2021-03-10T13:35:46.245 INFO:root:teuthology version: 1.1.0-b6eecfe8 2021-03-10T13:35:46.249 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_sage@teuthology --description rados:cephadm:upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-start-upgrade 4-wait fixed-2 mon_election/classic} --name sage-2021-03-10_13:21:20-rados:cephadm:upgrade-wip-sage-testing-2021-03-09-1434-distro-basic-gibba --verbose --archive /home/teuthworker/archive/sage-2021-03-10_13:21:20-rados:cephadm:upgrade-wip-sage-testing-2021-03-09-1434-distro-basic-gibba/5953060 -- /home/teuthworker/archive/sage-2021-03-10_13:21:20-rados:cephadm:upgrade-wip-sage-testing-2021-03-09-1434-distro-basic-gibba/5953060/orig.config.yaml 2021-03-10T13:35:46.277 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-03-10T13:35:46.326 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/sage-2021-03-10_13:21:20-rados:cephadm:upgrade-wip-sage-testing-2021-03-09-1434-distro-basic-gibba/5953060 branch: wip-sage-testing-2021-03-09-1434 description: rados:cephadm:upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-start-upgrade 4-wait fixed-2 mon_election/classic} email: null first_in_suite: false job_id: '5953060' kernel: kdb: true sha1: distro last_in_suite: false machine_type: gibba name: sage-2021-03-10_13:21:20-rados:cephadm:upgrade-wip-sage-testing-2021-03-09-1434-distro-basic-gibba nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-sage-testing-2021-03-09-1434 ceph: conf: global: mon election default strategy: 1 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug filestore: 20 debug journal: 20 debug ms: 1 debug osd: 25 osd shutdown pgref assert: true log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: b26fc080937a021ce826cdc94d1adb52c064381a ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: sha1: b26fc080937a021ce826cdc94d1adb52c064381a workunit: branch: cephadm-rgw-simplification sha1: fd39f244c71b258f156a77730a6203886f27efb2 owner: scheduled_sage@teuthology priority: 75 repo: git://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - alertmanager.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - grafana.a - node-exporter.b sha1: b26fc080937a021ce826cdc94d1adb52c064381a sleep_before_teardown: 0 suite: rados:cephadm:upgrade suite_branch: cephadm-rgw-simplification suite_path: /home/teuthworker/src/github.com_liewegas_ceph_fd39f244c71b258f156a77730a6203886f27efb2/qa suite_relpath: qa suite_repo: https://github.com/liewegas/ceph suite_sha1: fd39f244c71b258f156a77730a6203886f27efb2 targets: gibba015.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCfqdBXPIXlq4vf+cvOfY2ub3ydR7alrtilgIrsI1tlYqomisj3YgAbpEZ94CcpZ1HS0ETgstgwIGve+BoJ4rKJlrx1rMQc/bfZLWZdnV0PqgLbyyrFxaLztXac57e5FdbpocFXLDbEZkc2kxERmKpnSLu0QwD/KYIqzgDIlLws9k/l/1tfjxO9zth7nOf77FLdttolTL49Q2KxUiLnJNpSEHcAEIF4fZlMHErfNR/a6lEo3vJZvuyYEjbktQ4usmRzd3kYTiEIfDrY5K/9FAyCHhcSSVbCRZpjt2YdjS+2UApier7KH2xgnklFrmJIWODv3mBPuzWuJUe8fDXPGD9kIGCh0veN3rUsELv0YAmAum0J0n47nA+s01/Ez5aEW0yAFurCL9jqLvqpkxbq0uStAa2jC71ICWlQPT8C5VB8+MhCaVr7uSjwG0FDua6Wt2QUTMBGJsckb09//kMhiCUeGrfQZN6X2CTq5M5xP+sp0DStoFCkm32fDtJJH5fvzus= gibba045.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrEq2tAlnoMYu3lAE23vM3lzZBPdbEFRlZXZCdEB6Elqzkmy4ZWYrZgF2RHrazMDnYdx88VXi736c+za/cA2Z3fM/Ub3x370l0tIlSEVnjva5pq6rgP72M4sEhCpkVq7nVezYsXkhdOhstDDK7AduKgAGkHr443ryKdAMMQ4vrYJmp/3xUA90eKPlvEttVlAes6MJx/pJV3c7B3mpt6N3dLYW/sx1DMa1UcR8yhtY2uSumir7NG7OjruTW8B7IYdkljNuySVynOzyZflui9Kke3Ybi6a+9gNQdOM1z3skJ8oWcMjec2iEqclATuloXR/uHkXs5uBWX4jDYrawk9mFC8Ca9P4M4/dvQWgjYUfESacu1KBdJqatli8Xg1BgyWJ80Guf1WC8sdCwVNvNtbRcHJwksL8dOeY0zpvGj349GpGXzKRQ6PL+qi6SgLcAsgRDZRzM+Xm9MwZqxjZEDgdy4O/6s4R6K1xvrAh8OPaDqbVIw/ROp7svaHYiLzokl6PU= tasks: - cephadm: allow_ptrace: false cephadm_branch: v15.2.0 cephadm_git_url: https://github.com/ceph/ceph image: docker.io/ceph/ceph:v15.2.0 - cephadm.shell: env: - sha1 mon.a: - radosgw-admin realm create --rgw-realm=r --default - radosgw-admin zonegroup create --rgw-zonegroup=default --master --default - radosgw-admin zone create --rgw-zonegroup=default --rgw-zone=z --master --default - radosgw-admin period update --rgw-realm=r --commit - ceph orch apply rgw r z --placement=1 - sleep 120 - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 mon.a: - while ceph orch upgrade status | jq '.in_progress' | grep true ; do ceph orch ps ; ceph versions ; sleep 30 ; done - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 teuthology_branch: master teuthology_sha1: b6eecfe89a4363750d696160843a096384b357a8 timestamp: 2021-03-10_13:21:20 tube: gibba user: sage verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.gibba.26181 2021-03-10T13:35:46.326 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_liewegas_ceph_fd39f244c71b258f156a77730a6203886f27efb2/qa; will attempt to use it 2021-03-10T13:35:46.337 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_liewegas_ceph_fd39f244c71b258f156a77730a6203886f27efb2/qa/tasks 2021-03-10T13:35:46.338 INFO:teuthology.run_tasks:Running task internal.check_packages... 2021-03-10T13:35:46.340 INFO:teuthology.task.internal:Checking packages... 2021-03-10T13:35:46.422 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'basic' and ceph hash 'b26fc080937a021ce826cdc94d1adb52c064381a' 2021-03-10T13:35:46.422 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-03-10T13:35:46.423 INFO:teuthology.packaging:ref: None 2021-03-10T13:35:46.423 INFO:teuthology.packaging:tag: None 2021-03-10T13:35:46.423 INFO:teuthology.packaging:branch: wip-sage-testing-2021-03-09-1434 2021-03-10T13:35:46.424 INFO:teuthology.packaging:sha1: b26fc080937a021ce826cdc94d1adb52c064381a 2021-03-10T13:35:46.424 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-sage-testing-2021-03-09-1434 2021-03-10T13:35:46.561 INFO:teuthology.task.internal:Found packages for ceph version 17.0.0-1749-gb26fc080-1focal 2021-03-10T13:35:46.561 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2021-03-10T13:35:46.569 INFO:teuthology.task.internal:no buildpackages task found 2021-03-10T13:35:46.569 INFO:teuthology.run_tasks:Running task internal.save_config... 2021-03-10T13:35:46.597 INFO:teuthology.task.internal:Saving configuration 2021-03-10T13:35:46.608 INFO:teuthology.run_tasks:Running task internal.check_lock... 2021-03-10T13:35:46.616 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-03-10T13:35:46.635 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-03-10 13:30:41.136012', 'description': '/home/teuthworker/archive/sage-2021-03-10_13:21:20-rados:cephadm:upgrade-wip-sage-testing-2021-03-09-1434-distro-basic-gibba/5953060', 'locked_by': 'scheduled_sage@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAINZGhGAql9O4LIfLesVfKFbQIWknlKIno9c8iqv/H9qA', 'os_version': '20.04', 'machine_type': 'gibba', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'gibba015.front.sepia.ceph.com'} 2021-03-10T13:35:46.651 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-03-10 13:30:41.135992', 'description': '/home/teuthworker/archive/sage-2021-03-10_13:21:20-rados:cephadm:upgrade-wip-sage-testing-2021-03-09-1434-distro-basic-gibba/5953060', 'locked_by': 'scheduled_sage@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKuOsCf/hXw6ll33m72dnaaqI5/0hC+sua/O5TGMqtEu', 'os_version': '20.04', 'machine_type': 'gibba', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'gibba045.front.sepia.ceph.com'} 2021-03-10T13:35:46.651 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2021-03-10T13:35:46.659 INFO:teuthology.task.internal:roles: ubuntu@gibba015.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a', 'alertmanager.a'] 2021-03-10T13:35:46.659 INFO:teuthology.task.internal:roles: ubuntu@gibba045.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b'] 2021-03-10T13:35:46.659 INFO:teuthology.run_tasks:Running task console_log... 2021-03-10T13:35:46.720 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe79824a598>, signals=[15]) 2021-03-10T13:35:46.722 INFO:teuthology.run_tasks:Running task internal.connect... 2021-03-10T13:35:46.732 INFO:teuthology.task.internal:Opening connections... 2021-03-10T13:35:46.732 DEBUG:teuthology.task.internal:connecting to ubuntu@gibba015.front.sepia.ceph.com 2021-03-10T13:35:46.735 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba015.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-03-10T13:35:46.770 DEBUG:teuthology.task.internal:connecting to ubuntu@gibba045.front.sepia.ceph.com 2021-03-10T13:35:46.771 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-03-10T13:35:46.805 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2021-03-10T13:35:46.815 DEBUG:teuthology.orchestra.run.gibba015:> uname -m 2021-03-10T13:35:46.819 INFO:teuthology.orchestra.run.gibba015.stdout:x86_64 2021-03-10T13:35:46.820 DEBUG:teuthology.orchestra.run.gibba015:> cat /etc/os-release 2021-03-10T13:35:46.823 INFO:teuthology.orchestra.run.gibba015.stdout:NAME="Ubuntu" 2021-03-10T13:35:46.824 INFO:teuthology.orchestra.run.gibba015.stdout:VERSION="20.04.2 LTS (Focal Fossa)" 2021-03-10T13:35:46.824 INFO:teuthology.orchestra.run.gibba015.stdout:ID=ubuntu 2021-03-10T13:35:46.824 INFO:teuthology.orchestra.run.gibba015.stdout:ID_LIKE=debian 2021-03-10T13:35:46.824 INFO:teuthology.orchestra.run.gibba015.stdout:PRETTY_NAME="Ubuntu 20.04.2 LTS" 2021-03-10T13:35:46.824 INFO:teuthology.orchestra.run.gibba015.stdout:VERSION_ID="20.04" 2021-03-10T13:35:46.825 INFO:teuthology.orchestra.run.gibba015.stdout:HOME_URL="https://www.ubuntu.com/" 2021-03-10T13:35:46.825 INFO:teuthology.orchestra.run.gibba015.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-03-10T13:35:46.825 INFO:teuthology.orchestra.run.gibba015.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-03-10T13:35:46.825 INFO:teuthology.orchestra.run.gibba015.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-03-10T13:35:46.826 INFO:teuthology.orchestra.run.gibba015.stdout:VERSION_CODENAME=focal 2021-03-10T13:35:46.826 INFO:teuthology.orchestra.run.gibba015.stdout:UBUNTU_CODENAME=focal 2021-03-10T13:35:46.827 INFO:teuthology.lock.ops:Updating gibba015.front.sepia.ceph.com on lock server 2021-03-10T13:35:46.842 DEBUG:teuthology.orchestra.run.gibba045:> uname -m 2021-03-10T13:35:46.894 INFO:teuthology.orchestra.run.gibba045.stdout:x86_64 2021-03-10T13:35:46.894 DEBUG:teuthology.orchestra.run.gibba045:> cat /etc/os-release 2021-03-10T13:35:46.942 INFO:teuthology.orchestra.run.gibba045.stdout:NAME="Ubuntu" 2021-03-10T13:35:46.943 INFO:teuthology.orchestra.run.gibba045.stdout:VERSION="20.04.2 LTS (Focal Fossa)" 2021-03-10T13:35:46.943 INFO:teuthology.orchestra.run.gibba045.stdout:ID=ubuntu 2021-03-10T13:35:46.943 INFO:teuthology.orchestra.run.gibba045.stdout:ID_LIKE=debian 2021-03-10T13:35:46.944 INFO:teuthology.orchestra.run.gibba045.stdout:PRETTY_NAME="Ubuntu 20.04.2 LTS" 2021-03-10T13:35:46.944 INFO:teuthology.orchestra.run.gibba045.stdout:VERSION_ID="20.04" 2021-03-10T13:35:46.944 INFO:teuthology.orchestra.run.gibba045.stdout:HOME_URL="https://www.ubuntu.com/" 2021-03-10T13:35:46.944 INFO:teuthology.orchestra.run.gibba045.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-03-10T13:35:46.944 INFO:teuthology.orchestra.run.gibba045.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-03-10T13:35:46.945 INFO:teuthology.orchestra.run.gibba045.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-03-10T13:35:46.945 INFO:teuthology.orchestra.run.gibba045.stdout:VERSION_CODENAME=focal 2021-03-10T13:35:46.945 INFO:teuthology.orchestra.run.gibba045.stdout:UBUNTU_CODENAME=focal 2021-03-10T13:35:46.945 INFO:teuthology.lock.ops:Updating gibba045.front.sepia.ceph.com on lock server 2021-03-10T13:35:46.961 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2021-03-10T13:35:46.973 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2021-03-10T13:35:46.985 INFO:teuthology.task.internal:Checking for old test directory... 2021-03-10T13:35:46.986 DEBUG:teuthology.orchestra.run.gibba015:> test '!' -e /home/ubuntu/cephtest 2021-03-10T13:35:46.990 DEBUG:teuthology.orchestra.run.gibba045:> test '!' -e /home/ubuntu/cephtest 2021-03-10T13:35:46.997 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2021-03-10T13:35:47.007 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2021-03-10T13:35:47.008 DEBUG:teuthology.orchestra.run.gibba015:> test -z $(ls -A /var/lib/ceph) 2021-03-10T13:35:47.010 DEBUG:teuthology.orchestra.run.gibba045:> test -z $(ls -A /var/lib/ceph) 2021-03-10T13:35:47.050 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2021-03-10T13:35:47.096 INFO:teuthology.run_tasks:Running task kernel... 2021-03-10T13:35:47.118 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.c': {'kdb': True, 'sha1': 'distro'}, 'mgr.y': {'kdb': True, 'sha1': 'distro'}, 'osd.0': {'kdb': True, 'sha1': 'distro'}, 'osd.1': {'kdb': True, 'sha1': 'distro'}, 'osd.2': {'kdb': True, 'sha1': 'distro'}, 'osd.3': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}, 'node-exporter.a': {'kdb': True, 'sha1': 'distro'}, 'alertmanager.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}, 'osd.4': {'kdb': True, 'sha1': 'distro'}, 'osd.5': {'kdb': True, 'sha1': 'distro'}, 'osd.6': {'kdb': True, 'sha1': 'distro'}, 'osd.7': {'kdb': True, 'sha1': 'distro'}, 'client.1': {'kdb': True, 'sha1': 'distro'}, 'prometheus.a': {'kdb': True, 'sha1': 'distro'}, 'grafana.a': {'kdb': True, 'sha1': 'distro'}, 'node-exporter.b': {'kdb': True, 'sha1': 'distro'}} 2021-03-10T13:35:47.119 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2021-03-10T13:35:47.119 DEBUG:teuthology.orchestra.run.gibba015:> uname -r 2021-03-10T13:35:47.128 INFO:teuthology.orchestra.run.gibba015.stdout:5.4.0-66-generic 2021-03-10T13:35:47.129 INFO:teuthology.task.kernel:Running kernel on gibba015: 5.4.0-66-generic 2021-03-10T13:35:47.129 DEBUG:teuthology.orchestra.run.gibba015:> sudo apt-get clean 2021-03-10T13:35:47.283 DEBUG:teuthology.orchestra.run.gibba015:> sudo apt-get update 2021-03-10T13:35:47.398 INFO:teuthology.orchestra.run.gibba015.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [109 kB] 2021-03-10T13:35:47.521 INFO:teuthology.orchestra.run.gibba015.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-03-10T13:35:47.601 INFO:teuthology.orchestra.run.gibba015.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2021-03-10T13:35:47.663 INFO:teuthology.orchestra.run.gibba015.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [527 kB] 2021-03-10T13:35:47.756 INFO:teuthology.orchestra.run.gibba015.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [199 kB] 2021-03-10T13:35:47.760 INFO:teuthology.orchestra.run.gibba015.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [113 kB] 2021-03-10T13:35:47.762 INFO:teuthology.orchestra.run.gibba015.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [7,208 B] 2021-03-10T13:35:47.762 INFO:teuthology.orchestra.run.gibba015.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [133 kB] 2021-03-10T13:35:47.765 INFO:teuthology.orchestra.run.gibba015.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [19.5 kB] 2021-03-10T13:35:47.766 INFO:teuthology.orchestra.run.gibba015.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [545 kB] 2021-03-10T13:35:47.781 INFO:teuthology.orchestra.run.gibba015.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [431 kB] 2021-03-10T13:35:47.788 INFO:teuthology.orchestra.run.gibba015.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [79.6 kB] 2021-03-10T13:35:47.790 INFO:teuthology.orchestra.run.gibba015.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [10.5 kB] 2021-03-10T13:35:47.948 INFO:teuthology.orchestra.run.gibba015.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-backports InRelease [101 kB] 2021-03-10T13:35:48.097 INFO:teuthology.orchestra.run.gibba015.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [844 kB] 2021-03-10T13:35:48.318 INFO:teuthology.orchestra.run.gibba015.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [436 kB] 2021-03-10T13:35:48.360 INFO:teuthology.orchestra.run.gibba015.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [202 kB] 2021-03-10T13:35:48.376 INFO:teuthology.orchestra.run.gibba015.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [12.8 kB] 2021-03-10T13:35:48.377 INFO:teuthology.orchestra.run.gibba015.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [156 kB] 2021-03-10T13:35:48.388 INFO:teuthology.orchestra.run.gibba015.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [23.3 kB] 2021-03-10T13:35:48.390 INFO:teuthology.orchestra.run.gibba015.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [749 kB] 2021-03-10T13:35:48.429 INFO:teuthology.orchestra.run.gibba015.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [558 kB] 2021-03-10T13:35:48.452 INFO:teuthology.orchestra.run.gibba015.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [157 kB] 2021-03-10T13:35:48.458 INFO:teuthology.orchestra.run.gibba015.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [16.2 kB] 2021-03-10T13:35:50.299 INFO:teuthology.orchestra.run.gibba015.stdout:Fetched 5,542 kB in 1s (4,420 kB/s) 2021-03-10T13:35:51.320 INFO:teuthology.orchestra.run.gibba015.stdout:Reading package lists... 2021-03-10T13:35:51.330 DEBUG:teuthology.orchestra.run.gibba015:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-03-10T13:35:51.366 INFO:teuthology.orchestra.run.gibba015.stdout:Reading package lists... 2021-03-10T13:35:51.458 INFO:teuthology.orchestra.run.gibba015.stdout:Building dependency tree... 2021-03-10T13:35:51.458 INFO:teuthology.orchestra.run.gibba015.stdout:Reading state information... 2021-03-10T13:35:51.502 INFO:teuthology.orchestra.run.gibba015.stderr:E: Unable to locate package linux-image-current-generic 2021-03-10T13:35:51.503 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-03-10T13:35:51.504 DEBUG:teuthology.orchestra.run.gibba015:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-03-10T13:35:51.538 INFO:teuthology.orchestra.run.gibba015.stdout:Reading package lists... 2021-03-10T13:35:51.630 INFO:teuthology.orchestra.run.gibba015.stdout:Building dependency tree... 2021-03-10T13:35:51.631 INFO:teuthology.orchestra.run.gibba015.stdout:Reading state information... 2021-03-10T13:35:51.717 INFO:teuthology.orchestra.run.gibba015.stdout:linux-image-generic is already the newest version (5.4.0.66.69). 2021-03-10T13:35:51.718 INFO:teuthology.orchestra.run.gibba015.stdout:linux-image-generic set to manually installed. 2021-03-10T13:35:51.718 INFO:teuthology.orchestra.run.gibba015.stdout:0 upgraded, 0 newly installed, 0 to remove and 9 not upgraded. 2021-03-10T13:35:51.719 DEBUG:teuthology.orchestra.run.gibba015:> dpkg -s linux-image-generic 2021-03-10T13:35:51.771 INFO:teuthology.orchestra.run.gibba015.stdout:Package: linux-image-generic 2021-03-10T13:35:51.771 INFO:teuthology.orchestra.run.gibba015.stdout:Status: install ok installed 2021-03-10T13:35:51.771 INFO:teuthology.orchestra.run.gibba015.stdout:Priority: optional 2021-03-10T13:35:51.772 INFO:teuthology.orchestra.run.gibba015.stdout:Section: kernel 2021-03-10T13:35:51.772 INFO:teuthology.orchestra.run.gibba015.stdout:Installed-Size: 18 2021-03-10T13:35:51.772 INFO:teuthology.orchestra.run.gibba015.stdout:Maintainer: Ubuntu Kernel Team 2021-03-10T13:35:51.772 INFO:teuthology.orchestra.run.gibba015.stdout:Architecture: amd64 2021-03-10T13:35:51.772 INFO:teuthology.orchestra.run.gibba015.stdout:Source: linux-meta 2021-03-10T13:35:51.773 INFO:teuthology.orchestra.run.gibba015.stdout:Version: 5.4.0.66.69 2021-03-10T13:35:51.773 INFO:teuthology.orchestra.run.gibba015.stdout:Provides: virtualbox-guest-modules (= 6.1.16-dfsg-6~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.6) 2021-03-10T13:35:51.773 INFO:teuthology.orchestra.run.gibba015.stdout:Depends: linux-image-5.4.0-66-generic, linux-modules-extra-5.4.0-66-generic, linux-firmware, intel-microcode, amd64-microcode 2021-03-10T13:35:51.773 INFO:teuthology.orchestra.run.gibba015.stdout:Recommends: thermald 2021-03-10T13:35:51.774 INFO:teuthology.orchestra.run.gibba015.stdout:Description: Generic Linux kernel image 2021-03-10T13:35:51.774 INFO:teuthology.orchestra.run.gibba015.stdout: This package will always depend on the latest generic kernel image 2021-03-10T13:35:51.774 INFO:teuthology.orchestra.run.gibba015.stdout: available. 2021-03-10T13:35:51.774 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2021-03-10T13:35:51.775 DEBUG:teuthology.orchestra.run.gibba045:> uname -r 2021-03-10T13:35:51.783 INFO:teuthology.orchestra.run.gibba045.stdout:5.4.0-66-generic 2021-03-10T13:35:51.784 INFO:teuthology.task.kernel:Running kernel on gibba045: 5.4.0-66-generic 2021-03-10T13:35:51.784 DEBUG:teuthology.orchestra.run.gibba045:> sudo apt-get clean 2021-03-10T13:35:51.877 DEBUG:teuthology.orchestra.run.gibba045:> sudo apt-get update 2021-03-10T13:35:52.122 INFO:teuthology.orchestra.run.gibba045.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2021-03-10T13:35:52.123 INFO:teuthology.orchestra.run.gibba045.stdout:Get:2 http://security.ubuntu.com/ubuntu focal-security InRelease [109 kB] 2021-03-10T13:35:52.170 INFO:teuthology.orchestra.run.gibba045.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2021-03-10T13:35:52.483 INFO:teuthology.orchestra.run.gibba045.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [199 kB] 2021-03-10T13:35:52.508 INFO:teuthology.orchestra.run.gibba045.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-backports InRelease [101 kB] 2021-03-10T13:35:52.625 INFO:teuthology.orchestra.run.gibba045.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [844 kB] 2021-03-10T13:35:52.696 INFO:teuthology.orchestra.run.gibba045.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [527 kB] 2021-03-10T13:35:52.823 INFO:teuthology.orchestra.run.gibba045.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [113 kB] 2021-03-10T13:35:52.826 INFO:teuthology.orchestra.run.gibba045.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [436 kB] 2021-03-10T13:35:52.842 INFO:teuthology.orchestra.run.gibba045.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [7,208 B] 2021-03-10T13:35:52.844 INFO:teuthology.orchestra.run.gibba045.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [133 kB] 2021-03-10T13:35:52.860 INFO:teuthology.orchestra.run.gibba045.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [19.5 kB] 2021-03-10T13:35:52.860 INFO:teuthology.orchestra.run.gibba045.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [431 kB] 2021-03-10T13:35:52.876 INFO:teuthology.orchestra.run.gibba045.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [202 kB] 2021-03-10T13:35:52.890 INFO:teuthology.orchestra.run.gibba045.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [12.8 kB] 2021-03-10T13:35:52.891 INFO:teuthology.orchestra.run.gibba045.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [156 kB] 2021-03-10T13:35:52.900 INFO:teuthology.orchestra.run.gibba045.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [545 kB] 2021-03-10T13:35:52.900 INFO:teuthology.orchestra.run.gibba045.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [23.3 kB] 2021-03-10T13:35:52.912 INFO:teuthology.orchestra.run.gibba045.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [558 kB] 2021-03-10T13:35:52.935 INFO:teuthology.orchestra.run.gibba045.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [749 kB] 2021-03-10T13:35:52.940 INFO:teuthology.orchestra.run.gibba045.stdout:Get:21 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [79.6 kB] 2021-03-10T13:35:52.944 INFO:teuthology.orchestra.run.gibba045.stdout:Get:22 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [10.5 kB] 2021-03-10T13:35:52.967 INFO:teuthology.orchestra.run.gibba045.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [157 kB] 2021-03-10T13:35:52.971 INFO:teuthology.orchestra.run.gibba045.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [16.2 kB] 2021-03-10T13:35:54.963 INFO:teuthology.orchestra.run.gibba045.stdout:Fetched 5,542 kB in 1s (4,064 kB/s) 2021-03-10T13:35:55.921 INFO:teuthology.orchestra.run.gibba045.stdout:Reading package lists... 2021-03-10T13:35:55.931 DEBUG:teuthology.orchestra.run.gibba045:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-03-10T13:35:55.966 INFO:teuthology.orchestra.run.gibba045.stdout:Reading package lists... 2021-03-10T13:35:56.060 INFO:teuthology.orchestra.run.gibba045.stdout:Building dependency tree... 2021-03-10T13:35:56.060 INFO:teuthology.orchestra.run.gibba045.stdout:Reading state information... 2021-03-10T13:35:56.102 INFO:teuthology.orchestra.run.gibba045.stderr:E: Unable to locate package linux-image-current-generic 2021-03-10T13:35:56.103 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-03-10T13:35:56.104 DEBUG:teuthology.orchestra.run.gibba045:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-03-10T13:35:56.139 INFO:teuthology.orchestra.run.gibba045.stdout:Reading package lists... 2021-03-10T13:35:56.233 INFO:teuthology.orchestra.run.gibba045.stdout:Building dependency tree... 2021-03-10T13:35:56.234 INFO:teuthology.orchestra.run.gibba045.stdout:Reading state information... 2021-03-10T13:35:56.320 INFO:teuthology.orchestra.run.gibba045.stdout:linux-image-generic is already the newest version (5.4.0.66.69). 2021-03-10T13:35:56.320 INFO:teuthology.orchestra.run.gibba045.stdout:linux-image-generic set to manually installed. 2021-03-10T13:35:56.320 INFO:teuthology.orchestra.run.gibba045.stdout:0 upgraded, 0 newly installed, 0 to remove and 9 not upgraded. 2021-03-10T13:35:56.321 DEBUG:teuthology.orchestra.run.gibba045:> dpkg -s linux-image-generic 2021-03-10T13:35:56.331 INFO:teuthology.orchestra.run.gibba045.stdout:Package: linux-image-generic 2021-03-10T13:35:56.331 INFO:teuthology.orchestra.run.gibba045.stdout:Status: install ok installed 2021-03-10T13:35:56.332 INFO:teuthology.orchestra.run.gibba045.stdout:Priority: optional 2021-03-10T13:35:56.332 INFO:teuthology.orchestra.run.gibba045.stdout:Section: kernel 2021-03-10T13:35:56.332 INFO:teuthology.orchestra.run.gibba045.stdout:Installed-Size: 18 2021-03-10T13:35:56.332 INFO:teuthology.orchestra.run.gibba045.stdout:Maintainer: Ubuntu Kernel Team 2021-03-10T13:35:56.333 INFO:teuthology.orchestra.run.gibba045.stdout:Architecture: amd64 2021-03-10T13:35:56.333 INFO:teuthology.orchestra.run.gibba045.stdout:Source: linux-meta 2021-03-10T13:35:56.333 INFO:teuthology.orchestra.run.gibba045.stdout:Version: 5.4.0.66.69 2021-03-10T13:35:56.333 INFO:teuthology.orchestra.run.gibba045.stdout:Provides: virtualbox-guest-modules (= 6.1.16-dfsg-6~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.6) 2021-03-10T13:35:56.333 INFO:teuthology.orchestra.run.gibba045.stdout:Depends: linux-image-5.4.0-66-generic, linux-modules-extra-5.4.0-66-generic, linux-firmware, intel-microcode, amd64-microcode 2021-03-10T13:35:56.334 INFO:teuthology.orchestra.run.gibba045.stdout:Recommends: thermald 2021-03-10T13:35:56.334 INFO:teuthology.orchestra.run.gibba045.stdout:Description: Generic Linux kernel image 2021-03-10T13:35:56.334 INFO:teuthology.orchestra.run.gibba045.stdout: This package will always depend on the latest generic kernel image 2021-03-10T13:35:56.334 INFO:teuthology.orchestra.run.gibba045.stdout: available. 2021-03-10T13:35:56.335 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2021-03-10T13:35:56.335 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2021-03-10T13:35:56.335 DEBUG:teuthology.orchestra.run.gibba015:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-03-10T13:35:56.359 INFO:teuthology.orchestra.run.gibba015.stdout:ttyS1 2021-03-10T13:35:56.383 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2021-03-10T13:35:56.383 DEBUG:teuthology.orchestra.run.gibba045:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-03-10T13:35:56.396 INFO:teuthology.orchestra.run.gibba045.stdout:ttyS1 2021-03-10T13:35:56.438 INFO:teuthology.run_tasks:Running task internal.base... 2021-03-10T13:35:56.449 INFO:teuthology.task.internal:Creating test directory... 2021-03-10T13:35:56.450 DEBUG:teuthology.orchestra.run.gibba015:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-03-10T13:35:56.453 DEBUG:teuthology.orchestra.run.gibba045:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-03-10T13:35:56.488 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2021-03-10T13:35:56.498 INFO:teuthology.run_tasks:Running task internal.archive... 2021-03-10T13:35:56.516 INFO:teuthology.task.internal:Creating archive directory... 2021-03-10T13:35:56.517 DEBUG:teuthology.orchestra.run.gibba015:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-03-10T13:35:56.519 DEBUG:teuthology.orchestra.run.gibba045:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-03-10T13:35:56.533 INFO:teuthology.run_tasks:Running task internal.coredump... 2021-03-10T13:35:56.544 INFO:teuthology.task.internal:Enabling coredump saving... 2021-03-10T13:35:56.544 DEBUG:teuthology.orchestra.run.gibba015:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-03-10T13:35:56.547 DEBUG:teuthology.orchestra.run.gibba045:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-03-10T13:35:56.568 INFO:teuthology.orchestra.run.gibba015.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-10T13:35:56.570 INFO:teuthology.orchestra.run.gibba015.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-10T13:35:56.573 INFO:teuthology.orchestra.run.gibba045.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-10T13:35:56.582 INFO:teuthology.orchestra.run.gibba045.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-10T13:35:56.583 INFO:teuthology.run_tasks:Running task internal.sudo... 2021-03-10T13:35:56.594 INFO:teuthology.task.internal:Configuring sudo... 2021-03-10T13:35:56.594 DEBUG:teuthology.orchestra.run.gibba015:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-03-10T13:35:56.597 DEBUG:teuthology.orchestra.run.gibba045:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-03-10T13:35:56.636 INFO:teuthology.run_tasks:Running task internal.syslog... 2021-03-10T13:35:56.648 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2021-03-10T13:35:56.649 DEBUG:teuthology.orchestra.run.gibba015:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-03-10T13:35:56.652 DEBUG:teuthology.orchestra.run.gibba045:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-03-10T13:35:56.659 DEBUG:teuthology.orchestra.run.gibba015:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-03-10T13:35:56.668 DEBUG:teuthology.orchestra.run.gibba015:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-03-10T13:35:56.677 DEBUG:teuthology.orchestra.run.gibba015:> set -ex 2021-03-10T13:35:56.678 DEBUG:teuthology.orchestra.run.gibba015:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-03-10T13:35:56.749 DEBUG:teuthology.orchestra.run.gibba045:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-03-10T13:35:56.758 DEBUG:teuthology.orchestra.run.gibba045:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-03-10T13:35:56.803 DEBUG:teuthology.orchestra.run.gibba045:> set -ex 2021-03-10T13:35:56.804 DEBUG:teuthology.orchestra.run.gibba045:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-03-10T13:35:56.820 DEBUG:teuthology.orchestra.run.gibba015:> sudo service rsyslog restart 2021-03-10T13:35:56.823 DEBUG:teuthology.orchestra.run.gibba045:> sudo service rsyslog restart 2021-03-10T13:35:56.873 INFO:teuthology.run_tasks:Running task internal.timer... 2021-03-10T13:35:56.886 INFO:teuthology.task.internal:Starting timer... 2021-03-10T13:35:56.886 INFO:teuthology.run_tasks:Running task pcp... 2021-03-10T13:35:56.920 INFO:teuthology.run_tasks:Running task selinux... 2021-03-10T13:35:56.936 DEBUG:teuthology.task.selinux:Excluding gibba015: OS 'ubuntu' does not support SELinux 2021-03-10T13:35:56.936 DEBUG:teuthology.task.selinux:Excluding gibba045: OS 'ubuntu' does not support SELinux 2021-03-10T13:35:56.937 DEBUG:teuthology.task.selinux:Getting current SELinux state 2021-03-10T13:35:56.937 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2021-03-10T13:35:56.937 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2021-03-10T13:35:56.938 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2021-03-10T13:35:56.955 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master was just updated or references a specific commit; assuming it is current 2021-03-10T13:35:56.956 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to origin/master 2021-03-10T13:35:57.278 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2021-03-10T13:35:57.282 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit gibba015.front.sepia.ceph.com,gibba045.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2021-03-10T13:35:57.786 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2021-03-10T13:35:59.277 INFO:teuthology.task.ansible.out:[WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2021-03-10T13:36:01.337 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2021-03-10T13:36:01.370 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:01 +0000 (0:00:00.058) 0:00:00.059 ******* 2021-03-10T13:36:01.381 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:01 +0000 (0:00:00.011) 0:00:00.070 ******* 2021-03-10T13:36:03.162 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2021-03-10T13:36:03.164 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Distribution Ubuntu 20.04 on host gibba015.front.sepia.ceph.com should use /usr/bin/python3, but is using /usr/bin/python for backward compatibility with prior Ansible releases. A future Ansible release will default to using the discovered platform python for this host. See https://docs.ansible.com/ansible/2.9/reference_appendices/inter preter_discovery.html for more information. This feature will be removed in version 2.12. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. ok: [gibba015.front.sepia.ceph.com] 2021-03-10T13:36:03.212 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:03 +0000 (0:00:01.830) 0:00:01.901 ******* 2021-03-10T13:36:03.345 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Distribution Ubuntu 20.04 on host gibba045.front.sepia.ceph.com should use /usr/bin/python3, but is using /usr/bin/python for backward compatibility with prior Ansible releases. A future Ansible release will default to using the discovered platform python for this host. See https://docs.ansible.com/ansible/2.9/reference_appendices/inter preter_discovery.html for more information. This feature will be removed in version 2.12. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. ok: [gibba045.front.sepia.ceph.com] 2021-03-10T13:36:03.393 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:03 +0000 (0:00:00.181) 0:00:02.082 ******* 2021-03-10T13:36:03.430 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2021-03-10T13:36:03.432 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-03-10T13:36:03.453 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:03 +0000 (0:00:00.059) 0:00:02.142 ******* 2021-03-10T13:36:03.500 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-03-10T13:36:03.524 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:03 +0000 (0:00:00.070) 0:00:02.213 ******* 2021-03-10T13:36:04.067 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2021-03-10T13:36:04.069 INFO:teuthology.task.ansible.out:changed: [gibba045.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} changed: [gibba015.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-03-10T13:36:04.092 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:04 +0000 (0:00:00.567) 0:00:02.780 ******* 2021-03-10T13:36:04.109 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:04 +0000 (0:00:00.017) 0:00:02.798 ******* 2021-03-10T13:36:04.394 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2021-03-10T13:36:04.396 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.053512", "end": "2021-03-10 13:36:04.712387", "rc": 0, "start": "2021-03-10 13:36:04.658875", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} 2021-03-10T13:36:04.419 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:04 +0000 (0:00:00.309) 0:00:03.108 ******* 2021-03-10T13:36:04.426 INFO:teuthology.task.ansible.out:changed: [gibba045.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.059021", "end": "2021-03-10 13:36:04.495562", "rc": 0, "start": "2021-03-10 13:36:04.436541", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} 2021-03-10T13:36:04.451 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:04 +0000 (0:00:00.032) 0:00:03.140 ******* 2021-03-10T13:36:04.622 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2021-03-10T13:36:04.624 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} ok: [gibba015.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-03-10T13:36:04.647 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:04 +0000 (0:00:00.195) 0:00:03.336 ******* 2021-03-10T13:36:04.666 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:04 +0000 (0:00:00.019) 0:00:03.355 ******* 2021-03-10T13:36:05.367 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2021-03-10T13:36:05.368 INFO:teuthology.task.ansible.out:changed: [gibba045.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1615383364.693674-27228-254448949013270/source", "state": "file", "uid": 0} changed: [gibba015.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1615383364.6764956-27223-167602295845991/source", "state": "file", "uid": 0} 2021-03-10T13:36:05.389 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:05 +0000 (0:00:00.723) 0:00:04.078 ******* 2021-03-10T13:36:05.408 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:05 +0000 (0:00:00.018) 0:00:04.097 ******* 2021-03-10T13:36:05.816 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2021-03-10T13:36:05.817 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4 2021-03-10T13:36:05.819 INFO:teuthology.task.ansible.out:r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-03-10T13:36:05.839 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4 2021-03-10T13:36:05.840 INFO:teuthology.task.ansible.out:r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-03-10T13:36:05.913 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2021-03-10T13:36:05.916 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-03-10T13:36:06.046 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:06 +0000 (0:00:00.637) 0:00:04.734 ******* 2021-03-10T13:36:06.064 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:06 +0000 (0:00:00.018) 0:00:04.753 ******* 2021-03-10T13:36:06.732 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [gibba015.front.sepia.ceph.com] 2021-03-10T13:36:06.743 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] 2021-03-10T13:36:06.803 INFO:teuthology.task.ansible.out:[WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2021-03-10T13:36:06.805 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:06 +0000 (0:00:00.739) 0:00:05.492 ******* 2021-03-10T13:36:06.825 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:06 +0000 (0:00:00.021) 0:00:05.514 ******* 2021-03-10T13:36:07.212 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2021-03-10T13:36:07.214 INFO:teuthology.task.ansible.out:changed: [gibba045.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.175535", "end": "2021-03-10 13:36:07.191101", "rc": 0, "start": "2021-03-10 13:36:07.015566", "stderr": "", "stderr_lines": [], "stdout": "c31004c4720a55ac12a95d66c32e64f592877604", "stdout_lines": ["c31004c4720a55ac12a95d66c32e64f592877604"]} 2021-03-10T13:36:07.235 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:07 +0000 (0:00:00.409) 0:00:05.924 ******* 2021-03-10T13:36:07.241 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.202109", "end": "2021-03-10 13:36:07.199577", "rc": 0, "start": "2021-03-10 13:36:06.997468", "stderr": "", "stderr_lines": [], "stdout": "c31004c4720a55ac12a95d66c32e64f592877604", "stdout_lines": ["c31004c4720a55ac12a95d66c32e64f592877604"]} 2021-03-10T13:36:07.266 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:07 +0000 (0:00:00.030) 0:00:05.954 ******* 2021-03-10T13:36:07.343 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2021-03-10T13:36:07.345 INFO:teuthology.task.ansible.out:changed: [gibba045.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.011676", "end": "2021-03-10 13:36:07.435363", "failed_when_result": false, "rc": 0, "start": "2021-03-10 13:36:07.423687", "stderr": "", "stderr_lines": [], "stdout": "df8946f08e870e2d2565b79099289ca48bd825f3", "stdout_lines": ["df8946f08e870e2d2565b79099289ca48bd825f3"]} 2021-03-10T13:36:07.371 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:07 +0000 (0:00:00.105) 0:00:06.060 ******* 2021-03-10T13:36:07.388 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.036172", "end": "2021-03-10 13:36:07.708194", "failed_when_result": false, "rc": 0, "start": "2021-03-10 13:36:07.672022", "stderr": "", "stderr_lines": [], "stdout": "df8946f08e870e2d2565b79099289ca48bd825f3", "stdout_lines": ["df8946f08e870e2d2565b79099289ca48bd825f3"]} 2021-03-10T13:36:07.412 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:07 +0000 (0:00:00.041) 0:00:06.101 ******* 2021-03-10T13:36:07.439 INFO:teuthology.task.ansible.out: TASK [Determine if we can skip users and pubkeys updates] ********************** 2021-03-10T13:36:07.441 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:07.462 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:07 +0000 (0:00:00.049) 0:00:06.151 ******* 2021-03-10T13:36:07.478 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:07.501 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:07 +0000 (0:00:00.038) 0:00:06.190 ******* 2021-03-10T13:36:07.517 INFO:teuthology.task.ansible.out: TASK [Merge extra_admin_users into managed_admin_users] ************************ 2021-03-10T13:36:07.518 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:07.540 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:07 +0000 (0:00:00.038) 0:00:06.229 ******* 2021-03-10T13:36:07.566 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:07.589 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:07 +0000 (0:00:00.048) 0:00:06.278 ******* 2021-03-10T13:36:07.605 INFO:teuthology.task.ansible.out: TASK [Remove managed_admin_users from managed_users] *************************** 2021-03-10T13:36:07.606 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:07.628 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:07 +0000 (0:00:00.038) 0:00:06.317 ******* 2021-03-10T13:36:07.654 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:07.677 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:07 +0000 (0:00:00.049) 0:00:06.366 ******* 2021-03-10T13:36:07.693 INFO:teuthology.task.ansible.out: TASK [Filter the managed_users list] ******************************************* 2021-03-10T13:36:07.695 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:07.717 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:07 +0000 (0:00:00.039) 0:00:06.406 ******* 2021-03-10T13:36:07.743 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:07.766 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:07 +0000 (0:00:00.048) 0:00:06.455 ******* 2021-03-10T13:36:07.781 INFO:teuthology.task.ansible.out: TASK [Filter the managed_admin_users list] ************************************* 2021-03-10T13:36:07.783 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:07.804 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:07 +0000 (0:00:00.038) 0:00:06.493 ******* 2021-03-10T13:36:07.831 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:07.853 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:07 +0000 (0:00:00.048) 0:00:06.542 ******* 2021-03-10T13:36:07.940 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2021-03-10T13:36:07.942 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-03-10T13:36:07.967 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:07 +0000 (0:00:00.113) 0:00:06.656 ******* 2021-03-10T13:36:07.994 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-03-10T13:36:08.017 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:08 +0000 (0:00:00.050) 0:00:06.706 ******* 2021-03-10T13:36:08.147 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** 2021-03-10T13:36:08.147 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-03-10T13:36:08.199 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-03-10T13:36:08.242 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-03-10T13:36:08.294 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-03-10T13:36:08.327 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-03-10T13:36:08.379 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-03-10T13:36:08.421 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-03-10T13:36:08.474 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-03-10T13:36:08.506 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-03-10T13:36:08.558 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-03-10T13:36:08.601 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-03-10T13:36:08.653 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-03-10T13:36:08.695 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-03-10T13:36:08.737 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-03-10T13:36:08.780 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-03-10T13:36:08.832 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-03-10T13:36:08.874 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-03-10T13:36:08.917 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-03-10T13:36:08.969 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-03-10T13:36:08.971 INFO:teuthology.task.ansible.out: 2021-03-10T13:36:09.013 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-03-10T13:36:09.055 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-03-10T13:36:09.098 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-03-10T13:36:09.151 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-03-10T13:36:09.193 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-03-10T13:36:09.235 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-03-10T13:36:09.277 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-03-10T13:36:09.330 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-03-10T13:36:09.372 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-03-10T13:36:09.415 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-03-10T13:36:09.457 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-03-10T13:36:09.510 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-03-10T13:36:09.552 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-03-10T13:36:09.605 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-03-10T13:36:09.637 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-03-10T13:36:09.689 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2021-03-10T13:36:09.721 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2021-03-10T13:36:09.783 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-03-10T13:36:09.815 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-03-10T13:36:09.868 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-03-10T13:36:09.900 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-03-10T13:36:09.952 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2021-03-10T13:36:09.984 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2021-03-10T13:36:10.037 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-03-10T13:36:10.080 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-03-10T13:36:10.132 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-03-10T13:36:10.164 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-03-10T13:36:10.217 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-03-10T13:36:10.259 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-03-10T13:36:10.302 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-03-10T13:36:10.345 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-03-10T13:36:10.397 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-03-10T13:36:10.429 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-03-10T13:36:10.482 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-03-10T13:36:10.524 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-03-10T13:36:10.577 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-03-10T13:36:10.619 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-03-10T13:36:10.662 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-03-10T13:36:10.704 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-03-10T13:36:10.757 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-03-10T13:36:10.789 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-03-10T13:36:10.842 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-03-10T13:36:10.873 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-03-10T13:36:10.926 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-03-10T13:36:10.958 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-03-10T13:36:11.021 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1133} 2021-03-10T13:36:11.053 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1133} 2021-03-10T13:36:11.116 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-03-10T13:36:11.148 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-03-10T13:36:11.201 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-03-10T13:36:11.233 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-03-10T13:36:11.296 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-03-10T13:36:11.318 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-03-10T13:36:11.391 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1137} 2021-03-10T13:36:11.412 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1137} 2021-03-10T13:36:11.475 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-03-10T13:36:11.496 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-03-10T13:36:11.569 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-03-10T13:36:11.581 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-03-10T13:36:11.654 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-03-10T13:36:11.676 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-03-10T13:36:11.749 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-03-10T13:36:11.761 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-03-10T13:36:11.844 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-03-10T13:36:11.855 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-03-10T13:36:11.929 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-03-10T13:36:11.940 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-03-10T13:36:12.023 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-03-10T13:36:12.034 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-03-10T13:36:12.107 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-03-10T13:36:12.119 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-03-10T13:36:12.192 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-03-10T13:36:12.203 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-03-10T13:36:12.287 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-03-10T13:36:12.298 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-03-10T13:36:12.372 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-03-10T13:36:12.383 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-03-10T13:36:12.457 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-03-10T13:36:12.468 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-03-10T13:36:12.541 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-03-10T13:36:12.563 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-03-10T13:36:12.626 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-03-10T13:36:12.648 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-03-10T13:36:12.721 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-03-10T13:36:12.733 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-03-10T13:36:12.816 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-03-10T13:36:12.827 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-03-10T13:36:12.900 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-03-10T13:36:12.922 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-03-10T13:36:12.985 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-03-10T13:36:13.007 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-03-10T13:36:13.080 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-03-10T13:36:13.091 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-03-10T13:36:13.175 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-03-10T13:36:13.197 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-03-10T13:36:13.270 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-03-10T13:36:13.292 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-03-10T13:36:13.354 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-03-10T13:36:13.376 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-03-10T13:36:13.449 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-03-10T13:36:13.460 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-03-10T13:36:13.543 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-03-10T13:36:13.555 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-03-10T13:36:13.628 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-03-10T13:36:13.639 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-03-10T13:36:13.712 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-03-10T13:36:13.734 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-03-10T13:36:13.807 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-03-10T13:36:13.818 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-03-10T13:36:13.902 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-03-10T13:36:13.913 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-03-10T13:36:13.987 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-03-10T13:36:13.998 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-03-10T13:36:14.081 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-03-10T13:36:14.093 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-03-10T13:36:14.166 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-03-10T13:36:14.188 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-03-10T13:36:14.251 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-03-10T13:36:14.272 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-03-10T13:36:14.345 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-03-10T13:36:14.357 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-03-10T13:36:14.430 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-03-10T13:36:14.441 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-03-10T13:36:14.515 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-03-10T13:36:14.536 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-03-10T13:36:14.599 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-03-10T13:36:14.620 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-03-10T13:36:14.704 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-03-10T13:36:14.716 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-03-10T13:36:14.789 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-03-10T13:36:14.811 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-03-10T13:36:14.874 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-03-10T13:36:14.895 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-03-10T13:36:14.969 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-03-10T13:36:14.980 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-03-10T13:36:15.053 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-03-10T13:36:15.065 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-03-10T13:36:15.152 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-03-10T13:36:15.194 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-03-10T13:36:15.236 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-03-10T13:36:15.288 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-03-10T13:36:15.320 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-03-10T13:36:15.383 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-03-10T13:36:15.414 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-03-10T13:36:15.467 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-03-10T13:36:15.499 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-03-10T13:36:15.552 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-03-10T13:36:15.584 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-03-10T13:36:15.636 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-03-10T13:36:15.679 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1184} 2021-03-10T13:36:15.732 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1184} 2021-03-10T13:36:15.774 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1185} 2021-03-10T13:36:15.827 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1185} 2021-03-10T13:36:15.859 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-03-10T13:36:15.922 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-03-10T13:36:15.954 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-03-10T13:36:16.007 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-03-10T13:36:16.039 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-03-10T13:36:16.102 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-03-10T13:36:16.134 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-03-10T13:36:16.197 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-03-10T13:36:16.219 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-03-10T13:36:16.312 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-03-10T13:36:16.313 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-03-10T13:36:16.397 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-03-10T13:36:16.408 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-03-10T13:36:16.492 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-03-10T13:36:16.493 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-03-10T13:36:16.577 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-03-10T13:36:16.588 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-03-10T13:36:16.661 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-03-10T13:36:16.673 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-03-10T13:36:16.756 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-03-10T13:36:16.767 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-03-10T13:36:16.841 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-03-10T13:36:16.852 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-03-10T13:36:16.926 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-03-10T13:36:16.947 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-03-10T13:36:17.021 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-03-10T13:36:17.032 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-03-10T13:36:17.106 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-03-10T13:36:17.127 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-03-10T13:36:17.190 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-03-10T13:36:17.223 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-03-10T13:36:17.286 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-03-10T13:36:17.318 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-03-10T13:36:17.380 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-03-10T13:36:17.402 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-03-10T13:36:17.465 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-03-10T13:36:17.497 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-03-10T13:36:17.560 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-03-10T13:36:17.581 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-03-10T13:36:17.644 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-03-10T13:36:17.666 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-03-10T13:36:17.729 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-03-10T13:36:17.760 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-03-10T13:36:17.823 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-03-10T13:36:17.844 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-03-10T13:36:17.907 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-03-10T13:36:17.939 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-03-10T13:36:18.002 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-03-10T13:36:18.023 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-03-10T13:36:18.086 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-03-10T13:36:18.118 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-03-10T13:36:18.181 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-03-10T13:36:18.202 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-03-10T13:36:18.265 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-03-10T13:36:18.296 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-03-10T13:36:18.359 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-03-10T13:36:18.381 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-03-10T13:36:18.444 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-03-10T13:36:18.476 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-03-10T13:36:18.538 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-03-10T13:36:18.560 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-03-10T13:36:18.623 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-03-10T13:36:18.644 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-03-10T13:36:18.707 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-03-10T13:36:18.739 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-03-10T13:36:18.802 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-03-10T13:36:18.823 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-03-10T13:36:18.886 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-03-10T13:36:18.946 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-03-10T13:36:18.981 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-03-10T13:36:19.003 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-03-10T13:36:19.066 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-03-10T13:36:19.098 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-03-10T13:36:19.160 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-03-10T13:36:19.182 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-03-10T13:36:19.255 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-03-10T13:36:19.267 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-03-10T13:36:19.340 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-03-10T13:36:19.361 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-03-10T13:36:19.434 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-03-10T13:36:19.456 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-03-10T13:36:19.529 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-03-10T13:36:19.540 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-03-10T13:36:19.624 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-03-10T13:36:19.635 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-03-10T13:36:19.708 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-03-10T13:36:19.730 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-03-10T13:36:19.802 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-03-10T13:36:19.814 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-03-10T13:36:19.908 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-03-10T13:36:20.002 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1231, "groups": "sudo", "home": "/home/hmunjulu", "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "move_home": false, "name": "hmunjulu", "shell": "/bin/bash", "state": "present", "uid": 1231} 2021-03-10T13:36:20.013 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-03-10T13:36:20.086 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-03-10T13:36:20.098 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-03-10T13:36:20.182 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-03-10T13:36:20.194 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1231, "groups": "sudo", "home": "/home/hmunjulu", "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "move_home": false, "name": "hmunjulu", "shell": "/bin/bash", "state": "present", "uid": 1231} 2021-03-10T13:36:20.277 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-03-10T13:36:20.360 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-03-10T13:36:20.392 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-03-10T13:36:20.455 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-03-10T13:36:20.497 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-03-10T13:36:20.539 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-03-10T13:36:20.581 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@thinkpad 5H//Tz6a0uBQDJiYlp9bIA 5ad4213c5f177c9d3586e58770208dd3e18f57d78f12d5d1a9dfa541d5c5c957\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@thinkpad 5H//Tz6a0uBQDJiYlp9bIA 5ad4213c5f177c9d3586e58770208dd3e18f57d78f12d5d1a9dfa541d5c5c957\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-03-10T13:36:20.623 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@thinkpad 5H//Tz6a0uBQDJiYlp9bIA 5ad4213c5f177c9d3586e58770208dd3e18f57d78f12d5d1a9dfa541d5c5c957\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@thinkpad 5H//Tz6a0uBQDJiYlp9bIA 5ad4213c5f177c9d3586e58770208dd3e18f57d78f12d5d1a9dfa541d5c5c957\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-03-10T13:36:20.676 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-03-10T13:36:20.853 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-03-10T13:36:20.937 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:20 +0000 (0:00:12.919) 0:00:19.626 ******* 2021-03-10T13:36:20.956 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:20 +0000 (0:00:00.019) 0:00:19.645 ******* 2021-03-10T13:36:20.996 INFO:teuthology.task.ansible.out: TASK [Create all users without sudo access.] *********************************** 2021-03-10T13:36:21.017 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:21 +0000 (0:00:00.061) 0:00:19.706 ******* 2021-03-10T13:36:21.046 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:21 +0000 (0:00:00.028) 0:00:19.735 ******* 2021-03-10T13:36:21.093 INFO:teuthology.task.ansible.out: TASK [Merge managed_users and managed_admin users] ***************************** 2021-03-10T13:36:21.095 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@fedora r 2021-03-10T13:36:21.097 INFO:teuthology.task.ansible.out:T6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c 2021-03-10T13:36:21.098 INFO:teuthology.task.ansible.out:63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD 2021-03-10T13:36:21.100 INFO:teuthology.task.ansible.out:0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9d 2021-03-10T13:36:21.102 INFO:teuthology.task.ansible.out:f7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5m 2021-03-10T13:36:21.102 INFO:teuthology.task.ansible.out:Rahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 2021-03-10T13:36:21.104 INFO:teuthology.task.ansible.out:4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953 2021-03-10T13:36:21.105 INFO:teuthology.task.ansible.out:cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7 2021-03-10T13:36:21.107 INFO:teuthology.task.ansible.out:cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef148 2021-03-10T13:36:21.109 INFO:teuthology.task.ansible.out:0c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017 2021-03-10T13:36:21.110 INFO:teuthology.task.ansible.out:b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArN 2021-03-10T13:36:21.111 INFO:teuthology.task.ansible.out:hsAMXq/nkSC9tKDig 131b8214b 2021-03-10T13:36:21.112 INFO:teuthology.task.ansible.out:bea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez 2021-03-10T13:36:21.114 INFO:teuthology.task.ansible.out:@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed1 2021-03-10T13:36:21.116 INFO:teuthology.task.ansible.out:9b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@thinkpad 5H//Tz6a0uBQDJiYlp9bIA 5ad4213c5f177c9d3586e58770208dd3e18f57d78f12d5d1a9dfa541d5c5c957\n"}, {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}]}, "changed": false} 2021-03-10T13:36:21.137 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:21 +0000 (0:00:00.091) 0:00:19.826 ******* 2021-03-10T13:36:21.146 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@fedora r 2021-03-10T13:36:21.148 INFO:teuthology.task.ansible.out:T6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c 2021-03-10T13:36:21.149 INFO:teuthology.task.ansible.out:63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD 2021-03-10T13:36:21.151 INFO:teuthology.task.ansible.out:0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9d 2021-03-10T13:36:21.152 INFO:teuthology.task.ansible.out:f7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name" 2021-03-10T13:36:21.153 INFO:teuthology.task.ansible.out:: "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 2021-03-10T13:36:21.154 INFO:teuthology.task.ansible.out:4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953 2021-03-10T13:36:21.156 INFO:teuthology.task.ansible.out:cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7 2021-03-10T13:36:21.157 INFO:teuthology.task.ansible.out:cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef148 2021-03-10T13:36:21.159 INFO:teuthology.task.ansible.out:0c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017 2021-03-10T13:36:21.161 INFO:teuthology.task.ansible.out:b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214b 2021-03-10T13:36:21.162 INFO:teuthology.task.ansible.out:bea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez 2021-03-10T13:36:21.164 INFO:teuthology.task.ansible.out:@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed1 2021-03-10T13:36:21.165 INFO:teuthology.task.ansible.out:9b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe 2021-03-10T13:36:21.166 INFO:teuthology.task.ansible.out:16d6b872450fe0"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@thinkpad 5H//Tz6a0uBQDJiYlp9bIA 5ad4213c5f177c9d3586e58770208dd3e18f57d78f12d5d1a9dfa541d5c5c957\n"}, {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}]}, "changed": false} 2021-03-10T13:36:21.193 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:21 +0000 (0:00:00.055) 0:00:19.882 ******* 2021-03-10T13:36:21.797 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2021-03-10T13:36:21.799 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"after": "c31004c4720a55ac12a95d66c32e64f592877604", "attempts": 1, "before": "c31004c4720a55ac12a95d66c32e64f592877604", "changed": false, "remote_url_changed": false} 2021-03-10T13:36:21.819 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:21 +0000 (0:00:00.626) 0:00:20.508 ******* 2021-03-10T13:36:21.826 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => {"after": "c31004c4720a55ac12a95d66c32e64f592877604", "attempts": 1, "before": "c31004c4720a55ac12a95d66c32e64f592877604", "changed": false, "remote_url_changed": false} 2021-03-10T13:36:21.850 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:21 +0000 (0:00:00.030) 0:00:20.539 ******* 2021-03-10T13:36:22.043 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-10T13:36:22.044 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-03-10T13:36:22.085 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-03-10T13:36:22.138 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-03-10T13:36:22.204 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-03-10T13:36:22.267 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-03-10T13:36:22.310 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-03-10T13:36:22.373 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZt 2021-03-10T13:36:22.374 INFO:teuthology.task.ansible.out:IEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-03-10T13:36:22.415 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZt 2021-03-10T13:36:22.416 INFO:teuthology.task.ansible.out:IEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-03-10T13:36:22.488 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-03-10T13:36:22.561 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-03-10T13:36:22.603 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o 2021-03-10T13:36:22.605 INFO:teuthology.task.ansible.out:8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-03-10T13:36:22.676 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o 2021-03-10T13:36:22.678 INFO:teuthology.task.ansible.out:8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-03-10T13:36:22.708 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-03-10T13:36:22.781 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-03-10T13:36:22.813 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-03-10T13:36:22.896 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-03-10T13:36:22.918 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-03-10T13:36:22.929 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:23.013 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-03-10T13:36:23.023 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:23.034 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMorb 2021-03-10T13:36:23.036 INFO:teuthology.task.ansible.out:nuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-03-10T13:36:23.128 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMorb 2021-03-10T13:36:23.129 INFO:teuthology.task.ansible.out:nuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-03-10T13:36:23.149 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemers 2021-03-10T13:36:23.151 INFO:teuthology.task.ansible.out:on", "validate_certs": true} skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:23.160 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:23.233 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemers 2021-03-10T13:36:23.235 INFO:teuthology.task.ansible.out:on", "validate_certs": true} 2021-03-10T13:36:23.244 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:23.245 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:23.266 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-03-10T13:36:23.338 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-03-10T13:36:23.391 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtSo 2021-03-10T13:36:23.392 INFO:teuthology.task.ansible.out:AWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-03-10T13:36:23.443 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtSo 2021-03-10T13:36:23.445 INFO:teuthology.task.ansible.out:AWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-03-10T13:36:23.486 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-03-10T13:36:23.538 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-03-10T13:36:23.601 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": n 2021-03-10T13:36:23.603 INFO:teuthology.task.ansible.out:ull, "state": "present", "user": "davidz", "validate_certs": true} 2021-03-10T13:36:23.632 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": n 2021-03-10T13:36:23.634 INFO:teuthology.task.ansible.out:ull, "state": "present", "user": "davidz", "validate_certs": true} 2021-03-10T13:36:23.695 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-03-10T13:36:23.717 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-03-10T13:36:23.810 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-03-10T13:36:23.811 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-03-10T13:36:23.894 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2021-03-10T13:36:23.905 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2021-03-10T13:36:23.988 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9C 2021-03-10T13:36:23.990 INFO:teuthology.task.ansible.out:kxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-03-10T13:36:23.999 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9C 2021-03-10T13:36:24.001 INFO:teuthology.task.ansible.out:kxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-03-10T13:36:24.083 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBYB 2021-03-10T13:36:24.084 INFO:teuthology.task.ansible.out:0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-03-10T13:36:24.094 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBYB 2021-03-10T13:36:24.096 INFO:teuthology.task.ansible.out:0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-03-10T13:36:24.188 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-03-10T13:36:24.209 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-03-10T13:36:24.282 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-03-10T13:36:24.303 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-03-10T13:36:24.366 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46T 2021-03-10T13:36:24.368 INFO:teuthology.task.ansible.out:RJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-03-10T13:36:24.388 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46T 2021-03-10T13:36:24.390 INFO:teuthology.task.ansible.out:RJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-03-10T13:36:24.462 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-03-10T13:36:24.473 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-03-10T13:36:24.557 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-03-10T13:36:24.558 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-03-10T13:36:24.652 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-03-10T13:36:24.654 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-03-10T13:36:24.746 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-03-10T13:36:24.748 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-03-10T13:36:24.841 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-03-10T13:36:24.843 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-03-10T13:36:24.926 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQvU 2021-03-10T13:36:24.928 INFO:teuthology.task.ansible.out:xUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-03-10T13:36:24.937 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQvU 2021-03-10T13:36:24.939 INFO:teuthology.task.ansible.out:xUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-03-10T13:36:25.021 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2021-03-10T13:36:25.032 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2021-03-10T13:36:25.116 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-03-10T13:36:25.127 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-03-10T13:36:25.211 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-03-10T13:36:25.212 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-03-10T13:36:25.295 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-03-10T13:36:25.306 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-03-10T13:36:25.379 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2021-03-10T13:36:25.390 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2021-03-10T13:36:25.473 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-03-10T13:36:25.515 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-03-10T13:36:25.557 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-03-10T13:36:25.609 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-03-10T13:36:25.652 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-03-10T13:36:25.694 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-03-10T13:36:25.747 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-03-10T13:36:25.789 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-03-10T13:36:25.831 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1O 2021-03-10T13:36:25.833 INFO:teuthology.task.ansible.out:MJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-03-10T13:36:25.884 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1O 2021-03-10T13:36:25.886 INFO:teuthology.task.ansible.out:MJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-03-10T13:36:25.916 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyKz 2021-03-10T13:36:25.917 INFO:teuthology.task.ansible.out:2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-03-10T13:36:25.969 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyKz 2021-03-10T13:36:25.970 INFO:teuthology.task.ansible.out:2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-03-10T13:36:26.011 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-03-10T13:36:26.064 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-03-10T13:36:26.106 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-03-10T13:36:26.169 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-03-10T13:36:26.201 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-03-10T13:36:26.276 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-03-10T13:36:26.307 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": nul 2021-03-10T13:36:26.309 INFO:teuthology.task.ansible.out:l, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-03-10T13:36:26.370 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": nul 2021-03-10T13:36:26.372 INFO:teuthology.task.ansible.out:l, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-03-10T13:36:26.413 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjEf 2021-03-10T13:36:26.415 INFO:teuthology.task.ansible.out:dVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+dT 2021-03-10T13:36:26.416 INFO:teuthology.task.ansible.out:zNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-03-10T13:36:26.466 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjEf 2021-03-10T13:36:26.468 INFO:teuthology.task.ansible.out:dVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+dT 2021-03-10T13:36:26.469 INFO:teuthology.task.ansible.out:zNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-03-10T13:36:26.508 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-03-10T13:36:26.581 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-03-10T13:36:26.603 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-03-10T13:36:26.676 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-03-10T13:36:26.697 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-03-10T13:36:26.760 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-03-10T13:36:26.802 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-03-10T13:36:26.854 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-03-10T13:36:26.896 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-03-10T13:36:26.948 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-03-10T13:36:27.001 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home/ 2021-03-10T13:36:27.003 INFO:teuthology.task.ansible.out:nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-03-10T13:36:27.043 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home/ 2021-03-10T13:36:27.044 INFO:teuthology.task.ansible.out:nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-03-10T13:36:27.085 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-03-10T13:36:27.137 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-03-10T13:36:27.169 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-03-10T13:36:27.232 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-03-10T13:36:27.264 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "g 2021-03-10T13:36:27.266 INFO:teuthology.task.ansible.out:abrioux", "validate_certs": true} 2021-03-10T13:36:27.337 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "g 2021-03-10T13:36:27.339 INFO:teuthology.task.ansible.out:abrioux", "validate_certs": true} 2021-03-10T13:36:27.359 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-03-10T13:36:27.432 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-03-10T13:36:27.454 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-03-10T13:36:27.527 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-03-10T13:36:27.548 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kkk 2021-03-10T13:36:27.550 INFO:teuthology.task.ansible.out:e6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-03-10T13:36:27.621 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kkk 2021-03-10T13:36:27.623 INFO:teuthology.task.ansible.out:e6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-03-10T13:36:27.642 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-03-10T13:36:27.715 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-03-10T13:36:27.726 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-03-10T13:36:27.809 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-03-10T13:36:27.820 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-03-10T13:36:27.903 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-03-10T13:36:27.905 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-03-10T13:36:27.997 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-03-10T13:36:27.999 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-03-10T13:36:28.081 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-03-10T13:36:28.092 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-03-10T13:36:28.175 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-03-10T13:36:28.186 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-03-10T13:36:28.260 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-03-10T13:36:28.271 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-03-10T13:36:28.354 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-03-10T13:36:28.366 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-03-10T13:36:28.449 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-03-10T13:36:28.460 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-03-10T13:36:28.533 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-03-10T13:36:28.544 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-03-10T13:36:28.627 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-03-10T13:36:28.629 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-03-10T13:36:28.721 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-03-10T13:36:28.722 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-03-10T13:36:28.807 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-03-10T13:36:28.807 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-03-10T13:36:28.890 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-03-10T13:36:28.901 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-03-10T13:36:28.995 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-03-10T13:36:28.996 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-03-10T13:36:29.100 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-03-10T13:36:29.111 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-03-10T13:36:29.206 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-03-10T13:36:29.229 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-03-10T13:36:29.312 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-03-10T13:36:29.314 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-03-10T13:36:29.406 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-03-10T13:36:29.408 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-03-10T13:36:29.500 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-03-10T13:36:29.511 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1l 2021-03-10T13:36:29.513 INFO:teuthology.task.ansible.out:XTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-03-10T13:36:29.595 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-03-10T13:36:29.606 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1l 2021-03-10T13:36:29.608 INFO:teuthology.task.ansible.out:XTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-03-10T13:36:29.689 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-03-10T13:36:29.691 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-03-10T13:36:29.783 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-03-10T13:36:29.794 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-03-10T13:36:29.878 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2021-03-10T13:36:29.888 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-03-10T13:36:29.982 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2021-03-10T13:36:30.014 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.localdo 2021-03-10T13:36:30.016 INFO:teuthology.task.ansible.out:main", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2021-03-10T13:36:30.077 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.localdo 2021-03-10T13:36:30.078 INFO:teuthology.task.ansible.out:main", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2021-03-10T13:36:30.098 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq2 2021-03-10T13:36:30.100 INFO:teuthology.task.ansible.out:z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-03-10T13:36:30.171 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq2 2021-03-10T13:36:30.173 INFO:teuthology.task.ansible.out:z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-03-10T13:36:30.193 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-03-10T13:36:30.267 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-03-10T13:36:30.288 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-03-10T13:36:30.361 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-03-10T13:36:30.403 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-03-10T13:36:30.455 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-03-10T13:36:30.487 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-03-10T13:36:30.560 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-03-10T13:36:30.582 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-03-10T13:36:30.655 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-03-10T13:36:30.676 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-03-10T13:36:30.739 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-03-10T13:36:30.771 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-03-10T13:36:30.834 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-03-10T13:36:30.865 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loca 2021-03-10T13:36:30.867 INFO:teuthology.task.ansible.out:l", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-03-10T13:36:30.918 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loca 2021-03-10T13:36:30.920 INFO:teuthology.task.ansible.out:l", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-03-10T13:36:30.949 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-03-10T13:36:31.022 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-03-10T13:36:31.044 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-03-10T13:36:31.117 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-03-10T13:36:31.128 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-03-10T13:36:31.212 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-03-10T13:36:31.223 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-03-10T13:36:31.296 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-03-10T13:36:31.307 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-03-10T13:36:31.390 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-03-10T13:36:31.402 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-03-10T13:36:31.485 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-03-10T13:36:31.496 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", " 2021-03-10T13:36:31.497 INFO:teuthology.task.ansible.out:manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-03-10T13:36:31.569 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", " 2021-03-10T13:36:31.570 INFO:teuthology.task.ansible.out:manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-03-10T13:36:31.580 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-03-10T13:36:31.653 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-03-10T13:36:31.664 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-03-10T13:36:31.747 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-03-10T13:36:31.758 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-03-10T13:36:31.841 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-03-10T13:36:31.842 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-03-10T13:36:31.925 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-03-10T13:36:31.937 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-03-10T13:36:32.020 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-03-10T13:36:32.021 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-03-10T13:36:32.104 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-03-10T13:36:32.115 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-03-10T13:36:32.198 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-03-10T13:36:32.199 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-03-10T13:36:32.283 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-03-10T13:36:32.294 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-03-10T13:36:32.377 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-03-10T13:36:32.378 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-03-10T13:36:32.461 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-03-10T13:36:32.472 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-03-10T13:36:32.555 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-03-10T13:36:32.566 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-03-10T13:36:32.650 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-03-10T13:36:32.661 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-03-10T13:36:32.734 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-03-10T13:36:32.745 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-03-10T13:36:32.828 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-03-10T13:36:32.839 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-03-10T13:36:32.922 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-03-10T13:36:32.933 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-03-10T13:36:33.006 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-03-10T13:36:33.017 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-03-10T13:36:33.090 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-03-10T13:36:33.111 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-03-10T13:36:33.195 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjLd 2021-03-10T13:36:33.197 INFO:teuthology.task.ansible.out:+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-03-10T13:36:33.206 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-03-10T13:36:33.310 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjLd 2021-03-10T13:36:33.312 INFO:teuthology.task.ansible.out:+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-03-10T13:36:33.321 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-03-10T13:36:33.415 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-03-10T13:36:33.436 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-03-10T13:36:33.509 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-03-10T13:36:33.520 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-03-10T13:36:33.593 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-03-10T13:36:33.614 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-03-10T13:36:33.688 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-03-10T13:36:33.699 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-03-10T13:36:33.782 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-03-10T13:36:33.793 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-03-10T13:36:33.877 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-03-10T13:36:33.879 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-03-10T13:36:33.971 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-03-10T13:36:33.973 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-03-10T13:36:34.065 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-03-10T13:36:34.068 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-03-10T13:36:34.160 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-03-10T13:36:34.161 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-03-10T13:36:34.245 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-03-10T13:36:34.256 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-03-10T13:36:34.349 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-03-10T13:36:34.360 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQKiUAlB8dxudAY60M7jnIJvs9yb2pNaT+BVv1Vk1kMs0XjPjcw9cyT3DtQ1xGLF367phRi/cfQbXOYbHG+uyBzQ4EEnBFvziktWRx4mfeWYxKjkjbfkVfpKPsxztqCbwm6+NYzMxGK2cExN7jUHnghHAjfA0IUpVVg9peBD3kUveLwS+UxuJAnuj+G4480LS6GDyLrhFEXU7uOIIlW4S9oLnU6vJL6GAzwyLE4ijTA8Ek03SJ01Ey/gpU9AqnQNp9u12l/7sJely6sI9pAuIzmS8Ht324hexxSWN5sFjXgLvLfFK83ziDBdrFBr0WXnWsFdRpHs2CwSq1JTkByqbN hmunjulu@hmunjulu.remote.csb", "key_options": null, "keyfile": "/home/hmunjulu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hmunjulu", "validate_certs": true} 2021-03-10T13:36:34.433 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQKiUAlB8dxudAY60M7jnIJvs9yb2pNaT+BVv1Vk1kMs0XjPjcw9cyT3DtQ1xGLF367phRi/cfQbXOYbHG+uyBzQ4EEnBFvziktWRx4mfeWYxKjkjbfkVfpKPsxztqCbwm6+NYzMxGK2cExN7jUHnghHAjfA0IUpVVg9peBD3kUveLwS+UxuJAnuj+G4480LS6GDyLrhFEXU7uOIIlW4S9oLnU6vJL6GAzwyLE4ijTA8Ek03SJ01Ey/gpU9AqnQNp9u12l/7sJely6sI9pAuIzmS8Ht324hexxSWN5sFjXgLvLfFK83ziDBdrFBr0WXnWsFdRpHs2CwSq1JTkByqbN hmunjulu@hmunjulu.remote.csb", "key_options": null, "keyfile": "/home/hmunjulu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hmunjulu", "validate_certs": true} 2021-03-10T13:36:34.455 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-03-10T13:36:34.539 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-03-10T13:36:34.540 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev", "key_options": null, "keyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-03-10T13:36:34.623 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev", "key_options": null, "keyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-03-10T13:36:34.634 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-03-10T13:36:34.717 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-03-10T13:36:34.769 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-03-10T13:36:34.801 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-03-10T13:36:34.864 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@thinkpad 5H//Tz6a0uBQDJiYlp9bIA 5ad4213c5f177c9d3586e58770208dd3e18f57d78f12d5d1a9dfa541d5c5c957\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@thinkpad 5H//Tz6a0uBQDJiYlp9bIA 5ad4213c5f177c9d3586e58770208dd3e18f57d78f12d5d1a9dfa541d5c5c957\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", "key_options": 2021-03-10T13:36:34.866 INFO:teuthology.task.ansible.out: null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-03-10T13:36:34.906 INFO:teuthology.task.ansible.out:changed: [gibba045.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@thinkpad 5H//Tz6a0uBQDJiYlp9bIA 5ad4213c5f177c9d3586e58770208dd3e18f57d78f12d5d1a9dfa541d5c5c957\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@thinkpad 5H//Tz6a0uBQDJiYlp9bIA 5ad4213c5f177c9d3586e58770208dd3e18f57d78f12d5d1a9dfa541d5c5c957\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", "key_options": 2021-03-10T13:36:34.908 INFO:teuthology.task.ansible.out: null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-03-10T13:36:34.958 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDr6H7hmtGCUrO3GppgMHwbmA4XT/Vipz/uLG/N8h6ZxtaLQKpCefRpdKcFlOdDwxkTmT5q9vmXQ8nl95lTGq+eeMxl4ho104ZD9e9AIYmgYqFy7/qNP8gkqduIPlypLL9m5rElTcGd7zqfMqgljMvAmnXLtZNJlIuFtszVU5WPI1QCwfQ3t5aHF6j66bpVoN9uWItVGB1LApQz9TtViWsQ9Hl8X4YauJToO+TkuSX+H/OGH7ZC6CPOzNZb3b3vF/jLMnTzXl86PJs1se4DjKkRGLVCVbr2WhLwQeZ8TEn3Hg1Gn5X8zNM5cTo6U8SnXBAe9ZYbuyfvghrNLdlZpmN+8l0/l5zC3z+N+sEzklXwHw4MQLF+KSloVFd9NN/kyenufTZAyp8VxllZ9TgdC+CPORIWyzmu1elOtYo7LNuE6CIh/Zm9B54SO6hVHhVoOCqe/dIyjeHJA0WKIZblK1XZEvWuu0E2T3jhxfe1GICyTukeB8WoBQH9DZ1yzMPt59E= nia@redhat.com", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-03-10T13:36:35.021 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDr6H7hmtGCUrO3GppgMHwbmA4XT/Vipz/uLG/N8h6ZxtaLQKpCefRpdKcFlOdDwxkTmT5q9vmXQ8nl95lTGq+eeMxl4ho104ZD9e9AIYmgYqFy7/qNP8gkqduIPlypLL9m5rElTcGd7zqfMqgljMvAmnXLtZNJlIuFtszVU5WPI1QCwfQ3t5aHF6j66bpVoN9uWItVGB1LApQz9TtViWsQ9Hl8X4YauJToO+TkuSX+H/OGH7ZC6CPOzNZb3b3vF/jLMnTzXl86PJs1se4DjKkRGLVCVbr2WhLwQeZ8TEn3Hg1Gn5X8zNM5cTo6U8SnXBAe9ZYbuyfvghrNLdlZpmN+8l0/l5zC3z+N+sEzklXwHw4MQLF+KSloVFd9NN/kyenufTZAyp8VxllZ9TgdC+CPORIWyzmu1elOtYo7LNuE6CIh/Zm9B54SO6hVHhVoOCqe/dIyjeHJA0WKIZblK1XZEvWuu0E2T3jhxfe1GICyTukeB8WoBQH9DZ1yzMPt59E= nia@redhat.com", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-03-10T13:36:35.087 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:35 +0000 (0:00:13.236) 0:00:33.776 ******* 2021-03-10T13:36:35.109 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:35 +0000 (0:00:00.021) 0:00:33.798 ******* 2021-03-10T13:36:35.180 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-03-10T13:36:35.182 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.192 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.193 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.203 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.205 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.206 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.216 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.218 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.219 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.220 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c 2021-03-10T13:36:35.222 INFO:teuthology.task.ansible.out:518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.231 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.233 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.244 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.244 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.328 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2021-03-10T13:36:35.339 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.340 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2021-03-10T13:36:35.341 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.352 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.353 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.446 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-03-10T13:36:35.448 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-03-10T13:36:35.531 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2021-03-10T13:36:35.533 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2021-03-10T13:36:35.543 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.544 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.554 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.556 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb63 2021-03-10T13:36:35.557 INFO:teuthology.task.ansible.out:37037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.567 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.569 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.579 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.580 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\ 2021-03-10T13:36:35.582 INFO:teuthology.task.ansible.out:nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.591 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.592 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96ac 2021-03-10T13:36:35.594 INFO:teuthology.task.ansible.out:f22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.603 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.605 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.615 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.617 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.627 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.629 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.639 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.641 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e 2021-03-10T13:36:35.643 INFO:teuthology.task.ansible.out:0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.652 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.653 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.663 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.665 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.675 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.677 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.687 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.689 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.699 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.701 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.712 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.713 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nva 2021-03-10T13:36:35.715 INFO:teuthology.task.ansible.out:su@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.724 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.725 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.736 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.737 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.748 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.750 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.760 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.760 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.761 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.761 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.772 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.774 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.784 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.785 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.796 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.798 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.808 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.810 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.820 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.821 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.821 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.822 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.832 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.834 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.844 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.846 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.857 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.858 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.869 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.870 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.881 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.882 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.893 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.895 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.904 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.906 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.917 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.918 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.929 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.930 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.941 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.942 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.953 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.955 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.965 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.967 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.978 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.979 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.989 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:35.991 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:36.002 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:36.003 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:36.013 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:36.015 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:36.025 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:36.027 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "skip_reason": "Conditional result was False"} skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:36.038 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:36.039 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:36.050 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:36.051 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:36.062 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:36.063 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:36.064 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:36.074 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:36.076 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:36.087 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:36.088 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:36.098 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:36.100 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:36.111 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:36.112 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:36.123 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:36.124 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:36.135 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:36.137 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:36.147 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:36.149 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:36.159 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:36.161 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:36.172 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:36.174 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:36.183 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:36.185 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:36.185 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:36.196 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:36.198 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:36.208 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:36.210 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:36.220 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:36.222 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:36.232 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:36.233 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:36.234 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:36.245 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:36.246 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:36.256 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:36.258 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:36.269 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:36.270 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:36.280 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:36.282 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:36.292 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:36.294 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:36.305 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:36.306 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:36.316 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:36.318 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:36.329 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:36.330 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@thinkpad 5H//Tz6a0uBQDJiYlp9bIA 5ad4213c5f177c9d3586e58770208dd3e18f57d78f12d5d1a9dfa541d5c5c957\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@thinkpad 5H//Tz6a0uBQDJiYlp9bIA 5ad4213c5f177c9d3586e58770208dd3e18f57d78f12d5d1a9dfa541d5c5c957\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:36.341 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@thinkpad 5H//Tz6a0uBQDJiYlp9bIA 5ad4213c5f177c9d3586e58770208dd3e18f57d78f12d5d1a9dfa541d5c5c957\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@thinkpad 5H//Tz6a0uBQDJiYlp9bIA 5ad4213c5f177c9d3586e58770208dd3e18f57d78f12d5d1a9dfa541d5c5c957\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:36.343 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:36.360 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:36.398 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:36 +0000 (0:00:01.289) 0:00:35.087 ******* 2021-03-10T13:36:36.419 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:36 +0000 (0:00:00.020) 0:00:35.108 ******* 2021-03-10T13:36:36.468 INFO:teuthology.task.ansible.out: TASK [Filter the revoked_users list] ******************************************* 2021-03-10T13:36:36.470 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:36.492 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:36 +0000 (0:00:00.072) 0:00:35.181 ******* 2021-03-10T13:36:36.498 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:36.525 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:36 +0000 (0:00:00.033) 0:00:35.214 ******* 2021-03-10T13:36:36.656 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-10T13:36:36.658 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-03-10T13:36:36.689 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-03-10T13:36:36.741 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-03-10T13:36:36.784 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-03-10T13:36:36.836 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-03-10T13:36:36.878 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-03-10T13:36:36.920 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-03-10T13:36:36.962 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-03-10T13:36:37.015 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-03-10T13:36:37.046 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-03-10T13:36:37.109 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-03-10T13:36:37.141 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-03-10T13:36:37.236 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-03-10T13:36:37.247 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-03-10T13:36:37.332 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-03-10T13:36:37.374 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-03-10T13:36:37.416 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-03-10T13:36:37.459 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-03-10T13:36:37.553 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-03-10T13:36:37.564 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-03-10T13:36:37.658 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-03-10T13:36:37.659 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-03-10T13:36:37.743 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-03-10T13:36:37.754 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-03-10T13:36:37.838 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-03-10T13:36:37.850 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-03-10T13:36:37.933 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-03-10T13:36:37.945 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-03-10T13:36:38.018 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-03-10T13:36:38.040 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-03-10T13:36:38.113 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-03-10T13:36:38.135 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-03-10T13:36:38.197 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-03-10T13:36:38.219 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-03-10T13:36:38.302 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-03-10T13:36:38.314 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-03-10T13:36:38.409 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-03-10T13:36:38.442 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-03-10T13:36:38.494 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-03-10T13:36:38.537 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-03-10T13:36:38.579 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-03-10T13:36:38.631 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-03-10T13:36:38.674 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2021-03-10T13:36:38.726 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2021-03-10T13:36:38.769 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-03-10T13:36:38.821 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-03-10T13:36:38.853 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-03-10T13:36:38.906 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-03-10T13:36:38.948 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-03-10T13:36:39.001 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-03-10T13:36:39.043 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-03-10T13:36:39.086 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-03-10T13:36:39.128 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-03-10T13:36:39.170 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-03-10T13:36:39.212 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-03-10T13:36:39.265 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-03-10T13:36:39.308 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-03-10T13:36:39.360 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-03-10T13:36:39.392 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-03-10T13:36:39.444 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-03-10T13:36:39.487 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-03-10T13:36:39.550 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-03-10T13:36:39.571 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-03-10T13:36:39.634 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-03-10T13:36:39.666 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-03-10T13:36:39.719 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-03-10T13:36:39.761 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-03-10T13:36:39.813 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-03-10T13:36:39.845 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-03-10T13:36:39.908 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-03-10T13:36:39.929 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-03-10T13:36:40.002 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-03-10T13:36:40.024 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-03-10T13:36:40.097 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-03-10T13:36:40.119 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-03-10T13:36:40.182 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-03-10T13:36:40.203 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-03-10T13:36:40.266 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-03-10T13:36:40.288 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-03-10T13:36:40.361 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-03-10T13:36:40.383 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-03-10T13:36:40.445 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-03-10T13:36:40.477 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-03-10T13:36:40.530 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-03-10T13:36:40.561 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-03-10T13:36:40.624 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-03-10T13:36:40.656 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-03-10T13:36:40.719 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-03-10T13:36:40.740 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-03-10T13:36:40.803 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-03-10T13:36:40.825 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-03-10T13:36:40.898 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-03-10T13:36:40.920 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-03-10T13:36:40.982 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-03-10T13:36:41.004 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-03-10T13:36:41.077 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-03-10T13:36:41.099 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-03-10T13:36:41.142 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:41 +0000 (0:00:04.616) 0:00:39.831 ******* 2021-03-10T13:36:41.169 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-03-10T13:36:41.222 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:41 +0000 (0:00:00.080) 0:00:39.911 ******* 2021-03-10T13:36:41.455 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-03-10T13:36:41.457 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => {"changed": true, "checksum": "1d9711ff879c231c67cb70d00ca0088797a377d0", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "80a55def4b505d08aff3687f81f74dc2", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1615383401.2240095-29133-220904640190732/source", "state": "file", "uid": 0} 2021-03-10T13:36:41.482 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:41 +0000 (0:00:00.260) 0:00:40.171 ******* 2021-03-10T13:36:41.530 INFO:teuthology.task.ansible.out:changed: [gibba045.front.sepia.ceph.com] => {"changed": true, "checksum": "1d9711ff879c231c67cb70d00ca0088797a377d0", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "80a55def4b505d08aff3687f81f74dc2", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1615383401.304351-29154-84486353968381/source", "state": "file", "uid": 0} 2021-03-10T13:36:41.554 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:41 +0000 (0:00:00.072) 0:00:40.243 ******* 2021-03-10T13:36:41.560 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2021-03-10T13:36:41.562 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => { "msg": "Host gibba015.front.sepia.ceph.com is running Ubuntu 20.04 (focal)" } 2021-03-10T13:36:41.589 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:41 +0000 (0:00:00.033) 0:00:40.277 ******* 2021-03-10T13:36:41.617 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => { "msg": "Host gibba045.front.sepia.ceph.com is running Ubuntu 20.04 (focal)" } 2021-03-10T13:36:41.641 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:41 +0000 (0:00:00.052) 0:00:40.330 ******* 2021-03-10T13:36:41.668 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2021-03-10T13:36:41.670 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2021-03-10T13:36:41.693 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:41 +0000 (0:00:00.052) 0:00:40.382 ******* 2021-03-10T13:36:41.721 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2021-03-10T13:36:41.746 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:41 +0000 (0:00:00.052) 0:00:40.435 ******* 2021-03-10T13:36:41.762 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2021-03-10T13:36:41.764 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:41.787 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:41 +0000 (0:00:00.040) 0:00:40.476 ******* 2021-03-10T13:36:41.814 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:41.837 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:41 +0000 (0:00:00.050) 0:00:40.526 ******* 2021-03-10T13:36:41.853 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2021-03-10T13:36:41.855 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:41.878 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:41 +0000 (0:00:00.040) 0:00:40.567 ******* 2021-03-10T13:36:41.904 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:41.928 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:41 +0000 (0:00:00.050) 0:00:40.617 ******* 2021-03-10T13:36:41.955 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2021-03-10T13:36:41.956 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:41.982 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:41 +0000 (0:00:00.053) 0:00:40.671 ******* 2021-03-10T13:36:41.999 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:42.027 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:42 +0000 (0:00:00.044) 0:00:40.715 ******* 2021-03-10T13:36:42.054 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2021-03-10T13:36:42.055 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:42.077 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:42 +0000 (0:00:00.050) 0:00:40.766 ******* 2021-03-10T13:36:42.094 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:42.118 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:42 +0000 (0:00:00.040) 0:00:40.807 ******* 2021-03-10T13:36:42.144 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2021-03-10T13:36:42.146 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:42.169 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:42 +0000 (0:00:00.050) 0:00:40.858 ******* 2021-03-10T13:36:42.185 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:42.209 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:42 +0000 (0:00:00.040) 0:00:40.898 ******* 2021-03-10T13:36:42.236 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2021-03-10T13:36:42.238 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:42.260 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:42 +0000 (0:00:00.051) 0:00:40.949 ******* 2021-03-10T13:36:42.277 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:42.301 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:42 +0000 (0:00:00.041) 0:00:40.990 ******* 2021-03-10T13:36:42.328 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2021-03-10T13:36:42.330 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:42.353 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:42 +0000 (0:00:00.051) 0:00:41.042 ******* 2021-03-10T13:36:42.371 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:42.395 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:42 +0000 (0:00:00.041) 0:00:41.084 ******* 2021-03-10T13:36:42.422 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2021-03-10T13:36:42.424 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:42.446 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:42 +0000 (0:00:00.051) 0:00:41.135 ******* 2021-03-10T13:36:42.463 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:42.487 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:42 +0000 (0:00:00.040) 0:00:41.176 ******* 2021-03-10T13:36:42.514 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2021-03-10T13:36:42.516 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [gibba015.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-10T13:36:42.539 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:42 +0000 (0:00:00.051) 0:00:41.227 ******* 2021-03-10T13:36:42.555 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-10T13:36:42.557 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-10T13:36:42.583 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:42 +0000 (0:00:00.044) 0:00:41.272 ******* 2021-03-10T13:36:42.610 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2021-03-10T13:36:42.611 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:42.635 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:42 +0000 (0:00:00.052) 0:00:41.324 ******* 2021-03-10T13:36:42.652 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:42.677 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:42 +0000 (0:00:00.041) 0:00:41.366 ******* 2021-03-10T13:36:42.694 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2021-03-10T13:36:42.695 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:42.718 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:42 +0000 (0:00:00.041) 0:00:41.407 ******* 2021-03-10T13:36:42.746 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:42.770 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:42 +0000 (0:00:00.051) 0:00:41.459 ******* 2021-03-10T13:36:42.786 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2021-03-10T13:36:42.788 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-10T13:36:42.811 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:42 +0000 (0:00:00.040) 0:00:41.500 ******* 2021-03-10T13:36:42.839 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-10T13:36:42.863 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:42 +0000 (0:00:00.052) 0:00:41.552 ******* 2021-03-10T13:36:42.890 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2021-03-10T13:36:42.892 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:42.915 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:42 +0000 (0:00:00.051) 0:00:41.604 ******* 2021-03-10T13:36:42.932 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:42.956 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:42 +0000 (0:00:00.041) 0:00:41.645 ******* 2021-03-10T13:36:42.983 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2021-03-10T13:36:42.984 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-10T13:36:43.007 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:43 +0000 (0:00:00.050) 0:00:41.696 ******* 2021-03-10T13:36:43.023 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-10T13:36:43.048 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:43 +0000 (0:00:00.040) 0:00:41.737 ******* 2021-03-10T13:36:43.074 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2021-03-10T13:36:43.076 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:43.099 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:43 +0000 (0:00:00.050) 0:00:41.787 ******* 2021-03-10T13:36:43.116 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:43.144 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:43 +0000 (0:00:00.044) 0:00:41.832 ******* 2021-03-10T13:36:43.170 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2021-03-10T13:36:43.172 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:43.194 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:43 +0000 (0:00:00.050) 0:00:41.883 ******* 2021-03-10T13:36:43.211 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:43.235 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:43 +0000 (0:00:00.040) 0:00:41.924 ******* 2021-03-10T13:36:43.262 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2021-03-10T13:36:43.263 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:43.286 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:43 +0000 (0:00:00.050) 0:00:41.975 ******* 2021-03-10T13:36:43.303 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:43.327 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:43 +0000 (0:00:00.041) 0:00:42.016 ******* 2021-03-10T13:36:43.359 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2021-03-10T13:36:43.361 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:43.383 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:43 +0000 (0:00:00.056) 0:00:42.072 ******* 2021-03-10T13:36:43.401 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:43.425 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:43 +0000 (0:00:00.041) 0:00:42.114 ******* 2021-03-10T13:36:43.451 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2021-03-10T13:36:43.453 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-10T13:36:43.476 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:43 +0000 (0:00:00.050) 0:00:42.165 ******* 2021-03-10T13:36:43.493 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-10T13:36:43.516 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:43 +0000 (0:00:00.040) 0:00:42.205 ******* 2021-03-10T13:36:43.543 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-03-10T13:36:43.544 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:43.565 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:43 +0000 (0:00:00.049) 0:00:42.254 ******* 2021-03-10T13:36:43.592 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:43.614 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:43 +0000 (0:00:00.048) 0:00:42.303 ******* 2021-03-10T13:36:43.630 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2021-03-10T13:36:43.632 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:43.653 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:43 +0000 (0:00:00.038) 0:00:42.342 ******* 2021-03-10T13:36:43.680 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:43.706 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:43 +0000 (0:00:00.052) 0:00:42.395 ******* 2021-03-10T13:36:43.722 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2021-03-10T13:36:43.723 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:43.745 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:43 +0000 (0:00:00.039) 0:00:42.434 ******* 2021-03-10T13:36:43.772 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:43.796 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:43 +0000 (0:00:00.050) 0:00:42.485 ******* 2021-03-10T13:36:43.811 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2021-03-10T13:36:43.813 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:43.835 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:43 +0000 (0:00:00.039) 0:00:42.524 ******* 2021-03-10T13:36:43.852 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:43.875 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:43 +0000 (0:00:00.040) 0:00:42.564 ******* 2021-03-10T13:36:43.902 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2021-03-10T13:36:43.903 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:43.925 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:43 +0000 (0:00:00.050) 0:00:42.614 ******* 2021-03-10T13:36:43.942 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:43.965 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:43 +0000 (0:00:00.040) 0:00:42.654 ******* 2021-03-10T13:36:43.991 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2021-03-10T13:36:43.993 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:44.015 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:44 +0000 (0:00:00.049) 0:00:42.704 ******* 2021-03-10T13:36:44.031 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:44.054 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:44 +0000 (0:00:00.039) 0:00:42.743 ******* 2021-03-10T13:36:44.080 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2021-03-10T13:36:44.081 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-10T13:36:44.103 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:44 +0000 (0:00:00.048) 0:00:42.792 ******* 2021-03-10T13:36:44.119 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-10T13:36:44.142 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:44 +0000 (0:00:00.038) 0:00:42.831 ******* 2021-03-10T13:36:44.167 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2021-03-10T13:36:44.168 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:44.189 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:44 +0000 (0:00:00.047) 0:00:42.878 ******* 2021-03-10T13:36:44.206 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:44.232 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:44 +0000 (0:00:00.042) 0:00:42.921 ******* 2021-03-10T13:36:44.259 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2021-03-10T13:36:44.261 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:44.282 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:44 +0000 (0:00:00.049) 0:00:42.971 ******* 2021-03-10T13:36:44.298 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:44.322 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:44 +0000 (0:00:00.039) 0:00:43.011 ******* 2021-03-10T13:36:44.348 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2021-03-10T13:36:44.349 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:44.371 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:44 +0000 (0:00:00.049) 0:00:43.060 ******* 2021-03-10T13:36:44.387 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:44.411 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:44 +0000 (0:00:00.039) 0:00:43.100 ******* 2021-03-10T13:36:44.447 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-03-10T13:36:44.449 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:44.472 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:44 +0000 (0:00:00.061) 0:00:43.161 ******* 2021-03-10T13:36:44.488 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:44.489 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:44.523 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:44 +0000 (0:00:00.050) 0:00:43.212 ******* 2021-03-10T13:36:44.538 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-03-10T13:36:44.540 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} 2021-03-10T13:36:44.550 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-03-10T13:36:44.573 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:44 +0000 (0:00:00.049) 0:00:43.262 ******* 2021-03-10T13:36:44.599 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} 2021-03-10T13:36:44.601 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-03-10T13:36:44.623 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:44 +0000 (0:00:00.050) 0:00:43.312 ******* 2021-03-10T13:36:44.639 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-03-10T13:36:44.641 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:44.663 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:44 +0000 (0:00:00.039) 0:00:43.352 ******* 2021-03-10T13:36:44.689 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:44.712 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:44 +0000 (0:00:00.048) 0:00:43.401 ******* 2021-03-10T13:36:44.811 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-03-10T13:36:44.812 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.009668", "end": "2021-03-10 13:36:45.127127", "rc": 0, "start": "2021-03-10 13:36:45.117459", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-03-10T13:36:44.834 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:44 +0000 (0:00:00.121) 0:00:43.522 ******* 2021-03-10T13:36:44.871 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.012024", "end": "2021-03-10 13:36:44.968263", "rc": 0, "start": "2021-03-10 13:36:44.956239", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-03-10T13:36:44.896 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:44 +0000 (0:00:00.062) 0:00:43.585 ******* 2021-03-10T13:36:44.902 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2021-03-10T13:36:44.903 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:44.926 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:44 +0000 (0:00:00.029) 0:00:43.615 ******* 2021-03-10T13:36:44.953 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:44.976 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:44 +0000 (0:00:00.050) 0:00:43.665 ******* 2021-03-10T13:36:44.992 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2021-03-10T13:36:44.994 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:45.016 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:45 +0000 (0:00:00.039) 0:00:43.705 ******* 2021-03-10T13:36:45.043 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:45.066 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:45 +0000 (0:00:00.049) 0:00:43.755 ******* 2021-03-10T13:36:45.733 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-03-10T13:36:45.735 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "name": "sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "sleep.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit sleep.target is masked.\"", "LoadState": "masked", "Names": "sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} ok: [gibba045.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "name": "sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "sleep.target", "FailureAction": "none", "FragmentPath" 2021-03-10T13:36:45.737 INFO:teuthology.task.ansible.out:: "/dev/null", "Id": "sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit sleep.target is masked.\"", "LoadState": "masked", "Names": "sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-03-10T13:36:45.849 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "name": "suspend.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "suspend.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "suspend.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit suspend.target is masked.\"", "LoadState": "masked", "Names": "suspend.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-03-10T13:36:45.851 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "name": "suspend.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "suspend.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "suspend.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit suspend.target is masked.\"", "LoadState": "masked", "Names": "suspend.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-03-10T13:36:45.965 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "name": "hibernate.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hibernate.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "hibernate.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hibernate.target is masked.\"", "LoadState": "masked", "Names": "hibernate.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-03-10T13:36:45.966 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "name": "hibernate.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hibernate.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "hibernate.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hibernate.target is masked.\"", "LoadState": "masked", "Names": "hibernate.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-03-10T13:36:46.070 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "name": "hybrid-sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hybrid-sleep.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "hybrid-sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hybrid-sleep.target is masked.\"", "LoadState": "masked", "Names": "hybrid-sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-03-10T13:36:46.084 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "name": "hybrid-sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hybrid-sleep.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "hybrid-sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hybrid-sleep.target is masked.\"", "LoadState": "masked", "Names": "hybrid-sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-03-10T13:36:46.108 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:46 +0000 (0:00:01.042) 0:00:44.797 ******* 2021-03-10T13:36:46.128 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:46 +0000 (0:00:00.019) 0:00:44.816 ******* 2021-03-10T13:36:46.175 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-03-10T13:36:46.177 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:46.197 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:46 +0000 (0:00:00.069) 0:00:44.886 ******* 2021-03-10T13:36:46.203 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:46.230 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:46 +0000 (0:00:00.032) 0:00:44.919 ******* 2021-03-10T13:36:46.267 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2021-03-10T13:36:46.268 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:46.290 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:46 +0000 (0:00:00.060) 0:00:44.979 ******* 2021-03-10T13:36:46.297 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:46.322 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:46 +0000 (0:00:00.031) 0:00:45.011 ******* 2021-03-10T13:36:46.348 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2021-03-10T13:36:46.350 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:46.372 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:46 +0000 (0:00:00.049) 0:00:45.061 ******* 2021-03-10T13:36:46.387 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:46.410 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:46 +0000 (0:00:00.038) 0:00:45.099 ******* 2021-03-10T13:36:46.436 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2021-03-10T13:36:46.438 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:46.460 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:46 +0000 (0:00:00.050) 0:00:45.149 ******* 2021-03-10T13:36:46.477 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:46.500 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:46 +0000 (0:00:00.039) 0:00:45.189 ******* 2021-03-10T13:36:46.527 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2021-03-10T13:36:46.529 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:46.550 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:46 +0000 (0:00:00.049) 0:00:45.239 ******* 2021-03-10T13:36:46.565 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:46.588 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:46 +0000 (0:00:00.038) 0:00:45.277 ******* 2021-03-10T13:36:47.410 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-03-10T13:36:47.412 INFO:teuthology.task.ansible.out:changed: [gibba045.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.724441", "end": "2021-03-10 13:36:47.500892", "rc": 0, "start": "2021-03-10 13:36:46.776451", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T13:36:47.435 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:47 +0000 (0:00:00.846) 0:00:46.124 ******* 2021-03-10T13:36:47.502 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2021-03-10T13:36:47.504 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:47.529 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:47 +0000 (0:00:00.094) 0:00:46.218 ******* 2021-03-10T13:36:47.668 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2021-03-10T13:36:47.669 INFO:teuthology.task.ansible.out:[WARNING]: Consider using the apt module rather than running 'apt-get'. If you need to use command because apt is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [gibba045.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.007494", "end": "2021-03-10 13:36:47.766296", "rc": 0, "start": "2021-03-10 13:36:47.758802", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T13:36:47.690 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:47 +0000 (0:00:00.161) 0:00:46.379 ******* 2021-03-10T13:36:48.189 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-03-10T13:36:48.191 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:01.546445", "end": "2021-03-10 13:36:48.502385", "rc": 0, "start": "2021-03-10 13:36:46.955940", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T13:36:48.212 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:48 +0000 (0:00:00.521) 0:00:46.901 ******* 2021-03-10T13:36:48.280 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2021-03-10T13:36:48.282 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:48.303 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:48 +0000 (0:00:00.091) 0:00:46.992 ******* 2021-03-10T13:36:48.463 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2021-03-10T13:36:48.465 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.007660", "end": "2021-03-10 13:36:48.771816", "rc": 0, "start": "2021-03-10 13:36:48.764156", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T13:36:48.485 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:48 +0000 (0:00:00.182) 0:00:47.174 ******* 2021-03-10T13:36:49.430 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2021-03-10T13:36:49.432 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1615383353, "cache_updated": false, "changed": false} 2021-03-10T13:36:49.453 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:49 +0000 (0:00:00.967) 0:00:48.142 ******* 2021-03-10T13:36:49.923 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-03-10T13:36:49.963 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => {"cache_update_time": 1615383353, "cache_updated": false, "changed": false} Wednesday 10 March 2021 13:36:49 +0000 (0:00:00.491) 0:00:48.634 ******* 2021-03-10T13:36:50.002 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2021-03-10T13:36:50.004 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:50.025 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:50 +0000 (0:00:00.080) 0:00:48.714 ******* 2021-03-10T13:36:50.298 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2021-03-10T13:36:50.300 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1615383348, "cache_updated": false, "changed": false} 2021-03-10T13:36:50.321 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:50 +0000 (0:00:00.295) 0:00:49.010 ******* 2021-03-10T13:36:50.544 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2021-03-10T13:36:50.546 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-03-10T13:36:50.567 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:50 +0000 (0:00:00.245) 0:00:49.256 ******* 2021-03-10T13:36:50.758 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-03-10T13:36:50.759 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"cache_update_time": 1615383348, "cache_updated": false, "changed": false} 2021-03-10T13:36:50.781 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:50 +0000 (0:00:00.214) 0:00:49.470 ******* 2021-03-10T13:36:50.849 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2021-03-10T13:36:50.851 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:50.872 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:50 +0000 (0:00:00.090) 0:00:49.561 ******* 2021-03-10T13:36:51.003 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2021-03-10T13:36:51.004 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => {"cache_update_time": 1615383353, "cache_updated": false, "changed": false} 2021-03-10T13:36:51.027 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:51 +0000 (0:00:00.154) 0:00:49.715 ******* 2021-03-10T13:36:51.259 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2021-03-10T13:36:51.261 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-03-10T13:36:51.282 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:51 +0000 (0:00:00.255) 0:00:49.971 ******* 2021-03-10T13:36:51.538 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-03-10T13:36:51.540 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-03-10T13:36:51.767 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-03-10T13:36:51.839 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2021-03-10T13:36:51.841 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"cache_update_time": 1615383348, "cache_updated": false, "changed": false} 2021-03-10T13:36:51.861 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:51 +0000 (0:00:00.579) 0:00:50.550 ******* 2021-03-10T13:36:51.970 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-03-10T13:36:51.972 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-03-10T13:36:51.995 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:51 +0000 (0:00:00.133) 0:00:50.684 ******* 2021-03-10T13:36:52.104 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-03-10T13:36:52.106 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-03-10T13:36:52.126 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:52 +0000 (0:00:00.131) 0:00:50.815 ******* 2021-03-10T13:36:52.162 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-03-10T13:36:52.164 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-03-10T13:36:52.391 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-03-10T13:36:52.392 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2021-03-10T13:36:52.454 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-03-10T13:36:52.456 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-03-10T13:36:52.601 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-03-10T13:36:52.603 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-03-10T13:36:52.653 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-03-10T13:36:52.655 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-03-10T13:36:52.679 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:52 +0000 (0:00:00.552) 0:00:51.368 ******* 2021-03-10T13:36:52.799 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-03-10T13:36:52.801 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-03-10T13:36:52.822 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:52 +0000 (0:00:00.142) 0:00:51.511 ******* 2021-03-10T13:36:52.828 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-03-10T13:36:52.830 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3605, "state": "file", "uid": 0} 2021-03-10T13:36:52.855 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:52 +0000 (0:00:00.033) 0:00:51.544 ******* 2021-03-10T13:36:53.050 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-03-10T13:36:53.052 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-03-10T13:36:53.073 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:53 +0000 (0:00:00.217) 0:00:51.762 ******* 2021-03-10T13:36:53.224 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-03-10T13:36:53.226 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2021-03-10T13:36:53.246 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2021-03-10T13:36:53.248 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:53.269 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:53 +0000 (0:00:00.196) 0:00:51.958 ******* 2021-03-10T13:36:53.399 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-03-10T13:36:53.401 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-03-10T13:36:53.452 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* skipping: [gibba045.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-10T13:36:53.475 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:53 +0000 (0:00:00.205) 0:00:52.164 ******* 2021-03-10T13:36:53.606 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-03-10T13:36:53.607 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3605, "state": "file", "uid": 0} 2021-03-10T13:36:53.642 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:53 +0000 (0:00:00.167) 0:00:52.331 ******* 2021-03-10T13:36:53.659 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-03-10T13:36:53.661 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-03-10T13:36:53.670 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-03-10T13:36:53.672 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-03-10T13:36:53.682 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-03-10T13:36:53.797 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:53 +0000 (0:00:00.155) 0:00:52.486 ******* 2021-03-10T13:36:53.824 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-03-10T13:36:53.826 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-03-10T13:36:53.848 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:53 +0000 (0:00:00.050) 0:00:52.537 ******* 2021-03-10T13:36:53.864 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-03-10T13:36:53.866 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:53.889 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:53 +0000 (0:00:00.041) 0:00:52.578 ******* 2021-03-10T13:36:53.916 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2021-03-10T13:36:53.917 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:53.940 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:53 +0000 (0:00:00.051) 0:00:52.629 ******* 2021-03-10T13:36:54.009 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2021-03-10T13:36:54.011 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-10T13:36:54.031 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:54 +0000 (0:00:00.090) 0:00:52.720 ******* 2021-03-10T13:36:54.109 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** skipping: [gibba015.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-03-10T13:36:54.120 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-03-10T13:36:54.131 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-03-10T13:36:54.132 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-03-10T13:36:54.154 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:54 +0000 (0:00:00.122) 0:00:52.843 ******* 2021-03-10T13:36:54.221 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-03-10T13:36:54.223 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:54.244 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:54 +0000 (0:00:00.089) 0:00:52.932 ******* 2021-03-10T13:36:54.342 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2021-03-10T13:36:54.344 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => {"cache_update_time": 1615383353, "cache_updated": false, "changed": false} 2021-03-10T13:36:54.366 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:54 +0000 (0:00:00.122) 0:00:53.055 ******* 2021-03-10T13:36:54.650 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-03-10T13:36:54.652 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-03-10T13:36:54.674 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:54 +0000 (0:00:00.307) 0:00:53.362 ******* 2021-03-10T13:36:54.711 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2021-03-10T13:36:54.712 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"cache_update_time": 1615383348, "cache_updated": false, "changed": false} 2021-03-10T13:36:54.745 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:54 +0000 (0:00:00.070) 0:00:53.433 ******* 2021-03-10T13:36:55.026 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2021-03-10T13:36:55.027 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-03-10T13:36:55.054 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:55 +0000 (0:00:00.308) 0:00:53.742 ******* 2021-03-10T13:36:55.071 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-03-10T13:36:55.072 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-03-10T13:36:55.096 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:55 +0000 (0:00:00.042) 0:00:53.785 ******* 2021-03-10T13:36:55.212 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-03-10T13:36:55.214 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-03-10T13:36:55.287 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-03-10T13:36:55.313 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:55 +0000 (0:00:00.216) 0:00:54.002 ******* 2021-03-10T13:36:55.391 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-03-10T13:36:55.393 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:55.414 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:55 +0000 (0:00:00.100) 0:00:54.103 ******* 2021-03-10T13:36:55.420 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2021-03-10T13:36:55.422 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-03-10T13:36:55.447 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:55 +0000 (0:00:00.033) 0:00:54.136 ******* 2021-03-10T13:36:55.495 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2021-03-10T13:36:55.497 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-10T13:36:55.518 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:55 +0000 (0:00:00.070) 0:00:54.207 ******* 2021-03-10T13:36:55.597 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-03-10T13:36:55.599 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:55.620 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:55 +0000 (0:00:00.101) 0:00:54.309 ******* 2021-03-10T13:36:55.626 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-03-10T13:36:55.628 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-03-10T13:36:55.690 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-03-10T13:36:55.715 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:55 +0000 (0:00:00.094) 0:00:54.403 ******* 2021-03-10T13:36:55.802 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-03-10T13:36:55.804 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:55.825 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:55 +0000 (0:00:00.110) 0:00:54.514 ******* 2021-03-10T13:36:55.893 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2021-03-10T13:36:55.894 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} TASK [common : Check firewalld status] ***************************************** skipping: [gibba015.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-10T13:36:55.917 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:55 +0000 (0:00:00.091) 0:00:54.606 ******* 2021-03-10T13:36:55.944 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:55 +0000 (0:00:00.026) 0:00:54.632 ******* 2021-03-10T13:36:55.991 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-03-10T13:36:55.993 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:56.016 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:56 +0000 (0:00:00.072) 0:00:54.704 ******* 2021-03-10T13:36:56.147 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-03-10T13:36:56.148 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-03-10 13:35:14 UTC", "ActiveEnterTimestampMonotonic": "12462912", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-tmpfiles-setup.service systemd-journald.socket network.target time-sync.target var-run.mount nss-lookup.target basic.target local-fs.target system.slice remote-fs.target -.mount sysinit.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-03-10 13:35:14 UTC", "AssertTimestampMonotonic": "12454682", "Before": "multi-user.target plymouth-quit.service getty@tty1.service xdm.service shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-03-10 13:35:14 UTC", "Con 2021-03-10T13:36:56.149 INFO:teuthology.task.ansible.out:ditionTimestampMonotonic": "12454681", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nagios-nrpe-server.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "972", "ExecMainStartTimestamp": "Wed 2021-03-10 13:35:14 UTC", "ExecMainStartTimestampMonotonic": "12462815", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPostEx": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GID": "118", "Group": "nagios", "GuessMainPID": "yes", 2021-03-10T13:36:56.151 INFO:teuthology.task.ansible.out:"IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-03-10 13:35:14 UTC", "InactiveExitTimestampMonotonic": "12462912", "InvocationID": "1cec384014214070bf883dc4d6da9b48", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127828", "LimitNPROCSoft": "127828", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127828", "LimitSIGPENDINGSoft": "127828", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "972", "MemoryAccounting": "yes", "MemoryCurrent": "1257472", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "Me 2021-03-10T13:36:56.152 INFO:teuthology.task.ansible.out:moryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/run/nagios/nrpe.pid", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-03-10 13:35:14 UTC", "StateChangeTimestampMonotonic": "12462912", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "Sy 2021-03-10T13:36:56.154 INFO:teuthology.task.ansible.out:slogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "38348", "TimeoutAbortUSec": "1min", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "110", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-03-10T13:36:56.171 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:56 +0000 (0:00:00.155) 0:00:54.860 ******* 2021-03-10T13:36:56.230 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2021-03-10T13:36:56.232 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:56.253 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:56 +0000 (0:00:00.081) 0:00:54.942 ******* 2021-03-10T13:36:56.300 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2021-03-10T13:36:56.301 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-03-10T13:36:56.325 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:56 +0000 (0:00:00.071) 0:00:55.014 ******* 2021-03-10T13:36:56.330 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2021-03-10T13:36:56.332 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:56.356 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:56 +0000 (0:00:00.030) 0:00:55.044 ******* 2021-03-10T13:36:56.433 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2021-03-10T13:36:56.435 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:56.455 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:56 +0000 (0:00:00.099) 0:00:55.144 ******* 2021-03-10T13:36:56.533 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:56.557 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:56 +0000 (0:00:00.101) 0:00:55.246 ******* 2021-03-10T13:36:56.564 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-03-10T13:36:56.566 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-03-10 13:35:17 UTC", "ActiveEnterTimestampMonotonic": "13922898", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "time-sync.target system.slice sysinit.target basic.target systemd-tmpfiles-setup.service systemd-journald.socket -.mount var-run.mount remote-fs.target nss-lookup.target local-fs.target network.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-03-10 13:35:17 UTC", "AssertTimestampMonotonic": "13899018", "Before": "getty@tty1.service multi-user.target shutdown.target plymouth-quit.service xdm.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-03-10 13:35:17 UTC", "Con 2021-03-10T13:36:56.567 INFO:teuthology.task.ansible.out:ditionTimestampMonotonic": "13899017", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nagios-nrpe-server.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1376", "ExecMainStartTimestamp": "Wed 2021-03-10 13:35:17 UTC", "ExecMainStartTimestampMonotonic": "13922817", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPostEx": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GID": "118", "Group": "nagios", "GuessMainPID": "yes", 2021-03-10T13:36:56.569 INFO:teuthology.task.ansible.out: "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-03-10 13:35:17 UTC", "InactiveExitTimestampMonotonic": "13922898", "InvocationID": "1eaa6dabfe2b48a58bf279410e1e8310", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127828", "LimitNPROCSoft": "127828", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127828", "LimitSIGPENDINGSoft": "127828", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "1376", "MemoryAccounting": "yes", "MemoryCurrent": "1269760", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", " 2021-03-10T13:36:56.570 INFO:teuthology.task.ansible.out:MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/run/nagios/nrpe.pid", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount system.slice sysinit.target", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-03-10 13:35:17 UTC", "StateChangeTimestampMonotonic": "13922898", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", " 2021-03-10T13:36:56.572 INFO:teuthology.task.ansible.out:SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "38348", "TimeoutAbortUSec": "1min", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "110", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-03-10T13:36:56.593 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:56 +0000 (0:00:00.036) 0:00:55.282 ******* 2021-03-10T13:36:56.631 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2021-03-10T13:36:56.632 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:56.654 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:56 +0000 (0:00:00.060) 0:00:55.343 ******* 2021-03-10T13:36:56.670 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2021-03-10T13:36:56.672 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:56.700 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:56 +0000 (0:00:00.045) 0:00:55.389 ******* 2021-03-10T13:36:56.729 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2021-03-10T13:36:56.731 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:56.753 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:56 +0000 (0:00:00.052) 0:00:55.442 ******* 2021-03-10T13:36:56.780 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2021-03-10T13:36:56.781 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:56.807 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:56 +0000 (0:00:00.053) 0:00:55.495 ******* 2021-03-10T13:36:56.824 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2021-03-10T13:36:56.826 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:56.855 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:56 +0000 (0:00:00.048) 0:00:55.544 ******* 2021-03-10T13:36:56.872 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2021-03-10T13:36:56.873 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:56.896 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:56 +0000 (0:00:00.040) 0:00:55.584 ******* 2021-03-10T13:36:56.924 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2021-03-10T13:36:56.925 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:56.959 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:56 +0000 (0:00:00.063) 0:00:55.648 ******* 2021-03-10T13:36:56.979 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2021-03-10T13:36:56.981 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:57.004 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:57 +0000 (0:00:00.044) 0:00:55.693 ******* 2021-03-10T13:36:57.033 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2021-03-10T13:36:57.035 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:57.070 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:57 +0000 (0:00:00.066) 0:00:55.759 ******* 2021-03-10T13:36:57.090 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2021-03-10T13:36:57.092 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:57.115 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:57 +0000 (0:00:00.044) 0:00:55.803 ******* 2021-03-10T13:36:57.141 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2021-03-10T13:36:57.143 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:57.166 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:57 +0000 (0:00:00.051) 0:00:55.855 ******* 2021-03-10T13:36:57.183 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2021-03-10T13:36:57.184 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:57.218 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:57 +0000 (0:00:00.052) 0:00:55.907 ******* 2021-03-10T13:36:57.238 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-03-10T13:36:57.239 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2021-03-10T13:36:57.267 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:57 +0000 (0:00:00.048) 0:00:55.956 ******* 2021-03-10T13:36:57.284 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2021-03-10T13:36:57.286 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:57.308 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:57 +0000 (0:00:00.040) 0:00:55.997 ******* 2021-03-10T13:36:57.355 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-03-10T13:36:57.356 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "no_recommended_packages": ["collectl"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-03-10T13:36:57.379 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:57 +0000 (0:00:00.070) 0:00:56.067 ******* 2021-03-10T13:36:57.383 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2021-03-10T13:36:57.385 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:57.411 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:57 +0000 (0:00:00.032) 0:00:56.100 ******* 2021-03-10T13:36:57.459 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-03-10T13:36:57.461 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io", "python3-nose", "python3-virtualenv", "python3-configobj", "python3-gevent", "python3-numpy", "python3-matplotlib", "python3-setuptools"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"} 2021-03-10T13:36:57.484 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:57 +0000 (0:00:00.072) 0:00:56.172 ******* 2021-03-10T13:36:57.489 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2021-03-10T13:36:57.490 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:57.515 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:57 +0000 (0:00:00.031) 0:00:56.204 ******* 2021-03-10T13:36:57.564 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2021-03-10T13:36:57.566 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-03-10T13:36:57.587 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:57 +0000 (0:00:00.072) 0:00:56.276 ******* 2021-03-10T13:36:57.593 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2021-03-10T13:36:57.595 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:57.620 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:57 +0000 (0:00:00.032) 0:00:56.309 ******* 2021-03-10T13:36:57.688 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2021-03-10T13:36:57.690 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} TASK [testnode : Include package type specific vars.] ************************** ok: [gibba015.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2021-03-10T13:36:57.712 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:57 +0000 (0:00:00.092) 0:00:56.401 ******* 2021-03-10T13:36:57.731 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:57 +0000 (0:00:00.019) 0:00:56.420 ******* 2021-03-10T13:36:57.779 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-03-10T13:36:57.781 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "no_recommended_packages": ["collectl"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-03-10T13:36:57.805 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:57 +0000 (0:00:00.073) 0:00:56.494 ******* 2021-03-10T13:36:57.874 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-03-10T13:36:57.876 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io", "python3-nose", "python3-virtualenv", "python3-configobj", "python3-gevent", "python3-numpy", "python3-matplotlib", "python3-setuptools"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"} 2021-03-10T13:36:57.898 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:57 +0000 (0:00:00.092) 0:00:56.587 ******* 2021-03-10T13:36:57.924 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2021-03-10T13:36:57.926 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-03-10T13:36:57.947 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:57 +0000 (0:00:00.049) 0:00:56.636 ******* 2021-03-10T13:36:57.974 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2021-03-10T13:36:57.976 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-03-10T13:36:57.998 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:57 +0000 (0:00:00.050) 0:00:56.687 ******* 2021-03-10T13:36:58.015 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2021-03-10T13:36:58.016 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:58.039 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:58 +0000 (0:00:00.040) 0:00:56.728 ******* 2021-03-10T13:36:58.096 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2021-03-10T13:36:58.098 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-03-10T13:36:58.121 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:58 +0000 (0:00:00.082) 0:00:56.810 ******* 2021-03-10T13:36:58.127 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2021-03-10T13:36:58.129 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:58.151 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:58 +0000 (0:00:00.029) 0:00:56.840 ******* 2021-03-10T13:36:58.270 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2021-03-10T13:36:58.272 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-03-10T13:36:58.293 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:58 +0000 (0:00:00.142) 0:00:56.982 ******* 2021-03-10T13:36:58.310 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2021-03-10T13:36:58.312 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2021-03-10T13:36:58.335 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:58 +0000 (0:00:00.041) 0:00:57.024 ******* 2021-03-10T13:36:58.351 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2021-03-10T13:36:58.353 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:58.376 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:58 +0000 (0:00:00.040) 0:00:57.065 ******* 2021-03-10T13:36:58.444 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2021-03-10T13:36:58.445 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:36:58.466 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:58 +0000 (0:00:00.090) 0:00:57.155 ******* 2021-03-10T13:36:58.627 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2021-03-10T13:36:58.628 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2021-03-10T13:36:58.649 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:58 +0000 (0:00:00.183) 0:00:57.338 ******* 2021-03-10T13:36:58.678 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-03-10T13:36:58.680 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2021-03-10T13:36:58.702 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:58 +0000 (0:00:00.052) 0:00:57.391 ******* 2021-03-10T13:36:58.782 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-03-10T13:36:58.784 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "gibba045"}, "changed": false} 2021-03-10T13:36:58.805 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:58 +0000 (0:00:00.102) 0:00:57.494 ******* 2021-03-10T13:36:59.008 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-03-10T13:36:59.010 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2021-03-10T13:36:59.032 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:59 +0000 (0:00:00.226) 0:00:57.721 ******* 2021-03-10T13:36:59.110 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-03-10T13:36:59.112 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "gibba015"}, "changed": false} 2021-03-10T13:36:59.133 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:59 +0000 (0:00:00.100) 0:00:57.822 ******* 2021-03-10T13:36:59.504 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2021-03-10T13:36:59.506 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "", "ansible_fqdn": "gibba045", "ansible_hostname": "gibba045", "ansible_nodename": "gibba045"}, "changed": false, "name": "gibba045"} ok: [gibba015.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "", "ansible_fqdn": "gibba015", "ansible_hostname": "gibba015", "ansible_nodename": "gibba015"}, "changed": false, "name": "gibba015"} 2021-03-10T13:36:59.540 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:59 +0000 (0:00:00.407) 0:00:58.229 ******* 2021-03-10T13:36:59.564 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:59 +0000 (0:00:00.023) 0:00:58.253 ******* 2021-03-10T13:36:59.810 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2021-03-10T13:36:59.812 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-03-10T13:36:59.833 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:59 +0000 (0:00:00.269) 0:00:58.522 ******* 2021-03-10T13:36:59.839 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-03-10T13:36:59.863 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:36:59 +0000 (0:00:00.029) 0:00:58.552 ******* 2021-03-10T13:37:00.106 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2021-03-10T13:37:00.108 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-03-10T13:37:00.129 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:00 +0000 (0:00:00.265) 0:00:58.818 ******* 2021-03-10T13:37:00.136 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-03-10T13:37:00.161 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:00 +0000 (0:00:00.031) 0:00:58.850 ******* 2021-03-10T13:37:00.519 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2021-03-10T13:37:00.521 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-03-10T13:37:00.542 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:00 +0000 (0:00:00.381) 0:00:59.231 ******* 2021-03-10T13:37:00.559 INFO:teuthology.task.ansible.out:changed: [gibba045.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-03-10T13:37:00.583 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:00 +0000 (0:00:00.040) 0:00:59.272 ******* 2021-03-10T13:37:00.609 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2021-03-10T13:37:00.611 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:00.633 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:00 +0000 (0:00:00.049) 0:00:59.322 ******* 2021-03-10T13:37:00.649 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:00.675 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:00 +0000 (0:00:00.041) 0:00:59.364 ******* 2021-03-10T13:37:00.701 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-03-10T13:37:00.703 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:00.726 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:00 +0000 (0:00:00.051) 0:00:59.415 ******* 2021-03-10T13:37:00.743 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:00.767 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:00 +0000 (0:00:00.041) 0:00:59.456 ******* 2021-03-10T13:37:00.795 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-03-10T13:37:00.797 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:00.819 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:00 +0000 (0:00:00.052) 0:00:59.508 ******* 2021-03-10T13:37:00.836 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:00.861 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:00 +0000 (0:00:00.041) 0:00:59.550 ******* 2021-03-10T13:37:00.890 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-03-10T13:37:00.892 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:00.916 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:00 +0000 (0:00:00.054) 0:00:59.605 ******* 2021-03-10T13:37:00.945 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:00.970 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:00 +0000 (0:00:00.053) 0:00:59.659 ******* 2021-03-10T13:37:00.997 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-03-10T13:37:00.999 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:01.022 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:01 +0000 (0:00:00.051) 0:00:59.710 ******* 2021-03-10T13:37:01.049 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:01.072 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:01 +0000 (0:00:00.050) 0:00:59.761 ******* 2021-03-10T13:37:01.088 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-03-10T13:37:01.089 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:01.112 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:01 +0000 (0:00:00.039) 0:00:59.800 ******* 2021-03-10T13:37:01.139 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:01.162 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:01 +0000 (0:00:00.050) 0:00:59.851 ******* 2021-03-10T13:37:01.179 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-03-10T13:37:01.181 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:01.203 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:01 +0000 (0:00:00.040) 0:00:59.892 ******* 2021-03-10T13:37:01.240 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:01.266 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:01 +0000 (0:00:00.063) 0:00:59.955 ******* 2021-03-10T13:37:01.283 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-03-10T13:37:01.284 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:01.307 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:01 +0000 (0:00:00.040) 0:00:59.996 ******* 2021-03-10T13:37:01.334 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:01.358 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:01 +0000 (0:00:00.051) 0:01:00.047 ******* 2021-03-10T13:37:01.374 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-03-10T13:37:01.399 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:01 +0000 (0:00:00.040) 0:01:00.088 ******* 2021-03-10T13:37:01.440 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:01 +0000 (0:00:00.040) 0:01:00.128 ******* 2021-03-10T13:37:01.456 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-03-10T13:37:01.483 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:01 +0000 (0:00:00.043) 0:01:00.172 ******* 2021-03-10T13:37:01.535 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:01 +0000 (0:00:00.051) 0:01:00.223 ******* 2021-03-10T13:37:01.551 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-03-10T13:37:01.576 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:01 +0000 (0:00:00.041) 0:01:00.265 ******* 2021-03-10T13:37:01.627 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:01 +0000 (0:00:00.051) 0:01:00.316 ******* 2021-03-10T13:37:01.654 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2021-03-10T13:37:01.656 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:01.682 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:01 +0000 (0:00:00.054) 0:01:00.370 ******* 2021-03-10T13:37:01.698 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:01.722 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:01 +0000 (0:00:00.040) 0:01:00.411 ******* 2021-03-10T13:37:01.759 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2021-03-10T13:37:01.761 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-03-10T13:37:01.784 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:01 +0000 (0:00:00.061) 0:01:00.473 ******* 2021-03-10T13:37:01.801 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-03-10T13:37:01.802 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-03-10T13:37:01.828 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:01 +0000 (0:00:00.043) 0:01:00.517 ******* 2021-03-10T13:37:01.855 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2021-03-10T13:37:01.857 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:01.879 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:01 +0000 (0:00:00.050) 0:01:00.567 ******* 2021-03-10T13:37:01.895 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:01.918 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:01 +0000 (0:00:00.039) 0:01:00.607 ******* 2021-03-10T13:37:01.934 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-10T13:37:01.936 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:01.958 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:01 +0000 (0:00:00.040) 0:01:00.647 ******* 2021-03-10T13:37:01.985 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:02.009 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:02 +0000 (0:00:00.050) 0:01:00.698 ******* 2021-03-10T13:37:02.025 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2021-03-10T13:37:02.026 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:02.049 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:02 +0000 (0:00:00.040) 0:01:00.738 ******* 2021-03-10T13:37:02.076 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:02.101 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:02 +0000 (0:00:00.051) 0:01:00.789 ******* 2021-03-10T13:37:02.117 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2021-03-10T13:37:02.119 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:02.142 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:02 +0000 (0:00:00.041) 0:01:00.831 ******* 2021-03-10T13:37:02.169 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:02.193 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:02 +0000 (0:00:00.050) 0:01:00.881 ******* 2021-03-10T13:37:02.209 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2021-03-10T13:37:02.211 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:02.233 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:02 +0000 (0:00:00.040) 0:01:00.922 ******* 2021-03-10T13:37:02.260 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:02.284 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:02 +0000 (0:00:00.050) 0:01:00.973 ******* 2021-03-10T13:37:02.300 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2021-03-10T13:37:02.302 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:02.324 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:02 +0000 (0:00:00.039) 0:01:01.013 ******* 2021-03-10T13:37:02.351 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:02.379 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:02 +0000 (0:00:00.055) 0:01:01.068 ******* 2021-03-10T13:37:02.398 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-03-10T13:37:02.399 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:02.423 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:02 +0000 (0:00:00.043) 0:01:01.111 ******* 2021-03-10T13:37:02.452 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:02.477 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:02 +0000 (0:00:00.053) 0:01:01.165 ******* 2021-03-10T13:37:02.493 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-03-10T13:37:02.495 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:02.518 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:02 +0000 (0:00:00.041) 0:01:01.207 ******* 2021-03-10T13:37:02.546 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:02.570 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:02 +0000 (0:00:00.051) 0:01:01.259 ******* 2021-03-10T13:37:02.596 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-03-10T13:37:02.598 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:02.621 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:02 +0000 (0:00:00.051) 0:01:01.310 ******* 2021-03-10T13:37:02.638 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:02.662 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:02 +0000 (0:00:00.040) 0:01:01.351 ******* 2021-03-10T13:37:02.689 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2021-03-10T13:37:02.691 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:02.713 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:02 +0000 (0:00:00.051) 0:01:01.402 ******* 2021-03-10T13:37:02.730 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:02.754 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:02 +0000 (0:00:00.041) 0:01:01.443 ******* 2021-03-10T13:37:02.781 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-03-10T13:37:02.783 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:02.805 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:02 +0000 (0:00:00.050) 0:01:01.494 ******* 2021-03-10T13:37:02.821 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:02.845 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:02 +0000 (0:00:00.040) 0:01:01.534 ******* 2021-03-10T13:37:02.872 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-03-10T13:37:02.874 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:02.896 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:02 +0000 (0:00:00.050) 0:01:01.585 ******* 2021-03-10T13:37:02.912 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:02.939 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:02 +0000 (0:00:00.042) 0:01:01.628 ******* 2021-03-10T13:37:02.966 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2021-03-10T13:37:02.967 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:02.990 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:02 +0000 (0:00:00.051) 0:01:01.679 ******* 2021-03-10T13:37:03.007 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:03.031 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:03 +0000 (0:00:00.041) 0:01:01.720 ******* 2021-03-10T13:37:03.048 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2021-03-10T13:37:03.050 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:03.072 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:03 +0000 (0:00:00.041) 0:01:01.761 ******* 2021-03-10T13:37:03.100 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:03.124 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:03 +0000 (0:00:00.050) 0:01:01.812 ******* 2021-03-10T13:37:03.140 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2021-03-10T13:37:03.142 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:03.164 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:03 +0000 (0:00:00.040) 0:01:01.853 ******* 2021-03-10T13:37:03.192 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:03.216 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:03 +0000 (0:00:00.051) 0:01:01.905 ******* 2021-03-10T13:37:03.232 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2021-03-10T13:37:03.234 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:03.256 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:03 +0000 (0:00:00.040) 0:01:01.945 ******* 2021-03-10T13:37:03.284 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:03.308 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:03 +0000 (0:00:00.051) 0:01:01.997 ******* 2021-03-10T13:37:03.336 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2021-03-10T13:37:03.338 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:03.360 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:03 +0000 (0:00:00.052) 0:01:02.049 ******* 2021-03-10T13:37:03.377 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:03.401 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:03 +0000 (0:00:00.040) 0:01:02.090 ******* 2021-03-10T13:37:03.448 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2021-03-10T13:37:03.450 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:03.472 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:03 +0000 (0:00:00.070) 0:01:02.160 ******* 2021-03-10T13:37:03.478 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:03.509 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:03 +0000 (0:00:00.037) 0:01:02.198 ******* 2021-03-10T13:37:03.546 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2021-03-10T13:37:03.548 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:03.570 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:03 +0000 (0:00:00.061) 0:01:02.259 ******* 2021-03-10T13:37:03.577 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:03.602 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:03 +0000 (0:00:00.031) 0:01:02.291 ******* 2021-03-10T13:37:03.639 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2021-03-10T13:37:03.641 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:03.663 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:03 +0000 (0:00:00.060) 0:01:02.352 ******* 2021-03-10T13:37:03.669 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:03.694 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:03 +0000 (0:00:00.031) 0:01:02.383 ******* 2021-03-10T13:37:03.804 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2021-03-10T13:37:03.806 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.001424", "end": "2021-03-10 13:37:04.115945", "rc": 0, "start": "2021-03-10 13:37:04.114521", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T13:37:03.827 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:03 +0000 (0:00:00.132) 0:01:02.516 ******* 2021-03-10T13:37:03.854 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.001343", "end": "2021-03-10 13:37:03.943256", "rc": 0, "start": "2021-03-10 13:37:03.941913", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T13:37:03.877 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:03 +0000 (0:00:00.050) 0:01:02.566 ******* 2021-03-10T13:37:03.893 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-03-10T13:37:03.917 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:03 +0000 (0:00:00.039) 0:01:02.606 ******* 2021-03-10T13:37:03.967 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:03 +0000 (0:00:00.049) 0:01:02.656 ******* 2021-03-10T13:37:04.191 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2021-03-10T13:37:04.193 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2021-03-10T13:37:04.215 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:04 +0000 (0:00:00.247) 0:01:02.904 ******* 2021-03-10T13:37:04.232 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2021-03-10T13:37:04.256 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:04 +0000 (0:00:00.040) 0:01:02.945 ******* 2021-03-10T13:37:04.283 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2021-03-10T13:37:04.285 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:04.310 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:04 +0000 (0:00:00.054) 0:01:02.999 ******* 2021-03-10T13:37:04.328 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:04.353 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:04 +0000 (0:00:00.042) 0:01:03.042 ******* 2021-03-10T13:37:05.390 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-03-10T13:37:05.392 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2021-03-10T13:37:05.412 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2021-03-10T13:37:06.031 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-03-10T13:37:06.055 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:06 +0000 (0:00:01.702) 0:01:04.744 ******* 2021-03-10T13:37:06.134 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-03-10T13:37:06.158 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:06 +0000 (0:00:00.103) 0:01:04.847 ******* 2021-03-10T13:37:06.517 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2021-03-10T13:37:06.519 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"cache_update_time": 1615383348, "cache_updated": false, "changed": false} 2021-03-10T13:37:06.541 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:06 +0000 (0:00:00.382) 0:01:05.229 ******* 2021-03-10T13:37:06.608 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-03-10T13:37:06.631 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:06 +0000 (0:00:00.090) 0:01:05.320 ******* 2021-03-10T13:37:06.658 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2021-03-10T13:37:06.659 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => {"cache_update_time": 1615383353, "cache_updated": false, "changed": false} 2021-03-10T13:37:06.684 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:06 +0000 (0:00:00.052) 0:01:05.373 ******* 2021-03-10T13:37:06.753 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-03-10T13:37:06.775 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:06 +0000 (0:00:00.091) 0:01:05.464 ******* 2021-03-10T13:37:06.791 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2021-03-10T13:37:06.793 INFO:teuthology.task.ansible.out:[WARNING]: Consider using 'become', 'become_method', and 'become_user' rather than running sudo changed: [gibba015.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.011101", "end": "2021-03-10 13:37:07.103405", "rc": 0, "start": "2021-03-10 13:37:07.092304", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T13:37:06.816 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:06 +0000 (0:00:00.040) 0:01:05.505 ******* 2021-03-10T13:37:06.936 INFO:teuthology.task.ansible.out:changed: [gibba045.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.011168", "end": "2021-03-10 13:37:07.027049", "rc": 0, "start": "2021-03-10 13:37:07.015881", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T13:37:06.960 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:06 +0000 (0:00:00.144) 0:01:05.649 ******* 2021-03-10T13:37:08.260 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2021-03-10T13:37:08.262 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"cache_update_time": 1615383348, "cache_updated": false, "changed": false} 2021-03-10T13:37:08.284 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:08 +0000 (0:00:01.323) 0:01:06.973 ******* 2021-03-10T13:37:08.373 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => {"cache_update_time": 1615383353, "cache_updated": false, "changed": false} 2021-03-10T13:37:08.396 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:08 +0000 (0:00:00.111) 0:01:07.085 ******* 2021-03-10T13:37:17.115 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2021-03-10T13:37:17.117 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 liborc-0.4-0\n libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5 libtag1v5-vanilla\n libusbredirparser1 libv4l-0 libv4lconvert0 libvirglrenderer1 libvisual-0.4-0\n libvte-2.91-0 libvte-2.91-common libwayland-server0 msr-tools ovmf\n qemu-system-data qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 9 not upgraded.\nAfter this operation, 62.7 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 101691 files and directories currently installed.)\r\nR 2021-03-10T13:37:17.119 INFO:teuthology.task.ansible.out:emoving qemu-utils (1:4.2-3ubuntu6.14) ...\r\nRemoving qemu-system-x86 (1:4.2-3ubuntu6.14) ...\r\nRemoving qemu-system-common (1:4.2-3ubuntu6.14) ...\r\nRemoving qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) ...\r\nRemoving librbd1 (15.2.8-0ubuntu0.20.04.1) ...\r\nRemoving librados2 (15.2.8-0ubuntu0.20.04.1) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 liborc-0.4-0", " libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5 libtag1v5-vanilla", " libusbredirparser1 libv4l-0 libv4lconvert0 libvirglrenderer1 libvisual-0.4-0", " libvte-2.91-0 libvte-2.91-common libwayland-server0 msr-tools ovmf", " qemu-system-data qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 9 not upgraded.", "After this operation, 62.7 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading 2021-03-10T13:37:17.120 INFO:teuthology.task.ansible.out: database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 101691 files and directories currently installed.)", "Removing qemu-utils (1:4.2-3ubuntu6.14) ...", "Removing qemu-system-x86 (1:4.2-3ubuntu6.14) ...", "Removing qemu-system-common (1:4.2-3ubuntu6.14) ...", "Removing qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) ...", "Removing librbd1 (15.2.8-0ubuntu0.20.04.1) ...", "Removing librados2 (15.2.8-0ubuntu0.20.04.1) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ..."]} 2021-03-10T13:37:17.142 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:17 +0000 (0:00:08.746) 0:01:15.831 ******* 2021-03-10T13:37:17.423 INFO:teuthology.task.ansible.out:changed: [gibba045.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 liborc-0.4-0\n libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5 libtag1v5-vanilla\n libusbredirparser1 libv4l-0 libv4lconvert0 libvirglrenderer1 libvisual-0.4-0\n libvte-2.91-0 libvte-2.91-common libwayland-server0 msr-tools ovmf\n qemu-system-data qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 9 not upgraded.\nAfter this operation, 62.7 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 101691 files and directories currently installed.)\r\nR 2021-03-10T13:37:17.425 INFO:teuthology.task.ansible.out:emoving qemu-utils (1:4.2-3ubuntu6.14) ...\r\nRemoving qemu-system-x86 (1:4.2-3ubuntu6.14) ...\r\nRemoving qemu-system-common (1:4.2-3ubuntu6.14) ...\r\nRemoving qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) ...\r\nRemoving librbd1 (15.2.8-0ubuntu0.20.04.1) ...\r\nRemoving librados2 (15.2.8-0ubuntu0.20.04.1) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 liborc-0.4-0", " libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5 libtag1v5-vanilla", " libusbredirparser1 libv4l-0 libv4lconvert0 libvirglrenderer1 libvisual-0.4-0", " libvte-2.91-0 libvte-2.91-common libwayland-server0 msr-tools ovmf", " qemu-system-data qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 9 not upgraded.", "After this operation, 62.7 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading 2021-03-10T13:37:17.427 INFO:teuthology.task.ansible.out: database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 101691 files and directories currently installed.)", "Removing qemu-utils (1:4.2-3ubuntu6.14) ...", "Removing qemu-system-x86 (1:4.2-3ubuntu6.14) ...", "Removing qemu-system-common (1:4.2-3ubuntu6.14) ...", "Removing qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) ...", "Removing librbd1 (15.2.8-0ubuntu0.20.04.1) ...", "Removing librados2 (15.2.8-0ubuntu0.20.04.1) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ..."]} 2021-03-10T13:37:17.449 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:17 +0000 (0:00:00.306) 0:01:16.138 ******* 2021-03-10T13:37:17.601 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-03-10T13:37:17.603 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"cache_update_time": 1615383348, "cache_updated": false, "changed": false} 2021-03-10T13:37:17.629 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:17 +0000 (0:00:00.179) 0:01:16.317 ******* 2021-03-10T13:37:17.710 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2021-03-10T13:37:17.712 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:17.733 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:17 +0000 (0:00:00.103) 0:01:16.421 ******* 2021-03-10T13:37:17.895 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-03-10T13:37:17.897 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => {"cache_update_time": 1615383353, "cache_updated": false, "changed": false} 2021-03-10T13:37:17.920 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:17 +0000 (0:00:00.187) 0:01:16.609 ******* 2021-03-10T13:37:18.001 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2021-03-10T13:37:18.003 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:18.024 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:18 +0000 (0:00:00.103) 0:01:16.713 ******* 2021-03-10T13:37:27.072 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-03-10T13:37:27.072 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => {"cache_update_time": 1615383348, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils\nSuggested packages:\n git-daemon-run | git-daemon-sysvinit git-doc git-el git-email git-gui gitk\n gitweb git-cvs git-mediawiki git-svn samba vde2 debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\nThe following packages will be upgraded:\n git\n1 upgraded, 6 newly installed, 0 to remove and 8 not upgraded.\nNeed to get 18.2 MB of archives.\nAfter this operation, 62.7 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 git amd64 1:2.25.1-1ubuntu3.1 [4557 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.8-0ubuntu0.20.04.1 [3209 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.8-0ubuntu0.20.04.1 [1615 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.14 [53.1 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.14 [1055 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.14 [6726 kB]\nGet:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.14 [975 kB]\nFetched 18.2 MB in 1s (13.5 MB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading databas 2021-03-10T13:37:27.074 INFO:teuthology.task.ansible.out:e ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 101619 files and directories currently installed.)\r\nPreparing to unpack .../0-git_1%3a2.25.1-1ubuntu3.1_amd64.deb ...\r\nUnpacking git (1:2.25.1-1ubuntu3.1) over (1:2.25.1-1ubuntu3) ...\r\nSelecting previously unselected package librados2.\r\nPreparing to unpack .../1-librados2_15.2.8-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librados2 (15.2.8-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../2-librbd1_15.2.8-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librbd1 (15.2.8-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../3-qemu-block-extra_1%3a4.2-3ubuntu6.14_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../4-qemu-system-common_1%3a4.2-3ubuntu6.14_amd64.deb ...\r\nUnpacking qemu-system-common (1:4.2-3ubuntu6.14) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../5-qemu-system-x86_1%3a4.2-3ubuntu6.14_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:4.2-3ubuntu6.14) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../6-qemu-utils_1%3a4.2-3ubuntu6.14_amd64.deb ...\r\nUnpacking qemu-utils (1:4.2-3ubuntu6.14) ...\r\nSetting up librados2 (15.2.8-0ubuntu0.20.04.1) ...\r\nSetting up git (1:2.25.1-1ubuntu3.1) ...\r\nSetting up librbd1 (15.2.8-0ubuntu0.20.04.1) ...\r\nSetting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) 2021-03-10T13:37:27.076 INFO:teuthology.task.ansible.out:...\r\nSetting up qemu-system-common (1:4.2-3ubuntu6.14) ...\r\nSetting up qemu-system-x86 (1:4.2-3ubuntu6.14) ...\r\nSetting up qemu-utils (1:4.2-3ubuntu6.14) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils", "Suggested packages:", " git-daemon-run | git-daemon-sysvinit git-doc git-el git-email git-gui gitk", " gitweb git-cvs git-mediawiki git-svn samba vde2 debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "The following packages will be upgraded:", " git", "1 upgraded, 6 newly installed, 0 to remove and 8 not upgraded.", "Need to get 18.2 MB of archives.", "After this operation, 62.7 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 git amd64 1:2.25.1-1ubuntu3.1 [4557 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.8-0ubuntu0.20.04.1 [3209 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.8-0ubuntu0.20.04.1 [1615 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.14 [53.1 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.14 [1055 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.14 [6726 kB]", "Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.14 [975 kB]", "Fetched 18.2 MB in 1s (13.5 MB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", " 2021-03-10T13:37:27.077 INFO:teuthology.task.ansible.out:(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 101619 files and directories currently installed.)", "Preparing to unpack .../0-git_1%3a2.25.1-1ubuntu3.1_amd64.deb ...", "Unpacking git (1:2.25.1-1ubuntu3.1) over (1:2.25.1-1ubuntu3) ...", "Selecting previously unselected package librados2.", "Preparing to unpack .../1-librados2_15.2.8-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librados2 (15.2.8-0ubuntu0.20.04.1) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../2-librbd1_15.2.8-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librbd1 (15.2.8-0ubuntu0.20.04.1) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../3-qemu-block-extra_1%3a4.2-3ubuntu6.14_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../4-qemu-system-common_1%3a4.2-3ubuntu6.14_amd64.deb ...", "Unpacking qemu-system-common (1:4.2-3ubuntu6.14) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../5-qemu-system-x86_1%3a4.2-3ubuntu6.14_amd64.deb ...", "Unpacking qemu-system-x86 (1:4.2-3ubuntu6.14) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../6-qemu-utils_1%3a4.2-3ubuntu6.14_amd64.deb ...", "Unpacking qemu-utils (1:4.2-3ubuntu6.14) ...", "Setting up librados2 (15.2.8-0ubuntu0.20.04.1) ...", "Setting up git (1:2.25.1-1ubuntu3.1) ...", "Setting up librbd1 (15.2.8-0ubuntu0.20.04.1) ...", "Sett 2021-03-10T13:37:27.079 INFO:teuthology.task.ansible.out:ing up qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) ...", "Setting up qemu-system-common (1:4.2-3ubuntu6.14) ...", "Setting up qemu-system-x86 (1:4.2-3ubuntu6.14) ...", "Setting up qemu-utils (1:4.2-3ubuntu6.14) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ..."]} 2021-03-10T13:37:27.097 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:27 +0000 (0:00:09.073) 0:01:25.786 ******* 2021-03-10T13:37:27.427 INFO:teuthology.task.ansible.out:changed: [gibba045.front.sepia.ceph.com] => {"cache_update_time": 1615383353, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils\nSuggested packages:\n git-daemon-run | git-daemon-sysvinit git-doc git-el git-email git-gui gitk\n gitweb git-cvs git-mediawiki git-svn samba vde2 debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\nThe following packages will be upgraded:\n git\n1 upgraded, 6 newly installed, 0 to remove and 8 not upgraded.\nNeed to get 18.2 MB of archives.\nAfter this operation, 62.7 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 git amd64 1:2.25.1-1ubuntu3.1 [4557 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.8-0ubuntu0.20.04.1 [3209 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.8-0ubuntu0.20.04.1 [1615 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.14 [53.1 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.14 [1055 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.14 [6726 kB]\nGet:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.14 [975 kB]\nFetched 18.2 MB in 1s (14.2 MB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading databas 2021-03-10T13:37:27.428 INFO:teuthology.task.ansible.out:e ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 101619 files and directories currently installed.)\r\nPreparing to unpack .../0-git_1%3a2.25.1-1ubuntu3.1_amd64.deb ...\r\nUnpacking git (1:2.25.1-1ubuntu3.1) over (1:2.25.1-1ubuntu3) ...\r\nSelecting previously unselected package librados2.\r\nPreparing to unpack .../1-librados2_15.2.8-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librados2 (15.2.8-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../2-librbd1_15.2.8-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librbd1 (15.2.8-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../3-qemu-block-extra_1%3a4.2-3ubuntu6.14_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../4-qemu-system-common_1%3a4.2-3ubuntu6.14_amd64.deb ...\r\nUnpacking qemu-system-common (1:4.2-3ubuntu6.14) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../5-qemu-system-x86_1%3a4.2-3ubuntu6.14_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:4.2-3ubuntu6.14) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../6-qemu-utils_1%3a4.2-3ubuntu6.14_amd64.deb ...\r\nUnpacking qemu-utils (1:4.2-3ubuntu6.14) ...\r\nSetting up librados2 (15.2.8-0ubuntu0.20.04.1) ...\r\nSetting up git (1:2.25.1-1ubuntu3.1) ...\r\nSetting up librbd1 (15.2.8-0ubuntu0.20.04.1) ...\r\nSetting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) 2021-03-10T13:37:27.430 INFO:teuthology.task.ansible.out:...\r\nSetting up qemu-system-common (1:4.2-3ubuntu6.14) ...\r\nSetting up qemu-system-x86 (1:4.2-3ubuntu6.14) ...\r\nSetting up qemu-utils (1:4.2-3ubuntu6.14) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils", "Suggested packages:", " git-daemon-run | git-daemon-sysvinit git-doc git-el git-email git-gui gitk", " gitweb git-cvs git-mediawiki git-svn samba vde2 debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "The following packages will be upgraded:", " git", "1 upgraded, 6 newly installed, 0 to remove and 8 not upgraded.", "Need to get 18.2 MB of archives.", "After this operation, 62.7 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 git amd64 1:2.25.1-1ubuntu3.1 [4557 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.8-0ubuntu0.20.04.1 [3209 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.8-0ubuntu0.20.04.1 [1615 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.14 [53.1 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.14 [1055 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.14 [6726 kB]", "Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.14 [975 kB]", "Fetched 18.2 MB in 1s (14.2 MB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", " 2021-03-10T13:37:27.432 INFO:teuthology.task.ansible.out:(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 101619 files and directories currently installed.)", "Preparing to unpack .../0-git_1%3a2.25.1-1ubuntu3.1_amd64.deb ...", "Unpacking git (1:2.25.1-1ubuntu3.1) over (1:2.25.1-1ubuntu3) ...", "Selecting previously unselected package librados2.", "Preparing to unpack .../1-librados2_15.2.8-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librados2 (15.2.8-0ubuntu0.20.04.1) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../2-librbd1_15.2.8-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librbd1 (15.2.8-0ubuntu0.20.04.1) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../3-qemu-block-extra_1%3a4.2-3ubuntu6.14_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../4-qemu-system-common_1%3a4.2-3ubuntu6.14_amd64.deb ...", "Unpacking qemu-system-common (1:4.2-3ubuntu6.14) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../5-qemu-system-x86_1%3a4.2-3ubuntu6.14_amd64.deb ...", "Unpacking qemu-system-x86 (1:4.2-3ubuntu6.14) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../6-qemu-utils_1%3a4.2-3ubuntu6.14_amd64.deb ...", "Unpacking qemu-utils (1:4.2-3ubuntu6.14) ...", "Setting up librados2 (15.2.8-0ubuntu0.20.04.1) ...", "Setting up git (1:2.25.1-1ubuntu3.1) ...", "Setting up librbd1 (15.2.8-0ubuntu0.20.04.1) ...", "Sett 2021-03-10T13:37:27.433 INFO:teuthology.task.ansible.out:ing up qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) ...", "Setting up qemu-system-common (1:4.2-3ubuntu6.14) ...", "Setting up qemu-system-x86 (1:4.2-3ubuntu6.14) ...", "Setting up qemu-utils (1 2021-03-10T13:37:27.434 INFO:teuthology.task.ansible.out::4.2-3ubuntu6.14) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ..."]} 2021-03-10T13:37:27.459 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:27 +0000 (0:00:00.361) 0:01:26.148 ******* 2021-03-10T13:37:27.558 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2021-03-10T13:37:27.560 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"cache_update_time": 1615383348, "cache_updated": false, "changed": false} 2021-03-10T13:37:27.584 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:27 +0000 (0:00:00.124) 0:01:26.273 ******* 2021-03-10T13:37:27.901 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => {"cache_update_time": 1615383353, "cache_updated": false, "changed": false} 2021-03-10T13:37:27.924 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:27 +0000 (0:00:00.340) 0:01:26.613 ******* 2021-03-10T13:37:28.033 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages with --no-install-recommends] **************** 2021-03-10T13:37:28.035 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"cache_update_time": 1615383348, "cache_updated": false, "changed": false} 2021-03-10T13:37:28.058 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:28 +0000 (0:00:00.133) 0:01:26.747 ******* 2021-03-10T13:37:28.239 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-03-10T13:37:28.241 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-03-10T13:37:28.262 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:28 +0000 (0:00:00.204) 0:01:26.951 ******* 2021-03-10T13:37:28.330 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-03-10T13:37:28.332 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:28.353 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:28 +0000 (0:00:00.090) 0:01:27.042 ******* 2021-03-10T13:37:28.369 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages with --no-install-recommends] **************** 2021-03-10T13:37:28.371 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => {"cache_update_time": 1615383353, "cache_updated": false, "changed": false} 2021-03-10T13:37:28.394 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:28 +0000 (0:00:00.040) 0:01:27.083 ******* 2021-03-10T13:37:28.503 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-03-10T13:37:28.504 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2021-03-10T13:37:28.526 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:28 +0000 (0:00:00.132) 0:01:27.215 ******* 2021-03-10T13:37:28.543 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-03-10T13:37:28.544 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-03-10T13:37:28.568 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:28 +0000 (0:00:00.041) 0:01:27.256 ******* 2021-03-10T13:37:28.635 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-03-10T13:37:28.637 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:28.658 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:28 +0000 (0:00:00.090) 0:01:27.347 ******* 2021-03-10T13:37:28.798 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-03-10T13:37:28.800 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} TASK [testnode : Upload /etc/fuse.conf.] *************************************** ok: [gibba015.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2021-03-10T13:37:28.822 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:28 +0000 (0:00:00.163) 0:01:27.511 ******* 2021-03-10T13:37:28.842 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:28 +0000 (0:00:00.019) 0:01:27.531 ******* 2021-03-10T13:37:28.992 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2021-03-10T13:37:28.994 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-03-10T13:37:29.016 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:29 +0000 (0:00:00.174) 0:01:27.705 ******* 2021-03-10T13:37:29.115 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-03-10T13:37:29.116 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2021-03-10T13:37:29.142 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:29 +0000 (0:00:00.125) 0:01:27.831 ******* 2021-03-10T13:37:29.169 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-03-10T13:37:29.171 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-03-10T13:37:29.193 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:29 +0000 (0:00:00.051) 0:01:27.882 ******* 2021-03-10T13:37:29.302 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2021-03-10T13:37:29.304 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-03-10T13:37:29.327 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:29 +0000 (0:00:00.133) 0:01:28.016 ******* 2021-03-10T13:37:29.447 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-03-10T13:37:29.448 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Wed 2021-03-10 13:35:18 UTC", "ActiveEnterTimestampMonotonic": "14713274", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-journald.socket systemd-tmpfiles-setup.service system.slice sysinit.target network.target remote-fs.target basic.target -.mount nss-lookup.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-03-10 13:35:17 UTC", "AssertTimestampMonotonic": "13811221", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-03-10 13:35:17 UTC", "ConditionTimestampMonotonic": "13811221", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": 2021-03-10T13:37:29.450 INFO:teuthology.task.ansible.out: "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "Documentation": "https://httpd.apache.org/docs/2.4/", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1522", "ExecMainStartTimestamp": "Wed 2021-03-10 13:35:18 UTC", "ExecMainStartTimestampMonotonic": "14713224", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709 2021-03-10T13:37:29.452 INFO:teuthology.task.ansible.out:551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-03-10 13:35:17 UTC", "InactiveExitTimestampMonotonic": "13811880", "InvocationID": "b7a53c1859204daabcb35b62864ba028", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127828", "LimitNPROCSoft": "127828", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127828", "LimitSIGPENDINGSoft": "127828", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "1522", "MemoryAccounting": "yes", "MemoryCurrent": "10579968", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPoli 2021-03-10T13:37:29.453 INFO:teuthology.task.ansible.out:cy": "n/a", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount system.slice sysinit.target", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-03-10 13:35:18 UTC", "StateChangeTimestampMonotonic": "14713274", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "38348", "TimeoutAbortUSec": 2021-03-10T13:37:29.455 INFO:teuthology.task.ansible.out: "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-03-10T13:37:29.471 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:29 +0000 (0:00:00.144) 0:01:28.160 ******* 2021-03-10T13:37:29.478 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-03-10T13:37:29.479 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-03-10T13:37:29.501 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:29 +0000 (0:00:00.030) 0:01:28.190 ******* 2021-03-10T13:37:29.538 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-03-10T13:37:29.539 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:29.560 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:29 +0000 (0:00:00.058) 0:01:28.249 ******* 2021-03-10T13:37:29.638 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-03-10T13:37:29.640 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:29.659 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:29 +0000 (0:00:00.099) 0:01:28.348 ******* 2021-03-10T13:37:29.728 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-03-10T13:37:29.729 INFO:teuthology.task.ansible.out:changed: [gibba045.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Wed 2021-03-10 13:35:16 UTC", "ActiveEnterTimestampMonotonic": "13973401", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-journald.socket system.slice -.mount network.target sysinit.target systemd-tmpfiles-setup.service basic.target remote-fs.target nss-lookup.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-03-10 13:35:14 UTC", "AssertTimestampMonotonic": "12354864", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-03-10 13:35:14 UTC", "ConditionTimestampMonotonic": "12354863", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": 2021-03-10T13:37:29.731 INFO:teuthology.task.ansible.out: "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "Documentation": "https://httpd.apache.org/docs/2.4/", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1417", "ExecMainStartTimestamp": "Wed 2021-03-10 13:35:16 UTC", "ExecMainStartTimestampMonotonic": "13973391", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709 2021-03-10T13:37:29.733 INFO:teuthology.task.ansible.out:551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-03-10 13:35:14 UTC", "InactiveExitTimestampMonotonic": "12355499", "InvocationID": "49ba5c5d8a934ab8a3154ba6195c5319", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127828", "LimitNPROCSoft": "127828", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127828", "LimitSIGPENDINGSoft": "127828", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "1417", "MemoryAccounting": "yes", "MemoryCurrent": "10358784", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPoli 2021-03-10T13:37:29.734 INFO:teuthology.task.ansible.out:cy": "n/a", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-03-10 13:35:16 UTC", "StateChangeTimestampMonotonic": "13973401", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "38348", "TimeoutAbortUSec": 2021-03-10T13:37:29.736 INFO:teuthology.task.ansible.out: "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", 2021-03-10T13:37:29.736 INFO:teuthology.task.ansible.out: "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-03-10T13:37:29.738 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-03-10T13:37:29.738 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:29.759 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:29 +0000 (0:00:00.099) 0:01:28.448 ******* 2021-03-10T13:37:29.777 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:29 +0000 (0:00:00.018) 0:01:28.466 ******* 2021-03-10T13:37:29.814 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-03-10T13:37:29.816 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:29.837 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:29 +0000 (0:00:00.059) 0:01:28.526 ******* 2021-03-10T13:37:29.852 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-03-10T13:37:29.854 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:29.877 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:29 +0000 (0:00:00.040) 0:01:28.566 ******* 2021-03-10T13:37:29.904 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-03-10T13:37:29.905 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:29.927 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:29 +0000 (0:00:00.049) 0:01:28.616 ******* 2021-03-10T13:37:29.943 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-03-10T13:37:29.944 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:29.966 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:29 +0000 (0:00:00.039) 0:01:28.655 ******* 2021-03-10T13:37:29.992 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-03-10T13:37:29.994 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:30.016 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:30 +0000 (0:00:00.049) 0:01:28.705 ******* 2021-03-10T13:37:30.032 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-03-10T13:37:30.034 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:30.062 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:30 +0000 (0:00:00.046) 0:01:28.751 ******* 2021-03-10T13:37:30.078 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-03-10T13:37:30.080 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:30.102 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:30 +0000 (0:00:00.040) 0:01:28.791 ******* 2021-03-10T13:37:30.129 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-03-10T13:37:30.131 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:30.153 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:30 +0000 (0:00:00.050) 0:01:28.842 ******* 2021-03-10T13:37:30.169 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-03-10T13:37:30.171 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:30.193 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:30 +0000 (0:00:00.040) 0:01:28.882 ******* 2021-03-10T13:37:30.223 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-03-10T13:37:30.225 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:30.249 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:30 +0000 (0:00:00.056) 0:01:28.938 ******* 2021-03-10T13:37:30.266 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-10T13:37:30.268 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:30.290 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:30 +0000 (0:00:00.040) 0:01:28.979 ******* 2021-03-10T13:37:30.317 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-03-10T13:37:30.319 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:30.340 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:30 +0000 (0:00:00.050) 0:01:29.029 ******* 2021-03-10T13:37:30.356 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-03-10T13:37:30.358 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:30.381 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:30 +0000 (0:00:00.040) 0:01:29.069 ******* 2021-03-10T13:37:30.407 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-03-10T13:37:30.409 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:30.434 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:30 +0000 (0:00:00.053) 0:01:29.123 ******* 2021-03-10T13:37:30.451 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-03-10T13:37:30.452 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:30.475 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:30 +0000 (0:00:00.040) 0:01:29.164 ******* 2021-03-10T13:37:30.502 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-03-10T13:37:30.503 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:30.525 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:30 +0000 (0:00:00.050) 0:01:29.214 ******* 2021-03-10T13:37:30.541 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-03-10T13:37:30.542 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:30.566 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:30 +0000 (0:00:00.040) 0:01:29.255 ******* 2021-03-10T13:37:30.592 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-10T13:37:30.594 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:30.616 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:30 +0000 (0:00:00.050) 0:01:29.305 ******* 2021-03-10T13:37:30.632 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-03-10T13:37:30.634 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:30.656 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:30 +0000 (0:00:00.040) 0:01:29.345 ******* 2021-03-10T13:37:30.683 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-03-10T13:37:30.684 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:30.706 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:30 +0000 (0:00:00.049) 0:01:29.395 ******* 2021-03-10T13:37:30.722 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-03-10T13:37:30.723 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:30.746 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:30 +0000 (0:00:00.040) 0:01:29.435 ******* 2021-03-10T13:37:30.774 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-03-10T13:37:30.776 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:30.797 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:30 +0000 (0:00:00.051) 0:01:29.486 ******* 2021-03-10T13:37:30.813 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-03-10T13:37:30.815 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:30.837 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:30 +0000 (0:00:00.039) 0:01:29.526 ******* 2021-03-10T13:37:30.865 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-03-10T13:37:30.867 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:30.888 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:30 +0000 (0:00:00.050) 0:01:29.577 ******* 2021-03-10T13:37:30.914 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-03-10T13:37:30.915 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:30.936 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:30 +0000 (0:00:00.048) 0:01:29.625 ******* 2021-03-10T13:37:30.953 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-03-10T13:37:30.954 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:30.979 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:30 +0000 (0:00:00.042) 0:01:29.668 ******* 2021-03-10T13:37:31.006 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-03-10T13:37:31.008 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:31.030 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:31 +0000 (0:00:00.050) 0:01:29.719 ******* 2021-03-10T13:37:31.046 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-03-10T13:37:31.048 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:31.070 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:31 +0000 (0:00:00.040) 0:01:29.759 ******* 2021-03-10T13:37:31.095 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-03-10T13:37:31.097 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:31.118 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:31 +0000 (0:00:00.048) 0:01:29.807 ******* 2021-03-10T13:37:31.134 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-03-10T13:37:31.136 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:31.157 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:31 +0000 (0:00:00.039) 0:01:29.846 ******* 2021-03-10T13:37:31.184 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-03-10T13:37:31.186 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:31.207 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:31 +0000 (0:00:00.049) 0:01:29.896 ******* 2021-03-10T13:37:31.223 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-03-10T13:37:31.224 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:31.246 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:31 +0000 (0:00:00.038) 0:01:29.935 ******* 2021-03-10T13:37:31.272 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-03-10T13:37:31.273 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:31.295 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:31 +0000 (0:00:00.048) 0:01:29.984 ******* 2021-03-10T13:37:31.310 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-03-10T13:37:31.312 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:31.334 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:31 +0000 (0:00:00.039) 0:01:30.023 ******* 2021-03-10T13:37:31.361 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-03-10T13:37:31.362 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:31.384 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:31 +0000 (0:00:00.049) 0:01:30.073 ******* 2021-03-10T13:37:31.400 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-03-10T13:37:31.402 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:31.425 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:31 +0000 (0:00:00.040) 0:01:30.113 ******* 2021-03-10T13:37:31.454 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-03-10T13:37:31.456 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:31.489 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:31 +0000 (0:00:00.064) 0:01:30.178 ******* 2021-03-10T13:37:31.508 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-03-10T13:37:31.510 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:31.535 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:31 +0000 (0:00:00.046) 0:01:30.224 ******* 2021-03-10T13:37:31.562 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-03-10T13:37:31.564 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:31.587 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:31 +0000 (0:00:00.051) 0:01:30.276 ******* 2021-03-10T13:37:31.603 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-03-10T13:37:31.605 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:31.628 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:31 +0000 (0:00:00.040) 0:01:30.317 ******* 2021-03-10T13:37:31.644 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-03-10T13:37:31.645 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:31.668 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:31 +0000 (0:00:00.040) 0:01:30.357 ******* 2021-03-10T13:37:31.695 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-03-10T13:37:31.697 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:31.720 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:31 +0000 (0:00:00.051) 0:01:30.409 ******* 2021-03-10T13:37:31.736 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-03-10T13:37:31.738 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:31.760 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:31 +0000 (0:00:00.040) 0:01:30.449 ******* 2021-03-10T13:37:31.787 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-03-10T13:37:31.789 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:31.811 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:31 +0000 (0:00:00.051) 0:01:30.500 ******* 2021-03-10T13:37:31.827 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2021-03-10T13:37:31.829 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:31.851 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:31 +0000 (0:00:00.040) 0:01:30.540 ******* 2021-03-10T13:37:31.878 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-03-10T13:37:31.879 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:31.901 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:31 +0000 (0:00:00.050) 0:01:30.590 ******* 2021-03-10T13:37:31.968 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-03-10T13:37:31.970 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:31.991 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:31 +0000 (0:00:00.089) 0:01:30.680 ******* 2021-03-10T13:37:32.007 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-03-10T13:37:32.009 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2021-03-10T13:37:32.031 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:32 +0000 (0:00:00.040) 0:01:30.720 ******* 2021-03-10T13:37:32.061 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-03-10T13:37:32.062 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:32.094 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:32 +0000 (0:00:00.062) 0:01:30.783 ******* 2021-03-10T13:37:32.165 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2021-03-10T13:37:32.167 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:32.190 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:32 +0000 (0:00:00.095) 0:01:30.879 ******* 2021-03-10T13:37:32.309 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-03-10T13:37:32.310 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2021-03-10T13:37:32.332 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:32 +0000 (0:00:00.142) 0:01:31.021 ******* 2021-03-10T13:37:32.340 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-03-10T13:37:32.341 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2021-03-10T13:37:32.375 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:32 +0000 (0:00:00.043) 0:01:31.064 ******* 2021-03-10T13:37:32.405 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-03-10T13:37:32.407 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:32.429 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:32 +0000 (0:00:00.053) 0:01:31.118 ******* 2021-03-10T13:37:32.653 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-03-10T13:37:32.654 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2021-03-10T13:37:32.676 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:32 +0000 (0:00:00.246) 0:01:31.365 ******* 2021-03-10T13:37:32.724 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-03-10T13:37:32.726 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2021-03-10T13:37:32.748 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:32 +0000 (0:00:00.072) 0:01:31.437 ******* 2021-03-10T13:37:32.754 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-03-10T13:37:32.755 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:32.778 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:32 +0000 (0:00:00.029) 0:01:31.467 ******* 2021-03-10T13:37:33.042 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2021-03-10T13:37:33.044 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} TASK [testnode : Upload weekly kernel-clean crontab.] ************************** ok: [gibba045.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2021-03-10T13:37:33.065 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:33 +0000 (0:00:00.286) 0:01:31.754 ******* 2021-03-10T13:37:33.084 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:33 +0000 (0:00:00.018) 0:01:31.773 ******* 2021-03-10T13:37:33.337 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-03-10T13:37:33.339 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2021-03-10T13:37:33.363 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:33 +0000 (0:00:00.279) 0:01:32.052 ******* 2021-03-10T13:37:33.370 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2021-03-10T13:37:33.371 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-03-10T13:37:33.396 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:33 +0000 (0:00:00.032) 0:01:32.084 ******* 2021-03-10T13:37:33.497 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** ok: [gibba015.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-03-10T13:37:33.521 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:33 +0000 (0:00:00.125) 0:01:32.210 ******* 2021-03-10T13:37:33.578 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2021-03-10T13:37:33.580 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:33.602 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:33 +0000 (0:00:00.081) 0:01:32.291 ******* 2021-03-10T13:37:33.659 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-03-10T13:37:33.661 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:33.682 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:33 +0000 (0:00:00.080) 0:01:32.371 ******* 2021-03-10T13:37:33.688 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-03-10T13:37:33.689 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2021-03-10T13:37:33.714 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:33 +0000 (0:00:00.031) 0:01:32.403 ******* 2021-03-10T13:37:33.741 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2021-03-10T13:37:33.743 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:33.765 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:33 +0000 (0:00:00.051) 0:01:32.454 ******* 2021-03-10T13:37:33.833 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2021-03-10T13:37:33.834 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:33.854 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:33 +0000 (0:00:00.089) 0:01:32.543 ******* 2021-03-10T13:37:33.870 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-03-10T13:37:33.872 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-03-10T13:37:33.894 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:33 +0000 (0:00:00.039) 0:01:32.583 ******* 2021-03-10T13:37:33.921 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2021-03-10T13:37:33.922 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:33.944 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:33 +0000 (0:00:00.049) 0:01:32.633 ******* 2021-03-10T13:37:33.959 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2021-03-10T13:37:33.961 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:33.983 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:33 +0000 (0:00:00.039) 0:01:32.672 ******* 2021-03-10T13:37:34.011 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-10T13:37:34.013 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-03-10T13:37:34.045 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:34 +0000 (0:00:00.061) 0:01:32.734 ******* 2021-03-10T13:37:34.064 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-03-10T13:37:34.066 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:34.091 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:34 +0000 (0:00:00.045) 0:01:32.780 ******* 2021-03-10T13:37:34.128 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-03-10T13:37:34.130 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-03-10T13:37:34.140 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2021-03-10T13:37:34.142 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2021-03-10T13:37:34.151 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-03-10T13:37:34.153 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-03-10T13:37:34.162 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2021-03-10T13:37:34.164 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for NVMe drive] ***************************************** ok: [gibba015.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-03-10T13:37:34.185 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:34 +0000 (0:00:00.094) 0:01:32.874 ******* 2021-03-10T13:37:34.191 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2021-03-10T13:37:34.192 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-03-10T13:37:34.193 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2021-03-10T13:37:34.193 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2021-03-10T13:37:34.204 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-03-10T13:37:34.206 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-03-10T13:37:34.233 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:34 +0000 (0:00:00.047) 0:01:32.922 ******* 2021-03-10T13:37:34.249 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2021-03-10T13:37:34.251 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:34.273 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:34 +0000 (0:00:00.040) 0:01:32.962 ******* 2021-03-10T13:37:34.341 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2021-03-10T13:37:34.343 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:34.364 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:34 +0000 (0:00:00.091) 0:01:33.053 ******* 2021-03-10T13:37:34.441 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-10T13:37:34.443 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-03-10T13:37:34.464 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:34 +0000 (0:00:00.100) 0:01:33.153 ******* 2021-03-10T13:37:34.480 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-03-10T13:37:34.482 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.004341", "end": "2021-03-10 13:37:34.458110", "rc": 0, "start": "2021-03-10 13:37:34.453769", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_b6eecfe89a4363750d696160843a096384b357a8/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_b6eecfe89a4363750d696160843a096384b357a8/virtualenv/bin/teuthology-lock"]} 2021-03-10T13:37:34.507 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:34 +0000 (0:00:00.042) 0:01:33.196 ******* 2021-03-10T13:37:34.544 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-03-10T13:37:34.546 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} 2021-03-10T13:37:34.555 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-03-10T13:37:34.557 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2021-03-10T13:37:34.566 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2021-03-10T13:37:34.568 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-03-10T13:37:34.577 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-03-10T13:37:34.579 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:34.603 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:34 +0000 (0:00:00.096) 0:01:33.292 ******* 2021-03-10T13:37:34.609 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-03-10T13:37:34.609 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-03-10T13:37:34.611 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} skipping: [gibba045.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} skipping: [gibba045.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-03-10T13:37:34.611 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2021-03-10T13:37:34.612 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2021-03-10T13:37:34.612 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-03-10T13:37:34.623 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2021-03-10T13:37:34.625 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-03-10T13:37:34.650 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:34 +0000 (0:00:00.047) 0:01:33.339 ******* 2021-03-10T13:37:34.667 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2021-03-10T13:37:34.669 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:34.695 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:34 +0000 (0:00:00.044) 0:01:33.384 ******* 2021-03-10T13:37:34.774 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-03-10T13:37:34.775 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:34.796 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:34 +0000 (0:00:00.100) 0:01:33.485 ******* 2021-03-10T13:37:34.873 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-03-10T13:37:34.875 INFO:teuthology.task.ansible.out:changed: [gibba045.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003365", "end": "2021-03-10 13:37:34.848748", "rc": 0, "start": "2021-03-10 13:37:34.845383", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_b6eecfe89a4363750d696160843a096384b357a8/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_b6eecfe89a4363750d696160843a096384b357a8/virtualenv/bin/teuthology-lock"]} 2021-03-10T13:37:34.899 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:34 +0000 (0:00:00.103) 0:01:33.588 ******* 2021-03-10T13:37:34.968 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2021-03-10T13:37:34.970 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:34.998 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:34 +0000 (0:00:00.098) 0:01:33.687 ******* 2021-03-10T13:37:35.066 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2021-03-10T13:37:35.067 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:35.088 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:35 +0000 (0:00:00.090) 0:01:33.777 ******* 2021-03-10T13:37:35.155 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-03-10T13:37:35.156 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:35.177 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:35 +0000 (0:00:00.088) 0:01:33.866 ******* 2021-03-10T13:37:35.236 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-03-10T13:37:35.238 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"cache_update_time": 1615383348, "cache_updated": false, "changed": false} 2021-03-10T13:37:35.260 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:35 +0000 (0:00:00.083) 0:01:33.949 ******* 2021-03-10T13:37:35.320 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-03-10T13:37:35.322 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:35.342 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:35 +0000 (0:00:00.082) 0:01:34.031 ******* 2021-03-10T13:37:35.586 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-03-10T13:37:35.588 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'block_used': 13728330, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226366778, 'size_available': 927198322688, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 113650, 'block_size': 4096, 'inode_available': 60941326}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226366778, "block_size": 4096, "block_total": 240095108, "block_used": 13728330, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60941326, "inode_total": 61054976, "inode_used": 113650, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 927198322688, "size_total": 983429562368, "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}} 2021-03-10T13:37:35.610 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:35 +0000 (0:00:00.267) 0:01:34.299 ******* 2021-03-10T13:37:35.617 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-03-10T13:37:35.619 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => {"cache_update_time": 1615383353, "cache_updated": false, "changed": false} 2021-03-10T13:37:35.644 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:35 +0000 (0:00:00.033) 0:01:34.333 ******* 2021-03-10T13:37:35.712 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-03-10T13:37:35.713 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:35.734 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:35 +0000 (0:00:00.090) 0:01:34.423 ******* 2021-03-10T13:37:35.821 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-03-10T13:37:35.823 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item={'block_used': 13728330, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226366778, 'size_available': 927198322688, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 113650, 'block_size': 4096, 'inode_available': 60941326}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226366778, "block_size": 4096, "block_total": 240095108, "block_used": 13728330, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60941326, "inode_total": 61054976, "inode_used": 113650, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 927198322688, "size_total": 983429562368, "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}} 2021-03-10T13:37:35.844 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:35 +0000 (0:00:00.110) 0:01:34.533 ******* 2021-03-10T13:37:35.891 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-03-10T13:37:35.893 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.002458", "end": "2021-03-10 13:37:36.208447", "rc": 0, "start": "2021-03-10 13:37:36.205989", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T13:37:35.915 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:35 +0000 (0:00:00.070) 0:01:34.604 ******* 2021-03-10T13:37:35.983 INFO:teuthology.task.ansible.out:changed: [gibba045.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.002483", "end": "2021-03-10 13:37:36.082019", "rc": 0, "start": "2021-03-10 13:37:36.079536", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T13:37:36.006 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:36 +0000 (0:00:00.090) 0:01:34.695 ******* 2021-03-10T13:37:36.012 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-03-10T13:37:36.013 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'block_used': 13728330, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226366778, 'size_available': 927198322688, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 113650, 'block_size': 4096, 'inode_available': 60941326}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226366778, "block_size": 4096, "block_total": 240095108, "block_used": 13728330, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60941326, "inode_total": 61054976, "inode_used": 113650, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 927198322688, "size_total": 983429562368, "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:36.041 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:36 +0000 (0:00:00.034) 0:01:34.729 ******* 2021-03-10T13:37:36.079 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'block_used': 13728330, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226366778, 'size_available': 927198322688, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 113650, 'block_size': 4096, 'inode_available': 60941326}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226366778, "block_size": 4096, "block_total": 240095108, "block_used": 13728330, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60941326, "inode_total": 61054976, "inode_used": 113650, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 927198322688, "size_total": 983429562368, "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:36.103 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:36 +0000 (0:00:00.062) 0:01:34.792 ******* 2021-03-10T13:37:36.109 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-03-10T13:37:36.134 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:36 +0000 (0:00:00.030) 0:01:34.823 ******* 2021-03-10T13:37:36.185 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:36 +0000 (0:00:00.050) 0:01:34.874 ******* 2021-03-10T13:37:36.336 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-03-10T13:37:36.338 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:36.410 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:38.071 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-b8RaZec4Q0bjhPaF9bEcxUlM9gqi5pA4v3TcKib9RMrxOXOWbCjd1jsG4pnzNWY0'], 'uuids': ['741d5499-e990-4395-bc88-e14ee583629a']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.645856", "end": "2021-03-10 13:37:38.381406", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-b8RaZec4Q0bjhPaF9bEcxUlM9gqi5pA4v3TcKib9RMrxOXOWbCjd1jsG4pnzNWY0"], "labels": [], "masters": [], "uuids": ["741d5499-e990-4395-bc88-e14ee583629a"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 13:37:36.735550", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-10T13:37:38.083 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:38.094 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:38.178 INFO:teuthology.task.ansible.out:changed: [gibba045.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-ShvOrBHbpWREeuPNpMYqGxMPrl560bs4E6zuRrSBJblKeAUDdopF0KmcjDJyTCzJ'], 'uuids': ['55c33ada-3ebf-458c-b150-5747462cd828']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.675579", "end": "2021-03-10 13:37:38.264717", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-ShvOrBHbpWREeuPNpMYqGxMPrl560bs4E6zuRrSBJblKeAUDdopF0KmcjDJyTCzJ"], "labels": [], "masters": [], "uuids": ["55c33ada-3ebf-458c-b150-5747462cd828"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 13:37:36.589138", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-10T13:37:38.190 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:38.191 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:39.290 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-b8RaZec4Q0bjhPaF9bEcxUlM9gqi5pA4L5PyYtOb8Djte4kbiUZmp3v4HHEI5MKp'], 'uuids': ['6b88eb39-4dcb-4703-849d-034ec5713f90']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.121177", "end": "2021-03-10 13:37:39.601317", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-b8RaZec4Q0bjhPaF9bEcxUlM9gqi5pA4L5PyYtOb8Djte4kbiUZmp3v4HHEI5MKp"], "labels": [], "masters": [], "uuids": ["6b88eb39-4dcb-4703-849d-034ec5713f90"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 13:37:38.480140", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-10T13:37:39.302 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF', 'wwn-0x50000399ab801e93'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF-part1', 'wwn-0x50000399ab801e93-part1'], 'uuids': ['a79497c0-8b9d-46cc-9a4d-f403ab32c811']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x50000399ab801e93', 'model': 'TOSHIBA MG04ACA1', 'serial': 'Y9I3K3PZF6XF', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)", "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF", "wwn-0x50000399ab801e93"], "labels": [], "masters": [], "uuids": []}, "model": "TOSHIBA MG04ACA1", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF-part1", "wwn-0x50000399ab801e93-part1"], "labels": [], "masters": [], "uuids": ["a79497c0-8b9d-46cc-9a4d-f403ab32c811"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Y9I3K3PZF6XF", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x50000399ab801e93"}}, "skip_reason": "Cond 2021-03-10T13:37:39.303 INFO:teuthology.task.ansible.out:itional result was False"} 2021-03-10T13:37:39.375 INFO:teuthology.task.ansible.out:changed: [gibba045.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-ShvOrBHbpWREeuPNpMYqGxMPrl560bs4SzsJI5iYe2RMVAnYOuT03DjKTCyzjTEo'], 'uuids': ['dea4abb5-1995-48f5-9289-1a313e1d3db5']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.095545", "end": "2021-03-10 13:37:39.459240", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-ShvOrBHbpWREeuPNpMYqGxMPrl560bs4SzsJI5iYe2RMVAnYOuT03DjKTCyzjTEo"], "labels": [], "masters": [], "uuids": ["dea4abb5-1995-48f5-9289-1a313e1d3db5"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 13:37:38.363695", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-10T13:37:39.376 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF', 'wwn-0x50000399ab801e8a'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF-part1', 'wwn-0x50000399ab801e8a-part1'], 'uuids': ['a79497c0-8b9d-46cc-9a4d-f403ab32c811']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x50000399ab801e8a', 'model': 'TOSHIBA MG04ACA1', 'serial': 'Y9I3K3PQF6XF', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)", "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF", "wwn-0x50000399ab801e8a"], "labels": [], "masters": [], "uuids": []}, "model": "TOSHIBA MG04ACA1", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF-part1", "wwn-0x50000399ab801e8a-part1"], "labels": [], "masters": [], "uuids": ["a79497c0-8b9d-46cc-9a4d-f403ab32c811"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Y9I3K3PQF6XF", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x50000399ab801e8a"}}, "skip_reason": "Cond 2021-03-10T13:37:39.378 INFO:teuthology.task.ansible.out:itional result was False"} 2021-03-10T13:37:40.508 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '732585168', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-9qN2xb-NHps-RuID-cUSt-8VAG-60EK-oIYsrz', 'nvme-INTEL_SSDPEL1K375GA_PHKM913400GH375A', 'nvme-nvme.8086-50484b4d393133343030474833373541-494e54454c2053534450454c314b3337354741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEL1K375GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '349.32 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.123848", "end": "2021-03-10 13:37:40.817142", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]", "links": {"ids": ["lvm-pv-uuid-9qN2xb-NHps-RuID-cUSt-8VAG-60EK-oIYsrz", "nvme-INTEL_SSDPEL1K375GA_PHKM913400GH375A", "nvme-nvme.8086-50484b4d393133343030474833373541-494e54454c2053534450454c314b3337354741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEL1K375GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "732585168", "sectorsize": "512", "size": "349.32 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 13:37:39.693294", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nGPT data structures destroyed! You m 2021-03-10T13:37:40.510 INFO:teuthology.task.ansible.out:ay now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-10T13:37:40.520 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:40.531 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:40.584 INFO:teuthology.task.ansible.out:changed: [gibba045.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '732585168', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-5GFgcg-NPjz-C7De-0H8q-v3wS-q1ej-0yNCjC', 'nvme-INTEL_SSDPEL1K375GA_PHKM913400CR375A', 'nvme-nvme.8086-50484b4d393133343030435233373541-494e54454c2053534450454c314b3337354741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEL1K375GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '349.32 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.116283", "end": "2021-03-10 13:37:40.665602", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]", "links": {"ids": ["lvm-pv-uuid-5GFgcg-NPjz-C7De-0H8q-v3wS-q1ej-0yNCjC", "nvme-INTEL_SSDPEL1K375GA_PHKM913400CR375A", "nvme-nvme.8086-50484b4d393133343030435233373541-494e54454c2053534450454c314b3337354741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEL1K375GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "732585168", "sectorsize": "512", "size": "349.32 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 13:37:39.549319", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nGPT data structures destroyed! You m 2021-03-10T13:37:40.585 INFO:teuthology.task.ansible.out:ay now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} skipping: [gibba045.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:40.596 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:41.718 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '27262976', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-b8RaZec4Q0bjhPaF9bEcxUlM9gqi5pA4v66Hd3GuipptkB9AYesew1l0NpCVDxnn'], 'uuids': ['3c198638-d29d-44b6-ad64-948f014e19c3']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '13.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.110279", "end": "2021-03-10 13:37:42.028099", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-b8RaZec4Q0bjhPaF9bEcxUlM9gqi5pA4v66Hd3GuipptkB9AYesew1l0NpCVDxnn"], "labels": [], "masters": [], "uuids": ["3c198638-d29d-44b6-ad64-948f014e19c3"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "27262976", "sectorsize": "512", "size": "13.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 13:37:40.917820", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-10T13:37:41.729 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:41.740 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:41.794 INFO:teuthology.task.ansible.out:changed: [gibba045.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '27262976', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-ShvOrBHbpWREeuPNpMYqGxMPrl560bs4d4o522jdltn8p31ZAQoKD2HZQ2pbIu13'], 'uuids': ['024dc4e9-58ca-49c2-8e24-a01d1cb137ca']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '13.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.117112", "end": "2021-03-10 13:37:41.885237", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-ShvOrBHbpWREeuPNpMYqGxMPrl560bs4d4o522jdltn8p31ZAQoKD2HZQ2pbIu13"], "labels": [], "masters": [], "uuids": ["024dc4e9-58ca-49c2-8e24-a01d1cb137ca"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "27262976", "sectorsize": "512", "size": "13.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 13:37:40.768125", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-10T13:37:41.805 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:41.816 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:42.933 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-b8RaZec4Q0bjhPaF9bEcxUlM9gqi5pA4cKFlDeuaWPGocsaAEYIyRcnCqvFmkCLL'], 'uuids': ['68be1201-6b3b-4023-8b4c-0ff7e22237a1']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.112500", "end": "2021-03-10 13:37:43.237058", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-b8RaZec4Q0bjhPaF9bEcxUlM9gqi5pA4cKFlDeuaWPGocsaAEYIyRcnCqvFmkCLL"], "labels": [], "masters": [], "uuids": ["68be1201-6b3b-4023-8b4c-0ff7e22237a1"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 13:37:42.124558", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-10T13:37:42.945 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:43.008 INFO:teuthology.task.ansible.out:changed: [gibba045.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-ShvOrBHbpWREeuPNpMYqGxMPrl560bs4QmnoJmy0dZArzlkpcefYcXgiouZMmGMe'], 'uuids': ['677706f6-8ba6-4800-bbc6-e7ad704a75a3']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.093720", "end": "2021-03-10 13:37:43.085381", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-ShvOrBHbpWREeuPNpMYqGxMPrl560bs4QmnoJmy0dZArzlkpcefYcXgiouZMmGMe"], "labels": [], "masters": [], "uuids": ["677706f6-8ba6-4800-bbc6-e7ad704a75a3"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 13:37:41.991661", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-10T13:37:43.313 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:44.124 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-b8RaZec4Q0bjhPaF9bEcxUlM9gqi5pA4rBxZQEZldsYTftdLBeNQulGPBcm1L3Pj'], 'uuids': ['b727a1d2-54a8-46dd-8546-d9137f0ce124']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.098257", "end": "2021-03-10 13:37:44.429151", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-b8RaZec4Q0bjhPaF9bEcxUlM9gqi5pA4rBxZQEZldsYTftdLBeNQulGPBcm1L3Pj"], "labels": [], "masters": [], "uuids": ["b727a1d2-54a8-46dd-8546-d9137f0ce124"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 13:37:43.330894", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-10T13:37:44.155 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:44 +0000 (0:00:07.969) 0:01:42.844 ******* 2021-03-10T13:37:44.225 INFO:teuthology.task.ansible.out:changed: [gibba045.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-ShvOrBHbpWREeuPNpMYqGxMPrl560bs4dCk6rJUdfty02FzItVTzeeJ1EWItmite'], 'uuids': ['95861282-3ec0-4822-b5e3-decdc41b79d4']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.108560", "end": "2021-03-10 13:37:44.310569", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-ShvOrBHbpWREeuPNpMYqGxMPrl560bs4dCk6rJUdfty02FzItVTzeeJ1EWItmite"], "labels": [], "masters": [], "uuids": ["95861282-3ec0-4822-b5e3-decdc41b79d4"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 13:37:43.202009", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-10T13:37:44.259 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:44 +0000 (0:00:00.103) 0:01:42.948 ******* 2021-03-10T13:37:44.264 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-03-10T13:37:44.265 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:44.340 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:44.413 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-b8RaZec4Q0bjhPaF9bEcxUlM9gqi5pA4v3TcKib9RMrxOXOWbCjd1jsG4pnzNWY0'], 'uuids': ['741d5499-e990-4395-bc88-e14ee583629a']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.077112", "end": "2021-03-10 13:37:44.720890", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-b8RaZec4Q0bjhPaF9bEcxUlM9gqi5pA4v3TcKib9RMrxOXOWbCjd1jsG4pnzNWY0"], "labels": [], "masters": [], "uuids": ["741d5499-e990-4395-bc88-e14ee583629a"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 13:37:44.643778", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0758592 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0758592 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-03-10T13:37:44.414 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:44.426 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:44.510 INFO:teuthology.task.ansible.out:changed: [gibba045.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-ShvOrBHbpWREeuPNpMYqGxMPrl560bs4E6zuRrSBJblKeAUDdopF0KmcjDJyTCzJ'], 'uuids': ['55c33ada-3ebf-458c-b150-5747462cd828']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.078016", "end": "2021-03-10 13:37:44.596604", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-ShvOrBHbpWREeuPNpMYqGxMPrl560bs4E6zuRrSBJblKeAUDdopF0KmcjDJyTCzJ"], "labels": [], "masters": [], "uuids": ["55c33ada-3ebf-458c-b150-5747462cd828"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 13:37:44.518588", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0767694 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0767694 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-03-10T13:37:44.511 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:44.523 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:44.628 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-b8RaZec4Q0bjhPaF9bEcxUlM9gqi5pA4L5PyYtOb8Djte4kbiUZmp3v4HHEI5MKp'], 'uuids': ['6b88eb39-4dcb-4703-849d-034ec5713f90']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.078011", "end": "2021-03-10 13:37:44.943713", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-b8RaZec4Q0bjhPaF9bEcxUlM9gqi5pA4L5PyYtOb8Djte4kbiUZmp3v4HHEI5MKp"], "labels": [], "masters": [], "uuids": ["6b88eb39-4dcb-4703-849d-034ec5713f90"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 13:37:44.865702", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0768089 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0768089 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-03-10T13:37:44.639 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF', 'wwn-0x50000399ab801e93'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF-part1', 'wwn-0x50000399ab801e93-part1'], 'uuids': ['a79497c0-8b9d-46cc-9a4d-f403ab32c811']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x50000399ab801e93', 'model': 'TOSHIBA MG04ACA1', 'serial': 'Y9I3K3PZF6XF', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)", "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF", "wwn-0x50000399ab801e93"], "labels": [], "masters": [], "uuids": []}, "model": "TOSHIBA MG04ACA1", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF-part1", "wwn-0x50000399ab801e93-part1"], "labels": [], "masters": [], "uuids": ["a79497c0-8b9d-46cc-9a4d-f403ab32c811"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Y9I3K3PZF6XF", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x50000399ab801e93"}}, "skip_reason": "Cond 2021-03-10T13:37:44.641 INFO:teuthology.task.ansible.out:itional result was False"} 2021-03-10T13:37:44.682 INFO:teuthology.task.ansible.out:changed: [gibba045.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-ShvOrBHbpWREeuPNpMYqGxMPrl560bs4SzsJI5iYe2RMVAnYOuT03DjKTCyzjTEo'], 'uuids': ['dea4abb5-1995-48f5-9289-1a313e1d3db5']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.077468", "end": "2021-03-10 13:37:44.772070", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-ShvOrBHbpWREeuPNpMYqGxMPrl560bs4SzsJI5iYe2RMVAnYOuT03DjKTCyzjTEo"], "labels": [], "masters": [], "uuids": ["dea4abb5-1995-48f5-9289-1a313e1d3db5"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 13:37:44.694602", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0762081 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0762081 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-03-10T13:37:44.683 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF', 'wwn-0x50000399ab801e8a'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF-part1', 'wwn-0x50000399ab801e8a-part1'], 'uuids': ['a79497c0-8b9d-46cc-9a4d-f403ab32c811']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x50000399ab801e8a', 'model': 'TOSHIBA MG04ACA1', 'serial': 'Y9I3K3PQF6XF', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)", "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF", "wwn-0x50000399ab801e8a"], "labels": [], "masters": [], "uuids": []}, "model": "TOSHIBA MG04ACA1", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF-part1", "wwn-0x50000399ab801e8a-part1"], "labels": [], "masters": [], "uuids": ["a79497c0-8b9d-46cc-9a4d-f403ab32c811"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Y9I3K3PQF6XF", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x50000399ab801e8a"}}, "skip_reason": "Cond 2021-03-10T13:37:44.685 INFO:teuthology.task.ansible.out:itional result was False"} 2021-03-10T13:37:44.747 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '732585168', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-9qN2xb-NHps-RuID-cUSt-8VAG-60EK-oIYsrz', 'nvme-INTEL_SSDPEL1K375GA_PHKM913400GH375A', 'nvme-nvme.8086-50484b4d393133343030474833373541-494e54454c2053534450454c314b3337354741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEL1K375GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '349.32 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.025423", "end": "2021-03-10 13:37:45.061051", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]", "links": {"ids": ["lvm-pv-uuid-9qN2xb-NHps-RuID-cUSt-8VAG-60EK-oIYsrz", "nvme-INTEL_SSDPEL1K375GA_PHKM913400GH375A", "nvme-nvme.8086-50484b4d393133343030474833373541-494e54454c2053534450454c314b3337354741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEL1K375GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "732585168", "sectorsize": "512", "size": "349.32 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 13:37:45.035628", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0241752 s, 4.8 GB/s", "stderr_lines": ["1 2021-03-10T13:37:44.749 INFO:teuthology.task.ansible.out:10+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0241752 s, 4.8 GB/s"], "stdout": "", "stdout_lines": []} 2021-03-10T13:37:44.758 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:44.770 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:44.802 INFO:teuthology.task.ansible.out:changed: [gibba045.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '732585168', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-5GFgcg-NPjz-C7De-0H8q-v3wS-q1ej-0yNCjC', 'nvme-INTEL_SSDPEL1K375GA_PHKM913400CR375A', 'nvme-nvme.8086-50484b4d393133343030435233373541-494e54454c2053534450454c314b3337354741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEL1K375GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '349.32 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.025119", "end": "2021-03-10 13:37:44.890002", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]", "links": {"ids": ["lvm-pv-uuid-5GFgcg-NPjz-C7De-0H8q-v3wS-q1ej-0yNCjC", "nvme-INTEL_SSDPEL1K375GA_PHKM913400CR375A", "nvme-nvme.8086-50484b4d393133343030435233373541-494e54454c2053534450454c314b3337354741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEL1K375GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "732585168", "sectorsize": "512", "size": "349.32 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 13:37:44.864883", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0238914 s, 4.8 GB/s", "stderr_lines": ["1 2021-03-10T13:37:44.804 INFO:teuthology.task.ansible.out:10+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0238914 s, 4.8 GB/s"], "stdout": "", "stdout_lines": []} skipping: [gibba045.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:44.815 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:44.930 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '27262976', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-b8RaZec4Q0bjhPaF9bEcxUlM9gqi5pA4v66Hd3GuipptkB9AYesew1l0NpCVDxnn'], 'uuids': ['3c198638-d29d-44b6-ad64-948f014e19c3']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '13.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.077886", "end": "2021-03-10 13:37:45.238523", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-b8RaZec4Q0bjhPaF9bEcxUlM9gqi5pA4v66Hd3GuipptkB9AYesew1l0NpCVDxnn"], "labels": [], "masters": [], "uuids": ["3c198638-d29d-44b6-ad64-948f014e19c3"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "27262976", "sectorsize": "512", "size": "13.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 13:37:45.160637", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0766878 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0766878 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-03-10T13:37:44.931 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:44.942 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:44.984 INFO:teuthology.task.ansible.out:changed: [gibba045.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '27262976', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-ShvOrBHbpWREeuPNpMYqGxMPrl560bs4d4o522jdltn8p31ZAQoKD2HZQ2pbIu13'], 'uuids': ['024dc4e9-58ca-49c2-8e24-a01d1cb137ca']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '13.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.078300", "end": "2021-03-10 13:37:45.070911", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-ShvOrBHbpWREeuPNpMYqGxMPrl560bs4d4o522jdltn8p31ZAQoKD2HZQ2pbIu13"], "labels": [], "masters": [], "uuids": ["024dc4e9-58ca-49c2-8e24-a01d1cb137ca"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "27262976", "sectorsize": "512", "size": "13.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 13:37:44.992611", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0770648 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0770648 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-03-10T13:37:44.985 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:44.997 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:45.111 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-b8RaZec4Q0bjhPaF9bEcxUlM9gqi5pA4cKFlDeuaWPGocsaAEYIyRcnCqvFmkCLL'], 'uuids': ['68be1201-6b3b-4023-8b4c-0ff7e22237a1']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.077684", "end": "2021-03-10 13:37:45.418450", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-b8RaZec4Q0bjhPaF9bEcxUlM9gqi5pA4cKFlDeuaWPGocsaAEYIyRcnCqvFmkCLL"], "labels": [], "masters": [], "uuids": ["68be1201-6b3b-4023-8b4c-0ff7e22237a1"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 13:37:45.340766", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0764876 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0764876 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-03-10T13:37:45.112 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:45.155 INFO:teuthology.task.ansible.out:changed: [gibba045.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-ShvOrBHbpWREeuPNpMYqGxMPrl560bs4QmnoJmy0dZArzlkpcefYcXgiouZMmGMe'], 'uuids': ['677706f6-8ba6-4800-bbc6-e7ad704a75a3']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.077918", "end": "2021-03-10 13:37:45.248724", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-ShvOrBHbpWREeuPNpMYqGxMPrl560bs4QmnoJmy0dZArzlkpcefYcXgiouZMmGMe"], "labels": [], "masters": [], "uuids": ["677706f6-8ba6-4800-bbc6-e7ad704a75a3"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 13:37:45.170806", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0767061 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0767061 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-03-10T13:37:45.166 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:45.281 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-b8RaZec4Q0bjhPaF9bEcxUlM9gqi5pA4rBxZQEZldsYTftdLBeNQulGPBcm1L3Pj'], 'uuids': ['b727a1d2-54a8-46dd-8546-d9137f0ce124']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.077558", "end": "2021-03-10 13:37:45.591486", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-b8RaZec4Q0bjhPaF9bEcxUlM9gqi5pA4rBxZQEZldsYTftdLBeNQulGPBcm1L3Pj"], "labels": [], "masters": [], "uuids": ["b727a1d2-54a8-46dd-8546-d9137f0ce124"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 13:37:45.513928", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0762946 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0762946 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-03-10T13:37:45.313 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:45 +0000 (0:00:01.053) 0:01:44.001 ******* 2021-03-10T13:37:45.371 INFO:teuthology.task.ansible.out:changed: [gibba045.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-ShvOrBHbpWREeuPNpMYqGxMPrl560bs4dCk6rJUdfty02FzItVTzeeJ1EWItmite'], 'uuids': ['95861282-3ec0-4822-b5e3-decdc41b79d4']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.078065", "end": "2021-03-10 13:37:45.463722", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-ShvOrBHbpWREeuPNpMYqGxMPrl560bs4dCk6rJUdfty02FzItVTzeeJ1EWItmite"], "labels": [], "masters": [], "uuids": ["95861282-3ec0-4822-b5e3-decdc41b79d4"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 13:37:45.385657", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0768357 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0768357 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-03-10T13:37:45.414 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:45 +0000 (0:00:00.100) 0:01:44.102 ******* 2021-03-10T13:37:45.667 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-03-10T13:37:45.669 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.147908", "end": "2021-03-10 13:37:45.917376", "rc": 0, "start": "2021-03-10 13:37:45.769468", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T13:37:45.691 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:45 +0000 (0:00:00.277) 0:01:44.380 ******* 2021-03-10T13:37:45.789 INFO:teuthology.task.ansible.out:changed: [gibba045.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.206624", "end": "2021-03-10 13:37:45.817925", "rc": 0, "start": "2021-03-10 13:37:45.611301", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T13:37:45.812 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:45 +0000 (0:00:00.121) 0:01:44.501 ******* 2021-03-10T13:37:45.851 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-03-10T13:37:45.853 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.064447", "end": "2021-03-10 13:37:46.164517", "rc": 0, "start": "2021-03-10 13:37:46.100070", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T13:37:45.875 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:45 +0000 (0:00:00.062) 0:01:44.564 ******* 2021-03-10T13:37:45.942 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-03-10T13:37:46.006 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:46 +0000 (0:00:00.130) 0:01:44.695 ******* 2021-03-10T13:37:46.012 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-03-10T13:37:46.013 INFO:teuthology.task.ansible.out:changed: [gibba045.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.077387", "end": "2021-03-10 13:37:46.076998", "rc": 0, "start": "2021-03-10 13:37:45.999611", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T13:37:46.037 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:46 +0000 (0:00:00.031) 0:01:44.726 ******* 2021-03-10T13:37:46.043 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-03-10T13:37:46.045 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:46.069 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:46 +0000 (0:00:00.031) 0:01:44.758 ******* 2021-03-10T13:37:46.074 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-03-10T13:37:46.101 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:46 +0000 (0:00:00.031) 0:01:44.790 ******* 2021-03-10T13:37:46.106 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-03-10T13:37:46.108 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:46.131 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:46 +0000 (0:00:00.029) 0:01:44.820 ******* 2021-03-10T13:37:46.137 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-03-10T13:37:46.138 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:46.162 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:46 +0000 (0:00:00.031) 0:01:44.851 ******* 2021-03-10T13:37:46.167 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-03-10T13:37:46.169 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:46.193 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:46 +0000 (0:00:00.031) 0:01:44.882 ******* 2021-03-10T13:37:46.198 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-03-10T13:37:46.200 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:46.225 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:46 +0000 (0:00:00.031) 0:01:44.914 ******* 2021-03-10T13:37:46.231 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-03-10T13:37:46.233 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:46.255 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:46 +0000 (0:00:00.029) 0:01:44.944 ******* 2021-03-10T13:37:46.260 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-03-10T13:37:46.261 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:46.289 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:46 +0000 (0:00:00.034) 0:01:44.978 ******* 2021-03-10T13:37:46.328 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-03-10T13:37:46.329 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:46.351 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:46 +0000 (0:00:00.061) 0:01:45.040 ******* 2021-03-10T13:37:46.356 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-03-10T13:37:46.358 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-03-10T13:37:46.382 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:46 +0000 (0:00:00.030) 0:01:45.070 ******* 2021-03-10T13:37:46.417 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-03-10T13:37:46.419 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'block_used': 13728330, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226366778, 'size_available': 927198322688, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 113650, 'block_size': 4096, 'inode_available': 60941326}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226366778, "block_size": 4096, "block_total": 240095108, "block_used": 13728330, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60941326, "inode_total": 61054976, "inode_used": 113650, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 927198322688, "size_total": 983429562368, "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:46.441 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:46 +0000 (0:00:00.059) 0:01:45.130 ******* 2021-03-10T13:37:46.446 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-03-10T13:37:46.448 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-03-10T13:37:46.471 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:46 +0000 (0:00:00.030) 0:01:45.160 ******* 2021-03-10T13:37:46.476 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2021-03-10T13:37:46.477 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:46.500 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:46 +0000 (0:00:00.028) 0:01:45.189 ******* 2021-03-10T13:37:46.505 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-03-10T13:37:46.507 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'block_used': 13728330, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226366778, 'size_available': 927198322688, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 113650, 'block_size': 4096, 'inode_available': 60941326}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226366778, "block_size": 4096, "block_total": 240095108, "block_used": 13728330, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60941326, "inode_total": 61054976, "inode_used": 113650, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 927198322688, "size_total": 983429562368, "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:46.539 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:46 +0000 (0:00:00.039) 0:01:45.228 ******* 2021-03-10T13:37:46.543 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-10T13:37:46.545 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:46.566 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:46 +0000 (0:00:00.027) 0:01:45.255 ******* 2021-03-10T13:37:46.571 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2021-03-10T13:37:46.573 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:46.594 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:46 +0000 (0:00:00.027) 0:01:45.283 ******* 2021-03-10T13:37:46.599 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-10T13:37:46.600 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:46.622 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:46 +0000 (0:00:00.027) 0:01:45.311 ******* 2021-03-10T13:37:46.627 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-10T13:37:46.628 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:46.653 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:46 +0000 (0:00:00.030) 0:01:45.342 ******* 2021-03-10T13:37:46.657 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2021-03-10T13:37:46.659 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:46.681 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:46 +0000 (0:00:00.028) 0:01:45.370 ******* 2021-03-10T13:37:46.686 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-10T13:37:46.688 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:46.709 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:46 +0000 (0:00:00.027) 0:01:45.398 ******* 2021-03-10T13:37:46.714 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-03-10T13:37:46.715 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:46.737 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:46 +0000 (0:00:00.027) 0:01:45.426 ******* 2021-03-10T13:37:46.742 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2021-03-10T13:37:46.744 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:46.765 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:46 +0000 (0:00:00.028) 0:01:45.454 ******* 2021-03-10T13:37:46.770 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-03-10T13:37:46.771 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:46.794 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:46 +0000 (0:00:00.028) 0:01:45.483 ******* 2021-03-10T13:37:46.799 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-03-10T13:37:46.801 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:46.824 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:46 +0000 (0:00:00.030) 0:01:45.513 ******* 2021-03-10T13:37:46.852 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-03-10T13:37:46.854 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:46.875 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:46 +0000 (0:00:00.050) 0:01:45.564 ******* 2021-03-10T13:37:47.419 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2021-03-10T13:37:47.421 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-03-10T13:37:47.442 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:47 +0000 (0:00:00.567) 0:01:46.131 ******* 2021-03-10T13:37:47.490 INFO:teuthology.task.ansible.out:changed: [gibba045.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-03-10T13:37:47.513 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:47 +0000 (0:00:00.070) 0:01:46.202 ******* 2021-03-10T13:37:47.980 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-03-10T13:37:47.982 INFO:teuthology.task.ansible.out:changed: [gibba045.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-10T13:37:48.054 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-10T13:37:48.377 INFO:teuthology.task.ansible.out:changed: [gibba045.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-10T13:37:48.430 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-10T13:37:48.742 INFO:teuthology.task.ansible.out:changed: [gibba045.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-10T13:37:48.856 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-10T13:37:49.126 INFO:teuthology.task.ansible.out:changed: [gibba045.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-10T13:37:49.240 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-10T13:37:49.417 INFO:teuthology.task.ansible.out:changed: [gibba045.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '13G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "13G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-10T13:37:49.440 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:49 +0000 (0:00:01.927) 0:01:48.129 ******* 2021-03-10T13:37:49.549 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-03-10T13:37:49.550 INFO:teuthology.task.ansible.out:changed: [gibba045.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-03-10T13:37:49.571 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:49 +0000 (0:00:00.131) 0:01:48.260 ******* 2021-03-10T13:37:49.587 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-03-10T13:37:49.589 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '13G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "13G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-10T13:37:49.614 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:49 +0000 (0:00:00.042) 0:01:48.303 ******* 2021-03-10T13:37:49.714 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-03-10T13:37:49.716 INFO:teuthology.task.ansible.out:changed: [gibba045.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-03-10T13:37:49.726 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-03-10T13:37:49.728 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-03-10T13:37:49.749 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:49 +0000 (0:00:00.134) 0:01:48.438 ******* 2021-03-10T13:37:49.796 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-03-10T13:37:49.798 INFO:teuthology.task.ansible.out:changed: [gibba045.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-03-10T13:37:49.862 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-03-10T13:37:49.874 INFO:teuthology.task.ansible.out:changed: [gibba045.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-03-10T13:37:49.948 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-03-10T13:37:49.949 INFO:teuthology.task.ansible.out:changed: [gibba045.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-03-10T13:37:49.960 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '13G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "13G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:49.984 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:49 +0000 (0:00:00.235) 0:01:48.673 ******* 2021-03-10T13:37:50.010 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* 2021-03-10T13:37:50.012 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:50.035 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:50 +0000 (0:00:00.050) 0:01:48.724 ******* 2021-03-10T13:37:50.040 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-03-10T13:37:50.041 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-03-10T13:37:50.063 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-03-10T13:37:50.065 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:50.085 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:50 +0000 (0:00:00.049) 0:01:48.774 ******* 2021-03-10T13:37:50.100 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-03-10T13:37:50.102 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-03-10T13:37:50.112 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '13G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "13G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:50.138 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:50 +0000 (0:00:00.053) 0:01:48.827 ******* 2021-03-10T13:37:50.165 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* 2021-03-10T13:37:50.167 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:50.187 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:50 +0000 (0:00:00.048) 0:01:48.876 ******* 2021-03-10T13:37:50.193 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-03-10T13:37:50.195 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-03-10T13:37:50.216 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:50 +0000 (0:00:00.028) 0:01:48.905 ******* 2021-03-10T13:37:50.221 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-03-10T13:37:50.222 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:50.247 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:50 +0000 (0:00:00.030) 0:01:48.935 ******* 2021-03-10T13:37:50.252 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2021-03-10T13:37:50.254 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-03-10T13:37:50.278 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:50 +0000 (0:00:00.031) 0:01:48.967 ******* 2021-03-10T13:37:50.356 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-03-10T13:37:50.358 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-03-10T13:37:50.379 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:50 +0000 (0:00:00.101) 0:01:49.068 ******* 2021-03-10T13:37:50.416 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2021-03-10T13:37:50.418 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-03-10T13:37:50.439 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:50 +0000 (0:00:00.059) 0:01:49.127 ******* 2021-03-10T13:37:50.685 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2021-03-10T13:37:50.686 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => {"changed": true} 2021-03-10T13:37:50.708 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:50 +0000 (0:00:00.269) 0:01:49.397 ******* 2021-03-10T13:37:50.715 INFO:teuthology.task.ansible.out:changed: [gibba045.front.sepia.ceph.com] => {"changed": true} 2021-03-10T13:37:50.739 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:50 +0000 (0:00:00.030) 0:01:49.428 ******* 2021-03-10T13:37:51.118 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2021-03-10T13:37:51.120 INFO:teuthology.task.ansible.out:changed: [gibba045.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} changed: [gibba015.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-03-10T13:37:51.141 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:51 +0000 (0:00:00.401) 0:01:49.830 ******* 2021-03-10T13:37:51.161 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:51 +0000 (0:00:00.020) 0:01:49.850 ******* 2021-03-10T13:37:51.166 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** 2021-03-10T13:37:51.168 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:51.191 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:51 +0000 (0:00:00.029) 0:01:49.880 ******* 2021-03-10T13:37:51.197 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:51.220 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:51 +0000 (0:00:00.029) 0:01:49.909 ******* 2021-03-10T13:37:51.226 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** 2021-03-10T13:37:51.227 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:51.249 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:51 +0000 (0:00:00.028) 0:01:49.938 ******* 2021-03-10T13:37:51.255 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:51.279 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:51 +0000 (0:00:00.029) 0:01:49.968 ******* 2021-03-10T13:37:51.284 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-03-10T13:37:51.286 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:51.308 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:51 +0000 (0:00:00.029) 0:01:49.997 ******* 2021-03-10T13:37:51.314 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:51.336 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:51 +0000 (0:00:00.028) 0:01:50.025 ******* 2021-03-10T13:37:51.341 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-03-10T13:37:51.343 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:51.364 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:51 +0000 (0:00:00.027) 0:01:50.053 ******* 2021-03-10T13:37:51.369 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:51.393 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:51 +0000 (0:00:00.029) 0:01:50.082 ******* 2021-03-10T13:37:51.512 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2021-03-10T13:37:51.514 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-03-10T13:37:51.535 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:51 +0000 (0:00:00.141) 0:01:50.224 ******* 2021-03-10T13:37:51.540 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-03-10T13:37:51.570 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:51 +0000 (0:00:00.035) 0:01:50.259 ******* 2021-03-10T13:37:51.638 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-03-10T13:37:51.640 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2021-03-10T13:37:51.662 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:51 +0000 (0:00:00.091) 0:01:50.351 ******* 2021-03-10T13:37:51.688 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2021-03-10T13:37:51.711 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:51 +0000 (0:00:00.049) 0:01:50.400 ******* 2021-03-10T13:37:51.892 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2021-03-10T13:37:51.894 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-03-10T13:37:51.917 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:51 +0000 (0:00:00.205) 0:01:50.605 ******* 2021-03-10T13:37:51.944 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-03-10T13:37:51.968 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:51 +0000 (0:00:00.051) 0:01:50.657 ******* 2021-03-10T13:37:52.202 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2021-03-10T13:37:52.204 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} ok: [gibba015.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2021-03-10T13:37:52.225 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:52 +0000 (0:00:00.256) 0:01:50.914 ******* 2021-03-10T13:37:52.244 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:52 +0000 (0:00:00.018) 0:01:50.932 ******* 2021-03-10T13:37:52.643 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2021-03-10T13:37:52.644 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"cache_update_time": 1615383348, "cache_updated": false, "changed": false} ok: [gibba045.front.sepia.ceph.com] => {"cache_update_time": 1615383353, "cache_updated": false, "changed": false} 2021-03-10T13:37:52.664 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:52 +0000 (0:00:00.420) 0:01:51.353 ******* 2021-03-10T13:37:52.683 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:52 +0000 (0:00:00.018) 0:01:51.372 ******* 2021-03-10T13:37:52.897 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2021-03-10T13:37:52.898 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.138652", "end": "2021-03-10 13:37:53.209674", "rc": 0, "start": "2021-03-10 13:37:53.071022", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.30.0/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.30.0/Amazon/S3.pm"]} 2021-03-10T13:37:52.919 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:52 +0000 (0:00:00.236) 0:01:51.608 ******* 2021-03-10T13:37:52.945 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.139926", "end": "2021-03-10 13:37:53.036784", "rc": 0, "start": "2021-03-10 13:37:52.896858", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.30.0/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.30.0/Amazon/S3.pm"]} 2021-03-10T13:37:52.947 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:52.970 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:52 +0000 (0:00:00.050) 0:01:51.659 ******* 2021-03-10T13:37:52.989 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:52 +0000 (0:00:00.019) 0:01:51.678 ******* 2021-03-10T13:37:52.994 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2021-03-10T13:37:52.996 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:53.018 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:53 +0000 (0:00:00.028) 0:01:51.707 ******* 2021-03-10T13:37:53.023 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2021-03-10T13:37:53.024 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:53.047 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:53 +0000 (0:00:00.029) 0:01:51.736 ******* 2021-03-10T13:37:53.073 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2021-03-10T13:37:53.075 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:53.095 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:53 +0000 (0:00:00.047) 0:01:51.784 ******* 2021-03-10T13:37:53.411 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-03-10T13:37:53.413 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"cache_update_time": 1615383348, "cache_updated": false, "changed": false} 2021-03-10T13:37:53.433 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:53 +0000 (0:00:00.338) 0:01:52.122 ******* 2021-03-10T13:37:53.460 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2021-03-10T13:37:53.462 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:53.481 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:53 +0000 (0:00:00.047) 0:01:52.170 ******* 2021-03-10T13:37:53.497 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-03-10T13:37:53.499 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => {"cache_update_time": 1615383353, "cache_updated": false, "changed": false} 2021-03-10T13:37:53.521 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:53 +0000 (0:00:00.039) 0:01:52.209 ******* 2021-03-10T13:37:53.546 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2021-03-10T13:37:53.548 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:53.569 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:53 +0000 (0:00:00.048) 0:01:52.258 ******* 2021-03-10T13:37:53.718 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-03-10T13:37:53.720 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2021-03-10T13:37:53.742 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:53 +0000 (0:00:00.173) 0:01:52.431 ******* 2021-03-10T13:37:53.767 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-03-10T13:37:53.769 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:53.789 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:53 +0000 (0:00:00.047) 0:01:52.478 ******* 2021-03-10T13:37:53.805 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-03-10T13:37:53.807 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2021-03-10T13:37:53.834 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:53 +0000 (0:00:00.044) 0:01:52.523 ******* 2021-03-10T13:37:53.861 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-03-10T13:37:53.863 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:53.882 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:53 +0000 (0:00:00.048) 0:01:52.571 ******* 2021-03-10T13:37:53.940 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-03-10T13:37:53.941 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-03-10 13:35:15 UTC", "ActiveEnterTimestampMonotonic": "12247449", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "network.target -.mount system.slice systemd-journald.socket sysinit.target systemd-tmpfiles-setup.service basic.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-03-10 13:35:15 UTC", "AssertTimestampMonotonic": "12067036", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-03-10 13:35:15 UTC", "ConditionTimestampMonotonic": "12067035", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target systemd-timesyncd.service", "ControlGroup": 2021-03-10T13:37:53.942 INFO:teuthology.task.ansible.out:"/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documentation": "man:ntpd(8)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "957", "ExecMainStartTimestamp": "Wed 2021-03-10 13:35:15 UTC", "ExecMainStartTimestampMonotonic": "12247440", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-03-10 13:35:15 UTC", "InactiveExitTimestampMonotonic": "12067527", "InvocationID": "217abc1f5515412698c76419dc84a2ad", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "Limi 2021-03-10T13:37:53.944 INFO:teuthology.task.ansible.out:tCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127828", "LimitNPROCSoft": "127828", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127828", "LimitSIGPENDINGSoft": "127828", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "957", "MemoryAccounting": "yes", "MemoryCurrent": "4055040", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "Requir 2021-03-10T13:37:53.946 INFO:teuthology.task.ansible.out:esMountsFor": "/var/tmp /tmp", "Restart": "no", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-03-10 13:35:15 UTC", "StateChangeTimestampMonotonic": "12247449", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "38348", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-03-10T13:37:53.965 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:53 +0000 (0:00:00.082) 0:01:52.654 ******* 2021-03-10T13:37:53.991 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-10T13:37:53.993 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-03-10T13:37:54.013 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:54 +0000 (0:00:00.048) 0:01:52.702 ******* 2021-03-10T13:37:54.039 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-10T13:37:54.040 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} TASK [testnode : Make sure ntpd is running.] *********************************** 2021-03-10T13:37:54.041 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-03-10 13:35:14 UTC", "ActiveEnterTimestampMonotonic": "12521688", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-journald.socket -.mount network.target basic.target sysinit.target systemd-tmpfiles-setup.service system.slice", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-03-10 13:35:14 UTC", "AssertTimestampMonotonic": "12302798", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "suc 2021-03-10T13:37:54.042 INFO:teuthology.task.ansible.out:cess", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-03-10 13:35:14 UTC", "ConditionTimestampMonotonic": "12302797", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service shutdown.target", "ControlGroup": "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documentation": "man:ntpd(8)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "960", "ExecMainStartTimestamp": "Wed 2021-03-10 13:35:14 UTC", "ExecMainStartTimestampMonotonic": "12521680", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-03-10 13:35:14 UTC", "InactiveExitTimestampMonotonic": "12303442", "InvocationID": "2c7f86684254484b8 2021-03-10T13:37:54.044 INFO:teuthology.task.ansible.out:aecb13e2ac60af5", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127828", "LimitNPROCSoft": "127828", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127828", "LimitSIGPENDINGSoft": "127828", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "960", "MemoryAccounting": "yes", "MemoryCurrent": "4116480", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no" 2021-03-10T13:37:54.046 INFO:teuthology.task.ansible.out:, "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "no", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-03-10 13:35:14 UTC", "StateChangeTimestampMonotonic": "12521688", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "38348", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-03-10T13:37:54.063 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:54 +0000 (0:00:00.050) 0:01:52.752 ******* 2021-03-10T13:37:54.082 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:54 +0000 (0:00:00.018) 0:01:52.770 ******* 2021-03-10T13:37:54.087 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-03-10T13:37:54.088 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:54.109 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:54 +0000 (0:00:00.027) 0:01:52.798 ******* 2021-03-10T13:37:54.114 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-10T13:37:54.115 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-03-10T13:37:54.138 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:54 +0000 (0:00:00.029) 0:01:52.827 ******* 2021-03-10T13:37:54.165 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-10T13:37:54.166 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-03-10T13:37:54.187 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:54 +0000 (0:00:00.048) 0:01:52.876 ******* 2021-03-10T13:37:54.212 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-03-10T13:37:54.214 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:54.233 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:54 +0000 (0:00:00.046) 0:01:52.922 ******* 2021-03-10T13:37:54.939 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2021-03-10T13:37:54.941 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"cache_update_time": 1615383348, "cache_updated": false, "changed": false} 2021-03-10T13:37:54.961 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:54 +0000 (0:00:00.727) 0:01:53.650 ******* 2021-03-10T13:37:54.987 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-03-10T13:37:54.989 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:55.009 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:55 +0000 (0:00:00.047) 0:01:53.698 ******* 2021-03-10T13:37:55.096 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2021-03-10T13:37:55.098 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => {"cache_update_time": 1615383353, "cache_updated": false, "changed": false} 2021-03-10T13:37:55.121 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:55 +0000 (0:00:00.111) 0:01:53.809 ******* 2021-03-10T13:37:55.139 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2021-03-10T13:37:55.141 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-03-10T13:37:55.173 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:55 +0000 (0:00:00.052) 0:01:53.862 ******* 2021-03-10T13:37:55.180 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-03-10T13:37:55.182 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:55.209 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:55 +0000 (0:00:00.035) 0:01:53.898 ******* 2021-03-10T13:37:55.338 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2021-03-10T13:37:55.340 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-03-10T13:37:55.360 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:55 +0000 (0:00:00.151) 0:01:54.049 ******* 2021-03-10T13:37:55.479 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2021-03-10T13:37:55.481 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-03-10T13:37:55.504 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:55 +0000 (0:00:00.143) 0:01:54.193 ******* 2021-03-10T13:37:55.676 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-03-10T13:37:55.699 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:55 +0000 (0:00:00.195) 0:01:54.388 ******* 2021-03-10T13:37:57.390 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2021-03-10T13:37:57.392 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)\nRequirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)", "Requirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)"], "version": null, "virtualenv": null} 2021-03-10T13:37:57.414 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:57 +0000 (0:00:01.715) 0:01:56.103 ******* 2021-03-10T13:37:57.547 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)\nRequirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)", "Requirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)"], "version": null, "virtualenv": null} 2021-03-10T13:37:57.575 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:57 +0000 (0:00:00.160) 0:01:56.264 ******* 2021-03-10T13:37:57.747 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2021-03-10T13:37:57.749 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"changed": false} 2021-03-10T13:37:57.772 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:57 +0000 (0:00:00.196) 0:01:56.461 ******* 2021-03-10T13:37:57.799 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-03-10T13:37:57.801 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp1s0f0"}, "changed": false} 2021-03-10T13:37:57.822 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:57 +0000 (0:00:00.050) 0:01:56.511 ******* 2021-03-10T13:37:57.933 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2021-03-10T13:37:57.935 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => {"changed": false} 2021-03-10T13:37:57.958 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:57 +0000 (0:00:00.136) 0:01:56.647 ******* 2021-03-10T13:37:57.965 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-03-10T13:37:57.966 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1615383332.6942239, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1615383332.6902237, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 158, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1615383332.6902237, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "1582242096", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-03-10T13:37:57.990 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:57 +0000 (0:00:00.032) 0:01:56.679 ******* 2021-03-10T13:37:57.996 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-03-10T13:37:57.998 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp1s0f0"}, "changed": false} 2021-03-10T13:37:58.021 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:58 +0000 (0:00:00.030) 0:01:56.710 ******* 2021-03-10T13:37:58.142 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-03-10T13:37:58.144 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1615383330.1674774, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1615383330.1634774, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 158, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1615383330.1634774, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "1582242096", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-03-10T13:37:58.166 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:58 +0000 (0:00:00.144) 0:01:56.855 ******* 2021-03-10T13:37:58.380 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2021-03-10T13:37:58.382 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"changed": false, "msg": ""} ok: [gibba045.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2021-03-10T13:37:58.407 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:58 +0000 (0:00:00.240) 0:01:57.095 ******* 2021-03-10T13:37:58.427 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:58 +0000 (0:00:00.020) 0:01:57.116 ******* 2021-03-10T13:37:58.434 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-03-10T13:37:58.435 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-03-10T13:37:58.458 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:58 +0000 (0:00:00.030) 0:01:57.147 ******* 2021-03-10T13:37:58.463 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-03-10T13:37:58.487 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:58 +0000 (0:00:00.028) 0:01:57.176 ******* 2021-03-10T13:37:58.492 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2021-03-10T13:37:58.494 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:58.517 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:58 +0000 (0:00:00.029) 0:01:57.205 ******* 2021-03-10T13:37:58.522 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:58.547 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:58 +0000 (0:00:00.030) 0:01:57.236 ******* 2021-03-10T13:37:58.635 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2021-03-10T13:37:58.637 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-03-10T13:37:58.659 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:58 +0000 (0:00:00.111) 0:01:57.348 ******* 2021-03-10T13:37:58.675 INFO:teuthology.task.ansible.out:changed: [gibba045.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-03-10T13:37:58.700 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:58 +0000 (0:00:00.040) 0:01:57.389 ******* 2021-03-10T13:37:58.769 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-03-10T13:37:58.771 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-03-10T13:37:58.793 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:58 +0000 (0:00:00.092) 0:01:57.482 ******* 2021-03-10T13:37:58.819 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2021-03-10T13:37:58.821 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:58.842 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:58 +0000 (0:00:00.049) 0:01:57.531 ******* 2021-03-10T13:37:58.859 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-03-10T13:37:58.861 INFO:teuthology.task.ansible.out:changed: [gibba045.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-03-10T13:37:58.884 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:58 +0000 (0:00:00.041) 0:01:57.573 ******* 2021-03-10T13:37:58.890 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-03-10T13:37:58.892 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item=enp1s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f0", "skip_reason": "Conditional result was False"} 2021-03-10T13:37:58.892 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item=enp1s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f1", "skip_reason": "Conditional result was False"} 2021-03-10T13:37:58.892 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2021-03-10T13:37:58.916 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:58 +0000 (0:00:00.031) 0:01:57.605 ******* 2021-03-10T13:37:58.922 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2021-03-10T13:37:58.923 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:58.954 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:58 +0000 (0:00:00.037) 0:01:57.642 ******* 2021-03-10T13:37:58.963 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-03-10T13:37:58.964 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:58.975 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:58.977 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp1s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp1s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:59.003 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:59 +0000 (0:00:00.049) 0:01:57.692 ******* 2021-03-10T13:37:59.009 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-03-10T13:37:59.011 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} skipping: [gibba045.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} skipping: [gibba045.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-03-10T13:37:59.011 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item=enp1s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f1", "skip_reason": "Conditional result was False"} 2021-03-10T13:37:59.012 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item=enp1s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f0", "skip_reason": "Conditional result was False"} 2021-03-10T13:37:59.036 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:59 +0000 (0:00:00.032) 0:01:57.725 ******* 2021-03-10T13:37:59.041 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-10T13:37:59.043 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:59.070 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:59 +0000 (0:00:00.033) 0:01:57.759 ******* 2021-03-10T13:37:59.078 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-03-10T13:37:59.080 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [gibba045.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:59.091 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:59.093 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp1s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [gibba045.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp1s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:59.094 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:59.116 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:59 +0000 (0:00:00.046) 0:01:57.805 ******* 2021-03-10T13:37:59.134 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:59 +0000 (0:00:00.018) 0:01:57.823 ******* 2021-03-10T13:37:59.140 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2021-03-10T13:37:59.142 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:59.167 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:59 +0000 (0:00:00.032) 0:01:57.856 ******* 2021-03-10T13:37:59.173 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-10T13:37:59.175 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:59.200 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:59 +0000 (0:00:00.032) 0:01:57.889 ******* 2021-03-10T13:37:59.205 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-03-10T13:37:59.207 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:59.229 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:59 +0000 (0:00:00.028) 0:01:57.918 ******* 2021-03-10T13:37:59.235 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2021-03-10T13:37:59.236 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:59.259 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:59 +0000 (0:00:00.030) 0:01:57.948 ******* 2021-03-10T13:37:59.264 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-03-10T13:37:59.266 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:59.290 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:59 +0000 (0:00:00.030) 0:01:57.979 ******* 2021-03-10T13:37:59.295 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2021-03-10T13:37:59.297 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:59.321 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:59 +0000 (0:00:00.030) 0:01:58.010 ******* 2021-03-10T13:37:59.326 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-03-10T13:37:59.327 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:59.355 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:59 +0000 (0:00:00.034) 0:01:58.044 ******* 2021-03-10T13:37:59.361 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-03-10T13:37:59.363 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:59.386 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:59 +0000 (0:00:00.031) 0:01:58.075 ******* 2021-03-10T13:37:59.391 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2021-03-10T13:37:59.393 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:59.416 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:59 +0000 (0:00:00.030) 0:01:58.105 ******* 2021-03-10T13:37:59.422 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-03-10T13:37:59.423 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:59.448 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:59 +0000 (0:00:00.031) 0:01:58.137 ******* 2021-03-10T13:37:59.454 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-03-10T13:37:59.456 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:59.479 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:59 +0000 (0:00:00.030) 0:01:58.168 ******* 2021-03-10T13:37:59.485 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-03-10T13:37:59.487 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:59.514 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:59 +0000 (0:00:00.034) 0:01:58.203 ******* 2021-03-10T13:37:59.542 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2021-03-10T13:37:59.544 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:59.566 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:59 +0000 (0:00:00.051) 0:01:58.255 ******* 2021-03-10T13:37:59.592 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-03-10T13:37:59.594 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:37:59.615 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:59 +0000 (0:00:00.048) 0:01:58.304 ******* 2021-03-10T13:37:59.632 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-03-10T13:37:59.634 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.002546", "end": "2021-03-10 13:37:59.924848", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-03-10 13:37:59.922302", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T13:37:59.716 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.001836", "end": "2021-03-10 13:38:00.028739", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-03-10 13:38:00.026903", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T13:37:59.758 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.002498", "end": "2021-03-10 13:37:59.840822", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-03-10 13:37:59.838324", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T13:37:59.821 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.001686", "end": "2021-03-10 13:38:00.124866", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-03-10 13:38:00.123180", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-03-10T13:37:59.852 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.001843", "end": "2021-03-10 13:37:59.940160", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-03-10 13:37:59.938317", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T13:37:59.936 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.024562", "end": "2021-03-10 13:38:00.244679", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-03-10 13:38:00.220117", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T13:37:59.962 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:37:59 +0000 (0:00:00.346) 0:01:58.651 ******* 2021-03-10T13:37:59.969 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.001709", "end": "2021-03-10 13:38:00.035680", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-03-10 13:38:00.033971", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-03-10T13:37:59.991 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-03-10T13:38:00.014 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:00 +0000 (0:00:00.052) 0:01:58.703 ******* 2021-03-10T13:38:00.104 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-03-10T13:38:00.106 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.030893", "end": "2021-03-10 13:38:00.173073", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-03-10 13:38:00.142180", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T13:38:00.130 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:00 +0000 (0:00:00.116) 0:01:58.819 ******* 2021-03-10T13:38:00.148 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-03-10T13:38:00.150 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-03-10T13:38:00.175 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-03-10T13:38:00.205 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:00 +0000 (0:00:00.074) 0:01:58.894 ******* 2021-03-10T13:38:00.337 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-03-10T13:38:00.338 INFO:teuthology.task.ansible.out:changed: [gibba045.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-03-10T13:38:00.403 INFO:teuthology.task.ansible.out: PLAY [testnodes,senta,vossi,jenkins_slaves] ************************************ 2021-03-10T13:38:00.420 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:00 +0000 (0:00:00.214) 0:01:59.109 ******* 2021-03-10T13:38:00.444 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:00 +0000 (0:00:00.023) 0:01:59.132 ******* 2021-03-10T13:38:01.273 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [gibba015.front.sepia.ceph.com] 2021-03-10T13:38:01.323 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:01 +0000 (0:00:00.879) 0:02:00.012 ******* 2021-03-10T13:38:01.366 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-03-10T13:38:01.367 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-03-10T13:38:01.390 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:01 +0000 (0:00:00.066) 0:02:00.079 ******* 2021-03-10T13:38:01.408 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2021-03-10T13:38:01.409 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] 2021-03-10T13:38:01.443 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-03-10T13:38:01.444 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:01.464 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:01 +0000 (0:00:00.074) 0:02:00.153 ******* 2021-03-10T13:38:01.503 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:01 +0000 (0:00:00.038) 0:02:00.191 ******* 2021-03-10T13:38:01.523 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2021-03-10T13:38:01.525 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-03-10T13:38:01.547 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:01 +0000 (0:00:00.044) 0:02:00.236 ******* 2021-03-10T13:38:01.555 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-03-10T13:38:01.556 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-03-10T13:38:01.581 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:01 +0000 (0:00:00.033) 0:02:00.270 ******* 2021-03-10T13:38:01.608 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-03-10T13:38:01.610 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:01.638 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:01 +0000 (0:00:00.057) 0:02:00.327 ******* 2021-03-10T13:38:01.676 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2021-03-10T13:38:01.678 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-03-10T13:38:01.699 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:01 +0000 (0:00:00.061) 0:02:00.388 ******* 2021-03-10T13:38:02.015 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-03-10T13:38:02.017 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"cache_update_time": 1615383348, "cache_updated": false, "changed": false} 2021-03-10T13:38:02.039 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:02 +0000 (0:00:00.339) 0:02:00.728 ******* 2021-03-10T13:38:02.066 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-03-10T13:38:02.068 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:02.089 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:02 +0000 (0:00:00.050) 0:02:00.778 ******* 2021-03-10T13:38:02.127 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-03-10T13:38:02.128 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2021-03-10T13:38:02.149 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:02 +0000 (0:00:00.060) 0:02:00.838 ******* 2021-03-10T13:38:02.166 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-03-10T13:38:02.167 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => {"cache_update_time": 1615383353, "cache_updated": false, "changed": false} 2021-03-10T13:38:02.191 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:02 +0000 (0:00:00.041) 0:02:00.880 ******* 2021-03-10T13:38:02.217 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-03-10T13:38:02.219 INFO:teuthology.task.ansible.out:skipping: [gibba045.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:38:02.241 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:02 +0000 (0:00:00.049) 0:02:00.930 ******* 2021-03-10T13:38:02.267 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-03-10T13:38:02.268 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2021-03-10T13:38:02.289 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:02 +0000 (0:00:00.048) 0:02:00.978 ******* 2021-03-10T13:38:02.307 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2021-03-10T13:38:02.308 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-03-10T13:38:02.412 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-03-10T13:38:02.439 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:02 +0000 (0:00:00.149) 0:02:01.128 ******* 2021-03-10T13:38:02.457 INFO:teuthology.task.ansible.out:changed: [gibba045.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-03-10T13:38:02.552 INFO:teuthology.task.ansible.out:changed: [gibba045.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-03-10T13:38:02.578 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:02 +0000 (0:00:00.138) 0:02:01.267 ******* 2021-03-10T13:38:02.770 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2021-03-10T13:38:02.772 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1615383482.4895108-32725-233651543591883/source", "state": "file", "uid": 0} 2021-03-10T13:38:02.905 INFO:teuthology.task.ansible.out:changed: [gibba045.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1615383482.62769-32740-125349103692462/source", "state": "file", "uid": 0} 2021-03-10T13:38:03.044 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1615383482.781748-32725-245599181069375/source", "state": "file", "uid": 0} 2021-03-10T13:38:03.068 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:03 +0000 (0:00:00.490) 0:02:01.757 ******* 2021-03-10T13:38:03.198 INFO:teuthology.task.ansible.out:changed: [gibba045.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1615383482.9356487-32740-173088563402380/source", "state": "file", "uid": 0} 2021-03-10T13:38:03.222 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:03 +0000 (0:00:00.154) 0:02:01.911 ******* 2021-03-10T13:38:06.306 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** 2021-03-10T13:38:06.308 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => {"changed": true, "cmd": ["/usr/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": " Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-nj9u7rxh\n", "stderr_lines": [" Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-nj9u7rxh"], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-nj9u7rxh\nCollecting docopt\n Downloading docopt-0.6.2.tar.gz (25 kB)\nCollecting toml\n Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB)\nBuilding wheels for collected packages: registries-conf-ctl, docopt\n Building wheel for registries-conf-ctl (setup.py): started\n Building wheel for registries-conf-ctl (setup.py): finished with status 'done'\n Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=6035 sha256=31ddc0c70e6a665b27ee52f3409d5463130474f5cae2191f9ff7b48a1f143ae3\n Stored in directory: /tmp/pip-ephem-wheel-cache-evzvq8u6/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42\n Building wheel for docopt (setup.py): started\n Building wheel for docopt (setup.py): finished with status 'done'\n Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13704 sha256=b68bbdda29da3fba0b8ac052eca96041034dffca001c542bf16b14e3ae79c7f0\n Stored in directory: /root/.cache/pip/wheels/56/ea/58/ead137b087d9e326852a851351d1debf4ada529b6ac0ec4e8c\nSuccessfully built registries-conf-ctl docopt\nInstalling collected packages: docopt, toml, registries-conf-ctl\nSuccessfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2\n", "stdout_lines": ["Collecting git+https://github.c 2021-03-10T13:38:06.309 INFO:teuthology.task.ansible.out:om/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-nj9u7rxh", "Collecting docopt", " Downloading docopt-0.6.2.tar.gz (25 kB)", "Collecting toml", " Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB)", "Building wheels for collected packages: registries-conf-ctl, docopt", " Building wheel for registries-conf-ctl (setup.py): started", " Building wheel for registries-conf-ctl (setup.py): finished with status 'done'", " Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=6035 sha256=31ddc0c70e6a665b27ee52f3409d5463130474f5cae2191f9ff7b48a1f143ae3", " Stored in directory: /tmp/pip-ephem-wheel-cache-evzvq8u6/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42", " Building wheel for docopt (setup.py): started", " Building wheel for docopt (setup.py): finished with status 'done'", " Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13704 sha256=b68bbdda29da3fba0b8ac052eca96041034dffca001c542bf16b14e3ae79c7f0", " Stored in directory: /root/.cache/pip/wheels/56/ea/58/ead137b087d9e326852a851351d1debf4ada529b6ac0ec4e8c", "Successfully built registries-conf-ctl docopt", "Installing collected packages: docopt, toml, registries-conf-ctl", "Successfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2"], "version": null, "virtualenv": null} 2021-03-10T13:38:06.331 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:06 +0000 (0:00:03.108) 0:02:05.020 ******* 2021-03-10T13:38:06.461 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* 2021-03-10T13:38:06.463 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-03-10T13:38:06.490 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:06 +0000 (0:00:00.158) 0:02:05.178 ******* 2021-03-10T13:38:06.671 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** 2021-03-10T13:38:06.673 INFO:teuthology.task.ansible.out:changed: [gibba045.front.sepia.ceph.com] => {"changed": true, "cmd": ["/usr/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": " Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-tdczyp5d\n", "stderr_lines": [" Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-tdczyp5d"], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-tdczyp5d\nCollecting docopt\n Downloading docopt-0.6.2.tar.gz (25 kB)\nCollecting toml\n Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB)\nBuilding wheels for collected packages: registries-conf-ctl, docopt\n Building wheel for registries-conf-ctl (setup.py): started\n Building wheel for registries-conf-ctl (setup.py): finished with status 'done'\n Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=6035 sha256=3d9bfc43154c0852febedf400045feeaef8a1bd6dd288a894221449b7e9d26fd\n Stored in directory: /tmp/pip-ephem-wheel-cache-rxgq5w4r/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42\n Building wheel for docopt (setup.py): started\n Building wheel for docopt (setup.py): finished with status 'done'\n Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13704 sha256=b68bbdda29da3fba0b8ac052eca96041034dffca001c542bf16b14e3ae79c7f0\n Stored in directory: /root/.cache/pip/wheels/56/ea/58/ead137b087d9e326852a851351d1debf4ada529b6ac0ec4e8c\nSuccessfully built registries-conf-ctl docopt\nInstalling collected packages: docopt, toml, registries-conf-ctl\nSuccessfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2\n", "stdout_lines": ["Collecting git+https://github.c 2021-03-10T13:38:06.675 INFO:teuthology.task.ansible.out:om/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-tdczyp5d", "Collecting docopt", " Downloading docopt-0.6.2.tar.gz (25 kB)", "Collecting toml", " Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB)", "Building wheels for collected packages: registries-conf-ctl, docopt", " Building wheel for registries-conf-ctl (setup.py): started", " Building wheel for registries-conf-ctl (setup.py): finished with status 'done'", " Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=6035 sha256=3d9bfc43154c0852febedf400045feeaef8a1bd6dd288a894221449b7e9d26fd", " Stored in directory: /tmp/pip-ephem-wheel-cache-rxgq5w4r/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42", " Building wheel for docopt (setup.py): started", " Building wheel for docopt (setup.py): finished with status 'done'", " Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13704 sha256=b68bbdda29da3fba0b8ac052eca96041034dffca001c542bf16b14e3ae79c7f0", " Stored in directory: /root/.cache/pip/wheels/56/ea/58/ead137b087d9e326852a851351d1debf4ada529b6ac0ec4e8c", "Successfully built registries-conf-ctl docopt", "Installing collected packages: docopt, toml, registries-conf-ctl", "Successfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2"], "version": null, "virtualenv": null} 2021-03-10T13:38:06.696 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:06 +0000 (0:00:00.206) 0:02:05.385 ******* 2021-03-10T13:38:06.805 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/docker/daemon.json if necessary] ************ 2021-03-10T13:38:06.807 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => {"changed": true, "checksum": "bf21a9e8fbc5a3846fb05b4fa0859e0917b2202f", "dest": "/etc/docker/daemon.json", "gid": 0, "group": "root", "md5sum": "99914b932bd37a50b983c5e7c90ae93b", "mode": "0644", "owner": "root", "size": 2, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1615383486.5375628-363-60591770777891/source", "state": "file", "uid": 0} 2021-03-10T13:38:06.830 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:06 +0000 (0:00:00.133) 0:02:05.519 ******* 2021-03-10T13:38:06.857 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* 2021-03-10T13:38:06.858 INFO:teuthology.task.ansible.out:ok: [gibba045.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-03-10T13:38:06.881 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:06 +0000 (0:00:00.051) 0:02:05.570 ******* 2021-03-10T13:38:07.001 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-03-10T13:38:07.002 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.019086", "end": "2021-03-10 13:38:07.310075", "rc": 0, "start": "2021-03-10 13:38:07.290989", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T13:38:07.025 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:07 +0000 (0:00:00.143) 0:02:05.714 ******* 2021-03-10T13:38:07.186 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/docker/daemon.json if necessary] ************ 2021-03-10T13:38:07.188 INFO:teuthology.task.ansible.out:changed: [gibba045.front.sepia.ceph.com] => {"changed": true, "checksum": "bf21a9e8fbc5a3846fb05b4fa0859e0917b2202f", "dest": "/etc/docker/daemon.json", "gid": 0, "group": "root", "md5sum": "99914b932bd37a50b983c5e7c90ae93b", "mode": "0644", "owner": "root", "size": 2, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1615383486.9250507-389-191980109248940/source", "state": "file", "uid": 0} 2021-03-10T13:38:07.212 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:07 +0000 (0:00:00.187) 0:02:05.901 ******* 2021-03-10T13:38:07.385 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-03-10T13:38:07.386 INFO:teuthology.task.ansible.out:changed: [gibba045.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.019344", "end": "2021-03-10 13:38:07.479126", "rc": 0, "start": "2021-03-10 13:38:07.459782", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T13:38:07.408 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:38:07 +0000 (0:00:00.195) 0:02:06.097 ******* 2021-03-10T13:38:10.977 INFO:teuthology.task.ansible.out: TASK [container-host : Restart docker service] ********************************* 2021-03-10T13:38:10.979 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "firewalld.service basic.target systemd-journald.socket containerd.service network-online.target system.slice sysinit.target docker.socket", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ConsistsOf": "docker.socket", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "yes", "DelegateControllers": "cpu cpuacct cpuset io blkio memory devices pids bpf-fire 2021-03-10T13:38:10.980 INFO:teuthology.task.ansible.out:wall bpf-devices", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", " 2021-03-10T13:38:10.982 INFO:teuthology.task.ansible.out:LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127828", "LimitSIGPENDINGSoft": "127828", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMPolicy": "continue", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", 2021-03-10T13:38:10.983 INFO:teuthology.task.ansible.out:"RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target docker.socket system.slice", "Restart": "always", "RestartKillSignal": "15", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-03-10 13:35:40 UTC", "StateChangeTimestampMonotonic": "36724087", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "infinity", "TimeoutAbortUSec": "infinity", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSec": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-online.target containerd.service", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-03-10T13:38:11.095 INFO:teuthology.task.ansible.out:changed: [gibba045.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "docker.socket system.slice sysinit.target basic.target network-online.target containerd.service firewalld.service systemd-journald.socket", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ConsistsOf": "docker.socket", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "yes", "DelegateControllers": "cpu cpuacct cpuset io blkio memory devices pids bpf-fire 2021-03-10T13:38:11.097 INFO:teuthology.task.ansible.out:wall bpf-devices", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", " 2021-03-10T13:38:11.099 INFO:teuthology.task.ansible.out:LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127828", "LimitSIGPENDINGSoft": "127828", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMPolicy": "continue", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", 2021-03-10T13:38:11.100 INFO:teuthology.task.ansible.out:"RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target docker.socket", "Restart": "always", "RestartKillSignal": "15", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-03-10 13:35:37 UTC", "StateChangeTimestampMonotonic": "35126973", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "infinity", "TimeoutAbortUSec": "infinity", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSec": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "containerd.service network-online.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-03-10T13:38:11.162 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2021-03-10T13:38:11.163 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched 2021-03-10T13:38:11.165 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** skipping: no hosts matched PLAY RECAP ********************************************************************* gibba015.front.sepia.ceph.com : ok=129 changed=35 unreachable=0 failed=0 skipped=182 rescued=0 ignored=0 gibba045.front.sepia.ceph.com : ok=129 changed=35 unreachable=0 failed=0 skipped=182 rescued=0 ignored=0 Wednesday 10 March 2021 13:38:11 +0000 (0:00:03.756) 0:02:09.853 ******* =============================================================================== 2021-03-10T13:38:11.165 INFO:teuthology.task.ansible.out:users : Update authorized_keys using the keys repo --------------------- 13.24s Create all admin users with sudo access. ------------------------------- 12.92s testnode : Install packages --------------------------------------------- 9.07s testnode : Ensure packages are not present. ----------------------------- 8.75s testnode : Zap all non-root disks --------------------------------------- 7.97s Remove revoked users ---------------------------------------------------- 4.62s container-host : Restart docker service --------------------------------- 3.76s container-host : Install registries-conf-ctl ---------------------------- 3.11s testnode : Create logical volume(s) ------------------------------------- 1.93s Gathering Facts --------------------------------------------------------- 1.83s testnode : Install packages via pip ------------------------------------- 1.72s testnode : Install apt keys --------------------------------------------- 1.70s testnode : Update apt cache. -------------------------------------------- 1.32s users : Update authorized_keys for each user with literal keys ---------- 1.29s 2021-03-10T13:38:11.166 INFO:teuthology.task.ansible.out:testnode : Blow away lingering OSD data and FSIDs ----------------------- 1.05s common : Mask sleep units ----------------------------------------------- 1.04s common : Update apt cache ----------------------------------------------- 0.97s Gathering Facts - 2021-03-10T13:38:11.167 INFO:teuthology.task.ansible.out:-------------------------------------------------------- 0.88s common : Set the hardware clock ----------------------------------------- 0.85s Gathering Facts --------------------------------------------------------- 0.74s 2021-03-10T13:38:11.481 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@gibba015.front.sepia.ceph.com'), Remote(name='ubuntu@gibba045.front.sepia.ceph.com')] 2021-03-10T13:38:11.483 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-03-10T13:38:11.484 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba015.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-03-10T13:38:11.517 DEBUG:teuthology.orchestra.run.gibba015:> true 2021-03-10T13:38:11.598 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-03-10T13:38:11.599 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-03-10T13:38:11.631 DEBUG:teuthology.orchestra.run.gibba045:> true 2021-03-10T13:38:11.714 INFO:teuthology.run_tasks:Running task clock... 2021-03-10T13:38:11.738 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2021-03-10T13:38:11.739 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-03-10T13:38:11.740 DEBUG:teuthology.orchestra.run.gibba015:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-03-10T13:38:11.761 INFO:teuthology.orchestra.run.gibba015.stdout:10 Mar 13:38:12 ntpd[8687]: ntpd 4.2.8p12@1.3728-o (1): Starting 2021-03-10T13:38:11.761 INFO:teuthology.orchestra.run.gibba015.stdout:10 Mar 13:38:12 ntpd[8687]: Command line: ntpd -gq 2021-03-10T13:38:11.762 INFO:teuthology.orchestra.run.gibba015.stdout:10 Mar 13:38:12 ntpd[8687]: proto: precision = 0.034 usec (-25) 2021-03-10T13:38:11.762 INFO:teuthology.orchestra.run.gibba015.stdout:10 Mar 13:38:12 ntpd[8687]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-03-10T13:38:11.762 INFO:teuthology.orchestra.run.gibba015.stdout:10 Mar 13:38:12 ntpd[8687]: restrict ::: KOD does nothing without LIMITED. 2021-03-10T13:38:11.763 INFO:teuthology.orchestra.run.gibba015.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-03-10T13:38:11.763 INFO:teuthology.orchestra.run.gibba015.stderr:restrict ::: KOD does nothing without LIMITED. 2021-03-10T13:38:11.764 INFO:teuthology.orchestra.run.gibba015.stdout:10 Mar 13:38:12 ntpd[8687]: Listen and drop on 0 v6wildcard [::]:123 2021-03-10T13:38:11.764 INFO:teuthology.orchestra.run.gibba015.stdout:10 Mar 13:38:12 ntpd[8687]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-03-10T13:38:11.764 INFO:teuthology.orchestra.run.gibba015.stdout:10 Mar 13:38:12 ntpd[8687]: Listen normally on 2 lo 127.0.0.1:123 2021-03-10T13:38:11.764 INFO:teuthology.orchestra.run.gibba015.stdout:10 Mar 13:38:12 ntpd[8687]: Listen normally on 3 enp1s0f0 172.21.2.115:123 2021-03-10T13:38:11.765 INFO:teuthology.orchestra.run.gibba015.stdout:10 Mar 13:38:12 ntpd[8687]: Listen normally on 4 lo [::1]:123 2021-03-10T13:38:11.765 INFO:teuthology.orchestra.run.gibba015.stdout:10 Mar 13:38:12 ntpd[8687]: Listen normally on 5 enp1s0f0 [fe80::3eec:efff:fe3d:9252%4]:123 2021-03-10T13:38:11.765 INFO:teuthology.orchestra.run.gibba015.stdout:10 Mar 13:38:12 ntpd[8687]: Listening on routing socket on fd #22 for interface updates 2021-03-10T13:38:13.762 INFO:teuthology.orchestra.run.gibba015.stderr:10 Mar 13:38:14 ntpd[8687]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:38:13.763 INFO:teuthology.orchestra.run.gibba015.stderr:10 Mar 13:38:14 ntpd[8687]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:38:13.763 INFO:teuthology.orchestra.run.gibba015.stderr:10 Mar 13:38:14 ntpd[8687]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:38:13.763 INFO:teuthology.orchestra.run.gibba015.stderr:10 Mar 13:38:14 ntpd[8687]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:38:13.763 INFO:teuthology.orchestra.run.gibba015.stderr:10 Mar 13:38:14 ntpd[8687]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T13:38:13.763 INFO:teuthology.orchestra.run.gibba015.stderr:10 Mar 13:38:14 ntpd[8687]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T13:38:15.762 INFO:teuthology.orchestra.run.gibba015.stderr:10 Mar 13:38:16 ntpd[8687]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:38:15.763 INFO:teuthology.orchestra.run.gibba015.stderr:10 Mar 13:38:16 ntpd[8687]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:38:15.763 INFO:teuthology.orchestra.run.gibba015.stderr:10 Mar 13:38:16 ntpd[8687]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:38:15.763 INFO:teuthology.orchestra.run.gibba015.stderr:10 Mar 13:38:16 ntpd[8687]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:38:15.763 INFO:teuthology.orchestra.run.gibba015.stderr:10 Mar 13:38:16 ntpd[8687]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:38:15.764 INFO:teuthology.orchestra.run.gibba015.stderr:10 Mar 13:38:16 ntpd[8687]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:38:15.764 INFO:teuthology.orchestra.run.gibba015.stderr:10 Mar 13:38:16 ntpd[8687]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T13:38:15.764 INFO:teuthology.orchestra.run.gibba015.stderr:10 Mar 13:38:16 ntpd[8687]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T13:38:15.764 INFO:teuthology.orchestra.run.gibba015.stderr:10 Mar 13:38:16 ntpd[8687]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:38:15.765 INFO:teuthology.orchestra.run.gibba015.stderr:10 Mar 13:38:16 ntpd[8687]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:38:15.765 INFO:teuthology.orchestra.run.gibba015.stderr:10 Mar 13:38:16 ntpd[8687]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T13:38:15.765 INFO:teuthology.orchestra.run.gibba015.stderr:10 Mar 13:38:16 ntpd[8687]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T13:38:16.763 INFO:teuthology.orchestra.run.gibba015.stderr:10 Mar 13:38:17 ntpd[8687]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:38:16.763 INFO:teuthology.orchestra.run.gibba015.stderr:10 Mar 13:38:17 ntpd[8687]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:38:16.763 INFO:teuthology.orchestra.run.gibba015.stderr:10 Mar 13:38:17 ntpd[8687]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:38:16.763 INFO:teuthology.orchestra.run.gibba015.stderr:10 Mar 13:38:17 ntpd[8687]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:38:16.764 INFO:teuthology.orchestra.run.gibba015.stderr:10 Mar 13:38:17 ntpd[8687]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:38:16.764 INFO:teuthology.orchestra.run.gibba015.stderr:10 Mar 13:38:17 ntpd[8687]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:38:16.764 INFO:teuthology.orchestra.run.gibba015.stderr:10 Mar 13:38:17 ntpd[8687]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T13:38:16.764 INFO:teuthology.orchestra.run.gibba015.stderr:10 Mar 13:38:17 ntpd[8687]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T13:38:16.765 INFO:teuthology.orchestra.run.gibba015.stderr:10 Mar 13:38:17 ntpd[8687]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:38:16.765 INFO:teuthology.orchestra.run.gibba015.stderr:10 Mar 13:38:17 ntpd[8687]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:38:16.765 INFO:teuthology.orchestra.run.gibba015.stderr:10 Mar 13:38:17 ntpd[8687]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T13:38:16.765 INFO:teuthology.orchestra.run.gibba015.stderr:10 Mar 13:38:17 ntpd[8687]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T13:38:17.763 INFO:teuthology.orchestra.run.gibba015.stderr:10 Mar 13:38:18 ntpd[8687]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:38:17.763 INFO:teuthology.orchestra.run.gibba015.stderr:10 Mar 13:38:18 ntpd[8687]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:38:17.763 INFO:teuthology.orchestra.run.gibba015.stderr:10 Mar 13:38:18 ntpd[8687]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:38:17.763 INFO:teuthology.orchestra.run.gibba015.stderr:10 Mar 13:38:18 ntpd[8687]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:38:17.764 INFO:teuthology.orchestra.run.gibba015.stderr:10 Mar 13:38:18 ntpd[8687]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:38:17.764 INFO:teuthology.orchestra.run.gibba015.stderr:10 Mar 13:38:18 ntpd[8687]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:38:17.764 INFO:teuthology.orchestra.run.gibba015.stderr:10 Mar 13:38:18 ntpd[8687]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T13:38:17.764 INFO:teuthology.orchestra.run.gibba015.stderr:10 Mar 13:38:18 ntpd[8687]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T13:38:17.765 INFO:teuthology.orchestra.run.gibba015.stderr:10 Mar 13:38:18 ntpd[8687]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:38:17.765 INFO:teuthology.orchestra.run.gibba015.stderr:10 Mar 13:38:18 ntpd[8687]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:38:17.765 INFO:teuthology.orchestra.run.gibba015.stderr:10 Mar 13:38:18 ntpd[8687]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T13:38:17.765 INFO:teuthology.orchestra.run.gibba015.stderr:10 Mar 13:38:18 ntpd[8687]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T13:38:18.763 INFO:teuthology.orchestra.run.gibba015.stderr:10 Mar 13:38:19 ntpd[8687]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:38:18.763 INFO:teuthology.orchestra.run.gibba015.stderr:10 Mar 13:38:19 ntpd[8687]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:38:18.763 INFO:teuthology.orchestra.run.gibba015.stderr:10 Mar 13:38:19 ntpd[8687]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:38:18.764 INFO:teuthology.orchestra.run.gibba015.stderr:10 Mar 13:38:19 ntpd[8687]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:38:18.764 INFO:teuthology.orchestra.run.gibba015.stderr:10 Mar 13:38:19 ntpd[8687]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:38:18.764 INFO:teuthology.orchestra.run.gibba015.stderr:10 Mar 13:38:19 ntpd[8687]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:38:18.764 INFO:teuthology.orchestra.run.gibba015.stderr:10 Mar 13:38:19 ntpd[8687]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T13:38:18.765 INFO:teuthology.orchestra.run.gibba015.stderr:10 Mar 13:38:19 ntpd[8687]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T13:38:18.765 INFO:teuthology.orchestra.run.gibba015.stderr:10 Mar 13:38:19 ntpd[8687]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:38:18.765 INFO:teuthology.orchestra.run.gibba015.stderr:10 Mar 13:38:19 ntpd[8687]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:38:18.765 INFO:teuthology.orchestra.run.gibba015.stderr:10 Mar 13:38:19 ntpd[8687]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T13:38:18.765 INFO:teuthology.orchestra.run.gibba015.stderr:10 Mar 13:38:19 ntpd[8687]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T13:38:19.763 INFO:teuthology.orchestra.run.gibba015.stderr:10 Mar 13:38:20 ntpd[8687]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:38:19.764 INFO:teuthology.orchestra.run.gibba015.stderr:10 Mar 13:38:20 ntpd[8687]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:38:19.764 INFO:teuthology.orchestra.run.gibba015.stderr:10 Mar 13:38:20 ntpd[8687]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:38:19.764 INFO:teuthology.orchestra.run.gibba015.stderr:10 Mar 13:38:20 ntpd[8687]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:38:19.765 INFO:teuthology.orchestra.run.gibba015.stderr:10 Mar 13:38:20 ntpd[8687]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:38:19.765 INFO:teuthology.orchestra.run.gibba015.stderr:10 Mar 13:38:20 ntpd[8687]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:38:19.766 INFO:teuthology.orchestra.run.gibba015.stderr:10 Mar 13:38:20 ntpd[8687]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T13:38:19.766 INFO:teuthology.orchestra.run.gibba015.stderr:10 Mar 13:38:20 ntpd[8687]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T13:38:19.767 INFO:teuthology.orchestra.run.gibba015.stderr:10 Mar 13:38:20 ntpd[8687]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:38:19.767 INFO:teuthology.orchestra.run.gibba015.stderr:10 Mar 13:38:20 ntpd[8687]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:38:19.767 INFO:teuthology.orchestra.run.gibba015.stderr:10 Mar 13:38:20 ntpd[8687]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T13:38:19.768 INFO:teuthology.orchestra.run.gibba015.stderr:10 Mar 13:38:20 ntpd[8687]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T13:38:19.769 INFO:teuthology.orchestra.run.gibba015.stdout:10 Mar 13:38:19 ntpd[8687]: ntpd: time set -0.330184 s 2021-03-10T13:38:19.770 INFO:teuthology.orchestra.run.gibba015.stdout:ntpd: time set -0.330184s 2021-03-10T13:38:19.771 INFO:teuthology.orchestra.run.gibba015.stderr:10 Mar 13:38:19 ntpd[8687]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2021-03-10T13:38:19.771 INFO:teuthology.orchestra.run.gibba015.stderr:10 Mar 13:38:19 ntpd[8687]: can't open /var/log/ntpstats/loopstats.20210310: Permission denied 2021-03-10T13:38:19.852 INFO:teuthology.orchestra.run.gibba015.stdout: remote refid st t when poll reach delay offset jitter 2021-03-10T13:38:19.853 INFO:teuthology.orchestra.run.gibba015.stdout:============================================================================== 2021-03-10T13:38:19.853 INFO:teuthology.orchestra.run.gibba015.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-03-10T13:38:19.853 INFO:teuthology.orchestra.run.gibba015.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-03-10T13:38:19.854 INFO:teuthology.orchestra.run.gibba015.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-03-10T13:38:19.854 INFO:teuthology.orchestra.run.gibba015.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-03-10T13:38:19.856 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-03-10T13:38:19.856 DEBUG:teuthology.orchestra.run.gibba045:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-03-10T13:38:19.878 INFO:teuthology.orchestra.run.gibba045.stdout:10 Mar 13:38:19 ntpd[8644]: ntpd 4.2.8p12@1.3728-o (1): Starting 2021-03-10T13:38:19.879 INFO:teuthology.orchestra.run.gibba045.stdout:10 Mar 13:38:19 ntpd[8644]: Command line: ntpd -gq 2021-03-10T13:38:19.879 INFO:teuthology.orchestra.run.gibba045.stdout:10 Mar 13:38:19 ntpd[8644]: proto: precision = 0.033 usec (-25) 2021-03-10T13:38:19.880 INFO:teuthology.orchestra.run.gibba045.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-03-10T13:38:19.880 INFO:teuthology.orchestra.run.gibba045.stdout:10 Mar 13:38:19 ntpd[8644]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-03-10T13:38:19.881 INFO:teuthology.orchestra.run.gibba045.stderr:restrict ::: KOD does nothing without LIMITED. 2021-03-10T13:38:19.883 INFO:teuthology.orchestra.run.gibba045.stdout:10 Mar 13:38:19 ntpd[8644]: restrict ::: KOD does nothing without LIMITED. 2021-03-10T13:38:19.883 INFO:teuthology.orchestra.run.gibba045.stdout:10 Mar 13:38:19 ntpd[8644]: Listen and drop on 0 v6wildcard [::]:123 2021-03-10T13:38:19.883 INFO:teuthology.orchestra.run.gibba045.stdout:10 Mar 13:38:19 ntpd[8644]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-03-10T13:38:19.884 INFO:teuthology.orchestra.run.gibba045.stdout:10 Mar 13:38:19 ntpd[8644]: Listen normally on 2 lo 127.0.0.1:123 2021-03-10T13:38:19.884 INFO:teuthology.orchestra.run.gibba045.stdout:10 Mar 13:38:19 ntpd[8644]: Listen normally on 3 enp1s0f0 172.21.2.145:123 2021-03-10T13:38:19.884 INFO:teuthology.orchestra.run.gibba045.stdout:10 Mar 13:38:19 ntpd[8644]: Listen normally on 4 lo [::1]:123 2021-03-10T13:38:19.884 INFO:teuthology.orchestra.run.gibba045.stdout:10 Mar 13:38:19 ntpd[8644]: Listen normally on 5 enp1s0f0 [fe80::3eec:efff:fe3d:91b4%4]:123 2021-03-10T13:38:19.885 INFO:teuthology.orchestra.run.gibba045.stdout:10 Mar 13:38:19 ntpd[8644]: Listening on routing socket on fd #22 for interface updates 2021-03-10T13:38:20.878 INFO:teuthology.orchestra.run.gibba045.stderr:10 Mar 13:38:20 ntpd[8644]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:38:20.879 INFO:teuthology.orchestra.run.gibba045.stderr:10 Mar 13:38:20 ntpd[8644]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:38:20.879 INFO:teuthology.orchestra.run.gibba045.stderr:10 Mar 13:38:20 ntpd[8644]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:38:20.879 INFO:teuthology.orchestra.run.gibba045.stderr:10 Mar 13:38:20 ntpd[8644]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:38:20.880 INFO:teuthology.orchestra.run.gibba045.stderr:10 Mar 13:38:20 ntpd[8644]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T13:38:20.880 INFO:teuthology.orchestra.run.gibba045.stderr:10 Mar 13:38:20 ntpd[8644]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T13:38:21.879 INFO:teuthology.orchestra.run.gibba045.stderr:10 Mar 13:38:21 ntpd[8644]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:38:21.880 INFO:teuthology.orchestra.run.gibba045.stderr:10 Mar 13:38:21 ntpd[8644]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:38:21.880 INFO:teuthology.orchestra.run.gibba045.stderr:10 Mar 13:38:21 ntpd[8644]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:38:21.880 INFO:teuthology.orchestra.run.gibba045.stderr:10 Mar 13:38:21 ntpd[8644]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:38:21.880 INFO:teuthology.orchestra.run.gibba045.stderr:10 Mar 13:38:21 ntpd[8644]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T13:38:21.881 INFO:teuthology.orchestra.run.gibba045.stderr:10 Mar 13:38:21 ntpd[8644]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T13:38:22.879 INFO:teuthology.orchestra.run.gibba045.stderr:10 Mar 13:38:22 ntpd[8644]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:38:22.879 INFO:teuthology.orchestra.run.gibba045.stderr:10 Mar 13:38:22 ntpd[8644]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:38:22.880 INFO:teuthology.orchestra.run.gibba045.stderr:10 Mar 13:38:22 ntpd[8644]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:38:22.880 INFO:teuthology.orchestra.run.gibba045.stderr:10 Mar 13:38:22 ntpd[8644]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:38:22.880 INFO:teuthology.orchestra.run.gibba045.stderr:10 Mar 13:38:22 ntpd[8644]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T13:38:22.880 INFO:teuthology.orchestra.run.gibba045.stderr:10 Mar 13:38:22 ntpd[8644]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T13:38:23.880 INFO:teuthology.orchestra.run.gibba045.stderr:10 Mar 13:38:23 ntpd[8644]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:38:23.881 INFO:teuthology.orchestra.run.gibba045.stderr:10 Mar 13:38:23 ntpd[8644]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:38:23.881 INFO:teuthology.orchestra.run.gibba045.stderr:10 Mar 13:38:23 ntpd[8644]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:38:23.882 INFO:teuthology.orchestra.run.gibba045.stderr:10 Mar 13:38:23 ntpd[8644]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:38:23.882 INFO:teuthology.orchestra.run.gibba045.stderr:10 Mar 13:38:23 ntpd[8644]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:38:23.882 INFO:teuthology.orchestra.run.gibba045.stderr:10 Mar 13:38:23 ntpd[8644]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:38:23.882 INFO:teuthology.orchestra.run.gibba045.stderr:10 Mar 13:38:23 ntpd[8644]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T13:38:23.883 INFO:teuthology.orchestra.run.gibba045.stderr:10 Mar 13:38:23 ntpd[8644]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T13:38:23.883 INFO:teuthology.orchestra.run.gibba045.stderr:10 Mar 13:38:23 ntpd[8644]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:38:23.883 INFO:teuthology.orchestra.run.gibba045.stderr:10 Mar 13:38:23 ntpd[8644]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:38:23.883 INFO:teuthology.orchestra.run.gibba045.stderr:10 Mar 13:38:23 ntpd[8644]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T13:38:23.883 INFO:teuthology.orchestra.run.gibba045.stderr:10 Mar 13:38:23 ntpd[8644]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T13:38:24.880 INFO:teuthology.orchestra.run.gibba045.stderr:10 Mar 13:38:24 ntpd[8644]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:38:24.880 INFO:teuthology.orchestra.run.gibba045.stderr:10 Mar 13:38:24 ntpd[8644]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:38:24.880 INFO:teuthology.orchestra.run.gibba045.stderr:10 Mar 13:38:24 ntpd[8644]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:38:24.880 INFO:teuthology.orchestra.run.gibba045.stderr:10 Mar 13:38:24 ntpd[8644]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:38:24.881 INFO:teuthology.orchestra.run.gibba045.stderr:10 Mar 13:38:24 ntpd[8644]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:38:24.881 INFO:teuthology.orchestra.run.gibba045.stderr:10 Mar 13:38:24 ntpd[8644]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:38:24.881 INFO:teuthology.orchestra.run.gibba045.stderr:10 Mar 13:38:24 ntpd[8644]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T13:38:24.881 INFO:teuthology.orchestra.run.gibba045.stderr:10 Mar 13:38:24 ntpd[8644]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T13:38:24.882 INFO:teuthology.orchestra.run.gibba045.stderr:10 Mar 13:38:24 ntpd[8644]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:38:24.882 INFO:teuthology.orchestra.run.gibba045.stderr:10 Mar 13:38:24 ntpd[8644]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:38:24.882 INFO:teuthology.orchestra.run.gibba045.stderr:10 Mar 13:38:24 ntpd[8644]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T13:38:24.882 INFO:teuthology.orchestra.run.gibba045.stderr:10 Mar 13:38:24 ntpd[8644]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T13:38:25.880 INFO:teuthology.orchestra.run.gibba045.stderr:10 Mar 13:38:25 ntpd[8644]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:38:25.880 INFO:teuthology.orchestra.run.gibba045.stderr:10 Mar 13:38:25 ntpd[8644]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:38:25.881 INFO:teuthology.orchestra.run.gibba045.stderr:10 Mar 13:38:25 ntpd[8644]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:38:25.881 INFO:teuthology.orchestra.run.gibba045.stderr:10 Mar 13:38:25 ntpd[8644]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:38:25.881 INFO:teuthology.orchestra.run.gibba045.stderr:10 Mar 13:38:25 ntpd[8644]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:38:25.881 INFO:teuthology.orchestra.run.gibba045.stderr:10 Mar 13:38:25 ntpd[8644]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:38:25.882 INFO:teuthology.orchestra.run.gibba045.stderr:10 Mar 13:38:25 ntpd[8644]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T13:38:25.882 INFO:teuthology.orchestra.run.gibba045.stderr:10 Mar 13:38:25 ntpd[8644]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T13:38:25.882 INFO:teuthology.orchestra.run.gibba045.stderr:10 Mar 13:38:25 ntpd[8644]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:38:25.882 INFO:teuthology.orchestra.run.gibba045.stderr:10 Mar 13:38:25 ntpd[8644]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:38:25.883 INFO:teuthology.orchestra.run.gibba045.stderr:10 Mar 13:38:25 ntpd[8644]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T13:38:25.883 INFO:teuthology.orchestra.run.gibba045.stderr:10 Mar 13:38:25 ntpd[8644]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T13:38:26.879 INFO:teuthology.orchestra.run.gibba045.stderr:10 Mar 13:38:26 ntpd[8644]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:38:26.880 INFO:teuthology.orchestra.run.gibba045.stderr:10 Mar 13:38:26 ntpd[8644]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:38:26.880 INFO:teuthology.orchestra.run.gibba045.stderr:10 Mar 13:38:26 ntpd[8644]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:38:26.880 INFO:teuthology.orchestra.run.gibba045.stderr:10 Mar 13:38:26 ntpd[8644]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:38:26.880 INFO:teuthology.orchestra.run.gibba045.stderr:10 Mar 13:38:26 ntpd[8644]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:38:26.881 INFO:teuthology.orchestra.run.gibba045.stderr:10 Mar 13:38:26 ntpd[8644]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:38:26.881 INFO:teuthology.orchestra.run.gibba045.stderr:10 Mar 13:38:26 ntpd[8644]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T13:38:26.881 INFO:teuthology.orchestra.run.gibba045.stderr:10 Mar 13:38:26 ntpd[8644]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T13:38:26.882 INFO:teuthology.orchestra.run.gibba045.stdout:10 Mar 13:38:26 ntpd[8644]: ntpd: time set -0.107365 s 2021-03-10T13:38:26.882 INFO:teuthology.orchestra.run.gibba045.stdout:ntpd: time set -0.107365s 2021-03-10T13:38:26.883 INFO:teuthology.orchestra.run.gibba045.stderr:10 Mar 13:38:26 ntpd[8644]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2021-03-10T13:38:26.883 INFO:teuthology.orchestra.run.gibba045.stderr:10 Mar 13:38:26 ntpd[8644]: can't open /var/log/ntpstats/loopstats.20210310: Permission denied 2021-03-10T13:38:26.973 INFO:teuthology.orchestra.run.gibba045.stdout: remote refid st t when poll reach delay offset jitter 2021-03-10T13:38:26.973 INFO:teuthology.orchestra.run.gibba045.stdout:============================================================================== 2021-03-10T13:38:26.973 INFO:teuthology.orchestra.run.gibba045.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-03-10T13:38:26.974 INFO:teuthology.orchestra.run.gibba045.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-03-10T13:38:26.974 INFO:teuthology.orchestra.run.gibba045.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-03-10T13:38:26.974 INFO:teuthology.orchestra.run.gibba045.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-03-10T13:38:26.975 INFO:teuthology.run_tasks:Running task cephadm... 2021-03-10T13:38:27.060 INFO:tasks.cephadm:Config: {'allow_ptrace': False, 'cephadm_branch': 'v15.2.0', 'cephadm_git_url': 'https://github.com/ceph/ceph', 'image': 'docker.io/ceph/ceph:v15.2.0', 'conf': {'global': {'mon election default strategy': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug filestore': 20, 'debug journal': 20, 'debug ms': 1, 'debug osd': 25, 'osd shutdown pgref assert': True}}, 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': 'b26fc080937a021ce826cdc94d1adb52c064381a'} 2021-03-10T13:38:27.061 INFO:tasks.cephadm:Cluster image is docker.io/ceph/ceph:v15.2.0 2021-03-10T13:38:27.062 INFO:tasks.cephadm:Cluster fsid is e4a642d2-81a5-11eb-9080-001a4aab830c 2021-03-10T13:38:27.062 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2021-03-10T13:38:27.063 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.2.115', 'mon.c': '[v2:172.21.2.115:3301,v1:172.21.2.115:6790]', 'mon.b': '172.21.2.145'} 2021-03-10T13:38:27.063 INFO:tasks.cephadm:First mon is mon.a on gibba015 2021-03-10T13:38:27.064 INFO:tasks.cephadm:First mgr is y 2021-03-10T13:38:27.064 INFO:tasks.cephadm:Normalizing hostnames... 2021-03-10T13:38:27.064 DEBUG:teuthology.orchestra.run.gibba015:> sudo hostname $(hostname -s) 2021-03-10T13:38:27.081 DEBUG:teuthology.orchestra.run.gibba045:> sudo hostname $(hostname -s) 2021-03-10T13:38:27.097 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref v15.2.0)... 2021-03-10T13:38:27.098 DEBUG:teuthology.orchestra.run.gibba015:> curl --silent https://raw.githubusercontent.com/ceph/ceph/v15.2.0/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2021-03-10T13:38:27.353 INFO:teuthology.orchestra.run.gibba015.stdout:-rw-rw-r-- 1 ubuntu ubuntu 151122 Mar 10 13:38 /home/ubuntu/cephtest/cephadm 2021-03-10T13:38:27.354 DEBUG:teuthology.orchestra.run.gibba045:> curl --silent https://raw.githubusercontent.com/ceph/ceph/v15.2.0/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2021-03-10T13:38:27.462 INFO:teuthology.orchestra.run.gibba045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 151122 Mar 10 13:38 /home/ubuntu/cephtest/cephadm 2021-03-10T13:38:27.462 DEBUG:teuthology.orchestra.run.gibba015:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2021-03-10T13:38:27.474 DEBUG:teuthology.orchestra.run.gibba045:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2021-03-10T13:38:27.492 DEBUG:teuthology.orchestra.run.gibba015:> sudo mkdir -p /etc/ceph 2021-03-10T13:38:27.513 DEBUG:teuthology.orchestra.run.gibba045:> sudo mkdir -p /etc/ceph 2021-03-10T13:38:27.524 DEBUG:teuthology.orchestra.run.gibba015:> sudo chmod 777 /etc/ceph 2021-03-10T13:38:27.574 DEBUG:teuthology.orchestra.run.gibba045:> sudo chmod 777 /etc/ceph 2021-03-10T13:38:27.582 INFO:tasks.cephadm:Writing seed config... 2021-03-10T13:38:27.584 INFO:tasks.cephadm: override: [global] mon election default strategy = 1 2021-03-10T13:38:27.585 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2021-03-10T13:38:27.585 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2021-03-10T13:38:27.585 INFO:tasks.cephadm: override: [mon] debug mon = 20 2021-03-10T13:38:27.586 INFO:tasks.cephadm: override: [mon] debug ms = 1 2021-03-10T13:38:27.586 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2021-03-10T13:38:27.586 INFO:tasks.cephadm: override: [osd] debug filestore = 20 2021-03-10T13:38:27.587 INFO:tasks.cephadm: override: [osd] debug journal = 20 2021-03-10T13:38:27.587 INFO:tasks.cephadm: override: [osd] debug ms = 1 2021-03-10T13:38:27.587 INFO:tasks.cephadm: override: [osd] debug osd = 25 2021-03-10T13:38:27.587 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2021-03-10T13:38:27.588 DEBUG:teuthology.orchestra.run.gibba015:> set -ex 2021-03-10T13:38:27.589 DEBUG:teuthology.orchestra.run.gibba015:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2021-03-10T13:38:27.597 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = e4a642d2-81a5-11eb-9080-001a4aab830c mon election default strategy = 1 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true debug filestore = 20 debug journal = 20 debug ms = 1 debug osd = 25 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 debug mon = 20 debug ms = 1 debug paxos = 20 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2021-03-10T13:38:27.598 DEBUG:teuthology.orchestra.run.gibba015:mon.a> sudo journalctl -f -n 0 -u ceph-e4a642d2-81a5-11eb-9080-001a4aab830c@mon.a.service 2021-03-10T13:38:27.641 DEBUG:teuthology.orchestra.run.gibba015:mgr.y> sudo journalctl -f -n 0 -u ceph-e4a642d2-81a5-11eb-9080-001a4aab830c@mgr.y.service 2021-03-10T13:38:27.643 INFO:tasks.cephadm:Bootstrapping... 2021-03-10T13:38:27.644 DEBUG:teuthology.orchestra.run.gibba015:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 -v bootstrap --fsid e4a642d2-81a5-11eb-9080-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.2.115 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2021-03-10T13:38:27.663 INFO:journalctl@ceph.mon.a.gibba015.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T13:38:27.664 INFO:journalctl@ceph.mgr.y.gibba015.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T13:38:27.714 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:Could not locate podman: podman not found 2021-03-10T13:38:27.714 INFO:teuthology.orchestra.run.gibba015.stderr:INFO:cephadm:Verifying podman|docker is present... 2021-03-10T13:38:27.715 INFO:teuthology.orchestra.run.gibba015.stderr:INFO:cephadm:Verifying lvm2 is present... 2021-03-10T13:38:27.715 INFO:teuthology.orchestra.run.gibba015.stderr:INFO:cephadm:Verifying time synchronization is in place... 2021-03-10T13:38:27.715 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:Running command: systemctl is-enabled chrony.service 2021-03-10T13:38:27.716 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:systemctl:stderr Failed to get unit file state for chrony.service: No such file or directory 2021-03-10T13:38:27.716 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:Running command: systemctl is-active chrony.service 2021-03-10T13:38:27.718 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:systemctl:stdout inactive 2021-03-10T13:38:27.718 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:Running command: systemctl is-enabled chronyd.service 2021-03-10T13:38:27.720 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:systemctl:stderr Failed to get unit file state for chronyd.service: No such file or directory 2021-03-10T13:38:27.720 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:Running command: systemctl is-active chronyd.service 2021-03-10T13:38:27.722 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:systemctl:stdout inactive 2021-03-10T13:38:27.722 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:Running command: systemctl is-enabled systemd-timesyncd.service 2021-03-10T13:38:27.724 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:systemctl:stdout masked 2021-03-10T13:38:27.724 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:Running command: systemctl is-active systemd-timesyncd.service 2021-03-10T13:38:27.726 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:systemctl:stdout inactive 2021-03-10T13:38:27.726 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:Running command: systemctl is-enabled ntpd.service 2021-03-10T13:38:27.728 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:systemctl:stderr Failed to get unit file state for ntpd.service: No such file or directory 2021-03-10T13:38:27.728 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:Running command: systemctl is-active ntpd.service 2021-03-10T13:38:27.729 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:systemctl:stdout inactive 2021-03-10T13:38:27.730 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:Running command: systemctl is-enabled ntp.service 2021-03-10T13:38:27.732 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:systemctl:stdout enabled 2021-03-10T13:38:27.732 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:Running command: systemctl is-active ntp.service 2021-03-10T13:38:27.734 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:systemctl:stdout active 2021-03-10T13:38:27.734 INFO:teuthology.orchestra.run.gibba015.stderr:INFO:cephadm:Unit ntp.service is enabled and running 2021-03-10T13:38:27.734 INFO:teuthology.orchestra.run.gibba015.stderr:INFO:cephadm:Repeating the final host check... 2021-03-10T13:38:27.735 INFO:teuthology.orchestra.run.gibba015.stderr:INFO:cephadm:podman|docker (/usr/bin/docker) is present 2021-03-10T13:38:27.735 INFO:teuthology.orchestra.run.gibba015.stderr:INFO:cephadm:systemctl is present 2021-03-10T13:38:27.735 INFO:teuthology.orchestra.run.gibba015.stderr:INFO:cephadm:lvcreate is present 2021-03-10T13:38:27.735 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:Running command: systemctl is-enabled chrony.service 2021-03-10T13:38:27.736 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:systemctl:stderr Failed to get unit file state for chrony.service: No such file or directory 2021-03-10T13:38:27.736 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:Running command: systemctl is-active chrony.service 2021-03-10T13:38:27.737 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:systemctl:stdout inactive 2021-03-10T13:38:27.738 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:Running command: systemctl is-enabled chronyd.service 2021-03-10T13:38:27.739 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:systemctl:stderr Failed to get unit file state for chronyd.service: No such file or directory 2021-03-10T13:38:27.739 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:Running command: systemctl is-active chronyd.service 2021-03-10T13:38:27.741 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:systemctl:stdout inactive 2021-03-10T13:38:27.741 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:Running command: systemctl is-enabled systemd-timesyncd.service 2021-03-10T13:38:27.743 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:systemctl:stdout masked 2021-03-10T13:38:27.743 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:Running command: systemctl is-active systemd-timesyncd.service 2021-03-10T13:38:27.745 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:systemctl:stdout inactive 2021-03-10T13:38:27.745 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:Running command: systemctl is-enabled ntpd.service 2021-03-10T13:38:27.746 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:systemctl:stderr Failed to get unit file state for ntpd.service: No such file or directory 2021-03-10T13:38:27.747 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:Running command: systemctl is-active ntpd.service 2021-03-10T13:38:27.748 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:systemctl:stdout inactive 2021-03-10T13:38:27.748 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:Running command: systemctl is-enabled ntp.service 2021-03-10T13:38:27.750 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:systemctl:stdout enabled 2021-03-10T13:38:27.750 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:Running command: systemctl is-active ntp.service 2021-03-10T13:38:27.753 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:systemctl:stdout active 2021-03-10T13:38:27.753 INFO:teuthology.orchestra.run.gibba015.stderr:INFO:cephadm:Unit ntp.service is enabled and running 2021-03-10T13:38:27.753 INFO:teuthology.orchestra.run.gibba015.stderr:INFO:cephadm:Host looks OK 2021-03-10T13:38:27.753 INFO:teuthology.orchestra.run.gibba015.stderr:INFO:root:Cluster fsid: e4a642d2-81a5-11eb-9080-001a4aab830c 2021-03-10T13:38:27.754 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:Acquiring lock 139700450627936 on /run/cephadm/e4a642d2-81a5-11eb-9080-001a4aab830c.lock 2021-03-10T13:38:27.754 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:Lock 139700450627936 acquired on /run/cephadm/e4a642d2-81a5-11eb-9080-001a4aab830c.lock 2021-03-10T13:38:27.754 INFO:teuthology.orchestra.run.gibba015.stderr:INFO:cephadm:Verifying IP 172.21.2.115 port 3300 ... 2021-03-10T13:38:27.754 INFO:teuthology.orchestra.run.gibba015.stderr:INFO:cephadm:Verifying IP 172.21.2.115 port 6789 ... 2021-03-10T13:38:27.754 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:Base mon IP is 172.21.2.115, final addrv is [v2:172.21.2.115:3300,v1:172.21.2.115:6789] 2021-03-10T13:38:27.755 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:Running command: /usr/sbin/ip route ls 2021-03-10T13:38:27.756 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/sbin/ip:stdout default via 172.21.15.254 dev enp1s0f0 2021-03-10T13:38:27.756 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/sbin/ip:stdout default via 172.21.15.254 dev enp1s0f0 proto dhcp src 172.21.2.115 metric 100 2021-03-10T13:38:27.756 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/sbin/ip:stdout 172.17.0.0/16 dev docker0 proto kernel scope link src 172.17.0.1 linkdown 2021-03-10T13:38:27.757 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/sbin/ip:stdout 172.21.0.0/20 dev enp1s0f0 proto kernel scope link src 172.21.2.115 2021-03-10T13:38:27.757 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/sbin/ip:stdout 172.21.15.254 dev enp1s0f0 proto dhcp scope link src 172.21.2.115 metric 100 2021-03-10T13:38:27.757 INFO:teuthology.orchestra.run.gibba015.stderr:INFO:cephadm:Mon IP 172.21.2.115 is in CIDR network 172.21.0.0/20 2021-03-10T13:38:27.757 INFO:teuthology.orchestra.run.gibba015.stderr:INFO:cephadm:Pulling latest docker.io/ceph/ceph:v15.2.0 container... 2021-03-10T13:38:27.757 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:Running command: /usr/bin/docker pull docker.io/ceph/ceph:v15.2.0 2021-03-10T13:38:28.996 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/docker:stdout v15.2.0: Pulling from ceph/ceph 2021-03-10T13:38:29.022 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/docker:stdout 8a29a15cefae: Pulling fs layer 2021-03-10T13:38:29.023 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/docker:stdout 120f0bd0d532: Pulling fs layer 2021-03-10T13:38:29.342 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/docker:stdout 8a29a15cefae: Download complete 2021-03-10T13:38:29.957 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/docker:stdout 120f0bd0d532: Verifying Checksum 2021-03-10T13:38:29.957 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/docker:stdout 120f0bd0d532: Download complete 2021-03-10T13:38:30.702 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/docker:stdout 8a29a15cefae: Pull complete 2021-03-10T13:38:34.600 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/docker:stdout 120f0bd0d532: Pull complete 2021-03-10T13:38:34.659 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/docker:stdout Digest: sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60 2021-03-10T13:38:34.693 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/docker:stdout Status: Downloaded newer image for ceph/ceph:v15.2.0 2021-03-10T13:38:34.695 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/docker:stdout docker.io/ceph/ceph:v15.2.0 2021-03-10T13:38:34.700 INFO:teuthology.orchestra.run.gibba015.stderr:INFO:cephadm:Extracting ceph user uid/gid from container image... 2021-03-10T13:38:34.700 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba015', '--entrypoint', 'stat', 'docker.io/ceph/ceph:v15.2.0', '-c', '%u %g', '/var/lib/ceph'] 2021-03-10T13:38:34.700 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba015 --entrypoint stat docker.io/ceph/ceph:v15.2.0 -c %u %g /var/lib/ceph 2021-03-10T13:38:43.274 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:stat:stdout 167 167 2021-03-10T13:38:43.801 INFO:teuthology.orchestra.run.gibba015.stderr:INFO:cephadm:Creating initial keys... 2021-03-10T13:38:43.802 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba015', '--entrypoint', '/usr/bin/ceph-authtool', 'docker.io/ceph/ceph:v15.2.0', '--gen-print-key'] 2021-03-10T13:38:43.802 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba015 --entrypoint /usr/bin/ceph-authtool docker.io/ceph/ceph:v15.2.0 --gen-print-key 2021-03-10T13:38:44.533 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-authtool:stdout AQDky0hgiBGuHxAAGlBc7GfDMs8x9y5F7nlWmw== 2021-03-10T13:38:45.007 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba015', '--entrypoint', '/usr/bin/ceph-authtool', 'docker.io/ceph/ceph:v15.2.0', '--gen-print-key'] 2021-03-10T13:38:45.007 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba015 --entrypoint /usr/bin/ceph-authtool docker.io/ceph/ceph:v15.2.0 --gen-print-key 2021-03-10T13:38:45.725 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-authtool:stdout AQDly0hgRZ0dKxAAdk//KcLnxD6LYtUsP3/0kw== 2021-03-10T13:38:46.185 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba015', '--entrypoint', '/usr/bin/ceph-authtool', 'docker.io/ceph/ceph:v15.2.0', '--gen-print-key'] 2021-03-10T13:38:46.186 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba015 --entrypoint /usr/bin/ceph-authtool docker.io/ceph/ceph:v15.2.0 --gen-print-key 2021-03-10T13:38:46.918 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-authtool:stdout AQDmy0hg502eNhAA2MKEdI03velQUtcsyZ6Mhw== 2021-03-10T13:38:47.398 INFO:teuthology.orchestra.run.gibba015.stderr:INFO:cephadm:Creating initial monmap... 2021-03-10T13:38:47.399 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba015', '-v', '/tmp/ceph-tmp2yv09ixb:/tmp/monmap:z', '--entrypoint', '/usr/bin/monmaptool', 'docker.io/ceph/ceph:v15.2.0', '--create', '--clobber', '--fsid', 'e4a642d2-81a5-11eb-9080-001a4aab830c', '--addv', 'a', '[v2:172.21.2.115:3300,v1:172.21.2.115:6789]', '/tmp/monmap'] 2021-03-10T13:38:47.399 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba015 -v /tmp/ceph-tmp2yv09ixb:/tmp/monmap:z --entrypoint /usr/bin/monmaptool docker.io/ceph/ceph:v15.2.0 --create --clobber --fsid e4a642d2-81a5-11eb-9080-001a4aab830c --addv a [v2:172.21.2.115:3300,v1:172.21.2.115:6789] /tmp/monmap 2021-03-10T13:38:48.186 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/monmaptool:stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2021-03-10T13:38:48.187 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/monmaptool:stdout /usr/bin/monmaptool: set fsid to e4a642d2-81a5-11eb-9080-001a4aab830c 2021-03-10T13:38:48.187 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/monmaptool:stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2021-03-10T13:38:48.724 INFO:teuthology.orchestra.run.gibba015.stderr:INFO:cephadm:Creating mon... 2021-03-10T13:38:48.725 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba015', '-v', '/var/log/ceph/e4a642d2-81a5-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/var/lib/ceph/e4a642d2-81a5-11eb-9080-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z', '-v', '/tmp/ceph-tmp8rkh4suf:/tmp/keyring:z', '-v', '/tmp/ceph-tmp2yv09ixb:/tmp/monmap:z', '--entrypoint', '/usr/bin/ceph-mon', 'docker.io/ceph/ceph:v15.2.0', '--mkfs', '-i', 'a', '--fsid', 'e4a642d2-81a5-11eb-9080-001a4aab830c', '-c', '/dev/null', '--monmap', '/tmp/monmap', '--keyring', '/tmp/keyring', '--setuser', 'ceph', '--setgroup', 'ceph', '--default-log-to-file=false', '--default-log-to-stderr=true', '--default-log-stderr-prefix="debug "', '--default-mon-cluster-log-to-file=false', '--default-mon-cluster-log-to-stderr=true'] 2021-03-10T13:38:48.726 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba015 -v /var/log/ceph/e4a642d2-81a5-11eb-9080-001a4aab830c:/var/log/ceph:z -v /var/lib/ceph/e4a642d2-81a5-11eb-9080-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z -v /tmp/ceph-tmp8rkh4suf:/tmp/keyring:z -v /tmp/ceph-tmp2yv09ixb:/tmp/monmap:z --entrypoint /usr/bin/ceph-mon docker.io/ceph/ceph:v15.2.0 --mkfs -i a --fsid e4a642d2-81a5-11eb-9080-001a4aab830c -c /dev/null --monmap /tmp/monmap --keyring /tmp/keyring --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix="debug " --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true 2021-03-10T13:38:49.513 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 0 set uid:gid to 167:167 (ceph:ceph) 2021-03-10T13:38:49.513 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 1 imported monmap: 2021-03-10T13:38:49.513 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr epoch 0 2021-03-10T13:38:49.514 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr fsid e4a642d2-81a5-11eb-9080-001a4aab830c 2021-03-10T13:38:49.514 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr last_changed 2021-03-10T13:38:48.184244+0000 2021-03-10T13:38:49.514 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr created 2021-03-10T13:38:48.184244+0000 2021-03-10T13:38:49.514 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr min_mon_release 0 (unknown) 2021-03-10T13:38:49.515 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 0: [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] mon.a 2021-03-10T13:38:49.515 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T13:38:49.515 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 0 /usr/bin/ceph-mon: set fsid to e4a642d2-81a5-11eb-9080-001a4aab830c 2021-03-10T13:38:49.515 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 0 set rocksdb option compression = kNoCompression 2021-03-10T13:38:49.515 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 0 set rocksdb option level_compaction_dynamic_level_bytes = true 2021-03-10T13:38:49.516 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 0 set rocksdb option write_buffer_size = 33554432 2021-03-10T13:38:49.516 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 0 set rocksdb option compression = kNoCompression 2021-03-10T13:38:49.516 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 0 set rocksdb option level_compaction_dynamic_level_bytes = true 2021-03-10T13:38:49.516 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 0 set rocksdb option write_buffer_size = 33554432 2021-03-10T13:38:49.516 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: RocksDB version: 6.1.2 2021-03-10T13:38:49.517 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T13:38:49.517 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2021-03-10T13:38:49.517 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Compile date Mar 23 2020 2021-03-10T13:38:49.517 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: DB SUMMARY 2021-03-10T13:38:49.518 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T13:38:49.518 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 0, files: 2021-03-10T13:38:49.518 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T13:38:49.518 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 2021-03-10T13:38:49.519 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T13:38:49.519 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.error_if_exists: 0 2021-03-10T13:38:49.519 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.create_if_missing: 1 2021-03-10T13:38:49.519 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.paranoid_checks: 1 2021-03-10T13:38:49.519 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.env: 0x55c8a35f91a0 2021-03-10T13:38:49.520 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.info_log: 0x55c8a41d5a80 2021-03-10T13:38:49.520 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.max_file_opening_threads: 16 2021-03-10T13:38:49.520 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.statistics: (nil) 2021-03-10T13:38:49.520 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.use_fsync: 0 2021-03-10T13:38:49.520 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.max_log_file_size: 0 2021-03-10T13:38:49.521 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.max_manifest_file_size: 1073741824 2021-03-10T13:38:49.521 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.log_file_time_to_roll: 0 2021-03-10T13:38:49.521 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.keep_log_file_num: 1000 2021-03-10T13:38:49.521 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.recycle_log_file_num: 0 2021-03-10T13:38:49.521 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.allow_fallocate: 1 2021-03-10T13:38:49.522 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.allow_mmap_reads: 0 2021-03-10T13:38:49.522 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.allow_mmap_writes: 0 2021-03-10T13:38:49.522 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.use_direct_reads: 0 2021-03-10T13:38:49.522 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2021-03-10T13:38:49.522 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.create_missing_column_families: 0 2021-03-10T13:38:49.523 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.db_log_dir: 2021-03-10T13:38:49.523 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2021-03-10T13:38:49.523 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.table_cache_numshardbits: 6 2021-03-10T13:38:49.523 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.max_subcompactions: 1 2021-03-10T13:38:49.523 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.max_background_flushes: -1 2021-03-10T13:38:49.524 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.WAL_ttl_seconds: 0 2021-03-10T13:38:49.524 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.WAL_size_limit_MB: 0 2021-03-10T13:38:49.524 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.manifest_preallocation_size: 4194304 2021-03-10T13:38:49.524 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.is_fd_close_on_exec: 1 2021-03-10T13:38:49.524 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.advise_random_on_open: 1 2021-03-10T13:38:49.525 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.db_write_buffer_size: 0 2021-03-10T13:38:49.525 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.write_buffer_manager: 0x55c8a4d76120 2021-03-10T13:38:49.525 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.access_hint_on_compaction_start: 1 2021-03-10T13:38:49.525 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2021-03-10T13:38:49.525 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2021-03-10T13:38:49.526 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.use_adaptive_mutex: 0 2021-03-10T13:38:49.526 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.rate_limiter: (nil) 2021-03-10T13:38:49.526 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2021-03-10T13:38:49.526 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.wal_recovery_mode: 2 2021-03-10T13:38:49.527 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.enable_thread_tracking: 0 2021-03-10T13:38:49.527 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.enable_pipelined_write: 0 2021-03-10T13:38:49.527 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2021-03-10T13:38:49.527 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2021-03-10T13:38:49.527 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.write_thread_max_yield_usec: 100 2021-03-10T13:38:49.528 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2021-03-10T13:38:49.528 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.row_cache: None 2021-03-10T13:38:49.528 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.wal_filter: None 2021-03-10T13:38:49.528 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.avoid_flush_during_recovery: 0 2021-03-10T13:38:49.528 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.allow_ingest_behind: 0 2021-03-10T13:38:49.529 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.preserve_deletes: 0 2021-03-10T13:38:49.529 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.two_write_queues: 0 2021-03-10T13:38:49.529 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.manual_wal_flush: 0 2021-03-10T13:38:49.529 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.atomic_flush: 0 2021-03-10T13:38:49.529 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2021-03-10T13:38:49.530 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.max_background_jobs: 2 2021-03-10T13:38:49.530 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.max_background_compactions: -1 2021-03-10T13:38:49.530 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2021-03-10T13:38:49.530 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2021-03-10T13:38:49.530 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.delayed_write_rate : 16777216 2021-03-10T13:38:49.531 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.max_total_wal_size: 0 2021-03-10T13:38:49.531 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2021-03-10T13:38:49.531 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.stats_dump_period_sec: 600 2021-03-10T13:38:49.531 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.stats_persist_period_sec: 600 2021-03-10T13:38:49.532 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.stats_history_buffer_size: 1048576 2021-03-10T13:38:49.532 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.max_open_files: -1 2021-03-10T13:38:49.532 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.bytes_per_sync: 0 2021-03-10T13:38:49.532 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.wal_bytes_per_sync: 0 2021-03-10T13:38:49.532 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.compaction_readahead_size: 0 2021-03-10T13:38:49.533 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Compression algorithms supported: 2021-03-10T13:38:49.533 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: kZSTDNotFinalCompression supported: 0 2021-03-10T13:38:49.533 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: kZSTD supported: 0 2021-03-10T13:38:49.533 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: kXpressCompression supported: 0 2021-03-10T13:38:49.533 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: kLZ4HCCompression supported: 1 2021-03-10T13:38:49.534 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: kLZ4Compression supported: 1 2021-03-10T13:38:49.534 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: kBZip2Compression supported: 0 2021-03-10T13:38:49.534 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: kZlibCompression supported: 1 2021-03-10T13:38:49.534 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: kSnappyCompression supported: 1 2021-03-10T13:38:49.534 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Fast CRC32 supported: Supported on x86 2021-03-10T13:38:49.535 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: [db/db_impl_open.cc:228] Creating manifest 1 2021-03-10T13:38:49.535 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T13:38:49.535 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: [db/version_set.cc:3543] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 2021-03-10T13:38:49.535 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T13:38:49.535 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: [db/column_family.cc:477] --------------- Options for column family [default]: 2021-03-10T13:38:49.536 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T13:38:49.536 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2021-03-10T13:38:49.536 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.merge_operator: 2021-03-10T13:38:49.536 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.compaction_filter: None 2021-03-10T13:38:49.536 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.compaction_filter_factory: None 2021-03-10T13:38:49.537 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.memtable_factory: SkipListFactory 2021-03-10T13:38:49.537 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.table_factory: BlockBasedTable 2021-03-10T13:38:49.537 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55c8a40fe130) 2021-03-10T13:38:49.537 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr cache_index_and_filter_blocks: 1 2021-03-10T13:38:49.537 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr cache_index_and_filter_blocks_with_high_priority: 1 2021-03-10T13:38:49.538 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr pin_l0_filter_and_index_blocks_in_cache: 0 2021-03-10T13:38:49.538 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr pin_top_level_index_and_filter: 1 2021-03-10T13:38:49.538 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr index_type: 0 2021-03-10T13:38:49.538 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr data_block_index_type: 0 2021-03-10T13:38:49.538 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr data_block_hash_table_util_ratio: 0.750000 2021-03-10T13:38:49.539 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr hash_index_allow_collision: 1 2021-03-10T13:38:49.539 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr checksum: 1 2021-03-10T13:38:49.539 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr no_block_cache: 0 2021-03-10T13:38:49.539 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_cache: 0x55c8a4134510 2021-03-10T13:38:49.539 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_cache_name: BinnedLRUCache 2021-03-10T13:38:49.540 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_cache_options: 2021-03-10T13:38:49.540 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr capacity : 536870912 2021-03-10T13:38:49.540 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr num_shard_bits : 4 2021-03-10T13:38:49.540 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr strict_capacity_limit : 0 2021-03-10T13:38:49.540 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr high_pri_pool_ratio: 0.000 2021-03-10T13:38:49.541 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_cache_compressed: (nil) 2021-03-10T13:38:49.541 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr persistent_cache: (nil) 2021-03-10T13:38:49.541 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_size: 4096 2021-03-10T13:38:49.541 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_size_deviation: 10 2021-03-10T13:38:49.541 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_restart_interval: 16 2021-03-10T13:38:49.542 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr index_block_restart_interval: 1 2021-03-10T13:38:49.542 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr metadata_block_size: 4096 2021-03-10T13:38:49.542 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr partition_filters: 0 2021-03-10T13:38:49.542 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr use_delta_encoding: 1 2021-03-10T13:38:49.542 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr filter_policy: rocksdb.BuiltinBloomFilter 2021-03-10T13:38:49.543 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr whole_key_filtering: 1 2021-03-10T13:38:49.543 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr verify_compression: 0 2021-03-10T13:38:49.543 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr read_amp_bytes_per_bit: 0 2021-03-10T13:38:49.543 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr format_version: 2 2021-03-10T13:38:49.543 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr enable_index_compression: 1 2021-03-10T13:38:49.544 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_align: 0 2021-03-10T13:38:49.544 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T13:38:49.544 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.write_buffer_size: 33554432 2021-03-10T13:38:49.544 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.max_write_buffer_number: 2 2021-03-10T13:38:49.544 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.compression: NoCompression 2021-03-10T13:38:49.545 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.bottommost_compression: Disabled 2021-03-10T13:38:49.545 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.prefix_extractor: nullptr 2021-03-10T13:38:49.545 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2021-03-10T13:38:49.545 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.num_levels: 7 2021-03-10T13:38:49.545 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2021-03-10T13:38:49.546 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2021-03-10T13:38:49.546 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2021-03-10T13:38:49.546 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2021-03-10T13:38:49.546 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2021-03-10T13:38:49.546 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2021-03-10T13:38:49.547 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2021-03-10T13:38:49.547 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2021-03-10T13:38:49.547 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.compression_opts.window_bits: -14 2021-03-10T13:38:49.547 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.compression_opts.level: 32767 2021-03-10T13:38:49.547 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.compression_opts.strategy: 0 2021-03-10T13:38:49.548 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2021-03-10T13:38:49.548 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2021-03-10T13:38:49.548 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.compression_opts.enabled: false 2021-03-10T13:38:49.548 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2021-03-10T13:38:49.548 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2021-03-10T13:38:49.549 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.level0_stop_writes_trigger: 36 2021-03-10T13:38:49.549 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.target_file_size_base: 67108864 2021-03-10T13:38:49.549 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.target_file_size_multiplier: 1 2021-03-10T13:38:49.549 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2021-03-10T13:38:49.549 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2021-03-10T13:38:49.550 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2021-03-10T13:38:49.550 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2021-03-10T13:38:49.550 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2021-03-10T13:38:49.550 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2021-03-10T13:38:49.550 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2021-03-10T13:38:49.551 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2021-03-10T13:38:49.551 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2021-03-10T13:38:49.551 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2021-03-10T13:38:49.551 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2021-03-10T13:38:49.551 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.max_compaction_bytes: 1677721600 2021-03-10T13:38:49.552 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.arena_block_size: 4194304 2021-03-10T13:38:49.552 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2021-03-10T13:38:49.552 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2021-03-10T13:38:49.552 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2021-03-10T13:38:49.553 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.disable_auto_compactions: 0 2021-03-10T13:38:49.553 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2021-03-10T13:38:49.553 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2021-03-10T13:38:49.553 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2021-03-10T13:38:49.553 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2021-03-10T13:38:49.553 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2021-03-10T13:38:49.554 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2021-03-10T13:38:49.554 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2021-03-10T13:38:49.554 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2021-03-10T13:38:49.554 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2021-03-10T13:38:49.555 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2021-03-10T13:38:49.555 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.table_properties_collectors: 2021-03-10T13:38:49.555 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.inplace_update_support: 0 2021-03-10T13:38:49.555 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.inplace_update_num_locks: 10000 2021-03-10T13:38:49.555 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2021-03-10T13:38:49.556 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.memtable_whole_key_filtering: 0 2021-03-10T13:38:49.556 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.memtable_huge_page_size: 0 2021-03-10T13:38:49.556 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.bloom_locality: 0 2021-03-10T13:38:49.556 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.max_successive_merges: 0 2021-03-10T13:38:49.556 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.optimize_filters_for_hits: 0 2021-03-10T13:38:49.557 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.paranoid_file_checks: 0 2021-03-10T13:38:49.557 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.force_consistency_checks: 0 2021-03-10T13:38:49.557 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.report_bg_io_stats: 0 2021-03-10T13:38:49.557 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.484+0000 7fb4dfd2d6c0 4 rocksdb: Options.ttl: 0 2021-03-10T13:38:49.557 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.488+0000 7fb4dfd2d6c0 4 rocksdb: [db/version_set.cc:3757] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2021-03-10T13:38:49.558 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T13:38:49.558 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.488+0000 7fb4dfd2d6c0 4 rocksdb: [db/version_set.cc:3766] Column family [default] (ID 0), log number is 0 2021-03-10T13:38:49.558 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T13:38:49.558 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.488+0000 7fb4dfd2d6c0 4 rocksdb: DB pointer 0x55c8a41d0400 2021-03-10T13:38:49.559 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.488+0000 7fb4c8eee700 4 rocksdb: [db/db_impl.cc:777] ------- DUMPING STATS ------- 2021-03-10T13:38:49.559 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.488+0000 7fb4c8eee700 4 rocksdb: [db/db_impl.cc:778] 2021-03-10T13:38:49.559 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** DB Stats ** 2021-03-10T13:38:49.559 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T13:38:49.559 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2021-03-10T13:38:49.560 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2021-03-10T13:38:49.560 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2021-03-10T13:38:49.560 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2021-03-10T13:38:49.560 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2021-03-10T13:38:49.560 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2021-03-10T13:38:49.561 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T13:38:49.561 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** Compaction Stats [default] ** 2021-03-10T13:38:49.561 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T13:38:49.561 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T13:38:49.561 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-03-10T13:38:49.562 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-03-10T13:38:49.562 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T13:38:49.562 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** Compaction Stats [default] ** 2021-03-10T13:38:49.562 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T13:38:49.562 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T13:38:49.563 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T13:38:49.563 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Flush(GB): cumulative 0.000, interval 0.000 2021-03-10T13:38:49.563 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(GB): cumulative 0.000, interval 0.000 2021-03-10T13:38:49.563 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(Total Files): cumulative 0, interval 0 2021-03-10T13:38:49.563 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(L0 Files): cumulative 0, interval 0 2021-03-10T13:38:49.564 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(Keys): cumulative 0, interval 0 2021-03-10T13:38:49.564 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T13:38:49.564 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T13:38:49.564 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-03-10T13:38:49.564 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T13:38:49.565 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** File Read Latency Histogram By Level [default] ** 2021-03-10T13:38:49.565 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T13:38:49.565 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** Compaction Stats [default] ** 2021-03-10T13:38:49.565 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T13:38:49.565 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T13:38:49.566 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-03-10T13:38:49.566 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-03-10T13:38:49.566 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T13:38:49.566 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** Compaction Stats [default] ** 2021-03-10T13:38:49.566 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T13:38:49.567 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T13:38:49.567 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T13:38:49.567 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Flush(GB): cumulative 0.000, interval 0.000 2021-03-10T13:38:49.567 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(GB): cumulative 0.000, interval 0.000 2021-03-10T13:38:49.567 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(Total Files): cumulative 0, interval 0 2021-03-10T13:38:49.568 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(L0 Files): cumulative 0, interval 0 2021-03-10T13:38:49.568 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(Keys): cumulative 0, interval 0 2021-03-10T13:38:49.568 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T13:38:49.568 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T13:38:49.568 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-03-10T13:38:49.569 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T13:38:49.569 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** File Read Latency Histogram By Level [default] ** 2021-03-10T13:38:49.569 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T13:38:49.569 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.488+0000 7fb4dfd2d6c0 4 rocksdb: [db/db_impl.cc:390] Shutdown: canceling all background work 2021-03-10T13:38:49.569 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.488+0000 7fb4dfd2d6c0 4 rocksdb: [db/db_impl.cc:563] Shutdown complete 2021-03-10T13:38:49.570 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:38:49.488+0000 7fb4dfd2d6c0 0 /usr/bin/ceph-mon: created monfs at /var/lib/ceph/mon/ceph-a for mon.a 2021-03-10T13:38:49.989 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:Running command: install -d -m0770 -o 167 -g 167 /var/run/ceph/e4a642d2-81a5-11eb-9080-001a4aab830c 2021-03-10T13:38:49.991 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:Running command: systemctl disable ceph.target 2021-03-10T13:38:50.108 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:Running command: systemctl enable ceph.target 2021-03-10T13:38:50.110 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:systemctl:stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /etc/systemd/system/ceph.target. 2021-03-10T13:38:50.230 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:Running command: systemctl start ceph.target 2021-03-10T13:38:50.232 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:Running command: systemctl enable ceph-e4a642d2-81a5-11eb-9080-001a4aab830c.target 2021-03-10T13:38:50.234 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:systemctl:stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-e4a642d2-81a5-11eb-9080-001a4aab830c.target -> /etc/systemd/system/ceph-e4a642d2-81a5-11eb-9080-001a4aab830c.target. 2021-03-10T13:38:50.235 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:systemctl:stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-e4a642d2-81a5-11eb-9080-001a4aab830c.target -> /etc/systemd/system/ceph-e4a642d2-81a5-11eb-9080-001a4aab830c.target. 2021-03-10T13:38:50.362 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:Running command: systemctl start ceph-e4a642d2-81a5-11eb-9080-001a4aab830c.target 2021-03-10T13:38:50.363 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:Running command: systemctl daemon-reload 2021-03-10T13:38:50.512 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:Running command: systemctl stop ceph-e4a642d2-81a5-11eb-9080-001a4aab830c@mon.a 2021-03-10T13:38:50.517 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:Running command: systemctl reset-failed ceph-e4a642d2-81a5-11eb-9080-001a4aab830c@mon.a 2021-03-10T13:38:50.519 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:systemctl:stderr Failed to reset failed state of unit ceph-e4a642d2-81a5-11eb-9080-001a4aab830c@mon.a.service: Unit ceph-e4a642d2-81a5-11eb-9080-001a4aab830c@mon.a.service not loaded. 2021-03-10T13:38:50.520 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:Running command: systemctl enable ceph-e4a642d2-81a5-11eb-9080-001a4aab830c@mon.a 2021-03-10T13:38:50.520 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:systemctl:stderr Created symlink /etc/systemd/system/ceph-e4a642d2-81a5-11eb-9080-001a4aab830c.target.wants/ceph-e4a642d2-81a5-11eb-9080-001a4aab830c@mon.a.service -> /etc/systemd/system/ceph-e4a642d2-81a5-11eb-9080-001a4aab830c@.service. 2021-03-10T13:38:50.648 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:Running command: systemctl start ceph-e4a642d2-81a5-11eb-9080-001a4aab830c@mon.a 2021-03-10T13:38:50.674 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:firewalld does not appear to be present 2021-03-10T13:38:50.675 INFO:teuthology.orchestra.run.gibba015.stderr:INFO:cephadm:Waiting for mon to start... 2021-03-10T13:38:50.676 INFO:teuthology.orchestra.run.gibba015.stderr:INFO:cephadm:Waiting for mon... 2021-03-10T13:38:50.676 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba015 -v /var/lib/ceph/e4a642d2-81a5-11eb-9080-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z -v /tmp/ceph-tmp3221digx:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpygecn9iw:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 status 2021-03-10T13:38:50.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:50 gibba015 docker[9384]: Error: No such container: ceph-e4a642d2-81a5-11eb-9080-001a4aab830c-mon.a 2021-03-10T13:38:50.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:50 gibba015 systemd[1]: Started Ceph mon.a for e4a642d2-81a5-11eb-9080-001a4aab830c. 2021-03-10T13:38:51.965 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout cluster: 2021-03-10T13:38:51.965 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout id: e4a642d2-81a5-11eb-9080-001a4aab830c 2021-03-10T13:38:51.966 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout health: HEALTH_OK 2021-03-10T13:38:51.966 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2021-03-10T13:38:51.966 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout services: 2021-03-10T13:38:51.966 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon: 1 daemons, quorum a (age 0.126349s) 2021-03-10T13:38:51.967 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mgr: no daemons active 2021-03-10T13:38:51.967 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout osd: 0 osds: 0 up, 0 in 2021-03-10T13:38:51.967 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2021-03-10T13:38:51.967 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout data: 2021-03-10T13:38:51.968 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout pools: 0 pools, 0 pgs 2021-03-10T13:38:51.968 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout objects: 0 objects, 0 B 2021-03-10T13:38:51.968 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout usage: 0 B used, 0 B / 0 B avail 2021-03-10T13:38:51.968 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout pgs: 2021-03-10T13:38:51.969 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2021-03-10T13:38:52.063 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:51 gibba015 bash[9400]: cluster 2021-03-10T13:38:51.836418+0000 mon.a (mon.0) 0 : [INF] mkfs e4a642d2-81a5-11eb-9080-001a4aab830c 2021-03-10T13:38:52.064 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:51 gibba015 bash[9400]: cluster 2021-03-10T13:38:51.832755+0000 mon.a (mon.0) 1 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2021-03-10T13:38:52.523 INFO:teuthology.orchestra.run.gibba015.stderr:INFO:cephadm:Assimilating anything we can from ceph.conf... 2021-03-10T13:38:52.523 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba015', '-v', '/var/log/ceph/e4a642d2-81a5-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmp3221digx:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpygecn9iw:/etc/ceph/ceph.conf:z', '-v', '/var/lib/ceph/e4a642d2-81a5-11eb-9080-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'config', 'assimilate-conf', '-i', '/var/lib/ceph/mon/ceph-a/config'] 2021-03-10T13:38:52.523 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba015 -v /var/log/ceph/e4a642d2-81a5-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp3221digx:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpygecn9iw:/etc/ceph/ceph.conf:z -v /var/lib/ceph/e4a642d2-81a5-11eb-9080-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 config assimilate-conf -i /var/lib/ceph/mon/ceph-a/config 2021-03-10T13:38:53.196 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:52 gibba015 bash[9400]: cluster 2021-03-10T13:38:51.835666+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2021-03-10T13:38:53.196 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:52 gibba015 bash[9400]: cluster 2021-03-10T13:38:51.835981+0000 mon.a (mon.0) 3 : cluster [DBG] monmap e1: 1 mons at {a=[v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0]} 2021-03-10T13:38:53.197 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:52 gibba015 bash[9400]: cluster 2021-03-10T13:38:51.837461+0000 mon.a (mon.0) 4 : cluster [DBG] fsmap 2021-03-10T13:38:53.197 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:52 gibba015 bash[9400]: cluster 2021-03-10T13:38:51.839427+0000 mon.a (mon.0) 5 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2021-03-10T13:38:53.197 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:52 gibba015 bash[9400]: cluster 2021-03-10T13:38:51.839778+0000 mon.a (mon.0) 6 : cluster [DBG] mgrmap e1: no daemons active 2021-03-10T13:38:53.197 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:52 gibba015 bash[9400]: audit 2021-03-10T13:38:51.961996+0000 mon.a (mon.0) 7 : audit [DBG] from='client.? 172.21.2.115:0/1909062742' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2021-03-10T13:38:53.440 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2021-03-10T13:38:53.441 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout [global] 2021-03-10T13:38:53.441 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout fsid = e4a642d2-81a5-11eb-9080-001a4aab830c 2021-03-10T13:38:53.441 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon_election_default_strategy = 1 2021-03-10T13:38:53.441 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon_host = [v2:172.21.2.115:3300,v1:172.21.2.115:6789] 2021-03-10T13:38:53.442 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon_osd_allow_pg_remap = true 2021-03-10T13:38:53.442 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon_osd_allow_primary_affinity = true 2021-03-10T13:38:53.442 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon_warn_on_no_sortbitwise = false 2021-03-10T13:38:53.442 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout osd_crush_chooseleaf_type = 0 2021-03-10T13:38:53.442 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2021-03-10T13:38:53.443 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout [mgr] 2021-03-10T13:38:53.443 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mgr/telemetry/nag = false 2021-03-10T13:38:53.443 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2021-03-10T13:38:53.443 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout [osd] 2021-03-10T13:38:53.443 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout osd_map_max_advance = 10 2021-03-10T13:38:53.444 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout osd_sloppy_crc = true 2021-03-10T13:38:53.932 INFO:teuthology.orchestra.run.gibba015.stderr:INFO:cephadm:Generating new minimal ceph.conf... 2021-03-10T13:38:53.932 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba015', '-v', '/var/log/ceph/e4a642d2-81a5-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmp3221digx:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpygecn9iw:/etc/ceph/ceph.conf:z', '-v', '/var/lib/ceph/e4a642d2-81a5-11eb-9080-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'config', 'generate-minimal-conf', '-o', '/var/lib/ceph/mon/ceph-a/config'] 2021-03-10T13:38:53.932 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba015 -v /var/log/ceph/e4a642d2-81a5-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp3221digx:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpygecn9iw:/etc/ceph/ceph.conf:z -v /var/lib/ceph/e4a642d2-81a5-11eb-9080-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 config generate-minimal-conf -o /var/lib/ceph/mon/ceph-a/config 2021-03-10T13:38:53.954 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:53 gibba015 bash[9400]: audit 2021-03-10T13:38:53.434430+0000 mon.a (mon.0) 8 : audit [INF] from='client.? 172.21.2.115:0/3688394535' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2021-03-10T13:38:53.954 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:53 gibba015 bash[9400]: audit 2021-03-10T13:38:53.436696+0000 mon.a (mon.0) 9 : audit [INF] from='client.? 172.21.2.115:0/3688394535' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2021-03-10T13:38:55.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:54 gibba015 bash[9400]: audit 2021-03-10T13:38:54.862492+0000 mon.a (mon.0) 10 : audit [DBG] from='client.? 172.21.2.115:0/1400062389' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:38:55.397 INFO:teuthology.orchestra.run.gibba015.stderr:INFO:cephadm:Restarting the monitor... 2021-03-10T13:38:55.397 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:Running command: systemctl restart ceph-e4a642d2-81a5-11eb-9080-001a4aab830c@mon.a 2021-03-10T13:38:55.650 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:55 gibba015 systemd[1]: Stopping Ceph mon.a for e4a642d2-81a5-11eb-9080-001a4aab830c... 2021-03-10T13:38:55.651 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:55 gibba015 bash[9400]: debug 2021-03-10T13:38:55.456+0000 7f34e6a3f700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2021-03-10T13:38:55.651 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:55 gibba015 bash[9400]: debug 2021-03-10T13:38:55.456+0000 7f34e6a3f700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2021-03-10T13:38:56.041 INFO:teuthology.orchestra.run.gibba015.stderr:INFO:cephadm:Setting mon public_network... 2021-03-10T13:38:56.041 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba015', '-v', '/var/log/ceph/e4a642d2-81a5-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmp3221digx:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpygecn9iw:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'config', 'set', 'mon', 'public_network', '172.21.0.0/20'] 2021-03-10T13:38:56.041 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba015 -v /var/log/ceph/e4a642d2-81a5-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp3221digx:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpygecn9iw:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 config set mon public_network 172.21.0.0/20 2021-03-10T13:38:56.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:56 gibba015 docker[9752]: ceph-e4a642d2-81a5-11eb-9080-001a4aab830c-mon.a 2021-03-10T13:38:56.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:56 gibba015 systemd[1]: ceph-e4a642d2-81a5-11eb-9080-001a4aab830c@mon.a.service: Succeeded. 2021-03-10T13:38:56.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:56 gibba015 systemd[1]: Stopped Ceph mon.a for e4a642d2-81a5-11eb-9080-001a4aab830c. 2021-03-10T13:38:56.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:56 gibba015 systemd[1]: Starting Ceph mon.a for e4a642d2-81a5-11eb-9080-001a4aab830c... 2021-03-10T13:38:56.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:56 gibba015 docker[9788]: Error: No such container: ceph-e4a642d2-81a5-11eb-9080-001a4aab830c-mon.a 2021-03-10T13:38:56.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:56 gibba015 systemd[1]: Started Ceph mon.a for e4a642d2-81a5-11eb-9080-001a4aab830c. 2021-03-10T13:38:57.203 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.024+0000 7f13e385a6c0 0 set uid:gid to 167:167 (ceph:ceph) 2021-03-10T13:38:57.204 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.024+0000 7f13e385a6c0 0 ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc), process ceph-mon, pid 1 2021-03-10T13:38:57.204 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.024+0000 7f13e385a6c0 0 pidfile_write: ignore empty --pid-file 2021-03-10T13:38:57.204 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 0 load: jerasure load: lrc load: isa 2021-03-10T13:38:57.204 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 0 set rocksdb option compression = kNoCompression 2021-03-10T13:38:57.205 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 0 set rocksdb option level_compaction_dynamic_level_bytes = true 2021-03-10T13:38:57.205 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 0 set rocksdb option write_buffer_size = 33554432 2021-03-10T13:38:57.205 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 0 set rocksdb option compression = kNoCompression 2021-03-10T13:38:57.205 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 0 set rocksdb option level_compaction_dynamic_level_bytes = true 2021-03-10T13:38:57.205 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 0 set rocksdb option write_buffer_size = 33554432 2021-03-10T13:38:57.206 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 1 rocksdb: do_open column families: [default] 2021-03-10T13:38:57.206 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: RocksDB version: 6.1.2 2021-03-10T13:38:57.206 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2021-03-10T13:38:57.206 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Compile date Mar 23 2020 2021-03-10T13:38:57.207 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: DB SUMMARY 2021-03-10T13:38:57.207 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: CURRENT file: CURRENT 2021-03-10T13:38:57.207 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: IDENTITY file: IDENTITY 2021-03-10T13:38:57.207 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 109 Bytes 2021-03-10T13:38:57.207 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000004.sst 2021-03-10T13:38:57.208 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000006.log size: 69025 ; 2021-03-10T13:38:57.208 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.error_if_exists: 0 2021-03-10T13:38:57.208 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.create_if_missing: 0 2021-03-10T13:38:57.208 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.paranoid_checks: 1 2021-03-10T13:38:57.208 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.env: 0x558480e351a0 2021-03-10T13:38:57.209 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.info_log: 0x558481ef89a0 2021-03-10T13:38:57.209 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.max_file_opening_threads: 16 2021-03-10T13:38:57.209 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.statistics: (nil) 2021-03-10T13:38:57.209 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.use_fsync: 0 2021-03-10T13:38:57.209 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.max_log_file_size: 0 2021-03-10T13:38:57.210 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.max_manifest_file_size: 1073741824 2021-03-10T13:38:57.210 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.log_file_time_to_roll: 0 2021-03-10T13:38:57.210 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.keep_log_file_num: 1000 2021-03-10T13:38:57.210 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.recycle_log_file_num: 0 2021-03-10T13:38:57.211 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.allow_fallocate: 1 2021-03-10T13:38:57.211 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.allow_mmap_reads: 0 2021-03-10T13:38:57.211 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.allow_mmap_writes: 0 2021-03-10T13:38:57.211 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.use_direct_reads: 0 2021-03-10T13:38:57.211 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2021-03-10T13:38:57.212 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.create_missing_column_families: 0 2021-03-10T13:38:57.212 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.db_log_dir: 2021-03-10T13:38:57.212 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2021-03-10T13:38:57.212 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.table_cache_numshardbits: 6 2021-03-10T13:38:57.212 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.max_subcompactions: 1 2021-03-10T13:38:57.213 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.max_background_flushes: -1 2021-03-10T13:38:57.213 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.WAL_ttl_seconds: 0 2021-03-10T13:38:57.213 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.WAL_size_limit_MB: 0 2021-03-10T13:38:57.213 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.manifest_preallocation_size: 4194304 2021-03-10T13:38:57.213 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.is_fd_close_on_exec: 1 2021-03-10T13:38:57.214 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.advise_random_on_open: 1 2021-03-10T13:38:57.214 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.db_write_buffer_size: 0 2021-03-10T13:38:57.214 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.write_buffer_manager: 0x558482a92ae0 2021-03-10T13:38:57.214 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.access_hint_on_compaction_start: 1 2021-03-10T13:38:57.215 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2021-03-10T13:38:57.215 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2021-03-10T13:38:57.215 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.use_adaptive_mutex: 0 2021-03-10T13:38:57.215 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.rate_limiter: (nil) 2021-03-10T13:38:57.215 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2021-03-10T13:38:57.216 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.wal_recovery_mode: 2 2021-03-10T13:38:57.216 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.enable_thread_tracking: 0 2021-03-10T13:38:57.216 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.enable_pipelined_write: 0 2021-03-10T13:38:57.216 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2021-03-10T13:38:57.216 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2021-03-10T13:38:57.217 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.write_thread_max_yield_usec: 100 2021-03-10T13:38:57.217 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2021-03-10T13:38:57.217 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.row_cache: None 2021-03-10T13:38:57.217 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.wal_filter: None 2021-03-10T13:38:57.217 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.avoid_flush_during_recovery: 0 2021-03-10T13:38:57.218 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.allow_ingest_behind: 0 2021-03-10T13:38:57.218 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.preserve_deletes: 0 2021-03-10T13:38:57.218 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.two_write_queues: 0 2021-03-10T13:38:57.218 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.manual_wal_flush: 0 2021-03-10T13:38:57.218 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.atomic_flush: 0 2021-03-10T13:38:57.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2021-03-10T13:38:57.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.max_background_jobs: 2 2021-03-10T13:38:57.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.max_background_compactions: -1 2021-03-10T13:38:57.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2021-03-10T13:38:57.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2021-03-10T13:38:57.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.delayed_write_rate : 16777216 2021-03-10T13:38:57.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.max_total_wal_size: 0 2021-03-10T13:38:57.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2021-03-10T13:38:57.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.stats_dump_period_sec: 600 2021-03-10T13:38:57.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.stats_persist_period_sec: 600 2021-03-10T13:38:57.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.stats_history_buffer_size: 1048576 2021-03-10T13:38:57.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.max_open_files: -1 2021-03-10T13:38:57.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.bytes_per_sync: 0 2021-03-10T13:38:57.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.wal_bytes_per_sync: 0 2021-03-10T13:38:57.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.compaction_readahead_size: 0 2021-03-10T13:38:57.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Compression algorithms supported: 2021-03-10T13:38:57.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: kZSTDNotFinalCompression supported: 0 2021-03-10T13:38:57.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: kZSTD supported: 0 2021-03-10T13:38:57.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: kXpressCompression supported: 0 2021-03-10T13:38:57.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: kLZ4HCCompression supported: 1 2021-03-10T13:38:57.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: kLZ4Compression supported: 1 2021-03-10T13:38:57.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: kBZip2Compression supported: 0 2021-03-10T13:38:57.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: kZlibCompression supported: 1 2021-03-10T13:38:57.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: kSnappyCompression supported: 1 2021-03-10T13:38:57.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Fast CRC32 supported: Supported on x86 2021-03-10T13:38:57.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: [db/version_set.cc:3543] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 2021-03-10T13:38:57.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: [db/column_family.cc:477] --------------- Options for column family [default]: 2021-03-10T13:38:57.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2021-03-10T13:38:57.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.merge_operator: 2021-03-10T13:38:57.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.compaction_filter: None 2021-03-10T13:38:57.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.compaction_filter_factory: None 2021-03-10T13:38:57.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.memtable_factory: SkipListFactory 2021-03-10T13:38:57.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.table_factory: BlockBasedTable 2021-03-10T13:38:57.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x558481e18138) 2021-03-10T13:38:57.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: cache_index_and_filter_blocks: 1 2021-03-10T13:38:57.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: cache_index_and_filter_blocks_with_high_priority: 1 2021-03-10T13:38:57.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: pin_l0_filter_and_index_blocks_in_cache: 0 2021-03-10T13:38:57.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: pin_top_level_index_and_filter: 1 2021-03-10T13:38:57.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: index_type: 0 2021-03-10T13:38:57.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: data_block_index_type: 0 2021-03-10T13:38:57.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: data_block_hash_table_util_ratio: 0.750000 2021-03-10T13:38:57.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: hash_index_allow_collision: 1 2021-03-10T13:38:57.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: checksum: 1 2021-03-10T13:38:57.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: no_block_cache: 0 2021-03-10T13:38:57.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: block_cache: 0x558481e4e610 2021-03-10T13:38:57.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: block_cache_name: BinnedLRUCache 2021-03-10T13:38:57.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: block_cache_options: 2021-03-10T13:38:57.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: capacity : 536870912 2021-03-10T13:38:57.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: num_shard_bits : 4 2021-03-10T13:38:57.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: strict_capacity_limit : 0 2021-03-10T13:38:57.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: high_pri_pool_ratio: 0.000 2021-03-10T13:38:57.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: block_cache_compressed: (nil) 2021-03-10T13:38:57.230 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: persistent_cache: (nil) 2021-03-10T13:38:57.230 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: block_size: 4096 2021-03-10T13:38:57.230 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: block_size_deviation: 10 2021-03-10T13:38:57.230 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: block_restart_interval: 16 2021-03-10T13:38:57.230 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: index_block_restart_interval: 1 2021-03-10T13:38:57.231 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: metadata_block_size: 4096 2021-03-10T13:38:57.231 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: partition_filters: 0 2021-03-10T13:38:57.231 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: use_delta_encoding: 1 2021-03-10T13:38:57.231 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: filter_policy: rocksdb.BuiltinBloomFilter 2021-03-10T13:38:57.231 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: whole_key_filtering: 1 2021-03-10T13:38:57.232 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: verify_compression: 0 2021-03-10T13:38:57.232 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: read_amp_bytes_per_bit: 0 2021-03-10T13:38:57.232 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: format_version: 2 2021-03-10T13:38:57.232 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: enable_index_compression: 1 2021-03-10T13:38:57.232 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: block_align: 0 2021-03-10T13:38:57.233 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.write_buffer_size: 33554432 2021-03-10T13:38:57.233 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.max_write_buffer_number: 2 2021-03-10T13:38:57.233 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.compression: NoCompression 2021-03-10T13:38:57.233 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.bottommost_compression: Disabled 2021-03-10T13:38:57.233 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.prefix_extractor: nullptr 2021-03-10T13:38:57.234 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2021-03-10T13:38:57.234 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.num_levels: 7 2021-03-10T13:38:57.234 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2021-03-10T13:38:57.234 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2021-03-10T13:38:57.234 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2021-03-10T13:38:57.235 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2021-03-10T13:38:57.235 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2021-03-10T13:38:57.235 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2021-03-10T13:38:57.235 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2021-03-10T13:38:57.236 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2021-03-10T13:38:57.236 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.compression_opts.window_bits: -14 2021-03-10T13:38:57.236 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.compression_opts.level: 32767 2021-03-10T13:38:57.236 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.compression_opts.strategy: 0 2021-03-10T13:38:57.236 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2021-03-10T13:38:57.237 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2021-03-10T13:38:57.237 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.compression_opts.enabled: false 2021-03-10T13:38:57.237 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2021-03-10T13:38:57.237 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2021-03-10T13:38:57.237 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.level0_stop_writes_trigger: 36 2021-03-10T13:38:57.238 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.target_file_size_base: 67108864 2021-03-10T13:38:57.238 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.target_file_size_multiplier: 1 2021-03-10T13:38:57.238 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2021-03-10T13:38:57.238 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2021-03-10T13:38:57.239 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2021-03-10T13:38:57.239 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2021-03-10T13:38:57.239 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2021-03-10T13:38:57.239 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2021-03-10T13:38:57.239 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2021-03-10T13:38:57.240 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2021-03-10T13:38:57.240 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2021-03-10T13:38:57.240 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2021-03-10T13:38:57.240 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2021-03-10T13:38:57.240 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.max_compaction_bytes: 1677721600 2021-03-10T13:38:57.241 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.arena_block_size: 4194304 2021-03-10T13:38:57.241 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2021-03-10T13:38:57.241 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2021-03-10T13:38:57.241 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2021-03-10T13:38:57.241 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.disable_auto_compactions: 0 2021-03-10T13:38:57.242 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2021-03-10T13:38:57.242 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2021-03-10T13:38:57.242 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2021-03-10T13:38:57.242 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2021-03-10T13:38:57.243 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2021-03-10T13:38:57.243 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2021-03-10T13:38:57.243 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2021-03-10T13:38:57.243 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2021-03-10T13:38:57.243 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2021-03-10T13:38:57.244 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2021-03-10T13:38:57.244 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.table_properties_collectors: 2021-03-10T13:38:57.244 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.inplace_update_support: 0 2021-03-10T13:38:57.244 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.inplace_update_num_locks: 10000 2021-03-10T13:38:57.244 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2021-03-10T13:38:57.245 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.memtable_whole_key_filtering: 0 2021-03-10T13:38:57.245 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.memtable_huge_page_size: 0 2021-03-10T13:38:57.245 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.bloom_locality: 0 2021-03-10T13:38:57.245 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.max_successive_merges: 0 2021-03-10T13:38:57.245 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.optimize_filters_for_hits: 0 2021-03-10T13:38:57.246 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.paranoid_file_checks: 0 2021-03-10T13:38:57.246 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.force_consistency_checks: 0 2021-03-10T13:38:57.246 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.report_bg_io_stats: 0 2021-03-10T13:38:57.246 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.028+0000 7f13e385a6c0 4 rocksdb: Options.ttl: 0 2021-03-10T13:38:57.247 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.032+0000 7f13e385a6c0 4 rocksdb: [db/version_set.cc:3757] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 5, log_number is 4,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2021-03-10T13:38:57.247 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.032+0000 7f13e385a6c0 4 rocksdb: [db/version_set.cc:3766] Column family [default] (ID 0), log number is 4 2021-03-10T13:38:57.247 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.032+0000 7f13e385a6c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1615383537033345, "job": 1, "event": "recovery_started", "log_files": [6]} 2021-03-10T13:38:57.247 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.032+0000 7f13e385a6c0 4 rocksdb: [db/db_impl_open.cc:583] Recovering log #6 mode 2 2021-03-10T13:38:57.247 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.032+0000 7f13e385a6c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1615383537034041, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 7, "file_size": 66120, "table_properties": {"data_size": 64415, "index_size": 310, "filter_size": 581, "raw_key_size": 8602, "raw_average_key_size": 46, "raw_value_size": 59469, "raw_average_value_size": 321, "num_data_blocks": 10, "num_entries": 185, "filter_policy_name": "rocksdb.BuiltinBloomFilter"}} 2021-03-10T13:38:57.248 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.032+0000 7f13e385a6c0 4 rocksdb: [db/version_set.cc:3036] Creating manifest 8 2021-03-10T13:38:57.248 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.032+0000 7f13e385a6c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1615383537034702, "job": 1, "event": "recovery_finished"} 2021-03-10T13:38:57.248 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.032+0000 7f13e385a6c0 4 rocksdb: DB pointer 0x558481ee9200 2021-03-10T13:38:57.248 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.032+0000 7f13ca9a7700 4 rocksdb: [db/db_impl.cc:777] ------- DUMPING STATS ------- 2021-03-10T13:38:57.248 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.032+0000 7f13ca9a7700 4 rocksdb: [db/db_impl.cc:778] 2021-03-10T13:38:57.249 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: ** DB Stats ** 2021-03-10T13:38:57.249 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T13:38:57.249 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2021-03-10T13:38:57.249 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2021-03-10T13:38:57.249 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2021-03-10T13:38:57.250 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2021-03-10T13:38:57.250 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2021-03-10T13:38:57.250 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2021-03-10T13:38:57.250 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: ** Compaction Stats [default] ** 2021-03-10T13:38:57.251 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T13:38:57.251 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T13:38:57.251 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: L0 2/0 66.19 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 116.8 0.00 0.00 1 0.001 0 0 2021-03-10T13:38:57.251 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: Sum 2/0 66.19 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 116.8 0.00 0.00 1 0.001 0 0 2021-03-10T13:38:57.251 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 116.8 0.00 0.00 1 0.001 0 0 2021-03-10T13:38:57.252 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: ** Compaction Stats [default] ** 2021-03-10T13:38:57.252 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T13:38:57.252 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T13:38:57.252 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 116.8 0.00 0.00 1 0.001 0 0 2021-03-10T13:38:57.252 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T13:38:57.253 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: Flush(GB): cumulative 0.000, interval 0.000 2021-03-10T13:38:57.253 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: AddFile(GB): cumulative 0.000, interval 0.000 2021-03-10T13:38:57.253 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: AddFile(Total Files): cumulative 0, interval 0 2021-03-10T13:38:57.253 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: AddFile(L0 Files): cumulative 0, interval 0 2021-03-10T13:38:57.254 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: AddFile(Keys): cumulative 0, interval 0 2021-03-10T13:38:57.254 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: Cumulative compaction: 0.00 GB write, 22.47 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T13:38:57.254 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: Interval compaction: 0.00 GB write, 22.47 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T13:38:57.254 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-03-10T13:38:57.254 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: ** File Read Latency Histogram By Level [default] ** 2021-03-10T13:38:57.255 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: ** Compaction Stats [default] ** 2021-03-10T13:38:57.255 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T13:38:57.255 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T13:38:57.255 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: L0 2/0 66.19 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 116.8 0.00 0.00 1 0.001 0 0 2021-03-10T13:38:57.255 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: Sum 2/0 66.19 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 116.8 0.00 0.00 1 0.001 0 0 2021-03-10T13:38:57.256 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-03-10T13:38:57.256 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: ** Compaction Stats [default] ** 2021-03-10T13:38:57.256 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T13:38:57.256 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T13:38:57.257 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 116.8 0.00 0.00 1 0.001 0 0 2021-03-10T13:38:57.257 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T13:38:57.257 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: Flush(GB): cumulative 0.000, interval 0.000 2021-03-10T13:38:57.257 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: AddFile(GB): cumulative 0.000, interval 0.000 2021-03-10T13:38:57.257 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: AddFile(Total Files): cumulative 0, interval 0 2021-03-10T13:38:57.258 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: AddFile(L0 Files): cumulative 0, interval 0 2021-03-10T13:38:57.258 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: AddFile(Keys): cumulative 0, interval 0 2021-03-10T13:38:57.258 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: Cumulative compaction: 0.00 GB write, 22.16 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T13:38:57.258 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T13:38:57.258 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-03-10T13:38:57.259 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: ** File Read Latency Histogram By Level [default] ** 2021-03-10T13:38:57.259 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.032+0000 7f13e385a6c0 0 starting mon.a rank 0 at public addrs [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] at bind addrs [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid e4a642d2-81a5-11eb-9080-001a4aab830c 2021-03-10T13:38:57.259 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.032+0000 7f13e385a6c0 1 mon.a@-1(???) e1 preinit fsid e4a642d2-81a5-11eb-9080-001a4aab830c 2021-03-10T13:38:57.259 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.032+0000 7f13e385a6c0 0 mon.a@-1(???).mds e1 new map 2021-03-10T13:38:57.259 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.032+0000 7f13e385a6c0 0 mon.a@-1(???).mds e1 print_map 2021-03-10T13:38:57.260 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: e1 2021-03-10T13:38:57.260 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: enable_multiple, ever_enabled_multiple: 0,0 2021-03-10T13:38:57.260 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-03-10T13:38:57.260 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: legacy client fscid: -1 2021-03-10T13:38:57.260 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: 2021-03-10T13:38:57.261 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: No filesystems configured 2021-03-10T13:38:57.261 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.032+0000 7f13e385a6c0 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2021-03-10T13:38:57.261 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.032+0000 7f13e385a6c0 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2021-03-10T13:38:57.261 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.032+0000 7f13e385a6c0 0 mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2021-03-10T13:38:57.261 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.032+0000 7f13e385a6c0 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2021-03-10T13:38:57.262 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: audit 2021-03-10T13:38:54.862492+0000 mon.a (mon.0) 10 : audit [DBG] from='client.? 172.21.2.115:0/1400062389' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:38:57.262 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.036+0000 7f13e385a6c0 1 mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2021-03-10T13:38:57.262 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.036+0000 7f13e385a6c0 20 expand_channel_meta expand map: {default=false} 2021-03-10T13:38:57.262 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.036+0000 7f13e385a6c0 20 expand_channel_meta from 'false' to 'false' 2021-03-10T13:38:57.263 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.036+0000 7f13e385a6c0 20 expand_channel_meta expanded map: {default=false} 2021-03-10T13:38:57.263 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.036+0000 7f13e385a6c0 20 expand_channel_meta expand map: {default=info} 2021-03-10T13:38:57.263 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.036+0000 7f13e385a6c0 20 expand_channel_meta from 'info' to 'info' 2021-03-10T13:38:57.263 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.036+0000 7f13e385a6c0 20 expand_channel_meta expanded map: {default=info} 2021-03-10T13:38:57.263 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.036+0000 7f13e385a6c0 20 expand_channel_meta expand map: {default=daemon} 2021-03-10T13:38:57.264 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.036+0000 7f13e385a6c0 20 expand_channel_meta from 'daemon' to 'daemon' 2021-03-10T13:38:57.264 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.036+0000 7f13e385a6c0 20 expand_channel_meta expanded map: {default=daemon} 2021-03-10T13:38:57.264 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.036+0000 7f13e385a6c0 20 expand_channel_meta expand map: {default=debug} 2021-03-10T13:38:57.264 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.036+0000 7f13e385a6c0 20 expand_channel_meta from 'debug' to 'debug' 2021-03-10T13:38:57.264 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: debug 2021-03-10T13:38:57.036+0000 7f13e385a6c0 20 expand_channel_meta expanded map: {default=debug} 2021-03-10T13:38:57.265 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: cluster 2021-03-10T13:38:57.039813+0000 mon.a (mon.0) 1 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2021-03-10T13:38:57.265 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: cluster 2021-03-10T13:38:57.039852+0000 mon.a (mon.0) 2 : cluster [DBG] monmap e1: 1 mons at {a=[v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0]} 2021-03-10T13:38:57.265 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: cluster 2021-03-10T13:38:57.039887+0000 mon.a (mon.0) 3 : cluster [DBG] fsmap 2021-03-10T13:38:57.265 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: cluster 2021-03-10T13:38:57.039907+0000 mon.a (mon.0) 4 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2021-03-10T13:38:57.265 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:57 gibba015 bash[9806]: cluster 2021-03-10T13:38:57.040228+0000 mon.a (mon.0) 5 : cluster [DBG] mgrmap e1: no daemons active 2021-03-10T13:38:57.747 INFO:teuthology.orchestra.run.gibba015.stderr:INFO:cephadm:Creating mgr... 2021-03-10T13:38:57.748 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:Running command: systemctl daemon-reload 2021-03-10T13:38:57.873 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:Running command: systemctl stop ceph-e4a642d2-81a5-11eb-9080-001a4aab830c@mgr.y 2021-03-10T13:38:57.877 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:Running command: systemctl reset-failed ceph-e4a642d2-81a5-11eb-9080-001a4aab830c@mgr.y 2021-03-10T13:38:57.879 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:systemctl:stderr Failed to reset failed state of unit ceph-e4a642d2-81a5-11eb-9080-001a4aab830c@mgr.y.service: Unit ceph-e4a642d2-81a5-11eb-9080-001a4aab830c@mgr.y.service not loaded. 2021-03-10T13:38:57.880 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:Running command: systemctl enable ceph-e4a642d2-81a5-11eb-9080-001a4aab830c@mgr.y 2021-03-10T13:38:57.881 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:systemctl:stderr Created symlink /etc/systemd/system/ceph-e4a642d2-81a5-11eb-9080-001a4aab830c.target.wants/ceph-e4a642d2-81a5-11eb-9080-001a4aab830c@mgr.y.service -> /etc/systemd/system/ceph-e4a642d2-81a5-11eb-9080-001a4aab830c@.service. 2021-03-10T13:38:58.003 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:Running command: systemctl start ceph-e4a642d2-81a5-11eb-9080-001a4aab830c@mgr.y 2021-03-10T13:38:58.028 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:firewalld does not appear to be present 2021-03-10T13:38:58.028 INFO:teuthology.orchestra.run.gibba015.stderr:INFO:cephadm:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2021-03-10T13:38:58.028 INFO:teuthology.orchestra.run.gibba015.stderr:INFO:cephadm:Wrote config to /etc/ceph/ceph.conf 2021-03-10T13:38:58.029 INFO:teuthology.orchestra.run.gibba015.stderr:INFO:cephadm:Waiting for mgr to start... 2021-03-10T13:38:58.029 INFO:teuthology.orchestra.run.gibba015.stderr:INFO:cephadm:Waiting for mgr... 2021-03-10T13:38:58.029 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba015', '-v', '/var/log/ceph/e4a642d2-81a5-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmp3221digx:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpygecn9iw:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'status', '-f', 'json-pretty'] 2021-03-10T13:38:58.029 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba015 -v /var/log/ceph/e4a642d2-81a5-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp3221digx:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpygecn9iw:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 status -f json-pretty 2021-03-10T13:38:58.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:58 gibba015 bash[9806]: audit 2021-03-10T13:38:57.152229+0000 mon.a (mon.0) 6 : audit [INF] from='client.? 172.21.2.115:0/2355085764' entity='client.admin' cmd=[{"prefix": "config set", "who": "mon", "name": "public_network", "value": "172.21.0.0/20"}]: dispatch 2021-03-10T13:38:58.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:58 gibba015 bash[9806]: audit 2021-03-10T13:38:57.153927+0000 mon.a (mon.0) 7 : audit [INF] from='client.? 172.21.2.115:0/2355085764' entity='client.admin' cmd='[{"prefix": "config set", "who": "mon", "name": "public_network", "value": "172.21.0.0/20"}]': finished 2021-03-10T13:38:58.473 INFO:journalctl@ceph.mgr.y.gibba015.stdout:Mar 10 13:38:58 gibba015 docker[10018]: Error: No such container: ceph-e4a642d2-81a5-11eb-9080-001a4aab830c-mgr.y 2021-03-10T13:38:58.474 INFO:journalctl@ceph.mgr.y.gibba015.stdout:Mar 10 13:38:58 gibba015 systemd[1]: Started Ceph mgr.y for e4a642d2-81a5-11eb-9080-001a4aab830c. 2021-03-10T13:38:59.240 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2021-03-10T13:38:59.240 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:38:59.240 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "fsid": "e4a642d2-81a5-11eb-9080-001a4aab830c", 2021-03-10T13:38:59.241 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "health": { 2021-03-10T13:38:59.241 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status": "HEALTH_OK", 2021-03-10T13:38:59.241 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "checks": {}, 2021-03-10T13:38:59.241 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mutes": [] 2021-03-10T13:38:59.241 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:38:59.242 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "election_epoch": 5, 2021-03-10T13:38:59.242 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum": [ 2021-03-10T13:38:59.242 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 0 2021-03-10T13:38:59.242 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:38:59.243 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum_names": [ 2021-03-10T13:38:59.243 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "a" 2021-03-10T13:38:59.243 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:38:59.243 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum_age": 2, 2021-03-10T13:38:59.243 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "monmap": { 2021-03-10T13:38:59.244 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2021-03-10T13:38:59.244 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_mon_release_name": "octopus", 2021-03-10T13:38:59.244 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_mons": 1 2021-03-10T13:38:59.244 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:38:59.244 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osdmap": { 2021-03-10T13:38:59.245 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2021-03-10T13:38:59.245 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_osds": 0, 2021-03-10T13:38:59.245 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_up_osds": 0, 2021-03-10T13:38:59.245 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_up_since": 0, 2021-03-10T13:38:59.246 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_in_osds": 0, 2021-03-10T13:38:59.246 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_in_since": 0, 2021-03-10T13:38:59.246 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_remapped_pgs": 0 2021-03-10T13:38:59.246 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:38:59.247 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pgmap": { 2021-03-10T13:38:59.247 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pgs_by_state": [], 2021-03-10T13:38:59.247 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_pgs": 0, 2021-03-10T13:38:59.247 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_pools": 0, 2021-03-10T13:38:59.247 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_objects": 0, 2021-03-10T13:38:59.248 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "data_bytes": 0, 2021-03-10T13:38:59.248 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_used": 0, 2021-03-10T13:38:59.248 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_avail": 0, 2021-03-10T13:38:59.248 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_total": 0 2021-03-10T13:38:59.249 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:38:59.249 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "fsmap": { 2021-03-10T13:38:59.249 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2021-03-10T13:38:59.249 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "by_rank": [], 2021-03-10T13:38:59.249 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "up:standby": 0 2021-03-10T13:38:59.250 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:38:59.250 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mgrmap": { 2021-03-10T13:38:59.250 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available": false, 2021-03-10T13:38:59.250 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_standbys": 0, 2021-03-10T13:38:59.251 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modules": [ 2021-03-10T13:38:59.251 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "iostat", 2021-03-10T13:38:59.251 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "restful" 2021-03-10T13:38:59.251 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:38:59.251 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {} 2021-03-10T13:38:59.252 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:38:59.252 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "servicemap": { 2021-03-10T13:38:59.252 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2021-03-10T13:38:59.252 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modified": "2021-03-10T13:38:51.836659+0000", 2021-03-10T13:38:59.252 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {} 2021-03-10T13:38:59.253 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:38:59.253 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress_events": {} 2021-03-10T13:38:59.253 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:38:59.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:38:59 gibba015 bash[9806]: audit 2021-03-10T13:38:59.231279+0000 mon.a (mon.0) 8 : audit [DBG] from='client.? 172.21.2.115:0/918304924' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2021-03-10T13:38:59.761 INFO:teuthology.orchestra.run.gibba015.stderr:INFO:cephadm:mgr not available, waiting (1/10)... 2021-03-10T13:39:00.763 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba015', '-v', '/var/log/ceph/e4a642d2-81a5-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmp3221digx:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpygecn9iw:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'status', '-f', 'json-pretty'] 2021-03-10T13:39:00.763 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba015 -v /var/log/ceph/e4a642d2-81a5-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp3221digx:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpygecn9iw:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 status -f json-pretty 2021-03-10T13:39:01.600 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2021-03-10T13:39:01.600 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:39:01.601 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "fsid": "e4a642d2-81a5-11eb-9080-001a4aab830c", 2021-03-10T13:39:01.601 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "health": { 2021-03-10T13:39:01.601 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status": "HEALTH_OK", 2021-03-10T13:39:01.601 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "checks": {}, 2021-03-10T13:39:01.602 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mutes": [] 2021-03-10T13:39:01.602 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:01.602 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "election_epoch": 5, 2021-03-10T13:39:01.602 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum": [ 2021-03-10T13:39:01.602 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 0 2021-03-10T13:39:01.603 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:01.603 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum_names": [ 2021-03-10T13:39:01.603 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "a" 2021-03-10T13:39:01.603 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:01.604 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum_age": 4, 2021-03-10T13:39:01.604 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "monmap": { 2021-03-10T13:39:01.604 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2021-03-10T13:39:01.604 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_mon_release_name": "octopus", 2021-03-10T13:39:01.604 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_mons": 1 2021-03-10T13:39:01.605 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:01.605 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osdmap": { 2021-03-10T13:39:01.605 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2021-03-10T13:39:01.605 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_osds": 0, 2021-03-10T13:39:01.605 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_up_osds": 0, 2021-03-10T13:39:01.606 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_up_since": 0, 2021-03-10T13:39:01.606 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_in_osds": 0, 2021-03-10T13:39:01.606 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_in_since": 0, 2021-03-10T13:39:01.606 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_remapped_pgs": 0 2021-03-10T13:39:01.607 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:01.607 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pgmap": { 2021-03-10T13:39:01.607 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pgs_by_state": [], 2021-03-10T13:39:01.607 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_pgs": 0, 2021-03-10T13:39:01.607 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_pools": 0, 2021-03-10T13:39:01.608 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_objects": 0, 2021-03-10T13:39:01.608 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "data_bytes": 0, 2021-03-10T13:39:01.608 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_used": 0, 2021-03-10T13:39:01.608 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_avail": 0, 2021-03-10T13:39:01.608 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_total": 0 2021-03-10T13:39:01.609 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:01.609 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "fsmap": { 2021-03-10T13:39:01.609 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2021-03-10T13:39:01.609 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "by_rank": [], 2021-03-10T13:39:01.610 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "up:standby": 0 2021-03-10T13:39:01.610 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:01.610 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mgrmap": { 2021-03-10T13:39:01.610 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available": false, 2021-03-10T13:39:01.610 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_standbys": 0, 2021-03-10T13:39:01.611 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modules": [ 2021-03-10T13:39:01.611 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "iostat", 2021-03-10T13:39:01.611 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "restful" 2021-03-10T13:39:01.611 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:01.611 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {} 2021-03-10T13:39:01.612 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:01.612 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "servicemap": { 2021-03-10T13:39:01.612 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2021-03-10T13:39:01.612 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modified": "2021-03-10T13:38:51.836659+0000", 2021-03-10T13:39:01.613 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {} 2021-03-10T13:39:01.613 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:01.613 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress_events": {} 2021-03-10T13:39:01.613 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:01.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:01 gibba015 bash[9806]: audit 2021-03-10T13:39:01.592054+0000 mon.a (mon.0) 9 : audit [DBG] from='client.? 172.21.2.115:0/2398560020' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2021-03-10T13:39:02.100 INFO:teuthology.orchestra.run.gibba015.stderr:INFO:cephadm:mgr not available, waiting (2/10)... 2021-03-10T13:39:02.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:02 gibba015 bash[9806]: cluster 2021-03-10T13:39:01.886962+0000 mon.a (mon.0) 10 : cluster [INF] Activating manager daemon y 2021-03-10T13:39:02.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:02 gibba015 bash[9806]: cluster 2021-03-10T13:39:01.889080+0000 mon.a (mon.0) 11 : cluster [DBG] mgrmap e2: y(active, starting, since 0.0021656s) 2021-03-10T13:39:02.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:02 gibba015 bash[9806]: audit 2021-03-10T13:39:01.889699+0000 mon.a (mon.0) 12 : audit [DBG] from='mgr.14100 172.21.2.115:0/2651376543' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-03-10T13:39:02.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:02 gibba015 bash[9806]: audit 2021-03-10T13:39:01.889826+0000 mon.a (mon.0) 13 : audit [DBG] from='mgr.14100 172.21.2.115:0/2651376543' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-03-10T13:39:02.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:02 gibba015 bash[9806]: audit 2021-03-10T13:39:01.889980+0000 mon.a (mon.0) 14 : audit [DBG] from='mgr.14100 172.21.2.115:0/2651376543' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-03-10T13:39:02.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:02 gibba015 bash[9806]: audit 2021-03-10T13:39:01.890374+0000 mon.a (mon.0) 15 : audit [DBG] from='mgr.14100 172.21.2.115:0/2651376543' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-03-10T13:39:02.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:02 gibba015 bash[9806]: audit 2021-03-10T13:39:01.890523+0000 mon.a (mon.0) 16 : audit [DBG] from='mgr.14100 172.21.2.115:0/2651376543' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2021-03-10T13:39:02.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:02 gibba015 bash[9806]: cluster 2021-03-10T13:39:01.891935+0000 mon.a (mon.0) 17 : cluster [INF] Manager daemon y is now available 2021-03-10T13:39:02.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:02 gibba015 bash[9806]: audit 2021-03-10T13:39:01.899613+0000 mon.a (mon.0) 18 : audit [INF] from='mgr.14100 172.21.2.115:0/2651376543' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2021-03-10T13:39:02.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:02 gibba015 bash[9806]: audit 2021-03-10T13:39:01.967949+0000 mon.a (mon.0) 19 : audit [INF] from='mgr.14100 172.21.2.115:0/2651376543' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]': finished 2021-03-10T13:39:02.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:02 gibba015 bash[9806]: cluster 2021-03-10T13:39:01.967989+0000 mon.a (mon.0) 20 : cluster [DBG] osdmap e2: 0 total, 0 up, 0 in 2021-03-10T13:39:02.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:02 gibba015 bash[9806]: audit 2021-03-10T13:39:01.968801+0000 mon.a (mon.0) 21 : audit [INF] from='mgr.14100 172.21.2.115:0/2651376543' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2021-03-10T13:39:02.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:02 gibba015 bash[9806]: audit 2021-03-10T13:39:01.972114+0000 mon.a (mon.0) 22 : audit [INF] from='mgr.14100 172.21.2.115:0/2651376543' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/telemetry/report_id","val":"feb7fc86-1811-4458-93d9-9793a0bfe1c9"}]: dispatch 2021-03-10T13:39:02.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:02 gibba015 bash[9806]: audit 2021-03-10T13:39:01.973530+0000 mon.a (mon.0) 23 : audit [INF] from='mgr.14100 172.21.2.115:0/2651376543' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/telemetry/report_id","val":"feb7fc86-1811-4458-93d9-9793a0bfe1c9"}]': finished 2021-03-10T13:39:02.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:02 gibba015 bash[9806]: audit 2021-03-10T13:39:01.974072+0000 mon.a (mon.0) 24 : audit [INF] from='mgr.14100 172.21.2.115:0/2651376543' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/telemetry/salt","val":"90ec1740-f64d-4fd8-a373-ba057a4111b6"}]: dispatch 2021-03-10T13:39:02.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:02 gibba015 bash[9806]: audit 2021-03-10T13:39:01.975913+0000 mon.a (mon.0) 25 : audit [INF] from='mgr.14100 172.21.2.115:0/2651376543' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/telemetry/salt","val":"90ec1740-f64d-4fd8-a373-ba057a4111b6"}]': finished 2021-03-10T13:39:03.102 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba015', '-v', '/var/log/ceph/e4a642d2-81a5-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmp3221digx:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpygecn9iw:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'status', '-f', 'json-pretty'] 2021-03-10T13:39:03.102 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba015 -v /var/log/ceph/e4a642d2-81a5-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp3221digx:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpygecn9iw:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 status -f json-pretty 2021-03-10T13:39:04.189 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2021-03-10T13:39:04.189 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:39:04.189 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "fsid": "e4a642d2-81a5-11eb-9080-001a4aab830c", 2021-03-10T13:39:04.189 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "health": { 2021-03-10T13:39:04.190 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status": "HEALTH_OK", 2021-03-10T13:39:04.190 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "checks": {}, 2021-03-10T13:39:04.190 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mutes": [] 2021-03-10T13:39:04.191 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:04.191 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "election_epoch": 5, 2021-03-10T13:39:04.191 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum": [ 2021-03-10T13:39:04.191 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 0 2021-03-10T13:39:04.191 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:04.192 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum_names": [ 2021-03-10T13:39:04.192 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "a" 2021-03-10T13:39:04.192 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:04.192 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum_age": 7, 2021-03-10T13:39:04.193 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "monmap": { 2021-03-10T13:39:04.193 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2021-03-10T13:39:04.193 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_mon_release_name": "octopus", 2021-03-10T13:39:04.193 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_mons": 1 2021-03-10T13:39:04.193 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:04.194 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osdmap": { 2021-03-10T13:39:04.194 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 3, 2021-03-10T13:39:04.194 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_osds": 0, 2021-03-10T13:39:04.194 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_up_osds": 0, 2021-03-10T13:39:04.194 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_up_since": 0, 2021-03-10T13:39:04.195 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_in_osds": 0, 2021-03-10T13:39:04.195 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_in_since": 0, 2021-03-10T13:39:04.195 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_remapped_pgs": 0 2021-03-10T13:39:04.195 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:04.196 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pgmap": { 2021-03-10T13:39:04.196 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pgs_by_state": [], 2021-03-10T13:39:04.196 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_pgs": 0, 2021-03-10T13:39:04.196 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_pools": 0, 2021-03-10T13:39:04.196 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_objects": 0, 2021-03-10T13:39:04.197 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "data_bytes": 0, 2021-03-10T13:39:04.197 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_used": 0, 2021-03-10T13:39:04.197 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_avail": 0, 2021-03-10T13:39:04.197 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_total": 0 2021-03-10T13:39:04.197 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:04.198 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "fsmap": { 2021-03-10T13:39:04.198 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2021-03-10T13:39:04.198 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "by_rank": [], 2021-03-10T13:39:04.198 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "up:standby": 0 2021-03-10T13:39:04.199 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:04.199 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mgrmap": { 2021-03-10T13:39:04.199 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available": true, 2021-03-10T13:39:04.199 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_standbys": 0, 2021-03-10T13:39:04.200 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modules": [ 2021-03-10T13:39:04.200 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "iostat", 2021-03-10T13:39:04.200 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "restful" 2021-03-10T13:39:04.200 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:04.200 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {} 2021-03-10T13:39:04.201 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:04.201 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "servicemap": { 2021-03-10T13:39:04.201 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2021-03-10T13:39:04.201 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modified": "2021-03-10T13:38:51.836659+0000", 2021-03-10T13:39:04.202 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {} 2021-03-10T13:39:04.202 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:04.202 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress_events": {} 2021-03-10T13:39:04.202 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:04.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:03 gibba015 bash[9806]: cluster 2021-03-10T13:39:02.897539+0000 mon.a (mon.0) 26 : cluster [DBG] mgrmap e3: y(active, since 1.01063s) 2021-03-10T13:39:04.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:03 gibba015 bash[9806]: audit 2021-03-10T13:39:02.973760+0000 mon.a (mon.0) 27 : audit [INF] from='mgr.14100 172.21.2.115:0/2651376543' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2021-03-10T13:39:04.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:03 gibba015 bash[9806]: cluster 2021-03-10T13:39:02.973893+0000 mon.a (mon.0) 28 : cluster [DBG] osdmap e3: 0 total, 0 up, 0 in 2021-03-10T13:39:04.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:03 gibba015 bash[9806]: audit 2021-03-10T13:39:02.981237+0000 mon.a (mon.0) 29 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2021-03-10T13:39:04.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:03 gibba015 bash[9806]: audit 2021-03-10T13:39:03.139247+0000 mon.a (mon.0) 30 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2021-03-10T13:39:04.726 INFO:teuthology.orchestra.run.gibba015.stderr:INFO:cephadm:Enabling cephadm module... 2021-03-10T13:39:04.726 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba015', '-v', '/var/log/ceph/e4a642d2-81a5-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmp3221digx:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpygecn9iw:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'mgr', 'module', 'enable', 'cephadm'] 2021-03-10T13:39:04.727 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba015 -v /var/log/ceph/e4a642d2-81a5-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp3221digx:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpygecn9iw:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 mgr module enable cephadm 2021-03-10T13:39:05.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:04 gibba015 bash[9806]: cluster 2021-03-10T13:39:03.971003+0000 mon.a (mon.0) 31 : cluster [DBG] mgrmap e4: y(active, since 2s) 2021-03-10T13:39:05.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:04 gibba015 bash[9806]: audit 2021-03-10T13:39:04.181229+0000 mon.a (mon.0) 32 : audit [DBG] from='client.? 172.21.2.115:0/2509192965' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2021-03-10T13:39:06.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:05 gibba015 bash[9806]: audit 2021-03-10T13:39:05.708330+0000 mon.a (mon.0) 33 : audit [INF] from='client.? 172.21.2.115:0/1054703911' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2021-03-10T13:39:06.473 INFO:journalctl@ceph.mgr.y.gibba015.stdout:Mar 10 13:39:05 gibba015 bash[10036]: ignoring --setuser ceph since I am not root 2021-03-10T13:39:06.474 INFO:journalctl@ceph.mgr.y.gibba015.stdout:Mar 10 13:39:05 gibba015 bash[10036]: ignoring --setgroup ceph since I am not root 2021-03-10T13:39:06.480 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba015', '-v', '/var/log/ceph/e4a642d2-81a5-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmp3221digx:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpygecn9iw:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'mgr', 'dump'] 2021-03-10T13:39:06.480 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba015 -v /var/log/ceph/e4a642d2-81a5-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp3221digx:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpygecn9iw:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 mgr dump 2021-03-10T13:39:07.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:06 gibba015 bash[9806]: audit 2021-03-10T13:39:05.980181+0000 mon.a (mon.0) 34 : audit [INF] from='client.? 172.21.2.115:0/1054703911' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2021-03-10T13:39:07.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:06 gibba015 bash[9806]: cluster 2021-03-10T13:39:05.980223+0000 mon.a (mon.0) 35 : cluster [DBG] mgrmap e5: y(active, since 4s) 2021-03-10T13:39:07.933 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:39:07.933 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 5, 2021-03-10T13:39:07.933 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_gid": 14100, 2021-03-10T13:39:07.933 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_name": "y", 2021-03-10T13:39:07.934 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_addrs": { 2021-03-10T13:39:07.934 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2021-03-10T13:39:07.934 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:39:07.934 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2021-03-10T13:39:07.935 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.2.115:6800", 2021-03-10T13:39:07.935 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 357167334 2021-03-10T13:39:07.935 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:07.935 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:39:07.935 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v1", 2021-03-10T13:39:07.936 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.2.115:6801", 2021-03-10T13:39:07.936 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 357167334 2021-03-10T13:39:07.936 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:07.936 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2021-03-10T13:39:07.936 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:07.937 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_addr": "172.21.2.115:6801/357167334", 2021-03-10T13:39:07.937 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_change": "2021-03-10T13:39:01.886908+0000", 2021-03-10T13:39:07.937 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_mgr_features": 4540138292836696063, 2021-03-10T13:39:07.937 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available": true, 2021-03-10T13:39:07.937 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "standbys": [], 2021-03-10T13:39:07.938 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modules": [ 2021-03-10T13:39:07.938 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "cephadm", 2021-03-10T13:39:07.938 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "iostat", 2021-03-10T13:39:07.938 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "restful" 2021-03-10T13:39:07.939 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:07.939 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available_modules": [ 2021-03-10T13:39:07.939 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:39:07.939 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "alerts", 2021-03-10T13:39:07.939 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:39:07.940 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:39:07.940 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:39:07.940 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2021-03-10T13:39:07.940 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2021-03-10T13:39:07.940 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:39:07.941 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:07.941 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:07.941 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2021-03-10T13:39:07.941 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:07.941 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:07.942 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:07.942 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "How frequently to reexamine health status", 2021-03-10T13:39:07.942 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:07.942 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:07.942 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:07.943 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:07.943 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:39:07.943 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:39:07.943 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:07.943 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:07.944 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:07.944 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:07.944 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:07.944 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:07.944 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:07.945 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:07.945 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:07.945 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:07.945 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:07.945 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:07.946 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:07.946 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:07.946 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:07.946 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:07.947 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:07.947 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:07.947 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:07.947 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:39:07.947 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:39:07.948 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:07.948 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:07.948 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:07.948 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:07.948 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:07.949 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:07.949 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:07.949 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:07.949 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:07.949 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:07.950 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:07.950 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:07.950 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:39:07.950 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:39:07.950 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:07.951 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:07.951 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:07.951 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:39:07.951 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:07.951 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:07.952 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:07.952 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:07.952 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:07.952 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:07.952 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:07.953 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:07.953 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:07.953 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:07.953 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:07.953 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:07.954 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:07.954 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:07.954 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:07.954 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:39:07.955 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:39:07.955 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:07.955 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:07.955 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:07.955 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:07.956 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:07.956 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:07.956 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:07.956 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:07.956 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:07.957 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:07.957 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:07.957 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:07.957 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_destination": { 2021-03-10T13:39:07.957 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_destination", 2021-03-10T13:39:07.958 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:07.958 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:07.958 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:07.958 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:07.959 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:07.959 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:07.959 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:07.959 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Email address to send alerts to", 2021-03-10T13:39:07.959 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:07.960 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:07.960 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:07.960 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:07.960 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_from_name": { 2021-03-10T13:39:07.960 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_from_name", 2021-03-10T13:39:07.961 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:07.961 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:07.961 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:07.961 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "Ceph", 2021-03-10T13:39:07.961 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:07.962 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:07.962 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:07.962 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Email From: name", 2021-03-10T13:39:07.962 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:07.963 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:07.963 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:07.963 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:07.963 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_host": { 2021-03-10T13:39:07.963 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_host", 2021-03-10T13:39:07.964 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:07.964 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:07.964 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:07.964 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:07.964 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:07.965 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:07.965 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:07.965 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "SMTP server", 2021-03-10T13:39:07.965 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:07.965 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:07.966 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:07.966 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:07.966 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_password": { 2021-03-10T13:39:07.966 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_password", 2021-03-10T13:39:07.966 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:07.967 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:07.967 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:07.967 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:07.967 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:07.967 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:07.968 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:07.968 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Password to authenticate with", 2021-03-10T13:39:07.968 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:07.968 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:07.968 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:07.969 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:07.969 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_port": { 2021-03-10T13:39:07.969 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_port", 2021-03-10T13:39:07.969 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:39:07.969 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:07.970 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:07.970 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "465", 2021-03-10T13:39:07.970 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:07.970 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:07.971 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:07.971 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "SMTP port", 2021-03-10T13:39:07.971 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:07.971 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:07.971 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:07.972 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:07.972 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_sender": { 2021-03-10T13:39:07.972 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_sender", 2021-03-10T13:39:07.972 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:07.972 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:07.973 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:07.973 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:07.973 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:07.973 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:07.973 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:07.974 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "SMTP envelope sender", 2021-03-10T13:39:07.974 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:07.974 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:07.974 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:07.974 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:07.975 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_ssl": { 2021-03-10T13:39:07.975 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_ssl", 2021-03-10T13:39:07.975 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:07.975 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:07.975 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:07.976 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:39:07.976 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:07.976 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:07.976 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:07.976 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Use SSL to connect to SMTP server", 2021-03-10T13:39:07.977 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:07.977 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:07.977 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:07.977 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:07.977 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_user": { 2021-03-10T13:39:07.978 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_user", 2021-03-10T13:39:07.978 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:07.978 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:07.978 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:07.979 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:07.979 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:07.979 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:07.979 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:07.979 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "User to authenticate as", 2021-03-10T13:39:07.980 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:07.980 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:07.980 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:07.980 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:07.980 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:07.980 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:07.981 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:39:07.981 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "balancer", 2021-03-10T13:39:07.981 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:39:07.981 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:39:07.981 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:39:07.982 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active": { 2021-03-10T13:39:07.982 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "active", 2021-03-10T13:39:07.982 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:07.982 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:07.983 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:07.983 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:07.983 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:07.983 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:07.983 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:07.984 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "automatically balance PGs across cluster", 2021-03-10T13:39:07.984 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:07.984 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:07.984 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:07.984 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:07.985 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "begin_time": { 2021-03-10T13:39:07.985 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "begin_time", 2021-03-10T13:39:07.985 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:07.985 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:07.985 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:07.986 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0000", 2021-03-10T13:39:07.986 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:07.986 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:07.986 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:07.987 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "beginning time of day to automatically balance", 2021-03-10T13:39:07.987 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "This is a time of day in the format HHMM.", 2021-03-10T13:39:07.987 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:07.987 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:07.987 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:07.988 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "begin_weekday": { 2021-03-10T13:39:07.988 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "begin_weekday", 2021-03-10T13:39:07.988 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2021-03-10T13:39:07.988 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:07.988 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:07.989 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0", 2021-03-10T13:39:07.989 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "0", 2021-03-10T13:39:07.989 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "7", 2021-03-10T13:39:07.989 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:07.989 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Restrict automatic balancing to this day of the week or later", 2021-03-10T13:39:07.990 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2021-03-10T13:39:07.990 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:07.990 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:07.990 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:07.991 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush_compat_max_iterations": { 2021-03-10T13:39:07.991 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crush_compat_max_iterations", 2021-03-10T13:39:07.991 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2021-03-10T13:39:07.991 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:07.991 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:07.992 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "25", 2021-03-10T13:39:07.992 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "1", 2021-03-10T13:39:07.992 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "250", 2021-03-10T13:39:07.992 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:07.992 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "maximum number of iterations to attempt optimization", 2021-03-10T13:39:07.993 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:07.993 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:07.993 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:07.993 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:07.993 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush_compat_metrics": { 2021-03-10T13:39:07.994 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crush_compat_metrics", 2021-03-10T13:39:07.994 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:07.994 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:07.994 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:07.995 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "pgs,objects,bytes", 2021-03-10T13:39:07.995 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:07.995 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:07.995 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:07.995 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "metrics with which to calculate OSD utilization", 2021-03-10T13:39:07.996 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2021-03-10T13:39:07.996 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:07.996 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:07.996 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:07.996 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush_compat_step": { 2021-03-10T13:39:07.996 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crush_compat_step", 2021-03-10T13:39:07.997 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "float", 2021-03-10T13:39:07.997 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:07.997 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:07.997 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0.5", 2021-03-10T13:39:07.998 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "0.001", 2021-03-10T13:39:07.998 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "0.999", 2021-03-10T13:39:07.998 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:07.998 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "aggressiveness of optimization", 2021-03-10T13:39:07.998 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": ".99 is very aggressive, .01 is less aggressive", 2021-03-10T13:39:07.999 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:07.999 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:07.999 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:07.999 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "end_time": { 2021-03-10T13:39:07.999 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "end_time", 2021-03-10T13:39:08.000 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.000 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.000 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.000 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "2400", 2021-03-10T13:39:08.001 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.001 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.001 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.001 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "ending time of day to automatically balance", 2021-03-10T13:39:08.001 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "This is a time of day in the format HHMM.", 2021-03-10T13:39:08.002 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.002 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.002 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.002 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "end_weekday": { 2021-03-10T13:39:08.002 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "end_weekday", 2021-03-10T13:39:08.003 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2021-03-10T13:39:08.003 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.003 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.003 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "7", 2021-03-10T13:39:08.003 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "0", 2021-03-10T13:39:08.004 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "7", 2021-03-10T13:39:08.004 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.004 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Restrict automatic balancing to days of the week earlier than this", 2021-03-10T13:39:08.004 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2021-03-10T13:39:08.004 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.005 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.005 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.005 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:39:08.005 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:39:08.005 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.006 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.006 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.006 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:08.006 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.006 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.007 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:08.007 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:08.007 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:08.007 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:08.007 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:08.008 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:08.008 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:08.008 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:08.008 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.008 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.009 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.009 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.009 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.009 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:39:08.009 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:39:08.010 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.010 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.010 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.010 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:08.011 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.011 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.011 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.011 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.011 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.012 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.012 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.012 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.012 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:39:08.012 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:39:08.013 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.013 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.013 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.013 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:39:08.013 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.014 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.014 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:08.014 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:08.014 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:08.014 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:08.015 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:08.015 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:08.015 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:08.015 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:08.015 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.016 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.016 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.016 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.016 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.017 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:39:08.017 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:39:08.017 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.017 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.017 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.018 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:08.018 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.018 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.018 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.018 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.019 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.019 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.019 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.019 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.019 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_score": { 2021-03-10T13:39:08.020 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "min_score", 2021-03-10T13:39:08.020 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "float", 2021-03-10T13:39:08.020 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.020 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.020 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0", 2021-03-10T13:39:08.021 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.021 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.021 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.021 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "minimum score, below which no optimization is attempted", 2021-03-10T13:39:08.021 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.022 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.022 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.022 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.022 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mode": { 2021-03-10T13:39:08.022 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mode", 2021-03-10T13:39:08.023 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.023 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.023 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.023 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "none", 2021-03-10T13:39:08.023 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.024 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.024 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:08.024 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush-compat", 2021-03-10T13:39:08.024 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "none", 2021-03-10T13:39:08.024 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "upmap" 2021-03-10T13:39:08.025 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:08.025 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Balancer mode", 2021-03-10T13:39:08.025 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.025 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.026 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.026 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.026 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pool_ids": { 2021-03-10T13:39:08.026 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pool_ids", 2021-03-10T13:39:08.026 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.027 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.027 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.027 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:08.027 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.028 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.028 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.028 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "pools which the automatic balancing will be limited to", 2021-03-10T13:39:08.028 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.028 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.029 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.029 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.029 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2021-03-10T13:39:08.029 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2021-03-10T13:39:08.029 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:39:08.030 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.030 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.030 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2021-03-10T13:39:08.030 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.030 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.031 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.031 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to wake up and attempt optimization", 2021-03-10T13:39:08.031 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.031 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.031 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.032 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.032 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "upmap_max_deviation": { 2021-03-10T13:39:08.032 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "upmap_max_deviation", 2021-03-10T13:39:08.032 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:39:08.032 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.033 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.033 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2021-03-10T13:39:08.033 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "1", 2021-03-10T13:39:08.033 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.033 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.033 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "deviation below which no optimization is attempted", 2021-03-10T13:39:08.034 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2021-03-10T13:39:08.034 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.034 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.034 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.035 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "upmap_max_optimizations": { 2021-03-10T13:39:08.035 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "upmap_max_optimizations", 2021-03-10T13:39:08.035 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2021-03-10T13:39:08.035 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.035 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.035 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2021-03-10T13:39:08.036 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.036 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.036 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.036 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "maximum upmap optimizations to make per attempt", 2021-03-10T13:39:08.037 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.037 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.037 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.037 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:08.037 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:08.037 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.038 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:39:08.038 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "cephadm", 2021-03-10T13:39:08.038 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:39:08.038 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:39:08.039 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:39:08.039 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "allow_ptrace": { 2021-03-10T13:39:08.039 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "allow_ptrace", 2021-03-10T13:39:08.039 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.039 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.040 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.040 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:08.040 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.040 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.040 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.040 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "allow SYS_PTRACE capability on ceph containers", 2021-03-10T13:39:08.041 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2021-03-10T13:39:08.041 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.041 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.041 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.041 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "container_image_base": { 2021-03-10T13:39:08.042 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "container_image_base", 2021-03-10T13:39:08.042 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.042 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.042 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.042 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "ceph/ceph", 2021-03-10T13:39:08.043 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.043 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.043 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.043 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Container image name, without the tag", 2021-03-10T13:39:08.043 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.044 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.044 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.044 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.044 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "daemon_cache_timeout": { 2021-03-10T13:39:08.044 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "daemon_cache_timeout", 2021-03-10T13:39:08.045 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:39:08.045 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.045 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.045 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2021-03-10T13:39:08.045 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.046 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.046 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.046 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "seconds to cache service (daemon) inventory", 2021-03-10T13:39:08.046 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.046 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.047 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.047 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.047 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "device_cache_timeout": { 2021-03-10T13:39:08.047 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "device_cache_timeout", 2021-03-10T13:39:08.048 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:39:08.048 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.048 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.048 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "1800", 2021-03-10T13:39:08.048 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.049 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.049 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.049 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "seconds to cache device inventory", 2021-03-10T13:39:08.049 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.049 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.050 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.050 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.050 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "host_check_interval": { 2021-03-10T13:39:08.050 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "host_check_interval", 2021-03-10T13:39:08.050 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:39:08.051 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.051 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.051 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2021-03-10T13:39:08.051 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.051 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.052 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.052 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to perform a host check", 2021-03-10T13:39:08.052 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.052 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.052 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.053 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.053 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:39:08.053 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:39:08.053 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.053 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.054 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.054 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:08.054 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.054 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.054 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:08.055 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:08.055 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:08.055 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:08.055 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:08.056 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:08.056 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:08.056 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:08.056 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.056 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.056 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.057 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.057 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.057 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:39:08.057 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:39:08.057 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.058 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.058 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.058 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:39:08.058 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.059 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.059 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.059 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "log to the \"cephadm\" cluster log channel\"", 2021-03-10T13:39:08.059 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.059 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.059 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.060 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.060 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:39:08.060 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:39:08.060 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.060 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.061 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.061 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:39:08.061 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.061 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.062 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:08.062 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:08.062 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:08.062 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:08.062 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:08.063 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:08.063 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:08.063 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:08.063 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.063 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.064 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.064 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.064 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.064 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:39:08.064 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:39:08.065 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.065 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.065 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.065 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:08.065 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.066 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.066 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.066 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.066 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.066 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.067 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.067 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.067 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mode": { 2021-03-10T13:39:08.067 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mode", 2021-03-10T13:39:08.067 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.068 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.068 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.068 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "root", 2021-03-10T13:39:08.068 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.068 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.069 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:08.069 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "cephadm-package", 2021-03-10T13:39:08.069 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "root" 2021-03-10T13:39:08.069 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:08.069 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "mode for remote execution of cephadm", 2021-03-10T13:39:08.070 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.070 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.070 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.070 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.070 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssh_config_file": { 2021-03-10T13:39:08.071 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssh_config_file", 2021-03-10T13:39:08.071 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.071 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.071 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.071 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T13:39:08.072 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.072 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.072 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.072 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "customized SSH config file to connect to managed hosts", 2021-03-10T13:39:08.072 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.073 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.073 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.073 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.073 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_on_failed_host_check": { 2021-03-10T13:39:08.073 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_on_failed_host_check", 2021-03-10T13:39:08.074 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.074 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.074 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.074 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:39:08.074 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.075 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.075 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.075 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise a health warning if the host check fails", 2021-03-10T13:39:08.075 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.075 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.075 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.076 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.076 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_on_stray_daemons": { 2021-03-10T13:39:08.076 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_on_stray_daemons", 2021-03-10T13:39:08.076 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.076 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.077 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.077 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:39:08.077 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.077 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.077 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.078 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2021-03-10T13:39:08.078 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.078 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.078 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.078 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.079 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_on_stray_hosts": { 2021-03-10T13:39:08.079 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_on_stray_hosts", 2021-03-10T13:39:08.079 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.079 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.079 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.080 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:39:08.080 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.080 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.080 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.080 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2021-03-10T13:39:08.081 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.081 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.081 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.081 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:08.081 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:08.082 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.082 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:39:08.082 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crash", 2021-03-10T13:39:08.082 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:39:08.082 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:39:08.083 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:39:08.083 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:39:08.083 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:39:08.083 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.083 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.084 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.084 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:08.084 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.084 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.084 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:08.085 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:08.085 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:08.085 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:08.085 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:08.085 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:08.086 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:08.086 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:08.086 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.086 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.086 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.087 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.087 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.087 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:39:08.087 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:39:08.087 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.088 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.088 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.088 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:08.088 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.088 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.088 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.089 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.089 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.089 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.089 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.090 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.090 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:39:08.090 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:39:08.090 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.090 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.091 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.091 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:39:08.091 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.091 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.091 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:08.092 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:08.092 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:08.092 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:08.092 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:08.092 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:08.092 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:08.093 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:08.093 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.093 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.093 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.093 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.094 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.094 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:39:08.094 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:39:08.094 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.094 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.095 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.095 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:08.095 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.095 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.095 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.096 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.096 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.096 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.096 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.096 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.097 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "retain_interval": { 2021-03-10T13:39:08.097 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "retain_interval", 2021-03-10T13:39:08.097 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:39:08.097 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.097 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.098 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "31536000", 2021-03-10T13:39:08.098 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.098 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.098 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.098 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how long to retain crashes before pruning them", 2021-03-10T13:39:08.099 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.099 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.099 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.099 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.100 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_recent_interval": { 2021-03-10T13:39:08.100 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_recent_interval", 2021-03-10T13:39:08.100 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:39:08.100 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.100 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.101 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "1209600", 2021-03-10T13:39:08.101 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.101 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.101 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.102 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "time interval in which to warn about recent crashes", 2021-03-10T13:39:08.102 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.102 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.102 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.102 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:08.103 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:08.103 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.103 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:39:08.103 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "dashboard", 2021-03-10T13:39:08.103 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:39:08.104 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:39:08.104 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:39:08.104 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ALERTMANAGER_API_HOST": { 2021-03-10T13:39:08.104 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ALERTMANAGER_API_HOST", 2021-03-10T13:39:08.104 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.104 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.105 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.105 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:08.105 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.105 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.105 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.106 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.106 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.106 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.106 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.107 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.107 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "AUDIT_API_ENABLED": { 2021-03-10T13:39:08.107 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "AUDIT_API_ENABLED", 2021-03-10T13:39:08.107 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.107 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.108 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.108 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:08.108 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.108 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.108 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.108 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.109 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.109 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.109 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.109 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.109 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "AUDIT_API_LOG_PAYLOAD": { 2021-03-10T13:39:08.110 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "AUDIT_API_LOG_PAYLOAD", 2021-03-10T13:39:08.110 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.110 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.110 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.110 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:39:08.111 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.111 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.111 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.111 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.111 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.112 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.112 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.112 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.112 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ENABLE_BROWSABLE_API": { 2021-03-10T13:39:08.112 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ENABLE_BROWSABLE_API", 2021-03-10T13:39:08.113 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.113 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.113 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.113 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:39:08.113 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.114 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.114 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.114 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.114 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.114 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.115 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.115 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.115 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_cephfs": { 2021-03-10T13:39:08.115 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_cephfs", 2021-03-10T13:39:08.115 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.116 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.116 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.116 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:39:08.116 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.116 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.117 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.117 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.117 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.117 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.118 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.118 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.118 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_iscsi": { 2021-03-10T13:39:08.118 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_iscsi", 2021-03-10T13:39:08.118 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.119 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.119 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.119 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:39:08.119 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.119 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.120 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.120 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.120 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.120 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.120 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.121 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.121 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_mirroring": { 2021-03-10T13:39:08.121 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_mirroring", 2021-03-10T13:39:08.121 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.121 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.122 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.122 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:39:08.122 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.122 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.123 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.123 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.123 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.123 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.123 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.124 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.124 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_nfs": { 2021-03-10T13:39:08.124 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_nfs", 2021-03-10T13:39:08.124 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.124 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.125 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.125 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:39:08.125 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.125 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.126 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.126 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.126 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.126 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.126 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.127 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.127 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_rbd": { 2021-03-10T13:39:08.127 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_rbd", 2021-03-10T13:39:08.127 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.128 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.128 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.128 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:39:08.128 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.128 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.129 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.129 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.129 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.129 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.129 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.130 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.130 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_rgw": { 2021-03-10T13:39:08.130 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_rgw", 2021-03-10T13:39:08.130 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.130 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.131 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.131 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:39:08.131 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.131 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.131 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.132 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.132 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.132 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.132 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.132 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.133 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2021-03-10T13:39:08.133 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2021-03-10T13:39:08.133 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.133 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.134 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.134 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:08.134 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.134 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.134 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.135 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.135 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.135 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.135 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.135 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.136 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_PASSWORD": { 2021-03-10T13:39:08.136 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_PASSWORD", 2021-03-10T13:39:08.136 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.136 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.136 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.137 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "admin", 2021-03-10T13:39:08.137 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.137 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.137 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.137 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.138 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.138 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.138 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.138 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.139 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_SSL_VERIFY": { 2021-03-10T13:39:08.139 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_SSL_VERIFY", 2021-03-10T13:39:08.139 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.139 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.139 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.140 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:39:08.140 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.140 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.140 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.140 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.141 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.141 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.141 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.141 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.141 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_URL": { 2021-03-10T13:39:08.142 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_URL", 2021-03-10T13:39:08.142 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.142 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.142 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.143 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:08.143 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.143 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.143 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.143 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.144 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.144 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.144 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.144 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.144 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_USERNAME": { 2021-03-10T13:39:08.145 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_USERNAME", 2021-03-10T13:39:08.145 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.145 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.145 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.145 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "admin", 2021-03-10T13:39:08.146 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.146 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.146 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.146 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.147 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.147 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.147 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.147 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.147 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_UPDATE_DASHBOARDS": { 2021-03-10T13:39:08.148 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_UPDATE_DASHBOARDS", 2021-03-10T13:39:08.148 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.148 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.148 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.148 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:08.149 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.149 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.149 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.149 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.149 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.150 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.150 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.150 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.150 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ISCSI_API_SSL_VERIFICATION": { 2021-03-10T13:39:08.150 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ISCSI_API_SSL_VERIFICATION", 2021-03-10T13:39:08.151 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.151 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.151 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.151 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:39:08.151 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.152 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.152 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.152 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.152 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.152 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.153 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.153 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.153 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PROMETHEUS_API_HOST": { 2021-03-10T13:39:08.153 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PROMETHEUS_API_HOST", 2021-03-10T13:39:08.153 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.153 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.154 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.154 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:08.154 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.154 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.155 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.155 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.155 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.155 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.155 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.156 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.156 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2021-03-10T13:39:08.156 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2021-03-10T13:39:08.156 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.156 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.157 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.157 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:08.157 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.157 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.157 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.158 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.158 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.158 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.158 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.158 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.159 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2021-03-10T13:39:08.159 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2021-03-10T13:39:08.159 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.159 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.159 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.160 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:08.160 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.160 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.160 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.160 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.161 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.161 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.161 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.161 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.161 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2021-03-10T13:39:08.162 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2021-03-10T13:39:08.162 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.162 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.162 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.162 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:39:08.163 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.163 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.163 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.163 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.163 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.163 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.164 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.164 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.164 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2021-03-10T13:39:08.164 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2021-03-10T13:39:08.164 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.165 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.165 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.165 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:39:08.165 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.165 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.166 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.166 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.166 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.166 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.166 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.167 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.167 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2021-03-10T13:39:08.167 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2021-03-10T13:39:08.167 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.168 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.168 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.168 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:08.168 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.168 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.168 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.169 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.169 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.169 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.169 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.169 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.170 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2021-03-10T13:39:08.170 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2021-03-10T13:39:08.170 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.170 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.170 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.171 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:08.171 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.171 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.171 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.171 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.172 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.172 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.172 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.172 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.172 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2021-03-10T13:39:08.173 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2021-03-10T13:39:08.173 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.173 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.173 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.173 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:08.173 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.174 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.174 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.174 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.174 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.174 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.175 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.175 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.175 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_ENABLED": { 2021-03-10T13:39:08.175 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_ENABLED", 2021-03-10T13:39:08.175 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.176 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.176 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.176 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:39:08.176 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.176 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.177 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.177 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.177 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.177 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.177 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.178 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.178 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_EXCLUSION_LIST": { 2021-03-10T13:39:08.178 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_EXCLUSION_LIST", 2021-03-10T13:39:08.178 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.178 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.179 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.179 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2021-03-10T13:39:08.179 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.179 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.179 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.179 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.180 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.180 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.180 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.180 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.180 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_MIN_COMPLEXITY": { 2021-03-10T13:39:08.181 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_MIN_COMPLEXITY", 2021-03-10T13:39:08.181 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:39:08.181 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.181 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.181 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2021-03-10T13:39:08.182 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.182 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.182 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.182 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.182 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.183 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.183 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.183 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.183 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_MIN_LENGTH": { 2021-03-10T13:39:08.183 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_MIN_LENGTH", 2021-03-10T13:39:08.184 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:39:08.184 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.184 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.184 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8", 2021-03-10T13:39:08.184 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.185 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.185 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.185 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.185 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.185 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.186 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.186 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.186 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "REST_REQUESTS_TIMEOUT": { 2021-03-10T13:39:08.186 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "REST_REQUESTS_TIMEOUT", 2021-03-10T13:39:08.186 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:39:08.187 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.187 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.187 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "45", 2021-03-10T13:39:08.187 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.187 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.188 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.188 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.188 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.188 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.188 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.189 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.189 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_ACCESS_KEY": { 2021-03-10T13:39:08.189 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_ACCESS_KEY", 2021-03-10T13:39:08.189 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.189 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.190 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.190 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:08.190 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.190 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.190 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.191 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.191 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.191 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.191 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.191 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.192 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_ADMIN_RESOURCE": { 2021-03-10T13:39:08.192 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_ADMIN_RESOURCE", 2021-03-10T13:39:08.192 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.192 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.192 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.193 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "admin", 2021-03-10T13:39:08.193 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.193 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.193 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.193 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.193 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.194 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.194 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.194 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.194 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_HOST": { 2021-03-10T13:39:08.194 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_HOST", 2021-03-10T13:39:08.195 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.195 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.195 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.195 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:08.195 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.196 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.196 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.196 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.196 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.196 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.197 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.197 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.197 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_PORT": { 2021-03-10T13:39:08.197 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_PORT", 2021-03-10T13:39:08.197 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:39:08.197 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.198 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.198 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "80", 2021-03-10T13:39:08.198 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.198 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.199 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.199 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.199 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.199 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.199 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.199 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.200 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_SCHEME": { 2021-03-10T13:39:08.200 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_SCHEME", 2021-03-10T13:39:08.200 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.200 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.200 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.201 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "http", 2021-03-10T13:39:08.201 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.201 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.201 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.202 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.202 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.202 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.202 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.202 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.203 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_SECRET_KEY": { 2021-03-10T13:39:08.203 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_SECRET_KEY", 2021-03-10T13:39:08.203 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.203 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.203 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.204 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:08.204 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.204 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.204 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.204 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.205 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.205 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.205 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.205 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.205 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_SSL_VERIFY": { 2021-03-10T13:39:08.206 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_SSL_VERIFY", 2021-03-10T13:39:08.206 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.206 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.206 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.206 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:39:08.207 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.207 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.207 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.207 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.207 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.207 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.208 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.208 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.208 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_USER_ID": { 2021-03-10T13:39:08.208 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_USER_ID", 2021-03-10T13:39:08.208 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.209 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.209 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.209 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:08.209 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.209 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.210 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.210 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.210 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.210 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.210 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.211 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.211 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "USER_PWD_EXPIRATION_SPAN": { 2021-03-10T13:39:08.211 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "USER_PWD_EXPIRATION_SPAN", 2021-03-10T13:39:08.211 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:39:08.211 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.212 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.212 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0", 2021-03-10T13:39:08.212 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.212 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.213 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.213 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.213 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.213 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.213 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.213 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.214 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "USER_PWD_EXPIRATION_WARNING_1": { 2021-03-10T13:39:08.214 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "USER_PWD_EXPIRATION_WARNING_1", 2021-03-10T13:39:08.214 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:39:08.214 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.215 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.215 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2021-03-10T13:39:08.215 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.215 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.215 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.216 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.216 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.216 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.216 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.216 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.216 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "USER_PWD_EXPIRATION_WARNING_2": { 2021-03-10T13:39:08.217 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "USER_PWD_EXPIRATION_WARNING_2", 2021-03-10T13:39:08.217 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:39:08.217 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.217 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.217 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2021-03-10T13:39:08.218 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.218 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.218 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.218 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.218 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.219 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.219 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.219 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.219 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crt_file": { 2021-03-10T13:39:08.219 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crt_file", 2021-03-10T13:39:08.220 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.220 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.220 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.220 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:08.220 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.221 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.221 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.221 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.221 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.221 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.222 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.222 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.222 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug": { 2021-03-10T13:39:08.222 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "debug", 2021-03-10T13:39:08.222 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.223 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.223 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.223 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:08.223 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.223 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.224 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.224 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Enable/disable debug options", 2021-03-10T13:39:08.224 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.224 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.224 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.225 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.225 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "jwt_token_ttl": { 2021-03-10T13:39:08.225 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "jwt_token_ttl", 2021-03-10T13:39:08.225 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:39:08.225 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.226 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.226 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "28800", 2021-03-10T13:39:08.226 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.226 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.226 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.227 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.227 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.227 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.227 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.227 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.228 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "key_file": { 2021-03-10T13:39:08.228 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "key_file", 2021-03-10T13:39:08.228 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.228 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.228 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.229 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:08.229 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.229 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.229 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.229 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.230 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.230 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.230 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.230 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.231 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:39:08.231 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:39:08.231 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.231 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.231 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.232 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:08.232 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.232 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.232 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:08.232 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:08.232 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:08.233 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:08.233 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:08.233 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:08.233 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:08.233 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:08.234 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.234 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.234 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.234 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.234 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.235 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:39:08.235 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:39:08.235 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.235 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.236 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.236 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:08.236 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.236 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.236 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.237 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.237 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.237 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.237 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.237 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.238 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:39:08.238 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:39:08.238 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.238 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.238 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.239 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:39:08.239 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.239 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.239 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:08.239 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:08.240 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:08.240 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:08.240 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:08.240 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:08.240 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:08.241 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:08.241 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.241 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.241 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.241 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.242 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.242 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:39:08.242 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:39:08.242 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.242 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.243 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.243 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:08.243 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.243 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.243 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.244 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.244 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.244 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.244 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.244 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.245 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "password": { 2021-03-10T13:39:08.245 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "password", 2021-03-10T13:39:08.245 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.245 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.245 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.246 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:08.246 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.246 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.246 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.246 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.247 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.247 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.247 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.247 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.247 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_addr": { 2021-03-10T13:39:08.248 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_addr", 2021-03-10T13:39:08.248 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.248 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.248 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.248 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "::", 2021-03-10T13:39:08.249 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.249 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.249 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.249 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.249 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.250 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.250 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.250 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.250 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_port": { 2021-03-10T13:39:08.250 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_port", 2021-03-10T13:39:08.251 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:39:08.251 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.251 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.251 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8080", 2021-03-10T13:39:08.251 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.252 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.252 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.252 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.252 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.252 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.253 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.253 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.253 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssl": { 2021-03-10T13:39:08.253 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssl", 2021-03-10T13:39:08.253 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.254 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.254 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.254 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:39:08.254 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.254 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.255 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.255 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.255 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.255 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.256 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.256 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.256 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssl_server_port": { 2021-03-10T13:39:08.256 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssl_server_port", 2021-03-10T13:39:08.256 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:39:08.257 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.257 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.257 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8443", 2021-03-10T13:39:08.257 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.257 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.257 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.258 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.258 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.258 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.258 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.259 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.259 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "standby_behaviour": { 2021-03-10T13:39:08.259 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "standby_behaviour", 2021-03-10T13:39:08.259 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.259 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.260 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.260 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "redirect", 2021-03-10T13:39:08.260 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.260 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.260 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:08.261 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:08.261 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "redirect" 2021-03-10T13:39:08.261 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:08.261 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.261 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.262 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.262 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.262 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.262 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "standby_error_status_code": { 2021-03-10T13:39:08.262 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "standby_error_status_code", 2021-03-10T13:39:08.263 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:39:08.263 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.263 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.263 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "500", 2021-03-10T13:39:08.263 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "400", 2021-03-10T13:39:08.264 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "599", 2021-03-10T13:39:08.264 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.264 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.264 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.264 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.265 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.265 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.265 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "url_prefix": { 2021-03-10T13:39:08.265 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "url_prefix", 2021-03-10T13:39:08.265 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.265 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.266 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.266 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:08.266 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.266 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.266 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.267 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.267 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.267 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.267 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.267 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.268 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "username": { 2021-03-10T13:39:08.268 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "username", 2021-03-10T13:39:08.268 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.268 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.268 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.269 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:08.269 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.269 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.269 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.269 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.270 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.270 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.270 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.270 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:08.271 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:08.271 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.271 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:39:08.271 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "devicehealth", 2021-03-10T13:39:08.271 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:39:08.272 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:39:08.272 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:39:08.272 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enable_monitoring": { 2021-03-10T13:39:08.272 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "enable_monitoring", 2021-03-10T13:39:08.272 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.273 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.273 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.273 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:39:08.273 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.273 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.274 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.274 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "monitor device health metrics", 2021-03-10T13:39:08.274 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.274 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.274 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.275 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.275 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:39:08.275 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:39:08.275 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.275 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.276 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.276 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:08.276 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.276 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.276 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:08.277 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:08.277 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:08.277 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:08.277 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:08.277 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:08.277 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:08.278 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:08.278 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.278 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.278 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.279 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.279 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.279 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:39:08.279 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:39:08.279 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.280 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.280 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.280 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:08.280 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.280 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.281 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.281 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.281 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.281 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.281 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.281 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.282 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:39:08.282 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:39:08.282 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.282 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.283 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.283 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:39:08.283 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.283 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.283 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:08.283 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:08.284 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:08.284 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:08.284 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:08.284 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:08.284 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:08.285 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:08.285 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.285 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.285 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.285 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.286 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.286 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:39:08.286 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:39:08.286 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.286 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.287 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.287 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:08.287 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.287 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.288 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.288 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.288 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.288 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.288 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.288 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.289 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mark_out_threshold": { 2021-03-10T13:39:08.289 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mark_out_threshold", 2021-03-10T13:39:08.289 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:39:08.289 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.290 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.290 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "2419200", 2021-03-10T13:39:08.290 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.290 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.290 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.291 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "automatically mark OSD if it may fail before this long", 2021-03-10T13:39:08.291 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.291 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.291 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.291 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.292 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pool_name": { 2021-03-10T13:39:08.292 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pool_name", 2021-03-10T13:39:08.292 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.292 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.292 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.293 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "device_health_metrics", 2021-03-10T13:39:08.293 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.293 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.293 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.293 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "name of pool in which to store device health metrics", 2021-03-10T13:39:08.294 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.294 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.294 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.294 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.294 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "retention_period": { 2021-03-10T13:39:08.295 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "retention_period", 2021-03-10T13:39:08.295 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:39:08.295 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.295 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.295 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "15552000", 2021-03-10T13:39:08.296 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.296 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.296 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.296 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how long to retain device health metrics", 2021-03-10T13:39:08.296 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.297 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.297 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.297 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.297 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "scrape_frequency": { 2021-03-10T13:39:08.297 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "scrape_frequency", 2021-03-10T13:39:08.297 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:39:08.298 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.298 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.298 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "86400", 2021-03-10T13:39:08.298 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.298 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.299 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.299 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to scrape device health metrics", 2021-03-10T13:39:08.299 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.299 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.299 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.300 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.300 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "self_heal": { 2021-03-10T13:39:08.300 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "self_heal", 2021-03-10T13:39:08.300 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.300 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.301 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.301 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:39:08.301 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.301 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.302 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.302 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "preemptively heal cluster around devices that may fail", 2021-03-10T13:39:08.302 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.302 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.302 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.303 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.303 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2021-03-10T13:39:08.303 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2021-03-10T13:39:08.303 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:39:08.303 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.304 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.304 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2021-03-10T13:39:08.304 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.304 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.304 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.305 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to wake up and check device health", 2021-03-10T13:39:08.305 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.305 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.305 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.305 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.306 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_threshold": { 2021-03-10T13:39:08.306 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_threshold", 2021-03-10T13:39:08.306 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:39:08.306 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.306 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.307 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "7257600", 2021-03-10T13:39:08.307 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.307 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.307 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.307 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise health warning if OSD may fail before this long", 2021-03-10T13:39:08.308 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.308 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.308 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.308 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:08.308 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:08.309 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.309 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:39:08.309 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "diskprediction_local", 2021-03-10T13:39:08.309 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:39:08.309 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:39:08.310 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:39:08.310 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:39:08.310 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:39:08.310 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.310 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.311 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.311 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:08.311 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.311 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.311 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:08.312 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:08.312 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:08.312 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:08.312 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:08.312 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:08.312 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:08.313 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:08.313 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.313 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.313 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.313 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.314 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.314 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:39:08.314 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:39:08.314 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.314 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.315 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.315 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:08.315 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.315 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.315 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.316 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.316 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.316 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.316 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.316 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.317 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:39:08.317 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:39:08.317 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.317 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.317 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.318 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:39:08.318 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.318 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.318 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:08.318 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:08.319 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:08.319 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:08.319 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:08.319 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:08.319 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:08.320 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:08.320 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.320 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.320 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.320 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.321 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.321 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:39:08.321 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:39:08.321 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.321 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.322 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.322 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:08.322 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.322 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.322 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.323 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.323 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.323 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.323 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.323 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.324 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "predict_interval": { 2021-03-10T13:39:08.324 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "predict_interval", 2021-03-10T13:39:08.324 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.324 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.324 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.325 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "86400", 2021-03-10T13:39:08.325 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.325 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.325 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.325 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.326 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.326 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.326 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.326 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.326 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "predictor_model": { 2021-03-10T13:39:08.327 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "predictor_model", 2021-03-10T13:39:08.327 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.327 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.327 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.328 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "prophetstor", 2021-03-10T13:39:08.328 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.328 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.328 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.329 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.329 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.329 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.329 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.330 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.330 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2021-03-10T13:39:08.330 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2021-03-10T13:39:08.330 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.330 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.331 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.331 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2021-03-10T13:39:08.331 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.331 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.331 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.332 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.332 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.332 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.332 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.332 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:08.333 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:08.333 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.333 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:39:08.333 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "influx", 2021-03-10T13:39:08.333 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": false, 2021-03-10T13:39:08.334 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "influxdb python module not found", 2021-03-10T13:39:08.334 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:39:08.334 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "batch_size": { 2021-03-10T13:39:08.334 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "batch_size", 2021-03-10T13:39:08.335 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.335 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.335 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.335 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5000", 2021-03-10T13:39:08.335 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.336 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.336 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.336 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.336 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.336 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.337 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.337 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.337 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "database": { 2021-03-10T13:39:08.337 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "database", 2021-03-10T13:39:08.337 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.338 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.338 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.338 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "ceph", 2021-03-10T13:39:08.338 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.339 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.339 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.339 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.339 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.339 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.340 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.340 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.340 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "hostname": { 2021-03-10T13:39:08.340 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "hostname", 2021-03-10T13:39:08.340 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.341 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.341 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.341 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T13:39:08.341 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.341 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.342 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.342 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.342 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.342 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.343 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.343 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.343 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2021-03-10T13:39:08.343 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2021-03-10T13:39:08.343 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.344 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.344 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.344 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "30", 2021-03-10T13:39:08.344 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.344 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.345 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.345 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.345 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.345 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.345 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.346 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.346 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:39:08.346 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:39:08.346 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.347 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.347 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.347 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:08.347 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.347 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.348 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:08.348 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:08.348 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:08.348 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:08.348 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:08.349 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:08.349 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:08.349 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:08.349 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.349 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.349 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.350 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.350 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.350 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:39:08.350 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:39:08.350 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.351 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.351 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.351 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:08.351 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.351 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.352 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.352 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.352 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.352 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.352 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.353 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.353 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:39:08.353 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:39:08.353 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.354 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.354 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.354 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:39:08.354 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.354 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.355 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:08.355 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:08.355 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:08.355 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:08.355 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:08.356 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:08.356 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:08.356 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:08.356 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.356 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.357 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.357 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.357 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.357 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:39:08.357 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:39:08.358 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.358 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.358 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.358 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:08.358 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.359 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.359 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.359 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.359 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.360 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.360 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.360 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.360 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "password": { 2021-03-10T13:39:08.360 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "password", 2021-03-10T13:39:08.361 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.361 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.361 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.361 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T13:39:08.361 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.361 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.362 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.362 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.362 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.362 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.362 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.363 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.363 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "port": { 2021-03-10T13:39:08.363 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "port", 2021-03-10T13:39:08.363 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.363 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.364 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.364 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8086", 2021-03-10T13:39:08.364 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.364 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.364 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.365 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.365 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.365 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.365 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.365 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.366 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssl": { 2021-03-10T13:39:08.366 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssl", 2021-03-10T13:39:08.366 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.366 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.366 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.367 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "false", 2021-03-10T13:39:08.367 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.367 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.367 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.367 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.368 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.368 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.368 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.368 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.369 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "threads": { 2021-03-10T13:39:08.369 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "threads", 2021-03-10T13:39:08.369 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.369 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.369 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.369 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2021-03-10T13:39:08.370 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.370 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.370 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.370 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.371 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.371 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.371 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.371 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.371 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "username": { 2021-03-10T13:39:08.372 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "username", 2021-03-10T13:39:08.372 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.372 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.372 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.372 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T13:39:08.373 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.373 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.373 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.373 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.373 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.374 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.374 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.374 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.374 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "verify_ssl": { 2021-03-10T13:39:08.374 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "verify_ssl", 2021-03-10T13:39:08.375 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.375 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.375 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.375 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "true", 2021-03-10T13:39:08.375 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.376 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.376 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.376 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.376 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.377 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.377 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.377 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:08.377 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:08.377 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.378 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:39:08.378 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "insights", 2021-03-10T13:39:08.378 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:39:08.378 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:39:08.378 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:39:08.379 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:39:08.379 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:39:08.379 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.379 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.379 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.380 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:08.380 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.380 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.380 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:08.380 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:08.381 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:08.381 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:08.381 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:08.381 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:08.381 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:08.382 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:08.382 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.382 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.382 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.383 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.383 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.383 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:39:08.383 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:39:08.383 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.384 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.384 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.384 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:08.384 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.384 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.385 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.385 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.385 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.385 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.385 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.386 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.386 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:39:08.386 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:39:08.386 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.387 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.387 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.387 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:39:08.387 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.387 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.388 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:08.388 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:08.388 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:08.388 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:08.388 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:08.389 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:08.389 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:08.389 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:08.389 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.389 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.390 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.390 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.390 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.390 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:39:08.390 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:39:08.391 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.391 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.391 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.391 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:08.391 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.392 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.392 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.392 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.392 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.392 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.393 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.393 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:08.393 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:08.393 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.393 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:39:08.394 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "iostat", 2021-03-10T13:39:08.394 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:39:08.394 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:39:08.394 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:39:08.394 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:39:08.395 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:39:08.395 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.395 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.395 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.395 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:08.396 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.396 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.396 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:08.396 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:08.396 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:08.397 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:08.397 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:08.397 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:08.397 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:08.397 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:08.398 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.398 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.398 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.398 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.398 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.399 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:39:08.399 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:39:08.399 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.399 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.400 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.400 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:08.400 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.400 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.400 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.401 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.401 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.401 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.401 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.401 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.402 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:39:08.402 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:39:08.402 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.402 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.403 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.403 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:39:08.403 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.403 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.403 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:08.404 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:08.404 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:08.404 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:08.404 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:08.404 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:08.405 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:08.405 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:08.405 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.405 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.405 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.406 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.406 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.406 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:39:08.406 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:39:08.406 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.407 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.407 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.407 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:08.407 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.407 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.408 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.408 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.408 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.408 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.408 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.409 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:08.409 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:08.409 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.409 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:39:08.409 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "k8sevents", 2021-03-10T13:39:08.409 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:39:08.410 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:39:08.410 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:39:08.410 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ceph_event_retention_days": { 2021-03-10T13:39:08.410 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ceph_event_retention_days", 2021-03-10T13:39:08.411 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:39:08.411 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.411 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.411 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "7", 2021-03-10T13:39:08.411 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.412 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.412 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.412 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Days to hold ceph event information within local cache", 2021-03-10T13:39:08.412 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.412 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.413 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.413 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.413 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "config_check_secs": { 2021-03-10T13:39:08.413 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "config_check_secs", 2021-03-10T13:39:08.413 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:39:08.414 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.414 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.414 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2021-03-10T13:39:08.414 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "10", 2021-03-10T13:39:08.414 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.415 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.415 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "interval (secs) to check for cluster configuration changes", 2021-03-10T13:39:08.415 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.415 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.415 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.416 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.416 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:39:08.416 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:39:08.416 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.416 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.417 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.417 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:08.417 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.417 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.417 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:08.418 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:08.418 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:08.418 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:08.418 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:08.419 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:08.419 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:08.419 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:08.419 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.419 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.420 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.420 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.420 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.420 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:39:08.420 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:39:08.420 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.421 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.421 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.421 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:08.421 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.422 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.422 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.422 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.422 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.422 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.423 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.423 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.423 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:39:08.423 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:39:08.423 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.424 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.424 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.424 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:39:08.424 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.424 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.425 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:08.425 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:08.425 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:08.425 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:08.425 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:08.425 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:08.426 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:08.426 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:08.426 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.426 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.427 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.427 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.427 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.427 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:39:08.427 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:39:08.428 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.428 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.428 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.428 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:08.428 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.429 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.429 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.429 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.429 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.429 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.430 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.430 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:08.430 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:08.430 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.431 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:39:08.431 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "localpool", 2021-03-10T13:39:08.431 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:39:08.431 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:39:08.431 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:39:08.432 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "failure_domain": { 2021-03-10T13:39:08.432 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "failure_domain", 2021-03-10T13:39:08.432 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.432 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.432 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.433 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "host", 2021-03-10T13:39:08.433 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.433 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.433 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.433 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "failure domain for any created local pool", 2021-03-10T13:39:08.434 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.434 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.434 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.434 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.434 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:39:08.435 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:39:08.435 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.435 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.435 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.435 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:08.436 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.436 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.436 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:08.436 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:08.436 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:08.437 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:08.437 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:08.437 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:08.437 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:08.437 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:08.438 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.438 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.438 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.438 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.438 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.439 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:39:08.439 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:39:08.439 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.439 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.439 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.440 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:08.440 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.440 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.440 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.440 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.441 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.441 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.441 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.441 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.441 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:39:08.442 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:39:08.442 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.442 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.442 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.443 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:39:08.443 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.443 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.443 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:08.443 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:08.443 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:08.444 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:08.444 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:08.444 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:08.444 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:08.444 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:08.445 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.445 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.445 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.445 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.445 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.446 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:39:08.446 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:39:08.446 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.446 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.447 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.447 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:08.447 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.447 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.447 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.448 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.448 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.448 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.448 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.448 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.449 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_size": { 2021-03-10T13:39:08.449 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "min_size", 2021-03-10T13:39:08.449 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:39:08.449 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.449 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.449 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:08.450 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.450 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.450 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.450 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "default min_size for any created local pool", 2021-03-10T13:39:08.451 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.451 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.451 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.451 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.451 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_rep": { 2021-03-10T13:39:08.452 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "num_rep", 2021-03-10T13:39:08.452 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:39:08.452 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.452 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.452 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "3", 2021-03-10T13:39:08.453 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.453 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.453 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.453 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "default replica count for any created local pool", 2021-03-10T13:39:08.453 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.454 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.454 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.454 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.454 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pg_num": { 2021-03-10T13:39:08.454 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pg_num", 2021-03-10T13:39:08.455 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:39:08.455 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.455 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.455 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "128", 2021-03-10T13:39:08.455 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.456 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.456 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.456 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "default pg_num for any created local pool", 2021-03-10T13:39:08.456 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.456 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.457 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.457 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.457 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "prefix": { 2021-03-10T13:39:08.457 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "prefix", 2021-03-10T13:39:08.457 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.458 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.458 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.458 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:08.458 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.458 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.459 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.459 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "name prefix for any created local pool", 2021-03-10T13:39:08.459 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.459 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.459 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.460 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.460 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "subtree": { 2021-03-10T13:39:08.460 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "subtree", 2021-03-10T13:39:08.460 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.460 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.461 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.461 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "rack", 2021-03-10T13:39:08.461 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.461 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.461 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.462 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "CRUSH level for which to create a local pool", 2021-03-10T13:39:08.462 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.462 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.462 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.463 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:08.463 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:08.463 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.463 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:39:08.463 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "orchestrator", 2021-03-10T13:39:08.464 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:39:08.464 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:39:08.464 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:39:08.464 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:39:08.464 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:39:08.465 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.465 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.465 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.465 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:08.465 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.466 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.466 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:08.466 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:08.466 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:08.466 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:08.467 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:08.467 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:08.467 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:08.467 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:08.467 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.467 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.468 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.468 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.468 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.468 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:39:08.468 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:39:08.469 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.469 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.469 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.469 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:08.469 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.470 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.470 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.470 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.470 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.470 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.471 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.471 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.471 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:39:08.471 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:39:08.471 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.472 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.472 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.472 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:39:08.472 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.472 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.473 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:08.473 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:08.473 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:08.473 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:08.473 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:08.474 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:08.474 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:08.474 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:08.474 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.474 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.475 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.475 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.475 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.475 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:39:08.475 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:39:08.476 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.476 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.476 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.476 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:08.476 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.477 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.477 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.477 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.477 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.477 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.478 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.478 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.478 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "orchestrator": { 2021-03-10T13:39:08.478 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "orchestrator", 2021-03-10T13:39:08.478 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.479 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.479 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.479 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T13:39:08.479 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.479 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.480 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:08.480 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "cephadm", 2021-03-10T13:39:08.480 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rook", 2021-03-10T13:39:08.480 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "test_orchestrator" 2021-03-10T13:39:08.480 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:08.481 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Orchestrator backend", 2021-03-10T13:39:08.481 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.481 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.481 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.481 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:08.482 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:08.482 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.482 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:39:08.482 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "osd_support", 2021-03-10T13:39:08.482 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:39:08.483 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:39:08.483 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:39:08.483 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:39:08.483 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:39:08.483 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.484 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.484 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.484 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:08.484 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.484 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.485 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:08.485 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:08.485 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:08.485 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:08.485 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:08.486 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:08.486 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:08.486 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:08.486 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.486 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.487 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.487 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.487 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.487 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:39:08.487 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:39:08.488 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.488 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.488 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.490 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:08.490 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.490 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.491 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.491 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.491 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.491 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.491 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.492 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.492 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:39:08.492 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:39:08.492 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.492 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.493 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.493 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:39:08.493 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.493 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.493 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:08.494 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:08.494 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:08.494 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:08.494 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:08.495 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:08.495 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:08.495 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:08.495 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.495 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.496 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.496 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.496 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.496 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:39:08.496 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:39:08.497 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.497 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.497 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.497 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:08.497 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.498 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.498 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.498 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.498 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.498 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.499 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.499 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:08.499 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:08.499 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.499 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:39:08.500 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pg_autoscaler", 2021-03-10T13:39:08.500 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:39:08.500 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:39:08.500 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:39:08.500 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:39:08.501 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:39:08.501 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.501 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.501 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.502 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:08.502 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.502 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.502 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:08.502 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:08.503 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:08.503 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:08.503 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:08.503 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:08.503 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:08.504 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:08.504 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.504 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.504 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.504 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.505 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.505 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:39:08.505 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:39:08.505 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.505 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.506 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.506 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:08.506 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.506 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.506 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.507 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.507 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.507 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.507 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.507 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.508 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:39:08.508 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:39:08.508 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.508 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.508 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.509 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:39:08.509 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.509 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.509 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:08.509 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:08.510 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:08.510 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:08.510 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:08.510 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:08.510 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:08.511 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:08.511 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.511 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.511 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.511 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.512 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.512 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:39:08.512 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:39:08.512 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.512 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.513 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.513 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:08.513 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.513 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.513 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.514 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.514 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.514 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.514 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.515 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.515 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2021-03-10T13:39:08.515 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2021-03-10T13:39:08.515 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.515 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.516 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.516 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2021-03-10T13:39:08.516 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.516 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.517 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.517 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.517 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.517 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.517 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.518 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:08.518 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:08.518 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.518 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:39:08.519 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "progress", 2021-03-10T13:39:08.519 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:39:08.519 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:39:08.519 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:39:08.519 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:39:08.520 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:39:08.520 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.520 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.520 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.520 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:08.521 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.521 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.521 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:08.521 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:08.521 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:08.522 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:08.522 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:08.522 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:08.522 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:08.523 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:08.523 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.523 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.523 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.523 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.524 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.524 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:39:08.524 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:39:08.524 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.524 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.525 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.525 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:08.525 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.525 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.525 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.526 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.526 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.526 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.526 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.526 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.527 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:39:08.527 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:39:08.527 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.527 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.527 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.528 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:39:08.528 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.528 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.528 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:08.528 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:08.529 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:08.529 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:08.529 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:08.529 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:08.529 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:08.530 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:08.530 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.530 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.530 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.530 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.531 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.531 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:39:08.531 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:39:08.531 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.531 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.531 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.532 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:08.532 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.532 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.532 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.532 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.533 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.533 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.533 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.533 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.533 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max_completed_events": { 2021-03-10T13:39:08.534 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "max_completed_events", 2021-03-10T13:39:08.534 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:39:08.534 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.534 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.534 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "50", 2021-03-10T13:39:08.535 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.535 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.535 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.535 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "number of past completed events to remember", 2021-03-10T13:39:08.536 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.536 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.536 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.536 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.536 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "persist_interval": { 2021-03-10T13:39:08.536 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "persist_interval", 2021-03-10T13:39:08.537 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:39:08.537 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.537 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.537 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2021-03-10T13:39:08.537 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.538 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.538 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.538 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to persist completed events", 2021-03-10T13:39:08.538 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.538 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.539 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.539 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:08.539 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:08.539 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.539 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:39:08.540 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "prometheus", 2021-03-10T13:39:08.540 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:39:08.540 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:39:08.540 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:39:08.540 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:39:08.541 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:39:08.541 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.541 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.541 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.541 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:08.542 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.542 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.542 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:08.542 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:08.542 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:08.543 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:08.543 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:08.543 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:08.543 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:08.543 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:08.544 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.544 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.544 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.544 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.544 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.545 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:39:08.545 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:39:08.545 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.545 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.545 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.546 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:08.546 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.546 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.546 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.546 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.547 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.547 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.547 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.547 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.547 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:39:08.548 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:39:08.548 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.548 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.548 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.549 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:39:08.549 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.549 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.549 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:08.549 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:08.550 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:08.550 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:08.550 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:08.550 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:08.550 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:08.551 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:08.551 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.551 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.551 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.551 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.552 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.552 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:39:08.552 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:39:08.552 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.552 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.553 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.553 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:08.553 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.553 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.553 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.553 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.554 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.554 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.554 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.554 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.554 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_stats_pools": { 2021-03-10T13:39:08.555 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rbd_stats_pools", 2021-03-10T13:39:08.555 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.555 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.555 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.555 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:08.556 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.556 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.556 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.556 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.556 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.557 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.557 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.557 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.557 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_stats_pools_refresh_interval": { 2021-03-10T13:39:08.557 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rbd_stats_pools_refresh_interval", 2021-03-10T13:39:08.558 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.558 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.558 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.558 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:08.558 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.559 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.559 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.559 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.559 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.559 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.560 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.560 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.560 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "scrape_interval": { 2021-03-10T13:39:08.560 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "scrape_interval", 2021-03-10T13:39:08.560 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.561 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.561 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.561 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:08.561 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.561 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.562 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.562 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.562 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.562 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.562 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.563 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.563 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_addr": { 2021-03-10T13:39:08.563 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_addr", 2021-03-10T13:39:08.563 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.563 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.564 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.564 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:08.564 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.564 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.564 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.565 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.565 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.565 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.565 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.565 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.565 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_port": { 2021-03-10T13:39:08.566 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_port", 2021-03-10T13:39:08.566 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.566 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.566 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.566 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:08.567 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.567 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.567 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.567 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.567 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.568 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.568 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.568 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:08.568 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:08.568 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.569 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:39:08.569 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rbd_support", 2021-03-10T13:39:08.569 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:39:08.569 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:39:08.569 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:39:08.570 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:39:08.570 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:39:08.570 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.570 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.571 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.571 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:08.571 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.571 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.571 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:08.572 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:08.572 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:08.572 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:08.572 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:08.572 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:08.573 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:08.573 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:08.573 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.573 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.573 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.574 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.574 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.574 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:39:08.574 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:39:08.574 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.575 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.575 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.575 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:08.575 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.575 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.575 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.576 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.576 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.576 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.576 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.576 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.577 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:39:08.577 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:39:08.577 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.577 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.577 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.578 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:39:08.578 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.578 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.578 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:08.578 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:08.579 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:08.579 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:08.579 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:08.579 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:08.579 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:08.580 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:08.580 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.580 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.580 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.580 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.581 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.581 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:39:08.581 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:39:08.581 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.581 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.582 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.582 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:08.582 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.582 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.582 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.583 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.583 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.583 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.583 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.583 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.584 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mirror_snapshot_schedule": { 2021-03-10T13:39:08.584 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mirror_snapshot_schedule", 2021-03-10T13:39:08.584 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.584 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.584 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.584 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:08.585 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.585 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.585 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.585 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.585 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.586 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.586 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.586 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.586 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "trash_purge_schedule": { 2021-03-10T13:39:08.586 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "trash_purge_schedule", 2021-03-10T13:39:08.587 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.587 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.587 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.587 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:08.587 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.588 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.588 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.588 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.588 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.588 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.589 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.589 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:08.589 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:08.589 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.589 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:39:08.590 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "restful", 2021-03-10T13:39:08.590 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:39:08.590 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:39:08.590 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:39:08.590 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "key_file": { 2021-03-10T13:39:08.591 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "key_file", 2021-03-10T13:39:08.591 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.591 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.591 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.591 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:08.592 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.592 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.592 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.592 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.592 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.593 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.593 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.593 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.593 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:39:08.593 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:39:08.594 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.594 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.594 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.594 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:08.595 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.595 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.595 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:08.595 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:08.595 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:08.596 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:08.596 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:08.596 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:08.596 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:08.596 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:08.597 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.597 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.597 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.597 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.597 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.597 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:39:08.598 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:39:08.598 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.598 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.598 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.599 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:08.599 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.599 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.599 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.599 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.600 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.600 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.600 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.600 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.600 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:39:08.601 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:39:08.601 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.601 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.601 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.601 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:39:08.602 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.602 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.602 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:08.602 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:08.602 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:08.603 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:08.603 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:08.603 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:08.603 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:08.603 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:08.604 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.604 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.604 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.604 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.604 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.605 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:39:08.605 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:39:08.605 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.605 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.605 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.606 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:08.606 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.606 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.606 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.606 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.607 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.607 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.607 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.607 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.607 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_addr": { 2021-03-10T13:39:08.608 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_addr", 2021-03-10T13:39:08.608 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.608 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.608 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.608 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:08.609 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.609 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.609 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.609 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.609 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.610 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.610 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.610 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.610 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_port": { 2021-03-10T13:39:08.611 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_port", 2021-03-10T13:39:08.611 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.611 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.611 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.611 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:08.612 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.612 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.612 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.612 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.612 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.613 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.613 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.613 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:08.613 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:08.613 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.614 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:39:08.614 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rook", 2021-03-10T13:39:08.614 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:39:08.614 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:39:08.614 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:39:08.615 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:39:08.615 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:39:08.615 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.615 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.615 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.616 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:08.616 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.616 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.616 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:08.616 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:08.617 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:08.617 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:08.617 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:08.617 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:08.617 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:08.618 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:08.618 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.618 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.618 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.619 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.619 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.619 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:39:08.619 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:39:08.619 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.620 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.620 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.620 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:08.620 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.620 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.620 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.621 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.621 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.621 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.621 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.622 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.622 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:39:08.622 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:39:08.622 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.622 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.623 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.623 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:39:08.623 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.623 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.623 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:08.624 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:08.624 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:08.624 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:08.624 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:08.624 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:08.625 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:08.625 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:08.625 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.625 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.625 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.625 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.626 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.626 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:39:08.626 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:39:08.626 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.627 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.627 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.627 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:08.627 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.627 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.628 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.628 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.628 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.628 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.628 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.629 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:08.629 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:08.629 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.629 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:39:08.629 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "selftest", 2021-03-10T13:39:08.630 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:39:08.630 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:39:08.630 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:39:08.630 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:39:08.631 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:39:08.631 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.631 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.631 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.631 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:08.632 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.632 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.632 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:08.632 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:08.632 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:08.633 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:08.633 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:08.633 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:08.633 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:08.633 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:08.634 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.634 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.634 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.634 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.634 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.635 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:39:08.635 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:39:08.635 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.635 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.635 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.636 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:08.636 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.636 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.636 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.637 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.637 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.637 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.637 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.637 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.638 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:39:08.638 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:39:08.638 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.638 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.638 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.639 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:39:08.639 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.639 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.639 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:08.640 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:08.640 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:08.640 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:08.640 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:08.640 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:08.641 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:08.641 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:08.641 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.641 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.641 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.642 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.642 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.642 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:39:08.642 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:39:08.642 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.643 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.643 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.643 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:08.643 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.643 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.644 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.644 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.644 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.644 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.644 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.645 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.645 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "roption1": { 2021-03-10T13:39:08.645 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "roption1", 2021-03-10T13:39:08.645 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.645 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.646 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.646 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:08.646 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.646 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.646 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.647 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.647 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.647 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.647 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.647 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.648 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "roption2": { 2021-03-10T13:39:08.648 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "roption2", 2021-03-10T13:39:08.648 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.648 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.648 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.649 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "xyz", 2021-03-10T13:39:08.649 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.649 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.649 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.649 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.650 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.650 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.650 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.650 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.651 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption1": { 2021-03-10T13:39:08.651 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption1", 2021-03-10T13:39:08.651 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.651 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.651 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.652 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:08.652 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.652 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.652 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.652 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.653 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.653 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.653 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.653 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.653 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption2": { 2021-03-10T13:39:08.654 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption2", 2021-03-10T13:39:08.654 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:39:08.654 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.654 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.654 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:08.655 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.655 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.655 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.655 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.655 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.656 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.656 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.656 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.656 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption3": { 2021-03-10T13:39:08.656 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption3", 2021-03-10T13:39:08.657 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "float", 2021-03-10T13:39:08.657 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.657 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.657 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:08.658 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.658 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.658 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.658 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.658 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.659 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.659 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.659 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.659 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption4": { 2021-03-10T13:39:08.660 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption4", 2021-03-10T13:39:08.660 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.660 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.660 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.660 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:08.661 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.661 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.661 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.661 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.661 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.662 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.662 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.662 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.662 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption5": { 2021-03-10T13:39:08.662 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption5", 2021-03-10T13:39:08.663 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.663 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.663 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.663 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:08.664 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.664 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.664 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.664 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.664 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.665 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.665 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.665 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.665 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption6": { 2021-03-10T13:39:08.665 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption6", 2021-03-10T13:39:08.666 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.666 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.666 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.666 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:39:08.666 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.667 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.667 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.667 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.667 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.667 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.668 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.668 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.668 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "testkey": { 2021-03-10T13:39:08.668 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "testkey", 2021-03-10T13:39:08.669 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.669 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.669 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.669 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:08.669 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.670 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.670 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.670 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.670 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.670 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.671 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.671 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.671 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "testlkey": { 2021-03-10T13:39:08.671 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "testlkey", 2021-03-10T13:39:08.672 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.672 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.672 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.672 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:08.672 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.673 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.673 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.673 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.673 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.673 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.674 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.674 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.674 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "testnewline": { 2021-03-10T13:39:08.674 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "testnewline", 2021-03-10T13:39:08.674 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.675 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.675 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.675 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:08.675 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.676 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.676 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.676 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.676 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.676 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.677 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.677 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:08.677 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:08.677 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.677 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:39:08.678 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "status", 2021-03-10T13:39:08.678 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:39:08.678 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:39:08.678 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:39:08.679 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:39:08.679 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:39:08.679 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.679 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.679 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.680 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:08.680 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.680 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.680 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:08.680 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:08.681 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:08.681 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:08.681 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:08.681 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:08.681 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:08.681 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:08.682 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.682 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.682 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.682 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.683 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.683 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:39:08.683 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:39:08.683 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.683 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.684 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.684 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:08.684 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.684 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.684 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.685 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.685 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.685 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.685 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.685 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.686 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:39:08.686 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:39:08.686 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.686 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.686 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.687 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:39:08.687 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.687 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.687 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:08.688 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:08.688 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:08.688 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:08.688 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:08.688 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:08.689 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:08.689 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:08.689 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.689 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.689 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.690 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.690 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.690 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:39:08.690 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:39:08.690 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.691 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.691 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.691 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:08.691 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.691 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.692 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.692 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.692 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.692 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.693 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.693 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:08.693 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:08.693 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.693 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:39:08.694 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "telegraf", 2021-03-10T13:39:08.694 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:39:08.694 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:39:08.694 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:39:08.694 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "address": { 2021-03-10T13:39:08.695 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "address", 2021-03-10T13:39:08.695 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.695 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.695 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.696 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "unixgram:///tmp/telegraf.sock", 2021-03-10T13:39:08.696 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.696 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.696 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.696 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.697 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.697 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.697 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.697 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.697 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2021-03-10T13:39:08.698 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2021-03-10T13:39:08.698 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:39:08.698 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.698 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.699 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "15", 2021-03-10T13:39:08.699 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.699 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.699 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.699 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.700 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.700 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.700 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.700 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.700 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:39:08.701 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:39:08.701 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.701 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.701 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.701 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:08.702 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.702 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.702 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:08.702 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:08.703 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:08.703 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:08.703 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:08.703 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:08.703 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:08.704 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:08.704 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.704 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.704 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.704 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.705 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.705 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:39:08.705 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:39:08.705 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.705 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.706 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.706 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:08.706 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.706 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.706 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.707 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.707 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.707 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.707 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.708 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.708 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:39:08.708 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:39:08.708 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.708 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.709 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.709 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:39:08.709 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.709 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.709 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:08.710 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:08.710 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:08.710 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:08.710 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:08.710 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:08.711 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:08.711 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:08.711 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.711 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.712 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.712 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.712 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.712 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:39:08.712 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:39:08.713 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.713 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.713 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.713 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:08.713 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.714 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.714 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.714 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.714 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.715 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.715 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.715 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:08.715 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:08.715 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.716 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:39:08.716 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "telemetry", 2021-03-10T13:39:08.716 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:39:08.716 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:39:08.716 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:39:08.717 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_basic": { 2021-03-10T13:39:08.717 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_basic", 2021-03-10T13:39:08.717 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.717 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.717 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.718 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:39:08.718 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.718 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.718 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.719 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Share basic cluster information (size, version)", 2021-03-10T13:39:08.719 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.719 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.719 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.719 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.720 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_crash": { 2021-03-10T13:39:08.720 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_crash", 2021-03-10T13:39:08.720 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.720 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.720 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.721 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:39:08.721 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.721 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.721 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.721 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.722 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.722 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.722 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.722 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.723 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_device": { 2021-03-10T13:39:08.723 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_device", 2021-03-10T13:39:08.723 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.723 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.723 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.724 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:39:08.724 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.724 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.724 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.724 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.725 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.725 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.725 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.725 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.725 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_ident": { 2021-03-10T13:39:08.726 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_ident", 2021-03-10T13:39:08.726 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.726 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.726 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.726 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:08.727 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.727 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.727 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.727 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.727 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.728 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.728 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.728 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.728 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "contact": { 2021-03-10T13:39:08.729 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "contact", 2021-03-10T13:39:08.729 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.729 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.729 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.729 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T13:39:08.730 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.730 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.730 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.730 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.730 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.731 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.731 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.731 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.731 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "description": { 2021-03-10T13:39:08.732 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "description", 2021-03-10T13:39:08.732 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.732 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.732 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.732 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T13:39:08.733 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.733 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.733 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.733 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.733 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.734 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.734 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.734 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.734 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "device_url": { 2021-03-10T13:39:08.734 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "device_url", 2021-03-10T13:39:08.735 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.735 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.735 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.735 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "https://telemetry.ceph.com/device", 2021-03-10T13:39:08.735 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.736 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.736 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.736 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.736 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.736 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.737 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.737 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.737 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enabled": { 2021-03-10T13:39:08.737 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "enabled", 2021-03-10T13:39:08.737 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.738 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.738 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.738 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:08.738 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.739 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.739 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.739 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.739 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.739 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.740 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.740 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.740 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2021-03-10T13:39:08.740 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2021-03-10T13:39:08.740 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:39:08.741 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.741 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.741 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "24", 2021-03-10T13:39:08.741 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "8", 2021-03-10T13:39:08.741 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.742 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.742 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.742 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.742 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.743 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.743 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.743 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "last_opt_revision": { 2021-03-10T13:39:08.743 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "last_opt_revision", 2021-03-10T13:39:08.743 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:39:08.744 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.744 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.744 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "1", 2021-03-10T13:39:08.744 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.744 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.745 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.745 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.745 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.745 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.746 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.746 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.746 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "leaderboard": { 2021-03-10T13:39:08.746 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "leaderboard", 2021-03-10T13:39:08.746 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.747 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.747 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.747 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:08.747 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.747 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.748 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.748 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.748 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.748 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.748 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.749 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.749 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:39:08.749 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:39:08.749 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.749 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.750 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.750 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:08.750 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.750 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.751 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:08.751 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:08.751 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:08.751 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:08.751 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:08.752 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:08.752 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:08.752 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:08.752 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.752 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.752 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.753 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.753 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.753 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:39:08.753 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:39:08.753 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.754 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.754 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.754 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:08.754 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.755 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.755 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.755 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.755 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.755 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.755 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.756 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.756 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:39:08.756 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:39:08.756 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.756 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.757 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.757 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:39:08.757 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.757 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.757 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:08.758 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:08.758 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:08.758 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:08.758 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:08.759 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:08.759 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:08.759 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:08.759 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.759 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.760 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.760 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.760 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.760 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:39:08.761 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:39:08.761 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.761 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.761 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.761 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:08.762 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.762 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.762 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.762 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.763 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.763 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.763 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.763 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.763 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "organization": { 2021-03-10T13:39:08.764 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "organization", 2021-03-10T13:39:08.764 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.764 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.764 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.765 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T13:39:08.765 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.765 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.765 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.765 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.766 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.766 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.766 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.766 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.767 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "proxy": { 2021-03-10T13:39:08.767 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "proxy", 2021-03-10T13:39:08.767 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.767 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.767 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.768 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T13:39:08.768 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.768 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.768 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.769 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.769 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.769 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.769 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.769 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.770 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "url": { 2021-03-10T13:39:08.770 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "url", 2021-03-10T13:39:08.770 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.770 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.770 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.771 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "https://telemetry.ceph.com/report", 2021-03-10T13:39:08.771 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.771 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.771 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.771 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.772 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.772 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.772 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.772 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:08.772 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:08.773 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.773 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:39:08.773 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "test_orchestrator", 2021-03-10T13:39:08.773 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:39:08.773 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:39:08.774 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:39:08.774 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:39:08.774 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:39:08.774 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.775 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.775 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.775 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:08.775 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.775 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.775 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:08.776 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:08.776 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:08.776 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:08.776 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:08.776 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:08.777 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:08.777 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:08.777 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.777 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.777 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.778 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.778 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.778 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:39:08.778 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:39:08.779 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.779 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.779 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.779 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:08.779 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.780 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.780 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.780 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.780 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.780 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.781 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.781 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.781 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:39:08.781 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:39:08.781 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.782 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.782 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.782 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:39:08.782 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.783 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.783 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:08.783 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:08.783 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:08.783 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:08.784 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:08.784 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:08.784 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:08.784 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:08.784 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.785 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.785 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.785 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.785 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.785 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:39:08.786 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:39:08.786 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.786 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.786 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.787 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:08.787 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.787 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.787 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.787 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.788 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.788 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.788 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.788 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:08.788 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:08.789 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.789 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:39:08.789 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "volumes", 2021-03-10T13:39:08.789 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:39:08.789 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:39:08.790 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:39:08.790 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:39:08.790 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:39:08.790 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.790 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.791 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.791 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:08.791 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.791 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.792 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:08.792 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:08.792 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:08.792 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:08.792 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:08.793 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:08.793 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:08.793 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:08.793 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.793 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.794 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.794 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.794 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.794 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:39:08.794 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:39:08.795 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.795 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.795 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.795 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:08.795 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.796 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.796 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.796 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.796 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.796 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.797 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.797 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.797 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:39:08.797 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:39:08.797 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.798 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.798 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.798 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:39:08.798 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.798 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.799 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:08.799 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:08.799 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:08.799 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:08.799 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:08.800 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:08.800 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:08.800 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:08.800 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.800 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.801 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.801 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.801 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.801 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:39:08.802 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:39:08.802 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.802 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.802 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.802 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:08.803 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.803 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.803 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.803 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.803 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.804 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.804 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.804 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:08.804 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:08.804 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.805 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:39:08.805 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix", 2021-03-10T13:39:08.805 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:39:08.805 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:39:08.805 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:39:08.806 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "discovery_interval": { 2021-03-10T13:39:08.806 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "discovery_interval", 2021-03-10T13:39:08.806 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.806 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.806 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.807 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "100", 2021-03-10T13:39:08.807 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.807 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.807 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.807 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.807 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.808 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.808 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.808 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.808 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "identifier": { 2021-03-10T13:39:08.808 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "identifier", 2021-03-10T13:39:08.809 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.809 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.809 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.809 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:08.809 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.810 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.810 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.810 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.810 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.810 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.811 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.811 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.811 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2021-03-10T13:39:08.811 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2021-03-10T13:39:08.811 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:39:08.812 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.812 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.812 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2021-03-10T13:39:08.812 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.812 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.813 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.813 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.813 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.813 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.813 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.814 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.814 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:39:08.814 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:39:08.814 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.814 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.815 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.815 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:08.815 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.815 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.815 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:08.816 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:08.816 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:08.816 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:08.816 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:08.816 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:08.817 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:08.817 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:08.817 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.817 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.817 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.817 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.818 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.818 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:39:08.818 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:39:08.818 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.819 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.819 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.819 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:08.819 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.819 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.820 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.820 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.820 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.820 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.820 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.821 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.821 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:39:08.821 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:39:08.821 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.821 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.822 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.822 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:39:08.822 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.822 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.822 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:08.823 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:08.823 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:08.823 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:08.823 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:08.823 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:08.824 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:08.824 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:08.824 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.824 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.824 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.825 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.825 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.825 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:39:08.825 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:39:08.825 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:08.826 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.826 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:08.826 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:08.826 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.826 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.827 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.827 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.827 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.827 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.827 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.828 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.828 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "zabbix_host": { 2021-03-10T13:39:08.828 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix_host", 2021-03-10T13:39:08.828 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.828 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.828 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.829 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T13:39:08.829 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.829 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.829 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.829 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.830 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.830 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.830 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.830 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.830 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "zabbix_port": { 2021-03-10T13:39:08.831 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix_port", 2021-03-10T13:39:08.831 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:39:08.831 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.831 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.831 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10051", 2021-03-10T13:39:08.832 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.832 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.832 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.832 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.832 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.833 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.833 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.833 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.833 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "zabbix_sender": { 2021-03-10T13:39:08.833 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix_sender", 2021-03-10T13:39:08.834 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:08.834 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:08.834 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:08.834 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "/usr/bin/zabbix_sender", 2021-03-10T13:39:08.834 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:08.835 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:08.835 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:08.835 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:08.835 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:08.835 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:08.836 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:08.836 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:08.836 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:08.836 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:08.836 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:08.836 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {}, 2021-03-10T13:39:08.837 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "always_on_modules": { 2021-03-10T13:39:08.837 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nautilus": [ 2021-03-10T13:39:08.837 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "balancer", 2021-03-10T13:39:08.837 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crash", 2021-03-10T13:39:08.837 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "devicehealth", 2021-03-10T13:39:08.838 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "orchestrator_cli", 2021-03-10T13:39:08.838 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress", 2021-03-10T13:39:08.838 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_support", 2021-03-10T13:39:08.838 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status", 2021-03-10T13:39:08.838 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "volumes" 2021-03-10T13:39:08.839 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:08.839 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "octopus": [ 2021-03-10T13:39:08.839 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "balancer", 2021-03-10T13:39:08.839 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crash", 2021-03-10T13:39:08.839 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "devicehealth", 2021-03-10T13:39:08.840 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "orchestrator", 2021-03-10T13:39:08.840 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_support", 2021-03-10T13:39:08.840 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pg_autoscaler", 2021-03-10T13:39:08.840 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress", 2021-03-10T13:39:08.840 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_support", 2021-03-10T13:39:08.841 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status", 2021-03-10T13:39:08.841 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "telemetry", 2021-03-10T13:39:08.841 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "volumes" 2021-03-10T13:39:08.841 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:08.841 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "last_failure_osd_epoch": 0, 2021-03-10T13:39:08.842 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_clients": [ 2021-03-10T13:39:08.842 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:39:08.842 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2021-03-10T13:39:08.842 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:39:08.842 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2021-03-10T13:39:08.843 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.2.115:0", 2021-03-10T13:39:08.843 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 4116648559 2021-03-10T13:39:08.843 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:08.843 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2021-03-10T13:39:08.843 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.844 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:39:08.844 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2021-03-10T13:39:08.844 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:39:08.844 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2021-03-10T13:39:08.844 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.2.115:0", 2021-03-10T13:39:08.845 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 683907604 2021-03-10T13:39:08.845 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:08.845 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2021-03-10T13:39:08.845 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:08.845 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:39:08.846 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2021-03-10T13:39:08.846 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:39:08.846 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2021-03-10T13:39:08.846 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.2.115:0", 2021-03-10T13:39:08.846 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 354126993 2021-03-10T13:39:08.847 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:08.847 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2021-03-10T13:39:08.847 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:08.847 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2021-03-10T13:39:08.847 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:08.848 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:08.848 INFO:teuthology.orchestra.run.gibba015.stderr:INFO:cephadm:Waiting for the mgr to restart... 2021-03-10T13:39:08.849 INFO:teuthology.orchestra.run.gibba015.stderr:INFO:cephadm:Waiting for Mgr epoch 5... 2021-03-10T13:39:08.849 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba015', '-v', '/var/log/ceph/e4a642d2-81a5-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmp3221digx:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpygecn9iw:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'tell', 'mgr', 'mgr_status'] 2021-03-10T13:39:08.849 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba015 -v /var/log/ceph/e4a642d2-81a5-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp3221digx:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpygecn9iw:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 tell mgr mgr_status 2021-03-10T13:39:08.849 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:08 gibba015 bash[9806]: audit 2021-03-10T13:39:07.477844+0000 mon.a (mon.0) 36 : audit [DBG] from='client.? 172.21.2.115:0/3900066692' entity='client.admin' cmd=[{"prefix": "mgr dump"}]: dispatch 2021-03-10T13:39:09.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:09 gibba015 bash[9806]: cluster 2021-03-10T13:39:08.741332+0000 mon.a (mon.0) 37 : cluster [INF] Active manager daemon y restarted 2021-03-10T13:39:09.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:09 gibba015 bash[9806]: cluster 2021-03-10T13:39:08.741839+0000 mon.a (mon.0) 38 : cluster [INF] Activating manager daemon y 2021-03-10T13:39:09.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:09 gibba015 bash[9806]: cluster 2021-03-10T13:39:08.743281+0000 mon.a (mon.0) 39 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2021-03-10T13:39:10.065 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:39:10.065 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mgrmap_epoch": 7, 2021-03-10T13:39:10.065 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "initialized": true 2021-03-10T13:39:10.065 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:10.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:10 gibba015 bash[9806]: cluster 2021-03-10T13:39:09.053214+0000 mon.a (mon.0) 40 : cluster [DBG] mgrmap e6: y(active, starting, since 0.311409s) 2021-03-10T13:39:10.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:10 gibba015 bash[9806]: audit 2021-03-10T13:39:09.058032+0000 mon.a (mon.0) 41 : audit [DBG] from='mgr.14117 172.21.2.115:0/3460604445' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-03-10T13:39:10.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:10 gibba015 bash[9806]: audit 2021-03-10T13:39:09.060457+0000 mon.a (mon.0) 42 : audit [DBG] from='mgr.14117 172.21.2.115:0/3460604445' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-03-10T13:39:10.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:10 gibba015 bash[9806]: audit 2021-03-10T13:39:09.060941+0000 mon.a (mon.0) 43 : audit [DBG] from='mgr.14117 172.21.2.115:0/3460604445' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-03-10T13:39:10.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:10 gibba015 bash[9806]: audit 2021-03-10T13:39:09.061443+0000 mon.a (mon.0) 44 : audit [DBG] from='mgr.14117 172.21.2.115:0/3460604445' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-03-10T13:39:10.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:10 gibba015 bash[9806]: audit 2021-03-10T13:39:09.062848+0000 mon.a (mon.0) 45 : audit [DBG] from='mgr.14117 172.21.2.115:0/3460604445' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2021-03-10T13:39:10.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:10 gibba015 bash[9806]: audit 2021-03-10T13:39:09.064980+0000 mon.a (mon.0) 46 : audit [DBG] from='mgr.14117 172.21.2.115:0/3460604445' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2021-03-10T13:39:10.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:10 gibba015 bash[9806]: audit 2021-03-10T13:39:09.066209+0000 mon.a (mon.0) 47 : audit [DBG] from='mgr.14117 172.21.2.115:0/3460604445' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2021-03-10T13:39:10.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:10 gibba015 bash[9806]: cluster 2021-03-10T13:39:09.071712+0000 mon.a (mon.0) 48 : cluster [INF] Manager daemon y is now available 2021-03-10T13:39:10.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:10 gibba015 bash[9806]: audit 2021-03-10T13:39:09.091539+0000 mon.a (mon.0) 49 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2021-03-10T13:39:10.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:10 gibba015 bash[9806]: audit 2021-03-10T13:39:09.250832+0000 mon.a (mon.0) 50 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2021-03-10T13:39:10.672 INFO:teuthology.orchestra.run.gibba015.stderr:INFO:cephadm:Setting orchestrator backend to cephadm... 2021-03-10T13:39:10.673 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba015', '-v', '/var/log/ceph/e4a642d2-81a5-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmp3221digx:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpygecn9iw:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'orch', 'set', 'backend', 'cephadm'] 2021-03-10T13:39:10.673 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba015 -v /var/log/ceph/e4a642d2-81a5-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp3221digx:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpygecn9iw:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 orch set backend cephadm 2021-03-10T13:39:11.320 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:11 gibba015 bash[9806]: cluster 2021-03-10T13:39:10.053023+0000 mon.a (mon.0) 51 : cluster [DBG] mgrmap e7: y(active, since 1.31123s) 2021-03-10T13:39:12.151 INFO:teuthology.orchestra.run.gibba015.stderr:INFO:cephadm:Generating ssh key... 2021-03-10T13:39:12.151 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba015', '-v', '/var/log/ceph/e4a642d2-81a5-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmp3221digx:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpygecn9iw:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'cephadm', 'generate-key'] 2021-03-10T13:39:12.151 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba015 -v /var/log/ceph/e4a642d2-81a5-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp3221digx:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpygecn9iw:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 cephadm generate-key 2021-03-10T13:39:12.172 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:12 gibba015 bash[9806]: cluster 2021-03-10T13:39:11.067615+0000 mon.a (mon.0) 52 : cluster [DBG] mgrmap e8: y(active, since 2s) 2021-03-10T13:39:12.172 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:12 gibba015 bash[9806]: audit 2021-03-10T13:39:11.640719+0000 mgr.y (mgr.14117) 1 : audit [DBG] from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:39:12.173 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:12 gibba015 bash[9806]: audit 2021-03-10T13:39:11.641627+0000 mon.a (mon.0) 53 : audit [INF] from='mgr.14117 172.21.2.115:0/3460604445' entity='mgr.y' cmd=[{"prefix":"config set","value":"cephadm","who":"mgr","name":"mgr/orchestrator/orchestrator"}]: dispatch 2021-03-10T13:39:12.173 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:12 gibba015 bash[9806]: audit 2021-03-10T13:39:11.644076+0000 mon.a (mon.0) 54 : audit [INF] from='mgr.14117 172.21.2.115:0/3460604445' entity='mgr.y' cmd='[{"prefix":"config set","value":"cephadm","who":"mgr","name":"mgr/orchestrator/orchestrator"}]': finished 2021-03-10T13:39:13.724 INFO:journalctl@ceph.mgr.y.gibba015.stdout:Mar 10 13:39:13 gibba015 bash[10036]: Generating public/private rsa key pair. 2021-03-10T13:39:13.724 INFO:journalctl@ceph.mgr.y.gibba015.stdout:Mar 10 13:39:13 gibba015 bash[10036]: Your identification has been saved in /tmp/tmpbxfqyb7g/key. 2021-03-10T13:39:13.725 INFO:journalctl@ceph.mgr.y.gibba015.stdout:Mar 10 13:39:13 gibba015 bash[10036]: Your public key has been saved in /tmp/tmpbxfqyb7g/key.pub. 2021-03-10T13:39:13.725 INFO:journalctl@ceph.mgr.y.gibba015.stdout:Mar 10 13:39:13 gibba015 bash[10036]: The key fingerprint is: 2021-03-10T13:39:13.725 INFO:journalctl@ceph.mgr.y.gibba015.stdout:Mar 10 13:39:13 gibba015 bash[10036]: SHA256:/T2KRyc6XP7vWTVvQN5BIEsaLD5SVbXOxTxmTG2TRGw ceph-e4a642d2-81a5-11eb-9080-001a4aab830c 2021-03-10T13:39:13.726 INFO:journalctl@ceph.mgr.y.gibba015.stdout:Mar 10 13:39:13 gibba015 bash[10036]: The key's randomart image is: 2021-03-10T13:39:13.726 INFO:journalctl@ceph.mgr.y.gibba015.stdout:Mar 10 13:39:13 gibba015 bash[10036]: +---[RSA 3072]----+ 2021-03-10T13:39:13.727 INFO:journalctl@ceph.mgr.y.gibba015.stdout:Mar 10 13:39:13 gibba015 bash[10036]: | oo.+.o==o| 2021-03-10T13:39:13.727 INFO:journalctl@ceph.mgr.y.gibba015.stdout:Mar 10 13:39:13 gibba015 bash[10036]: | o .+ o BEo| 2021-03-10T13:39:13.727 INFO:journalctl@ceph.mgr.y.gibba015.stdout:Mar 10 13:39:13 gibba015 bash[10036]: | o .. . .o@.| 2021-03-10T13:39:13.728 INFO:journalctl@ceph.mgr.y.gibba015.stdout:Mar 10 13:39:13 gibba015 bash[10036]: | . o . oo+.o| 2021-03-10T13:39:13.728 INFO:journalctl@ceph.mgr.y.gibba015.stdout:Mar 10 13:39:13 gibba015 bash[10036]: | . S . oo.o| 2021-03-10T13:39:13.729 INFO:journalctl@ceph.mgr.y.gibba015.stdout:Mar 10 13:39:13 gibba015 bash[10036]: | .+...+| 2021-03-10T13:39:13.729 INFO:journalctl@ceph.mgr.y.gibba015.stdout:Mar 10 13:39:13 gibba015 bash[10036]: | . =.oo +| 2021-03-10T13:39:13.729 INFO:journalctl@ceph.mgr.y.gibba015.stdout:Mar 10 13:39:13 gibba015 bash[10036]: | +.o. oo| 2021-03-10T13:39:13.730 INFO:journalctl@ceph.mgr.y.gibba015.stdout:Mar 10 13:39:13 gibba015 bash[10036]: | .o...+o| 2021-03-10T13:39:13.730 INFO:journalctl@ceph.mgr.y.gibba015.stdout:Mar 10 13:39:13 gibba015 bash[10036]: +----[SHA256]-----+ 2021-03-10T13:39:13.731 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:13 gibba015 bash[9806]: audit 2021-03-10T13:39:13.280799+0000 mon.a (mon.0) 55 : audit [INF] from='mgr.14117 172.21.2.115:0/3460604445' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/ssh_identity_key","val":"-----BEGIN OPENSSH PRIVATE KEY-----\nb3BlbnNzaC1rZXktdjEAAAAABG5vbmUAAAAEbm9uZQAAAAAAAAABAAABlwAAAAdzc2gtcn\nNhAAAAAwEAAQAAAYEA18oZs2zLSRl3GKxMB9ojD2adUSa8/NgjVHiZ1VOrpvsNMRm8nmoa\nP6ojWerPTljTnBcfob603Y3Vue7lzJJaaPZcsk9p+oc5m3WrtI7GsI2SlN1sTP5Q9aiMKM\n2BNQLAwAQXxYMdcHq33YvEQ9uuZsYcLI7e/ByjNiZSvc1B/VKiH2l+K0DnyrkxApGkLiDa\nNwIuVIJjxihqSu24d/tj4XY8+IAXmkZNoI8KfL4IWXT/jVTwOwiGzjk1XNhlHd8oNUhtft\nc0xNn5y1ku4q84rz9y1F4FOkMmFJPnEMtrnlCNtIm6vn0kuKMIPE/tDbDHcXsHqKVCKEDB\neTJoSU9UgLFJIuk5ndXPBkaNoZPyMCs3b0EyLDAOvEG54VYS3kqaXPVix7VLfxFSsQAn4j\nGZP1axwqS7T0rh+PfYePPn3xrsw4Repl/jFbCoQ35G+H6MKOGCDSxxuuu+WKmoZ2qpYVLN\nHWPp7vzHqUSV0OtdmPf23wts8DrbMINACr/b3NK/AAAFoKTPnUakz51GAAAAB3NzaC1yc2\nEAAAGBANfKGbNsy0kZdxisTAfaIw9mnVEmvPzYI1R4mdVTq6b7DTEZvJ5qGj+qI1nqz05Y\n05wXH6G+tN2N1bnu5cySWmj2XLJPafqHOZt1q7SOxrCNkpTdbEz+UPWojCjNgTUCwMAEF8\nWDHXB6t92LxEPbrmbGHCyO3vwcozYmUr3NQf1Soh9pfitA58q5MQKRpC4g2jcCLlSCY8Yo\nakrtuHf7Y+F2PPiAF5pGTaCPCny+CFl0/41U8DsIhs45NVzYZR3fKDVIbX7XNMTZ+ctZLu\nKvOK8/ctReBTpDJhST5xDLa55QjbSJur59JLijCDxP7Q2wx3F7B6ilQihAwXkyaElPVICx\nSSLpOZ3VzwZGjaGT8jArN29BMiwwDrxBueFWEt5Kmlz1Yse1S38RUrEAJ+IxmT9WscKku0\n9K4fj32Hjz598a7MOEXqZf4xWwqEN+Rvh+jCjhgg0scbrrvlipqGdqqWFSzR1j6e78x6lE\nldDrXZj39t8LbPA62zCDQAq/29zSvwAAAAMBAAEAAAGBAIiLrCOrTh9da81DCYFWeST/q8\nB0INZl9kU3YzBoF5A8ACb3wDEFtsJeaKw3NyK+dnio8S0qPcyMOZfEIcmHOop8ij+SnN8Y\nvk0u8o34YqXJj91/F07JBnXMR5RyJbZjnZBjhp9GzlQkc0BPdsvxsLP73Ewdw+AIRwa2zV\nipD3660TfLSzkXgxT2hpq3igpeY3a3fJWhRH1ZiZkMP9Q8UQGUDhS5CTZoEirtGJfCsAnb\nTPIjszfHt3W7IZc0nxd94ws8X3nH440TCYvV6un96SlZ00PrXCxargx8Bz0ARluhfyCYF+\nRKvuKHsF3r6vx7JpGVj41+HqA6iPf+1MI/b65b2D02WT3pXGdAsmqG3llJV1PJmYwXEQws\naWxV1BJCXcyBzG+wV/xOr4ZRwa1vTBrDjK2zcD9rwNYlVlC1b59j1i3H2me6lkKPzVVTv4\nD0wCZIo1zfqKxBXbVIxxm9XHIPLPLkGePz35WhTQ0qKV+75tPba055LNK8DiVYMX3nAQAA\nAMEA5rW9eK6/Jsx63+fKPnwt3lMgMsb5lwpxRyun9pOk4Ypyw+xo1T11y4avT/RnAdfifl\ngxPugMsYCWwpIDUiCQvHTjQDFB8oh8mipO92uGYDWQPn7B+T8Yi0r2nKCF94KpMlxpCwXC\nnCGQpSpNhUSywPsfjp2AE5bt8IKYazwj7EaYFqp520zLx3p4EODHIuHYYX7JHRtzfA/76P\nAQ96A+gDaVo2u+W6zrxbj8MxtrDYwdRiLWyNjqTVBPYkXtAag2AAAAwQD9PHSaIRObv278\nKrdwzGK8bXET3K2WXOCxWjghmlL3YaQbAox3iOxd4Gmv7Nl5cQUhbkGvjL8QsfyhYFoCax\nhyufy5Lt9crOGyMVGMy6K7gSkhkOk/+5tC5HmRtSquTKg4no1IXffB/IMZh6/kwvLAO2dQ\nWDTYl9WzFhWtnLoxRbEC1L2G2VjduTSPJ8lamWgacLO2hvJ4wqq4fbJez5iNfKeYNYNAHZ\nPbv96PxmqSzKlKhkRPTkMgqbzTswhHXH8AAADBANolBLheF6XiQ5pa6JYw/i1fZH/B7NWZ\nr0MWZj7XMdbM98j3nYPEjmZy2DIPVqQ/vX48i+CXJac8iQv48R7ml9mx3yd/t6C3YF4D0O\n7Cpn75r4B2jsrKxbR4HoPCVpMxC/cH5f7GSPshKIDbTPfbqJH/oFHHMrnWpAJiO8Aei0Vj\nBUuuImQnASfROoJwnDsvX0ZtF4rjvMr0+cGXEAgb6Qn9Vvqf+DulQ58XSV6oIzMtANylQ6\nFta1tK1WVCluBpwQAAACljZXBoLWU0YTY0MmQyLTgxYTUtMTFlYi05MDgwLTAwMWE0YWFi\nODMwYw==\n-----END OPENSSH PRIVATE KEY-----\n"}]: dispatch 2021-03-10T13:39:13.732 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:13 gibba015 bash[9806]: audit 2021-03-10T13:39:13.282517+0000 mon.a (mon.0) 56 : audit [INF] from='mgr.14117 172.21.2.115:0/3460604445' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/ssh_identity_key","val":"-----BEGIN OPENSSH PRIVATE KEY-----\nb3BlbnNzaC1rZXktdjEAAAAABG5vbmUAAAAEbm9uZQAAAAAAAAABAAABlwAAAAdzc2gtcn\nNhAAAAAwEAAQAAAYEA18oZs2zLSRl3GKxMB9ojD2adUSa8/NgjVHiZ1VOrpvsNMRm8nmoa\nP6ojWerPTljTnBcfob603Y3Vue7lzJJaaPZcsk9p+oc5m3WrtI7GsI2SlN1sTP5Q9aiMKM\n2BNQLAwAQXxYMdcHq33YvEQ9uuZsYcLI7e/ByjNiZSvc1B/VKiH2l+K0DnyrkxApGkLiDa\nNwIuVIJjxihqSu24d/tj4XY8+IAXmkZNoI8KfL4IWXT/jVTwOwiGzjk1XNhlHd8oNUhtft\nc0xNn5y1ku4q84rz9y1F4FOkMmFJPnEMtrnlCNtIm6vn0kuKMIPE/tDbDHcXsHqKVCKEDB\neTJoSU9UgLFJIuk5ndXPBkaNoZPyMCs3b0EyLDAOvEG54VYS3kqaXPVix7VLfxFSsQAn4j\nGZP1axwqS7T0rh+PfYePPn3xrsw4Repl/jFbCoQ35G+H6MKOGCDSxxuuu+WKmoZ2qpYVLN\nHWPp7vzHqUSV0OtdmPf23wts8DrbMINACr/b3NK/AAAFoKTPnUakz51GAAAAB3NzaC1yc2\nEAAAGBANfKGbNsy0kZdxisTAfaIw9mnVEmvPzYI1R4mdVTq6b7DTEZvJ5qGj+qI1nqz05Y\n05wXH6G+tN2N1bnu5cySWmj2XLJPafqHOZt1q7SOxrCNkpTdbEz+UPWojCjNgTUCwMAEF8\nWDHXB6t92LxEPbrmbGHCyO3vwcozYmUr3NQf1Soh9pfitA58q5MQKRpC4g2jcCLlSCY8Yo\nakrtuHf7Y+F2PPiAF5pGTaCPCny+CFl0/41U8DsIhs45NVzYZR3fKDVIbX7XNMTZ+ctZLu\nKvOK8/ctReBTpDJhST5xDLa55QjbSJur59JLijCDxP7Q2wx3F7B6ilQihAwXkyaElPVICx\nSSLpOZ3VzwZGjaGT8jArN29BMiwwDrxBueFWEt5Kmlz1Yse1S38RUrEAJ+IxmT9WscKku0\n9K4fj32Hjz598a7MOEXqZf4xWwqEN+Rvh+jCjhgg0scbrrvlipqGdqqWFSzR1j6e78x6lE\nldDrXZj39t8LbPA62zCDQAq/29zSvwAAAAMBAAEAAAGBAIiLrCOrTh9da81DCYFWeST/q8\nB0INZl9kU3YzBoF5A8ACb3wDEFtsJeaKw3NyK+dnio8S0qPcyMOZfEIcmHOop8ij+SnN8Y\nvk0u8o34YqXJj91/F07JBnXMR5RyJbZjnZBjhp9GzlQkc0BPdsvxsLP73Ewdw+AIRwa2zV\nipD3660TfLSzkXgxT2hpq3igpeY3a3fJWhRH1ZiZkMP9Q8UQGUDhS5CTZoEirtGJfCsAnb\nTPIjszfHt3W7IZc0nxd94ws8X3nH440TCYvV6un96SlZ00PrXCxargx8Bz0ARluhfyCYF+\nRKvuKHsF3r6vx7JpGVj41+HqA6iPf+1MI/b65b2D02WT3pXGdAsmqG3llJV1PJmYwXEQws\naWxV1BJCXcyBzG+wV/xOr4ZRwa1vTBrDjK2zcD9rwNYlVlC1b59j1i3H2me6lkKPzVVTv4\nD0wCZIo1zfqKxBXbVIxxm9XHIPLPLkGePz35WhTQ0qKV+75tPba055LNK8DiVYMX3nAQAA\nAMEA5rW9eK6/Jsx63+fKPnwt3lMgMsb5lwpxRyun9pOk4Ypyw+xo1T11y4avT/RnAdfifl\ngxPugMsYCWwpIDUiCQvHTjQDFB8oh8mipO92uGYDWQPn7B+T8Yi0r2nKCF94KpMlxpCwXC\nnCGQpSpNhUSywPsfjp2AE5bt8IKYazwj7EaYFqp520zLx3p4EODHIuHYYX7JHRtzfA/76P\nAQ96A+gDaVo2u+W6zrxbj8MxtrDYwdRiLWyNjqTVBPYkXtAag2AAAAwQD9PHSaIRObv278\nKrdwzGK8bXET3K2WXOCxWjghmlL3YaQbAox3iOxd4Gmv7Nl5cQUhbkGvjL8QsfyhYFoCax\nhyufy5Lt9crOGyMVGMy6K7gSkhkOk/+5tC5HmRtSquTKg4no1IXffB/IMZh6/kwvLAO2dQ\nWDTYl9WzFhWtnLoxRbEC1L2G2VjduTSPJ8lamWgacLO2hvJ4wqq4fbJez5iNfKeYNYNAHZ\nPbv96PxmqSzKlKhkRPTkMgqbzTswhHXH8AAADBANolBLheF6XiQ5pa6JYw/i1fZH/B7NWZ\nr0MWZj7XMdbM98j3nYPEjmZy2DIPVqQ/vX48i+CXJac8iQv48R7ml9mx3yd/t6C3YF4D0O\n7Cpn75r4B2jsrKxbR4HoPCVpMxC/cH5f7GSPshKIDbTPfbqJH/oFHHMrnWpAJiO8Aei0Vj\nBUuuImQnASfROoJwnDsvX0ZtF4rjvMr0+cGXEAgb6Qn9Vvqf+DulQ58XSV6oIzMtANylQ6\nFta1tK1WVCluBpwQAAACljZXBoLWU0YTY0MmQyLTgxYTUtMTFlYi05MDgwLTAwMWE0YWFi\nODMwYw==\n-----END OPENSSH PRIVATE KEY-----\n"}]': finished 2021-03-10T13:39:13.732 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:13 gibba015 bash[9806]: audit 2021-03-10T13:39:13.282960+0000 mon.a (mon.0) 57 : audit [INF] from='mgr.14117 172.21.2.115:0/3460604445' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/ssh_identity_pub","val":"ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDXyhmzbMtJGXcYrEwH2iMPZp1RJrz82CNUeJnVU6um+w0xGbyeaho/qiNZ6s9OWNOcFx+hvrTdjdW57uXMklpo9lyyT2n6hzmbdau0jsawjZKU3WxM/lD1qIwozYE1AsDABBfFgx1werfdi8RD265mxhwsjt78HKM2JlK9zUH9UqIfaX4rQOfKuTECkaQuINo3Ai5UgmPGKGpK7bh3+2Phdjz4gBeaRk2gjwp8vghZdP+NVPA7CIbOOTVc2GUd3yg1SG1+1zTE2fnLWS7irzivP3LUXgU6QyYUk+cQy2ueUI20ibq+fSS4owg8T+0NsMdxeweopUIoQMF5MmhJT1SAsUki6Tmd1c8GRo2hk/IwKzdvQTIsMA68QbnhVhLeSppc9WLHtUt/EVKxACfiMZk/VrHCpLtPSuH499h48+ffGuzDhF6mX+MVsKhDfkb4fowo4YINLHG6675YqahnaqlhUs0dY+nu/MepRJXQ612Y9/bfC2zwOtswg0AKv9vc0r8= ceph-e4a642d2-81a5-11eb-9080-001a4aab830c\n"}]: dispatch 2021-03-10T13:39:13.733 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:13 gibba015 bash[9806]: audit 2021-03-10T13:39:13.284249+0000 mon.a (mon.0) 58 : audit [INF] from='mgr.14117 172.21.2.115:0/3460604445' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/ssh_identity_pub","val":"ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDXyhmzbMtJGXcYrEwH2iMPZp1RJrz82CNUeJnVU6um+w0xGbyeaho/qiNZ6s9OWNOcFx+hvrTdjdW57uXMklpo9lyyT2n6hzmbdau0jsawjZKU3WxM/lD1qIwozYE1AsDABBfFgx1werfdi8RD265mxhwsjt78HKM2JlK9zUH9UqIfaX4rQOfKuTECkaQuINo3Ai5UgmPGKGpK7bh3+2Phdjz4gBeaRk2gjwp8vghZdP+NVPA7CIbOOTVc2GUd3yg1SG1+1zTE2fnLWS7irzivP3LUXgU6QyYUk+cQy2ueUI20ibq+fSS4owg8T+0NsMdxeweopUIoQMF5MmhJT1SAsUki6Tmd1c8GRo2hk/IwKzdvQTIsMA68QbnhVhLeSppc9WLHtUt/EVKxACfiMZk/VrHCpLtPSuH499h48+ffGuzDhF6mX+MVsKhDfkb4fowo4YINLHG6675YqahnaqlhUs0dY+nu/MepRJXQ612Y9/bfC2zwOtswg0AKv9vc0r8= ceph-e4a642d2-81a5-11eb-9080-001a4aab830c\n"}]': finished 2021-03-10T13:39:13.841 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba015', '-v', '/var/log/ceph/e4a642d2-81a5-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmp3221digx:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpygecn9iw:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'cephadm', 'get-pub-key'] 2021-03-10T13:39:13.841 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba015 -v /var/log/ceph/e4a642d2-81a5-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp3221digx:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpygecn9iw:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 cephadm get-pub-key 2021-03-10T13:39:14.611 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:14 gibba015 bash[9806]: audit 2021-03-10T13:39:13.196885+0000 mgr.y (mgr.14117) 2 : audit [DBG] from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:39:14.611 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:14 gibba015 bash[9806]: cephadm 2021-03-10T13:39:13.197053+0000 mgr.y (mgr.14117) 3 : cephadm [INF] Generating ssh key... 2021-03-10T13:39:14.835 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDXyhmzbMtJGXcYrEwH2iMPZp1RJrz82CNUeJnVU6um+w0xGbyeaho/qiNZ6s9OWNOcFx+hvrTdjdW57uXMklpo9lyyT2n6hzmbdau0jsawjZKU3WxM/lD1qIwozYE1AsDABBfFgx1werfdi8RD265mxhwsjt78HKM2JlK9zUH9UqIfaX4rQOfKuTECkaQuINo3Ai5UgmPGKGpK7bh3+2Phdjz4gBeaRk2gjwp8vghZdP+NVPA7CIbOOTVc2GUd3yg1SG1+1zTE2fnLWS7irzivP3LUXgU6QyYUk+cQy2ueUI20ibq+fSS4owg8T+0NsMdxeweopUIoQMF5MmhJT1SAsUki6Tmd1c8GRo2hk/IwKzdvQTIsMA68QbnhVhLeSppc9WLHtUt/EVKxACfiMZk/VrHCpLtPSuH499h48+ffGuzDhF6mX+MVsKhDfkb4fowo4YINLHG6675YqahnaqlhUs0dY+nu/MepRJXQ612Y9/bfC2zwOtswg0AKv9vc0r8= ceph-e4a642d2-81a5-11eb-9080-001a4aab830c 2021-03-10T13:39:15.355 INFO:teuthology.orchestra.run.gibba015.stderr:INFO:cephadm:Wrote public SSH key to to /home/ubuntu/cephtest/ceph.pub 2021-03-10T13:39:15.355 INFO:teuthology.orchestra.run.gibba015.stderr:INFO:cephadm:Adding key to root@localhost's authorized_keys... 2021-03-10T13:39:15.356 INFO:teuthology.orchestra.run.gibba015.stderr:INFO:cephadm:Adding host gibba015... 2021-03-10T13:39:15.356 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba015', '-v', '/var/log/ceph/e4a642d2-81a5-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmp3221digx:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpygecn9iw:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'orch', 'host', 'add', 'gibba015'] 2021-03-10T13:39:15.356 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba015 -v /var/log/ceph/e4a642d2-81a5-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp3221digx:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpygecn9iw:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 orch host add gibba015 2021-03-10T13:39:15.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:15 gibba015 bash[9806]: audit 2021-03-10T13:39:14.832631+0000 mgr.y (mgr.14117) 4 : audit [DBG] from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:39:16.722 INFO:journalctl@ceph.mgr.y.gibba015.stdout:Mar 10 13:39:16 gibba015 bash[10036]: Warning: Permanently added 'gibba015,172.21.2.115' (ECDSA) to the list of known hosts. 2021-03-10T13:39:17.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:16 gibba015 bash[9806]: audit 2021-03-10T13:39:16.669593+0000 mon.a (mon.0) 59 : audit [INF] from='mgr.14117 172.21.2.115:0/3460604445' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"gibba015\": {\"hostname\": \"gibba015\", \"addr\": \"gibba015\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2021-03-10T13:39:17.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:16 gibba015 bash[9806]: audit 2021-03-10T13:39:16.671294+0000 mon.a (mon.0) 60 : audit [INF] from='mgr.14117 172.21.2.115:0/3460604445' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"gibba015\": {\"hostname\": \"gibba015\", \"addr\": \"gibba015\", \"labels\": [], \"status\": \"\"}}"}]': finished 2021-03-10T13:39:17.352 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout Added host 'gibba015' 2021-03-10T13:39:18.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:17 gibba015 bash[9806]: audit 2021-03-10T13:39:16.345023+0000 mgr.y (mgr.14117) 5 : audit [DBG] from='client.14136 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "gibba015", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:39:18.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:17 gibba015 bash[9806]: cephadm 2021-03-10T13:39:16.671717+0000 mgr.y (mgr.14117) 6 : cephadm [INF] Added host gibba015 2021-03-10T13:39:18.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:17 gibba015 bash[9806]: audit 2021-03-10T13:39:16.784746+0000 mon.a (mon.0) 61 : audit [INF] from='mgr.14117 172.21.2.115:0/3460604445' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {}, \"devices\": [], \"daemon_config_deps\": {}, \"networks\": {}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]: dispatch 2021-03-10T13:39:18.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:17 gibba015 bash[9806]: audit 2021-03-10T13:39:16.786401+0000 mon.a (mon.0) 62 : audit [INF] from='mgr.14117 172.21.2.115:0/3460604445' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {}, \"devices\": [], \"daemon_config_deps\": {}, \"networks\": {}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]': finished 2021-03-10T13:39:18.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:17 gibba015 bash[9806]: audit 2021-03-10T13:39:16.786937+0000 mon.a (mon.0) 63 : audit [DBG] from='mgr.14117 172.21.2.115:0/3460604445' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:39:18.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:17 gibba015 bash[9806]: audit 2021-03-10T13:39:17.102726+0000 mon.a (mon.0) 64 : audit [INF] from='mgr.14117 172.21.2.115:0/3460604445' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:39:17.101311\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:39:17.102287\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}}, \"devices\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2021-03-10T13:39:17.102350\", \"networks\": {}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]: dispatch 2021-03-10T13:39:18.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:17 gibba015 bash[9806]: audit 2021-03-10T13:39:17.104535+0000 mon.a (mon.0) 65 : audit [INF] from='mgr.14117 172.21.2.115:0/3460604445' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:39:17.101311\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:39:17.102287\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}}, \"devices\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2021-03-10T13:39:17.102350\", \"networks\": {}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]': finished 2021-03-10T13:39:18.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:17 gibba015 bash[9806]: audit 2021-03-10T13:39:17.105034+0000 mon.a (mon.0) 66 : audit [DBG] from='mgr.14117 172.21.2.115:0/3460604445' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:39:18.243 INFO:teuthology.orchestra.run.gibba015.stderr:INFO:cephadm:Enabling the dashboard module... 2021-03-10T13:39:18.244 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba015', '-v', '/var/log/ceph/e4a642d2-81a5-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmp3221digx:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpygecn9iw:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'mgr', 'module', 'enable', 'dashboard'] 2021-03-10T13:39:18.244 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba015 -v /var/log/ceph/e4a642d2-81a5-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp3221digx:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpygecn9iw:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 mgr module enable dashboard 2021-03-10T13:39:20.276 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:20 gibba015 bash[9806]: audit 2021-03-10T13:39:19.969506+0000 mon.a (mon.0) 67 : audit [INF] from='client.? 172.21.2.115:0/579372140' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2021-03-10T13:39:20.277 INFO:journalctl@ceph.mgr.y.gibba015.stdout:Mar 10 13:39:20 gibba015 bash[10036]: ignoring --setuser ceph since I am not root 2021-03-10T13:39:20.277 INFO:journalctl@ceph.mgr.y.gibba015.stdout:Mar 10 13:39:20 gibba015 bash[10036]: ignoring --setgroup ceph since I am not root 2021-03-10T13:39:20.762 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba015', '-v', '/var/log/ceph/e4a642d2-81a5-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmp3221digx:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpygecn9iw:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'mgr', 'dump'] 2021-03-10T13:39:20.762 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba015 -v /var/log/ceph/e4a642d2-81a5-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp3221digx:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpygecn9iw:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 mgr dump 2021-03-10T13:39:21.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:21 gibba015 bash[9806]: audit 2021-03-10T13:39:20.022358+0000 mon.a (mon.0) 68 : audit [INF] from='client.? 172.21.2.115:0/579372140' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2021-03-10T13:39:21.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:21 gibba015 bash[9806]: cluster 2021-03-10T13:39:20.022385+0000 mon.a (mon.0) 69 : cluster [DBG] mgrmap e9: y(active, since 11s) 2021-03-10T13:39:22.442 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:39:22.442 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 9, 2021-03-10T13:39:22.443 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_gid": 14117, 2021-03-10T13:39:22.443 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_name": "y", 2021-03-10T13:39:22.443 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_addrs": { 2021-03-10T13:39:22.443 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2021-03-10T13:39:22.444 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:39:22.444 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2021-03-10T13:39:22.444 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.2.115:6800", 2021-03-10T13:39:22.444 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 2856562116 2021-03-10T13:39:22.444 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.445 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:39:22.445 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v1", 2021-03-10T13:39:22.445 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.2.115:6801", 2021-03-10T13:39:22.445 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 2856562116 2021-03-10T13:39:22.445 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:22.446 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2021-03-10T13:39:22.446 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.446 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_addr": "172.21.2.115:6801/2856562116", 2021-03-10T13:39:22.446 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_change": "2021-03-10T13:39:08.741780+0000", 2021-03-10T13:39:22.447 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_mgr_features": 4540138292836696063, 2021-03-10T13:39:22.447 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available": true, 2021-03-10T13:39:22.447 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "standbys": [], 2021-03-10T13:39:22.447 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modules": [ 2021-03-10T13:39:22.447 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "cephadm", 2021-03-10T13:39:22.448 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "dashboard", 2021-03-10T13:39:22.448 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "iostat", 2021-03-10T13:39:22.448 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "restful" 2021-03-10T13:39:22.448 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:22.448 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available_modules": [ 2021-03-10T13:39:22.449 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:39:22.449 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "alerts", 2021-03-10T13:39:22.449 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:39:22.449 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:39:22.450 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:39:22.450 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2021-03-10T13:39:22.450 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2021-03-10T13:39:22.450 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:39:22.450 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.451 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.451 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2021-03-10T13:39:22.451 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.451 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.452 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.452 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "How frequently to reexamine health status", 2021-03-10T13:39:22.452 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.452 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.452 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.453 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.453 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:39:22.453 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:39:22.453 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:22.453 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.454 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.454 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:22.454 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.454 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.455 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:22.455 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:22.455 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:22.455 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:22.455 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:22.456 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:22.456 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:22.456 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:22.456 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.456 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.457 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.457 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.457 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.457 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:39:22.458 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:39:22.458 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:22.458 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.458 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.459 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:22.459 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.459 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.459 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.459 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.460 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.460 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.460 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.460 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.461 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:39:22.461 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:39:22.461 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:22.461 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.461 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.462 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:39:22.462 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.462 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.462 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:22.462 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:22.463 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:22.463 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:22.463 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:22.463 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:22.464 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:22.464 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:22.464 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.464 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.464 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.465 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.465 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.465 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:39:22.465 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:39:22.465 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:22.466 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.466 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.466 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:22.466 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.467 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.467 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.467 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.467 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.467 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.468 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.468 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.468 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_destination": { 2021-03-10T13:39:22.468 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_destination", 2021-03-10T13:39:22.469 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:22.469 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.469 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.469 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:22.470 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.470 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.470 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.470 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Email address to send alerts to", 2021-03-10T13:39:22.471 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.471 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.471 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.471 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.471 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_from_name": { 2021-03-10T13:39:22.472 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_from_name", 2021-03-10T13:39:22.472 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:22.472 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.472 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.473 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "Ceph", 2021-03-10T13:39:22.473 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.473 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.473 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.474 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Email From: name", 2021-03-10T13:39:22.474 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.474 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.474 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.474 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.475 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_host": { 2021-03-10T13:39:22.475 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_host", 2021-03-10T13:39:22.475 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:22.475 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.476 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.476 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:22.476 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.476 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.477 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.477 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "SMTP server", 2021-03-10T13:39:22.477 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.477 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.477 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.478 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.478 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_password": { 2021-03-10T13:39:22.478 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_password", 2021-03-10T13:39:22.478 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:22.479 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.479 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.479 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:22.479 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.479 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.480 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.480 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Password to authenticate with", 2021-03-10T13:39:22.480 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.480 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.481 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.481 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.481 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_port": { 2021-03-10T13:39:22.481 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_port", 2021-03-10T13:39:22.481 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:39:22.482 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.482 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.482 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "465", 2021-03-10T13:39:22.482 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.483 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.483 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.483 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "SMTP port", 2021-03-10T13:39:22.483 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.483 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.484 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.484 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.484 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_sender": { 2021-03-10T13:39:22.484 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_sender", 2021-03-10T13:39:22.485 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:22.485 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.485 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.485 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:22.485 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.486 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.486 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.486 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "SMTP envelope sender", 2021-03-10T13:39:22.486 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.487 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.487 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.487 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.487 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_ssl": { 2021-03-10T13:39:22.487 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_ssl", 2021-03-10T13:39:22.488 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:22.488 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.488 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.488 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:39:22.488 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.489 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.489 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.489 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Use SSL to connect to SMTP server", 2021-03-10T13:39:22.489 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.490 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.490 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.490 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.490 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_user": { 2021-03-10T13:39:22.490 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_user", 2021-03-10T13:39:22.491 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:22.491 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.491 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.491 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:22.491 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.492 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.492 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.492 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "User to authenticate as", 2021-03-10T13:39:22.492 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.493 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.493 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.493 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:22.493 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:22.493 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.494 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:39:22.494 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "balancer", 2021-03-10T13:39:22.494 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:39:22.494 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:39:22.495 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:39:22.495 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active": { 2021-03-10T13:39:22.495 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "active", 2021-03-10T13:39:22.495 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:22.495 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.496 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.496 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:22.496 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.496 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.497 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.497 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "automatically balance PGs across cluster", 2021-03-10T13:39:22.497 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.497 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.497 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.498 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.498 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "begin_time": { 2021-03-10T13:39:22.498 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "begin_time", 2021-03-10T13:39:22.498 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:22.499 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.499 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.499 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0000", 2021-03-10T13:39:22.499 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.499 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.500 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.500 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "beginning time of day to automatically balance", 2021-03-10T13:39:22.500 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "This is a time of day in the format HHMM.", 2021-03-10T13:39:22.500 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.500 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.501 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.501 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "begin_weekday": { 2021-03-10T13:39:22.501 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "begin_weekday", 2021-03-10T13:39:22.501 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2021-03-10T13:39:22.501 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.502 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.502 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0", 2021-03-10T13:39:22.502 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "0", 2021-03-10T13:39:22.502 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "7", 2021-03-10T13:39:22.503 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.503 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Restrict automatic balancing to this day of the week or later", 2021-03-10T13:39:22.503 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2021-03-10T13:39:22.503 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.503 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.504 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.504 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush_compat_max_iterations": { 2021-03-10T13:39:22.504 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crush_compat_max_iterations", 2021-03-10T13:39:22.504 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2021-03-10T13:39:22.504 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.505 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.505 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "25", 2021-03-10T13:39:22.505 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "1", 2021-03-10T13:39:22.505 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "250", 2021-03-10T13:39:22.506 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.506 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "maximum number of iterations to attempt optimization", 2021-03-10T13:39:22.506 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.506 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.506 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.507 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.507 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush_compat_metrics": { 2021-03-10T13:39:22.507 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crush_compat_metrics", 2021-03-10T13:39:22.507 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:22.507 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.508 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.508 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "pgs,objects,bytes", 2021-03-10T13:39:22.508 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.508 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.508 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.509 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "metrics with which to calculate OSD utilization", 2021-03-10T13:39:22.509 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2021-03-10T13:39:22.509 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.509 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.510 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.510 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush_compat_step": { 2021-03-10T13:39:22.510 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crush_compat_step", 2021-03-10T13:39:22.510 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "float", 2021-03-10T13:39:22.511 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.511 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.511 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0.5", 2021-03-10T13:39:22.511 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "0.001", 2021-03-10T13:39:22.511 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "0.999", 2021-03-10T13:39:22.512 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.512 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "aggressiveness of optimization", 2021-03-10T13:39:22.512 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": ".99 is very aggressive, .01 is less aggressive", 2021-03-10T13:39:22.512 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.512 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.513 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.513 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "end_time": { 2021-03-10T13:39:22.513 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "end_time", 2021-03-10T13:39:22.513 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:22.514 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.514 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.514 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "2400", 2021-03-10T13:39:22.514 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.514 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.515 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.515 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "ending time of day to automatically balance", 2021-03-10T13:39:22.515 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "This is a time of day in the format HHMM.", 2021-03-10T13:39:22.515 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.515 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.516 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.516 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "end_weekday": { 2021-03-10T13:39:22.516 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "end_weekday", 2021-03-10T13:39:22.516 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2021-03-10T13:39:22.516 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.517 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.517 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "7", 2021-03-10T13:39:22.517 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "0", 2021-03-10T13:39:22.517 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "7", 2021-03-10T13:39:22.517 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.518 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Restrict automatic balancing to days of the week earlier than this", 2021-03-10T13:39:22.518 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2021-03-10T13:39:22.518 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.518 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.519 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.519 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:39:22.519 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:39:22.519 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:22.519 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.520 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.520 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:22.520 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.520 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.521 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:22.521 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:22.521 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:22.521 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:22.521 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:22.522 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:22.522 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:22.522 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:22.522 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.523 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.523 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.523 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.523 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.523 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:39:22.524 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:39:22.524 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:22.524 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.524 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.524 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:22.525 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.525 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.525 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.525 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.525 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.526 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.526 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.526 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.526 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:39:22.527 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:39:22.527 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:22.527 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.527 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.527 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:39:22.528 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.528 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.528 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:22.528 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:22.528 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:22.529 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:22.529 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:22.529 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:22.529 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:22.529 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:22.530 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.530 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.530 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.530 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.531 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.531 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:39:22.531 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:39:22.531 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:22.531 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.532 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.532 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:22.532 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.532 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.532 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.533 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.533 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.533 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.533 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.533 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.534 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_score": { 2021-03-10T13:39:22.534 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "min_score", 2021-03-10T13:39:22.534 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "float", 2021-03-10T13:39:22.534 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.535 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.535 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0", 2021-03-10T13:39:22.535 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.535 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.535 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.536 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "minimum score, below which no optimization is attempted", 2021-03-10T13:39:22.536 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.536 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.536 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.536 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.537 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mode": { 2021-03-10T13:39:22.537 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mode", 2021-03-10T13:39:22.537 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:22.537 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.537 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.538 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "none", 2021-03-10T13:39:22.538 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.538 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.538 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:22.539 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush-compat", 2021-03-10T13:39:22.539 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "none", 2021-03-10T13:39:22.539 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "upmap" 2021-03-10T13:39:22.539 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:22.539 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Balancer mode", 2021-03-10T13:39:22.540 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.540 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.540 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.540 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.540 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pool_ids": { 2021-03-10T13:39:22.541 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pool_ids", 2021-03-10T13:39:22.541 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:22.541 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.541 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.541 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:22.542 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.542 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.542 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.542 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "pools which the automatic balancing will be limited to", 2021-03-10T13:39:22.543 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.543 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.543 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.543 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.544 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2021-03-10T13:39:22.544 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2021-03-10T13:39:22.544 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:39:22.544 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.545 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.545 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2021-03-10T13:39:22.545 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.545 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.545 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.546 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to wake up and attempt optimization", 2021-03-10T13:39:22.546 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.546 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.546 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.546 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.547 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "upmap_max_deviation": { 2021-03-10T13:39:22.547 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "upmap_max_deviation", 2021-03-10T13:39:22.547 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:39:22.547 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.547 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.548 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2021-03-10T13:39:22.548 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "1", 2021-03-10T13:39:22.548 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.548 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.548 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "deviation below which no optimization is attempted", 2021-03-10T13:39:22.549 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2021-03-10T13:39:22.549 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.549 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.549 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.550 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "upmap_max_optimizations": { 2021-03-10T13:39:22.550 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "upmap_max_optimizations", 2021-03-10T13:39:22.550 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2021-03-10T13:39:22.550 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.550 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.551 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2021-03-10T13:39:22.551 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.551 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.551 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.551 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "maximum upmap optimizations to make per attempt", 2021-03-10T13:39:22.552 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.552 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.552 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.552 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:22.552 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:22.553 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.553 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:39:22.553 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "cephadm", 2021-03-10T13:39:22.553 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:39:22.553 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:39:22.554 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:39:22.554 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "allow_ptrace": { 2021-03-10T13:39:22.554 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "allow_ptrace", 2021-03-10T13:39:22.554 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:22.555 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.555 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.555 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:22.555 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.555 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.556 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.556 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "allow SYS_PTRACE capability on ceph containers", 2021-03-10T13:39:22.556 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2021-03-10T13:39:22.556 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.556 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.557 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.557 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "container_image_base": { 2021-03-10T13:39:22.557 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "container_image_base", 2021-03-10T13:39:22.557 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:22.558 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.558 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.558 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "ceph/ceph", 2021-03-10T13:39:22.558 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.558 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.559 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.559 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Container image name, without the tag", 2021-03-10T13:39:22.559 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.559 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.559 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.560 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.560 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "daemon_cache_timeout": { 2021-03-10T13:39:22.560 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "daemon_cache_timeout", 2021-03-10T13:39:22.560 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:39:22.560 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.561 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.561 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2021-03-10T13:39:22.561 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.561 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.561 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.562 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "seconds to cache service (daemon) inventory", 2021-03-10T13:39:22.562 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.562 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.562 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.563 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.563 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "device_cache_timeout": { 2021-03-10T13:39:22.563 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "device_cache_timeout", 2021-03-10T13:39:22.563 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:39:22.563 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.564 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.564 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "1800", 2021-03-10T13:39:22.564 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.564 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.565 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.565 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "seconds to cache device inventory", 2021-03-10T13:39:22.565 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.565 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.565 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.566 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.566 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "host_check_interval": { 2021-03-10T13:39:22.566 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "host_check_interval", 2021-03-10T13:39:22.566 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:39:22.567 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.567 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.567 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2021-03-10T13:39:22.567 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.567 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.568 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.568 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to perform a host check", 2021-03-10T13:39:22.568 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.568 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.568 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.569 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.569 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:39:22.569 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:39:22.569 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:22.569 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.570 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.570 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:22.570 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.570 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.571 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:22.571 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:22.571 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:22.571 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:22.571 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:22.572 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:22.572 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:22.572 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:22.572 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.572 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.573 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.573 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.573 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.573 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:39:22.573 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:39:22.574 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:22.574 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.574 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.574 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:39:22.574 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.575 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.575 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.575 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "log to the \"cephadm\" cluster log channel\"", 2021-03-10T13:39:22.575 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.576 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.576 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.576 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.576 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:39:22.576 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:39:22.577 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:22.577 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.577 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.577 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:39:22.577 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.578 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.578 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:22.578 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:22.578 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:22.579 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:22.579 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:22.579 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:22.579 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:22.579 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:22.580 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.580 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.580 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.580 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.580 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.581 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:39:22.581 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:39:22.581 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:22.581 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.581 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.582 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:22.582 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.582 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.582 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.583 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.583 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.583 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.583 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.583 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.584 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mode": { 2021-03-10T13:39:22.584 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mode", 2021-03-10T13:39:22.584 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:22.584 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.585 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.585 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "root", 2021-03-10T13:39:22.585 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.585 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.585 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:22.586 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "cephadm-package", 2021-03-10T13:39:22.586 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "root" 2021-03-10T13:39:22.586 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:22.586 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "mode for remote execution of cephadm", 2021-03-10T13:39:22.587 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.587 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.587 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.587 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.587 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssh_config_file": { 2021-03-10T13:39:22.588 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssh_config_file", 2021-03-10T13:39:22.588 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:22.588 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.588 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.588 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T13:39:22.589 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.589 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.589 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.589 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "customized SSH config file to connect to managed hosts", 2021-03-10T13:39:22.590 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.590 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.590 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.590 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.590 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_on_failed_host_check": { 2021-03-10T13:39:22.591 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_on_failed_host_check", 2021-03-10T13:39:22.591 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:22.591 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.591 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.592 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:39:22.592 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.592 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.592 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.592 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise a health warning if the host check fails", 2021-03-10T13:39:22.593 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.593 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.593 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.593 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.593 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_on_stray_daemons": { 2021-03-10T13:39:22.594 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_on_stray_daemons", 2021-03-10T13:39:22.594 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:22.594 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.594 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.595 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:39:22.595 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.595 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.595 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.595 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2021-03-10T13:39:22.596 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.596 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.596 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.596 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.596 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_on_stray_hosts": { 2021-03-10T13:39:22.597 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_on_stray_hosts", 2021-03-10T13:39:22.597 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:22.597 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.597 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.598 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:39:22.598 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.598 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.598 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.602 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2021-03-10T13:39:22.602 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.602 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.602 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.603 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:22.603 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:22.603 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.603 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:39:22.603 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crash", 2021-03-10T13:39:22.604 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:39:22.604 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:39:22.604 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:39:22.604 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:39:22.605 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:39:22.605 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:22.605 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.605 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.605 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:22.606 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.606 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.606 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:22.606 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:22.607 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:22.607 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:22.607 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:22.607 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:22.607 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:22.608 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:22.608 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.608 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.608 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.608 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.609 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.609 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:39:22.609 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:39:22.609 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:22.610 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.610 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.610 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:22.610 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.610 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.611 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.611 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.611 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.611 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.611 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.612 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.612 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:39:22.612 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:39:22.612 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:22.613 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.613 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.613 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:39:22.613 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.613 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.614 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:22.614 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:22.614 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:22.614 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:22.614 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:22.615 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:22.615 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:22.615 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:22.615 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.616 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.616 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.616 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.616 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.616 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:39:22.617 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:39:22.617 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:22.617 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.617 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.617 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:22.618 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.618 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.618 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.618 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.619 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.619 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.619 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.619 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.619 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "retain_interval": { 2021-03-10T13:39:22.620 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "retain_interval", 2021-03-10T13:39:22.620 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:39:22.620 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.620 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.621 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "31536000", 2021-03-10T13:39:22.621 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.621 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.621 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.621 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how long to retain crashes before pruning them", 2021-03-10T13:39:22.622 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.622 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.622 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.622 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.623 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_recent_interval": { 2021-03-10T13:39:22.623 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_recent_interval", 2021-03-10T13:39:22.623 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:39:22.623 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.623 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.624 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "1209600", 2021-03-10T13:39:22.624 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.624 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.624 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.624 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "time interval in which to warn about recent crashes", 2021-03-10T13:39:22.625 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.625 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.625 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.625 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:22.625 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:22.626 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.626 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:39:22.626 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "dashboard", 2021-03-10T13:39:22.626 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:39:22.627 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:39:22.627 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:39:22.627 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ALERTMANAGER_API_HOST": { 2021-03-10T13:39:22.627 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ALERTMANAGER_API_HOST", 2021-03-10T13:39:22.627 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:22.628 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.628 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.628 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:22.628 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.629 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.629 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.629 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.629 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.629 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.630 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.630 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.630 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "AUDIT_API_ENABLED": { 2021-03-10T13:39:22.630 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "AUDIT_API_ENABLED", 2021-03-10T13:39:22.630 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:22.631 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.631 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.631 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:22.631 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.632 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.632 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.632 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.632 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.632 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.633 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.633 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.633 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "AUDIT_API_LOG_PAYLOAD": { 2021-03-10T13:39:22.633 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "AUDIT_API_LOG_PAYLOAD", 2021-03-10T13:39:22.633 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:22.634 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.634 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.634 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:39:22.634 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.635 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.635 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.635 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.635 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.635 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.636 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.636 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.636 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ENABLE_BROWSABLE_API": { 2021-03-10T13:39:22.636 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ENABLE_BROWSABLE_API", 2021-03-10T13:39:22.636 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:22.637 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.637 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.637 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:39:22.637 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.637 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.638 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.638 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.638 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.638 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.639 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.639 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.639 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_cephfs": { 2021-03-10T13:39:22.639 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_cephfs", 2021-03-10T13:39:22.639 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:22.640 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.640 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.640 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:39:22.640 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.640 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.641 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.641 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.641 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.641 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.642 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.642 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.642 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_iscsi": { 2021-03-10T13:39:22.642 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_iscsi", 2021-03-10T13:39:22.642 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:22.643 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.643 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.643 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:39:22.643 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.643 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.644 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.644 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.644 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.644 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.645 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.645 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.645 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_mirroring": { 2021-03-10T13:39:22.645 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_mirroring", 2021-03-10T13:39:22.645 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:22.646 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.646 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.646 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:39:22.646 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.647 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.647 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.647 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.647 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.647 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.648 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.648 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.648 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_nfs": { 2021-03-10T13:39:22.648 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_nfs", 2021-03-10T13:39:22.648 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:22.649 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.649 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.649 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:39:22.649 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.650 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.650 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.650 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.650 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.650 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.651 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.651 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.651 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_rbd": { 2021-03-10T13:39:22.651 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_rbd", 2021-03-10T13:39:22.651 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:22.652 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.652 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.652 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:39:22.652 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.653 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.653 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.653 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.653 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.653 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.654 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.654 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.654 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_rgw": { 2021-03-10T13:39:22.654 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_rgw", 2021-03-10T13:39:22.655 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:22.655 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.655 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.655 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:39:22.655 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.656 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.656 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.656 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.656 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.656 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.657 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.657 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.657 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2021-03-10T13:39:22.657 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2021-03-10T13:39:22.658 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:22.658 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.658 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.658 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:22.658 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.659 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.659 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.659 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.659 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.659 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.660 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.660 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.660 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_PASSWORD": { 2021-03-10T13:39:22.660 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_PASSWORD", 2021-03-10T13:39:22.661 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:22.661 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.661 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.661 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "admin", 2021-03-10T13:39:22.661 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.662 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.662 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.662 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.662 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.663 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.663 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.663 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.663 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_SSL_VERIFY": { 2021-03-10T13:39:22.663 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_SSL_VERIFY", 2021-03-10T13:39:22.664 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:22.664 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.664 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.664 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:39:22.664 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.665 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.665 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.665 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.665 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.666 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.666 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.666 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.666 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_URL": { 2021-03-10T13:39:22.666 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_URL", 2021-03-10T13:39:22.667 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:22.667 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.667 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.667 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:22.667 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.668 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.668 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.668 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.668 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.669 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.669 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.669 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.669 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_USERNAME": { 2021-03-10T13:39:22.669 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_USERNAME", 2021-03-10T13:39:22.670 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:22.670 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.670 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.670 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "admin", 2021-03-10T13:39:22.671 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.671 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.671 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.671 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.671 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.672 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.672 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.672 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.672 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_UPDATE_DASHBOARDS": { 2021-03-10T13:39:22.672 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_UPDATE_DASHBOARDS", 2021-03-10T13:39:22.673 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:22.673 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.673 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.673 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:22.673 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.674 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.674 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.674 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.674 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.674 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.675 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.675 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.675 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ISCSI_API_SSL_VERIFICATION": { 2021-03-10T13:39:22.675 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ISCSI_API_SSL_VERIFICATION", 2021-03-10T13:39:22.676 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:22.676 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.676 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.676 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:39:22.676 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.677 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.677 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.677 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.677 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.677 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.678 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.678 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.678 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PROMETHEUS_API_HOST": { 2021-03-10T13:39:22.678 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PROMETHEUS_API_HOST", 2021-03-10T13:39:22.679 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:22.679 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.679 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.679 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:22.679 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.680 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.680 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.680 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.680 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.680 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.681 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.681 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.681 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2021-03-10T13:39:22.681 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2021-03-10T13:39:22.682 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:22.682 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.682 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.682 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:22.682 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.683 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.683 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.683 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.683 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.684 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.684 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.684 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.684 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2021-03-10T13:39:22.684 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2021-03-10T13:39:22.685 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:22.685 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.685 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.685 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:22.686 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.686 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.686 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.686 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.686 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.687 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.687 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.687 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.687 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2021-03-10T13:39:22.687 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2021-03-10T13:39:22.688 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:22.688 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.688 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.688 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:39:22.689 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.689 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.689 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.689 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.690 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.690 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.690 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.690 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.690 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2021-03-10T13:39:22.691 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2021-03-10T13:39:22.691 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:22.691 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.691 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.692 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:39:22.692 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.692 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.692 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.692 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.693 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.693 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.693 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.693 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.693 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2021-03-10T13:39:22.694 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2021-03-10T13:39:22.694 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:22.694 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.694 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.695 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:22.695 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.695 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.695 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.695 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.696 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.696 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.696 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.696 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.697 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2021-03-10T13:39:22.697 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2021-03-10T13:39:22.697 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:22.697 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.697 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.698 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:22.698 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.698 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.698 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.698 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.699 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.699 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.699 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.699 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.700 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2021-03-10T13:39:22.700 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2021-03-10T13:39:22.700 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:22.700 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.700 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.701 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:22.701 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.701 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.701 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.701 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.702 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.702 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.702 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.702 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.703 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_ENABLED": { 2021-03-10T13:39:22.703 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_ENABLED", 2021-03-10T13:39:22.703 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:22.703 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.703 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.704 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:39:22.704 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.704 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.704 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.704 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.705 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.705 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.705 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.705 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.706 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_EXCLUSION_LIST": { 2021-03-10T13:39:22.706 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_EXCLUSION_LIST", 2021-03-10T13:39:22.706 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:22.706 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.706 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.707 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2021-03-10T13:39:22.707 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.707 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.707 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.707 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.708 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.708 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.708 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.708 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.709 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_MIN_COMPLEXITY": { 2021-03-10T13:39:22.709 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_MIN_COMPLEXITY", 2021-03-10T13:39:22.709 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:39:22.709 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.709 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.710 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2021-03-10T13:39:22.710 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.710 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.710 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.710 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.711 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.711 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.711 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.711 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.712 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_MIN_LENGTH": { 2021-03-10T13:39:22.712 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_MIN_LENGTH", 2021-03-10T13:39:22.712 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:39:22.712 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.712 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.713 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8", 2021-03-10T13:39:22.713 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.713 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.713 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.714 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.714 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.714 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.714 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.714 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.715 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "REST_REQUESTS_TIMEOUT": { 2021-03-10T13:39:22.715 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "REST_REQUESTS_TIMEOUT", 2021-03-10T13:39:22.715 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:39:22.715 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.715 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.716 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "45", 2021-03-10T13:39:22.716 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.716 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.716 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.716 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.717 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.717 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.717 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.717 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.718 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_ACCESS_KEY": { 2021-03-10T13:39:22.718 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_ACCESS_KEY", 2021-03-10T13:39:22.718 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:22.718 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.718 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.719 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:22.719 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.719 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.719 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.719 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.720 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.720 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.720 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.720 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.721 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_ADMIN_RESOURCE": { 2021-03-10T13:39:22.721 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_ADMIN_RESOURCE", 2021-03-10T13:39:22.721 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:22.721 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.721 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.722 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "admin", 2021-03-10T13:39:22.722 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.722 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.722 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.723 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.723 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.723 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.723 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.723 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.724 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_HOST": { 2021-03-10T13:39:22.724 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_HOST", 2021-03-10T13:39:22.724 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:22.724 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.724 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.725 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:22.725 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.725 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.725 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.726 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.726 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.726 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.726 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.726 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.727 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_PORT": { 2021-03-10T13:39:22.727 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_PORT", 2021-03-10T13:39:22.727 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:39:22.727 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.727 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.728 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "80", 2021-03-10T13:39:22.728 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.728 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.728 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.729 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.729 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.729 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.729 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.729 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.730 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_SCHEME": { 2021-03-10T13:39:22.730 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_SCHEME", 2021-03-10T13:39:22.730 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:22.730 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.730 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.731 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "http", 2021-03-10T13:39:22.731 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.731 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.731 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.732 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.732 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.732 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.732 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.732 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.733 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_SECRET_KEY": { 2021-03-10T13:39:22.733 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_SECRET_KEY", 2021-03-10T13:39:22.733 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:22.733 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.733 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.734 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:22.734 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.734 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.734 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.735 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.735 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.735 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.735 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.735 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.736 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_SSL_VERIFY": { 2021-03-10T13:39:22.736 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_SSL_VERIFY", 2021-03-10T13:39:22.736 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:22.736 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.737 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.737 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:39:22.737 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.737 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.737 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.738 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.738 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.738 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.738 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.739 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.739 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_USER_ID": { 2021-03-10T13:39:22.739 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_USER_ID", 2021-03-10T13:39:22.739 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:22.739 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.740 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.740 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:22.740 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.740 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.741 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.741 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.741 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.741 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.741 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.742 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.742 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "USER_PWD_EXPIRATION_SPAN": { 2021-03-10T13:39:22.742 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "USER_PWD_EXPIRATION_SPAN", 2021-03-10T13:39:22.742 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:39:22.742 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.743 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.743 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0", 2021-03-10T13:39:22.743 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.743 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.744 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.744 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.744 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.744 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.744 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.745 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.745 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "USER_PWD_EXPIRATION_WARNING_1": { 2021-03-10T13:39:22.745 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "USER_PWD_EXPIRATION_WARNING_1", 2021-03-10T13:39:22.745 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:39:22.745 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.746 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.746 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2021-03-10T13:39:22.746 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.746 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.747 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.747 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.747 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.747 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.747 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.748 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.748 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "USER_PWD_EXPIRATION_WARNING_2": { 2021-03-10T13:39:22.748 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "USER_PWD_EXPIRATION_WARNING_2", 2021-03-10T13:39:22.748 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:39:22.749 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.749 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.749 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2021-03-10T13:39:22.749 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.749 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.750 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.750 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.750 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.750 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.751 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.751 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.751 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crt_file": { 2021-03-10T13:39:22.751 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crt_file", 2021-03-10T13:39:22.751 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:22.752 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.752 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.752 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:22.752 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.752 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.753 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.753 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.753 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.753 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.754 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.754 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.754 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug": { 2021-03-10T13:39:22.754 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "debug", 2021-03-10T13:39:22.754 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:22.755 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.755 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.755 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:22.755 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.755 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.756 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.756 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Enable/disable debug options", 2021-03-10T13:39:22.756 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.756 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.757 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.757 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.757 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "jwt_token_ttl": { 2021-03-10T13:39:22.757 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "jwt_token_ttl", 2021-03-10T13:39:22.757 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:39:22.758 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.758 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.758 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "28800", 2021-03-10T13:39:22.758 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.759 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.759 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.759 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.759 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.759 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.760 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.760 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.760 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "key_file": { 2021-03-10T13:39:22.760 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "key_file", 2021-03-10T13:39:22.760 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:22.761 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.761 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.761 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:22.761 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.762 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.762 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.762 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.762 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.762 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.763 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.763 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.763 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:39:22.763 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:39:22.764 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:22.764 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.764 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.764 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:22.764 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.765 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.765 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:22.765 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:22.765 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:22.765 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:22.766 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:22.766 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:22.766 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:22.766 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:22.767 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.767 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.767 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.767 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.767 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.768 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:39:22.768 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:39:22.768 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:22.768 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.769 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.769 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:22.769 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.769 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.769 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.770 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.770 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.770 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.770 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.770 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.771 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:39:22.771 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:39:22.771 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:22.771 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.772 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.772 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:39:22.772 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.772 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.772 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:22.773 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:22.773 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:22.773 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:22.773 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:22.774 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:22.774 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:22.774 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:22.774 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.774 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.775 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.775 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.775 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.775 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:39:22.775 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:39:22.776 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:22.776 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.776 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.776 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:22.777 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.777 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.777 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.777 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.777 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.778 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.778 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.778 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.778 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "password": { 2021-03-10T13:39:22.779 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "password", 2021-03-10T13:39:22.779 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:22.779 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.779 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.779 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:22.780 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.780 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.780 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.780 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.780 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.781 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.781 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.781 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.781 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_addr": { 2021-03-10T13:39:22.782 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_addr", 2021-03-10T13:39:22.782 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:22.782 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.782 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.783 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "::", 2021-03-10T13:39:22.783 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.783 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.783 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.784 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.784 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.784 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.784 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.784 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.785 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_port": { 2021-03-10T13:39:22.785 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_port", 2021-03-10T13:39:22.785 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:39:22.785 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.786 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.786 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8080", 2021-03-10T13:39:22.786 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.786 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.786 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.787 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.787 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.787 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.787 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.788 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.788 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssl": { 2021-03-10T13:39:22.788 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssl", 2021-03-10T13:39:22.788 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:22.788 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.789 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.789 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:39:22.789 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.789 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.789 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.790 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.790 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.790 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.790 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.791 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.791 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssl_server_port": { 2021-03-10T13:39:22.791 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssl_server_port", 2021-03-10T13:39:22.791 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:39:22.791 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.792 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.792 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8443", 2021-03-10T13:39:22.792 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.792 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.792 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.793 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.793 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.793 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.793 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.794 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.794 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "standby_behaviour": { 2021-03-10T13:39:22.794 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "standby_behaviour", 2021-03-10T13:39:22.794 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:22.794 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.795 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.795 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "redirect", 2021-03-10T13:39:22.795 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.795 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.796 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:22.796 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:22.796 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "redirect" 2021-03-10T13:39:22.796 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:22.796 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.797 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.797 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.797 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.797 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.797 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "standby_error_status_code": { 2021-03-10T13:39:22.798 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "standby_error_status_code", 2021-03-10T13:39:22.798 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:39:22.798 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.798 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.799 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "500", 2021-03-10T13:39:22.799 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "400", 2021-03-10T13:39:22.799 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "599", 2021-03-10T13:39:22.799 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.799 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.800 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.800 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.800 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.800 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.800 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "url_prefix": { 2021-03-10T13:39:22.801 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "url_prefix", 2021-03-10T13:39:22.801 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:22.801 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.801 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.802 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:22.802 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.802 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.802 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.802 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.803 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.803 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.803 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.803 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.803 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "username": { 2021-03-10T13:39:22.804 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "username", 2021-03-10T13:39:22.804 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:22.804 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.804 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.805 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:22.805 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.805 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.805 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.805 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.806 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.806 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.806 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.806 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:22.806 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:22.807 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.807 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:39:22.807 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "devicehealth", 2021-03-10T13:39:22.807 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:39:22.807 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:39:22.808 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:39:22.808 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enable_monitoring": { 2021-03-10T13:39:22.808 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "enable_monitoring", 2021-03-10T13:39:22.808 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:22.808 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.809 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.809 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:39:22.809 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.809 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.810 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.810 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "monitor device health metrics", 2021-03-10T13:39:22.810 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.810 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.810 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.811 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.811 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:39:22.811 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:39:22.811 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:22.811 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.812 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.812 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:22.812 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.812 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.812 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:22.813 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:22.813 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:22.813 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:22.813 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:22.814 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:22.814 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:22.814 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:22.814 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.814 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.815 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.815 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.815 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.815 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:39:22.815 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:39:22.816 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:22.816 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.816 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.816 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:22.816 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.817 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.817 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.817 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.817 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.818 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.818 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.818 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.818 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:39:22.818 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:39:22.819 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:22.819 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.819 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.819 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:39:22.819 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.820 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.820 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:22.820 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:22.820 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:22.820 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:22.821 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:22.821 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:22.821 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:22.821 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:22.821 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.822 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.822 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.822 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.822 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.823 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:39:22.823 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:39:22.823 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:22.823 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.823 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.824 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:22.824 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.824 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.824 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.824 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.825 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.825 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.825 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.825 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.826 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mark_out_threshold": { 2021-03-10T13:39:22.826 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mark_out_threshold", 2021-03-10T13:39:22.826 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:39:22.826 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.826 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.827 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "2419200", 2021-03-10T13:39:22.827 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.827 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.827 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.827 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "automatically mark OSD if it may fail before this long", 2021-03-10T13:39:22.828 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.828 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.828 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.828 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.828 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pool_name": { 2021-03-10T13:39:22.829 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pool_name", 2021-03-10T13:39:22.829 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:22.829 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.829 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.830 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "device_health_metrics", 2021-03-10T13:39:22.830 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.830 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.830 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.830 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "name of pool in which to store device health metrics", 2021-03-10T13:39:22.831 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.831 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.831 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.831 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.831 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "retention_period": { 2021-03-10T13:39:22.832 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "retention_period", 2021-03-10T13:39:22.832 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:39:22.832 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.832 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.832 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "15552000", 2021-03-10T13:39:22.833 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.833 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.833 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.833 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how long to retain device health metrics", 2021-03-10T13:39:22.833 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.834 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.834 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.834 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.834 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "scrape_frequency": { 2021-03-10T13:39:22.834 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "scrape_frequency", 2021-03-10T13:39:22.835 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:39:22.835 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.835 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.835 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "86400", 2021-03-10T13:39:22.835 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.836 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.836 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.836 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to scrape device health metrics", 2021-03-10T13:39:22.836 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.837 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.837 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.837 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.837 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "self_heal": { 2021-03-10T13:39:22.837 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "self_heal", 2021-03-10T13:39:22.838 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:22.838 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.838 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.838 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:39:22.838 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.839 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.839 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.839 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "preemptively heal cluster around devices that may fail", 2021-03-10T13:39:22.839 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.839 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.840 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.840 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.840 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2021-03-10T13:39:22.840 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2021-03-10T13:39:22.840 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:39:22.841 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.841 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.841 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2021-03-10T13:39:22.841 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.841 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.842 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.842 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to wake up and check device health", 2021-03-10T13:39:22.842 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.842 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.843 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.843 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.843 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_threshold": { 2021-03-10T13:39:22.843 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_threshold", 2021-03-10T13:39:22.843 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:39:22.844 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.844 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.844 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "7257600", 2021-03-10T13:39:22.844 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.844 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.845 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.845 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise health warning if OSD may fail before this long", 2021-03-10T13:39:22.845 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.845 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.846 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.846 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:22.846 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:22.846 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.846 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:39:22.847 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "diskprediction_local", 2021-03-10T13:39:22.847 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:39:22.847 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:39:22.847 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:39:22.848 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:39:22.848 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:39:22.848 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:22.848 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.848 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.849 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:22.849 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.849 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.849 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:22.849 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:22.850 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:22.850 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:22.850 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:22.850 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:22.851 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:22.851 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:22.851 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.851 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.851 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.852 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.852 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.852 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:39:22.852 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:39:22.852 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:22.853 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.853 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.853 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:22.853 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.854 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.854 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.854 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.854 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.854 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.855 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.855 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.855 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:39:22.855 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:39:22.855 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:22.856 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.856 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.856 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:39:22.856 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.857 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.857 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:22.857 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:22.857 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:22.857 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:22.858 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:22.858 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:22.858 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:22.858 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:22.858 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.859 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.859 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.859 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.859 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.859 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:39:22.860 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:39:22.860 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:22.860 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.860 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.860 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:22.861 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.861 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.861 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.861 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.862 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.862 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.862 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.862 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.862 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "predict_interval": { 2021-03-10T13:39:22.863 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "predict_interval", 2021-03-10T13:39:22.863 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:22.863 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.863 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.863 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "86400", 2021-03-10T13:39:22.864 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.864 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.864 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.864 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.864 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.865 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.865 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.865 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.865 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "predictor_model": { 2021-03-10T13:39:22.865 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "predictor_model", 2021-03-10T13:39:22.866 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:22.866 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.866 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.866 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "prophetstor", 2021-03-10T13:39:22.867 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.867 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.867 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.867 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.867 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.868 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.868 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.868 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.868 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2021-03-10T13:39:22.868 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2021-03-10T13:39:22.869 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:22.869 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.869 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.869 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2021-03-10T13:39:22.870 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.870 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.870 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.870 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.870 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.871 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.871 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.871 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:22.871 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:22.871 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.872 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:39:22.872 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "influx", 2021-03-10T13:39:22.872 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": false, 2021-03-10T13:39:22.872 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "influxdb python module not found", 2021-03-10T13:39:22.872 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:39:22.873 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "batch_size": { 2021-03-10T13:39:22.873 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "batch_size", 2021-03-10T13:39:22.873 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:22.873 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.873 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.874 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5000", 2021-03-10T13:39:22.874 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.874 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.874 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.875 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.875 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.875 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.875 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.875 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.876 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "database": { 2021-03-10T13:39:22.876 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "database", 2021-03-10T13:39:22.876 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:22.876 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.876 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.877 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "ceph", 2021-03-10T13:39:22.877 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.877 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.877 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.877 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.878 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.878 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.878 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.878 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.878 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "hostname": { 2021-03-10T13:39:22.879 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "hostname", 2021-03-10T13:39:22.879 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:22.879 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.879 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.880 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T13:39:22.880 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.880 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.880 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.880 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.881 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.881 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.881 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.881 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.881 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2021-03-10T13:39:22.882 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2021-03-10T13:39:22.882 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:22.882 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.882 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.882 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "30", 2021-03-10T13:39:22.883 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.883 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.883 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.883 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.883 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.884 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.884 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.884 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.884 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:39:22.884 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:39:22.885 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:22.885 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.885 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.885 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:22.885 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.886 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.886 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:22.886 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:22.886 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:22.887 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:22.887 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:22.887 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:22.887 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:22.887 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:22.888 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.888 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.888 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.888 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.888 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.889 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:39:22.889 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:39:22.889 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:22.889 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.889 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.890 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:22.890 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.890 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.890 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.890 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.891 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.891 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.891 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.891 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.891 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:39:22.892 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:39:22.892 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:22.892 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.892 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.892 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:39:22.893 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.893 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.893 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:22.893 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:22.893 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:22.894 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:22.894 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:22.894 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:22.894 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:22.895 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:22.895 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.895 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.895 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.895 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.896 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.896 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:39:22.896 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:39:22.896 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:22.896 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.897 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.897 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:22.897 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.897 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.897 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.898 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.898 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.898 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.898 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.899 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.899 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "password": { 2021-03-10T13:39:22.899 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "password", 2021-03-10T13:39:22.899 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:22.899 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.900 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.900 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T13:39:22.900 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.900 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.900 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.901 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.901 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.901 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.901 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.901 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.902 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "port": { 2021-03-10T13:39:22.902 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "port", 2021-03-10T13:39:22.902 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:22.902 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.903 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.903 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8086", 2021-03-10T13:39:22.903 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.903 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.903 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.904 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.904 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.904 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.904 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.905 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.905 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssl": { 2021-03-10T13:39:22.905 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssl", 2021-03-10T13:39:22.905 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:22.905 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.906 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.906 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "false", 2021-03-10T13:39:22.906 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.906 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.906 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.907 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.907 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.907 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.907 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.908 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.908 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "threads": { 2021-03-10T13:39:22.908 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "threads", 2021-03-10T13:39:22.908 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:22.908 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.909 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.909 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2021-03-10T13:39:22.909 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.909 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.909 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.910 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.910 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.910 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.910 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.910 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.911 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "username": { 2021-03-10T13:39:22.911 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "username", 2021-03-10T13:39:22.911 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:22.911 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.911 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.912 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T13:39:22.912 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.912 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.912 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.913 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.913 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.913 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.913 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.913 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.914 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "verify_ssl": { 2021-03-10T13:39:22.914 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "verify_ssl", 2021-03-10T13:39:22.914 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:22.914 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.914 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.915 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "true", 2021-03-10T13:39:22.915 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.915 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.915 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.915 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.916 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.916 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.916 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.916 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:22.917 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:22.917 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.917 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:39:22.917 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "insights", 2021-03-10T13:39:22.917 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:39:22.918 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:39:22.918 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:39:22.918 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:39:22.918 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:39:22.918 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:22.919 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.919 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.919 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:22.919 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.919 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.920 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:22.920 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:22.920 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:22.920 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:22.920 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:22.921 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:22.921 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:22.921 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:22.921 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.922 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.922 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.922 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.922 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.922 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:39:22.923 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:39:22.923 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:22.923 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.923 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.924 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:22.924 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.924 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.924 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.924 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.925 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.925 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.925 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.925 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.925 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:39:22.926 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:39:22.926 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:22.926 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.926 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.926 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:39:22.927 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.927 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.927 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:22.927 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:22.928 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:22.928 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:22.928 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:22.928 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:22.928 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:22.929 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:22.929 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.929 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.929 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.929 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.930 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.930 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:39:22.930 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:39:22.930 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:22.930 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.931 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.931 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:22.931 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.931 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.931 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.932 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.932 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.932 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.932 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.932 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:22.933 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:22.933 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.933 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:39:22.933 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "iostat", 2021-03-10T13:39:22.933 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:39:22.934 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:39:22.934 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:39:22.934 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:39:22.934 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:39:22.934 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:22.935 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.935 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.935 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:22.935 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.935 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.936 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:22.936 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:22.936 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:22.936 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:22.936 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:22.937 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:22.937 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:22.937 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:22.937 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.938 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.938 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.938 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.938 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.938 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:39:22.939 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:39:22.939 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:22.939 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.939 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.939 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:22.940 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.940 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.940 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.940 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.940 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.941 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.941 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.941 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.941 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:39:22.941 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:39:22.942 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:22.942 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.942 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.942 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:39:22.943 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.943 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.943 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:22.943 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:22.943 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:22.944 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:22.944 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:22.944 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:22.944 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:22.944 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:22.945 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.945 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.945 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.945 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.945 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.946 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:39:22.946 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:39:22.946 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:22.946 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.946 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.947 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:22.947 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.947 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.947 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.947 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.948 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.948 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.948 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.948 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:22.948 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:22.949 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.949 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:39:22.949 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "k8sevents", 2021-03-10T13:39:22.949 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:39:22.949 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:39:22.950 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:39:22.950 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ceph_event_retention_days": { 2021-03-10T13:39:22.950 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ceph_event_retention_days", 2021-03-10T13:39:22.950 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:39:22.950 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.951 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.951 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "7", 2021-03-10T13:39:22.951 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.951 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.951 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.952 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Days to hold ceph event information within local cache", 2021-03-10T13:39:22.952 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.952 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.952 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.952 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.953 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "config_check_secs": { 2021-03-10T13:39:22.953 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "config_check_secs", 2021-03-10T13:39:22.953 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:39:22.953 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.953 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:22.954 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2021-03-10T13:39:22.954 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "10", 2021-03-10T13:39:22.954 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.954 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.955 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "interval (secs) to check for cluster configuration changes", 2021-03-10T13:39:22.955 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.955 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.955 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.955 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.956 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:39:22.956 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:39:22.956 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:22.956 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.956 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.957 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:22.957 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.957 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.957 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:22.957 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:22.958 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:22.958 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:22.958 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:22.958 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:22.958 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:22.959 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:22.959 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.959 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.959 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.959 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.960 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.960 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:39:22.960 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:39:22.960 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:22.960 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.961 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.961 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:22.961 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.961 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.961 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.962 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.962 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.962 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.962 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.962 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.963 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:39:22.963 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:39:22.963 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:22.963 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.964 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.964 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:39:22.964 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.964 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.964 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:22.964 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:22.965 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:22.965 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:22.965 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:22.965 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:22.965 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:22.966 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:22.966 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.966 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.966 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.967 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.967 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.967 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:39:22.967 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:39:22.967 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:22.968 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.968 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.968 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:22.968 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.968 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.969 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.969 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.969 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.969 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.969 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.969 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:22.970 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:22.970 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.970 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:39:22.970 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "localpool", 2021-03-10T13:39:22.970 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:39:22.971 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:39:22.971 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:39:22.971 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "failure_domain": { 2021-03-10T13:39:22.971 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "failure_domain", 2021-03-10T13:39:22.971 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:22.972 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.972 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.972 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "host", 2021-03-10T13:39:22.972 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.972 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.973 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.973 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "failure domain for any created local pool", 2021-03-10T13:39:22.973 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.973 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.973 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.973 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.974 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:39:22.974 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:39:22.974 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:22.974 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.975 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.975 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:22.975 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.975 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.975 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:22.975 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:22.976 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:22.976 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:22.976 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:22.976 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:22.976 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:22.977 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:22.977 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.977 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.977 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.978 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.978 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.978 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:39:22.978 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:39:22.978 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:22.979 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.979 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.979 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:22.979 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.979 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.980 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.980 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.980 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.980 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.980 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.981 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.981 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:39:22.981 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:39:22.981 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:22.981 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.982 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.982 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:39:22.982 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.982 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.982 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:22.983 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:22.983 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:22.983 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:22.983 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:22.983 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:22.984 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:22.984 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:22.984 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.984 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.984 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.985 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.985 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.985 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:39:22.985 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:39:22.985 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:22.986 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.986 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.986 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:22.986 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.987 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.987 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.987 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:22.987 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.987 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.988 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.988 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.988 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_size": { 2021-03-10T13:39:22.988 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "min_size", 2021-03-10T13:39:22.988 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:39:22.989 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.989 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.989 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:22.989 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.989 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.990 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.990 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "default min_size for any created local pool", 2021-03-10T13:39:22.990 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.990 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.990 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.991 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.991 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_rep": { 2021-03-10T13:39:22.991 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "num_rep", 2021-03-10T13:39:22.991 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:39:22.991 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.992 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.992 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "3", 2021-03-10T13:39:22.992 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.992 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.993 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.993 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "default replica count for any created local pool", 2021-03-10T13:39:22.993 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.993 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.993 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.994 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.994 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pg_num": { 2021-03-10T13:39:22.994 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pg_num", 2021-03-10T13:39:22.994 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:39:22.994 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.995 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.995 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "128", 2021-03-10T13:39:22.995 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.995 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.995 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.996 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "default pg_num for any created local pool", 2021-03-10T13:39:22.996 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.996 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.996 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.996 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:22.997 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "prefix": { 2021-03-10T13:39:22.997 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "prefix", 2021-03-10T13:39:22.997 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:22.997 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:22.997 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:22.998 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:22.998 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:22.998 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:22.998 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:22.999 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "name prefix for any created local pool", 2021-03-10T13:39:22.999 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:22.999 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:22.999 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:22.999 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.000 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "subtree": { 2021-03-10T13:39:23.000 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "subtree", 2021-03-10T13:39:23.000 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:23.000 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.000 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:23.001 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "rack", 2021-03-10T13:39:23.001 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.001 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.001 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:23.001 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "CRUSH level for which to create a local pool", 2021-03-10T13:39:23.002 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.002 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.002 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.002 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:23.003 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:23.003 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.003 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:39:23.003 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "orchestrator", 2021-03-10T13:39:23.003 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:39:23.004 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:39:23.004 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:39:23.004 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:39:23.004 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:39:23.004 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:23.005 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.005 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:23.005 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:23.005 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.005 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.006 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:23.006 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:23.006 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:23.006 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:23.006 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:23.007 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:23.007 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:23.007 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:23.007 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.007 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.008 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.008 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.008 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.008 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:39:23.009 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:39:23.009 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:23.009 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.009 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:23.009 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:23.010 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.010 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.010 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:23.010 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.010 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.011 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.011 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.011 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.011 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:39:23.011 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:39:23.012 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:23.012 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.012 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:23.012 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:39:23.012 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.013 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.013 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:23.013 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:23.013 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:23.014 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:23.014 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:23.014 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:23.014 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:23.014 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:23.015 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.015 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.015 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.015 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.015 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.016 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:39:23.016 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:39:23.016 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:23.016 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.016 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:23.017 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:23.017 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.017 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.017 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:23.018 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.018 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.018 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.018 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.018 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.019 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "orchestrator": { 2021-03-10T13:39:23.019 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "orchestrator", 2021-03-10T13:39:23.019 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:23.019 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.019 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:23.020 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T13:39:23.020 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.020 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.020 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:23.020 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "cephadm", 2021-03-10T13:39:23.021 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rook", 2021-03-10T13:39:23.021 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "test_orchestrator" 2021-03-10T13:39:23.021 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:23.021 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Orchestrator backend", 2021-03-10T13:39:23.021 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.022 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.022 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.022 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:23.022 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:23.023 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.023 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:39:23.023 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "osd_support", 2021-03-10T13:39:23.023 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:39:23.023 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:39:23.024 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:39:23.024 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:39:23.024 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:39:23.024 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:23.024 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.025 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:23.025 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:23.025 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.025 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.026 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:23.026 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:23.026 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:23.026 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:23.026 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:23.027 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:23.027 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:23.027 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:23.027 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.027 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.028 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.028 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.028 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.028 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:39:23.028 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:39:23.029 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:23.029 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.029 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:23.029 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:23.030 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.030 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.030 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:23.030 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.030 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.031 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.031 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.031 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.031 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:39:23.031 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:39:23.032 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:23.032 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.032 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:23.032 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:39:23.032 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.033 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.033 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:23.033 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:23.033 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:23.034 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:23.034 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:23.034 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:23.034 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:23.034 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:23.035 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.035 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.035 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.035 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.035 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.036 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:39:23.036 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:39:23.036 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:23.036 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.036 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:23.037 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:23.037 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.037 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.037 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:23.038 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.038 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.038 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.038 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.038 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:23.039 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:23.039 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.039 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:39:23.039 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pg_autoscaler", 2021-03-10T13:39:23.039 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:39:23.040 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:39:23.040 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:39:23.040 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:39:23.040 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:39:23.040 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:23.041 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.041 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:23.041 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:23.041 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.041 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.042 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:23.042 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:23.042 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:23.042 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:23.043 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:23.043 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:23.043 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:23.043 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:23.043 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.044 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.044 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.044 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.044 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.044 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:39:23.045 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:39:23.045 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:23.045 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.045 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:23.045 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:23.046 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.046 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.046 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:23.046 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.046 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.047 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.047 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.047 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.047 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:39:23.047 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:39:23.048 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:23.048 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.048 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:23.048 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:39:23.049 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.049 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.049 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:23.049 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:23.049 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:23.050 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:23.050 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:23.050 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:23.050 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:23.050 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:23.051 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.051 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.051 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.051 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.051 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.052 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:39:23.052 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:39:23.052 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:23.052 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.052 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:23.053 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:23.053 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.053 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.053 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:23.053 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.054 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.054 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.054 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.054 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.055 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2021-03-10T13:39:23.055 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2021-03-10T13:39:23.055 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:23.055 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.055 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:23.055 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2021-03-10T13:39:23.056 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.056 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.056 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:23.056 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.057 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.057 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.057 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.057 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:23.057 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:23.058 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.058 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:39:23.058 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "progress", 2021-03-10T13:39:23.058 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:39:23.058 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:39:23.059 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:39:23.059 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:39:23.059 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:39:23.059 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:23.059 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.060 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:23.060 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:23.060 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.060 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.060 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:23.061 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:23.061 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:23.061 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:23.061 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:23.061 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:23.062 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:23.062 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:23.062 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.062 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.062 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.063 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.063 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.063 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:39:23.063 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:39:23.063 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:23.064 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.064 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:23.064 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:23.064 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.064 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.065 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:23.065 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.065 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.065 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.065 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.066 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.066 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:39:23.066 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:39:23.066 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:23.066 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.067 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:23.067 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:39:23.067 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.067 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.067 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:23.068 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:23.068 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:23.068 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:23.068 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:23.068 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:23.069 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:23.069 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:23.069 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.069 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.069 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.070 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.070 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.070 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:39:23.070 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:39:23.070 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:23.071 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.071 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:23.071 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:23.071 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.071 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.072 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:23.072 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.072 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.072 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.072 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.073 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.073 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max_completed_events": { 2021-03-10T13:39:23.073 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "max_completed_events", 2021-03-10T13:39:23.073 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:39:23.073 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.074 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:23.074 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "50", 2021-03-10T13:39:23.074 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.074 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.074 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:23.075 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "number of past completed events to remember", 2021-03-10T13:39:23.075 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.075 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.075 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.076 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.076 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "persist_interval": { 2021-03-10T13:39:23.076 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "persist_interval", 2021-03-10T13:39:23.076 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:39:23.076 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.077 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:23.077 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2021-03-10T13:39:23.077 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.077 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.077 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:23.078 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to persist completed events", 2021-03-10T13:39:23.078 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.078 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.078 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.078 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:23.079 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:23.079 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.079 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:39:23.079 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "prometheus", 2021-03-10T13:39:23.079 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:39:23.080 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:39:23.080 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:39:23.080 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:39:23.080 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:39:23.080 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:23.081 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.081 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:23.081 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:23.081 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.081 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.081 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:23.082 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:23.082 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:23.082 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:23.082 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:23.083 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:23.083 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:23.083 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:23.083 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.083 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.084 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.084 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.084 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.084 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:39:23.084 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:39:23.084 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:23.085 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.085 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:23.085 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:23.085 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.086 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.086 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:23.086 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.086 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.086 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.087 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.087 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.087 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:39:23.087 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:39:23.087 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:23.088 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.088 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:23.088 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:39:23.088 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.088 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.089 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:23.089 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:23.089 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:23.089 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:23.089 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:23.090 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:23.090 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:23.090 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:23.090 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.090 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.091 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.091 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.091 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.091 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:39:23.091 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:39:23.091 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:23.092 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.092 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:23.092 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:23.092 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.092 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.093 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:23.093 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.093 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.093 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.093 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.094 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.094 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_stats_pools": { 2021-03-10T13:39:23.094 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rbd_stats_pools", 2021-03-10T13:39:23.094 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:23.094 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.095 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:23.095 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:23.095 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.095 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.095 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:23.096 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.096 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.096 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.096 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.096 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.097 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_stats_pools_refresh_interval": { 2021-03-10T13:39:23.097 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rbd_stats_pools_refresh_interval", 2021-03-10T13:39:23.097 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:23.097 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.097 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:23.098 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:23.098 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.098 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.098 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:23.098 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.099 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.099 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.099 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.099 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.099 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "scrape_interval": { 2021-03-10T13:39:23.100 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "scrape_interval", 2021-03-10T13:39:23.100 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:23.100 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.100 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:23.100 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:23.101 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.101 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.101 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:23.101 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.101 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.102 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.102 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.102 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.102 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_addr": { 2021-03-10T13:39:23.102 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_addr", 2021-03-10T13:39:23.103 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:23.103 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.103 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:23.103 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:23.103 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.104 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.104 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:23.104 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.104 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.104 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.105 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.105 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.105 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_port": { 2021-03-10T13:39:23.105 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_port", 2021-03-10T13:39:23.105 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:23.106 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.106 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:23.106 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:23.106 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.106 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.107 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:23.107 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.107 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.107 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.107 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.108 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:23.108 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:23.108 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.108 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:39:23.108 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rbd_support", 2021-03-10T13:39:23.108 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:39:23.109 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:39:23.109 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:39:23.109 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:39:23.109 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:39:23.109 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:23.110 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.110 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:23.110 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:23.110 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.110 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.111 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:23.111 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:23.111 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:23.111 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:23.111 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:23.112 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:23.112 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:23.112 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:23.112 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.112 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.113 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.113 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.113 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.113 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:39:23.113 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:39:23.114 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:23.114 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.114 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:23.114 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:23.114 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.115 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.115 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:23.115 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.115 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.116 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.116 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.116 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.116 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:39:23.116 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:39:23.117 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:23.117 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.117 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:23.117 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:39:23.117 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.118 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.118 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:23.118 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:23.118 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:23.118 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:23.119 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:23.119 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:23.119 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:23.119 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:23.119 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.120 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.120 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.120 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.120 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.120 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:39:23.121 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:39:23.121 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:23.121 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.121 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:23.121 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:23.122 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.122 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.122 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:23.122 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.122 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.123 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.123 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.123 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.123 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mirror_snapshot_schedule": { 2021-03-10T13:39:23.123 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mirror_snapshot_schedule", 2021-03-10T13:39:23.124 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:23.124 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.124 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:23.124 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:23.124 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.125 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.125 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:23.125 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.125 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.125 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.126 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.126 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.126 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "trash_purge_schedule": { 2021-03-10T13:39:23.126 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "trash_purge_schedule", 2021-03-10T13:39:23.126 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:23.127 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.127 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:23.127 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:23.127 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.127 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.128 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:23.128 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.128 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.128 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.128 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.129 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:23.129 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:23.129 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.129 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:39:23.129 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "restful", 2021-03-10T13:39:23.130 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:39:23.130 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:39:23.130 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:39:23.130 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "key_file": { 2021-03-10T13:39:23.130 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "key_file", 2021-03-10T13:39:23.131 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:23.131 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.131 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:23.131 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:23.131 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.132 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.132 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:23.132 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.132 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.132 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.133 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.133 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.133 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:39:23.133 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:39:23.133 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:23.134 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.134 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:23.134 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:23.134 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.134 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.135 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:23.135 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:23.135 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:23.135 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:23.135 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:23.136 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:23.136 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:23.136 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:23.136 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.136 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.137 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.137 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.137 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.137 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:39:23.137 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:39:23.138 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:23.138 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.138 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:23.138 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:23.138 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.139 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.139 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:23.139 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.139 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.139 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.140 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.140 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.140 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:39:23.140 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:39:23.140 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:23.141 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.141 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:23.141 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:39:23.141 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.141 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.142 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:23.142 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:23.142 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:23.142 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:23.142 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:23.143 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:23.143 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:23.143 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:23.143 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.143 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.143 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.144 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.144 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.144 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:39:23.144 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:39:23.144 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:23.145 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.145 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:23.145 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:23.145 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.145 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.146 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:23.146 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.146 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.146 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.146 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.147 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.147 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_addr": { 2021-03-10T13:39:23.147 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_addr", 2021-03-10T13:39:23.147 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:23.147 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.148 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:23.148 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:23.148 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.148 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.148 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:23.149 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.149 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.149 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.149 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.149 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.150 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_port": { 2021-03-10T13:39:23.150 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_port", 2021-03-10T13:39:23.150 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:23.150 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.150 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:23.151 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:23.151 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.151 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.151 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:23.151 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.152 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.152 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.152 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.152 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:23.152 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:23.153 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.153 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:39:23.153 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rook", 2021-03-10T13:39:23.153 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:39:23.153 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:39:23.154 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:39:23.154 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:39:23.154 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:39:23.154 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:23.154 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.155 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:23.155 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:23.155 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.155 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.155 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:23.156 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:23.156 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:23.156 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:23.156 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:23.156 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:23.157 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:23.157 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:23.157 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.157 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.157 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.158 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.158 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.158 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:39:23.158 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:39:23.158 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:23.159 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.159 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:23.159 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:23.159 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.159 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.160 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:23.160 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.160 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.160 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.160 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.161 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.161 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:39:23.161 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:39:23.161 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:23.161 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.162 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:23.162 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:39:23.162 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.162 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.162 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:23.163 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:23.163 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:23.163 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:23.163 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:23.163 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:23.164 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:23.164 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:23.164 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.164 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.164 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.165 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.165 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.165 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:39:23.165 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:39:23.165 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:23.166 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.166 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:23.166 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:23.166 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.166 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.167 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:23.167 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.167 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.167 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.167 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.168 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:23.168 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:23.168 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.168 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:39:23.168 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "selftest", 2021-03-10T13:39:23.169 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:39:23.169 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:39:23.169 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:39:23.169 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:39:23.169 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:39:23.170 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:23.170 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.170 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:23.170 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:23.170 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.170 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.171 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:23.171 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:23.171 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:23.171 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:23.171 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:23.172 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:23.172 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:23.172 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:23.172 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.172 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.173 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.173 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.173 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.173 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:39:23.173 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:39:23.174 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:23.174 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.174 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:23.174 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:23.175 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.175 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.175 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:23.175 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.176 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.176 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.176 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.176 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.177 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:39:23.177 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:39:23.177 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:23.177 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.177 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:23.178 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:39:23.178 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.178 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.178 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:23.179 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:23.179 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:23.179 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:23.179 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:23.179 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:23.180 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:23.180 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:23.180 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.180 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.180 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.181 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.181 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.181 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:39:23.181 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:39:23.181 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:23.182 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.182 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:23.182 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:23.182 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.183 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.183 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:23.183 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.184 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.184 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.184 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.184 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.184 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "roption1": { 2021-03-10T13:39:23.185 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "roption1", 2021-03-10T13:39:23.185 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:23.185 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.185 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:23.185 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:23.186 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.186 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.186 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:23.186 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.187 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.187 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.187 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.187 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.187 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "roption2": { 2021-03-10T13:39:23.188 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "roption2", 2021-03-10T13:39:23.188 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:23.188 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.188 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:23.189 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "xyz", 2021-03-10T13:39:23.189 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.189 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.189 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:23.189 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.190 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.190 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.190 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.190 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.191 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption1": { 2021-03-10T13:39:23.191 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption1", 2021-03-10T13:39:23.191 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:23.191 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.191 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:23.192 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:23.192 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.192 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.192 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:23.192 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.193 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.193 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.193 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.193 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.194 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption2": { 2021-03-10T13:39:23.194 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption2", 2021-03-10T13:39:23.194 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:39:23.194 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.194 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:23.195 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:23.195 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.195 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.195 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:23.196 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.196 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.196 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.196 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.196 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.197 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption3": { 2021-03-10T13:39:23.197 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption3", 2021-03-10T13:39:23.197 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "float", 2021-03-10T13:39:23.197 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.198 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:23.198 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:23.198 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.198 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.198 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:23.199 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.199 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.199 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.199 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.199 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.200 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption4": { 2021-03-10T13:39:23.200 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption4", 2021-03-10T13:39:23.200 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:23.200 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.201 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:23.201 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:23.201 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.201 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.201 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:23.202 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.202 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.202 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.202 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.203 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.203 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption5": { 2021-03-10T13:39:23.203 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption5", 2021-03-10T13:39:23.203 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:23.203 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.204 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:23.204 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:23.204 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.204 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.205 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:23.205 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.205 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.205 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.205 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.206 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.206 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption6": { 2021-03-10T13:39:23.206 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption6", 2021-03-10T13:39:23.206 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:23.206 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.207 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:23.207 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:39:23.207 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.207 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.208 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:23.208 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.208 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.208 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.208 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.209 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.209 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "testkey": { 2021-03-10T13:39:23.209 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "testkey", 2021-03-10T13:39:23.209 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:23.209 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.210 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:23.210 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:23.210 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.210 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.211 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:23.211 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.211 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.211 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.211 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.212 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.212 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "testlkey": { 2021-03-10T13:39:23.212 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "testlkey", 2021-03-10T13:39:23.212 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:23.213 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.213 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:23.213 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:23.213 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.213 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.214 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:23.214 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.214 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.214 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.214 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.215 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.215 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "testnewline": { 2021-03-10T13:39:23.215 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "testnewline", 2021-03-10T13:39:23.215 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:23.216 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.216 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:23.216 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:23.216 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.216 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.217 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:23.217 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.217 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.217 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.218 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.218 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:23.218 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:23.218 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.218 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:39:23.219 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "status", 2021-03-10T13:39:23.219 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:39:23.219 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:39:23.219 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:39:23.220 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:39:23.220 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:39:23.220 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:23.220 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.220 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:23.221 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:23.221 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.221 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.221 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:23.222 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:23.222 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:23.222 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:23.222 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:23.222 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:23.223 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:23.223 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:23.223 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.223 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.224 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.224 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.224 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.224 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:39:23.224 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:39:23.225 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:23.225 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.225 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:23.225 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:23.226 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.226 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.226 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:23.226 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.226 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.227 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.227 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.227 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.227 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:39:23.227 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:39:23.228 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:23.228 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.228 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:23.228 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:39:23.229 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.229 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.229 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:23.229 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:23.229 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:23.230 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:23.230 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:23.230 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:23.230 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:23.231 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:23.231 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.231 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.231 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.231 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.232 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.232 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:39:23.232 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:39:23.232 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:23.233 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.233 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:23.233 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:23.233 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.233 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.234 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:23.234 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.234 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.234 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.234 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.235 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:23.235 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:23.235 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.235 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:39:23.236 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "telegraf", 2021-03-10T13:39:23.236 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:39:23.236 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:39:23.236 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:39:23.236 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "address": { 2021-03-10T13:39:23.237 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "address", 2021-03-10T13:39:23.237 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:23.237 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.237 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:23.238 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "unixgram:///tmp/telegraf.sock", 2021-03-10T13:39:23.238 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.238 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.238 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:23.238 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.239 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.239 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.239 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.239 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.239 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2021-03-10T13:39:23.240 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2021-03-10T13:39:23.240 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:39:23.240 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.240 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:23.241 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "15", 2021-03-10T13:39:23.241 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.241 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.241 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:23.241 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.242 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.242 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.242 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.242 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.243 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:39:23.243 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:39:23.243 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:23.243 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.243 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:23.244 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:23.244 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.244 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.244 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:23.244 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:23.245 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:23.245 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:23.245 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:23.245 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:23.246 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:23.246 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:23.246 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.246 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.246 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.247 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.247 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.247 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:39:23.247 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:39:23.248 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:23.248 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.248 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:23.248 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:23.248 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.249 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.249 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:23.249 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.249 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.249 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.250 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.250 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.250 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:39:23.250 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:39:23.251 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:23.251 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.251 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:23.251 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:39:23.252 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.252 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.252 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:23.252 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:23.252 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:23.253 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:23.253 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:23.253 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:23.253 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:23.253 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:23.254 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.254 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.254 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.254 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.255 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.255 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:39:23.255 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:39:23.255 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:23.255 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.256 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:23.256 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:23.256 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.256 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.257 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:23.257 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.257 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.257 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.257 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.258 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:23.258 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:23.258 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.258 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:39:23.259 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "telemetry", 2021-03-10T13:39:23.259 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:39:23.259 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:39:23.259 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:39:23.260 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_basic": { 2021-03-10T13:39:23.260 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_basic", 2021-03-10T13:39:23.260 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:23.260 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.260 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:23.261 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:39:23.261 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.261 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.261 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:23.262 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Share basic cluster information (size, version)", 2021-03-10T13:39:23.262 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.262 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.262 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.263 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.263 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_crash": { 2021-03-10T13:39:23.263 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_crash", 2021-03-10T13:39:23.263 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:23.263 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.264 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:23.264 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:39:23.264 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.264 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.265 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:23.265 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.265 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.265 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.265 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.266 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.266 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_device": { 2021-03-10T13:39:23.266 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_device", 2021-03-10T13:39:23.266 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:23.267 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.267 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:23.267 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:39:23.267 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.267 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.268 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:23.268 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.268 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.268 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.269 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.269 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.269 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_ident": { 2021-03-10T13:39:23.269 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_ident", 2021-03-10T13:39:23.269 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:23.270 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.270 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:23.270 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:23.270 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.271 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.271 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:23.271 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.271 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.271 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.272 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.272 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.272 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "contact": { 2021-03-10T13:39:23.272 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "contact", 2021-03-10T13:39:23.273 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:23.273 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.273 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:23.273 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T13:39:23.273 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.274 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.274 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:23.274 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.274 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.275 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.275 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.275 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.275 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "description": { 2021-03-10T13:39:23.275 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "description", 2021-03-10T13:39:23.276 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:23.276 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.276 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:23.276 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T13:39:23.277 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.277 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.277 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:23.277 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.277 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.278 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.278 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.278 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.278 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "device_url": { 2021-03-10T13:39:23.279 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "device_url", 2021-03-10T13:39:23.279 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:23.279 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.279 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:23.279 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "https://telemetry.ceph.com/device", 2021-03-10T13:39:23.280 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.280 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.280 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:23.280 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.281 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.281 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.281 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.281 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.281 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enabled": { 2021-03-10T13:39:23.282 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "enabled", 2021-03-10T13:39:23.282 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:23.282 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.282 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:23.283 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:23.283 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.283 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.283 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:23.283 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.284 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.284 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.284 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.284 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.285 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2021-03-10T13:39:23.285 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2021-03-10T13:39:23.285 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:39:23.285 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.285 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:23.286 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "24", 2021-03-10T13:39:23.286 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "8", 2021-03-10T13:39:23.286 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.286 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:23.287 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.287 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.287 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.287 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.287 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.288 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "last_opt_revision": { 2021-03-10T13:39:23.288 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "last_opt_revision", 2021-03-10T13:39:23.288 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:39:23.288 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.289 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:23.289 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "1", 2021-03-10T13:39:23.289 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.289 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.289 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:23.290 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.290 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.290 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.290 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.291 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.291 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "leaderboard": { 2021-03-10T13:39:23.291 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "leaderboard", 2021-03-10T13:39:23.291 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:23.291 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.292 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:23.292 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:23.292 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.292 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.293 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:23.293 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.293 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.293 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.293 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.294 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.294 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:39:23.294 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:39:23.294 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:23.295 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.295 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:23.295 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:23.295 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.295 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.296 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:23.296 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:23.296 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:23.296 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:23.297 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:23.297 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:23.297 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:23.297 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:23.297 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.298 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.298 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.298 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.298 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.299 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:39:23.299 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:39:23.299 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:23.299 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.299 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:23.300 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:23.300 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.300 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.300 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:23.300 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.301 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.301 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.301 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.301 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.302 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:39:23.302 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:39:23.302 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:23.302 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.302 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:23.303 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:39:23.303 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.303 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.303 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:23.304 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:23.304 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:23.304 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:23.304 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:23.304 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:23.305 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:23.305 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:23.305 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.305 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.306 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.306 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.306 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.306 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:39:23.306 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:39:23.307 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:23.307 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.307 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:23.307 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:23.308 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.308 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.308 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:23.308 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.308 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.309 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.309 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.309 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.309 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "organization": { 2021-03-10T13:39:23.310 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "organization", 2021-03-10T13:39:23.310 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:23.310 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.310 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:23.310 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T13:39:23.311 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.311 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.311 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:23.311 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.312 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.312 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.312 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.312 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.312 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "proxy": { 2021-03-10T13:39:23.313 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "proxy", 2021-03-10T13:39:23.313 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:23.313 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.313 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:23.314 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T13:39:23.314 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.314 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.314 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:23.315 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.315 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.315 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.315 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.315 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.316 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "url": { 2021-03-10T13:39:23.316 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "url", 2021-03-10T13:39:23.316 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:23.316 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.316 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:23.317 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "https://telemetry.ceph.com/report", 2021-03-10T13:39:23.317 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.317 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.317 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:23.318 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.318 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.318 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.318 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.318 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:23.319 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:23.319 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.319 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:39:23.319 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "test_orchestrator", 2021-03-10T13:39:23.320 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:39:23.320 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:39:23.320 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:39:23.320 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:39:23.320 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:39:23.321 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:23.321 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.321 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:23.321 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:23.321 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.322 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.322 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:23.322 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:23.322 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:23.323 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:23.323 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:23.323 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:23.323 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:23.323 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:23.324 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.324 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.324 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.324 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.325 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.325 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:39:23.325 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:39:23.325 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:23.326 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.326 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:23.326 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:23.326 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.326 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.327 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:23.327 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.327 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.327 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.328 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.328 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.328 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:39:23.328 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:39:23.328 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:23.329 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.329 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:23.329 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:39:23.329 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.330 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.330 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:23.330 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:23.330 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:23.330 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:23.331 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:23.331 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:23.331 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:23.331 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:23.331 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.332 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.332 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.332 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.332 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.333 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:39:23.333 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:39:23.333 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:23.333 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.333 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:23.334 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:23.334 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.334 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.334 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:23.335 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.335 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.335 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.335 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.335 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:23.336 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:23.336 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.336 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:39:23.336 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "volumes", 2021-03-10T13:39:23.336 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:39:23.337 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:39:23.337 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:39:23.337 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:39:23.337 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:39:23.338 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:23.338 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.338 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:23.338 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:23.338 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.339 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.339 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:23.339 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:23.339 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:23.339 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:23.340 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:23.340 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:23.340 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:23.340 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:23.341 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.341 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.341 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.341 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.341 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.342 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:39:23.342 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:39:23.342 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:23.342 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.343 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:23.343 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:23.343 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.343 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.343 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:23.344 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.344 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.344 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.344 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.344 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.345 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:39:23.345 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:39:23.345 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:23.345 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.346 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:23.346 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:39:23.346 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.346 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.346 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:23.347 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:23.347 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:23.347 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:23.347 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:23.348 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:23.348 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:23.348 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:23.348 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.348 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.349 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.349 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.349 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.349 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:39:23.350 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:39:23.350 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:23.350 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.350 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:23.350 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:23.351 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.351 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.351 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:23.351 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.351 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.352 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.352 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.352 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:23.352 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:23.353 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.353 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:39:23.353 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix", 2021-03-10T13:39:23.353 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:39:23.353 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:39:23.354 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:39:23.354 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "discovery_interval": { 2021-03-10T13:39:23.354 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "discovery_interval", 2021-03-10T13:39:23.354 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:23.355 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.355 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:23.355 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "100", 2021-03-10T13:39:23.355 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.355 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.356 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:23.356 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.356 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.356 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.357 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.357 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.357 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "identifier": { 2021-03-10T13:39:23.357 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "identifier", 2021-03-10T13:39:23.357 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:23.358 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.358 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:23.358 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:23.358 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.359 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.359 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:23.359 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.359 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.359 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.360 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.360 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.360 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2021-03-10T13:39:23.360 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2021-03-10T13:39:23.360 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:39:23.361 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.361 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:23.361 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2021-03-10T13:39:23.361 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.362 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.362 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:23.362 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.362 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.362 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.363 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.363 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.363 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:39:23.363 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:39:23.363 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:23.364 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.364 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:23.364 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:39:23.364 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.365 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.365 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:23.365 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:23.365 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:23.365 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:23.366 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:23.366 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:23.366 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:23.366 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:23.367 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.367 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.367 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.367 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.367 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.368 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:39:23.368 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:39:23.368 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:23.368 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.369 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:23.369 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:23.369 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.369 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.369 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:23.370 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.370 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.370 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.370 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.370 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.371 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:39:23.371 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:39:23.371 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:23.371 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.372 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:23.372 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:39:23.372 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.372 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.372 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:39:23.373 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:39:23.373 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:39:23.373 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:39:23.373 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:39:23.374 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:39:23.374 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:39:23.374 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:23.374 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.374 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.375 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.375 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.375 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.375 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:39:23.375 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:39:23.376 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:39:23.376 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.376 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:39:23.376 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:39:23.377 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.377 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.377 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:23.377 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.377 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.378 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.378 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.378 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.378 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "zabbix_host": { 2021-03-10T13:39:23.379 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix_host", 2021-03-10T13:39:23.379 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:23.379 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.379 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:23.379 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T13:39:23.380 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.380 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.380 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:23.380 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.381 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.381 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.381 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.381 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.381 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "zabbix_port": { 2021-03-10T13:39:23.382 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix_port", 2021-03-10T13:39:23.382 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:39:23.382 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.382 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:23.383 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10051", 2021-03-10T13:39:23.383 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.383 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.383 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:23.383 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.384 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.384 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.384 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.384 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.385 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "zabbix_sender": { 2021-03-10T13:39:23.385 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix_sender", 2021-03-10T13:39:23.385 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:39:23.385 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:39:23.385 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:39:23.386 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "/usr/bin/zabbix_sender", 2021-03-10T13:39:23.386 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:39:23.386 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:39:23.386 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:39:23.387 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:39:23.387 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:39:23.387 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:39:23.387 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:39:23.387 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:23.388 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:23.388 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:23.388 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:23.388 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {}, 2021-03-10T13:39:23.388 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "always_on_modules": { 2021-03-10T13:39:23.389 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nautilus": [ 2021-03-10T13:39:23.389 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "balancer", 2021-03-10T13:39:23.389 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crash", 2021-03-10T13:39:23.389 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "devicehealth", 2021-03-10T13:39:23.390 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "orchestrator_cli", 2021-03-10T13:39:23.390 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress", 2021-03-10T13:39:23.390 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_support", 2021-03-10T13:39:23.390 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status", 2021-03-10T13:39:23.390 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "volumes" 2021-03-10T13:39:23.391 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:23.391 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "octopus": [ 2021-03-10T13:39:23.391 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "balancer", 2021-03-10T13:39:23.391 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crash", 2021-03-10T13:39:23.392 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "devicehealth", 2021-03-10T13:39:23.392 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "orchestrator", 2021-03-10T13:39:23.392 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_support", 2021-03-10T13:39:23.392 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pg_autoscaler", 2021-03-10T13:39:23.392 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress", 2021-03-10T13:39:23.393 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_support", 2021-03-10T13:39:23.393 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status", 2021-03-10T13:39:23.393 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "telemetry", 2021-03-10T13:39:23.393 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "volumes" 2021-03-10T13:39:23.394 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:39:23.394 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "last_failure_osd_epoch": 4, 2021-03-10T13:39:23.394 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_clients": [ 2021-03-10T13:39:23.394 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:39:23.394 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2021-03-10T13:39:23.395 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:39:23.395 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2021-03-10T13:39:23.395 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.2.115:0", 2021-03-10T13:39:23.395 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 3537681212 2021-03-10T13:39:23.396 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:23.396 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2021-03-10T13:39:23.396 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.396 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:39:23.396 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2021-03-10T13:39:23.397 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:39:23.397 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2021-03-10T13:39:23.397 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.2.115:0", 2021-03-10T13:39:23.397 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 1426333611 2021-03-10T13:39:23.397 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:23.398 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2021-03-10T13:39:23.398 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:39:23.398 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:39:23.398 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2021-03-10T13:39:23.399 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:39:23.399 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2021-03-10T13:39:23.399 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.2.115:0", 2021-03-10T13:39:23.399 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 4136771330 2021-03-10T13:39:23.399 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:23.400 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2021-03-10T13:39:23.400 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:23.400 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2021-03-10T13:39:23.400 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:23.401 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:23.401 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:22 gibba015 bash[9806]: audit 2021-03-10T13:39:22.004305+0000 mon.a (mon.0) 70 : audit [DBG] from='client.? 172.21.2.115:0/1439784093' entity='client.admin' cmd=[{"prefix": "mgr dump"}]: dispatch 2021-03-10T13:39:23.402 INFO:teuthology.orchestra.run.gibba015.stderr:INFO:cephadm:Waiting for the mgr to restart... 2021-03-10T13:39:23.402 INFO:teuthology.orchestra.run.gibba015.stderr:INFO:cephadm:Waiting for Mgr epoch 9... 2021-03-10T13:39:23.402 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba015', '-v', '/var/log/ceph/e4a642d2-81a5-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmp3221digx:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpygecn9iw:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'tell', 'mgr', 'mgr_status'] 2021-03-10T13:39:23.403 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba015 -v /var/log/ceph/e4a642d2-81a5-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp3221digx:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpygecn9iw:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 tell mgr mgr_status 2021-03-10T13:39:23.472 INFO:journalctl@ceph.mgr.y.gibba015.stdout:Mar 10 13:39:23 gibba015 bash[10036]: Warning: Permanently added 'gibba015,172.21.2.115' (ECDSA) to the list of known hosts. 2021-03-10T13:39:23.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:23 gibba015 bash[9806]: cluster 2021-03-10T13:39:22.850156+0000 mon.a (mon.0) 71 : cluster [INF] Active manager daemon y restarted 2021-03-10T13:39:23.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:23 gibba015 bash[9806]: cluster 2021-03-10T13:39:22.850552+0000 mon.a (mon.0) 72 : cluster [INF] Activating manager daemon y 2021-03-10T13:39:23.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:23 gibba015 bash[9806]: cluster 2021-03-10T13:39:22.852110+0000 mon.a (mon.0) 73 : cluster [DBG] osdmap e5: 0 total, 0 up, 0 in 2021-03-10T13:39:24.072 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:39:24.073 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mgrmap_epoch": 11, 2021-03-10T13:39:24.073 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "initialized": true 2021-03-10T13:39:24.073 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:39:24.421 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:24 gibba015 bash[9806]: cluster 2021-03-10T13:39:23.055669+0000 mon.a (mon.0) 74 : cluster [DBG] mgrmap e10: y(active, starting, since 0.205155s) 2021-03-10T13:39:24.421 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:24 gibba015 bash[9806]: audit 2021-03-10T13:39:23.060205+0000 mon.a (mon.0) 75 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-03-10T13:39:24.422 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:24 gibba015 bash[9806]: audit 2021-03-10T13:39:23.062458+0000 mon.a (mon.0) 76 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-03-10T13:39:24.422 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:24 gibba015 bash[9806]: audit 2021-03-10T13:39:23.062855+0000 mon.a (mon.0) 77 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-03-10T13:39:24.422 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:24 gibba015 bash[9806]: audit 2021-03-10T13:39:23.063229+0000 mon.a (mon.0) 78 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-03-10T13:39:24.422 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:24 gibba015 bash[9806]: audit 2021-03-10T13:39:23.064716+0000 mon.a (mon.0) 79 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2021-03-10T13:39:24.423 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:24 gibba015 bash[9806]: audit 2021-03-10T13:39:23.067450+0000 mon.a (mon.0) 80 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.gibba015"}]: dispatch 2021-03-10T13:39:24.423 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:24 gibba015 bash[9806]: audit 2021-03-10T13:39:23.068763+0000 mon.a (mon.0) 81 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2021-03-10T13:39:24.423 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:24 gibba015 bash[9806]: audit 2021-03-10T13:39:23.070126+0000 mon.a (mon.0) 82 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2021-03-10T13:39:24.423 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:24 gibba015 bash[9806]: audit 2021-03-10T13:39:23.071482+0000 mon.a (mon.0) 83 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2021-03-10T13:39:24.424 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:24 gibba015 bash[9806]: audit 2021-03-10T13:39:23.072809+0000 mon.a (mon.0) 84 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2021-03-10T13:39:24.424 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:24 gibba015 bash[9806]: audit 2021-03-10T13:39:23.074155+0000 mon.a (mon.0) 85 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2021-03-10T13:39:24.424 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:24 gibba015 bash[9806]: cluster 2021-03-10T13:39:23.079723+0000 mon.a (mon.0) 86 : cluster [INF] Manager daemon y is now available 2021-03-10T13:39:24.424 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:24 gibba015 bash[9806]: audit 2021-03-10T13:39:23.113913+0000 mon.a (mon.0) 87 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2021-03-10T13:39:24.424 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:24 gibba015 bash[9806]: audit 2021-03-10T13:39:23.273059+0000 mon.a (mon.0) 88 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2021-03-10T13:39:24.425 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:24 gibba015 bash[9806]: audit 2021-03-10T13:39:23.273311+0000 mon.a (mon.0) 89 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:39:24.425 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:24 gibba015 bash[9806]: audit 2021-03-10T13:39:23.580875+0000 mon.a (mon.0) 90 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:39:23.580359\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:39:23.580433\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}}, \"devices\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2021-03-10T13:39:23.580499\", \"networks\": {}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]: dispatch 2021-03-10T13:39:24.425 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:24 gibba015 bash[9806]: audit 2021-03-10T13:39:23.582566+0000 mon.a (mon.0) 91 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:39:23.580359\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:39:23.580433\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}}, \"devices\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2021-03-10T13:39:23.580499\", \"networks\": {}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]': finished 2021-03-10T13:39:24.425 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:24 gibba015 bash[9806]: audit 2021-03-10T13:39:23.583100+0000 mon.a (mon.0) 92 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:39:24.917 INFO:teuthology.orchestra.run.gibba015.stderr:INFO:cephadm:Generating a dashboard self-signed certificate... 2021-03-10T13:39:24.917 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba015', '-v', '/var/log/ceph/e4a642d2-81a5-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmp3221digx:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpygecn9iw:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'dashboard', 'create-self-signed-cert'] 2021-03-10T13:39:24.917 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba015 -v /var/log/ceph/e4a642d2-81a5-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp3221digx:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpygecn9iw:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 dashboard create-self-signed-cert 2021-03-10T13:39:25.203 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:25 gibba015 bash[9806]: cluster 2021-03-10T13:39:24.061956+0000 mon.a (mon.0) 93 : cluster [DBG] mgrmap e11: y(active, since 1.21146s) 2021-03-10T13:39:26.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:26 gibba015 bash[9806]: cluster 2021-03-10T13:39:25.073938+0000 mon.a (mon.0) 94 : cluster [DBG] mgrmap e12: y(active, since 2s) 2021-03-10T13:39:26.690 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout Self-signed certificate created 2021-03-10T13:39:27.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:27 gibba015 bash[9806]: audit 2021-03-10T13:39:26.640256+0000 mgr.y (mgr.14140) 1 : audit [DBG] from='client.14153 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:39:27.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:27 gibba015 bash[9806]: audit 2021-03-10T13:39:26.684048+0000 mon.a (mon.0) 95 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/dashboard/crt","val":"-----BEGIN CERTIFICATE-----\nMIICzzCCAbcCEBukJSQ2VkArsXcu2G0keu8wDQYJKoZIhvcNAQENBQAwJjELMAkG\nA1UECgwCSVQxFzAVBgNVBAMMDmNlcGgtZGFzaGJvYXJkMB4XDTIxMDMxMDEzMzky\nNloXDTMxMDMwODEzMzkyNlowJjELMAkGA1UECgwCSVQxFzAVBgNVBAMMDmNlcGgt\nZGFzaGJvYXJkMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEA7xINSqIs\naFvru3UUwg/5Ammyw1w33ZChiDY90uHKheMKmWvOQkZaBDDpPoen+wfHjhjtrMCT\ncR3oedEqXu5Jic5UvaATqJjzWweQBt2GgraQxKKgveV/GsGfMNWPkvfCS1JBAS12\n0wVCKU1qK7BWg8QlXNGIM/bXpOFAKrSfOHZglZreWHtPcvYRk+vvVjX5UhubXF45\nJfaj/UWv1MiW0UscXKkVBDuCvhlfUcDIW5MjUPvFIol9LJ6ESIWpdYTvp3SC4WXm\nEiv3dlTOlae+AiVALRfSxM8s0YZzs1BQyFMuT0C6NmfpXSVYCdMyrEdK1FDkmJsS\nj30xA3BxC6KfOQIDAQABMA0GCSqGSIb3DQEBDQUAA4IBAQDTaM38FckrnvuA5vwK\nV7gmuLpGbN9a1gkolQIhv+RpXbM8fv6inDNfDcjJbinS8Fudl0u/isLl5mIUp0Si\nQ0nVsX/r1192e0S/XI5iDMMNZ5BNksjK9YcoEP9IG0xo2FyWtKDCv0rng4awWjjK\nNggM8GQpf2cqi+dx7KWQ6FW+KlJEPpBhVEO4DfxjUy2HmM1+ww1CEd6yHLFL2OEW\n+k9m31UGyN5ztt+zlw9GwxwnNqxGJBX6f6rupIEw8TamEKyADNW4AFxgKw15cMdj\nP/xKuDlU+gaYbbahWhp1u5J28lmZJxODIuJwSrT7piUNOjanut59E5QzlR1o3Hi4\nmYV9\n-----END CERTIFICATE-----\n"}]: dispatch 2021-03-10T13:39:27.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:27 gibba015 bash[9806]: audit 2021-03-10T13:39:26.685782+0000 mon.a (mon.0) 96 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/dashboard/crt","val":"-----BEGIN CERTIFICATE-----\nMIICzzCCAbcCEBukJSQ2VkArsXcu2G0keu8wDQYJKoZIhvcNAQENBQAwJjELMAkG\nA1UECgwCSVQxFzAVBgNVBAMMDmNlcGgtZGFzaGJvYXJkMB4XDTIxMDMxMDEzMzky\nNloXDTMxMDMwODEzMzkyNlowJjELMAkGA1UECgwCSVQxFzAVBgNVBAMMDmNlcGgt\nZGFzaGJvYXJkMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEA7xINSqIs\naFvru3UUwg/5Ammyw1w33ZChiDY90uHKheMKmWvOQkZaBDDpPoen+wfHjhjtrMCT\ncR3oedEqXu5Jic5UvaATqJjzWweQBt2GgraQxKKgveV/GsGfMNWPkvfCS1JBAS12\n0wVCKU1qK7BWg8QlXNGIM/bXpOFAKrSfOHZglZreWHtPcvYRk+vvVjX5UhubXF45\nJfaj/UWv1MiW0UscXKkVBDuCvhlfUcDIW5MjUPvFIol9LJ6ESIWpdYTvp3SC4WXm\nEiv3dlTOlae+AiVALRfSxM8s0YZzs1BQyFMuT0C6NmfpXSVYCdMyrEdK1FDkmJsS\nj30xA3BxC6KfOQIDAQABMA0GCSqGSIb3DQEBDQUAA4IBAQDTaM38FckrnvuA5vwK\nV7gmuLpGbN9a1gkolQIhv+RpXbM8fv6inDNfDcjJbinS8Fudl0u/isLl5mIUp0Si\nQ0nVsX/r1192e0S/XI5iDMMNZ5BNksjK9YcoEP9IG0xo2FyWtKDCv0rng4awWjjK\nNggM8GQpf2cqi+dx7KWQ6FW+KlJEPpBhVEO4DfxjUy2HmM1+ww1CEd6yHLFL2OEW\n+k9m31UGyN5ztt+zlw9GwxwnNqxGJBX6f6rupIEw8TamEKyADNW4AFxgKw15cMdj\nP/xKuDlU+gaYbbahWhp1u5J28lmZJxODIuJwSrT7piUNOjanut59E5QzlR1o3Hi4\nmYV9\n-----END CERTIFICATE-----\n"}]': finished 2021-03-10T13:39:27.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:27 gibba015 bash[9806]: audit 2021-03-10T13:39:26.686189+0000 mon.a (mon.0) 97 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/dashboard/key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvQIBADANBgkqhkiG9w0BAQEFAASCBKcwggSjAgEAAoIBAQDvEg1KoixoW+u7\ndRTCD/kCabLDXDfdkKGINj3S4cqF4wqZa85CRloEMOk+h6f7B8eOGO2swJNxHeh5\n0Spe7kmJzlS9oBOomPNbB5AG3YaCtpDEoqC95X8awZ8w1Y+S98JLUkEBLXbTBUIp\nTWorsFaDxCVc0Ygz9tek4UAqtJ84dmCVmt5Ye09y9hGT6+9WNflSG5tcXjkl9qP9\nRa/UyJbRSxxcqRUEO4K+GV9RwMhbkyNQ+8UiiX0snoRIhal1hO+ndILhZeYSK/d2\nVM6Vp74CJUAtF9LEzyzRhnOzUFDIUy5PQLo2Z+ldJVgJ0zKsR0rUUOSYmxKPfTED\ncHELop85AgMBAAECggEAGg91s3UKMjYS9FRG9wCWvFSZUAJ1dImXkimXg61pTj75\noM/HpCHXHi3WvyI6hXrLngnJntM/P01rUhwi6kY/be43/pO8kNxbasjgQl9Tklwk\nW8r+irTBrkD9AW3GQNcRLvTAcUhrc4VXOPlfYXPPen2fNQcCOefmieqj/APEd3r6\nBpJcXUgLz/SyUjuslkhlzzYCSs0QAgGIS53frYu+7ldf2/60Rl+uoAdNDRoObE3W\nxbnzxe8uZqvvFSeDHuM2wIOOcm+BSIcs4+YTiNJuU0Ab+uF60P4W+eeXLJkTCgSO\n+ld4Un4QSa1NpTdCDLRaHjnGHowmY02Tv1MxyibsoQKBgQD+9tydxPDl4tI0A/5H\n/54M42HbKyCHDLMpsV0rnJn+gkkQmGIFcJWTIiZQa1VmlkTvKrCmjQ5ry7Z4yjPg\n4jDHC1SgohS8UCivS9s1c8xCRZYsKwVjVQPrh+g3h79+ptkHlR2JX6ytbhSRBA/r\ne9IroV5jO4qvfTdUReiJj8n8YwKBgQDwCqmBqgemVoAXy6DeBdwBX66EP5kLSagE\nk1sRbWF2aAJlqWG2PTesia024G5otawfYZvoaBSR4q+mi46MbmhPdsYxJ5iyyXMt\nZSMK+zqwkVPDodctIFpOeYtGoIUUh0LJmPBan3YLyCoHbxVLD4wZFiPxunA++FSE\nROEFGzYiswKBgC6OZ0SL1K01mMqUvBbrjzGtR44ctujSIdkIIQo4o0n9Alh8atGx\neC6QusxOfR6pa9b8RZt0AGEgpqYxzf1PcDa4U/CtB/pG7NbtlA6ToYWsbTqNdINp\n37hfbcDOEeKPluuyh90w0jgs9KZyRnHqfzsmUTTvh2h6BeNmjIqp7ekfAoGBAK8m\nWIDwXByXSWgTgRIAHIQ0GNcOwNFnsV2FWBHjShZn1jfv3AhpqtIOs4EzSdzFkw5i\n3qw6Jag9TAWuFxmJBjvVYtBDIDx0mcIp5eQBZNWpdQFued/Hl51jOqkSP4i3GZiY\nK+k0KaJ3L5O1Dkhy07sKWLftXjHUaXcJ+1cKf/nZAoGAfZR4Ds/fH7Lv/YNv2f/t\n81hS8AM5keJbaZH6jnkzfafkHClbocayp9cuBXUxGj+rhDUibfT+0kSuorR++2Qs\nIlGVqVVMuFjZaIWb2svOusIfMDRi+eYFFAqf37VkibsnFlyuZZ9qi3EcOMbfCM4o\nrT9XA75S2CuCeoEfxqE5bFo=\n-----END PRIVATE KEY-----\n"}]: dispatch 2021-03-10T13:39:27.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:27 gibba015 bash[9806]: audit 2021-03-10T13:39:26.687533+0000 mon.a (mon.0) 98 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/dashboard/key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvQIBADANBgkqhkiG9w0BAQEFAASCBKcwggSjAgEAAoIBAQDvEg1KoixoW+u7\ndRTCD/kCabLDXDfdkKGINj3S4cqF4wqZa85CRloEMOk+h6f7B8eOGO2swJNxHeh5\n0Spe7kmJzlS9oBOomPNbB5AG3YaCtpDEoqC95X8awZ8w1Y+S98JLUkEBLXbTBUIp\nTWorsFaDxCVc0Ygz9tek4UAqtJ84dmCVmt5Ye09y9hGT6+9WNflSG5tcXjkl9qP9\nRa/UyJbRSxxcqRUEO4K+GV9RwMhbkyNQ+8UiiX0snoRIhal1hO+ndILhZeYSK/d2\nVM6Vp74CJUAtF9LEzyzRhnOzUFDIUy5PQLo2Z+ldJVgJ0zKsR0rUUOSYmxKPfTED\ncHELop85AgMBAAECggEAGg91s3UKMjYS9FRG9wCWvFSZUAJ1dImXkimXg61pTj75\noM/HpCHXHi3WvyI6hXrLngnJntM/P01rUhwi6kY/be43/pO8kNxbasjgQl9Tklwk\nW8r+irTBrkD9AW3GQNcRLvTAcUhrc4VXOPlfYXPPen2fNQcCOefmieqj/APEd3r6\nBpJcXUgLz/SyUjuslkhlzzYCSs0QAgGIS53frYu+7ldf2/60Rl+uoAdNDRoObE3W\nxbnzxe8uZqvvFSeDHuM2wIOOcm+BSIcs4+YTiNJuU0Ab+uF60P4W+eeXLJkTCgSO\n+ld4Un4QSa1NpTdCDLRaHjnGHowmY02Tv1MxyibsoQKBgQD+9tydxPDl4tI0A/5H\n/54M42HbKyCHDLMpsV0rnJn+gkkQmGIFcJWTIiZQa1VmlkTvKrCmjQ5ry7Z4yjPg\n4jDHC1SgohS8UCivS9s1c8xCRZYsKwVjVQPrh+g3h79+ptkHlR2JX6ytbhSRBA/r\ne9IroV5jO4qvfTdUReiJj8n8YwKBgQDwCqmBqgemVoAXy6DeBdwBX66EP5kLSagE\nk1sRbWF2aAJlqWG2PTesia024G5otawfYZvoaBSR4q+mi46MbmhPdsYxJ5iyyXMt\nZSMK+zqwkVPDodctIFpOeYtGoIUUh0LJmPBan3YLyCoHbxVLD4wZFiPxunA++FSE\nROEFGzYiswKBgC6OZ0SL1K01mMqUvBbrjzGtR44ctujSIdkIIQo4o0n9Alh8atGx\neC6QusxOfR6pa9b8RZt0AGEgpqYxzf1PcDa4U/CtB/pG7NbtlA6ToYWsbTqNdINp\n37hfbcDOEeKPluuyh90w0jgs9KZyRnHqfzsmUTTvh2h6BeNmjIqp7ekfAoGBAK8m\nWIDwXByXSWgTgRIAHIQ0GNcOwNFnsV2FWBHjShZn1jfv3AhpqtIOs4EzSdzFkw5i\n3qw6Jag9TAWuFxmJBjvVYtBDIDx0mcIp5eQBZNWpdQFued/Hl51jOqkSP4i3GZiY\nK+k0KaJ3L5O1Dkhy07sKWLftXjHUaXcJ+1cKf/nZAoGAfZR4Ds/fH7Lv/YNv2f/t\n81hS8AM5keJbaZH6jnkzfafkHClbocayp9cuBXUxGj+rhDUibfT+0kSuorR++2Qs\nIlGVqVVMuFjZaIWb2svOusIfMDRi+eYFFAqf37VkibsnFlyuZZ9qi3EcOMbfCM4o\nrT9XA75S2CuCeoEfxqE5bFo=\n-----END PRIVATE KEY-----\n"}]': finished 2021-03-10T13:39:27.315 INFO:teuthology.orchestra.run.gibba015.stderr:INFO:cephadm:Creating initial admin user... 2021-03-10T13:39:27.316 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba015', '-v', '/var/log/ceph/e4a642d2-81a5-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmp3221digx:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpygecn9iw:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'dashboard', 'ac-user-create', 'admin', 'czy7u2xd3m', 'administrator', '--force-password', '--pwd-update-required'] 2021-03-10T13:39:27.316 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba015 -v /var/log/ceph/e4a642d2-81a5-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp3221digx:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpygecn9iw:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 dashboard ac-user-create admin czy7u2xd3m administrator --force-password --pwd-update-required 2021-03-10T13:39:28.558 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout {"username": "admin", "password": "$2b$12$pa4sKA9sCtmUb2QwudISg.H4H//UZNqPWsWqo8cISGBOwKgMzp/ES", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1615383568, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2021-03-10T13:39:28.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:28 gibba015 bash[9806]: audit 2021-03-10T13:39:28.553804+0000 mon.a (mon.0) 99 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/dashboard/accessdb_v2","val":"{\"users\": {\"admin\": {\"username\": \"admin\", \"password\": \"$2b$12$pa4sKA9sCtmUb2QwudISg.H4H//UZNqPWsWqo8cISGBOwKgMzp/ES\", \"roles\": [\"administrator\"], \"name\": null, \"email\": null, \"lastUpdate\": 1615383568, \"enabled\": true, \"pwdExpirationDate\": null, \"pwdUpdateRequired\": true}}, \"roles\": {}, \"version\": 2}"}]: dispatch 2021-03-10T13:39:28.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:28 gibba015 bash[9806]: audit 2021-03-10T13:39:28.555494+0000 mon.a (mon.0) 100 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/dashboard/accessdb_v2","val":"{\"users\": {\"admin\": {\"username\": \"admin\", \"password\": \"$2b$12$pa4sKA9sCtmUb2QwudISg.H4H//UZNqPWsWqo8cISGBOwKgMzp/ES\", \"roles\": [\"administrator\"], \"name\": null, \"email\": null, \"lastUpdate\": 1615383568, \"enabled\": true, \"pwdExpirationDate\": null, \"pwdUpdateRequired\": true}}, \"roles\": {}, \"version\": 2}"}]': finished 2021-03-10T13:39:29.042 INFO:teuthology.orchestra.run.gibba015.stderr:INFO:cephadm:Fetching dashboard port number... 2021-03-10T13:39:29.042 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba015', '-v', '/var/log/ceph/e4a642d2-81a5-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmp3221digx:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpygecn9iw:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'config', 'get', 'mgr', 'mgr/dashboard/ssl_server_port'] 2021-03-10T13:39:29.042 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba015 -v /var/log/ceph/e4a642d2-81a5-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp3221digx:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpygecn9iw:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 config get mgr mgr/dashboard/ssl_server_port 2021-03-10T13:39:29.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:29 gibba015 bash[9806]: audit 2021-03-10T13:39:28.390853+0000 mgr.y (mgr.14140) 2 : audit [DBG] from='client.14155 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "password": "czy7u2xd3m", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:39:29.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:29 gibba015 bash[9806]: audit 2021-03-10T13:39:28.623439+0000 mon.a (mon.0) 101 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:39:29.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:29 gibba015 bash[9806]: audit 2021-03-10T13:39:28.725866+0000 mon.a (mon.0) 102 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:39:23.580359\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:39:23.580433\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2021-03-10T13:39:23.580499\", \"last_device_update\": \"2021-03-10T13:39:28.725398\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]: dispatch 2021-03-10T13:39:29.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:29 gibba015 bash[9806]: audit 2021-03-10T13:39:28.727683+0000 mon.a (mon.0) 103 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:39:23.580359\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:39:23.580433\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2021-03-10T13:39:23.580499\", \"last_device_update\": \"2021-03-10T13:39:28.725398\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]': finished 2021-03-10T13:39:30.002 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 8443 2021-03-10T13:39:30.548 INFO:teuthology.orchestra.run.gibba015.stderr:INFO:cephadm:Ceph Dashboard is now available at: 2021-03-10T13:39:30.549 INFO:teuthology.orchestra.run.gibba015.stderr: 2021-03-10T13:39:30.549 INFO:teuthology.orchestra.run.gibba015.stderr: URL: https://gibba015:8443/ 2021-03-10T13:39:30.549 INFO:teuthology.orchestra.run.gibba015.stderr: User: admin 2021-03-10T13:39:30.550 INFO:teuthology.orchestra.run.gibba015.stderr: Password: czy7u2xd3m 2021-03-10T13:39:30.550 INFO:teuthology.orchestra.run.gibba015.stderr: 2021-03-10T13:39:30.550 INFO:teuthology.orchestra.run.gibba015.stderr:INFO:cephadm:You can access the Ceph CLI with: 2021-03-10T13:39:30.550 INFO:teuthology.orchestra.run.gibba015.stderr: 2021-03-10T13:39:30.550 INFO:teuthology.orchestra.run.gibba015.stderr: sudo /home/ubuntu/cephtest/cephadm shell --fsid e4a642d2-81a5-11eb-9080-001a4aab830c -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2021-03-10T13:39:30.551 INFO:teuthology.orchestra.run.gibba015.stderr: 2021-03-10T13:39:30.551 INFO:teuthology.orchestra.run.gibba015.stderr:INFO:cephadm:Please consider enabling telemetry to help improve Ceph: 2021-03-10T13:39:30.551 INFO:teuthology.orchestra.run.gibba015.stderr: 2021-03-10T13:39:30.551 INFO:teuthology.orchestra.run.gibba015.stderr: ceph telemetry on 2021-03-10T13:39:30.551 INFO:teuthology.orchestra.run.gibba015.stderr: 2021-03-10T13:39:30.552 INFO:teuthology.orchestra.run.gibba015.stderr:For more information see: 2021-03-10T13:39:30.552 INFO:teuthology.orchestra.run.gibba015.stderr: 2021-03-10T13:39:30.552 INFO:teuthology.orchestra.run.gibba015.stderr: https://docs.ceph.com/docs/master/mgr/telemetry/ 2021-03-10T13:39:30.552 INFO:teuthology.orchestra.run.gibba015.stderr: 2021-03-10T13:39:30.553 INFO:teuthology.orchestra.run.gibba015.stderr:INFO:cephadm:Bootstrap complete. 2021-03-10T13:39:30.553 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:Releasing lock 139700450627936 on /run/cephadm/e4a642d2-81a5-11eb-9080-001a4aab830c.lock 2021-03-10T13:39:30.553 INFO:teuthology.orchestra.run.gibba015.stderr:DEBUG:cephadm:Lock 139700450627936 released on /run/cephadm/e4a642d2-81a5-11eb-9080-001a4aab830c.lock 2021-03-10T13:39:30.557 INFO:tasks.cephadm:Fetching config... 2021-03-10T13:39:30.558 DEBUG:teuthology.orchestra.run.gibba015:> set -ex 2021-03-10T13:39:30.558 DEBUG:teuthology.orchestra.run.gibba015:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2021-03-10T13:39:30.562 INFO:tasks.cephadm:Fetching client.admin keyring... 2021-03-10T13:39:30.562 DEBUG:teuthology.orchestra.run.gibba015:> set -ex 2021-03-10T13:39:30.563 DEBUG:teuthology.orchestra.run.gibba015:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2021-03-10T13:39:30.566 INFO:tasks.cephadm:Fetching mon keyring... 2021-03-10T13:39:30.567 DEBUG:teuthology.orchestra.run.gibba015:> set -ex 2021-03-10T13:39:30.567 DEBUG:teuthology.orchestra.run.gibba015:> sudo dd if=/var/lib/ceph/e4a642d2-81a5-11eb-9080-001a4aab830c/mon.a/keyring of=/dev/stdout 2021-03-10T13:39:30.573 INFO:tasks.cephadm:Fetching pub ssh key... 2021-03-10T13:39:30.574 DEBUG:teuthology.orchestra.run.gibba015:> set -ex 2021-03-10T13:39:30.574 DEBUG:teuthology.orchestra.run.gibba015:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2021-03-10T13:39:30.620 INFO:tasks.cephadm:Installing pub ssh key for root users... 2021-03-10T13:39:30.620 DEBUG:teuthology.orchestra.run.gibba015:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDXyhmzbMtJGXcYrEwH2iMPZp1RJrz82CNUeJnVU6um+w0xGbyeaho/qiNZ6s9OWNOcFx+hvrTdjdW57uXMklpo9lyyT2n6hzmbdau0jsawjZKU3WxM/lD1qIwozYE1AsDABBfFgx1werfdi8RD265mxhwsjt78HKM2JlK9zUH9UqIfaX4rQOfKuTECkaQuINo3Ai5UgmPGKGpK7bh3+2Phdjz4gBeaRk2gjwp8vghZdP+NVPA7CIbOOTVc2GUd3yg1SG1+1zTE2fnLWS7irzivP3LUXgU6QyYUk+cQy2ueUI20ibq+fSS4owg8T+0NsMdxeweopUIoQMF5MmhJT1SAsUki6Tmd1c8GRo2hk/IwKzdvQTIsMA68QbnhVhLeSppc9WLHtUt/EVKxACfiMZk/VrHCpLtPSuH499h48+ffGuzDhF6mX+MVsKhDfkb4fowo4YINLHG6675YqahnaqlhUs0dY+nu/MepRJXQ612Y9/bfC2zwOtswg0AKv9vc0r8= ceph-e4a642d2-81a5-11eb-9080-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2021-03-10T13:39:30.634 INFO:teuthology.orchestra.run.gibba015.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDXyhmzbMtJGXcYrEwH2iMPZp1RJrz82CNUeJnVU6um+w0xGbyeaho/qiNZ6s9OWNOcFx+hvrTdjdW57uXMklpo9lyyT2n6hzmbdau0jsawjZKU3WxM/lD1qIwozYE1AsDABBfFgx1werfdi8RD265mxhwsjt78HKM2JlK9zUH9UqIfaX4rQOfKuTECkaQuINo3Ai5UgmPGKGpK7bh3+2Phdjz4gBeaRk2gjwp8vghZdP+NVPA7CIbOOTVc2GUd3yg1SG1+1zTE2fnLWS7irzivP3LUXgU6QyYUk+cQy2ueUI20ibq+fSS4owg8T+0NsMdxeweopUIoQMF5MmhJT1SAsUki6Tmd1c8GRo2hk/IwKzdvQTIsMA68QbnhVhLeSppc9WLHtUt/EVKxACfiMZk/VrHCpLtPSuH499h48+ffGuzDhF6mX+MVsKhDfkb4fowo4YINLHG6675YqahnaqlhUs0dY+nu/MepRJXQ612Y9/bfC2zwOtswg0AKv9vc0r8= ceph-e4a642d2-81a5-11eb-9080-001a4aab830c 2021-03-10T13:39:30.638 DEBUG:teuthology.orchestra.run.gibba045:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDXyhmzbMtJGXcYrEwH2iMPZp1RJrz82CNUeJnVU6um+w0xGbyeaho/qiNZ6s9OWNOcFx+hvrTdjdW57uXMklpo9lyyT2n6hzmbdau0jsawjZKU3WxM/lD1qIwozYE1AsDABBfFgx1werfdi8RD265mxhwsjt78HKM2JlK9zUH9UqIfaX4rQOfKuTECkaQuINo3Ai5UgmPGKGpK7bh3+2Phdjz4gBeaRk2gjwp8vghZdP+NVPA7CIbOOTVc2GUd3yg1SG1+1zTE2fnLWS7irzivP3LUXgU6QyYUk+cQy2ueUI20ibq+fSS4owg8T+0NsMdxeweopUIoQMF5MmhJT1SAsUki6Tmd1c8GRo2hk/IwKzdvQTIsMA68QbnhVhLeSppc9WLHtUt/EVKxACfiMZk/VrHCpLtPSuH499h48+ffGuzDhF6mX+MVsKhDfkb4fowo4YINLHG6675YqahnaqlhUs0dY+nu/MepRJXQ612Y9/bfC2zwOtswg0AKv9vc0r8= ceph-e4a642d2-81a5-11eb-9080-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2021-03-10T13:39:30.654 INFO:teuthology.orchestra.run.gibba045.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDXyhmzbMtJGXcYrEwH2iMPZp1RJrz82CNUeJnVU6um+w0xGbyeaho/qiNZ6s9OWNOcFx+hvrTdjdW57uXMklpo9lyyT2n6hzmbdau0jsawjZKU3WxM/lD1qIwozYE1AsDABBfFgx1werfdi8RD265mxhwsjt78HKM2JlK9zUH9UqIfaX4rQOfKuTECkaQuINo3Ai5UgmPGKGpK7bh3+2Phdjz4gBeaRk2gjwp8vghZdP+NVPA7CIbOOTVc2GUd3yg1SG1+1zTE2fnLWS7irzivP3LUXgU6QyYUk+cQy2ueUI20ibq+fSS4owg8T+0NsMdxeweopUIoQMF5MmhJT1SAsUki6Tmd1c8GRo2hk/IwKzdvQTIsMA68QbnhVhLeSppc9WLHtUt/EVKxACfiMZk/VrHCpLtPSuH499h48+ffGuzDhF6mX+MVsKhDfkb4fowo4YINLHG6675YqahnaqlhUs0dY+nu/MepRJXQ612Y9/bfC2zwOtswg0AKv9vc0r8= ceph-e4a642d2-81a5-11eb-9080-001a4aab830c 2021-03-10T13:39:30.658 INFO:tasks.cephadm:Writing (initial) conf and keyring to gibba045 2021-03-10T13:39:30.658 DEBUG:teuthology.orchestra.run.gibba045:> set -ex 2021-03-10T13:39:30.662 DEBUG:teuthology.orchestra.run.gibba045:> dd of=/etc/ceph/ceph.conf 2021-03-10T13:39:30.666 DEBUG:teuthology.orchestra.run.gibba045:> set -ex 2021-03-10T13:39:30.666 DEBUG:teuthology.orchestra.run.gibba045:> dd of=/etc/ceph/ceph.client.admin.keyring 2021-03-10T13:39:30.712 INFO:tasks.cephadm:Adding host gibba045 to orchestrator... 2021-03-10T13:39:30.712 DEBUG:teuthology.orchestra.run.gibba045:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e4a642d2-81a5-11eb-9080-001a4aab830c -- ceph orch host add gibba045 2021-03-10T13:39:30.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:30 gibba015 bash[9806]: cluster 2021-03-10T13:39:29.729801+0000 mon.a (mon.0) 104 : cluster [DBG] mgrmap e13: y(active, since 6s) 2021-03-10T13:39:30.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:30 gibba015 bash[9806]: audit 2021-03-10T13:39:29.999002+0000 mon.a (mon.0) 105 : audit [DBG] from='client.? 172.21.2.115:0/1085627122' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2021-03-10T13:39:44.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:44 gibba015 bash[9806]: cluster 2021-03-10T13:39:43.064742+0000 mgr.y (mgr.14140) 3 : cluster [DBG] pgmap v3: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:39:46.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:46 gibba015 bash[9806]: cluster 2021-03-10T13:39:45.065380+0000 mgr.y (mgr.14140) 4 : cluster [DBG] pgmap v4: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:39:48.223 INFO:journalctl@ceph.mgr.y.gibba015.stdout:Mar 10 13:39:47 gibba015 bash[10036]: Warning: Permanently added 'gibba045,172.21.2.145' (ECDSA) to the list of known hosts. 2021-03-10T13:39:48.923 INFO:teuthology.orchestra.run.gibba045.stdout:Added host 'gibba045' 2021-03-10T13:39:49.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:49 gibba015 bash[9806]: cluster 2021-03-10T13:39:47.066156+0000 mgr.y (mgr.14140) 5 : cluster [DBG] pgmap v5: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:39:49.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:49 gibba015 bash[9806]: audit 2021-03-10T13:39:47.914344+0000 mgr.y (mgr.14140) 6 : audit [DBG] from='client.14159 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "gibba045", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:39:49.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:49 gibba015 bash[9806]: audit 2021-03-10T13:39:48.359451+0000 mon.a (mon.0) 106 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"gibba015\": {\"hostname\": \"gibba015\", \"addr\": \"gibba015\", \"labels\": [], \"status\": \"\"}, \"gibba045\": {\"hostname\": \"gibba045\", \"addr\": \"gibba045\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2021-03-10T13:39:49.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:49 gibba015 bash[9806]: audit 2021-03-10T13:39:48.365315+0000 mon.a (mon.0) 107 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"gibba015\": {\"hostname\": \"gibba015\", \"addr\": \"gibba015\", \"labels\": [], \"status\": \"\"}, \"gibba045\": {\"hostname\": \"gibba045\", \"addr\": \"gibba045\", \"labels\": [], \"status\": \"\"}}"}]': finished 2021-03-10T13:39:49.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:49 gibba015 bash[9806]: audit 2021-03-10T13:39:48.493900+0000 mon.a (mon.0) 108 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {}, \"devices\": [], \"daemon_config_deps\": {}, \"networks\": {}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:39:49.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:49 gibba015 bash[9806]: audit 2021-03-10T13:39:48.496458+0000 mon.a (mon.0) 109 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {}, \"devices\": [], \"daemon_config_deps\": {}, \"networks\": {}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:39:49.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:49 gibba015 bash[9806]: audit 2021-03-10T13:39:48.497315+0000 mon.a (mon.0) 110 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:39:49.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:49 gibba015 bash[9806]: audit 2021-03-10T13:39:48.607193+0000 mon.a (mon.0) 111 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {}, \"devices\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2021-03-10T13:39:48.606233\", \"networks\": {}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:39:49.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:49 gibba015 bash[9806]: audit 2021-03-10T13:39:48.613279+0000 mon.a (mon.0) 112 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {}, \"devices\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2021-03-10T13:39:48.606233\", \"networks\": {}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:39:49.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:49 gibba015 bash[9806]: audit 2021-03-10T13:39:48.614431+0000 mon.a (mon.0) 113 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:39:49.689 DEBUG:teuthology.orchestra.run.gibba045:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e4a642d2-81a5-11eb-9080-001a4aab830c -- ceph orch host ls --format=json 2021-03-10T13:39:50.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:50 gibba015 bash[9806]: cephadm 2021-03-10T13:39:48.366466+0000 mgr.y (mgr.14140) 7 : cephadm [INF] Added host gibba045 2021-03-10T13:39:50.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:50 gibba015 bash[9806]: cluster 2021-03-10T13:39:49.066409+0000 mgr.y (mgr.14140) 8 : cluster [DBG] pgmap v6: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:39:53.156 INFO:teuthology.orchestra.run.gibba045.stdout: 2021-03-10T13:39:53.156 INFO:teuthology.orchestra.run.gibba045.stdout:[{"addr": "gibba015", "hostname": "gibba015", "labels": [], "status": ""}, {"addr": "gibba045", "hostname": "gibba045", "labels": [], "status": ""}] 2021-03-10T13:39:53.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:53 gibba015 bash[9806]: cluster 2021-03-10T13:39:51.067014+0000 mgr.y (mgr.14140) 9 : cluster [DBG] pgmap v7: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:39:53.915 INFO:tasks.cephadm:Setting crush tunables to default 2021-03-10T13:39:53.916 DEBUG:teuthology.orchestra.run.gibba015:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e4a642d2-81a5-11eb-9080-001a4aab830c -- ceph osd crush tunables default 2021-03-10T13:39:54.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:54 gibba015 bash[9806]: cluster 2021-03-10T13:39:53.067568+0000 mgr.y (mgr.14140) 10 : cluster [DBG] pgmap v8: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:39:54.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:54 gibba015 bash[9806]: audit 2021-03-10T13:39:53.150106+0000 mgr.y (mgr.14140) 11 : audit [DBG] from='client.14161 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-03-10T13:39:55.367 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:55 gibba015 bash[9806]: audit 2021-03-10T13:39:54.157020+0000 mon.a (mon.0) 114 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:39:55.367 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:55 gibba015 bash[9806]: audit 2021-03-10T13:39:54.263873+0000 mon.a (mon.0) 115 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2021-03-10T13:39:48.606233\", \"last_device_update\": \"2021-03-10T13:39:54.262468\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:39:55.368 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:55 gibba015 bash[9806]: audit 2021-03-10T13:39:54.270112+0000 mon.a (mon.0) 116 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2021-03-10T13:39:48.606233\", \"last_device_update\": \"2021-03-10T13:39:54.262468\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:39:56.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:56 gibba015 bash[9806]: cluster 2021-03-10T13:39:55.068119+0000 mgr.y (mgr.14140) 12 : cluster [DBG] pgmap v9: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:39:57.282 INFO:teuthology.orchestra.run.gibba015.stderr:adjusted tunables profile to default 2021-03-10T13:39:57.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:57 gibba015 bash[9806]: audit 2021-03-10T13:39:56.288817+0000 mon.a (mon.0) 117 : audit [INF] from='client.? 172.21.2.115:0/529198794' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2021-03-10T13:39:57.825 INFO:tasks.cephadm:Adding mon.c on gibba015 2021-03-10T13:39:57.826 DEBUG:teuthology.orchestra.run.gibba015:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e4a642d2-81a5-11eb-9080-001a4aab830c -- ceph orch daemon add mon 'gibba015:[v2:172.21.2.115:3301,v1:172.21.2.115:6790]=c' 2021-03-10T13:39:58.561 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:58 gibba015 bash[9806]: cluster 2021-03-10T13:39:57.068841+0000 mgr.y (mgr.14140) 13 : cluster [DBG] pgmap v10: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:39:58.562 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:58 gibba015 bash[9806]: audit 2021-03-10T13:39:57.277718+0000 mon.a (mon.0) 118 : audit [INF] from='client.? 172.21.2.115:0/529198794' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2021-03-10T13:39:58.562 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:39:58 gibba015 bash[9806]: cluster 2021-03-10T13:39:57.277740+0000 mon.a (mon.0) 119 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2021-03-10T13:40:00.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:00 gibba015 bash[9806]: cluster 2021-03-10T13:39:59.069581+0000 mgr.y (mgr.14140) 14 : cluster [DBG] pgmap v12: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:40:00.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:00 gibba015 bash[9806]: audit 2021-03-10T13:40:00.148234+0000 mon.a (mon.0) 120 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:40:00.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:00 gibba015 bash[9806]: audit 2021-03-10T13:40:00.149217+0000 mon.a (mon.0) 121 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:40:00.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:00 gibba015 bash[9806]: audit 2021-03-10T13:40:00.150165+0000 mon.a (mon.0) 122 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.c", "key": "container_image"}]: dispatch 2021-03-10T13:40:01.608 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:01 gibba015 bash[9806]: audit 2021-03-10T13:40:00.146946+0000 mgr.y (mgr.14140) 15 : audit [DBG] from='client.14165 -' entity='client.admin' cmd=[{"prefix": "orch daemon add", "daemon_type": "mon", "placement": "gibba015:[v2:172.21.2.115:3301,v1:172.21.2.115:6790]=c", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:40:01.609 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:01 gibba015 bash[9806]: cephadm 2021-03-10T13:40:00.149957+0000 mgr.y (mgr.14140) 16 : cephadm [INF] Deploying daemon mon.c on gibba015 2021-03-10T13:40:03.299 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:03 gibba015 bash[9806]: cluster 2021-03-10T13:40:01.070092+0000 mgr.y (mgr.14140) 17 : cluster [DBG] pgmap v13: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:40:04.157 INFO:teuthology.orchestra.run.gibba015.stdout:Deployed mon.c on host 'gibba015' 2021-03-10T13:40:04.348 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:04 gibba015 bash[9806]: audit 2021-03-10T13:40:03.307394+0000 mon.a (mon.0) 123 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:39:23.580359\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:39:23.580433\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}}, \"last_device_update\": \"2021-03-10T13:39:28.725398\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]: dispatch 2021-03-10T13:40:04.348 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:04 gibba015 bash[9806]: audit 2021-03-10T13:40:03.307748+0000 mon.a (mon.0) 124 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:40:04.349 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:04 gibba015 bash[9806]: audit 2021-03-10T13:40:03.308878+0000 mon.a (mon.0) 125 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:39:23.580359\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:39:23.580433\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}}, \"last_device_update\": \"2021-03-10T13:39:28.725398\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]': finished 2021-03-10T13:40:04.349 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:04 gibba015 bash[9806]: audit 2021-03-10T13:40:03.698420+0000 mon.a (mon.0) 126 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:03.697811\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:03.697873\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:03.697902\", \"created\": \"2021-03-10T13:40:03.296449\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}}, \"last_daemon_update\": \"2021-03-10T13:40:03.697952\", \"last_device_update\": \"2021-03-10T13:39:28.725398\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]: dispatch 2021-03-10T13:40:04.349 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:04 gibba015 bash[9806]: audit 2021-03-10T13:40:03.700238+0000 mon.a (mon.0) 127 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:03.697811\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:03.697873\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:03.697902\", \"created\": \"2021-03-10T13:40:03.296449\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}}, \"last_daemon_update\": \"2021-03-10T13:40:03.697952\", \"last_device_update\": \"2021-03-10T13:39:28.725398\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]': finished 2021-03-10T13:40:04.888 DEBUG:teuthology.orchestra.run.gibba015:mon.c> sudo journalctl -f -n 0 -u ceph-e4a642d2-81a5-11eb-9080-001a4aab830c@mon.c.service 2021-03-10T13:40:04.890 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2021-03-10T13:40:04.891 DEBUG:teuthology.orchestra.run.gibba015:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e4a642d2-81a5-11eb-9080-001a4aab830c -- ceph mon dump -f json 2021-03-10T13:40:04.909 INFO:journalctl@ceph.mon.c.gibba015.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T13:40:09.513 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-03-10T13:40:09.514 INFO:teuthology.orchestra.run.gibba015.stdout:{"epoch":2,"fsid":"e4a642d2-81a5-11eb-9080-001a4aab830c","modified":"2021-03-10T13:40:04.181989Z","created":"2021-03-10T13:38:48.184244Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:3300","nonce":0},{"type":"v1","addr":"172.21.2.115:6789","nonce":0}]},"addr":"172.21.2.115:6789/0","public_addr":"172.21.2.115:6789/0","priority":0,"weight":0},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:3301","nonce":0},{"type":"v1","addr":"172.21.2.115:6790","nonce":0}]},"addr":"172.21.2.115:6790/0","public_addr":"172.21.2.115:6790/0","priority":0,"weight":0}],"quorum":[0,1]} 2021-03-10T13:40:09.515 INFO:teuthology.orchestra.run.gibba015.stderr:dumped monmap epoch 2 2021-03-10T13:40:09.567 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:09 gibba015 bash[9806]: cluster 2021-03-10T13:40:04.183864+0000 mon.a (mon.0) 128 : cluster [INF] mon.a calling monitor election 2021-03-10T13:40:09.567 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:09 gibba015 bash[9806]: cluster 2021-03-10T13:40:05.071103+0000 mgr.y (mgr.14140) 19 : cluster [DBG] pgmap v15: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:40:09.567 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:09 gibba015 bash[9806]: cluster 2021-03-10T13:40:06.182892+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2021-03-10T13:40:09.567 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:09 gibba015 bash[9806]: cluster 2021-03-10T13:40:07.071987+0000 mgr.y (mgr.14140) 20 : cluster [DBG] pgmap v16: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:40:09.568 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:09 gibba015 bash[9806]: cluster 2021-03-10T13:40:09.190180+0000 mon.a (mon.0) 129 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2021-03-10T13:40:09.568 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:09 gibba015 bash[9806]: cluster 2021-03-10T13:40:09.198718+0000 mon.a (mon.0) 130 : cluster [DBG] monmap e2: 2 mons at {a=[v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0],c=[v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0]} 2021-03-10T13:40:09.568 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:09 gibba015 bash[9806]: cluster 2021-03-10T13:40:09.198846+0000 mon.a (mon.0) 131 : cluster [DBG] fsmap 2021-03-10T13:40:09.568 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:09 gibba015 bash[9806]: cluster 2021-03-10T13:40:09.198918+0000 mon.a (mon.0) 132 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2021-03-10T13:40:09.569 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:09 gibba015 bash[9806]: cluster 2021-03-10T13:40:09.199310+0000 mon.a (mon.0) 133 : cluster [DBG] mgrmap e13: y(active, since 46s) 2021-03-10T13:40:09.569 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:09 gibba015 bash[9806]: cluster 2021-03-10T13:40:09.201936+0000 mon.a (mon.0) 134 : cluster [INF] overall HEALTH_OK 2021-03-10T13:40:09.569 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:09 gibba015 bash[13005]: cluster 2021-03-10T13:40:04.183864+0000 mon.a (mon.0) 128 : cluster [INF] mon.a calling monitor election 2021-03-10T13:40:09.570 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:09 gibba015 bash[13005]: cluster 2021-03-10T13:40:05.071103+0000 mgr.y (mgr.14140) 19 : cluster [DBG] pgmap v15: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:40:09.570 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:09 gibba015 bash[13005]: cluster 2021-03-10T13:40:06.182892+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2021-03-10T13:40:09.570 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:09 gibba015 bash[13005]: cluster 2021-03-10T13:40:07.071987+0000 mgr.y (mgr.14140) 20 : cluster [DBG] pgmap v16: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:40:09.570 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:09 gibba015 bash[13005]: cluster 2021-03-10T13:40:09.190180+0000 mon.a (mon.0) 129 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2021-03-10T13:40:09.571 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:09 gibba015 bash[13005]: cluster 2021-03-10T13:40:09.198718+0000 mon.a (mon.0) 130 : cluster [DBG] monmap e2: 2 mons at {a=[v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0],c=[v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0]} 2021-03-10T13:40:09.571 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:09 gibba015 bash[13005]: cluster 2021-03-10T13:40:09.198846+0000 mon.a (mon.0) 131 : cluster [DBG] fsmap 2021-03-10T13:40:09.571 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:09 gibba015 bash[13005]: cluster 2021-03-10T13:40:09.198918+0000 mon.a (mon.0) 132 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2021-03-10T13:40:09.571 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:09 gibba015 bash[13005]: cluster 2021-03-10T13:40:09.199310+0000 mon.a (mon.0) 133 : cluster [DBG] mgrmap e13: y(active, since 46s) 2021-03-10T13:40:09.571 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:09 gibba015 bash[13005]: cluster 2021-03-10T13:40:09.201936+0000 mon.a (mon.0) 134 : cluster [INF] overall HEALTH_OK 2021-03-10T13:40:10.037 INFO:tasks.cephadm:Adding mon.b on gibba045 2021-03-10T13:40:10.038 DEBUG:teuthology.orchestra.run.gibba045:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e4a642d2-81a5-11eb-9080-001a4aab830c -- ceph orch daemon add mon gibba045:172.21.2.145=b 2021-03-10T13:40:10.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:10 gibba015 bash[9806]: cluster 2021-03-10T13:40:09.072963+0000 mgr.y (mgr.14140) 21 : cluster [DBG] pgmap v17: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:40:10.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:10 gibba015 bash[9806]: audit 2021-03-10T13:40:09.510158+0000 mon.a (mon.0) 135 : audit [DBG] from='client.? 172.21.2.115:0/1174779457' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-03-10T13:40:10.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:10 gibba015 bash[13005]: cluster 2021-03-10T13:40:09.072963+0000 mgr.y (mgr.14140) 21 : cluster [DBG] pgmap v17: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:40:10.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:10 gibba015 bash[13005]: audit 2021-03-10T13:40:09.510158+0000 mon.a (mon.0) 135 : audit [DBG] from='client.? 172.21.2.115:0/1174779457' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-03-10T13:40:13.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:13 gibba015 bash[9806]: cluster 2021-03-10T13:40:11.073984+0000 mgr.y (mgr.14140) 22 : cluster [DBG] pgmap v18: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:40:13.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:13 gibba015 bash[9806]: audit 2021-03-10T13:40:12.577243+0000 mon.a (mon.0) 136 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:40:13.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:13 gibba015 bash[9806]: audit 2021-03-10T13:40:12.580375+0000 mon.a (mon.0) 137 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:40:13.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:13 gibba015 bash[9806]: audit 2021-03-10T13:40:12.583841+0000 mon.a (mon.0) 138 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.b", "key": "container_image"}]: dispatch 2021-03-10T13:40:13.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:13 gibba015 bash[13005]: cluster 2021-03-10T13:40:11.073984+0000 mgr.y (mgr.14140) 22 : cluster [DBG] pgmap v18: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:40:13.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:13 gibba015 bash[13005]: audit 2021-03-10T13:40:12.577243+0000 mon.a (mon.0) 136 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:40:13.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:13 gibba015 bash[13005]: audit 2021-03-10T13:40:12.580375+0000 mon.a (mon.0) 137 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:40:13.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:13 gibba015 bash[13005]: audit 2021-03-10T13:40:12.583841+0000 mon.a (mon.0) 138 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.b", "key": "container_image"}]: dispatch 2021-03-10T13:40:14.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:14 gibba015 bash[9806]: audit 2021-03-10T13:40:12.573309+0000 mgr.y (mgr.14140) 23 : audit [DBG] from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch daemon add", "daemon_type": "mon", "placement": "gibba045:172.21.2.145=b", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:40:14.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:14 gibba015 bash[9806]: cephadm 2021-03-10T13:40:12.582889+0000 mgr.y (mgr.14140) 24 : cephadm [INF] Deploying daemon mon.b on gibba045 2021-03-10T13:40:14.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:14 gibba015 bash[9806]: cluster 2021-03-10T13:40:13.074267+0000 mgr.y (mgr.14140) 25 : cluster [DBG] pgmap v19: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:40:14.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:14 gibba015 bash[13005]: audit 2021-03-10T13:40:12.573309+0000 mgr.y (mgr.14140) 23 : audit [DBG] from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch daemon add", "daemon_type": "mon", "placement": "gibba045:172.21.2.145=b", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:40:14.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:14 gibba015 bash[13005]: cephadm 2021-03-10T13:40:12.582889+0000 mgr.y (mgr.14140) 24 : cephadm [INF] Deploying daemon mon.b on gibba045 2021-03-10T13:40:14.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:14 gibba015 bash[13005]: cluster 2021-03-10T13:40:13.074267+0000 mgr.y (mgr.14140) 25 : cluster [DBG] pgmap v19: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:40:16.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:16 gibba015 bash[9806]: cluster 2021-03-10T13:40:15.075035+0000 mgr.y (mgr.14140) 26 : cluster [DBG] pgmap v20: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:40:16.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:16 gibba015 bash[9806]: audit 2021-03-10T13:40:16.056190+0000 mon.a (mon.0) 139 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}}, \"last_device_update\": \"2021-03-10T13:39:54.262468\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:40:16.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:16 gibba015 bash[9806]: audit 2021-03-10T13:40:16.057501+0000 mon.a (mon.0) 140 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:40:16.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:16 gibba015 bash[9806]: audit 2021-03-10T13:40:16.063924+0000 mon.a (mon.0) 141 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}}, \"last_device_update\": \"2021-03-10T13:39:54.262468\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:40:16.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:16 gibba015 bash[13005]: cluster 2021-03-10T13:40:15.075035+0000 mgr.y (mgr.14140) 26 : cluster [DBG] pgmap v20: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:40:16.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:16 gibba015 bash[13005]: audit 2021-03-10T13:40:16.056190+0000 mon.a (mon.0) 139 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}}, \"last_device_update\": \"2021-03-10T13:39:54.262468\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:40:16.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:16 gibba015 bash[13005]: audit 2021-03-10T13:40:16.057501+0000 mon.a (mon.0) 140 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:40:16.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:16 gibba015 bash[13005]: audit 2021-03-10T13:40:16.063924+0000 mon.a (mon.0) 141 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}}, \"last_device_update\": \"2021-03-10T13:39:54.262468\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:40:16.589 INFO:teuthology.orchestra.run.gibba045.stdout:Deployed mon.b on host 'gibba045' 2021-03-10T13:40:17.237 DEBUG:teuthology.orchestra.run.gibba045:mon.b> sudo journalctl -f -n 0 -u ceph-e4a642d2-81a5-11eb-9080-001a4aab830c@mon.b.service 2021-03-10T13:40:17.239 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2021-03-10T13:40:17.240 DEBUG:teuthology.orchestra.run.gibba045:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e4a642d2-81a5-11eb-9080-001a4aab830c -- ceph mon dump -f json 2021-03-10T13:40:17.274 INFO:journalctl@ceph.mon.b.gibba045.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T13:40:17.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:17 gibba015 bash[9806]: audit 2021-03-10T13:40:16.259735+0000 mon.a (mon.0) 142 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:16.257836\", \"created\": \"2021-03-10T13:40:16.047558\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}}, \"last_daemon_update\": \"2021-03-10T13:40:16.258174\", \"last_device_update\": \"2021-03-10T13:39:54.262468\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:40:17.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:17 gibba015 bash[9806]: audit 2021-03-10T13:40:16.267675+0000 mon.a (mon.0) 143 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:16.257836\", \"created\": \"2021-03-10T13:40:16.047558\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}}, \"last_daemon_update\": \"2021-03-10T13:40:16.258174\", \"last_device_update\": \"2021-03-10T13:39:54.262468\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:40:17.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:17 gibba015 bash[13005]: audit 2021-03-10T13:40:16.259735+0000 mon.a (mon.0) 142 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:16.257836\", \"created\": \"2021-03-10T13:40:16.047558\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}}, \"last_daemon_update\": \"2021-03-10T13:40:16.258174\", \"last_device_update\": \"2021-03-10T13:39:54.262468\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:40:17.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:17 gibba015 bash[13005]: audit 2021-03-10T13:40:16.267675+0000 mon.a (mon.0) 143 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:16.257836\", \"created\": \"2021-03-10T13:40:16.047558\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}}, \"last_daemon_update\": \"2021-03-10T13:40:16.258174\", \"last_device_update\": \"2021-03-10T13:39:54.262468\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:40:17.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:17 gibba045 bash[9787]: debug 2021-03-10T13:40:17.247+0000 7fe1e5a2a700 0 mon.b@-1(synchronizing).mds e1 new map 2021-03-10T13:40:17.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:17 gibba045 bash[9787]: debug 2021-03-10T13:40:17.247+0000 7fe1e5a2a700 0 mon.b@-1(synchronizing).mds e1 print_map 2021-03-10T13:40:17.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:17 gibba045 bash[9787]: e1 2021-03-10T13:40:17.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:17 gibba045 bash[9787]: enable_multiple, ever_enabled_multiple: 0,0 2021-03-10T13:40:17.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:17 gibba045 bash[9787]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-03-10T13:40:17.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:17 gibba045 bash[9787]: legacy client fscid: -1 2021-03-10T13:40:17.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:17 gibba045 bash[9787]: 2021-03-10T13:40:17.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:17 gibba045 bash[9787]: No filesystems configured 2021-03-10T13:40:17.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:17 gibba045 bash[9787]: debug 2021-03-10T13:40:17.247+0000 7fe1e5a2a700 1 mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2021-03-10T13:40:17.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:17 gibba045 bash[9787]: debug 2021-03-10T13:40:17.247+0000 7fe1e5a2a700 1 mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2021-03-10T13:40:17.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:17 gibba045 bash[9787]: debug 2021-03-10T13:40:17.247+0000 7fe1e5a2a700 1 mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2021-03-10T13:40:17.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:17 gibba045 bash[9787]: debug 2021-03-10T13:40:17.247+0000 7fe1e5a2a700 1 mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2021-03-10T13:40:17.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:17 gibba045 bash[9787]: debug 2021-03-10T13:40:17.247+0000 7fe1e5a2a700 1 mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2021-03-10T13:40:17.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:17 gibba045 bash[9787]: debug 2021-03-10T13:40:17.247+0000 7fe1e5a2a700 1 mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2021-03-10T13:40:17.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:17 gibba045 bash[9787]: debug 2021-03-10T13:40:17.247+0000 7fe1e5a2a700 1 mon.b@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2021-03-10T13:40:17.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:17 gibba045 bash[9787]: debug 2021-03-10T13:40:17.247+0000 7fe1e5a2a700 1 mon.b@-1(synchronizing).osd e6 e6: 0 total, 0 up, 0 in 2021-03-10T13:40:17.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:17 gibba045 bash[9787]: debug 2021-03-10T13:40:17.247+0000 7fe1e5a2a700 0 mon.b@-1(synchronizing).osd e6 crush map has features 288514051259236352, adjusting msgr requires 2021-03-10T13:40:17.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:17 gibba045 bash[9787]: debug 2021-03-10T13:40:17.247+0000 7fe1e5a2a700 0 mon.b@-1(synchronizing).osd e6 crush map has features 288514051259236352, adjusting msgr requires 2021-03-10T13:40:17.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:17 gibba045 bash[9787]: debug 2021-03-10T13:40:17.247+0000 7fe1e5a2a700 0 mon.b@-1(synchronizing).osd e6 crush map has features 3314933000852226048, adjusting msgr requires 2021-03-10T13:40:17.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:17 gibba045 bash[9787]: debug 2021-03-10T13:40:17.247+0000 7fe1e5a2a700 0 mon.b@-1(synchronizing).osd e6 crush map has features 288514051259236352, adjusting msgr requires 2021-03-10T13:40:17.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:17 gibba045 bash[9787]: audit 2021-03-10T13:40:16.259735+0000 mon.a (mon.0) 142 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:16.257836\", \"created\": \"2021-03-10T13:40:16.047558\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}}, \"last_daemon_update\": \"2021-03-10T13:40:16.258174\", \"last_device_update\": \"2021-03-10T13:39:54.262468\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:40:17.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:17 gibba045 bash[9787]: audit 2021-03-10T13:40:16.267675+0000 mon.a (mon.0) 143 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:16.257836\", \"created\": \"2021-03-10T13:40:16.047558\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}}, \"last_daemon_update\": \"2021-03-10T13:40:16.258174\", \"last_device_update\": \"2021-03-10T13:39:54.262468\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:40:17.563 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:17 gibba045 bash[9787]: debug 2021-03-10T13:40:17.247+0000 7fe1e5a2a700 1 mon.b@-1(synchronizing).paxosservice(auth 1..5) refresh upgraded, format 0 -> 3 2021-03-10T13:40:17.563 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:17 gibba045 bash[9787]: debug 2021-03-10T13:40:17.247+0000 7fe1e5a2a700 10 mon.b@-1(synchronizing) e2 handle_conf_change mon_allow_pool_delete 2021-03-10T13:40:17.563 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:17 gibba045 bash[9787]: debug 2021-03-10T13:40:17.247+0000 7fe1e5a2a700 20 expand_channel_meta expand map: {default=false} 2021-03-10T13:40:17.563 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:17 gibba045 bash[9787]: debug 2021-03-10T13:40:17.247+0000 7fe1e5a2a700 20 expand_channel_meta from 'false' to 'false' 2021-03-10T13:40:17.563 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:17 gibba045 bash[9787]: debug 2021-03-10T13:40:17.247+0000 7fe1e5a2a700 20 expand_channel_meta expanded map: {default=false} 2021-03-10T13:40:17.564 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:17 gibba045 bash[9787]: debug 2021-03-10T13:40:17.247+0000 7fe1e5a2a700 20 expand_channel_meta expand map: {default=info} 2021-03-10T13:40:17.564 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:17 gibba045 bash[9787]: debug 2021-03-10T13:40:17.247+0000 7fe1e5a2a700 20 expand_channel_meta from 'info' to 'info' 2021-03-10T13:40:17.564 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:17 gibba045 bash[9787]: debug 2021-03-10T13:40:17.247+0000 7fe1e5a2a700 20 expand_channel_meta expanded map: {default=info} 2021-03-10T13:40:17.564 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:17 gibba045 bash[9787]: debug 2021-03-10T13:40:17.247+0000 7fe1e5a2a700 20 expand_channel_meta expand map: {default=daemon} 2021-03-10T13:40:17.565 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:17 gibba045 bash[9787]: debug 2021-03-10T13:40:17.247+0000 7fe1e5a2a700 20 expand_channel_meta from 'daemon' to 'daemon' 2021-03-10T13:40:17.565 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:17 gibba045 bash[9787]: debug 2021-03-10T13:40:17.247+0000 7fe1e5a2a700 20 expand_channel_meta expanded map: {default=daemon} 2021-03-10T13:40:17.565 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:17 gibba045 bash[9787]: debug 2021-03-10T13:40:17.247+0000 7fe1e5a2a700 20 expand_channel_meta expand map: {default=debug} 2021-03-10T13:40:17.565 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:17 gibba045 bash[9787]: debug 2021-03-10T13:40:17.247+0000 7fe1e5a2a700 20 expand_channel_meta from 'debug' to 'debug' 2021-03-10T13:40:17.565 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:17 gibba045 bash[9787]: debug 2021-03-10T13:40:17.247+0000 7fe1e5a2a700 20 expand_channel_meta expanded map: {default=debug} 2021-03-10T13:40:22.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:22 gibba015 bash[9806]: cluster 2021-03-10T13:40:17.075753+0000 mgr.y (mgr.14140) 27 : cluster [DBG] pgmap v21: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:40:22.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:22 gibba015 bash[9806]: cluster 2021-03-10T13:40:17.255153+0000 mon.a (mon.0) 144 : cluster [INF] mon.a calling monitor election 2021-03-10T13:40:22.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:22 gibba015 bash[9806]: cluster 2021-03-10T13:40:17.257110+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2021-03-10T13:40:22.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:22 gibba015 bash[9806]: cluster 2021-03-10T13:40:19.076700+0000 mgr.y (mgr.14140) 28 : cluster [DBG] pgmap v22: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:40:22.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:22 gibba015 bash[9806]: cluster 2021-03-10T13:40:19.256942+0000 mon.b (mon.2) 1 : cluster [INF] mon.b calling monitor election 2021-03-10T13:40:22.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:22 gibba015 bash[9806]: cluster 2021-03-10T13:40:21.077716+0000 mgr.y (mgr.14140) 29 : cluster [DBG] pgmap v23: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:40:22.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:22 gibba015 bash[9806]: cluster 2021-03-10T13:40:22.280406+0000 mon.a (mon.0) 145 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-03-10T13:40:22.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:22 gibba015 bash[9806]: cluster 2021-03-10T13:40:22.289900+0000 mon.a (mon.0) 146 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0],b=[v2:172.21.2.145:3300/0,v1:172.21.2.145:6789/0],c=[v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0]} 2021-03-10T13:40:22.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:22 gibba015 bash[9806]: cluster 2021-03-10T13:40:22.290046+0000 mon.a (mon.0) 147 : cluster [DBG] fsmap 2021-03-10T13:40:22.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:22 gibba015 bash[9806]: cluster 2021-03-10T13:40:22.290120+0000 mon.a (mon.0) 148 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2021-03-10T13:40:22.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:22 gibba015 bash[9806]: cluster 2021-03-10T13:40:22.290515+0000 mon.a (mon.0) 149 : cluster [DBG] mgrmap e13: y(active, since 59s) 2021-03-10T13:40:22.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:22 gibba015 bash[9806]: cluster 2021-03-10T13:40:22.293596+0000 mon.a (mon.0) 150 : cluster [INF] overall HEALTH_OK 2021-03-10T13:40:22.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:22 gibba015 bash[13005]: cluster 2021-03-10T13:40:17.075753+0000 mgr.y (mgr.14140) 27 : cluster [DBG] pgmap v21: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:40:22.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:22 gibba015 bash[13005]: cluster 2021-03-10T13:40:17.255153+0000 mon.a (mon.0) 144 : cluster [INF] mon.a calling monitor election 2021-03-10T13:40:22.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:22 gibba015 bash[13005]: cluster 2021-03-10T13:40:17.257110+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2021-03-10T13:40:22.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:22 gibba015 bash[13005]: cluster 2021-03-10T13:40:19.076700+0000 mgr.y (mgr.14140) 28 : cluster [DBG] pgmap v22: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:40:22.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:22 gibba015 bash[13005]: cluster 2021-03-10T13:40:19.256942+0000 mon.b (mon.2) 1 : cluster [INF] mon.b calling monitor election 2021-03-10T13:40:22.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:22 gibba015 bash[13005]: cluster 2021-03-10T13:40:21.077716+0000 mgr.y (mgr.14140) 29 : cluster [DBG] pgmap v23: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:40:22.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:22 gibba015 bash[13005]: cluster 2021-03-10T13:40:22.280406+0000 mon.a (mon.0) 145 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-03-10T13:40:22.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:22 gibba015 bash[13005]: cluster 2021-03-10T13:40:22.289900+0000 mon.a (mon.0) 146 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0],b=[v2:172.21.2.145:3300/0,v1:172.21.2.145:6789/0],c=[v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0]} 2021-03-10T13:40:22.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:22 gibba015 bash[13005]: cluster 2021-03-10T13:40:22.290046+0000 mon.a (mon.0) 147 : cluster [DBG] fsmap 2021-03-10T13:40:22.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:22 gibba015 bash[13005]: cluster 2021-03-10T13:40:22.290120+0000 mon.a (mon.0) 148 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2021-03-10T13:40:22.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:22 gibba015 bash[13005]: cluster 2021-03-10T13:40:22.290515+0000 mon.a (mon.0) 149 : cluster [DBG] mgrmap e13: y(active, since 59s) 2021-03-10T13:40:22.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:22 gibba015 bash[13005]: cluster 2021-03-10T13:40:22.293596+0000 mon.a (mon.0) 150 : cluster [INF] overall HEALTH_OK 2021-03-10T13:40:22.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:22 gibba045 bash[9787]: cluster 2021-03-10T13:40:17.075753+0000 mgr.y (mgr.14140) 27 : cluster [DBG] pgmap v21: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:40:22.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:22 gibba045 bash[9787]: cluster 2021-03-10T13:40:17.255153+0000 mon.a (mon.0) 144 : cluster [INF] mon.a calling monitor election 2021-03-10T13:40:22.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:22 gibba045 bash[9787]: cluster 2021-03-10T13:40:17.257110+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2021-03-10T13:40:22.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:22 gibba045 bash[9787]: cluster 2021-03-10T13:40:19.076700+0000 mgr.y (mgr.14140) 28 : cluster [DBG] pgmap v22: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:40:22.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:22 gibba045 bash[9787]: cluster 2021-03-10T13:40:19.256942+0000 mon.b (mon.2) 1 : cluster [INF] mon.b calling monitor election 2021-03-10T13:40:22.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:22 gibba045 bash[9787]: cluster 2021-03-10T13:40:21.077716+0000 mgr.y (mgr.14140) 29 : cluster [DBG] pgmap v23: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:40:22.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:22 gibba045 bash[9787]: cluster 2021-03-10T13:40:22.280406+0000 mon.a (mon.0) 145 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-03-10T13:40:22.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:22 gibba045 bash[9787]: cluster 2021-03-10T13:40:22.289900+0000 mon.a (mon.0) 146 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0],b=[v2:172.21.2.145:3300/0,v1:172.21.2.145:6789/0],c=[v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0]} 2021-03-10T13:40:22.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:22 gibba045 bash[9787]: cluster 2021-03-10T13:40:22.290046+0000 mon.a (mon.0) 147 : cluster [DBG] fsmap 2021-03-10T13:40:22.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:22 gibba045 bash[9787]: cluster 2021-03-10T13:40:22.290120+0000 mon.a (mon.0) 148 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2021-03-10T13:40:22.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:22 gibba045 bash[9787]: cluster 2021-03-10T13:40:22.290515+0000 mon.a (mon.0) 149 : cluster [DBG] mgrmap e13: y(active, since 59s) 2021-03-10T13:40:22.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:22 gibba045 bash[9787]: cluster 2021-03-10T13:40:22.293596+0000 mon.a (mon.0) 150 : cluster [INF] overall HEALTH_OK 2021-03-10T13:40:23.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:23 gibba015 bash[9806]: cluster 2021-03-10T13:40:23.354247+0000 mon.a (mon.0) 151 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2021-03-10T13:40:23.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:23 gibba015 bash[13005]: cluster 2021-03-10T13:40:23.354247+0000 mon.a (mon.0) 151 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2021-03-10T13:40:23.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:23 gibba045 bash[9787]: cluster 2021-03-10T13:40:23.354247+0000 mon.a (mon.0) 151 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2021-03-10T13:40:23.871 INFO:teuthology.orchestra.run.gibba045.stdout: 2021-03-10T13:40:23.871 INFO:teuthology.orchestra.run.gibba045.stdout:{"epoch":3,"fsid":"e4a642d2-81a5-11eb-9080-001a4aab830c","modified":"2021-03-10T13:40:17.249497Z","created":"2021-03-10T13:38:48.184244Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:3300","nonce":0},{"type":"v1","addr":"172.21.2.115:6789","nonce":0}]},"addr":"172.21.2.115:6789/0","public_addr":"172.21.2.115:6789/0","priority":0,"weight":0},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:3301","nonce":0},{"type":"v1","addr":"172.21.2.115:6790","nonce":0}]},"addr":"172.21.2.115:6790/0","public_addr":"172.21.2.115:6790/0","priority":0,"weight":0},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.145:3300","nonce":0},{"type":"v1","addr":"172.21.2.145:6789","nonce":0}]},"addr":"172.21.2.145:6789/0","public_addr":"172.21.2.145:6789/0","priority":0,"weight":0}],"quorum":[0,1,2]} 2021-03-10T13:40:23.873 INFO:teuthology.orchestra.run.gibba045.stderr:dumped monmap epoch 3 2021-03-10T13:40:24.447 INFO:tasks.cephadm:Generating final ceph.conf file... 2021-03-10T13:40:24.448 DEBUG:teuthology.orchestra.run.gibba015:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e4a642d2-81a5-11eb-9080-001a4aab830c -- ceph config generate-minimal-conf 2021-03-10T13:40:24.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:24 gibba015 bash[9806]: cluster 2021-03-10T13:40:23.078614+0000 mgr.y (mgr.14140) 30 : cluster [DBG] pgmap v24: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:40:24.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:24 gibba015 bash[9806]: audit 2021-03-10T13:40:23.866587+0000 mon.a (mon.0) 152 : audit [DBG] from='client.? 172.21.2.145:0/2140269559' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-03-10T13:40:24.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:24 gibba015 bash[13005]: cluster 2021-03-10T13:40:23.078614+0000 mgr.y (mgr.14140) 30 : cluster [DBG] pgmap v24: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:40:24.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:24 gibba015 bash[13005]: audit 2021-03-10T13:40:23.866587+0000 mon.a (mon.0) 152 : audit [DBG] from='client.? 172.21.2.145:0/2140269559' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-03-10T13:40:24.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:24 gibba045 bash[9787]: cluster 2021-03-10T13:40:23.078614+0000 mgr.y (mgr.14140) 30 : cluster [DBG] pgmap v24: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:40:24.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:24 gibba045 bash[9787]: audit 2021-03-10T13:40:23.866587+0000 mon.a (mon.0) 152 : audit [DBG] from='client.? 172.21.2.145:0/2140269559' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-03-10T13:40:26.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:26 gibba015 bash[9806]: cluster 2021-03-10T13:40:25.079428+0000 mgr.y (mgr.14140) 31 : cluster [DBG] pgmap v25: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:40:26.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:26 gibba015 bash[13005]: cluster 2021-03-10T13:40:25.079428+0000 mgr.y (mgr.14140) 31 : cluster [DBG] pgmap v25: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:40:26.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:26 gibba045 bash[9787]: cluster 2021-03-10T13:40:25.079428+0000 mgr.y (mgr.14140) 31 : cluster [DBG] pgmap v25: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:40:26.833 INFO:teuthology.orchestra.run.gibba015.stdout:# minimal ceph.conf for e4a642d2-81a5-11eb-9080-001a4aab830c 2021-03-10T13:40:26.833 INFO:teuthology.orchestra.run.gibba015.stdout:[global] 2021-03-10T13:40:26.833 INFO:teuthology.orchestra.run.gibba015.stdout: fsid = e4a642d2-81a5-11eb-9080-001a4aab830c 2021-03-10T13:40:26.833 INFO:teuthology.orchestra.run.gibba015.stdout: mon_host = [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] [v2:172.21.2.145:3300/0,v1:172.21.2.145:6789/0] [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] 2021-03-10T13:40:27.363 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2021-03-10T13:40:27.364 DEBUG:teuthology.orchestra.run.gibba015:> set -ex 2021-03-10T13:40:27.364 DEBUG:teuthology.orchestra.run.gibba015:> sudo dd of=/etc/ceph/ceph.conf 2021-03-10T13:40:27.371 DEBUG:teuthology.orchestra.run.gibba015:> set -ex 2021-03-10T13:40:27.371 DEBUG:teuthology.orchestra.run.gibba015:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2021-03-10T13:40:27.378 DEBUG:teuthology.orchestra.run.gibba045:> set -ex 2021-03-10T13:40:27.379 DEBUG:teuthology.orchestra.run.gibba045:> sudo dd of=/etc/ceph/ceph.conf 2021-03-10T13:40:27.390 DEBUG:teuthology.orchestra.run.gibba045:> set -ex 2021-03-10T13:40:27.391 DEBUG:teuthology.orchestra.run.gibba045:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2021-03-10T13:40:27.397 INFO:tasks.cephadm:Adding mgr.y on gibba015 2021-03-10T13:40:27.397 INFO:tasks.cephadm:Adding mgr.x on gibba045 2021-03-10T13:40:27.397 DEBUG:teuthology.orchestra.run.gibba045:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e4a642d2-81a5-11eb-9080-001a4aab830c -- ceph orch apply mgr '3;gibba015=y;gibba045=x' 2021-03-10T13:40:27.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:27 gibba015 bash[9806]: audit 2021-03-10T13:40:26.829532+0000 mon.a (mon.0) 153 : audit [DBG] from='client.? 172.21.2.115:0/346052304' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:40:27.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:27 gibba015 bash[13005]: audit 2021-03-10T13:40:26.829532+0000 mon.a (mon.0) 153 : audit [DBG] from='client.? 172.21.2.115:0/346052304' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:40:27.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:27 gibba045 bash[9787]: audit 2021-03-10T13:40:26.829532+0000 mon.a (mon.0) 153 : audit [DBG] from='client.? 172.21.2.115:0/346052304' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:40:28.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:28 gibba015 bash[9806]: cluster 2021-03-10T13:40:27.080308+0000 mgr.y (mgr.14140) 32 : cluster [DBG] pgmap v26: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:40:28.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:28 gibba015 bash[13005]: cluster 2021-03-10T13:40:27.080308+0000 mgr.y (mgr.14140) 32 : cluster [DBG] pgmap v26: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:40:28.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:28 gibba045 bash[9787]: cluster 2021-03-10T13:40:27.080308+0000 mgr.y (mgr.14140) 32 : cluster [DBG] pgmap v26: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:40:29.817 INFO:teuthology.orchestra.run.gibba045.stdout:Scheduled mgr update... 2021-03-10T13:40:30.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:30 gibba015 bash[9806]: cluster 2021-03-10T13:40:29.081464+0000 mgr.y (mgr.14140) 33 : cluster [DBG] pgmap v27: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:40:30.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:30 gibba015 bash[9806]: audit 2021-03-10T13:40:29.800382+0000 mgr.y (mgr.14140) 34 : audit [DBG] from='client.34103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;gibba015=y;gibba045=x", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:40:30.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:30 gibba015 bash[9806]: cephadm 2021-03-10T13:40:29.801858+0000 mgr.y (mgr.14140) 35 : cephadm [INF] Saving service mgr spec with placement count:3 gibba015=y,gibba045=x 2021-03-10T13:40:30.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:30 gibba015 bash[9806]: audit 2021-03-10T13:40:29.802897+0000 mon.a (mon.0) 154 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2021-03-10T13:40:29.801898\", \"spec\": {\"placement\": {\"count\": 3, \"hosts\": [{\"hostname\": \"gibba015\", \"name\": \"y\", \"network\": \"\"}, {\"hostname\": \"gibba045\", \"name\": \"x\", \"network\": \"\"}]}, \"service_type\": \"mgr\"}}"}]: dispatch 2021-03-10T13:40:30.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:30 gibba015 bash[9806]: audit 2021-03-10T13:40:29.810682+0000 mon.a (mon.0) 155 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2021-03-10T13:40:29.801898\", \"spec\": {\"placement\": {\"count\": 3, \"hosts\": [{\"hostname\": \"gibba015\", \"name\": \"y\", \"network\": \"\"}, {\"hostname\": \"gibba045\", \"name\": \"x\", \"network\": \"\"}]}, \"service_type\": \"mgr\"}}"}]': finished 2021-03-10T13:40:30.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:30 gibba015 bash[9806]: audit 2021-03-10T13:40:29.815554+0000 mon.a (mon.0) 156 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:40:30.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:30 gibba015 bash[9806]: audit 2021-03-10T13:40:29.823604+0000 mon.a (mon.0) 157 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2021-03-10T13:40:30.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:30 gibba015 bash[9806]: audit 2021-03-10T13:40:29.826418+0000 mon.a (mon.0) 158 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:40:30.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:30 gibba015 bash[9806]: cephadm 2021-03-10T13:40:29.828744+0000 mgr.y (mgr.14140) 36 : cephadm [INF] Deploying daemon mgr.x on gibba045 2021-03-10T13:40:30.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:30 gibba015 bash[9806]: audit 2021-03-10T13:40:29.829659+0000 mon.a (mon.0) 159 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2021-03-10T13:40:30.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:30 gibba015 bash[13005]: cluster 2021-03-10T13:40:29.081464+0000 mgr.y (mgr.14140) 33 : cluster [DBG] pgmap v27: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:40:30.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:30 gibba015 bash[13005]: audit 2021-03-10T13:40:29.800382+0000 mgr.y (mgr.14140) 34 : audit [DBG] from='client.34103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;gibba015=y;gibba045=x", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:40:30.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:30 gibba015 bash[13005]: cephadm 2021-03-10T13:40:29.801858+0000 mgr.y (mgr.14140) 35 : cephadm [INF] Saving service mgr spec with placement count:3 gibba015=y,gibba045=x 2021-03-10T13:40:30.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:30 gibba015 bash[13005]: audit 2021-03-10T13:40:29.802897+0000 mon.a (mon.0) 154 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2021-03-10T13:40:29.801898\", \"spec\": {\"placement\": {\"count\": 3, \"hosts\": [{\"hostname\": \"gibba015\", \"name\": \"y\", \"network\": \"\"}, {\"hostname\": \"gibba045\", \"name\": \"x\", \"network\": \"\"}]}, \"service_type\": \"mgr\"}}"}]: dispatch 2021-03-10T13:40:30.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:30 gibba015 bash[13005]: audit 2021-03-10T13:40:29.810682+0000 mon.a (mon.0) 155 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2021-03-10T13:40:29.801898\", \"spec\": {\"placement\": {\"count\": 3, \"hosts\": [{\"hostname\": \"gibba015\", \"name\": \"y\", \"network\": \"\"}, {\"hostname\": \"gibba045\", \"name\": \"x\", \"network\": \"\"}]}, \"service_type\": \"mgr\"}}"}]': finished 2021-03-10T13:40:30.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:30 gibba015 bash[13005]: audit 2021-03-10T13:40:29.815554+0000 mon.a (mon.0) 156 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:40:30.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:30 gibba015 bash[13005]: audit 2021-03-10T13:40:29.823604+0000 mon.a (mon.0) 157 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2021-03-10T13:40:30.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:30 gibba015 bash[13005]: audit 2021-03-10T13:40:29.826418+0000 mon.a (mon.0) 158 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:40:30.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:30 gibba015 bash[13005]: cephadm 2021-03-10T13:40:29.828744+0000 mgr.y (mgr.14140) 36 : cephadm [INF] Deploying daemon mgr.x on gibba045 2021-03-10T13:40:30.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:30 gibba015 bash[13005]: audit 2021-03-10T13:40:29.829659+0000 mon.a (mon.0) 159 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2021-03-10T13:40:30.792 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:30 gibba045 bash[9787]: cluster 2021-03-10T13:40:29.081464+0000 mgr.y (mgr.14140) 33 : cluster [DBG] pgmap v27: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:40:30.793 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:30 gibba045 bash[9787]: audit 2021-03-10T13:40:29.800382+0000 mgr.y (mgr.14140) 34 : audit [DBG] from='client.34103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;gibba015=y;gibba045=x", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:40:30.793 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:30 gibba045 bash[9787]: cephadm 2021-03-10T13:40:29.801858+0000 mgr.y (mgr.14140) 35 : cephadm [INF] Saving service mgr spec with placement count:3 gibba015=y,gibba045=x 2021-03-10T13:40:30.793 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:30 gibba045 bash[9787]: audit 2021-03-10T13:40:29.802897+0000 mon.a (mon.0) 154 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2021-03-10T13:40:29.801898\", \"spec\": {\"placement\": {\"count\": 3, \"hosts\": [{\"hostname\": \"gibba015\", \"name\": \"y\", \"network\": \"\"}, {\"hostname\": \"gibba045\", \"name\": \"x\", \"network\": \"\"}]}, \"service_type\": \"mgr\"}}"}]: dispatch 2021-03-10T13:40:30.794 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:30 gibba045 bash[9787]: audit 2021-03-10T13:40:29.810682+0000 mon.a (mon.0) 155 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2021-03-10T13:40:29.801898\", \"spec\": {\"placement\": {\"count\": 3, \"hosts\": [{\"hostname\": \"gibba015\", \"name\": \"y\", \"network\": \"\"}, {\"hostname\": \"gibba045\", \"name\": \"x\", \"network\": \"\"}]}, \"service_type\": \"mgr\"}}"}]': finished 2021-03-10T13:40:30.794 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:30 gibba045 bash[9787]: audit 2021-03-10T13:40:29.815554+0000 mon.a (mon.0) 156 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:40:30.794 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:30 gibba045 bash[9787]: audit 2021-03-10T13:40:29.823604+0000 mon.a (mon.0) 157 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2021-03-10T13:40:30.794 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:30 gibba045 bash[9787]: audit 2021-03-10T13:40:29.826418+0000 mon.a (mon.0) 158 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:40:30.795 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:30 gibba045 bash[9787]: cephadm 2021-03-10T13:40:29.828744+0000 mgr.y (mgr.14140) 36 : cephadm [INF] Deploying daemon mgr.x on gibba045 2021-03-10T13:40:30.795 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:30 gibba045 bash[9787]: audit 2021-03-10T13:40:29.829659+0000 mon.a (mon.0) 159 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2021-03-10T13:40:30.796 DEBUG:teuthology.orchestra.run.gibba045:mgr.x> sudo journalctl -f -n 0 -u ceph-e4a642d2-81a5-11eb-9080-001a4aab830c@mgr.x.service 2021-03-10T13:40:30.799 INFO:tasks.cephadm:Deploying OSDs... 2021-03-10T13:40:30.799 DEBUG:teuthology.orchestra.run.gibba015:> set -ex 2021-03-10T13:40:30.800 DEBUG:teuthology.orchestra.run.gibba015:> dd if=/scratch_devs of=/dev/stdout 2021-03-10T13:40:30.809 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-03-10T13:40:30.809 DEBUG:teuthology.orchestra.run.gibba015:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-03-10T13:40:30.816 INFO:journalctl@ceph.mgr.x.gibba045.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T13:40:30.855 INFO:teuthology.orchestra.run.gibba015.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-03-10T13:40:30.855 INFO:teuthology.orchestra.run.gibba015.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-03-10T13:40:30.856 INFO:teuthology.orchestra.run.gibba015.stdout:Device: 6h/6d Inode: 347 Links: 1 2021-03-10T13:40:30.856 INFO:teuthology.orchestra.run.gibba015.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-03-10T13:40:30.856 INFO:teuthology.orchestra.run.gibba015.stdout:Access: 2021-03-10 13:37:48.462223339 +0000 2021-03-10T13:40:30.856 INFO:teuthology.orchestra.run.gibba015.stdout:Modify: 2021-03-10 13:37:48.290223340 +0000 2021-03-10T13:40:30.857 INFO:teuthology.orchestra.run.gibba015.stdout:Change: 2021-03-10 13:37:48.290223340 +0000 2021-03-10T13:40:30.857 INFO:teuthology.orchestra.run.gibba015.stdout: Birth: - 2021-03-10T13:40:30.859 INFO:teuthology.orchestra.run.gibba015.stderr:1+0 records in 2021-03-10T13:40:30.859 INFO:teuthology.orchestra.run.gibba015.stderr:1+0 records out 2021-03-10T13:40:30.860 INFO:teuthology.orchestra.run.gibba015.stderr:512 bytes copied, 0.000209572 s, 2.4 MB/s 2021-03-10T13:40:30.862 DEBUG:teuthology.orchestra.run.gibba015:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-03-10T13:40:30.866 INFO:teuthology.orchestra.run.gibba015.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-03-10T13:40:30.867 INFO:teuthology.orchestra.run.gibba015.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-03-10T13:40:30.867 INFO:teuthology.orchestra.run.gibba015.stdout:Device: 6h/6d Inode: 352 Links: 1 2021-03-10T13:40:30.867 INFO:teuthology.orchestra.run.gibba015.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-03-10T13:40:30.867 INFO:teuthology.orchestra.run.gibba015.stdout:Access: 2021-03-10 13:37:48.842223338 +0000 2021-03-10T13:40:30.868 INFO:teuthology.orchestra.run.gibba015.stdout:Modify: 2021-03-10 13:37:48.742223339 +0000 2021-03-10T13:40:30.868 INFO:teuthology.orchestra.run.gibba015.stdout:Change: 2021-03-10 13:37:48.742223339 +0000 2021-03-10T13:40:30.868 INFO:teuthology.orchestra.run.gibba015.stdout: Birth: - 2021-03-10T13:40:30.872 INFO:teuthology.orchestra.run.gibba015.stderr:1+0 records in 2021-03-10T13:40:30.872 INFO:teuthology.orchestra.run.gibba015.stderr:1+0 records out 2021-03-10T13:40:30.872 INFO:teuthology.orchestra.run.gibba015.stderr:512 bytes copied, 0.000260775 s, 2.0 MB/s 2021-03-10T13:40:30.875 DEBUG:teuthology.orchestra.run.gibba015:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-03-10T13:40:30.882 INFO:teuthology.orchestra.run.gibba015.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-03-10T13:40:30.882 INFO:teuthology.orchestra.run.gibba015.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-03-10T13:40:30.882 INFO:teuthology.orchestra.run.gibba015.stdout:Device: 6h/6d Inode: 359 Links: 1 2021-03-10T13:40:30.882 INFO:teuthology.orchestra.run.gibba015.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-03-10T13:40:30.883 INFO:teuthology.orchestra.run.gibba015.stdout:Access: 2021-03-10 13:37:49.270223337 +0000 2021-03-10T13:40:30.883 INFO:teuthology.orchestra.run.gibba015.stdout:Modify: 2021-03-10 13:37:49.074223337 +0000 2021-03-10T13:40:30.883 INFO:teuthology.orchestra.run.gibba015.stdout:Change: 2021-03-10 13:37:49.074223337 +0000 2021-03-10T13:40:30.883 INFO:teuthology.orchestra.run.gibba015.stdout: Birth: - 2021-03-10T13:40:30.889 INFO:teuthology.orchestra.run.gibba015.stderr:1+0 records in 2021-03-10T13:40:30.889 INFO:teuthology.orchestra.run.gibba015.stderr:1+0 records out 2021-03-10T13:40:30.890 INFO:teuthology.orchestra.run.gibba015.stderr:512 bytes copied, 0.000236228 s, 2.2 MB/s 2021-03-10T13:40:30.891 DEBUG:teuthology.orchestra.run.gibba015:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-03-10T13:40:30.895 INFO:teuthology.orchestra.run.gibba015.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-03-10T13:40:30.895 INFO:teuthology.orchestra.run.gibba015.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-03-10T13:40:30.895 INFO:teuthology.orchestra.run.gibba015.stdout:Device: 6h/6d Inode: 366 Links: 1 2021-03-10T13:40:30.895 INFO:teuthology.orchestra.run.gibba015.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-03-10T13:40:30.896 INFO:teuthology.orchestra.run.gibba015.stdout:Access: 2021-03-10 13:37:49.654223335 +0000 2021-03-10T13:40:30.896 INFO:teuthology.orchestra.run.gibba015.stdout:Modify: 2021-03-10 13:37:49.506223336 +0000 2021-03-10T13:40:30.896 INFO:teuthology.orchestra.run.gibba015.stdout:Change: 2021-03-10 13:37:49.506223336 +0000 2021-03-10T13:40:30.896 INFO:teuthology.orchestra.run.gibba015.stdout: Birth: - 2021-03-10T13:40:30.897 INFO:teuthology.orchestra.run.gibba015.stderr:1+0 records in 2021-03-10T13:40:30.898 INFO:teuthology.orchestra.run.gibba015.stderr:1+0 records out 2021-03-10T13:40:30.898 INFO:teuthology.orchestra.run.gibba015.stderr:512 bytes copied, 0.000226809 s, 2.3 MB/s 2021-03-10T13:40:30.899 DEBUG:teuthology.orchestra.run.gibba045:> set -ex 2021-03-10T13:40:30.899 DEBUG:teuthology.orchestra.run.gibba045:> dd if=/scratch_devs of=/dev/stdout 2021-03-10T13:40:30.908 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-03-10T13:40:30.909 DEBUG:teuthology.orchestra.run.gibba045:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-03-10T13:40:30.960 INFO:teuthology.orchestra.run.gibba045.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-03-10T13:40:30.961 INFO:teuthology.orchestra.run.gibba045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-03-10T13:40:30.961 INFO:teuthology.orchestra.run.gibba045.stdout:Device: 6h/6d Inode: 344 Links: 1 2021-03-10T13:40:30.961 INFO:teuthology.orchestra.run.gibba045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-03-10T13:40:30.961 INFO:teuthology.orchestra.run.gibba045.stdout:Access: 2021-03-10 13:37:48.171476838 +0000 2021-03-10T13:40:30.961 INFO:teuthology.orchestra.run.gibba045.stdout:Modify: 2021-03-10 13:37:48.007476838 +0000 2021-03-10T13:40:30.962 INFO:teuthology.orchestra.run.gibba045.stdout:Change: 2021-03-10 13:37:48.007476838 +0000 2021-03-10T13:40:30.962 INFO:teuthology.orchestra.run.gibba045.stdout: Birth: - 2021-03-10T13:40:30.968 INFO:teuthology.orchestra.run.gibba045.stderr:1+0 records in 2021-03-10T13:40:30.968 INFO:teuthology.orchestra.run.gibba045.stderr:1+0 records out 2021-03-10T13:40:30.968 INFO:teuthology.orchestra.run.gibba045.stderr:512 bytes copied, 0.000190179 s, 2.7 MB/s 2021-03-10T13:40:30.969 DEBUG:teuthology.orchestra.run.gibba045:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-03-10T13:40:30.973 INFO:teuthology.orchestra.run.gibba045.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-03-10T13:40:30.973 INFO:teuthology.orchestra.run.gibba045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-03-10T13:40:30.974 INFO:teuthology.orchestra.run.gibba045.stdout:Device: 6h/6d Inode: 350 Links: 1 2021-03-10T13:40:30.974 INFO:teuthology.orchestra.run.gibba045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-03-10T13:40:30.974 INFO:teuthology.orchestra.run.gibba045.stdout:Access: 2021-03-10 13:37:48.575476836 +0000 2021-03-10T13:40:30.974 INFO:teuthology.orchestra.run.gibba045.stdout:Modify: 2021-03-10 13:37:48.423476837 +0000 2021-03-10T13:40:30.975 INFO:teuthology.orchestra.run.gibba045.stdout:Change: 2021-03-10 13:37:48.423476837 +0000 2021-03-10T13:40:30.975 INFO:teuthology.orchestra.run.gibba045.stdout: Birth: - 2021-03-10T13:40:30.976 INFO:teuthology.orchestra.run.gibba045.stderr:1+0 records in 2021-03-10T13:40:30.976 INFO:teuthology.orchestra.run.gibba045.stderr:1+0 records out 2021-03-10T13:40:30.976 INFO:teuthology.orchestra.run.gibba045.stderr:512 bytes copied, 0.000199627 s, 2.6 MB/s 2021-03-10T13:40:30.977 DEBUG:teuthology.orchestra.run.gibba045:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-03-10T13:40:30.980 INFO:teuthology.orchestra.run.gibba045.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-03-10T13:40:30.981 INFO:teuthology.orchestra.run.gibba045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-03-10T13:40:30.981 INFO:teuthology.orchestra.run.gibba045.stdout:Device: 6h/6d Inode: 360 Links: 1 2021-03-10T13:40:30.981 INFO:teuthology.orchestra.run.gibba045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-03-10T13:40:30.981 INFO:teuthology.orchestra.run.gibba045.stdout:Access: 2021-03-10 13:37:48.939476835 +0000 2021-03-10T13:40:30.982 INFO:teuthology.orchestra.run.gibba045.stdout:Modify: 2021-03-10 13:37:48.815476835 +0000 2021-03-10T13:40:30.982 INFO:teuthology.orchestra.run.gibba045.stdout:Change: 2021-03-10 13:37:48.815476835 +0000 2021-03-10T13:40:30.982 INFO:teuthology.orchestra.run.gibba045.stdout: Birth: - 2021-03-10T13:40:30.983 INFO:teuthology.orchestra.run.gibba045.stderr:1+0 records in 2021-03-10T13:40:30.983 INFO:teuthology.orchestra.run.gibba045.stderr:1+0 records out 2021-03-10T13:40:30.983 INFO:teuthology.orchestra.run.gibba045.stderr:512 bytes copied, 0.000153722 s, 3.3 MB/s 2021-03-10T13:40:30.985 DEBUG:teuthology.orchestra.run.gibba045:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-03-10T13:40:30.988 INFO:teuthology.orchestra.run.gibba045.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-03-10T13:40:30.989 INFO:teuthology.orchestra.run.gibba045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-03-10T13:40:30.989 INFO:teuthology.orchestra.run.gibba045.stdout:Device: 6h/6d Inode: 364 Links: 1 2021-03-10T13:40:30.989 INFO:teuthology.orchestra.run.gibba045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-03-10T13:40:30.989 INFO:teuthology.orchestra.run.gibba045.stdout:Access: 2021-03-10 13:37:49.311476833 +0000 2021-03-10T13:40:30.990 INFO:teuthology.orchestra.run.gibba045.stdout:Modify: 2021-03-10 13:37:49.171476834 +0000 2021-03-10T13:40:30.990 INFO:teuthology.orchestra.run.gibba045.stdout:Change: 2021-03-10 13:37:49.171476834 +0000 2021-03-10T13:40:30.990 INFO:teuthology.orchestra.run.gibba045.stdout: Birth: - 2021-03-10T13:40:30.992 INFO:teuthology.orchestra.run.gibba045.stderr:1+0 records in 2021-03-10T13:40:30.992 INFO:teuthology.orchestra.run.gibba045.stderr:1+0 records out 2021-03-10T13:40:30.992 INFO:teuthology.orchestra.run.gibba045.stderr:512 bytes copied, 0.000170367 s, 3.0 MB/s 2021-03-10T13:40:30.994 INFO:tasks.cephadm:Deploying osd.0 on gibba015 with /dev/vg_nvme/lv_4... 2021-03-10T13:40:30.994 DEBUG:teuthology.orchestra.run.gibba015:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e4a642d2-81a5-11eb-9080-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2021-03-10T13:40:32.306 INFO:journalctl@ceph.mgr.x.gibba045.stdout:Mar 10 13:40:32 gibba045 docker[10393]: Error: No such container: ceph-e4a642d2-81a5-11eb-9080-001a4aab830c-mgr.x 2021-03-10T13:40:32.307 INFO:journalctl@ceph.mgr.x.gibba045.stdout:Mar 10 13:40:32 gibba045 systemd[1]: Started Ceph mgr.x for e4a642d2-81a5-11eb-9080-001a4aab830c. 2021-03-10T13:40:32.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:32 gibba015 bash[9806]: cluster 2021-03-10T13:40:31.081859+0000 mgr.y (mgr.14140) 37 : cluster [DBG] pgmap v28: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:40:32.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:32 gibba015 bash[9806]: audit 2021-03-10T13:40:32.026207+0000 mon.a (mon.0) 160 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:16.257836\", \"created\": \"2021-03-10T13:40:16.047558\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}}, \"last_device_update\": \"2021-03-10T13:39:54.262468\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:40:32.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:32 gibba015 bash[13005]: cluster 2021-03-10T13:40:31.081859+0000 mgr.y (mgr.14140) 37 : cluster [DBG] pgmap v28: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:40:32.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:32 gibba015 bash[13005]: audit 2021-03-10T13:40:32.026207+0000 mon.a (mon.0) 160 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:16.257836\", \"created\": \"2021-03-10T13:40:16.047558\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}}, \"last_device_update\": \"2021-03-10T13:39:54.262468\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:40:32.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:32 gibba015 bash[9806]: audit 2021-03-10T13:40:32.033948+0000 mon.a (mon.0) 161 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:16.257836\", \"created\": \"2021-03-10T13:40:16.047558\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}}, \"last_device_update\": \"2021-03-10T13:39:54.262468\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:40:32.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:32 gibba015 bash[9806]: audit 2021-03-10T13:40:32.035458+0000 mon.a (mon.0) 162 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.gibba045.orlgmj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:40:32.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:32 gibba015 bash[9806]: audit 2021-03-10T13:40:32.037490+0000 mon.a (mon.0) 163 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.gibba045.orlgmj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2021-03-10T13:40:32.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:32 gibba015 bash[9806]: audit 2021-03-10T13:40:32.038292+0000 mon.a (mon.0) 164 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:40:32.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:32 gibba015 bash[9806]: cephadm 2021-03-10T13:40:32.038669+0000 mgr.y (mgr.14140) 38 : cephadm [INF] Deploying daemon mgr.gibba045.orlgmj on gibba045 2021-03-10T13:40:32.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:32 gibba015 bash[9806]: audit 2021-03-10T13:40:32.038918+0000 mon.a (mon.0) 165 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.gibba045.orlgmj", "key": "container_image"}]: dispatch 2021-03-10T13:40:32.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:32 gibba015 bash[13005]: audit 2021-03-10T13:40:32.033948+0000 mon.a (mon.0) 161 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:16.257836\", \"created\": \"2021-03-10T13:40:16.047558\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}}, \"last_device_update\": \"2021-03-10T13:39:54.262468\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:40:32.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:32 gibba015 bash[13005]: audit 2021-03-10T13:40:32.035458+0000 mon.a (mon.0) 162 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.gibba045.orlgmj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:40:32.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:32 gibba015 bash[13005]: audit 2021-03-10T13:40:32.037490+0000 mon.a (mon.0) 163 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.gibba045.orlgmj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2021-03-10T13:40:32.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:32 gibba015 bash[13005]: audit 2021-03-10T13:40:32.038292+0000 mon.a (mon.0) 164 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:40:32.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:32 gibba015 bash[13005]: cephadm 2021-03-10T13:40:32.038669+0000 mgr.y (mgr.14140) 38 : cephadm [INF] Deploying daemon mgr.gibba045.orlgmj on gibba045 2021-03-10T13:40:32.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:32 gibba015 bash[13005]: audit 2021-03-10T13:40:32.038918+0000 mon.a (mon.0) 165 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.gibba045.orlgmj", "key": "container_image"}]: dispatch 2021-03-10T13:40:32.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:32 gibba045 bash[9787]: cluster 2021-03-10T13:40:31.081859+0000 mgr.y (mgr.14140) 37 : cluster [DBG] pgmap v28: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:40:32.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:32 gibba045 bash[9787]: audit 2021-03-10T13:40:32.026207+0000 mon.a (mon.0) 160 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:16.257836\", \"created\": \"2021-03-10T13:40:16.047558\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}}, \"last_device_update\": \"2021-03-10T13:39:54.262468\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:40:32.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:32 gibba045 bash[9787]: audit 2021-03-10T13:40:32.033948+0000 mon.a (mon.0) 161 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:16.257836\", \"created\": \"2021-03-10T13:40:16.047558\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}}, \"last_device_update\": \"2021-03-10T13:39:54.262468\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:40:32.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:32 gibba045 bash[9787]: audit 2021-03-10T13:40:32.035458+0000 mon.a (mon.0) 162 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.gibba045.orlgmj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:40:32.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:32 gibba045 bash[9787]: audit 2021-03-10T13:40:32.037490+0000 mon.a (mon.0) 163 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.gibba045.orlgmj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2021-03-10T13:40:32.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:32 gibba045 bash[9787]: audit 2021-03-10T13:40:32.038292+0000 mon.a (mon.0) 164 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:40:32.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:32 gibba045 bash[9787]: cephadm 2021-03-10T13:40:32.038669+0000 mgr.y (mgr.14140) 38 : cephadm [INF] Deploying daemon mgr.gibba045.orlgmj on gibba045 2021-03-10T13:40:32.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:32 gibba045 bash[9787]: audit 2021-03-10T13:40:32.038918+0000 mon.a (mon.0) 165 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.gibba045.orlgmj", "key": "container_image"}]: dispatch 2021-03-10T13:40:33.627 INFO:teuthology.orchestra.run.gibba015.stderr:--> Zapping: /dev/vg_nvme/lv_4 2021-03-10T13:40:33.628 INFO:teuthology.orchestra.run.gibba015.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2021-03-10T13:40:33.628 INFO:teuthology.orchestra.run.gibba015.stderr: stderr: 10+0 records in 2021-03-10T13:40:33.628 INFO:teuthology.orchestra.run.gibba015.stderr:10+0 records out 2021-03-10T13:40:33.629 INFO:teuthology.orchestra.run.gibba015.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0090227 s, 1.2 GB/s 2021-03-10T13:40:33.629 INFO:teuthology.orchestra.run.gibba015.stderr:--> Zapping successful for: 2021-03-10T13:40:34.167 DEBUG:teuthology.orchestra.run.gibba015:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e4a642d2-81a5-11eb-9080-001a4aab830c -- ceph orch daemon add osd gibba015:vg_nvme/lv_4 2021-03-10T13:40:34.533 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:34 gibba045 bash[9787]: cluster 2021-03-10T13:40:33.082364+0000 mgr.y (mgr.14140) 39 : cluster [DBG] pgmap v29: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:40:34.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:34 gibba015 bash[9806]: cluster 2021-03-10T13:40:33.082364+0000 mgr.y (mgr.14140) 39 : cluster [DBG] pgmap v29: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:40:34.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:34 gibba015 bash[13005]: cluster 2021-03-10T13:40:33.082364+0000 mgr.y (mgr.14140) 39 : cluster [DBG] pgmap v29: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:40:35.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:35 gibba015 bash[9806]: audit 2021-03-10T13:40:34.546349+0000 mon.a (mon.0) 166 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:16.257836\", \"created\": \"2021-03-10T13:40:16.047558\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}}, \"last_device_update\": \"2021-03-10T13:39:54.262468\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:40:35.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:35 gibba015 bash[13005]: audit 2021-03-10T13:40:34.546349+0000 mon.a (mon.0) 166 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:16.257836\", \"created\": \"2021-03-10T13:40:16.047558\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}}, \"last_device_update\": \"2021-03-10T13:39:54.262468\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:40:35.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:35 gibba015 bash[9806]: audit 2021-03-10T13:40:34.554159+0000 mon.a (mon.0) 167 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:16.257836\", \"created\": \"2021-03-10T13:40:16.047558\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}}, \"last_device_update\": \"2021-03-10T13:39:54.262468\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:40:35.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:35 gibba015 bash[9806]: audit 2021-03-10T13:40:34.556166+0000 mon.a (mon.0) 168 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:40:35.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:35 gibba015 bash[13005]: audit 2021-03-10T13:40:34.554159+0000 mon.a (mon.0) 167 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:16.257836\", \"created\": \"2021-03-10T13:40:16.047558\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}}, \"last_device_update\": \"2021-03-10T13:39:54.262468\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:40:35.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:35 gibba015 bash[13005]: audit 2021-03-10T13:40:34.556166+0000 mon.a (mon.0) 168 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:40:35.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:35 gibba015 bash[9806]: audit 2021-03-10T13:40:34.959201+0000 mon.a (mon.0) 169 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:34.956565\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:34.956831\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:34.956999\", \"created\": \"2021-03-10T13:40:34.535558\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}}, \"last_daemon_update\": \"2021-03-10T13:40:34.957304\", \"last_device_update\": \"2021-03-10T13:39:54.262468\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:40:35.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:35 gibba015 bash[13005]: audit 2021-03-10T13:40:34.959201+0000 mon.a (mon.0) 169 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:34.956565\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:34.956831\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:34.956999\", \"created\": \"2021-03-10T13:40:34.535558\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}}, \"last_daemon_update\": \"2021-03-10T13:40:34.957304\", \"last_device_update\": \"2021-03-10T13:39:54.262468\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:40:35.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:35 gibba015 bash[9806]: audit 2021-03-10T13:40:34.967174+0000 mon.a (mon.0) 170 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:34.956565\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:34.956831\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:34.956999\", \"created\": \"2021-03-10T13:40:34.535558\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}}, \"last_daemon_update\": \"2021-03-10T13:40:34.957304\", \"last_device_update\": \"2021-03-10T13:39:54.262468\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:40:35.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:35 gibba015 bash[9806]: cephadm 2021-03-10T13:40:34.970344+0000 mgr.y (mgr.14140) 40 : cephadm [INF] Reconfiguring mgr.y (unknown last config time)... 2021-03-10T13:40:35.729 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:35 gibba015 bash[9806]: audit 2021-03-10T13:40:34.971080+0000 mon.a (mon.0) 171 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.y"}]: dispatch 2021-03-10T13:40:35.729 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:35 gibba015 bash[9806]: audit 2021-03-10T13:40:34.974036+0000 mon.a (mon.0) 172 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:40:35.729 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:35 gibba015 bash[9806]: cephadm 2021-03-10T13:40:34.976395+0000 mgr.y (mgr.14140) 41 : cephadm [INF] Reconfiguring daemon mgr.y on gibba015 2021-03-10T13:40:35.729 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:35 gibba015 bash[9806]: audit 2021-03-10T13:40:34.978185+0000 mon.a (mon.0) 173 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.y", "key": "container_image"}]: dispatch 2021-03-10T13:40:35.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:35 gibba015 bash[13005]: audit 2021-03-10T13:40:34.967174+0000 mon.a (mon.0) 170 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:34.956565\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:34.956831\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:34.956999\", \"created\": \"2021-03-10T13:40:34.535558\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}}, \"last_daemon_update\": \"2021-03-10T13:40:34.957304\", \"last_device_update\": \"2021-03-10T13:39:54.262468\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:40:35.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:35 gibba015 bash[13005]: cephadm 2021-03-10T13:40:34.970344+0000 mgr.y (mgr.14140) 40 : cephadm [INF] Reconfiguring mgr.y (unknown last config time)... 2021-03-10T13:40:35.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:35 gibba015 bash[13005]: audit 2021-03-10T13:40:34.971080+0000 mon.a (mon.0) 171 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.y"}]: dispatch 2021-03-10T13:40:35.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:35 gibba015 bash[13005]: audit 2021-03-10T13:40:34.974036+0000 mon.a (mon.0) 172 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:40:35.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:35 gibba015 bash[13005]: cephadm 2021-03-10T13:40:34.976395+0000 mgr.y (mgr.14140) 41 : cephadm [INF] Reconfiguring daemon mgr.y on gibba015 2021-03-10T13:40:35.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:35 gibba015 bash[13005]: audit 2021-03-10T13:40:34.978185+0000 mon.a (mon.0) 173 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.y", "key": "container_image"}]: dispatch 2021-03-10T13:40:35.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:35 gibba045 bash[9787]: audit 2021-03-10T13:40:34.546349+0000 mon.a (mon.0) 166 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:16.257836\", \"created\": \"2021-03-10T13:40:16.047558\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}}, \"last_device_update\": \"2021-03-10T13:39:54.262468\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:40:35.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:35 gibba045 bash[9787]: audit 2021-03-10T13:40:34.554159+0000 mon.a (mon.0) 167 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:16.257836\", \"created\": \"2021-03-10T13:40:16.047558\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}}, \"last_device_update\": \"2021-03-10T13:39:54.262468\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:40:35.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:35 gibba045 bash[9787]: audit 2021-03-10T13:40:34.556166+0000 mon.a (mon.0) 168 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:40:35.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:35 gibba045 bash[9787]: audit 2021-03-10T13:40:34.959201+0000 mon.a (mon.0) 169 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:34.956565\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:34.956831\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:34.956999\", \"created\": \"2021-03-10T13:40:34.535558\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}}, \"last_daemon_update\": \"2021-03-10T13:40:34.957304\", \"last_device_update\": \"2021-03-10T13:39:54.262468\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:40:35.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:35 gibba045 bash[9787]: audit 2021-03-10T13:40:34.967174+0000 mon.a (mon.0) 170 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:34.956565\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:34.956831\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:34.956999\", \"created\": \"2021-03-10T13:40:34.535558\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}}, \"last_daemon_update\": \"2021-03-10T13:40:34.957304\", \"last_device_update\": \"2021-03-10T13:39:54.262468\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:40:35.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:35 gibba045 bash[9787]: cephadm 2021-03-10T13:40:34.970344+0000 mgr.y (mgr.14140) 40 : cephadm [INF] Reconfiguring mgr.y (unknown last config time)... 2021-03-10T13:40:35.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:35 gibba045 bash[9787]: audit 2021-03-10T13:40:34.971080+0000 mon.a (mon.0) 171 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.y"}]: dispatch 2021-03-10T13:40:35.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:35 gibba045 bash[9787]: audit 2021-03-10T13:40:34.974036+0000 mon.a (mon.0) 172 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:40:35.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:35 gibba045 bash[9787]: cephadm 2021-03-10T13:40:34.976395+0000 mgr.y (mgr.14140) 41 : cephadm [INF] Reconfiguring daemon mgr.y on gibba015 2021-03-10T13:40:35.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:35 gibba045 bash[9787]: audit 2021-03-10T13:40:34.978185+0000 mon.a (mon.0) 173 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.y", "key": "container_image"}]: dispatch 2021-03-10T13:40:37.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:36 gibba015 bash[9806]: cluster 2021-03-10T13:40:35.082670+0000 mgr.y (mgr.14140) 42 : cluster [DBG] pgmap v30: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:40:37.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:36 gibba015 bash[9806]: cluster 2021-03-10T13:40:36.392475+0000 mon.a (mon.0) 174 : cluster [DBG] Standby manager daemon x started 2021-03-10T13:40:37.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:36 gibba015 bash[9806]: audit 2021-03-10T13:40:36.396607+0000 mon.b (mon.2) 2 : audit [DBG] from='mgr.? 172.21.2.145:0/2371827159' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:40:37.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:36 gibba015 bash[9806]: audit 2021-03-10T13:40:36.397532+0000 mon.b (mon.2) 3 : audit [DBG] from='mgr.? 172.21.2.145:0/2371827159' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:40:37.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:36 gibba015 bash[13005]: cluster 2021-03-10T13:40:35.082670+0000 mgr.y (mgr.14140) 42 : cluster [DBG] pgmap v30: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:40:37.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:36 gibba015 bash[13005]: cluster 2021-03-10T13:40:36.392475+0000 mon.a (mon.0) 174 : cluster [DBG] Standby manager daemon x started 2021-03-10T13:40:37.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:36 gibba015 bash[13005]: audit 2021-03-10T13:40:36.396607+0000 mon.b (mon.2) 2 : audit [DBG] from='mgr.? 172.21.2.145:0/2371827159' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:40:37.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:36 gibba015 bash[13005]: audit 2021-03-10T13:40:36.397532+0000 mon.b (mon.2) 3 : audit [DBG] from='mgr.? 172.21.2.145:0/2371827159' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:40:37.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:36 gibba045 bash[9787]: cluster 2021-03-10T13:40:35.082670+0000 mgr.y (mgr.14140) 42 : cluster [DBG] pgmap v30: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:40:37.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:36 gibba045 bash[9787]: cluster 2021-03-10T13:40:36.392475+0000 mon.a (mon.0) 174 : cluster [DBG] Standby manager daemon x started 2021-03-10T13:40:37.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:36 gibba045 bash[9787]: audit 2021-03-10T13:40:36.396607+0000 mon.b (mon.2) 2 : audit [DBG] from='mgr.? 172.21.2.145:0/2371827159' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:40:37.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:36 gibba045 bash[9787]: audit 2021-03-10T13:40:36.397532+0000 mon.b (mon.2) 3 : audit [DBG] from='mgr.? 172.21.2.145:0/2371827159' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:40:38.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:37 gibba015 bash[9806]: cluster 2021-03-10T13:40:36.971568+0000 mon.a (mon.0) 175 : cluster [DBG] mgrmap e14: y(active, since 74s), standbys: x 2021-03-10T13:40:38.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:37 gibba015 bash[9806]: audit 2021-03-10T13:40:36.972118+0000 mon.a (mon.0) 176 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-03-10T13:40:38.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:37 gibba015 bash[9806]: audit 2021-03-10T13:40:37.454415+0000 mon.a (mon.0) 177 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:03.697811\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:03.697902\", \"created\": \"2021-03-10T13:40:03.296449\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}}, \"last_device_update\": \"2021-03-10T13:39:28.725398\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]: dispatch 2021-03-10T13:40:38.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:37 gibba015 bash[13005]: cluster 2021-03-10T13:40:36.971568+0000 mon.a (mon.0) 175 : cluster [DBG] mgrmap e14: y(active, since 74s), standbys: x 2021-03-10T13:40:38.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:37 gibba015 bash[13005]: audit 2021-03-10T13:40:36.972118+0000 mon.a (mon.0) 176 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-03-10T13:40:38.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:37 gibba015 bash[13005]: audit 2021-03-10T13:40:37.454415+0000 mon.a (mon.0) 177 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:03.697811\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:03.697902\", \"created\": \"2021-03-10T13:40:03.296449\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}}, \"last_device_update\": \"2021-03-10T13:39:28.725398\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]: dispatch 2021-03-10T13:40:38.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:37 gibba015 bash[9806]: audit 2021-03-10T13:40:37.457276+0000 mon.a (mon.0) 178 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:03.697811\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:03.697902\", \"created\": \"2021-03-10T13:40:03.296449\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}}, \"last_device_update\": \"2021-03-10T13:39:28.725398\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]': finished 2021-03-10T13:40:38.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:37 gibba015 bash[9806]: audit 2021-03-10T13:40:37.458116+0000 mon.a (mon.0) 179 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:40:38.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:37 gibba015 bash[9806]: audit 2021-03-10T13:40:37.681356+0000 mon.a (mon.0) 180 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T13:40:38.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:37 gibba015 bash[9806]: audit 2021-03-10T13:40:37.682174+0000 mon.a (mon.0) 181 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:40:38.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:37 gibba015 bash[9806]: audit 2021-03-10T13:40:37.683131+0000 mon.a (mon.0) 182 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:40:38.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:37 gibba015 bash[13005]: audit 2021-03-10T13:40:37.457276+0000 mon.a (mon.0) 178 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:03.697811\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:03.697902\", \"created\": \"2021-03-10T13:40:03.296449\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}}, \"last_device_update\": \"2021-03-10T13:39:28.725398\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]': finished 2021-03-10T13:40:38.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:37 gibba015 bash[13005]: audit 2021-03-10T13:40:37.458116+0000 mon.a (mon.0) 179 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:40:38.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:37 gibba015 bash[13005]: audit 2021-03-10T13:40:37.681356+0000 mon.a (mon.0) 180 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T13:40:38.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:37 gibba015 bash[13005]: audit 2021-03-10T13:40:37.682174+0000 mon.a (mon.0) 181 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:40:38.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:37 gibba015 bash[13005]: audit 2021-03-10T13:40:37.683131+0000 mon.a (mon.0) 182 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:40:38.230 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:37 gibba015 bash[9806]: audit 2021-03-10T13:40:37.775126+0000 mon.a (mon.0) 183 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:37.774503\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:37.774560\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:37.774590\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}}, \"last_daemon_update\": \"2021-03-10T13:40:37.774647\", \"last_device_update\": \"2021-03-10T13:39:28.725398\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]: dispatch 2021-03-10T13:40:38.231 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:37 gibba015 bash[9806]: audit 2021-03-10T13:40:37.777826+0000 mon.a (mon.0) 184 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:37.774503\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:37.774560\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:37.774590\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}}, \"last_daemon_update\": \"2021-03-10T13:40:37.774647\", \"last_device_update\": \"2021-03-10T13:39:28.725398\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]': finished 2021-03-10T13:40:38.231 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:37 gibba015 bash[9806]: audit 2021-03-10T13:40:37.778337+0000 mon.a (mon.0) 185 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:40:38.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:37 gibba015 bash[13005]: audit 2021-03-10T13:40:37.775126+0000 mon.a (mon.0) 183 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:37.774503\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:37.774560\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:37.774590\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}}, \"last_daemon_update\": \"2021-03-10T13:40:37.774647\", \"last_device_update\": \"2021-03-10T13:39:28.725398\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]: dispatch 2021-03-10T13:40:38.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:37 gibba015 bash[13005]: audit 2021-03-10T13:40:37.777826+0000 mon.a (mon.0) 184 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:37.774503\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:37.774560\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:37.774590\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}}, \"last_daemon_update\": \"2021-03-10T13:40:37.774647\", \"last_device_update\": \"2021-03-10T13:39:28.725398\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]': finished 2021-03-10T13:40:38.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:37 gibba015 bash[13005]: audit 2021-03-10T13:40:37.778337+0000 mon.a (mon.0) 185 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:40:38.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:37 gibba045 bash[9787]: cluster 2021-03-10T13:40:36.971568+0000 mon.a (mon.0) 175 : cluster [DBG] mgrmap e14: y(active, since 74s), standbys: x 2021-03-10T13:40:38.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:37 gibba045 bash[9787]: audit 2021-03-10T13:40:36.972118+0000 mon.a (mon.0) 176 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-03-10T13:40:38.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:37 gibba045 bash[9787]: audit 2021-03-10T13:40:37.454415+0000 mon.a (mon.0) 177 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:03.697811\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:03.697902\", \"created\": \"2021-03-10T13:40:03.296449\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}}, \"last_device_update\": \"2021-03-10T13:39:28.725398\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]: dispatch 2021-03-10T13:40:38.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:37 gibba045 bash[9787]: audit 2021-03-10T13:40:37.457276+0000 mon.a (mon.0) 178 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:03.697811\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:03.697902\", \"created\": \"2021-03-10T13:40:03.296449\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}}, \"last_device_update\": \"2021-03-10T13:39:28.725398\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]': finished 2021-03-10T13:40:38.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:37 gibba045 bash[9787]: audit 2021-03-10T13:40:37.458116+0000 mon.a (mon.0) 179 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:40:38.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:37 gibba045 bash[9787]: audit 2021-03-10T13:40:37.681356+0000 mon.a (mon.0) 180 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T13:40:38.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:37 gibba045 bash[9787]: audit 2021-03-10T13:40:37.682174+0000 mon.a (mon.0) 181 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:40:38.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:37 gibba045 bash[9787]: audit 2021-03-10T13:40:37.683131+0000 mon.a (mon.0) 182 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:40:38.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:37 gibba045 bash[9787]: audit 2021-03-10T13:40:37.775126+0000 mon.a (mon.0) 183 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:37.774503\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:37.774560\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:37.774590\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}}, \"last_daemon_update\": \"2021-03-10T13:40:37.774647\", \"last_device_update\": \"2021-03-10T13:39:28.725398\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]: dispatch 2021-03-10T13:40:38.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:37 gibba045 bash[9787]: audit 2021-03-10T13:40:37.777826+0000 mon.a (mon.0) 184 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:37.774503\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:37.774560\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:37.774590\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}}, \"last_daemon_update\": \"2021-03-10T13:40:37.774647\", \"last_device_update\": \"2021-03-10T13:39:28.725398\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]': finished 2021-03-10T13:40:38.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:37 gibba045 bash[9787]: audit 2021-03-10T13:40:37.778337+0000 mon.a (mon.0) 185 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:40:39.172 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:38 gibba015 bash[9806]: cluster 2021-03-10T13:40:37.083323+0000 mgr.y (mgr.14140) 43 : cluster [DBG] pgmap v31: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:40:39.172 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:38 gibba015 bash[9806]: audit 2021-03-10T13:40:37.680284+0000 mgr.y (mgr.14140) 44 : audit [DBG] from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba015:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:40:39.173 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:38 gibba015 bash[9806]: cephadm 2021-03-10T13:40:37.681087+0000 mgr.y (mgr.14140) 45 : cephadm [INF] Applying osd on host gibba015... 2021-03-10T13:40:39.173 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:38 gibba015 bash[13005]: cluster 2021-03-10T13:40:37.083323+0000 mgr.y (mgr.14140) 43 : cluster [DBG] pgmap v31: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:40:39.173 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:38 gibba015 bash[13005]: audit 2021-03-10T13:40:37.680284+0000 mgr.y (mgr.14140) 44 : audit [DBG] from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba015:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:40:39.174 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:38 gibba015 bash[13005]: cephadm 2021-03-10T13:40:37.681087+0000 mgr.y (mgr.14140) 45 : cephadm [INF] Applying osd on host gibba015... 2021-03-10T13:40:39.174 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:38 gibba015 bash[9806]: audit 2021-03-10T13:40:38.111873+0000 mon.a (mon.0) 186 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:38.109242\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:38.109509\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:38.109675\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}}, \"last_daemon_update\": \"2021-03-10T13:40:38.110002\", \"last_device_update\": \"2021-03-10T13:39:54.262468\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:40:39.175 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:38 gibba015 bash[9806]: audit 2021-03-10T13:40:38.120632+0000 mon.a (mon.0) 187 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:38.109242\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:38.109509\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:38.109675\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}}, \"last_daemon_update\": \"2021-03-10T13:40:38.110002\", \"last_device_update\": \"2021-03-10T13:39:54.262468\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:40:39.175 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:38 gibba015 bash[9806]: cluster 2021-03-10T13:40:38.230762+0000 mon.a (mon.0) 188 : cluster [DBG] Standby manager daemon gibba045.orlgmj started 2021-03-10T13:40:39.175 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:38 gibba015 bash[9806]: audit 2021-03-10T13:40:38.233969+0000 mon.b (mon.2) 4 : audit [DBG] from='mgr.? 172.21.2.145:0/3974492891' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:40:39.175 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:38 gibba015 bash[9806]: audit 2021-03-10T13:40:38.234967+0000 mon.b (mon.2) 5 : audit [DBG] from='mgr.? 172.21.2.145:0/3974492891' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:40:39.176 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:38 gibba015 bash[13005]: audit 2021-03-10T13:40:38.111873+0000 mon.a (mon.0) 186 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:38.109242\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:38.109509\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:38.109675\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}}, \"last_daemon_update\": \"2021-03-10T13:40:38.110002\", \"last_device_update\": \"2021-03-10T13:39:54.262468\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:40:39.176 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:38 gibba015 bash[13005]: audit 2021-03-10T13:40:38.120632+0000 mon.a (mon.0) 187 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:38.109242\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:38.109509\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:38.109675\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}}, \"last_daemon_update\": \"2021-03-10T13:40:38.110002\", \"last_device_update\": \"2021-03-10T13:39:54.262468\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:40:39.176 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:38 gibba015 bash[13005]: cluster 2021-03-10T13:40:38.230762+0000 mon.a (mon.0) 188 : cluster [DBG] Standby manager daemon gibba045.orlgmj started 2021-03-10T13:40:39.177 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:38 gibba015 bash[13005]: audit 2021-03-10T13:40:38.233969+0000 mon.b (mon.2) 4 : audit [DBG] from='mgr.? 172.21.2.145:0/3974492891' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:40:39.177 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:38 gibba015 bash[13005]: audit 2021-03-10T13:40:38.234967+0000 mon.b (mon.2) 5 : audit [DBG] from='mgr.? 172.21.2.145:0/3974492891' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:40:39.263 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:38 gibba045 bash[9787]: cluster 2021-03-10T13:40:37.083323+0000 mgr.y (mgr.14140) 43 : cluster [DBG] pgmap v31: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:40:39.263 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:38 gibba045 bash[9787]: audit 2021-03-10T13:40:37.680284+0000 mgr.y (mgr.14140) 44 : audit [DBG] from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba015:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:40:39.264 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:38 gibba045 bash[9787]: cephadm 2021-03-10T13:40:37.681087+0000 mgr.y (mgr.14140) 45 : cephadm [INF] Applying osd on host gibba015... 2021-03-10T13:40:39.264 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:38 gibba045 bash[9787]: audit 2021-03-10T13:40:38.111873+0000 mon.a (mon.0) 186 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:38.109242\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:38.109509\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:38.109675\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}}, \"last_daemon_update\": \"2021-03-10T13:40:38.110002\", \"last_device_update\": \"2021-03-10T13:39:54.262468\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:40:39.264 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:38 gibba045 bash[9787]: audit 2021-03-10T13:40:38.120632+0000 mon.a (mon.0) 187 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:38.109242\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:38.109509\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:38.109675\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}}, \"last_daemon_update\": \"2021-03-10T13:40:38.110002\", \"last_device_update\": \"2021-03-10T13:39:54.262468\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:40:39.264 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:38 gibba045 bash[9787]: cluster 2021-03-10T13:40:38.230762+0000 mon.a (mon.0) 188 : cluster [DBG] Standby manager daemon gibba045.orlgmj started 2021-03-10T13:40:39.265 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:38 gibba045 bash[9787]: audit 2021-03-10T13:40:38.233969+0000 mon.b (mon.2) 4 : audit [DBG] from='mgr.? 172.21.2.145:0/3974492891' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:40:39.265 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:38 gibba045 bash[9787]: audit 2021-03-10T13:40:38.234967+0000 mon.b (mon.2) 5 : audit [DBG] from='mgr.? 172.21.2.145:0/3974492891' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:40:40.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:40 gibba015 bash[9806]: cluster 2021-03-10T13:40:39.084068+0000 mgr.y (mgr.14140) 46 : cluster [DBG] pgmap v32: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:40:40.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:40 gibba015 bash[9806]: cluster 2021-03-10T13:40:39.128568+0000 mon.a (mon.0) 189 : cluster [DBG] mgrmap e15: y(active, since 76s), standbys: x, gibba045.orlgmj 2021-03-10T13:40:40.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:40 gibba015 bash[9806]: audit 2021-03-10T13:40:39.128651+0000 mon.a (mon.0) 190 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "gibba045.orlgmj", "id": "gibba045.orlgmj"}]: dispatch 2021-03-10T13:40:40.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:40 gibba015 bash[9806]: cluster 2021-03-10T13:40:39.261844+0000 mgr.gibba045.orlgmj (mgr.34115) 1 : cluster [ERR] Unhandled exception from module 'dashboard' while running on mgr.gibba045.orlgmj: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:40:40.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:40 gibba015 bash[13005]: cluster 2021-03-10T13:40:39.084068+0000 mgr.y (mgr.14140) 46 : cluster [DBG] pgmap v32: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:40:40.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:40 gibba015 bash[13005]: cluster 2021-03-10T13:40:39.128568+0000 mon.a (mon.0) 189 : cluster [DBG] mgrmap e15: y(active, since 76s), standbys: x, gibba045.orlgmj 2021-03-10T13:40:40.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:40 gibba015 bash[13005]: audit 2021-03-10T13:40:39.128651+0000 mon.a (mon.0) 190 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "gibba045.orlgmj", "id": "gibba045.orlgmj"}]: dispatch 2021-03-10T13:40:40.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:40 gibba015 bash[13005]: cluster 2021-03-10T13:40:39.261844+0000 mgr.gibba045.orlgmj (mgr.34115) 1 : cluster [ERR] Unhandled exception from module 'dashboard' while running on mgr.gibba045.orlgmj: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:40:40.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:40 gibba045 bash[9787]: cluster 2021-03-10T13:40:39.084068+0000 mgr.y (mgr.14140) 46 : cluster [DBG] pgmap v32: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:40:40.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:40 gibba045 bash[9787]: cluster 2021-03-10T13:40:39.128568+0000 mon.a (mon.0) 189 : cluster [DBG] mgrmap e15: y(active, since 76s), standbys: x, gibba045.orlgmj 2021-03-10T13:40:40.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:40 gibba045 bash[9787]: audit 2021-03-10T13:40:39.128651+0000 mon.a (mon.0) 190 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "gibba045.orlgmj", "id": "gibba045.orlgmj"}]: dispatch 2021-03-10T13:40:40.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:40 gibba045 bash[9787]: cluster 2021-03-10T13:40:39.261844+0000 mgr.gibba045.orlgmj (mgr.34115) 1 : cluster [ERR] Unhandled exception from module 'dashboard' while running on mgr.gibba045.orlgmj: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:40:41.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:41 gibba015 bash[9806]: audit 2021-03-10T13:40:40.485818+0000 mon.a (mon.0) 191 : audit [INF] from='client.? 172.21.2.115:0/2454593928' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8e0c9467-d453-440a-91ea-1b07c3f35dde"}]: dispatch 2021-03-10T13:40:41.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:41 gibba015 bash[9806]: audit 2021-03-10T13:40:40.490292+0000 mon.a (mon.0) 192 : audit [INF] from='client.? 172.21.2.115:0/2454593928' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8e0c9467-d453-440a-91ea-1b07c3f35dde"}]': finished 2021-03-10T13:40:41.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:41 gibba015 bash[9806]: cluster 2021-03-10T13:40:40.490351+0000 mon.a (mon.0) 193 : cluster [DBG] osdmap e7: 1 total, 0 up, 0 in 2021-03-10T13:40:41.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:41 gibba015 bash[9806]: audit 2021-03-10T13:40:40.490434+0000 mon.a (mon.0) 194 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T13:40:41.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:41 gibba015 bash[13005]: audit 2021-03-10T13:40:40.485818+0000 mon.a (mon.0) 191 : audit [INF] from='client.? 172.21.2.115:0/2454593928' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8e0c9467-d453-440a-91ea-1b07c3f35dde"}]: dispatch 2021-03-10T13:40:41.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:41 gibba015 bash[13005]: audit 2021-03-10T13:40:40.490292+0000 mon.a (mon.0) 192 : audit [INF] from='client.? 172.21.2.115:0/2454593928' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8e0c9467-d453-440a-91ea-1b07c3f35dde"}]': finished 2021-03-10T13:40:41.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:41 gibba015 bash[13005]: cluster 2021-03-10T13:40:40.490351+0000 mon.a (mon.0) 193 : cluster [DBG] osdmap e7: 1 total, 0 up, 0 in 2021-03-10T13:40:41.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:41 gibba015 bash[13005]: audit 2021-03-10T13:40:40.490434+0000 mon.a (mon.0) 194 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T13:40:41.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:41 gibba045 bash[9787]: audit 2021-03-10T13:40:40.485818+0000 mon.a (mon.0) 191 : audit [INF] from='client.? 172.21.2.115:0/2454593928' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8e0c9467-d453-440a-91ea-1b07c3f35dde"}]: dispatch 2021-03-10T13:40:41.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:41 gibba045 bash[9787]: audit 2021-03-10T13:40:40.490292+0000 mon.a (mon.0) 192 : audit [INF] from='client.? 172.21.2.115:0/2454593928' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8e0c9467-d453-440a-91ea-1b07c3f35dde"}]': finished 2021-03-10T13:40:41.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:41 gibba045 bash[9787]: cluster 2021-03-10T13:40:40.490351+0000 mon.a (mon.0) 193 : cluster [DBG] osdmap e7: 1 total, 0 up, 0 in 2021-03-10T13:40:41.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:41 gibba045 bash[9787]: audit 2021-03-10T13:40:40.490434+0000 mon.a (mon.0) 194 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T13:40:42.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:42 gibba045 bash[9787]: cluster 2021-03-10T13:40:41.084659+0000 mgr.y (mgr.14140) 47 : cluster [DBG] pgmap v34: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:40:42.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:42 gibba015 bash[9806]: cluster 2021-03-10T13:40:41.084659+0000 mgr.y (mgr.14140) 47 : cluster [DBG] pgmap v34: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:40:42.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:42 gibba015 bash[13005]: cluster 2021-03-10T13:40:41.084659+0000 mgr.y (mgr.14140) 47 : cluster [DBG] pgmap v34: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:40:43.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:43 gibba045 bash[9787]: audit 2021-03-10T13:40:42.622334+0000 mon.a (mon.0) 195 : audit [DBG] from='client.? 172.21.2.115:0/1741397166' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T13:40:43.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:43 gibba015 bash[9806]: audit 2021-03-10T13:40:42.622334+0000 mon.a (mon.0) 195 : audit [DBG] from='client.? 172.21.2.115:0/1741397166' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T13:40:43.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:43 gibba015 bash[13005]: audit 2021-03-10T13:40:42.622334+0000 mon.a (mon.0) 195 : audit [DBG] from='client.? 172.21.2.115:0/1741397166' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T13:40:44.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:44 gibba045 bash[9787]: cluster 2021-03-10T13:40:43.085481+0000 mgr.y (mgr.14140) 48 : cluster [DBG] pgmap v35: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:40:44.852 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:44 gibba015 bash[9806]: cluster 2021-03-10T13:40:43.085481+0000 mgr.y (mgr.14140) 48 : cluster [DBG] pgmap v35: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:40:44.853 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:44 gibba015 bash[13005]: cluster 2021-03-10T13:40:43.085481+0000 mgr.y (mgr.14140) 48 : cluster [DBG] pgmap v35: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:40:45.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:45 gibba015 bash[9806]: audit 2021-03-10T13:40:45.220905+0000 mon.a (mon.0) 196 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:40:45.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:45 gibba015 bash[13005]: audit 2021-03-10T13:40:45.220905+0000 mon.a (mon.0) 196 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:40:45.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:45 gibba045 bash[9787]: audit 2021-03-10T13:40:45.220905+0000 mon.a (mon.0) 196 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:40:46.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:46 gibba015 bash[13005]: cluster 2021-03-10T13:40:45.086470+0000 mgr.y (mgr.14140) 49 : cluster [DBG] pgmap v36: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:40:46.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:46 gibba015 bash[9806]: cluster 2021-03-10T13:40:45.086470+0000 mgr.y (mgr.14140) 49 : cluster [DBG] pgmap v36: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:40:46.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:46 gibba045 bash[9787]: cluster 2021-03-10T13:40:45.086470+0000 mgr.y (mgr.14140) 49 : cluster [DBG] pgmap v36: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:40:48.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:48 gibba015 bash[9806]: cluster 2021-03-10T13:40:47.086935+0000 mgr.y (mgr.14140) 50 : cluster [DBG] pgmap v37: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:40:48.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:48 gibba015 bash[13005]: cluster 2021-03-10T13:40:47.086935+0000 mgr.y (mgr.14140) 50 : cluster [DBG] pgmap v37: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:40:48.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:48 gibba045 bash[9787]: cluster 2021-03-10T13:40:47.086935+0000 mgr.y (mgr.14140) 50 : cluster [DBG] pgmap v37: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:40:49.446 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:49 gibba015 bash[9806]: audit 2021-03-10T13:40:48.300981+0000 mon.a (mon.0) 197 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2021-03-10T13:40:49.447 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:49 gibba015 bash[9806]: audit 2021-03-10T13:40:48.301874+0000 mon.a (mon.0) 198 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:40:49.447 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:49 gibba015 bash[9806]: cephadm 2021-03-10T13:40:48.302524+0000 mgr.y (mgr.14140) 51 : cephadm [INF] Deploying daemon osd.0 on gibba015 2021-03-10T13:40:49.447 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:49 gibba015 bash[9806]: audit 2021-03-10T13:40:48.302682+0000 mon.a (mon.0) 199 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.0", "key": "container_image"}]: dispatch 2021-03-10T13:40:49.448 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:49 gibba015 bash[13005]: audit 2021-03-10T13:40:48.300981+0000 mon.a (mon.0) 197 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2021-03-10T13:40:49.448 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:49 gibba015 bash[13005]: audit 2021-03-10T13:40:48.301874+0000 mon.a (mon.0) 198 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:40:49.448 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:49 gibba015 bash[13005]: cephadm 2021-03-10T13:40:48.302524+0000 mgr.y (mgr.14140) 51 : cephadm [INF] Deploying daemon osd.0 on gibba015 2021-03-10T13:40:49.448 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:49 gibba015 bash[13005]: audit 2021-03-10T13:40:48.302682+0000 mon.a (mon.0) 199 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.0", "key": "container_image"}]: dispatch 2021-03-10T13:40:49.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:49 gibba045 bash[9787]: audit 2021-03-10T13:40:48.300981+0000 mon.a (mon.0) 197 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2021-03-10T13:40:49.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:49 gibba045 bash[9787]: audit 2021-03-10T13:40:48.301874+0000 mon.a (mon.0) 198 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:40:49.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:49 gibba045 bash[9787]: cephadm 2021-03-10T13:40:48.302524+0000 mgr.y (mgr.14140) 51 : cephadm [INF] Deploying daemon osd.0 on gibba015 2021-03-10T13:40:49.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:49 gibba045 bash[9787]: audit 2021-03-10T13:40:48.302682+0000 mon.a (mon.0) 199 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.0", "key": "container_image"}]: dispatch 2021-03-10T13:40:50.091 INFO:teuthology.orchestra.run.gibba015.stdout:Created osd(s) 0 on host 'gibba015' 2021-03-10T13:40:50.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:50 gibba015 bash[9806]: cluster 2021-03-10T13:40:49.087511+0000 mgr.y (mgr.14140) 52 : cluster [DBG] pgmap v38: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:40:50.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:50 gibba015 bash[13005]: cluster 2021-03-10T13:40:49.087511+0000 mgr.y (mgr.14140) 52 : cluster [DBG] pgmap v38: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:40:50.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:50 gibba015 bash[9806]: audit 2021-03-10T13:40:50.083101+0000 mon.a (mon.0) 200 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:37.774503\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:37.774560\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:37.774590\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}}, \"last_device_update\": \"2021-03-10T13:39:28.725398\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]: dispatch 2021-03-10T13:40:50.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:50 gibba015 bash[9806]: audit 2021-03-10T13:40:50.083619+0000 mon.a (mon.0) 201 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:40:50.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:50 gibba015 bash[9806]: audit 2021-03-10T13:40:50.086317+0000 mon.a (mon.0) 202 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:37.774503\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:37.774560\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:37.774590\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}}, \"last_device_update\": \"2021-03-10T13:39:28.725398\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]': finished 2021-03-10T13:40:50.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:50 gibba015 bash[13005]: audit 2021-03-10T13:40:50.083101+0000 mon.a (mon.0) 200 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:37.774503\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:37.774560\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:37.774590\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}}, \"last_device_update\": \"2021-03-10T13:39:28.725398\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]: dispatch 2021-03-10T13:40:50.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:50 gibba015 bash[13005]: audit 2021-03-10T13:40:50.083619+0000 mon.a (mon.0) 201 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:40:50.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:50 gibba015 bash[13005]: audit 2021-03-10T13:40:50.086317+0000 mon.a (mon.0) 202 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:37.774503\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:37.774560\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:37.774590\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}}, \"last_device_update\": \"2021-03-10T13:39:28.725398\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]': finished 2021-03-10T13:40:50.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:50 gibba045 bash[9787]: cluster 2021-03-10T13:40:49.087511+0000 mgr.y (mgr.14140) 52 : cluster [DBG] pgmap v38: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:40:50.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:50 gibba045 bash[9787]: audit 2021-03-10T13:40:50.083101+0000 mon.a (mon.0) 200 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:37.774503\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:37.774560\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:37.774590\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}}, \"last_device_update\": \"2021-03-10T13:39:28.725398\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]: dispatch 2021-03-10T13:40:50.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:50 gibba045 bash[9787]: audit 2021-03-10T13:40:50.083619+0000 mon.a (mon.0) 201 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:40:50.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:50 gibba045 bash[9787]: audit 2021-03-10T13:40:50.086317+0000 mon.a (mon.0) 202 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:37.774503\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:37.774560\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:37.774590\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}}, \"last_device_update\": \"2021-03-10T13:39:28.725398\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]': finished 2021-03-10T13:40:51.159 DEBUG:teuthology.orchestra.run.gibba015:osd.0> sudo journalctl -f -n 0 -u ceph-e4a642d2-81a5-11eb-9080-001a4aab830c@osd.0.service 2021-03-10T13:40:51.162 INFO:tasks.cephadm:Deploying osd.1 on gibba015 with /dev/vg_nvme/lv_3... 2021-03-10T13:40:51.162 DEBUG:teuthology.orchestra.run.gibba015:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e4a642d2-81a5-11eb-9080-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2021-03-10T13:40:51.189 INFO:journalctl@ceph.osd.0.gibba015.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T13:40:51.491 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:51 gibba015 bash[13005]: audit 2021-03-10T13:40:50.564195+0000 mon.a (mon.0) 203 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:50.562125\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:50.562314\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:50.562428\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:50.562531\", \"created\": \"2021-03-10T13:40:50.072448\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}}, \"last_daemon_update\": \"2021-03-10T13:40:50.562713\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]: dispatch 2021-03-10T13:40:51.491 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:51 gibba015 bash[13005]: audit 2021-03-10T13:40:50.571238+0000 mon.a (mon.0) 204 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:50.562125\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:50.562314\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:50.562428\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:50.562531\", \"created\": \"2021-03-10T13:40:50.072448\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}}, \"last_daemon_update\": \"2021-03-10T13:40:50.562713\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]': finished 2021-03-10T13:40:51.492 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:51 gibba015 bash[13005]: audit 2021-03-10T13:40:50.572616+0000 mon.a (mon.0) 205 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:40:51.492 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:51 gibba015 bash[9806]: audit 2021-03-10T13:40:50.564195+0000 mon.a (mon.0) 203 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:50.562125\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:50.562314\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:50.562428\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:50.562531\", \"created\": \"2021-03-10T13:40:50.072448\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}}, \"last_daemon_update\": \"2021-03-10T13:40:50.562713\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]: dispatch 2021-03-10T13:40:51.493 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:51 gibba015 bash[9806]: audit 2021-03-10T13:40:50.571238+0000 mon.a (mon.0) 204 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:50.562125\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:50.562314\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:50.562428\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:50.562531\", \"created\": \"2021-03-10T13:40:50.072448\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}}, \"last_daemon_update\": \"2021-03-10T13:40:50.562713\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]': finished 2021-03-10T13:40:51.493 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:51 gibba015 bash[9806]: audit 2021-03-10T13:40:50.572616+0000 mon.a (mon.0) 205 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:40:51.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:51 gibba045 bash[9787]: audit 2021-03-10T13:40:50.564195+0000 mon.a (mon.0) 203 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:50.562125\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:50.562314\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:50.562428\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:50.562531\", \"created\": \"2021-03-10T13:40:50.072448\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}}, \"last_daemon_update\": \"2021-03-10T13:40:50.562713\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]: dispatch 2021-03-10T13:40:51.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:51 gibba045 bash[9787]: audit 2021-03-10T13:40:50.571238+0000 mon.a (mon.0) 204 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:50.562125\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:50.562314\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:50.562428\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:50.562531\", \"created\": \"2021-03-10T13:40:50.072448\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}}, \"last_daemon_update\": \"2021-03-10T13:40:50.562713\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]': finished 2021-03-10T13:40:51.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:51 gibba045 bash[9787]: audit 2021-03-10T13:40:50.572616+0000 mon.a (mon.0) 205 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:40:52.436 INFO:journalctl@ceph.osd.0.gibba015.stdout:Mar 10 13:40:52 gibba015 bash[14611]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2021-03-10T13:40:52.436 INFO:journalctl@ceph.osd.0.gibba015.stdout:Mar 10 13:40:52 gibba015 bash[14611]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-0 --no-mon-config 2021-03-10T13:40:52.436 INFO:journalctl@ceph.osd.0.gibba015.stdout:Mar 10 13:40:52 gibba015 bash[14611]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0/block 2021-03-10T13:40:52.437 INFO:journalctl@ceph.osd.0.gibba015.stdout:Mar 10 13:40:52 gibba015 bash[14611]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-0/block 2021-03-10T13:40:52.437 INFO:journalctl@ceph.osd.0.gibba015.stdout:Mar 10 13:40:52 gibba015 bash[14611]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2021-03-10T13:40:52.437 INFO:journalctl@ceph.osd.0.gibba015.stdout:Mar 10 13:40:52 gibba015 bash[14611]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2021-03-10T13:40:52.437 INFO:journalctl@ceph.osd.0.gibba015.stdout:Mar 10 13:40:52 gibba015 bash[14611]: --> ceph-volume lvm activate successful for osd ID: 0 2021-03-10T13:40:52.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:52 gibba015 bash[9806]: cluster 2021-03-10T13:40:51.088161+0000 mgr.y (mgr.14140) 53 : cluster [DBG] pgmap v39: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:40:52.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:52 gibba015 bash[13005]: cluster 2021-03-10T13:40:51.088161+0000 mgr.y (mgr.14140) 53 : cluster [DBG] pgmap v39: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:40:53.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:52 gibba045 bash[9787]: cluster 2021-03-10T13:40:51.088161+0000 mgr.y (mgr.14140) 53 : cluster [DBG] pgmap v39: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:40:54.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:54 gibba015 bash[9806]: cluster 2021-03-10T13:40:53.088765+0000 mgr.y (mgr.14140) 54 : cluster [DBG] pgmap v40: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:40:54.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:54 gibba015 bash[13005]: cluster 2021-03-10T13:40:53.088765+0000 mgr.y (mgr.14140) 54 : cluster [DBG] pgmap v40: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:40:55.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:54 gibba045 bash[9787]: cluster 2021-03-10T13:40:53.088765+0000 mgr.y (mgr.14140) 54 : cluster [DBG] pgmap v40: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:40:55.973 INFO:journalctl@ceph.osd.0.gibba015.stdout:Mar 10 13:40:55 gibba015 bash[14952]: debug 2021-03-10T13:40:55.580+0000 7f44c2626ec0 -1 Falling back to public interface 2021-03-10T13:40:55.990 INFO:teuthology.orchestra.run.gibba015.stderr:--> Zapping: /dev/vg_nvme/lv_3 2021-03-10T13:40:55.991 INFO:teuthology.orchestra.run.gibba015.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2021-03-10T13:40:55.991 INFO:teuthology.orchestra.run.gibba015.stderr: stderr: 10+0 records in 2021-03-10T13:40:55.991 INFO:teuthology.orchestra.run.gibba015.stderr:10+0 records out 2021-03-10T13:40:55.991 INFO:teuthology.orchestra.run.gibba015.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0233444 s, 449 MB/s 2021-03-10T13:40:55.992 INFO:teuthology.orchestra.run.gibba015.stderr: stderr: 2021-03-10T13:40:55.992 INFO:teuthology.orchestra.run.gibba015.stderr:--> Zapping successful for: 2021-03-10T13:40:56.473 INFO:journalctl@ceph.osd.0.gibba015.stdout:Mar 10 13:40:56 gibba015 bash[14952]: debug 2021-03-10T13:40:56.212+0000 7f44c2626ec0 -1 osd.0 0 log_to_monitors {default=true} 2021-03-10T13:40:56.579 DEBUG:teuthology.orchestra.run.gibba015:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e4a642d2-81a5-11eb-9080-001a4aab830c -- ceph orch daemon add osd gibba015:vg_nvme/lv_3 2021-03-10T13:40:56.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:56 gibba015 bash[9806]: cluster 2021-03-10T13:40:55.089450+0000 mgr.y (mgr.14140) 55 : cluster [DBG] pgmap v41: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:40:56.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:56 gibba015 bash[9806]: audit 2021-03-10T13:40:56.215747+0000 mon.c (mon.1) 3 : audit [INF] from='osd.0 [v2:172.21.2.115:6802/1771792750,v1:172.21.2.115:6803/1771792750]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-03-10T13:40:56.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:56 gibba015 bash[9806]: audit 2021-03-10T13:40:56.216001+0000 mon.a (mon.0) 206 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-03-10T13:40:56.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:56 gibba015 bash[13005]: cluster 2021-03-10T13:40:55.089450+0000 mgr.y (mgr.14140) 55 : cluster [DBG] pgmap v41: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:40:56.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:56 gibba015 bash[13005]: audit 2021-03-10T13:40:56.215747+0000 mon.c (mon.1) 3 : audit [INF] from='osd.0 [v2:172.21.2.115:6802/1771792750,v1:172.21.2.115:6803/1771792750]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-03-10T13:40:56.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:56 gibba015 bash[13005]: audit 2021-03-10T13:40:56.216001+0000 mon.a (mon.0) 206 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-03-10T13:40:57.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:56 gibba045 bash[9787]: cluster 2021-03-10T13:40:55.089450+0000 mgr.y (mgr.14140) 55 : cluster [DBG] pgmap v41: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:40:57.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:56 gibba045 bash[9787]: audit 2021-03-10T13:40:56.215747+0000 mon.c (mon.1) 3 : audit [INF] from='osd.0 [v2:172.21.2.115:6802/1771792750,v1:172.21.2.115:6803/1771792750]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-03-10T13:40:57.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:56 gibba045 bash[9787]: audit 2021-03-10T13:40:56.216001+0000 mon.a (mon.0) 206 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-03-10T13:40:57.874 INFO:journalctl@ceph.osd.0.gibba015.stdout:Mar 10 13:40:57 gibba015 bash[14952]: debug 2021-03-10T13:40:57.608+0000 7f44a73d3700 -1 osd.0 0 waiting for initial osdmap 2021-03-10T13:40:57.874 INFO:journalctl@ceph.osd.0.gibba015.stdout:Mar 10 13:40:57 gibba015 bash[14952]: debug 2021-03-10T13:40:57.612+0000 7f44b25ef700 -1 osd.0 9 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T13:40:57.875 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:57 gibba015 bash[9806]: audit 2021-03-10T13:40:56.592999+0000 mon.a (mon.0) 207 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2021-03-10T13:40:57.875 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:57 gibba015 bash[9806]: cluster 2021-03-10T13:40:56.593026+0000 mon.a (mon.0) 208 : cluster [DBG] osdmap e8: 1 total, 0 up, 0 in 2021-03-10T13:40:57.875 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:57 gibba015 bash[9806]: audit 2021-03-10T13:40:56.593498+0000 mon.a (mon.0) 209 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T13:40:57.875 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:57 gibba015 bash[9806]: audit 2021-03-10T13:40:56.593926+0000 mon.c (mon.1) 4 : audit [INF] from='osd.0 [v2:172.21.2.115:6802/1771792750,v1:172.21.2.115:6803/1771792750]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0820, "args": ["host=gibba015", "root=default"]}]: dispatch 2021-03-10T13:40:57.876 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:57 gibba015 bash[9806]: audit 2021-03-10T13:40:56.601989+0000 mon.a (mon.0) 210 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0820, "args": ["host=gibba015", "root=default"]}]: dispatch 2021-03-10T13:40:57.876 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:57 gibba015 bash[9806]: audit 2021-03-10T13:40:57.581477+0000 mon.a (mon.0) 211 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:40:57.876 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:57 gibba015 bash[13005]: audit 2021-03-10T13:40:56.592999+0000 mon.a (mon.0) 207 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2021-03-10T13:40:57.876 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:57 gibba015 bash[13005]: cluster 2021-03-10T13:40:56.593026+0000 mon.a (mon.0) 208 : cluster [DBG] osdmap e8: 1 total, 0 up, 0 in 2021-03-10T13:40:57.877 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:57 gibba015 bash[13005]: audit 2021-03-10T13:40:56.593498+0000 mon.a (mon.0) 209 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T13:40:57.877 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:57 gibba015 bash[13005]: audit 2021-03-10T13:40:56.593926+0000 mon.c (mon.1) 4 : audit [INF] from='osd.0 [v2:172.21.2.115:6802/1771792750,v1:172.21.2.115:6803/1771792750]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0820, "args": ["host=gibba015", "root=default"]}]: dispatch 2021-03-10T13:40:57.877 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:57 gibba015 bash[13005]: audit 2021-03-10T13:40:56.601989+0000 mon.a (mon.0) 210 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0820, "args": ["host=gibba015", "root=default"]}]: dispatch 2021-03-10T13:40:57.877 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:57 gibba015 bash[13005]: audit 2021-03-10T13:40:57.581477+0000 mon.a (mon.0) 211 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:40:58.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:57 gibba045 bash[9787]: audit 2021-03-10T13:40:56.592999+0000 mon.a (mon.0) 207 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2021-03-10T13:40:58.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:57 gibba045 bash[9787]: cluster 2021-03-10T13:40:56.593026+0000 mon.a (mon.0) 208 : cluster [DBG] osdmap e8: 1 total, 0 up, 0 in 2021-03-10T13:40:58.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:57 gibba045 bash[9787]: audit 2021-03-10T13:40:56.593498+0000 mon.a (mon.0) 209 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T13:40:58.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:57 gibba045 bash[9787]: audit 2021-03-10T13:40:56.593926+0000 mon.c (mon.1) 4 : audit [INF] from='osd.0 [v2:172.21.2.115:6802/1771792750,v1:172.21.2.115:6803/1771792750]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0820, "args": ["host=gibba015", "root=default"]}]: dispatch 2021-03-10T13:40:58.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:57 gibba045 bash[9787]: audit 2021-03-10T13:40:56.601989+0000 mon.a (mon.0) 210 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0820, "args": ["host=gibba015", "root=default"]}]: dispatch 2021-03-10T13:40:58.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:57 gibba045 bash[9787]: audit 2021-03-10T13:40:57.581477+0000 mon.a (mon.0) 211 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:40:58.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:58 gibba015 bash[9806]: cluster 2021-03-10T13:40:57.089963+0000 mgr.y (mgr.14140) 56 : cluster [DBG] pgmap v43: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:40:58.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:58 gibba015 bash[9806]: cluster 2021-03-10T13:40:57.236635+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T13:40:58.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:58 gibba015 bash[9806]: cluster 2021-03-10T13:40:57.236733+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T13:40:58.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:58 gibba015 bash[9806]: audit 2021-03-10T13:40:57.604147+0000 mon.a (mon.0) 212 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0820, "args": ["host=gibba015", "root=default"]}]': finished 2021-03-10T13:40:58.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:58 gibba015 bash[9806]: cluster 2021-03-10T13:40:57.604208+0000 mon.a (mon.0) 213 : cluster [DBG] osdmap e9: 1 total, 0 up, 0 in 2021-03-10T13:40:58.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:58 gibba015 bash[9806]: audit 2021-03-10T13:40:57.604730+0000 mon.a (mon.0) 214 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T13:40:58.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:58 gibba015 bash[13005]: cluster 2021-03-10T13:40:57.089963+0000 mgr.y (mgr.14140) 56 : cluster [DBG] pgmap v43: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:40:58.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:58 gibba015 bash[13005]: cluster 2021-03-10T13:40:57.236635+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T13:40:58.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:58 gibba015 bash[13005]: cluster 2021-03-10T13:40:57.236733+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T13:40:58.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:58 gibba015 bash[13005]: audit 2021-03-10T13:40:57.604147+0000 mon.a (mon.0) 212 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0820, "args": ["host=gibba015", "root=default"]}]': finished 2021-03-10T13:40:58.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:58 gibba015 bash[13005]: cluster 2021-03-10T13:40:57.604208+0000 mon.a (mon.0) 213 : cluster [DBG] osdmap e9: 1 total, 0 up, 0 in 2021-03-10T13:40:58.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:58 gibba015 bash[13005]: audit 2021-03-10T13:40:57.604730+0000 mon.a (mon.0) 214 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T13:40:58.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:58 gibba015 bash[9806]: audit 2021-03-10T13:40:57.681411+0000 mon.a (mon.0) 215 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:50.562125\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:50.562314\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:50.562428\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:50.562531\", \"created\": \"2021-03-10T13:40:50.072448\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}}, \"last_daemon_update\": \"2021-03-10T13:40:50.562713\", \"last_device_update\": \"2021-03-10T13:40:57.680870\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]: dispatch 2021-03-10T13:40:58.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:58 gibba015 bash[9806]: audit 2021-03-10T13:40:57.685240+0000 mon.a (mon.0) 216 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:50.562125\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:50.562314\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:50.562428\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:50.562531\", \"created\": \"2021-03-10T13:40:50.072448\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}}, \"last_daemon_update\": \"2021-03-10T13:40:50.562713\", \"last_device_update\": \"2021-03-10T13:40:57.680870\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]': finished 2021-03-10T13:40:58.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:58 gibba015 bash[13005]: audit 2021-03-10T13:40:57.681411+0000 mon.a (mon.0) 215 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:50.562125\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:50.562314\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:50.562428\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:50.562531\", \"created\": \"2021-03-10T13:40:50.072448\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}}, \"last_daemon_update\": \"2021-03-10T13:40:50.562713\", \"last_device_update\": \"2021-03-10T13:40:57.680870\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]: dispatch 2021-03-10T13:40:58.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:58 gibba015 bash[13005]: audit 2021-03-10T13:40:57.685240+0000 mon.a (mon.0) 216 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:50.562125\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:50.562314\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:50.562428\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:50.562531\", \"created\": \"2021-03-10T13:40:50.072448\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}}, \"last_daemon_update\": \"2021-03-10T13:40:50.562713\", \"last_device_update\": \"2021-03-10T13:40:57.680870\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]': finished 2021-03-10T13:40:59.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:58 gibba045 bash[9787]: cluster 2021-03-10T13:40:57.089963+0000 mgr.y (mgr.14140) 56 : cluster [DBG] pgmap v43: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:40:59.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:58 gibba045 bash[9787]: cluster 2021-03-10T13:40:57.236635+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T13:40:59.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:58 gibba045 bash[9787]: cluster 2021-03-10T13:40:57.236733+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T13:40:59.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:58 gibba045 bash[9787]: audit 2021-03-10T13:40:57.604147+0000 mon.a (mon.0) 212 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0820, "args": ["host=gibba015", "root=default"]}]': finished 2021-03-10T13:40:59.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:58 gibba045 bash[9787]: cluster 2021-03-10T13:40:57.604208+0000 mon.a (mon.0) 213 : cluster [DBG] osdmap e9: 1 total, 0 up, 0 in 2021-03-10T13:40:59.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:58 gibba045 bash[9787]: audit 2021-03-10T13:40:57.604730+0000 mon.a (mon.0) 214 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T13:40:59.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:58 gibba045 bash[9787]: audit 2021-03-10T13:40:57.681411+0000 mon.a (mon.0) 215 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:50.562125\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:50.562314\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:50.562428\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:50.562531\", \"created\": \"2021-03-10T13:40:50.072448\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}}, \"last_daemon_update\": \"2021-03-10T13:40:50.562713\", \"last_device_update\": \"2021-03-10T13:40:57.680870\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]: dispatch 2021-03-10T13:40:59.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:58 gibba045 bash[9787]: audit 2021-03-10T13:40:57.685240+0000 mon.a (mon.0) 216 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:50.562125\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:50.562314\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:50.562428\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:50.562531\", \"created\": \"2021-03-10T13:40:50.072448\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}}, \"last_daemon_update\": \"2021-03-10T13:40:50.562713\", \"last_device_update\": \"2021-03-10T13:40:57.680870\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]': finished 2021-03-10T13:40:59.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:59 gibba015 bash[9806]: cluster 2021-03-10T13:40:58.622694+0000 mon.a (mon.0) 217 : cluster [INF] osd.0 [v2:172.21.2.115:6802/1771792750,v1:172.21.2.115:6803/1771792750] boot 2021-03-10T13:40:59.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:59 gibba015 bash[9806]: cluster 2021-03-10T13:40:58.622748+0000 mon.a (mon.0) 218 : cluster [DBG] osdmap e10: 1 total, 1 up, 1 in 2021-03-10T13:40:59.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:59 gibba015 bash[9806]: audit 2021-03-10T13:40:58.623299+0000 mon.a (mon.0) 219 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T13:40:59.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:59 gibba015 bash[9806]: audit 2021-03-10T13:40:59.295632+0000 mon.a (mon.0) 220 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T13:40:59.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:59 gibba015 bash[9806]: audit 2021-03-10T13:40:59.296514+0000 mon.a (mon.0) 221 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:40:59.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:40:59 gibba015 bash[9806]: audit 2021-03-10T13:40:59.297453+0000 mon.a (mon.0) 222 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:40:59.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:59 gibba015 bash[13005]: cluster 2021-03-10T13:40:58.622694+0000 mon.a (mon.0) 217 : cluster [INF] osd.0 [v2:172.21.2.115:6802/1771792750,v1:172.21.2.115:6803/1771792750] boot 2021-03-10T13:40:59.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:59 gibba015 bash[13005]: cluster 2021-03-10T13:40:58.622748+0000 mon.a (mon.0) 218 : cluster [DBG] osdmap e10: 1 total, 1 up, 1 in 2021-03-10T13:40:59.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:59 gibba015 bash[13005]: audit 2021-03-10T13:40:58.623299+0000 mon.a (mon.0) 219 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T13:40:59.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:59 gibba015 bash[13005]: audit 2021-03-10T13:40:59.295632+0000 mon.a (mon.0) 220 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T13:40:59.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:59 gibba015 bash[13005]: audit 2021-03-10T13:40:59.296514+0000 mon.a (mon.0) 221 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:40:59.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:40:59 gibba015 bash[13005]: audit 2021-03-10T13:40:59.297453+0000 mon.a (mon.0) 222 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:41:00.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:59 gibba045 bash[9787]: cluster 2021-03-10T13:40:58.622694+0000 mon.a (mon.0) 217 : cluster [INF] osd.0 [v2:172.21.2.115:6802/1771792750,v1:172.21.2.115:6803/1771792750] boot 2021-03-10T13:41:00.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:59 gibba045 bash[9787]: cluster 2021-03-10T13:40:58.622748+0000 mon.a (mon.0) 218 : cluster [DBG] osdmap e10: 1 total, 1 up, 1 in 2021-03-10T13:41:00.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:59 gibba045 bash[9787]: audit 2021-03-10T13:40:58.623299+0000 mon.a (mon.0) 219 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T13:41:00.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:59 gibba045 bash[9787]: audit 2021-03-10T13:40:59.295632+0000 mon.a (mon.0) 220 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T13:41:00.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:59 gibba045 bash[9787]: audit 2021-03-10T13:40:59.296514+0000 mon.a (mon.0) 221 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:41:00.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:40:59 gibba045 bash[9787]: audit 2021-03-10T13:40:59.297453+0000 mon.a (mon.0) 222 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:41:00.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:00 gibba015 bash[9806]: cluster 2021-03-10T13:40:59.090239+0000 mgr.y (mgr.14140) 57 : cluster [DBG] pgmap v46: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:41:00.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:00 gibba015 bash[9806]: audit 2021-03-10T13:40:59.294945+0000 mgr.y (mgr.14140) 58 : audit [DBG] from='client.14217 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba015:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:41:00.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:00 gibba015 bash[9806]: cephadm 2021-03-10T13:40:59.295407+0000 mgr.y (mgr.14140) 59 : cephadm [INF] Applying osd on host gibba015... 2021-03-10T13:41:00.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:00 gibba015 bash[9806]: cluster 2021-03-10T13:40:59.626656+0000 mon.a (mon.0) 223 : cluster [DBG] osdmap e11: 1 total, 1 up, 1 in 2021-03-10T13:41:00.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:00 gibba015 bash[13005]: cluster 2021-03-10T13:40:59.090239+0000 mgr.y (mgr.14140) 57 : cluster [DBG] pgmap v46: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:41:00.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:00 gibba015 bash[13005]: audit 2021-03-10T13:40:59.294945+0000 mgr.y (mgr.14140) 58 : audit [DBG] from='client.14217 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba015:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:41:00.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:00 gibba015 bash[13005]: cephadm 2021-03-10T13:40:59.295407+0000 mgr.y (mgr.14140) 59 : cephadm [INF] Applying osd on host gibba015... 2021-03-10T13:41:00.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:00 gibba015 bash[13005]: cluster 2021-03-10T13:40:59.626656+0000 mon.a (mon.0) 223 : cluster [DBG] osdmap e11: 1 total, 1 up, 1 in 2021-03-10T13:41:01.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:00 gibba045 bash[9787]: cluster 2021-03-10T13:40:59.090239+0000 mgr.y (mgr.14140) 57 : cluster [DBG] pgmap v46: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:41:01.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:00 gibba045 bash[9787]: audit 2021-03-10T13:40:59.294945+0000 mgr.y (mgr.14140) 58 : audit [DBG] from='client.14217 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba015:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:41:01.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:00 gibba045 bash[9787]: cephadm 2021-03-10T13:40:59.295407+0000 mgr.y (mgr.14140) 59 : cephadm [INF] Applying osd on host gibba015... 2021-03-10T13:41:01.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:00 gibba045 bash[9787]: cluster 2021-03-10T13:40:59.626656+0000 mon.a (mon.0) 223 : cluster [DBG] osdmap e11: 1 total, 1 up, 1 in 2021-03-10T13:41:01.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:01 gibba015 bash[9806]: cluster 2021-03-10T13:41:00.630604+0000 mon.a (mon.0) 224 : cluster [DBG] osdmap e12: 1 total, 1 up, 1 in 2021-03-10T13:41:01.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:01 gibba015 bash[13005]: cluster 2021-03-10T13:41:00.630604+0000 mon.a (mon.0) 224 : cluster [DBG] osdmap e12: 1 total, 1 up, 1 in 2021-03-10T13:41:02.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:01 gibba045 bash[9787]: cluster 2021-03-10T13:41:00.630604+0000 mon.a (mon.0) 224 : cluster [DBG] osdmap e12: 1 total, 1 up, 1 in 2021-03-10T13:41:02.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:02 gibba015 bash[9806]: cluster 2021-03-10T13:41:01.090990+0000 mgr.y (mgr.14140) 60 : cluster [DBG] pgmap v49: 1 pgs: 1 creating+peering; 0 B data, 96 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:41:02.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:02 gibba015 bash[9806]: cluster 2021-03-10T13:41:01.633608+0000 mon.a (mon.0) 225 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-03-10T13:41:02.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:02 gibba015 bash[9806]: audit 2021-03-10T13:41:02.166685+0000 mon.c (mon.1) 5 : audit [INF] from='client.? 172.21.2.115:0/2822715931' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be"}]: dispatch 2021-03-10T13:41:02.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:02 gibba015 bash[9806]: audit 2021-03-10T13:41:02.166987+0000 mon.a (mon.0) 226 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be"}]: dispatch 2021-03-10T13:41:02.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:02 gibba015 bash[9806]: audit 2021-03-10T13:41:02.171625+0000 mon.a (mon.0) 227 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be"}]': finished 2021-03-10T13:41:02.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:02 gibba015 bash[9806]: cluster 2021-03-10T13:41:02.171667+0000 mon.a (mon.0) 228 : cluster [DBG] osdmap e13: 2 total, 1 up, 1 in 2021-03-10T13:41:02.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:02 gibba015 bash[9806]: audit 2021-03-10T13:41:02.171770+0000 mon.a (mon.0) 229 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T13:41:02.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:02 gibba015 bash[13005]: cluster 2021-03-10T13:41:01.090990+0000 mgr.y (mgr.14140) 60 : cluster [DBG] pgmap v49: 1 pgs: 1 creating+peering; 0 B data, 96 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:41:02.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:02 gibba015 bash[13005]: cluster 2021-03-10T13:41:01.633608+0000 mon.a (mon.0) 225 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-03-10T13:41:02.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:02 gibba015 bash[13005]: audit 2021-03-10T13:41:02.166685+0000 mon.c (mon.1) 5 : audit [INF] from='client.? 172.21.2.115:0/2822715931' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be"}]: dispatch 2021-03-10T13:41:02.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:02 gibba015 bash[13005]: audit 2021-03-10T13:41:02.166987+0000 mon.a (mon.0) 226 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be"}]: dispatch 2021-03-10T13:41:02.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:02 gibba015 bash[13005]: audit 2021-03-10T13:41:02.171625+0000 mon.a (mon.0) 227 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be"}]': finished 2021-03-10T13:41:02.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:02 gibba015 bash[13005]: cluster 2021-03-10T13:41:02.171667+0000 mon.a (mon.0) 228 : cluster [DBG] osdmap e13: 2 total, 1 up, 1 in 2021-03-10T13:41:02.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:02 gibba015 bash[13005]: audit 2021-03-10T13:41:02.171770+0000 mon.a (mon.0) 229 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T13:41:03.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:02 gibba045 bash[9787]: cluster 2021-03-10T13:41:01.090990+0000 mgr.y (mgr.14140) 60 : cluster [DBG] pgmap v49: 1 pgs: 1 creating+peering; 0 B data, 96 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:41:03.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:02 gibba045 bash[9787]: cluster 2021-03-10T13:41:01.633608+0000 mon.a (mon.0) 225 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-03-10T13:41:03.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:02 gibba045 bash[9787]: audit 2021-03-10T13:41:02.166685+0000 mon.c (mon.1) 5 : audit [INF] from='client.? 172.21.2.115:0/2822715931' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be"}]: dispatch 2021-03-10T13:41:03.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:02 gibba045 bash[9787]: audit 2021-03-10T13:41:02.166987+0000 mon.a (mon.0) 226 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be"}]: dispatch 2021-03-10T13:41:03.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:02 gibba045 bash[9787]: audit 2021-03-10T13:41:02.171625+0000 mon.a (mon.0) 227 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be"}]': finished 2021-03-10T13:41:03.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:02 gibba045 bash[9787]: cluster 2021-03-10T13:41:02.171667+0000 mon.a (mon.0) 228 : cluster [DBG] osdmap e13: 2 total, 1 up, 1 in 2021-03-10T13:41:03.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:02 gibba045 bash[9787]: audit 2021-03-10T13:41:02.171770+0000 mon.a (mon.0) 229 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T13:41:04.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:04 gibba015 bash[9806]: cluster 2021-03-10T13:41:03.091873+0000 mgr.y (mgr.14140) 61 : cluster [DBG] pgmap v51: 1 pgs: 1 creating+peering; 0 B data, 96 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:41:04.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:04 gibba015 bash[9806]: audit 2021-03-10T13:41:04.160655+0000 mon.a (mon.0) 230 : audit [DBG] from='client.? 172.21.2.115:0/1052134880' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T13:41:04.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:04 gibba015 bash[13005]: cluster 2021-03-10T13:41:03.091873+0000 mgr.y (mgr.14140) 61 : cluster [DBG] pgmap v51: 1 pgs: 1 creating+peering; 0 B data, 96 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:41:04.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:04 gibba015 bash[13005]: audit 2021-03-10T13:41:04.160655+0000 mon.a (mon.0) 230 : audit [DBG] from='client.? 172.21.2.115:0/1052134880' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T13:41:05.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:04 gibba045 bash[9787]: cluster 2021-03-10T13:41:03.091873+0000 mgr.y (mgr.14140) 61 : cluster [DBG] pgmap v51: 1 pgs: 1 creating+peering; 0 B data, 96 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:41:05.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:04 gibba045 bash[9787]: audit 2021-03-10T13:41:04.160655+0000 mon.a (mon.0) 230 : audit [DBG] from='client.? 172.21.2.115:0/1052134880' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T13:41:06.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:06 gibba015 bash[9806]: cluster 2021-03-10T13:41:05.092672+0000 mgr.y (mgr.14140) 62 : cluster [DBG] pgmap v52: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:41:06.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:06 gibba015 bash[13005]: cluster 2021-03-10T13:41:05.092672+0000 mgr.y (mgr.14140) 62 : cluster [DBG] pgmap v52: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:41:07.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:06 gibba045 bash[9787]: cluster 2021-03-10T13:41:05.092672+0000 mgr.y (mgr.14140) 62 : cluster [DBG] pgmap v52: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:41:07.779 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:07 gibba015 bash[9806]: audit 2021-03-10T13:41:06.706895+0000 mon.a (mon.0) 231 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:41:07.780 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:07 gibba015 bash[9806]: cluster 2021-03-10T13:41:07.075264+0000 mon.a (mon.0) 232 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2021-03-10T13:41:07.780 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:07 gibba015 bash[13005]: audit 2021-03-10T13:41:06.706895+0000 mon.a (mon.0) 231 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:41:07.780 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:07 gibba015 bash[13005]: cluster 2021-03-10T13:41:07.075264+0000 mon.a (mon.0) 232 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2021-03-10T13:41:08.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:07 gibba045 bash[9787]: audit 2021-03-10T13:41:06.706895+0000 mon.a (mon.0) 231 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:41:08.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:07 gibba045 bash[9787]: cluster 2021-03-10T13:41:07.075264+0000 mon.a (mon.0) 232 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2021-03-10T13:41:08.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:08 gibba015 bash[9806]: cluster 2021-03-10T13:41:07.093254+0000 mgr.y (mgr.14140) 63 : cluster [DBG] pgmap v53: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:41:08.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:08 gibba015 bash[13005]: cluster 2021-03-10T13:41:07.093254+0000 mgr.y (mgr.14140) 63 : cluster [DBG] pgmap v53: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:41:09.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:08 gibba045 bash[9787]: cluster 2021-03-10T13:41:07.093254+0000 mgr.y (mgr.14140) 63 : cluster [DBG] pgmap v53: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:41:10.888 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:10 gibba015 bash[9806]: cluster 2021-03-10T13:41:09.093490+0000 mgr.y (mgr.14140) 64 : cluster [DBG] pgmap v54: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:41:10.889 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:10 gibba015 bash[9806]: audit 2021-03-10T13:41:09.777642+0000 mon.a (mon.0) 233 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2021-03-10T13:41:10.889 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:10 gibba015 bash[9806]: audit 2021-03-10T13:41:09.778475+0000 mon.a (mon.0) 234 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:41:10.889 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:10 gibba015 bash[9806]: cephadm 2021-03-10T13:41:09.778994+0000 mgr.y (mgr.14140) 65 : cephadm [INF] Deploying daemon osd.1 on gibba015 2021-03-10T13:41:10.889 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:10 gibba015 bash[9806]: audit 2021-03-10T13:41:09.779150+0000 mon.a (mon.0) 235 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.1", "key": "container_image"}]: dispatch 2021-03-10T13:41:10.890 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:10 gibba015 bash[13005]: cluster 2021-03-10T13:41:09.093490+0000 mgr.y (mgr.14140) 64 : cluster [DBG] pgmap v54: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:41:10.890 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:10 gibba015 bash[13005]: audit 2021-03-10T13:41:09.777642+0000 mon.a (mon.0) 233 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2021-03-10T13:41:10.890 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:10 gibba015 bash[13005]: audit 2021-03-10T13:41:09.778475+0000 mon.a (mon.0) 234 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:41:10.890 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:10 gibba015 bash[13005]: cephadm 2021-03-10T13:41:09.778994+0000 mgr.y (mgr.14140) 65 : cephadm [INF] Deploying daemon osd.1 on gibba015 2021-03-10T13:41:10.891 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:10 gibba015 bash[13005]: audit 2021-03-10T13:41:09.779150+0000 mon.a (mon.0) 235 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.1", "key": "container_image"}]: dispatch 2021-03-10T13:41:11.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:10 gibba045 bash[9787]: cluster 2021-03-10T13:41:09.093490+0000 mgr.y (mgr.14140) 64 : cluster [DBG] pgmap v54: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:41:11.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:10 gibba045 bash[9787]: audit 2021-03-10T13:41:09.777642+0000 mon.a (mon.0) 233 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2021-03-10T13:41:11.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:10 gibba045 bash[9787]: audit 2021-03-10T13:41:09.778475+0000 mon.a (mon.0) 234 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:41:11.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:10 gibba045 bash[9787]: cephadm 2021-03-10T13:41:09.778994+0000 mgr.y (mgr.14140) 65 : cephadm [INF] Deploying daemon osd.1 on gibba015 2021-03-10T13:41:11.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:10 gibba045 bash[9787]: audit 2021-03-10T13:41:09.779150+0000 mon.a (mon.0) 235 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.1", "key": "container_image"}]: dispatch 2021-03-10T13:41:11.573 INFO:teuthology.orchestra.run.gibba015.stdout:Created osd(s) 1 on host 'gibba015' 2021-03-10T13:41:11.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:11 gibba015 bash[13005]: audit 2021-03-10T13:41:11.564947+0000 mon.a (mon.0) 236 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:50.562125\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:50.562314\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:50.562428\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:50.562531\", \"created\": \"2021-03-10T13:40:50.072448\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}}, \"last_device_update\": \"2021-03-10T13:40:57.680870\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]: dispatch 2021-03-10T13:41:11.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:11 gibba015 bash[13005]: audit 2021-03-10T13:41:11.565464+0000 mon.a (mon.0) 237 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:41:11.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:11 gibba015 bash[13005]: audit 2021-03-10T13:41:11.568735+0000 mon.a (mon.0) 238 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:50.562125\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:50.562314\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:50.562428\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:50.562531\", \"created\": \"2021-03-10T13:40:50.072448\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}}, \"last_device_update\": \"2021-03-10T13:40:57.680870\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]': finished 2021-03-10T13:41:11.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:11 gibba015 bash[9806]: audit 2021-03-10T13:41:11.564947+0000 mon.a (mon.0) 236 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:50.562125\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:50.562314\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:50.562428\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:50.562531\", \"created\": \"2021-03-10T13:40:50.072448\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}}, \"last_device_update\": \"2021-03-10T13:40:57.680870\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]: dispatch 2021-03-10T13:41:11.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:11 gibba015 bash[9806]: audit 2021-03-10T13:41:11.565464+0000 mon.a (mon.0) 237 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:41:11.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:11 gibba015 bash[9806]: audit 2021-03-10T13:41:11.568735+0000 mon.a (mon.0) 238 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:50.562125\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:50.562314\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:50.562428\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:50.562531\", \"created\": \"2021-03-10T13:40:50.072448\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}}, \"last_device_update\": \"2021-03-10T13:40:57.680870\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]': finished 2021-03-10T13:41:12.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:11 gibba045 bash[9787]: audit 2021-03-10T13:41:11.564947+0000 mon.a (mon.0) 236 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:50.562125\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:50.562314\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:50.562428\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:50.562531\", \"created\": \"2021-03-10T13:40:50.072448\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}}, \"last_device_update\": \"2021-03-10T13:40:57.680870\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]: dispatch 2021-03-10T13:41:12.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:11 gibba045 bash[9787]: audit 2021-03-10T13:41:11.565464+0000 mon.a (mon.0) 237 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:41:12.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:11 gibba045 bash[9787]: audit 2021-03-10T13:41:11.568735+0000 mon.a (mon.0) 238 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:50.562125\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:50.562314\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:50.562428\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:50.562531\", \"created\": \"2021-03-10T13:40:50.072448\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}}, \"last_device_update\": \"2021-03-10T13:40:57.680870\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]': finished 2021-03-10T13:41:12.748 DEBUG:teuthology.orchestra.run.gibba015:osd.1> sudo journalctl -f -n 0 -u ceph-e4a642d2-81a5-11eb-9080-001a4aab830c@osd.1.service 2021-03-10T13:41:12.750 INFO:tasks.cephadm:Deploying osd.2 on gibba015 with /dev/vg_nvme/lv_2... 2021-03-10T13:41:12.750 DEBUG:teuthology.orchestra.run.gibba015:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e4a642d2-81a5-11eb-9080-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2021-03-10T13:41:12.822 INFO:journalctl@ceph.osd.1.gibba015.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T13:41:12.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:12 gibba015 bash[9806]: cluster 2021-03-10T13:41:11.094193+0000 mgr.y (mgr.14140) 66 : cluster [DBG] pgmap v55: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:41:12.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:12 gibba015 bash[13005]: cluster 2021-03-10T13:41:11.094193+0000 mgr.y (mgr.14140) 66 : cluster [DBG] pgmap v55: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:41:12.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:12 gibba015 bash[13005]: audit 2021-03-10T13:41:12.020982+0000 mon.a (mon.0) 239 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019283\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019428\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019514\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019592\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019669\", \"created\": \"2021-03-10T13:41:11.556448\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}}, \"last_daemon_update\": \"2021-03-10T13:41:12.019798\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]: dispatch 2021-03-10T13:41:12.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:12 gibba015 bash[13005]: audit 2021-03-10T13:41:12.026337+0000 mon.a (mon.0) 240 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019283\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019428\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019514\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019592\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019669\", \"created\": \"2021-03-10T13:41:11.556448\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}}, \"last_daemon_update\": \"2021-03-10T13:41:12.019798\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]': finished 2021-03-10T13:41:12.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:12 gibba015 bash[13005]: audit 2021-03-10T13:41:12.027114+0000 mon.a (mon.0) 241 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:41:12.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:12 gibba015 bash[9806]: audit 2021-03-10T13:41:12.020982+0000 mon.a (mon.0) 239 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019283\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019428\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019514\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019592\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019669\", \"created\": \"2021-03-10T13:41:11.556448\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}}, \"last_daemon_update\": \"2021-03-10T13:41:12.019798\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]: dispatch 2021-03-10T13:41:12.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:12 gibba015 bash[9806]: audit 2021-03-10T13:41:12.026337+0000 mon.a (mon.0) 240 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019283\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019428\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019514\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019592\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019669\", \"created\": \"2021-03-10T13:41:11.556448\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}}, \"last_daemon_update\": \"2021-03-10T13:41:12.019798\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]': finished 2021-03-10T13:41:12.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:12 gibba015 bash[9806]: audit 2021-03-10T13:41:12.027114+0000 mon.a (mon.0) 241 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:41:13.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:12 gibba045 bash[9787]: cluster 2021-03-10T13:41:11.094193+0000 mgr.y (mgr.14140) 66 : cluster [DBG] pgmap v55: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:41:13.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:12 gibba045 bash[9787]: audit 2021-03-10T13:41:12.020982+0000 mon.a (mon.0) 239 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019283\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019428\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019514\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019592\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019669\", \"created\": \"2021-03-10T13:41:11.556448\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}}, \"last_daemon_update\": \"2021-03-10T13:41:12.019798\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]: dispatch 2021-03-10T13:41:13.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:12 gibba045 bash[9787]: audit 2021-03-10T13:41:12.026337+0000 mon.a (mon.0) 240 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019283\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019428\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019514\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019592\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019669\", \"created\": \"2021-03-10T13:41:11.556448\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}}, \"last_daemon_update\": \"2021-03-10T13:41:12.019798\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]': finished 2021-03-10T13:41:13.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:12 gibba045 bash[9787]: audit 2021-03-10T13:41:12.027114+0000 mon.a (mon.0) 241 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:41:14.224 INFO:journalctl@ceph.osd.1.gibba015.stdout:Mar 10 13:41:13 gibba015 bash[16043]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2021-03-10T13:41:14.225 INFO:journalctl@ceph.osd.1.gibba015.stdout:Mar 10 13:41:13 gibba015 bash[16043]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-1 --no-mon-config 2021-03-10T13:41:14.225 INFO:journalctl@ceph.osd.1.gibba015.stdout:Mar 10 13:41:13 gibba015 bash[16043]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-1/block 2021-03-10T13:41:14.225 INFO:journalctl@ceph.osd.1.gibba015.stdout:Mar 10 13:41:13 gibba015 bash[16043]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-1/block 2021-03-10T13:41:14.225 INFO:journalctl@ceph.osd.1.gibba015.stdout:Mar 10 13:41:13 gibba015 bash[16043]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2021-03-10T13:41:14.225 INFO:journalctl@ceph.osd.1.gibba015.stdout:Mar 10 13:41:13 gibba015 bash[16043]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2021-03-10T13:41:14.226 INFO:journalctl@ceph.osd.1.gibba015.stdout:Mar 10 13:41:13 gibba015 bash[16043]: --> ceph-volume lvm activate successful for osd ID: 1 2021-03-10T13:41:14.816 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:14 gibba015 bash[9806]: cluster 2021-03-10T13:41:13.094887+0000 mgr.y (mgr.14140) 67 : cluster [DBG] pgmap v56: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:41:14.817 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:14 gibba015 bash[13005]: cluster 2021-03-10T13:41:13.094887+0000 mgr.y (mgr.14140) 67 : cluster [DBG] pgmap v56: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:41:15.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:14 gibba045 bash[9787]: cluster 2021-03-10T13:41:13.094887+0000 mgr.y (mgr.14140) 67 : cluster [DBG] pgmap v56: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:41:16.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:16 gibba015 bash[9806]: cluster 2021-03-10T13:41:15.095578+0000 mgr.y (mgr.14140) 68 : cluster [DBG] pgmap v57: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:41:16.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:16 gibba015 bash[13005]: cluster 2021-03-10T13:41:15.095578+0000 mgr.y (mgr.14140) 68 : cluster [DBG] pgmap v57: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:41:17.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:16 gibba045 bash[9787]: cluster 2021-03-10T13:41:15.095578+0000 mgr.y (mgr.14140) 68 : cluster [DBG] pgmap v57: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:41:17.653 INFO:teuthology.orchestra.run.gibba015.stderr:--> Zapping: /dev/vg_nvme/lv_2 2021-03-10T13:41:17.653 INFO:teuthology.orchestra.run.gibba015.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2021-03-10T13:41:17.653 INFO:teuthology.orchestra.run.gibba015.stderr: stderr: 10+0 records in 2021-03-10T13:41:17.654 INFO:teuthology.orchestra.run.gibba015.stderr:10+0 records out 2021-03-10T13:41:17.654 INFO:teuthology.orchestra.run.gibba015.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00734425 s, 1.4 GB/s 2021-03-10T13:41:17.654 INFO:teuthology.orchestra.run.gibba015.stderr:--> Zapping successful for: 2021-03-10T13:41:18.094 INFO:journalctl@ceph.osd.1.gibba015.stdout:Mar 10 13:41:17 gibba015 bash[16403]: debug 2021-03-10T13:41:17.844+0000 7f1d6cd01ec0 -1 Falling back to public interface 2021-03-10T13:41:18.128 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:18 gibba015 bash[9806]: cluster 2021-03-10T13:41:17.096168+0000 mgr.y (mgr.14140) 69 : cluster [DBG] pgmap v58: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:41:18.128 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:18 gibba015 bash[13005]: cluster 2021-03-10T13:41:17.096168+0000 mgr.y (mgr.14140) 69 : cluster [DBG] pgmap v58: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:41:18.466 DEBUG:teuthology.orchestra.run.gibba015:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e4a642d2-81a5-11eb-9080-001a4aab830c -- ceph orch daemon add osd gibba015:vg_nvme/lv_2 2021-03-10T13:41:18.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:18 gibba045 bash[9787]: cluster 2021-03-10T13:41:17.096168+0000 mgr.y (mgr.14140) 69 : cluster [DBG] pgmap v58: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:41:18.724 INFO:journalctl@ceph.osd.1.gibba015.stdout:Mar 10 13:41:18 gibba015 bash[16403]: debug 2021-03-10T13:41:18.528+0000 7f1d6cd01ec0 -1 osd.1 0 log_to_monitors {default=true} 2021-03-10T13:41:19.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:19 gibba015 bash[9806]: audit 2021-03-10T13:41:18.533757+0000 mon.c (mon.1) 6 : audit [INF] from='osd.1 [v2:172.21.2.115:6810/1316793725,v1:172.21.2.115:6811/1316793725]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-03-10T13:41:19.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:19 gibba015 bash[9806]: audit 2021-03-10T13:41:18.533936+0000 mon.a (mon.0) 242 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-03-10T13:41:19.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:19 gibba015 bash[13005]: audit 2021-03-10T13:41:18.533757+0000 mon.c (mon.1) 6 : audit [INF] from='osd.1 [v2:172.21.2.115:6810/1316793725,v1:172.21.2.115:6811/1316793725]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-03-10T13:41:19.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:19 gibba015 bash[13005]: audit 2021-03-10T13:41:18.533936+0000 mon.a (mon.0) 242 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-03-10T13:41:19.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:19 gibba045 bash[9787]: audit 2021-03-10T13:41:18.533757+0000 mon.c (mon.1) 6 : audit [INF] from='osd.1 [v2:172.21.2.115:6810/1316793725,v1:172.21.2.115:6811/1316793725]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-03-10T13:41:19.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:19 gibba045 bash[9787]: audit 2021-03-10T13:41:18.533936+0000 mon.a (mon.0) 242 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-03-10T13:41:20.474 INFO:journalctl@ceph.osd.1.gibba015.stdout:Mar 10 13:41:20 gibba015 bash[16403]: debug 2021-03-10T13:41:20.116+0000 7f1d55ab6700 -1 osd.1 0 waiting for initial osdmap 2021-03-10T13:41:20.474 INFO:journalctl@ceph.osd.1.gibba015.stdout:Mar 10 13:41:20 gibba015 bash[16403]: debug 2021-03-10T13:41:20.116+0000 7f1d60cd2700 -1 osd.1 15 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T13:41:20.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:20 gibba015 bash[9806]: cluster 2021-03-10T13:41:19.096380+0000 mgr.y (mgr.14140) 70 : cluster [DBG] pgmap v59: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:41:20.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:20 gibba015 bash[9806]: audit 2021-03-10T13:41:19.106462+0000 mon.a (mon.0) 243 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2021-03-10T13:41:20.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:20 gibba015 bash[9806]: cluster 2021-03-10T13:41:19.106504+0000 mon.a (mon.0) 244 : cluster [DBG] osdmap e14: 2 total, 1 up, 1 in 2021-03-10T13:41:20.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:20 gibba015 bash[9806]: audit 2021-03-10T13:41:19.106669+0000 mon.a (mon.0) 245 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:41:20.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:20 gibba015 bash[9806]: audit 2021-03-10T13:41:19.106931+0000 mon.a (mon.0) 246 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T13:41:20.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:20 gibba015 bash[9806]: audit 2021-03-10T13:41:19.107043+0000 mon.c (mon.1) 7 : audit [INF] from='osd.1 [v2:172.21.2.115:6810/1316793725,v1:172.21.2.115:6811/1316793725]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0820, "args": ["host=gibba015", "root=default"]}]: dispatch 2021-03-10T13:41:20.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:20 gibba015 bash[9806]: audit 2021-03-10T13:41:19.107414+0000 mon.a (mon.0) 247 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0820, "args": ["host=gibba015", "root=default"]}]: dispatch 2021-03-10T13:41:20.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:20 gibba015 bash[13005]: cluster 2021-03-10T13:41:19.096380+0000 mgr.y (mgr.14140) 70 : cluster [DBG] pgmap v59: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:41:20.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:20 gibba015 bash[13005]: audit 2021-03-10T13:41:19.106462+0000 mon.a (mon.0) 243 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2021-03-10T13:41:20.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:20 gibba015 bash[13005]: cluster 2021-03-10T13:41:19.106504+0000 mon.a (mon.0) 244 : cluster [DBG] osdmap e14: 2 total, 1 up, 1 in 2021-03-10T13:41:20.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:20 gibba015 bash[13005]: audit 2021-03-10T13:41:19.106669+0000 mon.a (mon.0) 245 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:41:20.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:20 gibba015 bash[13005]: audit 2021-03-10T13:41:19.106931+0000 mon.a (mon.0) 246 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T13:41:20.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:20 gibba015 bash[13005]: audit 2021-03-10T13:41:19.107043+0000 mon.c (mon.1) 7 : audit [INF] from='osd.1 [v2:172.21.2.115:6810/1316793725,v1:172.21.2.115:6811/1316793725]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0820, "args": ["host=gibba015", "root=default"]}]: dispatch 2021-03-10T13:41:20.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:20 gibba015 bash[13005]: audit 2021-03-10T13:41:19.107414+0000 mon.a (mon.0) 247 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0820, "args": ["host=gibba015", "root=default"]}]: dispatch 2021-03-10T13:41:20.479 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:20 gibba015 bash[9806]: audit 2021-03-10T13:41:19.205908+0000 mon.a (mon.0) 248 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019283\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019428\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019514\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019592\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019669\", \"created\": \"2021-03-10T13:41:11.556448\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}}, \"last_daemon_update\": \"2021-03-10T13:41:12.019798\", \"last_device_update\": \"2021-03-10T13:41:19.205323\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]: dispatch 2021-03-10T13:41:20.479 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:20 gibba015 bash[9806]: audit 2021-03-10T13:41:19.209302+0000 mon.a (mon.0) 249 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019283\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019428\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019514\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019592\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019669\", \"created\": \"2021-03-10T13:41:11.556448\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}}, \"last_daemon_update\": \"2021-03-10T13:41:12.019798\", \"last_device_update\": \"2021-03-10T13:41:19.205323\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]': finished 2021-03-10T13:41:20.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:20 gibba015 bash[13005]: audit 2021-03-10T13:41:19.205908+0000 mon.a (mon.0) 248 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019283\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019428\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019514\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019592\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019669\", \"created\": \"2021-03-10T13:41:11.556448\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}}, \"last_daemon_update\": \"2021-03-10T13:41:12.019798\", \"last_device_update\": \"2021-03-10T13:41:19.205323\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]: dispatch 2021-03-10T13:41:20.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:20 gibba015 bash[13005]: audit 2021-03-10T13:41:19.209302+0000 mon.a (mon.0) 249 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019283\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019428\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019514\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019592\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019669\", \"created\": \"2021-03-10T13:41:11.556448\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}}, \"last_daemon_update\": \"2021-03-10T13:41:12.019798\", \"last_device_update\": \"2021-03-10T13:41:19.205323\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]': finished 2021-03-10T13:41:20.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:20 gibba045 bash[9787]: cluster 2021-03-10T13:41:19.096380+0000 mgr.y (mgr.14140) 70 : cluster [DBG] pgmap v59: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:41:20.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:20 gibba045 bash[9787]: audit 2021-03-10T13:41:19.106462+0000 mon.a (mon.0) 243 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2021-03-10T13:41:20.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:20 gibba045 bash[9787]: cluster 2021-03-10T13:41:19.106504+0000 mon.a (mon.0) 244 : cluster [DBG] osdmap e14: 2 total, 1 up, 1 in 2021-03-10T13:41:20.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:20 gibba045 bash[9787]: audit 2021-03-10T13:41:19.106669+0000 mon.a (mon.0) 245 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:41:20.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:20 gibba045 bash[9787]: audit 2021-03-10T13:41:19.106931+0000 mon.a (mon.0) 246 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T13:41:20.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:20 gibba045 bash[9787]: audit 2021-03-10T13:41:19.107043+0000 mon.c (mon.1) 7 : audit [INF] from='osd.1 [v2:172.21.2.115:6810/1316793725,v1:172.21.2.115:6811/1316793725]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0820, "args": ["host=gibba015", "root=default"]}]: dispatch 2021-03-10T13:41:20.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:20 gibba045 bash[9787]: audit 2021-03-10T13:41:19.107414+0000 mon.a (mon.0) 247 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0820, "args": ["host=gibba015", "root=default"]}]: dispatch 2021-03-10T13:41:20.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:20 gibba045 bash[9787]: audit 2021-03-10T13:41:19.205908+0000 mon.a (mon.0) 248 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019283\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019428\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019514\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019592\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019669\", \"created\": \"2021-03-10T13:41:11.556448\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}}, \"last_daemon_update\": \"2021-03-10T13:41:12.019798\", \"last_device_update\": \"2021-03-10T13:41:19.205323\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]: dispatch 2021-03-10T13:41:20.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:20 gibba045 bash[9787]: audit 2021-03-10T13:41:19.209302+0000 mon.a (mon.0) 249 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019283\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019428\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019514\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019592\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019669\", \"created\": \"2021-03-10T13:41:11.556448\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}}, \"last_daemon_update\": \"2021-03-10T13:41:12.019798\", \"last_device_update\": \"2021-03-10T13:41:19.205323\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]': finished 2021-03-10T13:41:21.368 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:21 gibba015 bash[9806]: cluster 2021-03-10T13:41:19.554861+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T13:41:21.368 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:21 gibba015 bash[9806]: cluster 2021-03-10T13:41:19.554907+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T13:41:21.369 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:21 gibba015 bash[9806]: audit 2021-03-10T13:41:20.108663+0000 mon.a (mon.0) 250 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0820, "args": ["host=gibba015", "root=default"]}]': finished 2021-03-10T13:41:21.369 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:21 gibba015 bash[9806]: cluster 2021-03-10T13:41:20.108732+0000 mon.a (mon.0) 251 : cluster [DBG] osdmap e15: 2 total, 1 up, 1 in 2021-03-10T13:41:21.369 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:21 gibba015 bash[9806]: audit 2021-03-10T13:41:20.109146+0000 mon.a (mon.0) 252 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T13:41:21.369 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:21 gibba015 bash[13005]: cluster 2021-03-10T13:41:19.554861+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T13:41:21.370 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:21 gibba015 bash[13005]: cluster 2021-03-10T13:41:19.554907+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T13:41:21.370 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:21 gibba015 bash[13005]: audit 2021-03-10T13:41:20.108663+0000 mon.a (mon.0) 250 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0820, "args": ["host=gibba015", "root=default"]}]': finished 2021-03-10T13:41:21.370 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:21 gibba015 bash[13005]: cluster 2021-03-10T13:41:20.108732+0000 mon.a (mon.0) 251 : cluster [DBG] osdmap e15: 2 total, 1 up, 1 in 2021-03-10T13:41:21.370 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:21 gibba015 bash[13005]: audit 2021-03-10T13:41:20.109146+0000 mon.a (mon.0) 252 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T13:41:21.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:21 gibba045 bash[9787]: cluster 2021-03-10T13:41:19.554861+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T13:41:21.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:21 gibba045 bash[9787]: cluster 2021-03-10T13:41:19.554907+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T13:41:21.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:21 gibba045 bash[9787]: audit 2021-03-10T13:41:20.108663+0000 mon.a (mon.0) 250 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0820, "args": ["host=gibba015", "root=default"]}]': finished 2021-03-10T13:41:21.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:21 gibba045 bash[9787]: cluster 2021-03-10T13:41:20.108732+0000 mon.a (mon.0) 251 : cluster [DBG] osdmap e15: 2 total, 1 up, 1 in 2021-03-10T13:41:21.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:21 gibba045 bash[9787]: audit 2021-03-10T13:41:20.109146+0000 mon.a (mon.0) 252 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T13:41:22.461 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:22 gibba015 bash[9806]: cluster 2021-03-10T13:41:21.096614+0000 mgr.y (mgr.14140) 71 : cluster [DBG] pgmap v62: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:41:22.462 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:22 gibba015 bash[9806]: cluster 2021-03-10T13:41:21.120780+0000 mon.a (mon.0) 253 : cluster [INF] osd.1 [v2:172.21.2.115:6810/1316793725,v1:172.21.2.115:6811/1316793725] boot 2021-03-10T13:41:22.462 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:22 gibba015 bash[9806]: cluster 2021-03-10T13:41:21.120806+0000 mon.a (mon.0) 254 : cluster [DBG] osdmap e16: 2 total, 2 up, 2 in 2021-03-10T13:41:22.462 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:22 gibba015 bash[9806]: audit 2021-03-10T13:41:21.121298+0000 mon.a (mon.0) 255 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T13:41:22.462 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:22 gibba015 bash[9806]: audit 2021-03-10T13:41:21.251044+0000 mgr.y (mgr.14140) 72 : audit [DBG] from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba015:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:41:22.462 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:22 gibba015 bash[9806]: cephadm 2021-03-10T13:41:21.251494+0000 mgr.y (mgr.14140) 73 : cephadm [INF] Applying osd on host gibba015... 2021-03-10T13:41:22.463 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:22 gibba015 bash[9806]: audit 2021-03-10T13:41:21.251696+0000 mon.a (mon.0) 256 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T13:41:22.463 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:22 gibba015 bash[9806]: audit 2021-03-10T13:41:21.252468+0000 mon.a (mon.0) 257 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:41:22.463 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:22 gibba015 bash[9806]: audit 2021-03-10T13:41:21.253287+0000 mon.a (mon.0) 258 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:41:22.463 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:22 gibba015 bash[13005]: cluster 2021-03-10T13:41:21.096614+0000 mgr.y (mgr.14140) 71 : cluster [DBG] pgmap v62: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:41:22.464 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:22 gibba015 bash[13005]: cluster 2021-03-10T13:41:21.120780+0000 mon.a (mon.0) 253 : cluster [INF] osd.1 [v2:172.21.2.115:6810/1316793725,v1:172.21.2.115:6811/1316793725] boot 2021-03-10T13:41:22.464 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:22 gibba015 bash[13005]: cluster 2021-03-10T13:41:21.120806+0000 mon.a (mon.0) 254 : cluster [DBG] osdmap e16: 2 total, 2 up, 2 in 2021-03-10T13:41:22.464 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:22 gibba015 bash[13005]: audit 2021-03-10T13:41:21.121298+0000 mon.a (mon.0) 255 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T13:41:22.464 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:22 gibba015 bash[13005]: audit 2021-03-10T13:41:21.251044+0000 mgr.y (mgr.14140) 72 : audit [DBG] from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba015:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:41:22.464 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:22 gibba015 bash[13005]: cephadm 2021-03-10T13:41:21.251494+0000 mgr.y (mgr.14140) 73 : cephadm [INF] Applying osd on host gibba015... 2021-03-10T13:41:22.465 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:22 gibba015 bash[13005]: audit 2021-03-10T13:41:21.251696+0000 mon.a (mon.0) 256 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T13:41:22.465 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:22 gibba015 bash[13005]: audit 2021-03-10T13:41:21.252468+0000 mon.a (mon.0) 257 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:41:22.465 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:22 gibba015 bash[13005]: audit 2021-03-10T13:41:21.253287+0000 mon.a (mon.0) 258 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:41:22.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:22 gibba045 bash[9787]: cluster 2021-03-10T13:41:21.096614+0000 mgr.y (mgr.14140) 71 : cluster [DBG] pgmap v62: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:41:22.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:22 gibba045 bash[9787]: cluster 2021-03-10T13:41:21.120780+0000 mon.a (mon.0) 253 : cluster [INF] osd.1 [v2:172.21.2.115:6810/1316793725,v1:172.21.2.115:6811/1316793725] boot 2021-03-10T13:41:22.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:22 gibba045 bash[9787]: cluster 2021-03-10T13:41:21.120806+0000 mon.a (mon.0) 254 : cluster [DBG] osdmap e16: 2 total, 2 up, 2 in 2021-03-10T13:41:22.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:22 gibba045 bash[9787]: audit 2021-03-10T13:41:21.121298+0000 mon.a (mon.0) 255 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T13:41:22.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:22 gibba045 bash[9787]: audit 2021-03-10T13:41:21.251044+0000 mgr.y (mgr.14140) 72 : audit [DBG] from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba015:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:41:22.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:22 gibba045 bash[9787]: cephadm 2021-03-10T13:41:21.251494+0000 mgr.y (mgr.14140) 73 : cephadm [INF] Applying osd on host gibba015... 2021-03-10T13:41:22.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:22 gibba045 bash[9787]: audit 2021-03-10T13:41:21.251696+0000 mon.a (mon.0) 256 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T13:41:22.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:22 gibba045 bash[9787]: audit 2021-03-10T13:41:21.252468+0000 mon.a (mon.0) 257 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:41:22.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:22 gibba045 bash[9787]: audit 2021-03-10T13:41:21.253287+0000 mon.a (mon.0) 258 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:41:23.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:23 gibba015 bash[9806]: cluster 2021-03-10T13:41:22.139711+0000 mon.a (mon.0) 259 : cluster [DBG] osdmap e17: 2 total, 2 up, 2 in 2021-03-10T13:41:23.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:23 gibba015 bash[9806]: audit 2021-03-10T13:41:22.431281+0000 mon.a (mon.0) 260 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/devicehealth/last_scrape","val":"20210310-133923"}]: dispatch 2021-03-10T13:41:23.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:23 gibba015 bash[9806]: audit 2021-03-10T13:41:22.440260+0000 mon.a (mon.0) 261 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/devicehealth/last_scrape","val":"20210310-133923"}]': finished 2021-03-10T13:41:23.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:23 gibba015 bash[13005]: cluster 2021-03-10T13:41:22.139711+0000 mon.a (mon.0) 259 : cluster [DBG] osdmap e17: 2 total, 2 up, 2 in 2021-03-10T13:41:23.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:23 gibba015 bash[13005]: audit 2021-03-10T13:41:22.431281+0000 mon.a (mon.0) 260 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/devicehealth/last_scrape","val":"20210310-133923"}]: dispatch 2021-03-10T13:41:23.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:23 gibba015 bash[13005]: audit 2021-03-10T13:41:22.440260+0000 mon.a (mon.0) 261 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/devicehealth/last_scrape","val":"20210310-133923"}]': finished 2021-03-10T13:41:23.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:23 gibba045 bash[9787]: cluster 2021-03-10T13:41:22.139711+0000 mon.a (mon.0) 259 : cluster [DBG] osdmap e17: 2 total, 2 up, 2 in 2021-03-10T13:41:23.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:23 gibba045 bash[9787]: audit 2021-03-10T13:41:22.431281+0000 mon.a (mon.0) 260 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/devicehealth/last_scrape","val":"20210310-133923"}]: dispatch 2021-03-10T13:41:23.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:23 gibba045 bash[9787]: audit 2021-03-10T13:41:22.440260+0000 mon.a (mon.0) 261 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/devicehealth/last_scrape","val":"20210310-133923"}]': finished 2021-03-10T13:41:24.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:24 gibba015 bash[13005]: cluster 2021-03-10T13:41:23.097406+0000 mgr.y (mgr.14140) 74 : cluster [DBG] pgmap v65: 1 pgs: 1 undersized+peered; 0 B data, 264 KiB used, 166 GiB / 168 GiB avail 2021-03-10T13:41:24.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:24 gibba015 bash[13005]: audit 2021-03-10T13:41:24.336819+0000 mon.a (mon.0) 262 : audit [INF] from='client.? 172.21.2.115:0/1633485913' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3ae91563-2d31-48f5-aeed-1ba427cef365"}]: dispatch 2021-03-10T13:41:24.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:24 gibba015 bash[13005]: audit 2021-03-10T13:41:24.341447+0000 mon.a (mon.0) 263 : audit [INF] from='client.? 172.21.2.115:0/1633485913' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3ae91563-2d31-48f5-aeed-1ba427cef365"}]': finished 2021-03-10T13:41:24.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:24 gibba015 bash[13005]: cluster 2021-03-10T13:41:24.341494+0000 mon.a (mon.0) 264 : cluster [DBG] osdmap e18: 3 total, 2 up, 2 in 2021-03-10T13:41:24.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:24 gibba015 bash[13005]: audit 2021-03-10T13:41:24.341614+0000 mon.a (mon.0) 265 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T13:41:24.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:24 gibba015 bash[9806]: cluster 2021-03-10T13:41:23.097406+0000 mgr.y (mgr.14140) 74 : cluster [DBG] pgmap v65: 1 pgs: 1 undersized+peered; 0 B data, 264 KiB used, 166 GiB / 168 GiB avail 2021-03-10T13:41:24.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:24 gibba015 bash[9806]: audit 2021-03-10T13:41:24.336819+0000 mon.a (mon.0) 262 : audit [INF] from='client.? 172.21.2.115:0/1633485913' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3ae91563-2d31-48f5-aeed-1ba427cef365"}]: dispatch 2021-03-10T13:41:24.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:24 gibba015 bash[9806]: audit 2021-03-10T13:41:24.341447+0000 mon.a (mon.0) 263 : audit [INF] from='client.? 172.21.2.115:0/1633485913' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3ae91563-2d31-48f5-aeed-1ba427cef365"}]': finished 2021-03-10T13:41:24.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:24 gibba015 bash[9806]: cluster 2021-03-10T13:41:24.341494+0000 mon.a (mon.0) 264 : cluster [DBG] osdmap e18: 3 total, 2 up, 2 in 2021-03-10T13:41:24.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:24 gibba015 bash[9806]: audit 2021-03-10T13:41:24.341614+0000 mon.a (mon.0) 265 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T13:41:24.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:24 gibba045 bash[9787]: cluster 2021-03-10T13:41:23.097406+0000 mgr.y (mgr.14140) 74 : cluster [DBG] pgmap v65: 1 pgs: 1 undersized+peered; 0 B data, 264 KiB used, 166 GiB / 168 GiB avail 2021-03-10T13:41:24.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:24 gibba045 bash[9787]: audit 2021-03-10T13:41:24.336819+0000 mon.a (mon.0) 262 : audit [INF] from='client.? 172.21.2.115:0/1633485913' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3ae91563-2d31-48f5-aeed-1ba427cef365"}]: dispatch 2021-03-10T13:41:24.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:24 gibba045 bash[9787]: audit 2021-03-10T13:41:24.341447+0000 mon.a (mon.0) 263 : audit [INF] from='client.? 172.21.2.115:0/1633485913' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3ae91563-2d31-48f5-aeed-1ba427cef365"}]': finished 2021-03-10T13:41:24.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:24 gibba045 bash[9787]: cluster 2021-03-10T13:41:24.341494+0000 mon.a (mon.0) 264 : cluster [DBG] osdmap e18: 3 total, 2 up, 2 in 2021-03-10T13:41:24.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:24 gibba045 bash[9787]: audit 2021-03-10T13:41:24.341614+0000 mon.a (mon.0) 265 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T13:41:26.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:26 gibba015 bash[9806]: cluster 2021-03-10T13:41:25.097888+0000 mgr.y (mgr.14140) 75 : cluster [DBG] pgmap v67: 1 pgs: 1 undersized+peered; 0 B data, 296 KiB used, 166 GiB / 168 GiB avail 2021-03-10T13:41:26.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:26 gibba015 bash[9806]: audit 2021-03-10T13:41:26.379180+0000 mon.c (mon.1) 8 : audit [DBG] from='client.? 172.21.2.115:0/1409857808' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T13:41:26.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:26 gibba015 bash[13005]: cluster 2021-03-10T13:41:25.097888+0000 mgr.y (mgr.14140) 75 : cluster [DBG] pgmap v67: 1 pgs: 1 undersized+peered; 0 B data, 296 KiB used, 166 GiB / 168 GiB avail 2021-03-10T13:41:26.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:26 gibba015 bash[13005]: audit 2021-03-10T13:41:26.379180+0000 mon.c (mon.1) 8 : audit [DBG] from='client.? 172.21.2.115:0/1409857808' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T13:41:26.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:26 gibba045 bash[9787]: cluster 2021-03-10T13:41:25.097888+0000 mgr.y (mgr.14140) 75 : cluster [DBG] pgmap v67: 1 pgs: 1 undersized+peered; 0 B data, 296 KiB used, 166 GiB / 168 GiB avail 2021-03-10T13:41:26.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:26 gibba045 bash[9787]: audit 2021-03-10T13:41:26.379180+0000 mon.c (mon.1) 8 : audit [DBG] from='client.? 172.21.2.115:0/1409857808' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T13:41:28.448 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:28 gibba015 bash[9806]: cluster 2021-03-10T13:41:27.098480+0000 mgr.y (mgr.14140) 76 : cluster [DBG] pgmap v68: 1 pgs: 1 undersized+peered; 0 B data, 296 KiB used, 166 GiB / 168 GiB avail 2021-03-10T13:41:28.449 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:28 gibba015 bash[13005]: cluster 2021-03-10T13:41:27.098480+0000 mgr.y (mgr.14140) 76 : cluster [DBG] pgmap v68: 1 pgs: 1 undersized+peered; 0 B data, 296 KiB used, 166 GiB / 168 GiB avail 2021-03-10T13:41:28.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:28 gibba045 bash[9787]: cluster 2021-03-10T13:41:27.098480+0000 mgr.y (mgr.14140) 76 : cluster [DBG] pgmap v68: 1 pgs: 1 undersized+peered; 0 B data, 296 KiB used, 166 GiB / 168 GiB avail 2021-03-10T13:41:29.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:29 gibba015 bash[9806]: audit 2021-03-10T13:41:29.021513+0000 mon.a (mon.0) 266 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:41:29.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:29 gibba015 bash[13005]: audit 2021-03-10T13:41:29.021513+0000 mon.a (mon.0) 266 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:41:29.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:29 gibba045 bash[9787]: audit 2021-03-10T13:41:29.021513+0000 mon.a (mon.0) 266 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:41:30.180 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:30 gibba015 bash[9806]: cluster 2021-03-10T13:41:29.098782+0000 mgr.y (mgr.14140) 77 : cluster [DBG] pgmap v69: 1 pgs: 1 active+undersized+degraded; 0 B data, 312 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:41:30.180 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:30 gibba015 bash[9806]: cluster 2021-03-10T13:41:29.149208+0000 mon.a (mon.0) 267 : cluster [WRN] Health check failed: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2021-03-10T13:41:30.180 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:30 gibba015 bash[9806]: cluster 2021-03-10T13:41:29.149229+0000 mon.a (mon.0) 268 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2021-03-10T13:41:30.181 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:30 gibba015 bash[13005]: cluster 2021-03-10T13:41:29.098782+0000 mgr.y (mgr.14140) 77 : cluster [DBG] pgmap v69: 1 pgs: 1 active+undersized+degraded; 0 B data, 312 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:41:30.181 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:30 gibba015 bash[13005]: cluster 2021-03-10T13:41:29.149208+0000 mon.a (mon.0) 267 : cluster [WRN] Health check failed: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2021-03-10T13:41:30.181 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:30 gibba015 bash[13005]: cluster 2021-03-10T13:41:29.149229+0000 mon.a (mon.0) 268 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2021-03-10T13:41:30.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:30 gibba045 bash[9787]: cluster 2021-03-10T13:41:29.098782+0000 mgr.y (mgr.14140) 77 : cluster [DBG] pgmap v69: 1 pgs: 1 active+undersized+degraded; 0 B data, 312 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:41:30.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:30 gibba045 bash[9787]: cluster 2021-03-10T13:41:29.149208+0000 mon.a (mon.0) 267 : cluster [WRN] Health check failed: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2021-03-10T13:41:30.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:30 gibba045 bash[9787]: cluster 2021-03-10T13:41:29.149229+0000 mon.a (mon.0) 268 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2021-03-10T13:41:32.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:32 gibba015 bash[9806]: cluster 2021-03-10T13:41:31.099524+0000 mgr.y (mgr.14140) 78 : cluster [DBG] pgmap v70: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:41:32.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:32 gibba015 bash[13005]: cluster 2021-03-10T13:41:31.099524+0000 mgr.y (mgr.14140) 78 : cluster [DBG] pgmap v70: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:41:32.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:32 gibba045 bash[9787]: cluster 2021-03-10T13:41:31.099524+0000 mgr.y (mgr.14140) 78 : cluster [DBG] pgmap v70: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:41:33.412 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:33 gibba015 bash[9806]: audit 2021-03-10T13:41:32.425924+0000 mon.a (mon.0) 269 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2021-03-10T13:41:33.412 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:33 gibba015 bash[9806]: audit 2021-03-10T13:41:32.426888+0000 mon.a (mon.0) 270 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:41:33.413 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:33 gibba015 bash[9806]: cephadm 2021-03-10T13:41:32.427440+0000 mgr.y (mgr.14140) 79 : cephadm [INF] Deploying daemon osd.2 on gibba015 2021-03-10T13:41:33.413 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:33 gibba015 bash[9806]: audit 2021-03-10T13:41:32.427669+0000 mon.a (mon.0) 271 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.2", "key": "container_image"}]: dispatch 2021-03-10T13:41:33.413 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:33 gibba015 bash[13005]: audit 2021-03-10T13:41:32.425924+0000 mon.a (mon.0) 269 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2021-03-10T13:41:33.414 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:33 gibba015 bash[13005]: audit 2021-03-10T13:41:32.426888+0000 mon.a (mon.0) 270 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:41:33.414 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:33 gibba015 bash[13005]: cephadm 2021-03-10T13:41:32.427440+0000 mgr.y (mgr.14140) 79 : cephadm [INF] Deploying daemon osd.2 on gibba015 2021-03-10T13:41:33.414 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:33 gibba015 bash[13005]: audit 2021-03-10T13:41:32.427669+0000 mon.a (mon.0) 271 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.2", "key": "container_image"}]: dispatch 2021-03-10T13:41:33.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:33 gibba045 bash[9787]: audit 2021-03-10T13:41:32.425924+0000 mon.a (mon.0) 269 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2021-03-10T13:41:33.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:33 gibba045 bash[9787]: audit 2021-03-10T13:41:32.426888+0000 mon.a (mon.0) 270 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:41:33.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:33 gibba045 bash[9787]: cephadm 2021-03-10T13:41:32.427440+0000 mgr.y (mgr.14140) 79 : cephadm [INF] Deploying daemon osd.2 on gibba015 2021-03-10T13:41:33.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:33 gibba045 bash[9787]: audit 2021-03-10T13:41:32.427669+0000 mon.a (mon.0) 271 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.2", "key": "container_image"}]: dispatch 2021-03-10T13:41:34.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:34 gibba015 bash[9806]: cluster 2021-03-10T13:41:33.100246+0000 mgr.y (mgr.14140) 80 : cluster [DBG] pgmap v71: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:41:34.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:34 gibba015 bash[13005]: cluster 2021-03-10T13:41:33.100246+0000 mgr.y (mgr.14140) 80 : cluster [DBG] pgmap v71: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:41:34.261 INFO:teuthology.orchestra.run.gibba015.stdout:Created osd(s) 2 on host 'gibba015' 2021-03-10T13:41:34.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:34 gibba045 bash[9787]: cluster 2021-03-10T13:41:33.100246+0000 mgr.y (mgr.14140) 80 : cluster [DBG] pgmap v71: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:41:35.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:35 gibba015 bash[9806]: audit 2021-03-10T13:41:34.253145+0000 mon.a (mon.0) 272 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019283\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019428\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019514\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019592\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019669\", \"created\": \"2021-03-10T13:41:11.556448\"}, \"osd.2\": {\"hostname\": \"gibba015\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644\"}}, \"last_device_update\": \"2021-03-10T13:41:19.205323\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]: dispatch 2021-03-10T13:41:35.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:35 gibba015 bash[9806]: audit 2021-03-10T13:41:34.253626+0000 mon.a (mon.0) 273 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:41:35.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:35 gibba015 bash[13005]: audit 2021-03-10T13:41:34.253145+0000 mon.a (mon.0) 272 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019283\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019428\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019514\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019592\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019669\", \"created\": \"2021-03-10T13:41:11.556448\"}, \"osd.2\": {\"hostname\": \"gibba015\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644\"}}, \"last_device_update\": \"2021-03-10T13:41:19.205323\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]: dispatch 2021-03-10T13:41:35.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:35 gibba015 bash[13005]: audit 2021-03-10T13:41:34.253626+0000 mon.a (mon.0) 273 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:41:35.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:35 gibba015 bash[9806]: audit 2021-03-10T13:41:34.256947+0000 mon.a (mon.0) 274 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019283\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019428\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019514\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019592\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019669\", \"created\": \"2021-03-10T13:41:11.556448\"}, \"osd.2\": {\"hostname\": \"gibba015\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644\"}}, \"last_device_update\": \"2021-03-10T13:41:19.205323\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]': finished 2021-03-10T13:41:35.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:35 gibba015 bash[13005]: audit 2021-03-10T13:41:34.256947+0000 mon.a (mon.0) 274 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019283\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019428\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019514\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019592\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019669\", \"created\": \"2021-03-10T13:41:11.556448\"}, \"osd.2\": {\"hostname\": \"gibba015\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644\"}}, \"last_device_update\": \"2021-03-10T13:41:19.205323\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]': finished 2021-03-10T13:41:35.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:35 gibba015 bash[9806]: audit 2021-03-10T13:41:34.806623+0000 mon.a (mon.0) 275 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805835\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805893\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805922\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805949\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805974\", \"created\": \"2021-03-10T13:41:11.556448\", \"started\": \"2021-03-10T13:41:15.069232\"}, \"osd.2\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.806000\", \"created\": \"2021-03-10T13:41:34.244448\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644\"}}, \"last_daemon_update\": \"2021-03-10T13:41:34.806049\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]: dispatch 2021-03-10T13:41:35.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:35 gibba015 bash[9806]: audit 2021-03-10T13:41:34.810294+0000 mon.a (mon.0) 276 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805835\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805893\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805922\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805949\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805974\", \"created\": \"2021-03-10T13:41:11.556448\", \"started\": \"2021-03-10T13:41:15.069232\"}, \"osd.2\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.806000\", \"created\": \"2021-03-10T13:41:34.244448\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644\"}}, \"last_daemon_update\": \"2021-03-10T13:41:34.806049\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]': finished 2021-03-10T13:41:35.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:35 gibba015 bash[9806]: audit 2021-03-10T13:41:34.810742+0000 mon.a (mon.0) 277 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:41:35.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:35 gibba015 bash[13005]: audit 2021-03-10T13:41:34.806623+0000 mon.a (mon.0) 275 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805835\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805893\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805922\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805949\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805974\", \"created\": \"2021-03-10T13:41:11.556448\", \"started\": \"2021-03-10T13:41:15.069232\"}, \"osd.2\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.806000\", \"created\": \"2021-03-10T13:41:34.244448\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644\"}}, \"last_daemon_update\": \"2021-03-10T13:41:34.806049\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]: dispatch 2021-03-10T13:41:35.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:35 gibba015 bash[13005]: audit 2021-03-10T13:41:34.810294+0000 mon.a (mon.0) 276 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805835\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805893\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805922\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805949\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805974\", \"created\": \"2021-03-10T13:41:11.556448\", \"started\": \"2021-03-10T13:41:15.069232\"}, \"osd.2\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.806000\", \"created\": \"2021-03-10T13:41:34.244448\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644\"}}, \"last_daemon_update\": \"2021-03-10T13:41:34.806049\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]': finished 2021-03-10T13:41:35.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:35 gibba015 bash[13005]: audit 2021-03-10T13:41:34.810742+0000 mon.a (mon.0) 277 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:41:35.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:35 gibba045 bash[9787]: audit 2021-03-10T13:41:34.253145+0000 mon.a (mon.0) 272 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019283\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019428\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019514\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019592\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019669\", \"created\": \"2021-03-10T13:41:11.556448\"}, \"osd.2\": {\"hostname\": \"gibba015\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644\"}}, \"last_device_update\": \"2021-03-10T13:41:19.205323\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]: dispatch 2021-03-10T13:41:35.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:35 gibba045 bash[9787]: audit 2021-03-10T13:41:34.253626+0000 mon.a (mon.0) 273 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:41:35.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:35 gibba045 bash[9787]: audit 2021-03-10T13:41:34.256947+0000 mon.a (mon.0) 274 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019283\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019428\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019514\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019592\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:12.019669\", \"created\": \"2021-03-10T13:41:11.556448\"}, \"osd.2\": {\"hostname\": \"gibba015\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644\"}}, \"last_device_update\": \"2021-03-10T13:41:19.205323\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]': finished 2021-03-10T13:41:35.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:35 gibba045 bash[9787]: audit 2021-03-10T13:41:34.806623+0000 mon.a (mon.0) 275 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805835\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805893\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805922\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805949\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805974\", \"created\": \"2021-03-10T13:41:11.556448\", \"started\": \"2021-03-10T13:41:15.069232\"}, \"osd.2\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.806000\", \"created\": \"2021-03-10T13:41:34.244448\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644\"}}, \"last_daemon_update\": \"2021-03-10T13:41:34.806049\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]: dispatch 2021-03-10T13:41:35.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:35 gibba045 bash[9787]: audit 2021-03-10T13:41:34.810294+0000 mon.a (mon.0) 276 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805835\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805893\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805922\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805949\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805974\", \"created\": \"2021-03-10T13:41:11.556448\", \"started\": \"2021-03-10T13:41:15.069232\"}, \"osd.2\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.806000\", \"created\": \"2021-03-10T13:41:34.244448\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644\"}}, \"last_daemon_update\": \"2021-03-10T13:41:34.806049\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]': finished 2021-03-10T13:41:35.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:35 gibba045 bash[9787]: audit 2021-03-10T13:41:34.810742+0000 mon.a (mon.0) 277 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:41:35.626 DEBUG:teuthology.orchestra.run.gibba015:osd.2> sudo journalctl -f -n 0 -u ceph-e4a642d2-81a5-11eb-9080-001a4aab830c@osd.2.service 2021-03-10T13:41:35.628 INFO:tasks.cephadm:Deploying osd.3 on gibba015 with /dev/vg_nvme/lv_1... 2021-03-10T13:41:35.629 DEBUG:teuthology.orchestra.run.gibba015:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e4a642d2-81a5-11eb-9080-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2021-03-10T13:41:35.690 INFO:journalctl@ceph.osd.2.gibba015.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T13:41:36.789 INFO:journalctl@ceph.osd.2.gibba015.stdout:Mar 10 13:41:36 gibba015 bash[17487]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2021-03-10T13:41:36.790 INFO:journalctl@ceph.osd.2.gibba015.stdout:Mar 10 13:41:36 gibba015 bash[17487]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-2 --no-mon-config 2021-03-10T13:41:36.790 INFO:journalctl@ceph.osd.2.gibba015.stdout:Mar 10 13:41:36 gibba015 bash[17487]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2/block 2021-03-10T13:41:36.790 INFO:journalctl@ceph.osd.2.gibba015.stdout:Mar 10 13:41:36 gibba015 bash[17487]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-2/block 2021-03-10T13:41:36.790 INFO:journalctl@ceph.osd.2.gibba015.stdout:Mar 10 13:41:36 gibba015 bash[17487]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2021-03-10T13:41:36.790 INFO:journalctl@ceph.osd.2.gibba015.stdout:Mar 10 13:41:36 gibba015 bash[17487]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2021-03-10T13:41:36.791 INFO:journalctl@ceph.osd.2.gibba015.stdout:Mar 10 13:41:36 gibba015 bash[17487]: --> ceph-volume lvm activate successful for osd ID: 2 2021-03-10T13:41:37.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:36 gibba015 bash[9806]: cluster 2021-03-10T13:41:35.101262+0000 mgr.y (mgr.14140) 81 : cluster [DBG] pgmap v72: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:41:37.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:36 gibba015 bash[13005]: cluster 2021-03-10T13:41:35.101262+0000 mgr.y (mgr.14140) 81 : cluster [DBG] pgmap v72: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:41:37.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:36 gibba045 bash[9787]: cluster 2021-03-10T13:41:35.101262+0000 mgr.y (mgr.14140) 81 : cluster [DBG] pgmap v72: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:41:38.384 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:38 gibba015 bash[9806]: cluster 2021-03-10T13:41:37.101818+0000 mgr.y (mgr.14140) 82 : cluster [DBG] pgmap v73: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:41:38.384 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:38 gibba015 bash[13005]: cluster 2021-03-10T13:41:37.101818+0000 mgr.y (mgr.14140) 82 : cluster [DBG] pgmap v73: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:41:38.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:38 gibba045 bash[9787]: cluster 2021-03-10T13:41:37.101818+0000 mgr.y (mgr.14140) 82 : cluster [DBG] pgmap v73: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:41:40.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:40 gibba015 bash[9806]: cluster 2021-03-10T13:41:39.102301+0000 mgr.y (mgr.14140) 83 : cluster [DBG] pgmap v74: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:41:40.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:40 gibba015 bash[13005]: cluster 2021-03-10T13:41:39.102301+0000 mgr.y (mgr.14140) 83 : cluster [DBG] pgmap v74: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:41:40.472 INFO:journalctl@ceph.osd.2.gibba015.stdout:Mar 10 13:41:40 gibba015 bash[17829]: debug 2021-03-10T13:41:40.195+0000 7f44f9139ec0 -1 Falling back to public interface 2021-03-10T13:41:40.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:40 gibba045 bash[9787]: cluster 2021-03-10T13:41:39.102301+0000 mgr.y (mgr.14140) 83 : cluster [DBG] pgmap v74: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:41:40.584 INFO:teuthology.orchestra.run.gibba015.stderr:--> Zapping: /dev/vg_nvme/lv_1 2021-03-10T13:41:40.585 INFO:teuthology.orchestra.run.gibba015.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2021-03-10T13:41:40.585 INFO:teuthology.orchestra.run.gibba015.stderr: stderr: 10+0 records in 2021-03-10T13:41:40.585 INFO:teuthology.orchestra.run.gibba015.stderr:10+0 records out 2021-03-10T13:41:40.585 INFO:teuthology.orchestra.run.gibba015.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0117056 s, 896 MB/s 2021-03-10T13:41:40.586 INFO:teuthology.orchestra.run.gibba015.stderr:--> Zapping successful for: 2021-03-10T13:41:40.971 INFO:journalctl@ceph.osd.2.gibba015.stdout:Mar 10 13:41:40 gibba015 bash[17829]: debug 2021-03-10T13:41:40.863+0000 7f44f9139ec0 -1 osd.2 0 log_to_monitors {default=true} 2021-03-10T13:41:41.210 DEBUG:teuthology.orchestra.run.gibba015:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e4a642d2-81a5-11eb-9080-001a4aab830c -- ceph orch daemon add osd gibba015:vg_nvme/lv_1 2021-03-10T13:41:41.528 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:41 gibba015 bash[9806]: audit 2021-03-10T13:41:40.873927+0000 mon.c (mon.1) 9 : audit [INF] from='osd.2 [v2:172.21.2.115:6818/3628070800,v1:172.21.2.115:6819/3628070800]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-03-10T13:41:41.529 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:41 gibba015 bash[9806]: audit 2021-03-10T13:41:40.874637+0000 mon.a (mon.0) 278 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-03-10T13:41:41.529 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:41 gibba015 bash[13005]: audit 2021-03-10T13:41:40.873927+0000 mon.c (mon.1) 9 : audit [INF] from='osd.2 [v2:172.21.2.115:6818/3628070800,v1:172.21.2.115:6819/3628070800]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-03-10T13:41:41.529 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:41 gibba015 bash[13005]: audit 2021-03-10T13:41:40.874637+0000 mon.a (mon.0) 278 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-03-10T13:41:41.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:41 gibba045 bash[9787]: audit 2021-03-10T13:41:40.873927+0000 mon.c (mon.1) 9 : audit [INF] from='osd.2 [v2:172.21.2.115:6818/3628070800,v1:172.21.2.115:6819/3628070800]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-03-10T13:41:41.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:41 gibba045 bash[9787]: audit 2021-03-10T13:41:40.874637+0000 mon.a (mon.0) 278 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-03-10T13:41:42.462 INFO:journalctl@ceph.osd.2.gibba015.stdout:Mar 10 13:41:42 gibba015 bash[17829]: debug 2021-03-10T13:41:42.180+0000 7f44ddee6700 -1 osd.2 0 waiting for initial osdmap 2021-03-10T13:41:42.463 INFO:journalctl@ceph.osd.2.gibba015.stdout:Mar 10 13:41:42 gibba015 bash[17829]: debug 2021-03-10T13:41:42.184+0000 7f44e9102700 -1 osd.2 20 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T13:41:42.463 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:42 gibba015 bash[9806]: cluster 2021-03-10T13:41:41.102854+0000 mgr.y (mgr.14140) 84 : cluster [DBG] pgmap v75: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:41:42.464 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:42 gibba015 bash[9806]: audit 2021-03-10T13:41:41.180707+0000 mon.a (mon.0) 279 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2021-03-10T13:41:42.464 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:42 gibba015 bash[9806]: cluster 2021-03-10T13:41:41.180740+0000 mon.a (mon.0) 280 : cluster [DBG] osdmap e19: 3 total, 2 up, 2 in 2021-03-10T13:41:42.464 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:42 gibba015 bash[9806]: audit 2021-03-10T13:41:41.180914+0000 mon.a (mon.0) 281 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T13:41:42.464 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:42 gibba015 bash[9806]: audit 2021-03-10T13:41:41.181255+0000 mon.c (mon.1) 10 : audit [INF] from='osd.2 [v2:172.21.2.115:6818/3628070800,v1:172.21.2.115:6819/3628070800]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0820, "args": ["host=gibba015", "root=default"]}]: dispatch 2021-03-10T13:41:42.465 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:42 gibba015 bash[9806]: audit 2021-03-10T13:41:41.181611+0000 mon.a (mon.0) 282 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0820, "args": ["host=gibba015", "root=default"]}]: dispatch 2021-03-10T13:41:42.465 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:42 gibba015 bash[9806]: cluster 2021-03-10T13:41:41.826114+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T13:41:42.465 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:42 gibba015 bash[9806]: cluster 2021-03-10T13:41:41.826213+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T13:41:42.465 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:42 gibba015 bash[13005]: cluster 2021-03-10T13:41:41.102854+0000 mgr.y (mgr.14140) 84 : cluster [DBG] pgmap v75: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:41:42.466 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:42 gibba015 bash[13005]: audit 2021-03-10T13:41:41.180707+0000 mon.a (mon.0) 279 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2021-03-10T13:41:42.466 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:42 gibba015 bash[13005]: cluster 2021-03-10T13:41:41.180740+0000 mon.a (mon.0) 280 : cluster [DBG] osdmap e19: 3 total, 2 up, 2 in 2021-03-10T13:41:42.466 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:42 gibba015 bash[13005]: audit 2021-03-10T13:41:41.180914+0000 mon.a (mon.0) 281 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T13:41:42.466 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:42 gibba015 bash[13005]: audit 2021-03-10T13:41:41.181255+0000 mon.c (mon.1) 10 : audit [INF] from='osd.2 [v2:172.21.2.115:6818/3628070800,v1:172.21.2.115:6819/3628070800]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0820, "args": ["host=gibba015", "root=default"]}]: dispatch 2021-03-10T13:41:42.467 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:42 gibba015 bash[13005]: audit 2021-03-10T13:41:41.181611+0000 mon.a (mon.0) 282 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0820, "args": ["host=gibba015", "root=default"]}]: dispatch 2021-03-10T13:41:42.467 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:42 gibba015 bash[13005]: cluster 2021-03-10T13:41:41.826114+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T13:41:42.467 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:42 gibba015 bash[13005]: cluster 2021-03-10T13:41:41.826213+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T13:41:42.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:42 gibba045 bash[9787]: cluster 2021-03-10T13:41:41.102854+0000 mgr.y (mgr.14140) 84 : cluster [DBG] pgmap v75: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:41:42.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:42 gibba045 bash[9787]: audit 2021-03-10T13:41:41.180707+0000 mon.a (mon.0) 279 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2021-03-10T13:41:42.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:42 gibba045 bash[9787]: cluster 2021-03-10T13:41:41.180740+0000 mon.a (mon.0) 280 : cluster [DBG] osdmap e19: 3 total, 2 up, 2 in 2021-03-10T13:41:42.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:42 gibba045 bash[9787]: audit 2021-03-10T13:41:41.180914+0000 mon.a (mon.0) 281 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T13:41:42.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:42 gibba045 bash[9787]: audit 2021-03-10T13:41:41.181255+0000 mon.c (mon.1) 10 : audit [INF] from='osd.2 [v2:172.21.2.115:6818/3628070800,v1:172.21.2.115:6819/3628070800]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0820, "args": ["host=gibba015", "root=default"]}]: dispatch 2021-03-10T13:41:42.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:42 gibba045 bash[9787]: audit 2021-03-10T13:41:41.181611+0000 mon.a (mon.0) 282 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0820, "args": ["host=gibba015", "root=default"]}]: dispatch 2021-03-10T13:41:42.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:42 gibba045 bash[9787]: cluster 2021-03-10T13:41:41.826114+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T13:41:42.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:42 gibba045 bash[9787]: cluster 2021-03-10T13:41:41.826213+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T13:41:43.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:43 gibba015 bash[13005]: audit 2021-03-10T13:41:42.181314+0000 mon.a (mon.0) 283 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0820, "args": ["host=gibba015", "root=default"]}]': finished 2021-03-10T13:41:43.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:43 gibba015 bash[13005]: cluster 2021-03-10T13:41:42.181349+0000 mon.a (mon.0) 284 : cluster [DBG] osdmap e20: 3 total, 2 up, 2 in 2021-03-10T13:41:43.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:43 gibba015 bash[13005]: audit 2021-03-10T13:41:42.182058+0000 mon.a (mon.0) 285 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T13:41:43.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:43 gibba015 bash[13005]: audit 2021-03-10T13:41:42.191317+0000 mon.a (mon.0) 286 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:41:43.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:43 gibba015 bash[9806]: audit 2021-03-10T13:41:42.181314+0000 mon.a (mon.0) 283 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0820, "args": ["host=gibba015", "root=default"]}]': finished 2021-03-10T13:41:43.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:43 gibba015 bash[9806]: cluster 2021-03-10T13:41:42.181349+0000 mon.a (mon.0) 284 : cluster [DBG] osdmap e20: 3 total, 2 up, 2 in 2021-03-10T13:41:43.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:43 gibba015 bash[9806]: audit 2021-03-10T13:41:42.182058+0000 mon.a (mon.0) 285 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T13:41:43.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:43 gibba015 bash[9806]: audit 2021-03-10T13:41:42.191317+0000 mon.a (mon.0) 286 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:41:43.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:43 gibba015 bash[9806]: audit 2021-03-10T13:41:42.291446+0000 mon.a (mon.0) 287 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805835\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805893\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805922\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805949\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805974\", \"created\": \"2021-03-10T13:41:11.556448\", \"started\": \"2021-03-10T13:41:15.069232\"}, \"osd.2\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.806000\", \"created\": \"2021-03-10T13:41:34.244448\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644\"}}, \"last_daemon_update\": \"2021-03-10T13:41:34.806049\", \"last_device_update\": \"2021-03-10T13:41:42.290903\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]: dispatch 2021-03-10T13:41:43.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:43 gibba015 bash[9806]: audit 2021-03-10T13:41:42.295448+0000 mon.a (mon.0) 288 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805835\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805893\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805922\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805949\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805974\", \"created\": \"2021-03-10T13:41:11.556448\", \"started\": \"2021-03-10T13:41:15.069232\"}, \"osd.2\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.806000\", \"created\": \"2021-03-10T13:41:34.244448\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644\"}}, \"last_daemon_update\": \"2021-03-10T13:41:34.806049\", \"last_device_update\": \"2021-03-10T13:41:42.290903\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]': finished 2021-03-10T13:41:43.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:43 gibba015 bash[13005]: audit 2021-03-10T13:41:42.291446+0000 mon.a (mon.0) 287 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805835\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805893\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805922\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805949\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805974\", \"created\": \"2021-03-10T13:41:11.556448\", \"started\": \"2021-03-10T13:41:15.069232\"}, \"osd.2\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.806000\", \"created\": \"2021-03-10T13:41:34.244448\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644\"}}, \"last_daemon_update\": \"2021-03-10T13:41:34.806049\", \"last_device_update\": \"2021-03-10T13:41:42.290903\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]: dispatch 2021-03-10T13:41:43.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:43 gibba015 bash[13005]: audit 2021-03-10T13:41:42.295448+0000 mon.a (mon.0) 288 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805835\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805893\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805922\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805949\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805974\", \"created\": \"2021-03-10T13:41:11.556448\", \"started\": \"2021-03-10T13:41:15.069232\"}, \"osd.2\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.806000\", \"created\": \"2021-03-10T13:41:34.244448\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644\"}}, \"last_daemon_update\": \"2021-03-10T13:41:34.806049\", \"last_device_update\": \"2021-03-10T13:41:42.290903\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]': finished 2021-03-10T13:41:43.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:43 gibba045 bash[9787]: audit 2021-03-10T13:41:42.181314+0000 mon.a (mon.0) 283 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0820, "args": ["host=gibba015", "root=default"]}]': finished 2021-03-10T13:41:43.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:43 gibba045 bash[9787]: cluster 2021-03-10T13:41:42.181349+0000 mon.a (mon.0) 284 : cluster [DBG] osdmap e20: 3 total, 2 up, 2 in 2021-03-10T13:41:43.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:43 gibba045 bash[9787]: audit 2021-03-10T13:41:42.182058+0000 mon.a (mon.0) 285 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T13:41:43.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:43 gibba045 bash[9787]: audit 2021-03-10T13:41:42.191317+0000 mon.a (mon.0) 286 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:41:43.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:43 gibba045 bash[9787]: audit 2021-03-10T13:41:42.291446+0000 mon.a (mon.0) 287 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805835\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805893\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805922\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805949\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805974\", \"created\": \"2021-03-10T13:41:11.556448\", \"started\": \"2021-03-10T13:41:15.069232\"}, \"osd.2\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.806000\", \"created\": \"2021-03-10T13:41:34.244448\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644\"}}, \"last_daemon_update\": \"2021-03-10T13:41:34.806049\", \"last_device_update\": \"2021-03-10T13:41:42.290903\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]: dispatch 2021-03-10T13:41:43.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:43 gibba045 bash[9787]: audit 2021-03-10T13:41:42.295448+0000 mon.a (mon.0) 288 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805835\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805893\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805922\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805949\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805974\", \"created\": \"2021-03-10T13:41:11.556448\", \"started\": \"2021-03-10T13:41:15.069232\"}, \"osd.2\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.806000\", \"created\": \"2021-03-10T13:41:34.244448\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644\"}}, \"last_daemon_update\": \"2021-03-10T13:41:34.806049\", \"last_device_update\": \"2021-03-10T13:41:42.290903\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]': finished 2021-03-10T13:41:44.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:44 gibba015 bash[9806]: cluster 2021-03-10T13:41:43.103628+0000 mgr.y (mgr.14140) 85 : cluster [DBG] pgmap v78: 1 pgs: 1 active+undersized+degraded; 0 B data, 328 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:41:44.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:44 gibba015 bash[9806]: cluster 2021-03-10T13:41:43.188351+0000 mon.a (mon.0) 289 : cluster [INF] osd.2 [v2:172.21.2.115:6818/3628070800,v1:172.21.2.115:6819/3628070800] boot 2021-03-10T13:41:44.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:44 gibba015 bash[9806]: cluster 2021-03-10T13:41:43.188375+0000 mon.a (mon.0) 290 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2021-03-10T13:41:44.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:44 gibba015 bash[9806]: audit 2021-03-10T13:41:43.188785+0000 mon.a (mon.0) 291 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T13:41:44.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:44 gibba015 bash[9806]: audit 2021-03-10T13:41:44.185372+0000 mon.a (mon.0) 292 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T13:41:44.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:44 gibba015 bash[9806]: audit 2021-03-10T13:41:44.186201+0000 mon.a (mon.0) 293 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:41:44.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:44 gibba015 bash[9806]: audit 2021-03-10T13:41:44.187080+0000 mon.a (mon.0) 294 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:41:44.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:44 gibba015 bash[13005]: cluster 2021-03-10T13:41:43.103628+0000 mgr.y (mgr.14140) 85 : cluster [DBG] pgmap v78: 1 pgs: 1 active+undersized+degraded; 0 B data, 328 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:41:44.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:44 gibba015 bash[13005]: cluster 2021-03-10T13:41:43.188351+0000 mon.a (mon.0) 289 : cluster [INF] osd.2 [v2:172.21.2.115:6818/3628070800,v1:172.21.2.115:6819/3628070800] boot 2021-03-10T13:41:44.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:44 gibba015 bash[13005]: cluster 2021-03-10T13:41:43.188375+0000 mon.a (mon.0) 290 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2021-03-10T13:41:44.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:44 gibba015 bash[13005]: audit 2021-03-10T13:41:43.188785+0000 mon.a (mon.0) 291 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T13:41:44.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:44 gibba015 bash[13005]: audit 2021-03-10T13:41:44.185372+0000 mon.a (mon.0) 292 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T13:41:44.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:44 gibba015 bash[13005]: audit 2021-03-10T13:41:44.186201+0000 mon.a (mon.0) 293 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:41:44.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:44 gibba015 bash[13005]: audit 2021-03-10T13:41:44.187080+0000 mon.a (mon.0) 294 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:41:44.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:44 gibba045 bash[9787]: cluster 2021-03-10T13:41:43.103628+0000 mgr.y (mgr.14140) 85 : cluster [DBG] pgmap v78: 1 pgs: 1 active+undersized+degraded; 0 B data, 328 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:41:44.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:44 gibba045 bash[9787]: cluster 2021-03-10T13:41:43.188351+0000 mon.a (mon.0) 289 : cluster [INF] osd.2 [v2:172.21.2.115:6818/3628070800,v1:172.21.2.115:6819/3628070800] boot 2021-03-10T13:41:44.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:44 gibba045 bash[9787]: cluster 2021-03-10T13:41:43.188375+0000 mon.a (mon.0) 290 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2021-03-10T13:41:44.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:44 gibba045 bash[9787]: audit 2021-03-10T13:41:43.188785+0000 mon.a (mon.0) 291 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T13:41:44.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:44 gibba045 bash[9787]: audit 2021-03-10T13:41:44.185372+0000 mon.a (mon.0) 292 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T13:41:44.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:44 gibba045 bash[9787]: audit 2021-03-10T13:41:44.186201+0000 mon.a (mon.0) 293 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:41:44.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:44 gibba045 bash[9787]: audit 2021-03-10T13:41:44.187080+0000 mon.a (mon.0) 294 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:41:45.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:45 gibba015 bash[9806]: audit 2021-03-10T13:41:44.184650+0000 mgr.y (mgr.14140) 86 : audit [DBG] from='client.14271 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba015:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:41:45.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:45 gibba015 bash[9806]: cephadm 2021-03-10T13:41:44.185121+0000 mgr.y (mgr.14140) 87 : cephadm [INF] Applying osd on host gibba015... 2021-03-10T13:41:45.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:45 gibba015 bash[9806]: cluster 2021-03-10T13:41:44.302419+0000 mon.a (mon.0) 295 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2021-03-10T13:41:45.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:45 gibba015 bash[13005]: audit 2021-03-10T13:41:44.184650+0000 mgr.y (mgr.14140) 86 : audit [DBG] from='client.14271 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba015:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:41:45.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:45 gibba015 bash[13005]: cephadm 2021-03-10T13:41:44.185121+0000 mgr.y (mgr.14140) 87 : cephadm [INF] Applying osd on host gibba015... 2021-03-10T13:41:45.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:45 gibba015 bash[13005]: cluster 2021-03-10T13:41:44.302419+0000 mon.a (mon.0) 295 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2021-03-10T13:41:45.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:45 gibba045 bash[9787]: audit 2021-03-10T13:41:44.184650+0000 mgr.y (mgr.14140) 86 : audit [DBG] from='client.14271 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba015:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:41:45.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:45 gibba045 bash[9787]: cephadm 2021-03-10T13:41:44.185121+0000 mgr.y (mgr.14140) 87 : cephadm [INF] Applying osd on host gibba015... 2021-03-10T13:41:45.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:45 gibba045 bash[9787]: cluster 2021-03-10T13:41:44.302419+0000 mon.a (mon.0) 295 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2021-03-10T13:41:46.665 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:46 gibba015 bash[9806]: cluster 2021-03-10T13:41:45.104371+0000 mgr.y (mgr.14140) 88 : cluster [DBG] pgmap v81: 1 pgs: 1 active+undersized+degraded; 0 B data, 528 KiB used, 249 GiB / 252 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:41:46.665 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:46 gibba015 bash[9806]: cluster 2021-03-10T13:41:45.310511+0000 mon.a (mon.0) 296 : cluster [DBG] osdmap e23: 3 total, 3 up, 3 in 2021-03-10T13:41:46.665 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:46 gibba015 bash[13005]: cluster 2021-03-10T13:41:45.104371+0000 mgr.y (mgr.14140) 88 : cluster [DBG] pgmap v81: 1 pgs: 1 active+undersized+degraded; 0 B data, 528 KiB used, 249 GiB / 252 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:41:46.666 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:46 gibba015 bash[13005]: cluster 2021-03-10T13:41:45.310511+0000 mon.a (mon.0) 296 : cluster [DBG] osdmap e23: 3 total, 3 up, 3 in 2021-03-10T13:41:46.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:46 gibba045 bash[9787]: cluster 2021-03-10T13:41:45.104371+0000 mgr.y (mgr.14140) 88 : cluster [DBG] pgmap v81: 1 pgs: 1 active+undersized+degraded; 0 B data, 528 KiB used, 249 GiB / 252 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:41:46.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:46 gibba045 bash[9787]: cluster 2021-03-10T13:41:45.310511+0000 mon.a (mon.0) 296 : cluster [DBG] osdmap e23: 3 total, 3 up, 3 in 2021-03-10T13:41:48.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:48 gibba015 bash[9806]: cluster 2021-03-10T13:41:47.104724+0000 mgr.y (mgr.14140) 89 : cluster [DBG] pgmap v83: 1 pgs: 1 active+undersized+degraded; 0 B data, 528 KiB used, 249 GiB / 252 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:41:48.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:48 gibba015 bash[9806]: audit 2021-03-10T13:41:47.214235+0000 mon.a (mon.0) 297 : audit [INF] from='client.? 172.21.2.115:0/1860911003' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "de4bb3e1-0f94-479d-9771-be80408c9a32"}]: dispatch 2021-03-10T13:41:48.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:48 gibba015 bash[9806]: audit 2021-03-10T13:41:47.219380+0000 mon.a (mon.0) 298 : audit [INF] from='client.? 172.21.2.115:0/1860911003' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "de4bb3e1-0f94-479d-9771-be80408c9a32"}]': finished 2021-03-10T13:41:48.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:48 gibba015 bash[9806]: cluster 2021-03-10T13:41:47.219439+0000 mon.a (mon.0) 299 : cluster [DBG] osdmap e24: 4 total, 3 up, 3 in 2021-03-10T13:41:48.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:48 gibba015 bash[9806]: audit 2021-03-10T13:41:47.219568+0000 mon.a (mon.0) 300 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T13:41:48.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:48 gibba015 bash[13005]: cluster 2021-03-10T13:41:47.104724+0000 mgr.y (mgr.14140) 89 : cluster [DBG] pgmap v83: 1 pgs: 1 active+undersized+degraded; 0 B data, 528 KiB used, 249 GiB / 252 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:41:48.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:48 gibba015 bash[13005]: audit 2021-03-10T13:41:47.214235+0000 mon.a (mon.0) 297 : audit [INF] from='client.? 172.21.2.115:0/1860911003' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "de4bb3e1-0f94-479d-9771-be80408c9a32"}]: dispatch 2021-03-10T13:41:48.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:48 gibba015 bash[13005]: audit 2021-03-10T13:41:47.219380+0000 mon.a (mon.0) 298 : audit [INF] from='client.? 172.21.2.115:0/1860911003' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "de4bb3e1-0f94-479d-9771-be80408c9a32"}]': finished 2021-03-10T13:41:48.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:48 gibba015 bash[13005]: cluster 2021-03-10T13:41:47.219439+0000 mon.a (mon.0) 299 : cluster [DBG] osdmap e24: 4 total, 3 up, 3 in 2021-03-10T13:41:48.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:48 gibba015 bash[13005]: audit 2021-03-10T13:41:47.219568+0000 mon.a (mon.0) 300 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T13:41:48.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:48 gibba045 bash[9787]: cluster 2021-03-10T13:41:47.104724+0000 mgr.y (mgr.14140) 89 : cluster [DBG] pgmap v83: 1 pgs: 1 active+undersized+degraded; 0 B data, 528 KiB used, 249 GiB / 252 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:41:48.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:48 gibba045 bash[9787]: audit 2021-03-10T13:41:47.214235+0000 mon.a (mon.0) 297 : audit [INF] from='client.? 172.21.2.115:0/1860911003' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "de4bb3e1-0f94-479d-9771-be80408c9a32"}]: dispatch 2021-03-10T13:41:48.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:48 gibba045 bash[9787]: audit 2021-03-10T13:41:47.219380+0000 mon.a (mon.0) 298 : audit [INF] from='client.? 172.21.2.115:0/1860911003' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "de4bb3e1-0f94-479d-9771-be80408c9a32"}]': finished 2021-03-10T13:41:48.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:48 gibba045 bash[9787]: cluster 2021-03-10T13:41:47.219439+0000 mon.a (mon.0) 299 : cluster [DBG] osdmap e24: 4 total, 3 up, 3 in 2021-03-10T13:41:48.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:48 gibba045 bash[9787]: audit 2021-03-10T13:41:47.219568+0000 mon.a (mon.0) 300 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T13:41:49.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:49 gibba015 bash[9806]: cluster 2021-03-10T13:41:49.108245+0000 mon.a (mon.0) 301 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded) 2021-03-10T13:41:49.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:49 gibba015 bash[9806]: cluster 2021-03-10T13:41:49.108277+0000 mon.a (mon.0) 302 : cluster [INF] Cluster is now healthy 2021-03-10T13:41:49.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:49 gibba015 bash[13005]: cluster 2021-03-10T13:41:49.108245+0000 mon.a (mon.0) 301 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded) 2021-03-10T13:41:49.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:49 gibba015 bash[13005]: cluster 2021-03-10T13:41:49.108277+0000 mon.a (mon.0) 302 : cluster [INF] Cluster is now healthy 2021-03-10T13:41:49.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:49 gibba045 bash[9787]: cluster 2021-03-10T13:41:49.108245+0000 mon.a (mon.0) 301 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded) 2021-03-10T13:41:49.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:49 gibba045 bash[9787]: cluster 2021-03-10T13:41:49.108277+0000 mon.a (mon.0) 302 : cluster [INF] Cluster is now healthy 2021-03-10T13:41:50.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:50 gibba015 bash[9806]: cluster 2021-03-10T13:41:49.104955+0000 mgr.y (mgr.14140) 90 : cluster [DBG] pgmap v85: 1 pgs: 1 active+clean; 0 B data, 560 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:41:50.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:50 gibba015 bash[9806]: audit 2021-03-10T13:41:49.370395+0000 mon.a (mon.0) 303 : audit [DBG] from='client.? 172.21.2.115:0/3597181968' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T13:41:50.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:50 gibba015 bash[13005]: cluster 2021-03-10T13:41:49.104955+0000 mgr.y (mgr.14140) 90 : cluster [DBG] pgmap v85: 1 pgs: 1 active+clean; 0 B data, 560 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:41:50.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:50 gibba015 bash[13005]: audit 2021-03-10T13:41:49.370395+0000 mon.a (mon.0) 303 : audit [DBG] from='client.? 172.21.2.115:0/3597181968' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T13:41:50.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:50 gibba045 bash[9787]: cluster 2021-03-10T13:41:49.104955+0000 mgr.y (mgr.14140) 90 : cluster [DBG] pgmap v85: 1 pgs: 1 active+clean; 0 B data, 560 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:41:50.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:50 gibba045 bash[9787]: audit 2021-03-10T13:41:49.370395+0000 mon.a (mon.0) 303 : audit [DBG] from='client.? 172.21.2.115:0/3597181968' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T13:41:52.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:52 gibba015 bash[9806]: cluster 2021-03-10T13:41:51.105509+0000 mgr.y (mgr.14140) 91 : cluster [DBG] pgmap v86: 1 pgs: 1 active+clean; 0 B data, 616 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:41:52.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:52 gibba015 bash[9806]: audit 2021-03-10T13:41:51.986685+0000 mon.a (mon.0) 304 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:41:52.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:52 gibba015 bash[13005]: cluster 2021-03-10T13:41:51.105509+0000 mgr.y (mgr.14140) 91 : cluster [DBG] pgmap v86: 1 pgs: 1 active+clean; 0 B data, 616 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:41:52.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:52 gibba015 bash[13005]: audit 2021-03-10T13:41:51.986685+0000 mon.a (mon.0) 304 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:41:52.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:52 gibba045 bash[9787]: cluster 2021-03-10T13:41:51.105509+0000 mgr.y (mgr.14140) 91 : cluster [DBG] pgmap v86: 1 pgs: 1 active+clean; 0 B data, 616 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:41:52.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:52 gibba045 bash[9787]: audit 2021-03-10T13:41:51.986685+0000 mon.a (mon.0) 304 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:41:54.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:54 gibba015 bash[9806]: cluster 2021-03-10T13:41:53.106201+0000 mgr.y (mgr.14140) 92 : cluster [DBG] pgmap v87: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:41:54.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:54 gibba015 bash[13005]: cluster 2021-03-10T13:41:53.106201+0000 mgr.y (mgr.14140) 92 : cluster [DBG] pgmap v87: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:41:54.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:54 gibba045 bash[9787]: cluster 2021-03-10T13:41:53.106201+0000 mgr.y (mgr.14140) 92 : cluster [DBG] pgmap v87: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:41:56.445 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:56 gibba015 bash[9806]: cluster 2021-03-10T13:41:55.106753+0000 mgr.y (mgr.14140) 93 : cluster [DBG] pgmap v88: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:41:56.446 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:56 gibba015 bash[9806]: audit 2021-03-10T13:41:55.553198+0000 mon.a (mon.0) 305 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2021-03-10T13:41:56.446 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:56 gibba015 bash[9806]: audit 2021-03-10T13:41:55.554106+0000 mon.a (mon.0) 306 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:41:56.446 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:56 gibba015 bash[9806]: cephadm 2021-03-10T13:41:55.554894+0000 mgr.y (mgr.14140) 94 : cephadm [INF] Deploying daemon osd.3 on gibba015 2021-03-10T13:41:56.447 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:56 gibba015 bash[9806]: audit 2021-03-10T13:41:55.555129+0000 mon.a (mon.0) 307 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.3", "key": "container_image"}]: dispatch 2021-03-10T13:41:56.447 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:56 gibba015 bash[13005]: cluster 2021-03-10T13:41:55.106753+0000 mgr.y (mgr.14140) 93 : cluster [DBG] pgmap v88: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:41:56.447 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:56 gibba015 bash[13005]: audit 2021-03-10T13:41:55.553198+0000 mon.a (mon.0) 305 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2021-03-10T13:41:56.448 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:56 gibba015 bash[13005]: audit 2021-03-10T13:41:55.554106+0000 mon.a (mon.0) 306 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:41:56.448 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:56 gibba015 bash[13005]: cephadm 2021-03-10T13:41:55.554894+0000 mgr.y (mgr.14140) 94 : cephadm [INF] Deploying daemon osd.3 on gibba015 2021-03-10T13:41:56.448 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:56 gibba015 bash[13005]: audit 2021-03-10T13:41:55.555129+0000 mon.a (mon.0) 307 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.3", "key": "container_image"}]: dispatch 2021-03-10T13:41:56.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:56 gibba045 bash[9787]: cluster 2021-03-10T13:41:55.106753+0000 mgr.y (mgr.14140) 93 : cluster [DBG] pgmap v88: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:41:56.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:56 gibba045 bash[9787]: audit 2021-03-10T13:41:55.553198+0000 mon.a (mon.0) 305 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2021-03-10T13:41:56.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:56 gibba045 bash[9787]: audit 2021-03-10T13:41:55.554106+0000 mon.a (mon.0) 306 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:41:56.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:56 gibba045 bash[9787]: cephadm 2021-03-10T13:41:55.554894+0000 mgr.y (mgr.14140) 94 : cephadm [INF] Deploying daemon osd.3 on gibba015 2021-03-10T13:41:56.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:56 gibba045 bash[9787]: audit 2021-03-10T13:41:55.555129+0000 mon.a (mon.0) 307 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.3", "key": "container_image"}]: dispatch 2021-03-10T13:41:57.343 INFO:teuthology.orchestra.run.gibba015.stdout:Created osd(s) 3 on host 'gibba015' 2021-03-10T13:41:58.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:58 gibba015 bash[9806]: cluster 2021-03-10T13:41:57.106969+0000 mgr.y (mgr.14140) 95 : cluster [DBG] pgmap v89: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:41:58.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:58 gibba015 bash[13005]: cluster 2021-03-10T13:41:57.106969+0000 mgr.y (mgr.14140) 95 : cluster [DBG] pgmap v89: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:41:58.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:58 gibba015 bash[9806]: audit 2021-03-10T13:41:57.338876+0000 mon.a (mon.0) 308 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805835\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805893\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805922\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805949\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805974\", \"created\": \"2021-03-10T13:41:11.556448\", \"started\": \"2021-03-10T13:41:15.069232\"}, \"osd.2\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.806000\", \"created\": \"2021-03-10T13:41:34.244448\"}, \"osd.3\": {\"hostname\": \"gibba015\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867\"}}, \"last_device_update\": \"2021-03-10T13:41:42.290903\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]: dispatch 2021-03-10T13:41:58.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:58 gibba015 bash[9806]: audit 2021-03-10T13:41:57.339474+0000 mon.a (mon.0) 309 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:41:58.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:58 gibba015 bash[13005]: audit 2021-03-10T13:41:57.338876+0000 mon.a (mon.0) 308 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805835\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805893\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805922\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805949\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805974\", \"created\": \"2021-03-10T13:41:11.556448\", \"started\": \"2021-03-10T13:41:15.069232\"}, \"osd.2\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.806000\", \"created\": \"2021-03-10T13:41:34.244448\"}, \"osd.3\": {\"hostname\": \"gibba015\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867\"}}, \"last_device_update\": \"2021-03-10T13:41:42.290903\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]: dispatch 2021-03-10T13:41:58.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:58 gibba015 bash[13005]: audit 2021-03-10T13:41:57.339474+0000 mon.a (mon.0) 309 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:41:58.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:58 gibba015 bash[9806]: audit 2021-03-10T13:41:57.342868+0000 mon.a (mon.0) 310 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805835\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805893\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805922\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805949\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805974\", \"created\": \"2021-03-10T13:41:11.556448\", \"started\": \"2021-03-10T13:41:15.069232\"}, \"osd.2\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.806000\", \"created\": \"2021-03-10T13:41:34.244448\"}, \"osd.3\": {\"hostname\": \"gibba015\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867\"}}, \"last_device_update\": \"2021-03-10T13:41:42.290903\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]': finished 2021-03-10T13:41:58.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:58 gibba015 bash[13005]: audit 2021-03-10T13:41:57.342868+0000 mon.a (mon.0) 310 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805835\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805893\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805922\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805949\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805974\", \"created\": \"2021-03-10T13:41:11.556448\", \"started\": \"2021-03-10T13:41:15.069232\"}, \"osd.2\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.806000\", \"created\": \"2021-03-10T13:41:34.244448\"}, \"osd.3\": {\"hostname\": \"gibba015\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867\"}}, \"last_device_update\": \"2021-03-10T13:41:42.290903\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]': finished 2021-03-10T13:41:58.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:58 gibba015 bash[9806]: audit 2021-03-10T13:41:57.986479+0000 mon.a (mon.0) 311 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985622\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985680\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985710\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985736\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985762\", \"created\": \"2021-03-10T13:41:11.556448\", \"started\": \"2021-03-10T13:41:15.069232\"}, \"osd.2\": {\"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985788\", \"created\": \"2021-03-10T13:41:34.244448\", \"started\": \"2021-03-10T13:41:37.507096\"}, \"osd.3\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985813\", \"created\": \"2021-03-10T13:41:57.328380\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867\"}}, \"last_daemon_update\": \"2021-03-10T13:41:57.985863\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]: dispatch 2021-03-10T13:41:58.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:58 gibba015 bash[9806]: audit 2021-03-10T13:41:57.990671+0000 mon.a (mon.0) 312 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985622\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985680\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985710\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985736\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985762\", \"created\": \"2021-03-10T13:41:11.556448\", \"started\": \"2021-03-10T13:41:15.069232\"}, \"osd.2\": {\"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985788\", \"created\": \"2021-03-10T13:41:34.244448\", \"started\": \"2021-03-10T13:41:37.507096\"}, \"osd.3\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985813\", \"created\": \"2021-03-10T13:41:57.328380\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867\"}}, \"last_daemon_update\": \"2021-03-10T13:41:57.985863\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]': finished 2021-03-10T13:41:58.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:41:58 gibba015 bash[9806]: audit 2021-03-10T13:41:57.991192+0000 mon.a (mon.0) 313 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:41:58.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:58 gibba015 bash[13005]: audit 2021-03-10T13:41:57.986479+0000 mon.a (mon.0) 311 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985622\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985680\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985710\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985736\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985762\", \"created\": \"2021-03-10T13:41:11.556448\", \"started\": \"2021-03-10T13:41:15.069232\"}, \"osd.2\": {\"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985788\", \"created\": \"2021-03-10T13:41:34.244448\", \"started\": \"2021-03-10T13:41:37.507096\"}, \"osd.3\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985813\", \"created\": \"2021-03-10T13:41:57.328380\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867\"}}, \"last_daemon_update\": \"2021-03-10T13:41:57.985863\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]: dispatch 2021-03-10T13:41:58.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:58 gibba015 bash[13005]: audit 2021-03-10T13:41:57.990671+0000 mon.a (mon.0) 312 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985622\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985680\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985710\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985736\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985762\", \"created\": \"2021-03-10T13:41:11.556448\", \"started\": \"2021-03-10T13:41:15.069232\"}, \"osd.2\": {\"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985788\", \"created\": \"2021-03-10T13:41:34.244448\", \"started\": \"2021-03-10T13:41:37.507096\"}, \"osd.3\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985813\", \"created\": \"2021-03-10T13:41:57.328380\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867\"}}, \"last_daemon_update\": \"2021-03-10T13:41:57.985863\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]': finished 2021-03-10T13:41:58.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:41:58 gibba015 bash[13005]: audit 2021-03-10T13:41:57.991192+0000 mon.a (mon.0) 313 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:41:58.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:58 gibba045 bash[9787]: cluster 2021-03-10T13:41:57.106969+0000 mgr.y (mgr.14140) 95 : cluster [DBG] pgmap v89: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:41:58.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:58 gibba045 bash[9787]: audit 2021-03-10T13:41:57.338876+0000 mon.a (mon.0) 308 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805835\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805893\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805922\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805949\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805974\", \"created\": \"2021-03-10T13:41:11.556448\", \"started\": \"2021-03-10T13:41:15.069232\"}, \"osd.2\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.806000\", \"created\": \"2021-03-10T13:41:34.244448\"}, \"osd.3\": {\"hostname\": \"gibba015\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867\"}}, \"last_device_update\": \"2021-03-10T13:41:42.290903\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]: dispatch 2021-03-10T13:41:58.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:58 gibba045 bash[9787]: audit 2021-03-10T13:41:57.339474+0000 mon.a (mon.0) 309 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:41:58.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:58 gibba045 bash[9787]: audit 2021-03-10T13:41:57.342868+0000 mon.a (mon.0) 310 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805835\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805893\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805922\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805949\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.805974\", \"created\": \"2021-03-10T13:41:11.556448\", \"started\": \"2021-03-10T13:41:15.069232\"}, \"osd.2\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:34.806000\", \"created\": \"2021-03-10T13:41:34.244448\"}, \"osd.3\": {\"hostname\": \"gibba015\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867\"}}, \"last_device_update\": \"2021-03-10T13:41:42.290903\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]': finished 2021-03-10T13:41:58.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:58 gibba045 bash[9787]: audit 2021-03-10T13:41:57.986479+0000 mon.a (mon.0) 311 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985622\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985680\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985710\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985736\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985762\", \"created\": \"2021-03-10T13:41:11.556448\", \"started\": \"2021-03-10T13:41:15.069232\"}, \"osd.2\": {\"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985788\", \"created\": \"2021-03-10T13:41:34.244448\", \"started\": \"2021-03-10T13:41:37.507096\"}, \"osd.3\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985813\", \"created\": \"2021-03-10T13:41:57.328380\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867\"}}, \"last_daemon_update\": \"2021-03-10T13:41:57.985863\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]: dispatch 2021-03-10T13:41:58.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:58 gibba045 bash[9787]: audit 2021-03-10T13:41:57.990671+0000 mon.a (mon.0) 312 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985622\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985680\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985710\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985736\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985762\", \"created\": \"2021-03-10T13:41:11.556448\", \"started\": \"2021-03-10T13:41:15.069232\"}, \"osd.2\": {\"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985788\", \"created\": \"2021-03-10T13:41:34.244448\", \"started\": \"2021-03-10T13:41:37.507096\"}, \"osd.3\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985813\", \"created\": \"2021-03-10T13:41:57.328380\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867\"}}, \"last_daemon_update\": \"2021-03-10T13:41:57.985863\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]': finished 2021-03-10T13:41:58.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:41:58 gibba045 bash[9787]: audit 2021-03-10T13:41:57.991192+0000 mon.a (mon.0) 313 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:41:58.658 DEBUG:teuthology.orchestra.run.gibba015:osd.3> sudo journalctl -f -n 0 -u ceph-e4a642d2-81a5-11eb-9080-001a4aab830c@osd.3.service 2021-03-10T13:41:58.660 INFO:tasks.cephadm:Deploying osd.4 on gibba045 with /dev/vg_nvme/lv_4... 2021-03-10T13:41:58.660 DEBUG:teuthology.orchestra.run.gibba045:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e4a642d2-81a5-11eb-9080-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2021-03-10T13:41:58.720 INFO:journalctl@ceph.osd.3.gibba015.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T13:41:59.720 INFO:journalctl@ceph.osd.3.gibba015.stdout:Mar 10 13:41:59 gibba015 bash[18946]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2021-03-10T13:41:59.721 INFO:journalctl@ceph.osd.3.gibba015.stdout:Mar 10 13:41:59 gibba015 bash[18946]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_1 --path /var/lib/ceph/osd/ceph-3 --no-mon-config 2021-03-10T13:41:59.721 INFO:journalctl@ceph.osd.3.gibba015.stdout:Mar 10 13:41:59 gibba015 bash[18946]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3/block 2021-03-10T13:41:59.721 INFO:journalctl@ceph.osd.3.gibba015.stdout:Mar 10 13:41:59 gibba015 bash[18946]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-3/block 2021-03-10T13:41:59.721 INFO:journalctl@ceph.osd.3.gibba015.stdout:Mar 10 13:41:59 gibba015 bash[18946]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2021-03-10T13:41:59.721 INFO:journalctl@ceph.osd.3.gibba015.stdout:Mar 10 13:41:59 gibba015 bash[18946]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2021-03-10T13:41:59.722 INFO:journalctl@ceph.osd.3.gibba015.stdout:Mar 10 13:41:59 gibba015 bash[18946]: --> ceph-volume lvm activate successful for osd ID: 3 2021-03-10T13:42:00.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:00 gibba015 bash[9806]: cluster 2021-03-10T13:41:59.107767+0000 mgr.y (mgr.14140) 96 : cluster [DBG] pgmap v90: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 249 GiB / 252 GiB avail 2021-03-10T13:42:00.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:00 gibba015 bash[13005]: cluster 2021-03-10T13:41:59.107767+0000 mgr.y (mgr.14140) 96 : cluster [DBG] pgmap v90: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 249 GiB / 252 GiB avail 2021-03-10T13:42:00.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:00 gibba045 bash[9787]: cluster 2021-03-10T13:41:59.107767+0000 mgr.y (mgr.14140) 96 : cluster [DBG] pgmap v90: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 249 GiB / 252 GiB avail 2021-03-10T13:42:01.464 INFO:teuthology.orchestra.run.gibba045.stderr:--> Zapping: /dev/vg_nvme/lv_4 2021-03-10T13:42:01.464 INFO:teuthology.orchestra.run.gibba045.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2021-03-10T13:42:01.464 INFO:teuthology.orchestra.run.gibba045.stderr: stderr: 10+0 records in 2021-03-10T13:42:01.465 INFO:teuthology.orchestra.run.gibba045.stderr:10+0 records out 2021-03-10T13:42:01.465 INFO:teuthology.orchestra.run.gibba045.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0111384 s, 941 MB/s 2021-03-10T13:42:01.465 INFO:teuthology.orchestra.run.gibba045.stderr:--> Zapping successful for: 2021-03-10T13:42:02.091 DEBUG:teuthology.orchestra.run.gibba045:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e4a642d2-81a5-11eb-9080-001a4aab830c -- ceph orch daemon add osd gibba045:vg_nvme/lv_4 2021-03-10T13:42:02.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:02 gibba015 bash[9806]: cluster 2021-03-10T13:42:01.108404+0000 mgr.y (mgr.14140) 97 : cluster [DBG] pgmap v91: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 249 GiB / 252 GiB avail 2021-03-10T13:42:02.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:02 gibba015 bash[13005]: cluster 2021-03-10T13:42:01.108404+0000 mgr.y (mgr.14140) 97 : cluster [DBG] pgmap v91: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 249 GiB / 252 GiB avail 2021-03-10T13:42:02.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:02 gibba045 bash[9787]: cluster 2021-03-10T13:42:01.108404+0000 mgr.y (mgr.14140) 97 : cluster [DBG] pgmap v91: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 249 GiB / 252 GiB avail 2021-03-10T13:42:02.970 INFO:journalctl@ceph.osd.3.gibba015.stdout:Mar 10 13:42:02 gibba015 bash[19305]: debug 2021-03-10T13:42:02.496+0000 7eff822efec0 -1 Falling back to public interface 2021-03-10T13:42:03.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:03 gibba015 bash[9806]: audit 2021-03-10T13:42:03.150765+0000 mon.a (mon.0) 314 : audit [INF] from='osd.3 [v2:172.21.2.115:6826/1478911402,v1:172.21.2.115:6827/1478911402]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-03-10T13:42:03.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:03 gibba015 bash[13005]: audit 2021-03-10T13:42:03.150765+0000 mon.a (mon.0) 314 : audit [INF] from='osd.3 [v2:172.21.2.115:6826/1478911402,v1:172.21.2.115:6827/1478911402]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-03-10T13:42:03.471 INFO:journalctl@ceph.osd.3.gibba015.stdout:Mar 10 13:42:03 gibba015 bash[19305]: debug 2021-03-10T13:42:03.144+0000 7eff822efec0 -1 osd.3 0 log_to_monitors {default=true} 2021-03-10T13:42:03.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:03 gibba045 bash[9787]: audit 2021-03-10T13:42:03.150765+0000 mon.a (mon.0) 314 : audit [INF] from='osd.3 [v2:172.21.2.115:6826/1478911402,v1:172.21.2.115:6827/1478911402]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-03-10T13:42:04.470 INFO:journalctl@ceph.osd.3.gibba015.stdout:Mar 10 13:42:04 gibba015 bash[19305]: debug 2021-03-10T13:42:04.196+0000 7eff6709c700 -1 osd.3 0 waiting for initial osdmap 2021-03-10T13:42:04.471 INFO:journalctl@ceph.osd.3.gibba015.stdout:Mar 10 13:42:04 gibba015 bash[19305]: debug 2021-03-10T13:42:04.200+0000 7eff722b8700 -1 osd.3 26 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T13:42:04.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:04 gibba015 bash[9806]: cluster 2021-03-10T13:42:03.108789+0000 mgr.y (mgr.14140) 98 : cluster [DBG] pgmap v92: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 249 GiB / 252 GiB avail 2021-03-10T13:42:04.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:04 gibba015 bash[9806]: audit 2021-03-10T13:42:03.187964+0000 mon.a (mon.0) 315 : audit [INF] from='osd.3 [v2:172.21.2.115:6826/1478911402,v1:172.21.2.115:6827/1478911402]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2021-03-10T13:42:04.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:04 gibba015 bash[9806]: cluster 2021-03-10T13:42:03.188012+0000 mon.a (mon.0) 316 : cluster [DBG] osdmap e25: 4 total, 3 up, 3 in 2021-03-10T13:42:04.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:04 gibba015 bash[9806]: audit 2021-03-10T13:42:03.188190+0000 mon.a (mon.0) 317 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T13:42:04.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:04 gibba015 bash[9806]: audit 2021-03-10T13:42:03.188517+0000 mon.a (mon.0) 318 : audit [INF] from='osd.3 [v2:172.21.2.115:6826/1478911402,v1:172.21.2.115:6827/1478911402]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0820, "args": ["host=gibba015", "root=default"]}]: dispatch 2021-03-10T13:42:04.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:04 gibba015 bash[9806]: audit 2021-03-10T13:42:03.757735+0000 mon.a (mon.0) 319 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:42:04.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:04 gibba015 bash[13005]: cluster 2021-03-10T13:42:03.108789+0000 mgr.y (mgr.14140) 98 : cluster [DBG] pgmap v92: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 249 GiB / 252 GiB avail 2021-03-10T13:42:04.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:04 gibba015 bash[13005]: audit 2021-03-10T13:42:03.187964+0000 mon.a (mon.0) 315 : audit [INF] from='osd.3 [v2:172.21.2.115:6826/1478911402,v1:172.21.2.115:6827/1478911402]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2021-03-10T13:42:04.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:04 gibba015 bash[13005]: cluster 2021-03-10T13:42:03.188012+0000 mon.a (mon.0) 316 : cluster [DBG] osdmap e25: 4 total, 3 up, 3 in 2021-03-10T13:42:04.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:04 gibba015 bash[13005]: audit 2021-03-10T13:42:03.188190+0000 mon.a (mon.0) 317 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T13:42:04.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:04 gibba015 bash[13005]: audit 2021-03-10T13:42:03.188517+0000 mon.a (mon.0) 318 : audit [INF] from='osd.3 [v2:172.21.2.115:6826/1478911402,v1:172.21.2.115:6827/1478911402]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0820, "args": ["host=gibba015", "root=default"]}]: dispatch 2021-03-10T13:42:04.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:04 gibba015 bash[13005]: audit 2021-03-10T13:42:03.757735+0000 mon.a (mon.0) 319 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:42:04.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:04 gibba015 bash[9806]: audit 2021-03-10T13:42:03.853686+0000 mon.a (mon.0) 320 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985622\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985680\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985710\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985736\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985762\", \"created\": \"2021-03-10T13:41:11.556448\", \"started\": \"2021-03-10T13:41:15.069232\"}, \"osd.2\": {\"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985788\", \"created\": \"2021-03-10T13:41:34.244448\", \"started\": \"2021-03-10T13:41:37.507096\"}, \"osd.3\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985813\", \"created\": \"2021-03-10T13:41:57.328380\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867\"}}, \"last_daemon_update\": \"2021-03-10T13:41:57.985863\", \"last_device_update\": \"2021-03-10T13:42:03.853072\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]: dispatch 2021-03-10T13:42:04.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:04 gibba015 bash[9806]: audit 2021-03-10T13:42:03.857567+0000 mon.a (mon.0) 321 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985622\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985680\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985710\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985736\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985762\", \"created\": \"2021-03-10T13:41:11.556448\", \"started\": \"2021-03-10T13:41:15.069232\"}, \"osd.2\": {\"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985788\", \"created\": \"2021-03-10T13:41:34.244448\", \"started\": \"2021-03-10T13:41:37.507096\"}, \"osd.3\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985813\", \"created\": \"2021-03-10T13:41:57.328380\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867\"}}, \"last_daemon_update\": \"2021-03-10T13:41:57.985863\", \"last_device_update\": \"2021-03-10T13:42:03.853072\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]': finished 2021-03-10T13:42:04.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:04 gibba015 bash[13005]: audit 2021-03-10T13:42:03.853686+0000 mon.a (mon.0) 320 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985622\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985680\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985710\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985736\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985762\", \"created\": \"2021-03-10T13:41:11.556448\", \"started\": \"2021-03-10T13:41:15.069232\"}, \"osd.2\": {\"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985788\", \"created\": \"2021-03-10T13:41:34.244448\", \"started\": \"2021-03-10T13:41:37.507096\"}, \"osd.3\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985813\", \"created\": \"2021-03-10T13:41:57.328380\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867\"}}, \"last_daemon_update\": \"2021-03-10T13:41:57.985863\", \"last_device_update\": \"2021-03-10T13:42:03.853072\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]: dispatch 2021-03-10T13:42:04.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:04 gibba015 bash[13005]: audit 2021-03-10T13:42:03.857567+0000 mon.a (mon.0) 321 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985622\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985680\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985710\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985736\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985762\", \"created\": \"2021-03-10T13:41:11.556448\", \"started\": \"2021-03-10T13:41:15.069232\"}, \"osd.2\": {\"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985788\", \"created\": \"2021-03-10T13:41:34.244448\", \"started\": \"2021-03-10T13:41:37.507096\"}, \"osd.3\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985813\", \"created\": \"2021-03-10T13:41:57.328380\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867\"}}, \"last_daemon_update\": \"2021-03-10T13:41:57.985863\", \"last_device_update\": \"2021-03-10T13:42:03.853072\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]': finished 2021-03-10T13:42:04.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:04 gibba045 bash[9787]: cluster 2021-03-10T13:42:03.108789+0000 mgr.y (mgr.14140) 98 : cluster [DBG] pgmap v92: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 249 GiB / 252 GiB avail 2021-03-10T13:42:04.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:04 gibba045 bash[9787]: audit 2021-03-10T13:42:03.187964+0000 mon.a (mon.0) 315 : audit [INF] from='osd.3 [v2:172.21.2.115:6826/1478911402,v1:172.21.2.115:6827/1478911402]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2021-03-10T13:42:04.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:04 gibba045 bash[9787]: cluster 2021-03-10T13:42:03.188012+0000 mon.a (mon.0) 316 : cluster [DBG] osdmap e25: 4 total, 3 up, 3 in 2021-03-10T13:42:04.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:04 gibba045 bash[9787]: audit 2021-03-10T13:42:03.188190+0000 mon.a (mon.0) 317 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T13:42:04.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:04 gibba045 bash[9787]: audit 2021-03-10T13:42:03.188517+0000 mon.a (mon.0) 318 : audit [INF] from='osd.3 [v2:172.21.2.115:6826/1478911402,v1:172.21.2.115:6827/1478911402]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0820, "args": ["host=gibba015", "root=default"]}]: dispatch 2021-03-10T13:42:04.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:04 gibba045 bash[9787]: audit 2021-03-10T13:42:03.757735+0000 mon.a (mon.0) 319 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:42:04.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:04 gibba045 bash[9787]: audit 2021-03-10T13:42:03.853686+0000 mon.a (mon.0) 320 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985622\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985680\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985710\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985736\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985762\", \"created\": \"2021-03-10T13:41:11.556448\", \"started\": \"2021-03-10T13:41:15.069232\"}, \"osd.2\": {\"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985788\", \"created\": \"2021-03-10T13:41:34.244448\", \"started\": \"2021-03-10T13:41:37.507096\"}, \"osd.3\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985813\", \"created\": \"2021-03-10T13:41:57.328380\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867\"}}, \"last_daemon_update\": \"2021-03-10T13:41:57.985863\", \"last_device_update\": \"2021-03-10T13:42:03.853072\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]: dispatch 2021-03-10T13:42:04.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:04 gibba045 bash[9787]: audit 2021-03-10T13:42:03.857567+0000 mon.a (mon.0) 321 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985622\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985680\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985710\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985736\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985762\", \"created\": \"2021-03-10T13:41:11.556448\", \"started\": \"2021-03-10T13:41:15.069232\"}, \"osd.2\": {\"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985788\", \"created\": \"2021-03-10T13:41:34.244448\", \"started\": \"2021-03-10T13:41:37.507096\"}, \"osd.3\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985813\", \"created\": \"2021-03-10T13:41:57.328380\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867\"}}, \"last_daemon_update\": \"2021-03-10T13:41:57.985863\", \"last_device_update\": \"2021-03-10T13:42:03.853072\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]': finished 2021-03-10T13:42:05.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:05 gibba015 bash[9806]: cluster 2021-03-10T13:42:04.186108+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T13:42:05.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:05 gibba015 bash[9806]: cluster 2021-03-10T13:42:04.186210+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T13:42:05.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:05 gibba015 bash[9806]: audit 2021-03-10T13:42:04.196349+0000 mon.a (mon.0) 322 : audit [INF] from='osd.3 [v2:172.21.2.115:6826/1478911402,v1:172.21.2.115:6827/1478911402]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0820, "args": ["host=gibba015", "root=default"]}]': finished 2021-03-10T13:42:05.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:05 gibba015 bash[9806]: cluster 2021-03-10T13:42:04.196477+0000 mon.a (mon.0) 323 : cluster [DBG] osdmap e26: 4 total, 3 up, 3 in 2021-03-10T13:42:05.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:05 gibba015 bash[9806]: audit 2021-03-10T13:42:04.197070+0000 mon.a (mon.0) 324 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T13:42:05.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:05 gibba015 bash[9806]: audit 2021-03-10T13:42:04.619327+0000 mgr.y (mgr.14140) 99 : audit [DBG] from='client.34127 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba045:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:42:05.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:05 gibba015 bash[9806]: cephadm 2021-03-10T13:42:04.621852+0000 mgr.y (mgr.14140) 100 : cephadm [INF] Applying osd on host gibba045... 2021-03-10T13:42:05.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:05 gibba015 bash[9806]: audit 2021-03-10T13:42:04.622634+0000 mon.a (mon.0) 325 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T13:42:05.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:05 gibba015 bash[9806]: audit 2021-03-10T13:42:04.625463+0000 mon.a (mon.0) 326 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:42:05.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:05 gibba015 bash[9806]: audit 2021-03-10T13:42:04.629372+0000 mon.a (mon.0) 327 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:42:05.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:05 gibba015 bash[13005]: cluster 2021-03-10T13:42:04.186108+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T13:42:05.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:05 gibba015 bash[13005]: cluster 2021-03-10T13:42:04.186210+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T13:42:05.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:05 gibba015 bash[13005]: audit 2021-03-10T13:42:04.196349+0000 mon.a (mon.0) 322 : audit [INF] from='osd.3 [v2:172.21.2.115:6826/1478911402,v1:172.21.2.115:6827/1478911402]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0820, "args": ["host=gibba015", "root=default"]}]': finished 2021-03-10T13:42:05.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:05 gibba015 bash[13005]: cluster 2021-03-10T13:42:04.196477+0000 mon.a (mon.0) 323 : cluster [DBG] osdmap e26: 4 total, 3 up, 3 in 2021-03-10T13:42:05.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:05 gibba015 bash[13005]: audit 2021-03-10T13:42:04.197070+0000 mon.a (mon.0) 324 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T13:42:05.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:05 gibba015 bash[13005]: audit 2021-03-10T13:42:04.619327+0000 mgr.y (mgr.14140) 99 : audit [DBG] from='client.34127 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba045:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:42:05.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:05 gibba015 bash[13005]: cephadm 2021-03-10T13:42:04.621852+0000 mgr.y (mgr.14140) 100 : cephadm [INF] Applying osd on host gibba045... 2021-03-10T13:42:05.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:05 gibba015 bash[13005]: audit 2021-03-10T13:42:04.622634+0000 mon.a (mon.0) 325 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T13:42:05.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:05 gibba015 bash[13005]: audit 2021-03-10T13:42:04.625463+0000 mon.a (mon.0) 326 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:42:05.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:05 gibba015 bash[13005]: audit 2021-03-10T13:42:04.629372+0000 mon.a (mon.0) 327 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:42:05.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:05 gibba045 bash[9787]: cluster 2021-03-10T13:42:04.186108+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T13:42:05.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:05 gibba045 bash[9787]: cluster 2021-03-10T13:42:04.186210+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T13:42:05.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:05 gibba045 bash[9787]: audit 2021-03-10T13:42:04.196349+0000 mon.a (mon.0) 322 : audit [INF] from='osd.3 [v2:172.21.2.115:6826/1478911402,v1:172.21.2.115:6827/1478911402]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0820, "args": ["host=gibba015", "root=default"]}]': finished 2021-03-10T13:42:05.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:05 gibba045 bash[9787]: cluster 2021-03-10T13:42:04.196477+0000 mon.a (mon.0) 323 : cluster [DBG] osdmap e26: 4 total, 3 up, 3 in 2021-03-10T13:42:05.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:05 gibba045 bash[9787]: audit 2021-03-10T13:42:04.197070+0000 mon.a (mon.0) 324 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T13:42:05.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:05 gibba045 bash[9787]: audit 2021-03-10T13:42:04.619327+0000 mgr.y (mgr.14140) 99 : audit [DBG] from='client.34127 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba045:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:42:05.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:05 gibba045 bash[9787]: cephadm 2021-03-10T13:42:04.621852+0000 mgr.y (mgr.14140) 100 : cephadm [INF] Applying osd on host gibba045... 2021-03-10T13:42:05.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:05 gibba045 bash[9787]: audit 2021-03-10T13:42:04.622634+0000 mon.a (mon.0) 325 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T13:42:05.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:05 gibba045 bash[9787]: audit 2021-03-10T13:42:04.625463+0000 mon.a (mon.0) 326 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:42:05.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:05 gibba045 bash[9787]: audit 2021-03-10T13:42:04.629372+0000 mon.a (mon.0) 327 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:42:06.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:06 gibba045 bash[9787]: cluster 2021-03-10T13:42:05.109527+0000 mgr.y (mgr.14140) 101 : cluster [DBG] pgmap v95: 1 pgs: 1 active+clean; 0 B data, 632 KiB used, 249 GiB / 252 GiB avail 2021-03-10T13:42:06.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:06 gibba045 bash[9787]: cluster 2021-03-10T13:42:05.211179+0000 mon.a (mon.0) 328 : cluster [INF] osd.3 [v2:172.21.2.115:6826/1478911402,v1:172.21.2.115:6827/1478911402] boot 2021-03-10T13:42:06.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:06 gibba045 bash[9787]: cluster 2021-03-10T13:42:05.211217+0000 mon.a (mon.0) 329 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2021-03-10T13:42:06.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:06 gibba045 bash[9787]: audit 2021-03-10T13:42:05.212011+0000 mon.a (mon.0) 330 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T13:42:06.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:06 gibba015 bash[9806]: cluster 2021-03-10T13:42:05.109527+0000 mgr.y (mgr.14140) 101 : cluster [DBG] pgmap v95: 1 pgs: 1 active+clean; 0 B data, 632 KiB used, 249 GiB / 252 GiB avail 2021-03-10T13:42:06.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:06 gibba015 bash[9806]: cluster 2021-03-10T13:42:05.211179+0000 mon.a (mon.0) 328 : cluster [INF] osd.3 [v2:172.21.2.115:6826/1478911402,v1:172.21.2.115:6827/1478911402] boot 2021-03-10T13:42:06.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:06 gibba015 bash[9806]: cluster 2021-03-10T13:42:05.211217+0000 mon.a (mon.0) 329 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2021-03-10T13:42:06.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:06 gibba015 bash[9806]: audit 2021-03-10T13:42:05.212011+0000 mon.a (mon.0) 330 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T13:42:06.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:06 gibba015 bash[13005]: cluster 2021-03-10T13:42:05.109527+0000 mgr.y (mgr.14140) 101 : cluster [DBG] pgmap v95: 1 pgs: 1 active+clean; 0 B data, 632 KiB used, 249 GiB / 252 GiB avail 2021-03-10T13:42:06.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:06 gibba015 bash[13005]: cluster 2021-03-10T13:42:05.211179+0000 mon.a (mon.0) 328 : cluster [INF] osd.3 [v2:172.21.2.115:6826/1478911402,v1:172.21.2.115:6827/1478911402] boot 2021-03-10T13:42:06.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:06 gibba015 bash[13005]: cluster 2021-03-10T13:42:05.211217+0000 mon.a (mon.0) 329 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2021-03-10T13:42:06.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:06 gibba015 bash[13005]: audit 2021-03-10T13:42:05.212011+0000 mon.a (mon.0) 330 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T13:42:07.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:07 gibba045 bash[9787]: cluster 2021-03-10T13:42:06.230020+0000 mon.a (mon.0) 331 : cluster [DBG] osdmap e28: 4 total, 4 up, 4 in 2021-03-10T13:42:07.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:07 gibba015 bash[9806]: cluster 2021-03-10T13:42:06.230020+0000 mon.a (mon.0) 331 : cluster [DBG] osdmap e28: 4 total, 4 up, 4 in 2021-03-10T13:42:07.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:07 gibba015 bash[13005]: cluster 2021-03-10T13:42:06.230020+0000 mon.a (mon.0) 331 : cluster [DBG] osdmap e28: 4 total, 4 up, 4 in 2021-03-10T13:42:08.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:08 gibba045 bash[9787]: cluster 2021-03-10T13:42:07.109833+0000 mgr.y (mgr.14140) 102 : cluster [DBG] pgmap v98: 1 pgs: 1 active+clean; 0 B data, 864 KiB used, 332 GiB / 336 GiB avail 2021-03-10T13:42:08.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:08 gibba045 bash[9787]: audit 2021-03-10T13:42:07.625501+0000 mon.b (mon.2) 6 : audit [INF] from='client.? 172.21.2.145:0/3468728870' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f"}]: dispatch 2021-03-10T13:42:08.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:08 gibba045 bash[9787]: audit 2021-03-10T13:42:07.628736+0000 mon.a (mon.0) 332 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f"}]: dispatch 2021-03-10T13:42:08.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:08 gibba045 bash[9787]: audit 2021-03-10T13:42:07.640155+0000 mon.a (mon.0) 333 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f"}]': finished 2021-03-10T13:42:08.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:08 gibba045 bash[9787]: cluster 2021-03-10T13:42:07.640207+0000 mon.a (mon.0) 334 : cluster [DBG] osdmap e29: 5 total, 4 up, 4 in 2021-03-10T13:42:08.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:08 gibba045 bash[9787]: audit 2021-03-10T13:42:07.640394+0000 mon.a (mon.0) 335 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T13:42:08.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:08 gibba015 bash[13005]: cluster 2021-03-10T13:42:07.109833+0000 mgr.y (mgr.14140) 102 : cluster [DBG] pgmap v98: 1 pgs: 1 active+clean; 0 B data, 864 KiB used, 332 GiB / 336 GiB avail 2021-03-10T13:42:08.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:08 gibba015 bash[13005]: audit 2021-03-10T13:42:07.625501+0000 mon.b (mon.2) 6 : audit [INF] from='client.? 172.21.2.145:0/3468728870' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f"}]: dispatch 2021-03-10T13:42:08.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:08 gibba015 bash[13005]: audit 2021-03-10T13:42:07.628736+0000 mon.a (mon.0) 332 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f"}]: dispatch 2021-03-10T13:42:08.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:08 gibba015 bash[13005]: audit 2021-03-10T13:42:07.640155+0000 mon.a (mon.0) 333 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f"}]': finished 2021-03-10T13:42:08.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:08 gibba015 bash[13005]: cluster 2021-03-10T13:42:07.640207+0000 mon.a (mon.0) 334 : cluster [DBG] osdmap e29: 5 total, 4 up, 4 in 2021-03-10T13:42:08.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:08 gibba015 bash[13005]: audit 2021-03-10T13:42:07.640394+0000 mon.a (mon.0) 335 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T13:42:08.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:08 gibba015 bash[9806]: cluster 2021-03-10T13:42:07.109833+0000 mgr.y (mgr.14140) 102 : cluster [DBG] pgmap v98: 1 pgs: 1 active+clean; 0 B data, 864 KiB used, 332 GiB / 336 GiB avail 2021-03-10T13:42:08.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:08 gibba015 bash[9806]: audit 2021-03-10T13:42:07.625501+0000 mon.b (mon.2) 6 : audit [INF] from='client.? 172.21.2.145:0/3468728870' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f"}]: dispatch 2021-03-10T13:42:08.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:08 gibba015 bash[9806]: audit 2021-03-10T13:42:07.628736+0000 mon.a (mon.0) 332 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f"}]: dispatch 2021-03-10T13:42:08.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:08 gibba015 bash[9806]: audit 2021-03-10T13:42:07.640155+0000 mon.a (mon.0) 333 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f"}]': finished 2021-03-10T13:42:08.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:08 gibba015 bash[9806]: cluster 2021-03-10T13:42:07.640207+0000 mon.a (mon.0) 334 : cluster [DBG] osdmap e29: 5 total, 4 up, 4 in 2021-03-10T13:42:08.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:08 gibba015 bash[9806]: audit 2021-03-10T13:42:07.640394+0000 mon.a (mon.0) 335 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T13:42:10.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:10 gibba045 bash[9787]: cluster 2021-03-10T13:42:09.110581+0000 mgr.y (mgr.14140) 103 : cluster [DBG] pgmap v100: 1 pgs: 1 active+clean; 0 B data, 896 KiB used, 332 GiB / 336 GiB avail 2021-03-10T13:42:10.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:10 gibba045 bash[9787]: audit 2021-03-10T13:42:09.606025+0000 mon.b (mon.2) 7 : audit [DBG] from='client.? 172.21.2.145:0/566174853' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T13:42:10.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:10 gibba015 bash[9806]: cluster 2021-03-10T13:42:09.110581+0000 mgr.y (mgr.14140) 103 : cluster [DBG] pgmap v100: 1 pgs: 1 active+clean; 0 B data, 896 KiB used, 332 GiB / 336 GiB avail 2021-03-10T13:42:10.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:10 gibba015 bash[9806]: audit 2021-03-10T13:42:09.606025+0000 mon.b (mon.2) 7 : audit [DBG] from='client.? 172.21.2.145:0/566174853' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T13:42:10.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:10 gibba015 bash[13005]: cluster 2021-03-10T13:42:09.110581+0000 mgr.y (mgr.14140) 103 : cluster [DBG] pgmap v100: 1 pgs: 1 active+clean; 0 B data, 896 KiB used, 332 GiB / 336 GiB avail 2021-03-10T13:42:10.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:10 gibba015 bash[13005]: audit 2021-03-10T13:42:09.606025+0000 mon.b (mon.2) 7 : audit [DBG] from='client.? 172.21.2.145:0/566174853' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T13:42:12.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:12 gibba045 bash[9787]: cluster 2021-03-10T13:42:11.111466+0000 mgr.y (mgr.14140) 104 : cluster [DBG] pgmap v101: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 332 GiB / 336 GiB avail 2021-03-10T13:42:12.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:12 gibba045 bash[9787]: audit 2021-03-10T13:42:12.208324+0000 mon.a (mon.0) 336 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:42:12.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:12 gibba015 bash[9806]: cluster 2021-03-10T13:42:11.111466+0000 mgr.y (mgr.14140) 104 : cluster [DBG] pgmap v101: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 332 GiB / 336 GiB avail 2021-03-10T13:42:12.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:12 gibba015 bash[9806]: audit 2021-03-10T13:42:12.208324+0000 mon.a (mon.0) 336 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:42:12.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:12 gibba015 bash[13005]: cluster 2021-03-10T13:42:11.111466+0000 mgr.y (mgr.14140) 104 : cluster [DBG] pgmap v101: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 332 GiB / 336 GiB avail 2021-03-10T13:42:12.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:12 gibba015 bash[13005]: audit 2021-03-10T13:42:12.208324+0000 mon.a (mon.0) 336 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:42:14.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:14 gibba045 bash[9787]: cluster 2021-03-10T13:42:13.112283+0000 mgr.y (mgr.14140) 105 : cluster [DBG] pgmap v102: 1 pgs: 1 active+clean; 0 B data, 984 KiB used, 332 GiB / 336 GiB avail 2021-03-10T13:42:14.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:14 gibba015 bash[9806]: cluster 2021-03-10T13:42:13.112283+0000 mgr.y (mgr.14140) 105 : cluster [DBG] pgmap v102: 1 pgs: 1 active+clean; 0 B data, 984 KiB used, 332 GiB / 336 GiB avail 2021-03-10T13:42:14.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:14 gibba015 bash[13005]: cluster 2021-03-10T13:42:13.112283+0000 mgr.y (mgr.14140) 105 : cluster [DBG] pgmap v102: 1 pgs: 1 active+clean; 0 B data, 984 KiB used, 332 GiB / 336 GiB avail 2021-03-10T13:42:16.422 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:16 gibba045 bash[9787]: cluster 2021-03-10T13:42:15.113267+0000 mgr.y (mgr.14140) 106 : cluster [DBG] pgmap v103: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 332 GiB / 336 GiB avail 2021-03-10T13:42:16.423 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:16 gibba045 bash[9787]: audit 2021-03-10T13:42:15.332219+0000 mon.a (mon.0) 337 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2021-03-10T13:42:16.423 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:16 gibba045 bash[9787]: audit 2021-03-10T13:42:15.333963+0000 mon.a (mon.0) 338 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:42:16.423 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:16 gibba045 bash[9787]: cephadm 2021-03-10T13:42:15.335337+0000 mgr.y (mgr.14140) 107 : cephadm [INF] Deploying daemon osd.4 on gibba045 2021-03-10T13:42:16.423 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:16 gibba045 bash[9787]: audit 2021-03-10T13:42:15.335944+0000 mon.a (mon.0) 339 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.4", "key": "container_image"}]: dispatch 2021-03-10T13:42:16.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:16 gibba015 bash[9806]: cluster 2021-03-10T13:42:15.113267+0000 mgr.y (mgr.14140) 106 : cluster [DBG] pgmap v103: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 332 GiB / 336 GiB avail 2021-03-10T13:42:16.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:16 gibba015 bash[9806]: audit 2021-03-10T13:42:15.332219+0000 mon.a (mon.0) 337 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2021-03-10T13:42:16.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:16 gibba015 bash[9806]: audit 2021-03-10T13:42:15.333963+0000 mon.a (mon.0) 338 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:42:16.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:16 gibba015 bash[9806]: cephadm 2021-03-10T13:42:15.335337+0000 mgr.y (mgr.14140) 107 : cephadm [INF] Deploying daemon osd.4 on gibba045 2021-03-10T13:42:16.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:16 gibba015 bash[9806]: audit 2021-03-10T13:42:15.335944+0000 mon.a (mon.0) 339 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.4", "key": "container_image"}]: dispatch 2021-03-10T13:42:16.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:16 gibba015 bash[13005]: cluster 2021-03-10T13:42:15.113267+0000 mgr.y (mgr.14140) 106 : cluster [DBG] pgmap v103: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 332 GiB / 336 GiB avail 2021-03-10T13:42:16.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:16 gibba015 bash[13005]: audit 2021-03-10T13:42:15.332219+0000 mon.a (mon.0) 337 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2021-03-10T13:42:16.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:16 gibba015 bash[13005]: audit 2021-03-10T13:42:15.333963+0000 mon.a (mon.0) 338 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:42:16.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:16 gibba015 bash[13005]: cephadm 2021-03-10T13:42:15.335337+0000 mgr.y (mgr.14140) 107 : cephadm [INF] Deploying daemon osd.4 on gibba045 2021-03-10T13:42:16.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:16 gibba015 bash[13005]: audit 2021-03-10T13:42:15.335944+0000 mon.a (mon.0) 339 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.4", "key": "container_image"}]: dispatch 2021-03-10T13:42:17.106 INFO:teuthology.orchestra.run.gibba045.stdout:Created osd(s) 4 on host 'gibba045' 2021-03-10T13:42:17.420 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:17 gibba045 bash[9787]: audit 2021-03-10T13:42:17.095069+0000 mon.a (mon.0) 340 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:38.109242\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:38.109509\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:38.109675\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}}, \"last_device_update\": \"2021-03-10T13:39:54.262468\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:42:17.420 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:17 gibba045 bash[9787]: audit 2021-03-10T13:42:17.096470+0000 mon.a (mon.0) 341 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:42:17.420 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:17 gibba045 bash[9787]: audit 2021-03-10T13:42:17.104883+0000 mon.a (mon.0) 342 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:38.109242\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:38.109509\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:38.109675\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}}, \"last_device_update\": \"2021-03-10T13:39:54.262468\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:42:17.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:17 gibba015 bash[9806]: audit 2021-03-10T13:42:17.095069+0000 mon.a (mon.0) 340 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:38.109242\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:38.109509\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:38.109675\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}}, \"last_device_update\": \"2021-03-10T13:39:54.262468\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:42:17.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:17 gibba015 bash[9806]: audit 2021-03-10T13:42:17.096470+0000 mon.a (mon.0) 341 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:42:17.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:17 gibba015 bash[9806]: audit 2021-03-10T13:42:17.104883+0000 mon.a (mon.0) 342 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:38.109242\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:38.109509\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:38.109675\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}}, \"last_device_update\": \"2021-03-10T13:39:54.262468\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:42:17.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:17 gibba015 bash[13005]: audit 2021-03-10T13:42:17.095069+0000 mon.a (mon.0) 340 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:38.109242\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:38.109509\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:38.109675\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}}, \"last_device_update\": \"2021-03-10T13:39:54.262468\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:42:17.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:17 gibba015 bash[13005]: audit 2021-03-10T13:42:17.096470+0000 mon.a (mon.0) 341 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:42:17.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:17 gibba015 bash[13005]: audit 2021-03-10T13:42:17.104883+0000 mon.a (mon.0) 342 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:38.109242\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:38.109509\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:40:38.109675\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}}, \"last_device_update\": \"2021-03-10T13:39:54.262468\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:42:18.176 DEBUG:teuthology.orchestra.run.gibba045:osd.4> sudo journalctl -f -n 0 -u ceph-e4a642d2-81a5-11eb-9080-001a4aab830c@osd.4.service 2021-03-10T13:42:18.178 INFO:tasks.cephadm:Deploying osd.5 on gibba045 with /dev/vg_nvme/lv_3... 2021-03-10T13:42:18.178 DEBUG:teuthology.orchestra.run.gibba045:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e4a642d2-81a5-11eb-9080-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2021-03-10T13:42:18.254 INFO:journalctl@ceph.osd.4.gibba045.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T13:42:18.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:18 gibba045 bash[9787]: cluster 2021-03-10T13:42:17.113587+0000 mgr.y (mgr.14140) 108 : cluster [DBG] pgmap v104: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 332 GiB / 336 GiB avail 2021-03-10T13:42:18.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:18 gibba045 bash[9787]: audit 2021-03-10T13:42:17.482090+0000 mon.a (mon.0) 343 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.479174\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.479453\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.479623\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.479780\", \"created\": \"2021-03-10T13:42:17.077564\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}}, \"last_daemon_update\": \"2021-03-10T13:42:17.480044\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:42:18.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:18 gibba045 bash[9787]: audit 2021-03-10T13:42:17.490639+0000 mon.a (mon.0) 344 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.479174\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.479453\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.479623\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.479780\", \"created\": \"2021-03-10T13:42:17.077564\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}}, \"last_daemon_update\": \"2021-03-10T13:42:17.480044\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:42:18.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:18 gibba045 bash[9787]: audit 2021-03-10T13:42:17.492408+0000 mon.a (mon.0) 345 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:42:18.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:18 gibba015 bash[9806]: cluster 2021-03-10T13:42:17.113587+0000 mgr.y (mgr.14140) 108 : cluster [DBG] pgmap v104: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 332 GiB / 336 GiB avail 2021-03-10T13:42:18.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:18 gibba015 bash[13005]: cluster 2021-03-10T13:42:17.113587+0000 mgr.y (mgr.14140) 108 : cluster [DBG] pgmap v104: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 332 GiB / 336 GiB avail 2021-03-10T13:42:18.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:18 gibba015 bash[9806]: audit 2021-03-10T13:42:17.482090+0000 mon.a (mon.0) 343 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.479174\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.479453\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.479623\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.479780\", \"created\": \"2021-03-10T13:42:17.077564\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}}, \"last_daemon_update\": \"2021-03-10T13:42:17.480044\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:42:18.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:18 gibba015 bash[9806]: audit 2021-03-10T13:42:17.490639+0000 mon.a (mon.0) 344 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.479174\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.479453\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.479623\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.479780\", \"created\": \"2021-03-10T13:42:17.077564\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}}, \"last_daemon_update\": \"2021-03-10T13:42:17.480044\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:42:18.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:18 gibba015 bash[9806]: audit 2021-03-10T13:42:17.492408+0000 mon.a (mon.0) 345 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:42:18.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:18 gibba015 bash[13005]: audit 2021-03-10T13:42:17.482090+0000 mon.a (mon.0) 343 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.479174\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.479453\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.479623\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.479780\", \"created\": \"2021-03-10T13:42:17.077564\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}}, \"last_daemon_update\": \"2021-03-10T13:42:17.480044\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:42:18.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:18 gibba015 bash[13005]: audit 2021-03-10T13:42:17.490639+0000 mon.a (mon.0) 344 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.479174\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.479453\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.479623\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.479780\", \"created\": \"2021-03-10T13:42:17.077564\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}}, \"last_daemon_update\": \"2021-03-10T13:42:17.480044\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:42:18.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:18 gibba015 bash[13005]: audit 2021-03-10T13:42:17.492408+0000 mon.a (mon.0) 345 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:42:19.558 INFO:journalctl@ceph.osd.4.gibba045.stdout:Mar 10 13:42:19 gibba045 bash[11926]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2021-03-10T13:42:19.559 INFO:journalctl@ceph.osd.4.gibba045.stdout:Mar 10 13:42:19 gibba045 bash[11926]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-4 --no-mon-config 2021-03-10T13:42:19.559 INFO:journalctl@ceph.osd.4.gibba045.stdout:Mar 10 13:42:19 gibba045 bash[11926]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-4/block 2021-03-10T13:42:19.559 INFO:journalctl@ceph.osd.4.gibba045.stdout:Mar 10 13:42:19 gibba045 bash[11926]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-4/block 2021-03-10T13:42:19.560 INFO:journalctl@ceph.osd.4.gibba045.stdout:Mar 10 13:42:19 gibba045 bash[11926]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2021-03-10T13:42:19.560 INFO:journalctl@ceph.osd.4.gibba045.stdout:Mar 10 13:42:19 gibba045 bash[11926]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2021-03-10T13:42:19.560 INFO:journalctl@ceph.osd.4.gibba045.stdout:Mar 10 13:42:19 gibba045 bash[11926]: --> ceph-volume lvm activate successful for osd ID: 4 2021-03-10T13:42:20.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:20 gibba045 bash[9787]: cluster 2021-03-10T13:42:19.114260+0000 mgr.y (mgr.14140) 109 : cluster [DBG] pgmap v105: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 332 GiB / 336 GiB avail 2021-03-10T13:42:20.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:20 gibba015 bash[9806]: cluster 2021-03-10T13:42:19.114260+0000 mgr.y (mgr.14140) 109 : cluster [DBG] pgmap v105: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 332 GiB / 336 GiB avail 2021-03-10T13:42:20.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:20 gibba015 bash[13005]: cluster 2021-03-10T13:42:19.114260+0000 mgr.y (mgr.14140) 109 : cluster [DBG] pgmap v105: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 332 GiB / 336 GiB avail 2021-03-10T13:42:22.478 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:22 gibba045 bash[9787]: cluster 2021-03-10T13:42:21.115131+0000 mgr.y (mgr.14140) 110 : cluster [DBG] pgmap v106: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 332 GiB / 336 GiB avail 2021-03-10T13:42:22.478 INFO:journalctl@ceph.osd.4.gibba045.stdout:Mar 10 13:42:22 gibba045 bash[12292]: debug 2021-03-10T13:42:22.261+0000 7fd5c2eb9ec0 1 -- 172.21.2.145:0/3492762822 >> [v2:172.21.2.145:3300/0,v1:172.21.2.145:6789/0] conn(0x5633a7c4ac00 msgr2=0x5633a7c47680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-10T13:42:22.478 INFO:journalctl@ceph.osd.4.gibba045.stdout:Mar 10 13:42:22 gibba045 bash[12292]: debug 2021-03-10T13:42:22.261+0000 7fd5c2eb9ec0 1 --2- 172.21.2.145:0/3492762822 >> [v2:172.21.2.145:3300/0,v1:172.21.2.145:6789/0] conn(0x5633a7c4ac00 0x5633a7c47680 secure :-1 s=READY pgs=18 cs=0 l=1 rx=0x5633a7be1d10 tx=0x5633a88b6aa0).stop 2021-03-10T13:42:22.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:22 gibba015 bash[9806]: cluster 2021-03-10T13:42:21.115131+0000 mgr.y (mgr.14140) 110 : cluster [DBG] pgmap v106: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 332 GiB / 336 GiB avail 2021-03-10T13:42:22.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:22 gibba015 bash[13005]: cluster 2021-03-10T13:42:21.115131+0000 mgr.y (mgr.14140) 110 : cluster [DBG] pgmap v106: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 332 GiB / 336 GiB avail 2021-03-10T13:42:22.924 INFO:teuthology.orchestra.run.gibba045.stderr:--> Zapping: /dev/vg_nvme/lv_3 2021-03-10T13:42:22.924 INFO:teuthology.orchestra.run.gibba045.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2021-03-10T13:42:22.924 INFO:teuthology.orchestra.run.gibba045.stderr: stderr: 10+0 records in 2021-03-10T13:42:22.925 INFO:teuthology.orchestra.run.gibba045.stderr:10+0 records out 2021-03-10T13:42:22.925 INFO:teuthology.orchestra.run.gibba045.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0108242 s, 969 MB/s 2021-03-10T13:42:22.925 INFO:teuthology.orchestra.run.gibba045.stderr:--> Zapping successful for: 2021-03-10T13:42:23.188 INFO:journalctl@ceph.osd.4.gibba045.stdout:Mar 10 13:42:22 gibba045 bash[12292]: debug 2021-03-10T13:42:22.905+0000 7fd5c2eb9ec0 -1 Falling back to public interface 2021-03-10T13:42:23.572 DEBUG:teuthology.orchestra.run.gibba045:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e4a642d2-81a5-11eb-9080-001a4aab830c -- ceph orch daemon add osd gibba045:vg_nvme/lv_3 2021-03-10T13:42:23.891 INFO:journalctl@ceph.osd.4.gibba045.stdout:Mar 10 13:42:23 gibba045 bash[12292]: debug 2021-03-10T13:42:23.537+0000 7fd5c2eb9ec0 -1 osd.4 0 log_to_monitors {default=true} 2021-03-10T13:42:24.662 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:24 gibba045 bash[9787]: cluster 2021-03-10T13:42:23.115914+0000 mgr.y (mgr.14140) 111 : cluster [DBG] pgmap v107: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 332 GiB / 336 GiB avail 2021-03-10T13:42:24.663 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:24 gibba045 bash[9787]: audit 2021-03-10T13:42:23.550035+0000 mon.b (mon.2) 8 : audit [INF] from='osd.4 [v2:172.21.2.145:6800/860882436,v1:172.21.2.145:6801/860882436]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-03-10T13:42:24.663 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:24 gibba045 bash[9787]: audit 2021-03-10T13:42:23.552939+0000 mon.a (mon.0) 346 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-03-10T13:42:24.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:24 gibba015 bash[9806]: cluster 2021-03-10T13:42:23.115914+0000 mgr.y (mgr.14140) 111 : cluster [DBG] pgmap v107: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 332 GiB / 336 GiB avail 2021-03-10T13:42:24.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:24 gibba015 bash[9806]: audit 2021-03-10T13:42:23.550035+0000 mon.b (mon.2) 8 : audit [INF] from='osd.4 [v2:172.21.2.145:6800/860882436,v1:172.21.2.145:6801/860882436]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-03-10T13:42:24.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:24 gibba015 bash[9806]: audit 2021-03-10T13:42:23.552939+0000 mon.a (mon.0) 346 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-03-10T13:42:24.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:24 gibba015 bash[13005]: cluster 2021-03-10T13:42:23.115914+0000 mgr.y (mgr.14140) 111 : cluster [DBG] pgmap v107: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 332 GiB / 336 GiB avail 2021-03-10T13:42:24.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:24 gibba015 bash[13005]: audit 2021-03-10T13:42:23.550035+0000 mon.b (mon.2) 8 : audit [INF] from='osd.4 [v2:172.21.2.145:6800/860882436,v1:172.21.2.145:6801/860882436]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-03-10T13:42:24.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:24 gibba015 bash[13005]: audit 2021-03-10T13:42:23.552939+0000 mon.a (mon.0) 346 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-03-10T13:42:25.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:25 gibba015 bash[9806]: audit 2021-03-10T13:42:24.316486+0000 mon.b (mon.2) 9 : audit [INF] from='osd.4 [v2:172.21.2.145:6800/860882436,v1:172.21.2.145:6801/860882436]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0820, "args": ["host=gibba045", "root=default"]}]: dispatch 2021-03-10T13:42:25.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:25 gibba015 bash[9806]: audit 2021-03-10T13:42:24.317455+0000 mon.a (mon.0) 347 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2021-03-10T13:42:25.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:25 gibba015 bash[9806]: cluster 2021-03-10T13:42:24.317481+0000 mon.a (mon.0) 348 : cluster [DBG] osdmap e30: 5 total, 4 up, 4 in 2021-03-10T13:42:25.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:25 gibba015 bash[9806]: audit 2021-03-10T13:42:24.317548+0000 mon.a (mon.0) 349 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T13:42:25.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:25 gibba015 bash[9806]: audit 2021-03-10T13:42:24.318350+0000 mon.a (mon.0) 350 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0820, "args": ["host=gibba045", "root=default"]}]: dispatch 2021-03-10T13:42:25.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:25 gibba015 bash[9806]: audit 2021-03-10T13:42:24.478189+0000 mon.a (mon.0) 351 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:42:25.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:25 gibba015 bash[9806]: cluster 2021-03-10T13:42:24.539470+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T13:42:25.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:25 gibba015 bash[9806]: cluster 2021-03-10T13:42:24.539499+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T13:42:25.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:25 gibba015 bash[13005]: audit 2021-03-10T13:42:24.316486+0000 mon.b (mon.2) 9 : audit [INF] from='osd.4 [v2:172.21.2.145:6800/860882436,v1:172.21.2.145:6801/860882436]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0820, "args": ["host=gibba045", "root=default"]}]: dispatch 2021-03-10T13:42:25.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:25 gibba015 bash[13005]: audit 2021-03-10T13:42:24.317455+0000 mon.a (mon.0) 347 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2021-03-10T13:42:25.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:25 gibba015 bash[13005]: cluster 2021-03-10T13:42:24.317481+0000 mon.a (mon.0) 348 : cluster [DBG] osdmap e30: 5 total, 4 up, 4 in 2021-03-10T13:42:25.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:25 gibba015 bash[13005]: audit 2021-03-10T13:42:24.317548+0000 mon.a (mon.0) 349 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T13:42:25.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:25 gibba015 bash[13005]: audit 2021-03-10T13:42:24.318350+0000 mon.a (mon.0) 350 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0820, "args": ["host=gibba045", "root=default"]}]: dispatch 2021-03-10T13:42:25.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:25 gibba015 bash[13005]: audit 2021-03-10T13:42:24.478189+0000 mon.a (mon.0) 351 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:42:25.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:25 gibba015 bash[13005]: cluster 2021-03-10T13:42:24.539470+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T13:42:25.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:25 gibba015 bash[13005]: cluster 2021-03-10T13:42:24.539499+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T13:42:25.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:25 gibba015 bash[9806]: audit 2021-03-10T13:42:24.587926+0000 mon.a (mon.0) 352 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.479174\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.479453\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.479623\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.479780\", \"created\": \"2021-03-10T13:42:17.077564\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}}, \"last_daemon_update\": \"2021-03-10T13:42:17.480044\", \"last_device_update\": \"2021-03-10T13:42:24.585797\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:42:25.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:25 gibba015 bash[9806]: audit 2021-03-10T13:42:24.596674+0000 mon.a (mon.0) 353 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.479174\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.479453\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.479623\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.479780\", \"created\": \"2021-03-10T13:42:17.077564\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}}, \"last_daemon_update\": \"2021-03-10T13:42:17.480044\", \"last_device_update\": \"2021-03-10T13:42:24.585797\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:42:25.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:25 gibba015 bash[13005]: audit 2021-03-10T13:42:24.587926+0000 mon.a (mon.0) 352 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.479174\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.479453\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.479623\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.479780\", \"created\": \"2021-03-10T13:42:17.077564\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}}, \"last_daemon_update\": \"2021-03-10T13:42:17.480044\", \"last_device_update\": \"2021-03-10T13:42:24.585797\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:42:25.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:25 gibba015 bash[13005]: audit 2021-03-10T13:42:24.596674+0000 mon.a (mon.0) 353 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.479174\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.479453\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.479623\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.479780\", \"created\": \"2021-03-10T13:42:17.077564\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}}, \"last_daemon_update\": \"2021-03-10T13:42:17.480044\", \"last_device_update\": \"2021-03-10T13:42:24.585797\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:42:25.808 INFO:journalctl@ceph.osd.4.gibba045.stdout:Mar 10 13:42:25 gibba045 bash[12292]: debug 2021-03-10T13:42:25.321+0000 7fd5abc6e700 -1 osd.4 0 waiting for initial osdmap 2021-03-10T13:42:25.808 INFO:journalctl@ceph.osd.4.gibba045.stdout:Mar 10 13:42:25 gibba045 bash[12292]: debug 2021-03-10T13:42:25.325+0000 7fd5b6e8a700 -1 osd.4 31 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T13:42:25.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:25 gibba045 bash[9787]: audit 2021-03-10T13:42:24.316486+0000 mon.b (mon.2) 9 : audit [INF] from='osd.4 [v2:172.21.2.145:6800/860882436,v1:172.21.2.145:6801/860882436]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0820, "args": ["host=gibba045", "root=default"]}]: dispatch 2021-03-10T13:42:25.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:25 gibba045 bash[9787]: audit 2021-03-10T13:42:24.317455+0000 mon.a (mon.0) 347 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2021-03-10T13:42:25.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:25 gibba045 bash[9787]: cluster 2021-03-10T13:42:24.317481+0000 mon.a (mon.0) 348 : cluster [DBG] osdmap e30: 5 total, 4 up, 4 in 2021-03-10T13:42:25.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:25 gibba045 bash[9787]: audit 2021-03-10T13:42:24.317548+0000 mon.a (mon.0) 349 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T13:42:25.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:25 gibba045 bash[9787]: audit 2021-03-10T13:42:24.318350+0000 mon.a (mon.0) 350 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0820, "args": ["host=gibba045", "root=default"]}]: dispatch 2021-03-10T13:42:25.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:25 gibba045 bash[9787]: audit 2021-03-10T13:42:24.478189+0000 mon.a (mon.0) 351 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:42:25.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:25 gibba045 bash[9787]: cluster 2021-03-10T13:42:24.539470+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T13:42:25.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:25 gibba045 bash[9787]: cluster 2021-03-10T13:42:24.539499+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T13:42:25.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:25 gibba045 bash[9787]: audit 2021-03-10T13:42:24.587926+0000 mon.a (mon.0) 352 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.479174\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.479453\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.479623\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.479780\", \"created\": \"2021-03-10T13:42:17.077564\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}}, \"last_daemon_update\": \"2021-03-10T13:42:17.480044\", \"last_device_update\": \"2021-03-10T13:42:24.585797\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:42:25.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:25 gibba045 bash[9787]: audit 2021-03-10T13:42:24.596674+0000 mon.a (mon.0) 353 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.479174\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.479453\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.479623\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.479780\", \"created\": \"2021-03-10T13:42:17.077564\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}}, \"last_daemon_update\": \"2021-03-10T13:42:17.480044\", \"last_device_update\": \"2021-03-10T13:42:24.585797\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:42:26.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:26 gibba015 bash[9806]: cluster 2021-03-10T13:42:25.116876+0000 mgr.y (mgr.14140) 112 : cluster [DBG] pgmap v109: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 332 GiB / 336 GiB avail 2021-03-10T13:42:26.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:26 gibba015 bash[9806]: audit 2021-03-10T13:42:25.326566+0000 mon.a (mon.0) 354 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0820, "args": ["host=gibba045", "root=default"]}]': finished 2021-03-10T13:42:26.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:26 gibba015 bash[9806]: cluster 2021-03-10T13:42:25.326595+0000 mon.a (mon.0) 355 : cluster [DBG] osdmap e31: 5 total, 4 up, 4 in 2021-03-10T13:42:26.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:26 gibba015 bash[9806]: audit 2021-03-10T13:42:25.327379+0000 mon.a (mon.0) 356 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T13:42:26.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:26 gibba015 bash[13005]: cluster 2021-03-10T13:42:25.116876+0000 mgr.y (mgr.14140) 112 : cluster [DBG] pgmap v109: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 332 GiB / 336 GiB avail 2021-03-10T13:42:26.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:26 gibba015 bash[13005]: audit 2021-03-10T13:42:25.326566+0000 mon.a (mon.0) 354 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0820, "args": ["host=gibba045", "root=default"]}]': finished 2021-03-10T13:42:26.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:26 gibba015 bash[13005]: cluster 2021-03-10T13:42:25.326595+0000 mon.a (mon.0) 355 : cluster [DBG] osdmap e31: 5 total, 4 up, 4 in 2021-03-10T13:42:26.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:26 gibba015 bash[13005]: audit 2021-03-10T13:42:25.327379+0000 mon.a (mon.0) 356 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T13:42:26.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:26 gibba045 bash[9787]: cluster 2021-03-10T13:42:25.116876+0000 mgr.y (mgr.14140) 112 : cluster [DBG] pgmap v109: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 332 GiB / 336 GiB avail 2021-03-10T13:42:26.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:26 gibba045 bash[9787]: audit 2021-03-10T13:42:25.326566+0000 mon.a (mon.0) 354 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0820, "args": ["host=gibba045", "root=default"]}]': finished 2021-03-10T13:42:26.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:26 gibba045 bash[9787]: cluster 2021-03-10T13:42:25.326595+0000 mon.a (mon.0) 355 : cluster [DBG] osdmap e31: 5 total, 4 up, 4 in 2021-03-10T13:42:26.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:26 gibba045 bash[9787]: audit 2021-03-10T13:42:25.327379+0000 mon.a (mon.0) 356 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T13:42:27.505 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:27 gibba045 bash[9787]: audit 2021-03-10T13:42:26.335117+0000 mgr.y (mgr.14140) 113 : audit [DBG] from='client.34154 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba045:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:42:27.506 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:27 gibba045 bash[9787]: cephadm 2021-03-10T13:42:26.337289+0000 mgr.y (mgr.14140) 114 : cephadm [INF] Applying osd on host gibba045... 2021-03-10T13:42:27.506 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:27 gibba045 bash[9787]: audit 2021-03-10T13:42:26.339695+0000 mon.a (mon.0) 357 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T13:42:27.506 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:27 gibba045 bash[9787]: audit 2021-03-10T13:42:26.340444+0000 mon.a (mon.0) 358 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:42:27.506 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:27 gibba045 bash[9787]: cluster 2021-03-10T13:42:26.342251+0000 mon.a (mon.0) 359 : cluster [INF] osd.4 [v2:172.21.2.145:6800/860882436,v1:172.21.2.145:6801/860882436] boot 2021-03-10T13:42:27.507 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:27 gibba045 bash[9787]: cluster 2021-03-10T13:42:26.342278+0000 mon.a (mon.0) 360 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2021-03-10T13:42:27.507 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:27 gibba045 bash[9787]: audit 2021-03-10T13:42:26.342487+0000 mon.a (mon.0) 361 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T13:42:27.507 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:27 gibba045 bash[9787]: audit 2021-03-10T13:42:26.343042+0000 mon.a (mon.0) 362 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:42:27.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:27 gibba015 bash[9806]: audit 2021-03-10T13:42:26.335117+0000 mgr.y (mgr.14140) 113 : audit [DBG] from='client.34154 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba045:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:42:27.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:27 gibba015 bash[9806]: cephadm 2021-03-10T13:42:26.337289+0000 mgr.y (mgr.14140) 114 : cephadm [INF] Applying osd on host gibba045... 2021-03-10T13:42:27.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:27 gibba015 bash[9806]: audit 2021-03-10T13:42:26.339695+0000 mon.a (mon.0) 357 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T13:42:27.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:27 gibba015 bash[9806]: audit 2021-03-10T13:42:26.340444+0000 mon.a (mon.0) 358 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:42:27.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:27 gibba015 bash[9806]: cluster 2021-03-10T13:42:26.342251+0000 mon.a (mon.0) 359 : cluster [INF] osd.4 [v2:172.21.2.145:6800/860882436,v1:172.21.2.145:6801/860882436] boot 2021-03-10T13:42:27.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:27 gibba015 bash[9806]: cluster 2021-03-10T13:42:26.342278+0000 mon.a (mon.0) 360 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2021-03-10T13:42:27.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:27 gibba015 bash[9806]: audit 2021-03-10T13:42:26.342487+0000 mon.a (mon.0) 361 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T13:42:27.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:27 gibba015 bash[9806]: audit 2021-03-10T13:42:26.343042+0000 mon.a (mon.0) 362 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:42:27.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:27 gibba015 bash[13005]: audit 2021-03-10T13:42:26.335117+0000 mgr.y (mgr.14140) 113 : audit [DBG] from='client.34154 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba045:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:42:27.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:27 gibba015 bash[13005]: cephadm 2021-03-10T13:42:26.337289+0000 mgr.y (mgr.14140) 114 : cephadm [INF] Applying osd on host gibba045... 2021-03-10T13:42:27.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:27 gibba015 bash[13005]: audit 2021-03-10T13:42:26.339695+0000 mon.a (mon.0) 357 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T13:42:27.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:27 gibba015 bash[13005]: audit 2021-03-10T13:42:26.340444+0000 mon.a (mon.0) 358 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:42:27.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:27 gibba015 bash[13005]: cluster 2021-03-10T13:42:26.342251+0000 mon.a (mon.0) 359 : cluster [INF] osd.4 [v2:172.21.2.145:6800/860882436,v1:172.21.2.145:6801/860882436] boot 2021-03-10T13:42:27.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:27 gibba015 bash[13005]: cluster 2021-03-10T13:42:26.342278+0000 mon.a (mon.0) 360 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2021-03-10T13:42:27.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:27 gibba015 bash[13005]: audit 2021-03-10T13:42:26.342487+0000 mon.a (mon.0) 361 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T13:42:27.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:27 gibba015 bash[13005]: audit 2021-03-10T13:42:26.343042+0000 mon.a (mon.0) 362 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:42:28.675 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:28 gibba045 bash[9787]: cluster 2021-03-10T13:42:27.117549+0000 mgr.y (mgr.14140) 115 : cluster [DBG] pgmap v112: 1 pgs: 1 active+clean; 0 B data, 1008 KiB used, 332 GiB / 336 GiB avail 2021-03-10T13:42:28.676 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:28 gibba045 bash[9787]: cluster 2021-03-10T13:42:27.350769+0000 mon.a (mon.0) 363 : cluster [DBG] osdmap e33: 5 total, 5 up, 5 in 2021-03-10T13:42:28.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:28 gibba015 bash[9806]: cluster 2021-03-10T13:42:27.117549+0000 mgr.y (mgr.14140) 115 : cluster [DBG] pgmap v112: 1 pgs: 1 active+clean; 0 B data, 1008 KiB used, 332 GiB / 336 GiB avail 2021-03-10T13:42:28.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:28 gibba015 bash[9806]: cluster 2021-03-10T13:42:27.350769+0000 mon.a (mon.0) 363 : cluster [DBG] osdmap e33: 5 total, 5 up, 5 in 2021-03-10T13:42:28.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:28 gibba015 bash[13005]: cluster 2021-03-10T13:42:27.117549+0000 mgr.y (mgr.14140) 115 : cluster [DBG] pgmap v112: 1 pgs: 1 active+clean; 0 B data, 1008 KiB used, 332 GiB / 336 GiB avail 2021-03-10T13:42:28.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:28 gibba015 bash[13005]: cluster 2021-03-10T13:42:27.350769+0000 mon.a (mon.0) 363 : cluster [DBG] osdmap e33: 5 total, 5 up, 5 in 2021-03-10T13:42:29.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:29 gibba015 bash[9806]: audit 2021-03-10T13:42:29.244397+0000 mon.b (mon.2) 10 : audit [INF] from='client.? 172.21.2.145:0/874243789' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "81a848ae-eccd-42a4-8537-dde9fbce70f3"}]: dispatch 2021-03-10T13:42:29.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:29 gibba015 bash[9806]: audit 2021-03-10T13:42:29.247185+0000 mon.a (mon.0) 364 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "81a848ae-eccd-42a4-8537-dde9fbce70f3"}]: dispatch 2021-03-10T13:42:29.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:29 gibba015 bash[9806]: audit 2021-03-10T13:42:29.258583+0000 mon.a (mon.0) 365 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "81a848ae-eccd-42a4-8537-dde9fbce70f3"}]': finished 2021-03-10T13:42:29.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:29 gibba015 bash[9806]: cluster 2021-03-10T13:42:29.258643+0000 mon.a (mon.0) 366 : cluster [DBG] osdmap e34: 6 total, 5 up, 5 in 2021-03-10T13:42:29.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:29 gibba015 bash[9806]: audit 2021-03-10T13:42:29.258775+0000 mon.a (mon.0) 367 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T13:42:29.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:29 gibba015 bash[13005]: audit 2021-03-10T13:42:29.244397+0000 mon.b (mon.2) 10 : audit [INF] from='client.? 172.21.2.145:0/874243789' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "81a848ae-eccd-42a4-8537-dde9fbce70f3"}]: dispatch 2021-03-10T13:42:29.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:29 gibba015 bash[13005]: audit 2021-03-10T13:42:29.247185+0000 mon.a (mon.0) 364 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "81a848ae-eccd-42a4-8537-dde9fbce70f3"}]: dispatch 2021-03-10T13:42:29.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:29 gibba015 bash[13005]: audit 2021-03-10T13:42:29.258583+0000 mon.a (mon.0) 365 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "81a848ae-eccd-42a4-8537-dde9fbce70f3"}]': finished 2021-03-10T13:42:29.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:29 gibba015 bash[13005]: cluster 2021-03-10T13:42:29.258643+0000 mon.a (mon.0) 366 : cluster [DBG] osdmap e34: 6 total, 5 up, 5 in 2021-03-10T13:42:29.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:29 gibba015 bash[13005]: audit 2021-03-10T13:42:29.258775+0000 mon.a (mon.0) 367 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T13:42:29.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:29 gibba045 bash[9787]: audit 2021-03-10T13:42:29.244397+0000 mon.b (mon.2) 10 : audit [INF] from='client.? 172.21.2.145:0/874243789' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "81a848ae-eccd-42a4-8537-dde9fbce70f3"}]: dispatch 2021-03-10T13:42:29.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:29 gibba045 bash[9787]: audit 2021-03-10T13:42:29.247185+0000 mon.a (mon.0) 364 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "81a848ae-eccd-42a4-8537-dde9fbce70f3"}]: dispatch 2021-03-10T13:42:29.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:29 gibba045 bash[9787]: audit 2021-03-10T13:42:29.258583+0000 mon.a (mon.0) 365 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "81a848ae-eccd-42a4-8537-dde9fbce70f3"}]': finished 2021-03-10T13:42:29.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:29 gibba045 bash[9787]: cluster 2021-03-10T13:42:29.258643+0000 mon.a (mon.0) 366 : cluster [DBG] osdmap e34: 6 total, 5 up, 5 in 2021-03-10T13:42:29.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:29 gibba045 bash[9787]: audit 2021-03-10T13:42:29.258775+0000 mon.a (mon.0) 367 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T13:42:30.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:30 gibba015 bash[9806]: cluster 2021-03-10T13:42:29.118183+0000 mgr.y (mgr.14140) 116 : cluster [DBG] pgmap v114: 1 pgs: 1 peering; 0 B data, 1.3 MiB used, 415 GiB / 420 GiB avail 2021-03-10T13:42:30.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:30 gibba015 bash[13005]: cluster 2021-03-10T13:42:29.118183+0000 mgr.y (mgr.14140) 116 : cluster [DBG] pgmap v114: 1 pgs: 1 peering; 0 B data, 1.3 MiB used, 415 GiB / 420 GiB avail 2021-03-10T13:42:30.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:30 gibba045 bash[9787]: cluster 2021-03-10T13:42:29.118183+0000 mgr.y (mgr.14140) 116 : cluster [DBG] pgmap v114: 1 pgs: 1 peering; 0 B data, 1.3 MiB used, 415 GiB / 420 GiB avail 2021-03-10T13:42:31.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:31 gibba015 bash[9806]: audit 2021-03-10T13:42:31.240815+0000 mon.b (mon.2) 11 : audit [DBG] from='client.? 172.21.2.145:0/988413922' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T13:42:31.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:31 gibba015 bash[13005]: audit 2021-03-10T13:42:31.240815+0000 mon.b (mon.2) 11 : audit [DBG] from='client.? 172.21.2.145:0/988413922' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T13:42:31.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:31 gibba045 bash[9787]: audit 2021-03-10T13:42:31.240815+0000 mon.b (mon.2) 11 : audit [DBG] from='client.? 172.21.2.145:0/988413922' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T13:42:32.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:32 gibba015 bash[9806]: cluster 2021-03-10T13:42:31.118999+0000 mgr.y (mgr.14140) 117 : cluster [DBG] pgmap v116: 1 pgs: 1 peering; 0 B data, 1.3 MiB used, 415 GiB / 420 GiB avail 2021-03-10T13:42:32.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:32 gibba015 bash[13005]: cluster 2021-03-10T13:42:31.118999+0000 mgr.y (mgr.14140) 117 : cluster [DBG] pgmap v116: 1 pgs: 1 peering; 0 B data, 1.3 MiB used, 415 GiB / 420 GiB avail 2021-03-10T13:42:32.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:32 gibba045 bash[9787]: cluster 2021-03-10T13:42:31.118999+0000 mgr.y (mgr.14140) 117 : cluster [DBG] pgmap v116: 1 pgs: 1 peering; 0 B data, 1.3 MiB used, 415 GiB / 420 GiB avail 2021-03-10T13:42:34.696 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:34 gibba045 bash[9787]: cluster 2021-03-10T13:42:33.119720+0000 mgr.y (mgr.14140) 118 : cluster [DBG] pgmap v117: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:42:34.696 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:34 gibba045 bash[9787]: audit 2021-03-10T13:42:33.832218+0000 mon.a (mon.0) 368 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:42:34.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:34 gibba015 bash[9806]: cluster 2021-03-10T13:42:33.119720+0000 mgr.y (mgr.14140) 118 : cluster [DBG] pgmap v117: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:42:34.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:34 gibba015 bash[9806]: audit 2021-03-10T13:42:33.832218+0000 mon.a (mon.0) 368 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:42:34.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:34 gibba015 bash[13005]: cluster 2021-03-10T13:42:33.119720+0000 mgr.y (mgr.14140) 118 : cluster [DBG] pgmap v117: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:42:34.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:34 gibba015 bash[13005]: audit 2021-03-10T13:42:33.832218+0000 mon.a (mon.0) 368 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:42:36.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:36 gibba015 bash[9806]: cluster 2021-03-10T13:42:35.120397+0000 mgr.y (mgr.14140) 119 : cluster [DBG] pgmap v118: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:42:36.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:36 gibba015 bash[13005]: cluster 2021-03-10T13:42:35.120397+0000 mgr.y (mgr.14140) 119 : cluster [DBG] pgmap v118: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:42:36.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:36 gibba045 bash[9787]: cluster 2021-03-10T13:42:35.120397+0000 mgr.y (mgr.14140) 119 : cluster [DBG] pgmap v118: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:42:37.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:37 gibba045 bash[9787]: audit 2021-03-10T13:42:37.043283+0000 mon.a (mon.0) 369 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2021-03-10T13:42:37.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:37 gibba045 bash[9787]: audit 2021-03-10T13:42:37.046413+0000 mon.a (mon.0) 370 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:42:37.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:37 gibba045 bash[9787]: cephadm 2021-03-10T13:42:37.048977+0000 mgr.y (mgr.14140) 120 : cephadm [INF] Deploying daemon osd.5 on gibba045 2021-03-10T13:42:37.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:37 gibba045 bash[9787]: audit 2021-03-10T13:42:37.050084+0000 mon.a (mon.0) 371 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.5", "key": "container_image"}]: dispatch 2021-03-10T13:42:37.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:37 gibba015 bash[9806]: audit 2021-03-10T13:42:37.043283+0000 mon.a (mon.0) 369 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2021-03-10T13:42:37.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:37 gibba015 bash[9806]: audit 2021-03-10T13:42:37.046413+0000 mon.a (mon.0) 370 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:42:37.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:37 gibba015 bash[9806]: cephadm 2021-03-10T13:42:37.048977+0000 mgr.y (mgr.14140) 120 : cephadm [INF] Deploying daemon osd.5 on gibba045 2021-03-10T13:42:37.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:37 gibba015 bash[9806]: audit 2021-03-10T13:42:37.050084+0000 mon.a (mon.0) 371 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.5", "key": "container_image"}]: dispatch 2021-03-10T13:42:37.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:37 gibba015 bash[13005]: audit 2021-03-10T13:42:37.043283+0000 mon.a (mon.0) 369 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2021-03-10T13:42:37.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:37 gibba015 bash[13005]: audit 2021-03-10T13:42:37.046413+0000 mon.a (mon.0) 370 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:42:37.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:37 gibba015 bash[13005]: cephadm 2021-03-10T13:42:37.048977+0000 mgr.y (mgr.14140) 120 : cephadm [INF] Deploying daemon osd.5 on gibba045 2021-03-10T13:42:37.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:37 gibba015 bash[13005]: audit 2021-03-10T13:42:37.050084+0000 mon.a (mon.0) 371 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.5", "key": "container_image"}]: dispatch 2021-03-10T13:42:38.692 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:38 gibba045 bash[9787]: cluster 2021-03-10T13:42:37.121244+0000 mgr.y (mgr.14140) 121 : cluster [DBG] pgmap v119: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:42:38.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:38 gibba015 bash[9806]: cluster 2021-03-10T13:42:37.121244+0000 mgr.y (mgr.14140) 121 : cluster [DBG] pgmap v119: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:42:38.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:38 gibba015 bash[13005]: cluster 2021-03-10T13:42:37.121244+0000 mgr.y (mgr.14140) 121 : cluster [DBG] pgmap v119: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:42:38.808 INFO:teuthology.orchestra.run.gibba045.stdout:Created osd(s) 5 on host 'gibba045' 2021-03-10T13:42:39.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:39 gibba015 bash[9806]: audit 2021-03-10T13:42:38.798140+0000 mon.a (mon.0) 372 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.479174\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.479453\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.479623\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.479780\", \"created\": \"2021-03-10T13:42:17.077564\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}}, \"last_device_update\": \"2021-03-10T13:42:24.585797\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:42:39.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:39 gibba015 bash[9806]: audit 2021-03-10T13:42:38.799690+0000 mon.a (mon.0) 373 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:42:39.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:39 gibba015 bash[13005]: audit 2021-03-10T13:42:38.798140+0000 mon.a (mon.0) 372 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.479174\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.479453\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.479623\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.479780\", \"created\": \"2021-03-10T13:42:17.077564\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}}, \"last_device_update\": \"2021-03-10T13:42:24.585797\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:42:39.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:39 gibba015 bash[13005]: audit 2021-03-10T13:42:38.799690+0000 mon.a (mon.0) 373 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:42:39.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:39 gibba015 bash[9806]: audit 2021-03-10T13:42:38.806725+0000 mon.a (mon.0) 374 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.479174\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.479453\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.479623\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.479780\", \"created\": \"2021-03-10T13:42:17.077564\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}}, \"last_device_update\": \"2021-03-10T13:42:24.585797\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:42:39.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:39 gibba015 bash[13005]: audit 2021-03-10T13:42:38.806725+0000 mon.a (mon.0) 374 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.479174\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.479453\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.479623\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.479780\", \"created\": \"2021-03-10T13:42:17.077564\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}}, \"last_device_update\": \"2021-03-10T13:42:24.585797\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:42:39.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:39 gibba015 bash[9806]: audit 2021-03-10T13:42:39.307763+0000 mon.a (mon.0) 375 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.304460\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.304729\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.304903\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.305101\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.305265\", \"created\": \"2021-03-10T13:42:38.781564\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}}, \"last_daemon_update\": \"2021-03-10T13:42:39.305538\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:42:39.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:39 gibba015 bash[9806]: audit 2021-03-10T13:42:39.316492+0000 mon.a (mon.0) 376 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.304460\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.304729\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.304903\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.305101\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.305265\", \"created\": \"2021-03-10T13:42:38.781564\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}}, \"last_daemon_update\": \"2021-03-10T13:42:39.305538\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:42:39.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:39 gibba015 bash[9806]: audit 2021-03-10T13:42:39.317209+0000 mon.a (mon.0) 377 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:42:39.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:39 gibba015 bash[13005]: audit 2021-03-10T13:42:39.307763+0000 mon.a (mon.0) 375 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.304460\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.304729\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.304903\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.305101\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.305265\", \"created\": \"2021-03-10T13:42:38.781564\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}}, \"last_daemon_update\": \"2021-03-10T13:42:39.305538\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:42:39.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:39 gibba015 bash[13005]: audit 2021-03-10T13:42:39.316492+0000 mon.a (mon.0) 376 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.304460\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.304729\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.304903\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.305101\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.305265\", \"created\": \"2021-03-10T13:42:38.781564\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}}, \"last_daemon_update\": \"2021-03-10T13:42:39.305538\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:42:39.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:39 gibba015 bash[13005]: audit 2021-03-10T13:42:39.317209+0000 mon.a (mon.0) 377 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:42:39.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:39 gibba045 bash[9787]: audit 2021-03-10T13:42:38.798140+0000 mon.a (mon.0) 372 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.479174\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.479453\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.479623\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.479780\", \"created\": \"2021-03-10T13:42:17.077564\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}}, \"last_device_update\": \"2021-03-10T13:42:24.585797\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:42:39.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:39 gibba045 bash[9787]: audit 2021-03-10T13:42:38.799690+0000 mon.a (mon.0) 373 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:42:39.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:39 gibba045 bash[9787]: audit 2021-03-10T13:42:38.806725+0000 mon.a (mon.0) 374 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.479174\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.479453\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.479623\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:17.479780\", \"created\": \"2021-03-10T13:42:17.077564\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}}, \"last_device_update\": \"2021-03-10T13:42:24.585797\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:42:39.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:39 gibba045 bash[9787]: audit 2021-03-10T13:42:39.307763+0000 mon.a (mon.0) 375 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.304460\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.304729\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.304903\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.305101\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.305265\", \"created\": \"2021-03-10T13:42:38.781564\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}}, \"last_daemon_update\": \"2021-03-10T13:42:39.305538\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:42:39.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:39 gibba045 bash[9787]: audit 2021-03-10T13:42:39.316492+0000 mon.a (mon.0) 376 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.304460\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.304729\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.304903\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.305101\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.305265\", \"created\": \"2021-03-10T13:42:38.781564\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}}, \"last_daemon_update\": \"2021-03-10T13:42:39.305538\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:42:39.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:39 gibba045 bash[9787]: audit 2021-03-10T13:42:39.317209+0000 mon.a (mon.0) 377 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:42:39.940 DEBUG:teuthology.orchestra.run.gibba045:osd.5> sudo journalctl -f -n 0 -u ceph-e4a642d2-81a5-11eb-9080-001a4aab830c@osd.5.service 2021-03-10T13:42:39.943 INFO:tasks.cephadm:Deploying osd.6 on gibba045 with /dev/vg_nvme/lv_2... 2021-03-10T13:42:39.943 DEBUG:teuthology.orchestra.run.gibba045:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e4a642d2-81a5-11eb-9080-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2021-03-10T13:42:39.992 INFO:journalctl@ceph.osd.5.gibba045.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T13:42:41.120 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:40 gibba045 bash[9787]: cluster 2021-03-10T13:42:39.121923+0000 mgr.y (mgr.14140) 122 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:42:41.121 INFO:journalctl@ceph.osd.5.gibba045.stdout:Mar 10 13:42:40 gibba045 bash[13379]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2021-03-10T13:42:41.121 INFO:journalctl@ceph.osd.5.gibba045.stdout:Mar 10 13:42:40 gibba045 bash[13379]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-5 --no-mon-config 2021-03-10T13:42:41.121 INFO:journalctl@ceph.osd.5.gibba045.stdout:Mar 10 13:42:40 gibba045 bash[13379]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-5/block 2021-03-10T13:42:41.121 INFO:journalctl@ceph.osd.5.gibba045.stdout:Mar 10 13:42:40 gibba045 bash[13379]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-5/block 2021-03-10T13:42:41.121 INFO:journalctl@ceph.osd.5.gibba045.stdout:Mar 10 13:42:40 gibba045 bash[13379]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2021-03-10T13:42:41.122 INFO:journalctl@ceph.osd.5.gibba045.stdout:Mar 10 13:42:40 gibba045 bash[13379]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2021-03-10T13:42:41.122 INFO:journalctl@ceph.osd.5.gibba045.stdout:Mar 10 13:42:40 gibba045 bash[13379]: --> ceph-volume lvm activate successful for osd ID: 5 2021-03-10T13:42:41.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:40 gibba015 bash[9806]: cluster 2021-03-10T13:42:39.121923+0000 mgr.y (mgr.14140) 122 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:42:41.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:40 gibba015 bash[13005]: cluster 2021-03-10T13:42:39.121923+0000 mgr.y (mgr.14140) 122 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:42:43.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:42 gibba045 bash[9787]: cluster 2021-03-10T13:42:41.122583+0000 mgr.y (mgr.14140) 123 : cluster [DBG] pgmap v121: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:42:43.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:42 gibba015 bash[9806]: cluster 2021-03-10T13:42:41.122583+0000 mgr.y (mgr.14140) 123 : cluster [DBG] pgmap v121: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:42:43.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:42 gibba015 bash[13005]: cluster 2021-03-10T13:42:41.122583+0000 mgr.y (mgr.14140) 123 : cluster [DBG] pgmap v121: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:42:44.779 INFO:teuthology.orchestra.run.gibba045.stderr:--> Zapping: /dev/vg_nvme/lv_2 2021-03-10T13:42:44.780 INFO:teuthology.orchestra.run.gibba045.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2021-03-10T13:42:44.780 INFO:teuthology.orchestra.run.gibba045.stderr: stderr: 10+0 records in 2021-03-10T13:42:44.780 INFO:teuthology.orchestra.run.gibba045.stderr:10+0 records out 2021-03-10T13:42:44.780 INFO:teuthology.orchestra.run.gibba045.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00918045 s, 1.1 GB/s 2021-03-10T13:42:44.781 INFO:teuthology.orchestra.run.gibba045.stderr:--> Zapping successful for: 2021-03-10T13:42:45.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:44 gibba015 bash[9806]: cluster 2021-03-10T13:42:43.123320+0000 mgr.y (mgr.14140) 124 : cluster [DBG] pgmap v122: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:42:45.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:44 gibba015 bash[13005]: cluster 2021-03-10T13:42:43.123320+0000 mgr.y (mgr.14140) 124 : cluster [DBG] pgmap v122: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:42:45.307 INFO:journalctl@ceph.osd.5.gibba045.stdout:Mar 10 13:42:44 gibba045 bash[13761]: debug 2021-03-10T13:42:44.965+0000 7fc3c163fec0 -1 Falling back to public interface 2021-03-10T13:42:45.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:44 gibba045 bash[9787]: cluster 2021-03-10T13:42:43.123320+0000 mgr.y (mgr.14140) 124 : cluster [DBG] pgmap v122: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:42:45.438 DEBUG:teuthology.orchestra.run.gibba045:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e4a642d2-81a5-11eb-9080-001a4aab830c -- ceph orch daemon add osd gibba045:vg_nvme/lv_2 2021-03-10T13:42:45.808 INFO:journalctl@ceph.osd.5.gibba045.stdout:Mar 10 13:42:45 gibba045 bash[13761]: debug 2021-03-10T13:42:45.613+0000 7fc3c163fec0 -1 osd.5 0 log_to_monitors {default=true} 2021-03-10T13:42:46.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:45 gibba015 bash[9806]: audit 2021-03-10T13:42:45.620607+0000 mon.b (mon.2) 12 : audit [INF] from='osd.5 [v2:172.21.2.145:6808/839821364,v1:172.21.2.145:6809/839821364]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-03-10T13:42:46.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:45 gibba015 bash[9806]: audit 2021-03-10T13:42:45.623020+0000 mon.a (mon.0) 378 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-03-10T13:42:46.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:45 gibba015 bash[13005]: audit 2021-03-10T13:42:45.620607+0000 mon.b (mon.2) 12 : audit [INF] from='osd.5 [v2:172.21.2.145:6808/839821364,v1:172.21.2.145:6809/839821364]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-03-10T13:42:46.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:45 gibba015 bash[13005]: audit 2021-03-10T13:42:45.623020+0000 mon.a (mon.0) 378 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-03-10T13:42:46.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:45 gibba045 bash[9787]: audit 2021-03-10T13:42:45.620607+0000 mon.b (mon.2) 12 : audit [INF] from='osd.5 [v2:172.21.2.145:6808/839821364,v1:172.21.2.145:6809/839821364]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-03-10T13:42:46.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:45 gibba045 bash[9787]: audit 2021-03-10T13:42:45.623020+0000 mon.a (mon.0) 378 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-03-10T13:42:47.058 INFO:journalctl@ceph.osd.5.gibba045.stdout:Mar 10 13:42:46 gibba045 bash[13761]: debug 2021-03-10T13:42:46.853+0000 7fc3aa3f4700 -1 osd.5 0 waiting for initial osdmap 2021-03-10T13:42:47.059 INFO:journalctl@ceph.osd.5.gibba045.stdout:Mar 10 13:42:46 gibba045 bash[13761]: debug 2021-03-10T13:42:46.857+0000 7fc3b5610700 -1 osd.5 36 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T13:42:47.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:46 gibba045 bash[9787]: cluster 2021-03-10T13:42:45.124187+0000 mgr.y (mgr.14140) 125 : cluster [DBG] pgmap v123: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail 2021-03-10T13:42:47.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:46 gibba045 bash[9787]: audit 2021-03-10T13:42:45.844421+0000 mon.b (mon.2) 13 : audit [INF] from='osd.5 [v2:172.21.2.145:6808/839821364,v1:172.21.2.145:6809/839821364]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0820, "args": ["host=gibba045", "root=default"]}]: dispatch 2021-03-10T13:42:47.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:46 gibba045 bash[9787]: audit 2021-03-10T13:42:45.844931+0000 mon.a (mon.0) 379 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2021-03-10T13:42:47.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:46 gibba045 bash[9787]: cluster 2021-03-10T13:42:45.844957+0000 mon.a (mon.0) 380 : cluster [DBG] osdmap e35: 6 total, 5 up, 5 in 2021-03-10T13:42:47.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:46 gibba045 bash[9787]: audit 2021-03-10T13:42:45.845036+0000 mon.a (mon.0) 381 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T13:42:47.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:46 gibba045 bash[9787]: audit 2021-03-10T13:42:45.846054+0000 mon.a (mon.0) 382 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0820, "args": ["host=gibba045", "root=default"]}]: dispatch 2021-03-10T13:42:47.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:46 gibba045 bash[9787]: audit 2021-03-10T13:42:46.165357+0000 mon.a (mon.0) 383 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:42:47.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:46 gibba045 bash[9787]: audit 2021-03-10T13:42:46.286651+0000 mon.a (mon.0) 384 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.304460\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.304729\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.304903\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.305101\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.305265\", \"created\": \"2021-03-10T13:42:38.781564\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}}, \"last_daemon_update\": \"2021-03-10T13:42:39.305538\", \"last_device_update\": \"2021-03-10T13:42:46.284408\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:42:47.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:46 gibba045 bash[9787]: audit 2021-03-10T13:42:46.295194+0000 mon.a (mon.0) 385 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.304460\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.304729\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.304903\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.305101\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.305265\", \"created\": \"2021-03-10T13:42:38.781564\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}}, \"last_daemon_update\": \"2021-03-10T13:42:39.305538\", \"last_device_update\": \"2021-03-10T13:42:46.284408\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:42:47.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:46 gibba045 bash[9787]: cluster 2021-03-10T13:42:46.583403+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T13:42:47.062 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:46 gibba045 bash[9787]: cluster 2021-03-10T13:42:46.583446+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T13:42:47.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:46 gibba015 bash[9806]: cluster 2021-03-10T13:42:45.124187+0000 mgr.y (mgr.14140) 125 : cluster [DBG] pgmap v123: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail 2021-03-10T13:42:47.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:46 gibba015 bash[9806]: audit 2021-03-10T13:42:45.844421+0000 mon.b (mon.2) 13 : audit [INF] from='osd.5 [v2:172.21.2.145:6808/839821364,v1:172.21.2.145:6809/839821364]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0820, "args": ["host=gibba045", "root=default"]}]: dispatch 2021-03-10T13:42:47.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:46 gibba015 bash[9806]: audit 2021-03-10T13:42:45.844931+0000 mon.a (mon.0) 379 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2021-03-10T13:42:47.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:46 gibba015 bash[9806]: cluster 2021-03-10T13:42:45.844957+0000 mon.a (mon.0) 380 : cluster [DBG] osdmap e35: 6 total, 5 up, 5 in 2021-03-10T13:42:47.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:46 gibba015 bash[9806]: audit 2021-03-10T13:42:45.845036+0000 mon.a (mon.0) 381 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T13:42:47.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:46 gibba015 bash[9806]: audit 2021-03-10T13:42:45.846054+0000 mon.a (mon.0) 382 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0820, "args": ["host=gibba045", "root=default"]}]: dispatch 2021-03-10T13:42:47.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:46 gibba015 bash[9806]: audit 2021-03-10T13:42:46.165357+0000 mon.a (mon.0) 383 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:42:47.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:46 gibba015 bash[13005]: cluster 2021-03-10T13:42:45.124187+0000 mgr.y (mgr.14140) 125 : cluster [DBG] pgmap v123: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail 2021-03-10T13:42:47.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:46 gibba015 bash[13005]: audit 2021-03-10T13:42:45.844421+0000 mon.b (mon.2) 13 : audit [INF] from='osd.5 [v2:172.21.2.145:6808/839821364,v1:172.21.2.145:6809/839821364]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0820, "args": ["host=gibba045", "root=default"]}]: dispatch 2021-03-10T13:42:47.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:46 gibba015 bash[13005]: audit 2021-03-10T13:42:45.844931+0000 mon.a (mon.0) 379 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2021-03-10T13:42:47.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:46 gibba015 bash[13005]: cluster 2021-03-10T13:42:45.844957+0000 mon.a (mon.0) 380 : cluster [DBG] osdmap e35: 6 total, 5 up, 5 in 2021-03-10T13:42:47.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:46 gibba015 bash[13005]: audit 2021-03-10T13:42:45.845036+0000 mon.a (mon.0) 381 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T13:42:47.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:46 gibba015 bash[13005]: audit 2021-03-10T13:42:45.846054+0000 mon.a (mon.0) 382 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0820, "args": ["host=gibba045", "root=default"]}]: dispatch 2021-03-10T13:42:47.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:46 gibba015 bash[13005]: audit 2021-03-10T13:42:46.165357+0000 mon.a (mon.0) 383 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:42:47.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:46 gibba015 bash[9806]: audit 2021-03-10T13:42:46.286651+0000 mon.a (mon.0) 384 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.304460\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.304729\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.304903\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.305101\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.305265\", \"created\": \"2021-03-10T13:42:38.781564\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}}, \"last_daemon_update\": \"2021-03-10T13:42:39.305538\", \"last_device_update\": \"2021-03-10T13:42:46.284408\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:42:47.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:46 gibba015 bash[13005]: audit 2021-03-10T13:42:46.286651+0000 mon.a (mon.0) 384 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.304460\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.304729\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.304903\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.305101\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.305265\", \"created\": \"2021-03-10T13:42:38.781564\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}}, \"last_daemon_update\": \"2021-03-10T13:42:39.305538\", \"last_device_update\": \"2021-03-10T13:42:46.284408\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:42:47.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:46 gibba015 bash[13005]: audit 2021-03-10T13:42:46.295194+0000 mon.a (mon.0) 385 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.304460\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.304729\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.304903\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.305101\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.305265\", \"created\": \"2021-03-10T13:42:38.781564\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}}, \"last_daemon_update\": \"2021-03-10T13:42:39.305538\", \"last_device_update\": \"2021-03-10T13:42:46.284408\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:42:47.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:46 gibba015 bash[13005]: cluster 2021-03-10T13:42:46.583403+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T13:42:47.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:46 gibba015 bash[13005]: cluster 2021-03-10T13:42:46.583446+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T13:42:47.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:46 gibba015 bash[9806]: audit 2021-03-10T13:42:46.295194+0000 mon.a (mon.0) 385 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.304460\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.304729\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.304903\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.305101\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.305265\", \"created\": \"2021-03-10T13:42:38.781564\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}}, \"last_daemon_update\": \"2021-03-10T13:42:39.305538\", \"last_device_update\": \"2021-03-10T13:42:46.284408\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:42:47.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:46 gibba015 bash[9806]: cluster 2021-03-10T13:42:46.583403+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T13:42:47.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:46 gibba015 bash[9806]: cluster 2021-03-10T13:42:46.583446+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T13:42:48.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:47 gibba015 bash[9806]: audit 2021-03-10T13:42:46.854323+0000 mon.a (mon.0) 386 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0820, "args": ["host=gibba045", "root=default"]}]': finished 2021-03-10T13:42:48.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:47 gibba015 bash[9806]: cluster 2021-03-10T13:42:46.854452+0000 mon.a (mon.0) 387 : cluster [DBG] osdmap e36: 6 total, 5 up, 5 in 2021-03-10T13:42:48.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:47 gibba015 bash[9806]: audit 2021-03-10T13:42:46.855225+0000 mon.a (mon.0) 388 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T13:42:48.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:47 gibba015 bash[13005]: audit 2021-03-10T13:42:46.854323+0000 mon.a (mon.0) 386 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0820, "args": ["host=gibba045", "root=default"]}]': finished 2021-03-10T13:42:48.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:47 gibba015 bash[13005]: cluster 2021-03-10T13:42:46.854452+0000 mon.a (mon.0) 387 : cluster [DBG] osdmap e36: 6 total, 5 up, 5 in 2021-03-10T13:42:48.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:47 gibba015 bash[13005]: audit 2021-03-10T13:42:46.855225+0000 mon.a (mon.0) 388 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T13:42:48.278 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:47 gibba045 bash[9787]: audit 2021-03-10T13:42:46.854323+0000 mon.a (mon.0) 386 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0820, "args": ["host=gibba045", "root=default"]}]': finished 2021-03-10T13:42:48.279 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:47 gibba045 bash[9787]: cluster 2021-03-10T13:42:46.854452+0000 mon.a (mon.0) 387 : cluster [DBG] osdmap e36: 6 total, 5 up, 5 in 2021-03-10T13:42:48.279 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:47 gibba045 bash[9787]: audit 2021-03-10T13:42:46.855225+0000 mon.a (mon.0) 388 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T13:42:49.165 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:48 gibba045 bash[9787]: cluster 2021-03-10T13:42:47.124640+0000 mgr.y (mgr.14140) 126 : cluster [DBG] pgmap v126: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail 2021-03-10T13:42:49.166 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:48 gibba045 bash[9787]: cluster 2021-03-10T13:42:47.874128+0000 mon.a (mon.0) 389 : cluster [INF] osd.5 [v2:172.21.2.145:6808/839821364,v1:172.21.2.145:6809/839821364] boot 2021-03-10T13:42:49.166 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:48 gibba045 bash[9787]: cluster 2021-03-10T13:42:47.874156+0000 mon.a (mon.0) 390 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2021-03-10T13:42:49.166 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:48 gibba045 bash[9787]: audit 2021-03-10T13:42:47.874231+0000 mon.a (mon.0) 391 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T13:42:49.166 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:48 gibba045 bash[9787]: audit 2021-03-10T13:42:48.161732+0000 mon.a (mon.0) 392 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T13:42:49.167 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:48 gibba045 bash[9787]: audit 2021-03-10T13:42:48.162703+0000 mon.a (mon.0) 393 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:42:49.167 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:48 gibba045 bash[9787]: audit 2021-03-10T13:42:48.164202+0000 mon.a (mon.0) 394 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:42:49.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:48 gibba015 bash[9806]: cluster 2021-03-10T13:42:47.124640+0000 mgr.y (mgr.14140) 126 : cluster [DBG] pgmap v126: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail 2021-03-10T13:42:49.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:48 gibba015 bash[9806]: cluster 2021-03-10T13:42:47.874128+0000 mon.a (mon.0) 389 : cluster [INF] osd.5 [v2:172.21.2.145:6808/839821364,v1:172.21.2.145:6809/839821364] boot 2021-03-10T13:42:49.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:48 gibba015 bash[9806]: cluster 2021-03-10T13:42:47.874156+0000 mon.a (mon.0) 390 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2021-03-10T13:42:49.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:48 gibba015 bash[9806]: audit 2021-03-10T13:42:47.874231+0000 mon.a (mon.0) 391 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T13:42:49.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:48 gibba015 bash[9806]: audit 2021-03-10T13:42:48.161732+0000 mon.a (mon.0) 392 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T13:42:49.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:48 gibba015 bash[9806]: audit 2021-03-10T13:42:48.162703+0000 mon.a (mon.0) 393 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:42:49.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:48 gibba015 bash[9806]: audit 2021-03-10T13:42:48.164202+0000 mon.a (mon.0) 394 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:42:49.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:48 gibba015 bash[13005]: cluster 2021-03-10T13:42:47.124640+0000 mgr.y (mgr.14140) 126 : cluster [DBG] pgmap v126: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail 2021-03-10T13:42:49.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:48 gibba015 bash[13005]: cluster 2021-03-10T13:42:47.874128+0000 mon.a (mon.0) 389 : cluster [INF] osd.5 [v2:172.21.2.145:6808/839821364,v1:172.21.2.145:6809/839821364] boot 2021-03-10T13:42:49.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:48 gibba015 bash[13005]: cluster 2021-03-10T13:42:47.874156+0000 mon.a (mon.0) 390 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2021-03-10T13:42:49.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:48 gibba015 bash[13005]: audit 2021-03-10T13:42:47.874231+0000 mon.a (mon.0) 391 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T13:42:49.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:48 gibba015 bash[13005]: audit 2021-03-10T13:42:48.161732+0000 mon.a (mon.0) 392 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T13:42:49.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:48 gibba015 bash[13005]: audit 2021-03-10T13:42:48.162703+0000 mon.a (mon.0) 393 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:42:49.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:48 gibba015 bash[13005]: audit 2021-03-10T13:42:48.164202+0000 mon.a (mon.0) 394 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:42:50.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:49 gibba045 bash[9787]: audit 2021-03-10T13:42:48.160685+0000 mgr.y (mgr.14140) 127 : audit [DBG] from='client.34181 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba045:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:42:50.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:49 gibba045 bash[9787]: cephadm 2021-03-10T13:42:48.161390+0000 mgr.y (mgr.14140) 128 : cephadm [INF] Applying osd on host gibba045... 2021-03-10T13:42:50.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:49 gibba045 bash[9787]: cluster 2021-03-10T13:42:48.888111+0000 mon.a (mon.0) 395 : cluster [DBG] osdmap e38: 6 total, 6 up, 6 in 2021-03-10T13:42:50.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:49 gibba015 bash[9806]: audit 2021-03-10T13:42:48.160685+0000 mgr.y (mgr.14140) 127 : audit [DBG] from='client.34181 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba045:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:42:50.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:49 gibba015 bash[9806]: cephadm 2021-03-10T13:42:48.161390+0000 mgr.y (mgr.14140) 128 : cephadm [INF] Applying osd on host gibba045... 2021-03-10T13:42:50.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:49 gibba015 bash[9806]: cluster 2021-03-10T13:42:48.888111+0000 mon.a (mon.0) 395 : cluster [DBG] osdmap e38: 6 total, 6 up, 6 in 2021-03-10T13:42:50.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:49 gibba015 bash[13005]: audit 2021-03-10T13:42:48.160685+0000 mgr.y (mgr.14140) 127 : audit [DBG] from='client.34181 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba045:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:42:50.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:49 gibba015 bash[13005]: cephadm 2021-03-10T13:42:48.161390+0000 mgr.y (mgr.14140) 128 : cephadm [INF] Applying osd on host gibba045... 2021-03-10T13:42:50.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:49 gibba015 bash[13005]: cluster 2021-03-10T13:42:48.888111+0000 mon.a (mon.0) 395 : cluster [DBG] osdmap e38: 6 total, 6 up, 6 in 2021-03-10T13:42:51.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:50 gibba015 bash[9806]: cluster 2021-03-10T13:42:49.125288+0000 mgr.y (mgr.14140) 129 : cluster [DBG] pgmap v129: 1 pgs: 1 peering; 0 B data, 1.8 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:42:51.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:50 gibba015 bash[9806]: cluster 2021-03-10T13:42:49.888461+0000 mon.a (mon.0) 396 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-03-10T13:42:51.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:50 gibba015 bash[13005]: cluster 2021-03-10T13:42:49.125288+0000 mgr.y (mgr.14140) 129 : cluster [DBG] pgmap v129: 1 pgs: 1 peering; 0 B data, 1.8 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:42:51.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:50 gibba015 bash[13005]: cluster 2021-03-10T13:42:49.888461+0000 mon.a (mon.0) 396 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-03-10T13:42:51.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:50 gibba045 bash[9787]: cluster 2021-03-10T13:42:49.125288+0000 mgr.y (mgr.14140) 129 : cluster [DBG] pgmap v129: 1 pgs: 1 peering; 0 B data, 1.8 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:42:51.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:50 gibba045 bash[9787]: cluster 2021-03-10T13:42:49.888461+0000 mon.a (mon.0) 396 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-03-10T13:42:52.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:51 gibba015 bash[9806]: audit 2021-03-10T13:42:50.994890+0000 mon.b (mon.2) 14 : audit [INF] from='client.? 172.21.2.145:0/928028493' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e1f6bac7-fc45-424c-be0e-0ed40192d2a1"}]: dispatch 2021-03-10T13:42:52.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:51 gibba015 bash[9806]: audit 2021-03-10T13:42:50.997652+0000 mon.a (mon.0) 397 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e1f6bac7-fc45-424c-be0e-0ed40192d2a1"}]: dispatch 2021-03-10T13:42:52.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:51 gibba015 bash[9806]: audit 2021-03-10T13:42:51.009177+0000 mon.a (mon.0) 398 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e1f6bac7-fc45-424c-be0e-0ed40192d2a1"}]': finished 2021-03-10T13:42:52.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:51 gibba015 bash[9806]: cluster 2021-03-10T13:42:51.009256+0000 mon.a (mon.0) 399 : cluster [DBG] osdmap e39: 7 total, 6 up, 6 in 2021-03-10T13:42:52.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:51 gibba015 bash[9806]: audit 2021-03-10T13:42:51.009377+0000 mon.a (mon.0) 400 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T13:42:52.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:51 gibba015 bash[13005]: audit 2021-03-10T13:42:50.994890+0000 mon.b (mon.2) 14 : audit [INF] from='client.? 172.21.2.145:0/928028493' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e1f6bac7-fc45-424c-be0e-0ed40192d2a1"}]: dispatch 2021-03-10T13:42:52.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:51 gibba015 bash[13005]: audit 2021-03-10T13:42:50.997652+0000 mon.a (mon.0) 397 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e1f6bac7-fc45-424c-be0e-0ed40192d2a1"}]: dispatch 2021-03-10T13:42:52.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:51 gibba015 bash[13005]: audit 2021-03-10T13:42:51.009177+0000 mon.a (mon.0) 398 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e1f6bac7-fc45-424c-be0e-0ed40192d2a1"}]': finished 2021-03-10T13:42:52.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:51 gibba015 bash[13005]: cluster 2021-03-10T13:42:51.009256+0000 mon.a (mon.0) 399 : cluster [DBG] osdmap e39: 7 total, 6 up, 6 in 2021-03-10T13:42:52.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:51 gibba015 bash[13005]: audit 2021-03-10T13:42:51.009377+0000 mon.a (mon.0) 400 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T13:42:52.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:51 gibba045 bash[9787]: audit 2021-03-10T13:42:50.994890+0000 mon.b (mon.2) 14 : audit [INF] from='client.? 172.21.2.145:0/928028493' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e1f6bac7-fc45-424c-be0e-0ed40192d2a1"}]: dispatch 2021-03-10T13:42:52.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:51 gibba045 bash[9787]: audit 2021-03-10T13:42:50.997652+0000 mon.a (mon.0) 397 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e1f6bac7-fc45-424c-be0e-0ed40192d2a1"}]: dispatch 2021-03-10T13:42:52.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:51 gibba045 bash[9787]: audit 2021-03-10T13:42:51.009177+0000 mon.a (mon.0) 398 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e1f6bac7-fc45-424c-be0e-0ed40192d2a1"}]': finished 2021-03-10T13:42:52.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:51 gibba045 bash[9787]: cluster 2021-03-10T13:42:51.009256+0000 mon.a (mon.0) 399 : cluster [DBG] osdmap e39: 7 total, 6 up, 6 in 2021-03-10T13:42:52.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:51 gibba045 bash[9787]: audit 2021-03-10T13:42:51.009377+0000 mon.a (mon.0) 400 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T13:42:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:53 gibba045 bash[9787]: cluster 2021-03-10T13:42:51.126038+0000 mgr.y (mgr.14140) 130 : cluster [DBG] pgmap v131: 1 pgs: 1 peering; 0 B data, 1.9 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:42:53.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:53 gibba045 bash[9787]: audit 2021-03-10T13:42:52.995463+0000 mon.b (mon.2) 15 : audit [DBG] from='client.? 172.21.2.145:0/633621896' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T13:42:53.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:53 gibba015 bash[9806]: cluster 2021-03-10T13:42:51.126038+0000 mgr.y (mgr.14140) 130 : cluster [DBG] pgmap v131: 1 pgs: 1 peering; 0 B data, 1.9 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:42:53.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:53 gibba015 bash[9806]: audit 2021-03-10T13:42:52.995463+0000 mon.b (mon.2) 15 : audit [DBG] from='client.? 172.21.2.145:0/633621896' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T13:42:53.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:53 gibba015 bash[13005]: cluster 2021-03-10T13:42:51.126038+0000 mgr.y (mgr.14140) 130 : cluster [DBG] pgmap v131: 1 pgs: 1 peering; 0 B data, 1.9 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:42:53.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:53 gibba015 bash[13005]: audit 2021-03-10T13:42:52.995463+0000 mon.b (mon.2) 15 : audit [DBG] from='client.? 172.21.2.145:0/633621896' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T13:42:55.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:55 gibba045 bash[9787]: cluster 2021-03-10T13:42:53.127021+0000 mgr.y (mgr.14140) 131 : cluster [DBG] pgmap v132: 1 pgs: 1 peering; 0 B data, 2.0 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:42:55.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:55 gibba015 bash[9806]: cluster 2021-03-10T13:42:53.127021+0000 mgr.y (mgr.14140) 131 : cluster [DBG] pgmap v132: 1 pgs: 1 peering; 0 B data, 2.0 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:42:55.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:55 gibba015 bash[13005]: cluster 2021-03-10T13:42:53.127021+0000 mgr.y (mgr.14140) 131 : cluster [DBG] pgmap v132: 1 pgs: 1 peering; 0 B data, 2.0 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:42:56.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:56 gibba045 bash[9787]: audit 2021-03-10T13:42:55.581565+0000 mon.a (mon.0) 401 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:42:56.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:56 gibba015 bash[9806]: audit 2021-03-10T13:42:55.581565+0000 mon.a (mon.0) 401 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:42:56.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:56 gibba015 bash[13005]: audit 2021-03-10T13:42:55.581565+0000 mon.a (mon.0) 401 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:42:57.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:57 gibba045 bash[9787]: cluster 2021-03-10T13:42:55.127852+0000 mgr.y (mgr.14140) 132 : cluster [DBG] pgmap v133: 1 pgs: 1 active+clean; 0 B data, 2.0 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:42:57.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:57 gibba045 bash[9787]: cluster 2021-03-10T13:42:56.020311+0000 mon.a (mon.0) 402 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2021-03-10T13:42:57.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:57 gibba045 bash[9787]: cluster 2021-03-10T13:42:56.020415+0000 mon.a (mon.0) 403 : cluster [INF] Cluster is now healthy 2021-03-10T13:42:57.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:57 gibba015 bash[9806]: cluster 2021-03-10T13:42:55.127852+0000 mgr.y (mgr.14140) 132 : cluster [DBG] pgmap v133: 1 pgs: 1 active+clean; 0 B data, 2.0 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:42:57.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:57 gibba015 bash[9806]: cluster 2021-03-10T13:42:56.020311+0000 mon.a (mon.0) 402 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2021-03-10T13:42:57.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:57 gibba015 bash[9806]: cluster 2021-03-10T13:42:56.020415+0000 mon.a (mon.0) 403 : cluster [INF] Cluster is now healthy 2021-03-10T13:42:57.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:57 gibba015 bash[13005]: cluster 2021-03-10T13:42:55.127852+0000 mgr.y (mgr.14140) 132 : cluster [DBG] pgmap v133: 1 pgs: 1 active+clean; 0 B data, 2.0 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:42:57.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:57 gibba015 bash[13005]: cluster 2021-03-10T13:42:56.020311+0000 mon.a (mon.0) 402 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2021-03-10T13:42:57.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:57 gibba015 bash[13005]: cluster 2021-03-10T13:42:56.020415+0000 mon.a (mon.0) 403 : cluster [INF] Cluster is now healthy 2021-03-10T13:42:58.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:58 gibba015 bash[9806]: cluster 2021-03-10T13:42:57.128385+0000 mgr.y (mgr.14140) 133 : cluster [DBG] pgmap v134: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:42:58.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:58 gibba015 bash[13005]: cluster 2021-03-10T13:42:57.128385+0000 mgr.y (mgr.14140) 133 : cluster [DBG] pgmap v134: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:42:58.472 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:58 gibba045 bash[9787]: cluster 2021-03-10T13:42:57.128385+0000 mgr.y (mgr.14140) 133 : cluster [DBG] pgmap v134: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:42:59.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:59 gibba045 bash[9787]: audit 2021-03-10T13:42:58.833113+0000 mon.a (mon.0) 404 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2021-03-10T13:42:59.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:59 gibba045 bash[9787]: audit 2021-03-10T13:42:58.836020+0000 mon.a (mon.0) 405 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:42:59.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:59 gibba045 bash[9787]: cephadm 2021-03-10T13:42:58.838413+0000 mgr.y (mgr.14140) 134 : cephadm [INF] Deploying daemon osd.6 on gibba045 2021-03-10T13:42:59.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:42:59 gibba045 bash[9787]: audit 2021-03-10T13:42:58.839360+0000 mon.a (mon.0) 406 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.6", "key": "container_image"}]: dispatch 2021-03-10T13:42:59.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:59 gibba015 bash[9806]: audit 2021-03-10T13:42:58.833113+0000 mon.a (mon.0) 404 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2021-03-10T13:42:59.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:59 gibba015 bash[9806]: audit 2021-03-10T13:42:58.836020+0000 mon.a (mon.0) 405 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:42:59.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:59 gibba015 bash[9806]: cephadm 2021-03-10T13:42:58.838413+0000 mgr.y (mgr.14140) 134 : cephadm [INF] Deploying daemon osd.6 on gibba045 2021-03-10T13:42:59.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:42:59 gibba015 bash[9806]: audit 2021-03-10T13:42:58.839360+0000 mon.a (mon.0) 406 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.6", "key": "container_image"}]: dispatch 2021-03-10T13:42:59.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:59 gibba015 bash[13005]: audit 2021-03-10T13:42:58.833113+0000 mon.a (mon.0) 404 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2021-03-10T13:42:59.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:59 gibba015 bash[13005]: audit 2021-03-10T13:42:58.836020+0000 mon.a (mon.0) 405 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:42:59.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:59 gibba015 bash[13005]: cephadm 2021-03-10T13:42:58.838413+0000 mgr.y (mgr.14140) 134 : cephadm [INF] Deploying daemon osd.6 on gibba045 2021-03-10T13:42:59.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:42:59 gibba015 bash[13005]: audit 2021-03-10T13:42:58.839360+0000 mon.a (mon.0) 406 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.6", "key": "container_image"}]: dispatch 2021-03-10T13:43:00.256 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:00 gibba045 bash[9787]: cluster 2021-03-10T13:42:59.129156+0000 mgr.y (mgr.14140) 135 : cluster [DBG] pgmap v135: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:43:00.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:00 gibba015 bash[9806]: cluster 2021-03-10T13:42:59.129156+0000 mgr.y (mgr.14140) 135 : cluster [DBG] pgmap v135: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:43:00.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:00 gibba015 bash[13005]: cluster 2021-03-10T13:42:59.129156+0000 mgr.y (mgr.14140) 135 : cluster [DBG] pgmap v135: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:43:00.522 INFO:teuthology.orchestra.run.gibba045.stdout:Created osd(s) 6 on host 'gibba045' 2021-03-10T13:43:01.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:01 gibba015 bash[9806]: audit 2021-03-10T13:43:00.511230+0000 mon.a (mon.0) 407 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.304460\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.304729\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.304903\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.305101\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.305265\", \"created\": \"2021-03-10T13:42:38.781564\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}}, \"last_device_update\": \"2021-03-10T13:42:46.284408\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:43:01.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:01 gibba015 bash[9806]: audit 2021-03-10T13:43:00.512790+0000 mon.a (mon.0) 408 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:43:01.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:01 gibba015 bash[13005]: audit 2021-03-10T13:43:00.511230+0000 mon.a (mon.0) 407 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.304460\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.304729\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.304903\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.305101\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.305265\", \"created\": \"2021-03-10T13:42:38.781564\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}}, \"last_device_update\": \"2021-03-10T13:42:46.284408\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:43:01.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:01 gibba015 bash[13005]: audit 2021-03-10T13:43:00.512790+0000 mon.a (mon.0) 408 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:43:01.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:01 gibba015 bash[9806]: audit 2021-03-10T13:43:00.519616+0000 mon.a (mon.0) 409 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.304460\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.304729\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.304903\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.305101\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.305265\", \"created\": \"2021-03-10T13:42:38.781564\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}}, \"last_device_update\": \"2021-03-10T13:42:46.284408\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:43:01.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:01 gibba015 bash[13005]: audit 2021-03-10T13:43:00.519616+0000 mon.a (mon.0) 409 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.304460\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.304729\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.304903\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.305101\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.305265\", \"created\": \"2021-03-10T13:42:38.781564\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}}, \"last_device_update\": \"2021-03-10T13:42:46.284408\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:43:01.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:01 gibba015 bash[9806]: audit 2021-03-10T13:43:01.052620+0000 mon.a (mon.0) 410 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.048983\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049297\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049471\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049629\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049779\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049929\", \"created\": \"2021-03-10T13:43:00.493564\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}}, \"last_daemon_update\": \"2021-03-10T13:43:01.050200\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:43:01.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:01 gibba015 bash[9806]: audit 2021-03-10T13:43:01.061463+0000 mon.a (mon.0) 411 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.048983\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049297\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049471\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049629\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049779\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049929\", \"created\": \"2021-03-10T13:43:00.493564\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}}, \"last_daemon_update\": \"2021-03-10T13:43:01.050200\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:43:01.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:01 gibba015 bash[9806]: audit 2021-03-10T13:43:01.062287+0000 mon.a (mon.0) 412 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:43:01.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:01 gibba015 bash[13005]: audit 2021-03-10T13:43:01.052620+0000 mon.a (mon.0) 410 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.048983\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049297\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049471\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049629\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049779\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049929\", \"created\": \"2021-03-10T13:43:00.493564\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}}, \"last_daemon_update\": \"2021-03-10T13:43:01.050200\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:43:01.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:01 gibba015 bash[13005]: audit 2021-03-10T13:43:01.061463+0000 mon.a (mon.0) 411 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.048983\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049297\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049471\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049629\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049779\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049929\", \"created\": \"2021-03-10T13:43:00.493564\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}}, \"last_daemon_update\": \"2021-03-10T13:43:01.050200\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:43:01.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:01 gibba015 bash[13005]: audit 2021-03-10T13:43:01.062287+0000 mon.a (mon.0) 412 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:43:01.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:01 gibba045 bash[9787]: audit 2021-03-10T13:43:00.511230+0000 mon.a (mon.0) 407 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.304460\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.304729\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.304903\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.305101\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.305265\", \"created\": \"2021-03-10T13:42:38.781564\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}}, \"last_device_update\": \"2021-03-10T13:42:46.284408\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:43:01.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:01 gibba045 bash[9787]: audit 2021-03-10T13:43:00.512790+0000 mon.a (mon.0) 408 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:43:01.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:01 gibba045 bash[9787]: audit 2021-03-10T13:43:00.519616+0000 mon.a (mon.0) 409 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.304460\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.304729\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.304903\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.305101\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:42:39.305265\", \"created\": \"2021-03-10T13:42:38.781564\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}}, \"last_device_update\": \"2021-03-10T13:42:46.284408\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:43:01.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:01 gibba045 bash[9787]: audit 2021-03-10T13:43:01.052620+0000 mon.a (mon.0) 410 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.048983\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049297\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049471\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049629\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049779\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049929\", \"created\": \"2021-03-10T13:43:00.493564\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}}, \"last_daemon_update\": \"2021-03-10T13:43:01.050200\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:43:01.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:01 gibba045 bash[9787]: audit 2021-03-10T13:43:01.061463+0000 mon.a (mon.0) 411 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.048983\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049297\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049471\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049629\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049779\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049929\", \"created\": \"2021-03-10T13:43:00.493564\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}}, \"last_daemon_update\": \"2021-03-10T13:43:01.050200\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:43:01.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:01 gibba045 bash[9787]: audit 2021-03-10T13:43:01.062287+0000 mon.a (mon.0) 412 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:43:01.564 DEBUG:teuthology.orchestra.run.gibba045:osd.6> sudo journalctl -f -n 0 -u ceph-e4a642d2-81a5-11eb-9080-001a4aab830c@osd.6.service 2021-03-10T13:43:01.567 INFO:tasks.cephadm:Deploying osd.7 on gibba045 with /dev/vg_nvme/lv_1... 2021-03-10T13:43:01.567 DEBUG:teuthology.orchestra.run.gibba045:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e4a642d2-81a5-11eb-9080-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2021-03-10T13:43:01.668 INFO:journalctl@ceph.osd.6.gibba045.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T13:43:02.366 INFO:journalctl@ceph.osd.6.gibba045.stdout:Mar 10 13:43:02 gibba045 bash[14829]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2021-03-10T13:43:02.366 INFO:journalctl@ceph.osd.6.gibba045.stdout:Mar 10 13:43:02 gibba045 bash[14829]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-6 --no-mon-config 2021-03-10T13:43:02.367 INFO:journalctl@ceph.osd.6.gibba045.stdout:Mar 10 13:43:02 gibba045 bash[14829]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-6/block 2021-03-10T13:43:02.367 INFO:journalctl@ceph.osd.6.gibba045.stdout:Mar 10 13:43:02 gibba045 bash[14829]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-6/block 2021-03-10T13:43:02.367 INFO:journalctl@ceph.osd.6.gibba045.stdout:Mar 10 13:43:02 gibba045 bash[14829]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2021-03-10T13:43:02.367 INFO:journalctl@ceph.osd.6.gibba045.stdout:Mar 10 13:43:02 gibba045 bash[14829]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2021-03-10T13:43:02.367 INFO:journalctl@ceph.osd.6.gibba045.stdout:Mar 10 13:43:02 gibba045 bash[14829]: --> ceph-volume lvm activate successful for osd ID: 6 2021-03-10T13:43:03.251 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:03 gibba045 bash[9787]: cluster 2021-03-10T13:43:01.130028+0000 mgr.y (mgr.14140) 136 : cluster [DBG] pgmap v136: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:43:03.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:03 gibba015 bash[9806]: cluster 2021-03-10T13:43:01.130028+0000 mgr.y (mgr.14140) 136 : cluster [DBG] pgmap v136: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:43:03.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:03 gibba015 bash[13005]: cluster 2021-03-10T13:43:01.130028+0000 mgr.y (mgr.14140) 136 : cluster [DBG] pgmap v136: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:43:04.384 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:04 gibba045 bash[9787]: audit 2021-03-10T13:43:03.127817+0000 mon.a (mon.0) 413 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"d2493283-8b4a-4bfa-bc09-88d77b213100\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615383758.8098798, \"finished_at\": 1615383780.5236287}, {\"id\": \"e4d96cc7-4f52-40ca-a7b2-18eec4db3fc0\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615383767.8740945, \"finished_at\": 1615383780.5237308}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2021-03-10T13:43:04.385 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:04 gibba045 bash[9787]: audit 2021-03-10T13:43:03.132517+0000 mon.a (mon.0) 414 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"d2493283-8b4a-4bfa-bc09-88d77b213100\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615383758.8098798, \"finished_at\": 1615383780.5236287}, {\"id\": \"e4d96cc7-4f52-40ca-a7b2-18eec4db3fc0\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615383767.8740945, \"finished_at\": 1615383780.5237308}], \"version\": 2, \"compat_version\": 2}"}]': finished 2021-03-10T13:43:04.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:04 gibba015 bash[9806]: audit 2021-03-10T13:43:03.127817+0000 mon.a (mon.0) 413 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"d2493283-8b4a-4bfa-bc09-88d77b213100\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615383758.8098798, \"finished_at\": 1615383780.5236287}, {\"id\": \"e4d96cc7-4f52-40ca-a7b2-18eec4db3fc0\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615383767.8740945, \"finished_at\": 1615383780.5237308}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2021-03-10T13:43:04.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:04 gibba015 bash[9806]: audit 2021-03-10T13:43:03.132517+0000 mon.a (mon.0) 414 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"d2493283-8b4a-4bfa-bc09-88d77b213100\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615383758.8098798, \"finished_at\": 1615383780.5236287}, {\"id\": \"e4d96cc7-4f52-40ca-a7b2-18eec4db3fc0\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615383767.8740945, \"finished_at\": 1615383780.5237308}], \"version\": 2, \"compat_version\": 2}"}]': finished 2021-03-10T13:43:04.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:04 gibba015 bash[13005]: audit 2021-03-10T13:43:03.127817+0000 mon.a (mon.0) 413 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"d2493283-8b4a-4bfa-bc09-88d77b213100\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615383758.8098798, \"finished_at\": 1615383780.5236287}, {\"id\": \"e4d96cc7-4f52-40ca-a7b2-18eec4db3fc0\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615383767.8740945, \"finished_at\": 1615383780.5237308}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2021-03-10T13:43:04.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:04 gibba015 bash[13005]: audit 2021-03-10T13:43:03.132517+0000 mon.a (mon.0) 414 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"d2493283-8b4a-4bfa-bc09-88d77b213100\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615383758.8098798, \"finished_at\": 1615383780.5236287}, {\"id\": \"e4d96cc7-4f52-40ca-a7b2-18eec4db3fc0\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615383767.8740945, \"finished_at\": 1615383780.5237308}], \"version\": 2, \"compat_version\": 2}"}]': finished 2021-03-10T13:43:05.404 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:05 gibba045 bash[9787]: cluster 2021-03-10T13:43:03.130456+0000 mgr.y (mgr.14140) 137 : cluster [DBG] pgmap v137: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:43:05.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:05 gibba015 bash[9806]: cluster 2021-03-10T13:43:03.130456+0000 mgr.y (mgr.14140) 137 : cluster [DBG] pgmap v137: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:43:05.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:05 gibba015 bash[13005]: cluster 2021-03-10T13:43:03.130456+0000 mgr.y (mgr.14140) 137 : cluster [DBG] pgmap v137: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:43:06.257 INFO:journalctl@ceph.osd.6.gibba045.stdout:Mar 10 13:43:06 gibba045 bash[15178]: debug 2021-03-10T13:43:06.009+0000 7f8a39cffec0 -1 Falling back to public interface 2021-03-10T13:43:06.743 INFO:teuthology.orchestra.run.gibba045.stderr:--> Zapping: /dev/vg_nvme/lv_1 2021-03-10T13:43:06.744 INFO:teuthology.orchestra.run.gibba045.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2021-03-10T13:43:06.744 INFO:teuthology.orchestra.run.gibba045.stderr: stderr: 10+0 records in 2021-03-10T13:43:06.744 INFO:teuthology.orchestra.run.gibba045.stderr:10+0 records out 2021-03-10T13:43:06.744 INFO:teuthology.orchestra.run.gibba045.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00877575 s, 1.2 GB/s 2021-03-10T13:43:06.745 INFO:teuthology.orchestra.run.gibba045.stderr:--> Zapping successful for: 2021-03-10T13:43:07.058 INFO:journalctl@ceph.osd.6.gibba045.stdout:Mar 10 13:43:06 gibba045 bash[15178]: debug 2021-03-10T13:43:06.721+0000 7f8a39cffec0 -1 osd.6 0 log_to_monitors {default=true} 2021-03-10T13:43:07.232 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:07 gibba045 bash[9787]: cluster 2021-03-10T13:43:05.131121+0000 mgr.y (mgr.14140) 138 : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:43:07.233 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:07 gibba045 bash[9787]: audit 2021-03-10T13:43:06.729470+0000 mon.b (mon.2) 16 : audit [INF] from='osd.6 [v2:172.21.2.145:6816/2136431237,v1:172.21.2.145:6817/2136431237]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-03-10T13:43:07.233 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:07 gibba045 bash[9787]: audit 2021-03-10T13:43:06.731411+0000 mon.a (mon.0) 415 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-03-10T13:43:07.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:07 gibba015 bash[9806]: cluster 2021-03-10T13:43:05.131121+0000 mgr.y (mgr.14140) 138 : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:43:07.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:07 gibba015 bash[9806]: audit 2021-03-10T13:43:06.729470+0000 mon.b (mon.2) 16 : audit [INF] from='osd.6 [v2:172.21.2.145:6816/2136431237,v1:172.21.2.145:6817/2136431237]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-03-10T13:43:07.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:07 gibba015 bash[9806]: audit 2021-03-10T13:43:06.731411+0000 mon.a (mon.0) 415 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-03-10T13:43:07.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:07 gibba015 bash[13005]: cluster 2021-03-10T13:43:05.131121+0000 mgr.y (mgr.14140) 138 : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:43:07.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:07 gibba015 bash[13005]: audit 2021-03-10T13:43:06.729470+0000 mon.b (mon.2) 16 : audit [INF] from='osd.6 [v2:172.21.2.145:6816/2136431237,v1:172.21.2.145:6817/2136431237]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-03-10T13:43:07.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:07 gibba015 bash[13005]: audit 2021-03-10T13:43:06.731411+0000 mon.a (mon.0) 415 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-03-10T13:43:07.547 DEBUG:teuthology.orchestra.run.gibba045:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e4a642d2-81a5-11eb-9080-001a4aab830c -- ceph orch daemon add osd gibba045:vg_nvme/lv_1 2021-03-10T13:43:08.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:08 gibba015 bash[9806]: audit 2021-03-10T13:43:07.094456+0000 mon.a (mon.0) 416 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2021-03-10T13:43:08.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:08 gibba015 bash[9806]: cluster 2021-03-10T13:43:07.094479+0000 mon.a (mon.0) 417 : cluster [DBG] osdmap e40: 7 total, 6 up, 6 in 2021-03-10T13:43:08.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:08 gibba015 bash[9806]: audit 2021-03-10T13:43:07.094570+0000 mon.a (mon.0) 418 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T13:43:08.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:08 gibba015 bash[9806]: audit 2021-03-10T13:43:07.100829+0000 mon.b (mon.2) 17 : audit [INF] from='osd.6 [v2:172.21.2.145:6816/2136431237,v1:172.21.2.145:6817/2136431237]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba045", "root=default"]}]: dispatch 2021-03-10T13:43:08.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:08 gibba015 bash[9806]: audit 2021-03-10T13:43:07.103013+0000 mon.a (mon.0) 419 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba045", "root=default"]}]: dispatch 2021-03-10T13:43:08.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:08 gibba015 bash[9806]: cluster 2021-03-10T13:43:07.712260+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T13:43:08.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:08 gibba015 bash[9806]: cluster 2021-03-10T13:43:07.712377+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T13:43:08.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:08 gibba015 bash[13005]: audit 2021-03-10T13:43:07.094456+0000 mon.a (mon.0) 416 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2021-03-10T13:43:08.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:08 gibba015 bash[13005]: cluster 2021-03-10T13:43:07.094479+0000 mon.a (mon.0) 417 : cluster [DBG] osdmap e40: 7 total, 6 up, 6 in 2021-03-10T13:43:08.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:08 gibba015 bash[13005]: audit 2021-03-10T13:43:07.094570+0000 mon.a (mon.0) 418 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T13:43:08.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:08 gibba015 bash[13005]: audit 2021-03-10T13:43:07.100829+0000 mon.b (mon.2) 17 : audit [INF] from='osd.6 [v2:172.21.2.145:6816/2136431237,v1:172.21.2.145:6817/2136431237]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba045", "root=default"]}]: dispatch 2021-03-10T13:43:08.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:08 gibba015 bash[13005]: audit 2021-03-10T13:43:07.103013+0000 mon.a (mon.0) 419 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba045", "root=default"]}]: dispatch 2021-03-10T13:43:08.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:08 gibba015 bash[13005]: cluster 2021-03-10T13:43:07.712260+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T13:43:08.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:08 gibba015 bash[13005]: cluster 2021-03-10T13:43:07.712377+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T13:43:08.492 INFO:journalctl@ceph.osd.6.gibba045.stdout:Mar 10 13:43:08 gibba045 bash[15178]: debug 2021-03-10T13:43:08.105+0000 7f8a1eaac700 -1 osd.6 0 waiting for initial osdmap 2021-03-10T13:43:08.493 INFO:journalctl@ceph.osd.6.gibba045.stdout:Mar 10 13:43:08 gibba045 bash[15178]: debug 2021-03-10T13:43:08.109+0000 7f8a29cc8700 -1 osd.6 41 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T13:43:08.493 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:08 gibba045 bash[9787]: audit 2021-03-10T13:43:07.094456+0000 mon.a (mon.0) 416 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2021-03-10T13:43:08.493 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:08 gibba045 bash[9787]: cluster 2021-03-10T13:43:07.094479+0000 mon.a (mon.0) 417 : cluster [DBG] osdmap e40: 7 total, 6 up, 6 in 2021-03-10T13:43:08.493 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:08 gibba045 bash[9787]: audit 2021-03-10T13:43:07.094570+0000 mon.a (mon.0) 418 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T13:43:08.494 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:08 gibba045 bash[9787]: audit 2021-03-10T13:43:07.100829+0000 mon.b (mon.2) 17 : audit [INF] from='osd.6 [v2:172.21.2.145:6816/2136431237,v1:172.21.2.145:6817/2136431237]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba045", "root=default"]}]: dispatch 2021-03-10T13:43:08.494 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:08 gibba045 bash[9787]: audit 2021-03-10T13:43:07.103013+0000 mon.a (mon.0) 419 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba045", "root=default"]}]: dispatch 2021-03-10T13:43:08.494 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:08 gibba045 bash[9787]: cluster 2021-03-10T13:43:07.712260+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T13:43:08.494 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:08 gibba045 bash[9787]: cluster 2021-03-10T13:43:07.712377+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T13:43:09.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:09 gibba015 bash[9806]: cluster 2021-03-10T13:43:07.131608+0000 mgr.y (mgr.14140) 139 : cluster [DBG] pgmap v140: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:43:09.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:09 gibba015 bash[9806]: audit 2021-03-10T13:43:08.104875+0000 mon.a (mon.0) 420 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba045", "root=default"]}]': finished 2021-03-10T13:43:09.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:09 gibba015 bash[9806]: cluster 2021-03-10T13:43:08.104927+0000 mon.a (mon.0) 421 : cluster [DBG] osdmap e41: 7 total, 6 up, 6 in 2021-03-10T13:43:09.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:09 gibba015 bash[9806]: audit 2021-03-10T13:43:08.105671+0000 mon.a (mon.0) 422 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T13:43:09.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:09 gibba015 bash[9806]: audit 2021-03-10T13:43:08.182019+0000 mon.a (mon.0) 423 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:43:09.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:09 gibba015 bash[13005]: cluster 2021-03-10T13:43:07.131608+0000 mgr.y (mgr.14140) 139 : cluster [DBG] pgmap v140: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:43:09.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:09 gibba015 bash[13005]: audit 2021-03-10T13:43:08.104875+0000 mon.a (mon.0) 420 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba045", "root=default"]}]': finished 2021-03-10T13:43:09.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:09 gibba015 bash[13005]: cluster 2021-03-10T13:43:08.104927+0000 mon.a (mon.0) 421 : cluster [DBG] osdmap e41: 7 total, 6 up, 6 in 2021-03-10T13:43:09.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:09 gibba015 bash[13005]: audit 2021-03-10T13:43:08.105671+0000 mon.a (mon.0) 422 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T13:43:09.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:09 gibba015 bash[13005]: audit 2021-03-10T13:43:08.182019+0000 mon.a (mon.0) 423 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:43:09.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:09 gibba015 bash[9806]: audit 2021-03-10T13:43:08.306541+0000 mon.a (mon.0) 424 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.048983\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049297\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049471\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049629\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049779\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049929\", \"created\": \"2021-03-10T13:43:00.493564\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}}, \"last_daemon_update\": \"2021-03-10T13:43:01.050200\", \"last_device_update\": \"2021-03-10T13:43:08.304072\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:43:09.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:09 gibba015 bash[9806]: audit 2021-03-10T13:43:08.315463+0000 mon.a (mon.0) 425 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.048983\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049297\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049471\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049629\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049779\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049929\", \"created\": \"2021-03-10T13:43:00.493564\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}}, \"last_daemon_update\": \"2021-03-10T13:43:01.050200\", \"last_device_update\": \"2021-03-10T13:43:08.304072\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:43:09.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:09 gibba015 bash[9806]: cluster 2021-03-10T13:43:09.109720+0000 mon.a (mon.0) 426 : cluster [INF] osd.6 [v2:172.21.2.145:6816/2136431237,v1:172.21.2.145:6817/2136431237] boot 2021-03-10T13:43:09.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:09 gibba015 bash[13005]: audit 2021-03-10T13:43:08.306541+0000 mon.a (mon.0) 424 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.048983\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049297\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049471\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049629\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049779\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049929\", \"created\": \"2021-03-10T13:43:00.493564\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}}, \"last_daemon_update\": \"2021-03-10T13:43:01.050200\", \"last_device_update\": \"2021-03-10T13:43:08.304072\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:43:09.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:09 gibba015 bash[13005]: audit 2021-03-10T13:43:08.315463+0000 mon.a (mon.0) 425 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.048983\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049297\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049471\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049629\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049779\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049929\", \"created\": \"2021-03-10T13:43:00.493564\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}}, \"last_daemon_update\": \"2021-03-10T13:43:01.050200\", \"last_device_update\": \"2021-03-10T13:43:08.304072\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:43:09.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:09 gibba015 bash[13005]: cluster 2021-03-10T13:43:09.109720+0000 mon.a (mon.0) 426 : cluster [INF] osd.6 [v2:172.21.2.145:6816/2136431237,v1:172.21.2.145:6817/2136431237] boot 2021-03-10T13:43:09.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:09 gibba045 bash[9787]: cluster 2021-03-10T13:43:07.131608+0000 mgr.y (mgr.14140) 139 : cluster [DBG] pgmap v140: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:43:09.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:09 gibba045 bash[9787]: audit 2021-03-10T13:43:08.104875+0000 mon.a (mon.0) 420 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba045", "root=default"]}]': finished 2021-03-10T13:43:09.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:09 gibba045 bash[9787]: cluster 2021-03-10T13:43:08.104927+0000 mon.a (mon.0) 421 : cluster [DBG] osdmap e41: 7 total, 6 up, 6 in 2021-03-10T13:43:09.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:09 gibba045 bash[9787]: audit 2021-03-10T13:43:08.105671+0000 mon.a (mon.0) 422 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T13:43:09.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:09 gibba045 bash[9787]: audit 2021-03-10T13:43:08.182019+0000 mon.a (mon.0) 423 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:43:09.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:09 gibba045 bash[9787]: audit 2021-03-10T13:43:08.306541+0000 mon.a (mon.0) 424 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.048983\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049297\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049471\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049629\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049779\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049929\", \"created\": \"2021-03-10T13:43:00.493564\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}}, \"last_daemon_update\": \"2021-03-10T13:43:01.050200\", \"last_device_update\": \"2021-03-10T13:43:08.304072\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:43:09.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:09 gibba045 bash[9787]: audit 2021-03-10T13:43:08.315463+0000 mon.a (mon.0) 425 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.048983\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049297\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049471\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049629\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049779\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049929\", \"created\": \"2021-03-10T13:43:00.493564\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}}, \"last_daemon_update\": \"2021-03-10T13:43:01.050200\", \"last_device_update\": \"2021-03-10T13:43:08.304072\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:43:09.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:09 gibba045 bash[9787]: cluster 2021-03-10T13:43:09.109720+0000 mon.a (mon.0) 426 : cluster [INF] osd.6 [v2:172.21.2.145:6816/2136431237,v1:172.21.2.145:6817/2136431237] boot 2021-03-10T13:43:10.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:10 gibba045 bash[9787]: cluster 2021-03-10T13:43:09.109783+0000 mon.a (mon.0) 427 : cluster [DBG] osdmap e42: 7 total, 7 up, 7 in 2021-03-10T13:43:10.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:10 gibba045 bash[9787]: audit 2021-03-10T13:43:09.109983+0000 mon.a (mon.0) 428 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T13:43:10.308 INFO:journalctl@ceph.osd.5.gibba045.stdout:Mar 10 13:43:10 gibba045 bash[13761]: debug 2021-03-10T13:43:10.121+0000 7fc39f5e4700 -1 osd.5 43 build_incremental_map_msg missing incremental map 43 2021-03-10T13:43:10.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:10 gibba015 bash[9806]: cluster 2021-03-10T13:43:09.109783+0000 mon.a (mon.0) 427 : cluster [DBG] osdmap e42: 7 total, 7 up, 7 in 2021-03-10T13:43:10.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:10 gibba015 bash[9806]: audit 2021-03-10T13:43:09.109983+0000 mon.a (mon.0) 428 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T13:43:10.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:10 gibba015 bash[13005]: cluster 2021-03-10T13:43:09.109783+0000 mon.a (mon.0) 427 : cluster [DBG] osdmap e42: 7 total, 7 up, 7 in 2021-03-10T13:43:10.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:10 gibba015 bash[13005]: audit 2021-03-10T13:43:09.109983+0000 mon.a (mon.0) 428 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T13:43:10.473 INFO:journalctl@ceph.osd.1.gibba015.stdout:Mar 10 13:43:10 gibba015 bash[16403]: debug 2021-03-10T13:43:10.124+0000 7f1d46c9e700 -1 osd.1 43 build_incremental_map_msg missing incremental map 43 2021-03-10T13:43:10.808 INFO:journalctl@ceph.osd.5.gibba045.stdout:Mar 10 13:43:10 gibba045 bash[13761]: debug 2021-03-10T13:43:10.549+0000 7fc3bbe8d700 -1 osd.5 43 build_incremental_map_msg missing incremental map 43 2021-03-10T13:43:10.971 INFO:journalctl@ceph.osd.1.gibba015.stdout:Mar 10 13:43:10 gibba015 bash[16403]: debug 2021-03-10T13:43:10.552+0000 7f1d6654d700 -1 osd.1 43 build_incremental_map_msg missing incremental map 43 2021-03-10T13:43:11.389 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:11 gibba045 bash[9787]: cluster 2021-03-10T13:43:09.131853+0000 mgr.y (mgr.14140) 140 : cluster [DBG] pgmap v143: 1 pgs: 1 active+clean; 0 B data, 2.4 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:43:11.389 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:11 gibba045 bash[9787]: cluster 2021-03-10T13:43:10.125446+0000 mon.a (mon.0) 429 : cluster [DBG] osdmap e43: 7 total, 7 up, 7 in 2021-03-10T13:43:11.389 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:11 gibba045 bash[9787]: audit 2021-03-10T13:43:10.240542+0000 mgr.y (mgr.14140) 141 : audit [DBG] from='client.34208 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba045:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:43:11.390 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:11 gibba045 bash[9787]: cephadm 2021-03-10T13:43:10.242596+0000 mgr.y (mgr.14140) 142 : cephadm [INF] Applying osd on host gibba045... 2021-03-10T13:43:11.390 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:11 gibba045 bash[9787]: audit 2021-03-10T13:43:10.243427+0000 mon.a (mon.0) 430 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T13:43:11.390 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:11 gibba045 bash[9787]: audit 2021-03-10T13:43:10.246494+0000 mon.a (mon.0) 431 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:43:11.390 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:11 gibba045 bash[9787]: audit 2021-03-10T13:43:10.250964+0000 mon.a (mon.0) 432 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:43:11.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:11 gibba015 bash[9806]: cluster 2021-03-10T13:43:09.131853+0000 mgr.y (mgr.14140) 140 : cluster [DBG] pgmap v143: 1 pgs: 1 active+clean; 0 B data, 2.4 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:43:11.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:11 gibba015 bash[9806]: cluster 2021-03-10T13:43:10.125446+0000 mon.a (mon.0) 429 : cluster [DBG] osdmap e43: 7 total, 7 up, 7 in 2021-03-10T13:43:11.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:11 gibba015 bash[9806]: audit 2021-03-10T13:43:10.240542+0000 mgr.y (mgr.14140) 141 : audit [DBG] from='client.34208 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba045:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:43:11.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:11 gibba015 bash[9806]: cephadm 2021-03-10T13:43:10.242596+0000 mgr.y (mgr.14140) 142 : cephadm [INF] Applying osd on host gibba045... 2021-03-10T13:43:11.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:11 gibba015 bash[9806]: audit 2021-03-10T13:43:10.243427+0000 mon.a (mon.0) 430 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T13:43:11.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:11 gibba015 bash[9806]: audit 2021-03-10T13:43:10.246494+0000 mon.a (mon.0) 431 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:43:11.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:11 gibba015 bash[9806]: audit 2021-03-10T13:43:10.250964+0000 mon.a (mon.0) 432 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:43:11.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:11 gibba015 bash[13005]: cluster 2021-03-10T13:43:09.131853+0000 mgr.y (mgr.14140) 140 : cluster [DBG] pgmap v143: 1 pgs: 1 active+clean; 0 B data, 2.4 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:43:11.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:11 gibba015 bash[13005]: cluster 2021-03-10T13:43:10.125446+0000 mon.a (mon.0) 429 : cluster [DBG] osdmap e43: 7 total, 7 up, 7 in 2021-03-10T13:43:11.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:11 gibba015 bash[13005]: audit 2021-03-10T13:43:10.240542+0000 mgr.y (mgr.14140) 141 : audit [DBG] from='client.34208 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba045:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:43:11.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:11 gibba015 bash[13005]: cephadm 2021-03-10T13:43:10.242596+0000 mgr.y (mgr.14140) 142 : cephadm [INF] Applying osd on host gibba045... 2021-03-10T13:43:11.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:11 gibba015 bash[13005]: audit 2021-03-10T13:43:10.243427+0000 mon.a (mon.0) 430 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T13:43:11.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:11 gibba015 bash[13005]: audit 2021-03-10T13:43:10.246494+0000 mon.a (mon.0) 431 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:43:11.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:11 gibba015 bash[13005]: audit 2021-03-10T13:43:10.250964+0000 mon.a (mon.0) 432 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:43:12.451 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:12 gibba045 bash[9787]: cluster 2021-03-10T13:43:11.132364+0000 mgr.y (mgr.14140) 143 : cluster [DBG] pgmap v145: 1 pgs: 1 active+clean; 0 B data, 2.5 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:43:12.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:12 gibba015 bash[9806]: cluster 2021-03-10T13:43:11.132364+0000 mgr.y (mgr.14140) 143 : cluster [DBG] pgmap v145: 1 pgs: 1 active+clean; 0 B data, 2.5 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:43:12.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:12 gibba015 bash[13005]: cluster 2021-03-10T13:43:11.132364+0000 mgr.y (mgr.14140) 143 : cluster [DBG] pgmap v145: 1 pgs: 1 active+clean; 0 B data, 2.5 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:43:13.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:13 gibba015 bash[9806]: audit 2021-03-10T13:43:13.073094+0000 mon.b (mon.2) 18 : audit [INF] from='client.? 172.21.2.145:0/900540372' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d10c3d75-2027-4372-9bcb-24a1c376704e"}]: dispatch 2021-03-10T13:43:13.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:13 gibba015 bash[9806]: audit 2021-03-10T13:43:13.075208+0000 mon.a (mon.0) 433 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d10c3d75-2027-4372-9bcb-24a1c376704e"}]: dispatch 2021-03-10T13:43:13.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:13 gibba015 bash[9806]: audit 2021-03-10T13:43:13.087089+0000 mon.a (mon.0) 434 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d10c3d75-2027-4372-9bcb-24a1c376704e"}]': finished 2021-03-10T13:43:13.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:13 gibba015 bash[9806]: cluster 2021-03-10T13:43:13.087131+0000 mon.a (mon.0) 435 : cluster [DBG] osdmap e44: 8 total, 7 up, 7 in 2021-03-10T13:43:13.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:13 gibba015 bash[9806]: audit 2021-03-10T13:43:13.087252+0000 mon.a (mon.0) 436 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T13:43:13.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:13 gibba015 bash[13005]: audit 2021-03-10T13:43:13.073094+0000 mon.b (mon.2) 18 : audit [INF] from='client.? 172.21.2.145:0/900540372' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d10c3d75-2027-4372-9bcb-24a1c376704e"}]: dispatch 2021-03-10T13:43:13.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:13 gibba015 bash[13005]: audit 2021-03-10T13:43:13.075208+0000 mon.a (mon.0) 433 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d10c3d75-2027-4372-9bcb-24a1c376704e"}]: dispatch 2021-03-10T13:43:13.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:13 gibba015 bash[13005]: audit 2021-03-10T13:43:13.087089+0000 mon.a (mon.0) 434 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d10c3d75-2027-4372-9bcb-24a1c376704e"}]': finished 2021-03-10T13:43:13.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:13 gibba015 bash[13005]: cluster 2021-03-10T13:43:13.087131+0000 mon.a (mon.0) 435 : cluster [DBG] osdmap e44: 8 total, 7 up, 7 in 2021-03-10T13:43:13.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:13 gibba015 bash[13005]: audit 2021-03-10T13:43:13.087252+0000 mon.a (mon.0) 436 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T13:43:13.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:13 gibba045 bash[9787]: audit 2021-03-10T13:43:13.073094+0000 mon.b (mon.2) 18 : audit [INF] from='client.? 172.21.2.145:0/900540372' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d10c3d75-2027-4372-9bcb-24a1c376704e"}]: dispatch 2021-03-10T13:43:13.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:13 gibba045 bash[9787]: audit 2021-03-10T13:43:13.075208+0000 mon.a (mon.0) 433 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d10c3d75-2027-4372-9bcb-24a1c376704e"}]: dispatch 2021-03-10T13:43:13.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:13 gibba045 bash[9787]: audit 2021-03-10T13:43:13.087089+0000 mon.a (mon.0) 434 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d10c3d75-2027-4372-9bcb-24a1c376704e"}]': finished 2021-03-10T13:43:13.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:13 gibba045 bash[9787]: cluster 2021-03-10T13:43:13.087131+0000 mon.a (mon.0) 435 : cluster [DBG] osdmap e44: 8 total, 7 up, 7 in 2021-03-10T13:43:13.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:13 gibba045 bash[9787]: audit 2021-03-10T13:43:13.087252+0000 mon.a (mon.0) 436 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T13:43:15.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:15 gibba015 bash[9806]: cluster 2021-03-10T13:43:13.132973+0000 mgr.y (mgr.14140) 144 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 0 B data, 2.6 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:43:15.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:15 gibba015 bash[13005]: cluster 2021-03-10T13:43:13.132973+0000 mgr.y (mgr.14140) 144 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 0 B data, 2.6 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:43:15.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:15 gibba045 bash[9787]: cluster 2021-03-10T13:43:13.132973+0000 mgr.y (mgr.14140) 144 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 0 B data, 2.6 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:43:16.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:16 gibba015 bash[9806]: audit 2021-03-10T13:43:15.123942+0000 mon.b (mon.2) 19 : audit [DBG] from='client.? 172.21.2.145:0/187459991' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T13:43:16.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:16 gibba015 bash[13005]: audit 2021-03-10T13:43:15.123942+0000 mon.b (mon.2) 19 : audit [DBG] from='client.? 172.21.2.145:0/187459991' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T13:43:16.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:16 gibba045 bash[9787]: audit 2021-03-10T13:43:15.123942+0000 mon.b (mon.2) 19 : audit [DBG] from='client.? 172.21.2.145:0/187459991' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T13:43:17.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:17 gibba015 bash[9806]: cluster 2021-03-10T13:43:15.133745+0000 mgr.y (mgr.14140) 145 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 0 B data, 2.7 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:43:17.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:17 gibba015 bash[13005]: cluster 2021-03-10T13:43:15.133745+0000 mgr.y (mgr.14140) 145 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 0 B data, 2.7 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:43:17.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:17 gibba045 bash[9787]: cluster 2021-03-10T13:43:15.133745+0000 mgr.y (mgr.14140) 145 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 0 B data, 2.7 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:43:18.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:18 gibba015 bash[9806]: cluster 2021-03-10T13:43:17.134188+0000 mgr.y (mgr.14140) 146 : cluster [DBG] pgmap v149: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:43:18.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:18 gibba015 bash[9806]: audit 2021-03-10T13:43:17.698482+0000 mon.a (mon.0) 437 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:43:18.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:18 gibba015 bash[13005]: cluster 2021-03-10T13:43:17.134188+0000 mgr.y (mgr.14140) 146 : cluster [DBG] pgmap v149: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:43:18.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:18 gibba015 bash[13005]: audit 2021-03-10T13:43:17.698482+0000 mon.a (mon.0) 437 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:43:18.501 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:18 gibba045 bash[9787]: cluster 2021-03-10T13:43:17.134188+0000 mgr.y (mgr.14140) 146 : cluster [DBG] pgmap v149: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:43:18.502 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:18 gibba045 bash[9787]: audit 2021-03-10T13:43:17.698482+0000 mon.a (mon.0) 437 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:43:20.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:20 gibba015 bash[9806]: cluster 2021-03-10T13:43:19.135105+0000 mgr.y (mgr.14140) 147 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:43:20.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:20 gibba015 bash[13005]: cluster 2021-03-10T13:43:19.135105+0000 mgr.y (mgr.14140) 147 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:43:20.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:20 gibba045 bash[9787]: cluster 2021-03-10T13:43:19.135105+0000 mgr.y (mgr.14140) 147 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:43:21.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:21 gibba015 bash[9806]: audit 2021-03-10T13:43:21.081660+0000 mon.a (mon.0) 438 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2021-03-10T13:43:21.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:21 gibba015 bash[9806]: audit 2021-03-10T13:43:21.084546+0000 mon.a (mon.0) 439 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:43:21.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:21 gibba015 bash[9806]: cephadm 2021-03-10T13:43:21.086845+0000 mgr.y (mgr.14140) 148 : cephadm [INF] Deploying daemon osd.7 on gibba045 2021-03-10T13:43:21.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:21 gibba015 bash[9806]: audit 2021-03-10T13:43:21.087774+0000 mon.a (mon.0) 440 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.7", "key": "container_image"}]: dispatch 2021-03-10T13:43:21.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:21 gibba015 bash[13005]: audit 2021-03-10T13:43:21.081660+0000 mon.a (mon.0) 438 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2021-03-10T13:43:21.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:21 gibba015 bash[13005]: audit 2021-03-10T13:43:21.084546+0000 mon.a (mon.0) 439 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:43:21.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:21 gibba015 bash[13005]: cephadm 2021-03-10T13:43:21.086845+0000 mgr.y (mgr.14140) 148 : cephadm [INF] Deploying daemon osd.7 on gibba045 2021-03-10T13:43:21.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:21 gibba015 bash[13005]: audit 2021-03-10T13:43:21.087774+0000 mon.a (mon.0) 440 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.7", "key": "container_image"}]: dispatch 2021-03-10T13:43:21.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:21 gibba045 bash[9787]: audit 2021-03-10T13:43:21.081660+0000 mon.a (mon.0) 438 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2021-03-10T13:43:21.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:21 gibba045 bash[9787]: audit 2021-03-10T13:43:21.084546+0000 mon.a (mon.0) 439 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:43:21.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:21 gibba045 bash[9787]: cephadm 2021-03-10T13:43:21.086845+0000 mgr.y (mgr.14140) 148 : cephadm [INF] Deploying daemon osd.7 on gibba045 2021-03-10T13:43:21.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:21 gibba045 bash[9787]: audit 2021-03-10T13:43:21.087774+0000 mon.a (mon.0) 440 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.7", "key": "container_image"}]: dispatch 2021-03-10T13:43:22.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:22 gibba015 bash[9806]: cluster 2021-03-10T13:43:21.135682+0000 mgr.y (mgr.14140) 149 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:43:22.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:22 gibba015 bash[13005]: cluster 2021-03-10T13:43:21.135682+0000 mgr.y (mgr.14140) 149 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:43:22.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:22 gibba045 bash[9787]: cluster 2021-03-10T13:43:21.135682+0000 mgr.y (mgr.14140) 149 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:43:22.926 INFO:teuthology.orchestra.run.gibba045.stdout:Created osd(s) 7 on host 'gibba045' 2021-03-10T13:43:23.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:23 gibba015 bash[9806]: audit 2021-03-10T13:43:22.915663+0000 mon.a (mon.0) 441 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.048983\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049297\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049471\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049629\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049779\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049929\", \"created\": \"2021-03-10T13:43:00.493564\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}}, \"last_device_update\": \"2021-03-10T13:43:08.304072\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:43:23.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:23 gibba015 bash[9806]: audit 2021-03-10T13:43:22.917313+0000 mon.a (mon.0) 442 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:43:23.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:23 gibba015 bash[9806]: audit 2021-03-10T13:43:22.924082+0000 mon.a (mon.0) 443 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.048983\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049297\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049471\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049629\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049779\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049929\", \"created\": \"2021-03-10T13:43:00.493564\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}}, \"last_device_update\": \"2021-03-10T13:43:08.304072\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:43:23.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:23 gibba015 bash[9806]: audit 2021-03-10T13:43:23.134075+0000 mon.a (mon.0) 444 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"d2493283-8b4a-4bfa-bc09-88d77b213100\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615383758.8098798, \"finished_at\": 1615383780.5236287}, {\"id\": \"e4d96cc7-4f52-40ca-a7b2-18eec4db3fc0\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615383767.8740945, \"finished_at\": 1615383780.5237308}, {\"id\": \"fa1274cb-9a6e-44af-8201-c2a710ca1e2d\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1615383789.1095817, \"finished_at\": 1615383802.9271262}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2021-03-10T13:43:23.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:23 gibba015 bash[9806]: audit 2021-03-10T13:43:23.137631+0000 mon.a (mon.0) 445 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"d2493283-8b4a-4bfa-bc09-88d77b213100\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615383758.8098798, \"finished_at\": 1615383780.5236287}, {\"id\": \"e4d96cc7-4f52-40ca-a7b2-18eec4db3fc0\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615383767.8740945, \"finished_at\": 1615383780.5237308}, {\"id\": \"fa1274cb-9a6e-44af-8201-c2a710ca1e2d\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1615383789.1095817, \"finished_at\": 1615383802.9271262}], \"version\": 2, \"compat_version\": 2}"}]': finished 2021-03-10T13:43:23.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:23 gibba015 bash[13005]: audit 2021-03-10T13:43:22.915663+0000 mon.a (mon.0) 441 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.048983\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049297\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049471\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049629\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049779\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049929\", \"created\": \"2021-03-10T13:43:00.493564\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}}, \"last_device_update\": \"2021-03-10T13:43:08.304072\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:43:23.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:23 gibba015 bash[13005]: audit 2021-03-10T13:43:22.917313+0000 mon.a (mon.0) 442 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:43:23.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:23 gibba015 bash[13005]: audit 2021-03-10T13:43:22.924082+0000 mon.a (mon.0) 443 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.048983\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049297\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049471\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049629\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049779\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049929\", \"created\": \"2021-03-10T13:43:00.493564\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}}, \"last_device_update\": \"2021-03-10T13:43:08.304072\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:43:23.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:23 gibba015 bash[13005]: audit 2021-03-10T13:43:23.134075+0000 mon.a (mon.0) 444 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"d2493283-8b4a-4bfa-bc09-88d77b213100\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615383758.8098798, \"finished_at\": 1615383780.5236287}, {\"id\": \"e4d96cc7-4f52-40ca-a7b2-18eec4db3fc0\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615383767.8740945, \"finished_at\": 1615383780.5237308}, {\"id\": \"fa1274cb-9a6e-44af-8201-c2a710ca1e2d\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1615383789.1095817, \"finished_at\": 1615383802.9271262}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2021-03-10T13:43:23.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:23 gibba015 bash[13005]: audit 2021-03-10T13:43:23.137631+0000 mon.a (mon.0) 445 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"d2493283-8b4a-4bfa-bc09-88d77b213100\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615383758.8098798, \"finished_at\": 1615383780.5236287}, {\"id\": \"e4d96cc7-4f52-40ca-a7b2-18eec4db3fc0\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615383767.8740945, \"finished_at\": 1615383780.5237308}, {\"id\": \"fa1274cb-9a6e-44af-8201-c2a710ca1e2d\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1615383789.1095817, \"finished_at\": 1615383802.9271262}], \"version\": 2, \"compat_version\": 2}"}]': finished 2021-03-10T13:43:23.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:23 gibba045 bash[9787]: audit 2021-03-10T13:43:22.915663+0000 mon.a (mon.0) 441 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.048983\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049297\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049471\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049629\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049779\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049929\", \"created\": \"2021-03-10T13:43:00.493564\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}}, \"last_device_update\": \"2021-03-10T13:43:08.304072\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:43:23.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:23 gibba045 bash[9787]: audit 2021-03-10T13:43:22.917313+0000 mon.a (mon.0) 442 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:43:23.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:23 gibba045 bash[9787]: audit 2021-03-10T13:43:22.924082+0000 mon.a (mon.0) 443 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.048983\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049297\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049471\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049629\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049779\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:01.049929\", \"created\": \"2021-03-10T13:43:00.493564\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}}, \"last_device_update\": \"2021-03-10T13:43:08.304072\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:43:23.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:23 gibba045 bash[9787]: audit 2021-03-10T13:43:23.134075+0000 mon.a (mon.0) 444 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"d2493283-8b4a-4bfa-bc09-88d77b213100\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615383758.8098798, \"finished_at\": 1615383780.5236287}, {\"id\": \"e4d96cc7-4f52-40ca-a7b2-18eec4db3fc0\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615383767.8740945, \"finished_at\": 1615383780.5237308}, {\"id\": \"fa1274cb-9a6e-44af-8201-c2a710ca1e2d\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1615383789.1095817, \"finished_at\": 1615383802.9271262}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2021-03-10T13:43:23.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:23 gibba045 bash[9787]: audit 2021-03-10T13:43:23.137631+0000 mon.a (mon.0) 445 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"d2493283-8b4a-4bfa-bc09-88d77b213100\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615383758.8098798, \"finished_at\": 1615383780.5236287}, {\"id\": \"e4d96cc7-4f52-40ca-a7b2-18eec4db3fc0\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615383767.8740945, \"finished_at\": 1615383780.5237308}, {\"id\": \"fa1274cb-9a6e-44af-8201-c2a710ca1e2d\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1615383789.1095817, \"finished_at\": 1615383802.9271262}], \"version\": 2, \"compat_version\": 2}"}]': finished 2021-03-10T13:43:23.982 DEBUG:teuthology.orchestra.run.gibba045:osd.7> sudo journalctl -f -n 0 -u ceph-e4a642d2-81a5-11eb-9080-001a4aab830c@osd.7.service 2021-03-10T13:43:23.985 INFO:tasks.cephadm:Adding prometheus.a on gibba045 2021-03-10T13:43:23.985 DEBUG:teuthology.orchestra.run.gibba045:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e4a642d2-81a5-11eb-9080-001a4aab830c -- ceph orch apply prometheus '1;gibba045=a' 2021-03-10T13:43:24.072 INFO:journalctl@ceph.osd.7.gibba045.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T13:43:24.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:24 gibba045 bash[9787]: cluster 2021-03-10T13:43:23.135993+0000 mgr.y (mgr.14140) 150 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:43:24.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:24 gibba045 bash[9787]: audit 2021-03-10T13:43:23.438906+0000 mon.a (mon.0) 446 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435001\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435266\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435433\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435590\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435741\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435891\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.436039\", \"created\": \"2021-03-10T13:43:22.897564\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}}, \"last_daemon_update\": \"2021-03-10T13:43:23.436301\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:43:24.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:24 gibba045 bash[9787]: audit 2021-03-10T13:43:23.447744+0000 mon.a (mon.0) 447 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435001\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435266\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435433\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435590\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435741\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435891\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.436039\", \"created\": \"2021-03-10T13:43:22.897564\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}}, \"last_daemon_update\": \"2021-03-10T13:43:23.436301\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:43:24.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:24 gibba045 bash[9787]: audit 2021-03-10T13:43:23.448492+0000 mon.a (mon.0) 448 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:43:24.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:24 gibba015 bash[9806]: cluster 2021-03-10T13:43:23.135993+0000 mgr.y (mgr.14140) 150 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:43:24.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:24 gibba015 bash[13005]: cluster 2021-03-10T13:43:23.135993+0000 mgr.y (mgr.14140) 150 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:43:24.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:24 gibba015 bash[9806]: audit 2021-03-10T13:43:23.438906+0000 mon.a (mon.0) 446 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435001\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435266\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435433\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435590\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435741\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435891\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.436039\", \"created\": \"2021-03-10T13:43:22.897564\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}}, \"last_daemon_update\": \"2021-03-10T13:43:23.436301\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:43:24.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:24 gibba015 bash[9806]: audit 2021-03-10T13:43:23.447744+0000 mon.a (mon.0) 447 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435001\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435266\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435433\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435590\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435741\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435891\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.436039\", \"created\": \"2021-03-10T13:43:22.897564\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}}, \"last_daemon_update\": \"2021-03-10T13:43:23.436301\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:43:24.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:24 gibba015 bash[9806]: audit 2021-03-10T13:43:23.448492+0000 mon.a (mon.0) 448 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:43:24.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:24 gibba015 bash[13005]: audit 2021-03-10T13:43:23.438906+0000 mon.a (mon.0) 446 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435001\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435266\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435433\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435590\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435741\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435891\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.436039\", \"created\": \"2021-03-10T13:43:22.897564\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}}, \"last_daemon_update\": \"2021-03-10T13:43:23.436301\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:43:24.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:24 gibba015 bash[13005]: audit 2021-03-10T13:43:23.447744+0000 mon.a (mon.0) 447 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435001\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435266\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435433\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435590\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435741\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435891\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.436039\", \"created\": \"2021-03-10T13:43:22.897564\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}}, \"last_daemon_update\": \"2021-03-10T13:43:23.436301\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:43:24.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:24 gibba015 bash[13005]: audit 2021-03-10T13:43:23.448492+0000 mon.a (mon.0) 448 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:43:25.358 INFO:journalctl@ceph.osd.7.gibba045.stdout:Mar 10 13:43:25 gibba045 bash[16315]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2021-03-10T13:43:25.358 INFO:journalctl@ceph.osd.7.gibba045.stdout:Mar 10 13:43:25 gibba045 bash[16315]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_1 --path /var/lib/ceph/osd/ceph-7 --no-mon-config 2021-03-10T13:43:25.358 INFO:journalctl@ceph.osd.7.gibba045.stdout:Mar 10 13:43:25 gibba045 bash[16315]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-7/block 2021-03-10T13:43:25.359 INFO:journalctl@ceph.osd.7.gibba045.stdout:Mar 10 13:43:25 gibba045 bash[16315]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-7/block 2021-03-10T13:43:25.359 INFO:journalctl@ceph.osd.7.gibba045.stdout:Mar 10 13:43:25 gibba045 bash[16315]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2021-03-10T13:43:25.359 INFO:journalctl@ceph.osd.7.gibba045.stdout:Mar 10 13:43:25 gibba045 bash[16315]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2021-03-10T13:43:25.359 INFO:journalctl@ceph.osd.7.gibba045.stdout:Mar 10 13:43:25 gibba045 bash[16315]: --> ceph-volume lvm activate successful for osd ID: 7 2021-03-10T13:43:26.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:26 gibba045 bash[9787]: cluster 2021-03-10T13:43:25.136888+0000 mgr.y (mgr.14140) 151 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:43:26.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:26 gibba015 bash[9806]: cluster 2021-03-10T13:43:25.136888+0000 mgr.y (mgr.14140) 151 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:43:26.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:26 gibba015 bash[13005]: cluster 2021-03-10T13:43:25.136888+0000 mgr.y (mgr.14140) 151 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:43:28.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:28 gibba045 bash[9787]: cluster 2021-03-10T13:43:27.137423+0000 mgr.y (mgr.14140) 152 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:43:28.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:28 gibba015 bash[9806]: cluster 2021-03-10T13:43:27.137423+0000 mgr.y (mgr.14140) 152 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:43:28.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:28 gibba015 bash[13005]: cluster 2021-03-10T13:43:27.137423+0000 mgr.y (mgr.14140) 152 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:43:28.856 INFO:teuthology.orchestra.run.gibba045.stdout:Scheduled prometheus update... 2021-03-10T13:43:28.931 INFO:journalctl@ceph.osd.7.gibba045.stdout:Mar 10 13:43:28 gibba045 bash[16684]: debug 2021-03-10T13:43:28.769+0000 7f482143fec0 -1 Falling back to public interface 2021-03-10T13:43:29.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:29 gibba045 bash[9787]: audit 2021-03-10T13:43:28.843108+0000 mgr.y (mgr.14140) 153 : audit [DBG] from='client.34232 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;gibba045=a", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:43:29.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:29 gibba045 bash[9787]: cephadm 2021-03-10T13:43:28.844376+0000 mgr.y (mgr.14140) 154 : cephadm [INF] Saving service prometheus spec with placement count:1 gibba045=a 2021-03-10T13:43:29.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:29 gibba045 bash[9787]: audit 2021-03-10T13:43:28.845405+0000 mon.a (mon.0) 449 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.prometheus","val":"{\"created\": \"2021-03-10T13:43:28.844413\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba045\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"prometheus\"}}"}]: dispatch 2021-03-10T13:43:29.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:29 gibba045 bash[9787]: audit 2021-03-10T13:43:28.853929+0000 mon.a (mon.0) 450 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.prometheus","val":"{\"created\": \"2021-03-10T13:43:28.844413\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba045\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"prometheus\"}}"}]': finished 2021-03-10T13:43:29.459 DEBUG:teuthology.orchestra.run.gibba045:prometheus.a> sudo journalctl -f -n 0 -u ceph-e4a642d2-81a5-11eb-9080-001a4aab830c@prometheus.a.service 2021-03-10T13:43:29.462 INFO:tasks.cephadm:Adding node-exporter.a on gibba015 2021-03-10T13:43:29.462 INFO:tasks.cephadm:Adding node-exporter.b on gibba045 2021-03-10T13:43:29.463 DEBUG:teuthology.orchestra.run.gibba045:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e4a642d2-81a5-11eb-9080-001a4aab830c -- ceph orch apply node-exporter '2;gibba015=a;gibba045=b' 2021-03-10T13:43:29.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:29 gibba015 bash[9806]: audit 2021-03-10T13:43:28.843108+0000 mgr.y (mgr.14140) 153 : audit [DBG] from='client.34232 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;gibba045=a", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:43:29.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:29 gibba015 bash[9806]: cephadm 2021-03-10T13:43:28.844376+0000 mgr.y (mgr.14140) 154 : cephadm [INF] Saving service prometheus spec with placement count:1 gibba045=a 2021-03-10T13:43:29.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:29 gibba015 bash[9806]: audit 2021-03-10T13:43:28.845405+0000 mon.a (mon.0) 449 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.prometheus","val":"{\"created\": \"2021-03-10T13:43:28.844413\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba045\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"prometheus\"}}"}]: dispatch 2021-03-10T13:43:29.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:29 gibba015 bash[9806]: audit 2021-03-10T13:43:28.853929+0000 mon.a (mon.0) 450 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.prometheus","val":"{\"created\": \"2021-03-10T13:43:28.844413\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba045\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"prometheus\"}}"}]': finished 2021-03-10T13:43:29.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:29 gibba015 bash[13005]: audit 2021-03-10T13:43:28.843108+0000 mgr.y (mgr.14140) 153 : audit [DBG] from='client.34232 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;gibba045=a", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:43:29.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:29 gibba015 bash[13005]: cephadm 2021-03-10T13:43:28.844376+0000 mgr.y (mgr.14140) 154 : cephadm [INF] Saving service prometheus spec with placement count:1 gibba045=a 2021-03-10T13:43:29.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:29 gibba015 bash[13005]: audit 2021-03-10T13:43:28.845405+0000 mon.a (mon.0) 449 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.prometheus","val":"{\"created\": \"2021-03-10T13:43:28.844413\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba045\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"prometheus\"}}"}]: dispatch 2021-03-10T13:43:29.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:29 gibba015 bash[13005]: audit 2021-03-10T13:43:28.853929+0000 mon.a (mon.0) 450 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.prometheus","val":"{\"created\": \"2021-03-10T13:43:28.844413\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba045\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"prometheus\"}}"}]': finished 2021-03-10T13:43:29.481 INFO:journalctl@ceph.prometheus.a.gibba045.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T13:43:29.808 INFO:journalctl@ceph.osd.7.gibba045.stdout:Mar 10 13:43:29 gibba045 bash[16684]: debug 2021-03-10T13:43:29.461+0000 7f482143fec0 -1 osd.7 0 log_to_monitors {default=true} 2021-03-10T13:43:30.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:30 gibba045 bash[9787]: cluster 2021-03-10T13:43:29.138288+0000 mgr.y (mgr.14140) 155 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:43:30.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:30 gibba045 bash[9787]: audit 2021-03-10T13:43:29.468864+0000 mon.b (mon.2) 20 : audit [INF] from='osd.7 [v2:172.21.2.145:6824/604814097,v1:172.21.2.145:6825/604814097]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-03-10T13:43:30.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:30 gibba045 bash[9787]: audit 2021-03-10T13:43:29.470673+0000 mon.a (mon.0) 451 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-03-10T13:43:30.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:30 gibba015 bash[9806]: cluster 2021-03-10T13:43:29.138288+0000 mgr.y (mgr.14140) 155 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:43:30.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:30 gibba015 bash[9806]: audit 2021-03-10T13:43:29.468864+0000 mon.b (mon.2) 20 : audit [INF] from='osd.7 [v2:172.21.2.145:6824/604814097,v1:172.21.2.145:6825/604814097]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-03-10T13:43:30.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:30 gibba015 bash[9806]: audit 2021-03-10T13:43:29.470673+0000 mon.a (mon.0) 451 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-03-10T13:43:30.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:30 gibba015 bash[13005]: cluster 2021-03-10T13:43:29.138288+0000 mgr.y (mgr.14140) 155 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:43:30.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:30 gibba015 bash[13005]: audit 2021-03-10T13:43:29.468864+0000 mon.b (mon.2) 20 : audit [INF] from='osd.7 [v2:172.21.2.145:6824/604814097,v1:172.21.2.145:6825/604814097]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-03-10T13:43:30.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:30 gibba015 bash[13005]: audit 2021-03-10T13:43:29.470673+0000 mon.a (mon.0) 451 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-03-10T13:43:31.308 INFO:journalctl@ceph.osd.7.gibba045.stdout:Mar 10 13:43:31 gibba045 bash[16684]: debug 2021-03-10T13:43:31.169+0000 7f48061ec700 -1 osd.7 0 waiting for initial osdmap 2021-03-10T13:43:31.308 INFO:journalctl@ceph.osd.7.gibba045.stdout:Mar 10 13:43:31 gibba045 bash[16684]: debug 2021-03-10T13:43:31.177+0000 7f4811408700 -1 osd.7 46 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T13:43:31.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:31 gibba045 bash[9787]: audit 2021-03-10T13:43:30.162615+0000 mon.b (mon.2) 21 : audit [INF] from='osd.7 [v2:172.21.2.145:6824/604814097,v1:172.21.2.145:6825/604814097]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0820, "args": ["host=gibba045", "root=default"]}]: dispatch 2021-03-10T13:43:31.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:31 gibba045 bash[9787]: audit 2021-03-10T13:43:30.162979+0000 mon.a (mon.0) 452 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2021-03-10T13:43:31.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:31 gibba045 bash[9787]: cluster 2021-03-10T13:43:30.163001+0000 mon.a (mon.0) 453 : cluster [DBG] osdmap e45: 8 total, 7 up, 7 in 2021-03-10T13:43:31.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:31 gibba045 bash[9787]: audit 2021-03-10T13:43:30.163069+0000 mon.a (mon.0) 454 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T13:43:31.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:31 gibba045 bash[9787]: audit 2021-03-10T13:43:30.163873+0000 mon.a (mon.0) 455 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0820, "args": ["host=gibba045", "root=default"]}]: dispatch 2021-03-10T13:43:31.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:31 gibba045 bash[9787]: cluster 2021-03-10T13:43:30.440575+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T13:43:31.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:31 gibba045 bash[9787]: cluster 2021-03-10T13:43:30.440676+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T13:43:31.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:31 gibba045 bash[9787]: audit 2021-03-10T13:43:30.585350+0000 mon.a (mon.0) 456 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:43:31.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:31 gibba045 bash[9787]: audit 2021-03-10T13:43:30.695987+0000 mon.a (mon.0) 457 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435001\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435266\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435433\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435590\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435741\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435891\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.436039\", \"created\": \"2021-03-10T13:43:22.897564\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}}, \"last_daemon_update\": \"2021-03-10T13:43:23.436301\", \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:43:31.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:31 gibba045 bash[9787]: audit 2021-03-10T13:43:30.704779+0000 mon.a (mon.0) 458 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435001\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435266\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435433\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435590\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435741\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435891\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.436039\", \"created\": \"2021-03-10T13:43:22.897564\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}}, \"last_daemon_update\": \"2021-03-10T13:43:23.436301\", \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:43:31.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:31 gibba045 bash[9787]: cephadm 2021-03-10T13:43:30.707735+0000 mgr.y (mgr.14140) 156 : cephadm [INF] Deploying daemon prometheus.a on gibba045 2021-03-10T13:43:31.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:31 gibba015 bash[9806]: audit 2021-03-10T13:43:30.162615+0000 mon.b (mon.2) 21 : audit [INF] from='osd.7 [v2:172.21.2.145:6824/604814097,v1:172.21.2.145:6825/604814097]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0820, "args": ["host=gibba045", "root=default"]}]: dispatch 2021-03-10T13:43:31.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:31 gibba015 bash[9806]: audit 2021-03-10T13:43:30.162979+0000 mon.a (mon.0) 452 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2021-03-10T13:43:31.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:31 gibba015 bash[9806]: cluster 2021-03-10T13:43:30.163001+0000 mon.a (mon.0) 453 : cluster [DBG] osdmap e45: 8 total, 7 up, 7 in 2021-03-10T13:43:31.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:31 gibba015 bash[9806]: audit 2021-03-10T13:43:30.163069+0000 mon.a (mon.0) 454 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T13:43:31.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:31 gibba015 bash[9806]: audit 2021-03-10T13:43:30.163873+0000 mon.a (mon.0) 455 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0820, "args": ["host=gibba045", "root=default"]}]: dispatch 2021-03-10T13:43:31.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:31 gibba015 bash[9806]: cluster 2021-03-10T13:43:30.440575+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T13:43:31.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:31 gibba015 bash[9806]: cluster 2021-03-10T13:43:30.440676+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T13:43:31.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:31 gibba015 bash[9806]: audit 2021-03-10T13:43:30.585350+0000 mon.a (mon.0) 456 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:43:31.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:31 gibba015 bash[13005]: audit 2021-03-10T13:43:30.162615+0000 mon.b (mon.2) 21 : audit [INF] from='osd.7 [v2:172.21.2.145:6824/604814097,v1:172.21.2.145:6825/604814097]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0820, "args": ["host=gibba045", "root=default"]}]: dispatch 2021-03-10T13:43:31.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:31 gibba015 bash[13005]: audit 2021-03-10T13:43:30.162979+0000 mon.a (mon.0) 452 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2021-03-10T13:43:31.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:31 gibba015 bash[13005]: cluster 2021-03-10T13:43:30.163001+0000 mon.a (mon.0) 453 : cluster [DBG] osdmap e45: 8 total, 7 up, 7 in 2021-03-10T13:43:31.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:31 gibba015 bash[13005]: audit 2021-03-10T13:43:30.163069+0000 mon.a (mon.0) 454 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T13:43:31.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:31 gibba015 bash[13005]: audit 2021-03-10T13:43:30.163873+0000 mon.a (mon.0) 455 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0820, "args": ["host=gibba045", "root=default"]}]: dispatch 2021-03-10T13:43:31.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:31 gibba015 bash[13005]: cluster 2021-03-10T13:43:30.440575+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T13:43:31.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:31 gibba015 bash[13005]: cluster 2021-03-10T13:43:30.440676+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T13:43:31.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:31 gibba015 bash[13005]: audit 2021-03-10T13:43:30.585350+0000 mon.a (mon.0) 456 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:43:31.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:31 gibba015 bash[9806]: audit 2021-03-10T13:43:30.695987+0000 mon.a (mon.0) 457 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435001\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435266\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435433\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435590\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435741\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435891\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.436039\", \"created\": \"2021-03-10T13:43:22.897564\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}}, \"last_daemon_update\": \"2021-03-10T13:43:23.436301\", \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:43:31.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:31 gibba015 bash[9806]: audit 2021-03-10T13:43:30.704779+0000 mon.a (mon.0) 458 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435001\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435266\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435433\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435590\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435741\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435891\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.436039\", \"created\": \"2021-03-10T13:43:22.897564\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}}, \"last_daemon_update\": \"2021-03-10T13:43:23.436301\", \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:43:31.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:31 gibba015 bash[9806]: cephadm 2021-03-10T13:43:30.707735+0000 mgr.y (mgr.14140) 156 : cephadm [INF] Deploying daemon prometheus.a on gibba045 2021-03-10T13:43:31.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:31 gibba015 bash[13005]: audit 2021-03-10T13:43:30.695987+0000 mon.a (mon.0) 457 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435001\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435266\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435433\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435590\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435741\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435891\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.436039\", \"created\": \"2021-03-10T13:43:22.897564\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}}, \"last_daemon_update\": \"2021-03-10T13:43:23.436301\", \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:43:31.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:31 gibba015 bash[13005]: audit 2021-03-10T13:43:30.704779+0000 mon.a (mon.0) 458 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435001\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435266\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435433\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435590\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435741\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435891\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.436039\", \"created\": \"2021-03-10T13:43:22.897564\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}}, \"last_daemon_update\": \"2021-03-10T13:43:23.436301\", \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:43:31.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:31 gibba015 bash[13005]: cephadm 2021-03-10T13:43:30.707735+0000 mgr.y (mgr.14140) 156 : cephadm [INF] Deploying daemon prometheus.a on gibba045 2021-03-10T13:43:32.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:32 gibba015 bash[9806]: cluster 2021-03-10T13:43:31.139323+0000 mgr.y (mgr.14140) 157 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:43:32.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:32 gibba015 bash[9806]: audit 2021-03-10T13:43:31.171976+0000 mon.a (mon.0) 459 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0820, "args": ["host=gibba045", "root=default"]}]': finished 2021-03-10T13:43:32.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:32 gibba015 bash[9806]: cluster 2021-03-10T13:43:31.172036+0000 mon.a (mon.0) 460 : cluster [DBG] osdmap e46: 8 total, 7 up, 7 in 2021-03-10T13:43:32.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:32 gibba015 bash[9806]: audit 2021-03-10T13:43:31.172849+0000 mon.a (mon.0) 461 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T13:43:32.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:32 gibba015 bash[13005]: cluster 2021-03-10T13:43:31.139323+0000 mgr.y (mgr.14140) 157 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:43:32.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:32 gibba015 bash[13005]: audit 2021-03-10T13:43:31.171976+0000 mon.a (mon.0) 459 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0820, "args": ["host=gibba045", "root=default"]}]': finished 2021-03-10T13:43:32.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:32 gibba015 bash[13005]: cluster 2021-03-10T13:43:31.172036+0000 mon.a (mon.0) 460 : cluster [DBG] osdmap e46: 8 total, 7 up, 7 in 2021-03-10T13:43:32.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:32 gibba015 bash[13005]: audit 2021-03-10T13:43:31.172849+0000 mon.a (mon.0) 461 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T13:43:32.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:32 gibba045 bash[9787]: cluster 2021-03-10T13:43:31.139323+0000 mgr.y (mgr.14140) 157 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:43:32.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:32 gibba045 bash[9787]: audit 2021-03-10T13:43:31.171976+0000 mon.a (mon.0) 459 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0820, "args": ["host=gibba045", "root=default"]}]': finished 2021-03-10T13:43:32.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:32 gibba045 bash[9787]: cluster 2021-03-10T13:43:31.172036+0000 mon.a (mon.0) 460 : cluster [DBG] osdmap e46: 8 total, 7 up, 7 in 2021-03-10T13:43:32.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:32 gibba045 bash[9787]: audit 2021-03-10T13:43:31.172849+0000 mon.a (mon.0) 461 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T13:43:33.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:33 gibba015 bash[9806]: cluster 2021-03-10T13:43:32.189402+0000 mon.a (mon.0) 462 : cluster [INF] osd.7 [v2:172.21.2.145:6824/604814097,v1:172.21.2.145:6825/604814097] boot 2021-03-10T13:43:33.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:33 gibba015 bash[9806]: cluster 2021-03-10T13:43:32.189456+0000 mon.a (mon.0) 463 : cluster [DBG] osdmap e47: 8 total, 8 up, 8 in 2021-03-10T13:43:33.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:33 gibba015 bash[9806]: audit 2021-03-10T13:43:32.189578+0000 mon.a (mon.0) 464 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T13:43:33.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:33 gibba015 bash[13005]: cluster 2021-03-10T13:43:32.189402+0000 mon.a (mon.0) 462 : cluster [INF] osd.7 [v2:172.21.2.145:6824/604814097,v1:172.21.2.145:6825/604814097] boot 2021-03-10T13:43:33.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:33 gibba015 bash[13005]: cluster 2021-03-10T13:43:32.189456+0000 mon.a (mon.0) 463 : cluster [DBG] osdmap e47: 8 total, 8 up, 8 in 2021-03-10T13:43:33.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:33 gibba015 bash[13005]: audit 2021-03-10T13:43:32.189578+0000 mon.a (mon.0) 464 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T13:43:33.518 INFO:teuthology.orchestra.run.gibba045.stdout:Scheduled node-exporter update... 2021-03-10T13:43:33.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:33 gibba045 bash[9787]: cluster 2021-03-10T13:43:32.189402+0000 mon.a (mon.0) 462 : cluster [INF] osd.7 [v2:172.21.2.145:6824/604814097,v1:172.21.2.145:6825/604814097] boot 2021-03-10T13:43:33.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:33 gibba045 bash[9787]: cluster 2021-03-10T13:43:32.189456+0000 mon.a (mon.0) 463 : cluster [DBG] osdmap e47: 8 total, 8 up, 8 in 2021-03-10T13:43:33.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:33 gibba045 bash[9787]: audit 2021-03-10T13:43:32.189578+0000 mon.a (mon.0) 464 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T13:43:33.558 INFO:journalctl@ceph.osd.6.gibba045.stdout:Mar 10 13:43:33 gibba045 bash[15178]: debug 2021-03-10T13:43:33.197+0000 7f8a0fc94700 -1 osd.6 48 build_incremental_map_msg missing incremental map 48 2021-03-10T13:43:34.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:34 gibba015 bash[9806]: cluster 2021-03-10T13:43:33.140122+0000 mgr.y (mgr.14140) 158 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 0 B data, 2.9 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:43:34.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:34 gibba015 bash[9806]: cluster 2021-03-10T13:43:33.201376+0000 mon.a (mon.0) 465 : cluster [DBG] osdmap e48: 8 total, 8 up, 8 in 2021-03-10T13:43:34.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:34 gibba015 bash[9806]: audit 2021-03-10T13:43:33.505247+0000 mgr.y (mgr.14140) 159 : audit [DBG] from='client.34241 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;gibba015=a;gibba045=b", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:43:34.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:34 gibba015 bash[9806]: cephadm 2021-03-10T13:43:33.506625+0000 mgr.y (mgr.14140) 160 : cephadm [INF] Saving service node-exporter spec with placement count:2 gibba015=a,gibba045=b 2021-03-10T13:43:34.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:34 gibba015 bash[9806]: audit 2021-03-10T13:43:33.507642+0000 mon.a (mon.0) 466 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.node-exporter","val":"{\"created\": \"2021-03-10T13:43:33.506660\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"gibba015\", \"name\": \"a\", \"network\": \"\"}, {\"hostname\": \"gibba045\", \"name\": \"b\", \"network\": \"\"}]}, \"service_type\": \"node-exporter\"}}"}]: dispatch 2021-03-10T13:43:34.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:34 gibba015 bash[9806]: audit 2021-03-10T13:43:33.516300+0000 mon.a (mon.0) 467 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.node-exporter","val":"{\"created\": \"2021-03-10T13:43:33.506660\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"gibba015\", \"name\": \"a\", \"network\": \"\"}, {\"hostname\": \"gibba045\", \"name\": \"b\", \"network\": \"\"}]}, \"service_type\": \"node-exporter\"}}"}]': finished 2021-03-10T13:43:34.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:34 gibba015 bash[13005]: cluster 2021-03-10T13:43:33.140122+0000 mgr.y (mgr.14140) 158 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 0 B data, 2.9 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:43:34.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:34 gibba015 bash[13005]: cluster 2021-03-10T13:43:33.201376+0000 mon.a (mon.0) 465 : cluster [DBG] osdmap e48: 8 total, 8 up, 8 in 2021-03-10T13:43:34.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:34 gibba015 bash[13005]: audit 2021-03-10T13:43:33.505247+0000 mgr.y (mgr.14140) 159 : audit [DBG] from='client.34241 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;gibba015=a;gibba045=b", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:43:34.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:34 gibba015 bash[13005]: cephadm 2021-03-10T13:43:33.506625+0000 mgr.y (mgr.14140) 160 : cephadm [INF] Saving service node-exporter spec with placement count:2 gibba015=a,gibba045=b 2021-03-10T13:43:34.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:34 gibba015 bash[13005]: audit 2021-03-10T13:43:33.507642+0000 mon.a (mon.0) 466 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.node-exporter","val":"{\"created\": \"2021-03-10T13:43:33.506660\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"gibba015\", \"name\": \"a\", \"network\": \"\"}, {\"hostname\": \"gibba045\", \"name\": \"b\", \"network\": \"\"}]}, \"service_type\": \"node-exporter\"}}"}]: dispatch 2021-03-10T13:43:34.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:34 gibba015 bash[13005]: audit 2021-03-10T13:43:33.516300+0000 mon.a (mon.0) 467 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.node-exporter","val":"{\"created\": \"2021-03-10T13:43:33.506660\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"gibba015\", \"name\": \"a\", \"network\": \"\"}, {\"hostname\": \"gibba045\", \"name\": \"b\", \"network\": \"\"}]}, \"service_type\": \"node-exporter\"}}"}]': finished 2021-03-10T13:43:34.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:34 gibba045 bash[9787]: cluster 2021-03-10T13:43:33.140122+0000 mgr.y (mgr.14140) 158 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 0 B data, 2.9 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:43:34.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:34 gibba045 bash[9787]: cluster 2021-03-10T13:43:33.201376+0000 mon.a (mon.0) 465 : cluster [DBG] osdmap e48: 8 total, 8 up, 8 in 2021-03-10T13:43:34.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:34 gibba045 bash[9787]: audit 2021-03-10T13:43:33.505247+0000 mgr.y (mgr.14140) 159 : audit [DBG] from='client.34241 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;gibba015=a;gibba045=b", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:43:34.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:34 gibba045 bash[9787]: cephadm 2021-03-10T13:43:33.506625+0000 mgr.y (mgr.14140) 160 : cephadm [INF] Saving service node-exporter spec with placement count:2 gibba015=a,gibba045=b 2021-03-10T13:43:34.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:34 gibba045 bash[9787]: audit 2021-03-10T13:43:33.507642+0000 mon.a (mon.0) 466 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.node-exporter","val":"{\"created\": \"2021-03-10T13:43:33.506660\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"gibba015\", \"name\": \"a\", \"network\": \"\"}, {\"hostname\": \"gibba045\", \"name\": \"b\", \"network\": \"\"}]}, \"service_type\": \"node-exporter\"}}"}]: dispatch 2021-03-10T13:43:34.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:34 gibba045 bash[9787]: audit 2021-03-10T13:43:33.516300+0000 mon.a (mon.0) 467 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.node-exporter","val":"{\"created\": \"2021-03-10T13:43:33.506660\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"gibba015\", \"name\": \"a\", \"network\": \"\"}, {\"hostname\": \"gibba045\", \"name\": \"b\", \"network\": \"\"}]}, \"service_type\": \"node-exporter\"}}"}]': finished 2021-03-10T13:43:35.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:35 gibba045 bash[9787]: cluster 2021-03-10T13:43:35.204911+0000 mon.a (mon.0) 468 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-03-10T13:43:35.570 DEBUG:teuthology.orchestra.run.gibba015:node-exporter.a> sudo journalctl -f -n 0 -u ceph-e4a642d2-81a5-11eb-9080-001a4aab830c@node-exporter.a.service 2021-03-10T13:43:35.573 DEBUG:teuthology.orchestra.run.gibba045:node-exporter.b> sudo journalctl -f -n 0 -u ceph-e4a642d2-81a5-11eb-9080-001a4aab830c@node-exporter.b.service 2021-03-10T13:43:35.576 INFO:tasks.cephadm:Adding alertmanager.a on gibba015 2021-03-10T13:43:35.576 DEBUG:teuthology.orchestra.run.gibba045:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e4a642d2-81a5-11eb-9080-001a4aab830c -- ceph orch apply alertmanager '1;gibba015=a' 2021-03-10T13:43:35.580 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:35 gibba015 bash[9806]: cluster 2021-03-10T13:43:35.204911+0000 mon.a (mon.0) 468 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-03-10T13:43:35.580 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:35 gibba015 bash[13005]: cluster 2021-03-10T13:43:35.204911+0000 mon.a (mon.0) 468 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-03-10T13:43:35.582 INFO:journalctl@ceph.node-exporter.a.gibba015.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T13:43:35.638 INFO:journalctl@ceph.node-exporter.b.gibba045.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T13:43:36.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:36 gibba045 bash[9787]: cluster 2021-03-10T13:43:35.141237+0000 mgr.y (mgr.14140) 161 : cluster [DBG] pgmap v162: 1 pgs: 1 peering; 0 B data, 3.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:43:36.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:36 gibba015 bash[9806]: cluster 2021-03-10T13:43:35.141237+0000 mgr.y (mgr.14140) 161 : cluster [DBG] pgmap v162: 1 pgs: 1 peering; 0 B data, 3.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:43:36.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:36 gibba015 bash[13005]: cluster 2021-03-10T13:43:35.141237+0000 mgr.y (mgr.14140) 161 : cluster [DBG] pgmap v162: 1 pgs: 1 peering; 0 B data, 3.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:43:38.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:38 gibba015 bash[9806]: cluster 2021-03-10T13:43:37.141619+0000 mgr.y (mgr.14140) 162 : cluster [DBG] pgmap v163: 1 pgs: 1 peering; 0 B data, 3.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:43:38.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:38 gibba015 bash[13005]: cluster 2021-03-10T13:43:37.141619+0000 mgr.y (mgr.14140) 162 : cluster [DBG] pgmap v163: 1 pgs: 1 peering; 0 B data, 3.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:43:38.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:38 gibba045 bash[9787]: cluster 2021-03-10T13:43:37.141619+0000 mgr.y (mgr.14140) 162 : cluster [DBG] pgmap v163: 1 pgs: 1 peering; 0 B data, 3.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:43:39.296 INFO:teuthology.orchestra.run.gibba045.stdout:Scheduled alertmanager update... 2021-03-10T13:43:39.465 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:39 gibba045 bash[9787]: cluster 2021-03-10T13:43:39.146403+0000 mon.a (mon.0) 469 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2021-03-10T13:43:39.465 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:39 gibba045 bash[9787]: cluster 2021-03-10T13:43:39.146495+0000 mon.a (mon.0) 470 : cluster [INF] Cluster is now healthy 2021-03-10T13:43:39.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:39 gibba015 bash[9806]: cluster 2021-03-10T13:43:39.146403+0000 mon.a (mon.0) 469 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2021-03-10T13:43:39.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:39 gibba015 bash[9806]: cluster 2021-03-10T13:43:39.146495+0000 mon.a (mon.0) 470 : cluster [INF] Cluster is now healthy 2021-03-10T13:43:39.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:39 gibba015 bash[13005]: cluster 2021-03-10T13:43:39.146403+0000 mon.a (mon.0) 469 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2021-03-10T13:43:39.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:39 gibba015 bash[13005]: cluster 2021-03-10T13:43:39.146495+0000 mon.a (mon.0) 470 : cluster [INF] Cluster is now healthy 2021-03-10T13:43:40.061 DEBUG:teuthology.orchestra.run.gibba015:alertmanager.a> sudo journalctl -f -n 0 -u ceph-e4a642d2-81a5-11eb-9080-001a4aab830c@alertmanager.a.service 2021-03-10T13:43:40.064 INFO:tasks.cephadm:Adding grafana.a on gibba045 2021-03-10T13:43:40.064 DEBUG:teuthology.orchestra.run.gibba045:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e4a642d2-81a5-11eb-9080-001a4aab830c -- ceph orch apply grafana '1;gibba045=a' 2021-03-10T13:43:40.092 INFO:journalctl@ceph.alertmanager.a.gibba015.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T13:43:40.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:40 gibba015 bash[9806]: cluster 2021-03-10T13:43:39.142549+0000 mgr.y (mgr.14140) 163 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:43:40.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:40 gibba015 bash[9806]: audit 2021-03-10T13:43:39.284141+0000 mgr.y (mgr.14140) 164 : audit [DBG] from='client.34247 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;gibba015=a", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:43:40.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:40 gibba015 bash[9806]: cephadm 2021-03-10T13:43:39.285480+0000 mgr.y (mgr.14140) 165 : cephadm [INF] Saving service alertmanager spec with placement count:1 gibba015=a 2021-03-10T13:43:40.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:40 gibba015 bash[9806]: audit 2021-03-10T13:43:39.286444+0000 mon.a (mon.0) 471 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.alertmanager","val":"{\"created\": \"2021-03-10T13:43:39.285514\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba015\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"alertmanager\"}}"}]: dispatch 2021-03-10T13:43:40.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:40 gibba015 bash[9806]: audit 2021-03-10T13:43:39.294670+0000 mon.a (mon.0) 472 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.alertmanager","val":"{\"created\": \"2021-03-10T13:43:39.285514\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba015\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"alertmanager\"}}"}]': finished 2021-03-10T13:43:40.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:40 gibba015 bash[13005]: cluster 2021-03-10T13:43:39.142549+0000 mgr.y (mgr.14140) 163 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:43:40.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:40 gibba015 bash[13005]: audit 2021-03-10T13:43:39.284141+0000 mgr.y (mgr.14140) 164 : audit [DBG] from='client.34247 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;gibba015=a", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:43:40.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:40 gibba015 bash[13005]: cephadm 2021-03-10T13:43:39.285480+0000 mgr.y (mgr.14140) 165 : cephadm [INF] Saving service alertmanager spec with placement count:1 gibba015=a 2021-03-10T13:43:40.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:40 gibba015 bash[13005]: audit 2021-03-10T13:43:39.286444+0000 mon.a (mon.0) 471 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.alertmanager","val":"{\"created\": \"2021-03-10T13:43:39.285514\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba015\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"alertmanager\"}}"}]: dispatch 2021-03-10T13:43:40.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:40 gibba015 bash[13005]: audit 2021-03-10T13:43:39.294670+0000 mon.a (mon.0) 472 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.alertmanager","val":"{\"created\": \"2021-03-10T13:43:39.285514\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba015\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"alertmanager\"}}"}]': finished 2021-03-10T13:43:40.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:40 gibba045 bash[9787]: cluster 2021-03-10T13:43:39.142549+0000 mgr.y (mgr.14140) 163 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:43:40.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:40 gibba045 bash[9787]: audit 2021-03-10T13:43:39.284141+0000 mgr.y (mgr.14140) 164 : audit [DBG] from='client.34247 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;gibba015=a", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:43:40.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:40 gibba045 bash[9787]: cephadm 2021-03-10T13:43:39.285480+0000 mgr.y (mgr.14140) 165 : cephadm [INF] Saving service alertmanager spec with placement count:1 gibba015=a 2021-03-10T13:43:40.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:40 gibba045 bash[9787]: audit 2021-03-10T13:43:39.286444+0000 mon.a (mon.0) 471 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.alertmanager","val":"{\"created\": \"2021-03-10T13:43:39.285514\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba015\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"alertmanager\"}}"}]: dispatch 2021-03-10T13:43:40.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:40 gibba045 bash[9787]: audit 2021-03-10T13:43:39.294670+0000 mon.a (mon.0) 472 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.alertmanager","val":"{\"created\": \"2021-03-10T13:43:39.285514\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba015\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"alertmanager\"}}"}]': finished 2021-03-10T13:43:42.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:42 gibba045 bash[9787]: cluster 2021-03-10T13:43:41.143562+0000 mgr.y (mgr.14140) 166 : cluster [DBG] pgmap v165: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:43:42.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:42 gibba015 bash[9806]: cluster 2021-03-10T13:43:41.143562+0000 mgr.y (mgr.14140) 166 : cluster [DBG] pgmap v165: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:43:42.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:42 gibba015 bash[13005]: cluster 2021-03-10T13:43:41.143562+0000 mgr.y (mgr.14140) 166 : cluster [DBG] pgmap v165: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:43:43.058 INFO:journalctl@ceph.prometheus.a.gibba045.stdout:Mar 10 13:43:42 gibba045 docker[17908]: Error: No such container: ceph-e4a642d2-81a5-11eb-9080-001a4aab830c-prometheus.a 2021-03-10T13:43:43.058 INFO:journalctl@ceph.prometheus.a.gibba045.stdout:Mar 10 13:43:42 gibba045 systemd[1]: Started Ceph prometheus.a for e4a642d2-81a5-11eb-9080-001a4aab830c. 2021-03-10T13:43:43.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:43 gibba015 bash[9806]: audit 2021-03-10T13:43:42.839803+0000 mon.a (mon.0) 473 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435001\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435266\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435433\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435590\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435741\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435891\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.436039\", \"created\": \"2021-03-10T13:43:22.897564\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:43:30.705787\"}}, \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:43:43.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:43 gibba015 bash[13005]: audit 2021-03-10T13:43:42.839803+0000 mon.a (mon.0) 473 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435001\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435266\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435433\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435590\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435741\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435891\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.436039\", \"created\": \"2021-03-10T13:43:22.897564\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:43:30.705787\"}}, \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:43:43.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:43 gibba015 bash[9806]: audit 2021-03-10T13:43:42.848761+0000 mon.a (mon.0) 474 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435001\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435266\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435433\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435590\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435741\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435891\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.436039\", \"created\": \"2021-03-10T13:43:22.897564\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:43:30.705787\"}}, \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:43:43.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:43 gibba015 bash[9806]: audit 2021-03-10T13:43:42.849613+0000 mon.a (mon.0) 475 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:43:43.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:43 gibba015 bash[9806]: audit 2021-03-10T13:43:43.140607+0000 mon.a (mon.0) 476 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"d2493283-8b4a-4bfa-bc09-88d77b213100\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615383758.8098798, \"finished_at\": 1615383780.5236287}, {\"id\": \"e4d96cc7-4f52-40ca-a7b2-18eec4db3fc0\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615383767.8740945, \"finished_at\": 1615383780.5237308}, {\"id\": \"fa1274cb-9a6e-44af-8201-c2a710ca1e2d\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1615383789.1095817, \"finished_at\": 1615383802.9271262}, {\"id\": \"bf840adc-88e0-4439-b29a-ff57bbdc79a8\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1615383812.189496, \"finished_at\": 1615383819.1583781}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2021-03-10T13:43:43.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:43 gibba015 bash[9806]: audit 2021-03-10T13:43:43.148965+0000 mon.a (mon.0) 477 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"d2493283-8b4a-4bfa-bc09-88d77b213100\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615383758.8098798, \"finished_at\": 1615383780.5236287}, {\"id\": \"e4d96cc7-4f52-40ca-a7b2-18eec4db3fc0\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615383767.8740945, \"finished_at\": 1615383780.5237308}, {\"id\": \"fa1274cb-9a6e-44af-8201-c2a710ca1e2d\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1615383789.1095817, \"finished_at\": 1615383802.9271262}, {\"id\": \"bf840adc-88e0-4439-b29a-ff57bbdc79a8\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1615383812.189496, \"finished_at\": 1615383819.1583781}], \"version\": 2, \"compat_version\": 2}"}]': finished 2021-03-10T13:43:43.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:43 gibba015 bash[13005]: audit 2021-03-10T13:43:42.848761+0000 mon.a (mon.0) 474 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435001\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435266\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435433\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435590\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435741\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435891\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.436039\", \"created\": \"2021-03-10T13:43:22.897564\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:43:30.705787\"}}, \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:43:43.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:43 gibba015 bash[13005]: audit 2021-03-10T13:43:42.849613+0000 mon.a (mon.0) 475 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:43:43.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:43 gibba015 bash[13005]: audit 2021-03-10T13:43:43.140607+0000 mon.a (mon.0) 476 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"d2493283-8b4a-4bfa-bc09-88d77b213100\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615383758.8098798, \"finished_at\": 1615383780.5236287}, {\"id\": \"e4d96cc7-4f52-40ca-a7b2-18eec4db3fc0\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615383767.8740945, \"finished_at\": 1615383780.5237308}, {\"id\": \"fa1274cb-9a6e-44af-8201-c2a710ca1e2d\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1615383789.1095817, \"finished_at\": 1615383802.9271262}, {\"id\": \"bf840adc-88e0-4439-b29a-ff57bbdc79a8\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1615383812.189496, \"finished_at\": 1615383819.1583781}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2021-03-10T13:43:43.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:43 gibba015 bash[13005]: audit 2021-03-10T13:43:43.148965+0000 mon.a (mon.0) 477 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"d2493283-8b4a-4bfa-bc09-88d77b213100\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615383758.8098798, \"finished_at\": 1615383780.5236287}, {\"id\": \"e4d96cc7-4f52-40ca-a7b2-18eec4db3fc0\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615383767.8740945, \"finished_at\": 1615383780.5237308}, {\"id\": \"fa1274cb-9a6e-44af-8201-c2a710ca1e2d\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1615383789.1095817, \"finished_at\": 1615383802.9271262}, {\"id\": \"bf840adc-88e0-4439-b29a-ff57bbdc79a8\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1615383812.189496, \"finished_at\": 1615383819.1583781}], \"version\": 2, \"compat_version\": 2}"}]': finished 2021-03-10T13:43:43.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:43 gibba045 bash[9787]: audit 2021-03-10T13:43:42.839803+0000 mon.a (mon.0) 473 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435001\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435266\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435433\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435590\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435741\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435891\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.436039\", \"created\": \"2021-03-10T13:43:22.897564\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:43:30.705787\"}}, \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:43:43.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:43 gibba045 bash[9787]: audit 2021-03-10T13:43:42.848761+0000 mon.a (mon.0) 474 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435001\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435266\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435433\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435590\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435741\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.435891\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:23.436039\", \"created\": \"2021-03-10T13:43:22.897564\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:43:30.705787\"}}, \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:43:43.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:43 gibba045 bash[9787]: audit 2021-03-10T13:43:42.849613+0000 mon.a (mon.0) 475 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:43:43.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:43 gibba045 bash[9787]: audit 2021-03-10T13:43:43.140607+0000 mon.a (mon.0) 476 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"d2493283-8b4a-4bfa-bc09-88d77b213100\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615383758.8098798, \"finished_at\": 1615383780.5236287}, {\"id\": \"e4d96cc7-4f52-40ca-a7b2-18eec4db3fc0\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615383767.8740945, \"finished_at\": 1615383780.5237308}, {\"id\": \"fa1274cb-9a6e-44af-8201-c2a710ca1e2d\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1615383789.1095817, \"finished_at\": 1615383802.9271262}, {\"id\": \"bf840adc-88e0-4439-b29a-ff57bbdc79a8\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1615383812.189496, \"finished_at\": 1615383819.1583781}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2021-03-10T13:43:43.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:43 gibba045 bash[9787]: audit 2021-03-10T13:43:43.148965+0000 mon.a (mon.0) 477 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"d2493283-8b4a-4bfa-bc09-88d77b213100\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615383758.8098798, \"finished_at\": 1615383780.5236287}, {\"id\": \"e4d96cc7-4f52-40ca-a7b2-18eec4db3fc0\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615383767.8740945, \"finished_at\": 1615383780.5237308}, {\"id\": \"fa1274cb-9a6e-44af-8201-c2a710ca1e2d\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1615383789.1095817, \"finished_at\": 1615383802.9271262}, {\"id\": \"bf840adc-88e0-4439-b29a-ff57bbdc79a8\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1615383812.189496, \"finished_at\": 1615383819.1583781}], \"version\": 2, \"compat_version\": 2}"}]': finished 2021-03-10T13:43:43.994 INFO:teuthology.orchestra.run.gibba045.stdout:Scheduled grafana update... 2021-03-10T13:43:44.097 INFO:journalctl@ceph.node-exporter.b.gibba045.stdout:Mar 10 13:43:43 gibba045 systemd[1]: Started Ceph node-exporter.b for e4a642d2-81a5-11eb-9080-001a4aab830c. 2021-03-10T13:43:44.097 INFO:journalctl@ceph.node-exporter.b.gibba045.stdout:Mar 10 13:43:43 gibba045 bash[18255]: Unable to find image 'prom/node-exporter:latest' locally 2021-03-10T13:43:44.254 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:44 gibba015 bash[13005]: cluster 2021-03-10T13:43:43.144303+0000 mgr.y (mgr.14140) 167 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:43:44.255 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:44 gibba015 bash[9806]: cluster 2021-03-10T13:43:43.144303+0000 mgr.y (mgr.14140) 167 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:43:44.255 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:44 gibba015 bash[13005]: audit 2021-03-10T13:43:43.438175+0000 mon.a (mon.0) 478 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.434074\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.434339\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.434505\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.434661\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.434812\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.434959\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.435109\", \"created\": \"2021-03-10T13:43:22.897564\", \"started\": \"2021-03-10T13:43:26.167781\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.435259\", \"created\": \"2021-03-10T13:43:42.821564\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:43:30.705787\"}}, \"last_daemon_update\": \"2021-03-10T13:43:43.435526\", \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:43:44.256 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:44 gibba015 bash[9806]: audit 2021-03-10T13:43:43.438175+0000 mon.a (mon.0) 478 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.434074\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.434339\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.434505\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.434661\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.434812\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.434959\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.435109\", \"created\": \"2021-03-10T13:43:22.897564\", \"started\": \"2021-03-10T13:43:26.167781\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.435259\", \"created\": \"2021-03-10T13:43:42.821564\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:43:30.705787\"}}, \"last_daemon_update\": \"2021-03-10T13:43:43.435526\", \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:43:44.256 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:44 gibba015 bash[13005]: audit 2021-03-10T13:43:43.446773+0000 mon.a (mon.0) 479 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.434074\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.434339\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.434505\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.434661\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.434812\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.434959\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.435109\", \"created\": \"2021-03-10T13:43:22.897564\", \"started\": \"2021-03-10T13:43:26.167781\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.435259\", \"created\": \"2021-03-10T13:43:42.821564\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:43:30.705787\"}}, \"last_daemon_update\": \"2021-03-10T13:43:43.435526\", \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:43:44.256 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:44 gibba015 bash[13005]: audit 2021-03-10T13:43:43.448016+0000 mon.a (mon.0) 480 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon"}]: dispatch 2021-03-10T13:43:44.257 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:44 gibba015 bash[13005]: audit 2021-03-10T13:43:43.448882+0000 mon.a (mon.0) 481 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:43:44.257 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:44 gibba015 bash[13005]: cephadm 2021-03-10T13:43:43.449616+0000 mgr.y (mgr.14140) 168 : cephadm [INF] Deploying daemon node-exporter.b on gibba045 2021-03-10T13:43:44.257 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:44 gibba015 bash[9806]: audit 2021-03-10T13:43:43.446773+0000 mon.a (mon.0) 479 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.434074\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.434339\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.434505\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.434661\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.434812\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.434959\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.435109\", \"created\": \"2021-03-10T13:43:22.897564\", \"started\": \"2021-03-10T13:43:26.167781\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.435259\", \"created\": \"2021-03-10T13:43:42.821564\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:43:30.705787\"}}, \"last_daemon_update\": \"2021-03-10T13:43:43.435526\", \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:43:44.258 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:44 gibba015 bash[9806]: audit 2021-03-10T13:43:43.448016+0000 mon.a (mon.0) 480 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon"}]: dispatch 2021-03-10T13:43:44.258 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:44 gibba015 bash[9806]: audit 2021-03-10T13:43:43.448882+0000 mon.a (mon.0) 481 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:43:44.258 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:44 gibba015 bash[9806]: cephadm 2021-03-10T13:43:43.449616+0000 mgr.y (mgr.14140) 168 : cephadm [INF] Deploying daemon node-exporter.b on gibba045 2021-03-10T13:43:44.259 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:44 gibba015 bash[13005]: audit 2021-03-10T13:43:43.879373+0000 mon.a (mon.0) 482 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.434074\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.434339\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.434505\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.434661\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.434812\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.434959\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.435109\", \"created\": \"2021-03-10T13:43:22.897564\", \"started\": \"2021-03-10T13:43:26.167781\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.435259\", \"created\": \"2021-03-10T13:43:42.821564\"}, \"node-exporter.b\": {\"hostname\": \"gibba045\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:43:30.705787\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872\"}}, \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:43:44.259 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:44 gibba015 bash[9806]: audit 2021-03-10T13:43:43.879373+0000 mon.a (mon.0) 482 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.434074\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.434339\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.434505\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.434661\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.434812\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.434959\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.435109\", \"created\": \"2021-03-10T13:43:22.897564\", \"started\": \"2021-03-10T13:43:26.167781\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.435259\", \"created\": \"2021-03-10T13:43:42.821564\"}, \"node-exporter.b\": {\"hostname\": \"gibba045\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:43:30.705787\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872\"}}, \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:43:44.260 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:44 gibba015 bash[13005]: audit 2021-03-10T13:43:43.888187+0000 mon.a (mon.0) 483 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.434074\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.434339\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.434505\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.434661\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.434812\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.434959\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.435109\", \"created\": \"2021-03-10T13:43:22.897564\", \"started\": \"2021-03-10T13:43:26.167781\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.435259\", \"created\": \"2021-03-10T13:43:42.821564\"}, \"node-exporter.b\": {\"hostname\": \"gibba045\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:43:30.705787\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872\"}}, \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:43:44.260 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:44 gibba015 bash[13005]: audit 2021-03-10T13:43:43.889142+0000 mon.a (mon.0) 484 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon"}]: dispatch 2021-03-10T13:43:44.260 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:44 gibba015 bash[13005]: audit 2021-03-10T13:43:43.890117+0000 mon.a (mon.0) 485 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:43:44.260 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:44 gibba015 bash[13005]: cephadm 2021-03-10T13:43:43.890914+0000 mgr.y (mgr.14140) 169 : cephadm [INF] Deploying daemon node-exporter.a on gibba015 2021-03-10T13:43:44.260 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:44 gibba015 bash[13005]: audit 2021-03-10T13:43:43.989961+0000 mgr.y (mgr.14140) 170 : audit [DBG] from='client.34253 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;gibba045=a", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:43:44.261 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:44 gibba015 bash[9806]: audit 2021-03-10T13:43:43.888187+0000 mon.a (mon.0) 483 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.434074\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.434339\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.434505\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.434661\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.434812\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.434959\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.435109\", \"created\": \"2021-03-10T13:43:22.897564\", \"started\": \"2021-03-10T13:43:26.167781\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.435259\", \"created\": \"2021-03-10T13:43:42.821564\"}, \"node-exporter.b\": {\"hostname\": \"gibba045\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:43:30.705787\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872\"}}, \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:43:44.261 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:44 gibba015 bash[9806]: audit 2021-03-10T13:43:43.889142+0000 mon.a (mon.0) 484 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon"}]: dispatch 2021-03-10T13:43:44.261 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:44 gibba015 bash[9806]: audit 2021-03-10T13:43:43.890117+0000 mon.a (mon.0) 485 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:43:44.262 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:44 gibba015 bash[9806]: cephadm 2021-03-10T13:43:43.890914+0000 mgr.y (mgr.14140) 169 : cephadm [INF] Deploying daemon node-exporter.a on gibba015 2021-03-10T13:43:44.262 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:44 gibba015 bash[9806]: audit 2021-03-10T13:43:43.989961+0000 mgr.y (mgr.14140) 170 : audit [DBG] from='client.34253 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;gibba045=a", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:43:44.262 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:44 gibba015 bash[13005]: cephadm 2021-03-10T13:43:43.990475+0000 mgr.y (mgr.14140) 171 : cephadm [INF] Saving service grafana spec with placement count:1 gibba045=a 2021-03-10T13:43:44.262 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:44 gibba015 bash[13005]: audit 2021-03-10T13:43:43.990850+0000 mon.a (mon.0) 486 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.grafana","val":"{\"created\": \"2021-03-10T13:43:43.990499\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba045\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"grafana\"}}"}]: dispatch 2021-03-10T13:43:44.263 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:44 gibba015 bash[13005]: audit 2021-03-10T13:43:43.993283+0000 mon.a (mon.0) 487 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.grafana","val":"{\"created\": \"2021-03-10T13:43:43.990499\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba045\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"grafana\"}}"}]': finished 2021-03-10T13:43:44.263 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:44 gibba015 bash[9806]: cephadm 2021-03-10T13:43:43.990475+0000 mgr.y (mgr.14140) 171 : cephadm [INF] Saving service grafana spec with placement count:1 gibba045=a 2021-03-10T13:43:44.263 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:44 gibba015 bash[9806]: audit 2021-03-10T13:43:43.990850+0000 mon.a (mon.0) 486 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.grafana","val":"{\"created\": \"2021-03-10T13:43:43.990499\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba045\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"grafana\"}}"}]: dispatch 2021-03-10T13:43:44.263 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:44 gibba015 bash[9806]: audit 2021-03-10T13:43:43.993283+0000 mon.a (mon.0) 487 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.grafana","val":"{\"created\": \"2021-03-10T13:43:43.990499\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba045\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"grafana\"}}"}]': finished 2021-03-10T13:43:44.408 INFO:journalctl@ceph.node-exporter.b.gibba045.stdout:Mar 10 13:43:44 gibba045 bash[18255]: latest: Pulling from prom/node-exporter 2021-03-10T13:43:44.408 INFO:journalctl@ceph.node-exporter.b.gibba045.stdout:Mar 10 13:43:44 gibba045 bash[18255]: dc6dd4561653: Pulling fs layer 2021-03-10T13:43:44.408 INFO:journalctl@ceph.node-exporter.b.gibba045.stdout:Mar 10 13:43:44 gibba045 bash[18255]: 613f88646930: Pulling fs layer 2021-03-10T13:43:44.409 INFO:journalctl@ceph.node-exporter.b.gibba045.stdout:Mar 10 13:43:44 gibba045 bash[18255]: edad907fb257: Pulling fs layer 2021-03-10T13:43:44.409 INFO:journalctl@ceph.node-exporter.b.gibba045.stdout:Mar 10 13:43:44 gibba045 bash[18255]: 613f88646930: Download complete 2021-03-10T13:43:44.409 INFO:journalctl@ceph.prometheus.a.gibba045.stdout:Mar 10 13:43:44 gibba045 bash[17926]: level=info ts=2021-03-10T13:43:44.095Z caller=main.go:366 msg="No time or size retention was set so using the default time retention" duration=15d 2021-03-10T13:43:44.410 INFO:journalctl@ceph.prometheus.a.gibba045.stdout:Mar 10 13:43:44 gibba045 bash[17926]: level=info ts=2021-03-10T13:43:44.095Z caller=main.go:404 msg="Starting Prometheus" version="(version=2.25.0, branch=HEAD, revision=a6be548dbc17780d562a39c0e4bd0bd4c00ad6e2)" 2021-03-10T13:43:44.410 INFO:journalctl@ceph.prometheus.a.gibba045.stdout:Mar 10 13:43:44 gibba045 bash[17926]: level=info ts=2021-03-10T13:43:44.095Z caller=main.go:409 build_context="(go=go1.15.8, user=root@615f028225c9, date=20210217-14:17:24)" 2021-03-10T13:43:44.410 INFO:journalctl@ceph.prometheus.a.gibba045.stdout:Mar 10 13:43:44 gibba045 bash[17926]: level=info ts=2021-03-10T13:43:44.095Z caller=main.go:410 host_details="(Linux 5.4.0-66-generic #74-Ubuntu SMP Wed Jan 27 22:54:38 UTC 2021 x86_64 gibba045 (none))" 2021-03-10T13:43:44.410 INFO:journalctl@ceph.prometheus.a.gibba045.stdout:Mar 10 13:43:44 gibba045 bash[17926]: level=info ts=2021-03-10T13:43:44.095Z caller=main.go:411 fd_limits="(soft=1048576, hard=1048576)" 2021-03-10T13:43:44.410 INFO:journalctl@ceph.prometheus.a.gibba045.stdout:Mar 10 13:43:44 gibba045 bash[17926]: level=info ts=2021-03-10T13:43:44.095Z caller=main.go:412 vm_limits="(soft=unlimited, hard=unlimited)" 2021-03-10T13:43:44.411 INFO:journalctl@ceph.prometheus.a.gibba045.stdout:Mar 10 13:43:44 gibba045 bash[17926]: level=info ts=2021-03-10T13:43:44.096Z caller=web.go:532 component=web msg="Start listening for connections" address=:9095 2021-03-10T13:43:44.411 INFO:journalctl@ceph.prometheus.a.gibba045.stdout:Mar 10 13:43:44 gibba045 bash[17926]: level=info ts=2021-03-10T13:43:44.097Z caller=main.go:779 msg="Starting TSDB ..." 2021-03-10T13:43:44.411 INFO:journalctl@ceph.prometheus.a.gibba045.stdout:Mar 10 13:43:44 gibba045 bash[17926]: level=info ts=2021-03-10T13:43:44.097Z caller=tls_config.go:191 component=web msg="TLS is disabled." http2=false 2021-03-10T13:43:44.411 INFO:journalctl@ceph.prometheus.a.gibba045.stdout:Mar 10 13:43:44 gibba045 bash[17926]: level=info ts=2021-03-10T13:43:44.099Z caller=head.go:668 component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2021-03-10T13:43:44.411 INFO:journalctl@ceph.prometheus.a.gibba045.stdout:Mar 10 13:43:44 gibba045 bash[17926]: level=info ts=2021-03-10T13:43:44.099Z caller=head.go:682 component=tsdb msg="On-disk memory mappable chunks replay completed" duration=1.59µs 2021-03-10T13:43:44.412 INFO:journalctl@ceph.prometheus.a.gibba045.stdout:Mar 10 13:43:44 gibba045 bash[17926]: level=info ts=2021-03-10T13:43:44.099Z caller=head.go:688 component=tsdb msg="Replaying WAL, this may take a while" 2021-03-10T13:43:44.412 INFO:journalctl@ceph.prometheus.a.gibba045.stdout:Mar 10 13:43:44 gibba045 bash[17926]: level=info ts=2021-03-10T13:43:44.100Z caller=head.go:740 component=tsdb msg="WAL segment loaded" segment=0 maxSegment=0 2021-03-10T13:43:44.412 INFO:journalctl@ceph.prometheus.a.gibba045.stdout:Mar 10 13:43:44 gibba045 bash[17926]: level=info ts=2021-03-10T13:43:44.100Z caller=head.go:745 component=tsdb msg="WAL replay completed" checkpoint_replay_duration=12.966µs wal_replay_duration=507.295µs total_replay_duration=535.805µs 2021-03-10T13:43:44.412 INFO:journalctl@ceph.prometheus.a.gibba045.stdout:Mar 10 13:43:44 gibba045 bash[17926]: level=info ts=2021-03-10T13:43:44.101Z caller=main.go:799 fs_type=XFS_SUPER_MAGIC 2021-03-10T13:43:44.413 INFO:journalctl@ceph.prometheus.a.gibba045.stdout:Mar 10 13:43:44 gibba045 bash[17926]: level=info ts=2021-03-10T13:43:44.101Z caller=main.go:802 msg="TSDB started" 2021-03-10T13:43:44.413 INFO:journalctl@ceph.prometheus.a.gibba045.stdout:Mar 10 13:43:44 gibba045 bash[17926]: level=info ts=2021-03-10T13:43:44.101Z caller=main.go:928 msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2021-03-10T13:43:44.413 INFO:journalctl@ceph.prometheus.a.gibba045.stdout:Mar 10 13:43:44 gibba045 bash[17926]: level=info ts=2021-03-10T13:43:44.101Z caller=main.go:959 msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=430.024µs remote_storage=947ns web_handler=222ns query_engine=403ns scrape=243.034µs scrape_sd=17.937µs notify=405ns notify_sd=1.318µs rules=21.238µs 2021-03-10T13:43:44.413 INFO:journalctl@ceph.prometheus.a.gibba045.stdout:Mar 10 13:43:44 gibba045 bash[17926]: level=info ts=2021-03-10T13:43:44.101Z caller=main.go:751 msg="Server is ready to receive web requests." 2021-03-10T13:43:44.414 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:44 gibba045 bash[9787]: cluster 2021-03-10T13:43:43.144303+0000 mgr.y (mgr.14140) 167 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:43:44.414 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:44 gibba045 bash[9787]: audit 2021-03-10T13:43:43.438175+0000 mon.a (mon.0) 478 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.434074\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.434339\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.434505\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.434661\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.434812\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.434959\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.435109\", \"created\": \"2021-03-10T13:43:22.897564\", \"started\": \"2021-03-10T13:43:26.167781\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.435259\", \"created\": \"2021-03-10T13:43:42.821564\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:43:30.705787\"}}, \"last_daemon_update\": \"2021-03-10T13:43:43.435526\", \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:43:44.415 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:44 gibba045 bash[9787]: audit 2021-03-10T13:43:43.446773+0000 mon.a (mon.0) 479 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.434074\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.434339\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.434505\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.434661\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.434812\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.434959\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.435109\", \"created\": \"2021-03-10T13:43:22.897564\", \"started\": \"2021-03-10T13:43:26.167781\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.435259\", \"created\": \"2021-03-10T13:43:42.821564\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:43:30.705787\"}}, \"last_daemon_update\": \"2021-03-10T13:43:43.435526\", \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:43:44.415 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:44 gibba045 bash[9787]: audit 2021-03-10T13:43:43.448016+0000 mon.a (mon.0) 480 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon"}]: dispatch 2021-03-10T13:43:44.415 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:44 gibba045 bash[9787]: audit 2021-03-10T13:43:43.448882+0000 mon.a (mon.0) 481 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:43:44.416 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:44 gibba045 bash[9787]: cephadm 2021-03-10T13:43:43.449616+0000 mgr.y (mgr.14140) 168 : cephadm [INF] Deploying daemon node-exporter.b on gibba045 2021-03-10T13:43:44.416 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:44 gibba045 bash[9787]: audit 2021-03-10T13:43:43.879373+0000 mon.a (mon.0) 482 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.434074\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.434339\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.434505\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.434661\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.434812\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.434959\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.435109\", \"created\": \"2021-03-10T13:43:22.897564\", \"started\": \"2021-03-10T13:43:26.167781\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.435259\", \"created\": \"2021-03-10T13:43:42.821564\"}, \"node-exporter.b\": {\"hostname\": \"gibba045\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:43:30.705787\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872\"}}, \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:43:44.416 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:44 gibba045 bash[9787]: audit 2021-03-10T13:43:43.888187+0000 mon.a (mon.0) 483 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.434074\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.434339\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.434505\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.434661\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.434812\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.434959\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.435109\", \"created\": \"2021-03-10T13:43:22.897564\", \"started\": \"2021-03-10T13:43:26.167781\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:43.435259\", \"created\": \"2021-03-10T13:43:42.821564\"}, \"node-exporter.b\": {\"hostname\": \"gibba045\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:43:30.705787\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872\"}}, \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:43:44.416 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:44 gibba045 bash[9787]: audit 2021-03-10T13:43:43.889142+0000 mon.a (mon.0) 484 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon"}]: dispatch 2021-03-10T13:43:44.417 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:44 gibba045 bash[9787]: audit 2021-03-10T13:43:43.890117+0000 mon.a (mon.0) 485 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:43:44.417 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:44 gibba045 bash[9787]: cephadm 2021-03-10T13:43:43.890914+0000 mgr.y (mgr.14140) 169 : cephadm [INF] Deploying daemon node-exporter.a on gibba015 2021-03-10T13:43:44.417 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:44 gibba045 bash[9787]: audit 2021-03-10T13:43:43.989961+0000 mgr.y (mgr.14140) 170 : audit [DBG] from='client.34253 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;gibba045=a", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:43:44.417 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:44 gibba045 bash[9787]: cephadm 2021-03-10T13:43:43.990475+0000 mgr.y (mgr.14140) 171 : cephadm [INF] Saving service grafana spec with placement count:1 gibba045=a 2021-03-10T13:43:44.417 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:44 gibba045 bash[9787]: audit 2021-03-10T13:43:43.990850+0000 mon.a (mon.0) 486 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.grafana","val":"{\"created\": \"2021-03-10T13:43:43.990499\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba045\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"grafana\"}}"}]: dispatch 2021-03-10T13:43:44.418 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:44 gibba045 bash[9787]: audit 2021-03-10T13:43:43.993283+0000 mon.a (mon.0) 487 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.grafana","val":"{\"created\": \"2021-03-10T13:43:43.990499\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba045\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"grafana\"}}"}]': finished 2021-03-10T13:43:44.558 INFO:journalctl@ceph.node-exporter.b.gibba045.stdout:Mar 10 13:43:44 gibba045 bash[18255]: dc6dd4561653: Download complete 2021-03-10T13:43:44.558 INFO:journalctl@ceph.node-exporter.b.gibba045.stdout:Mar 10 13:43:44 gibba045 bash[18255]: edad907fb257: Verifying Checksum 2021-03-10T13:43:44.564 INFO:journalctl@ceph.node-exporter.a.gibba015.stdout:Mar 10 13:43:44 gibba015 systemd[1]: Started Ceph node-exporter.a for e4a642d2-81a5-11eb-9080-001a4aab830c. 2021-03-10T13:43:44.564 INFO:journalctl@ceph.node-exporter.a.gibba015.stdout:Mar 10 13:43:44 gibba015 bash[19675]: Unable to find image 'prom/node-exporter:latest' locally 2021-03-10T13:43:44.564 INFO:journalctl@ceph.node-exporter.a.gibba015.stdout:Mar 10 13:43:44 gibba015 bash[19675]: latest: Pulling from prom/node-exporter 2021-03-10T13:43:44.842 DEBUG:teuthology.orchestra.run.gibba045:grafana.a> sudo journalctl -f -n 0 -u ceph-e4a642d2-81a5-11eb-9080-001a4aab830c@grafana.a.service 2021-03-10T13:43:44.844 INFO:tasks.cephadm:Setting up client nodes... 2021-03-10T13:43:44.844 DEBUG:teuthology.orchestra.run.gibba015:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e4a642d2-81a5-11eb-9080-001a4aab830c -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2021-03-10T13:43:44.861 INFO:journalctl@ceph.node-exporter.a.gibba015.stdout:Mar 10 13:43:44 gibba015 bash[19675]: dc6dd4561653: Pulling fs layer 2021-03-10T13:43:44.861 INFO:journalctl@ceph.node-exporter.a.gibba015.stdout:Mar 10 13:43:44 gibba015 bash[19675]: 613f88646930: Pulling fs layer 2021-03-10T13:43:44.861 INFO:journalctl@ceph.node-exporter.a.gibba015.stdout:Mar 10 13:43:44 gibba015 bash[19675]: edad907fb257: Pulling fs layer 2021-03-10T13:43:44.861 INFO:journalctl@ceph.node-exporter.a.gibba015.stdout:Mar 10 13:43:44 gibba015 bash[19675]: 613f88646930: Verifying Checksum 2021-03-10T13:43:44.861 INFO:journalctl@ceph.node-exporter.a.gibba015.stdout:Mar 10 13:43:44 gibba015 bash[19675]: 613f88646930: Download complete 2021-03-10T13:43:44.862 INFO:journalctl@ceph.node-exporter.a.gibba015.stdout:Mar 10 13:43:44 gibba015 bash[19675]: dc6dd4561653: Verifying Checksum 2021-03-10T13:43:44.862 INFO:journalctl@ceph.node-exporter.a.gibba015.stdout:Mar 10 13:43:44 gibba015 bash[19675]: edad907fb257: Verifying Checksum 2021-03-10T13:43:44.862 INFO:journalctl@ceph.node-exporter.a.gibba015.stdout:Mar 10 13:43:44 gibba015 bash[19675]: edad907fb257: Download complete 2021-03-10T13:43:44.868 INFO:journalctl@ceph.grafana.a.gibba045.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T13:43:44.978 INFO:journalctl@ceph.node-exporter.b.gibba045.stdout:Mar 10 13:43:44 gibba045 bash[18255]: dc6dd4561653: Pull complete 2021-03-10T13:43:45.221 INFO:journalctl@ceph.node-exporter.a.gibba015.stdout:Mar 10 13:43:45 gibba015 bash[19675]: dc6dd4561653: Pull complete 2021-03-10T13:43:45.233 INFO:journalctl@ceph.node-exporter.b.gibba045.stdout:Mar 10 13:43:44 gibba045 bash[18255]: 613f88646930: Pull complete 2021-03-10T13:43:45.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:45 gibba015 bash[13005]: audit 2021-03-10T13:43:44.283166+0000 mon.a (mon.0) 488 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985622\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985680\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985710\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985736\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985762\", \"created\": \"2021-03-10T13:41:11.556448\", \"started\": \"2021-03-10T13:41:15.069232\"}, \"osd.2\": {\"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985788\", \"created\": \"2021-03-10T13:41:34.244448\", \"started\": \"2021-03-10T13:41:37.507096\"}, \"osd.3\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985813\", \"created\": \"2021-03-10T13:41:57.328380\"}, \"node-exporter.a\": {\"hostname\": \"gibba015\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955\"}}, \"last_device_update\": \"2021-03-10T13:42:03.853072\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]: dispatch 2021-03-10T13:43:45.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:45 gibba015 bash[13005]: audit 2021-03-10T13:43:44.286303+0000 mon.a (mon.0) 489 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985622\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985680\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985710\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985736\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985762\", \"created\": \"2021-03-10T13:41:11.556448\", \"started\": \"2021-03-10T13:41:15.069232\"}, \"osd.2\": {\"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985788\", \"created\": \"2021-03-10T13:41:34.244448\", \"started\": \"2021-03-10T13:41:37.507096\"}, \"osd.3\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985813\", \"created\": \"2021-03-10T13:41:57.328380\"}, \"node-exporter.a\": {\"hostname\": \"gibba015\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955\"}}, \"last_device_update\": \"2021-03-10T13:42:03.853072\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]': finished 2021-03-10T13:43:45.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:45 gibba015 bash[13005]: cephadm 2021-03-10T13:43:44.288530+0000 mgr.y (mgr.14140) 172 : cephadm [INF] Deploying daemon alertmanager.a on gibba015 2021-03-10T13:43:45.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:45 gibba015 bash[9806]: audit 2021-03-10T13:43:44.283166+0000 mon.a (mon.0) 488 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985622\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985680\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985710\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985736\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985762\", \"created\": \"2021-03-10T13:41:11.556448\", \"started\": \"2021-03-10T13:41:15.069232\"}, \"osd.2\": {\"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985788\", \"created\": \"2021-03-10T13:41:34.244448\", \"started\": \"2021-03-10T13:41:37.507096\"}, \"osd.3\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985813\", \"created\": \"2021-03-10T13:41:57.328380\"}, \"node-exporter.a\": {\"hostname\": \"gibba015\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955\"}}, \"last_device_update\": \"2021-03-10T13:42:03.853072\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]: dispatch 2021-03-10T13:43:45.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:45 gibba015 bash[9806]: audit 2021-03-10T13:43:44.286303+0000 mon.a (mon.0) 489 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985622\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985680\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985710\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985736\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985762\", \"created\": \"2021-03-10T13:41:11.556448\", \"started\": \"2021-03-10T13:41:15.069232\"}, \"osd.2\": {\"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985788\", \"created\": \"2021-03-10T13:41:34.244448\", \"started\": \"2021-03-10T13:41:37.507096\"}, \"osd.3\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985813\", \"created\": \"2021-03-10T13:41:57.328380\"}, \"node-exporter.a\": {\"hostname\": \"gibba015\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955\"}}, \"last_device_update\": \"2021-03-10T13:42:03.853072\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]': finished 2021-03-10T13:43:45.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:45 gibba015 bash[9806]: cephadm 2021-03-10T13:43:44.288530+0000 mgr.y (mgr.14140) 172 : cephadm [INF] Deploying daemon alertmanager.a on gibba015 2021-03-10T13:43:45.558 INFO:journalctl@ceph.node-exporter.b.gibba045.stdout:Mar 10 13:43:45 gibba045 bash[18255]: edad907fb257: Pull complete 2021-03-10T13:43:45.558 INFO:journalctl@ceph.node-exporter.b.gibba045.stdout:Mar 10 13:43:45 gibba045 bash[18255]: Digest: sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810 2021-03-10T13:43:45.559 INFO:journalctl@ceph.node-exporter.b.gibba045.stdout:Mar 10 13:43:45 gibba045 bash[18255]: Status: Downloaded newer image for prom/node-exporter:latest 2021-03-10T13:43:45.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:45 gibba045 bash[9787]: audit 2021-03-10T13:43:44.283166+0000 mon.a (mon.0) 488 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985622\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985680\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985710\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985736\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985762\", \"created\": \"2021-03-10T13:41:11.556448\", \"started\": \"2021-03-10T13:41:15.069232\"}, \"osd.2\": {\"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985788\", \"created\": \"2021-03-10T13:41:34.244448\", \"started\": \"2021-03-10T13:41:37.507096\"}, \"osd.3\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985813\", \"created\": \"2021-03-10T13:41:57.328380\"}, \"node-exporter.a\": {\"hostname\": \"gibba015\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955\"}}, \"last_device_update\": \"2021-03-10T13:42:03.853072\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]: dispatch 2021-03-10T13:43:45.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:45 gibba045 bash[9787]: audit 2021-03-10T13:43:44.286303+0000 mon.a (mon.0) 489 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985622\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985680\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985710\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985736\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985762\", \"created\": \"2021-03-10T13:41:11.556448\", \"started\": \"2021-03-10T13:41:15.069232\"}, \"osd.2\": {\"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985788\", \"created\": \"2021-03-10T13:41:34.244448\", \"started\": \"2021-03-10T13:41:37.507096\"}, \"osd.3\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985813\", \"created\": \"2021-03-10T13:41:57.328380\"}, \"node-exporter.a\": {\"hostname\": \"gibba015\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955\"}}, \"last_device_update\": \"2021-03-10T13:42:03.853072\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]': finished 2021-03-10T13:43:45.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:45 gibba045 bash[9787]: cephadm 2021-03-10T13:43:44.288530+0000 mgr.y (mgr.14140) 172 : cephadm [INF] Deploying daemon alertmanager.a on gibba015 2021-03-10T13:43:46.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:46 gibba045 bash[9787]: cluster 2021-03-10T13:43:45.144684+0000 mgr.y (mgr.14140) 173 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:43:46.559 INFO:journalctl@ceph.node-exporter.b.gibba045.stdout:Mar 10 13:43:46 gibba045 bash[18255]: level=info ts=2021-03-10T13:43:46.498Z caller=node_exporter.go:178 msg="Starting node_exporter" version="(version=1.1.2, branch=HEAD, revision=b597c1244d7bef49e6f3359c87a56dd7707f6719)" 2021-03-10T13:43:46.559 INFO:journalctl@ceph.node-exporter.b.gibba045.stdout:Mar 10 13:43:46 gibba045 bash[18255]: level=info ts=2021-03-10T13:43:46.498Z caller=node_exporter.go:179 msg="Build context" build_context="(go=go1.15.8, user=root@f07de8ca602a, date=20210305-09:29:10)" 2021-03-10T13:43:46.559 INFO:journalctl@ceph.node-exporter.b.gibba045.stdout:Mar 10 13:43:46 gibba045 bash[18255]: level=info ts=2021-03-10T13:43:46.498Z caller=filesystem_common.go:74 collector=filesystem msg="Parsed flag --collector.filesystem.ignored-mount-points" flag=^/(dev|proc|sys|var/lib/docker/.+)($|/) 2021-03-10T13:43:46.559 INFO:journalctl@ceph.node-exporter.b.gibba045.stdout:Mar 10 13:43:46 gibba045 bash[18255]: level=info ts=2021-03-10T13:43:46.498Z caller=filesystem_common.go:76 collector=filesystem msg="Parsed flag --collector.filesystem.ignored-fs-types" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2021-03-10T13:43:46.560 INFO:journalctl@ceph.node-exporter.b.gibba045.stdout:Mar 10 13:43:46 gibba045 bash[18255]: level=info ts=2021-03-10T13:43:46.498Z caller=node_exporter.go:106 msg="Enabled collectors" 2021-03-10T13:43:46.560 INFO:journalctl@ceph.node-exporter.b.gibba045.stdout:Mar 10 13:43:46 gibba045 bash[18255]: level=info ts=2021-03-10T13:43:46.498Z caller=node_exporter.go:113 collector=arp 2021-03-10T13:43:46.560 INFO:journalctl@ceph.node-exporter.b.gibba045.stdout:Mar 10 13:43:46 gibba045 bash[18255]: level=info ts=2021-03-10T13:43:46.498Z caller=node_exporter.go:113 collector=bcache 2021-03-10T13:43:46.560 INFO:journalctl@ceph.node-exporter.b.gibba045.stdout:Mar 10 13:43:46 gibba045 bash[18255]: level=info ts=2021-03-10T13:43:46.498Z caller=node_exporter.go:113 collector=bonding 2021-03-10T13:43:46.560 INFO:journalctl@ceph.node-exporter.b.gibba045.stdout:Mar 10 13:43:46 gibba045 bash[18255]: level=info ts=2021-03-10T13:43:46.498Z caller=node_exporter.go:113 collector=btrfs 2021-03-10T13:43:46.561 INFO:journalctl@ceph.node-exporter.b.gibba045.stdout:Mar 10 13:43:46 gibba045 bash[18255]: level=info ts=2021-03-10T13:43:46.498Z caller=node_exporter.go:113 collector=conntrack 2021-03-10T13:43:46.561 INFO:journalctl@ceph.node-exporter.b.gibba045.stdout:Mar 10 13:43:46 gibba045 bash[18255]: level=info ts=2021-03-10T13:43:46.498Z caller=node_exporter.go:113 collector=cpu 2021-03-10T13:43:46.561 INFO:journalctl@ceph.node-exporter.b.gibba045.stdout:Mar 10 13:43:46 gibba045 bash[18255]: level=info ts=2021-03-10T13:43:46.498Z caller=node_exporter.go:113 collector=cpufreq 2021-03-10T13:43:46.561 INFO:journalctl@ceph.node-exporter.b.gibba045.stdout:Mar 10 13:43:46 gibba045 bash[18255]: level=info ts=2021-03-10T13:43:46.498Z caller=node_exporter.go:113 collector=diskstats 2021-03-10T13:43:46.562 INFO:journalctl@ceph.node-exporter.b.gibba045.stdout:Mar 10 13:43:46 gibba045 bash[18255]: level=info ts=2021-03-10T13:43:46.498Z caller=node_exporter.go:113 collector=edac 2021-03-10T13:43:46.562 INFO:journalctl@ceph.node-exporter.b.gibba045.stdout:Mar 10 13:43:46 gibba045 bash[18255]: level=info ts=2021-03-10T13:43:46.498Z caller=node_exporter.go:113 collector=entropy 2021-03-10T13:43:46.562 INFO:journalctl@ceph.node-exporter.b.gibba045.stdout:Mar 10 13:43:46 gibba045 bash[18255]: level=info ts=2021-03-10T13:43:46.498Z caller=node_exporter.go:113 collector=fibrechannel 2021-03-10T13:43:46.562 INFO:journalctl@ceph.node-exporter.b.gibba045.stdout:Mar 10 13:43:46 gibba045 bash[18255]: level=info ts=2021-03-10T13:43:46.498Z caller=node_exporter.go:113 collector=filefd 2021-03-10T13:43:46.562 INFO:journalctl@ceph.node-exporter.b.gibba045.stdout:Mar 10 13:43:46 gibba045 bash[18255]: level=info ts=2021-03-10T13:43:46.498Z caller=node_exporter.go:113 collector=filesystem 2021-03-10T13:43:46.563 INFO:journalctl@ceph.node-exporter.b.gibba045.stdout:Mar 10 13:43:46 gibba045 bash[18255]: level=info ts=2021-03-10T13:43:46.498Z caller=node_exporter.go:113 collector=hwmon 2021-03-10T13:43:46.563 INFO:journalctl@ceph.node-exporter.b.gibba045.stdout:Mar 10 13:43:46 gibba045 bash[18255]: level=info ts=2021-03-10T13:43:46.498Z caller=node_exporter.go:113 collector=infiniband 2021-03-10T13:43:46.563 INFO:journalctl@ceph.node-exporter.b.gibba045.stdout:Mar 10 13:43:46 gibba045 bash[18255]: level=info ts=2021-03-10T13:43:46.498Z caller=node_exporter.go:113 collector=ipvs 2021-03-10T13:43:46.563 INFO:journalctl@ceph.node-exporter.b.gibba045.stdout:Mar 10 13:43:46 gibba045 bash[18255]: level=info ts=2021-03-10T13:43:46.498Z caller=node_exporter.go:113 collector=loadavg 2021-03-10T13:43:46.564 INFO:journalctl@ceph.node-exporter.b.gibba045.stdout:Mar 10 13:43:46 gibba045 bash[18255]: level=info ts=2021-03-10T13:43:46.498Z caller=node_exporter.go:113 collector=mdadm 2021-03-10T13:43:46.564 INFO:journalctl@ceph.node-exporter.b.gibba045.stdout:Mar 10 13:43:46 gibba045 bash[18255]: level=info ts=2021-03-10T13:43:46.498Z caller=node_exporter.go:113 collector=meminfo 2021-03-10T13:43:46.564 INFO:journalctl@ceph.node-exporter.b.gibba045.stdout:Mar 10 13:43:46 gibba045 bash[18255]: level=info ts=2021-03-10T13:43:46.498Z caller=node_exporter.go:113 collector=netclass 2021-03-10T13:43:46.564 INFO:journalctl@ceph.node-exporter.b.gibba045.stdout:Mar 10 13:43:46 gibba045 bash[18255]: level=info ts=2021-03-10T13:43:46.498Z caller=node_exporter.go:113 collector=netdev 2021-03-10T13:43:46.564 INFO:journalctl@ceph.node-exporter.b.gibba045.stdout:Mar 10 13:43:46 gibba045 bash[18255]: level=info ts=2021-03-10T13:43:46.498Z caller=node_exporter.go:113 collector=netstat 2021-03-10T13:43:46.565 INFO:journalctl@ceph.node-exporter.b.gibba045.stdout:Mar 10 13:43:46 gibba045 bash[18255]: level=info ts=2021-03-10T13:43:46.498Z caller=node_exporter.go:113 collector=nfs 2021-03-10T13:43:46.565 INFO:journalctl@ceph.node-exporter.b.gibba045.stdout:Mar 10 13:43:46 gibba045 bash[18255]: level=info ts=2021-03-10T13:43:46.498Z caller=node_exporter.go:113 collector=nfsd 2021-03-10T13:43:46.565 INFO:journalctl@ceph.node-exporter.b.gibba045.stdout:Mar 10 13:43:46 gibba045 bash[18255]: level=info ts=2021-03-10T13:43:46.498Z caller=node_exporter.go:113 collector=powersupplyclass 2021-03-10T13:43:46.565 INFO:journalctl@ceph.node-exporter.b.gibba045.stdout:Mar 10 13:43:46 gibba045 bash[18255]: level=info ts=2021-03-10T13:43:46.498Z caller=node_exporter.go:113 collector=pressure 2021-03-10T13:43:46.565 INFO:journalctl@ceph.node-exporter.b.gibba045.stdout:Mar 10 13:43:46 gibba045 bash[18255]: level=info ts=2021-03-10T13:43:46.498Z caller=node_exporter.go:113 collector=rapl 2021-03-10T13:43:46.566 INFO:journalctl@ceph.node-exporter.b.gibba045.stdout:Mar 10 13:43:46 gibba045 bash[18255]: level=info ts=2021-03-10T13:43:46.498Z caller=node_exporter.go:113 collector=schedstat 2021-03-10T13:43:46.566 INFO:journalctl@ceph.node-exporter.b.gibba045.stdout:Mar 10 13:43:46 gibba045 bash[18255]: level=info ts=2021-03-10T13:43:46.498Z caller=node_exporter.go:113 collector=sockstat 2021-03-10T13:43:46.566 INFO:journalctl@ceph.node-exporter.b.gibba045.stdout:Mar 10 13:43:46 gibba045 bash[18255]: level=info ts=2021-03-10T13:43:46.498Z caller=node_exporter.go:113 collector=softnet 2021-03-10T13:43:46.566 INFO:journalctl@ceph.node-exporter.b.gibba045.stdout:Mar 10 13:43:46 gibba045 bash[18255]: level=info ts=2021-03-10T13:43:46.498Z caller=node_exporter.go:113 collector=stat 2021-03-10T13:43:46.567 INFO:journalctl@ceph.node-exporter.b.gibba045.stdout:Mar 10 13:43:46 gibba045 bash[18255]: level=info ts=2021-03-10T13:43:46.498Z caller=node_exporter.go:113 collector=textfile 2021-03-10T13:43:46.567 INFO:journalctl@ceph.node-exporter.b.gibba045.stdout:Mar 10 13:43:46 gibba045 bash[18255]: level=info ts=2021-03-10T13:43:46.498Z caller=node_exporter.go:113 collector=thermal_zone 2021-03-10T13:43:46.567 INFO:journalctl@ceph.node-exporter.b.gibba045.stdout:Mar 10 13:43:46 gibba045 bash[18255]: level=info ts=2021-03-10T13:43:46.498Z caller=node_exporter.go:113 collector=time 2021-03-10T13:43:46.567 INFO:journalctl@ceph.node-exporter.b.gibba045.stdout:Mar 10 13:43:46 gibba045 bash[18255]: level=info ts=2021-03-10T13:43:46.498Z caller=node_exporter.go:113 collector=udp_queues 2021-03-10T13:43:46.567 INFO:journalctl@ceph.node-exporter.b.gibba045.stdout:Mar 10 13:43:46 gibba045 bash[18255]: level=info ts=2021-03-10T13:43:46.498Z caller=node_exporter.go:113 collector=uname 2021-03-10T13:43:46.568 INFO:journalctl@ceph.node-exporter.b.gibba045.stdout:Mar 10 13:43:46 gibba045 bash[18255]: level=info ts=2021-03-10T13:43:46.498Z caller=node_exporter.go:113 collector=vmstat 2021-03-10T13:43:46.568 INFO:journalctl@ceph.node-exporter.b.gibba045.stdout:Mar 10 13:43:46 gibba045 bash[18255]: level=info ts=2021-03-10T13:43:46.498Z caller=node_exporter.go:113 collector=xfs 2021-03-10T13:43:46.568 INFO:journalctl@ceph.node-exporter.b.gibba045.stdout:Mar 10 13:43:46 gibba045 bash[18255]: level=info ts=2021-03-10T13:43:46.498Z caller=node_exporter.go:113 collector=zfs 2021-03-10T13:43:46.568 INFO:journalctl@ceph.node-exporter.b.gibba045.stdout:Mar 10 13:43:46 gibba045 bash[18255]: level=info ts=2021-03-10T13:43:46.498Z caller=node_exporter.go:195 msg="Listening on" address=:9100 2021-03-10T13:43:46.568 INFO:journalctl@ceph.node-exporter.b.gibba045.stdout:Mar 10 13:43:46 gibba045 bash[18255]: level=info ts=2021-03-10T13:43:46.499Z caller=tls_config.go:191 msg="TLS is disabled." http2=false 2021-03-10T13:43:46.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:46 gibba015 bash[9806]: cluster 2021-03-10T13:43:45.144684+0000 mgr.y (mgr.14140) 173 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:43:46.722 INFO:journalctl@ceph.node-exporter.a.gibba015.stdout:Mar 10 13:43:46 gibba015 bash[19675]: 613f88646930: Pull complete 2021-03-10T13:43:46.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:46 gibba015 bash[13005]: cluster 2021-03-10T13:43:45.144684+0000 mgr.y (mgr.14140) 173 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:43:47.471 INFO:journalctl@ceph.node-exporter.a.gibba015.stdout:Mar 10 13:43:47 gibba015 bash[19675]: edad907fb257: Pull complete 2021-03-10T13:43:47.471 INFO:journalctl@ceph.node-exporter.a.gibba015.stdout:Mar 10 13:43:47 gibba015 bash[19675]: Digest: sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810 2021-03-10T13:43:47.845 INFO:journalctl@ceph.node-exporter.a.gibba015.stdout:Mar 10 13:43:47 gibba015 bash[19675]: Status: Downloaded newer image for prom/node-exporter:latest 2021-03-10T13:43:48.411 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:48 gibba015 bash[9806]: cluster 2021-03-10T13:43:47.145023+0000 mgr.y (mgr.14140) 174 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:43:48.412 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:48 gibba015 bash[13005]: cluster 2021-03-10T13:43:47.145023+0000 mgr.y (mgr.14140) 174 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:43:48.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:48 gibba045 bash[9787]: cluster 2021-03-10T13:43:47.145023+0000 mgr.y (mgr.14140) 174 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:43:50.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:50 gibba015 bash[9806]: cluster 2021-03-10T13:43:49.145789+0000 mgr.y (mgr.14140) 175 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:43:50.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:50 gibba015 bash[13005]: cluster 2021-03-10T13:43:49.145789+0000 mgr.y (mgr.14140) 175 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:43:50.223 INFO:journalctl@ceph.node-exporter.a.gibba015.stdout:Mar 10 13:43:50 gibba015 bash[19675]: level=info ts=2021-03-10T13:43:50.088Z caller=node_exporter.go:178 msg="Starting node_exporter" version="(version=1.1.2, branch=HEAD, revision=b597c1244d7bef49e6f3359c87a56dd7707f6719)" 2021-03-10T13:43:50.223 INFO:journalctl@ceph.node-exporter.a.gibba015.stdout:Mar 10 13:43:50 gibba015 bash[19675]: level=info ts=2021-03-10T13:43:50.088Z caller=node_exporter.go:179 msg="Build context" build_context="(go=go1.15.8, user=root@f07de8ca602a, date=20210305-09:29:10)" 2021-03-10T13:43:50.223 INFO:journalctl@ceph.node-exporter.a.gibba015.stdout:Mar 10 13:43:50 gibba015 bash[19675]: level=info ts=2021-03-10T13:43:50.088Z caller=filesystem_common.go:74 collector=filesystem msg="Parsed flag --collector.filesystem.ignored-mount-points" flag=^/(dev|proc|sys|var/lib/docker/.+)($|/) 2021-03-10T13:43:50.223 INFO:journalctl@ceph.node-exporter.a.gibba015.stdout:Mar 10 13:43:50 gibba015 bash[19675]: level=info ts=2021-03-10T13:43:50.088Z caller=filesystem_common.go:76 collector=filesystem msg="Parsed flag --collector.filesystem.ignored-fs-types" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2021-03-10T13:43:50.223 INFO:journalctl@ceph.node-exporter.a.gibba015.stdout:Mar 10 13:43:50 gibba015 bash[19675]: level=info ts=2021-03-10T13:43:50.088Z caller=node_exporter.go:106 msg="Enabled collectors" 2021-03-10T13:43:50.224 INFO:journalctl@ceph.node-exporter.a.gibba015.stdout:Mar 10 13:43:50 gibba015 bash[19675]: level=info ts=2021-03-10T13:43:50.088Z caller=node_exporter.go:113 collector=arp 2021-03-10T13:43:50.224 INFO:journalctl@ceph.node-exporter.a.gibba015.stdout:Mar 10 13:43:50 gibba015 bash[19675]: level=info ts=2021-03-10T13:43:50.088Z caller=node_exporter.go:113 collector=bcache 2021-03-10T13:43:50.224 INFO:journalctl@ceph.node-exporter.a.gibba015.stdout:Mar 10 13:43:50 gibba015 bash[19675]: level=info ts=2021-03-10T13:43:50.088Z caller=node_exporter.go:113 collector=bonding 2021-03-10T13:43:50.224 INFO:journalctl@ceph.node-exporter.a.gibba015.stdout:Mar 10 13:43:50 gibba015 bash[19675]: level=info ts=2021-03-10T13:43:50.088Z caller=node_exporter.go:113 collector=btrfs 2021-03-10T13:43:50.224 INFO:journalctl@ceph.node-exporter.a.gibba015.stdout:Mar 10 13:43:50 gibba015 bash[19675]: level=info ts=2021-03-10T13:43:50.088Z caller=node_exporter.go:113 collector=conntrack 2021-03-10T13:43:50.225 INFO:journalctl@ceph.node-exporter.a.gibba015.stdout:Mar 10 13:43:50 gibba015 bash[19675]: level=info ts=2021-03-10T13:43:50.088Z caller=node_exporter.go:113 collector=cpu 2021-03-10T13:43:50.225 INFO:journalctl@ceph.node-exporter.a.gibba015.stdout:Mar 10 13:43:50 gibba015 bash[19675]: level=info ts=2021-03-10T13:43:50.088Z caller=node_exporter.go:113 collector=cpufreq 2021-03-10T13:43:50.225 INFO:journalctl@ceph.node-exporter.a.gibba015.stdout:Mar 10 13:43:50 gibba015 bash[19675]: level=info ts=2021-03-10T13:43:50.088Z caller=node_exporter.go:113 collector=diskstats 2021-03-10T13:43:50.225 INFO:journalctl@ceph.node-exporter.a.gibba015.stdout:Mar 10 13:43:50 gibba015 bash[19675]: level=info ts=2021-03-10T13:43:50.088Z caller=node_exporter.go:113 collector=edac 2021-03-10T13:43:50.226 INFO:journalctl@ceph.node-exporter.a.gibba015.stdout:Mar 10 13:43:50 gibba015 bash[19675]: level=info ts=2021-03-10T13:43:50.088Z caller=node_exporter.go:113 collector=entropy 2021-03-10T13:43:50.226 INFO:journalctl@ceph.node-exporter.a.gibba015.stdout:Mar 10 13:43:50 gibba015 bash[19675]: level=info ts=2021-03-10T13:43:50.088Z caller=node_exporter.go:113 collector=fibrechannel 2021-03-10T13:43:50.226 INFO:journalctl@ceph.node-exporter.a.gibba015.stdout:Mar 10 13:43:50 gibba015 bash[19675]: level=info ts=2021-03-10T13:43:50.088Z caller=node_exporter.go:113 collector=filefd 2021-03-10T13:43:50.226 INFO:journalctl@ceph.node-exporter.a.gibba015.stdout:Mar 10 13:43:50 gibba015 bash[19675]: level=info ts=2021-03-10T13:43:50.088Z caller=node_exporter.go:113 collector=filesystem 2021-03-10T13:43:50.226 INFO:journalctl@ceph.node-exporter.a.gibba015.stdout:Mar 10 13:43:50 gibba015 bash[19675]: level=info ts=2021-03-10T13:43:50.088Z caller=node_exporter.go:113 collector=hwmon 2021-03-10T13:43:50.227 INFO:journalctl@ceph.node-exporter.a.gibba015.stdout:Mar 10 13:43:50 gibba015 bash[19675]: level=info ts=2021-03-10T13:43:50.088Z caller=node_exporter.go:113 collector=infiniband 2021-03-10T13:43:50.227 INFO:journalctl@ceph.node-exporter.a.gibba015.stdout:Mar 10 13:43:50 gibba015 bash[19675]: level=info ts=2021-03-10T13:43:50.088Z caller=node_exporter.go:113 collector=ipvs 2021-03-10T13:43:50.227 INFO:journalctl@ceph.node-exporter.a.gibba015.stdout:Mar 10 13:43:50 gibba015 bash[19675]: level=info ts=2021-03-10T13:43:50.088Z caller=node_exporter.go:113 collector=loadavg 2021-03-10T13:43:50.227 INFO:journalctl@ceph.node-exporter.a.gibba015.stdout:Mar 10 13:43:50 gibba015 bash[19675]: level=info ts=2021-03-10T13:43:50.088Z caller=node_exporter.go:113 collector=mdadm 2021-03-10T13:43:50.227 INFO:journalctl@ceph.node-exporter.a.gibba015.stdout:Mar 10 13:43:50 gibba015 bash[19675]: level=info ts=2021-03-10T13:43:50.088Z caller=node_exporter.go:113 collector=meminfo 2021-03-10T13:43:50.228 INFO:journalctl@ceph.node-exporter.a.gibba015.stdout:Mar 10 13:43:50 gibba015 bash[19675]: level=info ts=2021-03-10T13:43:50.088Z caller=node_exporter.go:113 collector=netclass 2021-03-10T13:43:50.228 INFO:journalctl@ceph.node-exporter.a.gibba015.stdout:Mar 10 13:43:50 gibba015 bash[19675]: level=info ts=2021-03-10T13:43:50.088Z caller=node_exporter.go:113 collector=netdev 2021-03-10T13:43:50.228 INFO:journalctl@ceph.node-exporter.a.gibba015.stdout:Mar 10 13:43:50 gibba015 bash[19675]: level=info ts=2021-03-10T13:43:50.088Z caller=node_exporter.go:113 collector=netstat 2021-03-10T13:43:50.228 INFO:journalctl@ceph.node-exporter.a.gibba015.stdout:Mar 10 13:43:50 gibba015 bash[19675]: level=info ts=2021-03-10T13:43:50.088Z caller=node_exporter.go:113 collector=nfs 2021-03-10T13:43:50.228 INFO:journalctl@ceph.node-exporter.a.gibba015.stdout:Mar 10 13:43:50 gibba015 bash[19675]: level=info ts=2021-03-10T13:43:50.088Z caller=node_exporter.go:113 collector=nfsd 2021-03-10T13:43:50.229 INFO:journalctl@ceph.node-exporter.a.gibba015.stdout:Mar 10 13:43:50 gibba015 bash[19675]: level=info ts=2021-03-10T13:43:50.088Z caller=node_exporter.go:113 collector=powersupplyclass 2021-03-10T13:43:50.229 INFO:journalctl@ceph.node-exporter.a.gibba015.stdout:Mar 10 13:43:50 gibba015 bash[19675]: level=info ts=2021-03-10T13:43:50.088Z caller=node_exporter.go:113 collector=pressure 2021-03-10T13:43:50.229 INFO:journalctl@ceph.node-exporter.a.gibba015.stdout:Mar 10 13:43:50 gibba015 bash[19675]: level=info ts=2021-03-10T13:43:50.088Z caller=node_exporter.go:113 collector=rapl 2021-03-10T13:43:50.229 INFO:journalctl@ceph.node-exporter.a.gibba015.stdout:Mar 10 13:43:50 gibba015 bash[19675]: level=info ts=2021-03-10T13:43:50.088Z caller=node_exporter.go:113 collector=schedstat 2021-03-10T13:43:50.229 INFO:journalctl@ceph.node-exporter.a.gibba015.stdout:Mar 10 13:43:50 gibba015 bash[19675]: level=info ts=2021-03-10T13:43:50.088Z caller=node_exporter.go:113 collector=sockstat 2021-03-10T13:43:50.230 INFO:journalctl@ceph.node-exporter.a.gibba015.stdout:Mar 10 13:43:50 gibba015 bash[19675]: level=info ts=2021-03-10T13:43:50.088Z caller=node_exporter.go:113 collector=softnet 2021-03-10T13:43:50.230 INFO:journalctl@ceph.node-exporter.a.gibba015.stdout:Mar 10 13:43:50 gibba015 bash[19675]: level=info ts=2021-03-10T13:43:50.088Z caller=node_exporter.go:113 collector=stat 2021-03-10T13:43:50.230 INFO:journalctl@ceph.node-exporter.a.gibba015.stdout:Mar 10 13:43:50 gibba015 bash[19675]: level=info ts=2021-03-10T13:43:50.088Z caller=node_exporter.go:113 collector=textfile 2021-03-10T13:43:50.230 INFO:journalctl@ceph.node-exporter.a.gibba015.stdout:Mar 10 13:43:50 gibba015 bash[19675]: level=info ts=2021-03-10T13:43:50.089Z caller=node_exporter.go:113 collector=thermal_zone 2021-03-10T13:43:50.230 INFO:journalctl@ceph.node-exporter.a.gibba015.stdout:Mar 10 13:43:50 gibba015 bash[19675]: level=info ts=2021-03-10T13:43:50.089Z caller=node_exporter.go:113 collector=time 2021-03-10T13:43:50.231 INFO:journalctl@ceph.node-exporter.a.gibba015.stdout:Mar 10 13:43:50 gibba015 bash[19675]: level=info ts=2021-03-10T13:43:50.089Z caller=node_exporter.go:113 collector=udp_queues 2021-03-10T13:43:50.231 INFO:journalctl@ceph.node-exporter.a.gibba015.stdout:Mar 10 13:43:50 gibba015 bash[19675]: level=info ts=2021-03-10T13:43:50.089Z caller=node_exporter.go:113 collector=uname 2021-03-10T13:43:50.231 INFO:journalctl@ceph.node-exporter.a.gibba015.stdout:Mar 10 13:43:50 gibba015 bash[19675]: level=info ts=2021-03-10T13:43:50.089Z caller=node_exporter.go:113 collector=vmstat 2021-03-10T13:43:50.231 INFO:journalctl@ceph.node-exporter.a.gibba015.stdout:Mar 10 13:43:50 gibba015 bash[19675]: level=info ts=2021-03-10T13:43:50.089Z caller=node_exporter.go:113 collector=xfs 2021-03-10T13:43:50.231 INFO:journalctl@ceph.node-exporter.a.gibba015.stdout:Mar 10 13:43:50 gibba015 bash[19675]: level=info ts=2021-03-10T13:43:50.089Z caller=node_exporter.go:113 collector=zfs 2021-03-10T13:43:50.232 INFO:journalctl@ceph.node-exporter.a.gibba015.stdout:Mar 10 13:43:50 gibba015 bash[19675]: level=info ts=2021-03-10T13:43:50.089Z caller=node_exporter.go:195 msg="Listening on" address=:9100 2021-03-10T13:43:50.232 INFO:journalctl@ceph.node-exporter.a.gibba015.stdout:Mar 10 13:43:50 gibba015 bash[19675]: level=info ts=2021-03-10T13:43:50.089Z caller=tls_config.go:191 msg="TLS is disabled." http2=false 2021-03-10T13:43:50.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:50 gibba045 bash[9787]: cluster 2021-03-10T13:43:49.145789+0000 mgr.y (mgr.14140) 175 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:43:51.584 INFO:teuthology.orchestra.run.gibba015.stdout:[client.0] 2021-03-10T13:43:51.585 INFO:teuthology.orchestra.run.gibba015.stdout: key = AQAXzUhgLWiEIhAAQ02FrjzW3FwvtIsNq1QMag== 2021-03-10T13:43:52.386 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:52 gibba015 bash[9806]: cluster 2021-03-10T13:43:51.146500+0000 mgr.y (mgr.14140) 176 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:43:52.387 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:52 gibba015 bash[9806]: audit 2021-03-10T13:43:51.579013+0000 mon.a (mon.0) 490 : audit [INF] from='client.? 172.21.2.115:0/620142666' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-03-10T13:43:52.387 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:52 gibba015 bash[9806]: audit 2021-03-10T13:43:51.583062+0000 mon.a (mon.0) 491 : audit [INF] from='client.? 172.21.2.115:0/620142666' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-03-10T13:43:52.387 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:52 gibba015 bash[13005]: cluster 2021-03-10T13:43:51.146500+0000 mgr.y (mgr.14140) 176 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:43:52.388 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:52 gibba015 bash[13005]: audit 2021-03-10T13:43:51.579013+0000 mon.a (mon.0) 490 : audit [INF] from='client.? 172.21.2.115:0/620142666' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-03-10T13:43:52.388 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:52 gibba015 bash[13005]: audit 2021-03-10T13:43:51.583062+0000 mon.a (mon.0) 491 : audit [INF] from='client.? 172.21.2.115:0/620142666' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-03-10T13:43:52.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:52 gibba045 bash[9787]: cluster 2021-03-10T13:43:51.146500+0000 mgr.y (mgr.14140) 176 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:43:52.571 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:52 gibba045 bash[9787]: audit 2021-03-10T13:43:51.579013+0000 mon.a (mon.0) 490 : audit [INF] from='client.? 172.21.2.115:0/620142666' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-03-10T13:43:52.571 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:52 gibba045 bash[9787]: audit 2021-03-10T13:43:51.583062+0000 mon.a (mon.0) 491 : audit [INF] from='client.? 172.21.2.115:0/620142666' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-03-10T13:43:52.773 DEBUG:teuthology.orchestra.run.gibba015:> set -ex 2021-03-10T13:43:52.773 DEBUG:teuthology.orchestra.run.gibba015:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2021-03-10T13:43:52.774 DEBUG:teuthology.orchestra.run.gibba015:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2021-03-10T13:43:52.783 DEBUG:teuthology.orchestra.run.gibba045:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e4a642d2-81a5-11eb-9080-001a4aab830c -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2021-03-10T13:43:54.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:54 gibba015 bash[13005]: cluster 2021-03-10T13:43:53.147181+0000 mgr.y (mgr.14140) 177 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:43:54.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:54 gibba015 bash[9806]: cluster 2021-03-10T13:43:53.147181+0000 mgr.y (mgr.14140) 177 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:43:54.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:54 gibba045 bash[9787]: cluster 2021-03-10T13:43:53.147181+0000 mgr.y (mgr.14140) 177 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:43:54.721 INFO:journalctl@ceph.alertmanager.a.gibba015.stdout:Mar 10 13:43:54 gibba015 docker[20259]: Error: No such container: ceph-e4a642d2-81a5-11eb-9080-001a4aab830c-alertmanager.a 2021-03-10T13:43:54.721 INFO:journalctl@ceph.alertmanager.a.gibba015.stdout:Mar 10 13:43:54 gibba015 systemd[1]: Started Ceph alertmanager.a for e4a642d2-81a5-11eb-9080-001a4aab830c. 2021-03-10T13:43:55.402 INFO:teuthology.orchestra.run.gibba045.stdout:[client.1] 2021-03-10T13:43:55.403 INFO:teuthology.orchestra.run.gibba045.stdout: key = AQAbzUhgeh2mFxAA7CpNQIn8+5uEz1qqIlXX1g== 2021-03-10T13:43:55.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:55 gibba015 bash[9806]: audit 2021-03-10T13:43:54.642210+0000 mon.a (mon.0) 492 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985622\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985680\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985710\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985736\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985762\", \"created\": \"2021-03-10T13:41:11.556448\", \"started\": \"2021-03-10T13:41:15.069232\"}, \"osd.2\": {\"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985788\", \"created\": \"2021-03-10T13:41:34.244448\", \"started\": \"2021-03-10T13:41:37.507096\"}, \"osd.3\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985813\", \"created\": \"2021-03-10T13:41:57.328380\"}, \"node-exporter.a\": {\"hostname\": \"gibba015\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}, \"alertmanager.a\": {\"hostname\": \"gibba015\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:44.286749\"}}, \"last_device_update\": \"2021-03-10T13:42:03.853072\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]: dispatch 2021-03-10T13:43:55.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:55 gibba015 bash[9806]: audit 2021-03-10T13:43:54.645738+0000 mon.a (mon.0) 493 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985622\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985680\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985710\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985736\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985762\", \"created\": \"2021-03-10T13:41:11.556448\", \"started\": \"2021-03-10T13:41:15.069232\"}, \"osd.2\": {\"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985788\", \"created\": \"2021-03-10T13:41:34.244448\", \"started\": \"2021-03-10T13:41:37.507096\"}, \"osd.3\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985813\", \"created\": \"2021-03-10T13:41:57.328380\"}, \"node-exporter.a\": {\"hostname\": \"gibba015\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}, \"alertmanager.a\": {\"hostname\": \"gibba015\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:44.286749\"}}, \"last_device_update\": \"2021-03-10T13:42:03.853072\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]': finished 2021-03-10T13:43:55.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:55 gibba015 bash[9806]: audit 2021-03-10T13:43:54.646225+0000 mon.a (mon.0) 494 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:43:55.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:55 gibba015 bash[13005]: audit 2021-03-10T13:43:54.642210+0000 mon.a (mon.0) 492 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985622\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985680\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985710\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985736\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985762\", \"created\": \"2021-03-10T13:41:11.556448\", \"started\": \"2021-03-10T13:41:15.069232\"}, \"osd.2\": {\"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985788\", \"created\": \"2021-03-10T13:41:34.244448\", \"started\": \"2021-03-10T13:41:37.507096\"}, \"osd.3\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985813\", \"created\": \"2021-03-10T13:41:57.328380\"}, \"node-exporter.a\": {\"hostname\": \"gibba015\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}, \"alertmanager.a\": {\"hostname\": \"gibba015\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:44.286749\"}}, \"last_device_update\": \"2021-03-10T13:42:03.853072\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]: dispatch 2021-03-10T13:43:55.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:55 gibba015 bash[13005]: audit 2021-03-10T13:43:54.645738+0000 mon.a (mon.0) 493 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985622\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985680\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985710\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985736\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985762\", \"created\": \"2021-03-10T13:41:11.556448\", \"started\": \"2021-03-10T13:41:15.069232\"}, \"osd.2\": {\"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985788\", \"created\": \"2021-03-10T13:41:34.244448\", \"started\": \"2021-03-10T13:41:37.507096\"}, \"osd.3\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985813\", \"created\": \"2021-03-10T13:41:57.328380\"}, \"node-exporter.a\": {\"hostname\": \"gibba015\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}, \"alertmanager.a\": {\"hostname\": \"gibba015\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:44.286749\"}}, \"last_device_update\": \"2021-03-10T13:42:03.853072\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]': finished 2021-03-10T13:43:55.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:55 gibba015 bash[13005]: audit 2021-03-10T13:43:54.646225+0000 mon.a (mon.0) 494 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:43:55.477 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:55 gibba045 bash[9787]: audit 2021-03-10T13:43:54.642210+0000 mon.a (mon.0) 492 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985622\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985680\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985710\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985736\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985762\", \"created\": \"2021-03-10T13:41:11.556448\", \"started\": \"2021-03-10T13:41:15.069232\"}, \"osd.2\": {\"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985788\", \"created\": \"2021-03-10T13:41:34.244448\", \"started\": \"2021-03-10T13:41:37.507096\"}, \"osd.3\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985813\", \"created\": \"2021-03-10T13:41:57.328380\"}, \"node-exporter.a\": {\"hostname\": \"gibba015\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}, \"alertmanager.a\": {\"hostname\": \"gibba015\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:44.286749\"}}, \"last_device_update\": \"2021-03-10T13:42:03.853072\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]: dispatch 2021-03-10T13:43:55.477 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:55 gibba045 bash[9787]: audit 2021-03-10T13:43:54.645738+0000 mon.a (mon.0) 493 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985622\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985680\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985710\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985736\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985762\", \"created\": \"2021-03-10T13:41:11.556448\", \"started\": \"2021-03-10T13:41:15.069232\"}, \"osd.2\": {\"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985788\", \"created\": \"2021-03-10T13:41:34.244448\", \"started\": \"2021-03-10T13:41:37.507096\"}, \"osd.3\": {\"hostname\": \"gibba015\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:41:57.985813\", \"created\": \"2021-03-10T13:41:57.328380\"}, \"node-exporter.a\": {\"hostname\": \"gibba015\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}, \"alertmanager.a\": {\"hostname\": \"gibba015\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:44.286749\"}}, \"last_device_update\": \"2021-03-10T13:42:03.853072\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]': finished 2021-03-10T13:43:55.477 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:55 gibba045 bash[9787]: audit 2021-03-10T13:43:54.646225+0000 mon.a (mon.0) 494 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:43:55.972 INFO:journalctl@ceph.alertmanager.a.gibba015.stdout:Mar 10 13:43:55 gibba015 bash[20279]: level=info ts=2021-03-10T13:43:55.684Z caller=main.go:216 msg="Starting Alertmanager" version="(version=0.21.0, branch=HEAD, revision=4c6c03ebfe21009c546e4d1e9b92c371d67c021d)" 2021-03-10T13:43:55.972 INFO:journalctl@ceph.alertmanager.a.gibba015.stdout:Mar 10 13:43:55 gibba015 bash[20279]: level=info ts=2021-03-10T13:43:55.684Z caller=main.go:217 build_context="(go=go1.14.4, user=root@dee35927357f, date=20200617-08:54:02)" 2021-03-10T13:43:55.972 INFO:journalctl@ceph.alertmanager.a.gibba015.stdout:Mar 10 13:43:55 gibba015 bash[20279]: level=info ts=2021-03-10T13:43:55.686Z caller=cluster.go:161 component=cluster msg="setting advertise address explicitly" addr=172.21.2.115 port=9094 2021-03-10T13:43:55.972 INFO:journalctl@ceph.alertmanager.a.gibba015.stdout:Mar 10 13:43:55 gibba015 bash[20279]: level=info ts=2021-03-10T13:43:55.687Z caller=cluster.go:623 component=cluster msg="Waiting for gossip to settle..." interval=2s 2021-03-10T13:43:55.973 INFO:journalctl@ceph.alertmanager.a.gibba015.stdout:Mar 10 13:43:55 gibba015 bash[20279]: level=info ts=2021-03-10T13:43:55.709Z caller=coordinator.go:119 component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2021-03-10T13:43:55.973 INFO:journalctl@ceph.alertmanager.a.gibba015.stdout:Mar 10 13:43:55 gibba015 bash[20279]: level=info ts=2021-03-10T13:43:55.709Z caller=coordinator.go:131 component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2021-03-10T13:43:55.973 INFO:journalctl@ceph.alertmanager.a.gibba015.stdout:Mar 10 13:43:55 gibba015 bash[20279]: level=info ts=2021-03-10T13:43:55.711Z caller=main.go:485 msg=Listening address=:9093 2021-03-10T13:43:55.974 DEBUG:teuthology.orchestra.run.gibba045:> set -ex 2021-03-10T13:43:55.975 DEBUG:teuthology.orchestra.run.gibba045:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2021-03-10T13:43:55.975 DEBUG:teuthology.orchestra.run.gibba045:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2021-03-10T13:43:55.983 DEBUG:teuthology.orchestra.run.gibba015:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid e4a642d2-81a5-11eb-9080-001a4aab830c -- ceph osd dump --format=json 2021-03-10T13:43:56.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:56 gibba045 bash[9787]: cluster 2021-03-10T13:43:55.147529+0000 mgr.y (mgr.14140) 178 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:43:56.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:56 gibba045 bash[9787]: audit 2021-03-10T13:43:55.395407+0000 mon.b (mon.2) 22 : audit [INF] from='client.? 172.21.2.145:0/488941088' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-03-10T13:43:56.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:56 gibba045 bash[9787]: audit 2021-03-10T13:43:55.396619+0000 mon.a (mon.0) 495 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-03-10T13:43:56.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:56 gibba045 bash[9787]: audit 2021-03-10T13:43:55.401011+0000 mon.a (mon.0) 496 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-03-10T13:43:56.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:56 gibba045 bash[9787]: audit 2021-03-10T13:43:55.952820+0000 mon.a (mon.0) 497 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:55.951863\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:55.951923\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:55.951953\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:55.951980\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:55.952008\", \"created\": \"2021-03-10T13:41:11.556448\", \"started\": \"2021-03-10T13:41:15.069232\"}, \"osd.2\": {\"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:55.952034\", \"created\": \"2021-03-10T13:41:34.244448\", \"started\": \"2021-03-10T13:41:37.507096\"}, \"osd.3\": {\"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:55.952060\", \"created\": \"2021-03-10T13:41:57.328380\", \"started\": \"2021-03-10T13:42:00.781947\"}, \"node-exporter.a\": {\"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:55.952087\", \"created\": \"2021-03-10T13:43:44.272379\", \"started\": \"2021-03-10T13:43:47.550063\"}, \"alertmanager.a\": {\"hostname\": \"gibba015\", \"container_id\": \"a6e6a6bfd056\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:55.952113\", \"created\": \"2021-03-10T13:43:54.628379\", \"started\": \"2021-03-10T13:43:54.655085\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:44.286749\"}}, \"last_daemon_update\": \"2021-03-10T13:43:55.952175\", \"last_device_update\": \"2021-03-10T13:42:03.853072\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]: dispatch 2021-03-10T13:43:56.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:56 gibba045 bash[9787]: audit 2021-03-10T13:43:55.956563+0000 mon.a (mon.0) 498 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:55.951863\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:55.951923\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:55.951953\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:55.951980\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:55.952008\", \"created\": \"2021-03-10T13:41:11.556448\", \"started\": \"2021-03-10T13:41:15.069232\"}, \"osd.2\": {\"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:55.952034\", \"created\": \"2021-03-10T13:41:34.244448\", \"started\": \"2021-03-10T13:41:37.507096\"}, \"osd.3\": {\"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:55.952060\", \"created\": \"2021-03-10T13:41:57.328380\", \"started\": \"2021-03-10T13:42:00.781947\"}, \"node-exporter.a\": {\"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:55.952087\", \"created\": \"2021-03-10T13:43:44.272379\", \"started\": \"2021-03-10T13:43:47.550063\"}, \"alertmanager.a\": {\"hostname\": \"gibba015\", \"container_id\": \"a6e6a6bfd056\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:55.952113\", \"created\": \"2021-03-10T13:43:54.628379\", \"started\": \"2021-03-10T13:43:54.655085\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:44.286749\"}}, \"last_daemon_update\": \"2021-03-10T13:43:55.952175\", \"last_device_update\": \"2021-03-10T13:42:03.853072\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]': finished 2021-03-10T13:43:56.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:56 gibba045 bash[9787]: audit 2021-03-10T13:43:55.957009+0000 mon.a (mon.0) 499 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:43:56.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:56 gibba015 bash[9806]: cluster 2021-03-10T13:43:55.147529+0000 mgr.y (mgr.14140) 178 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:43:56.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:56 gibba015 bash[9806]: audit 2021-03-10T13:43:55.395407+0000 mon.b (mon.2) 22 : audit [INF] from='client.? 172.21.2.145:0/488941088' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-03-10T13:43:56.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:56 gibba015 bash[9806]: audit 2021-03-10T13:43:55.396619+0000 mon.a (mon.0) 495 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-03-10T13:43:56.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:56 gibba015 bash[9806]: audit 2021-03-10T13:43:55.401011+0000 mon.a (mon.0) 496 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-03-10T13:43:56.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:56 gibba015 bash[13005]: cluster 2021-03-10T13:43:55.147529+0000 mgr.y (mgr.14140) 178 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:43:56.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:56 gibba015 bash[13005]: audit 2021-03-10T13:43:55.395407+0000 mon.b (mon.2) 22 : audit [INF] from='client.? 172.21.2.145:0/488941088' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-03-10T13:43:56.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:56 gibba015 bash[13005]: audit 2021-03-10T13:43:55.396619+0000 mon.a (mon.0) 495 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-03-10T13:43:56.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:56 gibba015 bash[13005]: audit 2021-03-10T13:43:55.401011+0000 mon.a (mon.0) 496 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-03-10T13:43:56.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:56 gibba015 bash[9806]: audit 2021-03-10T13:43:55.952820+0000 mon.a (mon.0) 497 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:55.951863\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:55.951923\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:55.951953\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:55.951980\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:55.952008\", \"created\": \"2021-03-10T13:41:11.556448\", \"started\": \"2021-03-10T13:41:15.069232\"}, \"osd.2\": {\"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:55.952034\", \"created\": \"2021-03-10T13:41:34.244448\", \"started\": \"2021-03-10T13:41:37.507096\"}, \"osd.3\": {\"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:55.952060\", \"created\": \"2021-03-10T13:41:57.328380\", \"started\": \"2021-03-10T13:42:00.781947\"}, \"node-exporter.a\": {\"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:55.952087\", \"created\": \"2021-03-10T13:43:44.272379\", \"started\": \"2021-03-10T13:43:47.550063\"}, \"alertmanager.a\": {\"hostname\": \"gibba015\", \"container_id\": \"a6e6a6bfd056\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:55.952113\", \"created\": \"2021-03-10T13:43:54.628379\", \"started\": \"2021-03-10T13:43:54.655085\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:44.286749\"}}, \"last_daemon_update\": \"2021-03-10T13:43:55.952175\", \"last_device_update\": \"2021-03-10T13:42:03.853072\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]: dispatch 2021-03-10T13:43:56.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:56 gibba015 bash[9806]: audit 2021-03-10T13:43:55.956563+0000 mon.a (mon.0) 498 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:55.951863\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:55.951923\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:55.951953\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:55.951980\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:55.952008\", \"created\": \"2021-03-10T13:41:11.556448\", \"started\": \"2021-03-10T13:41:15.069232\"}, \"osd.2\": {\"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:55.952034\", \"created\": \"2021-03-10T13:41:34.244448\", \"started\": \"2021-03-10T13:41:37.507096\"}, \"osd.3\": {\"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:55.952060\", \"created\": \"2021-03-10T13:41:57.328380\", \"started\": \"2021-03-10T13:42:00.781947\"}, \"node-exporter.a\": {\"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:55.952087\", \"created\": \"2021-03-10T13:43:44.272379\", \"started\": \"2021-03-10T13:43:47.550063\"}, \"alertmanager.a\": {\"hostname\": \"gibba015\", \"container_id\": \"a6e6a6bfd056\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:55.952113\", \"created\": \"2021-03-10T13:43:54.628379\", \"started\": \"2021-03-10T13:43:54.655085\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:44.286749\"}}, \"last_daemon_update\": \"2021-03-10T13:43:55.952175\", \"last_device_update\": \"2021-03-10T13:42:03.853072\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]': finished 2021-03-10T13:43:56.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:56 gibba015 bash[9806]: audit 2021-03-10T13:43:55.957009+0000 mon.a (mon.0) 499 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:43:56.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:56 gibba015 bash[13005]: audit 2021-03-10T13:43:55.952820+0000 mon.a (mon.0) 497 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:55.951863\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:55.951923\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:55.951953\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:55.951980\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:55.952008\", \"created\": \"2021-03-10T13:41:11.556448\", \"started\": \"2021-03-10T13:41:15.069232\"}, \"osd.2\": {\"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:55.952034\", \"created\": \"2021-03-10T13:41:34.244448\", \"started\": \"2021-03-10T13:41:37.507096\"}, \"osd.3\": {\"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:55.952060\", \"created\": \"2021-03-10T13:41:57.328380\", \"started\": \"2021-03-10T13:42:00.781947\"}, \"node-exporter.a\": {\"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:55.952087\", \"created\": \"2021-03-10T13:43:44.272379\", \"started\": \"2021-03-10T13:43:47.550063\"}, \"alertmanager.a\": {\"hostname\": \"gibba015\", \"container_id\": \"a6e6a6bfd056\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:55.952113\", \"created\": \"2021-03-10T13:43:54.628379\", \"started\": \"2021-03-10T13:43:54.655085\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:44.286749\"}}, \"last_daemon_update\": \"2021-03-10T13:43:55.952175\", \"last_device_update\": \"2021-03-10T13:42:03.853072\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]: dispatch 2021-03-10T13:43:56.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:56 gibba015 bash[13005]: audit 2021-03-10T13:43:55.956563+0000 mon.a (mon.0) 498 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:55.951863\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:55.951923\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:55.951953\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:55.951980\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:55.952008\", \"created\": \"2021-03-10T13:41:11.556448\", \"started\": \"2021-03-10T13:41:15.069232\"}, \"osd.2\": {\"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:55.952034\", \"created\": \"2021-03-10T13:41:34.244448\", \"started\": \"2021-03-10T13:41:37.507096\"}, \"osd.3\": {\"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:55.952060\", \"created\": \"2021-03-10T13:41:57.328380\", \"started\": \"2021-03-10T13:42:00.781947\"}, \"node-exporter.a\": {\"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:55.952087\", \"created\": \"2021-03-10T13:43:44.272379\", \"started\": \"2021-03-10T13:43:47.550063\"}, \"alertmanager.a\": {\"hostname\": \"gibba015\", \"container_id\": \"a6e6a6bfd056\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:55.952113\", \"created\": \"2021-03-10T13:43:54.628379\", \"started\": \"2021-03-10T13:43:54.655085\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:44.286749\"}}, \"last_daemon_update\": \"2021-03-10T13:43:55.952175\", \"last_device_update\": \"2021-03-10T13:42:03.853072\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]': finished 2021-03-10T13:43:56.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:56 gibba015 bash[13005]: audit 2021-03-10T13:43:55.957009+0000 mon.a (mon.0) 499 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:43:57.391 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:57 gibba015 bash[13005]: audit 2021-03-10T13:43:56.661960+0000 mon.a (mon.0) 500 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.657123\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.657397\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.657568\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.657727\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.657880\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.658029\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.658179\", \"created\": \"2021-03-10T13:43:22.897564\", \"started\": \"2021-03-10T13:43:26.167781\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"container_id\": \"c7e3982b6fae\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.658331\", \"created\": \"2021-03-10T13:43:42.821564\", \"started\": \"2021-03-10T13:43:42.848064\"}, \"node-exporter.b\": {\"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.658482\", \"created\": \"2021-03-10T13:43:43.861564\", \"started\": \"2021-03-10T13:43:45.351099\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:43:30.705787\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872\"}}, \"last_daemon_update\": \"2021-03-10T13:43:56.658817\", \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:43:57.392 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:57 gibba015 bash[9806]: audit 2021-03-10T13:43:56.661960+0000 mon.a (mon.0) 500 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.657123\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.657397\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.657568\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.657727\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.657880\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.658029\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.658179\", \"created\": \"2021-03-10T13:43:22.897564\", \"started\": \"2021-03-10T13:43:26.167781\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"container_id\": \"c7e3982b6fae\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.658331\", \"created\": \"2021-03-10T13:43:42.821564\", \"started\": \"2021-03-10T13:43:42.848064\"}, \"node-exporter.b\": {\"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.658482\", \"created\": \"2021-03-10T13:43:43.861564\", \"started\": \"2021-03-10T13:43:45.351099\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:43:30.705787\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872\"}}, \"last_daemon_update\": \"2021-03-10T13:43:56.658817\", \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:43:57.392 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:57 gibba015 bash[13005]: audit 2021-03-10T13:43:56.671285+0000 mon.a (mon.0) 501 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.657123\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.657397\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.657568\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.657727\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.657880\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.658029\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.658179\", \"created\": \"2021-03-10T13:43:22.897564\", \"started\": \"2021-03-10T13:43:26.167781\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"container_id\": \"c7e3982b6fae\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.658331\", \"created\": \"2021-03-10T13:43:42.821564\", \"started\": \"2021-03-10T13:43:42.848064\"}, \"node-exporter.b\": {\"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.658482\", \"created\": \"2021-03-10T13:43:43.861564\", \"started\": \"2021-03-10T13:43:45.351099\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:43:30.705787\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872\"}}, \"last_daemon_update\": \"2021-03-10T13:43:56.658817\", \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:43:57.393 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:57 gibba015 bash[13005]: audit 2021-03-10T13:43:56.730544+0000 mon.a (mon.0) 502 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICxjCCAa4CEQCMpYlyPsdFdrMOB4cXvuxzMA0GCSqGSIb3DQEBDQUAMCExDTAL\nBgNVBAoMBENlcGgxEDAOBgNVBAMMB2NlcGhhZG0wHhcNMjEwMzEwMTM0MzU2WhcN\nMzEwMzA4MTM0MzU2WjAhMQ0wCwYDVQQKDARDZXBoMRAwDgYDVQQDDAdjZXBoYWRt\nMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAwjWM7yS1YCetHYR6kpjm\nsERVD7AFZ/F/U2CdOQkT2uOycZyguhIPuKjtYDkNZ5D2Bwf+E5mHJWd6cTpEWrsX\n1GBOv0gucyHzxoDuDeBU1/luIhReAZlw5xQuupCIqDjKYG5hjZ4f1NK3zyz8if55\nSNaPWskqhqSXv1sY3YiS1cQPdxPJqxEVevTQRbEVjEEFuV3QD2hzgj0yjU8a4/gg\ny3dNihOlMqby3EcNs4LGmS6Mz9y2/+uoQiG9L4hLgyHMMTVWoxO0QOMLwhDmoRze\ng5UGZIYeHLRDSb23yVGDr+ku+uVQ8ThX7+B5xTBt82hDHJO8wxPBoy5nudTMmKM8\nywIDAQABMA0GCSqGSIb3DQEBDQUAA4IBAQCvs+3c5nJsh6r1j1P33JN0rxIT8exQ\nWwC1VXJi2yIOYHUFEi2GUvOlNGVPbtHBxoMISukq8RXl/qokDhVowhVv6a7nIsuj\n0VMMpiXWpbsZvMjBK8aDKdV+f7k4ttx68wspzlLGMrAqZ92EjarzCCdKcLzyyix1\nS+SEwvu72lay36kHN6thm6DMpOcHJP7d6CKbxiZpBYC9q4AoChHHsP/nOB1J+CvQ\n8fIQM8BMf43gDhJud3V1XqQzlQdOgjynr3r2jNDWPx+8bkMnfLVgx+1kZKBGVAzp\nHLKKyIEIB4PWc9WbsDYGq6SgIw2FyKExNbBNb3ezpKKIwRsSPUmBDus+\n-----END CERTIFICATE-----\n"}]: dispatch 2021-03-10T13:43:57.393 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:57 gibba015 bash[13005]: audit 2021-03-10T13:43:56.734576+0000 mon.a (mon.0) 503 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICxjCCAa4CEQCMpYlyPsdFdrMOB4cXvuxzMA0GCSqGSIb3DQEBDQUAMCExDTAL\nBgNVBAoMBENlcGgxEDAOBgNVBAMMB2NlcGhhZG0wHhcNMjEwMzEwMTM0MzU2WhcN\nMzEwMzA4MTM0MzU2WjAhMQ0wCwYDVQQKDARDZXBoMRAwDgYDVQQDDAdjZXBoYWRt\nMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAwjWM7yS1YCetHYR6kpjm\nsERVD7AFZ/F/U2CdOQkT2uOycZyguhIPuKjtYDkNZ5D2Bwf+E5mHJWd6cTpEWrsX\n1GBOv0gucyHzxoDuDeBU1/luIhReAZlw5xQuupCIqDjKYG5hjZ4f1NK3zyz8if55\nSNaPWskqhqSXv1sY3YiS1cQPdxPJqxEVevTQRbEVjEEFuV3QD2hzgj0yjU8a4/gg\ny3dNihOlMqby3EcNs4LGmS6Mz9y2/+uoQiG9L4hLgyHMMTVWoxO0QOMLwhDmoRze\ng5UGZIYeHLRDSb23yVGDr+ku+uVQ8ThX7+B5xTBt82hDHJO8wxPBoy5nudTMmKM8\nywIDAQABMA0GCSqGSIb3DQEBDQUAA4IBAQCvs+3c5nJsh6r1j1P33JN0rxIT8exQ\nWwC1VXJi2yIOYHUFEi2GUvOlNGVPbtHBxoMISukq8RXl/qokDhVowhVv6a7nIsuj\n0VMMpiXWpbsZvMjBK8aDKdV+f7k4ttx68wspzlLGMrAqZ92EjarzCCdKcLzyyix1\nS+SEwvu72lay36kHN6thm6DMpOcHJP7d6CKbxiZpBYC9q4AoChHHsP/nOB1J+CvQ\n8fIQM8BMf43gDhJud3V1XqQzlQdOgjynr3r2jNDWPx+8bkMnfLVgx+1kZKBGVAzp\nHLKKyIEIB4PWc9WbsDYGq6SgIw2FyKExNbBNb3ezpKKIwRsSPUmBDus+\n-----END CERTIFICATE-----\n"}]': finished 2021-03-10T13:43:57.393 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:57 gibba015 bash[13005]: audit 2021-03-10T13:43:56.735236+0000 mon.a (mon.0) 504 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvQIBADANBgkqhkiG9w0BAQEFAASCBKcwggSjAgEAAoIBAQDCNYzvJLVgJ60d\nhHqSmOawRFUPsAVn8X9TYJ05CRPa47JxnKC6Eg+4qO1gOQ1nkPYHB/4TmYclZ3px\nOkRauxfUYE6/SC5zIfPGgO4N4FTX+W4iFF4BmXDnFC66kIioOMpgbmGNnh/U0rfP\nLPyJ/nlI1o9aySqGpJe/WxjdiJLVxA93E8mrERV69NBFsRWMQQW5XdAPaHOCPTKN\nTxrj+CDLd02KE6UypvLcRw2zgsaZLozP3Lb/66hCIb0viEuDIcwxNVajE7RA4wvC\nEOahHN6DlQZkhh4ctENJvbfJUYOv6S765VDxOFfv4HnFMG3zaEMck7zDE8GjLme5\n1MyYozzLAgMBAAECggEBALOx1uBjR8tbist4C+3eufy4jTgBt07Q3e3oxDDE3HE5\nI6AJu5HPKmrDKzhQMb31HB+vXoEGGk0arOldb2fAGzFvlw1YHVp8PNIb86g1PGvF\nqAiybbTvI888FmybVUbJnT+SgoMFnxBNlLOGPXj1U4V4uZXX8pg4bQwqnxxDxREy\nRYYu1j7fZrTS2oUxovqT0xnyHa4lq0llimHCfPGcEuWXgyPCjLr1Vk976ylDaXzi\nq1FaP+wUh8/dBAiqqY1AlJenVObqKfhKBvIdJwdNWlBRcB/OXQwJkKsgV0cJNYSY\nSaam0jDfWdx4G1hwJfM4kJoSC48cYm+sv0MHSd8D/zECgYEA7FErDdjW2nNHuREI\nqqbzWGHXReQfSk4Kq3PieaN3mZaJP91rwDa0ttgAwnyyYr5Xf+cxa6qCKMLDMjQ2\nmpZrfOOj55v+i2ZZPdKxZOvZE4TOE3HmjaoyZFlbE7Bse+8nY15pcTTfF/xjG0Xc\nbn0Dc/iPGTmvVxAmjFY9U6dVOtMCgYEA0mKLQCoZevmnSvSFZMCSOe8hWv+1NrNO\nImf5U/KphM5XOcXx9lQ53Oxs2iXLPZnIa94aoMABCEqzNaqm7BVyYy2EaV+u7WBZ\neBlG/Zm82QZ8rcyloac88Km8K0QnBHX6kEeYlzZcsQ47/y5/TF0Oodj5fais4kBB\nQ5X88zKbSykCgYAtI1vb6z0uwLJEcTJ8liMJELczzF0Frl5vXVU28rhXh99zaXG5\nZzmhayTKAVN5dO31qk1QSWNPMdRi9IIxiOXDFyApjyxRqB0HqATmR/5Qsh9Cq5Dk\nIkw5yq+Q1TQDgCy/2Dq/ut+aD0VG4lM2b36HWkTLBq+tK5KRX6+bGO04rQKBgCHi\nIyE7Zo0qxinJRe6bITHZdJrOUiY0LKJX8oz1qR2tidjRK44LtKIDJejga2JJcUEG\nLW20XrYyKbi7+lRNg/W7L/c0pNywRtiT4Z4Yc5TUeaIYMpjdcXAlNhwVxt7uDWPN\nVCMOa1FMxJbtqyzmU+P3KP92+hkaViiHcIzOmro5AoGAGXTGzQKDxAlzCtthmtSl\niorFNJ8GboQRu2ECjuEDQTT3H+NLA4kXYnP8DeY2Wi5/ZYmNpcjsrWjJkT5CL362\naVz500hXf7CMfT07wIWZHCZctDlvwexBkaMhFFD1Y7EZypvroiTYbft9/Egmw3zW\n9TRCmKz0CMEzB1MStgFPxk8=\n-----END PRIVATE KEY-----\n"}]: dispatch 2021-03-10T13:43:57.393 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:57 gibba015 bash[13005]: audit 2021-03-10T13:43:56.742352+0000 mon.a (mon.0) 505 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvQIBADANBgkqhkiG9w0BAQEFAASCBKcwggSjAgEAAoIBAQDCNYzvJLVgJ60d\nhHqSmOawRFUPsAVn8X9TYJ05CRPa47JxnKC6Eg+4qO1gOQ1nkPYHB/4TmYclZ3px\nOkRauxfUYE6/SC5zIfPGgO4N4FTX+W4iFF4BmXDnFC66kIioOMpgbmGNnh/U0rfP\nLPyJ/nlI1o9aySqGpJe/WxjdiJLVxA93E8mrERV69NBFsRWMQQW5XdAPaHOCPTKN\nTxrj+CDLd02KE6UypvLcRw2zgsaZLozP3Lb/66hCIb0viEuDIcwxNVajE7RA4wvC\nEOahHN6DlQZkhh4ctENJvbfJUYOv6S765VDxOFfv4HnFMG3zaEMck7zDE8GjLme5\n1MyYozzLAgMBAAECggEBALOx1uBjR8tbist4C+3eufy4jTgBt07Q3e3oxDDE3HE5\nI6AJu5HPKmrDKzhQMb31HB+vXoEGGk0arOldb2fAGzFvlw1YHVp8PNIb86g1PGvF\nqAiybbTvI888FmybVUbJnT+SgoMFnxBNlLOGPXj1U4V4uZXX8pg4bQwqnxxDxREy\nRYYu1j7fZrTS2oUxovqT0xnyHa4lq0llimHCfPGcEuWXgyPCjLr1Vk976ylDaXzi\nq1FaP+wUh8/dBAiqqY1AlJenVObqKfhKBvIdJwdNWlBRcB/OXQwJkKsgV0cJNYSY\nSaam0jDfWdx4G1hwJfM4kJoSC48cYm+sv0MHSd8D/zECgYEA7FErDdjW2nNHuREI\nqqbzWGHXReQfSk4Kq3PieaN3mZaJP91rwDa0ttgAwnyyYr5Xf+cxa6qCKMLDMjQ2\nmpZrfOOj55v+i2ZZPdKxZOvZE4TOE3HmjaoyZFlbE7Bse+8nY15pcTTfF/xjG0Xc\nbn0Dc/iPGTmvVxAmjFY9U6dVOtMCgYEA0mKLQCoZevmnSvSFZMCSOe8hWv+1NrNO\nImf5U/KphM5XOcXx9lQ53Oxs2iXLPZnIa94aoMABCEqzNaqm7BVyYy2EaV+u7WBZ\neBlG/Zm82QZ8rcyloac88Km8K0QnBHX6kEeYlzZcsQ47/y5/TF0Oodj5fais4kBB\nQ5X88zKbSykCgYAtI1vb6z0uwLJEcTJ8liMJELczzF0Frl5vXVU28rhXh99zaXG5\nZzmhayTKAVN5dO31qk1QSWNPMdRi9IIxiOXDFyApjyxRqB0HqATmR/5Qsh9Cq5Dk\nIkw5yq+Q1TQDgCy/2Dq/ut+aD0VG4lM2b36HWkTLBq+tK5KRX6+bGO04rQKBgCHi\nIyE7Zo0qxinJRe6bITHZdJrOUiY0LKJX8oz1qR2tidjRK44LtKIDJejga2JJcUEG\nLW20XrYyKbi7+lRNg/W7L/c0pNywRtiT4Z4Yc5TUeaIYMpjdcXAlNhwVxt7uDWPN\nVCMOa1FMxJbtqyzmU+P3KP92+hkaViiHcIzOmro5AoGAGXTGzQKDxAlzCtthmtSl\niorFNJ8GboQRu2ECjuEDQTT3H+NLA4kXYnP8DeY2Wi5/ZYmNpcjsrWjJkT5CL362\naVz500hXf7CMfT07wIWZHCZctDlvwexBkaMhFFD1Y7EZypvroiTYbft9/Egmw3zW\n9TRCmKz0CMEzB1MStgFPxk8=\n-----END PRIVATE KEY-----\n"}]': finished 2021-03-10T13:43:57.394 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:57 gibba015 bash[13005]: cephadm 2021-03-10T13:43:56.742945+0000 mgr.y (mgr.14140) 179 : cephadm [INF] Deploying daemon grafana.a on gibba045 2021-03-10T13:43:57.394 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:57 gibba015 bash[9806]: audit 2021-03-10T13:43:56.671285+0000 mon.a (mon.0) 501 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.657123\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.657397\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.657568\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.657727\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.657880\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.658029\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.658179\", \"created\": \"2021-03-10T13:43:22.897564\", \"started\": \"2021-03-10T13:43:26.167781\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"container_id\": \"c7e3982b6fae\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.658331\", \"created\": \"2021-03-10T13:43:42.821564\", \"started\": \"2021-03-10T13:43:42.848064\"}, \"node-exporter.b\": {\"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.658482\", \"created\": \"2021-03-10T13:43:43.861564\", \"started\": \"2021-03-10T13:43:45.351099\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:43:30.705787\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872\"}}, \"last_daemon_update\": \"2021-03-10T13:43:56.658817\", \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:43:57.394 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:57 gibba015 bash[9806]: audit 2021-03-10T13:43:56.730544+0000 mon.a (mon.0) 502 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICxjCCAa4CEQCMpYlyPsdFdrMOB4cXvuxzMA0GCSqGSIb3DQEBDQUAMCExDTAL\nBgNVBAoMBENlcGgxEDAOBgNVBAMMB2NlcGhhZG0wHhcNMjEwMzEwMTM0MzU2WhcN\nMzEwMzA4MTM0MzU2WjAhMQ0wCwYDVQQKDARDZXBoMRAwDgYDVQQDDAdjZXBoYWRt\nMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAwjWM7yS1YCetHYR6kpjm\nsERVD7AFZ/F/U2CdOQkT2uOycZyguhIPuKjtYDkNZ5D2Bwf+E5mHJWd6cTpEWrsX\n1GBOv0gucyHzxoDuDeBU1/luIhReAZlw5xQuupCIqDjKYG5hjZ4f1NK3zyz8if55\nSNaPWskqhqSXv1sY3YiS1cQPdxPJqxEVevTQRbEVjEEFuV3QD2hzgj0yjU8a4/gg\ny3dNihOlMqby3EcNs4LGmS6Mz9y2/+uoQiG9L4hLgyHMMTVWoxO0QOMLwhDmoRze\ng5UGZIYeHLRDSb23yVGDr+ku+uVQ8ThX7+B5xTBt82hDHJO8wxPBoy5nudTMmKM8\nywIDAQABMA0GCSqGSIb3DQEBDQUAA4IBAQCvs+3c5nJsh6r1j1P33JN0rxIT8exQ\nWwC1VXJi2yIOYHUFEi2GUvOlNGVPbtHBxoMISukq8RXl/qokDhVowhVv6a7nIsuj\n0VMMpiXWpbsZvMjBK8aDKdV+f7k4ttx68wspzlLGMrAqZ92EjarzCCdKcLzyyix1\nS+SEwvu72lay36kHN6thm6DMpOcHJP7d6CKbxiZpBYC9q4AoChHHsP/nOB1J+CvQ\n8fIQM8BMf43gDhJud3V1XqQzlQdOgjynr3r2jNDWPx+8bkMnfLVgx+1kZKBGVAzp\nHLKKyIEIB4PWc9WbsDYGq6SgIw2FyKExNbBNb3ezpKKIwRsSPUmBDus+\n-----END CERTIFICATE-----\n"}]: dispatch 2021-03-10T13:43:57.395 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:57 gibba015 bash[9806]: audit 2021-03-10T13:43:56.734576+0000 mon.a (mon.0) 503 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICxjCCAa4CEQCMpYlyPsdFdrMOB4cXvuxzMA0GCSqGSIb3DQEBDQUAMCExDTAL\nBgNVBAoMBENlcGgxEDAOBgNVBAMMB2NlcGhhZG0wHhcNMjEwMzEwMTM0MzU2WhcN\nMzEwMzA4MTM0MzU2WjAhMQ0wCwYDVQQKDARDZXBoMRAwDgYDVQQDDAdjZXBoYWRt\nMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAwjWM7yS1YCetHYR6kpjm\nsERVD7AFZ/F/U2CdOQkT2uOycZyguhIPuKjtYDkNZ5D2Bwf+E5mHJWd6cTpEWrsX\n1GBOv0gucyHzxoDuDeBU1/luIhReAZlw5xQuupCIqDjKYG5hjZ4f1NK3zyz8if55\nSNaPWskqhqSXv1sY3YiS1cQPdxPJqxEVevTQRbEVjEEFuV3QD2hzgj0yjU8a4/gg\ny3dNihOlMqby3EcNs4LGmS6Mz9y2/+uoQiG9L4hLgyHMMTVWoxO0QOMLwhDmoRze\ng5UGZIYeHLRDSb23yVGDr+ku+uVQ8ThX7+B5xTBt82hDHJO8wxPBoy5nudTMmKM8\nywIDAQABMA0GCSqGSIb3DQEBDQUAA4IBAQCvs+3c5nJsh6r1j1P33JN0rxIT8exQ\nWwC1VXJi2yIOYHUFEi2GUvOlNGVPbtHBxoMISukq8RXl/qokDhVowhVv6a7nIsuj\n0VMMpiXWpbsZvMjBK8aDKdV+f7k4ttx68wspzlLGMrAqZ92EjarzCCdKcLzyyix1\nS+SEwvu72lay36kHN6thm6DMpOcHJP7d6CKbxiZpBYC9q4AoChHHsP/nOB1J+CvQ\n8fIQM8BMf43gDhJud3V1XqQzlQdOgjynr3r2jNDWPx+8bkMnfLVgx+1kZKBGVAzp\nHLKKyIEIB4PWc9WbsDYGq6SgIw2FyKExNbBNb3ezpKKIwRsSPUmBDus+\n-----END CERTIFICATE-----\n"}]': finished 2021-03-10T13:43:57.395 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:57 gibba015 bash[9806]: audit 2021-03-10T13:43:56.735236+0000 mon.a (mon.0) 504 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvQIBADANBgkqhkiG9w0BAQEFAASCBKcwggSjAgEAAoIBAQDCNYzvJLVgJ60d\nhHqSmOawRFUPsAVn8X9TYJ05CRPa47JxnKC6Eg+4qO1gOQ1nkPYHB/4TmYclZ3px\nOkRauxfUYE6/SC5zIfPGgO4N4FTX+W4iFF4BmXDnFC66kIioOMpgbmGNnh/U0rfP\nLPyJ/nlI1o9aySqGpJe/WxjdiJLVxA93E8mrERV69NBFsRWMQQW5XdAPaHOCPTKN\nTxrj+CDLd02KE6UypvLcRw2zgsaZLozP3Lb/66hCIb0viEuDIcwxNVajE7RA4wvC\nEOahHN6DlQZkhh4ctENJvbfJUYOv6S765VDxOFfv4HnFMG3zaEMck7zDE8GjLme5\n1MyYozzLAgMBAAECggEBALOx1uBjR8tbist4C+3eufy4jTgBt07Q3e3oxDDE3HE5\nI6AJu5HPKmrDKzhQMb31HB+vXoEGGk0arOldb2fAGzFvlw1YHVp8PNIb86g1PGvF\nqAiybbTvI888FmybVUbJnT+SgoMFnxBNlLOGPXj1U4V4uZXX8pg4bQwqnxxDxREy\nRYYu1j7fZrTS2oUxovqT0xnyHa4lq0llimHCfPGcEuWXgyPCjLr1Vk976ylDaXzi\nq1FaP+wUh8/dBAiqqY1AlJenVObqKfhKBvIdJwdNWlBRcB/OXQwJkKsgV0cJNYSY\nSaam0jDfWdx4G1hwJfM4kJoSC48cYm+sv0MHSd8D/zECgYEA7FErDdjW2nNHuREI\nqqbzWGHXReQfSk4Kq3PieaN3mZaJP91rwDa0ttgAwnyyYr5Xf+cxa6qCKMLDMjQ2\nmpZrfOOj55v+i2ZZPdKxZOvZE4TOE3HmjaoyZFlbE7Bse+8nY15pcTTfF/xjG0Xc\nbn0Dc/iPGTmvVxAmjFY9U6dVOtMCgYEA0mKLQCoZevmnSvSFZMCSOe8hWv+1NrNO\nImf5U/KphM5XOcXx9lQ53Oxs2iXLPZnIa94aoMABCEqzNaqm7BVyYy2EaV+u7WBZ\neBlG/Zm82QZ8rcyloac88Km8K0QnBHX6kEeYlzZcsQ47/y5/TF0Oodj5fais4kBB\nQ5X88zKbSykCgYAtI1vb6z0uwLJEcTJ8liMJELczzF0Frl5vXVU28rhXh99zaXG5\nZzmhayTKAVN5dO31qk1QSWNPMdRi9IIxiOXDFyApjyxRqB0HqATmR/5Qsh9Cq5Dk\nIkw5yq+Q1TQDgCy/2Dq/ut+aD0VG4lM2b36HWkTLBq+tK5KRX6+bGO04rQKBgCHi\nIyE7Zo0qxinJRe6bITHZdJrOUiY0LKJX8oz1qR2tidjRK44LtKIDJejga2JJcUEG\nLW20XrYyKbi7+lRNg/W7L/c0pNywRtiT4Z4Yc5TUeaIYMpjdcXAlNhwVxt7uDWPN\nVCMOa1FMxJbtqyzmU+P3KP92+hkaViiHcIzOmro5AoGAGXTGzQKDxAlzCtthmtSl\niorFNJ8GboQRu2ECjuEDQTT3H+NLA4kXYnP8DeY2Wi5/ZYmNpcjsrWjJkT5CL362\naVz500hXf7CMfT07wIWZHCZctDlvwexBkaMhFFD1Y7EZypvroiTYbft9/Egmw3zW\n9TRCmKz0CMEzB1MStgFPxk8=\n-----END PRIVATE KEY-----\n"}]: dispatch 2021-03-10T13:43:57.395 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:57 gibba015 bash[9806]: audit 2021-03-10T13:43:56.742352+0000 mon.a (mon.0) 505 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvQIBADANBgkqhkiG9w0BAQEFAASCBKcwggSjAgEAAoIBAQDCNYzvJLVgJ60d\nhHqSmOawRFUPsAVn8X9TYJ05CRPa47JxnKC6Eg+4qO1gOQ1nkPYHB/4TmYclZ3px\nOkRauxfUYE6/SC5zIfPGgO4N4FTX+W4iFF4BmXDnFC66kIioOMpgbmGNnh/U0rfP\nLPyJ/nlI1o9aySqGpJe/WxjdiJLVxA93E8mrERV69NBFsRWMQQW5XdAPaHOCPTKN\nTxrj+CDLd02KE6UypvLcRw2zgsaZLozP3Lb/66hCIb0viEuDIcwxNVajE7RA4wvC\nEOahHN6DlQZkhh4ctENJvbfJUYOv6S765VDxOFfv4HnFMG3zaEMck7zDE8GjLme5\n1MyYozzLAgMBAAECggEBALOx1uBjR8tbist4C+3eufy4jTgBt07Q3e3oxDDE3HE5\nI6AJu5HPKmrDKzhQMb31HB+vXoEGGk0arOldb2fAGzFvlw1YHVp8PNIb86g1PGvF\nqAiybbTvI888FmybVUbJnT+SgoMFnxBNlLOGPXj1U4V4uZXX8pg4bQwqnxxDxREy\nRYYu1j7fZrTS2oUxovqT0xnyHa4lq0llimHCfPGcEuWXgyPCjLr1Vk976ylDaXzi\nq1FaP+wUh8/dBAiqqY1AlJenVObqKfhKBvIdJwdNWlBRcB/OXQwJkKsgV0cJNYSY\nSaam0jDfWdx4G1hwJfM4kJoSC48cYm+sv0MHSd8D/zECgYEA7FErDdjW2nNHuREI\nqqbzWGHXReQfSk4Kq3PieaN3mZaJP91rwDa0ttgAwnyyYr5Xf+cxa6qCKMLDMjQ2\nmpZrfOOj55v+i2ZZPdKxZOvZE4TOE3HmjaoyZFlbE7Bse+8nY15pcTTfF/xjG0Xc\nbn0Dc/iPGTmvVxAmjFY9U6dVOtMCgYEA0mKLQCoZevmnSvSFZMCSOe8hWv+1NrNO\nImf5U/KphM5XOcXx9lQ53Oxs2iXLPZnIa94aoMABCEqzNaqm7BVyYy2EaV+u7WBZ\neBlG/Zm82QZ8rcyloac88Km8K0QnBHX6kEeYlzZcsQ47/y5/TF0Oodj5fais4kBB\nQ5X88zKbSykCgYAtI1vb6z0uwLJEcTJ8liMJELczzF0Frl5vXVU28rhXh99zaXG5\nZzmhayTKAVN5dO31qk1QSWNPMdRi9IIxiOXDFyApjyxRqB0HqATmR/5Qsh9Cq5Dk\nIkw5yq+Q1TQDgCy/2Dq/ut+aD0VG4lM2b36HWkTLBq+tK5KRX6+bGO04rQKBgCHi\nIyE7Zo0qxinJRe6bITHZdJrOUiY0LKJX8oz1qR2tidjRK44LtKIDJejga2JJcUEG\nLW20XrYyKbi7+lRNg/W7L/c0pNywRtiT4Z4Yc5TUeaIYMpjdcXAlNhwVxt7uDWPN\nVCMOa1FMxJbtqyzmU+P3KP92+hkaViiHcIzOmro5AoGAGXTGzQKDxAlzCtthmtSl\niorFNJ8GboQRu2ECjuEDQTT3H+NLA4kXYnP8DeY2Wi5/ZYmNpcjsrWjJkT5CL362\naVz500hXf7CMfT07wIWZHCZctDlvwexBkaMhFFD1Y7EZypvroiTYbft9/Egmw3zW\n9TRCmKz0CMEzB1MStgFPxk8=\n-----END PRIVATE KEY-----\n"}]': finished 2021-03-10T13:43:57.395 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:57 gibba015 bash[9806]: cephadm 2021-03-10T13:43:56.742945+0000 mgr.y (mgr.14140) 179 : cephadm [INF] Deploying daemon grafana.a on gibba045 2021-03-10T13:43:57.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:57 gibba045 bash[9787]: audit 2021-03-10T13:43:56.661960+0000 mon.a (mon.0) 500 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.657123\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.657397\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.657568\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.657727\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.657880\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.658029\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.658179\", \"created\": \"2021-03-10T13:43:22.897564\", \"started\": \"2021-03-10T13:43:26.167781\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"container_id\": \"c7e3982b6fae\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.658331\", \"created\": \"2021-03-10T13:43:42.821564\", \"started\": \"2021-03-10T13:43:42.848064\"}, \"node-exporter.b\": {\"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.658482\", \"created\": \"2021-03-10T13:43:43.861564\", \"started\": \"2021-03-10T13:43:45.351099\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:43:30.705787\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872\"}}, \"last_daemon_update\": \"2021-03-10T13:43:56.658817\", \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:43:57.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:57 gibba045 bash[9787]: audit 2021-03-10T13:43:56.671285+0000 mon.a (mon.0) 501 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.657123\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.657397\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.657568\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.657727\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.657880\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.658029\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.658179\", \"created\": \"2021-03-10T13:43:22.897564\", \"started\": \"2021-03-10T13:43:26.167781\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"container_id\": \"c7e3982b6fae\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.658331\", \"created\": \"2021-03-10T13:43:42.821564\", \"started\": \"2021-03-10T13:43:42.848064\"}, \"node-exporter.b\": {\"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.658482\", \"created\": \"2021-03-10T13:43:43.861564\", \"started\": \"2021-03-10T13:43:45.351099\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:43:30.705787\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872\"}}, \"last_daemon_update\": \"2021-03-10T13:43:56.658817\", \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:43:57.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:57 gibba045 bash[9787]: audit 2021-03-10T13:43:56.730544+0000 mon.a (mon.0) 502 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICxjCCAa4CEQCMpYlyPsdFdrMOB4cXvuxzMA0GCSqGSIb3DQEBDQUAMCExDTAL\nBgNVBAoMBENlcGgxEDAOBgNVBAMMB2NlcGhhZG0wHhcNMjEwMzEwMTM0MzU2WhcN\nMzEwMzA4MTM0MzU2WjAhMQ0wCwYDVQQKDARDZXBoMRAwDgYDVQQDDAdjZXBoYWRt\nMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAwjWM7yS1YCetHYR6kpjm\nsERVD7AFZ/F/U2CdOQkT2uOycZyguhIPuKjtYDkNZ5D2Bwf+E5mHJWd6cTpEWrsX\n1GBOv0gucyHzxoDuDeBU1/luIhReAZlw5xQuupCIqDjKYG5hjZ4f1NK3zyz8if55\nSNaPWskqhqSXv1sY3YiS1cQPdxPJqxEVevTQRbEVjEEFuV3QD2hzgj0yjU8a4/gg\ny3dNihOlMqby3EcNs4LGmS6Mz9y2/+uoQiG9L4hLgyHMMTVWoxO0QOMLwhDmoRze\ng5UGZIYeHLRDSb23yVGDr+ku+uVQ8ThX7+B5xTBt82hDHJO8wxPBoy5nudTMmKM8\nywIDAQABMA0GCSqGSIb3DQEBDQUAA4IBAQCvs+3c5nJsh6r1j1P33JN0rxIT8exQ\nWwC1VXJi2yIOYHUFEi2GUvOlNGVPbtHBxoMISukq8RXl/qokDhVowhVv6a7nIsuj\n0VMMpiXWpbsZvMjBK8aDKdV+f7k4ttx68wspzlLGMrAqZ92EjarzCCdKcLzyyix1\nS+SEwvu72lay36kHN6thm6DMpOcHJP7d6CKbxiZpBYC9q4AoChHHsP/nOB1J+CvQ\n8fIQM8BMf43gDhJud3V1XqQzlQdOgjynr3r2jNDWPx+8bkMnfLVgx+1kZKBGVAzp\nHLKKyIEIB4PWc9WbsDYGq6SgIw2FyKExNbBNb3ezpKKIwRsSPUmBDus+\n-----END CERTIFICATE-----\n"}]: dispatch 2021-03-10T13:43:57.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:57 gibba045 bash[9787]: audit 2021-03-10T13:43:56.734576+0000 mon.a (mon.0) 503 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICxjCCAa4CEQCMpYlyPsdFdrMOB4cXvuxzMA0GCSqGSIb3DQEBDQUAMCExDTAL\nBgNVBAoMBENlcGgxEDAOBgNVBAMMB2NlcGhhZG0wHhcNMjEwMzEwMTM0MzU2WhcN\nMzEwMzA4MTM0MzU2WjAhMQ0wCwYDVQQKDARDZXBoMRAwDgYDVQQDDAdjZXBoYWRt\nMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAwjWM7yS1YCetHYR6kpjm\nsERVD7AFZ/F/U2CdOQkT2uOycZyguhIPuKjtYDkNZ5D2Bwf+E5mHJWd6cTpEWrsX\n1GBOv0gucyHzxoDuDeBU1/luIhReAZlw5xQuupCIqDjKYG5hjZ4f1NK3zyz8if55\nSNaPWskqhqSXv1sY3YiS1cQPdxPJqxEVevTQRbEVjEEFuV3QD2hzgj0yjU8a4/gg\ny3dNihOlMqby3EcNs4LGmS6Mz9y2/+uoQiG9L4hLgyHMMTVWoxO0QOMLwhDmoRze\ng5UGZIYeHLRDSb23yVGDr+ku+uVQ8ThX7+B5xTBt82hDHJO8wxPBoy5nudTMmKM8\nywIDAQABMA0GCSqGSIb3DQEBDQUAA4IBAQCvs+3c5nJsh6r1j1P33JN0rxIT8exQ\nWwC1VXJi2yIOYHUFEi2GUvOlNGVPbtHBxoMISukq8RXl/qokDhVowhVv6a7nIsuj\n0VMMpiXWpbsZvMjBK8aDKdV+f7k4ttx68wspzlLGMrAqZ92EjarzCCdKcLzyyix1\nS+SEwvu72lay36kHN6thm6DMpOcHJP7d6CKbxiZpBYC9q4AoChHHsP/nOB1J+CvQ\n8fIQM8BMf43gDhJud3V1XqQzlQdOgjynr3r2jNDWPx+8bkMnfLVgx+1kZKBGVAzp\nHLKKyIEIB4PWc9WbsDYGq6SgIw2FyKExNbBNb3ezpKKIwRsSPUmBDus+\n-----END CERTIFICATE-----\n"}]': finished 2021-03-10T13:43:57.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:57 gibba045 bash[9787]: audit 2021-03-10T13:43:56.735236+0000 mon.a (mon.0) 504 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvQIBADANBgkqhkiG9w0BAQEFAASCBKcwggSjAgEAAoIBAQDCNYzvJLVgJ60d\nhHqSmOawRFUPsAVn8X9TYJ05CRPa47JxnKC6Eg+4qO1gOQ1nkPYHB/4TmYclZ3px\nOkRauxfUYE6/SC5zIfPGgO4N4FTX+W4iFF4BmXDnFC66kIioOMpgbmGNnh/U0rfP\nLPyJ/nlI1o9aySqGpJe/WxjdiJLVxA93E8mrERV69NBFsRWMQQW5XdAPaHOCPTKN\nTxrj+CDLd02KE6UypvLcRw2zgsaZLozP3Lb/66hCIb0viEuDIcwxNVajE7RA4wvC\nEOahHN6DlQZkhh4ctENJvbfJUYOv6S765VDxOFfv4HnFMG3zaEMck7zDE8GjLme5\n1MyYozzLAgMBAAECggEBALOx1uBjR8tbist4C+3eufy4jTgBt07Q3e3oxDDE3HE5\nI6AJu5HPKmrDKzhQMb31HB+vXoEGGk0arOldb2fAGzFvlw1YHVp8PNIb86g1PGvF\nqAiybbTvI888FmybVUbJnT+SgoMFnxBNlLOGPXj1U4V4uZXX8pg4bQwqnxxDxREy\nRYYu1j7fZrTS2oUxovqT0xnyHa4lq0llimHCfPGcEuWXgyPCjLr1Vk976ylDaXzi\nq1FaP+wUh8/dBAiqqY1AlJenVObqKfhKBvIdJwdNWlBRcB/OXQwJkKsgV0cJNYSY\nSaam0jDfWdx4G1hwJfM4kJoSC48cYm+sv0MHSd8D/zECgYEA7FErDdjW2nNHuREI\nqqbzWGHXReQfSk4Kq3PieaN3mZaJP91rwDa0ttgAwnyyYr5Xf+cxa6qCKMLDMjQ2\nmpZrfOOj55v+i2ZZPdKxZOvZE4TOE3HmjaoyZFlbE7Bse+8nY15pcTTfF/xjG0Xc\nbn0Dc/iPGTmvVxAmjFY9U6dVOtMCgYEA0mKLQCoZevmnSvSFZMCSOe8hWv+1NrNO\nImf5U/KphM5XOcXx9lQ53Oxs2iXLPZnIa94aoMABCEqzNaqm7BVyYy2EaV+u7WBZ\neBlG/Zm82QZ8rcyloac88Km8K0QnBHX6kEeYlzZcsQ47/y5/TF0Oodj5fais4kBB\nQ5X88zKbSykCgYAtI1vb6z0uwLJEcTJ8liMJELczzF0Frl5vXVU28rhXh99zaXG5\nZzmhayTKAVN5dO31qk1QSWNPMdRi9IIxiOXDFyApjyxRqB0HqATmR/5Qsh9Cq5Dk\nIkw5yq+Q1TQDgCy/2Dq/ut+aD0VG4lM2b36HWkTLBq+tK5KRX6+bGO04rQKBgCHi\nIyE7Zo0qxinJRe6bITHZdJrOUiY0LKJX8oz1qR2tidjRK44LtKIDJejga2JJcUEG\nLW20XrYyKbi7+lRNg/W7L/c0pNywRtiT4Z4Yc5TUeaIYMpjdcXAlNhwVxt7uDWPN\nVCMOa1FMxJbtqyzmU+P3KP92+hkaViiHcIzOmro5AoGAGXTGzQKDxAlzCtthmtSl\niorFNJ8GboQRu2ECjuEDQTT3H+NLA4kXYnP8DeY2Wi5/ZYmNpcjsrWjJkT5CL362\naVz500hXf7CMfT07wIWZHCZctDlvwexBkaMhFFD1Y7EZypvroiTYbft9/Egmw3zW\n9TRCmKz0CMEzB1MStgFPxk8=\n-----END PRIVATE KEY-----\n"}]: dispatch 2021-03-10T13:43:57.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:57 gibba045 bash[9787]: audit 2021-03-10T13:43:56.742352+0000 mon.a (mon.0) 505 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvQIBADANBgkqhkiG9w0BAQEFAASCBKcwggSjAgEAAoIBAQDCNYzvJLVgJ60d\nhHqSmOawRFUPsAVn8X9TYJ05CRPa47JxnKC6Eg+4qO1gOQ1nkPYHB/4TmYclZ3px\nOkRauxfUYE6/SC5zIfPGgO4N4FTX+W4iFF4BmXDnFC66kIioOMpgbmGNnh/U0rfP\nLPyJ/nlI1o9aySqGpJe/WxjdiJLVxA93E8mrERV69NBFsRWMQQW5XdAPaHOCPTKN\nTxrj+CDLd02KE6UypvLcRw2zgsaZLozP3Lb/66hCIb0viEuDIcwxNVajE7RA4wvC\nEOahHN6DlQZkhh4ctENJvbfJUYOv6S765VDxOFfv4HnFMG3zaEMck7zDE8GjLme5\n1MyYozzLAgMBAAECggEBALOx1uBjR8tbist4C+3eufy4jTgBt07Q3e3oxDDE3HE5\nI6AJu5HPKmrDKzhQMb31HB+vXoEGGk0arOldb2fAGzFvlw1YHVp8PNIb86g1PGvF\nqAiybbTvI888FmybVUbJnT+SgoMFnxBNlLOGPXj1U4V4uZXX8pg4bQwqnxxDxREy\nRYYu1j7fZrTS2oUxovqT0xnyHa4lq0llimHCfPGcEuWXgyPCjLr1Vk976ylDaXzi\nq1FaP+wUh8/dBAiqqY1AlJenVObqKfhKBvIdJwdNWlBRcB/OXQwJkKsgV0cJNYSY\nSaam0jDfWdx4G1hwJfM4kJoSC48cYm+sv0MHSd8D/zECgYEA7FErDdjW2nNHuREI\nqqbzWGHXReQfSk4Kq3PieaN3mZaJP91rwDa0ttgAwnyyYr5Xf+cxa6qCKMLDMjQ2\nmpZrfOOj55v+i2ZZPdKxZOvZE4TOE3HmjaoyZFlbE7Bse+8nY15pcTTfF/xjG0Xc\nbn0Dc/iPGTmvVxAmjFY9U6dVOtMCgYEA0mKLQCoZevmnSvSFZMCSOe8hWv+1NrNO\nImf5U/KphM5XOcXx9lQ53Oxs2iXLPZnIa94aoMABCEqzNaqm7BVyYy2EaV+u7WBZ\neBlG/Zm82QZ8rcyloac88Km8K0QnBHX6kEeYlzZcsQ47/y5/TF0Oodj5fais4kBB\nQ5X88zKbSykCgYAtI1vb6z0uwLJEcTJ8liMJELczzF0Frl5vXVU28rhXh99zaXG5\nZzmhayTKAVN5dO31qk1QSWNPMdRi9IIxiOXDFyApjyxRqB0HqATmR/5Qsh9Cq5Dk\nIkw5yq+Q1TQDgCy/2Dq/ut+aD0VG4lM2b36HWkTLBq+tK5KRX6+bGO04rQKBgCHi\nIyE7Zo0qxinJRe6bITHZdJrOUiY0LKJX8oz1qR2tidjRK44LtKIDJejga2JJcUEG\nLW20XrYyKbi7+lRNg/W7L/c0pNywRtiT4Z4Yc5TUeaIYMpjdcXAlNhwVxt7uDWPN\nVCMOa1FMxJbtqyzmU+P3KP92+hkaViiHcIzOmro5AoGAGXTGzQKDxAlzCtthmtSl\niorFNJ8GboQRu2ECjuEDQTT3H+NLA4kXYnP8DeY2Wi5/ZYmNpcjsrWjJkT5CL362\naVz500hXf7CMfT07wIWZHCZctDlvwexBkaMhFFD1Y7EZypvroiTYbft9/Egmw3zW\n9TRCmKz0CMEzB1MStgFPxk8=\n-----END PRIVATE KEY-----\n"}]': finished 2021-03-10T13:43:57.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:57 gibba045 bash[9787]: cephadm 2021-03-10T13:43:56.742945+0000 mgr.y (mgr.14140) 179 : cephadm [INF] Deploying daemon grafana.a on gibba045 2021-03-10T13:43:57.971 INFO:journalctl@ceph.alertmanager.a.gibba015.stdout:Mar 10 13:43:57 gibba015 bash[20279]: level=info ts=2021-03-10T13:43:57.687Z caller=cluster.go:648 component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000208626s 2021-03-10T13:43:58.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:58 gibba015 bash[13005]: cluster 2021-03-10T13:43:57.147816+0000 mgr.y (mgr.14140) 180 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:43:58.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:58 gibba015 bash[9806]: cluster 2021-03-10T13:43:57.147816+0000 mgr.y (mgr.14140) 180 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:43:58.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:58 gibba045 bash[9787]: cluster 2021-03-10T13:43:57.147816+0000 mgr.y (mgr.14140) 180 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:43:58.958 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-03-10T13:43:58.958 INFO:teuthology.orchestra.run.gibba015.stdout:{"epoch":48,"fsid":"e4a642d2-81a5-11eb-9080-001a4aab830c","created":"2021-03-10T13:38:51.836343+0000","modified":"2021-03-10T13:43:33.188920+0000","last_up_change":"2021-03-10T13:43:32.175965+0000","last_in_change":"2021-03-10T13:43:32.175965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-03-10T13:39:01.965515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"8e0c9467-d453-440a-91ea-1b07c3f35dde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":1771792750},{"type":"v1","addr":"172.21.2.115:6803","nonce":1771792750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":1771792750},{"type":"v1","addr":"172.21.2.115:6805","nonce":1771792750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":1771792750},{"type":"v1","addr":"172.21.2.115:6809","nonce":1771792750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":1771792750},{"type":"v1","addr":"172.21.2.115:6807","nonce":1771792750}]},"public_addr":"172.21.2.115:6803/1771792750","cluster_addr":"172.21.2.115:6805/1771792750","heartbeat_back_addr":"172.21.2.115:6809/1771792750","heartbeat_front_addr":"172.21.2.115:6807/1771792750","state":["exists","up"]},{"osd":1,"uuid":"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":1316793725},{"type":"v1","addr":"172.21.2.115:6811","nonce":1316793725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":1316793725},{"type":"v1","addr":"172.21.2.115:6813","nonce":1316793725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":1316793725},{"type":"v1","addr":"172.21.2.115:6817","nonce":1316793725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":1316793725},{"type":"v1","addr":"172.21.2.115:6815","nonce":1316793725}]},"public_addr":"172.21.2.115:6811/1316793725","cluster_addr":"172.21.2.115:6813/1316793725","heartbeat_back_addr":"172.21.2.115:6817/1316793725","heartbeat_front_addr":"172.21.2.115:6815/1316793725","state":["exists","up"]},{"osd":2,"uuid":"3ae91563-2d31-48f5-aeed-1ba427cef365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":3628070800},{"type":"v1","addr":"172.21.2.115:6819","nonce":3628070800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":3628070800},{"type":"v1","addr":"172.21.2.115:6821","nonce":3628070800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":3628070800},{"type":"v1","addr":"172.21.2.115:6825","nonce":3628070800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":3628070800},{"type":"v1","addr":"172.21.2.115:6823","nonce":3628070800}]},"public_addr":"172.21.2.115:6819/3628070800","cluster_addr":"172.21.2.115:6821/3628070800","heartbeat_back_addr":"172.21.2.115:6825/3628070800","heartbeat_front_addr":"172.21.2.115:6823/3628070800","state":["exists","up"]},{"osd":3,"uuid":"de4bb3e1-0f94-479d-9771-be80408c9a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":1478911402},{"type":"v1","addr":"172.21.2.115:6827","nonce":1478911402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":1478911402},{"type":"v1","addr":"172.21.2.115:6829","nonce":1478911402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":1478911402},{"type":"v1","addr":"172.21.2.115:6833","nonce":1478911402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":1478911402},{"type":"v1","addr":"172.21.2.115:6831","nonce":1478911402}]},"public_addr":"172.21.2.115:6827/1478911402","cluster_addr":"172.21.2.115:6829/1478911402","heartbeat_back_addr":"172.21.2.115:6833/1478911402","heartbeat_front_addr":"172.21.2.115:6831/1478911402","state":["exists","up"]},{"osd":4,"uuid":"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.145:6800","nonce":860882436},{"type":"v1","addr":"172.21.2.145:6801","nonce":860882436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.145:6802","nonce":860882436},{"type":"v1","addr":"172.21.2.145:6803","nonce":860882436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.145:6806","nonce":860882436},{"type":"v1","addr":"172.21.2.145:6807","nonce":860882436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.145:6804","nonce":860882436},{"type":"v1","addr":"172.21.2.145:6805","nonce":860882436}]},"public_addr":"172.21.2.145:6801/860882436","cluster_addr":"172.21.2.145:6803/860882436","heartbeat_back_addr":"172.21.2.145:6807/860882436","heartbeat_front_addr":"172.21.2.145:6805/860882436","state":["exists","up"]},{"osd":5,"uuid":"81a848ae-eccd-42a4-8537-dde9fbce70f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.145:6808","nonce":839821364},{"type":"v1","addr":"172.21.2.145:6809","nonce":839821364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.145:6810","nonce":839821364},{"type":"v1","addr":"172.21.2.145:6811","nonce":839821364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.145:6814","nonce":839821364},{"type":"v1","addr":"172.21.2.145:6815","nonce":839821364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.145:6812","nonce":839821364},{"type":"v1","addr":"172.21.2.145:6813","nonce":839821364}]},"public_addr":"172.21.2.145:6809/839821364","cluster_addr":"172.21.2.145:6811/839821364","heartbeat_back_addr":"172.21.2.145:6815/839821364","heartbeat_front_addr":"172.21.2.145:6813/839821364","state":["exists","up"]},{"osd":6,"uuid":"e1f6bac7-fc45-424c-be0e-0ed40192d2a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.145:6816","nonce":2136431237},{"type":"v1","addr":"172.21.2.145:6817","nonce":2136431237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.145:6818","nonce":2136431237},{"type":"v1","addr":"172.21.2.145:6819","nonce":2136431237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.145:6822","nonce":2136431237},{"type":"v1","addr":"172.21.2.145:6823","nonce":2136431237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.145:6820","nonce":2136431237},{"type":"v1","addr":"172.21.2.145:6821","nonce":2136431237}]},"public_addr":"172.21.2.145:6817/2136431237","cluster_addr":"172.21.2.145:6819/2136431237","heartbeat_back_addr":"172.21.2.145:6823/2136431237","heartbeat_front_addr":"172.21.2.145:6821/2136431237","state":["exists","up"]},{"osd":7,"uuid":"d10c3d75-2027-4372-9bcb-24a1c376704e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.145:6824","nonce":604814097},{"type":"v1","addr":"172.21.2.145:6825","nonce":604814097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.145:6826","nonce":604814097},{"type":"v1","addr":"172.21.2.145:6827","nonce":604814097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.145:6830","nonce":604814097},{"type":"v1","addr":"172.21.2.145:6831","nonce":604814097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.145:6828","nonce":604814097},{"type":"v1","addr":"172.21.2.145:6829","nonce":604814097}]},"public_addr":"172.21.2.145:6825/604814097","cluster_addr":"172.21.2.145:6827/604814097","heartbeat_back_addr":"172.21.2.145:6831/604814097","heartbeat_front_addr":"172.21.2.145:6829/604814097","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T13:40:57.236741+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T13:41:19.554909+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T13:41:41.826221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T13:42:04.186219+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T13:42:24.539501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T13:42:46.583449+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T13:43:07.712386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T13:43:30.440683+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.2.115:6801/2856562116":"2021-03-11T13:39:22.850169+0000","172.21.2.115:6800/2856562116":"2021-03-11T13:39:22.850169+0000","172.21.2.115:0/1426333611":"2021-03-11T13:39:22.850169+0000","172.21.2.115:0/3537681212":"2021-03-11T13:39:22.850169+0000","172.21.2.115:0/4136771330":"2021-03-11T13:39:22.850169+0000","172.21.2.115:0/683907604":"2021-03-11T13:39:08.741345+0000","172.21.2.115:6800/357167334":"2021-03-11T13:39:08.741345+0000","172.21.2.115:0/4116648559":"2021-03-11T13:39:08.741345+0000","172.21.2.115:0/354126993":"2021-03-11T13:39:08.741345+0000","172.21.2.115:6801/357167334":"2021-03-11T13:39:08.741345+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-03-10T13:43:59.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:43:59 gibba015 bash[9806]: audit 2021-03-10T13:43:58.956494+0000 mon.a (mon.0) 506 : audit [DBG] from='client.? 172.21.2.115:0/3416824069' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-03-10T13:43:59.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:43:59 gibba015 bash[13005]: audit 2021-03-10T13:43:58.956494+0000 mon.a (mon.0) 506 : audit [DBG] from='client.? 172.21.2.115:0/3416824069' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-03-10T13:43:59.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:43:59 gibba045 bash[9787]: audit 2021-03-10T13:43:58.956494+0000 mon.a (mon.0) 506 : audit [DBG] from='client.? 172.21.2.115:0/3416824069' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-03-10T13:43:59.592 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-03-10T13:39:01.965515+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}] 2021-03-10T13:43:59.593 DEBUG:teuthology.orchestra.run.gibba015:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid e4a642d2-81a5-11eb-9080-001a4aab830c -- ceph osd pool get device_health_metrics pg_num 2021-03-10T13:44:00.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:44:00 gibba015 bash[9806]: cluster 2021-03-10T13:43:59.148079+0000 mgr.y (mgr.14140) 181 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:00.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:44:00 gibba015 bash[13005]: cluster 2021-03-10T13:43:59.148079+0000 mgr.y (mgr.14140) 181 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:00.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:44:00 gibba045 bash[9787]: cluster 2021-03-10T13:43:59.148079+0000 mgr.y (mgr.14140) 181 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:02.219 INFO:teuthology.orchestra.run.gibba015.stdout:pg_num: 1 2021-03-10T13:44:02.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:44:02 gibba045 bash[9787]: cluster 2021-03-10T13:44:01.148730+0000 mgr.y (mgr.14140) 182 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:02.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:44:02 gibba045 bash[9787]: audit 2021-03-10T13:44:02.218156+0000 mon.c (mon.1) 11 : audit [DBG] from='client.? 172.21.2.115:0/3042707841' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2021-03-10T13:44:02.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:44:02 gibba015 bash[9806]: cluster 2021-03-10T13:44:01.148730+0000 mgr.y (mgr.14140) 182 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:02.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:44:02 gibba015 bash[9806]: audit 2021-03-10T13:44:02.218156+0000 mon.c (mon.1) 11 : audit [DBG] from='client.? 172.21.2.115:0/3042707841' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2021-03-10T13:44:02.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:44:02 gibba015 bash[13005]: cluster 2021-03-10T13:44:01.148730+0000 mgr.y (mgr.14140) 182 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:02.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:44:02 gibba015 bash[13005]: audit 2021-03-10T13:44:02.218156+0000 mon.c (mon.1) 11 : audit [DBG] from='client.? 172.21.2.115:0/3042707841' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2021-03-10T13:44:02.802 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2021-03-10T13:44:02.803 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2021-03-10T13:44:02.803 DEBUG:teuthology.orchestra.run.gibba015:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid e4a642d2-81a5-11eb-9080-001a4aab830c -- ceph mgr dump --format=json 2021-03-10T13:44:04.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:44:04 gibba015 bash[9806]: cluster 2021-03-10T13:44:03.149649+0000 mgr.y (mgr.14140) 183 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:04.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:44:04 gibba015 bash[13005]: cluster 2021-03-10T13:44:03.149649+0000 mgr.y (mgr.14140) 183 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:04.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:44:04 gibba045 bash[9787]: cluster 2021-03-10T13:44:03.149649+0000 mgr.y (mgr.14140) 183 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:05.585 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-03-10T13:44:05.971 INFO:journalctl@ceph.alertmanager.a.gibba015.stdout:Mar 10 13:44:05 gibba015 bash[20279]: level=info ts=2021-03-10T13:44:05.688Z caller=cluster.go:640 component=cluster msg="gossip settled; proceeding" elapsed=10.001257583s 2021-03-10T13:44:06.223 INFO:teuthology.orchestra.run.gibba015.stdout:{"epoch":15,"active_gid":14140,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":3984032085},{"type":"v1","addr":"172.21.2.115:6801","nonce":3984032085}]},"active_addr":"172.21.2.115:6801/3984032085","active_change":"2021-03-10T13:39:22.850489+0000","active_mgr_features":4540138292836696063,"available":true,"standbys":[{"gid":34109,"name":"x","mgr_features":4540138292836696063,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":34115,"name":"gibba045.orlgmj","mgr_features":4540138292836696063,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://gibba015:8443/"},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","osd_support","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":5,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.2.115:0","nonce":476865797}]},{"addrvec":[{"type":"v2","addr":"172.21.2.115:0","nonce":756381310}]},{"addrvec":[{"type":"v2","addr":"172.21.2.115:0","nonce":3829412}]}]}} 2021-03-10T13:44:06.228 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2021-03-10T13:44:06.229 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2021-03-10T13:44:06.229 DEBUG:teuthology.orchestra.run.gibba015:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid e4a642d2-81a5-11eb-9080-001a4aab830c -- ceph osd dump --format=json 2021-03-10T13:44:06.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:44:06 gibba045 bash[9787]: cluster 2021-03-10T13:44:05.150417+0000 mgr.y (mgr.14140) 184 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:06.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:44:06 gibba045 bash[9787]: audit 2021-03-10T13:44:05.578857+0000 mon.c (mon.1) 12 : audit [DBG] from='client.? 172.21.2.115:0/1075453023' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2021-03-10T13:44:06.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:44:06 gibba015 bash[9806]: cluster 2021-03-10T13:44:05.150417+0000 mgr.y (mgr.14140) 184 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:06.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:44:06 gibba015 bash[9806]: audit 2021-03-10T13:44:05.578857+0000 mon.c (mon.1) 12 : audit [DBG] from='client.? 172.21.2.115:0/1075453023' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2021-03-10T13:44:06.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:44:06 gibba015 bash[13005]: cluster 2021-03-10T13:44:05.150417+0000 mgr.y (mgr.14140) 184 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:06.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:44:06 gibba015 bash[13005]: audit 2021-03-10T13:44:05.578857+0000 mon.c (mon.1) 12 : audit [DBG] from='client.? 172.21.2.115:0/1075453023' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2021-03-10T13:44:08.433 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:44:08 gibba045 bash[9787]: cluster 2021-03-10T13:44:07.151051+0000 mgr.y (mgr.14140) 185 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:08.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:44:08 gibba015 bash[9806]: cluster 2021-03-10T13:44:07.151051+0000 mgr.y (mgr.14140) 185 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:08.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:44:08 gibba015 bash[13005]: cluster 2021-03-10T13:44:07.151051+0000 mgr.y (mgr.14140) 185 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:08.944 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-03-10T13:44:08.944 INFO:teuthology.orchestra.run.gibba015.stdout:{"epoch":48,"fsid":"e4a642d2-81a5-11eb-9080-001a4aab830c","created":"2021-03-10T13:38:51.836343+0000","modified":"2021-03-10T13:43:33.188920+0000","last_up_change":"2021-03-10T13:43:32.175965+0000","last_in_change":"2021-03-10T13:43:32.175965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-03-10T13:39:01.965515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"8e0c9467-d453-440a-91ea-1b07c3f35dde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":1771792750},{"type":"v1","addr":"172.21.2.115:6803","nonce":1771792750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":1771792750},{"type":"v1","addr":"172.21.2.115:6805","nonce":1771792750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":1771792750},{"type":"v1","addr":"172.21.2.115:6809","nonce":1771792750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":1771792750},{"type":"v1","addr":"172.21.2.115:6807","nonce":1771792750}]},"public_addr":"172.21.2.115:6803/1771792750","cluster_addr":"172.21.2.115:6805/1771792750","heartbeat_back_addr":"172.21.2.115:6809/1771792750","heartbeat_front_addr":"172.21.2.115:6807/1771792750","state":["exists","up"]},{"osd":1,"uuid":"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":1316793725},{"type":"v1","addr":"172.21.2.115:6811","nonce":1316793725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":1316793725},{"type":"v1","addr":"172.21.2.115:6813","nonce":1316793725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":1316793725},{"type":"v1","addr":"172.21.2.115:6817","nonce":1316793725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":1316793725},{"type":"v1","addr":"172.21.2.115:6815","nonce":1316793725}]},"public_addr":"172.21.2.115:6811/1316793725","cluster_addr":"172.21.2.115:6813/1316793725","heartbeat_back_addr":"172.21.2.115:6817/1316793725","heartbeat_front_addr":"172.21.2.115:6815/1316793725","state":["exists","up"]},{"osd":2,"uuid":"3ae91563-2d31-48f5-aeed-1ba427cef365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":3628070800},{"type":"v1","addr":"172.21.2.115:6819","nonce":3628070800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":3628070800},{"type":"v1","addr":"172.21.2.115:6821","nonce":3628070800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":3628070800},{"type":"v1","addr":"172.21.2.115:6825","nonce":3628070800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":3628070800},{"type":"v1","addr":"172.21.2.115:6823","nonce":3628070800}]},"public_addr":"172.21.2.115:6819/3628070800","cluster_addr":"172.21.2.115:6821/3628070800","heartbeat_back_addr":"172.21.2.115:6825/3628070800","heartbeat_front_addr":"172.21.2.115:6823/3628070800","state":["exists","up"]},{"osd":3,"uuid":"de4bb3e1-0f94-479d-9771-be80408c9a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":1478911402},{"type":"v1","addr":"172.21.2.115:6827","nonce":1478911402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":1478911402},{"type":"v1","addr":"172.21.2.115:6829","nonce":1478911402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":1478911402},{"type":"v1","addr":"172.21.2.115:6833","nonce":1478911402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":1478911402},{"type":"v1","addr":"172.21.2.115:6831","nonce":1478911402}]},"public_addr":"172.21.2.115:6827/1478911402","cluster_addr":"172.21.2.115:6829/1478911402","heartbeat_back_addr":"172.21.2.115:6833/1478911402","heartbeat_front_addr":"172.21.2.115:6831/1478911402","state":["exists","up"]},{"osd":4,"uuid":"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.145:6800","nonce":860882436},{"type":"v1","addr":"172.21.2.145:6801","nonce":860882436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.145:6802","nonce":860882436},{"type":"v1","addr":"172.21.2.145:6803","nonce":860882436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.145:6806","nonce":860882436},{"type":"v1","addr":"172.21.2.145:6807","nonce":860882436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.145:6804","nonce":860882436},{"type":"v1","addr":"172.21.2.145:6805","nonce":860882436}]},"public_addr":"172.21.2.145:6801/860882436","cluster_addr":"172.21.2.145:6803/860882436","heartbeat_back_addr":"172.21.2.145:6807/860882436","heartbeat_front_addr":"172.21.2.145:6805/860882436","state":["exists","up"]},{"osd":5,"uuid":"81a848ae-eccd-42a4-8537-dde9fbce70f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.145:6808","nonce":839821364},{"type":"v1","addr":"172.21.2.145:6809","nonce":839821364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.145:6810","nonce":839821364},{"type":"v1","addr":"172.21.2.145:6811","nonce":839821364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.145:6814","nonce":839821364},{"type":"v1","addr":"172.21.2.145:6815","nonce":839821364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.145:6812","nonce":839821364},{"type":"v1","addr":"172.21.2.145:6813","nonce":839821364}]},"public_addr":"172.21.2.145:6809/839821364","cluster_addr":"172.21.2.145:6811/839821364","heartbeat_back_addr":"172.21.2.145:6815/839821364","heartbeat_front_addr":"172.21.2.145:6813/839821364","state":["exists","up"]},{"osd":6,"uuid":"e1f6bac7-fc45-424c-be0e-0ed40192d2a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.145:6816","nonce":2136431237},{"type":"v1","addr":"172.21.2.145:6817","nonce":2136431237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.145:6818","nonce":2136431237},{"type":"v1","addr":"172.21.2.145:6819","nonce":2136431237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.145:6822","nonce":2136431237},{"type":"v1","addr":"172.21.2.145:6823","nonce":2136431237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.145:6820","nonce":2136431237},{"type":"v1","addr":"172.21.2.145:6821","nonce":2136431237}]},"public_addr":"172.21.2.145:6817/2136431237","cluster_addr":"172.21.2.145:6819/2136431237","heartbeat_back_addr":"172.21.2.145:6823/2136431237","heartbeat_front_addr":"172.21.2.145:6821/2136431237","state":["exists","up"]},{"osd":7,"uuid":"d10c3d75-2027-4372-9bcb-24a1c376704e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.145:6824","nonce":604814097},{"type":"v1","addr":"172.21.2.145:6825","nonce":604814097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.145:6826","nonce":604814097},{"type":"v1","addr":"172.21.2.145:6827","nonce":604814097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.145:6830","nonce":604814097},{"type":"v1","addr":"172.21.2.145:6831","nonce":604814097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.145:6828","nonce":604814097},{"type":"v1","addr":"172.21.2.145:6829","nonce":604814097}]},"public_addr":"172.21.2.145:6825/604814097","cluster_addr":"172.21.2.145:6827/604814097","heartbeat_back_addr":"172.21.2.145:6831/604814097","heartbeat_front_addr":"172.21.2.145:6829/604814097","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T13:40:57.236741+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T13:41:19.554909+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T13:41:41.826221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T13:42:04.186219+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T13:42:24.539501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T13:42:46.583449+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T13:43:07.712386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T13:43:30.440683+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.2.115:6801/2856562116":"2021-03-11T13:39:22.850169+0000","172.21.2.115:6800/2856562116":"2021-03-11T13:39:22.850169+0000","172.21.2.115:0/1426333611":"2021-03-11T13:39:22.850169+0000","172.21.2.115:0/3537681212":"2021-03-11T13:39:22.850169+0000","172.21.2.115:0/4136771330":"2021-03-11T13:39:22.850169+0000","172.21.2.115:0/683907604":"2021-03-11T13:39:08.741345+0000","172.21.2.115:6800/357167334":"2021-03-11T13:39:08.741345+0000","172.21.2.115:0/4116648559":"2021-03-11T13:39:08.741345+0000","172.21.2.115:0/354126993":"2021-03-11T13:39:08.741345+0000","172.21.2.115:6801/357167334":"2021-03-11T13:39:08.741345+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-03-10T13:44:09.058 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:08 gibba045 docker[19142]: Error: No such container: ceph-e4a642d2-81a5-11eb-9080-001a4aab830c-grafana.a 2021-03-10T13:44:09.059 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:08 gibba045 systemd[1]: Started Ceph grafana.a for e4a642d2-81a5-11eb-9080-001a4aab830c. 2021-03-10T13:44:09.381 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:44:09 gibba015 bash[13005]: audit 2021-03-10T13:44:08.736797+0000 mon.a (mon.0) 507 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.657123\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.657397\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.657568\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.657727\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.657880\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.658029\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.658179\", \"created\": \"2021-03-10T13:43:22.897564\", \"started\": \"2021-03-10T13:43:26.167781\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"container_id\": \"c7e3982b6fae\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.658331\", \"created\": \"2021-03-10T13:43:42.821564\", \"started\": \"2021-03-10T13:43:42.848064\"}, \"node-exporter.b\": {\"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.658482\", \"created\": \"2021-03-10T13:43:43.861564\", \"started\": \"2021-03-10T13:43:45.351099\"}, \"grafana.a\": {\"hostname\": \"gibba045\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:43:30.705787\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818\"}}, \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:44:09.382 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:44:09 gibba015 bash[9806]: audit 2021-03-10T13:44:08.736797+0000 mon.a (mon.0) 507 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.657123\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.657397\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.657568\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.657727\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.657880\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.658029\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.658179\", \"created\": \"2021-03-10T13:43:22.897564\", \"started\": \"2021-03-10T13:43:26.167781\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"container_id\": \"c7e3982b6fae\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.658331\", \"created\": \"2021-03-10T13:43:42.821564\", \"started\": \"2021-03-10T13:43:42.848064\"}, \"node-exporter.b\": {\"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.658482\", \"created\": \"2021-03-10T13:43:43.861564\", \"started\": \"2021-03-10T13:43:45.351099\"}, \"grafana.a\": {\"hostname\": \"gibba045\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:43:30.705787\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818\"}}, \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:44:09.382 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:44:09 gibba015 bash[9806]: audit 2021-03-10T13:44:08.741516+0000 mon.a (mon.0) 508 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.657123\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.657397\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.657568\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.657727\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.657880\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.658029\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.658179\", \"created\": \"2021-03-10T13:43:22.897564\", \"started\": \"2021-03-10T13:43:26.167781\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"container_id\": \"c7e3982b6fae\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.658331\", \"created\": \"2021-03-10T13:43:42.821564\", \"started\": \"2021-03-10T13:43:42.848064\"}, \"node-exporter.b\": {\"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.658482\", \"created\": \"2021-03-10T13:43:43.861564\", \"started\": \"2021-03-10T13:43:45.351099\"}, \"grafana.a\": {\"hostname\": \"gibba045\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:43:30.705787\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818\"}}, \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:44:09.383 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:44:09 gibba015 bash[9806]: audit 2021-03-10T13:44:08.742652+0000 mon.a (mon.0) 509 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:44:09.383 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:44:09 gibba015 bash[9806]: audit 2021-03-10T13:44:08.941794+0000 mon.a (mon.0) 510 : audit [DBG] from='client.? 172.21.2.115:0/2460446746' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-03-10T13:44:09.383 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:44:09 gibba015 bash[13005]: audit 2021-03-10T13:44:08.741516+0000 mon.a (mon.0) 508 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.657123\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.657397\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.657568\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.657727\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.657880\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.658029\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.658179\", \"created\": \"2021-03-10T13:43:22.897564\", \"started\": \"2021-03-10T13:43:26.167781\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"container_id\": \"c7e3982b6fae\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.658331\", \"created\": \"2021-03-10T13:43:42.821564\", \"started\": \"2021-03-10T13:43:42.848064\"}, \"node-exporter.b\": {\"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.658482\", \"created\": \"2021-03-10T13:43:43.861564\", \"started\": \"2021-03-10T13:43:45.351099\"}, \"grafana.a\": {\"hostname\": \"gibba045\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:43:30.705787\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818\"}}, \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:44:09.384 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:44:09 gibba015 bash[13005]: audit 2021-03-10T13:44:08.742652+0000 mon.a (mon.0) 509 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:44:09.384 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:44:09 gibba015 bash[13005]: audit 2021-03-10T13:44:08.941794+0000 mon.a (mon.0) 510 : audit [DBG] from='client.? 172.21.2.115:0/2460446746' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-03-10T13:44:09.534 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:44:09 gibba045 bash[9787]: audit 2021-03-10T13:44:08.736797+0000 mon.a (mon.0) 507 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.657123\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.657397\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.657568\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.657727\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.657880\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.658029\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.658179\", \"created\": \"2021-03-10T13:43:22.897564\", \"started\": \"2021-03-10T13:43:26.167781\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"container_id\": \"c7e3982b6fae\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.658331\", \"created\": \"2021-03-10T13:43:42.821564\", \"started\": \"2021-03-10T13:43:42.848064\"}, \"node-exporter.b\": {\"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.658482\", \"created\": \"2021-03-10T13:43:43.861564\", \"started\": \"2021-03-10T13:43:45.351099\"}, \"grafana.a\": {\"hostname\": \"gibba045\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:43:30.705787\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818\"}}, \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:44:09.535 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:44:09 gibba045 bash[9787]: audit 2021-03-10T13:44:08.741516+0000 mon.a (mon.0) 508 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.657123\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.657397\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.657568\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.657727\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.657880\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.658029\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.658179\", \"created\": \"2021-03-10T13:43:22.897564\", \"started\": \"2021-03-10T13:43:26.167781\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"container_id\": \"c7e3982b6fae\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.658331\", \"created\": \"2021-03-10T13:43:42.821564\", \"started\": \"2021-03-10T13:43:42.848064\"}, \"node-exporter.b\": {\"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:56.658482\", \"created\": \"2021-03-10T13:43:43.861564\", \"started\": \"2021-03-10T13:43:45.351099\"}, \"grafana.a\": {\"hostname\": \"gibba045\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:43:30.705787\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818\"}}, \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:44:09.535 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:44:09 gibba045 bash[9787]: audit 2021-03-10T13:44:08.742652+0000 mon.a (mon.0) 509 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:44:09.535 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:44:09 gibba045 bash[9787]: audit 2021-03-10T13:44:08.941794+0000 mon.a (mon.0) 510 : audit [DBG] from='client.? 172.21.2.115:0/2460446746' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-03-10T13:44:09.576 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2021-03-10T13:44:09.577 DEBUG:teuthology.orchestra.run.gibba015:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid e4a642d2-81a5-11eb-9080-001a4aab830c -- ceph osd dump --format=json 2021-03-10T13:44:09.808 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:09 gibba045 bash[19160]: t=2021-03-10T13:44:09+0000 lvl=info msg="Starting Grafana" logger=server version=6.6.2 commit=3fa63cfc34 branch=HEAD compiled=2020-02-20T12:03:49+0000 2021-03-10T13:44:09.808 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:09 gibba045 bash[19160]: t=2021-03-10T13:44:09+0000 lvl=info msg="Config loaded from" logger=settings file=/usr/share/grafana/conf/defaults.ini 2021-03-10T13:44:09.808 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:09 gibba045 bash[19160]: t=2021-03-10T13:44:09+0000 lvl=info msg="Config loaded from" logger=settings file=/etc/grafana/grafana.ini 2021-03-10T13:44:09.809 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:09 gibba045 bash[19160]: t=2021-03-10T13:44:09+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_DATA=/var/lib/grafana" 2021-03-10T13:44:09.809 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:09 gibba045 bash[19160]: t=2021-03-10T13:44:09+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_LOGS=/var/log/grafana" 2021-03-10T13:44:09.809 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:09 gibba045 bash[19160]: t=2021-03-10T13:44:09+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_PLUGINS=/var/lib/grafana/plugins" 2021-03-10T13:44:09.809 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:09 gibba045 bash[19160]: t=2021-03-10T13:44:09+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_PROVISIONING=/etc/grafana/provisioning" 2021-03-10T13:44:09.810 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:09 gibba045 bash[19160]: t=2021-03-10T13:44:09+0000 lvl=info msg="Path Home" logger=settings path=/usr/share/grafana 2021-03-10T13:44:09.810 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:09 gibba045 bash[19160]: t=2021-03-10T13:44:09+0000 lvl=info msg="Path Data" logger=settings path=/var/lib/grafana 2021-03-10T13:44:09.810 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:09 gibba045 bash[19160]: t=2021-03-10T13:44:09+0000 lvl=info msg="Path Logs" logger=settings path=/var/log/grafana 2021-03-10T13:44:09.810 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:09 gibba045 bash[19160]: t=2021-03-10T13:44:09+0000 lvl=info msg="Path Plugins" logger=settings path=/var/lib/grafana/plugins 2021-03-10T13:44:09.811 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:09 gibba045 bash[19160]: t=2021-03-10T13:44:09+0000 lvl=info msg="Path Provisioning" logger=settings path=/etc/grafana/provisioning 2021-03-10T13:44:09.811 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:09 gibba045 bash[19160]: t=2021-03-10T13:44:09+0000 lvl=info msg="App mode production" logger=settings 2021-03-10T13:44:09.811 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:09 gibba045 bash[19160]: t=2021-03-10T13:44:09+0000 lvl=info msg="Initializing SqlStore" logger=server 2021-03-10T13:44:09.811 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:09 gibba045 bash[19160]: t=2021-03-10T13:44:09+0000 lvl=info msg="Connecting to DB" logger=sqlstore dbtype=sqlite3 2021-03-10T13:44:09.811 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:09 gibba045 bash[19160]: t=2021-03-10T13:44:09+0000 lvl=info msg="Starting DB migration" logger=migrator 2021-03-10T13:44:09.812 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:09 gibba045 bash[19160]: t=2021-03-10T13:44:09+0000 lvl=info msg="Executing migration" logger=migrator id="create migration_log table" 2021-03-10T13:44:09.812 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:09 gibba045 bash[19160]: t=2021-03-10T13:44:09+0000 lvl=info msg="Executing migration" logger=migrator id="create user table" 2021-03-10T13:44:09.812 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:09 gibba045 bash[19160]: t=2021-03-10T13:44:09+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user.login" 2021-03-10T13:44:10.089 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:09 gibba045 bash[19160]: t=2021-03-10T13:44:09+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user.email" 2021-03-10T13:44:10.089 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:09 gibba045 bash[19160]: t=2021-03-10T13:44:09+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_user_login - v1" 2021-03-10T13:44:10.090 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:09 gibba045 bash[19160]: t=2021-03-10T13:44:09+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_user_email - v1" 2021-03-10T13:44:10.090 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:10 gibba045 bash[19160]: t=2021-03-10T13:44:10+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table user to user_v1 - v1" 2021-03-10T13:44:10.366 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:10 gibba045 bash[19160]: t=2021-03-10T13:44:10+0000 lvl=info msg="Executing migration" logger=migrator id="create user table v2" 2021-03-10T13:44:10.367 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:10 gibba045 bash[19160]: t=2021-03-10T13:44:10+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_user_login - v2" 2021-03-10T13:44:10.367 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:10 gibba045 bash[19160]: t=2021-03-10T13:44:10+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_user_email - v2" 2021-03-10T13:44:10.367 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:10 gibba045 bash[19160]: t=2021-03-10T13:44:10+0000 lvl=info msg="Executing migration" logger=migrator id="copy data_source v1 to v2" 2021-03-10T13:44:10.368 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:10 gibba045 bash[19160]: t=2021-03-10T13:44:10+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table user_v1" 2021-03-10T13:44:10.368 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:44:10 gibba045 bash[9787]: cluster 2021-03-10T13:44:09.151408+0000 mgr.y (mgr.14140) 186 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:10.369 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:44:10 gibba045 bash[9787]: audit 2021-03-10T13:44:09.620036+0000 mon.a (mon.0) 511 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619060\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619134\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619164\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619191\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619218\", \"created\": \"2021-03-10T13:41:11.556448\", \"started\": \"2021-03-10T13:41:15.069232\"}, \"osd.2\": {\"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619244\", \"created\": \"2021-03-10T13:41:34.244448\", \"started\": \"2021-03-10T13:41:37.507096\"}, \"osd.3\": {\"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619270\", \"created\": \"2021-03-10T13:41:57.328380\", \"started\": \"2021-03-10T13:42:00.781947\"}, \"node-exporter.a\": {\"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619296\", \"created\": \"2021-03-10T13:43:44.272379\", \"started\": \"2021-03-10T13:43:47.550063\"}, \"alertmanager.a\": {\"hostname\": \"gibba015\", \"container_id\": \"a6e6a6bfd056\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619322\", \"created\": \"2021-03-10T13:43:54.628379\", \"started\": \"2021-03-10T13:43:54.655085\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:44.286749\"}}, \"last_daemon_update\": \"2021-03-10T13:44:09.619387\", \"last_device_update\": \"2021-03-10T13:42:03.853072\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]: dispatch 2021-03-10T13:44:10.369 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:44:10 gibba045 bash[9787]: audit 2021-03-10T13:44:09.623239+0000 mon.a (mon.0) 512 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619060\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619134\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619164\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619191\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619218\", \"created\": \"2021-03-10T13:41:11.556448\", \"started\": \"2021-03-10T13:41:15.069232\"}, \"osd.2\": {\"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619244\", \"created\": \"2021-03-10T13:41:34.244448\", \"started\": \"2021-03-10T13:41:37.507096\"}, \"osd.3\": {\"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619270\", \"created\": \"2021-03-10T13:41:57.328380\", \"started\": \"2021-03-10T13:42:00.781947\"}, \"node-exporter.a\": {\"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619296\", \"created\": \"2021-03-10T13:43:44.272379\", \"started\": \"2021-03-10T13:43:47.550063\"}, \"alertmanager.a\": {\"hostname\": \"gibba015\", \"container_id\": \"a6e6a6bfd056\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619322\", \"created\": \"2021-03-10T13:43:54.628379\", \"started\": \"2021-03-10T13:43:54.655085\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:44.286749\"}}, \"last_daemon_update\": \"2021-03-10T13:44:09.619387\", \"last_device_update\": \"2021-03-10T13:42:03.853072\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]': finished 2021-03-10T13:44:10.369 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:44:10 gibba045 bash[9787]: audit 2021-03-10T13:44:09.623865+0000 mon.a (mon.0) 513 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:44:10.431 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:44:10 gibba015 bash[9806]: cluster 2021-03-10T13:44:09.151408+0000 mgr.y (mgr.14140) 186 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:10.432 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:44:10 gibba015 bash[13005]: cluster 2021-03-10T13:44:09.151408+0000 mgr.y (mgr.14140) 186 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:10.432 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:44:10 gibba015 bash[9806]: audit 2021-03-10T13:44:09.620036+0000 mon.a (mon.0) 511 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619060\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619134\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619164\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619191\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619218\", \"created\": \"2021-03-10T13:41:11.556448\", \"started\": \"2021-03-10T13:41:15.069232\"}, \"osd.2\": {\"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619244\", \"created\": \"2021-03-10T13:41:34.244448\", \"started\": \"2021-03-10T13:41:37.507096\"}, \"osd.3\": {\"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619270\", \"created\": \"2021-03-10T13:41:57.328380\", \"started\": \"2021-03-10T13:42:00.781947\"}, \"node-exporter.a\": {\"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619296\", \"created\": \"2021-03-10T13:43:44.272379\", \"started\": \"2021-03-10T13:43:47.550063\"}, \"alertmanager.a\": {\"hostname\": \"gibba015\", \"container_id\": \"a6e6a6bfd056\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619322\", \"created\": \"2021-03-10T13:43:54.628379\", \"started\": \"2021-03-10T13:43:54.655085\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:44.286749\"}}, \"last_daemon_update\": \"2021-03-10T13:44:09.619387\", \"last_device_update\": \"2021-03-10T13:42:03.853072\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]: dispatch 2021-03-10T13:44:10.433 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:44:10 gibba015 bash[9806]: audit 2021-03-10T13:44:09.623239+0000 mon.a (mon.0) 512 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619060\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619134\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619164\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619191\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619218\", \"created\": \"2021-03-10T13:41:11.556448\", \"started\": \"2021-03-10T13:41:15.069232\"}, \"osd.2\": {\"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619244\", \"created\": \"2021-03-10T13:41:34.244448\", \"started\": \"2021-03-10T13:41:37.507096\"}, \"osd.3\": {\"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619270\", \"created\": \"2021-03-10T13:41:57.328380\", \"started\": \"2021-03-10T13:42:00.781947\"}, \"node-exporter.a\": {\"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619296\", \"created\": \"2021-03-10T13:43:44.272379\", \"started\": \"2021-03-10T13:43:47.550063\"}, \"alertmanager.a\": {\"hostname\": \"gibba015\", \"container_id\": \"a6e6a6bfd056\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619322\", \"created\": \"2021-03-10T13:43:54.628379\", \"started\": \"2021-03-10T13:43:54.655085\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:44.286749\"}}, \"last_daemon_update\": \"2021-03-10T13:44:09.619387\", \"last_device_update\": \"2021-03-10T13:42:03.853072\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]': finished 2021-03-10T13:44:10.433 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:44:10 gibba015 bash[9806]: audit 2021-03-10T13:44:09.623865+0000 mon.a (mon.0) 513 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:44:10.434 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:44:10 gibba015 bash[13005]: audit 2021-03-10T13:44:09.620036+0000 mon.a (mon.0) 511 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619060\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619134\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619164\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619191\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619218\", \"created\": \"2021-03-10T13:41:11.556448\", \"started\": \"2021-03-10T13:41:15.069232\"}, \"osd.2\": {\"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619244\", \"created\": \"2021-03-10T13:41:34.244448\", \"started\": \"2021-03-10T13:41:37.507096\"}, \"osd.3\": {\"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619270\", \"created\": \"2021-03-10T13:41:57.328380\", \"started\": \"2021-03-10T13:42:00.781947\"}, \"node-exporter.a\": {\"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619296\", \"created\": \"2021-03-10T13:43:44.272379\", \"started\": \"2021-03-10T13:43:47.550063\"}, \"alertmanager.a\": {\"hostname\": \"gibba015\", \"container_id\": \"a6e6a6bfd056\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619322\", \"created\": \"2021-03-10T13:43:54.628379\", \"started\": \"2021-03-10T13:43:54.655085\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:44.286749\"}}, \"last_daemon_update\": \"2021-03-10T13:44:09.619387\", \"last_device_update\": \"2021-03-10T13:42:03.853072\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]: dispatch 2021-03-10T13:44:10.434 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:44:10 gibba015 bash[13005]: audit 2021-03-10T13:44:09.623239+0000 mon.a (mon.0) 512 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619060\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619134\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619164\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619191\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619218\", \"created\": \"2021-03-10T13:41:11.556448\", \"started\": \"2021-03-10T13:41:15.069232\"}, \"osd.2\": {\"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619244\", \"created\": \"2021-03-10T13:41:34.244448\", \"started\": \"2021-03-10T13:41:37.507096\"}, \"osd.3\": {\"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619270\", \"created\": \"2021-03-10T13:41:57.328380\", \"started\": \"2021-03-10T13:42:00.781947\"}, \"node-exporter.a\": {\"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619296\", \"created\": \"2021-03-10T13:43:44.272379\", \"started\": \"2021-03-10T13:43:47.550063\"}, \"alertmanager.a\": {\"hostname\": \"gibba015\", \"container_id\": \"a6e6a6bfd056\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619322\", \"created\": \"2021-03-10T13:43:54.628379\", \"started\": \"2021-03-10T13:43:54.655085\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:44.286749\"}}, \"last_daemon_update\": \"2021-03-10T13:44:09.619387\", \"last_device_update\": \"2021-03-10T13:42:03.853072\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]': finished 2021-03-10T13:44:10.434 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:44:10 gibba015 bash[13005]: audit 2021-03-10T13:44:09.623865+0000 mon.a (mon.0) 513 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:44:10.661 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:10 gibba045 bash[19160]: t=2021-03-10T13:44:10+0000 lvl=info msg="Executing migration" logger=migrator id="Add column help_flags1 to user table" 2021-03-10T13:44:10.661 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:10 gibba045 bash[19160]: t=2021-03-10T13:44:10+0000 lvl=info msg="Executing migration" logger=migrator id="Update user table charset" 2021-03-10T13:44:10.661 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:10 gibba045 bash[19160]: t=2021-03-10T13:44:10+0000 lvl=info msg="Executing migration" logger=migrator id="Add last_seen_at column to user" 2021-03-10T13:44:10.662 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:10 gibba045 bash[19160]: t=2021-03-10T13:44:10+0000 lvl=info msg="Executing migration" logger=migrator id="Add missing user data" 2021-03-10T13:44:10.662 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:10 gibba045 bash[19160]: t=2021-03-10T13:44:10+0000 lvl=info msg="Executing migration" logger=migrator id="Add is_disabled column to user" 2021-03-10T13:44:10.662 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:10 gibba045 bash[19160]: t=2021-03-10T13:44:10+0000 lvl=info msg="Executing migration" logger=migrator id="create temp user table v1-7" 2021-03-10T13:44:10.922 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:10 gibba045 bash[19160]: t=2021-03-10T13:44:10+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_email - v1-7" 2021-03-10T13:44:10.922 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:10 gibba045 bash[19160]: t=2021-03-10T13:44:10+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_org_id - v1-7" 2021-03-10T13:44:10.922 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:10 gibba045 bash[19160]: t=2021-03-10T13:44:10+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_code - v1-7" 2021-03-10T13:44:10.923 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:10 gibba045 bash[19160]: t=2021-03-10T13:44:10+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_status - v1-7" 2021-03-10T13:44:10.923 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:10 gibba045 bash[19160]: t=2021-03-10T13:44:10+0000 lvl=info msg="Executing migration" logger=migrator id="Update temp_user table charset" 2021-03-10T13:44:10.923 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:10 gibba045 bash[19160]: t=2021-03-10T13:44:10+0000 lvl=info msg="Executing migration" logger=migrator id="create star table" 2021-03-10T13:44:10.923 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:10 gibba045 bash[19160]: t=2021-03-10T13:44:10+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index star.user_id_dashboard_id" 2021-03-10T13:44:11.182 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:11 gibba045 bash[19160]: t=2021-03-10T13:44:11+0000 lvl=info msg="Executing migration" logger=migrator id="create org table v1" 2021-03-10T13:44:11.182 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:11 gibba045 bash[19160]: t=2021-03-10T13:44:11+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_org_name - v1" 2021-03-10T13:44:11.183 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:11 gibba045 bash[19160]: t=2021-03-10T13:44:11+0000 lvl=info msg="Executing migration" logger=migrator id="create org_user table v1" 2021-03-10T13:44:11.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:44:11 gibba015 bash[9806]: audit 2021-03-10T13:44:10.550006+0000 mon.a (mon.0) 514 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.548877\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.548943\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.548976\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.549007\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.549037\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.549075\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.549107\", \"created\": \"2021-03-10T13:43:22.897564\", \"started\": \"2021-03-10T13:43:26.167781\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"container_id\": \"c7e3982b6fae\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.549137\", \"created\": \"2021-03-10T13:43:42.821564\", \"started\": \"2021-03-10T13:43:42.848064\"}, \"node-exporter.b\": {\"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.549167\", \"created\": \"2021-03-10T13:43:43.861564\", \"started\": \"2021-03-10T13:43:45.351099\"}, \"grafana.a\": {\"hostname\": \"gibba045\", \"container_id\": \"d86cab6511db\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.549197\", \"created\": \"2021-03-10T13:44:08.721564\", \"started\": \"2021-03-10T13:44:08.746042\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:43:30.705787\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818\"}}, \"last_daemon_update\": \"2021-03-10T13:44:10.549271\", \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:44:11.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:44:11 gibba015 bash[9806]: audit 2021-03-10T13:44:10.552893+0000 mon.a (mon.0) 515 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.548877\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.548943\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.548976\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.549007\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.549037\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.549075\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.549107\", \"created\": \"2021-03-10T13:43:22.897564\", \"started\": \"2021-03-10T13:43:26.167781\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"container_id\": \"c7e3982b6fae\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.549137\", \"created\": \"2021-03-10T13:43:42.821564\", \"started\": \"2021-03-10T13:43:42.848064\"}, \"node-exporter.b\": {\"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.549167\", \"created\": \"2021-03-10T13:43:43.861564\", \"started\": \"2021-03-10T13:43:45.351099\"}, \"grafana.a\": {\"hostname\": \"gibba045\", \"container_id\": \"d86cab6511db\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.549197\", \"created\": \"2021-03-10T13:44:08.721564\", \"started\": \"2021-03-10T13:44:08.746042\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:43:30.705787\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818\"}}, \"last_daemon_update\": \"2021-03-10T13:44:10.549271\", \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:44:11.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:44:11 gibba015 bash[9806]: cephadm 2021-03-10T13:44:10.554423+0000 mgr.y (mgr.14140) 187 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2021-03-10T13:44:11.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:44:11 gibba015 bash[9806]: cephadm 2021-03-10T13:44:10.556483+0000 mgr.y (mgr.14140) 188 : cephadm [INF] Reconfiguring daemon alertmanager.a on gibba015 2021-03-10T13:44:11.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:44:11 gibba015 bash[13005]: audit 2021-03-10T13:44:10.550006+0000 mon.a (mon.0) 514 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.548877\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.548943\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.548976\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.549007\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.549037\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.549075\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.549107\", \"created\": \"2021-03-10T13:43:22.897564\", \"started\": \"2021-03-10T13:43:26.167781\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"container_id\": \"c7e3982b6fae\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.549137\", \"created\": \"2021-03-10T13:43:42.821564\", \"started\": \"2021-03-10T13:43:42.848064\"}, \"node-exporter.b\": {\"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.549167\", \"created\": \"2021-03-10T13:43:43.861564\", \"started\": \"2021-03-10T13:43:45.351099\"}, \"grafana.a\": {\"hostname\": \"gibba045\", \"container_id\": \"d86cab6511db\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.549197\", \"created\": \"2021-03-10T13:44:08.721564\", \"started\": \"2021-03-10T13:44:08.746042\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:43:30.705787\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818\"}}, \"last_daemon_update\": \"2021-03-10T13:44:10.549271\", \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:44:11.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:44:11 gibba015 bash[13005]: audit 2021-03-10T13:44:10.552893+0000 mon.a (mon.0) 515 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.548877\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.548943\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.548976\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.549007\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.549037\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.549075\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.549107\", \"created\": \"2021-03-10T13:43:22.897564\", \"started\": \"2021-03-10T13:43:26.167781\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"container_id\": \"c7e3982b6fae\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.549137\", \"created\": \"2021-03-10T13:43:42.821564\", \"started\": \"2021-03-10T13:43:42.848064\"}, \"node-exporter.b\": {\"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.549167\", \"created\": \"2021-03-10T13:43:43.861564\", \"started\": \"2021-03-10T13:43:45.351099\"}, \"grafana.a\": {\"hostname\": \"gibba045\", \"container_id\": \"d86cab6511db\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.549197\", \"created\": \"2021-03-10T13:44:08.721564\", \"started\": \"2021-03-10T13:44:08.746042\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:43:30.705787\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818\"}}, \"last_daemon_update\": \"2021-03-10T13:44:10.549271\", \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:44:11.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:44:11 gibba015 bash[13005]: cephadm 2021-03-10T13:44:10.554423+0000 mgr.y (mgr.14140) 187 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2021-03-10T13:44:11.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:44:11 gibba015 bash[13005]: cephadm 2021-03-10T13:44:10.556483+0000 mgr.y (mgr.14140) 188 : cephadm [INF] Reconfiguring daemon alertmanager.a on gibba015 2021-03-10T13:44:11.483 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:11 gibba045 bash[19160]: t=2021-03-10T13:44:11+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_org_user_org_id - v1" 2021-03-10T13:44:11.484 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:11 gibba045 bash[19160]: t=2021-03-10T13:44:11+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_org_user_org_id_user_id - v1" 2021-03-10T13:44:11.484 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:11 gibba045 bash[19160]: t=2021-03-10T13:44:11+0000 lvl=info msg="Executing migration" logger=migrator id="Update org table charset" 2021-03-10T13:44:11.484 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:11 gibba045 bash[19160]: t=2021-03-10T13:44:11+0000 lvl=info msg="Executing migration" logger=migrator id="Update org_user table charset" 2021-03-10T13:44:11.485 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:44:11 gibba045 bash[9787]: audit 2021-03-10T13:44:10.550006+0000 mon.a (mon.0) 514 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.548877\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.548943\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.548976\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.549007\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.549037\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.549075\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.549107\", \"created\": \"2021-03-10T13:43:22.897564\", \"started\": \"2021-03-10T13:43:26.167781\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"container_id\": \"c7e3982b6fae\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.549137\", \"created\": \"2021-03-10T13:43:42.821564\", \"started\": \"2021-03-10T13:43:42.848064\"}, \"node-exporter.b\": {\"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.549167\", \"created\": \"2021-03-10T13:43:43.861564\", \"started\": \"2021-03-10T13:43:45.351099\"}, \"grafana.a\": {\"hostname\": \"gibba045\", \"container_id\": \"d86cab6511db\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.549197\", \"created\": \"2021-03-10T13:44:08.721564\", \"started\": \"2021-03-10T13:44:08.746042\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:43:30.705787\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818\"}}, \"last_daemon_update\": \"2021-03-10T13:44:10.549271\", \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:44:11.485 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:44:11 gibba045 bash[9787]: audit 2021-03-10T13:44:10.552893+0000 mon.a (mon.0) 515 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.548877\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.548943\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.548976\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.549007\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.549037\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.549075\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.549107\", \"created\": \"2021-03-10T13:43:22.897564\", \"started\": \"2021-03-10T13:43:26.167781\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"container_id\": \"c7e3982b6fae\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.549137\", \"created\": \"2021-03-10T13:43:42.821564\", \"started\": \"2021-03-10T13:43:42.848064\"}, \"node-exporter.b\": {\"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.549167\", \"created\": \"2021-03-10T13:43:43.861564\", \"started\": \"2021-03-10T13:43:45.351099\"}, \"grafana.a\": {\"hostname\": \"gibba045\", \"container_id\": \"d86cab6511db\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.549197\", \"created\": \"2021-03-10T13:44:08.721564\", \"started\": \"2021-03-10T13:44:08.746042\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:43:30.705787\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818\"}}, \"last_daemon_update\": \"2021-03-10T13:44:10.549271\", \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:44:11.486 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:44:11 gibba045 bash[9787]: cephadm 2021-03-10T13:44:10.554423+0000 mgr.y (mgr.14140) 187 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2021-03-10T13:44:11.486 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:44:11 gibba045 bash[9787]: cephadm 2021-03-10T13:44:10.556483+0000 mgr.y (mgr.14140) 188 : cephadm [INF] Reconfiguring daemon alertmanager.a on gibba015 2021-03-10T13:44:11.753 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:11 gibba045 bash[19160]: t=2021-03-10T13:44:11+0000 lvl=info msg="Executing migration" logger=migrator id="Migrate all Read Only Viewers to Viewers" 2021-03-10T13:44:11.753 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:11 gibba045 bash[19160]: t=2021-03-10T13:44:11+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard table" 2021-03-10T13:44:11.754 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:11 gibba045 bash[19160]: t=2021-03-10T13:44:11+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard.account_id" 2021-03-10T13:44:11.754 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:11 gibba045 bash[19160]: t=2021-03-10T13:44:11+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_account_id_slug" 2021-03-10T13:44:12.038 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:11 gibba045 bash[19160]: t=2021-03-10T13:44:11+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_tag table" 2021-03-10T13:44:12.039 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:11 gibba045 bash[19160]: t=2021-03-10T13:44:11+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_tag.dasboard_id_term" 2021-03-10T13:44:12.039 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:11 gibba045 bash[19160]: t=2021-03-10T13:44:11+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_dashboard_tag_dashboard_id_term - v1" 2021-03-10T13:44:12.039 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:11 gibba045 bash[19160]: t=2021-03-10T13:44:11+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table dashboard to dashboard_v1 - v1" 2021-03-10T13:44:12.040 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:11 gibba045 bash[19160]: t=2021-03-10T13:44:11+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard v2" 2021-03-10T13:44:12.040 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:12 gibba045 bash[19160]: t=2021-03-10T13:44:12+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_org_id - v2" 2021-03-10T13:44:12.306 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:12 gibba045 bash[19160]: t=2021-03-10T13:44:12+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_org_id_slug - v2" 2021-03-10T13:44:12.307 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:12 gibba045 bash[19160]: t=2021-03-10T13:44:12+0000 lvl=info msg="Executing migration" logger=migrator id="copy dashboard v1 to v2" 2021-03-10T13:44:12.307 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:12 gibba045 bash[19160]: t=2021-03-10T13:44:12+0000 lvl=info msg="Executing migration" logger=migrator id="drop table dashboard_v1" 2021-03-10T13:44:12.558 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:12 gibba045 bash[19160]: t=2021-03-10T13:44:12+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard.data to mediumtext v1" 2021-03-10T13:44:12.558 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:12 gibba045 bash[19160]: t=2021-03-10T13:44:12+0000 lvl=info msg="Executing migration" logger=migrator id="Add column updated_by in dashboard - v2" 2021-03-10T13:44:12.559 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:12 gibba045 bash[19160]: t=2021-03-10T13:44:12+0000 lvl=info msg="Executing migration" logger=migrator id="Add column created_by in dashboard - v2" 2021-03-10T13:44:12.559 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:12 gibba045 bash[19160]: t=2021-03-10T13:44:12+0000 lvl=info msg="Executing migration" logger=migrator id="Add column gnetId in dashboard" 2021-03-10T13:44:12.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:44:12 gibba015 bash[9806]: cluster 2021-03-10T13:44:11.152054+0000 mgr.y (mgr.14140) 189 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:12.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:44:12 gibba015 bash[13005]: cluster 2021-03-10T13:44:11.152054+0000 mgr.y (mgr.14140) 189 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:12.868 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:44:12 gibba045 bash[9787]: cluster 2021-03-10T13:44:11.152054+0000 mgr.y (mgr.14140) 189 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:12.868 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:12 gibba045 bash[19160]: t=2021-03-10T13:44:12+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for gnetId in dashboard" 2021-03-10T13:44:12.869 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:12 gibba045 bash[19160]: t=2021-03-10T13:44:12+0000 lvl=info msg="Executing migration" logger=migrator id="Add column plugin_id in dashboard" 2021-03-10T13:44:12.869 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:12 gibba045 bash[19160]: t=2021-03-10T13:44:12+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for plugin_id in dashboard" 2021-03-10T13:44:12.869 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:12 gibba045 bash[19160]: t=2021-03-10T13:44:12+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for dashboard_id in dashboard_tag" 2021-03-10T13:44:12.869 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:12 gibba045 bash[19160]: t=2021-03-10T13:44:12+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard table charset" 2021-03-10T13:44:13.015 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-03-10T13:44:13.015 INFO:teuthology.orchestra.run.gibba015.stdout:{"epoch":48,"fsid":"e4a642d2-81a5-11eb-9080-001a4aab830c","created":"2021-03-10T13:38:51.836343+0000","modified":"2021-03-10T13:43:33.188920+0000","last_up_change":"2021-03-10T13:43:32.175965+0000","last_in_change":"2021-03-10T13:43:32.175965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-03-10T13:39:01.965515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"8e0c9467-d453-440a-91ea-1b07c3f35dde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":1771792750},{"type":"v1","addr":"172.21.2.115:6803","nonce":1771792750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":1771792750},{"type":"v1","addr":"172.21.2.115:6805","nonce":1771792750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":1771792750},{"type":"v1","addr":"172.21.2.115:6809","nonce":1771792750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":1771792750},{"type":"v1","addr":"172.21.2.115:6807","nonce":1771792750}]},"public_addr":"172.21.2.115:6803/1771792750","cluster_addr":"172.21.2.115:6805/1771792750","heartbeat_back_addr":"172.21.2.115:6809/1771792750","heartbeat_front_addr":"172.21.2.115:6807/1771792750","state":["exists","up"]},{"osd":1,"uuid":"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":1316793725},{"type":"v1","addr":"172.21.2.115:6811","nonce":1316793725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":1316793725},{"type":"v1","addr":"172.21.2.115:6813","nonce":1316793725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":1316793725},{"type":"v1","addr":"172.21.2.115:6817","nonce":1316793725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":1316793725},{"type":"v1","addr":"172.21.2.115:6815","nonce":1316793725}]},"public_addr":"172.21.2.115:6811/1316793725","cluster_addr":"172.21.2.115:6813/1316793725","heartbeat_back_addr":"172.21.2.115:6817/1316793725","heartbeat_front_addr":"172.21.2.115:6815/1316793725","state":["exists","up"]},{"osd":2,"uuid":"3ae91563-2d31-48f5-aeed-1ba427cef365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":3628070800},{"type":"v1","addr":"172.21.2.115:6819","nonce":3628070800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":3628070800},{"type":"v1","addr":"172.21.2.115:6821","nonce":3628070800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":3628070800},{"type":"v1","addr":"172.21.2.115:6825","nonce":3628070800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":3628070800},{"type":"v1","addr":"172.21.2.115:6823","nonce":3628070800}]},"public_addr":"172.21.2.115:6819/3628070800","cluster_addr":"172.21.2.115:6821/3628070800","heartbeat_back_addr":"172.21.2.115:6825/3628070800","heartbeat_front_addr":"172.21.2.115:6823/3628070800","state":["exists","up"]},{"osd":3,"uuid":"de4bb3e1-0f94-479d-9771-be80408c9a32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":1478911402},{"type":"v1","addr":"172.21.2.115:6827","nonce":1478911402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":1478911402},{"type":"v1","addr":"172.21.2.115:6829","nonce":1478911402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":1478911402},{"type":"v1","addr":"172.21.2.115:6833","nonce":1478911402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":1478911402},{"type":"v1","addr":"172.21.2.115:6831","nonce":1478911402}]},"public_addr":"172.21.2.115:6827/1478911402","cluster_addr":"172.21.2.115:6829/1478911402","heartbeat_back_addr":"172.21.2.115:6833/1478911402","heartbeat_front_addr":"172.21.2.115:6831/1478911402","state":["exists","up"]},{"osd":4,"uuid":"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.145:6800","nonce":860882436},{"type":"v1","addr":"172.21.2.145:6801","nonce":860882436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.145:6802","nonce":860882436},{"type":"v1","addr":"172.21.2.145:6803","nonce":860882436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.145:6806","nonce":860882436},{"type":"v1","addr":"172.21.2.145:6807","nonce":860882436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.145:6804","nonce":860882436},{"type":"v1","addr":"172.21.2.145:6805","nonce":860882436}]},"public_addr":"172.21.2.145:6801/860882436","cluster_addr":"172.21.2.145:6803/860882436","heartbeat_back_addr":"172.21.2.145:6807/860882436","heartbeat_front_addr":"172.21.2.145:6805/860882436","state":["exists","up"]},{"osd":5,"uuid":"81a848ae-eccd-42a4-8537-dde9fbce70f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.145:6808","nonce":839821364},{"type":"v1","addr":"172.21.2.145:6809","nonce":839821364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.145:6810","nonce":839821364},{"type":"v1","addr":"172.21.2.145:6811","nonce":839821364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.145:6814","nonce":839821364},{"type":"v1","addr":"172.21.2.145:6815","nonce":839821364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.145:6812","nonce":839821364},{"type":"v1","addr":"172.21.2.145:6813","nonce":839821364}]},"public_addr":"172.21.2.145:6809/839821364","cluster_addr":"172.21.2.145:6811/839821364","heartbeat_back_addr":"172.21.2.145:6815/839821364","heartbeat_front_addr":"172.21.2.145:6813/839821364","state":["exists","up"]},{"osd":6,"uuid":"e1f6bac7-fc45-424c-be0e-0ed40192d2a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.145:6816","nonce":2136431237},{"type":"v1","addr":"172.21.2.145:6817","nonce":2136431237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.145:6818","nonce":2136431237},{"type":"v1","addr":"172.21.2.145:6819","nonce":2136431237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.145:6822","nonce":2136431237},{"type":"v1","addr":"172.21.2.145:6823","nonce":2136431237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.145:6820","nonce":2136431237},{"type":"v1","addr":"172.21.2.145:6821","nonce":2136431237}]},"public_addr":"172.21.2.145:6817/2136431237","cluster_addr":"172.21.2.145:6819/2136431237","heartbeat_back_addr":"172.21.2.145:6823/2136431237","heartbeat_front_addr":"172.21.2.145:6821/2136431237","state":["exists","up"]},{"osd":7,"uuid":"d10c3d75-2027-4372-9bcb-24a1c376704e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.145:6824","nonce":604814097},{"type":"v1","addr":"172.21.2.145:6825","nonce":604814097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.145:6826","nonce":604814097},{"type":"v1","addr":"172.21.2.145:6827","nonce":604814097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.145:6830","nonce":604814097},{"type":"v1","addr":"172.21.2.145:6831","nonce":604814097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.145:6828","nonce":604814097},{"type":"v1","addr":"172.21.2.145:6829","nonce":604814097}]},"public_addr":"172.21.2.145:6825/604814097","cluster_addr":"172.21.2.145:6827/604814097","heartbeat_back_addr":"172.21.2.145:6831/604814097","heartbeat_front_addr":"172.21.2.145:6829/604814097","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T13:40:57.236741+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T13:41:19.554909+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T13:41:41.826221+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T13:42:04.186219+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T13:42:24.539501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T13:42:46.583449+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T13:43:07.712386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T13:43:30.440683+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.2.115:6801/2856562116":"2021-03-11T13:39:22.850169+0000","172.21.2.115:6800/2856562116":"2021-03-11T13:39:22.850169+0000","172.21.2.115:0/1426333611":"2021-03-11T13:39:22.850169+0000","172.21.2.115:0/3537681212":"2021-03-11T13:39:22.850169+0000","172.21.2.115:0/4136771330":"2021-03-11T13:39:22.850169+0000","172.21.2.115:0/683907604":"2021-03-11T13:39:08.741345+0000","172.21.2.115:6800/357167334":"2021-03-11T13:39:08.741345+0000","172.21.2.115:0/4116648559":"2021-03-11T13:39:08.741345+0000","172.21.2.115:0/354126993":"2021-03-11T13:39:08.741345+0000","172.21.2.115:6801/357167334":"2021-03-11T13:39:08.741345+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-03-10T13:44:13.156 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:12 gibba045 bash[19160]: t=2021-03-10T13:44:12+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard_tag table charset" 2021-03-10T13:44:13.157 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:12 gibba045 bash[19160]: t=2021-03-10T13:44:12+0000 lvl=info msg="Executing migration" logger=migrator id="Add column folder_id in dashboard" 2021-03-10T13:44:13.157 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:13 gibba045 bash[19160]: t=2021-03-10T13:44:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add column isFolder in dashboard" 2021-03-10T13:44:13.157 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:13 gibba045 bash[19160]: t=2021-03-10T13:44:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add column has_acl in dashboard" 2021-03-10T13:44:13.157 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:13 gibba045 bash[19160]: t=2021-03-10T13:44:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add column uid in dashboard" 2021-03-10T13:44:13.466 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:13 gibba045 bash[19160]: t=2021-03-10T13:44:13+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid column values in dashboard" 2021-03-10T13:44:13.467 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:13 gibba045 bash[19160]: t=2021-03-10T13:44:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index dashboard_org_id_uid" 2021-03-10T13:44:13.467 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:13 gibba045 bash[19160]: t=2021-03-10T13:44:13+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index org_id_slug" 2021-03-10T13:44:13.574 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:44:13 gibba015 bash[9806]: audit 2021-03-10T13:44:13.013005+0000 mon.c (mon.1) 13 : audit [DBG] from='client.? 172.21.2.115:0/804188170' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-03-10T13:44:13.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:44:13 gibba015 bash[13005]: audit 2021-03-10T13:44:13.013005+0000 mon.c (mon.1) 13 : audit [DBG] from='client.? 172.21.2.115:0/804188170' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-03-10T13:44:13.760 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:44:13 gibba045 bash[9787]: audit 2021-03-10T13:44:13.013005+0000 mon.c (mon.1) 13 : audit [DBG] from='client.? 172.21.2.115:0/804188170' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-03-10T13:44:13.761 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:13 gibba045 bash[19160]: t=2021-03-10T13:44:13+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard title length" 2021-03-10T13:44:13.761 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:13 gibba045 bash[19160]: t=2021-03-10T13:44:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index for dashboard_org_id_title_folder_id" 2021-03-10T13:44:13.761 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:13 gibba045 bash[19160]: t=2021-03-10T13:44:13+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_provisioning" 2021-03-10T13:44:13.761 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:13 gibba045 bash[19160]: t=2021-03-10T13:44:13+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table dashboard_provisioning to dashboard_provisioning_tmp_qwerty - v1" 2021-03-10T13:44:13.762 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:13 gibba045 bash[19160]: t=2021-03-10T13:44:13+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_provisioning v2" 2021-03-10T13:44:14.020 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:13 gibba045 bash[19160]: t=2021-03-10T13:44:13+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_provisioning_dashboard_id - v2" 2021-03-10T13:44:14.020 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:13 gibba045 bash[19160]: t=2021-03-10T13:44:13+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_provisioning_dashboard_id_name - v2" 2021-03-10T13:44:14.021 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:13 gibba045 bash[19160]: t=2021-03-10T13:44:13+0000 lvl=info msg="Executing migration" logger=migrator id="copy dashboard_provisioning v1 to v2" 2021-03-10T13:44:14.021 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:13 gibba045 bash[19160]: t=2021-03-10T13:44:13+0000 lvl=info msg="Executing migration" logger=migrator id="drop dashboard_provisioning_tmp_qwerty" 2021-03-10T13:44:14.021 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:14 gibba045 bash[19160]: t=2021-03-10T13:44:14+0000 lvl=info msg="Executing migration" logger=migrator id="Add check_sum column" 2021-03-10T13:44:14.165 DEBUG:teuthology.orchestra.run.gibba015:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid e4a642d2-81a5-11eb-9080-001a4aab830c -- ceph tell osd.0 flush_pg_stats 2021-03-10T13:44:14.308 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:14 gibba045 bash[19160]: t=2021-03-10T13:44:14+0000 lvl=info msg="Executing migration" logger=migrator id="create data_source table" 2021-03-10T13:44:14.308 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:14 gibba045 bash[19160]: t=2021-03-10T13:44:14+0000 lvl=info msg="Executing migration" logger=migrator id="add index data_source.account_id" 2021-03-10T13:44:14.308 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:14 gibba045 bash[19160]: t=2021-03-10T13:44:14+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index data_source.account_id_name" 2021-03-10T13:44:14.309 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:14 gibba045 bash[19160]: t=2021-03-10T13:44:14+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_data_source_account_id - v1" 2021-03-10T13:44:14.309 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:14 gibba045 bash[19160]: t=2021-03-10T13:44:14+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_data_source_account_id_name - v1" 2021-03-10T13:44:14.582 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:14 gibba045 bash[19160]: t=2021-03-10T13:44:14+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table data_source to data_source_v1 - v1" 2021-03-10T13:44:14.582 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:14 gibba045 bash[19160]: t=2021-03-10T13:44:14+0000 lvl=info msg="Executing migration" logger=migrator id="create data_source table v2" 2021-03-10T13:44:14.582 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:14 gibba045 bash[19160]: t=2021-03-10T13:44:14+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_data_source_org_id - v2" 2021-03-10T13:44:14.582 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:14 gibba045 bash[19160]: t=2021-03-10T13:44:14+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_data_source_org_id_name - v2" 2021-03-10T13:44:14.583 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:14 gibba045 bash[19160]: t=2021-03-10T13:44:14+0000 lvl=info msg="Executing migration" logger=migrator id="copy data_source v1 to v2" 2021-03-10T13:44:14.883 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:44:14 gibba045 bash[9787]: cluster 2021-03-10T13:44:13.152822+0000 mgr.y (mgr.14140) 190 : cluster [DBG] pgmap v181: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:14.884 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:14 gibba045 bash[19160]: t=2021-03-10T13:44:14+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table data_source_v1 #2" 2021-03-10T13:44:14.884 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:14 gibba045 bash[19160]: t=2021-03-10T13:44:14+0000 lvl=info msg="Executing migration" logger=migrator id="Add column with_credentials" 2021-03-10T13:44:14.884 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:14 gibba045 bash[19160]: t=2021-03-10T13:44:14+0000 lvl=info msg="Executing migration" logger=migrator id="Add secure json data column" 2021-03-10T13:44:14.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:44:14 gibba015 bash[9806]: cluster 2021-03-10T13:44:13.152822+0000 mgr.y (mgr.14140) 190 : cluster [DBG] pgmap v181: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:14.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:44:14 gibba015 bash[13005]: cluster 2021-03-10T13:44:13.152822+0000 mgr.y (mgr.14140) 190 : cluster [DBG] pgmap v181: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:15.177 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:14 gibba045 bash[19160]: t=2021-03-10T13:44:14+0000 lvl=info msg="Executing migration" logger=migrator id="Update data_source table charset" 2021-03-10T13:44:15.177 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:14 gibba045 bash[19160]: t=2021-03-10T13:44:14+0000 lvl=info msg="Executing migration" logger=migrator id="Update initial version to 1" 2021-03-10T13:44:15.178 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:15 gibba045 bash[19160]: t=2021-03-10T13:44:15+0000 lvl=info msg="Executing migration" logger=migrator id="Add read_only data column" 2021-03-10T13:44:15.178 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:15 gibba045 bash[19160]: t=2021-03-10T13:44:15+0000 lvl=info msg="Executing migration" logger=migrator id="Migrate logging ds to loki ds" 2021-03-10T13:44:15.178 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:15 gibba045 bash[19160]: t=2021-03-10T13:44:15+0000 lvl=info msg="Executing migration" logger=migrator id="Update json_data with nulls" 2021-03-10T13:44:15.178 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:15 gibba045 bash[19160]: t=2021-03-10T13:44:15+0000 lvl=info msg="Executing migration" logger=migrator id="create api_key table" 2021-03-10T13:44:15.470 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:15 gibba045 bash[19160]: t=2021-03-10T13:44:15+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.account_id" 2021-03-10T13:44:15.471 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:15 gibba045 bash[19160]: t=2021-03-10T13:44:15+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.key" 2021-03-10T13:44:15.471 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:15 gibba045 bash[19160]: t=2021-03-10T13:44:15+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.account_id_name" 2021-03-10T13:44:15.471 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:15 gibba045 bash[19160]: t=2021-03-10T13:44:15+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_api_key_account_id - v1" 2021-03-10T13:44:15.739 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:15 gibba045 bash[19160]: t=2021-03-10T13:44:15+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_api_key_key - v1" 2021-03-10T13:44:15.739 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:15 gibba045 bash[19160]: t=2021-03-10T13:44:15+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_api_key_account_id_name - v1" 2021-03-10T13:44:15.739 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:15 gibba045 bash[19160]: t=2021-03-10T13:44:15+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table api_key to api_key_v1 - v1" 2021-03-10T13:44:15.739 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:15 gibba045 bash[19160]: t=2021-03-10T13:44:15+0000 lvl=info msg="Executing migration" logger=migrator id="create api_key table v2" 2021-03-10T13:44:15.740 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:15 gibba045 bash[19160]: t=2021-03-10T13:44:15+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_api_key_org_id - v2" 2021-03-10T13:44:15.740 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:15 gibba045 bash[19160]: t=2021-03-10T13:44:15+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_api_key_key - v2" 2021-03-10T13:44:15.990 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:15 gibba045 bash[19160]: t=2021-03-10T13:44:15+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_api_key_org_id_name - v2" 2021-03-10T13:44:15.990 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:15 gibba045 bash[19160]: t=2021-03-10T13:44:15+0000 lvl=info msg="Executing migration" logger=migrator id="copy api_key v1 to v2" 2021-03-10T13:44:15.991 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:15 gibba045 bash[19160]: t=2021-03-10T13:44:15+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table api_key_v1" 2021-03-10T13:44:16.241 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:15 gibba045 bash[19160]: t=2021-03-10T13:44:15+0000 lvl=info msg="Executing migration" logger=migrator id="Update api_key table charset" 2021-03-10T13:44:16.241 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:16 gibba045 bash[19160]: t=2021-03-10T13:44:16+0000 lvl=info msg="Executing migration" logger=migrator id="Add expires to api_key table" 2021-03-10T13:44:16.242 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:16 gibba045 bash[19160]: t=2021-03-10T13:44:16+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_snapshot table v4" 2021-03-10T13:44:16.242 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:16 gibba045 bash[19160]: t=2021-03-10T13:44:16+0000 lvl=info msg="Executing migration" logger=migrator id="drop table dashboard_snapshot_v4 #1" 2021-03-10T13:44:16.242 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:16 gibba045 bash[19160]: t=2021-03-10T13:44:16+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_snapshot table v5 #2" 2021-03-10T13:44:16.306 INFO:journalctl@ceph.alertmanager.a.gibba015.stdout:Mar 10 13:44:16 gibba015 systemd[1]: Stopping Ceph alertmanager.a for e4a642d2-81a5-11eb-9080-001a4aab830c... 2021-03-10T13:44:16.492 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:16 gibba045 bash[19160]: t=2021-03-10T13:44:16+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_snapshot_key - v5" 2021-03-10T13:44:16.493 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:16 gibba045 bash[19160]: t=2021-03-10T13:44:16+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_snapshot_delete_key - v5" 2021-03-10T13:44:16.493 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:16 gibba045 bash[19160]: t=2021-03-10T13:44:16+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_snapshot_user_id - v5" 2021-03-10T13:44:16.493 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:16 gibba045 bash[19160]: t=2021-03-10T13:44:16+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard_snapshot to mediumtext v2" 2021-03-10T13:44:16.598 INFO:journalctl@ceph.alertmanager.a.gibba015.stdout:Mar 10 13:44:16 gibba015 bash[20279]: level=info ts=2021-03-10T13:44:16.304Z caller=main.go:524 msg="Received SIGTERM, exiting gracefully..." 2021-03-10T13:44:16.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:44:16 gibba015 bash[9806]: cluster 2021-03-10T13:44:15.153735+0000 mgr.y (mgr.14140) 191 : cluster [DBG] pgmap v182: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:16.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:44:16 gibba015 bash[13005]: cluster 2021-03-10T13:44:15.153735+0000 mgr.y (mgr.14140) 191 : cluster [DBG] pgmap v182: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:16.770 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:44:16 gibba045 bash[9787]: cluster 2021-03-10T13:44:15.153735+0000 mgr.y (mgr.14140) 191 : cluster [DBG] pgmap v182: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:16.770 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:16 gibba045 bash[19160]: t=2021-03-10T13:44:16+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard_snapshot table charset" 2021-03-10T13:44:16.770 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:16 gibba045 bash[19160]: t=2021-03-10T13:44:16+0000 lvl=info msg="Executing migration" logger=migrator id="Add column external_delete_url to dashboard_snapshots table" 2021-03-10T13:44:16.771 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:16 gibba045 bash[19160]: t=2021-03-10T13:44:16+0000 lvl=info msg="Executing migration" logger=migrator id="create quota table v1" 2021-03-10T13:44:16.771 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:16 gibba045 bash[19160]: t=2021-03-10T13:44:16+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_quota_org_id_user_id_target - v1" 2021-03-10T13:44:16.771 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:16 gibba045 bash[19160]: t=2021-03-10T13:44:16+0000 lvl=info msg="Executing migration" logger=migrator id="Update quota table charset" 2021-03-10T13:44:17.030 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:16 gibba045 bash[19160]: t=2021-03-10T13:44:16+0000 lvl=info msg="Executing migration" logger=migrator id="create plugin_setting table" 2021-03-10T13:44:17.030 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:16 gibba045 bash[19160]: t=2021-03-10T13:44:16+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_plugin_setting_org_id_plugin_id - v1" 2021-03-10T13:44:17.031 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:16 gibba045 bash[19160]: t=2021-03-10T13:44:16+0000 lvl=info msg="Executing migration" logger=migrator id="Add column plugin_version to plugin_settings" 2021-03-10T13:44:17.281 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:17 gibba045 bash[19160]: t=2021-03-10T13:44:17+0000 lvl=info msg="Executing migration" logger=migrator id="Update plugin_setting table charset" 2021-03-10T13:44:17.281 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:17 gibba045 bash[19160]: t=2021-03-10T13:44:17+0000 lvl=info msg="Executing migration" logger=migrator id="create session table" 2021-03-10T13:44:17.282 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:17 gibba045 bash[19160]: t=2021-03-10T13:44:17+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table playlist table" 2021-03-10T13:44:17.282 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:17 gibba045 bash[19160]: t=2021-03-10T13:44:17+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table playlist_item table" 2021-03-10T13:44:17.282 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:17 gibba045 bash[19160]: t=2021-03-10T13:44:17+0000 lvl=info msg="Executing migration" logger=migrator id="create playlist table v2" 2021-03-10T13:44:17.549 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:17 gibba045 bash[19160]: t=2021-03-10T13:44:17+0000 lvl=info msg="Executing migration" logger=migrator id="create playlist item table v2" 2021-03-10T13:44:17.549 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:17 gibba045 bash[19160]: t=2021-03-10T13:44:17+0000 lvl=info msg="Executing migration" logger=migrator id="Update playlist table charset" 2021-03-10T13:44:17.549 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:17 gibba045 bash[19160]: t=2021-03-10T13:44:17+0000 lvl=info msg="Executing migration" logger=migrator id="Update playlist_item table charset" 2021-03-10T13:44:17.808 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:17 gibba045 bash[19160]: t=2021-03-10T13:44:17+0000 lvl=info msg="Executing migration" logger=migrator id="drop preferences table v2" 2021-03-10T13:44:17.809 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:17 gibba045 bash[19160]: t=2021-03-10T13:44:17+0000 lvl=info msg="Executing migration" logger=migrator id="drop preferences table v3" 2021-03-10T13:44:17.809 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:17 gibba045 bash[19160]: t=2021-03-10T13:44:17+0000 lvl=info msg="Executing migration" logger=migrator id="create preferences table v3" 2021-03-10T13:44:17.972 INFO:journalctl@ceph.alertmanager.a.gibba015.stdout:Mar 10 13:44:17 gibba015 docker[21863]: ceph-e4a642d2-81a5-11eb-9080-001a4aab830c-alertmanager.a 2021-03-10T13:44:17.972 INFO:journalctl@ceph.alertmanager.a.gibba015.stdout:Mar 10 13:44:17 gibba015 systemd[1]: ceph-e4a642d2-81a5-11eb-9080-001a4aab830c@alertmanager.a.service: Succeeded. 2021-03-10T13:44:17.973 INFO:journalctl@ceph.alertmanager.a.gibba015.stdout:Mar 10 13:44:17 gibba015 systemd[1]: Stopped Ceph alertmanager.a for e4a642d2-81a5-11eb-9080-001a4aab830c. 2021-03-10T13:44:17.973 INFO:journalctl@ceph.alertmanager.a.gibba015.stdout:Mar 10 13:44:17 gibba015 systemd[1]: Starting Ceph alertmanager.a for e4a642d2-81a5-11eb-9080-001a4aab830c... 2021-03-10T13:44:17.973 INFO:journalctl@ceph.alertmanager.a.gibba015.stdout:Mar 10 13:44:17 gibba015 docker[21919]: Error: No such container: ceph-e4a642d2-81a5-11eb-9080-001a4aab830c-alertmanager.a 2021-03-10T13:44:17.973 INFO:journalctl@ceph.alertmanager.a.gibba015.stdout:Mar 10 13:44:17 gibba015 systemd[1]: Started Ceph alertmanager.a for e4a642d2-81a5-11eb-9080-001a4aab830c. 2021-03-10T13:44:18.058 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:17 gibba045 bash[19160]: t=2021-03-10T13:44:17+0000 lvl=info msg="Executing migration" logger=migrator id="Update preferences table charset" 2021-03-10T13:44:18.291 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:44:18 gibba045 bash[9787]: cluster 2021-03-10T13:44:17.154512+0000 mgr.y (mgr.14140) 192 : cluster [DBG] pgmap v183: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:18.291 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:44:18 gibba045 bash[9787]: audit 2021-03-10T13:44:17.554139+0000 mon.a (mon.0) 516 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619060\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619134\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619164\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619191\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619218\", \"created\": \"2021-03-10T13:41:11.556448\", \"started\": \"2021-03-10T13:41:15.069232\"}, \"osd.2\": {\"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619244\", \"created\": \"2021-03-10T13:41:34.244448\", \"started\": \"2021-03-10T13:41:37.507096\"}, \"osd.3\": {\"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619270\", \"created\": \"2021-03-10T13:41:57.328380\", \"started\": \"2021-03-10T13:42:00.781947\"}, \"node-exporter.a\": {\"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619296\", \"created\": \"2021-03-10T13:43:44.272379\", \"started\": \"2021-03-10T13:43:47.550063\"}, \"alertmanager.a\": {\"hostname\": \"gibba015\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:44:10.554431\"}}, \"last_device_update\": \"2021-03-10T13:42:03.853072\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]: dispatch 2021-03-10T13:44:18.292 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:44:18 gibba045 bash[9787]: audit 2021-03-10T13:44:17.558005+0000 mon.a (mon.0) 517 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619060\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619134\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619164\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619191\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619218\", \"created\": \"2021-03-10T13:41:11.556448\", \"started\": \"2021-03-10T13:41:15.069232\"}, \"osd.2\": {\"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619244\", \"created\": \"2021-03-10T13:41:34.244448\", \"started\": \"2021-03-10T13:41:37.507096\"}, \"osd.3\": {\"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619270\", \"created\": \"2021-03-10T13:41:57.328380\", \"started\": \"2021-03-10T13:42:00.781947\"}, \"node-exporter.a\": {\"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619296\", \"created\": \"2021-03-10T13:43:44.272379\", \"started\": \"2021-03-10T13:43:47.550063\"}, \"alertmanager.a\": {\"hostname\": \"gibba015\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:44:10.554431\"}}, \"last_device_update\": \"2021-03-10T13:42:03.853072\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]': finished 2021-03-10T13:44:18.292 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:44:18 gibba045 bash[9787]: cephadm 2021-03-10T13:44:17.558710+0000 mgr.y (mgr.14140) 193 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2021-03-10T13:44:18.292 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:44:18 gibba045 bash[9787]: cephadm 2021-03-10T13:44:17.560979+0000 mgr.y (mgr.14140) 194 : cephadm [INF] Reconfiguring daemon prometheus.a on gibba045 2021-03-10T13:44:18.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:44:18 gibba015 bash[9806]: cluster 2021-03-10T13:44:17.154512+0000 mgr.y (mgr.14140) 192 : cluster [DBG] pgmap v183: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:18.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:44:18 gibba015 bash[13005]: cluster 2021-03-10T13:44:17.154512+0000 mgr.y (mgr.14140) 192 : cluster [DBG] pgmap v183: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:18.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:44:18 gibba015 bash[9806]: audit 2021-03-10T13:44:17.554139+0000 mon.a (mon.0) 516 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619060\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619134\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619164\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619191\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619218\", \"created\": \"2021-03-10T13:41:11.556448\", \"started\": \"2021-03-10T13:41:15.069232\"}, \"osd.2\": {\"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619244\", \"created\": \"2021-03-10T13:41:34.244448\", \"started\": \"2021-03-10T13:41:37.507096\"}, \"osd.3\": {\"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619270\", \"created\": \"2021-03-10T13:41:57.328380\", \"started\": \"2021-03-10T13:42:00.781947\"}, \"node-exporter.a\": {\"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619296\", \"created\": \"2021-03-10T13:43:44.272379\", \"started\": \"2021-03-10T13:43:47.550063\"}, \"alertmanager.a\": {\"hostname\": \"gibba015\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:44:10.554431\"}}, \"last_device_update\": \"2021-03-10T13:42:03.853072\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]: dispatch 2021-03-10T13:44:18.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:44:18 gibba015 bash[9806]: audit 2021-03-10T13:44:17.558005+0000 mon.a (mon.0) 517 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619060\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619134\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619164\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619191\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619218\", \"created\": \"2021-03-10T13:41:11.556448\", \"started\": \"2021-03-10T13:41:15.069232\"}, \"osd.2\": {\"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619244\", \"created\": \"2021-03-10T13:41:34.244448\", \"started\": \"2021-03-10T13:41:37.507096\"}, \"osd.3\": {\"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619270\", \"created\": \"2021-03-10T13:41:57.328380\", \"started\": \"2021-03-10T13:42:00.781947\"}, \"node-exporter.a\": {\"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619296\", \"created\": \"2021-03-10T13:43:44.272379\", \"started\": \"2021-03-10T13:43:47.550063\"}, \"alertmanager.a\": {\"hostname\": \"gibba015\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:44:10.554431\"}}, \"last_device_update\": \"2021-03-10T13:42:03.853072\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]': finished 2021-03-10T13:44:18.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:44:18 gibba015 bash[9806]: cephadm 2021-03-10T13:44:17.558710+0000 mgr.y (mgr.14140) 193 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2021-03-10T13:44:18.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:44:18 gibba015 bash[9806]: cephadm 2021-03-10T13:44:17.560979+0000 mgr.y (mgr.14140) 194 : cephadm [INF] Reconfiguring daemon prometheus.a on gibba045 2021-03-10T13:44:18.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:44:18 gibba015 bash[13005]: audit 2021-03-10T13:44:17.554139+0000 mon.a (mon.0) 516 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619060\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619134\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619164\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619191\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619218\", \"created\": \"2021-03-10T13:41:11.556448\", \"started\": \"2021-03-10T13:41:15.069232\"}, \"osd.2\": {\"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619244\", \"created\": \"2021-03-10T13:41:34.244448\", \"started\": \"2021-03-10T13:41:37.507096\"}, \"osd.3\": {\"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619270\", \"created\": \"2021-03-10T13:41:57.328380\", \"started\": \"2021-03-10T13:42:00.781947\"}, \"node-exporter.a\": {\"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619296\", \"created\": \"2021-03-10T13:43:44.272379\", \"started\": \"2021-03-10T13:43:47.550063\"}, \"alertmanager.a\": {\"hostname\": \"gibba015\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:44:10.554431\"}}, \"last_device_update\": \"2021-03-10T13:42:03.853072\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]: dispatch 2021-03-10T13:44:18.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:44:18 gibba015 bash[13005]: audit 2021-03-10T13:44:17.558005+0000 mon.a (mon.0) 517 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619060\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619134\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619164\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619191\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619218\", \"created\": \"2021-03-10T13:41:11.556448\", \"started\": \"2021-03-10T13:41:15.069232\"}, \"osd.2\": {\"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619244\", \"created\": \"2021-03-10T13:41:34.244448\", \"started\": \"2021-03-10T13:41:37.507096\"}, \"osd.3\": {\"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619270\", \"created\": \"2021-03-10T13:41:57.328380\", \"started\": \"2021-03-10T13:42:00.781947\"}, \"node-exporter.a\": {\"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:09.619296\", \"created\": \"2021-03-10T13:43:44.272379\", \"started\": \"2021-03-10T13:43:47.550063\"}, \"alertmanager.a\": {\"hostname\": \"gibba015\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:44:10.554431\"}}, \"last_device_update\": \"2021-03-10T13:42:03.853072\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]': finished 2021-03-10T13:44:18.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:44:18 gibba015 bash[13005]: cephadm 2021-03-10T13:44:17.558710+0000 mgr.y (mgr.14140) 193 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2021-03-10T13:44:18.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:44:18 gibba015 bash[13005]: cephadm 2021-03-10T13:44:17.560979+0000 mgr.y (mgr.14140) 194 : cephadm [INF] Reconfiguring daemon prometheus.a on gibba045 2021-03-10T13:44:18.558 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:18 gibba045 bash[19160]: t=2021-03-10T13:44:18+0000 lvl=info msg="Executing migration" logger=migrator id="Add column team_id in preferences" 2021-03-10T13:44:18.558 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:18 gibba045 bash[19160]: t=2021-03-10T13:44:18+0000 lvl=info msg="Executing migration" logger=migrator id="Update team_id column values in preferences" 2021-03-10T13:44:18.808 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:18 gibba045 bash[19160]: t=2021-03-10T13:44:18+0000 lvl=info msg="Executing migration" logger=migrator id="create alert table v1" 2021-03-10T13:44:18.878 INFO:journalctl@ceph.alertmanager.a.gibba015.stdout:Mar 10 13:44:18 gibba015 bash[21936]: level=info ts=2021-03-10T13:44:18.769Z caller=main.go:216 msg="Starting Alertmanager" version="(version=0.21.0, branch=HEAD, revision=4c6c03ebfe21009c546e4d1e9b92c371d67c021d)" 2021-03-10T13:44:18.878 INFO:journalctl@ceph.alertmanager.a.gibba015.stdout:Mar 10 13:44:18 gibba015 bash[21936]: level=info ts=2021-03-10T13:44:18.769Z caller=main.go:217 build_context="(go=go1.14.4, user=root@dee35927357f, date=20200617-08:54:02)" 2021-03-10T13:44:18.879 INFO:journalctl@ceph.alertmanager.a.gibba015.stdout:Mar 10 13:44:18 gibba015 bash[21936]: level=info ts=2021-03-10T13:44:18.770Z caller=cluster.go:161 component=cluster msg="setting advertise address explicitly" addr=172.21.2.115 port=9094 2021-03-10T13:44:18.879 INFO:journalctl@ceph.alertmanager.a.gibba015.stdout:Mar 10 13:44:18 gibba015 bash[21936]: level=info ts=2021-03-10T13:44:18.771Z caller=cluster.go:623 component=cluster msg="Waiting for gossip to settle..." interval=2s 2021-03-10T13:44:18.879 INFO:journalctl@ceph.alertmanager.a.gibba015.stdout:Mar 10 13:44:18 gibba015 bash[21936]: level=info ts=2021-03-10T13:44:18.785Z caller=coordinator.go:119 component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2021-03-10T13:44:18.879 INFO:journalctl@ceph.alertmanager.a.gibba015.stdout:Mar 10 13:44:18 gibba015 bash[21936]: level=info ts=2021-03-10T13:44:18.785Z caller=coordinator.go:131 component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2021-03-10T13:44:18.879 INFO:journalctl@ceph.alertmanager.a.gibba015.stdout:Mar 10 13:44:18 gibba015 bash[21936]: level=info ts=2021-03-10T13:44:18.787Z caller=main.go:485 msg=Listening address=:9093 2021-03-10T13:44:19.292 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:18 gibba045 bash[19160]: t=2021-03-10T13:44:18+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert org_id & id " 2021-03-10T13:44:19.292 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:19 gibba045 bash[19160]: t=2021-03-10T13:44:19+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert state" 2021-03-10T13:44:19.293 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:19 gibba045 bash[19160]: t=2021-03-10T13:44:19+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert dashboard_id" 2021-03-10T13:44:19.431 INFO:teuthology.orchestra.run.gibba015.stdout:42949673001 2021-03-10T13:44:19.431 DEBUG:teuthology.orchestra.run.gibba015:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid e4a642d2-81a5-11eb-9080-001a4aab830c -- ceph tell osd.1 flush_pg_stats 2021-03-10T13:44:19.543 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:19 gibba045 bash[19160]: t=2021-03-10T13:44:19+0000 lvl=info msg="Executing migration" logger=migrator id="Create alert_rule_tag table v1" 2021-03-10T13:44:19.543 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:19 gibba045 bash[19160]: t=2021-03-10T13:44:19+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index alert_rule_tag.alert_id_tag_id" 2021-03-10T13:44:19.543 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:19 gibba045 bash[19160]: t=2021-03-10T13:44:19+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_notification table v1" 2021-03-10T13:44:19.808 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:19 gibba045 bash[19160]: t=2021-03-10T13:44:19+0000 lvl=info msg="Executing migration" logger=migrator id="Add column is_default" 2021-03-10T13:44:19.808 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:19 gibba045 bash[19160]: t=2021-03-10T13:44:19+0000 lvl=info msg="Executing migration" logger=migrator id="Add column frequency" 2021-03-10T13:44:19.809 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:19 gibba045 bash[19160]: t=2021-03-10T13:44:19+0000 lvl=info msg="Executing migration" logger=migrator id="Add column send_reminder" 2021-03-10T13:44:19.809 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:19 gibba045 bash[19160]: t=2021-03-10T13:44:19+0000 lvl=info msg="Executing migration" logger=migrator id="Add column disable_resolve_message" 2021-03-10T13:44:20.190 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:19 gibba045 bash[19160]: t=2021-03-10T13:44:19+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert_notification org_id & name" 2021-03-10T13:44:20.190 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:20 gibba045 bash[19160]: t=2021-03-10T13:44:20+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert table charset" 2021-03-10T13:44:20.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:44:20 gibba045 bash[9787]: cluster 2021-03-10T13:44:19.155530+0000 mgr.y (mgr.14140) 195 : cluster [DBG] pgmap v184: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:20.452 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:44:20 gibba015 bash[9806]: cluster 2021-03-10T13:44:19.155530+0000 mgr.y (mgr.14140) 195 : cluster [DBG] pgmap v184: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:20.452 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:44:20 gibba015 bash[13005]: cluster 2021-03-10T13:44:19.155530+0000 mgr.y (mgr.14140) 195 : cluster [DBG] pgmap v184: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:20.536 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:20 gibba045 bash[19160]: t=2021-03-10T13:44:20+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert_notification table charset" 2021-03-10T13:44:20.808 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:20 gibba045 bash[19160]: t=2021-03-10T13:44:20+0000 lvl=info msg="Executing migration" logger=migrator id="create notification_journal table v1" 2021-03-10T13:44:20.808 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:20 gibba045 bash[19160]: t=2021-03-10T13:44:20+0000 lvl=info msg="Executing migration" logger=migrator id="add index notification_journal org_id & alert_id & notifier_id" 2021-03-10T13:44:20.808 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:20 gibba045 bash[19160]: t=2021-03-10T13:44:20+0000 lvl=info msg="Executing migration" logger=migrator id="drop alert_notification_journal" 2021-03-10T13:44:20.972 INFO:journalctl@ceph.alertmanager.a.gibba015.stdout:Mar 10 13:44:20 gibba015 bash[21936]: level=info ts=2021-03-10T13:44:20.771Z caller=cluster.go:648 component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000009643s 2021-03-10T13:44:21.295 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:21 gibba045 bash[19160]: t=2021-03-10T13:44:21+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_notification_state table v1" 2021-03-10T13:44:21.295 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:21 gibba045 bash[19160]: t=2021-03-10T13:44:21+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert_notification_state org_id & alert_id & notifier_id" 2021-03-10T13:44:21.979 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:21 gibba045 bash[19160]: t=2021-03-10T13:44:21+0000 lvl=info msg="Executing migration" logger=migrator id="Add for to alert table" 2021-03-10T13:44:21.980 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:21 gibba045 bash[19160]: t=2021-03-10T13:44:21+0000 lvl=info msg="Executing migration" logger=migrator id="Add column uid in alert_notification" 2021-03-10T13:44:21.980 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:21 gibba045 bash[19160]: t=2021-03-10T13:44:21+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid column values in alert_notification" 2021-03-10T13:44:21.980 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:21 gibba045 bash[19160]: t=2021-03-10T13:44:21+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index alert_notification_org_id_uid" 2021-03-10T13:44:21.980 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:21 gibba045 bash[19160]: t=2021-03-10T13:44:21+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index org_id_name" 2021-03-10T13:44:22.292 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:44:22 gibba045 bash[9787]: cluster 2021-03-10T13:44:21.156284+0000 mgr.y (mgr.14140) 196 : cluster [DBG] pgmap v185: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:22.292 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:22 gibba045 bash[19160]: t=2021-03-10T13:44:22+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old annotation table v4" 2021-03-10T13:44:22.292 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:22 gibba045 bash[19160]: t=2021-03-10T13:44:22+0000 lvl=info msg="Executing migration" logger=migrator id="create annotation table v5" 2021-03-10T13:44:22.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:44:22 gibba015 bash[9806]: cluster 2021-03-10T13:44:21.156284+0000 mgr.y (mgr.14140) 196 : cluster [DBG] pgmap v185: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:22.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:44:22 gibba015 bash[13005]: cluster 2021-03-10T13:44:21.156284+0000 mgr.y (mgr.14140) 196 : cluster [DBG] pgmap v185: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:22.558 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:22 gibba045 bash[19160]: t=2021-03-10T13:44:22+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 0 v3" 2021-03-10T13:44:22.558 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:22 gibba045 bash[19160]: t=2021-03-10T13:44:22+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 1 v3" 2021-03-10T13:44:22.559 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:22 gibba045 bash[19160]: t=2021-03-10T13:44:22+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 2 v3" 2021-03-10T13:44:22.678 INFO:teuthology.orchestra.run.gibba015.stdout:68719476774 2021-03-10T13:44:22.678 DEBUG:teuthology.orchestra.run.gibba015:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid e4a642d2-81a5-11eb-9080-001a4aab830c -- ceph tell osd.2 flush_pg_stats 2021-03-10T13:44:23.164 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:22 gibba045 bash[19160]: t=2021-03-10T13:44:22+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 3 v3" 2021-03-10T13:44:23.164 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:23 gibba045 bash[19160]: t=2021-03-10T13:44:23+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 4 v3" 2021-03-10T13:44:23.445 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:23 gibba045 bash[19160]: t=2021-03-10T13:44:23+0000 lvl=info msg="Executing migration" logger=migrator id="Update annotation table charset" 2021-03-10T13:44:23.446 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:23 gibba045 bash[19160]: t=2021-03-10T13:44:23+0000 lvl=info msg="Executing migration" logger=migrator id="Add column region_id to annotation table" 2021-03-10T13:44:23.446 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:23 gibba045 bash[19160]: t=2021-03-10T13:44:23+0000 lvl=info msg="Executing migration" logger=migrator id="Drop category_id index" 2021-03-10T13:44:23.446 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:23 gibba045 bash[19160]: t=2021-03-10T13:44:23+0000 lvl=info msg="Executing migration" logger=migrator id="Add column tags to annotation table" 2021-03-10T13:44:23.447 INFO:journalctl@ceph.prometheus.a.gibba045.stdout:Mar 10 13:44:23 gibba045 systemd[1]: Stopping Ceph prometheus.a for e4a642d2-81a5-11eb-9080-001a4aab830c... 2021-03-10T13:44:23.447 INFO:journalctl@ceph.prometheus.a.gibba045.stdout:Mar 10 13:44:23 gibba045 bash[17926]: level=warn ts=2021-03-10T13:44:23.330Z caller=main.go:629 msg="Received SIGTERM, exiting gracefully..." 2021-03-10T13:44:23.447 INFO:journalctl@ceph.prometheus.a.gibba045.stdout:Mar 10 13:44:23 gibba045 bash[17926]: level=info ts=2021-03-10T13:44:23.330Z caller=main.go:652 msg="Stopping scrape discovery manager..." 2021-03-10T13:44:23.447 INFO:journalctl@ceph.prometheus.a.gibba045.stdout:Mar 10 13:44:23 gibba045 bash[17926]: level=info ts=2021-03-10T13:44:23.330Z caller=main.go:666 msg="Stopping notify discovery manager..." 2021-03-10T13:44:23.447 INFO:journalctl@ceph.prometheus.a.gibba045.stdout:Mar 10 13:44:23 gibba045 bash[17926]: level=info ts=2021-03-10T13:44:23.330Z caller=main.go:688 msg="Stopping scrape manager..." 2021-03-10T13:44:23.448 INFO:journalctl@ceph.prometheus.a.gibba045.stdout:Mar 10 13:44:23 gibba045 bash[17926]: level=info ts=2021-03-10T13:44:23.330Z caller=main.go:648 msg="Scrape discovery manager stopped" 2021-03-10T13:44:23.448 INFO:journalctl@ceph.prometheus.a.gibba045.stdout:Mar 10 13:44:23 gibba045 bash[17926]: level=info ts=2021-03-10T13:44:23.330Z caller=manager.go:924 component="rule manager" msg="Stopping rule manager..." 2021-03-10T13:44:23.448 INFO:journalctl@ceph.prometheus.a.gibba045.stdout:Mar 10 13:44:23 gibba045 bash[17926]: level=info ts=2021-03-10T13:44:23.330Z caller=manager.go:934 component="rule manager" msg="Rule manager stopped" 2021-03-10T13:44:23.448 INFO:journalctl@ceph.prometheus.a.gibba045.stdout:Mar 10 13:44:23 gibba045 bash[17926]: level=info ts=2021-03-10T13:44:23.330Z caller=main.go:662 msg="Notify discovery manager stopped" 2021-03-10T13:44:23.448 INFO:journalctl@ceph.prometheus.a.gibba045.stdout:Mar 10 13:44:23 gibba045 bash[17926]: level=info ts=2021-03-10T13:44:23.330Z caller=main.go:682 msg="Scrape manager stopped" 2021-03-10T13:44:23.449 INFO:journalctl@ceph.prometheus.a.gibba045.stdout:Mar 10 13:44:23 gibba045 bash[17926]: level=info ts=2021-03-10T13:44:23.330Z caller=notifier.go:601 component=notifier msg="Stopping notification manager..." 2021-03-10T13:44:23.449 INFO:journalctl@ceph.prometheus.a.gibba045.stdout:Mar 10 13:44:23 gibba045 bash[17926]: level=info ts=2021-03-10T13:44:23.330Z caller=main.go:856 msg="Notifier manager stopped" 2021-03-10T13:44:23.449 INFO:journalctl@ceph.prometheus.a.gibba045.stdout:Mar 10 13:44:23 gibba045 bash[17926]: level=info ts=2021-03-10T13:44:23.330Z caller=main.go:868 msg="See you next time!" 2021-03-10T13:44:23.818 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:23 gibba045 bash[19160]: t=2021-03-10T13:44:23+0000 lvl=info msg="Executing migration" logger=migrator id="Create annotation_tag table v2" 2021-03-10T13:44:23.819 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:23 gibba045 bash[19160]: t=2021-03-10T13:44:23+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index annotation_tag.annotation_id_tag_id" 2021-03-10T13:44:24.194 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:23 gibba045 bash[19160]: t=2021-03-10T13:44:23+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert annotations and set TEXT to empty" 2021-03-10T13:44:24.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:44:24 gibba015 bash[9806]: cluster 2021-03-10T13:44:23.156940+0000 mgr.y (mgr.14140) 197 : cluster [DBG] pgmap v186: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:24.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:44:24 gibba015 bash[13005]: cluster 2021-03-10T13:44:23.156940+0000 mgr.y (mgr.14140) 197 : cluster [DBG] pgmap v186: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:24.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:44:24 gibba045 bash[9787]: cluster 2021-03-10T13:44:23.156940+0000 mgr.y (mgr.14140) 197 : cluster [DBG] pgmap v186: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:24.558 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:24 gibba045 bash[19160]: t=2021-03-10T13:44:24+0000 lvl=info msg="Executing migration" logger=migrator id="Add created time to annotation table" 2021-03-10T13:44:24.559 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:24 gibba045 bash[19160]: t=2021-03-10T13:44:24+0000 lvl=info msg="Executing migration" logger=migrator id="Add updated time to annotation table" 2021-03-10T13:44:24.559 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:24 gibba045 bash[19160]: t=2021-03-10T13:44:24+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for created in annotation table" 2021-03-10T13:44:24.559 INFO:journalctl@ceph.prometheus.a.gibba045.stdout:Mar 10 13:44:24 gibba045 docker[19740]: ceph-e4a642d2-81a5-11eb-9080-001a4aab830c-prometheus.a 2021-03-10T13:44:24.560 INFO:journalctl@ceph.prometheus.a.gibba045.stdout:Mar 10 13:44:24 gibba045 systemd[1]: ceph-e4a642d2-81a5-11eb-9080-001a4aab830c@prometheus.a.service: Succeeded. 2021-03-10T13:44:24.560 INFO:journalctl@ceph.prometheus.a.gibba045.stdout:Mar 10 13:44:24 gibba045 systemd[1]: Stopped Ceph prometheus.a for e4a642d2-81a5-11eb-9080-001a4aab830c. 2021-03-10T13:44:24.560 INFO:journalctl@ceph.prometheus.a.gibba045.stdout:Mar 10 13:44:24 gibba045 systemd[1]: Starting Ceph prometheus.a for e4a642d2-81a5-11eb-9080-001a4aab830c... 2021-03-10T13:44:24.560 INFO:journalctl@ceph.prometheus.a.gibba045.stdout:Mar 10 13:44:24 gibba045 docker[19775]: Error: No such container: ceph-e4a642d2-81a5-11eb-9080-001a4aab830c-prometheus.a 2021-03-10T13:44:24.560 INFO:journalctl@ceph.prometheus.a.gibba045.stdout:Mar 10 13:44:24 gibba045 systemd[1]: Started Ceph prometheus.a for e4a642d2-81a5-11eb-9080-001a4aab830c. 2021-03-10T13:44:24.808 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:24 gibba045 bash[19160]: t=2021-03-10T13:44:24+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for updated in annotation table" 2021-03-10T13:44:25.181 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:24 gibba045 bash[19160]: t=2021-03-10T13:44:24+0000 lvl=info msg="Executing migration" logger=migrator id="Convert existing annotations from seconds to milliseconds" 2021-03-10T13:44:25.181 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:24 gibba045 bash[19160]: t=2021-03-10T13:44:24+0000 lvl=info msg="Executing migration" logger=migrator id="Add epoch_end column" 2021-03-10T13:44:25.375 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:44:25 gibba015 bash[9806]: audit 2021-03-10T13:44:24.383834+0000 mon.a (mon.0) 518 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.548877\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.548943\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.548976\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.549007\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.549037\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.549075\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.549107\", \"created\": \"2021-03-10T13:43:22.897564\", \"started\": \"2021-03-10T13:43:26.167781\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}, \"node-exporter.b\": {\"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.549167\", \"created\": \"2021-03-10T13:43:43.861564\", \"started\": \"2021-03-10T13:43:45.351099\"}, \"grafana.a\": {\"hostname\": \"gibba045\", \"container_id\": \"d86cab6511db\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.549197\", \"created\": \"2021-03-10T13:44:08.721564\", \"started\": \"2021-03-10T13:44:08.746042\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:44:17.558720\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818\"}}, \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:44:25.376 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:44:25 gibba015 bash[13005]: audit 2021-03-10T13:44:24.383834+0000 mon.a (mon.0) 518 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.548877\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.548943\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.548976\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.549007\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.549037\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.549075\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.549107\", \"created\": \"2021-03-10T13:43:22.897564\", \"started\": \"2021-03-10T13:43:26.167781\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}, \"node-exporter.b\": {\"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.549167\", \"created\": \"2021-03-10T13:43:43.861564\", \"started\": \"2021-03-10T13:43:45.351099\"}, \"grafana.a\": {\"hostname\": \"gibba045\", \"container_id\": \"d86cab6511db\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.549197\", \"created\": \"2021-03-10T13:44:08.721564\", \"started\": \"2021-03-10T13:44:08.746042\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:44:17.558720\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818\"}}, \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:44:25.376 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:44:25 gibba015 bash[9806]: audit 2021-03-10T13:44:24.387247+0000 mon.a (mon.0) 519 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.548877\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.548943\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.548976\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.549007\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.549037\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.549075\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.549107\", \"created\": \"2021-03-10T13:43:22.897564\", \"started\": \"2021-03-10T13:43:26.167781\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}, \"node-exporter.b\": {\"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.549167\", \"created\": \"2021-03-10T13:43:43.861564\", \"started\": \"2021-03-10T13:43:45.351099\"}, \"grafana.a\": {\"hostname\": \"gibba045\", \"container_id\": \"d86cab6511db\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.549197\", \"created\": \"2021-03-10T13:44:08.721564\", \"started\": \"2021-03-10T13:44:08.746042\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:44:17.558720\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818\"}}, \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:44:25.377 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:44:25 gibba015 bash[9806]: cephadm 2021-03-10T13:44:24.387694+0000 mgr.y (mgr.14140) 198 : cephadm [INF] Setting dashboard grafana config to https://gibba045:3000 2021-03-10T13:44:25.377 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:44:25 gibba015 bash[9806]: audit 2021-03-10T13:44:24.387966+0000 mon.a (mon.0) 520 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config set","value":"https://gibba045:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]: dispatch 2021-03-10T13:44:25.377 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:44:25 gibba015 bash[9806]: audit 2021-03-10T13:44:24.392057+0000 mon.a (mon.0) 521 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config set","value":"https://gibba045:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]': finished 2021-03-10T13:44:25.377 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:44:25 gibba015 bash[9806]: audit 2021-03-10T13:44:24.393715+0000 mon.a (mon.0) 522 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:44:25.378 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:44:25 gibba015 bash[13005]: audit 2021-03-10T13:44:24.387247+0000 mon.a (mon.0) 519 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.548877\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.548943\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.548976\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.549007\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.549037\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.549075\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.549107\", \"created\": \"2021-03-10T13:43:22.897564\", \"started\": \"2021-03-10T13:43:26.167781\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}, \"node-exporter.b\": {\"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.549167\", \"created\": \"2021-03-10T13:43:43.861564\", \"started\": \"2021-03-10T13:43:45.351099\"}, \"grafana.a\": {\"hostname\": \"gibba045\", \"container_id\": \"d86cab6511db\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.549197\", \"created\": \"2021-03-10T13:44:08.721564\", \"started\": \"2021-03-10T13:44:08.746042\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:44:17.558720\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818\"}}, \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:44:25.378 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:44:25 gibba015 bash[13005]: cephadm 2021-03-10T13:44:24.387694+0000 mgr.y (mgr.14140) 198 : cephadm [INF] Setting dashboard grafana config to https://gibba045:3000 2021-03-10T13:44:25.379 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:44:25 gibba015 bash[13005]: audit 2021-03-10T13:44:24.387966+0000 mon.a (mon.0) 520 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config set","value":"https://gibba045:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]: dispatch 2021-03-10T13:44:25.379 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:44:25 gibba015 bash[13005]: audit 2021-03-10T13:44:24.392057+0000 mon.a (mon.0) 521 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config set","value":"https://gibba045:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]': finished 2021-03-10T13:44:25.379 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:44:25 gibba015 bash[13005]: audit 2021-03-10T13:44:24.393715+0000 mon.a (mon.0) 522 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:44:25.379 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:44:25 gibba015 bash[9806]: audit 2021-03-10T13:44:25.122675+0000 mon.a (mon.0) 523 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:25.121729\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:25.121788\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:25.121818\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:25.121845\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:25.121872\", \"created\": \"2021-03-10T13:41:11.556448\", \"started\": \"2021-03-10T13:41:15.069232\"}, \"osd.2\": {\"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:25.121898\", \"created\": \"2021-03-10T13:41:34.244448\", \"started\": \"2021-03-10T13:41:37.507096\"}, \"osd.3\": {\"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:25.121925\", \"created\": \"2021-03-10T13:41:57.328380\", \"started\": \"2021-03-10T13:42:00.781947\"}, \"node-exporter.a\": {\"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:25.121952\", \"created\": \"2021-03-10T13:43:44.272379\", \"started\": \"2021-03-10T13:43:47.550063\"}, \"alertmanager.a\": {\"hostname\": \"gibba015\", \"container_id\": \"842b16a0ff6e\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:25.121979\", \"created\": \"2021-03-10T13:43:54.628379\", \"started\": \"2021-03-10T13:44:17.568021\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:44:10.554431\"}}, \"last_daemon_update\": \"2021-03-10T13:44:25.122040\", \"last_device_update\": \"2021-03-10T13:42:03.853072\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]: dispatch 2021-03-10T13:44:25.380 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:44:25 gibba015 bash[9806]: audit 2021-03-10T13:44:25.126329+0000 mon.a (mon.0) 524 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:25.121729\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:25.121788\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:25.121818\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:25.121845\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:25.121872\", \"created\": \"2021-03-10T13:41:11.556448\", \"started\": \"2021-03-10T13:41:15.069232\"}, \"osd.2\": {\"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:25.121898\", \"created\": \"2021-03-10T13:41:34.244448\", \"started\": \"2021-03-10T13:41:37.507096\"}, \"osd.3\": {\"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:25.121925\", \"created\": \"2021-03-10T13:41:57.328380\", \"started\": \"2021-03-10T13:42:00.781947\"}, \"node-exporter.a\": {\"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:25.121952\", \"created\": \"2021-03-10T13:43:44.272379\", \"started\": \"2021-03-10T13:43:47.550063\"}, \"alertmanager.a\": {\"hostname\": \"gibba015\", \"container_id\": \"842b16a0ff6e\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:25.121979\", \"created\": \"2021-03-10T13:43:54.628379\", \"started\": \"2021-03-10T13:44:17.568021\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:44:10.554431\"}}, \"last_daemon_update\": \"2021-03-10T13:44:25.122040\", \"last_device_update\": \"2021-03-10T13:42:03.853072\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]': finished 2021-03-10T13:44:25.380 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:44:25 gibba015 bash[9806]: audit 2021-03-10T13:44:25.126898+0000 mon.a (mon.0) 525 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:44:25.381 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:44:25 gibba015 bash[13005]: audit 2021-03-10T13:44:25.122675+0000 mon.a (mon.0) 523 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:25.121729\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:25.121788\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:25.121818\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:25.121845\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:25.121872\", \"created\": \"2021-03-10T13:41:11.556448\", \"started\": \"2021-03-10T13:41:15.069232\"}, \"osd.2\": {\"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:25.121898\", \"created\": \"2021-03-10T13:41:34.244448\", \"started\": \"2021-03-10T13:41:37.507096\"}, \"osd.3\": {\"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:25.121925\", \"created\": \"2021-03-10T13:41:57.328380\", \"started\": \"2021-03-10T13:42:00.781947\"}, \"node-exporter.a\": {\"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:25.121952\", \"created\": \"2021-03-10T13:43:44.272379\", \"started\": \"2021-03-10T13:43:47.550063\"}, \"alertmanager.a\": {\"hostname\": \"gibba015\", \"container_id\": \"842b16a0ff6e\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:25.121979\", \"created\": \"2021-03-10T13:43:54.628379\", \"started\": \"2021-03-10T13:44:17.568021\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:44:10.554431\"}}, \"last_daemon_update\": \"2021-03-10T13:44:25.122040\", \"last_device_update\": \"2021-03-10T13:42:03.853072\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]: dispatch 2021-03-10T13:44:25.381 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:44:25 gibba015 bash[13005]: audit 2021-03-10T13:44:25.126329+0000 mon.a (mon.0) 524 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:25.121729\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:25.121788\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:25.121818\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:25.121845\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:25.121872\", \"created\": \"2021-03-10T13:41:11.556448\", \"started\": \"2021-03-10T13:41:15.069232\"}, \"osd.2\": {\"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:25.121898\", \"created\": \"2021-03-10T13:41:34.244448\", \"started\": \"2021-03-10T13:41:37.507096\"}, \"osd.3\": {\"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:25.121925\", \"created\": \"2021-03-10T13:41:57.328380\", \"started\": \"2021-03-10T13:42:00.781947\"}, \"node-exporter.a\": {\"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:25.121952\", \"created\": \"2021-03-10T13:43:44.272379\", \"started\": \"2021-03-10T13:43:47.550063\"}, \"alertmanager.a\": {\"hostname\": \"gibba015\", \"container_id\": \"842b16a0ff6e\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:25.121979\", \"created\": \"2021-03-10T13:43:54.628379\", \"started\": \"2021-03-10T13:44:17.568021\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:44:10.554431\"}}, \"last_daemon_update\": \"2021-03-10T13:44:25.122040\", \"last_device_update\": \"2021-03-10T13:42:03.853072\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]': finished 2021-03-10T13:44:25.381 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:44:25 gibba015 bash[13005]: audit 2021-03-10T13:44:25.126898+0000 mon.a (mon.0) 525 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:44:25.441 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:25 gibba045 bash[19160]: t=2021-03-10T13:44:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for epoch_end" 2021-03-10T13:44:25.442 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:25 gibba045 bash[19160]: t=2021-03-10T13:44:25+0000 lvl=info msg="Executing migration" logger=migrator id="Make epoch_end the same as epoch" 2021-03-10T13:44:25.443 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:44:25 gibba045 bash[9787]: audit 2021-03-10T13:44:24.383834+0000 mon.a (mon.0) 518 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.548877\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.548943\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.548976\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.549007\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.549037\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.549075\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.549107\", \"created\": \"2021-03-10T13:43:22.897564\", \"started\": \"2021-03-10T13:43:26.167781\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}, \"node-exporter.b\": {\"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.549167\", \"created\": \"2021-03-10T13:43:43.861564\", \"started\": \"2021-03-10T13:43:45.351099\"}, \"grafana.a\": {\"hostname\": \"gibba045\", \"container_id\": \"d86cab6511db\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.549197\", \"created\": \"2021-03-10T13:44:08.721564\", \"started\": \"2021-03-10T13:44:08.746042\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:44:17.558720\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818\"}}, \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:44:25.443 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:44:25 gibba045 bash[9787]: audit 2021-03-10T13:44:24.387247+0000 mon.a (mon.0) 519 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.548877\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.548943\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.548976\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.549007\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.549037\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.549075\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.549107\", \"created\": \"2021-03-10T13:43:22.897564\", \"started\": \"2021-03-10T13:43:26.167781\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}, \"node-exporter.b\": {\"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.549167\", \"created\": \"2021-03-10T13:43:43.861564\", \"started\": \"2021-03-10T13:43:45.351099\"}, \"grafana.a\": {\"hostname\": \"gibba045\", \"container_id\": \"d86cab6511db\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:10.549197\", \"created\": \"2021-03-10T13:44:08.721564\", \"started\": \"2021-03-10T13:44:08.746042\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:44:17.558720\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818\"}}, \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:44:25.443 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:44:25 gibba045 bash[9787]: cephadm 2021-03-10T13:44:24.387694+0000 mgr.y (mgr.14140) 198 : cephadm [INF] Setting dashboard grafana config to https://gibba045:3000 2021-03-10T13:44:25.444 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:44:25 gibba045 bash[9787]: audit 2021-03-10T13:44:24.387966+0000 mon.a (mon.0) 520 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config set","value":"https://gibba045:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]: dispatch 2021-03-10T13:44:25.444 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:44:25 gibba045 bash[9787]: audit 2021-03-10T13:44:24.392057+0000 mon.a (mon.0) 521 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config set","value":"https://gibba045:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]': finished 2021-03-10T13:44:25.444 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:44:25 gibba045 bash[9787]: audit 2021-03-10T13:44:24.393715+0000 mon.a (mon.0) 522 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:44:25.444 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:44:25 gibba045 bash[9787]: audit 2021-03-10T13:44:25.122675+0000 mon.a (mon.0) 523 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:25.121729\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:25.121788\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:25.121818\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:25.121845\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:25.121872\", \"created\": \"2021-03-10T13:41:11.556448\", \"started\": \"2021-03-10T13:41:15.069232\"}, \"osd.2\": {\"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:25.121898\", \"created\": \"2021-03-10T13:41:34.244448\", \"started\": \"2021-03-10T13:41:37.507096\"}, \"osd.3\": {\"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:25.121925\", \"created\": \"2021-03-10T13:41:57.328380\", \"started\": \"2021-03-10T13:42:00.781947\"}, \"node-exporter.a\": {\"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:25.121952\", \"created\": \"2021-03-10T13:43:44.272379\", \"started\": \"2021-03-10T13:43:47.550063\"}, \"alertmanager.a\": {\"hostname\": \"gibba015\", \"container_id\": \"842b16a0ff6e\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:25.121979\", \"created\": \"2021-03-10T13:43:54.628379\", \"started\": \"2021-03-10T13:44:17.568021\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:44:10.554431\"}}, \"last_daemon_update\": \"2021-03-10T13:44:25.122040\", \"last_device_update\": \"2021-03-10T13:42:03.853072\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]: dispatch 2021-03-10T13:44:25.445 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:44:25 gibba045 bash[9787]: audit 2021-03-10T13:44:25.126329+0000 mon.a (mon.0) 524 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:25.121729\", \"created\": \"2021-03-10T13:38:50.668449\", \"started\": \"2021-03-10T13:38:56.060544\"}, \"mgr.y\": {\"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:25.121788\", \"created\": \"2021-03-10T13:38:58.024449\", \"started\": \"2021-03-10T13:38:58.047154\"}, \"mon.c\": {\"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:25.121818\", \"created\": \"2021-03-10T13:40:03.296449\", \"started\": \"2021-03-10T13:40:03.320843\"}, \"osd.0\": {\"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:25.121845\", \"created\": \"2021-03-10T13:40:50.072448\", \"started\": \"2021-03-10T13:40:53.142290\"}, \"osd.1\": {\"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:25.121872\", \"created\": \"2021-03-10T13:41:11.556448\", \"started\": \"2021-03-10T13:41:15.069232\"}, \"osd.2\": {\"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:25.121898\", \"created\": \"2021-03-10T13:41:34.244448\", \"started\": \"2021-03-10T13:41:37.507096\"}, \"osd.3\": {\"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:25.121925\", \"created\": \"2021-03-10T13:41:57.328380\", \"started\": \"2021-03-10T13:42:00.781947\"}, \"node-exporter.a\": {\"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:25.121952\", \"created\": \"2021-03-10T13:43:44.272379\", \"started\": \"2021-03-10T13:43:47.550063\"}, \"alertmanager.a\": {\"hostname\": \"gibba015\", \"container_id\": \"842b16a0ff6e\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:25.121979\", \"created\": \"2021-03-10T13:43:54.628379\", \"started\": \"2021-03-10T13:44:17.568021\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:44:10.554431\"}}, \"last_daemon_update\": \"2021-03-10T13:44:25.122040\", \"last_device_update\": \"2021-03-10T13:42:03.853072\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426\"}"}]': finished 2021-03-10T13:44:25.445 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:44:25 gibba045 bash[9787]: audit 2021-03-10T13:44:25.126898+0000 mon.a (mon.0) 525 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:44:25.694 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:25 gibba045 bash[19160]: t=2021-03-10T13:44:25+0000 lvl=info msg="Executing migration" logger=migrator id="Move region to single row" 2021-03-10T13:44:25.695 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:25 gibba045 bash[19160]: t=2021-03-10T13:44:25+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_epoch from annotation table" 2021-03-10T13:44:25.856 INFO:teuthology.orchestra.run.gibba015.stdout:90194313252 2021-03-10T13:44:25.856 DEBUG:teuthology.orchestra.run.gibba015:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid e4a642d2-81a5-11eb-9080-001a4aab830c -- ceph tell osd.3 flush_pg_stats 2021-03-10T13:44:25.961 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:25 gibba045 bash[19160]: t=2021-03-10T13:44:25+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_dashboard_id_panel_id_epoch from annotation table" 2021-03-10T13:44:25.962 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:25 gibba045 bash[19160]: t=2021-03-10T13:44:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for org_id_dashboard_id_epoch_end_epoch on annotation table" 2021-03-10T13:44:25.962 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:25 gibba045 bash[19160]: t=2021-03-10T13:44:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for org_id_epoch_end_epoch on annotation table" 2021-03-10T13:44:25.962 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:25 gibba045 bash[19160]: t=2021-03-10T13:44:25+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_epoch_epoch_end from annotation table" 2021-03-10T13:44:25.962 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:25 gibba045 bash[19160]: t=2021-03-10T13:44:25+0000 lvl=info msg="Executing migration" logger=migrator id="create test_data table" 2021-03-10T13:44:25.963 INFO:journalctl@ceph.prometheus.a.gibba045.stdout:Mar 10 13:44:25 gibba045 bash[19791]: level=info ts=2021-03-10T13:44:25.917Z caller=main.go:366 msg="No time or size retention was set so using the default time retention" duration=15d 2021-03-10T13:44:25.963 INFO:journalctl@ceph.prometheus.a.gibba045.stdout:Mar 10 13:44:25 gibba045 bash[19791]: level=info ts=2021-03-10T13:44:25.917Z caller=main.go:404 msg="Starting Prometheus" version="(version=2.25.0, branch=HEAD, revision=a6be548dbc17780d562a39c0e4bd0bd4c00ad6e2)" 2021-03-10T13:44:25.963 INFO:journalctl@ceph.prometheus.a.gibba045.stdout:Mar 10 13:44:25 gibba045 bash[19791]: level=info ts=2021-03-10T13:44:25.917Z caller=main.go:409 build_context="(go=go1.15.8, user=root@615f028225c9, date=20210217-14:17:24)" 2021-03-10T13:44:25.964 INFO:journalctl@ceph.prometheus.a.gibba045.stdout:Mar 10 13:44:25 gibba045 bash[19791]: level=info ts=2021-03-10T13:44:25.917Z caller=main.go:410 host_details="(Linux 5.4.0-66-generic #74-Ubuntu SMP Wed Jan 27 22:54:38 UTC 2021 x86_64 gibba045 (none))" 2021-03-10T13:44:25.964 INFO:journalctl@ceph.prometheus.a.gibba045.stdout:Mar 10 13:44:25 gibba045 bash[19791]: level=info ts=2021-03-10T13:44:25.917Z caller=main.go:411 fd_limits="(soft=1048576, hard=1048576)" 2021-03-10T13:44:25.964 INFO:journalctl@ceph.prometheus.a.gibba045.stdout:Mar 10 13:44:25 gibba045 bash[19791]: level=info ts=2021-03-10T13:44:25.917Z caller=main.go:412 vm_limits="(soft=unlimited, hard=unlimited)" 2021-03-10T13:44:25.964 INFO:journalctl@ceph.prometheus.a.gibba045.stdout:Mar 10 13:44:25 gibba045 bash[19791]: level=info ts=2021-03-10T13:44:25.918Z caller=web.go:532 component=web msg="Start listening for connections" address=:9095 2021-03-10T13:44:25.964 INFO:journalctl@ceph.prometheus.a.gibba045.stdout:Mar 10 13:44:25 gibba045 bash[19791]: level=info ts=2021-03-10T13:44:25.919Z caller=main.go:779 msg="Starting TSDB ..." 2021-03-10T13:44:25.965 INFO:journalctl@ceph.prometheus.a.gibba045.stdout:Mar 10 13:44:25 gibba045 bash[19791]: level=info ts=2021-03-10T13:44:25.919Z caller=tls_config.go:191 component=web msg="TLS is disabled." http2=false 2021-03-10T13:44:25.965 INFO:journalctl@ceph.prometheus.a.gibba045.stdout:Mar 10 13:44:25 gibba045 bash[19791]: level=info ts=2021-03-10T13:44:25.920Z caller=head.go:668 component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2021-03-10T13:44:25.965 INFO:journalctl@ceph.prometheus.a.gibba045.stdout:Mar 10 13:44:25 gibba045 bash[19791]: level=info ts=2021-03-10T13:44:25.920Z caller=head.go:682 component=tsdb msg="On-disk memory mappable chunks replay completed" duration=1.235µs 2021-03-10T13:44:25.965 INFO:journalctl@ceph.prometheus.a.gibba045.stdout:Mar 10 13:44:25 gibba045 bash[19791]: level=info ts=2021-03-10T13:44:25.920Z caller=head.go:688 component=tsdb msg="Replaying WAL, this may take a while" 2021-03-10T13:44:25.965 INFO:journalctl@ceph.prometheus.a.gibba045.stdout:Mar 10 13:44:25 gibba045 bash[19791]: level=info ts=2021-03-10T13:44:25.921Z caller=head.go:740 component=tsdb msg="WAL segment loaded" segment=0 maxSegment=1 2021-03-10T13:44:25.966 INFO:journalctl@ceph.prometheus.a.gibba045.stdout:Mar 10 13:44:25 gibba045 bash[19791]: level=info ts=2021-03-10T13:44:25.921Z caller=head.go:740 component=tsdb msg="WAL segment loaded" segment=1 maxSegment=1 2021-03-10T13:44:25.966 INFO:journalctl@ceph.prometheus.a.gibba045.stdout:Mar 10 13:44:25 gibba045 bash[19791]: level=info ts=2021-03-10T13:44:25.921Z caller=head.go:745 component=tsdb msg="WAL replay completed" checkpoint_replay_duration=12.728µs wal_replay_duration=757.884µs total_replay_duration=779.829µs 2021-03-10T13:44:25.966 INFO:journalctl@ceph.prometheus.a.gibba045.stdout:Mar 10 13:44:25 gibba045 bash[19791]: level=info ts=2021-03-10T13:44:25.922Z caller=main.go:799 fs_type=XFS_SUPER_MAGIC 2021-03-10T13:44:25.966 INFO:journalctl@ceph.prometheus.a.gibba045.stdout:Mar 10 13:44:25 gibba045 bash[19791]: level=info ts=2021-03-10T13:44:25.922Z caller=main.go:802 msg="TSDB started" 2021-03-10T13:44:25.967 INFO:journalctl@ceph.prometheus.a.gibba045.stdout:Mar 10 13:44:25 gibba045 bash[19791]: level=info ts=2021-03-10T13:44:25.922Z caller=main.go:928 msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2021-03-10T13:44:25.967 INFO:journalctl@ceph.prometheus.a.gibba045.stdout:Mar 10 13:44:25 gibba045 bash[19791]: level=info ts=2021-03-10T13:44:25.922Z caller=main.go:959 msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=395.434µs remote_storage=1.237µs web_handler=243ns query_engine=381ns scrape=189.868µs scrape_sd=17.97µs notify=10.888µs notify_sd=5.23µs rules=14.785µs 2021-03-10T13:44:25.967 INFO:journalctl@ceph.prometheus.a.gibba045.stdout:Mar 10 13:44:25 gibba045 bash[19791]: level=info ts=2021-03-10T13:44:25.922Z caller=main.go:751 msg="Server is ready to receive web requests." 2021-03-10T13:44:26.272 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:26 gibba045 bash[19160]: t=2021-03-10T13:44:26+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_version table v1" 2021-03-10T13:44:26.272 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:26 gibba045 bash[19160]: t=2021-03-10T13:44:26+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_version.dashboard_id" 2021-03-10T13:44:26.273 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:26 gibba045 bash[19160]: t=2021-03-10T13:44:26+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_version.dashboard_id and dashboard_version.version" 2021-03-10T13:44:26.558 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:26 gibba045 bash[19160]: t=2021-03-10T13:44:26+0000 lvl=info msg="Executing migration" logger=migrator id="Set dashboard version to 1 where 0" 2021-03-10T13:44:26.558 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:26 gibba045 bash[19160]: t=2021-03-10T13:44:26+0000 lvl=info msg="Executing migration" logger=migrator id="save existing dashboard data in dashboard_version table v1" 2021-03-10T13:44:26.559 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:26 gibba045 bash[19160]: t=2021-03-10T13:44:26+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard_version.data to mediumtext v1" 2021-03-10T13:44:26.559 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:26 gibba045 bash[19160]: t=2021-03-10T13:44:26+0000 lvl=info msg="Executing migration" logger=migrator id="create team table" 2021-03-10T13:44:26.559 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:26 gibba045 bash[19160]: t=2021-03-10T13:44:26+0000 lvl=info msg="Executing migration" logger=migrator id="add index team.org_id" 2021-03-10T13:44:26.843 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:26 gibba045 bash[19160]: t=2021-03-10T13:44:26+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_org_id_name" 2021-03-10T13:44:26.844 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:26 gibba045 bash[19160]: t=2021-03-10T13:44:26+0000 lvl=info msg="Executing migration" logger=migrator id="create team member table" 2021-03-10T13:44:26.844 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:26 gibba045 bash[19160]: t=2021-03-10T13:44:26+0000 lvl=info msg="Executing migration" logger=migrator id="add index team_member.org_id" 2021-03-10T13:44:26.844 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:26 gibba045 bash[19160]: t=2021-03-10T13:44:26+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_member_org_id_team_id_user_id" 2021-03-10T13:44:27.112 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:26 gibba045 bash[19160]: t=2021-03-10T13:44:26+0000 lvl=info msg="Executing migration" logger=migrator id="Add column email to team table" 2021-03-10T13:44:27.112 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:26 gibba045 bash[19160]: t=2021-03-10T13:44:26+0000 lvl=info msg="Executing migration" logger=migrator id="Add column external to team_member table" 2021-03-10T13:44:27.112 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:26 gibba045 bash[19160]: t=2021-03-10T13:44:26+0000 lvl=info msg="Executing migration" logger=migrator id="Add column permission to team_member table" 2021-03-10T13:44:27.113 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:27 gibba045 bash[19160]: t=2021-03-10T13:44:27+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard acl table" 2021-03-10T13:44:27.113 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:27 gibba045 bash[19160]: t=2021-03-10T13:44:27+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_acl_dashboard_id" 2021-03-10T13:44:27.113 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:27 gibba045 bash[19160]: t=2021-03-10T13:44:27+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_acl_dashboard_id_user_id" 2021-03-10T13:44:27.430 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:27 gibba045 bash[19160]: t=2021-03-10T13:44:27+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_acl_dashboard_id_team_id" 2021-03-10T13:44:27.431 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:27 gibba045 bash[19160]: t=2021-03-10T13:44:27+0000 lvl=info msg="Executing migration" logger=migrator id="save default acl rules in dashboard_acl table" 2021-03-10T13:44:27.431 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:27 gibba045 bash[19160]: t=2021-03-10T13:44:27+0000 lvl=info msg="Executing migration" logger=migrator id="create tag table" 2021-03-10T13:44:27.431 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:27 gibba045 bash[19160]: t=2021-03-10T13:44:27+0000 lvl=info msg="Executing migration" logger=migrator id="add index tag.key_value" 2021-03-10T13:44:27.432 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:44:27 gibba045 bash[9787]: cluster 2021-03-10T13:44:25.157266+0000 mgr.y (mgr.14140) 199 : cluster [DBG] pgmap v187: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:27.432 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:44:27 gibba045 bash[9787]: audit 2021-03-10T13:44:26.425160+0000 mon.a (mon.0) 526 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.420119\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.420388\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.420557\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.420716\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.420867\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.421015\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.421206\", \"created\": \"2021-03-10T13:43:22.897564\", \"started\": \"2021-03-10T13:43:26.167781\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"container_id\": \"b3907fa26ba0\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.421355\", \"created\": \"2021-03-10T13:43:42.821564\", \"started\": \"2021-03-10T13:44:24.396576\"}, \"node-exporter.b\": {\"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.421503\", \"created\": \"2021-03-10T13:43:43.861564\", \"started\": \"2021-03-10T13:43:45.351099\"}, \"grafana.a\": {\"hostname\": \"gibba045\", \"container_id\": \"d86cab6511db\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.421652\", \"created\": \"2021-03-10T13:44:08.721564\", \"started\": \"2021-03-10T13:44:08.746042\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:44:17.558720\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818\"}}, \"last_daemon_update\": \"2021-03-10T13:44:26.421986\", \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:44:27.433 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:44:27 gibba045 bash[9787]: audit 2021-03-10T13:44:26.433840+0000 mon.a (mon.0) 527 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.420119\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.420388\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.420557\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.420716\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.420867\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.421015\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.421206\", \"created\": \"2021-03-10T13:43:22.897564\", \"started\": \"2021-03-10T13:43:26.167781\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"container_id\": \"b3907fa26ba0\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.421355\", \"created\": \"2021-03-10T13:43:42.821564\", \"started\": \"2021-03-10T13:44:24.396576\"}, \"node-exporter.b\": {\"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.421503\", \"created\": \"2021-03-10T13:43:43.861564\", \"started\": \"2021-03-10T13:43:45.351099\"}, \"grafana.a\": {\"hostname\": \"gibba045\", \"container_id\": \"d86cab6511db\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.421652\", \"created\": \"2021-03-10T13:44:08.721564\", \"started\": \"2021-03-10T13:44:08.746042\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:44:17.558720\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818\"}}, \"last_daemon_update\": \"2021-03-10T13:44:26.421986\", \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:44:27.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:44:27 gibba015 bash[9806]: cluster 2021-03-10T13:44:25.157266+0000 mgr.y (mgr.14140) 199 : cluster [DBG] pgmap v187: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:27.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:44:27 gibba015 bash[13005]: cluster 2021-03-10T13:44:25.157266+0000 mgr.y (mgr.14140) 199 : cluster [DBG] pgmap v187: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:27.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:44:27 gibba015 bash[9806]: audit 2021-03-10T13:44:26.425160+0000 mon.a (mon.0) 526 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.420119\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.420388\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.420557\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.420716\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.420867\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.421015\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.421206\", \"created\": \"2021-03-10T13:43:22.897564\", \"started\": \"2021-03-10T13:43:26.167781\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"container_id\": \"b3907fa26ba0\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.421355\", \"created\": \"2021-03-10T13:43:42.821564\", \"started\": \"2021-03-10T13:44:24.396576\"}, \"node-exporter.b\": {\"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.421503\", \"created\": \"2021-03-10T13:43:43.861564\", \"started\": \"2021-03-10T13:43:45.351099\"}, \"grafana.a\": {\"hostname\": \"gibba045\", \"container_id\": \"d86cab6511db\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.421652\", \"created\": \"2021-03-10T13:44:08.721564\", \"started\": \"2021-03-10T13:44:08.746042\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:44:17.558720\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818\"}}, \"last_daemon_update\": \"2021-03-10T13:44:26.421986\", \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:44:27.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:44:27 gibba015 bash[9806]: audit 2021-03-10T13:44:26.433840+0000 mon.a (mon.0) 527 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.420119\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.420388\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.420557\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.420716\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.420867\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.421015\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.421206\", \"created\": \"2021-03-10T13:43:22.897564\", \"started\": \"2021-03-10T13:43:26.167781\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"container_id\": \"b3907fa26ba0\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.421355\", \"created\": \"2021-03-10T13:43:42.821564\", \"started\": \"2021-03-10T13:44:24.396576\"}, \"node-exporter.b\": {\"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.421503\", \"created\": \"2021-03-10T13:43:43.861564\", \"started\": \"2021-03-10T13:43:45.351099\"}, \"grafana.a\": {\"hostname\": \"gibba045\", \"container_id\": \"d86cab6511db\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.421652\", \"created\": \"2021-03-10T13:44:08.721564\", \"started\": \"2021-03-10T13:44:08.746042\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:44:17.558720\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818\"}}, \"last_daemon_update\": \"2021-03-10T13:44:26.421986\", \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:44:27.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:44:27 gibba015 bash[13005]: audit 2021-03-10T13:44:26.425160+0000 mon.a (mon.0) 526 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.420119\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.420388\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.420557\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.420716\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.420867\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.421015\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.421206\", \"created\": \"2021-03-10T13:43:22.897564\", \"started\": \"2021-03-10T13:43:26.167781\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"container_id\": \"b3907fa26ba0\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.421355\", \"created\": \"2021-03-10T13:43:42.821564\", \"started\": \"2021-03-10T13:44:24.396576\"}, \"node-exporter.b\": {\"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.421503\", \"created\": \"2021-03-10T13:43:43.861564\", \"started\": \"2021-03-10T13:43:45.351099\"}, \"grafana.a\": {\"hostname\": \"gibba045\", \"container_id\": \"d86cab6511db\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.421652\", \"created\": \"2021-03-10T13:44:08.721564\", \"started\": \"2021-03-10T13:44:08.746042\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:44:17.558720\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818\"}}, \"last_daemon_update\": \"2021-03-10T13:44:26.421986\", \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:44:27.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:44:27 gibba015 bash[13005]: audit 2021-03-10T13:44:26.433840+0000 mon.a (mon.0) 527 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.420119\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.420388\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.420557\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.420716\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.420867\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.421015\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.421206\", \"created\": \"2021-03-10T13:43:22.897564\", \"started\": \"2021-03-10T13:43:26.167781\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"container_id\": \"b3907fa26ba0\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.421355\", \"created\": \"2021-03-10T13:43:42.821564\", \"started\": \"2021-03-10T13:44:24.396576\"}, \"node-exporter.b\": {\"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.421503\", \"created\": \"2021-03-10T13:43:43.861564\", \"started\": \"2021-03-10T13:43:45.351099\"}, \"grafana.a\": {\"hostname\": \"gibba045\", \"container_id\": \"d86cab6511db\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.421652\", \"created\": \"2021-03-10T13:44:08.721564\", \"started\": \"2021-03-10T13:44:08.746042\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:44:17.558720\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818\"}}, \"last_daemon_update\": \"2021-03-10T13:44:26.421986\", \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:44:27.715 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:27 gibba045 bash[19160]: t=2021-03-10T13:44:27+0000 lvl=info msg="Executing migration" logger=migrator id="create login attempt table" 2021-03-10T13:44:27.715 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:27 gibba045 bash[19160]: t=2021-03-10T13:44:27+0000 lvl=info msg="Executing migration" logger=migrator id="add index login_attempt.username" 2021-03-10T13:44:27.715 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:27 gibba045 bash[19160]: t=2021-03-10T13:44:27+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_login_attempt_username - v1" 2021-03-10T13:44:27.716 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:27 gibba045 bash[19160]: t=2021-03-10T13:44:27+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table login_attempt to login_attempt_tmp_qwerty - v1" 2021-03-10T13:44:27.983 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:27 gibba045 bash[19160]: t=2021-03-10T13:44:27+0000 lvl=info msg="Executing migration" logger=migrator id="create login_attempt v2" 2021-03-10T13:44:27.984 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:27 gibba045 bash[19160]: t=2021-03-10T13:44:27+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_login_attempt_username - v2" 2021-03-10T13:44:27.984 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:27 gibba045 bash[19160]: t=2021-03-10T13:44:27+0000 lvl=info msg="Executing migration" logger=migrator id="copy login_attempt v1 to v2" 2021-03-10T13:44:27.984 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:27 gibba045 bash[19160]: t=2021-03-10T13:44:27+0000 lvl=info msg="Executing migration" logger=migrator id="drop login_attempt_tmp_qwerty" 2021-03-10T13:44:28.281 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:44:28 gibba045 bash[9787]: cluster 2021-03-10T13:44:27.157506+0000 mgr.y (mgr.14140) 200 : cluster [DBG] pgmap v188: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:28.282 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:27 gibba045 bash[19160]: t=2021-03-10T13:44:27+0000 lvl=info msg="Executing migration" logger=migrator id="create user auth table" 2021-03-10T13:44:28.282 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:28 gibba045 bash[19160]: t=2021-03-10T13:44:28+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_user_auth_auth_module_auth_id - v1" 2021-03-10T13:44:28.282 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:28 gibba045 bash[19160]: t=2021-03-10T13:44:28+0000 lvl=info msg="Executing migration" logger=migrator id="alter user_auth.auth_id to length 190" 2021-03-10T13:44:28.283 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:28 gibba045 bash[19160]: t=2021-03-10T13:44:28+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth access token to user_auth" 2021-03-10T13:44:28.462 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:44:28 gibba015 bash[9806]: cluster 2021-03-10T13:44:27.157506+0000 mgr.y (mgr.14140) 200 : cluster [DBG] pgmap v188: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:28.463 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:44:28 gibba015 bash[13005]: cluster 2021-03-10T13:44:27.157506+0000 mgr.y (mgr.14140) 200 : cluster [DBG] pgmap v188: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:28.545 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:28 gibba045 bash[19160]: t=2021-03-10T13:44:28+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth refresh token to user_auth" 2021-03-10T13:44:28.545 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:28 gibba045 bash[19160]: t=2021-03-10T13:44:28+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth token type to user_auth" 2021-03-10T13:44:28.545 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:28 gibba045 bash[19160]: t=2021-03-10T13:44:28+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth expiry to user_auth" 2021-03-10T13:44:28.546 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:28 gibba045 bash[19160]: t=2021-03-10T13:44:28+0000 lvl=info msg="Executing migration" logger=migrator id="Add index to user_id column in user_auth" 2021-03-10T13:44:28.546 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:28 gibba045 bash[19160]: t=2021-03-10T13:44:28+0000 lvl=info msg="Executing migration" logger=migrator id="create server_lock table" 2021-03-10T13:44:28.546 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:28 gibba045 bash[19160]: t=2021-03-10T13:44:28+0000 lvl=info msg="Executing migration" logger=migrator id="add index server_lock.operation_uid" 2021-03-10T13:44:28.808 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:28 gibba045 bash[19160]: t=2021-03-10T13:44:28+0000 lvl=info msg="Executing migration" logger=migrator id="create user auth token table" 2021-03-10T13:44:28.808 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:28 gibba045 bash[19160]: t=2021-03-10T13:44:28+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_auth_token.auth_token" 2021-03-10T13:44:28.809 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:28 gibba045 bash[19160]: t=2021-03-10T13:44:28+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_auth_token.prev_auth_token" 2021-03-10T13:44:28.809 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:28 gibba045 bash[19160]: t=2021-03-10T13:44:28+0000 lvl=info msg="Executing migration" logger=migrator id="create cache_data table" 2021-03-10T13:44:28.971 INFO:journalctl@ceph.alertmanager.a.gibba015.stdout:Mar 10 13:44:28 gibba015 bash[21936]: level=info ts=2021-03-10T13:44:28.771Z caller=cluster.go:640 component=cluster msg="gossip settled; proceeding" elapsed=10.000754483s 2021-03-10T13:44:29.083 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:28 gibba045 bash[19160]: t=2021-03-10T13:44:28+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index cache_data.cache_key" 2021-03-10T13:44:29.083 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:29 gibba045 bash[19160]: t=2021-03-10T13:44:29+0000 lvl=info msg="Created default admin" logger=sqlstore user=admin 2021-03-10T13:44:29.084 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:29 gibba045 bash[19160]: t=2021-03-10T13:44:29+0000 lvl=info msg="Initializing HTTPServer" logger=server 2021-03-10T13:44:29.084 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:29 gibba045 bash[19160]: t=2021-03-10T13:44:29+0000 lvl=info msg="Initializing BackendPluginManager" logger=server 2021-03-10T13:44:29.084 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:29 gibba045 bash[19160]: t=2021-03-10T13:44:29+0000 lvl=info msg="Initializing PluginManager" logger=server 2021-03-10T13:44:29.084 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:29 gibba045 bash[19160]: t=2021-03-10T13:44:29+0000 lvl=info msg="Starting plugin search" logger=plugins 2021-03-10T13:44:29.085 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:29 gibba045 bash[19160]: t=2021-03-10T13:44:29+0000 lvl=info msg="Registering plugin" logger=plugins name="Pie Chart" 2021-03-10T13:44:29.085 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:29 gibba045 bash[19160]: t=2021-03-10T13:44:29+0000 lvl=info msg="Registering plugin" logger=plugins name="Status Panel" 2021-03-10T13:44:29.085 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:29 gibba045 bash[19160]: t=2021-03-10T13:44:29+0000 lvl=info msg="Initializing HooksService" logger=server 2021-03-10T13:44:29.085 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:29 gibba045 bash[19160]: t=2021-03-10T13:44:29+0000 lvl=info msg="Initializing OSSLicensingService" logger=server 2021-03-10T13:44:29.085 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:29 gibba045 bash[19160]: t=2021-03-10T13:44:29+0000 lvl=info msg="Initializing InternalMetricsService" logger=server 2021-03-10T13:44:29.086 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:29 gibba045 bash[19160]: t=2021-03-10T13:44:29+0000 lvl=info msg="Initializing RemoteCache" logger=server 2021-03-10T13:44:29.086 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:29 gibba045 bash[19160]: t=2021-03-10T13:44:29+0000 lvl=info msg="Initializing QuotaService" logger=server 2021-03-10T13:44:29.086 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:29 gibba045 bash[19160]: t=2021-03-10T13:44:29+0000 lvl=info msg="Initializing ServerLockService" logger=server 2021-03-10T13:44:29.086 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:29 gibba045 bash[19160]: t=2021-03-10T13:44:29+0000 lvl=info msg="Initializing UserAuthTokenService" logger=server 2021-03-10T13:44:29.087 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:29 gibba045 bash[19160]: t=2021-03-10T13:44:29+0000 lvl=info msg="Initializing RenderingService" logger=server 2021-03-10T13:44:29.087 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:29 gibba045 bash[19160]: t=2021-03-10T13:44:29+0000 lvl=info msg="Initializing AlertEngine" logger=server 2021-03-10T13:44:29.087 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:29 gibba045 bash[19160]: t=2021-03-10T13:44:29+0000 lvl=info msg="Initializing DatasourceCacheService" logger=server 2021-03-10T13:44:29.087 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:29 gibba045 bash[19160]: t=2021-03-10T13:44:29+0000 lvl=info msg="Initializing LoginService" logger=server 2021-03-10T13:44:29.087 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:29 gibba045 bash[19160]: t=2021-03-10T13:44:29+0000 lvl=info msg="Initializing SearchService" logger=server 2021-03-10T13:44:29.088 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:29 gibba045 bash[19160]: t=2021-03-10T13:44:29+0000 lvl=info msg="Initializing TracingService" logger=server 2021-03-10T13:44:29.088 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:29 gibba045 bash[19160]: t=2021-03-10T13:44:29+0000 lvl=info msg="Initializing UsageStatsService" logger=server 2021-03-10T13:44:29.088 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:29 gibba045 bash[19160]: t=2021-03-10T13:44:29+0000 lvl=info msg="Initializing CleanUpService" logger=server 2021-03-10T13:44:29.088 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:29 gibba045 bash[19160]: t=2021-03-10T13:44:29+0000 lvl=info msg="Initializing NotificationService" logger=server 2021-03-10T13:44:29.088 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:29 gibba045 bash[19160]: t=2021-03-10T13:44:29+0000 lvl=info msg="Initializing provisioningServiceImpl" logger=server 2021-03-10T13:44:29.089 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:29 gibba045 bash[19160]: t=2021-03-10T13:44:29+0000 lvl=warn msg="[Deprecated] the datasource provisioning config is outdated. please upgrade" logger=provisioning.datasources filename=/etc/grafana/provisioning/datasources/ceph-dashboard.yml 2021-03-10T13:44:29.089 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:29 gibba045 bash[19160]: t=2021-03-10T13:44:29+0000 lvl=info msg="inserting datasource from configuration " logger=provisioning.datasources name="Dashboard 1" 2021-03-10T13:44:29.089 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:29 gibba045 bash[19160]: t=2021-03-10T13:44:29+0000 lvl=info msg="Backend rendering via phantomJS" logger=rendering renderer=phantomJS 2021-03-10T13:44:29.089 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:29 gibba045 bash[19160]: t=2021-03-10T13:44:29+0000 lvl=warn msg="phantomJS is deprecated and will be removed in a future release. You should consider migrating from phantomJS to grafana-image-renderer plugin." logger=rendering renderer=phantomJS 2021-03-10T13:44:29.221 INFO:teuthology.orchestra.run.gibba015.stdout:115964117022 2021-03-10T13:44:29.221 DEBUG:teuthology.orchestra.run.gibba015:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid e4a642d2-81a5-11eb-9080-001a4aab830c -- ceph tell osd.4 flush_pg_stats 2021-03-10T13:44:29.558 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:29 gibba045 bash[19160]: t=2021-03-10T13:44:29+0000 lvl=info msg="Initializing Stream Manager" 2021-03-10T13:44:29.559 INFO:journalctl@ceph.grafana.a.gibba045.stdout:Mar 10 13:44:29 gibba045 bash[19160]: t=2021-03-10T13:44:29+0000 lvl=info msg="HTTP Server Listen" logger=http.server address=127.0.0.1:3000 protocol=https subUrl= socket= 2021-03-10T13:44:30.457 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:44:30 gibba015 bash[9806]: cluster 2021-03-10T13:44:29.158268+0000 mgr.y (mgr.14140) 201 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:30.457 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:44:30 gibba015 bash[13005]: cluster 2021-03-10T13:44:29.158268+0000 mgr.y (mgr.14140) 201 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:30.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:44:30 gibba045 bash[9787]: cluster 2021-03-10T13:44:29.158268+0000 mgr.y (mgr.14140) 201 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:32.421 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:44:32 gibba015 bash[9806]: cluster 2021-03-10T13:44:31.158926+0000 mgr.y (mgr.14140) 202 : cluster [DBG] pgmap v190: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:32.422 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:44:32 gibba015 bash[13005]: cluster 2021-03-10T13:44:31.158926+0000 mgr.y (mgr.14140) 202 : cluster [DBG] pgmap v190: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:32.423 INFO:teuthology.orchestra.run.gibba015.stdout:137438953499 2021-03-10T13:44:32.423 DEBUG:teuthology.orchestra.run.gibba015:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid e4a642d2-81a5-11eb-9080-001a4aab830c -- ceph tell osd.5 flush_pg_stats 2021-03-10T13:44:32.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:44:32 gibba045 bash[9787]: cluster 2021-03-10T13:44:31.158926+0000 mgr.y (mgr.14140) 202 : cluster [DBG] pgmap v190: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:34.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:44:34 gibba015 bash[9806]: cluster 2021-03-10T13:44:33.159768+0000 mgr.y (mgr.14140) 203 : cluster [DBG] pgmap v191: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:34.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:44:34 gibba015 bash[13005]: cluster 2021-03-10T13:44:33.159768+0000 mgr.y (mgr.14140) 203 : cluster [DBG] pgmap v191: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:34.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:44:34 gibba045 bash[9787]: cluster 2021-03-10T13:44:33.159768+0000 mgr.y (mgr.14140) 203 : cluster [DBG] pgmap v191: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:35.676 INFO:teuthology.orchestra.run.gibba015.stdout:158913789976 2021-03-10T13:44:35.677 DEBUG:teuthology.orchestra.run.gibba015:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid e4a642d2-81a5-11eb-9080-001a4aab830c -- ceph tell osd.6 flush_pg_stats 2021-03-10T13:44:36.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:44:36 gibba015 bash[9806]: cluster 2021-03-10T13:44:35.160607+0000 mgr.y (mgr.14140) 204 : cluster [DBG] pgmap v192: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:36.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:44:36 gibba015 bash[13005]: cluster 2021-03-10T13:44:35.160607+0000 mgr.y (mgr.14140) 204 : cluster [DBG] pgmap v192: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:36.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:44:36 gibba045 bash[9787]: cluster 2021-03-10T13:44:35.160607+0000 mgr.y (mgr.14140) 204 : cluster [DBG] pgmap v192: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:38.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:44:38 gibba015 bash[9806]: cluster 2021-03-10T13:44:37.161366+0000 mgr.y (mgr.14140) 205 : cluster [DBG] pgmap v193: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:38.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:44:38 gibba015 bash[13005]: cluster 2021-03-10T13:44:37.161366+0000 mgr.y (mgr.14140) 205 : cluster [DBG] pgmap v193: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:38.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:44:38 gibba045 bash[9787]: cluster 2021-03-10T13:44:37.161366+0000 mgr.y (mgr.14140) 205 : cluster [DBG] pgmap v193: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:38.949 INFO:teuthology.orchestra.run.gibba015.stdout:180388626451 2021-03-10T13:44:38.950 DEBUG:teuthology.orchestra.run.gibba015:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid e4a642d2-81a5-11eb-9080-001a4aab830c -- ceph tell osd.7 flush_pg_stats 2021-03-10T13:44:40.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:44:40 gibba015 bash[9806]: cluster 2021-03-10T13:44:39.162186+0000 mgr.y (mgr.14140) 206 : cluster [DBG] pgmap v194: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:40.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:44:40 gibba015 bash[13005]: cluster 2021-03-10T13:44:39.162186+0000 mgr.y (mgr.14140) 206 : cluster [DBG] pgmap v194: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:40.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:44:40 gibba045 bash[9787]: cluster 2021-03-10T13:44:39.162186+0000 mgr.y (mgr.14140) 206 : cluster [DBG] pgmap v194: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:42.289 INFO:teuthology.orchestra.run.gibba015.stdout:201863462929 2021-03-10T13:44:42.290 DEBUG:teuthology.orchestra.run.gibba015:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid e4a642d2-81a5-11eb-9080-001a4aab830c -- ceph osd last-stat-seq osd.0 2021-03-10T13:44:42.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:44:42 gibba015 bash[9806]: cluster 2021-03-10T13:44:41.163025+0000 mgr.y (mgr.14140) 207 : cluster [DBG] pgmap v195: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:42.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:44:42 gibba015 bash[13005]: cluster 2021-03-10T13:44:41.163025+0000 mgr.y (mgr.14140) 207 : cluster [DBG] pgmap v195: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:42.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:44:42 gibba045 bash[9787]: cluster 2021-03-10T13:44:41.163025+0000 mgr.y (mgr.14140) 207 : cluster [DBG] pgmap v195: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:44.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:44:44 gibba015 bash[9806]: cluster 2021-03-10T13:44:43.163728+0000 mgr.y (mgr.14140) 208 : cluster [DBG] pgmap v196: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:44.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:44:44 gibba015 bash[13005]: cluster 2021-03-10T13:44:43.163728+0000 mgr.y (mgr.14140) 208 : cluster [DBG] pgmap v196: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:44.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:44:44 gibba045 bash[9787]: cluster 2021-03-10T13:44:43.163728+0000 mgr.y (mgr.14140) 208 : cluster [DBG] pgmap v196: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:45.073 INFO:teuthology.orchestra.run.gibba015.stdout:42949673006 2021-03-10T13:44:45.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:44:45 gibba015 bash[9806]: audit 2021-03-10T13:44:45.071889+0000 mon.c (mon.1) 14 : audit [DBG] from='client.? 172.21.2.115:0/423010790' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2021-03-10T13:44:45.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:44:45 gibba015 bash[13005]: audit 2021-03-10T13:44:45.071889+0000 mon.c (mon.1) 14 : audit [DBG] from='client.? 172.21.2.115:0/423010790' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2021-03-10T13:44:45.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:44:45 gibba045 bash[9787]: audit 2021-03-10T13:44:45.071889+0000 mon.c (mon.1) 14 : audit [DBG] from='client.? 172.21.2.115:0/423010790' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2021-03-10T13:44:45.699 INFO:tasks.cephadm.ceph_manager.ceph:need seq 42949673001 got 42949673006 for osd.0 2021-03-10T13:44:45.699 DEBUG:teuthology.orchestra.run.gibba015:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid e4a642d2-81a5-11eb-9080-001a4aab830c -- ceph osd last-stat-seq osd.1 2021-03-10T13:44:46.523 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:44:46 gibba015 bash[9806]: cluster 2021-03-10T13:44:45.164206+0000 mgr.y (mgr.14140) 209 : cluster [DBG] pgmap v197: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:46.523 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:44:46 gibba015 bash[13005]: cluster 2021-03-10T13:44:45.164206+0000 mgr.y (mgr.14140) 209 : cluster [DBG] pgmap v197: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:46.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:44:46 gibba045 bash[9787]: cluster 2021-03-10T13:44:45.164206+0000 mgr.y (mgr.14140) 209 : cluster [DBG] pgmap v197: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:48.329 INFO:teuthology.orchestra.run.gibba015.stdout:68719476780 2021-03-10T13:44:48.389 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:44:48 gibba015 bash[9806]: cluster 2021-03-10T13:44:47.164771+0000 mgr.y (mgr.14140) 210 : cluster [DBG] pgmap v198: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:48.390 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:44:48 gibba015 bash[13005]: cluster 2021-03-10T13:44:47.164771+0000 mgr.y (mgr.14140) 210 : cluster [DBG] pgmap v198: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:48.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:44:48 gibba045 bash[9787]: cluster 2021-03-10T13:44:47.164771+0000 mgr.y (mgr.14140) 210 : cluster [DBG] pgmap v198: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:48.939 INFO:tasks.cephadm.ceph_manager.ceph:need seq 68719476774 got 68719476780 for osd.1 2021-03-10T13:44:48.939 DEBUG:teuthology.orchestra.run.gibba015:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid e4a642d2-81a5-11eb-9080-001a4aab830c -- ceph osd last-stat-seq osd.2 2021-03-10T13:44:49.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:44:49 gibba015 bash[9806]: audit 2021-03-10T13:44:48.327868+0000 mon.a (mon.0) 528 : audit [DBG] from='client.? 172.21.2.115:0/3024332519' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2021-03-10T13:44:49.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:44:49 gibba015 bash[13005]: audit 2021-03-10T13:44:48.327868+0000 mon.a (mon.0) 528 : audit [DBG] from='client.? 172.21.2.115:0/3024332519' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2021-03-10T13:44:49.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:44:49 gibba045 bash[9787]: audit 2021-03-10T13:44:48.327868+0000 mon.a (mon.0) 528 : audit [DBG] from='client.? 172.21.2.115:0/3024332519' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2021-03-10T13:44:50.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:44:50 gibba015 bash[9806]: cluster 2021-03-10T13:44:49.165733+0000 mgr.y (mgr.14140) 211 : cluster [DBG] pgmap v199: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:50.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:44:50 gibba015 bash[13005]: cluster 2021-03-10T13:44:49.165733+0000 mgr.y (mgr.14140) 211 : cluster [DBG] pgmap v199: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:50.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:44:50 gibba045 bash[9787]: cluster 2021-03-10T13:44:49.165733+0000 mgr.y (mgr.14140) 211 : cluster [DBG] pgmap v199: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:51.645 INFO:teuthology.orchestra.run.gibba015.stdout:90194313257 2021-03-10T13:44:52.226 INFO:tasks.cephadm.ceph_manager.ceph:need seq 90194313252 got 90194313257 for osd.2 2021-03-10T13:44:52.227 DEBUG:teuthology.orchestra.run.gibba015:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid e4a642d2-81a5-11eb-9080-001a4aab830c -- ceph osd last-stat-seq osd.3 2021-03-10T13:44:52.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:44:52 gibba015 bash[9806]: cluster 2021-03-10T13:44:51.166476+0000 mgr.y (mgr.14140) 212 : cluster [DBG] pgmap v200: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:52.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:44:52 gibba015 bash[9806]: audit 2021-03-10T13:44:51.643287+0000 mon.c (mon.1) 15 : audit [DBG] from='client.? 172.21.2.115:0/980147966' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2021-03-10T13:44:52.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:44:52 gibba015 bash[13005]: cluster 2021-03-10T13:44:51.166476+0000 mgr.y (mgr.14140) 212 : cluster [DBG] pgmap v200: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:52.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:44:52 gibba015 bash[13005]: audit 2021-03-10T13:44:51.643287+0000 mon.c (mon.1) 15 : audit [DBG] from='client.? 172.21.2.115:0/980147966' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2021-03-10T13:44:52.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:44:52 gibba045 bash[9787]: cluster 2021-03-10T13:44:51.166476+0000 mgr.y (mgr.14140) 212 : cluster [DBG] pgmap v200: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:52.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:44:52 gibba045 bash[9787]: audit 2021-03-10T13:44:51.643287+0000 mon.c (mon.1) 15 : audit [DBG] from='client.? 172.21.2.115:0/980147966' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2021-03-10T13:44:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:44:54 gibba015 bash[9806]: cluster 2021-03-10T13:44:53.167163+0000 mgr.y (mgr.14140) 213 : cluster [DBG] pgmap v201: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:54.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:44:54 gibba015 bash[13005]: cluster 2021-03-10T13:44:53.167163+0000 mgr.y (mgr.14140) 213 : cluster [DBG] pgmap v201: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:54.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:44:54 gibba045 bash[9787]: cluster 2021-03-10T13:44:53.167163+0000 mgr.y (mgr.14140) 213 : cluster [DBG] pgmap v201: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:54.895 INFO:teuthology.orchestra.run.gibba015.stdout:115964117027 2021-03-10T13:44:55.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:44:55 gibba015 bash[9806]: audit 2021-03-10T13:44:54.893022+0000 mon.c (mon.1) 16 : audit [DBG] from='client.? 172.21.2.115:0/4277469072' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2021-03-10T13:44:55.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:44:55 gibba015 bash[13005]: audit 2021-03-10T13:44:54.893022+0000 mon.c (mon.1) 16 : audit [DBG] from='client.? 172.21.2.115:0/4277469072' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2021-03-10T13:44:55.541 INFO:tasks.cephadm.ceph_manager.ceph:need seq 115964117022 got 115964117027 for osd.3 2021-03-10T13:44:55.541 DEBUG:teuthology.orchestra.run.gibba015:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid e4a642d2-81a5-11eb-9080-001a4aab830c -- ceph osd last-stat-seq osd.4 2021-03-10T13:44:55.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:44:55 gibba045 bash[9787]: audit 2021-03-10T13:44:54.893022+0000 mon.c (mon.1) 16 : audit [DBG] from='client.? 172.21.2.115:0/4277469072' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2021-03-10T13:44:56.534 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:44:56 gibba015 bash[9806]: cluster 2021-03-10T13:44:55.168032+0000 mgr.y (mgr.14140) 214 : cluster [DBG] pgmap v202: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:56.534 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:44:56 gibba015 bash[13005]: cluster 2021-03-10T13:44:55.168032+0000 mgr.y (mgr.14140) 214 : cluster [DBG] pgmap v202: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:56.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:44:56 gibba045 bash[9787]: cluster 2021-03-10T13:44:55.168032+0000 mgr.y (mgr.14140) 214 : cluster [DBG] pgmap v202: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:58.247 INFO:teuthology.orchestra.run.gibba015.stdout:137438953504 2021-03-10T13:44:58.310 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:44:58 gibba015 bash[9806]: cluster 2021-03-10T13:44:57.168717+0000 mgr.y (mgr.14140) 215 : cluster [DBG] pgmap v203: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:58.310 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:44:58 gibba015 bash[13005]: cluster 2021-03-10T13:44:57.168717+0000 mgr.y (mgr.14140) 215 : cluster [DBG] pgmap v203: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:58.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:44:58 gibba045 bash[9787]: cluster 2021-03-10T13:44:57.168717+0000 mgr.y (mgr.14140) 215 : cluster [DBG] pgmap v203: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:44:58.836 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953499 got 137438953504 for osd.4 2021-03-10T13:44:58.836 DEBUG:teuthology.orchestra.run.gibba015:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid e4a642d2-81a5-11eb-9080-001a4aab830c -- ceph osd last-stat-seq osd.5 2021-03-10T13:44:59.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:44:59 gibba015 bash[9806]: audit 2021-03-10T13:44:58.245918+0000 mon.a (mon.0) 529 : audit [DBG] from='client.? 172.21.2.115:0/2643129646' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2021-03-10T13:44:59.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:44:59 gibba015 bash[13005]: audit 2021-03-10T13:44:58.245918+0000 mon.a (mon.0) 529 : audit [DBG] from='client.? 172.21.2.115:0/2643129646' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2021-03-10T13:44:59.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:44:59 gibba045 bash[9787]: audit 2021-03-10T13:44:58.245918+0000 mon.a (mon.0) 529 : audit [DBG] from='client.? 172.21.2.115:0/2643129646' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2021-03-10T13:45:00.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:00 gibba015 bash[9806]: cluster 2021-03-10T13:44:59.169446+0000 mgr.y (mgr.14140) 216 : cluster [DBG] pgmap v204: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:45:00.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:00 gibba015 bash[13005]: cluster 2021-03-10T13:44:59.169446+0000 mgr.y (mgr.14140) 216 : cluster [DBG] pgmap v204: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:45:00.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:00 gibba045 bash[9787]: cluster 2021-03-10T13:44:59.169446+0000 mgr.y (mgr.14140) 216 : cluster [DBG] pgmap v204: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:45:01.604 INFO:teuthology.orchestra.run.gibba015.stdout:158913789981 2021-03-10T13:45:02.223 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913789976 got 158913789981 for osd.5 2021-03-10T13:45:02.223 DEBUG:teuthology.orchestra.run.gibba015:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid e4a642d2-81a5-11eb-9080-001a4aab830c -- ceph osd last-stat-seq osd.6 2021-03-10T13:45:02.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:02 gibba015 bash[9806]: cluster 2021-03-10T13:45:01.169849+0000 mgr.y (mgr.14140) 217 : cluster [DBG] pgmap v205: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:45:02.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:02 gibba015 bash[9806]: audit 2021-03-10T13:45:01.602183+0000 mon.a (mon.0) 530 : audit [DBG] from='client.? 172.21.2.115:0/4119880830' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2021-03-10T13:45:02.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:02 gibba015 bash[13005]: cluster 2021-03-10T13:45:01.169849+0000 mgr.y (mgr.14140) 217 : cluster [DBG] pgmap v205: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:45:02.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:02 gibba015 bash[13005]: audit 2021-03-10T13:45:01.602183+0000 mon.a (mon.0) 530 : audit [DBG] from='client.? 172.21.2.115:0/4119880830' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2021-03-10T13:45:02.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:02 gibba045 bash[9787]: cluster 2021-03-10T13:45:01.169849+0000 mgr.y (mgr.14140) 217 : cluster [DBG] pgmap v205: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:45:02.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:02 gibba045 bash[9787]: audit 2021-03-10T13:45:01.602183+0000 mon.a (mon.0) 530 : audit [DBG] from='client.? 172.21.2.115:0/4119880830' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2021-03-10T13:45:04.540 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:04 gibba015 bash[9806]: cluster 2021-03-10T13:45:03.170133+0000 mgr.y (mgr.14140) 218 : cluster [DBG] pgmap v206: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:45:04.540 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:04 gibba015 bash[13005]: cluster 2021-03-10T13:45:03.170133+0000 mgr.y (mgr.14140) 218 : cluster [DBG] pgmap v206: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:45:04.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:04 gibba045 bash[9787]: cluster 2021-03-10T13:45:03.170133+0000 mgr.y (mgr.14140) 218 : cluster [DBG] pgmap v206: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:45:04.833 INFO:teuthology.orchestra.run.gibba015.stdout:180388626456 2021-03-10T13:45:05.426 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:05 gibba015 bash[9806]: audit 2021-03-10T13:45:04.831156+0000 mon.a (mon.0) 531 : audit [DBG] from='client.? 172.21.2.115:0/2136953598' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2021-03-10T13:45:05.426 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:05 gibba015 bash[13005]: audit 2021-03-10T13:45:04.831156+0000 mon.a (mon.0) 531 : audit [DBG] from='client.? 172.21.2.115:0/2136953598' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2021-03-10T13:45:05.427 INFO:tasks.cephadm.ceph_manager.ceph:need seq 180388626451 got 180388626456 for osd.6 2021-03-10T13:45:05.428 DEBUG:teuthology.orchestra.run.gibba015:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid e4a642d2-81a5-11eb-9080-001a4aab830c -- ceph osd last-stat-seq osd.7 2021-03-10T13:45:05.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:05 gibba045 bash[9787]: audit 2021-03-10T13:45:04.831156+0000 mon.a (mon.0) 531 : audit [DBG] from='client.? 172.21.2.115:0/2136953598' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2021-03-10T13:45:06.505 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:06 gibba015 bash[13005]: cluster 2021-03-10T13:45:05.170967+0000 mgr.y (mgr.14140) 219 : cluster [DBG] pgmap v207: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:45:06.505 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:06 gibba015 bash[9806]: cluster 2021-03-10T13:45:05.170967+0000 mgr.y (mgr.14140) 219 : cluster [DBG] pgmap v207: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:45:06.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:06 gibba045 bash[9787]: cluster 2021-03-10T13:45:05.170967+0000 mgr.y (mgr.14140) 219 : cluster [DBG] pgmap v207: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:45:08.208 INFO:teuthology.orchestra.run.gibba015.stdout:201863462934 2021-03-10T13:45:08.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:08 gibba015 bash[9806]: cluster 2021-03-10T13:45:07.171309+0000 mgr.y (mgr.14140) 220 : cluster [DBG] pgmap v208: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:45:08.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:08 gibba015 bash[13005]: cluster 2021-03-10T13:45:07.171309+0000 mgr.y (mgr.14140) 220 : cluster [DBG] pgmap v208: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:45:08.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:08 gibba045 bash[9787]: cluster 2021-03-10T13:45:07.171309+0000 mgr.y (mgr.14140) 220 : cluster [DBG] pgmap v208: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:45:08.827 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863462929 got 201863462934 for osd.7 2021-03-10T13:45:08.828 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2021-03-10T13:45:08.828 DEBUG:teuthology.orchestra.run.gibba015:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid e4a642d2-81a5-11eb-9080-001a4aab830c -- ceph pg dump --format=json 2021-03-10T13:45:09.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:09 gibba015 bash[9806]: audit 2021-03-10T13:45:08.205786+0000 mon.a (mon.0) 532 : audit [DBG] from='client.? 172.21.2.115:0/1250044586' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2021-03-10T13:45:09.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:09 gibba015 bash[13005]: audit 2021-03-10T13:45:08.205786+0000 mon.a (mon.0) 532 : audit [DBG] from='client.? 172.21.2.115:0/1250044586' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2021-03-10T13:45:09.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:09 gibba045 bash[9787]: audit 2021-03-10T13:45:08.205786+0000 mon.a (mon.0) 532 : audit [DBG] from='client.? 172.21.2.115:0/1250044586' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2021-03-10T13:45:10.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:10 gibba015 bash[9806]: cluster 2021-03-10T13:45:09.171981+0000 mgr.y (mgr.14140) 221 : cluster [DBG] pgmap v209: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:45:10.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:10 gibba015 bash[13005]: cluster 2021-03-10T13:45:09.171981+0000 mgr.y (mgr.14140) 221 : cluster [DBG] pgmap v209: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:45:10.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:10 gibba045 bash[9787]: cluster 2021-03-10T13:45:09.171981+0000 mgr.y (mgr.14140) 221 : cluster [DBG] pgmap v209: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:45:11.673 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-03-10T13:45:11.674 INFO:teuthology.orchestra.run.gibba015.stderr:dumped all 2021-03-10T13:45:12.260 INFO:teuthology.orchestra.run.gibba015.stdout:{"pg_ready":true,"pg_map":{"version":210,"stamp":"2021-03-10T13:45:11.172412+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":8,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":704643072,"kb_used":8392276,"kb_used_data":3604,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":696250796,"statfs":{"total":721554505728,"available":712960815104,"internally_reserved":8589934592,"allocated":3690496,"data_stored":1467790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003352"},"pg_stats":[{"pgid":"1.0","version":"17'1","reported_seq":"14","reported_epoch":"48","state":"active+clean","last_fresh":"2021-03-10T13:43:33.204299+0000","last_change":"2021-03-10T13:43:33.204299+0000","last_active":"2021-03-10T13:43:33.204299+0000","last_peered":"2021-03-10T13:43:33.204299+0000","last_clean":"2021-03-10T13:43:33.204299+0000","last_became_active":"2021-03-10T13:43:33.202715+0000","last_became_peered":"2021-03-10T13:43:33.202715+0000","last_unstale":"2021-03-10T13:43:33.204299+0000","last_undegraded":"2021-03-10T13:43:33.204299+0000","last_fullsized":"2021-03-10T13:43:33.204299+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":2,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-10T13:39:01.965533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-10T13:39:01.965533+0000","last_clean_scrub_stamp":"2021-03-10T13:39:01.965533+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":3,"acting":3,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":47,"seq":201863462935,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":1049036,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":87031348,"statfs":{"total":90194313216,"available":89120100352,"internally_reserved":1073741824,"allocated":462848,"data_stored":183584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 10 13:44:33 2021","interfaces":[{"interface":"back","average":{"1min":1.595,"5min":1.595,"15min":1.595},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":2.5249999999999999,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":2.21},{"interface":"front","average":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":2.4129999999999998,"5min":2.4129999999999998,"15min":2.4129999999999998},"last":1.9650000000000001}]},{"osd":1,"last update":"Wed Mar 10 13:44:33 2021","interfaces":[{"interface":"back","average":{"1min":1.518,"5min":1.518,"15min":1.518},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":2.6920000000000002,"5min":2.6920000000000002,"15min":2.6920000000000002},"last":2.6019999999999999},{"interface":"front","average":{"1min":1.601,"5min":1.601,"15min":1.601},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":2.431,"5min":2.431,"15min":2.431},"last":1.6910000000000001}]},{"osd":2,"last update":"Wed Mar 10 13:44:33 2021","interfaces":[{"interface":"back","average":{"1min":1.657,"5min":1.657,"15min":1.657},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":2.6760000000000002,"5min":2.6760000000000002,"15min":2.6760000000000002},"last":1.605},{"interface":"front","average":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":2.4279999999999999,"5min":2.4279999999999999,"15min":2.4279999999999999},"last":2.0499999999999998}]},{"osd":3,"last update":"Wed Mar 10 13:44:33 2021","interfaces":[{"interface":"back","average":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":2.5609999999999999,"5min":2.5609999999999999,"15min":2.5609999999999999},"last":1.466},{"interface":"front","average":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":2.8849999999999998,"5min":2.8849999999999998,"15min":2.8849999999999998},"last":2.3479999999999999}]},{"osd":4,"last update":"Wed Mar 10 13:44:33 2021","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":2.548,"5min":2.548,"15min":2.548},"last":1.1180000000000001},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":2.3889999999999998,"5min":2.3889999999999998,"15min":2.3889999999999998},"last":1.827}]},{"osd":5,"last update":"Wed Mar 10 13:44:33 2021","interfaces":[{"interface":"back","average":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":2.7349999999999999,"5min":2.7349999999999999,"15min":2.7349999999999999},"last":1.198},{"interface":"front","average":{"1min":1.488,"5min":1.488,"15min":1.488},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":2.7280000000000002,"5min":2.7280000000000002,"15min":2.7280000000000002},"last":1.292}]},{"osd":6,"last update":"Wed Mar 10 13:44:33 2021","interfaces":[{"interface":"back","average":{"1min":1.446,"5min":1.446,"15min":1.446},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":2.5880000000000001,"5min":2.5880000000000001,"15min":2.5880000000000001},"last":1.004},{"interface":"front","average":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":2.7330000000000001,"5min":2.7330000000000001,"15min":2.7330000000000001},"last":2.5059999999999998}]}]},{"osd":6,"up_from":42,"seq":180388626458,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":1049032,"kb_used_data":448,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":87031352,"statfs":{"total":90194313216,"available":89120104448,"internally_reserved":1073741824,"allocated":458752,"data_stored":183290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 10 13:44:11 2021","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":2.472,"5min":2.472,"15min":2.472},"last":1.26},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":2.2040000000000002,"5min":2.2040000000000002,"15min":2.2040000000000002},"last":1.8029999999999999}]},{"osd":1,"last update":"Wed Mar 10 13:44:11 2021","interfaces":[{"interface":"back","average":{"1min":1.579,"5min":1.579,"15min":1.579},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":2.7010000000000001,"5min":2.7010000000000001,"15min":2.7010000000000001},"last":1.145},{"interface":"front","average":{"1min":1.417,"5min":1.417,"15min":1.417},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":2.2669999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.6519999999999999}]},{"osd":2,"last update":"Wed Mar 10 13:44:11 2021","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.486,"15min":1.486},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":2.5680000000000001,"5min":2.5680000000000001,"15min":2.5680000000000001},"last":2.0819999999999999},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":2.3780000000000001,"5min":2.3780000000000001,"15min":2.3780000000000001},"last":2.1890000000000001}]},{"osd":3,"last update":"Wed Mar 10 13:44:11 2021","interfaces":[{"interface":"back","average":{"1min":1.458,"5min":1.458,"15min":1.458},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":2.444,"5min":2.444,"15min":2.444},"last":2.3130000000000002},{"interface":"front","average":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":2.8460000000000001,"5min":2.8460000000000001,"15min":2.8460000000000001},"last":0.89300000000000002}]},{"osd":4,"last update":"Wed Mar 10 13:44:11 2021","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.075,"15min":1.075},"min":{"1min":0.19,"5min":0.19,"15min":0.19},"max":{"1min":2.1040000000000001,"5min":2.1040000000000001,"15min":2.1040000000000001},"last":1.0620000000000001},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":2.4089999999999998,"5min":2.4089999999999998,"15min":2.4089999999999998},"last":1.502}]},{"osd":5,"last update":"Wed Mar 10 13:44:11 2021","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.304,"15min":1.304},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":2.0979999999999999,"5min":2.0979999999999999,"15min":2.0979999999999999},"last":1.379},{"interface":"front","average":{"1min":1.304,"5min":1.304,"15min":1.304},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":2.597,"5min":2.597,"15min":2.597},"last":1.897}]},{"osd":7,"last update":"Wed Mar 10 13:44:33 2021","interfaces":[{"interface":"back","average":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":2.8079999999999998,"5min":2.8079999999999998,"15min":2.8079999999999998},"last":2.532},{"interface":"front","average":{"1min":1.7170000000000001,"5min":1.7170000000000001,"15min":1.7170000000000001},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":2.6259999999999999,"5min":2.6259999999999999,"15min":2.6259999999999999},"last":2.4460000000000002}]}]},{"osd":1,"up_from":16,"seq":68719476784,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88080384,"kb_used":1049032,"kb_used_data":448,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":87031352,"statfs":{"total":90194313216,"available":89120104448,"internally_reserved":1073741824,"allocated":458752,"data_stored":183290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 10 13:44:31 2021","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.71599999999999997,"15min":0.66900000000000004},"min":{"1min":0.192,"5min":0.14999999999999999,"15min":0.14999999999999999},"max":{"1min":1.107,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":0.34799999999999998},{"interface":"front","average":{"1min":1.077,"5min":0.877,"15min":0.79900000000000004},"min":{"1min":0.20200000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":2.3839999999999999,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":0.21199999999999999}]},{"osd":2,"last update":"Wed Mar 10 13:44:51 2021","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.83999999999999997,"15min":0.82699999999999996},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":2.0819999999999999,"5min":2.0819999999999999,"15min":2.0819999999999999},"last":0.23999999999999999},{"interface":"front","average":{"1min":1.141,"5min":1.0669999999999999,"15min":1.0349999999999999},"min":{"1min":0.28499999999999998,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":2.508,"5min":2.508,"15min":2.508},"last":0.32000000000000001}]},{"osd":3,"last update":"Wed Mar 10 13:44:10 2021","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.234,"15min":1.2490000000000001},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":1.996,"5min":2.032,"15min":2.032},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.98499999999999999,"5min":1.0209999999999999,"15min":1.0269999999999999},"min":{"1min":0.29199999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.738,"5min":1.738,"15min":1.738},"last":0.377}]},{"osd":4,"last update":"Wed Mar 10 13:44:31 2021","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.4159999999999999,"15min":1.446},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.8240000000000001,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":1.093},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.341,"15min":1.3300000000000001},"min":{"1min":0.42799999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":2.262,"5min":2.262,"15min":2.262},"last":0.92200000000000004}]},{"osd":5,"last update":"Wed Mar 10 13:44:51 2021","interfaces":[{"interface":"back","average":{"1min":1.734,"5min":1.6819999999999999,"15min":1.6739999999999999},"min":{"1min":0.46500000000000002,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":2.3279999999999998,"5min":2.4239999999999999,"15min":2.4239999999999999},"last":1.177},{"interface":"front","average":{"1min":1.605,"5min":1.571,"15min":1.5649999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":2.3500000000000001,"5min":2.3500000000000001,"15min":2.3500000000000001},"last":1.2250000000000001}]},{"osd":6,"last update":"Wed Mar 10 13:44:10 2021","interfaces":[{"interface":"back","average":{"1min":1.474,"5min":1.474,"15min":1.474},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.988,"5min":1.988,"15min":1.988},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":2.3220000000000001,"5min":2.3220000000000001,"15min":2.3220000000000001},"last":0.95199999999999996}]},{"osd":7,"last update":"Wed Mar 10 13:44:35 2021","interfaces":[{"interface":"back","average":{"1min":1.603,"5min":1.603,"15min":1.603},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":2.4129999999999998,"5min":2.4129999999999998,"15min":2.4129999999999998},"last":0.98499999999999999},{"interface":"front","average":{"1min":1.542,"5min":1.542,"15min":1.542},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":2.3919999999999999,"5min":2.3919999999999999,"15min":2.3919999999999999},"last":1.212}]}]},{"osd":0,"up_from":10,"seq":42949673012,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":1049036,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":87031348,"statfs":{"total":90194313216,"available":89120100352,"internally_reserved":1073741824,"allocated":462848,"data_stored":183584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Mar 10 13:44:27 2021","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.84499999999999997,"15min":0.79300000000000004},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":2.3140000000000001,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":0.26200000000000001},{"interface":"front","average":{"1min":1.1779999999999999,"5min":0.85899999999999999,"15min":0.77300000000000002},"min":{"1min":0.16300000000000001,"5min":0.16300000000000001,"15min":0.16300000000000001},"max":{"1min":2.2320000000000002,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.19900000000000001}]},{"osd":2,"last update":"Wed Mar 10 13:44:50 2021","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.069,"15min":1.0509999999999999},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":1.9330000000000001,"5min":2.4420000000000002,"15min":2.4420000000000002},"last":0.24299999999999999},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.88700000000000001,"15min":0.85499999999999998},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":1.3100000000000001,"5min":1.869,"15min":1.869},"last":0.32800000000000001}]},{"osd":3,"last update":"Wed Mar 10 13:44:14 2021","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":0.97799999999999998,"15min":0.95999999999999996},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":1.95,"5min":1.95,"15min":1.95},"last":0.31},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.1599999999999999,"15min":1.1140000000000001},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":2.444,"5min":2.444,"15min":2.444},"last":0.23100000000000001}]},{"osd":4,"last update":"Wed Mar 10 13:44:31 2021","interfaces":[{"interface":"back","average":{"1min":1.5569999999999999,"5min":1.5800000000000001,"15min":1.5840000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":2.161,"5min":2.3050000000000002,"15min":2.3050000000000002},"last":1.099},{"interface":"front","average":{"1min":1.7909999999999999,"5min":1.7689999999999999,"15min":1.7649999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":2.4569999999999999,"5min":2.52,"15min":2.52},"last":1.145}]},{"osd":5,"last update":"Wed Mar 10 13:44:50 2021","interfaces":[{"interface":"back","average":{"1min":1.5189999999999999,"5min":1.4870000000000001,"15min":1.4810000000000001},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":2.5310000000000001,"5min":2.5310000000000001,"15min":2.5310000000000001},"last":1.165},{"interface":"front","average":{"1min":1.5920000000000001,"5min":1.681,"15min":1.696},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":2.4049999999999998,"5min":2.4049999999999998,"15min":2.4049999999999998},"last":1.1899999999999999}]},{"osd":6,"last update":"Wed Mar 10 13:44:09 2021","interfaces":[{"interface":"back","average":{"1min":1.704,"5min":1.704,"15min":1.704},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":2.7069999999999999,"5min":2.7069999999999999,"15min":2.7069999999999999},"last":1.052},{"interface":"front","average":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":2.5840000000000001,"5min":2.5840000000000001,"15min":2.5840000000000001},"last":1.1200000000000001}]},{"osd":7,"last update":"Wed Mar 10 13:44:32 2021","interfaces":[{"interface":"back","average":{"1min":1.9670000000000001,"5min":1.9670000000000001,"15min":1.9670000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":2.879,"5min":2.879,"15min":2.879},"last":1.2350000000000001},{"interface":"front","average":{"1min":1.746,"5min":1.746,"15min":1.746},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":2.5800000000000001,"5min":2.5800000000000001,"15min":2.5800000000000001},"last":1.032}]}]},{"osd":2,"up_from":21,"seq":90194313261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88080384,"kb_used":1049036,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":87031348,"statfs":{"total":90194313216,"available":89120100352,"internally_reserved":1073741824,"allocated":462848,"data_stored":183584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 10 13:44:49 2021","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.82899999999999996,"15min":0.84599999999999997},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":1.4410000000000001,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.92600000000000005,"5min":1.01,"15min":0.97799999999999998},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":1.7829999999999999,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":1.048}]},{"osd":1,"last update":"Wed Mar 10 13:44:49 2021","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.873,"15min":0.81100000000000005},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":1.9219999999999999,"5min":2.6280000000000001,"15min":2.6280000000000001},"last":1.4379999999999999},{"interface":"front","average":{"1min":0.86599999999999999,"5min":1.046,"15min":1.089},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.7270000000000001,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":1.361}]},{"osd":3,"last update":"Wed Mar 10 13:44:11 2021","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.085,"15min":1.079},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.81799999999999995},{"interface":"front","average":{"1min":1.157,"5min":1.2689999999999999,"15min":1.288},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":2.1000000000000001,"5min":2.194,"15min":2.194},"last":1.1859999999999999}]},{"osd":4,"last update":"Wed Mar 10 13:44:29 2021","interfaces":[{"interface":"back","average":{"1min":1.53,"5min":1.577,"15min":1.585},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":2.4689999999999999,"5min":2.4689999999999999,"15min":2.4689999999999999},"last":1.9370000000000001},{"interface":"front","average":{"1min":1.5009999999999999,"5min":1.548,"15min":1.556},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":2.5129999999999999,"5min":2.5129999999999999,"15min":2.5129999999999999},"last":2.0619999999999998}]},{"osd":5,"last update":"Wed Mar 10 13:44:51 2021","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.6120000000000001,"15min":1.6379999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":2.508,"5min":2.508,"15min":2.508},"last":2.375},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.492,"15min":1.53},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":2.1269999999999998,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":1.522}]},{"osd":6,"last update":"Wed Mar 10 13:44:11 2021","interfaces":[{"interface":"back","average":{"1min":1.613,"5min":1.613,"15min":1.613},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":2.2000000000000002,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":2.2040000000000002},{"interface":"front","average":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":1.6899999999999999},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":2.629,"5min":2.629,"15min":2.629},"last":1.6870000000000001}]},{"osd":7,"last update":"Wed Mar 10 13:44:32 2021","interfaces":[{"interface":"back","average":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":2.4729999999999999,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":1.806},{"interface":"front","average":{"1min":1.7869999999999999,"5min":1.7869999999999999,"15min":1.7869999999999999},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":2.5150000000000001,"5min":2.5150000000000001,"15min":2.5150000000000001},"last":1.5640000000000001}]}]},{"osd":3,"up_from":27,"seq":115964117030,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88080384,"kb_used":1049036,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":87031348,"statfs":{"total":90194313216,"available":89120100352,"internally_reserved":1073741824,"allocated":462848,"data_stored":183584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 10 13:44:09 2021","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.84399999999999997,"15min":0.84899999999999998},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":1.857,"5min":1.857,"15min":1.857},"last":1.734},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.93000000000000005,"15min":0.92400000000000004},"min":{"1min":0.30099999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":2.2120000000000002,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.82299999999999995}]},{"osd":1,"last update":"Wed Mar 10 13:44:09 2021","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":1.1299999999999999,"15min":1.153},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":2.0209999999999999,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.1890000000000001,"15min":1.177},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":2.3620000000000001,"5min":2.3620000000000001,"15min":2.3620000000000001},"last":1.3340000000000001}]},{"osd":2,"last update":"Wed Mar 10 13:44:09 2021","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.1259999999999999,"15min":1.1240000000000001},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":2.6139999999999999,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":0.90700000000000003},{"interface":"front","average":{"1min":1.0569999999999999,"5min":0.98899999999999999,"15min":0.97799999999999998},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":1.796,"5min":1.796,"15min":1.796},"last":1.012}]},{"osd":4,"last update":"Wed Mar 10 13:44:33 2021","interfaces":[{"interface":"back","average":{"1min":1.4930000000000001,"5min":1.3049999999999999,"15min":1.2729999999999999},"min":{"1min":0.77600000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":2.4660000000000002,"5min":2.4660000000000002,"15min":2.4660000000000002},"last":1.8879999999999999},{"interface":"front","average":{"1min":1.5600000000000001,"5min":1.4350000000000001,"15min":1.4139999999999999},"min":{"1min":0.746,"5min":0.497,"15min":0.497},"max":{"1min":2.2599999999999998,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":2.4409999999999998}]},{"osd":5,"last update":"Wed Mar 10 13:44:56 2021","interfaces":[{"interface":"back","average":{"1min":1.635,"5min":1.4550000000000001,"15min":1.425},"min":{"1min":0.79000000000000004,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.4630000000000001,"5min":2.4630000000000001,"15min":2.4630000000000001},"last":2.0569999999999999},{"interface":"front","average":{"1min":1.429,"5min":1.5249999999999999,"15min":1.5409999999999999},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":2.0259999999999998,"5min":2.4239999999999999,"15min":2.4239999999999999},"last":1.4710000000000001}]},{"osd":6,"last update":"Wed Mar 10 13:44:14 2021","interfaces":[{"interface":"back","average":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":2.3319999999999999,"5min":2.3319999999999999,"15min":2.3319999999999999},"last":2.3380000000000001},{"interface":"front","average":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":2.0880000000000001,"5min":2.0880000000000001,"15min":2.0880000000000001},"last":1.5960000000000001}]},{"osd":7,"last update":"Wed Mar 10 13:44:33 2021","interfaces":[{"interface":"back","average":{"1min":1.7869999999999999,"5min":1.7869999999999999,"15min":1.7869999999999999},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":2.5739999999999998,"5min":2.5739999999999998,"15min":2.5739999999999998},"last":2.214},{"interface":"front","average":{"1min":1.7769999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":3.0790000000000002,"5min":3.0790000000000002,"15min":3.0790000000000002},"last":2.5819999999999999}]}]},{"osd":4,"up_from":32,"seq":137438953507,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88080384,"kb_used":1049036,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":87031348,"statfs":{"total":90194313216,"available":89120100352,"internally_reserved":1073741824,"allocated":462848,"data_stored":183584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 10 13:44:30 2021","interfaces":[{"interface":"back","average":{"1min":1.45,"5min":1.3839999999999999,"15min":1.373},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":2.452,"5min":2.452,"15min":2.452},"last":0.93100000000000005},{"interface":"front","average":{"1min":1.4890000000000001,"5min":1.429,"15min":1.419},"min":{"1min":0.67900000000000005,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":2.669,"5min":2.669,"15min":2.669},"last":1.611}]},{"osd":1,"last update":"Wed Mar 10 13:44:30 2021","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.343,"15min":1.337},"min":{"1min":0.71899999999999997,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":2.3340000000000001,"5min":2.3340000000000001,"15min":2.3340000000000001},"last":1.506},{"interface":"front","average":{"1min":1.528,"5min":1.4490000000000001,"15min":1.4359999999999999},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":2.5379999999999998,"5min":2.5379999999999998,"15min":2.5379999999999998},"last":1.3819999999999999}]},{"osd":2,"last update":"Wed Mar 10 13:44:30 2021","interfaces":[{"interface":"back","average":{"1min":1.544,"5min":1.3380000000000001,"15min":1.304},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":2.5800000000000001,"5min":2.5800000000000001,"15min":2.5800000000000001},"last":1.788},{"interface":"front","average":{"1min":1.365,"5min":1.423,"15min":1.4330000000000001},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":2.0499999999999998,"5min":2.222,"15min":2.222},"last":1.2270000000000001}]},{"osd":3,"last update":"Wed Mar 10 13:44:30 2021","interfaces":[{"interface":"back","average":{"1min":1.6299999999999999,"5min":1.454,"15min":1.425},"min":{"1min":0.65100000000000002,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":2.5670000000000002,"5min":2.5670000000000002,"15min":2.5670000000000002},"last":2.2090000000000001},{"interface":"front","average":{"1min":1.6200000000000001,"5min":1.319,"15min":1.2689999999999999},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":2.456,"5min":2.456,"15min":2.456},"last":2.1000000000000001}]},{"osd":5,"last update":"Wed Mar 10 13:44:51 2021","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":0.94099999999999995,"15min":0.88400000000000001},"min":{"1min":0.28100000000000003,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":2.1440000000000001,"5min":2.1440000000000001,"15min":2.1440000000000001},"last":1.139},{"interface":"front","average":{"1min":1.4870000000000001,"5min":1.1259999999999999,"15min":1.0660000000000001},"min":{"1min":0.311,"5min":0.193,"15min":0.193},"max":{"1min":2.5510000000000002,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":2.343}]},{"osd":6,"last update":"Wed Mar 10 13:44:09 2021","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":2.3740000000000001,"5min":2.3740000000000001,"15min":2.3740000000000001},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":2.3039999999999998,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1.929}]},{"osd":7,"last update":"Wed Mar 10 13:44:36 2021","interfaces":[{"interface":"back","average":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":2.4300000000000002,"5min":2.4300000000000002,"15min":2.4300000000000002},"last":2.524},{"interface":"front","average":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":2.5979999999999999,"5min":2.5979999999999999,"15min":2.5979999999999999},"last":2.0299999999999998}]}]},{"osd":5,"up_from":37,"seq":158913789983,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88080384,"kb_used":1049032,"kb_used_data":448,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":87031352,"statfs":{"total":90194313216,"available":89120104448,"internally_reserved":1073741824,"allocated":458752,"data_stored":183290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 10 13:44:52 2021","interfaces":[{"interface":"back","average":{"1min":1.5760000000000001,"5min":1.363,"15min":1.327},"min":{"1min":0.71999999999999997,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":3.0910000000000002,"5min":3.0910000000000002,"15min":3.0910000000000002},"last":1.988},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.57499999999999996,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.8129999999999999,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":1.1930000000000001}]},{"osd":1,"last update":"Wed Mar 10 13:44:52 2021","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.3120000000000001,"15min":1.3069999999999999},"min":{"1min":0.64700000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":2.762,"5min":2.762,"15min":2.762},"last":0.85599999999999998},{"interface":"front","average":{"1min":1.573,"5min":1.3919999999999999,"15min":1.3620000000000001},"min":{"1min":0.68200000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":2.6469999999999998,"5min":2.6469999999999998,"15min":2.6469999999999998},"last":1.03}]},{"osd":2,"last update":"Wed Mar 10 13:44:52 2021","interfaces":[{"interface":"back","average":{"1min":1.454,"5min":1.3360000000000001,"15min":1.3160000000000001},"min":{"1min":0.80900000000000005,"5min":0.433,"15min":0.433},"max":{"1min":2.472,"5min":2.472,"15min":2.472},"last":1.7849999999999999},{"interface":"front","average":{"1min":1.6519999999999999,"5min":1.3879999999999999,"15min":1.3440000000000001},"min":{"1min":0.60699999999999998,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":2.581,"5min":2.581,"15min":2.581},"last":1.492}]},{"osd":3,"last update":"Wed Mar 10 13:44:52 2021","interfaces":[{"interface":"back","average":{"1min":1.5920000000000001,"5min":1.347,"15min":1.306},"min":{"1min":0.71699999999999997,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":2.605,"5min":2.605,"15min":2.605},"last":1.629},{"interface":"front","average":{"1min":1.4890000000000001,"5min":1.3640000000000001,"15min":1.343},"min":{"1min":0.67500000000000004,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":2.3780000000000001,"5min":2.3780000000000001,"15min":2.3780000000000001},"last":1.3779999999999999}]},{"osd":4,"last update":"Wed Mar 10 13:44:52 2021","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.0029999999999999,"15min":0.94699999999999995},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":2.2949999999999999,"5min":2.6299999999999999,"15min":2.6299999999999999},"last":2.677},{"interface":"front","average":{"1min":1.2270000000000001,"5min":0.83899999999999997,"15min":0.77400000000000002},"min":{"1min":0.20799999999999999,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":1.9950000000000001,"5min":1.9950000000000001,"15min":1.9950000000000001},"last":2.1589999999999998}]},{"osd":6,"last update":"Wed Mar 10 13:44:14 2021","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":2.0150000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":2.2789999999999999},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":2.4649999999999999,"5min":2.4649999999999999,"15min":2.4649999999999999},"last":2.847}]},{"osd":7,"last update":"Wed Mar 10 13:44:34 2021","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":2.722,"5min":2.722,"15min":2.722},"last":2.403},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":2.1579999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":2.5329999999999999}]}]}]}} 2021-03-10T13:45:12.262 DEBUG:teuthology.orchestra.run.gibba015:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid e4a642d2-81a5-11eb-9080-001a4aab830c -- ceph pg dump --format=json 2021-03-10T13:45:12.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:12 gibba015 bash[9806]: cluster 2021-03-10T13:45:11.172877+0000 mgr.y (mgr.14140) 222 : cluster [DBG] pgmap v210: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:45:12.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:12 gibba015 bash[9806]: audit 2021-03-10T13:45:11.668821+0000 mgr.y (mgr.14140) 223 : audit [DBG] from='client.14439 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-03-10T13:45:12.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:12 gibba015 bash[13005]: cluster 2021-03-10T13:45:11.172877+0000 mgr.y (mgr.14140) 222 : cluster [DBG] pgmap v210: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:45:12.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:12 gibba015 bash[13005]: audit 2021-03-10T13:45:11.668821+0000 mgr.y (mgr.14140) 223 : audit [DBG] from='client.14439 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-03-10T13:45:12.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:12 gibba045 bash[9787]: cluster 2021-03-10T13:45:11.172877+0000 mgr.y (mgr.14140) 222 : cluster [DBG] pgmap v210: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:45:12.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:12 gibba045 bash[9787]: audit 2021-03-10T13:45:11.668821+0000 mgr.y (mgr.14140) 223 : audit [DBG] from='client.14439 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-03-10T13:45:14.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:14 gibba045 bash[9787]: cluster 2021-03-10T13:45:13.173664+0000 mgr.y (mgr.14140) 224 : cluster [DBG] pgmap v211: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:45:14.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:14 gibba015 bash[9806]: cluster 2021-03-10T13:45:13.173664+0000 mgr.y (mgr.14140) 224 : cluster [DBG] pgmap v211: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:45:14.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:14 gibba015 bash[13005]: cluster 2021-03-10T13:45:13.173664+0000 mgr.y (mgr.14140) 224 : cluster [DBG] pgmap v211: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:45:14.965 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-03-10T13:45:14.966 INFO:teuthology.orchestra.run.gibba015.stderr:dumped all 2021-03-10T13:45:15.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:15 gibba015 bash[9806]: audit 2021-03-10T13:45:14.960887+0000 mgr.y (mgr.14140) 225 : audit [DBG] from='client.24358 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-03-10T13:45:15.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:15 gibba015 bash[13005]: audit 2021-03-10T13:45:14.960887+0000 mgr.y (mgr.14140) 225 : audit [DBG] from='client.24358 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-03-10T13:45:15.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:15 gibba045 bash[9787]: audit 2021-03-10T13:45:14.960887+0000 mgr.y (mgr.14140) 225 : audit [DBG] from='client.24358 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-03-10T13:45:15.609 INFO:teuthology.orchestra.run.gibba015.stdout:{"pg_ready":true,"pg_map":{"version":211,"stamp":"2021-03-10T13:45:13.173274+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":8,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":704643072,"kb_used":8392276,"kb_used_data":3604,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":696250796,"statfs":{"total":721554505728,"available":712960815104,"internally_reserved":8589934592,"allocated":3690496,"data_stored":1467790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003572"},"pg_stats":[{"pgid":"1.0","version":"17'1","reported_seq":"14","reported_epoch":"48","state":"active+clean","last_fresh":"2021-03-10T13:43:33.204299+0000","last_change":"2021-03-10T13:43:33.204299+0000","last_active":"2021-03-10T13:43:33.204299+0000","last_peered":"2021-03-10T13:43:33.204299+0000","last_clean":"2021-03-10T13:43:33.204299+0000","last_became_active":"2021-03-10T13:43:33.202715+0000","last_became_peered":"2021-03-10T13:43:33.202715+0000","last_unstale":"2021-03-10T13:43:33.204299+0000","last_undegraded":"2021-03-10T13:43:33.204299+0000","last_fullsized":"2021-03-10T13:43:33.204299+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":2,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-10T13:39:01.965533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-10T13:39:01.965533+0000","last_clean_scrub_stamp":"2021-03-10T13:39:01.965533+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":3,"acting":3,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":47,"seq":201863462935,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":1049036,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":87031348,"statfs":{"total":90194313216,"available":89120100352,"internally_reserved":1073741824,"allocated":462848,"data_stored":183584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 10 13:44:33 2021","interfaces":[{"interface":"back","average":{"1min":1.595,"5min":1.595,"15min":1.595},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":2.5249999999999999,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":2.21},{"interface":"front","average":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":2.4129999999999998,"5min":2.4129999999999998,"15min":2.4129999999999998},"last":1.9650000000000001}]},{"osd":1,"last update":"Wed Mar 10 13:44:33 2021","interfaces":[{"interface":"back","average":{"1min":1.518,"5min":1.518,"15min":1.518},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":2.6920000000000002,"5min":2.6920000000000002,"15min":2.6920000000000002},"last":2.6019999999999999},{"interface":"front","average":{"1min":1.601,"5min":1.601,"15min":1.601},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":2.431,"5min":2.431,"15min":2.431},"last":1.6910000000000001}]},{"osd":2,"last update":"Wed Mar 10 13:44:33 2021","interfaces":[{"interface":"back","average":{"1min":1.657,"5min":1.657,"15min":1.657},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":2.6760000000000002,"5min":2.6760000000000002,"15min":2.6760000000000002},"last":1.605},{"interface":"front","average":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":2.4279999999999999,"5min":2.4279999999999999,"15min":2.4279999999999999},"last":2.0499999999999998}]},{"osd":3,"last update":"Wed Mar 10 13:44:33 2021","interfaces":[{"interface":"back","average":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":2.5609999999999999,"5min":2.5609999999999999,"15min":2.5609999999999999},"last":1.466},{"interface":"front","average":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":2.8849999999999998,"5min":2.8849999999999998,"15min":2.8849999999999998},"last":2.3479999999999999}]},{"osd":4,"last update":"Wed Mar 10 13:44:33 2021","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":2.548,"5min":2.548,"15min":2.548},"last":1.1180000000000001},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":2.3889999999999998,"5min":2.3889999999999998,"15min":2.3889999999999998},"last":1.827}]},{"osd":5,"last update":"Wed Mar 10 13:44:33 2021","interfaces":[{"interface":"back","average":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":2.7349999999999999,"5min":2.7349999999999999,"15min":2.7349999999999999},"last":1.198},{"interface":"front","average":{"1min":1.488,"5min":1.488,"15min":1.488},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":2.7280000000000002,"5min":2.7280000000000002,"15min":2.7280000000000002},"last":1.292}]},{"osd":6,"last update":"Wed Mar 10 13:44:33 2021","interfaces":[{"interface":"back","average":{"1min":1.446,"5min":1.446,"15min":1.446},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":2.5880000000000001,"5min":2.5880000000000001,"15min":2.5880000000000001},"last":1.004},{"interface":"front","average":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":2.7330000000000001,"5min":2.7330000000000001,"15min":2.7330000000000001},"last":2.5059999999999998}]}]},{"osd":6,"up_from":42,"seq":180388626458,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":1049032,"kb_used_data":448,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":87031352,"statfs":{"total":90194313216,"available":89120104448,"internally_reserved":1073741824,"allocated":458752,"data_stored":183290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 10 13:44:11 2021","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":2.472,"5min":2.472,"15min":2.472},"last":1.26},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":2.2040000000000002,"5min":2.2040000000000002,"15min":2.2040000000000002},"last":1.8029999999999999}]},{"osd":1,"last update":"Wed Mar 10 13:44:11 2021","interfaces":[{"interface":"back","average":{"1min":1.579,"5min":1.579,"15min":1.579},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":2.7010000000000001,"5min":2.7010000000000001,"15min":2.7010000000000001},"last":1.145},{"interface":"front","average":{"1min":1.417,"5min":1.417,"15min":1.417},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":2.2669999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.6519999999999999}]},{"osd":2,"last update":"Wed Mar 10 13:44:11 2021","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.486,"15min":1.486},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":2.5680000000000001,"5min":2.5680000000000001,"15min":2.5680000000000001},"last":2.0819999999999999},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":2.3780000000000001,"5min":2.3780000000000001,"15min":2.3780000000000001},"last":2.1890000000000001}]},{"osd":3,"last update":"Wed Mar 10 13:44:11 2021","interfaces":[{"interface":"back","average":{"1min":1.458,"5min":1.458,"15min":1.458},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":2.444,"5min":2.444,"15min":2.444},"last":2.3130000000000002},{"interface":"front","average":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":2.8460000000000001,"5min":2.8460000000000001,"15min":2.8460000000000001},"last":0.89300000000000002}]},{"osd":4,"last update":"Wed Mar 10 13:44:11 2021","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.075,"15min":1.075},"min":{"1min":0.19,"5min":0.19,"15min":0.19},"max":{"1min":2.1040000000000001,"5min":2.1040000000000001,"15min":2.1040000000000001},"last":1.0620000000000001},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":2.4089999999999998,"5min":2.4089999999999998,"15min":2.4089999999999998},"last":1.502}]},{"osd":5,"last update":"Wed Mar 10 13:44:11 2021","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.304,"15min":1.304},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":2.0979999999999999,"5min":2.0979999999999999,"15min":2.0979999999999999},"last":1.379},{"interface":"front","average":{"1min":1.304,"5min":1.304,"15min":1.304},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":2.597,"5min":2.597,"15min":2.597},"last":1.897}]},{"osd":7,"last update":"Wed Mar 10 13:44:33 2021","interfaces":[{"interface":"back","average":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":2.8079999999999998,"5min":2.8079999999999998,"15min":2.8079999999999998},"last":2.532},{"interface":"front","average":{"1min":1.7170000000000001,"5min":1.7170000000000001,"15min":1.7170000000000001},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":2.6259999999999999,"5min":2.6259999999999999,"15min":2.6259999999999999},"last":2.4460000000000002}]}]},{"osd":1,"up_from":16,"seq":68719476785,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88080384,"kb_used":1049032,"kb_used_data":448,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":87031352,"statfs":{"total":90194313216,"available":89120104448,"internally_reserved":1073741824,"allocated":458752,"data_stored":183290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 10 13:44:31 2021","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.71599999999999997,"15min":0.66900000000000004},"min":{"1min":0.192,"5min":0.14999999999999999,"15min":0.14999999999999999},"max":{"1min":1.107,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":0.79100000000000004},{"interface":"front","average":{"1min":1.077,"5min":0.877,"15min":0.79900000000000004},"min":{"1min":0.20200000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":2.3839999999999999,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.0589999999999999}]},{"osd":2,"last update":"Wed Mar 10 13:44:51 2021","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.83999999999999997,"15min":0.82699999999999996},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":2.0819999999999999,"5min":2.0819999999999999,"15min":2.0819999999999999},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.141,"5min":1.0669999999999999,"15min":1.0349999999999999},"min":{"1min":0.28499999999999998,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":2.508,"5min":2.508,"15min":2.508},"last":0.88200000000000001}]},{"osd":3,"last update":"Wed Mar 10 13:45:11 2021","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.2370000000000001,"15min":1.25},"min":{"1min":0.29599999999999999,"5min":0.252,"15min":0.252},"max":{"1min":2.2069999999999999,"5min":2.2069999999999999,"15min":2.2069999999999999},"last":1.2110000000000001},{"interface":"front","average":{"1min":0.93100000000000005,"5min":1.0009999999999999,"15min":1.0209999999999999},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":1.54,"5min":1.738,"15min":1.738},"last":1.1359999999999999}]},{"osd":4,"last update":"Wed Mar 10 13:44:31 2021","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.4159999999999999,"15min":1.446},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.8240000000000001,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":1.7370000000000001},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.341,"15min":1.3300000000000001},"min":{"1min":0.42799999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":2.262,"5min":2.262,"15min":2.262},"last":1.5740000000000001}]},{"osd":5,"last update":"Wed Mar 10 13:44:51 2021","interfaces":[{"interface":"back","average":{"1min":1.734,"5min":1.6819999999999999,"15min":1.6739999999999999},"min":{"1min":0.46500000000000002,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":2.3279999999999998,"5min":2.4239999999999999,"15min":2.4239999999999999},"last":2.0070000000000001},{"interface":"front","average":{"1min":1.605,"5min":1.571,"15min":1.5649999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":2.3500000000000001,"5min":2.3500000000000001,"15min":2.3500000000000001},"last":1.4830000000000001}]},{"osd":6,"last update":"Wed Mar 10 13:45:11 2021","interfaces":[{"interface":"back","average":{"1min":1.528,"5min":1.484,"15min":1.4770000000000001},"min":{"1min":0.94999999999999996,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":2.0409999999999999,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":1.841},{"interface":"front","average":{"1min":1.7390000000000001,"5min":1.677,"15min":1.667},"min":{"1min":0.95199999999999996,"5min":0.443,"15min":0.443},"max":{"1min":2.54,"5min":2.54,"15min":2.54},"last":1.6799999999999999}]},{"osd":7,"last update":"Wed Mar 10 13:44:35 2021","interfaces":[{"interface":"back","average":{"1min":1.603,"5min":1.603,"15min":1.603},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":2.4129999999999998,"5min":2.4129999999999998,"15min":2.4129999999999998},"last":1.901},{"interface":"front","average":{"1min":1.542,"5min":1.542,"15min":1.542},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":2.3919999999999999,"5min":2.3919999999999999,"15min":2.3919999999999999},"last":1.952}]}]},{"osd":0,"up_from":10,"seq":42949673012,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":1049036,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":87031348,"statfs":{"total":90194313216,"available":89120100352,"internally_reserved":1073741824,"allocated":462848,"data_stored":183584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Mar 10 13:44:27 2021","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.84499999999999997,"15min":0.79300000000000004},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":2.3140000000000001,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":0.26200000000000001},{"interface":"front","average":{"1min":1.1779999999999999,"5min":0.85899999999999999,"15min":0.77300000000000002},"min":{"1min":0.16300000000000001,"5min":0.16300000000000001,"15min":0.16300000000000001},"max":{"1min":2.2320000000000002,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.19900000000000001}]},{"osd":2,"last update":"Wed Mar 10 13:44:50 2021","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.069,"15min":1.0509999999999999},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":1.9330000000000001,"5min":2.4420000000000002,"15min":2.4420000000000002},"last":0.24299999999999999},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.88700000000000001,"15min":0.85499999999999998},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":1.3100000000000001,"5min":1.869,"15min":1.869},"last":0.32800000000000001}]},{"osd":3,"last update":"Wed Mar 10 13:44:14 2021","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":0.97799999999999998,"15min":0.95999999999999996},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":1.95,"5min":1.95,"15min":1.95},"last":0.31},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.1599999999999999,"15min":1.1140000000000001},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":2.444,"5min":2.444,"15min":2.444},"last":0.23100000000000001}]},{"osd":4,"last update":"Wed Mar 10 13:44:31 2021","interfaces":[{"interface":"back","average":{"1min":1.5569999999999999,"5min":1.5800000000000001,"15min":1.5840000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":2.161,"5min":2.3050000000000002,"15min":2.3050000000000002},"last":1.099},{"interface":"front","average":{"1min":1.7909999999999999,"5min":1.7689999999999999,"15min":1.7649999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":2.4569999999999999,"5min":2.52,"15min":2.52},"last":1.145}]},{"osd":5,"last update":"Wed Mar 10 13:44:50 2021","interfaces":[{"interface":"back","average":{"1min":1.5189999999999999,"5min":1.4870000000000001,"15min":1.4810000000000001},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":2.5310000000000001,"5min":2.5310000000000001,"15min":2.5310000000000001},"last":1.165},{"interface":"front","average":{"1min":1.5920000000000001,"5min":1.681,"15min":1.696},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":2.4049999999999998,"5min":2.4049999999999998,"15min":2.4049999999999998},"last":1.1899999999999999}]},{"osd":6,"last update":"Wed Mar 10 13:44:09 2021","interfaces":[{"interface":"back","average":{"1min":1.704,"5min":1.704,"15min":1.704},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":2.7069999999999999,"5min":2.7069999999999999,"15min":2.7069999999999999},"last":1.052},{"interface":"front","average":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":2.5840000000000001,"5min":2.5840000000000001,"15min":2.5840000000000001},"last":1.1200000000000001}]},{"osd":7,"last update":"Wed Mar 10 13:44:32 2021","interfaces":[{"interface":"back","average":{"1min":1.9670000000000001,"5min":1.9670000000000001,"15min":1.9670000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":2.879,"5min":2.879,"15min":2.879},"last":1.2350000000000001},{"interface":"front","average":{"1min":1.746,"5min":1.746,"15min":1.746},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":2.5800000000000001,"5min":2.5800000000000001,"15min":2.5800000000000001},"last":1.032}]}]},{"osd":2,"up_from":21,"seq":90194313261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88080384,"kb_used":1049036,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":87031348,"statfs":{"total":90194313216,"available":89120100352,"internally_reserved":1073741824,"allocated":462848,"data_stored":183584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 10 13:44:49 2021","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.82899999999999996,"15min":0.84599999999999997},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":1.4410000000000001,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.92600000000000005,"5min":1.01,"15min":0.97799999999999998},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":1.7829999999999999,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":1.048}]},{"osd":1,"last update":"Wed Mar 10 13:44:49 2021","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.873,"15min":0.81100000000000005},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":1.9219999999999999,"5min":2.6280000000000001,"15min":2.6280000000000001},"last":1.4379999999999999},{"interface":"front","average":{"1min":0.86599999999999999,"5min":1.046,"15min":1.089},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.7270000000000001,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":1.361}]},{"osd":3,"last update":"Wed Mar 10 13:44:11 2021","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.085,"15min":1.079},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.81799999999999995},{"interface":"front","average":{"1min":1.157,"5min":1.2689999999999999,"15min":1.288},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":2.1000000000000001,"5min":2.194,"15min":2.194},"last":1.1859999999999999}]},{"osd":4,"last update":"Wed Mar 10 13:44:29 2021","interfaces":[{"interface":"back","average":{"1min":1.53,"5min":1.577,"15min":1.585},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":2.4689999999999999,"5min":2.4689999999999999,"15min":2.4689999999999999},"last":1.9370000000000001},{"interface":"front","average":{"1min":1.5009999999999999,"5min":1.548,"15min":1.556},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":2.5129999999999999,"5min":2.5129999999999999,"15min":2.5129999999999999},"last":2.0619999999999998}]},{"osd":5,"last update":"Wed Mar 10 13:44:51 2021","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.6120000000000001,"15min":1.6379999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":2.508,"5min":2.508,"15min":2.508},"last":2.375},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.492,"15min":1.53},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":2.1269999999999998,"5min":2.1269999999999998,"15min":2.1269999999999998},"last":1.522}]},{"osd":6,"last update":"Wed Mar 10 13:44:11 2021","interfaces":[{"interface":"back","average":{"1min":1.613,"5min":1.613,"15min":1.613},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":2.2000000000000002,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":2.2040000000000002},{"interface":"front","average":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":1.6899999999999999},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":2.629,"5min":2.629,"15min":2.629},"last":1.6870000000000001}]},{"osd":7,"last update":"Wed Mar 10 13:44:32 2021","interfaces":[{"interface":"back","average":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":2.4729999999999999,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":1.806},{"interface":"front","average":{"1min":1.7869999999999999,"5min":1.7869999999999999,"15min":1.7869999999999999},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":2.5150000000000001,"5min":2.5150000000000001,"15min":2.5150000000000001},"last":1.5640000000000001}]}]},{"osd":3,"up_from":27,"seq":115964117031,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88080384,"kb_used":1049036,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":87031348,"statfs":{"total":90194313216,"available":89120100352,"internally_reserved":1073741824,"allocated":462848,"data_stored":183584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 10 13:45:11 2021","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":0.88500000000000001,"15min":0.86299999999999999},"min":{"1min":0.28299999999999997,"5min":0.224,"15min":0.224},"max":{"1min":1.835,"5min":1.857,"15min":1.857},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.91500000000000004,"15min":0.91900000000000004},"min":{"1min":0.35999999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":1.3600000000000001,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.81599999999999995}]},{"osd":1,"last update":"Wed Mar 10 13:45:11 2021","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":1.0820000000000001,"15min":1.137},"min":{"1min":0.34999999999999998,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":1.1890000000000001,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":1.1060000000000001},{"interface":"front","average":{"1min":1.284,"5min":1.212,"15min":1.1839999999999999},"min":{"1min":0.33900000000000002,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":1.9550000000000001,"5min":2.3620000000000001,"15min":2.3620000000000001},"last":0.77000000000000002}]},{"osd":2,"last update":"Wed Mar 10 13:45:11 2021","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.1459999999999999,"15min":1.131},"min":{"1min":0.28000000000000003,"5min":0.218,"15min":0.218},"max":{"1min":2.0710000000000002,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":0.92300000000000004},{"interface":"front","average":{"1min":1.04,"5min":1.0029999999999999,"15min":0.98299999999999998},"min":{"1min":0.26500000000000001,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":1.7370000000000001,"5min":1.796,"15min":1.796},"last":0.71899999999999997}]},{"osd":4,"last update":"Wed Mar 10 13:44:33 2021","interfaces":[{"interface":"back","average":{"1min":1.4930000000000001,"5min":1.3049999999999999,"15min":1.2729999999999999},"min":{"1min":0.77600000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":2.4660000000000002,"5min":2.4660000000000002,"15min":2.4660000000000002},"last":2.339},{"interface":"front","average":{"1min":1.5600000000000001,"5min":1.4350000000000001,"15min":1.4139999999999999},"min":{"1min":0.746,"5min":0.497,"15min":0.497},"max":{"1min":2.2599999999999998,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":1.6539999999999999}]},{"osd":5,"last update":"Wed Mar 10 13:44:56 2021","interfaces":[{"interface":"back","average":{"1min":1.635,"5min":1.4550000000000001,"15min":1.425},"min":{"1min":0.79000000000000004,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.4630000000000001,"5min":2.4630000000000001,"15min":2.4630000000000001},"last":1.78},{"interface":"front","average":{"1min":1.429,"5min":1.5249999999999999,"15min":1.5409999999999999},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":2.0259999999999998,"5min":2.4239999999999999,"15min":2.4239999999999999},"last":2.181}]},{"osd":6,"last update":"Wed Mar 10 13:44:14 2021","interfaces":[{"interface":"back","average":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":2.3319999999999999,"5min":2.3319999999999999,"15min":2.3319999999999999},"last":1.3440000000000001},{"interface":"front","average":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":2.0880000000000001,"5min":2.0880000000000001,"15min":2.0880000000000001},"last":1.502}]},{"osd":7,"last update":"Wed Mar 10 13:44:33 2021","interfaces":[{"interface":"back","average":{"1min":1.7869999999999999,"5min":1.7869999999999999,"15min":1.7869999999999999},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":2.5739999999999998,"5min":2.5739999999999998,"15min":2.5739999999999998},"last":1.9139999999999999},{"interface":"front","average":{"1min":1.7769999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":3.0790000000000002,"5min":3.0790000000000002,"15min":3.0790000000000002},"last":2.0350000000000001}]}]},{"osd":4,"up_from":32,"seq":137438953508,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88080384,"kb_used":1049036,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":87031348,"statfs":{"total":90194313216,"available":89120100352,"internally_reserved":1073741824,"allocated":462848,"data_stored":183584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 10 13:44:30 2021","interfaces":[{"interface":"back","average":{"1min":1.45,"5min":1.3839999999999999,"15min":1.373},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":2.452,"5min":2.452,"15min":2.452},"last":1.046},{"interface":"front","average":{"1min":1.4890000000000001,"5min":1.429,"15min":1.419},"min":{"1min":0.67900000000000005,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":2.669,"5min":2.669,"15min":2.669},"last":2.468}]},{"osd":1,"last update":"Wed Mar 10 13:44:30 2021","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.343,"15min":1.337},"min":{"1min":0.71899999999999997,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":2.3340000000000001,"5min":2.3340000000000001,"15min":2.3340000000000001},"last":1.5},{"interface":"front","average":{"1min":1.528,"5min":1.4490000000000001,"15min":1.4359999999999999},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":2.5379999999999998,"5min":2.5379999999999998,"15min":2.5379999999999998},"last":1.9019999999999999}]},{"osd":2,"last update":"Wed Mar 10 13:44:30 2021","interfaces":[{"interface":"back","average":{"1min":1.544,"5min":1.3380000000000001,"15min":1.304},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":2.5800000000000001,"5min":2.5800000000000001,"15min":2.5800000000000001},"last":2.173},{"interface":"front","average":{"1min":1.365,"5min":1.423,"15min":1.4330000000000001},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":2.0499999999999998,"5min":2.222,"15min":2.222},"last":1.6180000000000001}]},{"osd":3,"last update":"Wed Mar 10 13:44:30 2021","interfaces":[{"interface":"back","average":{"1min":1.6299999999999999,"5min":1.454,"15min":1.425},"min":{"1min":0.65100000000000002,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":2.5670000000000002,"5min":2.5670000000000002,"15min":2.5670000000000002},"last":2.2970000000000002},{"interface":"front","average":{"1min":1.6200000000000001,"5min":1.319,"15min":1.2689999999999999},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":2.456,"5min":2.456,"15min":2.456},"last":1.7629999999999999}]},{"osd":5,"last update":"Wed Mar 10 13:44:51 2021","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":0.94099999999999995,"15min":0.88400000000000001},"min":{"1min":0.28100000000000003,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":2.1440000000000001,"5min":2.1440000000000001,"15min":2.1440000000000001},"last":0.88700000000000001},{"interface":"front","average":{"1min":1.4870000000000001,"5min":1.1259999999999999,"15min":1.0660000000000001},"min":{"1min":0.311,"5min":0.193,"15min":0.193},"max":{"1min":2.5510000000000002,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":1.3220000000000001}]},{"osd":6,"last update":"Wed Mar 10 13:45:11 2021","interfaces":[{"interface":"back","average":{"1min":1.3799999999999999,"5min":1.238,"15min":1.214},"min":{"1min":0.29299999999999998,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":2.7010000000000001,"5min":2.7010000000000001,"15min":2.7010000000000001},"last":1.171},{"interface":"front","average":{"1min":1.575,"5min":1.3169999999999999,"15min":1.274},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":2.7959999999999998,"5min":2.7959999999999998,"15min":2.7959999999999998},"last":1.0960000000000001}]},{"osd":7,"last update":"Wed Mar 10 13:44:36 2021","interfaces":[{"interface":"back","average":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":2.4300000000000002,"5min":2.4300000000000002,"15min":2.4300000000000002},"last":1.5800000000000001},{"interface":"front","average":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":2.5979999999999999,"5min":2.5979999999999999,"15min":2.5979999999999999},"last":2.004}]}]},{"osd":5,"up_from":37,"seq":158913789983,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88080384,"kb_used":1049032,"kb_used_data":448,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":87031352,"statfs":{"total":90194313216,"available":89120104448,"internally_reserved":1073741824,"allocated":458752,"data_stored":183290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 10 13:44:52 2021","interfaces":[{"interface":"back","average":{"1min":1.5760000000000001,"5min":1.363,"15min":1.327},"min":{"1min":0.71999999999999997,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":3.0910000000000002,"5min":3.0910000000000002,"15min":3.0910000000000002},"last":1.988},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.57499999999999996,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.8129999999999999,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":1.1930000000000001}]},{"osd":1,"last update":"Wed Mar 10 13:44:52 2021","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.3120000000000001,"15min":1.3069999999999999},"min":{"1min":0.64700000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":2.762,"5min":2.762,"15min":2.762},"last":0.85599999999999998},{"interface":"front","average":{"1min":1.573,"5min":1.3919999999999999,"15min":1.3620000000000001},"min":{"1min":0.68200000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":2.6469999999999998,"5min":2.6469999999999998,"15min":2.6469999999999998},"last":1.03}]},{"osd":2,"last update":"Wed Mar 10 13:44:52 2021","interfaces":[{"interface":"back","average":{"1min":1.454,"5min":1.3360000000000001,"15min":1.3160000000000001},"min":{"1min":0.80900000000000005,"5min":0.433,"15min":0.433},"max":{"1min":2.472,"5min":2.472,"15min":2.472},"last":1.7849999999999999},{"interface":"front","average":{"1min":1.6519999999999999,"5min":1.3879999999999999,"15min":1.3440000000000001},"min":{"1min":0.60699999999999998,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":2.581,"5min":2.581,"15min":2.581},"last":1.492}]},{"osd":3,"last update":"Wed Mar 10 13:44:52 2021","interfaces":[{"interface":"back","average":{"1min":1.5920000000000001,"5min":1.347,"15min":1.306},"min":{"1min":0.71699999999999997,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":2.605,"5min":2.605,"15min":2.605},"last":1.629},{"interface":"front","average":{"1min":1.4890000000000001,"5min":1.3640000000000001,"15min":1.343},"min":{"1min":0.67500000000000004,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":2.3780000000000001,"5min":2.3780000000000001,"15min":2.3780000000000001},"last":1.3779999999999999}]},{"osd":4,"last update":"Wed Mar 10 13:44:52 2021","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.0029999999999999,"15min":0.94699999999999995},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":2.2949999999999999,"5min":2.6299999999999999,"15min":2.6299999999999999},"last":2.677},{"interface":"front","average":{"1min":1.2270000000000001,"5min":0.83899999999999997,"15min":0.77400000000000002},"min":{"1min":0.20799999999999999,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":1.9950000000000001,"5min":1.9950000000000001,"15min":1.9950000000000001},"last":2.1589999999999998}]},{"osd":6,"last update":"Wed Mar 10 13:44:14 2021","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":2.0150000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":2.2789999999999999},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":2.4649999999999999,"5min":2.4649999999999999,"15min":2.4649999999999999},"last":2.847}]},{"osd":7,"last update":"Wed Mar 10 13:44:34 2021","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":2.722,"5min":2.722,"15min":2.722},"last":2.403},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":2.1579999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":2.5329999999999999}]}]}]}} 2021-03-10T13:45:15.611 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2021-03-10T13:45:15.611 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2021-03-10T13:45:15.611 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2021-03-10T13:45:15.612 DEBUG:teuthology.orchestra.run.gibba015:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid e4a642d2-81a5-11eb-9080-001a4aab830c -- ceph health --format=json 2021-03-10T13:45:16.522 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:16 gibba015 bash[9806]: cluster 2021-03-10T13:45:15.174498+0000 mgr.y (mgr.14140) 226 : cluster [DBG] pgmap v212: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:45:16.523 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:16 gibba015 bash[13005]: cluster 2021-03-10T13:45:15.174498+0000 mgr.y (mgr.14140) 226 : cluster [DBG] pgmap v212: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:45:16.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:16 gibba045 bash[9787]: cluster 2021-03-10T13:45:15.174498+0000 mgr.y (mgr.14140) 226 : cluster [DBG] pgmap v212: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:45:18.376 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-03-10T13:45:18.463 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:18 gibba015 bash[9806]: cluster 2021-03-10T13:45:17.175175+0000 mgr.y (mgr.14140) 227 : cluster [DBG] pgmap v213: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:45:18.464 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:18 gibba015 bash[13005]: cluster 2021-03-10T13:45:17.175175+0000 mgr.y (mgr.14140) 227 : cluster [DBG] pgmap v213: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:45:18.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:18 gibba045 bash[9787]: cluster 2021-03-10T13:45:17.175175+0000 mgr.y (mgr.14140) 227 : cluster [DBG] pgmap v213: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:45:19.021 INFO:teuthology.orchestra.run.gibba015.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2021-03-10T13:45:19.022 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2021-03-10T13:45:19.022 INFO:tasks.cephadm:Setup complete, yielding 2021-03-10T13:45:19.023 INFO:teuthology.run_tasks:Running task cephadm.shell... 2021-03-10T13:45:19.034 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@gibba015.front.sepia.ceph.com 2021-03-10T13:45:19.035 DEBUG:teuthology.orchestra.run.gibba015:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e4a642d2-81a5-11eb-9080-001a4aab830c -e sha1=b26fc080937a021ce826cdc94d1adb52c064381a -- bash -c 'radosgw-admin realm create --rgw-realm=r --default' 2021-03-10T13:45:19.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:19 gibba015 bash[9806]: audit 2021-03-10T13:45:18.373990+0000 mon.a (mon.0) 533 : audit [DBG] from='client.? 172.21.2.115:0/1199644090' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2021-03-10T13:45:19.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:19 gibba015 bash[13005]: audit 2021-03-10T13:45:18.373990+0000 mon.a (mon.0) 533 : audit [DBG] from='client.? 172.21.2.115:0/1199644090' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2021-03-10T13:45:19.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:19 gibba045 bash[9787]: audit 2021-03-10T13:45:18.373990+0000 mon.a (mon.0) 533 : audit [DBG] from='client.? 172.21.2.115:0/1199644090' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2021-03-10T13:45:20.432 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:20 gibba015 bash[9806]: cluster 2021-03-10T13:45:19.175842+0000 mgr.y (mgr.14140) 228 : cluster [DBG] pgmap v214: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:45:20.433 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:20 gibba015 bash[13005]: cluster 2021-03-10T13:45:19.175842+0000 mgr.y (mgr.14140) 228 : cluster [DBG] pgmap v214: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:45:20.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:20 gibba045 bash[9787]: cluster 2021-03-10T13:45:19.175842+0000 mgr.y (mgr.14140) 228 : cluster [DBG] pgmap v214: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:45:22.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:22 gibba015 bash[9806]: cluster 2021-03-10T13:45:21.176518+0000 mgr.y (mgr.14140) 229 : cluster [DBG] pgmap v215: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:45:22.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:22 gibba015 bash[13005]: cluster 2021-03-10T13:45:21.176518+0000 mgr.y (mgr.14140) 229 : cluster [DBG] pgmap v215: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:45:22.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:22 gibba045 bash[9787]: cluster 2021-03-10T13:45:21.176518+0000 mgr.y (mgr.14140) 229 : cluster [DBG] pgmap v215: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:45:23.245 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T13:45:23.246 INFO:teuthology.orchestra.run.gibba015.stdout: "id": "babc18a4-51df-4a49-bd53-4eef0e2e159f", 2021-03-10T13:45:23.246 INFO:teuthology.orchestra.run.gibba015.stdout: "name": "r", 2021-03-10T13:45:23.246 INFO:teuthology.orchestra.run.gibba015.stdout: "current_period": "8a4ea83e-1f23-4312-9175-bfdb75df500a", 2021-03-10T13:45:23.246 INFO:teuthology.orchestra.run.gibba015.stdout: "epoch": 1 2021-03-10T13:45:23.246 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T13:45:23.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:23 gibba045 bash[9787]: cluster 2021-03-10T13:45:22.214752+0000 mon.a (mon.0) 534 : cluster [DBG] osdmap e49: 8 total, 8 up, 8 in 2021-03-10T13:45:23.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:23 gibba045 bash[9787]: audit 2021-03-10T13:45:22.215796+0000 mon.c (mon.1) 17 : audit [INF] from='client.? 172.21.2.115:0/2031279975' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-03-10T13:45:23.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:23 gibba045 bash[9787]: audit 2021-03-10T13:45:22.216138+0000 mon.a (mon.0) 535 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-03-10T13:45:23.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:23 gibba015 bash[9806]: cluster 2021-03-10T13:45:22.214752+0000 mon.a (mon.0) 534 : cluster [DBG] osdmap e49: 8 total, 8 up, 8 in 2021-03-10T13:45:23.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:23 gibba015 bash[9806]: audit 2021-03-10T13:45:22.215796+0000 mon.c (mon.1) 17 : audit [INF] from='client.? 172.21.2.115:0/2031279975' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-03-10T13:45:23.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:23 gibba015 bash[9806]: audit 2021-03-10T13:45:22.216138+0000 mon.a (mon.0) 535 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-03-10T13:45:23.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:23 gibba015 bash[13005]: cluster 2021-03-10T13:45:22.214752+0000 mon.a (mon.0) 534 : cluster [DBG] osdmap e49: 8 total, 8 up, 8 in 2021-03-10T13:45:23.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:23 gibba015 bash[13005]: audit 2021-03-10T13:45:22.215796+0000 mon.c (mon.1) 17 : audit [INF] from='client.? 172.21.2.115:0/2031279975' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-03-10T13:45:23.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:23 gibba015 bash[13005]: audit 2021-03-10T13:45:22.216138+0000 mon.a (mon.0) 535 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-03-10T13:45:23.827 DEBUG:teuthology.orchestra.run.gibba015:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e4a642d2-81a5-11eb-9080-001a4aab830c -e sha1=b26fc080937a021ce826cdc94d1adb52c064381a -- bash -c 'radosgw-admin zonegroup create --rgw-zonegroup=default --master --default' 2021-03-10T13:45:24.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:24 gibba045 bash[9787]: cluster 2021-03-10T13:45:23.177188+0000 mgr.y (mgr.14140) 230 : cluster [DBG] pgmap v217: 33 pgs: 1 creating+peering, 1 active+clean, 31 unknown; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:45:24.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:24 gibba045 bash[9787]: audit 2021-03-10T13:45:23.221658+0000 mon.a (mon.0) 536 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2021-03-10T13:45:24.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:24 gibba045 bash[9787]: cluster 2021-03-10T13:45:23.221964+0000 mon.a (mon.0) 537 : cluster [DBG] osdmap e50: 8 total, 8 up, 8 in 2021-03-10T13:45:24.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:24 gibba015 bash[9806]: cluster 2021-03-10T13:45:23.177188+0000 mgr.y (mgr.14140) 230 : cluster [DBG] pgmap v217: 33 pgs: 1 creating+peering, 1 active+clean, 31 unknown; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:45:24.735 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:24 gibba015 bash[9806]: audit 2021-03-10T13:45:23.221658+0000 mon.a (mon.0) 536 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2021-03-10T13:45:24.736 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:24 gibba015 bash[9806]: cluster 2021-03-10T13:45:23.221964+0000 mon.a (mon.0) 537 : cluster [DBG] osdmap e50: 8 total, 8 up, 8 in 2021-03-10T13:45:24.736 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:24 gibba015 bash[13005]: cluster 2021-03-10T13:45:23.177188+0000 mgr.y (mgr.14140) 230 : cluster [DBG] pgmap v217: 33 pgs: 1 creating+peering, 1 active+clean, 31 unknown; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:45:24.736 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:24 gibba015 bash[13005]: audit 2021-03-10T13:45:23.221658+0000 mon.a (mon.0) 536 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2021-03-10T13:45:24.736 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:24 gibba015 bash[13005]: cluster 2021-03-10T13:45:23.221964+0000 mon.a (mon.0) 537 : cluster [DBG] osdmap e50: 8 total, 8 up, 8 in 2021-03-10T13:45:25.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:25 gibba015 bash[9806]: cluster 2021-03-10T13:45:24.230930+0000 mon.a (mon.0) 538 : cluster [DBG] osdmap e51: 8 total, 8 up, 8 in 2021-03-10T13:45:25.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:25 gibba015 bash[13005]: cluster 2021-03-10T13:45:24.230930+0000 mon.a (mon.0) 538 : cluster [DBG] osdmap e51: 8 total, 8 up, 8 in 2021-03-10T13:45:25.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:25 gibba045 bash[9787]: cluster 2021-03-10T13:45:24.230930+0000 mon.a (mon.0) 538 : cluster [DBG] osdmap e51: 8 total, 8 up, 8 in 2021-03-10T13:45:26.469 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T13:45:26.469 INFO:teuthology.orchestra.run.gibba015.stdout: "id": "b10678eb-393c-4db8-9520-4fb4c1ff5c99", 2021-03-10T13:45:26.470 INFO:teuthology.orchestra.run.gibba015.stdout: "name": "default", 2021-03-10T13:45:26.470 INFO:teuthology.orchestra.run.gibba015.stdout: "api_name": "default", 2021-03-10T13:45:26.470 INFO:teuthology.orchestra.run.gibba015.stdout: "is_master": "true", 2021-03-10T13:45:26.470 INFO:teuthology.orchestra.run.gibba015.stdout: "endpoints": [], 2021-03-10T13:45:26.471 INFO:teuthology.orchestra.run.gibba015.stdout: "hostnames": [], 2021-03-10T13:45:26.471 INFO:teuthology.orchestra.run.gibba015.stdout: "hostnames_s3website": [], 2021-03-10T13:45:26.471 INFO:teuthology.orchestra.run.gibba015.stdout: "master_zone": "", 2021-03-10T13:45:26.471 INFO:teuthology.orchestra.run.gibba015.stdout: "zones": [], 2021-03-10T13:45:26.471 INFO:teuthology.orchestra.run.gibba015.stdout: "placement_targets": [], 2021-03-10T13:45:26.472 INFO:teuthology.orchestra.run.gibba015.stdout: "default_placement": "", 2021-03-10T13:45:26.472 INFO:teuthology.orchestra.run.gibba015.stdout: "realm_id": "babc18a4-51df-4a49-bd53-4eef0e2e159f", 2021-03-10T13:45:26.472 INFO:teuthology.orchestra.run.gibba015.stdout: "sync_policy": { 2021-03-10T13:45:26.472 INFO:teuthology.orchestra.run.gibba015.stdout: "groups": [] 2021-03-10T13:45:26.472 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T13:45:26.473 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T13:45:26.534 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:26 gibba015 bash[9806]: cluster 2021-03-10T13:45:25.177840+0000 mgr.y (mgr.14140) 231 : cluster [DBG] pgmap v220: 33 pgs: 17 active+clean, 7 creating+peering, 9 unknown; 227 B data, 3.7 MiB used, 664 GiB / 672 GiB avail; 1023 B/s wr, 1 op/s 2021-03-10T13:45:26.534 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:26 gibba015 bash[13005]: cluster 2021-03-10T13:45:25.177840+0000 mgr.y (mgr.14140) 231 : cluster [DBG] pgmap v220: 33 pgs: 17 active+clean, 7 creating+peering, 9 unknown; 227 B data, 3.7 MiB used, 664 GiB / 672 GiB avail; 1023 B/s wr, 1 op/s 2021-03-10T13:45:26.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:26 gibba045 bash[9787]: cluster 2021-03-10T13:45:25.177840+0000 mgr.y (mgr.14140) 231 : cluster [DBG] pgmap v220: 33 pgs: 17 active+clean, 7 creating+peering, 9 unknown; 227 B data, 3.7 MiB used, 664 GiB / 672 GiB avail; 1023 B/s wr, 1 op/s 2021-03-10T13:45:27.079 DEBUG:teuthology.orchestra.run.gibba015:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e4a642d2-81a5-11eb-9080-001a4aab830c -e sha1=b26fc080937a021ce826cdc94d1adb52c064381a -- bash -c 'radosgw-admin zone create --rgw-zonegroup=default --rgw-zone=z --master --default' 2021-03-10T13:45:28.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:28 gibba015 bash[9806]: cluster 2021-03-10T13:45:27.178183+0000 mgr.y (mgr.14140) 232 : cluster [DBG] pgmap v221: 33 pgs: 26 active+clean, 7 creating+peering; 273 B data, 3.8 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s wr, 1 op/s 2021-03-10T13:45:28.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:28 gibba015 bash[13005]: cluster 2021-03-10T13:45:27.178183+0000 mgr.y (mgr.14140) 232 : cluster [DBG] pgmap v221: 33 pgs: 26 active+clean, 7 creating+peering; 273 B data, 3.8 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s wr, 1 op/s 2021-03-10T13:45:28.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:28 gibba045 bash[9787]: cluster 2021-03-10T13:45:27.178183+0000 mgr.y (mgr.14140) 232 : cluster [DBG] pgmap v221: 33 pgs: 26 active+clean, 7 creating+peering; 273 B data, 3.8 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s wr, 1 op/s 2021-03-10T13:45:29.625 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T13:45:29.626 INFO:teuthology.orchestra.run.gibba015.stdout: "id": "f25535e1-5b93-4e49-bc54-2025ff80f57d", 2021-03-10T13:45:29.626 INFO:teuthology.orchestra.run.gibba015.stdout: "name": "z", 2021-03-10T13:45:29.626 INFO:teuthology.orchestra.run.gibba015.stdout: "domain_root": "z.rgw.meta:root", 2021-03-10T13:45:29.626 INFO:teuthology.orchestra.run.gibba015.stdout: "control_pool": "z.rgw.control", 2021-03-10T13:45:29.627 INFO:teuthology.orchestra.run.gibba015.stdout: "gc_pool": "z.rgw.log:gc", 2021-03-10T13:45:29.627 INFO:teuthology.orchestra.run.gibba015.stdout: "lc_pool": "z.rgw.log:lc", 2021-03-10T13:45:29.627 INFO:teuthology.orchestra.run.gibba015.stdout: "log_pool": "z.rgw.log", 2021-03-10T13:45:29.627 INFO:teuthology.orchestra.run.gibba015.stdout: "intent_log_pool": "z.rgw.log:intent", 2021-03-10T13:45:29.628 INFO:teuthology.orchestra.run.gibba015.stdout: "usage_log_pool": "z.rgw.log:usage", 2021-03-10T13:45:29.628 INFO:teuthology.orchestra.run.gibba015.stdout: "roles_pool": "z.rgw.meta:roles", 2021-03-10T13:45:29.628 INFO:teuthology.orchestra.run.gibba015.stdout: "reshard_pool": "z.rgw.log:reshard", 2021-03-10T13:45:29.628 INFO:teuthology.orchestra.run.gibba015.stdout: "user_keys_pool": "z.rgw.meta:users.keys", 2021-03-10T13:45:29.629 INFO:teuthology.orchestra.run.gibba015.stdout: "user_email_pool": "z.rgw.meta:users.email", 2021-03-10T13:45:29.629 INFO:teuthology.orchestra.run.gibba015.stdout: "user_swift_pool": "z.rgw.meta:users.swift", 2021-03-10T13:45:29.629 INFO:teuthology.orchestra.run.gibba015.stdout: "user_uid_pool": "z.rgw.meta:users.uid", 2021-03-10T13:45:29.629 INFO:teuthology.orchestra.run.gibba015.stdout: "otp_pool": "z.rgw.otp", 2021-03-10T13:45:29.629 INFO:teuthology.orchestra.run.gibba015.stdout: "system_key": { 2021-03-10T13:45:29.630 INFO:teuthology.orchestra.run.gibba015.stdout: "access_key": "", 2021-03-10T13:45:29.630 INFO:teuthology.orchestra.run.gibba015.stdout: "secret_key": "" 2021-03-10T13:45:29.630 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T13:45:29.630 INFO:teuthology.orchestra.run.gibba015.stdout: "placement_pools": [ 2021-03-10T13:45:29.630 INFO:teuthology.orchestra.run.gibba015.stdout: { 2021-03-10T13:45:29.631 INFO:teuthology.orchestra.run.gibba015.stdout: "key": "default-placement", 2021-03-10T13:45:29.631 INFO:teuthology.orchestra.run.gibba015.stdout: "val": { 2021-03-10T13:45:29.631 INFO:teuthology.orchestra.run.gibba015.stdout: "index_pool": "z.rgw.buckets.index", 2021-03-10T13:45:29.631 INFO:teuthology.orchestra.run.gibba015.stdout: "storage_classes": { 2021-03-10T13:45:29.631 INFO:teuthology.orchestra.run.gibba015.stdout: "STANDARD": { 2021-03-10T13:45:29.632 INFO:teuthology.orchestra.run.gibba015.stdout: "data_pool": "z.rgw.buckets.data" 2021-03-10T13:45:29.632 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T13:45:29.632 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T13:45:29.632 INFO:teuthology.orchestra.run.gibba015.stdout: "data_extra_pool": "z.rgw.buckets.non-ec", 2021-03-10T13:45:29.632 INFO:teuthology.orchestra.run.gibba015.stdout: "index_type": 0 2021-03-10T13:45:29.633 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T13:45:29.633 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T13:45:29.633 INFO:teuthology.orchestra.run.gibba015.stdout: ], 2021-03-10T13:45:29.633 INFO:teuthology.orchestra.run.gibba015.stdout: "realm_id": "babc18a4-51df-4a49-bd53-4eef0e2e159f" 2021-03-10T13:45:29.634 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T13:45:30.269 DEBUG:teuthology.orchestra.run.gibba015:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e4a642d2-81a5-11eb-9080-001a4aab830c -e sha1=b26fc080937a021ce826cdc94d1adb52c064381a -- bash -c 'radosgw-admin period update --rgw-realm=r --commit' 2021-03-10T13:45:30.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:30 gibba015 bash[9806]: cluster 2021-03-10T13:45:29.180450+0000 mgr.y (mgr.14140) 233 : cluster [DBG] pgmap v222: 33 pgs: 33 active+clean; 772 B data, 3.9 MiB used, 664 GiB / 672 GiB avail; 293 B/s rd, 1.6 KiB/s wr, 2 op/s 2021-03-10T13:45:30.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:30 gibba015 bash[13005]: cluster 2021-03-10T13:45:29.180450+0000 mgr.y (mgr.14140) 233 : cluster [DBG] pgmap v222: 33 pgs: 33 active+clean; 772 B data, 3.9 MiB used, 664 GiB / 672 GiB avail; 293 B/s rd, 1.6 KiB/s wr, 2 op/s 2021-03-10T13:45:30.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:30 gibba045 bash[9787]: cluster 2021-03-10T13:45:29.180450+0000 mgr.y (mgr.14140) 233 : cluster [DBG] pgmap v222: 33 pgs: 33 active+clean; 772 B data, 3.9 MiB used, 664 GiB / 672 GiB avail; 293 B/s rd, 1.6 KiB/s wr, 2 op/s 2021-03-10T13:45:32.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:32 gibba015 bash[9806]: cluster 2021-03-10T13:45:31.181001+0000 mgr.y (mgr.14140) 234 : cluster [DBG] pgmap v223: 33 pgs: 33 active+clean; 772 B data, 4.0 MiB used, 664 GiB / 672 GiB avail; 255 B/s rd, 1.4 KiB/s wr, 1 op/s 2021-03-10T13:45:32.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:32 gibba015 bash[13005]: cluster 2021-03-10T13:45:31.181001+0000 mgr.y (mgr.14140) 234 : cluster [DBG] pgmap v223: 33 pgs: 33 active+clean; 772 B data, 4.0 MiB used, 664 GiB / 672 GiB avail; 255 B/s rd, 1.4 KiB/s wr, 1 op/s 2021-03-10T13:45:32.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:32 gibba045 bash[9787]: cluster 2021-03-10T13:45:31.181001+0000 mgr.y (mgr.14140) 234 : cluster [DBG] pgmap v223: 33 pgs: 33 active+clean; 772 B data, 4.0 MiB used, 664 GiB / 672 GiB avail; 255 B/s rd, 1.4 KiB/s wr, 1 op/s 2021-03-10T13:45:34.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:34 gibba045 bash[9787]: cluster 2021-03-10T13:45:33.182062+0000 mgr.y (mgr.14140) 235 : cluster [DBG] pgmap v224: 33 pgs: 33 active+clean; 1.5 KiB data, 4.0 MiB used, 664 GiB / 672 GiB avail; 411 B/s rd, 1.3 KiB/s wr, 2 op/s 2021-03-10T13:45:34.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:34 gibba045 bash[9787]: cluster 2021-03-10T13:45:33.220502+0000 mon.a (mon.0) 539 : cluster [DBG] osdmap e52: 8 total, 8 up, 8 in 2021-03-10T13:45:34.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:34 gibba045 bash[9787]: audit 2021-03-10T13:45:33.221054+0000 mon.c (mon.1) 18 : audit [INF] from='client.? 172.21.2.115:0/205464704' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]: dispatch 2021-03-10T13:45:34.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:34 gibba045 bash[9787]: audit 2021-03-10T13:45:33.223030+0000 mon.a (mon.0) 540 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]: dispatch 2021-03-10T13:45:34.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:34 gibba015 bash[9806]: cluster 2021-03-10T13:45:33.182062+0000 mgr.y (mgr.14140) 235 : cluster [DBG] pgmap v224: 33 pgs: 33 active+clean; 1.5 KiB data, 4.0 MiB used, 664 GiB / 672 GiB avail; 411 B/s rd, 1.3 KiB/s wr, 2 op/s 2021-03-10T13:45:34.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:34 gibba015 bash[9806]: cluster 2021-03-10T13:45:33.220502+0000 mon.a (mon.0) 539 : cluster [DBG] osdmap e52: 8 total, 8 up, 8 in 2021-03-10T13:45:34.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:34 gibba015 bash[9806]: audit 2021-03-10T13:45:33.221054+0000 mon.c (mon.1) 18 : audit [INF] from='client.? 172.21.2.115:0/205464704' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]: dispatch 2021-03-10T13:45:34.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:34 gibba015 bash[9806]: audit 2021-03-10T13:45:33.223030+0000 mon.a (mon.0) 540 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]: dispatch 2021-03-10T13:45:34.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:34 gibba015 bash[13005]: cluster 2021-03-10T13:45:33.182062+0000 mgr.y (mgr.14140) 235 : cluster [DBG] pgmap v224: 33 pgs: 33 active+clean; 1.5 KiB data, 4.0 MiB used, 664 GiB / 672 GiB avail; 411 B/s rd, 1.3 KiB/s wr, 2 op/s 2021-03-10T13:45:34.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:34 gibba015 bash[13005]: cluster 2021-03-10T13:45:33.220502+0000 mon.a (mon.0) 539 : cluster [DBG] osdmap e52: 8 total, 8 up, 8 in 2021-03-10T13:45:34.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:34 gibba015 bash[13005]: audit 2021-03-10T13:45:33.221054+0000 mon.c (mon.1) 18 : audit [INF] from='client.? 172.21.2.115:0/205464704' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]: dispatch 2021-03-10T13:45:34.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:34 gibba015 bash[13005]: audit 2021-03-10T13:45:33.223030+0000 mon.a (mon.0) 540 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]: dispatch 2021-03-10T13:45:35.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:35 gibba045 bash[9787]: audit 2021-03-10T13:45:34.218086+0000 mon.a (mon.0) 541 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]': finished 2021-03-10T13:45:35.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:35 gibba045 bash[9787]: cluster 2021-03-10T13:45:34.218130+0000 mon.a (mon.0) 542 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2021-03-10T13:45:35.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:35 gibba015 bash[9806]: audit 2021-03-10T13:45:34.218086+0000 mon.a (mon.0) 541 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]': finished 2021-03-10T13:45:35.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:35 gibba015 bash[9806]: cluster 2021-03-10T13:45:34.218130+0000 mon.a (mon.0) 542 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2021-03-10T13:45:35.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:35 gibba015 bash[13005]: audit 2021-03-10T13:45:34.218086+0000 mon.a (mon.0) 541 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]': finished 2021-03-10T13:45:35.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:35 gibba015 bash[13005]: cluster 2021-03-10T13:45:34.218130+0000 mon.a (mon.0) 542 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2021-03-10T13:45:36.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:36 gibba045 bash[9787]: cluster 2021-03-10T13:45:35.183032+0000 mgr.y (mgr.14140) 236 : cluster [DBG] pgmap v227: 65 pgs: 7 creating+peering, 19 unknown, 39 active+clean; 1.8 KiB data, 4.1 MiB used, 664 GiB / 672 GiB avail; 2.0 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2021-03-10T13:45:36.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:36 gibba045 bash[9787]: cluster 2021-03-10T13:45:35.228879+0000 mon.a (mon.0) 543 : cluster [DBG] osdmap e54: 8 total, 8 up, 8 in 2021-03-10T13:45:36.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:36 gibba045 bash[9787]: audit 2021-03-10T13:45:35.230570+0000 mon.c (mon.1) 19 : audit [INF] from='client.? 172.21.2.115:0/205464704' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]: dispatch 2021-03-10T13:45:36.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:36 gibba045 bash[9787]: audit 2021-03-10T13:45:35.233869+0000 mon.a (mon.0) 544 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]: dispatch 2021-03-10T13:45:36.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:36 gibba015 bash[9806]: cluster 2021-03-10T13:45:35.183032+0000 mgr.y (mgr.14140) 236 : cluster [DBG] pgmap v227: 65 pgs: 7 creating+peering, 19 unknown, 39 active+clean; 1.8 KiB data, 4.1 MiB used, 664 GiB / 672 GiB avail; 2.0 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2021-03-10T13:45:36.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:36 gibba015 bash[9806]: cluster 2021-03-10T13:45:35.228879+0000 mon.a (mon.0) 543 : cluster [DBG] osdmap e54: 8 total, 8 up, 8 in 2021-03-10T13:45:36.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:36 gibba015 bash[9806]: audit 2021-03-10T13:45:35.230570+0000 mon.c (mon.1) 19 : audit [INF] from='client.? 172.21.2.115:0/205464704' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]: dispatch 2021-03-10T13:45:36.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:36 gibba015 bash[9806]: audit 2021-03-10T13:45:35.233869+0000 mon.a (mon.0) 544 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]: dispatch 2021-03-10T13:45:36.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:36 gibba015 bash[13005]: cluster 2021-03-10T13:45:35.183032+0000 mgr.y (mgr.14140) 236 : cluster [DBG] pgmap v227: 65 pgs: 7 creating+peering, 19 unknown, 39 active+clean; 1.8 KiB data, 4.1 MiB used, 664 GiB / 672 GiB avail; 2.0 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2021-03-10T13:45:36.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:36 gibba015 bash[13005]: cluster 2021-03-10T13:45:35.228879+0000 mon.a (mon.0) 543 : cluster [DBG] osdmap e54: 8 total, 8 up, 8 in 2021-03-10T13:45:36.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:36 gibba015 bash[13005]: audit 2021-03-10T13:45:35.230570+0000 mon.c (mon.1) 19 : audit [INF] from='client.? 172.21.2.115:0/205464704' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]: dispatch 2021-03-10T13:45:36.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:36 gibba015 bash[13005]: audit 2021-03-10T13:45:35.233869+0000 mon.a (mon.0) 544 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]: dispatch 2021-03-10T13:45:37.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:37 gibba045 bash[9787]: audit 2021-03-10T13:45:36.233992+0000 mon.a (mon.0) 545 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]': finished 2021-03-10T13:45:37.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:37 gibba045 bash[9787]: cluster 2021-03-10T13:45:36.234054+0000 mon.a (mon.0) 546 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2021-03-10T13:45:37.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:37 gibba045 bash[9787]: cluster 2021-03-10T13:45:37.238610+0000 mon.a (mon.0) 547 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2021-03-10T13:45:37.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:37 gibba015 bash[9806]: audit 2021-03-10T13:45:36.233992+0000 mon.a (mon.0) 545 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]': finished 2021-03-10T13:45:37.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:37 gibba015 bash[9806]: cluster 2021-03-10T13:45:36.234054+0000 mon.a (mon.0) 546 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2021-03-10T13:45:37.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:37 gibba015 bash[9806]: cluster 2021-03-10T13:45:37.238610+0000 mon.a (mon.0) 547 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2021-03-10T13:45:37.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:37 gibba015 bash[13005]: audit 2021-03-10T13:45:36.233992+0000 mon.a (mon.0) 545 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]': finished 2021-03-10T13:45:37.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:37 gibba015 bash[13005]: cluster 2021-03-10T13:45:36.234054+0000 mon.a (mon.0) 546 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2021-03-10T13:45:37.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:37 gibba015 bash[13005]: cluster 2021-03-10T13:45:37.238610+0000 mon.a (mon.0) 547 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2021-03-10T13:45:38.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:38 gibba045 bash[9787]: cluster 2021-03-10T13:45:37.183958+0000 mgr.y (mgr.14140) 237 : cluster [DBG] pgmap v230: 97 pgs: 14 creating+peering, 30 unknown, 53 active+clean; 1.8 KiB data, 4.1 MiB used, 664 GiB / 672 GiB avail; 4.0 KiB/s rd, 767 B/s wr, 5 op/s 2021-03-10T13:45:38.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:38 gibba045 bash[9787]: audit 2021-03-10T13:45:37.239770+0000 mon.c (mon.1) 20 : audit [INF] from='client.? 172.21.2.115:0/4228531792' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]: dispatch 2021-03-10T13:45:38.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:38 gibba045 bash[9787]: audit 2021-03-10T13:45:37.240142+0000 mon.a (mon.0) 548 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]: dispatch 2021-03-10T13:45:38.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:38 gibba045 bash[9787]: audit 2021-03-10T13:45:38.237999+0000 mon.a (mon.0) 549 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]': finished 2021-03-10T13:45:38.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:38 gibba045 bash[9787]: cluster 2021-03-10T13:45:38.238100+0000 mon.a (mon.0) 550 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2021-03-10T13:45:38.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:38 gibba045 bash[9787]: audit 2021-03-10T13:45:38.239350+0000 mon.c (mon.1) 21 : audit [INF] from='client.? 172.21.2.115:0/4228531792' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2021-03-10T13:45:38.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:38 gibba045 bash[9787]: audit 2021-03-10T13:45:38.239756+0000 mon.a (mon.0) 551 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2021-03-10T13:45:38.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:38 gibba015 bash[9806]: cluster 2021-03-10T13:45:37.183958+0000 mgr.y (mgr.14140) 237 : cluster [DBG] pgmap v230: 97 pgs: 14 creating+peering, 30 unknown, 53 active+clean; 1.8 KiB data, 4.1 MiB used, 664 GiB / 672 GiB avail; 4.0 KiB/s rd, 767 B/s wr, 5 op/s 2021-03-10T13:45:38.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:38 gibba015 bash[9806]: audit 2021-03-10T13:45:37.239770+0000 mon.c (mon.1) 20 : audit [INF] from='client.? 172.21.2.115:0/4228531792' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]: dispatch 2021-03-10T13:45:38.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:38 gibba015 bash[9806]: audit 2021-03-10T13:45:37.240142+0000 mon.a (mon.0) 548 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]: dispatch 2021-03-10T13:45:38.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:38 gibba015 bash[9806]: audit 2021-03-10T13:45:38.237999+0000 mon.a (mon.0) 549 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]': finished 2021-03-10T13:45:38.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:38 gibba015 bash[9806]: cluster 2021-03-10T13:45:38.238100+0000 mon.a (mon.0) 550 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2021-03-10T13:45:38.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:38 gibba015 bash[9806]: audit 2021-03-10T13:45:38.239350+0000 mon.c (mon.1) 21 : audit [INF] from='client.? 172.21.2.115:0/4228531792' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2021-03-10T13:45:38.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:38 gibba015 bash[9806]: audit 2021-03-10T13:45:38.239756+0000 mon.a (mon.0) 551 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2021-03-10T13:45:38.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:38 gibba015 bash[13005]: cluster 2021-03-10T13:45:37.183958+0000 mgr.y (mgr.14140) 237 : cluster [DBG] pgmap v230: 97 pgs: 14 creating+peering, 30 unknown, 53 active+clean; 1.8 KiB data, 4.1 MiB used, 664 GiB / 672 GiB avail; 4.0 KiB/s rd, 767 B/s wr, 5 op/s 2021-03-10T13:45:38.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:38 gibba015 bash[13005]: audit 2021-03-10T13:45:37.239770+0000 mon.c (mon.1) 20 : audit [INF] from='client.? 172.21.2.115:0/4228531792' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]: dispatch 2021-03-10T13:45:38.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:38 gibba015 bash[13005]: audit 2021-03-10T13:45:37.240142+0000 mon.a (mon.0) 548 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]: dispatch 2021-03-10T13:45:38.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:38 gibba015 bash[13005]: audit 2021-03-10T13:45:38.237999+0000 mon.a (mon.0) 549 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]': finished 2021-03-10T13:45:38.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:38 gibba015 bash[13005]: cluster 2021-03-10T13:45:38.238100+0000 mon.a (mon.0) 550 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2021-03-10T13:45:38.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:38 gibba015 bash[13005]: audit 2021-03-10T13:45:38.239350+0000 mon.c (mon.1) 21 : audit [INF] from='client.? 172.21.2.115:0/4228531792' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2021-03-10T13:45:38.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:38 gibba015 bash[13005]: audit 2021-03-10T13:45:38.239756+0000 mon.a (mon.0) 551 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2021-03-10T13:45:40.467 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T13:45:40.468 INFO:teuthology.orchestra.run.gibba015.stdout: "id": "f997334a-ab83-4688-a927-e261e82eed80", 2021-03-10T13:45:40.468 INFO:teuthology.orchestra.run.gibba015.stdout: "epoch": 1, 2021-03-10T13:45:40.468 INFO:teuthology.orchestra.run.gibba015.stdout: "predecessor_uuid": "8a4ea83e-1f23-4312-9175-bfdb75df500a", 2021-03-10T13:45:40.468 INFO:teuthology.orchestra.run.gibba015.stdout: "sync_status": [], 2021-03-10T13:45:40.469 INFO:teuthology.orchestra.run.gibba015.stdout: "period_map": { 2021-03-10T13:45:40.469 INFO:teuthology.orchestra.run.gibba015.stdout: "id": "f997334a-ab83-4688-a927-e261e82eed80", 2021-03-10T13:45:40.469 INFO:teuthology.orchestra.run.gibba015.stdout: "zonegroups": [ 2021-03-10T13:45:40.469 INFO:teuthology.orchestra.run.gibba015.stdout: { 2021-03-10T13:45:40.469 INFO:teuthology.orchestra.run.gibba015.stdout: "id": "b10678eb-393c-4db8-9520-4fb4c1ff5c99", 2021-03-10T13:45:40.470 INFO:teuthology.orchestra.run.gibba015.stdout: "name": "default", 2021-03-10T13:45:40.470 INFO:teuthology.orchestra.run.gibba015.stdout: "api_name": "default", 2021-03-10T13:45:40.470 INFO:teuthology.orchestra.run.gibba015.stdout: "is_master": "true", 2021-03-10T13:45:40.470 INFO:teuthology.orchestra.run.gibba015.stdout: "endpoints": [], 2021-03-10T13:45:40.471 INFO:teuthology.orchestra.run.gibba015.stdout: "hostnames": [], 2021-03-10T13:45:40.471 INFO:teuthology.orchestra.run.gibba015.stdout: "hostnames_s3website": [], 2021-03-10T13:45:40.471 INFO:teuthology.orchestra.run.gibba015.stdout: "master_zone": "f25535e1-5b93-4e49-bc54-2025ff80f57d", 2021-03-10T13:45:40.471 INFO:teuthology.orchestra.run.gibba015.stdout: "zones": [ 2021-03-10T13:45:40.471 INFO:teuthology.orchestra.run.gibba015.stdout: { 2021-03-10T13:45:40.472 INFO:teuthology.orchestra.run.gibba015.stdout: "id": "f25535e1-5b93-4e49-bc54-2025ff80f57d", 2021-03-10T13:45:40.472 INFO:teuthology.orchestra.run.gibba015.stdout: "name": "z", 2021-03-10T13:45:40.472 INFO:teuthology.orchestra.run.gibba015.stdout: "endpoints": [], 2021-03-10T13:45:40.472 INFO:teuthology.orchestra.run.gibba015.stdout: "log_meta": "false", 2021-03-10T13:45:40.472 INFO:teuthology.orchestra.run.gibba015.stdout: "log_data": "false", 2021-03-10T13:45:40.473 INFO:teuthology.orchestra.run.gibba015.stdout: "bucket_index_max_shards": 11, 2021-03-10T13:45:40.473 INFO:teuthology.orchestra.run.gibba015.stdout: "read_only": "false", 2021-03-10T13:45:40.473 INFO:teuthology.orchestra.run.gibba015.stdout: "tier_type": "", 2021-03-10T13:45:40.473 INFO:teuthology.orchestra.run.gibba015.stdout: "sync_from_all": "true", 2021-03-10T13:45:40.474 INFO:teuthology.orchestra.run.gibba015.stdout: "sync_from": [], 2021-03-10T13:45:40.474 INFO:teuthology.orchestra.run.gibba015.stdout: "redirect_zone": "" 2021-03-10T13:45:40.474 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T13:45:40.474 INFO:teuthology.orchestra.run.gibba015.stdout: ], 2021-03-10T13:45:40.474 INFO:teuthology.orchestra.run.gibba015.stdout: "placement_targets": [ 2021-03-10T13:45:40.475 INFO:teuthology.orchestra.run.gibba015.stdout: { 2021-03-10T13:45:40.475 INFO:teuthology.orchestra.run.gibba015.stdout: "name": "default-placement", 2021-03-10T13:45:40.475 INFO:teuthology.orchestra.run.gibba015.stdout: "tags": [], 2021-03-10T13:45:40.475 INFO:teuthology.orchestra.run.gibba015.stdout: "storage_classes": [ 2021-03-10T13:45:40.475 INFO:teuthology.orchestra.run.gibba015.stdout: "STANDARD" 2021-03-10T13:45:40.476 INFO:teuthology.orchestra.run.gibba015.stdout: ] 2021-03-10T13:45:40.476 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T13:45:40.476 INFO:teuthology.orchestra.run.gibba015.stdout: ], 2021-03-10T13:45:40.476 INFO:teuthology.orchestra.run.gibba015.stdout: "default_placement": "default-placement", 2021-03-10T13:45:40.476 INFO:teuthology.orchestra.run.gibba015.stdout: "realm_id": "babc18a4-51df-4a49-bd53-4eef0e2e159f", 2021-03-10T13:45:40.476 INFO:teuthology.orchestra.run.gibba015.stdout: "sync_policy": { 2021-03-10T13:45:40.477 INFO:teuthology.orchestra.run.gibba015.stdout: "groups": [] 2021-03-10T13:45:40.477 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T13:45:40.477 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T13:45:40.477 INFO:teuthology.orchestra.run.gibba015.stdout: ], 2021-03-10T13:45:40.477 INFO:teuthology.orchestra.run.gibba015.stdout: "short_zone_ids": [ 2021-03-10T13:45:40.478 INFO:teuthology.orchestra.run.gibba015.stdout: { 2021-03-10T13:45:40.478 INFO:teuthology.orchestra.run.gibba015.stdout: "key": "f25535e1-5b93-4e49-bc54-2025ff80f57d", 2021-03-10T13:45:40.478 INFO:teuthology.orchestra.run.gibba015.stdout: "val": 3340780059 2021-03-10T13:45:40.478 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T13:45:40.478 INFO:teuthology.orchestra.run.gibba015.stdout: ] 2021-03-10T13:45:40.479 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T13:45:40.479 INFO:teuthology.orchestra.run.gibba015.stdout: "master_zonegroup": "b10678eb-393c-4db8-9520-4fb4c1ff5c99", 2021-03-10T13:45:40.479 INFO:teuthology.orchestra.run.gibba015.stdout: "master_zone": "f25535e1-5b93-4e49-bc54-2025ff80f57d", 2021-03-10T13:45:40.479 INFO:teuthology.orchestra.run.gibba015.stdout: "period_config": { 2021-03-10T13:45:40.479 INFO:teuthology.orchestra.run.gibba015.stdout: "bucket_quota": { 2021-03-10T13:45:40.480 INFO:teuthology.orchestra.run.gibba015.stdout: "enabled": false, 2021-03-10T13:45:40.480 INFO:teuthology.orchestra.run.gibba015.stdout: "check_on_raw": false, 2021-03-10T13:45:40.480 INFO:teuthology.orchestra.run.gibba015.stdout: "max_size": -1, 2021-03-10T13:45:40.480 INFO:teuthology.orchestra.run.gibba015.stdout: "max_size_kb": 0, 2021-03-10T13:45:40.480 INFO:teuthology.orchestra.run.gibba015.stdout: "max_objects": -1 2021-03-10T13:45:40.480 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T13:45:40.481 INFO:teuthology.orchestra.run.gibba015.stdout: "user_quota": { 2021-03-10T13:45:40.481 INFO:teuthology.orchestra.run.gibba015.stdout: "enabled": false, 2021-03-10T13:45:40.481 INFO:teuthology.orchestra.run.gibba015.stdout: "check_on_raw": false, 2021-03-10T13:45:40.481 INFO:teuthology.orchestra.run.gibba015.stdout: "max_size": -1, 2021-03-10T13:45:40.482 INFO:teuthology.orchestra.run.gibba015.stdout: "max_size_kb": 0, 2021-03-10T13:45:40.482 INFO:teuthology.orchestra.run.gibba015.stdout: "max_objects": -1 2021-03-10T13:45:40.482 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T13:45:40.482 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T13:45:40.482 INFO:teuthology.orchestra.run.gibba015.stdout: "realm_id": "babc18a4-51df-4a49-bd53-4eef0e2e159f", 2021-03-10T13:45:40.483 INFO:teuthology.orchestra.run.gibba015.stdout: "realm_name": "r", 2021-03-10T13:45:40.483 INFO:teuthology.orchestra.run.gibba015.stdout: "realm_epoch": 2 2021-03-10T13:45:40.483 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T13:45:40.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:40 gibba045 bash[9787]: cluster 2021-03-10T13:45:39.184352+0000 mgr.y (mgr.14140) 238 : cluster [DBG] pgmap v233: 129 pgs: 15 creating+peering, 22 unknown, 92 active+clean; 1.8 KiB data, 4.4 MiB used, 664 GiB / 672 GiB avail; 1.5 KiB/s rd, 1 op/s 2021-03-10T13:45:40.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:40 gibba045 bash[9787]: audit 2021-03-10T13:45:39.241118+0000 mon.a (mon.0) 552 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2021-03-10T13:45:40.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:40 gibba045 bash[9787]: cluster 2021-03-10T13:45:39.241172+0000 mon.a (mon.0) 553 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2021-03-10T13:45:40.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:40 gibba045 bash[9787]: audit 2021-03-10T13:45:39.241949+0000 mon.c (mon.1) 22 : audit [INF] from='client.? 172.21.2.115:0/4228531792' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2021-03-10T13:45:40.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:40 gibba045 bash[9787]: audit 2021-03-10T13:45:39.242443+0000 mon.a (mon.0) 554 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2021-03-10T13:45:40.601 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:40 gibba015 bash[9806]: cluster 2021-03-10T13:45:39.184352+0000 mgr.y (mgr.14140) 238 : cluster [DBG] pgmap v233: 129 pgs: 15 creating+peering, 22 unknown, 92 active+clean; 1.8 KiB data, 4.4 MiB used, 664 GiB / 672 GiB avail; 1.5 KiB/s rd, 1 op/s 2021-03-10T13:45:40.601 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:40 gibba015 bash[9806]: audit 2021-03-10T13:45:39.241118+0000 mon.a (mon.0) 552 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2021-03-10T13:45:40.602 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:40 gibba015 bash[9806]: cluster 2021-03-10T13:45:39.241172+0000 mon.a (mon.0) 553 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2021-03-10T13:45:40.602 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:40 gibba015 bash[9806]: audit 2021-03-10T13:45:39.241949+0000 mon.c (mon.1) 22 : audit [INF] from='client.? 172.21.2.115:0/4228531792' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2021-03-10T13:45:40.602 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:40 gibba015 bash[9806]: audit 2021-03-10T13:45:39.242443+0000 mon.a (mon.0) 554 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2021-03-10T13:45:40.603 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:40 gibba015 bash[13005]: cluster 2021-03-10T13:45:39.184352+0000 mgr.y (mgr.14140) 238 : cluster [DBG] pgmap v233: 129 pgs: 15 creating+peering, 22 unknown, 92 active+clean; 1.8 KiB data, 4.4 MiB used, 664 GiB / 672 GiB avail; 1.5 KiB/s rd, 1 op/s 2021-03-10T13:45:40.603 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:40 gibba015 bash[13005]: audit 2021-03-10T13:45:39.241118+0000 mon.a (mon.0) 552 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2021-03-10T13:45:40.603 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:40 gibba015 bash[13005]: cluster 2021-03-10T13:45:39.241172+0000 mon.a (mon.0) 553 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2021-03-10T13:45:40.603 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:40 gibba015 bash[13005]: audit 2021-03-10T13:45:39.241949+0000 mon.c (mon.1) 22 : audit [INF] from='client.? 172.21.2.115:0/4228531792' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2021-03-10T13:45:40.603 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:40 gibba015 bash[13005]: audit 2021-03-10T13:45:39.242443+0000 mon.a (mon.0) 554 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2021-03-10T13:45:41.255 DEBUG:teuthology.orchestra.run.gibba015:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e4a642d2-81a5-11eb-9080-001a4aab830c -e sha1=b26fc080937a021ce826cdc94d1adb52c064381a -- bash -c 'ceph orch apply rgw r z --placement=1' 2021-03-10T13:45:41.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:41 gibba045 bash[9787]: audit 2021-03-10T13:45:40.248481+0000 mon.a (mon.0) 555 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2021-03-10T13:45:41.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:41 gibba045 bash[9787]: cluster 2021-03-10T13:45:40.248517+0000 mon.a (mon.0) 556 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2021-03-10T13:45:41.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:41 gibba015 bash[9806]: audit 2021-03-10T13:45:40.248481+0000 mon.a (mon.0) 555 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2021-03-10T13:45:41.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:41 gibba015 bash[9806]: cluster 2021-03-10T13:45:40.248517+0000 mon.a (mon.0) 556 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2021-03-10T13:45:41.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:41 gibba015 bash[13005]: audit 2021-03-10T13:45:40.248481+0000 mon.a (mon.0) 555 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2021-03-10T13:45:41.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:41 gibba015 bash[13005]: cluster 2021-03-10T13:45:40.248517+0000 mon.a (mon.0) 556 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2021-03-10T13:45:42.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:42 gibba015 bash[9806]: cluster 2021-03-10T13:45:41.185250+0000 mgr.y (mgr.14140) 239 : cluster [DBG] pgmap v236: 129 pgs: 15 creating+peering, 8 unknown, 106 active+clean; 1.8 KiB data, 4.5 MiB used, 664 GiB / 672 GiB avail; 511 B/s rd, 0 op/s 2021-03-10T13:45:42.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:42 gibba015 bash[13005]: cluster 2021-03-10T13:45:41.185250+0000 mgr.y (mgr.14140) 239 : cluster [DBG] pgmap v236: 129 pgs: 15 creating+peering, 8 unknown, 106 active+clean; 1.8 KiB data, 4.5 MiB used, 664 GiB / 672 GiB avail; 511 B/s rd, 0 op/s 2021-03-10T13:45:42.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:42 gibba045 bash[9787]: cluster 2021-03-10T13:45:41.185250+0000 mgr.y (mgr.14140) 239 : cluster [DBG] pgmap v236: 129 pgs: 15 creating+peering, 8 unknown, 106 active+clean; 1.8 KiB data, 4.5 MiB used, 664 GiB / 672 GiB avail; 511 B/s rd, 0 op/s 2021-03-10T13:45:43.988 INFO:teuthology.orchestra.run.gibba015.stdout:Scheduled rgw update... 2021-03-10T13:45:44.332 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:44 gibba015 bash[9806]: cluster 2021-03-10T13:45:43.186188+0000 mgr.y (mgr.14140) 240 : cluster [DBG] pgmap v237: 129 pgs: 4 creating+peering, 125 active+clean; 4.6 KiB data, 4.8 MiB used, 664 GiB / 672 GiB avail; 688 B/s rd, 3.4 KiB/s wr, 13 op/s 2021-03-10T13:45:44.332 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:44 gibba015 bash[9806]: audit 2021-03-10T13:45:43.981049+0000 mgr.y (mgr.14140) 241 : audit [DBG] from='client.14514 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "realm_name": "r", "zone_name": "z", "placement": "1", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:45:44.333 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:44 gibba015 bash[9806]: cephadm 2021-03-10T13:45:43.981438+0000 mgr.y (mgr.14140) 242 : cephadm [INF] Saving service rgw.r.z spec with placement count:1 2021-03-10T13:45:44.333 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:44 gibba015 bash[9806]: audit 2021-03-10T13:45:43.981715+0000 mon.a (mon.0) 557 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.rgw.r.z","val":"{\"created\": \"2021-03-10T13:45:43.981445\", \"spec\": {\"placement\": {\"count\": 1}, \"rgw_realm\": \"r\", \"rgw_zone\": \"z\", \"service_id\": \"r.z\", \"service_type\": \"rgw\"}}"}]: dispatch 2021-03-10T13:45:44.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:44 gibba015 bash[9806]: audit 2021-03-10T13:45:43.985235+0000 mon.a (mon.0) 558 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.rgw.r.z","val":"{\"created\": \"2021-03-10T13:45:43.981445\", \"spec\": {\"placement\": {\"count\": 1}, \"rgw_realm\": \"r\", \"rgw_zone\": \"z\", \"service_id\": \"r.z\", \"service_type\": \"rgw\"}}"}]': finished 2021-03-10T13:45:44.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:44 gibba015 bash[9806]: audit 2021-03-10T13:45:43.987232+0000 mon.a (mon.0) 559 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_zone", "value": "z"}]: dispatch 2021-03-10T13:45:44.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:44 gibba015 bash[9806]: audit 2021-03-10T13:45:43.993388+0000 mon.a (mon.0) 560 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_zone", "value": "z"}]': finished 2021-03-10T13:45:44.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:44 gibba015 bash[9806]: audit 2021-03-10T13:45:43.994390+0000 mon.a (mon.0) 561 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r", "name": "rgw_realm", "value": "r"}]: dispatch 2021-03-10T13:45:44.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:44 gibba015 bash[9806]: audit 2021-03-10T13:45:43.997450+0000 mon.a (mon.0) 562 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r", "name": "rgw_realm", "value": "r"}]': finished 2021-03-10T13:45:44.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:44 gibba015 bash[9806]: audit 2021-03-10T13:45:43.998345+0000 mon.a (mon.0) 563 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_frontends", "value": "beast port=80"}]: dispatch 2021-03-10T13:45:44.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:44 gibba015 bash[9806]: audit 2021-03-10T13:45:44.000947+0000 mon.a (mon.0) 564 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_frontends", "value": "beast port=80"}]': finished 2021-03-10T13:45:44.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:44 gibba015 bash[9806]: audit 2021-03-10T13:45:44.001506+0000 mon.a (mon.0) 565 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.gibba045.atotkw", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]: dispatch 2021-03-10T13:45:44.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:44 gibba015 bash[9806]: audit 2021-03-10T13:45:44.003987+0000 mon.a (mon.0) 566 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.gibba045.atotkw", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]': finished 2021-03-10T13:45:44.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:44 gibba015 bash[9806]: audit 2021-03-10T13:45:44.004822+0000 mon.a (mon.0) 567 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:45:44.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:44 gibba015 bash[9806]: cephadm 2021-03-10T13:45:44.005188+0000 mgr.y (mgr.14140) 243 : cephadm [INF] Deploying daemon rgw.r.z.gibba045.atotkw on gibba045 2021-03-10T13:45:44.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:44 gibba015 bash[9806]: audit 2021-03-10T13:45:44.005406+0000 mon.a (mon.0) 568 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.rgw.r.z.gibba045.atotkw", "key": "container_image"}]: dispatch 2021-03-10T13:45:44.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:44 gibba015 bash[13005]: cluster 2021-03-10T13:45:43.186188+0000 mgr.y (mgr.14140) 240 : cluster [DBG] pgmap v237: 129 pgs: 4 creating+peering, 125 active+clean; 4.6 KiB data, 4.8 MiB used, 664 GiB / 672 GiB avail; 688 B/s rd, 3.4 KiB/s wr, 13 op/s 2021-03-10T13:45:44.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:44 gibba015 bash[13005]: audit 2021-03-10T13:45:43.981049+0000 mgr.y (mgr.14140) 241 : audit [DBG] from='client.14514 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "realm_name": "r", "zone_name": "z", "placement": "1", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:45:44.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:44 gibba015 bash[13005]: cephadm 2021-03-10T13:45:43.981438+0000 mgr.y (mgr.14140) 242 : cephadm [INF] Saving service rgw.r.z spec with placement count:1 2021-03-10T13:45:44.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:44 gibba015 bash[13005]: audit 2021-03-10T13:45:43.981715+0000 mon.a (mon.0) 557 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.rgw.r.z","val":"{\"created\": \"2021-03-10T13:45:43.981445\", \"spec\": {\"placement\": {\"count\": 1}, \"rgw_realm\": \"r\", \"rgw_zone\": \"z\", \"service_id\": \"r.z\", \"service_type\": \"rgw\"}}"}]: dispatch 2021-03-10T13:45:44.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:44 gibba015 bash[13005]: audit 2021-03-10T13:45:43.985235+0000 mon.a (mon.0) 558 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.rgw.r.z","val":"{\"created\": \"2021-03-10T13:45:43.981445\", \"spec\": {\"placement\": {\"count\": 1}, \"rgw_realm\": \"r\", \"rgw_zone\": \"z\", \"service_id\": \"r.z\", \"service_type\": \"rgw\"}}"}]': finished 2021-03-10T13:45:44.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:44 gibba015 bash[13005]: audit 2021-03-10T13:45:43.987232+0000 mon.a (mon.0) 559 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_zone", "value": "z"}]: dispatch 2021-03-10T13:45:44.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:44 gibba015 bash[13005]: audit 2021-03-10T13:45:43.993388+0000 mon.a (mon.0) 560 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_zone", "value": "z"}]': finished 2021-03-10T13:45:44.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:44 gibba015 bash[13005]: audit 2021-03-10T13:45:43.994390+0000 mon.a (mon.0) 561 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r", "name": "rgw_realm", "value": "r"}]: dispatch 2021-03-10T13:45:44.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:44 gibba015 bash[13005]: audit 2021-03-10T13:45:43.997450+0000 mon.a (mon.0) 562 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r", "name": "rgw_realm", "value": "r"}]': finished 2021-03-10T13:45:44.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:44 gibba015 bash[13005]: audit 2021-03-10T13:45:43.998345+0000 mon.a (mon.0) 563 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_frontends", "value": "beast port=80"}]: dispatch 2021-03-10T13:45:44.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:44 gibba015 bash[13005]: audit 2021-03-10T13:45:44.000947+0000 mon.a (mon.0) 564 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_frontends", "value": "beast port=80"}]': finished 2021-03-10T13:45:44.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:44 gibba015 bash[13005]: audit 2021-03-10T13:45:44.001506+0000 mon.a (mon.0) 565 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.gibba045.atotkw", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]: dispatch 2021-03-10T13:45:44.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:44 gibba015 bash[13005]: audit 2021-03-10T13:45:44.003987+0000 mon.a (mon.0) 566 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.gibba045.atotkw", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]': finished 2021-03-10T13:45:44.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:44 gibba015 bash[13005]: audit 2021-03-10T13:45:44.004822+0000 mon.a (mon.0) 567 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:45:44.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:44 gibba015 bash[13005]: cephadm 2021-03-10T13:45:44.005188+0000 mgr.y (mgr.14140) 243 : cephadm [INF] Deploying daemon rgw.r.z.gibba045.atotkw on gibba045 2021-03-10T13:45:44.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:44 gibba015 bash[13005]: audit 2021-03-10T13:45:44.005406+0000 mon.a (mon.0) 568 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.rgw.r.z.gibba045.atotkw", "key": "container_image"}]: dispatch 2021-03-10T13:45:44.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:44 gibba045 bash[9787]: cluster 2021-03-10T13:45:43.186188+0000 mgr.y (mgr.14140) 240 : cluster [DBG] pgmap v237: 129 pgs: 4 creating+peering, 125 active+clean; 4.6 KiB data, 4.8 MiB used, 664 GiB / 672 GiB avail; 688 B/s rd, 3.4 KiB/s wr, 13 op/s 2021-03-10T13:45:44.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:44 gibba045 bash[9787]: audit 2021-03-10T13:45:43.981049+0000 mgr.y (mgr.14140) 241 : audit [DBG] from='client.14514 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "realm_name": "r", "zone_name": "z", "placement": "1", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:45:44.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:44 gibba045 bash[9787]: cephadm 2021-03-10T13:45:43.981438+0000 mgr.y (mgr.14140) 242 : cephadm [INF] Saving service rgw.r.z spec with placement count:1 2021-03-10T13:45:44.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:44 gibba045 bash[9787]: audit 2021-03-10T13:45:43.981715+0000 mon.a (mon.0) 557 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.rgw.r.z","val":"{\"created\": \"2021-03-10T13:45:43.981445\", \"spec\": {\"placement\": {\"count\": 1}, \"rgw_realm\": \"r\", \"rgw_zone\": \"z\", \"service_id\": \"r.z\", \"service_type\": \"rgw\"}}"}]: dispatch 2021-03-10T13:45:44.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:44 gibba045 bash[9787]: audit 2021-03-10T13:45:43.985235+0000 mon.a (mon.0) 558 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.rgw.r.z","val":"{\"created\": \"2021-03-10T13:45:43.981445\", \"spec\": {\"placement\": {\"count\": 1}, \"rgw_realm\": \"r\", \"rgw_zone\": \"z\", \"service_id\": \"r.z\", \"service_type\": \"rgw\"}}"}]': finished 2021-03-10T13:45:44.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:44 gibba045 bash[9787]: audit 2021-03-10T13:45:43.987232+0000 mon.a (mon.0) 559 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_zone", "value": "z"}]: dispatch 2021-03-10T13:45:44.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:44 gibba045 bash[9787]: audit 2021-03-10T13:45:43.993388+0000 mon.a (mon.0) 560 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_zone", "value": "z"}]': finished 2021-03-10T13:45:44.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:44 gibba045 bash[9787]: audit 2021-03-10T13:45:43.994390+0000 mon.a (mon.0) 561 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r", "name": "rgw_realm", "value": "r"}]: dispatch 2021-03-10T13:45:44.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:44 gibba045 bash[9787]: audit 2021-03-10T13:45:43.997450+0000 mon.a (mon.0) 562 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r", "name": "rgw_realm", "value": "r"}]': finished 2021-03-10T13:45:44.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:44 gibba045 bash[9787]: audit 2021-03-10T13:45:43.998345+0000 mon.a (mon.0) 563 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_frontends", "value": "beast port=80"}]: dispatch 2021-03-10T13:45:44.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:44 gibba045 bash[9787]: audit 2021-03-10T13:45:44.000947+0000 mon.a (mon.0) 564 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_frontends", "value": "beast port=80"}]': finished 2021-03-10T13:45:44.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:44 gibba045 bash[9787]: audit 2021-03-10T13:45:44.001506+0000 mon.a (mon.0) 565 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.gibba045.atotkw", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]: dispatch 2021-03-10T13:45:44.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:44 gibba045 bash[9787]: audit 2021-03-10T13:45:44.003987+0000 mon.a (mon.0) 566 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.gibba045.atotkw", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]': finished 2021-03-10T13:45:44.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:44 gibba045 bash[9787]: audit 2021-03-10T13:45:44.004822+0000 mon.a (mon.0) 567 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:45:44.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:44 gibba045 bash[9787]: cephadm 2021-03-10T13:45:44.005188+0000 mgr.y (mgr.14140) 243 : cephadm [INF] Deploying daemon rgw.r.z.gibba045.atotkw on gibba045 2021-03-10T13:45:44.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:44 gibba045 bash[9787]: audit 2021-03-10T13:45:44.005406+0000 mon.a (mon.0) 568 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.rgw.r.z.gibba045.atotkw", "key": "container_image"}]: dispatch 2021-03-10T13:45:44.619 DEBUG:teuthology.orchestra.run.gibba015:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e4a642d2-81a5-11eb-9080-001a4aab830c -e sha1=b26fc080937a021ce826cdc94d1adb52c064381a -- bash -c 'sleep 120' 2021-03-10T13:45:46.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:46 gibba015 bash[9806]: cluster 2021-03-10T13:45:45.187714+0000 mgr.y (mgr.14140) 244 : cluster [DBG] pgmap v238: 129 pgs: 129 active+clean; 6.9 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.0 KiB/s rd, 5.6 KiB/s wr, 21 op/s 2021-03-10T13:45:46.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:46 gibba015 bash[13005]: cluster 2021-03-10T13:45:45.187714+0000 mgr.y (mgr.14140) 244 : cluster [DBG] pgmap v238: 129 pgs: 129 active+clean; 6.9 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.0 KiB/s rd, 5.6 KiB/s wr, 21 op/s 2021-03-10T13:45:46.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:46 gibba015 bash[9806]: audit 2021-03-10T13:45:45.939659+0000 mon.a (mon.0) 569 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.420119\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.420388\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.420557\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.420716\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.420867\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.421015\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.421206\", \"created\": \"2021-03-10T13:43:22.897564\", \"started\": \"2021-03-10T13:43:26.167781\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"container_id\": \"b3907fa26ba0\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.421355\", \"created\": \"2021-03-10T13:43:42.821564\", \"started\": \"2021-03-10T13:44:24.396576\"}, \"node-exporter.b\": {\"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.421503\", \"created\": \"2021-03-10T13:43:43.861564\", \"started\": \"2021-03-10T13:43:45.351099\"}, \"grafana.a\": {\"hostname\": \"gibba045\", \"container_id\": \"d86cab6511db\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.421652\", \"created\": \"2021-03-10T13:44:08.721564\", \"started\": \"2021-03-10T13:44:08.746042\"}, \"rgw.r.z.gibba045.atotkw\": {\"hostname\": \"gibba045\", \"daemon_id\": \"r.z.gibba045.atotkw\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:44:17.558720\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818\"}, \"rgw.r.z.gibba045.atotkw\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:44.004644\"}}, \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:45:46.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:46 gibba015 bash[9806]: audit 2021-03-10T13:45:45.948774+0000 mon.a (mon.0) 570 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.420119\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.420388\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.420557\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.420716\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.420867\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.421015\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.421206\", \"created\": \"2021-03-10T13:43:22.897564\", \"started\": \"2021-03-10T13:43:26.167781\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"container_id\": \"b3907fa26ba0\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.421355\", \"created\": \"2021-03-10T13:43:42.821564\", \"started\": \"2021-03-10T13:44:24.396576\"}, \"node-exporter.b\": {\"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.421503\", \"created\": \"2021-03-10T13:43:43.861564\", \"started\": \"2021-03-10T13:43:45.351099\"}, \"grafana.a\": {\"hostname\": \"gibba045\", \"container_id\": \"d86cab6511db\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.421652\", \"created\": \"2021-03-10T13:44:08.721564\", \"started\": \"2021-03-10T13:44:08.746042\"}, \"rgw.r.z.gibba045.atotkw\": {\"hostname\": \"gibba045\", \"daemon_id\": \"r.z.gibba045.atotkw\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:44:17.558720\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818\"}, \"rgw.r.z.gibba045.atotkw\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:44.004644\"}}, \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:45:46.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:46 gibba015 bash[9806]: audit 2021-03-10T13:45:45.950483+0000 mon.a (mon.0) 571 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:45:46.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:46 gibba015 bash[13005]: audit 2021-03-10T13:45:45.939659+0000 mon.a (mon.0) 569 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.420119\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.420388\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.420557\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.420716\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.420867\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.421015\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.421206\", \"created\": \"2021-03-10T13:43:22.897564\", \"started\": \"2021-03-10T13:43:26.167781\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"container_id\": \"b3907fa26ba0\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.421355\", \"created\": \"2021-03-10T13:43:42.821564\", \"started\": \"2021-03-10T13:44:24.396576\"}, \"node-exporter.b\": {\"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.421503\", \"created\": \"2021-03-10T13:43:43.861564\", \"started\": \"2021-03-10T13:43:45.351099\"}, \"grafana.a\": {\"hostname\": \"gibba045\", \"container_id\": \"d86cab6511db\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.421652\", \"created\": \"2021-03-10T13:44:08.721564\", \"started\": \"2021-03-10T13:44:08.746042\"}, \"rgw.r.z.gibba045.atotkw\": {\"hostname\": \"gibba045\", \"daemon_id\": \"r.z.gibba045.atotkw\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:44:17.558720\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818\"}, \"rgw.r.z.gibba045.atotkw\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:44.004644\"}}, \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:45:46.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:46 gibba015 bash[13005]: audit 2021-03-10T13:45:45.948774+0000 mon.a (mon.0) 570 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.420119\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.420388\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.420557\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.420716\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.420867\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.421015\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.421206\", \"created\": \"2021-03-10T13:43:22.897564\", \"started\": \"2021-03-10T13:43:26.167781\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"container_id\": \"b3907fa26ba0\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.421355\", \"created\": \"2021-03-10T13:43:42.821564\", \"started\": \"2021-03-10T13:44:24.396576\"}, \"node-exporter.b\": {\"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.421503\", \"created\": \"2021-03-10T13:43:43.861564\", \"started\": \"2021-03-10T13:43:45.351099\"}, \"grafana.a\": {\"hostname\": \"gibba045\", \"container_id\": \"d86cab6511db\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.421652\", \"created\": \"2021-03-10T13:44:08.721564\", \"started\": \"2021-03-10T13:44:08.746042\"}, \"rgw.r.z.gibba045.atotkw\": {\"hostname\": \"gibba045\", \"daemon_id\": \"r.z.gibba045.atotkw\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:44:17.558720\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818\"}, \"rgw.r.z.gibba045.atotkw\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:44.004644\"}}, \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:45:46.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:46 gibba015 bash[13005]: audit 2021-03-10T13:45:45.950483+0000 mon.a (mon.0) 571 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:45:46.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:46 gibba045 bash[9787]: cluster 2021-03-10T13:45:45.187714+0000 mgr.y (mgr.14140) 244 : cluster [DBG] pgmap v238: 129 pgs: 129 active+clean; 6.9 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.0 KiB/s rd, 5.6 KiB/s wr, 21 op/s 2021-03-10T13:45:46.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:46 gibba045 bash[9787]: audit 2021-03-10T13:45:45.939659+0000 mon.a (mon.0) 569 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.420119\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.420388\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.420557\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.420716\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.420867\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.421015\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.421206\", \"created\": \"2021-03-10T13:43:22.897564\", \"started\": \"2021-03-10T13:43:26.167781\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"container_id\": \"b3907fa26ba0\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.421355\", \"created\": \"2021-03-10T13:43:42.821564\", \"started\": \"2021-03-10T13:44:24.396576\"}, \"node-exporter.b\": {\"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.421503\", \"created\": \"2021-03-10T13:43:43.861564\", \"started\": \"2021-03-10T13:43:45.351099\"}, \"grafana.a\": {\"hostname\": \"gibba045\", \"container_id\": \"d86cab6511db\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.421652\", \"created\": \"2021-03-10T13:44:08.721564\", \"started\": \"2021-03-10T13:44:08.746042\"}, \"rgw.r.z.gibba045.atotkw\": {\"hostname\": \"gibba045\", \"daemon_id\": \"r.z.gibba045.atotkw\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:44:17.558720\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818\"}, \"rgw.r.z.gibba045.atotkw\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:44.004644\"}}, \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:45:46.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:46 gibba045 bash[9787]: audit 2021-03-10T13:45:45.948774+0000 mon.a (mon.0) 570 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.420119\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.420388\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.420557\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.420716\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.420867\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.421015\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.421206\", \"created\": \"2021-03-10T13:43:22.897564\", \"started\": \"2021-03-10T13:43:26.167781\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"container_id\": \"b3907fa26ba0\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.421355\", \"created\": \"2021-03-10T13:43:42.821564\", \"started\": \"2021-03-10T13:44:24.396576\"}, \"node-exporter.b\": {\"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.421503\", \"created\": \"2021-03-10T13:43:43.861564\", \"started\": \"2021-03-10T13:43:45.351099\"}, \"grafana.a\": {\"hostname\": \"gibba045\", \"container_id\": \"d86cab6511db\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:26.421652\", \"created\": \"2021-03-10T13:44:08.721564\", \"started\": \"2021-03-10T13:44:08.746042\"}, \"rgw.r.z.gibba045.atotkw\": {\"hostname\": \"gibba045\", \"daemon_id\": \"r.z.gibba045.atotkw\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:44:17.558720\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818\"}, \"rgw.r.z.gibba045.atotkw\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:44.004644\"}}, \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:45:46.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:46 gibba045 bash[9787]: audit 2021-03-10T13:45:45.950483+0000 mon.a (mon.0) 571 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:45:47.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:47 gibba015 bash[9806]: audit 2021-03-10T13:45:46.910280+0000 mon.a (mon.0) 572 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.904712\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.904982\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.905216\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.905381\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.905535\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.905720\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.905932\", \"created\": \"2021-03-10T13:43:22.897564\", \"started\": \"2021-03-10T13:43:26.167781\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"container_id\": \"b3907fa26ba0\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.906092\", \"created\": \"2021-03-10T13:43:42.821564\", \"started\": \"2021-03-10T13:44:24.396576\"}, \"node-exporter.b\": {\"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.906245\", \"created\": \"2021-03-10T13:43:43.861564\", \"started\": \"2021-03-10T13:43:45.351099\"}, \"grafana.a\": {\"hostname\": \"gibba045\", \"container_id\": \"d86cab6511db\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.906397\", \"created\": \"2021-03-10T13:44:08.721564\", \"started\": \"2021-03-10T13:44:08.746042\"}, \"rgw.r.z.gibba045.atotkw\": {\"hostname\": \"gibba045\", \"container_id\": \"31a06a43ffb1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba045.atotkw\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.906548\", \"created\": \"2021-03-10T13:45:45.925564\", \"started\": \"2021-03-10T13:45:45.949462\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:44:17.558720\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818\"}, \"rgw.r.z.gibba045.atotkw\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:44.004644\"}}, \"last_daemon_update\": \"2021-03-10T13:45:46.906961\", \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:45:47.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:47 gibba015 bash[9806]: audit 2021-03-10T13:45:46.919274+0000 mon.a (mon.0) 573 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.904712\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.904982\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.905216\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.905381\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.905535\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.905720\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.905932\", \"created\": \"2021-03-10T13:43:22.897564\", \"started\": \"2021-03-10T13:43:26.167781\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"container_id\": \"b3907fa26ba0\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.906092\", \"created\": \"2021-03-10T13:43:42.821564\", \"started\": \"2021-03-10T13:44:24.396576\"}, \"node-exporter.b\": {\"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.906245\", \"created\": \"2021-03-10T13:43:43.861564\", \"started\": \"2021-03-10T13:43:45.351099\"}, \"grafana.a\": {\"hostname\": \"gibba045\", \"container_id\": \"d86cab6511db\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.906397\", \"created\": \"2021-03-10T13:44:08.721564\", \"started\": \"2021-03-10T13:44:08.746042\"}, \"rgw.r.z.gibba045.atotkw\": {\"hostname\": \"gibba045\", \"container_id\": \"31a06a43ffb1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba045.atotkw\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.906548\", \"created\": \"2021-03-10T13:45:45.925564\", \"started\": \"2021-03-10T13:45:45.949462\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:44:17.558720\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818\"}, \"rgw.r.z.gibba045.atotkw\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:44.004644\"}}, \"last_daemon_update\": \"2021-03-10T13:45:46.906961\", \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:45:47.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:47 gibba015 bash[13005]: audit 2021-03-10T13:45:46.910280+0000 mon.a (mon.0) 572 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.904712\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.904982\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.905216\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.905381\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.905535\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.905720\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.905932\", \"created\": \"2021-03-10T13:43:22.897564\", \"started\": \"2021-03-10T13:43:26.167781\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"container_id\": \"b3907fa26ba0\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.906092\", \"created\": \"2021-03-10T13:43:42.821564\", \"started\": \"2021-03-10T13:44:24.396576\"}, \"node-exporter.b\": {\"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.906245\", \"created\": \"2021-03-10T13:43:43.861564\", \"started\": \"2021-03-10T13:43:45.351099\"}, \"grafana.a\": {\"hostname\": \"gibba045\", \"container_id\": \"d86cab6511db\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.906397\", \"created\": \"2021-03-10T13:44:08.721564\", \"started\": \"2021-03-10T13:44:08.746042\"}, \"rgw.r.z.gibba045.atotkw\": {\"hostname\": \"gibba045\", \"container_id\": \"31a06a43ffb1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba045.atotkw\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.906548\", \"created\": \"2021-03-10T13:45:45.925564\", \"started\": \"2021-03-10T13:45:45.949462\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:44:17.558720\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818\"}, \"rgw.r.z.gibba045.atotkw\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:44.004644\"}}, \"last_daemon_update\": \"2021-03-10T13:45:46.906961\", \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:45:47.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:47 gibba015 bash[13005]: audit 2021-03-10T13:45:46.919274+0000 mon.a (mon.0) 573 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.904712\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.904982\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.905216\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.905381\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.905535\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.905720\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.905932\", \"created\": \"2021-03-10T13:43:22.897564\", \"started\": \"2021-03-10T13:43:26.167781\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"container_id\": \"b3907fa26ba0\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.906092\", \"created\": \"2021-03-10T13:43:42.821564\", \"started\": \"2021-03-10T13:44:24.396576\"}, \"node-exporter.b\": {\"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.906245\", \"created\": \"2021-03-10T13:43:43.861564\", \"started\": \"2021-03-10T13:43:45.351099\"}, \"grafana.a\": {\"hostname\": \"gibba045\", \"container_id\": \"d86cab6511db\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.906397\", \"created\": \"2021-03-10T13:44:08.721564\", \"started\": \"2021-03-10T13:44:08.746042\"}, \"rgw.r.z.gibba045.atotkw\": {\"hostname\": \"gibba045\", \"container_id\": \"31a06a43ffb1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba045.atotkw\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.906548\", \"created\": \"2021-03-10T13:45:45.925564\", \"started\": \"2021-03-10T13:45:45.949462\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:44:17.558720\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818\"}, \"rgw.r.z.gibba045.atotkw\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:44.004644\"}}, \"last_daemon_update\": \"2021-03-10T13:45:46.906961\", \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:45:47.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:47 gibba045 bash[9787]: audit 2021-03-10T13:45:46.910280+0000 mon.a (mon.0) 572 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.904712\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.904982\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.905216\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.905381\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.905535\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.905720\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.905932\", \"created\": \"2021-03-10T13:43:22.897564\", \"started\": \"2021-03-10T13:43:26.167781\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"container_id\": \"b3907fa26ba0\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.906092\", \"created\": \"2021-03-10T13:43:42.821564\", \"started\": \"2021-03-10T13:44:24.396576\"}, \"node-exporter.b\": {\"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.906245\", \"created\": \"2021-03-10T13:43:43.861564\", \"started\": \"2021-03-10T13:43:45.351099\"}, \"grafana.a\": {\"hostname\": \"gibba045\", \"container_id\": \"d86cab6511db\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.906397\", \"created\": \"2021-03-10T13:44:08.721564\", \"started\": \"2021-03-10T13:44:08.746042\"}, \"rgw.r.z.gibba045.atotkw\": {\"hostname\": \"gibba045\", \"container_id\": \"31a06a43ffb1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba045.atotkw\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.906548\", \"created\": \"2021-03-10T13:45:45.925564\", \"started\": \"2021-03-10T13:45:45.949462\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:44:17.558720\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818\"}, \"rgw.r.z.gibba045.atotkw\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:44.004644\"}}, \"last_daemon_update\": \"2021-03-10T13:45:46.906961\", \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:45:47.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:47 gibba045 bash[9787]: audit 2021-03-10T13:45:46.919274+0000 mon.a (mon.0) 573 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.904712\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"28c4b572e5d6\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.904982\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:40:32.040327\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.905216\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.905381\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.905535\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.905720\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.905932\", \"created\": \"2021-03-10T13:43:22.897564\", \"started\": \"2021-03-10T13:43:26.167781\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"container_id\": \"b3907fa26ba0\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.906092\", \"created\": \"2021-03-10T13:43:42.821564\", \"started\": \"2021-03-10T13:44:24.396576\"}, \"node-exporter.b\": {\"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.906245\", \"created\": \"2021-03-10T13:43:43.861564\", \"started\": \"2021-03-10T13:43:45.351099\"}, \"grafana.a\": {\"hostname\": \"gibba045\", \"container_id\": \"d86cab6511db\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.906397\", \"created\": \"2021-03-10T13:44:08.721564\", \"started\": \"2021-03-10T13:44:08.746042\"}, \"rgw.r.z.gibba045.atotkw\": {\"hostname\": \"gibba045\", \"container_id\": \"31a06a43ffb1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba045.atotkw\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.906548\", \"created\": \"2021-03-10T13:45:45.925564\", \"started\": \"2021-03-10T13:45:45.949462\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:29.825698\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:44:17.558720\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818\"}, \"rgw.r.z.gibba045.atotkw\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:44.004644\"}}, \"last_daemon_update\": \"2021-03-10T13:45:46.906961\", \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:45:48.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:48 gibba045 bash[9787]: cluster 2021-03-10T13:45:47.188964+0000 mgr.y (mgr.14140) 245 : cluster [DBG] pgmap v239: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 5.0 KiB/s wr, 20 op/s 2021-03-10T13:45:48.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:48 gibba015 bash[9806]: cluster 2021-03-10T13:45:47.188964+0000 mgr.y (mgr.14140) 245 : cluster [DBG] pgmap v239: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 5.0 KiB/s wr, 20 op/s 2021-03-10T13:45:48.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:48 gibba015 bash[13005]: cluster 2021-03-10T13:45:47.188964+0000 mgr.y (mgr.14140) 245 : cluster [DBG] pgmap v239: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 5.0 KiB/s wr, 20 op/s 2021-03-10T13:45:50.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:50 gibba015 bash[9806]: cluster 2021-03-10T13:45:49.189704+0000 mgr.y (mgr.14140) 246 : cluster [DBG] pgmap v240: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.1 KiB/s rd, 4.0 KiB/s wr, 18 op/s 2021-03-10T13:45:50.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:50 gibba015 bash[13005]: cluster 2021-03-10T13:45:49.189704+0000 mgr.y (mgr.14140) 246 : cluster [DBG] pgmap v240: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.1 KiB/s rd, 4.0 KiB/s wr, 18 op/s 2021-03-10T13:45:50.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:50 gibba045 bash[9787]: cluster 2021-03-10T13:45:49.189704+0000 mgr.y (mgr.14140) 246 : cluster [DBG] pgmap v240: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.1 KiB/s rd, 4.0 KiB/s wr, 18 op/s 2021-03-10T13:45:52.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:52 gibba015 bash[9806]: cluster 2021-03-10T13:45:51.190689+0000 mgr.y (mgr.14140) 247 : cluster [DBG] pgmap v241: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.1 KiB/s rd, 3.7 KiB/s wr, 17 op/s 2021-03-10T13:45:52.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:52 gibba015 bash[13005]: cluster 2021-03-10T13:45:51.190689+0000 mgr.y (mgr.14140) 247 : cluster [DBG] pgmap v241: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.1 KiB/s rd, 3.7 KiB/s wr, 17 op/s 2021-03-10T13:45:52.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:52 gibba045 bash[9787]: cluster 2021-03-10T13:45:51.190689+0000 mgr.y (mgr.14140) 247 : cluster [DBG] pgmap v241: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.1 KiB/s rd, 3.7 KiB/s wr, 17 op/s 2021-03-10T13:45:54.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:54 gibba015 bash[9806]: cluster 2021-03-10T13:45:53.192110+0000 mgr.y (mgr.14140) 248 : cluster [DBG] pgmap v242: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.3 KiB/s rd, 3.3 KiB/s wr, 16 op/s 2021-03-10T13:45:54.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:54 gibba015 bash[13005]: cluster 2021-03-10T13:45:53.192110+0000 mgr.y (mgr.14140) 248 : cluster [DBG] pgmap v242: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.3 KiB/s rd, 3.3 KiB/s wr, 16 op/s 2021-03-10T13:45:54.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:54 gibba045 bash[9787]: cluster 2021-03-10T13:45:53.192110+0000 mgr.y (mgr.14140) 248 : cluster [DBG] pgmap v242: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.3 KiB/s rd, 3.3 KiB/s wr, 16 op/s 2021-03-10T13:45:56.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:56 gibba015 bash[9806]: cluster 2021-03-10T13:45:55.193573+0000 mgr.y (mgr.14140) 249 : cluster [DBG] pgmap v243: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2021-03-10T13:45:56.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:56 gibba015 bash[13005]: cluster 2021-03-10T13:45:55.193573+0000 mgr.y (mgr.14140) 249 : cluster [DBG] pgmap v243: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2021-03-10T13:45:56.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:56 gibba045 bash[9787]: cluster 2021-03-10T13:45:55.193573+0000 mgr.y (mgr.14140) 249 : cluster [DBG] pgmap v243: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2021-03-10T13:45:58.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:45:58 gibba015 bash[9806]: cluster 2021-03-10T13:45:57.194748+0000 mgr.y (mgr.14140) 250 : cluster [DBG] pgmap v244: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.7 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T13:45:58.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:45:58 gibba015 bash[13005]: cluster 2021-03-10T13:45:57.194748+0000 mgr.y (mgr.14140) 250 : cluster [DBG] pgmap v244: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.7 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T13:45:58.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:45:58 gibba045 bash[9787]: cluster 2021-03-10T13:45:57.194748+0000 mgr.y (mgr.14140) 250 : cluster [DBG] pgmap v244: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.7 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T13:46:00.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:46:00 gibba015 bash[9806]: cluster 2021-03-10T13:45:59.195573+0000 mgr.y (mgr.14140) 251 : cluster [DBG] pgmap v245: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.5 KiB/s rd, 0 B/s wr, 3 op/s 2021-03-10T13:46:00.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:46:00 gibba015 bash[13005]: cluster 2021-03-10T13:45:59.195573+0000 mgr.y (mgr.14140) 251 : cluster [DBG] pgmap v245: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.5 KiB/s rd, 0 B/s wr, 3 op/s 2021-03-10T13:46:00.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:46:00 gibba045 bash[9787]: cluster 2021-03-10T13:45:59.195573+0000 mgr.y (mgr.14140) 251 : cluster [DBG] pgmap v245: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.5 KiB/s rd, 0 B/s wr, 3 op/s 2021-03-10T13:46:02.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:46:02 gibba045 bash[9787]: cluster 2021-03-10T13:46:01.196673+0000 mgr.y (mgr.14140) 252 : cluster [DBG] pgmap v246: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:46:02.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:46:02 gibba015 bash[9806]: cluster 2021-03-10T13:46:01.196673+0000 mgr.y (mgr.14140) 252 : cluster [DBG] pgmap v246: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:46:02.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:46:02 gibba015 bash[13005]: cluster 2021-03-10T13:46:01.196673+0000 mgr.y (mgr.14140) 252 : cluster [DBG] pgmap v246: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:46:04.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:46:04 gibba045 bash[9787]: cluster 2021-03-10T13:46:03.198234+0000 mgr.y (mgr.14140) 253 : cluster [DBG] pgmap v247: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.6 KiB/s rd, 85 B/s wr, 3 op/s 2021-03-10T13:46:04.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:46:04 gibba015 bash[9806]: cluster 2021-03-10T13:46:03.198234+0000 mgr.y (mgr.14140) 253 : cluster [DBG] pgmap v247: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.6 KiB/s rd, 85 B/s wr, 3 op/s 2021-03-10T13:46:04.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:46:04 gibba015 bash[13005]: cluster 2021-03-10T13:46:03.198234+0000 mgr.y (mgr.14140) 253 : cluster [DBG] pgmap v247: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.6 KiB/s rd, 85 B/s wr, 3 op/s 2021-03-10T13:46:06.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:46:06 gibba045 bash[9787]: cluster 2021-03-10T13:46:05.199486+0000 mgr.y (mgr.14140) 254 : cluster [DBG] pgmap v248: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:46:06.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:46:06 gibba015 bash[9806]: cluster 2021-03-10T13:46:05.199486+0000 mgr.y (mgr.14140) 254 : cluster [DBG] pgmap v248: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:46:06.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:46:06 gibba015 bash[13005]: cluster 2021-03-10T13:46:05.199486+0000 mgr.y (mgr.14140) 254 : cluster [DBG] pgmap v248: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:46:08.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:46:08 gibba015 bash[9806]: cluster 2021-03-10T13:46:07.199898+0000 mgr.y (mgr.14140) 255 : cluster [DBG] pgmap v249: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:46:08.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:46:08 gibba015 bash[13005]: cluster 2021-03-10T13:46:07.199898+0000 mgr.y (mgr.14140) 255 : cluster [DBG] pgmap v249: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:46:08.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:46:08 gibba045 bash[9787]: cluster 2021-03-10T13:46:07.199898+0000 mgr.y (mgr.14140) 255 : cluster [DBG] pgmap v249: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:46:10.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:46:10 gibba045 bash[9787]: cluster 2021-03-10T13:46:09.201138+0000 mgr.y (mgr.14140) 256 : cluster [DBG] pgmap v250: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.5 KiB/s rd, 85 B/s wr, 3 op/s 2021-03-10T13:46:10.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:46:10 gibba015 bash[9806]: cluster 2021-03-10T13:46:09.201138+0000 mgr.y (mgr.14140) 256 : cluster [DBG] pgmap v250: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.5 KiB/s rd, 85 B/s wr, 3 op/s 2021-03-10T13:46:10.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:46:10 gibba015 bash[13005]: cluster 2021-03-10T13:46:09.201138+0000 mgr.y (mgr.14140) 256 : cluster [DBG] pgmap v250: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.5 KiB/s rd, 85 B/s wr, 3 op/s 2021-03-10T13:46:12.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:46:12 gibba045 bash[9787]: cluster 2021-03-10T13:46:11.202438+0000 mgr.y (mgr.14140) 257 : cluster [DBG] pgmap v251: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.2 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:46:12.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:46:12 gibba015 bash[9806]: cluster 2021-03-10T13:46:11.202438+0000 mgr.y (mgr.14140) 257 : cluster [DBG] pgmap v251: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.2 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:46:12.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:46:12 gibba015 bash[13005]: cluster 2021-03-10T13:46:11.202438+0000 mgr.y (mgr.14140) 257 : cluster [DBG] pgmap v251: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.2 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:46:14.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:46:14 gibba045 bash[9787]: cluster 2021-03-10T13:46:13.204120+0000 mgr.y (mgr.14140) 258 : cluster [DBG] pgmap v252: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.6 KiB/s rd, 85 B/s wr, 3 op/s 2021-03-10T13:46:14.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:46:14 gibba015 bash[9806]: cluster 2021-03-10T13:46:13.204120+0000 mgr.y (mgr.14140) 258 : cluster [DBG] pgmap v252: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.6 KiB/s rd, 85 B/s wr, 3 op/s 2021-03-10T13:46:14.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:46:14 gibba015 bash[13005]: cluster 2021-03-10T13:46:13.204120+0000 mgr.y (mgr.14140) 258 : cluster [DBG] pgmap v252: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.6 KiB/s rd, 85 B/s wr, 3 op/s 2021-03-10T13:46:16.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:46:16 gibba045 bash[9787]: cluster 2021-03-10T13:46:15.205436+0000 mgr.y (mgr.14140) 259 : cluster [DBG] pgmap v253: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:46:16.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:46:16 gibba015 bash[9806]: cluster 2021-03-10T13:46:15.205436+0000 mgr.y (mgr.14140) 259 : cluster [DBG] pgmap v253: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:46:16.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:46:16 gibba015 bash[13005]: cluster 2021-03-10T13:46:15.205436+0000 mgr.y (mgr.14140) 259 : cluster [DBG] pgmap v253: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:46:18.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:46:18 gibba015 bash[9806]: cluster 2021-03-10T13:46:17.206558+0000 mgr.y (mgr.14140) 260 : cluster [DBG] pgmap v254: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:46:18.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:46:18 gibba015 bash[13005]: cluster 2021-03-10T13:46:17.206558+0000 mgr.y (mgr.14140) 260 : cluster [DBG] pgmap v254: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:46:18.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:46:18 gibba045 bash[9787]: cluster 2021-03-10T13:46:17.206558+0000 mgr.y (mgr.14140) 260 : cluster [DBG] pgmap v254: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:46:20.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:46:20 gibba045 bash[9787]: cluster 2021-03-10T13:46:19.206987+0000 mgr.y (mgr.14140) 261 : cluster [DBG] pgmap v255: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:46:20.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:46:20 gibba015 bash[9806]: cluster 2021-03-10T13:46:19.206987+0000 mgr.y (mgr.14140) 261 : cluster [DBG] pgmap v255: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:46:20.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:46:20 gibba015 bash[13005]: cluster 2021-03-10T13:46:19.206987+0000 mgr.y (mgr.14140) 261 : cluster [DBG] pgmap v255: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:46:22.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:46:22 gibba045 bash[9787]: cluster 2021-03-10T13:46:21.208202+0000 mgr.y (mgr.14140) 262 : cluster [DBG] pgmap v256: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 767 B/s rd, 0 B/s wr, 1 op/s 2021-03-10T13:46:22.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:46:22 gibba015 bash[9806]: cluster 2021-03-10T13:46:21.208202+0000 mgr.y (mgr.14140) 262 : cluster [DBG] pgmap v256: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 767 B/s rd, 0 B/s wr, 1 op/s 2021-03-10T13:46:22.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:46:22 gibba015 bash[13005]: cluster 2021-03-10T13:46:21.208202+0000 mgr.y (mgr.14140) 262 : cluster [DBG] pgmap v256: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 767 B/s rd, 0 B/s wr, 1 op/s 2021-03-10T13:46:24.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:46:24 gibba045 bash[9787]: cluster 2021-03-10T13:46:23.209743+0000 mgr.y (mgr.14140) 263 : cluster [DBG] pgmap v257: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.9 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:46:24.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:46:24 gibba015 bash[9806]: cluster 2021-03-10T13:46:23.209743+0000 mgr.y (mgr.14140) 263 : cluster [DBG] pgmap v257: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.9 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:46:24.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:46:24 gibba015 bash[13005]: cluster 2021-03-10T13:46:23.209743+0000 mgr.y (mgr.14140) 263 : cluster [DBG] pgmap v257: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.9 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:46:26.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:46:26 gibba045 bash[9787]: cluster 2021-03-10T13:46:25.211307+0000 mgr.y (mgr.14140) 264 : cluster [DBG] pgmap v258: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:46:26.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:46:26 gibba015 bash[9806]: cluster 2021-03-10T13:46:25.211307+0000 mgr.y (mgr.14140) 264 : cluster [DBG] pgmap v258: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:46:26.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:46:26 gibba015 bash[13005]: cluster 2021-03-10T13:46:25.211307+0000 mgr.y (mgr.14140) 264 : cluster [DBG] pgmap v258: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:46:28.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:46:28 gibba045 bash[9787]: cluster 2021-03-10T13:46:27.212428+0000 mgr.y (mgr.14140) 265 : cluster [DBG] pgmap v259: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:46:28.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:46:28 gibba015 bash[9806]: cluster 2021-03-10T13:46:27.212428+0000 mgr.y (mgr.14140) 265 : cluster [DBG] pgmap v259: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:46:28.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:46:28 gibba015 bash[13005]: cluster 2021-03-10T13:46:27.212428+0000 mgr.y (mgr.14140) 265 : cluster [DBG] pgmap v259: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:46:30.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:46:30 gibba045 bash[9787]: cluster 2021-03-10T13:46:29.212981+0000 mgr.y (mgr.14140) 266 : cluster [DBG] pgmap v260: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:46:30.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:46:30 gibba015 bash[9806]: cluster 2021-03-10T13:46:29.212981+0000 mgr.y (mgr.14140) 266 : cluster [DBG] pgmap v260: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:46:30.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:46:30 gibba015 bash[13005]: cluster 2021-03-10T13:46:29.212981+0000 mgr.y (mgr.14140) 266 : cluster [DBG] pgmap v260: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:46:32.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:46:32 gibba045 bash[9787]: cluster 2021-03-10T13:46:31.213902+0000 mgr.y (mgr.14140) 267 : cluster [DBG] pgmap v261: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:46:32.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:46:32 gibba015 bash[9806]: cluster 2021-03-10T13:46:31.213902+0000 mgr.y (mgr.14140) 267 : cluster [DBG] pgmap v261: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:46:32.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:46:32 gibba015 bash[13005]: cluster 2021-03-10T13:46:31.213902+0000 mgr.y (mgr.14140) 267 : cluster [DBG] pgmap v261: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:46:34.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:46:34 gibba045 bash[9787]: cluster 2021-03-10T13:46:33.215331+0000 mgr.y (mgr.14140) 268 : cluster [DBG] pgmap v262: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.7 KiB/s rd, 85 B/s wr, 3 op/s 2021-03-10T13:46:34.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:46:34 gibba015 bash[9806]: cluster 2021-03-10T13:46:33.215331+0000 mgr.y (mgr.14140) 268 : cluster [DBG] pgmap v262: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.7 KiB/s rd, 85 B/s wr, 3 op/s 2021-03-10T13:46:34.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:46:34 gibba015 bash[13005]: cluster 2021-03-10T13:46:33.215331+0000 mgr.y (mgr.14140) 268 : cluster [DBG] pgmap v262: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.7 KiB/s rd, 85 B/s wr, 3 op/s 2021-03-10T13:46:36.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:46:36 gibba045 bash[9787]: cluster 2021-03-10T13:46:35.216775+0000 mgr.y (mgr.14140) 269 : cluster [DBG] pgmap v263: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.9 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:46:36.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:46:36 gibba015 bash[9806]: cluster 2021-03-10T13:46:35.216775+0000 mgr.y (mgr.14140) 269 : cluster [DBG] pgmap v263: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.9 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:46:36.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:46:36 gibba015 bash[13005]: cluster 2021-03-10T13:46:35.216775+0000 mgr.y (mgr.14140) 269 : cluster [DBG] pgmap v263: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.9 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:46:38.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:46:38 gibba045 bash[9787]: cluster 2021-03-10T13:46:37.217976+0000 mgr.y (mgr.14140) 270 : cluster [DBG] pgmap v264: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:46:38.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:46:38 gibba015 bash[9806]: cluster 2021-03-10T13:46:37.217976+0000 mgr.y (mgr.14140) 270 : cluster [DBG] pgmap v264: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:46:38.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:46:38 gibba015 bash[13005]: cluster 2021-03-10T13:46:37.217976+0000 mgr.y (mgr.14140) 270 : cluster [DBG] pgmap v264: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:46:40.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:46:40 gibba045 bash[9787]: cluster 2021-03-10T13:46:39.218763+0000 mgr.y (mgr.14140) 271 : cluster [DBG] pgmap v265: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:46:40.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:46:40 gibba015 bash[9806]: cluster 2021-03-10T13:46:39.218763+0000 mgr.y (mgr.14140) 271 : cluster [DBG] pgmap v265: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:46:40.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:46:40 gibba015 bash[13005]: cluster 2021-03-10T13:46:39.218763+0000 mgr.y (mgr.14140) 271 : cluster [DBG] pgmap v265: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:46:42.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:46:42 gibba045 bash[9787]: cluster 2021-03-10T13:46:41.219920+0000 mgr.y (mgr.14140) 272 : cluster [DBG] pgmap v266: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:46:42.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:46:42 gibba015 bash[9806]: cluster 2021-03-10T13:46:41.219920+0000 mgr.y (mgr.14140) 272 : cluster [DBG] pgmap v266: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:46:42.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:46:42 gibba015 bash[13005]: cluster 2021-03-10T13:46:41.219920+0000 mgr.y (mgr.14140) 272 : cluster [DBG] pgmap v266: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:46:44.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:46:44 gibba045 bash[9787]: cluster 2021-03-10T13:46:43.221330+0000 mgr.y (mgr.14140) 273 : cluster [DBG] pgmap v267: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:46:44.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:46:44 gibba015 bash[9806]: cluster 2021-03-10T13:46:43.221330+0000 mgr.y (mgr.14140) 273 : cluster [DBG] pgmap v267: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:46:44.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:46:44 gibba015 bash[13005]: cluster 2021-03-10T13:46:43.221330+0000 mgr.y (mgr.14140) 273 : cluster [DBG] pgmap v267: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:46:46.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:46:46 gibba045 bash[9787]: cluster 2021-03-10T13:46:45.222635+0000 mgr.y (mgr.14140) 274 : cluster [DBG] pgmap v268: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1 op/s 2021-03-10T13:46:46.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:46:46 gibba015 bash[9806]: cluster 2021-03-10T13:46:45.222635+0000 mgr.y (mgr.14140) 274 : cluster [DBG] pgmap v268: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1 op/s 2021-03-10T13:46:46.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:46:46 gibba015 bash[13005]: cluster 2021-03-10T13:46:45.222635+0000 mgr.y (mgr.14140) 274 : cluster [DBG] pgmap v268: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1 op/s 2021-03-10T13:46:48.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:46:48 gibba045 bash[9787]: cluster 2021-03-10T13:46:47.223778+0000 mgr.y (mgr.14140) 275 : cluster [DBG] pgmap v269: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.8 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:46:48.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:46:48 gibba015 bash[9806]: cluster 2021-03-10T13:46:47.223778+0000 mgr.y (mgr.14140) 275 : cluster [DBG] pgmap v269: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.8 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:46:48.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:46:48 gibba015 bash[13005]: cluster 2021-03-10T13:46:47.223778+0000 mgr.y (mgr.14140) 275 : cluster [DBG] pgmap v269: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.8 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:46:50.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:46:50 gibba045 bash[9787]: cluster 2021-03-10T13:46:49.224560+0000 mgr.y (mgr.14140) 276 : cluster [DBG] pgmap v270: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:46:50.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:46:50 gibba015 bash[9806]: cluster 2021-03-10T13:46:49.224560+0000 mgr.y (mgr.14140) 276 : cluster [DBG] pgmap v270: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:46:50.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:46:50 gibba015 bash[13005]: cluster 2021-03-10T13:46:49.224560+0000 mgr.y (mgr.14140) 276 : cluster [DBG] pgmap v270: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:46:52.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:46:52 gibba045 bash[9787]: cluster 2021-03-10T13:46:51.225766+0000 mgr.y (mgr.14140) 277 : cluster [DBG] pgmap v271: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:46:52.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:46:52 gibba015 bash[9806]: cluster 2021-03-10T13:46:51.225766+0000 mgr.y (mgr.14140) 277 : cluster [DBG] pgmap v271: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:46:52.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:46:52 gibba015 bash[13005]: cluster 2021-03-10T13:46:51.225766+0000 mgr.y (mgr.14140) 277 : cluster [DBG] pgmap v271: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:46:54.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:46:54 gibba045 bash[9787]: cluster 2021-03-10T13:46:53.227156+0000 mgr.y (mgr.14140) 278 : cluster [DBG] pgmap v272: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:46:54.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:46:54 gibba015 bash[9806]: cluster 2021-03-10T13:46:53.227156+0000 mgr.y (mgr.14140) 278 : cluster [DBG] pgmap v272: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:46:54.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:46:54 gibba015 bash[13005]: cluster 2021-03-10T13:46:53.227156+0000 mgr.y (mgr.14140) 278 : cluster [DBG] pgmap v272: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:46:56.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:46:56 gibba045 bash[9787]: cluster 2021-03-10T13:46:55.228402+0000 mgr.y (mgr.14140) 279 : cluster [DBG] pgmap v273: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.2 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:46:56.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:46:56 gibba015 bash[9806]: cluster 2021-03-10T13:46:55.228402+0000 mgr.y (mgr.14140) 279 : cluster [DBG] pgmap v273: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.2 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:46:56.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:46:56 gibba015 bash[13005]: cluster 2021-03-10T13:46:55.228402+0000 mgr.y (mgr.14140) 279 : cluster [DBG] pgmap v273: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.2 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:46:58.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:46:58 gibba045 bash[9787]: cluster 2021-03-10T13:46:57.229297+0000 mgr.y (mgr.14140) 280 : cluster [DBG] pgmap v274: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.8 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:46:58.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:46:58 gibba015 bash[9806]: cluster 2021-03-10T13:46:57.229297+0000 mgr.y (mgr.14140) 280 : cluster [DBG] pgmap v274: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.8 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:46:58.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:46:58 gibba015 bash[13005]: cluster 2021-03-10T13:46:57.229297+0000 mgr.y (mgr.14140) 280 : cluster [DBG] pgmap v274: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.8 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:47:00.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:47:00 gibba045 bash[9787]: cluster 2021-03-10T13:46:59.229775+0000 mgr.y (mgr.14140) 281 : cluster [DBG] pgmap v275: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:47:00.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:47:00 gibba015 bash[9806]: cluster 2021-03-10T13:46:59.229775+0000 mgr.y (mgr.14140) 281 : cluster [DBG] pgmap v275: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:47:00.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:47:00 gibba015 bash[13005]: cluster 2021-03-10T13:46:59.229775+0000 mgr.y (mgr.14140) 281 : cluster [DBG] pgmap v275: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:47:02.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:47:02 gibba045 bash[9787]: cluster 2021-03-10T13:47:01.230868+0000 mgr.y (mgr.14140) 282 : cluster [DBG] pgmap v276: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:47:02.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:47:02 gibba015 bash[9806]: cluster 2021-03-10T13:47:01.230868+0000 mgr.y (mgr.14140) 282 : cluster [DBG] pgmap v276: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:47:02.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:47:02 gibba015 bash[13005]: cluster 2021-03-10T13:47:01.230868+0000 mgr.y (mgr.14140) 282 : cluster [DBG] pgmap v276: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:47:04.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:47:04 gibba045 bash[9787]: cluster 2021-03-10T13:47:03.231743+0000 mgr.y (mgr.14140) 283 : cluster [DBG] pgmap v277: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:47:04.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:47:04 gibba015 bash[9806]: cluster 2021-03-10T13:47:03.231743+0000 mgr.y (mgr.14140) 283 : cluster [DBG] pgmap v277: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:47:04.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:47:04 gibba015 bash[13005]: cluster 2021-03-10T13:47:03.231743+0000 mgr.y (mgr.14140) 283 : cluster [DBG] pgmap v277: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:47:06.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:47:06 gibba045 bash[9787]: cluster 2021-03-10T13:47:05.232956+0000 mgr.y (mgr.14140) 284 : cluster [DBG] pgmap v278: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:47:06.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:47:06 gibba015 bash[9806]: cluster 2021-03-10T13:47:05.232956+0000 mgr.y (mgr.14140) 284 : cluster [DBG] pgmap v278: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:47:06.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:47:06 gibba015 bash[13005]: cluster 2021-03-10T13:47:05.232956+0000 mgr.y (mgr.14140) 284 : cluster [DBG] pgmap v278: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:47:08.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:47:08 gibba045 bash[9787]: cluster 2021-03-10T13:47:07.234050+0000 mgr.y (mgr.14140) 285 : cluster [DBG] pgmap v279: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.0 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:47:08.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:47:08 gibba015 bash[9806]: cluster 2021-03-10T13:47:07.234050+0000 mgr.y (mgr.14140) 285 : cluster [DBG] pgmap v279: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.0 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:47:08.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:47:08 gibba015 bash[13005]: cluster 2021-03-10T13:47:07.234050+0000 mgr.y (mgr.14140) 285 : cluster [DBG] pgmap v279: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.0 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:47:10.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:47:10 gibba045 bash[9787]: cluster 2021-03-10T13:47:09.234744+0000 mgr.y (mgr.14140) 286 : cluster [DBG] pgmap v280: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.7 KiB/s rd, 85 B/s wr, 3 op/s 2021-03-10T13:47:10.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:47:10 gibba015 bash[9806]: cluster 2021-03-10T13:47:09.234744+0000 mgr.y (mgr.14140) 286 : cluster [DBG] pgmap v280: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.7 KiB/s rd, 85 B/s wr, 3 op/s 2021-03-10T13:47:10.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:47:10 gibba015 bash[13005]: cluster 2021-03-10T13:47:09.234744+0000 mgr.y (mgr.14140) 286 : cluster [DBG] pgmap v280: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.7 KiB/s rd, 85 B/s wr, 3 op/s 2021-03-10T13:47:12.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:47:12 gibba045 bash[9787]: cluster 2021-03-10T13:47:11.235760+0000 mgr.y (mgr.14140) 287 : cluster [DBG] pgmap v281: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:47:12.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:47:12 gibba015 bash[9806]: cluster 2021-03-10T13:47:11.235760+0000 mgr.y (mgr.14140) 287 : cluster [DBG] pgmap v281: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:47:12.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:47:12 gibba015 bash[13005]: cluster 2021-03-10T13:47:11.235760+0000 mgr.y (mgr.14140) 287 : cluster [DBG] pgmap v281: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:47:14.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:47:14 gibba045 bash[9787]: cluster 2021-03-10T13:47:13.237547+0000 mgr.y (mgr.14140) 288 : cluster [DBG] pgmap v282: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:47:14.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:47:14 gibba015 bash[9806]: cluster 2021-03-10T13:47:13.237547+0000 mgr.y (mgr.14140) 288 : cluster [DBG] pgmap v282: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:47:14.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:47:14 gibba015 bash[13005]: cluster 2021-03-10T13:47:13.237547+0000 mgr.y (mgr.14140) 288 : cluster [DBG] pgmap v282: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:47:16.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:47:16 gibba045 bash[9787]: cluster 2021-03-10T13:47:15.238765+0000 mgr.y (mgr.14140) 289 : cluster [DBG] pgmap v283: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:47:16.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:47:16 gibba015 bash[9806]: cluster 2021-03-10T13:47:15.238765+0000 mgr.y (mgr.14140) 289 : cluster [DBG] pgmap v283: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:47:16.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:47:16 gibba015 bash[13005]: cluster 2021-03-10T13:47:15.238765+0000 mgr.y (mgr.14140) 289 : cluster [DBG] pgmap v283: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:47:18.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:47:18 gibba045 bash[9787]: cluster 2021-03-10T13:47:17.239556+0000 mgr.y (mgr.14140) 290 : cluster [DBG] pgmap v284: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.3 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:47:18.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:47:18 gibba015 bash[9806]: cluster 2021-03-10T13:47:17.239556+0000 mgr.y (mgr.14140) 290 : cluster [DBG] pgmap v284: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.3 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:47:18.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:47:18 gibba015 bash[13005]: cluster 2021-03-10T13:47:17.239556+0000 mgr.y (mgr.14140) 290 : cluster [DBG] pgmap v284: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.3 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:47:20.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:47:20 gibba045 bash[9787]: cluster 2021-03-10T13:47:19.240293+0000 mgr.y (mgr.14140) 291 : cluster [DBG] pgmap v285: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:47:20.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:47:20 gibba015 bash[9806]: cluster 2021-03-10T13:47:19.240293+0000 mgr.y (mgr.14140) 291 : cluster [DBG] pgmap v285: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:47:20.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:47:20 gibba015 bash[13005]: cluster 2021-03-10T13:47:19.240293+0000 mgr.y (mgr.14140) 291 : cluster [DBG] pgmap v285: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:47:22.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:47:22 gibba045 bash[9787]: cluster 2021-03-10T13:47:21.241213+0000 mgr.y (mgr.14140) 292 : cluster [DBG] pgmap v286: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 938 B/s rd, 0 B/s wr, 1 op/s 2021-03-10T13:47:22.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:47:22 gibba015 bash[9806]: cluster 2021-03-10T13:47:21.241213+0000 mgr.y (mgr.14140) 292 : cluster [DBG] pgmap v286: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 938 B/s rd, 0 B/s wr, 1 op/s 2021-03-10T13:47:22.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:47:22 gibba015 bash[13005]: cluster 2021-03-10T13:47:21.241213+0000 mgr.y (mgr.14140) 292 : cluster [DBG] pgmap v286: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 938 B/s rd, 0 B/s wr, 1 op/s 2021-03-10T13:47:24.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:47:24 gibba045 bash[9787]: cluster 2021-03-10T13:47:23.242397+0000 mgr.y (mgr.14140) 293 : cluster [DBG] pgmap v287: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 852 B/s rd, 0 B/s wr, 1 op/s 2021-03-10T13:47:24.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:47:24 gibba015 bash[9806]: cluster 2021-03-10T13:47:23.242397+0000 mgr.y (mgr.14140) 293 : cluster [DBG] pgmap v287: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 852 B/s rd, 0 B/s wr, 1 op/s 2021-03-10T13:47:24.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:47:24 gibba015 bash[13005]: cluster 2021-03-10T13:47:23.242397+0000 mgr.y (mgr.14140) 293 : cluster [DBG] pgmap v287: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 852 B/s rd, 0 B/s wr, 1 op/s 2021-03-10T13:47:26.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:47:26 gibba045 bash[9787]: cluster 2021-03-10T13:47:25.243706+0000 mgr.y (mgr.14140) 294 : cluster [DBG] pgmap v288: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 852 B/s rd, 0 B/s wr, 1 op/s 2021-03-10T13:47:26.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:47:26 gibba015 bash[9806]: cluster 2021-03-10T13:47:25.243706+0000 mgr.y (mgr.14140) 294 : cluster [DBG] pgmap v288: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 852 B/s rd, 0 B/s wr, 1 op/s 2021-03-10T13:47:26.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:47:26 gibba015 bash[13005]: cluster 2021-03-10T13:47:25.243706+0000 mgr.y (mgr.14140) 294 : cluster [DBG] pgmap v288: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 852 B/s rd, 0 B/s wr, 1 op/s 2021-03-10T13:47:28.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:47:28 gibba045 bash[9787]: cluster 2021-03-10T13:47:27.244259+0000 mgr.y (mgr.14140) 295 : cluster [DBG] pgmap v289: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 852 B/s rd, 0 B/s wr, 1 op/s 2021-03-10T13:47:28.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:47:28 gibba015 bash[9806]: cluster 2021-03-10T13:47:27.244259+0000 mgr.y (mgr.14140) 295 : cluster [DBG] pgmap v289: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 852 B/s rd, 0 B/s wr, 1 op/s 2021-03-10T13:47:28.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:47:28 gibba015 bash[13005]: cluster 2021-03-10T13:47:27.244259+0000 mgr.y (mgr.14140) 295 : cluster [DBG] pgmap v289: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 852 B/s rd, 0 B/s wr, 1 op/s 2021-03-10T13:47:30.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:47:30 gibba045 bash[9787]: cluster 2021-03-10T13:47:29.244981+0000 mgr.y (mgr.14140) 296 : cluster [DBG] pgmap v290: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 597 B/s rd, 0 B/s wr, 1 op/s 2021-03-10T13:47:30.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:47:30 gibba015 bash[9806]: cluster 2021-03-10T13:47:29.244981+0000 mgr.y (mgr.14140) 296 : cluster [DBG] pgmap v290: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 597 B/s rd, 0 B/s wr, 1 op/s 2021-03-10T13:47:30.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:47:30 gibba015 bash[13005]: cluster 2021-03-10T13:47:29.244981+0000 mgr.y (mgr.14140) 296 : cluster [DBG] pgmap v290: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 597 B/s rd, 0 B/s wr, 1 op/s 2021-03-10T13:47:32.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:47:32 gibba045 bash[9787]: cluster 2021-03-10T13:47:31.245471+0000 mgr.y (mgr.14140) 297 : cluster [DBG] pgmap v291: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 170 B/s rd, 0 B/s wr, 0 op/s 2021-03-10T13:47:32.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:47:32 gibba015 bash[9806]: cluster 2021-03-10T13:47:31.245471+0000 mgr.y (mgr.14140) 297 : cluster [DBG] pgmap v291: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 170 B/s rd, 0 B/s wr, 0 op/s 2021-03-10T13:47:32.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:47:32 gibba015 bash[13005]: cluster 2021-03-10T13:47:31.245471+0000 mgr.y (mgr.14140) 297 : cluster [DBG] pgmap v291: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 170 B/s rd, 0 B/s wr, 0 op/s 2021-03-10T13:47:34.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:47:34 gibba045 bash[9787]: cluster 2021-03-10T13:47:33.246244+0000 mgr.y (mgr.14140) 298 : cluster [DBG] pgmap v292: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:34.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:47:34 gibba015 bash[9806]: cluster 2021-03-10T13:47:33.246244+0000 mgr.y (mgr.14140) 298 : cluster [DBG] pgmap v292: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:34.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:47:34 gibba015 bash[13005]: cluster 2021-03-10T13:47:33.246244+0000 mgr.y (mgr.14140) 298 : cluster [DBG] pgmap v292: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:36.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:47:36 gibba045 bash[9787]: cluster 2021-03-10T13:47:35.247698+0000 mgr.y (mgr.14140) 299 : cluster [DBG] pgmap v293: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:36.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:47:36 gibba015 bash[9806]: cluster 2021-03-10T13:47:35.247698+0000 mgr.y (mgr.14140) 299 : cluster [DBG] pgmap v293: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:36.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:47:36 gibba015 bash[13005]: cluster 2021-03-10T13:47:35.247698+0000 mgr.y (mgr.14140) 299 : cluster [DBG] pgmap v293: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:38.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:47:38 gibba045 bash[9787]: cluster 2021-03-10T13:47:37.248361+0000 mgr.y (mgr.14140) 300 : cluster [DBG] pgmap v294: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:38.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:47:38 gibba015 bash[9806]: cluster 2021-03-10T13:47:37.248361+0000 mgr.y (mgr.14140) 300 : cluster [DBG] pgmap v294: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:38.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:47:38 gibba015 bash[13005]: cluster 2021-03-10T13:47:37.248361+0000 mgr.y (mgr.14140) 300 : cluster [DBG] pgmap v294: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:40.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:47:40 gibba045 bash[9787]: cluster 2021-03-10T13:47:39.249164+0000 mgr.y (mgr.14140) 301 : cluster [DBG] pgmap v295: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:40.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:47:40 gibba015 bash[9806]: cluster 2021-03-10T13:47:39.249164+0000 mgr.y (mgr.14140) 301 : cluster [DBG] pgmap v295: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:40.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:47:40 gibba015 bash[13005]: cluster 2021-03-10T13:47:39.249164+0000 mgr.y (mgr.14140) 301 : cluster [DBG] pgmap v295: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:42.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:47:42 gibba045 bash[9787]: cluster 2021-03-10T13:47:41.250166+0000 mgr.y (mgr.14140) 302 : cluster [DBG] pgmap v296: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:42.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:47:42 gibba015 bash[9806]: cluster 2021-03-10T13:47:41.250166+0000 mgr.y (mgr.14140) 302 : cluster [DBG] pgmap v296: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:42.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:47:42 gibba015 bash[13005]: cluster 2021-03-10T13:47:41.250166+0000 mgr.y (mgr.14140) 302 : cluster [DBG] pgmap v296: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:44.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:47:44 gibba045 bash[9787]: cluster 2021-03-10T13:47:43.251576+0000 mgr.y (mgr.14140) 303 : cluster [DBG] pgmap v297: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:44.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:47:44 gibba015 bash[9806]: cluster 2021-03-10T13:47:43.251576+0000 mgr.y (mgr.14140) 303 : cluster [DBG] pgmap v297: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:44.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:47:44 gibba015 bash[13005]: cluster 2021-03-10T13:47:43.251576+0000 mgr.y (mgr.14140) 303 : cluster [DBG] pgmap v297: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:46.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:47:46 gibba045 bash[9787]: cluster 2021-03-10T13:47:45.253032+0000 mgr.y (mgr.14140) 304 : cluster [DBG] pgmap v298: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:46.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:47:46 gibba015 bash[9806]: cluster 2021-03-10T13:47:45.253032+0000 mgr.y (mgr.14140) 304 : cluster [DBG] pgmap v298: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:46.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:47:46 gibba015 bash[13005]: cluster 2021-03-10T13:47:45.253032+0000 mgr.y (mgr.14140) 304 : cluster [DBG] pgmap v298: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:47.921 DEBUG:teuthology.orchestra.run.gibba015:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e4a642d2-81a5-11eb-9080-001a4aab830c -e sha1=b26fc080937a021ce826cdc94d1adb52c064381a -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2021-03-10T13:47:48.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:47:48 gibba045 bash[9787]: cluster 2021-03-10T13:47:47.253481+0000 mgr.y (mgr.14140) 305 : cluster [DBG] pgmap v299: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:48.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:47:48 gibba015 bash[9806]: cluster 2021-03-10T13:47:47.253481+0000 mgr.y (mgr.14140) 305 : cluster [DBG] pgmap v299: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:48.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:47:48 gibba015 bash[13005]: cluster 2021-03-10T13:47:47.253481+0000 mgr.y (mgr.14140) 305 : cluster [DBG] pgmap v299: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:50.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:47:50 gibba045 bash[9787]: cluster 2021-03-10T13:47:49.254774+0000 mgr.y (mgr.14140) 306 : cluster [DBG] pgmap v300: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:50.701 INFO:teuthology.orchestra.run.gibba015.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a 2021-03-10T13:47:50.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:47:50 gibba015 bash[9806]: cluster 2021-03-10T13:47:49.254774+0000 mgr.y (mgr.14140) 306 : cluster [DBG] pgmap v300: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:50.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:47:50 gibba015 bash[13005]: cluster 2021-03-10T13:47:49.254774+0000 mgr.y (mgr.14140) 306 : cluster [DBG] pgmap v300: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:51.554 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:47:51 gibba015 bash[9806]: audit 2021-03-10T13:47:50.692958+0000 mgr.y (mgr.14140) 307 : audit [DBG] from='client.24451 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:47:51.555 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:47:51 gibba015 bash[9806]: audit 2021-03-10T13:47:50.693538+0000 mon.a (mon.0) 574 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"e38afbda-df9b-4c75-b599-248e5f8168df\"}"}]: dispatch 2021-03-10T13:47:51.555 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:47:51 gibba015 bash[9806]: audit 2021-03-10T13:47:50.697458+0000 mon.a (mon.0) 575 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"e38afbda-df9b-4c75-b599-248e5f8168df\"}"}]': finished 2021-03-10T13:47:51.555 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:47:51 gibba015 bash[9806]: cephadm 2021-03-10T13:47:50.699104+0000 mgr.y (mgr.14140) 308 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a 2021-03-10T13:47:51.556 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:47:51 gibba015 bash[13005]: audit 2021-03-10T13:47:50.692958+0000 mgr.y (mgr.14140) 307 : audit [DBG] from='client.24451 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:47:51.556 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:47:51 gibba015 bash[13005]: audit 2021-03-10T13:47:50.693538+0000 mon.a (mon.0) 574 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"e38afbda-df9b-4c75-b599-248e5f8168df\"}"}]: dispatch 2021-03-10T13:47:51.556 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:47:51 gibba015 bash[13005]: audit 2021-03-10T13:47:50.697458+0000 mon.a (mon.0) 575 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"e38afbda-df9b-4c75-b599-248e5f8168df\"}"}]': finished 2021-03-10T13:47:51.556 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:47:51 gibba015 bash[13005]: cephadm 2021-03-10T13:47:50.699104+0000 mgr.y (mgr.14140) 308 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a 2021-03-10T13:47:51.557 INFO:teuthology.run_tasks:Running task cephadm.shell... 2021-03-10T13:47:51.566 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@gibba015.front.sepia.ceph.com 2021-03-10T13:47:51.566 DEBUG:teuthology.orchestra.run.gibba015:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e4a642d2-81a5-11eb-9080-001a4aab830c -e sha1=b26fc080937a021ce826cdc94d1adb52c064381a -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true ; do ceph orch ps ; ceph versions ; sleep 30 ; done' 2021-03-10T13:47:51.567 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:47:51 gibba045 bash[9787]: audit 2021-03-10T13:47:50.692958+0000 mgr.y (mgr.14140) 307 : audit [DBG] from='client.24451 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:47:51.567 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:47:51 gibba045 bash[9787]: audit 2021-03-10T13:47:50.693538+0000 mon.a (mon.0) 574 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"e38afbda-df9b-4c75-b599-248e5f8168df\"}"}]: dispatch 2021-03-10T13:47:51.568 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:47:51 gibba045 bash[9787]: audit 2021-03-10T13:47:50.697458+0000 mon.a (mon.0) 575 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"e38afbda-df9b-4c75-b599-248e5f8168df\"}"}]': finished 2021-03-10T13:47:51.568 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:47:51 gibba045 bash[9787]: cephadm 2021-03-10T13:47:50.699104+0000 mgr.y (mgr.14140) 308 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a 2021-03-10T13:47:52.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:47:52 gibba015 bash[9806]: cluster 2021-03-10T13:47:51.255188+0000 mgr.y (mgr.14140) 309 : cluster [DBG] pgmap v301: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:52.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:47:52 gibba015 bash[13005]: cluster 2021-03-10T13:47:51.255188+0000 mgr.y (mgr.14140) 309 : cluster [DBG] pgmap v301: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:53.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:47:52 gibba045 bash[9787]: cluster 2021-03-10T13:47:51.255188+0000 mgr.y (mgr.14140) 309 : cluster [DBG] pgmap v301: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:54.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:47:54 gibba015 bash[9806]: cluster 2021-03-10T13:47:53.256330+0000 mgr.y (mgr.14140) 310 : cluster [DBG] pgmap v302: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:54.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:47:54 gibba015 bash[13005]: cluster 2021-03-10T13:47:53.256330+0000 mgr.y (mgr.14140) 310 : cluster [DBG] pgmap v302: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:55.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:47:54 gibba045 bash[9787]: cluster 2021-03-10T13:47:53.256330+0000 mgr.y (mgr.14140) 310 : cluster [DBG] pgmap v302: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:56.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:47:56 gibba015 bash[9806]: cluster 2021-03-10T13:47:55.256777+0000 mgr.y (mgr.14140) 311 : cluster [DBG] pgmap v303: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:56.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:47:56 gibba015 bash[13005]: cluster 2021-03-10T13:47:55.256777+0000 mgr.y (mgr.14140) 311 : cluster [DBG] pgmap v303: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:57.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:47:56 gibba045 bash[9787]: cluster 2021-03-10T13:47:55.256777+0000 mgr.y (mgr.14140) 311 : cluster [DBG] pgmap v303: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:58.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:47:58 gibba045 bash[9787]: cluster 2021-03-10T13:47:57.257073+0000 mgr.y (mgr.14140) 312 : cluster [DBG] pgmap v304: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:58.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:47:58 gibba015 bash[9806]: cluster 2021-03-10T13:47:57.257073+0000 mgr.y (mgr.14140) 312 : cluster [DBG] pgmap v304: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:58.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:47:58 gibba015 bash[13005]: cluster 2021-03-10T13:47:57.257073+0000 mgr.y (mgr.14140) 312 : cluster [DBG] pgmap v304: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:00.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:00 gibba015 bash[9806]: cluster 2021-03-10T13:47:59.257442+0000 mgr.y (mgr.14140) 313 : cluster [DBG] pgmap v305: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:00.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:00 gibba015 bash[13005]: cluster 2021-03-10T13:47:59.257442+0000 mgr.y (mgr.14140) 313 : cluster [DBG] pgmap v305: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:00.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:00 gibba045 bash[9787]: cluster 2021-03-10T13:47:59.257442+0000 mgr.y (mgr.14140) 313 : cluster [DBG] pgmap v305: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:02.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:02 gibba015 bash[9806]: cluster 2021-03-10T13:48:01.258474+0000 mgr.y (mgr.14140) 314 : cluster [DBG] pgmap v306: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:02.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:02 gibba015 bash[13005]: cluster 2021-03-10T13:48:01.258474+0000 mgr.y (mgr.14140) 314 : cluster [DBG] pgmap v306: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:02.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:02 gibba045 bash[9787]: cluster 2021-03-10T13:48:01.258474+0000 mgr.y (mgr.14140) 314 : cluster [DBG] pgmap v306: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:04.618 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:04 gibba015 bash[9806]: cluster 2021-03-10T13:48:03.259697+0000 mgr.y (mgr.14140) 315 : cluster [DBG] pgmap v307: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:04.618 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:04 gibba015 bash[13005]: cluster 2021-03-10T13:48:03.259697+0000 mgr.y (mgr.14140) 315 : cluster [DBG] pgmap v307: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:04.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:04 gibba045 bash[9787]: cluster 2021-03-10T13:48:03.259697+0000 mgr.y (mgr.14140) 315 : cluster [DBG] pgmap v307: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:06.357 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T13:48:06.551 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T13:48:06.552 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3m) 3m ago 4m 0.21.0 prom/alertmanager c876f5897d7b 842b16a0ff6e 2021-03-10T13:48:06.552 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3m) 2m ago 3m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T13:48:06.552 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (7m) 2m ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 3fdfde0680ad 2021-03-10T13:48:06.553 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (7m) 2m ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 28c4b572e5d6 2021-03-10T13:48:06.553 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (9m) 3m ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 9e4717dfc4f8 2021-03-10T13:48:06.553 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (9m) 3m ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 d38e67be51e5 2021-03-10T13:48:06.553 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (7m) 2m ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 2523bc3385be 2021-03-10T13:48:06.553 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (8m) 3m ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 d2d863b7e101 2021-03-10T13:48:06.554 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (4m) 3m ago 4m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T13:48:06.554 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (4m) 2m ago 4m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T13:48:06.554 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (7m) 3m ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 1e67f692bb03 2021-03-10T13:48:06.554 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (6m) 3m ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 83369fd7640c 2021-03-10T13:48:06.555 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (6m) 3m ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b90f9ada390a 2021-03-10T13:48:06.555 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (6m) 3m ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 a77eccf371e5 2021-03-10T13:48:06.555 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (5m) 2m ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 9b9c84c84955 2021-03-10T13:48:06.555 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (5m) 2m ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 662e73261675 2021-03-10T13:48:06.556 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (5m) 2m ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 338d252f22e3 2021-03-10T13:48:06.556 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (4m) 2m ago 4m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 784edc0668a4 2021-03-10T13:48:06.556 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3m) 2m ago 4m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T13:48:06.556 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 running (2m) 2m ago 2m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 31a06a43ffb1 2021-03-10T13:48:06.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:06 gibba015 bash[9806]: cluster 2021-03-10T13:48:05.261187+0000 mgr.y (mgr.14140) 316 : cluster [DBG] pgmap v308: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:06.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:06 gibba015 bash[9806]: audit 2021-03-10T13:48:05.979638+0000 mon.a (mon.0) 576 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"e38afbda-df9b-4c75-b599-248e5f8168df\", \"target_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"target_version\": \"ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)\"}"}]: dispatch 2021-03-10T13:48:06.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:06 gibba015 bash[9806]: audit 2021-03-10T13:48:05.983731+0000 mon.a (mon.0) 577 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"e38afbda-df9b-4c75-b599-248e5f8168df\", \"target_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"target_version\": \"ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)\"}"}]': finished 2021-03-10T13:48:06.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:06 gibba015 bash[9806]: cephadm 2021-03-10T13:48:05.984086+0000 mgr.y (mgr.14140) 317 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a with id d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14 2021-03-10T13:48:06.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:06 gibba015 bash[9806]: audit 2021-03-10T13:48:05.984349+0000 mon.a (mon.0) 578 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:48:06.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:06 gibba015 bash[9806]: cephadm 2021-03-10T13:48:05.985216+0000 mgr.y (mgr.14140) 318 : cephadm [INF] Upgrade: Checking mgr daemons... 2021-03-10T13:48:06.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:06 gibba015 bash[9806]: cephadm 2021-03-10T13:48:05.985404+0000 mgr.y (mgr.14140) 319 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2021-03-10T13:48:06.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:06 gibba015 bash[9806]: cephadm 2021-03-10T13:48:06.123778+0000 mgr.y (mgr.14140) 320 : cephadm [INF] Upgrade: Pulling quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a on gibba045 2021-03-10T13:48:06.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:06 gibba015 bash[13005]: cluster 2021-03-10T13:48:05.261187+0000 mgr.y (mgr.14140) 316 : cluster [DBG] pgmap v308: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:06.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:06 gibba015 bash[13005]: audit 2021-03-10T13:48:05.979638+0000 mon.a (mon.0) 576 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"e38afbda-df9b-4c75-b599-248e5f8168df\", \"target_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"target_version\": \"ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)\"}"}]: dispatch 2021-03-10T13:48:06.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:06 gibba015 bash[13005]: audit 2021-03-10T13:48:05.983731+0000 mon.a (mon.0) 577 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"e38afbda-df9b-4c75-b599-248e5f8168df\", \"target_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"target_version\": \"ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)\"}"}]': finished 2021-03-10T13:48:06.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:06 gibba015 bash[13005]: cephadm 2021-03-10T13:48:05.984086+0000 mgr.y (mgr.14140) 317 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a with id d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14 2021-03-10T13:48:06.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:06 gibba015 bash[13005]: audit 2021-03-10T13:48:05.984349+0000 mon.a (mon.0) 578 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:48:06.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:06 gibba015 bash[13005]: cephadm 2021-03-10T13:48:05.985216+0000 mgr.y (mgr.14140) 318 : cephadm [INF] Upgrade: Checking mgr daemons... 2021-03-10T13:48:06.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:06 gibba015 bash[13005]: cephadm 2021-03-10T13:48:05.985404+0000 mgr.y (mgr.14140) 319 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2021-03-10T13:48:06.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:06 gibba015 bash[13005]: cephadm 2021-03-10T13:48:06.123778+0000 mgr.y (mgr.14140) 320 : cephadm [INF] Upgrade: Pulling quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a on gibba045 2021-03-10T13:48:06.766 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T13:48:06.767 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T13:48:06.767 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3 2021-03-10T13:48:06.767 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T13:48:06.768 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T13:48:06.768 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3 2021-03-10T13:48:06.768 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T13:48:06.768 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T13:48:06.768 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2021-03-10T13:48:06.769 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T13:48:06.769 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T13:48:06.769 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T13:48:06.769 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 14 2021-03-10T13:48:06.769 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T13:48:06.770 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T13:48:06.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:06 gibba045 bash[9787]: cluster 2021-03-10T13:48:05.261187+0000 mgr.y (mgr.14140) 316 : cluster [DBG] pgmap v308: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:06.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:06 gibba045 bash[9787]: audit 2021-03-10T13:48:05.979638+0000 mon.a (mon.0) 576 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"e38afbda-df9b-4c75-b599-248e5f8168df\", \"target_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"target_version\": \"ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)\"}"}]: dispatch 2021-03-10T13:48:06.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:06 gibba045 bash[9787]: audit 2021-03-10T13:48:05.983731+0000 mon.a (mon.0) 577 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"e38afbda-df9b-4c75-b599-248e5f8168df\", \"target_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"target_version\": \"ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)\"}"}]': finished 2021-03-10T13:48:06.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:06 gibba045 bash[9787]: cephadm 2021-03-10T13:48:05.984086+0000 mgr.y (mgr.14140) 317 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a with id d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14 2021-03-10T13:48:06.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:06 gibba045 bash[9787]: audit 2021-03-10T13:48:05.984349+0000 mon.a (mon.0) 578 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:48:06.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:06 gibba045 bash[9787]: cephadm 2021-03-10T13:48:05.985216+0000 mgr.y (mgr.14140) 318 : cephadm [INF] Upgrade: Checking mgr daemons... 2021-03-10T13:48:06.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:06 gibba045 bash[9787]: cephadm 2021-03-10T13:48:05.985404+0000 mgr.y (mgr.14140) 319 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2021-03-10T13:48:06.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:06 gibba045 bash[9787]: cephadm 2021-03-10T13:48:06.123778+0000 mgr.y (mgr.14140) 320 : cephadm [INF] Upgrade: Pulling quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a on gibba045 2021-03-10T13:48:07.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:07 gibba015 bash[9806]: audit 2021-03-10T13:48:06.347424+0000 mgr.y (mgr.14140) 321 : audit [DBG] from='client.14544 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:48:07.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:07 gibba015 bash[9806]: audit 2021-03-10T13:48:06.546684+0000 mgr.y (mgr.14140) 322 : audit [DBG] from='client.14550 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:48:07.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:07 gibba015 bash[9806]: audit 2021-03-10T13:48:06.764536+0000 mon.b (mon.2) 23 : audit [DBG] from='client.? 172.21.2.115:0/2797819734' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:48:07.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:07 gibba015 bash[13005]: audit 2021-03-10T13:48:06.347424+0000 mgr.y (mgr.14140) 321 : audit [DBG] from='client.14544 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:48:07.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:07 gibba015 bash[13005]: audit 2021-03-10T13:48:06.546684+0000 mgr.y (mgr.14140) 322 : audit [DBG] from='client.14550 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:48:07.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:07 gibba015 bash[13005]: audit 2021-03-10T13:48:06.764536+0000 mon.b (mon.2) 23 : audit [DBG] from='client.? 172.21.2.115:0/2797819734' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:48:07.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:07 gibba045 bash[9787]: audit 2021-03-10T13:48:06.347424+0000 mgr.y (mgr.14140) 321 : audit [DBG] from='client.14544 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:48:07.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:07 gibba045 bash[9787]: audit 2021-03-10T13:48:06.546684+0000 mgr.y (mgr.14140) 322 : audit [DBG] from='client.14550 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:48:07.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:07 gibba045 bash[9787]: audit 2021-03-10T13:48:06.764536+0000 mon.b (mon.2) 23 : audit [DBG] from='client.? 172.21.2.115:0/2797819734' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:48:08.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:08 gibba015 bash[9806]: cluster 2021-03-10T13:48:07.261804+0000 mgr.y (mgr.14140) 323 : cluster [DBG] pgmap v309: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:08.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:08 gibba015 bash[13005]: cluster 2021-03-10T13:48:07.261804+0000 mgr.y (mgr.14140) 323 : cluster [DBG] pgmap v309: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:08.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:08 gibba045 bash[9787]: cluster 2021-03-10T13:48:07.261804+0000 mgr.y (mgr.14140) 323 : cluster [DBG] pgmap v309: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:10.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:10 gibba015 bash[9806]: cluster 2021-03-10T13:48:09.262520+0000 mgr.y (mgr.14140) 324 : cluster [DBG] pgmap v310: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:10.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:10 gibba015 bash[13005]: cluster 2021-03-10T13:48:09.262520+0000 mgr.y (mgr.14140) 324 : cluster [DBG] pgmap v310: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:10.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:10 gibba045 bash[9787]: cluster 2021-03-10T13:48:09.262520+0000 mgr.y (mgr.14140) 324 : cluster [DBG] pgmap v310: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:12.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:12 gibba045 bash[9787]: cluster 2021-03-10T13:48:11.263196+0000 mgr.y (mgr.14140) 325 : cluster [DBG] pgmap v311: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:12.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:12 gibba015 bash[9806]: cluster 2021-03-10T13:48:11.263196+0000 mgr.y (mgr.14140) 325 : cluster [DBG] pgmap v311: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:12.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:12 gibba015 bash[13005]: cluster 2021-03-10T13:48:11.263196+0000 mgr.y (mgr.14140) 325 : cluster [DBG] pgmap v311: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:14.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:14 gibba015 bash[9806]: cluster 2021-03-10T13:48:13.264650+0000 mgr.y (mgr.14140) 326 : cluster [DBG] pgmap v312: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:14.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:14 gibba015 bash[13005]: cluster 2021-03-10T13:48:13.264650+0000 mgr.y (mgr.14140) 326 : cluster [DBG] pgmap v312: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:14.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:14 gibba045 bash[9787]: cluster 2021-03-10T13:48:13.264650+0000 mgr.y (mgr.14140) 326 : cluster [DBG] pgmap v312: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:16.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:16 gibba015 bash[9806]: cluster 2021-03-10T13:48:15.266128+0000 mgr.y (mgr.14140) 327 : cluster [DBG] pgmap v313: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:16.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:16 gibba015 bash[13005]: cluster 2021-03-10T13:48:15.266128+0000 mgr.y (mgr.14140) 327 : cluster [DBG] pgmap v313: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:16.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:16 gibba045 bash[9787]: cluster 2021-03-10T13:48:15.266128+0000 mgr.y (mgr.14140) 327 : cluster [DBG] pgmap v313: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:18.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:18 gibba045 bash[9787]: cluster 2021-03-10T13:48:17.266852+0000 mgr.y (mgr.14140) 328 : cluster [DBG] pgmap v314: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:18.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:18 gibba015 bash[9806]: cluster 2021-03-10T13:48:17.266852+0000 mgr.y (mgr.14140) 328 : cluster [DBG] pgmap v314: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:18.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:18 gibba015 bash[13005]: cluster 2021-03-10T13:48:17.266852+0000 mgr.y (mgr.14140) 328 : cluster [DBG] pgmap v314: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:20.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:20 gibba045 bash[9787]: cluster 2021-03-10T13:48:19.267585+0000 mgr.y (mgr.14140) 329 : cluster [DBG] pgmap v315: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:20.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:20 gibba015 bash[9806]: cluster 2021-03-10T13:48:19.267585+0000 mgr.y (mgr.14140) 329 : cluster [DBG] pgmap v315: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:20.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:20 gibba015 bash[13005]: cluster 2021-03-10T13:48:19.267585+0000 mgr.y (mgr.14140) 329 : cluster [DBG] pgmap v315: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:21.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:21 gibba045 bash[9787]: cephadm 2021-03-10T13:48:21.017731+0000 mgr.y (mgr.14140) 330 : cephadm [INF] Upgrade: It is presumed safe to stop mgr.x 2021-03-10T13:48:21.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:21 gibba045 bash[9787]: cephadm 2021-03-10T13:48:21.017955+0000 mgr.y (mgr.14140) 331 : cephadm [INF] Upgrade: Redeploying mgr.x 2021-03-10T13:48:21.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:21 gibba045 bash[9787]: audit 2021-03-10T13:48:21.018854+0000 mon.a (mon.0) 579 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr.x"}]: dispatch 2021-03-10T13:48:21.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:21 gibba045 bash[9787]: audit 2021-03-10T13:48:21.027979+0000 mon.a (mon.0) 580 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr.x"}]': finished 2021-03-10T13:48:21.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:21 gibba045 bash[9787]: audit 2021-03-10T13:48:21.028819+0000 mon.a (mon.0) 581 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.x"}]: dispatch 2021-03-10T13:48:21.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:21 gibba045 bash[9787]: audit 2021-03-10T13:48:21.029467+0000 mon.a (mon.0) 582 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:48:21.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:21 gibba045 bash[9787]: cephadm 2021-03-10T13:48:21.030149+0000 mgr.y (mgr.14140) 332 : cephadm [INF] Deploying daemon mgr.x on gibba045 2021-03-10T13:48:21.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:21 gibba045 bash[9787]: audit 2021-03-10T13:48:21.030382+0000 mon.a (mon.0) 583 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2021-03-10T13:48:21.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:21 gibba015 bash[9806]: cephadm 2021-03-10T13:48:21.017731+0000 mgr.y (mgr.14140) 330 : cephadm [INF] Upgrade: It is presumed safe to stop mgr.x 2021-03-10T13:48:21.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:21 gibba015 bash[9806]: cephadm 2021-03-10T13:48:21.017955+0000 mgr.y (mgr.14140) 331 : cephadm [INF] Upgrade: Redeploying mgr.x 2021-03-10T13:48:21.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:21 gibba015 bash[9806]: audit 2021-03-10T13:48:21.018854+0000 mon.a (mon.0) 579 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr.x"}]: dispatch 2021-03-10T13:48:21.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:21 gibba015 bash[9806]: audit 2021-03-10T13:48:21.027979+0000 mon.a (mon.0) 580 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr.x"}]': finished 2021-03-10T13:48:21.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:21 gibba015 bash[9806]: audit 2021-03-10T13:48:21.028819+0000 mon.a (mon.0) 581 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.x"}]: dispatch 2021-03-10T13:48:21.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:21 gibba015 bash[9806]: audit 2021-03-10T13:48:21.029467+0000 mon.a (mon.0) 582 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:48:21.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:21 gibba015 bash[9806]: cephadm 2021-03-10T13:48:21.030149+0000 mgr.y (mgr.14140) 332 : cephadm [INF] Deploying daemon mgr.x on gibba045 2021-03-10T13:48:21.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:21 gibba015 bash[9806]: audit 2021-03-10T13:48:21.030382+0000 mon.a (mon.0) 583 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2021-03-10T13:48:21.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:21 gibba015 bash[13005]: cephadm 2021-03-10T13:48:21.017731+0000 mgr.y (mgr.14140) 330 : cephadm [INF] Upgrade: It is presumed safe to stop mgr.x 2021-03-10T13:48:21.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:21 gibba015 bash[13005]: cephadm 2021-03-10T13:48:21.017955+0000 mgr.y (mgr.14140) 331 : cephadm [INF] Upgrade: Redeploying mgr.x 2021-03-10T13:48:21.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:21 gibba015 bash[13005]: audit 2021-03-10T13:48:21.018854+0000 mon.a (mon.0) 579 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr.x"}]: dispatch 2021-03-10T13:48:21.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:21 gibba015 bash[13005]: audit 2021-03-10T13:48:21.027979+0000 mon.a (mon.0) 580 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr.x"}]': finished 2021-03-10T13:48:21.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:21 gibba015 bash[13005]: audit 2021-03-10T13:48:21.028819+0000 mon.a (mon.0) 581 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.x"}]: dispatch 2021-03-10T13:48:21.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:21 gibba015 bash[13005]: audit 2021-03-10T13:48:21.029467+0000 mon.a (mon.0) 582 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:48:21.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:21 gibba015 bash[13005]: cephadm 2021-03-10T13:48:21.030149+0000 mgr.y (mgr.14140) 332 : cephadm [INF] Deploying daemon mgr.x on gibba045 2021-03-10T13:48:21.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:21 gibba015 bash[13005]: audit 2021-03-10T13:48:21.030382+0000 mon.a (mon.0) 583 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2021-03-10T13:48:23.036 INFO:journalctl@ceph.mgr.x.gibba045.stdout:Mar 10 13:48:22 gibba045 systemd[1]: Stopping Ceph mgr.x for e4a642d2-81a5-11eb-9080-001a4aab830c... 2021-03-10T13:48:23.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:23 gibba045 bash[9787]: cluster 2021-03-10T13:48:21.268973+0000 mgr.y (mgr.14140) 333 : cluster [DBG] pgmap v316: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:23.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:23 gibba015 bash[9806]: cluster 2021-03-10T13:48:21.268973+0000 mgr.y (mgr.14140) 333 : cluster [DBG] pgmap v316: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:23.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:23 gibba015 bash[13005]: cluster 2021-03-10T13:48:21.268973+0000 mgr.y (mgr.14140) 333 : cluster [DBG] pgmap v316: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:25.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:25 gibba045 bash[9787]: cluster 2021-03-10T13:48:23.270303+0000 mgr.y (mgr.14140) 334 : cluster [DBG] pgmap v317: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:25.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:25 gibba015 bash[9806]: cluster 2021-03-10T13:48:23.270303+0000 mgr.y (mgr.14140) 334 : cluster [DBG] pgmap v317: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:25.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:25 gibba015 bash[13005]: cluster 2021-03-10T13:48:23.270303+0000 mgr.y (mgr.14140) 334 : cluster [DBG] pgmap v317: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:27.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:27 gibba045 bash[9787]: cluster 2021-03-10T13:48:25.271915+0000 mgr.y (mgr.14140) 335 : cluster [DBG] pgmap v318: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:27.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:27 gibba015 bash[9806]: cluster 2021-03-10T13:48:25.271915+0000 mgr.y (mgr.14140) 335 : cluster [DBG] pgmap v318: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:27.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:27 gibba015 bash[13005]: cluster 2021-03-10T13:48:25.271915+0000 mgr.y (mgr.14140) 335 : cluster [DBG] pgmap v318: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:28.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:28 gibba045 bash[9787]: cluster 2021-03-10T13:48:27.272665+0000 mgr.y (mgr.14140) 336 : cluster [DBG] pgmap v319: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:28.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:28 gibba015 bash[9806]: cluster 2021-03-10T13:48:27.272665+0000 mgr.y (mgr.14140) 336 : cluster [DBG] pgmap v319: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:28.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:28 gibba015 bash[13005]: cluster 2021-03-10T13:48:27.272665+0000 mgr.y (mgr.14140) 336 : cluster [DBG] pgmap v319: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:30.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:30 gibba015 bash[9806]: cluster 2021-03-10T13:48:29.273685+0000 mgr.y (mgr.14140) 337 : cluster [DBG] pgmap v320: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:30.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:30 gibba015 bash[13005]: cluster 2021-03-10T13:48:29.273685+0000 mgr.y (mgr.14140) 337 : cluster [DBG] pgmap v320: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:30.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:30 gibba045 bash[9787]: cluster 2021-03-10T13:48:29.273685+0000 mgr.y (mgr.14140) 337 : cluster [DBG] pgmap v320: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:32.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:32 gibba015 bash[9806]: cluster 2021-03-10T13:48:31.275005+0000 mgr.y (mgr.14140) 338 : cluster [DBG] pgmap v321: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:32.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:32 gibba015 bash[13005]: cluster 2021-03-10T13:48:31.275005+0000 mgr.y (mgr.14140) 338 : cluster [DBG] pgmap v321: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:32.791 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:32 gibba045 bash[9787]: cluster 2021-03-10T13:48:31.275005+0000 mgr.y (mgr.14140) 338 : cluster [DBG] pgmap v321: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:33.807 INFO:journalctl@ceph.mgr.x.gibba045.stdout:Mar 10 13:48:33 gibba045 docker[22044]: ceph-e4a642d2-81a5-11eb-9080-001a4aab830c-mgr.x 2021-03-10T13:48:33.807 INFO:journalctl@ceph.mgr.x.gibba045.stdout:Mar 10 13:48:33 gibba045 systemd[1]: ceph-e4a642d2-81a5-11eb-9080-001a4aab830c@mgr.x.service: Main process exited, code=exited, status=137/n/a 2021-03-10T13:48:33.807 INFO:journalctl@ceph.mgr.x.gibba045.stdout:Mar 10 13:48:33 gibba045 systemd[1]: ceph-e4a642d2-81a5-11eb-9080-001a4aab830c@mgr.x.service: Failed with result 'exit-code'. 2021-03-10T13:48:33.807 INFO:journalctl@ceph.mgr.x.gibba045.stdout:Mar 10 13:48:33 gibba045 systemd[1]: Stopped Ceph mgr.x for e4a642d2-81a5-11eb-9080-001a4aab830c. 2021-03-10T13:48:33.808 INFO:journalctl@ceph.mgr.x.gibba045.stdout:Mar 10 13:48:33 gibba045 systemd[1]: Starting Ceph mgr.x for e4a642d2-81a5-11eb-9080-001a4aab830c... 2021-03-10T13:48:33.808 INFO:journalctl@ceph.mgr.x.gibba045.stdout:Mar 10 13:48:33 gibba045 docker[22117]: Error: No such container: ceph-e4a642d2-81a5-11eb-9080-001a4aab830c-mgr.x 2021-03-10T13:48:33.808 INFO:journalctl@ceph.mgr.x.gibba045.stdout:Mar 10 13:48:33 gibba045 systemd[1]: Started Ceph mgr.x for e4a642d2-81a5-11eb-9080-001a4aab830c. 2021-03-10T13:48:34.621 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:34 gibba045 bash[9787]: cluster 2021-03-10T13:48:33.276400+0000 mgr.y (mgr.14140) 339 : cluster [DBG] pgmap v322: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:34.621 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:34 gibba045 bash[9787]: audit 2021-03-10T13:48:33.648804+0000 mon.a (mon.0) 584 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.904712\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.905216\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.905381\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.905535\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.905720\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.905932\", \"created\": \"2021-03-10T13:43:22.897564\", \"started\": \"2021-03-10T13:43:26.167781\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"container_id\": \"b3907fa26ba0\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.906092\", \"created\": \"2021-03-10T13:43:42.821564\", \"started\": \"2021-03-10T13:44:24.396576\"}, \"node-exporter.b\": {\"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.906245\", \"created\": \"2021-03-10T13:43:43.861564\", \"started\": \"2021-03-10T13:43:45.351099\"}, \"grafana.a\": {\"hostname\": \"gibba045\", \"container_id\": \"d86cab6511db\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.906397\", \"created\": \"2021-03-10T13:44:08.721564\", \"started\": \"2021-03-10T13:44:08.746042\"}, \"rgw.r.z.gibba045.atotkw\": {\"hostname\": \"gibba045\", \"container_id\": \"31a06a43ffb1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba045.atotkw\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.906548\", \"created\": \"2021-03-10T13:45:45.925564\", \"started\": \"2021-03-10T13:45:45.949462\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:21.028684\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:44:17.558720\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818\"}, \"rgw.r.z.gibba045.atotkw\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:44.004644\"}}, \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:48:34.621 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:34 gibba045 bash[9787]: audit 2021-03-10T13:48:33.657582+0000 mon.a (mon.0) 585 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.904712\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.905216\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.905381\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.905535\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.905720\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.905932\", \"created\": \"2021-03-10T13:43:22.897564\", \"started\": \"2021-03-10T13:43:26.167781\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"container_id\": \"b3907fa26ba0\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.906092\", \"created\": \"2021-03-10T13:43:42.821564\", \"started\": \"2021-03-10T13:44:24.396576\"}, \"node-exporter.b\": {\"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.906245\", \"created\": \"2021-03-10T13:43:43.861564\", \"started\": \"2021-03-10T13:43:45.351099\"}, \"grafana.a\": {\"hostname\": \"gibba045\", \"container_id\": \"d86cab6511db\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.906397\", \"created\": \"2021-03-10T13:44:08.721564\", \"started\": \"2021-03-10T13:44:08.746042\"}, \"rgw.r.z.gibba045.atotkw\": {\"hostname\": \"gibba045\", \"container_id\": \"31a06a43ffb1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba045.atotkw\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.906548\", \"created\": \"2021-03-10T13:45:45.925564\", \"started\": \"2021-03-10T13:45:45.949462\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:21.028684\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:44:17.558720\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818\"}, \"rgw.r.z.gibba045.atotkw\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:44.004644\"}}, \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:48:34.622 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:34 gibba045 bash[9787]: audit 2021-03-10T13:48:33.658227+0000 mon.a (mon.0) 586 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:48:34.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:34 gibba015 bash[9806]: cluster 2021-03-10T13:48:33.276400+0000 mgr.y (mgr.14140) 339 : cluster [DBG] pgmap v322: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:34.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:34 gibba015 bash[13005]: cluster 2021-03-10T13:48:33.276400+0000 mgr.y (mgr.14140) 339 : cluster [DBG] pgmap v322: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:34.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:34 gibba015 bash[13005]: audit 2021-03-10T13:48:33.648804+0000 mon.a (mon.0) 584 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.904712\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.905216\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.905381\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.905535\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.905720\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.905932\", \"created\": \"2021-03-10T13:43:22.897564\", \"started\": \"2021-03-10T13:43:26.167781\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"container_id\": \"b3907fa26ba0\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.906092\", \"created\": \"2021-03-10T13:43:42.821564\", \"started\": \"2021-03-10T13:44:24.396576\"}, \"node-exporter.b\": {\"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.906245\", \"created\": \"2021-03-10T13:43:43.861564\", \"started\": \"2021-03-10T13:43:45.351099\"}, \"grafana.a\": {\"hostname\": \"gibba045\", \"container_id\": \"d86cab6511db\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.906397\", \"created\": \"2021-03-10T13:44:08.721564\", \"started\": \"2021-03-10T13:44:08.746042\"}, \"rgw.r.z.gibba045.atotkw\": {\"hostname\": \"gibba045\", \"container_id\": \"31a06a43ffb1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba045.atotkw\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.906548\", \"created\": \"2021-03-10T13:45:45.925564\", \"started\": \"2021-03-10T13:45:45.949462\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:21.028684\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:44:17.558720\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818\"}, \"rgw.r.z.gibba045.atotkw\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:44.004644\"}}, \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:48:34.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:34 gibba015 bash[9806]: audit 2021-03-10T13:48:33.648804+0000 mon.a (mon.0) 584 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.904712\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.905216\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.905381\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.905535\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.905720\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.905932\", \"created\": \"2021-03-10T13:43:22.897564\", \"started\": \"2021-03-10T13:43:26.167781\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"container_id\": \"b3907fa26ba0\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.906092\", \"created\": \"2021-03-10T13:43:42.821564\", \"started\": \"2021-03-10T13:44:24.396576\"}, \"node-exporter.b\": {\"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.906245\", \"created\": \"2021-03-10T13:43:43.861564\", \"started\": \"2021-03-10T13:43:45.351099\"}, \"grafana.a\": {\"hostname\": \"gibba045\", \"container_id\": \"d86cab6511db\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.906397\", \"created\": \"2021-03-10T13:44:08.721564\", \"started\": \"2021-03-10T13:44:08.746042\"}, \"rgw.r.z.gibba045.atotkw\": {\"hostname\": \"gibba045\", \"container_id\": \"31a06a43ffb1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba045.atotkw\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.906548\", \"created\": \"2021-03-10T13:45:45.925564\", \"started\": \"2021-03-10T13:45:45.949462\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:21.028684\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:44:17.558720\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818\"}, \"rgw.r.z.gibba045.atotkw\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:44.004644\"}}, \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:48:34.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:34 gibba015 bash[9806]: audit 2021-03-10T13:48:33.657582+0000 mon.a (mon.0) 585 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.904712\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.905216\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.905381\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.905535\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.905720\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.905932\", \"created\": \"2021-03-10T13:43:22.897564\", \"started\": \"2021-03-10T13:43:26.167781\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"container_id\": \"b3907fa26ba0\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.906092\", \"created\": \"2021-03-10T13:43:42.821564\", \"started\": \"2021-03-10T13:44:24.396576\"}, \"node-exporter.b\": {\"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.906245\", \"created\": \"2021-03-10T13:43:43.861564\", \"started\": \"2021-03-10T13:43:45.351099\"}, \"grafana.a\": {\"hostname\": \"gibba045\", \"container_id\": \"d86cab6511db\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.906397\", \"created\": \"2021-03-10T13:44:08.721564\", \"started\": \"2021-03-10T13:44:08.746042\"}, \"rgw.r.z.gibba045.atotkw\": {\"hostname\": \"gibba045\", \"container_id\": \"31a06a43ffb1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba045.atotkw\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.906548\", \"created\": \"2021-03-10T13:45:45.925564\", \"started\": \"2021-03-10T13:45:45.949462\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:21.028684\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:44:17.558720\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818\"}, \"rgw.r.z.gibba045.atotkw\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:44.004644\"}}, \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:48:34.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:34 gibba015 bash[9806]: audit 2021-03-10T13:48:33.658227+0000 mon.a (mon.0) 586 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:48:34.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:34 gibba015 bash[13005]: audit 2021-03-10T13:48:33.657582+0000 mon.a (mon.0) 585 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.904712\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.905216\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.905381\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.905535\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.905720\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.905932\", \"created\": \"2021-03-10T13:43:22.897564\", \"started\": \"2021-03-10T13:43:26.167781\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"container_id\": \"b3907fa26ba0\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.906092\", \"created\": \"2021-03-10T13:43:42.821564\", \"started\": \"2021-03-10T13:44:24.396576\"}, \"node-exporter.b\": {\"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.906245\", \"created\": \"2021-03-10T13:43:43.861564\", \"started\": \"2021-03-10T13:43:45.351099\"}, \"grafana.a\": {\"hostname\": \"gibba045\", \"container_id\": \"d86cab6511db\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.906397\", \"created\": \"2021-03-10T13:44:08.721564\", \"started\": \"2021-03-10T13:44:08.746042\"}, \"rgw.r.z.gibba045.atotkw\": {\"hostname\": \"gibba045\", \"container_id\": \"31a06a43ffb1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba045.atotkw\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:46.906548\", \"created\": \"2021-03-10T13:45:45.925564\", \"started\": \"2021-03-10T13:45:45.949462\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:21.028684\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:44:17.558720\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818\"}, \"rgw.r.z.gibba045.atotkw\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:44.004644\"}}, \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:48:34.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:34 gibba015 bash[13005]: audit 2021-03-10T13:48:33.658227+0000 mon.a (mon.0) 586 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:48:35.057 INFO:journalctl@ceph.mgr.x.gibba045.stdout:Mar 10 13:48:34 gibba045 bash[22134]: debug 2021-03-10T13:48:34.646+0000 7f412099f700 1 -- 172.21.2.145:0/3251076942 <== mon.2 v2:172.21.2.145:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x563ca4a664e0 con 0x563ca4b54c00 2021-03-10T13:48:35.705 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:35 gibba045 bash[9787]: audit 2021-03-10T13:48:34.693238+0000 mon.a (mon.0) 587 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.688141\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.688407\", \"created\": \"2021-03-10T13:40:32.015558\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.688512\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.688672\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.688823\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.688970\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.689154\", \"created\": \"2021-03-10T13:43:22.897564\", \"started\": \"2021-03-10T13:43:26.167781\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"container_id\": \"b3907fa26ba0\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.689306\", \"created\": \"2021-03-10T13:43:42.821564\", \"started\": \"2021-03-10T13:44:24.396576\"}, \"node-exporter.b\": {\"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.689452\", \"created\": \"2021-03-10T13:43:43.861564\", \"started\": \"2021-03-10T13:43:45.351099\"}, \"grafana.a\": {\"hostname\": \"gibba045\", \"container_id\": \"d86cab6511db\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.689599\", \"created\": \"2021-03-10T13:44:08.721564\", \"started\": \"2021-03-10T13:44:08.746042\"}, \"rgw.r.z.gibba045.atotkw\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba045.atotkw\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2021-03-10T13:48:34.689744\", \"created\": \"2021-03-10T13:45:45.925564\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:21.028684\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:44:17.558720\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818\"}, \"rgw.r.z.gibba045.atotkw\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:44.004644\"}}, \"last_daemon_update\": \"2021-03-10T13:48:34.690025\", \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:48:35.705 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:35 gibba045 bash[9787]: audit 2021-03-10T13:48:34.702393+0000 mon.a (mon.0) 588 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.688141\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.688407\", \"created\": \"2021-03-10T13:40:32.015558\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.688512\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.688672\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.688823\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.688970\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.689154\", \"created\": \"2021-03-10T13:43:22.897564\", \"started\": \"2021-03-10T13:43:26.167781\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"container_id\": \"b3907fa26ba0\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.689306\", \"created\": \"2021-03-10T13:43:42.821564\", \"started\": \"2021-03-10T13:44:24.396576\"}, \"node-exporter.b\": {\"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.689452\", \"created\": \"2021-03-10T13:43:43.861564\", \"started\": \"2021-03-10T13:43:45.351099\"}, \"grafana.a\": {\"hostname\": \"gibba045\", \"container_id\": \"d86cab6511db\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.689599\", \"created\": \"2021-03-10T13:44:08.721564\", \"started\": \"2021-03-10T13:44:08.746042\"}, \"rgw.r.z.gibba045.atotkw\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba045.atotkw\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2021-03-10T13:48:34.689744\", \"created\": \"2021-03-10T13:45:45.925564\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:21.028684\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:44:17.558720\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818\"}, \"rgw.r.z.gibba045.atotkw\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:44.004644\"}}, \"last_daemon_update\": \"2021-03-10T13:48:34.690025\", \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:48:35.706 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:35 gibba045 bash[9787]: cephadm 2021-03-10T13:48:34.708809+0000 mgr.y (mgr.14140) 340 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a with id d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14 2021-03-10T13:48:35.706 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:35 gibba045 bash[9787]: audit 2021-03-10T13:48:34.709032+0000 mon.a (mon.0) 589 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:48:35.706 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:35 gibba045 bash[9787]: cephadm 2021-03-10T13:48:34.710170+0000 mgr.y (mgr.14140) 341 : cephadm [INF] Upgrade: Checking mgr daemons... 2021-03-10T13:48:35.706 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:35 gibba045 bash[9787]: cephadm 2021-03-10T13:48:34.710234+0000 mgr.y (mgr.14140) 342 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2021-03-10T13:48:35.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:35 gibba015 bash[13005]: audit 2021-03-10T13:48:34.693238+0000 mon.a (mon.0) 587 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.688141\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.688407\", \"created\": \"2021-03-10T13:40:32.015558\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.688512\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.688672\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.688823\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.688970\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.689154\", \"created\": \"2021-03-10T13:43:22.897564\", \"started\": \"2021-03-10T13:43:26.167781\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"container_id\": \"b3907fa26ba0\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.689306\", \"created\": \"2021-03-10T13:43:42.821564\", \"started\": \"2021-03-10T13:44:24.396576\"}, \"node-exporter.b\": {\"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.689452\", \"created\": \"2021-03-10T13:43:43.861564\", \"started\": \"2021-03-10T13:43:45.351099\"}, \"grafana.a\": {\"hostname\": \"gibba045\", \"container_id\": \"d86cab6511db\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.689599\", \"created\": \"2021-03-10T13:44:08.721564\", \"started\": \"2021-03-10T13:44:08.746042\"}, \"rgw.r.z.gibba045.atotkw\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba045.atotkw\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2021-03-10T13:48:34.689744\", \"created\": \"2021-03-10T13:45:45.925564\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:21.028684\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:44:17.558720\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818\"}, \"rgw.r.z.gibba045.atotkw\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:44.004644\"}}, \"last_daemon_update\": \"2021-03-10T13:48:34.690025\", \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:48:35.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:35 gibba015 bash[9806]: audit 2021-03-10T13:48:34.693238+0000 mon.a (mon.0) 587 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.688141\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.688407\", \"created\": \"2021-03-10T13:40:32.015558\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.688512\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.688672\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.688823\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.688970\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.689154\", \"created\": \"2021-03-10T13:43:22.897564\", \"started\": \"2021-03-10T13:43:26.167781\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"container_id\": \"b3907fa26ba0\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.689306\", \"created\": \"2021-03-10T13:43:42.821564\", \"started\": \"2021-03-10T13:44:24.396576\"}, \"node-exporter.b\": {\"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.689452\", \"created\": \"2021-03-10T13:43:43.861564\", \"started\": \"2021-03-10T13:43:45.351099\"}, \"grafana.a\": {\"hostname\": \"gibba045\", \"container_id\": \"d86cab6511db\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.689599\", \"created\": \"2021-03-10T13:44:08.721564\", \"started\": \"2021-03-10T13:44:08.746042\"}, \"rgw.r.z.gibba045.atotkw\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba045.atotkw\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2021-03-10T13:48:34.689744\", \"created\": \"2021-03-10T13:45:45.925564\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:21.028684\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:44:17.558720\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818\"}, \"rgw.r.z.gibba045.atotkw\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:44.004644\"}}, \"last_daemon_update\": \"2021-03-10T13:48:34.690025\", \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:48:35.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:35 gibba015 bash[9806]: audit 2021-03-10T13:48:34.702393+0000 mon.a (mon.0) 588 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.688141\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.688407\", \"created\": \"2021-03-10T13:40:32.015558\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.688512\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.688672\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.688823\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.688970\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.689154\", \"created\": \"2021-03-10T13:43:22.897564\", \"started\": \"2021-03-10T13:43:26.167781\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"container_id\": \"b3907fa26ba0\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.689306\", \"created\": \"2021-03-10T13:43:42.821564\", \"started\": \"2021-03-10T13:44:24.396576\"}, \"node-exporter.b\": {\"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.689452\", \"created\": \"2021-03-10T13:43:43.861564\", \"started\": \"2021-03-10T13:43:45.351099\"}, \"grafana.a\": {\"hostname\": \"gibba045\", \"container_id\": \"d86cab6511db\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.689599\", \"created\": \"2021-03-10T13:44:08.721564\", \"started\": \"2021-03-10T13:44:08.746042\"}, \"rgw.r.z.gibba045.atotkw\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba045.atotkw\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2021-03-10T13:48:34.689744\", \"created\": \"2021-03-10T13:45:45.925564\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:21.028684\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:44:17.558720\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818\"}, \"rgw.r.z.gibba045.atotkw\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:44.004644\"}}, \"last_daemon_update\": \"2021-03-10T13:48:34.690025\", \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:48:35.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:35 gibba015 bash[9806]: cephadm 2021-03-10T13:48:34.708809+0000 mgr.y (mgr.14140) 340 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a with id d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14 2021-03-10T13:48:35.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:35 gibba015 bash[9806]: audit 2021-03-10T13:48:34.709032+0000 mon.a (mon.0) 589 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:48:35.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:35 gibba015 bash[9806]: cephadm 2021-03-10T13:48:34.710170+0000 mgr.y (mgr.14140) 341 : cephadm [INF] Upgrade: Checking mgr daemons... 2021-03-10T13:48:35.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:35 gibba015 bash[9806]: cephadm 2021-03-10T13:48:34.710234+0000 mgr.y (mgr.14140) 342 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2021-03-10T13:48:35.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:35 gibba015 bash[13005]: audit 2021-03-10T13:48:34.702393+0000 mon.a (mon.0) 588 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.688141\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.688407\", \"created\": \"2021-03-10T13:40:32.015558\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"3fdfde0680ad\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.688512\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:40:34.568447\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.688672\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.688823\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.688970\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.689154\", \"created\": \"2021-03-10T13:43:22.897564\", \"started\": \"2021-03-10T13:43:26.167781\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"container_id\": \"b3907fa26ba0\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.689306\", \"created\": \"2021-03-10T13:43:42.821564\", \"started\": \"2021-03-10T13:44:24.396576\"}, \"node-exporter.b\": {\"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.689452\", \"created\": \"2021-03-10T13:43:43.861564\", \"started\": \"2021-03-10T13:43:45.351099\"}, \"grafana.a\": {\"hostname\": \"gibba045\", \"container_id\": \"d86cab6511db\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.689599\", \"created\": \"2021-03-10T13:44:08.721564\", \"started\": \"2021-03-10T13:44:08.746042\"}, \"rgw.r.z.gibba045.atotkw\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba045.atotkw\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2021-03-10T13:48:34.689744\", \"created\": \"2021-03-10T13:45:45.925564\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:21.028684\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:32.038088\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:44:17.558720\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818\"}, \"rgw.r.z.gibba045.atotkw\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:44.004644\"}}, \"last_daemon_update\": \"2021-03-10T13:48:34.690025\", \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:48:35.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:35 gibba015 bash[13005]: cephadm 2021-03-10T13:48:34.708809+0000 mgr.y (mgr.14140) 340 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a with id d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14 2021-03-10T13:48:35.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:35 gibba015 bash[13005]: audit 2021-03-10T13:48:34.709032+0000 mon.a (mon.0) 589 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:48:35.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:35 gibba015 bash[13005]: cephadm 2021-03-10T13:48:34.710170+0000 mgr.y (mgr.14140) 341 : cephadm [INF] Upgrade: Checking mgr daemons... 2021-03-10T13:48:35.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:35 gibba015 bash[13005]: cephadm 2021-03-10T13:48:34.710234+0000 mgr.y (mgr.14140) 342 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2021-03-10T13:48:36.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:36 gibba045 bash[9787]: cluster 2021-03-10T13:48:35.277797+0000 mgr.y (mgr.14140) 343 : cluster [DBG] pgmap v323: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:36.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:36 gibba015 bash[9806]: cluster 2021-03-10T13:48:35.277797+0000 mgr.y (mgr.14140) 343 : cluster [DBG] pgmap v323: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:36.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:36 gibba015 bash[13005]: cluster 2021-03-10T13:48:35.277797+0000 mgr.y (mgr.14140) 343 : cluster [DBG] pgmap v323: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:36.975 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T13:48:37.169 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T13:48:37.169 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (4m) 4m ago 4m 0.21.0 prom/alertmanager c876f5897d7b 842b16a0ff6e 2021-03-10T13:48:37.169 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (4m) 2s ago 4m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T13:48:37.170 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (8m) 2s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 3fdfde0680ad 2021-03-10T13:48:37.170 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running 2s ago 8m quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a 2021-03-10T13:48:37.170 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (9m) 4m ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 9e4717dfc4f8 2021-03-10T13:48:37.170 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (9m) 4m ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 d38e67be51e5 2021-03-10T13:48:37.171 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (8m) 2s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 2523bc3385be 2021-03-10T13:48:37.171 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (8m) 4m ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 d2d863b7e101 2021-03-10T13:48:37.171 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (4m) 4m ago 4m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T13:48:37.171 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (4m) 2s ago 4m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T13:48:37.172 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (7m) 4m ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 1e67f692bb03 2021-03-10T13:48:37.172 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (7m) 4m ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 83369fd7640c 2021-03-10T13:48:37.172 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (6m) 4m ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b90f9ada390a 2021-03-10T13:48:37.172 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (6m) 4m ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 a77eccf371e5 2021-03-10T13:48:37.173 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (6m) 2s ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 9b9c84c84955 2021-03-10T13:48:37.173 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (5m) 2s ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 662e73261675 2021-03-10T13:48:37.173 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (5m) 2s ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 338d252f22e3 2021-03-10T13:48:37.173 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (5m) 2s ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 784edc0668a4 2021-03-10T13:48:37.174 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (4m) 2s ago 4m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T13:48:37.174 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 2s ago 2m docker.io/ceph/ceph:v15.2.0 2021-03-10T13:48:37.382 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T13:48:37.382 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T13:48:37.383 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3 2021-03-10T13:48:37.383 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T13:48:37.383 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T13:48:37.383 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3 2021-03-10T13:48:37.384 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T13:48:37.384 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T13:48:37.384 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2021-03-10T13:48:37.384 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T13:48:37.384 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T13:48:37.385 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T13:48:37.385 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 14 2021-03-10T13:48:37.385 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T13:48:37.385 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T13:48:37.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:37 gibba015 bash[9806]: audit 2021-03-10T13:48:36.965952+0000 mgr.y (mgr.14140) 344 : audit [DBG] from='client.14565 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:48:37.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:37 gibba015 bash[9806]: audit 2021-03-10T13:48:37.164329+0000 mgr.y (mgr.14140) 345 : audit [DBG] from='client.24481 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:48:37.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:37 gibba015 bash[9806]: audit 2021-03-10T13:48:37.380530+0000 mon.a (mon.0) 590 : audit [DBG] from='client.? 172.21.2.115:0/2562828779' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:48:37.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:37 gibba015 bash[13005]: audit 2021-03-10T13:48:36.965952+0000 mgr.y (mgr.14140) 344 : audit [DBG] from='client.14565 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:48:37.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:37 gibba015 bash[13005]: audit 2021-03-10T13:48:37.164329+0000 mgr.y (mgr.14140) 345 : audit [DBG] from='client.24481 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:48:37.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:37 gibba015 bash[13005]: audit 2021-03-10T13:48:37.380530+0000 mon.a (mon.0) 590 : audit [DBG] from='client.? 172.21.2.115:0/2562828779' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:48:38.035 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:37 gibba045 bash[9787]: audit 2021-03-10T13:48:36.965952+0000 mgr.y (mgr.14140) 344 : audit [DBG] from='client.14565 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:48:38.035 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:37 gibba045 bash[9787]: audit 2021-03-10T13:48:37.164329+0000 mgr.y (mgr.14140) 345 : audit [DBG] from='client.24481 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:48:38.035 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:37 gibba045 bash[9787]: audit 2021-03-10T13:48:37.380530+0000 mon.a (mon.0) 590 : audit [DBG] from='client.? 172.21.2.115:0/2562828779' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:48:38.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:38 gibba015 bash[9806]: cluster 2021-03-10T13:48:37.278226+0000 mgr.y (mgr.14140) 346 : cluster [DBG] pgmap v324: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:38.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:38 gibba015 bash[9806]: cephadm 2021-03-10T13:48:37.908245+0000 mgr.y (mgr.14140) 347 : cephadm [INF] Upgrade: It is presumed safe to stop mgr.gibba045.orlgmj 2021-03-10T13:48:38.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:38 gibba015 bash[9806]: cephadm 2021-03-10T13:48:37.908457+0000 mgr.y (mgr.14140) 348 : cephadm [INF] Upgrade: Redeploying mgr.gibba045.orlgmj 2021-03-10T13:48:38.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:38 gibba015 bash[9806]: audit 2021-03-10T13:48:37.909405+0000 mon.a (mon.0) 591 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr.gibba045.orlgmj"}]: dispatch 2021-03-10T13:48:38.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:38 gibba015 bash[9806]: audit 2021-03-10T13:48:37.918479+0000 mon.a (mon.0) 592 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr.gibba045.orlgmj"}]': finished 2021-03-10T13:48:38.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:38 gibba015 bash[9806]: audit 2021-03-10T13:48:37.919474+0000 mon.a (mon.0) 593 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.gibba045.orlgmj"}]: dispatch 2021-03-10T13:48:38.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:38 gibba015 bash[9806]: audit 2021-03-10T13:48:37.920433+0000 mon.a (mon.0) 594 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:48:38.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:38 gibba015 bash[9806]: cephadm 2021-03-10T13:48:37.921200+0000 mgr.y (mgr.14140) 349 : cephadm [INF] Deploying daemon mgr.gibba045.orlgmj on gibba045 2021-03-10T13:48:38.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:38 gibba015 bash[9806]: audit 2021-03-10T13:48:37.921553+0000 mon.a (mon.0) 595 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.gibba045.orlgmj", "key": "container_image"}]: dispatch 2021-03-10T13:48:38.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:38 gibba015 bash[9806]: audit 2021-03-10T13:48:38.491127+0000 mon.b (mon.2) 24 : audit [DBG] from='mgr.? 172.21.2.145:0/4142699568' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:48:38.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:38 gibba015 bash[9806]: cluster 2021-03-10T13:48:38.491839+0000 mon.a (mon.0) 596 : cluster [DBG] Standby manager daemon x restarted 2021-03-10T13:48:38.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:38 gibba015 bash[9806]: cluster 2021-03-10T13:48:38.492098+0000 mon.a (mon.0) 597 : cluster [DBG] Standby manager daemon x started 2021-03-10T13:48:38.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:38 gibba015 bash[9806]: audit 2021-03-10T13:48:38.492232+0000 mon.b (mon.2) 25 : audit [DBG] from='mgr.? 172.21.2.145:0/4142699568' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:48:38.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:38 gibba015 bash[13005]: cluster 2021-03-10T13:48:37.278226+0000 mgr.y (mgr.14140) 346 : cluster [DBG] pgmap v324: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:38.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:38 gibba015 bash[13005]: cephadm 2021-03-10T13:48:37.908245+0000 mgr.y (mgr.14140) 347 : cephadm [INF] Upgrade: It is presumed safe to stop mgr.gibba045.orlgmj 2021-03-10T13:48:38.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:38 gibba015 bash[13005]: cephadm 2021-03-10T13:48:37.908457+0000 mgr.y (mgr.14140) 348 : cephadm [INF] Upgrade: Redeploying mgr.gibba045.orlgmj 2021-03-10T13:48:38.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:38 gibba015 bash[13005]: audit 2021-03-10T13:48:37.909405+0000 mon.a (mon.0) 591 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr.gibba045.orlgmj"}]: dispatch 2021-03-10T13:48:38.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:38 gibba015 bash[13005]: audit 2021-03-10T13:48:37.918479+0000 mon.a (mon.0) 592 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr.gibba045.orlgmj"}]': finished 2021-03-10T13:48:38.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:38 gibba015 bash[13005]: audit 2021-03-10T13:48:37.919474+0000 mon.a (mon.0) 593 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.gibba045.orlgmj"}]: dispatch 2021-03-10T13:48:38.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:38 gibba015 bash[13005]: audit 2021-03-10T13:48:37.920433+0000 mon.a (mon.0) 594 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:48:38.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:38 gibba015 bash[13005]: cephadm 2021-03-10T13:48:37.921200+0000 mgr.y (mgr.14140) 349 : cephadm [INF] Deploying daemon mgr.gibba045.orlgmj on gibba045 2021-03-10T13:48:38.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:38 gibba015 bash[13005]: audit 2021-03-10T13:48:37.921553+0000 mon.a (mon.0) 595 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.gibba045.orlgmj", "key": "container_image"}]: dispatch 2021-03-10T13:48:38.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:38 gibba015 bash[13005]: audit 2021-03-10T13:48:38.491127+0000 mon.b (mon.2) 24 : audit [DBG] from='mgr.? 172.21.2.145:0/4142699568' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:48:38.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:38 gibba015 bash[13005]: cluster 2021-03-10T13:48:38.491839+0000 mon.a (mon.0) 596 : cluster [DBG] Standby manager daemon x restarted 2021-03-10T13:48:38.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:38 gibba015 bash[13005]: cluster 2021-03-10T13:48:38.492098+0000 mon.a (mon.0) 597 : cluster [DBG] Standby manager daemon x started 2021-03-10T13:48:38.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:38 gibba015 bash[13005]: audit 2021-03-10T13:48:38.492232+0000 mon.b (mon.2) 25 : audit [DBG] from='mgr.? 172.21.2.145:0/4142699568' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:48:38.979 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:38 gibba045 bash[9787]: cluster 2021-03-10T13:48:37.278226+0000 mgr.y (mgr.14140) 346 : cluster [DBG] pgmap v324: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:38.979 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:38 gibba045 bash[9787]: cephadm 2021-03-10T13:48:37.908245+0000 mgr.y (mgr.14140) 347 : cephadm [INF] Upgrade: It is presumed safe to stop mgr.gibba045.orlgmj 2021-03-10T13:48:38.979 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:38 gibba045 bash[9787]: cephadm 2021-03-10T13:48:37.908457+0000 mgr.y (mgr.14140) 348 : cephadm [INF] Upgrade: Redeploying mgr.gibba045.orlgmj 2021-03-10T13:48:38.979 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:38 gibba045 bash[9787]: audit 2021-03-10T13:48:37.909405+0000 mon.a (mon.0) 591 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr.gibba045.orlgmj"}]: dispatch 2021-03-10T13:48:38.980 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:38 gibba045 bash[9787]: audit 2021-03-10T13:48:37.918479+0000 mon.a (mon.0) 592 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr.gibba045.orlgmj"}]': finished 2021-03-10T13:48:38.980 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:38 gibba045 bash[9787]: audit 2021-03-10T13:48:37.919474+0000 mon.a (mon.0) 593 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.gibba045.orlgmj"}]: dispatch 2021-03-10T13:48:38.980 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:38 gibba045 bash[9787]: audit 2021-03-10T13:48:37.920433+0000 mon.a (mon.0) 594 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:48:38.980 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:38 gibba045 bash[9787]: cephadm 2021-03-10T13:48:37.921200+0000 mgr.y (mgr.14140) 349 : cephadm [INF] Deploying daemon mgr.gibba045.orlgmj on gibba045 2021-03-10T13:48:38.981 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:38 gibba045 bash[9787]: audit 2021-03-10T13:48:37.921553+0000 mon.a (mon.0) 595 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.gibba045.orlgmj", "key": "container_image"}]: dispatch 2021-03-10T13:48:38.981 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:38 gibba045 bash[9787]: audit 2021-03-10T13:48:38.491127+0000 mon.b (mon.2) 24 : audit [DBG] from='mgr.? 172.21.2.145:0/4142699568' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:48:38.981 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:38 gibba045 bash[9787]: cluster 2021-03-10T13:48:38.491839+0000 mon.a (mon.0) 596 : cluster [DBG] Standby manager daemon x restarted 2021-03-10T13:48:38.981 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:38 gibba045 bash[9787]: cluster 2021-03-10T13:48:38.492098+0000 mon.a (mon.0) 597 : cluster [DBG] Standby manager daemon x started 2021-03-10T13:48:38.981 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:38 gibba045 bash[9787]: audit 2021-03-10T13:48:38.492232+0000 mon.b (mon.2) 25 : audit [DBG] from='mgr.? 172.21.2.145:0/4142699568' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:48:40.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:40 gibba045 bash[9787]: cluster 2021-03-10T13:48:39.278820+0000 mgr.y (mgr.14140) 350 : cluster [DBG] pgmap v325: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:40.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:40 gibba045 bash[9787]: cluster 2021-03-10T13:48:39.278989+0000 mon.a (mon.0) 598 : cluster [DBG] mgrmap e16: y(active, since 9m), standbys: gibba045.orlgmj, x 2021-03-10T13:48:40.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:40 gibba015 bash[9806]: cluster 2021-03-10T13:48:39.278820+0000 mgr.y (mgr.14140) 350 : cluster [DBG] pgmap v325: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:40.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:40 gibba015 bash[9806]: cluster 2021-03-10T13:48:39.278989+0000 mon.a (mon.0) 598 : cluster [DBG] mgrmap e16: y(active, since 9m), standbys: gibba045.orlgmj, x 2021-03-10T13:48:40.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:40 gibba015 bash[13005]: cluster 2021-03-10T13:48:39.278820+0000 mgr.y (mgr.14140) 350 : cluster [DBG] pgmap v325: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:40.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:40 gibba015 bash[13005]: cluster 2021-03-10T13:48:39.278989+0000 mon.a (mon.0) 598 : cluster [DBG] mgrmap e16: y(active, since 9m), standbys: gibba045.orlgmj, x 2021-03-10T13:48:42.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:42 gibba045 bash[9787]: cluster 2021-03-10T13:48:41.280108+0000 mgr.y (mgr.14140) 351 : cluster [DBG] pgmap v326: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:42.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:42 gibba015 bash[9806]: cluster 2021-03-10T13:48:41.280108+0000 mgr.y (mgr.14140) 351 : cluster [DBG] pgmap v326: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:42.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:42 gibba015 bash[13005]: cluster 2021-03-10T13:48:41.280108+0000 mgr.y (mgr.14140) 351 : cluster [DBG] pgmap v326: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:44.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:44 gibba015 bash[9806]: cluster 2021-03-10T13:48:43.281546+0000 mgr.y (mgr.14140) 352 : cluster [DBG] pgmap v327: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:44.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:44 gibba015 bash[13005]: cluster 2021-03-10T13:48:43.281546+0000 mgr.y (mgr.14140) 352 : cluster [DBG] pgmap v327: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:44.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:44 gibba045 bash[9787]: cluster 2021-03-10T13:48:43.281546+0000 mgr.y (mgr.14140) 352 : cluster [DBG] pgmap v327: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:46.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:46 gibba015 bash[9806]: cluster 2021-03-10T13:48:45.282940+0000 mgr.y (mgr.14140) 353 : cluster [DBG] pgmap v328: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:46.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:46 gibba015 bash[13005]: cluster 2021-03-10T13:48:45.282940+0000 mgr.y (mgr.14140) 353 : cluster [DBG] pgmap v328: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:46.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:46 gibba045 bash[9787]: cluster 2021-03-10T13:48:45.282940+0000 mgr.y (mgr.14140) 353 : cluster [DBG] pgmap v328: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:48.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:48 gibba045 bash[9787]: cluster 2021-03-10T13:48:47.283671+0000 mgr.y (mgr.14140) 354 : cluster [DBG] pgmap v329: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:48.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:48 gibba015 bash[9806]: cluster 2021-03-10T13:48:47.283671+0000 mgr.y (mgr.14140) 354 : cluster [DBG] pgmap v329: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:48.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:48 gibba015 bash[13005]: cluster 2021-03-10T13:48:47.283671+0000 mgr.y (mgr.14140) 354 : cluster [DBG] pgmap v329: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:50.350 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:50 gibba015 bash[9806]: cluster 2021-03-10T13:48:49.284727+0000 mgr.y (mgr.14140) 355 : cluster [DBG] pgmap v330: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:50.351 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:50 gibba015 bash[13005]: cluster 2021-03-10T13:48:49.284727+0000 mgr.y (mgr.14140) 355 : cluster [DBG] pgmap v330: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:50.607 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:50 gibba045 bash[9787]: cluster 2021-03-10T13:48:49.284727+0000 mgr.y (mgr.14140) 355 : cluster [DBG] pgmap v330: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:51.444 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:51 gibba045 bash[9787]: audit 2021-03-10T13:48:50.621391+0000 mon.a (mon.0) 599 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.688141\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.688407\", \"created\": \"2021-03-10T13:40:32.015558\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.688672\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.688823\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.688970\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.689154\", \"created\": \"2021-03-10T13:43:22.897564\", \"started\": \"2021-03-10T13:43:26.167781\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"container_id\": \"b3907fa26ba0\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.689306\", \"created\": \"2021-03-10T13:43:42.821564\", \"started\": \"2021-03-10T13:44:24.396576\"}, \"node-exporter.b\": {\"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.689452\", \"created\": \"2021-03-10T13:43:43.861564\", \"started\": \"2021-03-10T13:43:45.351099\"}, \"grafana.a\": {\"hostname\": \"gibba045\", \"container_id\": \"d86cab6511db\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.689599\", \"created\": \"2021-03-10T13:44:08.721564\", \"started\": \"2021-03-10T13:44:08.746042\"}, \"rgw.r.z.gibba045.atotkw\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba045.atotkw\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2021-03-10T13:48:34.689744\", \"created\": \"2021-03-10T13:45:45.925564\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:21.028684\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:37.919264\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:44:17.558720\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818\"}, \"rgw.r.z.gibba045.atotkw\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:44.004644\"}}, \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:48:51.445 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:51 gibba045 bash[9787]: audit 2021-03-10T13:48:50.630609+0000 mon.a (mon.0) 600 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.688141\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.688407\", \"created\": \"2021-03-10T13:40:32.015558\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.688672\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.688823\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.688970\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.689154\", \"created\": \"2021-03-10T13:43:22.897564\", \"started\": \"2021-03-10T13:43:26.167781\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"container_id\": \"b3907fa26ba0\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.689306\", \"created\": \"2021-03-10T13:43:42.821564\", \"started\": \"2021-03-10T13:44:24.396576\"}, \"node-exporter.b\": {\"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.689452\", \"created\": \"2021-03-10T13:43:43.861564\", \"started\": \"2021-03-10T13:43:45.351099\"}, \"grafana.a\": {\"hostname\": \"gibba045\", \"container_id\": \"d86cab6511db\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.689599\", \"created\": \"2021-03-10T13:44:08.721564\", \"started\": \"2021-03-10T13:44:08.746042\"}, \"rgw.r.z.gibba045.atotkw\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba045.atotkw\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2021-03-10T13:48:34.689744\", \"created\": \"2021-03-10T13:45:45.925564\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:21.028684\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:37.919264\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:44:17.558720\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818\"}, \"rgw.r.z.gibba045.atotkw\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:44.004644\"}}, \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:48:51.445 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:51 gibba045 bash[9787]: audit 2021-03-10T13:48:50.631335+0000 mon.a (mon.0) 601 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:48:51.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:51 gibba015 bash[9806]: audit 2021-03-10T13:48:50.621391+0000 mon.a (mon.0) 599 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.688141\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.688407\", \"created\": \"2021-03-10T13:40:32.015558\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.688672\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.688823\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.688970\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.689154\", \"created\": \"2021-03-10T13:43:22.897564\", \"started\": \"2021-03-10T13:43:26.167781\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"container_id\": \"b3907fa26ba0\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.689306\", \"created\": \"2021-03-10T13:43:42.821564\", \"started\": \"2021-03-10T13:44:24.396576\"}, \"node-exporter.b\": {\"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.689452\", \"created\": \"2021-03-10T13:43:43.861564\", \"started\": \"2021-03-10T13:43:45.351099\"}, \"grafana.a\": {\"hostname\": \"gibba045\", \"container_id\": \"d86cab6511db\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.689599\", \"created\": \"2021-03-10T13:44:08.721564\", \"started\": \"2021-03-10T13:44:08.746042\"}, \"rgw.r.z.gibba045.atotkw\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba045.atotkw\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2021-03-10T13:48:34.689744\", \"created\": \"2021-03-10T13:45:45.925564\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:21.028684\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:37.919264\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:44:17.558720\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818\"}, \"rgw.r.z.gibba045.atotkw\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:44.004644\"}}, \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:48:51.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:51 gibba015 bash[9806]: audit 2021-03-10T13:48:50.630609+0000 mon.a (mon.0) 600 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.688141\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.688407\", \"created\": \"2021-03-10T13:40:32.015558\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.688672\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.688823\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.688970\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.689154\", \"created\": \"2021-03-10T13:43:22.897564\", \"started\": \"2021-03-10T13:43:26.167781\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"container_id\": \"b3907fa26ba0\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.689306\", \"created\": \"2021-03-10T13:43:42.821564\", \"started\": \"2021-03-10T13:44:24.396576\"}, \"node-exporter.b\": {\"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.689452\", \"created\": \"2021-03-10T13:43:43.861564\", \"started\": \"2021-03-10T13:43:45.351099\"}, \"grafana.a\": {\"hostname\": \"gibba045\", \"container_id\": \"d86cab6511db\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.689599\", \"created\": \"2021-03-10T13:44:08.721564\", \"started\": \"2021-03-10T13:44:08.746042\"}, \"rgw.r.z.gibba045.atotkw\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba045.atotkw\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2021-03-10T13:48:34.689744\", \"created\": \"2021-03-10T13:45:45.925564\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:21.028684\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:37.919264\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:44:17.558720\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818\"}, \"rgw.r.z.gibba045.atotkw\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:44.004644\"}}, \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:48:51.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:51 gibba015 bash[9806]: audit 2021-03-10T13:48:50.631335+0000 mon.a (mon.0) 601 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:48:51.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:51 gibba015 bash[13005]: audit 2021-03-10T13:48:50.621391+0000 mon.a (mon.0) 599 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.688141\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.688407\", \"created\": \"2021-03-10T13:40:32.015558\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.688672\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.688823\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.688970\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.689154\", \"created\": \"2021-03-10T13:43:22.897564\", \"started\": \"2021-03-10T13:43:26.167781\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"container_id\": \"b3907fa26ba0\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.689306\", \"created\": \"2021-03-10T13:43:42.821564\", \"started\": \"2021-03-10T13:44:24.396576\"}, \"node-exporter.b\": {\"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.689452\", \"created\": \"2021-03-10T13:43:43.861564\", \"started\": \"2021-03-10T13:43:45.351099\"}, \"grafana.a\": {\"hostname\": \"gibba045\", \"container_id\": \"d86cab6511db\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.689599\", \"created\": \"2021-03-10T13:44:08.721564\", \"started\": \"2021-03-10T13:44:08.746042\"}, \"rgw.r.z.gibba045.atotkw\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba045.atotkw\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2021-03-10T13:48:34.689744\", \"created\": \"2021-03-10T13:45:45.925564\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:21.028684\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:37.919264\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:44:17.558720\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818\"}, \"rgw.r.z.gibba045.atotkw\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:44.004644\"}}, \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:48:51.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:51 gibba015 bash[13005]: audit 2021-03-10T13:48:50.630609+0000 mon.a (mon.0) 600 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.688141\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.688407\", \"created\": \"2021-03-10T13:40:32.015558\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.688672\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.688823\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.688970\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.689154\", \"created\": \"2021-03-10T13:43:22.897564\", \"started\": \"2021-03-10T13:43:26.167781\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"container_id\": \"b3907fa26ba0\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.689306\", \"created\": \"2021-03-10T13:43:42.821564\", \"started\": \"2021-03-10T13:44:24.396576\"}, \"node-exporter.b\": {\"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.689452\", \"created\": \"2021-03-10T13:43:43.861564\", \"started\": \"2021-03-10T13:43:45.351099\"}, \"grafana.a\": {\"hostname\": \"gibba045\", \"container_id\": \"d86cab6511db\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:34.689599\", \"created\": \"2021-03-10T13:44:08.721564\", \"started\": \"2021-03-10T13:44:08.746042\"}, \"rgw.r.z.gibba045.atotkw\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba045.atotkw\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2021-03-10T13:48:34.689744\", \"created\": \"2021-03-10T13:45:45.925564\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:21.028684\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:37.919264\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:44:17.558720\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818\"}, \"rgw.r.z.gibba045.atotkw\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:44.004644\"}}, \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:48:51.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:51 gibba015 bash[13005]: audit 2021-03-10T13:48:50.631335+0000 mon.a (mon.0) 601 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:48:52.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:52 gibba015 bash[9806]: cluster 2021-03-10T13:48:51.285972+0000 mgr.y (mgr.14140) 356 : cluster [DBG] pgmap v331: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:52.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:52 gibba015 bash[13005]: cluster 2021-03-10T13:48:51.285972+0000 mgr.y (mgr.14140) 356 : cluster [DBG] pgmap v331: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:52.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:52 gibba015 bash[9806]: audit 2021-03-10T13:48:52.112726+0000 mon.a (mon.0) 602 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:52.107490\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"0b25900c63e0\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:52.107754\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:48:33.658328\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"ea964e825589\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:52.107923\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:48:50.630289\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:52.108080\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:52.108230\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:52.108376\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:52.108522\", \"created\": \"2021-03-10T13:43:22.897564\", \"started\": \"2021-03-10T13:43:26.167781\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"container_id\": \"b3907fa26ba0\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:52.108672\", \"created\": \"2021-03-10T13:43:42.821564\", \"started\": \"2021-03-10T13:44:24.396576\"}, \"node-exporter.b\": {\"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:52.108821\", \"created\": \"2021-03-10T13:43:43.861564\", \"started\": \"2021-03-10T13:43:45.351099\"}, \"grafana.a\": {\"hostname\": \"gibba045\", \"container_id\": \"d86cab6511db\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:52.108969\", \"created\": \"2021-03-10T13:44:08.721564\", \"started\": \"2021-03-10T13:44:08.746042\"}, \"rgw.r.z.gibba045.atotkw\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba045.atotkw\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2021-03-10T13:48:52.109146\", \"created\": \"2021-03-10T13:45:45.925564\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:21.028684\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:37.919264\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:44:17.558720\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818\"}, \"rgw.r.z.gibba045.atotkw\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:44.004644\"}}, \"last_daemon_update\": \"2021-03-10T13:48:52.109432\", \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:48:52.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:52 gibba015 bash[13005]: audit 2021-03-10T13:48:52.112726+0000 mon.a (mon.0) 602 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:52.107490\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"0b25900c63e0\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:52.107754\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:48:33.658328\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"ea964e825589\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:52.107923\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:48:50.630289\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:52.108080\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:52.108230\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:52.108376\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:52.108522\", \"created\": \"2021-03-10T13:43:22.897564\", \"started\": \"2021-03-10T13:43:26.167781\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"container_id\": \"b3907fa26ba0\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:52.108672\", \"created\": \"2021-03-10T13:43:42.821564\", \"started\": \"2021-03-10T13:44:24.396576\"}, \"node-exporter.b\": {\"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:52.108821\", \"created\": \"2021-03-10T13:43:43.861564\", \"started\": \"2021-03-10T13:43:45.351099\"}, \"grafana.a\": {\"hostname\": \"gibba045\", \"container_id\": \"d86cab6511db\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:52.108969\", \"created\": \"2021-03-10T13:44:08.721564\", \"started\": \"2021-03-10T13:44:08.746042\"}, \"rgw.r.z.gibba045.atotkw\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba045.atotkw\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2021-03-10T13:48:52.109146\", \"created\": \"2021-03-10T13:45:45.925564\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:21.028684\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:37.919264\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:44:17.558720\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818\"}, \"rgw.r.z.gibba045.atotkw\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:44.004644\"}}, \"last_daemon_update\": \"2021-03-10T13:48:52.109432\", \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:48:52.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:52 gibba015 bash[9806]: audit 2021-03-10T13:48:52.121606+0000 mon.a (mon.0) 603 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:52.107490\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"0b25900c63e0\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:52.107754\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:48:33.658328\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"ea964e825589\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:52.107923\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:48:50.630289\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:52.108080\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:52.108230\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:52.108376\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:52.108522\", \"created\": \"2021-03-10T13:43:22.897564\", \"started\": \"2021-03-10T13:43:26.167781\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"container_id\": \"b3907fa26ba0\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:52.108672\", \"created\": \"2021-03-10T13:43:42.821564\", \"started\": \"2021-03-10T13:44:24.396576\"}, \"node-exporter.b\": {\"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:52.108821\", \"created\": \"2021-03-10T13:43:43.861564\", \"started\": \"2021-03-10T13:43:45.351099\"}, \"grafana.a\": {\"hostname\": \"gibba045\", \"container_id\": \"d86cab6511db\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:52.108969\", \"created\": \"2021-03-10T13:44:08.721564\", \"started\": \"2021-03-10T13:44:08.746042\"}, \"rgw.r.z.gibba045.atotkw\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba045.atotkw\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2021-03-10T13:48:52.109146\", \"created\": \"2021-03-10T13:45:45.925564\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:21.028684\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:37.919264\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:44:17.558720\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818\"}, \"rgw.r.z.gibba045.atotkw\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:44.004644\"}}, \"last_daemon_update\": \"2021-03-10T13:48:52.109432\", \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:48:52.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:52 gibba015 bash[9806]: cephadm 2021-03-10T13:48:52.123135+0000 mgr.y (mgr.14140) 357 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a with id d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14 2021-03-10T13:48:52.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:52 gibba015 bash[9806]: audit 2021-03-10T13:48:52.123352+0000 mon.a (mon.0) 604 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:48:52.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:52 gibba015 bash[9806]: cephadm 2021-03-10T13:48:52.124167+0000 mgr.y (mgr.14140) 358 : cephadm [INF] Upgrade: Checking mgr daemons... 2021-03-10T13:48:52.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:52 gibba015 bash[9806]: cephadm 2021-03-10T13:48:52.124229+0000 mgr.y (mgr.14140) 359 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2021-03-10T13:48:52.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:52 gibba015 bash[9806]: cephadm 2021-03-10T13:48:52.125784+0000 mgr.y (mgr.14140) 360 : cephadm [INF] Upgrade: there are 2 other already-upgraded standby mgrs, failing over 2021-03-10T13:48:52.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:52 gibba015 bash[9806]: audit 2021-03-10T13:48:52.126176+0000 mon.a (mon.0) 605 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2021-03-10T13:48:52.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:52 gibba015 bash[9806]: cluster 2021-03-10T13:48:52.129855+0000 mon.a (mon.0) 606 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2021-03-10T13:48:52.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:52 gibba015 bash[9806]: cluster 2021-03-10T13:48:52.415584+0000 mon.a (mon.0) 607 : cluster [DBG] Standby manager daemon y started 2021-03-10T13:48:52.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:52 gibba015 bash[13005]: audit 2021-03-10T13:48:52.121606+0000 mon.a (mon.0) 603 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:52.107490\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"0b25900c63e0\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:52.107754\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:48:33.658328\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"ea964e825589\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:52.107923\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:48:50.630289\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:52.108080\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:52.108230\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:52.108376\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:52.108522\", \"created\": \"2021-03-10T13:43:22.897564\", \"started\": \"2021-03-10T13:43:26.167781\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"container_id\": \"b3907fa26ba0\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:52.108672\", \"created\": \"2021-03-10T13:43:42.821564\", \"started\": \"2021-03-10T13:44:24.396576\"}, \"node-exporter.b\": {\"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:52.108821\", \"created\": \"2021-03-10T13:43:43.861564\", \"started\": \"2021-03-10T13:43:45.351099\"}, \"grafana.a\": {\"hostname\": \"gibba045\", \"container_id\": \"d86cab6511db\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:52.108969\", \"created\": \"2021-03-10T13:44:08.721564\", \"started\": \"2021-03-10T13:44:08.746042\"}, \"rgw.r.z.gibba045.atotkw\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba045.atotkw\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2021-03-10T13:48:52.109146\", \"created\": \"2021-03-10T13:45:45.925564\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:21.028684\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:37.919264\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:44:17.558720\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818\"}, \"rgw.r.z.gibba045.atotkw\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:44.004644\"}}, \"last_daemon_update\": \"2021-03-10T13:48:52.109432\", \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:48:52.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:52 gibba015 bash[13005]: cephadm 2021-03-10T13:48:52.123135+0000 mgr.y (mgr.14140) 357 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a with id d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14 2021-03-10T13:48:52.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:52 gibba015 bash[13005]: audit 2021-03-10T13:48:52.123352+0000 mon.a (mon.0) 604 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:48:52.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:52 gibba015 bash[13005]: cephadm 2021-03-10T13:48:52.124167+0000 mgr.y (mgr.14140) 358 : cephadm [INF] Upgrade: Checking mgr daemons... 2021-03-10T13:48:52.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:52 gibba015 bash[13005]: cephadm 2021-03-10T13:48:52.124229+0000 mgr.y (mgr.14140) 359 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2021-03-10T13:48:52.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:52 gibba015 bash[13005]: cephadm 2021-03-10T13:48:52.125784+0000 mgr.y (mgr.14140) 360 : cephadm [INF] Upgrade: there are 2 other already-upgraded standby mgrs, failing over 2021-03-10T13:48:52.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:52 gibba015 bash[13005]: audit 2021-03-10T13:48:52.126176+0000 mon.a (mon.0) 605 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2021-03-10T13:48:52.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:52 gibba015 bash[13005]: cluster 2021-03-10T13:48:52.129855+0000 mon.a (mon.0) 606 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2021-03-10T13:48:52.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:52 gibba015 bash[13005]: cluster 2021-03-10T13:48:52.415584+0000 mon.a (mon.0) 607 : cluster [DBG] Standby manager daemon y started 2021-03-10T13:48:53.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:52 gibba045 bash[9787]: cluster 2021-03-10T13:48:51.285972+0000 mgr.y (mgr.14140) 356 : cluster [DBG] pgmap v331: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:53.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:52 gibba045 bash[9787]: audit 2021-03-10T13:48:52.112726+0000 mon.a (mon.0) 602 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:52.107490\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"0b25900c63e0\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:52.107754\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:48:33.658328\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"ea964e825589\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:52.107923\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:48:50.630289\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:52.108080\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:52.108230\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:52.108376\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:52.108522\", \"created\": \"2021-03-10T13:43:22.897564\", \"started\": \"2021-03-10T13:43:26.167781\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"container_id\": \"b3907fa26ba0\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:52.108672\", \"created\": \"2021-03-10T13:43:42.821564\", \"started\": \"2021-03-10T13:44:24.396576\"}, \"node-exporter.b\": {\"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:52.108821\", \"created\": \"2021-03-10T13:43:43.861564\", \"started\": \"2021-03-10T13:43:45.351099\"}, \"grafana.a\": {\"hostname\": \"gibba045\", \"container_id\": \"d86cab6511db\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:52.108969\", \"created\": \"2021-03-10T13:44:08.721564\", \"started\": \"2021-03-10T13:44:08.746042\"}, \"rgw.r.z.gibba045.atotkw\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba045.atotkw\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2021-03-10T13:48:52.109146\", \"created\": \"2021-03-10T13:45:45.925564\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:21.028684\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:37.919264\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:44:17.558720\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818\"}, \"rgw.r.z.gibba045.atotkw\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:44.004644\"}}, \"last_daemon_update\": \"2021-03-10T13:48:52.109432\", \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]: dispatch 2021-03-10T13:48:53.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:52 gibba045 bash[9787]: audit 2021-03-10T13:48:52.121606+0000 mon.a (mon.0) 603 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:52.107490\", \"created\": \"2021-03-10T13:40:16.047558\", \"started\": \"2021-03-10T13:40:16.069701\"}, \"mgr.x\": {\"hostname\": \"gibba045\", \"container_id\": \"0b25900c63e0\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:52.107754\", \"created\": \"2021-03-10T13:40:32.015558\", \"started\": \"2021-03-10T13:48:33.658328\"}, \"mgr.gibba045.orlgmj\": {\"hostname\": \"gibba045\", \"container_id\": \"ea964e825589\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"gibba045.orlgmj\", \"daemon_type\": \"mgr\", \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:52.107923\", \"created\": \"2021-03-10T13:40:34.535558\", \"started\": \"2021-03-10T13:48:50.630289\"}, \"osd.4\": {\"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:52.108080\", \"created\": \"2021-03-10T13:42:17.077564\", \"started\": \"2021-03-10T13:42:20.232803\"}, \"osd.5\": {\"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:52.108230\", \"created\": \"2021-03-10T13:42:38.781564\", \"started\": \"2021-03-10T13:42:42.298036\"}, \"osd.6\": {\"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:52.108376\", \"created\": \"2021-03-10T13:43:00.493564\", \"started\": \"2021-03-10T13:43:03.477079\"}, \"osd.7\": {\"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:52.108522\", \"created\": \"2021-03-10T13:43:22.897564\", \"started\": \"2021-03-10T13:43:26.167781\"}, \"prometheus.a\": {\"hostname\": \"gibba045\", \"container_id\": \"b3907fa26ba0\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:52.108672\", \"created\": \"2021-03-10T13:43:42.821564\", \"started\": \"2021-03-10T13:44:24.396576\"}, \"node-exporter.b\": {\"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:52.108821\", \"created\": \"2021-03-10T13:43:43.861564\", \"started\": \"2021-03-10T13:43:45.351099\"}, \"grafana.a\": {\"hostname\": \"gibba045\", \"container_id\": \"d86cab6511db\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:52.108969\", \"created\": \"2021-03-10T13:44:08.721564\", \"started\": \"2021-03-10T13:44:08.746042\"}, \"rgw.r.z.gibba045.atotkw\": {\"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba045.atotkw\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2021-03-10T13:48:52.109146\", \"created\": \"2021-03-10T13:45:45.925564\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:21.028684\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:37.919264\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:44:17.558720\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818\"}, \"rgw.r.z.gibba045.atotkw\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:44.004644\"}}, \"last_daemon_update\": \"2021-03-10T13:48:52.109432\", \"last_device_update\": \"2021-03-10T13:43:30.693305\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445\"}"}]': finished 2021-03-10T13:48:53.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:52 gibba045 bash[9787]: cephadm 2021-03-10T13:48:52.123135+0000 mgr.y (mgr.14140) 357 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a with id d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14 2021-03-10T13:48:53.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:52 gibba045 bash[9787]: audit 2021-03-10T13:48:52.123352+0000 mon.a (mon.0) 604 : audit [DBG] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:48:53.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:52 gibba045 bash[9787]: cephadm 2021-03-10T13:48:52.124167+0000 mgr.y (mgr.14140) 358 : cephadm [INF] Upgrade: Checking mgr daemons... 2021-03-10T13:48:53.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:52 gibba045 bash[9787]: cephadm 2021-03-10T13:48:52.124229+0000 mgr.y (mgr.14140) 359 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2021-03-10T13:48:53.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:52 gibba045 bash[9787]: cephadm 2021-03-10T13:48:52.125784+0000 mgr.y (mgr.14140) 360 : cephadm [INF] Upgrade: there are 2 other already-upgraded standby mgrs, failing over 2021-03-10T13:48:53.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:52 gibba045 bash[9787]: audit 2021-03-10T13:48:52.126176+0000 mon.a (mon.0) 605 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2021-03-10T13:48:53.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:52 gibba045 bash[9787]: cluster 2021-03-10T13:48:52.129855+0000 mon.a (mon.0) 606 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2021-03-10T13:48:53.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:52 gibba045 bash[9787]: cluster 2021-03-10T13:48:52.415584+0000 mon.a (mon.0) 607 : cluster [DBG] Standby manager daemon y started 2021-03-10T13:48:53.471 INFO:journalctl@ceph.mgr.y.gibba015.stdout:Mar 10 13:48:53 gibba015 bash[10036]: debug 2021-03-10T13:48:53.123+0000 7fdf779b6700 -1 mgr handle_mgr_map I was active but no longer am 2021-03-10T13:48:53.471 INFO:journalctl@ceph.mgr.y.gibba015.stdout:Mar 10 13:48:53 gibba015 bash[10036]: ignoring --setuser ceph since I am not root 2021-03-10T13:48:53.471 INFO:journalctl@ceph.mgr.y.gibba015.stdout:Mar 10 13:48:53 gibba015 bash[10036]: ignoring --setgroup ceph since I am not root 2021-03-10T13:48:53.472 INFO:journalctl@ceph.mgr.y.gibba015.stdout:Mar 10 13:48:53 gibba015 bash[10036]: debug 2021-03-10T13:48:53.151+0000 7f4c30afc040 1 -- 172.21.2.115:0/1500804572 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x559518f5b000 msgr2=0x559519bda480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-10T13:48:53.472 INFO:journalctl@ceph.mgr.y.gibba015.stdout:Mar 10 13:48:53 gibba015 bash[10036]: debug 2021-03-10T13:48:53.151+0000 7f4c30afc040 1 --2- 172.21.2.115:0/1500804572 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x559518f5b000 0x559519bda480 secure :-1 s=READY pgs=149 cs=0 l=1 rx=0x559518f4d140 tx=0x559518f4f7c0).stop 2021-03-10T13:48:53.472 INFO:journalctl@ceph.mgr.y.gibba015.stdout:Mar 10 13:48:53 gibba015 bash[10036]: debug 2021-03-10T13:48:53.151+0000 7f4c30afc040 -1 asok(0x559518f56000) AdminSocketConfigObs::init: failed: AdminSocket::bind_and_listen: failed to bind the UNIX domain socket to '/var/run/ceph/ceph-mgr.y.asok': (13) Permission denied 2021-03-10T13:48:54.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:54 gibba015 bash[9806]: audit 2021-03-10T13:48:53.129885+0000 mon.a (mon.0) 608 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix": "mgr fail", "who": "y"}]': finished 2021-03-10T13:48:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:54 gibba015 bash[9806]: cluster 2021-03-10T13:48:53.129922+0000 mon.a (mon.0) 609 : cluster [DBG] mgrmap e17: gibba045.orlgmj(active, starting, since 1.00325s), standbys: y, x 2021-03-10T13:48:54.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:54 gibba015 bash[13005]: audit 2021-03-10T13:48:53.129885+0000 mon.a (mon.0) 608 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix": "mgr fail", "who": "y"}]': finished 2021-03-10T13:48:54.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:54 gibba015 bash[13005]: cluster 2021-03-10T13:48:53.129922+0000 mon.a (mon.0) 609 : cluster [DBG] mgrmap e17: gibba045.orlgmj(active, starting, since 1.00325s), standbys: y, x 2021-03-10T13:48:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:54 gibba045 bash[9787]: audit 2021-03-10T13:48:53.129885+0000 mon.a (mon.0) 608 : audit [INF] from='mgr.14140 172.21.2.115:0/3251448373' entity='mgr.y' cmd='[{"prefix": "mgr fail", "who": "y"}]': finished 2021-03-10T13:48:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:54 gibba045 bash[9787]: cluster 2021-03-10T13:48:53.129922+0000 mon.a (mon.0) 609 : cluster [DBG] mgrmap e17: gibba045.orlgmj(active, starting, since 1.00325s), standbys: y, x 2021-03-10T13:48:55.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:55 gibba015 bash[9806]: cluster 2021-03-10T13:48:55.301764+0000 mon.a (mon.0) 610 : cluster [INF] Active manager daemon gibba045.orlgmj restarted 2021-03-10T13:48:55.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:55 gibba015 bash[9806]: cluster 2021-03-10T13:48:55.302471+0000 mon.a (mon.0) 611 : cluster [INF] Activating manager daemon gibba045.orlgmj 2021-03-10T13:48:55.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:55 gibba015 bash[9806]: audit 2021-03-10T13:48:55.302732+0000 mon.b (mon.2) 26 : audit [DBG] from='mgr.? 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:48:55.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:55 gibba015 bash[9806]: cluster 2021-03-10T13:48:55.306136+0000 mon.a (mon.0) 612 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2021-03-10T13:48:55.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:55 gibba015 bash[9806]: audit 2021-03-10T13:48:55.306238+0000 mon.b (mon.2) 27 : audit [DBG] from='mgr.? 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:48:55.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:55 gibba015 bash[13005]: cluster 2021-03-10T13:48:55.301764+0000 mon.a (mon.0) 610 : cluster [INF] Active manager daemon gibba045.orlgmj restarted 2021-03-10T13:48:55.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:55 gibba015 bash[13005]: cluster 2021-03-10T13:48:55.302471+0000 mon.a (mon.0) 611 : cluster [INF] Activating manager daemon gibba045.orlgmj 2021-03-10T13:48:55.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:55 gibba015 bash[13005]: audit 2021-03-10T13:48:55.302732+0000 mon.b (mon.2) 26 : audit [DBG] from='mgr.? 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:48:55.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:55 gibba015 bash[13005]: cluster 2021-03-10T13:48:55.306136+0000 mon.a (mon.0) 612 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2021-03-10T13:48:55.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:55 gibba015 bash[13005]: audit 2021-03-10T13:48:55.306238+0000 mon.b (mon.2) 27 : audit [DBG] from='mgr.? 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:48:55.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:55 gibba045 bash[9787]: cluster 2021-03-10T13:48:55.301764+0000 mon.a (mon.0) 610 : cluster [INF] Active manager daemon gibba045.orlgmj restarted 2021-03-10T13:48:55.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:55 gibba045 bash[9787]: cluster 2021-03-10T13:48:55.302471+0000 mon.a (mon.0) 611 : cluster [INF] Activating manager daemon gibba045.orlgmj 2021-03-10T13:48:55.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:55 gibba045 bash[9787]: audit 2021-03-10T13:48:55.302732+0000 mon.b (mon.2) 26 : audit [DBG] from='mgr.? 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:48:55.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:55 gibba045 bash[9787]: cluster 2021-03-10T13:48:55.306136+0000 mon.a (mon.0) 612 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2021-03-10T13:48:55.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:55 gibba045 bash[9787]: audit 2021-03-10T13:48:55.306238+0000 mon.b (mon.2) 27 : audit [DBG] from='mgr.? 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:48:56.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[9806]: cluster 2021-03-10T13:48:55.359188+0000 mon.a (mon.0) 613 : cluster [DBG] mgrmap e18: gibba045.orlgmj(active, starting, since 0.0568588s), standbys: y, x 2021-03-10T13:48:56.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[9806]: audit 2021-03-10T13:48:55.364558+0000 mon.b (mon.2) 28 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "mgr metadata", "who": "gibba045.orlgmj", "id": "gibba045.orlgmj"}]: dispatch 2021-03-10T13:48:56.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[9806]: audit 2021-03-10T13:48:55.364731+0000 mon.b (mon.2) 29 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-03-10T13:48:56.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[9806]: audit 2021-03-10T13:48:55.364870+0000 mon.b (mon.2) 30 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-03-10T13:48:56.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[9806]: audit 2021-03-10T13:48:55.365054+0000 mon.b (mon.2) 31 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T13:48:56.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[9806]: audit 2021-03-10T13:48:55.365239+0000 mon.b (mon.2) 32 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T13:48:56.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[9806]: audit 2021-03-10T13:48:55.365399+0000 mon.b (mon.2) 33 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T13:48:56.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[9806]: audit 2021-03-10T13:48:55.365573+0000 mon.b (mon.2) 34 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T13:48:56.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[9806]: audit 2021-03-10T13:48:55.365736+0000 mon.b (mon.2) 35 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T13:48:56.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[9806]: audit 2021-03-10T13:48:55.365903+0000 mon.b (mon.2) 36 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T13:48:56.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[9806]: audit 2021-03-10T13:48:55.366055+0000 mon.b (mon.2) 37 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T13:48:56.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[9806]: audit 2021-03-10T13:48:55.366217+0000 mon.b (mon.2) 38 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T13:48:56.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[9806]: audit 2021-03-10T13:48:55.366383+0000 mon.b (mon.2) 39 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-03-10T13:48:56.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[9806]: audit 2021-03-10T13:48:55.366510+0000 mon.b (mon.2) 40 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-03-10T13:48:56.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[9806]: audit 2021-03-10T13:48:55.366861+0000 mon.b (mon.2) 41 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-03-10T13:48:56.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[9806]: audit 2021-03-10T13:48:55.367576+0000 mon.b (mon.2) 42 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key ls"}]: dispatch 2021-03-10T13:48:56.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[9806]: audit 2021-03-10T13:48:55.368287+0000 mon.b (mon.2) 43 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2021-03-10T13:48:56.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[13005]: cluster 2021-03-10T13:48:55.359188+0000 mon.a (mon.0) 613 : cluster [DBG] mgrmap e18: gibba045.orlgmj(active, starting, since 0.0568588s), standbys: y, x 2021-03-10T13:48:56.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[13005]: audit 2021-03-10T13:48:55.364558+0000 mon.b (mon.2) 28 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "mgr metadata", "who": "gibba045.orlgmj", "id": "gibba045.orlgmj"}]: dispatch 2021-03-10T13:48:56.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[13005]: audit 2021-03-10T13:48:55.364731+0000 mon.b (mon.2) 29 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-03-10T13:48:56.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[13005]: audit 2021-03-10T13:48:55.364870+0000 mon.b (mon.2) 30 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-03-10T13:48:56.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[13005]: audit 2021-03-10T13:48:55.365054+0000 mon.b (mon.2) 31 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T13:48:56.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[13005]: audit 2021-03-10T13:48:55.365239+0000 mon.b (mon.2) 32 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T13:48:56.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[13005]: audit 2021-03-10T13:48:55.365399+0000 mon.b (mon.2) 33 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T13:48:56.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[13005]: audit 2021-03-10T13:48:55.365573+0000 mon.b (mon.2) 34 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T13:48:56.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[13005]: audit 2021-03-10T13:48:55.365736+0000 mon.b (mon.2) 35 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T13:48:56.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[13005]: audit 2021-03-10T13:48:55.365903+0000 mon.b (mon.2) 36 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T13:48:56.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[13005]: audit 2021-03-10T13:48:55.366055+0000 mon.b (mon.2) 37 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T13:48:56.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[13005]: audit 2021-03-10T13:48:55.366217+0000 mon.b (mon.2) 38 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T13:48:56.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[13005]: audit 2021-03-10T13:48:55.366383+0000 mon.b (mon.2) 39 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-03-10T13:48:56.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[13005]: audit 2021-03-10T13:48:55.366510+0000 mon.b (mon.2) 40 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-03-10T13:48:56.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[13005]: audit 2021-03-10T13:48:55.366861+0000 mon.b (mon.2) 41 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-03-10T13:48:56.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[13005]: audit 2021-03-10T13:48:55.367576+0000 mon.b (mon.2) 42 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key ls"}]: dispatch 2021-03-10T13:48:56.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[13005]: audit 2021-03-10T13:48:55.368287+0000 mon.b (mon.2) 43 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2021-03-10T13:48:56.729 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[9806]: audit 2021-03-10T13:48:55.368703+0000 mon.b (mon.2) 44 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2021-03-10T13:48:56.730 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[9806]: audit 2021-03-10T13:48:55.369107+0000 mon.b (mon.2) 45 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.gibba015"}]: dispatch 2021-03-10T13:48:56.730 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[9806]: audit 2021-03-10T13:48:55.369581+0000 mon.b (mon.2) 46 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.gibba045"}]: dispatch 2021-03-10T13:48:56.730 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[9806]: audit 2021-03-10T13:48:55.370035+0000 mon.b (mon.2) 47 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2021-03-10T13:48:56.730 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[9806]: audit 2021-03-10T13:48:55.370389+0000 mon.b (mon.2) 48 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2021-03-10T13:48:56.731 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[9806]: audit 2021-03-10T13:48:55.370728+0000 mon.b (mon.2) 49 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2021-03-10T13:48:56.731 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[9806]: audit 2021-03-10T13:48:55.371116+0000 mon.b (mon.2) 50 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2021-03-10T13:48:56.731 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[9806]: audit 2021-03-10T13:48:55.371492+0000 mon.b (mon.2) 51 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2021-03-10T13:48:56.731 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[9806]: audit 2021-03-10T13:48:55.371920+0000 mon.b (mon.2) 52 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2021-03-10T13:48:56.731 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[9806]: audit 2021-03-10T13:48:55.372286+0000 mon.b (mon.2) 53 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2021-03-10T13:48:56.732 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[9806]: audit 2021-03-10T13:48:55.372523+0000 mon.b (mon.2) 54 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2021-03-10T13:48:56.732 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[9806]: audit 2021-03-10T13:48:55.372791+0000 mon.b (mon.2) 55 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2021-03-10T13:48:56.732 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[9806]: audit 2021-03-10T13:48:55.373052+0000 mon.b (mon.2) 56 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2021-03-10T13:48:56.732 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[9806]: audit 2021-03-10T13:48:55.373308+0000 mon.b (mon.2) 57 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2021-03-10T13:48:56.733 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[9806]: audit 2021-03-10T13:48:55.373599+0000 mon.b (mon.2) 58 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:48:56.733 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[9806]: audit 2021-03-10T13:48:55.373854+0000 mon.b (mon.2) 59 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:48:56.733 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[13005]: audit 2021-03-10T13:48:55.368703+0000 mon.b (mon.2) 44 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2021-03-10T13:48:56.733 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[13005]: audit 2021-03-10T13:48:55.369107+0000 mon.b (mon.2) 45 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.gibba015"}]: dispatch 2021-03-10T13:48:56.734 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[13005]: audit 2021-03-10T13:48:55.369581+0000 mon.b (mon.2) 46 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.gibba045"}]: dispatch 2021-03-10T13:48:56.734 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[13005]: audit 2021-03-10T13:48:55.370035+0000 mon.b (mon.2) 47 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2021-03-10T13:48:56.734 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[13005]: audit 2021-03-10T13:48:55.370389+0000 mon.b (mon.2) 48 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2021-03-10T13:48:56.734 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[13005]: audit 2021-03-10T13:48:55.370728+0000 mon.b (mon.2) 49 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2021-03-10T13:48:56.735 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[13005]: audit 2021-03-10T13:48:55.371116+0000 mon.b (mon.2) 50 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2021-03-10T13:48:56.735 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[13005]: audit 2021-03-10T13:48:55.371492+0000 mon.b (mon.2) 51 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2021-03-10T13:48:56.735 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[13005]: audit 2021-03-10T13:48:55.371920+0000 mon.b (mon.2) 52 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2021-03-10T13:48:56.735 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[13005]: audit 2021-03-10T13:48:55.372286+0000 mon.b (mon.2) 53 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2021-03-10T13:48:56.735 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[13005]: audit 2021-03-10T13:48:55.372523+0000 mon.b (mon.2) 54 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2021-03-10T13:48:56.736 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[13005]: audit 2021-03-10T13:48:55.372791+0000 mon.b (mon.2) 55 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2021-03-10T13:48:56.736 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[13005]: audit 2021-03-10T13:48:55.373052+0000 mon.b (mon.2) 56 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2021-03-10T13:48:56.736 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[13005]: audit 2021-03-10T13:48:55.373308+0000 mon.b (mon.2) 57 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2021-03-10T13:48:56.736 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[13005]: audit 2021-03-10T13:48:55.373599+0000 mon.b (mon.2) 58 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:48:56.737 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[13005]: audit 2021-03-10T13:48:55.373854+0000 mon.b (mon.2) 59 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:48:56.737 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[9806]: audit 2021-03-10T13:48:55.374087+0000 mon.b (mon.2) 60 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2021-03-10T13:48:56.737 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[9806]: audit 2021-03-10T13:48:55.374270+0000 mon.b (mon.2) 61 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2021-03-10T13:48:56.738 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[9806]: audit 2021-03-10T13:48:55.374509+0000 mon.b (mon.2) 62 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2021-03-10T13:48:56.738 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[9806]: audit 2021-03-10T13:48:55.374715+0000 mon.b (mon.2) 63 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2021-03-10T13:48:56.738 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[9806]: cluster 2021-03-10T13:48:55.902214+0000 mon.a (mon.0) 614 : cluster [DBG] Standby manager daemon y restarted 2021-03-10T13:48:56.738 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[9806]: cluster 2021-03-10T13:48:55.902320+0000 mon.a (mon.0) 615 : cluster [DBG] Standby manager daemon y started 2021-03-10T13:48:56.738 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[9806]: audit 2021-03-10T13:48:55.903169+0000 mon.a (mon.0) 616 : audit [DBG] from='mgr.? 172.21.2.115:0/2957924757' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:48:56.739 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[9806]: audit 2021-03-10T13:48:55.903974+0000 mon.a (mon.0) 617 : audit [DBG] from='mgr.? 172.21.2.115:0/2957924757' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:48:56.739 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[13005]: audit 2021-03-10T13:48:55.374087+0000 mon.b (mon.2) 60 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2021-03-10T13:48:56.739 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[13005]: audit 2021-03-10T13:48:55.374270+0000 mon.b (mon.2) 61 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2021-03-10T13:48:56.739 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[13005]: audit 2021-03-10T13:48:55.374509+0000 mon.b (mon.2) 62 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2021-03-10T13:48:56.740 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[13005]: audit 2021-03-10T13:48:55.374715+0000 mon.b (mon.2) 63 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2021-03-10T13:48:56.740 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[13005]: cluster 2021-03-10T13:48:55.902214+0000 mon.a (mon.0) 614 : cluster [DBG] Standby manager daemon y restarted 2021-03-10T13:48:56.740 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[13005]: cluster 2021-03-10T13:48:55.902320+0000 mon.a (mon.0) 615 : cluster [DBG] Standby manager daemon y started 2021-03-10T13:48:56.740 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[13005]: audit 2021-03-10T13:48:55.903169+0000 mon.a (mon.0) 616 : audit [DBG] from='mgr.? 172.21.2.115:0/2957924757' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:48:56.740 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:56 gibba015 bash[13005]: audit 2021-03-10T13:48:55.903974+0000 mon.a (mon.0) 617 : audit [DBG] from='mgr.? 172.21.2.115:0/2957924757' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:48:56.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:56 gibba045 bash[9787]: cluster 2021-03-10T13:48:55.359188+0000 mon.a (mon.0) 613 : cluster [DBG] mgrmap e18: gibba045.orlgmj(active, starting, since 0.0568588s), standbys: y, x 2021-03-10T13:48:56.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:56 gibba045 bash[9787]: audit 2021-03-10T13:48:55.364558+0000 mon.b (mon.2) 28 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "mgr metadata", "who": "gibba045.orlgmj", "id": "gibba045.orlgmj"}]: dispatch 2021-03-10T13:48:56.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:56 gibba045 bash[9787]: audit 2021-03-10T13:48:55.364731+0000 mon.b (mon.2) 29 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-03-10T13:48:56.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:56 gibba045 bash[9787]: audit 2021-03-10T13:48:55.364870+0000 mon.b (mon.2) 30 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-03-10T13:48:56.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:56 gibba045 bash[9787]: audit 2021-03-10T13:48:55.365054+0000 mon.b (mon.2) 31 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T13:48:56.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:56 gibba045 bash[9787]: audit 2021-03-10T13:48:55.365239+0000 mon.b (mon.2) 32 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T13:48:56.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:56 gibba045 bash[9787]: audit 2021-03-10T13:48:55.365399+0000 mon.b (mon.2) 33 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T13:48:56.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:56 gibba045 bash[9787]: audit 2021-03-10T13:48:55.365573+0000 mon.b (mon.2) 34 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T13:48:56.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:56 gibba045 bash[9787]: audit 2021-03-10T13:48:55.365736+0000 mon.b (mon.2) 35 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T13:48:56.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:56 gibba045 bash[9787]: audit 2021-03-10T13:48:55.365903+0000 mon.b (mon.2) 36 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T13:48:56.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:56 gibba045 bash[9787]: audit 2021-03-10T13:48:55.366055+0000 mon.b (mon.2) 37 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T13:48:56.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:56 gibba045 bash[9787]: audit 2021-03-10T13:48:55.366217+0000 mon.b (mon.2) 38 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T13:48:56.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:56 gibba045 bash[9787]: audit 2021-03-10T13:48:55.366383+0000 mon.b (mon.2) 39 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-03-10T13:48:56.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:56 gibba045 bash[9787]: audit 2021-03-10T13:48:55.366510+0000 mon.b (mon.2) 40 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-03-10T13:48:56.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:56 gibba045 bash[9787]: audit 2021-03-10T13:48:55.366861+0000 mon.b (mon.2) 41 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-03-10T13:48:56.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:56 gibba045 bash[9787]: audit 2021-03-10T13:48:55.367576+0000 mon.b (mon.2) 42 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key ls"}]: dispatch 2021-03-10T13:48:56.812 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:56 gibba045 bash[9787]: audit 2021-03-10T13:48:55.368287+0000 mon.b (mon.2) 43 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2021-03-10T13:48:56.812 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:56 gibba045 bash[9787]: audit 2021-03-10T13:48:55.368703+0000 mon.b (mon.2) 44 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2021-03-10T13:48:56.813 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:56 gibba045 bash[9787]: audit 2021-03-10T13:48:55.369107+0000 mon.b (mon.2) 45 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.gibba015"}]: dispatch 2021-03-10T13:48:56.813 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:56 gibba045 bash[9787]: audit 2021-03-10T13:48:55.369581+0000 mon.b (mon.2) 46 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.gibba045"}]: dispatch 2021-03-10T13:48:56.813 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:56 gibba045 bash[9787]: audit 2021-03-10T13:48:55.370035+0000 mon.b (mon.2) 47 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2021-03-10T13:48:56.813 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:56 gibba045 bash[9787]: audit 2021-03-10T13:48:55.370389+0000 mon.b (mon.2) 48 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2021-03-10T13:48:56.814 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:56 gibba045 bash[9787]: audit 2021-03-10T13:48:55.370728+0000 mon.b (mon.2) 49 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2021-03-10T13:48:56.814 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:56 gibba045 bash[9787]: audit 2021-03-10T13:48:55.371116+0000 mon.b (mon.2) 50 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2021-03-10T13:48:56.814 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:56 gibba045 bash[9787]: audit 2021-03-10T13:48:55.371492+0000 mon.b (mon.2) 51 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2021-03-10T13:48:56.814 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:56 gibba045 bash[9787]: audit 2021-03-10T13:48:55.371920+0000 mon.b (mon.2) 52 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2021-03-10T13:48:56.815 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:56 gibba045 bash[9787]: audit 2021-03-10T13:48:55.372286+0000 mon.b (mon.2) 53 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2021-03-10T13:48:56.815 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:56 gibba045 bash[9787]: audit 2021-03-10T13:48:55.372523+0000 mon.b (mon.2) 54 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2021-03-10T13:48:56.815 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:56 gibba045 bash[9787]: audit 2021-03-10T13:48:55.372791+0000 mon.b (mon.2) 55 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2021-03-10T13:48:56.815 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:56 gibba045 bash[9787]: audit 2021-03-10T13:48:55.373052+0000 mon.b (mon.2) 56 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2021-03-10T13:48:56.815 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:56 gibba045 bash[9787]: audit 2021-03-10T13:48:55.373308+0000 mon.b (mon.2) 57 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2021-03-10T13:48:56.816 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:56 gibba045 bash[9787]: audit 2021-03-10T13:48:55.373599+0000 mon.b (mon.2) 58 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:48:56.816 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:56 gibba045 bash[9787]: audit 2021-03-10T13:48:55.373854+0000 mon.b (mon.2) 59 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:48:56.816 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:56 gibba045 bash[9787]: audit 2021-03-10T13:48:55.374087+0000 mon.b (mon.2) 60 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2021-03-10T13:48:56.816 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:56 gibba045 bash[9787]: audit 2021-03-10T13:48:55.374270+0000 mon.b (mon.2) 61 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2021-03-10T13:48:56.816 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:56 gibba045 bash[9787]: audit 2021-03-10T13:48:55.374509+0000 mon.b (mon.2) 62 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2021-03-10T13:48:56.817 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:56 gibba045 bash[9787]: audit 2021-03-10T13:48:55.374715+0000 mon.b (mon.2) 63 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2021-03-10T13:48:56.817 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:56 gibba045 bash[9787]: cluster 2021-03-10T13:48:55.902214+0000 mon.a (mon.0) 614 : cluster [DBG] Standby manager daemon y restarted 2021-03-10T13:48:56.817 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:56 gibba045 bash[9787]: cluster 2021-03-10T13:48:55.902320+0000 mon.a (mon.0) 615 : cluster [DBG] Standby manager daemon y started 2021-03-10T13:48:56.817 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:56 gibba045 bash[9787]: audit 2021-03-10T13:48:55.903169+0000 mon.a (mon.0) 616 : audit [DBG] from='mgr.? 172.21.2.115:0/2957924757' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:48:56.817 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:56 gibba045 bash[9787]: audit 2021-03-10T13:48:55.903974+0000 mon.a (mon.0) 617 : audit [DBG] from='mgr.? 172.21.2.115:0/2957924757' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:48:57.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:57 gibba015 bash[9806]: audit 2021-03-10T13:48:56.376112+0000 mon.b (mon.2) 64 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config set","value":"0","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T13:48:57.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:57 gibba015 bash[9806]: cluster 2021-03-10T13:48:56.378598+0000 mon.a (mon.0) 618 : cluster [INF] Manager daemon gibba045.orlgmj is now available 2021-03-10T13:48:57.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:57 gibba015 bash[9806]: cluster 2021-03-10T13:48:56.378678+0000 mon.a (mon.0) 619 : cluster [DBG] mgrmap e19: gibba045.orlgmj(active, starting, since 1.07635s), standbys: y, x 2021-03-10T13:48:57.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:57 gibba015 bash[9806]: audit 2021-03-10T13:48:56.379853+0000 mon.a (mon.0) 620 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config set","value":"0","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T13:48:57.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:57 gibba015 bash[9806]: audit 2021-03-10T13:48:56.383164+0000 mon.a (mon.0) 621 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix":"config set","value":"0","who":"mgr","name":"mgr/cephadm/migration_current"}]': finished 2021-03-10T13:48:57.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:57 gibba015 bash[9806]: cephadm 2021-03-10T13:48:56.385558+0000 mgr.gibba045.orlgmj (mgr.34379) 2 : cephadm [INF] Migrating to explicit placement 2021-03-10T13:48:57.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:57 gibba015 bash[9806]: audit 2021-03-10T13:48:56.385861+0000 mon.b (mon.2) 65 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2021-03-10T13:48:56.385568Z\", \"spec\": {\"placement\": {\"count\": 3, \"hosts\": [\"gibba015=y\", \"gibba045=x\", \"gibba045=x\"]}, \"service_name\": \"mgr\", \"service_type\": \"mgr\"}}"}]: dispatch 2021-03-10T13:48:57.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:57 gibba015 bash[9806]: audit 2021-03-10T13:48:56.386013+0000 mon.a (mon.0) 622 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2021-03-10T13:48:56.385568Z\", \"spec\": {\"placement\": {\"count\": 3, \"hosts\": [\"gibba015=y\", \"gibba045=x\", \"gibba045=x\"]}, \"service_name\": \"mgr\", \"service_type\": \"mgr\"}}"}]: dispatch 2021-03-10T13:48:57.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:57 gibba015 bash[9806]: audit 2021-03-10T13:48:56.388637+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2021-03-10T13:48:56.385568Z\", \"spec\": {\"placement\": {\"count\": 3, \"hosts\": [\"gibba015=y\", \"gibba045=x\", \"gibba045=x\"]}, \"service_name\": \"mgr\", \"service_type\": \"mgr\"}}"}]': finished 2021-03-10T13:48:57.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:57 gibba015 bash[9806]: audit 2021-03-10T13:48:56.390085+0000 mon.b (mon.2) 66 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config set","value":"1","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T13:48:57.729 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:57 gibba015 bash[9806]: audit 2021-03-10T13:48:56.390263+0000 mon.a (mon.0) 624 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config set","value":"1","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T13:48:57.730 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:57 gibba015 bash[9806]: audit 2021-03-10T13:48:56.393587+0000 mon.a (mon.0) 625 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix":"config set","value":"1","who":"mgr","name":"mgr/cephadm/migration_current"}]': finished 2021-03-10T13:48:57.731 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:57 gibba015 bash[9806]: audit 2021-03-10T13:48:56.394938+0000 mon.b (mon.2) 67 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config set","value":"2","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T13:48:57.731 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:57 gibba015 bash[9806]: audit 2021-03-10T13:48:56.395036+0000 mon.a (mon.0) 626 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config set","value":"2","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T13:48:57.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:57 gibba015 bash[13005]: audit 2021-03-10T13:48:56.376112+0000 mon.b (mon.2) 64 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config set","value":"0","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T13:48:57.734 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:57 gibba015 bash[13005]: cluster 2021-03-10T13:48:56.378598+0000 mon.a (mon.0) 618 : cluster [INF] Manager daemon gibba045.orlgmj is now available 2021-03-10T13:48:57.735 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:57 gibba015 bash[13005]: cluster 2021-03-10T13:48:56.378678+0000 mon.a (mon.0) 619 : cluster [DBG] mgrmap e19: gibba045.orlgmj(active, starting, since 1.07635s), standbys: y, x 2021-03-10T13:48:57.736 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:57 gibba015 bash[13005]: audit 2021-03-10T13:48:56.379853+0000 mon.a (mon.0) 620 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config set","value":"0","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T13:48:57.736 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:57 gibba015 bash[13005]: audit 2021-03-10T13:48:56.383164+0000 mon.a (mon.0) 621 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix":"config set","value":"0","who":"mgr","name":"mgr/cephadm/migration_current"}]': finished 2021-03-10T13:48:57.737 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:57 gibba015 bash[13005]: cephadm 2021-03-10T13:48:56.385558+0000 mgr.gibba045.orlgmj (mgr.34379) 2 : cephadm [INF] Migrating to explicit placement 2021-03-10T13:48:57.737 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:57 gibba015 bash[13005]: audit 2021-03-10T13:48:56.385861+0000 mon.b (mon.2) 65 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2021-03-10T13:48:56.385568Z\", \"spec\": {\"placement\": {\"count\": 3, \"hosts\": [\"gibba015=y\", \"gibba045=x\", \"gibba045=x\"]}, \"service_name\": \"mgr\", \"service_type\": \"mgr\"}}"}]: dispatch 2021-03-10T13:48:57.738 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:57 gibba015 bash[13005]: audit 2021-03-10T13:48:56.386013+0000 mon.a (mon.0) 622 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2021-03-10T13:48:56.385568Z\", \"spec\": {\"placement\": {\"count\": 3, \"hosts\": [\"gibba015=y\", \"gibba045=x\", \"gibba045=x\"]}, \"service_name\": \"mgr\", \"service_type\": \"mgr\"}}"}]: dispatch 2021-03-10T13:48:57.738 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:57 gibba015 bash[13005]: audit 2021-03-10T13:48:56.388637+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2021-03-10T13:48:56.385568Z\", \"spec\": {\"placement\": {\"count\": 3, \"hosts\": [\"gibba015=y\", \"gibba045=x\", \"gibba045=x\"]}, \"service_name\": \"mgr\", \"service_type\": \"mgr\"}}"}]': finished 2021-03-10T13:48:57.739 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:57 gibba015 bash[13005]: audit 2021-03-10T13:48:56.390085+0000 mon.b (mon.2) 66 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config set","value":"1","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T13:48:57.739 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:57 gibba015 bash[13005]: audit 2021-03-10T13:48:56.390263+0000 mon.a (mon.0) 624 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config set","value":"1","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T13:48:57.740 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:57 gibba015 bash[13005]: audit 2021-03-10T13:48:56.393587+0000 mon.a (mon.0) 625 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix":"config set","value":"1","who":"mgr","name":"mgr/cephadm/migration_current"}]': finished 2021-03-10T13:48:57.740 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:57 gibba015 bash[13005]: audit 2021-03-10T13:48:56.394938+0000 mon.b (mon.2) 67 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config set","value":"2","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T13:48:57.740 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:57 gibba015 bash[13005]: audit 2021-03-10T13:48:56.395036+0000 mon.a (mon.0) 626 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config set","value":"2","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T13:48:57.741 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:57 gibba015 bash[9806]: audit 2021-03-10T13:48:56.398254+0000 mon.a (mon.0) 627 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix":"config set","value":"2","who":"mgr","name":"mgr/cephadm/migration_current"}]': finished 2021-03-10T13:48:57.742 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:57 gibba015 bash[9806]: audit 2021-03-10T13:48:56.476492+0000 mon.b (mon.2) 68 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:48:57.742 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:57 gibba015 bash[9806]: audit 2021-03-10T13:48:56.496479+0000 mon.b (mon.2) 69 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:48:57.743 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:57 gibba015 bash[9806]: audit 2021-03-10T13:48:56.497205+0000 mon.a (mon.0) 628 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:48:57.743 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:57 gibba015 bash[9806]: audit 2021-03-10T13:48:56.500106+0000 mon.b (mon.2) 70 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T13:48:57.743 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:57 gibba015 bash[9806]: audit 2021-03-10T13:48:56.500609+0000 mon.a (mon.0) 629 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T13:48:57.744 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:57 gibba015 bash[13005]: audit 2021-03-10T13:48:56.398254+0000 mon.a (mon.0) 627 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix":"config set","value":"2","who":"mgr","name":"mgr/cephadm/migration_current"}]': finished 2021-03-10T13:48:57.744 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:57 gibba015 bash[13005]: audit 2021-03-10T13:48:56.476492+0000 mon.b (mon.2) 68 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:48:57.745 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:57 gibba015 bash[13005]: audit 2021-03-10T13:48:56.496479+0000 mon.b (mon.2) 69 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:48:57.745 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:57 gibba015 bash[13005]: audit 2021-03-10T13:48:56.497205+0000 mon.a (mon.0) 628 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:48:57.745 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:57 gibba015 bash[13005]: audit 2021-03-10T13:48:56.500106+0000 mon.b (mon.2) 70 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T13:48:57.746 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:57 gibba015 bash[13005]: audit 2021-03-10T13:48:56.500609+0000 mon.a (mon.0) 629 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T13:48:57.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:57 gibba045 bash[9787]: audit 2021-03-10T13:48:56.376112+0000 mon.b (mon.2) 64 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config set","value":"0","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T13:48:57.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:57 gibba045 bash[9787]: cluster 2021-03-10T13:48:56.378598+0000 mon.a (mon.0) 618 : cluster [INF] Manager daemon gibba045.orlgmj is now available 2021-03-10T13:48:57.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:57 gibba045 bash[9787]: cluster 2021-03-10T13:48:56.378678+0000 mon.a (mon.0) 619 : cluster [DBG] mgrmap e19: gibba045.orlgmj(active, starting, since 1.07635s), standbys: y, x 2021-03-10T13:48:57.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:57 gibba045 bash[9787]: audit 2021-03-10T13:48:56.379853+0000 mon.a (mon.0) 620 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config set","value":"0","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T13:48:57.812 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:57 gibba045 bash[9787]: audit 2021-03-10T13:48:56.383164+0000 mon.a (mon.0) 621 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix":"config set","value":"0","who":"mgr","name":"mgr/cephadm/migration_current"}]': finished 2021-03-10T13:48:57.812 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:57 gibba045 bash[9787]: cephadm 2021-03-10T13:48:56.385558+0000 mgr.gibba045.orlgmj (mgr.34379) 2 : cephadm [INF] Migrating to explicit placement 2021-03-10T13:48:57.812 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:57 gibba045 bash[9787]: audit 2021-03-10T13:48:56.385861+0000 mon.b (mon.2) 65 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2021-03-10T13:48:56.385568Z\", \"spec\": {\"placement\": {\"count\": 3, \"hosts\": [\"gibba015=y\", \"gibba045=x\", \"gibba045=x\"]}, \"service_name\": \"mgr\", \"service_type\": \"mgr\"}}"}]: dispatch 2021-03-10T13:48:57.812 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:57 gibba045 bash[9787]: audit 2021-03-10T13:48:56.386013+0000 mon.a (mon.0) 622 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2021-03-10T13:48:56.385568Z\", \"spec\": {\"placement\": {\"count\": 3, \"hosts\": [\"gibba015=y\", \"gibba045=x\", \"gibba045=x\"]}, \"service_name\": \"mgr\", \"service_type\": \"mgr\"}}"}]: dispatch 2021-03-10T13:48:57.812 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:57 gibba045 bash[9787]: audit 2021-03-10T13:48:56.388637+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2021-03-10T13:48:56.385568Z\", \"spec\": {\"placement\": {\"count\": 3, \"hosts\": [\"gibba015=y\", \"gibba045=x\", \"gibba045=x\"]}, \"service_name\": \"mgr\", \"service_type\": \"mgr\"}}"}]': finished 2021-03-10T13:48:57.813 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:57 gibba045 bash[9787]: audit 2021-03-10T13:48:56.390085+0000 mon.b (mon.2) 66 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config set","value":"1","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T13:48:57.813 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:57 gibba045 bash[9787]: audit 2021-03-10T13:48:56.390263+0000 mon.a (mon.0) 624 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config set","value":"1","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T13:48:57.813 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:57 gibba045 bash[9787]: audit 2021-03-10T13:48:56.393587+0000 mon.a (mon.0) 625 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix":"config set","value":"1","who":"mgr","name":"mgr/cephadm/migration_current"}]': finished 2021-03-10T13:48:57.814 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:57 gibba045 bash[9787]: audit 2021-03-10T13:48:56.394938+0000 mon.b (mon.2) 67 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config set","value":"2","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T13:48:57.814 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:57 gibba045 bash[9787]: audit 2021-03-10T13:48:56.395036+0000 mon.a (mon.0) 626 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config set","value":"2","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T13:48:57.814 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:57 gibba045 bash[9787]: audit 2021-03-10T13:48:56.398254+0000 mon.a (mon.0) 627 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix":"config set","value":"2","who":"mgr","name":"mgr/cephadm/migration_current"}]': finished 2021-03-10T13:48:57.814 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:57 gibba045 bash[9787]: audit 2021-03-10T13:48:56.476492+0000 mon.b (mon.2) 68 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:48:57.814 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:57 gibba045 bash[9787]: audit 2021-03-10T13:48:56.496479+0000 mon.b (mon.2) 69 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:48:57.815 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:57 gibba045 bash[9787]: audit 2021-03-10T13:48:56.497205+0000 mon.a (mon.0) 628 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:48:57.815 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:57 gibba045 bash[9787]: audit 2021-03-10T13:48:56.500106+0000 mon.b (mon.2) 70 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T13:48:57.815 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:57 gibba045 bash[9787]: audit 2021-03-10T13:48:56.500609+0000 mon.a (mon.0) 629 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T13:48:58.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:58 gibba015 bash[9806]: debug 2021-03-10T13:48:58.391+0000 7f13cf9b1700 -1 log_channel(cluster) log [ERR] : Health check failed: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) (MGR_MODULE_ERROR) 2021-03-10T13:48:58.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:58 gibba015 bash[9806]: cluster 2021-03-10T13:48:57.394382+0000 mon.a (mon.0) 630 : cluster [DBG] mgrmap e20: gibba045.orlgmj(active, since 2s), standbys: y, x 2021-03-10T13:48:58.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:58 gibba015 bash[9806]: cluster 2021-03-10T13:48:57.397974+0000 mgr.gibba045.orlgmj (mgr.34379) 3 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:58.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:58 gibba015 bash[13005]: cluster 2021-03-10T13:48:57.394382+0000 mon.a (mon.0) 630 : cluster [DBG] mgrmap e20: gibba045.orlgmj(active, since 2s), standbys: y, x 2021-03-10T13:48:58.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:58 gibba015 bash[13005]: cluster 2021-03-10T13:48:57.397974+0000 mgr.gibba045.orlgmj (mgr.34379) 3 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:58.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:58 gibba045 bash[9787]: cluster 2021-03-10T13:48:57.394382+0000 mon.a (mon.0) 630 : cluster [DBG] mgrmap e20: gibba045.orlgmj(active, since 2s), standbys: y, x 2021-03-10T13:48:58.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:58 gibba045 bash[9787]: cluster 2021-03-10T13:48:57.397974+0000 mgr.gibba045.orlgmj (mgr.34379) 3 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:59.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:59 gibba015 bash[9806]: cluster 2021-03-10T13:48:57.630501+0000 mgr.gibba045.orlgmj (mgr.34379) 4 : cluster [ERR] Unhandled exception from module 'dashboard' while running on mgr.gibba045.orlgmj: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:48:59.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:48:59 gibba015 bash[9806]: cluster 2021-03-10T13:48:58.396933+0000 mon.a (mon.0) 631 : cluster [ERR] Health check failed: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) (MGR_MODULE_ERROR) 2021-03-10T13:48:59.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:59 gibba015 bash[13005]: cluster 2021-03-10T13:48:57.630501+0000 mgr.gibba045.orlgmj (mgr.34379) 4 : cluster [ERR] Unhandled exception from module 'dashboard' while running on mgr.gibba045.orlgmj: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:48:59.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:48:59 gibba015 bash[13005]: cluster 2021-03-10T13:48:58.396933+0000 mon.a (mon.0) 631 : cluster [ERR] Health check failed: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) (MGR_MODULE_ERROR) 2021-03-10T13:48:59.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:59 gibba045 bash[9787]: cluster 2021-03-10T13:48:57.630501+0000 mgr.gibba045.orlgmj (mgr.34379) 4 : cluster [ERR] Unhandled exception from module 'dashboard' while running on mgr.gibba045.orlgmj: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:48:59.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:48:59 gibba045 bash[9787]: cluster 2021-03-10T13:48:58.396933+0000 mon.a (mon.0) 631 : cluster [ERR] Health check failed: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) (MGR_MODULE_ERROR) 2021-03-10T13:49:00.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:00 gibba015 bash[9806]: cluster 2021-03-10T13:48:59.366136+0000 mgr.gibba045.orlgmj (mgr.34379) 5 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:00.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:00 gibba015 bash[13005]: cluster 2021-03-10T13:48:59.366136+0000 mgr.gibba045.orlgmj (mgr.34379) 5 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:00.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:00 gibba045 bash[9787]: cluster 2021-03-10T13:48:59.366136+0000 mgr.gibba045.orlgmj (mgr.34379) 5 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:02.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:02 gibba015 bash[9806]: cluster 2021-03-10T13:49:01.366631+0000 mgr.gibba045.orlgmj (mgr.34379) 6 : cluster [DBG] pgmap v5: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:02.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:02 gibba015 bash[9806]: audit 2021-03-10T13:49:02.318392+0000 mon.b (mon.2) 71 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config set", "name": "container_image", "value": "ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60", "who": "global"}]: dispatch 2021-03-10T13:49:02.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:02 gibba015 bash[9806]: audit 2021-03-10T13:49:02.319072+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config set", "name": "container_image", "value": "ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60", "who": "global"}]: dispatch 2021-03-10T13:49:02.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:02 gibba015 bash[9806]: audit 2021-03-10T13:49:02.323588+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix": "config set", "name": "container_image", "value": "ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60", "who": "global"}]': finished 2021-03-10T13:49:02.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:02 gibba015 bash[9806]: audit 2021-03-10T13:49:02.329989+0000 mon.b (mon.2) 72 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.gibba045.orlgmj"}]: dispatch 2021-03-10T13:49:02.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:02 gibba015 bash[9806]: audit 2021-03-10T13:49:02.330034+0000 mon.a (mon.0) 634 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.gibba045.orlgmj"}]: dispatch 2021-03-10T13:49:02.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:02 gibba015 bash[9806]: audit 2021-03-10T13:49:02.333174+0000 mon.a (mon.0) 635 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.gibba045.orlgmj"}]': finished 2021-03-10T13:49:02.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:02 gibba015 bash[9806]: audit 2021-03-10T13:49:02.335003+0000 mon.b (mon.2) 73 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.x"}]: dispatch 2021-03-10T13:49:02.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:02 gibba015 bash[9806]: audit 2021-03-10T13:49:02.335005+0000 mon.a (mon.0) 636 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.x"}]: dispatch 2021-03-10T13:49:02.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:02 gibba015 bash[9806]: audit 2021-03-10T13:49:02.338019+0000 mon.a (mon.0) 637 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.x"}]': finished 2021-03-10T13:49:02.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:02 gibba015 bash[9806]: audit 2021-03-10T13:49:02.339865+0000 mon.b (mon.2) 74 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:49:02.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:02 gibba015 bash[13005]: cluster 2021-03-10T13:49:01.366631+0000 mgr.gibba045.orlgmj (mgr.34379) 6 : cluster [DBG] pgmap v5: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:02.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:02 gibba015 bash[13005]: audit 2021-03-10T13:49:02.318392+0000 mon.b (mon.2) 71 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config set", "name": "container_image", "value": "ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60", "who": "global"}]: dispatch 2021-03-10T13:49:02.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:02 gibba015 bash[13005]: audit 2021-03-10T13:49:02.319072+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config set", "name": "container_image", "value": "ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60", "who": "global"}]: dispatch 2021-03-10T13:49:02.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:02 gibba015 bash[13005]: audit 2021-03-10T13:49:02.323588+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix": "config set", "name": "container_image", "value": "ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60", "who": "global"}]': finished 2021-03-10T13:49:02.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:02 gibba015 bash[13005]: audit 2021-03-10T13:49:02.329989+0000 mon.b (mon.2) 72 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.gibba045.orlgmj"}]: dispatch 2021-03-10T13:49:02.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:02 gibba015 bash[13005]: audit 2021-03-10T13:49:02.330034+0000 mon.a (mon.0) 634 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.gibba045.orlgmj"}]: dispatch 2021-03-10T13:49:02.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:02 gibba015 bash[13005]: audit 2021-03-10T13:49:02.333174+0000 mon.a (mon.0) 635 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.gibba045.orlgmj"}]': finished 2021-03-10T13:49:02.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:02 gibba015 bash[13005]: audit 2021-03-10T13:49:02.335003+0000 mon.b (mon.2) 73 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.x"}]: dispatch 2021-03-10T13:49:02.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:02 gibba015 bash[13005]: audit 2021-03-10T13:49:02.335005+0000 mon.a (mon.0) 636 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.x"}]: dispatch 2021-03-10T13:49:02.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:02 gibba015 bash[13005]: audit 2021-03-10T13:49:02.338019+0000 mon.a (mon.0) 637 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.x"}]': finished 2021-03-10T13:49:02.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:02 gibba015 bash[13005]: audit 2021-03-10T13:49:02.339865+0000 mon.b (mon.2) 74 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:49:02.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:02 gibba045 bash[9787]: cluster 2021-03-10T13:49:01.366631+0000 mgr.gibba045.orlgmj (mgr.34379) 6 : cluster [DBG] pgmap v5: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:02.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:02 gibba045 bash[9787]: audit 2021-03-10T13:49:02.318392+0000 mon.b (mon.2) 71 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config set", "name": "container_image", "value": "ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60", "who": "global"}]: dispatch 2021-03-10T13:49:02.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:02 gibba045 bash[9787]: audit 2021-03-10T13:49:02.319072+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config set", "name": "container_image", "value": "ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60", "who": "global"}]: dispatch 2021-03-10T13:49:02.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:02 gibba045 bash[9787]: audit 2021-03-10T13:49:02.323588+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix": "config set", "name": "container_image", "value": "ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60", "who": "global"}]': finished 2021-03-10T13:49:02.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:02 gibba045 bash[9787]: audit 2021-03-10T13:49:02.329989+0000 mon.b (mon.2) 72 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.gibba045.orlgmj"}]: dispatch 2021-03-10T13:49:02.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:02 gibba045 bash[9787]: audit 2021-03-10T13:49:02.330034+0000 mon.a (mon.0) 634 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.gibba045.orlgmj"}]: dispatch 2021-03-10T13:49:02.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:02 gibba045 bash[9787]: audit 2021-03-10T13:49:02.333174+0000 mon.a (mon.0) 635 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.gibba045.orlgmj"}]': finished 2021-03-10T13:49:02.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:02 gibba045 bash[9787]: audit 2021-03-10T13:49:02.335003+0000 mon.b (mon.2) 73 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.x"}]: dispatch 2021-03-10T13:49:02.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:02 gibba045 bash[9787]: audit 2021-03-10T13:49:02.335005+0000 mon.a (mon.0) 636 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.x"}]: dispatch 2021-03-10T13:49:02.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:02 gibba045 bash[9787]: audit 2021-03-10T13:49:02.338019+0000 mon.a (mon.0) 637 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.x"}]': finished 2021-03-10T13:49:02.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:02 gibba045 bash[9787]: audit 2021-03-10T13:49:02.339865+0000 mon.b (mon.2) 74 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:49:03.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:03 gibba015 bash[9806]: audit 2021-03-10T13:49:02.526754+0000 mon.b (mon.2) 75 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:49:03.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:03 gibba015 bash[13005]: audit 2021-03-10T13:49:02.526754+0000 mon.b (mon.2) 75 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:49:03.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:03 gibba045 bash[9787]: audit 2021-03-10T13:49:02.526754+0000 mon.b (mon.2) 75 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:49:04.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:04 gibba015 bash[9806]: cluster 2021-03-10T13:49:03.369016+0000 mgr.gibba045.orlgmj (mgr.34379) 7 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:04.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:04 gibba015 bash[13005]: cluster 2021-03-10T13:49:03.369016+0000 mgr.gibba045.orlgmj (mgr.34379) 7 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:04.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:04 gibba045 bash[9787]: cluster 2021-03-10T13:49:03.369016+0000 mgr.gibba045.orlgmj (mgr.34379) 7 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:06.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:06 gibba015 bash[9806]: cluster 2021-03-10T13:49:05.370145+0000 mgr.gibba045.orlgmj (mgr.34379) 8 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:06.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:06 gibba015 bash[13005]: cluster 2021-03-10T13:49:05.370145+0000 mgr.gibba045.orlgmj (mgr.34379) 8 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:06.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:06 gibba015 bash[13005]: audit 2021-03-10T13:49:05.849288+0000 mon.b (mon.2) 76 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93375692, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847333Z\", \"created\": \"2021-03-10T13:38:50.668449Z\", \"started\": \"2021-03-10T13:38:56.060544Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 307337625, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847491Z\", \"created\": \"2021-03-10T13:38:58.024449Z\", \"started\": \"2021-03-10T13:38:58.047154Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95776931, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847552Z\", \"created\": \"2021-03-10T13:40:03.296449Z\", \"started\": \"2021-03-10T13:40:03.320843Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48737812, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847608Z\", \"created\": \"2021-03-10T13:40:50.072448Z\", \"started\": \"2021-03-10T13:40:53.142290Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49733959, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847779Z\", \"created\": \"2021-03-10T13:41:11.556448Z\", \"started\": \"2021-03-10T13:41:15.069232Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46493859, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847910Z\", \"created\": \"2021-03-10T13:41:34.244448Z\", \"started\": \"2021-03-10T13:41:37.507096Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46850375, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848034Z\", \"created\": \"2021-03-10T13:41:57.328380Z\", \"started\": \"2021-03-10T13:42:00.781947Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22387097, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848156Z\", \"created\": \"2021-03-10T13:43:44.272379Z\", \"started\": \"2021-03-10T13:43:47.550063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"842b16a0ff6e\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13348372, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848232Z\", \"created\": \"2021-03-10T13:43:54.628379Z\", \"started\": \"2021-03-10T13:44:17.568021Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:44:10.554431Z\"}}, \"last_daemon_update\": \"2021-03-10T13:49:05.848345Z\", \"last_device_update\": \"2021-03-10T13:42:03.853072Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:49:06.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:06 gibba015 bash[9806]: audit 2021-03-10T13:49:05.849288+0000 mon.b (mon.2) 76 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93375692, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847333Z\", \"created\": \"2021-03-10T13:38:50.668449Z\", \"started\": \"2021-03-10T13:38:56.060544Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 307337625, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847491Z\", \"created\": \"2021-03-10T13:38:58.024449Z\", \"started\": \"2021-03-10T13:38:58.047154Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95776931, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847552Z\", \"created\": \"2021-03-10T13:40:03.296449Z\", \"started\": \"2021-03-10T13:40:03.320843Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48737812, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847608Z\", \"created\": \"2021-03-10T13:40:50.072448Z\", \"started\": \"2021-03-10T13:40:53.142290Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49733959, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847779Z\", \"created\": \"2021-03-10T13:41:11.556448Z\", \"started\": \"2021-03-10T13:41:15.069232Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46493859, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847910Z\", \"created\": \"2021-03-10T13:41:34.244448Z\", \"started\": \"2021-03-10T13:41:37.507096Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46850375, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848034Z\", \"created\": \"2021-03-10T13:41:57.328380Z\", \"started\": \"2021-03-10T13:42:00.781947Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22387097, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848156Z\", \"created\": \"2021-03-10T13:43:44.272379Z\", \"started\": \"2021-03-10T13:43:47.550063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"842b16a0ff6e\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13348372, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848232Z\", \"created\": \"2021-03-10T13:43:54.628379Z\", \"started\": \"2021-03-10T13:44:17.568021Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:44:10.554431Z\"}}, \"last_daemon_update\": \"2021-03-10T13:49:05.848345Z\", \"last_device_update\": \"2021-03-10T13:42:03.853072Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:49:06.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:06 gibba015 bash[13005]: audit 2021-03-10T13:49:05.849570+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93375692, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847333Z\", \"created\": \"2021-03-10T13:38:50.668449Z\", \"started\": \"2021-03-10T13:38:56.060544Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 307337625, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847491Z\", \"created\": \"2021-03-10T13:38:58.024449Z\", \"started\": \"2021-03-10T13:38:58.047154Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95776931, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847552Z\", \"created\": \"2021-03-10T13:40:03.296449Z\", \"started\": \"2021-03-10T13:40:03.320843Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48737812, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847608Z\", \"created\": \"2021-03-10T13:40:50.072448Z\", \"started\": \"2021-03-10T13:40:53.142290Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49733959, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847779Z\", \"created\": \"2021-03-10T13:41:11.556448Z\", \"started\": \"2021-03-10T13:41:15.069232Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46493859, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847910Z\", \"created\": \"2021-03-10T13:41:34.244448Z\", \"started\": \"2021-03-10T13:41:37.507096Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46850375, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848034Z\", \"created\": \"2021-03-10T13:41:57.328380Z\", \"started\": \"2021-03-10T13:42:00.781947Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22387097, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848156Z\", \"created\": \"2021-03-10T13:43:44.272379Z\", \"started\": \"2021-03-10T13:43:47.550063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"842b16a0ff6e\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13348372, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848232Z\", \"created\": \"2021-03-10T13:43:54.628379Z\", \"started\": \"2021-03-10T13:44:17.568021Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:44:10.554431Z\"}}, \"last_daemon_update\": \"2021-03-10T13:49:05.848345Z\", \"last_device_update\": \"2021-03-10T13:42:03.853072Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:49:06.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:06 gibba015 bash[13005]: audit 2021-03-10T13:49:05.852525+0000 mon.a (mon.0) 639 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93375692, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847333Z\", \"created\": \"2021-03-10T13:38:50.668449Z\", \"started\": \"2021-03-10T13:38:56.060544Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 307337625, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847491Z\", \"created\": \"2021-03-10T13:38:58.024449Z\", \"started\": \"2021-03-10T13:38:58.047154Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95776931, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847552Z\", \"created\": \"2021-03-10T13:40:03.296449Z\", \"started\": \"2021-03-10T13:40:03.320843Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48737812, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847608Z\", \"created\": \"2021-03-10T13:40:50.072448Z\", \"started\": \"2021-03-10T13:40:53.142290Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49733959, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847779Z\", \"created\": \"2021-03-10T13:41:11.556448Z\", \"started\": \"2021-03-10T13:41:15.069232Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46493859, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847910Z\", \"created\": \"2021-03-10T13:41:34.244448Z\", \"started\": \"2021-03-10T13:41:37.507096Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46850375, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848034Z\", \"created\": \"2021-03-10T13:41:57.328380Z\", \"started\": \"2021-03-10T13:42:00.781947Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22387097, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848156Z\", \"created\": \"2021-03-10T13:43:44.272379Z\", \"started\": \"2021-03-10T13:43:47.550063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"842b16a0ff6e\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13348372, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848232Z\", \"created\": \"2021-03-10T13:43:54.628379Z\", \"started\": \"2021-03-10T13:44:17.568021Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:44:10.554431Z\"}}, \"last_daemon_update\": \"2021-03-10T13:49:05.848345Z\", \"last_device_update\": \"2021-03-10T13:42:03.853072Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426Z\", \"scheduled_daemon_actions\": {}}"}]': finished 2021-03-10T13:49:06.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:06 gibba015 bash[9806]: audit 2021-03-10T13:49:05.849570+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93375692, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847333Z\", \"created\": \"2021-03-10T13:38:50.668449Z\", \"started\": \"2021-03-10T13:38:56.060544Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 307337625, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847491Z\", \"created\": \"2021-03-10T13:38:58.024449Z\", \"started\": \"2021-03-10T13:38:58.047154Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95776931, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847552Z\", \"created\": \"2021-03-10T13:40:03.296449Z\", \"started\": \"2021-03-10T13:40:03.320843Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48737812, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847608Z\", \"created\": \"2021-03-10T13:40:50.072448Z\", \"started\": \"2021-03-10T13:40:53.142290Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49733959, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847779Z\", \"created\": \"2021-03-10T13:41:11.556448Z\", \"started\": \"2021-03-10T13:41:15.069232Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46493859, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847910Z\", \"created\": \"2021-03-10T13:41:34.244448Z\", \"started\": \"2021-03-10T13:41:37.507096Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46850375, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848034Z\", \"created\": \"2021-03-10T13:41:57.328380Z\", \"started\": \"2021-03-10T13:42:00.781947Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22387097, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848156Z\", \"created\": \"2021-03-10T13:43:44.272379Z\", \"started\": \"2021-03-10T13:43:47.550063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"842b16a0ff6e\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13348372, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848232Z\", \"created\": \"2021-03-10T13:43:54.628379Z\", \"started\": \"2021-03-10T13:44:17.568021Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:44:10.554431Z\"}}, \"last_daemon_update\": \"2021-03-10T13:49:05.848345Z\", \"last_device_update\": \"2021-03-10T13:42:03.853072Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:49:06.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:06 gibba015 bash[9806]: audit 2021-03-10T13:49:05.852525+0000 mon.a (mon.0) 639 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93375692, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847333Z\", \"created\": \"2021-03-10T13:38:50.668449Z\", \"started\": \"2021-03-10T13:38:56.060544Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 307337625, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847491Z\", \"created\": \"2021-03-10T13:38:58.024449Z\", \"started\": \"2021-03-10T13:38:58.047154Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95776931, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847552Z\", \"created\": \"2021-03-10T13:40:03.296449Z\", \"started\": \"2021-03-10T13:40:03.320843Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48737812, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847608Z\", \"created\": \"2021-03-10T13:40:50.072448Z\", \"started\": \"2021-03-10T13:40:53.142290Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49733959, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847779Z\", \"created\": \"2021-03-10T13:41:11.556448Z\", \"started\": \"2021-03-10T13:41:15.069232Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46493859, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847910Z\", \"created\": \"2021-03-10T13:41:34.244448Z\", \"started\": \"2021-03-10T13:41:37.507096Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46850375, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848034Z\", \"created\": \"2021-03-10T13:41:57.328380Z\", \"started\": \"2021-03-10T13:42:00.781947Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22387097, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848156Z\", \"created\": \"2021-03-10T13:43:44.272379Z\", \"started\": \"2021-03-10T13:43:47.550063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"842b16a0ff6e\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13348372, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848232Z\", \"created\": \"2021-03-10T13:43:54.628379Z\", \"started\": \"2021-03-10T13:44:17.568021Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:44:10.554431Z\"}}, \"last_daemon_update\": \"2021-03-10T13:49:05.848345Z\", \"last_device_update\": \"2021-03-10T13:42:03.853072Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426Z\", \"scheduled_daemon_actions\": {}}"}]': finished 2021-03-10T13:49:06.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:06 gibba045 bash[9787]: cluster 2021-03-10T13:49:05.370145+0000 mgr.gibba045.orlgmj (mgr.34379) 8 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:06.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:06 gibba045 bash[9787]: audit 2021-03-10T13:49:05.849288+0000 mon.b (mon.2) 76 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93375692, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847333Z\", \"created\": \"2021-03-10T13:38:50.668449Z\", \"started\": \"2021-03-10T13:38:56.060544Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 307337625, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847491Z\", \"created\": \"2021-03-10T13:38:58.024449Z\", \"started\": \"2021-03-10T13:38:58.047154Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95776931, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847552Z\", \"created\": \"2021-03-10T13:40:03.296449Z\", \"started\": \"2021-03-10T13:40:03.320843Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48737812, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847608Z\", \"created\": \"2021-03-10T13:40:50.072448Z\", \"started\": \"2021-03-10T13:40:53.142290Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49733959, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847779Z\", \"created\": \"2021-03-10T13:41:11.556448Z\", \"started\": \"2021-03-10T13:41:15.069232Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46493859, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847910Z\", \"created\": \"2021-03-10T13:41:34.244448Z\", \"started\": \"2021-03-10T13:41:37.507096Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46850375, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848034Z\", \"created\": \"2021-03-10T13:41:57.328380Z\", \"started\": \"2021-03-10T13:42:00.781947Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22387097, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848156Z\", \"created\": \"2021-03-10T13:43:44.272379Z\", \"started\": \"2021-03-10T13:43:47.550063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"842b16a0ff6e\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13348372, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848232Z\", \"created\": \"2021-03-10T13:43:54.628379Z\", \"started\": \"2021-03-10T13:44:17.568021Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:44:10.554431Z\"}}, \"last_daemon_update\": \"2021-03-10T13:49:05.848345Z\", \"last_device_update\": \"2021-03-10T13:42:03.853072Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:49:06.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:06 gibba045 bash[9787]: audit 2021-03-10T13:49:05.849570+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93375692, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847333Z\", \"created\": \"2021-03-10T13:38:50.668449Z\", \"started\": \"2021-03-10T13:38:56.060544Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 307337625, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847491Z\", \"created\": \"2021-03-10T13:38:58.024449Z\", \"started\": \"2021-03-10T13:38:58.047154Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95776931, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847552Z\", \"created\": \"2021-03-10T13:40:03.296449Z\", \"started\": \"2021-03-10T13:40:03.320843Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48737812, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847608Z\", \"created\": \"2021-03-10T13:40:50.072448Z\", \"started\": \"2021-03-10T13:40:53.142290Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49733959, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847779Z\", \"created\": \"2021-03-10T13:41:11.556448Z\", \"started\": \"2021-03-10T13:41:15.069232Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46493859, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847910Z\", \"created\": \"2021-03-10T13:41:34.244448Z\", \"started\": \"2021-03-10T13:41:37.507096Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46850375, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848034Z\", \"created\": \"2021-03-10T13:41:57.328380Z\", \"started\": \"2021-03-10T13:42:00.781947Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22387097, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848156Z\", \"created\": \"2021-03-10T13:43:44.272379Z\", \"started\": \"2021-03-10T13:43:47.550063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"842b16a0ff6e\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13348372, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848232Z\", \"created\": \"2021-03-10T13:43:54.628379Z\", \"started\": \"2021-03-10T13:44:17.568021Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:44:10.554431Z\"}}, \"last_daemon_update\": \"2021-03-10T13:49:05.848345Z\", \"last_device_update\": \"2021-03-10T13:42:03.853072Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:49:06.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:06 gibba045 bash[9787]: audit 2021-03-10T13:49:05.852525+0000 mon.a (mon.0) 639 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93375692, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847333Z\", \"created\": \"2021-03-10T13:38:50.668449Z\", \"started\": \"2021-03-10T13:38:56.060544Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 307337625, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847491Z\", \"created\": \"2021-03-10T13:38:58.024449Z\", \"started\": \"2021-03-10T13:38:58.047154Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95776931, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847552Z\", \"created\": \"2021-03-10T13:40:03.296449Z\", \"started\": \"2021-03-10T13:40:03.320843Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48737812, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847608Z\", \"created\": \"2021-03-10T13:40:50.072448Z\", \"started\": \"2021-03-10T13:40:53.142290Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49733959, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847779Z\", \"created\": \"2021-03-10T13:41:11.556448Z\", \"started\": \"2021-03-10T13:41:15.069232Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46493859, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847910Z\", \"created\": \"2021-03-10T13:41:34.244448Z\", \"started\": \"2021-03-10T13:41:37.507096Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46850375, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848034Z\", \"created\": \"2021-03-10T13:41:57.328380Z\", \"started\": \"2021-03-10T13:42:00.781947Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22387097, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848156Z\", \"created\": \"2021-03-10T13:43:44.272379Z\", \"started\": \"2021-03-10T13:43:47.550063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"842b16a0ff6e\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13348372, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848232Z\", \"created\": \"2021-03-10T13:43:54.628379Z\", \"started\": \"2021-03-10T13:44:17.568021Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:44:10.554431Z\"}}, \"last_daemon_update\": \"2021-03-10T13:49:05.848345Z\", \"last_device_update\": \"2021-03-10T13:42:03.853072Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426Z\", \"scheduled_daemon_actions\": {}}"}]': finished 2021-03-10T13:49:07.624 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T13:49:07.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:07 gibba015 bash[9806]: cephadm 2021-03-10T13:49:05.853514+0000 mgr.gibba045.orlgmj (mgr.34379) 9 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T13:49:07.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:07 gibba015 bash[13005]: cephadm 2021-03-10T13:49:05.853514+0000 mgr.gibba045.orlgmj (mgr.34379) 9 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T13:49:07.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:07 gibba015 bash[13005]: audit 2021-03-10T13:49:06.723992+0000 mon.b (mon.2) 77 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101774786, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721104Z\", \"created\": \"2021-03-10T13:40:16.047558Z\", \"started\": \"2021-03-10T13:40:16.069701Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba045\", \"container_id\": \"0b25900c63e0\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 373817344, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721263Z\", \"created\": \"2021-03-10T13:40:32.015558Z\", \"started\": \"2021-03-10T13:48:33.658328Z\"}, \"mgr.gibba045.orlgmj\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba045.orlgmj\", \"hostname\": \"gibba045\", \"container_id\": \"ea964e825589\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 403701760, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721358Z\", \"created\": \"2021-03-10T13:40:34.535558Z\", \"started\": \"2021-03-10T13:48:50.630289Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48360325, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721446Z\", \"created\": \"2021-03-10T13:42:17.077564Z\", \"started\": \"2021-03-10T13:42:20.232803Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47238348, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721681Z\", \"created\": \"2021-03-10T13:42:38.781564Z\", \"started\": \"2021-03-10T13:42:42.298036Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46357544, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721874Z\", \"created\": \"2021-03-10T13:43:00.493564Z\", \"started\": \"2021-03-10T13:43:03.477079Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48255467, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722061Z\", \"created\": \"2021-03-10T13:43:22.897564Z\", \"started\": \"2021-03-10T13:43:26.167781Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba045\", \"container_id\": \"b3907fa26ba0\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 34697379, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722246Z\", \"created\": \"2021-03-10T13:43:42.821564Z\", \"started\": \"2021-03-10T13:44:24.396576Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23991418, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722341Z\", \"created\": \"2021-03-10T13:43:43.861564Z\", \"started\": \"2021-03-10T13:43:45.351099Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba045\", \"container_id\": \"d86cab6511db\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29611786, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722427Z\", \"created\": \"2021-03-10T13:44:08.721564Z\", \"started\": \"2021-03-10T13:44:08.746042Z\"}, \"rgw.r.z.gibba045.atotkw\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba045.atotkw\", \"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722512Z\", \"created\": \"2021-03-10T13:45:45.925564Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:21.028684Z\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:37.919264Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:44:17.558720Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818Z\"}, \"rgw.r.z.gibba045.atotkw\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:44.004644Z\"}}, \"last_daemon_update\": \"2021-03-10T13:49:06.722624Z\", \"last_device_update\": \"2021-03-10T13:43:30.693305Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:49:07.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:07 gibba015 bash[9806]: audit 2021-03-10T13:49:06.723992+0000 mon.b (mon.2) 77 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101774786, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721104Z\", \"created\": \"2021-03-10T13:40:16.047558Z\", \"started\": \"2021-03-10T13:40:16.069701Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba045\", \"container_id\": \"0b25900c63e0\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 373817344, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721263Z\", \"created\": \"2021-03-10T13:40:32.015558Z\", \"started\": \"2021-03-10T13:48:33.658328Z\"}, \"mgr.gibba045.orlgmj\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba045.orlgmj\", \"hostname\": \"gibba045\", \"container_id\": \"ea964e825589\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 403701760, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721358Z\", \"created\": \"2021-03-10T13:40:34.535558Z\", \"started\": \"2021-03-10T13:48:50.630289Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48360325, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721446Z\", \"created\": \"2021-03-10T13:42:17.077564Z\", \"started\": \"2021-03-10T13:42:20.232803Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47238348, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721681Z\", \"created\": \"2021-03-10T13:42:38.781564Z\", \"started\": \"2021-03-10T13:42:42.298036Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46357544, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721874Z\", \"created\": \"2021-03-10T13:43:00.493564Z\", \"started\": \"2021-03-10T13:43:03.477079Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48255467, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722061Z\", \"created\": \"2021-03-10T13:43:22.897564Z\", \"started\": \"2021-03-10T13:43:26.167781Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba045\", \"container_id\": \"b3907fa26ba0\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 34697379, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722246Z\", \"created\": \"2021-03-10T13:43:42.821564Z\", \"started\": \"2021-03-10T13:44:24.396576Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23991418, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722341Z\", \"created\": \"2021-03-10T13:43:43.861564Z\", \"started\": \"2021-03-10T13:43:45.351099Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba045\", \"container_id\": \"d86cab6511db\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29611786, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722427Z\", \"created\": \"2021-03-10T13:44:08.721564Z\", \"started\": \"2021-03-10T13:44:08.746042Z\"}, \"rgw.r.z.gibba045.atotkw\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba045.atotkw\", \"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722512Z\", \"created\": \"2021-03-10T13:45:45.925564Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:21.028684Z\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:37.919264Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:44:17.558720Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818Z\"}, \"rgw.r.z.gibba045.atotkw\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:44.004644Z\"}}, \"last_daemon_update\": \"2021-03-10T13:49:06.722624Z\", \"last_device_update\": \"2021-03-10T13:43:30.693305Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:49:07.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:07 gibba015 bash[13005]: audit 2021-03-10T13:49:06.725251+0000 mon.a (mon.0) 640 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101774786, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721104Z\", \"created\": \"2021-03-10T13:40:16.047558Z\", \"started\": \"2021-03-10T13:40:16.069701Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba045\", \"container_id\": \"0b25900c63e0\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 373817344, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721263Z\", \"created\": \"2021-03-10T13:40:32.015558Z\", \"started\": \"2021-03-10T13:48:33.658328Z\"}, \"mgr.gibba045.orlgmj\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba045.orlgmj\", \"hostname\": \"gibba045\", \"container_id\": \"ea964e825589\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 403701760, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721358Z\", \"created\": \"2021-03-10T13:40:34.535558Z\", \"started\": \"2021-03-10T13:48:50.630289Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48360325, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721446Z\", \"created\": \"2021-03-10T13:42:17.077564Z\", \"started\": \"2021-03-10T13:42:20.232803Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47238348, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721681Z\", \"created\": \"2021-03-10T13:42:38.781564Z\", \"started\": \"2021-03-10T13:42:42.298036Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46357544, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721874Z\", \"created\": \"2021-03-10T13:43:00.493564Z\", \"started\": \"2021-03-10T13:43:03.477079Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48255467, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722061Z\", \"created\": \"2021-03-10T13:43:22.897564Z\", \"started\": \"2021-03-10T13:43:26.167781Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba045\", \"container_id\": \"b3907fa26ba0\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 34697379, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722246Z\", \"created\": \"2021-03-10T13:43:42.821564Z\", \"started\": \"2021-03-10T13:44:24.396576Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23991418, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722341Z\", \"created\": \"2021-03-10T13:43:43.861564Z\", \"started\": \"2021-03-10T13:43:45.351099Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba045\", \"container_id\": \"d86cab6511db\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29611786, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722427Z\", \"created\": \"2021-03-10T13:44:08.721564Z\", \"started\": \"2021-03-10T13:44:08.746042Z\"}, \"rgw.r.z.gibba045.atotkw\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba045.atotkw\", \"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722512Z\", \"created\": \"2021-03-10T13:45:45.925564Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:21.028684Z\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:37.919264Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:44:17.558720Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818Z\"}, \"rgw.r.z.gibba045.atotkw\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:44.004644Z\"}}, \"last_daemon_update\": \"2021-03-10T13:49:06.722624Z\", \"last_device_update\": \"2021-03-10T13:43:30.693305Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:49:07.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:07 gibba015 bash[13005]: audit 2021-03-10T13:49:06.734724+0000 mon.a (mon.0) 641 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101774786, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721104Z\", \"created\": \"2021-03-10T13:40:16.047558Z\", \"started\": \"2021-03-10T13:40:16.069701Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba045\", \"container_id\": \"0b25900c63e0\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 373817344, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721263Z\", \"created\": \"2021-03-10T13:40:32.015558Z\", \"started\": \"2021-03-10T13:48:33.658328Z\"}, \"mgr.gibba045.orlgmj\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba045.orlgmj\", \"hostname\": \"gibba045\", \"container_id\": \"ea964e825589\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 403701760, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721358Z\", \"created\": \"2021-03-10T13:40:34.535558Z\", \"started\": \"2021-03-10T13:48:50.630289Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48360325, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721446Z\", \"created\": \"2021-03-10T13:42:17.077564Z\", \"started\": \"2021-03-10T13:42:20.232803Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47238348, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721681Z\", \"created\": \"2021-03-10T13:42:38.781564Z\", \"started\": \"2021-03-10T13:42:42.298036Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46357544, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721874Z\", \"created\": \"2021-03-10T13:43:00.493564Z\", \"started\": \"2021-03-10T13:43:03.477079Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48255467, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722061Z\", \"created\": \"2021-03-10T13:43:22.897564Z\", \"started\": \"2021-03-10T13:43:26.167781Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba045\", \"container_id\": \"b3907fa26ba0\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 34697379, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722246Z\", \"created\": \"2021-03-10T13:43:42.821564Z\", \"started\": \"2021-03-10T13:44:24.396576Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23991418, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722341Z\", \"created\": \"2021-03-10T13:43:43.861564Z\", \"started\": \"2021-03-10T13:43:45.351099Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba045\", \"container_id\": \"d86cab6511db\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29611786, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722427Z\", \"created\": \"2021-03-10T13:44:08.721564Z\", \"started\": \"2021-03-10T13:44:08.746042Z\"}, \"rgw.r.z.gibba045.atotkw\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba045.atotkw\", \"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722512Z\", \"created\": \"2021-03-10T13:45:45.925564Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:21.028684Z\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:37.919264Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:44:17.558720Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818Z\"}, \"rgw.r.z.gibba045.atotkw\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:44.004644Z\"}}, \"last_daemon_update\": \"2021-03-10T13:49:06.722624Z\", \"last_device_update\": \"2021-03-10T13:43:30.693305Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445Z\", \"scheduled_daemon_actions\": {}}"}]': finished 2021-03-10T13:49:07.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:07 gibba015 bash[13005]: audit 2021-03-10T13:49:06.984344+0000 mon.b (mon.2) 78 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T13:49:07.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:07 gibba015 bash[13005]: audit 2021-03-10T13:49:06.987494+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T13:49:07.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:07 gibba015 bash[13005]: audit 2021-03-10T13:49:06.996509+0000 mon.a (mon.0) 643 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2021-03-10T13:49:07.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:07 gibba015 bash[13005]: audit 2021-03-10T13:49:06.999603+0000 mon.b (mon.2) 79 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:49:07.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:07 gibba015 bash[13005]: audit 2021-03-10T13:49:07.000552+0000 mon.b (mon.2) 80 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:49:07.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:07 gibba015 bash[13005]: audit 2021-03-10T13:49:07.001335+0000 mon.b (mon.2) 81 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:49:07.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:07 gibba015 bash[13005]: audit 2021-03-10T13:49:07.002263+0000 mon.b (mon.2) 82 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2021-03-10T13:49:07.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:07 gibba015 bash[9806]: audit 2021-03-10T13:49:06.725251+0000 mon.a (mon.0) 640 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101774786, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721104Z\", \"created\": \"2021-03-10T13:40:16.047558Z\", \"started\": \"2021-03-10T13:40:16.069701Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba045\", \"container_id\": \"0b25900c63e0\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 373817344, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721263Z\", \"created\": \"2021-03-10T13:40:32.015558Z\", \"started\": \"2021-03-10T13:48:33.658328Z\"}, \"mgr.gibba045.orlgmj\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba045.orlgmj\", \"hostname\": \"gibba045\", \"container_id\": \"ea964e825589\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 403701760, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721358Z\", \"created\": \"2021-03-10T13:40:34.535558Z\", \"started\": \"2021-03-10T13:48:50.630289Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48360325, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721446Z\", \"created\": \"2021-03-10T13:42:17.077564Z\", \"started\": \"2021-03-10T13:42:20.232803Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47238348, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721681Z\", \"created\": \"2021-03-10T13:42:38.781564Z\", \"started\": \"2021-03-10T13:42:42.298036Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46357544, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721874Z\", \"created\": \"2021-03-10T13:43:00.493564Z\", \"started\": \"2021-03-10T13:43:03.477079Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48255467, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722061Z\", \"created\": \"2021-03-10T13:43:22.897564Z\", \"started\": \"2021-03-10T13:43:26.167781Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba045\", \"container_id\": \"b3907fa26ba0\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 34697379, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722246Z\", \"created\": \"2021-03-10T13:43:42.821564Z\", \"started\": \"2021-03-10T13:44:24.396576Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23991418, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722341Z\", \"created\": \"2021-03-10T13:43:43.861564Z\", \"started\": \"2021-03-10T13:43:45.351099Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba045\", \"container_id\": \"d86cab6511db\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29611786, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722427Z\", \"created\": \"2021-03-10T13:44:08.721564Z\", \"started\": \"2021-03-10T13:44:08.746042Z\"}, \"rgw.r.z.gibba045.atotkw\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba045.atotkw\", \"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722512Z\", \"created\": \"2021-03-10T13:45:45.925564Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:21.028684Z\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:37.919264Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:44:17.558720Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818Z\"}, \"rgw.r.z.gibba045.atotkw\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:44.004644Z\"}}, \"last_daemon_update\": \"2021-03-10T13:49:06.722624Z\", \"last_device_update\": \"2021-03-10T13:43:30.693305Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:49:07.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:07 gibba015 bash[9806]: audit 2021-03-10T13:49:06.734724+0000 mon.a (mon.0) 641 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101774786, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721104Z\", \"created\": \"2021-03-10T13:40:16.047558Z\", \"started\": \"2021-03-10T13:40:16.069701Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba045\", \"container_id\": \"0b25900c63e0\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 373817344, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721263Z\", \"created\": \"2021-03-10T13:40:32.015558Z\", \"started\": \"2021-03-10T13:48:33.658328Z\"}, \"mgr.gibba045.orlgmj\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba045.orlgmj\", \"hostname\": \"gibba045\", \"container_id\": \"ea964e825589\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 403701760, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721358Z\", \"created\": \"2021-03-10T13:40:34.535558Z\", \"started\": \"2021-03-10T13:48:50.630289Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48360325, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721446Z\", \"created\": \"2021-03-10T13:42:17.077564Z\", \"started\": \"2021-03-10T13:42:20.232803Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47238348, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721681Z\", \"created\": \"2021-03-10T13:42:38.781564Z\", \"started\": \"2021-03-10T13:42:42.298036Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46357544, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721874Z\", \"created\": \"2021-03-10T13:43:00.493564Z\", \"started\": \"2021-03-10T13:43:03.477079Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48255467, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722061Z\", \"created\": \"2021-03-10T13:43:22.897564Z\", \"started\": \"2021-03-10T13:43:26.167781Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba045\", \"container_id\": \"b3907fa26ba0\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 34697379, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722246Z\", \"created\": \"2021-03-10T13:43:42.821564Z\", \"started\": \"2021-03-10T13:44:24.396576Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23991418, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722341Z\", \"created\": \"2021-03-10T13:43:43.861564Z\", \"started\": \"2021-03-10T13:43:45.351099Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba045\", \"container_id\": \"d86cab6511db\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29611786, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722427Z\", \"created\": \"2021-03-10T13:44:08.721564Z\", \"started\": \"2021-03-10T13:44:08.746042Z\"}, \"rgw.r.z.gibba045.atotkw\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba045.atotkw\", \"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722512Z\", \"created\": \"2021-03-10T13:45:45.925564Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:21.028684Z\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:37.919264Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:44:17.558720Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818Z\"}, \"rgw.r.z.gibba045.atotkw\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:44.004644Z\"}}, \"last_daemon_update\": \"2021-03-10T13:49:06.722624Z\", \"last_device_update\": \"2021-03-10T13:43:30.693305Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445Z\", \"scheduled_daemon_actions\": {}}"}]': finished 2021-03-10T13:49:07.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:07 gibba015 bash[9806]: audit 2021-03-10T13:49:06.984344+0000 mon.b (mon.2) 78 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T13:49:07.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:07 gibba015 bash[9806]: audit 2021-03-10T13:49:06.987494+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T13:49:07.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:07 gibba015 bash[9806]: audit 2021-03-10T13:49:06.996509+0000 mon.a (mon.0) 643 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2021-03-10T13:49:07.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:07 gibba015 bash[9806]: audit 2021-03-10T13:49:06.999603+0000 mon.b (mon.2) 79 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:49:07.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:07 gibba015 bash[9806]: audit 2021-03-10T13:49:07.000552+0000 mon.b (mon.2) 80 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:49:07.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:07 gibba015 bash[9806]: audit 2021-03-10T13:49:07.001335+0000 mon.b (mon.2) 81 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:49:07.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:07 gibba015 bash[9806]: audit 2021-03-10T13:49:07.002263+0000 mon.b (mon.2) 82 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2021-03-10T13:49:07.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:07 gibba045 bash[9787]: cephadm 2021-03-10T13:49:05.853514+0000 mgr.gibba045.orlgmj (mgr.34379) 9 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T13:49:07.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:07 gibba045 bash[9787]: audit 2021-03-10T13:49:06.723992+0000 mon.b (mon.2) 77 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101774786, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721104Z\", \"created\": \"2021-03-10T13:40:16.047558Z\", \"started\": \"2021-03-10T13:40:16.069701Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba045\", \"container_id\": \"0b25900c63e0\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 373817344, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721263Z\", \"created\": \"2021-03-10T13:40:32.015558Z\", \"started\": \"2021-03-10T13:48:33.658328Z\"}, \"mgr.gibba045.orlgmj\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba045.orlgmj\", \"hostname\": \"gibba045\", \"container_id\": \"ea964e825589\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 403701760, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721358Z\", \"created\": \"2021-03-10T13:40:34.535558Z\", \"started\": \"2021-03-10T13:48:50.630289Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48360325, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721446Z\", \"created\": \"2021-03-10T13:42:17.077564Z\", \"started\": \"2021-03-10T13:42:20.232803Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47238348, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721681Z\", \"created\": \"2021-03-10T13:42:38.781564Z\", \"started\": \"2021-03-10T13:42:42.298036Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46357544, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721874Z\", \"created\": \"2021-03-10T13:43:00.493564Z\", \"started\": \"2021-03-10T13:43:03.477079Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48255467, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722061Z\", \"created\": \"2021-03-10T13:43:22.897564Z\", \"started\": \"2021-03-10T13:43:26.167781Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba045\", \"container_id\": \"b3907fa26ba0\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 34697379, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722246Z\", \"created\": \"2021-03-10T13:43:42.821564Z\", \"started\": \"2021-03-10T13:44:24.396576Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23991418, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722341Z\", \"created\": \"2021-03-10T13:43:43.861564Z\", \"started\": \"2021-03-10T13:43:45.351099Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba045\", \"container_id\": \"d86cab6511db\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29611786, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722427Z\", \"created\": \"2021-03-10T13:44:08.721564Z\", \"started\": \"2021-03-10T13:44:08.746042Z\"}, \"rgw.r.z.gibba045.atotkw\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba045.atotkw\", \"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722512Z\", \"created\": \"2021-03-10T13:45:45.925564Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:21.028684Z\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:37.919264Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:44:17.558720Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818Z\"}, \"rgw.r.z.gibba045.atotkw\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:44.004644Z\"}}, \"last_daemon_update\": \"2021-03-10T13:49:06.722624Z\", \"last_device_update\": \"2021-03-10T13:43:30.693305Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:49:07.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:07 gibba045 bash[9787]: audit 2021-03-10T13:49:06.725251+0000 mon.a (mon.0) 640 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101774786, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721104Z\", \"created\": \"2021-03-10T13:40:16.047558Z\", \"started\": \"2021-03-10T13:40:16.069701Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba045\", \"container_id\": \"0b25900c63e0\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 373817344, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721263Z\", \"created\": \"2021-03-10T13:40:32.015558Z\", \"started\": \"2021-03-10T13:48:33.658328Z\"}, \"mgr.gibba045.orlgmj\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba045.orlgmj\", \"hostname\": \"gibba045\", \"container_id\": \"ea964e825589\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 403701760, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721358Z\", \"created\": \"2021-03-10T13:40:34.535558Z\", \"started\": \"2021-03-10T13:48:50.630289Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48360325, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721446Z\", \"created\": \"2021-03-10T13:42:17.077564Z\", \"started\": \"2021-03-10T13:42:20.232803Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47238348, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721681Z\", \"created\": \"2021-03-10T13:42:38.781564Z\", \"started\": \"2021-03-10T13:42:42.298036Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46357544, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721874Z\", \"created\": \"2021-03-10T13:43:00.493564Z\", \"started\": \"2021-03-10T13:43:03.477079Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48255467, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722061Z\", \"created\": \"2021-03-10T13:43:22.897564Z\", \"started\": \"2021-03-10T13:43:26.167781Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba045\", \"container_id\": \"b3907fa26ba0\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 34697379, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722246Z\", \"created\": \"2021-03-10T13:43:42.821564Z\", \"started\": \"2021-03-10T13:44:24.396576Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23991418, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722341Z\", \"created\": \"2021-03-10T13:43:43.861564Z\", \"started\": \"2021-03-10T13:43:45.351099Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba045\", \"container_id\": \"d86cab6511db\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29611786, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722427Z\", \"created\": \"2021-03-10T13:44:08.721564Z\", \"started\": \"2021-03-10T13:44:08.746042Z\"}, \"rgw.r.z.gibba045.atotkw\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba045.atotkw\", \"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722512Z\", \"created\": \"2021-03-10T13:45:45.925564Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:21.028684Z\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:37.919264Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:44:17.558720Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818Z\"}, \"rgw.r.z.gibba045.atotkw\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:44.004644Z\"}}, \"last_daemon_update\": \"2021-03-10T13:49:06.722624Z\", \"last_device_update\": \"2021-03-10T13:43:30.693305Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:49:07.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:07 gibba045 bash[9787]: audit 2021-03-10T13:49:06.734724+0000 mon.a (mon.0) 641 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101774786, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721104Z\", \"created\": \"2021-03-10T13:40:16.047558Z\", \"started\": \"2021-03-10T13:40:16.069701Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba045\", \"container_id\": \"0b25900c63e0\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 373817344, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721263Z\", \"created\": \"2021-03-10T13:40:32.015558Z\", \"started\": \"2021-03-10T13:48:33.658328Z\"}, \"mgr.gibba045.orlgmj\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba045.orlgmj\", \"hostname\": \"gibba045\", \"container_id\": \"ea964e825589\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 403701760, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721358Z\", \"created\": \"2021-03-10T13:40:34.535558Z\", \"started\": \"2021-03-10T13:48:50.630289Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48360325, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721446Z\", \"created\": \"2021-03-10T13:42:17.077564Z\", \"started\": \"2021-03-10T13:42:20.232803Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47238348, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721681Z\", \"created\": \"2021-03-10T13:42:38.781564Z\", \"started\": \"2021-03-10T13:42:42.298036Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46357544, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721874Z\", \"created\": \"2021-03-10T13:43:00.493564Z\", \"started\": \"2021-03-10T13:43:03.477079Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48255467, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722061Z\", \"created\": \"2021-03-10T13:43:22.897564Z\", \"started\": \"2021-03-10T13:43:26.167781Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba045\", \"container_id\": \"b3907fa26ba0\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 34697379, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722246Z\", \"created\": \"2021-03-10T13:43:42.821564Z\", \"started\": \"2021-03-10T13:44:24.396576Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23991418, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722341Z\", \"created\": \"2021-03-10T13:43:43.861564Z\", \"started\": \"2021-03-10T13:43:45.351099Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba045\", \"container_id\": \"d86cab6511db\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29611786, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722427Z\", \"created\": \"2021-03-10T13:44:08.721564Z\", \"started\": \"2021-03-10T13:44:08.746042Z\"}, \"rgw.r.z.gibba045.atotkw\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba045.atotkw\", \"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722512Z\", \"created\": \"2021-03-10T13:45:45.925564Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:12.579614Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:21.028684Z\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:37.919264Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:44:17.558720Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818Z\"}, \"rgw.r.z.gibba045.atotkw\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:44.004644Z\"}}, \"last_daemon_update\": \"2021-03-10T13:49:06.722624Z\", \"last_device_update\": \"2021-03-10T13:43:30.693305Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445Z\", \"scheduled_daemon_actions\": {}}"}]': finished 2021-03-10T13:49:07.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:07 gibba045 bash[9787]: audit 2021-03-10T13:49:06.984344+0000 mon.b (mon.2) 78 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T13:49:07.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:07 gibba045 bash[9787]: audit 2021-03-10T13:49:06.987494+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T13:49:07.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:07 gibba045 bash[9787]: audit 2021-03-10T13:49:06.996509+0000 mon.a (mon.0) 643 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2021-03-10T13:49:07.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:07 gibba045 bash[9787]: audit 2021-03-10T13:49:06.999603+0000 mon.b (mon.2) 79 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:49:07.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:07 gibba045 bash[9787]: audit 2021-03-10T13:49:07.000552+0000 mon.b (mon.2) 80 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:49:07.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:07 gibba045 bash[9787]: audit 2021-03-10T13:49:07.001335+0000 mon.b (mon.2) 81 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:49:07.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:07 gibba045 bash[9787]: audit 2021-03-10T13:49:07.002263+0000 mon.b (mon.2) 82 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2021-03-10T13:49:07.852 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T13:49:07.852 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (4m) 1s ago 5m 0.21.0 prom/alertmanager c876f5897d7b 842b16a0ff6e 2021-03-10T13:49:07.852 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (4m) 1s ago 4m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T13:49:07.852 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (17s) 1s ago 8m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T13:49:07.852 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (34s) 1s ago 8m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T13:49:07.853 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (10m) 1s ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 9e4717dfc4f8 2021-03-10T13:49:07.853 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (10m) 1s ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 d38e67be51e5 2021-03-10T13:49:07.853 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (8m) 1s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 2523bc3385be 2021-03-10T13:49:07.853 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (9m) 1s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 d2d863b7e101 2021-03-10T13:49:07.854 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (5m) 1s ago 5m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T13:49:07.854 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (5m) 1s ago 5m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T13:49:07.854 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (8m) 1s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 1e67f692bb03 2021-03-10T13:49:07.854 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (7m) 1s ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 83369fd7640c 2021-03-10T13:49:07.854 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (7m) 1s ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b90f9ada390a 2021-03-10T13:49:07.855 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (7m) 1s ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 a77eccf371e5 2021-03-10T13:49:07.855 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (6m) 1s ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 9b9c84c84955 2021-03-10T13:49:07.855 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (6m) 1s ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 662e73261675 2021-03-10T13:49:07.855 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (6m) 1s ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 338d252f22e3 2021-03-10T13:49:07.856 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (5m) 1s ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 784edc0668a4 2021-03-10T13:49:07.856 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (4m) 1s ago 5m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T13:49:07.856 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 1s ago 3m docker.io/ceph/ceph:v15.2.0 2021-03-10T13:49:08.100 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T13:49:08.100 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T13:49:08.100 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3 2021-03-10T13:49:08.101 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T13:49:08.101 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T13:49:08.101 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 1, 2021-03-10T13:49:08.101 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 2 2021-03-10T13:49:08.101 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T13:49:08.102 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T13:49:08.102 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2021-03-10T13:49:08.102 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T13:49:08.102 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T13:49:08.103 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T13:49:08.103 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 12, 2021-03-10T13:49:08.103 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 2 2021-03-10T13:49:08.103 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T13:49:08.103 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T13:49:08.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:08 gibba015 bash[9806]: cephadm 2021-03-10T13:49:06.735989+0000 mgr.gibba045.orlgmj (mgr.34379) 10 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T13:49:08.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:08 gibba015 bash[9806]: cluster 2021-03-10T13:49:06.983974+0000 mgr.gibba045.orlgmj (mgr.34379) 11 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:08.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:08 gibba015 bash[9806]: cephadm 2021-03-10T13:49:06.999322+0000 mgr.gibba045.orlgmj (mgr.34379) 12 : cephadm [INF] Reconfiguring mon.a (unknown last config time)... 2021-03-10T13:49:08.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:08 gibba015 bash[9806]: cephadm 2021-03-10T13:49:07.001978+0000 mgr.gibba045.orlgmj (mgr.34379) 13 : cephadm [INF] Reconfiguring daemon mon.a on gibba015 2021-03-10T13:49:08.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:08 gibba015 bash[9806]: cluster 2021-03-10T13:49:07.728872+0000 mon.a (mon.0) 644 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2021-03-10T13:49:08.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:08 gibba015 bash[9806]: audit 2021-03-10T13:49:08.098921+0000 mon.a (mon.0) 645 : audit [DBG] from='client.? 172.21.2.115:0/2069153568' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:49:08.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:08 gibba015 bash[13005]: cephadm 2021-03-10T13:49:06.735989+0000 mgr.gibba045.orlgmj (mgr.34379) 10 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T13:49:08.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:08 gibba015 bash[13005]: cluster 2021-03-10T13:49:06.983974+0000 mgr.gibba045.orlgmj (mgr.34379) 11 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:08.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:08 gibba015 bash[13005]: cephadm 2021-03-10T13:49:06.999322+0000 mgr.gibba045.orlgmj (mgr.34379) 12 : cephadm [INF] Reconfiguring mon.a (unknown last config time)... 2021-03-10T13:49:08.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:08 gibba015 bash[13005]: cephadm 2021-03-10T13:49:07.001978+0000 mgr.gibba045.orlgmj (mgr.34379) 13 : cephadm [INF] Reconfiguring daemon mon.a on gibba015 2021-03-10T13:49:08.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:08 gibba015 bash[13005]: cluster 2021-03-10T13:49:07.728872+0000 mon.a (mon.0) 644 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2021-03-10T13:49:08.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:08 gibba015 bash[13005]: audit 2021-03-10T13:49:08.098921+0000 mon.a (mon.0) 645 : audit [DBG] from='client.? 172.21.2.115:0/2069153568' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:49:08.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:08 gibba045 bash[9787]: cephadm 2021-03-10T13:49:06.735989+0000 mgr.gibba045.orlgmj (mgr.34379) 10 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T13:49:08.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:08 gibba045 bash[9787]: cluster 2021-03-10T13:49:06.983974+0000 mgr.gibba045.orlgmj (mgr.34379) 11 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:08.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:08 gibba045 bash[9787]: cephadm 2021-03-10T13:49:06.999322+0000 mgr.gibba045.orlgmj (mgr.34379) 12 : cephadm [INF] Reconfiguring mon.a (unknown last config time)... 2021-03-10T13:49:08.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:08 gibba045 bash[9787]: cephadm 2021-03-10T13:49:07.001978+0000 mgr.gibba045.orlgmj (mgr.34379) 13 : cephadm [INF] Reconfiguring daemon mon.a on gibba015 2021-03-10T13:49:08.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:08 gibba045 bash[9787]: cluster 2021-03-10T13:49:07.728872+0000 mon.a (mon.0) 644 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2021-03-10T13:49:08.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:08 gibba045 bash[9787]: audit 2021-03-10T13:49:08.098921+0000 mon.a (mon.0) 645 : audit [DBG] from='client.? 172.21.2.115:0/2069153568' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:49:09.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:09 gibba045 bash[9787]: audit 2021-03-10T13:49:07.614338+0000 mgr.gibba045.orlgmj (mgr.34379) 14 : audit [DBG] from='client.24502 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:49:09.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:09 gibba045 bash[9787]: audit 2021-03-10T13:49:07.839371+0000 mgr.gibba045.orlgmj (mgr.34379) 15 : audit [DBG] from='client.24508 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:49:09.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:09 gibba045 bash[9787]: audit 2021-03-10T13:49:08.911496+0000 mon.b (mon.2) 83 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93375692, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847333Z\", \"created\": \"2021-03-10T13:38:50.668449Z\", \"started\": \"2021-03-10T13:38:56.060544Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 307337625, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847491Z\", \"created\": \"2021-03-10T13:38:58.024449Z\", \"started\": \"2021-03-10T13:38:58.047154Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95776931, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847552Z\", \"created\": \"2021-03-10T13:40:03.296449Z\", \"started\": \"2021-03-10T13:40:03.320843Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48737812, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847608Z\", \"created\": \"2021-03-10T13:40:50.072448Z\", \"started\": \"2021-03-10T13:40:53.142290Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49733959, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847779Z\", \"created\": \"2021-03-10T13:41:11.556448Z\", \"started\": \"2021-03-10T13:41:15.069232Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46493859, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847910Z\", \"created\": \"2021-03-10T13:41:34.244448Z\", \"started\": \"2021-03-10T13:41:37.507096Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46850375, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848034Z\", \"created\": \"2021-03-10T13:41:57.328380Z\", \"started\": \"2021-03-10T13:42:00.781947Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22387097, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848156Z\", \"created\": \"2021-03-10T13:43:44.272379Z\", \"started\": \"2021-03-10T13:43:47.550063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"842b16a0ff6e\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13348372, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848232Z\", \"created\": \"2021-03-10T13:43:54.628379Z\", \"started\": \"2021-03-10T13:44:17.568021Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:44:10.554431Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:07.001926Z\"}}, \"last_daemon_update\": \"2021-03-10T13:49:05.848345Z\", \"last_device_update\": \"2021-03-10T13:42:03.853072Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:49:09.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:09 gibba045 bash[9787]: audit 2021-03-10T13:49:08.912588+0000 mon.a (mon.0) 646 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93375692, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847333Z\", \"created\": \"2021-03-10T13:38:50.668449Z\", \"started\": \"2021-03-10T13:38:56.060544Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 307337625, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847491Z\", \"created\": \"2021-03-10T13:38:58.024449Z\", \"started\": \"2021-03-10T13:38:58.047154Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95776931, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847552Z\", \"created\": \"2021-03-10T13:40:03.296449Z\", \"started\": \"2021-03-10T13:40:03.320843Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48737812, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847608Z\", \"created\": \"2021-03-10T13:40:50.072448Z\", \"started\": \"2021-03-10T13:40:53.142290Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49733959, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847779Z\", \"created\": \"2021-03-10T13:41:11.556448Z\", \"started\": \"2021-03-10T13:41:15.069232Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46493859, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847910Z\", \"created\": \"2021-03-10T13:41:34.244448Z\", \"started\": \"2021-03-10T13:41:37.507096Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46850375, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848034Z\", \"created\": \"2021-03-10T13:41:57.328380Z\", \"started\": \"2021-03-10T13:42:00.781947Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22387097, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848156Z\", \"created\": \"2021-03-10T13:43:44.272379Z\", \"started\": \"2021-03-10T13:43:47.550063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"842b16a0ff6e\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13348372, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848232Z\", \"created\": \"2021-03-10T13:43:54.628379Z\", \"started\": \"2021-03-10T13:44:17.568021Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:44:10.554431Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:07.001926Z\"}}, \"last_daemon_update\": \"2021-03-10T13:49:05.848345Z\", \"last_device_update\": \"2021-03-10T13:42:03.853072Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:49:09.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:09 gibba045 bash[9787]: audit 2021-03-10T13:49:08.916659+0000 mon.a (mon.0) 647 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93375692, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847333Z\", \"created\": \"2021-03-10T13:38:50.668449Z\", \"started\": \"2021-03-10T13:38:56.060544Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 307337625, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847491Z\", \"created\": \"2021-03-10T13:38:58.024449Z\", \"started\": \"2021-03-10T13:38:58.047154Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95776931, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847552Z\", \"created\": \"2021-03-10T13:40:03.296449Z\", \"started\": \"2021-03-10T13:40:03.320843Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48737812, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847608Z\", \"created\": \"2021-03-10T13:40:50.072448Z\", \"started\": \"2021-03-10T13:40:53.142290Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49733959, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847779Z\", \"created\": \"2021-03-10T13:41:11.556448Z\", \"started\": \"2021-03-10T13:41:15.069232Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46493859, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847910Z\", \"created\": \"2021-03-10T13:41:34.244448Z\", \"started\": \"2021-03-10T13:41:37.507096Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46850375, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848034Z\", \"created\": \"2021-03-10T13:41:57.328380Z\", \"started\": \"2021-03-10T13:42:00.781947Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22387097, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848156Z\", \"created\": \"2021-03-10T13:43:44.272379Z\", \"started\": \"2021-03-10T13:43:47.550063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"842b16a0ff6e\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13348372, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848232Z\", \"created\": \"2021-03-10T13:43:54.628379Z\", \"started\": \"2021-03-10T13:44:17.568021Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:44:10.554431Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:07.001926Z\"}}, \"last_daemon_update\": \"2021-03-10T13:49:05.848345Z\", \"last_device_update\": \"2021-03-10T13:42:03.853072Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426Z\", \"scheduled_daemon_actions\": {}}"}]': finished 2021-03-10T13:49:09.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:09 gibba045 bash[9787]: audit 2021-03-10T13:49:08.922926+0000 mon.b (mon.2) 84 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:49:09.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:09 gibba045 bash[9787]: audit 2021-03-10T13:49:08.923789+0000 mon.b (mon.2) 85 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:49:09.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:09 gibba045 bash[9787]: audit 2021-03-10T13:49:08.924527+0000 mon.b (mon.2) 86 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:49:09.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:09 gibba045 bash[9787]: audit 2021-03-10T13:49:08.925432+0000 mon.b (mon.2) 87 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2021-03-10T13:49:09.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:09 gibba015 bash[9806]: audit 2021-03-10T13:49:07.614338+0000 mgr.gibba045.orlgmj (mgr.34379) 14 : audit [DBG] from='client.24502 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:49:09.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:09 gibba015 bash[9806]: audit 2021-03-10T13:49:07.839371+0000 mgr.gibba045.orlgmj (mgr.34379) 15 : audit [DBG] from='client.24508 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:49:09.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:09 gibba015 bash[13005]: audit 2021-03-10T13:49:07.614338+0000 mgr.gibba045.orlgmj (mgr.34379) 14 : audit [DBG] from='client.24502 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:49:09.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:09 gibba015 bash[13005]: audit 2021-03-10T13:49:07.839371+0000 mgr.gibba045.orlgmj (mgr.34379) 15 : audit [DBG] from='client.24508 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:49:09.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:09 gibba015 bash[9806]: audit 2021-03-10T13:49:08.911496+0000 mon.b (mon.2) 83 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93375692, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847333Z\", \"created\": \"2021-03-10T13:38:50.668449Z\", \"started\": \"2021-03-10T13:38:56.060544Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 307337625, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847491Z\", \"created\": \"2021-03-10T13:38:58.024449Z\", \"started\": \"2021-03-10T13:38:58.047154Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95776931, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847552Z\", \"created\": \"2021-03-10T13:40:03.296449Z\", \"started\": \"2021-03-10T13:40:03.320843Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48737812, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847608Z\", \"created\": \"2021-03-10T13:40:50.072448Z\", \"started\": \"2021-03-10T13:40:53.142290Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49733959, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847779Z\", \"created\": \"2021-03-10T13:41:11.556448Z\", \"started\": \"2021-03-10T13:41:15.069232Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46493859, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847910Z\", \"created\": \"2021-03-10T13:41:34.244448Z\", \"started\": \"2021-03-10T13:41:37.507096Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46850375, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848034Z\", \"created\": \"2021-03-10T13:41:57.328380Z\", \"started\": \"2021-03-10T13:42:00.781947Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22387097, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848156Z\", \"created\": \"2021-03-10T13:43:44.272379Z\", \"started\": \"2021-03-10T13:43:47.550063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"842b16a0ff6e\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13348372, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848232Z\", \"created\": \"2021-03-10T13:43:54.628379Z\", \"started\": \"2021-03-10T13:44:17.568021Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:44:10.554431Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:07.001926Z\"}}, \"last_daemon_update\": \"2021-03-10T13:49:05.848345Z\", \"last_device_update\": \"2021-03-10T13:42:03.853072Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:49:09.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:09 gibba015 bash[13005]: audit 2021-03-10T13:49:08.911496+0000 mon.b (mon.2) 83 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93375692, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847333Z\", \"created\": \"2021-03-10T13:38:50.668449Z\", \"started\": \"2021-03-10T13:38:56.060544Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 307337625, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847491Z\", \"created\": \"2021-03-10T13:38:58.024449Z\", \"started\": \"2021-03-10T13:38:58.047154Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95776931, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847552Z\", \"created\": \"2021-03-10T13:40:03.296449Z\", \"started\": \"2021-03-10T13:40:03.320843Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48737812, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847608Z\", \"created\": \"2021-03-10T13:40:50.072448Z\", \"started\": \"2021-03-10T13:40:53.142290Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49733959, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847779Z\", \"created\": \"2021-03-10T13:41:11.556448Z\", \"started\": \"2021-03-10T13:41:15.069232Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46493859, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847910Z\", \"created\": \"2021-03-10T13:41:34.244448Z\", \"started\": \"2021-03-10T13:41:37.507096Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46850375, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848034Z\", \"created\": \"2021-03-10T13:41:57.328380Z\", \"started\": \"2021-03-10T13:42:00.781947Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22387097, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848156Z\", \"created\": \"2021-03-10T13:43:44.272379Z\", \"started\": \"2021-03-10T13:43:47.550063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"842b16a0ff6e\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13348372, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848232Z\", \"created\": \"2021-03-10T13:43:54.628379Z\", \"started\": \"2021-03-10T13:44:17.568021Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:44:10.554431Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:07.001926Z\"}}, \"last_daemon_update\": \"2021-03-10T13:49:05.848345Z\", \"last_device_update\": \"2021-03-10T13:42:03.853072Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:49:09.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:09 gibba015 bash[9806]: audit 2021-03-10T13:49:08.912588+0000 mon.a (mon.0) 646 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93375692, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847333Z\", \"created\": \"2021-03-10T13:38:50.668449Z\", \"started\": \"2021-03-10T13:38:56.060544Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 307337625, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847491Z\", \"created\": \"2021-03-10T13:38:58.024449Z\", \"started\": \"2021-03-10T13:38:58.047154Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95776931, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847552Z\", \"created\": \"2021-03-10T13:40:03.296449Z\", \"started\": \"2021-03-10T13:40:03.320843Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48737812, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847608Z\", \"created\": \"2021-03-10T13:40:50.072448Z\", \"started\": \"2021-03-10T13:40:53.142290Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49733959, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847779Z\", \"created\": \"2021-03-10T13:41:11.556448Z\", \"started\": \"2021-03-10T13:41:15.069232Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46493859, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847910Z\", \"created\": \"2021-03-10T13:41:34.244448Z\", \"started\": \"2021-03-10T13:41:37.507096Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46850375, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848034Z\", \"created\": \"2021-03-10T13:41:57.328380Z\", \"started\": \"2021-03-10T13:42:00.781947Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22387097, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848156Z\", \"created\": \"2021-03-10T13:43:44.272379Z\", \"started\": \"2021-03-10T13:43:47.550063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"842b16a0ff6e\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13348372, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848232Z\", \"created\": \"2021-03-10T13:43:54.628379Z\", \"started\": \"2021-03-10T13:44:17.568021Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:44:10.554431Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:07.001926Z\"}}, \"last_daemon_update\": \"2021-03-10T13:49:05.848345Z\", \"last_device_update\": \"2021-03-10T13:42:03.853072Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:49:09.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:09 gibba015 bash[13005]: audit 2021-03-10T13:49:08.912588+0000 mon.a (mon.0) 646 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93375692, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847333Z\", \"created\": \"2021-03-10T13:38:50.668449Z\", \"started\": \"2021-03-10T13:38:56.060544Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 307337625, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847491Z\", \"created\": \"2021-03-10T13:38:58.024449Z\", \"started\": \"2021-03-10T13:38:58.047154Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95776931, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847552Z\", \"created\": \"2021-03-10T13:40:03.296449Z\", \"started\": \"2021-03-10T13:40:03.320843Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48737812, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847608Z\", \"created\": \"2021-03-10T13:40:50.072448Z\", \"started\": \"2021-03-10T13:40:53.142290Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49733959, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847779Z\", \"created\": \"2021-03-10T13:41:11.556448Z\", \"started\": \"2021-03-10T13:41:15.069232Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46493859, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847910Z\", \"created\": \"2021-03-10T13:41:34.244448Z\", \"started\": \"2021-03-10T13:41:37.507096Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46850375, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848034Z\", \"created\": \"2021-03-10T13:41:57.328380Z\", \"started\": \"2021-03-10T13:42:00.781947Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22387097, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848156Z\", \"created\": \"2021-03-10T13:43:44.272379Z\", \"started\": \"2021-03-10T13:43:47.550063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"842b16a0ff6e\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13348372, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848232Z\", \"created\": \"2021-03-10T13:43:54.628379Z\", \"started\": \"2021-03-10T13:44:17.568021Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:44:10.554431Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:07.001926Z\"}}, \"last_daemon_update\": \"2021-03-10T13:49:05.848345Z\", \"last_device_update\": \"2021-03-10T13:42:03.853072Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:49:09.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:09 gibba015 bash[9806]: audit 2021-03-10T13:49:08.916659+0000 mon.a (mon.0) 647 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93375692, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847333Z\", \"created\": \"2021-03-10T13:38:50.668449Z\", \"started\": \"2021-03-10T13:38:56.060544Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 307337625, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847491Z\", \"created\": \"2021-03-10T13:38:58.024449Z\", \"started\": \"2021-03-10T13:38:58.047154Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95776931, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847552Z\", \"created\": \"2021-03-10T13:40:03.296449Z\", \"started\": \"2021-03-10T13:40:03.320843Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48737812, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847608Z\", \"created\": \"2021-03-10T13:40:50.072448Z\", \"started\": \"2021-03-10T13:40:53.142290Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49733959, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847779Z\", \"created\": \"2021-03-10T13:41:11.556448Z\", \"started\": \"2021-03-10T13:41:15.069232Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46493859, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847910Z\", \"created\": \"2021-03-10T13:41:34.244448Z\", \"started\": \"2021-03-10T13:41:37.507096Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46850375, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848034Z\", \"created\": \"2021-03-10T13:41:57.328380Z\", \"started\": \"2021-03-10T13:42:00.781947Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22387097, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848156Z\", \"created\": \"2021-03-10T13:43:44.272379Z\", \"started\": \"2021-03-10T13:43:47.550063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"842b16a0ff6e\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13348372, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848232Z\", \"created\": \"2021-03-10T13:43:54.628379Z\", \"started\": \"2021-03-10T13:44:17.568021Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:44:10.554431Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:07.001926Z\"}}, \"last_daemon_update\": \"2021-03-10T13:49:05.848345Z\", \"last_device_update\": \"2021-03-10T13:42:03.853072Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426Z\", \"scheduled_daemon_actions\": {}}"}]': finished 2021-03-10T13:49:09.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:09 gibba015 bash[9806]: audit 2021-03-10T13:49:08.922926+0000 mon.b (mon.2) 84 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:49:09.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:09 gibba015 bash[9806]: audit 2021-03-10T13:49:08.923789+0000 mon.b (mon.2) 85 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:49:09.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:09 gibba015 bash[9806]: audit 2021-03-10T13:49:08.924527+0000 mon.b (mon.2) 86 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:49:09.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:09 gibba015 bash[9806]: audit 2021-03-10T13:49:08.925432+0000 mon.b (mon.2) 87 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2021-03-10T13:49:09.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:09 gibba015 bash[13005]: audit 2021-03-10T13:49:08.916659+0000 mon.a (mon.0) 647 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93375692, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847333Z\", \"created\": \"2021-03-10T13:38:50.668449Z\", \"started\": \"2021-03-10T13:38:56.060544Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 307337625, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847491Z\", \"created\": \"2021-03-10T13:38:58.024449Z\", \"started\": \"2021-03-10T13:38:58.047154Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95776931, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847552Z\", \"created\": \"2021-03-10T13:40:03.296449Z\", \"started\": \"2021-03-10T13:40:03.320843Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48737812, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847608Z\", \"created\": \"2021-03-10T13:40:50.072448Z\", \"started\": \"2021-03-10T13:40:53.142290Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49733959, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847779Z\", \"created\": \"2021-03-10T13:41:11.556448Z\", \"started\": \"2021-03-10T13:41:15.069232Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46493859, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847910Z\", \"created\": \"2021-03-10T13:41:34.244448Z\", \"started\": \"2021-03-10T13:41:37.507096Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46850375, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848034Z\", \"created\": \"2021-03-10T13:41:57.328380Z\", \"started\": \"2021-03-10T13:42:00.781947Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22387097, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848156Z\", \"created\": \"2021-03-10T13:43:44.272379Z\", \"started\": \"2021-03-10T13:43:47.550063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"842b16a0ff6e\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13348372, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848232Z\", \"created\": \"2021-03-10T13:43:54.628379Z\", \"started\": \"2021-03-10T13:44:17.568021Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:00.148995Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:44:10.554431Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:07.001926Z\"}}, \"last_daemon_update\": \"2021-03-10T13:49:05.848345Z\", \"last_device_update\": \"2021-03-10T13:42:03.853072Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426Z\", \"scheduled_daemon_actions\": {}}"}]': finished 2021-03-10T13:49:09.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:09 gibba015 bash[13005]: audit 2021-03-10T13:49:08.922926+0000 mon.b (mon.2) 84 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:49:09.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:09 gibba015 bash[13005]: audit 2021-03-10T13:49:08.923789+0000 mon.b (mon.2) 85 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:49:09.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:09 gibba015 bash[13005]: audit 2021-03-10T13:49:08.924527+0000 mon.b (mon.2) 86 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:49:09.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:09 gibba015 bash[13005]: audit 2021-03-10T13:49:08.925432+0000 mon.b (mon.2) 87 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2021-03-10T13:49:10.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:10 gibba015 bash[9806]: cephadm 2021-03-10T13:49:08.922698+0000 mgr.gibba045.orlgmj (mgr.34379) 16 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2021-03-10T13:49:10.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:10 gibba015 bash[9806]: cephadm 2021-03-10T13:49:08.925183+0000 mgr.gibba045.orlgmj (mgr.34379) 17 : cephadm [INF] Reconfiguring daemon mon.c on gibba015 2021-03-10T13:49:10.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:10 gibba015 bash[9806]: cluster 2021-03-10T13:49:08.984839+0000 mgr.gibba045.orlgmj (mgr.34379) 18 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:10.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:10 gibba015 bash[13005]: cephadm 2021-03-10T13:49:08.922698+0000 mgr.gibba045.orlgmj (mgr.34379) 16 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2021-03-10T13:49:10.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:10 gibba015 bash[13005]: cephadm 2021-03-10T13:49:08.925183+0000 mgr.gibba045.orlgmj (mgr.34379) 17 : cephadm [INF] Reconfiguring daemon mon.c on gibba015 2021-03-10T13:49:10.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:10 gibba015 bash[13005]: cluster 2021-03-10T13:49:08.984839+0000 mgr.gibba045.orlgmj (mgr.34379) 18 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:10.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:10 gibba045 bash[9787]: cephadm 2021-03-10T13:49:08.922698+0000 mgr.gibba045.orlgmj (mgr.34379) 16 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2021-03-10T13:49:10.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:10 gibba045 bash[9787]: cephadm 2021-03-10T13:49:08.925183+0000 mgr.gibba045.orlgmj (mgr.34379) 17 : cephadm [INF] Reconfiguring daemon mon.c on gibba015 2021-03-10T13:49:10.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:10 gibba045 bash[9787]: cluster 2021-03-10T13:49:08.984839+0000 mgr.gibba045.orlgmj (mgr.34379) 18 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:11.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:11 gibba045 bash[9787]: audit 2021-03-10T13:49:10.760456+0000 mon.b (mon.2) 88 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93375692, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847333Z\", \"created\": \"2021-03-10T13:38:50.668449Z\", \"started\": \"2021-03-10T13:38:56.060544Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 307337625, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847491Z\", \"created\": \"2021-03-10T13:38:58.024449Z\", \"started\": \"2021-03-10T13:38:58.047154Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95776931, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847552Z\", \"created\": \"2021-03-10T13:40:03.296449Z\", \"started\": \"2021-03-10T13:40:03.320843Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48737812, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847608Z\", \"created\": \"2021-03-10T13:40:50.072448Z\", \"started\": \"2021-03-10T13:40:53.142290Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49733959, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847779Z\", \"created\": \"2021-03-10T13:41:11.556448Z\", \"started\": \"2021-03-10T13:41:15.069232Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46493859, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847910Z\", \"created\": \"2021-03-10T13:41:34.244448Z\", \"started\": \"2021-03-10T13:41:37.507096Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46850375, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848034Z\", \"created\": \"2021-03-10T13:41:57.328380Z\", \"started\": \"2021-03-10T13:42:00.781947Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22387097, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848156Z\", \"created\": \"2021-03-10T13:43:44.272379Z\", \"started\": \"2021-03-10T13:43:47.550063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"842b16a0ff6e\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13348372, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848232Z\", \"created\": \"2021-03-10T13:43:54.628379Z\", \"started\": \"2021-03-10T13:44:17.568021Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:08.925129Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:44:10.554431Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:07.001926Z\"}}, \"last_daemon_update\": \"2021-03-10T13:49:05.848345Z\", \"last_device_update\": \"2021-03-10T13:42:03.853072Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426Z\"}"}]: dispatch 2021-03-10T13:49:11.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:11 gibba045 bash[9787]: audit 2021-03-10T13:49:10.761474+0000 mon.a (mon.0) 648 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93375692, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847333Z\", \"created\": \"2021-03-10T13:38:50.668449Z\", \"started\": \"2021-03-10T13:38:56.060544Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 307337625, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847491Z\", \"created\": \"2021-03-10T13:38:58.024449Z\", \"started\": \"2021-03-10T13:38:58.047154Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95776931, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847552Z\", \"created\": \"2021-03-10T13:40:03.296449Z\", \"started\": \"2021-03-10T13:40:03.320843Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48737812, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847608Z\", \"created\": \"2021-03-10T13:40:50.072448Z\", \"started\": \"2021-03-10T13:40:53.142290Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49733959, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847779Z\", \"created\": \"2021-03-10T13:41:11.556448Z\", \"started\": \"2021-03-10T13:41:15.069232Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46493859, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847910Z\", \"created\": \"2021-03-10T13:41:34.244448Z\", \"started\": \"2021-03-10T13:41:37.507096Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46850375, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848034Z\", \"created\": \"2021-03-10T13:41:57.328380Z\", \"started\": \"2021-03-10T13:42:00.781947Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22387097, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848156Z\", \"created\": \"2021-03-10T13:43:44.272379Z\", \"started\": \"2021-03-10T13:43:47.550063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"842b16a0ff6e\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13348372, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848232Z\", \"created\": \"2021-03-10T13:43:54.628379Z\", \"started\": \"2021-03-10T13:44:17.568021Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:08.925129Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:44:10.554431Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:07.001926Z\"}}, \"last_daemon_update\": \"2021-03-10T13:49:05.848345Z\", \"last_device_update\": \"2021-03-10T13:42:03.853072Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426Z\"}"}]: dispatch 2021-03-10T13:49:11.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:11 gibba045 bash[9787]: audit 2021-03-10T13:49:10.765847+0000 mon.a (mon.0) 649 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93375692, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847333Z\", \"created\": \"2021-03-10T13:38:50.668449Z\", \"started\": \"2021-03-10T13:38:56.060544Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 307337625, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847491Z\", \"created\": \"2021-03-10T13:38:58.024449Z\", \"started\": \"2021-03-10T13:38:58.047154Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95776931, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847552Z\", \"created\": \"2021-03-10T13:40:03.296449Z\", \"started\": \"2021-03-10T13:40:03.320843Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48737812, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847608Z\", \"created\": \"2021-03-10T13:40:50.072448Z\", \"started\": \"2021-03-10T13:40:53.142290Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49733959, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847779Z\", \"created\": \"2021-03-10T13:41:11.556448Z\", \"started\": \"2021-03-10T13:41:15.069232Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46493859, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847910Z\", \"created\": \"2021-03-10T13:41:34.244448Z\", \"started\": \"2021-03-10T13:41:37.507096Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46850375, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848034Z\", \"created\": \"2021-03-10T13:41:57.328380Z\", \"started\": \"2021-03-10T13:42:00.781947Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22387097, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848156Z\", \"created\": \"2021-03-10T13:43:44.272379Z\", \"started\": \"2021-03-10T13:43:47.550063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"842b16a0ff6e\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13348372, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848232Z\", \"created\": \"2021-03-10T13:43:54.628379Z\", \"started\": \"2021-03-10T13:44:17.568021Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:08.925129Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:44:10.554431Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:07.001926Z\"}}, \"last_daemon_update\": \"2021-03-10T13:49:05.848345Z\", \"last_device_update\": \"2021-03-10T13:42:03.853072Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426Z\"}"}]': finished 2021-03-10T13:49:11.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:11 gibba015 bash[13005]: audit 2021-03-10T13:49:10.760456+0000 mon.b (mon.2) 88 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93375692, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847333Z\", \"created\": \"2021-03-10T13:38:50.668449Z\", \"started\": \"2021-03-10T13:38:56.060544Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 307337625, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847491Z\", \"created\": \"2021-03-10T13:38:58.024449Z\", \"started\": \"2021-03-10T13:38:58.047154Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95776931, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847552Z\", \"created\": \"2021-03-10T13:40:03.296449Z\", \"started\": \"2021-03-10T13:40:03.320843Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48737812, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847608Z\", \"created\": \"2021-03-10T13:40:50.072448Z\", \"started\": \"2021-03-10T13:40:53.142290Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49733959, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847779Z\", \"created\": \"2021-03-10T13:41:11.556448Z\", \"started\": \"2021-03-10T13:41:15.069232Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46493859, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847910Z\", \"created\": \"2021-03-10T13:41:34.244448Z\", \"started\": \"2021-03-10T13:41:37.507096Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46850375, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848034Z\", \"created\": \"2021-03-10T13:41:57.328380Z\", \"started\": \"2021-03-10T13:42:00.781947Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22387097, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848156Z\", \"created\": \"2021-03-10T13:43:44.272379Z\", \"started\": \"2021-03-10T13:43:47.550063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"842b16a0ff6e\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13348372, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848232Z\", \"created\": \"2021-03-10T13:43:54.628379Z\", \"started\": \"2021-03-10T13:44:17.568021Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:08.925129Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:44:10.554431Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:07.001926Z\"}}, \"last_daemon_update\": \"2021-03-10T13:49:05.848345Z\", \"last_device_update\": \"2021-03-10T13:42:03.853072Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426Z\"}"}]: dispatch 2021-03-10T13:49:11.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:11 gibba015 bash[9806]: audit 2021-03-10T13:49:10.760456+0000 mon.b (mon.2) 88 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93375692, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847333Z\", \"created\": \"2021-03-10T13:38:50.668449Z\", \"started\": \"2021-03-10T13:38:56.060544Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 307337625, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847491Z\", \"created\": \"2021-03-10T13:38:58.024449Z\", \"started\": \"2021-03-10T13:38:58.047154Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95776931, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847552Z\", \"created\": \"2021-03-10T13:40:03.296449Z\", \"started\": \"2021-03-10T13:40:03.320843Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48737812, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847608Z\", \"created\": \"2021-03-10T13:40:50.072448Z\", \"started\": \"2021-03-10T13:40:53.142290Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49733959, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847779Z\", \"created\": \"2021-03-10T13:41:11.556448Z\", \"started\": \"2021-03-10T13:41:15.069232Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46493859, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847910Z\", \"created\": \"2021-03-10T13:41:34.244448Z\", \"started\": \"2021-03-10T13:41:37.507096Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46850375, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848034Z\", \"created\": \"2021-03-10T13:41:57.328380Z\", \"started\": \"2021-03-10T13:42:00.781947Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22387097, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848156Z\", \"created\": \"2021-03-10T13:43:44.272379Z\", \"started\": \"2021-03-10T13:43:47.550063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"842b16a0ff6e\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13348372, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848232Z\", \"created\": \"2021-03-10T13:43:54.628379Z\", \"started\": \"2021-03-10T13:44:17.568021Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:08.925129Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:44:10.554431Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:07.001926Z\"}}, \"last_daemon_update\": \"2021-03-10T13:49:05.848345Z\", \"last_device_update\": \"2021-03-10T13:42:03.853072Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426Z\"}"}]: dispatch 2021-03-10T13:49:11.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:11 gibba015 bash[13005]: audit 2021-03-10T13:49:10.761474+0000 mon.a (mon.0) 648 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93375692, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847333Z\", \"created\": \"2021-03-10T13:38:50.668449Z\", \"started\": \"2021-03-10T13:38:56.060544Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 307337625, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847491Z\", \"created\": \"2021-03-10T13:38:58.024449Z\", \"started\": \"2021-03-10T13:38:58.047154Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95776931, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847552Z\", \"created\": \"2021-03-10T13:40:03.296449Z\", \"started\": \"2021-03-10T13:40:03.320843Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48737812, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847608Z\", \"created\": \"2021-03-10T13:40:50.072448Z\", \"started\": \"2021-03-10T13:40:53.142290Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49733959, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847779Z\", \"created\": \"2021-03-10T13:41:11.556448Z\", \"started\": \"2021-03-10T13:41:15.069232Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46493859, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847910Z\", \"created\": \"2021-03-10T13:41:34.244448Z\", \"started\": \"2021-03-10T13:41:37.507096Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46850375, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848034Z\", \"created\": \"2021-03-10T13:41:57.328380Z\", \"started\": \"2021-03-10T13:42:00.781947Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22387097, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848156Z\", \"created\": \"2021-03-10T13:43:44.272379Z\", \"started\": \"2021-03-10T13:43:47.550063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"842b16a0ff6e\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13348372, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848232Z\", \"created\": \"2021-03-10T13:43:54.628379Z\", \"started\": \"2021-03-10T13:44:17.568021Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:08.925129Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:44:10.554431Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:07.001926Z\"}}, \"last_daemon_update\": \"2021-03-10T13:49:05.848345Z\", \"last_device_update\": \"2021-03-10T13:42:03.853072Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426Z\"}"}]: dispatch 2021-03-10T13:49:11.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:11 gibba015 bash[13005]: audit 2021-03-10T13:49:10.765847+0000 mon.a (mon.0) 649 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93375692, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847333Z\", \"created\": \"2021-03-10T13:38:50.668449Z\", \"started\": \"2021-03-10T13:38:56.060544Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 307337625, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847491Z\", \"created\": \"2021-03-10T13:38:58.024449Z\", \"started\": \"2021-03-10T13:38:58.047154Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95776931, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847552Z\", \"created\": \"2021-03-10T13:40:03.296449Z\", \"started\": \"2021-03-10T13:40:03.320843Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48737812, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847608Z\", \"created\": \"2021-03-10T13:40:50.072448Z\", \"started\": \"2021-03-10T13:40:53.142290Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49733959, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847779Z\", \"created\": \"2021-03-10T13:41:11.556448Z\", \"started\": \"2021-03-10T13:41:15.069232Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46493859, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847910Z\", \"created\": \"2021-03-10T13:41:34.244448Z\", \"started\": \"2021-03-10T13:41:37.507096Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46850375, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848034Z\", \"created\": \"2021-03-10T13:41:57.328380Z\", \"started\": \"2021-03-10T13:42:00.781947Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22387097, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848156Z\", \"created\": \"2021-03-10T13:43:44.272379Z\", \"started\": \"2021-03-10T13:43:47.550063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"842b16a0ff6e\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13348372, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848232Z\", \"created\": \"2021-03-10T13:43:54.628379Z\", \"started\": \"2021-03-10T13:44:17.568021Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:08.925129Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:44:10.554431Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:07.001926Z\"}}, \"last_daemon_update\": \"2021-03-10T13:49:05.848345Z\", \"last_device_update\": \"2021-03-10T13:42:03.853072Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426Z\"}"}]': finished 2021-03-10T13:49:11.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:11 gibba015 bash[9806]: audit 2021-03-10T13:49:10.761474+0000 mon.a (mon.0) 648 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93375692, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847333Z\", \"created\": \"2021-03-10T13:38:50.668449Z\", \"started\": \"2021-03-10T13:38:56.060544Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 307337625, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847491Z\", \"created\": \"2021-03-10T13:38:58.024449Z\", \"started\": \"2021-03-10T13:38:58.047154Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95776931, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847552Z\", \"created\": \"2021-03-10T13:40:03.296449Z\", \"started\": \"2021-03-10T13:40:03.320843Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48737812, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847608Z\", \"created\": \"2021-03-10T13:40:50.072448Z\", \"started\": \"2021-03-10T13:40:53.142290Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49733959, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847779Z\", \"created\": \"2021-03-10T13:41:11.556448Z\", \"started\": \"2021-03-10T13:41:15.069232Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46493859, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847910Z\", \"created\": \"2021-03-10T13:41:34.244448Z\", \"started\": \"2021-03-10T13:41:37.507096Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46850375, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848034Z\", \"created\": \"2021-03-10T13:41:57.328380Z\", \"started\": \"2021-03-10T13:42:00.781947Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22387097, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848156Z\", \"created\": \"2021-03-10T13:43:44.272379Z\", \"started\": \"2021-03-10T13:43:47.550063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"842b16a0ff6e\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13348372, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848232Z\", \"created\": \"2021-03-10T13:43:54.628379Z\", \"started\": \"2021-03-10T13:44:17.568021Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:08.925129Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:44:10.554431Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:07.001926Z\"}}, \"last_daemon_update\": \"2021-03-10T13:49:05.848345Z\", \"last_device_update\": \"2021-03-10T13:42:03.853072Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426Z\"}"}]: dispatch 2021-03-10T13:49:11.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:11 gibba015 bash[9806]: audit 2021-03-10T13:49:10.765847+0000 mon.a (mon.0) 649 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93375692, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847333Z\", \"created\": \"2021-03-10T13:38:50.668449Z\", \"started\": \"2021-03-10T13:38:56.060544Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 307337625, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847491Z\", \"created\": \"2021-03-10T13:38:58.024449Z\", \"started\": \"2021-03-10T13:38:58.047154Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95776931, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847552Z\", \"created\": \"2021-03-10T13:40:03.296449Z\", \"started\": \"2021-03-10T13:40:03.320843Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48737812, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847608Z\", \"created\": \"2021-03-10T13:40:50.072448Z\", \"started\": \"2021-03-10T13:40:53.142290Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49733959, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847779Z\", \"created\": \"2021-03-10T13:41:11.556448Z\", \"started\": \"2021-03-10T13:41:15.069232Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46493859, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847910Z\", \"created\": \"2021-03-10T13:41:34.244448Z\", \"started\": \"2021-03-10T13:41:37.507096Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46850375, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848034Z\", \"created\": \"2021-03-10T13:41:57.328380Z\", \"started\": \"2021-03-10T13:42:00.781947Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22387097, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848156Z\", \"created\": \"2021-03-10T13:43:44.272379Z\", \"started\": \"2021-03-10T13:43:47.550063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"842b16a0ff6e\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13348372, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848232Z\", \"created\": \"2021-03-10T13:43:54.628379Z\", \"started\": \"2021-03-10T13:44:17.568021Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:08.925129Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:44:10.554431Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:07.001926Z\"}}, \"last_daemon_update\": \"2021-03-10T13:49:05.848345Z\", \"last_device_update\": \"2021-03-10T13:42:03.853072Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426Z\"}"}]': finished 2021-03-10T13:49:12.766 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:12 gibba015 bash[9806]: cephadm 2021-03-10T13:49:10.771835+0000 mgr.gibba045.orlgmj (mgr.34379) 19 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2021-03-10T13:49:12.766 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:12 gibba015 bash[9806]: cephadm 2021-03-10T13:49:10.777932+0000 mgr.gibba045.orlgmj (mgr.34379) 20 : cephadm [INF] Reconfiguring daemon alertmanager.a on gibba015 2021-03-10T13:49:12.766 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:12 gibba015 bash[9806]: cluster 2021-03-10T13:49:10.986045+0000 mgr.gibba045.orlgmj (mgr.34379) 21 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:12.767 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:12 gibba015 bash[13005]: cephadm 2021-03-10T13:49:10.771835+0000 mgr.gibba045.orlgmj (mgr.34379) 19 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2021-03-10T13:49:12.767 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:12 gibba015 bash[13005]: cephadm 2021-03-10T13:49:10.777932+0000 mgr.gibba045.orlgmj (mgr.34379) 20 : cephadm [INF] Reconfiguring daemon alertmanager.a on gibba015 2021-03-10T13:49:12.767 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:12 gibba015 bash[13005]: cluster 2021-03-10T13:49:10.986045+0000 mgr.gibba045.orlgmj (mgr.34379) 21 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:12.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:12 gibba045 bash[9787]: cephadm 2021-03-10T13:49:10.771835+0000 mgr.gibba045.orlgmj (mgr.34379) 19 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2021-03-10T13:49:12.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:12 gibba045 bash[9787]: cephadm 2021-03-10T13:49:10.777932+0000 mgr.gibba045.orlgmj (mgr.34379) 20 : cephadm [INF] Reconfiguring daemon alertmanager.a on gibba015 2021-03-10T13:49:12.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:12 gibba045 bash[9787]: cluster 2021-03-10T13:49:10.986045+0000 mgr.gibba045.orlgmj (mgr.34379) 21 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:14.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:14 gibba015 bash[9806]: cluster 2021-03-10T13:49:12.988237+0000 mgr.gibba045.orlgmj (mgr.34379) 22 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:14.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:14 gibba015 bash[13005]: cluster 2021-03-10T13:49:12.988237+0000 mgr.gibba045.orlgmj (mgr.34379) 22 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:14.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:14 gibba045 bash[9787]: cluster 2021-03-10T13:49:12.988237+0000 mgr.gibba045.orlgmj (mgr.34379) 22 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:16.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:16 gibba015 bash[9806]: cluster 2021-03-10T13:49:14.989436+0000 mgr.gibba045.orlgmj (mgr.34379) 23 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:16.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:16 gibba015 bash[13005]: cluster 2021-03-10T13:49:14.989436+0000 mgr.gibba045.orlgmj (mgr.34379) 23 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:16.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:16 gibba045 bash[9787]: cluster 2021-03-10T13:49:14.989436+0000 mgr.gibba045.orlgmj (mgr.34379) 23 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:17.091 INFO:journalctl@ceph.alertmanager.a.gibba015.stdout:Mar 10 13:49:16 gibba015 systemd[1]: Stopping Ceph alertmanager.a for e4a642d2-81a5-11eb-9080-001a4aab830c... 2021-03-10T13:49:17.092 INFO:journalctl@ceph.alertmanager.a.gibba015.stdout:Mar 10 13:49:16 gibba015 bash[21936]: level=info ts=2021-03-10T13:49:16.856Z caller=main.go:524 msg="Received SIGTERM, exiting gracefully..." 2021-03-10T13:49:17.971 INFO:journalctl@ceph.alertmanager.a.gibba015.stdout:Mar 10 13:49:17 gibba015 docker[27887]: ceph-e4a642d2-81a5-11eb-9080-001a4aab830c-alertmanager.a 2021-03-10T13:49:17.972 INFO:journalctl@ceph.alertmanager.a.gibba015.stdout:Mar 10 13:49:17 gibba015 systemd[1]: ceph-e4a642d2-81a5-11eb-9080-001a4aab830c@alertmanager.a.service: Succeeded. 2021-03-10T13:49:17.972 INFO:journalctl@ceph.alertmanager.a.gibba015.stdout:Mar 10 13:49:17 gibba015 systemd[1]: Stopped Ceph alertmanager.a for e4a642d2-81a5-11eb-9080-001a4aab830c. 2021-03-10T13:49:17.972 INFO:journalctl@ceph.alertmanager.a.gibba015.stdout:Mar 10 13:49:17 gibba015 systemd[1]: Starting Ceph alertmanager.a for e4a642d2-81a5-11eb-9080-001a4aab830c... 2021-03-10T13:49:17.972 INFO:journalctl@ceph.alertmanager.a.gibba015.stdout:Mar 10 13:49:17 gibba015 docker[27922]: Error: No such container: ceph-e4a642d2-81a5-11eb-9080-001a4aab830c-alertmanager.a 2021-03-10T13:49:17.973 INFO:journalctl@ceph.alertmanager.a.gibba015.stdout:Mar 10 13:49:17 gibba015 systemd[1]: Started Ceph alertmanager.a for e4a642d2-81a5-11eb-9080-001a4aab830c. 2021-03-10T13:49:18.721 INFO:journalctl@ceph.alertmanager.a.gibba015.stdout:Mar 10 13:49:18 gibba015 bash[27938]: level=info ts=2021-03-10T13:49:18.485Z caller=main.go:216 msg="Starting Alertmanager" version="(version=0.21.0, branch=HEAD, revision=4c6c03ebfe21009c546e4d1e9b92c371d67c021d)" 2021-03-10T13:49:18.722 INFO:journalctl@ceph.alertmanager.a.gibba015.stdout:Mar 10 13:49:18 gibba015 bash[27938]: level=info ts=2021-03-10T13:49:18.485Z caller=main.go:217 build_context="(go=go1.14.4, user=root@dee35927357f, date=20200617-08:54:02)" 2021-03-10T13:49:18.722 INFO:journalctl@ceph.alertmanager.a.gibba015.stdout:Mar 10 13:49:18 gibba015 bash[27938]: level=info ts=2021-03-10T13:49:18.487Z caller=cluster.go:161 component=cluster msg="setting advertise address explicitly" addr=172.21.2.115 port=9094 2021-03-10T13:49:18.722 INFO:journalctl@ceph.alertmanager.a.gibba015.stdout:Mar 10 13:49:18 gibba015 bash[27938]: level=info ts=2021-03-10T13:49:18.488Z caller=cluster.go:623 component=cluster msg="Waiting for gossip to settle..." interval=2s 2021-03-10T13:49:18.723 INFO:journalctl@ceph.alertmanager.a.gibba015.stdout:Mar 10 13:49:18 gibba015 bash[27938]: level=info ts=2021-03-10T13:49:18.506Z caller=coordinator.go:119 component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2021-03-10T13:49:18.723 INFO:journalctl@ceph.alertmanager.a.gibba015.stdout:Mar 10 13:49:18 gibba015 bash[27938]: level=info ts=2021-03-10T13:49:18.506Z caller=coordinator.go:131 component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2021-03-10T13:49:18.723 INFO:journalctl@ceph.alertmanager.a.gibba015.stdout:Mar 10 13:49:18 gibba015 bash[27938]: level=info ts=2021-03-10T13:49:18.508Z caller=main.go:485 msg=Listening address=:9093 2021-03-10T13:49:18.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:18 gibba015 bash[9806]: cluster 2021-03-10T13:49:16.990605+0000 mgr.gibba045.orlgmj (mgr.34379) 24 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:18.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:18 gibba015 bash[13005]: cluster 2021-03-10T13:49:16.990605+0000 mgr.gibba045.orlgmj (mgr.34379) 24 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:18.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:18 gibba015 bash[9806]: audit 2021-03-10T13:49:17.522131+0000 mon.b (mon.2) 89 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93375692, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847333Z\", \"created\": \"2021-03-10T13:38:50.668449Z\", \"started\": \"2021-03-10T13:38:56.060544Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 307337625, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847491Z\", \"created\": \"2021-03-10T13:38:58.024449Z\", \"started\": \"2021-03-10T13:38:58.047154Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95776931, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847552Z\", \"created\": \"2021-03-10T13:40:03.296449Z\", \"started\": \"2021-03-10T13:40:03.320843Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48737812, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847608Z\", \"created\": \"2021-03-10T13:40:50.072448Z\", \"started\": \"2021-03-10T13:40:53.142290Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49733959, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847779Z\", \"created\": \"2021-03-10T13:41:11.556448Z\", \"started\": \"2021-03-10T13:41:15.069232Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46493859, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847910Z\", \"created\": \"2021-03-10T13:41:34.244448Z\", \"started\": \"2021-03-10T13:41:37.507096Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46850375, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848034Z\", \"created\": \"2021-03-10T13:41:57.328380Z\", \"started\": \"2021-03-10T13:42:00.781947Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22387097, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848156Z\", \"created\": \"2021-03-10T13:43:44.272379Z\", \"started\": \"2021-03-10T13:43:47.550063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:08.925129Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:49:10.777874Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:07.001926Z\"}}, \"last_device_update\": \"2021-03-10T13:42:03.853072Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426Z\"}"}]: dispatch 2021-03-10T13:49:18.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:18 gibba015 bash[13005]: audit 2021-03-10T13:49:17.522131+0000 mon.b (mon.2) 89 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93375692, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847333Z\", \"created\": \"2021-03-10T13:38:50.668449Z\", \"started\": \"2021-03-10T13:38:56.060544Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 307337625, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847491Z\", \"created\": \"2021-03-10T13:38:58.024449Z\", \"started\": \"2021-03-10T13:38:58.047154Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95776931, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847552Z\", \"created\": \"2021-03-10T13:40:03.296449Z\", \"started\": \"2021-03-10T13:40:03.320843Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48737812, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847608Z\", \"created\": \"2021-03-10T13:40:50.072448Z\", \"started\": \"2021-03-10T13:40:53.142290Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49733959, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847779Z\", \"created\": \"2021-03-10T13:41:11.556448Z\", \"started\": \"2021-03-10T13:41:15.069232Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46493859, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847910Z\", \"created\": \"2021-03-10T13:41:34.244448Z\", \"started\": \"2021-03-10T13:41:37.507096Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46850375, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848034Z\", \"created\": \"2021-03-10T13:41:57.328380Z\", \"started\": \"2021-03-10T13:42:00.781947Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22387097, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848156Z\", \"created\": \"2021-03-10T13:43:44.272379Z\", \"started\": \"2021-03-10T13:43:47.550063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:08.925129Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:49:10.777874Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:07.001926Z\"}}, \"last_device_update\": \"2021-03-10T13:42:03.853072Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426Z\"}"}]: dispatch 2021-03-10T13:49:18.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:18 gibba015 bash[9806]: audit 2021-03-10T13:49:17.522445+0000 mon.a (mon.0) 650 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93375692, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847333Z\", \"created\": \"2021-03-10T13:38:50.668449Z\", \"started\": \"2021-03-10T13:38:56.060544Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 307337625, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847491Z\", \"created\": \"2021-03-10T13:38:58.024449Z\", \"started\": \"2021-03-10T13:38:58.047154Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95776931, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847552Z\", \"created\": \"2021-03-10T13:40:03.296449Z\", \"started\": \"2021-03-10T13:40:03.320843Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48737812, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847608Z\", \"created\": \"2021-03-10T13:40:50.072448Z\", \"started\": \"2021-03-10T13:40:53.142290Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49733959, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847779Z\", \"created\": \"2021-03-10T13:41:11.556448Z\", \"started\": \"2021-03-10T13:41:15.069232Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46493859, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847910Z\", \"created\": \"2021-03-10T13:41:34.244448Z\", \"started\": \"2021-03-10T13:41:37.507096Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46850375, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848034Z\", \"created\": \"2021-03-10T13:41:57.328380Z\", \"started\": \"2021-03-10T13:42:00.781947Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22387097, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848156Z\", \"created\": \"2021-03-10T13:43:44.272379Z\", \"started\": \"2021-03-10T13:43:47.550063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:08.925129Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:49:10.777874Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:07.001926Z\"}}, \"last_device_update\": \"2021-03-10T13:42:03.853072Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426Z\"}"}]: dispatch 2021-03-10T13:49:18.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:18 gibba015 bash[13005]: audit 2021-03-10T13:49:17.522445+0000 mon.a (mon.0) 650 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93375692, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847333Z\", \"created\": \"2021-03-10T13:38:50.668449Z\", \"started\": \"2021-03-10T13:38:56.060544Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 307337625, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847491Z\", \"created\": \"2021-03-10T13:38:58.024449Z\", \"started\": \"2021-03-10T13:38:58.047154Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95776931, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847552Z\", \"created\": \"2021-03-10T13:40:03.296449Z\", \"started\": \"2021-03-10T13:40:03.320843Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48737812, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847608Z\", \"created\": \"2021-03-10T13:40:50.072448Z\", \"started\": \"2021-03-10T13:40:53.142290Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49733959, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847779Z\", \"created\": \"2021-03-10T13:41:11.556448Z\", \"started\": \"2021-03-10T13:41:15.069232Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46493859, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847910Z\", \"created\": \"2021-03-10T13:41:34.244448Z\", \"started\": \"2021-03-10T13:41:37.507096Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46850375, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848034Z\", \"created\": \"2021-03-10T13:41:57.328380Z\", \"started\": \"2021-03-10T13:42:00.781947Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22387097, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848156Z\", \"created\": \"2021-03-10T13:43:44.272379Z\", \"started\": \"2021-03-10T13:43:47.550063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:08.925129Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:49:10.777874Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:07.001926Z\"}}, \"last_device_update\": \"2021-03-10T13:42:03.853072Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426Z\"}"}]: dispatch 2021-03-10T13:49:18.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:18 gibba015 bash[9806]: audit 2021-03-10T13:49:17.525518+0000 mon.a (mon.0) 651 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93375692, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847333Z\", \"created\": \"2021-03-10T13:38:50.668449Z\", \"started\": \"2021-03-10T13:38:56.060544Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 307337625, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847491Z\", \"created\": \"2021-03-10T13:38:58.024449Z\", \"started\": \"2021-03-10T13:38:58.047154Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95776931, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847552Z\", \"created\": \"2021-03-10T13:40:03.296449Z\", \"started\": \"2021-03-10T13:40:03.320843Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48737812, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847608Z\", \"created\": \"2021-03-10T13:40:50.072448Z\", \"started\": \"2021-03-10T13:40:53.142290Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49733959, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847779Z\", \"created\": \"2021-03-10T13:41:11.556448Z\", \"started\": \"2021-03-10T13:41:15.069232Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46493859, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847910Z\", \"created\": \"2021-03-10T13:41:34.244448Z\", \"started\": \"2021-03-10T13:41:37.507096Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46850375, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848034Z\", \"created\": \"2021-03-10T13:41:57.328380Z\", \"started\": \"2021-03-10T13:42:00.781947Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22387097, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848156Z\", \"created\": \"2021-03-10T13:43:44.272379Z\", \"started\": \"2021-03-10T13:43:47.550063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:08.925129Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:49:10.777874Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:07.001926Z\"}}, \"last_device_update\": \"2021-03-10T13:42:03.853072Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426Z\"}"}]': finished 2021-03-10T13:49:18.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:18 gibba015 bash[9806]: cephadm 2021-03-10T13:49:17.526667+0000 mgr.gibba045.orlgmj (mgr.34379) 25 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2021-03-10T13:49:18.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:18 gibba015 bash[9806]: audit 2021-03-10T13:49:17.526909+0000 mon.b (mon.2) 90 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:49:18.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:18 gibba015 bash[9806]: audit 2021-03-10T13:49:17.527734+0000 mon.b (mon.2) 91 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:49:18.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:18 gibba015 bash[9806]: audit 2021-03-10T13:49:17.528546+0000 mon.b (mon.2) 92 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:49:18.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:18 gibba015 bash[9806]: cephadm 2021-03-10T13:49:17.529083+0000 mgr.gibba045.orlgmj (mgr.34379) 26 : cephadm [INF] Reconfiguring daemon mon.b on gibba045 2021-03-10T13:49:18.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:18 gibba015 bash[9806]: audit 2021-03-10T13:49:17.529377+0000 mon.b (mon.2) 93 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2021-03-10T13:49:18.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:18 gibba015 bash[13005]: audit 2021-03-10T13:49:17.525518+0000 mon.a (mon.0) 651 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93375692, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847333Z\", \"created\": \"2021-03-10T13:38:50.668449Z\", \"started\": \"2021-03-10T13:38:56.060544Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 307337625, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847491Z\", \"created\": \"2021-03-10T13:38:58.024449Z\", \"started\": \"2021-03-10T13:38:58.047154Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95776931, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847552Z\", \"created\": \"2021-03-10T13:40:03.296449Z\", \"started\": \"2021-03-10T13:40:03.320843Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48737812, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847608Z\", \"created\": \"2021-03-10T13:40:50.072448Z\", \"started\": \"2021-03-10T13:40:53.142290Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49733959, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847779Z\", \"created\": \"2021-03-10T13:41:11.556448Z\", \"started\": \"2021-03-10T13:41:15.069232Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46493859, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847910Z\", \"created\": \"2021-03-10T13:41:34.244448Z\", \"started\": \"2021-03-10T13:41:37.507096Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46850375, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848034Z\", \"created\": \"2021-03-10T13:41:57.328380Z\", \"started\": \"2021-03-10T13:42:00.781947Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22387097, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848156Z\", \"created\": \"2021-03-10T13:43:44.272379Z\", \"started\": \"2021-03-10T13:43:47.550063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:08.925129Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:49:10.777874Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:07.001926Z\"}}, \"last_device_update\": \"2021-03-10T13:42:03.853072Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426Z\"}"}]': finished 2021-03-10T13:49:18.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:18 gibba015 bash[13005]: cephadm 2021-03-10T13:49:17.526667+0000 mgr.gibba045.orlgmj (mgr.34379) 25 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2021-03-10T13:49:18.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:18 gibba015 bash[13005]: audit 2021-03-10T13:49:17.526909+0000 mon.b (mon.2) 90 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:49:18.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:18 gibba015 bash[13005]: audit 2021-03-10T13:49:17.527734+0000 mon.b (mon.2) 91 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:49:18.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:18 gibba015 bash[13005]: audit 2021-03-10T13:49:17.528546+0000 mon.b (mon.2) 92 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:49:18.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:18 gibba015 bash[13005]: cephadm 2021-03-10T13:49:17.529083+0000 mgr.gibba045.orlgmj (mgr.34379) 26 : cephadm [INF] Reconfiguring daemon mon.b on gibba045 2021-03-10T13:49:18.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:18 gibba015 bash[13005]: audit 2021-03-10T13:49:17.529377+0000 mon.b (mon.2) 93 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2021-03-10T13:49:18.741 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:18 gibba045 bash[9787]: cluster 2021-03-10T13:49:16.990605+0000 mgr.gibba045.orlgmj (mgr.34379) 24 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:18.742 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:18 gibba045 bash[9787]: audit 2021-03-10T13:49:17.522131+0000 mon.b (mon.2) 89 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93375692, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847333Z\", \"created\": \"2021-03-10T13:38:50.668449Z\", \"started\": \"2021-03-10T13:38:56.060544Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 307337625, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847491Z\", \"created\": \"2021-03-10T13:38:58.024449Z\", \"started\": \"2021-03-10T13:38:58.047154Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95776931, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847552Z\", \"created\": \"2021-03-10T13:40:03.296449Z\", \"started\": \"2021-03-10T13:40:03.320843Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48737812, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847608Z\", \"created\": \"2021-03-10T13:40:50.072448Z\", \"started\": \"2021-03-10T13:40:53.142290Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49733959, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847779Z\", \"created\": \"2021-03-10T13:41:11.556448Z\", \"started\": \"2021-03-10T13:41:15.069232Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46493859, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847910Z\", \"created\": \"2021-03-10T13:41:34.244448Z\", \"started\": \"2021-03-10T13:41:37.507096Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46850375, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848034Z\", \"created\": \"2021-03-10T13:41:57.328380Z\", \"started\": \"2021-03-10T13:42:00.781947Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22387097, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848156Z\", \"created\": \"2021-03-10T13:43:44.272379Z\", \"started\": \"2021-03-10T13:43:47.550063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:08.925129Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:49:10.777874Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:07.001926Z\"}}, \"last_device_update\": \"2021-03-10T13:42:03.853072Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426Z\"}"}]: dispatch 2021-03-10T13:49:18.742 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:18 gibba045 bash[9787]: audit 2021-03-10T13:49:17.522445+0000 mon.a (mon.0) 650 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93375692, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847333Z\", \"created\": \"2021-03-10T13:38:50.668449Z\", \"started\": \"2021-03-10T13:38:56.060544Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 307337625, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847491Z\", \"created\": \"2021-03-10T13:38:58.024449Z\", \"started\": \"2021-03-10T13:38:58.047154Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95776931, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847552Z\", \"created\": \"2021-03-10T13:40:03.296449Z\", \"started\": \"2021-03-10T13:40:03.320843Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48737812, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847608Z\", \"created\": \"2021-03-10T13:40:50.072448Z\", \"started\": \"2021-03-10T13:40:53.142290Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49733959, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847779Z\", \"created\": \"2021-03-10T13:41:11.556448Z\", \"started\": \"2021-03-10T13:41:15.069232Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46493859, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847910Z\", \"created\": \"2021-03-10T13:41:34.244448Z\", \"started\": \"2021-03-10T13:41:37.507096Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46850375, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848034Z\", \"created\": \"2021-03-10T13:41:57.328380Z\", \"started\": \"2021-03-10T13:42:00.781947Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22387097, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848156Z\", \"created\": \"2021-03-10T13:43:44.272379Z\", \"started\": \"2021-03-10T13:43:47.550063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:08.925129Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:49:10.777874Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:07.001926Z\"}}, \"last_device_update\": \"2021-03-10T13:42:03.853072Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426Z\"}"}]: dispatch 2021-03-10T13:49:18.743 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:18 gibba045 bash[9787]: audit 2021-03-10T13:49:17.525518+0000 mon.a (mon.0) 651 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93375692, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847333Z\", \"created\": \"2021-03-10T13:38:50.668449Z\", \"started\": \"2021-03-10T13:38:56.060544Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba015\", \"container_id\": \"9e4717dfc4f8\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 307337625, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847491Z\", \"created\": \"2021-03-10T13:38:58.024449Z\", \"started\": \"2021-03-10T13:38:58.047154Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95776931, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847552Z\", \"created\": \"2021-03-10T13:40:03.296449Z\", \"started\": \"2021-03-10T13:40:03.320843Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48737812, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847608Z\", \"created\": \"2021-03-10T13:40:50.072448Z\", \"started\": \"2021-03-10T13:40:53.142290Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49733959, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847779Z\", \"created\": \"2021-03-10T13:41:11.556448Z\", \"started\": \"2021-03-10T13:41:15.069232Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46493859, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847910Z\", \"created\": \"2021-03-10T13:41:34.244448Z\", \"started\": \"2021-03-10T13:41:37.507096Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46850375, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848034Z\", \"created\": \"2021-03-10T13:41:57.328380Z\", \"started\": \"2021-03-10T13:42:00.781947Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22387097, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848156Z\", \"created\": \"2021-03-10T13:43:44.272379Z\", \"started\": \"2021-03-10T13:43:47.550063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:08.925129Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:34.970377Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:49:10.777874Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:07.001926Z\"}}, \"last_device_update\": \"2021-03-10T13:42:03.853072Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426Z\"}"}]': finished 2021-03-10T13:49:18.743 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:18 gibba045 bash[9787]: cephadm 2021-03-10T13:49:17.526667+0000 mgr.gibba045.orlgmj (mgr.34379) 25 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2021-03-10T13:49:18.743 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:18 gibba045 bash[9787]: audit 2021-03-10T13:49:17.526909+0000 mon.b (mon.2) 90 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:49:18.743 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:18 gibba045 bash[9787]: audit 2021-03-10T13:49:17.527734+0000 mon.b (mon.2) 91 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:49:18.744 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:18 gibba045 bash[9787]: audit 2021-03-10T13:49:17.528546+0000 mon.b (mon.2) 92 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:49:18.744 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:18 gibba045 bash[9787]: cephadm 2021-03-10T13:49:17.529083+0000 mgr.gibba045.orlgmj (mgr.34379) 26 : cephadm [INF] Reconfiguring daemon mon.b on gibba045 2021-03-10T13:49:18.744 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:18 gibba045 bash[9787]: audit 2021-03-10T13:49:17.529377+0000 mon.b (mon.2) 93 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2021-03-10T13:49:19.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:19 gibba045 bash[9787]: audit 2021-03-10T13:49:19.181949+0000 mon.b (mon.2) 94 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101774786, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721104Z\", \"created\": \"2021-03-10T13:40:16.047558Z\", \"started\": \"2021-03-10T13:40:16.069701Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba045\", \"container_id\": \"0b25900c63e0\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 373817344, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721263Z\", \"created\": \"2021-03-10T13:40:32.015558Z\", \"started\": \"2021-03-10T13:48:33.658328Z\"}, \"mgr.gibba045.orlgmj\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba045.orlgmj\", \"hostname\": \"gibba045\", \"container_id\": \"ea964e825589\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 403701760, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721358Z\", \"created\": \"2021-03-10T13:40:34.535558Z\", \"started\": \"2021-03-10T13:48:50.630289Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48360325, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721446Z\", \"created\": \"2021-03-10T13:42:17.077564Z\", \"started\": \"2021-03-10T13:42:20.232803Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47238348, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721681Z\", \"created\": \"2021-03-10T13:42:38.781564Z\", \"started\": \"2021-03-10T13:42:42.298036Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46357544, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721874Z\", \"created\": \"2021-03-10T13:43:00.493564Z\", \"started\": \"2021-03-10T13:43:03.477079Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48255467, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722061Z\", \"created\": \"2021-03-10T13:43:22.897564Z\", \"started\": \"2021-03-10T13:43:26.167781Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba045\", \"container_id\": \"b3907fa26ba0\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 34697379, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722246Z\", \"created\": \"2021-03-10T13:43:42.821564Z\", \"started\": \"2021-03-10T13:44:24.396576Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23991418, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722341Z\", \"created\": \"2021-03-10T13:43:43.861564Z\", \"started\": \"2021-03-10T13:43:45.351099Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba045\", \"container_id\": \"d86cab6511db\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29611786, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722427Z\", \"created\": \"2021-03-10T13:44:08.721564Z\", \"started\": \"2021-03-10T13:44:08.746042Z\"}, \"rgw.r.z.gibba045.atotkw\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba045.atotkw\", \"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722512Z\", \"created\": \"2021-03-10T13:45:45.925564Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:17.529027Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:21.028684Z\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:37.919264Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:44:17.558720Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818Z\"}, \"rgw.r.z.gibba045.atotkw\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:44.004644Z\"}}, \"last_daemon_update\": \"2021-03-10T13:49:06.722624Z\", \"last_device_update\": \"2021-03-10T13:43:30.693305Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:49:19.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:19 gibba045 bash[9787]: audit 2021-03-10T13:49:19.183610+0000 mon.a (mon.0) 652 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101774786, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721104Z\", \"created\": \"2021-03-10T13:40:16.047558Z\", \"started\": \"2021-03-10T13:40:16.069701Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba045\", \"container_id\": \"0b25900c63e0\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 373817344, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721263Z\", \"created\": \"2021-03-10T13:40:32.015558Z\", \"started\": \"2021-03-10T13:48:33.658328Z\"}, \"mgr.gibba045.orlgmj\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba045.orlgmj\", \"hostname\": \"gibba045\", \"container_id\": \"ea964e825589\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 403701760, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721358Z\", \"created\": \"2021-03-10T13:40:34.535558Z\", \"started\": \"2021-03-10T13:48:50.630289Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48360325, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721446Z\", \"created\": \"2021-03-10T13:42:17.077564Z\", \"started\": \"2021-03-10T13:42:20.232803Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47238348, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721681Z\", \"created\": \"2021-03-10T13:42:38.781564Z\", \"started\": \"2021-03-10T13:42:42.298036Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46357544, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721874Z\", \"created\": \"2021-03-10T13:43:00.493564Z\", \"started\": \"2021-03-10T13:43:03.477079Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48255467, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722061Z\", \"created\": \"2021-03-10T13:43:22.897564Z\", \"started\": \"2021-03-10T13:43:26.167781Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba045\", \"container_id\": \"b3907fa26ba0\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 34697379, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722246Z\", \"created\": \"2021-03-10T13:43:42.821564Z\", \"started\": \"2021-03-10T13:44:24.396576Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23991418, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722341Z\", \"created\": \"2021-03-10T13:43:43.861564Z\", \"started\": \"2021-03-10T13:43:45.351099Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba045\", \"container_id\": \"d86cab6511db\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29611786, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722427Z\", \"created\": \"2021-03-10T13:44:08.721564Z\", \"started\": \"2021-03-10T13:44:08.746042Z\"}, \"rgw.r.z.gibba045.atotkw\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba045.atotkw\", \"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722512Z\", \"created\": \"2021-03-10T13:45:45.925564Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:17.529027Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:21.028684Z\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:37.919264Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:44:17.558720Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818Z\"}, \"rgw.r.z.gibba045.atotkw\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:44.004644Z\"}}, \"last_daemon_update\": \"2021-03-10T13:49:06.722624Z\", \"last_device_update\": \"2021-03-10T13:43:30.693305Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:49:19.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:19 gibba045 bash[9787]: audit 2021-03-10T13:49:19.192816+0000 mon.a (mon.0) 653 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101774786, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721104Z\", \"created\": \"2021-03-10T13:40:16.047558Z\", \"started\": \"2021-03-10T13:40:16.069701Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba045\", \"container_id\": \"0b25900c63e0\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 373817344, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721263Z\", \"created\": \"2021-03-10T13:40:32.015558Z\", \"started\": \"2021-03-10T13:48:33.658328Z\"}, \"mgr.gibba045.orlgmj\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba045.orlgmj\", \"hostname\": \"gibba045\", \"container_id\": \"ea964e825589\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 403701760, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721358Z\", \"created\": \"2021-03-10T13:40:34.535558Z\", \"started\": \"2021-03-10T13:48:50.630289Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48360325, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721446Z\", \"created\": \"2021-03-10T13:42:17.077564Z\", \"started\": \"2021-03-10T13:42:20.232803Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47238348, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721681Z\", \"created\": \"2021-03-10T13:42:38.781564Z\", \"started\": \"2021-03-10T13:42:42.298036Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46357544, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721874Z\", \"created\": \"2021-03-10T13:43:00.493564Z\", \"started\": \"2021-03-10T13:43:03.477079Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48255467, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722061Z\", \"created\": \"2021-03-10T13:43:22.897564Z\", \"started\": \"2021-03-10T13:43:26.167781Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba045\", \"container_id\": \"b3907fa26ba0\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 34697379, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722246Z\", \"created\": \"2021-03-10T13:43:42.821564Z\", \"started\": \"2021-03-10T13:44:24.396576Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23991418, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722341Z\", \"created\": \"2021-03-10T13:43:43.861564Z\", \"started\": \"2021-03-10T13:43:45.351099Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba045\", \"container_id\": \"d86cab6511db\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29611786, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722427Z\", \"created\": \"2021-03-10T13:44:08.721564Z\", \"started\": \"2021-03-10T13:44:08.746042Z\"}, \"rgw.r.z.gibba045.atotkw\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba045.atotkw\", \"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722512Z\", \"created\": \"2021-03-10T13:45:45.925564Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:17.529027Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:21.028684Z\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:37.919264Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:44:17.558720Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818Z\"}, \"rgw.r.z.gibba045.atotkw\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:44.004644Z\"}}, \"last_daemon_update\": \"2021-03-10T13:49:06.722624Z\", \"last_device_update\": \"2021-03-10T13:43:30.693305Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445Z\", \"scheduled_daemon_actions\": {}}"}]': finished 2021-03-10T13:49:19.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:19 gibba045 bash[9787]: audit 2021-03-10T13:49:19.198121+0000 mon.b (mon.2) 95 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-03-10T13:49:19.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:19 gibba015 bash[9806]: audit 2021-03-10T13:49:19.181949+0000 mon.b (mon.2) 94 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101774786, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721104Z\", \"created\": \"2021-03-10T13:40:16.047558Z\", \"started\": \"2021-03-10T13:40:16.069701Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba045\", \"container_id\": \"0b25900c63e0\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 373817344, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721263Z\", \"created\": \"2021-03-10T13:40:32.015558Z\", \"started\": \"2021-03-10T13:48:33.658328Z\"}, \"mgr.gibba045.orlgmj\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba045.orlgmj\", \"hostname\": \"gibba045\", \"container_id\": \"ea964e825589\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 403701760, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721358Z\", \"created\": \"2021-03-10T13:40:34.535558Z\", \"started\": \"2021-03-10T13:48:50.630289Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48360325, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721446Z\", \"created\": \"2021-03-10T13:42:17.077564Z\", \"started\": \"2021-03-10T13:42:20.232803Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47238348, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721681Z\", \"created\": \"2021-03-10T13:42:38.781564Z\", \"started\": \"2021-03-10T13:42:42.298036Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46357544, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721874Z\", \"created\": \"2021-03-10T13:43:00.493564Z\", \"started\": \"2021-03-10T13:43:03.477079Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48255467, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722061Z\", \"created\": \"2021-03-10T13:43:22.897564Z\", \"started\": \"2021-03-10T13:43:26.167781Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba045\", \"container_id\": \"b3907fa26ba0\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 34697379, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722246Z\", \"created\": \"2021-03-10T13:43:42.821564Z\", \"started\": \"2021-03-10T13:44:24.396576Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23991418, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722341Z\", \"created\": \"2021-03-10T13:43:43.861564Z\", \"started\": \"2021-03-10T13:43:45.351099Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba045\", \"container_id\": \"d86cab6511db\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29611786, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722427Z\", \"created\": \"2021-03-10T13:44:08.721564Z\", \"started\": \"2021-03-10T13:44:08.746042Z\"}, \"rgw.r.z.gibba045.atotkw\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba045.atotkw\", \"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722512Z\", \"created\": \"2021-03-10T13:45:45.925564Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:17.529027Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:21.028684Z\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:37.919264Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:44:17.558720Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818Z\"}, \"rgw.r.z.gibba045.atotkw\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:44.004644Z\"}}, \"last_daemon_update\": \"2021-03-10T13:49:06.722624Z\", \"last_device_update\": \"2021-03-10T13:43:30.693305Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:49:19.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:19 gibba015 bash[13005]: audit 2021-03-10T13:49:19.181949+0000 mon.b (mon.2) 94 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101774786, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721104Z\", \"created\": \"2021-03-10T13:40:16.047558Z\", \"started\": \"2021-03-10T13:40:16.069701Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba045\", \"container_id\": \"0b25900c63e0\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 373817344, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721263Z\", \"created\": \"2021-03-10T13:40:32.015558Z\", \"started\": \"2021-03-10T13:48:33.658328Z\"}, \"mgr.gibba045.orlgmj\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba045.orlgmj\", \"hostname\": \"gibba045\", \"container_id\": \"ea964e825589\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 403701760, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721358Z\", \"created\": \"2021-03-10T13:40:34.535558Z\", \"started\": \"2021-03-10T13:48:50.630289Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48360325, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721446Z\", \"created\": \"2021-03-10T13:42:17.077564Z\", \"started\": \"2021-03-10T13:42:20.232803Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47238348, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721681Z\", \"created\": \"2021-03-10T13:42:38.781564Z\", \"started\": \"2021-03-10T13:42:42.298036Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46357544, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721874Z\", \"created\": \"2021-03-10T13:43:00.493564Z\", \"started\": \"2021-03-10T13:43:03.477079Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48255467, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722061Z\", \"created\": \"2021-03-10T13:43:22.897564Z\", \"started\": \"2021-03-10T13:43:26.167781Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba045\", \"container_id\": \"b3907fa26ba0\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 34697379, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722246Z\", \"created\": \"2021-03-10T13:43:42.821564Z\", \"started\": \"2021-03-10T13:44:24.396576Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23991418, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722341Z\", \"created\": \"2021-03-10T13:43:43.861564Z\", \"started\": \"2021-03-10T13:43:45.351099Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba045\", \"container_id\": \"d86cab6511db\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29611786, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722427Z\", \"created\": \"2021-03-10T13:44:08.721564Z\", \"started\": \"2021-03-10T13:44:08.746042Z\"}, \"rgw.r.z.gibba045.atotkw\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba045.atotkw\", \"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722512Z\", \"created\": \"2021-03-10T13:45:45.925564Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:17.529027Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:21.028684Z\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:37.919264Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:44:17.558720Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818Z\"}, \"rgw.r.z.gibba045.atotkw\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:44.004644Z\"}}, \"last_daemon_update\": \"2021-03-10T13:49:06.722624Z\", \"last_device_update\": \"2021-03-10T13:43:30.693305Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:49:19.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:19 gibba015 bash[9806]: audit 2021-03-10T13:49:19.183610+0000 mon.a (mon.0) 652 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101774786, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721104Z\", \"created\": \"2021-03-10T13:40:16.047558Z\", \"started\": \"2021-03-10T13:40:16.069701Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba045\", \"container_id\": \"0b25900c63e0\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 373817344, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721263Z\", \"created\": \"2021-03-10T13:40:32.015558Z\", \"started\": \"2021-03-10T13:48:33.658328Z\"}, \"mgr.gibba045.orlgmj\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba045.orlgmj\", \"hostname\": \"gibba045\", \"container_id\": \"ea964e825589\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 403701760, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721358Z\", \"created\": \"2021-03-10T13:40:34.535558Z\", \"started\": \"2021-03-10T13:48:50.630289Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48360325, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721446Z\", \"created\": \"2021-03-10T13:42:17.077564Z\", \"started\": \"2021-03-10T13:42:20.232803Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47238348, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721681Z\", \"created\": \"2021-03-10T13:42:38.781564Z\", \"started\": \"2021-03-10T13:42:42.298036Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46357544, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721874Z\", \"created\": \"2021-03-10T13:43:00.493564Z\", \"started\": \"2021-03-10T13:43:03.477079Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48255467, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722061Z\", \"created\": \"2021-03-10T13:43:22.897564Z\", \"started\": \"2021-03-10T13:43:26.167781Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba045\", \"container_id\": \"b3907fa26ba0\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 34697379, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722246Z\", \"created\": \"2021-03-10T13:43:42.821564Z\", \"started\": \"2021-03-10T13:44:24.396576Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23991418, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722341Z\", \"created\": \"2021-03-10T13:43:43.861564Z\", \"started\": \"2021-03-10T13:43:45.351099Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba045\", \"container_id\": \"d86cab6511db\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29611786, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722427Z\", \"created\": \"2021-03-10T13:44:08.721564Z\", \"started\": \"2021-03-10T13:44:08.746042Z\"}, \"rgw.r.z.gibba045.atotkw\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba045.atotkw\", \"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722512Z\", \"created\": \"2021-03-10T13:45:45.925564Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:17.529027Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:21.028684Z\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:37.919264Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:44:17.558720Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818Z\"}, \"rgw.r.z.gibba045.atotkw\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:44.004644Z\"}}, \"last_daemon_update\": \"2021-03-10T13:49:06.722624Z\", \"last_device_update\": \"2021-03-10T13:43:30.693305Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:49:19.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:19 gibba015 bash[9806]: audit 2021-03-10T13:49:19.192816+0000 mon.a (mon.0) 653 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101774786, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721104Z\", \"created\": \"2021-03-10T13:40:16.047558Z\", \"started\": \"2021-03-10T13:40:16.069701Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba045\", \"container_id\": \"0b25900c63e0\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 373817344, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721263Z\", \"created\": \"2021-03-10T13:40:32.015558Z\", \"started\": \"2021-03-10T13:48:33.658328Z\"}, \"mgr.gibba045.orlgmj\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba045.orlgmj\", \"hostname\": \"gibba045\", \"container_id\": \"ea964e825589\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 403701760, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721358Z\", \"created\": \"2021-03-10T13:40:34.535558Z\", \"started\": \"2021-03-10T13:48:50.630289Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48360325, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721446Z\", \"created\": \"2021-03-10T13:42:17.077564Z\", \"started\": \"2021-03-10T13:42:20.232803Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47238348, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721681Z\", \"created\": \"2021-03-10T13:42:38.781564Z\", \"started\": \"2021-03-10T13:42:42.298036Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46357544, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721874Z\", \"created\": \"2021-03-10T13:43:00.493564Z\", \"started\": \"2021-03-10T13:43:03.477079Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48255467, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722061Z\", \"created\": \"2021-03-10T13:43:22.897564Z\", \"started\": \"2021-03-10T13:43:26.167781Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba045\", \"container_id\": \"b3907fa26ba0\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 34697379, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722246Z\", \"created\": \"2021-03-10T13:43:42.821564Z\", \"started\": \"2021-03-10T13:44:24.396576Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23991418, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722341Z\", \"created\": \"2021-03-10T13:43:43.861564Z\", \"started\": \"2021-03-10T13:43:45.351099Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba045\", \"container_id\": \"d86cab6511db\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29611786, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722427Z\", \"created\": \"2021-03-10T13:44:08.721564Z\", \"started\": \"2021-03-10T13:44:08.746042Z\"}, \"rgw.r.z.gibba045.atotkw\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba045.atotkw\", \"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722512Z\", \"created\": \"2021-03-10T13:45:45.925564Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:17.529027Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:21.028684Z\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:37.919264Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:44:17.558720Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818Z\"}, \"rgw.r.z.gibba045.atotkw\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:44.004644Z\"}}, \"last_daemon_update\": \"2021-03-10T13:49:06.722624Z\", \"last_device_update\": \"2021-03-10T13:43:30.693305Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445Z\", \"scheduled_daemon_actions\": {}}"}]': finished 2021-03-10T13:49:19.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:19 gibba015 bash[9806]: audit 2021-03-10T13:49:19.198121+0000 mon.b (mon.2) 95 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-03-10T13:49:19.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:19 gibba015 bash[13005]: audit 2021-03-10T13:49:19.183610+0000 mon.a (mon.0) 652 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101774786, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721104Z\", \"created\": \"2021-03-10T13:40:16.047558Z\", \"started\": \"2021-03-10T13:40:16.069701Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba045\", \"container_id\": \"0b25900c63e0\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 373817344, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721263Z\", \"created\": \"2021-03-10T13:40:32.015558Z\", \"started\": \"2021-03-10T13:48:33.658328Z\"}, \"mgr.gibba045.orlgmj\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba045.orlgmj\", \"hostname\": \"gibba045\", \"container_id\": \"ea964e825589\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 403701760, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721358Z\", \"created\": \"2021-03-10T13:40:34.535558Z\", \"started\": \"2021-03-10T13:48:50.630289Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48360325, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721446Z\", \"created\": \"2021-03-10T13:42:17.077564Z\", \"started\": \"2021-03-10T13:42:20.232803Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47238348, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721681Z\", \"created\": \"2021-03-10T13:42:38.781564Z\", \"started\": \"2021-03-10T13:42:42.298036Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46357544, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721874Z\", \"created\": \"2021-03-10T13:43:00.493564Z\", \"started\": \"2021-03-10T13:43:03.477079Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48255467, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722061Z\", \"created\": \"2021-03-10T13:43:22.897564Z\", \"started\": \"2021-03-10T13:43:26.167781Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba045\", \"container_id\": \"b3907fa26ba0\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 34697379, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722246Z\", \"created\": \"2021-03-10T13:43:42.821564Z\", \"started\": \"2021-03-10T13:44:24.396576Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23991418, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722341Z\", \"created\": \"2021-03-10T13:43:43.861564Z\", \"started\": \"2021-03-10T13:43:45.351099Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba045\", \"container_id\": \"d86cab6511db\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29611786, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722427Z\", \"created\": \"2021-03-10T13:44:08.721564Z\", \"started\": \"2021-03-10T13:44:08.746042Z\"}, \"rgw.r.z.gibba045.atotkw\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba045.atotkw\", \"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722512Z\", \"created\": \"2021-03-10T13:45:45.925564Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:17.529027Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:21.028684Z\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:37.919264Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:44:17.558720Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818Z\"}, \"rgw.r.z.gibba045.atotkw\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:44.004644Z\"}}, \"last_daemon_update\": \"2021-03-10T13:49:06.722624Z\", \"last_device_update\": \"2021-03-10T13:43:30.693305Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:49:19.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:19 gibba015 bash[13005]: audit 2021-03-10T13:49:19.192816+0000 mon.a (mon.0) 653 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101774786, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721104Z\", \"created\": \"2021-03-10T13:40:16.047558Z\", \"started\": \"2021-03-10T13:40:16.069701Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba045\", \"container_id\": \"0b25900c63e0\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 373817344, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721263Z\", \"created\": \"2021-03-10T13:40:32.015558Z\", \"started\": \"2021-03-10T13:48:33.658328Z\"}, \"mgr.gibba045.orlgmj\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba045.orlgmj\", \"hostname\": \"gibba045\", \"container_id\": \"ea964e825589\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 403701760, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721358Z\", \"created\": \"2021-03-10T13:40:34.535558Z\", \"started\": \"2021-03-10T13:48:50.630289Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48360325, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721446Z\", \"created\": \"2021-03-10T13:42:17.077564Z\", \"started\": \"2021-03-10T13:42:20.232803Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47238348, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721681Z\", \"created\": \"2021-03-10T13:42:38.781564Z\", \"started\": \"2021-03-10T13:42:42.298036Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46357544, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721874Z\", \"created\": \"2021-03-10T13:43:00.493564Z\", \"started\": \"2021-03-10T13:43:03.477079Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48255467, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722061Z\", \"created\": \"2021-03-10T13:43:22.897564Z\", \"started\": \"2021-03-10T13:43:26.167781Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba045\", \"container_id\": \"b3907fa26ba0\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 34697379, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722246Z\", \"created\": \"2021-03-10T13:43:42.821564Z\", \"started\": \"2021-03-10T13:44:24.396576Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23991418, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722341Z\", \"created\": \"2021-03-10T13:43:43.861564Z\", \"started\": \"2021-03-10T13:43:45.351099Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba045\", \"container_id\": \"d86cab6511db\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29611786, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722427Z\", \"created\": \"2021-03-10T13:44:08.721564Z\", \"started\": \"2021-03-10T13:44:08.746042Z\"}, \"rgw.r.z.gibba045.atotkw\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba045.atotkw\", \"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722512Z\", \"created\": \"2021-03-10T13:45:45.925564Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:17.529027Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:21.028684Z\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:37.919264Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:44:17.558720Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818Z\"}, \"rgw.r.z.gibba045.atotkw\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:44.004644Z\"}}, \"last_daemon_update\": \"2021-03-10T13:49:06.722624Z\", \"last_device_update\": \"2021-03-10T13:43:30.693305Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:39:48.493445Z\", \"scheduled_daemon_actions\": {}}"}]': finished 2021-03-10T13:49:19.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:19 gibba015 bash[13005]: audit 2021-03-10T13:49:19.198121+0000 mon.b (mon.2) 95 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-03-10T13:49:20.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:20 gibba045 bash[9787]: cluster 2021-03-10T13:49:18.992546+0000 mgr.gibba045.orlgmj (mgr.34379) 27 : cluster [DBG] pgmap v14: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:20.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:20 gibba045 bash[9787]: audit 2021-03-10T13:49:19.198500+0000 mgr.gibba045.orlgmj (mgr.34379) 28 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-03-10T13:49:20.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:20 gibba045 bash[9787]: cephadm 2021-03-10T13:49:19.199710+0000 mgr.gibba045.orlgmj (mgr.34379) 29 : cephadm [WRN] Failed to get Dashboard config for AlertManager: dashboard get-alertmanager-api-host failed: Module 'dashboard' has experienced an error and cannot handle commands: Timeout('Port 8443 not free on ::.',) retval: -5 2021-03-10T13:49:20.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:20 gibba045 bash[9787]: cephadm 2021-03-10T13:49:19.199818+0000 mgr.gibba045.orlgmj (mgr.34379) 30 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a 2021-03-10T13:49:20.851 INFO:journalctl@ceph.alertmanager.a.gibba015.stdout:Mar 10 13:49:20 gibba015 bash[27938]: level=info ts=2021-03-10T13:49:20.488Z caller=cluster.go:648 component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000146285s 2021-03-10T13:49:20.852 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:20 gibba015 bash[9806]: cluster 2021-03-10T13:49:18.992546+0000 mgr.gibba045.orlgmj (mgr.34379) 27 : cluster [DBG] pgmap v14: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:20.852 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:20 gibba015 bash[9806]: audit 2021-03-10T13:49:19.198500+0000 mgr.gibba045.orlgmj (mgr.34379) 28 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-03-10T13:49:20.852 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:20 gibba015 bash[9806]: cephadm 2021-03-10T13:49:19.199710+0000 mgr.gibba045.orlgmj (mgr.34379) 29 : cephadm [WRN] Failed to get Dashboard config for AlertManager: dashboard get-alertmanager-api-host failed: Module 'dashboard' has experienced an error and cannot handle commands: Timeout('Port 8443 not free on ::.',) retval: -5 2021-03-10T13:49:20.852 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:20 gibba015 bash[9806]: cephadm 2021-03-10T13:49:19.199818+0000 mgr.gibba045.orlgmj (mgr.34379) 30 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a 2021-03-10T13:49:20.853 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:20 gibba015 bash[13005]: cluster 2021-03-10T13:49:18.992546+0000 mgr.gibba045.orlgmj (mgr.34379) 27 : cluster [DBG] pgmap v14: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:20.853 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:20 gibba015 bash[13005]: audit 2021-03-10T13:49:19.198500+0000 mgr.gibba045.orlgmj (mgr.34379) 28 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-03-10T13:49:20.853 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:20 gibba015 bash[13005]: cephadm 2021-03-10T13:49:19.199710+0000 mgr.gibba045.orlgmj (mgr.34379) 29 : cephadm [WRN] Failed to get Dashboard config for AlertManager: dashboard get-alertmanager-api-host failed: Module 'dashboard' has experienced an error and cannot handle commands: Timeout('Port 8443 not free on ::.',) retval: -5 2021-03-10T13:49:20.853 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:20 gibba015 bash[13005]: cephadm 2021-03-10T13:49:19.199818+0000 mgr.gibba045.orlgmj (mgr.34379) 30 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a 2021-03-10T13:49:21.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:21 gibba045 bash[9787]: audit 2021-03-10T13:49:21.323394+0000 mon.b (mon.2) 96 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"e38afbda-df9b-4c75-b599-248e5f8168df\", \"target_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"target_version\": \"17.0.0-1749-gb26fc080\", \"fs_original_max_mds\": null, \"error\": null, \"paused\": false}"}]: dispatch 2021-03-10T13:49:21.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:21 gibba045 bash[9787]: audit 2021-03-10T13:49:21.324042+0000 mon.a (mon.0) 654 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"e38afbda-df9b-4c75-b599-248e5f8168df\", \"target_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"target_version\": \"17.0.0-1749-gb26fc080\", \"fs_original_max_mds\": null, \"error\": null, \"paused\": false}"}]: dispatch 2021-03-10T13:49:21.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:21 gibba045 bash[9787]: audit 2021-03-10T13:49:21.328304+0000 mon.a (mon.0) 655 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"e38afbda-df9b-4c75-b599-248e5f8168df\", \"target_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"target_version\": \"17.0.0-1749-gb26fc080\", \"fs_original_max_mds\": null, \"error\": null, \"paused\": false}"}]': finished 2021-03-10T13:49:21.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:21 gibba045 bash[9787]: audit 2021-03-10T13:49:21.335263+0000 mon.b (mon.2) 97 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:49:21.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:21 gibba015 bash[9806]: audit 2021-03-10T13:49:21.323394+0000 mon.b (mon.2) 96 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"e38afbda-df9b-4c75-b599-248e5f8168df\", \"target_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"target_version\": \"17.0.0-1749-gb26fc080\", \"fs_original_max_mds\": null, \"error\": null, \"paused\": false}"}]: dispatch 2021-03-10T13:49:21.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:21 gibba015 bash[9806]: audit 2021-03-10T13:49:21.324042+0000 mon.a (mon.0) 654 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"e38afbda-df9b-4c75-b599-248e5f8168df\", \"target_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"target_version\": \"17.0.0-1749-gb26fc080\", \"fs_original_max_mds\": null, \"error\": null, \"paused\": false}"}]: dispatch 2021-03-10T13:49:21.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:21 gibba015 bash[9806]: audit 2021-03-10T13:49:21.328304+0000 mon.a (mon.0) 655 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"e38afbda-df9b-4c75-b599-248e5f8168df\", \"target_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"target_version\": \"17.0.0-1749-gb26fc080\", \"fs_original_max_mds\": null, \"error\": null, \"paused\": false}"}]': finished 2021-03-10T13:49:21.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:21 gibba015 bash[9806]: audit 2021-03-10T13:49:21.335263+0000 mon.b (mon.2) 97 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:49:21.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:21 gibba015 bash[13005]: audit 2021-03-10T13:49:21.323394+0000 mon.b (mon.2) 96 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"e38afbda-df9b-4c75-b599-248e5f8168df\", \"target_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"target_version\": \"17.0.0-1749-gb26fc080\", \"fs_original_max_mds\": null, \"error\": null, \"paused\": false}"}]: dispatch 2021-03-10T13:49:21.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:21 gibba015 bash[13005]: audit 2021-03-10T13:49:21.324042+0000 mon.a (mon.0) 654 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"e38afbda-df9b-4c75-b599-248e5f8168df\", \"target_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"target_version\": \"17.0.0-1749-gb26fc080\", \"fs_original_max_mds\": null, \"error\": null, \"paused\": false}"}]: dispatch 2021-03-10T13:49:21.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:21 gibba015 bash[13005]: audit 2021-03-10T13:49:21.328304+0000 mon.a (mon.0) 655 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"e38afbda-df9b-4c75-b599-248e5f8168df\", \"target_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"target_version\": \"17.0.0-1749-gb26fc080\", \"fs_original_max_mds\": null, \"error\": null, \"paused\": false}"}]': finished 2021-03-10T13:49:21.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:21 gibba015 bash[13005]: audit 2021-03-10T13:49:21.335263+0000 mon.b (mon.2) 97 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:49:22.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:22 gibba015 bash[13005]: cluster 2021-03-10T13:49:20.993715+0000 mgr.gibba045.orlgmj (mgr.34379) 31 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:22.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:22 gibba015 bash[13005]: cephadm 2021-03-10T13:49:21.334517+0000 mgr.gibba045.orlgmj (mgr.34379) 32 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:49:22.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:22 gibba015 bash[13005]: cephadm 2021-03-10T13:49:21.336387+0000 mgr.gibba045.orlgmj (mgr.34379) 33 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:49:22.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:22 gibba015 bash[13005]: cephadm 2021-03-10T13:49:21.336584+0000 mgr.gibba045.orlgmj (mgr.34379) 34 : cephadm [INF] Upgrade: It is presumed safe to stop ['mgr.y'] 2021-03-10T13:49:22.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:22 gibba015 bash[9806]: cluster 2021-03-10T13:49:20.993715+0000 mgr.gibba045.orlgmj (mgr.34379) 31 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:22.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:22 gibba015 bash[9806]: cephadm 2021-03-10T13:49:21.334517+0000 mgr.gibba045.orlgmj (mgr.34379) 32 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:49:22.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:22 gibba015 bash[9806]: cephadm 2021-03-10T13:49:21.336387+0000 mgr.gibba045.orlgmj (mgr.34379) 33 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:49:22.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:22 gibba015 bash[9806]: cephadm 2021-03-10T13:49:21.336584+0000 mgr.gibba045.orlgmj (mgr.34379) 34 : cephadm [INF] Upgrade: It is presumed safe to stop ['mgr.y'] 2021-03-10T13:49:22.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:22 gibba045 bash[9787]: cluster 2021-03-10T13:49:20.993715+0000 mgr.gibba045.orlgmj (mgr.34379) 31 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:22.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:22 gibba045 bash[9787]: cephadm 2021-03-10T13:49:21.334517+0000 mgr.gibba045.orlgmj (mgr.34379) 32 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:49:22.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:22 gibba045 bash[9787]: cephadm 2021-03-10T13:49:21.336387+0000 mgr.gibba045.orlgmj (mgr.34379) 33 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:49:22.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:22 gibba045 bash[9787]: cephadm 2021-03-10T13:49:21.336584+0000 mgr.gibba045.orlgmj (mgr.34379) 34 : cephadm [INF] Upgrade: It is presumed safe to stop ['mgr.y'] 2021-03-10T13:49:23.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:23 gibba015 bash[9806]: cluster 2021-03-10T13:49:22.995986+0000 mgr.gibba045.orlgmj (mgr.34379) 35 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:23.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:23 gibba015 bash[9806]: cephadm 2021-03-10T13:49:23.237566+0000 mgr.gibba045.orlgmj (mgr.34379) 36 : cephadm [INF] Upgrade: Updating mgr.y 2021-03-10T13:49:23.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:23 gibba015 bash[9806]: audit 2021-03-10T13:49:23.238614+0000 mon.b (mon.2) 98 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.y"}]: dispatch 2021-03-10T13:49:23.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:23 gibba015 bash[9806]: audit 2021-03-10T13:49:23.239243+0000 mon.a (mon.0) 656 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.y"}]: dispatch 2021-03-10T13:49:23.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:23 gibba015 bash[9806]: audit 2021-03-10T13:49:23.243269+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.y"}]': finished 2021-03-10T13:49:23.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:23 gibba015 bash[9806]: audit 2021-03-10T13:49:23.248887+0000 mon.b (mon.2) 99 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:49:23.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:23 gibba015 bash[9806]: audit 2021-03-10T13:49:23.248963+0000 mon.a (mon.0) 658 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:49:23.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:23 gibba015 bash[9806]: audit 2021-03-10T13:49:23.250237+0000 mon.b (mon.2) 100 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "mgr services"}]: dispatch 2021-03-10T13:49:23.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:23 gibba015 bash[9806]: audit 2021-03-10T13:49:23.251091+0000 mon.b (mon.2) 101 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:49:23.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:23 gibba015 bash[9806]: cephadm 2021-03-10T13:49:23.251638+0000 mgr.gibba045.orlgmj (mgr.34379) 37 : cephadm [INF] Deploying daemon mgr.y on gibba015 2021-03-10T13:49:23.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:23 gibba015 bash[9806]: audit 2021-03-10T13:49:23.251869+0000 mon.b (mon.2) 102 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mgr.y","key": "container_image"}]: dispatch 2021-03-10T13:49:23.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:23 gibba015 bash[13005]: cluster 2021-03-10T13:49:22.995986+0000 mgr.gibba045.orlgmj (mgr.34379) 35 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:23.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:23 gibba015 bash[13005]: cephadm 2021-03-10T13:49:23.237566+0000 mgr.gibba045.orlgmj (mgr.34379) 36 : cephadm [INF] Upgrade: Updating mgr.y 2021-03-10T13:49:23.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:23 gibba015 bash[13005]: audit 2021-03-10T13:49:23.238614+0000 mon.b (mon.2) 98 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.y"}]: dispatch 2021-03-10T13:49:23.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:23 gibba015 bash[13005]: audit 2021-03-10T13:49:23.239243+0000 mon.a (mon.0) 656 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.y"}]: dispatch 2021-03-10T13:49:23.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:23 gibba015 bash[13005]: audit 2021-03-10T13:49:23.243269+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.y"}]': finished 2021-03-10T13:49:23.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:23 gibba015 bash[13005]: audit 2021-03-10T13:49:23.248887+0000 mon.b (mon.2) 99 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:49:23.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:23 gibba015 bash[13005]: audit 2021-03-10T13:49:23.248963+0000 mon.a (mon.0) 658 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:49:23.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:23 gibba015 bash[13005]: audit 2021-03-10T13:49:23.250237+0000 mon.b (mon.2) 100 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "mgr services"}]: dispatch 2021-03-10T13:49:23.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:23 gibba015 bash[13005]: audit 2021-03-10T13:49:23.251091+0000 mon.b (mon.2) 101 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:49:23.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:23 gibba015 bash[13005]: cephadm 2021-03-10T13:49:23.251638+0000 mgr.gibba045.orlgmj (mgr.34379) 37 : cephadm [INF] Deploying daemon mgr.y on gibba015 2021-03-10T13:49:23.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:23 gibba015 bash[13005]: audit 2021-03-10T13:49:23.251869+0000 mon.b (mon.2) 102 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mgr.y","key": "container_image"}]: dispatch 2021-03-10T13:49:24.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:23 gibba045 bash[9787]: cluster 2021-03-10T13:49:22.995986+0000 mgr.gibba045.orlgmj (mgr.34379) 35 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:24.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:23 gibba045 bash[9787]: cephadm 2021-03-10T13:49:23.237566+0000 mgr.gibba045.orlgmj (mgr.34379) 36 : cephadm [INF] Upgrade: Updating mgr.y 2021-03-10T13:49:24.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:23 gibba045 bash[9787]: audit 2021-03-10T13:49:23.238614+0000 mon.b (mon.2) 98 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.y"}]: dispatch 2021-03-10T13:49:24.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:23 gibba045 bash[9787]: audit 2021-03-10T13:49:23.239243+0000 mon.a (mon.0) 656 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.y"}]: dispatch 2021-03-10T13:49:24.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:23 gibba045 bash[9787]: audit 2021-03-10T13:49:23.243269+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.y"}]': finished 2021-03-10T13:49:24.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:23 gibba045 bash[9787]: audit 2021-03-10T13:49:23.248887+0000 mon.b (mon.2) 99 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:49:24.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:23 gibba045 bash[9787]: audit 2021-03-10T13:49:23.248963+0000 mon.a (mon.0) 658 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:49:24.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:23 gibba045 bash[9787]: audit 2021-03-10T13:49:23.250237+0000 mon.b (mon.2) 100 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "mgr services"}]: dispatch 2021-03-10T13:49:24.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:23 gibba045 bash[9787]: audit 2021-03-10T13:49:23.251091+0000 mon.b (mon.2) 101 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:49:24.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:23 gibba045 bash[9787]: cephadm 2021-03-10T13:49:23.251638+0000 mgr.gibba045.orlgmj (mgr.34379) 37 : cephadm [INF] Deploying daemon mgr.y on gibba015 2021-03-10T13:49:24.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:23 gibba045 bash[9787]: audit 2021-03-10T13:49:23.251869+0000 mon.b (mon.2) 102 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mgr.y","key": "container_image"}]: dispatch 2021-03-10T13:49:25.471 INFO:journalctl@ceph.mgr.y.gibba015.stdout:Mar 10 13:49:25 gibba015 systemd[1]: Stopping Ceph mgr.y for e4a642d2-81a5-11eb-9080-001a4aab830c... 2021-03-10T13:49:26.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:26 gibba015 bash[9806]: cluster 2021-03-10T13:49:24.997313+0000 mgr.gibba045.orlgmj (mgr.34379) 38 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:26.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:26 gibba015 bash[13005]: cluster 2021-03-10T13:49:24.997313+0000 mgr.gibba045.orlgmj (mgr.34379) 38 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:26.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:26 gibba045 bash[9787]: cluster 2021-03-10T13:49:24.997313+0000 mgr.gibba045.orlgmj (mgr.34379) 38 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:28.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:28 gibba045 bash[9787]: cluster 2021-03-10T13:49:26.998578+0000 mgr.gibba045.orlgmj (mgr.34379) 39 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:28.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:28 gibba015 bash[9806]: cluster 2021-03-10T13:49:26.998578+0000 mgr.gibba045.orlgmj (mgr.34379) 39 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:28.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:28 gibba015 bash[13005]: cluster 2021-03-10T13:49:26.998578+0000 mgr.gibba045.orlgmj (mgr.34379) 39 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:28.722 INFO:journalctl@ceph.alertmanager.a.gibba015.stdout:Mar 10 13:49:28 gibba015 bash[27938]: level=info ts=2021-03-10T13:49:28.489Z caller=cluster.go:640 component=cluster msg="gossip settled; proceeding" elapsed=10.001138436s 2021-03-10T13:49:30.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:30 gibba015 bash[9806]: cluster 2021-03-10T13:49:29.000481+0000 mgr.gibba045.orlgmj (mgr.34379) 40 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:30.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:30 gibba015 bash[13005]: cluster 2021-03-10T13:49:29.000481+0000 mgr.gibba045.orlgmj (mgr.34379) 40 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:30.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:30 gibba045 bash[9787]: cluster 2021-03-10T13:49:29.000481+0000 mgr.gibba045.orlgmj (mgr.34379) 40 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:32.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:32 gibba015 bash[9806]: cluster 2021-03-10T13:49:31.001485+0000 mgr.gibba045.orlgmj (mgr.34379) 41 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:32.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:32 gibba015 bash[13005]: cluster 2021-03-10T13:49:31.001485+0000 mgr.gibba045.orlgmj (mgr.34379) 41 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:32.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:32 gibba045 bash[9787]: cluster 2021-03-10T13:49:31.001485+0000 mgr.gibba045.orlgmj (mgr.34379) 41 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:34.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:34 gibba015 bash[9806]: cluster 2021-03-10T13:49:33.003628+0000 mgr.gibba045.orlgmj (mgr.34379) 42 : cluster [DBG] pgmap v21: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:34.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:34 gibba015 bash[13005]: cluster 2021-03-10T13:49:33.003628+0000 mgr.gibba045.orlgmj (mgr.34379) 42 : cluster [DBG] pgmap v21: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:34.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:34 gibba045 bash[9787]: cluster 2021-03-10T13:49:33.003628+0000 mgr.gibba045.orlgmj (mgr.34379) 42 : cluster [DBG] pgmap v21: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:36.221 INFO:journalctl@ceph.mgr.y.gibba015.stdout:Mar 10 13:49:35 gibba015 docker[28295]: ceph-e4a642d2-81a5-11eb-9080-001a4aab830c-mgr.y 2021-03-10T13:49:36.221 INFO:journalctl@ceph.mgr.y.gibba015.stdout:Mar 10 13:49:35 gibba015 systemd[1]: ceph-e4a642d2-81a5-11eb-9080-001a4aab830c@mgr.y.service: Main process exited, code=exited, status=137/n/a 2021-03-10T13:49:36.221 INFO:journalctl@ceph.mgr.y.gibba015.stdout:Mar 10 13:49:35 gibba015 systemd[1]: ceph-e4a642d2-81a5-11eb-9080-001a4aab830c@mgr.y.service: Failed with result 'exit-code'. 2021-03-10T13:49:36.222 INFO:journalctl@ceph.mgr.y.gibba015.stdout:Mar 10 13:49:35 gibba015 systemd[1]: Stopped Ceph mgr.y for e4a642d2-81a5-11eb-9080-001a4aab830c. 2021-03-10T13:49:36.222 INFO:journalctl@ceph.mgr.y.gibba015.stdout:Mar 10 13:49:36 gibba015 systemd[1]: Started Ceph mgr.y for e4a642d2-81a5-11eb-9080-001a4aab830c. 2021-03-10T13:49:36.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:36 gibba015 bash[9806]: cluster 2021-03-10T13:49:35.004742+0000 mgr.gibba045.orlgmj (mgr.34379) 43 : cluster [DBG] pgmap v22: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:36.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:36 gibba015 bash[13005]: cluster 2021-03-10T13:49:35.004742+0000 mgr.gibba045.orlgmj (mgr.34379) 43 : cluster [DBG] pgmap v22: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:36.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:36 gibba015 bash[9806]: audit 2021-03-10T13:49:36.094489+0000 mon.b (mon.2) 103 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93375692, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847333Z\", \"created\": \"2021-03-10T13:38:50.668449Z\", \"started\": \"2021-03-10T13:38:56.060544Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba015\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95776931, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847552Z\", \"created\": \"2021-03-10T13:40:03.296449Z\", \"started\": \"2021-03-10T13:40:03.320843Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48737812, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847608Z\", \"created\": \"2021-03-10T13:40:50.072448Z\", \"started\": \"2021-03-10T13:40:53.142290Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49733959, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847779Z\", \"created\": \"2021-03-10T13:41:11.556448Z\", \"started\": \"2021-03-10T13:41:15.069232Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46493859, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847910Z\", \"created\": \"2021-03-10T13:41:34.244448Z\", \"started\": \"2021-03-10T13:41:37.507096Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46850375, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848034Z\", \"created\": \"2021-03-10T13:41:57.328380Z\", \"started\": \"2021-03-10T13:42:00.781947Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22387097, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848156Z\", \"created\": \"2021-03-10T13:43:44.272379Z\", \"started\": \"2021-03-10T13:43:47.550063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:08.925129Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:23.251574Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:49:10.777874Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:07.001926Z\"}}, \"last_device_update\": \"2021-03-10T13:42:03.853072Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426Z\"}"}]: dispatch 2021-03-10T13:49:36.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:36 gibba015 bash[13005]: audit 2021-03-10T13:49:36.094489+0000 mon.b (mon.2) 103 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93375692, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847333Z\", \"created\": \"2021-03-10T13:38:50.668449Z\", \"started\": \"2021-03-10T13:38:56.060544Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba015\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95776931, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847552Z\", \"created\": \"2021-03-10T13:40:03.296449Z\", \"started\": \"2021-03-10T13:40:03.320843Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48737812, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847608Z\", \"created\": \"2021-03-10T13:40:50.072448Z\", \"started\": \"2021-03-10T13:40:53.142290Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49733959, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847779Z\", \"created\": \"2021-03-10T13:41:11.556448Z\", \"started\": \"2021-03-10T13:41:15.069232Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46493859, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847910Z\", \"created\": \"2021-03-10T13:41:34.244448Z\", \"started\": \"2021-03-10T13:41:37.507096Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46850375, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848034Z\", \"created\": \"2021-03-10T13:41:57.328380Z\", \"started\": \"2021-03-10T13:42:00.781947Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22387097, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848156Z\", \"created\": \"2021-03-10T13:43:44.272379Z\", \"started\": \"2021-03-10T13:43:47.550063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:08.925129Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:23.251574Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:49:10.777874Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:07.001926Z\"}}, \"last_device_update\": \"2021-03-10T13:42:03.853072Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426Z\"}"}]: dispatch 2021-03-10T13:49:36.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:36 gibba015 bash[9806]: audit 2021-03-10T13:49:36.095173+0000 mon.a (mon.0) 659 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93375692, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847333Z\", \"created\": \"2021-03-10T13:38:50.668449Z\", \"started\": \"2021-03-10T13:38:56.060544Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba015\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95776931, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847552Z\", \"created\": \"2021-03-10T13:40:03.296449Z\", \"started\": \"2021-03-10T13:40:03.320843Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48737812, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847608Z\", \"created\": \"2021-03-10T13:40:50.072448Z\", \"started\": \"2021-03-10T13:40:53.142290Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49733959, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847779Z\", \"created\": \"2021-03-10T13:41:11.556448Z\", \"started\": \"2021-03-10T13:41:15.069232Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46493859, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847910Z\", \"created\": \"2021-03-10T13:41:34.244448Z\", \"started\": \"2021-03-10T13:41:37.507096Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46850375, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848034Z\", \"created\": \"2021-03-10T13:41:57.328380Z\", \"started\": \"2021-03-10T13:42:00.781947Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22387097, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848156Z\", \"created\": \"2021-03-10T13:43:44.272379Z\", \"started\": \"2021-03-10T13:43:47.550063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:08.925129Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:23.251574Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:49:10.777874Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:07.001926Z\"}}, \"last_device_update\": \"2021-03-10T13:42:03.853072Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426Z\"}"}]: dispatch 2021-03-10T13:49:36.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:36 gibba015 bash[13005]: audit 2021-03-10T13:49:36.095173+0000 mon.a (mon.0) 659 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93375692, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847333Z\", \"created\": \"2021-03-10T13:38:50.668449Z\", \"started\": \"2021-03-10T13:38:56.060544Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba015\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95776931, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847552Z\", \"created\": \"2021-03-10T13:40:03.296449Z\", \"started\": \"2021-03-10T13:40:03.320843Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48737812, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847608Z\", \"created\": \"2021-03-10T13:40:50.072448Z\", \"started\": \"2021-03-10T13:40:53.142290Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49733959, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847779Z\", \"created\": \"2021-03-10T13:41:11.556448Z\", \"started\": \"2021-03-10T13:41:15.069232Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46493859, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847910Z\", \"created\": \"2021-03-10T13:41:34.244448Z\", \"started\": \"2021-03-10T13:41:37.507096Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46850375, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848034Z\", \"created\": \"2021-03-10T13:41:57.328380Z\", \"started\": \"2021-03-10T13:42:00.781947Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22387097, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848156Z\", \"created\": \"2021-03-10T13:43:44.272379Z\", \"started\": \"2021-03-10T13:43:47.550063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:08.925129Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:23.251574Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:49:10.777874Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:07.001926Z\"}}, \"last_device_update\": \"2021-03-10T13:42:03.853072Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426Z\"}"}]: dispatch 2021-03-10T13:49:36.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:36 gibba015 bash[9806]: audit 2021-03-10T13:49:36.098928+0000 mon.a (mon.0) 660 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93375692, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847333Z\", \"created\": \"2021-03-10T13:38:50.668449Z\", \"started\": \"2021-03-10T13:38:56.060544Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba015\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95776931, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847552Z\", \"created\": \"2021-03-10T13:40:03.296449Z\", \"started\": \"2021-03-10T13:40:03.320843Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48737812, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847608Z\", \"created\": \"2021-03-10T13:40:50.072448Z\", \"started\": \"2021-03-10T13:40:53.142290Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49733959, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847779Z\", \"created\": \"2021-03-10T13:41:11.556448Z\", \"started\": \"2021-03-10T13:41:15.069232Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46493859, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847910Z\", \"created\": \"2021-03-10T13:41:34.244448Z\", \"started\": \"2021-03-10T13:41:37.507096Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46850375, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848034Z\", \"created\": \"2021-03-10T13:41:57.328380Z\", \"started\": \"2021-03-10T13:42:00.781947Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22387097, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848156Z\", \"created\": \"2021-03-10T13:43:44.272379Z\", \"started\": \"2021-03-10T13:43:47.550063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:08.925129Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:23.251574Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:49:10.777874Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:07.001926Z\"}}, \"last_device_update\": \"2021-03-10T13:42:03.853072Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426Z\"}"}]': finished 2021-03-10T13:49:36.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:36 gibba015 bash[9806]: audit 2021-03-10T13:49:36.104690+0000 mon.b (mon.2) 104 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:49:36.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:36 gibba015 bash[13005]: audit 2021-03-10T13:49:36.098928+0000 mon.a (mon.0) 660 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93375692, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847333Z\", \"created\": \"2021-03-10T13:38:50.668449Z\", \"started\": \"2021-03-10T13:38:56.060544Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba015\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95776931, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847552Z\", \"created\": \"2021-03-10T13:40:03.296449Z\", \"started\": \"2021-03-10T13:40:03.320843Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48737812, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847608Z\", \"created\": \"2021-03-10T13:40:50.072448Z\", \"started\": \"2021-03-10T13:40:53.142290Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49733959, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847779Z\", \"created\": \"2021-03-10T13:41:11.556448Z\", \"started\": \"2021-03-10T13:41:15.069232Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46493859, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847910Z\", \"created\": \"2021-03-10T13:41:34.244448Z\", \"started\": \"2021-03-10T13:41:37.507096Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46850375, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848034Z\", \"created\": \"2021-03-10T13:41:57.328380Z\", \"started\": \"2021-03-10T13:42:00.781947Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22387097, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848156Z\", \"created\": \"2021-03-10T13:43:44.272379Z\", \"started\": \"2021-03-10T13:43:47.550063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:08.925129Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:23.251574Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:49:10.777874Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:07.001926Z\"}}, \"last_device_update\": \"2021-03-10T13:42:03.853072Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426Z\"}"}]': finished 2021-03-10T13:49:36.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:36 gibba015 bash[13005]: audit 2021-03-10T13:49:36.104690+0000 mon.b (mon.2) 104 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:49:36.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:36 gibba015 bash[9806]: audit 2021-03-10T13:49:36.291497+0000 mon.b (mon.2) 105 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93375692, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847333Z\", \"created\": \"2021-03-10T13:38:50.668449Z\", \"started\": \"2021-03-10T13:38:56.060544Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba015\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95776931, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847552Z\", \"created\": \"2021-03-10T13:40:03.296449Z\", \"started\": \"2021-03-10T13:40:03.320843Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48737812, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847608Z\", \"created\": \"2021-03-10T13:40:50.072448Z\", \"started\": \"2021-03-10T13:40:53.142290Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49733959, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847779Z\", \"created\": \"2021-03-10T13:41:11.556448Z\", \"started\": \"2021-03-10T13:41:15.069232Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46493859, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847910Z\", \"created\": \"2021-03-10T13:41:34.244448Z\", \"started\": \"2021-03-10T13:41:37.507096Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46850375, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848034Z\", \"created\": \"2021-03-10T13:41:57.328380Z\", \"started\": \"2021-03-10T13:42:00.781947Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22387097, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848156Z\", \"created\": \"2021-03-10T13:43:44.272379Z\", \"started\": \"2021-03-10T13:43:47.550063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:08.925129Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:23.251574Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:49:10.777874Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:07.001926Z\"}}, \"last_device_update\": \"2021-03-10T13:42:03.853072Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:49:36.287812Z\"}"}]: dispatch 2021-03-10T13:49:36.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:36 gibba015 bash[13005]: audit 2021-03-10T13:49:36.291497+0000 mon.b (mon.2) 105 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93375692, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847333Z\", \"created\": \"2021-03-10T13:38:50.668449Z\", \"started\": \"2021-03-10T13:38:56.060544Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba015\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95776931, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847552Z\", \"created\": \"2021-03-10T13:40:03.296449Z\", \"started\": \"2021-03-10T13:40:03.320843Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48737812, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847608Z\", \"created\": \"2021-03-10T13:40:50.072448Z\", \"started\": \"2021-03-10T13:40:53.142290Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49733959, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847779Z\", \"created\": \"2021-03-10T13:41:11.556448Z\", \"started\": \"2021-03-10T13:41:15.069232Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46493859, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847910Z\", \"created\": \"2021-03-10T13:41:34.244448Z\", \"started\": \"2021-03-10T13:41:37.507096Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46850375, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848034Z\", \"created\": \"2021-03-10T13:41:57.328380Z\", \"started\": \"2021-03-10T13:42:00.781947Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22387097, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848156Z\", \"created\": \"2021-03-10T13:43:44.272379Z\", \"started\": \"2021-03-10T13:43:47.550063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:08.925129Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:23.251574Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:49:10.777874Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:07.001926Z\"}}, \"last_device_update\": \"2021-03-10T13:42:03.853072Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:49:36.287812Z\"}"}]: dispatch 2021-03-10T13:49:36.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:36 gibba015 bash[9806]: audit 2021-03-10T13:49:36.292405+0000 mon.a (mon.0) 661 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93375692, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847333Z\", \"created\": \"2021-03-10T13:38:50.668449Z\", \"started\": \"2021-03-10T13:38:56.060544Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba015\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95776931, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847552Z\", \"created\": \"2021-03-10T13:40:03.296449Z\", \"started\": \"2021-03-10T13:40:03.320843Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48737812, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847608Z\", \"created\": \"2021-03-10T13:40:50.072448Z\", \"started\": \"2021-03-10T13:40:53.142290Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49733959, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847779Z\", \"created\": \"2021-03-10T13:41:11.556448Z\", \"started\": \"2021-03-10T13:41:15.069232Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46493859, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847910Z\", \"created\": \"2021-03-10T13:41:34.244448Z\", \"started\": \"2021-03-10T13:41:37.507096Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46850375, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848034Z\", \"created\": \"2021-03-10T13:41:57.328380Z\", \"started\": \"2021-03-10T13:42:00.781947Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22387097, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848156Z\", \"created\": \"2021-03-10T13:43:44.272379Z\", \"started\": \"2021-03-10T13:43:47.550063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:08.925129Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:23.251574Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:49:10.777874Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:07.001926Z\"}}, \"last_device_update\": \"2021-03-10T13:42:03.853072Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:49:36.287812Z\"}"}]: dispatch 2021-03-10T13:49:36.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:36 gibba015 bash[9806]: audit 2021-03-10T13:49:36.296268+0000 mon.a (mon.0) 662 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93375692, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847333Z\", \"created\": \"2021-03-10T13:38:50.668449Z\", \"started\": \"2021-03-10T13:38:56.060544Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba015\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95776931, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847552Z\", \"created\": \"2021-03-10T13:40:03.296449Z\", \"started\": \"2021-03-10T13:40:03.320843Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48737812, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847608Z\", \"created\": \"2021-03-10T13:40:50.072448Z\", \"started\": \"2021-03-10T13:40:53.142290Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49733959, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847779Z\", \"created\": \"2021-03-10T13:41:11.556448Z\", \"started\": \"2021-03-10T13:41:15.069232Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46493859, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847910Z\", \"created\": \"2021-03-10T13:41:34.244448Z\", \"started\": \"2021-03-10T13:41:37.507096Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46850375, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848034Z\", \"created\": \"2021-03-10T13:41:57.328380Z\", \"started\": \"2021-03-10T13:42:00.781947Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22387097, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848156Z\", \"created\": \"2021-03-10T13:43:44.272379Z\", \"started\": \"2021-03-10T13:43:47.550063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:08.925129Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:23.251574Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:49:10.777874Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:07.001926Z\"}}, \"last_device_update\": \"2021-03-10T13:42:03.853072Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:49:36.287812Z\"}"}]': finished 2021-03-10T13:49:36.479 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:36 gibba015 bash[9806]: audit 2021-03-10T13:49:36.305032+0000 mon.b (mon.2) 106 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:49:36.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:36 gibba015 bash[13005]: audit 2021-03-10T13:49:36.292405+0000 mon.a (mon.0) 661 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93375692, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847333Z\", \"created\": \"2021-03-10T13:38:50.668449Z\", \"started\": \"2021-03-10T13:38:56.060544Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba015\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95776931, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847552Z\", \"created\": \"2021-03-10T13:40:03.296449Z\", \"started\": \"2021-03-10T13:40:03.320843Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48737812, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847608Z\", \"created\": \"2021-03-10T13:40:50.072448Z\", \"started\": \"2021-03-10T13:40:53.142290Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49733959, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847779Z\", \"created\": \"2021-03-10T13:41:11.556448Z\", \"started\": \"2021-03-10T13:41:15.069232Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46493859, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847910Z\", \"created\": \"2021-03-10T13:41:34.244448Z\", \"started\": \"2021-03-10T13:41:37.507096Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46850375, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848034Z\", \"created\": \"2021-03-10T13:41:57.328380Z\", \"started\": \"2021-03-10T13:42:00.781947Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22387097, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848156Z\", \"created\": \"2021-03-10T13:43:44.272379Z\", \"started\": \"2021-03-10T13:43:47.550063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:08.925129Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:23.251574Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:49:10.777874Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:07.001926Z\"}}, \"last_device_update\": \"2021-03-10T13:42:03.853072Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:49:36.287812Z\"}"}]: dispatch 2021-03-10T13:49:36.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:36 gibba015 bash[13005]: audit 2021-03-10T13:49:36.296268+0000 mon.a (mon.0) 662 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93375692, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847333Z\", \"created\": \"2021-03-10T13:38:50.668449Z\", \"started\": \"2021-03-10T13:38:56.060544Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba015\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95776931, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847552Z\", \"created\": \"2021-03-10T13:40:03.296449Z\", \"started\": \"2021-03-10T13:40:03.320843Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48737812, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847608Z\", \"created\": \"2021-03-10T13:40:50.072448Z\", \"started\": \"2021-03-10T13:40:53.142290Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49733959, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847779Z\", \"created\": \"2021-03-10T13:41:11.556448Z\", \"started\": \"2021-03-10T13:41:15.069232Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46493859, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847910Z\", \"created\": \"2021-03-10T13:41:34.244448Z\", \"started\": \"2021-03-10T13:41:37.507096Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46850375, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848034Z\", \"created\": \"2021-03-10T13:41:57.328380Z\", \"started\": \"2021-03-10T13:42:00.781947Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22387097, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848156Z\", \"created\": \"2021-03-10T13:43:44.272379Z\", \"started\": \"2021-03-10T13:43:47.550063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:08.925129Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:23.251574Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:49:10.777874Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:07.001926Z\"}}, \"last_device_update\": \"2021-03-10T13:42:03.853072Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:49:36.287812Z\"}"}]': finished 2021-03-10T13:49:36.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:36 gibba015 bash[13005]: audit 2021-03-10T13:49:36.305032+0000 mon.b (mon.2) 106 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:49:36.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:36 gibba045 bash[9787]: cluster 2021-03-10T13:49:35.004742+0000 mgr.gibba045.orlgmj (mgr.34379) 43 : cluster [DBG] pgmap v22: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:36.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:36 gibba045 bash[9787]: audit 2021-03-10T13:49:36.094489+0000 mon.b (mon.2) 103 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93375692, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847333Z\", \"created\": \"2021-03-10T13:38:50.668449Z\", \"started\": \"2021-03-10T13:38:56.060544Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba015\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95776931, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847552Z\", \"created\": \"2021-03-10T13:40:03.296449Z\", \"started\": \"2021-03-10T13:40:03.320843Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48737812, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847608Z\", \"created\": \"2021-03-10T13:40:50.072448Z\", \"started\": \"2021-03-10T13:40:53.142290Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49733959, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847779Z\", \"created\": \"2021-03-10T13:41:11.556448Z\", \"started\": \"2021-03-10T13:41:15.069232Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46493859, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847910Z\", \"created\": \"2021-03-10T13:41:34.244448Z\", \"started\": \"2021-03-10T13:41:37.507096Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46850375, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848034Z\", \"created\": \"2021-03-10T13:41:57.328380Z\", \"started\": \"2021-03-10T13:42:00.781947Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22387097, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848156Z\", \"created\": \"2021-03-10T13:43:44.272379Z\", \"started\": \"2021-03-10T13:43:47.550063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:08.925129Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:23.251574Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:49:10.777874Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:07.001926Z\"}}, \"last_device_update\": \"2021-03-10T13:42:03.853072Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426Z\"}"}]: dispatch 2021-03-10T13:49:36.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:36 gibba045 bash[9787]: audit 2021-03-10T13:49:36.095173+0000 mon.a (mon.0) 659 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93375692, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847333Z\", \"created\": \"2021-03-10T13:38:50.668449Z\", \"started\": \"2021-03-10T13:38:56.060544Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba015\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95776931, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847552Z\", \"created\": \"2021-03-10T13:40:03.296449Z\", \"started\": \"2021-03-10T13:40:03.320843Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48737812, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847608Z\", \"created\": \"2021-03-10T13:40:50.072448Z\", \"started\": \"2021-03-10T13:40:53.142290Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49733959, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847779Z\", \"created\": \"2021-03-10T13:41:11.556448Z\", \"started\": \"2021-03-10T13:41:15.069232Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46493859, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847910Z\", \"created\": \"2021-03-10T13:41:34.244448Z\", \"started\": \"2021-03-10T13:41:37.507096Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46850375, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848034Z\", \"created\": \"2021-03-10T13:41:57.328380Z\", \"started\": \"2021-03-10T13:42:00.781947Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22387097, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848156Z\", \"created\": \"2021-03-10T13:43:44.272379Z\", \"started\": \"2021-03-10T13:43:47.550063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:08.925129Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:23.251574Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:49:10.777874Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:07.001926Z\"}}, \"last_device_update\": \"2021-03-10T13:42:03.853072Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426Z\"}"}]: dispatch 2021-03-10T13:49:36.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:36 gibba045 bash[9787]: audit 2021-03-10T13:49:36.098928+0000 mon.a (mon.0) 660 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93375692, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847333Z\", \"created\": \"2021-03-10T13:38:50.668449Z\", \"started\": \"2021-03-10T13:38:56.060544Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba015\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95776931, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847552Z\", \"created\": \"2021-03-10T13:40:03.296449Z\", \"started\": \"2021-03-10T13:40:03.320843Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48737812, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847608Z\", \"created\": \"2021-03-10T13:40:50.072448Z\", \"started\": \"2021-03-10T13:40:53.142290Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49733959, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847779Z\", \"created\": \"2021-03-10T13:41:11.556448Z\", \"started\": \"2021-03-10T13:41:15.069232Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46493859, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847910Z\", \"created\": \"2021-03-10T13:41:34.244448Z\", \"started\": \"2021-03-10T13:41:37.507096Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46850375, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848034Z\", \"created\": \"2021-03-10T13:41:57.328380Z\", \"started\": \"2021-03-10T13:42:00.781947Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22387097, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848156Z\", \"created\": \"2021-03-10T13:43:44.272379Z\", \"started\": \"2021-03-10T13:43:47.550063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:08.925129Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:23.251574Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:49:10.777874Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:07.001926Z\"}}, \"last_device_update\": \"2021-03-10T13:42:03.853072Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:39:16.784426Z\"}"}]': finished 2021-03-10T13:49:36.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:36 gibba045 bash[9787]: audit 2021-03-10T13:49:36.104690+0000 mon.b (mon.2) 104 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:49:36.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:36 gibba045 bash[9787]: audit 2021-03-10T13:49:36.291497+0000 mon.b (mon.2) 105 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93375692, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847333Z\", \"created\": \"2021-03-10T13:38:50.668449Z\", \"started\": \"2021-03-10T13:38:56.060544Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba015\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95776931, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847552Z\", \"created\": \"2021-03-10T13:40:03.296449Z\", \"started\": \"2021-03-10T13:40:03.320843Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48737812, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847608Z\", \"created\": \"2021-03-10T13:40:50.072448Z\", \"started\": \"2021-03-10T13:40:53.142290Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49733959, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847779Z\", \"created\": \"2021-03-10T13:41:11.556448Z\", \"started\": \"2021-03-10T13:41:15.069232Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46493859, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847910Z\", \"created\": \"2021-03-10T13:41:34.244448Z\", \"started\": \"2021-03-10T13:41:37.507096Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46850375, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848034Z\", \"created\": \"2021-03-10T13:41:57.328380Z\", \"started\": \"2021-03-10T13:42:00.781947Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22387097, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848156Z\", \"created\": \"2021-03-10T13:43:44.272379Z\", \"started\": \"2021-03-10T13:43:47.550063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:08.925129Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:23.251574Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:49:10.777874Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:07.001926Z\"}}, \"last_device_update\": \"2021-03-10T13:42:03.853072Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:49:36.287812Z\"}"}]: dispatch 2021-03-10T13:49:36.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:36 gibba045 bash[9787]: audit 2021-03-10T13:49:36.292405+0000 mon.a (mon.0) 661 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93375692, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847333Z\", \"created\": \"2021-03-10T13:38:50.668449Z\", \"started\": \"2021-03-10T13:38:56.060544Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba015\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95776931, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847552Z\", \"created\": \"2021-03-10T13:40:03.296449Z\", \"started\": \"2021-03-10T13:40:03.320843Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48737812, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847608Z\", \"created\": \"2021-03-10T13:40:50.072448Z\", \"started\": \"2021-03-10T13:40:53.142290Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49733959, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847779Z\", \"created\": \"2021-03-10T13:41:11.556448Z\", \"started\": \"2021-03-10T13:41:15.069232Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46493859, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847910Z\", \"created\": \"2021-03-10T13:41:34.244448Z\", \"started\": \"2021-03-10T13:41:37.507096Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46850375, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848034Z\", \"created\": \"2021-03-10T13:41:57.328380Z\", \"started\": \"2021-03-10T13:42:00.781947Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22387097, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848156Z\", \"created\": \"2021-03-10T13:43:44.272379Z\", \"started\": \"2021-03-10T13:43:47.550063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:08.925129Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:23.251574Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:49:10.777874Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:07.001926Z\"}}, \"last_device_update\": \"2021-03-10T13:42:03.853072Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:49:36.287812Z\"}"}]: dispatch 2021-03-10T13:49:36.812 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:36 gibba045 bash[9787]: audit 2021-03-10T13:49:36.296268+0000 mon.a (mon.0) 662 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93375692, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847333Z\", \"created\": \"2021-03-10T13:38:50.668449Z\", \"started\": \"2021-03-10T13:38:56.060544Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba015\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95776931, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847552Z\", \"created\": \"2021-03-10T13:40:03.296449Z\", \"started\": \"2021-03-10T13:40:03.320843Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48737812, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847608Z\", \"created\": \"2021-03-10T13:40:50.072448Z\", \"started\": \"2021-03-10T13:40:53.142290Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49733959, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847779Z\", \"created\": \"2021-03-10T13:41:11.556448Z\", \"started\": \"2021-03-10T13:41:15.069232Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46493859, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.847910Z\", \"created\": \"2021-03-10T13:41:34.244448Z\", \"started\": \"2021-03-10T13:41:37.507096Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46850375, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848034Z\", \"created\": \"2021-03-10T13:41:57.328380Z\", \"started\": \"2021-03-10T13:42:00.781947Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 22387097, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:05.848156Z\", \"created\": \"2021-03-10T13:43:44.272379Z\", \"started\": \"2021-03-10T13:43:47.550063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:08.925129Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:23.251574Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:49:10.777874Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:07.001926Z\"}}, \"last_device_update\": \"2021-03-10T13:42:03.853072Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:49:36.287812Z\"}"}]': finished 2021-03-10T13:49:36.812 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:36 gibba045 bash[9787]: audit 2021-03-10T13:49:36.305032+0000 mon.b (mon.2) 106 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:49:37.471 INFO:journalctl@ceph.mgr.y.gibba015.stdout:Mar 10 13:49:37 gibba015 bash[28392]: debug 2021-03-10T13:49:37.187+0000 7f5c685ef700 1 -- 172.21.2.115:0/1343426832 <== mon.0 v2:172.21.2.115:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5650f36484e0 con 0x5650f3739000 2021-03-10T13:49:38.356 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T13:49:38.586 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T13:49:38.586 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 starting - - 2021-03-10T13:49:38.586 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (5m) 31s ago 5m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T13:49:38.587 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (47s) 31s ago 9m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T13:49:38.587 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (64s) 31s ago 9m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T13:49:38.587 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 starting - - 2021-03-10T13:49:38.587 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (10m) 32s ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 d38e67be51e5 2021-03-10T13:49:38.588 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (9m) 31s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 2523bc3385be 2021-03-10T13:49:38.588 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (9m) 32s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 d2d863b7e101 2021-03-10T13:49:38.588 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (5m) 32s ago 5m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T13:49:38.588 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (5m) 31s ago 5m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T13:49:38.588 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (8m) 32s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 1e67f692bb03 2021-03-10T13:49:38.589 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (8m) 32s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 83369fd7640c 2021-03-10T13:49:38.589 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (8m) 32s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b90f9ada390a 2021-03-10T13:49:38.589 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (7m) 32s ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 a77eccf371e5 2021-03-10T13:49:38.589 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (7m) 31s ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 9b9c84c84955 2021-03-10T13:49:38.590 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (6m) 31s ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 662e73261675 2021-03-10T13:49:38.590 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (6m) 31s ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 338d252f22e3 2021-03-10T13:49:38.590 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (6m) 31s ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 784edc0668a4 2021-03-10T13:49:38.590 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (5m) 31s ago 5m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T13:49:38.590 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 31s ago 3m docker.io/ceph/ceph:v15.2.0 2021-03-10T13:49:38.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:38 gibba015 bash[9806]: cluster 2021-03-10T13:49:37.005949+0000 mgr.gibba045.orlgmj (mgr.34379) 44 : cluster [DBG] pgmap v23: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:38.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:38 gibba015 bash[13005]: cluster 2021-03-10T13:49:37.005949+0000 mgr.gibba045.orlgmj (mgr.34379) 44 : cluster [DBG] pgmap v23: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:38.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:38 gibba045 bash[9787]: cluster 2021-03-10T13:49:37.005949+0000 mgr.gibba045.orlgmj (mgr.34379) 44 : cluster [DBG] pgmap v23: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:38.841 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T13:49:38.841 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T13:49:38.841 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3 2021-03-10T13:49:38.842 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T13:49:38.842 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T13:49:38.842 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 1, 2021-03-10T13:49:38.842 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 2 2021-03-10T13:49:38.842 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T13:49:38.843 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T13:49:38.843 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2021-03-10T13:49:38.843 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T13:49:38.843 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T13:49:38.844 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T13:49:38.844 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 12, 2021-03-10T13:49:38.844 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 2 2021-03-10T13:49:38.844 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T13:49:38.844 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T13:49:39.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:39 gibba015 bash[9806]: audit 2021-03-10T13:49:38.345853+0000 mgr.gibba045.orlgmj (mgr.34379) 45 : audit [DBG] from='client.24526 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:49:39.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:39 gibba015 bash[9806]: audit 2021-03-10T13:49:38.839398+0000 mon.a (mon.0) 663 : audit [DBG] from='client.? 172.21.2.115:0/2283147405' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:49:39.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:39 gibba015 bash[13005]: audit 2021-03-10T13:49:38.345853+0000 mgr.gibba045.orlgmj (mgr.34379) 45 : audit [DBG] from='client.24526 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:49:39.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:39 gibba015 bash[13005]: audit 2021-03-10T13:49:38.839398+0000 mon.a (mon.0) 663 : audit [DBG] from='client.? 172.21.2.115:0/2283147405' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:49:39.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:39 gibba045 bash[9787]: audit 2021-03-10T13:49:38.345853+0000 mgr.gibba045.orlgmj (mgr.34379) 45 : audit [DBG] from='client.24526 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:49:39.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:39 gibba045 bash[9787]: audit 2021-03-10T13:49:38.839398+0000 mon.a (mon.0) 663 : audit [DBG] from='client.? 172.21.2.115:0/2283147405' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:49:40.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:40 gibba015 bash[9806]: audit 2021-03-10T13:49:38.573987+0000 mgr.gibba045.orlgmj (mgr.34379) 46 : audit [DBG] from='client.14622 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:49:40.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:40 gibba015 bash[9806]: cluster 2021-03-10T13:49:39.007866+0000 mgr.gibba045.orlgmj (mgr.34379) 47 : cluster [DBG] pgmap v24: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:40.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:40 gibba015 bash[13005]: audit 2021-03-10T13:49:38.573987+0000 mgr.gibba045.orlgmj (mgr.34379) 46 : audit [DBG] from='client.14622 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:49:40.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:40 gibba015 bash[13005]: cluster 2021-03-10T13:49:39.007866+0000 mgr.gibba045.orlgmj (mgr.34379) 47 : cluster [DBG] pgmap v24: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:40.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:40 gibba015 bash[9806]: audit 2021-03-10T13:49:39.961605+0000 mon.b (mon.2) 107 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 100558438, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.955985Z\", \"created\": \"2021-03-10T13:38:50.668449Z\", \"started\": \"2021-03-10T13:38:56.060544Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba015\", \"container_id\": \"fb55e770cd62\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 141977190, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.956513Z\", \"created\": \"2021-03-10T13:38:58.024449Z\", \"started\": \"2021-03-10T13:49:36.120688Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96248791, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.956853Z\", \"created\": \"2021-03-10T13:40:03.296449Z\", \"started\": \"2021-03-10T13:40:03.320843Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48884613, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.957156Z\", \"created\": \"2021-03-10T13:40:50.072448Z\", \"started\": \"2021-03-10T13:40:53.142290Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49702502, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.957867Z\", \"created\": \"2021-03-10T13:41:11.556448Z\", \"started\": \"2021-03-10T13:41:15.069232Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46042972, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.958515Z\", \"created\": \"2021-03-10T13:41:34.244448Z\", \"started\": \"2021-03-10T13:41:37.507096Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47385149, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.959330Z\", \"created\": \"2021-03-10T13:41:57.328380Z\", \"started\": \"2021-03-10T13:42:00.781947Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23330816, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.959992Z\", \"created\": \"2021-03-10T13:43:44.272379Z\", \"started\": \"2021-03-10T13:43:47.550063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"df987682eada\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12603883, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.960332Z\", \"created\": \"2021-03-10T13:43:54.628379Z\", \"started\": \"2021-03-10T13:49:17.528199Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:08.925129Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:23.251574Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:49:10.777874Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:07.001926Z\"}}, \"last_daemon_update\": \"2021-03-10T13:49:39.960665Z\", \"last_device_update\": \"2021-03-10T13:42:03.853072Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:49:36.287812Z\"}"}]: dispatch 2021-03-10T13:49:40.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:40 gibba015 bash[13005]: audit 2021-03-10T13:49:39.961605+0000 mon.b (mon.2) 107 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 100558438, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.955985Z\", \"created\": \"2021-03-10T13:38:50.668449Z\", \"started\": \"2021-03-10T13:38:56.060544Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba015\", \"container_id\": \"fb55e770cd62\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 141977190, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.956513Z\", \"created\": \"2021-03-10T13:38:58.024449Z\", \"started\": \"2021-03-10T13:49:36.120688Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96248791, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.956853Z\", \"created\": \"2021-03-10T13:40:03.296449Z\", \"started\": \"2021-03-10T13:40:03.320843Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48884613, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.957156Z\", \"created\": \"2021-03-10T13:40:50.072448Z\", \"started\": \"2021-03-10T13:40:53.142290Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49702502, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.957867Z\", \"created\": \"2021-03-10T13:41:11.556448Z\", \"started\": \"2021-03-10T13:41:15.069232Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46042972, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.958515Z\", \"created\": \"2021-03-10T13:41:34.244448Z\", \"started\": \"2021-03-10T13:41:37.507096Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47385149, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.959330Z\", \"created\": \"2021-03-10T13:41:57.328380Z\", \"started\": \"2021-03-10T13:42:00.781947Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23330816, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.959992Z\", \"created\": \"2021-03-10T13:43:44.272379Z\", \"started\": \"2021-03-10T13:43:47.550063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"df987682eada\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12603883, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.960332Z\", \"created\": \"2021-03-10T13:43:54.628379Z\", \"started\": \"2021-03-10T13:49:17.528199Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:08.925129Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:23.251574Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:49:10.777874Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:07.001926Z\"}}, \"last_daemon_update\": \"2021-03-10T13:49:39.960665Z\", \"last_device_update\": \"2021-03-10T13:42:03.853072Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:49:36.287812Z\"}"}]: dispatch 2021-03-10T13:49:40.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:40 gibba015 bash[9806]: audit 2021-03-10T13:49:39.961783+0000 mon.a (mon.0) 664 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 100558438, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.955985Z\", \"created\": \"2021-03-10T13:38:50.668449Z\", \"started\": \"2021-03-10T13:38:56.060544Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba015\", \"container_id\": \"fb55e770cd62\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 141977190, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.956513Z\", \"created\": \"2021-03-10T13:38:58.024449Z\", \"started\": \"2021-03-10T13:49:36.120688Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96248791, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.956853Z\", \"created\": \"2021-03-10T13:40:03.296449Z\", \"started\": \"2021-03-10T13:40:03.320843Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48884613, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.957156Z\", \"created\": \"2021-03-10T13:40:50.072448Z\", \"started\": \"2021-03-10T13:40:53.142290Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49702502, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.957867Z\", \"created\": \"2021-03-10T13:41:11.556448Z\", \"started\": \"2021-03-10T13:41:15.069232Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46042972, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.958515Z\", \"created\": \"2021-03-10T13:41:34.244448Z\", \"started\": \"2021-03-10T13:41:37.507096Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47385149, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.959330Z\", \"created\": \"2021-03-10T13:41:57.328380Z\", \"started\": \"2021-03-10T13:42:00.781947Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23330816, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.959992Z\", \"created\": \"2021-03-10T13:43:44.272379Z\", \"started\": \"2021-03-10T13:43:47.550063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"df987682eada\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12603883, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.960332Z\", \"created\": \"2021-03-10T13:43:54.628379Z\", \"started\": \"2021-03-10T13:49:17.528199Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:08.925129Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:23.251574Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:49:10.777874Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:07.001926Z\"}}, \"last_daemon_update\": \"2021-03-10T13:49:39.960665Z\", \"last_device_update\": \"2021-03-10T13:42:03.853072Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:49:36.287812Z\"}"}]: dispatch 2021-03-10T13:49:40.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:40 gibba015 bash[9806]: audit 2021-03-10T13:49:39.965294+0000 mon.a (mon.0) 665 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 100558438, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.955985Z\", \"created\": \"2021-03-10T13:38:50.668449Z\", \"started\": \"2021-03-10T13:38:56.060544Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba015\", \"container_id\": \"fb55e770cd62\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 141977190, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.956513Z\", \"created\": \"2021-03-10T13:38:58.024449Z\", \"started\": \"2021-03-10T13:49:36.120688Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96248791, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.956853Z\", \"created\": \"2021-03-10T13:40:03.296449Z\", \"started\": \"2021-03-10T13:40:03.320843Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48884613, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.957156Z\", \"created\": \"2021-03-10T13:40:50.072448Z\", \"started\": \"2021-03-10T13:40:53.142290Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49702502, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.957867Z\", \"created\": \"2021-03-10T13:41:11.556448Z\", \"started\": \"2021-03-10T13:41:15.069232Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46042972, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.958515Z\", \"created\": \"2021-03-10T13:41:34.244448Z\", \"started\": \"2021-03-10T13:41:37.507096Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47385149, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.959330Z\", \"created\": \"2021-03-10T13:41:57.328380Z\", \"started\": \"2021-03-10T13:42:00.781947Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23330816, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.959992Z\", \"created\": \"2021-03-10T13:43:44.272379Z\", \"started\": \"2021-03-10T13:43:47.550063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"df987682eada\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12603883, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.960332Z\", \"created\": \"2021-03-10T13:43:54.628379Z\", \"started\": \"2021-03-10T13:49:17.528199Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:08.925129Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:23.251574Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:49:10.777874Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:07.001926Z\"}}, \"last_daemon_update\": \"2021-03-10T13:49:39.960665Z\", \"last_device_update\": \"2021-03-10T13:42:03.853072Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:49:36.287812Z\"}"}]': finished 2021-03-10T13:49:40.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:40 gibba015 bash[9806]: audit 2021-03-10T13:49:39.967483+0000 mon.a (mon.0) 666 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T13:49:40.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:40 gibba015 bash[9806]: audit 2021-03-10T13:49:39.967557+0000 mon.b (mon.2) 108 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T13:49:40.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:40 gibba015 bash[9806]: audit 2021-03-10T13:49:39.969791+0000 mon.a (mon.0) 667 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2021-03-10T13:49:40.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:40 gibba015 bash[9806]: audit 2021-03-10T13:49:39.975388+0000 mon.b (mon.2) 109 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:49:40.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:40 gibba015 bash[9806]: audit 2021-03-10T13:49:39.976542+0000 mon.b (mon.2) 110 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:49:40.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:40 gibba015 bash[13005]: audit 2021-03-10T13:49:39.961783+0000 mon.a (mon.0) 664 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 100558438, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.955985Z\", \"created\": \"2021-03-10T13:38:50.668449Z\", \"started\": \"2021-03-10T13:38:56.060544Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba015\", \"container_id\": \"fb55e770cd62\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 141977190, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.956513Z\", \"created\": \"2021-03-10T13:38:58.024449Z\", \"started\": \"2021-03-10T13:49:36.120688Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96248791, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.956853Z\", \"created\": \"2021-03-10T13:40:03.296449Z\", \"started\": \"2021-03-10T13:40:03.320843Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48884613, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.957156Z\", \"created\": \"2021-03-10T13:40:50.072448Z\", \"started\": \"2021-03-10T13:40:53.142290Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49702502, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.957867Z\", \"created\": \"2021-03-10T13:41:11.556448Z\", \"started\": \"2021-03-10T13:41:15.069232Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46042972, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.958515Z\", \"created\": \"2021-03-10T13:41:34.244448Z\", \"started\": \"2021-03-10T13:41:37.507096Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47385149, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.959330Z\", \"created\": \"2021-03-10T13:41:57.328380Z\", \"started\": \"2021-03-10T13:42:00.781947Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23330816, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.959992Z\", \"created\": \"2021-03-10T13:43:44.272379Z\", \"started\": \"2021-03-10T13:43:47.550063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"df987682eada\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12603883, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.960332Z\", \"created\": \"2021-03-10T13:43:54.628379Z\", \"started\": \"2021-03-10T13:49:17.528199Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:08.925129Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:23.251574Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:49:10.777874Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:07.001926Z\"}}, \"last_daemon_update\": \"2021-03-10T13:49:39.960665Z\", \"last_device_update\": \"2021-03-10T13:42:03.853072Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:49:36.287812Z\"}"}]: dispatch 2021-03-10T13:49:40.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:40 gibba015 bash[13005]: audit 2021-03-10T13:49:39.965294+0000 mon.a (mon.0) 665 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 100558438, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.955985Z\", \"created\": \"2021-03-10T13:38:50.668449Z\", \"started\": \"2021-03-10T13:38:56.060544Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba015\", \"container_id\": \"fb55e770cd62\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 141977190, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.956513Z\", \"created\": \"2021-03-10T13:38:58.024449Z\", \"started\": \"2021-03-10T13:49:36.120688Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96248791, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.956853Z\", \"created\": \"2021-03-10T13:40:03.296449Z\", \"started\": \"2021-03-10T13:40:03.320843Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48884613, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.957156Z\", \"created\": \"2021-03-10T13:40:50.072448Z\", \"started\": \"2021-03-10T13:40:53.142290Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49702502, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.957867Z\", \"created\": \"2021-03-10T13:41:11.556448Z\", \"started\": \"2021-03-10T13:41:15.069232Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46042972, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.958515Z\", \"created\": \"2021-03-10T13:41:34.244448Z\", \"started\": \"2021-03-10T13:41:37.507096Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47385149, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.959330Z\", \"created\": \"2021-03-10T13:41:57.328380Z\", \"started\": \"2021-03-10T13:42:00.781947Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23330816, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.959992Z\", \"created\": \"2021-03-10T13:43:44.272379Z\", \"started\": \"2021-03-10T13:43:47.550063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"df987682eada\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12603883, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.960332Z\", \"created\": \"2021-03-10T13:43:54.628379Z\", \"started\": \"2021-03-10T13:49:17.528199Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:08.925129Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:23.251574Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:49:10.777874Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:07.001926Z\"}}, \"last_daemon_update\": \"2021-03-10T13:49:39.960665Z\", \"last_device_update\": \"2021-03-10T13:42:03.853072Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:49:36.287812Z\"}"}]': finished 2021-03-10T13:49:40.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:40 gibba015 bash[13005]: audit 2021-03-10T13:49:39.967483+0000 mon.a (mon.0) 666 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T13:49:40.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:40 gibba015 bash[13005]: audit 2021-03-10T13:49:39.967557+0000 mon.b (mon.2) 108 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T13:49:40.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:40 gibba015 bash[13005]: audit 2021-03-10T13:49:39.969791+0000 mon.a (mon.0) 667 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2021-03-10T13:49:40.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:40 gibba015 bash[13005]: audit 2021-03-10T13:49:39.975388+0000 mon.b (mon.2) 109 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:49:40.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:40 gibba015 bash[13005]: audit 2021-03-10T13:49:39.976542+0000 mon.b (mon.2) 110 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:49:40.480 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:40 gibba015 bash[9806]: audit 2021-03-10T13:49:39.977444+0000 mon.a (mon.0) 668 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr"}]: dispatch 2021-03-10T13:49:40.480 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:40 gibba015 bash[9806]: audit 2021-03-10T13:49:39.977544+0000 mon.b (mon.2) 111 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr"}]: dispatch 2021-03-10T13:49:40.480 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:40 gibba015 bash[9806]: audit 2021-03-10T13:49:39.980516+0000 mon.a (mon.0) 669 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr"}]': finished 2021-03-10T13:49:40.480 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:40 gibba015 bash[9806]: audit 2021-03-10T13:49:39.982269+0000 mon.a (mon.0) 670 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.gibba045.orlgmj"}]: dispatch 2021-03-10T13:49:40.481 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:40 gibba015 bash[9806]: audit 2021-03-10T13:49:39.982298+0000 mon.b (mon.2) 112 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.gibba045.orlgmj"}]: dispatch 2021-03-10T13:49:40.481 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:40 gibba015 bash[9806]: audit 2021-03-10T13:49:39.985218+0000 mon.a (mon.0) 671 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.gibba045.orlgmj"}]': finished 2021-03-10T13:49:40.481 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:40 gibba015 bash[9806]: audit 2021-03-10T13:49:39.987035+0000 mon.a (mon.0) 672 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2021-03-10T13:49:40.481 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:40 gibba015 bash[9806]: audit 2021-03-10T13:49:39.987099+0000 mon.b (mon.2) 113 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2021-03-10T13:49:40.482 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:40 gibba015 bash[9806]: audit 2021-03-10T13:49:39.990120+0000 mon.a (mon.0) 673 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]': finished 2021-03-10T13:49:40.482 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:40 gibba015 bash[9806]: audit 2021-03-10T13:49:39.992023+0000 mon.a (mon.0) 674 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2021-03-10T13:49:40.482 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:40 gibba015 bash[9806]: audit 2021-03-10T13:49:39.992151+0000 mon.b (mon.2) 114 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2021-03-10T13:49:40.482 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:40 gibba015 bash[9806]: audit 2021-03-10T13:49:39.994994+0000 mon.a (mon.0) 675 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2021-03-10T13:49:40.483 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:40 gibba015 bash[9806]: audit 2021-03-10T13:49:39.997770+0000 mon.b (mon.2) 115 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2021-03-10T13:49:40.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:40 gibba015 bash[13005]: audit 2021-03-10T13:49:39.977444+0000 mon.a (mon.0) 668 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr"}]: dispatch 2021-03-10T13:49:40.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:40 gibba015 bash[13005]: audit 2021-03-10T13:49:39.977544+0000 mon.b (mon.2) 111 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr"}]: dispatch 2021-03-10T13:49:40.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:40 gibba015 bash[13005]: audit 2021-03-10T13:49:39.980516+0000 mon.a (mon.0) 669 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr"}]': finished 2021-03-10T13:49:40.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:40 gibba015 bash[13005]: audit 2021-03-10T13:49:39.982269+0000 mon.a (mon.0) 670 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.gibba045.orlgmj"}]: dispatch 2021-03-10T13:49:40.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:40 gibba015 bash[13005]: audit 2021-03-10T13:49:39.982298+0000 mon.b (mon.2) 112 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.gibba045.orlgmj"}]: dispatch 2021-03-10T13:49:40.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:40 gibba015 bash[13005]: audit 2021-03-10T13:49:39.985218+0000 mon.a (mon.0) 671 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.gibba045.orlgmj"}]': finished 2021-03-10T13:49:40.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:40 gibba015 bash[13005]: audit 2021-03-10T13:49:39.987035+0000 mon.a (mon.0) 672 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2021-03-10T13:49:40.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:40 gibba015 bash[13005]: audit 2021-03-10T13:49:39.987099+0000 mon.b (mon.2) 113 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2021-03-10T13:49:40.485 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:40 gibba015 bash[13005]: audit 2021-03-10T13:49:39.990120+0000 mon.a (mon.0) 673 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]': finished 2021-03-10T13:49:40.485 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:40 gibba015 bash[13005]: audit 2021-03-10T13:49:39.992023+0000 mon.a (mon.0) 674 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2021-03-10T13:49:40.485 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:40 gibba015 bash[13005]: audit 2021-03-10T13:49:39.992151+0000 mon.b (mon.2) 114 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2021-03-10T13:49:40.485 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:40 gibba015 bash[13005]: audit 2021-03-10T13:49:39.994994+0000 mon.a (mon.0) 675 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2021-03-10T13:49:40.485 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:40 gibba015 bash[13005]: audit 2021-03-10T13:49:39.997770+0000 mon.b (mon.2) 115 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2021-03-10T13:49:40.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:40 gibba045 bash[9787]: audit 2021-03-10T13:49:38.573987+0000 mgr.gibba045.orlgmj (mgr.34379) 46 : audit [DBG] from='client.14622 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:49:40.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:40 gibba045 bash[9787]: cluster 2021-03-10T13:49:39.007866+0000 mgr.gibba045.orlgmj (mgr.34379) 47 : cluster [DBG] pgmap v24: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:40.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:40 gibba045 bash[9787]: audit 2021-03-10T13:49:39.961605+0000 mon.b (mon.2) 107 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 100558438, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.955985Z\", \"created\": \"2021-03-10T13:38:50.668449Z\", \"started\": \"2021-03-10T13:38:56.060544Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba015\", \"container_id\": \"fb55e770cd62\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 141977190, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.956513Z\", \"created\": \"2021-03-10T13:38:58.024449Z\", \"started\": \"2021-03-10T13:49:36.120688Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96248791, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.956853Z\", \"created\": \"2021-03-10T13:40:03.296449Z\", \"started\": \"2021-03-10T13:40:03.320843Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48884613, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.957156Z\", \"created\": \"2021-03-10T13:40:50.072448Z\", \"started\": \"2021-03-10T13:40:53.142290Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49702502, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.957867Z\", \"created\": \"2021-03-10T13:41:11.556448Z\", \"started\": \"2021-03-10T13:41:15.069232Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46042972, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.958515Z\", \"created\": \"2021-03-10T13:41:34.244448Z\", \"started\": \"2021-03-10T13:41:37.507096Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47385149, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.959330Z\", \"created\": \"2021-03-10T13:41:57.328380Z\", \"started\": \"2021-03-10T13:42:00.781947Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23330816, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.959992Z\", \"created\": \"2021-03-10T13:43:44.272379Z\", \"started\": \"2021-03-10T13:43:47.550063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"df987682eada\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12603883, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.960332Z\", \"created\": \"2021-03-10T13:43:54.628379Z\", \"started\": \"2021-03-10T13:49:17.528199Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:08.925129Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:23.251574Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:49:10.777874Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:07.001926Z\"}}, \"last_daemon_update\": \"2021-03-10T13:49:39.960665Z\", \"last_device_update\": \"2021-03-10T13:42:03.853072Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:49:36.287812Z\"}"}]: dispatch 2021-03-10T13:49:40.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:40 gibba045 bash[9787]: audit 2021-03-10T13:49:39.961783+0000 mon.a (mon.0) 664 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 100558438, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.955985Z\", \"created\": \"2021-03-10T13:38:50.668449Z\", \"started\": \"2021-03-10T13:38:56.060544Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba015\", \"container_id\": \"fb55e770cd62\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 141977190, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.956513Z\", \"created\": \"2021-03-10T13:38:58.024449Z\", \"started\": \"2021-03-10T13:49:36.120688Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96248791, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.956853Z\", \"created\": \"2021-03-10T13:40:03.296449Z\", \"started\": \"2021-03-10T13:40:03.320843Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48884613, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.957156Z\", \"created\": \"2021-03-10T13:40:50.072448Z\", \"started\": \"2021-03-10T13:40:53.142290Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49702502, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.957867Z\", \"created\": \"2021-03-10T13:41:11.556448Z\", \"started\": \"2021-03-10T13:41:15.069232Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46042972, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.958515Z\", \"created\": \"2021-03-10T13:41:34.244448Z\", \"started\": \"2021-03-10T13:41:37.507096Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47385149, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.959330Z\", \"created\": \"2021-03-10T13:41:57.328380Z\", \"started\": \"2021-03-10T13:42:00.781947Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23330816, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.959992Z\", \"created\": \"2021-03-10T13:43:44.272379Z\", \"started\": \"2021-03-10T13:43:47.550063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"df987682eada\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12603883, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.960332Z\", \"created\": \"2021-03-10T13:43:54.628379Z\", \"started\": \"2021-03-10T13:49:17.528199Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:08.925129Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:23.251574Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:49:10.777874Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:07.001926Z\"}}, \"last_daemon_update\": \"2021-03-10T13:49:39.960665Z\", \"last_device_update\": \"2021-03-10T13:42:03.853072Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:49:36.287812Z\"}"}]: dispatch 2021-03-10T13:49:40.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:40 gibba045 bash[9787]: audit 2021-03-10T13:49:39.965294+0000 mon.a (mon.0) 665 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"d38e67be51e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 100558438, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.955985Z\", \"created\": \"2021-03-10T13:38:50.668449Z\", \"started\": \"2021-03-10T13:38:56.060544Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba015\", \"container_id\": \"fb55e770cd62\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 141977190, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.956513Z\", \"created\": \"2021-03-10T13:38:58.024449Z\", \"started\": \"2021-03-10T13:49:36.120688Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96248791, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.956853Z\", \"created\": \"2021-03-10T13:40:03.296449Z\", \"started\": \"2021-03-10T13:40:03.320843Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48884613, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.957156Z\", \"created\": \"2021-03-10T13:40:50.072448Z\", \"started\": \"2021-03-10T13:40:53.142290Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49702502, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.957867Z\", \"created\": \"2021-03-10T13:41:11.556448Z\", \"started\": \"2021-03-10T13:41:15.069232Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46042972, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.958515Z\", \"created\": \"2021-03-10T13:41:34.244448Z\", \"started\": \"2021-03-10T13:41:37.507096Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47385149, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.959330Z\", \"created\": \"2021-03-10T13:41:57.328380Z\", \"started\": \"2021-03-10T13:42:00.781947Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23330816, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.959992Z\", \"created\": \"2021-03-10T13:43:44.272379Z\", \"started\": \"2021-03-10T13:43:47.550063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"df987682eada\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12603883, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.960332Z\", \"created\": \"2021-03-10T13:43:54.628379Z\", \"started\": \"2021-03-10T13:49:17.528199Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:08.925129Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:23.251574Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:49:10.777874Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:07.001926Z\"}}, \"last_daemon_update\": \"2021-03-10T13:49:39.960665Z\", \"last_device_update\": \"2021-03-10T13:42:03.853072Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:49:36.287812Z\"}"}]': finished 2021-03-10T13:49:40.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:40 gibba045 bash[9787]: audit 2021-03-10T13:49:39.967483+0000 mon.a (mon.0) 666 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T13:49:40.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:40 gibba045 bash[9787]: audit 2021-03-10T13:49:39.967557+0000 mon.b (mon.2) 108 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T13:49:40.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:40 gibba045 bash[9787]: audit 2021-03-10T13:49:39.969791+0000 mon.a (mon.0) 667 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2021-03-10T13:49:40.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:40 gibba045 bash[9787]: audit 2021-03-10T13:49:39.975388+0000 mon.b (mon.2) 109 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:49:40.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:40 gibba045 bash[9787]: audit 2021-03-10T13:49:39.976542+0000 mon.b (mon.2) 110 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:49:40.812 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:40 gibba045 bash[9787]: audit 2021-03-10T13:49:39.977444+0000 mon.a (mon.0) 668 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr"}]: dispatch 2021-03-10T13:49:40.812 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:40 gibba045 bash[9787]: audit 2021-03-10T13:49:39.977544+0000 mon.b (mon.2) 111 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr"}]: dispatch 2021-03-10T13:49:40.812 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:40 gibba045 bash[9787]: audit 2021-03-10T13:49:39.980516+0000 mon.a (mon.0) 669 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr"}]': finished 2021-03-10T13:49:40.812 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:40 gibba045 bash[9787]: audit 2021-03-10T13:49:39.982269+0000 mon.a (mon.0) 670 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.gibba045.orlgmj"}]: dispatch 2021-03-10T13:49:40.812 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:40 gibba045 bash[9787]: audit 2021-03-10T13:49:39.982298+0000 mon.b (mon.2) 112 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.gibba045.orlgmj"}]: dispatch 2021-03-10T13:49:40.813 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:40 gibba045 bash[9787]: audit 2021-03-10T13:49:39.985218+0000 mon.a (mon.0) 671 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.gibba045.orlgmj"}]': finished 2021-03-10T13:49:40.813 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:40 gibba045 bash[9787]: audit 2021-03-10T13:49:39.987035+0000 mon.a (mon.0) 672 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2021-03-10T13:49:40.813 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:40 gibba045 bash[9787]: audit 2021-03-10T13:49:39.987099+0000 mon.b (mon.2) 113 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2021-03-10T13:49:40.813 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:40 gibba045 bash[9787]: audit 2021-03-10T13:49:39.990120+0000 mon.a (mon.0) 673 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]': finished 2021-03-10T13:49:40.813 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:40 gibba045 bash[9787]: audit 2021-03-10T13:49:39.992023+0000 mon.a (mon.0) 674 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2021-03-10T13:49:40.814 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:40 gibba045 bash[9787]: audit 2021-03-10T13:49:39.992151+0000 mon.b (mon.2) 114 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2021-03-10T13:49:40.814 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:40 gibba045 bash[9787]: audit 2021-03-10T13:49:39.994994+0000 mon.a (mon.0) 675 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2021-03-10T13:49:40.814 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:40 gibba045 bash[9787]: audit 2021-03-10T13:49:39.997770+0000 mon.b (mon.2) 115 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2021-03-10T13:49:41.602 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:41 gibba015 bash[9806]: cephadm 2021-03-10T13:49:39.974744+0000 mgr.gibba045.orlgmj (mgr.34379) 48 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:49:41.602 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:41 gibba015 bash[9806]: cephadm 2021-03-10T13:49:39.976251+0000 mgr.gibba045.orlgmj (mgr.34379) 49 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:49:41.602 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:41 gibba015 bash[9806]: cephadm 2021-03-10T13:49:39.977293+0000 mgr.gibba045.orlgmj (mgr.34379) 50 : cephadm [WRN] Upgrade: 1 mgr daemon(s) are 15.2.0 != target 17.0.0-1749-gb26fc080 2021-03-10T13:49:41.603 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:41 gibba015 bash[9806]: cephadm 2021-03-10T13:49:39.977347+0000 mgr.gibba045.orlgmj (mgr.34379) 51 : cephadm [INF] Upgrade: Setting container_image for all mgr 2021-03-10T13:49:41.603 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:41 gibba015 bash[9806]: cephadm 2021-03-10T13:49:39.997284+0000 mgr.gibba045.orlgmj (mgr.34379) 52 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:49:41.603 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:41 gibba015 bash[9806]: cephadm 2021-03-10T13:49:39.997361+0000 mgr.gibba045.orlgmj (mgr.34379) 53 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:49:41.603 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:41 gibba015 bash[9806]: cephadm 2021-03-10T13:49:39.998441+0000 mgr.gibba045.orlgmj (mgr.34379) 54 : cephadm [INF] It is presumed safe to stop mon.a 2021-03-10T13:49:41.604 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:41 gibba015 bash[9806]: cephadm 2021-03-10T13:49:39.998540+0000 mgr.gibba045.orlgmj (mgr.34379) 55 : cephadm [INF] Upgrade: It is presumed safe to stop mon.a 2021-03-10T13:49:41.604 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:41 gibba015 bash[9806]: cluster 2021-03-10T13:49:41.214227+0000 mon.a (mon.0) 676 : cluster [DBG] Standby manager daemon y restarted 2021-03-10T13:49:41.604 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:41 gibba015 bash[9806]: cluster 2021-03-10T13:49:41.214336+0000 mon.a (mon.0) 677 : cluster [DBG] Standby manager daemon y started 2021-03-10T13:49:41.604 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:41 gibba015 bash[9806]: audit 2021-03-10T13:49:41.215659+0000 mon.a (mon.0) 678 : audit [DBG] from='mgr.? 172.21.2.115:0/1562513679' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:49:41.604 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:41 gibba015 bash[9806]: audit 2021-03-10T13:49:41.216655+0000 mon.a (mon.0) 679 : audit [DBG] from='mgr.? 172.21.2.115:0/1562513679' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:49:41.605 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:41 gibba015 bash[13005]: cephadm 2021-03-10T13:49:39.974744+0000 mgr.gibba045.orlgmj (mgr.34379) 48 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:49:41.605 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:41 gibba015 bash[13005]: cephadm 2021-03-10T13:49:39.976251+0000 mgr.gibba045.orlgmj (mgr.34379) 49 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:49:41.605 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:41 gibba015 bash[13005]: cephadm 2021-03-10T13:49:39.977293+0000 mgr.gibba045.orlgmj (mgr.34379) 50 : cephadm [WRN] Upgrade: 1 mgr daemon(s) are 15.2.0 != target 17.0.0-1749-gb26fc080 2021-03-10T13:49:41.605 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:41 gibba015 bash[13005]: cephadm 2021-03-10T13:49:39.977347+0000 mgr.gibba045.orlgmj (mgr.34379) 51 : cephadm [INF] Upgrade: Setting container_image for all mgr 2021-03-10T13:49:41.606 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:41 gibba015 bash[13005]: cephadm 2021-03-10T13:49:39.997284+0000 mgr.gibba045.orlgmj (mgr.34379) 52 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:49:41.606 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:41 gibba015 bash[13005]: cephadm 2021-03-10T13:49:39.997361+0000 mgr.gibba045.orlgmj (mgr.34379) 53 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:49:41.606 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:41 gibba015 bash[13005]: cephadm 2021-03-10T13:49:39.998441+0000 mgr.gibba045.orlgmj (mgr.34379) 54 : cephadm [INF] It is presumed safe to stop mon.a 2021-03-10T13:49:41.606 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:41 gibba015 bash[13005]: cephadm 2021-03-10T13:49:39.998540+0000 mgr.gibba045.orlgmj (mgr.34379) 55 : cephadm [INF] Upgrade: It is presumed safe to stop mon.a 2021-03-10T13:49:41.606 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:41 gibba015 bash[13005]: cluster 2021-03-10T13:49:41.214227+0000 mon.a (mon.0) 676 : cluster [DBG] Standby manager daemon y restarted 2021-03-10T13:49:41.607 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:41 gibba015 bash[13005]: cluster 2021-03-10T13:49:41.214336+0000 mon.a (mon.0) 677 : cluster [DBG] Standby manager daemon y started 2021-03-10T13:49:41.607 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:41 gibba015 bash[13005]: audit 2021-03-10T13:49:41.215659+0000 mon.a (mon.0) 678 : audit [DBG] from='mgr.? 172.21.2.115:0/1562513679' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:49:41.607 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:41 gibba015 bash[13005]: audit 2021-03-10T13:49:41.216655+0000 mon.a (mon.0) 679 : audit [DBG] from='mgr.? 172.21.2.115:0/1562513679' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:49:41.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:41 gibba045 bash[9787]: cephadm 2021-03-10T13:49:39.974744+0000 mgr.gibba045.orlgmj (mgr.34379) 48 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:49:41.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:41 gibba045 bash[9787]: cephadm 2021-03-10T13:49:39.976251+0000 mgr.gibba045.orlgmj (mgr.34379) 49 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:49:41.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:41 gibba045 bash[9787]: cephadm 2021-03-10T13:49:39.977293+0000 mgr.gibba045.orlgmj (mgr.34379) 50 : cephadm [WRN] Upgrade: 1 mgr daemon(s) are 15.2.0 != target 17.0.0-1749-gb26fc080 2021-03-10T13:49:41.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:41 gibba045 bash[9787]: cephadm 2021-03-10T13:49:39.977347+0000 mgr.gibba045.orlgmj (mgr.34379) 51 : cephadm [INF] Upgrade: Setting container_image for all mgr 2021-03-10T13:49:41.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:41 gibba045 bash[9787]: cephadm 2021-03-10T13:49:39.997284+0000 mgr.gibba045.orlgmj (mgr.34379) 52 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:49:41.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:41 gibba045 bash[9787]: cephadm 2021-03-10T13:49:39.997361+0000 mgr.gibba045.orlgmj (mgr.34379) 53 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:49:41.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:41 gibba045 bash[9787]: cephadm 2021-03-10T13:49:39.998441+0000 mgr.gibba045.orlgmj (mgr.34379) 54 : cephadm [INF] It is presumed safe to stop mon.a 2021-03-10T13:49:41.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:41 gibba045 bash[9787]: cephadm 2021-03-10T13:49:39.998540+0000 mgr.gibba045.orlgmj (mgr.34379) 55 : cephadm [INF] Upgrade: It is presumed safe to stop mon.a 2021-03-10T13:49:41.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:41 gibba045 bash[9787]: cluster 2021-03-10T13:49:41.214227+0000 mon.a (mon.0) 676 : cluster [DBG] Standby manager daemon y restarted 2021-03-10T13:49:41.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:41 gibba045 bash[9787]: cluster 2021-03-10T13:49:41.214336+0000 mon.a (mon.0) 677 : cluster [DBG] Standby manager daemon y started 2021-03-10T13:49:41.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:41 gibba045 bash[9787]: audit 2021-03-10T13:49:41.215659+0000 mon.a (mon.0) 678 : audit [DBG] from='mgr.? 172.21.2.115:0/1562513679' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:49:41.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:41 gibba045 bash[9787]: audit 2021-03-10T13:49:41.216655+0000 mon.a (mon.0) 679 : audit [DBG] from='mgr.? 172.21.2.115:0/1562513679' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:49:42.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:42 gibba015 bash[9806]: cluster 2021-03-10T13:49:41.008983+0000 mgr.gibba045.orlgmj (mgr.34379) 56 : cluster [DBG] pgmap v25: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:42.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:42 gibba015 bash[9806]: cluster 2021-03-10T13:49:41.363124+0000 mon.a (mon.0) 680 : cluster [DBG] mgrmap e21: gibba045.orlgmj(active, since 46s), standbys: y, x 2021-03-10T13:49:42.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:42 gibba015 bash[9806]: audit 2021-03-10T13:49:42.137089+0000 mon.b (mon.2) 116 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mon.a"}]: dispatch 2021-03-10T13:49:42.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:42 gibba015 bash[9806]: audit 2021-03-10T13:49:42.137232+0000 mon.a (mon.0) 681 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mon.a"}]: dispatch 2021-03-10T13:49:42.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:42 gibba015 bash[9806]: audit 2021-03-10T13:49:42.140761+0000 mon.a (mon.0) 682 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mon.a"}]': finished 2021-03-10T13:49:42.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:42 gibba015 bash[9806]: audit 2021-03-10T13:49:42.142200+0000 mon.b (mon.2) 117 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:49:42.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:42 gibba015 bash[9806]: audit 2021-03-10T13:49:42.142964+0000 mon.b (mon.2) 118 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:49:42.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:42 gibba015 bash[9806]: audit 2021-03-10T13:49:42.143678+0000 mon.b (mon.2) 119 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:49:42.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:42 gibba015 bash[9806]: audit 2021-03-10T13:49:42.144641+0000 mon.b (mon.2) 120 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2021-03-10T13:49:42.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:42 gibba015 bash[13005]: cluster 2021-03-10T13:49:41.008983+0000 mgr.gibba045.orlgmj (mgr.34379) 56 : cluster [DBG] pgmap v25: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:42.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:42 gibba015 bash[13005]: cluster 2021-03-10T13:49:41.363124+0000 mon.a (mon.0) 680 : cluster [DBG] mgrmap e21: gibba045.orlgmj(active, since 46s), standbys: y, x 2021-03-10T13:49:42.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:42 gibba015 bash[13005]: audit 2021-03-10T13:49:42.137089+0000 mon.b (mon.2) 116 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mon.a"}]: dispatch 2021-03-10T13:49:42.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:42 gibba015 bash[13005]: audit 2021-03-10T13:49:42.137232+0000 mon.a (mon.0) 681 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mon.a"}]: dispatch 2021-03-10T13:49:42.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:42 gibba015 bash[13005]: audit 2021-03-10T13:49:42.140761+0000 mon.a (mon.0) 682 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mon.a"}]': finished 2021-03-10T13:49:42.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:42 gibba015 bash[13005]: audit 2021-03-10T13:49:42.142200+0000 mon.b (mon.2) 117 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:49:42.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:42 gibba015 bash[13005]: audit 2021-03-10T13:49:42.142964+0000 mon.b (mon.2) 118 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:49:42.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:42 gibba015 bash[13005]: audit 2021-03-10T13:49:42.143678+0000 mon.b (mon.2) 119 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:49:42.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:42 gibba015 bash[13005]: audit 2021-03-10T13:49:42.144641+0000 mon.b (mon.2) 120 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2021-03-10T13:49:42.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:42 gibba045 bash[9787]: cluster 2021-03-10T13:49:41.008983+0000 mgr.gibba045.orlgmj (mgr.34379) 56 : cluster [DBG] pgmap v25: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:42.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:42 gibba045 bash[9787]: cluster 2021-03-10T13:49:41.363124+0000 mon.a (mon.0) 680 : cluster [DBG] mgrmap e21: gibba045.orlgmj(active, since 46s), standbys: y, x 2021-03-10T13:49:42.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:42 gibba045 bash[9787]: audit 2021-03-10T13:49:42.137089+0000 mon.b (mon.2) 116 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mon.a"}]: dispatch 2021-03-10T13:49:42.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:42 gibba045 bash[9787]: audit 2021-03-10T13:49:42.137232+0000 mon.a (mon.0) 681 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mon.a"}]: dispatch 2021-03-10T13:49:42.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:42 gibba045 bash[9787]: audit 2021-03-10T13:49:42.140761+0000 mon.a (mon.0) 682 : audit [INF] from='mgr.34379 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mon.a"}]': finished 2021-03-10T13:49:42.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:42 gibba045 bash[9787]: audit 2021-03-10T13:49:42.142200+0000 mon.b (mon.2) 117 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:49:42.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:42 gibba045 bash[9787]: audit 2021-03-10T13:49:42.142964+0000 mon.b (mon.2) 118 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:49:42.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:42 gibba045 bash[9787]: audit 2021-03-10T13:49:42.143678+0000 mon.b (mon.2) 119 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:49:42.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:42 gibba045 bash[9787]: audit 2021-03-10T13:49:42.144641+0000 mon.b (mon.2) 120 : audit [DBG] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2021-03-10T13:49:43.518 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:43 gibba015 bash[9806]: cephadm 2021-03-10T13:49:42.136737+0000 mgr.gibba045.orlgmj (mgr.34379) 57 : cephadm [INF] Upgrade: Updating mon.a 2021-03-10T13:49:43.519 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:43 gibba015 bash[9806]: cephadm 2021-03-10T13:49:42.144351+0000 mgr.gibba045.orlgmj (mgr.34379) 58 : cephadm [INF] Deploying daemon mon.a on gibba015 2021-03-10T13:49:43.519 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:43 gibba015 bash[13005]: cephadm 2021-03-10T13:49:42.136737+0000 mgr.gibba045.orlgmj (mgr.34379) 57 : cephadm [INF] Upgrade: Updating mon.a 2021-03-10T13:49:43.519 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:43 gibba015 bash[13005]: cephadm 2021-03-10T13:49:42.144351+0000 mgr.gibba045.orlgmj (mgr.34379) 58 : cephadm [INF] Deploying daemon mon.a on gibba015 2021-03-10T13:49:43.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:43 gibba045 bash[9787]: cephadm 2021-03-10T13:49:42.136737+0000 mgr.gibba045.orlgmj (mgr.34379) 57 : cephadm [INF] Upgrade: Updating mon.a 2021-03-10T13:49:43.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:43 gibba045 bash[9787]: cephadm 2021-03-10T13:49:42.144351+0000 mgr.gibba045.orlgmj (mgr.34379) 58 : cephadm [INF] Deploying daemon mon.a on gibba015 2021-03-10T13:49:44.443 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:44 gibba015 systemd[1]: Stopping Ceph mon.a for e4a642d2-81a5-11eb-9080-001a4aab830c... 2021-03-10T13:49:44.443 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:44 gibba015 bash[9806]: debug 2021-03-10T13:49:44.171+0000 7f13d39b9700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2021-03-10T13:49:44.443 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:44 gibba015 bash[9806]: debug 2021-03-10T13:49:44.171+0000 7f13d39b9700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2021-03-10T13:49:45.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:45 gibba015 docker[29286]: ceph-e4a642d2-81a5-11eb-9080-001a4aab830c-mon.a 2021-03-10T13:49:45.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:45 gibba015 systemd[1]: ceph-e4a642d2-81a5-11eb-9080-001a4aab830c@mon.a.service: Succeeded. 2021-03-10T13:49:45.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:45 gibba015 systemd[1]: Stopped Ceph mon.a for e4a642d2-81a5-11eb-9080-001a4aab830c. 2021-03-10T13:49:45.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:45 gibba015 systemd[1]: Started Ceph mon.a for e4a642d2-81a5-11eb-9080-001a4aab830c. 2021-03-10T13:49:46.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.275+0000 7f21d2d32700 0 set uid:gid to 167:167 (ceph:ceph) 2021-03-10T13:49:46.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.275+0000 7f21d2d32700 0 ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev), process ceph-mon, pid 6 2021-03-10T13:49:46.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.275+0000 7f21d2d32700 0 pidfile_write: ignore empty --pid-file 2021-03-10T13:49:46.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.279+0000 7f21d2d32700 0 load: jerasure load: lrc load: isa 2021-03-10T13:49:46.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: RocksDB version: 6.8.1 2021-03-10T13:49:46.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2021-03-10T13:49:46.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Compile date Mar 9 2021 2021-03-10T13:49:46.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: DB SUMMARY 2021-03-10T13:49:46.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: CURRENT file: CURRENT 2021-03-10T13:49:46.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: IDENTITY file: IDENTITY 2021-03-10T13:49:46.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: MANIFEST file: MANIFEST-000008 size: 895 Bytes 2021-03-10T13:49:46.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 2, files: 000026.sst 000027.sst 2021-03-10T13:49:46.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000024.log size: 8991586 ; 2021-03-10T13:49:46.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.error_if_exists: 0 2021-03-10T13:49:46.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.create_if_missing: 0 2021-03-10T13:49:46.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.paranoid_checks: 1 2021-03-10T13:49:46.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.env: 0x5650bf9c91c0 2021-03-10T13:49:46.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.fs: Posix File System 2021-03-10T13:49:46.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.info_log: 0x5650c03d91e0 2021-03-10T13:49:46.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.max_file_opening_threads: 16 2021-03-10T13:49:46.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.statistics: (nil) 2021-03-10T13:49:46.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.use_fsync: 0 2021-03-10T13:49:46.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.max_log_file_size: 0 2021-03-10T13:49:46.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2021-03-10T13:49:46.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.log_file_time_to_roll: 0 2021-03-10T13:49:46.479 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.keep_log_file_num: 1000 2021-03-10T13:49:46.479 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.recycle_log_file_num: 0 2021-03-10T13:49:46.480 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.allow_fallocate: 1 2021-03-10T13:49:46.481 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.allow_mmap_reads: 0 2021-03-10T13:49:46.481 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.allow_mmap_writes: 0 2021-03-10T13:49:46.481 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.use_direct_reads: 0 2021-03-10T13:49:46.481 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2021-03-10T13:49:46.481 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.create_missing_column_families: 0 2021-03-10T13:49:46.482 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.db_log_dir: 2021-03-10T13:49:46.482 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2021-03-10T13:49:46.482 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.table_cache_numshardbits: 6 2021-03-10T13:49:46.482 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.max_subcompactions: 1 2021-03-10T13:49:46.482 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.max_background_flushes: -1 2021-03-10T13:49:46.483 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.WAL_ttl_seconds: 0 2021-03-10T13:49:46.483 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.WAL_size_limit_MB: 0 2021-03-10T13:49:46.483 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2021-03-10T13:49:46.483 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2021-03-10T13:49:46.483 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.is_fd_close_on_exec: 1 2021-03-10T13:49:46.484 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.advise_random_on_open: 1 2021-03-10T13:49:46.484 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.db_write_buffer_size: 0 2021-03-10T13:49:46.484 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.write_buffer_manager: 0x5650c042dc50 2021-03-10T13:49:46.484 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2021-03-10T13:49:46.485 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2021-03-10T13:49:46.485 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2021-03-10T13:49:46.485 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.use_adaptive_mutex: 0 2021-03-10T13:49:46.485 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.rate_limiter: (nil) 2021-03-10T13:49:46.485 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2021-03-10T13:49:46.486 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.wal_recovery_mode: 2 2021-03-10T13:49:46.486 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.enable_thread_tracking: 0 2021-03-10T13:49:46.486 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.enable_pipelined_write: 0 2021-03-10T13:49:46.486 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.unordered_write: 0 2021-03-10T13:49:46.486 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2021-03-10T13:49:46.487 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2021-03-10T13:49:46.487 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2021-03-10T13:49:46.487 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2021-03-10T13:49:46.487 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.row_cache: None 2021-03-10T13:49:46.487 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.wal_filter: None 2021-03-10T13:49:46.488 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2021-03-10T13:49:46.488 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.allow_ingest_behind: 0 2021-03-10T13:49:46.488 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.preserve_deletes: 0 2021-03-10T13:49:46.488 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.two_write_queues: 0 2021-03-10T13:49:46.488 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.manual_wal_flush: 0 2021-03-10T13:49:46.489 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.atomic_flush: 0 2021-03-10T13:49:46.489 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2021-03-10T13:49:46.489 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.persist_stats_to_disk: 0 2021-03-10T13:49:46.489 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.write_dbid_to_manifest: 0 2021-03-10T13:49:46.489 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.log_readahead_size: 0 2021-03-10T13:49:46.490 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.sst_file_checksum_func: Unknown 2021-03-10T13:49:46.490 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.max_background_jobs: 2 2021-03-10T13:49:46.490 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.max_background_compactions: -1 2021-03-10T13:49:46.490 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2021-03-10T13:49:46.490 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2021-03-10T13:49:46.491 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.delayed_write_rate : 16777216 2021-03-10T13:49:46.491 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.max_total_wal_size: 0 2021-03-10T13:49:46.491 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2021-03-10T13:49:46.491 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.stats_dump_period_sec: 600 2021-03-10T13:49:46.491 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.stats_persist_period_sec: 600 2021-03-10T13:49:46.492 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2021-03-10T13:49:46.492 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.max_open_files: -1 2021-03-10T13:49:46.492 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.bytes_per_sync: 0 2021-03-10T13:49:46.492 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.wal_bytes_per_sync: 0 2021-03-10T13:49:46.492 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.strict_bytes_per_sync: 0 2021-03-10T13:49:46.493 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.compaction_readahead_size: 0 2021-03-10T13:49:46.493 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Compression algorithms supported: 2021-03-10T13:49:46.493 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2021-03-10T13:49:46.493 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: kZSTD supported: 0 2021-03-10T13:49:46.493 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: kXpressCompression supported: 0 2021-03-10T13:49:46.494 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: kLZ4HCCompression supported: 1 2021-03-10T13:49:46.494 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: kLZ4Compression supported: 1 2021-03-10T13:49:46.494 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: kBZip2Compression supported: 0 2021-03-10T13:49:46.494 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: kZlibCompression supported: 1 2021-03-10T13:49:46.494 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: kSnappyCompression supported: 1 2021-03-10T13:49:46.495 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Fast CRC32 supported: Supported on x86 2021-03-10T13:49:46.495 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000008 2021-03-10T13:49:46.495 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2021-03-10T13:49:46.495 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2021-03-10T13:49:46.495 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.merge_operator: 2021-03-10T13:49:46.495 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.compaction_filter: None 2021-03-10T13:49:46.496 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.compaction_filter_factory: None 2021-03-10T13:49:46.496 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.memtable_factory: SkipListFactory 2021-03-10T13:49:46.496 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.table_factory: BlockBasedTable 2021-03-10T13:49:46.496 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5650c037c230) 2021-03-10T13:49:46.496 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: cache_index_and_filter_blocks: 1 2021-03-10T13:49:46.497 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: cache_index_and_filter_blocks_with_high_priority: 0 2021-03-10T13:49:46.497 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: pin_l0_filter_and_index_blocks_in_cache: 0 2021-03-10T13:49:46.497 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: pin_top_level_index_and_filter: 1 2021-03-10T13:49:46.497 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: index_type: 0 2021-03-10T13:49:46.497 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: data_block_index_type: 0 2021-03-10T13:49:46.498 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: index_shortening: 1 2021-03-10T13:49:46.498 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: data_block_hash_table_util_ratio: 0.750000 2021-03-10T13:49:46.498 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: hash_index_allow_collision: 1 2021-03-10T13:49:46.498 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: checksum: 1 2021-03-10T13:49:46.498 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: no_block_cache: 0 2021-03-10T13:49:46.499 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: block_cache: 0x5650c03b4510 2021-03-10T13:49:46.499 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: block_cache_name: BinnedLRUCache 2021-03-10T13:49:46.499 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: block_cache_options: 2021-03-10T13:49:46.499 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: capacity : 536870912 2021-03-10T13:49:46.499 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: num_shard_bits : 4 2021-03-10T13:49:46.500 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: strict_capacity_limit : 0 2021-03-10T13:49:46.500 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: high_pri_pool_ratio: 0.000 2021-03-10T13:49:46.500 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: block_cache_compressed: (nil) 2021-03-10T13:49:46.500 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: persistent_cache: (nil) 2021-03-10T13:49:46.500 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: block_size: 4096 2021-03-10T13:49:46.501 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: block_size_deviation: 10 2021-03-10T13:49:46.501 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: block_restart_interval: 16 2021-03-10T13:49:46.501 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: index_block_restart_interval: 1 2021-03-10T13:49:46.501 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: metadata_block_size: 4096 2021-03-10T13:49:46.501 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: partition_filters: 0 2021-03-10T13:49:46.502 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: use_delta_encoding: 1 2021-03-10T13:49:46.502 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: filter_policy: rocksdb.BuiltinBloomFilter 2021-03-10T13:49:46.502 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: whole_key_filtering: 1 2021-03-10T13:49:46.502 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: verify_compression: 0 2021-03-10T13:49:46.502 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: read_amp_bytes_per_bit: 0 2021-03-10T13:49:46.503 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: format_version: 2 2021-03-10T13:49:46.503 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: enable_index_compression: 1 2021-03-10T13:49:46.503 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: block_align: 0 2021-03-10T13:49:46.503 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.write_buffer_size: 33554432 2021-03-10T13:49:46.503 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.max_write_buffer_number: 2 2021-03-10T13:49:46.504 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.compression: NoCompression 2021-03-10T13:49:46.504 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.bottommost_compression: Disabled 2021-03-10T13:49:46.504 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.prefix_extractor: nullptr 2021-03-10T13:49:46.504 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2021-03-10T13:49:46.504 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.num_levels: 7 2021-03-10T13:49:46.505 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2021-03-10T13:49:46.505 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2021-03-10T13:49:46.505 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2021-03-10T13:49:46.505 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2021-03-10T13:49:46.505 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2021-03-10T13:49:46.506 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2021-03-10T13:49:46.506 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2021-03-10T13:49:46.506 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2021-03-10T13:49:46.506 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2021-03-10T13:49:46.507 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.compression_opts.window_bits: -14 2021-03-10T13:49:46.507 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.compression_opts.level: 32767 2021-03-10T13:49:46.507 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.compression_opts.strategy: 0 2021-03-10T13:49:46.507 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2021-03-10T13:49:46.507 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2021-03-10T13:49:46.507 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.compression_opts.enabled: false 2021-03-10T13:49:46.508 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2021-03-10T13:49:46.508 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2021-03-10T13:49:46.508 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2021-03-10T13:49:46.508 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.target_file_size_base: 67108864 2021-03-10T13:49:46.508 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.target_file_size_multiplier: 1 2021-03-10T13:49:46.509 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2021-03-10T13:49:46.509 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2021-03-10T13:49:46.509 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2021-03-10T13:49:46.509 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2021-03-10T13:49:46.509 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2021-03-10T13:49:46.510 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2021-03-10T13:49:46.510 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2021-03-10T13:49:46.510 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2021-03-10T13:49:46.510 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2021-03-10T13:49:46.511 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2021-03-10T13:49:46.511 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2021-03-10T13:49:46.511 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2021-03-10T13:49:46.511 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.arena_block_size: 4194304 2021-03-10T13:49:46.511 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2021-03-10T13:49:46.511 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2021-03-10T13:49:46.512 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2021-03-10T13:49:46.512 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.disable_auto_compactions: 0 2021-03-10T13:49:46.512 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2021-03-10T13:49:46.512 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2021-03-10T13:49:46.512 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2021-03-10T13:49:46.513 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2021-03-10T13:49:46.513 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2021-03-10T13:49:46.513 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2021-03-10T13:49:46.513 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2021-03-10T13:49:46.513 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2021-03-10T13:49:46.514 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2021-03-10T13:49:46.514 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2021-03-10T13:49:46.514 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.table_properties_collectors: 2021-03-10T13:49:46.514 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.inplace_update_support: 0 2021-03-10T13:49:46.514 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.inplace_update_num_locks: 10000 2021-03-10T13:49:46.515 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2021-03-10T13:49:46.515 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2021-03-10T13:49:46.515 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.memtable_huge_page_size: 0 2021-03-10T13:49:46.515 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.bloom_locality: 0 2021-03-10T13:49:46.515 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.max_successive_merges: 0 2021-03-10T13:49:46.516 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.optimize_filters_for_hits: 0 2021-03-10T13:49:46.516 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.paranoid_file_checks: 0 2021-03-10T13:49:46.516 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.force_consistency_checks: 0 2021-03-10T13:49:46.516 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.report_bg_io_stats: 0 2021-03-10T13:49:46.517 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.ttl: 2592000 2021-03-10T13:49:46.517 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: Options.periodic_compaction_seconds: 0 2021-03-10T13:49:46.517 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000008 succeeded,manifest_file_number is 8, next_file_number is 29, last_sequence is 8723, log_number is 24,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2021-03-10T13:49:46.517 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 24 2021-03-10T13:49:46.517 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1615384186286395, "job": 1, "event": "recovery_started", "log_files": [24]} 2021-03-10T13:49:46.518 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.283+0000 7f21d2d32700 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #24 mode 2 2021-03-10T13:49:46.518 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.287+0000 7f21d2d32700 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2021-03-10T13:49:46.518 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.295+0000 7f21d2d32700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1615384186301023, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 29, "file_size": 8956132, "table_properties": {"data_size": 8951939, "index_size": 2922, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 453, "raw_key_size": 3635, "raw_average_key_size": 23, "raw_value_size": 8947302, "raw_average_value_size": 58099, "num_data_blocks": 90, "num_entries": 154, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1615384186, "oldest_key_time": 3, "file_creation_time": 0}} 2021-03-10T13:49:46.518 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.295+0000 7f21d2d32700 4 rocksdb: [version_set.cc:3826] Creating manifest 30 2021-03-10T13:49:46.519 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.299+0000 7f21d2d32700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1615384186302033, "job": 1, "event": "recovery_finished"} 2021-03-10T13:49:46.519 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.299+0000 7f21d2d32700 4 rocksdb: DB pointer 0x5650c0479800 2021-03-10T13:49:46.519 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.299+0000 7f21b9b45700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2021-03-10T13:49:46.519 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.299+0000 7f21b9b45700 4 rocksdb: [db_impl/db_impl.cc:851] 2021-03-10T13:49:46.519 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: ** DB Stats ** 2021-03-10T13:49:46.520 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T13:49:46.520 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2021-03-10T13:49:46.520 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2021-03-10T13:49:46.520 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2021-03-10T13:49:46.520 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2021-03-10T13:49:46.521 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2021-03-10T13:49:46.521 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2021-03-10T13:49:46.521 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: ** Compaction Stats [default] ** 2021-03-10T13:49:46.521 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T13:49:46.521 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T13:49:46.522 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: L0 1/0 8.54 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 996.6 0.01 0.00 1 0.009 0 0 2021-03-10T13:49:46.522 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: L6 2/0 65.18 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-03-10T13:49:46.522 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: Sum 3/0 73.72 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 996.6 0.01 0.00 1 0.009 0 0 2021-03-10T13:49:46.522 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 996.6 0.01 0.00 1 0.009 0 0 2021-03-10T13:49:46.522 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: ** Compaction Stats [default] ** 2021-03-10T13:49:46.523 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T13:49:46.523 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T13:49:46.523 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 996.6 0.01 0.00 1 0.009 0 0 2021-03-10T13:49:46.523 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T13:49:46.523 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: Flush(GB): cumulative 0.008, interval 0.008 2021-03-10T13:49:46.524 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: AddFile(GB): cumulative 0.000, interval 0.000 2021-03-10T13:49:46.524 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: AddFile(Total Files): cumulative 0, interval 0 2021-03-10T13:49:46.524 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: AddFile(L0 Files): cumulative 0, interval 0 2021-03-10T13:49:46.524 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: AddFile(Keys): cumulative 0, interval 0 2021-03-10T13:49:46.524 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: Cumulative compaction: 0.01 GB write, 480.52 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T13:49:46.525 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: Interval compaction: 0.01 GB write, 480.52 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T13:49:46.525 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-03-10T13:49:46.525 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: ** File Read Latency Histogram By Level [default] ** 2021-03-10T13:49:46.525 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: ** Compaction Stats [default] ** 2021-03-10T13:49:46.525 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T13:49:46.526 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T13:49:46.526 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: L0 1/0 8.54 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 996.6 0.01 0.00 1 0.009 0 0 2021-03-10T13:49:46.526 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: L6 2/0 65.18 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-03-10T13:49:46.526 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: Sum 3/0 73.72 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 996.6 0.01 0.00 1 0.009 0 0 2021-03-10T13:49:46.527 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-03-10T13:49:46.527 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: ** Compaction Stats [default] ** 2021-03-10T13:49:46.527 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T13:49:46.527 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T13:49:46.528 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 996.6 0.01 0.00 1 0.009 0 0 2021-03-10T13:49:46.528 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T13:49:46.528 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: Flush(GB): cumulative 0.008, interval 0.000 2021-03-10T13:49:46.528 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: AddFile(GB): cumulative 0.000, interval 0.000 2021-03-10T13:49:46.529 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: AddFile(Total Files): cumulative 0, interval 0 2021-03-10T13:49:46.529 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: AddFile(L0 Files): cumulative 0, interval 0 2021-03-10T13:49:46.529 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: AddFile(Keys): cumulative 0, interval 0 2021-03-10T13:49:46.529 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: Cumulative compaction: 0.01 GB write, 479.82 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T13:49:46.529 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T13:49:46.530 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-03-10T13:49:46.530 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: ** File Read Latency Histogram By Level [default] ** 2021-03-10T13:49:46.530 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.299+0000 7f21d2d32700 0 starting mon.a rank 0 at public addrs [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] at bind addrs [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid e4a642d2-81a5-11eb-9080-001a4aab830c 2021-03-10T13:49:46.530 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.299+0000 7f21d2d32700 1 mon.a@-1(???) e3 preinit fsid e4a642d2-81a5-11eb-9080-001a4aab830c 2021-03-10T13:49:46.530 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.299+0000 7f21d2d32700 0 mon.a@-1(???).mds e1 new map 2021-03-10T13:49:46.531 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.299+0000 7f21d2d32700 0 mon.a@-1(???).mds e1 print_map 2021-03-10T13:49:46.531 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: e1 2021-03-10T13:49:46.531 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: enable_multiple, ever_enabled_multiple: 0,0 2021-03-10T13:49:46.531 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-03-10T13:49:46.532 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: legacy client fscid: -1 2021-03-10T13:49:46.532 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: 2021-03-10T13:49:46.532 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: No filesystems configured 2021-03-10T13:49:46.532 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.299+0000 7f21d2d32700 0 mon.a@-1(???).osd e61 crush map has features 3314933000852226048, adjusting msgr requires 2021-03-10T13:49:46.532 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.299+0000 7f21d2d32700 0 mon.a@-1(???).osd e61 crush map has features 288514051259236352, adjusting msgr requires 2021-03-10T13:49:46.533 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.299+0000 7f21d2d32700 0 mon.a@-1(???).osd e61 crush map has features 288514051259236352, adjusting msgr requires 2021-03-10T13:49:46.533 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.299+0000 7f21d2d32700 0 mon.a@-1(???).osd e61 crush map has features 288514051259236352, adjusting msgr requires 2021-03-10T13:49:46.533 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: cephadm 2021-03-10T13:49:42.136737+0000 mgr.gibba045.orlgmj (mgr.34379) 57 : cephadm [INF] Upgrade: Updating mon.a 2021-03-10T13:49:46.533 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: cephadm 2021-03-10T13:49:42.144351+0000 mgr.gibba045.orlgmj (mgr.34379) 58 : cephadm [INF] Deploying daemon mon.a on gibba015 2021-03-10T13:49:46.533 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.303+0000 7f21d2d32700 1 mon.a@-1(???).paxosservice(auth 1..19) refresh upgraded, format 0 -> 3 2021-03-10T13:49:46.534 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.303+0000 7f21d2d32700 20 expand_channel_meta expand map: {default=false} 2021-03-10T13:49:46.534 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.303+0000 7f21d2d32700 20 expand_channel_meta from 'false' to 'false' 2021-03-10T13:49:46.534 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.303+0000 7f21d2d32700 20 expand_channel_meta expanded map: {default=false} 2021-03-10T13:49:46.534 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.303+0000 7f21d2d32700 20 expand_channel_meta expand map: {default=info} 2021-03-10T13:49:46.534 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.303+0000 7f21d2d32700 20 expand_channel_meta from 'info' to 'info' 2021-03-10T13:49:46.535 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.303+0000 7f21d2d32700 20 expand_channel_meta expanded map: {default=info} 2021-03-10T13:49:46.535 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.303+0000 7f21d2d32700 20 expand_channel_meta expand map: {default=daemon} 2021-03-10T13:49:46.535 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.303+0000 7f21d2d32700 20 expand_channel_meta from 'daemon' to 'daemon' 2021-03-10T13:49:46.535 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.303+0000 7f21d2d32700 20 expand_channel_meta expanded map: {default=daemon} 2021-03-10T13:49:46.535 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.303+0000 7f21d2d32700 20 expand_channel_meta expand map: {default=debug} 2021-03-10T13:49:46.536 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.303+0000 7f21d2d32700 20 expand_channel_meta from 'debug' to 'debug' 2021-03-10T13:49:46.536 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:46 gibba015 bash[29377]: debug 2021-03-10T13:49:46.303+0000 7f21d2d32700 20 expand_channel_meta expanded map: {default=debug} 2021-03-10T13:49:48.057 INFO:journalctl@ceph.mgr.x.gibba045.stdout:Mar 10 13:49:47 gibba045 bash[22134]: ignoring --setuser ceph since I am not root 2021-03-10T13:49:48.057 INFO:journalctl@ceph.mgr.x.gibba045.stdout:Mar 10 13:49:47 gibba045 bash[22134]: ignoring --setgroup ceph since I am not root 2021-03-10T13:49:48.057 INFO:journalctl@ceph.mgr.x.gibba045.stdout:Mar 10 13:49:47 gibba045 bash[22134]: debug 2021-03-10T13:49:47.762+0000 7ff87ae21700 1 -- 172.21.2.145:0/3949453847 <== mon.2 v2:172.21.2.145:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x560b8f4b44e0 con 0x560b8f5a4c00 2021-03-10T13:49:48.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:47 gibba045 bash[9787]: cluster 2021-03-10T13:49:45.012372+0000 mgr.gibba045.orlgmj (mgr.34379) 60 : cluster [DBG] pgmap v27: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:48.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:47 gibba045 bash[9787]: audit 2021-03-10T13:49:45.222707+0000 mon.b (mon.2) 121 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba015\", \"container_id\": \"fb55e770cd62\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 141977190, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.956513Z\", \"created\": \"2021-03-10T13:38:58.024449Z\", \"started\": \"2021-03-10T13:49:36.120688Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96248791, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.956853Z\", \"created\": \"2021-03-10T13:40:03.296449Z\", \"started\": \"2021-03-10T13:40:03.320843Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48884613, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.957156Z\", \"created\": \"2021-03-10T13:40:50.072448Z\", \"started\": \"2021-03-10T13:40:53.142290Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49702502, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.957867Z\", \"created\": \"2021-03-10T13:41:11.556448Z\", \"started\": \"2021-03-10T13:41:15.069232Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46042972, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.958515Z\", \"created\": \"2021-03-10T13:41:34.244448Z\", \"started\": \"2021-03-10T13:41:37.507096Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47385149, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.959330Z\", \"created\": \"2021-03-10T13:41:57.328380Z\", \"started\": \"2021-03-10T13:42:00.781947Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23330816, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.959992Z\", \"created\": \"2021-03-10T13:43:44.272379Z\", \"started\": \"2021-03-10T13:43:47.550063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"df987682eada\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12603883, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2021-03-10T13:49:39.960332Z\", \"created\": \"2021-03-10T13:43:54.628379Z\", \"started\": \"2021-03-10T13:49:17.528199Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:08.925129Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:23.251574Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:49:10.777874Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:42.144291Z\"}}, \"last_device_update\": \"2021-03-10T13:42:03.853072Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:49:36.287812Z\"}"}]: dispatch 2021-03-10T13:49:48.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:47 gibba045 bash[9787]: cluster 2021-03-10T13:49:46.516062+0000 mon.a (mon.0) 1 : cluster [INF] mon.a calling monitor election 2021-03-10T13:49:48.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:47 gibba045 bash[9787]: cluster 2021-03-10T13:49:47.013629+0000 mgr.gibba045.orlgmj (mgr.34379) 61 : cluster [DBG] pgmap v28: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:48.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:47 gibba045 bash[9787]: cluster 2021-03-10T13:49:47.713771+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-03-10T13:49:48.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:47 gibba045 bash[9787]: cluster 2021-03-10T13:49:47.724129+0000 mon.a (mon.0) 3 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0],b=[v2:172.21.2.145:3300/0,v1:172.21.2.145:6789/0],c=[v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0]} 2021-03-10T13:49:48.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:47 gibba045 bash[9787]: cluster 2021-03-10T13:49:47.724152+0000 mon.a (mon.0) 4 : cluster [DBG] fsmap 2021-03-10T13:49:48.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:47 gibba045 bash[9787]: cluster 2021-03-10T13:49:47.724170+0000 mon.a (mon.0) 5 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2021-03-10T13:49:48.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:47 gibba045 bash[9787]: cluster 2021-03-10T13:49:47.725028+0000 mon.a (mon.0) 6 : cluster [DBG] mgrmap e21: gibba045.orlgmj(active, since 52s), standbys: y, x 2021-03-10T13:49:48.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:47 gibba045 bash[9787]: cluster 2021-03-10T13:49:47.736402+0000 mon.a (mon.0) 7 : cluster [DBG] mgrmap e22: gibba045.orlgmj(active, since 52s), standbys: y, x 2021-03-10T13:49:48.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:47 gibba045 bash[9787]: cluster 2021-03-10T13:49:47.736918+0000 mon.a (mon.0) 8 : cluster [ERR] Health detail: HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:49:48.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:47 gibba045 bash[9787]: cluster 2021-03-10T13:49:47.736931+0000 mon.a (mon.0) 9 : cluster [ERR] [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2021-03-10T13:49:48.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:47 gibba045 bash[9787]: cluster 2021-03-10T13:49:47.736937+0000 mon.a (mon.0) 10 : cluster [ERR] daemon rgw.r.z.gibba045.atotkw on gibba045 is in error state 2021-03-10T13:49:48.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:47 gibba045 bash[9787]: cluster 2021-03-10T13:49:47.736972+0000 mon.a (mon.0) 11 : cluster [ERR] [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:49:48.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:47 gibba045 bash[9787]: cluster 2021-03-10T13:49:47.736982+0000 mon.a (mon.0) 12 : cluster [ERR] Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:49:48.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:47 gibba045 bash[9787]: audit 2021-03-10T13:49:47.741235+0000 mon.a (mon.0) 13 : audit [INF] from='mgr.34379 ' entity='' 2021-03-10T13:49:48.221 INFO:journalctl@ceph.mgr.y.gibba015.stdout:Mar 10 13:49:47 gibba015 bash[28392]: ignoring --setuser ceph since I am not root 2021-03-10T13:49:48.221 INFO:journalctl@ceph.mgr.y.gibba015.stdout:Mar 10 13:49:47 gibba015 bash[28392]: ignoring --setgroup ceph since I am not root 2021-03-10T13:49:48.222 INFO:journalctl@ceph.mgr.y.gibba015.stdout:Mar 10 13:49:47 gibba015 bash[28392]: debug 2021-03-10T13:49:47.759+0000 7feda4ee2700 1 -- 172.21.2.115:0/1074247605 <== mon.0 v2:172.21.2.115:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5637436104e0 con 0x563743700c00 2021-03-10T13:49:48.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:47 gibba015 bash[13005]: cluster 2021-03-10T13:49:45.012372+0000 mgr.gibba045.orlgmj (mgr.34379) 60 : cluster [DBG] pgmap v27: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:48.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:47 gibba015 bash[29377]: debug 2021-03-10T13:49:47.731+0000 7f21bab47700 -1 log_channel(cluster) log [ERR] : Health detail: HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:49:48.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:47 gibba015 bash[29377]: debug 2021-03-10T13:49:47.731+0000 7f21bab47700 -1 log_channel(cluster) log [ERR] : [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2021-03-10T13:49:48.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:47 gibba015 bash[29377]: debug 2021-03-10T13:49:47.731+0000 7f21bab47700 -1 log_channel(cluster) log [ERR] : daemon rgw.r.z.gibba045.atotkw on gibba045 is in error state 2021-03-10T13:49:48.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:47 gibba015 bash[29377]: debug 2021-03-10T13:49:47.731+0000 7f21bab47700 -1 log_channel(cluster) log [ERR] : [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:49:48.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:47 gibba015 bash[29377]: debug 2021-03-10T13:49:47.731+0000 7f21bab47700 -1 log_channel(cluster) log [ERR] : Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:49:48.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:47 gibba015 bash[29377]: cluster 2021-03-10T13:49:45.012372+0000 mgr.gibba045.orlgmj (mgr.34379) 60 : cluster [DBG] pgmap v27: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:48.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:47 gibba015 bash[13005]: audit 2021-03-10T13:49:45.222707+0000 mon.b (mon.2) 121 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba015\", \"container_id\": \"fb55e770cd62\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 141977190, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.956513Z\", \"created\": \"2021-03-10T13:38:58.024449Z\", \"started\": \"2021-03-10T13:49:36.120688Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96248791, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.956853Z\", \"created\": \"2021-03-10T13:40:03.296449Z\", \"started\": \"2021-03-10T13:40:03.320843Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48884613, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.957156Z\", \"created\": \"2021-03-10T13:40:50.072448Z\", \"started\": \"2021-03-10T13:40:53.142290Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49702502, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.957867Z\", \"created\": \"2021-03-10T13:41:11.556448Z\", \"started\": \"2021-03-10T13:41:15.069232Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46042972, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.958515Z\", \"created\": \"2021-03-10T13:41:34.244448Z\", \"started\": \"2021-03-10T13:41:37.507096Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47385149, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.959330Z\", \"created\": \"2021-03-10T13:41:57.328380Z\", \"started\": \"2021-03-10T13:42:00.781947Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23330816, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.959992Z\", \"created\": \"2021-03-10T13:43:44.272379Z\", \"started\": \"2021-03-10T13:43:47.550063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"df987682eada\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12603883, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2021-03-10T13:49:39.960332Z\", \"created\": \"2021-03-10T13:43:54.628379Z\", \"started\": \"2021-03-10T13:49:17.528199Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:08.925129Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:23.251574Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:49:10.777874Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:42.144291Z\"}}, \"last_device_update\": \"2021-03-10T13:42:03.853072Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:49:36.287812Z\"}"}]: dispatch 2021-03-10T13:49:48.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:47 gibba015 bash[13005]: cluster 2021-03-10T13:49:46.516062+0000 mon.a (mon.0) 1 : cluster [INF] mon.a calling monitor election 2021-03-10T13:49:48.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:47 gibba015 bash[13005]: cluster 2021-03-10T13:49:47.013629+0000 mgr.gibba045.orlgmj (mgr.34379) 61 : cluster [DBG] pgmap v28: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:48.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:47 gibba015 bash[13005]: cluster 2021-03-10T13:49:47.713771+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-03-10T13:49:48.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:47 gibba015 bash[13005]: cluster 2021-03-10T13:49:47.724129+0000 mon.a (mon.0) 3 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0],b=[v2:172.21.2.145:3300/0,v1:172.21.2.145:6789/0],c=[v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0]} 2021-03-10T13:49:48.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:47 gibba015 bash[13005]: cluster 2021-03-10T13:49:47.724152+0000 mon.a (mon.0) 4 : cluster [DBG] fsmap 2021-03-10T13:49:48.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:47 gibba015 bash[13005]: cluster 2021-03-10T13:49:47.724170+0000 mon.a (mon.0) 5 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2021-03-10T13:49:48.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:47 gibba015 bash[13005]: cluster 2021-03-10T13:49:47.725028+0000 mon.a (mon.0) 6 : cluster [DBG] mgrmap e21: gibba045.orlgmj(active, since 52s), standbys: y, x 2021-03-10T13:49:48.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:47 gibba015 bash[13005]: cluster 2021-03-10T13:49:47.736402+0000 mon.a (mon.0) 7 : cluster [DBG] mgrmap e22: gibba045.orlgmj(active, since 52s), standbys: y, x 2021-03-10T13:49:48.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:47 gibba015 bash[13005]: cluster 2021-03-10T13:49:47.736918+0000 mon.a (mon.0) 8 : cluster [ERR] Health detail: HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:49:48.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:47 gibba015 bash[13005]: cluster 2021-03-10T13:49:47.736931+0000 mon.a (mon.0) 9 : cluster [ERR] [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2021-03-10T13:49:48.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:47 gibba015 bash[13005]: cluster 2021-03-10T13:49:47.736937+0000 mon.a (mon.0) 10 : cluster [ERR] daemon rgw.r.z.gibba045.atotkw on gibba045 is in error state 2021-03-10T13:49:48.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:47 gibba015 bash[13005]: cluster 2021-03-10T13:49:47.736972+0000 mon.a (mon.0) 11 : cluster [ERR] [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:49:48.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:47 gibba015 bash[13005]: cluster 2021-03-10T13:49:47.736982+0000 mon.a (mon.0) 12 : cluster [ERR] Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:49:48.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:47 gibba015 bash[13005]: audit 2021-03-10T13:49:47.741235+0000 mon.a (mon.0) 13 : audit [INF] from='mgr.34379 ' entity='' 2021-03-10T13:49:48.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:47 gibba015 bash[29377]: audit 2021-03-10T13:49:45.222707+0000 mon.b (mon.2) 121 : audit [INF] from='mgr.34379 172.21.2.145:0/2555934946' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba015\", \"container_id\": \"fb55e770cd62\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 141977190, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.956513Z\", \"created\": \"2021-03-10T13:38:58.024449Z\", \"started\": \"2021-03-10T13:49:36.120688Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96248791, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.956853Z\", \"created\": \"2021-03-10T13:40:03.296449Z\", \"started\": \"2021-03-10T13:40:03.320843Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48884613, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.957156Z\", \"created\": \"2021-03-10T13:40:50.072448Z\", \"started\": \"2021-03-10T13:40:53.142290Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49702502, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.957867Z\", \"created\": \"2021-03-10T13:41:11.556448Z\", \"started\": \"2021-03-10T13:41:15.069232Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46042972, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.958515Z\", \"created\": \"2021-03-10T13:41:34.244448Z\", \"started\": \"2021-03-10T13:41:37.507096Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47385149, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.959330Z\", \"created\": \"2021-03-10T13:41:57.328380Z\", \"started\": \"2021-03-10T13:42:00.781947Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23330816, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:39.959992Z\", \"created\": \"2021-03-10T13:43:44.272379Z\", \"started\": \"2021-03-10T13:43:47.550063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"df987682eada\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12603883, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2021-03-10T13:49:39.960332Z\", \"created\": \"2021-03-10T13:43:54.628379Z\", \"started\": \"2021-03-10T13:49:17.528199Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:08.925129Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:23.251574Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:49:10.777874Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:42.144291Z\"}}, \"last_device_update\": \"2021-03-10T13:42:03.853072Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:49:36.287812Z\"}"}]: dispatch 2021-03-10T13:49:48.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:47 gibba015 bash[29377]: cluster 2021-03-10T13:49:46.516062+0000 mon.a (mon.0) 1 : cluster [INF] mon.a calling monitor election 2021-03-10T13:49:48.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:47 gibba015 bash[29377]: cluster 2021-03-10T13:49:47.013629+0000 mgr.gibba045.orlgmj (mgr.34379) 61 : cluster [DBG] pgmap v28: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:48.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:47 gibba015 bash[29377]: cluster 2021-03-10T13:49:47.713771+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-03-10T13:49:48.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:47 gibba015 bash[29377]: cluster 2021-03-10T13:49:47.724129+0000 mon.a (mon.0) 3 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0],b=[v2:172.21.2.145:3300/0,v1:172.21.2.145:6789/0],c=[v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0]} 2021-03-10T13:49:48.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:47 gibba015 bash[29377]: cluster 2021-03-10T13:49:47.724152+0000 mon.a (mon.0) 4 : cluster [DBG] fsmap 2021-03-10T13:49:48.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:47 gibba015 bash[29377]: cluster 2021-03-10T13:49:47.724170+0000 mon.a (mon.0) 5 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2021-03-10T13:49:48.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:47 gibba015 bash[29377]: cluster 2021-03-10T13:49:47.725028+0000 mon.a (mon.0) 6 : cluster [DBG] mgrmap e21: gibba045.orlgmj(active, since 52s), standbys: y, x 2021-03-10T13:49:48.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:47 gibba015 bash[29377]: cluster 2021-03-10T13:49:47.736402+0000 mon.a (mon.0) 7 : cluster [DBG] mgrmap e22: gibba045.orlgmj(active, since 52s), standbys: y, x 2021-03-10T13:49:48.230 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:47 gibba015 bash[29377]: cluster 2021-03-10T13:49:47.736918+0000 mon.a (mon.0) 8 : cluster [ERR] Health detail: HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:49:48.230 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:47 gibba015 bash[29377]: cluster 2021-03-10T13:49:47.736931+0000 mon.a (mon.0) 9 : cluster [ERR] [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2021-03-10T13:49:48.230 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:47 gibba015 bash[29377]: cluster 2021-03-10T13:49:47.736937+0000 mon.a (mon.0) 10 : cluster [ERR] daemon rgw.r.z.gibba045.atotkw on gibba045 is in error state 2021-03-10T13:49:48.230 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:47 gibba015 bash[29377]: cluster 2021-03-10T13:49:47.736972+0000 mon.a (mon.0) 11 : cluster [ERR] [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:49:48.230 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:47 gibba015 bash[29377]: cluster 2021-03-10T13:49:47.736982+0000 mon.a (mon.0) 12 : cluster [ERR] Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:49:48.231 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:47 gibba015 bash[29377]: audit 2021-03-10T13:49:47.741235+0000 mon.a (mon.0) 13 : audit [INF] from='mgr.34379 ' entity='' 2021-03-10T13:49:52.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:52 gibba015 bash[29377]: cluster 2021-03-10T13:49:51.530086+0000 mon.a (mon.0) 14 : cluster [DBG] Standby manager daemon y restarted 2021-03-10T13:49:52.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:52 gibba015 bash[29377]: cluster 2021-03-10T13:49:51.530146+0000 mon.a (mon.0) 15 : cluster [DBG] Standby manager daemon y started 2021-03-10T13:49:52.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:52 gibba015 bash[29377]: audit 2021-03-10T13:49:51.531611+0000 mon.a (mon.0) 16 : audit [DBG] from='mgr.? 172.21.2.115:0/771350271' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:49:52.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:52 gibba015 bash[29377]: audit 2021-03-10T13:49:51.532515+0000 mon.a (mon.0) 17 : audit [DBG] from='mgr.? 172.21.2.115:0/771350271' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:49:52.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:52 gibba015 bash[29377]: cluster 2021-03-10T13:49:51.614915+0000 mon.a (mon.0) 18 : cluster [INF] Active manager daemon gibba045.orlgmj restarted 2021-03-10T13:49:52.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:52 gibba015 bash[29377]: cluster 2021-03-10T13:49:51.615728+0000 mon.a (mon.0) 19 : cluster [INF] Activating manager daemon gibba045.orlgmj 2021-03-10T13:49:52.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:52 gibba015 bash[29377]: cluster 2021-03-10T13:49:51.619731+0000 mon.a (mon.0) 20 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2021-03-10T13:49:52.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:52 gibba015 bash[29377]: audit 2021-03-10T13:49:51.620272+0000 mon.b (mon.2) 122 : audit [DBG] from='mgr.? 172.21.2.145:0/2770323698' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:49:52.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:52 gibba015 bash[29377]: cluster 2021-03-10T13:49:51.620668+0000 mon.a (mon.0) 21 : cluster [DBG] Standby manager daemon x restarted 2021-03-10T13:49:52.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:52 gibba015 bash[29377]: cluster 2021-03-10T13:49:51.620731+0000 mon.a (mon.0) 22 : cluster [DBG] Standby manager daemon x started 2021-03-10T13:49:52.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:52 gibba015 bash[29377]: audit 2021-03-10T13:49:51.621113+0000 mon.b (mon.2) 123 : audit [DBG] from='mgr.? 172.21.2.145:0/2770323698' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:49:52.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:52 gibba015 bash[13005]: cluster 2021-03-10T13:49:51.530086+0000 mon.a (mon.0) 14 : cluster [DBG] Standby manager daemon y restarted 2021-03-10T13:49:52.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:52 gibba015 bash[13005]: cluster 2021-03-10T13:49:51.530146+0000 mon.a (mon.0) 15 : cluster [DBG] Standby manager daemon y started 2021-03-10T13:49:52.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:52 gibba015 bash[13005]: audit 2021-03-10T13:49:51.531611+0000 mon.a (mon.0) 16 : audit [DBG] from='mgr.? 172.21.2.115:0/771350271' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:49:52.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:52 gibba015 bash[13005]: audit 2021-03-10T13:49:51.532515+0000 mon.a (mon.0) 17 : audit [DBG] from='mgr.? 172.21.2.115:0/771350271' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:49:52.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:52 gibba015 bash[13005]: cluster 2021-03-10T13:49:51.614915+0000 mon.a (mon.0) 18 : cluster [INF] Active manager daemon gibba045.orlgmj restarted 2021-03-10T13:49:52.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:52 gibba015 bash[13005]: cluster 2021-03-10T13:49:51.615728+0000 mon.a (mon.0) 19 : cluster [INF] Activating manager daemon gibba045.orlgmj 2021-03-10T13:49:52.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:52 gibba015 bash[13005]: cluster 2021-03-10T13:49:51.619731+0000 mon.a (mon.0) 20 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2021-03-10T13:49:52.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:52 gibba015 bash[13005]: audit 2021-03-10T13:49:51.620272+0000 mon.b (mon.2) 122 : audit [DBG] from='mgr.? 172.21.2.145:0/2770323698' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:49:52.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:52 gibba015 bash[13005]: cluster 2021-03-10T13:49:51.620668+0000 mon.a (mon.0) 21 : cluster [DBG] Standby manager daemon x restarted 2021-03-10T13:49:52.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:52 gibba015 bash[13005]: cluster 2021-03-10T13:49:51.620731+0000 mon.a (mon.0) 22 : cluster [DBG] Standby manager daemon x started 2021-03-10T13:49:52.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:52 gibba015 bash[13005]: audit 2021-03-10T13:49:51.621113+0000 mon.b (mon.2) 123 : audit [DBG] from='mgr.? 172.21.2.145:0/2770323698' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:49:52.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:52 gibba045 bash[9787]: cluster 2021-03-10T13:49:51.530086+0000 mon.a (mon.0) 14 : cluster [DBG] Standby manager daemon y restarted 2021-03-10T13:49:52.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:52 gibba045 bash[9787]: cluster 2021-03-10T13:49:51.530146+0000 mon.a (mon.0) 15 : cluster [DBG] Standby manager daemon y started 2021-03-10T13:49:52.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:52 gibba045 bash[9787]: audit 2021-03-10T13:49:51.531611+0000 mon.a (mon.0) 16 : audit [DBG] from='mgr.? 172.21.2.115:0/771350271' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:49:52.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:52 gibba045 bash[9787]: audit 2021-03-10T13:49:51.532515+0000 mon.a (mon.0) 17 : audit [DBG] from='mgr.? 172.21.2.115:0/771350271' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:49:52.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:52 gibba045 bash[9787]: cluster 2021-03-10T13:49:51.614915+0000 mon.a (mon.0) 18 : cluster [INF] Active manager daemon gibba045.orlgmj restarted 2021-03-10T13:49:52.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:52 gibba045 bash[9787]: cluster 2021-03-10T13:49:51.615728+0000 mon.a (mon.0) 19 : cluster [INF] Activating manager daemon gibba045.orlgmj 2021-03-10T13:49:52.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:52 gibba045 bash[9787]: cluster 2021-03-10T13:49:51.619731+0000 mon.a (mon.0) 20 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2021-03-10T13:49:52.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:52 gibba045 bash[9787]: audit 2021-03-10T13:49:51.620272+0000 mon.b (mon.2) 122 : audit [DBG] from='mgr.? 172.21.2.145:0/2770323698' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:49:52.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:52 gibba045 bash[9787]: cluster 2021-03-10T13:49:51.620668+0000 mon.a (mon.0) 21 : cluster [DBG] Standby manager daemon x restarted 2021-03-10T13:49:52.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:52 gibba045 bash[9787]: cluster 2021-03-10T13:49:51.620731+0000 mon.a (mon.0) 22 : cluster [DBG] Standby manager daemon x started 2021-03-10T13:49:52.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:52 gibba045 bash[9787]: audit 2021-03-10T13:49:51.621113+0000 mon.b (mon.2) 123 : audit [DBG] from='mgr.? 172.21.2.145:0/2770323698' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:49:53.620 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:53 gibba045 bash[9787]: cluster 2021-03-10T13:49:52.331526+0000 mon.a (mon.0) 23 : cluster [DBG] mgrmap e23: gibba045.orlgmj(active, starting, since 0.715892s), standbys: x, y 2021-03-10T13:49:53.620 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:53 gibba045 bash[9787]: audit 2021-03-10T13:49:52.336124+0000 mon.b (mon.2) 124 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "mgr metadata", "who": "gibba045.orlgmj", "id": "gibba045.orlgmj"}]: dispatch 2021-03-10T13:49:53.620 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:53 gibba045 bash[9787]: audit 2021-03-10T13:49:52.336261+0000 mon.b (mon.2) 125 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-03-10T13:49:53.621 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:53 gibba045 bash[9787]: audit 2021-03-10T13:49:52.336382+0000 mon.b (mon.2) 126 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-03-10T13:49:53.621 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:53 gibba045 bash[9787]: audit 2021-03-10T13:49:52.336509+0000 mon.b (mon.2) 127 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T13:49:53.621 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:53 gibba045 bash[9787]: audit 2021-03-10T13:49:52.336641+0000 mon.b (mon.2) 128 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T13:49:53.621 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:53 gibba045 bash[9787]: audit 2021-03-10T13:49:52.336766+0000 mon.b (mon.2) 129 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T13:49:53.621 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:53 gibba045 bash[9787]: audit 2021-03-10T13:49:52.336891+0000 mon.b (mon.2) 130 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T13:49:53.622 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:53 gibba045 bash[9787]: audit 2021-03-10T13:49:52.337010+0000 mon.b (mon.2) 131 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T13:49:53.622 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:53 gibba045 bash[9787]: audit 2021-03-10T13:49:52.337134+0000 mon.b (mon.2) 132 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T13:49:53.622 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:53 gibba045 bash[9787]: audit 2021-03-10T13:49:52.337253+0000 mon.b (mon.2) 133 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T13:49:53.622 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:53 gibba045 bash[9787]: audit 2021-03-10T13:49:52.337381+0000 mon.b (mon.2) 134 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T13:49:53.623 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:53 gibba045 bash[9787]: audit 2021-03-10T13:49:52.337893+0000 mon.b (mon.2) 135 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-03-10T13:49:53.623 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:53 gibba045 bash[9787]: audit 2021-03-10T13:49:52.338000+0000 mon.b (mon.2) 136 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-03-10T13:49:53.623 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:53 gibba045 bash[9787]: audit 2021-03-10T13:49:52.338293+0000 mon.b (mon.2) 137 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-03-10T13:49:53.623 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:53 gibba045 bash[9787]: audit 2021-03-10T13:49:52.338791+0000 mon.b (mon.2) 138 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key ls"}]: dispatch 2021-03-10T13:49:53.623 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:53 gibba045 bash[9787]: audit 2021-03-10T13:49:52.339383+0000 mon.b (mon.2) 139 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2021-03-10T13:49:53.624 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:53 gibba045 bash[9787]: audit 2021-03-10T13:49:52.339680+0000 mon.b (mon.2) 140 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2021-03-10T13:49:53.624 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:53 gibba045 bash[9787]: audit 2021-03-10T13:49:52.340038+0000 mon.b (mon.2) 141 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.gibba015"}]: dispatch 2021-03-10T13:49:53.624 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:53 gibba045 bash[9787]: audit 2021-03-10T13:49:52.340322+0000 mon.b (mon.2) 142 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.gibba045"}]: dispatch 2021-03-10T13:49:53.624 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:53 gibba045 bash[9787]: audit 2021-03-10T13:49:52.340600+0000 mon.b (mon.2) 143 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2021-03-10T13:49:53.625 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:53 gibba045 bash[9787]: audit 2021-03-10T13:49:52.340982+0000 mon.b (mon.2) 144 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/osd_remove_queue"}]: dispatch 2021-03-10T13:49:53.625 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:53 gibba045 bash[9787]: audit 2021-03-10T13:49:52.341348+0000 mon.b (mon.2) 145 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2021-03-10T13:49:53.625 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:53 gibba045 bash[9787]: audit 2021-03-10T13:49:52.341727+0000 mon.b (mon.2) 146 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2021-03-10T13:49:53.625 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:53 gibba045 bash[9787]: audit 2021-03-10T13:49:52.342063+0000 mon.b (mon.2) 147 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2021-03-10T13:49:53.625 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:53 gibba045 bash[9787]: audit 2021-03-10T13:49:52.342348+0000 mon.b (mon.2) 148 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2021-03-10T13:49:53.626 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:53 gibba045 bash[9787]: audit 2021-03-10T13:49:52.342623+0000 mon.b (mon.2) 149 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2021-03-10T13:49:53.626 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:53 gibba045 bash[9787]: audit 2021-03-10T13:49:52.342931+0000 mon.b (mon.2) 150 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2021-03-10T13:49:53.626 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:53 gibba045 bash[9787]: audit 2021-03-10T13:49:52.343209+0000 mon.b (mon.2) 151 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2021-03-10T13:49:53.626 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:53 gibba045 bash[9787]: audit 2021-03-10T13:49:52.343426+0000 mon.b (mon.2) 152 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2021-03-10T13:49:53.627 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:53 gibba045 bash[9787]: audit 2021-03-10T13:49:52.343735+0000 mon.b (mon.2) 153 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2021-03-10T13:49:53.627 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:53 gibba045 bash[9787]: audit 2021-03-10T13:49:52.344039+0000 mon.b (mon.2) 154 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2021-03-10T13:49:53.627 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:53 gibba045 bash[9787]: audit 2021-03-10T13:49:52.344311+0000 mon.b (mon.2) 155 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:49:53.627 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:53 gibba045 bash[9787]: audit 2021-03-10T13:49:52.344588+0000 mon.b (mon.2) 156 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:49:53.628 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:53 gibba045 bash[9787]: audit 2021-03-10T13:49:52.344924+0000 mon.b (mon.2) 157 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2021-03-10T13:49:53.628 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:53 gibba045 bash[9787]: audit 2021-03-10T13:49:52.345189+0000 mon.b (mon.2) 158 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2021-03-10T13:49:53.628 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:53 gibba045 bash[9787]: audit 2021-03-10T13:49:52.345477+0000 mon.b (mon.2) 159 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2021-03-10T13:49:53.628 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:53 gibba045 bash[9787]: audit 2021-03-10T13:49:52.345802+0000 mon.b (mon.2) 160 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2021-03-10T13:49:53.628 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:53 gibba045 bash[9787]: cluster 2021-03-10T13:49:52.347391+0000 mon.a (mon.0) 24 : cluster [INF] Manager daemon gibba045.orlgmj is now available 2021-03-10T13:49:53.629 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:53 gibba045 bash[9787]: audit 2021-03-10T13:49:52.434807+0000 mon.b (mon.2) 161 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:49:53.629 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:53 gibba045 bash[9787]: audit 2021-03-10T13:49:52.457692+0000 mon.b (mon.2) 162 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:49:53.629 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:53 gibba045 bash[9787]: audit 2021-03-10T13:49:52.458184+0000 mon.a (mon.0) 25 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:49:53.629 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:53 gibba045 bash[9787]: audit 2021-03-10T13:49:52.463107+0000 mon.b (mon.2) 163 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T13:49:53.630 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:53 gibba045 bash[9787]: audit 2021-03-10T13:49:52.463446+0000 mon.a (mon.0) 26 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T13:49:53.630 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:53 gibba045 bash[9787]: audit 2021-03-10T13:49:52.623037+0000 mon.b (mon.2) 164 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:49:53.630 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:53 gibba045 bash[9787]: audit 2021-03-10T13:49:52.783036+0000 mon.b (mon.2) 165 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101774786, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721104Z\", \"created\": \"2021-03-10T13:40:16.047558Z\", \"started\": \"2021-03-10T13:40:16.069701Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba045\", \"container_id\": \"0b25900c63e0\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 373817344, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721263Z\", \"created\": \"2021-03-10T13:40:32.015558Z\", \"started\": \"2021-03-10T13:48:33.658328Z\"}, \"mgr.gibba045.orlgmj\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba045.orlgmj\", \"hostname\": \"gibba045\", \"container_id\": \"ea964e825589\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 403701760, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721358Z\", \"created\": \"2021-03-10T13:40:34.535558Z\", \"started\": \"2021-03-10T13:48:50.630289Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48360325, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721446Z\", \"created\": \"2021-03-10T13:42:17.077564Z\", \"started\": \"2021-03-10T13:42:20.232803Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47238348, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721681Z\", \"created\": \"2021-03-10T13:42:38.781564Z\", \"started\": \"2021-03-10T13:42:42.298036Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46357544, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721874Z\", \"created\": \"2021-03-10T13:43:00.493564Z\", \"started\": \"2021-03-10T13:43:03.477079Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48255467, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722061Z\", \"created\": \"2021-03-10T13:43:22.897564Z\", \"started\": \"2021-03-10T13:43:26.167781Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba045\", \"container_id\": \"b3907fa26ba0\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 34697379, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722246Z\", \"created\": \"2021-03-10T13:43:42.821564Z\", \"started\": \"2021-03-10T13:44:24.396576Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23991418, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722341Z\", \"created\": \"2021-03-10T13:43:43.861564Z\", \"started\": \"2021-03-10T13:43:45.351099Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba045\", \"container_id\": \"d86cab6511db\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29611786, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722427Z\", \"created\": \"2021-03-10T13:44:08.721564Z\", \"started\": \"2021-03-10T13:44:08.746042Z\"}, \"rgw.r.z.gibba045.atotkw\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba045.atotkw\", \"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722512Z\", \"created\": \"2021-03-10T13:45:45.925564Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:17.529027Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:21.028684Z\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:37.919264Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:44:17.558720Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818Z\"}, \"rgw.r.z.gibba045.atotkw\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:44.004644Z\"}}, \"last_device_update\": \"2021-03-10T13:43:30.693305Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:49:52.782023Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:49:53.630 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:53 gibba045 bash[9787]: audit 2021-03-10T13:49:52.786410+0000 mon.a (mon.0) 27 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:49:53.631 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:53 gibba045 bash[9787]: audit 2021-03-10T13:49:52.788038+0000 mon.b (mon.2) 166 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:49:53.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[29377]: cluster 2021-03-10T13:49:52.331526+0000 mon.a (mon.0) 23 : cluster [DBG] mgrmap e23: gibba045.orlgmj(active, starting, since 0.715892s), standbys: x, y 2021-03-10T13:49:53.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[29377]: audit 2021-03-10T13:49:52.336124+0000 mon.b (mon.2) 124 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "mgr metadata", "who": "gibba045.orlgmj", "id": "gibba045.orlgmj"}]: dispatch 2021-03-10T13:49:53.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[29377]: audit 2021-03-10T13:49:52.336261+0000 mon.b (mon.2) 125 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-03-10T13:49:53.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[29377]: audit 2021-03-10T13:49:52.336382+0000 mon.b (mon.2) 126 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-03-10T13:49:53.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[29377]: audit 2021-03-10T13:49:52.336509+0000 mon.b (mon.2) 127 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T13:49:53.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[29377]: audit 2021-03-10T13:49:52.336641+0000 mon.b (mon.2) 128 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T13:49:53.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[29377]: audit 2021-03-10T13:49:52.336766+0000 mon.b (mon.2) 129 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T13:49:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[29377]: audit 2021-03-10T13:49:52.336891+0000 mon.b (mon.2) 130 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T13:49:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[29377]: audit 2021-03-10T13:49:52.337010+0000 mon.b (mon.2) 131 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T13:49:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[29377]: audit 2021-03-10T13:49:52.337134+0000 mon.b (mon.2) 132 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T13:49:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[29377]: audit 2021-03-10T13:49:52.337253+0000 mon.b (mon.2) 133 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T13:49:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[29377]: audit 2021-03-10T13:49:52.337381+0000 mon.b (mon.2) 134 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T13:49:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[29377]: audit 2021-03-10T13:49:52.337893+0000 mon.b (mon.2) 135 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-03-10T13:49:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[29377]: audit 2021-03-10T13:49:52.338000+0000 mon.b (mon.2) 136 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-03-10T13:49:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[29377]: audit 2021-03-10T13:49:52.338293+0000 mon.b (mon.2) 137 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-03-10T13:49:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[29377]: audit 2021-03-10T13:49:52.338791+0000 mon.b (mon.2) 138 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key ls"}]: dispatch 2021-03-10T13:49:53.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[29377]: audit 2021-03-10T13:49:52.339383+0000 mon.b (mon.2) 139 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2021-03-10T13:49:53.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[13005]: cluster 2021-03-10T13:49:52.331526+0000 mon.a (mon.0) 23 : cluster [DBG] mgrmap e23: gibba045.orlgmj(active, starting, since 0.715892s), standbys: x, y 2021-03-10T13:49:53.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[13005]: audit 2021-03-10T13:49:52.336124+0000 mon.b (mon.2) 124 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "mgr metadata", "who": "gibba045.orlgmj", "id": "gibba045.orlgmj"}]: dispatch 2021-03-10T13:49:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[13005]: audit 2021-03-10T13:49:52.336261+0000 mon.b (mon.2) 125 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-03-10T13:49:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[13005]: audit 2021-03-10T13:49:52.336382+0000 mon.b (mon.2) 126 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-03-10T13:49:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[13005]: audit 2021-03-10T13:49:52.336509+0000 mon.b (mon.2) 127 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T13:49:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[13005]: audit 2021-03-10T13:49:52.336641+0000 mon.b (mon.2) 128 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T13:49:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[13005]: audit 2021-03-10T13:49:52.336766+0000 mon.b (mon.2) 129 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T13:49:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[13005]: audit 2021-03-10T13:49:52.336891+0000 mon.b (mon.2) 130 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T13:49:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[13005]: audit 2021-03-10T13:49:52.337010+0000 mon.b (mon.2) 131 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T13:49:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[13005]: audit 2021-03-10T13:49:52.337134+0000 mon.b (mon.2) 132 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T13:49:53.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[13005]: audit 2021-03-10T13:49:52.337253+0000 mon.b (mon.2) 133 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T13:49:53.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[13005]: audit 2021-03-10T13:49:52.337381+0000 mon.b (mon.2) 134 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T13:49:53.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[13005]: audit 2021-03-10T13:49:52.337893+0000 mon.b (mon.2) 135 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-03-10T13:49:53.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[13005]: audit 2021-03-10T13:49:52.338000+0000 mon.b (mon.2) 136 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-03-10T13:49:53.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[13005]: audit 2021-03-10T13:49:52.338293+0000 mon.b (mon.2) 137 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-03-10T13:49:53.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[13005]: audit 2021-03-10T13:49:52.338791+0000 mon.b (mon.2) 138 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key ls"}]: dispatch 2021-03-10T13:49:53.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[13005]: audit 2021-03-10T13:49:52.339383+0000 mon.b (mon.2) 139 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2021-03-10T13:49:53.732 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[29377]: audit 2021-03-10T13:49:52.339680+0000 mon.b (mon.2) 140 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2021-03-10T13:49:53.732 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[29377]: audit 2021-03-10T13:49:52.340038+0000 mon.b (mon.2) 141 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.gibba015"}]: dispatch 2021-03-10T13:49:53.732 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[29377]: audit 2021-03-10T13:49:52.340322+0000 mon.b (mon.2) 142 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.gibba045"}]: dispatch 2021-03-10T13:49:53.733 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[29377]: audit 2021-03-10T13:49:52.340600+0000 mon.b (mon.2) 143 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2021-03-10T13:49:53.733 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[29377]: audit 2021-03-10T13:49:52.340982+0000 mon.b (mon.2) 144 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/osd_remove_queue"}]: dispatch 2021-03-10T13:49:53.733 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[29377]: audit 2021-03-10T13:49:52.341348+0000 mon.b (mon.2) 145 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2021-03-10T13:49:53.733 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[29377]: audit 2021-03-10T13:49:52.341727+0000 mon.b (mon.2) 146 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2021-03-10T13:49:53.734 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[29377]: audit 2021-03-10T13:49:52.342063+0000 mon.b (mon.2) 147 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2021-03-10T13:49:53.734 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[29377]: audit 2021-03-10T13:49:52.342348+0000 mon.b (mon.2) 148 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2021-03-10T13:49:53.734 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[29377]: audit 2021-03-10T13:49:52.342623+0000 mon.b (mon.2) 149 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2021-03-10T13:49:53.734 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[29377]: audit 2021-03-10T13:49:52.342931+0000 mon.b (mon.2) 150 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2021-03-10T13:49:53.735 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[29377]: audit 2021-03-10T13:49:52.343209+0000 mon.b (mon.2) 151 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2021-03-10T13:49:53.735 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[29377]: audit 2021-03-10T13:49:52.343426+0000 mon.b (mon.2) 152 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2021-03-10T13:49:53.735 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[29377]: audit 2021-03-10T13:49:52.343735+0000 mon.b (mon.2) 153 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2021-03-10T13:49:53.735 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[29377]: audit 2021-03-10T13:49:52.344039+0000 mon.b (mon.2) 154 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2021-03-10T13:49:53.736 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[29377]: audit 2021-03-10T13:49:52.344311+0000 mon.b (mon.2) 155 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:49:53.736 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[13005]: audit 2021-03-10T13:49:52.339680+0000 mon.b (mon.2) 140 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2021-03-10T13:49:53.736 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[13005]: audit 2021-03-10T13:49:52.340038+0000 mon.b (mon.2) 141 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.gibba015"}]: dispatch 2021-03-10T13:49:53.737 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[13005]: audit 2021-03-10T13:49:52.340322+0000 mon.b (mon.2) 142 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.gibba045"}]: dispatch 2021-03-10T13:49:53.737 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[13005]: audit 2021-03-10T13:49:52.340600+0000 mon.b (mon.2) 143 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2021-03-10T13:49:53.737 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[13005]: audit 2021-03-10T13:49:52.340982+0000 mon.b (mon.2) 144 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/osd_remove_queue"}]: dispatch 2021-03-10T13:49:53.737 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[13005]: audit 2021-03-10T13:49:52.341348+0000 mon.b (mon.2) 145 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2021-03-10T13:49:53.738 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[13005]: audit 2021-03-10T13:49:52.341727+0000 mon.b (mon.2) 146 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2021-03-10T13:49:53.738 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[13005]: audit 2021-03-10T13:49:52.342063+0000 mon.b (mon.2) 147 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2021-03-10T13:49:53.738 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[13005]: audit 2021-03-10T13:49:52.342348+0000 mon.b (mon.2) 148 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2021-03-10T13:49:53.738 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[13005]: audit 2021-03-10T13:49:52.342623+0000 mon.b (mon.2) 149 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2021-03-10T13:49:53.739 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[13005]: audit 2021-03-10T13:49:52.342931+0000 mon.b (mon.2) 150 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2021-03-10T13:49:53.739 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[13005]: audit 2021-03-10T13:49:52.343209+0000 mon.b (mon.2) 151 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2021-03-10T13:49:53.739 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[13005]: audit 2021-03-10T13:49:52.343426+0000 mon.b (mon.2) 152 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2021-03-10T13:49:53.739 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[13005]: audit 2021-03-10T13:49:52.343735+0000 mon.b (mon.2) 153 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2021-03-10T13:49:53.740 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[13005]: audit 2021-03-10T13:49:52.344039+0000 mon.b (mon.2) 154 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2021-03-10T13:49:53.740 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[13005]: audit 2021-03-10T13:49:52.344311+0000 mon.b (mon.2) 155 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:49:53.740 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[29377]: audit 2021-03-10T13:49:52.344588+0000 mon.b (mon.2) 156 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:49:53.741 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[29377]: audit 2021-03-10T13:49:52.344924+0000 mon.b (mon.2) 157 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2021-03-10T13:49:53.741 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[29377]: audit 2021-03-10T13:49:52.345189+0000 mon.b (mon.2) 158 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2021-03-10T13:49:53.741 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[29377]: audit 2021-03-10T13:49:52.345477+0000 mon.b (mon.2) 159 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2021-03-10T13:49:53.742 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[29377]: audit 2021-03-10T13:49:52.345802+0000 mon.b (mon.2) 160 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2021-03-10T13:49:53.742 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[29377]: cluster 2021-03-10T13:49:52.347391+0000 mon.a (mon.0) 24 : cluster [INF] Manager daemon gibba045.orlgmj is now available 2021-03-10T13:49:53.742 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[29377]: audit 2021-03-10T13:49:52.434807+0000 mon.b (mon.2) 161 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:49:53.742 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[29377]: audit 2021-03-10T13:49:52.457692+0000 mon.b (mon.2) 162 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:49:53.743 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[29377]: audit 2021-03-10T13:49:52.458184+0000 mon.a (mon.0) 25 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:49:53.743 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[29377]: audit 2021-03-10T13:49:52.463107+0000 mon.b (mon.2) 163 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T13:49:53.743 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[29377]: audit 2021-03-10T13:49:52.463446+0000 mon.a (mon.0) 26 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T13:49:53.743 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[29377]: audit 2021-03-10T13:49:52.623037+0000 mon.b (mon.2) 164 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:49:53.744 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[13005]: audit 2021-03-10T13:49:52.344588+0000 mon.b (mon.2) 156 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:49:53.744 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[13005]: audit 2021-03-10T13:49:52.344924+0000 mon.b (mon.2) 157 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2021-03-10T13:49:53.744 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[13005]: audit 2021-03-10T13:49:52.345189+0000 mon.b (mon.2) 158 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2021-03-10T13:49:53.745 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[13005]: audit 2021-03-10T13:49:52.345477+0000 mon.b (mon.2) 159 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2021-03-10T13:49:53.745 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[13005]: audit 2021-03-10T13:49:52.345802+0000 mon.b (mon.2) 160 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2021-03-10T13:49:53.745 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[13005]: cluster 2021-03-10T13:49:52.347391+0000 mon.a (mon.0) 24 : cluster [INF] Manager daemon gibba045.orlgmj is now available 2021-03-10T13:49:53.745 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[13005]: audit 2021-03-10T13:49:52.434807+0000 mon.b (mon.2) 161 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:49:53.746 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[13005]: audit 2021-03-10T13:49:52.457692+0000 mon.b (mon.2) 162 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:49:53.746 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[13005]: audit 2021-03-10T13:49:52.458184+0000 mon.a (mon.0) 25 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:49:53.746 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[13005]: audit 2021-03-10T13:49:52.463107+0000 mon.b (mon.2) 163 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T13:49:53.746 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[13005]: audit 2021-03-10T13:49:52.463446+0000 mon.a (mon.0) 26 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T13:49:53.747 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[13005]: audit 2021-03-10T13:49:52.623037+0000 mon.b (mon.2) 164 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:49:53.747 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[29377]: audit 2021-03-10T13:49:52.783036+0000 mon.b (mon.2) 165 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101774786, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721104Z\", \"created\": \"2021-03-10T13:40:16.047558Z\", \"started\": \"2021-03-10T13:40:16.069701Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba045\", \"container_id\": \"0b25900c63e0\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 373817344, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721263Z\", \"created\": \"2021-03-10T13:40:32.015558Z\", \"started\": \"2021-03-10T13:48:33.658328Z\"}, \"mgr.gibba045.orlgmj\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba045.orlgmj\", \"hostname\": \"gibba045\", \"container_id\": \"ea964e825589\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 403701760, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721358Z\", \"created\": \"2021-03-10T13:40:34.535558Z\", \"started\": \"2021-03-10T13:48:50.630289Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48360325, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721446Z\", \"created\": \"2021-03-10T13:42:17.077564Z\", \"started\": \"2021-03-10T13:42:20.232803Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47238348, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721681Z\", \"created\": \"2021-03-10T13:42:38.781564Z\", \"started\": \"2021-03-10T13:42:42.298036Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46357544, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721874Z\", \"created\": \"2021-03-10T13:43:00.493564Z\", \"started\": \"2021-03-10T13:43:03.477079Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48255467, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722061Z\", \"created\": \"2021-03-10T13:43:22.897564Z\", \"started\": \"2021-03-10T13:43:26.167781Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba045\", \"container_id\": \"b3907fa26ba0\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 34697379, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722246Z\", \"created\": \"2021-03-10T13:43:42.821564Z\", \"started\": \"2021-03-10T13:44:24.396576Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23991418, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722341Z\", \"created\": \"2021-03-10T13:43:43.861564Z\", \"started\": \"2021-03-10T13:43:45.351099Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba045\", \"container_id\": \"d86cab6511db\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29611786, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722427Z\", \"created\": \"2021-03-10T13:44:08.721564Z\", \"started\": \"2021-03-10T13:44:08.746042Z\"}, \"rgw.r.z.gibba045.atotkw\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba045.atotkw\", \"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722512Z\", \"created\": \"2021-03-10T13:45:45.925564Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:17.529027Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:21.028684Z\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:37.919264Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:44:17.558720Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818Z\"}, \"rgw.r.z.gibba045.atotkw\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:44.004644Z\"}}, \"last_device_update\": \"2021-03-10T13:43:30.693305Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:49:52.782023Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:49:53.748 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[29377]: audit 2021-03-10T13:49:52.786410+0000 mon.a (mon.0) 27 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:49:53.748 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[29377]: audit 2021-03-10T13:49:52.788038+0000 mon.b (mon.2) 166 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:49:53.748 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[13005]: audit 2021-03-10T13:49:52.783036+0000 mon.b (mon.2) 165 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101774786, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721104Z\", \"created\": \"2021-03-10T13:40:16.047558Z\", \"started\": \"2021-03-10T13:40:16.069701Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba045\", \"container_id\": \"0b25900c63e0\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 373817344, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721263Z\", \"created\": \"2021-03-10T13:40:32.015558Z\", \"started\": \"2021-03-10T13:48:33.658328Z\"}, \"mgr.gibba045.orlgmj\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba045.orlgmj\", \"hostname\": \"gibba045\", \"container_id\": \"ea964e825589\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 403701760, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721358Z\", \"created\": \"2021-03-10T13:40:34.535558Z\", \"started\": \"2021-03-10T13:48:50.630289Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48360325, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721446Z\", \"created\": \"2021-03-10T13:42:17.077564Z\", \"started\": \"2021-03-10T13:42:20.232803Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47238348, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721681Z\", \"created\": \"2021-03-10T13:42:38.781564Z\", \"started\": \"2021-03-10T13:42:42.298036Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46357544, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.721874Z\", \"created\": \"2021-03-10T13:43:00.493564Z\", \"started\": \"2021-03-10T13:43:03.477079Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48255467, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722061Z\", \"created\": \"2021-03-10T13:43:22.897564Z\", \"started\": \"2021-03-10T13:43:26.167781Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba045\", \"container_id\": \"b3907fa26ba0\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 34697379, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722246Z\", \"created\": \"2021-03-10T13:43:42.821564Z\", \"started\": \"2021-03-10T13:44:24.396576Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23991418, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722341Z\", \"created\": \"2021-03-10T13:43:43.861564Z\", \"started\": \"2021-03-10T13:43:45.351099Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba045\", \"container_id\": \"d86cab6511db\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29611786, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722427Z\", \"created\": \"2021-03-10T13:44:08.721564Z\", \"started\": \"2021-03-10T13:44:08.746042Z\"}, \"rgw.r.z.gibba045.atotkw\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba045.atotkw\", \"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:06.722512Z\", \"created\": \"2021-03-10T13:45:45.925564Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:17.529027Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:21.028684Z\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:37.919264Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:44:17.558720Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818Z\"}, \"rgw.r.z.gibba045.atotkw\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:44.004644Z\"}}, \"last_device_update\": \"2021-03-10T13:43:30.693305Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:49:52.782023Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:49:53.749 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[13005]: audit 2021-03-10T13:49:52.786410+0000 mon.a (mon.0) 27 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:49:53.749 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:53 gibba015 bash[13005]: audit 2021-03-10T13:49:52.788038+0000 mon.b (mon.2) 166 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:49:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:54 gibba015 bash[29377]: cluster 2021-03-10T13:49:53.350896+0000 mon.a (mon.0) 28 : cluster [DBG] mgrmap e24: gibba045.orlgmj(active, since 1.73526s), standbys: x, y 2021-03-10T13:49:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:54 gibba015 bash[29377]: cluster 2021-03-10T13:49:53.355156+0000 mgr.gibba045.orlgmj (mgr.34412) 1 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:54 gibba015 bash[29377]: cluster 2021-03-10T13:49:53.618186+0000 mgr.gibba045.orlgmj (mgr.34412) 2 : cluster [ERR] Unhandled exception from module 'dashboard' while running on mgr.gibba045.orlgmj: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:49:54.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:54 gibba015 bash[13005]: cluster 2021-03-10T13:49:53.350896+0000 mon.a (mon.0) 28 : cluster [DBG] mgrmap e24: gibba045.orlgmj(active, since 1.73526s), standbys: x, y 2021-03-10T13:49:54.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:54 gibba015 bash[13005]: cluster 2021-03-10T13:49:53.355156+0000 mgr.gibba045.orlgmj (mgr.34412) 1 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:54.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:54 gibba015 bash[13005]: cluster 2021-03-10T13:49:53.618186+0000 mgr.gibba045.orlgmj (mgr.34412) 2 : cluster [ERR] Unhandled exception from module 'dashboard' while running on mgr.gibba045.orlgmj: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:49:54.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:54 gibba045 bash[9787]: cluster 2021-03-10T13:49:53.350896+0000 mon.a (mon.0) 28 : cluster [DBG] mgrmap e24: gibba045.orlgmj(active, since 1.73526s), standbys: x, y 2021-03-10T13:49:54.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:54 gibba045 bash[9787]: cluster 2021-03-10T13:49:53.355156+0000 mgr.gibba045.orlgmj (mgr.34412) 1 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:54.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:54 gibba045 bash[9787]: cluster 2021-03-10T13:49:53.618186+0000 mgr.gibba045.orlgmj (mgr.34412) 2 : cluster [ERR] Unhandled exception from module 'dashboard' while running on mgr.gibba045.orlgmj: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:49:55.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:55 gibba015 bash[29377]: cluster 2021-03-10T13:49:54.338653+0000 mgr.gibba045.orlgmj (mgr.34412) 3 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:55.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:55 gibba015 bash[29377]: cluster 2021-03-10T13:49:54.349116+0000 mon.a (mon.0) 29 : cluster [INF] Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2021-03-10T13:49:55.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:55 gibba015 bash[29377]: cluster 2021-03-10T13:49:54.363888+0000 mon.a (mon.0) 30 : cluster [DBG] mgrmap e25: gibba045.orlgmj(active, since 2s), standbys: x, y 2021-03-10T13:49:55.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:55 gibba015 bash[13005]: cluster 2021-03-10T13:49:54.338653+0000 mgr.gibba045.orlgmj (mgr.34412) 3 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:55.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:55 gibba015 bash[13005]: cluster 2021-03-10T13:49:54.349116+0000 mon.a (mon.0) 29 : cluster [INF] Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2021-03-10T13:49:55.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:55 gibba015 bash[13005]: cluster 2021-03-10T13:49:54.363888+0000 mon.a (mon.0) 30 : cluster [DBG] mgrmap e25: gibba045.orlgmj(active, since 2s), standbys: x, y 2021-03-10T13:49:55.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:55 gibba045 bash[9787]: cluster 2021-03-10T13:49:54.338653+0000 mgr.gibba045.orlgmj (mgr.34412) 3 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:55.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:55 gibba045 bash[9787]: cluster 2021-03-10T13:49:54.349116+0000 mon.a (mon.0) 29 : cluster [INF] Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2021-03-10T13:49:55.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:55 gibba045 bash[9787]: cluster 2021-03-10T13:49:54.363888+0000 mon.a (mon.0) 30 : cluster [DBG] mgrmap e25: gibba045.orlgmj(active, since 2s), standbys: x, y 2021-03-10T13:49:57.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:57 gibba015 bash[29377]: audit 2021-03-10T13:49:56.380111+0000 mon.b (mon.2) 167 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"49fd96830250\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 39468400, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.378355Z\", \"created\": \"2021-03-10T13:38:50.668449Z\", \"started\": \"2021-03-10T13:49:45.247194Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba015\", \"container_id\": \"fb55e770cd62\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 374761062, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.378478Z\", \"created\": \"2021-03-10T13:38:58.024449Z\", \"started\": \"2021-03-10T13:49:36.120688Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96206848, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.378540Z\", \"created\": \"2021-03-10T13:40:03.296449Z\", \"started\": \"2021-03-10T13:40:03.320843Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49482301, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.378596Z\", \"created\": \"2021-03-10T13:40:50.072448Z\", \"started\": \"2021-03-10T13:40:53.142290Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50216304, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.378756Z\", \"created\": \"2021-03-10T13:41:11.556448Z\", \"started\": \"2021-03-10T13:41:15.069232Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46556774, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.378884Z\", \"created\": \"2021-03-10T13:41:34.244448Z\", \"started\": \"2021-03-10T13:41:37.507096Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48087695, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.379003Z\", \"created\": \"2021-03-10T13:41:57.328380Z\", \"started\": \"2021-03-10T13:42:00.781947Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23519559, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.379124Z\", \"created\": \"2021-03-10T13:43:44.272379Z\", \"started\": \"2021-03-10T13:43:47.550063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"df987682eada\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13075742, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.379186Z\", \"created\": \"2021-03-10T13:43:54.628379Z\", \"started\": \"2021-03-10T13:49:17.528199Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:08.925129Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:23.251574Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:49:10.777874Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:42.144291Z\"}}, \"last_daemon_update\": \"2021-03-10T13:49:56.379282Z\", \"last_device_update\": \"2021-03-10T13:42:03.853072Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:49:36.287812Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:49:57.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:57 gibba015 bash[29377]: audit 2021-03-10T13:49:56.383581+0000 mon.a (mon.0) 31 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:49:57.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:57 gibba015 bash[29377]: cephadm 2021-03-10T13:49:56.384805+0000 mgr.gibba045.orlgmj (mgr.34412) 5 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T13:49:57.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:57 gibba015 bash[13005]: audit 2021-03-10T13:49:56.380111+0000 mon.b (mon.2) 167 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"49fd96830250\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 39468400, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.378355Z\", \"created\": \"2021-03-10T13:38:50.668449Z\", \"started\": \"2021-03-10T13:49:45.247194Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba015\", \"container_id\": \"fb55e770cd62\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 374761062, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.378478Z\", \"created\": \"2021-03-10T13:38:58.024449Z\", \"started\": \"2021-03-10T13:49:36.120688Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96206848, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.378540Z\", \"created\": \"2021-03-10T13:40:03.296449Z\", \"started\": \"2021-03-10T13:40:03.320843Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49482301, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.378596Z\", \"created\": \"2021-03-10T13:40:50.072448Z\", \"started\": \"2021-03-10T13:40:53.142290Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50216304, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.378756Z\", \"created\": \"2021-03-10T13:41:11.556448Z\", \"started\": \"2021-03-10T13:41:15.069232Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46556774, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.378884Z\", \"created\": \"2021-03-10T13:41:34.244448Z\", \"started\": \"2021-03-10T13:41:37.507096Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48087695, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.379003Z\", \"created\": \"2021-03-10T13:41:57.328380Z\", \"started\": \"2021-03-10T13:42:00.781947Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23519559, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.379124Z\", \"created\": \"2021-03-10T13:43:44.272379Z\", \"started\": \"2021-03-10T13:43:47.550063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"df987682eada\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13075742, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.379186Z\", \"created\": \"2021-03-10T13:43:54.628379Z\", \"started\": \"2021-03-10T13:49:17.528199Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:08.925129Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:23.251574Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:49:10.777874Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:42.144291Z\"}}, \"last_daemon_update\": \"2021-03-10T13:49:56.379282Z\", \"last_device_update\": \"2021-03-10T13:42:03.853072Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:49:36.287812Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:49:57.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:57 gibba015 bash[13005]: audit 2021-03-10T13:49:56.383581+0000 mon.a (mon.0) 31 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:49:57.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:57 gibba015 bash[13005]: cephadm 2021-03-10T13:49:56.384805+0000 mgr.gibba045.orlgmj (mgr.34412) 5 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T13:49:57.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:57 gibba015 bash[29377]: audit 2021-03-10T13:49:56.730020+0000 mon.b (mon.2) 168 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 102173245, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.728154Z\", \"created\": \"2021-03-10T13:40:16.047558Z\", \"started\": \"2021-03-10T13:40:16.069701Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba045\", \"container_id\": \"0b25900c63e0\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 375599923, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.728260Z\", \"created\": \"2021-03-10T13:40:32.015558Z\", \"started\": \"2021-03-10T13:48:33.658328Z\"}, \"mgr.gibba045.orlgmj\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba045.orlgmj\", \"hostname\": \"gibba045\", \"container_id\": \"ea964e825589\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 403806617, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.728319Z\", \"created\": \"2021-03-10T13:40:34.535558Z\", \"started\": \"2021-03-10T13:48:50.630289Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49241128, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.728373Z\", \"created\": \"2021-03-10T13:42:17.077564Z\", \"started\": \"2021-03-10T13:42:20.232803Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47615836, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.728529Z\", \"created\": \"2021-03-10T13:42:38.781564Z\", \"started\": \"2021-03-10T13:42:42.298036Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47185920, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.728651Z\", \"created\": \"2021-03-10T13:43:00.493564Z\", \"started\": \"2021-03-10T13:43:03.477079Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48748298, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.728765Z\", \"created\": \"2021-03-10T13:43:22.897564Z\", \"started\": \"2021-03-10T13:43:26.167781Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba045\", \"container_id\": \"b3907fa26ba0\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 35116810, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.728880Z\", \"created\": \"2021-03-10T13:43:42.821564Z\", \"started\": \"2021-03-10T13:44:24.396576Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 24201134, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.728939Z\", \"created\": \"2021-03-10T13:43:43.861564Z\", \"started\": \"2021-03-10T13:43:45.351099Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba045\", \"container_id\": \"d86cab6511db\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29915873, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.728993Z\", \"created\": \"2021-03-10T13:44:08.721564Z\", \"started\": \"2021-03-10T13:44:08.746042Z\"}, \"rgw.r.z.gibba045.atotkw\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba045.atotkw\", \"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.729045Z\", \"created\": \"2021-03-10T13:45:45.925564Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:17.529027Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:21.028684Z\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:37.919264Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:44:17.558720Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818Z\"}, \"rgw.r.z.gibba045.atotkw\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:44.004644Z\"}}, \"last_daemon_update\": \"2021-03-10T13:49:56.729117Z\", \"last_device_update\": \"2021-03-10T13:43:30.693305Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:49:52.782023Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:49:57.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:57 gibba015 bash[29377]: audit 2021-03-10T13:49:56.742398+0000 mon.a (mon.0) 32 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:49:57.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:57 gibba015 bash[29377]: cephadm 2021-03-10T13:49:56.743833+0000 mgr.gibba045.orlgmj (mgr.34412) 6 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T13:49:57.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:57 gibba015 bash[29377]: audit 2021-03-10T13:49:56.931984+0000 mon.b (mon.2) 169 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T13:49:57.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:57 gibba015 bash[29377]: audit 2021-03-10T13:49:56.942055+0000 mon.a (mon.0) 33 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:49:57.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:57 gibba015 bash[29377]: audit 2021-03-10T13:49:56.947670+0000 mon.b (mon.2) 170 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:49:57.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:57 gibba015 bash[29377]: audit 2021-03-10T13:49:56.948972+0000 mon.b (mon.2) 171 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:49:57.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:57 gibba015 bash[29377]: audit 2021-03-10T13:49:56.950173+0000 mon.b (mon.2) 172 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2021-03-10T13:49:57.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:57 gibba015 bash[13005]: audit 2021-03-10T13:49:56.730020+0000 mon.b (mon.2) 168 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 102173245, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.728154Z\", \"created\": \"2021-03-10T13:40:16.047558Z\", \"started\": \"2021-03-10T13:40:16.069701Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba045\", \"container_id\": \"0b25900c63e0\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 375599923, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.728260Z\", \"created\": \"2021-03-10T13:40:32.015558Z\", \"started\": \"2021-03-10T13:48:33.658328Z\"}, \"mgr.gibba045.orlgmj\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba045.orlgmj\", \"hostname\": \"gibba045\", \"container_id\": \"ea964e825589\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 403806617, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.728319Z\", \"created\": \"2021-03-10T13:40:34.535558Z\", \"started\": \"2021-03-10T13:48:50.630289Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49241128, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.728373Z\", \"created\": \"2021-03-10T13:42:17.077564Z\", \"started\": \"2021-03-10T13:42:20.232803Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47615836, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.728529Z\", \"created\": \"2021-03-10T13:42:38.781564Z\", \"started\": \"2021-03-10T13:42:42.298036Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47185920, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.728651Z\", \"created\": \"2021-03-10T13:43:00.493564Z\", \"started\": \"2021-03-10T13:43:03.477079Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48748298, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.728765Z\", \"created\": \"2021-03-10T13:43:22.897564Z\", \"started\": \"2021-03-10T13:43:26.167781Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba045\", \"container_id\": \"b3907fa26ba0\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 35116810, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.728880Z\", \"created\": \"2021-03-10T13:43:42.821564Z\", \"started\": \"2021-03-10T13:44:24.396576Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 24201134, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.728939Z\", \"created\": \"2021-03-10T13:43:43.861564Z\", \"started\": \"2021-03-10T13:43:45.351099Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba045\", \"container_id\": \"d86cab6511db\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29915873, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.728993Z\", \"created\": \"2021-03-10T13:44:08.721564Z\", \"started\": \"2021-03-10T13:44:08.746042Z\"}, \"rgw.r.z.gibba045.atotkw\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba045.atotkw\", \"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.729045Z\", \"created\": \"2021-03-10T13:45:45.925564Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:17.529027Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:21.028684Z\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:37.919264Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:44:17.558720Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818Z\"}, \"rgw.r.z.gibba045.atotkw\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:44.004644Z\"}}, \"last_daemon_update\": \"2021-03-10T13:49:56.729117Z\", \"last_device_update\": \"2021-03-10T13:43:30.693305Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:49:52.782023Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:49:57.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:57 gibba015 bash[13005]: audit 2021-03-10T13:49:56.742398+0000 mon.a (mon.0) 32 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:49:57.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:57 gibba015 bash[13005]: cephadm 2021-03-10T13:49:56.743833+0000 mgr.gibba045.orlgmj (mgr.34412) 6 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T13:49:57.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:57 gibba015 bash[13005]: audit 2021-03-10T13:49:56.931984+0000 mon.b (mon.2) 169 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T13:49:57.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:57 gibba015 bash[13005]: audit 2021-03-10T13:49:56.942055+0000 mon.a (mon.0) 33 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:49:57.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:57 gibba015 bash[13005]: audit 2021-03-10T13:49:56.947670+0000 mon.b (mon.2) 170 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:49:57.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:57 gibba015 bash[13005]: audit 2021-03-10T13:49:56.948972+0000 mon.b (mon.2) 171 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:49:57.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:57 gibba015 bash[13005]: audit 2021-03-10T13:49:56.950173+0000 mon.b (mon.2) 172 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2021-03-10T13:49:57.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:57 gibba045 bash[9787]: audit 2021-03-10T13:49:56.380111+0000 mon.b (mon.2) 167 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"49fd96830250\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 39468400, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.378355Z\", \"created\": \"2021-03-10T13:38:50.668449Z\", \"started\": \"2021-03-10T13:49:45.247194Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba015\", \"container_id\": \"fb55e770cd62\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 374761062, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.378478Z\", \"created\": \"2021-03-10T13:38:58.024449Z\", \"started\": \"2021-03-10T13:49:36.120688Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba015\", \"container_id\": \"d2d863b7e101\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96206848, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.378540Z\", \"created\": \"2021-03-10T13:40:03.296449Z\", \"started\": \"2021-03-10T13:40:03.320843Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49482301, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.378596Z\", \"created\": \"2021-03-10T13:40:50.072448Z\", \"started\": \"2021-03-10T13:40:53.142290Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50216304, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.378756Z\", \"created\": \"2021-03-10T13:41:11.556448Z\", \"started\": \"2021-03-10T13:41:15.069232Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46556774, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.378884Z\", \"created\": \"2021-03-10T13:41:34.244448Z\", \"started\": \"2021-03-10T13:41:37.507096Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48087695, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.379003Z\", \"created\": \"2021-03-10T13:41:57.328380Z\", \"started\": \"2021-03-10T13:42:00.781947Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23519559, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.379124Z\", \"created\": \"2021-03-10T13:43:44.272379Z\", \"started\": \"2021-03-10T13:43:47.550063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"df987682eada\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13075742, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.379186Z\", \"created\": \"2021-03-10T13:43:54.628379Z\", \"started\": \"2021-03-10T13:49:17.528199Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:08.925129Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:23.251574Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:49:10.777874Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:42.144291Z\"}}, \"last_daemon_update\": \"2021-03-10T13:49:56.379282Z\", \"last_device_update\": \"2021-03-10T13:42:03.853072Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:49:36.287812Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:49:57.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:57 gibba045 bash[9787]: audit 2021-03-10T13:49:56.383581+0000 mon.a (mon.0) 31 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:49:57.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:57 gibba045 bash[9787]: cephadm 2021-03-10T13:49:56.384805+0000 mgr.gibba045.orlgmj (mgr.34412) 5 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T13:49:57.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:57 gibba045 bash[9787]: audit 2021-03-10T13:49:56.730020+0000 mon.b (mon.2) 168 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba045","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba045\", \"container_id\": \"2523bc3385be\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 102173245, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.728154Z\", \"created\": \"2021-03-10T13:40:16.047558Z\", \"started\": \"2021-03-10T13:40:16.069701Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba045\", \"container_id\": \"0b25900c63e0\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 375599923, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.728260Z\", \"created\": \"2021-03-10T13:40:32.015558Z\", \"started\": \"2021-03-10T13:48:33.658328Z\"}, \"mgr.gibba045.orlgmj\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba045.orlgmj\", \"hostname\": \"gibba045\", \"container_id\": \"ea964e825589\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 403806617, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.728319Z\", \"created\": \"2021-03-10T13:40:34.535558Z\", \"started\": \"2021-03-10T13:48:50.630289Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba045\", \"container_id\": \"9b9c84c84955\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49241128, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.728373Z\", \"created\": \"2021-03-10T13:42:17.077564Z\", \"started\": \"2021-03-10T13:42:20.232803Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba045\", \"container_id\": \"662e73261675\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47615836, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.728529Z\", \"created\": \"2021-03-10T13:42:38.781564Z\", \"started\": \"2021-03-10T13:42:42.298036Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba045\", \"container_id\": \"338d252f22e3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47185920, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.728651Z\", \"created\": \"2021-03-10T13:43:00.493564Z\", \"started\": \"2021-03-10T13:43:03.477079Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba045\", \"container_id\": \"784edc0668a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48748298, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.728765Z\", \"created\": \"2021-03-10T13:43:22.897564Z\", \"started\": \"2021-03-10T13:43:26.167781Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba045\", \"container_id\": \"b3907fa26ba0\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 35116810, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.728880Z\", \"created\": \"2021-03-10T13:43:42.821564Z\", \"started\": \"2021-03-10T13:44:24.396576Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba045\", \"container_id\": \"369947ba7ea0\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 24201134, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.728939Z\", \"created\": \"2021-03-10T13:43:43.861564Z\", \"started\": \"2021-03-10T13:43:45.351099Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba045\", \"container_id\": \"d86cab6511db\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29915873, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.728993Z\", \"created\": \"2021-03-10T13:44:08.721564Z\", \"started\": \"2021-03-10T13:44:08.746042Z\"}, \"rgw.r.z.gibba045.atotkw\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba045.atotkw\", \"hostname\": \"gibba045\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.729045Z\", \"created\": \"2021-03-10T13:45:45.925564Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"d10c3d75-2027-4372-9bcb-24a1c376704e\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Q0rF9e-5rei-3j68-j9dN-FplO-UXVD-JjZkOL\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1f6bac7-fc45-424c-be0e-0ed40192d2a1\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"Ghb71X-E4bj-Vbr3-byFb-AZbJ-gYxd-awYfbJ\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a848ae-eccd-42a4-8537-dde9fbce70f3\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"2XFxBG-F4dn-5Gf0-aIrS-7rhZ-dMuZ-vtwekQ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f89e5ff0-e6b3-48aa-ab0b-dd8a61a3a90f\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"8VLkUu-vmg5-8cvm-PHqf-Uk5R-xoMi-fRiiy7\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CR375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PQF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:17.529027Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:21.028684Z\"}, \"mgr.gibba045.orlgmj\": {\"deps\": [], \"last_config\": \"2021-03-10T13:48:37.919264Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:15.331684Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:37.042434Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:42:58.832249Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:21.080770Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:44:17.558720Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.447872Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:43:56.672818Z\"}, \"rgw.r.z.gibba045.atotkw\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:44.004644Z\"}}, \"last_daemon_update\": \"2021-03-10T13:49:56.729117Z\", \"last_device_update\": \"2021-03-10T13:43:30.693305Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.145\"], \"172.21.15.254\": [\"172.21.2.145\"]}, \"last_host_check\": \"2021-03-10T13:49:52.782023Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:49:57.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:57 gibba045 bash[9787]: audit 2021-03-10T13:49:56.742398+0000 mon.a (mon.0) 32 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:49:57.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:57 gibba045 bash[9787]: cephadm 2021-03-10T13:49:56.743833+0000 mgr.gibba045.orlgmj (mgr.34412) 6 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T13:49:57.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:57 gibba045 bash[9787]: audit 2021-03-10T13:49:56.931984+0000 mon.b (mon.2) 169 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T13:49:57.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:57 gibba045 bash[9787]: audit 2021-03-10T13:49:56.942055+0000 mon.a (mon.0) 33 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:49:57.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:57 gibba045 bash[9787]: audit 2021-03-10T13:49:56.947670+0000 mon.b (mon.2) 170 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:49:57.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:57 gibba045 bash[9787]: audit 2021-03-10T13:49:56.948972+0000 mon.b (mon.2) 171 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:49:57.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:57 gibba045 bash[9787]: audit 2021-03-10T13:49:56.950173+0000 mon.b (mon.2) 172 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2021-03-10T13:49:58.552 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:58 gibba015 bash[29377]: cluster 2021-03-10T13:49:56.931666+0000 mgr.gibba045.orlgmj (mgr.34412) 7 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:58.553 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:58 gibba015 bash[29377]: cephadm 2021-03-10T13:49:56.947006+0000 mgr.gibba045.orlgmj (mgr.34412) 8 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:49:58.553 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:58 gibba015 bash[29377]: cephadm 2021-03-10T13:49:56.948650+0000 mgr.gibba045.orlgmj (mgr.34412) 9 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:49:58.553 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:58 gibba015 bash[29377]: cephadm 2021-03-10T13:49:56.949838+0000 mgr.gibba045.orlgmj (mgr.34412) 10 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:49:58.553 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:58 gibba015 bash[29377]: cephadm 2021-03-10T13:49:56.949875+0000 mgr.gibba045.orlgmj (mgr.34412) 11 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:49:58.553 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:58 gibba015 bash[29377]: cephadm 2021-03-10T13:49:56.950811+0000 mgr.gibba045.orlgmj (mgr.34412) 12 : cephadm [INF] It is presumed safe to stop mon.c 2021-03-10T13:49:58.554 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:58 gibba015 bash[29377]: cephadm 2021-03-10T13:49:56.950849+0000 mgr.gibba045.orlgmj (mgr.34412) 13 : cephadm [INF] Upgrade: It is presumed safe to stop mon.c 2021-03-10T13:49:58.554 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:58 gibba015 bash[29377]: cluster 2021-03-10T13:49:57.311192+0000 mon.a (mon.0) 34 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2021-03-10T13:49:58.554 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:58 gibba015 bash[13005]: cluster 2021-03-10T13:49:56.931666+0000 mgr.gibba045.orlgmj (mgr.34412) 7 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:58.555 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:58 gibba015 bash[13005]: cephadm 2021-03-10T13:49:56.947006+0000 mgr.gibba045.orlgmj (mgr.34412) 8 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:49:58.555 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:58 gibba015 bash[13005]: cephadm 2021-03-10T13:49:56.948650+0000 mgr.gibba045.orlgmj (mgr.34412) 9 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:49:58.555 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:58 gibba015 bash[13005]: cephadm 2021-03-10T13:49:56.949838+0000 mgr.gibba045.orlgmj (mgr.34412) 10 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:49:58.555 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:58 gibba015 bash[13005]: cephadm 2021-03-10T13:49:56.949875+0000 mgr.gibba045.orlgmj (mgr.34412) 11 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:49:58.556 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:58 gibba015 bash[13005]: cephadm 2021-03-10T13:49:56.950811+0000 mgr.gibba045.orlgmj (mgr.34412) 12 : cephadm [INF] It is presumed safe to stop mon.c 2021-03-10T13:49:58.556 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:58 gibba015 bash[13005]: cephadm 2021-03-10T13:49:56.950849+0000 mgr.gibba045.orlgmj (mgr.34412) 13 : cephadm [INF] Upgrade: It is presumed safe to stop mon.c 2021-03-10T13:49:58.556 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:58 gibba015 bash[13005]: cluster 2021-03-10T13:49:57.311192+0000 mon.a (mon.0) 34 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2021-03-10T13:49:58.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:58 gibba045 bash[9787]: cluster 2021-03-10T13:49:56.931666+0000 mgr.gibba045.orlgmj (mgr.34412) 7 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:58.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:58 gibba045 bash[9787]: cephadm 2021-03-10T13:49:56.947006+0000 mgr.gibba045.orlgmj (mgr.34412) 8 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:49:58.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:58 gibba045 bash[9787]: cephadm 2021-03-10T13:49:56.948650+0000 mgr.gibba045.orlgmj (mgr.34412) 9 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:49:58.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:58 gibba045 bash[9787]: cephadm 2021-03-10T13:49:56.949838+0000 mgr.gibba045.orlgmj (mgr.34412) 10 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:49:58.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:58 gibba045 bash[9787]: cephadm 2021-03-10T13:49:56.949875+0000 mgr.gibba045.orlgmj (mgr.34412) 11 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:49:58.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:58 gibba045 bash[9787]: cephadm 2021-03-10T13:49:56.950811+0000 mgr.gibba045.orlgmj (mgr.34412) 12 : cephadm [INF] It is presumed safe to stop mon.c 2021-03-10T13:49:58.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:58 gibba045 bash[9787]: cephadm 2021-03-10T13:49:56.950849+0000 mgr.gibba045.orlgmj (mgr.34412) 13 : cephadm [INF] Upgrade: It is presumed safe to stop mon.c 2021-03-10T13:49:58.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:58 gibba045 bash[9787]: cluster 2021-03-10T13:49:57.311192+0000 mon.a (mon.0) 34 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2021-03-10T13:49:59.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:59 gibba015 bash[29377]: audit 2021-03-10T13:49:59.010679+0000 mon.b (mon.2) 173 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mon.c"}]: dispatch 2021-03-10T13:49:59.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:59 gibba015 bash[29377]: audit 2021-03-10T13:49:59.015392+0000 mon.a (mon.0) 35 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:49:59.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:59 gibba015 bash[29377]: audit 2021-03-10T13:49:59.026855+0000 mon.b (mon.2) 174 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:49:59.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:59 gibba015 bash[29377]: audit 2021-03-10T13:49:59.029798+0000 mon.b (mon.2) 175 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:49:59.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:59 gibba015 bash[29377]: audit 2021-03-10T13:49:59.032534+0000 mon.b (mon.2) 176 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:49:59.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:49:59 gibba015 bash[29377]: audit 2021-03-10T13:49:59.036359+0000 mon.b (mon.2) 177 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2021-03-10T13:49:59.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:59 gibba015 bash[13005]: audit 2021-03-10T13:49:59.010679+0000 mon.b (mon.2) 173 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mon.c"}]: dispatch 2021-03-10T13:49:59.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:59 gibba015 bash[13005]: audit 2021-03-10T13:49:59.015392+0000 mon.a (mon.0) 35 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:49:59.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:59 gibba015 bash[13005]: audit 2021-03-10T13:49:59.026855+0000 mon.b (mon.2) 174 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:49:59.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:59 gibba015 bash[13005]: audit 2021-03-10T13:49:59.029798+0000 mon.b (mon.2) 175 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:49:59.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:59 gibba015 bash[13005]: audit 2021-03-10T13:49:59.032534+0000 mon.b (mon.2) 176 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:49:59.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:49:59 gibba015 bash[13005]: audit 2021-03-10T13:49:59.036359+0000 mon.b (mon.2) 177 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2021-03-10T13:49:59.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:59 gibba045 bash[9787]: audit 2021-03-10T13:49:59.010679+0000 mon.b (mon.2) 173 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mon.c"}]: dispatch 2021-03-10T13:49:59.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:59 gibba045 bash[9787]: audit 2021-03-10T13:49:59.015392+0000 mon.a (mon.0) 35 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:49:59.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:59 gibba045 bash[9787]: audit 2021-03-10T13:49:59.026855+0000 mon.b (mon.2) 174 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:49:59.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:59 gibba045 bash[9787]: audit 2021-03-10T13:49:59.029798+0000 mon.b (mon.2) 175 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:49:59.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:59 gibba045 bash[9787]: audit 2021-03-10T13:49:59.032534+0000 mon.b (mon.2) 176 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:49:59.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:49:59 gibba045 bash[9787]: audit 2021-03-10T13:49:59.036359+0000 mon.b (mon.2) 177 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2021-03-10T13:50:00.286 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:00 gibba015 bash[29377]: debug 2021-03-10T13:49:59.995+0000 7f21beb4f700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:50:00.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:00 gibba015 bash[29377]: cluster 2021-03-10T13:49:58.933503+0000 mgr.gibba045.orlgmj (mgr.34412) 14 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:00.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:00 gibba015 bash[29377]: cephadm 2021-03-10T13:49:59.009584+0000 mgr.gibba045.orlgmj (mgr.34412) 15 : cephadm [INF] Upgrade: Updating mon.c 2021-03-10T13:50:00.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:00 gibba015 bash[29377]: cephadm 2021-03-10T13:49:59.034852+0000 mgr.gibba045.orlgmj (mgr.34412) 16 : cephadm [INF] Deploying daemon mon.c on gibba015 2021-03-10T13:50:00.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:00 gibba015 bash[29377]: cluster 2021-03-10T13:50:00.000244+0000 mon.a (mon.0) 36 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:50:00.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:00 gibba015 bash[13005]: cluster 2021-03-10T13:49:58.933503+0000 mgr.gibba045.orlgmj (mgr.34412) 14 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:00.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:00 gibba015 bash[13005]: cephadm 2021-03-10T13:49:59.009584+0000 mgr.gibba045.orlgmj (mgr.34412) 15 : cephadm [INF] Upgrade: Updating mon.c 2021-03-10T13:50:00.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:00 gibba015 bash[13005]: cephadm 2021-03-10T13:49:59.034852+0000 mgr.gibba045.orlgmj (mgr.34412) 16 : cephadm [INF] Deploying daemon mon.c on gibba015 2021-03-10T13:50:00.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:00 gibba015 bash[13005]: cluster 2021-03-10T13:50:00.000244+0000 mon.a (mon.0) 36 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:50:00.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:00 gibba045 bash[9787]: cluster 2021-03-10T13:49:58.933503+0000 mgr.gibba045.orlgmj (mgr.34412) 14 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:00.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:00 gibba045 bash[9787]: cephadm 2021-03-10T13:49:59.009584+0000 mgr.gibba045.orlgmj (mgr.34412) 15 : cephadm [INF] Upgrade: Updating mon.c 2021-03-10T13:50:00.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:00 gibba045 bash[9787]: cephadm 2021-03-10T13:49:59.034852+0000 mgr.gibba045.orlgmj (mgr.34412) 16 : cephadm [INF] Deploying daemon mon.c on gibba015 2021-03-10T13:50:00.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:00 gibba045 bash[9787]: cluster 2021-03-10T13:50:00.000244+0000 mon.a (mon.0) 36 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:50:01.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:00 gibba015 systemd[1]: Stopping Ceph mon.c for e4a642d2-81a5-11eb-9080-001a4aab830c... 2021-03-10T13:50:01.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:01 gibba015 bash[13005]: debug 2021-03-10T13:50:01.071+0000 7ff3044da700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2021-03-10T13:50:01.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:01 gibba015 bash[13005]: debug 2021-03-10T13:50:01.071+0000 7ff3044da700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2021-03-10T13:50:02.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:01 gibba015 docker[30245]: ceph-e4a642d2-81a5-11eb-9080-001a4aab830c-mon.c 2021-03-10T13:50:02.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:01 gibba015 systemd[1]: ceph-e4a642d2-81a5-11eb-9080-001a4aab830c@mon.c.service: Succeeded. 2021-03-10T13:50:02.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:01 gibba015 systemd[1]: Stopped Ceph mon.c for e4a642d2-81a5-11eb-9080-001a4aab830c. 2021-03-10T13:50:02.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:02 gibba015 systemd[1]: Started Ceph mon.c for e4a642d2-81a5-11eb-9080-001a4aab830c. 2021-03-10T13:50:03.323 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.075+0000 7f0fa8aa7700 0 set uid:gid to 167:167 (ceph:ceph) 2021-03-10T13:50:03.323 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.075+0000 7f0fa8aa7700 0 ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev), process ceph-mon, pid 6 2021-03-10T13:50:03.324 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.075+0000 7f0fa8aa7700 0 pidfile_write: ignore empty --pid-file 2021-03-10T13:50:03.324 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 0 load: jerasure load: lrc load: isa 2021-03-10T13:50:03.324 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: RocksDB version: 6.8.1 2021-03-10T13:50:03.324 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2021-03-10T13:50:03.324 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Compile date Mar 9 2021 2021-03-10T13:50:03.325 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: DB SUMMARY 2021-03-10T13:50:03.325 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: CURRENT file: CURRENT 2021-03-10T13:50:03.325 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: IDENTITY file: IDENTITY 2021-03-10T13:50:03.325 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 771 Bytes 2021-03-10T13:50:03.326 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 2, files: 000022.sst 000023.sst 2021-03-10T13:50:03.326 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000020.log size: 17673975 ; 2021-03-10T13:50:03.326 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.error_if_exists: 0 2021-03-10T13:50:03.326 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.create_if_missing: 0 2021-03-10T13:50:03.326 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.paranoid_checks: 1 2021-03-10T13:50:03.327 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.env: 0x5578c71b21c0 2021-03-10T13:50:03.327 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.fs: Posix File System 2021-03-10T13:50:03.327 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.info_log: 0x5578c93131e0 2021-03-10T13:50:03.327 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.max_file_opening_threads: 16 2021-03-10T13:50:03.328 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.statistics: (nil) 2021-03-10T13:50:03.328 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.use_fsync: 0 2021-03-10T13:50:03.328 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.max_log_file_size: 0 2021-03-10T13:50:03.328 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2021-03-10T13:50:03.328 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.log_file_time_to_roll: 0 2021-03-10T13:50:03.329 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.keep_log_file_num: 1000 2021-03-10T13:50:03.329 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.recycle_log_file_num: 0 2021-03-10T13:50:03.330 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.allow_fallocate: 1 2021-03-10T13:50:03.330 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.allow_mmap_reads: 0 2021-03-10T13:50:03.331 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.allow_mmap_writes: 0 2021-03-10T13:50:03.331 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.use_direct_reads: 0 2021-03-10T13:50:03.331 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2021-03-10T13:50:03.331 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.create_missing_column_families: 0 2021-03-10T13:50:03.332 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.db_log_dir: 2021-03-10T13:50:03.332 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-c/store.db 2021-03-10T13:50:03.332 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.table_cache_numshardbits: 6 2021-03-10T13:50:03.332 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.max_subcompactions: 1 2021-03-10T13:50:03.332 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.max_background_flushes: -1 2021-03-10T13:50:03.333 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.WAL_ttl_seconds: 0 2021-03-10T13:50:03.333 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.WAL_size_limit_MB: 0 2021-03-10T13:50:03.333 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2021-03-10T13:50:03.333 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2021-03-10T13:50:03.333 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.is_fd_close_on_exec: 1 2021-03-10T13:50:03.334 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.advise_random_on_open: 1 2021-03-10T13:50:03.334 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.db_write_buffer_size: 0 2021-03-10T13:50:03.334 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.write_buffer_manager: 0x5578c9367c50 2021-03-10T13:50:03.334 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2021-03-10T13:50:03.335 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2021-03-10T13:50:03.335 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2021-03-10T13:50:03.335 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.use_adaptive_mutex: 0 2021-03-10T13:50:03.335 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.rate_limiter: (nil) 2021-03-10T13:50:03.335 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2021-03-10T13:50:03.336 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.wal_recovery_mode: 2 2021-03-10T13:50:03.336 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.enable_thread_tracking: 0 2021-03-10T13:50:03.336 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.enable_pipelined_write: 0 2021-03-10T13:50:03.336 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.unordered_write: 0 2021-03-10T13:50:03.337 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2021-03-10T13:50:03.337 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2021-03-10T13:50:03.337 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2021-03-10T13:50:03.337 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2021-03-10T13:50:03.338 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.row_cache: None 2021-03-10T13:50:03.338 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.wal_filter: None 2021-03-10T13:50:03.338 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2021-03-10T13:50:03.338 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.allow_ingest_behind: 0 2021-03-10T13:50:03.338 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.preserve_deletes: 0 2021-03-10T13:50:03.339 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.two_write_queues: 0 2021-03-10T13:50:03.339 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.manual_wal_flush: 0 2021-03-10T13:50:03.339 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.atomic_flush: 0 2021-03-10T13:50:03.339 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2021-03-10T13:50:03.340 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.persist_stats_to_disk: 0 2021-03-10T13:50:03.340 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.write_dbid_to_manifest: 0 2021-03-10T13:50:03.340 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.log_readahead_size: 0 2021-03-10T13:50:03.340 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.sst_file_checksum_func: Unknown 2021-03-10T13:50:03.340 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.max_background_jobs: 2 2021-03-10T13:50:03.341 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.max_background_compactions: -1 2021-03-10T13:50:03.341 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2021-03-10T13:50:03.341 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2021-03-10T13:50:03.341 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.delayed_write_rate : 16777216 2021-03-10T13:50:03.342 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.max_total_wal_size: 0 2021-03-10T13:50:03.342 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2021-03-10T13:50:03.342 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.stats_dump_period_sec: 600 2021-03-10T13:50:03.342 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.stats_persist_period_sec: 600 2021-03-10T13:50:03.342 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2021-03-10T13:50:03.343 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.max_open_files: -1 2021-03-10T13:50:03.343 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.bytes_per_sync: 0 2021-03-10T13:50:03.343 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.wal_bytes_per_sync: 0 2021-03-10T13:50:03.343 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.strict_bytes_per_sync: 0 2021-03-10T13:50:03.343 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.compaction_readahead_size: 0 2021-03-10T13:50:03.344 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Compression algorithms supported: 2021-03-10T13:50:03.344 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2021-03-10T13:50:03.344 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: kZSTD supported: 0 2021-03-10T13:50:03.344 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: kXpressCompression supported: 0 2021-03-10T13:50:03.345 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: kLZ4HCCompression supported: 1 2021-03-10T13:50:03.345 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: kLZ4Compression supported: 1 2021-03-10T13:50:03.345 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: kBZip2Compression supported: 0 2021-03-10T13:50:03.345 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: kZlibCompression supported: 1 2021-03-10T13:50:03.345 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: kSnappyCompression supported: 1 2021-03-10T13:50:03.346 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Fast CRC32 supported: Supported on x86 2021-03-10T13:50:03.346 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2021-03-10T13:50:03.346 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2021-03-10T13:50:03.346 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2021-03-10T13:50:03.347 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.merge_operator: 2021-03-10T13:50:03.347 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.compaction_filter: None 2021-03-10T13:50:03.347 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.compaction_filter_factory: None 2021-03-10T13:50:03.347 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.memtable_factory: SkipListFactory 2021-03-10T13:50:03.347 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.table_factory: BlockBasedTable 2021-03-10T13:50:03.348 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5578c92b6230) 2021-03-10T13:50:03.348 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: cache_index_and_filter_blocks: 1 2021-03-10T13:50:03.348 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: cache_index_and_filter_blocks_with_high_priority: 0 2021-03-10T13:50:03.348 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: pin_l0_filter_and_index_blocks_in_cache: 0 2021-03-10T13:50:03.348 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: pin_top_level_index_and_filter: 1 2021-03-10T13:50:03.349 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: index_type: 0 2021-03-10T13:50:03.349 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: data_block_index_type: 0 2021-03-10T13:50:03.349 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: index_shortening: 1 2021-03-10T13:50:03.349 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: data_block_hash_table_util_ratio: 0.750000 2021-03-10T13:50:03.349 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: hash_index_allow_collision: 1 2021-03-10T13:50:03.350 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: checksum: 1 2021-03-10T13:50:03.350 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: no_block_cache: 0 2021-03-10T13:50:03.350 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: block_cache: 0x5578c92ee510 2021-03-10T13:50:03.350 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: block_cache_name: BinnedLRUCache 2021-03-10T13:50:03.351 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: block_cache_options: 2021-03-10T13:50:03.351 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: capacity : 536870912 2021-03-10T13:50:03.351 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: num_shard_bits : 4 2021-03-10T13:50:03.351 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: strict_capacity_limit : 0 2021-03-10T13:50:03.351 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: high_pri_pool_ratio: 0.000 2021-03-10T13:50:03.352 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: block_cache_compressed: (nil) 2021-03-10T13:50:03.352 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: persistent_cache: (nil) 2021-03-10T13:50:03.352 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: block_size: 4096 2021-03-10T13:50:03.352 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: block_size_deviation: 10 2021-03-10T13:50:03.352 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: block_restart_interval: 16 2021-03-10T13:50:03.353 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: index_block_restart_interval: 1 2021-03-10T13:50:03.353 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: metadata_block_size: 4096 2021-03-10T13:50:03.353 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: partition_filters: 0 2021-03-10T13:50:03.353 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: use_delta_encoding: 1 2021-03-10T13:50:03.354 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: filter_policy: rocksdb.BuiltinBloomFilter 2021-03-10T13:50:03.354 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: whole_key_filtering: 1 2021-03-10T13:50:03.354 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: verify_compression: 0 2021-03-10T13:50:03.354 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: read_amp_bytes_per_bit: 0 2021-03-10T13:50:03.354 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: format_version: 2 2021-03-10T13:50:03.355 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: enable_index_compression: 1 2021-03-10T13:50:03.355 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: block_align: 0 2021-03-10T13:50:03.355 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.write_buffer_size: 33554432 2021-03-10T13:50:03.355 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.max_write_buffer_number: 2 2021-03-10T13:50:03.355 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.compression: NoCompression 2021-03-10T13:50:03.356 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.bottommost_compression: Disabled 2021-03-10T13:50:03.356 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.prefix_extractor: nullptr 2021-03-10T13:50:03.356 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2021-03-10T13:50:03.356 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.num_levels: 7 2021-03-10T13:50:03.357 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2021-03-10T13:50:03.357 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2021-03-10T13:50:03.357 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2021-03-10T13:50:03.357 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2021-03-10T13:50:03.357 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2021-03-10T13:50:03.358 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2021-03-10T13:50:03.358 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2021-03-10T13:50:03.358 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2021-03-10T13:50:03.358 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2021-03-10T13:50:03.358 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.compression_opts.window_bits: -14 2021-03-10T13:50:03.359 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.compression_opts.level: 32767 2021-03-10T13:50:03.359 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.compression_opts.strategy: 0 2021-03-10T13:50:03.359 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2021-03-10T13:50:03.359 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2021-03-10T13:50:03.360 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.compression_opts.enabled: false 2021-03-10T13:50:03.360 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2021-03-10T13:50:03.360 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2021-03-10T13:50:03.360 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2021-03-10T13:50:03.360 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.target_file_size_base: 67108864 2021-03-10T13:50:03.361 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.target_file_size_multiplier: 1 2021-03-10T13:50:03.361 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2021-03-10T13:50:03.361 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2021-03-10T13:50:03.361 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2021-03-10T13:50:03.361 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2021-03-10T13:50:03.362 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2021-03-10T13:50:03.362 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2021-03-10T13:50:03.362 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2021-03-10T13:50:03.362 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2021-03-10T13:50:03.363 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2021-03-10T13:50:03.363 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2021-03-10T13:50:03.363 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2021-03-10T13:50:03.363 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2021-03-10T13:50:03.363 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.arena_block_size: 4194304 2021-03-10T13:50:03.364 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2021-03-10T13:50:03.364 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2021-03-10T13:50:03.364 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2021-03-10T13:50:03.364 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.disable_auto_compactions: 0 2021-03-10T13:50:03.364 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2021-03-10T13:50:03.365 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2021-03-10T13:50:03.365 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2021-03-10T13:50:03.365 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2021-03-10T13:50:03.365 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2021-03-10T13:50:03.366 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2021-03-10T13:50:03.366 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2021-03-10T13:50:03.366 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2021-03-10T13:50:03.366 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2021-03-10T13:50:03.366 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2021-03-10T13:50:03.367 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.table_properties_collectors: 2021-03-10T13:50:03.367 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.inplace_update_support: 0 2021-03-10T13:50:03.367 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.inplace_update_num_locks: 10000 2021-03-10T13:50:03.367 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2021-03-10T13:50:03.368 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2021-03-10T13:50:03.368 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.memtable_huge_page_size: 0 2021-03-10T13:50:03.368 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.bloom_locality: 0 2021-03-10T13:50:03.368 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.max_successive_merges: 0 2021-03-10T13:50:03.368 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.optimize_filters_for_hits: 0 2021-03-10T13:50:03.369 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.paranoid_file_checks: 0 2021-03-10T13:50:03.369 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.force_consistency_checks: 0 2021-03-10T13:50:03.369 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.report_bg_io_stats: 0 2021-03-10T13:50:03.369 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.ttl: 2592000 2021-03-10T13:50:03.369 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: Options.periodic_compaction_seconds: 0 2021-03-10T13:50:03.370 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 25, last_sequence is 9254, log_number is 20,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2021-03-10T13:50:03.370 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.079+0000 7f0fa8aa7700 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 20 2021-03-10T13:50:03.370 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.083+0000 7f0fa8aa7700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1615384203085097, "job": 1, "event": "recovery_started", "log_files": [20]} 2021-03-10T13:50:03.370 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.083+0000 7f0fa8aa7700 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #20 mode 2 2021-03-10T13:50:03.371 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.091+0000 7f0fa8aa7700 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2021-03-10T13:50:03.371 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.099+0000 7f0fa8aa7700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1615384203102550, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 25, "file_size": 11704220, "table_properties": {"data_size": 11698255, "index_size": 4437, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 709, "raw_key_size": 5300, "raw_average_key_size": 22, "raw_value_size": 11691247, "raw_average_value_size": 49539, "num_data_blocks": 139, "num_entries": 236, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1615384203, "oldest_key_time": 3, "file_creation_time": 0}} 2021-03-10T13:50:03.371 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.099+0000 7f0fa8aa7700 4 rocksdb: [version_set.cc:3826] Creating manifest 26 2021-03-10T13:50:03.371 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.099+0000 7f0fa8aa7700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1615384203103387, "job": 1, "event": "recovery_finished"} 2021-03-10T13:50:03.371 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.099+0000 7f0fa8aa7700 4 rocksdb: DB pointer 0x5578c93b3800 2021-03-10T13:50:03.372 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.103+0000 7f0f8f8ba700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2021-03-10T13:50:03.372 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.103+0000 7f0f8f8ba700 4 rocksdb: [db_impl/db_impl.cc:851] 2021-03-10T13:50:03.372 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: ** DB Stats ** 2021-03-10T13:50:03.372 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T13:50:03.372 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2021-03-10T13:50:03.373 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2021-03-10T13:50:03.373 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2021-03-10T13:50:03.373 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2021-03-10T13:50:03.373 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2021-03-10T13:50:03.374 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2021-03-10T13:50:03.374 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: ** Compaction Stats [default] ** 2021-03-10T13:50:03.375 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T13:50:03.375 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T13:50:03.375 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: L0 1/0 11.16 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1209.6 0.01 0.00 1 0.009 0 0 2021-03-10T13:50:03.376 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: L6 2/0 65.18 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-03-10T13:50:03.376 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: Sum 3/0 76.34 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1209.6 0.01 0.00 1 0.009 0 0 2021-03-10T13:50:03.376 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1209.6 0.01 0.00 1 0.009 0 0 2021-03-10T13:50:03.376 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: ** Compaction Stats [default] ** 2021-03-10T13:50:03.376 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T13:50:03.377 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T13:50:03.377 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1209.6 0.01 0.00 1 0.009 0 0 2021-03-10T13:50:03.377 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T13:50:03.377 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: Flush(GB): cumulative 0.011, interval 0.011 2021-03-10T13:50:03.378 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: AddFile(GB): cumulative 0.000, interval 0.000 2021-03-10T13:50:03.378 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: AddFile(Total Files): cumulative 0, interval 0 2021-03-10T13:50:03.378 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: AddFile(L0 Files): cumulative 0, interval 0 2021-03-10T13:50:03.378 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: AddFile(Keys): cumulative 0, interval 0 2021-03-10T13:50:03.379 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: Cumulative compaction: 0.01 GB write, 548.53 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T13:50:03.379 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: Interval compaction: 0.01 GB write, 548.53 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T13:50:03.379 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-03-10T13:50:03.379 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: ** File Read Latency Histogram By Level [default] ** 2021-03-10T13:50:03.379 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: ** Compaction Stats [default] ** 2021-03-10T13:50:03.380 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T13:50:03.380 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T13:50:03.380 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: L0 1/0 11.16 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1209.6 0.01 0.00 1 0.009 0 0 2021-03-10T13:50:03.380 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: L6 2/0 65.18 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-03-10T13:50:03.380 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: Sum 3/0 76.34 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1209.6 0.01 0.00 1 0.009 0 0 2021-03-10T13:50:03.381 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-03-10T13:50:03.381 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: ** Compaction Stats [default] ** 2021-03-10T13:50:03.381 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T13:50:03.381 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T13:50:03.382 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1209.6 0.01 0.00 1 0.009 0 0 2021-03-10T13:50:03.382 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T13:50:03.382 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: Flush(GB): cumulative 0.011, interval 0.000 2021-03-10T13:50:03.382 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: AddFile(GB): cumulative 0.000, interval 0.000 2021-03-10T13:50:03.382 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: AddFile(Total Files): cumulative 0, interval 0 2021-03-10T13:50:03.383 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: AddFile(L0 Files): cumulative 0, interval 0 2021-03-10T13:50:03.383 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: AddFile(Keys): cumulative 0, interval 0 2021-03-10T13:50:03.383 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: Cumulative compaction: 0.01 GB write, 547.80 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T13:50:03.383 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T13:50:03.384 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-03-10T13:50:03.384 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: ** File Read Latency Histogram By Level [default] ** 2021-03-10T13:50:03.384 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.103+0000 7f0fa8aa7700 0 starting mon.c rank 1 at public addrs [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] at bind addrs [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] mon_data /var/lib/ceph/mon/ceph-c fsid e4a642d2-81a5-11eb-9080-001a4aab830c 2021-03-10T13:50:03.384 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.103+0000 7f0fa8aa7700 1 mon.c@-1(???) e3 preinit fsid e4a642d2-81a5-11eb-9080-001a4aab830c 2021-03-10T13:50:03.384 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.103+0000 7f0fa8aa7700 0 mon.c@-1(???).mds e1 new map 2021-03-10T13:50:03.385 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.103+0000 7f0fa8aa7700 0 mon.c@-1(???).mds e1 print_map 2021-03-10T13:50:03.385 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: e1 2021-03-10T13:50:03.385 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: enable_multiple, ever_enabled_multiple: 0,0 2021-03-10T13:50:03.385 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-03-10T13:50:03.386 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: legacy client fscid: -1 2021-03-10T13:50:03.386 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: 2021-03-10T13:50:03.386 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: No filesystems configured 2021-03-10T13:50:03.386 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.103+0000 7f0fa8aa7700 0 mon.c@-1(???).osd e62 crush map has features 3314933000852226048, adjusting msgr requires 2021-03-10T13:50:03.386 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.103+0000 7f0fa8aa7700 0 mon.c@-1(???).osd e62 crush map has features 288514051259236352, adjusting msgr requires 2021-03-10T13:50:03.387 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.103+0000 7f0fa8aa7700 0 mon.c@-1(???).osd e62 crush map has features 288514051259236352, adjusting msgr requires 2021-03-10T13:50:03.387 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.103+0000 7f0fa8aa7700 0 mon.c@-1(???).osd e62 crush map has features 288514051259236352, adjusting msgr requires 2021-03-10T13:50:03.387 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: cluster 2021-03-10T13:49:58.933503+0000 mgr.gibba045.orlgmj (mgr.34412) 14 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:03.387 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: cephadm 2021-03-10T13:49:59.009584+0000 mgr.gibba045.orlgmj (mgr.34412) 15 : cephadm [INF] Upgrade: Updating mon.c 2021-03-10T13:50:03.388 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: cephadm 2021-03-10T13:49:59.034852+0000 mgr.gibba045.orlgmj (mgr.34412) 16 : cephadm [INF] Deploying daemon mon.c on gibba015 2021-03-10T13:50:03.388 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: cluster 2021-03-10T13:50:00.000244+0000 mon.a (mon.0) 36 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:50:03.388 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:03 gibba015 bash[30343]: debug 2021-03-10T13:50:03.103+0000 7f0fa8aa7700 1 mon.c@-1(???).paxosservice(auth 1..21) refresh upgraded, format 0 -> 3 2021-03-10T13:50:04.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:04 gibba015 bash[29377]: debug 2021-03-10T13:50:04.339+0000 7f21bab47700 -1 log_channel(cluster) log [ERR] : Health detail: HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:50:04.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:04 gibba015 bash[29377]: debug 2021-03-10T13:50:04.339+0000 7f21bab47700 -1 log_channel(cluster) log [ERR] : [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2021-03-10T13:50:04.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:04 gibba015 bash[29377]: debug 2021-03-10T13:50:04.339+0000 7f21bab47700 -1 log_channel(cluster) log [ERR] : daemon rgw.r.z.gibba045.atotkw on gibba045 is in error state 2021-03-10T13:50:04.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:04 gibba015 bash[29377]: debug 2021-03-10T13:50:04.339+0000 7f21bab47700 -1 log_channel(cluster) log [ERR] : [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:50:04.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:04 gibba015 bash[29377]: debug 2021-03-10T13:50:04.339+0000 7f21bab47700 -1 log_channel(cluster) log [ERR] : Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:50:05.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:05 gibba015 bash[29377]: cluster 2021-03-10T13:50:00.934530+0000 mgr.gibba045.orlgmj (mgr.34412) 17 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:05.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:05 gibba015 bash[30343]: cluster 2021-03-10T13:50:00.934530+0000 mgr.gibba045.orlgmj (mgr.34412) 17 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:05.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:05 gibba015 bash[30343]: audit 2021-03-10T13:50:02.139187+0000 mon.b (mon.2) 178 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"49fd96830250\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 39468400, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.378355Z\", \"created\": \"2021-03-10T13:38:50.668449Z\", \"started\": \"2021-03-10T13:49:45.247194Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba015\", \"container_id\": \"fb55e770cd62\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 374761062, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.378478Z\", \"created\": \"2021-03-10T13:38:58.024449Z\", \"started\": \"2021-03-10T13:49:36.120688Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba015\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49482301, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.378596Z\", \"created\": \"2021-03-10T13:40:50.072448Z\", \"started\": \"2021-03-10T13:40:53.142290Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50216304, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.378756Z\", \"created\": \"2021-03-10T13:41:11.556448Z\", \"started\": \"2021-03-10T13:41:15.069232Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46556774, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.378884Z\", \"created\": \"2021-03-10T13:41:34.244448Z\", \"started\": \"2021-03-10T13:41:37.507096Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48087695, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.379003Z\", \"created\": \"2021-03-10T13:41:57.328380Z\", \"started\": \"2021-03-10T13:42:00.781947Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23519559, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.379124Z\", \"created\": \"2021-03-10T13:43:44.272379Z\", \"started\": \"2021-03-10T13:43:47.550063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"df987682eada\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13075742, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2021-03-10T13:49:56.379186Z\", \"created\": \"2021-03-10T13:43:54.628379Z\", \"started\": \"2021-03-10T13:49:17.528199Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:59.034551Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:23.251574Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:49:10.777874Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:42.144291Z\"}}, \"last_device_update\": \"2021-03-10T13:42:03.853072Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:49:36.287812Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:50:05.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:05 gibba015 bash[30343]: cluster 2021-03-10T13:50:02.935740+0000 mgr.gibba045.orlgmj (mgr.34412) 18 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:05.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:05 gibba015 bash[30343]: cluster 2021-03-10T13:50:03.315663+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2021-03-10T13:50:05.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:05 gibba015 bash[30343]: cluster 2021-03-10T13:50:04.318388+0000 mon.a (mon.0) 37 : cluster [INF] mon.a calling monitor election 2021-03-10T13:50:05.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:05 gibba015 bash[30343]: cluster 2021-03-10T13:50:04.324897+0000 mon.a (mon.0) 38 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-03-10T13:50:05.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:05 gibba015 bash[30343]: cluster 2021-03-10T13:50:04.337598+0000 mon.a (mon.0) 39 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0],b=[v2:172.21.2.145:3300/0,v1:172.21.2.145:6789/0],c=[v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0]} 2021-03-10T13:50:05.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:05 gibba015 bash[30343]: cluster 2021-03-10T13:50:04.337664+0000 mon.a (mon.0) 40 : cluster [DBG] fsmap 2021-03-10T13:50:05.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:05 gibba015 bash[30343]: cluster 2021-03-10T13:50:04.337681+0000 mon.a (mon.0) 41 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2021-03-10T13:50:05.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:05 gibba015 bash[30343]: cluster 2021-03-10T13:50:04.337994+0000 mon.a (mon.0) 42 : cluster [DBG] mgrmap e25: gibba045.orlgmj(active, since 12s), standbys: x, y 2021-03-10T13:50:05.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:05 gibba015 bash[30343]: cluster 2021-03-10T13:50:04.342333+0000 mon.a (mon.0) 43 : cluster [ERR] Health detail: HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:50:05.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:05 gibba015 bash[30343]: cluster 2021-03-10T13:50:04.342344+0000 mon.a (mon.0) 44 : cluster [ERR] [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2021-03-10T13:50:05.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:05 gibba015 bash[30343]: cluster 2021-03-10T13:50:04.342353+0000 mon.a (mon.0) 45 : cluster [ERR] daemon rgw.r.z.gibba045.atotkw on gibba045 is in error state 2021-03-10T13:50:05.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:05 gibba015 bash[30343]: cluster 2021-03-10T13:50:04.342361+0000 mon.a (mon.0) 46 : cluster [ERR] [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:50:05.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:05 gibba015 bash[30343]: cluster 2021-03-10T13:50:04.342397+0000 mon.a (mon.0) 47 : cluster [ERR] Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:50:05.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:05 gibba015 bash[30343]: audit 2021-03-10T13:50:04.345696+0000 mon.a (mon.0) 48 : audit [INF] from='mgr.34412 ' entity='' 2021-03-10T13:50:05.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:05 gibba015 bash[30343]: audit 2021-03-10T13:50:04.347567+0000 mon.b (mon.2) 179 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:50:05.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:05 gibba015 bash[30343]: audit 2021-03-10T13:50:04.349348+0000 mon.b (mon.2) 180 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:50:05.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:05 gibba015 bash[29377]: audit 2021-03-10T13:50:02.139187+0000 mon.b (mon.2) 178 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"49fd96830250\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 39468400, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.378355Z\", \"created\": \"2021-03-10T13:38:50.668449Z\", \"started\": \"2021-03-10T13:49:45.247194Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba015\", \"container_id\": \"fb55e770cd62\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 374761062, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.378478Z\", \"created\": \"2021-03-10T13:38:58.024449Z\", \"started\": \"2021-03-10T13:49:36.120688Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba015\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49482301, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.378596Z\", \"created\": \"2021-03-10T13:40:50.072448Z\", \"started\": \"2021-03-10T13:40:53.142290Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50216304, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.378756Z\", \"created\": \"2021-03-10T13:41:11.556448Z\", \"started\": \"2021-03-10T13:41:15.069232Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46556774, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.378884Z\", \"created\": \"2021-03-10T13:41:34.244448Z\", \"started\": \"2021-03-10T13:41:37.507096Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48087695, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.379003Z\", \"created\": \"2021-03-10T13:41:57.328380Z\", \"started\": \"2021-03-10T13:42:00.781947Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23519559, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.379124Z\", \"created\": \"2021-03-10T13:43:44.272379Z\", \"started\": \"2021-03-10T13:43:47.550063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"df987682eada\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13075742, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2021-03-10T13:49:56.379186Z\", \"created\": \"2021-03-10T13:43:54.628379Z\", \"started\": \"2021-03-10T13:49:17.528199Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:59.034551Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:23.251574Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:49:10.777874Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:42.144291Z\"}}, \"last_device_update\": \"2021-03-10T13:42:03.853072Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:49:36.287812Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:50:05.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:05 gibba015 bash[29377]: cluster 2021-03-10T13:50:02.935740+0000 mgr.gibba045.orlgmj (mgr.34412) 18 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:05.729 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:05 gibba015 bash[29377]: cluster 2021-03-10T13:50:03.315663+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2021-03-10T13:50:05.729 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:05 gibba015 bash[29377]: cluster 2021-03-10T13:50:04.318388+0000 mon.a (mon.0) 37 : cluster [INF] mon.a calling monitor election 2021-03-10T13:50:05.729 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:05 gibba015 bash[29377]: cluster 2021-03-10T13:50:04.324897+0000 mon.a (mon.0) 38 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-03-10T13:50:05.729 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:05 gibba015 bash[29377]: cluster 2021-03-10T13:50:04.337598+0000 mon.a (mon.0) 39 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0],b=[v2:172.21.2.145:3300/0,v1:172.21.2.145:6789/0],c=[v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0]} 2021-03-10T13:50:05.730 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:05 gibba015 bash[29377]: cluster 2021-03-10T13:50:04.337664+0000 mon.a (mon.0) 40 : cluster [DBG] fsmap 2021-03-10T13:50:05.730 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:05 gibba015 bash[29377]: cluster 2021-03-10T13:50:04.337681+0000 mon.a (mon.0) 41 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2021-03-10T13:50:05.730 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:05 gibba015 bash[29377]: cluster 2021-03-10T13:50:04.337994+0000 mon.a (mon.0) 42 : cluster [DBG] mgrmap e25: gibba045.orlgmj(active, since 12s), standbys: x, y 2021-03-10T13:50:05.730 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:05 gibba015 bash[29377]: cluster 2021-03-10T13:50:04.342333+0000 mon.a (mon.0) 43 : cluster [ERR] Health detail: HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:50:05.731 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:05 gibba015 bash[29377]: cluster 2021-03-10T13:50:04.342344+0000 mon.a (mon.0) 44 : cluster [ERR] [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2021-03-10T13:50:05.731 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:05 gibba015 bash[29377]: cluster 2021-03-10T13:50:04.342353+0000 mon.a (mon.0) 45 : cluster [ERR] daemon rgw.r.z.gibba045.atotkw on gibba045 is in error state 2021-03-10T13:50:05.731 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:05 gibba015 bash[29377]: cluster 2021-03-10T13:50:04.342361+0000 mon.a (mon.0) 46 : cluster [ERR] [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:50:05.731 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:05 gibba015 bash[29377]: cluster 2021-03-10T13:50:04.342397+0000 mon.a (mon.0) 47 : cluster [ERR] Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:50:05.731 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:05 gibba015 bash[29377]: audit 2021-03-10T13:50:04.345696+0000 mon.a (mon.0) 48 : audit [INF] from='mgr.34412 ' entity='' 2021-03-10T13:50:05.732 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:05 gibba015 bash[29377]: audit 2021-03-10T13:50:04.347567+0000 mon.b (mon.2) 179 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:50:05.732 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:05 gibba015 bash[29377]: audit 2021-03-10T13:50:04.349348+0000 mon.b (mon.2) 180 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:50:05.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:05 gibba045 bash[9787]: cluster 2021-03-10T13:50:00.934530+0000 mgr.gibba045.orlgmj (mgr.34412) 17 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:05.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:05 gibba045 bash[9787]: audit 2021-03-10T13:50:02.139187+0000 mon.b (mon.2) 178 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"49fd96830250\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 39468400, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.378355Z\", \"created\": \"2021-03-10T13:38:50.668449Z\", \"started\": \"2021-03-10T13:49:45.247194Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba015\", \"container_id\": \"fb55e770cd62\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 374761062, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.378478Z\", \"created\": \"2021-03-10T13:38:58.024449Z\", \"started\": \"2021-03-10T13:49:36.120688Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba015\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49482301, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.378596Z\", \"created\": \"2021-03-10T13:40:50.072448Z\", \"started\": \"2021-03-10T13:40:53.142290Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50216304, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.378756Z\", \"created\": \"2021-03-10T13:41:11.556448Z\", \"started\": \"2021-03-10T13:41:15.069232Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46556774, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.378884Z\", \"created\": \"2021-03-10T13:41:34.244448Z\", \"started\": \"2021-03-10T13:41:37.507096Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48087695, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.379003Z\", \"created\": \"2021-03-10T13:41:57.328380Z\", \"started\": \"2021-03-10T13:42:00.781947Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23519559, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:49:56.379124Z\", \"created\": \"2021-03-10T13:43:44.272379Z\", \"started\": \"2021-03-10T13:43:47.550063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"df987682eada\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13075742, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2021-03-10T13:49:56.379186Z\", \"created\": \"2021-03-10T13:43:54.628379Z\", \"started\": \"2021-03-10T13:49:17.528199Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:59.034551Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:23.251574Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:49:10.777874Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:42.144291Z\"}}, \"last_device_update\": \"2021-03-10T13:42:03.853072Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:49:36.287812Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:50:05.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:05 gibba045 bash[9787]: cluster 2021-03-10T13:50:02.935740+0000 mgr.gibba045.orlgmj (mgr.34412) 18 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:05.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:05 gibba045 bash[9787]: cluster 2021-03-10T13:50:03.315663+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2021-03-10T13:50:05.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:05 gibba045 bash[9787]: cluster 2021-03-10T13:50:04.318388+0000 mon.a (mon.0) 37 : cluster [INF] mon.a calling monitor election 2021-03-10T13:50:05.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:05 gibba045 bash[9787]: cluster 2021-03-10T13:50:04.324897+0000 mon.a (mon.0) 38 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-03-10T13:50:05.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:05 gibba045 bash[9787]: cluster 2021-03-10T13:50:04.337598+0000 mon.a (mon.0) 39 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0],b=[v2:172.21.2.145:3300/0,v1:172.21.2.145:6789/0],c=[v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0]} 2021-03-10T13:50:05.812 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:05 gibba045 bash[9787]: cluster 2021-03-10T13:50:04.337664+0000 mon.a (mon.0) 40 : cluster [DBG] fsmap 2021-03-10T13:50:05.812 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:05 gibba045 bash[9787]: cluster 2021-03-10T13:50:04.337681+0000 mon.a (mon.0) 41 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2021-03-10T13:50:05.812 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:05 gibba045 bash[9787]: cluster 2021-03-10T13:50:04.337994+0000 mon.a (mon.0) 42 : cluster [DBG] mgrmap e25: gibba045.orlgmj(active, since 12s), standbys: x, y 2021-03-10T13:50:05.813 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:05 gibba045 bash[9787]: cluster 2021-03-10T13:50:04.342333+0000 mon.a (mon.0) 43 : cluster [ERR] Health detail: HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:50:05.813 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:05 gibba045 bash[9787]: cluster 2021-03-10T13:50:04.342344+0000 mon.a (mon.0) 44 : cluster [ERR] [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2021-03-10T13:50:05.813 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:05 gibba045 bash[9787]: cluster 2021-03-10T13:50:04.342353+0000 mon.a (mon.0) 45 : cluster [ERR] daemon rgw.r.z.gibba045.atotkw on gibba045 is in error state 2021-03-10T13:50:05.814 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:05 gibba045 bash[9787]: cluster 2021-03-10T13:50:04.342361+0000 mon.a (mon.0) 46 : cluster [ERR] [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:50:05.814 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:05 gibba045 bash[9787]: cluster 2021-03-10T13:50:04.342397+0000 mon.a (mon.0) 47 : cluster [ERR] Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:50:05.815 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:05 gibba045 bash[9787]: audit 2021-03-10T13:50:04.345696+0000 mon.a (mon.0) 48 : audit [INF] from='mgr.34412 ' entity='' 2021-03-10T13:50:05.815 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:05 gibba045 bash[9787]: audit 2021-03-10T13:50:04.347567+0000 mon.b (mon.2) 179 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:50:05.815 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:05 gibba045 bash[9787]: audit 2021-03-10T13:50:04.349348+0000 mon.b (mon.2) 180 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:50:06.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:06 gibba015 bash[29377]: cluster 2021-03-10T13:50:04.937942+0000 mgr.gibba045.orlgmj (mgr.34412) 19 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:06.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:06 gibba015 bash[30343]: cluster 2021-03-10T13:50:04.937942+0000 mgr.gibba045.orlgmj (mgr.34412) 19 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:06.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:06 gibba045 bash[9787]: cluster 2021-03-10T13:50:04.937942+0000 mgr.gibba045.orlgmj (mgr.34412) 19 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:08.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:08 gibba045 bash[9787]: cluster 2021-03-10T13:50:06.938827+0000 mgr.gibba045.orlgmj (mgr.34412) 20 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:08.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:08 gibba045 bash[9787]: audit 2021-03-10T13:50:08.071059+0000 mon.b (mon.2) 181 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"49fd96830250\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 44491079, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:50:08.065743Z\", \"created\": \"2021-03-10T13:38:50.668449Z\", \"started\": \"2021-03-10T13:49:45.247194Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba015\", \"container_id\": \"fb55e770cd62\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 374656204, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:50:08.066240Z\", \"created\": \"2021-03-10T13:38:58.024449Z\", \"started\": \"2021-03-10T13:49:36.120688Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba015\", \"container_id\": \"6743d7c3d229\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 36563845, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:50:08.066573Z\", \"created\": \"2021-03-10T13:40:03.296449Z\", \"started\": \"2021-03-10T13:50:02.162978Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49597644, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:50:08.066880Z\", \"created\": \"2021-03-10T13:40:50.072448Z\", \"started\": \"2021-03-10T13:40:53.142290Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50363105, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:50:08.067596Z\", \"created\": \"2021-03-10T13:41:11.556448Z\", \"started\": \"2021-03-10T13:41:15.069232Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46672117, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:50:08.068272Z\", \"created\": \"2021-03-10T13:41:34.244448Z\", \"started\": \"2021-03-10T13:41:37.507096Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48339353, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:50:08.068963Z\", \"created\": \"2021-03-10T13:41:57.328380Z\", \"started\": \"2021-03-10T13:42:00.781947Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23718789, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:50:08.069605Z\", \"created\": \"2021-03-10T13:43:44.272379Z\", \"started\": \"2021-03-10T13:43:47.550063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"df987682eada\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13274972, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:50:08.069943Z\", \"created\": \"2021-03-10T13:43:54.628379Z\", \"started\": \"2021-03-10T13:49:17.528199Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:59.034551Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:23.251574Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:49:10.777874Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:42.144291Z\"}}, \"last_daemon_update\": \"2021-03-10T13:50:08.070082Z\", \"last_device_update\": \"2021-03-10T13:42:03.853072Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:49:36.287812Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:50:08.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:08 gibba045 bash[9787]: audit 2021-03-10T13:50:08.074555+0000 mon.a (mon.0) 49 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:50:08.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:08 gibba045 bash[9787]: audit 2021-03-10T13:50:08.077109+0000 mon.b (mon.2) 182 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T13:50:08.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:08 gibba045 bash[9787]: audit 2021-03-10T13:50:08.079333+0000 mon.a (mon.0) 50 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:50:08.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:08 gibba045 bash[9787]: audit 2021-03-10T13:50:08.085317+0000 mon.b (mon.2) 183 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:50:08.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:08 gibba045 bash[9787]: audit 2021-03-10T13:50:08.086594+0000 mon.b (mon.2) 184 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:50:08.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:08 gibba045 bash[9787]: audit 2021-03-10T13:50:08.087806+0000 mon.b (mon.2) 185 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "mon ok-to-stop", "ids": ["b"]}]: dispatch 2021-03-10T13:50:08.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:08 gibba015 bash[30343]: cluster 2021-03-10T13:50:06.938827+0000 mgr.gibba045.orlgmj (mgr.34412) 20 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:08.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:08 gibba015 bash[29377]: cluster 2021-03-10T13:50:06.938827+0000 mgr.gibba045.orlgmj (mgr.34412) 20 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:08.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:08 gibba015 bash[30343]: audit 2021-03-10T13:50:08.071059+0000 mon.b (mon.2) 181 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"49fd96830250\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 44491079, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:50:08.065743Z\", \"created\": \"2021-03-10T13:38:50.668449Z\", \"started\": \"2021-03-10T13:49:45.247194Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba015\", \"container_id\": \"fb55e770cd62\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 374656204, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:50:08.066240Z\", \"created\": \"2021-03-10T13:38:58.024449Z\", \"started\": \"2021-03-10T13:49:36.120688Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba015\", \"container_id\": \"6743d7c3d229\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 36563845, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:50:08.066573Z\", \"created\": \"2021-03-10T13:40:03.296449Z\", \"started\": \"2021-03-10T13:50:02.162978Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49597644, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:50:08.066880Z\", \"created\": \"2021-03-10T13:40:50.072448Z\", \"started\": \"2021-03-10T13:40:53.142290Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50363105, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:50:08.067596Z\", \"created\": \"2021-03-10T13:41:11.556448Z\", \"started\": \"2021-03-10T13:41:15.069232Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46672117, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:50:08.068272Z\", \"created\": \"2021-03-10T13:41:34.244448Z\", \"started\": \"2021-03-10T13:41:37.507096Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48339353, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:50:08.068963Z\", \"created\": \"2021-03-10T13:41:57.328380Z\", \"started\": \"2021-03-10T13:42:00.781947Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23718789, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:50:08.069605Z\", \"created\": \"2021-03-10T13:43:44.272379Z\", \"started\": \"2021-03-10T13:43:47.550063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"df987682eada\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13274972, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:50:08.069943Z\", \"created\": \"2021-03-10T13:43:54.628379Z\", \"started\": \"2021-03-10T13:49:17.528199Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:59.034551Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:23.251574Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:49:10.777874Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:42.144291Z\"}}, \"last_daemon_update\": \"2021-03-10T13:50:08.070082Z\", \"last_device_update\": \"2021-03-10T13:42:03.853072Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:49:36.287812Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:50:08.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:08 gibba015 bash[30343]: audit 2021-03-10T13:50:08.074555+0000 mon.a (mon.0) 49 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:50:08.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:08 gibba015 bash[30343]: audit 2021-03-10T13:50:08.077109+0000 mon.b (mon.2) 182 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T13:50:08.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:08 gibba015 bash[30343]: audit 2021-03-10T13:50:08.079333+0000 mon.a (mon.0) 50 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:50:08.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:08 gibba015 bash[30343]: audit 2021-03-10T13:50:08.085317+0000 mon.b (mon.2) 183 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:50:08.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:08 gibba015 bash[30343]: audit 2021-03-10T13:50:08.086594+0000 mon.b (mon.2) 184 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:50:08.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:08 gibba015 bash[30343]: audit 2021-03-10T13:50:08.087806+0000 mon.b (mon.2) 185 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "mon ok-to-stop", "ids": ["b"]}]: dispatch 2021-03-10T13:50:08.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:08 gibba015 bash[29377]: audit 2021-03-10T13:50:08.071059+0000 mon.b (mon.2) 181 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba015","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"49fd96830250\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 44491079, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:50:08.065743Z\", \"created\": \"2021-03-10T13:38:50.668449Z\", \"started\": \"2021-03-10T13:49:45.247194Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba015\", \"container_id\": \"fb55e770cd62\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 374656204, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:50:08.066240Z\", \"created\": \"2021-03-10T13:38:58.024449Z\", \"started\": \"2021-03-10T13:49:36.120688Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba015\", \"container_id\": \"6743d7c3d229\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 36563845, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:50:08.066573Z\", \"created\": \"2021-03-10T13:40:03.296449Z\", \"started\": \"2021-03-10T13:50:02.162978Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba015\", \"container_id\": \"1e67f692bb03\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49597644, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:50:08.066880Z\", \"created\": \"2021-03-10T13:40:50.072448Z\", \"started\": \"2021-03-10T13:40:53.142290Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba015\", \"container_id\": \"83369fd7640c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50363105, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:50:08.067596Z\", \"created\": \"2021-03-10T13:41:11.556448Z\", \"started\": \"2021-03-10T13:41:15.069232Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba015\", \"container_id\": \"b90f9ada390a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46672117, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:50:08.068272Z\", \"created\": \"2021-03-10T13:41:34.244448Z\", \"started\": \"2021-03-10T13:41:37.507096Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba015\", \"container_id\": \"a77eccf371e5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48339353, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:50:08.068963Z\", \"created\": \"2021-03-10T13:41:57.328380Z\", \"started\": \"2021-03-10T13:42:00.781947Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"3e13444f9f78\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23718789, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:50:08.069605Z\", \"created\": \"2021-03-10T13:43:44.272379Z\", \"started\": \"2021-03-10T13:43:47.550063Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba015\", \"container_id\": \"df987682eada\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13274972, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:50:08.069943Z\", \"created\": \"2021-03-10T13:43:54.628379Z\", \"started\": \"2021-03-10T13:49:17.528199Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"de4bb3e1-0f94-479d-9771-be80408c9a32\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"mvjuqr-qDJV-i5Sv-1xRZ-ekds-hKxT-26vfj3\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"3ae91563-2d31-48f5-aeed-1ba427cef365\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"b7KinE-6yPv-BRZX-L420-JZUz-Q06w-XJdxZK\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"cc626c7d-c7c8-4e9a-8f15-d98a1e7cf1be\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"iApVav-c1pq-mFRV-fQZx-HkNF-Sma9-nXDJUd\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8e0c9467-d453-440a-91ea-1b07c3f35dde\", \"cluster_fsid\": \"e4a642d2-81a5-11eb-9080-001a4aab830c\", \"block_uuid\": \"pxzf6N-CXns-Md5x-EfzX-yTnQ-OK7e-V4Mgdm\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400GH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:59.034551Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:23.251574Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:40:48.300743Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:09.777369Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:32.425644Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:41:55.552867Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:43:43.888955Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba045.orlgmj\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:49:10.777874Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:42.144291Z\"}}, \"last_daemon_update\": \"2021-03-10T13:50:08.070082Z\", \"last_device_update\": \"2021-03-10T13:42:03.853072Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.115\"], \"172.21.15.254\": [\"172.21.2.115\"]}, \"last_host_check\": \"2021-03-10T13:49:36.287812Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:50:08.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:08 gibba015 bash[29377]: audit 2021-03-10T13:50:08.074555+0000 mon.a (mon.0) 49 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:50:08.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:08 gibba015 bash[29377]: audit 2021-03-10T13:50:08.077109+0000 mon.b (mon.2) 182 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T13:50:08.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:08 gibba015 bash[29377]: audit 2021-03-10T13:50:08.079333+0000 mon.a (mon.0) 50 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:50:08.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:08 gibba015 bash[29377]: audit 2021-03-10T13:50:08.085317+0000 mon.b (mon.2) 183 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:50:08.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:08 gibba015 bash[29377]: audit 2021-03-10T13:50:08.086594+0000 mon.b (mon.2) 184 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:50:08.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:08 gibba015 bash[29377]: audit 2021-03-10T13:50:08.087806+0000 mon.b (mon.2) 185 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "mon ok-to-stop", "ids": ["b"]}]: dispatch 2021-03-10T13:50:09.083 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T13:50:09.305 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T13:50:09.306 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (51s) 1s ago 6m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T13:50:09.306 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (6m) 12s ago 6m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T13:50:09.306 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (78s) 12s ago 9m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T13:50:09.306 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (95s) 12s ago 9m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T13:50:09.306 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (33s) 1s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T13:50:09.307 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (24s) 1s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T13:50:09.307 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (9m) 12s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 2523bc3385be 2021-03-10T13:50:09.307 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (7s) 1s ago 10m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T13:50:09.307 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (6m) 1s ago 6m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T13:50:09.308 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (6m) 12s ago 6m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T13:50:09.308 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (9m) 1s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 1e67f692bb03 2021-03-10T13:50:09.308 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (8m) 1s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 83369fd7640c 2021-03-10T13:50:09.308 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (8m) 1s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b90f9ada390a 2021-03-10T13:50:09.308 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (8m) 1s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 a77eccf371e5 2021-03-10T13:50:09.309 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (7m) 12s ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 9b9c84c84955 2021-03-10T13:50:09.309 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (7m) 12s ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 662e73261675 2021-03-10T13:50:09.309 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (7m) 12s ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 338d252f22e3 2021-03-10T13:50:09.309 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (6m) 12s ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 784edc0668a4 2021-03-10T13:50:09.309 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (5m) 12s ago 6m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T13:50:09.310 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 12s ago 4m docker.io/ceph/ceph:v15.2.0 2021-03-10T13:50:09.553 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T13:50:09.553 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T13:50:09.554 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 1, 2021-03-10T13:50:09.554 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 2 2021-03-10T13:50:09.554 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T13:50:09.554 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T13:50:09.555 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:50:09.555 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T13:50:09.555 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T13:50:09.555 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2021-03-10T13:50:09.555 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T13:50:09.556 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T13:50:09.556 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T13:50:09.556 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 9, 2021-03-10T13:50:09.556 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 5 2021-03-10T13:50:09.557 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T13:50:09.557 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T13:50:09.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:09 gibba015 bash[29377]: cephadm 2021-03-10T13:50:08.084651+0000 mgr.gibba045.orlgmj (mgr.34412) 21 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:50:09.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:09 gibba015 bash[29377]: cephadm 2021-03-10T13:50:08.086321+0000 mgr.gibba045.orlgmj (mgr.34412) 22 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:50:09.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:09 gibba015 bash[29377]: cephadm 2021-03-10T13:50:08.087461+0000 mgr.gibba045.orlgmj (mgr.34412) 23 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:50:09.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:09 gibba015 bash[29377]: cephadm 2021-03-10T13:50:08.087510+0000 mgr.gibba045.orlgmj (mgr.34412) 24 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:50:09.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:09 gibba015 bash[29377]: cephadm 2021-03-10T13:50:08.088486+0000 mgr.gibba045.orlgmj (mgr.34412) 25 : cephadm [INF] It is presumed safe to stop mon.b 2021-03-10T13:50:09.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:09 gibba015 bash[29377]: cephadm 2021-03-10T13:50:08.088540+0000 mgr.gibba045.orlgmj (mgr.34412) 26 : cephadm [INF] Upgrade: It is presumed safe to stop mon.b 2021-03-10T13:50:09.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:09 gibba015 bash[30343]: cephadm 2021-03-10T13:50:08.084651+0000 mgr.gibba045.orlgmj (mgr.34412) 21 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:50:09.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:09 gibba015 bash[30343]: cephadm 2021-03-10T13:50:08.086321+0000 mgr.gibba045.orlgmj (mgr.34412) 22 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:50:09.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:09 gibba015 bash[30343]: cephadm 2021-03-10T13:50:08.087461+0000 mgr.gibba045.orlgmj (mgr.34412) 23 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:50:09.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:09 gibba015 bash[30343]: cephadm 2021-03-10T13:50:08.087510+0000 mgr.gibba045.orlgmj (mgr.34412) 24 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:50:09.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:09 gibba015 bash[30343]: cephadm 2021-03-10T13:50:08.088486+0000 mgr.gibba045.orlgmj (mgr.34412) 25 : cephadm [INF] It is presumed safe to stop mon.b 2021-03-10T13:50:09.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:09 gibba015 bash[30343]: cephadm 2021-03-10T13:50:08.088540+0000 mgr.gibba045.orlgmj (mgr.34412) 26 : cephadm [INF] Upgrade: It is presumed safe to stop mon.b 2021-03-10T13:50:09.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:09 gibba045 bash[9787]: cephadm 2021-03-10T13:50:08.084651+0000 mgr.gibba045.orlgmj (mgr.34412) 21 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:50:09.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:09 gibba045 bash[9787]: cephadm 2021-03-10T13:50:08.086321+0000 mgr.gibba045.orlgmj (mgr.34412) 22 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:50:09.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:09 gibba045 bash[9787]: cephadm 2021-03-10T13:50:08.087461+0000 mgr.gibba045.orlgmj (mgr.34412) 23 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:50:09.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:09 gibba045 bash[9787]: cephadm 2021-03-10T13:50:08.087510+0000 mgr.gibba045.orlgmj (mgr.34412) 24 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:50:09.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:09 gibba045 bash[9787]: cephadm 2021-03-10T13:50:08.088486+0000 mgr.gibba045.orlgmj (mgr.34412) 25 : cephadm [INF] It is presumed safe to stop mon.b 2021-03-10T13:50:09.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:09 gibba045 bash[9787]: cephadm 2021-03-10T13:50:08.088540+0000 mgr.gibba045.orlgmj (mgr.34412) 26 : cephadm [INF] Upgrade: It is presumed safe to stop mon.b 2021-03-10T13:50:10.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:10 gibba015 bash[29377]: cluster 2021-03-10T13:50:08.940720+0000 mgr.gibba045.orlgmj (mgr.34412) 27 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:10.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:10 gibba015 bash[29377]: audit 2021-03-10T13:50:09.072756+0000 mgr.gibba045.orlgmj (mgr.34412) 28 : audit [DBG] from='client.54103 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:50:10.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:10 gibba015 bash[29377]: audit 2021-03-10T13:50:09.296939+0000 mgr.gibba045.orlgmj (mgr.34412) 29 : audit [DBG] from='client.44121 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:50:10.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:10 gibba015 bash[29377]: audit 2021-03-10T13:50:09.551622+0000 mon.c (mon.1) 2 : audit [DBG] from='client.? 172.21.2.115:0/3144940195' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:50:10.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:10 gibba015 bash[29377]: audit 2021-03-10T13:50:09.828961+0000 mon.b (mon.2) 186 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mon.b"}]: dispatch 2021-03-10T13:50:10.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:10 gibba015 bash[29377]: audit 2021-03-10T13:50:09.838439+0000 mon.a (mon.0) 51 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:50:10.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:10 gibba015 bash[29377]: audit 2021-03-10T13:50:09.840722+0000 mon.b (mon.2) 187 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:50:10.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:10 gibba015 bash[29377]: audit 2021-03-10T13:50:09.841472+0000 mon.b (mon.2) 188 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:50:10.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:10 gibba015 bash[29377]: audit 2021-03-10T13:50:09.842225+0000 mon.b (mon.2) 189 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:50:10.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:10 gibba015 bash[29377]: audit 2021-03-10T13:50:09.843237+0000 mon.b (mon.2) 190 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2021-03-10T13:50:10.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:10 gibba015 bash[30343]: cluster 2021-03-10T13:50:08.940720+0000 mgr.gibba045.orlgmj (mgr.34412) 27 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:10.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:10 gibba015 bash[30343]: audit 2021-03-10T13:50:09.072756+0000 mgr.gibba045.orlgmj (mgr.34412) 28 : audit [DBG] from='client.54103 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:50:10.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:10 gibba015 bash[30343]: audit 2021-03-10T13:50:09.296939+0000 mgr.gibba045.orlgmj (mgr.34412) 29 : audit [DBG] from='client.44121 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:50:10.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:10 gibba015 bash[30343]: audit 2021-03-10T13:50:09.551622+0000 mon.c (mon.1) 2 : audit [DBG] from='client.? 172.21.2.115:0/3144940195' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:50:10.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:10 gibba015 bash[30343]: audit 2021-03-10T13:50:09.828961+0000 mon.b (mon.2) 186 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mon.b"}]: dispatch 2021-03-10T13:50:10.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:10 gibba015 bash[30343]: audit 2021-03-10T13:50:09.838439+0000 mon.a (mon.0) 51 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:50:10.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:10 gibba015 bash[30343]: audit 2021-03-10T13:50:09.840722+0000 mon.b (mon.2) 187 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:50:10.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:10 gibba015 bash[30343]: audit 2021-03-10T13:50:09.841472+0000 mon.b (mon.2) 188 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:50:10.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:10 gibba015 bash[30343]: audit 2021-03-10T13:50:09.842225+0000 mon.b (mon.2) 189 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:50:10.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:10 gibba015 bash[30343]: audit 2021-03-10T13:50:09.843237+0000 mon.b (mon.2) 190 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2021-03-10T13:50:10.796 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:10 gibba045 bash[9787]: cluster 2021-03-10T13:50:08.940720+0000 mgr.gibba045.orlgmj (mgr.34412) 27 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:10.796 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:10 gibba045 bash[9787]: audit 2021-03-10T13:50:09.072756+0000 mgr.gibba045.orlgmj (mgr.34412) 28 : audit [DBG] from='client.54103 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:50:10.797 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:10 gibba045 bash[9787]: audit 2021-03-10T13:50:09.296939+0000 mgr.gibba045.orlgmj (mgr.34412) 29 : audit [DBG] from='client.44121 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:50:10.797 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:10 gibba045 bash[9787]: audit 2021-03-10T13:50:09.551622+0000 mon.c (mon.1) 2 : audit [DBG] from='client.? 172.21.2.115:0/3144940195' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:50:10.797 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:10 gibba045 bash[9787]: audit 2021-03-10T13:50:09.828961+0000 mon.b (mon.2) 186 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mon.b"}]: dispatch 2021-03-10T13:50:10.797 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:10 gibba045 bash[9787]: audit 2021-03-10T13:50:09.838439+0000 mon.a (mon.0) 51 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:50:10.798 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:10 gibba045 bash[9787]: audit 2021-03-10T13:50:09.840722+0000 mon.b (mon.2) 187 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:50:10.798 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:10 gibba045 bash[9787]: audit 2021-03-10T13:50:09.841472+0000 mon.b (mon.2) 188 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:50:10.798 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:10 gibba045 bash[9787]: audit 2021-03-10T13:50:09.842225+0000 mon.b (mon.2) 189 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:50:10.798 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:10 gibba045 bash[9787]: audit 2021-03-10T13:50:09.843237+0000 mon.b (mon.2) 190 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2021-03-10T13:50:11.513 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:11 gibba045 bash[9787]: cephadm 2021-03-10T13:50:09.828640+0000 mgr.gibba045.orlgmj (mgr.34412) 30 : cephadm [INF] Upgrade: Updating mon.b 2021-03-10T13:50:11.514 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:11 gibba045 bash[9787]: cephadm 2021-03-10T13:50:09.842943+0000 mgr.gibba045.orlgmj (mgr.34412) 31 : cephadm [INF] Deploying daemon mon.b on gibba045 2021-03-10T13:50:11.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:11 gibba015 bash[29377]: cephadm 2021-03-10T13:50:09.828640+0000 mgr.gibba045.orlgmj (mgr.34412) 30 : cephadm [INF] Upgrade: Updating mon.b 2021-03-10T13:50:11.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:11 gibba015 bash[29377]: cephadm 2021-03-10T13:50:09.842943+0000 mgr.gibba045.orlgmj (mgr.34412) 31 : cephadm [INF] Deploying daemon mon.b on gibba045 2021-03-10T13:50:11.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:11 gibba015 bash[30343]: cephadm 2021-03-10T13:50:09.828640+0000 mgr.gibba045.orlgmj (mgr.34412) 30 : cephadm [INF] Upgrade: Updating mon.b 2021-03-10T13:50:11.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:11 gibba015 bash[30343]: cephadm 2021-03-10T13:50:09.842943+0000 mgr.gibba045.orlgmj (mgr.34412) 31 : cephadm [INF] Deploying daemon mon.b on gibba045 2021-03-10T13:50:11.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:11 gibba045 systemd[1]: Stopping Ceph mon.b for e4a642d2-81a5-11eb-9080-001a4aab830c... 2021-03-10T13:50:11.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:11 gibba045 bash[9787]: debug 2021-03-10T13:50:11.662+0000 7fe1ec237700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2021-03-10T13:50:11.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:11 gibba045 bash[9787]: debug 2021-03-10T13:50:11.662+0000 7fe1ec237700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2021-03-10T13:50:12.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:12 gibba045 docker[25437]: ceph-e4a642d2-81a5-11eb-9080-001a4aab830c-mon.b 2021-03-10T13:50:12.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:12 gibba045 systemd[1]: ceph-e4a642d2-81a5-11eb-9080-001a4aab830c@mon.b.service: Succeeded. 2021-03-10T13:50:12.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:12 gibba045 systemd[1]: Stopped Ceph mon.b for e4a642d2-81a5-11eb-9080-001a4aab830c. 2021-03-10T13:50:12.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:12 gibba045 systemd[1]: Started Ceph mon.b for e4a642d2-81a5-11eb-9080-001a4aab830c. 2021-03-10T13:50:13.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.522+0000 7f65c31b7700 0 set uid:gid to 167:167 (ceph:ceph) 2021-03-10T13:50:13.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.522+0000 7f65c31b7700 0 ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev), process ceph-mon, pid 6 2021-03-10T13:50:13.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.522+0000 7f65c31b7700 0 pidfile_write: ignore empty --pid-file 2021-03-10T13:50:13.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.522+0000 7f65c31b7700 0 load: jerasure load: lrc load: isa 2021-03-10T13:50:13.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: RocksDB version: 6.8.1 2021-03-10T13:50:13.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2021-03-10T13:50:13.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Compile date Mar 9 2021 2021-03-10T13:50:13.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: DB SUMMARY 2021-03-10T13:50:13.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: CURRENT file: CURRENT 2021-03-10T13:50:13.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: IDENTITY file: IDENTITY 2021-03-10T13:50:13.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 771 Bytes 2021-03-10T13:50:13.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 2, files: 000022.sst 000023.sst 2021-03-10T13:50:13.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000020.log size: 19413864 ; 2021-03-10T13:50:13.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.error_if_exists: 0 2021-03-10T13:50:13.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.create_if_missing: 0 2021-03-10T13:50:13.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.paranoid_checks: 1 2021-03-10T13:50:13.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.env: 0x5621260351c0 2021-03-10T13:50:13.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.fs: Posix File System 2021-03-10T13:50:13.812 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.info_log: 0x562126c851e0 2021-03-10T13:50:13.812 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.max_file_opening_threads: 16 2021-03-10T13:50:13.812 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.statistics: (nil) 2021-03-10T13:50:13.812 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.use_fsync: 0 2021-03-10T13:50:13.812 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.max_log_file_size: 0 2021-03-10T13:50:13.813 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2021-03-10T13:50:13.813 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.log_file_time_to_roll: 0 2021-03-10T13:50:13.813 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.keep_log_file_num: 1000 2021-03-10T13:50:13.813 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.recycle_log_file_num: 0 2021-03-10T13:50:13.815 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.allow_fallocate: 1 2021-03-10T13:50:13.815 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.allow_mmap_reads: 0 2021-03-10T13:50:13.815 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.allow_mmap_writes: 0 2021-03-10T13:50:13.815 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.use_direct_reads: 0 2021-03-10T13:50:13.816 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2021-03-10T13:50:13.816 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.create_missing_column_families: 0 2021-03-10T13:50:13.816 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.db_log_dir: 2021-03-10T13:50:13.816 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-b/store.db 2021-03-10T13:50:13.816 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.table_cache_numshardbits: 6 2021-03-10T13:50:13.817 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.max_subcompactions: 1 2021-03-10T13:50:13.817 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.max_background_flushes: -1 2021-03-10T13:50:13.817 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.WAL_ttl_seconds: 0 2021-03-10T13:50:13.817 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.WAL_size_limit_MB: 0 2021-03-10T13:50:13.818 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2021-03-10T13:50:13.818 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2021-03-10T13:50:13.818 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.is_fd_close_on_exec: 1 2021-03-10T13:50:13.818 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.advise_random_on_open: 1 2021-03-10T13:50:13.818 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.db_write_buffer_size: 0 2021-03-10T13:50:13.819 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.write_buffer_manager: 0x562126cd9c50 2021-03-10T13:50:13.819 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2021-03-10T13:50:13.819 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2021-03-10T13:50:13.819 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2021-03-10T13:50:13.819 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.use_adaptive_mutex: 0 2021-03-10T13:50:13.820 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.rate_limiter: (nil) 2021-03-10T13:50:13.820 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2021-03-10T13:50:13.820 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.wal_recovery_mode: 2 2021-03-10T13:50:13.820 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.enable_thread_tracking: 0 2021-03-10T13:50:13.820 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.enable_pipelined_write: 0 2021-03-10T13:50:13.821 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.unordered_write: 0 2021-03-10T13:50:13.821 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2021-03-10T13:50:13.821 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2021-03-10T13:50:13.821 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2021-03-10T13:50:13.821 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2021-03-10T13:50:13.822 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.row_cache: None 2021-03-10T13:50:13.822 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.wal_filter: None 2021-03-10T13:50:13.822 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2021-03-10T13:50:13.822 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.allow_ingest_behind: 0 2021-03-10T13:50:13.822 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.preserve_deletes: 0 2021-03-10T13:50:13.823 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.two_write_queues: 0 2021-03-10T13:50:13.823 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.manual_wal_flush: 0 2021-03-10T13:50:13.823 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.atomic_flush: 0 2021-03-10T13:50:13.823 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2021-03-10T13:50:13.823 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.persist_stats_to_disk: 0 2021-03-10T13:50:13.824 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.write_dbid_to_manifest: 0 2021-03-10T13:50:13.824 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.log_readahead_size: 0 2021-03-10T13:50:13.824 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.sst_file_checksum_func: Unknown 2021-03-10T13:50:13.824 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.max_background_jobs: 2 2021-03-10T13:50:13.825 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.max_background_compactions: -1 2021-03-10T13:50:13.825 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2021-03-10T13:50:13.825 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2021-03-10T13:50:13.825 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.delayed_write_rate : 16777216 2021-03-10T13:50:13.825 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.max_total_wal_size: 0 2021-03-10T13:50:13.825 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2021-03-10T13:50:13.826 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.stats_dump_period_sec: 600 2021-03-10T13:50:13.826 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.stats_persist_period_sec: 600 2021-03-10T13:50:13.826 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2021-03-10T13:50:13.826 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.max_open_files: -1 2021-03-10T13:50:13.827 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.bytes_per_sync: 0 2021-03-10T13:50:13.827 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.wal_bytes_per_sync: 0 2021-03-10T13:50:13.827 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.strict_bytes_per_sync: 0 2021-03-10T13:50:13.827 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.compaction_readahead_size: 0 2021-03-10T13:50:13.828 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Compression algorithms supported: 2021-03-10T13:50:13.828 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2021-03-10T13:50:13.828 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: kZSTD supported: 0 2021-03-10T13:50:13.828 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: kXpressCompression supported: 0 2021-03-10T13:50:13.828 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: kLZ4HCCompression supported: 1 2021-03-10T13:50:13.829 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: kLZ4Compression supported: 1 2021-03-10T13:50:13.829 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: kBZip2Compression supported: 0 2021-03-10T13:50:13.829 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: kZlibCompression supported: 1 2021-03-10T13:50:13.829 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: kSnappyCompression supported: 1 2021-03-10T13:50:13.829 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Fast CRC32 supported: Supported on x86 2021-03-10T13:50:13.830 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2021-03-10T13:50:13.830 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2021-03-10T13:50:13.830 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2021-03-10T13:50:13.830 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.merge_operator: 2021-03-10T13:50:13.830 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.compaction_filter: None 2021-03-10T13:50:13.831 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.compaction_filter_factory: None 2021-03-10T13:50:13.831 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.memtable_factory: SkipListFactory 2021-03-10T13:50:13.831 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.table_factory: BlockBasedTable 2021-03-10T13:50:13.831 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x562126c28230) 2021-03-10T13:50:13.831 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: cache_index_and_filter_blocks: 1 2021-03-10T13:50:13.832 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: cache_index_and_filter_blocks_with_high_priority: 0 2021-03-10T13:50:13.832 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: pin_l0_filter_and_index_blocks_in_cache: 0 2021-03-10T13:50:13.832 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: pin_top_level_index_and_filter: 1 2021-03-10T13:50:13.832 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: index_type: 0 2021-03-10T13:50:13.832 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: data_block_index_type: 0 2021-03-10T13:50:13.833 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: index_shortening: 1 2021-03-10T13:50:13.833 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: data_block_hash_table_util_ratio: 0.750000 2021-03-10T13:50:13.833 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: hash_index_allow_collision: 1 2021-03-10T13:50:13.833 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: checksum: 1 2021-03-10T13:50:13.833 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: no_block_cache: 0 2021-03-10T13:50:13.834 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: block_cache: 0x562126c60510 2021-03-10T13:50:13.834 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: block_cache_name: BinnedLRUCache 2021-03-10T13:50:13.834 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: block_cache_options: 2021-03-10T13:50:13.834 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: capacity : 536870912 2021-03-10T13:50:13.835 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: num_shard_bits : 4 2021-03-10T13:50:13.835 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: strict_capacity_limit : 0 2021-03-10T13:50:13.835 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: high_pri_pool_ratio: 0.000 2021-03-10T13:50:13.835 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: block_cache_compressed: (nil) 2021-03-10T13:50:13.835 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: persistent_cache: (nil) 2021-03-10T13:50:13.836 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: block_size: 4096 2021-03-10T13:50:13.836 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: block_size_deviation: 10 2021-03-10T13:50:13.836 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: block_restart_interval: 16 2021-03-10T13:50:13.836 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: index_block_restart_interval: 1 2021-03-10T13:50:13.836 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: metadata_block_size: 4096 2021-03-10T13:50:13.837 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: partition_filters: 0 2021-03-10T13:50:13.837 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: use_delta_encoding: 1 2021-03-10T13:50:13.837 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: filter_policy: rocksdb.BuiltinBloomFilter 2021-03-10T13:50:13.837 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: whole_key_filtering: 1 2021-03-10T13:50:13.837 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: verify_compression: 0 2021-03-10T13:50:13.837 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: read_amp_bytes_per_bit: 0 2021-03-10T13:50:13.838 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: format_version: 2 2021-03-10T13:50:13.838 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: enable_index_compression: 1 2021-03-10T13:50:13.838 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: block_align: 0 2021-03-10T13:50:13.838 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.write_buffer_size: 33554432 2021-03-10T13:50:13.839 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.max_write_buffer_number: 2 2021-03-10T13:50:13.839 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.compression: NoCompression 2021-03-10T13:50:13.839 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.bottommost_compression: Disabled 2021-03-10T13:50:13.839 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.prefix_extractor: nullptr 2021-03-10T13:50:13.839 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2021-03-10T13:50:13.840 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.num_levels: 7 2021-03-10T13:50:13.840 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2021-03-10T13:50:13.840 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2021-03-10T13:50:13.840 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2021-03-10T13:50:13.840 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2021-03-10T13:50:13.841 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2021-03-10T13:50:13.841 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2021-03-10T13:50:13.841 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2021-03-10T13:50:13.841 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2021-03-10T13:50:13.841 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2021-03-10T13:50:13.842 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.compression_opts.window_bits: -14 2021-03-10T13:50:13.842 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.compression_opts.level: 32767 2021-03-10T13:50:13.842 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.compression_opts.strategy: 0 2021-03-10T13:50:13.842 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2021-03-10T13:50:13.842 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2021-03-10T13:50:13.843 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.compression_opts.enabled: false 2021-03-10T13:50:13.843 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2021-03-10T13:50:13.843 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2021-03-10T13:50:13.843 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2021-03-10T13:50:13.843 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.target_file_size_base: 67108864 2021-03-10T13:50:13.844 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.target_file_size_multiplier: 1 2021-03-10T13:50:13.844 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2021-03-10T13:50:13.844 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2021-03-10T13:50:13.844 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2021-03-10T13:50:13.844 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2021-03-10T13:50:13.845 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2021-03-10T13:50:13.845 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2021-03-10T13:50:13.845 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2021-03-10T13:50:13.845 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2021-03-10T13:50:13.845 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2021-03-10T13:50:13.846 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2021-03-10T13:50:13.846 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2021-03-10T13:50:13.846 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2021-03-10T13:50:13.846 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.arena_block_size: 4194304 2021-03-10T13:50:13.846 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2021-03-10T13:50:13.847 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2021-03-10T13:50:13.847 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2021-03-10T13:50:13.847 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.disable_auto_compactions: 0 2021-03-10T13:50:13.847 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2021-03-10T13:50:13.848 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2021-03-10T13:50:13.848 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2021-03-10T13:50:13.848 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2021-03-10T13:50:13.848 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2021-03-10T13:50:13.848 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2021-03-10T13:50:13.849 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2021-03-10T13:50:13.849 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2021-03-10T13:50:13.849 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2021-03-10T13:50:13.849 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2021-03-10T13:50:13.849 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.table_properties_collectors: 2021-03-10T13:50:13.850 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.inplace_update_support: 0 2021-03-10T13:50:13.850 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.inplace_update_num_locks: 10000 2021-03-10T13:50:13.850 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2021-03-10T13:50:13.850 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2021-03-10T13:50:13.850 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.memtable_huge_page_size: 0 2021-03-10T13:50:13.851 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.bloom_locality: 0 2021-03-10T13:50:13.851 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.max_successive_merges: 0 2021-03-10T13:50:13.851 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.optimize_filters_for_hits: 0 2021-03-10T13:50:13.851 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.paranoid_file_checks: 0 2021-03-10T13:50:13.851 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.force_consistency_checks: 0 2021-03-10T13:50:13.852 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.report_bg_io_stats: 0 2021-03-10T13:50:13.852 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.ttl: 2592000 2021-03-10T13:50:13.852 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: Options.periodic_compaction_seconds: 0 2021-03-10T13:50:13.852 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 25, last_sequence is 9181, log_number is 20,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2021-03-10T13:50:13.852 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 20 2021-03-10T13:50:13.853 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1615384213529362, "job": 1, "event": "recovery_started", "log_files": [20]} 2021-03-10T13:50:13.853 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.526+0000 7f65c31b7700 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #20 mode 2 2021-03-10T13:50:13.853 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.534+0000 7f65c31b7700 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2021-03-10T13:50:13.853 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.546+0000 7f65c31b7700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1615384213548794, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 25, "file_size": 12839356, "table_properties": {"data_size": 12832484, "index_size": 5344, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 709, "raw_key_size": 6204, "raw_average_key_size": 22, "raw_value_size": 12824184, "raw_average_value_size": 45637, "num_data_blocks": 168, "num_entries": 281, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1615384213, "oldest_key_time": 3, "file_creation_time": 0}} 2021-03-10T13:50:13.853 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.546+0000 7f65c31b7700 4 rocksdb: [version_set.cc:3826] Creating manifest 26 2021-03-10T13:50:13.854 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.546+0000 7f65c31b7700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1615384213549755, "job": 1, "event": "recovery_finished"} 2021-03-10T13:50:13.854 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.546+0000 7f65c31b7700 4 rocksdb: DB pointer 0x562126d25800 2021-03-10T13:50:13.854 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.546+0000 7f65a9fca700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2021-03-10T13:50:13.854 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.546+0000 7f65a9fca700 4 rocksdb: [db_impl/db_impl.cc:851] 2021-03-10T13:50:13.854 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: ** DB Stats ** 2021-03-10T13:50:13.855 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T13:50:13.855 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2021-03-10T13:50:13.855 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2021-03-10T13:50:13.855 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2021-03-10T13:50:13.856 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2021-03-10T13:50:13.856 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2021-03-10T13:50:13.856 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2021-03-10T13:50:13.856 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: ** Compaction Stats [default] ** 2021-03-10T13:50:13.856 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T13:50:13.857 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T13:50:13.857 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: L0 1/0 12.24 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1164.9 0.01 0.00 1 0.011 0 0 2021-03-10T13:50:13.857 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: L6 2/0 65.18 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-03-10T13:50:13.857 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: Sum 3/0 77.43 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1164.9 0.01 0.00 1 0.011 0 0 2021-03-10T13:50:13.857 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1164.9 0.01 0.00 1 0.011 0 0 2021-03-10T13:50:13.858 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: ** Compaction Stats [default] ** 2021-03-10T13:50:13.858 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T13:50:13.858 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T13:50:13.858 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1164.9 0.01 0.00 1 0.011 0 0 2021-03-10T13:50:13.858 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T13:50:13.859 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: Flush(GB): cumulative 0.012, interval 0.012 2021-03-10T13:50:13.859 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: AddFile(GB): cumulative 0.000, interval 0.000 2021-03-10T13:50:13.859 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: AddFile(Total Files): cumulative 0, interval 0 2021-03-10T13:50:13.859 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: AddFile(L0 Files): cumulative 0, interval 0 2021-03-10T13:50:13.859 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: AddFile(Keys): cumulative 0, interval 0 2021-03-10T13:50:13.860 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: Cumulative compaction: 0.01 GB write, 541.79 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T13:50:13.860 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: Interval compaction: 0.01 GB write, 541.79 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T13:50:13.860 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-03-10T13:50:13.860 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: ** File Read Latency Histogram By Level [default] ** 2021-03-10T13:50:13.860 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: ** Compaction Stats [default] ** 2021-03-10T13:50:13.861 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T13:50:13.861 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T13:50:13.861 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: L0 1/0 12.24 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1164.9 0.01 0.00 1 0.011 0 0 2021-03-10T13:50:13.861 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: L6 2/0 65.18 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-03-10T13:50:13.861 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: Sum 3/0 77.43 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1164.9 0.01 0.00 1 0.011 0 0 2021-03-10T13:50:13.862 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-03-10T13:50:13.862 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: ** Compaction Stats [default] ** 2021-03-10T13:50:13.862 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T13:50:13.862 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T13:50:13.862 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1164.9 0.01 0.00 1 0.011 0 0 2021-03-10T13:50:13.863 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T13:50:13.863 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: Flush(GB): cumulative 0.012, interval 0.000 2021-03-10T13:50:13.863 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: AddFile(GB): cumulative 0.000, interval 0.000 2021-03-10T13:50:13.863 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: AddFile(Total Files): cumulative 0, interval 0 2021-03-10T13:50:13.863 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: AddFile(L0 Files): cumulative 0, interval 0 2021-03-10T13:50:13.864 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: AddFile(Keys): cumulative 0, interval 0 2021-03-10T13:50:13.864 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: Cumulative compaction: 0.01 GB write, 541.20 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T13:50:13.864 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T13:50:13.864 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-03-10T13:50:13.865 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: ** File Read Latency Histogram By Level [default] ** 2021-03-10T13:50:13.865 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.546+0000 7f65c31b7700 0 starting mon.b rank 2 at public addrs [v2:172.21.2.145:3300/0,v1:172.21.2.145:6789/0] at bind addrs [v2:172.21.2.145:3300/0,v1:172.21.2.145:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid e4a642d2-81a5-11eb-9080-001a4aab830c 2021-03-10T13:50:13.865 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.550+0000 7f65c31b7700 1 mon.b@-1(???) e3 preinit fsid e4a642d2-81a5-11eb-9080-001a4aab830c 2021-03-10T13:50:13.865 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.550+0000 7f65c31b7700 0 mon.b@-1(???).mds e1 new map 2021-03-10T13:50:13.865 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.550+0000 7f65c31b7700 0 mon.b@-1(???).mds e1 print_map 2021-03-10T13:50:13.866 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: e1 2021-03-10T13:50:13.866 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: enable_multiple, ever_enabled_multiple: 0,0 2021-03-10T13:50:13.866 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-03-10T13:50:13.866 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: legacy client fscid: -1 2021-03-10T13:50:13.866 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: 2021-03-10T13:50:13.867 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: No filesystems configured 2021-03-10T13:50:13.867 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.550+0000 7f65c31b7700 0 mon.b@-1(???).osd e62 crush map has features 3314933000852226048, adjusting msgr requires 2021-03-10T13:50:13.867 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.550+0000 7f65c31b7700 0 mon.b@-1(???).osd e62 crush map has features 288514051259236352, adjusting msgr requires 2021-03-10T13:50:13.867 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.550+0000 7f65c31b7700 0 mon.b@-1(???).osd e62 crush map has features 288514051259236352, adjusting msgr requires 2021-03-10T13:50:13.867 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.550+0000 7f65c31b7700 0 mon.b@-1(???).osd e62 crush map has features 288514051259236352, adjusting msgr requires 2021-03-10T13:50:13.868 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: cephadm 2021-03-10T13:50:09.828640+0000 mgr.gibba045.orlgmj (mgr.34412) 30 : cephadm [INF] Upgrade: Updating mon.b 2021-03-10T13:50:13.868 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: cephadm 2021-03-10T13:50:09.842943+0000 mgr.gibba045.orlgmj (mgr.34412) 31 : cephadm [INF] Deploying daemon mon.b on gibba045 2021-03-10T13:50:13.868 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:13 gibba045 bash[25517]: debug 2021-03-10T13:50:13.550+0000 7f65c31b7700 1 mon.b@-1(???).paxosservice(auth 1..22) refresh upgraded, format 0 -> 3 2021-03-10T13:50:14.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:14 gibba015 bash[29377]: debug 2021-03-10T13:50:14.051+0000 7f21bab47700 -1 log_channel(cluster) log [ERR] : Health detail: HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:50:14.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:14 gibba015 bash[29377]: debug 2021-03-10T13:50:14.051+0000 7f21bab47700 -1 log_channel(cluster) log [ERR] : [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2021-03-10T13:50:14.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:14 gibba015 bash[29377]: debug 2021-03-10T13:50:14.051+0000 7f21bab47700 -1 log_channel(cluster) log [ERR] : daemon rgw.r.z.gibba045.atotkw on gibba045 is in error state 2021-03-10T13:50:14.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:14 gibba015 bash[29377]: debug 2021-03-10T13:50:14.051+0000 7f21bab47700 -1 log_channel(cluster) log [ERR] : [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:50:14.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:14 gibba015 bash[29377]: debug 2021-03-10T13:50:14.051+0000 7f21bab47700 -1 log_channel(cluster) log [ERR] : Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:50:19.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:19 gibba015 bash[29377]: debug 2021-03-10T13:50:19.068+0000 7f21bc34a700 -1 log_channel(cluster) log [ERR] : Health detail: HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:50:19.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:19 gibba015 bash[29377]: debug 2021-03-10T13:50:19.068+0000 7f21bc34a700 -1 log_channel(cluster) log [ERR] : [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2021-03-10T13:50:19.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:19 gibba015 bash[29377]: debug 2021-03-10T13:50:19.068+0000 7f21bc34a700 -1 log_channel(cluster) log [ERR] : daemon rgw.r.z.gibba045.atotkw on gibba045 is in error state 2021-03-10T13:50:19.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:19 gibba015 bash[29377]: debug 2021-03-10T13:50:19.068+0000 7f21bc34a700 -1 log_channel(cluster) log [ERR] : [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:50:19.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:19 gibba015 bash[29377]: debug 2021-03-10T13:50:19.068+0000 7f21bc34a700 -1 log_channel(cluster) log [ERR] : Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:50:19.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:19 gibba015 bash[29377]: debug 2021-03-10T13:50:19.100+0000 7f21bab47700 -1 log_channel(cluster) log [ERR] : Health detail: HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:50:19.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:19 gibba015 bash[29377]: debug 2021-03-10T13:50:19.100+0000 7f21bab47700 -1 log_channel(cluster) log [ERR] : [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2021-03-10T13:50:19.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:19 gibba015 bash[29377]: debug 2021-03-10T13:50:19.100+0000 7f21bab47700 -1 log_channel(cluster) log [ERR] : daemon rgw.r.z.gibba045.atotkw on gibba045 is in error state 2021-03-10T13:50:19.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:19 gibba015 bash[29377]: debug 2021-03-10T13:50:19.100+0000 7f21bab47700 -1 log_channel(cluster) log [ERR] : [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:50:19.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:19 gibba015 bash[29377]: debug 2021-03-10T13:50:19.100+0000 7f21bab47700 -1 log_channel(cluster) log [ERR] : Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:50:20.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:20 gibba015 bash[29377]: cluster 2021-03-10T13:50:14.056025+0000 mon.c (mon.1) 3 : cluster [INF] mon.c calling monitor election 2021-03-10T13:50:20.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:20 gibba015 bash[29377]: cluster 2021-03-10T13:50:14.062618+0000 mon.b (mon.2) 2 : cluster [INF] mon.b calling monitor election 2021-03-10T13:50:20.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:20 gibba015 bash[29377]: cluster 2021-03-10T13:50:14.944501+0000 mgr.gibba045.orlgmj (mgr.34412) 34 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:20.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:20 gibba015 bash[29377]: cluster 2021-03-10T13:50:16.945409+0000 mgr.gibba045.orlgmj (mgr.34412) 35 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:20.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:20 gibba015 bash[29377]: cluster 2021-03-10T13:50:18.947219+0000 mgr.gibba045.orlgmj (mgr.34412) 36 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:20.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:20 gibba015 bash[29377]: cluster 2021-03-10T13:50:19.067116+0000 mon.c (mon.1) 4 : cluster [INF] mon.c calling monitor election 2021-03-10T13:50:20.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:20 gibba015 bash[29377]: cluster 2021-03-10T13:50:19.067720+0000 mon.a (mon.0) 66 : cluster [DBG] fsmap 2021-03-10T13:50:20.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:20 gibba015 bash[29377]: cluster 2021-03-10T13:50:19.067732+0000 mon.a (mon.0) 67 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2021-03-10T13:50:20.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:20 gibba015 bash[29377]: cluster 2021-03-10T13:50:19.068230+0000 mon.a (mon.0) 68 : cluster [DBG] mgrmap e25: gibba045.orlgmj(active, since 27s), standbys: x, y 2021-03-10T13:50:20.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:20 gibba015 bash[29377]: cluster 2021-03-10T13:50:19.068345+0000 mon.a (mon.0) 69 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2021-03-10T13:50:20.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:20 gibba015 bash[29377]: cluster 2021-03-10T13:50:19.069789+0000 mon.a (mon.0) 70 : cluster [ERR] Health detail: HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:50:20.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:20 gibba015 bash[29377]: cluster 2021-03-10T13:50:19.069800+0000 mon.a (mon.0) 71 : cluster [ERR] [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2021-03-10T13:50:20.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:20 gibba015 bash[29377]: cluster 2021-03-10T13:50:19.069806+0000 mon.a (mon.0) 72 : cluster [ERR] daemon rgw.r.z.gibba045.atotkw on gibba045 is in error state 2021-03-10T13:50:20.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:20 gibba015 bash[29377]: cluster 2021-03-10T13:50:19.069811+0000 mon.a (mon.0) 73 : cluster [ERR] [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:50:20.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:20 gibba015 bash[29377]: cluster 2021-03-10T13:50:19.069816+0000 mon.a (mon.0) 74 : cluster [ERR] Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:50:20.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:20 gibba015 bash[29377]: cluster 2021-03-10T13:50:19.070127+0000 mon.a (mon.0) 75 : cluster [INF] mon.a calling monitor election 2021-03-10T13:50:20.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:20 gibba015 bash[29377]: cluster 2021-03-10T13:50:19.087216+0000 mon.a (mon.0) 76 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-03-10T13:50:20.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:20 gibba015 bash[29377]: cluster 2021-03-10T13:50:19.094728+0000 mon.a (mon.0) 77 : cluster [DBG] monmap e4: 3 mons at {a=[v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0],b=[v2:172.21.2.145:3300/0,v1:172.21.2.145:6789/0],c=[v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0]} 2021-03-10T13:50:20.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:20 gibba015 bash[29377]: cluster 2021-03-10T13:50:19.094769+0000 mon.a (mon.0) 78 : cluster [DBG] fsmap 2021-03-10T13:50:20.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:20 gibba015 bash[29377]: cluster 2021-03-10T13:50:19.094789+0000 mon.a (mon.0) 79 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2021-03-10T13:50:20.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:20 gibba015 bash[29377]: cluster 2021-03-10T13:50:19.095095+0000 mon.a (mon.0) 80 : cluster [DBG] mgrmap e25: gibba045.orlgmj(active, since 27s), standbys: x, y 2021-03-10T13:50:20.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:20 gibba015 bash[29377]: cluster 2021-03-10T13:50:19.095222+0000 mon.a (mon.0) 81 : cluster [INF] Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2021-03-10T13:50:20.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:20 gibba015 bash[29377]: cluster 2021-03-10T13:50:19.101885+0000 mon.a (mon.0) 82 : cluster [ERR] Health detail: HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:50:20.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:20 gibba015 bash[30343]: cluster 2021-03-10T13:50:14.056025+0000 mon.c (mon.1) 3 : cluster [INF] mon.c calling monitor election 2021-03-10T13:50:20.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:20 gibba015 bash[30343]: cluster 2021-03-10T13:50:14.062618+0000 mon.b (mon.2) 2 : cluster [INF] mon.b calling monitor election 2021-03-10T13:50:20.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:20 gibba015 bash[30343]: cluster 2021-03-10T13:50:14.944501+0000 mgr.gibba045.orlgmj (mgr.34412) 34 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:20.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:20 gibba015 bash[30343]: cluster 2021-03-10T13:50:16.945409+0000 mgr.gibba045.orlgmj (mgr.34412) 35 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:20.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:20 gibba015 bash[30343]: cluster 2021-03-10T13:50:18.947219+0000 mgr.gibba045.orlgmj (mgr.34412) 36 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:20.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:20 gibba015 bash[30343]: cluster 2021-03-10T13:50:19.067116+0000 mon.c (mon.1) 4 : cluster [INF] mon.c calling monitor election 2021-03-10T13:50:20.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:20 gibba015 bash[30343]: cluster 2021-03-10T13:50:19.067720+0000 mon.a (mon.0) 66 : cluster [DBG] fsmap 2021-03-10T13:50:20.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:20 gibba015 bash[30343]: cluster 2021-03-10T13:50:19.067732+0000 mon.a (mon.0) 67 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2021-03-10T13:50:20.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:20 gibba015 bash[30343]: cluster 2021-03-10T13:50:19.068230+0000 mon.a (mon.0) 68 : cluster [DBG] mgrmap e25: gibba045.orlgmj(active, since 27s), standbys: x, y 2021-03-10T13:50:20.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:20 gibba015 bash[30343]: cluster 2021-03-10T13:50:19.068345+0000 mon.a (mon.0) 69 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2021-03-10T13:50:20.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:20 gibba015 bash[30343]: cluster 2021-03-10T13:50:19.069789+0000 mon.a (mon.0) 70 : cluster [ERR] Health detail: HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:50:20.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:20 gibba015 bash[30343]: cluster 2021-03-10T13:50:19.069800+0000 mon.a (mon.0) 71 : cluster [ERR] [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2021-03-10T13:50:20.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:20 gibba015 bash[30343]: cluster 2021-03-10T13:50:19.069806+0000 mon.a (mon.0) 72 : cluster [ERR] daemon rgw.r.z.gibba045.atotkw on gibba045 is in error state 2021-03-10T13:50:20.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:20 gibba015 bash[30343]: cluster 2021-03-10T13:50:19.069811+0000 mon.a (mon.0) 73 : cluster [ERR] [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:50:20.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:20 gibba015 bash[30343]: cluster 2021-03-10T13:50:19.069816+0000 mon.a (mon.0) 74 : cluster [ERR] Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:50:20.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:20 gibba015 bash[30343]: cluster 2021-03-10T13:50:19.070127+0000 mon.a (mon.0) 75 : cluster [INF] mon.a calling monitor election 2021-03-10T13:50:20.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:20 gibba015 bash[30343]: cluster 2021-03-10T13:50:19.087216+0000 mon.a (mon.0) 76 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-03-10T13:50:20.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:20 gibba015 bash[30343]: cluster 2021-03-10T13:50:19.094728+0000 mon.a (mon.0) 77 : cluster [DBG] monmap e4: 3 mons at {a=[v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0],b=[v2:172.21.2.145:3300/0,v1:172.21.2.145:6789/0],c=[v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0]} 2021-03-10T13:50:20.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:20 gibba015 bash[30343]: cluster 2021-03-10T13:50:19.094769+0000 mon.a (mon.0) 78 : cluster [DBG] fsmap 2021-03-10T13:50:20.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:20 gibba015 bash[30343]: cluster 2021-03-10T13:50:19.094789+0000 mon.a (mon.0) 79 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2021-03-10T13:50:20.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:20 gibba015 bash[30343]: cluster 2021-03-10T13:50:19.095095+0000 mon.a (mon.0) 80 : cluster [DBG] mgrmap e25: gibba045.orlgmj(active, since 27s), standbys: x, y 2021-03-10T13:50:20.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:20 gibba015 bash[30343]: cluster 2021-03-10T13:50:19.095222+0000 mon.a (mon.0) 81 : cluster [INF] Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2021-03-10T13:50:20.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:20 gibba015 bash[30343]: cluster 2021-03-10T13:50:19.101885+0000 mon.a (mon.0) 82 : cluster [ERR] Health detail: HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:50:20.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:20 gibba015 bash[30343]: cluster 2021-03-10T13:50:19.101902+0000 mon.a (mon.0) 83 : cluster [ERR] [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2021-03-10T13:50:20.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:20 gibba015 bash[30343]: cluster 2021-03-10T13:50:19.101912+0000 mon.a (mon.0) 84 : cluster [ERR] daemon rgw.r.z.gibba045.atotkw on gibba045 is in error state 2021-03-10T13:50:20.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:20 gibba015 bash[30343]: cluster 2021-03-10T13:50:19.101921+0000 mon.a (mon.0) 85 : cluster [ERR] [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:50:20.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:20 gibba015 bash[30343]: cluster 2021-03-10T13:50:19.101929+0000 mon.a (mon.0) 86 : cluster [ERR] Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:50:20.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:20 gibba015 bash[30343]: audit 2021-03-10T13:50:19.105114+0000 mon.a (mon.0) 87 : audit [INF] from='mgr.34412 ' entity='' 2021-03-10T13:50:20.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:20 gibba015 bash[30343]: audit 2021-03-10T13:50:19.106943+0000 mon.c (mon.1) 5 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:50:20.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:20 gibba015 bash[30343]: audit 2021-03-10T13:50:19.108797+0000 mon.c (mon.1) 6 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:50:20.485 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:20 gibba015 bash[29377]: cluster 2021-03-10T13:50:19.101902+0000 mon.a (mon.0) 83 : cluster [ERR] [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2021-03-10T13:50:20.485 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:20 gibba015 bash[29377]: cluster 2021-03-10T13:50:19.101912+0000 mon.a (mon.0) 84 : cluster [ERR] daemon rgw.r.z.gibba045.atotkw on gibba045 is in error state 2021-03-10T13:50:20.485 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:20 gibba015 bash[29377]: cluster 2021-03-10T13:50:19.101921+0000 mon.a (mon.0) 85 : cluster [ERR] [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:50:20.485 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:20 gibba015 bash[29377]: cluster 2021-03-10T13:50:19.101929+0000 mon.a (mon.0) 86 : cluster [ERR] Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:50:20.485 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:20 gibba015 bash[29377]: audit 2021-03-10T13:50:19.105114+0000 mon.a (mon.0) 87 : audit [INF] from='mgr.34412 ' entity='' 2021-03-10T13:50:20.486 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:20 gibba015 bash[29377]: audit 2021-03-10T13:50:19.106943+0000 mon.c (mon.1) 5 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:50:20.486 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:20 gibba015 bash[29377]: audit 2021-03-10T13:50:19.108797+0000 mon.c (mon.1) 6 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:50:20.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:20 gibba045 bash[25517]: cluster 2021-03-10T13:50:14.056025+0000 mon.c (mon.1) 3 : cluster [INF] mon.c calling monitor election 2021-03-10T13:50:20.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:20 gibba045 bash[25517]: cluster 2021-03-10T13:50:14.062618+0000 mon.b (mon.2) 2 : cluster [INF] mon.b calling monitor election 2021-03-10T13:50:20.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:20 gibba045 bash[25517]: cluster 2021-03-10T13:50:14.944501+0000 mgr.gibba045.orlgmj (mgr.34412) 34 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:20.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:20 gibba045 bash[25517]: cluster 2021-03-10T13:50:16.945409+0000 mgr.gibba045.orlgmj (mgr.34412) 35 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:20.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:20 gibba045 bash[25517]: cluster 2021-03-10T13:50:18.947219+0000 mgr.gibba045.orlgmj (mgr.34412) 36 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:20.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:20 gibba045 bash[25517]: cluster 2021-03-10T13:50:19.067116+0000 mon.c (mon.1) 4 : cluster [INF] mon.c calling monitor election 2021-03-10T13:50:20.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:20 gibba045 bash[25517]: cluster 2021-03-10T13:50:19.067720+0000 mon.a (mon.0) 66 : cluster [DBG] fsmap 2021-03-10T13:50:20.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:20 gibba045 bash[25517]: cluster 2021-03-10T13:50:19.067732+0000 mon.a (mon.0) 67 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2021-03-10T13:50:20.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:20 gibba045 bash[25517]: cluster 2021-03-10T13:50:19.068230+0000 mon.a (mon.0) 68 : cluster [DBG] mgrmap e25: gibba045.orlgmj(active, since 27s), standbys: x, y 2021-03-10T13:50:20.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:20 gibba045 bash[25517]: cluster 2021-03-10T13:50:19.068345+0000 mon.a (mon.0) 69 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2021-03-10T13:50:20.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:20 gibba045 bash[25517]: cluster 2021-03-10T13:50:19.069789+0000 mon.a (mon.0) 70 : cluster [ERR] Health detail: HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:50:20.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:20 gibba045 bash[25517]: cluster 2021-03-10T13:50:19.069800+0000 mon.a (mon.0) 71 : cluster [ERR] [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2021-03-10T13:50:20.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:20 gibba045 bash[25517]: cluster 2021-03-10T13:50:19.069806+0000 mon.a (mon.0) 72 : cluster [ERR] daemon rgw.r.z.gibba045.atotkw on gibba045 is in error state 2021-03-10T13:50:20.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:20 gibba045 bash[25517]: cluster 2021-03-10T13:50:19.069811+0000 mon.a (mon.0) 73 : cluster [ERR] [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:50:20.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:20 gibba045 bash[25517]: cluster 2021-03-10T13:50:19.069816+0000 mon.a (mon.0) 74 : cluster [ERR] Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:50:20.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:20 gibba045 bash[25517]: cluster 2021-03-10T13:50:19.070127+0000 mon.a (mon.0) 75 : cluster [INF] mon.a calling monitor election 2021-03-10T13:50:20.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:20 gibba045 bash[25517]: cluster 2021-03-10T13:50:19.087216+0000 mon.a (mon.0) 76 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-03-10T13:50:20.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:20 gibba045 bash[25517]: cluster 2021-03-10T13:50:19.094728+0000 mon.a (mon.0) 77 : cluster [DBG] monmap e4: 3 mons at {a=[v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0],b=[v2:172.21.2.145:3300/0,v1:172.21.2.145:6789/0],c=[v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0]} 2021-03-10T13:50:20.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:20 gibba045 bash[25517]: cluster 2021-03-10T13:50:19.094769+0000 mon.a (mon.0) 78 : cluster [DBG] fsmap 2021-03-10T13:50:20.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:20 gibba045 bash[25517]: cluster 2021-03-10T13:50:19.094789+0000 mon.a (mon.0) 79 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2021-03-10T13:50:20.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:20 gibba045 bash[25517]: cluster 2021-03-10T13:50:19.095095+0000 mon.a (mon.0) 80 : cluster [DBG] mgrmap e25: gibba045.orlgmj(active, since 27s), standbys: x, y 2021-03-10T13:50:20.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:20 gibba045 bash[25517]: cluster 2021-03-10T13:50:19.095222+0000 mon.a (mon.0) 81 : cluster [INF] Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2021-03-10T13:50:20.563 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:20 gibba045 bash[25517]: cluster 2021-03-10T13:50:19.101885+0000 mon.a (mon.0) 82 : cluster [ERR] Health detail: HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:50:20.563 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:20 gibba045 bash[25517]: cluster 2021-03-10T13:50:19.101902+0000 mon.a (mon.0) 83 : cluster [ERR] [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2021-03-10T13:50:20.563 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:20 gibba045 bash[25517]: cluster 2021-03-10T13:50:19.101912+0000 mon.a (mon.0) 84 : cluster [ERR] daemon rgw.r.z.gibba045.atotkw on gibba045 is in error state 2021-03-10T13:50:20.563 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:20 gibba045 bash[25517]: cluster 2021-03-10T13:50:19.101921+0000 mon.a (mon.0) 85 : cluster [ERR] [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:50:20.563 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:20 gibba045 bash[25517]: cluster 2021-03-10T13:50:19.101929+0000 mon.a (mon.0) 86 : cluster [ERR] Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:50:20.564 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:20 gibba045 bash[25517]: audit 2021-03-10T13:50:19.105114+0000 mon.a (mon.0) 87 : audit [INF] from='mgr.34412 ' entity='' 2021-03-10T13:50:20.564 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:20 gibba045 bash[25517]: audit 2021-03-10T13:50:19.106943+0000 mon.c (mon.1) 5 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:50:20.564 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:20 gibba045 bash[25517]: audit 2021-03-10T13:50:19.108797+0000 mon.c (mon.1) 6 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:50:22.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:22 gibba015 bash[29377]: cluster 2021-03-10T13:50:20.948269+0000 mgr.gibba045.orlgmj (mgr.34412) 37 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:22.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:22 gibba015 bash[30343]: cluster 2021-03-10T13:50:20.948269+0000 mgr.gibba045.orlgmj (mgr.34412) 37 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:22.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:22 gibba045 bash[25517]: cluster 2021-03-10T13:50:20.948269+0000 mgr.gibba045.orlgmj (mgr.34412) 37 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:24.305 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:24 gibba015 bash[29377]: cluster 2021-03-10T13:50:22.948791+0000 mgr.gibba045.orlgmj (mgr.34412) 38 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:24.305 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:24 gibba015 bash[29377]: audit 2021-03-10T13:50:23.047249+0000 mon.a (mon.0) 88 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:50:24.305 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:24 gibba015 bash[29377]: audit 2021-03-10T13:50:23.052605+0000 mon.a (mon.0) 89 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:50:24.306 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:24 gibba015 bash[29377]: audit 2021-03-10T13:50:23.057010+0000 mon.c (mon.1) 7 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:50:24.306 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:24 gibba015 bash[29377]: cephadm 2021-03-10T13:50:23.057275+0000 mgr.gibba045.orlgmj (mgr.34412) 39 : cephadm [INF] Reconfiguring mon.a (monmap changed)... 2021-03-10T13:50:24.306 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:24 gibba015 bash[29377]: audit 2021-03-10T13:50:23.058394+0000 mon.c (mon.1) 8 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:50:24.306 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:24 gibba015 bash[29377]: audit 2021-03-10T13:50:23.059439+0000 mon.c (mon.1) 9 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:50:24.307 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:24 gibba015 bash[29377]: audit 2021-03-10T13:50:23.060805+0000 mon.c (mon.1) 10 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2021-03-10T13:50:24.307 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:24 gibba015 bash[29377]: cephadm 2021-03-10T13:50:23.061021+0000 mgr.gibba045.orlgmj (mgr.34412) 40 : cephadm [INF] Reconfiguring daemon mon.a on gibba015 2021-03-10T13:50:24.307 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:24 gibba015 bash[30343]: cluster 2021-03-10T13:50:22.948791+0000 mgr.gibba045.orlgmj (mgr.34412) 38 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:24.307 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:24 gibba015 bash[30343]: audit 2021-03-10T13:50:23.047249+0000 mon.a (mon.0) 88 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:50:24.308 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:24 gibba015 bash[30343]: audit 2021-03-10T13:50:23.052605+0000 mon.a (mon.0) 89 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:50:24.308 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:24 gibba015 bash[30343]: audit 2021-03-10T13:50:23.057010+0000 mon.c (mon.1) 7 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:50:24.308 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:24 gibba015 bash[30343]: cephadm 2021-03-10T13:50:23.057275+0000 mgr.gibba045.orlgmj (mgr.34412) 39 : cephadm [INF] Reconfiguring mon.a (monmap changed)... 2021-03-10T13:50:24.308 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:24 gibba015 bash[30343]: audit 2021-03-10T13:50:23.058394+0000 mon.c (mon.1) 8 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:50:24.308 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:24 gibba015 bash[30343]: audit 2021-03-10T13:50:23.059439+0000 mon.c (mon.1) 9 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:50:24.309 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:24 gibba015 bash[30343]: audit 2021-03-10T13:50:23.060805+0000 mon.c (mon.1) 10 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2021-03-10T13:50:24.309 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:24 gibba015 bash[30343]: cephadm 2021-03-10T13:50:23.061021+0000 mgr.gibba045.orlgmj (mgr.34412) 40 : cephadm [INF] Reconfiguring daemon mon.a on gibba015 2021-03-10T13:50:24.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:24 gibba045 bash[25517]: cluster 2021-03-10T13:50:22.948791+0000 mgr.gibba045.orlgmj (mgr.34412) 38 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:24.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:24 gibba045 bash[25517]: audit 2021-03-10T13:50:23.047249+0000 mon.a (mon.0) 88 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:50:24.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:24 gibba045 bash[25517]: audit 2021-03-10T13:50:23.052605+0000 mon.a (mon.0) 89 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:50:24.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:24 gibba045 bash[25517]: audit 2021-03-10T13:50:23.057010+0000 mon.c (mon.1) 7 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:50:24.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:24 gibba045 bash[25517]: cephadm 2021-03-10T13:50:23.057275+0000 mgr.gibba045.orlgmj (mgr.34412) 39 : cephadm [INF] Reconfiguring mon.a (monmap changed)... 2021-03-10T13:50:24.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:24 gibba045 bash[25517]: audit 2021-03-10T13:50:23.058394+0000 mon.c (mon.1) 8 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:50:24.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:24 gibba045 bash[25517]: audit 2021-03-10T13:50:23.059439+0000 mon.c (mon.1) 9 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:50:24.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:24 gibba045 bash[25517]: audit 2021-03-10T13:50:23.060805+0000 mon.c (mon.1) 10 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2021-03-10T13:50:24.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:24 gibba045 bash[25517]: cephadm 2021-03-10T13:50:23.061021+0000 mgr.gibba045.orlgmj (mgr.34412) 40 : cephadm [INF] Reconfiguring daemon mon.a on gibba015 2021-03-10T13:50:26.294 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:26 gibba015 bash[30343]: cluster 2021-03-10T13:50:24.950815+0000 mgr.gibba045.orlgmj (mgr.34412) 41 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:26.295 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:26 gibba015 bash[30343]: audit 2021-03-10T13:50:25.021344+0000 mon.a (mon.0) 90 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:50:26.295 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:26 gibba015 bash[30343]: cephadm 2021-03-10T13:50:25.024854+0000 mgr.gibba045.orlgmj (mgr.34412) 42 : cephadm [INF] Reconfiguring mgr.y (monmap changed)... 2021-03-10T13:50:26.295 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:26 gibba015 bash[30343]: audit 2021-03-10T13:50:25.024921+0000 mon.c (mon.1) 11 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:50:26.295 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:26 gibba015 bash[30343]: audit 2021-03-10T13:50:25.025317+0000 mon.a (mon.0) 91 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:50:26.296 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:26 gibba015 bash[30343]: audit 2021-03-10T13:50:25.027166+0000 mon.c (mon.1) 12 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "mgr services"}]: dispatch 2021-03-10T13:50:26.296 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:26 gibba015 bash[30343]: audit 2021-03-10T13:50:25.028490+0000 mon.c (mon.1) 13 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:50:26.296 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:26 gibba015 bash[30343]: audit 2021-03-10T13:50:25.030522+0000 mon.c (mon.1) 14 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mgr.y","key": "container_image"}]: dispatch 2021-03-10T13:50:26.296 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:26 gibba015 bash[30343]: cephadm 2021-03-10T13:50:25.030780+0000 mgr.gibba045.orlgmj (mgr.34412) 43 : cephadm [INF] Reconfiguring daemon mgr.y on gibba015 2021-03-10T13:50:26.297 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:26 gibba015 bash[29377]: cluster 2021-03-10T13:50:24.950815+0000 mgr.gibba045.orlgmj (mgr.34412) 41 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:26.297 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:26 gibba015 bash[29377]: audit 2021-03-10T13:50:25.021344+0000 mon.a (mon.0) 90 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:50:26.297 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:26 gibba015 bash[29377]: cephadm 2021-03-10T13:50:25.024854+0000 mgr.gibba045.orlgmj (mgr.34412) 42 : cephadm [INF] Reconfiguring mgr.y (monmap changed)... 2021-03-10T13:50:26.298 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:26 gibba015 bash[29377]: audit 2021-03-10T13:50:25.024921+0000 mon.c (mon.1) 11 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:50:26.298 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:26 gibba015 bash[29377]: audit 2021-03-10T13:50:25.025317+0000 mon.a (mon.0) 91 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:50:26.298 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:26 gibba015 bash[29377]: audit 2021-03-10T13:50:25.027166+0000 mon.c (mon.1) 12 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "mgr services"}]: dispatch 2021-03-10T13:50:26.298 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:26 gibba015 bash[29377]: audit 2021-03-10T13:50:25.028490+0000 mon.c (mon.1) 13 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:50:26.299 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:26 gibba015 bash[29377]: audit 2021-03-10T13:50:25.030522+0000 mon.c (mon.1) 14 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mgr.y","key": "container_image"}]: dispatch 2021-03-10T13:50:26.299 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:26 gibba015 bash[29377]: cephadm 2021-03-10T13:50:25.030780+0000 mgr.gibba045.orlgmj (mgr.34412) 43 : cephadm [INF] Reconfiguring daemon mgr.y on gibba015 2021-03-10T13:50:26.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:26 gibba045 bash[25517]: cluster 2021-03-10T13:50:24.950815+0000 mgr.gibba045.orlgmj (mgr.34412) 41 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:26.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:26 gibba045 bash[25517]: audit 2021-03-10T13:50:25.021344+0000 mon.a (mon.0) 90 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:50:26.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:26 gibba045 bash[25517]: cephadm 2021-03-10T13:50:25.024854+0000 mgr.gibba045.orlgmj (mgr.34412) 42 : cephadm [INF] Reconfiguring mgr.y (monmap changed)... 2021-03-10T13:50:26.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:26 gibba045 bash[25517]: audit 2021-03-10T13:50:25.024921+0000 mon.c (mon.1) 11 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:50:26.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:26 gibba045 bash[25517]: audit 2021-03-10T13:50:25.025317+0000 mon.a (mon.0) 91 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:50:26.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:26 gibba045 bash[25517]: audit 2021-03-10T13:50:25.027166+0000 mon.c (mon.1) 12 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "mgr services"}]: dispatch 2021-03-10T13:50:26.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:26 gibba045 bash[25517]: audit 2021-03-10T13:50:25.028490+0000 mon.c (mon.1) 13 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:50:26.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:26 gibba045 bash[25517]: audit 2021-03-10T13:50:25.030522+0000 mon.c (mon.1) 14 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mgr.y","key": "container_image"}]: dispatch 2021-03-10T13:50:26.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:26 gibba045 bash[25517]: cephadm 2021-03-10T13:50:25.030780+0000 mgr.gibba045.orlgmj (mgr.34412) 43 : cephadm [INF] Reconfiguring daemon mgr.y on gibba015 2021-03-10T13:50:28.111 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:27 gibba015 bash[30343]: audit 2021-03-10T13:50:26.816934+0000 mon.a (mon.0) 92 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:50:28.111 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:27 gibba015 bash[30343]: cephadm 2021-03-10T13:50:26.820098+0000 mgr.gibba045.orlgmj (mgr.34412) 44 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2021-03-10T13:50:28.111 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:27 gibba015 bash[30343]: audit 2021-03-10T13:50:26.820191+0000 mon.c (mon.1) 15 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:50:28.111 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:27 gibba015 bash[30343]: audit 2021-03-10T13:50:26.822594+0000 mon.c (mon.1) 16 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:50:28.112 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:27 gibba015 bash[30343]: audit 2021-03-10T13:50:26.823980+0000 mon.c (mon.1) 17 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:50:28.112 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:27 gibba015 bash[30343]: audit 2021-03-10T13:50:26.825966+0000 mon.c (mon.1) 18 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2021-03-10T13:50:28.112 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:27 gibba015 bash[30343]: cephadm 2021-03-10T13:50:26.826123+0000 mgr.gibba045.orlgmj (mgr.34412) 45 : cephadm [INF] Reconfiguring daemon mon.c on gibba015 2021-03-10T13:50:28.112 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:27 gibba015 bash[30343]: cluster 2021-03-10T13:50:26.951888+0000 mgr.gibba045.orlgmj (mgr.34412) 46 : cluster [DBG] pgmap v21: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:28.113 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:27 gibba015 bash[29377]: audit 2021-03-10T13:50:26.816934+0000 mon.a (mon.0) 92 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:50:28.113 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:27 gibba015 bash[29377]: cephadm 2021-03-10T13:50:26.820098+0000 mgr.gibba045.orlgmj (mgr.34412) 44 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2021-03-10T13:50:28.113 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:27 gibba015 bash[29377]: audit 2021-03-10T13:50:26.820191+0000 mon.c (mon.1) 15 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:50:28.113 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:27 gibba015 bash[29377]: audit 2021-03-10T13:50:26.822594+0000 mon.c (mon.1) 16 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:50:28.114 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:27 gibba015 bash[29377]: audit 2021-03-10T13:50:26.823980+0000 mon.c (mon.1) 17 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:50:28.114 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:27 gibba015 bash[29377]: audit 2021-03-10T13:50:26.825966+0000 mon.c (mon.1) 18 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2021-03-10T13:50:28.114 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:27 gibba015 bash[29377]: cephadm 2021-03-10T13:50:26.826123+0000 mgr.gibba045.orlgmj (mgr.34412) 45 : cephadm [INF] Reconfiguring daemon mon.c on gibba015 2021-03-10T13:50:28.114 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:27 gibba015 bash[29377]: cluster 2021-03-10T13:50:26.951888+0000 mgr.gibba045.orlgmj (mgr.34412) 46 : cluster [DBG] pgmap v21: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:28.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:27 gibba045 bash[25517]: audit 2021-03-10T13:50:26.816934+0000 mon.a (mon.0) 92 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:50:28.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:27 gibba045 bash[25517]: cephadm 2021-03-10T13:50:26.820098+0000 mgr.gibba045.orlgmj (mgr.34412) 44 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2021-03-10T13:50:28.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:27 gibba045 bash[25517]: audit 2021-03-10T13:50:26.820191+0000 mon.c (mon.1) 15 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:50:28.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:27 gibba045 bash[25517]: audit 2021-03-10T13:50:26.822594+0000 mon.c (mon.1) 16 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:50:28.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:27 gibba045 bash[25517]: audit 2021-03-10T13:50:26.823980+0000 mon.c (mon.1) 17 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:50:28.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:27 gibba045 bash[25517]: audit 2021-03-10T13:50:26.825966+0000 mon.c (mon.1) 18 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2021-03-10T13:50:28.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:27 gibba045 bash[25517]: cephadm 2021-03-10T13:50:26.826123+0000 mgr.gibba045.orlgmj (mgr.34412) 45 : cephadm [INF] Reconfiguring daemon mon.c on gibba015 2021-03-10T13:50:28.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:27 gibba045 bash[25517]: cluster 2021-03-10T13:50:26.951888+0000 mgr.gibba045.orlgmj (mgr.34412) 46 : cluster [DBG] pgmap v21: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:29.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:29 gibba015 bash[29377]: audit 2021-03-10T13:50:28.649634+0000 mon.a (mon.0) 93 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:50:29.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:29 gibba015 bash[29377]: cephadm 2021-03-10T13:50:28.653126+0000 mgr.gibba045.orlgmj (mgr.34412) 47 : cephadm [INF] Reconfiguring osd.0 (monmap changed)... 2021-03-10T13:50:29.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:29 gibba015 bash[29377]: audit 2021-03-10T13:50:28.654338+0000 mon.c (mon.1) 19 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd.0","key": "container_image"}]: dispatch 2021-03-10T13:50:29.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:29 gibba015 bash[29377]: cephadm 2021-03-10T13:50:28.654600+0000 mgr.gibba045.orlgmj (mgr.34412) 48 : cephadm [INF] Reconfiguring daemon osd.0 on gibba015 2021-03-10T13:50:29.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:29 gibba015 bash[30343]: audit 2021-03-10T13:50:28.649634+0000 mon.a (mon.0) 93 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:50:29.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:29 gibba015 bash[30343]: cephadm 2021-03-10T13:50:28.653126+0000 mgr.gibba045.orlgmj (mgr.34412) 47 : cephadm [INF] Reconfiguring osd.0 (monmap changed)... 2021-03-10T13:50:29.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:29 gibba015 bash[30343]: audit 2021-03-10T13:50:28.654338+0000 mon.c (mon.1) 19 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd.0","key": "container_image"}]: dispatch 2021-03-10T13:50:29.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:29 gibba015 bash[30343]: cephadm 2021-03-10T13:50:28.654600+0000 mgr.gibba045.orlgmj (mgr.34412) 48 : cephadm [INF] Reconfiguring daemon osd.0 on gibba015 2021-03-10T13:50:30.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:29 gibba045 bash[25517]: audit 2021-03-10T13:50:28.649634+0000 mon.a (mon.0) 93 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:50:30.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:29 gibba045 bash[25517]: cephadm 2021-03-10T13:50:28.653126+0000 mgr.gibba045.orlgmj (mgr.34412) 47 : cephadm [INF] Reconfiguring osd.0 (monmap changed)... 2021-03-10T13:50:30.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:29 gibba045 bash[25517]: audit 2021-03-10T13:50:28.654338+0000 mon.c (mon.1) 19 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd.0","key": "container_image"}]: dispatch 2021-03-10T13:50:30.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:29 gibba045 bash[25517]: cephadm 2021-03-10T13:50:28.654600+0000 mgr.gibba045.orlgmj (mgr.34412) 48 : cephadm [INF] Reconfiguring daemon osd.0 on gibba015 2021-03-10T13:50:30.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:30 gibba015 bash[29377]: cluster 2021-03-10T13:50:28.953807+0000 mgr.gibba045.orlgmj (mgr.34412) 49 : cluster [DBG] pgmap v22: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:30.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:30 gibba015 bash[29377]: audit 2021-03-10T13:50:30.497977+0000 mon.a (mon.0) 94 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:50:30.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:30 gibba015 bash[29377]: audit 2021-03-10T13:50:30.503681+0000 mon.c (mon.1) 20 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd.1","key": "container_image"}]: dispatch 2021-03-10T13:50:30.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:30 gibba015 bash[30343]: cluster 2021-03-10T13:50:28.953807+0000 mgr.gibba045.orlgmj (mgr.34412) 49 : cluster [DBG] pgmap v22: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:30.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:30 gibba015 bash[30343]: audit 2021-03-10T13:50:30.497977+0000 mon.a (mon.0) 94 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:50:30.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:30 gibba015 bash[30343]: audit 2021-03-10T13:50:30.503681+0000 mon.c (mon.1) 20 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd.1","key": "container_image"}]: dispatch 2021-03-10T13:50:31.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:30 gibba045 bash[25517]: cluster 2021-03-10T13:50:28.953807+0000 mgr.gibba045.orlgmj (mgr.34412) 49 : cluster [DBG] pgmap v22: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:31.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:30 gibba045 bash[25517]: audit 2021-03-10T13:50:30.497977+0000 mon.a (mon.0) 94 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:50:31.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:30 gibba045 bash[25517]: audit 2021-03-10T13:50:30.503681+0000 mon.c (mon.1) 20 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd.1","key": "container_image"}]: dispatch 2021-03-10T13:50:31.877 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:31 gibba015 bash[29377]: cephadm 2021-03-10T13:50:30.501203+0000 mgr.gibba045.orlgmj (mgr.34412) 50 : cephadm [INF] Reconfiguring osd.1 (monmap changed)... 2021-03-10T13:50:31.878 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:31 gibba015 bash[29377]: cephadm 2021-03-10T13:50:30.503395+0000 mgr.gibba045.orlgmj (mgr.34412) 51 : cephadm [INF] Reconfiguring daemon osd.1 on gibba015 2021-03-10T13:50:31.878 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:31 gibba015 bash[30343]: cephadm 2021-03-10T13:50:30.501203+0000 mgr.gibba045.orlgmj (mgr.34412) 50 : cephadm [INF] Reconfiguring osd.1 (monmap changed)... 2021-03-10T13:50:31.878 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:31 gibba015 bash[30343]: cephadm 2021-03-10T13:50:30.503395+0000 mgr.gibba045.orlgmj (mgr.34412) 51 : cephadm [INF] Reconfiguring daemon osd.1 on gibba015 2021-03-10T13:50:32.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:31 gibba045 bash[25517]: cephadm 2021-03-10T13:50:30.501203+0000 mgr.gibba045.orlgmj (mgr.34412) 50 : cephadm [INF] Reconfiguring osd.1 (monmap changed)... 2021-03-10T13:50:32.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:31 gibba045 bash[25517]: cephadm 2021-03-10T13:50:30.503395+0000 mgr.gibba045.orlgmj (mgr.34412) 51 : cephadm [INF] Reconfiguring daemon osd.1 on gibba015 2021-03-10T13:50:32.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:32 gibba015 bash[29377]: cluster 2021-03-10T13:50:30.955005+0000 mgr.gibba045.orlgmj (mgr.34412) 52 : cluster [DBG] pgmap v23: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:32.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:32 gibba015 bash[29377]: audit 2021-03-10T13:50:32.300853+0000 mon.a (mon.0) 95 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:50:32.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:32 gibba015 bash[29377]: audit 2021-03-10T13:50:32.306468+0000 mon.c (mon.1) 21 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd.2","key": "container_image"}]: dispatch 2021-03-10T13:50:32.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:32 gibba015 bash[30343]: cluster 2021-03-10T13:50:30.955005+0000 mgr.gibba045.orlgmj (mgr.34412) 52 : cluster [DBG] pgmap v23: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:32.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:32 gibba015 bash[30343]: audit 2021-03-10T13:50:32.300853+0000 mon.a (mon.0) 95 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:50:32.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:32 gibba015 bash[30343]: audit 2021-03-10T13:50:32.306468+0000 mon.c (mon.1) 21 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd.2","key": "container_image"}]: dispatch 2021-03-10T13:50:33.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:32 gibba045 bash[25517]: cluster 2021-03-10T13:50:30.955005+0000 mgr.gibba045.orlgmj (mgr.34412) 52 : cluster [DBG] pgmap v23: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:33.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:32 gibba045 bash[25517]: audit 2021-03-10T13:50:32.300853+0000 mon.a (mon.0) 95 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:50:33.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:32 gibba045 bash[25517]: audit 2021-03-10T13:50:32.306468+0000 mon.c (mon.1) 21 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd.2","key": "container_image"}]: dispatch 2021-03-10T13:50:33.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:33 gibba015 bash[29377]: cephadm 2021-03-10T13:50:32.304014+0000 mgr.gibba045.orlgmj (mgr.34412) 53 : cephadm [INF] Reconfiguring osd.2 (monmap changed)... 2021-03-10T13:50:33.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:33 gibba015 bash[29377]: cephadm 2021-03-10T13:50:32.306300+0000 mgr.gibba045.orlgmj (mgr.34412) 54 : cephadm [INF] Reconfiguring daemon osd.2 on gibba015 2021-03-10T13:50:33.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:33 gibba015 bash[30343]: cephadm 2021-03-10T13:50:32.304014+0000 mgr.gibba045.orlgmj (mgr.34412) 53 : cephadm [INF] Reconfiguring osd.2 (monmap changed)... 2021-03-10T13:50:33.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:33 gibba015 bash[30343]: cephadm 2021-03-10T13:50:32.306300+0000 mgr.gibba045.orlgmj (mgr.34412) 54 : cephadm [INF] Reconfiguring daemon osd.2 on gibba015 2021-03-10T13:50:34.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:33 gibba045 bash[25517]: cephadm 2021-03-10T13:50:32.304014+0000 mgr.gibba045.orlgmj (mgr.34412) 53 : cephadm [INF] Reconfiguring osd.2 (monmap changed)... 2021-03-10T13:50:34.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:33 gibba045 bash[25517]: cephadm 2021-03-10T13:50:32.306300+0000 mgr.gibba045.orlgmj (mgr.34412) 54 : cephadm [INF] Reconfiguring daemon osd.2 on gibba015 2021-03-10T13:50:34.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:34 gibba015 bash[29377]: cluster 2021-03-10T13:50:32.956156+0000 mgr.gibba045.orlgmj (mgr.34412) 55 : cluster [DBG] pgmap v24: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:34.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:34 gibba015 bash[29377]: audit 2021-03-10T13:50:34.121934+0000 mon.a (mon.0) 96 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:50:34.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:34 gibba015 bash[29377]: audit 2021-03-10T13:50:34.123726+0000 mon.c (mon.1) 22 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd.3","key": "container_image"}]: dispatch 2021-03-10T13:50:34.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:34 gibba015 bash[30343]: cluster 2021-03-10T13:50:32.956156+0000 mgr.gibba045.orlgmj (mgr.34412) 55 : cluster [DBG] pgmap v24: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:34.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:34 gibba015 bash[30343]: audit 2021-03-10T13:50:34.121934+0000 mon.a (mon.0) 96 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:50:34.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:34 gibba015 bash[30343]: audit 2021-03-10T13:50:34.123726+0000 mon.c (mon.1) 22 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd.3","key": "container_image"}]: dispatch 2021-03-10T13:50:35.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:34 gibba045 bash[25517]: cluster 2021-03-10T13:50:32.956156+0000 mgr.gibba045.orlgmj (mgr.34412) 55 : cluster [DBG] pgmap v24: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:35.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:34 gibba045 bash[25517]: audit 2021-03-10T13:50:34.121934+0000 mon.a (mon.0) 96 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:50:35.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:34 gibba045 bash[25517]: audit 2021-03-10T13:50:34.123726+0000 mon.c (mon.1) 22 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd.3","key": "container_image"}]: dispatch 2021-03-10T13:50:35.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:35 gibba015 bash[29377]: cephadm 2021-03-10T13:50:34.123643+0000 mgr.gibba045.orlgmj (mgr.34412) 56 : cephadm [INF] Reconfiguring osd.3 (monmap changed)... 2021-03-10T13:50:35.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:35 gibba015 bash[29377]: cephadm 2021-03-10T13:50:34.124093+0000 mgr.gibba045.orlgmj (mgr.34412) 57 : cephadm [INF] Reconfiguring daemon osd.3 on gibba015 2021-03-10T13:50:35.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:35 gibba015 bash[30343]: cephadm 2021-03-10T13:50:34.123643+0000 mgr.gibba045.orlgmj (mgr.34412) 56 : cephadm [INF] Reconfiguring osd.3 (monmap changed)... 2021-03-10T13:50:35.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:35 gibba015 bash[30343]: cephadm 2021-03-10T13:50:34.124093+0000 mgr.gibba045.orlgmj (mgr.34412) 57 : cephadm [INF] Reconfiguring daemon osd.3 on gibba015 2021-03-10T13:50:36.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:35 gibba045 bash[25517]: cephadm 2021-03-10T13:50:34.123643+0000 mgr.gibba045.orlgmj (mgr.34412) 56 : cephadm [INF] Reconfiguring osd.3 (monmap changed)... 2021-03-10T13:50:36.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:35 gibba045 bash[25517]: cephadm 2021-03-10T13:50:34.124093+0000 mgr.gibba045.orlgmj (mgr.34412) 57 : cephadm [INF] Reconfiguring daemon osd.3 on gibba015 2021-03-10T13:50:36.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:36 gibba015 bash[29377]: cluster 2021-03-10T13:50:34.958202+0000 mgr.gibba045.orlgmj (mgr.34412) 58 : cluster [DBG] pgmap v25: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:36.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:36 gibba015 bash[29377]: audit 2021-03-10T13:50:36.074642+0000 mon.a (mon.0) 97 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:50:36.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:36 gibba015 bash[29377]: audit 2021-03-10T13:50:36.079088+0000 mon.c (mon.1) 23 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:50:36.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:36 gibba015 bash[29377]: audit 2021-03-10T13:50:36.080780+0000 mon.c (mon.1) 24 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:50:36.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:36 gibba015 bash[29377]: audit 2021-03-10T13:50:36.082098+0000 mon.c (mon.1) 25 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:50:36.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:36 gibba015 bash[29377]: audit 2021-03-10T13:50:36.083393+0000 mon.c (mon.1) 26 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2021-03-10T13:50:36.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:36 gibba015 bash[30343]: cluster 2021-03-10T13:50:34.958202+0000 mgr.gibba045.orlgmj (mgr.34412) 58 : cluster [DBG] pgmap v25: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:36.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:36 gibba015 bash[30343]: audit 2021-03-10T13:50:36.074642+0000 mon.a (mon.0) 97 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:50:36.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:36 gibba015 bash[30343]: audit 2021-03-10T13:50:36.079088+0000 mon.c (mon.1) 23 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:50:36.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:36 gibba015 bash[30343]: audit 2021-03-10T13:50:36.080780+0000 mon.c (mon.1) 24 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:50:36.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:36 gibba015 bash[30343]: audit 2021-03-10T13:50:36.082098+0000 mon.c (mon.1) 25 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:50:36.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:36 gibba015 bash[30343]: audit 2021-03-10T13:50:36.083393+0000 mon.c (mon.1) 26 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2021-03-10T13:50:37.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:36 gibba045 bash[25517]: cluster 2021-03-10T13:50:34.958202+0000 mgr.gibba045.orlgmj (mgr.34412) 58 : cluster [DBG] pgmap v25: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:37.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:36 gibba045 bash[25517]: audit 2021-03-10T13:50:36.074642+0000 mon.a (mon.0) 97 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:50:37.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:36 gibba045 bash[25517]: audit 2021-03-10T13:50:36.079088+0000 mon.c (mon.1) 23 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:50:37.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:36 gibba045 bash[25517]: audit 2021-03-10T13:50:36.080780+0000 mon.c (mon.1) 24 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:50:37.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:36 gibba045 bash[25517]: audit 2021-03-10T13:50:36.082098+0000 mon.c (mon.1) 25 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:50:37.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:36 gibba045 bash[25517]: audit 2021-03-10T13:50:36.083393+0000 mon.c (mon.1) 26 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2021-03-10T13:50:37.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:37 gibba015 bash[29377]: cephadm 2021-03-10T13:50:36.079215+0000 mgr.gibba045.orlgmj (mgr.34412) 59 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2021-03-10T13:50:37.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:37 gibba015 bash[29377]: cephadm 2021-03-10T13:50:36.083664+0000 mgr.gibba045.orlgmj (mgr.34412) 60 : cephadm [INF] Reconfiguring daemon mon.b on gibba045 2021-03-10T13:50:37.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:37 gibba015 bash[30343]: cephadm 2021-03-10T13:50:36.079215+0000 mgr.gibba045.orlgmj (mgr.34412) 59 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2021-03-10T13:50:37.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:37 gibba015 bash[30343]: cephadm 2021-03-10T13:50:36.083664+0000 mgr.gibba045.orlgmj (mgr.34412) 60 : cephadm [INF] Reconfiguring daemon mon.b on gibba045 2021-03-10T13:50:37.990 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:37 gibba045 bash[25517]: cephadm 2021-03-10T13:50:36.079215+0000 mgr.gibba045.orlgmj (mgr.34412) 59 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2021-03-10T13:50:37.991 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:37 gibba045 bash[25517]: cephadm 2021-03-10T13:50:36.083664+0000 mgr.gibba045.orlgmj (mgr.34412) 60 : cephadm [INF] Reconfiguring daemon mon.b on gibba045 2021-03-10T13:50:39.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:38 gibba045 bash[25517]: cluster 2021-03-10T13:50:36.959124+0000 mgr.gibba045.orlgmj (mgr.34412) 61 : cluster [DBG] pgmap v26: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:39.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:38 gibba045 bash[25517]: audit 2021-03-10T13:50:37.812589+0000 mon.a (mon.0) 98 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:50:39.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:38 gibba045 bash[25517]: audit 2021-03-10T13:50:37.814315+0000 mon.c (mon.1) 27 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:50:39.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:38 gibba045 bash[25517]: audit 2021-03-10T13:50:37.814625+0000 mon.a (mon.0) 99 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:50:39.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:38 gibba045 bash[25517]: audit 2021-03-10T13:50:37.816017+0000 mon.c (mon.1) 28 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "mgr services"}]: dispatch 2021-03-10T13:50:39.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:38 gibba045 bash[25517]: audit 2021-03-10T13:50:37.817238+0000 mon.c (mon.1) 29 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:50:39.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:38 gibba045 bash[25517]: audit 2021-03-10T13:50:37.818913+0000 mon.c (mon.1) 30 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mgr.x","key": "container_image"}]: dispatch 2021-03-10T13:50:39.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:38 gibba015 bash[29377]: cluster 2021-03-10T13:50:36.959124+0000 mgr.gibba045.orlgmj (mgr.34412) 61 : cluster [DBG] pgmap v26: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:39.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:38 gibba015 bash[29377]: audit 2021-03-10T13:50:37.812589+0000 mon.a (mon.0) 98 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:50:39.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:38 gibba015 bash[29377]: audit 2021-03-10T13:50:37.814315+0000 mon.c (mon.1) 27 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:50:39.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:38 gibba015 bash[29377]: audit 2021-03-10T13:50:37.814625+0000 mon.a (mon.0) 99 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:50:39.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:38 gibba015 bash[29377]: audit 2021-03-10T13:50:37.816017+0000 mon.c (mon.1) 28 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "mgr services"}]: dispatch 2021-03-10T13:50:39.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:38 gibba015 bash[29377]: audit 2021-03-10T13:50:37.817238+0000 mon.c (mon.1) 29 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:50:39.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:38 gibba015 bash[29377]: audit 2021-03-10T13:50:37.818913+0000 mon.c (mon.1) 30 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mgr.x","key": "container_image"}]: dispatch 2021-03-10T13:50:39.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:38 gibba015 bash[30343]: cluster 2021-03-10T13:50:36.959124+0000 mgr.gibba045.orlgmj (mgr.34412) 61 : cluster [DBG] pgmap v26: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:39.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:38 gibba015 bash[30343]: audit 2021-03-10T13:50:37.812589+0000 mon.a (mon.0) 98 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:50:39.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:38 gibba015 bash[30343]: audit 2021-03-10T13:50:37.814315+0000 mon.c (mon.1) 27 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:50:39.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:38 gibba015 bash[30343]: audit 2021-03-10T13:50:37.814625+0000 mon.a (mon.0) 99 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:50:39.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:38 gibba015 bash[30343]: audit 2021-03-10T13:50:37.816017+0000 mon.c (mon.1) 28 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "mgr services"}]: dispatch 2021-03-10T13:50:39.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:38 gibba015 bash[30343]: audit 2021-03-10T13:50:37.817238+0000 mon.c (mon.1) 29 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:50:39.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:38 gibba015 bash[30343]: audit 2021-03-10T13:50:37.818913+0000 mon.c (mon.1) 30 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mgr.x","key": "container_image"}]: dispatch 2021-03-10T13:50:39.802 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T13:50:40.031 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T13:50:40.032 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (82s) 31s ago 6m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T13:50:40.032 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (6m) 16s ago 6m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T13:50:40.032 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (109s) 16s ago 10m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T13:50:40.032 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2m) 16s ago 10m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T13:50:40.033 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (63s) 31s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T13:50:40.033 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (54s) 31s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T13:50:40.033 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (27s) 16s ago 10m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T13:50:40.033 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (37s) 31s ago 10m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T13:50:40.033 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (6m) 31s ago 6m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T13:50:40.034 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (6m) 16s ago 6m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T13:50:40.034 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (9m) 31s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 1e67f692bb03 2021-03-10T13:50:40.034 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (9m) 31s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 83369fd7640c 2021-03-10T13:50:40.034 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (9m) 31s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b90f9ada390a 2021-03-10T13:50:40.034 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (8m) 31s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 a77eccf371e5 2021-03-10T13:50:40.035 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (8m) 16s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 9b9c84c84955 2021-03-10T13:50:40.035 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (7m) 16s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 662e73261675 2021-03-10T13:50:40.035 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (7m) 16s ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 338d252f22e3 2021-03-10T13:50:40.035 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (7m) 16s ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 784edc0668a4 2021-03-10T13:50:40.035 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (6m) 16s ago 6m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T13:50:40.036 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 16s ago 4m docker.io/ceph/ceph:v15.2.0 2021-03-10T13:50:40.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:39 gibba045 bash[25517]: cephadm 2021-03-10T13:50:37.814684+0000 mgr.gibba045.orlgmj (mgr.34412) 62 : cephadm [INF] Reconfiguring mgr.x (monmap changed)... 2021-03-10T13:50:40.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:39 gibba045 bash[25517]: cephadm 2021-03-10T13:50:37.819165+0000 mgr.gibba045.orlgmj (mgr.34412) 63 : cephadm [INF] Reconfiguring daemon mgr.x on gibba045 2021-03-10T13:50:40.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:39 gibba045 bash[25517]: audit 2021-03-10T13:50:39.525739+0000 mon.a (mon.0) 100 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:50:40.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:39 gibba045 bash[25517]: audit 2021-03-10T13:50:39.527754+0000 mon.c (mon.1) 31 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.gibba045.orlgmj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:50:40.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:39 gibba045 bash[25517]: audit 2021-03-10T13:50:39.528087+0000 mon.a (mon.0) 101 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.gibba045.orlgmj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:50:40.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:39 gibba045 bash[25517]: audit 2021-03-10T13:50:39.530118+0000 mon.c (mon.1) 32 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "mgr services"}]: dispatch 2021-03-10T13:50:40.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:39 gibba045 bash[25517]: audit 2021-03-10T13:50:39.531395+0000 mon.c (mon.1) 33 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:50:40.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:39 gibba045 bash[25517]: audit 2021-03-10T13:50:39.532956+0000 mon.c (mon.1) 34 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mgr.gibba045.orlgmj","key": "container_image"}]: dispatch 2021-03-10T13:50:40.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:39 gibba015 bash[29377]: cephadm 2021-03-10T13:50:37.814684+0000 mgr.gibba045.orlgmj (mgr.34412) 62 : cephadm [INF] Reconfiguring mgr.x (monmap changed)... 2021-03-10T13:50:40.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:39 gibba015 bash[29377]: cephadm 2021-03-10T13:50:37.819165+0000 mgr.gibba045.orlgmj (mgr.34412) 63 : cephadm [INF] Reconfiguring daemon mgr.x on gibba045 2021-03-10T13:50:40.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:39 gibba015 bash[29377]: audit 2021-03-10T13:50:39.525739+0000 mon.a (mon.0) 100 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:50:40.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:39 gibba015 bash[29377]: audit 2021-03-10T13:50:39.527754+0000 mon.c (mon.1) 31 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.gibba045.orlgmj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:50:40.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:39 gibba015 bash[29377]: audit 2021-03-10T13:50:39.528087+0000 mon.a (mon.0) 101 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.gibba045.orlgmj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:50:40.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:39 gibba015 bash[29377]: audit 2021-03-10T13:50:39.530118+0000 mon.c (mon.1) 32 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "mgr services"}]: dispatch 2021-03-10T13:50:40.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:39 gibba015 bash[29377]: audit 2021-03-10T13:50:39.531395+0000 mon.c (mon.1) 33 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:50:40.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:39 gibba015 bash[29377]: audit 2021-03-10T13:50:39.532956+0000 mon.c (mon.1) 34 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mgr.gibba045.orlgmj","key": "container_image"}]: dispatch 2021-03-10T13:50:40.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:39 gibba015 bash[30343]: cephadm 2021-03-10T13:50:37.814684+0000 mgr.gibba045.orlgmj (mgr.34412) 62 : cephadm [INF] Reconfiguring mgr.x (monmap changed)... 2021-03-10T13:50:40.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:39 gibba015 bash[30343]: cephadm 2021-03-10T13:50:37.819165+0000 mgr.gibba045.orlgmj (mgr.34412) 63 : cephadm [INF] Reconfiguring daemon mgr.x on gibba045 2021-03-10T13:50:40.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:39 gibba015 bash[30343]: audit 2021-03-10T13:50:39.525739+0000 mon.a (mon.0) 100 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:50:40.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:39 gibba015 bash[30343]: audit 2021-03-10T13:50:39.527754+0000 mon.c (mon.1) 31 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.gibba045.orlgmj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:50:40.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:39 gibba015 bash[30343]: audit 2021-03-10T13:50:39.528087+0000 mon.a (mon.0) 101 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.gibba045.orlgmj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:50:40.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:39 gibba015 bash[30343]: audit 2021-03-10T13:50:39.530118+0000 mon.c (mon.1) 32 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "mgr services"}]: dispatch 2021-03-10T13:50:40.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:39 gibba015 bash[30343]: audit 2021-03-10T13:50:39.531395+0000 mon.c (mon.1) 33 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:50:40.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:39 gibba015 bash[30343]: audit 2021-03-10T13:50:39.532956+0000 mon.c (mon.1) 34 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mgr.gibba045.orlgmj","key": "container_image"}]: dispatch 2021-03-10T13:50:40.284 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T13:50:40.285 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T13:50:40.285 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:50:40.285 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T13:50:40.285 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T13:50:40.285 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:50:40.286 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T13:50:40.286 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T13:50:40.286 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2021-03-10T13:50:40.286 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T13:50:40.287 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T13:50:40.287 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T13:50:40.287 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8, 2021-03-10T13:50:40.287 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 6 2021-03-10T13:50:40.287 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T13:50:40.288 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T13:50:41.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:40 gibba045 bash[25517]: cluster 2021-03-10T13:50:38.961037+0000 mgr.gibba045.orlgmj (mgr.34412) 64 : cluster [DBG] pgmap v27: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:41.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:40 gibba045 bash[25517]: cephadm 2021-03-10T13:50:39.528081+0000 mgr.gibba045.orlgmj (mgr.34412) 65 : cephadm [INF] Reconfiguring mgr.gibba045.orlgmj (monmap changed)... 2021-03-10T13:50:41.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:40 gibba045 bash[25517]: cephadm 2021-03-10T13:50:39.533238+0000 mgr.gibba045.orlgmj (mgr.34412) 66 : cephadm [INF] Reconfiguring daemon mgr.gibba045.orlgmj on gibba045 2021-03-10T13:50:41.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:40 gibba045 bash[25517]: audit 2021-03-10T13:50:40.283146+0000 mon.a (mon.0) 102 : audit [DBG] from='client.? 172.21.2.115:0/2266111837' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:50:41.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:40 gibba015 bash[29377]: cluster 2021-03-10T13:50:38.961037+0000 mgr.gibba045.orlgmj (mgr.34412) 64 : cluster [DBG] pgmap v27: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:41.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:40 gibba015 bash[29377]: cephadm 2021-03-10T13:50:39.528081+0000 mgr.gibba045.orlgmj (mgr.34412) 65 : cephadm [INF] Reconfiguring mgr.gibba045.orlgmj (monmap changed)... 2021-03-10T13:50:41.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:40 gibba015 bash[29377]: cephadm 2021-03-10T13:50:39.533238+0000 mgr.gibba045.orlgmj (mgr.34412) 66 : cephadm [INF] Reconfiguring daemon mgr.gibba045.orlgmj on gibba045 2021-03-10T13:50:41.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:40 gibba015 bash[29377]: audit 2021-03-10T13:50:40.283146+0000 mon.a (mon.0) 102 : audit [DBG] from='client.? 172.21.2.115:0/2266111837' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:50:41.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:40 gibba015 bash[30343]: cluster 2021-03-10T13:50:38.961037+0000 mgr.gibba045.orlgmj (mgr.34412) 64 : cluster [DBG] pgmap v27: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:41.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:40 gibba015 bash[30343]: cephadm 2021-03-10T13:50:39.528081+0000 mgr.gibba045.orlgmj (mgr.34412) 65 : cephadm [INF] Reconfiguring mgr.gibba045.orlgmj (monmap changed)... 2021-03-10T13:50:41.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:40 gibba015 bash[30343]: cephadm 2021-03-10T13:50:39.533238+0000 mgr.gibba045.orlgmj (mgr.34412) 66 : cephadm [INF] Reconfiguring daemon mgr.gibba045.orlgmj on gibba045 2021-03-10T13:50:41.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:40 gibba015 bash[30343]: audit 2021-03-10T13:50:40.283146+0000 mon.a (mon.0) 102 : audit [DBG] from='client.? 172.21.2.115:0/2266111837' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:50:42.044 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:41 gibba045 bash[25517]: audit 2021-03-10T13:50:39.791635+0000 mgr.gibba045.orlgmj (mgr.34412) 67 : audit [DBG] from='client.54121 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:50:42.045 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:41 gibba045 bash[25517]: audit 2021-03-10T13:50:40.019914+0000 mgr.gibba045.orlgmj (mgr.34412) 68 : audit [DBG] from='client.54127 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:50:42.045 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:41 gibba045 bash[25517]: audit 2021-03-10T13:50:41.133099+0000 mon.a (mon.0) 103 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:50:42.045 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:41 gibba045 bash[25517]: audit 2021-03-10T13:50:41.135445+0000 mon.c (mon.1) 35 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd.4","key": "container_image"}]: dispatch 2021-03-10T13:50:42.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:41 gibba015 bash[29377]: audit 2021-03-10T13:50:39.791635+0000 mgr.gibba045.orlgmj (mgr.34412) 67 : audit [DBG] from='client.54121 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:50:42.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:41 gibba015 bash[29377]: audit 2021-03-10T13:50:40.019914+0000 mgr.gibba045.orlgmj (mgr.34412) 68 : audit [DBG] from='client.54127 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:50:42.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:41 gibba015 bash[29377]: audit 2021-03-10T13:50:41.133099+0000 mon.a (mon.0) 103 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:50:42.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:41 gibba015 bash[29377]: audit 2021-03-10T13:50:41.135445+0000 mon.c (mon.1) 35 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd.4","key": "container_image"}]: dispatch 2021-03-10T13:50:42.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:41 gibba015 bash[30343]: audit 2021-03-10T13:50:39.791635+0000 mgr.gibba045.orlgmj (mgr.34412) 67 : audit [DBG] from='client.54121 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:50:42.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:41 gibba015 bash[30343]: audit 2021-03-10T13:50:40.019914+0000 mgr.gibba045.orlgmj (mgr.34412) 68 : audit [DBG] from='client.54127 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:50:42.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:41 gibba015 bash[30343]: audit 2021-03-10T13:50:41.133099+0000 mon.a (mon.0) 103 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:50:42.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:41 gibba015 bash[30343]: audit 2021-03-10T13:50:41.135445+0000 mon.c (mon.1) 35 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd.4","key": "container_image"}]: dispatch 2021-03-10T13:50:43.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:42 gibba045 bash[25517]: cluster 2021-03-10T13:50:40.962030+0000 mgr.gibba045.orlgmj (mgr.34412) 69 : cluster [DBG] pgmap v28: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:43.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:42 gibba045 bash[25517]: cephadm 2021-03-10T13:50:41.135320+0000 mgr.gibba045.orlgmj (mgr.34412) 70 : cephadm [INF] Reconfiguring osd.4 (monmap changed)... 2021-03-10T13:50:43.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:42 gibba045 bash[25517]: cephadm 2021-03-10T13:50:41.135829+0000 mgr.gibba045.orlgmj (mgr.34412) 71 : cephadm [INF] Reconfiguring daemon osd.4 on gibba045 2021-03-10T13:50:43.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:42 gibba045 bash[25517]: audit 2021-03-10T13:50:42.734181+0000 mon.a (mon.0) 104 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:50:43.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:42 gibba045 bash[25517]: audit 2021-03-10T13:50:42.736545+0000 mon.c (mon.1) 36 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd.5","key": "container_image"}]: dispatch 2021-03-10T13:50:43.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:42 gibba015 bash[29377]: cluster 2021-03-10T13:50:40.962030+0000 mgr.gibba045.orlgmj (mgr.34412) 69 : cluster [DBG] pgmap v28: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:43.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:42 gibba015 bash[29377]: cephadm 2021-03-10T13:50:41.135320+0000 mgr.gibba045.orlgmj (mgr.34412) 70 : cephadm [INF] Reconfiguring osd.4 (monmap changed)... 2021-03-10T13:50:43.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:42 gibba015 bash[29377]: cephadm 2021-03-10T13:50:41.135829+0000 mgr.gibba045.orlgmj (mgr.34412) 71 : cephadm [INF] Reconfiguring daemon osd.4 on gibba045 2021-03-10T13:50:43.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:42 gibba015 bash[29377]: audit 2021-03-10T13:50:42.734181+0000 mon.a (mon.0) 104 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:50:43.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:42 gibba015 bash[29377]: audit 2021-03-10T13:50:42.736545+0000 mon.c (mon.1) 36 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd.5","key": "container_image"}]: dispatch 2021-03-10T13:50:43.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:42 gibba015 bash[30343]: cluster 2021-03-10T13:50:40.962030+0000 mgr.gibba045.orlgmj (mgr.34412) 69 : cluster [DBG] pgmap v28: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:43.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:42 gibba015 bash[30343]: cephadm 2021-03-10T13:50:41.135320+0000 mgr.gibba045.orlgmj (mgr.34412) 70 : cephadm [INF] Reconfiguring osd.4 (monmap changed)... 2021-03-10T13:50:43.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:42 gibba015 bash[30343]: cephadm 2021-03-10T13:50:41.135829+0000 mgr.gibba045.orlgmj (mgr.34412) 71 : cephadm [INF] Reconfiguring daemon osd.4 on gibba045 2021-03-10T13:50:43.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:42 gibba015 bash[30343]: audit 2021-03-10T13:50:42.734181+0000 mon.a (mon.0) 104 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:50:43.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:42 gibba015 bash[30343]: audit 2021-03-10T13:50:42.736545+0000 mon.c (mon.1) 36 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd.5","key": "container_image"}]: dispatch 2021-03-10T13:50:44.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:43 gibba045 bash[25517]: cephadm 2021-03-10T13:50:42.736404+0000 mgr.gibba045.orlgmj (mgr.34412) 72 : cephadm [INF] Reconfiguring osd.5 (monmap changed)... 2021-03-10T13:50:44.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:43 gibba045 bash[25517]: cephadm 2021-03-10T13:50:42.736932+0000 mgr.gibba045.orlgmj (mgr.34412) 73 : cephadm [INF] Reconfiguring daemon osd.5 on gibba045 2021-03-10T13:50:44.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:43 gibba015 bash[29377]: cephadm 2021-03-10T13:50:42.736404+0000 mgr.gibba045.orlgmj (mgr.34412) 72 : cephadm [INF] Reconfiguring osd.5 (monmap changed)... 2021-03-10T13:50:44.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:43 gibba015 bash[29377]: cephadm 2021-03-10T13:50:42.736932+0000 mgr.gibba045.orlgmj (mgr.34412) 73 : cephadm [INF] Reconfiguring daemon osd.5 on gibba045 2021-03-10T13:50:44.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:43 gibba015 bash[30343]: cephadm 2021-03-10T13:50:42.736404+0000 mgr.gibba045.orlgmj (mgr.34412) 72 : cephadm [INF] Reconfiguring osd.5 (monmap changed)... 2021-03-10T13:50:44.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:43 gibba015 bash[30343]: cephadm 2021-03-10T13:50:42.736932+0000 mgr.gibba045.orlgmj (mgr.34412) 73 : cephadm [INF] Reconfiguring daemon osd.5 on gibba045 2021-03-10T13:50:45.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:44 gibba045 bash[25517]: cluster 2021-03-10T13:50:42.962592+0000 mgr.gibba045.orlgmj (mgr.34412) 74 : cluster [DBG] pgmap v29: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:45.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:44 gibba045 bash[25517]: audit 2021-03-10T13:50:44.525242+0000 mon.a (mon.0) 105 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:50:45.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:44 gibba045 bash[25517]: audit 2021-03-10T13:50:44.528119+0000 mon.c (mon.1) 37 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd.6","key": "container_image"}]: dispatch 2021-03-10T13:50:45.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:44 gibba015 bash[29377]: cluster 2021-03-10T13:50:42.962592+0000 mgr.gibba045.orlgmj (mgr.34412) 74 : cluster [DBG] pgmap v29: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:45.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:44 gibba015 bash[29377]: audit 2021-03-10T13:50:44.525242+0000 mon.a (mon.0) 105 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:50:45.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:44 gibba015 bash[29377]: audit 2021-03-10T13:50:44.528119+0000 mon.c (mon.1) 37 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd.6","key": "container_image"}]: dispatch 2021-03-10T13:50:45.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:44 gibba015 bash[30343]: cluster 2021-03-10T13:50:42.962592+0000 mgr.gibba045.orlgmj (mgr.34412) 74 : cluster [DBG] pgmap v29: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:45.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:44 gibba015 bash[30343]: audit 2021-03-10T13:50:44.525242+0000 mon.a (mon.0) 105 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:50:45.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:44 gibba015 bash[30343]: audit 2021-03-10T13:50:44.528119+0000 mon.c (mon.1) 37 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd.6","key": "container_image"}]: dispatch 2021-03-10T13:50:46.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:45 gibba045 bash[25517]: cephadm 2021-03-10T13:50:44.527490+0000 mgr.gibba045.orlgmj (mgr.34412) 75 : cephadm [INF] Reconfiguring osd.6 (monmap changed)... 2021-03-10T13:50:46.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:45 gibba045 bash[25517]: cephadm 2021-03-10T13:50:44.528113+0000 mgr.gibba045.orlgmj (mgr.34412) 76 : cephadm [INF] Reconfiguring daemon osd.6 on gibba045 2021-03-10T13:50:46.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:45 gibba015 bash[29377]: cephadm 2021-03-10T13:50:44.527490+0000 mgr.gibba045.orlgmj (mgr.34412) 75 : cephadm [INF] Reconfiguring osd.6 (monmap changed)... 2021-03-10T13:50:46.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:45 gibba015 bash[29377]: cephadm 2021-03-10T13:50:44.528113+0000 mgr.gibba045.orlgmj (mgr.34412) 76 : cephadm [INF] Reconfiguring daemon osd.6 on gibba045 2021-03-10T13:50:46.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:45 gibba015 bash[30343]: cephadm 2021-03-10T13:50:44.527490+0000 mgr.gibba045.orlgmj (mgr.34412) 75 : cephadm [INF] Reconfiguring osd.6 (monmap changed)... 2021-03-10T13:50:46.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:45 gibba015 bash[30343]: cephadm 2021-03-10T13:50:44.528113+0000 mgr.gibba045.orlgmj (mgr.34412) 76 : cephadm [INF] Reconfiguring daemon osd.6 on gibba045 2021-03-10T13:50:47.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:46 gibba045 bash[25517]: cluster 2021-03-10T13:50:44.964348+0000 mgr.gibba045.orlgmj (mgr.34412) 77 : cluster [DBG] pgmap v30: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:47.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:46 gibba045 bash[25517]: audit 2021-03-10T13:50:46.190098+0000 mon.a (mon.0) 106 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:50:47.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:46 gibba045 bash[25517]: audit 2021-03-10T13:50:46.192737+0000 mon.c (mon.1) 38 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd.7","key": "container_image"}]: dispatch 2021-03-10T13:50:47.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:46 gibba015 bash[29377]: cluster 2021-03-10T13:50:44.964348+0000 mgr.gibba045.orlgmj (mgr.34412) 77 : cluster [DBG] pgmap v30: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:47.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:46 gibba015 bash[29377]: audit 2021-03-10T13:50:46.190098+0000 mon.a (mon.0) 106 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:50:47.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:46 gibba015 bash[29377]: audit 2021-03-10T13:50:46.192737+0000 mon.c (mon.1) 38 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd.7","key": "container_image"}]: dispatch 2021-03-10T13:50:47.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:46 gibba015 bash[30343]: cluster 2021-03-10T13:50:44.964348+0000 mgr.gibba045.orlgmj (mgr.34412) 77 : cluster [DBG] pgmap v30: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:47.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:46 gibba015 bash[30343]: audit 2021-03-10T13:50:46.190098+0000 mon.a (mon.0) 106 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:50:47.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:46 gibba015 bash[30343]: audit 2021-03-10T13:50:46.192737+0000 mon.c (mon.1) 38 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd.7","key": "container_image"}]: dispatch 2021-03-10T13:50:48.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:47 gibba045 bash[25517]: cephadm 2021-03-10T13:50:46.192462+0000 mgr.gibba045.orlgmj (mgr.34412) 78 : cephadm [INF] Reconfiguring osd.7 (monmap changed)... 2021-03-10T13:50:48.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:47 gibba045 bash[25517]: cephadm 2021-03-10T13:50:46.193088+0000 mgr.gibba045.orlgmj (mgr.34412) 79 : cephadm [INF] Reconfiguring daemon osd.7 on gibba045 2021-03-10T13:50:48.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:47 gibba045 bash[25517]: audit 2021-03-10T13:50:47.730038+0000 mon.a (mon.0) 107 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:50:48.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:47 gibba045 bash[25517]: audit 2021-03-10T13:50:47.736333+0000 mon.c (mon.1) 39 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.gibba045.atotkw", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2021-03-10T13:50:48.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:47 gibba045 bash[25517]: audit 2021-03-10T13:50:47.736714+0000 mon.a (mon.0) 108 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.gibba045.atotkw", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2021-03-10T13:50:48.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:47 gibba045 bash[25517]: audit 2021-03-10T13:50:47.740477+0000 mon.c (mon.1) 40 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "auth get", "entity": "client.rgw.r.z.gibba045.atotkw"}]: dispatch 2021-03-10T13:50:48.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:47 gibba045 bash[25517]: audit 2021-03-10T13:50:47.743374+0000 mon.c (mon.1) 41 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:50:48.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:47 gibba045 bash[25517]: audit 2021-03-10T13:50:47.747911+0000 mon.c (mon.1) 42 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "client.rgw.r.z.gibba045.atotkw","key": "container_image"}]: dispatch 2021-03-10T13:50:48.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:47 gibba015 bash[29377]: cephadm 2021-03-10T13:50:46.192462+0000 mgr.gibba045.orlgmj (mgr.34412) 78 : cephadm [INF] Reconfiguring osd.7 (monmap changed)... 2021-03-10T13:50:48.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:47 gibba015 bash[29377]: cephadm 2021-03-10T13:50:46.193088+0000 mgr.gibba045.orlgmj (mgr.34412) 79 : cephadm [INF] Reconfiguring daemon osd.7 on gibba045 2021-03-10T13:50:48.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:47 gibba015 bash[29377]: audit 2021-03-10T13:50:47.730038+0000 mon.a (mon.0) 107 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:50:48.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:47 gibba015 bash[29377]: audit 2021-03-10T13:50:47.736333+0000 mon.c (mon.1) 39 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.gibba045.atotkw", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2021-03-10T13:50:48.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:47 gibba015 bash[29377]: audit 2021-03-10T13:50:47.736714+0000 mon.a (mon.0) 108 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.gibba045.atotkw", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2021-03-10T13:50:48.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:47 gibba015 bash[29377]: audit 2021-03-10T13:50:47.740477+0000 mon.c (mon.1) 40 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "auth get", "entity": "client.rgw.r.z.gibba045.atotkw"}]: dispatch 2021-03-10T13:50:48.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:47 gibba015 bash[29377]: audit 2021-03-10T13:50:47.743374+0000 mon.c (mon.1) 41 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:50:48.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:47 gibba015 bash[29377]: audit 2021-03-10T13:50:47.747911+0000 mon.c (mon.1) 42 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "client.rgw.r.z.gibba045.atotkw","key": "container_image"}]: dispatch 2021-03-10T13:50:48.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:47 gibba015 bash[30343]: cephadm 2021-03-10T13:50:46.192462+0000 mgr.gibba045.orlgmj (mgr.34412) 78 : cephadm [INF] Reconfiguring osd.7 (monmap changed)... 2021-03-10T13:50:48.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:47 gibba015 bash[30343]: cephadm 2021-03-10T13:50:46.193088+0000 mgr.gibba045.orlgmj (mgr.34412) 79 : cephadm [INF] Reconfiguring daemon osd.7 on gibba045 2021-03-10T13:50:48.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:47 gibba015 bash[30343]: audit 2021-03-10T13:50:47.730038+0000 mon.a (mon.0) 107 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:50:48.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:47 gibba015 bash[30343]: audit 2021-03-10T13:50:47.736333+0000 mon.c (mon.1) 39 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.gibba045.atotkw", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2021-03-10T13:50:48.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:47 gibba015 bash[30343]: audit 2021-03-10T13:50:47.736714+0000 mon.a (mon.0) 108 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.gibba045.atotkw", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2021-03-10T13:50:48.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:47 gibba015 bash[30343]: audit 2021-03-10T13:50:47.740477+0000 mon.c (mon.1) 40 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "auth get", "entity": "client.rgw.r.z.gibba045.atotkw"}]: dispatch 2021-03-10T13:50:48.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:47 gibba015 bash[30343]: audit 2021-03-10T13:50:47.743374+0000 mon.c (mon.1) 41 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:50:48.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:47 gibba015 bash[30343]: audit 2021-03-10T13:50:47.747911+0000 mon.c (mon.1) 42 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "client.rgw.r.z.gibba045.atotkw","key": "container_image"}]: dispatch 2021-03-10T13:50:49.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:48 gibba045 bash[25517]: cluster 2021-03-10T13:50:46.965297+0000 mgr.gibba045.orlgmj (mgr.34412) 80 : cluster [DBG] pgmap v31: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:49.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:48 gibba045 bash[25517]: cephadm 2021-03-10T13:50:47.735982+0000 mgr.gibba045.orlgmj (mgr.34412) 81 : cephadm [INF] Reconfiguring rgw.r.z.gibba045.atotkw (monmap changed)... 2021-03-10T13:50:49.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:48 gibba045 bash[25517]: cephadm 2021-03-10T13:50:47.747094+0000 mgr.gibba045.orlgmj (mgr.34412) 82 : cephadm [INF] Reconfiguring daemon rgw.r.z.gibba045.atotkw on gibba045 2021-03-10T13:50:49.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:48 gibba015 bash[29377]: cluster 2021-03-10T13:50:46.965297+0000 mgr.gibba045.orlgmj (mgr.34412) 80 : cluster [DBG] pgmap v31: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:49.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:48 gibba015 bash[29377]: cephadm 2021-03-10T13:50:47.735982+0000 mgr.gibba045.orlgmj (mgr.34412) 81 : cephadm [INF] Reconfiguring rgw.r.z.gibba045.atotkw (monmap changed)... 2021-03-10T13:50:49.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:48 gibba015 bash[29377]: cephadm 2021-03-10T13:50:47.747094+0000 mgr.gibba045.orlgmj (mgr.34412) 82 : cephadm [INF] Reconfiguring daemon rgw.r.z.gibba045.atotkw on gibba045 2021-03-10T13:50:49.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:48 gibba015 bash[30343]: cluster 2021-03-10T13:50:46.965297+0000 mgr.gibba045.orlgmj (mgr.34412) 80 : cluster [DBG] pgmap v31: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:49.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:48 gibba015 bash[30343]: cephadm 2021-03-10T13:50:47.735982+0000 mgr.gibba045.orlgmj (mgr.34412) 81 : cephadm [INF] Reconfiguring rgw.r.z.gibba045.atotkw (monmap changed)... 2021-03-10T13:50:49.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:48 gibba015 bash[30343]: cephadm 2021-03-10T13:50:47.747094+0000 mgr.gibba045.orlgmj (mgr.34412) 82 : cephadm [INF] Reconfiguring daemon rgw.r.z.gibba045.atotkw on gibba045 2021-03-10T13:50:50.685 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:50 gibba015 bash[29377]: cluster 2021-03-10T13:50:48.967133+0000 mgr.gibba045.orlgmj (mgr.34412) 83 : cluster [DBG] pgmap v32: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:50.685 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:50 gibba015 bash[29377]: audit 2021-03-10T13:50:49.432856+0000 mon.a (mon.0) 109 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:50:50.686 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:50 gibba015 bash[29377]: cephadm 2021-03-10T13:50:49.434904+0000 mgr.gibba045.orlgmj (mgr.34412) 84 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:50:50.686 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:50 gibba015 bash[29377]: audit 2021-03-10T13:50:49.435072+0000 mon.c (mon.1) 43 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:50:50.686 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:50 gibba015 bash[29377]: audit 2021-03-10T13:50:49.436799+0000 mon.c (mon.1) 44 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:50:50.686 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:50 gibba015 bash[29377]: cephadm 2021-03-10T13:50:49.437073+0000 mgr.gibba045.orlgmj (mgr.34412) 85 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:50:50.687 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:50 gibba015 bash[29377]: cephadm 2021-03-10T13:50:49.438593+0000 mgr.gibba045.orlgmj (mgr.34412) 86 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:50:50.687 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:50 gibba015 bash[29377]: audit 2021-03-10T13:50:49.438652+0000 mon.c (mon.1) 45 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:50:50.687 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:50 gibba015 bash[29377]: cephadm 2021-03-10T13:50:49.438702+0000 mgr.gibba045.orlgmj (mgr.34412) 87 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:50:50.687 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:50 gibba015 bash[29377]: cephadm 2021-03-10T13:50:49.440447+0000 mgr.gibba045.orlgmj (mgr.34412) 88 : cephadm [INF] Upgrade: Setting container_image for all mon 2021-03-10T13:50:50.687 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:50 gibba015 bash[29377]: audit 2021-03-10T13:50:49.444144+0000 mon.a (mon.0) 110 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:50:50.688 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:50 gibba015 bash[29377]: audit 2021-03-10T13:50:49.445552+0000 mon.c (mon.1) 46 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2021-03-10T13:50:50.688 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:50 gibba015 bash[29377]: audit 2021-03-10T13:50:49.445880+0000 mon.a (mon.0) 111 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2021-03-10T13:50:50.688 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:50 gibba015 bash[29377]: audit 2021-03-10T13:50:49.448842+0000 mon.a (mon.0) 112 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]': finished 2021-03-10T13:50:50.688 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:50 gibba015 bash[29377]: audit 2021-03-10T13:50:49.450375+0000 mon.c (mon.1) 47 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2021-03-10T13:50:50.688 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:50 gibba015 bash[29377]: audit 2021-03-10T13:50:49.450692+0000 mon.a (mon.0) 113 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2021-03-10T13:50:50.689 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:50 gibba015 bash[29377]: audit 2021-03-10T13:50:49.453611+0000 mon.a (mon.0) 114 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]': finished 2021-03-10T13:50:50.689 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:50 gibba015 bash[29377]: audit 2021-03-10T13:50:49.455033+0000 mon.c (mon.1) 48 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2021-03-10T13:50:50.689 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:50 gibba015 bash[30343]: cluster 2021-03-10T13:50:48.967133+0000 mgr.gibba045.orlgmj (mgr.34412) 83 : cluster [DBG] pgmap v32: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:50.690 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:50 gibba015 bash[30343]: audit 2021-03-10T13:50:49.432856+0000 mon.a (mon.0) 109 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:50:50.690 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:50 gibba015 bash[30343]: cephadm 2021-03-10T13:50:49.434904+0000 mgr.gibba045.orlgmj (mgr.34412) 84 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:50:50.690 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:50 gibba015 bash[30343]: audit 2021-03-10T13:50:49.435072+0000 mon.c (mon.1) 43 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:50:50.690 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:50 gibba015 bash[30343]: audit 2021-03-10T13:50:49.436799+0000 mon.c (mon.1) 44 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:50:50.690 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:50 gibba015 bash[30343]: cephadm 2021-03-10T13:50:49.437073+0000 mgr.gibba045.orlgmj (mgr.34412) 85 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:50:50.691 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:50 gibba015 bash[30343]: cephadm 2021-03-10T13:50:49.438593+0000 mgr.gibba045.orlgmj (mgr.34412) 86 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:50:50.691 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:50 gibba015 bash[30343]: audit 2021-03-10T13:50:49.438652+0000 mon.c (mon.1) 45 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:50:50.691 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:50 gibba015 bash[30343]: cephadm 2021-03-10T13:50:49.438702+0000 mgr.gibba045.orlgmj (mgr.34412) 87 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:50:50.691 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:50 gibba015 bash[30343]: cephadm 2021-03-10T13:50:49.440447+0000 mgr.gibba045.orlgmj (mgr.34412) 88 : cephadm [INF] Upgrade: Setting container_image for all mon 2021-03-10T13:50:50.691 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:50 gibba015 bash[30343]: audit 2021-03-10T13:50:49.444144+0000 mon.a (mon.0) 110 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:50:50.692 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:50 gibba015 bash[30343]: audit 2021-03-10T13:50:49.445552+0000 mon.c (mon.1) 46 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2021-03-10T13:50:50.692 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:50 gibba015 bash[30343]: audit 2021-03-10T13:50:49.445880+0000 mon.a (mon.0) 111 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2021-03-10T13:50:50.692 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:50 gibba015 bash[30343]: audit 2021-03-10T13:50:49.448842+0000 mon.a (mon.0) 112 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]': finished 2021-03-10T13:50:50.692 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:50 gibba015 bash[30343]: audit 2021-03-10T13:50:49.450375+0000 mon.c (mon.1) 47 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2021-03-10T13:50:50.692 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:50 gibba015 bash[30343]: audit 2021-03-10T13:50:49.450692+0000 mon.a (mon.0) 113 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2021-03-10T13:50:50.693 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:50 gibba015 bash[30343]: audit 2021-03-10T13:50:49.453611+0000 mon.a (mon.0) 114 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]': finished 2021-03-10T13:50:50.693 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:50 gibba015 bash[30343]: audit 2021-03-10T13:50:49.455033+0000 mon.c (mon.1) 48 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2021-03-10T13:50:50.693 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:50 gibba015 bash[29377]: audit 2021-03-10T13:50:49.455272+0000 mon.a (mon.0) 115 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2021-03-10T13:50:50.694 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:50 gibba015 bash[29377]: audit 2021-03-10T13:50:49.458021+0000 mon.a (mon.0) 116 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]': finished 2021-03-10T13:50:50.694 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:50 gibba015 bash[29377]: audit 2021-03-10T13:50:49.459836+0000 mon.c (mon.1) 49 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:50:50.694 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:50 gibba015 bash[29377]: cephadm 2021-03-10T13:50:49.460154+0000 mgr.gibba045.orlgmj (mgr.34412) 89 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:50:50.694 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:50 gibba015 bash[29377]: cephadm 2021-03-10T13:50:49.460278+0000 mgr.gibba045.orlgmj (mgr.34412) 90 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:50:50.694 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:50 gibba015 bash[29377]: cephadm 2021-03-10T13:50:49.461596+0000 mgr.gibba045.orlgmj (mgr.34412) 91 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:50:50.695 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:50 gibba015 bash[29377]: audit 2021-03-10T13:50:49.464200+0000 mon.a (mon.0) 117 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:50:50.695 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:50 gibba015 bash[29377]: cephadm 2021-03-10T13:50:49.466128+0000 mgr.gibba045.orlgmj (mgr.34412) 92 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:50:50.695 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:50 gibba015 bash[29377]: audit 2021-03-10T13:50:49.466130+0000 mon.c (mon.1) 50 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2021-03-10T13:50:50.695 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:50 gibba015 bash[29377]: cephadm 2021-03-10T13:50:49.466247+0000 mgr.gibba045.orlgmj (mgr.34412) 93 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:50:50.696 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:50 gibba015 bash[29377]: audit 2021-03-10T13:50:49.467232+0000 mgr.gibba045.orlgmj (mgr.34412) 94 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2021-03-10T13:50:50.696 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:50 gibba015 bash[29377]: cephadm 2021-03-10T13:50:49.468700+0000 mgr.gibba045.orlgmj (mgr.34412) 95 : cephadm [INF] Upgrade: osd.0 is safe to restart 2021-03-10T13:50:50.696 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:50 gibba015 bash[30343]: audit 2021-03-10T13:50:49.455272+0000 mon.a (mon.0) 115 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2021-03-10T13:50:50.696 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:50 gibba015 bash[30343]: audit 2021-03-10T13:50:49.458021+0000 mon.a (mon.0) 116 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]': finished 2021-03-10T13:50:50.697 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:50 gibba015 bash[30343]: audit 2021-03-10T13:50:49.459836+0000 mon.c (mon.1) 49 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:50:50.697 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:50 gibba015 bash[30343]: cephadm 2021-03-10T13:50:49.460154+0000 mgr.gibba045.orlgmj (mgr.34412) 89 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:50:50.697 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:50 gibba015 bash[30343]: cephadm 2021-03-10T13:50:49.460278+0000 mgr.gibba045.orlgmj (mgr.34412) 90 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:50:50.697 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:50 gibba015 bash[30343]: cephadm 2021-03-10T13:50:49.461596+0000 mgr.gibba045.orlgmj (mgr.34412) 91 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:50:50.697 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:50 gibba015 bash[30343]: audit 2021-03-10T13:50:49.464200+0000 mon.a (mon.0) 117 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:50:50.698 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:50 gibba015 bash[30343]: cephadm 2021-03-10T13:50:49.466128+0000 mgr.gibba045.orlgmj (mgr.34412) 92 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:50:50.698 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:50 gibba015 bash[30343]: audit 2021-03-10T13:50:49.466130+0000 mon.c (mon.1) 50 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2021-03-10T13:50:50.698 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:50 gibba015 bash[30343]: cephadm 2021-03-10T13:50:49.466247+0000 mgr.gibba045.orlgmj (mgr.34412) 93 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:50:50.698 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:50 gibba015 bash[30343]: audit 2021-03-10T13:50:49.467232+0000 mgr.gibba045.orlgmj (mgr.34412) 94 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2021-03-10T13:50:50.698 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:50 gibba015 bash[30343]: cephadm 2021-03-10T13:50:49.468700+0000 mgr.gibba045.orlgmj (mgr.34412) 95 : cephadm [INF] Upgrade: osd.0 is safe to restart 2021-03-10T13:50:50.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:50 gibba045 bash[25517]: cluster 2021-03-10T13:50:48.967133+0000 mgr.gibba045.orlgmj (mgr.34412) 83 : cluster [DBG] pgmap v32: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:50.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:50 gibba045 bash[25517]: audit 2021-03-10T13:50:49.432856+0000 mon.a (mon.0) 109 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:50:50.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:50 gibba045 bash[25517]: cephadm 2021-03-10T13:50:49.434904+0000 mgr.gibba045.orlgmj (mgr.34412) 84 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:50:50.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:50 gibba045 bash[25517]: audit 2021-03-10T13:50:49.435072+0000 mon.c (mon.1) 43 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:50:50.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:50 gibba045 bash[25517]: audit 2021-03-10T13:50:49.436799+0000 mon.c (mon.1) 44 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:50:50.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:50 gibba045 bash[25517]: cephadm 2021-03-10T13:50:49.437073+0000 mgr.gibba045.orlgmj (mgr.34412) 85 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:50:50.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:50 gibba045 bash[25517]: cephadm 2021-03-10T13:50:49.438593+0000 mgr.gibba045.orlgmj (mgr.34412) 86 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:50:50.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:50 gibba045 bash[25517]: audit 2021-03-10T13:50:49.438652+0000 mon.c (mon.1) 45 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:50:50.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:50 gibba045 bash[25517]: cephadm 2021-03-10T13:50:49.438702+0000 mgr.gibba045.orlgmj (mgr.34412) 87 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:50:50.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:50 gibba045 bash[25517]: cephadm 2021-03-10T13:50:49.440447+0000 mgr.gibba045.orlgmj (mgr.34412) 88 : cephadm [INF] Upgrade: Setting container_image for all mon 2021-03-10T13:50:50.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:50 gibba045 bash[25517]: audit 2021-03-10T13:50:49.444144+0000 mon.a (mon.0) 110 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:50:50.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:50 gibba045 bash[25517]: audit 2021-03-10T13:50:49.445552+0000 mon.c (mon.1) 46 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2021-03-10T13:50:50.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:50 gibba045 bash[25517]: audit 2021-03-10T13:50:49.445880+0000 mon.a (mon.0) 111 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2021-03-10T13:50:50.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:50 gibba045 bash[25517]: audit 2021-03-10T13:50:49.448842+0000 mon.a (mon.0) 112 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]': finished 2021-03-10T13:50:50.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:50 gibba045 bash[25517]: audit 2021-03-10T13:50:49.450375+0000 mon.c (mon.1) 47 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2021-03-10T13:50:50.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:50 gibba045 bash[25517]: audit 2021-03-10T13:50:49.450692+0000 mon.a (mon.0) 113 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2021-03-10T13:50:50.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:50 gibba045 bash[25517]: audit 2021-03-10T13:50:49.453611+0000 mon.a (mon.0) 114 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]': finished 2021-03-10T13:50:50.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:50 gibba045 bash[25517]: audit 2021-03-10T13:50:49.455033+0000 mon.c (mon.1) 48 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2021-03-10T13:50:50.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:50 gibba045 bash[25517]: audit 2021-03-10T13:50:49.455272+0000 mon.a (mon.0) 115 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2021-03-10T13:50:50.812 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:50 gibba045 bash[25517]: audit 2021-03-10T13:50:49.458021+0000 mon.a (mon.0) 116 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]': finished 2021-03-10T13:50:50.812 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:50 gibba045 bash[25517]: audit 2021-03-10T13:50:49.459836+0000 mon.c (mon.1) 49 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:50:50.812 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:50 gibba045 bash[25517]: cephadm 2021-03-10T13:50:49.460154+0000 mgr.gibba045.orlgmj (mgr.34412) 89 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:50:50.812 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:50 gibba045 bash[25517]: cephadm 2021-03-10T13:50:49.460278+0000 mgr.gibba045.orlgmj (mgr.34412) 90 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:50:50.812 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:50 gibba045 bash[25517]: cephadm 2021-03-10T13:50:49.461596+0000 mgr.gibba045.orlgmj (mgr.34412) 91 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:50:50.813 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:50 gibba045 bash[25517]: audit 2021-03-10T13:50:49.464200+0000 mon.a (mon.0) 117 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:50:50.813 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:50 gibba045 bash[25517]: cephadm 2021-03-10T13:50:49.466128+0000 mgr.gibba045.orlgmj (mgr.34412) 92 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:50:50.813 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:50 gibba045 bash[25517]: audit 2021-03-10T13:50:49.466130+0000 mon.c (mon.1) 50 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2021-03-10T13:50:50.813 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:50 gibba045 bash[25517]: cephadm 2021-03-10T13:50:49.466247+0000 mgr.gibba045.orlgmj (mgr.34412) 93 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:50:50.814 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:50 gibba045 bash[25517]: audit 2021-03-10T13:50:49.467232+0000 mgr.gibba045.orlgmj (mgr.34412) 94 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2021-03-10T13:50:50.814 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:50 gibba045 bash[25517]: cephadm 2021-03-10T13:50:49.468700+0000 mgr.gibba045.orlgmj (mgr.34412) 95 : cephadm [INF] Upgrade: osd.0 is safe to restart 2021-03-10T13:50:52.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:52 gibba015 bash[29377]: cluster 2021-03-10T13:50:50.968313+0000 mgr.gibba045.orlgmj (mgr.34412) 96 : cluster [DBG] pgmap v33: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:52.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:52 gibba015 bash[29377]: cephadm 2021-03-10T13:50:51.436581+0000 mgr.gibba045.orlgmj (mgr.34412) 97 : cephadm [INF] Upgrade: Updating osd.0 2021-03-10T13:50:52.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:52 gibba015 bash[29377]: audit 2021-03-10T13:50:51.446443+0000 mon.a (mon.0) 118 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:50:52.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:52 gibba015 bash[29377]: cephadm 2021-03-10T13:50:51.451760+0000 mgr.gibba045.orlgmj (mgr.34412) 98 : cephadm [INF] Deploying daemon osd.0 on gibba015 2021-03-10T13:50:52.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:52 gibba015 bash[29377]: audit 2021-03-10T13:50:51.452151+0000 mon.c (mon.1) 51 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd.0","key": "container_image"}]: dispatch 2021-03-10T13:50:52.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:52 gibba015 bash[29377]: audit 2021-03-10T13:50:52.354078+0000 mon.c (mon.1) 52 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T13:50:52.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:52 gibba015 bash[29377]: audit 2021-03-10T13:50:52.355052+0000 mon.c (mon.1) 53 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T13:50:52.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:52 gibba015 bash[29377]: audit 2021-03-10T13:50:52.355381+0000 mon.a (mon.0) 119 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T13:50:52.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:52 gibba015 bash[29377]: audit 2021-03-10T13:50:52.355967+0000 mon.c (mon.1) 54 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T13:50:52.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:52 gibba015 bash[29377]: audit 2021-03-10T13:50:52.357154+0000 mon.c (mon.1) 55 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T13:50:52.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:52 gibba015 bash[29377]: audit 2021-03-10T13:50:52.357514+0000 mon.a (mon.0) 120 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T13:50:52.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:52 gibba015 bash[29377]: audit 2021-03-10T13:50:52.358837+0000 mon.a (mon.0) 121 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T13:50:52.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:52 gibba015 bash[29377]: audit 2021-03-10T13:50:52.359763+0000 mon.a (mon.0) 122 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T13:50:52.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:52 gibba015 bash[30343]: cluster 2021-03-10T13:50:50.968313+0000 mgr.gibba045.orlgmj (mgr.34412) 96 : cluster [DBG] pgmap v33: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:52.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:52 gibba015 bash[30343]: cephadm 2021-03-10T13:50:51.436581+0000 mgr.gibba045.orlgmj (mgr.34412) 97 : cephadm [INF] Upgrade: Updating osd.0 2021-03-10T13:50:52.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:52 gibba015 bash[30343]: audit 2021-03-10T13:50:51.446443+0000 mon.a (mon.0) 118 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:50:52.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:52 gibba015 bash[30343]: cephadm 2021-03-10T13:50:51.451760+0000 mgr.gibba045.orlgmj (mgr.34412) 98 : cephadm [INF] Deploying daemon osd.0 on gibba015 2021-03-10T13:50:52.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:52 gibba015 bash[30343]: audit 2021-03-10T13:50:51.452151+0000 mon.c (mon.1) 51 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd.0","key": "container_image"}]: dispatch 2021-03-10T13:50:52.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:52 gibba015 bash[30343]: audit 2021-03-10T13:50:52.354078+0000 mon.c (mon.1) 52 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T13:50:52.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:52 gibba015 bash[30343]: audit 2021-03-10T13:50:52.355052+0000 mon.c (mon.1) 53 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T13:50:52.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:52 gibba015 bash[30343]: audit 2021-03-10T13:50:52.355381+0000 mon.a (mon.0) 119 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T13:50:52.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:52 gibba015 bash[30343]: audit 2021-03-10T13:50:52.355967+0000 mon.c (mon.1) 54 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T13:50:52.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:52 gibba015 bash[30343]: audit 2021-03-10T13:50:52.357154+0000 mon.c (mon.1) 55 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T13:50:52.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:52 gibba015 bash[30343]: audit 2021-03-10T13:50:52.357514+0000 mon.a (mon.0) 120 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T13:50:52.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:52 gibba015 bash[30343]: audit 2021-03-10T13:50:52.358837+0000 mon.a (mon.0) 121 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T13:50:52.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:52 gibba015 bash[30343]: audit 2021-03-10T13:50:52.359763+0000 mon.a (mon.0) 122 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T13:50:52.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:52 gibba045 bash[25517]: cluster 2021-03-10T13:50:50.968313+0000 mgr.gibba045.orlgmj (mgr.34412) 96 : cluster [DBG] pgmap v33: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:52.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:52 gibba045 bash[25517]: cephadm 2021-03-10T13:50:51.436581+0000 mgr.gibba045.orlgmj (mgr.34412) 97 : cephadm [INF] Upgrade: Updating osd.0 2021-03-10T13:50:52.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:52 gibba045 bash[25517]: audit 2021-03-10T13:50:51.446443+0000 mon.a (mon.0) 118 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:50:52.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:52 gibba045 bash[25517]: cephadm 2021-03-10T13:50:51.451760+0000 mgr.gibba045.orlgmj (mgr.34412) 98 : cephadm [INF] Deploying daemon osd.0 on gibba015 2021-03-10T13:50:52.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:52 gibba045 bash[25517]: audit 2021-03-10T13:50:51.452151+0000 mon.c (mon.1) 51 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd.0","key": "container_image"}]: dispatch 2021-03-10T13:50:52.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:52 gibba045 bash[25517]: audit 2021-03-10T13:50:52.354078+0000 mon.c (mon.1) 52 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T13:50:52.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:52 gibba045 bash[25517]: audit 2021-03-10T13:50:52.355052+0000 mon.c (mon.1) 53 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T13:50:52.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:52 gibba045 bash[25517]: audit 2021-03-10T13:50:52.355381+0000 mon.a (mon.0) 119 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T13:50:52.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:52 gibba045 bash[25517]: audit 2021-03-10T13:50:52.355967+0000 mon.c (mon.1) 54 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T13:50:52.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:52 gibba045 bash[25517]: audit 2021-03-10T13:50:52.357154+0000 mon.c (mon.1) 55 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T13:50:52.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:52 gibba045 bash[25517]: audit 2021-03-10T13:50:52.357514+0000 mon.a (mon.0) 120 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T13:50:52.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:52 gibba045 bash[25517]: audit 2021-03-10T13:50:52.358837+0000 mon.a (mon.0) 121 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T13:50:52.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:52 gibba045 bash[25517]: audit 2021-03-10T13:50:52.359763+0000 mon.a (mon.0) 122 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T13:50:53.593 INFO:journalctl@ceph.osd.0.gibba015.stdout:Mar 10 13:50:53 gibba015 systemd[1]: Stopping Ceph osd.0 for e4a642d2-81a5-11eb-9080-001a4aab830c... 2021-03-10T13:50:53.593 INFO:journalctl@ceph.osd.0.gibba015.stdout:Mar 10 13:50:53 gibba015 bash[14952]: debug 2021-03-10T13:50:53.452+0000 7f44b9e6e700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2021-03-10T13:50:53.594 INFO:journalctl@ceph.osd.0.gibba015.stdout:Mar 10 13:50:53 gibba015 bash[14952]: debug 2021-03-10T13:50:53.452+0000 7f44b9e6e700 -1 osd.0 62 *** Got signal Terminated *** 2021-03-10T13:50:53.594 INFO:journalctl@ceph.osd.0.gibba015.stdout:Mar 10 13:50:53 gibba015 bash[14952]: debug 2021-03-10T13:50:53.452+0000 7f44b9e6e700 -1 osd.0 62 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-03-10T13:50:53.594 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:53 gibba015 bash[29377]: audit 2021-03-10T13:50:52.461423+0000 mon.c (mon.1) 56 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:50:53.595 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:53 gibba015 bash[29377]: audit 2021-03-10T13:50:52.461741+0000 mon.a (mon.0) 123 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:50:53.595 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:53 gibba015 bash[29377]: audit 2021-03-10T13:50:52.466924+0000 mon.c (mon.1) 57 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T13:50:53.595 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:53 gibba015 bash[29377]: audit 2021-03-10T13:50:52.467340+0000 mon.a (mon.0) 124 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T13:50:53.596 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:53 gibba015 bash[30343]: audit 2021-03-10T13:50:52.461423+0000 mon.c (mon.1) 56 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:50:53.596 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:53 gibba015 bash[30343]: audit 2021-03-10T13:50:52.461741+0000 mon.a (mon.0) 123 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:50:53.596 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:53 gibba015 bash[30343]: audit 2021-03-10T13:50:52.466924+0000 mon.c (mon.1) 57 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T13:50:53.596 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:53 gibba015 bash[30343]: audit 2021-03-10T13:50:52.467340+0000 mon.a (mon.0) 124 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T13:50:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:53 gibba045 bash[25517]: audit 2021-03-10T13:50:52.461423+0000 mon.c (mon.1) 56 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:50:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:53 gibba045 bash[25517]: audit 2021-03-10T13:50:52.461741+0000 mon.a (mon.0) 123 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:50:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:53 gibba045 bash[25517]: audit 2021-03-10T13:50:52.466924+0000 mon.c (mon.1) 57 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T13:50:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:53 gibba045 bash[25517]: audit 2021-03-10T13:50:52.467340+0000 mon.a (mon.0) 124 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T13:50:54.471 INFO:journalctl@ceph.osd.0.gibba015.stdout:Mar 10 13:50:54 gibba015 docker[31760]: ceph-e4a642d2-81a5-11eb-9080-001a4aab830c-osd.0 2021-03-10T13:50:54.617 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:54 gibba015 bash[29377]: cluster 2021-03-10T13:50:52.969559+0000 mgr.gibba045.orlgmj (mgr.34412) 99 : cluster [DBG] pgmap v34: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:54.617 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:54 gibba015 bash[29377]: cluster 2021-03-10T13:50:53.765245+0000 mon.a (mon.0) 125 : cluster [DBG] osd.0 reported immediately failed by osd.2 2021-03-10T13:50:54.617 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:54 gibba015 bash[29377]: cluster 2021-03-10T13:50:53.765338+0000 mon.a (mon.0) 126 : cluster [INF] osd.0 failed (root=default,host=gibba015) (connection refused reported by osd.2) 2021-03-10T13:50:54.618 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:54 gibba015 bash[29377]: cluster 2021-03-10T13:50:53.765850+0000 mon.a (mon.0) 127 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-03-10T13:50:54.618 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:54 gibba015 bash[29377]: cluster 2021-03-10T13:50:53.766040+0000 mon.a (mon.0) 128 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-03-10T13:50:54.618 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:54 gibba015 bash[29377]: cluster 2021-03-10T13:50:53.766444+0000 mon.a (mon.0) 129 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-03-10T13:50:54.618 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:54 gibba015 bash[29377]: cluster 2021-03-10T13:50:53.766752+0000 mon.a (mon.0) 130 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-03-10T13:50:54.619 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:54 gibba015 bash[29377]: cluster 2021-03-10T13:50:53.767187+0000 mon.a (mon.0) 131 : cluster [DBG] osd.0 reported immediately failed by osd.1 2021-03-10T13:50:54.619 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:54 gibba015 bash[29377]: cluster 2021-03-10T13:50:53.767362+0000 mon.a (mon.0) 132 : cluster [DBG] osd.0 reported immediately failed by osd.2 2021-03-10T13:50:54.619 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:54 gibba015 bash[29377]: cluster 2021-03-10T13:50:53.767756+0000 mon.a (mon.0) 133 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-03-10T13:50:54.619 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:54 gibba015 bash[29377]: cluster 2021-03-10T13:50:53.767933+0000 mon.a (mon.0) 134 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-03-10T13:50:54.620 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:54 gibba015 bash[29377]: cluster 2021-03-10T13:50:53.768330+0000 mon.a (mon.0) 135 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-03-10T13:50:54.620 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:54 gibba015 bash[29377]: cluster 2021-03-10T13:50:53.768611+0000 mon.a (mon.0) 136 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T13:50:54.620 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:54 gibba015 bash[29377]: cluster 2021-03-10T13:50:53.769010+0000 mon.a (mon.0) 137 : cluster [DBG] osd.0 reported immediately failed by osd.1 2021-03-10T13:50:54.620 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:54 gibba015 bash[29377]: cluster 2021-03-10T13:50:53.769314+0000 mon.a (mon.0) 138 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-03-10T13:50:54.620 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:54 gibba015 bash[29377]: cluster 2021-03-10T13:50:53.769825+0000 mon.a (mon.0) 139 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T13:50:54.621 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:54 gibba015 bash[29377]: cluster 2021-03-10T13:50:54.162066+0000 mon.a (mon.0) 140 : cluster [DBG] osd.0 reported immediately failed by osd.2 2021-03-10T13:50:54.621 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:54 gibba015 bash[29377]: cluster 2021-03-10T13:50:54.164652+0000 mon.a (mon.0) 141 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-03-10T13:50:54.621 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:54 gibba015 bash[29377]: cluster 2021-03-10T13:50:54.165022+0000 mon.a (mon.0) 142 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-03-10T13:50:54.621 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:54 gibba015 bash[29377]: cluster 2021-03-10T13:50:54.165271+0000 mon.a (mon.0) 143 : cluster [DBG] osd.0 reported immediately failed by osd.1 2021-03-10T13:50:54.622 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:54 gibba015 bash[29377]: cluster 2021-03-10T13:50:54.165676+0000 mon.a (mon.0) 144 : cluster [DBG] osd.0 reported immediately failed by osd.2 2021-03-10T13:50:54.622 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:54 gibba015 bash[29377]: cluster 2021-03-10T13:50:54.165856+0000 mon.a (mon.0) 145 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-03-10T13:50:54.622 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:54 gibba015 bash[29377]: cluster 2021-03-10T13:50:54.166294+0000 mon.a (mon.0) 146 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-03-10T13:50:54.622 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:54 gibba015 bash[29377]: cluster 2021-03-10T13:50:54.166596+0000 mon.a (mon.0) 147 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T13:50:54.622 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:54 gibba015 bash[29377]: cluster 2021-03-10T13:50:54.167002+0000 mon.a (mon.0) 148 : cluster [DBG] osd.0 reported immediately failed by osd.1 2021-03-10T13:50:54.623 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:54 gibba015 bash[30343]: cluster 2021-03-10T13:50:52.969559+0000 mgr.gibba045.orlgmj (mgr.34412) 99 : cluster [DBG] pgmap v34: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:54.623 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:54 gibba015 bash[30343]: cluster 2021-03-10T13:50:53.765245+0000 mon.a (mon.0) 125 : cluster [DBG] osd.0 reported immediately failed by osd.2 2021-03-10T13:50:54.623 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:54 gibba015 bash[30343]: cluster 2021-03-10T13:50:53.765338+0000 mon.a (mon.0) 126 : cluster [INF] osd.0 failed (root=default,host=gibba015) (connection refused reported by osd.2) 2021-03-10T13:50:54.624 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:54 gibba015 bash[30343]: cluster 2021-03-10T13:50:53.765850+0000 mon.a (mon.0) 127 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-03-10T13:50:54.624 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:54 gibba015 bash[30343]: cluster 2021-03-10T13:50:53.766040+0000 mon.a (mon.0) 128 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-03-10T13:50:54.624 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:54 gibba015 bash[30343]: cluster 2021-03-10T13:50:53.766444+0000 mon.a (mon.0) 129 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-03-10T13:50:54.624 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:54 gibba015 bash[30343]: cluster 2021-03-10T13:50:53.766752+0000 mon.a (mon.0) 130 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-03-10T13:50:54.624 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:54 gibba015 bash[30343]: cluster 2021-03-10T13:50:53.767187+0000 mon.a (mon.0) 131 : cluster [DBG] osd.0 reported immediately failed by osd.1 2021-03-10T13:50:54.625 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:54 gibba015 bash[30343]: cluster 2021-03-10T13:50:53.767362+0000 mon.a (mon.0) 132 : cluster [DBG] osd.0 reported immediately failed by osd.2 2021-03-10T13:50:54.625 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:54 gibba015 bash[30343]: cluster 2021-03-10T13:50:53.767756+0000 mon.a (mon.0) 133 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-03-10T13:50:54.625 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:54 gibba015 bash[30343]: cluster 2021-03-10T13:50:53.767933+0000 mon.a (mon.0) 134 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-03-10T13:50:54.625 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:54 gibba015 bash[30343]: cluster 2021-03-10T13:50:53.768330+0000 mon.a (mon.0) 135 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-03-10T13:50:54.625 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:54 gibba015 bash[30343]: cluster 2021-03-10T13:50:53.768611+0000 mon.a (mon.0) 136 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T13:50:54.626 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:54 gibba015 bash[30343]: cluster 2021-03-10T13:50:53.769010+0000 mon.a (mon.0) 137 : cluster [DBG] osd.0 reported immediately failed by osd.1 2021-03-10T13:50:54.626 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:54 gibba015 bash[30343]: cluster 2021-03-10T13:50:53.769314+0000 mon.a (mon.0) 138 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-03-10T13:50:54.626 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:54 gibba015 bash[30343]: cluster 2021-03-10T13:50:53.769825+0000 mon.a (mon.0) 139 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T13:50:54.626 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:54 gibba015 bash[30343]: cluster 2021-03-10T13:50:54.162066+0000 mon.a (mon.0) 140 : cluster [DBG] osd.0 reported immediately failed by osd.2 2021-03-10T13:50:54.626 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:54 gibba015 bash[30343]: cluster 2021-03-10T13:50:54.164652+0000 mon.a (mon.0) 141 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-03-10T13:50:54.627 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:54 gibba015 bash[30343]: cluster 2021-03-10T13:50:54.165022+0000 mon.a (mon.0) 142 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-03-10T13:50:54.627 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:54 gibba015 bash[30343]: cluster 2021-03-10T13:50:54.165271+0000 mon.a (mon.0) 143 : cluster [DBG] osd.0 reported immediately failed by osd.1 2021-03-10T13:50:54.627 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:54 gibba015 bash[30343]: cluster 2021-03-10T13:50:54.165676+0000 mon.a (mon.0) 144 : cluster [DBG] osd.0 reported immediately failed by osd.2 2021-03-10T13:50:54.627 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:54 gibba015 bash[30343]: cluster 2021-03-10T13:50:54.165856+0000 mon.a (mon.0) 145 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-03-10T13:50:54.628 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:54 gibba015 bash[30343]: cluster 2021-03-10T13:50:54.166294+0000 mon.a (mon.0) 146 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-03-10T13:50:54.628 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:54 gibba015 bash[30343]: cluster 2021-03-10T13:50:54.166596+0000 mon.a (mon.0) 147 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T13:50:54.628 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:54 gibba015 bash[30343]: cluster 2021-03-10T13:50:54.167002+0000 mon.a (mon.0) 148 : cluster [DBG] osd.0 reported immediately failed by osd.1 2021-03-10T13:50:54.628 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:54 gibba015 bash[29377]: cluster 2021-03-10T13:50:54.167177+0000 mon.a (mon.0) 149 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-03-10T13:50:54.629 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:54 gibba015 bash[29377]: cluster 2021-03-10T13:50:54.167560+0000 mon.a (mon.0) 150 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-03-10T13:50:54.629 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:54 gibba015 bash[29377]: cluster 2021-03-10T13:50:54.167834+0000 mon.a (mon.0) 151 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-03-10T13:50:54.629 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:54 gibba015 bash[29377]: cluster 2021-03-10T13:50:54.168353+0000 mon.a (mon.0) 152 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T13:50:54.629 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:54 gibba015 bash[29377]: cluster 2021-03-10T13:50:54.168631+0000 mon.a (mon.0) 153 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-03-10T13:50:54.630 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:54 gibba015 bash[29377]: cluster 2021-03-10T13:50:54.242716+0000 mon.a (mon.0) 154 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-03-10T13:50:54.630 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:54 gibba015 bash[29377]: cluster 2021-03-10T13:50:54.245005+0000 mon.a (mon.0) 155 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-03-10T13:50:54.630 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:54 gibba015 bash[29377]: cluster 2021-03-10T13:50:54.246903+0000 mon.a (mon.0) 156 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-03-10T13:50:54.630 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:54 gibba015 bash[29377]: cluster 2021-03-10T13:50:54.247485+0000 mon.a (mon.0) 157 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T13:50:54.630 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:54 gibba015 bash[29377]: cluster 2021-03-10T13:50:54.442135+0000 mon.a (mon.0) 158 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-03-10T13:50:54.631 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:54 gibba015 bash[29377]: cluster 2021-03-10T13:50:54.448130+0000 mon.a (mon.0) 159 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-03-10T13:50:54.631 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:54 gibba015 bash[29377]: cluster 2021-03-10T13:50:54.448890+0000 mon.a (mon.0) 160 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T13:50:54.631 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:54 gibba015 bash[29377]: cluster 2021-03-10T13:50:54.449229+0000 mon.a (mon.0) 161 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-03-10T13:50:54.631 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:54 gibba015 bash[30343]: cluster 2021-03-10T13:50:54.167177+0000 mon.a (mon.0) 149 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-03-10T13:50:54.632 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:54 gibba015 bash[30343]: cluster 2021-03-10T13:50:54.167560+0000 mon.a (mon.0) 150 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-03-10T13:50:54.632 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:54 gibba015 bash[30343]: cluster 2021-03-10T13:50:54.167834+0000 mon.a (mon.0) 151 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-03-10T13:50:54.632 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:54 gibba015 bash[30343]: cluster 2021-03-10T13:50:54.168353+0000 mon.a (mon.0) 152 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T13:50:54.632 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:54 gibba015 bash[30343]: cluster 2021-03-10T13:50:54.168631+0000 mon.a (mon.0) 153 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-03-10T13:50:54.632 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:54 gibba015 bash[30343]: cluster 2021-03-10T13:50:54.242716+0000 mon.a (mon.0) 154 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-03-10T13:50:54.633 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:54 gibba015 bash[30343]: cluster 2021-03-10T13:50:54.245005+0000 mon.a (mon.0) 155 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-03-10T13:50:54.633 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:54 gibba015 bash[30343]: cluster 2021-03-10T13:50:54.246903+0000 mon.a (mon.0) 156 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-03-10T13:50:54.633 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:54 gibba015 bash[30343]: cluster 2021-03-10T13:50:54.247485+0000 mon.a (mon.0) 157 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T13:50:54.633 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:54 gibba015 bash[30343]: cluster 2021-03-10T13:50:54.442135+0000 mon.a (mon.0) 158 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-03-10T13:50:54.633 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:54 gibba015 bash[30343]: cluster 2021-03-10T13:50:54.448130+0000 mon.a (mon.0) 159 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-03-10T13:50:54.633 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:54 gibba015 bash[30343]: cluster 2021-03-10T13:50:54.448890+0000 mon.a (mon.0) 160 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T13:50:54.634 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:54 gibba015 bash[30343]: cluster 2021-03-10T13:50:54.449229+0000 mon.a (mon.0) 161 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-03-10T13:50:54.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:54 gibba045 bash[25517]: cluster 2021-03-10T13:50:52.969559+0000 mgr.gibba045.orlgmj (mgr.34412) 99 : cluster [DBG] pgmap v34: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:54.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:54 gibba045 bash[25517]: cluster 2021-03-10T13:50:53.765245+0000 mon.a (mon.0) 125 : cluster [DBG] osd.0 reported immediately failed by osd.2 2021-03-10T13:50:54.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:54 gibba045 bash[25517]: cluster 2021-03-10T13:50:53.765338+0000 mon.a (mon.0) 126 : cluster [INF] osd.0 failed (root=default,host=gibba015) (connection refused reported by osd.2) 2021-03-10T13:50:54.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:54 gibba045 bash[25517]: cluster 2021-03-10T13:50:53.765850+0000 mon.a (mon.0) 127 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-03-10T13:50:54.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:54 gibba045 bash[25517]: cluster 2021-03-10T13:50:53.766040+0000 mon.a (mon.0) 128 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-03-10T13:50:54.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:54 gibba045 bash[25517]: cluster 2021-03-10T13:50:53.766444+0000 mon.a (mon.0) 129 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-03-10T13:50:54.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:54 gibba045 bash[25517]: cluster 2021-03-10T13:50:53.766752+0000 mon.a (mon.0) 130 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-03-10T13:50:54.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:54 gibba045 bash[25517]: cluster 2021-03-10T13:50:53.767187+0000 mon.a (mon.0) 131 : cluster [DBG] osd.0 reported immediately failed by osd.1 2021-03-10T13:50:54.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:54 gibba045 bash[25517]: cluster 2021-03-10T13:50:53.767362+0000 mon.a (mon.0) 132 : cluster [DBG] osd.0 reported immediately failed by osd.2 2021-03-10T13:50:54.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:54 gibba045 bash[25517]: cluster 2021-03-10T13:50:53.767756+0000 mon.a (mon.0) 133 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-03-10T13:50:54.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:54 gibba045 bash[25517]: cluster 2021-03-10T13:50:53.767933+0000 mon.a (mon.0) 134 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-03-10T13:50:54.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:54 gibba045 bash[25517]: cluster 2021-03-10T13:50:53.768330+0000 mon.a (mon.0) 135 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-03-10T13:50:54.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:54 gibba045 bash[25517]: cluster 2021-03-10T13:50:53.768611+0000 mon.a (mon.0) 136 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T13:50:54.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:54 gibba045 bash[25517]: cluster 2021-03-10T13:50:53.769010+0000 mon.a (mon.0) 137 : cluster [DBG] osd.0 reported immediately failed by osd.1 2021-03-10T13:50:54.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:54 gibba045 bash[25517]: cluster 2021-03-10T13:50:53.769314+0000 mon.a (mon.0) 138 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-03-10T13:50:54.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:54 gibba045 bash[25517]: cluster 2021-03-10T13:50:53.769825+0000 mon.a (mon.0) 139 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T13:50:54.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:54 gibba045 bash[25517]: cluster 2021-03-10T13:50:54.162066+0000 mon.a (mon.0) 140 : cluster [DBG] osd.0 reported immediately failed by osd.2 2021-03-10T13:50:54.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:54 gibba045 bash[25517]: cluster 2021-03-10T13:50:54.164652+0000 mon.a (mon.0) 141 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-03-10T13:50:54.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:54 gibba045 bash[25517]: cluster 2021-03-10T13:50:54.165022+0000 mon.a (mon.0) 142 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-03-10T13:50:54.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:54 gibba045 bash[25517]: cluster 2021-03-10T13:50:54.165271+0000 mon.a (mon.0) 143 : cluster [DBG] osd.0 reported immediately failed by osd.1 2021-03-10T13:50:54.812 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:54 gibba045 bash[25517]: cluster 2021-03-10T13:50:54.165676+0000 mon.a (mon.0) 144 : cluster [DBG] osd.0 reported immediately failed by osd.2 2021-03-10T13:50:54.812 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:54 gibba045 bash[25517]: cluster 2021-03-10T13:50:54.165856+0000 mon.a (mon.0) 145 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-03-10T13:50:54.812 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:54 gibba045 bash[25517]: cluster 2021-03-10T13:50:54.166294+0000 mon.a (mon.0) 146 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-03-10T13:50:54.812 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:54 gibba045 bash[25517]: cluster 2021-03-10T13:50:54.166596+0000 mon.a (mon.0) 147 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T13:50:54.812 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:54 gibba045 bash[25517]: cluster 2021-03-10T13:50:54.167002+0000 mon.a (mon.0) 148 : cluster [DBG] osd.0 reported immediately failed by osd.1 2021-03-10T13:50:54.813 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:54 gibba045 bash[25517]: cluster 2021-03-10T13:50:54.167177+0000 mon.a (mon.0) 149 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-03-10T13:50:54.813 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:54 gibba045 bash[25517]: cluster 2021-03-10T13:50:54.167560+0000 mon.a (mon.0) 150 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-03-10T13:50:54.813 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:54 gibba045 bash[25517]: cluster 2021-03-10T13:50:54.167834+0000 mon.a (mon.0) 151 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-03-10T13:50:54.813 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:54 gibba045 bash[25517]: cluster 2021-03-10T13:50:54.168353+0000 mon.a (mon.0) 152 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T13:50:54.813 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:54 gibba045 bash[25517]: cluster 2021-03-10T13:50:54.168631+0000 mon.a (mon.0) 153 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-03-10T13:50:54.814 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:54 gibba045 bash[25517]: cluster 2021-03-10T13:50:54.242716+0000 mon.a (mon.0) 154 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-03-10T13:50:54.814 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:54 gibba045 bash[25517]: cluster 2021-03-10T13:50:54.245005+0000 mon.a (mon.0) 155 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-03-10T13:50:54.814 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:54 gibba045 bash[25517]: cluster 2021-03-10T13:50:54.246903+0000 mon.a (mon.0) 156 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-03-10T13:50:54.814 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:54 gibba045 bash[25517]: cluster 2021-03-10T13:50:54.247485+0000 mon.a (mon.0) 157 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T13:50:54.814 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:54 gibba045 bash[25517]: cluster 2021-03-10T13:50:54.442135+0000 mon.a (mon.0) 158 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-03-10T13:50:54.815 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:54 gibba045 bash[25517]: cluster 2021-03-10T13:50:54.448130+0000 mon.a (mon.0) 159 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-03-10T13:50:54.815 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:54 gibba045 bash[25517]: cluster 2021-03-10T13:50:54.448890+0000 mon.a (mon.0) 160 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T13:50:54.815 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:54 gibba045 bash[25517]: cluster 2021-03-10T13:50:54.449229+0000 mon.a (mon.0) 161 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-03-10T13:50:55.710 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:55 gibba015 bash[30343]: cluster 2021-03-10T13:50:54.460580+0000 mon.a (mon.0) 162 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T13:50:55.711 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:55 gibba015 bash[30343]: cluster 2021-03-10T13:50:54.470736+0000 mon.a (mon.0) 163 : cluster [DBG] osdmap e63: 8 total, 7 up, 8 in 2021-03-10T13:50:55.711 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:55 gibba015 bash[30343]: audit 2021-03-10T13:50:54.472482+0000 mon.c (mon.1) 58 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2021-03-10T13:50:55.711 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:55 gibba015 bash[30343]: audit 2021-03-10T13:50:54.477715+0000 mon.a (mon.0) 164 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2021-03-10T13:50:55.711 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:55 gibba015 bash[30343]: audit 2021-03-10T13:50:54.478926+0000 mon.c (mon.1) 59 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2021-03-10T13:50:55.712 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:55 gibba015 bash[30343]: audit 2021-03-10T13:50:54.479274+0000 mon.a (mon.0) 165 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2021-03-10T13:50:55.712 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:55 gibba015 bash[30343]: audit 2021-03-10T13:50:55.470061+0000 mon.a (mon.0) 166 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2021-03-10T13:50:55.712 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:55 gibba015 bash[30343]: cluster 2021-03-10T13:50:55.470171+0000 mon.a (mon.0) 167 : cluster [DBG] osdmap e64: 8 total, 7 up, 8 in 2021-03-10T13:50:55.713 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:55 gibba015 bash[29377]: cluster 2021-03-10T13:50:54.460580+0000 mon.a (mon.0) 162 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T13:50:55.713 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:55 gibba015 bash[29377]: cluster 2021-03-10T13:50:54.470736+0000 mon.a (mon.0) 163 : cluster [DBG] osdmap e63: 8 total, 7 up, 8 in 2021-03-10T13:50:55.713 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:55 gibba015 bash[29377]: audit 2021-03-10T13:50:54.472482+0000 mon.c (mon.1) 58 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2021-03-10T13:50:55.713 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:55 gibba015 bash[29377]: audit 2021-03-10T13:50:54.477715+0000 mon.a (mon.0) 164 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2021-03-10T13:50:55.713 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:55 gibba015 bash[29377]: audit 2021-03-10T13:50:54.478926+0000 mon.c (mon.1) 59 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2021-03-10T13:50:55.714 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:55 gibba015 bash[29377]: audit 2021-03-10T13:50:54.479274+0000 mon.a (mon.0) 165 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2021-03-10T13:50:55.714 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:55 gibba015 bash[29377]: audit 2021-03-10T13:50:55.470061+0000 mon.a (mon.0) 166 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2021-03-10T13:50:55.714 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:55 gibba015 bash[29377]: cluster 2021-03-10T13:50:55.470171+0000 mon.a (mon.0) 167 : cluster [DBG] osdmap e64: 8 total, 7 up, 8 in 2021-03-10T13:50:55.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:55 gibba045 bash[25517]: cluster 2021-03-10T13:50:54.460580+0000 mon.a (mon.0) 162 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T13:50:55.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:55 gibba045 bash[25517]: cluster 2021-03-10T13:50:54.470736+0000 mon.a (mon.0) 163 : cluster [DBG] osdmap e63: 8 total, 7 up, 8 in 2021-03-10T13:50:55.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:55 gibba045 bash[25517]: audit 2021-03-10T13:50:54.472482+0000 mon.c (mon.1) 58 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2021-03-10T13:50:55.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:55 gibba045 bash[25517]: audit 2021-03-10T13:50:54.477715+0000 mon.a (mon.0) 164 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2021-03-10T13:50:55.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:55 gibba045 bash[25517]: audit 2021-03-10T13:50:54.478926+0000 mon.c (mon.1) 59 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2021-03-10T13:50:55.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:55 gibba045 bash[25517]: audit 2021-03-10T13:50:54.479274+0000 mon.a (mon.0) 165 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2021-03-10T13:50:55.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:55 gibba045 bash[25517]: audit 2021-03-10T13:50:55.470061+0000 mon.a (mon.0) 166 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2021-03-10T13:50:55.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:55 gibba045 bash[25517]: cluster 2021-03-10T13:50:55.470171+0000 mon.a (mon.0) 167 : cluster [DBG] osdmap e64: 8 total, 7 up, 8 in 2021-03-10T13:50:56.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:56 gibba015 bash[29377]: cluster 2021-03-10T13:50:54.970749+0000 mgr.gibba045.orlgmj (mgr.34412) 100 : cluster [DBG] pgmap v36: 129 pgs: 16 stale+active+clean, 113 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:56.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:56 gibba015 bash[29377]: audit 2021-03-10T13:50:56.401117+0000 mon.a (mon.0) 168 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:50:56.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:56 gibba015 bash[29377]: audit 2021-03-10T13:50:56.402525+0000 mon.c (mon.1) 60 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:50:56.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:56 gibba015 bash[29377]: audit 2021-03-10T13:50:56.405031+0000 mon.c (mon.1) 61 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:50:56.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:56 gibba015 bash[30343]: cluster 2021-03-10T13:50:54.970749+0000 mgr.gibba045.orlgmj (mgr.34412) 100 : cluster [DBG] pgmap v36: 129 pgs: 16 stale+active+clean, 113 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:56.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:56 gibba015 bash[30343]: audit 2021-03-10T13:50:56.401117+0000 mon.a (mon.0) 168 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:50:56.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:56 gibba015 bash[30343]: audit 2021-03-10T13:50:56.402525+0000 mon.c (mon.1) 60 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:50:56.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:56 gibba015 bash[30343]: audit 2021-03-10T13:50:56.405031+0000 mon.c (mon.1) 61 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:50:56.724 INFO:journalctl@ceph.osd.0.gibba015.stdout:Mar 10 13:50:56 gibba015 systemd[1]: ceph-e4a642d2-81a5-11eb-9080-001a4aab830c@osd.0.service: Succeeded. 2021-03-10T13:50:56.725 INFO:journalctl@ceph.osd.0.gibba015.stdout:Mar 10 13:50:56 gibba015 systemd[1]: Stopped Ceph osd.0 for e4a642d2-81a5-11eb-9080-001a4aab830c. 2021-03-10T13:50:56.725 INFO:journalctl@ceph.osd.0.gibba015.stdout:Mar 10 13:50:56 gibba015 systemd[1]: Started Ceph osd.0 for e4a642d2-81a5-11eb-9080-001a4aab830c. 2021-03-10T13:50:56.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:56 gibba045 bash[25517]: cluster 2021-03-10T13:50:54.970749+0000 mgr.gibba045.orlgmj (mgr.34412) 100 : cluster [DBG] pgmap v36: 129 pgs: 16 stale+active+clean, 113 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:56.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:56 gibba045 bash[25517]: audit 2021-03-10T13:50:56.401117+0000 mon.a (mon.0) 168 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:50:56.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:56 gibba045 bash[25517]: audit 2021-03-10T13:50:56.402525+0000 mon.c (mon.1) 60 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:50:56.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:56 gibba045 bash[25517]: audit 2021-03-10T13:50:56.405031+0000 mon.c (mon.1) 61 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:50:58.222 INFO:journalctl@ceph.osd.0.gibba015.stdout:Mar 10 13:50:57 gibba015 bash[31935]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2021-03-10T13:50:58.222 INFO:journalctl@ceph.osd.0.gibba015.stdout:Mar 10 13:50:57 gibba015 bash[31935]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-0 --no-mon-config 2021-03-10T13:50:58.222 INFO:journalctl@ceph.osd.0.gibba015.stdout:Mar 10 13:50:57 gibba015 bash[31935]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0/block 2021-03-10T13:50:58.223 INFO:journalctl@ceph.osd.0.gibba015.stdout:Mar 10 13:50:57 gibba015 bash[31935]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-0/block 2021-03-10T13:50:58.223 INFO:journalctl@ceph.osd.0.gibba015.stdout:Mar 10 13:50:57 gibba015 bash[31935]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2021-03-10T13:50:58.223 INFO:journalctl@ceph.osd.0.gibba015.stdout:Mar 10 13:50:57 gibba015 bash[31935]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2021-03-10T13:50:58.223 INFO:journalctl@ceph.osd.0.gibba015.stdout:Mar 10 13:50:57 gibba015 bash[31935]: --> ceph-volume lvm activate successful for osd ID: 0 2021-03-10T13:50:58.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:58 gibba015 bash[29377]: cluster 2021-03-10T13:50:56.972035+0000 mgr.gibba045.orlgmj (mgr.34412) 101 : cluster [DBG] pgmap v38: 129 pgs: 16 stale+active+clean, 113 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:58.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:58 gibba015 bash[30343]: cluster 2021-03-10T13:50:56.972035+0000 mgr.gibba045.orlgmj (mgr.34412) 101 : cluster [DBG] pgmap v38: 129 pgs: 16 stale+active+clean, 113 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:58.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:58 gibba045 bash[25517]: cluster 2021-03-10T13:50:56.972035+0000 mgr.gibba045.orlgmj (mgr.34412) 101 : cluster [DBG] pgmap v38: 129 pgs: 16 stale+active+clean, 113 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:50:59.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:50:59 gibba045 bash[25517]: cluster 2021-03-10T13:50:59.488388+0000 mon.a (mon.0) 169 : cluster [WRN] Health check failed: Degraded data redundancy: 23/192 objects degraded (11.979%), 16 pgs degraded (PG_DEGRADED) 2021-03-10T13:50:59.835 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:50:59 gibba015 bash[30343]: cluster 2021-03-10T13:50:59.488388+0000 mon.a (mon.0) 169 : cluster [WRN] Health check failed: Degraded data redundancy: 23/192 objects degraded (11.979%), 16 pgs degraded (PG_DEGRADED) 2021-03-10T13:50:59.835 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:50:59 gibba015 bash[29377]: cluster 2021-03-10T13:50:59.488388+0000 mon.a (mon.0) 169 : cluster [WRN] Health check failed: Degraded data redundancy: 23/192 objects degraded (11.979%), 16 pgs degraded (PG_DEGRADED) 2021-03-10T13:51:00.221 INFO:journalctl@ceph.osd.0.gibba015.stdout:Mar 10 13:50:59 gibba015 bash[32064]: debug 2021-03-10T13:50:59.832+0000 7f07e0f5e080 -1 Falling back to public interface 2021-03-10T13:51:00.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:00 gibba045 bash[25517]: cluster 2021-03-10T13:50:58.974335+0000 mgr.gibba045.orlgmj (mgr.34412) 102 : cluster [DBG] pgmap v39: 129 pgs: 16 active+undersized+degraded, 33 active+undersized, 80 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 23/192 objects degraded (11.979%) 2021-03-10T13:51:00.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:00 gibba045 bash[25517]: audit 2021-03-10T13:51:00.032132+0000 mon.a (mon.0) 170 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:51:00.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:00 gibba045 bash[25517]: audit 2021-03-10T13:51:00.231102+0000 mon.a (mon.0) 171 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:51:00.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:00 gibba045 bash[25517]: audit 2021-03-10T13:51:00.254112+0000 mon.c (mon.1) 62 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:51:00.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:00 gibba045 bash[25517]: audit 2021-03-10T13:51:00.258518+0000 mon.c (mon.1) 63 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:51:00.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:00 gibba045 bash[25517]: audit 2021-03-10T13:51:00.263297+0000 mon.c (mon.1) 64 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:51:00.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:00 gibba045 bash[25517]: audit 2021-03-10T13:51:00.267423+0000 mon.c (mon.1) 65 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:51:00.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:00 gibba045 bash[25517]: audit 2021-03-10T13:51:00.276293+0000 mon.c (mon.1) 66 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-03-10T13:51:00.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:00 gibba015 bash[29377]: cluster 2021-03-10T13:50:58.974335+0000 mgr.gibba045.orlgmj (mgr.34412) 102 : cluster [DBG] pgmap v39: 129 pgs: 16 active+undersized+degraded, 33 active+undersized, 80 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 23/192 objects degraded (11.979%) 2021-03-10T13:51:00.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:00 gibba015 bash[29377]: audit 2021-03-10T13:51:00.032132+0000 mon.a (mon.0) 170 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:51:00.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:00 gibba015 bash[29377]: audit 2021-03-10T13:51:00.231102+0000 mon.a (mon.0) 171 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:51:00.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:00 gibba015 bash[29377]: audit 2021-03-10T13:51:00.254112+0000 mon.c (mon.1) 62 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:51:00.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:00 gibba015 bash[29377]: audit 2021-03-10T13:51:00.258518+0000 mon.c (mon.1) 63 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:51:00.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:00 gibba015 bash[29377]: audit 2021-03-10T13:51:00.263297+0000 mon.c (mon.1) 64 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:51:00.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:00 gibba015 bash[29377]: audit 2021-03-10T13:51:00.267423+0000 mon.c (mon.1) 65 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:51:00.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:00 gibba015 bash[29377]: audit 2021-03-10T13:51:00.276293+0000 mon.c (mon.1) 66 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-03-10T13:51:00.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:00 gibba015 bash[30343]: cluster 2021-03-10T13:50:58.974335+0000 mgr.gibba045.orlgmj (mgr.34412) 102 : cluster [DBG] pgmap v39: 129 pgs: 16 active+undersized+degraded, 33 active+undersized, 80 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 23/192 objects degraded (11.979%) 2021-03-10T13:51:00.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:00 gibba015 bash[30343]: audit 2021-03-10T13:51:00.032132+0000 mon.a (mon.0) 170 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:51:00.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:00 gibba015 bash[30343]: audit 2021-03-10T13:51:00.231102+0000 mon.a (mon.0) 171 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:51:00.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:00 gibba015 bash[30343]: audit 2021-03-10T13:51:00.254112+0000 mon.c (mon.1) 62 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:51:00.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:00 gibba015 bash[30343]: audit 2021-03-10T13:51:00.258518+0000 mon.c (mon.1) 63 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:51:00.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:00 gibba015 bash[30343]: audit 2021-03-10T13:51:00.263297+0000 mon.c (mon.1) 64 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:51:00.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:00 gibba015 bash[30343]: audit 2021-03-10T13:51:00.267423+0000 mon.c (mon.1) 65 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:51:00.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:00 gibba015 bash[30343]: audit 2021-03-10T13:51:00.276293+0000 mon.c (mon.1) 66 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-03-10T13:51:01.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:01 gibba015 bash[29377]: cephadm 2021-03-10T13:51:00.034040+0000 mgr.gibba045.orlgmj (mgr.34412) 103 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T13:51:01.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:01 gibba015 bash[29377]: cephadm 2021-03-10T13:51:00.252025+0000 mgr.gibba045.orlgmj (mgr.34412) 104 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:51:01.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:01 gibba015 bash[29377]: cephadm 2021-03-10T13:51:00.258206+0000 mgr.gibba045.orlgmj (mgr.34412) 105 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:51:01.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:01 gibba015 bash[29377]: cephadm 2021-03-10T13:51:00.262362+0000 mgr.gibba045.orlgmj (mgr.34412) 106 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:51:01.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:01 gibba015 bash[29377]: cephadm 2021-03-10T13:51:00.262694+0000 mgr.gibba045.orlgmj (mgr.34412) 107 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:51:01.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:01 gibba015 bash[29377]: cephadm 2021-03-10T13:51:00.266894+0000 mgr.gibba045.orlgmj (mgr.34412) 108 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:51:01.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:01 gibba015 bash[29377]: cephadm 2021-03-10T13:51:00.267478+0000 mgr.gibba045.orlgmj (mgr.34412) 109 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:51:01.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:01 gibba015 bash[29377]: cephadm 2021-03-10T13:51:00.270871+0000 mgr.gibba045.orlgmj (mgr.34412) 110 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:51:01.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:01 gibba015 bash[29377]: cephadm 2021-03-10T13:51:00.274812+0000 mgr.gibba045.orlgmj (mgr.34412) 111 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:51:01.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:01 gibba015 bash[29377]: cephadm 2021-03-10T13:51:00.275483+0000 mgr.gibba045.orlgmj (mgr.34412) 112 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:51:01.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:01 gibba015 bash[29377]: audit 2021-03-10T13:51:00.277699+0000 mgr.gibba045.orlgmj (mgr.34412) 113 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-03-10T13:51:01.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:01 gibba015 bash[29377]: cephadm 2021-03-10T13:51:00.280807+0000 mgr.gibba045.orlgmj (mgr.34412) 114 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (17 PGs are or would become offline) 2021-03-10T13:51:01.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:01 gibba015 bash[30343]: cephadm 2021-03-10T13:51:00.034040+0000 mgr.gibba045.orlgmj (mgr.34412) 103 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T13:51:01.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:01 gibba015 bash[30343]: cephadm 2021-03-10T13:51:00.252025+0000 mgr.gibba045.orlgmj (mgr.34412) 104 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:51:01.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:01 gibba015 bash[30343]: cephadm 2021-03-10T13:51:00.258206+0000 mgr.gibba045.orlgmj (mgr.34412) 105 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:51:01.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:01 gibba015 bash[30343]: cephadm 2021-03-10T13:51:00.262362+0000 mgr.gibba045.orlgmj (mgr.34412) 106 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:51:01.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:01 gibba015 bash[30343]: cephadm 2021-03-10T13:51:00.262694+0000 mgr.gibba045.orlgmj (mgr.34412) 107 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:51:01.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:01 gibba015 bash[30343]: cephadm 2021-03-10T13:51:00.266894+0000 mgr.gibba045.orlgmj (mgr.34412) 108 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:51:01.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:01 gibba015 bash[30343]: cephadm 2021-03-10T13:51:00.267478+0000 mgr.gibba045.orlgmj (mgr.34412) 109 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:51:01.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:01 gibba015 bash[30343]: cephadm 2021-03-10T13:51:00.270871+0000 mgr.gibba045.orlgmj (mgr.34412) 110 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:51:01.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:01 gibba015 bash[30343]: cephadm 2021-03-10T13:51:00.274812+0000 mgr.gibba045.orlgmj (mgr.34412) 111 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:51:01.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:01 gibba015 bash[30343]: cephadm 2021-03-10T13:51:00.275483+0000 mgr.gibba045.orlgmj (mgr.34412) 112 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:51:01.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:01 gibba015 bash[30343]: audit 2021-03-10T13:51:00.277699+0000 mgr.gibba045.orlgmj (mgr.34412) 113 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-03-10T13:51:01.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:01 gibba015 bash[30343]: cephadm 2021-03-10T13:51:00.280807+0000 mgr.gibba045.orlgmj (mgr.34412) 114 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (17 PGs are or would become offline) 2021-03-10T13:51:02.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:01 gibba045 bash[25517]: cephadm 2021-03-10T13:51:00.034040+0000 mgr.gibba045.orlgmj (mgr.34412) 103 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T13:51:02.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:01 gibba045 bash[25517]: cephadm 2021-03-10T13:51:00.252025+0000 mgr.gibba045.orlgmj (mgr.34412) 104 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:51:02.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:01 gibba045 bash[25517]: cephadm 2021-03-10T13:51:00.258206+0000 mgr.gibba045.orlgmj (mgr.34412) 105 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:51:02.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:01 gibba045 bash[25517]: cephadm 2021-03-10T13:51:00.262362+0000 mgr.gibba045.orlgmj (mgr.34412) 106 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:51:02.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:01 gibba045 bash[25517]: cephadm 2021-03-10T13:51:00.262694+0000 mgr.gibba045.orlgmj (mgr.34412) 107 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:51:02.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:01 gibba045 bash[25517]: cephadm 2021-03-10T13:51:00.266894+0000 mgr.gibba045.orlgmj (mgr.34412) 108 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:51:02.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:01 gibba045 bash[25517]: cephadm 2021-03-10T13:51:00.267478+0000 mgr.gibba045.orlgmj (mgr.34412) 109 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:51:02.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:01 gibba045 bash[25517]: cephadm 2021-03-10T13:51:00.270871+0000 mgr.gibba045.orlgmj (mgr.34412) 110 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:51:02.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:01 gibba045 bash[25517]: cephadm 2021-03-10T13:51:00.274812+0000 mgr.gibba045.orlgmj (mgr.34412) 111 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:51:02.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:01 gibba045 bash[25517]: cephadm 2021-03-10T13:51:00.275483+0000 mgr.gibba045.orlgmj (mgr.34412) 112 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:51:02.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:01 gibba045 bash[25517]: audit 2021-03-10T13:51:00.277699+0000 mgr.gibba045.orlgmj (mgr.34412) 113 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-03-10T13:51:02.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:01 gibba045 bash[25517]: cephadm 2021-03-10T13:51:00.280807+0000 mgr.gibba045.orlgmj (mgr.34412) 114 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (17 PGs are or would become offline) 2021-03-10T13:51:02.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:02 gibba015 bash[29377]: cluster 2021-03-10T13:51:00.975794+0000 mgr.gibba045.orlgmj (mgr.34412) 115 : cluster [DBG] pgmap v40: 129 pgs: 16 active+undersized+degraded, 33 active+undersized, 80 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 23/192 objects degraded (11.979%) 2021-03-10T13:51:02.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:02 gibba015 bash[30343]: cluster 2021-03-10T13:51:00.975794+0000 mgr.gibba045.orlgmj (mgr.34412) 115 : cluster [DBG] pgmap v40: 129 pgs: 16 active+undersized+degraded, 33 active+undersized, 80 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 23/192 objects degraded (11.979%) 2021-03-10T13:51:03.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:02 gibba045 bash[25517]: cluster 2021-03-10T13:51:00.975794+0000 mgr.gibba045.orlgmj (mgr.34412) 115 : cluster [DBG] pgmap v40: 129 pgs: 16 active+undersized+degraded, 33 active+undersized, 80 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 23/192 objects degraded (11.979%) 2021-03-10T13:51:03.471 INFO:journalctl@ceph.osd.0.gibba015.stdout:Mar 10 13:51:03 gibba015 bash[32064]: debug 2021-03-10T13:51:03.024+0000 7f07e0f5e080 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: store not yet converted to per-pg omap 2021-03-10T13:51:03.472 INFO:journalctl@ceph.osd.0.gibba015.stdout:Mar 10 13:51:03 gibba015 bash[32064]: debug 2021-03-10T13:51:03.024+0000 7f07caa20700 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #-1:c1a3fc6e:::purged_snaps:0# has omap that is not per-pg or pgmeta 2021-03-10T13:51:03.472 INFO:journalctl@ceph.osd.0.gibba015.stdout:Mar 10 13:51:03 gibba015 bash[32064]: debug 2021-03-10T13:51:03.024+0000 7f07caa20700 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #1:ed089dd6:::INTEL_SSDPEL1K375GA_PHKM913400GH375A:head# has omap that is not per-pg or pgmeta 2021-03-10T13:51:03.472 INFO:journalctl@ceph.osd.0.gibba015.stdout:Mar 10 13:51:03 gibba015 bash[32064]: debug 2021-03-10T13:51:03.148+0000 7f07e0f5e080 -1 osd.0 62 log_to_monitors {default=true} 2021-03-10T13:51:03.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:03 gibba015 bash[29377]: audit 2021-03-10T13:51:03.155381+0000 mon.c (mon.1) 67 : audit [INF] from='osd.0 [v2:172.21.2.115:6800/915568784,v1:172.21.2.115:6801/915568784]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-03-10T13:51:03.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:03 gibba015 bash[29377]: audit 2021-03-10T13:51:03.155635+0000 mon.a (mon.0) 172 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-03-10T13:51:03.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:03 gibba015 bash[30343]: audit 2021-03-10T13:51:03.155381+0000 mon.c (mon.1) 67 : audit [INF] from='osd.0 [v2:172.21.2.115:6800/915568784,v1:172.21.2.115:6801/915568784]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-03-10T13:51:03.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:03 gibba015 bash[30343]: audit 2021-03-10T13:51:03.155635+0000 mon.a (mon.0) 172 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-03-10T13:51:03.973 INFO:journalctl@ceph.osd.0.gibba015.stdout:Mar 10 13:51:03 gibba015 bash[32064]: debug 2021-03-10T13:51:03.580+0000 7f07d0c3b700 -1 osd.0 62 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T13:51:04.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:03 gibba045 bash[25517]: audit 2021-03-10T13:51:03.155381+0000 mon.c (mon.1) 67 : audit [INF] from='osd.0 [v2:172.21.2.115:6800/915568784,v1:172.21.2.115:6801/915568784]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-03-10T13:51:04.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:03 gibba045 bash[25517]: audit 2021-03-10T13:51:03.155635+0000 mon.a (mon.0) 172 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-03-10T13:51:04.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:04 gibba015 bash[29377]: cluster 2021-03-10T13:51:02.977245+0000 mgr.gibba045.orlgmj (mgr.34412) 116 : cluster [DBG] pgmap v41: 129 pgs: 16 active+undersized+degraded, 33 active+undersized, 80 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 23/192 objects degraded (11.979%) 2021-03-10T13:51:04.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:04 gibba015 bash[29377]: audit 2021-03-10T13:51:03.577048+0000 mon.a (mon.0) 173 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2021-03-10T13:51:04.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:04 gibba015 bash[29377]: cluster 2021-03-10T13:51:03.577121+0000 mon.a (mon.0) 174 : cluster [DBG] osdmap e65: 8 total, 7 up, 8 in 2021-03-10T13:51:04.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:04 gibba015 bash[29377]: audit 2021-03-10T13:51:03.578104+0000 mon.c (mon.1) 68 : audit [INF] from='osd.0 [v2:172.21.2.115:6800/915568784,v1:172.21.2.115:6801/915568784]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0820, "args": ["host=gibba015", "root=default"]}]: dispatch 2021-03-10T13:51:04.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:04 gibba015 bash[29377]: audit 2021-03-10T13:51:03.578402+0000 mon.a (mon.0) 175 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0820, "args": ["host=gibba015", "root=default"]}]: dispatch 2021-03-10T13:51:04.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:04 gibba015 bash[30343]: cluster 2021-03-10T13:51:02.977245+0000 mgr.gibba045.orlgmj (mgr.34412) 116 : cluster [DBG] pgmap v41: 129 pgs: 16 active+undersized+degraded, 33 active+undersized, 80 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 23/192 objects degraded (11.979%) 2021-03-10T13:51:04.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:04 gibba015 bash[30343]: audit 2021-03-10T13:51:03.577048+0000 mon.a (mon.0) 173 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2021-03-10T13:51:04.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:04 gibba015 bash[30343]: cluster 2021-03-10T13:51:03.577121+0000 mon.a (mon.0) 174 : cluster [DBG] osdmap e65: 8 total, 7 up, 8 in 2021-03-10T13:51:04.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:04 gibba015 bash[30343]: audit 2021-03-10T13:51:03.578104+0000 mon.c (mon.1) 68 : audit [INF] from='osd.0 [v2:172.21.2.115:6800/915568784,v1:172.21.2.115:6801/915568784]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0820, "args": ["host=gibba015", "root=default"]}]: dispatch 2021-03-10T13:51:04.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:04 gibba015 bash[30343]: audit 2021-03-10T13:51:03.578402+0000 mon.a (mon.0) 175 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0820, "args": ["host=gibba015", "root=default"]}]: dispatch 2021-03-10T13:51:05.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:04 gibba045 bash[25517]: cluster 2021-03-10T13:51:02.977245+0000 mgr.gibba045.orlgmj (mgr.34412) 116 : cluster [DBG] pgmap v41: 129 pgs: 16 active+undersized+degraded, 33 active+undersized, 80 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 23/192 objects degraded (11.979%) 2021-03-10T13:51:05.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:04 gibba045 bash[25517]: audit 2021-03-10T13:51:03.577048+0000 mon.a (mon.0) 173 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2021-03-10T13:51:05.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:04 gibba045 bash[25517]: cluster 2021-03-10T13:51:03.577121+0000 mon.a (mon.0) 174 : cluster [DBG] osdmap e65: 8 total, 7 up, 8 in 2021-03-10T13:51:05.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:04 gibba045 bash[25517]: audit 2021-03-10T13:51:03.578104+0000 mon.c (mon.1) 68 : audit [INF] from='osd.0 [v2:172.21.2.115:6800/915568784,v1:172.21.2.115:6801/915568784]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0820, "args": ["host=gibba015", "root=default"]}]: dispatch 2021-03-10T13:51:05.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:04 gibba045 bash[25517]: audit 2021-03-10T13:51:03.578402+0000 mon.a (mon.0) 175 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0820, "args": ["host=gibba015", "root=default"]}]: dispatch 2021-03-10T13:51:05.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:05 gibba015 bash[29377]: cluster 2021-03-10T13:51:04.576791+0000 mon.a (mon.0) 176 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T13:51:05.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:05 gibba015 bash[29377]: cluster 2021-03-10T13:51:04.587137+0000 mon.a (mon.0) 177 : cluster [INF] osd.0 [v2:172.21.2.115:6800/915568784,v1:172.21.2.115:6801/915568784] boot 2021-03-10T13:51:05.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:05 gibba015 bash[29377]: cluster 2021-03-10T13:51:04.587172+0000 mon.a (mon.0) 178 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2021-03-10T13:51:05.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:05 gibba015 bash[29377]: audit 2021-03-10T13:51:04.587592+0000 mon.c (mon.1) 69 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T13:51:05.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:05 gibba015 bash[29377]: cluster 2021-03-10T13:51:05.591973+0000 mon.a (mon.0) 179 : cluster [DBG] osdmap e67: 8 total, 8 up, 8 in 2021-03-10T13:51:05.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:05 gibba015 bash[30343]: cluster 2021-03-10T13:51:04.576791+0000 mon.a (mon.0) 176 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T13:51:05.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:05 gibba015 bash[30343]: cluster 2021-03-10T13:51:04.587137+0000 mon.a (mon.0) 177 : cluster [INF] osd.0 [v2:172.21.2.115:6800/915568784,v1:172.21.2.115:6801/915568784] boot 2021-03-10T13:51:05.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:05 gibba015 bash[30343]: cluster 2021-03-10T13:51:04.587172+0000 mon.a (mon.0) 178 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2021-03-10T13:51:05.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:05 gibba015 bash[30343]: audit 2021-03-10T13:51:04.587592+0000 mon.c (mon.1) 69 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T13:51:05.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:05 gibba015 bash[30343]: cluster 2021-03-10T13:51:05.591973+0000 mon.a (mon.0) 179 : cluster [DBG] osdmap e67: 8 total, 8 up, 8 in 2021-03-10T13:51:06.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:05 gibba045 bash[25517]: cluster 2021-03-10T13:51:04.576791+0000 mon.a (mon.0) 176 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T13:51:06.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:05 gibba045 bash[25517]: cluster 2021-03-10T13:51:04.587137+0000 mon.a (mon.0) 177 : cluster [INF] osd.0 [v2:172.21.2.115:6800/915568784,v1:172.21.2.115:6801/915568784] boot 2021-03-10T13:51:06.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:05 gibba045 bash[25517]: cluster 2021-03-10T13:51:04.587172+0000 mon.a (mon.0) 178 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2021-03-10T13:51:06.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:05 gibba045 bash[25517]: audit 2021-03-10T13:51:04.587592+0000 mon.c (mon.1) 69 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T13:51:06.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:05 gibba045 bash[25517]: cluster 2021-03-10T13:51:05.591973+0000 mon.a (mon.0) 179 : cluster [DBG] osdmap e67: 8 total, 8 up, 8 in 2021-03-10T13:51:06.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:06 gibba015 bash[29377]: cluster 2021-03-10T13:51:04.978715+0000 mgr.gibba045.orlgmj (mgr.34412) 117 : cluster [DBG] pgmap v44: 129 pgs: 16 active+undersized+degraded, 33 active+undersized, 80 active+clean; 7.0 KiB data, 10 MiB used, 665 GiB / 672 GiB avail; 23/192 objects degraded (11.979%) 2021-03-10T13:51:06.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:06 gibba015 bash[30343]: cluster 2021-03-10T13:51:04.978715+0000 mgr.gibba045.orlgmj (mgr.34412) 117 : cluster [DBG] pgmap v44: 129 pgs: 16 active+undersized+degraded, 33 active+undersized, 80 active+clean; 7.0 KiB data, 10 MiB used, 665 GiB / 672 GiB avail; 23/192 objects degraded (11.979%) 2021-03-10T13:51:07.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:06 gibba045 bash[25517]: cluster 2021-03-10T13:51:04.978715+0000 mgr.gibba045.orlgmj (mgr.34412) 117 : cluster [DBG] pgmap v44: 129 pgs: 16 active+undersized+degraded, 33 active+undersized, 80 active+clean; 7.0 KiB data, 10 MiB used, 665 GiB / 672 GiB avail; 23/192 objects degraded (11.979%) 2021-03-10T13:51:08.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:08 gibba015 bash[29377]: cluster 2021-03-10T13:51:06.980142+0000 mgr.gibba045.orlgmj (mgr.34412) 118 : cluster [DBG] pgmap v46: 129 pgs: 16 active+undersized+degraded, 33 active+undersized, 80 active+clean; 7.0 KiB data, 10 MiB used, 665 GiB / 672 GiB avail; 23/192 objects degraded (11.979%) 2021-03-10T13:51:08.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:08 gibba015 bash[30343]: cluster 2021-03-10T13:51:06.980142+0000 mgr.gibba045.orlgmj (mgr.34412) 118 : cluster [DBG] pgmap v46: 129 pgs: 16 active+undersized+degraded, 33 active+undersized, 80 active+clean; 7.0 KiB data, 10 MiB used, 665 GiB / 672 GiB avail; 23/192 objects degraded (11.979%) 2021-03-10T13:51:09.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:08 gibba045 bash[25517]: cluster 2021-03-10T13:51:06.980142+0000 mgr.gibba045.orlgmj (mgr.34412) 118 : cluster [DBG] pgmap v46: 129 pgs: 16 active+undersized+degraded, 33 active+undersized, 80 active+clean; 7.0 KiB data, 10 MiB used, 665 GiB / 672 GiB avail; 23/192 objects degraded (11.979%) 2021-03-10T13:51:09.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:09 gibba015 bash[29377]: cluster 2021-03-10T13:51:09.611294+0000 mon.a (mon.0) 180 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 23/192 objects degraded (11.979%), 16 pgs degraded) 2021-03-10T13:51:09.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:09 gibba015 bash[30343]: cluster 2021-03-10T13:51:09.611294+0000 mon.a (mon.0) 180 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 23/192 objects degraded (11.979%), 16 pgs degraded) 2021-03-10T13:51:10.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:09 gibba045 bash[25517]: cluster 2021-03-10T13:51:09.611294+0000 mon.a (mon.0) 180 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 23/192 objects degraded (11.979%), 16 pgs degraded) 2021-03-10T13:51:10.527 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T13:51:10.756 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T13:51:10.757 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (113s) 10s ago 7m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T13:51:10.757 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (7m) 47s ago 7m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T13:51:10.757 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2m) 47s ago 10m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T13:51:10.757 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2m) 47s ago 10m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T13:51:10.757 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (94s) 10s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T13:51:10.758 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (85s) 10s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T13:51:10.758 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (58s) 47s ago 10m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T13:51:10.758 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (68s) 10s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T13:51:10.758 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (7m) 10s ago 7m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T13:51:10.759 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (7m) 47s ago 7m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T13:51:10.759 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (12s) 10s ago 10m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T13:51:10.759 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (9m) 10s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 83369fd7640c 2021-03-10T13:51:10.759 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (9m) 10s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b90f9ada390a 2021-03-10T13:51:10.759 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (9m) 10s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 a77eccf371e5 2021-03-10T13:51:10.760 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (8m) 47s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 9b9c84c84955 2021-03-10T13:51:10.760 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (8m) 47s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 662e73261675 2021-03-10T13:51:10.760 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (8m) 47s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 338d252f22e3 2021-03-10T13:51:10.760 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (7m) 47s ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 784edc0668a4 2021-03-10T13:51:10.760 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (6m) 47s ago 7m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T13:51:10.761 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 47s ago 5m docker.io/ceph/ceph:v15.2.0 2021-03-10T13:51:10.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:10 gibba015 bash[29377]: cluster 2021-03-10T13:51:08.982061+0000 mgr.gibba045.orlgmj (mgr.34412) 119 : cluster [DBG] pgmap v47: 129 pgs: 16 active+clean+wait, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T13:51:10.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:10 gibba015 bash[30343]: cluster 2021-03-10T13:51:08.982061+0000 mgr.gibba045.orlgmj (mgr.34412) 119 : cluster [DBG] pgmap v47: 129 pgs: 16 active+clean+wait, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T13:51:11.003 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T13:51:11.004 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T13:51:11.004 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:51:11.004 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T13:51:11.004 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T13:51:11.005 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:51:11.005 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T13:51:11.005 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T13:51:11.005 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 7, 2021-03-10T13:51:11.005 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 1 2021-03-10T13:51:11.006 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T13:51:11.006 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T13:51:11.006 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T13:51:11.006 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 7, 2021-03-10T13:51:11.006 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 7 2021-03-10T13:51:11.007 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T13:51:11.007 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T13:51:11.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:10 gibba045 bash[25517]: cluster 2021-03-10T13:51:08.982061+0000 mgr.gibba045.orlgmj (mgr.34412) 119 : cluster [DBG] pgmap v47: 129 pgs: 16 active+clean+wait, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T13:51:11.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:11 gibba015 bash[29377]: audit 2021-03-10T13:51:10.517347+0000 mgr.gibba045.orlgmj (mgr.34412) 120 : audit [DBG] from='client.54145 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:51:11.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:11 gibba015 bash[29377]: audit 2021-03-10T13:51:10.743531+0000 mgr.gibba045.orlgmj (mgr.34412) 121 : audit [DBG] from='client.44163 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:51:11.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:11 gibba015 bash[29377]: audit 2021-03-10T13:51:11.002028+0000 mon.a (mon.0) 181 : audit [DBG] from='client.? 172.21.2.115:0/1686853787' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:51:11.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:11 gibba015 bash[30343]: audit 2021-03-10T13:51:10.517347+0000 mgr.gibba045.orlgmj (mgr.34412) 120 : audit [DBG] from='client.54145 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:51:11.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:11 gibba015 bash[30343]: audit 2021-03-10T13:51:10.743531+0000 mgr.gibba045.orlgmj (mgr.34412) 121 : audit [DBG] from='client.44163 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:51:11.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:11 gibba015 bash[30343]: audit 2021-03-10T13:51:11.002028+0000 mon.a (mon.0) 181 : audit [DBG] from='client.? 172.21.2.115:0/1686853787' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:51:12.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:11 gibba045 bash[25517]: audit 2021-03-10T13:51:10.517347+0000 mgr.gibba045.orlgmj (mgr.34412) 120 : audit [DBG] from='client.54145 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:51:12.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:11 gibba045 bash[25517]: audit 2021-03-10T13:51:10.743531+0000 mgr.gibba045.orlgmj (mgr.34412) 121 : audit [DBG] from='client.44163 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:51:12.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:11 gibba045 bash[25517]: audit 2021-03-10T13:51:11.002028+0000 mon.a (mon.0) 181 : audit [DBG] from='client.? 172.21.2.115:0/1686853787' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:51:12.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:12 gibba015 bash[29377]: cluster 2021-03-10T13:51:10.983218+0000 mgr.gibba045.orlgmj (mgr.34412) 122 : cluster [DBG] pgmap v48: 129 pgs: 16 active+clean+wait, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T13:51:12.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:12 gibba015 bash[29377]: audit 2021-03-10T13:51:12.466834+0000 mon.a (mon.0) 182 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:51:12.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:12 gibba015 bash[30343]: cluster 2021-03-10T13:51:10.983218+0000 mgr.gibba045.orlgmj (mgr.34412) 122 : cluster [DBG] pgmap v48: 129 pgs: 16 active+clean+wait, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T13:51:12.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:12 gibba015 bash[30343]: audit 2021-03-10T13:51:12.466834+0000 mon.a (mon.0) 182 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:51:13.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:12 gibba045 bash[25517]: cluster 2021-03-10T13:51:10.983218+0000 mgr.gibba045.orlgmj (mgr.34412) 122 : cluster [DBG] pgmap v48: 129 pgs: 16 active+clean+wait, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T13:51:13.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:12 gibba045 bash[25517]: audit 2021-03-10T13:51:12.466834+0000 mon.a (mon.0) 182 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:51:14.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:14 gibba015 bash[29377]: cluster 2021-03-10T13:51:12.984066+0000 mgr.gibba045.orlgmj (mgr.34412) 123 : cluster [DBG] pgmap v49: 129 pgs: 16 active+clean+wait, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T13:51:14.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:14 gibba015 bash[30343]: cluster 2021-03-10T13:51:12.984066+0000 mgr.gibba045.orlgmj (mgr.34412) 123 : cluster [DBG] pgmap v49: 129 pgs: 16 active+clean+wait, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T13:51:15.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:14 gibba045 bash[25517]: cluster 2021-03-10T13:51:12.984066+0000 mgr.gibba045.orlgmj (mgr.34412) 123 : cluster [DBG] pgmap v49: 129 pgs: 16 active+clean+wait, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T13:51:15.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:15 gibba015 bash[29377]: audit 2021-03-10T13:51:15.296346+0000 mon.c (mon.1) 70 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-03-10T13:51:15.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:15 gibba015 bash[30343]: audit 2021-03-10T13:51:15.296346+0000 mon.c (mon.1) 70 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-03-10T13:51:16.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:15 gibba045 bash[25517]: audit 2021-03-10T13:51:15.296346+0000 mon.c (mon.1) 70 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-03-10T13:51:16.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:16 gibba015 bash[29377]: cluster 2021-03-10T13:51:14.986241+0000 mgr.gibba045.orlgmj (mgr.34412) 124 : cluster [DBG] pgmap v50: 129 pgs: 16 active+clean+wait, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T13:51:16.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:16 gibba015 bash[29377]: audit 2021-03-10T13:51:15.298230+0000 mgr.gibba045.orlgmj (mgr.34412) 125 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-03-10T13:51:16.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:16 gibba015 bash[29377]: cephadm 2021-03-10T13:51:15.302998+0000 mgr.gibba045.orlgmj (mgr.34412) 126 : cephadm [INF] Upgrade: osd.1 is safe to restart 2021-03-10T13:51:16.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:16 gibba015 bash[30343]: cluster 2021-03-10T13:51:14.986241+0000 mgr.gibba045.orlgmj (mgr.34412) 124 : cluster [DBG] pgmap v50: 129 pgs: 16 active+clean+wait, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T13:51:16.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:16 gibba015 bash[30343]: audit 2021-03-10T13:51:15.298230+0000 mgr.gibba045.orlgmj (mgr.34412) 125 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-03-10T13:51:16.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:16 gibba015 bash[30343]: cephadm 2021-03-10T13:51:15.302998+0000 mgr.gibba045.orlgmj (mgr.34412) 126 : cephadm [INF] Upgrade: osd.1 is safe to restart 2021-03-10T13:51:17.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:16 gibba045 bash[25517]: cluster 2021-03-10T13:51:14.986241+0000 mgr.gibba045.orlgmj (mgr.34412) 124 : cluster [DBG] pgmap v50: 129 pgs: 16 active+clean+wait, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T13:51:17.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:16 gibba045 bash[25517]: audit 2021-03-10T13:51:15.298230+0000 mgr.gibba045.orlgmj (mgr.34412) 125 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-03-10T13:51:17.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:16 gibba045 bash[25517]: cephadm 2021-03-10T13:51:15.302998+0000 mgr.gibba045.orlgmj (mgr.34412) 126 : cephadm [INF] Upgrade: osd.1 is safe to restart 2021-03-10T13:51:18.716 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:18 gibba015 bash[30343]: cluster 2021-03-10T13:51:16.987269+0000 mgr.gibba045.orlgmj (mgr.34412) 127 : cluster [DBG] pgmap v51: 129 pgs: 16 active+clean+wait, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T13:51:18.717 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:18 gibba015 bash[30343]: cephadm 2021-03-10T13:51:17.449205+0000 mgr.gibba045.orlgmj (mgr.34412) 128 : cephadm [INF] Upgrade: Updating osd.1 2021-03-10T13:51:18.717 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:18 gibba015 bash[30343]: audit 2021-03-10T13:51:17.454431+0000 mon.a (mon.0) 183 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:51:18.717 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:18 gibba015 bash[30343]: audit 2021-03-10T13:51:17.460068+0000 mon.c (mon.1) 71 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd.1","key": "container_image"}]: dispatch 2021-03-10T13:51:18.718 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:18 gibba015 bash[30343]: cephadm 2021-03-10T13:51:17.460168+0000 mgr.gibba045.orlgmj (mgr.34412) 129 : cephadm [INF] Deploying daemon osd.1 on gibba015 2021-03-10T13:51:18.718 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:18 gibba015 bash[29377]: cluster 2021-03-10T13:51:16.987269+0000 mgr.gibba045.orlgmj (mgr.34412) 127 : cluster [DBG] pgmap v51: 129 pgs: 16 active+clean+wait, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T13:51:18.718 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:18 gibba015 bash[29377]: cephadm 2021-03-10T13:51:17.449205+0000 mgr.gibba045.orlgmj (mgr.34412) 128 : cephadm [INF] Upgrade: Updating osd.1 2021-03-10T13:51:18.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:18 gibba015 bash[29377]: audit 2021-03-10T13:51:17.454431+0000 mon.a (mon.0) 183 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:51:18.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:18 gibba015 bash[29377]: audit 2021-03-10T13:51:17.460068+0000 mon.c (mon.1) 71 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd.1","key": "container_image"}]: dispatch 2021-03-10T13:51:18.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:18 gibba015 bash[29377]: cephadm 2021-03-10T13:51:17.460168+0000 mgr.gibba045.orlgmj (mgr.34412) 129 : cephadm [INF] Deploying daemon osd.1 on gibba015 2021-03-10T13:51:18.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:18 gibba045 bash[25517]: cluster 2021-03-10T13:51:16.987269+0000 mgr.gibba045.orlgmj (mgr.34412) 127 : cluster [DBG] pgmap v51: 129 pgs: 16 active+clean+wait, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T13:51:18.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:18 gibba045 bash[25517]: cephadm 2021-03-10T13:51:17.449205+0000 mgr.gibba045.orlgmj (mgr.34412) 128 : cephadm [INF] Upgrade: Updating osd.1 2021-03-10T13:51:18.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:18 gibba045 bash[25517]: audit 2021-03-10T13:51:17.454431+0000 mon.a (mon.0) 183 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:51:18.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:18 gibba045 bash[25517]: audit 2021-03-10T13:51:17.460068+0000 mon.c (mon.1) 71 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd.1","key": "container_image"}]: dispatch 2021-03-10T13:51:18.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:18 gibba045 bash[25517]: cephadm 2021-03-10T13:51:17.460168+0000 mgr.gibba045.orlgmj (mgr.34412) 129 : cephadm [INF] Deploying daemon osd.1 on gibba015 2021-03-10T13:51:19.685 INFO:journalctl@ceph.osd.1.gibba015.stdout:Mar 10 13:51:19 gibba015 systemd[1]: Stopping Ceph osd.1 for e4a642d2-81a5-11eb-9080-001a4aab830c... 2021-03-10T13:51:19.685 INFO:journalctl@ceph.osd.1.gibba015.stdout:Mar 10 13:51:19 gibba015 bash[16403]: debug 2021-03-10T13:51:19.548+0000 7f1d64549700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2021-03-10T13:51:19.685 INFO:journalctl@ceph.osd.1.gibba015.stdout:Mar 10 13:51:19 gibba015 bash[16403]: debug 2021-03-10T13:51:19.548+0000 7f1d64549700 -1 osd.1 67 *** Got signal Terminated *** 2021-03-10T13:51:19.685 INFO:journalctl@ceph.osd.1.gibba015.stdout:Mar 10 13:51:19 gibba015 bash[16403]: debug 2021-03-10T13:51:19.548+0000 7f1d64549700 -1 osd.1 67 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-03-10T13:51:20.722 INFO:journalctl@ceph.osd.1.gibba015.stdout:Mar 10 13:51:20 gibba015 docker[32959]: ceph-e4a642d2-81a5-11eb-9080-001a4aab830c-osd.1 2021-03-10T13:51:20.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:20 gibba015 bash[29377]: cluster 2021-03-10T13:51:18.989193+0000 mgr.gibba045.orlgmj (mgr.34412) 130 : cluster [DBG] pgmap v52: 129 pgs: 16 active+clean+wait, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T13:51:20.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:20 gibba015 bash[29377]: cluster 2021-03-10T13:51:19.847672+0000 mon.a (mon.0) 184 : cluster [DBG] osd.1 reported immediately failed by osd.2 2021-03-10T13:51:20.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:20 gibba015 bash[29377]: cluster 2021-03-10T13:51:19.847765+0000 mon.a (mon.0) 185 : cluster [INF] osd.1 failed (root=default,host=gibba015) (connection refused reported by osd.2) 2021-03-10T13:51:20.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:20 gibba015 bash[29377]: cluster 2021-03-10T13:51:19.848383+0000 mon.a (mon.0) 186 : cluster [DBG] osd.1 reported immediately failed by osd.2 2021-03-10T13:51:20.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:20 gibba015 bash[29377]: cluster 2021-03-10T13:51:19.848737+0000 mon.a (mon.0) 187 : cluster [DBG] osd.1 reported immediately failed by osd.3 2021-03-10T13:51:20.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:20 gibba015 bash[29377]: cluster 2021-03-10T13:51:19.849172+0000 mon.a (mon.0) 188 : cluster [DBG] osd.1 reported immediately failed by osd.5 2021-03-10T13:51:20.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:20 gibba015 bash[29377]: cluster 2021-03-10T13:51:19.849491+0000 mon.a (mon.0) 189 : cluster [DBG] osd.1 reported immediately failed by osd.7 2021-03-10T13:51:20.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:20 gibba015 bash[29377]: cluster 2021-03-10T13:51:19.849983+0000 mon.a (mon.0) 190 : cluster [DBG] osd.1 reported immediately failed by osd.0 2021-03-10T13:51:20.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:20 gibba015 bash[29377]: cluster 2021-03-10T13:51:19.850360+0000 mon.a (mon.0) 191 : cluster [DBG] osd.1 reported immediately failed by osd.3 2021-03-10T13:51:20.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:20 gibba015 bash[29377]: cluster 2021-03-10T13:51:19.850556+0000 mon.a (mon.0) 192 : cluster [DBG] osd.1 reported immediately failed by osd.5 2021-03-10T13:51:20.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:20 gibba015 bash[29377]: cluster 2021-03-10T13:51:19.850985+0000 mon.a (mon.0) 193 : cluster [DBG] osd.1 reported immediately failed by osd.7 2021-03-10T13:51:20.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:20 gibba015 bash[29377]: cluster 2021-03-10T13:51:19.851398+0000 mon.a (mon.0) 194 : cluster [DBG] osd.1 reported immediately failed by osd.6 2021-03-10T13:51:20.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:20 gibba015 bash[29377]: cluster 2021-03-10T13:51:19.851797+0000 mon.a (mon.0) 195 : cluster [DBG] osd.1 reported immediately failed by osd.0 2021-03-10T13:51:20.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:20 gibba015 bash[29377]: cluster 2021-03-10T13:51:19.852197+0000 mon.a (mon.0) 196 : cluster [DBG] osd.1 reported immediately failed by osd.4 2021-03-10T13:51:20.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:20 gibba015 bash[29377]: cluster 2021-03-10T13:51:19.852607+0000 mon.a (mon.0) 197 : cluster [DBG] osd.1 reported immediately failed by osd.6 2021-03-10T13:51:20.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:20 gibba015 bash[29377]: cluster 2021-03-10T13:51:19.852998+0000 mon.a (mon.0) 198 : cluster [DBG] osd.1 reported immediately failed by osd.4 2021-03-10T13:51:20.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:20 gibba015 bash[29377]: cluster 2021-03-10T13:51:20.246865+0000 mon.a (mon.0) 199 : cluster [DBG] osd.1 reported immediately failed by osd.3 2021-03-10T13:51:20.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:20 gibba015 bash[29377]: cluster 2021-03-10T13:51:20.247114+0000 mon.a (mon.0) 200 : cluster [DBG] osd.1 reported immediately failed by osd.2 2021-03-10T13:51:20.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:20 gibba015 bash[29377]: cluster 2021-03-10T13:51:20.247550+0000 mon.a (mon.0) 201 : cluster [DBG] osd.1 reported immediately failed by osd.3 2021-03-10T13:51:20.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:20 gibba015 bash[29377]: cluster 2021-03-10T13:51:20.247740+0000 mon.a (mon.0) 202 : cluster [DBG] osd.1 reported immediately failed by osd.5 2021-03-10T13:51:20.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:20 gibba015 bash[29377]: cluster 2021-03-10T13:51:20.248203+0000 mon.a (mon.0) 203 : cluster [DBG] osd.1 reported immediately failed by osd.7 2021-03-10T13:51:20.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:20 gibba015 bash[29377]: cluster 2021-03-10T13:51:20.248517+0000 mon.a (mon.0) 204 : cluster [DBG] osd.1 reported immediately failed by osd.0 2021-03-10T13:51:20.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:20 gibba015 bash[29377]: cluster 2021-03-10T13:51:20.248962+0000 mon.a (mon.0) 205 : cluster [DBG] osd.1 reported immediately failed by osd.2 2021-03-10T13:51:20.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:20 gibba015 bash[29377]: cluster 2021-03-10T13:51:20.249198+0000 mon.a (mon.0) 206 : cluster [DBG] osd.1 reported immediately failed by osd.5 2021-03-10T13:51:20.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:20 gibba015 bash[29377]: cluster 2021-03-10T13:51:20.249610+0000 mon.a (mon.0) 207 : cluster [DBG] osd.1 reported immediately failed by osd.7 2021-03-10T13:51:20.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:20 gibba015 bash[30343]: cluster 2021-03-10T13:51:18.989193+0000 mgr.gibba045.orlgmj (mgr.34412) 130 : cluster [DBG] pgmap v52: 129 pgs: 16 active+clean+wait, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T13:51:20.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:20 gibba015 bash[30343]: cluster 2021-03-10T13:51:19.847672+0000 mon.a (mon.0) 184 : cluster [DBG] osd.1 reported immediately failed by osd.2 2021-03-10T13:51:20.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:20 gibba015 bash[30343]: cluster 2021-03-10T13:51:19.847765+0000 mon.a (mon.0) 185 : cluster [INF] osd.1 failed (root=default,host=gibba015) (connection refused reported by osd.2) 2021-03-10T13:51:20.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:20 gibba015 bash[30343]: cluster 2021-03-10T13:51:19.848383+0000 mon.a (mon.0) 186 : cluster [DBG] osd.1 reported immediately failed by osd.2 2021-03-10T13:51:20.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:20 gibba015 bash[30343]: cluster 2021-03-10T13:51:19.848737+0000 mon.a (mon.0) 187 : cluster [DBG] osd.1 reported immediately failed by osd.3 2021-03-10T13:51:20.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:20 gibba015 bash[30343]: cluster 2021-03-10T13:51:19.849172+0000 mon.a (mon.0) 188 : cluster [DBG] osd.1 reported immediately failed by osd.5 2021-03-10T13:51:20.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:20 gibba015 bash[30343]: cluster 2021-03-10T13:51:19.849491+0000 mon.a (mon.0) 189 : cluster [DBG] osd.1 reported immediately failed by osd.7 2021-03-10T13:51:20.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:20 gibba015 bash[30343]: cluster 2021-03-10T13:51:19.849983+0000 mon.a (mon.0) 190 : cluster [DBG] osd.1 reported immediately failed by osd.0 2021-03-10T13:51:20.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:20 gibba015 bash[30343]: cluster 2021-03-10T13:51:19.850360+0000 mon.a (mon.0) 191 : cluster [DBG] osd.1 reported immediately failed by osd.3 2021-03-10T13:51:20.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:20 gibba015 bash[30343]: cluster 2021-03-10T13:51:19.850556+0000 mon.a (mon.0) 192 : cluster [DBG] osd.1 reported immediately failed by osd.5 2021-03-10T13:51:20.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:20 gibba015 bash[30343]: cluster 2021-03-10T13:51:19.850985+0000 mon.a (mon.0) 193 : cluster [DBG] osd.1 reported immediately failed by osd.7 2021-03-10T13:51:20.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:20 gibba015 bash[30343]: cluster 2021-03-10T13:51:19.851398+0000 mon.a (mon.0) 194 : cluster [DBG] osd.1 reported immediately failed by osd.6 2021-03-10T13:51:20.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:20 gibba015 bash[30343]: cluster 2021-03-10T13:51:19.851797+0000 mon.a (mon.0) 195 : cluster [DBG] osd.1 reported immediately failed by osd.0 2021-03-10T13:51:20.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:20 gibba015 bash[30343]: cluster 2021-03-10T13:51:19.852197+0000 mon.a (mon.0) 196 : cluster [DBG] osd.1 reported immediately failed by osd.4 2021-03-10T13:51:20.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:20 gibba015 bash[30343]: cluster 2021-03-10T13:51:19.852607+0000 mon.a (mon.0) 197 : cluster [DBG] osd.1 reported immediately failed by osd.6 2021-03-10T13:51:20.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:20 gibba015 bash[30343]: cluster 2021-03-10T13:51:19.852998+0000 mon.a (mon.0) 198 : cluster [DBG] osd.1 reported immediately failed by osd.4 2021-03-10T13:51:20.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:20 gibba015 bash[30343]: cluster 2021-03-10T13:51:20.246865+0000 mon.a (mon.0) 199 : cluster [DBG] osd.1 reported immediately failed by osd.3 2021-03-10T13:51:20.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:20 gibba015 bash[30343]: cluster 2021-03-10T13:51:20.247114+0000 mon.a (mon.0) 200 : cluster [DBG] osd.1 reported immediately failed by osd.2 2021-03-10T13:51:20.733 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:20 gibba015 bash[30343]: cluster 2021-03-10T13:51:20.247550+0000 mon.a (mon.0) 201 : cluster [DBG] osd.1 reported immediately failed by osd.3 2021-03-10T13:51:20.733 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:20 gibba015 bash[30343]: cluster 2021-03-10T13:51:20.247740+0000 mon.a (mon.0) 202 : cluster [DBG] osd.1 reported immediately failed by osd.5 2021-03-10T13:51:20.733 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:20 gibba015 bash[30343]: cluster 2021-03-10T13:51:20.248203+0000 mon.a (mon.0) 203 : cluster [DBG] osd.1 reported immediately failed by osd.7 2021-03-10T13:51:20.733 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:20 gibba015 bash[30343]: cluster 2021-03-10T13:51:20.248517+0000 mon.a (mon.0) 204 : cluster [DBG] osd.1 reported immediately failed by osd.0 2021-03-10T13:51:20.733 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:20 gibba015 bash[30343]: cluster 2021-03-10T13:51:20.248962+0000 mon.a (mon.0) 205 : cluster [DBG] osd.1 reported immediately failed by osd.2 2021-03-10T13:51:20.734 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:20 gibba015 bash[30343]: cluster 2021-03-10T13:51:20.249198+0000 mon.a (mon.0) 206 : cluster [DBG] osd.1 reported immediately failed by osd.5 2021-03-10T13:51:20.734 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:20 gibba015 bash[30343]: cluster 2021-03-10T13:51:20.249610+0000 mon.a (mon.0) 207 : cluster [DBG] osd.1 reported immediately failed by osd.7 2021-03-10T13:51:20.734 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:20 gibba015 bash[29377]: cluster 2021-03-10T13:51:20.249950+0000 mon.a (mon.0) 208 : cluster [DBG] osd.1 reported immediately failed by osd.6 2021-03-10T13:51:20.735 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:20 gibba015 bash[29377]: cluster 2021-03-10T13:51:20.250463+0000 mon.a (mon.0) 209 : cluster [DBG] osd.1 reported immediately failed by osd.4 2021-03-10T13:51:20.735 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:20 gibba015 bash[29377]: cluster 2021-03-10T13:51:20.250754+0000 mon.a (mon.0) 210 : cluster [DBG] osd.1 reported immediately failed by osd.4 2021-03-10T13:51:20.735 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:20 gibba015 bash[29377]: cluster 2021-03-10T13:51:20.251260+0000 mon.a (mon.0) 211 : cluster [DBG] osd.1 reported immediately failed by osd.0 2021-03-10T13:51:20.735 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:20 gibba015 bash[29377]: cluster 2021-03-10T13:51:20.251544+0000 mon.a (mon.0) 212 : cluster [DBG] osd.1 reported immediately failed by osd.6 2021-03-10T13:51:20.735 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:20 gibba015 bash[29377]: cluster 2021-03-10T13:51:20.258135+0000 mon.a (mon.0) 213 : cluster [DBG] osd.1 reported immediately failed by osd.3 2021-03-10T13:51:20.736 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:20 gibba015 bash[29377]: cluster 2021-03-10T13:51:20.258849+0000 mon.a (mon.0) 214 : cluster [DBG] osd.1 reported immediately failed by osd.2 2021-03-10T13:51:20.736 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:20 gibba015 bash[29377]: cluster 2021-03-10T13:51:20.259854+0000 mon.a (mon.0) 215 : cluster [DBG] osd.1 reported immediately failed by osd.4 2021-03-10T13:51:20.736 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:20 gibba015 bash[29377]: cluster 2021-03-10T13:51:20.260459+0000 mon.a (mon.0) 216 : cluster [DBG] osd.1 reported immediately failed by osd.6 2021-03-10T13:51:20.736 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:20 gibba015 bash[29377]: cluster 2021-03-10T13:51:20.459241+0000 mon.a (mon.0) 217 : cluster [DBG] osd.1 reported immediately failed by osd.2 2021-03-10T13:51:20.737 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:20 gibba015 bash[30343]: cluster 2021-03-10T13:51:20.249950+0000 mon.a (mon.0) 208 : cluster [DBG] osd.1 reported immediately failed by osd.6 2021-03-10T13:51:20.737 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:20 gibba015 bash[30343]: cluster 2021-03-10T13:51:20.250463+0000 mon.a (mon.0) 209 : cluster [DBG] osd.1 reported immediately failed by osd.4 2021-03-10T13:51:20.737 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:20 gibba015 bash[30343]: cluster 2021-03-10T13:51:20.250754+0000 mon.a (mon.0) 210 : cluster [DBG] osd.1 reported immediately failed by osd.4 2021-03-10T13:51:20.737 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:20 gibba015 bash[30343]: cluster 2021-03-10T13:51:20.251260+0000 mon.a (mon.0) 211 : cluster [DBG] osd.1 reported immediately failed by osd.0 2021-03-10T13:51:20.738 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:20 gibba015 bash[30343]: cluster 2021-03-10T13:51:20.251544+0000 mon.a (mon.0) 212 : cluster [DBG] osd.1 reported immediately failed by osd.6 2021-03-10T13:51:20.738 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:20 gibba015 bash[30343]: cluster 2021-03-10T13:51:20.258135+0000 mon.a (mon.0) 213 : cluster [DBG] osd.1 reported immediately failed by osd.3 2021-03-10T13:51:20.738 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:20 gibba015 bash[30343]: cluster 2021-03-10T13:51:20.258849+0000 mon.a (mon.0) 214 : cluster [DBG] osd.1 reported immediately failed by osd.2 2021-03-10T13:51:20.738 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:20 gibba015 bash[30343]: cluster 2021-03-10T13:51:20.259854+0000 mon.a (mon.0) 215 : cluster [DBG] osd.1 reported immediately failed by osd.4 2021-03-10T13:51:20.738 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:20 gibba015 bash[30343]: cluster 2021-03-10T13:51:20.260459+0000 mon.a (mon.0) 216 : cluster [DBG] osd.1 reported immediately failed by osd.6 2021-03-10T13:51:20.739 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:20 gibba015 bash[30343]: cluster 2021-03-10T13:51:20.459241+0000 mon.a (mon.0) 217 : cluster [DBG] osd.1 reported immediately failed by osd.2 2021-03-10T13:51:20.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:20 gibba045 bash[25517]: cluster 2021-03-10T13:51:18.989193+0000 mgr.gibba045.orlgmj (mgr.34412) 130 : cluster [DBG] pgmap v52: 129 pgs: 16 active+clean+wait, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T13:51:20.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:20 gibba045 bash[25517]: cluster 2021-03-10T13:51:19.847672+0000 mon.a (mon.0) 184 : cluster [DBG] osd.1 reported immediately failed by osd.2 2021-03-10T13:51:20.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:20 gibba045 bash[25517]: cluster 2021-03-10T13:51:19.847765+0000 mon.a (mon.0) 185 : cluster [INF] osd.1 failed (root=default,host=gibba015) (connection refused reported by osd.2) 2021-03-10T13:51:20.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:20 gibba045 bash[25517]: cluster 2021-03-10T13:51:19.848383+0000 mon.a (mon.0) 186 : cluster [DBG] osd.1 reported immediately failed by osd.2 2021-03-10T13:51:20.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:20 gibba045 bash[25517]: cluster 2021-03-10T13:51:19.848737+0000 mon.a (mon.0) 187 : cluster [DBG] osd.1 reported immediately failed by osd.3 2021-03-10T13:51:20.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:20 gibba045 bash[25517]: cluster 2021-03-10T13:51:19.849172+0000 mon.a (mon.0) 188 : cluster [DBG] osd.1 reported immediately failed by osd.5 2021-03-10T13:51:20.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:20 gibba045 bash[25517]: cluster 2021-03-10T13:51:19.849491+0000 mon.a (mon.0) 189 : cluster [DBG] osd.1 reported immediately failed by osd.7 2021-03-10T13:51:20.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:20 gibba045 bash[25517]: cluster 2021-03-10T13:51:19.849983+0000 mon.a (mon.0) 190 : cluster [DBG] osd.1 reported immediately failed by osd.0 2021-03-10T13:51:20.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:20 gibba045 bash[25517]: cluster 2021-03-10T13:51:19.850360+0000 mon.a (mon.0) 191 : cluster [DBG] osd.1 reported immediately failed by osd.3 2021-03-10T13:51:20.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:20 gibba045 bash[25517]: cluster 2021-03-10T13:51:19.850556+0000 mon.a (mon.0) 192 : cluster [DBG] osd.1 reported immediately failed by osd.5 2021-03-10T13:51:20.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:20 gibba045 bash[25517]: cluster 2021-03-10T13:51:19.850985+0000 mon.a (mon.0) 193 : cluster [DBG] osd.1 reported immediately failed by osd.7 2021-03-10T13:51:20.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:20 gibba045 bash[25517]: cluster 2021-03-10T13:51:19.851398+0000 mon.a (mon.0) 194 : cluster [DBG] osd.1 reported immediately failed by osd.6 2021-03-10T13:51:20.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:20 gibba045 bash[25517]: cluster 2021-03-10T13:51:19.851797+0000 mon.a (mon.0) 195 : cluster [DBG] osd.1 reported immediately failed by osd.0 2021-03-10T13:51:20.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:20 gibba045 bash[25517]: cluster 2021-03-10T13:51:19.852197+0000 mon.a (mon.0) 196 : cluster [DBG] osd.1 reported immediately failed by osd.4 2021-03-10T13:51:20.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:20 gibba045 bash[25517]: cluster 2021-03-10T13:51:19.852607+0000 mon.a (mon.0) 197 : cluster [DBG] osd.1 reported immediately failed by osd.6 2021-03-10T13:51:20.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:20 gibba045 bash[25517]: cluster 2021-03-10T13:51:19.852998+0000 mon.a (mon.0) 198 : cluster [DBG] osd.1 reported immediately failed by osd.4 2021-03-10T13:51:20.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:20 gibba045 bash[25517]: cluster 2021-03-10T13:51:20.246865+0000 mon.a (mon.0) 199 : cluster [DBG] osd.1 reported immediately failed by osd.3 2021-03-10T13:51:20.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:20 gibba045 bash[25517]: cluster 2021-03-10T13:51:20.247114+0000 mon.a (mon.0) 200 : cluster [DBG] osd.1 reported immediately failed by osd.2 2021-03-10T13:51:20.812 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:20 gibba045 bash[25517]: cluster 2021-03-10T13:51:20.247550+0000 mon.a (mon.0) 201 : cluster [DBG] osd.1 reported immediately failed by osd.3 2021-03-10T13:51:20.812 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:20 gibba045 bash[25517]: cluster 2021-03-10T13:51:20.247740+0000 mon.a (mon.0) 202 : cluster [DBG] osd.1 reported immediately failed by osd.5 2021-03-10T13:51:20.812 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:20 gibba045 bash[25517]: cluster 2021-03-10T13:51:20.248203+0000 mon.a (mon.0) 203 : cluster [DBG] osd.1 reported immediately failed by osd.7 2021-03-10T13:51:20.812 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:20 gibba045 bash[25517]: cluster 2021-03-10T13:51:20.248517+0000 mon.a (mon.0) 204 : cluster [DBG] osd.1 reported immediately failed by osd.0 2021-03-10T13:51:20.812 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:20 gibba045 bash[25517]: cluster 2021-03-10T13:51:20.248962+0000 mon.a (mon.0) 205 : cluster [DBG] osd.1 reported immediately failed by osd.2 2021-03-10T13:51:20.813 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:20 gibba045 bash[25517]: cluster 2021-03-10T13:51:20.249198+0000 mon.a (mon.0) 206 : cluster [DBG] osd.1 reported immediately failed by osd.5 2021-03-10T13:51:20.813 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:20 gibba045 bash[25517]: cluster 2021-03-10T13:51:20.249610+0000 mon.a (mon.0) 207 : cluster [DBG] osd.1 reported immediately failed by osd.7 2021-03-10T13:51:20.813 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:20 gibba045 bash[25517]: cluster 2021-03-10T13:51:20.249950+0000 mon.a (mon.0) 208 : cluster [DBG] osd.1 reported immediately failed by osd.6 2021-03-10T13:51:20.813 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:20 gibba045 bash[25517]: cluster 2021-03-10T13:51:20.250463+0000 mon.a (mon.0) 209 : cluster [DBG] osd.1 reported immediately failed by osd.4 2021-03-10T13:51:20.813 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:20 gibba045 bash[25517]: cluster 2021-03-10T13:51:20.250754+0000 mon.a (mon.0) 210 : cluster [DBG] osd.1 reported immediately failed by osd.4 2021-03-10T13:51:20.814 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:20 gibba045 bash[25517]: cluster 2021-03-10T13:51:20.251260+0000 mon.a (mon.0) 211 : cluster [DBG] osd.1 reported immediately failed by osd.0 2021-03-10T13:51:20.814 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:20 gibba045 bash[25517]: cluster 2021-03-10T13:51:20.251544+0000 mon.a (mon.0) 212 : cluster [DBG] osd.1 reported immediately failed by osd.6 2021-03-10T13:51:20.814 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:20 gibba045 bash[25517]: cluster 2021-03-10T13:51:20.258135+0000 mon.a (mon.0) 213 : cluster [DBG] osd.1 reported immediately failed by osd.3 2021-03-10T13:51:20.814 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:20 gibba045 bash[25517]: cluster 2021-03-10T13:51:20.258849+0000 mon.a (mon.0) 214 : cluster [DBG] osd.1 reported immediately failed by osd.2 2021-03-10T13:51:20.815 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:20 gibba045 bash[25517]: cluster 2021-03-10T13:51:20.259854+0000 mon.a (mon.0) 215 : cluster [DBG] osd.1 reported immediately failed by osd.4 2021-03-10T13:51:20.815 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:20 gibba045 bash[25517]: cluster 2021-03-10T13:51:20.260459+0000 mon.a (mon.0) 216 : cluster [DBG] osd.1 reported immediately failed by osd.6 2021-03-10T13:51:20.815 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:20 gibba045 bash[25517]: cluster 2021-03-10T13:51:20.459241+0000 mon.a (mon.0) 217 : cluster [DBG] osd.1 reported immediately failed by osd.2 2021-03-10T13:51:21.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:21 gibba015 bash[29377]: cluster 2021-03-10T13:51:20.459932+0000 mon.a (mon.0) 218 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T13:51:21.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:21 gibba015 bash[29377]: cluster 2021-03-10T13:51:20.465401+0000 mon.a (mon.0) 219 : cluster [DBG] osdmap e68: 8 total, 7 up, 8 in 2021-03-10T13:51:21.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:21 gibba015 bash[30343]: cluster 2021-03-10T13:51:20.459932+0000 mon.a (mon.0) 218 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T13:51:21.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:21 gibba015 bash[30343]: cluster 2021-03-10T13:51:20.465401+0000 mon.a (mon.0) 219 : cluster [DBG] osdmap e68: 8 total, 7 up, 8 in 2021-03-10T13:51:21.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:21 gibba045 bash[25517]: cluster 2021-03-10T13:51:20.459932+0000 mon.a (mon.0) 218 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T13:51:21.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:21 gibba045 bash[25517]: cluster 2021-03-10T13:51:20.465401+0000 mon.a (mon.0) 219 : cluster [DBG] osdmap e68: 8 total, 7 up, 8 in 2021-03-10T13:51:22.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:22 gibba015 bash[29377]: cluster 2021-03-10T13:51:20.990109+0000 mgr.gibba045.orlgmj (mgr.34412) 131 : cluster [DBG] pgmap v54: 129 pgs: 18 stale+active+clean, 16 active+clean+wait, 95 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T13:51:22.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:22 gibba015 bash[29377]: cluster 2021-03-10T13:51:21.472950+0000 mon.a (mon.0) 220 : cluster [DBG] osdmap e69: 8 total, 7 up, 8 in 2021-03-10T13:51:22.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:22 gibba015 bash[30343]: cluster 2021-03-10T13:51:20.990109+0000 mgr.gibba045.orlgmj (mgr.34412) 131 : cluster [DBG] pgmap v54: 129 pgs: 18 stale+active+clean, 16 active+clean+wait, 95 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T13:51:22.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:22 gibba015 bash[30343]: cluster 2021-03-10T13:51:21.472950+0000 mon.a (mon.0) 220 : cluster [DBG] osdmap e69: 8 total, 7 up, 8 in 2021-03-10T13:51:22.727 INFO:journalctl@ceph.osd.1.gibba015.stdout:Mar 10 13:51:22 gibba015 systemd[1]: ceph-e4a642d2-81a5-11eb-9080-001a4aab830c@osd.1.service: Succeeded. 2021-03-10T13:51:22.727 INFO:journalctl@ceph.osd.1.gibba015.stdout:Mar 10 13:51:22 gibba015 systemd[1]: Stopped Ceph osd.1 for e4a642d2-81a5-11eb-9080-001a4aab830c. 2021-03-10T13:51:22.727 INFO:journalctl@ceph.osd.1.gibba015.stdout:Mar 10 13:51:22 gibba015 systemd[1]: Started Ceph osd.1 for e4a642d2-81a5-11eb-9080-001a4aab830c. 2021-03-10T13:51:22.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:22 gibba045 bash[25517]: cluster 2021-03-10T13:51:20.990109+0000 mgr.gibba045.orlgmj (mgr.34412) 131 : cluster [DBG] pgmap v54: 129 pgs: 18 stale+active+clean, 16 active+clean+wait, 95 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T13:51:22.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:22 gibba045 bash[25517]: cluster 2021-03-10T13:51:21.472950+0000 mon.a (mon.0) 220 : cluster [DBG] osdmap e69: 8 total, 7 up, 8 in 2021-03-10T13:51:23.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:23 gibba045 bash[25517]: audit 2021-03-10T13:51:22.516336+0000 mon.a (mon.0) 221 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:51:23.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:23 gibba045 bash[25517]: audit 2021-03-10T13:51:22.517514+0000 mon.c (mon.1) 72 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:51:23.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:23 gibba045 bash[25517]: audit 2021-03-10T13:51:22.519823+0000 mon.c (mon.1) 73 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:51:23.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:23 gibba045 bash[25517]: cephadm 2021-03-10T13:51:22.520901+0000 mgr.gibba045.orlgmj (mgr.34412) 132 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T13:51:23.912 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:23 gibba015 bash[29377]: audit 2021-03-10T13:51:22.516336+0000 mon.a (mon.0) 221 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:51:23.913 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:23 gibba015 bash[29377]: audit 2021-03-10T13:51:22.517514+0000 mon.c (mon.1) 72 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:51:23.913 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:23 gibba015 bash[29377]: audit 2021-03-10T13:51:22.519823+0000 mon.c (mon.1) 73 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:51:23.913 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:23 gibba015 bash[29377]: cephadm 2021-03-10T13:51:22.520901+0000 mgr.gibba045.orlgmj (mgr.34412) 132 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T13:51:23.914 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:23 gibba015 bash[30343]: audit 2021-03-10T13:51:22.516336+0000 mon.a (mon.0) 221 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:51:23.914 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:23 gibba015 bash[30343]: audit 2021-03-10T13:51:22.517514+0000 mon.c (mon.1) 72 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:51:23.914 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:23 gibba015 bash[30343]: audit 2021-03-10T13:51:22.519823+0000 mon.c (mon.1) 73 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:51:23.914 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:23 gibba015 bash[30343]: cephadm 2021-03-10T13:51:22.520901+0000 mgr.gibba045.orlgmj (mgr.34412) 132 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T13:51:24.222 INFO:journalctl@ceph.osd.1.gibba015.stdout:Mar 10 13:51:23 gibba015 bash[33130]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2021-03-10T13:51:24.222 INFO:journalctl@ceph.osd.1.gibba015.stdout:Mar 10 13:51:23 gibba015 bash[33130]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-1 --no-mon-config 2021-03-10T13:51:24.223 INFO:journalctl@ceph.osd.1.gibba015.stdout:Mar 10 13:51:23 gibba015 bash[33130]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-1/block 2021-03-10T13:51:24.223 INFO:journalctl@ceph.osd.1.gibba015.stdout:Mar 10 13:51:23 gibba015 bash[33130]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-1/block 2021-03-10T13:51:24.223 INFO:journalctl@ceph.osd.1.gibba015.stdout:Mar 10 13:51:23 gibba015 bash[33130]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2021-03-10T13:51:24.223 INFO:journalctl@ceph.osd.1.gibba015.stdout:Mar 10 13:51:23 gibba015 bash[33130]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2021-03-10T13:51:24.223 INFO:journalctl@ceph.osd.1.gibba015.stdout:Mar 10 13:51:23 gibba015 bash[33130]: --> ceph-volume lvm activate successful for osd ID: 1 2021-03-10T13:51:24.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:24 gibba045 bash[25517]: cluster 2021-03-10T13:51:22.991302+0000 mgr.gibba045.orlgmj (mgr.34412) 133 : cluster [DBG] pgmap v56: 129 pgs: 18 stale+active+clean, 16 active+clean+wait, 95 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T13:51:24.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:24 gibba015 bash[29377]: cluster 2021-03-10T13:51:22.991302+0000 mgr.gibba045.orlgmj (mgr.34412) 133 : cluster [DBG] pgmap v56: 129 pgs: 18 stale+active+clean, 16 active+clean+wait, 95 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T13:51:24.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:24 gibba015 bash[30343]: cluster 2021-03-10T13:51:22.991302+0000 mgr.gibba045.orlgmj (mgr.34412) 133 : cluster [DBG] pgmap v56: 129 pgs: 18 stale+active+clean, 16 active+clean+wait, 95 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T13:51:25.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:25 gibba015 bash[30343]: cluster 2021-03-10T13:51:25.532352+0000 mon.a (mon.0) 222 : cluster [WRN] Health check failed: Degraded data redundancy: 28/192 objects degraded (14.583%), 21 pgs degraded (PG_DEGRADED) 2021-03-10T13:51:25.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:25 gibba015 bash[29377]: cluster 2021-03-10T13:51:25.532352+0000 mon.a (mon.0) 222 : cluster [WRN] Health check failed: Degraded data redundancy: 28/192 objects degraded (14.583%), 21 pgs degraded (PG_DEGRADED) 2021-03-10T13:51:25.972 INFO:journalctl@ceph.osd.1.gibba015.stdout:Mar 10 13:51:25 gibba015 bash[33259]: debug 2021-03-10T13:51:25.652+0000 7fac70ed1700 1 -- 172.21.2.115:0/2459365515 <== mon.1 v2:172.21.2.115:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55ef095944e0 con 0x55ef09611400 2021-03-10T13:51:26.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:25 gibba045 bash[25517]: cluster 2021-03-10T13:51:25.532352+0000 mon.a (mon.0) 222 : cluster [WRN] Health check failed: Degraded data redundancy: 28/192 objects degraded (14.583%), 21 pgs degraded (PG_DEGRADED) 2021-03-10T13:51:26.472 INFO:journalctl@ceph.osd.1.gibba015.stdout:Mar 10 13:51:25 gibba015 bash[33259]: debug 2021-03-10T13:51:25.988+0000 7fac78966080 -1 Falling back to public interface 2021-03-10T13:51:26.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:26 gibba045 bash[25517]: cluster 2021-03-10T13:51:24.993912+0000 mgr.gibba045.orlgmj (mgr.34412) 134 : cluster [DBG] pgmap v57: 129 pgs: 21 active+undersized+degraded, 35 active+undersized, 73 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail; 28/192 objects degraded (14.583%) 2021-03-10T13:51:26.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:26 gibba045 bash[25517]: audit 2021-03-10T13:51:26.348987+0000 mon.a (mon.0) 223 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:51:26.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:26 gibba045 bash[25517]: audit 2021-03-10T13:51:26.355456+0000 mon.a (mon.0) 224 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:51:26.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:26 gibba045 bash[25517]: audit 2021-03-10T13:51:26.360675+0000 mon.c (mon.1) 74 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:51:26.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:26 gibba045 bash[25517]: audit 2021-03-10T13:51:26.362760+0000 mon.c (mon.1) 75 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:51:26.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:26 gibba045 bash[25517]: audit 2021-03-10T13:51:26.364391+0000 mon.c (mon.1) 76 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:51:26.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:26 gibba045 bash[25517]: audit 2021-03-10T13:51:26.365668+0000 mon.c (mon.1) 77 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:51:26.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:26 gibba045 bash[25517]: audit 2021-03-10T13:51:26.369163+0000 mon.c (mon.1) 78 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-03-10T13:51:26.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:26 gibba015 bash[29377]: cluster 2021-03-10T13:51:24.993912+0000 mgr.gibba045.orlgmj (mgr.34412) 134 : cluster [DBG] pgmap v57: 129 pgs: 21 active+undersized+degraded, 35 active+undersized, 73 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail; 28/192 objects degraded (14.583%) 2021-03-10T13:51:26.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:26 gibba015 bash[29377]: audit 2021-03-10T13:51:26.348987+0000 mon.a (mon.0) 223 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:51:26.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:26 gibba015 bash[29377]: audit 2021-03-10T13:51:26.355456+0000 mon.a (mon.0) 224 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:51:26.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:26 gibba015 bash[29377]: audit 2021-03-10T13:51:26.360675+0000 mon.c (mon.1) 74 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:51:26.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:26 gibba015 bash[29377]: audit 2021-03-10T13:51:26.362760+0000 mon.c (mon.1) 75 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:51:26.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:26 gibba015 bash[29377]: audit 2021-03-10T13:51:26.364391+0000 mon.c (mon.1) 76 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:51:26.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:26 gibba015 bash[29377]: audit 2021-03-10T13:51:26.365668+0000 mon.c (mon.1) 77 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:51:26.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:26 gibba015 bash[29377]: audit 2021-03-10T13:51:26.369163+0000 mon.c (mon.1) 78 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-03-10T13:51:26.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:26 gibba015 bash[30343]: cluster 2021-03-10T13:51:24.993912+0000 mgr.gibba045.orlgmj (mgr.34412) 134 : cluster [DBG] pgmap v57: 129 pgs: 21 active+undersized+degraded, 35 active+undersized, 73 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail; 28/192 objects degraded (14.583%) 2021-03-10T13:51:26.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:26 gibba015 bash[30343]: audit 2021-03-10T13:51:26.348987+0000 mon.a (mon.0) 223 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:51:26.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:26 gibba015 bash[30343]: audit 2021-03-10T13:51:26.355456+0000 mon.a (mon.0) 224 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:51:26.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:26 gibba015 bash[30343]: audit 2021-03-10T13:51:26.360675+0000 mon.c (mon.1) 74 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:51:26.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:26 gibba015 bash[30343]: audit 2021-03-10T13:51:26.362760+0000 mon.c (mon.1) 75 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:51:26.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:26 gibba015 bash[30343]: audit 2021-03-10T13:51:26.364391+0000 mon.c (mon.1) 76 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:51:26.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:26 gibba015 bash[30343]: audit 2021-03-10T13:51:26.365668+0000 mon.c (mon.1) 77 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:51:26.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:26 gibba015 bash[30343]: audit 2021-03-10T13:51:26.369163+0000 mon.c (mon.1) 78 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-03-10T13:51:27.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:27 gibba015 bash[29377]: cephadm 2021-03-10T13:51:26.360987+0000 mgr.gibba045.orlgmj (mgr.34412) 135 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:51:27.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:27 gibba015 bash[29377]: cephadm 2021-03-10T13:51:26.363349+0000 mgr.gibba045.orlgmj (mgr.34412) 136 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:51:27.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:27 gibba015 bash[29377]: cephadm 2021-03-10T13:51:26.364943+0000 mgr.gibba045.orlgmj (mgr.34412) 137 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:51:27.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:27 gibba015 bash[29377]: cephadm 2021-03-10T13:51:26.364991+0000 mgr.gibba045.orlgmj (mgr.34412) 138 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:51:27.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:27 gibba015 bash[29377]: cephadm 2021-03-10T13:51:26.366428+0000 mgr.gibba045.orlgmj (mgr.34412) 139 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:51:27.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:27 gibba015 bash[29377]: cephadm 2021-03-10T13:51:26.366477+0000 mgr.gibba045.orlgmj (mgr.34412) 140 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:51:27.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:27 gibba015 bash[29377]: cephadm 2021-03-10T13:51:26.367647+0000 mgr.gibba045.orlgmj (mgr.34412) 141 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:51:27.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:27 gibba015 bash[29377]: cephadm 2021-03-10T13:51:26.369641+0000 mgr.gibba045.orlgmj (mgr.34412) 142 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:51:27.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:27 gibba015 bash[29377]: cephadm 2021-03-10T13:51:26.369694+0000 mgr.gibba045.orlgmj (mgr.34412) 143 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:51:27.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:27 gibba015 bash[29377]: audit 2021-03-10T13:51:26.370484+0000 mgr.gibba045.orlgmj (mgr.34412) 144 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-03-10T13:51:27.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:27 gibba015 bash[29377]: cephadm 2021-03-10T13:51:26.371479+0000 mgr.gibba045.orlgmj (mgr.34412) 145 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2021-03-10T13:51:27.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:27 gibba015 bash[30343]: cephadm 2021-03-10T13:51:26.360987+0000 mgr.gibba045.orlgmj (mgr.34412) 135 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:51:27.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:27 gibba015 bash[30343]: cephadm 2021-03-10T13:51:26.363349+0000 mgr.gibba045.orlgmj (mgr.34412) 136 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:51:27.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:27 gibba015 bash[30343]: cephadm 2021-03-10T13:51:26.364943+0000 mgr.gibba045.orlgmj (mgr.34412) 137 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:51:27.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:27 gibba015 bash[30343]: cephadm 2021-03-10T13:51:26.364991+0000 mgr.gibba045.orlgmj (mgr.34412) 138 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:51:27.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:27 gibba015 bash[30343]: cephadm 2021-03-10T13:51:26.366428+0000 mgr.gibba045.orlgmj (mgr.34412) 139 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:51:27.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:27 gibba015 bash[30343]: cephadm 2021-03-10T13:51:26.366477+0000 mgr.gibba045.orlgmj (mgr.34412) 140 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:51:27.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:27 gibba015 bash[30343]: cephadm 2021-03-10T13:51:26.367647+0000 mgr.gibba045.orlgmj (mgr.34412) 141 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:51:27.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:27 gibba015 bash[30343]: cephadm 2021-03-10T13:51:26.369641+0000 mgr.gibba045.orlgmj (mgr.34412) 142 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:51:27.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:27 gibba015 bash[30343]: cephadm 2021-03-10T13:51:26.369694+0000 mgr.gibba045.orlgmj (mgr.34412) 143 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:51:27.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:27 gibba015 bash[30343]: audit 2021-03-10T13:51:26.370484+0000 mgr.gibba045.orlgmj (mgr.34412) 144 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-03-10T13:51:27.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:27 gibba015 bash[30343]: cephadm 2021-03-10T13:51:26.371479+0000 mgr.gibba045.orlgmj (mgr.34412) 145 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2021-03-10T13:51:28.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:27 gibba045 bash[25517]: cephadm 2021-03-10T13:51:26.360987+0000 mgr.gibba045.orlgmj (mgr.34412) 135 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:51:28.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:27 gibba045 bash[25517]: cephadm 2021-03-10T13:51:26.363349+0000 mgr.gibba045.orlgmj (mgr.34412) 136 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:51:28.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:27 gibba045 bash[25517]: cephadm 2021-03-10T13:51:26.364943+0000 mgr.gibba045.orlgmj (mgr.34412) 137 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:51:28.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:27 gibba045 bash[25517]: cephadm 2021-03-10T13:51:26.364991+0000 mgr.gibba045.orlgmj (mgr.34412) 138 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:51:28.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:27 gibba045 bash[25517]: cephadm 2021-03-10T13:51:26.366428+0000 mgr.gibba045.orlgmj (mgr.34412) 139 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:51:28.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:27 gibba045 bash[25517]: cephadm 2021-03-10T13:51:26.366477+0000 mgr.gibba045.orlgmj (mgr.34412) 140 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:51:28.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:27 gibba045 bash[25517]: cephadm 2021-03-10T13:51:26.367647+0000 mgr.gibba045.orlgmj (mgr.34412) 141 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:51:28.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:27 gibba045 bash[25517]: cephadm 2021-03-10T13:51:26.369641+0000 mgr.gibba045.orlgmj (mgr.34412) 142 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:51:28.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:27 gibba045 bash[25517]: cephadm 2021-03-10T13:51:26.369694+0000 mgr.gibba045.orlgmj (mgr.34412) 143 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:51:28.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:27 gibba045 bash[25517]: audit 2021-03-10T13:51:26.370484+0000 mgr.gibba045.orlgmj (mgr.34412) 144 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-03-10T13:51:28.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:27 gibba045 bash[25517]: cephadm 2021-03-10T13:51:26.371479+0000 mgr.gibba045.orlgmj (mgr.34412) 145 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2021-03-10T13:51:28.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:28 gibba015 bash[29377]: cluster 2021-03-10T13:51:26.995355+0000 mgr.gibba045.orlgmj (mgr.34412) 146 : cluster [DBG] pgmap v58: 129 pgs: 21 active+undersized+degraded, 35 active+undersized, 73 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail; 28/192 objects degraded (14.583%) 2021-03-10T13:51:28.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:28 gibba015 bash[30343]: cluster 2021-03-10T13:51:26.995355+0000 mgr.gibba045.orlgmj (mgr.34412) 146 : cluster [DBG] pgmap v58: 129 pgs: 21 active+undersized+degraded, 35 active+undersized, 73 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail; 28/192 objects degraded (14.583%) 2021-03-10T13:51:29.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:28 gibba045 bash[25517]: cluster 2021-03-10T13:51:26.995355+0000 mgr.gibba045.orlgmj (mgr.34412) 146 : cluster [DBG] pgmap v58: 129 pgs: 21 active+undersized+degraded, 35 active+undersized, 73 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail; 28/192 objects degraded (14.583%) 2021-03-10T13:51:29.472 INFO:journalctl@ceph.osd.1.gibba015.stdout:Mar 10 13:51:29 gibba015 bash[33259]: debug 2021-03-10T13:51:29.176+0000 7fac78966080 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: store not yet converted to per-pg omap 2021-03-10T13:51:29.472 INFO:journalctl@ceph.osd.1.gibba015.stdout:Mar 10 13:51:29 gibba015 bash[33259]: debug 2021-03-10T13:51:29.180+0000 7fac6442c700 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #-1:c1a3fc6e:::purged_snaps:0# has omap that is not per-pg or pgmeta 2021-03-10T13:51:29.472 INFO:journalctl@ceph.osd.1.gibba015.stdout:Mar 10 13:51:29 gibba015 bash[33259]: debug 2021-03-10T13:51:29.304+0000 7fac78966080 -1 osd.1 67 log_to_monitors {default=true} 2021-03-10T13:51:29.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:29 gibba015 bash[29377]: audit 2021-03-10T13:51:29.311263+0000 mon.c (mon.1) 79 : audit [INF] from='osd.1 [v2:172.21.2.115:6808/2905260226,v1:172.21.2.115:6809/2905260226]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-03-10T13:51:29.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:29 gibba015 bash[29377]: audit 2021-03-10T13:51:29.311540+0000 mon.a (mon.0) 225 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-03-10T13:51:29.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:29 gibba015 bash[30343]: audit 2021-03-10T13:51:29.311263+0000 mon.c (mon.1) 79 : audit [INF] from='osd.1 [v2:172.21.2.115:6808/2905260226,v1:172.21.2.115:6809/2905260226]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-03-10T13:51:29.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:29 gibba015 bash[30343]: audit 2021-03-10T13:51:29.311540+0000 mon.a (mon.0) 225 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-03-10T13:51:29.973 INFO:journalctl@ceph.osd.1.gibba015.stdout:Mar 10 13:51:29 gibba015 bash[33259]: debug 2021-03-10T13:51:29.636+0000 7fac6a647700 -1 osd.1 67 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T13:51:30.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:29 gibba045 bash[25517]: audit 2021-03-10T13:51:29.311263+0000 mon.c (mon.1) 79 : audit [INF] from='osd.1 [v2:172.21.2.115:6808/2905260226,v1:172.21.2.115:6809/2905260226]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-03-10T13:51:30.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:29 gibba045 bash[25517]: audit 2021-03-10T13:51:29.311540+0000 mon.a (mon.0) 225 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-03-10T13:51:30.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:30 gibba015 bash[29377]: cluster 2021-03-10T13:51:28.997553+0000 mgr.gibba045.orlgmj (mgr.34412) 147 : cluster [DBG] pgmap v59: 129 pgs: 21 active+undersized+degraded, 35 active+undersized, 73 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail; 28/192 objects degraded (14.583%) 2021-03-10T13:51:30.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:30 gibba015 bash[29377]: audit 2021-03-10T13:51:29.631532+0000 mon.a (mon.0) 226 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2021-03-10T13:51:30.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:30 gibba015 bash[29377]: cluster 2021-03-10T13:51:29.631600+0000 mon.a (mon.0) 227 : cluster [DBG] osdmap e70: 8 total, 7 up, 8 in 2021-03-10T13:51:30.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:30 gibba015 bash[29377]: audit 2021-03-10T13:51:29.632440+0000 mon.c (mon.1) 80 : audit [INF] from='osd.1 [v2:172.21.2.115:6808/2905260226,v1:172.21.2.115:6809/2905260226]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0820, "args": ["host=gibba015", "root=default"]}]: dispatch 2021-03-10T13:51:30.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:30 gibba015 bash[29377]: audit 2021-03-10T13:51:29.632762+0000 mon.a (mon.0) 228 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0820, "args": ["host=gibba015", "root=default"]}]: dispatch 2021-03-10T13:51:30.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:30 gibba015 bash[30343]: cluster 2021-03-10T13:51:28.997553+0000 mgr.gibba045.orlgmj (mgr.34412) 147 : cluster [DBG] pgmap v59: 129 pgs: 21 active+undersized+degraded, 35 active+undersized, 73 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail; 28/192 objects degraded (14.583%) 2021-03-10T13:51:30.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:30 gibba015 bash[30343]: audit 2021-03-10T13:51:29.631532+0000 mon.a (mon.0) 226 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2021-03-10T13:51:30.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:30 gibba015 bash[30343]: cluster 2021-03-10T13:51:29.631600+0000 mon.a (mon.0) 227 : cluster [DBG] osdmap e70: 8 total, 7 up, 8 in 2021-03-10T13:51:30.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:30 gibba015 bash[30343]: audit 2021-03-10T13:51:29.632440+0000 mon.c (mon.1) 80 : audit [INF] from='osd.1 [v2:172.21.2.115:6808/2905260226,v1:172.21.2.115:6809/2905260226]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0820, "args": ["host=gibba015", "root=default"]}]: dispatch 2021-03-10T13:51:30.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:30 gibba015 bash[30343]: audit 2021-03-10T13:51:29.632762+0000 mon.a (mon.0) 228 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0820, "args": ["host=gibba015", "root=default"]}]: dispatch 2021-03-10T13:51:31.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:30 gibba045 bash[25517]: cluster 2021-03-10T13:51:28.997553+0000 mgr.gibba045.orlgmj (mgr.34412) 147 : cluster [DBG] pgmap v59: 129 pgs: 21 active+undersized+degraded, 35 active+undersized, 73 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail; 28/192 objects degraded (14.583%) 2021-03-10T13:51:31.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:30 gibba045 bash[25517]: audit 2021-03-10T13:51:29.631532+0000 mon.a (mon.0) 226 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2021-03-10T13:51:31.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:30 gibba045 bash[25517]: cluster 2021-03-10T13:51:29.631600+0000 mon.a (mon.0) 227 : cluster [DBG] osdmap e70: 8 total, 7 up, 8 in 2021-03-10T13:51:31.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:30 gibba045 bash[25517]: audit 2021-03-10T13:51:29.632440+0000 mon.c (mon.1) 80 : audit [INF] from='osd.1 [v2:172.21.2.115:6808/2905260226,v1:172.21.2.115:6809/2905260226]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0820, "args": ["host=gibba015", "root=default"]}]: dispatch 2021-03-10T13:51:31.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:30 gibba045 bash[25517]: audit 2021-03-10T13:51:29.632762+0000 mon.a (mon.0) 228 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0820, "args": ["host=gibba015", "root=default"]}]: dispatch 2021-03-10T13:51:31.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:31 gibba015 bash[29377]: cluster 2021-03-10T13:51:30.630995+0000 mon.a (mon.0) 229 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T13:51:31.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:31 gibba015 bash[29377]: cluster 2021-03-10T13:51:30.641710+0000 mon.a (mon.0) 230 : cluster [INF] osd.1 [v2:172.21.2.115:6808/2905260226,v1:172.21.2.115:6809/2905260226] boot 2021-03-10T13:51:31.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:31 gibba015 bash[29377]: cluster 2021-03-10T13:51:30.641740+0000 mon.a (mon.0) 231 : cluster [DBG] osdmap e71: 8 total, 8 up, 8 in 2021-03-10T13:51:31.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:31 gibba015 bash[29377]: audit 2021-03-10T13:51:30.642832+0000 mon.c (mon.1) 81 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T13:51:31.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:31 gibba015 bash[29377]: cluster 2021-03-10T13:51:31.645650+0000 mon.a (mon.0) 232 : cluster [DBG] osdmap e72: 8 total, 8 up, 8 in 2021-03-10T13:51:31.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:31 gibba015 bash[30343]: cluster 2021-03-10T13:51:30.630995+0000 mon.a (mon.0) 229 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T13:51:31.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:31 gibba015 bash[30343]: cluster 2021-03-10T13:51:30.641710+0000 mon.a (mon.0) 230 : cluster [INF] osd.1 [v2:172.21.2.115:6808/2905260226,v1:172.21.2.115:6809/2905260226] boot 2021-03-10T13:51:31.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:31 gibba015 bash[30343]: cluster 2021-03-10T13:51:30.641740+0000 mon.a (mon.0) 231 : cluster [DBG] osdmap e71: 8 total, 8 up, 8 in 2021-03-10T13:51:31.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:31 gibba015 bash[30343]: audit 2021-03-10T13:51:30.642832+0000 mon.c (mon.1) 81 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T13:51:31.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:31 gibba015 bash[30343]: cluster 2021-03-10T13:51:31.645650+0000 mon.a (mon.0) 232 : cluster [DBG] osdmap e72: 8 total, 8 up, 8 in 2021-03-10T13:51:32.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:31 gibba045 bash[25517]: cluster 2021-03-10T13:51:30.630995+0000 mon.a (mon.0) 229 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T13:51:32.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:31 gibba045 bash[25517]: cluster 2021-03-10T13:51:30.641710+0000 mon.a (mon.0) 230 : cluster [INF] osd.1 [v2:172.21.2.115:6808/2905260226,v1:172.21.2.115:6809/2905260226] boot 2021-03-10T13:51:32.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:31 gibba045 bash[25517]: cluster 2021-03-10T13:51:30.641740+0000 mon.a (mon.0) 231 : cluster [DBG] osdmap e71: 8 total, 8 up, 8 in 2021-03-10T13:51:32.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:31 gibba045 bash[25517]: audit 2021-03-10T13:51:30.642832+0000 mon.c (mon.1) 81 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T13:51:32.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:31 gibba045 bash[25517]: cluster 2021-03-10T13:51:31.645650+0000 mon.a (mon.0) 232 : cluster [DBG] osdmap e72: 8 total, 8 up, 8 in 2021-03-10T13:51:32.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:32 gibba015 bash[29377]: cluster 2021-03-10T13:51:30.998999+0000 mgr.gibba045.orlgmj (mgr.34412) 148 : cluster [DBG] pgmap v62: 129 pgs: 21 active+undersized+degraded, 35 active+undersized, 73 active+clean; 7.0 KiB data, 16 MiB used, 666 GiB / 672 GiB avail; 28/192 objects degraded (14.583%) 2021-03-10T13:51:32.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:32 gibba015 bash[30343]: cluster 2021-03-10T13:51:30.998999+0000 mgr.gibba045.orlgmj (mgr.34412) 148 : cluster [DBG] pgmap v62: 129 pgs: 21 active+undersized+degraded, 35 active+undersized, 73 active+clean; 7.0 KiB data, 16 MiB used, 666 GiB / 672 GiB avail; 28/192 objects degraded (14.583%) 2021-03-10T13:51:33.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:32 gibba045 bash[25517]: cluster 2021-03-10T13:51:30.998999+0000 mgr.gibba045.orlgmj (mgr.34412) 148 : cluster [DBG] pgmap v62: 129 pgs: 21 active+undersized+degraded, 35 active+undersized, 73 active+clean; 7.0 KiB data, 16 MiB used, 666 GiB / 672 GiB avail; 28/192 objects degraded (14.583%) 2021-03-10T13:51:34.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:34 gibba015 bash[29377]: cluster 2021-03-10T13:51:33.000503+0000 mgr.gibba045.orlgmj (mgr.34412) 149 : cluster [DBG] pgmap v64: 129 pgs: 21 active+undersized+degraded, 35 active+undersized, 73 active+clean; 7.0 KiB data, 16 MiB used, 666 GiB / 672 GiB avail; 28/192 objects degraded (14.583%) 2021-03-10T13:51:34.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:34 gibba015 bash[30343]: cluster 2021-03-10T13:51:33.000503+0000 mgr.gibba045.orlgmj (mgr.34412) 149 : cluster [DBG] pgmap v64: 129 pgs: 21 active+undersized+degraded, 35 active+undersized, 73 active+clean; 7.0 KiB data, 16 MiB used, 666 GiB / 672 GiB avail; 28/192 objects degraded (14.583%) 2021-03-10T13:51:35.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:34 gibba045 bash[25517]: cluster 2021-03-10T13:51:33.000503+0000 mgr.gibba045.orlgmj (mgr.34412) 149 : cluster [DBG] pgmap v64: 129 pgs: 21 active+undersized+degraded, 35 active+undersized, 73 active+clean; 7.0 KiB data, 16 MiB used, 666 GiB / 672 GiB avail; 28/192 objects degraded (14.583%) 2021-03-10T13:51:36.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:35 gibba045 bash[25517]: cluster 2021-03-10T13:51:35.666065+0000 mon.a (mon.0) 233 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 28/192 objects degraded (14.583%), 21 pgs degraded) 2021-03-10T13:51:36.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:35 gibba015 bash[29377]: cluster 2021-03-10T13:51:35.666065+0000 mon.a (mon.0) 233 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 28/192 objects degraded (14.583%), 21 pgs degraded) 2021-03-10T13:51:36.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:35 gibba015 bash[30343]: cluster 2021-03-10T13:51:35.666065+0000 mon.a (mon.0) 233 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 28/192 objects degraded (14.583%), 21 pgs degraded) 2021-03-10T13:51:37.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:36 gibba045 bash[25517]: cluster 2021-03-10T13:51:35.002573+0000 mgr.gibba045.orlgmj (mgr.34412) 150 : cluster [DBG] pgmap v65: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T13:51:37.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:36 gibba015 bash[29377]: cluster 2021-03-10T13:51:35.002573+0000 mgr.gibba045.orlgmj (mgr.34412) 150 : cluster [DBG] pgmap v65: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T13:51:37.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:36 gibba015 bash[30343]: cluster 2021-03-10T13:51:35.002573+0000 mgr.gibba045.orlgmj (mgr.34412) 150 : cluster [DBG] pgmap v65: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T13:51:38.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:38 gibba045 bash[25517]: cluster 2021-03-10T13:51:37.003715+0000 mgr.gibba045.orlgmj (mgr.34412) 151 : cluster [DBG] pgmap v66: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T13:51:38.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:38 gibba045 bash[25517]: audit 2021-03-10T13:51:37.481636+0000 mon.a (mon.0) 234 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:51:38.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:38 gibba015 bash[29377]: cluster 2021-03-10T13:51:37.003715+0000 mgr.gibba045.orlgmj (mgr.34412) 151 : cluster [DBG] pgmap v66: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T13:51:38.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:38 gibba015 bash[29377]: audit 2021-03-10T13:51:37.481636+0000 mon.a (mon.0) 234 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:51:38.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:38 gibba015 bash[30343]: cluster 2021-03-10T13:51:37.003715+0000 mgr.gibba045.orlgmj (mgr.34412) 151 : cluster [DBG] pgmap v66: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T13:51:38.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:38 gibba015 bash[30343]: audit 2021-03-10T13:51:37.481636+0000 mon.a (mon.0) 234 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:51:40.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:40 gibba045 bash[25517]: cluster 2021-03-10T13:51:39.005547+0000 mgr.gibba045.orlgmj (mgr.34412) 152 : cluster [DBG] pgmap v67: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T13:51:40.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:40 gibba015 bash[29377]: cluster 2021-03-10T13:51:39.005547+0000 mgr.gibba045.orlgmj (mgr.34412) 152 : cluster [DBG] pgmap v67: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T13:51:40.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:40 gibba015 bash[30343]: cluster 2021-03-10T13:51:39.005547+0000 mgr.gibba045.orlgmj (mgr.34412) 152 : cluster [DBG] pgmap v67: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T13:51:41.247 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T13:51:41.475 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T13:51:41.475 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2m) 15s ago 7m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T13:51:41.475 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (7m) 78s ago 7m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T13:51:41.475 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2m) 78s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T13:51:41.476 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3m) 78s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T13:51:41.476 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2m) 15s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T13:51:41.476 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (116s) 15s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T13:51:41.476 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (88s) 78s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T13:51:41.476 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (99s) 15s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T13:51:41.477 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (7m) 15s ago 7m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T13:51:41.477 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (7m) 78s ago 7m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T13:51:41.477 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (43s) 15s ago 10m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T13:51:41.477 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (16s) 15s ago 10m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T13:51:41.478 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (10m) 15s ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b90f9ada390a 2021-03-10T13:51:41.478 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (9m) 15s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 a77eccf371e5 2021-03-10T13:51:41.478 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (9m) 78s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 9b9c84c84955 2021-03-10T13:51:41.478 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (8m) 78s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 662e73261675 2021-03-10T13:51:41.478 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (8m) 78s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 338d252f22e3 2021-03-10T13:51:41.479 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (8m) 78s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 784edc0668a4 2021-03-10T13:51:41.479 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (7m) 78s ago 7m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T13:51:41.479 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 78s ago 5m docker.io/ceph/ceph:v15.2.0 2021-03-10T13:51:41.733 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T13:51:41.733 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T13:51:41.733 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:51:41.733 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T13:51:41.734 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T13:51:41.734 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:51:41.734 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T13:51:41.734 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T13:51:41.735 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 6, 2021-03-10T13:51:41.735 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 2 2021-03-10T13:51:41.735 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T13:51:41.735 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T13:51:41.736 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T13:51:41.736 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 6, 2021-03-10T13:51:41.736 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T13:51:41.736 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T13:51:41.736 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T13:51:42.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:42 gibba015 bash[29377]: cluster 2021-03-10T13:51:41.006639+0000 mgr.gibba045.orlgmj (mgr.34412) 153 : cluster [DBG] pgmap v68: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T13:51:42.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:42 gibba015 bash[29377]: audit 2021-03-10T13:51:41.237476+0000 mgr.gibba045.orlgmj (mgr.34412) 154 : audit [DBG] from='client.44181 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:51:42.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:42 gibba015 bash[29377]: audit 2021-03-10T13:51:41.383968+0000 mon.c (mon.1) 82 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-03-10T13:51:42.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:42 gibba015 bash[29377]: audit 2021-03-10T13:51:41.385594+0000 mgr.gibba045.orlgmj (mgr.34412) 155 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-03-10T13:51:42.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:42 gibba015 bash[29377]: cephadm 2021-03-10T13:51:41.387301+0000 mgr.gibba045.orlgmj (mgr.34412) 156 : cephadm [INF] Upgrade: osd.2 is safe to restart 2021-03-10T13:51:42.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:42 gibba015 bash[29377]: audit 2021-03-10T13:51:41.462792+0000 mgr.gibba045.orlgmj (mgr.34412) 157 : audit [DBG] from='client.54175 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:51:42.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:42 gibba015 bash[29377]: audit 2021-03-10T13:51:41.731079+0000 mon.a (mon.0) 235 : audit [DBG] from='client.? 172.21.2.115:0/3463376408' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:51:42.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:42 gibba015 bash[30343]: cluster 2021-03-10T13:51:41.006639+0000 mgr.gibba045.orlgmj (mgr.34412) 153 : cluster [DBG] pgmap v68: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T13:51:42.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:42 gibba015 bash[30343]: audit 2021-03-10T13:51:41.237476+0000 mgr.gibba045.orlgmj (mgr.34412) 154 : audit [DBG] from='client.44181 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:51:42.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:42 gibba015 bash[30343]: audit 2021-03-10T13:51:41.383968+0000 mon.c (mon.1) 82 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-03-10T13:51:42.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:42 gibba015 bash[30343]: audit 2021-03-10T13:51:41.385594+0000 mgr.gibba045.orlgmj (mgr.34412) 155 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-03-10T13:51:42.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:42 gibba015 bash[30343]: cephadm 2021-03-10T13:51:41.387301+0000 mgr.gibba045.orlgmj (mgr.34412) 156 : cephadm [INF] Upgrade: osd.2 is safe to restart 2021-03-10T13:51:42.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:42 gibba015 bash[30343]: audit 2021-03-10T13:51:41.462792+0000 mgr.gibba045.orlgmj (mgr.34412) 157 : audit [DBG] from='client.54175 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:51:42.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:42 gibba015 bash[30343]: audit 2021-03-10T13:51:41.731079+0000 mon.a (mon.0) 235 : audit [DBG] from='client.? 172.21.2.115:0/3463376408' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:51:42.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:42 gibba045 bash[25517]: cluster 2021-03-10T13:51:41.006639+0000 mgr.gibba045.orlgmj (mgr.34412) 153 : cluster [DBG] pgmap v68: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T13:51:42.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:42 gibba045 bash[25517]: audit 2021-03-10T13:51:41.237476+0000 mgr.gibba045.orlgmj (mgr.34412) 154 : audit [DBG] from='client.44181 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:51:42.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:42 gibba045 bash[25517]: audit 2021-03-10T13:51:41.383968+0000 mon.c (mon.1) 82 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-03-10T13:51:42.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:42 gibba045 bash[25517]: audit 2021-03-10T13:51:41.385594+0000 mgr.gibba045.orlgmj (mgr.34412) 155 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-03-10T13:51:42.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:42 gibba045 bash[25517]: cephadm 2021-03-10T13:51:41.387301+0000 mgr.gibba045.orlgmj (mgr.34412) 156 : cephadm [INF] Upgrade: osd.2 is safe to restart 2021-03-10T13:51:42.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:42 gibba045 bash[25517]: audit 2021-03-10T13:51:41.462792+0000 mgr.gibba045.orlgmj (mgr.34412) 157 : audit [DBG] from='client.54175 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:51:42.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:42 gibba045 bash[25517]: audit 2021-03-10T13:51:41.731079+0000 mon.a (mon.0) 235 : audit [DBG] from='client.? 172.21.2.115:0/3463376408' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:51:44.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:44 gibba015 bash[29377]: cluster 2021-03-10T13:51:43.007818+0000 mgr.gibba045.orlgmj (mgr.34412) 158 : cluster [DBG] pgmap v69: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T13:51:44.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:44 gibba015 bash[29377]: cephadm 2021-03-10T13:51:43.384779+0000 mgr.gibba045.orlgmj (mgr.34412) 159 : cephadm [INF] Upgrade: Updating osd.2 2021-03-10T13:51:44.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:44 gibba015 bash[29377]: audit 2021-03-10T13:51:43.389123+0000 mon.a (mon.0) 236 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:51:44.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:44 gibba015 bash[29377]: audit 2021-03-10T13:51:43.394353+0000 mon.c (mon.1) 83 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd.2","key": "container_image"}]: dispatch 2021-03-10T13:51:44.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:44 gibba015 bash[29377]: cephadm 2021-03-10T13:51:43.395045+0000 mgr.gibba045.orlgmj (mgr.34412) 160 : cephadm [INF] Deploying daemon osd.2 on gibba015 2021-03-10T13:51:44.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:44 gibba015 bash[30343]: cluster 2021-03-10T13:51:43.007818+0000 mgr.gibba045.orlgmj (mgr.34412) 158 : cluster [DBG] pgmap v69: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T13:51:44.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:44 gibba015 bash[30343]: cephadm 2021-03-10T13:51:43.384779+0000 mgr.gibba045.orlgmj (mgr.34412) 159 : cephadm [INF] Upgrade: Updating osd.2 2021-03-10T13:51:44.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:44 gibba015 bash[30343]: audit 2021-03-10T13:51:43.389123+0000 mon.a (mon.0) 236 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:51:44.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:44 gibba015 bash[30343]: audit 2021-03-10T13:51:43.394353+0000 mon.c (mon.1) 83 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd.2","key": "container_image"}]: dispatch 2021-03-10T13:51:44.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:44 gibba015 bash[30343]: cephadm 2021-03-10T13:51:43.395045+0000 mgr.gibba045.orlgmj (mgr.34412) 160 : cephadm [INF] Deploying daemon osd.2 on gibba015 2021-03-10T13:51:44.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:44 gibba045 bash[25517]: cluster 2021-03-10T13:51:43.007818+0000 mgr.gibba045.orlgmj (mgr.34412) 158 : cluster [DBG] pgmap v69: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T13:51:44.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:44 gibba045 bash[25517]: cephadm 2021-03-10T13:51:43.384779+0000 mgr.gibba045.orlgmj (mgr.34412) 159 : cephadm [INF] Upgrade: Updating osd.2 2021-03-10T13:51:44.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:44 gibba045 bash[25517]: audit 2021-03-10T13:51:43.389123+0000 mon.a (mon.0) 236 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:51:44.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:44 gibba045 bash[25517]: audit 2021-03-10T13:51:43.394353+0000 mon.c (mon.1) 83 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd.2","key": "container_image"}]: dispatch 2021-03-10T13:51:44.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:44 gibba045 bash[25517]: cephadm 2021-03-10T13:51:43.395045+0000 mgr.gibba045.orlgmj (mgr.34412) 160 : cephadm [INF] Deploying daemon osd.2 on gibba015 2021-03-10T13:51:45.589 INFO:journalctl@ceph.osd.2.gibba015.stdout:Mar 10 13:51:45 gibba015 systemd[1]: Stopping Ceph osd.2 for e4a642d2-81a5-11eb-9080-001a4aab830c... 2021-03-10T13:51:45.589 INFO:journalctl@ceph.osd.2.gibba015.stdout:Mar 10 13:51:45 gibba015 bash[17829]: debug 2021-03-10T13:51:45.436+0000 7f44f0981700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2021-03-10T13:51:45.589 INFO:journalctl@ceph.osd.2.gibba015.stdout:Mar 10 13:51:45 gibba015 bash[17829]: debug 2021-03-10T13:51:45.436+0000 7f44f0981700 -1 osd.2 72 *** Got signal Terminated *** 2021-03-10T13:51:45.589 INFO:journalctl@ceph.osd.2.gibba015.stdout:Mar 10 13:51:45 gibba015 bash[17829]: debug 2021-03-10T13:51:45.436+0000 7f44f0981700 -1 osd.2 72 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-03-10T13:51:46.472 INFO:journalctl@ceph.osd.2.gibba015.stdout:Mar 10 13:51:46 gibba015 docker[34165]: ceph-e4a642d2-81a5-11eb-9080-001a4aab830c-osd.2 2021-03-10T13:51:46.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:46 gibba015 bash[29377]: cluster 2021-03-10T13:51:45.009943+0000 mgr.gibba045.orlgmj (mgr.34412) 161 : cluster [DBG] pgmap v70: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T13:51:46.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:46 gibba015 bash[29377]: cluster 2021-03-10T13:51:45.597992+0000 mon.a (mon.0) 237 : cluster [DBG] osd.2 reported immediately failed by osd.3 2021-03-10T13:51:46.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:46 gibba015 bash[29377]: cluster 2021-03-10T13:51:45.598032+0000 mon.a (mon.0) 238 : cluster [INF] osd.2 failed (root=default,host=gibba015) (connection refused reported by osd.3) 2021-03-10T13:51:46.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:46 gibba015 bash[29377]: cluster 2021-03-10T13:51:45.601876+0000 mon.a (mon.0) 239 : cluster [DBG] osd.2 reported immediately failed by osd.0 2021-03-10T13:51:46.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:46 gibba015 bash[29377]: cluster 2021-03-10T13:51:45.730461+0000 mon.a (mon.0) 240 : cluster [DBG] osd.2 reported immediately failed by osd.3 2021-03-10T13:51:46.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:46 gibba015 bash[29377]: cluster 2021-03-10T13:51:45.732250+0000 mon.a (mon.0) 241 : cluster [DBG] osd.2 reported immediately failed by osd.3 2021-03-10T13:51:46.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:46 gibba015 bash[29377]: cluster 2021-03-10T13:51:45.733286+0000 mon.a (mon.0) 242 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-03-10T13:51:46.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:46 gibba015 bash[29377]: cluster 2021-03-10T13:51:45.733843+0000 mon.a (mon.0) 243 : cluster [DBG] osd.2 reported immediately failed by osd.1 2021-03-10T13:51:46.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:46 gibba015 bash[29377]: cluster 2021-03-10T13:51:45.734763+0000 mon.a (mon.0) 244 : cluster [DBG] osd.2 reported immediately failed by osd.0 2021-03-10T13:51:46.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:46 gibba015 bash[29377]: cluster 2021-03-10T13:51:45.735068+0000 mon.a (mon.0) 245 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-03-10T13:51:46.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:46 gibba015 bash[29377]: cluster 2021-03-10T13:51:45.735756+0000 mon.a (mon.0) 246 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-03-10T13:51:46.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:46 gibba015 bash[29377]: cluster 2021-03-10T13:51:45.736212+0000 mon.a (mon.0) 247 : cluster [DBG] osd.2 reported immediately failed by osd.1 2021-03-10T13:51:46.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:46 gibba015 bash[29377]: cluster 2021-03-10T13:51:45.736898+0000 mon.a (mon.0) 248 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-03-10T13:51:46.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:46 gibba015 bash[29377]: cluster 2021-03-10T13:51:45.737400+0000 mon.a (mon.0) 249 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T13:51:46.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:46 gibba015 bash[29377]: cluster 2021-03-10T13:51:45.738249+0000 mon.a (mon.0) 250 : cluster [DBG] osd.2 reported immediately failed by osd.6 2021-03-10T13:51:46.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:46 gibba015 bash[29377]: cluster 2021-03-10T13:51:45.738707+0000 mon.a (mon.0) 251 : cluster [DBG] osd.2 reported immediately failed by osd.0 2021-03-10T13:51:46.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:46 gibba015 bash[29377]: cluster 2021-03-10T13:51:45.739675+0000 mon.a (mon.0) 252 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T13:51:46.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:46 gibba015 bash[29377]: cluster 2021-03-10T13:51:45.740127+0000 mon.a (mon.0) 253 : cluster [DBG] osd.2 reported immediately failed by osd.6 2021-03-10T13:51:46.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:46 gibba015 bash[29377]: cluster 2021-03-10T13:51:45.800055+0000 mon.a (mon.0) 254 : cluster [DBG] osd.2 reported immediately failed by osd.3 2021-03-10T13:51:46.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:46 gibba015 bash[29377]: cluster 2021-03-10T13:51:45.807352+0000 mon.a (mon.0) 255 : cluster [DBG] osd.2 reported immediately failed by osd.0 2021-03-10T13:51:46.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:46 gibba015 bash[29377]: cluster 2021-03-10T13:51:46.130627+0000 mon.a (mon.0) 256 : cluster [DBG] osd.2 reported immediately failed by osd.3 2021-03-10T13:51:46.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:46 gibba015 bash[29377]: cluster 2021-03-10T13:51:46.130968+0000 mon.a (mon.0) 257 : cluster [DBG] osd.2 reported immediately failed by osd.3 2021-03-10T13:51:46.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:46 gibba015 bash[29377]: cluster 2021-03-10T13:51:46.131925+0000 mon.a (mon.0) 258 : cluster [DBG] osd.2 reported immediately failed by osd.0 2021-03-10T13:51:46.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:46 gibba015 bash[29377]: cluster 2021-03-10T13:51:46.133476+0000 mon.a (mon.0) 259 : cluster [DBG] osd.2 reported immediately failed by osd.0 2021-03-10T13:51:46.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:46 gibba015 bash[29377]: cluster 2021-03-10T13:51:46.133936+0000 mon.a (mon.0) 260 : cluster [DBG] osd.2 reported immediately failed by osd.1 2021-03-10T13:51:46.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:46 gibba015 bash[30343]: cluster 2021-03-10T13:51:45.009943+0000 mgr.gibba045.orlgmj (mgr.34412) 161 : cluster [DBG] pgmap v70: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T13:51:46.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:46 gibba015 bash[30343]: cluster 2021-03-10T13:51:45.597992+0000 mon.a (mon.0) 237 : cluster [DBG] osd.2 reported immediately failed by osd.3 2021-03-10T13:51:46.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:46 gibba015 bash[30343]: cluster 2021-03-10T13:51:45.598032+0000 mon.a (mon.0) 238 : cluster [INF] osd.2 failed (root=default,host=gibba015) (connection refused reported by osd.3) 2021-03-10T13:51:46.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:46 gibba015 bash[30343]: cluster 2021-03-10T13:51:45.601876+0000 mon.a (mon.0) 239 : cluster [DBG] osd.2 reported immediately failed by osd.0 2021-03-10T13:51:46.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:46 gibba015 bash[30343]: cluster 2021-03-10T13:51:45.730461+0000 mon.a (mon.0) 240 : cluster [DBG] osd.2 reported immediately failed by osd.3 2021-03-10T13:51:46.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:46 gibba015 bash[30343]: cluster 2021-03-10T13:51:45.732250+0000 mon.a (mon.0) 241 : cluster [DBG] osd.2 reported immediately failed by osd.3 2021-03-10T13:51:46.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:46 gibba015 bash[30343]: cluster 2021-03-10T13:51:45.733286+0000 mon.a (mon.0) 242 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-03-10T13:51:46.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:46 gibba015 bash[30343]: cluster 2021-03-10T13:51:45.733843+0000 mon.a (mon.0) 243 : cluster [DBG] osd.2 reported immediately failed by osd.1 2021-03-10T13:51:46.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:46 gibba015 bash[30343]: cluster 2021-03-10T13:51:45.734763+0000 mon.a (mon.0) 244 : cluster [DBG] osd.2 reported immediately failed by osd.0 2021-03-10T13:51:46.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:46 gibba015 bash[30343]: cluster 2021-03-10T13:51:45.735068+0000 mon.a (mon.0) 245 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-03-10T13:51:46.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:46 gibba015 bash[30343]: cluster 2021-03-10T13:51:45.735756+0000 mon.a (mon.0) 246 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-03-10T13:51:46.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:46 gibba015 bash[30343]: cluster 2021-03-10T13:51:45.736212+0000 mon.a (mon.0) 247 : cluster [DBG] osd.2 reported immediately failed by osd.1 2021-03-10T13:51:46.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:46 gibba015 bash[30343]: cluster 2021-03-10T13:51:45.736898+0000 mon.a (mon.0) 248 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-03-10T13:51:46.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:46 gibba015 bash[30343]: cluster 2021-03-10T13:51:45.737400+0000 mon.a (mon.0) 249 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T13:51:46.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:46 gibba015 bash[30343]: cluster 2021-03-10T13:51:45.738249+0000 mon.a (mon.0) 250 : cluster [DBG] osd.2 reported immediately failed by osd.6 2021-03-10T13:51:46.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:46 gibba015 bash[30343]: cluster 2021-03-10T13:51:45.738707+0000 mon.a (mon.0) 251 : cluster [DBG] osd.2 reported immediately failed by osd.0 2021-03-10T13:51:46.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:46 gibba015 bash[30343]: cluster 2021-03-10T13:51:45.739675+0000 mon.a (mon.0) 252 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T13:51:46.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:46 gibba015 bash[30343]: cluster 2021-03-10T13:51:45.740127+0000 mon.a (mon.0) 253 : cluster [DBG] osd.2 reported immediately failed by osd.6 2021-03-10T13:51:46.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:46 gibba015 bash[30343]: cluster 2021-03-10T13:51:45.800055+0000 mon.a (mon.0) 254 : cluster [DBG] osd.2 reported immediately failed by osd.3 2021-03-10T13:51:46.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:46 gibba015 bash[30343]: cluster 2021-03-10T13:51:45.807352+0000 mon.a (mon.0) 255 : cluster [DBG] osd.2 reported immediately failed by osd.0 2021-03-10T13:51:46.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:46 gibba015 bash[30343]: cluster 2021-03-10T13:51:46.130627+0000 mon.a (mon.0) 256 : cluster [DBG] osd.2 reported immediately failed by osd.3 2021-03-10T13:51:46.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:46 gibba015 bash[30343]: cluster 2021-03-10T13:51:46.130968+0000 mon.a (mon.0) 257 : cluster [DBG] osd.2 reported immediately failed by osd.3 2021-03-10T13:51:46.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:46 gibba015 bash[30343]: cluster 2021-03-10T13:51:46.131925+0000 mon.a (mon.0) 258 : cluster [DBG] osd.2 reported immediately failed by osd.0 2021-03-10T13:51:46.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:46 gibba015 bash[30343]: cluster 2021-03-10T13:51:46.133476+0000 mon.a (mon.0) 259 : cluster [DBG] osd.2 reported immediately failed by osd.0 2021-03-10T13:51:46.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:46 gibba015 bash[30343]: cluster 2021-03-10T13:51:46.133936+0000 mon.a (mon.0) 260 : cluster [DBG] osd.2 reported immediately failed by osd.1 2021-03-10T13:51:46.484 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:46 gibba015 bash[29377]: cluster 2021-03-10T13:51:46.134624+0000 mon.a (mon.0) 261 : cluster [DBG] osd.2 reported immediately failed by osd.1 2021-03-10T13:51:46.484 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:46 gibba015 bash[29377]: cluster 2021-03-10T13:51:46.134834+0000 mon.a (mon.0) 262 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-03-10T13:51:46.484 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:46 gibba015 bash[29377]: cluster 2021-03-10T13:51:46.135277+0000 mon.a (mon.0) 263 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-03-10T13:51:46.484 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:46 gibba015 bash[29377]: cluster 2021-03-10T13:51:46.135574+0000 mon.a (mon.0) 264 : cluster [DBG] osd.2 reported immediately failed by osd.6 2021-03-10T13:51:46.485 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:46 gibba015 bash[29377]: cluster 2021-03-10T13:51:46.135988+0000 mon.a (mon.0) 265 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-03-10T13:51:46.485 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:46 gibba015 bash[29377]: cluster 2021-03-10T13:51:46.136169+0000 mon.a (mon.0) 266 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-03-10T13:51:46.485 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:46 gibba015 bash[29377]: cluster 2021-03-10T13:51:46.136715+0000 mon.a (mon.0) 267 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T13:51:46.485 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:46 gibba015 bash[29377]: cluster 2021-03-10T13:51:46.137013+0000 mon.a (mon.0) 268 : cluster [DBG] osd.2 reported immediately failed by osd.6 2021-03-10T13:51:46.486 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:46 gibba015 bash[29377]: cluster 2021-03-10T13:51:46.137607+0000 mon.a (mon.0) 269 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T13:51:46.486 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:46 gibba015 bash[29377]: cluster 2021-03-10T13:51:46.197672+0000 mon.a (mon.0) 270 : cluster [DBG] osd.2 reported immediately failed by osd.3 2021-03-10T13:51:46.486 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:46 gibba015 bash[29377]: cluster 2021-03-10T13:51:46.208222+0000 mon.a (mon.0) 271 : cluster [DBG] osd.2 reported immediately failed by osd.0 2021-03-10T13:51:46.486 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:46 gibba015 bash[29377]: cluster 2021-03-10T13:51:46.267406+0000 mon.a (mon.0) 272 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T13:51:46.486 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:46 gibba015 bash[29377]: cluster 2021-03-10T13:51:46.268309+0000 mon.a (mon.0) 273 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-03-10T13:51:46.487 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:46 gibba015 bash[30343]: cluster 2021-03-10T13:51:46.134624+0000 mon.a (mon.0) 261 : cluster [DBG] osd.2 reported immediately failed by osd.1 2021-03-10T13:51:46.487 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:46 gibba015 bash[30343]: cluster 2021-03-10T13:51:46.134834+0000 mon.a (mon.0) 262 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-03-10T13:51:46.487 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:46 gibba015 bash[30343]: cluster 2021-03-10T13:51:46.135277+0000 mon.a (mon.0) 263 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-03-10T13:51:46.487 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:46 gibba015 bash[30343]: cluster 2021-03-10T13:51:46.135574+0000 mon.a (mon.0) 264 : cluster [DBG] osd.2 reported immediately failed by osd.6 2021-03-10T13:51:46.488 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:46 gibba015 bash[30343]: cluster 2021-03-10T13:51:46.135988+0000 mon.a (mon.0) 265 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-03-10T13:51:46.488 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:46 gibba015 bash[30343]: cluster 2021-03-10T13:51:46.136169+0000 mon.a (mon.0) 266 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-03-10T13:51:46.488 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:46 gibba015 bash[30343]: cluster 2021-03-10T13:51:46.136715+0000 mon.a (mon.0) 267 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T13:51:46.488 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:46 gibba015 bash[30343]: cluster 2021-03-10T13:51:46.137013+0000 mon.a (mon.0) 268 : cluster [DBG] osd.2 reported immediately failed by osd.6 2021-03-10T13:51:46.488 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:46 gibba015 bash[30343]: cluster 2021-03-10T13:51:46.137607+0000 mon.a (mon.0) 269 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T13:51:46.489 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:46 gibba015 bash[30343]: cluster 2021-03-10T13:51:46.197672+0000 mon.a (mon.0) 270 : cluster [DBG] osd.2 reported immediately failed by osd.3 2021-03-10T13:51:46.489 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:46 gibba015 bash[30343]: cluster 2021-03-10T13:51:46.208222+0000 mon.a (mon.0) 271 : cluster [DBG] osd.2 reported immediately failed by osd.0 2021-03-10T13:51:46.489 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:46 gibba015 bash[30343]: cluster 2021-03-10T13:51:46.267406+0000 mon.a (mon.0) 272 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T13:51:46.489 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:46 gibba015 bash[30343]: cluster 2021-03-10T13:51:46.268309+0000 mon.a (mon.0) 273 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-03-10T13:51:46.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:46 gibba045 bash[25517]: cluster 2021-03-10T13:51:45.009943+0000 mgr.gibba045.orlgmj (mgr.34412) 161 : cluster [DBG] pgmap v70: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T13:51:46.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:46 gibba045 bash[25517]: cluster 2021-03-10T13:51:45.597992+0000 mon.a (mon.0) 237 : cluster [DBG] osd.2 reported immediately failed by osd.3 2021-03-10T13:51:46.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:46 gibba045 bash[25517]: cluster 2021-03-10T13:51:45.598032+0000 mon.a (mon.0) 238 : cluster [INF] osd.2 failed (root=default,host=gibba015) (connection refused reported by osd.3) 2021-03-10T13:51:46.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:46 gibba045 bash[25517]: cluster 2021-03-10T13:51:45.601876+0000 mon.a (mon.0) 239 : cluster [DBG] osd.2 reported immediately failed by osd.0 2021-03-10T13:51:46.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:46 gibba045 bash[25517]: cluster 2021-03-10T13:51:45.730461+0000 mon.a (mon.0) 240 : cluster [DBG] osd.2 reported immediately failed by osd.3 2021-03-10T13:51:46.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:46 gibba045 bash[25517]: cluster 2021-03-10T13:51:45.732250+0000 mon.a (mon.0) 241 : cluster [DBG] osd.2 reported immediately failed by osd.3 2021-03-10T13:51:46.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:46 gibba045 bash[25517]: cluster 2021-03-10T13:51:45.733286+0000 mon.a (mon.0) 242 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-03-10T13:51:46.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:46 gibba045 bash[25517]: cluster 2021-03-10T13:51:45.733843+0000 mon.a (mon.0) 243 : cluster [DBG] osd.2 reported immediately failed by osd.1 2021-03-10T13:51:46.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:46 gibba045 bash[25517]: cluster 2021-03-10T13:51:45.734763+0000 mon.a (mon.0) 244 : cluster [DBG] osd.2 reported immediately failed by osd.0 2021-03-10T13:51:46.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:46 gibba045 bash[25517]: cluster 2021-03-10T13:51:45.735068+0000 mon.a (mon.0) 245 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-03-10T13:51:46.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:46 gibba045 bash[25517]: cluster 2021-03-10T13:51:45.735756+0000 mon.a (mon.0) 246 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-03-10T13:51:46.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:46 gibba045 bash[25517]: cluster 2021-03-10T13:51:45.736212+0000 mon.a (mon.0) 247 : cluster [DBG] osd.2 reported immediately failed by osd.1 2021-03-10T13:51:46.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:46 gibba045 bash[25517]: cluster 2021-03-10T13:51:45.736898+0000 mon.a (mon.0) 248 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-03-10T13:51:46.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:46 gibba045 bash[25517]: cluster 2021-03-10T13:51:45.737400+0000 mon.a (mon.0) 249 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T13:51:46.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:46 gibba045 bash[25517]: cluster 2021-03-10T13:51:45.738249+0000 mon.a (mon.0) 250 : cluster [DBG] osd.2 reported immediately failed by osd.6 2021-03-10T13:51:46.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:46 gibba045 bash[25517]: cluster 2021-03-10T13:51:45.738707+0000 mon.a (mon.0) 251 : cluster [DBG] osd.2 reported immediately failed by osd.0 2021-03-10T13:51:46.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:46 gibba045 bash[25517]: cluster 2021-03-10T13:51:45.739675+0000 mon.a (mon.0) 252 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T13:51:46.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:46 gibba045 bash[25517]: cluster 2021-03-10T13:51:45.740127+0000 mon.a (mon.0) 253 : cluster [DBG] osd.2 reported immediately failed by osd.6 2021-03-10T13:51:46.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:46 gibba045 bash[25517]: cluster 2021-03-10T13:51:45.800055+0000 mon.a (mon.0) 254 : cluster [DBG] osd.2 reported immediately failed by osd.3 2021-03-10T13:51:46.812 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:46 gibba045 bash[25517]: cluster 2021-03-10T13:51:45.807352+0000 mon.a (mon.0) 255 : cluster [DBG] osd.2 reported immediately failed by osd.0 2021-03-10T13:51:46.812 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:46 gibba045 bash[25517]: cluster 2021-03-10T13:51:46.130627+0000 mon.a (mon.0) 256 : cluster [DBG] osd.2 reported immediately failed by osd.3 2021-03-10T13:51:46.812 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:46 gibba045 bash[25517]: cluster 2021-03-10T13:51:46.130968+0000 mon.a (mon.0) 257 : cluster [DBG] osd.2 reported immediately failed by osd.3 2021-03-10T13:51:46.812 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:46 gibba045 bash[25517]: cluster 2021-03-10T13:51:46.131925+0000 mon.a (mon.0) 258 : cluster [DBG] osd.2 reported immediately failed by osd.0 2021-03-10T13:51:46.812 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:46 gibba045 bash[25517]: cluster 2021-03-10T13:51:46.133476+0000 mon.a (mon.0) 259 : cluster [DBG] osd.2 reported immediately failed by osd.0 2021-03-10T13:51:46.813 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:46 gibba045 bash[25517]: cluster 2021-03-10T13:51:46.133936+0000 mon.a (mon.0) 260 : cluster [DBG] osd.2 reported immediately failed by osd.1 2021-03-10T13:51:46.813 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:46 gibba045 bash[25517]: cluster 2021-03-10T13:51:46.134624+0000 mon.a (mon.0) 261 : cluster [DBG] osd.2 reported immediately failed by osd.1 2021-03-10T13:51:46.813 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:46 gibba045 bash[25517]: cluster 2021-03-10T13:51:46.134834+0000 mon.a (mon.0) 262 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-03-10T13:51:46.813 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:46 gibba045 bash[25517]: cluster 2021-03-10T13:51:46.135277+0000 mon.a (mon.0) 263 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-03-10T13:51:46.813 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:46 gibba045 bash[25517]: cluster 2021-03-10T13:51:46.135574+0000 mon.a (mon.0) 264 : cluster [DBG] osd.2 reported immediately failed by osd.6 2021-03-10T13:51:46.813 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:46 gibba045 bash[25517]: cluster 2021-03-10T13:51:46.135988+0000 mon.a (mon.0) 265 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-03-10T13:51:46.814 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:46 gibba045 bash[25517]: cluster 2021-03-10T13:51:46.136169+0000 mon.a (mon.0) 266 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-03-10T13:51:46.814 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:46 gibba045 bash[25517]: cluster 2021-03-10T13:51:46.136715+0000 mon.a (mon.0) 267 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T13:51:46.814 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:46 gibba045 bash[25517]: cluster 2021-03-10T13:51:46.137013+0000 mon.a (mon.0) 268 : cluster [DBG] osd.2 reported immediately failed by osd.6 2021-03-10T13:51:46.814 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:46 gibba045 bash[25517]: cluster 2021-03-10T13:51:46.137607+0000 mon.a (mon.0) 269 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T13:51:46.815 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:46 gibba045 bash[25517]: cluster 2021-03-10T13:51:46.197672+0000 mon.a (mon.0) 270 : cluster [DBG] osd.2 reported immediately failed by osd.3 2021-03-10T13:51:46.815 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:46 gibba045 bash[25517]: cluster 2021-03-10T13:51:46.208222+0000 mon.a (mon.0) 271 : cluster [DBG] osd.2 reported immediately failed by osd.0 2021-03-10T13:51:46.815 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:46 gibba045 bash[25517]: cluster 2021-03-10T13:51:46.267406+0000 mon.a (mon.0) 272 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T13:51:46.815 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:46 gibba045 bash[25517]: cluster 2021-03-10T13:51:46.268309+0000 mon.a (mon.0) 273 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-03-10T13:51:47.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:47 gibba015 bash[29377]: cluster 2021-03-10T13:51:46.395417+0000 mon.a (mon.0) 274 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T13:51:47.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:47 gibba015 bash[29377]: cluster 2021-03-10T13:51:46.409176+0000 mon.a (mon.0) 275 : cluster [DBG] osdmap e73: 8 total, 7 up, 8 in 2021-03-10T13:51:47.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:47 gibba015 bash[30343]: cluster 2021-03-10T13:51:46.395417+0000 mon.a (mon.0) 274 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T13:51:47.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:47 gibba015 bash[30343]: cluster 2021-03-10T13:51:46.409176+0000 mon.a (mon.0) 275 : cluster [DBG] osdmap e73: 8 total, 7 up, 8 in 2021-03-10T13:51:47.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:47 gibba045 bash[25517]: cluster 2021-03-10T13:51:46.395417+0000 mon.a (mon.0) 274 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T13:51:47.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:47 gibba045 bash[25517]: cluster 2021-03-10T13:51:46.409176+0000 mon.a (mon.0) 275 : cluster [DBG] osdmap e73: 8 total, 7 up, 8 in 2021-03-10T13:51:48.416 INFO:journalctl@ceph.osd.2.gibba015.stdout:Mar 10 13:51:48 gibba015 systemd[1]: ceph-e4a642d2-81a5-11eb-9080-001a4aab830c@osd.2.service: Succeeded. 2021-03-10T13:51:48.417 INFO:journalctl@ceph.osd.2.gibba015.stdout:Mar 10 13:51:48 gibba015 systemd[1]: Stopped Ceph osd.2 for e4a642d2-81a5-11eb-9080-001a4aab830c. 2021-03-10T13:51:48.417 INFO:journalctl@ceph.osd.2.gibba015.stdout:Mar 10 13:51:48 gibba015 systemd[1]: Started Ceph osd.2 for e4a642d2-81a5-11eb-9080-001a4aab830c. 2021-03-10T13:51:48.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:48 gibba015 bash[29377]: cluster 2021-03-10T13:51:47.011169+0000 mgr.gibba045.orlgmj (mgr.34412) 162 : cluster [DBG] pgmap v72: 129 pgs: 10 stale+active+clean, 18 active+clean+wait, 101 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T13:51:48.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:48 gibba015 bash[29377]: cluster 2021-03-10T13:51:47.411259+0000 mon.a (mon.0) 276 : cluster [DBG] osdmap e74: 8 total, 7 up, 8 in 2021-03-10T13:51:48.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:48 gibba015 bash[29377]: audit 2021-03-10T13:51:48.176772+0000 mon.a (mon.0) 277 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:51:48.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:48 gibba015 bash[29377]: audit 2021-03-10T13:51:48.178061+0000 mon.c (mon.1) 84 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:51:48.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:48 gibba015 bash[29377]: audit 2021-03-10T13:51:48.180154+0000 mon.c (mon.1) 85 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:51:48.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:48 gibba015 bash[30343]: cluster 2021-03-10T13:51:47.011169+0000 mgr.gibba045.orlgmj (mgr.34412) 162 : cluster [DBG] pgmap v72: 129 pgs: 10 stale+active+clean, 18 active+clean+wait, 101 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T13:51:48.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:48 gibba015 bash[30343]: cluster 2021-03-10T13:51:47.411259+0000 mon.a (mon.0) 276 : cluster [DBG] osdmap e74: 8 total, 7 up, 8 in 2021-03-10T13:51:48.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:48 gibba015 bash[30343]: audit 2021-03-10T13:51:48.176772+0000 mon.a (mon.0) 277 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:51:48.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:48 gibba015 bash[30343]: audit 2021-03-10T13:51:48.178061+0000 mon.c (mon.1) 84 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:51:48.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:48 gibba015 bash[30343]: audit 2021-03-10T13:51:48.180154+0000 mon.c (mon.1) 85 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:51:48.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:48 gibba045 bash[25517]: cluster 2021-03-10T13:51:47.011169+0000 mgr.gibba045.orlgmj (mgr.34412) 162 : cluster [DBG] pgmap v72: 129 pgs: 10 stale+active+clean, 18 active+clean+wait, 101 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T13:51:48.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:48 gibba045 bash[25517]: cluster 2021-03-10T13:51:47.411259+0000 mon.a (mon.0) 276 : cluster [DBG] osdmap e74: 8 total, 7 up, 8 in 2021-03-10T13:51:48.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:48 gibba045 bash[25517]: audit 2021-03-10T13:51:48.176772+0000 mon.a (mon.0) 277 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:51:48.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:48 gibba045 bash[25517]: audit 2021-03-10T13:51:48.178061+0000 mon.c (mon.1) 84 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:51:48.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:48 gibba045 bash[25517]: audit 2021-03-10T13:51:48.180154+0000 mon.c (mon.1) 85 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:51:49.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:49 gibba015 bash[29377]: cluster 2021-03-10T13:51:49.413362+0000 mon.a (mon.0) 278 : cluster [WRN] Health check failed: Degraded data redundancy: 12/192 objects degraded (6.250%), 10 pgs degraded (PG_DEGRADED) 2021-03-10T13:51:49.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:49 gibba015 bash[30343]: cluster 2021-03-10T13:51:49.413362+0000 mon.a (mon.0) 278 : cluster [WRN] Health check failed: Degraded data redundancy: 12/192 objects degraded (6.250%), 10 pgs degraded (PG_DEGRADED) 2021-03-10T13:51:49.723 INFO:journalctl@ceph.osd.2.gibba015.stdout:Mar 10 13:51:49 gibba015 bash[34342]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2021-03-10T13:51:49.723 INFO:journalctl@ceph.osd.2.gibba015.stdout:Mar 10 13:51:49 gibba015 bash[34342]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-2 --no-mon-config 2021-03-10T13:51:49.723 INFO:journalctl@ceph.osd.2.gibba015.stdout:Mar 10 13:51:49 gibba015 bash[34342]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2/block 2021-03-10T13:51:49.723 INFO:journalctl@ceph.osd.2.gibba015.stdout:Mar 10 13:51:49 gibba015 bash[34342]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-2/block 2021-03-10T13:51:49.724 INFO:journalctl@ceph.osd.2.gibba015.stdout:Mar 10 13:51:49 gibba015 bash[34342]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2021-03-10T13:51:49.724 INFO:journalctl@ceph.osd.2.gibba015.stdout:Mar 10 13:51:49 gibba015 bash[34342]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2021-03-10T13:51:49.724 INFO:journalctl@ceph.osd.2.gibba015.stdout:Mar 10 13:51:49 gibba015 bash[34342]: --> ceph-volume lvm activate successful for osd ID: 2 2021-03-10T13:51:49.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:49 gibba045 bash[25517]: cluster 2021-03-10T13:51:49.413362+0000 mon.a (mon.0) 278 : cluster [WRN] Health check failed: Degraded data redundancy: 12/192 objects degraded (6.250%), 10 pgs degraded (PG_DEGRADED) 2021-03-10T13:51:50.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:50 gibba045 bash[25517]: cluster 2021-03-10T13:51:49.013182+0000 mgr.gibba045.orlgmj (mgr.34412) 163 : cluster [DBG] pgmap v74: 129 pgs: 2 stale+active+clean, 10 active+undersized+degraded, 18 active+clean+wait, 16 active+undersized, 83 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail; 12/192 objects degraded (6.250%) 2021-03-10T13:51:50.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:50 gibba015 bash[29377]: cluster 2021-03-10T13:51:49.013182+0000 mgr.gibba045.orlgmj (mgr.34412) 163 : cluster [DBG] pgmap v74: 129 pgs: 2 stale+active+clean, 10 active+undersized+degraded, 18 active+clean+wait, 16 active+undersized, 83 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail; 12/192 objects degraded (6.250%) 2021-03-10T13:51:50.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:50 gibba015 bash[30343]: cluster 2021-03-10T13:51:49.013182+0000 mgr.gibba045.orlgmj (mgr.34412) 163 : cluster [DBG] pgmap v74: 129 pgs: 2 stale+active+clean, 10 active+undersized+degraded, 18 active+clean+wait, 16 active+undersized, 83 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail; 12/192 objects degraded (6.250%) 2021-03-10T13:51:51.363 INFO:journalctl@ceph.osd.2.gibba015.stdout:Mar 10 13:51:51 gibba015 bash[34470]: debug 2021-03-10T13:51:51.056+0000 7f9ef136a700 1 -- 172.21.2.115:0/1328159471 <== mon.1 v2:172.21.2.115:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x555dce2184e0 con 0x555dce294c00 2021-03-10T13:51:51.722 INFO:journalctl@ceph.osd.2.gibba015.stdout:Mar 10 13:51:51 gibba015 bash[34470]: debug 2021-03-10T13:51:51.360+0000 7f9ef8dff080 -1 Falling back to public interface 2021-03-10T13:51:52.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:52 gibba045 bash[25517]: cluster 2021-03-10T13:51:51.014636+0000 mgr.gibba045.orlgmj (mgr.34412) 164 : cluster [DBG] pgmap v75: 129 pgs: 12 active+undersized+degraded, 20 active+undersized, 97 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail; 18/192 objects degraded (9.375%) 2021-03-10T13:51:52.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:52 gibba045 bash[25517]: audit 2021-03-10T13:51:51.873024+0000 mon.a (mon.0) 279 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:51:52.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:52 gibba045 bash[25517]: audit 2021-03-10T13:51:51.876703+0000 mon.a (mon.0) 280 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:51:52.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:52 gibba045 bash[25517]: audit 2021-03-10T13:51:51.880995+0000 mon.c (mon.1) 86 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:51:52.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:52 gibba045 bash[25517]: audit 2021-03-10T13:51:51.882268+0000 mon.c (mon.1) 87 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:51:52.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:52 gibba045 bash[25517]: audit 2021-03-10T13:51:51.883555+0000 mon.c (mon.1) 88 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:51:52.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:52 gibba045 bash[25517]: audit 2021-03-10T13:51:51.884725+0000 mon.c (mon.1) 89 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:51:52.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:52 gibba045 bash[25517]: audit 2021-03-10T13:51:51.887429+0000 mon.c (mon.1) 90 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-03-10T13:51:52.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:52 gibba045 bash[25517]: audit 2021-03-10T13:51:52.463422+0000 mon.c (mon.1) 91 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:51:52.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:52 gibba045 bash[25517]: audit 2021-03-10T13:51:52.464529+0000 mon.a (mon.0) 281 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:51:52.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:52 gibba045 bash[25517]: audit 2021-03-10T13:51:52.469890+0000 mon.c (mon.1) 92 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T13:51:52.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:52 gibba045 bash[25517]: audit 2021-03-10T13:51:52.470990+0000 mon.a (mon.0) 282 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T13:51:52.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:52 gibba015 bash[29377]: cluster 2021-03-10T13:51:51.014636+0000 mgr.gibba045.orlgmj (mgr.34412) 164 : cluster [DBG] pgmap v75: 129 pgs: 12 active+undersized+degraded, 20 active+undersized, 97 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail; 18/192 objects degraded (9.375%) 2021-03-10T13:51:52.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:52 gibba015 bash[29377]: audit 2021-03-10T13:51:51.873024+0000 mon.a (mon.0) 279 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:51:52.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:52 gibba015 bash[29377]: audit 2021-03-10T13:51:51.876703+0000 mon.a (mon.0) 280 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:51:52.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:52 gibba015 bash[29377]: audit 2021-03-10T13:51:51.880995+0000 mon.c (mon.1) 86 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:51:52.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:52 gibba015 bash[29377]: audit 2021-03-10T13:51:51.882268+0000 mon.c (mon.1) 87 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:51:52.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:52 gibba015 bash[29377]: audit 2021-03-10T13:51:51.883555+0000 mon.c (mon.1) 88 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:51:52.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:52 gibba015 bash[29377]: audit 2021-03-10T13:51:51.884725+0000 mon.c (mon.1) 89 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:51:52.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:52 gibba015 bash[29377]: audit 2021-03-10T13:51:51.887429+0000 mon.c (mon.1) 90 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-03-10T13:51:52.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:52 gibba015 bash[29377]: audit 2021-03-10T13:51:52.463422+0000 mon.c (mon.1) 91 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:51:52.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:52 gibba015 bash[29377]: audit 2021-03-10T13:51:52.464529+0000 mon.a (mon.0) 281 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:51:52.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:52 gibba015 bash[29377]: audit 2021-03-10T13:51:52.469890+0000 mon.c (mon.1) 92 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T13:51:52.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:52 gibba015 bash[29377]: audit 2021-03-10T13:51:52.470990+0000 mon.a (mon.0) 282 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T13:51:52.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:52 gibba015 bash[30343]: cluster 2021-03-10T13:51:51.014636+0000 mgr.gibba045.orlgmj (mgr.34412) 164 : cluster [DBG] pgmap v75: 129 pgs: 12 active+undersized+degraded, 20 active+undersized, 97 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail; 18/192 objects degraded (9.375%) 2021-03-10T13:51:52.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:52 gibba015 bash[30343]: audit 2021-03-10T13:51:51.873024+0000 mon.a (mon.0) 279 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:51:52.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:52 gibba015 bash[30343]: audit 2021-03-10T13:51:51.876703+0000 mon.a (mon.0) 280 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:51:52.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:52 gibba015 bash[30343]: audit 2021-03-10T13:51:51.880995+0000 mon.c (mon.1) 86 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:51:52.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:52 gibba015 bash[30343]: audit 2021-03-10T13:51:51.882268+0000 mon.c (mon.1) 87 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:51:52.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:52 gibba015 bash[30343]: audit 2021-03-10T13:51:51.883555+0000 mon.c (mon.1) 88 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:51:52.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:52 gibba015 bash[30343]: audit 2021-03-10T13:51:51.884725+0000 mon.c (mon.1) 89 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:51:52.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:52 gibba015 bash[30343]: audit 2021-03-10T13:51:51.887429+0000 mon.c (mon.1) 90 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-03-10T13:51:52.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:52 gibba015 bash[30343]: audit 2021-03-10T13:51:52.463422+0000 mon.c (mon.1) 91 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:51:52.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:52 gibba015 bash[30343]: audit 2021-03-10T13:51:52.464529+0000 mon.a (mon.0) 281 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:51:52.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:52 gibba015 bash[30343]: audit 2021-03-10T13:51:52.469890+0000 mon.c (mon.1) 92 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T13:51:52.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:52 gibba015 bash[30343]: audit 2021-03-10T13:51:52.470990+0000 mon.a (mon.0) 282 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T13:51:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:53 gibba045 bash[25517]: cephadm 2021-03-10T13:51:51.881526+0000 mgr.gibba045.orlgmj (mgr.34412) 165 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:51:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:53 gibba045 bash[25517]: cephadm 2021-03-10T13:51:51.883187+0000 mgr.gibba045.orlgmj (mgr.34412) 166 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:51:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:53 gibba045 bash[25517]: cephadm 2021-03-10T13:51:51.884360+0000 mgr.gibba045.orlgmj (mgr.34412) 167 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:51:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:53 gibba045 bash[25517]: cephadm 2021-03-10T13:51:51.884434+0000 mgr.gibba045.orlgmj (mgr.34412) 168 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:51:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:53 gibba045 bash[25517]: cephadm 2021-03-10T13:51:51.885573+0000 mgr.gibba045.orlgmj (mgr.34412) 169 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:51:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:53 gibba045 bash[25517]: cephadm 2021-03-10T13:51:51.885612+0000 mgr.gibba045.orlgmj (mgr.34412) 170 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:51:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:53 gibba045 bash[25517]: cephadm 2021-03-10T13:51:51.886751+0000 mgr.gibba045.orlgmj (mgr.34412) 171 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:51:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:53 gibba045 bash[25517]: cephadm 2021-03-10T13:51:51.888195+0000 mgr.gibba045.orlgmj (mgr.34412) 172 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:51:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:53 gibba045 bash[25517]: cephadm 2021-03-10T13:51:51.888235+0000 mgr.gibba045.orlgmj (mgr.34412) 173 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:51:53.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:53 gibba045 bash[25517]: audit 2021-03-10T13:51:51.888827+0000 mgr.gibba045.orlgmj (mgr.34412) 174 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-03-10T13:51:53.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:53 gibba045 bash[25517]: cephadm 2021-03-10T13:51:51.889977+0000 mgr.gibba045.orlgmj (mgr.34412) 175 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2021-03-10T13:51:53.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:53 gibba015 bash[29377]: cephadm 2021-03-10T13:51:51.881526+0000 mgr.gibba045.orlgmj (mgr.34412) 165 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:51:53.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:53 gibba015 bash[29377]: cephadm 2021-03-10T13:51:51.883187+0000 mgr.gibba045.orlgmj (mgr.34412) 166 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:51:53.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:53 gibba015 bash[29377]: cephadm 2021-03-10T13:51:51.884360+0000 mgr.gibba045.orlgmj (mgr.34412) 167 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:51:53.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:53 gibba015 bash[29377]: cephadm 2021-03-10T13:51:51.884434+0000 mgr.gibba045.orlgmj (mgr.34412) 168 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:51:53.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:53 gibba015 bash[29377]: cephadm 2021-03-10T13:51:51.885573+0000 mgr.gibba045.orlgmj (mgr.34412) 169 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:51:53.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:53 gibba015 bash[29377]: cephadm 2021-03-10T13:51:51.885612+0000 mgr.gibba045.orlgmj (mgr.34412) 170 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:51:53.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:53 gibba015 bash[29377]: cephadm 2021-03-10T13:51:51.886751+0000 mgr.gibba045.orlgmj (mgr.34412) 171 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:51:53.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:53 gibba015 bash[29377]: cephadm 2021-03-10T13:51:51.888195+0000 mgr.gibba045.orlgmj (mgr.34412) 172 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:51:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:53 gibba015 bash[29377]: cephadm 2021-03-10T13:51:51.888235+0000 mgr.gibba045.orlgmj (mgr.34412) 173 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:51:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:53 gibba015 bash[29377]: audit 2021-03-10T13:51:51.888827+0000 mgr.gibba045.orlgmj (mgr.34412) 174 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-03-10T13:51:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:53 gibba015 bash[29377]: cephadm 2021-03-10T13:51:51.889977+0000 mgr.gibba045.orlgmj (mgr.34412) 175 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2021-03-10T13:51:53.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:53 gibba015 bash[30343]: cephadm 2021-03-10T13:51:51.881526+0000 mgr.gibba045.orlgmj (mgr.34412) 165 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:51:53.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:53 gibba015 bash[30343]: cephadm 2021-03-10T13:51:51.883187+0000 mgr.gibba045.orlgmj (mgr.34412) 166 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:51:53.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:53 gibba015 bash[30343]: cephadm 2021-03-10T13:51:51.884360+0000 mgr.gibba045.orlgmj (mgr.34412) 167 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:51:53.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:53 gibba015 bash[30343]: cephadm 2021-03-10T13:51:51.884434+0000 mgr.gibba045.orlgmj (mgr.34412) 168 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:51:53.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:53 gibba015 bash[30343]: cephadm 2021-03-10T13:51:51.885573+0000 mgr.gibba045.orlgmj (mgr.34412) 169 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:51:53.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:53 gibba015 bash[30343]: cephadm 2021-03-10T13:51:51.885612+0000 mgr.gibba045.orlgmj (mgr.34412) 170 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:51:53.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:53 gibba015 bash[30343]: cephadm 2021-03-10T13:51:51.886751+0000 mgr.gibba045.orlgmj (mgr.34412) 171 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:51:53.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:53 gibba015 bash[30343]: cephadm 2021-03-10T13:51:51.888195+0000 mgr.gibba045.orlgmj (mgr.34412) 172 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:51:53.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:53 gibba015 bash[30343]: cephadm 2021-03-10T13:51:51.888235+0000 mgr.gibba045.orlgmj (mgr.34412) 173 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:51:53.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:53 gibba015 bash[30343]: audit 2021-03-10T13:51:51.888827+0000 mgr.gibba045.orlgmj (mgr.34412) 174 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-03-10T13:51:53.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:53 gibba015 bash[30343]: cephadm 2021-03-10T13:51:51.889977+0000 mgr.gibba045.orlgmj (mgr.34412) 175 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2021-03-10T13:51:54.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:54 gibba045 bash[25517]: cluster 2021-03-10T13:51:53.015876+0000 mgr.gibba045.orlgmj (mgr.34412) 176 : cluster [DBG] pgmap v76: 129 pgs: 12 active+undersized+degraded, 20 active+undersized, 97 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail; 18/192 objects degraded (9.375%) 2021-03-10T13:51:54.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:54 gibba015 bash[29377]: cluster 2021-03-10T13:51:53.015876+0000 mgr.gibba045.orlgmj (mgr.34412) 176 : cluster [DBG] pgmap v76: 129 pgs: 12 active+undersized+degraded, 20 active+undersized, 97 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail; 18/192 objects degraded (9.375%) 2021-03-10T13:51:54.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:54 gibba015 bash[30343]: cluster 2021-03-10T13:51:53.015876+0000 mgr.gibba045.orlgmj (mgr.34412) 176 : cluster [DBG] pgmap v76: 129 pgs: 12 active+undersized+degraded, 20 active+undersized, 97 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail; 18/192 objects degraded (9.375%) 2021-03-10T13:51:54.973 INFO:journalctl@ceph.osd.2.gibba015.stdout:Mar 10 13:51:54 gibba015 bash[34470]: debug 2021-03-10T13:51:54.544+0000 7f9ef8dff080 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: store not yet converted to per-pg omap 2021-03-10T13:51:54.973 INFO:journalctl@ceph.osd.2.gibba015.stdout:Mar 10 13:51:54 gibba015 bash[34470]: debug 2021-03-10T13:51:54.544+0000 7f9ee50c6700 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #-1:c1a3fc6e:::purged_snaps:0# has omap that is not per-pg or pgmeta 2021-03-10T13:51:54.973 INFO:journalctl@ceph.osd.2.gibba015.stdout:Mar 10 13:51:54 gibba015 bash[34470]: debug 2021-03-10T13:51:54.672+0000 7f9ef8dff080 -1 osd.2 72 log_to_monitors {default=true} 2021-03-10T13:51:55.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:55 gibba045 bash[25517]: audit 2021-03-10T13:51:54.677609+0000 mon.c (mon.1) 93 : audit [INF] from='osd.2 [v2:172.21.2.115:6816/1026727874,v1:172.21.2.115:6817/1026727874]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-03-10T13:51:55.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:55 gibba045 bash[25517]: audit 2021-03-10T13:51:54.678059+0000 mon.a (mon.0) 283 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-03-10T13:51:55.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:55 gibba015 bash[29377]: audit 2021-03-10T13:51:54.677609+0000 mon.c (mon.1) 93 : audit [INF] from='osd.2 [v2:172.21.2.115:6816/1026727874,v1:172.21.2.115:6817/1026727874]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-03-10T13:51:55.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:55 gibba015 bash[29377]: audit 2021-03-10T13:51:54.678059+0000 mon.a (mon.0) 283 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-03-10T13:51:55.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:55 gibba015 bash[30343]: audit 2021-03-10T13:51:54.677609+0000 mon.c (mon.1) 93 : audit [INF] from='osd.2 [v2:172.21.2.115:6816/1026727874,v1:172.21.2.115:6817/1026727874]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-03-10T13:51:55.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:55 gibba015 bash[30343]: audit 2021-03-10T13:51:54.678059+0000 mon.a (mon.0) 283 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-03-10T13:51:55.973 INFO:journalctl@ceph.osd.2.gibba015.stdout:Mar 10 13:51:55 gibba015 bash[34470]: debug 2021-03-10T13:51:55.512+0000 7f9eeb2e1700 -1 osd.2 72 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T13:51:56.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:56 gibba045 bash[25517]: cluster 2021-03-10T13:51:55.018179+0000 mgr.gibba045.orlgmj (mgr.34412) 177 : cluster [DBG] pgmap v77: 129 pgs: 12 active+undersized+degraded, 20 active+undersized, 97 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail; 18/192 objects degraded (9.375%) 2021-03-10T13:51:56.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:56 gibba045 bash[25517]: audit 2021-03-10T13:51:55.504366+0000 mon.a (mon.0) 284 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2021-03-10T13:51:56.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:56 gibba045 bash[25517]: cluster 2021-03-10T13:51:55.504729+0000 mon.a (mon.0) 285 : cluster [DBG] osdmap e75: 8 total, 7 up, 8 in 2021-03-10T13:51:56.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:56 gibba045 bash[25517]: audit 2021-03-10T13:51:55.506283+0000 mon.c (mon.1) 94 : audit [INF] from='osd.2 [v2:172.21.2.115:6816/1026727874,v1:172.21.2.115:6817/1026727874]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0820, "args": ["host=gibba015", "root=default"]}]: dispatch 2021-03-10T13:51:56.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:56 gibba045 bash[25517]: audit 2021-03-10T13:51:55.508770+0000 mon.a (mon.0) 286 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0820, "args": ["host=gibba015", "root=default"]}]: dispatch 2021-03-10T13:51:56.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:56 gibba045 bash[25517]: cluster 2021-03-10T13:51:56.357429+0000 mon.a (mon.0) 287 : cluster [WRN] Health check update: Degraded data redundancy: 18/192 objects degraded (9.375%), 12 pgs degraded (PG_DEGRADED) 2021-03-10T13:51:56.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:56 gibba015 bash[29377]: cluster 2021-03-10T13:51:55.018179+0000 mgr.gibba045.orlgmj (mgr.34412) 177 : cluster [DBG] pgmap v77: 129 pgs: 12 active+undersized+degraded, 20 active+undersized, 97 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail; 18/192 objects degraded (9.375%) 2021-03-10T13:51:56.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:56 gibba015 bash[29377]: audit 2021-03-10T13:51:55.504366+0000 mon.a (mon.0) 284 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2021-03-10T13:51:56.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:56 gibba015 bash[29377]: cluster 2021-03-10T13:51:55.504729+0000 mon.a (mon.0) 285 : cluster [DBG] osdmap e75: 8 total, 7 up, 8 in 2021-03-10T13:51:56.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:56 gibba015 bash[29377]: audit 2021-03-10T13:51:55.506283+0000 mon.c (mon.1) 94 : audit [INF] from='osd.2 [v2:172.21.2.115:6816/1026727874,v1:172.21.2.115:6817/1026727874]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0820, "args": ["host=gibba015", "root=default"]}]: dispatch 2021-03-10T13:51:56.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:56 gibba015 bash[29377]: audit 2021-03-10T13:51:55.508770+0000 mon.a (mon.0) 286 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0820, "args": ["host=gibba015", "root=default"]}]: dispatch 2021-03-10T13:51:56.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:56 gibba015 bash[29377]: cluster 2021-03-10T13:51:56.357429+0000 mon.a (mon.0) 287 : cluster [WRN] Health check update: Degraded data redundancy: 18/192 objects degraded (9.375%), 12 pgs degraded (PG_DEGRADED) 2021-03-10T13:51:56.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:56 gibba015 bash[30343]: cluster 2021-03-10T13:51:55.018179+0000 mgr.gibba045.orlgmj (mgr.34412) 177 : cluster [DBG] pgmap v77: 129 pgs: 12 active+undersized+degraded, 20 active+undersized, 97 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail; 18/192 objects degraded (9.375%) 2021-03-10T13:51:56.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:56 gibba015 bash[30343]: audit 2021-03-10T13:51:55.504366+0000 mon.a (mon.0) 284 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2021-03-10T13:51:56.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:56 gibba015 bash[30343]: cluster 2021-03-10T13:51:55.504729+0000 mon.a (mon.0) 285 : cluster [DBG] osdmap e75: 8 total, 7 up, 8 in 2021-03-10T13:51:56.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:56 gibba015 bash[30343]: audit 2021-03-10T13:51:55.506283+0000 mon.c (mon.1) 94 : audit [INF] from='osd.2 [v2:172.21.2.115:6816/1026727874,v1:172.21.2.115:6817/1026727874]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0820, "args": ["host=gibba015", "root=default"]}]: dispatch 2021-03-10T13:51:56.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:56 gibba015 bash[30343]: audit 2021-03-10T13:51:55.508770+0000 mon.a (mon.0) 286 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0820, "args": ["host=gibba015", "root=default"]}]: dispatch 2021-03-10T13:51:56.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:56 gibba015 bash[30343]: cluster 2021-03-10T13:51:56.357429+0000 mon.a (mon.0) 287 : cluster [WRN] Health check update: Degraded data redundancy: 18/192 objects degraded (9.375%), 12 pgs degraded (PG_DEGRADED) 2021-03-10T13:51:57.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:57 gibba045 bash[25517]: cluster 2021-03-10T13:51:56.508320+0000 mon.a (mon.0) 288 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T13:51:57.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:57 gibba045 bash[25517]: cluster 2021-03-10T13:51:56.518561+0000 mon.a (mon.0) 289 : cluster [INF] osd.2 [v2:172.21.2.115:6816/1026727874,v1:172.21.2.115:6817/1026727874] boot 2021-03-10T13:51:57.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:57 gibba045 bash[25517]: cluster 2021-03-10T13:51:56.518602+0000 mon.a (mon.0) 290 : cluster [DBG] osdmap e76: 8 total, 8 up, 8 in 2021-03-10T13:51:57.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:57 gibba045 bash[25517]: audit 2021-03-10T13:51:56.519305+0000 mon.c (mon.1) 95 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T13:51:57.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:57 gibba015 bash[29377]: cluster 2021-03-10T13:51:56.508320+0000 mon.a (mon.0) 288 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T13:51:57.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:57 gibba015 bash[29377]: cluster 2021-03-10T13:51:56.518561+0000 mon.a (mon.0) 289 : cluster [INF] osd.2 [v2:172.21.2.115:6816/1026727874,v1:172.21.2.115:6817/1026727874] boot 2021-03-10T13:51:57.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:57 gibba015 bash[29377]: cluster 2021-03-10T13:51:56.518602+0000 mon.a (mon.0) 290 : cluster [DBG] osdmap e76: 8 total, 8 up, 8 in 2021-03-10T13:51:57.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:57 gibba015 bash[29377]: audit 2021-03-10T13:51:56.519305+0000 mon.c (mon.1) 95 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T13:51:57.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:57 gibba015 bash[30343]: cluster 2021-03-10T13:51:56.508320+0000 mon.a (mon.0) 288 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T13:51:57.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:57 gibba015 bash[30343]: cluster 2021-03-10T13:51:56.518561+0000 mon.a (mon.0) 289 : cluster [INF] osd.2 [v2:172.21.2.115:6816/1026727874,v1:172.21.2.115:6817/1026727874] boot 2021-03-10T13:51:57.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:57 gibba015 bash[30343]: cluster 2021-03-10T13:51:56.518602+0000 mon.a (mon.0) 290 : cluster [DBG] osdmap e76: 8 total, 8 up, 8 in 2021-03-10T13:51:57.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:57 gibba015 bash[30343]: audit 2021-03-10T13:51:56.519305+0000 mon.c (mon.1) 95 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T13:51:58.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:58 gibba045 bash[25517]: cluster 2021-03-10T13:51:57.019396+0000 mgr.gibba045.orlgmj (mgr.34412) 178 : cluster [DBG] pgmap v80: 129 pgs: 12 active+undersized+degraded, 20 active+undersized, 97 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail; 18/192 objects degraded (9.375%) 2021-03-10T13:51:58.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:51:58 gibba045 bash[25517]: cluster 2021-03-10T13:51:57.522546+0000 mon.a (mon.0) 291 : cluster [DBG] osdmap e77: 8 total, 8 up, 8 in 2021-03-10T13:51:58.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:58 gibba015 bash[29377]: cluster 2021-03-10T13:51:57.019396+0000 mgr.gibba045.orlgmj (mgr.34412) 178 : cluster [DBG] pgmap v80: 129 pgs: 12 active+undersized+degraded, 20 active+undersized, 97 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail; 18/192 objects degraded (9.375%) 2021-03-10T13:51:58.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:51:58 gibba015 bash[29377]: cluster 2021-03-10T13:51:57.522546+0000 mon.a (mon.0) 291 : cluster [DBG] osdmap e77: 8 total, 8 up, 8 in 2021-03-10T13:51:58.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:58 gibba015 bash[30343]: cluster 2021-03-10T13:51:57.019396+0000 mgr.gibba045.orlgmj (mgr.34412) 178 : cluster [DBG] pgmap v80: 129 pgs: 12 active+undersized+degraded, 20 active+undersized, 97 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail; 18/192 objects degraded (9.375%) 2021-03-10T13:51:58.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:51:58 gibba015 bash[30343]: cluster 2021-03-10T13:51:57.522546+0000 mon.a (mon.0) 291 : cluster [DBG] osdmap e77: 8 total, 8 up, 8 in 2021-03-10T13:52:00.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:00 gibba045 bash[25517]: cluster 2021-03-10T13:51:59.021305+0000 mgr.gibba045.orlgmj (mgr.34412) 179 : cluster [DBG] pgmap v82: 129 pgs: 3 active+undersized+degraded, 11 active+undersized, 115 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail; 7/192 objects degraded (3.646%) 2021-03-10T13:52:00.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:00 gibba015 bash[29377]: cluster 2021-03-10T13:51:59.021305+0000 mgr.gibba045.orlgmj (mgr.34412) 179 : cluster [DBG] pgmap v82: 129 pgs: 3 active+undersized+degraded, 11 active+undersized, 115 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail; 7/192 objects degraded (3.646%) 2021-03-10T13:52:00.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:00 gibba015 bash[30343]: cluster 2021-03-10T13:51:59.021305+0000 mgr.gibba045.orlgmj (mgr.34412) 179 : cluster [DBG] pgmap v82: 129 pgs: 3 active+undersized+degraded, 11 active+undersized, 115 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail; 7/192 objects degraded (3.646%) 2021-03-10T13:52:01.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:01 gibba045 bash[25517]: cluster 2021-03-10T13:52:01.360052+0000 mon.a (mon.0) 292 : cluster [WRN] Health check update: Degraded data redundancy: 7/192 objects degraded (3.646%), 3 pgs degraded (PG_DEGRADED) 2021-03-10T13:52:01.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:01 gibba015 bash[29377]: cluster 2021-03-10T13:52:01.360052+0000 mon.a (mon.0) 292 : cluster [WRN] Health check update: Degraded data redundancy: 7/192 objects degraded (3.646%), 3 pgs degraded (PG_DEGRADED) 2021-03-10T13:52:01.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:01 gibba015 bash[30343]: cluster 2021-03-10T13:52:01.360052+0000 mon.a (mon.0) 292 : cluster [WRN] Health check update: Degraded data redundancy: 7/192 objects degraded (3.646%), 3 pgs degraded (PG_DEGRADED) 2021-03-10T13:52:02.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:02 gibba015 bash[29377]: cluster 2021-03-10T13:52:01.022490+0000 mgr.gibba045.orlgmj (mgr.34412) 180 : cluster [DBG] pgmap v83: 129 pgs: 10 active+clean+wait, 119 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail 2021-03-10T13:52:02.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:02 gibba015 bash[29377]: cluster 2021-03-10T13:52:01.538213+0000 mon.a (mon.0) 293 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 7/192 objects degraded (3.646%), 3 pgs degraded) 2021-03-10T13:52:02.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:02 gibba015 bash[29377]: audit 2021-03-10T13:52:02.497146+0000 mon.a (mon.0) 294 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:52:02.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:02 gibba015 bash[30343]: cluster 2021-03-10T13:52:01.022490+0000 mgr.gibba045.orlgmj (mgr.34412) 180 : cluster [DBG] pgmap v83: 129 pgs: 10 active+clean+wait, 119 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail 2021-03-10T13:52:02.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:02 gibba015 bash[30343]: cluster 2021-03-10T13:52:01.538213+0000 mon.a (mon.0) 293 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 7/192 objects degraded (3.646%), 3 pgs degraded) 2021-03-10T13:52:02.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:02 gibba015 bash[30343]: audit 2021-03-10T13:52:02.497146+0000 mon.a (mon.0) 294 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:52:03.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:02 gibba045 bash[25517]: cluster 2021-03-10T13:52:01.022490+0000 mgr.gibba045.orlgmj (mgr.34412) 180 : cluster [DBG] pgmap v83: 129 pgs: 10 active+clean+wait, 119 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail 2021-03-10T13:52:03.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:02 gibba045 bash[25517]: cluster 2021-03-10T13:52:01.538213+0000 mon.a (mon.0) 293 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 7/192 objects degraded (3.646%), 3 pgs degraded) 2021-03-10T13:52:03.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:02 gibba045 bash[25517]: audit 2021-03-10T13:52:02.497146+0000 mon.a (mon.0) 294 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:52:04.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:04 gibba015 bash[29377]: cluster 2021-03-10T13:52:03.023632+0000 mgr.gibba045.orlgmj (mgr.34412) 181 : cluster [DBG] pgmap v84: 129 pgs: 10 active+clean+wait, 119 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail 2021-03-10T13:52:04.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:04 gibba015 bash[30343]: cluster 2021-03-10T13:52:03.023632+0000 mgr.gibba045.orlgmj (mgr.34412) 181 : cluster [DBG] pgmap v84: 129 pgs: 10 active+clean+wait, 119 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail 2021-03-10T13:52:05.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:04 gibba045 bash[25517]: cluster 2021-03-10T13:52:03.023632+0000 mgr.gibba045.orlgmj (mgr.34412) 181 : cluster [DBG] pgmap v84: 129 pgs: 10 active+clean+wait, 119 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail 2021-03-10T13:52:06.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:06 gibba015 bash[29377]: cluster 2021-03-10T13:52:05.025856+0000 mgr.gibba045.orlgmj (mgr.34412) 182 : cluster [DBG] pgmap v85: 129 pgs: 10 active+clean+wait, 119 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail 2021-03-10T13:52:06.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:06 gibba015 bash[30343]: cluster 2021-03-10T13:52:05.025856+0000 mgr.gibba045.orlgmj (mgr.34412) 182 : cluster [DBG] pgmap v85: 129 pgs: 10 active+clean+wait, 119 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail 2021-03-10T13:52:07.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:06 gibba045 bash[25517]: cluster 2021-03-10T13:52:05.025856+0000 mgr.gibba045.orlgmj (mgr.34412) 182 : cluster [DBG] pgmap v85: 129 pgs: 10 active+clean+wait, 119 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail 2021-03-10T13:52:07.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:07 gibba015 bash[29377]: audit 2021-03-10T13:52:06.904677+0000 mon.c (mon.1) 96 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-03-10T13:52:07.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:07 gibba015 bash[30343]: audit 2021-03-10T13:52:06.904677+0000 mon.c (mon.1) 96 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-03-10T13:52:08.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:07 gibba045 bash[25517]: audit 2021-03-10T13:52:06.904677+0000 mon.c (mon.1) 96 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-03-10T13:52:08.964 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:08 gibba015 bash[30343]: audit 2021-03-10T13:52:06.906847+0000 mgr.gibba045.orlgmj (mgr.34412) 183 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-03-10T13:52:08.965 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:08 gibba015 bash[30343]: cephadm 2021-03-10T13:52:06.911625+0000 mgr.gibba045.orlgmj (mgr.34412) 184 : cephadm [INF] Upgrade: osd.3 is safe to restart 2021-03-10T13:52:08.965 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:08 gibba015 bash[30343]: cluster 2021-03-10T13:52:07.027180+0000 mgr.gibba045.orlgmj (mgr.34412) 185 : cluster [DBG] pgmap v86: 129 pgs: 10 active+clean+wait, 119 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail 2021-03-10T13:52:08.965 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:08 gibba015 bash[29377]: audit 2021-03-10T13:52:06.906847+0000 mgr.gibba045.orlgmj (mgr.34412) 183 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-03-10T13:52:08.966 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:08 gibba015 bash[29377]: cephadm 2021-03-10T13:52:06.911625+0000 mgr.gibba045.orlgmj (mgr.34412) 184 : cephadm [INF] Upgrade: osd.3 is safe to restart 2021-03-10T13:52:08.966 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:08 gibba015 bash[29377]: cluster 2021-03-10T13:52:07.027180+0000 mgr.gibba045.orlgmj (mgr.34412) 185 : cluster [DBG] pgmap v86: 129 pgs: 10 active+clean+wait, 119 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail 2021-03-10T13:52:09.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:08 gibba045 bash[25517]: audit 2021-03-10T13:52:06.906847+0000 mgr.gibba045.orlgmj (mgr.34412) 183 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-03-10T13:52:09.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:08 gibba045 bash[25517]: cephadm 2021-03-10T13:52:06.911625+0000 mgr.gibba045.orlgmj (mgr.34412) 184 : cephadm [INF] Upgrade: osd.3 is safe to restart 2021-03-10T13:52:09.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:08 gibba045 bash[25517]: cluster 2021-03-10T13:52:07.027180+0000 mgr.gibba045.orlgmj (mgr.34412) 185 : cluster [DBG] pgmap v86: 129 pgs: 10 active+clean+wait, 119 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail 2021-03-10T13:52:10.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:09 gibba045 bash[25517]: cephadm 2021-03-10T13:52:08.779242+0000 mgr.gibba045.orlgmj (mgr.34412) 186 : cephadm [INF] Upgrade: Updating osd.3 2021-03-10T13:52:10.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:09 gibba045 bash[25517]: audit 2021-03-10T13:52:08.783576+0000 mon.a (mon.0) 295 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:52:10.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:09 gibba045 bash[25517]: audit 2021-03-10T13:52:08.789244+0000 mon.c (mon.1) 97 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd.3","key": "container_image"}]: dispatch 2021-03-10T13:52:10.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:09 gibba045 bash[25517]: cephadm 2021-03-10T13:52:08.790095+0000 mgr.gibba045.orlgmj (mgr.34412) 187 : cephadm [INF] Deploying daemon osd.3 on gibba015 2021-03-10T13:52:10.136 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:09 gibba015 bash[30343]: cephadm 2021-03-10T13:52:08.779242+0000 mgr.gibba045.orlgmj (mgr.34412) 186 : cephadm [INF] Upgrade: Updating osd.3 2021-03-10T13:52:10.137 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:09 gibba015 bash[30343]: audit 2021-03-10T13:52:08.783576+0000 mon.a (mon.0) 295 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:52:10.137 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:09 gibba015 bash[30343]: audit 2021-03-10T13:52:08.789244+0000 mon.c (mon.1) 97 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd.3","key": "container_image"}]: dispatch 2021-03-10T13:52:10.137 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:09 gibba015 bash[30343]: cephadm 2021-03-10T13:52:08.790095+0000 mgr.gibba045.orlgmj (mgr.34412) 187 : cephadm [INF] Deploying daemon osd.3 on gibba015 2021-03-10T13:52:10.137 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:09 gibba015 bash[29377]: cephadm 2021-03-10T13:52:08.779242+0000 mgr.gibba045.orlgmj (mgr.34412) 186 : cephadm [INF] Upgrade: Updating osd.3 2021-03-10T13:52:10.138 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:09 gibba015 bash[29377]: audit 2021-03-10T13:52:08.783576+0000 mon.a (mon.0) 295 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:52:10.138 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:09 gibba015 bash[29377]: audit 2021-03-10T13:52:08.789244+0000 mon.c (mon.1) 97 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd.3","key": "container_image"}]: dispatch 2021-03-10T13:52:10.138 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:09 gibba015 bash[29377]: cephadm 2021-03-10T13:52:08.790095+0000 mgr.gibba045.orlgmj (mgr.34412) 187 : cephadm [INF] Deploying daemon osd.3 on gibba015 2021-03-10T13:52:10.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:10 gibba015 bash[30343]: cluster 2021-03-10T13:52:09.028934+0000 mgr.gibba045.orlgmj (mgr.34412) 188 : cluster [DBG] pgmap v87: 129 pgs: 10 active+clean+wait, 119 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail 2021-03-10T13:52:10.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:10 gibba015 bash[29377]: cluster 2021-03-10T13:52:09.028934+0000 mgr.gibba045.orlgmj (mgr.34412) 188 : cluster [DBG] pgmap v87: 129 pgs: 10 active+clean+wait, 119 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail 2021-03-10T13:52:10.972 INFO:journalctl@ceph.osd.3.gibba015.stdout:Mar 10 13:52:10 gibba015 systemd[1]: Stopping Ceph osd.3 for e4a642d2-81a5-11eb-9080-001a4aab830c... 2021-03-10T13:52:10.972 INFO:journalctl@ceph.osd.3.gibba015.stdout:Mar 10 13:52:10 gibba015 bash[19305]: debug 2021-03-10T13:52:10.840+0000 7eff79b37700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2021-03-10T13:52:10.973 INFO:journalctl@ceph.osd.3.gibba015.stdout:Mar 10 13:52:10 gibba015 bash[19305]: debug 2021-03-10T13:52:10.840+0000 7eff79b37700 -1 osd.3 77 *** Got signal Terminated *** 2021-03-10T13:52:10.973 INFO:journalctl@ceph.osd.3.gibba015.stdout:Mar 10 13:52:10 gibba015 bash[19305]: debug 2021-03-10T13:52:10.840+0000 7eff79b37700 -1 osd.3 77 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-03-10T13:52:11.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:10 gibba045 bash[25517]: cluster 2021-03-10T13:52:09.028934+0000 mgr.gibba045.orlgmj (mgr.34412) 188 : cluster [DBG] pgmap v87: 129 pgs: 10 active+clean+wait, 119 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail 2021-03-10T13:52:11.971 INFO:journalctl@ceph.osd.3.gibba015.stdout:Mar 10 13:52:11 gibba015 docker[35290]: ceph-e4a642d2-81a5-11eb-9080-001a4aab830c-osd.3 2021-03-10T13:52:11.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[29377]: cluster 2021-03-10T13:52:10.959527+0000 mon.a (mon.0) 296 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-03-10T13:52:11.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[29377]: cluster 2021-03-10T13:52:10.959567+0000 mon.a (mon.0) 297 : cluster [INF] osd.3 failed (root=default,host=gibba015) (connection refused reported by osd.5) 2021-03-10T13:52:11.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[29377]: cluster 2021-03-10T13:52:10.959789+0000 mon.a (mon.0) 298 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-03-10T13:52:11.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[29377]: cluster 2021-03-10T13:52:10.959938+0000 mon.a (mon.0) 299 : cluster [DBG] osd.3 reported immediately failed by osd.7 2021-03-10T13:52:11.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[29377]: cluster 2021-03-10T13:52:10.960150+0000 mon.a (mon.0) 300 : cluster [DBG] osd.3 reported immediately failed by osd.4 2021-03-10T13:52:11.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[29377]: cluster 2021-03-10T13:52:10.960299+0000 mon.a (mon.0) 301 : cluster [DBG] osd.3 reported immediately failed by osd.7 2021-03-10T13:52:11.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[29377]: cluster 2021-03-10T13:52:10.960487+0000 mon.a (mon.0) 302 : cluster [DBG] osd.3 reported immediately failed by osd.4 2021-03-10T13:52:11.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[29377]: cluster 2021-03-10T13:52:10.960671+0000 mon.a (mon.0) 303 : cluster [DBG] osd.3 reported immediately failed by osd.6 2021-03-10T13:52:11.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[29377]: cluster 2021-03-10T13:52:10.960861+0000 mon.a (mon.0) 304 : cluster [DBG] osd.3 reported immediately failed by osd.6 2021-03-10T13:52:11.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[29377]: cluster 2021-03-10T13:52:11.157960+0000 mon.a (mon.0) 305 : cluster [DBG] osd.3 reported immediately failed by osd.4 2021-03-10T13:52:11.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[29377]: cluster 2021-03-10T13:52:11.158513+0000 mon.a (mon.0) 306 : cluster [DBG] osd.3 reported immediately failed by osd.4 2021-03-10T13:52:11.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[29377]: cluster 2021-03-10T13:52:11.159255+0000 mon.a (mon.0) 307 : cluster [DBG] osd.3 reported immediately failed by osd.6 2021-03-10T13:52:11.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[29377]: cluster 2021-03-10T13:52:11.159592+0000 mon.a (mon.0) 308 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-03-10T13:52:11.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[29377]: cluster 2021-03-10T13:52:11.160015+0000 mon.a (mon.0) 309 : cluster [DBG] osd.3 reported immediately failed by osd.2 2021-03-10T13:52:11.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[29377]: cluster 2021-03-10T13:52:11.161318+0000 mon.a (mon.0) 310 : cluster [DBG] osd.3 reported immediately failed by osd.1 2021-03-10T13:52:11.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[29377]: cluster 2021-03-10T13:52:11.161537+0000 mon.a (mon.0) 311 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-03-10T13:52:11.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[29377]: cluster 2021-03-10T13:52:11.162082+0000 mon.a (mon.0) 312 : cluster [DBG] osd.3 reported immediately failed by osd.0 2021-03-10T13:52:11.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[29377]: cluster 2021-03-10T13:52:11.162278+0000 mon.a (mon.0) 313 : cluster [DBG] osd.3 reported immediately failed by osd.7 2021-03-10T13:52:11.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[29377]: cluster 2021-03-10T13:52:11.162812+0000 mon.a (mon.0) 314 : cluster [DBG] osd.3 reported immediately failed by osd.2 2021-03-10T13:52:11.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[29377]: cluster 2021-03-10T13:52:11.162992+0000 mon.a (mon.0) 315 : cluster [DBG] osd.3 reported immediately failed by osd.7 2021-03-10T13:52:11.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[29377]: cluster 2021-03-10T13:52:11.163497+0000 mon.a (mon.0) 316 : cluster [DBG] osd.3 reported immediately failed by osd.0 2021-03-10T13:52:11.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[29377]: cluster 2021-03-10T13:52:11.163783+0000 mon.a (mon.0) 317 : cluster [DBG] osd.3 reported immediately failed by osd.1 2021-03-10T13:52:11.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[29377]: cluster 2021-03-10T13:52:11.164303+0000 mon.a (mon.0) 318 : cluster [DBG] osd.3 reported immediately failed by osd.6 2021-03-10T13:52:11.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[29377]: cluster 2021-03-10T13:52:11.254303+0000 mon.a (mon.0) 319 : cluster [DBG] osd.3 reported immediately failed by osd.6 2021-03-10T13:52:11.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[29377]: cluster 2021-03-10T13:52:11.254784+0000 mon.a (mon.0) 320 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-03-10T13:52:11.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[29377]: cluster 2021-03-10T13:52:11.455743+0000 mon.a (mon.0) 321 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-03-10T13:52:11.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[30343]: cluster 2021-03-10T13:52:10.959527+0000 mon.a (mon.0) 296 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-03-10T13:52:11.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[30343]: cluster 2021-03-10T13:52:10.959567+0000 mon.a (mon.0) 297 : cluster [INF] osd.3 failed (root=default,host=gibba015) (connection refused reported by osd.5) 2021-03-10T13:52:11.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[30343]: cluster 2021-03-10T13:52:10.959789+0000 mon.a (mon.0) 298 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-03-10T13:52:11.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[30343]: cluster 2021-03-10T13:52:10.959938+0000 mon.a (mon.0) 299 : cluster [DBG] osd.3 reported immediately failed by osd.7 2021-03-10T13:52:11.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[30343]: cluster 2021-03-10T13:52:10.960150+0000 mon.a (mon.0) 300 : cluster [DBG] osd.3 reported immediately failed by osd.4 2021-03-10T13:52:11.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[30343]: cluster 2021-03-10T13:52:10.960299+0000 mon.a (mon.0) 301 : cluster [DBG] osd.3 reported immediately failed by osd.7 2021-03-10T13:52:11.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[30343]: cluster 2021-03-10T13:52:10.960487+0000 mon.a (mon.0) 302 : cluster [DBG] osd.3 reported immediately failed by osd.4 2021-03-10T13:52:11.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[30343]: cluster 2021-03-10T13:52:10.960671+0000 mon.a (mon.0) 303 : cluster [DBG] osd.3 reported immediately failed by osd.6 2021-03-10T13:52:11.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[30343]: cluster 2021-03-10T13:52:10.960861+0000 mon.a (mon.0) 304 : cluster [DBG] osd.3 reported immediately failed by osd.6 2021-03-10T13:52:11.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[30343]: cluster 2021-03-10T13:52:11.157960+0000 mon.a (mon.0) 305 : cluster [DBG] osd.3 reported immediately failed by osd.4 2021-03-10T13:52:11.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[30343]: cluster 2021-03-10T13:52:11.158513+0000 mon.a (mon.0) 306 : cluster [DBG] osd.3 reported immediately failed by osd.4 2021-03-10T13:52:11.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[30343]: cluster 2021-03-10T13:52:11.159255+0000 mon.a (mon.0) 307 : cluster [DBG] osd.3 reported immediately failed by osd.6 2021-03-10T13:52:11.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[30343]: cluster 2021-03-10T13:52:11.159592+0000 mon.a (mon.0) 308 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-03-10T13:52:11.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[30343]: cluster 2021-03-10T13:52:11.160015+0000 mon.a (mon.0) 309 : cluster [DBG] osd.3 reported immediately failed by osd.2 2021-03-10T13:52:11.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[30343]: cluster 2021-03-10T13:52:11.161318+0000 mon.a (mon.0) 310 : cluster [DBG] osd.3 reported immediately failed by osd.1 2021-03-10T13:52:11.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[30343]: cluster 2021-03-10T13:52:11.161537+0000 mon.a (mon.0) 311 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-03-10T13:52:11.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[30343]: cluster 2021-03-10T13:52:11.162082+0000 mon.a (mon.0) 312 : cluster [DBG] osd.3 reported immediately failed by osd.0 2021-03-10T13:52:11.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[30343]: cluster 2021-03-10T13:52:11.162278+0000 mon.a (mon.0) 313 : cluster [DBG] osd.3 reported immediately failed by osd.7 2021-03-10T13:52:11.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[30343]: cluster 2021-03-10T13:52:11.162812+0000 mon.a (mon.0) 314 : cluster [DBG] osd.3 reported immediately failed by osd.2 2021-03-10T13:52:11.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[30343]: cluster 2021-03-10T13:52:11.162992+0000 mon.a (mon.0) 315 : cluster [DBG] osd.3 reported immediately failed by osd.7 2021-03-10T13:52:11.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[30343]: cluster 2021-03-10T13:52:11.163497+0000 mon.a (mon.0) 316 : cluster [DBG] osd.3 reported immediately failed by osd.0 2021-03-10T13:52:11.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[30343]: cluster 2021-03-10T13:52:11.163783+0000 mon.a (mon.0) 317 : cluster [DBG] osd.3 reported immediately failed by osd.1 2021-03-10T13:52:11.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[30343]: cluster 2021-03-10T13:52:11.164303+0000 mon.a (mon.0) 318 : cluster [DBG] osd.3 reported immediately failed by osd.6 2021-03-10T13:52:11.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[30343]: cluster 2021-03-10T13:52:11.254303+0000 mon.a (mon.0) 319 : cluster [DBG] osd.3 reported immediately failed by osd.6 2021-03-10T13:52:11.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[30343]: cluster 2021-03-10T13:52:11.254784+0000 mon.a (mon.0) 320 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-03-10T13:52:11.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[30343]: cluster 2021-03-10T13:52:11.455743+0000 mon.a (mon.0) 321 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-03-10T13:52:11.983 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[29377]: cluster 2021-03-10T13:52:11.456155+0000 mon.a (mon.0) 322 : cluster [DBG] osd.3 reported immediately failed by osd.6 2021-03-10T13:52:11.983 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[29377]: cluster 2021-03-10T13:52:11.558293+0000 mon.a (mon.0) 323 : cluster [DBG] osd.3 reported immediately failed by osd.4 2021-03-10T13:52:11.984 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[29377]: cluster 2021-03-10T13:52:11.558602+0000 mon.a (mon.0) 324 : cluster [DBG] osd.3 reported immediately failed by osd.4 2021-03-10T13:52:11.984 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[29377]: cluster 2021-03-10T13:52:11.559093+0000 mon.a (mon.0) 325 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-03-10T13:52:11.984 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[29377]: cluster 2021-03-10T13:52:11.559390+0000 mon.a (mon.0) 326 : cluster [DBG] osd.3 reported immediately failed by osd.6 2021-03-10T13:52:11.984 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[29377]: cluster 2021-03-10T13:52:11.559910+0000 mon.a (mon.0) 327 : cluster [DBG] osd.3 reported immediately failed by osd.0 2021-03-10T13:52:11.984 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[29377]: cluster 2021-03-10T13:52:11.560197+0000 mon.a (mon.0) 328 : cluster [DBG] osd.3 reported immediately failed by osd.0 2021-03-10T13:52:11.985 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[29377]: cluster 2021-03-10T13:52:11.561227+0000 mon.a (mon.0) 329 : cluster [DBG] osd.3 reported immediately failed by osd.7 2021-03-10T13:52:11.985 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[29377]: cluster 2021-03-10T13:52:11.561427+0000 mon.a (mon.0) 330 : cluster [DBG] osd.3 reported immediately failed by osd.7 2021-03-10T13:52:11.985 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[29377]: cluster 2021-03-10T13:52:11.561950+0000 mon.a (mon.0) 331 : cluster [DBG] osd.3 reported immediately failed by osd.6 2021-03-10T13:52:11.985 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[29377]: cluster 2021-03-10T13:52:11.562244+0000 mon.a (mon.0) 332 : cluster [DBG] osd.3 reported immediately failed by osd.1 2021-03-10T13:52:11.985 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[29377]: cluster 2021-03-10T13:52:11.562735+0000 mon.a (mon.0) 333 : cluster [DBG] osd.3 reported immediately failed by osd.1 2021-03-10T13:52:11.986 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[29377]: cluster 2021-03-10T13:52:11.563012+0000 mon.a (mon.0) 334 : cluster [DBG] osd.3 reported immediately failed by osd.2 2021-03-10T13:52:11.986 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[29377]: cluster 2021-03-10T13:52:11.563553+0000 mon.a (mon.0) 335 : cluster [DBG] osd.3 reported immediately failed by osd.2 2021-03-10T13:52:11.986 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[29377]: cluster 2021-03-10T13:52:11.563741+0000 mon.a (mon.0) 336 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-03-10T13:52:11.986 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[29377]: cluster 2021-03-10T13:52:11.657378+0000 mon.a (mon.0) 337 : cluster [DBG] osd.3 reported immediately failed by osd.1 2021-03-10T13:52:11.986 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[29377]: cluster 2021-03-10T13:52:11.658792+0000 mon.a (mon.0) 338 : cluster [DBG] osd.3 reported immediately failed by osd.4 2021-03-10T13:52:11.987 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[30343]: cluster 2021-03-10T13:52:11.456155+0000 mon.a (mon.0) 322 : cluster [DBG] osd.3 reported immediately failed by osd.6 2021-03-10T13:52:11.987 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[30343]: cluster 2021-03-10T13:52:11.558293+0000 mon.a (mon.0) 323 : cluster [DBG] osd.3 reported immediately failed by osd.4 2021-03-10T13:52:11.987 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[30343]: cluster 2021-03-10T13:52:11.558602+0000 mon.a (mon.0) 324 : cluster [DBG] osd.3 reported immediately failed by osd.4 2021-03-10T13:52:11.987 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[30343]: cluster 2021-03-10T13:52:11.559093+0000 mon.a (mon.0) 325 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-03-10T13:52:11.988 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[30343]: cluster 2021-03-10T13:52:11.559390+0000 mon.a (mon.0) 326 : cluster [DBG] osd.3 reported immediately failed by osd.6 2021-03-10T13:52:11.988 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[30343]: cluster 2021-03-10T13:52:11.559910+0000 mon.a (mon.0) 327 : cluster [DBG] osd.3 reported immediately failed by osd.0 2021-03-10T13:52:11.988 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[30343]: cluster 2021-03-10T13:52:11.560197+0000 mon.a (mon.0) 328 : cluster [DBG] osd.3 reported immediately failed by osd.0 2021-03-10T13:52:11.988 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[30343]: cluster 2021-03-10T13:52:11.561227+0000 mon.a (mon.0) 329 : cluster [DBG] osd.3 reported immediately failed by osd.7 2021-03-10T13:52:11.988 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[30343]: cluster 2021-03-10T13:52:11.561427+0000 mon.a (mon.0) 330 : cluster [DBG] osd.3 reported immediately failed by osd.7 2021-03-10T13:52:11.989 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[30343]: cluster 2021-03-10T13:52:11.561950+0000 mon.a (mon.0) 331 : cluster [DBG] osd.3 reported immediately failed by osd.6 2021-03-10T13:52:11.989 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[30343]: cluster 2021-03-10T13:52:11.562244+0000 mon.a (mon.0) 332 : cluster [DBG] osd.3 reported immediately failed by osd.1 2021-03-10T13:52:11.989 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[30343]: cluster 2021-03-10T13:52:11.562735+0000 mon.a (mon.0) 333 : cluster [DBG] osd.3 reported immediately failed by osd.1 2021-03-10T13:52:11.989 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[30343]: cluster 2021-03-10T13:52:11.563012+0000 mon.a (mon.0) 334 : cluster [DBG] osd.3 reported immediately failed by osd.2 2021-03-10T13:52:11.989 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[30343]: cluster 2021-03-10T13:52:11.563553+0000 mon.a (mon.0) 335 : cluster [DBG] osd.3 reported immediately failed by osd.2 2021-03-10T13:52:11.990 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[30343]: cluster 2021-03-10T13:52:11.563741+0000 mon.a (mon.0) 336 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-03-10T13:52:11.990 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[30343]: cluster 2021-03-10T13:52:11.657378+0000 mon.a (mon.0) 337 : cluster [DBG] osd.3 reported immediately failed by osd.1 2021-03-10T13:52:11.990 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:11 gibba015 bash[30343]: cluster 2021-03-10T13:52:11.658792+0000 mon.a (mon.0) 338 : cluster [DBG] osd.3 reported immediately failed by osd.4 2021-03-10T13:52:11.995 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T13:52:12.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:11 gibba045 bash[25517]: cluster 2021-03-10T13:52:10.959527+0000 mon.a (mon.0) 296 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-03-10T13:52:12.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:11 gibba045 bash[25517]: cluster 2021-03-10T13:52:10.959567+0000 mon.a (mon.0) 297 : cluster [INF] osd.3 failed (root=default,host=gibba015) (connection refused reported by osd.5) 2021-03-10T13:52:12.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:11 gibba045 bash[25517]: cluster 2021-03-10T13:52:10.959789+0000 mon.a (mon.0) 298 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-03-10T13:52:12.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:11 gibba045 bash[25517]: cluster 2021-03-10T13:52:10.959938+0000 mon.a (mon.0) 299 : cluster [DBG] osd.3 reported immediately failed by osd.7 2021-03-10T13:52:12.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:11 gibba045 bash[25517]: cluster 2021-03-10T13:52:10.960150+0000 mon.a (mon.0) 300 : cluster [DBG] osd.3 reported immediately failed by osd.4 2021-03-10T13:52:12.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:11 gibba045 bash[25517]: cluster 2021-03-10T13:52:10.960299+0000 mon.a (mon.0) 301 : cluster [DBG] osd.3 reported immediately failed by osd.7 2021-03-10T13:52:12.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:11 gibba045 bash[25517]: cluster 2021-03-10T13:52:10.960487+0000 mon.a (mon.0) 302 : cluster [DBG] osd.3 reported immediately failed by osd.4 2021-03-10T13:52:12.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:11 gibba045 bash[25517]: cluster 2021-03-10T13:52:10.960671+0000 mon.a (mon.0) 303 : cluster [DBG] osd.3 reported immediately failed by osd.6 2021-03-10T13:52:12.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:11 gibba045 bash[25517]: cluster 2021-03-10T13:52:10.960861+0000 mon.a (mon.0) 304 : cluster [DBG] osd.3 reported immediately failed by osd.6 2021-03-10T13:52:12.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:11 gibba045 bash[25517]: cluster 2021-03-10T13:52:11.157960+0000 mon.a (mon.0) 305 : cluster [DBG] osd.3 reported immediately failed by osd.4 2021-03-10T13:52:12.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:11 gibba045 bash[25517]: cluster 2021-03-10T13:52:11.158513+0000 mon.a (mon.0) 306 : cluster [DBG] osd.3 reported immediately failed by osd.4 2021-03-10T13:52:12.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:11 gibba045 bash[25517]: cluster 2021-03-10T13:52:11.159255+0000 mon.a (mon.0) 307 : cluster [DBG] osd.3 reported immediately failed by osd.6 2021-03-10T13:52:12.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:11 gibba045 bash[25517]: cluster 2021-03-10T13:52:11.159592+0000 mon.a (mon.0) 308 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-03-10T13:52:12.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:11 gibba045 bash[25517]: cluster 2021-03-10T13:52:11.160015+0000 mon.a (mon.0) 309 : cluster [DBG] osd.3 reported immediately failed by osd.2 2021-03-10T13:52:12.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:11 gibba045 bash[25517]: cluster 2021-03-10T13:52:11.161318+0000 mon.a (mon.0) 310 : cluster [DBG] osd.3 reported immediately failed by osd.1 2021-03-10T13:52:12.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:11 gibba045 bash[25517]: cluster 2021-03-10T13:52:11.161537+0000 mon.a (mon.0) 311 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-03-10T13:52:12.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:11 gibba045 bash[25517]: cluster 2021-03-10T13:52:11.162082+0000 mon.a (mon.0) 312 : cluster [DBG] osd.3 reported immediately failed by osd.0 2021-03-10T13:52:12.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:11 gibba045 bash[25517]: cluster 2021-03-10T13:52:11.162278+0000 mon.a (mon.0) 313 : cluster [DBG] osd.3 reported immediately failed by osd.7 2021-03-10T13:52:12.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:11 gibba045 bash[25517]: cluster 2021-03-10T13:52:11.162812+0000 mon.a (mon.0) 314 : cluster [DBG] osd.3 reported immediately failed by osd.2 2021-03-10T13:52:12.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:11 gibba045 bash[25517]: cluster 2021-03-10T13:52:11.162992+0000 mon.a (mon.0) 315 : cluster [DBG] osd.3 reported immediately failed by osd.7 2021-03-10T13:52:12.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:11 gibba045 bash[25517]: cluster 2021-03-10T13:52:11.163497+0000 mon.a (mon.0) 316 : cluster [DBG] osd.3 reported immediately failed by osd.0 2021-03-10T13:52:12.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:11 gibba045 bash[25517]: cluster 2021-03-10T13:52:11.163783+0000 mon.a (mon.0) 317 : cluster [DBG] osd.3 reported immediately failed by osd.1 2021-03-10T13:52:12.062 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:11 gibba045 bash[25517]: cluster 2021-03-10T13:52:11.164303+0000 mon.a (mon.0) 318 : cluster [DBG] osd.3 reported immediately failed by osd.6 2021-03-10T13:52:12.062 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:11 gibba045 bash[25517]: cluster 2021-03-10T13:52:11.254303+0000 mon.a (mon.0) 319 : cluster [DBG] osd.3 reported immediately failed by osd.6 2021-03-10T13:52:12.062 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:11 gibba045 bash[25517]: cluster 2021-03-10T13:52:11.254784+0000 mon.a (mon.0) 320 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-03-10T13:52:12.062 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:11 gibba045 bash[25517]: cluster 2021-03-10T13:52:11.455743+0000 mon.a (mon.0) 321 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-03-10T13:52:12.063 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:11 gibba045 bash[25517]: cluster 2021-03-10T13:52:11.456155+0000 mon.a (mon.0) 322 : cluster [DBG] osd.3 reported immediately failed by osd.6 2021-03-10T13:52:12.063 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:11 gibba045 bash[25517]: cluster 2021-03-10T13:52:11.558293+0000 mon.a (mon.0) 323 : cluster [DBG] osd.3 reported immediately failed by osd.4 2021-03-10T13:52:12.063 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:11 gibba045 bash[25517]: cluster 2021-03-10T13:52:11.558602+0000 mon.a (mon.0) 324 : cluster [DBG] osd.3 reported immediately failed by osd.4 2021-03-10T13:52:12.063 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:11 gibba045 bash[25517]: cluster 2021-03-10T13:52:11.559093+0000 mon.a (mon.0) 325 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-03-10T13:52:12.064 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:11 gibba045 bash[25517]: cluster 2021-03-10T13:52:11.559390+0000 mon.a (mon.0) 326 : cluster [DBG] osd.3 reported immediately failed by osd.6 2021-03-10T13:52:12.064 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:11 gibba045 bash[25517]: cluster 2021-03-10T13:52:11.559910+0000 mon.a (mon.0) 327 : cluster [DBG] osd.3 reported immediately failed by osd.0 2021-03-10T13:52:12.064 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:11 gibba045 bash[25517]: cluster 2021-03-10T13:52:11.560197+0000 mon.a (mon.0) 328 : cluster [DBG] osd.3 reported immediately failed by osd.0 2021-03-10T13:52:12.064 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:11 gibba045 bash[25517]: cluster 2021-03-10T13:52:11.561227+0000 mon.a (mon.0) 329 : cluster [DBG] osd.3 reported immediately failed by osd.7 2021-03-10T13:52:12.064 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:11 gibba045 bash[25517]: cluster 2021-03-10T13:52:11.561427+0000 mon.a (mon.0) 330 : cluster [DBG] osd.3 reported immediately failed by osd.7 2021-03-10T13:52:12.065 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:11 gibba045 bash[25517]: cluster 2021-03-10T13:52:11.561950+0000 mon.a (mon.0) 331 : cluster [DBG] osd.3 reported immediately failed by osd.6 2021-03-10T13:52:12.065 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:11 gibba045 bash[25517]: cluster 2021-03-10T13:52:11.562244+0000 mon.a (mon.0) 332 : cluster [DBG] osd.3 reported immediately failed by osd.1 2021-03-10T13:52:12.065 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:11 gibba045 bash[25517]: cluster 2021-03-10T13:52:11.562735+0000 mon.a (mon.0) 333 : cluster [DBG] osd.3 reported immediately failed by osd.1 2021-03-10T13:52:12.065 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:11 gibba045 bash[25517]: cluster 2021-03-10T13:52:11.563012+0000 mon.a (mon.0) 334 : cluster [DBG] osd.3 reported immediately failed by osd.2 2021-03-10T13:52:12.065 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:11 gibba045 bash[25517]: cluster 2021-03-10T13:52:11.563553+0000 mon.a (mon.0) 335 : cluster [DBG] osd.3 reported immediately failed by osd.2 2021-03-10T13:52:12.066 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:11 gibba045 bash[25517]: cluster 2021-03-10T13:52:11.563741+0000 mon.a (mon.0) 336 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-03-10T13:52:12.066 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:11 gibba045 bash[25517]: cluster 2021-03-10T13:52:11.657378+0000 mon.a (mon.0) 337 : cluster [DBG] osd.3 reported immediately failed by osd.1 2021-03-10T13:52:12.066 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:11 gibba045 bash[25517]: cluster 2021-03-10T13:52:11.658792+0000 mon.a (mon.0) 338 : cluster [DBG] osd.3 reported immediately failed by osd.4 2021-03-10T13:52:12.240 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T13:52:12.240 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2m) 20s ago 8m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T13:52:12.240 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (8m) 109s ago 8m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T13:52:12.240 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3m) 109s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T13:52:12.241 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3m) 109s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T13:52:12.241 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2m) 20s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T13:52:12.241 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2m) 20s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T13:52:12.241 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (119s) 109s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T13:52:12.241 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2m) 20s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T13:52:12.242 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (8m) 20s ago 8m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T13:52:12.242 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (8m) 109s ago 8m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T13:52:12.242 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (73s) 20s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T13:52:12.242 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (47s) 20s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T13:52:12.242 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (22s) 20s ago 10m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T13:52:12.243 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (10m) 20s ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 a77eccf371e5 2021-03-10T13:52:12.243 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (9m) 109s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 9b9c84c84955 2021-03-10T13:52:12.243 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (9m) 109s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 662e73261675 2021-03-10T13:52:12.243 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (9m) 109s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 338d252f22e3 2021-03-10T13:52:12.243 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (8m) 109s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 784edc0668a4 2021-03-10T13:52:12.244 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (7m) 109s ago 8m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T13:52:12.244 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 109s ago 6m docker.io/ceph/ceph:v15.2.0 2021-03-10T13:52:12.494 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T13:52:12.494 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T13:52:12.494 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:52:12.495 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T13:52:12.495 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T13:52:12.495 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:52:12.495 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T13:52:12.495 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T13:52:12.496 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 4, 2021-03-10T13:52:12.496 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:52:12.496 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T13:52:12.496 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T13:52:12.497 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T13:52:12.497 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 4, 2021-03-10T13:52:12.497 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 9 2021-03-10T13:52:12.497 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T13:52:12.497 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T13:52:12.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:12 gibba015 bash[29377]: cluster 2021-03-10T13:52:11.030364+0000 mgr.gibba045.orlgmj (mgr.34412) 189 : cluster [DBG] pgmap v88: 129 pgs: 10 active+clean+wait, 119 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail 2021-03-10T13:52:12.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:12 gibba015 bash[29377]: cluster 2021-03-10T13:52:11.798199+0000 mon.a (mon.0) 339 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T13:52:12.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:12 gibba015 bash[29377]: cluster 2021-03-10T13:52:11.813202+0000 mon.a (mon.0) 340 : cluster [DBG] osdmap e78: 8 total, 7 up, 8 in 2021-03-10T13:52:12.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:12 gibba015 bash[29377]: audit 2021-03-10T13:52:12.492311+0000 mon.a (mon.0) 341 : audit [DBG] from='client.? 172.21.2.115:0/2709651695' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:52:12.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:12 gibba015 bash[30343]: cluster 2021-03-10T13:52:11.030364+0000 mgr.gibba045.orlgmj (mgr.34412) 189 : cluster [DBG] pgmap v88: 129 pgs: 10 active+clean+wait, 119 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail 2021-03-10T13:52:12.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:12 gibba015 bash[30343]: cluster 2021-03-10T13:52:11.798199+0000 mon.a (mon.0) 339 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T13:52:12.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:12 gibba015 bash[30343]: cluster 2021-03-10T13:52:11.813202+0000 mon.a (mon.0) 340 : cluster [DBG] osdmap e78: 8 total, 7 up, 8 in 2021-03-10T13:52:12.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:12 gibba015 bash[30343]: audit 2021-03-10T13:52:12.492311+0000 mon.a (mon.0) 341 : audit [DBG] from='client.? 172.21.2.115:0/2709651695' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:52:13.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:12 gibba045 bash[25517]: cluster 2021-03-10T13:52:11.030364+0000 mgr.gibba045.orlgmj (mgr.34412) 189 : cluster [DBG] pgmap v88: 129 pgs: 10 active+clean+wait, 119 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail 2021-03-10T13:52:13.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:12 gibba045 bash[25517]: cluster 2021-03-10T13:52:11.798199+0000 mon.a (mon.0) 339 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T13:52:13.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:12 gibba045 bash[25517]: cluster 2021-03-10T13:52:11.813202+0000 mon.a (mon.0) 340 : cluster [DBG] osdmap e78: 8 total, 7 up, 8 in 2021-03-10T13:52:13.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:12 gibba045 bash[25517]: audit 2021-03-10T13:52:12.492311+0000 mon.a (mon.0) 341 : audit [DBG] from='client.? 172.21.2.115:0/2709651695' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:52:13.971 INFO:journalctl@ceph.osd.3.gibba015.stdout:Mar 10 13:52:13 gibba015 systemd[1]: ceph-e4a642d2-81a5-11eb-9080-001a4aab830c@osd.3.service: Succeeded. 2021-03-10T13:52:13.972 INFO:journalctl@ceph.osd.3.gibba015.stdout:Mar 10 13:52:13 gibba015 systemd[1]: Stopped Ceph osd.3 for e4a642d2-81a5-11eb-9080-001a4aab830c. 2021-03-10T13:52:13.972 INFO:journalctl@ceph.osd.3.gibba015.stdout:Mar 10 13:52:13 gibba015 systemd[1]: Started Ceph osd.3 for e4a642d2-81a5-11eb-9080-001a4aab830c. 2021-03-10T13:52:13.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:13 gibba015 bash[29377]: audit 2021-03-10T13:52:11.976718+0000 mgr.gibba045.orlgmj (mgr.34412) 190 : audit [DBG] from='client.44205 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:52:13.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:13 gibba015 bash[29377]: audit 2021-03-10T13:52:12.227764+0000 mgr.gibba045.orlgmj (mgr.34412) 191 : audit [DBG] from='client.44211 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:52:13.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:13 gibba015 bash[29377]: cluster 2021-03-10T13:52:12.814214+0000 mon.a (mon.0) 342 : cluster [DBG] osdmap e79: 8 total, 7 up, 8 in 2021-03-10T13:52:13.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:13 gibba015 bash[29377]: audit 2021-03-10T13:52:13.799512+0000 mon.a (mon.0) 343 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:52:13.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:13 gibba015 bash[29377]: audit 2021-03-10T13:52:13.800486+0000 mon.c (mon.1) 98 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:52:13.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:13 gibba015 bash[29377]: audit 2021-03-10T13:52:13.801852+0000 mon.c (mon.1) 99 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:52:13.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:13 gibba015 bash[30343]: audit 2021-03-10T13:52:11.976718+0000 mgr.gibba045.orlgmj (mgr.34412) 190 : audit [DBG] from='client.44205 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:52:13.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:13 gibba015 bash[30343]: audit 2021-03-10T13:52:12.227764+0000 mgr.gibba045.orlgmj (mgr.34412) 191 : audit [DBG] from='client.44211 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:52:13.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:13 gibba015 bash[30343]: cluster 2021-03-10T13:52:12.814214+0000 mon.a (mon.0) 342 : cluster [DBG] osdmap e79: 8 total, 7 up, 8 in 2021-03-10T13:52:13.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:13 gibba015 bash[30343]: audit 2021-03-10T13:52:13.799512+0000 mon.a (mon.0) 343 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:52:13.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:13 gibba015 bash[30343]: audit 2021-03-10T13:52:13.800486+0000 mon.c (mon.1) 98 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:52:13.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:13 gibba015 bash[30343]: audit 2021-03-10T13:52:13.801852+0000 mon.c (mon.1) 99 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:52:14.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:13 gibba045 bash[25517]: audit 2021-03-10T13:52:11.976718+0000 mgr.gibba045.orlgmj (mgr.34412) 190 : audit [DBG] from='client.44205 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:52:14.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:13 gibba045 bash[25517]: audit 2021-03-10T13:52:12.227764+0000 mgr.gibba045.orlgmj (mgr.34412) 191 : audit [DBG] from='client.44211 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:52:14.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:13 gibba045 bash[25517]: cluster 2021-03-10T13:52:12.814214+0000 mon.a (mon.0) 342 : cluster [DBG] osdmap e79: 8 total, 7 up, 8 in 2021-03-10T13:52:14.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:13 gibba045 bash[25517]: audit 2021-03-10T13:52:13.799512+0000 mon.a (mon.0) 343 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:52:14.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:13 gibba045 bash[25517]: audit 2021-03-10T13:52:13.800486+0000 mon.c (mon.1) 98 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:52:14.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:13 gibba045 bash[25517]: audit 2021-03-10T13:52:13.801852+0000 mon.c (mon.1) 99 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:52:15.120 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:14 gibba015 bash[29377]: cluster 2021-03-10T13:52:13.031477+0000 mgr.gibba045.orlgmj (mgr.34412) 192 : cluster [DBG] pgmap v91: 129 pgs: 20 stale+active+clean, 10 active+clean+wait, 99 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail 2021-03-10T13:52:15.121 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:14 gibba015 bash[30343]: cluster 2021-03-10T13:52:13.031477+0000 mgr.gibba045.orlgmj (mgr.34412) 192 : cluster [DBG] pgmap v91: 129 pgs: 20 stale+active+clean, 10 active+clean+wait, 99 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail 2021-03-10T13:52:15.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:14 gibba045 bash[25517]: cluster 2021-03-10T13:52:13.031477+0000 mgr.gibba045.orlgmj (mgr.34412) 192 : cluster [DBG] pgmap v91: 129 pgs: 20 stale+active+clean, 10 active+clean+wait, 99 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail 2021-03-10T13:52:15.472 INFO:journalctl@ceph.osd.3.gibba015.stdout:Mar 10 13:52:15 gibba015 bash[35555]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2021-03-10T13:52:15.472 INFO:journalctl@ceph.osd.3.gibba015.stdout:Mar 10 13:52:15 gibba015 bash[35555]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_1 --path /var/lib/ceph/osd/ceph-3 --no-mon-config 2021-03-10T13:52:15.473 INFO:journalctl@ceph.osd.3.gibba015.stdout:Mar 10 13:52:15 gibba015 bash[35555]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3/block 2021-03-10T13:52:15.473 INFO:journalctl@ceph.osd.3.gibba015.stdout:Mar 10 13:52:15 gibba015 bash[35555]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-3/block 2021-03-10T13:52:15.473 INFO:journalctl@ceph.osd.3.gibba015.stdout:Mar 10 13:52:15 gibba015 bash[35555]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2021-03-10T13:52:15.473 INFO:journalctl@ceph.osd.3.gibba015.stdout:Mar 10 13:52:15 gibba015 bash[35555]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2021-03-10T13:52:15.473 INFO:journalctl@ceph.osd.3.gibba015.stdout:Mar 10 13:52:15 gibba015 bash[35555]: --> ceph-volume lvm activate successful for osd ID: 3 2021-03-10T13:52:16.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:15 gibba015 bash[29377]: cluster 2021-03-10T13:52:15.033929+0000 mgr.gibba045.orlgmj (mgr.34412) 193 : cluster [DBG] pgmap v92: 129 pgs: 1 stale+active+clean, 15 active+undersized+degraded, 10 active+clean+wait, 30 active+undersized, 73 active+clean; 7.0 KiB data, 23 MiB used, 667 GiB / 672 GiB avail; 18/192 objects degraded (9.375%) 2021-03-10T13:52:16.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:15 gibba015 bash[30343]: cluster 2021-03-10T13:52:15.033929+0000 mgr.gibba045.orlgmj (mgr.34412) 193 : cluster [DBG] pgmap v92: 129 pgs: 1 stale+active+clean, 15 active+undersized+degraded, 10 active+clean+wait, 30 active+undersized, 73 active+clean; 7.0 KiB data, 23 MiB used, 667 GiB / 672 GiB avail; 18/192 objects degraded (9.375%) 2021-03-10T13:52:16.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:15 gibba045 bash[25517]: cluster 2021-03-10T13:52:15.033929+0000 mgr.gibba045.orlgmj (mgr.34412) 193 : cluster [DBG] pgmap v92: 129 pgs: 1 stale+active+clean, 15 active+undersized+degraded, 10 active+clean+wait, 30 active+undersized, 73 active+clean; 7.0 KiB data, 23 MiB used, 667 GiB / 672 GiB avail; 18/192 objects degraded (9.375%) 2021-03-10T13:52:16.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:16 gibba015 bash[29377]: cluster 2021-03-10T13:52:15.821209+0000 mon.a (mon.0) 344 : cluster [WRN] Health check failed: Degraded data redundancy: 18/192 objects degraded (9.375%), 15 pgs degraded (PG_DEGRADED) 2021-03-10T13:52:16.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:16 gibba015 bash[30343]: cluster 2021-03-10T13:52:15.821209+0000 mon.a (mon.0) 344 : cluster [WRN] Health check failed: Degraded data redundancy: 18/192 objects degraded (9.375%), 15 pgs degraded (PG_DEGRADED) 2021-03-10T13:52:16.973 INFO:journalctl@ceph.osd.3.gibba015.stdout:Mar 10 13:52:16 gibba015 bash[35675]: debug 2021-03-10T13:52:16.644+0000 7f553cf38700 1 -- 172.21.2.115:0/2030550311 <== mon.0 v2:172.21.2.115:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5644378f04e0 con 0x56443796cc00 2021-03-10T13:52:17.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:16 gibba045 bash[25517]: cluster 2021-03-10T13:52:15.821209+0000 mon.a (mon.0) 344 : cluster [WRN] Health check failed: Degraded data redundancy: 18/192 objects degraded (9.375%), 15 pgs degraded (PG_DEGRADED) 2021-03-10T13:52:17.471 INFO:journalctl@ceph.osd.3.gibba015.stdout:Mar 10 13:52:17 gibba015 bash[35675]: debug 2021-03-10T13:52:17.196+0000 7f55449cd080 -1 Falling back to public interface 2021-03-10T13:52:18.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:18 gibba045 bash[25517]: cluster 2021-03-10T13:52:17.035169+0000 mgr.gibba045.orlgmj (mgr.34412) 194 : cluster [DBG] pgmap v93: 129 pgs: 16 active+undersized+degraded, 34 active+undersized, 79 active+clean; 7.0 KiB data, 23 MiB used, 667 GiB / 672 GiB avail; 19/192 objects degraded (9.896%) 2021-03-10T13:52:18.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:18 gibba045 bash[25517]: audit 2021-03-10T13:52:17.233982+0000 mon.a (mon.0) 345 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:52:18.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:18 gibba045 bash[25517]: cephadm 2021-03-10T13:52:17.238849+0000 mgr.gibba045.orlgmj (mgr.34412) 195 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T13:52:18.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:18 gibba045 bash[25517]: audit 2021-03-10T13:52:17.445777+0000 mon.a (mon.0) 346 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:52:18.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:18 gibba045 bash[25517]: audit 2021-03-10T13:52:17.454151+0000 mon.c (mon.1) 100 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:52:18.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:18 gibba045 bash[25517]: cephadm 2021-03-10T13:52:17.454670+0000 mgr.gibba045.orlgmj (mgr.34412) 196 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:52:18.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:18 gibba045 bash[25517]: audit 2021-03-10T13:52:17.456049+0000 mon.c (mon.1) 101 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:52:18.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:18 gibba045 bash[25517]: cephadm 2021-03-10T13:52:17.456817+0000 mgr.gibba045.orlgmj (mgr.34412) 197 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:52:18.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:18 gibba045 bash[25517]: audit 2021-03-10T13:52:17.457490+0000 mon.c (mon.1) 102 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:52:18.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:18 gibba045 bash[25517]: cephadm 2021-03-10T13:52:17.458498+0000 mgr.gibba045.orlgmj (mgr.34412) 198 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:52:18.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:18 gibba045 bash[25517]: cephadm 2021-03-10T13:52:17.458536+0000 mgr.gibba045.orlgmj (mgr.34412) 199 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:52:18.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:18 gibba045 bash[25517]: audit 2021-03-10T13:52:17.458810+0000 mon.c (mon.1) 103 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:52:18.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:18 gibba045 bash[25517]: cephadm 2021-03-10T13:52:17.459708+0000 mgr.gibba045.orlgmj (mgr.34412) 200 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:52:18.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:18 gibba045 bash[25517]: cephadm 2021-03-10T13:52:17.459760+0000 mgr.gibba045.orlgmj (mgr.34412) 201 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:52:18.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:18 gibba045 bash[25517]: cephadm 2021-03-10T13:52:17.461210+0000 mgr.gibba045.orlgmj (mgr.34412) 202 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:52:18.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:18 gibba045 bash[25517]: audit 2021-03-10T13:52:17.462238+0000 mon.c (mon.1) 104 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-03-10T13:52:18.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:18 gibba045 bash[25517]: cephadm 2021-03-10T13:52:17.462963+0000 mgr.gibba045.orlgmj (mgr.34412) 203 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:52:18.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:18 gibba045 bash[25517]: cephadm 2021-03-10T13:52:17.463033+0000 mgr.gibba045.orlgmj (mgr.34412) 204 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:52:18.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:18 gibba045 bash[25517]: audit 2021-03-10T13:52:17.463807+0000 mgr.gibba045.orlgmj (mgr.34412) 205 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-03-10T13:52:18.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:18 gibba045 bash[25517]: cephadm 2021-03-10T13:52:17.465189+0000 mgr.gibba045.orlgmj (mgr.34412) 206 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (16 PGs are or would become offline) 2021-03-10T13:52:18.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:18 gibba015 bash[29377]: cluster 2021-03-10T13:52:17.035169+0000 mgr.gibba045.orlgmj (mgr.34412) 194 : cluster [DBG] pgmap v93: 129 pgs: 16 active+undersized+degraded, 34 active+undersized, 79 active+clean; 7.0 KiB data, 23 MiB used, 667 GiB / 672 GiB avail; 19/192 objects degraded (9.896%) 2021-03-10T13:52:18.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:18 gibba015 bash[29377]: audit 2021-03-10T13:52:17.233982+0000 mon.a (mon.0) 345 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:52:18.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:18 gibba015 bash[29377]: cephadm 2021-03-10T13:52:17.238849+0000 mgr.gibba045.orlgmj (mgr.34412) 195 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T13:52:18.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:18 gibba015 bash[29377]: audit 2021-03-10T13:52:17.445777+0000 mon.a (mon.0) 346 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:52:18.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:18 gibba015 bash[29377]: audit 2021-03-10T13:52:17.454151+0000 mon.c (mon.1) 100 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:52:18.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:18 gibba015 bash[29377]: cephadm 2021-03-10T13:52:17.454670+0000 mgr.gibba045.orlgmj (mgr.34412) 196 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:52:18.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:18 gibba015 bash[29377]: audit 2021-03-10T13:52:17.456049+0000 mon.c (mon.1) 101 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:52:18.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:18 gibba015 bash[29377]: cephadm 2021-03-10T13:52:17.456817+0000 mgr.gibba045.orlgmj (mgr.34412) 197 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:52:18.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:18 gibba015 bash[29377]: audit 2021-03-10T13:52:17.457490+0000 mon.c (mon.1) 102 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:52:18.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:18 gibba015 bash[29377]: cephadm 2021-03-10T13:52:17.458498+0000 mgr.gibba045.orlgmj (mgr.34412) 198 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:52:18.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:18 gibba015 bash[29377]: cephadm 2021-03-10T13:52:17.458536+0000 mgr.gibba045.orlgmj (mgr.34412) 199 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:52:18.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:18 gibba015 bash[29377]: audit 2021-03-10T13:52:17.458810+0000 mon.c (mon.1) 103 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:52:18.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:18 gibba015 bash[29377]: cephadm 2021-03-10T13:52:17.459708+0000 mgr.gibba045.orlgmj (mgr.34412) 200 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:52:18.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:18 gibba015 bash[29377]: cephadm 2021-03-10T13:52:17.459760+0000 mgr.gibba045.orlgmj (mgr.34412) 201 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:52:18.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:18 gibba015 bash[29377]: cephadm 2021-03-10T13:52:17.461210+0000 mgr.gibba045.orlgmj (mgr.34412) 202 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:52:18.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:18 gibba015 bash[29377]: audit 2021-03-10T13:52:17.462238+0000 mon.c (mon.1) 104 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-03-10T13:52:18.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:18 gibba015 bash[29377]: cephadm 2021-03-10T13:52:17.462963+0000 mgr.gibba045.orlgmj (mgr.34412) 203 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:52:18.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:18 gibba015 bash[29377]: cephadm 2021-03-10T13:52:17.463033+0000 mgr.gibba045.orlgmj (mgr.34412) 204 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:52:18.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:18 gibba015 bash[29377]: audit 2021-03-10T13:52:17.463807+0000 mgr.gibba045.orlgmj (mgr.34412) 205 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-03-10T13:52:18.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:18 gibba015 bash[29377]: cephadm 2021-03-10T13:52:17.465189+0000 mgr.gibba045.orlgmj (mgr.34412) 206 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (16 PGs are or would become offline) 2021-03-10T13:52:18.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:18 gibba015 bash[30343]: cluster 2021-03-10T13:52:17.035169+0000 mgr.gibba045.orlgmj (mgr.34412) 194 : cluster [DBG] pgmap v93: 129 pgs: 16 active+undersized+degraded, 34 active+undersized, 79 active+clean; 7.0 KiB data, 23 MiB used, 667 GiB / 672 GiB avail; 19/192 objects degraded (9.896%) 2021-03-10T13:52:18.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:18 gibba015 bash[30343]: audit 2021-03-10T13:52:17.233982+0000 mon.a (mon.0) 345 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:52:18.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:18 gibba015 bash[30343]: cephadm 2021-03-10T13:52:17.238849+0000 mgr.gibba045.orlgmj (mgr.34412) 195 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T13:52:18.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:18 gibba015 bash[30343]: audit 2021-03-10T13:52:17.445777+0000 mon.a (mon.0) 346 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:52:18.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:18 gibba015 bash[30343]: audit 2021-03-10T13:52:17.454151+0000 mon.c (mon.1) 100 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:52:18.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:18 gibba015 bash[30343]: cephadm 2021-03-10T13:52:17.454670+0000 mgr.gibba045.orlgmj (mgr.34412) 196 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:52:18.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:18 gibba015 bash[30343]: audit 2021-03-10T13:52:17.456049+0000 mon.c (mon.1) 101 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:52:18.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:18 gibba015 bash[30343]: cephadm 2021-03-10T13:52:17.456817+0000 mgr.gibba045.orlgmj (mgr.34412) 197 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:52:18.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:18 gibba015 bash[30343]: audit 2021-03-10T13:52:17.457490+0000 mon.c (mon.1) 102 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:52:18.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:18 gibba015 bash[30343]: cephadm 2021-03-10T13:52:17.458498+0000 mgr.gibba045.orlgmj (mgr.34412) 198 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:52:18.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:18 gibba015 bash[30343]: cephadm 2021-03-10T13:52:17.458536+0000 mgr.gibba045.orlgmj (mgr.34412) 199 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:52:18.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:18 gibba015 bash[30343]: audit 2021-03-10T13:52:17.458810+0000 mon.c (mon.1) 103 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:52:18.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:18 gibba015 bash[30343]: cephadm 2021-03-10T13:52:17.459708+0000 mgr.gibba045.orlgmj (mgr.34412) 200 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:52:18.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:18 gibba015 bash[30343]: cephadm 2021-03-10T13:52:17.459760+0000 mgr.gibba045.orlgmj (mgr.34412) 201 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:52:18.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:18 gibba015 bash[30343]: cephadm 2021-03-10T13:52:17.461210+0000 mgr.gibba045.orlgmj (mgr.34412) 202 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:52:18.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:18 gibba015 bash[30343]: audit 2021-03-10T13:52:17.462238+0000 mon.c (mon.1) 104 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-03-10T13:52:18.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:18 gibba015 bash[30343]: cephadm 2021-03-10T13:52:17.462963+0000 mgr.gibba045.orlgmj (mgr.34412) 203 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:52:18.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:18 gibba015 bash[30343]: cephadm 2021-03-10T13:52:17.463033+0000 mgr.gibba045.orlgmj (mgr.34412) 204 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:52:18.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:18 gibba015 bash[30343]: audit 2021-03-10T13:52:17.463807+0000 mgr.gibba045.orlgmj (mgr.34412) 205 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-03-10T13:52:18.733 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:18 gibba015 bash[30343]: cephadm 2021-03-10T13:52:17.465189+0000 mgr.gibba045.orlgmj (mgr.34412) 206 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (16 PGs are or would become offline) 2021-03-10T13:52:20.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:20 gibba045 bash[25517]: cluster 2021-03-10T13:52:19.037219+0000 mgr.gibba045.orlgmj (mgr.34412) 207 : cluster [DBG] pgmap v94: 129 pgs: 16 active+undersized+degraded, 34 active+undersized, 79 active+clean; 7.0 KiB data, 23 MiB used, 667 GiB / 672 GiB avail; 19/192 objects degraded (9.896%) 2021-03-10T13:52:20.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:20 gibba015 bash[29377]: cluster 2021-03-10T13:52:19.037219+0000 mgr.gibba045.orlgmj (mgr.34412) 207 : cluster [DBG] pgmap v94: 129 pgs: 16 active+undersized+degraded, 34 active+undersized, 79 active+clean; 7.0 KiB data, 23 MiB used, 667 GiB / 672 GiB avail; 19/192 objects degraded (9.896%) 2021-03-10T13:52:20.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:20 gibba015 bash[30343]: cluster 2021-03-10T13:52:19.037219+0000 mgr.gibba045.orlgmj (mgr.34412) 207 : cluster [DBG] pgmap v94: 129 pgs: 16 active+undersized+degraded, 34 active+undersized, 79 active+clean; 7.0 KiB data, 23 MiB used, 667 GiB / 672 GiB avail; 19/192 objects degraded (9.896%) 2021-03-10T13:52:20.723 INFO:journalctl@ceph.osd.3.gibba015.stdout:Mar 10 13:52:20 gibba015 bash[35675]: debug 2021-03-10T13:52:20.348+0000 7f55449cd080 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: store not yet converted to per-pg omap 2021-03-10T13:52:20.723 INFO:journalctl@ceph.osd.3.gibba015.stdout:Mar 10 13:52:20 gibba015 bash[35675]: debug 2021-03-10T13:52:20.352+0000 7f5531495700 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #-1:c1a3fc6e:::purged_snaps:0# has omap that is not per-pg or pgmeta 2021-03-10T13:52:20.724 INFO:journalctl@ceph.osd.3.gibba015.stdout:Mar 10 13:52:20 gibba015 bash[35675]: debug 2021-03-10T13:52:20.476+0000 7f55449cd080 -1 osd.3 77 log_to_monitors {default=true} 2021-03-10T13:52:21.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:21 gibba045 bash[25517]: audit 2021-03-10T13:52:20.480139+0000 mon.c (mon.1) 105 : audit [INF] from='osd.3 [v2:172.21.2.115:6824/3526812589,v1:172.21.2.115:6825/3526812589]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-03-10T13:52:21.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:21 gibba045 bash[25517]: audit 2021-03-10T13:52:20.480514+0000 mon.a (mon.0) 347 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-03-10T13:52:21.722 INFO:journalctl@ceph.osd.3.gibba015.stdout:Mar 10 13:52:21 gibba015 bash[35675]: debug 2021-03-10T13:52:21.260+0000 7f5536eaf700 -1 osd.3 77 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T13:52:21.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:21 gibba015 bash[29377]: audit 2021-03-10T13:52:20.480139+0000 mon.c (mon.1) 105 : audit [INF] from='osd.3 [v2:172.21.2.115:6824/3526812589,v1:172.21.2.115:6825/3526812589]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-03-10T13:52:21.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:21 gibba015 bash[29377]: audit 2021-03-10T13:52:20.480514+0000 mon.a (mon.0) 347 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-03-10T13:52:21.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:21 gibba015 bash[30343]: audit 2021-03-10T13:52:20.480139+0000 mon.c (mon.1) 105 : audit [INF] from='osd.3 [v2:172.21.2.115:6824/3526812589,v1:172.21.2.115:6825/3526812589]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-03-10T13:52:21.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:21 gibba015 bash[30343]: audit 2021-03-10T13:52:20.480514+0000 mon.a (mon.0) 347 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-03-10T13:52:22.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:22 gibba045 bash[25517]: cluster 2021-03-10T13:52:21.038681+0000 mgr.gibba045.orlgmj (mgr.34412) 208 : cluster [DBG] pgmap v95: 129 pgs: 16 active+undersized+degraded, 34 active+undersized, 79 active+clean; 7.0 KiB data, 23 MiB used, 667 GiB / 672 GiB avail; 19/192 objects degraded (9.896%) 2021-03-10T13:52:22.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:22 gibba045 bash[25517]: audit 2021-03-10T13:52:21.251557+0000 mon.a (mon.0) 348 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2021-03-10T13:52:22.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:22 gibba045 bash[25517]: cluster 2021-03-10T13:52:21.251794+0000 mon.a (mon.0) 349 : cluster [DBG] osdmap e80: 8 total, 7 up, 8 in 2021-03-10T13:52:22.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:22 gibba045 bash[25517]: audit 2021-03-10T13:52:21.252492+0000 mon.c (mon.1) 106 : audit [INF] from='osd.3 [v2:172.21.2.115:6824/3526812589,v1:172.21.2.115:6825/3526812589]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0820, "args": ["host=gibba015", "root=default"]}]: dispatch 2021-03-10T13:52:22.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:22 gibba045 bash[25517]: audit 2021-03-10T13:52:21.255511+0000 mon.a (mon.0) 350 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0820, "args": ["host=gibba015", "root=default"]}]: dispatch 2021-03-10T13:52:22.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:22 gibba045 bash[25517]: cluster 2021-03-10T13:52:21.368106+0000 mon.a (mon.0) 351 : cluster [WRN] Health check update: Degraded data redundancy: 19/192 objects degraded (9.896%), 16 pgs degraded (PG_DEGRADED) 2021-03-10T13:52:22.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:22 gibba015 bash[29377]: cluster 2021-03-10T13:52:21.038681+0000 mgr.gibba045.orlgmj (mgr.34412) 208 : cluster [DBG] pgmap v95: 129 pgs: 16 active+undersized+degraded, 34 active+undersized, 79 active+clean; 7.0 KiB data, 23 MiB used, 667 GiB / 672 GiB avail; 19/192 objects degraded (9.896%) 2021-03-10T13:52:22.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:22 gibba015 bash[29377]: audit 2021-03-10T13:52:21.251557+0000 mon.a (mon.0) 348 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2021-03-10T13:52:22.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:22 gibba015 bash[29377]: cluster 2021-03-10T13:52:21.251794+0000 mon.a (mon.0) 349 : cluster [DBG] osdmap e80: 8 total, 7 up, 8 in 2021-03-10T13:52:22.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:22 gibba015 bash[29377]: audit 2021-03-10T13:52:21.252492+0000 mon.c (mon.1) 106 : audit [INF] from='osd.3 [v2:172.21.2.115:6824/3526812589,v1:172.21.2.115:6825/3526812589]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0820, "args": ["host=gibba015", "root=default"]}]: dispatch 2021-03-10T13:52:22.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:22 gibba015 bash[29377]: audit 2021-03-10T13:52:21.255511+0000 mon.a (mon.0) 350 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0820, "args": ["host=gibba015", "root=default"]}]: dispatch 2021-03-10T13:52:22.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:22 gibba015 bash[29377]: cluster 2021-03-10T13:52:21.368106+0000 mon.a (mon.0) 351 : cluster [WRN] Health check update: Degraded data redundancy: 19/192 objects degraded (9.896%), 16 pgs degraded (PG_DEGRADED) 2021-03-10T13:52:22.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:22 gibba015 bash[30343]: cluster 2021-03-10T13:52:21.038681+0000 mgr.gibba045.orlgmj (mgr.34412) 208 : cluster [DBG] pgmap v95: 129 pgs: 16 active+undersized+degraded, 34 active+undersized, 79 active+clean; 7.0 KiB data, 23 MiB used, 667 GiB / 672 GiB avail; 19/192 objects degraded (9.896%) 2021-03-10T13:52:22.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:22 gibba015 bash[30343]: audit 2021-03-10T13:52:21.251557+0000 mon.a (mon.0) 348 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2021-03-10T13:52:22.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:22 gibba015 bash[30343]: cluster 2021-03-10T13:52:21.251794+0000 mon.a (mon.0) 349 : cluster [DBG] osdmap e80: 8 total, 7 up, 8 in 2021-03-10T13:52:22.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:22 gibba015 bash[30343]: audit 2021-03-10T13:52:21.252492+0000 mon.c (mon.1) 106 : audit [INF] from='osd.3 [v2:172.21.2.115:6824/3526812589,v1:172.21.2.115:6825/3526812589]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0820, "args": ["host=gibba015", "root=default"]}]: dispatch 2021-03-10T13:52:22.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:22 gibba015 bash[30343]: audit 2021-03-10T13:52:21.255511+0000 mon.a (mon.0) 350 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0820, "args": ["host=gibba015", "root=default"]}]: dispatch 2021-03-10T13:52:22.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:22 gibba015 bash[30343]: cluster 2021-03-10T13:52:21.368106+0000 mon.a (mon.0) 351 : cluster [WRN] Health check update: Degraded data redundancy: 19/192 objects degraded (9.896%), 16 pgs degraded (PG_DEGRADED) 2021-03-10T13:52:23.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:23 gibba045 bash[25517]: cluster 2021-03-10T13:52:22.255873+0000 mon.a (mon.0) 352 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T13:52:23.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:23 gibba045 bash[25517]: cluster 2021-03-10T13:52:22.267209+0000 mon.a (mon.0) 353 : cluster [INF] osd.3 [v2:172.21.2.115:6824/3526812589,v1:172.21.2.115:6825/3526812589] boot 2021-03-10T13:52:23.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:23 gibba045 bash[25517]: cluster 2021-03-10T13:52:22.267307+0000 mon.a (mon.0) 354 : cluster [DBG] osdmap e81: 8 total, 8 up, 8 in 2021-03-10T13:52:23.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:23 gibba045 bash[25517]: audit 2021-03-10T13:52:22.268300+0000 mon.c (mon.1) 107 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T13:52:23.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:23 gibba015 bash[29377]: cluster 2021-03-10T13:52:22.255873+0000 mon.a (mon.0) 352 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T13:52:23.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:23 gibba015 bash[29377]: cluster 2021-03-10T13:52:22.267209+0000 mon.a (mon.0) 353 : cluster [INF] osd.3 [v2:172.21.2.115:6824/3526812589,v1:172.21.2.115:6825/3526812589] boot 2021-03-10T13:52:23.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:23 gibba015 bash[29377]: cluster 2021-03-10T13:52:22.267307+0000 mon.a (mon.0) 354 : cluster [DBG] osdmap e81: 8 total, 8 up, 8 in 2021-03-10T13:52:23.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:23 gibba015 bash[29377]: audit 2021-03-10T13:52:22.268300+0000 mon.c (mon.1) 107 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T13:52:23.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:23 gibba015 bash[30343]: cluster 2021-03-10T13:52:22.255873+0000 mon.a (mon.0) 352 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T13:52:23.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:23 gibba015 bash[30343]: cluster 2021-03-10T13:52:22.267209+0000 mon.a (mon.0) 353 : cluster [INF] osd.3 [v2:172.21.2.115:6824/3526812589,v1:172.21.2.115:6825/3526812589] boot 2021-03-10T13:52:23.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:23 gibba015 bash[30343]: cluster 2021-03-10T13:52:22.267307+0000 mon.a (mon.0) 354 : cluster [DBG] osdmap e81: 8 total, 8 up, 8 in 2021-03-10T13:52:23.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:23 gibba015 bash[30343]: audit 2021-03-10T13:52:22.268300+0000 mon.c (mon.1) 107 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T13:52:24.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:24 gibba045 bash[25517]: cluster 2021-03-10T13:52:23.040072+0000 mgr.gibba045.orlgmj (mgr.34412) 209 : cluster [DBG] pgmap v98: 129 pgs: 16 active+undersized+degraded, 34 active+undersized, 79 active+clean; 7.0 KiB data, 27 MiB used, 668 GiB / 672 GiB avail; 19/192 objects degraded (9.896%) 2021-03-10T13:52:24.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:24 gibba045 bash[25517]: cluster 2021-03-10T13:52:23.272377+0000 mon.a (mon.0) 355 : cluster [DBG] osdmap e82: 8 total, 8 up, 8 in 2021-03-10T13:52:24.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:24 gibba015 bash[29377]: cluster 2021-03-10T13:52:23.040072+0000 mgr.gibba045.orlgmj (mgr.34412) 209 : cluster [DBG] pgmap v98: 129 pgs: 16 active+undersized+degraded, 34 active+undersized, 79 active+clean; 7.0 KiB data, 27 MiB used, 668 GiB / 672 GiB avail; 19/192 objects degraded (9.896%) 2021-03-10T13:52:24.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:24 gibba015 bash[29377]: cluster 2021-03-10T13:52:23.272377+0000 mon.a (mon.0) 355 : cluster [DBG] osdmap e82: 8 total, 8 up, 8 in 2021-03-10T13:52:24.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:24 gibba015 bash[30343]: cluster 2021-03-10T13:52:23.040072+0000 mgr.gibba045.orlgmj (mgr.34412) 209 : cluster [DBG] pgmap v98: 129 pgs: 16 active+undersized+degraded, 34 active+undersized, 79 active+clean; 7.0 KiB data, 27 MiB used, 668 GiB / 672 GiB avail; 19/192 objects degraded (9.896%) 2021-03-10T13:52:24.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:24 gibba015 bash[30343]: cluster 2021-03-10T13:52:23.272377+0000 mon.a (mon.0) 355 : cluster [DBG] osdmap e82: 8 total, 8 up, 8 in 2021-03-10T13:52:26.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:26 gibba045 bash[25517]: cluster 2021-03-10T13:52:25.042134+0000 mgr.gibba045.orlgmj (mgr.34412) 210 : cluster [DBG] pgmap v100: 129 pgs: 7 active+undersized+degraded, 17 active+undersized, 105 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail; 10/192 objects degraded (5.208%) 2021-03-10T13:52:26.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:26 gibba015 bash[29377]: cluster 2021-03-10T13:52:25.042134+0000 mgr.gibba045.orlgmj (mgr.34412) 210 : cluster [DBG] pgmap v100: 129 pgs: 7 active+undersized+degraded, 17 active+undersized, 105 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail; 10/192 objects degraded (5.208%) 2021-03-10T13:52:26.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:26 gibba015 bash[30343]: cluster 2021-03-10T13:52:25.042134+0000 mgr.gibba045.orlgmj (mgr.34412) 210 : cluster [DBG] pgmap v100: 129 pgs: 7 active+undersized+degraded, 17 active+undersized, 105 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail; 10/192 objects degraded (5.208%) 2021-03-10T13:52:27.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:27 gibba045 bash[25517]: cluster 2021-03-10T13:52:26.368909+0000 mon.a (mon.0) 356 : cluster [WRN] Health check update: Degraded data redundancy: 10/192 objects degraded (5.208%), 7 pgs degraded (PG_DEGRADED) 2021-03-10T13:52:27.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:27 gibba015 bash[29377]: cluster 2021-03-10T13:52:26.368909+0000 mon.a (mon.0) 356 : cluster [WRN] Health check update: Degraded data redundancy: 10/192 objects degraded (5.208%), 7 pgs degraded (PG_DEGRADED) 2021-03-10T13:52:27.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:27 gibba015 bash[30343]: cluster 2021-03-10T13:52:26.368909+0000 mon.a (mon.0) 356 : cluster [WRN] Health check update: Degraded data redundancy: 10/192 objects degraded (5.208%), 7 pgs degraded (PG_DEGRADED) 2021-03-10T13:52:28.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:28 gibba045 bash[25517]: cluster 2021-03-10T13:52:27.043521+0000 mgr.gibba045.orlgmj (mgr.34412) 211 : cluster [DBG] pgmap v101: 129 pgs: 20 active+clean+wait, 109 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail 2021-03-10T13:52:28.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:28 gibba045 bash[25517]: cluster 2021-03-10T13:52:27.373294+0000 mon.a (mon.0) 357 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 10/192 objects degraded (5.208%), 7 pgs degraded) 2021-03-10T13:52:28.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:28 gibba045 bash[25517]: audit 2021-03-10T13:52:27.512559+0000 mon.a (mon.0) 358 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:52:28.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:28 gibba015 bash[29377]: cluster 2021-03-10T13:52:27.043521+0000 mgr.gibba045.orlgmj (mgr.34412) 211 : cluster [DBG] pgmap v101: 129 pgs: 20 active+clean+wait, 109 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail 2021-03-10T13:52:28.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:28 gibba015 bash[29377]: cluster 2021-03-10T13:52:27.373294+0000 mon.a (mon.0) 357 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 10/192 objects degraded (5.208%), 7 pgs degraded) 2021-03-10T13:52:28.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:28 gibba015 bash[29377]: audit 2021-03-10T13:52:27.512559+0000 mon.a (mon.0) 358 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:52:28.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:28 gibba015 bash[30343]: cluster 2021-03-10T13:52:27.043521+0000 mgr.gibba045.orlgmj (mgr.34412) 211 : cluster [DBG] pgmap v101: 129 pgs: 20 active+clean+wait, 109 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail 2021-03-10T13:52:28.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:28 gibba015 bash[30343]: cluster 2021-03-10T13:52:27.373294+0000 mon.a (mon.0) 357 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 10/192 objects degraded (5.208%), 7 pgs degraded) 2021-03-10T13:52:28.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:28 gibba015 bash[30343]: audit 2021-03-10T13:52:27.512559+0000 mon.a (mon.0) 358 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:52:30.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:30 gibba045 bash[25517]: cluster 2021-03-10T13:52:29.045174+0000 mgr.gibba045.orlgmj (mgr.34412) 212 : cluster [DBG] pgmap v102: 129 pgs: 20 active+clean+wait, 109 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail 2021-03-10T13:52:30.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:30 gibba015 bash[29377]: cluster 2021-03-10T13:52:29.045174+0000 mgr.gibba045.orlgmj (mgr.34412) 212 : cluster [DBG] pgmap v102: 129 pgs: 20 active+clean+wait, 109 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail 2021-03-10T13:52:30.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:30 gibba015 bash[30343]: cluster 2021-03-10T13:52:29.045174+0000 mgr.gibba045.orlgmj (mgr.34412) 212 : cluster [DBG] pgmap v102: 129 pgs: 20 active+clean+wait, 109 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail 2021-03-10T13:52:32.677 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:32 gibba045 bash[25517]: cluster 2021-03-10T13:52:31.046645+0000 mgr.gibba045.orlgmj (mgr.34412) 213 : cluster [DBG] pgmap v103: 129 pgs: 20 active+clean+wait, 109 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail 2021-03-10T13:52:32.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:32 gibba015 bash[29377]: cluster 2021-03-10T13:52:31.046645+0000 mgr.gibba045.orlgmj (mgr.34412) 213 : cluster [DBG] pgmap v103: 129 pgs: 20 active+clean+wait, 109 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail 2021-03-10T13:52:32.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:32 gibba015 bash[30343]: cluster 2021-03-10T13:52:31.046645+0000 mgr.gibba045.orlgmj (mgr.34412) 213 : cluster [DBG] pgmap v103: 129 pgs: 20 active+clean+wait, 109 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail 2021-03-10T13:52:33.708 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:33 gibba045 bash[25517]: audit 2021-03-10T13:52:32.480437+0000 mon.c (mon.1) 108 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-03-10T13:52:33.708 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:33 gibba045 bash[25517]: audit 2021-03-10T13:52:32.482758+0000 mgr.gibba045.orlgmj (mgr.34412) 214 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-03-10T13:52:33.709 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:33 gibba045 bash[25517]: cephadm 2021-03-10T13:52:32.487869+0000 mgr.gibba045.orlgmj (mgr.34412) 215 : cephadm [INF] Upgrade: osd.4 is safe to restart 2021-03-10T13:52:33.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:33 gibba015 bash[29377]: audit 2021-03-10T13:52:32.480437+0000 mon.c (mon.1) 108 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-03-10T13:52:33.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:33 gibba015 bash[29377]: audit 2021-03-10T13:52:32.482758+0000 mgr.gibba045.orlgmj (mgr.34412) 214 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-03-10T13:52:33.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:33 gibba015 bash[29377]: cephadm 2021-03-10T13:52:32.487869+0000 mgr.gibba045.orlgmj (mgr.34412) 215 : cephadm [INF] Upgrade: osd.4 is safe to restart 2021-03-10T13:52:33.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:33 gibba015 bash[30343]: audit 2021-03-10T13:52:32.480437+0000 mon.c (mon.1) 108 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-03-10T13:52:33.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:33 gibba015 bash[30343]: audit 2021-03-10T13:52:32.482758+0000 mgr.gibba045.orlgmj (mgr.34412) 214 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-03-10T13:52:33.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:33 gibba015 bash[30343]: cephadm 2021-03-10T13:52:32.487869+0000 mgr.gibba045.orlgmj (mgr.34412) 215 : cephadm [INF] Upgrade: osd.4 is safe to restart 2021-03-10T13:52:34.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:34 gibba015 bash[29377]: cluster 2021-03-10T13:52:33.047744+0000 mgr.gibba045.orlgmj (mgr.34412) 216 : cluster [DBG] pgmap v104: 129 pgs: 20 active+clean+wait, 109 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail 2021-03-10T13:52:34.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:34 gibba015 bash[29377]: audit 2021-03-10T13:52:34.155124+0000 mon.a (mon.0) 359 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:52:34.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:34 gibba015 bash[29377]: audit 2021-03-10T13:52:34.156981+0000 mon.c (mon.1) 109 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd.4","key": "container_image"}]: dispatch 2021-03-10T13:52:34.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:34 gibba015 bash[30343]: cluster 2021-03-10T13:52:33.047744+0000 mgr.gibba045.orlgmj (mgr.34412) 216 : cluster [DBG] pgmap v104: 129 pgs: 20 active+clean+wait, 109 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail 2021-03-10T13:52:34.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:34 gibba015 bash[30343]: audit 2021-03-10T13:52:34.155124+0000 mon.a (mon.0) 359 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:52:34.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:34 gibba015 bash[30343]: audit 2021-03-10T13:52:34.156981+0000 mon.c (mon.1) 109 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd.4","key": "container_image"}]: dispatch 2021-03-10T13:52:34.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:34 gibba045 bash[25517]: cluster 2021-03-10T13:52:33.047744+0000 mgr.gibba045.orlgmj (mgr.34412) 216 : cluster [DBG] pgmap v104: 129 pgs: 20 active+clean+wait, 109 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail 2021-03-10T13:52:34.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:34 gibba045 bash[25517]: audit 2021-03-10T13:52:34.155124+0000 mon.a (mon.0) 359 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:52:34.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:34 gibba045 bash[25517]: audit 2021-03-10T13:52:34.156981+0000 mon.c (mon.1) 109 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd.4","key": "container_image"}]: dispatch 2021-03-10T13:52:35.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:35 gibba015 bash[29377]: cephadm 2021-03-10T13:52:34.145265+0000 mgr.gibba045.orlgmj (mgr.34412) 217 : cephadm [INF] Upgrade: Updating osd.4 2021-03-10T13:52:35.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:35 gibba015 bash[29377]: cephadm 2021-03-10T13:52:34.158197+0000 mgr.gibba045.orlgmj (mgr.34412) 218 : cephadm [INF] Deploying daemon osd.4 on gibba045 2021-03-10T13:52:35.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:35 gibba015 bash[30343]: cephadm 2021-03-10T13:52:34.145265+0000 mgr.gibba045.orlgmj (mgr.34412) 217 : cephadm [INF] Upgrade: Updating osd.4 2021-03-10T13:52:35.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:35 gibba015 bash[30343]: cephadm 2021-03-10T13:52:34.158197+0000 mgr.gibba045.orlgmj (mgr.34412) 218 : cephadm [INF] Deploying daemon osd.4 on gibba045 2021-03-10T13:52:35.776 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:35 gibba045 bash[25517]: cephadm 2021-03-10T13:52:34.145265+0000 mgr.gibba045.orlgmj (mgr.34412) 217 : cephadm [INF] Upgrade: Updating osd.4 2021-03-10T13:52:35.777 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:35 gibba045 bash[25517]: cephadm 2021-03-10T13:52:34.158197+0000 mgr.gibba045.orlgmj (mgr.34412) 218 : cephadm [INF] Deploying daemon osd.4 on gibba045 2021-03-10T13:52:36.056 INFO:journalctl@ceph.osd.4.gibba045.stdout:Mar 10 13:52:35 gibba045 systemd[1]: Stopping Ceph osd.4 for e4a642d2-81a5-11eb-9080-001a4aab830c... 2021-03-10T13:52:36.057 INFO:journalctl@ceph.osd.4.gibba045.stdout:Mar 10 13:52:35 gibba045 bash[12292]: debug 2021-03-10T13:52:35.975+0000 7fd5ba701700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2021-03-10T13:52:36.057 INFO:journalctl@ceph.osd.4.gibba045.stdout:Mar 10 13:52:35 gibba045 bash[12292]: debug 2021-03-10T13:52:35.975+0000 7fd5ba701700 -1 osd.4 82 *** Got signal Terminated *** 2021-03-10T13:52:36.057 INFO:journalctl@ceph.osd.4.gibba045.stdout:Mar 10 13:52:35 gibba045 bash[12292]: debug 2021-03-10T13:52:35.975+0000 7fd5ba701700 -1 osd.4 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-03-10T13:52:36.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:36 gibba015 bash[29377]: cluster 2021-03-10T13:52:35.049582+0000 mgr.gibba045.orlgmj (mgr.34412) 219 : cluster [DBG] pgmap v105: 129 pgs: 20 active+clean+wait, 109 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail 2021-03-10T13:52:36.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:36 gibba015 bash[29377]: cluster 2021-03-10T13:52:36.038005+0000 mon.a (mon.0) 360 : cluster [DBG] osd.4 reported immediately failed by osd.1 2021-03-10T13:52:36.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:36 gibba015 bash[29377]: cluster 2021-03-10T13:52:36.038089+0000 mon.a (mon.0) 361 : cluster [INF] osd.4 failed (root=default,host=gibba045) (connection refused reported by osd.1) 2021-03-10T13:52:36.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:36 gibba015 bash[29377]: cluster 2021-03-10T13:52:36.038774+0000 mon.a (mon.0) 362 : cluster [DBG] osd.4 reported immediately failed by osd.1 2021-03-10T13:52:36.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:36 gibba015 bash[29377]: cluster 2021-03-10T13:52:36.039061+0000 mon.a (mon.0) 363 : cluster [DBG] osd.4 reported immediately failed by osd.2 2021-03-10T13:52:36.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:36 gibba015 bash[29377]: cluster 2021-03-10T13:52:36.039570+0000 mon.a (mon.0) 364 : cluster [DBG] osd.4 reported immediately failed by osd.3 2021-03-10T13:52:36.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:36 gibba015 bash[29377]: cluster 2021-03-10T13:52:36.039858+0000 mon.a (mon.0) 365 : cluster [DBG] osd.4 reported immediately failed by osd.0 2021-03-10T13:52:36.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:36 gibba015 bash[29377]: cluster 2021-03-10T13:52:36.040341+0000 mon.a (mon.0) 366 : cluster [DBG] osd.4 reported immediately failed by osd.2 2021-03-10T13:52:36.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:36 gibba015 bash[29377]: cluster 2021-03-10T13:52:36.040609+0000 mon.a (mon.0) 367 : cluster [DBG] osd.4 reported immediately failed by osd.3 2021-03-10T13:52:36.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:36 gibba015 bash[29377]: cluster 2021-03-10T13:52:36.041131+0000 mon.a (mon.0) 368 : cluster [DBG] osd.4 reported immediately failed by osd.0 2021-03-10T13:52:36.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:36 gibba015 bash[29377]: cluster 2021-03-10T13:52:36.237671+0000 mon.a (mon.0) 369 : cluster [DBG] osd.4 reported immediately failed by osd.7 2021-03-10T13:52:36.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:36 gibba015 bash[29377]: cluster 2021-03-10T13:52:36.238072+0000 mon.a (mon.0) 370 : cluster [DBG] osd.4 reported immediately failed by osd.5 2021-03-10T13:52:36.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:36 gibba015 bash[29377]: cluster 2021-03-10T13:52:36.238243+0000 mon.a (mon.0) 371 : cluster [DBG] osd.4 reported immediately failed by osd.7 2021-03-10T13:52:36.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:36 gibba015 bash[29377]: cluster 2021-03-10T13:52:36.238782+0000 mon.a (mon.0) 372 : cluster [DBG] osd.4 reported immediately failed by osd.3 2021-03-10T13:52:36.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:36 gibba015 bash[29377]: cluster 2021-03-10T13:52:36.238955+0000 mon.a (mon.0) 373 : cluster [DBG] osd.4 reported immediately failed by osd.5 2021-03-10T13:52:36.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:36 gibba015 bash[29377]: cluster 2021-03-10T13:52:36.239495+0000 mon.a (mon.0) 374 : cluster [DBG] osd.4 reported immediately failed by osd.0 2021-03-10T13:52:36.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:36 gibba015 bash[29377]: cluster 2021-03-10T13:52:36.239809+0000 mon.a (mon.0) 375 : cluster [DBG] osd.4 reported immediately failed by osd.1 2021-03-10T13:52:36.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:36 gibba015 bash[29377]: cluster 2021-03-10T13:52:36.240487+0000 mon.a (mon.0) 376 : cluster [DBG] osd.4 reported immediately failed by osd.2 2021-03-10T13:52:36.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:36 gibba015 bash[29377]: cluster 2021-03-10T13:52:36.240759+0000 mon.a (mon.0) 377 : cluster [DBG] osd.4 reported immediately failed by osd.3 2021-03-10T13:52:36.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:36 gibba015 bash[29377]: cluster 2021-03-10T13:52:36.241342+0000 mon.a (mon.0) 378 : cluster [DBG] osd.4 reported immediately failed by osd.6 2021-03-10T13:52:36.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:36 gibba015 bash[29377]: cluster 2021-03-10T13:52:36.241622+0000 mon.a (mon.0) 379 : cluster [DBG] osd.4 reported immediately failed by osd.1 2021-03-10T13:52:36.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:36 gibba015 bash[29377]: cluster 2021-03-10T13:52:36.242060+0000 mon.a (mon.0) 380 : cluster [DBG] osd.4 reported immediately failed by osd.2 2021-03-10T13:52:36.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:36 gibba015 bash[29377]: cluster 2021-03-10T13:52:36.242106+0000 mon.a (mon.0) 381 : cluster [DBG] osd.4 reported immediately failed by osd.6 2021-03-10T13:52:36.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:36 gibba015 bash[29377]: cluster 2021-03-10T13:52:36.242237+0000 mon.a (mon.0) 382 : cluster [DBG] osd.4 reported immediately failed by osd.0 2021-03-10T13:52:36.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:36 gibba015 bash[30343]: cluster 2021-03-10T13:52:35.049582+0000 mgr.gibba045.orlgmj (mgr.34412) 219 : cluster [DBG] pgmap v105: 129 pgs: 20 active+clean+wait, 109 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail 2021-03-10T13:52:36.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:36 gibba015 bash[30343]: cluster 2021-03-10T13:52:36.038005+0000 mon.a (mon.0) 360 : cluster [DBG] osd.4 reported immediately failed by osd.1 2021-03-10T13:52:36.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:36 gibba015 bash[30343]: cluster 2021-03-10T13:52:36.038089+0000 mon.a (mon.0) 361 : cluster [INF] osd.4 failed (root=default,host=gibba045) (connection refused reported by osd.1) 2021-03-10T13:52:36.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:36 gibba015 bash[30343]: cluster 2021-03-10T13:52:36.038774+0000 mon.a (mon.0) 362 : cluster [DBG] osd.4 reported immediately failed by osd.1 2021-03-10T13:52:36.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:36 gibba015 bash[30343]: cluster 2021-03-10T13:52:36.039061+0000 mon.a (mon.0) 363 : cluster [DBG] osd.4 reported immediately failed by osd.2 2021-03-10T13:52:36.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:36 gibba015 bash[30343]: cluster 2021-03-10T13:52:36.039570+0000 mon.a (mon.0) 364 : cluster [DBG] osd.4 reported immediately failed by osd.3 2021-03-10T13:52:36.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:36 gibba015 bash[30343]: cluster 2021-03-10T13:52:36.039858+0000 mon.a (mon.0) 365 : cluster [DBG] osd.4 reported immediately failed by osd.0 2021-03-10T13:52:36.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:36 gibba015 bash[30343]: cluster 2021-03-10T13:52:36.040341+0000 mon.a (mon.0) 366 : cluster [DBG] osd.4 reported immediately failed by osd.2 2021-03-10T13:52:36.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:36 gibba015 bash[30343]: cluster 2021-03-10T13:52:36.040609+0000 mon.a (mon.0) 367 : cluster [DBG] osd.4 reported immediately failed by osd.3 2021-03-10T13:52:36.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:36 gibba015 bash[30343]: cluster 2021-03-10T13:52:36.041131+0000 mon.a (mon.0) 368 : cluster [DBG] osd.4 reported immediately failed by osd.0 2021-03-10T13:52:36.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:36 gibba015 bash[30343]: cluster 2021-03-10T13:52:36.237671+0000 mon.a (mon.0) 369 : cluster [DBG] osd.4 reported immediately failed by osd.7 2021-03-10T13:52:36.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:36 gibba015 bash[30343]: cluster 2021-03-10T13:52:36.238072+0000 mon.a (mon.0) 370 : cluster [DBG] osd.4 reported immediately failed by osd.5 2021-03-10T13:52:36.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:36 gibba015 bash[30343]: cluster 2021-03-10T13:52:36.238243+0000 mon.a (mon.0) 371 : cluster [DBG] osd.4 reported immediately failed by osd.7 2021-03-10T13:52:36.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:36 gibba015 bash[30343]: cluster 2021-03-10T13:52:36.238782+0000 mon.a (mon.0) 372 : cluster [DBG] osd.4 reported immediately failed by osd.3 2021-03-10T13:52:36.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:36 gibba015 bash[30343]: cluster 2021-03-10T13:52:36.238955+0000 mon.a (mon.0) 373 : cluster [DBG] osd.4 reported immediately failed by osd.5 2021-03-10T13:52:36.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:36 gibba015 bash[30343]: cluster 2021-03-10T13:52:36.239495+0000 mon.a (mon.0) 374 : cluster [DBG] osd.4 reported immediately failed by osd.0 2021-03-10T13:52:36.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:36 gibba015 bash[30343]: cluster 2021-03-10T13:52:36.239809+0000 mon.a (mon.0) 375 : cluster [DBG] osd.4 reported immediately failed by osd.1 2021-03-10T13:52:36.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:36 gibba015 bash[30343]: cluster 2021-03-10T13:52:36.240487+0000 mon.a (mon.0) 376 : cluster [DBG] osd.4 reported immediately failed by osd.2 2021-03-10T13:52:36.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:36 gibba015 bash[30343]: cluster 2021-03-10T13:52:36.240759+0000 mon.a (mon.0) 377 : cluster [DBG] osd.4 reported immediately failed by osd.3 2021-03-10T13:52:36.733 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:36 gibba015 bash[30343]: cluster 2021-03-10T13:52:36.241342+0000 mon.a (mon.0) 378 : cluster [DBG] osd.4 reported immediately failed by osd.6 2021-03-10T13:52:36.733 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:36 gibba015 bash[30343]: cluster 2021-03-10T13:52:36.241622+0000 mon.a (mon.0) 379 : cluster [DBG] osd.4 reported immediately failed by osd.1 2021-03-10T13:52:36.733 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:36 gibba015 bash[30343]: cluster 2021-03-10T13:52:36.242060+0000 mon.a (mon.0) 380 : cluster [DBG] osd.4 reported immediately failed by osd.2 2021-03-10T13:52:36.733 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:36 gibba015 bash[30343]: cluster 2021-03-10T13:52:36.242106+0000 mon.a (mon.0) 381 : cluster [DBG] osd.4 reported immediately failed by osd.6 2021-03-10T13:52:36.734 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:36 gibba015 bash[30343]: cluster 2021-03-10T13:52:36.242237+0000 mon.a (mon.0) 382 : cluster [DBG] osd.4 reported immediately failed by osd.0 2021-03-10T13:52:36.806 INFO:journalctl@ceph.osd.4.gibba045.stdout:Mar 10 13:52:36 gibba045 docker[27005]: ceph-e4a642d2-81a5-11eb-9080-001a4aab830c-osd.4 2021-03-10T13:52:36.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:36 gibba045 bash[25517]: cluster 2021-03-10T13:52:35.049582+0000 mgr.gibba045.orlgmj (mgr.34412) 219 : cluster [DBG] pgmap v105: 129 pgs: 20 active+clean+wait, 109 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail 2021-03-10T13:52:36.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:36 gibba045 bash[25517]: cluster 2021-03-10T13:52:36.038005+0000 mon.a (mon.0) 360 : cluster [DBG] osd.4 reported immediately failed by osd.1 2021-03-10T13:52:36.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:36 gibba045 bash[25517]: cluster 2021-03-10T13:52:36.038089+0000 mon.a (mon.0) 361 : cluster [INF] osd.4 failed (root=default,host=gibba045) (connection refused reported by osd.1) 2021-03-10T13:52:36.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:36 gibba045 bash[25517]: cluster 2021-03-10T13:52:36.038774+0000 mon.a (mon.0) 362 : cluster [DBG] osd.4 reported immediately failed by osd.1 2021-03-10T13:52:36.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:36 gibba045 bash[25517]: cluster 2021-03-10T13:52:36.039061+0000 mon.a (mon.0) 363 : cluster [DBG] osd.4 reported immediately failed by osd.2 2021-03-10T13:52:36.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:36 gibba045 bash[25517]: cluster 2021-03-10T13:52:36.039570+0000 mon.a (mon.0) 364 : cluster [DBG] osd.4 reported immediately failed by osd.3 2021-03-10T13:52:36.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:36 gibba045 bash[25517]: cluster 2021-03-10T13:52:36.039858+0000 mon.a (mon.0) 365 : cluster [DBG] osd.4 reported immediately failed by osd.0 2021-03-10T13:52:36.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:36 gibba045 bash[25517]: cluster 2021-03-10T13:52:36.040341+0000 mon.a (mon.0) 366 : cluster [DBG] osd.4 reported immediately failed by osd.2 2021-03-10T13:52:36.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:36 gibba045 bash[25517]: cluster 2021-03-10T13:52:36.040609+0000 mon.a (mon.0) 367 : cluster [DBG] osd.4 reported immediately failed by osd.3 2021-03-10T13:52:36.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:36 gibba045 bash[25517]: cluster 2021-03-10T13:52:36.041131+0000 mon.a (mon.0) 368 : cluster [DBG] osd.4 reported immediately failed by osd.0 2021-03-10T13:52:36.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:36 gibba045 bash[25517]: cluster 2021-03-10T13:52:36.237671+0000 mon.a (mon.0) 369 : cluster [DBG] osd.4 reported immediately failed by osd.7 2021-03-10T13:52:36.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:36 gibba045 bash[25517]: cluster 2021-03-10T13:52:36.238072+0000 mon.a (mon.0) 370 : cluster [DBG] osd.4 reported immediately failed by osd.5 2021-03-10T13:52:36.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:36 gibba045 bash[25517]: cluster 2021-03-10T13:52:36.238243+0000 mon.a (mon.0) 371 : cluster [DBG] osd.4 reported immediately failed by osd.7 2021-03-10T13:52:36.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:36 gibba045 bash[25517]: cluster 2021-03-10T13:52:36.238782+0000 mon.a (mon.0) 372 : cluster [DBG] osd.4 reported immediately failed by osd.3 2021-03-10T13:52:36.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:36 gibba045 bash[25517]: cluster 2021-03-10T13:52:36.238955+0000 mon.a (mon.0) 373 : cluster [DBG] osd.4 reported immediately failed by osd.5 2021-03-10T13:52:36.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:36 gibba045 bash[25517]: cluster 2021-03-10T13:52:36.239495+0000 mon.a (mon.0) 374 : cluster [DBG] osd.4 reported immediately failed by osd.0 2021-03-10T13:52:36.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:36 gibba045 bash[25517]: cluster 2021-03-10T13:52:36.239809+0000 mon.a (mon.0) 375 : cluster [DBG] osd.4 reported immediately failed by osd.1 2021-03-10T13:52:36.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:36 gibba045 bash[25517]: cluster 2021-03-10T13:52:36.240487+0000 mon.a (mon.0) 376 : cluster [DBG] osd.4 reported immediately failed by osd.2 2021-03-10T13:52:36.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:36 gibba045 bash[25517]: cluster 2021-03-10T13:52:36.240759+0000 mon.a (mon.0) 377 : cluster [DBG] osd.4 reported immediately failed by osd.3 2021-03-10T13:52:36.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:36 gibba045 bash[25517]: cluster 2021-03-10T13:52:36.241342+0000 mon.a (mon.0) 378 : cluster [DBG] osd.4 reported immediately failed by osd.6 2021-03-10T13:52:36.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:36 gibba045 bash[25517]: cluster 2021-03-10T13:52:36.241622+0000 mon.a (mon.0) 379 : cluster [DBG] osd.4 reported immediately failed by osd.1 2021-03-10T13:52:36.812 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:36 gibba045 bash[25517]: cluster 2021-03-10T13:52:36.242060+0000 mon.a (mon.0) 380 : cluster [DBG] osd.4 reported immediately failed by osd.2 2021-03-10T13:52:36.812 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:36 gibba045 bash[25517]: cluster 2021-03-10T13:52:36.242106+0000 mon.a (mon.0) 381 : cluster [DBG] osd.4 reported immediately failed by osd.6 2021-03-10T13:52:36.812 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:36 gibba045 bash[25517]: cluster 2021-03-10T13:52:36.242237+0000 mon.a (mon.0) 382 : cluster [DBG] osd.4 reported immediately failed by osd.0 2021-03-10T13:52:37.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:37 gibba015 bash[29377]: cluster 2021-03-10T13:52:36.409624+0000 mon.a (mon.0) 383 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T13:52:37.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:37 gibba015 bash[29377]: cluster 2021-03-10T13:52:36.414635+0000 mon.a (mon.0) 384 : cluster [DBG] osdmap e83: 8 total, 7 up, 8 in 2021-03-10T13:52:37.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:37 gibba015 bash[30343]: cluster 2021-03-10T13:52:36.409624+0000 mon.a (mon.0) 383 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T13:52:37.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:37 gibba015 bash[30343]: cluster 2021-03-10T13:52:36.414635+0000 mon.a (mon.0) 384 : cluster [DBG] osdmap e83: 8 total, 7 up, 8 in 2021-03-10T13:52:37.791 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:37 gibba045 bash[25517]: cluster 2021-03-10T13:52:36.409624+0000 mon.a (mon.0) 383 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T13:52:37.792 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:37 gibba045 bash[25517]: cluster 2021-03-10T13:52:36.414635+0000 mon.a (mon.0) 384 : cluster [DBG] osdmap e83: 8 total, 7 up, 8 in 2021-03-10T13:52:38.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:38 gibba045 bash[25517]: cluster 2021-03-10T13:52:37.050228+0000 mgr.gibba045.orlgmj (mgr.34412) 220 : cluster [DBG] pgmap v107: 129 pgs: 18 stale+active+clean, 20 active+clean+wait, 91 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail 2021-03-10T13:52:38.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:38 gibba045 bash[25517]: cluster 2021-03-10T13:52:37.424100+0000 mon.a (mon.0) 385 : cluster [DBG] osdmap e84: 8 total, 7 up, 8 in 2021-03-10T13:52:38.557 INFO:journalctl@ceph.osd.4.gibba045.stdout:Mar 10 13:52:38 gibba045 systemd[1]: ceph-e4a642d2-81a5-11eb-9080-001a4aab830c@osd.4.service: Succeeded. 2021-03-10T13:52:38.557 INFO:journalctl@ceph.osd.4.gibba045.stdout:Mar 10 13:52:38 gibba045 systemd[1]: Stopped Ceph osd.4 for e4a642d2-81a5-11eb-9080-001a4aab830c. 2021-03-10T13:52:38.557 INFO:journalctl@ceph.osd.4.gibba045.stdout:Mar 10 13:52:38 gibba045 systemd[1]: Started Ceph osd.4 for e4a642d2-81a5-11eb-9080-001a4aab830c. 2021-03-10T13:52:38.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:38 gibba015 bash[29377]: cluster 2021-03-10T13:52:37.050228+0000 mgr.gibba045.orlgmj (mgr.34412) 220 : cluster [DBG] pgmap v107: 129 pgs: 18 stale+active+clean, 20 active+clean+wait, 91 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail 2021-03-10T13:52:38.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:38 gibba015 bash[29377]: cluster 2021-03-10T13:52:37.424100+0000 mon.a (mon.0) 385 : cluster [DBG] osdmap e84: 8 total, 7 up, 8 in 2021-03-10T13:52:38.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:38 gibba015 bash[30343]: cluster 2021-03-10T13:52:37.050228+0000 mgr.gibba045.orlgmj (mgr.34412) 220 : cluster [DBG] pgmap v107: 129 pgs: 18 stale+active+clean, 20 active+clean+wait, 91 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail 2021-03-10T13:52:38.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:38 gibba015 bash[30343]: cluster 2021-03-10T13:52:37.424100+0000 mon.a (mon.0) 385 : cluster [DBG] osdmap e84: 8 total, 7 up, 8 in 2021-03-10T13:52:39.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:39 gibba045 bash[25517]: audit 2021-03-10T13:52:38.455689+0000 mon.a (mon.0) 386 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:52:39.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:39 gibba045 bash[25517]: audit 2021-03-10T13:52:38.457090+0000 mon.c (mon.1) 110 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:52:39.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:39 gibba045 bash[25517]: audit 2021-03-10T13:52:38.458778+0000 mon.c (mon.1) 111 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:52:39.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:39 gibba015 bash[29377]: audit 2021-03-10T13:52:38.455689+0000 mon.a (mon.0) 386 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:52:39.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:39 gibba015 bash[29377]: audit 2021-03-10T13:52:38.457090+0000 mon.c (mon.1) 110 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:52:39.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:39 gibba015 bash[29377]: audit 2021-03-10T13:52:38.458778+0000 mon.c (mon.1) 111 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:52:39.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:39 gibba015 bash[30343]: audit 2021-03-10T13:52:38.455689+0000 mon.a (mon.0) 386 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:52:39.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:39 gibba015 bash[30343]: audit 2021-03-10T13:52:38.457090+0000 mon.c (mon.1) 110 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:52:39.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:39 gibba015 bash[30343]: audit 2021-03-10T13:52:38.458778+0000 mon.c (mon.1) 111 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:52:40.057 INFO:journalctl@ceph.osd.4.gibba045.stdout:Mar 10 13:52:39 gibba045 bash[27183]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2021-03-10T13:52:40.057 INFO:journalctl@ceph.osd.4.gibba045.stdout:Mar 10 13:52:39 gibba045 bash[27183]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-4 --no-mon-config 2021-03-10T13:52:40.057 INFO:journalctl@ceph.osd.4.gibba045.stdout:Mar 10 13:52:39 gibba045 bash[27183]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-4/block 2021-03-10T13:52:40.057 INFO:journalctl@ceph.osd.4.gibba045.stdout:Mar 10 13:52:39 gibba045 bash[27183]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-4/block 2021-03-10T13:52:40.058 INFO:journalctl@ceph.osd.4.gibba045.stdout:Mar 10 13:52:39 gibba045 bash[27183]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2021-03-10T13:52:40.058 INFO:journalctl@ceph.osd.4.gibba045.stdout:Mar 10 13:52:39 gibba045 bash[27183]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2021-03-10T13:52:40.058 INFO:journalctl@ceph.osd.4.gibba045.stdout:Mar 10 13:52:39 gibba045 bash[27183]: --> ceph-volume lvm activate successful for osd ID: 4 2021-03-10T13:52:40.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:40 gibba015 bash[29377]: cluster 2021-03-10T13:52:39.051943+0000 mgr.gibba045.orlgmj (mgr.34412) 221 : cluster [DBG] pgmap v109: 129 pgs: 9 stale+active+clean, 15 active+undersized+degraded, 20 active+clean+wait, 21 active+undersized, 64 active+clean; 7.0 KiB data, 29 MiB used, 668 GiB / 672 GiB avail; 22/192 objects degraded (11.458%) 2021-03-10T13:52:40.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:40 gibba015 bash[29377]: cluster 2021-03-10T13:52:39.455912+0000 mon.a (mon.0) 387 : cluster [WRN] Health check failed: Degraded data redundancy: 22/192 objects degraded (11.458%), 15 pgs degraded (PG_DEGRADED) 2021-03-10T13:52:40.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:40 gibba015 bash[30343]: cluster 2021-03-10T13:52:39.051943+0000 mgr.gibba045.orlgmj (mgr.34412) 221 : cluster [DBG] pgmap v109: 129 pgs: 9 stale+active+clean, 15 active+undersized+degraded, 20 active+clean+wait, 21 active+undersized, 64 active+clean; 7.0 KiB data, 29 MiB used, 668 GiB / 672 GiB avail; 22/192 objects degraded (11.458%) 2021-03-10T13:52:40.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:40 gibba015 bash[30343]: cluster 2021-03-10T13:52:39.455912+0000 mon.a (mon.0) 387 : cluster [WRN] Health check failed: Degraded data redundancy: 22/192 objects degraded (11.458%), 15 pgs degraded (PG_DEGRADED) 2021-03-10T13:52:40.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:40 gibba045 bash[25517]: cluster 2021-03-10T13:52:39.051943+0000 mgr.gibba045.orlgmj (mgr.34412) 221 : cluster [DBG] pgmap v109: 129 pgs: 9 stale+active+clean, 15 active+undersized+degraded, 20 active+clean+wait, 21 active+undersized, 64 active+clean; 7.0 KiB data, 29 MiB used, 668 GiB / 672 GiB avail; 22/192 objects degraded (11.458%) 2021-03-10T13:52:40.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:40 gibba045 bash[25517]: cluster 2021-03-10T13:52:39.455912+0000 mon.a (mon.0) 387 : cluster [WRN] Health check failed: Degraded data redundancy: 22/192 objects degraded (11.458%), 15 pgs degraded (PG_DEGRADED) 2021-03-10T13:52:41.556 INFO:journalctl@ceph.osd.4.gibba045.stdout:Mar 10 13:52:41 gibba045 bash[27309]: debug 2021-03-10T13:52:41.207+0000 7f5e3f669700 1 -- 172.21.2.145:0/3001693266 <== mon.2 v2:172.21.2.145:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x561543a284e0 con 0x561543aa4c00 2021-03-10T13:52:42.056 INFO:journalctl@ceph.osd.4.gibba045.stdout:Mar 10 13:52:41 gibba045 bash[27309]: debug 2021-03-10T13:52:41.771+0000 7f5e470fe080 -1 Falling back to public interface 2021-03-10T13:52:42.737 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T13:52:42.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:42 gibba045 bash[25517]: cluster 2021-03-10T13:52:41.052482+0000 mgr.gibba045.orlgmj (mgr.34412) 222 : cluster [DBG] pgmap v110: 129 pgs: 5 stale+active+clean, 20 active+undersized+degraded, 20 active+clean+wait, 28 active+undersized, 56 active+clean; 7.0 KiB data, 29 MiB used, 668 GiB / 672 GiB avail; 28/192 objects degraded (14.583%) 2021-03-10T13:52:42.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:42 gibba045 bash[25517]: audit 2021-03-10T13:52:42.375505+0000 mon.a (mon.0) 388 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:52:42.965 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T13:52:42.966 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3m) 25s ago 8m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T13:52:42.966 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (8m) 0s ago 8m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T13:52:42.966 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3m) 0s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T13:52:42.966 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (4m) 0s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T13:52:42.967 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3m) 25s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T13:52:42.967 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2m) 25s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T13:52:42.967 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2m) 0s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T13:52:42.967 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2m) 25s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T13:52:42.967 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (8m) 25s ago 8m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T13:52:42.968 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (8m) 0s ago 8m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T13:52:42.968 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (104s) 25s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T13:52:42.968 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (78s) 25s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T13:52:42.968 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (52s) 25s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T13:52:42.968 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (27s) 25s ago 10m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T13:52:42.969 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2s) 0s ago 10m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T13:52:42.969 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (10m) 0s ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 662e73261675 2021-03-10T13:52:42.969 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (9m) 0s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 338d252f22e3 2021-03-10T13:52:42.969 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (9m) 0s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 784edc0668a4 2021-03-10T13:52:42.970 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (8m) 0s ago 9m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T13:52:42.970 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 0s ago 6m docker.io/ceph/ceph:v15.2.0 2021-03-10T13:52:42.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:42 gibba015 bash[29377]: cluster 2021-03-10T13:52:41.052482+0000 mgr.gibba045.orlgmj (mgr.34412) 222 : cluster [DBG] pgmap v110: 129 pgs: 5 stale+active+clean, 20 active+undersized+degraded, 20 active+clean+wait, 28 active+undersized, 56 active+clean; 7.0 KiB data, 29 MiB used, 668 GiB / 672 GiB avail; 28/192 objects degraded (14.583%) 2021-03-10T13:52:42.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:42 gibba015 bash[29377]: audit 2021-03-10T13:52:42.375505+0000 mon.a (mon.0) 388 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:52:42.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:42 gibba015 bash[30343]: cluster 2021-03-10T13:52:41.052482+0000 mgr.gibba045.orlgmj (mgr.34412) 222 : cluster [DBG] pgmap v110: 129 pgs: 5 stale+active+clean, 20 active+undersized+degraded, 20 active+clean+wait, 28 active+undersized, 56 active+clean; 7.0 KiB data, 29 MiB used, 668 GiB / 672 GiB avail; 28/192 objects degraded (14.583%) 2021-03-10T13:52:42.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:42 gibba015 bash[30343]: audit 2021-03-10T13:52:42.375505+0000 mon.a (mon.0) 388 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:52:43.213 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T13:52:43.213 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T13:52:43.213 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:52:43.213 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T13:52:43.214 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T13:52:43.214 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:52:43.214 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T13:52:43.214 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T13:52:43.215 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3, 2021-03-10T13:52:43.215 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 4 2021-03-10T13:52:43.215 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T13:52:43.215 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T13:52:43.216 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T13:52:43.216 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3, 2021-03-10T13:52:43.216 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 10 2021-03-10T13:52:43.216 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T13:52:43.216 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T13:52:43.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:43 gibba015 bash[29377]: cephadm 2021-03-10T13:52:42.378247+0000 mgr.gibba045.orlgmj (mgr.34412) 223 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T13:52:43.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:43 gibba015 bash[29377]: audit 2021-03-10T13:52:42.594278+0000 mon.a (mon.0) 389 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:52:43.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:43 gibba015 bash[29377]: audit 2021-03-10T13:52:42.598128+0000 mon.c (mon.1) 112 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:52:43.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:43 gibba015 bash[29377]: cephadm 2021-03-10T13:52:42.599036+0000 mgr.gibba045.orlgmj (mgr.34412) 224 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:52:43.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:43 gibba015 bash[29377]: audit 2021-03-10T13:52:42.599431+0000 mon.c (mon.1) 113 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:52:43.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:43 gibba015 bash[29377]: cephadm 2021-03-10T13:52:42.600646+0000 mgr.gibba045.orlgmj (mgr.34412) 225 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:52:43.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:43 gibba015 bash[29377]: audit 2021-03-10T13:52:42.600689+0000 mon.c (mon.1) 114 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:52:43.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:43 gibba015 bash[29377]: audit 2021-03-10T13:52:42.601806+0000 mon.c (mon.1) 115 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:52:43.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:43 gibba015 bash[29377]: cephadm 2021-03-10T13:52:42.601826+0000 mgr.gibba045.orlgmj (mgr.34412) 226 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:52:43.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:43 gibba015 bash[29377]: cephadm 2021-03-10T13:52:42.601864+0000 mgr.gibba045.orlgmj (mgr.34412) 227 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:52:43.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:43 gibba015 bash[29377]: cephadm 2021-03-10T13:52:42.603060+0000 mgr.gibba045.orlgmj (mgr.34412) 228 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:52:43.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:43 gibba015 bash[29377]: cephadm 2021-03-10T13:52:42.603097+0000 mgr.gibba045.orlgmj (mgr.34412) 229 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:52:43.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:43 gibba015 bash[29377]: cephadm 2021-03-10T13:52:42.604122+0000 mgr.gibba045.orlgmj (mgr.34412) 230 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:52:43.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:43 gibba015 bash[29377]: audit 2021-03-10T13:52:42.604451+0000 mon.c (mon.1) 116 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2021-03-10T13:52:43.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:43 gibba015 bash[29377]: cephadm 2021-03-10T13:52:42.605465+0000 mgr.gibba045.orlgmj (mgr.34412) 231 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:52:43.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:43 gibba015 bash[29377]: cephadm 2021-03-10T13:52:42.605503+0000 mgr.gibba045.orlgmj (mgr.34412) 232 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:52:43.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:43 gibba015 bash[29377]: audit 2021-03-10T13:52:42.606176+0000 mgr.gibba045.orlgmj (mgr.34412) 233 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2021-03-10T13:52:43.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:43 gibba015 bash[29377]: cephadm 2021-03-10T13:52:42.607295+0000 mgr.gibba045.orlgmj (mgr.34412) 234 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (8 PGs are or would become offline) 2021-03-10T13:52:43.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:43 gibba015 bash[29377]: audit 2021-03-10T13:52:42.727511+0000 mgr.gibba045.orlgmj (mgr.34412) 235 : audit [DBG] from='client.54217 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:52:43.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:43 gibba015 bash[29377]: audit 2021-03-10T13:52:43.210980+0000 mon.c (mon.1) 117 : audit [DBG] from='client.? 172.21.2.115:0/271960369' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:52:43.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:43 gibba015 bash[30343]: cephadm 2021-03-10T13:52:42.378247+0000 mgr.gibba045.orlgmj (mgr.34412) 223 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T13:52:43.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:43 gibba015 bash[30343]: audit 2021-03-10T13:52:42.594278+0000 mon.a (mon.0) 389 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:52:43.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:43 gibba015 bash[30343]: audit 2021-03-10T13:52:42.598128+0000 mon.c (mon.1) 112 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:52:43.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:43 gibba015 bash[30343]: cephadm 2021-03-10T13:52:42.599036+0000 mgr.gibba045.orlgmj (mgr.34412) 224 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:52:43.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:43 gibba015 bash[30343]: audit 2021-03-10T13:52:42.599431+0000 mon.c (mon.1) 113 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:52:43.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:43 gibba015 bash[30343]: cephadm 2021-03-10T13:52:42.600646+0000 mgr.gibba045.orlgmj (mgr.34412) 225 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:52:43.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:43 gibba015 bash[30343]: audit 2021-03-10T13:52:42.600689+0000 mon.c (mon.1) 114 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:52:43.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:43 gibba015 bash[30343]: audit 2021-03-10T13:52:42.601806+0000 mon.c (mon.1) 115 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:52:43.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:43 gibba015 bash[30343]: cephadm 2021-03-10T13:52:42.601826+0000 mgr.gibba045.orlgmj (mgr.34412) 226 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:52:43.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:43 gibba015 bash[30343]: cephadm 2021-03-10T13:52:42.601864+0000 mgr.gibba045.orlgmj (mgr.34412) 227 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:52:43.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:43 gibba015 bash[30343]: cephadm 2021-03-10T13:52:42.603060+0000 mgr.gibba045.orlgmj (mgr.34412) 228 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:52:43.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:43 gibba015 bash[30343]: cephadm 2021-03-10T13:52:42.603097+0000 mgr.gibba045.orlgmj (mgr.34412) 229 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:52:43.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:43 gibba015 bash[30343]: cephadm 2021-03-10T13:52:42.604122+0000 mgr.gibba045.orlgmj (mgr.34412) 230 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:52:43.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:43 gibba015 bash[30343]: audit 2021-03-10T13:52:42.604451+0000 mon.c (mon.1) 116 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2021-03-10T13:52:43.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:43 gibba015 bash[30343]: cephadm 2021-03-10T13:52:42.605465+0000 mgr.gibba045.orlgmj (mgr.34412) 231 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:52:43.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:43 gibba015 bash[30343]: cephadm 2021-03-10T13:52:42.605503+0000 mgr.gibba045.orlgmj (mgr.34412) 232 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:52:43.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:43 gibba015 bash[30343]: audit 2021-03-10T13:52:42.606176+0000 mgr.gibba045.orlgmj (mgr.34412) 233 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2021-03-10T13:52:43.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:43 gibba015 bash[30343]: cephadm 2021-03-10T13:52:42.607295+0000 mgr.gibba045.orlgmj (mgr.34412) 234 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (8 PGs are or would become offline) 2021-03-10T13:52:43.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:43 gibba015 bash[30343]: audit 2021-03-10T13:52:42.727511+0000 mgr.gibba045.orlgmj (mgr.34412) 235 : audit [DBG] from='client.54217 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:52:43.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:43 gibba015 bash[30343]: audit 2021-03-10T13:52:43.210980+0000 mon.c (mon.1) 117 : audit [DBG] from='client.? 172.21.2.115:0/271960369' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:52:44.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:43 gibba045 bash[25517]: cephadm 2021-03-10T13:52:42.378247+0000 mgr.gibba045.orlgmj (mgr.34412) 223 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T13:52:44.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:43 gibba045 bash[25517]: audit 2021-03-10T13:52:42.594278+0000 mon.a (mon.0) 389 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:52:44.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:43 gibba045 bash[25517]: audit 2021-03-10T13:52:42.598128+0000 mon.c (mon.1) 112 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:52:44.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:43 gibba045 bash[25517]: cephadm 2021-03-10T13:52:42.599036+0000 mgr.gibba045.orlgmj (mgr.34412) 224 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:52:44.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:43 gibba045 bash[25517]: audit 2021-03-10T13:52:42.599431+0000 mon.c (mon.1) 113 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:52:44.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:43 gibba045 bash[25517]: cephadm 2021-03-10T13:52:42.600646+0000 mgr.gibba045.orlgmj (mgr.34412) 225 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:52:44.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:43 gibba045 bash[25517]: audit 2021-03-10T13:52:42.600689+0000 mon.c (mon.1) 114 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:52:44.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:43 gibba045 bash[25517]: audit 2021-03-10T13:52:42.601806+0000 mon.c (mon.1) 115 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:52:44.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:43 gibba045 bash[25517]: cephadm 2021-03-10T13:52:42.601826+0000 mgr.gibba045.orlgmj (mgr.34412) 226 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:52:44.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:43 gibba045 bash[25517]: cephadm 2021-03-10T13:52:42.601864+0000 mgr.gibba045.orlgmj (mgr.34412) 227 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:52:44.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:43 gibba045 bash[25517]: cephadm 2021-03-10T13:52:42.603060+0000 mgr.gibba045.orlgmj (mgr.34412) 228 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:52:44.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:43 gibba045 bash[25517]: cephadm 2021-03-10T13:52:42.603097+0000 mgr.gibba045.orlgmj (mgr.34412) 229 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:52:44.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:43 gibba045 bash[25517]: cephadm 2021-03-10T13:52:42.604122+0000 mgr.gibba045.orlgmj (mgr.34412) 230 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:52:44.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:43 gibba045 bash[25517]: audit 2021-03-10T13:52:42.604451+0000 mon.c (mon.1) 116 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2021-03-10T13:52:44.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:43 gibba045 bash[25517]: cephadm 2021-03-10T13:52:42.605465+0000 mgr.gibba045.orlgmj (mgr.34412) 231 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:52:44.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:43 gibba045 bash[25517]: cephadm 2021-03-10T13:52:42.605503+0000 mgr.gibba045.orlgmj (mgr.34412) 232 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:52:44.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:43 gibba045 bash[25517]: audit 2021-03-10T13:52:42.606176+0000 mgr.gibba045.orlgmj (mgr.34412) 233 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2021-03-10T13:52:44.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:43 gibba045 bash[25517]: cephadm 2021-03-10T13:52:42.607295+0000 mgr.gibba045.orlgmj (mgr.34412) 234 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (8 PGs are or would become offline) 2021-03-10T13:52:44.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:43 gibba045 bash[25517]: audit 2021-03-10T13:52:42.727511+0000 mgr.gibba045.orlgmj (mgr.34412) 235 : audit [DBG] from='client.54217 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:52:44.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:43 gibba045 bash[25517]: audit 2021-03-10T13:52:43.210980+0000 mon.c (mon.1) 117 : audit [DBG] from='client.? 172.21.2.115:0/271960369' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:52:44.958 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:44 gibba045 bash[25517]: audit 2021-03-10T13:52:42.952041+0000 mgr.gibba045.orlgmj (mgr.34412) 236 : audit [DBG] from='client.44235 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:52:44.959 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:44 gibba045 bash[25517]: cluster 2021-03-10T13:52:43.053865+0000 mgr.gibba045.orlgmj (mgr.34412) 237 : cluster [DBG] pgmap v111: 129 pgs: 21 active+undersized+degraded, 35 active+undersized, 73 active+clean; 7.0 KiB data, 29 MiB used, 668 GiB / 672 GiB avail; 29/192 objects degraded (15.104%) 2021-03-10T13:52:44.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:44 gibba015 bash[29377]: audit 2021-03-10T13:52:42.952041+0000 mgr.gibba045.orlgmj (mgr.34412) 236 : audit [DBG] from='client.44235 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:52:44.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:44 gibba015 bash[29377]: cluster 2021-03-10T13:52:43.053865+0000 mgr.gibba045.orlgmj (mgr.34412) 237 : cluster [DBG] pgmap v111: 129 pgs: 21 active+undersized+degraded, 35 active+undersized, 73 active+clean; 7.0 KiB data, 29 MiB used, 668 GiB / 672 GiB avail; 29/192 objects degraded (15.104%) 2021-03-10T13:52:44.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:44 gibba015 bash[30343]: audit 2021-03-10T13:52:42.952041+0000 mgr.gibba045.orlgmj (mgr.34412) 236 : audit [DBG] from='client.44235 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:52:44.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:44 gibba015 bash[30343]: cluster 2021-03-10T13:52:43.053865+0000 mgr.gibba045.orlgmj (mgr.34412) 237 : cluster [DBG] pgmap v111: 129 pgs: 21 active+undersized+degraded, 35 active+undersized, 73 active+clean; 7.0 KiB data, 29 MiB used, 668 GiB / 672 GiB avail; 29/192 objects degraded (15.104%) 2021-03-10T13:52:45.307 INFO:journalctl@ceph.osd.4.gibba045.stdout:Mar 10 13:52:44 gibba045 bash[27309]: debug 2021-03-10T13:52:44.955+0000 7f5e470fe080 -1 bluestore(/var/lib/ceph/osd/ceph-4) fsck warning: store not yet converted to per-pg omap 2021-03-10T13:52:45.321 INFO:journalctl@ceph.osd.4.gibba045.stdout:Mar 10 13:52:44 gibba045 bash[27309]: debug 2021-03-10T13:52:44.955+0000 7f5e32bc4700 -1 bluestore(/var/lib/ceph/osd/ceph-4) fsck warning: #-1:c1a3fc6e:::purged_snaps:0# has omap that is not per-pg or pgmeta 2021-03-10T13:52:45.321 INFO:journalctl@ceph.osd.4.gibba045.stdout:Mar 10 13:52:45 gibba045 bash[27309]: debug 2021-03-10T13:52:45.083+0000 7f5e470fe080 -1 osd.4 82 log_to_monitors {default=true} 2021-03-10T13:52:45.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:45 gibba015 bash[29377]: audit 2021-03-10T13:52:45.087605+0000 mon.a (mon.0) 390 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-03-10T13:52:45.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:45 gibba015 bash[29377]: audit 2021-03-10T13:52:45.088271+0000 mon.b (mon.2) 3 : audit [INF] from='osd.4 [v2:172.21.2.145:6800/1783567545,v1:172.21.2.145:6801/1783567545]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-03-10T13:52:45.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:45 gibba015 bash[30343]: audit 2021-03-10T13:52:45.087605+0000 mon.a (mon.0) 390 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-03-10T13:52:45.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:45 gibba015 bash[30343]: audit 2021-03-10T13:52:45.088271+0000 mon.b (mon.2) 3 : audit [INF] from='osd.4 [v2:172.21.2.145:6800/1783567545,v1:172.21.2.145:6801/1783567545]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-03-10T13:52:46.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:45 gibba045 bash[25517]: audit 2021-03-10T13:52:45.087605+0000 mon.a (mon.0) 390 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-03-10T13:52:46.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:45 gibba045 bash[25517]: audit 2021-03-10T13:52:45.088271+0000 mon.b (mon.2) 3 : audit [INF] from='osd.4 [v2:172.21.2.145:6800/1783567545,v1:172.21.2.145:6801/1783567545]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-03-10T13:52:46.057 INFO:journalctl@ceph.osd.4.gibba045.stdout:Mar 10 13:52:45 gibba045 bash[27309]: debug 2021-03-10T13:52:45.631+0000 7f5e385de700 -1 osd.4 82 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T13:52:46.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:46 gibba015 bash[29377]: cluster 2021-03-10T13:52:45.054483+0000 mgr.gibba045.orlgmj (mgr.34412) 238 : cluster [DBG] pgmap v112: 129 pgs: 21 active+undersized+degraded, 35 active+undersized, 73 active+clean; 7.0 KiB data, 29 MiB used, 668 GiB / 672 GiB avail; 29/192 objects degraded (15.104%) 2021-03-10T13:52:46.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:46 gibba015 bash[29377]: audit 2021-03-10T13:52:45.624633+0000 mon.a (mon.0) 391 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2021-03-10T13:52:46.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:46 gibba015 bash[29377]: cluster 2021-03-10T13:52:45.624692+0000 mon.a (mon.0) 392 : cluster [DBG] osdmap e85: 8 total, 7 up, 8 in 2021-03-10T13:52:46.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:46 gibba015 bash[29377]: audit 2021-03-10T13:52:45.626157+0000 mon.a (mon.0) 393 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0820, "args": ["host=gibba045", "root=default"]}]: dispatch 2021-03-10T13:52:46.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:46 gibba015 bash[29377]: audit 2021-03-10T13:52:45.627366+0000 mon.b (mon.2) 4 : audit [INF] from='osd.4 [v2:172.21.2.145:6800/1783567545,v1:172.21.2.145:6801/1783567545]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0820, "args": ["host=gibba045", "root=default"]}]: dispatch 2021-03-10T13:52:46.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:46 gibba015 bash[29377]: cluster 2021-03-10T13:52:46.377238+0000 mon.a (mon.0) 394 : cluster [WRN] Health check update: Degraded data redundancy: 29/192 objects degraded (15.104%), 21 pgs degraded (PG_DEGRADED) 2021-03-10T13:52:46.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:46 gibba015 bash[30343]: cluster 2021-03-10T13:52:45.054483+0000 mgr.gibba045.orlgmj (mgr.34412) 238 : cluster [DBG] pgmap v112: 129 pgs: 21 active+undersized+degraded, 35 active+undersized, 73 active+clean; 7.0 KiB data, 29 MiB used, 668 GiB / 672 GiB avail; 29/192 objects degraded (15.104%) 2021-03-10T13:52:46.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:46 gibba015 bash[30343]: audit 2021-03-10T13:52:45.624633+0000 mon.a (mon.0) 391 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2021-03-10T13:52:46.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:46 gibba015 bash[30343]: cluster 2021-03-10T13:52:45.624692+0000 mon.a (mon.0) 392 : cluster [DBG] osdmap e85: 8 total, 7 up, 8 in 2021-03-10T13:52:46.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:46 gibba015 bash[30343]: audit 2021-03-10T13:52:45.626157+0000 mon.a (mon.0) 393 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0820, "args": ["host=gibba045", "root=default"]}]: dispatch 2021-03-10T13:52:46.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:46 gibba015 bash[30343]: audit 2021-03-10T13:52:45.627366+0000 mon.b (mon.2) 4 : audit [INF] from='osd.4 [v2:172.21.2.145:6800/1783567545,v1:172.21.2.145:6801/1783567545]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0820, "args": ["host=gibba045", "root=default"]}]: dispatch 2021-03-10T13:52:46.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:46 gibba015 bash[30343]: cluster 2021-03-10T13:52:46.377238+0000 mon.a (mon.0) 394 : cluster [WRN] Health check update: Degraded data redundancy: 29/192 objects degraded (15.104%), 21 pgs degraded (PG_DEGRADED) 2021-03-10T13:52:47.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:46 gibba045 bash[25517]: cluster 2021-03-10T13:52:45.054483+0000 mgr.gibba045.orlgmj (mgr.34412) 238 : cluster [DBG] pgmap v112: 129 pgs: 21 active+undersized+degraded, 35 active+undersized, 73 active+clean; 7.0 KiB data, 29 MiB used, 668 GiB / 672 GiB avail; 29/192 objects degraded (15.104%) 2021-03-10T13:52:47.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:46 gibba045 bash[25517]: audit 2021-03-10T13:52:45.624633+0000 mon.a (mon.0) 391 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2021-03-10T13:52:47.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:46 gibba045 bash[25517]: cluster 2021-03-10T13:52:45.624692+0000 mon.a (mon.0) 392 : cluster [DBG] osdmap e85: 8 total, 7 up, 8 in 2021-03-10T13:52:47.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:46 gibba045 bash[25517]: audit 2021-03-10T13:52:45.626157+0000 mon.a (mon.0) 393 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0820, "args": ["host=gibba045", "root=default"]}]: dispatch 2021-03-10T13:52:47.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:46 gibba045 bash[25517]: audit 2021-03-10T13:52:45.627366+0000 mon.b (mon.2) 4 : audit [INF] from='osd.4 [v2:172.21.2.145:6800/1783567545,v1:172.21.2.145:6801/1783567545]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0820, "args": ["host=gibba045", "root=default"]}]: dispatch 2021-03-10T13:52:47.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:46 gibba045 bash[25517]: cluster 2021-03-10T13:52:46.377238+0000 mon.a (mon.0) 394 : cluster [WRN] Health check update: Degraded data redundancy: 29/192 objects degraded (15.104%), 21 pgs degraded (PG_DEGRADED) 2021-03-10T13:52:47.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:47 gibba015 bash[29377]: cluster 2021-03-10T13:52:46.624254+0000 mon.a (mon.0) 395 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T13:52:47.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:47 gibba015 bash[29377]: cluster 2021-03-10T13:52:46.636102+0000 mon.a (mon.0) 396 : cluster [INF] osd.4 [v2:172.21.2.145:6800/1783567545,v1:172.21.2.145:6801/1783567545] boot 2021-03-10T13:52:47.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:47 gibba015 bash[29377]: cluster 2021-03-10T13:52:46.636315+0000 mon.a (mon.0) 397 : cluster [DBG] osdmap e86: 8 total, 8 up, 8 in 2021-03-10T13:52:47.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:47 gibba015 bash[29377]: audit 2021-03-10T13:52:46.638159+0000 mon.c (mon.1) 118 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T13:52:47.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:47 gibba015 bash[29377]: cluster 2021-03-10T13:52:47.640236+0000 mon.a (mon.0) 398 : cluster [DBG] osdmap e87: 8 total, 8 up, 8 in 2021-03-10T13:52:47.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:47 gibba015 bash[30343]: cluster 2021-03-10T13:52:46.624254+0000 mon.a (mon.0) 395 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T13:52:47.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:47 gibba015 bash[30343]: cluster 2021-03-10T13:52:46.636102+0000 mon.a (mon.0) 396 : cluster [INF] osd.4 [v2:172.21.2.145:6800/1783567545,v1:172.21.2.145:6801/1783567545] boot 2021-03-10T13:52:47.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:47 gibba015 bash[30343]: cluster 2021-03-10T13:52:46.636315+0000 mon.a (mon.0) 397 : cluster [DBG] osdmap e86: 8 total, 8 up, 8 in 2021-03-10T13:52:47.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:47 gibba015 bash[30343]: audit 2021-03-10T13:52:46.638159+0000 mon.c (mon.1) 118 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T13:52:47.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:47 gibba015 bash[30343]: cluster 2021-03-10T13:52:47.640236+0000 mon.a (mon.0) 398 : cluster [DBG] osdmap e87: 8 total, 8 up, 8 in 2021-03-10T13:52:48.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:47 gibba045 bash[25517]: cluster 2021-03-10T13:52:46.624254+0000 mon.a (mon.0) 395 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T13:52:48.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:47 gibba045 bash[25517]: cluster 2021-03-10T13:52:46.636102+0000 mon.a (mon.0) 396 : cluster [INF] osd.4 [v2:172.21.2.145:6800/1783567545,v1:172.21.2.145:6801/1783567545] boot 2021-03-10T13:52:48.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:47 gibba045 bash[25517]: cluster 2021-03-10T13:52:46.636315+0000 mon.a (mon.0) 397 : cluster [DBG] osdmap e86: 8 total, 8 up, 8 in 2021-03-10T13:52:48.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:47 gibba045 bash[25517]: audit 2021-03-10T13:52:46.638159+0000 mon.c (mon.1) 118 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T13:52:48.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:47 gibba045 bash[25517]: cluster 2021-03-10T13:52:47.640236+0000 mon.a (mon.0) 398 : cluster [DBG] osdmap e87: 8 total, 8 up, 8 in 2021-03-10T13:52:48.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:48 gibba015 bash[29377]: cluster 2021-03-10T13:52:47.055618+0000 mgr.gibba045.orlgmj (mgr.34412) 239 : cluster [DBG] pgmap v115: 129 pgs: 21 active+undersized+degraded, 35 active+undersized, 73 active+clean; 7.0 KiB data, 33 MiB used, 669 GiB / 672 GiB avail; 29/192 objects degraded (15.104%) 2021-03-10T13:52:48.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:48 gibba015 bash[30343]: cluster 2021-03-10T13:52:47.055618+0000 mgr.gibba045.orlgmj (mgr.34412) 239 : cluster [DBG] pgmap v115: 129 pgs: 21 active+undersized+degraded, 35 active+undersized, 73 active+clean; 7.0 KiB data, 33 MiB used, 669 GiB / 672 GiB avail; 29/192 objects degraded (15.104%) 2021-03-10T13:52:49.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:48 gibba045 bash[25517]: cluster 2021-03-10T13:52:47.055618+0000 mgr.gibba045.orlgmj (mgr.34412) 239 : cluster [DBG] pgmap v115: 129 pgs: 21 active+undersized+degraded, 35 active+undersized, 73 active+clean; 7.0 KiB data, 33 MiB used, 669 GiB / 672 GiB avail; 29/192 objects degraded (15.104%) 2021-03-10T13:52:50.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:50 gibba015 bash[29377]: cluster 2021-03-10T13:52:49.057717+0000 mgr.gibba045.orlgmj (mgr.34412) 240 : cluster [DBG] pgmap v117: 129 pgs: 10 active+undersized+degraded, 19 active+undersized, 100 active+clean; 7.0 KiB data, 34 MiB used, 669 GiB / 672 GiB avail; 14/192 objects degraded (7.292%) 2021-03-10T13:52:50.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:50 gibba015 bash[30343]: cluster 2021-03-10T13:52:49.057717+0000 mgr.gibba045.orlgmj (mgr.34412) 240 : cluster [DBG] pgmap v117: 129 pgs: 10 active+undersized+degraded, 19 active+undersized, 100 active+clean; 7.0 KiB data, 34 MiB used, 669 GiB / 672 GiB avail; 14/192 objects degraded (7.292%) 2021-03-10T13:52:51.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:50 gibba045 bash[25517]: cluster 2021-03-10T13:52:49.057717+0000 mgr.gibba045.orlgmj (mgr.34412) 240 : cluster [DBG] pgmap v117: 129 pgs: 10 active+undersized+degraded, 19 active+undersized, 100 active+clean; 7.0 KiB data, 34 MiB used, 669 GiB / 672 GiB avail; 14/192 objects degraded (7.292%) 2021-03-10T13:52:51.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:51 gibba015 bash[29377]: cluster 2021-03-10T13:52:51.378554+0000 mon.a (mon.0) 399 : cluster [WRN] Health check update: Degraded data redundancy: 14/192 objects degraded (7.292%), 10 pgs degraded (PG_DEGRADED) 2021-03-10T13:52:51.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:51 gibba015 bash[30343]: cluster 2021-03-10T13:52:51.378554+0000 mon.a (mon.0) 399 : cluster [WRN] Health check update: Degraded data redundancy: 14/192 objects degraded (7.292%), 10 pgs degraded (PG_DEGRADED) 2021-03-10T13:52:52.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:51 gibba045 bash[25517]: cluster 2021-03-10T13:52:51.378554+0000 mon.a (mon.0) 399 : cluster [WRN] Health check update: Degraded data redundancy: 14/192 objects degraded (7.292%), 10 pgs degraded (PG_DEGRADED) 2021-03-10T13:52:52.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:52 gibba015 bash[29377]: cluster 2021-03-10T13:52:51.059248+0000 mgr.gibba045.orlgmj (mgr.34412) 241 : cluster [DBG] pgmap v118: 129 pgs: 18 active+clean+wait, 1 active+undersized+degraded, 2 active+undersized, 108 active+clean; 7.0 KiB data, 34 MiB used, 669 GiB / 672 GiB avail; 1/192 objects degraded (0.521%) 2021-03-10T13:52:52.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:52 gibba015 bash[29377]: audit 2021-03-10T13:52:52.467350+0000 mon.c (mon.1) 119 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:52:52.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:52 gibba015 bash[29377]: audit 2021-03-10T13:52:52.468441+0000 mon.a (mon.0) 400 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:52:52.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:52 gibba015 bash[29377]: audit 2021-03-10T13:52:52.473850+0000 mon.c (mon.1) 120 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T13:52:52.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:52 gibba015 bash[29377]: audit 2021-03-10T13:52:52.474856+0000 mon.a (mon.0) 401 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T13:52:52.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:52 gibba015 bash[30343]: cluster 2021-03-10T13:52:51.059248+0000 mgr.gibba045.orlgmj (mgr.34412) 241 : cluster [DBG] pgmap v118: 129 pgs: 18 active+clean+wait, 1 active+undersized+degraded, 2 active+undersized, 108 active+clean; 7.0 KiB data, 34 MiB used, 669 GiB / 672 GiB avail; 1/192 objects degraded (0.521%) 2021-03-10T13:52:52.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:52 gibba015 bash[30343]: audit 2021-03-10T13:52:52.467350+0000 mon.c (mon.1) 119 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:52:52.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:52 gibba015 bash[30343]: audit 2021-03-10T13:52:52.468441+0000 mon.a (mon.0) 400 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:52:52.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:52 gibba015 bash[30343]: audit 2021-03-10T13:52:52.473850+0000 mon.c (mon.1) 120 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T13:52:52.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:52 gibba015 bash[30343]: audit 2021-03-10T13:52:52.474856+0000 mon.a (mon.0) 401 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T13:52:53.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:52 gibba045 bash[25517]: cluster 2021-03-10T13:52:51.059248+0000 mgr.gibba045.orlgmj (mgr.34412) 241 : cluster [DBG] pgmap v118: 129 pgs: 18 active+clean+wait, 1 active+undersized+degraded, 2 active+undersized, 108 active+clean; 7.0 KiB data, 34 MiB used, 669 GiB / 672 GiB avail; 1/192 objects degraded (0.521%) 2021-03-10T13:52:53.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:52 gibba045 bash[25517]: audit 2021-03-10T13:52:52.467350+0000 mon.c (mon.1) 119 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:52:53.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:52 gibba045 bash[25517]: audit 2021-03-10T13:52:52.468441+0000 mon.a (mon.0) 400 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:52:53.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:52 gibba045 bash[25517]: audit 2021-03-10T13:52:52.473850+0000 mon.c (mon.1) 120 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T13:52:53.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:52 gibba045 bash[25517]: audit 2021-03-10T13:52:52.474856+0000 mon.a (mon.0) 401 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T13:52:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:53 gibba045 bash[25517]: cluster 2021-03-10T13:52:53.675185+0000 mon.a (mon.0) 402 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/192 objects degraded (0.521%), 1 pg degraded) 2021-03-10T13:52:54.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:53 gibba015 bash[29377]: cluster 2021-03-10T13:52:53.675185+0000 mon.a (mon.0) 402 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/192 objects degraded (0.521%), 1 pg degraded) 2021-03-10T13:52:54.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:53 gibba015 bash[30343]: cluster 2021-03-10T13:52:53.675185+0000 mon.a (mon.0) 402 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/192 objects degraded (0.521%), 1 pg degraded) 2021-03-10T13:52:55.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:54 gibba045 bash[25517]: cluster 2021-03-10T13:52:53.060562+0000 mgr.gibba045.orlgmj (mgr.34412) 242 : cluster [DBG] pgmap v119: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T13:52:55.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:54 gibba015 bash[29377]: cluster 2021-03-10T13:52:53.060562+0000 mgr.gibba045.orlgmj (mgr.34412) 242 : cluster [DBG] pgmap v119: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T13:52:55.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:54 gibba015 bash[30343]: cluster 2021-03-10T13:52:53.060562+0000 mgr.gibba045.orlgmj (mgr.34412) 242 : cluster [DBG] pgmap v119: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T13:52:57.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:56 gibba045 bash[25517]: cluster 2021-03-10T13:52:55.062125+0000 mgr.gibba045.orlgmj (mgr.34412) 243 : cluster [DBG] pgmap v120: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T13:52:57.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:56 gibba015 bash[29377]: cluster 2021-03-10T13:52:55.062125+0000 mgr.gibba045.orlgmj (mgr.34412) 243 : cluster [DBG] pgmap v120: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T13:52:57.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:56 gibba015 bash[30343]: cluster 2021-03-10T13:52:55.062125+0000 mgr.gibba045.orlgmj (mgr.34412) 243 : cluster [DBG] pgmap v120: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T13:52:58.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:58 gibba045 bash[25517]: cluster 2021-03-10T13:52:57.063518+0000 mgr.gibba045.orlgmj (mgr.34412) 244 : cluster [DBG] pgmap v121: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T13:52:58.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:58 gibba045 bash[25517]: audit 2021-03-10T13:52:57.528834+0000 mon.a (mon.0) 403 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:52:58.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:58 gibba045 bash[25517]: audit 2021-03-10T13:52:57.622277+0000 mon.c (mon.1) 121 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2021-03-10T13:52:58.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:58 gibba045 bash[25517]: audit 2021-03-10T13:52:57.624847+0000 mgr.gibba045.orlgmj (mgr.34412) 245 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2021-03-10T13:52:58.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:52:58 gibba045 bash[25517]: cephadm 2021-03-10T13:52:57.629628+0000 mgr.gibba045.orlgmj (mgr.34412) 246 : cephadm [INF] Upgrade: osd.5 is safe to restart 2021-03-10T13:52:58.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:58 gibba015 bash[29377]: cluster 2021-03-10T13:52:57.063518+0000 mgr.gibba045.orlgmj (mgr.34412) 244 : cluster [DBG] pgmap v121: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T13:52:58.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:58 gibba015 bash[29377]: audit 2021-03-10T13:52:57.528834+0000 mon.a (mon.0) 403 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:52:58.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:58 gibba015 bash[29377]: audit 2021-03-10T13:52:57.622277+0000 mon.c (mon.1) 121 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2021-03-10T13:52:58.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:58 gibba015 bash[29377]: audit 2021-03-10T13:52:57.624847+0000 mgr.gibba045.orlgmj (mgr.34412) 245 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2021-03-10T13:52:58.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:52:58 gibba015 bash[29377]: cephadm 2021-03-10T13:52:57.629628+0000 mgr.gibba045.orlgmj (mgr.34412) 246 : cephadm [INF] Upgrade: osd.5 is safe to restart 2021-03-10T13:52:58.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:58 gibba015 bash[30343]: cluster 2021-03-10T13:52:57.063518+0000 mgr.gibba045.orlgmj (mgr.34412) 244 : cluster [DBG] pgmap v121: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T13:52:58.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:58 gibba015 bash[30343]: audit 2021-03-10T13:52:57.528834+0000 mon.a (mon.0) 403 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:52:58.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:58 gibba015 bash[30343]: audit 2021-03-10T13:52:57.622277+0000 mon.c (mon.1) 121 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2021-03-10T13:52:58.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:58 gibba015 bash[30343]: audit 2021-03-10T13:52:57.624847+0000 mgr.gibba045.orlgmj (mgr.34412) 245 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2021-03-10T13:52:58.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:52:58 gibba015 bash[30343]: cephadm 2021-03-10T13:52:57.629628+0000 mgr.gibba045.orlgmj (mgr.34412) 246 : cephadm [INF] Upgrade: osd.5 is safe to restart 2021-03-10T13:53:00.585 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:00 gibba045 bash[25517]: cluster 2021-03-10T13:52:59.065026+0000 mgr.gibba045.orlgmj (mgr.34412) 247 : cluster [DBG] pgmap v122: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T13:53:00.585 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:00 gibba045 bash[25517]: cephadm 2021-03-10T13:52:59.366737+0000 mgr.gibba045.orlgmj (mgr.34412) 248 : cephadm [INF] Upgrade: Updating osd.5 2021-03-10T13:53:00.585 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:00 gibba045 bash[25517]: audit 2021-03-10T13:52:59.377048+0000 mon.a (mon.0) 404 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:53:00.586 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:00 gibba045 bash[25517]: audit 2021-03-10T13:52:59.378904+0000 mon.c (mon.1) 122 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd.5","key": "container_image"}]: dispatch 2021-03-10T13:53:00.586 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:00 gibba045 bash[25517]: cephadm 2021-03-10T13:52:59.380217+0000 mgr.gibba045.orlgmj (mgr.34412) 249 : cephadm [INF] Deploying daemon osd.5 on gibba045 2021-03-10T13:53:00.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:00 gibba015 bash[29377]: cluster 2021-03-10T13:52:59.065026+0000 mgr.gibba045.orlgmj (mgr.34412) 247 : cluster [DBG] pgmap v122: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T13:53:00.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:00 gibba015 bash[29377]: cephadm 2021-03-10T13:52:59.366737+0000 mgr.gibba045.orlgmj (mgr.34412) 248 : cephadm [INF] Upgrade: Updating osd.5 2021-03-10T13:53:00.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:00 gibba015 bash[29377]: audit 2021-03-10T13:52:59.377048+0000 mon.a (mon.0) 404 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:53:00.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:00 gibba015 bash[29377]: audit 2021-03-10T13:52:59.378904+0000 mon.c (mon.1) 122 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd.5","key": "container_image"}]: dispatch 2021-03-10T13:53:00.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:00 gibba015 bash[29377]: cephadm 2021-03-10T13:52:59.380217+0000 mgr.gibba045.orlgmj (mgr.34412) 249 : cephadm [INF] Deploying daemon osd.5 on gibba045 2021-03-10T13:53:00.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:00 gibba015 bash[30343]: cluster 2021-03-10T13:52:59.065026+0000 mgr.gibba045.orlgmj (mgr.34412) 247 : cluster [DBG] pgmap v122: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T13:53:00.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:00 gibba015 bash[30343]: cephadm 2021-03-10T13:52:59.366737+0000 mgr.gibba045.orlgmj (mgr.34412) 248 : cephadm [INF] Upgrade: Updating osd.5 2021-03-10T13:53:00.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:00 gibba015 bash[30343]: audit 2021-03-10T13:52:59.377048+0000 mon.a (mon.0) 404 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:53:00.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:00 gibba015 bash[30343]: audit 2021-03-10T13:52:59.378904+0000 mon.c (mon.1) 122 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd.5","key": "container_image"}]: dispatch 2021-03-10T13:53:00.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:00 gibba015 bash[30343]: cephadm 2021-03-10T13:52:59.380217+0000 mgr.gibba045.orlgmj (mgr.34412) 249 : cephadm [INF] Deploying daemon osd.5 on gibba045 2021-03-10T13:53:01.307 INFO:journalctl@ceph.osd.5.gibba045.stdout:Mar 10 13:53:01 gibba045 systemd[1]: Stopping Ceph osd.5 for e4a642d2-81a5-11eb-9080-001a4aab830c... 2021-03-10T13:53:01.307 INFO:journalctl@ceph.osd.5.gibba045.stdout:Mar 10 13:53:01 gibba045 bash[13761]: debug 2021-03-10T13:53:01.275+0000 7fc3b8e87700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2021-03-10T13:53:01.307 INFO:journalctl@ceph.osd.5.gibba045.stdout:Mar 10 13:53:01 gibba045 bash[13761]: debug 2021-03-10T13:53:01.275+0000 7fc3b8e87700 -1 osd.5 87 *** Got signal Terminated *** 2021-03-10T13:53:01.308 INFO:journalctl@ceph.osd.5.gibba045.stdout:Mar 10 13:53:01 gibba045 bash[13761]: debug 2021-03-10T13:53:01.275+0000 7fc3b8e87700 -1 osd.5 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-03-10T13:53:02.306 INFO:journalctl@ceph.osd.5.gibba045.stdout:Mar 10 13:53:01 gibba045 docker[28254]: ceph-e4a642d2-81a5-11eb-9080-001a4aab830c-osd.5 2021-03-10T13:53:02.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[29377]: cluster 2021-03-10T13:53:01.065527+0000 mgr.gibba045.orlgmj (mgr.34412) 250 : cluster [DBG] pgmap v123: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T13:53:02.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[29377]: cluster 2021-03-10T13:53:01.531721+0000 mon.a (mon.0) 405 : cluster [DBG] osd.5 reported immediately failed by osd.7 2021-03-10T13:53:02.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[29377]: cluster 2021-03-10T13:53:01.531887+0000 mon.a (mon.0) 406 : cluster [INF] osd.5 failed (root=default,host=gibba045) (connection refused reported by osd.7) 2021-03-10T13:53:02.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[29377]: cluster 2021-03-10T13:53:01.532847+0000 mon.a (mon.0) 407 : cluster [DBG] osd.5 reported immediately failed by osd.6 2021-03-10T13:53:02.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[29377]: cluster 2021-03-10T13:53:01.533635+0000 mon.a (mon.0) 408 : cluster [DBG] osd.5 reported immediately failed by osd.1 2021-03-10T13:53:02.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[29377]: cluster 2021-03-10T13:53:01.534406+0000 mon.a (mon.0) 409 : cluster [DBG] osd.5 reported immediately failed by osd.2 2021-03-10T13:53:02.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[29377]: cluster 2021-03-10T13:53:01.535060+0000 mon.a (mon.0) 410 : cluster [DBG] osd.5 reported immediately failed by osd.0 2021-03-10T13:53:02.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[29377]: cluster 2021-03-10T13:53:01.582363+0000 mon.a (mon.0) 411 : cluster [DBG] osd.5 reported immediately failed by osd.7 2021-03-10T13:53:02.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[29377]: cluster 2021-03-10T13:53:01.582755+0000 mon.a (mon.0) 412 : cluster [DBG] osd.5 reported immediately failed by osd.7 2021-03-10T13:53:02.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[29377]: cluster 2021-03-10T13:53:01.583378+0000 mon.a (mon.0) 413 : cluster [DBG] osd.5 reported immediately failed by osd.6 2021-03-10T13:53:02.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[29377]: cluster 2021-03-10T13:53:01.583906+0000 mon.a (mon.0) 414 : cluster [DBG] osd.5 reported immediately failed by osd.6 2021-03-10T13:53:02.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[29377]: cluster 2021-03-10T13:53:01.584429+0000 mon.a (mon.0) 415 : cluster [DBG] osd.5 reported immediately failed by osd.0 2021-03-10T13:53:02.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[29377]: cluster 2021-03-10T13:53:01.584712+0000 mon.a (mon.0) 416 : cluster [DBG] osd.5 reported immediately failed by osd.4 2021-03-10T13:53:02.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[29377]: cluster 2021-03-10T13:53:01.585350+0000 mon.a (mon.0) 417 : cluster [DBG] osd.5 reported immediately failed by osd.1 2021-03-10T13:53:02.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[29377]: cluster 2021-03-10T13:53:01.585630+0000 mon.a (mon.0) 418 : cluster [DBG] osd.5 reported immediately failed by osd.4 2021-03-10T13:53:02.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[29377]: cluster 2021-03-10T13:53:01.586158+0000 mon.a (mon.0) 419 : cluster [DBG] osd.5 reported immediately failed by osd.3 2021-03-10T13:53:02.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[29377]: cluster 2021-03-10T13:53:01.586432+0000 mon.a (mon.0) 420 : cluster [DBG] osd.5 reported immediately failed by osd.0 2021-03-10T13:53:02.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[29377]: cluster 2021-03-10T13:53:01.586923+0000 mon.a (mon.0) 421 : cluster [DBG] osd.5 reported immediately failed by osd.3 2021-03-10T13:53:02.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[29377]: cluster 2021-03-10T13:53:01.587193+0000 mon.a (mon.0) 422 : cluster [DBG] osd.5 reported immediately failed by osd.1 2021-03-10T13:53:02.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[29377]: cluster 2021-03-10T13:53:01.587587+0000 mon.a (mon.0) 423 : cluster [DBG] osd.5 reported immediately failed by osd.2 2021-03-10T13:53:02.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[29377]: cluster 2021-03-10T13:53:01.587634+0000 mon.a (mon.0) 424 : cluster [DBG] osd.5 reported immediately failed by osd.2 2021-03-10T13:53:02.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[29377]: cluster 2021-03-10T13:53:01.731599+0000 mon.a (mon.0) 425 : cluster [DBG] osd.5 reported immediately failed by osd.6 2021-03-10T13:53:02.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[29377]: cluster 2021-03-10T13:53:01.731903+0000 mon.a (mon.0) 426 : cluster [DBG] osd.5 reported immediately failed by osd.1 2021-03-10T13:53:02.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[29377]: cluster 2021-03-10T13:53:01.734652+0000 mon.a (mon.0) 427 : cluster [DBG] osd.5 reported immediately failed by osd.7 2021-03-10T13:53:02.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[29377]: cluster 2021-03-10T13:53:01.982703+0000 mon.a (mon.0) 428 : cluster [DBG] osd.5 reported immediately failed by osd.7 2021-03-10T13:53:02.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[30343]: cluster 2021-03-10T13:53:01.065527+0000 mgr.gibba045.orlgmj (mgr.34412) 250 : cluster [DBG] pgmap v123: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T13:53:02.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[30343]: cluster 2021-03-10T13:53:01.531721+0000 mon.a (mon.0) 405 : cluster [DBG] osd.5 reported immediately failed by osd.7 2021-03-10T13:53:02.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[30343]: cluster 2021-03-10T13:53:01.531887+0000 mon.a (mon.0) 406 : cluster [INF] osd.5 failed (root=default,host=gibba045) (connection refused reported by osd.7) 2021-03-10T13:53:02.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[30343]: cluster 2021-03-10T13:53:01.532847+0000 mon.a (mon.0) 407 : cluster [DBG] osd.5 reported immediately failed by osd.6 2021-03-10T13:53:02.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[30343]: cluster 2021-03-10T13:53:01.533635+0000 mon.a (mon.0) 408 : cluster [DBG] osd.5 reported immediately failed by osd.1 2021-03-10T13:53:02.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[30343]: cluster 2021-03-10T13:53:01.534406+0000 mon.a (mon.0) 409 : cluster [DBG] osd.5 reported immediately failed by osd.2 2021-03-10T13:53:02.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[30343]: cluster 2021-03-10T13:53:01.535060+0000 mon.a (mon.0) 410 : cluster [DBG] osd.5 reported immediately failed by osd.0 2021-03-10T13:53:02.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[30343]: cluster 2021-03-10T13:53:01.582363+0000 mon.a (mon.0) 411 : cluster [DBG] osd.5 reported immediately failed by osd.7 2021-03-10T13:53:02.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[30343]: cluster 2021-03-10T13:53:01.582755+0000 mon.a (mon.0) 412 : cluster [DBG] osd.5 reported immediately failed by osd.7 2021-03-10T13:53:02.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[30343]: cluster 2021-03-10T13:53:01.583378+0000 mon.a (mon.0) 413 : cluster [DBG] osd.5 reported immediately failed by osd.6 2021-03-10T13:53:02.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[30343]: cluster 2021-03-10T13:53:01.583906+0000 mon.a (mon.0) 414 : cluster [DBG] osd.5 reported immediately failed by osd.6 2021-03-10T13:53:02.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[30343]: cluster 2021-03-10T13:53:01.584429+0000 mon.a (mon.0) 415 : cluster [DBG] osd.5 reported immediately failed by osd.0 2021-03-10T13:53:02.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[30343]: cluster 2021-03-10T13:53:01.584712+0000 mon.a (mon.0) 416 : cluster [DBG] osd.5 reported immediately failed by osd.4 2021-03-10T13:53:02.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[30343]: cluster 2021-03-10T13:53:01.585350+0000 mon.a (mon.0) 417 : cluster [DBG] osd.5 reported immediately failed by osd.1 2021-03-10T13:53:02.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[30343]: cluster 2021-03-10T13:53:01.585630+0000 mon.a (mon.0) 418 : cluster [DBG] osd.5 reported immediately failed by osd.4 2021-03-10T13:53:02.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[30343]: cluster 2021-03-10T13:53:01.586158+0000 mon.a (mon.0) 419 : cluster [DBG] osd.5 reported immediately failed by osd.3 2021-03-10T13:53:02.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[30343]: cluster 2021-03-10T13:53:01.586432+0000 mon.a (mon.0) 420 : cluster [DBG] osd.5 reported immediately failed by osd.0 2021-03-10T13:53:02.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[30343]: cluster 2021-03-10T13:53:01.586923+0000 mon.a (mon.0) 421 : cluster [DBG] osd.5 reported immediately failed by osd.3 2021-03-10T13:53:02.733 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[30343]: cluster 2021-03-10T13:53:01.587193+0000 mon.a (mon.0) 422 : cluster [DBG] osd.5 reported immediately failed by osd.1 2021-03-10T13:53:02.733 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[30343]: cluster 2021-03-10T13:53:01.587587+0000 mon.a (mon.0) 423 : cluster [DBG] osd.5 reported immediately failed by osd.2 2021-03-10T13:53:02.733 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[30343]: cluster 2021-03-10T13:53:01.587634+0000 mon.a (mon.0) 424 : cluster [DBG] osd.5 reported immediately failed by osd.2 2021-03-10T13:53:02.733 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[30343]: cluster 2021-03-10T13:53:01.731599+0000 mon.a (mon.0) 425 : cluster [DBG] osd.5 reported immediately failed by osd.6 2021-03-10T13:53:02.733 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[30343]: cluster 2021-03-10T13:53:01.731903+0000 mon.a (mon.0) 426 : cluster [DBG] osd.5 reported immediately failed by osd.1 2021-03-10T13:53:02.733 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[30343]: cluster 2021-03-10T13:53:01.734652+0000 mon.a (mon.0) 427 : cluster [DBG] osd.5 reported immediately failed by osd.7 2021-03-10T13:53:02.734 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[30343]: cluster 2021-03-10T13:53:01.982703+0000 mon.a (mon.0) 428 : cluster [DBG] osd.5 reported immediately failed by osd.7 2021-03-10T13:53:02.734 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[29377]: cluster 2021-03-10T13:53:01.983202+0000 mon.a (mon.0) 429 : cluster [DBG] osd.5 reported immediately failed by osd.7 2021-03-10T13:53:02.734 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[29377]: cluster 2021-03-10T13:53:01.983848+0000 mon.a (mon.0) 430 : cluster [DBG] osd.5 reported immediately failed by osd.6 2021-03-10T13:53:02.734 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[29377]: cluster 2021-03-10T13:53:01.984303+0000 mon.a (mon.0) 431 : cluster [DBG] osd.5 reported immediately failed by osd.4 2021-03-10T13:53:02.735 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[29377]: cluster 2021-03-10T13:53:01.984747+0000 mon.a (mon.0) 432 : cluster [DBG] osd.5 reported immediately failed by osd.6 2021-03-10T13:53:02.735 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[29377]: cluster 2021-03-10T13:53:01.985216+0000 mon.a (mon.0) 433 : cluster [DBG] osd.5 reported immediately failed by osd.4 2021-03-10T13:53:02.735 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[29377]: cluster 2021-03-10T13:53:01.985759+0000 mon.a (mon.0) 434 : cluster [DBG] osd.5 reported immediately failed by osd.0 2021-03-10T13:53:02.735 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[29377]: cluster 2021-03-10T13:53:01.985974+0000 mon.a (mon.0) 435 : cluster [DBG] osd.5 reported immediately failed by osd.1 2021-03-10T13:53:02.735 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[29377]: cluster 2021-03-10T13:53:01.986051+0000 mon.a (mon.0) 436 : cluster [DBG] osd.5 reported immediately failed by osd.3 2021-03-10T13:53:02.736 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[29377]: cluster 2021-03-10T13:53:01.986128+0000 mon.a (mon.0) 437 : cluster [DBG] osd.5 reported immediately failed by osd.0 2021-03-10T13:53:02.736 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[29377]: cluster 2021-03-10T13:53:01.986198+0000 mon.a (mon.0) 438 : cluster [DBG] osd.5 reported immediately failed by osd.1 2021-03-10T13:53:02.736 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[29377]: cluster 2021-03-10T13:53:01.986270+0000 mon.a (mon.0) 439 : cluster [DBG] osd.5 reported immediately failed by osd.3 2021-03-10T13:53:02.736 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[29377]: cluster 2021-03-10T13:53:01.986345+0000 mon.a (mon.0) 440 : cluster [DBG] osd.5 reported immediately failed by osd.2 2021-03-10T13:53:02.736 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[29377]: cluster 2021-03-10T13:53:01.986451+0000 mon.a (mon.0) 441 : cluster [DBG] osd.5 reported immediately failed by osd.2 2021-03-10T13:53:02.737 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[29377]: cluster 2021-03-10T13:53:02.131269+0000 mon.a (mon.0) 442 : cluster [DBG] osd.5 reported immediately failed by osd.6 2021-03-10T13:53:02.737 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[29377]: cluster 2021-03-10T13:53:02.131855+0000 mon.a (mon.0) 443 : cluster [DBG] osd.5 reported immediately failed by osd.1 2021-03-10T13:53:02.737 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[29377]: cluster 2021-03-10T13:53:02.133634+0000 mon.a (mon.0) 444 : cluster [DBG] osd.5 reported immediately failed by osd.7 2021-03-10T13:53:02.737 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[30343]: cluster 2021-03-10T13:53:01.983202+0000 mon.a (mon.0) 429 : cluster [DBG] osd.5 reported immediately failed by osd.7 2021-03-10T13:53:02.738 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[30343]: cluster 2021-03-10T13:53:01.983848+0000 mon.a (mon.0) 430 : cluster [DBG] osd.5 reported immediately failed by osd.6 2021-03-10T13:53:02.738 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[30343]: cluster 2021-03-10T13:53:01.984303+0000 mon.a (mon.0) 431 : cluster [DBG] osd.5 reported immediately failed by osd.4 2021-03-10T13:53:02.738 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[30343]: cluster 2021-03-10T13:53:01.984747+0000 mon.a (mon.0) 432 : cluster [DBG] osd.5 reported immediately failed by osd.6 2021-03-10T13:53:02.738 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[30343]: cluster 2021-03-10T13:53:01.985216+0000 mon.a (mon.0) 433 : cluster [DBG] osd.5 reported immediately failed by osd.4 2021-03-10T13:53:02.739 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[30343]: cluster 2021-03-10T13:53:01.985759+0000 mon.a (mon.0) 434 : cluster [DBG] osd.5 reported immediately failed by osd.0 2021-03-10T13:53:02.739 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[30343]: cluster 2021-03-10T13:53:01.985974+0000 mon.a (mon.0) 435 : cluster [DBG] osd.5 reported immediately failed by osd.1 2021-03-10T13:53:02.739 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[30343]: cluster 2021-03-10T13:53:01.986051+0000 mon.a (mon.0) 436 : cluster [DBG] osd.5 reported immediately failed by osd.3 2021-03-10T13:53:02.739 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[30343]: cluster 2021-03-10T13:53:01.986128+0000 mon.a (mon.0) 437 : cluster [DBG] osd.5 reported immediately failed by osd.0 2021-03-10T13:53:02.739 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[30343]: cluster 2021-03-10T13:53:01.986198+0000 mon.a (mon.0) 438 : cluster [DBG] osd.5 reported immediately failed by osd.1 2021-03-10T13:53:02.739 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[30343]: cluster 2021-03-10T13:53:01.986270+0000 mon.a (mon.0) 439 : cluster [DBG] osd.5 reported immediately failed by osd.3 2021-03-10T13:53:02.740 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[30343]: cluster 2021-03-10T13:53:01.986345+0000 mon.a (mon.0) 440 : cluster [DBG] osd.5 reported immediately failed by osd.2 2021-03-10T13:53:02.740 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[30343]: cluster 2021-03-10T13:53:01.986451+0000 mon.a (mon.0) 441 : cluster [DBG] osd.5 reported immediately failed by osd.2 2021-03-10T13:53:02.740 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[30343]: cluster 2021-03-10T13:53:02.131269+0000 mon.a (mon.0) 442 : cluster [DBG] osd.5 reported immediately failed by osd.6 2021-03-10T13:53:02.740 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[30343]: cluster 2021-03-10T13:53:02.131855+0000 mon.a (mon.0) 443 : cluster [DBG] osd.5 reported immediately failed by osd.1 2021-03-10T13:53:02.740 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:02 gibba015 bash[30343]: cluster 2021-03-10T13:53:02.133634+0000 mon.a (mon.0) 444 : cluster [DBG] osd.5 reported immediately failed by osd.7 2021-03-10T13:53:02.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:02 gibba045 bash[25517]: cluster 2021-03-10T13:53:01.065527+0000 mgr.gibba045.orlgmj (mgr.34412) 250 : cluster [DBG] pgmap v123: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T13:53:02.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:02 gibba045 bash[25517]: cluster 2021-03-10T13:53:01.531721+0000 mon.a (mon.0) 405 : cluster [DBG] osd.5 reported immediately failed by osd.7 2021-03-10T13:53:02.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:02 gibba045 bash[25517]: cluster 2021-03-10T13:53:01.531887+0000 mon.a (mon.0) 406 : cluster [INF] osd.5 failed (root=default,host=gibba045) (connection refused reported by osd.7) 2021-03-10T13:53:02.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:02 gibba045 bash[25517]: cluster 2021-03-10T13:53:01.532847+0000 mon.a (mon.0) 407 : cluster [DBG] osd.5 reported immediately failed by osd.6 2021-03-10T13:53:02.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:02 gibba045 bash[25517]: cluster 2021-03-10T13:53:01.533635+0000 mon.a (mon.0) 408 : cluster [DBG] osd.5 reported immediately failed by osd.1 2021-03-10T13:53:02.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:02 gibba045 bash[25517]: cluster 2021-03-10T13:53:01.534406+0000 mon.a (mon.0) 409 : cluster [DBG] osd.5 reported immediately failed by osd.2 2021-03-10T13:53:02.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:02 gibba045 bash[25517]: cluster 2021-03-10T13:53:01.535060+0000 mon.a (mon.0) 410 : cluster [DBG] osd.5 reported immediately failed by osd.0 2021-03-10T13:53:02.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:02 gibba045 bash[25517]: cluster 2021-03-10T13:53:01.582363+0000 mon.a (mon.0) 411 : cluster [DBG] osd.5 reported immediately failed by osd.7 2021-03-10T13:53:02.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:02 gibba045 bash[25517]: cluster 2021-03-10T13:53:01.582755+0000 mon.a (mon.0) 412 : cluster [DBG] osd.5 reported immediately failed by osd.7 2021-03-10T13:53:02.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:02 gibba045 bash[25517]: cluster 2021-03-10T13:53:01.583378+0000 mon.a (mon.0) 413 : cluster [DBG] osd.5 reported immediately failed by osd.6 2021-03-10T13:53:02.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:02 gibba045 bash[25517]: cluster 2021-03-10T13:53:01.583906+0000 mon.a (mon.0) 414 : cluster [DBG] osd.5 reported immediately failed by osd.6 2021-03-10T13:53:02.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:02 gibba045 bash[25517]: cluster 2021-03-10T13:53:01.584429+0000 mon.a (mon.0) 415 : cluster [DBG] osd.5 reported immediately failed by osd.0 2021-03-10T13:53:02.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:02 gibba045 bash[25517]: cluster 2021-03-10T13:53:01.584712+0000 mon.a (mon.0) 416 : cluster [DBG] osd.5 reported immediately failed by osd.4 2021-03-10T13:53:02.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:02 gibba045 bash[25517]: cluster 2021-03-10T13:53:01.585350+0000 mon.a (mon.0) 417 : cluster [DBG] osd.5 reported immediately failed by osd.1 2021-03-10T13:53:02.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:02 gibba045 bash[25517]: cluster 2021-03-10T13:53:01.585630+0000 mon.a (mon.0) 418 : cluster [DBG] osd.5 reported immediately failed by osd.4 2021-03-10T13:53:02.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:02 gibba045 bash[25517]: cluster 2021-03-10T13:53:01.586158+0000 mon.a (mon.0) 419 : cluster [DBG] osd.5 reported immediately failed by osd.3 2021-03-10T13:53:02.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:02 gibba045 bash[25517]: cluster 2021-03-10T13:53:01.586432+0000 mon.a (mon.0) 420 : cluster [DBG] osd.5 reported immediately failed by osd.0 2021-03-10T13:53:02.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:02 gibba045 bash[25517]: cluster 2021-03-10T13:53:01.586923+0000 mon.a (mon.0) 421 : cluster [DBG] osd.5 reported immediately failed by osd.3 2021-03-10T13:53:02.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:02 gibba045 bash[25517]: cluster 2021-03-10T13:53:01.587193+0000 mon.a (mon.0) 422 : cluster [DBG] osd.5 reported immediately failed by osd.1 2021-03-10T13:53:02.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:02 gibba045 bash[25517]: cluster 2021-03-10T13:53:01.587587+0000 mon.a (mon.0) 423 : cluster [DBG] osd.5 reported immediately failed by osd.2 2021-03-10T13:53:02.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:02 gibba045 bash[25517]: cluster 2021-03-10T13:53:01.587634+0000 mon.a (mon.0) 424 : cluster [DBG] osd.5 reported immediately failed by osd.2 2021-03-10T13:53:02.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:02 gibba045 bash[25517]: cluster 2021-03-10T13:53:01.731599+0000 mon.a (mon.0) 425 : cluster [DBG] osd.5 reported immediately failed by osd.6 2021-03-10T13:53:02.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:02 gibba045 bash[25517]: cluster 2021-03-10T13:53:01.731903+0000 mon.a (mon.0) 426 : cluster [DBG] osd.5 reported immediately failed by osd.1 2021-03-10T13:53:02.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:02 gibba045 bash[25517]: cluster 2021-03-10T13:53:01.734652+0000 mon.a (mon.0) 427 : cluster [DBG] osd.5 reported immediately failed by osd.7 2021-03-10T13:53:02.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:02 gibba045 bash[25517]: cluster 2021-03-10T13:53:01.982703+0000 mon.a (mon.0) 428 : cluster [DBG] osd.5 reported immediately failed by osd.7 2021-03-10T13:53:02.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:02 gibba045 bash[25517]: cluster 2021-03-10T13:53:01.983202+0000 mon.a (mon.0) 429 : cluster [DBG] osd.5 reported immediately failed by osd.7 2021-03-10T13:53:02.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:02 gibba045 bash[25517]: cluster 2021-03-10T13:53:01.983848+0000 mon.a (mon.0) 430 : cluster [DBG] osd.5 reported immediately failed by osd.6 2021-03-10T13:53:02.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:02 gibba045 bash[25517]: cluster 2021-03-10T13:53:01.984303+0000 mon.a (mon.0) 431 : cluster [DBG] osd.5 reported immediately failed by osd.4 2021-03-10T13:53:02.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:02 gibba045 bash[25517]: cluster 2021-03-10T13:53:01.984747+0000 mon.a (mon.0) 432 : cluster [DBG] osd.5 reported immediately failed by osd.6 2021-03-10T13:53:02.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:02 gibba045 bash[25517]: cluster 2021-03-10T13:53:01.985216+0000 mon.a (mon.0) 433 : cluster [DBG] osd.5 reported immediately failed by osd.4 2021-03-10T13:53:02.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:02 gibba045 bash[25517]: cluster 2021-03-10T13:53:01.985759+0000 mon.a (mon.0) 434 : cluster [DBG] osd.5 reported immediately failed by osd.0 2021-03-10T13:53:02.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:02 gibba045 bash[25517]: cluster 2021-03-10T13:53:01.985974+0000 mon.a (mon.0) 435 : cluster [DBG] osd.5 reported immediately failed by osd.1 2021-03-10T13:53:02.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:02 gibba045 bash[25517]: cluster 2021-03-10T13:53:01.986051+0000 mon.a (mon.0) 436 : cluster [DBG] osd.5 reported immediately failed by osd.3 2021-03-10T13:53:02.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:02 gibba045 bash[25517]: cluster 2021-03-10T13:53:01.986128+0000 mon.a (mon.0) 437 : cluster [DBG] osd.5 reported immediately failed by osd.0 2021-03-10T13:53:02.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:02 gibba045 bash[25517]: cluster 2021-03-10T13:53:01.986198+0000 mon.a (mon.0) 438 : cluster [DBG] osd.5 reported immediately failed by osd.1 2021-03-10T13:53:02.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:02 gibba045 bash[25517]: cluster 2021-03-10T13:53:01.986270+0000 mon.a (mon.0) 439 : cluster [DBG] osd.5 reported immediately failed by osd.3 2021-03-10T13:53:02.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:02 gibba045 bash[25517]: cluster 2021-03-10T13:53:01.986345+0000 mon.a (mon.0) 440 : cluster [DBG] osd.5 reported immediately failed by osd.2 2021-03-10T13:53:02.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:02 gibba045 bash[25517]: cluster 2021-03-10T13:53:01.986451+0000 mon.a (mon.0) 441 : cluster [DBG] osd.5 reported immediately failed by osd.2 2021-03-10T13:53:02.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:02 gibba045 bash[25517]: cluster 2021-03-10T13:53:02.131269+0000 mon.a (mon.0) 442 : cluster [DBG] osd.5 reported immediately failed by osd.6 2021-03-10T13:53:02.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:02 gibba045 bash[25517]: cluster 2021-03-10T13:53:02.131855+0000 mon.a (mon.0) 443 : cluster [DBG] osd.5 reported immediately failed by osd.1 2021-03-10T13:53:02.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:02 gibba045 bash[25517]: cluster 2021-03-10T13:53:02.133634+0000 mon.a (mon.0) 444 : cluster [DBG] osd.5 reported immediately failed by osd.7 2021-03-10T13:53:03.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:03 gibba045 bash[25517]: cluster 2021-03-10T13:53:02.388423+0000 mon.a (mon.0) 445 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T13:53:03.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:03 gibba045 bash[25517]: cluster 2021-03-10T13:53:02.398728+0000 mon.a (mon.0) 446 : cluster [DBG] osdmap e88: 8 total, 7 up, 8 in 2021-03-10T13:53:03.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:03 gibba015 bash[29377]: cluster 2021-03-10T13:53:02.388423+0000 mon.a (mon.0) 445 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T13:53:03.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:03 gibba015 bash[29377]: cluster 2021-03-10T13:53:02.398728+0000 mon.a (mon.0) 446 : cluster [DBG] osdmap e88: 8 total, 7 up, 8 in 2021-03-10T13:53:03.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:03 gibba015 bash[30343]: cluster 2021-03-10T13:53:02.388423+0000 mon.a (mon.0) 445 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T13:53:03.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:03 gibba015 bash[30343]: cluster 2021-03-10T13:53:02.398728+0000 mon.a (mon.0) 446 : cluster [DBG] osdmap e88: 8 total, 7 up, 8 in 2021-03-10T13:53:03.966 INFO:journalctl@ceph.osd.5.gibba045.stdout:Mar 10 13:53:03 gibba045 systemd[1]: ceph-e4a642d2-81a5-11eb-9080-001a4aab830c@osd.5.service: Succeeded. 2021-03-10T13:53:03.966 INFO:journalctl@ceph.osd.5.gibba045.stdout:Mar 10 13:53:03 gibba045 systemd[1]: Stopped Ceph osd.5 for e4a642d2-81a5-11eb-9080-001a4aab830c. 2021-03-10T13:53:03.966 INFO:journalctl@ceph.osd.5.gibba045.stdout:Mar 10 13:53:03 gibba045 systemd[1]: Started Ceph osd.5 for e4a642d2-81a5-11eb-9080-001a4aab830c. 2021-03-10T13:53:04.712 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:04 gibba045 bash[25517]: cluster 2021-03-10T13:53:03.065940+0000 mgr.gibba045.orlgmj (mgr.34412) 251 : cluster [DBG] pgmap v125: 129 pgs: 17 stale+active+clean, 18 active+clean+wait, 94 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T13:53:04.712 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:04 gibba045 bash[25517]: cluster 2021-03-10T13:53:03.403254+0000 mon.a (mon.0) 447 : cluster [DBG] osdmap e89: 8 total, 7 up, 8 in 2021-03-10T13:53:04.712 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:04 gibba045 bash[25517]: audit 2021-03-10T13:53:03.947960+0000 mon.a (mon.0) 448 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:53:04.713 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:04 gibba045 bash[25517]: audit 2021-03-10T13:53:03.949179+0000 mon.c (mon.1) 123 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:53:04.713 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:04 gibba045 bash[25517]: audit 2021-03-10T13:53:03.951081+0000 mon.c (mon.1) 124 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:53:04.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:04 gibba015 bash[29377]: cluster 2021-03-10T13:53:03.065940+0000 mgr.gibba045.orlgmj (mgr.34412) 251 : cluster [DBG] pgmap v125: 129 pgs: 17 stale+active+clean, 18 active+clean+wait, 94 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T13:53:04.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:04 gibba015 bash[29377]: cluster 2021-03-10T13:53:03.403254+0000 mon.a (mon.0) 447 : cluster [DBG] osdmap e89: 8 total, 7 up, 8 in 2021-03-10T13:53:04.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:04 gibba015 bash[29377]: audit 2021-03-10T13:53:03.947960+0000 mon.a (mon.0) 448 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:53:04.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:04 gibba015 bash[29377]: audit 2021-03-10T13:53:03.949179+0000 mon.c (mon.1) 123 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:53:04.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:04 gibba015 bash[29377]: audit 2021-03-10T13:53:03.951081+0000 mon.c (mon.1) 124 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:53:04.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:04 gibba015 bash[30343]: cluster 2021-03-10T13:53:03.065940+0000 mgr.gibba045.orlgmj (mgr.34412) 251 : cluster [DBG] pgmap v125: 129 pgs: 17 stale+active+clean, 18 active+clean+wait, 94 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T13:53:04.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:04 gibba015 bash[30343]: cluster 2021-03-10T13:53:03.403254+0000 mon.a (mon.0) 447 : cluster [DBG] osdmap e89: 8 total, 7 up, 8 in 2021-03-10T13:53:04.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:04 gibba015 bash[30343]: audit 2021-03-10T13:53:03.947960+0000 mon.a (mon.0) 448 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:53:04.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:04 gibba015 bash[30343]: audit 2021-03-10T13:53:03.949179+0000 mon.c (mon.1) 123 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:53:04.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:04 gibba015 bash[30343]: audit 2021-03-10T13:53:03.951081+0000 mon.c (mon.1) 124 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:53:05.307 INFO:journalctl@ceph.osd.5.gibba045.stdout:Mar 10 13:53:05 gibba045 bash[28427]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2021-03-10T13:53:05.307 INFO:journalctl@ceph.osd.5.gibba045.stdout:Mar 10 13:53:05 gibba045 bash[28427]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-5 --no-mon-config 2021-03-10T13:53:05.307 INFO:journalctl@ceph.osd.5.gibba045.stdout:Mar 10 13:53:05 gibba045 bash[28427]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-5/block 2021-03-10T13:53:05.308 INFO:journalctl@ceph.osd.5.gibba045.stdout:Mar 10 13:53:05 gibba045 bash[28427]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-5/block 2021-03-10T13:53:05.308 INFO:journalctl@ceph.osd.5.gibba045.stdout:Mar 10 13:53:05 gibba045 bash[28427]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2021-03-10T13:53:05.308 INFO:journalctl@ceph.osd.5.gibba045.stdout:Mar 10 13:53:05 gibba045 bash[28427]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2021-03-10T13:53:05.308 INFO:journalctl@ceph.osd.5.gibba045.stdout:Mar 10 13:53:05 gibba045 bash[28427]: --> ceph-volume lvm activate successful for osd ID: 5 2021-03-10T13:53:05.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:05 gibba015 bash[29377]: cluster 2021-03-10T13:53:05.412732+0000 mon.a (mon.0) 449 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 4 pgs peering (PG_AVAILABILITY) 2021-03-10T13:53:05.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:05 gibba015 bash[29377]: cluster 2021-03-10T13:53:05.412823+0000 mon.a (mon.0) 450 : cluster [WRN] Health check failed: Degraded data redundancy: 8/192 objects degraded (4.167%), 6 pgs degraded (PG_DEGRADED) 2021-03-10T13:53:05.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:05 gibba015 bash[30343]: cluster 2021-03-10T13:53:05.412732+0000 mon.a (mon.0) 449 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 4 pgs peering (PG_AVAILABILITY) 2021-03-10T13:53:05.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:05 gibba015 bash[30343]: cluster 2021-03-10T13:53:05.412823+0000 mon.a (mon.0) 450 : cluster [WRN] Health check failed: Degraded data redundancy: 8/192 objects degraded (4.167%), 6 pgs degraded (PG_DEGRADED) 2021-03-10T13:53:05.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:05 gibba045 bash[25517]: cluster 2021-03-10T13:53:05.412732+0000 mon.a (mon.0) 449 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 4 pgs peering (PG_AVAILABILITY) 2021-03-10T13:53:05.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:05 gibba045 bash[25517]: cluster 2021-03-10T13:53:05.412823+0000 mon.a (mon.0) 450 : cluster [WRN] Health check failed: Degraded data redundancy: 8/192 objects degraded (4.167%), 6 pgs degraded (PG_DEGRADED) 2021-03-10T13:53:06.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:06 gibba045 bash[25517]: cluster 2021-03-10T13:53:05.066357+0000 mgr.gibba045.orlgmj (mgr.34412) 252 : cluster [DBG] pgmap v127: 129 pgs: 9 stale+active+clean, 6 active+undersized+degraded, 13 peering, 18 active+clean+wait, 8 active+undersized, 75 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail; 8/192 objects degraded (4.167%) 2021-03-10T13:53:06.807 INFO:journalctl@ceph.osd.5.gibba045.stdout:Mar 10 13:53:06 gibba045 bash[28558]: debug 2021-03-10T13:53:06.507+0000 7f1e36d46700 1 -- 172.21.2.145:0/1299270875 <== mon.2 v2:172.21.2.145:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55ec12cf64e0 con 0x55ec12d72c00 2021-03-10T13:53:06.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:06 gibba015 bash[29377]: cluster 2021-03-10T13:53:05.066357+0000 mgr.gibba045.orlgmj (mgr.34412) 252 : cluster [DBG] pgmap v127: 129 pgs: 9 stale+active+clean, 6 active+undersized+degraded, 13 peering, 18 active+clean+wait, 8 active+undersized, 75 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail; 8/192 objects degraded (4.167%) 2021-03-10T13:53:06.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:06 gibba015 bash[30343]: cluster 2021-03-10T13:53:05.066357+0000 mgr.gibba045.orlgmj (mgr.34412) 252 : cluster [DBG] pgmap v127: 129 pgs: 9 stale+active+clean, 6 active+undersized+degraded, 13 peering, 18 active+clean+wait, 8 active+undersized, 75 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail; 8/192 objects degraded (4.167%) 2021-03-10T13:53:07.557 INFO:journalctl@ceph.osd.5.gibba045.stdout:Mar 10 13:53:07 gibba045 bash[28558]: debug 2021-03-10T13:53:07.051+0000 7f1e3e7db080 -1 Falling back to public interface 2021-03-10T13:53:08.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:08 gibba045 bash[25517]: cluster 2021-03-10T13:53:07.066818+0000 mgr.gibba045.orlgmj (mgr.34412) 253 : cluster [DBG] pgmap v128: 129 pgs: 9 active+undersized+degraded, 13 peering, 22 active+undersized, 85 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail; 13/192 objects degraded (6.771%) 2021-03-10T13:53:08.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:08 gibba015 bash[29377]: cluster 2021-03-10T13:53:07.066818+0000 mgr.gibba045.orlgmj (mgr.34412) 253 : cluster [DBG] pgmap v128: 129 pgs: 9 active+undersized+degraded, 13 peering, 22 active+undersized, 85 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail; 13/192 objects degraded (6.771%) 2021-03-10T13:53:08.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:08 gibba015 bash[30343]: cluster 2021-03-10T13:53:07.066818+0000 mgr.gibba045.orlgmj (mgr.34412) 253 : cluster [DBG] pgmap v128: 129 pgs: 9 active+undersized+degraded, 13 peering, 22 active+undersized, 85 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail; 13/192 objects degraded (6.771%) 2021-03-10T13:53:10.557 INFO:journalctl@ceph.osd.5.gibba045.stdout:Mar 10 13:53:10 gibba045 bash[28558]: debug 2021-03-10T13:53:10.323+0000 7f1e3e7db080 -1 bluestore(/var/lib/ceph/osd/ceph-5) fsck warning: store not yet converted to per-pg omap 2021-03-10T13:53:10.557 INFO:journalctl@ceph.osd.5.gibba045.stdout:Mar 10 13:53:10 gibba045 bash[28558]: debug 2021-03-10T13:53:10.323+0000 7f1e2b2a3700 -1 bluestore(/var/lib/ceph/osd/ceph-5) fsck warning: #-1:c1a3fc6e:::purged_snaps:0# has omap that is not per-pg or pgmeta 2021-03-10T13:53:10.557 INFO:journalctl@ceph.osd.5.gibba045.stdout:Mar 10 13:53:10 gibba045 bash[28558]: debug 2021-03-10T13:53:10.447+0000 7f1e3e7db080 -1 osd.5 87 log_to_monitors {default=true} 2021-03-10T13:53:10.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:10 gibba045 bash[25517]: cluster 2021-03-10T13:53:09.067458+0000 mgr.gibba045.orlgmj (mgr.34412) 254 : cluster [DBG] pgmap v129: 129 pgs: 16 active+undersized+degraded, 28 active+undersized, 85 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail; 21/192 objects degraded (10.938%) 2021-03-10T13:53:10.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:10 gibba045 bash[25517]: audit 2021-03-10T13:53:09.283027+0000 mon.a (mon.0) 451 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:53:10.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:10 gibba045 bash[25517]: audit 2021-03-10T13:53:09.288029+0000 mon.a (mon.0) 452 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:53:10.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:10 gibba045 bash[25517]: audit 2021-03-10T13:53:09.292027+0000 mon.c (mon.1) 125 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:53:10.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:10 gibba045 bash[25517]: cephadm 2021-03-10T13:53:09.293076+0000 mgr.gibba045.orlgmj (mgr.34412) 255 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:53:10.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:10 gibba045 bash[25517]: audit 2021-03-10T13:53:09.293597+0000 mon.c (mon.1) 126 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:53:10.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:10 gibba045 bash[25517]: cephadm 2021-03-10T13:53:09.294833+0000 mgr.gibba045.orlgmj (mgr.34412) 256 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:53:10.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:10 gibba045 bash[25517]: audit 2021-03-10T13:53:09.295061+0000 mon.c (mon.1) 127 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:53:10.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:10 gibba045 bash[25517]: cephadm 2021-03-10T13:53:09.296223+0000 mgr.gibba045.orlgmj (mgr.34412) 257 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:53:10.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:10 gibba045 bash[25517]: cephadm 2021-03-10T13:53:09.296269+0000 mgr.gibba045.orlgmj (mgr.34412) 258 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:53:10.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:10 gibba045 bash[25517]: audit 2021-03-10T13:53:09.296579+0000 mon.c (mon.1) 128 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:53:10.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:10 gibba045 bash[25517]: cephadm 2021-03-10T13:53:09.297870+0000 mgr.gibba045.orlgmj (mgr.34412) 259 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:53:10.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:10 gibba045 bash[25517]: cephadm 2021-03-10T13:53:09.297920+0000 mgr.gibba045.orlgmj (mgr.34412) 260 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:53:10.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:10 gibba045 bash[25517]: cephadm 2021-03-10T13:53:09.299117+0000 mgr.gibba045.orlgmj (mgr.34412) 261 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:53:10.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:10 gibba045 bash[25517]: audit 2021-03-10T13:53:09.300029+0000 mon.c (mon.1) 129 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2021-03-10T13:53:10.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:10 gibba045 bash[25517]: cephadm 2021-03-10T13:53:09.301103+0000 mgr.gibba045.orlgmj (mgr.34412) 262 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:53:10.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:10 gibba045 bash[25517]: cephadm 2021-03-10T13:53:09.301152+0000 mgr.gibba045.orlgmj (mgr.34412) 263 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:53:10.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:10 gibba045 bash[25517]: audit 2021-03-10T13:53:09.301954+0000 mgr.gibba045.orlgmj (mgr.34412) 264 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2021-03-10T13:53:10.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:10 gibba045 bash[25517]: cephadm 2021-03-10T13:53:09.303342+0000 mgr.gibba045.orlgmj (mgr.34412) 265 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2021-03-10T13:53:10.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:10 gibba045 bash[25517]: cluster 2021-03-10T13:53:09.479090+0000 mon.a (mon.0) 453 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 4 pgs peering) 2021-03-10T13:53:10.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:10 gibba015 bash[29377]: cluster 2021-03-10T13:53:09.067458+0000 mgr.gibba045.orlgmj (mgr.34412) 254 : cluster [DBG] pgmap v129: 129 pgs: 16 active+undersized+degraded, 28 active+undersized, 85 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail; 21/192 objects degraded (10.938%) 2021-03-10T13:53:10.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:10 gibba015 bash[29377]: audit 2021-03-10T13:53:09.283027+0000 mon.a (mon.0) 451 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:53:10.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:10 gibba015 bash[29377]: audit 2021-03-10T13:53:09.288029+0000 mon.a (mon.0) 452 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:53:10.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:10 gibba015 bash[29377]: audit 2021-03-10T13:53:09.292027+0000 mon.c (mon.1) 125 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:53:10.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:10 gibba015 bash[29377]: cephadm 2021-03-10T13:53:09.293076+0000 mgr.gibba045.orlgmj (mgr.34412) 255 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:53:10.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:10 gibba015 bash[29377]: audit 2021-03-10T13:53:09.293597+0000 mon.c (mon.1) 126 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:53:10.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:10 gibba015 bash[29377]: cephadm 2021-03-10T13:53:09.294833+0000 mgr.gibba045.orlgmj (mgr.34412) 256 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:53:10.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:10 gibba015 bash[29377]: audit 2021-03-10T13:53:09.295061+0000 mon.c (mon.1) 127 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:53:10.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:10 gibba015 bash[29377]: cephadm 2021-03-10T13:53:09.296223+0000 mgr.gibba045.orlgmj (mgr.34412) 257 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:53:10.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:10 gibba015 bash[29377]: cephadm 2021-03-10T13:53:09.296269+0000 mgr.gibba045.orlgmj (mgr.34412) 258 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:53:10.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:10 gibba015 bash[29377]: audit 2021-03-10T13:53:09.296579+0000 mon.c (mon.1) 128 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:53:10.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:10 gibba015 bash[29377]: cephadm 2021-03-10T13:53:09.297870+0000 mgr.gibba045.orlgmj (mgr.34412) 259 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:53:10.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:10 gibba015 bash[29377]: cephadm 2021-03-10T13:53:09.297920+0000 mgr.gibba045.orlgmj (mgr.34412) 260 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:53:10.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:10 gibba015 bash[29377]: cephadm 2021-03-10T13:53:09.299117+0000 mgr.gibba045.orlgmj (mgr.34412) 261 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:53:10.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:10 gibba015 bash[29377]: audit 2021-03-10T13:53:09.300029+0000 mon.c (mon.1) 129 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2021-03-10T13:53:10.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:10 gibba015 bash[29377]: cephadm 2021-03-10T13:53:09.301103+0000 mgr.gibba045.orlgmj (mgr.34412) 262 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:53:10.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:10 gibba015 bash[29377]: cephadm 2021-03-10T13:53:09.301152+0000 mgr.gibba045.orlgmj (mgr.34412) 263 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:53:10.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:10 gibba015 bash[29377]: audit 2021-03-10T13:53:09.301954+0000 mgr.gibba045.orlgmj (mgr.34412) 264 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2021-03-10T13:53:10.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:10 gibba015 bash[29377]: cephadm 2021-03-10T13:53:09.303342+0000 mgr.gibba045.orlgmj (mgr.34412) 265 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2021-03-10T13:53:10.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:10 gibba015 bash[29377]: cluster 2021-03-10T13:53:09.479090+0000 mon.a (mon.0) 453 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 4 pgs peering) 2021-03-10T13:53:10.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:10 gibba015 bash[30343]: cluster 2021-03-10T13:53:09.067458+0000 mgr.gibba045.orlgmj (mgr.34412) 254 : cluster [DBG] pgmap v129: 129 pgs: 16 active+undersized+degraded, 28 active+undersized, 85 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail; 21/192 objects degraded (10.938%) 2021-03-10T13:53:10.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:10 gibba015 bash[30343]: audit 2021-03-10T13:53:09.283027+0000 mon.a (mon.0) 451 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:53:10.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:10 gibba015 bash[30343]: audit 2021-03-10T13:53:09.288029+0000 mon.a (mon.0) 452 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:53:10.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:10 gibba015 bash[30343]: audit 2021-03-10T13:53:09.292027+0000 mon.c (mon.1) 125 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:53:10.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:10 gibba015 bash[30343]: cephadm 2021-03-10T13:53:09.293076+0000 mgr.gibba045.orlgmj (mgr.34412) 255 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:53:10.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:10 gibba015 bash[30343]: audit 2021-03-10T13:53:09.293597+0000 mon.c (mon.1) 126 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:53:10.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:10 gibba015 bash[30343]: cephadm 2021-03-10T13:53:09.294833+0000 mgr.gibba045.orlgmj (mgr.34412) 256 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:53:10.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:10 gibba015 bash[30343]: audit 2021-03-10T13:53:09.295061+0000 mon.c (mon.1) 127 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:53:10.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:10 gibba015 bash[30343]: cephadm 2021-03-10T13:53:09.296223+0000 mgr.gibba045.orlgmj (mgr.34412) 257 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:53:10.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:10 gibba015 bash[30343]: cephadm 2021-03-10T13:53:09.296269+0000 mgr.gibba045.orlgmj (mgr.34412) 258 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:53:10.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:10 gibba015 bash[30343]: audit 2021-03-10T13:53:09.296579+0000 mon.c (mon.1) 128 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:53:10.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:10 gibba015 bash[30343]: cephadm 2021-03-10T13:53:09.297870+0000 mgr.gibba045.orlgmj (mgr.34412) 259 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:53:10.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:10 gibba015 bash[30343]: cephadm 2021-03-10T13:53:09.297920+0000 mgr.gibba045.orlgmj (mgr.34412) 260 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:53:10.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:10 gibba015 bash[30343]: cephadm 2021-03-10T13:53:09.299117+0000 mgr.gibba045.orlgmj (mgr.34412) 261 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:53:10.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:10 gibba015 bash[30343]: audit 2021-03-10T13:53:09.300029+0000 mon.c (mon.1) 129 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2021-03-10T13:53:10.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:10 gibba015 bash[30343]: cephadm 2021-03-10T13:53:09.301103+0000 mgr.gibba045.orlgmj (mgr.34412) 262 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:53:10.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:10 gibba015 bash[30343]: cephadm 2021-03-10T13:53:09.301152+0000 mgr.gibba045.orlgmj (mgr.34412) 263 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:53:10.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:10 gibba015 bash[30343]: audit 2021-03-10T13:53:09.301954+0000 mgr.gibba045.orlgmj (mgr.34412) 264 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2021-03-10T13:53:10.733 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:10 gibba015 bash[30343]: cephadm 2021-03-10T13:53:09.303342+0000 mgr.gibba045.orlgmj (mgr.34412) 265 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2021-03-10T13:53:10.733 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:10 gibba015 bash[30343]: cluster 2021-03-10T13:53:09.479090+0000 mon.a (mon.0) 453 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 4 pgs peering) 2021-03-10T13:53:11.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:11 gibba045 bash[25517]: audit 2021-03-10T13:53:10.452132+0000 mon.a (mon.0) 454 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-03-10T13:53:11.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:11 gibba045 bash[25517]: audit 2021-03-10T13:53:10.452925+0000 mon.b (mon.2) 5 : audit [INF] from='osd.5 [v2:172.21.2.145:6808/3986120015,v1:172.21.2.145:6809/3986120015]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-03-10T13:53:11.557 INFO:journalctl@ceph.osd.5.gibba045.stdout:Mar 10 13:53:11 gibba045 bash[28558]: debug 2021-03-10T13:53:11.303+0000 7f1e314be700 -1 osd.5 87 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T13:53:11.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:11 gibba015 bash[29377]: audit 2021-03-10T13:53:10.452132+0000 mon.a (mon.0) 454 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-03-10T13:53:11.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:11 gibba015 bash[29377]: audit 2021-03-10T13:53:10.452925+0000 mon.b (mon.2) 5 : audit [INF] from='osd.5 [v2:172.21.2.145:6808/3986120015,v1:172.21.2.145:6809/3986120015]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-03-10T13:53:11.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:11 gibba015 bash[30343]: audit 2021-03-10T13:53:10.452132+0000 mon.a (mon.0) 454 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-03-10T13:53:11.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:11 gibba015 bash[30343]: audit 2021-03-10T13:53:10.452925+0000 mon.b (mon.2) 5 : audit [INF] from='osd.5 [v2:172.21.2.145:6808/3986120015,v1:172.21.2.145:6809/3986120015]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-03-10T13:53:12.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:12 gibba015 bash[29377]: cluster 2021-03-10T13:53:11.069281+0000 mgr.gibba045.orlgmj (mgr.34412) 266 : cluster [DBG] pgmap v130: 129 pgs: 16 active+undersized+degraded, 28 active+undersized, 85 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail; 21/192 objects degraded (10.938%) 2021-03-10T13:53:12.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:12 gibba015 bash[29377]: audit 2021-03-10T13:53:11.295786+0000 mon.a (mon.0) 455 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2021-03-10T13:53:12.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:12 gibba015 bash[29377]: cluster 2021-03-10T13:53:11.295830+0000 mon.a (mon.0) 456 : cluster [DBG] osdmap e90: 8 total, 7 up, 8 in 2021-03-10T13:53:12.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:12 gibba015 bash[29377]: audit 2021-03-10T13:53:11.297698+0000 mon.a (mon.0) 457 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0820, "args": ["host=gibba045", "root=default"]}]: dispatch 2021-03-10T13:53:12.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:12 gibba015 bash[29377]: audit 2021-03-10T13:53:11.299127+0000 mon.b (mon.2) 6 : audit [INF] from='osd.5 [v2:172.21.2.145:6808/3986120015,v1:172.21.2.145:6809/3986120015]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0820, "args": ["host=gibba045", "root=default"]}]: dispatch 2021-03-10T13:53:12.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:12 gibba015 bash[29377]: cluster 2021-03-10T13:53:11.388918+0000 mon.a (mon.0) 458 : cluster [WRN] Health check update: Degraded data redundancy: 21/192 objects degraded (10.938%), 16 pgs degraded (PG_DEGRADED) 2021-03-10T13:53:12.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:12 gibba015 bash[30343]: cluster 2021-03-10T13:53:11.069281+0000 mgr.gibba045.orlgmj (mgr.34412) 266 : cluster [DBG] pgmap v130: 129 pgs: 16 active+undersized+degraded, 28 active+undersized, 85 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail; 21/192 objects degraded (10.938%) 2021-03-10T13:53:12.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:12 gibba015 bash[30343]: audit 2021-03-10T13:53:11.295786+0000 mon.a (mon.0) 455 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2021-03-10T13:53:12.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:12 gibba015 bash[30343]: cluster 2021-03-10T13:53:11.295830+0000 mon.a (mon.0) 456 : cluster [DBG] osdmap e90: 8 total, 7 up, 8 in 2021-03-10T13:53:12.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:12 gibba015 bash[30343]: audit 2021-03-10T13:53:11.297698+0000 mon.a (mon.0) 457 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0820, "args": ["host=gibba045", "root=default"]}]: dispatch 2021-03-10T13:53:12.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:12 gibba015 bash[30343]: audit 2021-03-10T13:53:11.299127+0000 mon.b (mon.2) 6 : audit [INF] from='osd.5 [v2:172.21.2.145:6808/3986120015,v1:172.21.2.145:6809/3986120015]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0820, "args": ["host=gibba045", "root=default"]}]: dispatch 2021-03-10T13:53:12.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:12 gibba015 bash[30343]: cluster 2021-03-10T13:53:11.388918+0000 mon.a (mon.0) 458 : cluster [WRN] Health check update: Degraded data redundancy: 21/192 objects degraded (10.938%), 16 pgs degraded (PG_DEGRADED) 2021-03-10T13:53:12.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:12 gibba045 bash[25517]: cluster 2021-03-10T13:53:11.069281+0000 mgr.gibba045.orlgmj (mgr.34412) 266 : cluster [DBG] pgmap v130: 129 pgs: 16 active+undersized+degraded, 28 active+undersized, 85 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail; 21/192 objects degraded (10.938%) 2021-03-10T13:53:12.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:12 gibba045 bash[25517]: audit 2021-03-10T13:53:11.295786+0000 mon.a (mon.0) 455 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2021-03-10T13:53:12.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:12 gibba045 bash[25517]: cluster 2021-03-10T13:53:11.295830+0000 mon.a (mon.0) 456 : cluster [DBG] osdmap e90: 8 total, 7 up, 8 in 2021-03-10T13:53:12.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:12 gibba045 bash[25517]: audit 2021-03-10T13:53:11.297698+0000 mon.a (mon.0) 457 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0820, "args": ["host=gibba045", "root=default"]}]: dispatch 2021-03-10T13:53:12.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:12 gibba045 bash[25517]: audit 2021-03-10T13:53:11.299127+0000 mon.b (mon.2) 6 : audit [INF] from='osd.5 [v2:172.21.2.145:6808/3986120015,v1:172.21.2.145:6809/3986120015]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0820, "args": ["host=gibba045", "root=default"]}]: dispatch 2021-03-10T13:53:12.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:12 gibba045 bash[25517]: cluster 2021-03-10T13:53:11.388918+0000 mon.a (mon.0) 458 : cluster [WRN] Health check update: Degraded data redundancy: 21/192 objects degraded (10.938%), 16 pgs degraded (PG_DEGRADED) 2021-03-10T13:53:13.466 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T13:53:13.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:13 gibba015 bash[29377]: cluster 2021-03-10T13:53:12.294670+0000 mon.a (mon.0) 459 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T13:53:13.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:13 gibba015 bash[29377]: cluster 2021-03-10T13:53:12.299013+0000 mon.a (mon.0) 460 : cluster [INF] osd.5 [v2:172.21.2.145:6808/3986120015,v1:172.21.2.145:6809/3986120015] boot 2021-03-10T13:53:13.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:13 gibba015 bash[29377]: cluster 2021-03-10T13:53:12.299055+0000 mon.a (mon.0) 461 : cluster [DBG] osdmap e91: 8 total, 8 up, 8 in 2021-03-10T13:53:13.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:13 gibba015 bash[29377]: audit 2021-03-10T13:53:12.299840+0000 mon.c (mon.1) 130 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T13:53:13.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:13 gibba015 bash[29377]: cluster 2021-03-10T13:53:13.301599+0000 mon.a (mon.0) 462 : cluster [DBG] osdmap e92: 8 total, 8 up, 8 in 2021-03-10T13:53:13.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:13 gibba015 bash[30343]: cluster 2021-03-10T13:53:12.294670+0000 mon.a (mon.0) 459 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T13:53:13.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:13 gibba015 bash[30343]: cluster 2021-03-10T13:53:12.299013+0000 mon.a (mon.0) 460 : cluster [INF] osd.5 [v2:172.21.2.145:6808/3986120015,v1:172.21.2.145:6809/3986120015] boot 2021-03-10T13:53:13.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:13 gibba015 bash[30343]: cluster 2021-03-10T13:53:12.299055+0000 mon.a (mon.0) 461 : cluster [DBG] osdmap e91: 8 total, 8 up, 8 in 2021-03-10T13:53:13.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:13 gibba015 bash[30343]: audit 2021-03-10T13:53:12.299840+0000 mon.c (mon.1) 130 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T13:53:13.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:13 gibba015 bash[30343]: cluster 2021-03-10T13:53:13.301599+0000 mon.a (mon.0) 462 : cluster [DBG] osdmap e92: 8 total, 8 up, 8 in 2021-03-10T13:53:13.725 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T13:53:13.726 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3m) 56s ago 9m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T13:53:13.726 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (9m) 4s ago 9m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T13:53:13.726 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (4m) 4s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T13:53:13.726 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (4m) 4s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T13:53:13.726 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3m) 56s ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T13:53:13.727 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3m) 56s ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T13:53:13.727 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3m) 4s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T13:53:13.727 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3m) 56s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T13:53:13.727 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (9m) 56s ago 9m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T13:53:13.728 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (9m) 4s ago 9m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T13:53:13.728 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2m) 56s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T13:53:13.728 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (108s) 56s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T13:53:13.728 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (83s) 56s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T13:53:13.729 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (57s) 56s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T13:53:13.729 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (33s) 4s ago 10m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T13:53:13.729 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (8s) 4s ago 10m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T13:53:13.729 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (10m) 4s ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 338d252f22e3 2021-03-10T13:53:13.730 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (9m) 4s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 784edc0668a4 2021-03-10T13:53:13.730 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (8m) 4s ago 9m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T13:53:13.730 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 4s ago 7m docker.io/ceph/ceph:v15.2.0 2021-03-10T13:53:13.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:13 gibba045 bash[25517]: cluster 2021-03-10T13:53:12.294670+0000 mon.a (mon.0) 459 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T13:53:13.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:13 gibba045 bash[25517]: cluster 2021-03-10T13:53:12.299013+0000 mon.a (mon.0) 460 : cluster [INF] osd.5 [v2:172.21.2.145:6808/3986120015,v1:172.21.2.145:6809/3986120015] boot 2021-03-10T13:53:13.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:13 gibba045 bash[25517]: cluster 2021-03-10T13:53:12.299055+0000 mon.a (mon.0) 461 : cluster [DBG] osdmap e91: 8 total, 8 up, 8 in 2021-03-10T13:53:13.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:13 gibba045 bash[25517]: audit 2021-03-10T13:53:12.299840+0000 mon.c (mon.1) 130 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T13:53:13.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:13 gibba045 bash[25517]: cluster 2021-03-10T13:53:13.301599+0000 mon.a (mon.0) 462 : cluster [DBG] osdmap e92: 8 total, 8 up, 8 in 2021-03-10T13:53:13.978 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T13:53:13.978 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T13:53:13.978 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:53:13.979 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T13:53:13.979 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T13:53:13.979 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:53:13.979 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T13:53:13.979 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T13:53:13.980 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2021-03-10T13:53:13.980 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 6 2021-03-10T13:53:13.980 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T13:53:13.980 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T13:53:13.980 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T13:53:13.981 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2021-03-10T13:53:13.981 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 12 2021-03-10T13:53:13.981 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T13:53:13.981 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T13:53:14.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:14 gibba015 bash[29377]: cluster 2021-03-10T13:53:13.070631+0000 mgr.gibba045.orlgmj (mgr.34412) 267 : cluster [DBG] pgmap v133: 129 pgs: 16 active+undersized+degraded, 28 active+undersized, 85 active+clean; 7.0 KiB data, 40 MiB used, 670 GiB / 672 GiB avail; 21/192 objects degraded (10.938%) 2021-03-10T13:53:14.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:14 gibba015 bash[29377]: audit 2021-03-10T13:53:13.456244+0000 mgr.gibba045.orlgmj (mgr.34412) 268 : audit [DBG] from='client.54235 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:53:14.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:14 gibba015 bash[29377]: audit 2021-03-10T13:53:13.681391+0000 mgr.gibba045.orlgmj (mgr.34412) 269 : audit [DBG] from='client.54241 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:53:14.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:14 gibba015 bash[29377]: audit 2021-03-10T13:53:13.975989+0000 mon.c (mon.1) 131 : audit [DBG] from='client.? 172.21.2.115:0/3406646707' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:53:14.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:14 gibba015 bash[30343]: cluster 2021-03-10T13:53:13.070631+0000 mgr.gibba045.orlgmj (mgr.34412) 267 : cluster [DBG] pgmap v133: 129 pgs: 16 active+undersized+degraded, 28 active+undersized, 85 active+clean; 7.0 KiB data, 40 MiB used, 670 GiB / 672 GiB avail; 21/192 objects degraded (10.938%) 2021-03-10T13:53:14.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:14 gibba015 bash[30343]: audit 2021-03-10T13:53:13.456244+0000 mgr.gibba045.orlgmj (mgr.34412) 268 : audit [DBG] from='client.54235 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:53:14.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:14 gibba015 bash[30343]: audit 2021-03-10T13:53:13.681391+0000 mgr.gibba045.orlgmj (mgr.34412) 269 : audit [DBG] from='client.54241 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:53:14.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:14 gibba015 bash[30343]: audit 2021-03-10T13:53:13.975989+0000 mon.c (mon.1) 131 : audit [DBG] from='client.? 172.21.2.115:0/3406646707' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:53:14.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:14 gibba045 bash[25517]: cluster 2021-03-10T13:53:13.070631+0000 mgr.gibba045.orlgmj (mgr.34412) 267 : cluster [DBG] pgmap v133: 129 pgs: 16 active+undersized+degraded, 28 active+undersized, 85 active+clean; 7.0 KiB data, 40 MiB used, 670 GiB / 672 GiB avail; 21/192 objects degraded (10.938%) 2021-03-10T13:53:14.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:14 gibba045 bash[25517]: audit 2021-03-10T13:53:13.456244+0000 mgr.gibba045.orlgmj (mgr.34412) 268 : audit [DBG] from='client.54235 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:53:14.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:14 gibba045 bash[25517]: audit 2021-03-10T13:53:13.681391+0000 mgr.gibba045.orlgmj (mgr.34412) 269 : audit [DBG] from='client.54241 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:53:14.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:14 gibba045 bash[25517]: audit 2021-03-10T13:53:13.975989+0000 mon.c (mon.1) 131 : audit [DBG] from='client.? 172.21.2.115:0/3406646707' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:53:16.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:16 gibba015 bash[29377]: cluster 2021-03-10T13:53:15.072514+0000 mgr.gibba045.orlgmj (mgr.34412) 270 : cluster [DBG] pgmap v135: 129 pgs: 7 active+undersized+degraded, 18 active+undersized, 104 active+clean; 7.0 KiB data, 40 MiB used, 670 GiB / 672 GiB avail; 10/192 objects degraded (5.208%) 2021-03-10T13:53:16.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:16 gibba015 bash[30343]: cluster 2021-03-10T13:53:15.072514+0000 mgr.gibba045.orlgmj (mgr.34412) 270 : cluster [DBG] pgmap v135: 129 pgs: 7 active+undersized+degraded, 18 active+undersized, 104 active+clean; 7.0 KiB data, 40 MiB used, 670 GiB / 672 GiB avail; 10/192 objects degraded (5.208%) 2021-03-10T13:53:16.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:16 gibba045 bash[25517]: cluster 2021-03-10T13:53:15.072514+0000 mgr.gibba045.orlgmj (mgr.34412) 270 : cluster [DBG] pgmap v135: 129 pgs: 7 active+undersized+degraded, 18 active+undersized, 104 active+clean; 7.0 KiB data, 40 MiB used, 670 GiB / 672 GiB avail; 10/192 objects degraded (5.208%) 2021-03-10T13:53:17.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:17 gibba015 bash[29377]: cluster 2021-03-10T13:53:16.391481+0000 mon.a (mon.0) 463 : cluster [WRN] Health check update: Degraded data redundancy: 10/192 objects degraded (5.208%), 7 pgs degraded (PG_DEGRADED) 2021-03-10T13:53:17.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:17 gibba015 bash[30343]: cluster 2021-03-10T13:53:16.391481+0000 mon.a (mon.0) 463 : cluster [WRN] Health check update: Degraded data redundancy: 10/192 objects degraded (5.208%), 7 pgs degraded (PG_DEGRADED) 2021-03-10T13:53:17.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:17 gibba045 bash[25517]: cluster 2021-03-10T13:53:16.391481+0000 mon.a (mon.0) 463 : cluster [WRN] Health check update: Degraded data redundancy: 10/192 objects degraded (5.208%), 7 pgs degraded (PG_DEGRADED) 2021-03-10T13:53:18.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:18 gibba015 bash[29377]: cluster 2021-03-10T13:53:17.073999+0000 mgr.gibba045.orlgmj (mgr.34412) 271 : cluster [DBG] pgmap v136: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T13:53:18.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:18 gibba015 bash[29377]: cluster 2021-03-10T13:53:17.395257+0000 mon.a (mon.0) 464 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 10/192 objects degraded (5.208%), 7 pgs degraded) 2021-03-10T13:53:18.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:18 gibba015 bash[29377]: audit 2021-03-10T13:53:17.544819+0000 mon.a (mon.0) 465 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:53:18.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:18 gibba015 bash[30343]: cluster 2021-03-10T13:53:17.073999+0000 mgr.gibba045.orlgmj (mgr.34412) 271 : cluster [DBG] pgmap v136: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T13:53:18.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:18 gibba015 bash[30343]: cluster 2021-03-10T13:53:17.395257+0000 mon.a (mon.0) 464 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 10/192 objects degraded (5.208%), 7 pgs degraded) 2021-03-10T13:53:18.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:18 gibba015 bash[30343]: audit 2021-03-10T13:53:17.544819+0000 mon.a (mon.0) 465 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:53:18.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:18 gibba045 bash[25517]: cluster 2021-03-10T13:53:17.073999+0000 mgr.gibba045.orlgmj (mgr.34412) 271 : cluster [DBG] pgmap v136: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T13:53:18.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:18 gibba045 bash[25517]: cluster 2021-03-10T13:53:17.395257+0000 mon.a (mon.0) 464 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 10/192 objects degraded (5.208%), 7 pgs degraded) 2021-03-10T13:53:18.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:18 gibba045 bash[25517]: audit 2021-03-10T13:53:17.544819+0000 mon.a (mon.0) 465 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:53:20.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:20 gibba015 bash[29377]: cluster 2021-03-10T13:53:19.075308+0000 mgr.gibba045.orlgmj (mgr.34412) 272 : cluster [DBG] pgmap v137: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T13:53:20.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:20 gibba015 bash[30343]: cluster 2021-03-10T13:53:19.075308+0000 mgr.gibba045.orlgmj (mgr.34412) 272 : cluster [DBG] pgmap v137: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T13:53:20.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:20 gibba045 bash[25517]: cluster 2021-03-10T13:53:19.075308+0000 mgr.gibba045.orlgmj (mgr.34412) 272 : cluster [DBG] pgmap v137: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T13:53:22.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:22 gibba015 bash[29377]: cluster 2021-03-10T13:53:21.076939+0000 mgr.gibba045.orlgmj (mgr.34412) 273 : cluster [DBG] pgmap v138: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T13:53:22.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:22 gibba015 bash[30343]: cluster 2021-03-10T13:53:21.076939+0000 mgr.gibba045.orlgmj (mgr.34412) 273 : cluster [DBG] pgmap v138: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T13:53:22.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:22 gibba045 bash[25517]: cluster 2021-03-10T13:53:21.076939+0000 mgr.gibba045.orlgmj (mgr.34412) 273 : cluster [DBG] pgmap v138: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T13:53:24.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:24 gibba015 bash[29377]: cluster 2021-03-10T13:53:23.078495+0000 mgr.gibba045.orlgmj (mgr.34412) 274 : cluster [DBG] pgmap v139: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T13:53:24.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:24 gibba015 bash[29377]: audit 2021-03-10T13:53:24.317915+0000 mon.c (mon.1) 132 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2021-03-10T13:53:24.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:24 gibba015 bash[30343]: cluster 2021-03-10T13:53:23.078495+0000 mgr.gibba045.orlgmj (mgr.34412) 274 : cluster [DBG] pgmap v139: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T13:53:24.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:24 gibba015 bash[30343]: audit 2021-03-10T13:53:24.317915+0000 mon.c (mon.1) 132 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2021-03-10T13:53:24.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:24 gibba045 bash[25517]: cluster 2021-03-10T13:53:23.078495+0000 mgr.gibba045.orlgmj (mgr.34412) 274 : cluster [DBG] pgmap v139: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T13:53:24.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:24 gibba045 bash[25517]: audit 2021-03-10T13:53:24.317915+0000 mon.c (mon.1) 132 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2021-03-10T13:53:25.693 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:25 gibba045 bash[25517]: audit 2021-03-10T13:53:24.320700+0000 mgr.gibba045.orlgmj (mgr.34412) 275 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2021-03-10T13:53:25.694 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:25 gibba045 bash[25517]: cephadm 2021-03-10T13:53:24.325153+0000 mgr.gibba045.orlgmj (mgr.34412) 276 : cephadm [INF] Upgrade: osd.6 is safe to restart 2021-03-10T13:53:25.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:25 gibba015 bash[29377]: audit 2021-03-10T13:53:24.320700+0000 mgr.gibba045.orlgmj (mgr.34412) 275 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2021-03-10T13:53:25.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:25 gibba015 bash[29377]: cephadm 2021-03-10T13:53:24.325153+0000 mgr.gibba045.orlgmj (mgr.34412) 276 : cephadm [INF] Upgrade: osd.6 is safe to restart 2021-03-10T13:53:25.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:25 gibba015 bash[30343]: audit 2021-03-10T13:53:24.320700+0000 mgr.gibba045.orlgmj (mgr.34412) 275 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2021-03-10T13:53:25.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:25 gibba015 bash[30343]: cephadm 2021-03-10T13:53:24.325153+0000 mgr.gibba045.orlgmj (mgr.34412) 276 : cephadm [INF] Upgrade: osd.6 is safe to restart 2021-03-10T13:53:26.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:26 gibba045 bash[25517]: cluster 2021-03-10T13:53:25.080294+0000 mgr.gibba045.orlgmj (mgr.34412) 277 : cluster [DBG] pgmap v140: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T13:53:26.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:26 gibba045 bash[25517]: audit 2021-03-10T13:53:26.117664+0000 mon.a (mon.0) 466 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:53:26.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:26 gibba045 bash[25517]: audit 2021-03-10T13:53:26.119555+0000 mon.c (mon.1) 133 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd.6","key": "container_image"}]: dispatch 2021-03-10T13:53:26.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:26 gibba015 bash[29377]: cluster 2021-03-10T13:53:25.080294+0000 mgr.gibba045.orlgmj (mgr.34412) 277 : cluster [DBG] pgmap v140: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T13:53:26.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:26 gibba015 bash[29377]: audit 2021-03-10T13:53:26.117664+0000 mon.a (mon.0) 466 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:53:26.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:26 gibba015 bash[29377]: audit 2021-03-10T13:53:26.119555+0000 mon.c (mon.1) 133 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd.6","key": "container_image"}]: dispatch 2021-03-10T13:53:26.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:26 gibba015 bash[30343]: cluster 2021-03-10T13:53:25.080294+0000 mgr.gibba045.orlgmj (mgr.34412) 277 : cluster [DBG] pgmap v140: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T13:53:26.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:26 gibba015 bash[30343]: audit 2021-03-10T13:53:26.117664+0000 mon.a (mon.0) 466 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:53:26.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:26 gibba015 bash[30343]: audit 2021-03-10T13:53:26.119555+0000 mon.c (mon.1) 133 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd.6","key": "container_image"}]: dispatch 2021-03-10T13:53:27.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:27 gibba015 bash[29377]: cephadm 2021-03-10T13:53:26.108367+0000 mgr.gibba045.orlgmj (mgr.34412) 278 : cephadm [INF] Upgrade: Updating osd.6 2021-03-10T13:53:27.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:27 gibba015 bash[29377]: cephadm 2021-03-10T13:53:26.120975+0000 mgr.gibba045.orlgmj (mgr.34412) 279 : cephadm [INF] Deploying daemon osd.6 on gibba045 2021-03-10T13:53:27.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:27 gibba015 bash[30343]: cephadm 2021-03-10T13:53:26.108367+0000 mgr.gibba045.orlgmj (mgr.34412) 278 : cephadm [INF] Upgrade: Updating osd.6 2021-03-10T13:53:27.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:27 gibba015 bash[30343]: cephadm 2021-03-10T13:53:26.120975+0000 mgr.gibba045.orlgmj (mgr.34412) 279 : cephadm [INF] Deploying daemon osd.6 on gibba045 2021-03-10T13:53:27.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:27 gibba045 bash[25517]: cephadm 2021-03-10T13:53:26.108367+0000 mgr.gibba045.orlgmj (mgr.34412) 278 : cephadm [INF] Upgrade: Updating osd.6 2021-03-10T13:53:27.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:27 gibba045 bash[25517]: cephadm 2021-03-10T13:53:26.120975+0000 mgr.gibba045.orlgmj (mgr.34412) 279 : cephadm [INF] Deploying daemon osd.6 on gibba045 2021-03-10T13:53:28.190 INFO:journalctl@ceph.osd.6.gibba045.stdout:Mar 10 13:53:27 gibba045 systemd[1]: Stopping Ceph osd.6 for e4a642d2-81a5-11eb-9080-001a4aab830c... 2021-03-10T13:53:28.191 INFO:journalctl@ceph.osd.6.gibba045.stdout:Mar 10 13:53:28 gibba045 bash[15178]: debug 2021-03-10T13:53:28.059+0000 7f8a31547700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2021-03-10T13:53:28.191 INFO:journalctl@ceph.osd.6.gibba045.stdout:Mar 10 13:53:28 gibba045 bash[15178]: debug 2021-03-10T13:53:28.059+0000 7f8a31547700 -1 osd.6 92 *** Got signal Terminated *** 2021-03-10T13:53:28.191 INFO:journalctl@ceph.osd.6.gibba045.stdout:Mar 10 13:53:28 gibba045 bash[15178]: debug 2021-03-10T13:53:28.059+0000 7f8a31547700 -1 osd.6 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-03-10T13:53:28.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:28 gibba045 bash[25517]: cluster 2021-03-10T13:53:27.081815+0000 mgr.gibba045.orlgmj (mgr.34412) 280 : cluster [DBG] pgmap v141: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T13:53:28.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:28 gibba045 bash[25517]: cluster 2021-03-10T13:53:28.368962+0000 mon.a (mon.0) 467 : cluster [DBG] osd.6 reported immediately failed by osd.4 2021-03-10T13:53:28.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:28 gibba045 bash[25517]: cluster 2021-03-10T13:53:28.369126+0000 mon.a (mon.0) 468 : cluster [INF] osd.6 failed (root=default,host=gibba045) (connection refused reported by osd.4) 2021-03-10T13:53:28.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:28 gibba045 bash[25517]: cluster 2021-03-10T13:53:28.369746+0000 mon.a (mon.0) 469 : cluster [DBG] osd.6 reported immediately failed by osd.2 2021-03-10T13:53:28.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:28 gibba045 bash[25517]: cluster 2021-03-10T13:53:28.370047+0000 mon.a (mon.0) 470 : cluster [DBG] osd.6 reported immediately failed by osd.4 2021-03-10T13:53:28.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:28 gibba045 bash[25517]: cluster 2021-03-10T13:53:28.370668+0000 mon.a (mon.0) 471 : cluster [DBG] osd.6 reported immediately failed by osd.1 2021-03-10T13:53:28.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:28 gibba045 bash[25517]: cluster 2021-03-10T13:53:28.370851+0000 mon.a (mon.0) 472 : cluster [DBG] osd.6 reported immediately failed by osd.7 2021-03-10T13:53:28.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:28 gibba045 bash[25517]: cluster 2021-03-10T13:53:28.371326+0000 mon.a (mon.0) 473 : cluster [DBG] osd.6 reported immediately failed by osd.3 2021-03-10T13:53:28.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:28 gibba045 bash[25517]: cluster 2021-03-10T13:53:28.371587+0000 mon.a (mon.0) 474 : cluster [DBG] osd.6 reported immediately failed by osd.5 2021-03-10T13:53:28.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:28 gibba045 bash[25517]: cluster 2021-03-10T13:53:28.371986+0000 mon.a (mon.0) 475 : cluster [DBG] osd.6 reported immediately failed by osd.7 2021-03-10T13:53:28.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:28 gibba045 bash[25517]: cluster 2021-03-10T13:53:28.372263+0000 mon.a (mon.0) 476 : cluster [DBG] osd.6 reported immediately failed by osd.0 2021-03-10T13:53:28.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:28 gibba045 bash[25517]: cluster 2021-03-10T13:53:28.372838+0000 mon.a (mon.0) 477 : cluster [DBG] osd.6 reported immediately failed by osd.5 2021-03-10T13:53:28.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:28 gibba045 bash[25517]: cluster 2021-03-10T13:53:28.373194+0000 mon.a (mon.0) 478 : cluster [DBG] osd.6 reported immediately failed by osd.0 2021-03-10T13:53:28.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:28 gibba045 bash[25517]: cluster 2021-03-10T13:53:28.373658+0000 mon.a (mon.0) 479 : cluster [DBG] osd.6 reported immediately failed by osd.1 2021-03-10T13:53:28.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:28 gibba045 bash[25517]: cluster 2021-03-10T13:53:28.373744+0000 mon.a (mon.0) 480 : cluster [DBG] osd.6 reported immediately failed by osd.3 2021-03-10T13:53:28.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:28 gibba045 bash[25517]: cluster 2021-03-10T13:53:28.373886+0000 mon.a (mon.0) 481 : cluster [DBG] osd.6 reported immediately failed by osd.2 2021-03-10T13:53:28.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:28 gibba015 bash[29377]: cluster 2021-03-10T13:53:27.081815+0000 mgr.gibba045.orlgmj (mgr.34412) 280 : cluster [DBG] pgmap v141: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T13:53:28.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:28 gibba015 bash[29377]: cluster 2021-03-10T13:53:28.368962+0000 mon.a (mon.0) 467 : cluster [DBG] osd.6 reported immediately failed by osd.4 2021-03-10T13:53:28.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:28 gibba015 bash[29377]: cluster 2021-03-10T13:53:28.369126+0000 mon.a (mon.0) 468 : cluster [INF] osd.6 failed (root=default,host=gibba045) (connection refused reported by osd.4) 2021-03-10T13:53:28.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:28 gibba015 bash[29377]: cluster 2021-03-10T13:53:28.369746+0000 mon.a (mon.0) 469 : cluster [DBG] osd.6 reported immediately failed by osd.2 2021-03-10T13:53:28.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:28 gibba015 bash[29377]: cluster 2021-03-10T13:53:28.370047+0000 mon.a (mon.0) 470 : cluster [DBG] osd.6 reported immediately failed by osd.4 2021-03-10T13:53:28.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:28 gibba015 bash[29377]: cluster 2021-03-10T13:53:28.370668+0000 mon.a (mon.0) 471 : cluster [DBG] osd.6 reported immediately failed by osd.1 2021-03-10T13:53:28.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:28 gibba015 bash[29377]: cluster 2021-03-10T13:53:28.370851+0000 mon.a (mon.0) 472 : cluster [DBG] osd.6 reported immediately failed by osd.7 2021-03-10T13:53:28.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:28 gibba015 bash[29377]: cluster 2021-03-10T13:53:28.371326+0000 mon.a (mon.0) 473 : cluster [DBG] osd.6 reported immediately failed by osd.3 2021-03-10T13:53:28.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:28 gibba015 bash[29377]: cluster 2021-03-10T13:53:28.371587+0000 mon.a (mon.0) 474 : cluster [DBG] osd.6 reported immediately failed by osd.5 2021-03-10T13:53:28.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:28 gibba015 bash[29377]: cluster 2021-03-10T13:53:28.371986+0000 mon.a (mon.0) 475 : cluster [DBG] osd.6 reported immediately failed by osd.7 2021-03-10T13:53:28.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:28 gibba015 bash[29377]: cluster 2021-03-10T13:53:28.372263+0000 mon.a (mon.0) 476 : cluster [DBG] osd.6 reported immediately failed by osd.0 2021-03-10T13:53:28.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:28 gibba015 bash[29377]: cluster 2021-03-10T13:53:28.372838+0000 mon.a (mon.0) 477 : cluster [DBG] osd.6 reported immediately failed by osd.5 2021-03-10T13:53:28.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:28 gibba015 bash[29377]: cluster 2021-03-10T13:53:28.373194+0000 mon.a (mon.0) 478 : cluster [DBG] osd.6 reported immediately failed by osd.0 2021-03-10T13:53:28.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:28 gibba015 bash[29377]: cluster 2021-03-10T13:53:28.373658+0000 mon.a (mon.0) 479 : cluster [DBG] osd.6 reported immediately failed by osd.1 2021-03-10T13:53:28.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:28 gibba015 bash[29377]: cluster 2021-03-10T13:53:28.373744+0000 mon.a (mon.0) 480 : cluster [DBG] osd.6 reported immediately failed by osd.3 2021-03-10T13:53:28.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:28 gibba015 bash[29377]: cluster 2021-03-10T13:53:28.373886+0000 mon.a (mon.0) 481 : cluster [DBG] osd.6 reported immediately failed by osd.2 2021-03-10T13:53:28.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:28 gibba015 bash[30343]: cluster 2021-03-10T13:53:27.081815+0000 mgr.gibba045.orlgmj (mgr.34412) 280 : cluster [DBG] pgmap v141: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T13:53:28.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:28 gibba015 bash[30343]: cluster 2021-03-10T13:53:28.368962+0000 mon.a (mon.0) 467 : cluster [DBG] osd.6 reported immediately failed by osd.4 2021-03-10T13:53:28.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:28 gibba015 bash[30343]: cluster 2021-03-10T13:53:28.369126+0000 mon.a (mon.0) 468 : cluster [INF] osd.6 failed (root=default,host=gibba045) (connection refused reported by osd.4) 2021-03-10T13:53:28.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:28 gibba015 bash[30343]: cluster 2021-03-10T13:53:28.369746+0000 mon.a (mon.0) 469 : cluster [DBG] osd.6 reported immediately failed by osd.2 2021-03-10T13:53:28.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:28 gibba015 bash[30343]: cluster 2021-03-10T13:53:28.370047+0000 mon.a (mon.0) 470 : cluster [DBG] osd.6 reported immediately failed by osd.4 2021-03-10T13:53:28.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:28 gibba015 bash[30343]: cluster 2021-03-10T13:53:28.370668+0000 mon.a (mon.0) 471 : cluster [DBG] osd.6 reported immediately failed by osd.1 2021-03-10T13:53:28.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:28 gibba015 bash[30343]: cluster 2021-03-10T13:53:28.370851+0000 mon.a (mon.0) 472 : cluster [DBG] osd.6 reported immediately failed by osd.7 2021-03-10T13:53:28.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:28 gibba015 bash[30343]: cluster 2021-03-10T13:53:28.371326+0000 mon.a (mon.0) 473 : cluster [DBG] osd.6 reported immediately failed by osd.3 2021-03-10T13:53:28.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:28 gibba015 bash[30343]: cluster 2021-03-10T13:53:28.371587+0000 mon.a (mon.0) 474 : cluster [DBG] osd.6 reported immediately failed by osd.5 2021-03-10T13:53:28.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:28 gibba015 bash[30343]: cluster 2021-03-10T13:53:28.371986+0000 mon.a (mon.0) 475 : cluster [DBG] osd.6 reported immediately failed by osd.7 2021-03-10T13:53:28.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:28 gibba015 bash[30343]: cluster 2021-03-10T13:53:28.372263+0000 mon.a (mon.0) 476 : cluster [DBG] osd.6 reported immediately failed by osd.0 2021-03-10T13:53:28.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:28 gibba015 bash[30343]: cluster 2021-03-10T13:53:28.372838+0000 mon.a (mon.0) 477 : cluster [DBG] osd.6 reported immediately failed by osd.5 2021-03-10T13:53:28.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:28 gibba015 bash[30343]: cluster 2021-03-10T13:53:28.373194+0000 mon.a (mon.0) 478 : cluster [DBG] osd.6 reported immediately failed by osd.0 2021-03-10T13:53:28.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:28 gibba015 bash[30343]: cluster 2021-03-10T13:53:28.373658+0000 mon.a (mon.0) 479 : cluster [DBG] osd.6 reported immediately failed by osd.1 2021-03-10T13:53:28.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:28 gibba015 bash[30343]: cluster 2021-03-10T13:53:28.373744+0000 mon.a (mon.0) 480 : cluster [DBG] osd.6 reported immediately failed by osd.3 2021-03-10T13:53:28.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:28 gibba015 bash[30343]: cluster 2021-03-10T13:53:28.373886+0000 mon.a (mon.0) 481 : cluster [DBG] osd.6 reported immediately failed by osd.2 2021-03-10T13:53:28.743 INFO:journalctl@ceph.osd.6.gibba045.stdout:Mar 10 13:53:28 gibba045 docker[29492]: ceph-e4a642d2-81a5-11eb-9080-001a4aab830c-osd.6 2021-03-10T13:53:29.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:29 gibba015 bash[29377]: cluster 2021-03-10T13:53:28.437334+0000 mon.a (mon.0) 482 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T13:53:29.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:29 gibba015 bash[29377]: cluster 2021-03-10T13:53:28.444059+0000 mon.a (mon.0) 483 : cluster [DBG] osdmap e93: 8 total, 7 up, 8 in 2021-03-10T13:53:29.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:29 gibba015 bash[30343]: cluster 2021-03-10T13:53:28.437334+0000 mon.a (mon.0) 482 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T13:53:29.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:29 gibba015 bash[30343]: cluster 2021-03-10T13:53:28.444059+0000 mon.a (mon.0) 483 : cluster [DBG] osdmap e93: 8 total, 7 up, 8 in 2021-03-10T13:53:29.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:29 gibba045 bash[25517]: cluster 2021-03-10T13:53:28.437334+0000 mon.a (mon.0) 482 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T13:53:29.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:29 gibba045 bash[25517]: cluster 2021-03-10T13:53:28.444059+0000 mon.a (mon.0) 483 : cluster [DBG] osdmap e93: 8 total, 7 up, 8 in 2021-03-10T13:53:30.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:30 gibba015 bash[29377]: cluster 2021-03-10T13:53:29.082921+0000 mgr.gibba045.orlgmj (mgr.34412) 281 : cluster [DBG] pgmap v143: 129 pgs: 11 stale+active+clean, 3 peering, 17 active+clean+wait, 98 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T13:53:30.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:30 gibba015 bash[29377]: cluster 2021-03-10T13:53:29.451174+0000 mon.a (mon.0) 484 : cluster [DBG] osdmap e94: 8 total, 7 up, 8 in 2021-03-10T13:53:30.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:30 gibba015 bash[30343]: cluster 2021-03-10T13:53:29.082921+0000 mgr.gibba045.orlgmj (mgr.34412) 281 : cluster [DBG] pgmap v143: 129 pgs: 11 stale+active+clean, 3 peering, 17 active+clean+wait, 98 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T13:53:30.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:30 gibba015 bash[30343]: cluster 2021-03-10T13:53:29.451174+0000 mon.a (mon.0) 484 : cluster [DBG] osdmap e94: 8 total, 7 up, 8 in 2021-03-10T13:53:30.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:30 gibba045 bash[25517]: cluster 2021-03-10T13:53:29.082921+0000 mgr.gibba045.orlgmj (mgr.34412) 281 : cluster [DBG] pgmap v143: 129 pgs: 11 stale+active+clean, 3 peering, 17 active+clean+wait, 98 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T13:53:30.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:30 gibba045 bash[25517]: cluster 2021-03-10T13:53:29.451174+0000 mon.a (mon.0) 484 : cluster [DBG] osdmap e94: 8 total, 7 up, 8 in 2021-03-10T13:53:30.807 INFO:journalctl@ceph.osd.6.gibba045.stdout:Mar 10 13:53:30 gibba045 systemd[1]: ceph-e4a642d2-81a5-11eb-9080-001a4aab830c@osd.6.service: Succeeded. 2021-03-10T13:53:30.807 INFO:journalctl@ceph.osd.6.gibba045.stdout:Mar 10 13:53:30 gibba045 systemd[1]: Stopped Ceph osd.6 for e4a642d2-81a5-11eb-9080-001a4aab830c. 2021-03-10T13:53:30.807 INFO:journalctl@ceph.osd.6.gibba045.stdout:Mar 10 13:53:30 gibba045 systemd[1]: Started Ceph osd.6 for e4a642d2-81a5-11eb-9080-001a4aab830c. 2021-03-10T13:53:31.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:31 gibba015 bash[29377]: audit 2021-03-10T13:53:30.640171+0000 mon.a (mon.0) 485 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:53:31.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:31 gibba015 bash[29377]: audit 2021-03-10T13:53:30.641462+0000 mon.c (mon.1) 134 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:53:31.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:31 gibba015 bash[29377]: audit 2021-03-10T13:53:30.643211+0000 mon.c (mon.1) 135 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:53:31.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:31 gibba015 bash[29377]: cephadm 2021-03-10T13:53:30.644545+0000 mgr.gibba045.orlgmj (mgr.34412) 282 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T13:53:31.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:31 gibba015 bash[30343]: audit 2021-03-10T13:53:30.640171+0000 mon.a (mon.0) 485 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:53:31.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:31 gibba015 bash[30343]: audit 2021-03-10T13:53:30.641462+0000 mon.c (mon.1) 134 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:53:31.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:31 gibba015 bash[30343]: audit 2021-03-10T13:53:30.643211+0000 mon.c (mon.1) 135 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:53:31.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:31 gibba015 bash[30343]: cephadm 2021-03-10T13:53:30.644545+0000 mgr.gibba045.orlgmj (mgr.34412) 282 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T13:53:32.063 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:31 gibba045 bash[25517]: audit 2021-03-10T13:53:30.640171+0000 mon.a (mon.0) 485 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:53:32.063 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:31 gibba045 bash[25517]: audit 2021-03-10T13:53:30.641462+0000 mon.c (mon.1) 134 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:53:32.063 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:31 gibba045 bash[25517]: audit 2021-03-10T13:53:30.643211+0000 mon.c (mon.1) 135 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:53:32.064 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:31 gibba045 bash[25517]: cephadm 2021-03-10T13:53:30.644545+0000 mgr.gibba045.orlgmj (mgr.34412) 282 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T13:53:32.064 INFO:journalctl@ceph.osd.6.gibba045.stdout:Mar 10 13:53:31 gibba045 bash[29668]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2021-03-10T13:53:32.064 INFO:journalctl@ceph.osd.6.gibba045.stdout:Mar 10 13:53:31 gibba045 bash[29668]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-6 --no-mon-config 2021-03-10T13:53:32.065 INFO:journalctl@ceph.osd.6.gibba045.stdout:Mar 10 13:53:31 gibba045 bash[29668]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-6/block 2021-03-10T13:53:32.065 INFO:journalctl@ceph.osd.6.gibba045.stdout:Mar 10 13:53:31 gibba045 bash[29668]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-6/block 2021-03-10T13:53:32.065 INFO:journalctl@ceph.osd.6.gibba045.stdout:Mar 10 13:53:31 gibba045 bash[29668]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2021-03-10T13:53:32.065 INFO:journalctl@ceph.osd.6.gibba045.stdout:Mar 10 13:53:31 gibba045 bash[29668]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2021-03-10T13:53:32.065 INFO:journalctl@ceph.osd.6.gibba045.stdout:Mar 10 13:53:31 gibba045 bash[29668]: --> ceph-volume lvm activate successful for osd ID: 6 2021-03-10T13:53:32.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:32 gibba015 bash[29377]: cluster 2021-03-10T13:53:31.084640+0000 mgr.gibba045.orlgmj (mgr.34412) 283 : cluster [DBG] pgmap v145: 129 pgs: 4 stale+active+clean, 6 active+undersized+degraded, 3 peering, 17 active+clean+wait, 12 active+undersized, 87 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail; 10/192 objects degraded (5.208%) 2021-03-10T13:53:32.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:32 gibba015 bash[29377]: cluster 2021-03-10T13:53:31.636451+0000 mon.a (mon.0) 486 : cluster [WRN] Health check failed: Degraded data redundancy: 10/192 objects degraded (5.208%), 6 pgs degraded (PG_DEGRADED) 2021-03-10T13:53:32.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:32 gibba015 bash[30343]: cluster 2021-03-10T13:53:31.084640+0000 mgr.gibba045.orlgmj (mgr.34412) 283 : cluster [DBG] pgmap v145: 129 pgs: 4 stale+active+clean, 6 active+undersized+degraded, 3 peering, 17 active+clean+wait, 12 active+undersized, 87 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail; 10/192 objects degraded (5.208%) 2021-03-10T13:53:32.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:32 gibba015 bash[30343]: cluster 2021-03-10T13:53:31.636451+0000 mon.a (mon.0) 486 : cluster [WRN] Health check failed: Degraded data redundancy: 10/192 objects degraded (5.208%), 6 pgs degraded (PG_DEGRADED) 2021-03-10T13:53:33.027 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:32 gibba045 bash[25517]: cluster 2021-03-10T13:53:31.084640+0000 mgr.gibba045.orlgmj (mgr.34412) 283 : cluster [DBG] pgmap v145: 129 pgs: 4 stale+active+clean, 6 active+undersized+degraded, 3 peering, 17 active+clean+wait, 12 active+undersized, 87 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail; 10/192 objects degraded (5.208%) 2021-03-10T13:53:33.027 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:32 gibba045 bash[25517]: cluster 2021-03-10T13:53:31.636451+0000 mon.a (mon.0) 486 : cluster [WRN] Health check failed: Degraded data redundancy: 10/192 objects degraded (5.208%), 6 pgs degraded (PG_DEGRADED) 2021-03-10T13:53:33.306 INFO:journalctl@ceph.osd.6.gibba045.stdout:Mar 10 13:53:33 gibba045 bash[29796]: debug 2021-03-10T13:53:33.127+0000 7f7fe28ee700 1 -- 172.21.2.145:0/3601292539 <== mon.2 v2:172.21.2.145:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55e409ef44e0 con 0x55e409f71000 2021-03-10T13:53:34.056 INFO:journalctl@ceph.osd.6.gibba045.stdout:Mar 10 13:53:33 gibba045 bash[29796]: debug 2021-03-10T13:53:33.671+0000 7f7fea383080 -1 Falling back to public interface 2021-03-10T13:53:34.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:34 gibba015 bash[29377]: cluster 2021-03-10T13:53:33.086115+0000 mgr.gibba045.orlgmj (mgr.34412) 284 : cluster [DBG] pgmap v146: 129 pgs: 1 stale+active+clean, 11 active+undersized+degraded, 3 peering, 22 active+undersized, 92 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail; 17/192 objects degraded (8.854%) 2021-03-10T13:53:34.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:34 gibba015 bash[30343]: cluster 2021-03-10T13:53:33.086115+0000 mgr.gibba045.orlgmj (mgr.34412) 284 : cluster [DBG] pgmap v146: 129 pgs: 1 stale+active+clean, 11 active+undersized+degraded, 3 peering, 22 active+undersized, 92 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail; 17/192 objects degraded (8.854%) 2021-03-10T13:53:35.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:34 gibba045 bash[25517]: cluster 2021-03-10T13:53:33.086115+0000 mgr.gibba045.orlgmj (mgr.34412) 284 : cluster [DBG] pgmap v146: 129 pgs: 1 stale+active+clean, 11 active+undersized+degraded, 3 peering, 22 active+undersized, 92 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail; 17/192 objects degraded (8.854%) 2021-03-10T13:53:36.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:36 gibba015 bash[29377]: cluster 2021-03-10T13:53:35.086674+0000 mgr.gibba045.orlgmj (mgr.34412) 285 : cluster [DBG] pgmap v147: 129 pgs: 15 active+undersized+degraded, 28 active+undersized, 86 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail; 21/192 objects degraded (10.938%) 2021-03-10T13:53:36.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:36 gibba015 bash[29377]: audit 2021-03-10T13:53:35.891820+0000 mon.a (mon.0) 487 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:53:36.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:36 gibba015 bash[29377]: audit 2021-03-10T13:53:35.896019+0000 mon.a (mon.0) 488 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:53:36.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:36 gibba015 bash[29377]: audit 2021-03-10T13:53:35.900460+0000 mon.c (mon.1) 136 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:53:36.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:36 gibba015 bash[29377]: audit 2021-03-10T13:53:35.902163+0000 mon.c (mon.1) 137 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:53:36.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:36 gibba015 bash[29377]: audit 2021-03-10T13:53:35.903499+0000 mon.c (mon.1) 138 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:53:36.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:36 gibba015 bash[29377]: audit 2021-03-10T13:53:35.904751+0000 mon.c (mon.1) 139 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:53:36.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:36 gibba015 bash[29377]: audit 2021-03-10T13:53:35.908393+0000 mon.c (mon.1) 140 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2021-03-10T13:53:36.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:36 gibba015 bash[30343]: cluster 2021-03-10T13:53:35.086674+0000 mgr.gibba045.orlgmj (mgr.34412) 285 : cluster [DBG] pgmap v147: 129 pgs: 15 active+undersized+degraded, 28 active+undersized, 86 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail; 21/192 objects degraded (10.938%) 2021-03-10T13:53:36.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:36 gibba015 bash[30343]: audit 2021-03-10T13:53:35.891820+0000 mon.a (mon.0) 487 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:53:36.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:36 gibba015 bash[30343]: audit 2021-03-10T13:53:35.896019+0000 mon.a (mon.0) 488 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:53:36.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:36 gibba015 bash[30343]: audit 2021-03-10T13:53:35.900460+0000 mon.c (mon.1) 136 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:53:36.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:36 gibba015 bash[30343]: audit 2021-03-10T13:53:35.902163+0000 mon.c (mon.1) 137 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:53:36.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:36 gibba015 bash[30343]: audit 2021-03-10T13:53:35.903499+0000 mon.c (mon.1) 138 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:53:36.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:36 gibba015 bash[30343]: audit 2021-03-10T13:53:35.904751+0000 mon.c (mon.1) 139 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:53:36.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:36 gibba015 bash[30343]: audit 2021-03-10T13:53:35.908393+0000 mon.c (mon.1) 140 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2021-03-10T13:53:36.986 INFO:journalctl@ceph.osd.6.gibba045.stdout:Mar 10 13:53:36 gibba045 bash[29796]: debug 2021-03-10T13:53:36.855+0000 7f7fea383080 -1 bluestore(/var/lib/ceph/osd/ceph-6) fsck warning: store not yet converted to per-pg omap 2021-03-10T13:53:36.986 INFO:journalctl@ceph.osd.6.gibba045.stdout:Mar 10 13:53:36 gibba045 bash[29796]: debug 2021-03-10T13:53:36.859+0000 7f7fd764c700 -1 bluestore(/var/lib/ceph/osd/ceph-6) fsck warning: #-1:c1a3fc6e:::purged_snaps:0# has omap that is not per-pg or pgmeta 2021-03-10T13:53:36.987 INFO:journalctl@ceph.osd.6.gibba045.stdout:Mar 10 13:53:36 gibba045 bash[29796]: debug 2021-03-10T13:53:36.859+0000 7f7fd764c700 -1 bluestore(/var/lib/ceph/osd/ceph-6) fsck warning: #1:ed089dd6:::INTEL_SSDPEL1K375GA_PHKM913400GH375A:head# has omap that is not per-pg or pgmeta 2021-03-10T13:53:36.987 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:36 gibba045 bash[25517]: cluster 2021-03-10T13:53:35.086674+0000 mgr.gibba045.orlgmj (mgr.34412) 285 : cluster [DBG] pgmap v147: 129 pgs: 15 active+undersized+degraded, 28 active+undersized, 86 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail; 21/192 objects degraded (10.938%) 2021-03-10T13:53:36.987 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:36 gibba045 bash[25517]: audit 2021-03-10T13:53:35.891820+0000 mon.a (mon.0) 487 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:53:36.987 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:36 gibba045 bash[25517]: audit 2021-03-10T13:53:35.896019+0000 mon.a (mon.0) 488 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:53:36.988 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:36 gibba045 bash[25517]: audit 2021-03-10T13:53:35.900460+0000 mon.c (mon.1) 136 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:53:36.988 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:36 gibba045 bash[25517]: audit 2021-03-10T13:53:35.902163+0000 mon.c (mon.1) 137 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:53:36.988 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:36 gibba045 bash[25517]: audit 2021-03-10T13:53:35.903499+0000 mon.c (mon.1) 138 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:53:36.988 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:36 gibba045 bash[25517]: audit 2021-03-10T13:53:35.904751+0000 mon.c (mon.1) 139 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:53:36.988 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:36 gibba045 bash[25517]: audit 2021-03-10T13:53:35.908393+0000 mon.c (mon.1) 140 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2021-03-10T13:53:37.306 INFO:journalctl@ceph.osd.6.gibba045.stdout:Mar 10 13:53:36 gibba045 bash[29796]: debug 2021-03-10T13:53:36.983+0000 7f7fea383080 -1 osd.6 92 log_to_monitors {default=true} 2021-03-10T13:53:37.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:37 gibba015 bash[29377]: cephadm 2021-03-10T13:53:35.901603+0000 mgr.gibba045.orlgmj (mgr.34412) 286 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:53:37.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:37 gibba015 bash[29377]: cephadm 2021-03-10T13:53:35.903540+0000 mgr.gibba045.orlgmj (mgr.34412) 287 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:53:37.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:37 gibba015 bash[29377]: cephadm 2021-03-10T13:53:35.904957+0000 mgr.gibba045.orlgmj (mgr.34412) 288 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:53:37.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:37 gibba015 bash[29377]: cephadm 2021-03-10T13:53:35.905041+0000 mgr.gibba045.orlgmj (mgr.34412) 289 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:53:37.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:37 gibba015 bash[29377]: cephadm 2021-03-10T13:53:35.906179+0000 mgr.gibba045.orlgmj (mgr.34412) 290 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:53:37.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:37 gibba015 bash[29377]: cephadm 2021-03-10T13:53:35.906259+0000 mgr.gibba045.orlgmj (mgr.34412) 291 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:53:37.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:37 gibba015 bash[29377]: cephadm 2021-03-10T13:53:35.907502+0000 mgr.gibba045.orlgmj (mgr.34412) 292 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:53:37.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:37 gibba015 bash[29377]: cephadm 2021-03-10T13:53:35.909363+0000 mgr.gibba045.orlgmj (mgr.34412) 293 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:53:37.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:37 gibba015 bash[29377]: cephadm 2021-03-10T13:53:35.909451+0000 mgr.gibba045.orlgmj (mgr.34412) 294 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:53:37.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:37 gibba015 bash[29377]: audit 2021-03-10T13:53:35.910515+0000 mgr.gibba045.orlgmj (mgr.34412) 295 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2021-03-10T13:53:37.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:37 gibba015 bash[29377]: cephadm 2021-03-10T13:53:35.911777+0000 mgr.gibba045.orlgmj (mgr.34412) 296 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (16 PGs are or would become offline) 2021-03-10T13:53:37.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:37 gibba015 bash[29377]: audit 2021-03-10T13:53:36.988182+0000 mon.a (mon.0) 489 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-03-10T13:53:37.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:37 gibba015 bash[29377]: audit 2021-03-10T13:53:36.988976+0000 mon.b (mon.2) 7 : audit [INF] from='osd.6 [v2:172.21.2.145:6816/1837937910,v1:172.21.2.145:6817/1837937910]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-03-10T13:53:37.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:37 gibba015 bash[30343]: cephadm 2021-03-10T13:53:35.901603+0000 mgr.gibba045.orlgmj (mgr.34412) 286 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:53:37.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:37 gibba015 bash[30343]: cephadm 2021-03-10T13:53:35.903540+0000 mgr.gibba045.orlgmj (mgr.34412) 287 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:53:37.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:37 gibba015 bash[30343]: cephadm 2021-03-10T13:53:35.904957+0000 mgr.gibba045.orlgmj (mgr.34412) 288 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:53:37.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:37 gibba015 bash[30343]: cephadm 2021-03-10T13:53:35.905041+0000 mgr.gibba045.orlgmj (mgr.34412) 289 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:53:37.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:37 gibba015 bash[30343]: cephadm 2021-03-10T13:53:35.906179+0000 mgr.gibba045.orlgmj (mgr.34412) 290 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:53:37.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:37 gibba015 bash[30343]: cephadm 2021-03-10T13:53:35.906259+0000 mgr.gibba045.orlgmj (mgr.34412) 291 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:53:37.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:37 gibba015 bash[30343]: cephadm 2021-03-10T13:53:35.907502+0000 mgr.gibba045.orlgmj (mgr.34412) 292 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:53:37.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:37 gibba015 bash[30343]: cephadm 2021-03-10T13:53:35.909363+0000 mgr.gibba045.orlgmj (mgr.34412) 293 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:53:37.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:37 gibba015 bash[30343]: cephadm 2021-03-10T13:53:35.909451+0000 mgr.gibba045.orlgmj (mgr.34412) 294 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:53:37.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:37 gibba015 bash[30343]: audit 2021-03-10T13:53:35.910515+0000 mgr.gibba045.orlgmj (mgr.34412) 295 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2021-03-10T13:53:37.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:37 gibba015 bash[30343]: cephadm 2021-03-10T13:53:35.911777+0000 mgr.gibba045.orlgmj (mgr.34412) 296 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (16 PGs are or would become offline) 2021-03-10T13:53:37.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:37 gibba015 bash[30343]: audit 2021-03-10T13:53:36.988182+0000 mon.a (mon.0) 489 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-03-10T13:53:37.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:37 gibba015 bash[30343]: audit 2021-03-10T13:53:36.988976+0000 mon.b (mon.2) 7 : audit [INF] from='osd.6 [v2:172.21.2.145:6816/1837937910,v1:172.21.2.145:6817/1837937910]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-03-10T13:53:38.056 INFO:journalctl@ceph.osd.6.gibba045.stdout:Mar 10 13:53:37 gibba045 bash[29796]: debug 2021-03-10T13:53:37.679+0000 7f7fdd066700 -1 osd.6 92 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T13:53:38.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:37 gibba045 bash[25517]: cephadm 2021-03-10T13:53:35.901603+0000 mgr.gibba045.orlgmj (mgr.34412) 286 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:53:38.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:37 gibba045 bash[25517]: cephadm 2021-03-10T13:53:35.903540+0000 mgr.gibba045.orlgmj (mgr.34412) 287 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:53:38.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:37 gibba045 bash[25517]: cephadm 2021-03-10T13:53:35.904957+0000 mgr.gibba045.orlgmj (mgr.34412) 288 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:53:38.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:37 gibba045 bash[25517]: cephadm 2021-03-10T13:53:35.905041+0000 mgr.gibba045.orlgmj (mgr.34412) 289 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:53:38.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:37 gibba045 bash[25517]: cephadm 2021-03-10T13:53:35.906179+0000 mgr.gibba045.orlgmj (mgr.34412) 290 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:53:38.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:37 gibba045 bash[25517]: cephadm 2021-03-10T13:53:35.906259+0000 mgr.gibba045.orlgmj (mgr.34412) 291 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:53:38.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:37 gibba045 bash[25517]: cephadm 2021-03-10T13:53:35.907502+0000 mgr.gibba045.orlgmj (mgr.34412) 292 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:53:38.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:37 gibba045 bash[25517]: cephadm 2021-03-10T13:53:35.909363+0000 mgr.gibba045.orlgmj (mgr.34412) 293 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:53:38.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:37 gibba045 bash[25517]: cephadm 2021-03-10T13:53:35.909451+0000 mgr.gibba045.orlgmj (mgr.34412) 294 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:53:38.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:37 gibba045 bash[25517]: audit 2021-03-10T13:53:35.910515+0000 mgr.gibba045.orlgmj (mgr.34412) 295 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2021-03-10T13:53:38.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:37 gibba045 bash[25517]: cephadm 2021-03-10T13:53:35.911777+0000 mgr.gibba045.orlgmj (mgr.34412) 296 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (16 PGs are or would become offline) 2021-03-10T13:53:38.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:37 gibba045 bash[25517]: audit 2021-03-10T13:53:36.988182+0000 mon.a (mon.0) 489 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-03-10T13:53:38.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:37 gibba045 bash[25517]: audit 2021-03-10T13:53:36.988976+0000 mon.b (mon.2) 7 : audit [INF] from='osd.6 [v2:172.21.2.145:6816/1837937910,v1:172.21.2.145:6817/1837937910]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-03-10T13:53:38.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:38 gibba015 bash[29377]: cluster 2021-03-10T13:53:37.087957+0000 mgr.gibba045.orlgmj (mgr.34412) 297 : cluster [DBG] pgmap v148: 129 pgs: 15 active+undersized+degraded, 28 active+undersized, 86 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail; 21/192 objects degraded (10.938%) 2021-03-10T13:53:38.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:38 gibba015 bash[29377]: audit 2021-03-10T13:53:37.673146+0000 mon.a (mon.0) 490 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2021-03-10T13:53:38.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:38 gibba015 bash[29377]: cluster 2021-03-10T13:53:37.673195+0000 mon.a (mon.0) 491 : cluster [DBG] osdmap e95: 8 total, 7 up, 8 in 2021-03-10T13:53:38.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:38 gibba015 bash[29377]: audit 2021-03-10T13:53:37.674772+0000 mon.a (mon.0) 492 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba045", "root=default"]}]: dispatch 2021-03-10T13:53:38.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:38 gibba015 bash[29377]: audit 2021-03-10T13:53:37.676412+0000 mon.b (mon.2) 8 : audit [INF] from='osd.6 [v2:172.21.2.145:6816/1837937910,v1:172.21.2.145:6817/1837937910]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba045", "root=default"]}]: dispatch 2021-03-10T13:53:38.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:38 gibba015 bash[30343]: cluster 2021-03-10T13:53:37.087957+0000 mgr.gibba045.orlgmj (mgr.34412) 297 : cluster [DBG] pgmap v148: 129 pgs: 15 active+undersized+degraded, 28 active+undersized, 86 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail; 21/192 objects degraded (10.938%) 2021-03-10T13:53:38.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:38 gibba015 bash[30343]: audit 2021-03-10T13:53:37.673146+0000 mon.a (mon.0) 490 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2021-03-10T13:53:38.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:38 gibba015 bash[30343]: cluster 2021-03-10T13:53:37.673195+0000 mon.a (mon.0) 491 : cluster [DBG] osdmap e95: 8 total, 7 up, 8 in 2021-03-10T13:53:38.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:38 gibba015 bash[30343]: audit 2021-03-10T13:53:37.674772+0000 mon.a (mon.0) 492 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba045", "root=default"]}]: dispatch 2021-03-10T13:53:38.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:38 gibba015 bash[30343]: audit 2021-03-10T13:53:37.676412+0000 mon.b (mon.2) 8 : audit [INF] from='osd.6 [v2:172.21.2.145:6816/1837937910,v1:172.21.2.145:6817/1837937910]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba045", "root=default"]}]: dispatch 2021-03-10T13:53:39.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:38 gibba045 bash[25517]: cluster 2021-03-10T13:53:37.087957+0000 mgr.gibba045.orlgmj (mgr.34412) 297 : cluster [DBG] pgmap v148: 129 pgs: 15 active+undersized+degraded, 28 active+undersized, 86 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail; 21/192 objects degraded (10.938%) 2021-03-10T13:53:39.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:38 gibba045 bash[25517]: audit 2021-03-10T13:53:37.673146+0000 mon.a (mon.0) 490 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2021-03-10T13:53:39.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:38 gibba045 bash[25517]: cluster 2021-03-10T13:53:37.673195+0000 mon.a (mon.0) 491 : cluster [DBG] osdmap e95: 8 total, 7 up, 8 in 2021-03-10T13:53:39.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:38 gibba045 bash[25517]: audit 2021-03-10T13:53:37.674772+0000 mon.a (mon.0) 492 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba045", "root=default"]}]: dispatch 2021-03-10T13:53:39.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:38 gibba045 bash[25517]: audit 2021-03-10T13:53:37.676412+0000 mon.b (mon.2) 8 : audit [INF] from='osd.6 [v2:172.21.2.145:6816/1837937910,v1:172.21.2.145:6817/1837937910]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba045", "root=default"]}]: dispatch 2021-03-10T13:53:39.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:39 gibba015 bash[29377]: cluster 2021-03-10T13:53:38.672471+0000 mon.a (mon.0) 493 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T13:53:39.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:39 gibba015 bash[29377]: cluster 2021-03-10T13:53:38.683677+0000 mon.a (mon.0) 494 : cluster [INF] osd.6 [v2:172.21.2.145:6816/1837937910,v1:172.21.2.145:6817/1837937910] boot 2021-03-10T13:53:39.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:39 gibba015 bash[29377]: cluster 2021-03-10T13:53:38.683716+0000 mon.a (mon.0) 495 : cluster [DBG] osdmap e96: 8 total, 8 up, 8 in 2021-03-10T13:53:39.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:39 gibba015 bash[29377]: audit 2021-03-10T13:53:38.684416+0000 mon.c (mon.1) 141 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T13:53:39.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:39 gibba015 bash[30343]: cluster 2021-03-10T13:53:38.672471+0000 mon.a (mon.0) 493 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T13:53:39.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:39 gibba015 bash[30343]: cluster 2021-03-10T13:53:38.683677+0000 mon.a (mon.0) 494 : cluster [INF] osd.6 [v2:172.21.2.145:6816/1837937910,v1:172.21.2.145:6817/1837937910] boot 2021-03-10T13:53:39.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:39 gibba015 bash[30343]: cluster 2021-03-10T13:53:38.683716+0000 mon.a (mon.0) 495 : cluster [DBG] osdmap e96: 8 total, 8 up, 8 in 2021-03-10T13:53:39.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:39 gibba015 bash[30343]: audit 2021-03-10T13:53:38.684416+0000 mon.c (mon.1) 141 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T13:53:40.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:39 gibba045 bash[25517]: cluster 2021-03-10T13:53:38.672471+0000 mon.a (mon.0) 493 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T13:53:40.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:39 gibba045 bash[25517]: cluster 2021-03-10T13:53:38.683677+0000 mon.a (mon.0) 494 : cluster [INF] osd.6 [v2:172.21.2.145:6816/1837937910,v1:172.21.2.145:6817/1837937910] boot 2021-03-10T13:53:40.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:39 gibba045 bash[25517]: cluster 2021-03-10T13:53:38.683716+0000 mon.a (mon.0) 495 : cluster [DBG] osdmap e96: 8 total, 8 up, 8 in 2021-03-10T13:53:40.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:39 gibba045 bash[25517]: audit 2021-03-10T13:53:38.684416+0000 mon.c (mon.1) 141 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T13:53:40.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:40 gibba015 bash[29377]: cluster 2021-03-10T13:53:39.089087+0000 mgr.gibba045.orlgmj (mgr.34412) 298 : cluster [DBG] pgmap v151: 129 pgs: 15 active+undersized+degraded, 28 active+undersized, 86 active+clean; 7.0 KiB data, 46 MiB used, 671 GiB / 672 GiB avail; 21/192 objects degraded (10.938%) 2021-03-10T13:53:40.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:40 gibba015 bash[29377]: cluster 2021-03-10T13:53:39.686859+0000 mon.a (mon.0) 496 : cluster [DBG] osdmap e97: 8 total, 8 up, 8 in 2021-03-10T13:53:40.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:40 gibba015 bash[30343]: cluster 2021-03-10T13:53:39.089087+0000 mgr.gibba045.orlgmj (mgr.34412) 298 : cluster [DBG] pgmap v151: 129 pgs: 15 active+undersized+degraded, 28 active+undersized, 86 active+clean; 7.0 KiB data, 46 MiB used, 671 GiB / 672 GiB avail; 21/192 objects degraded (10.938%) 2021-03-10T13:53:40.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:40 gibba015 bash[30343]: cluster 2021-03-10T13:53:39.686859+0000 mon.a (mon.0) 496 : cluster [DBG] osdmap e97: 8 total, 8 up, 8 in 2021-03-10T13:53:41.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:40 gibba045 bash[25517]: cluster 2021-03-10T13:53:39.089087+0000 mgr.gibba045.orlgmj (mgr.34412) 298 : cluster [DBG] pgmap v151: 129 pgs: 15 active+undersized+degraded, 28 active+undersized, 86 active+clean; 7.0 KiB data, 46 MiB used, 671 GiB / 672 GiB avail; 21/192 objects degraded (10.938%) 2021-03-10T13:53:41.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:40 gibba045 bash[25517]: cluster 2021-03-10T13:53:39.686859+0000 mon.a (mon.0) 496 : cluster [DBG] osdmap e97: 8 total, 8 up, 8 in 2021-03-10T13:53:41.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:41 gibba015 bash[29377]: cluster 2021-03-10T13:53:41.403072+0000 mon.a (mon.0) 497 : cluster [WRN] Health check update: Degraded data redundancy: 21/192 objects degraded (10.938%), 15 pgs degraded (PG_DEGRADED) 2021-03-10T13:53:41.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:41 gibba015 bash[30343]: cluster 2021-03-10T13:53:41.403072+0000 mon.a (mon.0) 497 : cluster [WRN] Health check update: Degraded data redundancy: 21/192 objects degraded (10.938%), 15 pgs degraded (PG_DEGRADED) 2021-03-10T13:53:42.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:41 gibba045 bash[25517]: cluster 2021-03-10T13:53:41.403072+0000 mon.a (mon.0) 497 : cluster [WRN] Health check update: Degraded data redundancy: 21/192 objects degraded (10.938%), 15 pgs degraded (PG_DEGRADED) 2021-03-10T13:53:42.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:42 gibba015 bash[29377]: cluster 2021-03-10T13:53:41.090605+0000 mgr.gibba045.orlgmj (mgr.34412) 299 : cluster [DBG] pgmap v153: 129 pgs: 3 peering, 11 active+undersized+degraded, 21 active+undersized, 94 active+clean; 7.0 KiB data, 46 MiB used, 671 GiB / 672 GiB avail; 13/192 objects degraded (6.771%) 2021-03-10T13:53:42.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:42 gibba015 bash[30343]: cluster 2021-03-10T13:53:41.090605+0000 mgr.gibba045.orlgmj (mgr.34412) 299 : cluster [DBG] pgmap v153: 129 pgs: 3 peering, 11 active+undersized+degraded, 21 active+undersized, 94 active+clean; 7.0 KiB data, 46 MiB used, 671 GiB / 672 GiB avail; 13/192 objects degraded (6.771%) 2021-03-10T13:53:43.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:42 gibba045 bash[25517]: cluster 2021-03-10T13:53:41.090605+0000 mgr.gibba045.orlgmj (mgr.34412) 299 : cluster [DBG] pgmap v153: 129 pgs: 3 peering, 11 active+undersized+degraded, 21 active+undersized, 94 active+clean; 7.0 KiB data, 46 MiB used, 671 GiB / 672 GiB avail; 13/192 objects degraded (6.771%) 2021-03-10T13:53:44.264 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T13:53:44.490 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T13:53:44.490 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (4m) 87s ago 9m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T13:53:44.491 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (9m) 8s ago 9m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T13:53:44.491 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (4m) 8s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T13:53:44.491 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (5m) 8s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T13:53:44.491 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (4m) 87s ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T13:53:44.491 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3m) 87s ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T13:53:44.492 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3m) 8s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T13:53:44.492 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3m) 87s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T13:53:44.492 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (9m) 87s ago 10m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T13:53:44.492 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (9m) 8s ago 10m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T13:53:44.492 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2m) 87s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T13:53:44.493 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2m) 87s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T13:53:44.493 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (114s) 87s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T13:53:44.493 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (88s) 87s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T13:53:44.493 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (64s) 8s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T13:53:44.493 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (38s) 8s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T13:53:44.494 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (12s) 8s ago 10m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T13:53:44.494 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (10m) 8s ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 784edc0668a4 2021-03-10T13:53:44.494 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (9m) 8s ago 10m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T13:53:44.494 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 8s ago 7m docker.io/ceph/ceph:v15.2.0 2021-03-10T13:53:44.742 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T13:53:44.743 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T13:53:44.743 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:53:44.743 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T13:53:44.743 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T13:53:44.744 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:53:44.744 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T13:53:44.744 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T13:53:44.744 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 1, 2021-03-10T13:53:44.744 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 7 2021-03-10T13:53:44.745 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T13:53:44.745 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T13:53:44.745 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T13:53:44.745 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 1, 2021-03-10T13:53:44.745 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 13 2021-03-10T13:53:44.746 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T13:53:44.746 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T13:53:44.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:44 gibba015 bash[29377]: cluster 2021-03-10T13:53:43.092214+0000 mgr.gibba045.orlgmj (mgr.34412) 300 : cluster [DBG] pgmap v154: 129 pgs: 13 active+clean+wait, 3 peering, 3 active+undersized+degraded, 4 active+undersized, 106 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail; 3/192 objects degraded (1.562%) 2021-03-10T13:53:44.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:44 gibba015 bash[30343]: cluster 2021-03-10T13:53:43.092214+0000 mgr.gibba045.orlgmj (mgr.34412) 300 : cluster [DBG] pgmap v154: 129 pgs: 13 active+clean+wait, 3 peering, 3 active+undersized+degraded, 4 active+undersized, 106 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail; 3/192 objects degraded (1.562%) 2021-03-10T13:53:45.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:44 gibba045 bash[25517]: cluster 2021-03-10T13:53:43.092214+0000 mgr.gibba045.orlgmj (mgr.34412) 300 : cluster [DBG] pgmap v154: 129 pgs: 13 active+clean+wait, 3 peering, 3 active+undersized+degraded, 4 active+undersized, 106 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail; 3/192 objects degraded (1.562%) 2021-03-10T13:53:46.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:45 gibba045 bash[25517]: audit 2021-03-10T13:53:44.254394+0000 mgr.gibba045.orlgmj (mgr.34412) 301 : audit [DBG] from='client.54253 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:53:46.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:45 gibba045 bash[25517]: audit 2021-03-10T13:53:44.477084+0000 mgr.gibba045.orlgmj (mgr.34412) 302 : audit [DBG] from='client.54259 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:53:46.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:45 gibba045 bash[25517]: audit 2021-03-10T13:53:44.740566+0000 mon.a (mon.0) 498 : audit [DBG] from='client.? 172.21.2.115:0/2982551851' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:53:46.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:45 gibba015 bash[29377]: audit 2021-03-10T13:53:44.254394+0000 mgr.gibba045.orlgmj (mgr.34412) 301 : audit [DBG] from='client.54253 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:53:46.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:45 gibba015 bash[29377]: audit 2021-03-10T13:53:44.477084+0000 mgr.gibba045.orlgmj (mgr.34412) 302 : audit [DBG] from='client.54259 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:53:46.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:45 gibba015 bash[29377]: audit 2021-03-10T13:53:44.740566+0000 mon.a (mon.0) 498 : audit [DBG] from='client.? 172.21.2.115:0/2982551851' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:53:46.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:45 gibba015 bash[30343]: audit 2021-03-10T13:53:44.254394+0000 mgr.gibba045.orlgmj (mgr.34412) 301 : audit [DBG] from='client.54253 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:53:46.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:45 gibba015 bash[30343]: audit 2021-03-10T13:53:44.477084+0000 mgr.gibba045.orlgmj (mgr.34412) 302 : audit [DBG] from='client.54259 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:53:46.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:45 gibba015 bash[30343]: audit 2021-03-10T13:53:44.740566+0000 mon.a (mon.0) 498 : audit [DBG] from='client.? 172.21.2.115:0/2982551851' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:53:47.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:46 gibba045 bash[25517]: cluster 2021-03-10T13:53:45.093814+0000 mgr.gibba045.orlgmj (mgr.34412) 303 : cluster [DBG] pgmap v155: 129 pgs: 13 active+clean+wait, 116 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T13:53:47.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:46 gibba045 bash[25517]: cluster 2021-03-10T13:53:45.725027+0000 mon.a (mon.0) 499 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 3/192 objects degraded (1.562%), 3 pgs degraded) 2021-03-10T13:53:47.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:46 gibba015 bash[29377]: cluster 2021-03-10T13:53:45.093814+0000 mgr.gibba045.orlgmj (mgr.34412) 303 : cluster [DBG] pgmap v155: 129 pgs: 13 active+clean+wait, 116 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T13:53:47.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:46 gibba015 bash[29377]: cluster 2021-03-10T13:53:45.725027+0000 mon.a (mon.0) 499 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 3/192 objects degraded (1.562%), 3 pgs degraded) 2021-03-10T13:53:47.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:46 gibba015 bash[30343]: cluster 2021-03-10T13:53:45.093814+0000 mgr.gibba045.orlgmj (mgr.34412) 303 : cluster [DBG] pgmap v155: 129 pgs: 13 active+clean+wait, 116 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T13:53:47.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:46 gibba015 bash[30343]: cluster 2021-03-10T13:53:45.725027+0000 mon.a (mon.0) 499 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 3/192 objects degraded (1.562%), 3 pgs degraded) 2021-03-10T13:53:48.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:48 gibba015 bash[29377]: cluster 2021-03-10T13:53:47.095494+0000 mgr.gibba045.orlgmj (mgr.34412) 304 : cluster [DBG] pgmap v156: 129 pgs: 13 active+clean+wait, 116 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T13:53:48.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:48 gibba015 bash[29377]: audit 2021-03-10T13:53:47.560736+0000 mon.a (mon.0) 500 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:53:48.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:48 gibba015 bash[30343]: cluster 2021-03-10T13:53:47.095494+0000 mgr.gibba045.orlgmj (mgr.34412) 304 : cluster [DBG] pgmap v156: 129 pgs: 13 active+clean+wait, 116 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T13:53:48.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:48 gibba015 bash[30343]: audit 2021-03-10T13:53:47.560736+0000 mon.a (mon.0) 500 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:53:49.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:48 gibba045 bash[25517]: cluster 2021-03-10T13:53:47.095494+0000 mgr.gibba045.orlgmj (mgr.34412) 304 : cluster [DBG] pgmap v156: 129 pgs: 13 active+clean+wait, 116 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T13:53:49.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:48 gibba045 bash[25517]: audit 2021-03-10T13:53:47.560736+0000 mon.a (mon.0) 500 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:53:50.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:50 gibba015 bash[29377]: cluster 2021-03-10T13:53:49.096860+0000 mgr.gibba045.orlgmj (mgr.34412) 305 : cluster [DBG] pgmap v157: 129 pgs: 13 active+clean+wait, 116 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T13:53:50.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:50 gibba015 bash[30343]: cluster 2021-03-10T13:53:49.096860+0000 mgr.gibba045.orlgmj (mgr.34412) 305 : cluster [DBG] pgmap v157: 129 pgs: 13 active+clean+wait, 116 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T13:53:51.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:50 gibba045 bash[25517]: cluster 2021-03-10T13:53:49.096860+0000 mgr.gibba045.orlgmj (mgr.34412) 305 : cluster [DBG] pgmap v157: 129 pgs: 13 active+clean+wait, 116 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T13:53:51.870 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:51 gibba045 bash[25517]: audit 2021-03-10T13:53:50.912347+0000 mon.c (mon.1) 142 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2021-03-10T13:53:51.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:51 gibba015 bash[29377]: audit 2021-03-10T13:53:50.912347+0000 mon.c (mon.1) 142 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2021-03-10T13:53:51.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:51 gibba015 bash[30343]: audit 2021-03-10T13:53:50.912347+0000 mon.c (mon.1) 142 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2021-03-10T13:53:52.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:52 gibba015 bash[29377]: audit 2021-03-10T13:53:50.915278+0000 mgr.gibba045.orlgmj (mgr.34412) 306 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2021-03-10T13:53:52.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:52 gibba015 bash[29377]: cephadm 2021-03-10T13:53:50.919994+0000 mgr.gibba045.orlgmj (mgr.34412) 307 : cephadm [INF] Upgrade: osd.7 is safe to restart 2021-03-10T13:53:52.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:52 gibba015 bash[29377]: cluster 2021-03-10T13:53:51.097353+0000 mgr.gibba045.orlgmj (mgr.34412) 308 : cluster [DBG] pgmap v158: 129 pgs: 13 active+clean+wait, 116 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T13:53:52.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:52 gibba015 bash[29377]: audit 2021-03-10T13:53:52.372839+0000 mon.c (mon.1) 143 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T13:53:52.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:52 gibba015 bash[29377]: audit 2021-03-10T13:53:52.373600+0000 mon.c (mon.1) 144 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T13:53:52.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:52 gibba015 bash[29377]: audit 2021-03-10T13:53:52.374159+0000 mon.a (mon.0) 501 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T13:53:52.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:52 gibba015 bash[29377]: audit 2021-03-10T13:53:52.374552+0000 mon.c (mon.1) 145 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T13:53:52.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:52 gibba015 bash[29377]: audit 2021-03-10T13:53:52.375840+0000 mon.c (mon.1) 146 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T13:53:52.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:52 gibba015 bash[29377]: audit 2021-03-10T13:53:52.375950+0000 mon.a (mon.0) 502 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T13:53:52.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:52 gibba015 bash[29377]: audit 2021-03-10T13:53:52.377527+0000 mon.a (mon.0) 503 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T13:53:52.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:52 gibba015 bash[29377]: audit 2021-03-10T13:53:52.378431+0000 mon.a (mon.0) 504 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T13:53:52.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:52 gibba015 bash[29377]: audit 2021-03-10T13:53:52.483210+0000 mon.c (mon.1) 147 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:53:52.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:52 gibba015 bash[29377]: audit 2021-03-10T13:53:52.483830+0000 mon.c (mon.1) 148 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T13:53:52.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:52 gibba015 bash[29377]: audit 2021-03-10T13:53:52.484466+0000 mon.a (mon.0) 505 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:53:52.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:52 gibba015 bash[29377]: audit 2021-03-10T13:53:52.485717+0000 mon.a (mon.0) 506 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T13:53:52.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:52 gibba015 bash[29377]: audit 2021-03-10T13:53:52.568327+0000 mon.a (mon.0) 507 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:53:52.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:52 gibba015 bash[29377]: audit 2021-03-10T13:53:52.570556+0000 mon.c (mon.1) 149 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd.7","key": "container_image"}]: dispatch 2021-03-10T13:53:52.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:52 gibba015 bash[30343]: audit 2021-03-10T13:53:50.915278+0000 mgr.gibba045.orlgmj (mgr.34412) 306 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2021-03-10T13:53:52.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:52 gibba015 bash[30343]: cephadm 2021-03-10T13:53:50.919994+0000 mgr.gibba045.orlgmj (mgr.34412) 307 : cephadm [INF] Upgrade: osd.7 is safe to restart 2021-03-10T13:53:52.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:52 gibba015 bash[30343]: cluster 2021-03-10T13:53:51.097353+0000 mgr.gibba045.orlgmj (mgr.34412) 308 : cluster [DBG] pgmap v158: 129 pgs: 13 active+clean+wait, 116 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T13:53:52.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:52 gibba015 bash[30343]: audit 2021-03-10T13:53:52.372839+0000 mon.c (mon.1) 143 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T13:53:52.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:52 gibba015 bash[30343]: audit 2021-03-10T13:53:52.373600+0000 mon.c (mon.1) 144 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T13:53:52.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:52 gibba015 bash[30343]: audit 2021-03-10T13:53:52.374159+0000 mon.a (mon.0) 501 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T13:53:52.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:52 gibba015 bash[30343]: audit 2021-03-10T13:53:52.374552+0000 mon.c (mon.1) 145 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T13:53:52.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:52 gibba015 bash[30343]: audit 2021-03-10T13:53:52.375840+0000 mon.c (mon.1) 146 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T13:53:52.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:52 gibba015 bash[30343]: audit 2021-03-10T13:53:52.375950+0000 mon.a (mon.0) 502 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T13:53:52.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:52 gibba015 bash[30343]: audit 2021-03-10T13:53:52.377527+0000 mon.a (mon.0) 503 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T13:53:52.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:52 gibba015 bash[30343]: audit 2021-03-10T13:53:52.378431+0000 mon.a (mon.0) 504 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T13:53:52.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:52 gibba015 bash[30343]: audit 2021-03-10T13:53:52.483210+0000 mon.c (mon.1) 147 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:53:52.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:52 gibba015 bash[30343]: audit 2021-03-10T13:53:52.483830+0000 mon.c (mon.1) 148 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T13:53:52.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:52 gibba015 bash[30343]: audit 2021-03-10T13:53:52.484466+0000 mon.a (mon.0) 505 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:53:52.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:52 gibba015 bash[30343]: audit 2021-03-10T13:53:52.485717+0000 mon.a (mon.0) 506 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T13:53:52.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:52 gibba015 bash[30343]: audit 2021-03-10T13:53:52.568327+0000 mon.a (mon.0) 507 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:53:52.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:52 gibba015 bash[30343]: audit 2021-03-10T13:53:52.570556+0000 mon.c (mon.1) 149 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd.7","key": "container_image"}]: dispatch 2021-03-10T13:53:53.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:52 gibba045 bash[25517]: audit 2021-03-10T13:53:50.915278+0000 mgr.gibba045.orlgmj (mgr.34412) 306 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2021-03-10T13:53:53.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:52 gibba045 bash[25517]: cephadm 2021-03-10T13:53:50.919994+0000 mgr.gibba045.orlgmj (mgr.34412) 307 : cephadm [INF] Upgrade: osd.7 is safe to restart 2021-03-10T13:53:53.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:52 gibba045 bash[25517]: cluster 2021-03-10T13:53:51.097353+0000 mgr.gibba045.orlgmj (mgr.34412) 308 : cluster [DBG] pgmap v158: 129 pgs: 13 active+clean+wait, 116 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T13:53:53.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:52 gibba045 bash[25517]: audit 2021-03-10T13:53:52.372839+0000 mon.c (mon.1) 143 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T13:53:53.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:52 gibba045 bash[25517]: audit 2021-03-10T13:53:52.373600+0000 mon.c (mon.1) 144 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T13:53:53.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:52 gibba045 bash[25517]: audit 2021-03-10T13:53:52.374159+0000 mon.a (mon.0) 501 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T13:53:53.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:52 gibba045 bash[25517]: audit 2021-03-10T13:53:52.374552+0000 mon.c (mon.1) 145 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T13:53:53.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:52 gibba045 bash[25517]: audit 2021-03-10T13:53:52.375840+0000 mon.c (mon.1) 146 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T13:53:53.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:52 gibba045 bash[25517]: audit 2021-03-10T13:53:52.375950+0000 mon.a (mon.0) 502 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T13:53:53.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:52 gibba045 bash[25517]: audit 2021-03-10T13:53:52.377527+0000 mon.a (mon.0) 503 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T13:53:53.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:52 gibba045 bash[25517]: audit 2021-03-10T13:53:52.378431+0000 mon.a (mon.0) 504 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T13:53:53.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:52 gibba045 bash[25517]: audit 2021-03-10T13:53:52.483210+0000 mon.c (mon.1) 147 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:53:53.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:52 gibba045 bash[25517]: audit 2021-03-10T13:53:52.483830+0000 mon.c (mon.1) 148 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T13:53:53.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:52 gibba045 bash[25517]: audit 2021-03-10T13:53:52.484466+0000 mon.a (mon.0) 505 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:53:53.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:52 gibba045 bash[25517]: audit 2021-03-10T13:53:52.485717+0000 mon.a (mon.0) 506 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T13:53:53.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:52 gibba045 bash[25517]: audit 2021-03-10T13:53:52.568327+0000 mon.a (mon.0) 507 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:53:53.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:52 gibba045 bash[25517]: audit 2021-03-10T13:53:52.570556+0000 mon.c (mon.1) 149 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd.7","key": "container_image"}]: dispatch 2021-03-10T13:53:53.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:53 gibba015 bash[30343]: cephadm 2021-03-10T13:53:52.559132+0000 mgr.gibba045.orlgmj (mgr.34412) 309 : cephadm [INF] Upgrade: Updating osd.7 2021-03-10T13:53:53.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:53 gibba015 bash[30343]: cephadm 2021-03-10T13:53:52.572111+0000 mgr.gibba045.orlgmj (mgr.34412) 310 : cephadm [INF] Deploying daemon osd.7 on gibba045 2021-03-10T13:53:53.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:53 gibba015 bash[29377]: cephadm 2021-03-10T13:53:52.559132+0000 mgr.gibba045.orlgmj (mgr.34412) 309 : cephadm [INF] Upgrade: Updating osd.7 2021-03-10T13:53:53.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:53 gibba015 bash[29377]: cephadm 2021-03-10T13:53:52.572111+0000 mgr.gibba045.orlgmj (mgr.34412) 310 : cephadm [INF] Deploying daemon osd.7 on gibba045 2021-03-10T13:53:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:53 gibba045 bash[25517]: cephadm 2021-03-10T13:53:52.559132+0000 mgr.gibba045.orlgmj (mgr.34412) 309 : cephadm [INF] Upgrade: Updating osd.7 2021-03-10T13:53:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:53 gibba045 bash[25517]: cephadm 2021-03-10T13:53:52.572111+0000 mgr.gibba045.orlgmj (mgr.34412) 310 : cephadm [INF] Deploying daemon osd.7 on gibba045 2021-03-10T13:53:54.556 INFO:journalctl@ceph.osd.7.gibba045.stdout:Mar 10 13:53:54 gibba045 systemd[1]: Stopping Ceph osd.7 for e4a642d2-81a5-11eb-9080-001a4aab830c... 2021-03-10T13:53:54.556 INFO:journalctl@ceph.osd.7.gibba045.stdout:Mar 10 13:53:54 gibba045 bash[16684]: debug 2021-03-10T13:53:54.483+0000 7f4818c87700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2021-03-10T13:53:54.557 INFO:journalctl@ceph.osd.7.gibba045.stdout:Mar 10 13:53:54 gibba045 bash[16684]: debug 2021-03-10T13:53:54.483+0000 7f4818c87700 -1 osd.7 97 *** Got signal Terminated *** 2021-03-10T13:53:54.557 INFO:journalctl@ceph.osd.7.gibba045.stdout:Mar 10 13:53:54 gibba045 bash[16684]: debug 2021-03-10T13:53:54.483+0000 7f4818c87700 -1 osd.7 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-03-10T13:53:54.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:54 gibba015 bash[29377]: cluster 2021-03-10T13:53:53.097879+0000 mgr.gibba045.orlgmj (mgr.34412) 311 : cluster [DBG] pgmap v159: 129 pgs: 13 active+clean+wait, 116 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T13:53:54.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:54 gibba015 bash[30343]: cluster 2021-03-10T13:53:53.097879+0000 mgr.gibba045.orlgmj (mgr.34412) 311 : cluster [DBG] pgmap v159: 129 pgs: 13 active+clean+wait, 116 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T13:53:55.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:54 gibba045 bash[25517]: cluster 2021-03-10T13:53:53.097879+0000 mgr.gibba045.orlgmj (mgr.34412) 311 : cluster [DBG] pgmap v159: 129 pgs: 13 active+clean+wait, 116 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T13:53:55.557 INFO:journalctl@ceph.osd.7.gibba045.stdout:Mar 10 13:53:55 gibba045 docker[30722]: ceph-e4a642d2-81a5-11eb-9080-001a4aab830c-osd.7 2021-03-10T13:53:55.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:55 gibba015 bash[29377]: cluster 2021-03-10T13:53:54.767692+0000 mon.a (mon.0) 508 : cluster [DBG] osd.7 reported immediately failed by osd.5 2021-03-10T13:53:55.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:55 gibba015 bash[29377]: cluster 2021-03-10T13:53:54.767842+0000 mon.a (mon.0) 509 : cluster [INF] osd.7 failed (root=default,host=gibba045) (connection refused reported by osd.5) 2021-03-10T13:53:55.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:55 gibba015 bash[29377]: cluster 2021-03-10T13:53:54.768893+0000 mon.a (mon.0) 510 : cluster [DBG] osd.7 reported immediately failed by osd.2 2021-03-10T13:53:55.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:55 gibba015 bash[29377]: cluster 2021-03-10T13:53:54.769308+0000 mon.a (mon.0) 511 : cluster [DBG] osd.7 reported immediately failed by osd.6 2021-03-10T13:53:55.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:55 gibba015 bash[29377]: cluster 2021-03-10T13:53:54.769942+0000 mon.a (mon.0) 512 : cluster [DBG] osd.7 reported immediately failed by osd.0 2021-03-10T13:53:55.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:55 gibba015 bash[29377]: cluster 2021-03-10T13:53:54.770242+0000 mon.a (mon.0) 513 : cluster [DBG] osd.7 reported immediately failed by osd.4 2021-03-10T13:53:55.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:55 gibba015 bash[29377]: cluster 2021-03-10T13:53:54.770820+0000 mon.a (mon.0) 514 : cluster [DBG] osd.7 reported immediately failed by osd.1 2021-03-10T13:53:55.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:55 gibba015 bash[29377]: cluster 2021-03-10T13:53:54.771386+0000 mon.a (mon.0) 515 : cluster [DBG] osd.7 reported immediately failed by osd.5 2021-03-10T13:53:55.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:55 gibba015 bash[29377]: cluster 2021-03-10T13:53:54.771590+0000 mon.a (mon.0) 516 : cluster [DBG] osd.7 reported immediately failed by osd.2 2021-03-10T13:53:55.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:55 gibba015 bash[29377]: cluster 2021-03-10T13:53:54.771705+0000 mon.a (mon.0) 517 : cluster [DBG] osd.7 reported immediately failed by osd.6 2021-03-10T13:53:55.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:55 gibba015 bash[29377]: cluster 2021-03-10T13:53:54.771756+0000 mon.a (mon.0) 518 : cluster [DBG] osd.7 reported immediately failed by osd.3 2021-03-10T13:53:55.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:55 gibba015 bash[29377]: cluster 2021-03-10T13:53:54.771874+0000 mon.a (mon.0) 519 : cluster [DBG] osd.7 reported immediately failed by osd.4 2021-03-10T13:53:55.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:55 gibba015 bash[29377]: cluster 2021-03-10T13:53:54.771926+0000 mon.a (mon.0) 520 : cluster [DBG] osd.7 reported immediately failed by osd.0 2021-03-10T13:53:55.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:55 gibba015 bash[29377]: cluster 2021-03-10T13:53:54.772033+0000 mon.a (mon.0) 521 : cluster [DBG] osd.7 reported immediately failed by osd.1 2021-03-10T13:53:55.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:55 gibba015 bash[29377]: cluster 2021-03-10T13:53:54.772158+0000 mon.a (mon.0) 522 : cluster [DBG] osd.7 reported immediately failed by osd.3 2021-03-10T13:53:55.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:55 gibba015 bash[29377]: cluster 2021-03-10T13:53:55.167597+0000 mon.a (mon.0) 523 : cluster [DBG] osd.7 reported immediately failed by osd.5 2021-03-10T13:53:55.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:55 gibba015 bash[29377]: cluster 2021-03-10T13:53:55.168270+0000 mon.a (mon.0) 524 : cluster [DBG] osd.7 reported immediately failed by osd.6 2021-03-10T13:53:55.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:55 gibba015 bash[29377]: cluster 2021-03-10T13:53:55.168567+0000 mon.a (mon.0) 525 : cluster [DBG] osd.7 reported immediately failed by osd.5 2021-03-10T13:53:55.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:55 gibba015 bash[29377]: cluster 2021-03-10T13:53:55.169130+0000 mon.a (mon.0) 526 : cluster [DBG] osd.7 reported immediately failed by osd.4 2021-03-10T13:53:55.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:55 gibba015 bash[29377]: cluster 2021-03-10T13:53:55.169437+0000 mon.a (mon.0) 527 : cluster [DBG] osd.7 reported immediately failed by osd.1 2021-03-10T13:53:55.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:55 gibba015 bash[29377]: cluster 2021-03-10T13:53:55.169944+0000 mon.a (mon.0) 528 : cluster [DBG] osd.7 reported immediately failed by osd.6 2021-03-10T13:53:55.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:55 gibba015 bash[29377]: cluster 2021-03-10T13:53:55.170238+0000 mon.a (mon.0) 529 : cluster [DBG] osd.7 reported immediately failed by osd.1 2021-03-10T13:53:55.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:55 gibba015 bash[29377]: cluster 2021-03-10T13:53:55.170746+0000 mon.a (mon.0) 530 : cluster [DBG] osd.7 reported immediately failed by osd.4 2021-03-10T13:53:55.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:55 gibba015 bash[29377]: cluster 2021-03-10T13:53:55.171029+0000 mon.a (mon.0) 531 : cluster [DBG] osd.7 reported immediately failed by osd.2 2021-03-10T13:53:55.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:55 gibba015 bash[29377]: cluster 2021-03-10T13:53:55.171549+0000 mon.a (mon.0) 532 : cluster [DBG] osd.7 reported immediately failed by osd.3 2021-03-10T13:53:55.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:55 gibba015 bash[29377]: cluster 2021-03-10T13:53:55.171829+0000 mon.a (mon.0) 533 : cluster [DBG] osd.7 reported immediately failed by osd.0 2021-03-10T13:53:55.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:55 gibba015 bash[30343]: cluster 2021-03-10T13:53:54.767692+0000 mon.a (mon.0) 508 : cluster [DBG] osd.7 reported immediately failed by osd.5 2021-03-10T13:53:55.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:55 gibba015 bash[30343]: cluster 2021-03-10T13:53:54.767842+0000 mon.a (mon.0) 509 : cluster [INF] osd.7 failed (root=default,host=gibba045) (connection refused reported by osd.5) 2021-03-10T13:53:55.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:55 gibba015 bash[30343]: cluster 2021-03-10T13:53:54.768893+0000 mon.a (mon.0) 510 : cluster [DBG] osd.7 reported immediately failed by osd.2 2021-03-10T13:53:55.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:55 gibba015 bash[30343]: cluster 2021-03-10T13:53:54.769308+0000 mon.a (mon.0) 511 : cluster [DBG] osd.7 reported immediately failed by osd.6 2021-03-10T13:53:55.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:55 gibba015 bash[30343]: cluster 2021-03-10T13:53:54.769942+0000 mon.a (mon.0) 512 : cluster [DBG] osd.7 reported immediately failed by osd.0 2021-03-10T13:53:55.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:55 gibba015 bash[30343]: cluster 2021-03-10T13:53:54.770242+0000 mon.a (mon.0) 513 : cluster [DBG] osd.7 reported immediately failed by osd.4 2021-03-10T13:53:55.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:55 gibba015 bash[30343]: cluster 2021-03-10T13:53:54.770820+0000 mon.a (mon.0) 514 : cluster [DBG] osd.7 reported immediately failed by osd.1 2021-03-10T13:53:55.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:55 gibba015 bash[30343]: cluster 2021-03-10T13:53:54.771386+0000 mon.a (mon.0) 515 : cluster [DBG] osd.7 reported immediately failed by osd.5 2021-03-10T13:53:55.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:55 gibba015 bash[30343]: cluster 2021-03-10T13:53:54.771590+0000 mon.a (mon.0) 516 : cluster [DBG] osd.7 reported immediately failed by osd.2 2021-03-10T13:53:55.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:55 gibba015 bash[30343]: cluster 2021-03-10T13:53:54.771705+0000 mon.a (mon.0) 517 : cluster [DBG] osd.7 reported immediately failed by osd.6 2021-03-10T13:53:55.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:55 gibba015 bash[30343]: cluster 2021-03-10T13:53:54.771756+0000 mon.a (mon.0) 518 : cluster [DBG] osd.7 reported immediately failed by osd.3 2021-03-10T13:53:55.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:55 gibba015 bash[30343]: cluster 2021-03-10T13:53:54.771874+0000 mon.a (mon.0) 519 : cluster [DBG] osd.7 reported immediately failed by osd.4 2021-03-10T13:53:55.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:55 gibba015 bash[30343]: cluster 2021-03-10T13:53:54.771926+0000 mon.a (mon.0) 520 : cluster [DBG] osd.7 reported immediately failed by osd.0 2021-03-10T13:53:55.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:55 gibba015 bash[30343]: cluster 2021-03-10T13:53:54.772033+0000 mon.a (mon.0) 521 : cluster [DBG] osd.7 reported immediately failed by osd.1 2021-03-10T13:53:55.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:55 gibba015 bash[30343]: cluster 2021-03-10T13:53:54.772158+0000 mon.a (mon.0) 522 : cluster [DBG] osd.7 reported immediately failed by osd.3 2021-03-10T13:53:55.984 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:55 gibba015 bash[30343]: cluster 2021-03-10T13:53:55.167597+0000 mon.a (mon.0) 523 : cluster [DBG] osd.7 reported immediately failed by osd.5 2021-03-10T13:53:55.984 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:55 gibba015 bash[30343]: cluster 2021-03-10T13:53:55.168270+0000 mon.a (mon.0) 524 : cluster [DBG] osd.7 reported immediately failed by osd.6 2021-03-10T13:53:55.984 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:55 gibba015 bash[30343]: cluster 2021-03-10T13:53:55.168567+0000 mon.a (mon.0) 525 : cluster [DBG] osd.7 reported immediately failed by osd.5 2021-03-10T13:53:55.984 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:55 gibba015 bash[30343]: cluster 2021-03-10T13:53:55.169130+0000 mon.a (mon.0) 526 : cluster [DBG] osd.7 reported immediately failed by osd.4 2021-03-10T13:53:55.984 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:55 gibba015 bash[30343]: cluster 2021-03-10T13:53:55.169437+0000 mon.a (mon.0) 527 : cluster [DBG] osd.7 reported immediately failed by osd.1 2021-03-10T13:53:55.985 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:55 gibba015 bash[30343]: cluster 2021-03-10T13:53:55.169944+0000 mon.a (mon.0) 528 : cluster [DBG] osd.7 reported immediately failed by osd.6 2021-03-10T13:53:55.985 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:55 gibba015 bash[30343]: cluster 2021-03-10T13:53:55.170238+0000 mon.a (mon.0) 529 : cluster [DBG] osd.7 reported immediately failed by osd.1 2021-03-10T13:53:55.985 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:55 gibba015 bash[30343]: cluster 2021-03-10T13:53:55.170746+0000 mon.a (mon.0) 530 : cluster [DBG] osd.7 reported immediately failed by osd.4 2021-03-10T13:53:55.985 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:55 gibba015 bash[30343]: cluster 2021-03-10T13:53:55.171029+0000 mon.a (mon.0) 531 : cluster [DBG] osd.7 reported immediately failed by osd.2 2021-03-10T13:53:55.986 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:55 gibba015 bash[30343]: cluster 2021-03-10T13:53:55.171549+0000 mon.a (mon.0) 532 : cluster [DBG] osd.7 reported immediately failed by osd.3 2021-03-10T13:53:55.986 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:55 gibba015 bash[30343]: cluster 2021-03-10T13:53:55.171829+0000 mon.a (mon.0) 533 : cluster [DBG] osd.7 reported immediately failed by osd.0 2021-03-10T13:53:55.986 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:55 gibba015 bash[29377]: cluster 2021-03-10T13:53:55.172391+0000 mon.a (mon.0) 534 : cluster [DBG] osd.7 reported immediately failed by osd.2 2021-03-10T13:53:55.986 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:55 gibba015 bash[29377]: cluster 2021-03-10T13:53:55.172543+0000 mon.a (mon.0) 535 : cluster [DBG] osd.7 reported immediately failed by osd.3 2021-03-10T13:53:55.987 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:55 gibba015 bash[29377]: cluster 2021-03-10T13:53:55.172672+0000 mon.a (mon.0) 536 : cluster [DBG] osd.7 reported immediately failed by osd.0 2021-03-10T13:53:55.987 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:55 gibba015 bash[30343]: cluster 2021-03-10T13:53:55.172391+0000 mon.a (mon.0) 534 : cluster [DBG] osd.7 reported immediately failed by osd.2 2021-03-10T13:53:55.987 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:55 gibba015 bash[30343]: cluster 2021-03-10T13:53:55.172543+0000 mon.a (mon.0) 535 : cluster [DBG] osd.7 reported immediately failed by osd.3 2021-03-10T13:53:55.988 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:55 gibba015 bash[30343]: cluster 2021-03-10T13:53:55.172672+0000 mon.a (mon.0) 536 : cluster [DBG] osd.7 reported immediately failed by osd.0 2021-03-10T13:53:56.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:55 gibba045 bash[25517]: cluster 2021-03-10T13:53:54.767692+0000 mon.a (mon.0) 508 : cluster [DBG] osd.7 reported immediately failed by osd.5 2021-03-10T13:53:56.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:55 gibba045 bash[25517]: cluster 2021-03-10T13:53:54.767842+0000 mon.a (mon.0) 509 : cluster [INF] osd.7 failed (root=default,host=gibba045) (connection refused reported by osd.5) 2021-03-10T13:53:56.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:55 gibba045 bash[25517]: cluster 2021-03-10T13:53:54.768893+0000 mon.a (mon.0) 510 : cluster [DBG] osd.7 reported immediately failed by osd.2 2021-03-10T13:53:56.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:55 gibba045 bash[25517]: cluster 2021-03-10T13:53:54.769308+0000 mon.a (mon.0) 511 : cluster [DBG] osd.7 reported immediately failed by osd.6 2021-03-10T13:53:56.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:55 gibba045 bash[25517]: cluster 2021-03-10T13:53:54.769942+0000 mon.a (mon.0) 512 : cluster [DBG] osd.7 reported immediately failed by osd.0 2021-03-10T13:53:56.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:55 gibba045 bash[25517]: cluster 2021-03-10T13:53:54.770242+0000 mon.a (mon.0) 513 : cluster [DBG] osd.7 reported immediately failed by osd.4 2021-03-10T13:53:56.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:55 gibba045 bash[25517]: cluster 2021-03-10T13:53:54.770820+0000 mon.a (mon.0) 514 : cluster [DBG] osd.7 reported immediately failed by osd.1 2021-03-10T13:53:56.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:55 gibba045 bash[25517]: cluster 2021-03-10T13:53:54.771386+0000 mon.a (mon.0) 515 : cluster [DBG] osd.7 reported immediately failed by osd.5 2021-03-10T13:53:56.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:55 gibba045 bash[25517]: cluster 2021-03-10T13:53:54.771590+0000 mon.a (mon.0) 516 : cluster [DBG] osd.7 reported immediately failed by osd.2 2021-03-10T13:53:56.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:55 gibba045 bash[25517]: cluster 2021-03-10T13:53:54.771705+0000 mon.a (mon.0) 517 : cluster [DBG] osd.7 reported immediately failed by osd.6 2021-03-10T13:53:56.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:55 gibba045 bash[25517]: cluster 2021-03-10T13:53:54.771756+0000 mon.a (mon.0) 518 : cluster [DBG] osd.7 reported immediately failed by osd.3 2021-03-10T13:53:56.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:55 gibba045 bash[25517]: cluster 2021-03-10T13:53:54.771874+0000 mon.a (mon.0) 519 : cluster [DBG] osd.7 reported immediately failed by osd.4 2021-03-10T13:53:56.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:55 gibba045 bash[25517]: cluster 2021-03-10T13:53:54.771926+0000 mon.a (mon.0) 520 : cluster [DBG] osd.7 reported immediately failed by osd.0 2021-03-10T13:53:56.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:55 gibba045 bash[25517]: cluster 2021-03-10T13:53:54.772033+0000 mon.a (mon.0) 521 : cluster [DBG] osd.7 reported immediately failed by osd.1 2021-03-10T13:53:56.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:55 gibba045 bash[25517]: cluster 2021-03-10T13:53:54.772158+0000 mon.a (mon.0) 522 : cluster [DBG] osd.7 reported immediately failed by osd.3 2021-03-10T13:53:56.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:55 gibba045 bash[25517]: cluster 2021-03-10T13:53:55.167597+0000 mon.a (mon.0) 523 : cluster [DBG] osd.7 reported immediately failed by osd.5 2021-03-10T13:53:56.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:55 gibba045 bash[25517]: cluster 2021-03-10T13:53:55.168270+0000 mon.a (mon.0) 524 : cluster [DBG] osd.7 reported immediately failed by osd.6 2021-03-10T13:53:56.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:55 gibba045 bash[25517]: cluster 2021-03-10T13:53:55.168567+0000 mon.a (mon.0) 525 : cluster [DBG] osd.7 reported immediately failed by osd.5 2021-03-10T13:53:56.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:55 gibba045 bash[25517]: cluster 2021-03-10T13:53:55.169130+0000 mon.a (mon.0) 526 : cluster [DBG] osd.7 reported immediately failed by osd.4 2021-03-10T13:53:56.062 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:55 gibba045 bash[25517]: cluster 2021-03-10T13:53:55.169437+0000 mon.a (mon.0) 527 : cluster [DBG] osd.7 reported immediately failed by osd.1 2021-03-10T13:53:56.062 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:55 gibba045 bash[25517]: cluster 2021-03-10T13:53:55.169944+0000 mon.a (mon.0) 528 : cluster [DBG] osd.7 reported immediately failed by osd.6 2021-03-10T13:53:56.062 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:55 gibba045 bash[25517]: cluster 2021-03-10T13:53:55.170238+0000 mon.a (mon.0) 529 : cluster [DBG] osd.7 reported immediately failed by osd.1 2021-03-10T13:53:56.062 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:55 gibba045 bash[25517]: cluster 2021-03-10T13:53:55.170746+0000 mon.a (mon.0) 530 : cluster [DBG] osd.7 reported immediately failed by osd.4 2021-03-10T13:53:56.063 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:55 gibba045 bash[25517]: cluster 2021-03-10T13:53:55.171029+0000 mon.a (mon.0) 531 : cluster [DBG] osd.7 reported immediately failed by osd.2 2021-03-10T13:53:56.063 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:55 gibba045 bash[25517]: cluster 2021-03-10T13:53:55.171549+0000 mon.a (mon.0) 532 : cluster [DBG] osd.7 reported immediately failed by osd.3 2021-03-10T13:53:56.063 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:55 gibba045 bash[25517]: cluster 2021-03-10T13:53:55.171829+0000 mon.a (mon.0) 533 : cluster [DBG] osd.7 reported immediately failed by osd.0 2021-03-10T13:53:56.063 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:55 gibba045 bash[25517]: cluster 2021-03-10T13:53:55.172391+0000 mon.a (mon.0) 534 : cluster [DBG] osd.7 reported immediately failed by osd.2 2021-03-10T13:53:56.063 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:55 gibba045 bash[25517]: cluster 2021-03-10T13:53:55.172543+0000 mon.a (mon.0) 535 : cluster [DBG] osd.7 reported immediately failed by osd.3 2021-03-10T13:53:56.064 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:55 gibba045 bash[25517]: cluster 2021-03-10T13:53:55.172672+0000 mon.a (mon.0) 536 : cluster [DBG] osd.7 reported immediately failed by osd.0 2021-03-10T13:53:56.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:56 gibba015 bash[29377]: cluster 2021-03-10T13:53:55.099283+0000 mgr.gibba045.orlgmj (mgr.34412) 312 : cluster [DBG] pgmap v160: 129 pgs: 13 active+clean+wait, 116 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T13:53:56.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:56 gibba015 bash[29377]: cluster 2021-03-10T13:53:55.601767+0000 mon.a (mon.0) 537 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T13:53:56.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:56 gibba015 bash[29377]: cluster 2021-03-10T13:53:55.612676+0000 mon.a (mon.0) 538 : cluster [DBG] osdmap e98: 8 total, 7 up, 8 in 2021-03-10T13:53:56.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:56 gibba015 bash[30343]: cluster 2021-03-10T13:53:55.099283+0000 mgr.gibba045.orlgmj (mgr.34412) 312 : cluster [DBG] pgmap v160: 129 pgs: 13 active+clean+wait, 116 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T13:53:56.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:56 gibba015 bash[30343]: cluster 2021-03-10T13:53:55.601767+0000 mon.a (mon.0) 537 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T13:53:56.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:56 gibba015 bash[30343]: cluster 2021-03-10T13:53:55.612676+0000 mon.a (mon.0) 538 : cluster [DBG] osdmap e98: 8 total, 7 up, 8 in 2021-03-10T13:53:57.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:56 gibba045 bash[25517]: cluster 2021-03-10T13:53:55.099283+0000 mgr.gibba045.orlgmj (mgr.34412) 312 : cluster [DBG] pgmap v160: 129 pgs: 13 active+clean+wait, 116 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T13:53:57.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:56 gibba045 bash[25517]: cluster 2021-03-10T13:53:55.601767+0000 mon.a (mon.0) 537 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T13:53:57.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:56 gibba045 bash[25517]: cluster 2021-03-10T13:53:55.612676+0000 mon.a (mon.0) 538 : cluster [DBG] osdmap e98: 8 total, 7 up, 8 in 2021-03-10T13:53:57.556 INFO:journalctl@ceph.osd.7.gibba045.stdout:Mar 10 13:53:57 gibba045 systemd[1]: ceph-e4a642d2-81a5-11eb-9080-001a4aab830c@osd.7.service: Succeeded. 2021-03-10T13:53:57.557 INFO:journalctl@ceph.osd.7.gibba045.stdout:Mar 10 13:53:57 gibba045 systemd[1]: Stopped Ceph osd.7 for e4a642d2-81a5-11eb-9080-001a4aab830c. 2021-03-10T13:53:57.557 INFO:journalctl@ceph.osd.7.gibba045.stdout:Mar 10 13:53:57 gibba045 systemd[1]: Started Ceph osd.7 for e4a642d2-81a5-11eb-9080-001a4aab830c. 2021-03-10T13:53:57.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:57 gibba015 bash[30343]: cluster 2021-03-10T13:53:56.620758+0000 mon.a (mon.0) 539 : cluster [DBG] osdmap e99: 8 total, 7 up, 8 in 2021-03-10T13:53:57.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:57 gibba015 bash[30343]: audit 2021-03-10T13:53:57.312703+0000 mon.a (mon.0) 540 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:53:57.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:57 gibba015 bash[30343]: audit 2021-03-10T13:53:57.313990+0000 mon.c (mon.1) 150 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:53:57.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:57 gibba015 bash[30343]: audit 2021-03-10T13:53:57.315512+0000 mon.c (mon.1) 151 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:53:57.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:57 gibba015 bash[29377]: cluster 2021-03-10T13:53:56.620758+0000 mon.a (mon.0) 539 : cluster [DBG] osdmap e99: 8 total, 7 up, 8 in 2021-03-10T13:53:57.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:57 gibba015 bash[29377]: audit 2021-03-10T13:53:57.312703+0000 mon.a (mon.0) 540 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:53:57.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:57 gibba015 bash[29377]: audit 2021-03-10T13:53:57.313990+0000 mon.c (mon.1) 150 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:53:57.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:57 gibba015 bash[29377]: audit 2021-03-10T13:53:57.315512+0000 mon.c (mon.1) 151 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:53:58.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:57 gibba045 bash[25517]: cluster 2021-03-10T13:53:56.620758+0000 mon.a (mon.0) 539 : cluster [DBG] osdmap e99: 8 total, 7 up, 8 in 2021-03-10T13:53:58.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:57 gibba045 bash[25517]: audit 2021-03-10T13:53:57.312703+0000 mon.a (mon.0) 540 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:53:58.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:57 gibba045 bash[25517]: audit 2021-03-10T13:53:57.313990+0000 mon.c (mon.1) 150 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:53:58.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:57 gibba045 bash[25517]: audit 2021-03-10T13:53:57.315512+0000 mon.c (mon.1) 151 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:53:58.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:58 gibba045 bash[25517]: cluster 2021-03-10T13:53:57.100553+0000 mgr.gibba045.orlgmj (mgr.34412) 313 : cluster [DBG] pgmap v163: 129 pgs: 7 stale+active+clean, 30 peering, 13 active+clean+wait, 79 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T13:53:58.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:58 gibba045 bash[25517]: cluster 2021-03-10T13:53:57.625965+0000 mon.a (mon.0) 541 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 8 pgs peering (PG_AVAILABILITY) 2021-03-10T13:53:58.806 INFO:journalctl@ceph.osd.7.gibba045.stdout:Mar 10 13:53:58 gibba045 bash[30903]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2021-03-10T13:53:58.807 INFO:journalctl@ceph.osd.7.gibba045.stdout:Mar 10 13:53:58 gibba045 bash[30903]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_1 --path /var/lib/ceph/osd/ceph-7 --no-mon-config 2021-03-10T13:53:58.807 INFO:journalctl@ceph.osd.7.gibba045.stdout:Mar 10 13:53:58 gibba045 bash[30903]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-7/block 2021-03-10T13:53:58.807 INFO:journalctl@ceph.osd.7.gibba045.stdout:Mar 10 13:53:58 gibba045 bash[30903]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-7/block 2021-03-10T13:53:58.807 INFO:journalctl@ceph.osd.7.gibba045.stdout:Mar 10 13:53:58 gibba045 bash[30903]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2021-03-10T13:53:58.808 INFO:journalctl@ceph.osd.7.gibba045.stdout:Mar 10 13:53:58 gibba045 bash[30903]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2021-03-10T13:53:58.808 INFO:journalctl@ceph.osd.7.gibba045.stdout:Mar 10 13:53:58 gibba045 bash[30903]: --> ceph-volume lvm activate successful for osd ID: 7 2021-03-10T13:53:58.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:58 gibba015 bash[29377]: cluster 2021-03-10T13:53:57.100553+0000 mgr.gibba045.orlgmj (mgr.34412) 313 : cluster [DBG] pgmap v163: 129 pgs: 7 stale+active+clean, 30 peering, 13 active+clean+wait, 79 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T13:53:58.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:58 gibba015 bash[29377]: cluster 2021-03-10T13:53:57.625965+0000 mon.a (mon.0) 541 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 8 pgs peering (PG_AVAILABILITY) 2021-03-10T13:53:58.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:58 gibba015 bash[30343]: cluster 2021-03-10T13:53:57.100553+0000 mgr.gibba045.orlgmj (mgr.34412) 313 : cluster [DBG] pgmap v163: 129 pgs: 7 stale+active+clean, 30 peering, 13 active+clean+wait, 79 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T13:53:58.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:58 gibba015 bash[30343]: cluster 2021-03-10T13:53:57.625965+0000 mon.a (mon.0) 541 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 8 pgs peering (PG_AVAILABILITY) 2021-03-10T13:53:59.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:53:59 gibba015 bash[29377]: cluster 2021-03-10T13:53:59.633366+0000 mon.a (mon.0) 542 : cluster [WRN] Health check failed: Degraded data redundancy: 6/192 objects degraded (3.125%), 6 pgs degraded (PG_DEGRADED) 2021-03-10T13:53:59.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:53:59 gibba015 bash[30343]: cluster 2021-03-10T13:53:59.633366+0000 mon.a (mon.0) 542 : cluster [WRN] Health check failed: Degraded data redundancy: 6/192 objects degraded (3.125%), 6 pgs degraded (PG_DEGRADED) 2021-03-10T13:53:59.981 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:53:59 gibba045 bash[25517]: cluster 2021-03-10T13:53:59.633366+0000 mon.a (mon.0) 542 : cluster [WRN] Health check failed: Degraded data redundancy: 6/192 objects degraded (3.125%), 6 pgs degraded (PG_DEGRADED) 2021-03-10T13:54:00.306 INFO:journalctl@ceph.osd.7.gibba045.stdout:Mar 10 13:54:00 gibba045 bash[31027]: debug 2021-03-10T13:53:59.999+0000 7f26f3ea0700 1 -- 172.21.2.145:0/1460862262 <== mon.2 v2:172.21.2.145:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55ea94d8a4e0 con 0x55ea94e07400 2021-03-10T13:54:00.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:00 gibba015 bash[29377]: cluster 2021-03-10T13:53:59.101053+0000 mgr.gibba045.orlgmj (mgr.34412) 314 : cluster [DBG] pgmap v164: 129 pgs: 2 stale+active+clean, 6 active+undersized+degraded, 30 peering, 12 active+undersized, 79 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail; 6/192 objects degraded (3.125%) 2021-03-10T13:54:00.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:00 gibba015 bash[30343]: cluster 2021-03-10T13:53:59.101053+0000 mgr.gibba045.orlgmj (mgr.34412) 314 : cluster [DBG] pgmap v164: 129 pgs: 2 stale+active+clean, 6 active+undersized+degraded, 30 peering, 12 active+undersized, 79 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail; 6/192 objects degraded (3.125%) 2021-03-10T13:54:01.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:00 gibba045 bash[25517]: cluster 2021-03-10T13:53:59.101053+0000 mgr.gibba045.orlgmj (mgr.34412) 314 : cluster [DBG] pgmap v164: 129 pgs: 2 stale+active+clean, 6 active+undersized+degraded, 30 peering, 12 active+undersized, 79 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail; 6/192 objects degraded (3.125%) 2021-03-10T13:54:01.056 INFO:journalctl@ceph.osd.7.gibba045.stdout:Mar 10 13:54:00 gibba045 bash[31027]: debug 2021-03-10T13:54:00.575+0000 7f26fb935080 -1 Falling back to public interface 2021-03-10T13:54:02.390 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:02 gibba045 bash[25517]: cluster 2021-03-10T13:54:01.101635+0000 mgr.gibba045.orlgmj (mgr.34412) 315 : cluster [DBG] pgmap v165: 129 pgs: 17 active+undersized+degraded, 19 peering, 21 active+undersized, 72 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail; 21/192 objects degraded (10.938%) 2021-03-10T13:54:02.390 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:02 gibba045 bash[25517]: audit 2021-03-10T13:54:01.109479+0000 mon.a (mon.0) 543 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:54:02.390 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:02 gibba045 bash[25517]: cephadm 2021-03-10T13:54:01.112860+0000 mgr.gibba045.orlgmj (mgr.34412) 316 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T13:54:02.391 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:02 gibba045 bash[25517]: audit 2021-03-10T13:54:01.315145+0000 mon.a (mon.0) 544 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:54:02.391 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:02 gibba045 bash[25517]: audit 2021-03-10T13:54:01.319061+0000 mon.c (mon.1) 152 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:54:02.391 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:02 gibba045 bash[25517]: audit 2021-03-10T13:54:01.320266+0000 mon.c (mon.1) 153 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:54:02.391 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:02 gibba045 bash[25517]: cephadm 2021-03-10T13:54:01.320489+0000 mgr.gibba045.orlgmj (mgr.34412) 317 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:54:02.392 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:02 gibba045 bash[25517]: audit 2021-03-10T13:54:01.321375+0000 mon.c (mon.1) 154 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:54:02.392 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:02 gibba045 bash[25517]: cephadm 2021-03-10T13:54:01.322021+0000 mgr.gibba045.orlgmj (mgr.34412) 318 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:54:02.392 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:02 gibba045 bash[25517]: audit 2021-03-10T13:54:01.322510+0000 mon.c (mon.1) 155 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:54:02.392 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:02 gibba045 bash[25517]: cephadm 2021-03-10T13:54:01.323058+0000 mgr.gibba045.orlgmj (mgr.34412) 319 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:54:02.393 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:02 gibba045 bash[25517]: cephadm 2021-03-10T13:54:01.323102+0000 mgr.gibba045.orlgmj (mgr.34412) 320 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:54:02.393 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:02 gibba045 bash[25517]: cephadm 2021-03-10T13:54:01.324172+0000 mgr.gibba045.orlgmj (mgr.34412) 321 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:54:02.393 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:02 gibba045 bash[25517]: cephadm 2021-03-10T13:54:01.324233+0000 mgr.gibba045.orlgmj (mgr.34412) 322 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:54:02.393 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:02 gibba045 bash[25517]: audit 2021-03-10T13:54:01.325205+0000 mon.c (mon.1) 156 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:54:02.394 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:02 gibba045 bash[25517]: cephadm 2021-03-10T13:54:01.325350+0000 mgr.gibba045.orlgmj (mgr.34412) 323 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:54:02.394 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:02 gibba045 bash[25517]: cephadm 2021-03-10T13:54:01.326828+0000 mgr.gibba045.orlgmj (mgr.34412) 324 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:54:02.394 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:02 gibba045 bash[25517]: cephadm 2021-03-10T13:54:01.326872+0000 mgr.gibba045.orlgmj (mgr.34412) 325 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:54:02.394 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:02 gibba045 bash[25517]: cephadm 2021-03-10T13:54:01.328067+0000 mgr.gibba045.orlgmj (mgr.34412) 326 : cephadm [INF] Upgrade: Setting container_image for all osd 2021-03-10T13:54:02.394 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:02 gibba045 bash[25517]: audit 2021-03-10T13:54:01.329723+0000 mon.a (mon.0) 545 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:54:02.395 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:02 gibba045 bash[25517]: audit 2021-03-10T13:54:01.331481+0000 mon.c (mon.1) 157 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2021-03-10T13:54:02.395 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:02 gibba045 bash[25517]: audit 2021-03-10T13:54:01.331782+0000 mon.a (mon.0) 546 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2021-03-10T13:54:02.395 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:02 gibba045 bash[25517]: audit 2021-03-10T13:54:01.334691+0000 mon.a (mon.0) 547 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2021-03-10T13:54:02.395 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:02 gibba045 bash[25517]: audit 2021-03-10T13:54:01.336478+0000 mon.c (mon.1) 158 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2021-03-10T13:54:02.396 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:02 gibba045 bash[25517]: audit 2021-03-10T13:54:01.336756+0000 mon.a (mon.0) 548 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2021-03-10T13:54:02.396 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:02 gibba045 bash[25517]: audit 2021-03-10T13:54:01.339512+0000 mon.a (mon.0) 549 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2021-03-10T13:54:02.396 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:02 gibba045 bash[25517]: audit 2021-03-10T13:54:01.340897+0000 mon.c (mon.1) 159 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2021-03-10T13:54:02.396 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:02 gibba045 bash[25517]: audit 2021-03-10T13:54:01.341120+0000 mon.a (mon.0) 550 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2021-03-10T13:54:02.396 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:02 gibba045 bash[25517]: audit 2021-03-10T13:54:01.343776+0000 mon.a (mon.0) 551 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2021-03-10T13:54:02.397 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:02 gibba045 bash[25517]: audit 2021-03-10T13:54:01.345187+0000 mon.c (mon.1) 160 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2021-03-10T13:54:02.397 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:02 gibba045 bash[25517]: audit 2021-03-10T13:54:01.345458+0000 mon.a (mon.0) 552 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2021-03-10T13:54:02.397 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:02 gibba045 bash[25517]: audit 2021-03-10T13:54:01.348316+0000 mon.a (mon.0) 553 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2021-03-10T13:54:02.397 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:02 gibba045 bash[25517]: audit 2021-03-10T13:54:01.349620+0000 mon.c (mon.1) 161 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2021-03-10T13:54:02.398 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:02 gibba045 bash[25517]: audit 2021-03-10T13:54:01.349907+0000 mon.a (mon.0) 554 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2021-03-10T13:54:02.398 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:02 gibba045 bash[25517]: audit 2021-03-10T13:54:01.352817+0000 mon.a (mon.0) 555 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2021-03-10T13:54:02.398 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:02 gibba045 bash[25517]: audit 2021-03-10T13:54:01.354028+0000 mon.c (mon.1) 162 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2021-03-10T13:54:02.398 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:02 gibba045 bash[25517]: audit 2021-03-10T13:54:01.354311+0000 mon.a (mon.0) 556 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2021-03-10T13:54:02.399 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:02 gibba045 bash[25517]: audit 2021-03-10T13:54:01.357252+0000 mon.a (mon.0) 557 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2021-03-10T13:54:02.399 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:02 gibba045 bash[25517]: audit 2021-03-10T13:54:01.358876+0000 mon.c (mon.1) 163 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]: dispatch 2021-03-10T13:54:02.399 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:02 gibba045 bash[25517]: audit 2021-03-10T13:54:01.359198+0000 mon.a (mon.0) 558 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]: dispatch 2021-03-10T13:54:02.399 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:02 gibba045 bash[25517]: audit 2021-03-10T13:54:01.362488+0000 mon.a (mon.0) 559 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]': finished 2021-03-10T13:54:02.399 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:02 gibba045 bash[25517]: audit 2021-03-10T13:54:01.363808+0000 mon.c (mon.1) 164 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]: dispatch 2021-03-10T13:54:02.400 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:02 gibba045 bash[25517]: audit 2021-03-10T13:54:01.364175+0000 mon.a (mon.0) 560 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]: dispatch 2021-03-10T13:54:02.400 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:02 gibba045 bash[25517]: audit 2021-03-10T13:54:01.367487+0000 mon.a (mon.0) 561 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]': finished 2021-03-10T13:54:02.400 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:02 gibba045 bash[25517]: audit 2021-03-10T13:54:01.369598+0000 mon.c (mon.1) 165 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd require-osd-release", "release": "quincy"}]: dispatch 2021-03-10T13:54:02.400 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:02 gibba045 bash[25517]: audit 2021-03-10T13:54:01.369899+0000 mon.a (mon.0) 562 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd require-osd-release", "release": "quincy"}]: dispatch 2021-03-10T13:54:02.401 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:02 gibba045 bash[25517]: cephadm 2021-03-10T13:54:01.370927+0000 mgr.gibba045.orlgmj (mgr.34412) 327 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T13:54:02.401 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:02 gibba045 bash[25517]: cephadm 2021-03-10T13:54:01.371386+0000 mgr.gibba045.orlgmj (mgr.34412) 328 : cephadm [INF] Upgrade: Setting require_osd_release to 17 quincy 2021-03-10T13:54:02.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[30343]: cluster 2021-03-10T13:54:01.101635+0000 mgr.gibba045.orlgmj (mgr.34412) 315 : cluster [DBG] pgmap v165: 129 pgs: 17 active+undersized+degraded, 19 peering, 21 active+undersized, 72 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail; 21/192 objects degraded (10.938%) 2021-03-10T13:54:02.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[30343]: audit 2021-03-10T13:54:01.109479+0000 mon.a (mon.0) 543 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:54:02.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[30343]: cephadm 2021-03-10T13:54:01.112860+0000 mgr.gibba045.orlgmj (mgr.34412) 316 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T13:54:02.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[30343]: audit 2021-03-10T13:54:01.315145+0000 mon.a (mon.0) 544 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:54:02.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[30343]: audit 2021-03-10T13:54:01.319061+0000 mon.c (mon.1) 152 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:54:02.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[30343]: audit 2021-03-10T13:54:01.320266+0000 mon.c (mon.1) 153 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:54:02.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[30343]: cephadm 2021-03-10T13:54:01.320489+0000 mgr.gibba045.orlgmj (mgr.34412) 317 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:54:02.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[30343]: audit 2021-03-10T13:54:01.321375+0000 mon.c (mon.1) 154 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:54:02.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[30343]: cephadm 2021-03-10T13:54:01.322021+0000 mgr.gibba045.orlgmj (mgr.34412) 318 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:54:02.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[30343]: audit 2021-03-10T13:54:01.322510+0000 mon.c (mon.1) 155 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:54:02.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[30343]: cephadm 2021-03-10T13:54:01.323058+0000 mgr.gibba045.orlgmj (mgr.34412) 319 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:54:02.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[30343]: cephadm 2021-03-10T13:54:01.323102+0000 mgr.gibba045.orlgmj (mgr.34412) 320 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:54:02.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[30343]: cephadm 2021-03-10T13:54:01.324172+0000 mgr.gibba045.orlgmj (mgr.34412) 321 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:54:02.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[30343]: cephadm 2021-03-10T13:54:01.324233+0000 mgr.gibba045.orlgmj (mgr.34412) 322 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:54:02.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[30343]: audit 2021-03-10T13:54:01.325205+0000 mon.c (mon.1) 156 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:54:02.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[30343]: cephadm 2021-03-10T13:54:01.325350+0000 mgr.gibba045.orlgmj (mgr.34412) 323 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:54:02.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[30343]: cephadm 2021-03-10T13:54:01.326828+0000 mgr.gibba045.orlgmj (mgr.34412) 324 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:54:02.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[30343]: cephadm 2021-03-10T13:54:01.326872+0000 mgr.gibba045.orlgmj (mgr.34412) 325 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:54:02.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[30343]: cephadm 2021-03-10T13:54:01.328067+0000 mgr.gibba045.orlgmj (mgr.34412) 326 : cephadm [INF] Upgrade: Setting container_image for all osd 2021-03-10T13:54:02.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[30343]: audit 2021-03-10T13:54:01.329723+0000 mon.a (mon.0) 545 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:54:02.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[29377]: cluster 2021-03-10T13:54:01.101635+0000 mgr.gibba045.orlgmj (mgr.34412) 315 : cluster [DBG] pgmap v165: 129 pgs: 17 active+undersized+degraded, 19 peering, 21 active+undersized, 72 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail; 21/192 objects degraded (10.938%) 2021-03-10T13:54:02.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[29377]: audit 2021-03-10T13:54:01.109479+0000 mon.a (mon.0) 543 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:54:02.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[29377]: cephadm 2021-03-10T13:54:01.112860+0000 mgr.gibba045.orlgmj (mgr.34412) 316 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T13:54:02.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[29377]: audit 2021-03-10T13:54:01.315145+0000 mon.a (mon.0) 544 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:54:02.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[29377]: audit 2021-03-10T13:54:01.319061+0000 mon.c (mon.1) 152 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:54:02.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[29377]: audit 2021-03-10T13:54:01.320266+0000 mon.c (mon.1) 153 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:54:02.479 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[29377]: cephadm 2021-03-10T13:54:01.320489+0000 mgr.gibba045.orlgmj (mgr.34412) 317 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:54:02.479 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[29377]: audit 2021-03-10T13:54:01.321375+0000 mon.c (mon.1) 154 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:54:02.479 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[29377]: cephadm 2021-03-10T13:54:01.322021+0000 mgr.gibba045.orlgmj (mgr.34412) 318 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:54:02.479 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[29377]: audit 2021-03-10T13:54:01.322510+0000 mon.c (mon.1) 155 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:54:02.480 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[29377]: cephadm 2021-03-10T13:54:01.323058+0000 mgr.gibba045.orlgmj (mgr.34412) 319 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:54:02.480 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[29377]: cephadm 2021-03-10T13:54:01.323102+0000 mgr.gibba045.orlgmj (mgr.34412) 320 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:54:02.480 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[29377]: cephadm 2021-03-10T13:54:01.324172+0000 mgr.gibba045.orlgmj (mgr.34412) 321 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:54:02.480 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[29377]: cephadm 2021-03-10T13:54:01.324233+0000 mgr.gibba045.orlgmj (mgr.34412) 322 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:54:02.480 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[29377]: audit 2021-03-10T13:54:01.325205+0000 mon.c (mon.1) 156 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:54:02.481 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[29377]: cephadm 2021-03-10T13:54:01.325350+0000 mgr.gibba045.orlgmj (mgr.34412) 323 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:54:02.481 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[29377]: cephadm 2021-03-10T13:54:01.326828+0000 mgr.gibba045.orlgmj (mgr.34412) 324 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:54:02.481 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[29377]: cephadm 2021-03-10T13:54:01.326872+0000 mgr.gibba045.orlgmj (mgr.34412) 325 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:54:02.481 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[29377]: cephadm 2021-03-10T13:54:01.328067+0000 mgr.gibba045.orlgmj (mgr.34412) 326 : cephadm [INF] Upgrade: Setting container_image for all osd 2021-03-10T13:54:02.481 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[29377]: audit 2021-03-10T13:54:01.329723+0000 mon.a (mon.0) 545 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:54:02.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[30343]: audit 2021-03-10T13:54:01.331481+0000 mon.c (mon.1) 157 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2021-03-10T13:54:02.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[30343]: audit 2021-03-10T13:54:01.331782+0000 mon.a (mon.0) 546 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2021-03-10T13:54:02.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[30343]: audit 2021-03-10T13:54:01.334691+0000 mon.a (mon.0) 547 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2021-03-10T13:54:02.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[30343]: audit 2021-03-10T13:54:01.336478+0000 mon.c (mon.1) 158 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2021-03-10T13:54:02.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[30343]: audit 2021-03-10T13:54:01.336756+0000 mon.a (mon.0) 548 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2021-03-10T13:54:02.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[30343]: audit 2021-03-10T13:54:01.339512+0000 mon.a (mon.0) 549 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2021-03-10T13:54:02.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[30343]: audit 2021-03-10T13:54:01.340897+0000 mon.c (mon.1) 159 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2021-03-10T13:54:02.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[30343]: audit 2021-03-10T13:54:01.341120+0000 mon.a (mon.0) 550 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2021-03-10T13:54:02.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[30343]: audit 2021-03-10T13:54:01.343776+0000 mon.a (mon.0) 551 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2021-03-10T13:54:02.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[30343]: audit 2021-03-10T13:54:01.345187+0000 mon.c (mon.1) 160 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2021-03-10T13:54:02.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[30343]: audit 2021-03-10T13:54:01.345458+0000 mon.a (mon.0) 552 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2021-03-10T13:54:02.485 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[30343]: audit 2021-03-10T13:54:01.348316+0000 mon.a (mon.0) 553 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2021-03-10T13:54:02.485 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[30343]: audit 2021-03-10T13:54:01.349620+0000 mon.c (mon.1) 161 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2021-03-10T13:54:02.485 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[30343]: audit 2021-03-10T13:54:01.349907+0000 mon.a (mon.0) 554 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2021-03-10T13:54:02.485 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[30343]: audit 2021-03-10T13:54:01.352817+0000 mon.a (mon.0) 555 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2021-03-10T13:54:02.485 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[30343]: audit 2021-03-10T13:54:01.354028+0000 mon.c (mon.1) 162 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2021-03-10T13:54:02.486 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[30343]: audit 2021-03-10T13:54:01.354311+0000 mon.a (mon.0) 556 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2021-03-10T13:54:02.486 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[29377]: audit 2021-03-10T13:54:01.331481+0000 mon.c (mon.1) 157 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2021-03-10T13:54:02.486 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[29377]: audit 2021-03-10T13:54:01.331782+0000 mon.a (mon.0) 546 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2021-03-10T13:54:02.487 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[29377]: audit 2021-03-10T13:54:01.334691+0000 mon.a (mon.0) 547 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2021-03-10T13:54:02.487 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[29377]: audit 2021-03-10T13:54:01.336478+0000 mon.c (mon.1) 158 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2021-03-10T13:54:02.487 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[29377]: audit 2021-03-10T13:54:01.336756+0000 mon.a (mon.0) 548 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2021-03-10T13:54:02.487 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[29377]: audit 2021-03-10T13:54:01.339512+0000 mon.a (mon.0) 549 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2021-03-10T13:54:02.488 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[29377]: audit 2021-03-10T13:54:01.340897+0000 mon.c (mon.1) 159 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2021-03-10T13:54:02.488 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[29377]: audit 2021-03-10T13:54:01.341120+0000 mon.a (mon.0) 550 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2021-03-10T13:54:02.488 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[29377]: audit 2021-03-10T13:54:01.343776+0000 mon.a (mon.0) 551 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2021-03-10T13:54:02.488 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[29377]: audit 2021-03-10T13:54:01.345187+0000 mon.c (mon.1) 160 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2021-03-10T13:54:02.488 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[29377]: audit 2021-03-10T13:54:01.345458+0000 mon.a (mon.0) 552 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2021-03-10T13:54:02.489 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[29377]: audit 2021-03-10T13:54:01.348316+0000 mon.a (mon.0) 553 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2021-03-10T13:54:02.489 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[29377]: audit 2021-03-10T13:54:01.349620+0000 mon.c (mon.1) 161 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2021-03-10T13:54:02.489 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[29377]: audit 2021-03-10T13:54:01.349907+0000 mon.a (mon.0) 554 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2021-03-10T13:54:02.489 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[29377]: audit 2021-03-10T13:54:01.352817+0000 mon.a (mon.0) 555 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2021-03-10T13:54:02.490 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[29377]: audit 2021-03-10T13:54:01.354028+0000 mon.c (mon.1) 162 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2021-03-10T13:54:02.490 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[29377]: audit 2021-03-10T13:54:01.354311+0000 mon.a (mon.0) 556 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2021-03-10T13:54:02.490 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[30343]: audit 2021-03-10T13:54:01.357252+0000 mon.a (mon.0) 557 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2021-03-10T13:54:02.491 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[30343]: audit 2021-03-10T13:54:01.358876+0000 mon.c (mon.1) 163 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]: dispatch 2021-03-10T13:54:02.491 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[30343]: audit 2021-03-10T13:54:01.359198+0000 mon.a (mon.0) 558 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]: dispatch 2021-03-10T13:54:02.491 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[30343]: audit 2021-03-10T13:54:01.362488+0000 mon.a (mon.0) 559 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]': finished 2021-03-10T13:54:02.491 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[30343]: audit 2021-03-10T13:54:01.363808+0000 mon.c (mon.1) 164 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]: dispatch 2021-03-10T13:54:02.492 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[30343]: audit 2021-03-10T13:54:01.364175+0000 mon.a (mon.0) 560 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]: dispatch 2021-03-10T13:54:02.492 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[30343]: audit 2021-03-10T13:54:01.367487+0000 mon.a (mon.0) 561 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]': finished 2021-03-10T13:54:02.492 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[30343]: audit 2021-03-10T13:54:01.369598+0000 mon.c (mon.1) 165 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd require-osd-release", "release": "quincy"}]: dispatch 2021-03-10T13:54:02.492 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[30343]: audit 2021-03-10T13:54:01.369899+0000 mon.a (mon.0) 562 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd require-osd-release", "release": "quincy"}]: dispatch 2021-03-10T13:54:02.493 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[30343]: cephadm 2021-03-10T13:54:01.370927+0000 mgr.gibba045.orlgmj (mgr.34412) 327 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T13:54:02.493 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[30343]: cephadm 2021-03-10T13:54:01.371386+0000 mgr.gibba045.orlgmj (mgr.34412) 328 : cephadm [INF] Upgrade: Setting require_osd_release to 17 quincy 2021-03-10T13:54:02.493 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[29377]: audit 2021-03-10T13:54:01.357252+0000 mon.a (mon.0) 557 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2021-03-10T13:54:02.494 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[29377]: audit 2021-03-10T13:54:01.358876+0000 mon.c (mon.1) 163 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]: dispatch 2021-03-10T13:54:02.494 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[29377]: audit 2021-03-10T13:54:01.359198+0000 mon.a (mon.0) 558 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]: dispatch 2021-03-10T13:54:02.494 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[29377]: audit 2021-03-10T13:54:01.362488+0000 mon.a (mon.0) 559 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]': finished 2021-03-10T13:54:02.494 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[29377]: audit 2021-03-10T13:54:01.363808+0000 mon.c (mon.1) 164 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]: dispatch 2021-03-10T13:54:02.495 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[29377]: audit 2021-03-10T13:54:01.364175+0000 mon.a (mon.0) 560 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]: dispatch 2021-03-10T13:54:02.495 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[29377]: audit 2021-03-10T13:54:01.367487+0000 mon.a (mon.0) 561 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]': finished 2021-03-10T13:54:02.495 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[29377]: audit 2021-03-10T13:54:01.369598+0000 mon.c (mon.1) 165 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd require-osd-release", "release": "quincy"}]: dispatch 2021-03-10T13:54:02.495 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[29377]: audit 2021-03-10T13:54:01.369899+0000 mon.a (mon.0) 562 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd require-osd-release", "release": "quincy"}]: dispatch 2021-03-10T13:54:02.496 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[29377]: cephadm 2021-03-10T13:54:01.370927+0000 mgr.gibba045.orlgmj (mgr.34412) 327 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T13:54:02.496 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:02 gibba015 bash[29377]: cephadm 2021-03-10T13:54:01.371386+0000 mgr.gibba045.orlgmj (mgr.34412) 328 : cephadm [INF] Upgrade: Setting require_osd_release to 17 quincy 2021-03-10T13:54:03.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:03 gibba015 bash[29377]: audit 2021-03-10T13:54:02.376446+0000 mon.a (mon.0) 563 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix": "osd require-osd-release", "release": "quincy"}]': finished 2021-03-10T13:54:03.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:03 gibba015 bash[29377]: cluster 2021-03-10T13:54:02.376638+0000 mon.a (mon.0) 564 : cluster [DBG] osdmap e100: 8 total, 7 up, 8 in 2021-03-10T13:54:03.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:03 gibba015 bash[29377]: audit 2021-03-10T13:54:02.380818+0000 mon.c (mon.1) 166 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:54:03.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:03 gibba015 bash[29377]: cephadm 2021-03-10T13:54:02.382131+0000 mgr.gibba045.orlgmj (mgr.34412) 329 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T13:54:03.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:03 gibba015 bash[29377]: cephadm 2021-03-10T13:54:02.384086+0000 mgr.gibba045.orlgmj (mgr.34412) 330 : cephadm [INF] Upgrade: Setting container_image for all mds 2021-03-10T13:54:03.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:03 gibba015 bash[29377]: audit 2021-03-10T13:54:02.385841+0000 mon.a (mon.0) 565 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:54:03.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:03 gibba015 bash[29377]: cephadm 2021-03-10T13:54:02.389100+0000 mgr.gibba045.orlgmj (mgr.34412) 331 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T13:54:03.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:03 gibba015 bash[29377]: cephadm 2021-03-10T13:54:02.389139+0000 mgr.gibba045.orlgmj (mgr.34412) 332 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T13:54:03.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:03 gibba015 bash[29377]: cephadm 2021-03-10T13:54:02.389261+0000 mgr.gibba045.orlgmj (mgr.34412) 333 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T13:54:03.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:03 gibba015 bash[30343]: audit 2021-03-10T13:54:02.376446+0000 mon.a (mon.0) 563 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix": "osd require-osd-release", "release": "quincy"}]': finished 2021-03-10T13:54:03.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:03 gibba015 bash[30343]: cluster 2021-03-10T13:54:02.376638+0000 mon.a (mon.0) 564 : cluster [DBG] osdmap e100: 8 total, 7 up, 8 in 2021-03-10T13:54:03.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:03 gibba015 bash[30343]: audit 2021-03-10T13:54:02.380818+0000 mon.c (mon.1) 166 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:54:03.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:03 gibba015 bash[30343]: cephadm 2021-03-10T13:54:02.382131+0000 mgr.gibba045.orlgmj (mgr.34412) 329 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T13:54:03.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:03 gibba015 bash[30343]: cephadm 2021-03-10T13:54:02.384086+0000 mgr.gibba045.orlgmj (mgr.34412) 330 : cephadm [INF] Upgrade: Setting container_image for all mds 2021-03-10T13:54:03.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:03 gibba015 bash[30343]: audit 2021-03-10T13:54:02.385841+0000 mon.a (mon.0) 565 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:54:03.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:03 gibba015 bash[30343]: cephadm 2021-03-10T13:54:02.389100+0000 mgr.gibba045.orlgmj (mgr.34412) 331 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T13:54:03.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:03 gibba015 bash[30343]: cephadm 2021-03-10T13:54:02.389139+0000 mgr.gibba045.orlgmj (mgr.34412) 332 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T13:54:03.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:03 gibba015 bash[30343]: cephadm 2021-03-10T13:54:02.389261+0000 mgr.gibba045.orlgmj (mgr.34412) 333 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T13:54:03.757 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:03 gibba045 bash[25517]: audit 2021-03-10T13:54:02.376446+0000 mon.a (mon.0) 563 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd='[{"prefix": "osd require-osd-release", "release": "quincy"}]': finished 2021-03-10T13:54:03.757 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:03 gibba045 bash[25517]: cluster 2021-03-10T13:54:02.376638+0000 mon.a (mon.0) 564 : cluster [DBG] osdmap e100: 8 total, 7 up, 8 in 2021-03-10T13:54:03.757 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:03 gibba045 bash[25517]: audit 2021-03-10T13:54:02.380818+0000 mon.c (mon.1) 166 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:54:03.758 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:03 gibba045 bash[25517]: cephadm 2021-03-10T13:54:02.382131+0000 mgr.gibba045.orlgmj (mgr.34412) 329 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T13:54:03.758 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:03 gibba045 bash[25517]: cephadm 2021-03-10T13:54:02.384086+0000 mgr.gibba045.orlgmj (mgr.34412) 330 : cephadm [INF] Upgrade: Setting container_image for all mds 2021-03-10T13:54:03.758 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:03 gibba045 bash[25517]: audit 2021-03-10T13:54:02.385841+0000 mon.a (mon.0) 565 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:54:03.758 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:03 gibba045 bash[25517]: cephadm 2021-03-10T13:54:02.389100+0000 mgr.gibba045.orlgmj (mgr.34412) 331 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T13:54:03.759 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:03 gibba045 bash[25517]: cephadm 2021-03-10T13:54:02.389139+0000 mgr.gibba045.orlgmj (mgr.34412) 332 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T13:54:03.759 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:03 gibba045 bash[25517]: cephadm 2021-03-10T13:54:02.389261+0000 mgr.gibba045.orlgmj (mgr.34412) 333 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T13:54:04.056 INFO:journalctl@ceph.osd.7.gibba045.stdout:Mar 10 13:54:03 gibba045 bash[31027]: debug 2021-03-10T13:54:03.755+0000 7f26fb935080 -1 bluestore(/var/lib/ceph/osd/ceph-7) fsck warning: store not yet converted to per-pg omap 2021-03-10T13:54:04.057 INFO:journalctl@ceph.osd.7.gibba045.stdout:Mar 10 13:54:03 gibba045 bash[31027]: debug 2021-03-10T13:54:03.755+0000 7f26e7bfc700 -1 bluestore(/var/lib/ceph/osd/ceph-7) fsck warning: #-1:c1a3fc6e:::purged_snaps:0# has omap that is not per-pg or pgmeta 2021-03-10T13:54:04.057 INFO:journalctl@ceph.osd.7.gibba045.stdout:Mar 10 13:54:03 gibba045 bash[31027]: debug 2021-03-10T13:54:03.755+0000 7f26e7bfc700 -1 bluestore(/var/lib/ceph/osd/ceph-7) fsck warning: #1:ed089dd6:::INTEL_SSDPEL1K375GA_PHKM913400GH375A:head# has omap that is not per-pg or pgmeta 2021-03-10T13:54:04.057 INFO:journalctl@ceph.osd.7.gibba045.stdout:Mar 10 13:54:03 gibba045 bash[31027]: debug 2021-03-10T13:54:03.887+0000 7f26fb935080 -1 osd.7 97 log_to_monitors {default=true} 2021-03-10T13:54:04.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:04 gibba015 bash[29377]: cluster 2021-03-10T13:54:03.103103+0000 mgr.gibba045.orlgmj (mgr.34412) 334 : cluster [DBG] pgmap v167: 129 pgs: 27 active+undersized+degraded, 30 active+undersized, 72 active+clean; 7.0 KiB data, 48 MiB used, 671 GiB / 672 GiB avail; 33/192 objects degraded (17.188%) 2021-03-10T13:54:04.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:04 gibba015 bash[29377]: cluster 2021-03-10T13:54:03.383895+0000 mon.a (mon.0) 566 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2021-03-10T13:54:04.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:04 gibba015 bash[29377]: audit 2021-03-10T13:54:03.891023+0000 mon.a (mon.0) 567 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-03-10T13:54:04.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:04 gibba015 bash[29377]: audit 2021-03-10T13:54:03.892796+0000 mon.b (mon.2) 9 : audit [INF] from='osd.7 [v2:172.21.2.145:6824/3398608772,v1:172.21.2.145:6825/3398608772]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-03-10T13:54:04.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:04 gibba015 bash[30343]: cluster 2021-03-10T13:54:03.103103+0000 mgr.gibba045.orlgmj (mgr.34412) 334 : cluster [DBG] pgmap v167: 129 pgs: 27 active+undersized+degraded, 30 active+undersized, 72 active+clean; 7.0 KiB data, 48 MiB used, 671 GiB / 672 GiB avail; 33/192 objects degraded (17.188%) 2021-03-10T13:54:04.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:04 gibba015 bash[30343]: cluster 2021-03-10T13:54:03.383895+0000 mon.a (mon.0) 566 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2021-03-10T13:54:04.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:04 gibba015 bash[30343]: audit 2021-03-10T13:54:03.891023+0000 mon.a (mon.0) 567 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-03-10T13:54:04.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:04 gibba015 bash[30343]: audit 2021-03-10T13:54:03.892796+0000 mon.b (mon.2) 9 : audit [INF] from='osd.7 [v2:172.21.2.145:6824/3398608772,v1:172.21.2.145:6825/3398608772]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-03-10T13:54:04.806 INFO:journalctl@ceph.osd.7.gibba045.stdout:Mar 10 13:54:04 gibba045 bash[31027]: debug 2021-03-10T13:54:04.395+0000 7f26ede17700 -1 osd.7 97 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T13:54:04.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:04 gibba045 bash[25517]: cluster 2021-03-10T13:54:03.103103+0000 mgr.gibba045.orlgmj (mgr.34412) 334 : cluster [DBG] pgmap v167: 129 pgs: 27 active+undersized+degraded, 30 active+undersized, 72 active+clean; 7.0 KiB data, 48 MiB used, 671 GiB / 672 GiB avail; 33/192 objects degraded (17.188%) 2021-03-10T13:54:04.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:04 gibba045 bash[25517]: cluster 2021-03-10T13:54:03.383895+0000 mon.a (mon.0) 566 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2021-03-10T13:54:04.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:04 gibba045 bash[25517]: audit 2021-03-10T13:54:03.891023+0000 mon.a (mon.0) 567 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-03-10T13:54:04.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:04 gibba045 bash[25517]: audit 2021-03-10T13:54:03.892796+0000 mon.b (mon.2) 9 : audit [INF] from='osd.7 [v2:172.21.2.145:6824/3398608772,v1:172.21.2.145:6825/3398608772]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-03-10T13:54:05.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:05 gibba015 bash[29377]: audit 2021-03-10T13:54:04.389598+0000 mon.a (mon.0) 568 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2021-03-10T13:54:05.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:05 gibba015 bash[29377]: cluster 2021-03-10T13:54:04.389630+0000 mon.a (mon.0) 569 : cluster [DBG] osdmap e101: 8 total, 7 up, 8 in 2021-03-10T13:54:05.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:05 gibba015 bash[29377]: audit 2021-03-10T13:54:04.390584+0000 mon.a (mon.0) 570 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0820, "args": ["host=gibba045", "root=default"]}]: dispatch 2021-03-10T13:54:05.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:05 gibba015 bash[29377]: audit 2021-03-10T13:54:04.392361+0000 mon.b (mon.2) 10 : audit [INF] from='osd.7 [v2:172.21.2.145:6824/3398608772,v1:172.21.2.145:6825/3398608772]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0820, "args": ["host=gibba045", "root=default"]}]: dispatch 2021-03-10T13:54:05.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:05 gibba015 bash[30343]: audit 2021-03-10T13:54:04.389598+0000 mon.a (mon.0) 568 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2021-03-10T13:54:05.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:05 gibba015 bash[30343]: cluster 2021-03-10T13:54:04.389630+0000 mon.a (mon.0) 569 : cluster [DBG] osdmap e101: 8 total, 7 up, 8 in 2021-03-10T13:54:05.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:05 gibba015 bash[30343]: audit 2021-03-10T13:54:04.390584+0000 mon.a (mon.0) 570 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0820, "args": ["host=gibba045", "root=default"]}]: dispatch 2021-03-10T13:54:05.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:05 gibba015 bash[30343]: audit 2021-03-10T13:54:04.392361+0000 mon.b (mon.2) 10 : audit [INF] from='osd.7 [v2:172.21.2.145:6824/3398608772,v1:172.21.2.145:6825/3398608772]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0820, "args": ["host=gibba045", "root=default"]}]: dispatch 2021-03-10T13:54:05.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:05 gibba045 bash[25517]: audit 2021-03-10T13:54:04.389598+0000 mon.a (mon.0) 568 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2021-03-10T13:54:05.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:05 gibba045 bash[25517]: cluster 2021-03-10T13:54:04.389630+0000 mon.a (mon.0) 569 : cluster [DBG] osdmap e101: 8 total, 7 up, 8 in 2021-03-10T13:54:05.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:05 gibba045 bash[25517]: audit 2021-03-10T13:54:04.390584+0000 mon.a (mon.0) 570 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0820, "args": ["host=gibba045", "root=default"]}]: dispatch 2021-03-10T13:54:05.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:05 gibba045 bash[25517]: audit 2021-03-10T13:54:04.392361+0000 mon.b (mon.2) 10 : audit [INF] from='osd.7 [v2:172.21.2.145:6824/3398608772,v1:172.21.2.145:6825/3398608772]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0820, "args": ["host=gibba045", "root=default"]}]: dispatch 2021-03-10T13:54:06.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:06 gibba015 bash[29377]: cluster 2021-03-10T13:54:05.104626+0000 mgr.gibba045.orlgmj (mgr.34412) 335 : cluster [DBG] pgmap v169: 129 pgs: 27 active+undersized+degraded, 30 active+undersized, 72 active+clean; 7.0 KiB data, 52 MiB used, 672 GiB / 672 GiB avail; 33/192 objects degraded (17.188%) 2021-03-10T13:54:06.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:06 gibba015 bash[29377]: cluster 2021-03-10T13:54:05.389539+0000 mon.a (mon.0) 571 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T13:54:06.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:06 gibba015 bash[29377]: cluster 2021-03-10T13:54:05.400071+0000 mon.a (mon.0) 572 : cluster [INF] osd.7 [v2:172.21.2.145:6824/3398608772,v1:172.21.2.145:6825/3398608772] boot 2021-03-10T13:54:06.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:06 gibba015 bash[29377]: cluster 2021-03-10T13:54:05.400105+0000 mon.a (mon.0) 573 : cluster [DBG] osdmap e102: 8 total, 8 up, 8 in 2021-03-10T13:54:06.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:06 gibba015 bash[29377]: audit 2021-03-10T13:54:05.400721+0000 mon.c (mon.1) 167 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T13:54:06.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:06 gibba015 bash[30343]: cluster 2021-03-10T13:54:05.104626+0000 mgr.gibba045.orlgmj (mgr.34412) 335 : cluster [DBG] pgmap v169: 129 pgs: 27 active+undersized+degraded, 30 active+undersized, 72 active+clean; 7.0 KiB data, 52 MiB used, 672 GiB / 672 GiB avail; 33/192 objects degraded (17.188%) 2021-03-10T13:54:06.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:06 gibba015 bash[30343]: cluster 2021-03-10T13:54:05.389539+0000 mon.a (mon.0) 571 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T13:54:06.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:06 gibba015 bash[30343]: cluster 2021-03-10T13:54:05.400071+0000 mon.a (mon.0) 572 : cluster [INF] osd.7 [v2:172.21.2.145:6824/3398608772,v1:172.21.2.145:6825/3398608772] boot 2021-03-10T13:54:06.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:06 gibba015 bash[30343]: cluster 2021-03-10T13:54:05.400105+0000 mon.a (mon.0) 573 : cluster [DBG] osdmap e102: 8 total, 8 up, 8 in 2021-03-10T13:54:06.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:06 gibba015 bash[30343]: audit 2021-03-10T13:54:05.400721+0000 mon.c (mon.1) 167 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T13:54:06.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:06 gibba045 bash[25517]: cluster 2021-03-10T13:54:05.104626+0000 mgr.gibba045.orlgmj (mgr.34412) 335 : cluster [DBG] pgmap v169: 129 pgs: 27 active+undersized+degraded, 30 active+undersized, 72 active+clean; 7.0 KiB data, 52 MiB used, 672 GiB / 672 GiB avail; 33/192 objects degraded (17.188%) 2021-03-10T13:54:06.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:06 gibba045 bash[25517]: cluster 2021-03-10T13:54:05.389539+0000 mon.a (mon.0) 571 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T13:54:06.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:06 gibba045 bash[25517]: cluster 2021-03-10T13:54:05.400071+0000 mon.a (mon.0) 572 : cluster [INF] osd.7 [v2:172.21.2.145:6824/3398608772,v1:172.21.2.145:6825/3398608772] boot 2021-03-10T13:54:06.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:06 gibba045 bash[25517]: cluster 2021-03-10T13:54:05.400105+0000 mon.a (mon.0) 573 : cluster [DBG] osdmap e102: 8 total, 8 up, 8 in 2021-03-10T13:54:06.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:06 gibba045 bash[25517]: audit 2021-03-10T13:54:05.400721+0000 mon.c (mon.1) 167 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T13:54:07.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:07 gibba015 bash[29377]: cluster 2021-03-10T13:54:06.414490+0000 mon.a (mon.0) 574 : cluster [DBG] osdmap e103: 8 total, 8 up, 8 in 2021-03-10T13:54:07.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:07 gibba015 bash[29377]: cluster 2021-03-10T13:54:06.415290+0000 mon.a (mon.0) 575 : cluster [WRN] Health check update: Degraded data redundancy: 33/192 objects degraded (17.188%), 27 pgs degraded (PG_DEGRADED) 2021-03-10T13:54:07.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:07 gibba015 bash[30343]: cluster 2021-03-10T13:54:06.414490+0000 mon.a (mon.0) 574 : cluster [DBG] osdmap e103: 8 total, 8 up, 8 in 2021-03-10T13:54:07.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:07 gibba015 bash[30343]: cluster 2021-03-10T13:54:06.415290+0000 mon.a (mon.0) 575 : cluster [WRN] Health check update: Degraded data redundancy: 33/192 objects degraded (17.188%), 27 pgs degraded (PG_DEGRADED) 2021-03-10T13:54:07.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:07 gibba045 bash[25517]: cluster 2021-03-10T13:54:06.414490+0000 mon.a (mon.0) 574 : cluster [DBG] osdmap e103: 8 total, 8 up, 8 in 2021-03-10T13:54:07.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:07 gibba045 bash[25517]: cluster 2021-03-10T13:54:06.415290+0000 mon.a (mon.0) 575 : cluster [WRN] Health check update: Degraded data redundancy: 33/192 objects degraded (17.188%), 27 pgs degraded (PG_DEGRADED) 2021-03-10T13:54:08.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:08 gibba015 bash[29377]: cluster 2021-03-10T13:54:07.105786+0000 mgr.gibba045.orlgmj (mgr.34412) 336 : cluster [DBG] pgmap v172: 129 pgs: 23 peering, 16 active+undersized+degraded, 18 active+undersized, 72 active+clean; 7.0 KiB data, 52 MiB used, 672 GiB / 672 GiB avail; 18/192 objects degraded (9.375%) 2021-03-10T13:54:08.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:08 gibba015 bash[30343]: cluster 2021-03-10T13:54:07.105786+0000 mgr.gibba045.orlgmj (mgr.34412) 336 : cluster [DBG] pgmap v172: 129 pgs: 23 peering, 16 active+undersized+degraded, 18 active+undersized, 72 active+clean; 7.0 KiB data, 52 MiB used, 672 GiB / 672 GiB avail; 18/192 objects degraded (9.375%) 2021-03-10T13:54:08.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:08 gibba045 bash[25517]: cluster 2021-03-10T13:54:07.105786+0000 mgr.gibba045.orlgmj (mgr.34412) 336 : cluster [DBG] pgmap v172: 129 pgs: 23 peering, 16 active+undersized+degraded, 18 active+undersized, 72 active+clean; 7.0 KiB data, 52 MiB used, 672 GiB / 672 GiB avail; 18/192 objects degraded (9.375%) 2021-03-10T13:54:10.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:10 gibba015 bash[29377]: cluster 2021-03-10T13:54:09.107192+0000 mgr.gibba045.orlgmj (mgr.34412) 337 : cluster [DBG] pgmap v173: 129 pgs: 23 peering, 11 active+undersized+degraded, 10 active+undersized, 85 active+clean; 7.0 KiB data, 53 MiB used, 672 GiB / 672 GiB avail; 13/192 objects degraded (6.771%) 2021-03-10T13:54:10.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:10 gibba015 bash[30343]: cluster 2021-03-10T13:54:09.107192+0000 mgr.gibba045.orlgmj (mgr.34412) 337 : cluster [DBG] pgmap v173: 129 pgs: 23 peering, 11 active+undersized+degraded, 10 active+undersized, 85 active+clean; 7.0 KiB data, 53 MiB used, 672 GiB / 672 GiB avail; 13/192 objects degraded (6.771%) 2021-03-10T13:54:10.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:10 gibba045 bash[25517]: cluster 2021-03-10T13:54:09.107192+0000 mgr.gibba045.orlgmj (mgr.34412) 337 : cluster [DBG] pgmap v173: 129 pgs: 23 peering, 11 active+undersized+degraded, 10 active+undersized, 85 active+clean; 7.0 KiB data, 53 MiB used, 672 GiB / 672 GiB avail; 13/192 objects degraded (6.771%) 2021-03-10T13:54:11.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:11 gibba015 bash[29377]: cluster 2021-03-10T13:54:11.417198+0000 mon.a (mon.0) 576 : cluster [WRN] Health check update: Degraded data redundancy: 13/192 objects degraded (6.771%), 11 pgs degraded (PG_DEGRADED) 2021-03-10T13:54:11.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:11 gibba015 bash[30343]: cluster 2021-03-10T13:54:11.417198+0000 mon.a (mon.0) 576 : cluster [WRN] Health check update: Degraded data redundancy: 13/192 objects degraded (6.771%), 11 pgs degraded (PG_DEGRADED) 2021-03-10T13:54:11.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:11 gibba045 bash[25517]: cluster 2021-03-10T13:54:11.417198+0000 mon.a (mon.0) 576 : cluster [WRN] Health check update: Degraded data redundancy: 13/192 objects degraded (6.771%), 11 pgs degraded (PG_DEGRADED) 2021-03-10T13:54:12.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:12 gibba015 bash[29377]: cluster 2021-03-10T13:54:11.108888+0000 mgr.gibba045.orlgmj (mgr.34412) 338 : cluster [DBG] pgmap v174: 129 pgs: 17 active+clean+wait, 16 peering, 96 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:54:12.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:12 gibba015 bash[29377]: cluster 2021-03-10T13:54:11.444521+0000 mon.a (mon.0) 577 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 13/192 objects degraded (6.771%), 11 pgs degraded) 2021-03-10T13:54:12.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:12 gibba015 bash[30343]: cluster 2021-03-10T13:54:11.108888+0000 mgr.gibba045.orlgmj (mgr.34412) 338 : cluster [DBG] pgmap v174: 129 pgs: 17 active+clean+wait, 16 peering, 96 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:54:12.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:12 gibba015 bash[30343]: cluster 2021-03-10T13:54:11.444521+0000 mon.a (mon.0) 577 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 13/192 objects degraded (6.771%), 11 pgs degraded) 2021-03-10T13:54:12.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:12 gibba045 bash[25517]: cluster 2021-03-10T13:54:11.108888+0000 mgr.gibba045.orlgmj (mgr.34412) 338 : cluster [DBG] pgmap v174: 129 pgs: 17 active+clean+wait, 16 peering, 96 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:54:12.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:12 gibba045 bash[25517]: cluster 2021-03-10T13:54:11.444521+0000 mon.a (mon.0) 577 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 13/192 objects degraded (6.771%), 11 pgs degraded) 2021-03-10T13:54:14.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:14 gibba015 bash[29377]: cluster 2021-03-10T13:54:13.110460+0000 mgr.gibba045.orlgmj (mgr.34412) 339 : cluster [DBG] pgmap v175: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:54:14.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:14 gibba015 bash[30343]: cluster 2021-03-10T13:54:13.110460+0000 mgr.gibba045.orlgmj (mgr.34412) 339 : cluster [DBG] pgmap v175: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:54:14.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:14 gibba045 bash[25517]: cluster 2021-03-10T13:54:13.110460+0000 mgr.gibba045.orlgmj (mgr.34412) 339 : cluster [DBG] pgmap v175: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:54:14.992 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T13:54:15.221 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T13:54:15.221 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (4m) 117s ago 10m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T13:54:15.222 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (10m) 14s ago 10m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T13:54:15.222 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (5m) 14s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T13:54:15.222 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (5m) 14s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T13:54:15.223 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (4m) 118s ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T13:54:15.223 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (4m) 118s ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T13:54:15.223 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (4m) 14s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T13:54:15.224 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (4m) 118s ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T13:54:15.224 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (10m) 117s ago 10m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T13:54:15.224 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (10m) 14s ago 10m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T13:54:15.224 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3m) 118s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T13:54:15.225 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2m) 117s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T13:54:15.225 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2m) 117s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T13:54:15.225 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (119s) 117s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T13:54:15.225 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (94s) 14s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T13:54:15.225 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (69s) 14s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T13:54:15.226 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (42s) 14s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T13:54:15.226 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (16s) 14s ago 10m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T13:54:15.226 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (9m) 14s ago 10m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T13:54:15.226 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 14s ago 8m docker.io/ceph/ceph:v15.2.0 2021-03-10T13:54:15.474 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T13:54:15.475 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T13:54:15.475 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:54:15.475 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T13:54:15.476 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T13:54:15.476 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:54:15.476 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T13:54:15.476 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T13:54:15.477 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T13:54:15.477 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T13:54:15.477 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T13:54:15.477 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T13:54:15.478 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T13:54:15.478 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T13:54:15.478 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T13:54:16.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:16 gibba015 bash[29377]: audit 2021-03-10T13:54:14.982278+0000 mgr.gibba045.orlgmj (mgr.34412) 340 : audit [DBG] from='client.54274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:54:16.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:16 gibba015 bash[29377]: cluster 2021-03-10T13:54:15.112140+0000 mgr.gibba045.orlgmj (mgr.34412) 341 : cluster [DBG] pgmap v176: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:54:16.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:16 gibba015 bash[29377]: audit 2021-03-10T13:54:15.209092+0000 mgr.gibba045.orlgmj (mgr.34412) 342 : audit [DBG] from='client.44292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:54:16.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:16 gibba015 bash[29377]: audit 2021-03-10T13:54:15.472285+0000 mon.c (mon.1) 168 : audit [DBG] from='client.? 172.21.2.115:0/1319143965' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:54:16.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:16 gibba015 bash[30343]: audit 2021-03-10T13:54:14.982278+0000 mgr.gibba045.orlgmj (mgr.34412) 340 : audit [DBG] from='client.54274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:54:16.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:16 gibba015 bash[30343]: cluster 2021-03-10T13:54:15.112140+0000 mgr.gibba045.orlgmj (mgr.34412) 341 : cluster [DBG] pgmap v176: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:54:16.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:16 gibba015 bash[30343]: audit 2021-03-10T13:54:15.209092+0000 mgr.gibba045.orlgmj (mgr.34412) 342 : audit [DBG] from='client.44292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:54:16.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:16 gibba015 bash[30343]: audit 2021-03-10T13:54:15.472285+0000 mon.c (mon.1) 168 : audit [DBG] from='client.? 172.21.2.115:0/1319143965' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:54:16.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:16 gibba045 bash[25517]: audit 2021-03-10T13:54:14.982278+0000 mgr.gibba045.orlgmj (mgr.34412) 340 : audit [DBG] from='client.54274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:54:16.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:16 gibba045 bash[25517]: cluster 2021-03-10T13:54:15.112140+0000 mgr.gibba045.orlgmj (mgr.34412) 341 : cluster [DBG] pgmap v176: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:54:16.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:16 gibba045 bash[25517]: audit 2021-03-10T13:54:15.209092+0000 mgr.gibba045.orlgmj (mgr.34412) 342 : audit [DBG] from='client.44292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:54:16.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:16 gibba045 bash[25517]: audit 2021-03-10T13:54:15.472285+0000 mon.c (mon.1) 168 : audit [DBG] from='client.? 172.21.2.115:0/1319143965' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:54:18.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:18 gibba015 bash[29377]: cluster 2021-03-10T13:54:17.113819+0000 mgr.gibba045.orlgmj (mgr.34412) 343 : cluster [DBG] pgmap v177: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:54:18.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:18 gibba015 bash[29377]: cephadm 2021-03-10T13:54:17.405280+0000 mgr.gibba045.orlgmj (mgr.34412) 344 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T13:54:18.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:18 gibba015 bash[29377]: audit 2021-03-10T13:54:17.576606+0000 mon.a (mon.0) 578 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:54:18.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:18 gibba015 bash[30343]: cluster 2021-03-10T13:54:17.113819+0000 mgr.gibba045.orlgmj (mgr.34412) 343 : cluster [DBG] pgmap v177: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:54:18.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:18 gibba015 bash[30343]: cephadm 2021-03-10T13:54:17.405280+0000 mgr.gibba045.orlgmj (mgr.34412) 344 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T13:54:18.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:18 gibba015 bash[30343]: audit 2021-03-10T13:54:17.576606+0000 mon.a (mon.0) 578 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:54:19.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:18 gibba045 bash[25517]: cluster 2021-03-10T13:54:17.113819+0000 mgr.gibba045.orlgmj (mgr.34412) 343 : cluster [DBG] pgmap v177: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:54:19.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:18 gibba045 bash[25517]: cephadm 2021-03-10T13:54:17.405280+0000 mgr.gibba045.orlgmj (mgr.34412) 344 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T13:54:19.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:18 gibba045 bash[25517]: audit 2021-03-10T13:54:17.576606+0000 mon.a (mon.0) 578 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:54:20.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:20 gibba015 bash[29377]: cluster 2021-03-10T13:54:19.115149+0000 mgr.gibba045.orlgmj (mgr.34412) 345 : cluster [DBG] pgmap v178: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:54:20.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:20 gibba015 bash[30343]: cluster 2021-03-10T13:54:19.115149+0000 mgr.gibba045.orlgmj (mgr.34412) 345 : cluster [DBG] pgmap v178: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:54:21.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:20 gibba045 bash[25517]: cluster 2021-03-10T13:54:19.115149+0000 mgr.gibba045.orlgmj (mgr.34412) 345 : cluster [DBG] pgmap v178: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:54:22.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:22 gibba015 bash[29377]: cluster 2021-03-10T13:54:21.116917+0000 mgr.gibba045.orlgmj (mgr.34412) 346 : cluster [DBG] pgmap v179: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:54:22.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:22 gibba015 bash[30343]: cluster 2021-03-10T13:54:21.116917+0000 mgr.gibba045.orlgmj (mgr.34412) 346 : cluster [DBG] pgmap v179: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:54:23.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:22 gibba045 bash[25517]: cluster 2021-03-10T13:54:21.116917+0000 mgr.gibba045.orlgmj (mgr.34412) 346 : cluster [DBG] pgmap v179: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:54:24.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:24 gibba015 bash[29377]: cluster 2021-03-10T13:54:23.118318+0000 mgr.gibba045.orlgmj (mgr.34412) 347 : cluster [DBG] pgmap v180: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:54:24.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:24 gibba015 bash[30343]: cluster 2021-03-10T13:54:23.118318+0000 mgr.gibba045.orlgmj (mgr.34412) 347 : cluster [DBG] pgmap v180: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:54:25.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:24 gibba045 bash[25517]: cluster 2021-03-10T13:54:23.118318+0000 mgr.gibba045.orlgmj (mgr.34412) 347 : cluster [DBG] pgmap v180: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:54:26.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:26 gibba015 bash[29377]: cluster 2021-03-10T13:54:25.119847+0000 mgr.gibba045.orlgmj (mgr.34412) 348 : cluster [DBG] pgmap v181: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:54:26.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:26 gibba015 bash[30343]: cluster 2021-03-10T13:54:25.119847+0000 mgr.gibba045.orlgmj (mgr.34412) 348 : cluster [DBG] pgmap v181: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:54:27.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:26 gibba045 bash[25517]: cluster 2021-03-10T13:54:25.119847+0000 mgr.gibba045.orlgmj (mgr.34412) 348 : cluster [DBG] pgmap v181: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:54:28.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:28 gibba015 bash[29377]: cluster 2021-03-10T13:54:27.121530+0000 mgr.gibba045.orlgmj (mgr.34412) 349 : cluster [DBG] pgmap v182: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:54:28.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:28 gibba015 bash[30343]: cluster 2021-03-10T13:54:27.121530+0000 mgr.gibba045.orlgmj (mgr.34412) 349 : cluster [DBG] pgmap v182: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:54:29.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:28 gibba045 bash[25517]: cluster 2021-03-10T13:54:27.121530+0000 mgr.gibba045.orlgmj (mgr.34412) 349 : cluster [DBG] pgmap v182: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:54:30.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:30 gibba015 bash[29377]: cluster 2021-03-10T13:54:29.122737+0000 mgr.gibba045.orlgmj (mgr.34412) 350 : cluster [DBG] pgmap v183: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:54:30.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:30 gibba015 bash[30343]: cluster 2021-03-10T13:54:29.122737+0000 mgr.gibba045.orlgmj (mgr.34412) 350 : cluster [DBG] pgmap v183: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:54:31.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:30 gibba045 bash[25517]: cluster 2021-03-10T13:54:29.122737+0000 mgr.gibba045.orlgmj (mgr.34412) 350 : cluster [DBG] pgmap v183: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:54:32.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:32 gibba045 bash[25517]: cluster 2021-03-10T13:54:31.124342+0000 mgr.gibba045.orlgmj (mgr.34412) 351 : cluster [DBG] pgmap v184: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:54:32.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:32 gibba015 bash[29377]: cluster 2021-03-10T13:54:31.124342+0000 mgr.gibba045.orlgmj (mgr.34412) 351 : cluster [DBG] pgmap v184: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:54:32.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:32 gibba015 bash[30343]: cluster 2021-03-10T13:54:31.124342+0000 mgr.gibba045.orlgmj (mgr.34412) 351 : cluster [DBG] pgmap v184: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:54:33.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:33 gibba015 bash[29377]: cephadm 2021-03-10T13:54:32.421271+0000 mgr.gibba045.orlgmj (mgr.34412) 352 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T13:54:33.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:33 gibba015 bash[30343]: cephadm 2021-03-10T13:54:32.421271+0000 mgr.gibba045.orlgmj (mgr.34412) 352 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T13:54:34.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:33 gibba045 bash[25517]: cephadm 2021-03-10T13:54:32.421271+0000 mgr.gibba045.orlgmj (mgr.34412) 352 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T13:54:34.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:34 gibba015 bash[29377]: cluster 2021-03-10T13:54:33.125765+0000 mgr.gibba045.orlgmj (mgr.34412) 353 : cluster [DBG] pgmap v185: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:54:34.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:34 gibba015 bash[30343]: cluster 2021-03-10T13:54:33.125765+0000 mgr.gibba045.orlgmj (mgr.34412) 353 : cluster [DBG] pgmap v185: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:54:35.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:34 gibba045 bash[25517]: cluster 2021-03-10T13:54:33.125765+0000 mgr.gibba045.orlgmj (mgr.34412) 353 : cluster [DBG] pgmap v185: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:54:36.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:36 gibba015 bash[29377]: cluster 2021-03-10T13:54:35.127419+0000 mgr.gibba045.orlgmj (mgr.34412) 354 : cluster [DBG] pgmap v186: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:54:36.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:36 gibba015 bash[30343]: cluster 2021-03-10T13:54:35.127419+0000 mgr.gibba045.orlgmj (mgr.34412) 354 : cluster [DBG] pgmap v186: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:54:37.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:36 gibba045 bash[25517]: cluster 2021-03-10T13:54:35.127419+0000 mgr.gibba045.orlgmj (mgr.34412) 354 : cluster [DBG] pgmap v186: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:54:38.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:38 gibba015 bash[29377]: cluster 2021-03-10T13:54:37.129123+0000 mgr.gibba045.orlgmj (mgr.34412) 355 : cluster [DBG] pgmap v187: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:54:38.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:38 gibba015 bash[30343]: cluster 2021-03-10T13:54:37.129123+0000 mgr.gibba045.orlgmj (mgr.34412) 355 : cluster [DBG] pgmap v187: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:54:39.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:38 gibba045 bash[25517]: cluster 2021-03-10T13:54:37.129123+0000 mgr.gibba045.orlgmj (mgr.34412) 355 : cluster [DBG] pgmap v187: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:54:40.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:40 gibba015 bash[29377]: cluster 2021-03-10T13:54:39.130398+0000 mgr.gibba045.orlgmj (mgr.34412) 356 : cluster [DBG] pgmap v188: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:54:40.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:40 gibba015 bash[30343]: cluster 2021-03-10T13:54:39.130398+0000 mgr.gibba045.orlgmj (mgr.34412) 356 : cluster [DBG] pgmap v188: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:54:41.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:40 gibba045 bash[25517]: cluster 2021-03-10T13:54:39.130398+0000 mgr.gibba045.orlgmj (mgr.34412) 356 : cluster [DBG] pgmap v188: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:54:42.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:42 gibba015 bash[29377]: cluster 2021-03-10T13:54:41.131886+0000 mgr.gibba045.orlgmj (mgr.34412) 357 : cluster [DBG] pgmap v189: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:54:42.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:42 gibba015 bash[30343]: cluster 2021-03-10T13:54:41.131886+0000 mgr.gibba045.orlgmj (mgr.34412) 357 : cluster [DBG] pgmap v189: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:54:43.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:42 gibba045 bash[25517]: cluster 2021-03-10T13:54:41.131886+0000 mgr.gibba045.orlgmj (mgr.34412) 357 : cluster [DBG] pgmap v189: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:54:44.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:44 gibba015 bash[29377]: cluster 2021-03-10T13:54:43.133459+0000 mgr.gibba045.orlgmj (mgr.34412) 358 : cluster [DBG] pgmap v190: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:54:44.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:44 gibba015 bash[30343]: cluster 2021-03-10T13:54:43.133459+0000 mgr.gibba045.orlgmj (mgr.34412) 358 : cluster [DBG] pgmap v190: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:54:45.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:44 gibba045 bash[25517]: cluster 2021-03-10T13:54:43.133459+0000 mgr.gibba045.orlgmj (mgr.34412) 358 : cluster [DBG] pgmap v190: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:54:45.716 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T13:54:45.942 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T13:54:45.943 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (5m) 2m ago 10m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T13:54:45.943 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (10m) 44s ago 10m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T13:54:45.943 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (5m) 44s ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T13:54:45.943 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (6m) 44s ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T13:54:45.944 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (5m) 2m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T13:54:45.944 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (5m) 2m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T13:54:45.944 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (4m) 44s ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T13:54:45.944 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (4m) 2m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T13:54:45.944 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (10m) 2m ago 11m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T13:54:45.945 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (11m) 44s ago 11m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T13:54:45.945 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3m) 2m ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T13:54:45.945 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3m) 2m ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T13:54:45.945 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2m) 2m ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T13:54:45.945 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2m) 2m ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T13:54:45.946 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2m) 44s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T13:54:45.946 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (100s) 44s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T13:54:45.946 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (73s) 44s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T13:54:45.947 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (46s) 44s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T13:54:45.947 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (10m) 44s ago 11m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T13:54:45.947 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 44s ago 9m docker.io/ceph/ceph:v15.2.0 2021-03-10T13:54:46.187 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T13:54:46.188 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T13:54:46.188 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:54:46.188 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T13:54:46.188 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T13:54:46.188 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:54:46.189 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T13:54:46.189 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T13:54:46.189 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T13:54:46.189 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T13:54:46.189 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T13:54:46.190 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T13:54:46.190 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T13:54:46.190 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T13:54:46.190 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T13:54:46.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:46 gibba015 bash[29377]: cluster 2021-03-10T13:54:45.134664+0000 mgr.gibba045.orlgmj (mgr.34412) 359 : cluster [DBG] pgmap v191: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:54:46.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:46 gibba015 bash[29377]: audit 2021-03-10T13:54:45.707990+0000 mgr.gibba045.orlgmj (mgr.34412) 360 : audit [DBG] from='client.54292 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:54:46.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:46 gibba015 bash[29377]: audit 2021-03-10T13:54:46.185209+0000 mon.c (mon.1) 169 : audit [DBG] from='client.? 172.21.2.115:0/120437034' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:54:46.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:46 gibba015 bash[30343]: cluster 2021-03-10T13:54:45.134664+0000 mgr.gibba045.orlgmj (mgr.34412) 359 : cluster [DBG] pgmap v191: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:54:46.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:46 gibba015 bash[30343]: audit 2021-03-10T13:54:45.707990+0000 mgr.gibba045.orlgmj (mgr.34412) 360 : audit [DBG] from='client.54292 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:54:46.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:46 gibba015 bash[30343]: audit 2021-03-10T13:54:46.185209+0000 mon.c (mon.1) 169 : audit [DBG] from='client.? 172.21.2.115:0/120437034' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:54:47.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:46 gibba045 bash[25517]: cluster 2021-03-10T13:54:45.134664+0000 mgr.gibba045.orlgmj (mgr.34412) 359 : cluster [DBG] pgmap v191: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:54:47.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:46 gibba045 bash[25517]: audit 2021-03-10T13:54:45.707990+0000 mgr.gibba045.orlgmj (mgr.34412) 360 : audit [DBG] from='client.54292 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:54:47.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:46 gibba045 bash[25517]: audit 2021-03-10T13:54:46.185209+0000 mon.c (mon.1) 169 : audit [DBG] from='client.? 172.21.2.115:0/120437034' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:54:47.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:47 gibba015 bash[29377]: audit 2021-03-10T13:54:45.929595+0000 mgr.gibba045.orlgmj (mgr.34412) 361 : audit [DBG] from='client.44310 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:54:47.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:47 gibba015 bash[30343]: audit 2021-03-10T13:54:45.929595+0000 mgr.gibba045.orlgmj (mgr.34412) 361 : audit [DBG] from='client.44310 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:54:48.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:47 gibba045 bash[25517]: audit 2021-03-10T13:54:45.929595+0000 mgr.gibba045.orlgmj (mgr.34412) 361 : audit [DBG] from='client.44310 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:54:48.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:48 gibba015 bash[29377]: cluster 2021-03-10T13:54:47.136283+0000 mgr.gibba045.orlgmj (mgr.34412) 362 : cluster [DBG] pgmap v192: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:54:48.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:48 gibba015 bash[29377]: cephadm 2021-03-10T13:54:47.437210+0000 mgr.gibba045.orlgmj (mgr.34412) 363 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T13:54:48.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:48 gibba015 bash[30343]: cluster 2021-03-10T13:54:47.136283+0000 mgr.gibba045.orlgmj (mgr.34412) 362 : cluster [DBG] pgmap v192: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:54:48.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:48 gibba015 bash[30343]: cephadm 2021-03-10T13:54:47.437210+0000 mgr.gibba045.orlgmj (mgr.34412) 363 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T13:54:49.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:48 gibba045 bash[25517]: cluster 2021-03-10T13:54:47.136283+0000 mgr.gibba045.orlgmj (mgr.34412) 362 : cluster [DBG] pgmap v192: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:54:49.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:48 gibba045 bash[25517]: cephadm 2021-03-10T13:54:47.437210+0000 mgr.gibba045.orlgmj (mgr.34412) 363 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T13:54:51.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:50 gibba045 bash[25517]: cluster 2021-03-10T13:54:49.137467+0000 mgr.gibba045.orlgmj (mgr.34412) 364 : cluster [DBG] pgmap v193: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:54:51.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:50 gibba015 bash[29377]: cluster 2021-03-10T13:54:49.137467+0000 mgr.gibba045.orlgmj (mgr.34412) 364 : cluster [DBG] pgmap v193: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:54:51.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:50 gibba015 bash[30343]: cluster 2021-03-10T13:54:49.137467+0000 mgr.gibba045.orlgmj (mgr.34412) 364 : cluster [DBG] pgmap v193: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:54:53.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:52 gibba045 bash[25517]: cluster 2021-03-10T13:54:51.138130+0000 mgr.gibba045.orlgmj (mgr.34412) 365 : cluster [DBG] pgmap v194: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:54:53.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:52 gibba045 bash[25517]: audit 2021-03-10T13:54:52.383789+0000 mon.c (mon.1) 170 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T13:54:53.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:52 gibba045 bash[25517]: audit 2021-03-10T13:54:52.384526+0000 mon.c (mon.1) 171 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T13:54:53.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:52 gibba045 bash[25517]: audit 2021-03-10T13:54:52.384992+0000 mon.a (mon.0) 579 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T13:54:53.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:52 gibba045 bash[25517]: audit 2021-03-10T13:54:52.385248+0000 mon.c (mon.1) 172 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T13:54:53.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:52 gibba045 bash[25517]: audit 2021-03-10T13:54:52.386054+0000 mon.c (mon.1) 173 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T13:54:53.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:52 gibba045 bash[25517]: audit 2021-03-10T13:54:52.386495+0000 mon.a (mon.0) 580 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T13:54:53.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:52 gibba045 bash[25517]: audit 2021-03-10T13:54:52.387524+0000 mon.a (mon.0) 581 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T13:54:53.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:52 gibba045 bash[25517]: audit 2021-03-10T13:54:52.388337+0000 mon.a (mon.0) 582 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T13:54:53.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:52 gibba045 bash[25517]: audit 2021-03-10T13:54:52.491081+0000 mon.c (mon.1) 174 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:54:53.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:52 gibba045 bash[25517]: audit 2021-03-10T13:54:52.492041+0000 mon.c (mon.1) 175 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T13:54:53.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:52 gibba045 bash[25517]: audit 2021-03-10T13:54:52.492229+0000 mon.a (mon.0) 583 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:54:53.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:52 gibba045 bash[25517]: audit 2021-03-10T13:54:52.493308+0000 mon.a (mon.0) 584 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T13:54:53.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:52 gibba015 bash[29377]: cluster 2021-03-10T13:54:51.138130+0000 mgr.gibba045.orlgmj (mgr.34412) 365 : cluster [DBG] pgmap v194: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:54:53.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:52 gibba015 bash[29377]: audit 2021-03-10T13:54:52.383789+0000 mon.c (mon.1) 170 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T13:54:53.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:52 gibba015 bash[29377]: audit 2021-03-10T13:54:52.384526+0000 mon.c (mon.1) 171 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T13:54:53.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:52 gibba015 bash[29377]: audit 2021-03-10T13:54:52.384992+0000 mon.a (mon.0) 579 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T13:54:53.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:52 gibba015 bash[29377]: audit 2021-03-10T13:54:52.385248+0000 mon.c (mon.1) 172 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T13:54:53.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:52 gibba015 bash[29377]: audit 2021-03-10T13:54:52.386054+0000 mon.c (mon.1) 173 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T13:54:53.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:52 gibba015 bash[29377]: audit 2021-03-10T13:54:52.386495+0000 mon.a (mon.0) 580 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T13:54:53.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:52 gibba015 bash[29377]: audit 2021-03-10T13:54:52.387524+0000 mon.a (mon.0) 581 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T13:54:53.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:52 gibba015 bash[29377]: audit 2021-03-10T13:54:52.388337+0000 mon.a (mon.0) 582 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T13:54:53.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:52 gibba015 bash[29377]: audit 2021-03-10T13:54:52.491081+0000 mon.c (mon.1) 174 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:54:53.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:52 gibba015 bash[29377]: audit 2021-03-10T13:54:52.492041+0000 mon.c (mon.1) 175 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T13:54:53.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:52 gibba015 bash[29377]: audit 2021-03-10T13:54:52.492229+0000 mon.a (mon.0) 583 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:54:53.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:52 gibba015 bash[29377]: audit 2021-03-10T13:54:52.493308+0000 mon.a (mon.0) 584 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T13:54:53.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:52 gibba015 bash[30343]: cluster 2021-03-10T13:54:51.138130+0000 mgr.gibba045.orlgmj (mgr.34412) 365 : cluster [DBG] pgmap v194: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:54:53.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:52 gibba015 bash[30343]: audit 2021-03-10T13:54:52.383789+0000 mon.c (mon.1) 170 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T13:54:53.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:52 gibba015 bash[30343]: audit 2021-03-10T13:54:52.384526+0000 mon.c (mon.1) 171 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T13:54:53.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:52 gibba015 bash[30343]: audit 2021-03-10T13:54:52.384992+0000 mon.a (mon.0) 579 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T13:54:53.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:52 gibba015 bash[30343]: audit 2021-03-10T13:54:52.385248+0000 mon.c (mon.1) 172 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T13:54:53.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:52 gibba015 bash[30343]: audit 2021-03-10T13:54:52.386054+0000 mon.c (mon.1) 173 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T13:54:53.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:52 gibba015 bash[30343]: audit 2021-03-10T13:54:52.386495+0000 mon.a (mon.0) 580 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T13:54:53.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:52 gibba015 bash[30343]: audit 2021-03-10T13:54:52.387524+0000 mon.a (mon.0) 581 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T13:54:53.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:52 gibba015 bash[30343]: audit 2021-03-10T13:54:52.388337+0000 mon.a (mon.0) 582 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T13:54:53.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:52 gibba015 bash[30343]: audit 2021-03-10T13:54:52.491081+0000 mon.c (mon.1) 174 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:54:53.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:52 gibba015 bash[30343]: audit 2021-03-10T13:54:52.492041+0000 mon.c (mon.1) 175 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T13:54:53.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:52 gibba015 bash[30343]: audit 2021-03-10T13:54:52.492229+0000 mon.a (mon.0) 583 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:54:53.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:52 gibba015 bash[30343]: audit 2021-03-10T13:54:52.493308+0000 mon.a (mon.0) 584 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T13:54:55.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:54 gibba045 bash[25517]: cluster 2021-03-10T13:54:53.139500+0000 mgr.gibba045.orlgmj (mgr.34412) 366 : cluster [DBG] pgmap v195: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:54:55.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:54 gibba015 bash[29377]: cluster 2021-03-10T13:54:53.139500+0000 mgr.gibba045.orlgmj (mgr.34412) 366 : cluster [DBG] pgmap v195: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:54:55.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:54 gibba015 bash[30343]: cluster 2021-03-10T13:54:53.139500+0000 mgr.gibba045.orlgmj (mgr.34412) 366 : cluster [DBG] pgmap v195: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:54:57.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:56 gibba045 bash[25517]: cluster 2021-03-10T13:54:55.141277+0000 mgr.gibba045.orlgmj (mgr.34412) 367 : cluster [DBG] pgmap v196: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:54:57.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:56 gibba015 bash[29377]: cluster 2021-03-10T13:54:55.141277+0000 mgr.gibba045.orlgmj (mgr.34412) 367 : cluster [DBG] pgmap v196: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:54:57.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:56 gibba015 bash[30343]: cluster 2021-03-10T13:54:55.141277+0000 mgr.gibba045.orlgmj (mgr.34412) 367 : cluster [DBG] pgmap v196: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:54:59.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:54:58 gibba045 bash[25517]: cluster 2021-03-10T13:54:57.141812+0000 mgr.gibba045.orlgmj (mgr.34412) 368 : cluster [DBG] pgmap v197: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:54:59.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:54:58 gibba015 bash[29377]: cluster 2021-03-10T13:54:57.141812+0000 mgr.gibba045.orlgmj (mgr.34412) 368 : cluster [DBG] pgmap v197: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:54:59.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:54:58 gibba015 bash[30343]: cluster 2021-03-10T13:54:57.141812+0000 mgr.gibba045.orlgmj (mgr.34412) 368 : cluster [DBG] pgmap v197: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:01.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:55:00 gibba045 bash[25517]: cluster 2021-03-10T13:54:59.142935+0000 mgr.gibba045.orlgmj (mgr.34412) 369 : cluster [DBG] pgmap v198: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:01.131 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:55:00 gibba015 bash[29377]: cluster 2021-03-10T13:54:59.142935+0000 mgr.gibba045.orlgmj (mgr.34412) 369 : cluster [DBG] pgmap v198: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:01.131 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:55:00 gibba015 bash[30343]: cluster 2021-03-10T13:54:59.142935+0000 mgr.gibba045.orlgmj (mgr.34412) 369 : cluster [DBG] pgmap v198: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:03.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:55:02 gibba045 bash[25517]: cluster 2021-03-10T13:55:01.144805+0000 mgr.gibba045.orlgmj (mgr.34412) 370 : cluster [DBG] pgmap v199: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:03.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:55:02 gibba045 bash[25517]: audit 2021-03-10T13:55:02.446955+0000 mon.c (mon.1) 176 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:55:03.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:55:02 gibba045 bash[25517]: audit 2021-03-10T13:55:02.664792+0000 mon.a (mon.0) 585 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:55:03.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:55:02 gibba045 bash[25517]: audit 2021-03-10T13:55:02.668459+0000 mon.c (mon.1) 177 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:55:03.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:55:02 gibba045 bash[25517]: audit 2021-03-10T13:55:02.669671+0000 mon.c (mon.1) 178 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:03.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:55:02 gibba045 bash[25517]: audit 2021-03-10T13:55:02.670879+0000 mon.c (mon.1) 179 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:03.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:55:02 gibba045 bash[25517]: audit 2021-03-10T13:55:02.672184+0000 mon.c (mon.1) 180 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:03.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:55:02 gibba045 bash[25517]: audit 2021-03-10T13:55:02.675495+0000 mon.c (mon.1) 181 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:03.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:55:02 gibba045 bash[25517]: audit 2021-03-10T13:55:02.677168+0000 mon.c (mon.1) 182 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:03.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:55:02 gibba015 bash[29377]: cluster 2021-03-10T13:55:01.144805+0000 mgr.gibba045.orlgmj (mgr.34412) 370 : cluster [DBG] pgmap v199: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:03.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:55:02 gibba015 bash[29377]: audit 2021-03-10T13:55:02.446955+0000 mon.c (mon.1) 176 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:55:03.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:55:02 gibba015 bash[29377]: audit 2021-03-10T13:55:02.664792+0000 mon.a (mon.0) 585 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:55:03.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:55:02 gibba015 bash[29377]: audit 2021-03-10T13:55:02.668459+0000 mon.c (mon.1) 177 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:55:03.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:55:02 gibba015 bash[29377]: audit 2021-03-10T13:55:02.669671+0000 mon.c (mon.1) 178 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:03.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:55:02 gibba015 bash[29377]: audit 2021-03-10T13:55:02.670879+0000 mon.c (mon.1) 179 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:03.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:55:02 gibba015 bash[29377]: audit 2021-03-10T13:55:02.672184+0000 mon.c (mon.1) 180 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:03.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:55:02 gibba015 bash[29377]: audit 2021-03-10T13:55:02.675495+0000 mon.c (mon.1) 181 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:03.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:55:02 gibba015 bash[29377]: audit 2021-03-10T13:55:02.677168+0000 mon.c (mon.1) 182 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:03.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:55:02 gibba015 bash[30343]: cluster 2021-03-10T13:55:01.144805+0000 mgr.gibba045.orlgmj (mgr.34412) 370 : cluster [DBG] pgmap v199: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:03.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:55:02 gibba015 bash[30343]: audit 2021-03-10T13:55:02.446955+0000 mon.c (mon.1) 176 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:55:03.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:55:02 gibba015 bash[30343]: audit 2021-03-10T13:55:02.664792+0000 mon.a (mon.0) 585 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:55:03.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:55:02 gibba015 bash[30343]: audit 2021-03-10T13:55:02.668459+0000 mon.c (mon.1) 177 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:55:03.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:55:02 gibba015 bash[30343]: audit 2021-03-10T13:55:02.669671+0000 mon.c (mon.1) 178 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:03.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:55:02 gibba015 bash[30343]: audit 2021-03-10T13:55:02.670879+0000 mon.c (mon.1) 179 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:03.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:55:02 gibba015 bash[30343]: audit 2021-03-10T13:55:02.672184+0000 mon.c (mon.1) 180 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:03.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:55:02 gibba015 bash[30343]: audit 2021-03-10T13:55:02.675495+0000 mon.c (mon.1) 181 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:03.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:55:02 gibba015 bash[30343]: audit 2021-03-10T13:55:02.677168+0000 mon.c (mon.1) 182 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:04.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:55:03 gibba045 bash[25517]: cephadm 2021-03-10T13:55:02.451532+0000 mgr.gibba045.orlgmj (mgr.34412) 371 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T13:55:04.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:55:03 gibba045 bash[25517]: cephadm 2021-03-10T13:55:02.451936+0000 mgr.gibba045.orlgmj (mgr.34412) 372 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T13:55:04.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:55:03 gibba045 bash[25517]: cephadm 2021-03-10T13:55:02.670245+0000 mgr.gibba045.orlgmj (mgr.34412) 373 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:55:04.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:55:03 gibba045 bash[25517]: cephadm 2021-03-10T13:55:02.671808+0000 mgr.gibba045.orlgmj (mgr.34412) 374 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:55:04.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:55:03 gibba045 bash[25517]: cephadm 2021-03-10T13:55:02.672882+0000 mgr.gibba045.orlgmj (mgr.34412) 375 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:55:04.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:55:03 gibba045 bash[25517]: cephadm 2021-03-10T13:55:02.672921+0000 mgr.gibba045.orlgmj (mgr.34412) 376 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:55:04.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:55:03 gibba045 bash[25517]: cephadm 2021-03-10T13:55:02.674218+0000 mgr.gibba045.orlgmj (mgr.34412) 377 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:55:04.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:55:03 gibba045 bash[25517]: cephadm 2021-03-10T13:55:02.674256+0000 mgr.gibba045.orlgmj (mgr.34412) 378 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:55:04.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:55:03 gibba045 bash[25517]: cephadm 2021-03-10T13:55:02.675535+0000 mgr.gibba045.orlgmj (mgr.34412) 379 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:55:04.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:55:03 gibba045 bash[25517]: cephadm 2021-03-10T13:55:02.677431+0000 mgr.gibba045.orlgmj (mgr.34412) 380 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:55:04.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:55:03 gibba045 bash[25517]: cephadm 2021-03-10T13:55:02.677468+0000 mgr.gibba045.orlgmj (mgr.34412) 381 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:55:04.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:55:03 gibba045 bash[25517]: cephadm 2021-03-10T13:55:02.678945+0000 mgr.gibba045.orlgmj (mgr.34412) 382 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T13:55:04.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:55:03 gibba045 bash[25517]: cephadm 2021-03-10T13:55:02.679259+0000 mgr.gibba045.orlgmj (mgr.34412) 383 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T13:55:04.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:55:03 gibba045 bash[25517]: cephadm 2021-03-10T13:55:02.680623+0000 mgr.gibba045.orlgmj (mgr.34412) 384 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T13:55:04.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:55:03 gibba045 bash[25517]: cephadm 2021-03-10T13:55:02.680664+0000 mgr.gibba045.orlgmj (mgr.34412) 385 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T13:55:04.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:55:03 gibba045 bash[25517]: cephadm 2021-03-10T13:55:02.680768+0000 mgr.gibba045.orlgmj (mgr.34412) 386 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T13:55:04.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:55:03 gibba015 bash[29377]: cephadm 2021-03-10T13:55:02.451532+0000 mgr.gibba045.orlgmj (mgr.34412) 371 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T13:55:04.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:55:03 gibba015 bash[29377]: cephadm 2021-03-10T13:55:02.451936+0000 mgr.gibba045.orlgmj (mgr.34412) 372 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T13:55:04.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:55:03 gibba015 bash[29377]: cephadm 2021-03-10T13:55:02.670245+0000 mgr.gibba045.orlgmj (mgr.34412) 373 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:55:04.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:55:03 gibba015 bash[29377]: cephadm 2021-03-10T13:55:02.671808+0000 mgr.gibba045.orlgmj (mgr.34412) 374 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:55:04.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:55:03 gibba015 bash[29377]: cephadm 2021-03-10T13:55:02.672882+0000 mgr.gibba045.orlgmj (mgr.34412) 375 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:55:04.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:55:03 gibba015 bash[29377]: cephadm 2021-03-10T13:55:02.672921+0000 mgr.gibba045.orlgmj (mgr.34412) 376 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:55:04.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:55:03 gibba015 bash[29377]: cephadm 2021-03-10T13:55:02.674218+0000 mgr.gibba045.orlgmj (mgr.34412) 377 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:55:04.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:55:03 gibba015 bash[29377]: cephadm 2021-03-10T13:55:02.674256+0000 mgr.gibba045.orlgmj (mgr.34412) 378 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:55:04.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:55:03 gibba015 bash[29377]: cephadm 2021-03-10T13:55:02.675535+0000 mgr.gibba045.orlgmj (mgr.34412) 379 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:55:04.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:55:03 gibba015 bash[29377]: cephadm 2021-03-10T13:55:02.677431+0000 mgr.gibba045.orlgmj (mgr.34412) 380 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:55:04.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:55:03 gibba015 bash[29377]: cephadm 2021-03-10T13:55:02.677468+0000 mgr.gibba045.orlgmj (mgr.34412) 381 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:55:04.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:55:03 gibba015 bash[29377]: cephadm 2021-03-10T13:55:02.678945+0000 mgr.gibba045.orlgmj (mgr.34412) 382 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T13:55:04.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:55:03 gibba015 bash[29377]: cephadm 2021-03-10T13:55:02.679259+0000 mgr.gibba045.orlgmj (mgr.34412) 383 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T13:55:04.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:55:03 gibba015 bash[29377]: cephadm 2021-03-10T13:55:02.680623+0000 mgr.gibba045.orlgmj (mgr.34412) 384 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T13:55:04.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:55:03 gibba015 bash[29377]: cephadm 2021-03-10T13:55:02.680664+0000 mgr.gibba045.orlgmj (mgr.34412) 385 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T13:55:04.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:55:03 gibba015 bash[29377]: cephadm 2021-03-10T13:55:02.680768+0000 mgr.gibba045.orlgmj (mgr.34412) 386 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T13:55:04.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:55:03 gibba015 bash[30343]: cephadm 2021-03-10T13:55:02.451532+0000 mgr.gibba045.orlgmj (mgr.34412) 371 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T13:55:04.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:55:03 gibba015 bash[30343]: cephadm 2021-03-10T13:55:02.451936+0000 mgr.gibba045.orlgmj (mgr.34412) 372 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T13:55:04.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:55:03 gibba015 bash[30343]: cephadm 2021-03-10T13:55:02.670245+0000 mgr.gibba045.orlgmj (mgr.34412) 373 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:55:04.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:55:03 gibba015 bash[30343]: cephadm 2021-03-10T13:55:02.671808+0000 mgr.gibba045.orlgmj (mgr.34412) 374 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:55:04.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:55:03 gibba015 bash[30343]: cephadm 2021-03-10T13:55:02.672882+0000 mgr.gibba045.orlgmj (mgr.34412) 375 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:55:04.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:55:03 gibba015 bash[30343]: cephadm 2021-03-10T13:55:02.672921+0000 mgr.gibba045.orlgmj (mgr.34412) 376 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:55:04.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:55:03 gibba015 bash[30343]: cephadm 2021-03-10T13:55:02.674218+0000 mgr.gibba045.orlgmj (mgr.34412) 377 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:55:04.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:55:03 gibba015 bash[30343]: cephadm 2021-03-10T13:55:02.674256+0000 mgr.gibba045.orlgmj (mgr.34412) 378 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:55:04.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:55:03 gibba015 bash[30343]: cephadm 2021-03-10T13:55:02.675535+0000 mgr.gibba045.orlgmj (mgr.34412) 379 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:55:04.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:55:03 gibba015 bash[30343]: cephadm 2021-03-10T13:55:02.677431+0000 mgr.gibba045.orlgmj (mgr.34412) 380 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:55:04.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:55:03 gibba015 bash[30343]: cephadm 2021-03-10T13:55:02.677468+0000 mgr.gibba045.orlgmj (mgr.34412) 381 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:55:04.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:55:03 gibba015 bash[30343]: cephadm 2021-03-10T13:55:02.678945+0000 mgr.gibba045.orlgmj (mgr.34412) 382 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T13:55:04.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:55:03 gibba015 bash[30343]: cephadm 2021-03-10T13:55:02.679259+0000 mgr.gibba045.orlgmj (mgr.34412) 383 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T13:55:04.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:55:03 gibba015 bash[30343]: cephadm 2021-03-10T13:55:02.680623+0000 mgr.gibba045.orlgmj (mgr.34412) 384 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T13:55:04.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:55:03 gibba015 bash[30343]: cephadm 2021-03-10T13:55:02.680664+0000 mgr.gibba045.orlgmj (mgr.34412) 385 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T13:55:04.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:55:03 gibba015 bash[30343]: cephadm 2021-03-10T13:55:02.680768+0000 mgr.gibba045.orlgmj (mgr.34412) 386 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T13:55:05.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:55:04 gibba045 bash[25517]: cluster 2021-03-10T13:55:03.145531+0000 mgr.gibba045.orlgmj (mgr.34412) 387 : cluster [DBG] pgmap v200: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:05.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:55:04 gibba015 bash[29377]: cluster 2021-03-10T13:55:03.145531+0000 mgr.gibba045.orlgmj (mgr.34412) 387 : cluster [DBG] pgmap v200: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:05.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:55:04 gibba015 bash[30343]: cluster 2021-03-10T13:55:03.145531+0000 mgr.gibba045.orlgmj (mgr.34412) 387 : cluster [DBG] pgmap v200: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:07.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:55:06 gibba015 bash[29377]: cluster 2021-03-10T13:55:05.147000+0000 mgr.gibba045.orlgmj (mgr.34412) 388 : cluster [DBG] pgmap v201: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:07.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:55:06 gibba015 bash[30343]: cluster 2021-03-10T13:55:05.147000+0000 mgr.gibba045.orlgmj (mgr.34412) 388 : cluster [DBG] pgmap v201: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:07.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:55:06 gibba045 bash[25517]: cluster 2021-03-10T13:55:05.147000+0000 mgr.gibba045.orlgmj (mgr.34412) 388 : cluster [DBG] pgmap v201: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:09.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:55:08 gibba015 bash[29377]: cluster 2021-03-10T13:55:07.148863+0000 mgr.gibba045.orlgmj (mgr.34412) 389 : cluster [DBG] pgmap v202: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:09.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:55:08 gibba015 bash[30343]: cluster 2021-03-10T13:55:07.148863+0000 mgr.gibba045.orlgmj (mgr.34412) 389 : cluster [DBG] pgmap v202: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:09.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:55:08 gibba045 bash[25517]: cluster 2021-03-10T13:55:07.148863+0000 mgr.gibba045.orlgmj (mgr.34412) 389 : cluster [DBG] pgmap v202: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:11.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:55:10 gibba015 bash[29377]: cluster 2021-03-10T13:55:09.149353+0000 mgr.gibba045.orlgmj (mgr.34412) 390 : cluster [DBG] pgmap v203: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:11.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:55:10 gibba015 bash[30343]: cluster 2021-03-10T13:55:09.149353+0000 mgr.gibba045.orlgmj (mgr.34412) 390 : cluster [DBG] pgmap v203: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:11.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:55:10 gibba045 bash[25517]: cluster 2021-03-10T13:55:09.149353+0000 mgr.gibba045.orlgmj (mgr.34412) 390 : cluster [DBG] pgmap v203: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:13.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:55:12 gibba015 bash[29377]: cluster 2021-03-10T13:55:11.150944+0000 mgr.gibba045.orlgmj (mgr.34412) 391 : cluster [DBG] pgmap v204: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:13.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:55:12 gibba015 bash[30343]: cluster 2021-03-10T13:55:11.150944+0000 mgr.gibba045.orlgmj (mgr.34412) 391 : cluster [DBG] pgmap v204: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:13.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:55:12 gibba045 bash[25517]: cluster 2021-03-10T13:55:11.150944+0000 mgr.gibba045.orlgmj (mgr.34412) 391 : cluster [DBG] pgmap v204: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:15.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:55:14 gibba015 bash[29377]: cluster 2021-03-10T13:55:13.152679+0000 mgr.gibba045.orlgmj (mgr.34412) 392 : cluster [DBG] pgmap v205: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:15.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:55:14 gibba015 bash[30343]: cluster 2021-03-10T13:55:13.152679+0000 mgr.gibba045.orlgmj (mgr.34412) 392 : cluster [DBG] pgmap v205: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:15.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:55:14 gibba045 bash[25517]: cluster 2021-03-10T13:55:13.152679+0000 mgr.gibba045.orlgmj (mgr.34412) 392 : cluster [DBG] pgmap v205: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:16.432 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T13:55:16.660 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T13:55:16.660 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (5m) 2m ago 11m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T13:55:16.660 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (11m) 75s ago 11m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T13:55:16.661 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (6m) 75s ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T13:55:16.661 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (6m) 75s ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T13:55:16.661 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (5m) 2m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T13:55:16.661 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (5m) 2m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T13:55:16.661 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (5m) 75s ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T13:55:16.662 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (5m) 2m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T13:55:16.662 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (11m) 2m ago 11m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T13:55:16.662 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (11m) 75s ago 11m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T13:55:16.662 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (4m) 2m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T13:55:16.663 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3m) 2m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T13:55:16.663 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3m) 2m ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T13:55:16.663 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3m) 2m ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T13:55:16.663 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2m) 75s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T13:55:16.663 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2m) 75s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T13:55:16.664 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (104s) 75s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T13:55:16.664 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (77s) 75s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T13:55:16.664 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (10m) 75s ago 11m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T13:55:16.664 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 75s ago 9m docker.io/ceph/ceph:v15.2.0 2021-03-10T13:55:16.908 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T13:55:16.909 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T13:55:16.909 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:55:16.909 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T13:55:16.909 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T13:55:16.910 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:55:16.910 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T13:55:16.910 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T13:55:16.910 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T13:55:16.910 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T13:55:16.911 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T13:55:16.911 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T13:55:16.911 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T13:55:16.911 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T13:55:16.912 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T13:55:17.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:55:16 gibba015 bash[29377]: cluster 2021-03-10T13:55:15.153420+0000 mgr.gibba045.orlgmj (mgr.34412) 393 : cluster [DBG] pgmap v206: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:17.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:55:16 gibba015 bash[30343]: cluster 2021-03-10T13:55:15.153420+0000 mgr.gibba045.orlgmj (mgr.34412) 393 : cluster [DBG] pgmap v206: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:17.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:55:16 gibba045 bash[25517]: cluster 2021-03-10T13:55:15.153420+0000 mgr.gibba045.orlgmj (mgr.34412) 393 : cluster [DBG] pgmap v206: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:18.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:55:17 gibba045 bash[25517]: audit 2021-03-10T13:55:16.422800+0000 mgr.gibba045.orlgmj (mgr.34412) 394 : audit [DBG] from='client.54310 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:55:18.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:55:17 gibba045 bash[25517]: audit 2021-03-10T13:55:16.647100+0000 mgr.gibba045.orlgmj (mgr.34412) 395 : audit [DBG] from='client.54316 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:55:18.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:55:17 gibba045 bash[25517]: audit 2021-03-10T13:55:16.905926+0000 mon.a (mon.0) 586 : audit [DBG] from='client.? 172.21.2.115:0/2847757723' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:18.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:55:17 gibba015 bash[29377]: audit 2021-03-10T13:55:16.422800+0000 mgr.gibba045.orlgmj (mgr.34412) 394 : audit [DBG] from='client.54310 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:55:18.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:55:17 gibba015 bash[29377]: audit 2021-03-10T13:55:16.647100+0000 mgr.gibba045.orlgmj (mgr.34412) 395 : audit [DBG] from='client.54316 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:55:18.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:55:17 gibba015 bash[29377]: audit 2021-03-10T13:55:16.905926+0000 mon.a (mon.0) 586 : audit [DBG] from='client.? 172.21.2.115:0/2847757723' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:18.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:55:17 gibba015 bash[30343]: audit 2021-03-10T13:55:16.422800+0000 mgr.gibba045.orlgmj (mgr.34412) 394 : audit [DBG] from='client.54310 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:55:18.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:55:17 gibba015 bash[30343]: audit 2021-03-10T13:55:16.647100+0000 mgr.gibba045.orlgmj (mgr.34412) 395 : audit [DBG] from='client.54316 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:55:18.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:55:17 gibba015 bash[30343]: audit 2021-03-10T13:55:16.905926+0000 mon.a (mon.0) 586 : audit [DBG] from='client.? 172.21.2.115:0/2847757723' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:19.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:55:18 gibba015 bash[29377]: cluster 2021-03-10T13:55:17.154789+0000 mgr.gibba045.orlgmj (mgr.34412) 396 : cluster [DBG] pgmap v207: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:19.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:55:18 gibba015 bash[29377]: cephadm 2021-03-10T13:55:17.696571+0000 mgr.gibba045.orlgmj (mgr.34412) 397 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T13:55:19.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:55:18 gibba015 bash[30343]: cluster 2021-03-10T13:55:17.154789+0000 mgr.gibba045.orlgmj (mgr.34412) 396 : cluster [DBG] pgmap v207: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:19.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:55:18 gibba015 bash[30343]: cephadm 2021-03-10T13:55:17.696571+0000 mgr.gibba045.orlgmj (mgr.34412) 397 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T13:55:19.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:55:18 gibba045 bash[25517]: cluster 2021-03-10T13:55:17.154789+0000 mgr.gibba045.orlgmj (mgr.34412) 396 : cluster [DBG] pgmap v207: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:19.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:55:18 gibba045 bash[25517]: cephadm 2021-03-10T13:55:17.696571+0000 mgr.gibba045.orlgmj (mgr.34412) 397 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T13:55:21.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:55:20 gibba015 bash[29377]: cluster 2021-03-10T13:55:19.156095+0000 mgr.gibba045.orlgmj (mgr.34412) 398 : cluster [DBG] pgmap v208: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:21.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:55:20 gibba015 bash[30343]: cluster 2021-03-10T13:55:19.156095+0000 mgr.gibba045.orlgmj (mgr.34412) 398 : cluster [DBG] pgmap v208: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:21.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:55:20 gibba045 bash[25517]: cluster 2021-03-10T13:55:19.156095+0000 mgr.gibba045.orlgmj (mgr.34412) 398 : cluster [DBG] pgmap v208: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:23.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:55:22 gibba015 bash[29377]: cluster 2021-03-10T13:55:21.156942+0000 mgr.gibba045.orlgmj (mgr.34412) 399 : cluster [DBG] pgmap v209: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:23.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:55:22 gibba015 bash[30343]: cluster 2021-03-10T13:55:21.156942+0000 mgr.gibba045.orlgmj (mgr.34412) 399 : cluster [DBG] pgmap v209: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:23.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:55:22 gibba045 bash[25517]: cluster 2021-03-10T13:55:21.156942+0000 mgr.gibba045.orlgmj (mgr.34412) 399 : cluster [DBG] pgmap v209: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:25.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:55:24 gibba015 bash[29377]: cluster 2021-03-10T13:55:23.158454+0000 mgr.gibba045.orlgmj (mgr.34412) 400 : cluster [DBG] pgmap v210: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:25.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:55:24 gibba015 bash[30343]: cluster 2021-03-10T13:55:23.158454+0000 mgr.gibba045.orlgmj (mgr.34412) 400 : cluster [DBG] pgmap v210: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:25.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:55:24 gibba045 bash[25517]: cluster 2021-03-10T13:55:23.158454+0000 mgr.gibba045.orlgmj (mgr.34412) 400 : cluster [DBG] pgmap v210: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:26.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:55:25 gibba015 bash[29377]: cluster 2021-03-10T13:55:25.160155+0000 mgr.gibba045.orlgmj (mgr.34412) 401 : cluster [DBG] pgmap v211: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:26.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:55:25 gibba015 bash[30343]: cluster 2021-03-10T13:55:25.160155+0000 mgr.gibba045.orlgmj (mgr.34412) 401 : cluster [DBG] pgmap v211: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:26.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:55:25 gibba045 bash[25517]: cluster 2021-03-10T13:55:25.160155+0000 mgr.gibba045.orlgmj (mgr.34412) 401 : cluster [DBG] pgmap v211: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:28.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:55:28 gibba015 bash[29377]: cluster 2021-03-10T13:55:27.161170+0000 mgr.gibba045.orlgmj (mgr.34412) 402 : cluster [DBG] pgmap v212: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:28.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:55:28 gibba015 bash[30343]: cluster 2021-03-10T13:55:27.161170+0000 mgr.gibba045.orlgmj (mgr.34412) 402 : cluster [DBG] pgmap v212: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:28.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:55:28 gibba045 bash[25517]: cluster 2021-03-10T13:55:27.161170+0000 mgr.gibba045.orlgmj (mgr.34412) 402 : cluster [DBG] pgmap v212: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:30.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:55:30 gibba045 bash[25517]: cluster 2021-03-10T13:55:29.162534+0000 mgr.gibba045.orlgmj (mgr.34412) 403 : cluster [DBG] pgmap v213: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:30.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:55:30 gibba015 bash[29377]: cluster 2021-03-10T13:55:29.162534+0000 mgr.gibba045.orlgmj (mgr.34412) 403 : cluster [DBG] pgmap v213: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:30.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:55:30 gibba015 bash[30343]: cluster 2021-03-10T13:55:29.162534+0000 mgr.gibba045.orlgmj (mgr.34412) 403 : cluster [DBG] pgmap v213: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:32.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:55:32 gibba045 bash[25517]: cluster 2021-03-10T13:55:31.164295+0000 mgr.gibba045.orlgmj (mgr.34412) 404 : cluster [DBG] pgmap v214: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:32.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:55:32 gibba015 bash[29377]: cluster 2021-03-10T13:55:31.164295+0000 mgr.gibba045.orlgmj (mgr.34412) 404 : cluster [DBG] pgmap v214: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:32.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:55:32 gibba015 bash[30343]: cluster 2021-03-10T13:55:31.164295+0000 mgr.gibba045.orlgmj (mgr.34412) 404 : cluster [DBG] pgmap v214: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:33.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:55:33 gibba045 bash[25517]: cephadm 2021-03-10T13:55:32.712713+0000 mgr.gibba045.orlgmj (mgr.34412) 405 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T13:55:33.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:55:33 gibba015 bash[29377]: cephadm 2021-03-10T13:55:32.712713+0000 mgr.gibba045.orlgmj (mgr.34412) 405 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T13:55:33.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:55:33 gibba015 bash[30343]: cephadm 2021-03-10T13:55:32.712713+0000 mgr.gibba045.orlgmj (mgr.34412) 405 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T13:55:34.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:55:34 gibba045 bash[25517]: cluster 2021-03-10T13:55:33.165063+0000 mgr.gibba045.orlgmj (mgr.34412) 406 : cluster [DBG] pgmap v215: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:34.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:55:34 gibba015 bash[29377]: cluster 2021-03-10T13:55:33.165063+0000 mgr.gibba045.orlgmj (mgr.34412) 406 : cluster [DBG] pgmap v215: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:34.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:55:34 gibba015 bash[30343]: cluster 2021-03-10T13:55:33.165063+0000 mgr.gibba045.orlgmj (mgr.34412) 406 : cluster [DBG] pgmap v215: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:36.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:55:36 gibba045 bash[25517]: cluster 2021-03-10T13:55:35.166804+0000 mgr.gibba045.orlgmj (mgr.34412) 407 : cluster [DBG] pgmap v216: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:36.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:55:36 gibba015 bash[29377]: cluster 2021-03-10T13:55:35.166804+0000 mgr.gibba045.orlgmj (mgr.34412) 407 : cluster [DBG] pgmap v216: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:36.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:55:36 gibba015 bash[30343]: cluster 2021-03-10T13:55:35.166804+0000 mgr.gibba045.orlgmj (mgr.34412) 407 : cluster [DBG] pgmap v216: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:38.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:55:38 gibba045 bash[25517]: cluster 2021-03-10T13:55:37.168653+0000 mgr.gibba045.orlgmj (mgr.34412) 408 : cluster [DBG] pgmap v217: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:38.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:55:38 gibba015 bash[29377]: cluster 2021-03-10T13:55:37.168653+0000 mgr.gibba045.orlgmj (mgr.34412) 408 : cluster [DBG] pgmap v217: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:38.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:55:38 gibba015 bash[30343]: cluster 2021-03-10T13:55:37.168653+0000 mgr.gibba045.orlgmj (mgr.34412) 408 : cluster [DBG] pgmap v217: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:40.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:55:40 gibba045 bash[25517]: cluster 2021-03-10T13:55:39.169339+0000 mgr.gibba045.orlgmj (mgr.34412) 409 : cluster [DBG] pgmap v218: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:40.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:55:40 gibba015 bash[29377]: cluster 2021-03-10T13:55:39.169339+0000 mgr.gibba045.orlgmj (mgr.34412) 409 : cluster [DBG] pgmap v218: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:40.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:55:40 gibba015 bash[30343]: cluster 2021-03-10T13:55:39.169339+0000 mgr.gibba045.orlgmj (mgr.34412) 409 : cluster [DBG] pgmap v218: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:42.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:55:42 gibba045 bash[25517]: cluster 2021-03-10T13:55:41.170727+0000 mgr.gibba045.orlgmj (mgr.34412) 410 : cluster [DBG] pgmap v219: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:42.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:55:42 gibba015 bash[29377]: cluster 2021-03-10T13:55:41.170727+0000 mgr.gibba045.orlgmj (mgr.34412) 410 : cluster [DBG] pgmap v219: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:42.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:55:42 gibba015 bash[30343]: cluster 2021-03-10T13:55:41.170727+0000 mgr.gibba045.orlgmj (mgr.34412) 410 : cluster [DBG] pgmap v219: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:44.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:55:44 gibba045 bash[25517]: cluster 2021-03-10T13:55:43.172245+0000 mgr.gibba045.orlgmj (mgr.34412) 411 : cluster [DBG] pgmap v220: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:44.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:55:44 gibba015 bash[29377]: cluster 2021-03-10T13:55:43.172245+0000 mgr.gibba045.orlgmj (mgr.34412) 411 : cluster [DBG] pgmap v220: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:44.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:55:44 gibba015 bash[30343]: cluster 2021-03-10T13:55:43.172245+0000 mgr.gibba045.orlgmj (mgr.34412) 411 : cluster [DBG] pgmap v220: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:46.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:55:46 gibba045 bash[25517]: cluster 2021-03-10T13:55:45.173166+0000 mgr.gibba045.orlgmj (mgr.34412) 412 : cluster [DBG] pgmap v221: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:46.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:55:46 gibba015 bash[29377]: cluster 2021-03-10T13:55:45.173166+0000 mgr.gibba045.orlgmj (mgr.34412) 412 : cluster [DBG] pgmap v221: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:46.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:55:46 gibba015 bash[30343]: cluster 2021-03-10T13:55:45.173166+0000 mgr.gibba045.orlgmj (mgr.34412) 412 : cluster [DBG] pgmap v221: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:47.151 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T13:55:47.378 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T13:55:47.378 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (6m) 3m ago 11m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T13:55:47.378 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (11m) 106s ago 11m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T13:55:47.379 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (6m) 106s ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T13:55:47.379 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (7m) 106s ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T13:55:47.379 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (6m) 3m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T13:55:47.379 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (6m) 3m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T13:55:47.380 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (5m) 106s ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T13:55:47.380 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (5m) 3m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T13:55:47.380 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (11m) 3m ago 12m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T13:55:47.380 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (12m) 106s ago 12m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T13:55:47.380 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (4m) 3m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T13:55:47.381 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (4m) 3m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T13:55:47.381 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3m) 3m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T13:55:47.381 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3m) 3m ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T13:55:47.381 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3m) 106s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T13:55:47.381 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2m) 106s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T13:55:47.382 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2m) 106s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T13:55:47.382 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (108s) 106s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T13:55:47.382 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (11m) 106s ago 12m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T13:55:47.382 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 106s ago 10m docker.io/ceph/ceph:v15.2.0 2021-03-10T13:55:47.626 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T13:55:47.626 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T13:55:47.627 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:55:47.627 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T13:55:47.627 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T13:55:47.627 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:55:47.628 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T13:55:47.628 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T13:55:47.628 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T13:55:47.628 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T13:55:47.628 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T13:55:47.629 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T13:55:47.629 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T13:55:47.629 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T13:55:47.629 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T13:55:48.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:55:48 gibba015 bash[29377]: audit 2021-03-10T13:55:47.142374+0000 mgr.gibba045.orlgmj (mgr.34412) 413 : audit [DBG] from='client.54328 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:55:48.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:55:48 gibba015 bash[29377]: cluster 2021-03-10T13:55:47.174754+0000 mgr.gibba045.orlgmj (mgr.34412) 414 : cluster [DBG] pgmap v222: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:48.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:55:48 gibba015 bash[29377]: audit 2021-03-10T13:55:47.365521+0000 mgr.gibba045.orlgmj (mgr.34412) 415 : audit [DBG] from='client.54334 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:55:48.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:55:48 gibba015 bash[29377]: audit 2021-03-10T13:55:47.623674+0000 mon.a (mon.0) 587 : audit [DBG] from='client.? 172.21.2.115:0/3853607290' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:48.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:55:48 gibba015 bash[29377]: cephadm 2021-03-10T13:55:47.728817+0000 mgr.gibba045.orlgmj (mgr.34412) 416 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T13:55:48.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:55:48 gibba015 bash[30343]: audit 2021-03-10T13:55:47.142374+0000 mgr.gibba045.orlgmj (mgr.34412) 413 : audit [DBG] from='client.54328 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:55:48.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:55:48 gibba015 bash[30343]: cluster 2021-03-10T13:55:47.174754+0000 mgr.gibba045.orlgmj (mgr.34412) 414 : cluster [DBG] pgmap v222: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:48.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:55:48 gibba015 bash[30343]: audit 2021-03-10T13:55:47.365521+0000 mgr.gibba045.orlgmj (mgr.34412) 415 : audit [DBG] from='client.54334 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:55:48.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:55:48 gibba015 bash[30343]: audit 2021-03-10T13:55:47.623674+0000 mon.a (mon.0) 587 : audit [DBG] from='client.? 172.21.2.115:0/3853607290' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:48.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:55:48 gibba015 bash[30343]: cephadm 2021-03-10T13:55:47.728817+0000 mgr.gibba045.orlgmj (mgr.34412) 416 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T13:55:49.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:55:48 gibba045 bash[25517]: audit 2021-03-10T13:55:47.142374+0000 mgr.gibba045.orlgmj (mgr.34412) 413 : audit [DBG] from='client.54328 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:55:49.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:55:48 gibba045 bash[25517]: cluster 2021-03-10T13:55:47.174754+0000 mgr.gibba045.orlgmj (mgr.34412) 414 : cluster [DBG] pgmap v222: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:49.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:55:48 gibba045 bash[25517]: audit 2021-03-10T13:55:47.365521+0000 mgr.gibba045.orlgmj (mgr.34412) 415 : audit [DBG] from='client.54334 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:55:49.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:55:48 gibba045 bash[25517]: audit 2021-03-10T13:55:47.623674+0000 mon.a (mon.0) 587 : audit [DBG] from='client.? 172.21.2.115:0/3853607290' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:49.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:55:48 gibba045 bash[25517]: cephadm 2021-03-10T13:55:47.728817+0000 mgr.gibba045.orlgmj (mgr.34412) 416 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T13:55:50.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:55:50 gibba015 bash[29377]: cluster 2021-03-10T13:55:49.176164+0000 mgr.gibba045.orlgmj (mgr.34412) 417 : cluster [DBG] pgmap v223: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:50.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:55:50 gibba015 bash[30343]: cluster 2021-03-10T13:55:49.176164+0000 mgr.gibba045.orlgmj (mgr.34412) 417 : cluster [DBG] pgmap v223: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:51.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:55:50 gibba045 bash[25517]: cluster 2021-03-10T13:55:49.176164+0000 mgr.gibba045.orlgmj (mgr.34412) 417 : cluster [DBG] pgmap v223: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:52.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:55:52 gibba015 bash[29377]: cluster 2021-03-10T13:55:51.177156+0000 mgr.gibba045.orlgmj (mgr.34412) 418 : cluster [DBG] pgmap v224: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:52.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:55:52 gibba015 bash[29377]: audit 2021-03-10T13:55:52.393018+0000 mon.c (mon.1) 183 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T13:55:52.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:55:52 gibba015 bash[29377]: audit 2021-03-10T13:55:52.393805+0000 mon.c (mon.1) 184 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T13:55:52.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:55:52 gibba015 bash[29377]: audit 2021-03-10T13:55:52.394443+0000 mon.a (mon.0) 588 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T13:55:52.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:55:52 gibba015 bash[29377]: audit 2021-03-10T13:55:52.394460+0000 mon.c (mon.1) 185 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T13:55:52.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:55:52 gibba015 bash[29377]: audit 2021-03-10T13:55:52.395149+0000 mon.c (mon.1) 186 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T13:55:52.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:55:52 gibba015 bash[29377]: audit 2021-03-10T13:55:52.396942+0000 mon.a (mon.0) 589 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T13:55:52.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:55:52 gibba015 bash[29377]: audit 2021-03-10T13:55:52.398276+0000 mon.a (mon.0) 590 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T13:55:52.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:55:52 gibba015 bash[29377]: audit 2021-03-10T13:55:52.399477+0000 mon.a (mon.0) 591 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T13:55:52.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:55:52 gibba015 bash[29377]: audit 2021-03-10T13:55:52.497671+0000 mon.c (mon.1) 187 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:55:52.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:55:52 gibba015 bash[29377]: audit 2021-03-10T13:55:52.498320+0000 mon.c (mon.1) 188 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T13:55:52.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:55:52 gibba015 bash[29377]: audit 2021-03-10T13:55:52.498940+0000 mon.a (mon.0) 592 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:55:52.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:55:52 gibba015 bash[29377]: audit 2021-03-10T13:55:52.500651+0000 mon.a (mon.0) 593 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T13:55:52.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:55:52 gibba015 bash[30343]: cluster 2021-03-10T13:55:51.177156+0000 mgr.gibba045.orlgmj (mgr.34412) 418 : cluster [DBG] pgmap v224: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:52.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:55:52 gibba015 bash[30343]: audit 2021-03-10T13:55:52.393018+0000 mon.c (mon.1) 183 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T13:55:52.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:55:52 gibba015 bash[30343]: audit 2021-03-10T13:55:52.393805+0000 mon.c (mon.1) 184 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T13:55:52.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:55:52 gibba015 bash[30343]: audit 2021-03-10T13:55:52.394443+0000 mon.a (mon.0) 588 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T13:55:52.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:55:52 gibba015 bash[30343]: audit 2021-03-10T13:55:52.394460+0000 mon.c (mon.1) 185 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T13:55:52.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:55:52 gibba015 bash[30343]: audit 2021-03-10T13:55:52.395149+0000 mon.c (mon.1) 186 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T13:55:52.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:55:52 gibba015 bash[30343]: audit 2021-03-10T13:55:52.396942+0000 mon.a (mon.0) 589 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T13:55:52.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:55:52 gibba015 bash[30343]: audit 2021-03-10T13:55:52.398276+0000 mon.a (mon.0) 590 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T13:55:52.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:55:52 gibba015 bash[30343]: audit 2021-03-10T13:55:52.399477+0000 mon.a (mon.0) 591 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T13:55:52.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:55:52 gibba015 bash[30343]: audit 2021-03-10T13:55:52.497671+0000 mon.c (mon.1) 187 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:55:52.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:55:52 gibba015 bash[30343]: audit 2021-03-10T13:55:52.498320+0000 mon.c (mon.1) 188 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T13:55:52.984 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:55:52 gibba015 bash[30343]: audit 2021-03-10T13:55:52.498940+0000 mon.a (mon.0) 592 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:55:52.984 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:55:52 gibba015 bash[30343]: audit 2021-03-10T13:55:52.500651+0000 mon.a (mon.0) 593 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T13:55:53.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:55:52 gibba045 bash[25517]: cluster 2021-03-10T13:55:51.177156+0000 mgr.gibba045.orlgmj (mgr.34412) 418 : cluster [DBG] pgmap v224: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:53.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:55:52 gibba045 bash[25517]: audit 2021-03-10T13:55:52.393018+0000 mon.c (mon.1) 183 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T13:55:53.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:55:52 gibba045 bash[25517]: audit 2021-03-10T13:55:52.393805+0000 mon.c (mon.1) 184 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T13:55:53.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:55:52 gibba045 bash[25517]: audit 2021-03-10T13:55:52.394443+0000 mon.a (mon.0) 588 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T13:55:53.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:55:52 gibba045 bash[25517]: audit 2021-03-10T13:55:52.394460+0000 mon.c (mon.1) 185 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T13:55:53.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:55:52 gibba045 bash[25517]: audit 2021-03-10T13:55:52.395149+0000 mon.c (mon.1) 186 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T13:55:53.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:55:52 gibba045 bash[25517]: audit 2021-03-10T13:55:52.396942+0000 mon.a (mon.0) 589 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T13:55:53.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:55:52 gibba045 bash[25517]: audit 2021-03-10T13:55:52.398276+0000 mon.a (mon.0) 590 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T13:55:53.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:55:52 gibba045 bash[25517]: audit 2021-03-10T13:55:52.399477+0000 mon.a (mon.0) 591 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T13:55:53.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:55:52 gibba045 bash[25517]: audit 2021-03-10T13:55:52.497671+0000 mon.c (mon.1) 187 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:55:53.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:55:52 gibba045 bash[25517]: audit 2021-03-10T13:55:52.498320+0000 mon.c (mon.1) 188 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T13:55:53.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:55:52 gibba045 bash[25517]: audit 2021-03-10T13:55:52.498940+0000 mon.a (mon.0) 592 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:55:53.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:55:52 gibba045 bash[25517]: audit 2021-03-10T13:55:52.500651+0000 mon.a (mon.0) 593 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T13:55:54.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:55:54 gibba015 bash[29377]: cluster 2021-03-10T13:55:53.178405+0000 mgr.gibba045.orlgmj (mgr.34412) 419 : cluster [DBG] pgmap v225: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:54.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:55:54 gibba015 bash[30343]: cluster 2021-03-10T13:55:53.178405+0000 mgr.gibba045.orlgmj (mgr.34412) 419 : cluster [DBG] pgmap v225: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:55.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:55:54 gibba045 bash[25517]: cluster 2021-03-10T13:55:53.178405+0000 mgr.gibba045.orlgmj (mgr.34412) 419 : cluster [DBG] pgmap v225: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:56.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:55:56 gibba015 bash[29377]: cluster 2021-03-10T13:55:55.180058+0000 mgr.gibba045.orlgmj (mgr.34412) 420 : cluster [DBG] pgmap v226: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:56.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:55:56 gibba015 bash[30343]: cluster 2021-03-10T13:55:55.180058+0000 mgr.gibba045.orlgmj (mgr.34412) 420 : cluster [DBG] pgmap v226: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:57.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:55:56 gibba045 bash[25517]: cluster 2021-03-10T13:55:55.180058+0000 mgr.gibba045.orlgmj (mgr.34412) 420 : cluster [DBG] pgmap v226: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:58.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:55:58 gibba015 bash[29377]: cluster 2021-03-10T13:55:57.180944+0000 mgr.gibba045.orlgmj (mgr.34412) 421 : cluster [DBG] pgmap v227: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:58.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:55:58 gibba015 bash[30343]: cluster 2021-03-10T13:55:57.180944+0000 mgr.gibba045.orlgmj (mgr.34412) 421 : cluster [DBG] pgmap v227: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:55:59.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:55:58 gibba045 bash[25517]: cluster 2021-03-10T13:55:57.180944+0000 mgr.gibba045.orlgmj (mgr.34412) 421 : cluster [DBG] pgmap v227: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:00.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:56:00 gibba015 bash[29377]: cluster 2021-03-10T13:55:59.182049+0000 mgr.gibba045.orlgmj (mgr.34412) 422 : cluster [DBG] pgmap v228: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:00.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:56:00 gibba015 bash[30343]: cluster 2021-03-10T13:55:59.182049+0000 mgr.gibba045.orlgmj (mgr.34412) 422 : cluster [DBG] pgmap v228: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:01.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:56:00 gibba045 bash[25517]: cluster 2021-03-10T13:55:59.182049+0000 mgr.gibba045.orlgmj (mgr.34412) 422 : cluster [DBG] pgmap v228: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:02.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:56:02 gibba015 bash[29377]: cluster 2021-03-10T13:56:01.183679+0000 mgr.gibba045.orlgmj (mgr.34412) 423 : cluster [DBG] pgmap v229: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:02.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:56:02 gibba015 bash[30343]: cluster 2021-03-10T13:56:01.183679+0000 mgr.gibba045.orlgmj (mgr.34412) 423 : cluster [DBG] pgmap v229: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:02.976 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:56:02 gibba045 bash[25517]: cluster 2021-03-10T13:56:01.183679+0000 mgr.gibba045.orlgmj (mgr.34412) 423 : cluster [DBG] pgmap v229: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:03.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:56:03 gibba015 bash[29377]: audit 2021-03-10T13:56:02.742646+0000 mon.c (mon.1) 189 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:56:03.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:56:03 gibba015 bash[29377]: cephadm 2021-03-10T13:56:02.750535+0000 mgr.gibba045.orlgmj (mgr.34412) 424 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T13:56:03.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:56:03 gibba015 bash[29377]: cephadm 2021-03-10T13:56:02.752597+0000 mgr.gibba045.orlgmj (mgr.34412) 425 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T13:56:03.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:56:03 gibba015 bash[29377]: audit 2021-03-10T13:56:02.960872+0000 mon.a (mon.0) 594 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:56:03.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:56:03 gibba015 bash[29377]: audit 2021-03-10T13:56:02.964589+0000 mon.c (mon.1) 190 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:56:03.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:56:03 gibba015 bash[29377]: audit 2021-03-10T13:56:02.965949+0000 mon.c (mon.1) 191 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:56:03.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:56:03 gibba015 bash[29377]: audit 2021-03-10T13:56:02.967449+0000 mon.c (mon.1) 192 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:56:03.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:56:03 gibba015 bash[29377]: audit 2021-03-10T13:56:02.968596+0000 mon.c (mon.1) 193 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:56:03.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:56:03 gibba015 bash[29377]: audit 2021-03-10T13:56:02.971407+0000 mon.c (mon.1) 194 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:56:03.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:56:03 gibba015 bash[29377]: audit 2021-03-10T13:56:02.972864+0000 mon.c (mon.1) 195 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:56:03.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:56:03 gibba015 bash[30343]: audit 2021-03-10T13:56:02.742646+0000 mon.c (mon.1) 189 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:56:03.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:56:03 gibba015 bash[30343]: cephadm 2021-03-10T13:56:02.750535+0000 mgr.gibba045.orlgmj (mgr.34412) 424 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T13:56:03.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:56:03 gibba015 bash[30343]: cephadm 2021-03-10T13:56:02.752597+0000 mgr.gibba045.orlgmj (mgr.34412) 425 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T13:56:03.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:56:03 gibba015 bash[30343]: audit 2021-03-10T13:56:02.960872+0000 mon.a (mon.0) 594 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:56:03.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:56:03 gibba015 bash[30343]: audit 2021-03-10T13:56:02.964589+0000 mon.c (mon.1) 190 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:56:03.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:56:03 gibba015 bash[30343]: audit 2021-03-10T13:56:02.965949+0000 mon.c (mon.1) 191 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:56:03.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:56:03 gibba015 bash[30343]: audit 2021-03-10T13:56:02.967449+0000 mon.c (mon.1) 192 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:56:03.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:56:03 gibba015 bash[30343]: audit 2021-03-10T13:56:02.968596+0000 mon.c (mon.1) 193 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:56:03.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:56:03 gibba015 bash[30343]: audit 2021-03-10T13:56:02.971407+0000 mon.c (mon.1) 194 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:56:03.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:56:03 gibba015 bash[30343]: audit 2021-03-10T13:56:02.972864+0000 mon.c (mon.1) 195 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:56:04.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:56:03 gibba045 bash[25517]: audit 2021-03-10T13:56:02.742646+0000 mon.c (mon.1) 189 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:56:04.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:56:03 gibba045 bash[25517]: cephadm 2021-03-10T13:56:02.750535+0000 mgr.gibba045.orlgmj (mgr.34412) 424 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T13:56:04.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:56:03 gibba045 bash[25517]: cephadm 2021-03-10T13:56:02.752597+0000 mgr.gibba045.orlgmj (mgr.34412) 425 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T13:56:04.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:56:03 gibba045 bash[25517]: audit 2021-03-10T13:56:02.960872+0000 mon.a (mon.0) 594 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:56:04.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:56:03 gibba045 bash[25517]: audit 2021-03-10T13:56:02.964589+0000 mon.c (mon.1) 190 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:56:04.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:56:03 gibba045 bash[25517]: audit 2021-03-10T13:56:02.965949+0000 mon.c (mon.1) 191 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:56:04.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:56:03 gibba045 bash[25517]: audit 2021-03-10T13:56:02.967449+0000 mon.c (mon.1) 192 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:56:04.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:56:03 gibba045 bash[25517]: audit 2021-03-10T13:56:02.968596+0000 mon.c (mon.1) 193 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:56:04.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:56:03 gibba045 bash[25517]: audit 2021-03-10T13:56:02.971407+0000 mon.c (mon.1) 194 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:56:04.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:56:03 gibba045 bash[25517]: audit 2021-03-10T13:56:02.972864+0000 mon.c (mon.1) 195 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:56:04.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:56:04 gibba015 bash[29377]: cephadm 2021-03-10T13:56:02.966512+0000 mgr.gibba045.orlgmj (mgr.34412) 426 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:56:04.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:56:04 gibba015 bash[29377]: cephadm 2021-03-10T13:56:02.968222+0000 mgr.gibba045.orlgmj (mgr.34412) 427 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:56:04.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:56:04 gibba015 bash[29377]: cephadm 2021-03-10T13:56:02.969685+0000 mgr.gibba045.orlgmj (mgr.34412) 428 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:56:04.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:56:04 gibba015 bash[29377]: cephadm 2021-03-10T13:56:02.969721+0000 mgr.gibba045.orlgmj (mgr.34412) 429 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:56:04.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:56:04 gibba015 bash[29377]: cephadm 2021-03-10T13:56:02.970910+0000 mgr.gibba045.orlgmj (mgr.34412) 430 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:56:04.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:56:04 gibba015 bash[29377]: cephadm 2021-03-10T13:56:02.970945+0000 mgr.gibba045.orlgmj (mgr.34412) 431 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:56:04.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:56:04 gibba015 bash[29377]: cephadm 2021-03-10T13:56:02.972046+0000 mgr.gibba045.orlgmj (mgr.34412) 432 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:56:04.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:56:04 gibba015 bash[29377]: cephadm 2021-03-10T13:56:02.973647+0000 mgr.gibba045.orlgmj (mgr.34412) 433 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:56:04.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:56:04 gibba015 bash[29377]: cephadm 2021-03-10T13:56:02.973683+0000 mgr.gibba045.orlgmj (mgr.34412) 434 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:56:04.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:56:04 gibba015 bash[29377]: cephadm 2021-03-10T13:56:02.974969+0000 mgr.gibba045.orlgmj (mgr.34412) 435 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T13:56:04.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:56:04 gibba015 bash[29377]: cephadm 2021-03-10T13:56:02.975283+0000 mgr.gibba045.orlgmj (mgr.34412) 436 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T13:56:04.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:56:04 gibba015 bash[29377]: cephadm 2021-03-10T13:56:02.976355+0000 mgr.gibba045.orlgmj (mgr.34412) 437 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T13:56:04.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:56:04 gibba015 bash[29377]: cephadm 2021-03-10T13:56:02.976396+0000 mgr.gibba045.orlgmj (mgr.34412) 438 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T13:56:04.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:56:04 gibba015 bash[29377]: cephadm 2021-03-10T13:56:02.976569+0000 mgr.gibba045.orlgmj (mgr.34412) 439 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T13:56:04.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:56:04 gibba015 bash[29377]: cluster 2021-03-10T13:56:03.185101+0000 mgr.gibba045.orlgmj (mgr.34412) 440 : cluster [DBG] pgmap v230: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:04.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:56:04 gibba015 bash[30343]: cephadm 2021-03-10T13:56:02.966512+0000 mgr.gibba045.orlgmj (mgr.34412) 426 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:56:04.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:56:04 gibba015 bash[30343]: cephadm 2021-03-10T13:56:02.968222+0000 mgr.gibba045.orlgmj (mgr.34412) 427 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:56:04.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:56:04 gibba015 bash[30343]: cephadm 2021-03-10T13:56:02.969685+0000 mgr.gibba045.orlgmj (mgr.34412) 428 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:56:04.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:56:04 gibba015 bash[30343]: cephadm 2021-03-10T13:56:02.969721+0000 mgr.gibba045.orlgmj (mgr.34412) 429 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:56:04.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:56:04 gibba015 bash[30343]: cephadm 2021-03-10T13:56:02.970910+0000 mgr.gibba045.orlgmj (mgr.34412) 430 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:56:04.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:56:04 gibba015 bash[30343]: cephadm 2021-03-10T13:56:02.970945+0000 mgr.gibba045.orlgmj (mgr.34412) 431 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:56:04.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:56:04 gibba015 bash[30343]: cephadm 2021-03-10T13:56:02.972046+0000 mgr.gibba045.orlgmj (mgr.34412) 432 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:56:04.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:56:04 gibba015 bash[30343]: cephadm 2021-03-10T13:56:02.973647+0000 mgr.gibba045.orlgmj (mgr.34412) 433 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:56:04.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:56:04 gibba015 bash[30343]: cephadm 2021-03-10T13:56:02.973683+0000 mgr.gibba045.orlgmj (mgr.34412) 434 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:56:04.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:56:04 gibba015 bash[30343]: cephadm 2021-03-10T13:56:02.974969+0000 mgr.gibba045.orlgmj (mgr.34412) 435 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T13:56:04.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:56:04 gibba015 bash[30343]: cephadm 2021-03-10T13:56:02.975283+0000 mgr.gibba045.orlgmj (mgr.34412) 436 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T13:56:04.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:56:04 gibba015 bash[30343]: cephadm 2021-03-10T13:56:02.976355+0000 mgr.gibba045.orlgmj (mgr.34412) 437 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T13:56:04.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:56:04 gibba015 bash[30343]: cephadm 2021-03-10T13:56:02.976396+0000 mgr.gibba045.orlgmj (mgr.34412) 438 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T13:56:04.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:56:04 gibba015 bash[30343]: cephadm 2021-03-10T13:56:02.976569+0000 mgr.gibba045.orlgmj (mgr.34412) 439 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T13:56:04.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:56:04 gibba015 bash[30343]: cluster 2021-03-10T13:56:03.185101+0000 mgr.gibba045.orlgmj (mgr.34412) 440 : cluster [DBG] pgmap v230: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:05.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:56:04 gibba045 bash[25517]: cephadm 2021-03-10T13:56:02.966512+0000 mgr.gibba045.orlgmj (mgr.34412) 426 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:56:05.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:56:04 gibba045 bash[25517]: cephadm 2021-03-10T13:56:02.968222+0000 mgr.gibba045.orlgmj (mgr.34412) 427 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:56:05.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:56:04 gibba045 bash[25517]: cephadm 2021-03-10T13:56:02.969685+0000 mgr.gibba045.orlgmj (mgr.34412) 428 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:56:05.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:56:04 gibba045 bash[25517]: cephadm 2021-03-10T13:56:02.969721+0000 mgr.gibba045.orlgmj (mgr.34412) 429 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:56:05.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:56:04 gibba045 bash[25517]: cephadm 2021-03-10T13:56:02.970910+0000 mgr.gibba045.orlgmj (mgr.34412) 430 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:56:05.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:56:04 gibba045 bash[25517]: cephadm 2021-03-10T13:56:02.970945+0000 mgr.gibba045.orlgmj (mgr.34412) 431 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:56:05.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:56:04 gibba045 bash[25517]: cephadm 2021-03-10T13:56:02.972046+0000 mgr.gibba045.orlgmj (mgr.34412) 432 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:56:05.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:56:04 gibba045 bash[25517]: cephadm 2021-03-10T13:56:02.973647+0000 mgr.gibba045.orlgmj (mgr.34412) 433 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:56:05.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:56:04 gibba045 bash[25517]: cephadm 2021-03-10T13:56:02.973683+0000 mgr.gibba045.orlgmj (mgr.34412) 434 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:56:05.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:56:04 gibba045 bash[25517]: cephadm 2021-03-10T13:56:02.974969+0000 mgr.gibba045.orlgmj (mgr.34412) 435 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T13:56:05.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:56:04 gibba045 bash[25517]: cephadm 2021-03-10T13:56:02.975283+0000 mgr.gibba045.orlgmj (mgr.34412) 436 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T13:56:05.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:56:04 gibba045 bash[25517]: cephadm 2021-03-10T13:56:02.976355+0000 mgr.gibba045.orlgmj (mgr.34412) 437 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T13:56:05.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:56:04 gibba045 bash[25517]: cephadm 2021-03-10T13:56:02.976396+0000 mgr.gibba045.orlgmj (mgr.34412) 438 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T13:56:05.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:56:04 gibba045 bash[25517]: cephadm 2021-03-10T13:56:02.976569+0000 mgr.gibba045.orlgmj (mgr.34412) 439 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T13:56:05.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:56:04 gibba045 bash[25517]: cluster 2021-03-10T13:56:03.185101+0000 mgr.gibba045.orlgmj (mgr.34412) 440 : cluster [DBG] pgmap v230: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:06.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:56:06 gibba015 bash[29377]: cluster 2021-03-10T13:56:05.186812+0000 mgr.gibba045.orlgmj (mgr.34412) 441 : cluster [DBG] pgmap v231: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:06.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:56:06 gibba015 bash[30343]: cluster 2021-03-10T13:56:05.186812+0000 mgr.gibba045.orlgmj (mgr.34412) 441 : cluster [DBG] pgmap v231: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:07.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:56:06 gibba045 bash[25517]: cluster 2021-03-10T13:56:05.186812+0000 mgr.gibba045.orlgmj (mgr.34412) 441 : cluster [DBG] pgmap v231: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:08.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:56:08 gibba015 bash[29377]: cluster 2021-03-10T13:56:07.188493+0000 mgr.gibba045.orlgmj (mgr.34412) 442 : cluster [DBG] pgmap v232: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:08.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:56:08 gibba015 bash[30343]: cluster 2021-03-10T13:56:07.188493+0000 mgr.gibba045.orlgmj (mgr.34412) 442 : cluster [DBG] pgmap v232: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:09.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:56:08 gibba045 bash[25517]: cluster 2021-03-10T13:56:07.188493+0000 mgr.gibba045.orlgmj (mgr.34412) 442 : cluster [DBG] pgmap v232: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:10.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:56:10 gibba015 bash[29377]: cluster 2021-03-10T13:56:09.189675+0000 mgr.gibba045.orlgmj (mgr.34412) 443 : cluster [DBG] pgmap v233: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:10.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:56:10 gibba015 bash[30343]: cluster 2021-03-10T13:56:09.189675+0000 mgr.gibba045.orlgmj (mgr.34412) 443 : cluster [DBG] pgmap v233: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:11.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:56:10 gibba045 bash[25517]: cluster 2021-03-10T13:56:09.189675+0000 mgr.gibba045.orlgmj (mgr.34412) 443 : cluster [DBG] pgmap v233: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:12.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:56:12 gibba015 bash[29377]: cluster 2021-03-10T13:56:11.191503+0000 mgr.gibba045.orlgmj (mgr.34412) 444 : cluster [DBG] pgmap v234: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:12.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:56:12 gibba015 bash[30343]: cluster 2021-03-10T13:56:11.191503+0000 mgr.gibba045.orlgmj (mgr.34412) 444 : cluster [DBG] pgmap v234: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:13.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:56:12 gibba045 bash[25517]: cluster 2021-03-10T13:56:11.191503+0000 mgr.gibba045.orlgmj (mgr.34412) 444 : cluster [DBG] pgmap v234: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:14.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:56:14 gibba015 bash[29377]: cluster 2021-03-10T13:56:13.192945+0000 mgr.gibba045.orlgmj (mgr.34412) 445 : cluster [DBG] pgmap v235: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:14.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:56:14 gibba015 bash[30343]: cluster 2021-03-10T13:56:13.192945+0000 mgr.gibba045.orlgmj (mgr.34412) 445 : cluster [DBG] pgmap v235: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:15.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:56:14 gibba045 bash[25517]: cluster 2021-03-10T13:56:13.192945+0000 mgr.gibba045.orlgmj (mgr.34412) 445 : cluster [DBG] pgmap v235: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:16.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:56:16 gibba015 bash[29377]: cluster 2021-03-10T13:56:15.193653+0000 mgr.gibba045.orlgmj (mgr.34412) 446 : cluster [DBG] pgmap v236: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:16.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:56:16 gibba015 bash[30343]: cluster 2021-03-10T13:56:15.193653+0000 mgr.gibba045.orlgmj (mgr.34412) 446 : cluster [DBG] pgmap v236: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:17.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:56:16 gibba045 bash[25517]: cluster 2021-03-10T13:56:15.193653+0000 mgr.gibba045.orlgmj (mgr.34412) 446 : cluster [DBG] pgmap v236: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:17.873 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T13:56:18.100 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T13:56:18.101 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (7m) 4m ago 12m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T13:56:18.101 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (12m) 2m ago 12m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T13:56:18.101 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (7m) 2m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T13:56:18.101 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (7m) 2m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T13:56:18.101 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (6m) 4m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T13:56:18.102 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (6m) 4m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T13:56:18.102 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (6m) 2m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T13:56:18.102 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (6m) 4m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T13:56:18.102 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (12m) 4m ago 12m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T13:56:18.103 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (12m) 2m ago 12m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T13:56:18.103 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (5m) 4m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T13:56:18.103 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (4m) 4m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T13:56:18.103 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (4m) 4m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T13:56:18.104 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (4m) 4m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T13:56:18.104 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3m) 2m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T13:56:18.104 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3m) 2m ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T13:56:18.104 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2m) 2m ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T13:56:18.104 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2m) 2m ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T13:56:18.105 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (11m) 2m ago 12m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T13:56:18.105 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 2m ago 10m docker.io/ceph/ceph:v15.2.0 2021-03-10T13:56:18.348 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T13:56:18.349 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T13:56:18.349 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:56:18.349 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T13:56:18.349 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T13:56:18.350 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:56:18.350 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T13:56:18.350 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T13:56:18.350 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T13:56:18.351 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T13:56:18.351 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T13:56:18.351 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T13:56:18.351 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T13:56:18.352 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T13:56:18.352 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T13:56:18.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:56:18 gibba015 bash[29377]: cluster 2021-03-10T13:56:17.195041+0000 mgr.gibba045.orlgmj (mgr.34412) 447 : cluster [DBG] pgmap v237: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:18.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:56:18 gibba015 bash[29377]: audit 2021-03-10T13:56:17.864242+0000 mgr.gibba045.orlgmj (mgr.34412) 448 : audit [DBG] from='client.54346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:56:18.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:56:18 gibba015 bash[29377]: audit 2021-03-10T13:56:18.345722+0000 mon.a (mon.0) 595 : audit [DBG] from='client.? 172.21.2.115:0/2971051912' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:56:18.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:56:18 gibba015 bash[30343]: cluster 2021-03-10T13:56:17.195041+0000 mgr.gibba045.orlgmj (mgr.34412) 447 : cluster [DBG] pgmap v237: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:18.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:56:18 gibba015 bash[30343]: audit 2021-03-10T13:56:17.864242+0000 mgr.gibba045.orlgmj (mgr.34412) 448 : audit [DBG] from='client.54346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:56:18.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:56:18 gibba015 bash[30343]: audit 2021-03-10T13:56:18.345722+0000 mon.a (mon.0) 595 : audit [DBG] from='client.? 172.21.2.115:0/2971051912' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:56:19.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:56:18 gibba045 bash[25517]: cluster 2021-03-10T13:56:17.195041+0000 mgr.gibba045.orlgmj (mgr.34412) 447 : cluster [DBG] pgmap v237: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:19.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:56:18 gibba045 bash[25517]: audit 2021-03-10T13:56:17.864242+0000 mgr.gibba045.orlgmj (mgr.34412) 448 : audit [DBG] from='client.54346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:56:19.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:56:18 gibba045 bash[25517]: audit 2021-03-10T13:56:18.345722+0000 mon.a (mon.0) 595 : audit [DBG] from='client.? 172.21.2.115:0/2971051912' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:56:19.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:56:19 gibba015 bash[29377]: cephadm 2021-03-10T13:56:17.992706+0000 mgr.gibba045.orlgmj (mgr.34412) 449 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T13:56:19.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:56:19 gibba015 bash[29377]: audit 2021-03-10T13:56:18.088354+0000 mgr.gibba045.orlgmj (mgr.34412) 450 : audit [DBG] from='client.44364 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:56:19.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:56:19 gibba015 bash[30343]: cephadm 2021-03-10T13:56:17.992706+0000 mgr.gibba045.orlgmj (mgr.34412) 449 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T13:56:19.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:56:19 gibba015 bash[30343]: audit 2021-03-10T13:56:18.088354+0000 mgr.gibba045.orlgmj (mgr.34412) 450 : audit [DBG] from='client.44364 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:56:20.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:56:19 gibba045 bash[25517]: cephadm 2021-03-10T13:56:17.992706+0000 mgr.gibba045.orlgmj (mgr.34412) 449 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T13:56:20.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:56:19 gibba045 bash[25517]: audit 2021-03-10T13:56:18.088354+0000 mgr.gibba045.orlgmj (mgr.34412) 450 : audit [DBG] from='client.44364 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:56:20.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:56:20 gibba015 bash[29377]: cluster 2021-03-10T13:56:19.196313+0000 mgr.gibba045.orlgmj (mgr.34412) 451 : cluster [DBG] pgmap v238: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:20.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:56:20 gibba015 bash[30343]: cluster 2021-03-10T13:56:19.196313+0000 mgr.gibba045.orlgmj (mgr.34412) 451 : cluster [DBG] pgmap v238: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:21.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:56:20 gibba045 bash[25517]: cluster 2021-03-10T13:56:19.196313+0000 mgr.gibba045.orlgmj (mgr.34412) 451 : cluster [DBG] pgmap v238: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:22.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:56:22 gibba015 bash[29377]: cluster 2021-03-10T13:56:21.197845+0000 mgr.gibba045.orlgmj (mgr.34412) 452 : cluster [DBG] pgmap v239: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:22.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:56:22 gibba015 bash[30343]: cluster 2021-03-10T13:56:21.197845+0000 mgr.gibba045.orlgmj (mgr.34412) 452 : cluster [DBG] pgmap v239: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:23.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:56:22 gibba045 bash[25517]: cluster 2021-03-10T13:56:21.197845+0000 mgr.gibba045.orlgmj (mgr.34412) 452 : cluster [DBG] pgmap v239: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:24.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:56:24 gibba015 bash[29377]: cluster 2021-03-10T13:56:23.199215+0000 mgr.gibba045.orlgmj (mgr.34412) 453 : cluster [DBG] pgmap v240: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:24.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:56:24 gibba015 bash[30343]: cluster 2021-03-10T13:56:23.199215+0000 mgr.gibba045.orlgmj (mgr.34412) 453 : cluster [DBG] pgmap v240: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:25.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:56:24 gibba045 bash[25517]: cluster 2021-03-10T13:56:23.199215+0000 mgr.gibba045.orlgmj (mgr.34412) 453 : cluster [DBG] pgmap v240: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:27.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:56:26 gibba045 bash[25517]: cluster 2021-03-10T13:56:25.200896+0000 mgr.gibba045.orlgmj (mgr.34412) 454 : cluster [DBG] pgmap v241: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:27.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:56:26 gibba015 bash[29377]: cluster 2021-03-10T13:56:25.200896+0000 mgr.gibba045.orlgmj (mgr.34412) 454 : cluster [DBG] pgmap v241: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:27.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:56:26 gibba015 bash[30343]: cluster 2021-03-10T13:56:25.200896+0000 mgr.gibba045.orlgmj (mgr.34412) 454 : cluster [DBG] pgmap v241: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:29.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:56:28 gibba045 bash[25517]: cluster 2021-03-10T13:56:27.201971+0000 mgr.gibba045.orlgmj (mgr.34412) 455 : cluster [DBG] pgmap v242: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:29.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:56:28 gibba015 bash[29377]: cluster 2021-03-10T13:56:27.201971+0000 mgr.gibba045.orlgmj (mgr.34412) 455 : cluster [DBG] pgmap v242: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:29.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:56:28 gibba015 bash[30343]: cluster 2021-03-10T13:56:27.201971+0000 mgr.gibba045.orlgmj (mgr.34412) 455 : cluster [DBG] pgmap v242: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:31.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:56:30 gibba045 bash[25517]: cluster 2021-03-10T13:56:29.203231+0000 mgr.gibba045.orlgmj (mgr.34412) 456 : cluster [DBG] pgmap v243: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:31.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:56:30 gibba015 bash[29377]: cluster 2021-03-10T13:56:29.203231+0000 mgr.gibba045.orlgmj (mgr.34412) 456 : cluster [DBG] pgmap v243: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:31.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:56:30 gibba015 bash[30343]: cluster 2021-03-10T13:56:29.203231+0000 mgr.gibba045.orlgmj (mgr.34412) 456 : cluster [DBG] pgmap v243: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:33.009 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:56:32 gibba045 bash[25517]: cluster 2021-03-10T13:56:31.204850+0000 mgr.gibba045.orlgmj (mgr.34412) 457 : cluster [DBG] pgmap v244: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:33.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:56:32 gibba015 bash[29377]: cluster 2021-03-10T13:56:31.204850+0000 mgr.gibba045.orlgmj (mgr.34412) 457 : cluster [DBG] pgmap v244: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:33.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:56:32 gibba015 bash[30343]: cluster 2021-03-10T13:56:31.204850+0000 mgr.gibba045.orlgmj (mgr.34412) 457 : cluster [DBG] pgmap v244: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:35.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:56:34 gibba045 bash[25517]: cephadm 2021-03-10T13:56:33.008751+0000 mgr.gibba045.orlgmj (mgr.34412) 458 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T13:56:35.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:56:34 gibba045 bash[25517]: cluster 2021-03-10T13:56:33.205774+0000 mgr.gibba045.orlgmj (mgr.34412) 459 : cluster [DBG] pgmap v245: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:35.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:56:34 gibba015 bash[29377]: cephadm 2021-03-10T13:56:33.008751+0000 mgr.gibba045.orlgmj (mgr.34412) 458 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T13:56:35.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:56:34 gibba015 bash[29377]: cluster 2021-03-10T13:56:33.205774+0000 mgr.gibba045.orlgmj (mgr.34412) 459 : cluster [DBG] pgmap v245: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:35.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:56:34 gibba015 bash[30343]: cephadm 2021-03-10T13:56:33.008751+0000 mgr.gibba045.orlgmj (mgr.34412) 458 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T13:56:35.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:56:34 gibba015 bash[30343]: cluster 2021-03-10T13:56:33.205774+0000 mgr.gibba045.orlgmj (mgr.34412) 459 : cluster [DBG] pgmap v245: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:37.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:56:36 gibba045 bash[25517]: cluster 2021-03-10T13:56:35.207260+0000 mgr.gibba045.orlgmj (mgr.34412) 460 : cluster [DBG] pgmap v246: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:37.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:56:36 gibba015 bash[29377]: cluster 2021-03-10T13:56:35.207260+0000 mgr.gibba045.orlgmj (mgr.34412) 460 : cluster [DBG] pgmap v246: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:37.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:56:36 gibba015 bash[30343]: cluster 2021-03-10T13:56:35.207260+0000 mgr.gibba045.orlgmj (mgr.34412) 460 : cluster [DBG] pgmap v246: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:39.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:56:38 gibba045 bash[25517]: cluster 2021-03-10T13:56:37.208940+0000 mgr.gibba045.orlgmj (mgr.34412) 461 : cluster [DBG] pgmap v247: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:39.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:56:38 gibba015 bash[29377]: cluster 2021-03-10T13:56:37.208940+0000 mgr.gibba045.orlgmj (mgr.34412) 461 : cluster [DBG] pgmap v247: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:39.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:56:38 gibba015 bash[30343]: cluster 2021-03-10T13:56:37.208940+0000 mgr.gibba045.orlgmj (mgr.34412) 461 : cluster [DBG] pgmap v247: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:41.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:56:40 gibba045 bash[25517]: cluster 2021-03-10T13:56:39.210192+0000 mgr.gibba045.orlgmj (mgr.34412) 462 : cluster [DBG] pgmap v248: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:41.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:56:40 gibba015 bash[29377]: cluster 2021-03-10T13:56:39.210192+0000 mgr.gibba045.orlgmj (mgr.34412) 462 : cluster [DBG] pgmap v248: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:41.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:56:40 gibba015 bash[30343]: cluster 2021-03-10T13:56:39.210192+0000 mgr.gibba045.orlgmj (mgr.34412) 462 : cluster [DBG] pgmap v248: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:43.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:56:42 gibba015 bash[29377]: cluster 2021-03-10T13:56:41.211681+0000 mgr.gibba045.orlgmj (mgr.34412) 463 : cluster [DBG] pgmap v249: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:43.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:56:42 gibba015 bash[30343]: cluster 2021-03-10T13:56:41.211681+0000 mgr.gibba045.orlgmj (mgr.34412) 463 : cluster [DBG] pgmap v249: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:43.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:56:42 gibba045 bash[25517]: cluster 2021-03-10T13:56:41.211681+0000 mgr.gibba045.orlgmj (mgr.34412) 463 : cluster [DBG] pgmap v249: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:45.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:56:44 gibba015 bash[29377]: cluster 2021-03-10T13:56:43.213279+0000 mgr.gibba045.orlgmj (mgr.34412) 464 : cluster [DBG] pgmap v250: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:45.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:56:44 gibba015 bash[30343]: cluster 2021-03-10T13:56:43.213279+0000 mgr.gibba045.orlgmj (mgr.34412) 464 : cluster [DBG] pgmap v250: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:45.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:56:44 gibba045 bash[25517]: cluster 2021-03-10T13:56:43.213279+0000 mgr.gibba045.orlgmj (mgr.34412) 464 : cluster [DBG] pgmap v250: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:47.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:56:46 gibba015 bash[29377]: cluster 2021-03-10T13:56:45.214469+0000 mgr.gibba045.orlgmj (mgr.34412) 465 : cluster [DBG] pgmap v251: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:47.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:56:46 gibba015 bash[30343]: cluster 2021-03-10T13:56:45.214469+0000 mgr.gibba045.orlgmj (mgr.34412) 465 : cluster [DBG] pgmap v251: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:47.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:56:46 gibba045 bash[25517]: cluster 2021-03-10T13:56:45.214469+0000 mgr.gibba045.orlgmj (mgr.34412) 465 : cluster [DBG] pgmap v251: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:48.590 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T13:56:48.812 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T13:56:48.813 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (7m) 4m ago 12m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T13:56:48.813 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (12m) 2m ago 12m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T13:56:48.813 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (7m) 2m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T13:56:48.814 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (8m) 2m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T13:56:48.814 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (7m) 4m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T13:56:48.814 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (7m) 4m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T13:56:48.814 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (6m) 2m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T13:56:48.815 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (6m) 4m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T13:56:48.815 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (13m) 4m ago 13m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T13:56:48.815 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (13m) 2m ago 13m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T13:56:48.815 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (5m) 4m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T13:56:48.815 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (5m) 4m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T13:56:48.816 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (4m) 4m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T13:56:48.816 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (4m) 4m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T13:56:48.816 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (4m) 2m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T13:56:48.816 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3m) 2m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T13:56:48.816 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3m) 2m ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T13:56:48.817 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2m) 2m ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T13:56:48.817 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (12m) 2m ago 13m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T13:56:48.817 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 2m ago 11m docker.io/ceph/ceph:v15.2.0 2021-03-10T13:56:49.065 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T13:56:49.065 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T13:56:49.066 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:56:49.066 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T13:56:49.066 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T13:56:49.067 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:56:49.067 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T13:56:49.067 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T13:56:49.067 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T13:56:49.068 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T13:56:49.068 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T13:56:49.068 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T13:56:49.068 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T13:56:49.068 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T13:56:49.069 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T13:56:49.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:56:48 gibba015 bash[29377]: cluster 2021-03-10T13:56:47.216050+0000 mgr.gibba045.orlgmj (mgr.34412) 466 : cluster [DBG] pgmap v252: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:49.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:56:48 gibba015 bash[30343]: cluster 2021-03-10T13:56:47.216050+0000 mgr.gibba045.orlgmj (mgr.34412) 466 : cluster [DBG] pgmap v252: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:49.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:56:48 gibba045 bash[25517]: cluster 2021-03-10T13:56:47.216050+0000 mgr.gibba045.orlgmj (mgr.34412) 466 : cluster [DBG] pgmap v252: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:50.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:56:49 gibba015 bash[29377]: cephadm 2021-03-10T13:56:48.024845+0000 mgr.gibba045.orlgmj (mgr.34412) 467 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T13:56:50.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:56:49 gibba015 bash[29377]: audit 2021-03-10T13:56:48.581281+0000 mgr.gibba045.orlgmj (mgr.34412) 468 : audit [DBG] from='client.44376 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:56:50.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:56:49 gibba015 bash[29377]: audit 2021-03-10T13:56:48.802735+0000 mgr.gibba045.orlgmj (mgr.34412) 469 : audit [DBG] from='client.54370 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:56:50.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:56:49 gibba015 bash[29377]: audit 2021-03-10T13:56:49.062381+0000 mon.a (mon.0) 596 : audit [DBG] from='client.? 172.21.2.115:0/1612064221' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:56:50.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:56:49 gibba015 bash[30343]: cephadm 2021-03-10T13:56:48.024845+0000 mgr.gibba045.orlgmj (mgr.34412) 467 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T13:56:50.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:56:49 gibba015 bash[30343]: audit 2021-03-10T13:56:48.581281+0000 mgr.gibba045.orlgmj (mgr.34412) 468 : audit [DBG] from='client.44376 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:56:50.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:56:49 gibba015 bash[30343]: audit 2021-03-10T13:56:48.802735+0000 mgr.gibba045.orlgmj (mgr.34412) 469 : audit [DBG] from='client.54370 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:56:50.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:56:49 gibba015 bash[30343]: audit 2021-03-10T13:56:49.062381+0000 mon.a (mon.0) 596 : audit [DBG] from='client.? 172.21.2.115:0/1612064221' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:56:50.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:56:49 gibba045 bash[25517]: cephadm 2021-03-10T13:56:48.024845+0000 mgr.gibba045.orlgmj (mgr.34412) 467 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T13:56:50.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:56:49 gibba045 bash[25517]: audit 2021-03-10T13:56:48.581281+0000 mgr.gibba045.orlgmj (mgr.34412) 468 : audit [DBG] from='client.44376 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:56:50.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:56:49 gibba045 bash[25517]: audit 2021-03-10T13:56:48.802735+0000 mgr.gibba045.orlgmj (mgr.34412) 469 : audit [DBG] from='client.54370 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:56:50.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:56:49 gibba045 bash[25517]: audit 2021-03-10T13:56:49.062381+0000 mon.a (mon.0) 596 : audit [DBG] from='client.? 172.21.2.115:0/1612064221' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:56:51.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:56:50 gibba015 bash[29377]: cluster 2021-03-10T13:56:49.217308+0000 mgr.gibba045.orlgmj (mgr.34412) 470 : cluster [DBG] pgmap v253: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:51.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:56:50 gibba015 bash[30343]: cluster 2021-03-10T13:56:49.217308+0000 mgr.gibba045.orlgmj (mgr.34412) 470 : cluster [DBG] pgmap v253: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:51.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:56:50 gibba045 bash[25517]: cluster 2021-03-10T13:56:49.217308+0000 mgr.gibba045.orlgmj (mgr.34412) 470 : cluster [DBG] pgmap v253: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:53.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:56:52 gibba015 bash[30343]: cluster 2021-03-10T13:56:51.218521+0000 mgr.gibba045.orlgmj (mgr.34412) 471 : cluster [DBG] pgmap v254: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:53.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:56:52 gibba015 bash[30343]: audit 2021-03-10T13:56:52.402505+0000 mon.c (mon.1) 196 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T13:56:53.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:56:52 gibba015 bash[30343]: audit 2021-03-10T13:56:52.403221+0000 mon.c (mon.1) 197 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T13:56:53.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:56:52 gibba015 bash[30343]: audit 2021-03-10T13:56:52.403690+0000 mon.a (mon.0) 597 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T13:56:53.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:56:52 gibba015 bash[30343]: audit 2021-03-10T13:56:52.403900+0000 mon.c (mon.1) 198 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T13:56:53.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:56:52 gibba015 bash[30343]: audit 2021-03-10T13:56:52.404739+0000 mon.c (mon.1) 199 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T13:56:53.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:56:52 gibba015 bash[30343]: audit 2021-03-10T13:56:52.405041+0000 mon.a (mon.0) 598 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T13:56:53.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:56:52 gibba015 bash[30343]: audit 2021-03-10T13:56:52.406060+0000 mon.a (mon.0) 599 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T13:56:53.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:56:52 gibba015 bash[30343]: audit 2021-03-10T13:56:52.406863+0000 mon.a (mon.0) 600 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T13:56:53.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:56:52 gibba015 bash[30343]: audit 2021-03-10T13:56:52.504786+0000 mon.c (mon.1) 200 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:56:53.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:56:52 gibba015 bash[30343]: audit 2021-03-10T13:56:52.505466+0000 mon.c (mon.1) 201 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T13:56:53.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:56:52 gibba015 bash[30343]: audit 2021-03-10T13:56:52.505909+0000 mon.a (mon.0) 601 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:56:53.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:56:52 gibba015 bash[30343]: audit 2021-03-10T13:56:52.507019+0000 mon.a (mon.0) 602 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T13:56:53.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:56:52 gibba015 bash[29377]: cluster 2021-03-10T13:56:51.218521+0000 mgr.gibba045.orlgmj (mgr.34412) 471 : cluster [DBG] pgmap v254: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:53.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:56:52 gibba015 bash[29377]: audit 2021-03-10T13:56:52.402505+0000 mon.c (mon.1) 196 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T13:56:53.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:56:52 gibba015 bash[29377]: audit 2021-03-10T13:56:52.403221+0000 mon.c (mon.1) 197 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T13:56:53.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:56:52 gibba015 bash[29377]: audit 2021-03-10T13:56:52.403690+0000 mon.a (mon.0) 597 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T13:56:53.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:56:52 gibba015 bash[29377]: audit 2021-03-10T13:56:52.403900+0000 mon.c (mon.1) 198 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T13:56:53.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:56:52 gibba015 bash[29377]: audit 2021-03-10T13:56:52.404739+0000 mon.c (mon.1) 199 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T13:56:53.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:56:52 gibba015 bash[29377]: audit 2021-03-10T13:56:52.405041+0000 mon.a (mon.0) 598 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T13:56:53.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:56:52 gibba015 bash[29377]: audit 2021-03-10T13:56:52.406060+0000 mon.a (mon.0) 599 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T13:56:53.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:56:52 gibba015 bash[29377]: audit 2021-03-10T13:56:52.406863+0000 mon.a (mon.0) 600 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T13:56:53.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:56:52 gibba015 bash[29377]: audit 2021-03-10T13:56:52.504786+0000 mon.c (mon.1) 200 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:56:53.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:56:52 gibba015 bash[29377]: audit 2021-03-10T13:56:52.505466+0000 mon.c (mon.1) 201 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T13:56:53.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:56:52 gibba015 bash[29377]: audit 2021-03-10T13:56:52.505909+0000 mon.a (mon.0) 601 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:56:53.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:56:52 gibba015 bash[29377]: audit 2021-03-10T13:56:52.507019+0000 mon.a (mon.0) 602 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T13:56:53.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:56:52 gibba045 bash[25517]: cluster 2021-03-10T13:56:51.218521+0000 mgr.gibba045.orlgmj (mgr.34412) 471 : cluster [DBG] pgmap v254: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:53.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:56:52 gibba045 bash[25517]: audit 2021-03-10T13:56:52.402505+0000 mon.c (mon.1) 196 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T13:56:53.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:56:52 gibba045 bash[25517]: audit 2021-03-10T13:56:52.403221+0000 mon.c (mon.1) 197 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T13:56:53.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:56:52 gibba045 bash[25517]: audit 2021-03-10T13:56:52.403690+0000 mon.a (mon.0) 597 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T13:56:53.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:56:52 gibba045 bash[25517]: audit 2021-03-10T13:56:52.403900+0000 mon.c (mon.1) 198 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T13:56:53.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:56:52 gibba045 bash[25517]: audit 2021-03-10T13:56:52.404739+0000 mon.c (mon.1) 199 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T13:56:53.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:56:52 gibba045 bash[25517]: audit 2021-03-10T13:56:52.405041+0000 mon.a (mon.0) 598 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T13:56:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:56:52 gibba045 bash[25517]: audit 2021-03-10T13:56:52.406060+0000 mon.a (mon.0) 599 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T13:56:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:56:52 gibba045 bash[25517]: audit 2021-03-10T13:56:52.406863+0000 mon.a (mon.0) 600 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T13:56:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:56:52 gibba045 bash[25517]: audit 2021-03-10T13:56:52.504786+0000 mon.c (mon.1) 200 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:56:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:56:52 gibba045 bash[25517]: audit 2021-03-10T13:56:52.505466+0000 mon.c (mon.1) 201 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T13:56:53.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:56:52 gibba045 bash[25517]: audit 2021-03-10T13:56:52.505909+0000 mon.a (mon.0) 601 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:56:53.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:56:52 gibba045 bash[25517]: audit 2021-03-10T13:56:52.507019+0000 mon.a (mon.0) 602 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T13:56:55.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:56:54 gibba015 bash[30343]: cluster 2021-03-10T13:56:53.219991+0000 mgr.gibba045.orlgmj (mgr.34412) 472 : cluster [DBG] pgmap v255: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:55.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:56:54 gibba015 bash[29377]: cluster 2021-03-10T13:56:53.219991+0000 mgr.gibba045.orlgmj (mgr.34412) 472 : cluster [DBG] pgmap v255: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:55.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:56:54 gibba045 bash[25517]: cluster 2021-03-10T13:56:53.219991+0000 mgr.gibba045.orlgmj (mgr.34412) 472 : cluster [DBG] pgmap v255: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:57.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:56:56 gibba015 bash[29377]: cluster 2021-03-10T13:56:55.221654+0000 mgr.gibba045.orlgmj (mgr.34412) 473 : cluster [DBG] pgmap v256: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:57.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:56:56 gibba015 bash[30343]: cluster 2021-03-10T13:56:55.221654+0000 mgr.gibba045.orlgmj (mgr.34412) 473 : cluster [DBG] pgmap v256: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:57.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:56:56 gibba045 bash[25517]: cluster 2021-03-10T13:56:55.221654+0000 mgr.gibba045.orlgmj (mgr.34412) 473 : cluster [DBG] pgmap v256: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:59.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:56:58 gibba015 bash[29377]: cluster 2021-03-10T13:56:57.223420+0000 mgr.gibba045.orlgmj (mgr.34412) 474 : cluster [DBG] pgmap v257: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:59.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:56:58 gibba015 bash[30343]: cluster 2021-03-10T13:56:57.223420+0000 mgr.gibba045.orlgmj (mgr.34412) 474 : cluster [DBG] pgmap v257: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:56:59.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:56:58 gibba045 bash[25517]: cluster 2021-03-10T13:56:57.223420+0000 mgr.gibba045.orlgmj (mgr.34412) 474 : cluster [DBG] pgmap v257: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:01.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:57:00 gibba015 bash[29377]: cluster 2021-03-10T13:56:59.224718+0000 mgr.gibba045.orlgmj (mgr.34412) 475 : cluster [DBG] pgmap v258: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:01.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:57:00 gibba015 bash[30343]: cluster 2021-03-10T13:56:59.224718+0000 mgr.gibba045.orlgmj (mgr.34412) 475 : cluster [DBG] pgmap v258: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:01.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:57:00 gibba045 bash[25517]: cluster 2021-03-10T13:56:59.224718+0000 mgr.gibba045.orlgmj (mgr.34412) 475 : cluster [DBG] pgmap v258: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:03.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:57:02 gibba015 bash[29377]: cluster 2021-03-10T13:57:01.226336+0000 mgr.gibba045.orlgmj (mgr.34412) 476 : cluster [DBG] pgmap v259: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:03.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:57:02 gibba015 bash[30343]: cluster 2021-03-10T13:57:01.226336+0000 mgr.gibba045.orlgmj (mgr.34412) 476 : cluster [DBG] pgmap v259: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:03.257 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:57:02 gibba045 bash[25517]: cluster 2021-03-10T13:57:01.226336+0000 mgr.gibba045.orlgmj (mgr.34412) 476 : cluster [DBG] pgmap v259: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:04.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:57:03 gibba015 bash[29377]: audit 2021-03-10T13:57:03.026239+0000 mon.c (mon.1) 202 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:57:04.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:57:03 gibba015 bash[29377]: audit 2021-03-10T13:57:03.242266+0000 mon.a (mon.0) 603 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:57:04.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:57:03 gibba015 bash[29377]: audit 2021-03-10T13:57:03.246095+0000 mon.c (mon.1) 203 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:57:04.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:57:03 gibba015 bash[29377]: audit 2021-03-10T13:57:03.247700+0000 mon.c (mon.1) 204 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:57:04.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:57:03 gibba015 bash[29377]: audit 2021-03-10T13:57:03.248825+0000 mon.c (mon.1) 205 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:57:04.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:57:03 gibba015 bash[29377]: audit 2021-03-10T13:57:03.249688+0000 mon.c (mon.1) 206 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:57:04.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:57:03 gibba015 bash[29377]: audit 2021-03-10T13:57:03.252380+0000 mon.c (mon.1) 207 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:57:04.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:57:03 gibba015 bash[29377]: audit 2021-03-10T13:57:03.253909+0000 mon.c (mon.1) 208 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:57:04.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:57:03 gibba015 bash[30343]: audit 2021-03-10T13:57:03.026239+0000 mon.c (mon.1) 202 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:57:04.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:57:03 gibba015 bash[30343]: audit 2021-03-10T13:57:03.242266+0000 mon.a (mon.0) 603 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:57:04.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:57:03 gibba015 bash[30343]: audit 2021-03-10T13:57:03.246095+0000 mon.c (mon.1) 203 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:57:04.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:57:03 gibba015 bash[30343]: audit 2021-03-10T13:57:03.247700+0000 mon.c (mon.1) 204 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:57:04.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:57:03 gibba015 bash[30343]: audit 2021-03-10T13:57:03.248825+0000 mon.c (mon.1) 205 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:57:04.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:57:03 gibba015 bash[30343]: audit 2021-03-10T13:57:03.249688+0000 mon.c (mon.1) 206 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:57:04.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:57:03 gibba015 bash[30343]: audit 2021-03-10T13:57:03.252380+0000 mon.c (mon.1) 207 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:57:04.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:57:03 gibba015 bash[30343]: audit 2021-03-10T13:57:03.253909+0000 mon.c (mon.1) 208 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:57:04.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:57:03 gibba045 bash[25517]: audit 2021-03-10T13:57:03.026239+0000 mon.c (mon.1) 202 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:57:04.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:57:03 gibba045 bash[25517]: audit 2021-03-10T13:57:03.242266+0000 mon.a (mon.0) 603 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:57:04.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:57:03 gibba045 bash[25517]: audit 2021-03-10T13:57:03.246095+0000 mon.c (mon.1) 203 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:57:04.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:57:03 gibba045 bash[25517]: audit 2021-03-10T13:57:03.247700+0000 mon.c (mon.1) 204 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:57:04.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:57:03 gibba045 bash[25517]: audit 2021-03-10T13:57:03.248825+0000 mon.c (mon.1) 205 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:57:04.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:57:03 gibba045 bash[25517]: audit 2021-03-10T13:57:03.249688+0000 mon.c (mon.1) 206 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:57:04.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:57:03 gibba045 bash[25517]: audit 2021-03-10T13:57:03.252380+0000 mon.c (mon.1) 207 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:57:04.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:57:03 gibba045 bash[25517]: audit 2021-03-10T13:57:03.253909+0000 mon.c (mon.1) 208 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:57:05.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:57:04 gibba015 bash[29377]: cephadm 2021-03-10T13:57:03.033953+0000 mgr.gibba045.orlgmj (mgr.34412) 477 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T13:57:05.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:57:04 gibba015 bash[29377]: cephadm 2021-03-10T13:57:03.035805+0000 mgr.gibba045.orlgmj (mgr.34412) 478 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T13:57:05.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:57:04 gibba015 bash[29377]: cluster 2021-03-10T13:57:03.226855+0000 mgr.gibba045.orlgmj (mgr.34412) 479 : cluster [DBG] pgmap v260: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:05.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:57:04 gibba015 bash[29377]: cephadm 2021-03-10T13:57:03.248145+0000 mgr.gibba045.orlgmj (mgr.34412) 480 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:57:05.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:57:04 gibba015 bash[29377]: cephadm 2021-03-10T13:57:03.250011+0000 mgr.gibba045.orlgmj (mgr.34412) 481 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:57:05.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:57:04 gibba015 bash[29377]: cephadm 2021-03-10T13:57:03.251253+0000 mgr.gibba045.orlgmj (mgr.34412) 482 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:57:05.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:57:04 gibba015 bash[29377]: cephadm 2021-03-10T13:57:03.251299+0000 mgr.gibba045.orlgmj (mgr.34412) 483 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:57:05.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:57:04 gibba015 bash[29377]: cephadm 2021-03-10T13:57:03.252269+0000 mgr.gibba045.orlgmj (mgr.34412) 484 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:57:05.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:57:04 gibba015 bash[29377]: cephadm 2021-03-10T13:57:03.252312+0000 mgr.gibba045.orlgmj (mgr.34412) 485 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:57:05.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:57:04 gibba015 bash[29377]: cephadm 2021-03-10T13:57:03.253115+0000 mgr.gibba045.orlgmj (mgr.34412) 486 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:57:05.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:57:04 gibba015 bash[29377]: cephadm 2021-03-10T13:57:03.254521+0000 mgr.gibba045.orlgmj (mgr.34412) 487 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:57:05.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:57:04 gibba015 bash[29377]: cephadm 2021-03-10T13:57:03.254565+0000 mgr.gibba045.orlgmj (mgr.34412) 488 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:57:05.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:57:04 gibba015 bash[29377]: cephadm 2021-03-10T13:57:03.256004+0000 mgr.gibba045.orlgmj (mgr.34412) 489 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T13:57:05.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:57:04 gibba015 bash[29377]: cephadm 2021-03-10T13:57:03.256487+0000 mgr.gibba045.orlgmj (mgr.34412) 490 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T13:57:05.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:57:04 gibba015 bash[29377]: cephadm 2021-03-10T13:57:03.257818+0000 mgr.gibba045.orlgmj (mgr.34412) 491 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T13:57:05.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:57:04 gibba015 bash[29377]: cephadm 2021-03-10T13:57:03.257855+0000 mgr.gibba045.orlgmj (mgr.34412) 492 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T13:57:05.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:57:04 gibba015 bash[29377]: cephadm 2021-03-10T13:57:03.257966+0000 mgr.gibba045.orlgmj (mgr.34412) 493 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T13:57:05.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:57:04 gibba015 bash[30343]: cephadm 2021-03-10T13:57:03.033953+0000 mgr.gibba045.orlgmj (mgr.34412) 477 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T13:57:05.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:57:04 gibba015 bash[30343]: cephadm 2021-03-10T13:57:03.035805+0000 mgr.gibba045.orlgmj (mgr.34412) 478 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T13:57:05.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:57:04 gibba015 bash[30343]: cluster 2021-03-10T13:57:03.226855+0000 mgr.gibba045.orlgmj (mgr.34412) 479 : cluster [DBG] pgmap v260: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:05.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:57:04 gibba015 bash[30343]: cephadm 2021-03-10T13:57:03.248145+0000 mgr.gibba045.orlgmj (mgr.34412) 480 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:57:05.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:57:04 gibba015 bash[30343]: cephadm 2021-03-10T13:57:03.250011+0000 mgr.gibba045.orlgmj (mgr.34412) 481 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:57:05.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:57:04 gibba015 bash[30343]: cephadm 2021-03-10T13:57:03.251253+0000 mgr.gibba045.orlgmj (mgr.34412) 482 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:57:05.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:57:04 gibba015 bash[30343]: cephadm 2021-03-10T13:57:03.251299+0000 mgr.gibba045.orlgmj (mgr.34412) 483 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:57:05.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:57:04 gibba015 bash[30343]: cephadm 2021-03-10T13:57:03.252269+0000 mgr.gibba045.orlgmj (mgr.34412) 484 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:57:05.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:57:04 gibba015 bash[30343]: cephadm 2021-03-10T13:57:03.252312+0000 mgr.gibba045.orlgmj (mgr.34412) 485 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:57:05.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:57:04 gibba015 bash[30343]: cephadm 2021-03-10T13:57:03.253115+0000 mgr.gibba045.orlgmj (mgr.34412) 486 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:57:05.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:57:04 gibba015 bash[30343]: cephadm 2021-03-10T13:57:03.254521+0000 mgr.gibba045.orlgmj (mgr.34412) 487 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:57:05.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:57:04 gibba015 bash[30343]: cephadm 2021-03-10T13:57:03.254565+0000 mgr.gibba045.orlgmj (mgr.34412) 488 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:57:05.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:57:04 gibba015 bash[30343]: cephadm 2021-03-10T13:57:03.256004+0000 mgr.gibba045.orlgmj (mgr.34412) 489 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T13:57:05.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:57:04 gibba015 bash[30343]: cephadm 2021-03-10T13:57:03.256487+0000 mgr.gibba045.orlgmj (mgr.34412) 490 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T13:57:05.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:57:04 gibba015 bash[30343]: cephadm 2021-03-10T13:57:03.257818+0000 mgr.gibba045.orlgmj (mgr.34412) 491 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T13:57:05.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:57:04 gibba015 bash[30343]: cephadm 2021-03-10T13:57:03.257855+0000 mgr.gibba045.orlgmj (mgr.34412) 492 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T13:57:05.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:57:04 gibba015 bash[30343]: cephadm 2021-03-10T13:57:03.257966+0000 mgr.gibba045.orlgmj (mgr.34412) 493 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T13:57:05.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:57:04 gibba045 bash[25517]: cephadm 2021-03-10T13:57:03.033953+0000 mgr.gibba045.orlgmj (mgr.34412) 477 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T13:57:05.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:57:04 gibba045 bash[25517]: cephadm 2021-03-10T13:57:03.035805+0000 mgr.gibba045.orlgmj (mgr.34412) 478 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T13:57:05.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:57:04 gibba045 bash[25517]: cluster 2021-03-10T13:57:03.226855+0000 mgr.gibba045.orlgmj (mgr.34412) 479 : cluster [DBG] pgmap v260: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:05.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:57:04 gibba045 bash[25517]: cephadm 2021-03-10T13:57:03.248145+0000 mgr.gibba045.orlgmj (mgr.34412) 480 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:57:05.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:57:04 gibba045 bash[25517]: cephadm 2021-03-10T13:57:03.250011+0000 mgr.gibba045.orlgmj (mgr.34412) 481 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:57:05.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:57:04 gibba045 bash[25517]: cephadm 2021-03-10T13:57:03.251253+0000 mgr.gibba045.orlgmj (mgr.34412) 482 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:57:05.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:57:04 gibba045 bash[25517]: cephadm 2021-03-10T13:57:03.251299+0000 mgr.gibba045.orlgmj (mgr.34412) 483 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:57:05.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:57:04 gibba045 bash[25517]: cephadm 2021-03-10T13:57:03.252269+0000 mgr.gibba045.orlgmj (mgr.34412) 484 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:57:05.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:57:04 gibba045 bash[25517]: cephadm 2021-03-10T13:57:03.252312+0000 mgr.gibba045.orlgmj (mgr.34412) 485 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:57:05.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:57:04 gibba045 bash[25517]: cephadm 2021-03-10T13:57:03.253115+0000 mgr.gibba045.orlgmj (mgr.34412) 486 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:57:05.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:57:04 gibba045 bash[25517]: cephadm 2021-03-10T13:57:03.254521+0000 mgr.gibba045.orlgmj (mgr.34412) 487 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:57:05.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:57:04 gibba045 bash[25517]: cephadm 2021-03-10T13:57:03.254565+0000 mgr.gibba045.orlgmj (mgr.34412) 488 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:57:05.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:57:04 gibba045 bash[25517]: cephadm 2021-03-10T13:57:03.256004+0000 mgr.gibba045.orlgmj (mgr.34412) 489 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T13:57:05.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:57:04 gibba045 bash[25517]: cephadm 2021-03-10T13:57:03.256487+0000 mgr.gibba045.orlgmj (mgr.34412) 490 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T13:57:05.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:57:04 gibba045 bash[25517]: cephadm 2021-03-10T13:57:03.257818+0000 mgr.gibba045.orlgmj (mgr.34412) 491 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T13:57:05.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:57:04 gibba045 bash[25517]: cephadm 2021-03-10T13:57:03.257855+0000 mgr.gibba045.orlgmj (mgr.34412) 492 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T13:57:05.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:57:04 gibba045 bash[25517]: cephadm 2021-03-10T13:57:03.257966+0000 mgr.gibba045.orlgmj (mgr.34412) 493 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T13:57:07.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:57:06 gibba015 bash[29377]: cluster 2021-03-10T13:57:05.228397+0000 mgr.gibba045.orlgmj (mgr.34412) 494 : cluster [DBG] pgmap v261: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:07.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:57:06 gibba015 bash[30343]: cluster 2021-03-10T13:57:05.228397+0000 mgr.gibba045.orlgmj (mgr.34412) 494 : cluster [DBG] pgmap v261: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:07.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:57:06 gibba045 bash[25517]: cluster 2021-03-10T13:57:05.228397+0000 mgr.gibba045.orlgmj (mgr.34412) 494 : cluster [DBG] pgmap v261: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:09.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:57:08 gibba015 bash[29377]: cluster 2021-03-10T13:57:07.230226+0000 mgr.gibba045.orlgmj (mgr.34412) 495 : cluster [DBG] pgmap v262: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:09.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:57:08 gibba015 bash[30343]: cluster 2021-03-10T13:57:07.230226+0000 mgr.gibba045.orlgmj (mgr.34412) 495 : cluster [DBG] pgmap v262: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:09.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:57:08 gibba045 bash[25517]: cluster 2021-03-10T13:57:07.230226+0000 mgr.gibba045.orlgmj (mgr.34412) 495 : cluster [DBG] pgmap v262: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:10.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:57:09 gibba015 bash[29377]: cluster 2021-03-10T13:57:09.231595+0000 mgr.gibba045.orlgmj (mgr.34412) 496 : cluster [DBG] pgmap v263: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:10.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:57:09 gibba015 bash[30343]: cluster 2021-03-10T13:57:09.231595+0000 mgr.gibba045.orlgmj (mgr.34412) 496 : cluster [DBG] pgmap v263: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:10.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:57:09 gibba045 bash[25517]: cluster 2021-03-10T13:57:09.231595+0000 mgr.gibba045.orlgmj (mgr.34412) 496 : cluster [DBG] pgmap v263: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:12.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:57:12 gibba045 bash[25517]: cluster 2021-03-10T13:57:11.233289+0000 mgr.gibba045.orlgmj (mgr.34412) 497 : cluster [DBG] pgmap v264: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:12.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:57:12 gibba015 bash[29377]: cluster 2021-03-10T13:57:11.233289+0000 mgr.gibba045.orlgmj (mgr.34412) 497 : cluster [DBG] pgmap v264: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:12.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:57:12 gibba015 bash[30343]: cluster 2021-03-10T13:57:11.233289+0000 mgr.gibba045.orlgmj (mgr.34412) 497 : cluster [DBG] pgmap v264: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:14.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:57:14 gibba045 bash[25517]: cluster 2021-03-10T13:57:13.234670+0000 mgr.gibba045.orlgmj (mgr.34412) 498 : cluster [DBG] pgmap v265: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:14.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:57:14 gibba015 bash[29377]: cluster 2021-03-10T13:57:13.234670+0000 mgr.gibba045.orlgmj (mgr.34412) 498 : cluster [DBG] pgmap v265: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:14.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:57:14 gibba015 bash[30343]: cluster 2021-03-10T13:57:13.234670+0000 mgr.gibba045.orlgmj (mgr.34412) 498 : cluster [DBG] pgmap v265: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:16.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:57:16 gibba045 bash[25517]: cluster 2021-03-10T13:57:15.236273+0000 mgr.gibba045.orlgmj (mgr.34412) 499 : cluster [DBG] pgmap v266: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:16.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:57:16 gibba015 bash[29377]: cluster 2021-03-10T13:57:15.236273+0000 mgr.gibba045.orlgmj (mgr.34412) 499 : cluster [DBG] pgmap v266: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:16.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:57:16 gibba015 bash[30343]: cluster 2021-03-10T13:57:15.236273+0000 mgr.gibba045.orlgmj (mgr.34412) 499 : cluster [DBG] pgmap v266: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:18.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:57:18 gibba045 bash[25517]: cluster 2021-03-10T13:57:17.238069+0000 mgr.gibba045.orlgmj (mgr.34412) 500 : cluster [DBG] pgmap v267: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:18.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:57:18 gibba015 bash[29377]: cluster 2021-03-10T13:57:17.238069+0000 mgr.gibba045.orlgmj (mgr.34412) 500 : cluster [DBG] pgmap v267: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:18.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:57:18 gibba015 bash[30343]: cluster 2021-03-10T13:57:17.238069+0000 mgr.gibba045.orlgmj (mgr.34412) 500 : cluster [DBG] pgmap v267: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:19.317 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T13:57:19.560 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T13:57:19.560 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (8m) 5m ago 13m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T13:57:19.561 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (13m) 3m ago 13m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T13:57:19.561 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (8m) 3m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T13:57:19.561 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (8m) 3m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T13:57:19.561 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (7m) 5m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T13:57:19.562 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (7m) 5m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T13:57:19.562 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (7m) 3m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T13:57:19.562 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (7m) 5m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T13:57:19.562 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (13m) 5m ago 13m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T13:57:19.563 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (13m) 3m ago 13m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T13:57:19.563 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (6m) 5m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T13:57:19.563 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (5m) 5m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T13:57:19.563 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (5m) 5m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T13:57:19.563 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (5m) 5m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T13:57:19.564 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (4m) 3m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T13:57:19.564 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (4m) 3m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T13:57:19.564 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3m) 3m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T13:57:19.564 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3m) 3m ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T13:57:19.564 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (12m) 3m ago 13m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T13:57:19.565 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 3m ago 11m docker.io/ceph/ceph:v15.2.0 2021-03-10T13:57:19.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:57:19 gibba045 bash[25517]: cephadm 2021-03-10T13:57:18.273719+0000 mgr.gibba045.orlgmj (mgr.34412) 501 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T13:57:19.841 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T13:57:19.841 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T13:57:19.841 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:57:19.842 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T13:57:19.842 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T13:57:19.842 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:57:19.842 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T13:57:19.843 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T13:57:19.843 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T13:57:19.843 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T13:57:19.843 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T13:57:19.843 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T13:57:19.844 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T13:57:19.844 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T13:57:19.844 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T13:57:19.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:57:19 gibba015 bash[29377]: cephadm 2021-03-10T13:57:18.273719+0000 mgr.gibba045.orlgmj (mgr.34412) 501 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T13:57:19.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:57:19 gibba015 bash[30343]: cephadm 2021-03-10T13:57:18.273719+0000 mgr.gibba045.orlgmj (mgr.34412) 501 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T13:57:20.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:57:20 gibba015 bash[29377]: cluster 2021-03-10T13:57:19.239270+0000 mgr.gibba045.orlgmj (mgr.34412) 502 : cluster [DBG] pgmap v268: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:20.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:57:20 gibba015 bash[29377]: audit 2021-03-10T13:57:19.299866+0000 mgr.gibba045.orlgmj (mgr.34412) 503 : audit [DBG] from='client.44394 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:57:20.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:57:20 gibba015 bash[29377]: audit 2021-03-10T13:57:19.549857+0000 mgr.gibba045.orlgmj (mgr.34412) 504 : audit [DBG] from='client.44400 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:57:20.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:57:20 gibba015 bash[29377]: audit 2021-03-10T13:57:19.838629+0000 mon.c (mon.1) 209 : audit [DBG] from='client.? 172.21.2.115:0/4083966878' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:57:20.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:57:20 gibba015 bash[30343]: cluster 2021-03-10T13:57:19.239270+0000 mgr.gibba045.orlgmj (mgr.34412) 502 : cluster [DBG] pgmap v268: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:20.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:57:20 gibba015 bash[30343]: audit 2021-03-10T13:57:19.299866+0000 mgr.gibba045.orlgmj (mgr.34412) 503 : audit [DBG] from='client.44394 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:57:20.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:57:20 gibba015 bash[30343]: audit 2021-03-10T13:57:19.549857+0000 mgr.gibba045.orlgmj (mgr.34412) 504 : audit [DBG] from='client.44400 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:57:20.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:57:20 gibba015 bash[30343]: audit 2021-03-10T13:57:19.838629+0000 mon.c (mon.1) 209 : audit [DBG] from='client.? 172.21.2.115:0/4083966878' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:57:21.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:57:20 gibba045 bash[25517]: cluster 2021-03-10T13:57:19.239270+0000 mgr.gibba045.orlgmj (mgr.34412) 502 : cluster [DBG] pgmap v268: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:21.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:57:20 gibba045 bash[25517]: audit 2021-03-10T13:57:19.299866+0000 mgr.gibba045.orlgmj (mgr.34412) 503 : audit [DBG] from='client.44394 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:57:21.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:57:20 gibba045 bash[25517]: audit 2021-03-10T13:57:19.549857+0000 mgr.gibba045.orlgmj (mgr.34412) 504 : audit [DBG] from='client.44400 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:57:21.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:57:20 gibba045 bash[25517]: audit 2021-03-10T13:57:19.838629+0000 mon.c (mon.1) 209 : audit [DBG] from='client.? 172.21.2.115:0/4083966878' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:57:22.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:57:22 gibba015 bash[29377]: cluster 2021-03-10T13:57:21.240933+0000 mgr.gibba045.orlgmj (mgr.34412) 505 : cluster [DBG] pgmap v269: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:22.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:57:22 gibba015 bash[30343]: cluster 2021-03-10T13:57:21.240933+0000 mgr.gibba045.orlgmj (mgr.34412) 505 : cluster [DBG] pgmap v269: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:23.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:57:22 gibba045 bash[25517]: cluster 2021-03-10T13:57:21.240933+0000 mgr.gibba045.orlgmj (mgr.34412) 505 : cluster [DBG] pgmap v269: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:24.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:57:24 gibba015 bash[29377]: cluster 2021-03-10T13:57:23.242492+0000 mgr.gibba045.orlgmj (mgr.34412) 506 : cluster [DBG] pgmap v270: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:24.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:57:24 gibba015 bash[30343]: cluster 2021-03-10T13:57:23.242492+0000 mgr.gibba045.orlgmj (mgr.34412) 506 : cluster [DBG] pgmap v270: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:25.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:57:24 gibba045 bash[25517]: cluster 2021-03-10T13:57:23.242492+0000 mgr.gibba045.orlgmj (mgr.34412) 506 : cluster [DBG] pgmap v270: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:26.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:57:26 gibba015 bash[29377]: cluster 2021-03-10T13:57:25.244216+0000 mgr.gibba045.orlgmj (mgr.34412) 507 : cluster [DBG] pgmap v271: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:26.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:57:26 gibba015 bash[30343]: cluster 2021-03-10T13:57:25.244216+0000 mgr.gibba045.orlgmj (mgr.34412) 507 : cluster [DBG] pgmap v271: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:27.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:57:26 gibba045 bash[25517]: cluster 2021-03-10T13:57:25.244216+0000 mgr.gibba045.orlgmj (mgr.34412) 507 : cluster [DBG] pgmap v271: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:28.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:57:28 gibba015 bash[29377]: cluster 2021-03-10T13:57:27.245977+0000 mgr.gibba045.orlgmj (mgr.34412) 508 : cluster [DBG] pgmap v272: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:28.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:57:28 gibba015 bash[30343]: cluster 2021-03-10T13:57:27.245977+0000 mgr.gibba045.orlgmj (mgr.34412) 508 : cluster [DBG] pgmap v272: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:29.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:57:28 gibba045 bash[25517]: cluster 2021-03-10T13:57:27.245977+0000 mgr.gibba045.orlgmj (mgr.34412) 508 : cluster [DBG] pgmap v272: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:30.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:57:30 gibba015 bash[29377]: cluster 2021-03-10T13:57:29.247221+0000 mgr.gibba045.orlgmj (mgr.34412) 509 : cluster [DBG] pgmap v273: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:30.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:57:30 gibba015 bash[30343]: cluster 2021-03-10T13:57:29.247221+0000 mgr.gibba045.orlgmj (mgr.34412) 509 : cluster [DBG] pgmap v273: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:31.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:57:30 gibba045 bash[25517]: cluster 2021-03-10T13:57:29.247221+0000 mgr.gibba045.orlgmj (mgr.34412) 509 : cluster [DBG] pgmap v273: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:32.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:57:32 gibba015 bash[29377]: cluster 2021-03-10T13:57:31.248971+0000 mgr.gibba045.orlgmj (mgr.34412) 510 : cluster [DBG] pgmap v274: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:32.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:57:32 gibba015 bash[30343]: cluster 2021-03-10T13:57:31.248971+0000 mgr.gibba045.orlgmj (mgr.34412) 510 : cluster [DBG] pgmap v274: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:33.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:57:32 gibba045 bash[25517]: cluster 2021-03-10T13:57:31.248971+0000 mgr.gibba045.orlgmj (mgr.34412) 510 : cluster [DBG] pgmap v274: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:34.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:57:34 gibba015 bash[29377]: cluster 2021-03-10T13:57:33.250352+0000 mgr.gibba045.orlgmj (mgr.34412) 511 : cluster [DBG] pgmap v275: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:34.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:57:34 gibba015 bash[29377]: cephadm 2021-03-10T13:57:33.289513+0000 mgr.gibba045.orlgmj (mgr.34412) 512 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T13:57:34.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:57:34 gibba015 bash[30343]: cluster 2021-03-10T13:57:33.250352+0000 mgr.gibba045.orlgmj (mgr.34412) 511 : cluster [DBG] pgmap v275: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:34.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:57:34 gibba015 bash[30343]: cephadm 2021-03-10T13:57:33.289513+0000 mgr.gibba045.orlgmj (mgr.34412) 512 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T13:57:35.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:57:34 gibba045 bash[25517]: cluster 2021-03-10T13:57:33.250352+0000 mgr.gibba045.orlgmj (mgr.34412) 511 : cluster [DBG] pgmap v275: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:35.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:57:34 gibba045 bash[25517]: cephadm 2021-03-10T13:57:33.289513+0000 mgr.gibba045.orlgmj (mgr.34412) 512 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T13:57:36.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:57:36 gibba015 bash[29377]: cluster 2021-03-10T13:57:35.251857+0000 mgr.gibba045.orlgmj (mgr.34412) 513 : cluster [DBG] pgmap v276: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:36.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:57:36 gibba015 bash[30343]: cluster 2021-03-10T13:57:35.251857+0000 mgr.gibba045.orlgmj (mgr.34412) 513 : cluster [DBG] pgmap v276: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:37.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:57:36 gibba045 bash[25517]: cluster 2021-03-10T13:57:35.251857+0000 mgr.gibba045.orlgmj (mgr.34412) 513 : cluster [DBG] pgmap v276: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:38.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:57:38 gibba015 bash[29377]: cluster 2021-03-10T13:57:37.253657+0000 mgr.gibba045.orlgmj (mgr.34412) 514 : cluster [DBG] pgmap v277: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:38.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:57:38 gibba015 bash[30343]: cluster 2021-03-10T13:57:37.253657+0000 mgr.gibba045.orlgmj (mgr.34412) 514 : cluster [DBG] pgmap v277: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:39.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:57:38 gibba045 bash[25517]: cluster 2021-03-10T13:57:37.253657+0000 mgr.gibba045.orlgmj (mgr.34412) 514 : cluster [DBG] pgmap v277: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:40.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:57:40 gibba015 bash[29377]: cluster 2021-03-10T13:57:39.254999+0000 mgr.gibba045.orlgmj (mgr.34412) 515 : cluster [DBG] pgmap v278: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:40.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:57:40 gibba015 bash[30343]: cluster 2021-03-10T13:57:39.254999+0000 mgr.gibba045.orlgmj (mgr.34412) 515 : cluster [DBG] pgmap v278: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:41.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:57:40 gibba045 bash[25517]: cluster 2021-03-10T13:57:39.254999+0000 mgr.gibba045.orlgmj (mgr.34412) 515 : cluster [DBG] pgmap v278: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:42.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:57:42 gibba015 bash[29377]: cluster 2021-03-10T13:57:41.256680+0000 mgr.gibba045.orlgmj (mgr.34412) 516 : cluster [DBG] pgmap v279: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:42.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:57:42 gibba015 bash[30343]: cluster 2021-03-10T13:57:41.256680+0000 mgr.gibba045.orlgmj (mgr.34412) 516 : cluster [DBG] pgmap v279: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:43.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:57:42 gibba045 bash[25517]: cluster 2021-03-10T13:57:41.256680+0000 mgr.gibba045.orlgmj (mgr.34412) 516 : cluster [DBG] pgmap v279: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:44.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:57:44 gibba015 bash[29377]: cluster 2021-03-10T13:57:43.258138+0000 mgr.gibba045.orlgmj (mgr.34412) 517 : cluster [DBG] pgmap v280: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:44.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:57:44 gibba015 bash[30343]: cluster 2021-03-10T13:57:43.258138+0000 mgr.gibba045.orlgmj (mgr.34412) 517 : cluster [DBG] pgmap v280: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:45.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:57:44 gibba045 bash[25517]: cluster 2021-03-10T13:57:43.258138+0000 mgr.gibba045.orlgmj (mgr.34412) 517 : cluster [DBG] pgmap v280: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:46.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:57:46 gibba015 bash[29377]: cluster 2021-03-10T13:57:45.259779+0000 mgr.gibba045.orlgmj (mgr.34412) 518 : cluster [DBG] pgmap v281: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:46.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:57:46 gibba015 bash[30343]: cluster 2021-03-10T13:57:45.259779+0000 mgr.gibba045.orlgmj (mgr.34412) 518 : cluster [DBG] pgmap v281: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:47.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:57:46 gibba045 bash[25517]: cluster 2021-03-10T13:57:45.259779+0000 mgr.gibba045.orlgmj (mgr.34412) 518 : cluster [DBG] pgmap v281: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:48.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:57:48 gibba015 bash[29377]: cluster 2021-03-10T13:57:47.261565+0000 mgr.gibba045.orlgmj (mgr.34412) 519 : cluster [DBG] pgmap v282: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:48.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:57:48 gibba015 bash[30343]: cluster 2021-03-10T13:57:47.261565+0000 mgr.gibba045.orlgmj (mgr.34412) 519 : cluster [DBG] pgmap v282: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:49.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:57:48 gibba045 bash[25517]: cluster 2021-03-10T13:57:47.261565+0000 mgr.gibba045.orlgmj (mgr.34412) 519 : cluster [DBG] pgmap v282: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:49.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:57:49 gibba015 bash[29377]: cephadm 2021-03-10T13:57:48.305548+0000 mgr.gibba045.orlgmj (mgr.34412) 520 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T13:57:49.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:57:49 gibba015 bash[30343]: cephadm 2021-03-10T13:57:48.305548+0000 mgr.gibba045.orlgmj (mgr.34412) 520 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T13:57:50.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:57:49 gibba045 bash[25517]: cephadm 2021-03-10T13:57:48.305548+0000 mgr.gibba045.orlgmj (mgr.34412) 520 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T13:57:50.126 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T13:57:50.352 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T13:57:50.352 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (8m) 5m ago 13m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T13:57:50.352 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (13m) 3m ago 13m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T13:57:50.352 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (8m) 3m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T13:57:50.353 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (9m) 3m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T13:57:50.353 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (8m) 5m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T13:57:50.353 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (8m) 5m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T13:57:50.353 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (7m) 3m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T13:57:50.353 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (7m) 5m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T13:57:50.354 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (14m) 5m ago 14m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T13:57:50.354 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (14m) 3m ago 14m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T13:57:50.354 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (6m) 5m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T13:57:50.354 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (6m) 5m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T13:57:50.355 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (6m) 5m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T13:57:50.355 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (5m) 5m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T13:57:50.355 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (5m) 3m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T13:57:50.355 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (4m) 3m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T13:57:50.355 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (4m) 3m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T13:57:50.356 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3m) 3m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T13:57:50.356 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (13m) 3m ago 14m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T13:57:50.356 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 3m ago 12m docker.io/ceph/ceph:v15.2.0 2021-03-10T13:57:50.604 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T13:57:50.604 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T13:57:50.605 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:57:50.605 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T13:57:50.605 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T13:57:50.605 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:57:50.605 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T13:57:50.606 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T13:57:50.606 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T13:57:50.606 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T13:57:50.606 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T13:57:50.606 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T13:57:50.607 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T13:57:50.607 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T13:57:50.607 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T13:57:50.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:57:50 gibba015 bash[29377]: cluster 2021-03-10T13:57:49.262914+0000 mgr.gibba045.orlgmj (mgr.34412) 521 : cluster [DBG] pgmap v283: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:50.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:57:50 gibba015 bash[29377]: audit 2021-03-10T13:57:50.601973+0000 mon.a (mon.0) 604 : audit [DBG] from='client.? 172.21.2.115:0/1965222171' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:57:50.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:57:50 gibba015 bash[30343]: cluster 2021-03-10T13:57:49.262914+0000 mgr.gibba045.orlgmj (mgr.34412) 521 : cluster [DBG] pgmap v283: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:50.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:57:50 gibba015 bash[30343]: audit 2021-03-10T13:57:50.601973+0000 mon.a (mon.0) 604 : audit [DBG] from='client.? 172.21.2.115:0/1965222171' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:57:51.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:57:50 gibba045 bash[25517]: cluster 2021-03-10T13:57:49.262914+0000 mgr.gibba045.orlgmj (mgr.34412) 521 : cluster [DBG] pgmap v283: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:51.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:57:50 gibba045 bash[25517]: audit 2021-03-10T13:57:50.601973+0000 mon.a (mon.0) 604 : audit [DBG] from='client.? 172.21.2.115:0/1965222171' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:57:51.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:57:51 gibba015 bash[29377]: audit 2021-03-10T13:57:50.119239+0000 mgr.gibba045.orlgmj (mgr.34412) 522 : audit [DBG] from='client.54400 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:57:51.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:57:51 gibba015 bash[29377]: audit 2021-03-10T13:57:50.339809+0000 mgr.gibba045.orlgmj (mgr.34412) 523 : audit [DBG] from='client.44418 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:57:51.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:57:51 gibba015 bash[30343]: audit 2021-03-10T13:57:50.119239+0000 mgr.gibba045.orlgmj (mgr.34412) 522 : audit [DBG] from='client.54400 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:57:51.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:57:51 gibba015 bash[30343]: audit 2021-03-10T13:57:50.339809+0000 mgr.gibba045.orlgmj (mgr.34412) 523 : audit [DBG] from='client.44418 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:57:52.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:57:51 gibba045 bash[25517]: audit 2021-03-10T13:57:50.119239+0000 mgr.gibba045.orlgmj (mgr.34412) 522 : audit [DBG] from='client.54400 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:57:52.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:57:51 gibba045 bash[25517]: audit 2021-03-10T13:57:50.339809+0000 mgr.gibba045.orlgmj (mgr.34412) 523 : audit [DBG] from='client.44418 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:57:52.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:57:52 gibba015 bash[29377]: cluster 2021-03-10T13:57:51.264733+0000 mgr.gibba045.orlgmj (mgr.34412) 524 : cluster [DBG] pgmap v284: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:52.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:57:52 gibba015 bash[29377]: audit 2021-03-10T13:57:52.412136+0000 mon.c (mon.1) 210 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T13:57:52.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:57:52 gibba015 bash[29377]: audit 2021-03-10T13:57:52.412870+0000 mon.c (mon.1) 211 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 5]}]: dispatch 2021-03-10T13:57:52.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:57:52 gibba015 bash[29377]: audit 2021-03-10T13:57:52.413413+0000 mon.a (mon.0) 605 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T13:57:52.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:57:52 gibba015 bash[29377]: audit 2021-03-10T13:57:52.413617+0000 mon.c (mon.1) 212 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T13:57:52.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:57:52 gibba015 bash[29377]: audit 2021-03-10T13:57:52.414432+0000 mon.c (mon.1) 213 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T13:57:52.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:57:52 gibba015 bash[29377]: audit 2021-03-10T13:57:52.414857+0000 mon.a (mon.0) 606 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 5]}]: dispatch 2021-03-10T13:57:52.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:57:52 gibba015 bash[29377]: audit 2021-03-10T13:57:52.415917+0000 mon.a (mon.0) 607 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T13:57:52.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:57:52 gibba015 bash[29377]: audit 2021-03-10T13:57:52.416705+0000 mon.a (mon.0) 608 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T13:57:52.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:57:52 gibba015 bash[29377]: audit 2021-03-10T13:57:52.511854+0000 mon.c (mon.1) 214 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:57:52.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:57:52 gibba015 bash[29377]: audit 2021-03-10T13:57:52.512486+0000 mon.c (mon.1) 215 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T13:57:52.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:57:52 gibba015 bash[29377]: audit 2021-03-10T13:57:52.512973+0000 mon.a (mon.0) 609 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:57:52.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:57:52 gibba015 bash[29377]: audit 2021-03-10T13:57:52.514103+0000 mon.a (mon.0) 610 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T13:57:52.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:57:52 gibba015 bash[30343]: cluster 2021-03-10T13:57:51.264733+0000 mgr.gibba045.orlgmj (mgr.34412) 524 : cluster [DBG] pgmap v284: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:52.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:57:52 gibba015 bash[30343]: audit 2021-03-10T13:57:52.412136+0000 mon.c (mon.1) 210 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T13:57:52.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:57:52 gibba015 bash[30343]: audit 2021-03-10T13:57:52.412870+0000 mon.c (mon.1) 211 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 5]}]: dispatch 2021-03-10T13:57:52.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:57:52 gibba015 bash[30343]: audit 2021-03-10T13:57:52.413413+0000 mon.a (mon.0) 605 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T13:57:52.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:57:52 gibba015 bash[30343]: audit 2021-03-10T13:57:52.413617+0000 mon.c (mon.1) 212 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T13:57:52.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:57:52 gibba015 bash[30343]: audit 2021-03-10T13:57:52.414432+0000 mon.c (mon.1) 213 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T13:57:52.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:57:52 gibba015 bash[30343]: audit 2021-03-10T13:57:52.414857+0000 mon.a (mon.0) 606 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 5]}]: dispatch 2021-03-10T13:57:52.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:57:52 gibba015 bash[30343]: audit 2021-03-10T13:57:52.415917+0000 mon.a (mon.0) 607 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T13:57:52.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:57:52 gibba015 bash[30343]: audit 2021-03-10T13:57:52.416705+0000 mon.a (mon.0) 608 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T13:57:52.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:57:52 gibba015 bash[30343]: audit 2021-03-10T13:57:52.511854+0000 mon.c (mon.1) 214 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:57:52.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:57:52 gibba015 bash[30343]: audit 2021-03-10T13:57:52.512486+0000 mon.c (mon.1) 215 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T13:57:52.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:57:52 gibba015 bash[30343]: audit 2021-03-10T13:57:52.512973+0000 mon.a (mon.0) 609 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:57:52.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:57:52 gibba015 bash[30343]: audit 2021-03-10T13:57:52.514103+0000 mon.a (mon.0) 610 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T13:57:53.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:57:52 gibba045 bash[25517]: cluster 2021-03-10T13:57:51.264733+0000 mgr.gibba045.orlgmj (mgr.34412) 524 : cluster [DBG] pgmap v284: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:53.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:57:52 gibba045 bash[25517]: audit 2021-03-10T13:57:52.412136+0000 mon.c (mon.1) 210 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T13:57:53.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:57:52 gibba045 bash[25517]: audit 2021-03-10T13:57:52.412870+0000 mon.c (mon.1) 211 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 5]}]: dispatch 2021-03-10T13:57:53.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:57:52 gibba045 bash[25517]: audit 2021-03-10T13:57:52.413413+0000 mon.a (mon.0) 605 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T13:57:53.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:57:52 gibba045 bash[25517]: audit 2021-03-10T13:57:52.413617+0000 mon.c (mon.1) 212 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T13:57:53.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:57:52 gibba045 bash[25517]: audit 2021-03-10T13:57:52.414432+0000 mon.c (mon.1) 213 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T13:57:53.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:57:52 gibba045 bash[25517]: audit 2021-03-10T13:57:52.414857+0000 mon.a (mon.0) 606 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 5]}]: dispatch 2021-03-10T13:57:53.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:57:52 gibba045 bash[25517]: audit 2021-03-10T13:57:52.415917+0000 mon.a (mon.0) 607 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T13:57:53.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:57:52 gibba045 bash[25517]: audit 2021-03-10T13:57:52.416705+0000 mon.a (mon.0) 608 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T13:57:53.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:57:52 gibba045 bash[25517]: audit 2021-03-10T13:57:52.511854+0000 mon.c (mon.1) 214 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:57:53.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:57:52 gibba045 bash[25517]: audit 2021-03-10T13:57:52.512486+0000 mon.c (mon.1) 215 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T13:57:53.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:57:52 gibba045 bash[25517]: audit 2021-03-10T13:57:52.512973+0000 mon.a (mon.0) 609 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:57:53.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:57:52 gibba045 bash[25517]: audit 2021-03-10T13:57:52.514103+0000 mon.a (mon.0) 610 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T13:57:54.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:57:54 gibba015 bash[29377]: cluster 2021-03-10T13:57:53.266180+0000 mgr.gibba045.orlgmj (mgr.34412) 525 : cluster [DBG] pgmap v285: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:54.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:57:54 gibba015 bash[30343]: cluster 2021-03-10T13:57:53.266180+0000 mgr.gibba045.orlgmj (mgr.34412) 525 : cluster [DBG] pgmap v285: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:55.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:57:54 gibba045 bash[25517]: cluster 2021-03-10T13:57:53.266180+0000 mgr.gibba045.orlgmj (mgr.34412) 525 : cluster [DBG] pgmap v285: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:57.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:57:56 gibba045 bash[25517]: cluster 2021-03-10T13:57:55.267689+0000 mgr.gibba045.orlgmj (mgr.34412) 526 : cluster [DBG] pgmap v286: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:57.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:57:56 gibba015 bash[29377]: cluster 2021-03-10T13:57:55.267689+0000 mgr.gibba045.orlgmj (mgr.34412) 526 : cluster [DBG] pgmap v286: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:57.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:57:56 gibba015 bash[30343]: cluster 2021-03-10T13:57:55.267689+0000 mgr.gibba045.orlgmj (mgr.34412) 526 : cluster [DBG] pgmap v286: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:59.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:57:58 gibba045 bash[25517]: cluster 2021-03-10T13:57:57.269486+0000 mgr.gibba045.orlgmj (mgr.34412) 527 : cluster [DBG] pgmap v287: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:59.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:57:58 gibba015 bash[29377]: cluster 2021-03-10T13:57:57.269486+0000 mgr.gibba045.orlgmj (mgr.34412) 527 : cluster [DBG] pgmap v287: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:57:59.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:57:58 gibba015 bash[30343]: cluster 2021-03-10T13:57:57.269486+0000 mgr.gibba045.orlgmj (mgr.34412) 527 : cluster [DBG] pgmap v287: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:01.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:58:00 gibba045 bash[25517]: cluster 2021-03-10T13:57:59.270660+0000 mgr.gibba045.orlgmj (mgr.34412) 528 : cluster [DBG] pgmap v288: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:01.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:58:00 gibba015 bash[29377]: cluster 2021-03-10T13:57:59.270660+0000 mgr.gibba045.orlgmj (mgr.34412) 528 : cluster [DBG] pgmap v288: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:01.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:58:00 gibba015 bash[30343]: cluster 2021-03-10T13:57:59.270660+0000 mgr.gibba045.orlgmj (mgr.34412) 528 : cluster [DBG] pgmap v288: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:03.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:58:02 gibba045 bash[25517]: cluster 2021-03-10T13:58:01.272385+0000 mgr.gibba045.orlgmj (mgr.34412) 529 : cluster [DBG] pgmap v289: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:03.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:58:02 gibba015 bash[29377]: cluster 2021-03-10T13:58:01.272385+0000 mgr.gibba045.orlgmj (mgr.34412) 529 : cluster [DBG] pgmap v289: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:03.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:58:02 gibba015 bash[30343]: cluster 2021-03-10T13:58:01.272385+0000 mgr.gibba045.orlgmj (mgr.34412) 529 : cluster [DBG] pgmap v289: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:03.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:58:03 gibba045 bash[25517]: audit 2021-03-10T13:58:03.308488+0000 mon.c (mon.1) 216 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:58:03.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:58:03 gibba045 bash[25517]: audit 2021-03-10T13:58:03.510681+0000 mon.a (mon.0) 611 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:58:03.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:58:03 gibba045 bash[25517]: audit 2021-03-10T13:58:03.514354+0000 mon.c (mon.1) 217 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:58:03.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:58:03 gibba045 bash[25517]: audit 2021-03-10T13:58:03.516097+0000 mon.c (mon.1) 218 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:58:03.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:58:03 gibba045 bash[25517]: audit 2021-03-10T13:58:03.517337+0000 mon.c (mon.1) 219 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:58:03.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:58:03 gibba045 bash[25517]: audit 2021-03-10T13:58:03.518768+0000 mon.c (mon.1) 220 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:58:03.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:58:03 gibba045 bash[25517]: audit 2021-03-10T13:58:03.522177+0000 mon.c (mon.1) 221 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:58:03.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:58:03 gibba045 bash[25517]: audit 2021-03-10T13:58:03.523760+0000 mon.c (mon.1) 222 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:58:04.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:58:03 gibba015 bash[29377]: audit 2021-03-10T13:58:03.308488+0000 mon.c (mon.1) 216 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:58:04.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:58:03 gibba015 bash[29377]: audit 2021-03-10T13:58:03.510681+0000 mon.a (mon.0) 611 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:58:04.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:58:03 gibba015 bash[29377]: audit 2021-03-10T13:58:03.514354+0000 mon.c (mon.1) 217 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:58:04.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:58:03 gibba015 bash[29377]: audit 2021-03-10T13:58:03.516097+0000 mon.c (mon.1) 218 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:58:04.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:58:03 gibba015 bash[29377]: audit 2021-03-10T13:58:03.517337+0000 mon.c (mon.1) 219 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:58:04.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:58:03 gibba015 bash[29377]: audit 2021-03-10T13:58:03.518768+0000 mon.c (mon.1) 220 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:58:04.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:58:03 gibba015 bash[29377]: audit 2021-03-10T13:58:03.522177+0000 mon.c (mon.1) 221 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:58:04.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:58:03 gibba015 bash[29377]: audit 2021-03-10T13:58:03.523760+0000 mon.c (mon.1) 222 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:58:04.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:58:03 gibba015 bash[30343]: audit 2021-03-10T13:58:03.308488+0000 mon.c (mon.1) 216 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:58:04.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:58:03 gibba015 bash[30343]: audit 2021-03-10T13:58:03.510681+0000 mon.a (mon.0) 611 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:58:04.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:58:03 gibba015 bash[30343]: audit 2021-03-10T13:58:03.514354+0000 mon.c (mon.1) 217 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:58:04.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:58:03 gibba015 bash[30343]: audit 2021-03-10T13:58:03.516097+0000 mon.c (mon.1) 218 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:58:04.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:58:03 gibba015 bash[30343]: audit 2021-03-10T13:58:03.517337+0000 mon.c (mon.1) 219 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:58:04.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:58:03 gibba015 bash[30343]: audit 2021-03-10T13:58:03.518768+0000 mon.c (mon.1) 220 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:58:04.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:58:03 gibba015 bash[30343]: audit 2021-03-10T13:58:03.522177+0000 mon.c (mon.1) 221 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:58:04.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:58:03 gibba015 bash[30343]: audit 2021-03-10T13:58:03.523760+0000 mon.c (mon.1) 222 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:58:05.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:58:04 gibba045 bash[25517]: cluster 2021-03-10T13:58:03.274081+0000 mgr.gibba045.orlgmj (mgr.34412) 530 : cluster [DBG] pgmap v290: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:05.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:58:04 gibba045 bash[25517]: cephadm 2021-03-10T13:58:03.316704+0000 mgr.gibba045.orlgmj (mgr.34412) 531 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T13:58:05.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:58:04 gibba045 bash[25517]: cephadm 2021-03-10T13:58:03.318481+0000 mgr.gibba045.orlgmj (mgr.34412) 532 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T13:58:05.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:58:04 gibba045 bash[25517]: cephadm 2021-03-10T13:58:03.516290+0000 mgr.gibba045.orlgmj (mgr.34412) 533 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:58:05.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:58:04 gibba045 bash[25517]: cephadm 2021-03-10T13:58:03.518451+0000 mgr.gibba045.orlgmj (mgr.34412) 534 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:58:05.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:58:04 gibba045 bash[25517]: cephadm 2021-03-10T13:58:03.519765+0000 mgr.gibba045.orlgmj (mgr.34412) 535 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:58:05.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:58:04 gibba045 bash[25517]: cephadm 2021-03-10T13:58:03.519803+0000 mgr.gibba045.orlgmj (mgr.34412) 536 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:58:05.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:58:04 gibba045 bash[25517]: cephadm 2021-03-10T13:58:03.521156+0000 mgr.gibba045.orlgmj (mgr.34412) 537 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:58:05.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:58:04 gibba045 bash[25517]: cephadm 2021-03-10T13:58:03.521194+0000 mgr.gibba045.orlgmj (mgr.34412) 538 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:58:05.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:58:04 gibba045 bash[25517]: cephadm 2021-03-10T13:58:03.522650+0000 mgr.gibba045.orlgmj (mgr.34412) 539 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:58:05.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:58:04 gibba045 bash[25517]: cephadm 2021-03-10T13:58:03.524337+0000 mgr.gibba045.orlgmj (mgr.34412) 540 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:58:05.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:58:04 gibba045 bash[25517]: cephadm 2021-03-10T13:58:03.524395+0000 mgr.gibba045.orlgmj (mgr.34412) 541 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:58:05.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:58:04 gibba045 bash[25517]: cephadm 2021-03-10T13:58:03.525801+0000 mgr.gibba045.orlgmj (mgr.34412) 542 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T13:58:05.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:58:04 gibba045 bash[25517]: cephadm 2021-03-10T13:58:03.526123+0000 mgr.gibba045.orlgmj (mgr.34412) 543 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T13:58:05.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:58:04 gibba045 bash[25517]: cephadm 2021-03-10T13:58:03.527286+0000 mgr.gibba045.orlgmj (mgr.34412) 544 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T13:58:05.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:58:04 gibba045 bash[25517]: cephadm 2021-03-10T13:58:03.527324+0000 mgr.gibba045.orlgmj (mgr.34412) 545 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T13:58:05.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:58:04 gibba045 bash[25517]: cephadm 2021-03-10T13:58:03.527428+0000 mgr.gibba045.orlgmj (mgr.34412) 546 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T13:58:05.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:58:04 gibba015 bash[29377]: cluster 2021-03-10T13:58:03.274081+0000 mgr.gibba045.orlgmj (mgr.34412) 530 : cluster [DBG] pgmap v290: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:05.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:58:04 gibba015 bash[29377]: cephadm 2021-03-10T13:58:03.316704+0000 mgr.gibba045.orlgmj (mgr.34412) 531 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T13:58:05.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:58:04 gibba015 bash[29377]: cephadm 2021-03-10T13:58:03.318481+0000 mgr.gibba045.orlgmj (mgr.34412) 532 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T13:58:05.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:58:04 gibba015 bash[29377]: cephadm 2021-03-10T13:58:03.516290+0000 mgr.gibba045.orlgmj (mgr.34412) 533 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:58:05.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:58:04 gibba015 bash[29377]: cephadm 2021-03-10T13:58:03.518451+0000 mgr.gibba045.orlgmj (mgr.34412) 534 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:58:05.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:58:04 gibba015 bash[29377]: cephadm 2021-03-10T13:58:03.519765+0000 mgr.gibba045.orlgmj (mgr.34412) 535 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:58:05.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:58:04 gibba015 bash[29377]: cephadm 2021-03-10T13:58:03.519803+0000 mgr.gibba045.orlgmj (mgr.34412) 536 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:58:05.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:58:04 gibba015 bash[29377]: cephadm 2021-03-10T13:58:03.521156+0000 mgr.gibba045.orlgmj (mgr.34412) 537 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:58:05.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:58:04 gibba015 bash[29377]: cephadm 2021-03-10T13:58:03.521194+0000 mgr.gibba045.orlgmj (mgr.34412) 538 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:58:05.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:58:04 gibba015 bash[29377]: cephadm 2021-03-10T13:58:03.522650+0000 mgr.gibba045.orlgmj (mgr.34412) 539 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:58:05.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:58:04 gibba015 bash[29377]: cephadm 2021-03-10T13:58:03.524337+0000 mgr.gibba045.orlgmj (mgr.34412) 540 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:58:05.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:58:04 gibba015 bash[29377]: cephadm 2021-03-10T13:58:03.524395+0000 mgr.gibba045.orlgmj (mgr.34412) 541 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:58:05.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:58:04 gibba015 bash[29377]: cephadm 2021-03-10T13:58:03.525801+0000 mgr.gibba045.orlgmj (mgr.34412) 542 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T13:58:05.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:58:04 gibba015 bash[29377]: cephadm 2021-03-10T13:58:03.526123+0000 mgr.gibba045.orlgmj (mgr.34412) 543 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T13:58:05.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:58:04 gibba015 bash[29377]: cephadm 2021-03-10T13:58:03.527286+0000 mgr.gibba045.orlgmj (mgr.34412) 544 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T13:58:05.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:58:04 gibba015 bash[29377]: cephadm 2021-03-10T13:58:03.527324+0000 mgr.gibba045.orlgmj (mgr.34412) 545 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T13:58:05.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:58:04 gibba015 bash[29377]: cephadm 2021-03-10T13:58:03.527428+0000 mgr.gibba045.orlgmj (mgr.34412) 546 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T13:58:05.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:58:04 gibba015 bash[30343]: cluster 2021-03-10T13:58:03.274081+0000 mgr.gibba045.orlgmj (mgr.34412) 530 : cluster [DBG] pgmap v290: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:05.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:58:04 gibba015 bash[30343]: cephadm 2021-03-10T13:58:03.316704+0000 mgr.gibba045.orlgmj (mgr.34412) 531 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T13:58:05.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:58:04 gibba015 bash[30343]: cephadm 2021-03-10T13:58:03.318481+0000 mgr.gibba045.orlgmj (mgr.34412) 532 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T13:58:05.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:58:04 gibba015 bash[30343]: cephadm 2021-03-10T13:58:03.516290+0000 mgr.gibba045.orlgmj (mgr.34412) 533 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:58:05.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:58:04 gibba015 bash[30343]: cephadm 2021-03-10T13:58:03.518451+0000 mgr.gibba045.orlgmj (mgr.34412) 534 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:58:05.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:58:04 gibba015 bash[30343]: cephadm 2021-03-10T13:58:03.519765+0000 mgr.gibba045.orlgmj (mgr.34412) 535 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:58:05.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:58:04 gibba015 bash[30343]: cephadm 2021-03-10T13:58:03.519803+0000 mgr.gibba045.orlgmj (mgr.34412) 536 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:58:05.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:58:04 gibba015 bash[30343]: cephadm 2021-03-10T13:58:03.521156+0000 mgr.gibba045.orlgmj (mgr.34412) 537 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:58:05.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:58:04 gibba015 bash[30343]: cephadm 2021-03-10T13:58:03.521194+0000 mgr.gibba045.orlgmj (mgr.34412) 538 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:58:05.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:58:04 gibba015 bash[30343]: cephadm 2021-03-10T13:58:03.522650+0000 mgr.gibba045.orlgmj (mgr.34412) 539 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:58:05.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:58:04 gibba015 bash[30343]: cephadm 2021-03-10T13:58:03.524337+0000 mgr.gibba045.orlgmj (mgr.34412) 540 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:58:05.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:58:04 gibba015 bash[30343]: cephadm 2021-03-10T13:58:03.524395+0000 mgr.gibba045.orlgmj (mgr.34412) 541 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:58:05.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:58:04 gibba015 bash[30343]: cephadm 2021-03-10T13:58:03.525801+0000 mgr.gibba045.orlgmj (mgr.34412) 542 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T13:58:05.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:58:04 gibba015 bash[30343]: cephadm 2021-03-10T13:58:03.526123+0000 mgr.gibba045.orlgmj (mgr.34412) 543 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T13:58:05.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:58:04 gibba015 bash[30343]: cephadm 2021-03-10T13:58:03.527286+0000 mgr.gibba045.orlgmj (mgr.34412) 544 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T13:58:05.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:58:04 gibba015 bash[30343]: cephadm 2021-03-10T13:58:03.527324+0000 mgr.gibba045.orlgmj (mgr.34412) 545 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T13:58:05.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:58:04 gibba015 bash[30343]: cephadm 2021-03-10T13:58:03.527428+0000 mgr.gibba045.orlgmj (mgr.34412) 546 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T13:58:07.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:58:06 gibba045 bash[25517]: cluster 2021-03-10T13:58:05.275788+0000 mgr.gibba045.orlgmj (mgr.34412) 547 : cluster [DBG] pgmap v291: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:07.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:58:06 gibba015 bash[29377]: cluster 2021-03-10T13:58:05.275788+0000 mgr.gibba045.orlgmj (mgr.34412) 547 : cluster [DBG] pgmap v291: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:07.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:58:06 gibba015 bash[30343]: cluster 2021-03-10T13:58:05.275788+0000 mgr.gibba045.orlgmj (mgr.34412) 547 : cluster [DBG] pgmap v291: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:09.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:58:08 gibba045 bash[25517]: cluster 2021-03-10T13:58:07.277603+0000 mgr.gibba045.orlgmj (mgr.34412) 548 : cluster [DBG] pgmap v292: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:09.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:58:08 gibba015 bash[29377]: cluster 2021-03-10T13:58:07.277603+0000 mgr.gibba045.orlgmj (mgr.34412) 548 : cluster [DBG] pgmap v292: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:09.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:58:08 gibba015 bash[30343]: cluster 2021-03-10T13:58:07.277603+0000 mgr.gibba045.orlgmj (mgr.34412) 548 : cluster [DBG] pgmap v292: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:11.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:58:10 gibba045 bash[25517]: cluster 2021-03-10T13:58:09.278804+0000 mgr.gibba045.orlgmj (mgr.34412) 549 : cluster [DBG] pgmap v293: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:11.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:58:10 gibba015 bash[29377]: cluster 2021-03-10T13:58:09.278804+0000 mgr.gibba045.orlgmj (mgr.34412) 549 : cluster [DBG] pgmap v293: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:11.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:58:10 gibba015 bash[30343]: cluster 2021-03-10T13:58:09.278804+0000 mgr.gibba045.orlgmj (mgr.34412) 549 : cluster [DBG] pgmap v293: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:13.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:58:12 gibba015 bash[29377]: cluster 2021-03-10T13:58:11.280524+0000 mgr.gibba045.orlgmj (mgr.34412) 550 : cluster [DBG] pgmap v294: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:13.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:58:12 gibba015 bash[30343]: cluster 2021-03-10T13:58:11.280524+0000 mgr.gibba045.orlgmj (mgr.34412) 550 : cluster [DBG] pgmap v294: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:13.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:58:12 gibba045 bash[25517]: cluster 2021-03-10T13:58:11.280524+0000 mgr.gibba045.orlgmj (mgr.34412) 550 : cluster [DBG] pgmap v294: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:15.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:58:14 gibba015 bash[29377]: cluster 2021-03-10T13:58:13.282149+0000 mgr.gibba045.orlgmj (mgr.34412) 551 : cluster [DBG] pgmap v295: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:15.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:58:14 gibba015 bash[30343]: cluster 2021-03-10T13:58:13.282149+0000 mgr.gibba045.orlgmj (mgr.34412) 551 : cluster [DBG] pgmap v295: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:15.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:58:14 gibba045 bash[25517]: cluster 2021-03-10T13:58:13.282149+0000 mgr.gibba045.orlgmj (mgr.34412) 551 : cluster [DBG] pgmap v295: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:17.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:58:16 gibba015 bash[29377]: cluster 2021-03-10T13:58:15.283792+0000 mgr.gibba045.orlgmj (mgr.34412) 552 : cluster [DBG] pgmap v296: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:17.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:58:16 gibba015 bash[30343]: cluster 2021-03-10T13:58:15.283792+0000 mgr.gibba045.orlgmj (mgr.34412) 552 : cluster [DBG] pgmap v296: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:17.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:58:16 gibba045 bash[25517]: cluster 2021-03-10T13:58:15.283792+0000 mgr.gibba045.orlgmj (mgr.34412) 552 : cluster [DBG] pgmap v296: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:19.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:58:18 gibba015 bash[29377]: cluster 2021-03-10T13:58:17.285396+0000 mgr.gibba045.orlgmj (mgr.34412) 553 : cluster [DBG] pgmap v297: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:19.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:58:18 gibba015 bash[30343]: cluster 2021-03-10T13:58:17.285396+0000 mgr.gibba045.orlgmj (mgr.34412) 553 : cluster [DBG] pgmap v297: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:19.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:58:18 gibba045 bash[25517]: cluster 2021-03-10T13:58:17.285396+0000 mgr.gibba045.orlgmj (mgr.34412) 553 : cluster [DBG] pgmap v297: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:20.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:58:19 gibba015 bash[29377]: cephadm 2021-03-10T13:58:18.543210+0000 mgr.gibba045.orlgmj (mgr.34412) 554 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T13:58:20.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:58:19 gibba015 bash[30343]: cephadm 2021-03-10T13:58:18.543210+0000 mgr.gibba045.orlgmj (mgr.34412) 554 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T13:58:20.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:58:19 gibba045 bash[25517]: cephadm 2021-03-10T13:58:18.543210+0000 mgr.gibba045.orlgmj (mgr.34412) 554 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T13:58:20.848 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T13:58:21.077 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T13:58:21.078 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (9m) 6m ago 14m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T13:58:21.078 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (14m) 4m ago 14m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T13:58:21.078 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (9m) 4m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T13:58:21.078 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (9m) 4m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T13:58:21.078 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (8m) 6m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T13:58:21.079 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (8m) 6m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T13:58:21.079 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (8m) 4m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T13:58:21.079 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (8m) 6m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T13:58:21.079 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (14m) 6m ago 14m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T13:58:21.080 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (14m) 4m ago 14m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T13:58:21.080 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (7m) 6m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T13:58:21.080 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (6m) 6m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T13:58:21.080 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (6m) 6m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T13:58:21.081 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (6m) 6m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T13:58:21.081 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (5m) 4m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T13:58:21.081 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (5m) 4m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T13:58:21.081 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (4m) 4m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T13:58:21.081 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (4m) 4m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T13:58:21.082 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (13m) 4m ago 14m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T13:58:21.082 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 4m ago 12m docker.io/ceph/ceph:v15.2.0 2021-03-10T13:58:21.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:58:20 gibba015 bash[29377]: cluster 2021-03-10T13:58:19.286623+0000 mgr.gibba045.orlgmj (mgr.34412) 555 : cluster [DBG] pgmap v298: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:21.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:58:20 gibba015 bash[30343]: cluster 2021-03-10T13:58:19.286623+0000 mgr.gibba045.orlgmj (mgr.34412) 555 : cluster [DBG] pgmap v298: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:21.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:58:20 gibba045 bash[25517]: cluster 2021-03-10T13:58:19.286623+0000 mgr.gibba045.orlgmj (mgr.34412) 555 : cluster [DBG] pgmap v298: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:21.327 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T13:58:21.327 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T13:58:21.328 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:58:21.328 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T13:58:21.328 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T13:58:21.328 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:58:21.328 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T13:58:21.329 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T13:58:21.329 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T13:58:21.329 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T13:58:21.329 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T13:58:21.329 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T13:58:21.330 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T13:58:21.330 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T13:58:21.330 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T13:58:22.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:58:21 gibba015 bash[29377]: audit 2021-03-10T13:58:20.838377+0000 mgr.gibba045.orlgmj (mgr.34412) 556 : audit [DBG] from='client.54418 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:58:22.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:58:21 gibba015 bash[29377]: audit 2021-03-10T13:58:21.325091+0000 mon.a (mon.0) 612 : audit [DBG] from='client.? 172.21.2.115:0/1039242253' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:58:22.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:58:21 gibba015 bash[30343]: audit 2021-03-10T13:58:20.838377+0000 mgr.gibba045.orlgmj (mgr.34412) 556 : audit [DBG] from='client.54418 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:58:22.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:58:21 gibba015 bash[30343]: audit 2021-03-10T13:58:21.325091+0000 mon.a (mon.0) 612 : audit [DBG] from='client.? 172.21.2.115:0/1039242253' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:58:22.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:58:21 gibba045 bash[25517]: audit 2021-03-10T13:58:20.838377+0000 mgr.gibba045.orlgmj (mgr.34412) 556 : audit [DBG] from='client.54418 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:58:22.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:58:21 gibba045 bash[25517]: audit 2021-03-10T13:58:21.325091+0000 mon.a (mon.0) 612 : audit [DBG] from='client.? 172.21.2.115:0/1039242253' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:58:23.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:58:22 gibba015 bash[29377]: audit 2021-03-10T13:58:21.064951+0000 mgr.gibba045.orlgmj (mgr.34412) 557 : audit [DBG] from='client.54424 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:58:23.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:58:22 gibba015 bash[29377]: cluster 2021-03-10T13:58:21.288090+0000 mgr.gibba045.orlgmj (mgr.34412) 558 : cluster [DBG] pgmap v299: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:23.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:58:22 gibba015 bash[30343]: audit 2021-03-10T13:58:21.064951+0000 mgr.gibba045.orlgmj (mgr.34412) 557 : audit [DBG] from='client.54424 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:58:23.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:58:22 gibba015 bash[30343]: cluster 2021-03-10T13:58:21.288090+0000 mgr.gibba045.orlgmj (mgr.34412) 558 : cluster [DBG] pgmap v299: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:23.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:58:22 gibba045 bash[25517]: audit 2021-03-10T13:58:21.064951+0000 mgr.gibba045.orlgmj (mgr.34412) 557 : audit [DBG] from='client.54424 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:58:23.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:58:22 gibba045 bash[25517]: cluster 2021-03-10T13:58:21.288090+0000 mgr.gibba045.orlgmj (mgr.34412) 558 : cluster [DBG] pgmap v299: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:25.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:58:24 gibba015 bash[29377]: cluster 2021-03-10T13:58:23.289464+0000 mgr.gibba045.orlgmj (mgr.34412) 559 : cluster [DBG] pgmap v300: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:25.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:58:24 gibba015 bash[30343]: cluster 2021-03-10T13:58:23.289464+0000 mgr.gibba045.orlgmj (mgr.34412) 559 : cluster [DBG] pgmap v300: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:25.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:58:24 gibba045 bash[25517]: cluster 2021-03-10T13:58:23.289464+0000 mgr.gibba045.orlgmj (mgr.34412) 559 : cluster [DBG] pgmap v300: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:27.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:58:26 gibba015 bash[29377]: cluster 2021-03-10T13:58:25.291118+0000 mgr.gibba045.orlgmj (mgr.34412) 560 : cluster [DBG] pgmap v301: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:27.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:58:26 gibba015 bash[30343]: cluster 2021-03-10T13:58:25.291118+0000 mgr.gibba045.orlgmj (mgr.34412) 560 : cluster [DBG] pgmap v301: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:27.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:58:26 gibba045 bash[25517]: cluster 2021-03-10T13:58:25.291118+0000 mgr.gibba045.orlgmj (mgr.34412) 560 : cluster [DBG] pgmap v301: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:29.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:58:28 gibba015 bash[29377]: cluster 2021-03-10T13:58:27.292838+0000 mgr.gibba045.orlgmj (mgr.34412) 561 : cluster [DBG] pgmap v302: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:29.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:58:28 gibba015 bash[30343]: cluster 2021-03-10T13:58:27.292838+0000 mgr.gibba045.orlgmj (mgr.34412) 561 : cluster [DBG] pgmap v302: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:29.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:58:28 gibba045 bash[25517]: cluster 2021-03-10T13:58:27.292838+0000 mgr.gibba045.orlgmj (mgr.34412) 561 : cluster [DBG] pgmap v302: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:31.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:58:30 gibba015 bash[29377]: cluster 2021-03-10T13:58:29.294000+0000 mgr.gibba045.orlgmj (mgr.34412) 562 : cluster [DBG] pgmap v303: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:31.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:58:30 gibba015 bash[30343]: cluster 2021-03-10T13:58:29.294000+0000 mgr.gibba045.orlgmj (mgr.34412) 562 : cluster [DBG] pgmap v303: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:31.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:58:30 gibba045 bash[25517]: cluster 2021-03-10T13:58:29.294000+0000 mgr.gibba045.orlgmj (mgr.34412) 562 : cluster [DBG] pgmap v303: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:33.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:58:32 gibba015 bash[29377]: cluster 2021-03-10T13:58:31.295470+0000 mgr.gibba045.orlgmj (mgr.34412) 563 : cluster [DBG] pgmap v304: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:33.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:58:32 gibba015 bash[30343]: cluster 2021-03-10T13:58:31.295470+0000 mgr.gibba045.orlgmj (mgr.34412) 563 : cluster [DBG] pgmap v304: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:33.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:58:32 gibba045 bash[25517]: cluster 2021-03-10T13:58:31.295470+0000 mgr.gibba045.orlgmj (mgr.34412) 563 : cluster [DBG] pgmap v304: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:35.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:58:34 gibba015 bash[29377]: cluster 2021-03-10T13:58:33.297189+0000 mgr.gibba045.orlgmj (mgr.34412) 564 : cluster [DBG] pgmap v305: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:35.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:58:34 gibba015 bash[29377]: cephadm 2021-03-10T13:58:33.553381+0000 mgr.gibba045.orlgmj (mgr.34412) 565 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T13:58:35.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:58:34 gibba015 bash[30343]: cluster 2021-03-10T13:58:33.297189+0000 mgr.gibba045.orlgmj (mgr.34412) 564 : cluster [DBG] pgmap v305: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:35.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:58:34 gibba015 bash[30343]: cephadm 2021-03-10T13:58:33.553381+0000 mgr.gibba045.orlgmj (mgr.34412) 565 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T13:58:35.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:58:34 gibba045 bash[25517]: cluster 2021-03-10T13:58:33.297189+0000 mgr.gibba045.orlgmj (mgr.34412) 564 : cluster [DBG] pgmap v305: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:35.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:58:34 gibba045 bash[25517]: cephadm 2021-03-10T13:58:33.553381+0000 mgr.gibba045.orlgmj (mgr.34412) 565 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T13:58:37.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:58:36 gibba015 bash[29377]: cluster 2021-03-10T13:58:35.298878+0000 mgr.gibba045.orlgmj (mgr.34412) 566 : cluster [DBG] pgmap v306: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:37.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:58:36 gibba015 bash[30343]: cluster 2021-03-10T13:58:35.298878+0000 mgr.gibba045.orlgmj (mgr.34412) 566 : cluster [DBG] pgmap v306: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:37.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:58:36 gibba045 bash[25517]: cluster 2021-03-10T13:58:35.298878+0000 mgr.gibba045.orlgmj (mgr.34412) 566 : cluster [DBG] pgmap v306: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:39.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:58:38 gibba015 bash[29377]: cluster 2021-03-10T13:58:37.300702+0000 mgr.gibba045.orlgmj (mgr.34412) 567 : cluster [DBG] pgmap v307: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:39.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:58:38 gibba015 bash[30343]: cluster 2021-03-10T13:58:37.300702+0000 mgr.gibba045.orlgmj (mgr.34412) 567 : cluster [DBG] pgmap v307: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:39.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:58:38 gibba045 bash[25517]: cluster 2021-03-10T13:58:37.300702+0000 mgr.gibba045.orlgmj (mgr.34412) 567 : cluster [DBG] pgmap v307: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:41.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:58:40 gibba015 bash[29377]: cluster 2021-03-10T13:58:39.301989+0000 mgr.gibba045.orlgmj (mgr.34412) 568 : cluster [DBG] pgmap v308: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:41.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:58:40 gibba015 bash[30343]: cluster 2021-03-10T13:58:39.301989+0000 mgr.gibba045.orlgmj (mgr.34412) 568 : cluster [DBG] pgmap v308: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:41.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:58:40 gibba045 bash[25517]: cluster 2021-03-10T13:58:39.301989+0000 mgr.gibba045.orlgmj (mgr.34412) 568 : cluster [DBG] pgmap v308: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:43.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:58:42 gibba015 bash[29377]: cluster 2021-03-10T13:58:41.303606+0000 mgr.gibba045.orlgmj (mgr.34412) 569 : cluster [DBG] pgmap v309: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:43.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:58:42 gibba015 bash[30343]: cluster 2021-03-10T13:58:41.303606+0000 mgr.gibba045.orlgmj (mgr.34412) 569 : cluster [DBG] pgmap v309: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:43.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:58:42 gibba045 bash[25517]: cluster 2021-03-10T13:58:41.303606+0000 mgr.gibba045.orlgmj (mgr.34412) 569 : cluster [DBG] pgmap v309: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:45.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:58:44 gibba015 bash[29377]: cluster 2021-03-10T13:58:43.305243+0000 mgr.gibba045.orlgmj (mgr.34412) 570 : cluster [DBG] pgmap v310: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:45.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:58:44 gibba015 bash[30343]: cluster 2021-03-10T13:58:43.305243+0000 mgr.gibba045.orlgmj (mgr.34412) 570 : cluster [DBG] pgmap v310: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:45.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:58:44 gibba045 bash[25517]: cluster 2021-03-10T13:58:43.305243+0000 mgr.gibba045.orlgmj (mgr.34412) 570 : cluster [DBG] pgmap v310: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:47.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:58:46 gibba015 bash[29377]: cluster 2021-03-10T13:58:45.306789+0000 mgr.gibba045.orlgmj (mgr.34412) 571 : cluster [DBG] pgmap v311: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:47.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:58:46 gibba015 bash[30343]: cluster 2021-03-10T13:58:45.306789+0000 mgr.gibba045.orlgmj (mgr.34412) 571 : cluster [DBG] pgmap v311: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:47.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:58:46 gibba045 bash[25517]: cluster 2021-03-10T13:58:45.306789+0000 mgr.gibba045.orlgmj (mgr.34412) 571 : cluster [DBG] pgmap v311: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:49.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:58:48 gibba045 bash[25517]: cluster 2021-03-10T13:58:47.308281+0000 mgr.gibba045.orlgmj (mgr.34412) 572 : cluster [DBG] pgmap v312: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:49.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:58:48 gibba015 bash[29377]: cluster 2021-03-10T13:58:47.308281+0000 mgr.gibba045.orlgmj (mgr.34412) 572 : cluster [DBG] pgmap v312: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:49.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:58:48 gibba015 bash[30343]: cluster 2021-03-10T13:58:47.308281+0000 mgr.gibba045.orlgmj (mgr.34412) 572 : cluster [DBG] pgmap v312: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:50.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:58:49 gibba045 bash[25517]: cephadm 2021-03-10T13:58:48.561085+0000 mgr.gibba045.orlgmj (mgr.34412) 573 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T13:58:50.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:58:49 gibba015 bash[29377]: cephadm 2021-03-10T13:58:48.561085+0000 mgr.gibba045.orlgmj (mgr.34412) 573 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T13:58:50.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:58:49 gibba015 bash[30343]: cephadm 2021-03-10T13:58:48.561085+0000 mgr.gibba045.orlgmj (mgr.34412) 573 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T13:58:51.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:58:50 gibba045 bash[25517]: cluster 2021-03-10T13:58:49.309506+0000 mgr.gibba045.orlgmj (mgr.34412) 574 : cluster [DBG] pgmap v313: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:51.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:58:50 gibba015 bash[29377]: cluster 2021-03-10T13:58:49.309506+0000 mgr.gibba045.orlgmj (mgr.34412) 574 : cluster [DBG] pgmap v313: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:51.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:58:50 gibba015 bash[30343]: cluster 2021-03-10T13:58:49.309506+0000 mgr.gibba045.orlgmj (mgr.34412) 574 : cluster [DBG] pgmap v313: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:51.568 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T13:58:51.818 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T13:58:51.818 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (9m) 6m ago 14m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T13:58:51.818 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (14m) 4m ago 14m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T13:58:51.819 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (10m) 4m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T13:58:51.819 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (10m) 4m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T13:58:51.819 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (9m) 6m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T13:58:51.819 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (9m) 6m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T13:58:51.820 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (8m) 4m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T13:58:51.820 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (8m) 6m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T13:58:51.820 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (15m) 6m ago 15m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T13:58:51.820 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (15m) 4m ago 15m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T13:58:51.821 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (7m) 6m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T13:58:51.821 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (7m) 6m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T13:58:51.821 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (7m) 6m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T13:58:51.821 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (6m) 6m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T13:58:51.822 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (6m) 4m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T13:58:51.822 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (5m) 4m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T13:58:51.822 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (5m) 4m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T13:58:51.822 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (4m) 4m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T13:58:51.823 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (14m) 4m ago 15m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T13:58:51.823 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 4m ago 13m docker.io/ceph/ceph:v15.2.0 2021-03-10T13:58:52.066 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T13:58:52.067 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T13:58:52.067 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:58:52.067 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T13:58:52.067 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T13:58:52.067 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:58:52.068 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T13:58:52.068 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T13:58:52.068 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T13:58:52.068 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T13:58:52.069 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T13:58:52.069 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T13:58:52.069 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T13:58:52.069 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T13:58:52.070 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T13:58:52.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:58:52 gibba015 bash[29377]: cluster 2021-03-10T13:58:51.310949+0000 mgr.gibba045.orlgmj (mgr.34412) 575 : cluster [DBG] pgmap v314: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:52.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:58:52 gibba015 bash[29377]: audit 2021-03-10T13:58:51.560616+0000 mgr.gibba045.orlgmj (mgr.34412) 576 : audit [DBG] from='client.44448 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:58:52.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:58:52 gibba015 bash[29377]: audit 2021-03-10T13:58:51.786552+0000 mgr.gibba045.orlgmj (mgr.34412) 577 : audit [DBG] from='client.54442 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:58:52.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:58:52 gibba015 bash[29377]: audit 2021-03-10T13:58:52.063891+0000 mon.c (mon.1) 223 : audit [DBG] from='client.? 172.21.2.115:0/628571094' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:58:52.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:58:52 gibba015 bash[29377]: audit 2021-03-10T13:58:52.422696+0000 mon.c (mon.1) 224 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T13:58:52.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:58:52 gibba015 bash[29377]: audit 2021-03-10T13:58:52.423432+0000 mon.c (mon.1) 225 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T13:58:52.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:58:52 gibba015 bash[29377]: audit 2021-03-10T13:58:52.424104+0000 mon.a (mon.0) 613 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T13:58:52.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:58:52 gibba015 bash[29377]: audit 2021-03-10T13:58:52.424539+0000 mon.c (mon.1) 226 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T13:58:52.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:58:52 gibba015 bash[29377]: audit 2021-03-10T13:58:52.426005+0000 mon.c (mon.1) 227 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T13:58:52.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:58:52 gibba015 bash[29377]: audit 2021-03-10T13:58:52.426303+0000 mon.a (mon.0) 614 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T13:58:52.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:58:52 gibba015 bash[29377]: audit 2021-03-10T13:58:52.427520+0000 mon.a (mon.0) 615 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T13:58:52.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:58:52 gibba015 bash[29377]: audit 2021-03-10T13:58:52.427731+0000 mon.a (mon.0) 616 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T13:58:52.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:58:52 gibba015 bash[29377]: audit 2021-03-10T13:58:52.518894+0000 mon.c (mon.1) 228 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:58:52.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:58:52 gibba015 bash[29377]: audit 2021-03-10T13:58:52.519617+0000 mon.c (mon.1) 229 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T13:58:52.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:58:52 gibba015 bash[29377]: audit 2021-03-10T13:58:52.520173+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:58:52.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:58:52 gibba015 bash[29377]: audit 2021-03-10T13:58:52.521548+0000 mon.a (mon.0) 618 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T13:58:52.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:58:52 gibba015 bash[30343]: cluster 2021-03-10T13:58:51.310949+0000 mgr.gibba045.orlgmj (mgr.34412) 575 : cluster [DBG] pgmap v314: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:52.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:58:52 gibba015 bash[30343]: audit 2021-03-10T13:58:51.560616+0000 mgr.gibba045.orlgmj (mgr.34412) 576 : audit [DBG] from='client.44448 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:58:52.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:58:52 gibba015 bash[30343]: audit 2021-03-10T13:58:51.786552+0000 mgr.gibba045.orlgmj (mgr.34412) 577 : audit [DBG] from='client.54442 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:58:52.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:58:52 gibba015 bash[30343]: audit 2021-03-10T13:58:52.063891+0000 mon.c (mon.1) 223 : audit [DBG] from='client.? 172.21.2.115:0/628571094' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:58:52.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:58:52 gibba015 bash[30343]: audit 2021-03-10T13:58:52.422696+0000 mon.c (mon.1) 224 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T13:58:52.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:58:52 gibba015 bash[30343]: audit 2021-03-10T13:58:52.423432+0000 mon.c (mon.1) 225 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T13:58:52.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:58:52 gibba015 bash[30343]: audit 2021-03-10T13:58:52.424104+0000 mon.a (mon.0) 613 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T13:58:52.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:58:52 gibba015 bash[30343]: audit 2021-03-10T13:58:52.424539+0000 mon.c (mon.1) 226 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T13:58:52.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:58:52 gibba015 bash[30343]: audit 2021-03-10T13:58:52.426005+0000 mon.c (mon.1) 227 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T13:58:52.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:58:52 gibba015 bash[30343]: audit 2021-03-10T13:58:52.426303+0000 mon.a (mon.0) 614 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T13:58:52.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:58:52 gibba015 bash[30343]: audit 2021-03-10T13:58:52.427520+0000 mon.a (mon.0) 615 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T13:58:52.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:58:52 gibba015 bash[30343]: audit 2021-03-10T13:58:52.427731+0000 mon.a (mon.0) 616 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T13:58:52.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:58:52 gibba015 bash[30343]: audit 2021-03-10T13:58:52.518894+0000 mon.c (mon.1) 228 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:58:52.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:58:52 gibba015 bash[30343]: audit 2021-03-10T13:58:52.519617+0000 mon.c (mon.1) 229 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T13:58:52.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:58:52 gibba015 bash[30343]: audit 2021-03-10T13:58:52.520173+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:58:52.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:58:52 gibba015 bash[30343]: audit 2021-03-10T13:58:52.521548+0000 mon.a (mon.0) 618 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T13:58:53.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:58:52 gibba045 bash[25517]: cluster 2021-03-10T13:58:51.310949+0000 mgr.gibba045.orlgmj (mgr.34412) 575 : cluster [DBG] pgmap v314: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:53.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:58:52 gibba045 bash[25517]: audit 2021-03-10T13:58:51.560616+0000 mgr.gibba045.orlgmj (mgr.34412) 576 : audit [DBG] from='client.44448 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:58:53.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:58:52 gibba045 bash[25517]: audit 2021-03-10T13:58:51.786552+0000 mgr.gibba045.orlgmj (mgr.34412) 577 : audit [DBG] from='client.54442 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:58:53.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:58:52 gibba045 bash[25517]: audit 2021-03-10T13:58:52.063891+0000 mon.c (mon.1) 223 : audit [DBG] from='client.? 172.21.2.115:0/628571094' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:58:53.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:58:52 gibba045 bash[25517]: audit 2021-03-10T13:58:52.422696+0000 mon.c (mon.1) 224 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T13:58:53.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:58:52 gibba045 bash[25517]: audit 2021-03-10T13:58:52.423432+0000 mon.c (mon.1) 225 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T13:58:53.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:58:52 gibba045 bash[25517]: audit 2021-03-10T13:58:52.424104+0000 mon.a (mon.0) 613 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T13:58:53.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:58:52 gibba045 bash[25517]: audit 2021-03-10T13:58:52.424539+0000 mon.c (mon.1) 226 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T13:58:53.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:58:52 gibba045 bash[25517]: audit 2021-03-10T13:58:52.426005+0000 mon.c (mon.1) 227 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T13:58:53.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:58:52 gibba045 bash[25517]: audit 2021-03-10T13:58:52.426303+0000 mon.a (mon.0) 614 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T13:58:53.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:58:52 gibba045 bash[25517]: audit 2021-03-10T13:58:52.427520+0000 mon.a (mon.0) 615 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T13:58:53.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:58:52 gibba045 bash[25517]: audit 2021-03-10T13:58:52.427731+0000 mon.a (mon.0) 616 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T13:58:53.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:58:52 gibba045 bash[25517]: audit 2021-03-10T13:58:52.518894+0000 mon.c (mon.1) 228 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:58:53.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:58:52 gibba045 bash[25517]: audit 2021-03-10T13:58:52.519617+0000 mon.c (mon.1) 229 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T13:58:53.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:58:52 gibba045 bash[25517]: audit 2021-03-10T13:58:52.520173+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:58:53.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:58:52 gibba045 bash[25517]: audit 2021-03-10T13:58:52.521548+0000 mon.a (mon.0) 618 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T13:58:54.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:58:54 gibba015 bash[29377]: cluster 2021-03-10T13:58:53.312606+0000 mgr.gibba045.orlgmj (mgr.34412) 578 : cluster [DBG] pgmap v315: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:54.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:58:54 gibba015 bash[30343]: cluster 2021-03-10T13:58:53.312606+0000 mgr.gibba045.orlgmj (mgr.34412) 578 : cluster [DBG] pgmap v315: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:55.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:58:54 gibba045 bash[25517]: cluster 2021-03-10T13:58:53.312606+0000 mgr.gibba045.orlgmj (mgr.34412) 578 : cluster [DBG] pgmap v315: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:56.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:58:56 gibba015 bash[29377]: cluster 2021-03-10T13:58:55.313947+0000 mgr.gibba045.orlgmj (mgr.34412) 579 : cluster [DBG] pgmap v316: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:56.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:58:56 gibba015 bash[30343]: cluster 2021-03-10T13:58:55.313947+0000 mgr.gibba045.orlgmj (mgr.34412) 579 : cluster [DBG] pgmap v316: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:57.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:58:56 gibba045 bash[25517]: cluster 2021-03-10T13:58:55.313947+0000 mgr.gibba045.orlgmj (mgr.34412) 579 : cluster [DBG] pgmap v316: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:58.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:58:58 gibba015 bash[29377]: cluster 2021-03-10T13:58:57.315655+0000 mgr.gibba045.orlgmj (mgr.34412) 580 : cluster [DBG] pgmap v317: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:58.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:58:58 gibba015 bash[30343]: cluster 2021-03-10T13:58:57.315655+0000 mgr.gibba045.orlgmj (mgr.34412) 580 : cluster [DBG] pgmap v317: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:59.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:58:58 gibba045 bash[25517]: cluster 2021-03-10T13:58:57.315655+0000 mgr.gibba045.orlgmj (mgr.34412) 580 : cluster [DBG] pgmap v317: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:00.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:59:00 gibba015 bash[29377]: cluster 2021-03-10T13:58:59.316996+0000 mgr.gibba045.orlgmj (mgr.34412) 581 : cluster [DBG] pgmap v318: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:00.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:59:00 gibba015 bash[30343]: cluster 2021-03-10T13:58:59.316996+0000 mgr.gibba045.orlgmj (mgr.34412) 581 : cluster [DBG] pgmap v318: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:01.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:59:00 gibba045 bash[25517]: cluster 2021-03-10T13:58:59.316996+0000 mgr.gibba045.orlgmj (mgr.34412) 581 : cluster [DBG] pgmap v318: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:02.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:59:02 gibba015 bash[29377]: cluster 2021-03-10T13:59:01.318443+0000 mgr.gibba045.orlgmj (mgr.34412) 582 : cluster [DBG] pgmap v319: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:02.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:59:02 gibba015 bash[30343]: cluster 2021-03-10T13:59:01.318443+0000 mgr.gibba045.orlgmj (mgr.34412) 582 : cluster [DBG] pgmap v319: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:03.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:59:02 gibba045 bash[25517]: cluster 2021-03-10T13:59:01.318443+0000 mgr.gibba045.orlgmj (mgr.34412) 582 : cluster [DBG] pgmap v319: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:03.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:59:03 gibba015 bash[29377]: audit 2021-03-10T13:59:03.571376+0000 mon.c (mon.1) 230 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:59:03.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:59:03 gibba015 bash[30343]: audit 2021-03-10T13:59:03.571376+0000 mon.c (mon.1) 230 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:59:04.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:59:03 gibba045 bash[25517]: audit 2021-03-10T13:59:03.571376+0000 mon.c (mon.1) 230 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:59:05.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:59:04 gibba045 bash[25517]: cluster 2021-03-10T13:59:03.320122+0000 mgr.gibba045.orlgmj (mgr.34412) 583 : cluster [DBG] pgmap v320: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:05.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:59:04 gibba045 bash[25517]: cephadm 2021-03-10T13:59:03.579623+0000 mgr.gibba045.orlgmj (mgr.34412) 584 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T13:59:05.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:59:04 gibba045 bash[25517]: cephadm 2021-03-10T13:59:03.581592+0000 mgr.gibba045.orlgmj (mgr.34412) 585 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T13:59:05.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:59:04 gibba045 bash[25517]: audit 2021-03-10T13:59:03.789275+0000 mon.a (mon.0) 619 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:59:05.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:59:04 gibba045 bash[25517]: audit 2021-03-10T13:59:03.793061+0000 mon.c (mon.1) 231 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:59:05.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:59:04 gibba045 bash[25517]: audit 2021-03-10T13:59:03.794397+0000 mon.c (mon.1) 232 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:59:05.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:59:04 gibba045 bash[25517]: cephadm 2021-03-10T13:59:03.795301+0000 mgr.gibba045.orlgmj (mgr.34412) 586 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:59:05.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:59:04 gibba045 bash[25517]: audit 2021-03-10T13:59:03.795896+0000 mon.c (mon.1) 233 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:59:05.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:59:04 gibba045 bash[25517]: cephadm 2021-03-10T13:59:03.796774+0000 mgr.gibba045.orlgmj (mgr.34412) 587 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:59:05.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:59:04 gibba045 bash[25517]: audit 2021-03-10T13:59:03.796985+0000 mon.c (mon.1) 234 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:59:05.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:59:04 gibba045 bash[25517]: cephadm 2021-03-10T13:59:03.798255+0000 mgr.gibba045.orlgmj (mgr.34412) 588 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:59:05.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:59:04 gibba045 bash[25517]: cephadm 2021-03-10T13:59:03.798307+0000 mgr.gibba045.orlgmj (mgr.34412) 589 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:59:05.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:59:04 gibba045 bash[25517]: cephadm 2021-03-10T13:59:03.799628+0000 mgr.gibba045.orlgmj (mgr.34412) 590 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:59:05.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:59:04 gibba045 bash[25517]: cephadm 2021-03-10T13:59:03.799664+0000 mgr.gibba045.orlgmj (mgr.34412) 591 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:59:05.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:59:04 gibba045 bash[25517]: audit 2021-03-10T13:59:03.799679+0000 mon.c (mon.1) 235 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:59:05.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:59:04 gibba045 bash[25517]: cephadm 2021-03-10T13:59:03.800580+0000 mgr.gibba045.orlgmj (mgr.34412) 592 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:59:05.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:59:04 gibba045 bash[25517]: audit 2021-03-10T13:59:03.800956+0000 mon.c (mon.1) 236 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:59:05.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:59:04 gibba045 bash[25517]: cephadm 2021-03-10T13:59:03.802159+0000 mgr.gibba045.orlgmj (mgr.34412) 593 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:59:05.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:59:04 gibba045 bash[25517]: cephadm 2021-03-10T13:59:03.802195+0000 mgr.gibba045.orlgmj (mgr.34412) 594 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:59:05.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:59:04 gibba045 bash[25517]: cephadm 2021-03-10T13:59:03.803288+0000 mgr.gibba045.orlgmj (mgr.34412) 595 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T13:59:05.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:59:04 gibba045 bash[25517]: cephadm 2021-03-10T13:59:03.803619+0000 mgr.gibba045.orlgmj (mgr.34412) 596 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T13:59:05.062 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:59:04 gibba045 bash[25517]: cephadm 2021-03-10T13:59:03.804502+0000 mgr.gibba045.orlgmj (mgr.34412) 597 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T13:59:05.062 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:59:04 gibba045 bash[25517]: cephadm 2021-03-10T13:59:03.804547+0000 mgr.gibba045.orlgmj (mgr.34412) 598 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T13:59:05.062 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:59:04 gibba045 bash[25517]: cephadm 2021-03-10T13:59:03.804724+0000 mgr.gibba045.orlgmj (mgr.34412) 599 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T13:59:05.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:59:04 gibba015 bash[29377]: cluster 2021-03-10T13:59:03.320122+0000 mgr.gibba045.orlgmj (mgr.34412) 583 : cluster [DBG] pgmap v320: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:05.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:59:04 gibba015 bash[29377]: cephadm 2021-03-10T13:59:03.579623+0000 mgr.gibba045.orlgmj (mgr.34412) 584 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T13:59:05.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:59:04 gibba015 bash[29377]: cephadm 2021-03-10T13:59:03.581592+0000 mgr.gibba045.orlgmj (mgr.34412) 585 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T13:59:05.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:59:04 gibba015 bash[29377]: audit 2021-03-10T13:59:03.789275+0000 mon.a (mon.0) 619 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:59:05.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:59:04 gibba015 bash[29377]: audit 2021-03-10T13:59:03.793061+0000 mon.c (mon.1) 231 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:59:05.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:59:04 gibba015 bash[29377]: audit 2021-03-10T13:59:03.794397+0000 mon.c (mon.1) 232 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:59:05.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:59:04 gibba015 bash[29377]: cephadm 2021-03-10T13:59:03.795301+0000 mgr.gibba045.orlgmj (mgr.34412) 586 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:59:05.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:59:04 gibba015 bash[29377]: audit 2021-03-10T13:59:03.795896+0000 mon.c (mon.1) 233 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:59:05.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:59:04 gibba015 bash[29377]: cephadm 2021-03-10T13:59:03.796774+0000 mgr.gibba045.orlgmj (mgr.34412) 587 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:59:05.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:59:04 gibba015 bash[29377]: audit 2021-03-10T13:59:03.796985+0000 mon.c (mon.1) 234 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:59:05.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:59:04 gibba015 bash[29377]: cephadm 2021-03-10T13:59:03.798255+0000 mgr.gibba045.orlgmj (mgr.34412) 588 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:59:05.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:59:04 gibba015 bash[29377]: cephadm 2021-03-10T13:59:03.798307+0000 mgr.gibba045.orlgmj (mgr.34412) 589 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:59:05.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:59:04 gibba015 bash[29377]: cephadm 2021-03-10T13:59:03.799628+0000 mgr.gibba045.orlgmj (mgr.34412) 590 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:59:05.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:59:04 gibba015 bash[29377]: cephadm 2021-03-10T13:59:03.799664+0000 mgr.gibba045.orlgmj (mgr.34412) 591 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:59:05.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:59:04 gibba015 bash[29377]: audit 2021-03-10T13:59:03.799679+0000 mon.c (mon.1) 235 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:59:05.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:59:04 gibba015 bash[29377]: cephadm 2021-03-10T13:59:03.800580+0000 mgr.gibba045.orlgmj (mgr.34412) 592 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:59:05.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:59:04 gibba015 bash[29377]: audit 2021-03-10T13:59:03.800956+0000 mon.c (mon.1) 236 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:59:05.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:59:04 gibba015 bash[29377]: cephadm 2021-03-10T13:59:03.802159+0000 mgr.gibba045.orlgmj (mgr.34412) 593 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:59:05.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:59:04 gibba015 bash[29377]: cephadm 2021-03-10T13:59:03.802195+0000 mgr.gibba045.orlgmj (mgr.34412) 594 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:59:05.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:59:04 gibba015 bash[29377]: cephadm 2021-03-10T13:59:03.803288+0000 mgr.gibba045.orlgmj (mgr.34412) 595 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T13:59:05.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:59:04 gibba015 bash[29377]: cephadm 2021-03-10T13:59:03.803619+0000 mgr.gibba045.orlgmj (mgr.34412) 596 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T13:59:05.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:59:04 gibba015 bash[30343]: cluster 2021-03-10T13:59:03.320122+0000 mgr.gibba045.orlgmj (mgr.34412) 583 : cluster [DBG] pgmap v320: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:05.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:59:04 gibba015 bash[30343]: cephadm 2021-03-10T13:59:03.579623+0000 mgr.gibba045.orlgmj (mgr.34412) 584 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T13:59:05.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:59:04 gibba015 bash[30343]: cephadm 2021-03-10T13:59:03.581592+0000 mgr.gibba045.orlgmj (mgr.34412) 585 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T13:59:05.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:59:04 gibba015 bash[30343]: audit 2021-03-10T13:59:03.789275+0000 mon.a (mon.0) 619 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T13:59:05.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:59:04 gibba015 bash[30343]: audit 2021-03-10T13:59:03.793061+0000 mon.c (mon.1) 231 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:59:05.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:59:04 gibba015 bash[30343]: audit 2021-03-10T13:59:03.794397+0000 mon.c (mon.1) 232 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:59:05.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:59:04 gibba015 bash[30343]: cephadm 2021-03-10T13:59:03.795301+0000 mgr.gibba045.orlgmj (mgr.34412) 586 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:59:05.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:59:04 gibba015 bash[30343]: audit 2021-03-10T13:59:03.795896+0000 mon.c (mon.1) 233 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:59:05.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:59:04 gibba015 bash[30343]: cephadm 2021-03-10T13:59:03.796774+0000 mgr.gibba045.orlgmj (mgr.34412) 587 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:59:05.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:59:04 gibba015 bash[30343]: audit 2021-03-10T13:59:03.796985+0000 mon.c (mon.1) 234 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:59:05.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:59:04 gibba015 bash[30343]: cephadm 2021-03-10T13:59:03.798255+0000 mgr.gibba045.orlgmj (mgr.34412) 588 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:59:05.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:59:04 gibba015 bash[30343]: cephadm 2021-03-10T13:59:03.798307+0000 mgr.gibba045.orlgmj (mgr.34412) 589 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:59:05.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:59:04 gibba015 bash[30343]: cephadm 2021-03-10T13:59:03.799628+0000 mgr.gibba045.orlgmj (mgr.34412) 590 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:59:05.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:59:04 gibba015 bash[30343]: cephadm 2021-03-10T13:59:03.799664+0000 mgr.gibba045.orlgmj (mgr.34412) 591 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:59:05.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:59:04 gibba015 bash[30343]: audit 2021-03-10T13:59:03.799679+0000 mon.c (mon.1) 235 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:59:05.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:59:04 gibba015 bash[30343]: cephadm 2021-03-10T13:59:03.800580+0000 mgr.gibba045.orlgmj (mgr.34412) 592 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:59:05.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:59:04 gibba015 bash[30343]: audit 2021-03-10T13:59:03.800956+0000 mon.c (mon.1) 236 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:59:05.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:59:04 gibba015 bash[30343]: cephadm 2021-03-10T13:59:03.802159+0000 mgr.gibba045.orlgmj (mgr.34412) 593 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:59:05.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:59:04 gibba015 bash[30343]: cephadm 2021-03-10T13:59:03.802195+0000 mgr.gibba045.orlgmj (mgr.34412) 594 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:59:05.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:59:04 gibba015 bash[30343]: cephadm 2021-03-10T13:59:03.803288+0000 mgr.gibba045.orlgmj (mgr.34412) 595 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T13:59:05.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:59:04 gibba015 bash[30343]: cephadm 2021-03-10T13:59:03.803619+0000 mgr.gibba045.orlgmj (mgr.34412) 596 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T13:59:05.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:59:04 gibba015 bash[30343]: cephadm 2021-03-10T13:59:03.804502+0000 mgr.gibba045.orlgmj (mgr.34412) 597 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T13:59:05.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:59:04 gibba015 bash[30343]: cephadm 2021-03-10T13:59:03.804547+0000 mgr.gibba045.orlgmj (mgr.34412) 598 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T13:59:05.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:59:04 gibba015 bash[30343]: cephadm 2021-03-10T13:59:03.804724+0000 mgr.gibba045.orlgmj (mgr.34412) 599 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T13:59:05.233 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:59:04 gibba015 bash[29377]: cephadm 2021-03-10T13:59:03.804502+0000 mgr.gibba045.orlgmj (mgr.34412) 597 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T13:59:05.233 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:59:04 gibba015 bash[29377]: cephadm 2021-03-10T13:59:03.804547+0000 mgr.gibba045.orlgmj (mgr.34412) 598 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T13:59:05.234 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:59:04 gibba015 bash[29377]: cephadm 2021-03-10T13:59:03.804724+0000 mgr.gibba045.orlgmj (mgr.34412) 599 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T13:59:07.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:59:06 gibba015 bash[29377]: cluster 2021-03-10T13:59:05.321802+0000 mgr.gibba045.orlgmj (mgr.34412) 600 : cluster [DBG] pgmap v321: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:07.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:59:06 gibba015 bash[30343]: cluster 2021-03-10T13:59:05.321802+0000 mgr.gibba045.orlgmj (mgr.34412) 600 : cluster [DBG] pgmap v321: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:07.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:59:06 gibba045 bash[25517]: cluster 2021-03-10T13:59:05.321802+0000 mgr.gibba045.orlgmj (mgr.34412) 600 : cluster [DBG] pgmap v321: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:09.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:59:08 gibba015 bash[29377]: cluster 2021-03-10T13:59:07.323403+0000 mgr.gibba045.orlgmj (mgr.34412) 601 : cluster [DBG] pgmap v322: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:09.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:59:08 gibba015 bash[30343]: cluster 2021-03-10T13:59:07.323403+0000 mgr.gibba045.orlgmj (mgr.34412) 601 : cluster [DBG] pgmap v322: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:09.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:59:08 gibba045 bash[25517]: cluster 2021-03-10T13:59:07.323403+0000 mgr.gibba045.orlgmj (mgr.34412) 601 : cluster [DBG] pgmap v322: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:11.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:59:10 gibba015 bash[29377]: cluster 2021-03-10T13:59:09.324707+0000 mgr.gibba045.orlgmj (mgr.34412) 602 : cluster [DBG] pgmap v323: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:11.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:59:10 gibba015 bash[30343]: cluster 2021-03-10T13:59:09.324707+0000 mgr.gibba045.orlgmj (mgr.34412) 602 : cluster [DBG] pgmap v323: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:11.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:59:10 gibba045 bash[25517]: cluster 2021-03-10T13:59:09.324707+0000 mgr.gibba045.orlgmj (mgr.34412) 602 : cluster [DBG] pgmap v323: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:13.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:59:12 gibba015 bash[29377]: cluster 2021-03-10T13:59:11.326256+0000 mgr.gibba045.orlgmj (mgr.34412) 603 : cluster [DBG] pgmap v324: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:13.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:59:12 gibba015 bash[30343]: cluster 2021-03-10T13:59:11.326256+0000 mgr.gibba045.orlgmj (mgr.34412) 603 : cluster [DBG] pgmap v324: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:13.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:59:12 gibba045 bash[25517]: cluster 2021-03-10T13:59:11.326256+0000 mgr.gibba045.orlgmj (mgr.34412) 603 : cluster [DBG] pgmap v324: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:15.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:59:14 gibba015 bash[29377]: cluster 2021-03-10T13:59:13.327743+0000 mgr.gibba045.orlgmj (mgr.34412) 604 : cluster [DBG] pgmap v325: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:15.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:59:14 gibba015 bash[30343]: cluster 2021-03-10T13:59:13.327743+0000 mgr.gibba045.orlgmj (mgr.34412) 604 : cluster [DBG] pgmap v325: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:15.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:59:14 gibba045 bash[25517]: cluster 2021-03-10T13:59:13.327743+0000 mgr.gibba045.orlgmj (mgr.34412) 604 : cluster [DBG] pgmap v325: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:17.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:59:16 gibba015 bash[29377]: cluster 2021-03-10T13:59:15.329330+0000 mgr.gibba045.orlgmj (mgr.34412) 605 : cluster [DBG] pgmap v326: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:17.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:59:16 gibba015 bash[30343]: cluster 2021-03-10T13:59:15.329330+0000 mgr.gibba045.orlgmj (mgr.34412) 605 : cluster [DBG] pgmap v326: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:17.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:59:16 gibba045 bash[25517]: cluster 2021-03-10T13:59:15.329330+0000 mgr.gibba045.orlgmj (mgr.34412) 605 : cluster [DBG] pgmap v326: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:19.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:59:18 gibba015 bash[29377]: cluster 2021-03-10T13:59:17.330800+0000 mgr.gibba045.orlgmj (mgr.34412) 606 : cluster [DBG] pgmap v327: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:19.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:59:18 gibba015 bash[30343]: cluster 2021-03-10T13:59:17.330800+0000 mgr.gibba045.orlgmj (mgr.34412) 606 : cluster [DBG] pgmap v327: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:19.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:59:18 gibba045 bash[25517]: cluster 2021-03-10T13:59:17.330800+0000 mgr.gibba045.orlgmj (mgr.34412) 606 : cluster [DBG] pgmap v327: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:20.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:59:19 gibba015 bash[29377]: cephadm 2021-03-10T13:59:18.816991+0000 mgr.gibba045.orlgmj (mgr.34412) 607 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T13:59:20.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:59:19 gibba015 bash[30343]: cephadm 2021-03-10T13:59:18.816991+0000 mgr.gibba045.orlgmj (mgr.34412) 607 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T13:59:20.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:59:19 gibba045 bash[25517]: cephadm 2021-03-10T13:59:18.816991+0000 mgr.gibba045.orlgmj (mgr.34412) 607 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T13:59:21.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:59:20 gibba015 bash[29377]: cluster 2021-03-10T13:59:19.331986+0000 mgr.gibba045.orlgmj (mgr.34412) 608 : cluster [DBG] pgmap v328: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:21.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:59:20 gibba015 bash[30343]: cluster 2021-03-10T13:59:19.331986+0000 mgr.gibba045.orlgmj (mgr.34412) 608 : cluster [DBG] pgmap v328: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:21.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:59:20 gibba045 bash[25517]: cluster 2021-03-10T13:59:19.331986+0000 mgr.gibba045.orlgmj (mgr.34412) 608 : cluster [DBG] pgmap v328: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:22.308 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T13:59:22.534 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T13:59:22.534 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (10m) 7m ago 15m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T13:59:22.534 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (15m) 5m ago 15m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T13:59:22.535 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (10m) 5m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T13:59:22.535 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (10m) 5m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T13:59:22.535 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (9m) 7m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T13:59:22.535 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (9m) 7m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T13:59:22.536 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (9m) 5m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T13:59:22.536 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (9m) 7m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T13:59:22.536 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (15m) 7m ago 15m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T13:59:22.536 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (15m) 5m ago 15m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T13:59:22.536 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (8m) 7m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T13:59:22.537 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (7m) 7m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T13:59:22.537 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (7m) 7m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T13:59:22.537 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (7m) 7m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T13:59:22.537 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (6m) 5m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T13:59:22.537 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (6m) 5m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T13:59:22.538 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (5m) 5m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T13:59:22.538 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (5m) 5m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T13:59:22.538 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (14m) 5m ago 15m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T13:59:22.538 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 5m ago 13m docker.io/ceph/ceph:v15.2.0 2021-03-10T13:59:22.782 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T13:59:22.782 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T13:59:22.782 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:59:22.782 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T13:59:22.783 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T13:59:22.783 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:59:22.783 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T13:59:22.783 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T13:59:22.783 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T13:59:22.784 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T13:59:22.784 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T13:59:22.784 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T13:59:22.785 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T13:59:22.785 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T13:59:22.785 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T13:59:23.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:59:22 gibba015 bash[29377]: cluster 2021-03-10T13:59:21.333627+0000 mgr.gibba045.orlgmj (mgr.34412) 609 : cluster [DBG] pgmap v329: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:23.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:59:22 gibba015 bash[29377]: audit 2021-03-10T13:59:22.779604+0000 mon.c (mon.1) 237 : audit [DBG] from='client.? 172.21.2.115:0/3832197443' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:59:23.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:59:22 gibba015 bash[30343]: cluster 2021-03-10T13:59:21.333627+0000 mgr.gibba045.orlgmj (mgr.34412) 609 : cluster [DBG] pgmap v329: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:23.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:59:22 gibba015 bash[30343]: audit 2021-03-10T13:59:22.779604+0000 mon.c (mon.1) 237 : audit [DBG] from='client.? 172.21.2.115:0/3832197443' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:59:23.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:59:22 gibba045 bash[25517]: cluster 2021-03-10T13:59:21.333627+0000 mgr.gibba045.orlgmj (mgr.34412) 609 : cluster [DBG] pgmap v329: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:23.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:59:22 gibba045 bash[25517]: audit 2021-03-10T13:59:22.779604+0000 mon.c (mon.1) 237 : audit [DBG] from='client.? 172.21.2.115:0/3832197443' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:59:24.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:59:23 gibba015 bash[29377]: audit 2021-03-10T13:59:22.299480+0000 mgr.gibba045.orlgmj (mgr.34412) 610 : audit [DBG] from='client.44466 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:59:24.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:59:23 gibba015 bash[29377]: audit 2021-03-10T13:59:22.522074+0000 mgr.gibba045.orlgmj (mgr.34412) 611 : audit [DBG] from='client.54460 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:59:24.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:59:23 gibba015 bash[30343]: audit 2021-03-10T13:59:22.299480+0000 mgr.gibba045.orlgmj (mgr.34412) 610 : audit [DBG] from='client.44466 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:59:24.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:59:23 gibba015 bash[30343]: audit 2021-03-10T13:59:22.522074+0000 mgr.gibba045.orlgmj (mgr.34412) 611 : audit [DBG] from='client.54460 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:59:24.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:59:23 gibba045 bash[25517]: audit 2021-03-10T13:59:22.299480+0000 mgr.gibba045.orlgmj (mgr.34412) 610 : audit [DBG] from='client.44466 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:59:24.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:59:23 gibba045 bash[25517]: audit 2021-03-10T13:59:22.522074+0000 mgr.gibba045.orlgmj (mgr.34412) 611 : audit [DBG] from='client.54460 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:59:25.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:59:24 gibba015 bash[29377]: cluster 2021-03-10T13:59:23.334983+0000 mgr.gibba045.orlgmj (mgr.34412) 612 : cluster [DBG] pgmap v330: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:25.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:59:24 gibba015 bash[30343]: cluster 2021-03-10T13:59:23.334983+0000 mgr.gibba045.orlgmj (mgr.34412) 612 : cluster [DBG] pgmap v330: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:25.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:59:24 gibba045 bash[25517]: cluster 2021-03-10T13:59:23.334983+0000 mgr.gibba045.orlgmj (mgr.34412) 612 : cluster [DBG] pgmap v330: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:27.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:59:26 gibba015 bash[29377]: cluster 2021-03-10T13:59:25.336601+0000 mgr.gibba045.orlgmj (mgr.34412) 613 : cluster [DBG] pgmap v331: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:27.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:59:26 gibba015 bash[30343]: cluster 2021-03-10T13:59:25.336601+0000 mgr.gibba045.orlgmj (mgr.34412) 613 : cluster [DBG] pgmap v331: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:27.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:59:26 gibba045 bash[25517]: cluster 2021-03-10T13:59:25.336601+0000 mgr.gibba045.orlgmj (mgr.34412) 613 : cluster [DBG] pgmap v331: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:29.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:59:28 gibba015 bash[29377]: cluster 2021-03-10T13:59:27.338018+0000 mgr.gibba045.orlgmj (mgr.34412) 614 : cluster [DBG] pgmap v332: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:29.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:59:28 gibba015 bash[30343]: cluster 2021-03-10T13:59:27.338018+0000 mgr.gibba045.orlgmj (mgr.34412) 614 : cluster [DBG] pgmap v332: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:29.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:59:28 gibba045 bash[25517]: cluster 2021-03-10T13:59:27.338018+0000 mgr.gibba045.orlgmj (mgr.34412) 614 : cluster [DBG] pgmap v332: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:31.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:59:30 gibba015 bash[29377]: cluster 2021-03-10T13:59:29.339397+0000 mgr.gibba045.orlgmj (mgr.34412) 615 : cluster [DBG] pgmap v333: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:31.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:59:30 gibba015 bash[30343]: cluster 2021-03-10T13:59:29.339397+0000 mgr.gibba045.orlgmj (mgr.34412) 615 : cluster [DBG] pgmap v333: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:31.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:59:30 gibba045 bash[25517]: cluster 2021-03-10T13:59:29.339397+0000 mgr.gibba045.orlgmj (mgr.34412) 615 : cluster [DBG] pgmap v333: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:33.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:59:32 gibba015 bash[29377]: cluster 2021-03-10T13:59:31.341314+0000 mgr.gibba045.orlgmj (mgr.34412) 616 : cluster [DBG] pgmap v334: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:33.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:59:32 gibba015 bash[30343]: cluster 2021-03-10T13:59:31.341314+0000 mgr.gibba045.orlgmj (mgr.34412) 616 : cluster [DBG] pgmap v334: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:33.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:59:32 gibba045 bash[25517]: cluster 2021-03-10T13:59:31.341314+0000 mgr.gibba045.orlgmj (mgr.34412) 616 : cluster [DBG] pgmap v334: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:35.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:59:34 gibba015 bash[29377]: cluster 2021-03-10T13:59:33.343078+0000 mgr.gibba045.orlgmj (mgr.34412) 617 : cluster [DBG] pgmap v335: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:35.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:59:34 gibba015 bash[29377]: cephadm 2021-03-10T13:59:33.832321+0000 mgr.gibba045.orlgmj (mgr.34412) 618 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T13:59:35.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:59:34 gibba015 bash[30343]: cluster 2021-03-10T13:59:33.343078+0000 mgr.gibba045.orlgmj (mgr.34412) 617 : cluster [DBG] pgmap v335: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:35.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:59:34 gibba015 bash[30343]: cephadm 2021-03-10T13:59:33.832321+0000 mgr.gibba045.orlgmj (mgr.34412) 618 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T13:59:35.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:59:34 gibba045 bash[25517]: cluster 2021-03-10T13:59:33.343078+0000 mgr.gibba045.orlgmj (mgr.34412) 617 : cluster [DBG] pgmap v335: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:35.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:59:34 gibba045 bash[25517]: cephadm 2021-03-10T13:59:33.832321+0000 mgr.gibba045.orlgmj (mgr.34412) 618 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T13:59:37.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:59:36 gibba015 bash[29377]: cluster 2021-03-10T13:59:35.344821+0000 mgr.gibba045.orlgmj (mgr.34412) 619 : cluster [DBG] pgmap v336: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:37.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:59:36 gibba015 bash[30343]: cluster 2021-03-10T13:59:35.344821+0000 mgr.gibba045.orlgmj (mgr.34412) 619 : cluster [DBG] pgmap v336: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:37.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:59:36 gibba045 bash[25517]: cluster 2021-03-10T13:59:35.344821+0000 mgr.gibba045.orlgmj (mgr.34412) 619 : cluster [DBG] pgmap v336: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:39.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:59:38 gibba015 bash[29377]: cluster 2021-03-10T13:59:37.346701+0000 mgr.gibba045.orlgmj (mgr.34412) 620 : cluster [DBG] pgmap v337: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:39.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:59:38 gibba015 bash[30343]: cluster 2021-03-10T13:59:37.346701+0000 mgr.gibba045.orlgmj (mgr.34412) 620 : cluster [DBG] pgmap v337: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:39.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:59:38 gibba045 bash[25517]: cluster 2021-03-10T13:59:37.346701+0000 mgr.gibba045.orlgmj (mgr.34412) 620 : cluster [DBG] pgmap v337: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:41.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:59:40 gibba015 bash[29377]: cluster 2021-03-10T13:59:39.348227+0000 mgr.gibba045.orlgmj (mgr.34412) 621 : cluster [DBG] pgmap v338: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:41.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:59:40 gibba015 bash[30343]: cluster 2021-03-10T13:59:39.348227+0000 mgr.gibba045.orlgmj (mgr.34412) 621 : cluster [DBG] pgmap v338: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:41.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:59:40 gibba045 bash[25517]: cluster 2021-03-10T13:59:39.348227+0000 mgr.gibba045.orlgmj (mgr.34412) 621 : cluster [DBG] pgmap v338: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:43.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:59:42 gibba045 bash[25517]: cluster 2021-03-10T13:59:41.350140+0000 mgr.gibba045.orlgmj (mgr.34412) 622 : cluster [DBG] pgmap v339: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:43.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:59:42 gibba015 bash[29377]: cluster 2021-03-10T13:59:41.350140+0000 mgr.gibba045.orlgmj (mgr.34412) 622 : cluster [DBG] pgmap v339: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:43.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:59:42 gibba015 bash[30343]: cluster 2021-03-10T13:59:41.350140+0000 mgr.gibba045.orlgmj (mgr.34412) 622 : cluster [DBG] pgmap v339: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:45.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:59:44 gibba045 bash[25517]: cluster 2021-03-10T13:59:43.351830+0000 mgr.gibba045.orlgmj (mgr.34412) 623 : cluster [DBG] pgmap v340: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:45.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:59:44 gibba015 bash[29377]: cluster 2021-03-10T13:59:43.351830+0000 mgr.gibba045.orlgmj (mgr.34412) 623 : cluster [DBG] pgmap v340: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:45.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:59:44 gibba015 bash[30343]: cluster 2021-03-10T13:59:43.351830+0000 mgr.gibba045.orlgmj (mgr.34412) 623 : cluster [DBG] pgmap v340: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:47.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:59:46 gibba045 bash[25517]: cluster 2021-03-10T13:59:45.353362+0000 mgr.gibba045.orlgmj (mgr.34412) 624 : cluster [DBG] pgmap v341: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:47.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:59:46 gibba015 bash[29377]: cluster 2021-03-10T13:59:45.353362+0000 mgr.gibba045.orlgmj (mgr.34412) 624 : cluster [DBG] pgmap v341: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:47.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:59:46 gibba015 bash[30343]: cluster 2021-03-10T13:59:45.353362+0000 mgr.gibba045.orlgmj (mgr.34412) 624 : cluster [DBG] pgmap v341: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:48.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:59:48 gibba045 bash[25517]: cluster 2021-03-10T13:59:47.354868+0000 mgr.gibba045.orlgmj (mgr.34412) 625 : cluster [DBG] pgmap v342: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:48.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:59:48 gibba015 bash[29377]: cluster 2021-03-10T13:59:47.354868+0000 mgr.gibba045.orlgmj (mgr.34412) 625 : cluster [DBG] pgmap v342: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:48.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:59:48 gibba015 bash[30343]: cluster 2021-03-10T13:59:47.354868+0000 mgr.gibba045.orlgmj (mgr.34412) 625 : cluster [DBG] pgmap v342: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:49.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:59:49 gibba045 bash[25517]: cephadm 2021-03-10T13:59:48.848085+0000 mgr.gibba045.orlgmj (mgr.34412) 626 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T13:59:49.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:59:49 gibba015 bash[29377]: cephadm 2021-03-10T13:59:48.848085+0000 mgr.gibba045.orlgmj (mgr.34412) 626 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T13:59:49.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:59:49 gibba015 bash[30343]: cephadm 2021-03-10T13:59:48.848085+0000 mgr.gibba045.orlgmj (mgr.34412) 626 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T13:59:50.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:59:50 gibba015 bash[29377]: cluster 2021-03-10T13:59:49.356272+0000 mgr.gibba045.orlgmj (mgr.34412) 627 : cluster [DBG] pgmap v343: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:50.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:59:50 gibba015 bash[30343]: cluster 2021-03-10T13:59:49.356272+0000 mgr.gibba045.orlgmj (mgr.34412) 627 : cluster [DBG] pgmap v343: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:50.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:59:50 gibba045 bash[25517]: cluster 2021-03-10T13:59:49.356272+0000 mgr.gibba045.orlgmj (mgr.34412) 627 : cluster [DBG] pgmap v343: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:52.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:59:52 gibba015 bash[29377]: cluster 2021-03-10T13:59:51.358225+0000 mgr.gibba045.orlgmj (mgr.34412) 628 : cluster [DBG] pgmap v344: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:52.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:59:52 gibba015 bash[29377]: audit 2021-03-10T13:59:52.433028+0000 mon.c (mon.1) 238 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T13:59:52.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:59:52 gibba015 bash[29377]: audit 2021-03-10T13:59:52.433810+0000 mon.c (mon.1) 239 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T13:59:52.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:59:52 gibba015 bash[29377]: audit 2021-03-10T13:59:52.434257+0000 mon.a (mon.0) 620 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T13:59:52.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:59:52 gibba015 bash[29377]: audit 2021-03-10T13:59:52.434467+0000 mon.c (mon.1) 240 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T13:59:52.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:59:52 gibba015 bash[29377]: audit 2021-03-10T13:59:52.435319+0000 mon.c (mon.1) 241 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T13:59:52.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:59:52 gibba015 bash[29377]: audit 2021-03-10T13:59:52.435692+0000 mon.a (mon.0) 621 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T13:59:52.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:59:52 gibba015 bash[29377]: audit 2021-03-10T13:59:52.436656+0000 mon.a (mon.0) 622 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T13:59:52.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:59:52 gibba015 bash[29377]: audit 2021-03-10T13:59:52.437456+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T13:59:52.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:59:52 gibba015 bash[29377]: audit 2021-03-10T13:59:52.526223+0000 mon.c (mon.1) 242 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:59:52.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:59:52 gibba015 bash[29377]: audit 2021-03-10T13:59:52.526863+0000 mon.c (mon.1) 243 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T13:59:52.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:59:52 gibba015 bash[29377]: audit 2021-03-10T13:59:52.527366+0000 mon.a (mon.0) 624 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:59:52.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:59:52 gibba015 bash[29377]: audit 2021-03-10T13:59:52.528481+0000 mon.a (mon.0) 625 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T13:59:52.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:59:52 gibba015 bash[30343]: cluster 2021-03-10T13:59:51.358225+0000 mgr.gibba045.orlgmj (mgr.34412) 628 : cluster [DBG] pgmap v344: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:52.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:59:52 gibba015 bash[30343]: audit 2021-03-10T13:59:52.433028+0000 mon.c (mon.1) 238 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T13:59:52.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:59:52 gibba015 bash[30343]: audit 2021-03-10T13:59:52.433810+0000 mon.c (mon.1) 239 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T13:59:52.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:59:52 gibba015 bash[30343]: audit 2021-03-10T13:59:52.434257+0000 mon.a (mon.0) 620 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T13:59:52.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:59:52 gibba015 bash[30343]: audit 2021-03-10T13:59:52.434467+0000 mon.c (mon.1) 240 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T13:59:52.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:59:52 gibba015 bash[30343]: audit 2021-03-10T13:59:52.435319+0000 mon.c (mon.1) 241 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T13:59:52.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:59:52 gibba015 bash[30343]: audit 2021-03-10T13:59:52.435692+0000 mon.a (mon.0) 621 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T13:59:52.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:59:52 gibba015 bash[30343]: audit 2021-03-10T13:59:52.436656+0000 mon.a (mon.0) 622 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T13:59:52.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:59:52 gibba015 bash[30343]: audit 2021-03-10T13:59:52.437456+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T13:59:52.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:59:52 gibba015 bash[30343]: audit 2021-03-10T13:59:52.526223+0000 mon.c (mon.1) 242 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:59:52.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:59:52 gibba015 bash[30343]: audit 2021-03-10T13:59:52.526863+0000 mon.c (mon.1) 243 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T13:59:52.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:59:52 gibba015 bash[30343]: audit 2021-03-10T13:59:52.527366+0000 mon.a (mon.0) 624 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:59:52.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:59:52 gibba015 bash[30343]: audit 2021-03-10T13:59:52.528481+0000 mon.a (mon.0) 625 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T13:59:53.029 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T13:59:53.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:59:52 gibba045 bash[25517]: cluster 2021-03-10T13:59:51.358225+0000 mgr.gibba045.orlgmj (mgr.34412) 628 : cluster [DBG] pgmap v344: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:53.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:59:52 gibba045 bash[25517]: audit 2021-03-10T13:59:52.433028+0000 mon.c (mon.1) 238 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T13:59:53.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:59:52 gibba045 bash[25517]: audit 2021-03-10T13:59:52.433810+0000 mon.c (mon.1) 239 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T13:59:53.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:59:52 gibba045 bash[25517]: audit 2021-03-10T13:59:52.434257+0000 mon.a (mon.0) 620 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T13:59:53.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:59:52 gibba045 bash[25517]: audit 2021-03-10T13:59:52.434467+0000 mon.c (mon.1) 240 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T13:59:53.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:59:52 gibba045 bash[25517]: audit 2021-03-10T13:59:52.435319+0000 mon.c (mon.1) 241 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T13:59:53.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:59:52 gibba045 bash[25517]: audit 2021-03-10T13:59:52.435692+0000 mon.a (mon.0) 621 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T13:59:53.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:59:52 gibba045 bash[25517]: audit 2021-03-10T13:59:52.436656+0000 mon.a (mon.0) 622 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T13:59:53.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:59:52 gibba045 bash[25517]: audit 2021-03-10T13:59:52.437456+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T13:59:53.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:59:52 gibba045 bash[25517]: audit 2021-03-10T13:59:52.526223+0000 mon.c (mon.1) 242 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:59:53.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:59:52 gibba045 bash[25517]: audit 2021-03-10T13:59:52.526863+0000 mon.c (mon.1) 243 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T13:59:53.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:59:52 gibba045 bash[25517]: audit 2021-03-10T13:59:52.527366+0000 mon.a (mon.0) 624 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:59:53.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:59:52 gibba045 bash[25517]: audit 2021-03-10T13:59:52.528481+0000 mon.a (mon.0) 625 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T13:59:53.257 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T13:59:53.257 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (10m) 7m ago 15m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T13:59:53.258 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (15m) 5m ago 15m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T13:59:53.258 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (11m) 5m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T13:59:53.258 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (11m) 5m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T13:59:53.258 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (10m) 7m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T13:59:53.259 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (10m) 7m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T13:59:53.259 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (9m) 5m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T13:59:53.259 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (9m) 7m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T13:59:53.259 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (16m) 7m ago 16m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T13:59:53.259 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (16m) 5m ago 16m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T13:59:53.260 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (8m) 7m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T13:59:53.260 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (8m) 7m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T13:59:53.260 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (8m) 7m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T13:59:53.260 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (7m) 7m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T13:59:53.260 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (7m) 5m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T13:59:53.261 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (6m) 5m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T13:59:53.261 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (6m) 5m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T13:59:53.261 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (5m) 5m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T13:59:53.261 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (15m) 5m ago 16m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T13:59:53.261 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 5m ago 14m docker.io/ceph/ceph:v15.2.0 2021-03-10T13:59:53.508 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T13:59:53.509 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T13:59:53.509 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:59:53.509 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T13:59:53.509 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T13:59:53.510 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:59:53.510 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T13:59:53.510 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T13:59:53.510 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T13:59:53.510 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T13:59:53.511 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T13:59:53.511 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T13:59:53.511 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T13:59:53.511 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T13:59:53.512 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T13:59:53.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:59:53 gibba015 bash[29377]: audit 2021-03-10T13:59:53.506003+0000 mon.c (mon.1) 244 : audit [DBG] from='client.? 172.21.2.115:0/1648513583' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:59:53.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:59:53 gibba015 bash[30343]: audit 2021-03-10T13:59:53.506003+0000 mon.c (mon.1) 244 : audit [DBG] from='client.? 172.21.2.115:0/1648513583' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:59:54.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:59:53 gibba045 bash[25517]: audit 2021-03-10T13:59:53.506003+0000 mon.c (mon.1) 244 : audit [DBG] from='client.? 172.21.2.115:0/1648513583' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:59:54.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:59:54 gibba015 bash[29377]: audit 2021-03-10T13:59:53.020636+0000 mgr.gibba045.orlgmj (mgr.34412) 629 : audit [DBG] from='client.54472 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:59:54.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:59:54 gibba015 bash[29377]: audit 2021-03-10T13:59:53.244950+0000 mgr.gibba045.orlgmj (mgr.34412) 630 : audit [DBG] from='client.54478 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:59:54.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:59:54 gibba015 bash[29377]: cluster 2021-03-10T13:59:53.359026+0000 mgr.gibba045.orlgmj (mgr.34412) 631 : cluster [DBG] pgmap v345: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:54.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:59:54 gibba015 bash[30343]: audit 2021-03-10T13:59:53.020636+0000 mgr.gibba045.orlgmj (mgr.34412) 629 : audit [DBG] from='client.54472 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:59:54.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:59:54 gibba015 bash[30343]: audit 2021-03-10T13:59:53.244950+0000 mgr.gibba045.orlgmj (mgr.34412) 630 : audit [DBG] from='client.54478 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:59:54.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:59:54 gibba015 bash[30343]: cluster 2021-03-10T13:59:53.359026+0000 mgr.gibba045.orlgmj (mgr.34412) 631 : cluster [DBG] pgmap v345: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:55.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:59:54 gibba045 bash[25517]: audit 2021-03-10T13:59:53.020636+0000 mgr.gibba045.orlgmj (mgr.34412) 629 : audit [DBG] from='client.54472 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:59:55.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:59:54 gibba045 bash[25517]: audit 2021-03-10T13:59:53.244950+0000 mgr.gibba045.orlgmj (mgr.34412) 630 : audit [DBG] from='client.54478 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:59:55.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:59:54 gibba045 bash[25517]: cluster 2021-03-10T13:59:53.359026+0000 mgr.gibba045.orlgmj (mgr.34412) 631 : cluster [DBG] pgmap v345: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:56.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:59:56 gibba015 bash[29377]: cluster 2021-03-10T13:59:55.360596+0000 mgr.gibba045.orlgmj (mgr.34412) 632 : cluster [DBG] pgmap v346: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:56.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:59:56 gibba015 bash[30343]: cluster 2021-03-10T13:59:55.360596+0000 mgr.gibba045.orlgmj (mgr.34412) 632 : cluster [DBG] pgmap v346: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:57.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:59:56 gibba045 bash[25517]: cluster 2021-03-10T13:59:55.360596+0000 mgr.gibba045.orlgmj (mgr.34412) 632 : cluster [DBG] pgmap v346: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:58.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 13:59:58 gibba015 bash[29377]: cluster 2021-03-10T13:59:57.362218+0000 mgr.gibba045.orlgmj (mgr.34412) 633 : cluster [DBG] pgmap v347: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:58.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 13:59:58 gibba015 bash[30343]: cluster 2021-03-10T13:59:57.362218+0000 mgr.gibba045.orlgmj (mgr.34412) 633 : cluster [DBG] pgmap v347: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:59.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 13:59:58 gibba045 bash[25517]: cluster 2021-03-10T13:59:57.362218+0000 mgr.gibba045.orlgmj (mgr.34412) 633 : cluster [DBG] pgmap v347: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:00.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:00 gibba015 bash[29377]: debug 2021-03-10T13:59:59.996+0000 7f21beb4f700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T14:00:00.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:00 gibba015 bash[29377]: cluster 2021-03-10T13:59:59.363619+0000 mgr.gibba045.orlgmj (mgr.34412) 634 : cluster [DBG] pgmap v348: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:00.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:00 gibba015 bash[29377]: cluster 2021-03-10T14:00:00.000310+0000 mon.a (mon.0) 626 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T14:00:00.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:00:00 gibba015 bash[30343]: cluster 2021-03-10T13:59:59.363619+0000 mgr.gibba045.orlgmj (mgr.34412) 634 : cluster [DBG] pgmap v348: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:00.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:00:00 gibba015 bash[30343]: cluster 2021-03-10T14:00:00.000310+0000 mon.a (mon.0) 626 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T14:00:01.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:00:00 gibba045 bash[25517]: cluster 2021-03-10T13:59:59.363619+0000 mgr.gibba045.orlgmj (mgr.34412) 634 : cluster [DBG] pgmap v348: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:01.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:00:00 gibba045 bash[25517]: cluster 2021-03-10T14:00:00.000310+0000 mon.a (mon.0) 626 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T14:00:02.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:02 gibba015 bash[29377]: cluster 2021-03-10T14:00:01.365506+0000 mgr.gibba045.orlgmj (mgr.34412) 635 : cluster [DBG] pgmap v349: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:02.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:00:02 gibba015 bash[30343]: cluster 2021-03-10T14:00:01.365506+0000 mgr.gibba045.orlgmj (mgr.34412) 635 : cluster [DBG] pgmap v349: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:03.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:00:02 gibba045 bash[25517]: cluster 2021-03-10T14:00:01.365506+0000 mgr.gibba045.orlgmj (mgr.34412) 635 : cluster [DBG] pgmap v349: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:04.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:04 gibba015 bash[29377]: cluster 2021-03-10T14:00:03.366814+0000 mgr.gibba045.orlgmj (mgr.34412) 636 : cluster [DBG] pgmap v350: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:04.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:04 gibba015 bash[29377]: audit 2021-03-10T14:00:03.858802+0000 mon.c (mon.1) 245 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:00:04.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:04 gibba015 bash[29377]: audit 2021-03-10T14:00:04.071570+0000 mon.a (mon.0) 627 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:00:04.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:04 gibba015 bash[29377]: audit 2021-03-10T14:00:04.075934+0000 mon.a (mon.0) 628 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:00:04.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:04 gibba015 bash[29377]: audit 2021-03-10T14:00:04.261737+0000 mon.a (mon.0) 629 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:00:04.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:04 gibba015 bash[29377]: audit 2021-03-10T14:00:04.265556+0000 mon.c (mon.1) 246 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:00:04.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:04 gibba015 bash[29377]: audit 2021-03-10T14:00:04.267359+0000 mon.c (mon.1) 247 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:00:04.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:04 gibba015 bash[29377]: audit 2021-03-10T14:00:04.269008+0000 mon.c (mon.1) 248 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:00:04.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:04 gibba015 bash[29377]: audit 2021-03-10T14:00:04.270730+0000 mon.c (mon.1) 249 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:00:04.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:04 gibba015 bash[29377]: audit 2021-03-10T14:00:04.274463+0000 mon.c (mon.1) 250 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:00:04.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:04 gibba015 bash[29377]: audit 2021-03-10T14:00:04.276314+0000 mon.c (mon.1) 251 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:00:04.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:00:04 gibba015 bash[30343]: cluster 2021-03-10T14:00:03.366814+0000 mgr.gibba045.orlgmj (mgr.34412) 636 : cluster [DBG] pgmap v350: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:04.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:00:04 gibba015 bash[30343]: audit 2021-03-10T14:00:03.858802+0000 mon.c (mon.1) 245 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:00:04.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:00:04 gibba015 bash[30343]: audit 2021-03-10T14:00:04.071570+0000 mon.a (mon.0) 627 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:00:04.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:00:04 gibba015 bash[30343]: audit 2021-03-10T14:00:04.075934+0000 mon.a (mon.0) 628 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:00:04.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:00:04 gibba015 bash[30343]: audit 2021-03-10T14:00:04.261737+0000 mon.a (mon.0) 629 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:00:04.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:00:04 gibba015 bash[30343]: audit 2021-03-10T14:00:04.265556+0000 mon.c (mon.1) 246 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:00:04.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:00:04 gibba015 bash[30343]: audit 2021-03-10T14:00:04.267359+0000 mon.c (mon.1) 247 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:00:04.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:00:04 gibba015 bash[30343]: audit 2021-03-10T14:00:04.269008+0000 mon.c (mon.1) 248 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:00:04.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:00:04 gibba015 bash[30343]: audit 2021-03-10T14:00:04.270730+0000 mon.c (mon.1) 249 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:00:04.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:00:04 gibba015 bash[30343]: audit 2021-03-10T14:00:04.274463+0000 mon.c (mon.1) 250 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:00:04.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:00:04 gibba015 bash[30343]: audit 2021-03-10T14:00:04.276314+0000 mon.c (mon.1) 251 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:00:05.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:00:04 gibba045 bash[25517]: cluster 2021-03-10T14:00:03.366814+0000 mgr.gibba045.orlgmj (mgr.34412) 636 : cluster [DBG] pgmap v350: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:05.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:00:04 gibba045 bash[25517]: audit 2021-03-10T14:00:03.858802+0000 mon.c (mon.1) 245 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:00:05.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:00:04 gibba045 bash[25517]: audit 2021-03-10T14:00:04.071570+0000 mon.a (mon.0) 627 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:00:05.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:00:04 gibba045 bash[25517]: audit 2021-03-10T14:00:04.075934+0000 mon.a (mon.0) 628 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:00:05.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:00:04 gibba045 bash[25517]: audit 2021-03-10T14:00:04.261737+0000 mon.a (mon.0) 629 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:00:05.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:00:04 gibba045 bash[25517]: audit 2021-03-10T14:00:04.265556+0000 mon.c (mon.1) 246 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:00:05.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:00:04 gibba045 bash[25517]: audit 2021-03-10T14:00:04.267359+0000 mon.c (mon.1) 247 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:00:05.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:00:04 gibba045 bash[25517]: audit 2021-03-10T14:00:04.269008+0000 mon.c (mon.1) 248 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:00:05.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:00:04 gibba045 bash[25517]: audit 2021-03-10T14:00:04.270730+0000 mon.c (mon.1) 249 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:00:05.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:00:04 gibba045 bash[25517]: audit 2021-03-10T14:00:04.274463+0000 mon.c (mon.1) 250 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:00:05.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:00:04 gibba045 bash[25517]: audit 2021-03-10T14:00:04.276314+0000 mon.c (mon.1) 251 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:00:05.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:05 gibba015 bash[29377]: cephadm 2021-03-10T14:00:04.076224+0000 mgr.gibba045.orlgmj (mgr.34412) 637 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:00:05.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:05 gibba015 bash[29377]: cephadm 2021-03-10T14:00:04.080069+0000 mgr.gibba045.orlgmj (mgr.34412) 638 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:00:05.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:05 gibba015 bash[29377]: cephadm 2021-03-10T14:00:04.267912+0000 mgr.gibba045.orlgmj (mgr.34412) 639 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:00:05.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:05 gibba015 bash[29377]: cephadm 2021-03-10T14:00:04.269908+0000 mgr.gibba045.orlgmj (mgr.34412) 640 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:00:05.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:05 gibba015 bash[29377]: cephadm 2021-03-10T14:00:04.271524+0000 mgr.gibba045.orlgmj (mgr.34412) 641 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:00:05.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:05 gibba015 bash[29377]: cephadm 2021-03-10T14:00:04.271561+0000 mgr.gibba045.orlgmj (mgr.34412) 642 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:00:05.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:05 gibba015 bash[29377]: cephadm 2021-03-10T14:00:04.273326+0000 mgr.gibba045.orlgmj (mgr.34412) 643 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:00:05.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:05 gibba015 bash[29377]: cephadm 2021-03-10T14:00:04.273363+0000 mgr.gibba045.orlgmj (mgr.34412) 644 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:00:05.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:05 gibba015 bash[29377]: cephadm 2021-03-10T14:00:04.274930+0000 mgr.gibba045.orlgmj (mgr.34412) 645 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:00:05.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:05 gibba015 bash[29377]: cephadm 2021-03-10T14:00:04.276797+0000 mgr.gibba045.orlgmj (mgr.34412) 646 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:00:05.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:05 gibba015 bash[29377]: cephadm 2021-03-10T14:00:04.276883+0000 mgr.gibba045.orlgmj (mgr.34412) 647 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:00:05.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:05 gibba015 bash[29377]: cephadm 2021-03-10T14:00:04.278605+0000 mgr.gibba045.orlgmj (mgr.34412) 648 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:00:05.980 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:05 gibba015 bash[29377]: cephadm 2021-03-10T14:00:04.278915+0000 mgr.gibba045.orlgmj (mgr.34412) 649 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:00:05.980 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:05 gibba015 bash[29377]: cephadm 2021-03-10T14:00:04.280812+0000 mgr.gibba045.orlgmj (mgr.34412) 650 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:00:05.981 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:05 gibba015 bash[29377]: cephadm 2021-03-10T14:00:04.280851+0000 mgr.gibba045.orlgmj (mgr.34412) 651 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:00:05.981 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:05 gibba015 bash[29377]: cephadm 2021-03-10T14:00:04.280958+0000 mgr.gibba045.orlgmj (mgr.34412) 652 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:00:05.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:00:05 gibba015 bash[30343]: cephadm 2021-03-10T14:00:04.076224+0000 mgr.gibba045.orlgmj (mgr.34412) 637 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:00:05.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:00:05 gibba015 bash[30343]: cephadm 2021-03-10T14:00:04.080069+0000 mgr.gibba045.orlgmj (mgr.34412) 638 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:00:05.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:00:05 gibba015 bash[30343]: cephadm 2021-03-10T14:00:04.267912+0000 mgr.gibba045.orlgmj (mgr.34412) 639 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:00:05.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:00:05 gibba015 bash[30343]: cephadm 2021-03-10T14:00:04.269908+0000 mgr.gibba045.orlgmj (mgr.34412) 640 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:00:05.984 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:00:05 gibba015 bash[30343]: cephadm 2021-03-10T14:00:04.271524+0000 mgr.gibba045.orlgmj (mgr.34412) 641 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:00:05.984 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:00:05 gibba015 bash[30343]: cephadm 2021-03-10T14:00:04.271561+0000 mgr.gibba045.orlgmj (mgr.34412) 642 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:00:05.984 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:00:05 gibba015 bash[30343]: cephadm 2021-03-10T14:00:04.273326+0000 mgr.gibba045.orlgmj (mgr.34412) 643 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:00:05.985 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:00:05 gibba015 bash[30343]: cephadm 2021-03-10T14:00:04.273363+0000 mgr.gibba045.orlgmj (mgr.34412) 644 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:00:05.985 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:00:05 gibba015 bash[30343]: cephadm 2021-03-10T14:00:04.274930+0000 mgr.gibba045.orlgmj (mgr.34412) 645 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:00:05.986 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:00:05 gibba015 bash[30343]: cephadm 2021-03-10T14:00:04.276797+0000 mgr.gibba045.orlgmj (mgr.34412) 646 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:00:05.986 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:00:05 gibba015 bash[30343]: cephadm 2021-03-10T14:00:04.276883+0000 mgr.gibba045.orlgmj (mgr.34412) 647 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:00:05.987 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:00:05 gibba015 bash[30343]: cephadm 2021-03-10T14:00:04.278605+0000 mgr.gibba045.orlgmj (mgr.34412) 648 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:00:05.987 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:00:05 gibba015 bash[30343]: cephadm 2021-03-10T14:00:04.278915+0000 mgr.gibba045.orlgmj (mgr.34412) 649 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:00:05.987 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:00:05 gibba015 bash[30343]: cephadm 2021-03-10T14:00:04.280812+0000 mgr.gibba045.orlgmj (mgr.34412) 650 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:00:05.988 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:00:05 gibba015 bash[30343]: cephadm 2021-03-10T14:00:04.280851+0000 mgr.gibba045.orlgmj (mgr.34412) 651 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:00:05.988 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:00:05 gibba015 bash[30343]: cephadm 2021-03-10T14:00:04.280958+0000 mgr.gibba045.orlgmj (mgr.34412) 652 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:00:06.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:00:05 gibba045 bash[25517]: cephadm 2021-03-10T14:00:04.076224+0000 mgr.gibba045.orlgmj (mgr.34412) 637 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:00:06.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:00:05 gibba045 bash[25517]: cephadm 2021-03-10T14:00:04.080069+0000 mgr.gibba045.orlgmj (mgr.34412) 638 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:00:06.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:00:05 gibba045 bash[25517]: cephadm 2021-03-10T14:00:04.267912+0000 mgr.gibba045.orlgmj (mgr.34412) 639 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:00:06.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:00:05 gibba045 bash[25517]: cephadm 2021-03-10T14:00:04.269908+0000 mgr.gibba045.orlgmj (mgr.34412) 640 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:00:06.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:00:05 gibba045 bash[25517]: cephadm 2021-03-10T14:00:04.271524+0000 mgr.gibba045.orlgmj (mgr.34412) 641 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:00:06.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:00:05 gibba045 bash[25517]: cephadm 2021-03-10T14:00:04.271561+0000 mgr.gibba045.orlgmj (mgr.34412) 642 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:00:06.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:00:05 gibba045 bash[25517]: cephadm 2021-03-10T14:00:04.273326+0000 mgr.gibba045.orlgmj (mgr.34412) 643 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:00:06.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:00:05 gibba045 bash[25517]: cephadm 2021-03-10T14:00:04.273363+0000 mgr.gibba045.orlgmj (mgr.34412) 644 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:00:06.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:00:05 gibba045 bash[25517]: cephadm 2021-03-10T14:00:04.274930+0000 mgr.gibba045.orlgmj (mgr.34412) 645 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:00:06.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:00:05 gibba045 bash[25517]: cephadm 2021-03-10T14:00:04.276797+0000 mgr.gibba045.orlgmj (mgr.34412) 646 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:00:06.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:00:05 gibba045 bash[25517]: cephadm 2021-03-10T14:00:04.276883+0000 mgr.gibba045.orlgmj (mgr.34412) 647 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:00:06.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:00:05 gibba045 bash[25517]: cephadm 2021-03-10T14:00:04.278605+0000 mgr.gibba045.orlgmj (mgr.34412) 648 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:00:06.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:00:05 gibba045 bash[25517]: cephadm 2021-03-10T14:00:04.278915+0000 mgr.gibba045.orlgmj (mgr.34412) 649 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:00:06.062 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:00:05 gibba045 bash[25517]: cephadm 2021-03-10T14:00:04.280812+0000 mgr.gibba045.orlgmj (mgr.34412) 650 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:00:06.062 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:00:05 gibba045 bash[25517]: cephadm 2021-03-10T14:00:04.280851+0000 mgr.gibba045.orlgmj (mgr.34412) 651 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:00:06.063 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:00:05 gibba045 bash[25517]: cephadm 2021-03-10T14:00:04.280958+0000 mgr.gibba045.orlgmj (mgr.34412) 652 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:00:06.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:06 gibba015 bash[29377]: cluster 2021-03-10T14:00:05.368337+0000 mgr.gibba045.orlgmj (mgr.34412) 653 : cluster [DBG] pgmap v351: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:06.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:00:06 gibba015 bash[30343]: cluster 2021-03-10T14:00:05.368337+0000 mgr.gibba045.orlgmj (mgr.34412) 653 : cluster [DBG] pgmap v351: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:07.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:00:06 gibba045 bash[25517]: cluster 2021-03-10T14:00:05.368337+0000 mgr.gibba045.orlgmj (mgr.34412) 653 : cluster [DBG] pgmap v351: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:08.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:08 gibba015 bash[29377]: cluster 2021-03-10T14:00:07.369875+0000 mgr.gibba045.orlgmj (mgr.34412) 654 : cluster [DBG] pgmap v352: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:08.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:00:08 gibba015 bash[30343]: cluster 2021-03-10T14:00:07.369875+0000 mgr.gibba045.orlgmj (mgr.34412) 654 : cluster [DBG] pgmap v352: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:09.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:00:08 gibba045 bash[25517]: cluster 2021-03-10T14:00:07.369875+0000 mgr.gibba045.orlgmj (mgr.34412) 654 : cluster [DBG] pgmap v352: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:10.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:10 gibba015 bash[29377]: cluster 2021-03-10T14:00:09.371085+0000 mgr.gibba045.orlgmj (mgr.34412) 655 : cluster [DBG] pgmap v353: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:10.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:00:10 gibba015 bash[30343]: cluster 2021-03-10T14:00:09.371085+0000 mgr.gibba045.orlgmj (mgr.34412) 655 : cluster [DBG] pgmap v353: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:11.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:00:10 gibba045 bash[25517]: cluster 2021-03-10T14:00:09.371085+0000 mgr.gibba045.orlgmj (mgr.34412) 655 : cluster [DBG] pgmap v353: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:12.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:12 gibba015 bash[29377]: cluster 2021-03-10T14:00:11.372944+0000 mgr.gibba045.orlgmj (mgr.34412) 656 : cluster [DBG] pgmap v354: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:12.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:00:12 gibba015 bash[30343]: cluster 2021-03-10T14:00:11.372944+0000 mgr.gibba045.orlgmj (mgr.34412) 656 : cluster [DBG] pgmap v354: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:13.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:00:12 gibba045 bash[25517]: cluster 2021-03-10T14:00:11.372944+0000 mgr.gibba045.orlgmj (mgr.34412) 656 : cluster [DBG] pgmap v354: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:14.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:14 gibba015 bash[29377]: cluster 2021-03-10T14:00:13.374481+0000 mgr.gibba045.orlgmj (mgr.34412) 657 : cluster [DBG] pgmap v355: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:14.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:00:14 gibba015 bash[30343]: cluster 2021-03-10T14:00:13.374481+0000 mgr.gibba045.orlgmj (mgr.34412) 657 : cluster [DBG] pgmap v355: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:15.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:00:14 gibba045 bash[25517]: cluster 2021-03-10T14:00:13.374481+0000 mgr.gibba045.orlgmj (mgr.34412) 657 : cluster [DBG] pgmap v355: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:16.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:16 gibba015 bash[29377]: cluster 2021-03-10T14:00:15.376009+0000 mgr.gibba045.orlgmj (mgr.34412) 658 : cluster [DBG] pgmap v356: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:16.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:00:16 gibba015 bash[30343]: cluster 2021-03-10T14:00:15.376009+0000 mgr.gibba045.orlgmj (mgr.34412) 658 : cluster [DBG] pgmap v356: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:17.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:00:16 gibba045 bash[25517]: cluster 2021-03-10T14:00:15.376009+0000 mgr.gibba045.orlgmj (mgr.34412) 658 : cluster [DBG] pgmap v356: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:19.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:00:18 gibba045 bash[25517]: cluster 2021-03-10T14:00:17.377662+0000 mgr.gibba045.orlgmj (mgr.34412) 659 : cluster [DBG] pgmap v357: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:19.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:18 gibba015 bash[29377]: cluster 2021-03-10T14:00:17.377662+0000 mgr.gibba045.orlgmj (mgr.34412) 659 : cluster [DBG] pgmap v357: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:19.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:00:18 gibba015 bash[30343]: cluster 2021-03-10T14:00:17.377662+0000 mgr.gibba045.orlgmj (mgr.34412) 659 : cluster [DBG] pgmap v357: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:21.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:00:20 gibba045 bash[25517]: cephadm 2021-03-10T14:00:19.282007+0000 mgr.gibba045.orlgmj (mgr.34412) 660 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:00:21.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:00:20 gibba045 bash[25517]: cluster 2021-03-10T14:00:19.378996+0000 mgr.gibba045.orlgmj (mgr.34412) 661 : cluster [DBG] pgmap v358: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:21.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:20 gibba015 bash[29377]: cephadm 2021-03-10T14:00:19.282007+0000 mgr.gibba045.orlgmj (mgr.34412) 660 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:00:21.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:20 gibba015 bash[29377]: cluster 2021-03-10T14:00:19.378996+0000 mgr.gibba045.orlgmj (mgr.34412) 661 : cluster [DBG] pgmap v358: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:21.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:00:20 gibba015 bash[30343]: cephadm 2021-03-10T14:00:19.282007+0000 mgr.gibba045.orlgmj (mgr.34412) 660 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:00:21.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:00:20 gibba015 bash[30343]: cluster 2021-03-10T14:00:19.378996+0000 mgr.gibba045.orlgmj (mgr.34412) 661 : cluster [DBG] pgmap v358: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:23.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:00:22 gibba045 bash[25517]: cluster 2021-03-10T14:00:21.380863+0000 mgr.gibba045.orlgmj (mgr.34412) 662 : cluster [DBG] pgmap v359: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:23.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:22 gibba015 bash[29377]: cluster 2021-03-10T14:00:21.380863+0000 mgr.gibba045.orlgmj (mgr.34412) 662 : cluster [DBG] pgmap v359: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:23.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:00:22 gibba015 bash[30343]: cluster 2021-03-10T14:00:21.380863+0000 mgr.gibba045.orlgmj (mgr.34412) 662 : cluster [DBG] pgmap v359: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:23.762 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:00:23.994 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:00:23.995 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (11m) 8m ago 16m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:00:23.995 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (16m) 6m ago 16m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:00:23.995 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (11m) 6m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:00:23.995 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (11m) 6m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:00:23.996 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (10m) 8m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:00:23.996 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (10m) 8m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:00:23.996 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (10m) 6m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:00:23.996 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (10m) 8m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:00:23.997 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (16m) 8m ago 16m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:00:23.997 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (16m) 6m ago 16m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:00:23.997 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (9m) 8m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:00:23.997 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (8m) 8m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:00:23.997 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (8m) 8m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:00:23.998 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (8m) 8m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:00:23.998 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (7m) 6m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:00:23.998 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (7m) 6m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:00:23.998 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (6m) 6m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:00:23.999 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (6m) 6m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:00:23.999 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (15m) 6m ago 16m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:00:23.999 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 6m ago 14m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:00:24.241 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:00:24.242 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:00:24.242 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:00:24.242 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:00:24.243 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:00:24.243 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:00:24.243 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:00:24.243 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:00:24.244 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:00:24.244 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:00:24.244 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:00:24.244 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:00:24.244 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:00:24.245 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:00:24.245 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:00:25.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:00:24 gibba045 bash[25517]: cluster 2021-03-10T14:00:23.382360+0000 mgr.gibba045.orlgmj (mgr.34412) 663 : cluster [DBG] pgmap v360: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:25.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:00:24 gibba045 bash[25517]: audit 2021-03-10T14:00:23.745183+0000 mgr.gibba045.orlgmj (mgr.34412) 664 : audit [DBG] from='client.44502 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:00:25.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:00:24 gibba045 bash[25517]: audit 2021-03-10T14:00:23.982042+0000 mgr.gibba045.orlgmj (mgr.34412) 665 : audit [DBG] from='client.44508 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:00:25.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:00:24 gibba045 bash[25517]: audit 2021-03-10T14:00:24.239280+0000 mon.c (mon.1) 252 : audit [DBG] from='client.? 172.21.2.115:0/1691806935' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:00:25.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:24 gibba015 bash[29377]: cluster 2021-03-10T14:00:23.382360+0000 mgr.gibba045.orlgmj (mgr.34412) 663 : cluster [DBG] pgmap v360: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:25.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:24 gibba015 bash[29377]: audit 2021-03-10T14:00:23.745183+0000 mgr.gibba045.orlgmj (mgr.34412) 664 : audit [DBG] from='client.44502 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:00:25.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:24 gibba015 bash[29377]: audit 2021-03-10T14:00:23.982042+0000 mgr.gibba045.orlgmj (mgr.34412) 665 : audit [DBG] from='client.44508 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:00:25.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:24 gibba015 bash[29377]: audit 2021-03-10T14:00:24.239280+0000 mon.c (mon.1) 252 : audit [DBG] from='client.? 172.21.2.115:0/1691806935' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:00:25.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:00:24 gibba015 bash[30343]: cluster 2021-03-10T14:00:23.382360+0000 mgr.gibba045.orlgmj (mgr.34412) 663 : cluster [DBG] pgmap v360: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:25.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:00:24 gibba015 bash[30343]: audit 2021-03-10T14:00:23.745183+0000 mgr.gibba045.orlgmj (mgr.34412) 664 : audit [DBG] from='client.44502 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:00:25.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:00:24 gibba015 bash[30343]: audit 2021-03-10T14:00:23.982042+0000 mgr.gibba045.orlgmj (mgr.34412) 665 : audit [DBG] from='client.44508 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:00:25.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:00:24 gibba015 bash[30343]: audit 2021-03-10T14:00:24.239280+0000 mon.c (mon.1) 252 : audit [DBG] from='client.? 172.21.2.115:0/1691806935' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:00:27.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:00:26 gibba045 bash[25517]: cluster 2021-03-10T14:00:25.383845+0000 mgr.gibba045.orlgmj (mgr.34412) 666 : cluster [DBG] pgmap v361: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:27.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:26 gibba015 bash[29377]: cluster 2021-03-10T14:00:25.383845+0000 mgr.gibba045.orlgmj (mgr.34412) 666 : cluster [DBG] pgmap v361: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:27.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:00:26 gibba015 bash[30343]: cluster 2021-03-10T14:00:25.383845+0000 mgr.gibba045.orlgmj (mgr.34412) 666 : cluster [DBG] pgmap v361: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:29.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:00:28 gibba045 bash[25517]: cluster 2021-03-10T14:00:27.385546+0000 mgr.gibba045.orlgmj (mgr.34412) 667 : cluster [DBG] pgmap v362: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:29.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:28 gibba015 bash[29377]: cluster 2021-03-10T14:00:27.385546+0000 mgr.gibba045.orlgmj (mgr.34412) 667 : cluster [DBG] pgmap v362: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:29.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:00:28 gibba015 bash[30343]: cluster 2021-03-10T14:00:27.385546+0000 mgr.gibba045.orlgmj (mgr.34412) 667 : cluster [DBG] pgmap v362: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:31.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:00:30 gibba045 bash[25517]: cluster 2021-03-10T14:00:29.387123+0000 mgr.gibba045.orlgmj (mgr.34412) 668 : cluster [DBG] pgmap v363: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:31.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:30 gibba015 bash[29377]: cluster 2021-03-10T14:00:29.387123+0000 mgr.gibba045.orlgmj (mgr.34412) 668 : cluster [DBG] pgmap v363: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:31.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:00:30 gibba015 bash[30343]: cluster 2021-03-10T14:00:29.387123+0000 mgr.gibba045.orlgmj (mgr.34412) 668 : cluster [DBG] pgmap v363: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:33.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:00:32 gibba045 bash[25517]: cluster 2021-03-10T14:00:31.389233+0000 mgr.gibba045.orlgmj (mgr.34412) 669 : cluster [DBG] pgmap v364: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:33.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:32 gibba015 bash[29377]: cluster 2021-03-10T14:00:31.389233+0000 mgr.gibba045.orlgmj (mgr.34412) 669 : cluster [DBG] pgmap v364: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:33.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:00:32 gibba015 bash[30343]: cluster 2021-03-10T14:00:31.389233+0000 mgr.gibba045.orlgmj (mgr.34412) 669 : cluster [DBG] pgmap v364: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:35.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:00:34 gibba045 bash[25517]: cluster 2021-03-10T14:00:33.390477+0000 mgr.gibba045.orlgmj (mgr.34412) 670 : cluster [DBG] pgmap v365: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:35.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:34 gibba015 bash[29377]: cluster 2021-03-10T14:00:33.390477+0000 mgr.gibba045.orlgmj (mgr.34412) 670 : cluster [DBG] pgmap v365: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:35.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:00:34 gibba015 bash[30343]: cluster 2021-03-10T14:00:33.390477+0000 mgr.gibba045.orlgmj (mgr.34412) 670 : cluster [DBG] pgmap v365: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:36.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:35 gibba015 bash[29377]: cephadm 2021-03-10T14:00:34.297834+0000 mgr.gibba045.orlgmj (mgr.34412) 671 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:00:36.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:00:35 gibba015 bash[30343]: cephadm 2021-03-10T14:00:34.297834+0000 mgr.gibba045.orlgmj (mgr.34412) 671 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:00:36.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:00:35 gibba045 bash[25517]: cephadm 2021-03-10T14:00:34.297834+0000 mgr.gibba045.orlgmj (mgr.34412) 671 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:00:37.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:36 gibba015 bash[29377]: cluster 2021-03-10T14:00:35.392019+0000 mgr.gibba045.orlgmj (mgr.34412) 672 : cluster [DBG] pgmap v366: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:37.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:00:36 gibba015 bash[30343]: cluster 2021-03-10T14:00:35.392019+0000 mgr.gibba045.orlgmj (mgr.34412) 672 : cluster [DBG] pgmap v366: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:37.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:00:36 gibba045 bash[25517]: cluster 2021-03-10T14:00:35.392019+0000 mgr.gibba045.orlgmj (mgr.34412) 672 : cluster [DBG] pgmap v366: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:39.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:38 gibba015 bash[29377]: cluster 2021-03-10T14:00:37.393724+0000 mgr.gibba045.orlgmj (mgr.34412) 673 : cluster [DBG] pgmap v367: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:39.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:00:38 gibba015 bash[30343]: cluster 2021-03-10T14:00:37.393724+0000 mgr.gibba045.orlgmj (mgr.34412) 673 : cluster [DBG] pgmap v367: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:39.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:00:38 gibba045 bash[25517]: cluster 2021-03-10T14:00:37.393724+0000 mgr.gibba045.orlgmj (mgr.34412) 673 : cluster [DBG] pgmap v367: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:41.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:40 gibba015 bash[29377]: cluster 2021-03-10T14:00:39.394909+0000 mgr.gibba045.orlgmj (mgr.34412) 674 : cluster [DBG] pgmap v368: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:41.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:00:40 gibba015 bash[30343]: cluster 2021-03-10T14:00:39.394909+0000 mgr.gibba045.orlgmj (mgr.34412) 674 : cluster [DBG] pgmap v368: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:41.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:00:40 gibba045 bash[25517]: cluster 2021-03-10T14:00:39.394909+0000 mgr.gibba045.orlgmj (mgr.34412) 674 : cluster [DBG] pgmap v368: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:43.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:42 gibba015 bash[29377]: cluster 2021-03-10T14:00:41.396670+0000 mgr.gibba045.orlgmj (mgr.34412) 675 : cluster [DBG] pgmap v369: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:43.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:00:42 gibba015 bash[30343]: cluster 2021-03-10T14:00:41.396670+0000 mgr.gibba045.orlgmj (mgr.34412) 675 : cluster [DBG] pgmap v369: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:43.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:00:42 gibba045 bash[25517]: cluster 2021-03-10T14:00:41.396670+0000 mgr.gibba045.orlgmj (mgr.34412) 675 : cluster [DBG] pgmap v369: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:45.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:44 gibba015 bash[29377]: cluster 2021-03-10T14:00:43.397627+0000 mgr.gibba045.orlgmj (mgr.34412) 676 : cluster [DBG] pgmap v370: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:45.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:00:44 gibba015 bash[30343]: cluster 2021-03-10T14:00:43.397627+0000 mgr.gibba045.orlgmj (mgr.34412) 676 : cluster [DBG] pgmap v370: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:45.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:00:44 gibba045 bash[25517]: cluster 2021-03-10T14:00:43.397627+0000 mgr.gibba045.orlgmj (mgr.34412) 676 : cluster [DBG] pgmap v370: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:47.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:46 gibba015 bash[29377]: cluster 2021-03-10T14:00:45.399249+0000 mgr.gibba045.orlgmj (mgr.34412) 677 : cluster [DBG] pgmap v371: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:47.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:00:46 gibba015 bash[30343]: cluster 2021-03-10T14:00:45.399249+0000 mgr.gibba045.orlgmj (mgr.34412) 677 : cluster [DBG] pgmap v371: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:47.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:00:46 gibba045 bash[25517]: cluster 2021-03-10T14:00:45.399249+0000 mgr.gibba045.orlgmj (mgr.34412) 677 : cluster [DBG] pgmap v371: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:49.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:48 gibba015 bash[29377]: cluster 2021-03-10T14:00:47.400991+0000 mgr.gibba045.orlgmj (mgr.34412) 678 : cluster [DBG] pgmap v372: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:49.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:00:48 gibba015 bash[30343]: cluster 2021-03-10T14:00:47.400991+0000 mgr.gibba045.orlgmj (mgr.34412) 678 : cluster [DBG] pgmap v372: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:49.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:00:48 gibba045 bash[25517]: cluster 2021-03-10T14:00:47.400991+0000 mgr.gibba045.orlgmj (mgr.34412) 678 : cluster [DBG] pgmap v372: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:51.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:50 gibba015 bash[29377]: cephadm 2021-03-10T14:00:49.313215+0000 mgr.gibba045.orlgmj (mgr.34412) 679 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:00:51.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:50 gibba015 bash[29377]: cluster 2021-03-10T14:00:49.402332+0000 mgr.gibba045.orlgmj (mgr.34412) 680 : cluster [DBG] pgmap v373: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:51.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:00:50 gibba015 bash[30343]: cephadm 2021-03-10T14:00:49.313215+0000 mgr.gibba045.orlgmj (mgr.34412) 679 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:00:51.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:00:50 gibba015 bash[30343]: cluster 2021-03-10T14:00:49.402332+0000 mgr.gibba045.orlgmj (mgr.34412) 680 : cluster [DBG] pgmap v373: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:51.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:00:50 gibba045 bash[25517]: cephadm 2021-03-10T14:00:49.313215+0000 mgr.gibba045.orlgmj (mgr.34412) 679 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:00:51.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:00:50 gibba045 bash[25517]: cluster 2021-03-10T14:00:49.402332+0000 mgr.gibba045.orlgmj (mgr.34412) 680 : cluster [DBG] pgmap v373: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:53.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:52 gibba015 bash[29377]: cluster 2021-03-10T14:00:51.404349+0000 mgr.gibba045.orlgmj (mgr.34412) 681 : cluster [DBG] pgmap v374: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:53.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:52 gibba015 bash[29377]: audit 2021-03-10T14:00:52.443196+0000 mon.c (mon.1) 253 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T14:00:53.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:52 gibba015 bash[29377]: audit 2021-03-10T14:00:52.443915+0000 mon.c (mon.1) 254 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T14:00:53.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:52 gibba015 bash[29377]: audit 2021-03-10T14:00:52.444391+0000 mon.a (mon.0) 630 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T14:00:53.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:52 gibba015 bash[29377]: audit 2021-03-10T14:00:52.444918+0000 mon.c (mon.1) 255 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:00:53.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:52 gibba015 bash[29377]: audit 2021-03-10T14:00:52.445682+0000 mon.a (mon.0) 631 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T14:00:53.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:52 gibba015 bash[29377]: audit 2021-03-10T14:00:52.446359+0000 mon.c (mon.1) 256 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:00:53.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:52 gibba015 bash[29377]: audit 2021-03-10T14:00:52.446571+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:00:53.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:52 gibba015 bash[29377]: audit 2021-03-10T14:00:52.447588+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:00:53.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:52 gibba015 bash[29377]: audit 2021-03-10T14:00:52.533588+0000 mon.c (mon.1) 257 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:00:53.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:52 gibba015 bash[29377]: audit 2021-03-10T14:00:52.534283+0000 mon.c (mon.1) 258 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:00:53.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:52 gibba015 bash[29377]: audit 2021-03-10T14:00:52.534735+0000 mon.a (mon.0) 634 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:00:53.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:52 gibba015 bash[29377]: audit 2021-03-10T14:00:52.535818+0000 mon.a (mon.0) 635 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:00:53.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:00:52 gibba015 bash[30343]: cluster 2021-03-10T14:00:51.404349+0000 mgr.gibba045.orlgmj (mgr.34412) 681 : cluster [DBG] pgmap v374: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:53.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:00:52 gibba015 bash[30343]: audit 2021-03-10T14:00:52.443196+0000 mon.c (mon.1) 253 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T14:00:53.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:00:52 gibba015 bash[30343]: audit 2021-03-10T14:00:52.443915+0000 mon.c (mon.1) 254 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T14:00:53.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:00:52 gibba015 bash[30343]: audit 2021-03-10T14:00:52.444391+0000 mon.a (mon.0) 630 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T14:00:53.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:00:52 gibba015 bash[30343]: audit 2021-03-10T14:00:52.444918+0000 mon.c (mon.1) 255 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:00:53.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:00:52 gibba015 bash[30343]: audit 2021-03-10T14:00:52.445682+0000 mon.a (mon.0) 631 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T14:00:53.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:00:52 gibba015 bash[30343]: audit 2021-03-10T14:00:52.446359+0000 mon.c (mon.1) 256 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:00:53.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:00:52 gibba015 bash[30343]: audit 2021-03-10T14:00:52.446571+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:00:53.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:00:52 gibba015 bash[30343]: audit 2021-03-10T14:00:52.447588+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:00:53.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:00:52 gibba015 bash[30343]: audit 2021-03-10T14:00:52.533588+0000 mon.c (mon.1) 257 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:00:53.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:00:52 gibba015 bash[30343]: audit 2021-03-10T14:00:52.534283+0000 mon.c (mon.1) 258 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:00:53.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:00:52 gibba015 bash[30343]: audit 2021-03-10T14:00:52.534735+0000 mon.a (mon.0) 634 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:00:53.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:00:52 gibba015 bash[30343]: audit 2021-03-10T14:00:52.535818+0000 mon.a (mon.0) 635 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:00:53.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:00:52 gibba045 bash[25517]: cluster 2021-03-10T14:00:51.404349+0000 mgr.gibba045.orlgmj (mgr.34412) 681 : cluster [DBG] pgmap v374: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:53.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:00:52 gibba045 bash[25517]: audit 2021-03-10T14:00:52.443196+0000 mon.c (mon.1) 253 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T14:00:53.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:00:52 gibba045 bash[25517]: audit 2021-03-10T14:00:52.443915+0000 mon.c (mon.1) 254 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T14:00:53.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:00:52 gibba045 bash[25517]: audit 2021-03-10T14:00:52.444391+0000 mon.a (mon.0) 630 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T14:00:53.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:00:52 gibba045 bash[25517]: audit 2021-03-10T14:00:52.444918+0000 mon.c (mon.1) 255 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:00:53.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:00:52 gibba045 bash[25517]: audit 2021-03-10T14:00:52.445682+0000 mon.a (mon.0) 631 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T14:00:53.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:00:52 gibba045 bash[25517]: audit 2021-03-10T14:00:52.446359+0000 mon.c (mon.1) 256 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:00:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:00:52 gibba045 bash[25517]: audit 2021-03-10T14:00:52.446571+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:00:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:00:52 gibba045 bash[25517]: audit 2021-03-10T14:00:52.447588+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:00:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:00:52 gibba045 bash[25517]: audit 2021-03-10T14:00:52.533588+0000 mon.c (mon.1) 257 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:00:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:00:52 gibba045 bash[25517]: audit 2021-03-10T14:00:52.534283+0000 mon.c (mon.1) 258 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:00:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:00:52 gibba045 bash[25517]: audit 2021-03-10T14:00:52.534735+0000 mon.a (mon.0) 634 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:00:53.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:00:52 gibba045 bash[25517]: audit 2021-03-10T14:00:52.535818+0000 mon.a (mon.0) 635 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:00:54.483 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:00:54.747 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:00:54.748 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (11m) 8m ago 17m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:00:54.748 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (16m) 6m ago 16m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:00:54.748 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (12m) 6m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:00:54.748 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (12m) 6m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:00:54.749 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (11m) 8m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:00:54.749 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (11m) 8m ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:00:54.749 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (10m) 6m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:00:54.749 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (10m) 8m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:00:54.750 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (17m) 8m ago 17m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:00:54.750 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (17m) 6m ago 17m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:00:54.750 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (9m) 8m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:00:54.750 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (9m) 8m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:00:54.751 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (9m) 8m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:00:54.751 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (8m) 8m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:00:54.751 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (8m) 6m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:00:54.751 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (7m) 6m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:00:54.752 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (7m) 6m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:00:54.752 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (6m) 6m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:00:54.752 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (16m) 6m ago 17m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:00:54.752 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 6m ago 15m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:00:55.003 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:00:55.004 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:00:55.004 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:00:55.004 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:00:55.005 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:00:55.005 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:00:55.005 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:00:55.005 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:00:55.006 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:00:55.006 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:00:55.006 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:00:55.006 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:00:55.006 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:00:55.007 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:00:55.007 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:00:55.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:54 gibba015 bash[29377]: cluster 2021-03-10T14:00:53.405457+0000 mgr.gibba045.orlgmj (mgr.34412) 682 : cluster [DBG] pgmap v375: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:55.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:00:54 gibba015 bash[30343]: cluster 2021-03-10T14:00:53.405457+0000 mgr.gibba045.orlgmj (mgr.34412) 682 : cluster [DBG] pgmap v375: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:55.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:00:54 gibba045 bash[25517]: cluster 2021-03-10T14:00:53.405457+0000 mgr.gibba045.orlgmj (mgr.34412) 682 : cluster [DBG] pgmap v375: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:56.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:55 gibba015 bash[29377]: audit 2021-03-10T14:00:54.475650+0000 mgr.gibba045.orlgmj (mgr.34412) 683 : audit [DBG] from='client.44520 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:00:56.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:55 gibba015 bash[29377]: audit 2021-03-10T14:00:54.707987+0000 mgr.gibba045.orlgmj (mgr.34412) 684 : audit [DBG] from='client.54514 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:00:56.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:55 gibba015 bash[29377]: audit 2021-03-10T14:00:55.001103+0000 mon.a (mon.0) 636 : audit [DBG] from='client.? 172.21.2.115:0/1127803894' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:00:56.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:00:55 gibba015 bash[30343]: audit 2021-03-10T14:00:54.475650+0000 mgr.gibba045.orlgmj (mgr.34412) 683 : audit [DBG] from='client.44520 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:00:56.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:00:55 gibba015 bash[30343]: audit 2021-03-10T14:00:54.707987+0000 mgr.gibba045.orlgmj (mgr.34412) 684 : audit [DBG] from='client.54514 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:00:56.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:00:55 gibba015 bash[30343]: audit 2021-03-10T14:00:55.001103+0000 mon.a (mon.0) 636 : audit [DBG] from='client.? 172.21.2.115:0/1127803894' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:00:56.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:00:55 gibba045 bash[25517]: audit 2021-03-10T14:00:54.475650+0000 mgr.gibba045.orlgmj (mgr.34412) 683 : audit [DBG] from='client.44520 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:00:56.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:00:55 gibba045 bash[25517]: audit 2021-03-10T14:00:54.707987+0000 mgr.gibba045.orlgmj (mgr.34412) 684 : audit [DBG] from='client.54514 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:00:56.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:00:55 gibba045 bash[25517]: audit 2021-03-10T14:00:55.001103+0000 mon.a (mon.0) 636 : audit [DBG] from='client.? 172.21.2.115:0/1127803894' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:00:57.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:56 gibba015 bash[29377]: cluster 2021-03-10T14:00:55.407118+0000 mgr.gibba045.orlgmj (mgr.34412) 685 : cluster [DBG] pgmap v376: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:57.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:00:56 gibba015 bash[30343]: cluster 2021-03-10T14:00:55.407118+0000 mgr.gibba045.orlgmj (mgr.34412) 685 : cluster [DBG] pgmap v376: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:57.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:00:56 gibba045 bash[25517]: cluster 2021-03-10T14:00:55.407118+0000 mgr.gibba045.orlgmj (mgr.34412) 685 : cluster [DBG] pgmap v376: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:59.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:00:58 gibba015 bash[29377]: cluster 2021-03-10T14:00:57.408757+0000 mgr.gibba045.orlgmj (mgr.34412) 686 : cluster [DBG] pgmap v377: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:59.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:00:58 gibba015 bash[30343]: cluster 2021-03-10T14:00:57.408757+0000 mgr.gibba045.orlgmj (mgr.34412) 686 : cluster [DBG] pgmap v377: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:59.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:00:58 gibba045 bash[25517]: cluster 2021-03-10T14:00:57.408757+0000 mgr.gibba045.orlgmj (mgr.34412) 686 : cluster [DBG] pgmap v377: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:01.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:01:00 gibba015 bash[29377]: cluster 2021-03-10T14:00:59.410000+0000 mgr.gibba045.orlgmj (mgr.34412) 687 : cluster [DBG] pgmap v378: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:01.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:01:00 gibba015 bash[30343]: cluster 2021-03-10T14:00:59.410000+0000 mgr.gibba045.orlgmj (mgr.34412) 687 : cluster [DBG] pgmap v378: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:01.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:01:00 gibba045 bash[25517]: cluster 2021-03-10T14:00:59.410000+0000 mgr.gibba045.orlgmj (mgr.34412) 687 : cluster [DBG] pgmap v378: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:03.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:01:02 gibba015 bash[29377]: cluster 2021-03-10T14:01:01.411968+0000 mgr.gibba045.orlgmj (mgr.34412) 688 : cluster [DBG] pgmap v379: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:03.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:01:02 gibba015 bash[30343]: cluster 2021-03-10T14:01:01.411968+0000 mgr.gibba045.orlgmj (mgr.34412) 688 : cluster [DBG] pgmap v379: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:03.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:01:02 gibba045 bash[25517]: cluster 2021-03-10T14:01:01.411968+0000 mgr.gibba045.orlgmj (mgr.34412) 688 : cluster [DBG] pgmap v379: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:05.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:01:04 gibba015 bash[29377]: cluster 2021-03-10T14:01:03.413160+0000 mgr.gibba045.orlgmj (mgr.34412) 689 : cluster [DBG] pgmap v380: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:05.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:01:04 gibba015 bash[29377]: audit 2021-03-10T14:01:04.327102+0000 mon.c (mon.1) 259 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:01:05.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:01:04 gibba015 bash[29377]: audit 2021-03-10T14:01:04.559402+0000 mon.a (mon.0) 637 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:01:05.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:01:04 gibba015 bash[29377]: audit 2021-03-10T14:01:04.563280+0000 mon.c (mon.1) 260 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:01:05.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:01:04 gibba015 bash[29377]: audit 2021-03-10T14:01:04.564539+0000 mon.c (mon.1) 261 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:01:05.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:01:04 gibba015 bash[29377]: audit 2021-03-10T14:01:04.566101+0000 mon.c (mon.1) 262 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:01:05.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:01:04 gibba015 bash[29377]: audit 2021-03-10T14:01:04.567735+0000 mon.c (mon.1) 263 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:01:05.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:01:04 gibba015 bash[29377]: audit 2021-03-10T14:01:04.571234+0000 mon.c (mon.1) 264 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:01:05.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:01:04 gibba015 bash[29377]: audit 2021-03-10T14:01:04.573158+0000 mon.c (mon.1) 265 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:01:05.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:01:04 gibba015 bash[30343]: cluster 2021-03-10T14:01:03.413160+0000 mgr.gibba045.orlgmj (mgr.34412) 689 : cluster [DBG] pgmap v380: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:05.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:01:04 gibba015 bash[30343]: audit 2021-03-10T14:01:04.327102+0000 mon.c (mon.1) 259 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:01:05.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:01:04 gibba015 bash[30343]: audit 2021-03-10T14:01:04.559402+0000 mon.a (mon.0) 637 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:01:05.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:01:04 gibba015 bash[30343]: audit 2021-03-10T14:01:04.563280+0000 mon.c (mon.1) 260 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:01:05.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:01:04 gibba015 bash[30343]: audit 2021-03-10T14:01:04.564539+0000 mon.c (mon.1) 261 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:01:05.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:01:04 gibba015 bash[30343]: audit 2021-03-10T14:01:04.566101+0000 mon.c (mon.1) 262 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:01:05.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:01:04 gibba015 bash[30343]: audit 2021-03-10T14:01:04.567735+0000 mon.c (mon.1) 263 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:01:05.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:01:04 gibba015 bash[30343]: audit 2021-03-10T14:01:04.571234+0000 mon.c (mon.1) 264 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:01:05.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:01:04 gibba015 bash[30343]: audit 2021-03-10T14:01:04.573158+0000 mon.c (mon.1) 265 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:01:05.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:01:04 gibba045 bash[25517]: cluster 2021-03-10T14:01:03.413160+0000 mgr.gibba045.orlgmj (mgr.34412) 689 : cluster [DBG] pgmap v380: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:05.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:01:04 gibba045 bash[25517]: audit 2021-03-10T14:01:04.327102+0000 mon.c (mon.1) 259 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:01:05.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:01:04 gibba045 bash[25517]: audit 2021-03-10T14:01:04.559402+0000 mon.a (mon.0) 637 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:01:05.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:01:04 gibba045 bash[25517]: audit 2021-03-10T14:01:04.563280+0000 mon.c (mon.1) 260 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:01:05.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:01:04 gibba045 bash[25517]: audit 2021-03-10T14:01:04.564539+0000 mon.c (mon.1) 261 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:01:05.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:01:04 gibba045 bash[25517]: audit 2021-03-10T14:01:04.566101+0000 mon.c (mon.1) 262 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:01:05.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:01:04 gibba045 bash[25517]: audit 2021-03-10T14:01:04.567735+0000 mon.c (mon.1) 263 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:01:05.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:01:04 gibba045 bash[25517]: audit 2021-03-10T14:01:04.571234+0000 mon.c (mon.1) 264 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:01:05.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:01:04 gibba045 bash[25517]: audit 2021-03-10T14:01:04.573158+0000 mon.c (mon.1) 265 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:01:06.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:01:05 gibba015 bash[29377]: cephadm 2021-03-10T14:01:04.335364+0000 mgr.gibba045.orlgmj (mgr.34412) 690 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:01:06.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:01:05 gibba015 bash[29377]: cephadm 2021-03-10T14:01:04.337039+0000 mgr.gibba045.orlgmj (mgr.34412) 691 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:01:06.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:01:05 gibba015 bash[29377]: cephadm 2021-03-10T14:01:04.565438+0000 mgr.gibba045.orlgmj (mgr.34412) 692 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:01:06.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:01:05 gibba015 bash[29377]: cephadm 2021-03-10T14:01:04.567205+0000 mgr.gibba045.orlgmj (mgr.34412) 693 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:01:06.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:01:05 gibba015 bash[29377]: cephadm 2021-03-10T14:01:04.568356+0000 mgr.gibba045.orlgmj (mgr.34412) 694 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:01:06.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:01:05 gibba015 bash[29377]: cephadm 2021-03-10T14:01:04.568403+0000 mgr.gibba045.orlgmj (mgr.34412) 695 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:01:06.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:01:05 gibba015 bash[29377]: cephadm 2021-03-10T14:01:04.570237+0000 mgr.gibba045.orlgmj (mgr.34412) 696 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:01:06.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:01:05 gibba015 bash[29377]: cephadm 2021-03-10T14:01:04.570299+0000 mgr.gibba045.orlgmj (mgr.34412) 697 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:01:06.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:01:05 gibba015 bash[29377]: cephadm 2021-03-10T14:01:04.571642+0000 mgr.gibba045.orlgmj (mgr.34412) 698 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:01:06.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:01:05 gibba015 bash[29377]: cephadm 2021-03-10T14:01:04.573606+0000 mgr.gibba045.orlgmj (mgr.34412) 699 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:01:06.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:01:05 gibba015 bash[29377]: cephadm 2021-03-10T14:01:04.573646+0000 mgr.gibba045.orlgmj (mgr.34412) 700 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:01:06.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:01:05 gibba015 bash[29377]: cephadm 2021-03-10T14:01:04.575321+0000 mgr.gibba045.orlgmj (mgr.34412) 701 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:01:06.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:01:05 gibba015 bash[29377]: cephadm 2021-03-10T14:01:04.575673+0000 mgr.gibba045.orlgmj (mgr.34412) 702 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:01:06.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:01:05 gibba015 bash[29377]: cephadm 2021-03-10T14:01:04.577153+0000 mgr.gibba045.orlgmj (mgr.34412) 703 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:01:06.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:01:05 gibba015 bash[29377]: cephadm 2021-03-10T14:01:04.577197+0000 mgr.gibba045.orlgmj (mgr.34412) 704 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:01:06.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:01:05 gibba015 bash[29377]: cephadm 2021-03-10T14:01:04.577317+0000 mgr.gibba045.orlgmj (mgr.34412) 705 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:01:06.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:01:05 gibba015 bash[30343]: cephadm 2021-03-10T14:01:04.335364+0000 mgr.gibba045.orlgmj (mgr.34412) 690 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:01:06.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:01:05 gibba015 bash[30343]: cephadm 2021-03-10T14:01:04.337039+0000 mgr.gibba045.orlgmj (mgr.34412) 691 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:01:06.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:01:05 gibba015 bash[30343]: cephadm 2021-03-10T14:01:04.565438+0000 mgr.gibba045.orlgmj (mgr.34412) 692 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:01:06.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:01:05 gibba015 bash[30343]: cephadm 2021-03-10T14:01:04.567205+0000 mgr.gibba045.orlgmj (mgr.34412) 693 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:01:06.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:01:05 gibba015 bash[30343]: cephadm 2021-03-10T14:01:04.568356+0000 mgr.gibba045.orlgmj (mgr.34412) 694 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:01:06.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:01:05 gibba015 bash[30343]: cephadm 2021-03-10T14:01:04.568403+0000 mgr.gibba045.orlgmj (mgr.34412) 695 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:01:06.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:01:05 gibba015 bash[30343]: cephadm 2021-03-10T14:01:04.570237+0000 mgr.gibba045.orlgmj (mgr.34412) 696 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:01:06.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:01:05 gibba015 bash[30343]: cephadm 2021-03-10T14:01:04.570299+0000 mgr.gibba045.orlgmj (mgr.34412) 697 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:01:06.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:01:05 gibba015 bash[30343]: cephadm 2021-03-10T14:01:04.571642+0000 mgr.gibba045.orlgmj (mgr.34412) 698 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:01:06.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:01:05 gibba015 bash[30343]: cephadm 2021-03-10T14:01:04.573606+0000 mgr.gibba045.orlgmj (mgr.34412) 699 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:01:06.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:01:05 gibba015 bash[30343]: cephadm 2021-03-10T14:01:04.573646+0000 mgr.gibba045.orlgmj (mgr.34412) 700 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:01:06.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:01:05 gibba015 bash[30343]: cephadm 2021-03-10T14:01:04.575321+0000 mgr.gibba045.orlgmj (mgr.34412) 701 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:01:06.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:01:05 gibba015 bash[30343]: cephadm 2021-03-10T14:01:04.575673+0000 mgr.gibba045.orlgmj (mgr.34412) 702 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:01:06.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:01:05 gibba015 bash[30343]: cephadm 2021-03-10T14:01:04.577153+0000 mgr.gibba045.orlgmj (mgr.34412) 703 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:01:06.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:01:05 gibba015 bash[30343]: cephadm 2021-03-10T14:01:04.577197+0000 mgr.gibba045.orlgmj (mgr.34412) 704 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:01:06.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:01:05 gibba015 bash[30343]: cephadm 2021-03-10T14:01:04.577317+0000 mgr.gibba045.orlgmj (mgr.34412) 705 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:01:06.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:01:05 gibba045 bash[25517]: cephadm 2021-03-10T14:01:04.335364+0000 mgr.gibba045.orlgmj (mgr.34412) 690 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:01:06.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:01:05 gibba045 bash[25517]: cephadm 2021-03-10T14:01:04.337039+0000 mgr.gibba045.orlgmj (mgr.34412) 691 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:01:06.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:01:05 gibba045 bash[25517]: cephadm 2021-03-10T14:01:04.565438+0000 mgr.gibba045.orlgmj (mgr.34412) 692 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:01:06.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:01:05 gibba045 bash[25517]: cephadm 2021-03-10T14:01:04.567205+0000 mgr.gibba045.orlgmj (mgr.34412) 693 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:01:06.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:01:05 gibba045 bash[25517]: cephadm 2021-03-10T14:01:04.568356+0000 mgr.gibba045.orlgmj (mgr.34412) 694 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:01:06.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:01:05 gibba045 bash[25517]: cephadm 2021-03-10T14:01:04.568403+0000 mgr.gibba045.orlgmj (mgr.34412) 695 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:01:06.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:01:05 gibba045 bash[25517]: cephadm 2021-03-10T14:01:04.570237+0000 mgr.gibba045.orlgmj (mgr.34412) 696 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:01:06.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:01:05 gibba045 bash[25517]: cephadm 2021-03-10T14:01:04.570299+0000 mgr.gibba045.orlgmj (mgr.34412) 697 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:01:06.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:01:05 gibba045 bash[25517]: cephadm 2021-03-10T14:01:04.571642+0000 mgr.gibba045.orlgmj (mgr.34412) 698 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:01:06.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:01:05 gibba045 bash[25517]: cephadm 2021-03-10T14:01:04.573606+0000 mgr.gibba045.orlgmj (mgr.34412) 699 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:01:06.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:01:05 gibba045 bash[25517]: cephadm 2021-03-10T14:01:04.573646+0000 mgr.gibba045.orlgmj (mgr.34412) 700 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:01:06.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:01:05 gibba045 bash[25517]: cephadm 2021-03-10T14:01:04.575321+0000 mgr.gibba045.orlgmj (mgr.34412) 701 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:01:06.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:01:05 gibba045 bash[25517]: cephadm 2021-03-10T14:01:04.575673+0000 mgr.gibba045.orlgmj (mgr.34412) 702 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:01:06.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:01:05 gibba045 bash[25517]: cephadm 2021-03-10T14:01:04.577153+0000 mgr.gibba045.orlgmj (mgr.34412) 703 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:01:06.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:01:05 gibba045 bash[25517]: cephadm 2021-03-10T14:01:04.577197+0000 mgr.gibba045.orlgmj (mgr.34412) 704 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:01:06.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:01:05 gibba045 bash[25517]: cephadm 2021-03-10T14:01:04.577317+0000 mgr.gibba045.orlgmj (mgr.34412) 705 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:01:07.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:01:06 gibba015 bash[29377]: cluster 2021-03-10T14:01:05.414563+0000 mgr.gibba045.orlgmj (mgr.34412) 706 : cluster [DBG] pgmap v381: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:07.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:01:06 gibba015 bash[30343]: cluster 2021-03-10T14:01:05.414563+0000 mgr.gibba045.orlgmj (mgr.34412) 706 : cluster [DBG] pgmap v381: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:07.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:01:06 gibba045 bash[25517]: cluster 2021-03-10T14:01:05.414563+0000 mgr.gibba045.orlgmj (mgr.34412) 706 : cluster [DBG] pgmap v381: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:09.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:01:08 gibba015 bash[29377]: cluster 2021-03-10T14:01:07.416084+0000 mgr.gibba045.orlgmj (mgr.34412) 707 : cluster [DBG] pgmap v382: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:09.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:01:08 gibba015 bash[30343]: cluster 2021-03-10T14:01:07.416084+0000 mgr.gibba045.orlgmj (mgr.34412) 707 : cluster [DBG] pgmap v382: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:09.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:01:08 gibba045 bash[25517]: cluster 2021-03-10T14:01:07.416084+0000 mgr.gibba045.orlgmj (mgr.34412) 707 : cluster [DBG] pgmap v382: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:11.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:01:10 gibba045 bash[25517]: cluster 2021-03-10T14:01:09.417265+0000 mgr.gibba045.orlgmj (mgr.34412) 708 : cluster [DBG] pgmap v383: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:11.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:01:10 gibba015 bash[29377]: cluster 2021-03-10T14:01:09.417265+0000 mgr.gibba045.orlgmj (mgr.34412) 708 : cluster [DBG] pgmap v383: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:11.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:01:10 gibba015 bash[30343]: cluster 2021-03-10T14:01:09.417265+0000 mgr.gibba045.orlgmj (mgr.34412) 708 : cluster [DBG] pgmap v383: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:13.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:01:12 gibba045 bash[25517]: cluster 2021-03-10T14:01:11.419002+0000 mgr.gibba045.orlgmj (mgr.34412) 709 : cluster [DBG] pgmap v384: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:13.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:01:12 gibba015 bash[29377]: cluster 2021-03-10T14:01:11.419002+0000 mgr.gibba045.orlgmj (mgr.34412) 709 : cluster [DBG] pgmap v384: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:13.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:01:12 gibba015 bash[30343]: cluster 2021-03-10T14:01:11.419002+0000 mgr.gibba045.orlgmj (mgr.34412) 709 : cluster [DBG] pgmap v384: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:15.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:01:14 gibba045 bash[25517]: cluster 2021-03-10T14:01:13.420070+0000 mgr.gibba045.orlgmj (mgr.34412) 710 : cluster [DBG] pgmap v385: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:15.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:01:14 gibba015 bash[29377]: cluster 2021-03-10T14:01:13.420070+0000 mgr.gibba045.orlgmj (mgr.34412) 710 : cluster [DBG] pgmap v385: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:15.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:01:14 gibba015 bash[30343]: cluster 2021-03-10T14:01:13.420070+0000 mgr.gibba045.orlgmj (mgr.34412) 710 : cluster [DBG] pgmap v385: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:17.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:01:17 gibba045 bash[25517]: cluster 2021-03-10T14:01:15.421598+0000 mgr.gibba045.orlgmj (mgr.34412) 711 : cluster [DBG] pgmap v386: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:17.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:01:17 gibba015 bash[29377]: cluster 2021-03-10T14:01:15.421598+0000 mgr.gibba045.orlgmj (mgr.34412) 711 : cluster [DBG] pgmap v386: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:17.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:01:17 gibba015 bash[30343]: cluster 2021-03-10T14:01:15.421598+0000 mgr.gibba045.orlgmj (mgr.34412) 711 : cluster [DBG] pgmap v386: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:19.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:01:19 gibba045 bash[25517]: cluster 2021-03-10T14:01:17.423183+0000 mgr.gibba045.orlgmj (mgr.34412) 712 : cluster [DBG] pgmap v387: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:19.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:01:19 gibba015 bash[29377]: cluster 2021-03-10T14:01:17.423183+0000 mgr.gibba045.orlgmj (mgr.34412) 712 : cluster [DBG] pgmap v387: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:19.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:01:19 gibba015 bash[30343]: cluster 2021-03-10T14:01:17.423183+0000 mgr.gibba045.orlgmj (mgr.34412) 712 : cluster [DBG] pgmap v387: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:21.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:01:21 gibba045 bash[25517]: cluster 2021-03-10T14:01:19.424705+0000 mgr.gibba045.orlgmj (mgr.34412) 713 : cluster [DBG] pgmap v388: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:21.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:01:21 gibba045 bash[25517]: cephadm 2021-03-10T14:01:19.589220+0000 mgr.gibba045.orlgmj (mgr.34412) 714 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:01:21.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:01:21 gibba015 bash[29377]: cluster 2021-03-10T14:01:19.424705+0000 mgr.gibba045.orlgmj (mgr.34412) 713 : cluster [DBG] pgmap v388: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:21.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:01:21 gibba015 bash[29377]: cephadm 2021-03-10T14:01:19.589220+0000 mgr.gibba045.orlgmj (mgr.34412) 714 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:01:21.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:01:21 gibba015 bash[30343]: cluster 2021-03-10T14:01:19.424705+0000 mgr.gibba045.orlgmj (mgr.34412) 713 : cluster [DBG] pgmap v388: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:21.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:01:21 gibba015 bash[30343]: cephadm 2021-03-10T14:01:19.589220+0000 mgr.gibba045.orlgmj (mgr.34412) 714 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:01:23.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:01:23 gibba045 bash[25517]: cluster 2021-03-10T14:01:21.426643+0000 mgr.gibba045.orlgmj (mgr.34412) 715 : cluster [DBG] pgmap v389: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:23.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:01:23 gibba015 bash[29377]: cluster 2021-03-10T14:01:21.426643+0000 mgr.gibba045.orlgmj (mgr.34412) 715 : cluster [DBG] pgmap v389: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:23.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:01:23 gibba015 bash[30343]: cluster 2021-03-10T14:01:21.426643+0000 mgr.gibba045.orlgmj (mgr.34412) 715 : cluster [DBG] pgmap v389: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:25.252 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:01:25.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:01:25 gibba045 bash[25517]: cluster 2021-03-10T14:01:23.427846+0000 mgr.gibba045.orlgmj (mgr.34412) 716 : cluster [DBG] pgmap v390: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:25.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:01:25 gibba015 bash[29377]: cluster 2021-03-10T14:01:23.427846+0000 mgr.gibba045.orlgmj (mgr.34412) 716 : cluster [DBG] pgmap v390: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:25.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:01:25 gibba015 bash[30343]: cluster 2021-03-10T14:01:23.427846+0000 mgr.gibba045.orlgmj (mgr.34412) 716 : cluster [DBG] pgmap v390: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:25.479 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:01:25.480 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (12m) 9m ago 17m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:01:25.480 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (17m) 7m ago 17m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:01:25.480 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (12m) 7m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:01:25.480 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (12m) 7m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:01:25.481 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (11m) 9m ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:01:25.481 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (11m) 9m ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:01:25.481 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (11m) 7m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:01:25.481 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (11m) 9m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:01:25.482 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (17m) 9m ago 17m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:01:25.482 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (17m) 7m ago 17m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:01:25.482 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (10m) 9m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:01:25.482 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (10m) 9m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:01:25.483 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (9m) 9m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:01:25.483 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (9m) 9m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:01:25.483 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (8m) 7m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:01:25.483 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (8m) 7m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:01:25.484 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (7m) 7m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:01:25.484 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (7m) 7m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:01:25.484 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (17m) 7m ago 17m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:01:25.484 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 7m ago 15m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:01:25.729 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:01:25.729 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:01:25.730 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:01:25.730 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:01:25.730 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:01:25.730 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:01:25.731 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:01:25.731 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:01:25.731 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:01:25.731 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:01:25.731 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:01:25.732 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:01:25.732 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:01:25.732 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:01:25.732 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:01:26.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:01:26 gibba045 bash[25517]: audit 2021-03-10T14:01:25.242830+0000 mgr.gibba045.orlgmj (mgr.34412) 717 : audit [DBG] from='client.44538 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:01:26.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:01:26 gibba045 bash[25517]: cluster 2021-03-10T14:01:25.429531+0000 mgr.gibba045.orlgmj (mgr.34412) 718 : cluster [DBG] pgmap v391: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:26.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:01:26 gibba045 bash[25517]: audit 2021-03-10T14:01:25.468168+0000 mgr.gibba045.orlgmj (mgr.34412) 719 : audit [DBG] from='client.44544 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:01:26.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:01:26 gibba045 bash[25517]: audit 2021-03-10T14:01:25.726557+0000 mon.c (mon.1) 266 : audit [DBG] from='client.? 172.21.2.115:0/2321540121' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:01:26.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:01:26 gibba015 bash[29377]: audit 2021-03-10T14:01:25.242830+0000 mgr.gibba045.orlgmj (mgr.34412) 717 : audit [DBG] from='client.44538 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:01:26.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:01:26 gibba015 bash[29377]: cluster 2021-03-10T14:01:25.429531+0000 mgr.gibba045.orlgmj (mgr.34412) 718 : cluster [DBG] pgmap v391: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:26.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:01:26 gibba015 bash[29377]: audit 2021-03-10T14:01:25.468168+0000 mgr.gibba045.orlgmj (mgr.34412) 719 : audit [DBG] from='client.44544 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:01:26.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:01:26 gibba015 bash[29377]: audit 2021-03-10T14:01:25.726557+0000 mon.c (mon.1) 266 : audit [DBG] from='client.? 172.21.2.115:0/2321540121' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:01:26.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:01:26 gibba015 bash[30343]: audit 2021-03-10T14:01:25.242830+0000 mgr.gibba045.orlgmj (mgr.34412) 717 : audit [DBG] from='client.44538 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:01:26.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:01:26 gibba015 bash[30343]: cluster 2021-03-10T14:01:25.429531+0000 mgr.gibba045.orlgmj (mgr.34412) 718 : cluster [DBG] pgmap v391: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:26.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:01:26 gibba015 bash[30343]: audit 2021-03-10T14:01:25.468168+0000 mgr.gibba045.orlgmj (mgr.34412) 719 : audit [DBG] from='client.44544 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:01:26.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:01:26 gibba015 bash[30343]: audit 2021-03-10T14:01:25.726557+0000 mon.c (mon.1) 266 : audit [DBG] from='client.? 172.21.2.115:0/2321540121' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:01:28.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:01:28 gibba015 bash[29377]: cluster 2021-03-10T14:01:27.431264+0000 mgr.gibba045.orlgmj (mgr.34412) 720 : cluster [DBG] pgmap v392: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:28.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:01:28 gibba015 bash[30343]: cluster 2021-03-10T14:01:27.431264+0000 mgr.gibba045.orlgmj (mgr.34412) 720 : cluster [DBG] pgmap v392: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:29.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:01:28 gibba045 bash[25517]: cluster 2021-03-10T14:01:27.431264+0000 mgr.gibba045.orlgmj (mgr.34412) 720 : cluster [DBG] pgmap v392: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:30.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:01:30 gibba015 bash[29377]: cluster 2021-03-10T14:01:29.432619+0000 mgr.gibba045.orlgmj (mgr.34412) 721 : cluster [DBG] pgmap v393: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:30.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:01:30 gibba015 bash[30343]: cluster 2021-03-10T14:01:29.432619+0000 mgr.gibba045.orlgmj (mgr.34412) 721 : cluster [DBG] pgmap v393: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:31.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:01:30 gibba045 bash[25517]: cluster 2021-03-10T14:01:29.432619+0000 mgr.gibba045.orlgmj (mgr.34412) 721 : cluster [DBG] pgmap v393: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:32.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:01:32 gibba015 bash[29377]: cluster 2021-03-10T14:01:31.434589+0000 mgr.gibba045.orlgmj (mgr.34412) 722 : cluster [DBG] pgmap v394: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:32.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:01:32 gibba015 bash[30343]: cluster 2021-03-10T14:01:31.434589+0000 mgr.gibba045.orlgmj (mgr.34412) 722 : cluster [DBG] pgmap v394: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:33.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:01:32 gibba045 bash[25517]: cluster 2021-03-10T14:01:31.434589+0000 mgr.gibba045.orlgmj (mgr.34412) 722 : cluster [DBG] pgmap v394: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:34.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:01:34 gibba015 bash[29377]: cluster 2021-03-10T14:01:33.435739+0000 mgr.gibba045.orlgmj (mgr.34412) 723 : cluster [DBG] pgmap v395: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:34.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:01:34 gibba015 bash[30343]: cluster 2021-03-10T14:01:33.435739+0000 mgr.gibba045.orlgmj (mgr.34412) 723 : cluster [DBG] pgmap v395: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:35.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:01:34 gibba045 bash[25517]: cluster 2021-03-10T14:01:33.435739+0000 mgr.gibba045.orlgmj (mgr.34412) 723 : cluster [DBG] pgmap v395: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:35.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:01:35 gibba015 bash[29377]: cephadm 2021-03-10T14:01:34.601251+0000 mgr.gibba045.orlgmj (mgr.34412) 724 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:01:35.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:01:35 gibba015 bash[30343]: cephadm 2021-03-10T14:01:34.601251+0000 mgr.gibba045.orlgmj (mgr.34412) 724 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:01:36.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:01:35 gibba045 bash[25517]: cephadm 2021-03-10T14:01:34.601251+0000 mgr.gibba045.orlgmj (mgr.34412) 724 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:01:36.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:01:36 gibba015 bash[29377]: cluster 2021-03-10T14:01:35.437378+0000 mgr.gibba045.orlgmj (mgr.34412) 725 : cluster [DBG] pgmap v396: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:36.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:01:36 gibba015 bash[30343]: cluster 2021-03-10T14:01:35.437378+0000 mgr.gibba045.orlgmj (mgr.34412) 725 : cluster [DBG] pgmap v396: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:37.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:01:36 gibba045 bash[25517]: cluster 2021-03-10T14:01:35.437378+0000 mgr.gibba045.orlgmj (mgr.34412) 725 : cluster [DBG] pgmap v396: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:38.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:01:38 gibba015 bash[29377]: cluster 2021-03-10T14:01:37.439210+0000 mgr.gibba045.orlgmj (mgr.34412) 726 : cluster [DBG] pgmap v397: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:38.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:01:38 gibba015 bash[30343]: cluster 2021-03-10T14:01:37.439210+0000 mgr.gibba045.orlgmj (mgr.34412) 726 : cluster [DBG] pgmap v397: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:39.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:01:38 gibba045 bash[25517]: cluster 2021-03-10T14:01:37.439210+0000 mgr.gibba045.orlgmj (mgr.34412) 726 : cluster [DBG] pgmap v397: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:40.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:01:40 gibba015 bash[29377]: cluster 2021-03-10T14:01:39.440710+0000 mgr.gibba045.orlgmj (mgr.34412) 727 : cluster [DBG] pgmap v398: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:40.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:01:40 gibba015 bash[30343]: cluster 2021-03-10T14:01:39.440710+0000 mgr.gibba045.orlgmj (mgr.34412) 727 : cluster [DBG] pgmap v398: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:41.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:01:40 gibba045 bash[25517]: cluster 2021-03-10T14:01:39.440710+0000 mgr.gibba045.orlgmj (mgr.34412) 727 : cluster [DBG] pgmap v398: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:43.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:01:42 gibba045 bash[25517]: cluster 2021-03-10T14:01:41.442457+0000 mgr.gibba045.orlgmj (mgr.34412) 728 : cluster [DBG] pgmap v399: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:43.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:01:42 gibba015 bash[29377]: cluster 2021-03-10T14:01:41.442457+0000 mgr.gibba045.orlgmj (mgr.34412) 728 : cluster [DBG] pgmap v399: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:43.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:01:42 gibba015 bash[30343]: cluster 2021-03-10T14:01:41.442457+0000 mgr.gibba045.orlgmj (mgr.34412) 728 : cluster [DBG] pgmap v399: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:45.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:01:44 gibba045 bash[25517]: cluster 2021-03-10T14:01:43.443542+0000 mgr.gibba045.orlgmj (mgr.34412) 729 : cluster [DBG] pgmap v400: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:45.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:01:44 gibba015 bash[29377]: cluster 2021-03-10T14:01:43.443542+0000 mgr.gibba045.orlgmj (mgr.34412) 729 : cluster [DBG] pgmap v400: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:45.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:01:44 gibba015 bash[30343]: cluster 2021-03-10T14:01:43.443542+0000 mgr.gibba045.orlgmj (mgr.34412) 729 : cluster [DBG] pgmap v400: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:47.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:01:46 gibba045 bash[25517]: cluster 2021-03-10T14:01:45.445113+0000 mgr.gibba045.orlgmj (mgr.34412) 730 : cluster [DBG] pgmap v401: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:47.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:01:46 gibba015 bash[29377]: cluster 2021-03-10T14:01:45.445113+0000 mgr.gibba045.orlgmj (mgr.34412) 730 : cluster [DBG] pgmap v401: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:47.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:01:46 gibba015 bash[30343]: cluster 2021-03-10T14:01:45.445113+0000 mgr.gibba045.orlgmj (mgr.34412) 730 : cluster [DBG] pgmap v401: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:49.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:01:48 gibba045 bash[25517]: cluster 2021-03-10T14:01:47.446717+0000 mgr.gibba045.orlgmj (mgr.34412) 731 : cluster [DBG] pgmap v402: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:49.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:01:48 gibba015 bash[29377]: cluster 2021-03-10T14:01:47.446717+0000 mgr.gibba045.orlgmj (mgr.34412) 731 : cluster [DBG] pgmap v402: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:49.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:01:48 gibba015 bash[30343]: cluster 2021-03-10T14:01:47.446717+0000 mgr.gibba045.orlgmj (mgr.34412) 731 : cluster [DBG] pgmap v402: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:51.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:01:50 gibba045 bash[25517]: cluster 2021-03-10T14:01:49.447969+0000 mgr.gibba045.orlgmj (mgr.34412) 732 : cluster [DBG] pgmap v403: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:51.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:01:50 gibba045 bash[25517]: cephadm 2021-03-10T14:01:49.617261+0000 mgr.gibba045.orlgmj (mgr.34412) 733 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:01:51.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:01:50 gibba015 bash[29377]: cluster 2021-03-10T14:01:49.447969+0000 mgr.gibba045.orlgmj (mgr.34412) 732 : cluster [DBG] pgmap v403: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:51.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:01:50 gibba015 bash[29377]: cephadm 2021-03-10T14:01:49.617261+0000 mgr.gibba045.orlgmj (mgr.34412) 733 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:01:51.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:01:50 gibba015 bash[30343]: cluster 2021-03-10T14:01:49.447969+0000 mgr.gibba045.orlgmj (mgr.34412) 732 : cluster [DBG] pgmap v403: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:51.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:01:50 gibba015 bash[30343]: cephadm 2021-03-10T14:01:49.617261+0000 mgr.gibba045.orlgmj (mgr.34412) 733 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:01:53.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:01:52 gibba045 bash[25517]: cluster 2021-03-10T14:01:51.449692+0000 mgr.gibba045.orlgmj (mgr.34412) 734 : cluster [DBG] pgmap v404: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:53.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:01:52 gibba045 bash[25517]: audit 2021-03-10T14:01:52.454598+0000 mon.c (mon.1) 267 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T14:01:53.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:01:52 gibba045 bash[25517]: audit 2021-03-10T14:01:52.455343+0000 mon.c (mon.1) 268 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:01:53.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:01:52 gibba045 bash[25517]: audit 2021-03-10T14:01:52.455956+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T14:01:53.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:01:52 gibba045 bash[25517]: audit 2021-03-10T14:01:52.456483+0000 mon.c (mon.1) 269 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:01:53.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:01:52 gibba045 bash[25517]: audit 2021-03-10T14:01:52.457938+0000 mon.c (mon.1) 270 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:01:53.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:01:52 gibba045 bash[25517]: audit 2021-03-10T14:01:52.458619+0000 mon.a (mon.0) 639 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:01:53.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:01:52 gibba045 bash[25517]: audit 2021-03-10T14:01:52.459694+0000 mon.a (mon.0) 640 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:01:53.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:01:52 gibba045 bash[25517]: audit 2021-03-10T14:01:52.459898+0000 mon.a (mon.0) 641 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:01:53.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:01:52 gibba045 bash[25517]: audit 2021-03-10T14:01:52.539426+0000 mon.c (mon.1) 271 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:01:53.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:01:52 gibba045 bash[25517]: audit 2021-03-10T14:01:52.540084+0000 mon.c (mon.1) 272 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:01:53.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:01:52 gibba045 bash[25517]: audit 2021-03-10T14:01:52.540667+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:01:53.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:01:52 gibba045 bash[25517]: audit 2021-03-10T14:01:52.542023+0000 mon.a (mon.0) 643 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:01:53.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:01:52 gibba015 bash[29377]: cluster 2021-03-10T14:01:51.449692+0000 mgr.gibba045.orlgmj (mgr.34412) 734 : cluster [DBG] pgmap v404: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:53.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:01:52 gibba015 bash[29377]: audit 2021-03-10T14:01:52.454598+0000 mon.c (mon.1) 267 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T14:01:53.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:01:52 gibba015 bash[29377]: audit 2021-03-10T14:01:52.455343+0000 mon.c (mon.1) 268 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:01:53.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:01:52 gibba015 bash[29377]: audit 2021-03-10T14:01:52.455956+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T14:01:53.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:01:52 gibba015 bash[29377]: audit 2021-03-10T14:01:52.456483+0000 mon.c (mon.1) 269 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:01:53.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:01:52 gibba015 bash[29377]: audit 2021-03-10T14:01:52.457938+0000 mon.c (mon.1) 270 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:01:53.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:01:52 gibba015 bash[29377]: audit 2021-03-10T14:01:52.458619+0000 mon.a (mon.0) 639 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:01:53.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:01:52 gibba015 bash[29377]: audit 2021-03-10T14:01:52.459694+0000 mon.a (mon.0) 640 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:01:53.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:01:52 gibba015 bash[29377]: audit 2021-03-10T14:01:52.459898+0000 mon.a (mon.0) 641 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:01:53.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:01:52 gibba015 bash[29377]: audit 2021-03-10T14:01:52.539426+0000 mon.c (mon.1) 271 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:01:53.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:01:52 gibba015 bash[29377]: audit 2021-03-10T14:01:52.540084+0000 mon.c (mon.1) 272 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:01:53.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:01:52 gibba015 bash[29377]: audit 2021-03-10T14:01:52.540667+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:01:53.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:01:52 gibba015 bash[29377]: audit 2021-03-10T14:01:52.542023+0000 mon.a (mon.0) 643 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:01:53.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:01:52 gibba015 bash[30343]: cluster 2021-03-10T14:01:51.449692+0000 mgr.gibba045.orlgmj (mgr.34412) 734 : cluster [DBG] pgmap v404: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:53.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:01:52 gibba015 bash[30343]: audit 2021-03-10T14:01:52.454598+0000 mon.c (mon.1) 267 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T14:01:53.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:01:52 gibba015 bash[30343]: audit 2021-03-10T14:01:52.455343+0000 mon.c (mon.1) 268 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:01:53.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:01:52 gibba015 bash[30343]: audit 2021-03-10T14:01:52.455956+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T14:01:53.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:01:52 gibba015 bash[30343]: audit 2021-03-10T14:01:52.456483+0000 mon.c (mon.1) 269 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:01:53.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:01:52 gibba015 bash[30343]: audit 2021-03-10T14:01:52.457938+0000 mon.c (mon.1) 270 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:01:53.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:01:52 gibba015 bash[30343]: audit 2021-03-10T14:01:52.458619+0000 mon.a (mon.0) 639 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:01:53.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:01:52 gibba015 bash[30343]: audit 2021-03-10T14:01:52.459694+0000 mon.a (mon.0) 640 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:01:53.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:01:52 gibba015 bash[30343]: audit 2021-03-10T14:01:52.459898+0000 mon.a (mon.0) 641 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:01:53.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:01:52 gibba015 bash[30343]: audit 2021-03-10T14:01:52.539426+0000 mon.c (mon.1) 271 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:01:53.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:01:52 gibba015 bash[30343]: audit 2021-03-10T14:01:52.540084+0000 mon.c (mon.1) 272 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:01:53.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:01:52 gibba015 bash[30343]: audit 2021-03-10T14:01:52.540667+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:01:53.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:01:52 gibba015 bash[30343]: audit 2021-03-10T14:01:52.542023+0000 mon.a (mon.0) 643 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:01:55.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:01:54 gibba045 bash[25517]: cluster 2021-03-10T14:01:53.450890+0000 mgr.gibba045.orlgmj (mgr.34412) 735 : cluster [DBG] pgmap v405: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:55.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:01:54 gibba015 bash[29377]: cluster 2021-03-10T14:01:53.450890+0000 mgr.gibba045.orlgmj (mgr.34412) 735 : cluster [DBG] pgmap v405: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:55.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:01:54 gibba015 bash[30343]: cluster 2021-03-10T14:01:53.450890+0000 mgr.gibba045.orlgmj (mgr.34412) 735 : cluster [DBG] pgmap v405: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:55.972 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:01:56.200 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:01:56.200 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (12m) 9m ago 18m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:01:56.201 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (17m) 7m ago 17m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:01:56.201 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (13m) 7m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:01:56.201 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (13m) 7m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:01:56.201 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (12m) 9m ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:01:56.202 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (12m) 9m ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:01:56.202 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (11m) 7m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:01:56.202 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (11m) 9m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:01:56.202 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (18m) 9m ago 18m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:01:56.203 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (18m) 7m ago 18m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:01:56.203 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (10m) 9m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:01:56.203 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (10m) 9m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:01:56.203 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (10m) 9m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:01:56.204 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (9m) 9m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:01:56.204 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (9m) 7m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:01:56.204 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (8m) 7m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:01:56.204 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (8m) 7m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:01:56.205 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (7m) 7m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:01:56.205 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (17m) 7m ago 18m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:01:56.205 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 7m ago 16m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:01:56.448 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:01:56.448 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:01:56.448 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:01:56.449 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:01:56.449 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:01:56.449 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:01:56.449 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:01:56.450 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:01:56.450 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:01:56.450 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:01:56.451 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:01:56.451 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:01:56.451 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:01:56.451 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:01:56.452 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:01:57.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:01:56 gibba045 bash[25517]: cluster 2021-03-10T14:01:55.452535+0000 mgr.gibba045.orlgmj (mgr.34412) 736 : cluster [DBG] pgmap v406: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:57.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:01:56 gibba045 bash[25517]: audit 2021-03-10T14:01:55.963932+0000 mgr.gibba045.orlgmj (mgr.34412) 737 : audit [DBG] from='client.54544 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:01:57.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:01:56 gibba045 bash[25517]: audit 2021-03-10T14:01:56.445208+0000 mon.c (mon.1) 273 : audit [DBG] from='client.? 172.21.2.115:0/422380114' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:01:57.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:01:56 gibba015 bash[29377]: cluster 2021-03-10T14:01:55.452535+0000 mgr.gibba045.orlgmj (mgr.34412) 736 : cluster [DBG] pgmap v406: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:57.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:01:56 gibba015 bash[29377]: audit 2021-03-10T14:01:55.963932+0000 mgr.gibba045.orlgmj (mgr.34412) 737 : audit [DBG] from='client.54544 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:01:57.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:01:56 gibba015 bash[29377]: audit 2021-03-10T14:01:56.445208+0000 mon.c (mon.1) 273 : audit [DBG] from='client.? 172.21.2.115:0/422380114' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:01:57.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:01:56 gibba015 bash[30343]: cluster 2021-03-10T14:01:55.452535+0000 mgr.gibba045.orlgmj (mgr.34412) 736 : cluster [DBG] pgmap v406: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:57.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:01:56 gibba015 bash[30343]: audit 2021-03-10T14:01:55.963932+0000 mgr.gibba045.orlgmj (mgr.34412) 737 : audit [DBG] from='client.54544 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:01:57.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:01:56 gibba015 bash[30343]: audit 2021-03-10T14:01:56.445208+0000 mon.c (mon.1) 273 : audit [DBG] from='client.? 172.21.2.115:0/422380114' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:01:58.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:01:57 gibba045 bash[25517]: audit 2021-03-10T14:01:56.188349+0000 mgr.gibba045.orlgmj (mgr.34412) 738 : audit [DBG] from='client.54550 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:01:58.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:01:57 gibba015 bash[29377]: audit 2021-03-10T14:01:56.188349+0000 mgr.gibba045.orlgmj (mgr.34412) 738 : audit [DBG] from='client.54550 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:01:58.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:01:57 gibba015 bash[30343]: audit 2021-03-10T14:01:56.188349+0000 mgr.gibba045.orlgmj (mgr.34412) 738 : audit [DBG] from='client.54550 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:01:59.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:01:58 gibba045 bash[25517]: cluster 2021-03-10T14:01:57.453958+0000 mgr.gibba045.orlgmj (mgr.34412) 739 : cluster [DBG] pgmap v407: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:59.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:01:58 gibba015 bash[29377]: cluster 2021-03-10T14:01:57.453958+0000 mgr.gibba045.orlgmj (mgr.34412) 739 : cluster [DBG] pgmap v407: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:59.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:01:58 gibba015 bash[30343]: cluster 2021-03-10T14:01:57.453958+0000 mgr.gibba045.orlgmj (mgr.34412) 739 : cluster [DBG] pgmap v407: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:01.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:02:00 gibba015 bash[29377]: cluster 2021-03-10T14:01:59.455172+0000 mgr.gibba045.orlgmj (mgr.34412) 740 : cluster [DBG] pgmap v408: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:01.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:02:00 gibba015 bash[30343]: cluster 2021-03-10T14:01:59.455172+0000 mgr.gibba045.orlgmj (mgr.34412) 740 : cluster [DBG] pgmap v408: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:01.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:02:00 gibba045 bash[25517]: cluster 2021-03-10T14:01:59.455172+0000 mgr.gibba045.orlgmj (mgr.34412) 740 : cluster [DBG] pgmap v408: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:03.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:02:02 gibba015 bash[29377]: cluster 2021-03-10T14:02:01.457099+0000 mgr.gibba045.orlgmj (mgr.34412) 741 : cluster [DBG] pgmap v409: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:03.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:02:02 gibba015 bash[30343]: cluster 2021-03-10T14:02:01.457099+0000 mgr.gibba045.orlgmj (mgr.34412) 741 : cluster [DBG] pgmap v409: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:03.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:02:02 gibba045 bash[25517]: cluster 2021-03-10T14:02:01.457099+0000 mgr.gibba045.orlgmj (mgr.34412) 741 : cluster [DBG] pgmap v409: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:05.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:02:04 gibba015 bash[29377]: cluster 2021-03-10T14:02:03.458255+0000 mgr.gibba045.orlgmj (mgr.34412) 742 : cluster [DBG] pgmap v410: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:05.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:02:04 gibba015 bash[29377]: audit 2021-03-10T14:02:04.630657+0000 mon.c (mon.1) 274 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:02:05.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:02:04 gibba015 bash[30343]: cluster 2021-03-10T14:02:03.458255+0000 mgr.gibba045.orlgmj (mgr.34412) 742 : cluster [DBG] pgmap v410: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:05.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:02:04 gibba015 bash[30343]: audit 2021-03-10T14:02:04.630657+0000 mon.c (mon.1) 274 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:02:05.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:02:04 gibba045 bash[25517]: cluster 2021-03-10T14:02:03.458255+0000 mgr.gibba045.orlgmj (mgr.34412) 742 : cluster [DBG] pgmap v410: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:05.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:02:04 gibba045 bash[25517]: audit 2021-03-10T14:02:04.630657+0000 mon.c (mon.1) 274 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:02:06.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:02:05 gibba015 bash[29377]: cephadm 2021-03-10T14:02:04.637647+0000 mgr.gibba045.orlgmj (mgr.34412) 743 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:02:06.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:02:05 gibba015 bash[29377]: cephadm 2021-03-10T14:02:04.639546+0000 mgr.gibba045.orlgmj (mgr.34412) 744 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:02:06.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:02:05 gibba015 bash[29377]: audit 2021-03-10T14:02:04.831181+0000 mon.a (mon.0) 644 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:02:06.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:02:05 gibba015 bash[29377]: audit 2021-03-10T14:02:04.834941+0000 mon.c (mon.1) 275 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:02:06.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:02:05 gibba015 bash[29377]: audit 2021-03-10T14:02:04.835989+0000 mon.c (mon.1) 276 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:02:06.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:02:05 gibba015 bash[29377]: audit 2021-03-10T14:02:04.836969+0000 mon.c (mon.1) 277 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:02:06.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:02:05 gibba015 bash[29377]: cephadm 2021-03-10T14:02:04.837056+0000 mgr.gibba045.orlgmj (mgr.34412) 745 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:02:06.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:02:05 gibba015 bash[29377]: audit 2021-03-10T14:02:04.837862+0000 mon.c (mon.1) 278 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:02:06.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:02:05 gibba015 bash[29377]: cephadm 2021-03-10T14:02:04.838710+0000 mgr.gibba045.orlgmj (mgr.34412) 746 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:02:06.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:02:05 gibba015 bash[29377]: cephadm 2021-03-10T14:02:04.839630+0000 mgr.gibba045.orlgmj (mgr.34412) 747 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:02:06.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:02:05 gibba015 bash[29377]: cephadm 2021-03-10T14:02:04.839668+0000 mgr.gibba045.orlgmj (mgr.34412) 748 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:02:06.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:02:05 gibba015 bash[29377]: audit 2021-03-10T14:02:04.840381+0000 mon.c (mon.1) 279 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:02:06.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:02:05 gibba015 bash[29377]: cephadm 2021-03-10T14:02:04.840605+0000 mgr.gibba045.orlgmj (mgr.34412) 749 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:02:06.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:02:05 gibba015 bash[29377]: cephadm 2021-03-10T14:02:04.840649+0000 mgr.gibba045.orlgmj (mgr.34412) 750 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:02:06.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:02:05 gibba015 bash[29377]: cephadm 2021-03-10T14:02:04.841478+0000 mgr.gibba045.orlgmj (mgr.34412) 751 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:02:06.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:02:05 gibba015 bash[29377]: audit 2021-03-10T14:02:04.841675+0000 mon.c (mon.1) 280 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:02:06.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:02:05 gibba015 bash[29377]: cephadm 2021-03-10T14:02:04.842927+0000 mgr.gibba045.orlgmj (mgr.34412) 752 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:02:06.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:02:05 gibba015 bash[29377]: cephadm 2021-03-10T14:02:04.842966+0000 mgr.gibba045.orlgmj (mgr.34412) 753 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:02:06.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:02:05 gibba015 bash[29377]: cephadm 2021-03-10T14:02:04.844025+0000 mgr.gibba045.orlgmj (mgr.34412) 754 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:02:06.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:02:05 gibba015 bash[29377]: cephadm 2021-03-10T14:02:04.844407+0000 mgr.gibba045.orlgmj (mgr.34412) 755 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:02:06.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:02:05 gibba015 bash[29377]: cephadm 2021-03-10T14:02:04.845291+0000 mgr.gibba045.orlgmj (mgr.34412) 756 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:02:06.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:02:05 gibba015 bash[29377]: cephadm 2021-03-10T14:02:04.845380+0000 mgr.gibba045.orlgmj (mgr.34412) 757 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:02:06.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:02:05 gibba015 bash[29377]: cephadm 2021-03-10T14:02:04.845532+0000 mgr.gibba045.orlgmj (mgr.34412) 758 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:02:06.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:02:05 gibba015 bash[30343]: cephadm 2021-03-10T14:02:04.637647+0000 mgr.gibba045.orlgmj (mgr.34412) 743 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:02:06.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:02:05 gibba015 bash[30343]: cephadm 2021-03-10T14:02:04.639546+0000 mgr.gibba045.orlgmj (mgr.34412) 744 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:02:06.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:02:05 gibba015 bash[30343]: audit 2021-03-10T14:02:04.831181+0000 mon.a (mon.0) 644 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:02:06.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:02:05 gibba015 bash[30343]: audit 2021-03-10T14:02:04.834941+0000 mon.c (mon.1) 275 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:02:06.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:02:05 gibba015 bash[30343]: audit 2021-03-10T14:02:04.835989+0000 mon.c (mon.1) 276 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:02:06.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:02:05 gibba015 bash[30343]: audit 2021-03-10T14:02:04.836969+0000 mon.c (mon.1) 277 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:02:06.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:02:05 gibba015 bash[30343]: cephadm 2021-03-10T14:02:04.837056+0000 mgr.gibba045.orlgmj (mgr.34412) 745 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:02:06.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:02:05 gibba015 bash[30343]: audit 2021-03-10T14:02:04.837862+0000 mon.c (mon.1) 278 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:02:06.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:02:05 gibba015 bash[30343]: cephadm 2021-03-10T14:02:04.838710+0000 mgr.gibba045.orlgmj (mgr.34412) 746 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:02:06.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:02:05 gibba015 bash[30343]: cephadm 2021-03-10T14:02:04.839630+0000 mgr.gibba045.orlgmj (mgr.34412) 747 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:02:06.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:02:05 gibba015 bash[30343]: cephadm 2021-03-10T14:02:04.839668+0000 mgr.gibba045.orlgmj (mgr.34412) 748 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:02:06.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:02:05 gibba015 bash[30343]: audit 2021-03-10T14:02:04.840381+0000 mon.c (mon.1) 279 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:02:06.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:02:05 gibba015 bash[30343]: cephadm 2021-03-10T14:02:04.840605+0000 mgr.gibba045.orlgmj (mgr.34412) 749 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:02:06.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:02:05 gibba015 bash[30343]: cephadm 2021-03-10T14:02:04.840649+0000 mgr.gibba045.orlgmj (mgr.34412) 750 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:02:06.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:02:05 gibba015 bash[30343]: cephadm 2021-03-10T14:02:04.841478+0000 mgr.gibba045.orlgmj (mgr.34412) 751 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:02:06.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:02:05 gibba015 bash[30343]: audit 2021-03-10T14:02:04.841675+0000 mon.c (mon.1) 280 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:02:06.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:02:05 gibba015 bash[30343]: cephadm 2021-03-10T14:02:04.842927+0000 mgr.gibba045.orlgmj (mgr.34412) 752 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:02:06.234 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:02:05 gibba015 bash[30343]: cephadm 2021-03-10T14:02:04.842966+0000 mgr.gibba045.orlgmj (mgr.34412) 753 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:02:06.234 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:02:05 gibba015 bash[30343]: cephadm 2021-03-10T14:02:04.844025+0000 mgr.gibba045.orlgmj (mgr.34412) 754 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:02:06.234 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:02:05 gibba015 bash[30343]: cephadm 2021-03-10T14:02:04.844407+0000 mgr.gibba045.orlgmj (mgr.34412) 755 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:02:06.234 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:02:05 gibba015 bash[30343]: cephadm 2021-03-10T14:02:04.845291+0000 mgr.gibba045.orlgmj (mgr.34412) 756 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:02:06.234 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:02:05 gibba015 bash[30343]: cephadm 2021-03-10T14:02:04.845380+0000 mgr.gibba045.orlgmj (mgr.34412) 757 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:02:06.235 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:02:05 gibba015 bash[30343]: cephadm 2021-03-10T14:02:04.845532+0000 mgr.gibba045.orlgmj (mgr.34412) 758 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:02:06.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:02:05 gibba045 bash[25517]: cephadm 2021-03-10T14:02:04.637647+0000 mgr.gibba045.orlgmj (mgr.34412) 743 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:02:06.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:02:05 gibba045 bash[25517]: cephadm 2021-03-10T14:02:04.639546+0000 mgr.gibba045.orlgmj (mgr.34412) 744 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:02:06.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:02:05 gibba045 bash[25517]: audit 2021-03-10T14:02:04.831181+0000 mon.a (mon.0) 644 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:02:06.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:02:05 gibba045 bash[25517]: audit 2021-03-10T14:02:04.834941+0000 mon.c (mon.1) 275 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:02:06.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:02:05 gibba045 bash[25517]: audit 2021-03-10T14:02:04.835989+0000 mon.c (mon.1) 276 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:02:06.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:02:05 gibba045 bash[25517]: audit 2021-03-10T14:02:04.836969+0000 mon.c (mon.1) 277 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:02:06.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:02:05 gibba045 bash[25517]: cephadm 2021-03-10T14:02:04.837056+0000 mgr.gibba045.orlgmj (mgr.34412) 745 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:02:06.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:02:05 gibba045 bash[25517]: audit 2021-03-10T14:02:04.837862+0000 mon.c (mon.1) 278 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:02:06.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:02:05 gibba045 bash[25517]: cephadm 2021-03-10T14:02:04.838710+0000 mgr.gibba045.orlgmj (mgr.34412) 746 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:02:06.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:02:05 gibba045 bash[25517]: cephadm 2021-03-10T14:02:04.839630+0000 mgr.gibba045.orlgmj (mgr.34412) 747 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:02:06.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:02:05 gibba045 bash[25517]: cephadm 2021-03-10T14:02:04.839668+0000 mgr.gibba045.orlgmj (mgr.34412) 748 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:02:06.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:02:05 gibba045 bash[25517]: audit 2021-03-10T14:02:04.840381+0000 mon.c (mon.1) 279 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:02:06.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:02:05 gibba045 bash[25517]: cephadm 2021-03-10T14:02:04.840605+0000 mgr.gibba045.orlgmj (mgr.34412) 749 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:02:06.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:02:05 gibba045 bash[25517]: cephadm 2021-03-10T14:02:04.840649+0000 mgr.gibba045.orlgmj (mgr.34412) 750 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:02:06.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:02:05 gibba045 bash[25517]: cephadm 2021-03-10T14:02:04.841478+0000 mgr.gibba045.orlgmj (mgr.34412) 751 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:02:06.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:02:05 gibba045 bash[25517]: audit 2021-03-10T14:02:04.841675+0000 mon.c (mon.1) 280 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:02:06.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:02:05 gibba045 bash[25517]: cephadm 2021-03-10T14:02:04.842927+0000 mgr.gibba045.orlgmj (mgr.34412) 752 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:02:06.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:02:05 gibba045 bash[25517]: cephadm 2021-03-10T14:02:04.842966+0000 mgr.gibba045.orlgmj (mgr.34412) 753 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:02:06.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:02:05 gibba045 bash[25517]: cephadm 2021-03-10T14:02:04.844025+0000 mgr.gibba045.orlgmj (mgr.34412) 754 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:02:06.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:02:05 gibba045 bash[25517]: cephadm 2021-03-10T14:02:04.844407+0000 mgr.gibba045.orlgmj (mgr.34412) 755 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:02:06.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:02:05 gibba045 bash[25517]: cephadm 2021-03-10T14:02:04.845291+0000 mgr.gibba045.orlgmj (mgr.34412) 756 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:02:06.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:02:05 gibba045 bash[25517]: cephadm 2021-03-10T14:02:04.845380+0000 mgr.gibba045.orlgmj (mgr.34412) 757 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:02:06.312 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:02:05 gibba045 bash[25517]: cephadm 2021-03-10T14:02:04.845532+0000 mgr.gibba045.orlgmj (mgr.34412) 758 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:02:07.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:02:06 gibba015 bash[29377]: cluster 2021-03-10T14:02:05.459826+0000 mgr.gibba045.orlgmj (mgr.34412) 759 : cluster [DBG] pgmap v411: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:07.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:02:06 gibba015 bash[30343]: cluster 2021-03-10T14:02:05.459826+0000 mgr.gibba045.orlgmj (mgr.34412) 759 : cluster [DBG] pgmap v411: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:07.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:02:06 gibba045 bash[25517]: cluster 2021-03-10T14:02:05.459826+0000 mgr.gibba045.orlgmj (mgr.34412) 759 : cluster [DBG] pgmap v411: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:09.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:02:08 gibba015 bash[29377]: cluster 2021-03-10T14:02:07.461812+0000 mgr.gibba045.orlgmj (mgr.34412) 760 : cluster [DBG] pgmap v412: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:09.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:02:08 gibba015 bash[30343]: cluster 2021-03-10T14:02:07.461812+0000 mgr.gibba045.orlgmj (mgr.34412) 760 : cluster [DBG] pgmap v412: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:09.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:02:08 gibba045 bash[25517]: cluster 2021-03-10T14:02:07.461812+0000 mgr.gibba045.orlgmj (mgr.34412) 760 : cluster [DBG] pgmap v412: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:11.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:02:10 gibba015 bash[29377]: cluster 2021-03-10T14:02:09.463031+0000 mgr.gibba045.orlgmj (mgr.34412) 761 : cluster [DBG] pgmap v413: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:11.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:02:10 gibba015 bash[30343]: cluster 2021-03-10T14:02:09.463031+0000 mgr.gibba045.orlgmj (mgr.34412) 761 : cluster [DBG] pgmap v413: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:11.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:02:10 gibba045 bash[25517]: cluster 2021-03-10T14:02:09.463031+0000 mgr.gibba045.orlgmj (mgr.34412) 761 : cluster [DBG] pgmap v413: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:13.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:02:12 gibba015 bash[29377]: cluster 2021-03-10T14:02:11.464985+0000 mgr.gibba045.orlgmj (mgr.34412) 762 : cluster [DBG] pgmap v414: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:13.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:02:12 gibba015 bash[30343]: cluster 2021-03-10T14:02:11.464985+0000 mgr.gibba045.orlgmj (mgr.34412) 762 : cluster [DBG] pgmap v414: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:13.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:02:12 gibba045 bash[25517]: cluster 2021-03-10T14:02:11.464985+0000 mgr.gibba045.orlgmj (mgr.34412) 762 : cluster [DBG] pgmap v414: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:15.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:02:14 gibba015 bash[29377]: cluster 2021-03-10T14:02:13.466061+0000 mgr.gibba045.orlgmj (mgr.34412) 763 : cluster [DBG] pgmap v415: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:15.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:02:14 gibba015 bash[30343]: cluster 2021-03-10T14:02:13.466061+0000 mgr.gibba045.orlgmj (mgr.34412) 763 : cluster [DBG] pgmap v415: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:15.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:02:14 gibba045 bash[25517]: cluster 2021-03-10T14:02:13.466061+0000 mgr.gibba045.orlgmj (mgr.34412) 763 : cluster [DBG] pgmap v415: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:17.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:02:16 gibba015 bash[29377]: cluster 2021-03-10T14:02:15.467369+0000 mgr.gibba045.orlgmj (mgr.34412) 764 : cluster [DBG] pgmap v416: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:17.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:02:16 gibba015 bash[30343]: cluster 2021-03-10T14:02:15.467369+0000 mgr.gibba045.orlgmj (mgr.34412) 764 : cluster [DBG] pgmap v416: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:17.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:02:16 gibba045 bash[25517]: cluster 2021-03-10T14:02:15.467369+0000 mgr.gibba045.orlgmj (mgr.34412) 764 : cluster [DBG] pgmap v416: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:19.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:02:18 gibba015 bash[29377]: cluster 2021-03-10T14:02:17.469151+0000 mgr.gibba045.orlgmj (mgr.34412) 765 : cluster [DBG] pgmap v417: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:19.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:02:18 gibba015 bash[30343]: cluster 2021-03-10T14:02:17.469151+0000 mgr.gibba045.orlgmj (mgr.34412) 765 : cluster [DBG] pgmap v417: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:19.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:02:18 gibba045 bash[25517]: cluster 2021-03-10T14:02:17.469151+0000 mgr.gibba045.orlgmj (mgr.34412) 765 : cluster [DBG] pgmap v417: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:21.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:02:20 gibba015 bash[29377]: cluster 2021-03-10T14:02:19.470421+0000 mgr.gibba045.orlgmj (mgr.34412) 766 : cluster [DBG] pgmap v418: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:21.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:02:20 gibba015 bash[29377]: cephadm 2021-03-10T14:02:19.853528+0000 mgr.gibba045.orlgmj (mgr.34412) 767 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:02:21.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:02:20 gibba015 bash[30343]: cluster 2021-03-10T14:02:19.470421+0000 mgr.gibba045.orlgmj (mgr.34412) 766 : cluster [DBG] pgmap v418: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:21.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:02:20 gibba015 bash[30343]: cephadm 2021-03-10T14:02:19.853528+0000 mgr.gibba045.orlgmj (mgr.34412) 767 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:02:21.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:02:20 gibba045 bash[25517]: cluster 2021-03-10T14:02:19.470421+0000 mgr.gibba045.orlgmj (mgr.34412) 766 : cluster [DBG] pgmap v418: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:21.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:02:20 gibba045 bash[25517]: cephadm 2021-03-10T14:02:19.853528+0000 mgr.gibba045.orlgmj (mgr.34412) 767 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:02:23.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:02:22 gibba015 bash[29377]: cluster 2021-03-10T14:02:21.472500+0000 mgr.gibba045.orlgmj (mgr.34412) 768 : cluster [DBG] pgmap v419: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:23.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:02:22 gibba015 bash[30343]: cluster 2021-03-10T14:02:21.472500+0000 mgr.gibba045.orlgmj (mgr.34412) 768 : cluster [DBG] pgmap v419: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:23.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:02:22 gibba045 bash[25517]: cluster 2021-03-10T14:02:21.472500+0000 mgr.gibba045.orlgmj (mgr.34412) 768 : cluster [DBG] pgmap v419: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:25.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:02:24 gibba015 bash[29377]: cluster 2021-03-10T14:02:23.473007+0000 mgr.gibba045.orlgmj (mgr.34412) 769 : cluster [DBG] pgmap v420: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:25.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:02:24 gibba015 bash[30343]: cluster 2021-03-10T14:02:23.473007+0000 mgr.gibba045.orlgmj (mgr.34412) 769 : cluster [DBG] pgmap v420: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:25.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:02:24 gibba045 bash[25517]: cluster 2021-03-10T14:02:23.473007+0000 mgr.gibba045.orlgmj (mgr.34412) 769 : cluster [DBG] pgmap v420: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:26.693 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:02:26.948 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:02:26.948 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (13m) 10m ago 18m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:02:26.949 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (18m) 8m ago 18m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:02:26.949 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (13m) 8m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:02:26.949 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (13m) 8m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:02:26.949 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (12m) 10m ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:02:26.950 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (12m) 10m ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:02:26.950 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (12m) 8m ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:02:26.950 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (12m) 10m ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:02:26.950 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (18m) 10m ago 18m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:02:26.951 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (18m) 8m ago 18m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:02:26.951 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (11m) 10m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:02:26.951 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (11m) 10m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:02:26.951 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (10m) 10m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:02:26.952 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (10m) 10m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:02:26.952 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (9m) 8m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:02:26.952 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (9m) 8m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:02:26.952 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (8m) 8m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:02:26.953 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (8m) 8m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:02:26.953 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (18m) 8m ago 18m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:02:26.953 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 8m ago 16m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:02:27.199 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:02:27.200 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:02:27.200 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:02:27.200 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:02:27.200 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:02:27.201 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:02:27.201 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:02:27.201 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:02:27.201 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:02:27.201 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:02:27.202 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:02:27.202 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:02:27.202 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:02:27.202 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:02:27.203 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:02:27.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:02:26 gibba015 bash[29377]: cluster 2021-03-10T14:02:25.474538+0000 mgr.gibba045.orlgmj (mgr.34412) 770 : cluster [DBG] pgmap v421: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:27.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:02:26 gibba015 bash[30343]: cluster 2021-03-10T14:02:25.474538+0000 mgr.gibba045.orlgmj (mgr.34412) 770 : cluster [DBG] pgmap v421: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:27.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:02:26 gibba045 bash[25517]: cluster 2021-03-10T14:02:25.474538+0000 mgr.gibba045.orlgmj (mgr.34412) 770 : cluster [DBG] pgmap v421: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:28.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:02:27 gibba015 bash[29377]: audit 2021-03-10T14:02:26.684386+0000 mgr.gibba045.orlgmj (mgr.34412) 771 : audit [DBG] from='client.44574 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:02:28.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:02:27 gibba015 bash[29377]: audit 2021-03-10T14:02:26.908267+0000 mgr.gibba045.orlgmj (mgr.34412) 772 : audit [DBG] from='client.54568 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:02:28.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:02:27 gibba015 bash[29377]: audit 2021-03-10T14:02:27.196919+0000 mon.a (mon.0) 645 : audit [DBG] from='client.? 172.21.2.115:0/2489596531' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:02:28.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:02:27 gibba015 bash[30343]: audit 2021-03-10T14:02:26.684386+0000 mgr.gibba045.orlgmj (mgr.34412) 771 : audit [DBG] from='client.44574 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:02:28.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:02:27 gibba015 bash[30343]: audit 2021-03-10T14:02:26.908267+0000 mgr.gibba045.orlgmj (mgr.34412) 772 : audit [DBG] from='client.54568 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:02:28.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:02:27 gibba015 bash[30343]: audit 2021-03-10T14:02:27.196919+0000 mon.a (mon.0) 645 : audit [DBG] from='client.? 172.21.2.115:0/2489596531' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:02:28.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:02:27 gibba045 bash[25517]: audit 2021-03-10T14:02:26.684386+0000 mgr.gibba045.orlgmj (mgr.34412) 771 : audit [DBG] from='client.44574 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:02:28.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:02:27 gibba045 bash[25517]: audit 2021-03-10T14:02:26.908267+0000 mgr.gibba045.orlgmj (mgr.34412) 772 : audit [DBG] from='client.54568 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:02:28.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:02:27 gibba045 bash[25517]: audit 2021-03-10T14:02:27.196919+0000 mon.a (mon.0) 645 : audit [DBG] from='client.? 172.21.2.115:0/2489596531' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:02:29.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:02:28 gibba015 bash[29377]: cluster 2021-03-10T14:02:27.476135+0000 mgr.gibba045.orlgmj (mgr.34412) 773 : cluster [DBG] pgmap v422: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:29.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:02:28 gibba015 bash[30343]: cluster 2021-03-10T14:02:27.476135+0000 mgr.gibba045.orlgmj (mgr.34412) 773 : cluster [DBG] pgmap v422: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:29.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:02:28 gibba045 bash[25517]: cluster 2021-03-10T14:02:27.476135+0000 mgr.gibba045.orlgmj (mgr.34412) 773 : cluster [DBG] pgmap v422: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:31.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:02:30 gibba015 bash[29377]: cluster 2021-03-10T14:02:29.477606+0000 mgr.gibba045.orlgmj (mgr.34412) 774 : cluster [DBG] pgmap v423: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:31.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:02:30 gibba015 bash[30343]: cluster 2021-03-10T14:02:29.477606+0000 mgr.gibba045.orlgmj (mgr.34412) 774 : cluster [DBG] pgmap v423: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:31.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:02:30 gibba045 bash[25517]: cluster 2021-03-10T14:02:29.477606+0000 mgr.gibba045.orlgmj (mgr.34412) 774 : cluster [DBG] pgmap v423: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:33.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:02:32 gibba045 bash[25517]: cluster 2021-03-10T14:02:31.479456+0000 mgr.gibba045.orlgmj (mgr.34412) 775 : cluster [DBG] pgmap v424: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:33.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:02:32 gibba015 bash[29377]: cluster 2021-03-10T14:02:31.479456+0000 mgr.gibba045.orlgmj (mgr.34412) 775 : cluster [DBG] pgmap v424: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:33.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:02:32 gibba015 bash[30343]: cluster 2021-03-10T14:02:31.479456+0000 mgr.gibba045.orlgmj (mgr.34412) 775 : cluster [DBG] pgmap v424: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:35.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:02:34 gibba045 bash[25517]: cluster 2021-03-10T14:02:33.480725+0000 mgr.gibba045.orlgmj (mgr.34412) 776 : cluster [DBG] pgmap v425: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:35.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:02:34 gibba015 bash[29377]: cluster 2021-03-10T14:02:33.480725+0000 mgr.gibba045.orlgmj (mgr.34412) 776 : cluster [DBG] pgmap v425: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:35.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:02:34 gibba015 bash[30343]: cluster 2021-03-10T14:02:33.480725+0000 mgr.gibba045.orlgmj (mgr.34412) 776 : cluster [DBG] pgmap v425: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:36.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:02:35 gibba045 bash[25517]: cephadm 2021-03-10T14:02:34.861367+0000 mgr.gibba045.orlgmj (mgr.34412) 777 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:02:36.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:02:35 gibba015 bash[29377]: cephadm 2021-03-10T14:02:34.861367+0000 mgr.gibba045.orlgmj (mgr.34412) 777 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:02:36.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:02:35 gibba015 bash[30343]: cephadm 2021-03-10T14:02:34.861367+0000 mgr.gibba045.orlgmj (mgr.34412) 777 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:02:37.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:02:37 gibba045 bash[25517]: cluster 2021-03-10T14:02:35.482416+0000 mgr.gibba045.orlgmj (mgr.34412) 778 : cluster [DBG] pgmap v426: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:37.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:02:36 gibba015 bash[29377]: cluster 2021-03-10T14:02:35.482416+0000 mgr.gibba045.orlgmj (mgr.34412) 778 : cluster [DBG] pgmap v426: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:37.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:02:37 gibba015 bash[30343]: cluster 2021-03-10T14:02:35.482416+0000 mgr.gibba045.orlgmj (mgr.34412) 778 : cluster [DBG] pgmap v426: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:39.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:02:39 gibba045 bash[25517]: cluster 2021-03-10T14:02:37.484168+0000 mgr.gibba045.orlgmj (mgr.34412) 779 : cluster [DBG] pgmap v427: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:39.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:02:39 gibba015 bash[29377]: cluster 2021-03-10T14:02:37.484168+0000 mgr.gibba045.orlgmj (mgr.34412) 779 : cluster [DBG] pgmap v427: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:39.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:02:39 gibba015 bash[30343]: cluster 2021-03-10T14:02:37.484168+0000 mgr.gibba045.orlgmj (mgr.34412) 779 : cluster [DBG] pgmap v427: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:41.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:02:41 gibba045 bash[25517]: cluster 2021-03-10T14:02:39.485366+0000 mgr.gibba045.orlgmj (mgr.34412) 780 : cluster [DBG] pgmap v428: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:41.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:02:41 gibba015 bash[29377]: cluster 2021-03-10T14:02:39.485366+0000 mgr.gibba045.orlgmj (mgr.34412) 780 : cluster [DBG] pgmap v428: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:41.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:02:41 gibba015 bash[30343]: cluster 2021-03-10T14:02:39.485366+0000 mgr.gibba045.orlgmj (mgr.34412) 780 : cluster [DBG] pgmap v428: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:43.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:02:43 gibba045 bash[25517]: cluster 2021-03-10T14:02:41.487332+0000 mgr.gibba045.orlgmj (mgr.34412) 781 : cluster [DBG] pgmap v429: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:43.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:02:43 gibba015 bash[29377]: cluster 2021-03-10T14:02:41.487332+0000 mgr.gibba045.orlgmj (mgr.34412) 781 : cluster [DBG] pgmap v429: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:43.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:02:43 gibba015 bash[30343]: cluster 2021-03-10T14:02:41.487332+0000 mgr.gibba045.orlgmj (mgr.34412) 781 : cluster [DBG] pgmap v429: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:45.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:02:45 gibba045 bash[25517]: cluster 2021-03-10T14:02:43.488403+0000 mgr.gibba045.orlgmj (mgr.34412) 782 : cluster [DBG] pgmap v430: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:45.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:02:45 gibba015 bash[29377]: cluster 2021-03-10T14:02:43.488403+0000 mgr.gibba045.orlgmj (mgr.34412) 782 : cluster [DBG] pgmap v430: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:45.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:02:45 gibba015 bash[30343]: cluster 2021-03-10T14:02:43.488403+0000 mgr.gibba045.orlgmj (mgr.34412) 782 : cluster [DBG] pgmap v430: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:47.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:02:47 gibba045 bash[25517]: cluster 2021-03-10T14:02:45.489848+0000 mgr.gibba045.orlgmj (mgr.34412) 783 : cluster [DBG] pgmap v431: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:47.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:02:47 gibba015 bash[29377]: cluster 2021-03-10T14:02:45.489848+0000 mgr.gibba045.orlgmj (mgr.34412) 783 : cluster [DBG] pgmap v431: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:47.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:02:47 gibba015 bash[30343]: cluster 2021-03-10T14:02:45.489848+0000 mgr.gibba045.orlgmj (mgr.34412) 783 : cluster [DBG] pgmap v431: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:49.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:02:49 gibba015 bash[29377]: cluster 2021-03-10T14:02:47.491304+0000 mgr.gibba045.orlgmj (mgr.34412) 784 : cluster [DBG] pgmap v432: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:49.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:02:49 gibba015 bash[30343]: cluster 2021-03-10T14:02:47.491304+0000 mgr.gibba045.orlgmj (mgr.34412) 784 : cluster [DBG] pgmap v432: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:49.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:02:49 gibba045 bash[25517]: cluster 2021-03-10T14:02:47.491304+0000 mgr.gibba045.orlgmj (mgr.34412) 784 : cluster [DBG] pgmap v432: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:51.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:02:51 gibba015 bash[29377]: cluster 2021-03-10T14:02:49.492944+0000 mgr.gibba045.orlgmj (mgr.34412) 785 : cluster [DBG] pgmap v433: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:51.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:02:51 gibba015 bash[29377]: cephadm 2021-03-10T14:02:49.877451+0000 mgr.gibba045.orlgmj (mgr.34412) 786 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:02:51.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:02:51 gibba015 bash[30343]: cluster 2021-03-10T14:02:49.492944+0000 mgr.gibba045.orlgmj (mgr.34412) 785 : cluster [DBG] pgmap v433: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:51.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:02:51 gibba015 bash[30343]: cephadm 2021-03-10T14:02:49.877451+0000 mgr.gibba045.orlgmj (mgr.34412) 786 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:02:51.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:02:51 gibba045 bash[25517]: cluster 2021-03-10T14:02:49.492944+0000 mgr.gibba045.orlgmj (mgr.34412) 785 : cluster [DBG] pgmap v433: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:51.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:02:51 gibba045 bash[25517]: cephadm 2021-03-10T14:02:49.877451+0000 mgr.gibba045.orlgmj (mgr.34412) 786 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:02:53.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:02:53 gibba015 bash[29377]: cluster 2021-03-10T14:02:51.495006+0000 mgr.gibba045.orlgmj (mgr.34412) 787 : cluster [DBG] pgmap v434: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:53.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:02:53 gibba015 bash[29377]: audit 2021-03-10T14:02:52.465389+0000 mon.c (mon.1) 281 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T14:02:53.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:02:53 gibba015 bash[29377]: audit 2021-03-10T14:02:52.466129+0000 mon.c (mon.1) 282 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:02:53.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:02:53 gibba015 bash[29377]: audit 2021-03-10T14:02:52.466623+0000 mon.a (mon.0) 646 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T14:02:53.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:02:53 gibba015 bash[29377]: audit 2021-03-10T14:02:52.466814+0000 mon.c (mon.1) 283 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:02:53.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:02:53 gibba015 bash[29377]: audit 2021-03-10T14:02:52.467644+0000 mon.c (mon.1) 284 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:02:53.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:02:53 gibba015 bash[29377]: audit 2021-03-10T14:02:52.467794+0000 mon.a (mon.0) 647 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:02:53.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:02:53 gibba015 bash[29377]: audit 2021-03-10T14:02:52.468947+0000 mon.a (mon.0) 648 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:02:53.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:02:53 gibba015 bash[29377]: audit 2021-03-10T14:02:52.469820+0000 mon.a (mon.0) 649 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:02:53.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:02:53 gibba015 bash[29377]: audit 2021-03-10T14:02:52.546050+0000 mon.c (mon.1) 285 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:02:53.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:02:53 gibba015 bash[29377]: audit 2021-03-10T14:02:52.546726+0000 mon.c (mon.1) 286 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:02:53.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:02:53 gibba015 bash[29377]: audit 2021-03-10T14:02:52.547173+0000 mon.a (mon.0) 650 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:02:53.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:02:53 gibba015 bash[29377]: audit 2021-03-10T14:02:52.548281+0000 mon.a (mon.0) 651 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:02:53.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:02:53 gibba015 bash[30343]: cluster 2021-03-10T14:02:51.495006+0000 mgr.gibba045.orlgmj (mgr.34412) 787 : cluster [DBG] pgmap v434: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:53.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:02:53 gibba015 bash[30343]: audit 2021-03-10T14:02:52.465389+0000 mon.c (mon.1) 281 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T14:02:53.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:02:53 gibba015 bash[30343]: audit 2021-03-10T14:02:52.466129+0000 mon.c (mon.1) 282 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:02:53.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:02:53 gibba015 bash[30343]: audit 2021-03-10T14:02:52.466623+0000 mon.a (mon.0) 646 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T14:02:53.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:02:53 gibba015 bash[30343]: audit 2021-03-10T14:02:52.466814+0000 mon.c (mon.1) 283 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:02:53.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:02:53 gibba015 bash[30343]: audit 2021-03-10T14:02:52.467644+0000 mon.c (mon.1) 284 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:02:53.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:02:53 gibba015 bash[30343]: audit 2021-03-10T14:02:52.467794+0000 mon.a (mon.0) 647 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:02:53.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:02:53 gibba015 bash[30343]: audit 2021-03-10T14:02:52.468947+0000 mon.a (mon.0) 648 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:02:53.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:02:53 gibba015 bash[30343]: audit 2021-03-10T14:02:52.469820+0000 mon.a (mon.0) 649 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:02:53.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:02:53 gibba015 bash[30343]: audit 2021-03-10T14:02:52.546050+0000 mon.c (mon.1) 285 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:02:53.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:02:53 gibba015 bash[30343]: audit 2021-03-10T14:02:52.546726+0000 mon.c (mon.1) 286 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:02:53.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:02:53 gibba015 bash[30343]: audit 2021-03-10T14:02:52.547173+0000 mon.a (mon.0) 650 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:02:53.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:02:53 gibba015 bash[30343]: audit 2021-03-10T14:02:52.548281+0000 mon.a (mon.0) 651 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:02:53.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:02:53 gibba045 bash[25517]: cluster 2021-03-10T14:02:51.495006+0000 mgr.gibba045.orlgmj (mgr.34412) 787 : cluster [DBG] pgmap v434: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:53.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:02:53 gibba045 bash[25517]: audit 2021-03-10T14:02:52.465389+0000 mon.c (mon.1) 281 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T14:02:53.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:02:53 gibba045 bash[25517]: audit 2021-03-10T14:02:52.466129+0000 mon.c (mon.1) 282 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:02:53.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:02:53 gibba045 bash[25517]: audit 2021-03-10T14:02:52.466623+0000 mon.a (mon.0) 646 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T14:02:53.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:02:53 gibba045 bash[25517]: audit 2021-03-10T14:02:52.466814+0000 mon.c (mon.1) 283 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:02:53.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:02:53 gibba045 bash[25517]: audit 2021-03-10T14:02:52.467644+0000 mon.c (mon.1) 284 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:02:53.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:02:53 gibba045 bash[25517]: audit 2021-03-10T14:02:52.467794+0000 mon.a (mon.0) 647 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:02:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:02:53 gibba045 bash[25517]: audit 2021-03-10T14:02:52.468947+0000 mon.a (mon.0) 648 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:02:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:02:53 gibba045 bash[25517]: audit 2021-03-10T14:02:52.469820+0000 mon.a (mon.0) 649 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:02:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:02:53 gibba045 bash[25517]: audit 2021-03-10T14:02:52.546050+0000 mon.c (mon.1) 285 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:02:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:02:53 gibba045 bash[25517]: audit 2021-03-10T14:02:52.546726+0000 mon.c (mon.1) 286 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:02:53.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:02:53 gibba045 bash[25517]: audit 2021-03-10T14:02:52.547173+0000 mon.a (mon.0) 650 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:02:53.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:02:53 gibba045 bash[25517]: audit 2021-03-10T14:02:52.548281+0000 mon.a (mon.0) 651 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:02:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:02:54 gibba015 bash[29377]: cluster 2021-03-10T14:02:53.496238+0000 mgr.gibba045.orlgmj (mgr.34412) 788 : cluster [DBG] pgmap v435: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:54.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:02:54 gibba015 bash[30343]: cluster 2021-03-10T14:02:53.496238+0000 mgr.gibba045.orlgmj (mgr.34412) 788 : cluster [DBG] pgmap v435: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:02:54 gibba045 bash[25517]: cluster 2021-03-10T14:02:53.496238+0000 mgr.gibba045.orlgmj (mgr.34412) 788 : cluster [DBG] pgmap v435: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:56.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:02:56 gibba015 bash[29377]: cluster 2021-03-10T14:02:55.497875+0000 mgr.gibba045.orlgmj (mgr.34412) 789 : cluster [DBG] pgmap v436: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:56.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:02:56 gibba015 bash[30343]: cluster 2021-03-10T14:02:55.497875+0000 mgr.gibba045.orlgmj (mgr.34412) 789 : cluster [DBG] pgmap v436: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:57.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:02:56 gibba045 bash[25517]: cluster 2021-03-10T14:02:55.497875+0000 mgr.gibba045.orlgmj (mgr.34412) 789 : cluster [DBG] pgmap v436: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:57.442 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:02:57.673 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:02:57.674 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (13m) 10m ago 19m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:02:57.674 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (18m) 8m ago 18m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:02:57.674 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (14m) 8m ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:02:57.675 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (14m) 8m ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:02:57.675 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (13m) 10m ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:02:57.675 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (13m) 10m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:02:57.675 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (12m) 8m ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:02:57.676 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (12m) 10m ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:02:57.676 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (19m) 10m ago 19m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:02:57.676 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (19m) 8m ago 19m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:02:57.676 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (11m) 10m ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:02:57.677 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (11m) 10m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:02:57.677 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (11m) 10m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:02:57.677 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (10m) 10m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:02:57.677 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (10m) 8m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:02:57.677 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (9m) 8m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:02:57.678 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (9m) 8m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:02:57.678 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (8m) 8m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:02:57.678 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (18m) 8m ago 19m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:02:57.678 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 8m ago 17m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:02:57.921 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:02:57.922 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:02:57.922 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:02:57.922 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:02:57.922 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:02:57.922 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:02:57.923 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:02:57.923 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:02:57.923 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:02:57.923 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:02:57.924 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:02:57.924 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:02:57.924 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:02:57.924 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:02:57.924 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:02:58.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:02:58 gibba015 bash[29377]: audit 2021-03-10T14:02:57.434232+0000 mgr.gibba045.orlgmj (mgr.34412) 790 : audit [DBG] from='client.44592 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:02:58.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:02:58 gibba015 bash[29377]: cluster 2021-03-10T14:02:57.499574+0000 mgr.gibba045.orlgmj (mgr.34412) 791 : cluster [DBG] pgmap v437: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:58.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:02:58 gibba015 bash[29377]: audit 2021-03-10T14:02:57.661670+0000 mgr.gibba045.orlgmj (mgr.34412) 792 : audit [DBG] from='client.44598 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:02:58.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:02:58 gibba015 bash[29377]: audit 2021-03-10T14:02:57.918818+0000 mon.a (mon.0) 652 : audit [DBG] from='client.? 172.21.2.115:0/2371296972' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:02:58.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:02:58 gibba015 bash[30343]: audit 2021-03-10T14:02:57.434232+0000 mgr.gibba045.orlgmj (mgr.34412) 790 : audit [DBG] from='client.44592 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:02:58.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:02:58 gibba015 bash[30343]: cluster 2021-03-10T14:02:57.499574+0000 mgr.gibba045.orlgmj (mgr.34412) 791 : cluster [DBG] pgmap v437: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:58.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:02:58 gibba015 bash[30343]: audit 2021-03-10T14:02:57.661670+0000 mgr.gibba045.orlgmj (mgr.34412) 792 : audit [DBG] from='client.44598 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:02:58.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:02:58 gibba015 bash[30343]: audit 2021-03-10T14:02:57.918818+0000 mon.a (mon.0) 652 : audit [DBG] from='client.? 172.21.2.115:0/2371296972' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:02:59.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:02:58 gibba045 bash[25517]: audit 2021-03-10T14:02:57.434232+0000 mgr.gibba045.orlgmj (mgr.34412) 790 : audit [DBG] from='client.44592 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:02:59.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:02:58 gibba045 bash[25517]: cluster 2021-03-10T14:02:57.499574+0000 mgr.gibba045.orlgmj (mgr.34412) 791 : cluster [DBG] pgmap v437: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:59.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:02:58 gibba045 bash[25517]: audit 2021-03-10T14:02:57.661670+0000 mgr.gibba045.orlgmj (mgr.34412) 792 : audit [DBG] from='client.44598 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:02:59.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:02:58 gibba045 bash[25517]: audit 2021-03-10T14:02:57.918818+0000 mon.a (mon.0) 652 : audit [DBG] from='client.? 172.21.2.115:0/2371296972' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:03:00.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:03:00 gibba015 bash[29377]: cluster 2021-03-10T14:02:59.501269+0000 mgr.gibba045.orlgmj (mgr.34412) 793 : cluster [DBG] pgmap v438: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:00.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:03:00 gibba015 bash[30343]: cluster 2021-03-10T14:02:59.501269+0000 mgr.gibba045.orlgmj (mgr.34412) 793 : cluster [DBG] pgmap v438: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:01.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:03:00 gibba045 bash[25517]: cluster 2021-03-10T14:02:59.501269+0000 mgr.gibba045.orlgmj (mgr.34412) 793 : cluster [DBG] pgmap v438: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:02.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:03:02 gibba015 bash[29377]: cluster 2021-03-10T14:03:01.502976+0000 mgr.gibba045.orlgmj (mgr.34412) 794 : cluster [DBG] pgmap v439: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:02.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:03:02 gibba015 bash[30343]: cluster 2021-03-10T14:03:01.502976+0000 mgr.gibba045.orlgmj (mgr.34412) 794 : cluster [DBG] pgmap v439: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:03.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:03:02 gibba045 bash[25517]: cluster 2021-03-10T14:03:01.502976+0000 mgr.gibba045.orlgmj (mgr.34412) 794 : cluster [DBG] pgmap v439: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:05.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:03:04 gibba045 bash[25517]: cluster 2021-03-10T14:03:03.504178+0000 mgr.gibba045.orlgmj (mgr.34412) 795 : cluster [DBG] pgmap v440: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:05.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:03:04 gibba015 bash[29377]: cluster 2021-03-10T14:03:03.504178+0000 mgr.gibba045.orlgmj (mgr.34412) 795 : cluster [DBG] pgmap v440: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:05.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:03:04 gibba015 bash[30343]: cluster 2021-03-10T14:03:03.504178+0000 mgr.gibba045.orlgmj (mgr.34412) 795 : cluster [DBG] pgmap v440: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:06.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:03:05 gibba045 bash[25517]: audit 2021-03-10T14:03:04.891185+0000 mon.c (mon.1) 287 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:03:06.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:03:05 gibba045 bash[25517]: audit 2021-03-10T14:03:04.897202+0000 mon.c (mon.1) 288 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:03:06.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:03:05 gibba045 bash[25517]: cephadm 2021-03-10T14:03:04.899847+0000 mgr.gibba045.orlgmj (mgr.34412) 796 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:03:06.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:03:05 gibba015 bash[29377]: audit 2021-03-10T14:03:04.891185+0000 mon.c (mon.1) 287 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:03:06.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:03:05 gibba015 bash[29377]: audit 2021-03-10T14:03:04.897202+0000 mon.c (mon.1) 288 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:03:06.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:03:05 gibba015 bash[29377]: cephadm 2021-03-10T14:03:04.899847+0000 mgr.gibba045.orlgmj (mgr.34412) 796 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:03:06.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:03:05 gibba015 bash[30343]: audit 2021-03-10T14:03:04.891185+0000 mon.c (mon.1) 287 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:03:06.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:03:05 gibba015 bash[30343]: audit 2021-03-10T14:03:04.897202+0000 mon.c (mon.1) 288 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:03:06.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:03:05 gibba015 bash[30343]: cephadm 2021-03-10T14:03:04.899847+0000 mgr.gibba045.orlgmj (mgr.34412) 796 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:03:07.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:03:06 gibba045 bash[25517]: cluster 2021-03-10T14:03:05.505754+0000 mgr.gibba045.orlgmj (mgr.34412) 797 : cluster [DBG] pgmap v441: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:07.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:03:06 gibba015 bash[29377]: cluster 2021-03-10T14:03:05.505754+0000 mgr.gibba045.orlgmj (mgr.34412) 797 : cluster [DBG] pgmap v441: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:07.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:03:06 gibba015 bash[30343]: cluster 2021-03-10T14:03:05.505754+0000 mgr.gibba045.orlgmj (mgr.34412) 797 : cluster [DBG] pgmap v441: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:09.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:03:08 gibba045 bash[25517]: cluster 2021-03-10T14:03:07.507537+0000 mgr.gibba045.orlgmj (mgr.34412) 798 : cluster [DBG] pgmap v442: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:09.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:03:08 gibba045 bash[25517]: audit 2021-03-10T14:03:08.535834+0000 mon.a (mon.0) 653 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:03:09.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:03:08 gibba015 bash[29377]: cluster 2021-03-10T14:03:07.507537+0000 mgr.gibba045.orlgmj (mgr.34412) 798 : cluster [DBG] pgmap v442: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:09.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:03:08 gibba015 bash[29377]: audit 2021-03-10T14:03:08.535834+0000 mon.a (mon.0) 653 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:03:09.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:03:08 gibba015 bash[30343]: cluster 2021-03-10T14:03:07.507537+0000 mgr.gibba045.orlgmj (mgr.34412) 798 : cluster [DBG] pgmap v442: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:09.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:03:08 gibba015 bash[30343]: audit 2021-03-10T14:03:08.535834+0000 mon.a (mon.0) 653 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:03:10.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:03:09 gibba045 bash[25517]: cephadm 2021-03-10T14:03:08.539873+0000 mgr.gibba045.orlgmj (mgr.34412) 799 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:03:10.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:03:09 gibba045 bash[25517]: audit 2021-03-10T14:03:08.762101+0000 mon.a (mon.0) 654 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:03:10.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:03:09 gibba045 bash[25517]: audit 2021-03-10T14:03:08.765720+0000 mon.c (mon.1) 289 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:03:10.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:03:09 gibba045 bash[25517]: audit 2021-03-10T14:03:08.767173+0000 mon.c (mon.1) 290 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:03:10.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:03:09 gibba045 bash[25517]: cephadm 2021-03-10T14:03:08.767886+0000 mgr.gibba045.orlgmj (mgr.34412) 800 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:03:10.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:03:09 gibba045 bash[25517]: audit 2021-03-10T14:03:08.768631+0000 mon.c (mon.1) 291 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:03:10.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:03:09 gibba045 bash[25517]: cephadm 2021-03-10T14:03:08.769776+0000 mgr.gibba045.orlgmj (mgr.34412) 801 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:03:10.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:03:09 gibba045 bash[25517]: audit 2021-03-10T14:03:08.770064+0000 mon.c (mon.1) 292 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:03:10.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:03:09 gibba045 bash[25517]: cephadm 2021-03-10T14:03:08.771054+0000 mgr.gibba045.orlgmj (mgr.34412) 802 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:03:10.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:03:09 gibba045 bash[25517]: cephadm 2021-03-10T14:03:08.771146+0000 mgr.gibba045.orlgmj (mgr.34412) 803 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:03:10.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:03:09 gibba045 bash[25517]: cephadm 2021-03-10T14:03:08.772611+0000 mgr.gibba045.orlgmj (mgr.34412) 804 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:03:10.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:03:09 gibba045 bash[25517]: cephadm 2021-03-10T14:03:08.772753+0000 mgr.gibba045.orlgmj (mgr.34412) 805 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:03:10.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:03:09 gibba045 bash[25517]: audit 2021-03-10T14:03:08.772982+0000 mon.c (mon.1) 293 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:03:10.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:03:09 gibba045 bash[25517]: cephadm 2021-03-10T14:03:08.773957+0000 mgr.gibba045.orlgmj (mgr.34412) 806 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:03:10.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:03:09 gibba045 bash[25517]: audit 2021-03-10T14:03:08.774731+0000 mon.c (mon.1) 294 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:03:10.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:03:09 gibba045 bash[25517]: cephadm 2021-03-10T14:03:08.775436+0000 mgr.gibba045.orlgmj (mgr.34412) 807 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:03:10.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:03:09 gibba045 bash[25517]: cephadm 2021-03-10T14:03:08.775506+0000 mgr.gibba045.orlgmj (mgr.34412) 808 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:03:10.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:03:09 gibba045 bash[25517]: cephadm 2021-03-10T14:03:08.776916+0000 mgr.gibba045.orlgmj (mgr.34412) 809 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:03:10.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:03:09 gibba045 bash[25517]: cephadm 2021-03-10T14:03:08.777383+0000 mgr.gibba045.orlgmj (mgr.34412) 810 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:03:10.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:03:09 gibba045 bash[25517]: cephadm 2021-03-10T14:03:08.778645+0000 mgr.gibba045.orlgmj (mgr.34412) 811 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:03:10.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:03:09 gibba045 bash[25517]: cephadm 2021-03-10T14:03:08.778790+0000 mgr.gibba045.orlgmj (mgr.34412) 812 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:03:10.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:03:09 gibba045 bash[25517]: cephadm 2021-03-10T14:03:08.778910+0000 mgr.gibba045.orlgmj (mgr.34412) 813 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:03:10.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:03:09 gibba015 bash[29377]: cephadm 2021-03-10T14:03:08.539873+0000 mgr.gibba045.orlgmj (mgr.34412) 799 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:03:10.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:03:09 gibba015 bash[29377]: audit 2021-03-10T14:03:08.762101+0000 mon.a (mon.0) 654 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:03:10.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:03:09 gibba015 bash[29377]: audit 2021-03-10T14:03:08.765720+0000 mon.c (mon.1) 289 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:03:10.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:03:09 gibba015 bash[29377]: audit 2021-03-10T14:03:08.767173+0000 mon.c (mon.1) 290 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:03:10.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:03:09 gibba015 bash[29377]: cephadm 2021-03-10T14:03:08.767886+0000 mgr.gibba045.orlgmj (mgr.34412) 800 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:03:10.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:03:09 gibba015 bash[29377]: audit 2021-03-10T14:03:08.768631+0000 mon.c (mon.1) 291 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:03:10.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:03:09 gibba015 bash[29377]: cephadm 2021-03-10T14:03:08.769776+0000 mgr.gibba045.orlgmj (mgr.34412) 801 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:03:10.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:03:09 gibba015 bash[29377]: audit 2021-03-10T14:03:08.770064+0000 mon.c (mon.1) 292 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:03:10.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:03:09 gibba015 bash[29377]: cephadm 2021-03-10T14:03:08.771054+0000 mgr.gibba045.orlgmj (mgr.34412) 802 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:03:10.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:03:09 gibba015 bash[29377]: cephadm 2021-03-10T14:03:08.771146+0000 mgr.gibba045.orlgmj (mgr.34412) 803 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:03:10.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:03:09 gibba015 bash[29377]: cephadm 2021-03-10T14:03:08.772611+0000 mgr.gibba045.orlgmj (mgr.34412) 804 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:03:10.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:03:09 gibba015 bash[29377]: cephadm 2021-03-10T14:03:08.772753+0000 mgr.gibba045.orlgmj (mgr.34412) 805 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:03:10.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:03:09 gibba015 bash[29377]: audit 2021-03-10T14:03:08.772982+0000 mon.c (mon.1) 293 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:03:10.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:03:09 gibba015 bash[29377]: cephadm 2021-03-10T14:03:08.773957+0000 mgr.gibba045.orlgmj (mgr.34412) 806 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:03:10.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:03:09 gibba015 bash[29377]: audit 2021-03-10T14:03:08.774731+0000 mon.c (mon.1) 294 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:03:10.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:03:09 gibba015 bash[29377]: cephadm 2021-03-10T14:03:08.775436+0000 mgr.gibba045.orlgmj (mgr.34412) 807 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:03:10.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:03:09 gibba015 bash[29377]: cephadm 2021-03-10T14:03:08.775506+0000 mgr.gibba045.orlgmj (mgr.34412) 808 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:03:10.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:03:09 gibba015 bash[29377]: cephadm 2021-03-10T14:03:08.776916+0000 mgr.gibba045.orlgmj (mgr.34412) 809 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:03:10.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:03:09 gibba015 bash[29377]: cephadm 2021-03-10T14:03:08.777383+0000 mgr.gibba045.orlgmj (mgr.34412) 810 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:03:10.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:03:09 gibba015 bash[29377]: cephadm 2021-03-10T14:03:08.778645+0000 mgr.gibba045.orlgmj (mgr.34412) 811 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:03:10.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:03:09 gibba015 bash[29377]: cephadm 2021-03-10T14:03:08.778790+0000 mgr.gibba045.orlgmj (mgr.34412) 812 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:03:10.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:03:09 gibba015 bash[29377]: cephadm 2021-03-10T14:03:08.778910+0000 mgr.gibba045.orlgmj (mgr.34412) 813 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:03:10.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:03:09 gibba015 bash[30343]: cephadm 2021-03-10T14:03:08.539873+0000 mgr.gibba045.orlgmj (mgr.34412) 799 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:03:10.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:03:09 gibba015 bash[30343]: audit 2021-03-10T14:03:08.762101+0000 mon.a (mon.0) 654 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:03:10.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:03:09 gibba015 bash[30343]: audit 2021-03-10T14:03:08.765720+0000 mon.c (mon.1) 289 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:03:10.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:03:09 gibba015 bash[30343]: audit 2021-03-10T14:03:08.767173+0000 mon.c (mon.1) 290 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:03:10.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:03:09 gibba015 bash[30343]: cephadm 2021-03-10T14:03:08.767886+0000 mgr.gibba045.orlgmj (mgr.34412) 800 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:03:10.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:03:09 gibba015 bash[30343]: audit 2021-03-10T14:03:08.768631+0000 mon.c (mon.1) 291 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:03:10.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:03:09 gibba015 bash[30343]: cephadm 2021-03-10T14:03:08.769776+0000 mgr.gibba045.orlgmj (mgr.34412) 801 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:03:10.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:03:09 gibba015 bash[30343]: audit 2021-03-10T14:03:08.770064+0000 mon.c (mon.1) 292 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:03:10.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:03:09 gibba015 bash[30343]: cephadm 2021-03-10T14:03:08.771054+0000 mgr.gibba045.orlgmj (mgr.34412) 802 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:03:10.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:03:09 gibba015 bash[30343]: cephadm 2021-03-10T14:03:08.771146+0000 mgr.gibba045.orlgmj (mgr.34412) 803 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:03:10.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:03:09 gibba015 bash[30343]: cephadm 2021-03-10T14:03:08.772611+0000 mgr.gibba045.orlgmj (mgr.34412) 804 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:03:10.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:03:09 gibba015 bash[30343]: cephadm 2021-03-10T14:03:08.772753+0000 mgr.gibba045.orlgmj (mgr.34412) 805 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:03:10.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:03:09 gibba015 bash[30343]: audit 2021-03-10T14:03:08.772982+0000 mon.c (mon.1) 293 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:03:10.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:03:09 gibba015 bash[30343]: cephadm 2021-03-10T14:03:08.773957+0000 mgr.gibba045.orlgmj (mgr.34412) 806 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:03:10.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:03:09 gibba015 bash[30343]: audit 2021-03-10T14:03:08.774731+0000 mon.c (mon.1) 294 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:03:10.234 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:03:09 gibba015 bash[30343]: cephadm 2021-03-10T14:03:08.775436+0000 mgr.gibba045.orlgmj (mgr.34412) 807 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:03:10.234 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:03:09 gibba015 bash[30343]: cephadm 2021-03-10T14:03:08.775506+0000 mgr.gibba045.orlgmj (mgr.34412) 808 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:03:10.234 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:03:09 gibba015 bash[30343]: cephadm 2021-03-10T14:03:08.776916+0000 mgr.gibba045.orlgmj (mgr.34412) 809 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:03:10.235 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:03:09 gibba015 bash[30343]: cephadm 2021-03-10T14:03:08.777383+0000 mgr.gibba045.orlgmj (mgr.34412) 810 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:03:10.235 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:03:09 gibba015 bash[30343]: cephadm 2021-03-10T14:03:08.778645+0000 mgr.gibba045.orlgmj (mgr.34412) 811 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:03:10.235 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:03:09 gibba015 bash[30343]: cephadm 2021-03-10T14:03:08.778790+0000 mgr.gibba045.orlgmj (mgr.34412) 812 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:03:10.235 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:03:09 gibba015 bash[30343]: cephadm 2021-03-10T14:03:08.778910+0000 mgr.gibba045.orlgmj (mgr.34412) 813 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:03:11.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:03:10 gibba045 bash[25517]: cluster 2021-03-10T14:03:09.509192+0000 mgr.gibba045.orlgmj (mgr.34412) 814 : cluster [DBG] pgmap v443: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:11.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:03:10 gibba015 bash[29377]: cluster 2021-03-10T14:03:09.509192+0000 mgr.gibba045.orlgmj (mgr.34412) 814 : cluster [DBG] pgmap v443: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:11.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:03:10 gibba015 bash[30343]: cluster 2021-03-10T14:03:09.509192+0000 mgr.gibba045.orlgmj (mgr.34412) 814 : cluster [DBG] pgmap v443: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:13.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:03:12 gibba045 bash[25517]: cluster 2021-03-10T14:03:11.511036+0000 mgr.gibba045.orlgmj (mgr.34412) 815 : cluster [DBG] pgmap v444: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:13.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:03:12 gibba015 bash[29377]: cluster 2021-03-10T14:03:11.511036+0000 mgr.gibba045.orlgmj (mgr.34412) 815 : cluster [DBG] pgmap v444: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:13.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:03:12 gibba015 bash[30343]: cluster 2021-03-10T14:03:11.511036+0000 mgr.gibba045.orlgmj (mgr.34412) 815 : cluster [DBG] pgmap v444: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:15.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:03:14 gibba045 bash[25517]: cluster 2021-03-10T14:03:13.512368+0000 mgr.gibba045.orlgmj (mgr.34412) 816 : cluster [DBG] pgmap v445: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:15.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:03:14 gibba015 bash[29377]: cluster 2021-03-10T14:03:13.512368+0000 mgr.gibba045.orlgmj (mgr.34412) 816 : cluster [DBG] pgmap v445: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:15.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:03:14 gibba015 bash[30343]: cluster 2021-03-10T14:03:13.512368+0000 mgr.gibba045.orlgmj (mgr.34412) 816 : cluster [DBG] pgmap v445: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:17.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:03:16 gibba015 bash[29377]: cluster 2021-03-10T14:03:15.513882+0000 mgr.gibba045.orlgmj (mgr.34412) 817 : cluster [DBG] pgmap v446: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:17.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:03:16 gibba015 bash[30343]: cluster 2021-03-10T14:03:15.513882+0000 mgr.gibba045.orlgmj (mgr.34412) 817 : cluster [DBG] pgmap v446: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:17.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:03:16 gibba045 bash[25517]: cluster 2021-03-10T14:03:15.513882+0000 mgr.gibba045.orlgmj (mgr.34412) 817 : cluster [DBG] pgmap v446: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:19.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:03:18 gibba015 bash[29377]: cluster 2021-03-10T14:03:17.515611+0000 mgr.gibba045.orlgmj (mgr.34412) 818 : cluster [DBG] pgmap v447: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:19.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:03:18 gibba015 bash[30343]: cluster 2021-03-10T14:03:17.515611+0000 mgr.gibba045.orlgmj (mgr.34412) 818 : cluster [DBG] pgmap v447: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:19.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:03:18 gibba045 bash[25517]: cluster 2021-03-10T14:03:17.515611+0000 mgr.gibba045.orlgmj (mgr.34412) 818 : cluster [DBG] pgmap v447: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:21.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:03:20 gibba015 bash[29377]: cluster 2021-03-10T14:03:19.517144+0000 mgr.gibba045.orlgmj (mgr.34412) 819 : cluster [DBG] pgmap v448: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:21.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:03:20 gibba015 bash[30343]: cluster 2021-03-10T14:03:19.517144+0000 mgr.gibba045.orlgmj (mgr.34412) 819 : cluster [DBG] pgmap v448: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:21.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:03:20 gibba045 bash[25517]: cluster 2021-03-10T14:03:19.517144+0000 mgr.gibba045.orlgmj (mgr.34412) 819 : cluster [DBG] pgmap v448: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:23.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:03:22 gibba015 bash[29377]: cluster 2021-03-10T14:03:21.519011+0000 mgr.gibba045.orlgmj (mgr.34412) 820 : cluster [DBG] pgmap v449: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:23.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:03:22 gibba015 bash[30343]: cluster 2021-03-10T14:03:21.519011+0000 mgr.gibba045.orlgmj (mgr.34412) 820 : cluster [DBG] pgmap v449: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:23.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:03:22 gibba045 bash[25517]: cluster 2021-03-10T14:03:21.519011+0000 mgr.gibba045.orlgmj (mgr.34412) 820 : cluster [DBG] pgmap v449: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:25.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:03:24 gibba015 bash[29377]: cluster 2021-03-10T14:03:23.520318+0000 mgr.gibba045.orlgmj (mgr.34412) 821 : cluster [DBG] pgmap v450: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:25.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:03:24 gibba015 bash[29377]: cephadm 2021-03-10T14:03:23.788933+0000 mgr.gibba045.orlgmj (mgr.34412) 822 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:03:25.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:03:24 gibba015 bash[30343]: cluster 2021-03-10T14:03:23.520318+0000 mgr.gibba045.orlgmj (mgr.34412) 821 : cluster [DBG] pgmap v450: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:25.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:03:24 gibba015 bash[30343]: cephadm 2021-03-10T14:03:23.788933+0000 mgr.gibba045.orlgmj (mgr.34412) 822 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:03:25.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:03:24 gibba045 bash[25517]: cluster 2021-03-10T14:03:23.520318+0000 mgr.gibba045.orlgmj (mgr.34412) 821 : cluster [DBG] pgmap v450: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:25.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:03:24 gibba045 bash[25517]: cephadm 2021-03-10T14:03:23.788933+0000 mgr.gibba045.orlgmj (mgr.34412) 822 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:03:27.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:03:26 gibba015 bash[29377]: cluster 2021-03-10T14:03:25.522000+0000 mgr.gibba045.orlgmj (mgr.34412) 823 : cluster [DBG] pgmap v451: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:27.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:03:26 gibba015 bash[30343]: cluster 2021-03-10T14:03:25.522000+0000 mgr.gibba045.orlgmj (mgr.34412) 823 : cluster [DBG] pgmap v451: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:27.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:03:26 gibba045 bash[25517]: cluster 2021-03-10T14:03:25.522000+0000 mgr.gibba045.orlgmj (mgr.34412) 823 : cluster [DBG] pgmap v451: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:28.170 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:03:28.398 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:03:28.399 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (14m) 19s ago 19m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:03:28.399 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (19m) 9m ago 19m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:03:28.399 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (14m) 9m ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:03:28.399 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (14m) 9m ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:03:28.400 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (13m) 19s ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:03:28.400 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (13m) 19s ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:03:28.400 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (13m) 9m ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:03:28.400 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (13m) 19s ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:03:28.401 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (19m) 19s ago 19m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:03:28.401 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (19m) 9m ago 19m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:03:28.401 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (12m) 19s ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:03:28.401 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (12m) 19s ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:03:28.402 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (11m) 19s ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:03:28.402 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (11m) 19s ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:03:28.402 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (10m) 9m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:03:28.402 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (10m) 9m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:03:28.403 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (9m) 9m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:03:28.403 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (9m) 9m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:03:28.403 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (19m) 9m ago 19m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:03:28.403 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 9m ago 17m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:03:28.647 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:03:28.648 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:03:28.648 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:03:28.649 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:03:28.649 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:03:28.650 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:03:28.650 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:03:28.651 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:03:28.651 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:03:28.652 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:03:28.652 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:03:28.653 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:03:28.653 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:03:28.654 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:03:28.654 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:03:29.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:03:28 gibba015 bash[29377]: cluster 2021-03-10T14:03:27.523774+0000 mgr.gibba045.orlgmj (mgr.34412) 824 : cluster [DBG] pgmap v452: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:29.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:03:28 gibba015 bash[29377]: audit 2021-03-10T14:03:28.644758+0000 mon.c (mon.1) 295 : audit [DBG] from='client.? 172.21.2.115:0/3243604351' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:03:29.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:03:28 gibba015 bash[30343]: cluster 2021-03-10T14:03:27.523774+0000 mgr.gibba045.orlgmj (mgr.34412) 824 : cluster [DBG] pgmap v452: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:29.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:03:28 gibba015 bash[30343]: audit 2021-03-10T14:03:28.644758+0000 mon.c (mon.1) 295 : audit [DBG] from='client.? 172.21.2.115:0/3243604351' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:03:29.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:03:28 gibba045 bash[25517]: cluster 2021-03-10T14:03:27.523774+0000 mgr.gibba045.orlgmj (mgr.34412) 824 : cluster [DBG] pgmap v452: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:29.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:03:28 gibba045 bash[25517]: audit 2021-03-10T14:03:28.644758+0000 mon.c (mon.1) 295 : audit [DBG] from='client.? 172.21.2.115:0/3243604351' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:03:30.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:03:29 gibba015 bash[29377]: audit 2021-03-10T14:03:28.161087+0000 mgr.gibba045.orlgmj (mgr.34412) 825 : audit [DBG] from='client.44610 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:03:30.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:03:29 gibba015 bash[29377]: audit 2021-03-10T14:03:28.386476+0000 mgr.gibba045.orlgmj (mgr.34412) 826 : audit [DBG] from='client.44616 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:03:30.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:03:29 gibba015 bash[30343]: audit 2021-03-10T14:03:28.161087+0000 mgr.gibba045.orlgmj (mgr.34412) 825 : audit [DBG] from='client.44610 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:03:30.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:03:29 gibba015 bash[30343]: audit 2021-03-10T14:03:28.386476+0000 mgr.gibba045.orlgmj (mgr.34412) 826 : audit [DBG] from='client.44616 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:03:30.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:03:29 gibba045 bash[25517]: audit 2021-03-10T14:03:28.161087+0000 mgr.gibba045.orlgmj (mgr.34412) 825 : audit [DBG] from='client.44610 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:03:30.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:03:29 gibba045 bash[25517]: audit 2021-03-10T14:03:28.386476+0000 mgr.gibba045.orlgmj (mgr.34412) 826 : audit [DBG] from='client.44616 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:03:31.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:03:30 gibba015 bash[29377]: cluster 2021-03-10T14:03:29.525446+0000 mgr.gibba045.orlgmj (mgr.34412) 827 : cluster [DBG] pgmap v453: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:31.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:03:30 gibba015 bash[30343]: cluster 2021-03-10T14:03:29.525446+0000 mgr.gibba045.orlgmj (mgr.34412) 827 : cluster [DBG] pgmap v453: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:31.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:03:30 gibba045 bash[25517]: cluster 2021-03-10T14:03:29.525446+0000 mgr.gibba045.orlgmj (mgr.34412) 827 : cluster [DBG] pgmap v453: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:33.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:03:32 gibba015 bash[29377]: cluster 2021-03-10T14:03:31.527337+0000 mgr.gibba045.orlgmj (mgr.34412) 828 : cluster [DBG] pgmap v454: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:33.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:03:32 gibba015 bash[30343]: cluster 2021-03-10T14:03:31.527337+0000 mgr.gibba045.orlgmj (mgr.34412) 828 : cluster [DBG] pgmap v454: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:33.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:03:32 gibba045 bash[25517]: cluster 2021-03-10T14:03:31.527337+0000 mgr.gibba045.orlgmj (mgr.34412) 828 : cluster [DBG] pgmap v454: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:35.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:03:34 gibba015 bash[29377]: cluster 2021-03-10T14:03:33.528590+0000 mgr.gibba045.orlgmj (mgr.34412) 829 : cluster [DBG] pgmap v455: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:35.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:03:34 gibba015 bash[30343]: cluster 2021-03-10T14:03:33.528590+0000 mgr.gibba045.orlgmj (mgr.34412) 829 : cluster [DBG] pgmap v455: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:35.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:03:34 gibba045 bash[25517]: cluster 2021-03-10T14:03:33.528590+0000 mgr.gibba045.orlgmj (mgr.34412) 829 : cluster [DBG] pgmap v455: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:37.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:03:36 gibba015 bash[29377]: cluster 2021-03-10T14:03:35.530206+0000 mgr.gibba045.orlgmj (mgr.34412) 830 : cluster [DBG] pgmap v456: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:37.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:03:36 gibba015 bash[30343]: cluster 2021-03-10T14:03:35.530206+0000 mgr.gibba045.orlgmj (mgr.34412) 830 : cluster [DBG] pgmap v456: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:37.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:03:36 gibba045 bash[25517]: cluster 2021-03-10T14:03:35.530206+0000 mgr.gibba045.orlgmj (mgr.34412) 830 : cluster [DBG] pgmap v456: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:39.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:03:38 gibba045 bash[25517]: cluster 2021-03-10T14:03:37.531816+0000 mgr.gibba045.orlgmj (mgr.34412) 831 : cluster [DBG] pgmap v457: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:39.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:03:38 gibba015 bash[29377]: cluster 2021-03-10T14:03:37.531816+0000 mgr.gibba045.orlgmj (mgr.34412) 831 : cluster [DBG] pgmap v457: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:39.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:03:38 gibba015 bash[30343]: cluster 2021-03-10T14:03:37.531816+0000 mgr.gibba045.orlgmj (mgr.34412) 831 : cluster [DBG] pgmap v457: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:40.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:03:39 gibba015 bash[29377]: cephadm 2021-03-10T14:03:38.800638+0000 mgr.gibba045.orlgmj (mgr.34412) 832 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:03:40.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:03:39 gibba015 bash[30343]: cephadm 2021-03-10T14:03:38.800638+0000 mgr.gibba045.orlgmj (mgr.34412) 832 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:03:40.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:03:39 gibba045 bash[25517]: cephadm 2021-03-10T14:03:38.800638+0000 mgr.gibba045.orlgmj (mgr.34412) 832 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:03:41.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:03:40 gibba015 bash[29377]: cluster 2021-03-10T14:03:39.533480+0000 mgr.gibba045.orlgmj (mgr.34412) 833 : cluster [DBG] pgmap v458: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:41.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:03:40 gibba015 bash[30343]: cluster 2021-03-10T14:03:39.533480+0000 mgr.gibba045.orlgmj (mgr.34412) 833 : cluster [DBG] pgmap v458: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:41.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:03:40 gibba045 bash[25517]: cluster 2021-03-10T14:03:39.533480+0000 mgr.gibba045.orlgmj (mgr.34412) 833 : cluster [DBG] pgmap v458: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:43.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:03:42 gibba015 bash[29377]: cluster 2021-03-10T14:03:41.535405+0000 mgr.gibba045.orlgmj (mgr.34412) 834 : cluster [DBG] pgmap v459: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:43.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:03:42 gibba015 bash[30343]: cluster 2021-03-10T14:03:41.535405+0000 mgr.gibba045.orlgmj (mgr.34412) 834 : cluster [DBG] pgmap v459: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:43.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:03:42 gibba045 bash[25517]: cluster 2021-03-10T14:03:41.535405+0000 mgr.gibba045.orlgmj (mgr.34412) 834 : cluster [DBG] pgmap v459: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:45.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:03:44 gibba015 bash[29377]: cluster 2021-03-10T14:03:43.536501+0000 mgr.gibba045.orlgmj (mgr.34412) 835 : cluster [DBG] pgmap v460: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:45.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:03:44 gibba015 bash[30343]: cluster 2021-03-10T14:03:43.536501+0000 mgr.gibba045.orlgmj (mgr.34412) 835 : cluster [DBG] pgmap v460: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:45.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:03:44 gibba045 bash[25517]: cluster 2021-03-10T14:03:43.536501+0000 mgr.gibba045.orlgmj (mgr.34412) 835 : cluster [DBG] pgmap v460: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:47.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:03:46 gibba015 bash[29377]: cluster 2021-03-10T14:03:45.538188+0000 mgr.gibba045.orlgmj (mgr.34412) 836 : cluster [DBG] pgmap v461: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:47.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:03:46 gibba015 bash[30343]: cluster 2021-03-10T14:03:45.538188+0000 mgr.gibba045.orlgmj (mgr.34412) 836 : cluster [DBG] pgmap v461: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:47.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:03:46 gibba045 bash[25517]: cluster 2021-03-10T14:03:45.538188+0000 mgr.gibba045.orlgmj (mgr.34412) 836 : cluster [DBG] pgmap v461: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:49.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:03:48 gibba015 bash[29377]: cluster 2021-03-10T14:03:47.539900+0000 mgr.gibba045.orlgmj (mgr.34412) 837 : cluster [DBG] pgmap v462: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:49.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:03:48 gibba015 bash[30343]: cluster 2021-03-10T14:03:47.539900+0000 mgr.gibba045.orlgmj (mgr.34412) 837 : cluster [DBG] pgmap v462: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:49.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:03:48 gibba045 bash[25517]: cluster 2021-03-10T14:03:47.539900+0000 mgr.gibba045.orlgmj (mgr.34412) 837 : cluster [DBG] pgmap v462: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:51.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:03:50 gibba015 bash[29377]: cluster 2021-03-10T14:03:49.541514+0000 mgr.gibba045.orlgmj (mgr.34412) 838 : cluster [DBG] pgmap v463: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:51.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:03:50 gibba015 bash[30343]: cluster 2021-03-10T14:03:49.541514+0000 mgr.gibba045.orlgmj (mgr.34412) 838 : cluster [DBG] pgmap v463: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:51.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:03:50 gibba045 bash[25517]: cluster 2021-03-10T14:03:49.541514+0000 mgr.gibba045.orlgmj (mgr.34412) 838 : cluster [DBG] pgmap v463: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:53.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:03:52 gibba045 bash[25517]: cluster 2021-03-10T14:03:51.543362+0000 mgr.gibba045.orlgmj (mgr.34412) 839 : cluster [DBG] pgmap v464: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:53.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:03:52 gibba045 bash[25517]: audit 2021-03-10T14:03:52.475657+0000 mon.c (mon.1) 296 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T14:03:53.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:03:52 gibba045 bash[25517]: audit 2021-03-10T14:03:52.476381+0000 mon.c (mon.1) 297 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:03:53.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:03:52 gibba045 bash[25517]: audit 2021-03-10T14:03:52.476859+0000 mon.a (mon.0) 655 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T14:03:53.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:03:52 gibba045 bash[25517]: audit 2021-03-10T14:03:52.477041+0000 mon.c (mon.1) 298 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:03:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:03:52 gibba045 bash[25517]: audit 2021-03-10T14:03:52.478028+0000 mon.c (mon.1) 299 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:03:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:03:52 gibba045 bash[25517]: audit 2021-03-10T14:03:52.478474+0000 mon.a (mon.0) 656 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:03:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:03:52 gibba045 bash[25517]: audit 2021-03-10T14:03:52.479336+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:03:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:03:52 gibba045 bash[25517]: audit 2021-03-10T14:03:52.480377+0000 mon.a (mon.0) 658 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:03:53.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:03:52 gibba045 bash[25517]: audit 2021-03-10T14:03:52.553025+0000 mon.c (mon.1) 300 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:03:53.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:03:52 gibba045 bash[25517]: audit 2021-03-10T14:03:52.553681+0000 mon.c (mon.1) 301 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:03:53.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:03:52 gibba045 bash[25517]: audit 2021-03-10T14:03:52.554182+0000 mon.a (mon.0) 659 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:03:53.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:03:52 gibba045 bash[25517]: audit 2021-03-10T14:03:52.555296+0000 mon.a (mon.0) 660 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:03:53.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:03:52 gibba015 bash[29377]: cluster 2021-03-10T14:03:51.543362+0000 mgr.gibba045.orlgmj (mgr.34412) 839 : cluster [DBG] pgmap v464: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:53.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:03:52 gibba015 bash[29377]: audit 2021-03-10T14:03:52.475657+0000 mon.c (mon.1) 296 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T14:03:53.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:03:52 gibba015 bash[29377]: audit 2021-03-10T14:03:52.476381+0000 mon.c (mon.1) 297 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:03:53.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:03:52 gibba015 bash[29377]: audit 2021-03-10T14:03:52.476859+0000 mon.a (mon.0) 655 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T14:03:53.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:03:52 gibba015 bash[29377]: audit 2021-03-10T14:03:52.477041+0000 mon.c (mon.1) 298 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:03:53.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:03:52 gibba015 bash[29377]: audit 2021-03-10T14:03:52.478028+0000 mon.c (mon.1) 299 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:03:53.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:03:52 gibba015 bash[29377]: audit 2021-03-10T14:03:52.478474+0000 mon.a (mon.0) 656 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:03:53.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:03:52 gibba015 bash[29377]: audit 2021-03-10T14:03:52.479336+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:03:53.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:03:52 gibba015 bash[29377]: audit 2021-03-10T14:03:52.480377+0000 mon.a (mon.0) 658 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:03:53.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:03:52 gibba015 bash[29377]: audit 2021-03-10T14:03:52.553025+0000 mon.c (mon.1) 300 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:03:53.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:03:52 gibba015 bash[29377]: audit 2021-03-10T14:03:52.553681+0000 mon.c (mon.1) 301 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:03:53.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:03:52 gibba015 bash[29377]: audit 2021-03-10T14:03:52.554182+0000 mon.a (mon.0) 659 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:03:53.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:03:52 gibba015 bash[29377]: audit 2021-03-10T14:03:52.555296+0000 mon.a (mon.0) 660 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:03:53.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:03:52 gibba015 bash[30343]: cluster 2021-03-10T14:03:51.543362+0000 mgr.gibba045.orlgmj (mgr.34412) 839 : cluster [DBG] pgmap v464: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:53.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:03:52 gibba015 bash[30343]: audit 2021-03-10T14:03:52.475657+0000 mon.c (mon.1) 296 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T14:03:53.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:03:52 gibba015 bash[30343]: audit 2021-03-10T14:03:52.476381+0000 mon.c (mon.1) 297 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:03:53.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:03:52 gibba015 bash[30343]: audit 2021-03-10T14:03:52.476859+0000 mon.a (mon.0) 655 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T14:03:53.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:03:52 gibba015 bash[30343]: audit 2021-03-10T14:03:52.477041+0000 mon.c (mon.1) 298 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:03:53.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:03:52 gibba015 bash[30343]: audit 2021-03-10T14:03:52.478028+0000 mon.c (mon.1) 299 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:03:53.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:03:52 gibba015 bash[30343]: audit 2021-03-10T14:03:52.478474+0000 mon.a (mon.0) 656 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:03:53.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:03:52 gibba015 bash[30343]: audit 2021-03-10T14:03:52.479336+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:03:53.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:03:52 gibba015 bash[30343]: audit 2021-03-10T14:03:52.480377+0000 mon.a (mon.0) 658 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:03:53.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:03:52 gibba015 bash[30343]: audit 2021-03-10T14:03:52.553025+0000 mon.c (mon.1) 300 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:03:53.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:03:52 gibba015 bash[30343]: audit 2021-03-10T14:03:52.553681+0000 mon.c (mon.1) 301 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:03:53.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:03:52 gibba015 bash[30343]: audit 2021-03-10T14:03:52.554182+0000 mon.a (mon.0) 659 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:03:53.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:03:52 gibba015 bash[30343]: audit 2021-03-10T14:03:52.555296+0000 mon.a (mon.0) 660 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:03:55.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:03:54 gibba045 bash[25517]: cluster 2021-03-10T14:03:53.544661+0000 mgr.gibba045.orlgmj (mgr.34412) 840 : cluster [DBG] pgmap v465: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:55.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:03:54 gibba045 bash[25517]: cephadm 2021-03-10T14:03:53.812685+0000 mgr.gibba045.orlgmj (mgr.34412) 841 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:03:55.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:03:54 gibba015 bash[29377]: cluster 2021-03-10T14:03:53.544661+0000 mgr.gibba045.orlgmj (mgr.34412) 840 : cluster [DBG] pgmap v465: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:55.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:03:54 gibba015 bash[29377]: cephadm 2021-03-10T14:03:53.812685+0000 mgr.gibba045.orlgmj (mgr.34412) 841 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:03:55.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:03:54 gibba015 bash[30343]: cluster 2021-03-10T14:03:53.544661+0000 mgr.gibba045.orlgmj (mgr.34412) 840 : cluster [DBG] pgmap v465: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:55.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:03:54 gibba015 bash[30343]: cephadm 2021-03-10T14:03:53.812685+0000 mgr.gibba045.orlgmj (mgr.34412) 841 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:03:57.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:03:56 gibba045 bash[25517]: cluster 2021-03-10T14:03:55.546305+0000 mgr.gibba045.orlgmj (mgr.34412) 842 : cluster [DBG] pgmap v466: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:57.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:03:56 gibba015 bash[29377]: cluster 2021-03-10T14:03:55.546305+0000 mgr.gibba045.orlgmj (mgr.34412) 842 : cluster [DBG] pgmap v466: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:57.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:03:56 gibba015 bash[30343]: cluster 2021-03-10T14:03:55.546305+0000 mgr.gibba045.orlgmj (mgr.34412) 842 : cluster [DBG] pgmap v466: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:58.898 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:03:59.127 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:03:59.128 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (14m) 50s ago 20m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:03:59.128 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (19m) 9m ago 19m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:03:59.128 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (15m) 9m ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:03:59.128 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (15m) 9m ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:03:59.129 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (14m) 50s ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:03:59.129 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (14m) 50s ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:03:59.129 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (13m) 9m ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:03:59.129 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (13m) 50s ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:03:59.130 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (20m) 50s ago 20m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:03:59.130 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (20m) 9m ago 20m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:03:59.130 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (13m) 50s ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:03:59.130 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (12m) 50s ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:03:59.130 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (12m) 50s ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:03:59.131 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (11m) 50s ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:03:59.131 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (11m) 9m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:03:59.131 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (10m) 9m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:03:59.131 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (10m) 9m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:03:59.132 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (10m) 9m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:03:59.132 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (19m) 9m ago 20m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:03:59.132 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 9m ago 18m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:03:59.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:03:59 gibba045 bash[25517]: cluster 2021-03-10T14:03:57.548041+0000 mgr.gibba045.orlgmj (mgr.34412) 843 : cluster [DBG] pgmap v467: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:59.375 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:03:59.375 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:03:59.375 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:03:59.376 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:03:59.376 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:03:59.376 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:03:59.376 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:03:59.377 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:03:59.377 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:03:59.377 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:03:59.377 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:03:59.378 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:03:59.378 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:03:59.378 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:03:59.378 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:03:59.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:03:58 gibba015 bash[29377]: cluster 2021-03-10T14:03:57.548041+0000 mgr.gibba045.orlgmj (mgr.34412) 843 : cluster [DBG] pgmap v467: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:59.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:03:59 gibba015 bash[30343]: cluster 2021-03-10T14:03:57.548041+0000 mgr.gibba045.orlgmj (mgr.34412) 843 : cluster [DBG] pgmap v467: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:00.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:04:00 gibba045 bash[25517]: audit 2021-03-10T14:03:58.879863+0000 mgr.gibba045.orlgmj (mgr.34412) 844 : audit [DBG] from='client.54616 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:04:00.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:04:00 gibba045 bash[25517]: audit 2021-03-10T14:03:59.372468+0000 mon.c (mon.1) 302 : audit [DBG] from='client.? 172.21.2.115:0/2096646684' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:04:00.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:04:00 gibba015 bash[29377]: audit 2021-03-10T14:03:58.879863+0000 mgr.gibba045.orlgmj (mgr.34412) 844 : audit [DBG] from='client.54616 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:04:00.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:04:00 gibba015 bash[29377]: audit 2021-03-10T14:03:59.372468+0000 mon.c (mon.1) 302 : audit [DBG] from='client.? 172.21.2.115:0/2096646684' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:04:00.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:04:00 gibba015 bash[30343]: audit 2021-03-10T14:03:58.879863+0000 mgr.gibba045.orlgmj (mgr.34412) 844 : audit [DBG] from='client.54616 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:04:00.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:04:00 gibba015 bash[30343]: audit 2021-03-10T14:03:59.372468+0000 mon.c (mon.1) 302 : audit [DBG] from='client.? 172.21.2.115:0/2096646684' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:04:01.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:04:01 gibba045 bash[25517]: audit 2021-03-10T14:03:59.115206+0000 mgr.gibba045.orlgmj (mgr.34412) 845 : audit [DBG] from='client.44634 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:04:01.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:04:01 gibba045 bash[25517]: cluster 2021-03-10T14:03:59.549556+0000 mgr.gibba045.orlgmj (mgr.34412) 846 : cluster [DBG] pgmap v468: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:01.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:04:01 gibba015 bash[29377]: audit 2021-03-10T14:03:59.115206+0000 mgr.gibba045.orlgmj (mgr.34412) 845 : audit [DBG] from='client.44634 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:04:01.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:04:01 gibba015 bash[29377]: cluster 2021-03-10T14:03:59.549556+0000 mgr.gibba045.orlgmj (mgr.34412) 846 : cluster [DBG] pgmap v468: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:01.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:04:01 gibba015 bash[30343]: audit 2021-03-10T14:03:59.115206+0000 mgr.gibba045.orlgmj (mgr.34412) 845 : audit [DBG] from='client.44634 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:04:01.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:04:01 gibba015 bash[30343]: cluster 2021-03-10T14:03:59.549556+0000 mgr.gibba045.orlgmj (mgr.34412) 846 : cluster [DBG] pgmap v468: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:03.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:04:03 gibba045 bash[25517]: cluster 2021-03-10T14:04:01.551170+0000 mgr.gibba045.orlgmj (mgr.34412) 847 : cluster [DBG] pgmap v469: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:03.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:04:03 gibba015 bash[29377]: cluster 2021-03-10T14:04:01.551170+0000 mgr.gibba045.orlgmj (mgr.34412) 847 : cluster [DBG] pgmap v469: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:03.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:04:03 gibba015 bash[30343]: cluster 2021-03-10T14:04:01.551170+0000 mgr.gibba045.orlgmj (mgr.34412) 847 : cluster [DBG] pgmap v469: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:05.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:04:05 gibba045 bash[25517]: cluster 2021-03-10T14:04:03.552339+0000 mgr.gibba045.orlgmj (mgr.34412) 848 : cluster [DBG] pgmap v470: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:05.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:04:05 gibba015 bash[29377]: cluster 2021-03-10T14:04:03.552339+0000 mgr.gibba045.orlgmj (mgr.34412) 848 : cluster [DBG] pgmap v470: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:05.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:04:05 gibba015 bash[30343]: cluster 2021-03-10T14:04:03.552339+0000 mgr.gibba045.orlgmj (mgr.34412) 848 : cluster [DBG] pgmap v470: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:07.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:04:07 gibba045 bash[25517]: cluster 2021-03-10T14:04:05.553736+0000 mgr.gibba045.orlgmj (mgr.34412) 849 : cluster [DBG] pgmap v471: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:07.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:04:07 gibba015 bash[29377]: cluster 2021-03-10T14:04:05.553736+0000 mgr.gibba045.orlgmj (mgr.34412) 849 : cluster [DBG] pgmap v471: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:07.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:04:07 gibba015 bash[30343]: cluster 2021-03-10T14:04:05.553736+0000 mgr.gibba045.orlgmj (mgr.34412) 849 : cluster [DBG] pgmap v471: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:09.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:04:09 gibba045 bash[25517]: cluster 2021-03-10T14:04:07.555232+0000 mgr.gibba045.orlgmj (mgr.34412) 850 : cluster [DBG] pgmap v472: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:09.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:04:09 gibba045 bash[25517]: audit 2021-03-10T14:04:08.823132+0000 mon.c (mon.1) 303 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:04:09.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:04:09 gibba045 bash[25517]: audit 2021-03-10T14:04:08.829852+0000 mon.c (mon.1) 304 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:04:09.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:04:09 gibba015 bash[29377]: cluster 2021-03-10T14:04:07.555232+0000 mgr.gibba045.orlgmj (mgr.34412) 850 : cluster [DBG] pgmap v472: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:09.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:04:09 gibba015 bash[29377]: audit 2021-03-10T14:04:08.823132+0000 mon.c (mon.1) 303 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:04:09.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:04:09 gibba015 bash[29377]: audit 2021-03-10T14:04:08.829852+0000 mon.c (mon.1) 304 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:04:09.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:04:09 gibba015 bash[30343]: cluster 2021-03-10T14:04:07.555232+0000 mgr.gibba045.orlgmj (mgr.34412) 850 : cluster [DBG] pgmap v472: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:09.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:04:09 gibba015 bash[30343]: audit 2021-03-10T14:04:08.823132+0000 mon.c (mon.1) 303 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:04:09.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:04:09 gibba015 bash[30343]: audit 2021-03-10T14:04:08.829852+0000 mon.c (mon.1) 304 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:04:10.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:04:10 gibba045 bash[25517]: cephadm 2021-03-10T14:04:08.831091+0000 mgr.gibba045.orlgmj (mgr.34412) 851 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:04:10.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:04:10 gibba015 bash[29377]: cephadm 2021-03-10T14:04:08.831091+0000 mgr.gibba045.orlgmj (mgr.34412) 851 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:04:10.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:04:10 gibba015 bash[30343]: cephadm 2021-03-10T14:04:08.831091+0000 mgr.gibba045.orlgmj (mgr.34412) 851 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:04:11.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:04:11 gibba015 bash[29377]: cluster 2021-03-10T14:04:09.556549+0000 mgr.gibba045.orlgmj (mgr.34412) 852 : cluster [DBG] pgmap v473: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:11.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:04:11 gibba015 bash[30343]: cluster 2021-03-10T14:04:09.556549+0000 mgr.gibba045.orlgmj (mgr.34412) 852 : cluster [DBG] pgmap v473: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:11.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:04:11 gibba045 bash[25517]: cluster 2021-03-10T14:04:09.556549+0000 mgr.gibba045.orlgmj (mgr.34412) 852 : cluster [DBG] pgmap v473: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:13.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:04:13 gibba015 bash[29377]: cluster 2021-03-10T14:04:11.558212+0000 mgr.gibba045.orlgmj (mgr.34412) 853 : cluster [DBG] pgmap v474: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:13.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:04:13 gibba015 bash[29377]: audit 2021-03-10T14:04:12.540056+0000 mon.a (mon.0) 661 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:04:13.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:04:13 gibba015 bash[29377]: audit 2021-03-10T14:04:12.757863+0000 mon.a (mon.0) 662 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:04:13.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:04:13 gibba015 bash[29377]: audit 2021-03-10T14:04:12.761383+0000 mon.c (mon.1) 305 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:04:13.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:04:13 gibba015 bash[29377]: audit 2021-03-10T14:04:12.763722+0000 mon.c (mon.1) 306 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:04:13.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:04:13 gibba015 bash[29377]: audit 2021-03-10T14:04:12.765363+0000 mon.c (mon.1) 307 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:04:13.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:04:13 gibba015 bash[29377]: audit 2021-03-10T14:04:12.766832+0000 mon.c (mon.1) 308 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:04:13.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:04:13 gibba015 bash[29377]: audit 2021-03-10T14:04:12.770166+0000 mon.c (mon.1) 309 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:04:13.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:04:13 gibba015 bash[29377]: audit 2021-03-10T14:04:12.771568+0000 mon.c (mon.1) 310 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:04:13.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:04:13 gibba015 bash[30343]: cluster 2021-03-10T14:04:11.558212+0000 mgr.gibba045.orlgmj (mgr.34412) 853 : cluster [DBG] pgmap v474: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:13.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:04:13 gibba015 bash[30343]: audit 2021-03-10T14:04:12.540056+0000 mon.a (mon.0) 661 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:04:13.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:04:13 gibba015 bash[30343]: audit 2021-03-10T14:04:12.757863+0000 mon.a (mon.0) 662 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:04:13.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:04:13 gibba015 bash[30343]: audit 2021-03-10T14:04:12.761383+0000 mon.c (mon.1) 305 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:04:13.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:04:13 gibba015 bash[30343]: audit 2021-03-10T14:04:12.763722+0000 mon.c (mon.1) 306 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:04:13.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:04:13 gibba015 bash[30343]: audit 2021-03-10T14:04:12.765363+0000 mon.c (mon.1) 307 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:04:13.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:04:13 gibba015 bash[30343]: audit 2021-03-10T14:04:12.766832+0000 mon.c (mon.1) 308 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:04:13.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:04:13 gibba015 bash[30343]: audit 2021-03-10T14:04:12.770166+0000 mon.c (mon.1) 309 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:04:13.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:04:13 gibba015 bash[30343]: audit 2021-03-10T14:04:12.771568+0000 mon.c (mon.1) 310 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:04:13.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:04:13 gibba045 bash[25517]: cluster 2021-03-10T14:04:11.558212+0000 mgr.gibba045.orlgmj (mgr.34412) 853 : cluster [DBG] pgmap v474: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:13.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:04:13 gibba045 bash[25517]: audit 2021-03-10T14:04:12.540056+0000 mon.a (mon.0) 661 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:04:13.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:04:13 gibba045 bash[25517]: audit 2021-03-10T14:04:12.757863+0000 mon.a (mon.0) 662 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:04:13.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:04:13 gibba045 bash[25517]: audit 2021-03-10T14:04:12.761383+0000 mon.c (mon.1) 305 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:04:13.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:04:13 gibba045 bash[25517]: audit 2021-03-10T14:04:12.763722+0000 mon.c (mon.1) 306 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:04:13.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:04:13 gibba045 bash[25517]: audit 2021-03-10T14:04:12.765363+0000 mon.c (mon.1) 307 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:04:13.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:04:13 gibba045 bash[25517]: audit 2021-03-10T14:04:12.766832+0000 mon.c (mon.1) 308 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:04:13.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:04:13 gibba045 bash[25517]: audit 2021-03-10T14:04:12.770166+0000 mon.c (mon.1) 309 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:04:13.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:04:13 gibba045 bash[25517]: audit 2021-03-10T14:04:12.771568+0000 mon.c (mon.1) 310 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:04:14.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:04:14 gibba015 bash[29377]: cephadm 2021-03-10T14:04:12.544249+0000 mgr.gibba045.orlgmj (mgr.34412) 854 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:04:14.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:04:14 gibba015 bash[29377]: cephadm 2021-03-10T14:04:12.763655+0000 mgr.gibba045.orlgmj (mgr.34412) 855 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:04:14.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:04:14 gibba015 bash[29377]: cephadm 2021-03-10T14:04:12.765953+0000 mgr.gibba045.orlgmj (mgr.34412) 856 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:04:14.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:04:14 gibba015 bash[29377]: cephadm 2021-03-10T14:04:12.767778+0000 mgr.gibba045.orlgmj (mgr.34412) 857 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:04:14.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:04:14 gibba015 bash[29377]: cephadm 2021-03-10T14:04:12.767822+0000 mgr.gibba045.orlgmj (mgr.34412) 858 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:04:14.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:04:14 gibba015 bash[29377]: cephadm 2021-03-10T14:04:12.769260+0000 mgr.gibba045.orlgmj (mgr.34412) 859 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:04:14.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:04:14 gibba015 bash[29377]: cephadm 2021-03-10T14:04:12.769295+0000 mgr.gibba045.orlgmj (mgr.34412) 860 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:04:14.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:04:14 gibba015 bash[29377]: cephadm 2021-03-10T14:04:12.771326+0000 mgr.gibba045.orlgmj (mgr.34412) 861 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:04:14.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:04:14 gibba015 bash[29377]: cephadm 2021-03-10T14:04:12.772742+0000 mgr.gibba045.orlgmj (mgr.34412) 862 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:04:14.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:04:14 gibba015 bash[29377]: cephadm 2021-03-10T14:04:12.772778+0000 mgr.gibba045.orlgmj (mgr.34412) 863 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:04:14.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:04:14 gibba015 bash[29377]: cephadm 2021-03-10T14:04:12.773891+0000 mgr.gibba045.orlgmj (mgr.34412) 864 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:04:14.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:04:14 gibba015 bash[29377]: cephadm 2021-03-10T14:04:12.774293+0000 mgr.gibba045.orlgmj (mgr.34412) 865 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:04:14.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:04:14 gibba015 bash[29377]: cephadm 2021-03-10T14:04:12.775447+0000 mgr.gibba045.orlgmj (mgr.34412) 866 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:04:14.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:04:14 gibba015 bash[29377]: cephadm 2021-03-10T14:04:12.775491+0000 mgr.gibba045.orlgmj (mgr.34412) 867 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:04:14.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:04:14 gibba015 bash[29377]: cephadm 2021-03-10T14:04:12.775655+0000 mgr.gibba045.orlgmj (mgr.34412) 868 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:04:14.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:04:14 gibba015 bash[30343]: cephadm 2021-03-10T14:04:12.544249+0000 mgr.gibba045.orlgmj (mgr.34412) 854 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:04:14.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:04:14 gibba015 bash[30343]: cephadm 2021-03-10T14:04:12.763655+0000 mgr.gibba045.orlgmj (mgr.34412) 855 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:04:14.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:04:14 gibba015 bash[30343]: cephadm 2021-03-10T14:04:12.765953+0000 mgr.gibba045.orlgmj (mgr.34412) 856 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:04:14.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:04:14 gibba015 bash[30343]: cephadm 2021-03-10T14:04:12.767778+0000 mgr.gibba045.orlgmj (mgr.34412) 857 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:04:14.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:04:14 gibba015 bash[30343]: cephadm 2021-03-10T14:04:12.767822+0000 mgr.gibba045.orlgmj (mgr.34412) 858 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:04:14.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:04:14 gibba015 bash[30343]: cephadm 2021-03-10T14:04:12.769260+0000 mgr.gibba045.orlgmj (mgr.34412) 859 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:04:14.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:04:14 gibba015 bash[30343]: cephadm 2021-03-10T14:04:12.769295+0000 mgr.gibba045.orlgmj (mgr.34412) 860 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:04:14.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:04:14 gibba015 bash[30343]: cephadm 2021-03-10T14:04:12.771326+0000 mgr.gibba045.orlgmj (mgr.34412) 861 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:04:14.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:04:14 gibba015 bash[30343]: cephadm 2021-03-10T14:04:12.772742+0000 mgr.gibba045.orlgmj (mgr.34412) 862 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:04:14.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:04:14 gibba015 bash[30343]: cephadm 2021-03-10T14:04:12.772778+0000 mgr.gibba045.orlgmj (mgr.34412) 863 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:04:14.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:04:14 gibba015 bash[30343]: cephadm 2021-03-10T14:04:12.773891+0000 mgr.gibba045.orlgmj (mgr.34412) 864 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:04:14.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:04:14 gibba015 bash[30343]: cephadm 2021-03-10T14:04:12.774293+0000 mgr.gibba045.orlgmj (mgr.34412) 865 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:04:14.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:04:14 gibba015 bash[30343]: cephadm 2021-03-10T14:04:12.775447+0000 mgr.gibba045.orlgmj (mgr.34412) 866 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:04:14.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:04:14 gibba015 bash[30343]: cephadm 2021-03-10T14:04:12.775491+0000 mgr.gibba045.orlgmj (mgr.34412) 867 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:04:14.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:04:14 gibba015 bash[30343]: cephadm 2021-03-10T14:04:12.775655+0000 mgr.gibba045.orlgmj (mgr.34412) 868 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:04:14.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:04:14 gibba045 bash[25517]: cephadm 2021-03-10T14:04:12.544249+0000 mgr.gibba045.orlgmj (mgr.34412) 854 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:04:14.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:04:14 gibba045 bash[25517]: cephadm 2021-03-10T14:04:12.763655+0000 mgr.gibba045.orlgmj (mgr.34412) 855 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:04:14.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:04:14 gibba045 bash[25517]: cephadm 2021-03-10T14:04:12.765953+0000 mgr.gibba045.orlgmj (mgr.34412) 856 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:04:14.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:04:14 gibba045 bash[25517]: cephadm 2021-03-10T14:04:12.767778+0000 mgr.gibba045.orlgmj (mgr.34412) 857 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:04:14.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:04:14 gibba045 bash[25517]: cephadm 2021-03-10T14:04:12.767822+0000 mgr.gibba045.orlgmj (mgr.34412) 858 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:04:14.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:04:14 gibba045 bash[25517]: cephadm 2021-03-10T14:04:12.769260+0000 mgr.gibba045.orlgmj (mgr.34412) 859 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:04:14.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:04:14 gibba045 bash[25517]: cephadm 2021-03-10T14:04:12.769295+0000 mgr.gibba045.orlgmj (mgr.34412) 860 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:04:14.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:04:14 gibba045 bash[25517]: cephadm 2021-03-10T14:04:12.771326+0000 mgr.gibba045.orlgmj (mgr.34412) 861 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:04:14.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:04:14 gibba045 bash[25517]: cephadm 2021-03-10T14:04:12.772742+0000 mgr.gibba045.orlgmj (mgr.34412) 862 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:04:14.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:04:14 gibba045 bash[25517]: cephadm 2021-03-10T14:04:12.772778+0000 mgr.gibba045.orlgmj (mgr.34412) 863 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:04:14.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:04:14 gibba045 bash[25517]: cephadm 2021-03-10T14:04:12.773891+0000 mgr.gibba045.orlgmj (mgr.34412) 864 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:04:14.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:04:14 gibba045 bash[25517]: cephadm 2021-03-10T14:04:12.774293+0000 mgr.gibba045.orlgmj (mgr.34412) 865 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:04:14.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:04:14 gibba045 bash[25517]: cephadm 2021-03-10T14:04:12.775447+0000 mgr.gibba045.orlgmj (mgr.34412) 866 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:04:14.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:04:14 gibba045 bash[25517]: cephadm 2021-03-10T14:04:12.775491+0000 mgr.gibba045.orlgmj (mgr.34412) 867 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:04:14.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:04:14 gibba045 bash[25517]: cephadm 2021-03-10T14:04:12.775655+0000 mgr.gibba045.orlgmj (mgr.34412) 868 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:04:15.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:04:15 gibba015 bash[29377]: cluster 2021-03-10T14:04:13.559391+0000 mgr.gibba045.orlgmj (mgr.34412) 869 : cluster [DBG] pgmap v475: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:15.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:04:15 gibba015 bash[30343]: cluster 2021-03-10T14:04:13.559391+0000 mgr.gibba045.orlgmj (mgr.34412) 869 : cluster [DBG] pgmap v475: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:15.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:04:15 gibba045 bash[25517]: cluster 2021-03-10T14:04:13.559391+0000 mgr.gibba045.orlgmj (mgr.34412) 869 : cluster [DBG] pgmap v475: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:16.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:04:16 gibba015 bash[29377]: cluster 2021-03-10T14:04:15.560971+0000 mgr.gibba045.orlgmj (mgr.34412) 870 : cluster [DBG] pgmap v476: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:16.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:04:16 gibba015 bash[30343]: cluster 2021-03-10T14:04:15.560971+0000 mgr.gibba045.orlgmj (mgr.34412) 870 : cluster [DBG] pgmap v476: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:16.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:04:16 gibba045 bash[25517]: cluster 2021-03-10T14:04:15.560971+0000 mgr.gibba045.orlgmj (mgr.34412) 870 : cluster [DBG] pgmap v476: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:19.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:04:18 gibba045 bash[25517]: cluster 2021-03-10T14:04:17.562717+0000 mgr.gibba045.orlgmj (mgr.34412) 871 : cluster [DBG] pgmap v477: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:19.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:04:18 gibba015 bash[29377]: cluster 2021-03-10T14:04:17.562717+0000 mgr.gibba045.orlgmj (mgr.34412) 871 : cluster [DBG] pgmap v477: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:19.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:04:18 gibba015 bash[30343]: cluster 2021-03-10T14:04:17.562717+0000 mgr.gibba045.orlgmj (mgr.34412) 871 : cluster [DBG] pgmap v477: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:21.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:04:20 gibba045 bash[25517]: cluster 2021-03-10T14:04:19.564395+0000 mgr.gibba045.orlgmj (mgr.34412) 872 : cluster [DBG] pgmap v478: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:21.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:04:20 gibba015 bash[29377]: cluster 2021-03-10T14:04:19.564395+0000 mgr.gibba045.orlgmj (mgr.34412) 872 : cluster [DBG] pgmap v478: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:21.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:04:20 gibba015 bash[30343]: cluster 2021-03-10T14:04:19.564395+0000 mgr.gibba045.orlgmj (mgr.34412) 872 : cluster [DBG] pgmap v478: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:23.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:04:22 gibba045 bash[25517]: cluster 2021-03-10T14:04:21.566320+0000 mgr.gibba045.orlgmj (mgr.34412) 873 : cluster [DBG] pgmap v479: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:23.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:04:22 gibba015 bash[29377]: cluster 2021-03-10T14:04:21.566320+0000 mgr.gibba045.orlgmj (mgr.34412) 873 : cluster [DBG] pgmap v479: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:23.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:04:22 gibba015 bash[30343]: cluster 2021-03-10T14:04:21.566320+0000 mgr.gibba045.orlgmj (mgr.34412) 873 : cluster [DBG] pgmap v479: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:25.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:04:24 gibba045 bash[25517]: cluster 2021-03-10T14:04:23.567654+0000 mgr.gibba045.orlgmj (mgr.34412) 874 : cluster [DBG] pgmap v480: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:25.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:04:24 gibba015 bash[29377]: cluster 2021-03-10T14:04:23.567654+0000 mgr.gibba045.orlgmj (mgr.34412) 874 : cluster [DBG] pgmap v480: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:25.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:04:24 gibba015 bash[30343]: cluster 2021-03-10T14:04:23.567654+0000 mgr.gibba045.orlgmj (mgr.34412) 874 : cluster [DBG] pgmap v480: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:27.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:04:26 gibba045 bash[25517]: cluster 2021-03-10T14:04:25.569414+0000 mgr.gibba045.orlgmj (mgr.34412) 875 : cluster [DBG] pgmap v481: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:27.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:04:26 gibba015 bash[29377]: cluster 2021-03-10T14:04:25.569414+0000 mgr.gibba045.orlgmj (mgr.34412) 875 : cluster [DBG] pgmap v481: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:27.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:04:26 gibba015 bash[30343]: cluster 2021-03-10T14:04:25.569414+0000 mgr.gibba045.orlgmj (mgr.34412) 875 : cluster [DBG] pgmap v481: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:29.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:04:28 gibba045 bash[25517]: cluster 2021-03-10T14:04:27.570921+0000 mgr.gibba045.orlgmj (mgr.34412) 876 : cluster [DBG] pgmap v482: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:29.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:04:28 gibba045 bash[25517]: cephadm 2021-03-10T14:04:27.784830+0000 mgr.gibba045.orlgmj (mgr.34412) 877 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:04:29.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:04:28 gibba015 bash[29377]: cluster 2021-03-10T14:04:27.570921+0000 mgr.gibba045.orlgmj (mgr.34412) 876 : cluster [DBG] pgmap v482: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:29.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:04:28 gibba015 bash[29377]: cephadm 2021-03-10T14:04:27.784830+0000 mgr.gibba045.orlgmj (mgr.34412) 877 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:04:29.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:04:28 gibba015 bash[30343]: cluster 2021-03-10T14:04:27.570921+0000 mgr.gibba045.orlgmj (mgr.34412) 876 : cluster [DBG] pgmap v482: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:29.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:04:28 gibba015 bash[30343]: cephadm 2021-03-10T14:04:27.784830+0000 mgr.gibba045.orlgmj (mgr.34412) 877 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:04:29.623 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:04:29.859 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:04:29.859 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (15m) 81s ago 20m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:04:29.859 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (20m) 17s ago 20m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:04:29.859 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (15m) 17s ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:04:29.860 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (15m) 17s ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:04:29.860 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (14m) 81s ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:04:29.860 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (14m) 81s ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:04:29.861 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (14m) 17s ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:04:29.861 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (14m) 81s ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:04:29.862 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (20m) 81s ago 20m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:04:29.862 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (20m) 17s ago 20m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:04:29.862 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (13m) 81s ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:04:29.863 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (13m) 81s ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:04:29.863 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (12m) 81s ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:04:29.863 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (12m) 81s ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:04:29.863 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (11m) 17s ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:04:29.864 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (11m) 17s ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:04:29.864 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (10m) 17s ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:04:29.864 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (10m) 17s ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:04:29.864 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (20m) 17s ago 20m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:04:29.865 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 17s ago 18m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:04:30.110 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:04:30.110 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:04:30.111 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:04:30.111 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:04:30.111 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:04:30.111 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:04:30.112 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:04:30.112 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:04:30.112 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:04:30.112 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:04:30.113 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:04:30.113 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:04:30.113 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:04:30.113 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:04:30.114 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:04:31.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:04:30 gibba045 bash[25517]: cluster 2021-03-10T14:04:29.572413+0000 mgr.gibba045.orlgmj (mgr.34412) 878 : cluster [DBG] pgmap v483: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:31.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:04:30 gibba045 bash[25517]: audit 2021-03-10T14:04:29.615371+0000 mgr.gibba045.orlgmj (mgr.34412) 879 : audit [DBG] from='client.54634 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:04:31.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:04:30 gibba045 bash[25517]: audit 2021-03-10T14:04:29.841351+0000 mgr.gibba045.orlgmj (mgr.34412) 880 : audit [DBG] from='client.44652 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:04:31.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:04:30 gibba045 bash[25517]: audit 2021-03-10T14:04:30.107275+0000 mon.c (mon.1) 311 : audit [DBG] from='client.? 172.21.2.115:0/1722868297' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:04:31.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:04:30 gibba015 bash[29377]: cluster 2021-03-10T14:04:29.572413+0000 mgr.gibba045.orlgmj (mgr.34412) 878 : cluster [DBG] pgmap v483: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:31.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:04:30 gibba015 bash[29377]: audit 2021-03-10T14:04:29.615371+0000 mgr.gibba045.orlgmj (mgr.34412) 879 : audit [DBG] from='client.54634 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:04:31.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:04:30 gibba015 bash[29377]: audit 2021-03-10T14:04:29.841351+0000 mgr.gibba045.orlgmj (mgr.34412) 880 : audit [DBG] from='client.44652 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:04:31.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:04:30 gibba015 bash[29377]: audit 2021-03-10T14:04:30.107275+0000 mon.c (mon.1) 311 : audit [DBG] from='client.? 172.21.2.115:0/1722868297' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:04:31.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:04:30 gibba015 bash[30343]: cluster 2021-03-10T14:04:29.572413+0000 mgr.gibba045.orlgmj (mgr.34412) 878 : cluster [DBG] pgmap v483: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:31.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:04:30 gibba015 bash[30343]: audit 2021-03-10T14:04:29.615371+0000 mgr.gibba045.orlgmj (mgr.34412) 879 : audit [DBG] from='client.54634 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:04:31.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:04:30 gibba015 bash[30343]: audit 2021-03-10T14:04:29.841351+0000 mgr.gibba045.orlgmj (mgr.34412) 880 : audit [DBG] from='client.44652 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:04:31.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:04:30 gibba015 bash[30343]: audit 2021-03-10T14:04:30.107275+0000 mon.c (mon.1) 311 : audit [DBG] from='client.? 172.21.2.115:0/1722868297' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:04:33.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:04:32 gibba045 bash[25517]: cluster 2021-03-10T14:04:31.579044+0000 mgr.gibba045.orlgmj (mgr.34412) 881 : cluster [DBG] pgmap v484: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:33.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:04:32 gibba015 bash[29377]: cluster 2021-03-10T14:04:31.579044+0000 mgr.gibba045.orlgmj (mgr.34412) 881 : cluster [DBG] pgmap v484: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:33.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:04:32 gibba015 bash[30343]: cluster 2021-03-10T14:04:31.579044+0000 mgr.gibba045.orlgmj (mgr.34412) 881 : cluster [DBG] pgmap v484: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:35.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:04:34 gibba015 bash[29377]: cluster 2021-03-10T14:04:33.579919+0000 mgr.gibba045.orlgmj (mgr.34412) 882 : cluster [DBG] pgmap v485: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:35.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:04:34 gibba015 bash[30343]: cluster 2021-03-10T14:04:33.579919+0000 mgr.gibba045.orlgmj (mgr.34412) 882 : cluster [DBG] pgmap v485: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:35.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:04:34 gibba045 bash[25517]: cluster 2021-03-10T14:04:33.579919+0000 mgr.gibba045.orlgmj (mgr.34412) 882 : cluster [DBG] pgmap v485: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:37.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:04:36 gibba015 bash[29377]: cluster 2021-03-10T14:04:35.581458+0000 mgr.gibba045.orlgmj (mgr.34412) 883 : cluster [DBG] pgmap v486: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:37.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:04:36 gibba015 bash[30343]: cluster 2021-03-10T14:04:35.581458+0000 mgr.gibba045.orlgmj (mgr.34412) 883 : cluster [DBG] pgmap v486: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:37.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:04:36 gibba045 bash[25517]: cluster 2021-03-10T14:04:35.581458+0000 mgr.gibba045.orlgmj (mgr.34412) 883 : cluster [DBG] pgmap v486: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:39.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:04:38 gibba015 bash[29377]: cluster 2021-03-10T14:04:37.583112+0000 mgr.gibba045.orlgmj (mgr.34412) 884 : cluster [DBG] pgmap v487: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:39.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:04:38 gibba015 bash[30343]: cluster 2021-03-10T14:04:37.583112+0000 mgr.gibba045.orlgmj (mgr.34412) 884 : cluster [DBG] pgmap v487: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:39.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:04:38 gibba045 bash[25517]: cluster 2021-03-10T14:04:37.583112+0000 mgr.gibba045.orlgmj (mgr.34412) 884 : cluster [DBG] pgmap v487: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:41.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:04:40 gibba015 bash[29377]: cluster 2021-03-10T14:04:39.584730+0000 mgr.gibba045.orlgmj (mgr.34412) 885 : cluster [DBG] pgmap v488: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:41.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:04:40 gibba015 bash[30343]: cluster 2021-03-10T14:04:39.584730+0000 mgr.gibba045.orlgmj (mgr.34412) 885 : cluster [DBG] pgmap v488: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:41.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:04:40 gibba045 bash[25517]: cluster 2021-03-10T14:04:39.584730+0000 mgr.gibba045.orlgmj (mgr.34412) 885 : cluster [DBG] pgmap v488: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:43.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:04:42 gibba045 bash[25517]: cluster 2021-03-10T14:04:41.585423+0000 mgr.gibba045.orlgmj (mgr.34412) 886 : cluster [DBG] pgmap v489: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:43.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:04:42 gibba015 bash[29377]: cluster 2021-03-10T14:04:41.585423+0000 mgr.gibba045.orlgmj (mgr.34412) 886 : cluster [DBG] pgmap v489: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:43.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:04:42 gibba015 bash[30343]: cluster 2021-03-10T14:04:41.585423+0000 mgr.gibba045.orlgmj (mgr.34412) 886 : cluster [DBG] pgmap v489: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:44.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:04:43 gibba015 bash[29377]: cephadm 2021-03-10T14:04:42.800896+0000 mgr.gibba045.orlgmj (mgr.34412) 887 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:04:44.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:04:43 gibba015 bash[30343]: cephadm 2021-03-10T14:04:42.800896+0000 mgr.gibba045.orlgmj (mgr.34412) 887 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:04:44.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:04:43 gibba045 bash[25517]: cephadm 2021-03-10T14:04:42.800896+0000 mgr.gibba045.orlgmj (mgr.34412) 887 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:04:45.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:04:44 gibba015 bash[29377]: cluster 2021-03-10T14:04:43.586488+0000 mgr.gibba045.orlgmj (mgr.34412) 888 : cluster [DBG] pgmap v490: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:45.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:04:44 gibba015 bash[30343]: cluster 2021-03-10T14:04:43.586488+0000 mgr.gibba045.orlgmj (mgr.34412) 888 : cluster [DBG] pgmap v490: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:45.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:04:44 gibba045 bash[25517]: cluster 2021-03-10T14:04:43.586488+0000 mgr.gibba045.orlgmj (mgr.34412) 888 : cluster [DBG] pgmap v490: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:47.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:04:46 gibba015 bash[29377]: cluster 2021-03-10T14:04:45.588108+0000 mgr.gibba045.orlgmj (mgr.34412) 889 : cluster [DBG] pgmap v491: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:47.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:04:46 gibba015 bash[30343]: cluster 2021-03-10T14:04:45.588108+0000 mgr.gibba045.orlgmj (mgr.34412) 889 : cluster [DBG] pgmap v491: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:47.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:04:46 gibba045 bash[25517]: cluster 2021-03-10T14:04:45.588108+0000 mgr.gibba045.orlgmj (mgr.34412) 889 : cluster [DBG] pgmap v491: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:49.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:04:48 gibba015 bash[29377]: cluster 2021-03-10T14:04:47.589734+0000 mgr.gibba045.orlgmj (mgr.34412) 890 : cluster [DBG] pgmap v492: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:49.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:04:48 gibba015 bash[30343]: cluster 2021-03-10T14:04:47.589734+0000 mgr.gibba045.orlgmj (mgr.34412) 890 : cluster [DBG] pgmap v492: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:49.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:04:48 gibba045 bash[25517]: cluster 2021-03-10T14:04:47.589734+0000 mgr.gibba045.orlgmj (mgr.34412) 890 : cluster [DBG] pgmap v492: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:51.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:04:50 gibba015 bash[29377]: cluster 2021-03-10T14:04:49.591235+0000 mgr.gibba045.orlgmj (mgr.34412) 891 : cluster [DBG] pgmap v493: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:51.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:04:50 gibba015 bash[30343]: cluster 2021-03-10T14:04:49.591235+0000 mgr.gibba045.orlgmj (mgr.34412) 891 : cluster [DBG] pgmap v493: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:51.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:04:50 gibba045 bash[25517]: cluster 2021-03-10T14:04:49.591235+0000 mgr.gibba045.orlgmj (mgr.34412) 891 : cluster [DBG] pgmap v493: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:53.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:04:52 gibba015 bash[29377]: cluster 2021-03-10T14:04:51.592236+0000 mgr.gibba045.orlgmj (mgr.34412) 892 : cluster [DBG] pgmap v494: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:53.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:04:52 gibba015 bash[29377]: audit 2021-03-10T14:04:52.486396+0000 mon.c (mon.1) 312 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T14:04:53.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:04:52 gibba015 bash[29377]: audit 2021-03-10T14:04:52.487100+0000 mon.c (mon.1) 313 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:04:53.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:04:52 gibba015 bash[29377]: audit 2021-03-10T14:04:52.487592+0000 mon.a (mon.0) 663 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T14:04:53.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:04:52 gibba015 bash[29377]: audit 2021-03-10T14:04:52.487729+0000 mon.c (mon.1) 314 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:04:53.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:04:52 gibba015 bash[29377]: audit 2021-03-10T14:04:52.488448+0000 mon.c (mon.1) 315 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:04:53.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:04:52 gibba015 bash[29377]: audit 2021-03-10T14:04:52.488984+0000 mon.a (mon.0) 664 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:04:53.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:04:52 gibba015 bash[29377]: audit 2021-03-10T14:04:52.489978+0000 mon.a (mon.0) 665 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:04:53.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:04:52 gibba015 bash[29377]: audit 2021-03-10T14:04:52.490752+0000 mon.a (mon.0) 666 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:04:53.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:04:52 gibba015 bash[29377]: audit 2021-03-10T14:04:52.557943+0000 mon.c (mon.1) 316 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:04:53.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:04:52 gibba015 bash[29377]: audit 2021-03-10T14:04:52.558596+0000 mon.c (mon.1) 317 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:04:53.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:04:52 gibba015 bash[29377]: audit 2021-03-10T14:04:52.559060+0000 mon.a (mon.0) 667 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:04:53.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:04:52 gibba015 bash[29377]: audit 2021-03-10T14:04:52.560135+0000 mon.a (mon.0) 668 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:04:53.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:04:52 gibba015 bash[30343]: cluster 2021-03-10T14:04:51.592236+0000 mgr.gibba045.orlgmj (mgr.34412) 892 : cluster [DBG] pgmap v494: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:53.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:04:52 gibba015 bash[30343]: audit 2021-03-10T14:04:52.486396+0000 mon.c (mon.1) 312 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T14:04:53.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:04:52 gibba015 bash[30343]: audit 2021-03-10T14:04:52.487100+0000 mon.c (mon.1) 313 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:04:53.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:04:52 gibba015 bash[30343]: audit 2021-03-10T14:04:52.487592+0000 mon.a (mon.0) 663 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T14:04:53.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:04:52 gibba015 bash[30343]: audit 2021-03-10T14:04:52.487729+0000 mon.c (mon.1) 314 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:04:53.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:04:52 gibba015 bash[30343]: audit 2021-03-10T14:04:52.488448+0000 mon.c (mon.1) 315 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:04:53.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:04:52 gibba015 bash[30343]: audit 2021-03-10T14:04:52.488984+0000 mon.a (mon.0) 664 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:04:53.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:04:52 gibba015 bash[30343]: audit 2021-03-10T14:04:52.489978+0000 mon.a (mon.0) 665 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:04:53.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:04:52 gibba015 bash[30343]: audit 2021-03-10T14:04:52.490752+0000 mon.a (mon.0) 666 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:04:53.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:04:52 gibba015 bash[30343]: audit 2021-03-10T14:04:52.557943+0000 mon.c (mon.1) 316 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:04:53.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:04:52 gibba015 bash[30343]: audit 2021-03-10T14:04:52.558596+0000 mon.c (mon.1) 317 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:04:53.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:04:52 gibba015 bash[30343]: audit 2021-03-10T14:04:52.559060+0000 mon.a (mon.0) 667 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:04:53.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:04:52 gibba015 bash[30343]: audit 2021-03-10T14:04:52.560135+0000 mon.a (mon.0) 668 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:04:53.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:04:52 gibba045 bash[25517]: cluster 2021-03-10T14:04:51.592236+0000 mgr.gibba045.orlgmj (mgr.34412) 892 : cluster [DBG] pgmap v494: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:53.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:04:52 gibba045 bash[25517]: audit 2021-03-10T14:04:52.486396+0000 mon.c (mon.1) 312 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T14:04:53.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:04:52 gibba045 bash[25517]: audit 2021-03-10T14:04:52.487100+0000 mon.c (mon.1) 313 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:04:53.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:04:52 gibba045 bash[25517]: audit 2021-03-10T14:04:52.487592+0000 mon.a (mon.0) 663 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T14:04:53.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:04:52 gibba045 bash[25517]: audit 2021-03-10T14:04:52.487729+0000 mon.c (mon.1) 314 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:04:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:04:52 gibba045 bash[25517]: audit 2021-03-10T14:04:52.488448+0000 mon.c (mon.1) 315 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:04:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:04:52 gibba045 bash[25517]: audit 2021-03-10T14:04:52.488984+0000 mon.a (mon.0) 664 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:04:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:04:52 gibba045 bash[25517]: audit 2021-03-10T14:04:52.489978+0000 mon.a (mon.0) 665 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:04:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:04:52 gibba045 bash[25517]: audit 2021-03-10T14:04:52.490752+0000 mon.a (mon.0) 666 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:04:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:04:52 gibba045 bash[25517]: audit 2021-03-10T14:04:52.557943+0000 mon.c (mon.1) 316 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:04:53.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:04:52 gibba045 bash[25517]: audit 2021-03-10T14:04:52.558596+0000 mon.c (mon.1) 317 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:04:53.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:04:52 gibba045 bash[25517]: audit 2021-03-10T14:04:52.559060+0000 mon.a (mon.0) 667 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:04:53.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:04:52 gibba045 bash[25517]: audit 2021-03-10T14:04:52.560135+0000 mon.a (mon.0) 668 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:04:55.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:04:54 gibba015 bash[29377]: cluster 2021-03-10T14:04:53.593472+0000 mgr.gibba045.orlgmj (mgr.34412) 893 : cluster [DBG] pgmap v495: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:55.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:04:54 gibba015 bash[30343]: cluster 2021-03-10T14:04:53.593472+0000 mgr.gibba045.orlgmj (mgr.34412) 893 : cluster [DBG] pgmap v495: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:55.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:04:54 gibba045 bash[25517]: cluster 2021-03-10T14:04:53.593472+0000 mgr.gibba045.orlgmj (mgr.34412) 893 : cluster [DBG] pgmap v495: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:57.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:04:56 gibba015 bash[29377]: cluster 2021-03-10T14:04:55.595119+0000 mgr.gibba045.orlgmj (mgr.34412) 894 : cluster [DBG] pgmap v496: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:57.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:04:56 gibba015 bash[30343]: cluster 2021-03-10T14:04:55.595119+0000 mgr.gibba045.orlgmj (mgr.34412) 894 : cluster [DBG] pgmap v496: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:57.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:04:56 gibba045 bash[25517]: cluster 2021-03-10T14:04:55.595119+0000 mgr.gibba045.orlgmj (mgr.34412) 894 : cluster [DBG] pgmap v496: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:59.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:04:58 gibba015 bash[29377]: cluster 2021-03-10T14:04:57.596812+0000 mgr.gibba045.orlgmj (mgr.34412) 895 : cluster [DBG] pgmap v497: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:59.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:04:58 gibba015 bash[29377]: cephadm 2021-03-10T14:04:57.817079+0000 mgr.gibba045.orlgmj (mgr.34412) 896 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:04:59.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:04:58 gibba015 bash[30343]: cluster 2021-03-10T14:04:57.596812+0000 mgr.gibba045.orlgmj (mgr.34412) 895 : cluster [DBG] pgmap v497: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:59.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:04:58 gibba015 bash[30343]: cephadm 2021-03-10T14:04:57.817079+0000 mgr.gibba045.orlgmj (mgr.34412) 896 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:04:59.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:04:58 gibba045 bash[25517]: cluster 2021-03-10T14:04:57.596812+0000 mgr.gibba045.orlgmj (mgr.34412) 895 : cluster [DBG] pgmap v497: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:59.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:04:58 gibba045 bash[25517]: cephadm 2021-03-10T14:04:57.817079+0000 mgr.gibba045.orlgmj (mgr.34412) 896 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:05:00.359 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:05:00.590 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:05:00.590 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (15m) 112s ago 21m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:05:00.591 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (20m) 48s ago 20m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:05:00.591 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (16m) 48s ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:05:00.592 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (16m) 48s ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:05:00.592 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (15m) 112s ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:05:00.592 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (15m) 112s ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:05:00.593 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (14m) 48s ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:05:00.593 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (14m) 112s ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:05:00.594 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (21m) 112s ago 21m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:05:00.594 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (21m) 48s ago 21m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:05:00.594 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (14m) 112s ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:05:00.595 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (13m) 112s ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:05:00.595 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (13m) 112s ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:05:00.595 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (12m) 112s ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:05:00.595 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (12m) 48s ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:05:00.596 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (11m) 48s ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:05:00.596 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (11m) 48s ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:05:00.596 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (11m) 48s ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:05:00.596 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (20m) 48s ago 21m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:05:00.597 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 48s ago 19m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:05:00.861 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:05:00.862 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:05:00.862 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:05:00.862 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:05:00.863 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:05:00.863 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:05:00.863 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:05:00.863 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:05:00.863 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:05:00.864 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:05:00.864 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:05:00.864 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:05:00.864 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:05:00.864 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:05:00.865 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:05:01.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:05:00 gibba015 bash[29377]: cluster 2021-03-10T14:04:59.598262+0000 mgr.gibba045.orlgmj (mgr.34412) 897 : cluster [DBG] pgmap v498: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:01.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:05:00 gibba015 bash[29377]: audit 2021-03-10T14:05:00.858824+0000 mon.c (mon.1) 318 : audit [DBG] from='client.? 172.21.2.115:0/1932275533' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:05:01.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:05:00 gibba015 bash[30343]: cluster 2021-03-10T14:04:59.598262+0000 mgr.gibba045.orlgmj (mgr.34412) 897 : cluster [DBG] pgmap v498: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:01.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:05:00 gibba015 bash[30343]: audit 2021-03-10T14:05:00.858824+0000 mon.c (mon.1) 318 : audit [DBG] from='client.? 172.21.2.115:0/1932275533' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:05:01.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:05:00 gibba045 bash[25517]: cluster 2021-03-10T14:04:59.598262+0000 mgr.gibba045.orlgmj (mgr.34412) 897 : cluster [DBG] pgmap v498: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:01.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:05:00 gibba045 bash[25517]: audit 2021-03-10T14:05:00.858824+0000 mon.c (mon.1) 318 : audit [DBG] from='client.? 172.21.2.115:0/1932275533' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:05:02.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:05:01 gibba015 bash[30343]: audit 2021-03-10T14:05:00.350994+0000 mgr.gibba045.orlgmj (mgr.34412) 898 : audit [DBG] from='client.44664 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:05:02.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:05:01 gibba015 bash[30343]: audit 2021-03-10T14:05:00.576894+0000 mgr.gibba045.orlgmj (mgr.34412) 899 : audit [DBG] from='client.44670 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:05:02.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:05:01 gibba015 bash[29377]: audit 2021-03-10T14:05:00.350994+0000 mgr.gibba045.orlgmj (mgr.34412) 898 : audit [DBG] from='client.44664 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:05:02.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:05:01 gibba015 bash[29377]: audit 2021-03-10T14:05:00.576894+0000 mgr.gibba045.orlgmj (mgr.34412) 899 : audit [DBG] from='client.44670 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:05:02.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:05:01 gibba045 bash[25517]: audit 2021-03-10T14:05:00.350994+0000 mgr.gibba045.orlgmj (mgr.34412) 898 : audit [DBG] from='client.44664 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:05:02.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:05:01 gibba045 bash[25517]: audit 2021-03-10T14:05:00.576894+0000 mgr.gibba045.orlgmj (mgr.34412) 899 : audit [DBG] from='client.44670 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:05:03.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:05:02 gibba015 bash[29377]: cluster 2021-03-10T14:05:01.599271+0000 mgr.gibba045.orlgmj (mgr.34412) 900 : cluster [DBG] pgmap v499: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:03.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:05:02 gibba015 bash[30343]: cluster 2021-03-10T14:05:01.599271+0000 mgr.gibba045.orlgmj (mgr.34412) 900 : cluster [DBG] pgmap v499: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:03.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:05:02 gibba045 bash[25517]: cluster 2021-03-10T14:05:01.599271+0000 mgr.gibba045.orlgmj (mgr.34412) 900 : cluster [DBG] pgmap v499: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:05.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:05:04 gibba015 bash[29377]: cluster 2021-03-10T14:05:03.600498+0000 mgr.gibba045.orlgmj (mgr.34412) 901 : cluster [DBG] pgmap v500: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:05.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:05:04 gibba015 bash[30343]: cluster 2021-03-10T14:05:03.600498+0000 mgr.gibba045.orlgmj (mgr.34412) 901 : cluster [DBG] pgmap v500: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:05.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:05:04 gibba045 bash[25517]: cluster 2021-03-10T14:05:03.600498+0000 mgr.gibba045.orlgmj (mgr.34412) 901 : cluster [DBG] pgmap v500: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:07.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:05:06 gibba015 bash[29377]: cluster 2021-03-10T14:05:05.602204+0000 mgr.gibba045.orlgmj (mgr.34412) 902 : cluster [DBG] pgmap v501: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:07.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:05:06 gibba015 bash[30343]: cluster 2021-03-10T14:05:05.602204+0000 mgr.gibba045.orlgmj (mgr.34412) 902 : cluster [DBG] pgmap v501: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:07.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:05:06 gibba045 bash[25517]: cluster 2021-03-10T14:05:05.602204+0000 mgr.gibba045.orlgmj (mgr.34412) 902 : cluster [DBG] pgmap v501: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:09.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:05:08 gibba015 bash[29377]: cluster 2021-03-10T14:05:07.603903+0000 mgr.gibba045.orlgmj (mgr.34412) 903 : cluster [DBG] pgmap v502: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:09.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:05:08 gibba015 bash[30343]: cluster 2021-03-10T14:05:07.603903+0000 mgr.gibba045.orlgmj (mgr.34412) 903 : cluster [DBG] pgmap v502: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:09.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:05:08 gibba045 bash[25517]: cluster 2021-03-10T14:05:07.603903+0000 mgr.gibba045.orlgmj (mgr.34412) 903 : cluster [DBG] pgmap v502: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:11.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:05:10 gibba045 bash[25517]: cluster 2021-03-10T14:05:09.605414+0000 mgr.gibba045.orlgmj (mgr.34412) 904 : cluster [DBG] pgmap v503: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:11.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:05:10 gibba015 bash[29377]: cluster 2021-03-10T14:05:09.605414+0000 mgr.gibba045.orlgmj (mgr.34412) 904 : cluster [DBG] pgmap v503: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:11.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:05:10 gibba015 bash[30343]: cluster 2021-03-10T14:05:09.605414+0000 mgr.gibba045.orlgmj (mgr.34412) 904 : cluster [DBG] pgmap v503: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:13.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:05:12 gibba045 bash[25517]: cluster 2021-03-10T14:05:11.606315+0000 mgr.gibba045.orlgmj (mgr.34412) 905 : cluster [DBG] pgmap v504: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:13.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:05:12 gibba045 bash[25517]: audit 2021-03-10T14:05:12.827343+0000 mon.c (mon.1) 319 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:05:13.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:05:12 gibba015 bash[29377]: cluster 2021-03-10T14:05:11.606315+0000 mgr.gibba045.orlgmj (mgr.34412) 905 : cluster [DBG] pgmap v504: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:13.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:05:12 gibba015 bash[29377]: audit 2021-03-10T14:05:12.827343+0000 mon.c (mon.1) 319 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:05:13.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:05:12 gibba015 bash[30343]: cluster 2021-03-10T14:05:11.606315+0000 mgr.gibba045.orlgmj (mgr.34412) 905 : cluster [DBG] pgmap v504: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:13.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:05:12 gibba015 bash[30343]: audit 2021-03-10T14:05:12.827343+0000 mon.c (mon.1) 319 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:05:14.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:05:14 gibba015 bash[29377]: cephadm 2021-03-10T14:05:12.836092+0000 mgr.gibba045.orlgmj (mgr.34412) 906 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:05:14.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:05:14 gibba015 bash[29377]: cephadm 2021-03-10T14:05:12.837605+0000 mgr.gibba045.orlgmj (mgr.34412) 907 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:05:14.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:05:14 gibba015 bash[29377]: audit 2021-03-10T14:05:13.056728+0000 mon.a (mon.0) 669 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:05:14.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:05:14 gibba015 bash[29377]: audit 2021-03-10T14:05:13.060532+0000 mon.c (mon.1) 320 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:05:14.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:05:14 gibba015 bash[29377]: audit 2021-03-10T14:05:13.062261+0000 mon.c (mon.1) 321 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:05:14.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:05:14 gibba015 bash[29377]: cephadm 2021-03-10T14:05:13.062810+0000 mgr.gibba045.orlgmj (mgr.34412) 908 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:05:14.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:05:14 gibba015 bash[29377]: audit 2021-03-10T14:05:13.063792+0000 mon.c (mon.1) 322 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:05:14.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:05:14 gibba015 bash[29377]: cephadm 2021-03-10T14:05:13.064685+0000 mgr.gibba045.orlgmj (mgr.34412) 909 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:05:14.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:05:14 gibba015 bash[29377]: audit 2021-03-10T14:05:13.065036+0000 mon.c (mon.1) 323 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:05:14.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:05:14 gibba015 bash[29377]: cephadm 2021-03-10T14:05:13.066216+0000 mgr.gibba045.orlgmj (mgr.34412) 910 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:05:14.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:05:14 gibba015 bash[29377]: cephadm 2021-03-10T14:05:13.066253+0000 mgr.gibba045.orlgmj (mgr.34412) 911 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:05:14.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:05:14 gibba015 bash[29377]: cephadm 2021-03-10T14:05:13.067533+0000 mgr.gibba045.orlgmj (mgr.34412) 912 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:05:14.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:05:14 gibba015 bash[29377]: cephadm 2021-03-10T14:05:13.067571+0000 mgr.gibba045.orlgmj (mgr.34412) 913 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:05:14.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:05:14 gibba015 bash[29377]: audit 2021-03-10T14:05:13.068517+0000 mon.c (mon.1) 324 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:05:14.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:05:14 gibba015 bash[29377]: cephadm 2021-03-10T14:05:13.069115+0000 mgr.gibba045.orlgmj (mgr.34412) 914 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:05:14.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:05:14 gibba015 bash[29377]: audit 2021-03-10T14:05:13.070313+0000 mon.c (mon.1) 325 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:05:14.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:05:14 gibba015 bash[29377]: cephadm 2021-03-10T14:05:13.070886+0000 mgr.gibba045.orlgmj (mgr.34412) 915 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:05:14.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:05:14 gibba015 bash[29377]: cephadm 2021-03-10T14:05:13.070922+0000 mgr.gibba045.orlgmj (mgr.34412) 916 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:05:14.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:05:14 gibba015 bash[29377]: cephadm 2021-03-10T14:05:13.072464+0000 mgr.gibba045.orlgmj (mgr.34412) 917 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:05:14.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:05:14 gibba015 bash[29377]: cephadm 2021-03-10T14:05:13.072840+0000 mgr.gibba045.orlgmj (mgr.34412) 918 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:05:14.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:05:14 gibba015 bash[29377]: cephadm 2021-03-10T14:05:13.074191+0000 mgr.gibba045.orlgmj (mgr.34412) 919 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:05:14.479 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:05:14 gibba015 bash[29377]: cephadm 2021-03-10T14:05:13.074228+0000 mgr.gibba045.orlgmj (mgr.34412) 920 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:05:14.479 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:05:14 gibba015 bash[29377]: cephadm 2021-03-10T14:05:13.074332+0000 mgr.gibba045.orlgmj (mgr.34412) 921 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:05:14.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:05:14 gibba015 bash[30343]: cephadm 2021-03-10T14:05:12.836092+0000 mgr.gibba045.orlgmj (mgr.34412) 906 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:05:14.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:05:14 gibba015 bash[30343]: cephadm 2021-03-10T14:05:12.837605+0000 mgr.gibba045.orlgmj (mgr.34412) 907 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:05:14.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:05:14 gibba015 bash[30343]: audit 2021-03-10T14:05:13.056728+0000 mon.a (mon.0) 669 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:05:14.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:05:14 gibba015 bash[30343]: audit 2021-03-10T14:05:13.060532+0000 mon.c (mon.1) 320 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:05:14.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:05:14 gibba015 bash[30343]: audit 2021-03-10T14:05:13.062261+0000 mon.c (mon.1) 321 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:05:14.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:05:14 gibba015 bash[30343]: cephadm 2021-03-10T14:05:13.062810+0000 mgr.gibba045.orlgmj (mgr.34412) 908 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:05:14.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:05:14 gibba015 bash[30343]: audit 2021-03-10T14:05:13.063792+0000 mon.c (mon.1) 322 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:05:14.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:05:14 gibba015 bash[30343]: cephadm 2021-03-10T14:05:13.064685+0000 mgr.gibba045.orlgmj (mgr.34412) 909 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:05:14.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:05:14 gibba015 bash[30343]: audit 2021-03-10T14:05:13.065036+0000 mon.c (mon.1) 323 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:05:14.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:05:14 gibba015 bash[30343]: cephadm 2021-03-10T14:05:13.066216+0000 mgr.gibba045.orlgmj (mgr.34412) 910 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:05:14.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:05:14 gibba015 bash[30343]: cephadm 2021-03-10T14:05:13.066253+0000 mgr.gibba045.orlgmj (mgr.34412) 911 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:05:14.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:05:14 gibba015 bash[30343]: cephadm 2021-03-10T14:05:13.067533+0000 mgr.gibba045.orlgmj (mgr.34412) 912 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:05:14.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:05:14 gibba015 bash[30343]: cephadm 2021-03-10T14:05:13.067571+0000 mgr.gibba045.orlgmj (mgr.34412) 913 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:05:14.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:05:14 gibba015 bash[30343]: audit 2021-03-10T14:05:13.068517+0000 mon.c (mon.1) 324 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:05:14.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:05:14 gibba015 bash[30343]: cephadm 2021-03-10T14:05:13.069115+0000 mgr.gibba045.orlgmj (mgr.34412) 914 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:05:14.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:05:14 gibba015 bash[30343]: audit 2021-03-10T14:05:13.070313+0000 mon.c (mon.1) 325 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:05:14.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:05:14 gibba015 bash[30343]: cephadm 2021-03-10T14:05:13.070886+0000 mgr.gibba045.orlgmj (mgr.34412) 915 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:05:14.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:05:14 gibba015 bash[30343]: cephadm 2021-03-10T14:05:13.070922+0000 mgr.gibba045.orlgmj (mgr.34412) 916 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:05:14.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:05:14 gibba015 bash[30343]: cephadm 2021-03-10T14:05:13.072464+0000 mgr.gibba045.orlgmj (mgr.34412) 917 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:05:14.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:05:14 gibba015 bash[30343]: cephadm 2021-03-10T14:05:13.072840+0000 mgr.gibba045.orlgmj (mgr.34412) 918 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:05:14.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:05:14 gibba015 bash[30343]: cephadm 2021-03-10T14:05:13.074191+0000 mgr.gibba045.orlgmj (mgr.34412) 919 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:05:14.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:05:14 gibba015 bash[30343]: cephadm 2021-03-10T14:05:13.074228+0000 mgr.gibba045.orlgmj (mgr.34412) 920 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:05:14.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:05:14 gibba015 bash[30343]: cephadm 2021-03-10T14:05:13.074332+0000 mgr.gibba045.orlgmj (mgr.34412) 921 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:05:14.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:05:14 gibba045 bash[25517]: cephadm 2021-03-10T14:05:12.836092+0000 mgr.gibba045.orlgmj (mgr.34412) 906 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:05:14.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:05:14 gibba045 bash[25517]: cephadm 2021-03-10T14:05:12.837605+0000 mgr.gibba045.orlgmj (mgr.34412) 907 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:05:14.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:05:14 gibba045 bash[25517]: audit 2021-03-10T14:05:13.056728+0000 mon.a (mon.0) 669 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:05:14.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:05:14 gibba045 bash[25517]: audit 2021-03-10T14:05:13.060532+0000 mon.c (mon.1) 320 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:05:14.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:05:14 gibba045 bash[25517]: audit 2021-03-10T14:05:13.062261+0000 mon.c (mon.1) 321 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:05:14.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:05:14 gibba045 bash[25517]: cephadm 2021-03-10T14:05:13.062810+0000 mgr.gibba045.orlgmj (mgr.34412) 908 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:05:14.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:05:14 gibba045 bash[25517]: audit 2021-03-10T14:05:13.063792+0000 mon.c (mon.1) 322 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:05:14.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:05:14 gibba045 bash[25517]: cephadm 2021-03-10T14:05:13.064685+0000 mgr.gibba045.orlgmj (mgr.34412) 909 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:05:14.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:05:14 gibba045 bash[25517]: audit 2021-03-10T14:05:13.065036+0000 mon.c (mon.1) 323 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:05:14.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:05:14 gibba045 bash[25517]: cephadm 2021-03-10T14:05:13.066216+0000 mgr.gibba045.orlgmj (mgr.34412) 910 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:05:14.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:05:14 gibba045 bash[25517]: cephadm 2021-03-10T14:05:13.066253+0000 mgr.gibba045.orlgmj (mgr.34412) 911 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:05:14.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:05:14 gibba045 bash[25517]: cephadm 2021-03-10T14:05:13.067533+0000 mgr.gibba045.orlgmj (mgr.34412) 912 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:05:14.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:05:14 gibba045 bash[25517]: cephadm 2021-03-10T14:05:13.067571+0000 mgr.gibba045.orlgmj (mgr.34412) 913 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:05:14.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:05:14 gibba045 bash[25517]: audit 2021-03-10T14:05:13.068517+0000 mon.c (mon.1) 324 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:05:14.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:05:14 gibba045 bash[25517]: cephadm 2021-03-10T14:05:13.069115+0000 mgr.gibba045.orlgmj (mgr.34412) 914 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:05:14.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:05:14 gibba045 bash[25517]: audit 2021-03-10T14:05:13.070313+0000 mon.c (mon.1) 325 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:05:14.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:05:14 gibba045 bash[25517]: cephadm 2021-03-10T14:05:13.070886+0000 mgr.gibba045.orlgmj (mgr.34412) 915 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:05:14.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:05:14 gibba045 bash[25517]: cephadm 2021-03-10T14:05:13.070922+0000 mgr.gibba045.orlgmj (mgr.34412) 916 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:05:14.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:05:14 gibba045 bash[25517]: cephadm 2021-03-10T14:05:13.072464+0000 mgr.gibba045.orlgmj (mgr.34412) 917 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:05:14.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:05:14 gibba045 bash[25517]: cephadm 2021-03-10T14:05:13.072840+0000 mgr.gibba045.orlgmj (mgr.34412) 918 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:05:14.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:05:14 gibba045 bash[25517]: cephadm 2021-03-10T14:05:13.074191+0000 mgr.gibba045.orlgmj (mgr.34412) 919 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:05:14.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:05:14 gibba045 bash[25517]: cephadm 2021-03-10T14:05:13.074228+0000 mgr.gibba045.orlgmj (mgr.34412) 920 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:05:14.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:05:14 gibba045 bash[25517]: cephadm 2021-03-10T14:05:13.074332+0000 mgr.gibba045.orlgmj (mgr.34412) 921 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:05:15.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:05:15 gibba015 bash[29377]: cluster 2021-03-10T14:05:13.607408+0000 mgr.gibba045.orlgmj (mgr.34412) 922 : cluster [DBG] pgmap v505: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:15.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:05:15 gibba015 bash[30343]: cluster 2021-03-10T14:05:13.607408+0000 mgr.gibba045.orlgmj (mgr.34412) 922 : cluster [DBG] pgmap v505: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:15.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:05:15 gibba045 bash[25517]: cluster 2021-03-10T14:05:13.607408+0000 mgr.gibba045.orlgmj (mgr.34412) 922 : cluster [DBG] pgmap v505: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:17.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:05:17 gibba015 bash[29377]: cluster 2021-03-10T14:05:15.609070+0000 mgr.gibba045.orlgmj (mgr.34412) 923 : cluster [DBG] pgmap v506: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:17.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:05:17 gibba015 bash[30343]: cluster 2021-03-10T14:05:15.609070+0000 mgr.gibba045.orlgmj (mgr.34412) 923 : cluster [DBG] pgmap v506: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:17.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:05:17 gibba045 bash[25517]: cluster 2021-03-10T14:05:15.609070+0000 mgr.gibba045.orlgmj (mgr.34412) 923 : cluster [DBG] pgmap v506: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:19.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:05:19 gibba015 bash[29377]: cluster 2021-03-10T14:05:17.610737+0000 mgr.gibba045.orlgmj (mgr.34412) 924 : cluster [DBG] pgmap v507: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:19.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:05:19 gibba015 bash[30343]: cluster 2021-03-10T14:05:17.610737+0000 mgr.gibba045.orlgmj (mgr.34412) 924 : cluster [DBG] pgmap v507: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:19.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:05:19 gibba045 bash[25517]: cluster 2021-03-10T14:05:17.610737+0000 mgr.gibba045.orlgmj (mgr.34412) 924 : cluster [DBG] pgmap v507: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:21.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:05:21 gibba015 bash[29377]: cluster 2021-03-10T14:05:19.612309+0000 mgr.gibba045.orlgmj (mgr.34412) 925 : cluster [DBG] pgmap v508: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:21.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:05:21 gibba015 bash[30343]: cluster 2021-03-10T14:05:19.612309+0000 mgr.gibba045.orlgmj (mgr.34412) 925 : cluster [DBG] pgmap v508: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:21.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:05:21 gibba045 bash[25517]: cluster 2021-03-10T14:05:19.612309+0000 mgr.gibba045.orlgmj (mgr.34412) 925 : cluster [DBG] pgmap v508: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:23.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:05:23 gibba015 bash[29377]: cluster 2021-03-10T14:05:21.613054+0000 mgr.gibba045.orlgmj (mgr.34412) 926 : cluster [DBG] pgmap v509: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:23.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:05:23 gibba015 bash[30343]: cluster 2021-03-10T14:05:21.613054+0000 mgr.gibba045.orlgmj (mgr.34412) 926 : cluster [DBG] pgmap v509: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:23.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:05:23 gibba045 bash[25517]: cluster 2021-03-10T14:05:21.613054+0000 mgr.gibba045.orlgmj (mgr.34412) 926 : cluster [DBG] pgmap v509: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:25.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:05:25 gibba015 bash[29377]: cluster 2021-03-10T14:05:23.614127+0000 mgr.gibba045.orlgmj (mgr.34412) 927 : cluster [DBG] pgmap v510: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:25.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:05:25 gibba015 bash[30343]: cluster 2021-03-10T14:05:23.614127+0000 mgr.gibba045.orlgmj (mgr.34412) 927 : cluster [DBG] pgmap v510: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:25.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:05:25 gibba045 bash[25517]: cluster 2021-03-10T14:05:23.614127+0000 mgr.gibba045.orlgmj (mgr.34412) 927 : cluster [DBG] pgmap v510: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:26.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:05:26 gibba015 bash[29377]: cluster 2021-03-10T14:05:25.615741+0000 mgr.gibba045.orlgmj (mgr.34412) 928 : cluster [DBG] pgmap v511: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:26.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:05:26 gibba015 bash[30343]: cluster 2021-03-10T14:05:25.615741+0000 mgr.gibba045.orlgmj (mgr.34412) 928 : cluster [DBG] pgmap v511: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:26.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:05:26 gibba045 bash[25517]: cluster 2021-03-10T14:05:25.615741+0000 mgr.gibba045.orlgmj (mgr.34412) 928 : cluster [DBG] pgmap v511: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:29.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:05:28 gibba045 bash[25517]: cluster 2021-03-10T14:05:27.617488+0000 mgr.gibba045.orlgmj (mgr.34412) 929 : cluster [DBG] pgmap v512: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:29.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:05:28 gibba045 bash[25517]: cephadm 2021-03-10T14:05:28.090418+0000 mgr.gibba045.orlgmj (mgr.34412) 930 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:05:29.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:05:28 gibba015 bash[29377]: cluster 2021-03-10T14:05:27.617488+0000 mgr.gibba045.orlgmj (mgr.34412) 929 : cluster [DBG] pgmap v512: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:29.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:05:28 gibba015 bash[29377]: cephadm 2021-03-10T14:05:28.090418+0000 mgr.gibba045.orlgmj (mgr.34412) 930 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:05:29.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:05:28 gibba015 bash[30343]: cluster 2021-03-10T14:05:27.617488+0000 mgr.gibba045.orlgmj (mgr.34412) 929 : cluster [DBG] pgmap v512: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:29.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:05:28 gibba015 bash[30343]: cephadm 2021-03-10T14:05:28.090418+0000 mgr.gibba045.orlgmj (mgr.34412) 930 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:05:31.105 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:05:31.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:05:30 gibba015 bash[29377]: cluster 2021-03-10T14:05:29.618828+0000 mgr.gibba045.orlgmj (mgr.34412) 931 : cluster [DBG] pgmap v513: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:31.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:05:30 gibba015 bash[30343]: cluster 2021-03-10T14:05:29.618828+0000 mgr.gibba045.orlgmj (mgr.34412) 931 : cluster [DBG] pgmap v513: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:31.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:05:30 gibba045 bash[25517]: cluster 2021-03-10T14:05:29.618828+0000 mgr.gibba045.orlgmj (mgr.34412) 931 : cluster [DBG] pgmap v513: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:31.333 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:05:31.333 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (16m) 2m ago 21m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:05:31.334 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (21m) 78s ago 21m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:05:31.334 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (16m) 78s ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:05:31.334 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (16m) 78s ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:05:31.334 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (15m) 2m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:05:31.335 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (15m) 2m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:05:31.335 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (15m) 78s ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:05:31.335 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (15m) 2m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:05:31.335 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (21m) 2m ago 21m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:05:31.335 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (21m) 78s ago 21m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:05:31.336 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (14m) 2m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:05:31.336 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (14m) 2m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:05:31.336 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (13m) 2m ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:05:31.336 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (13m) 2m ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:05:31.336 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (12m) 78s ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:05:31.337 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (12m) 78s ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:05:31.337 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (11m) 78s ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:05:31.337 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (11m) 78s ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:05:31.337 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (21m) 78s ago 21m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:05:31.337 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 78s ago 19m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:05:31.581 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:05:31.581 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:05:31.582 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:05:31.582 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:05:31.582 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:05:31.582 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:05:31.583 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:05:31.583 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:05:31.583 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:05:31.583 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:05:31.584 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:05:31.584 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:05:31.584 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:05:31.584 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:05:31.584 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:05:32.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:05:31 gibba015 bash[29377]: audit 2021-03-10T14:05:31.096025+0000 mgr.gibba045.orlgmj (mgr.34412) 932 : audit [DBG] from='client.54670 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:05:32.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:05:31 gibba015 bash[29377]: audit 2021-03-10T14:05:31.578671+0000 mon.a (mon.0) 670 : audit [DBG] from='client.? 172.21.2.115:0/1333012442' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:05:32.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:05:31 gibba015 bash[30343]: audit 2021-03-10T14:05:31.096025+0000 mgr.gibba045.orlgmj (mgr.34412) 932 : audit [DBG] from='client.54670 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:05:32.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:05:31 gibba015 bash[30343]: audit 2021-03-10T14:05:31.578671+0000 mon.a (mon.0) 670 : audit [DBG] from='client.? 172.21.2.115:0/1333012442' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:05:32.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:05:31 gibba045 bash[25517]: audit 2021-03-10T14:05:31.096025+0000 mgr.gibba045.orlgmj (mgr.34412) 932 : audit [DBG] from='client.54670 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:05:32.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:05:31 gibba045 bash[25517]: audit 2021-03-10T14:05:31.578671+0000 mon.a (mon.0) 670 : audit [DBG] from='client.? 172.21.2.115:0/1333012442' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:05:33.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:05:32 gibba015 bash[29377]: audit 2021-03-10T14:05:31.321047+0000 mgr.gibba045.orlgmj (mgr.34412) 933 : audit [DBG] from='client.44688 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:05:33.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:05:32 gibba015 bash[29377]: cluster 2021-03-10T14:05:31.620627+0000 mgr.gibba045.orlgmj (mgr.34412) 934 : cluster [DBG] pgmap v514: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:33.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:05:32 gibba015 bash[30343]: audit 2021-03-10T14:05:31.321047+0000 mgr.gibba045.orlgmj (mgr.34412) 933 : audit [DBG] from='client.44688 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:05:33.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:05:32 gibba015 bash[30343]: cluster 2021-03-10T14:05:31.620627+0000 mgr.gibba045.orlgmj (mgr.34412) 934 : cluster [DBG] pgmap v514: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:33.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:05:32 gibba045 bash[25517]: audit 2021-03-10T14:05:31.321047+0000 mgr.gibba045.orlgmj (mgr.34412) 933 : audit [DBG] from='client.44688 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:05:33.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:05:32 gibba045 bash[25517]: cluster 2021-03-10T14:05:31.620627+0000 mgr.gibba045.orlgmj (mgr.34412) 934 : cluster [DBG] pgmap v514: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:35.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:05:34 gibba015 bash[29377]: cluster 2021-03-10T14:05:33.621990+0000 mgr.gibba045.orlgmj (mgr.34412) 935 : cluster [DBG] pgmap v515: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:35.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:05:34 gibba015 bash[30343]: cluster 2021-03-10T14:05:33.621990+0000 mgr.gibba045.orlgmj (mgr.34412) 935 : cluster [DBG] pgmap v515: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:35.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:05:34 gibba045 bash[25517]: cluster 2021-03-10T14:05:33.621990+0000 mgr.gibba045.orlgmj (mgr.34412) 935 : cluster [DBG] pgmap v515: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:37.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:05:36 gibba015 bash[29377]: cluster 2021-03-10T14:05:35.623731+0000 mgr.gibba045.orlgmj (mgr.34412) 936 : cluster [DBG] pgmap v516: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:37.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:05:36 gibba015 bash[30343]: cluster 2021-03-10T14:05:35.623731+0000 mgr.gibba045.orlgmj (mgr.34412) 936 : cluster [DBG] pgmap v516: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:37.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:05:36 gibba045 bash[25517]: cluster 2021-03-10T14:05:35.623731+0000 mgr.gibba045.orlgmj (mgr.34412) 936 : cluster [DBG] pgmap v516: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:39.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:05:38 gibba015 bash[29377]: cluster 2021-03-10T14:05:37.625508+0000 mgr.gibba045.orlgmj (mgr.34412) 937 : cluster [DBG] pgmap v517: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:39.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:05:38 gibba015 bash[30343]: cluster 2021-03-10T14:05:37.625508+0000 mgr.gibba045.orlgmj (mgr.34412) 937 : cluster [DBG] pgmap v517: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:39.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:05:38 gibba045 bash[25517]: cluster 2021-03-10T14:05:37.625508+0000 mgr.gibba045.orlgmj (mgr.34412) 937 : cluster [DBG] pgmap v517: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:41.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:05:40 gibba015 bash[29377]: cluster 2021-03-10T14:05:39.626070+0000 mgr.gibba045.orlgmj (mgr.34412) 938 : cluster [DBG] pgmap v518: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:41.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:05:40 gibba015 bash[30343]: cluster 2021-03-10T14:05:39.626070+0000 mgr.gibba045.orlgmj (mgr.34412) 938 : cluster [DBG] pgmap v518: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:41.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:05:40 gibba045 bash[25517]: cluster 2021-03-10T14:05:39.626070+0000 mgr.gibba045.orlgmj (mgr.34412) 938 : cluster [DBG] pgmap v518: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:43.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:05:42 gibba015 bash[29377]: cluster 2021-03-10T14:05:41.627706+0000 mgr.gibba045.orlgmj (mgr.34412) 939 : cluster [DBG] pgmap v519: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:43.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:05:42 gibba015 bash[30343]: cluster 2021-03-10T14:05:41.627706+0000 mgr.gibba045.orlgmj (mgr.34412) 939 : cluster [DBG] pgmap v519: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:43.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:05:42 gibba045 bash[25517]: cluster 2021-03-10T14:05:41.627706+0000 mgr.gibba045.orlgmj (mgr.34412) 939 : cluster [DBG] pgmap v519: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:44.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:05:43 gibba015 bash[29377]: cephadm 2021-03-10T14:05:43.106332+0000 mgr.gibba045.orlgmj (mgr.34412) 940 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:05:44.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:05:43 gibba015 bash[30343]: cephadm 2021-03-10T14:05:43.106332+0000 mgr.gibba045.orlgmj (mgr.34412) 940 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:05:44.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:05:43 gibba045 bash[25517]: cephadm 2021-03-10T14:05:43.106332+0000 mgr.gibba045.orlgmj (mgr.34412) 940 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:05:45.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:05:44 gibba015 bash[29377]: cluster 2021-03-10T14:05:43.629027+0000 mgr.gibba045.orlgmj (mgr.34412) 941 : cluster [DBG] pgmap v520: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:45.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:05:44 gibba015 bash[30343]: cluster 2021-03-10T14:05:43.629027+0000 mgr.gibba045.orlgmj (mgr.34412) 941 : cluster [DBG] pgmap v520: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:45.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:05:44 gibba045 bash[25517]: cluster 2021-03-10T14:05:43.629027+0000 mgr.gibba045.orlgmj (mgr.34412) 941 : cluster [DBG] pgmap v520: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:47.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:05:46 gibba015 bash[29377]: cluster 2021-03-10T14:05:45.630534+0000 mgr.gibba045.orlgmj (mgr.34412) 942 : cluster [DBG] pgmap v521: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:47.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:05:46 gibba015 bash[30343]: cluster 2021-03-10T14:05:45.630534+0000 mgr.gibba045.orlgmj (mgr.34412) 942 : cluster [DBG] pgmap v521: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:47.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:05:46 gibba045 bash[25517]: cluster 2021-03-10T14:05:45.630534+0000 mgr.gibba045.orlgmj (mgr.34412) 942 : cluster [DBG] pgmap v521: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:49.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:05:48 gibba015 bash[29377]: cluster 2021-03-10T14:05:47.632283+0000 mgr.gibba045.orlgmj (mgr.34412) 943 : cluster [DBG] pgmap v522: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:49.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:05:48 gibba015 bash[30343]: cluster 2021-03-10T14:05:47.632283+0000 mgr.gibba045.orlgmj (mgr.34412) 943 : cluster [DBG] pgmap v522: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:49.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:05:48 gibba045 bash[25517]: cluster 2021-03-10T14:05:47.632283+0000 mgr.gibba045.orlgmj (mgr.34412) 943 : cluster [DBG] pgmap v522: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:51.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:05:50 gibba015 bash[29377]: cluster 2021-03-10T14:05:49.633230+0000 mgr.gibba045.orlgmj (mgr.34412) 944 : cluster [DBG] pgmap v523: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:51.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:05:50 gibba015 bash[30343]: cluster 2021-03-10T14:05:49.633230+0000 mgr.gibba045.orlgmj (mgr.34412) 944 : cluster [DBG] pgmap v523: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:51.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:05:50 gibba045 bash[25517]: cluster 2021-03-10T14:05:49.633230+0000 mgr.gibba045.orlgmj (mgr.34412) 944 : cluster [DBG] pgmap v523: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:53.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:05:52 gibba015 bash[29377]: cluster 2021-03-10T14:05:51.634943+0000 mgr.gibba045.orlgmj (mgr.34412) 945 : cluster [DBG] pgmap v524: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:53.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:05:52 gibba015 bash[29377]: audit 2021-03-10T14:05:52.497118+0000 mon.c (mon.1) 326 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T14:05:53.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:05:52 gibba015 bash[29377]: audit 2021-03-10T14:05:52.497877+0000 mon.c (mon.1) 327 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:05:53.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:05:52 gibba015 bash[29377]: audit 2021-03-10T14:05:52.498329+0000 mon.a (mon.0) 671 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T14:05:53.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:05:52 gibba015 bash[29377]: audit 2021-03-10T14:05:52.498544+0000 mon.c (mon.1) 328 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:05:53.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:05:52 gibba015 bash[29377]: audit 2021-03-10T14:05:52.499205+0000 mon.c (mon.1) 329 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:05:53.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:05:52 gibba015 bash[29377]: audit 2021-03-10T14:05:52.499848+0000 mon.a (mon.0) 672 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:05:53.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:05:52 gibba015 bash[29377]: audit 2021-03-10T14:05:52.500912+0000 mon.a (mon.0) 673 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:05:53.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:05:52 gibba015 bash[29377]: audit 2021-03-10T14:05:52.502091+0000 mon.a (mon.0) 674 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:05:53.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:05:52 gibba015 bash[29377]: audit 2021-03-10T14:05:52.564697+0000 mon.c (mon.1) 330 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:05:53.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:05:52 gibba015 bash[29377]: audit 2021-03-10T14:05:52.565359+0000 mon.c (mon.1) 331 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:05:53.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:05:52 gibba015 bash[29377]: audit 2021-03-10T14:05:52.565852+0000 mon.a (mon.0) 675 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:05:53.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:05:52 gibba015 bash[29377]: audit 2021-03-10T14:05:52.566997+0000 mon.a (mon.0) 676 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:05:53.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:05:52 gibba015 bash[30343]: cluster 2021-03-10T14:05:51.634943+0000 mgr.gibba045.orlgmj (mgr.34412) 945 : cluster [DBG] pgmap v524: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:53.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:05:52 gibba015 bash[30343]: audit 2021-03-10T14:05:52.497118+0000 mon.c (mon.1) 326 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T14:05:53.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:05:52 gibba015 bash[30343]: audit 2021-03-10T14:05:52.497877+0000 mon.c (mon.1) 327 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:05:53.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:05:52 gibba015 bash[30343]: audit 2021-03-10T14:05:52.498329+0000 mon.a (mon.0) 671 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T14:05:53.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:05:52 gibba015 bash[30343]: audit 2021-03-10T14:05:52.498544+0000 mon.c (mon.1) 328 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:05:53.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:05:52 gibba015 bash[30343]: audit 2021-03-10T14:05:52.499205+0000 mon.c (mon.1) 329 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:05:53.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:05:52 gibba015 bash[30343]: audit 2021-03-10T14:05:52.499848+0000 mon.a (mon.0) 672 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:05:53.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:05:52 gibba015 bash[30343]: audit 2021-03-10T14:05:52.500912+0000 mon.a (mon.0) 673 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:05:53.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:05:52 gibba015 bash[30343]: audit 2021-03-10T14:05:52.502091+0000 mon.a (mon.0) 674 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:05:53.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:05:52 gibba015 bash[30343]: audit 2021-03-10T14:05:52.564697+0000 mon.c (mon.1) 330 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:05:53.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:05:52 gibba015 bash[30343]: audit 2021-03-10T14:05:52.565359+0000 mon.c (mon.1) 331 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:05:53.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:05:52 gibba015 bash[30343]: audit 2021-03-10T14:05:52.565852+0000 mon.a (mon.0) 675 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:05:53.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:05:52 gibba015 bash[30343]: audit 2021-03-10T14:05:52.566997+0000 mon.a (mon.0) 676 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:05:53.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:05:52 gibba045 bash[25517]: cluster 2021-03-10T14:05:51.634943+0000 mgr.gibba045.orlgmj (mgr.34412) 945 : cluster [DBG] pgmap v524: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:53.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:05:52 gibba045 bash[25517]: audit 2021-03-10T14:05:52.497118+0000 mon.c (mon.1) 326 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T14:05:53.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:05:52 gibba045 bash[25517]: audit 2021-03-10T14:05:52.497877+0000 mon.c (mon.1) 327 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:05:53.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:05:52 gibba045 bash[25517]: audit 2021-03-10T14:05:52.498329+0000 mon.a (mon.0) 671 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T14:05:53.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:05:52 gibba045 bash[25517]: audit 2021-03-10T14:05:52.498544+0000 mon.c (mon.1) 328 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:05:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:05:52 gibba045 bash[25517]: audit 2021-03-10T14:05:52.499205+0000 mon.c (mon.1) 329 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:05:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:05:52 gibba045 bash[25517]: audit 2021-03-10T14:05:52.499848+0000 mon.a (mon.0) 672 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:05:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:05:52 gibba045 bash[25517]: audit 2021-03-10T14:05:52.500912+0000 mon.a (mon.0) 673 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:05:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:05:52 gibba045 bash[25517]: audit 2021-03-10T14:05:52.502091+0000 mon.a (mon.0) 674 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:05:53.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:05:52 gibba045 bash[25517]: audit 2021-03-10T14:05:52.564697+0000 mon.c (mon.1) 330 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:05:53.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:05:52 gibba045 bash[25517]: audit 2021-03-10T14:05:52.565359+0000 mon.c (mon.1) 331 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:05:53.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:05:52 gibba045 bash[25517]: audit 2021-03-10T14:05:52.565852+0000 mon.a (mon.0) 675 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:05:53.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:05:52 gibba045 bash[25517]: audit 2021-03-10T14:05:52.566997+0000 mon.a (mon.0) 676 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:05:55.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:05:54 gibba015 bash[29377]: cluster 2021-03-10T14:05:53.636303+0000 mgr.gibba045.orlgmj (mgr.34412) 946 : cluster [DBG] pgmap v525: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:55.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:05:54 gibba015 bash[30343]: cluster 2021-03-10T14:05:53.636303+0000 mgr.gibba045.orlgmj (mgr.34412) 946 : cluster [DBG] pgmap v525: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:55.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:05:54 gibba045 bash[25517]: cluster 2021-03-10T14:05:53.636303+0000 mgr.gibba045.orlgmj (mgr.34412) 946 : cluster [DBG] pgmap v525: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:57.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:05:56 gibba015 bash[29377]: cluster 2021-03-10T14:05:55.638006+0000 mgr.gibba045.orlgmj (mgr.34412) 947 : cluster [DBG] pgmap v526: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:57.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:05:56 gibba015 bash[30343]: cluster 2021-03-10T14:05:55.638006+0000 mgr.gibba045.orlgmj (mgr.34412) 947 : cluster [DBG] pgmap v526: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:57.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:05:56 gibba045 bash[25517]: cluster 2021-03-10T14:05:55.638006+0000 mgr.gibba045.orlgmj (mgr.34412) 947 : cluster [DBG] pgmap v526: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:59.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:05:58 gibba015 bash[29377]: cluster 2021-03-10T14:05:57.639734+0000 mgr.gibba045.orlgmj (mgr.34412) 948 : cluster [DBG] pgmap v527: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:59.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:05:58 gibba015 bash[29377]: cephadm 2021-03-10T14:05:58.122265+0000 mgr.gibba045.orlgmj (mgr.34412) 949 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:05:59.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:05:58 gibba015 bash[30343]: cluster 2021-03-10T14:05:57.639734+0000 mgr.gibba045.orlgmj (mgr.34412) 948 : cluster [DBG] pgmap v527: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:59.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:05:58 gibba015 bash[30343]: cephadm 2021-03-10T14:05:58.122265+0000 mgr.gibba045.orlgmj (mgr.34412) 949 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:05:59.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:05:58 gibba045 bash[25517]: cluster 2021-03-10T14:05:57.639734+0000 mgr.gibba045.orlgmj (mgr.34412) 948 : cluster [DBG] pgmap v527: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:59.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:05:58 gibba045 bash[25517]: cephadm 2021-03-10T14:05:58.122265+0000 mgr.gibba045.orlgmj (mgr.34412) 949 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:06:01.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:06:00 gibba015 bash[29377]: cluster 2021-03-10T14:05:59.641370+0000 mgr.gibba045.orlgmj (mgr.34412) 950 : cluster [DBG] pgmap v528: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:01.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:06:00 gibba015 bash[30343]: cluster 2021-03-10T14:05:59.641370+0000 mgr.gibba045.orlgmj (mgr.34412) 950 : cluster [DBG] pgmap v528: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:01.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:06:00 gibba045 bash[25517]: cluster 2021-03-10T14:05:59.641370+0000 mgr.gibba045.orlgmj (mgr.34412) 950 : cluster [DBG] pgmap v528: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:01.823 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:06:02.051 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:06:02.051 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (16m) 2m ago 22m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:06:02.052 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (21m) 109s ago 21m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:06:02.052 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (17m) 109s ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:06:02.052 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (17m) 109s ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:06:02.052 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (16m) 2m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:06:02.053 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (16m) 2m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:06:02.053 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (15m) 109s ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:06:02.053 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (15m) 2m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:06:02.053 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (22m) 2m ago 22m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:06:02.054 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (22m) 109s ago 22m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:06:02.054 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (15m) 2m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:06:02.054 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (14m) 2m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:06:02.054 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (14m) 2m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:06:02.055 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (13m) 2m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:06:02.055 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (13m) 109s ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:06:02.055 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (12m) 109s ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:06:02.055 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (12m) 109s ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:06:02.055 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (12m) 109s ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:06:02.056 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (21m) 109s ago 22m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:06:02.056 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 109s ago 20m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:06:02.302 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:06:02.302 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:06:02.303 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:06:02.303 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:06:02.303 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:06:02.303 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:06:02.303 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:06:02.304 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:06:02.304 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:06:02.304 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:06:02.304 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:06:02.304 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:06:02.305 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:06:02.305 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:06:02.305 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:06:03.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:06:02 gibba015 bash[29377]: cluster 2021-03-10T14:06:01.643264+0000 mgr.gibba045.orlgmj (mgr.34412) 951 : cluster [DBG] pgmap v529: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:03.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:06:02 gibba015 bash[29377]: audit 2021-03-10T14:06:01.814410+0000 mgr.gibba045.orlgmj (mgr.34412) 952 : audit [DBG] from='client.54688 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:06:03.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:06:02 gibba015 bash[29377]: audit 2021-03-10T14:06:02.039394+0000 mgr.gibba045.orlgmj (mgr.34412) 953 : audit [DBG] from='client.44706 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:06:03.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:06:02 gibba015 bash[29377]: audit 2021-03-10T14:06:02.299450+0000 mon.a (mon.0) 677 : audit [DBG] from='client.? 172.21.2.115:0/2879332472' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:06:03.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:06:02 gibba015 bash[30343]: cluster 2021-03-10T14:06:01.643264+0000 mgr.gibba045.orlgmj (mgr.34412) 951 : cluster [DBG] pgmap v529: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:03.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:06:02 gibba015 bash[30343]: audit 2021-03-10T14:06:01.814410+0000 mgr.gibba045.orlgmj (mgr.34412) 952 : audit [DBG] from='client.54688 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:06:03.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:06:02 gibba015 bash[30343]: audit 2021-03-10T14:06:02.039394+0000 mgr.gibba045.orlgmj (mgr.34412) 953 : audit [DBG] from='client.44706 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:06:03.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:06:02 gibba015 bash[30343]: audit 2021-03-10T14:06:02.299450+0000 mon.a (mon.0) 677 : audit [DBG] from='client.? 172.21.2.115:0/2879332472' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:06:03.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:06:02 gibba045 bash[25517]: cluster 2021-03-10T14:06:01.643264+0000 mgr.gibba045.orlgmj (mgr.34412) 951 : cluster [DBG] pgmap v529: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:03.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:06:02 gibba045 bash[25517]: audit 2021-03-10T14:06:01.814410+0000 mgr.gibba045.orlgmj (mgr.34412) 952 : audit [DBG] from='client.54688 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:06:03.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:06:02 gibba045 bash[25517]: audit 2021-03-10T14:06:02.039394+0000 mgr.gibba045.orlgmj (mgr.34412) 953 : audit [DBG] from='client.44706 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:06:03.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:06:02 gibba045 bash[25517]: audit 2021-03-10T14:06:02.299450+0000 mon.a (mon.0) 677 : audit [DBG] from='client.? 172.21.2.115:0/2879332472' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:06:05.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:06:04 gibba015 bash[29377]: cluster 2021-03-10T14:06:03.644634+0000 mgr.gibba045.orlgmj (mgr.34412) 954 : cluster [DBG] pgmap v530: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:05.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:06:04 gibba015 bash[30343]: cluster 2021-03-10T14:06:03.644634+0000 mgr.gibba045.orlgmj (mgr.34412) 954 : cluster [DBG] pgmap v530: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:05.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:06:04 gibba045 bash[25517]: cluster 2021-03-10T14:06:03.644634+0000 mgr.gibba045.orlgmj (mgr.34412) 954 : cluster [DBG] pgmap v530: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:07.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:06:06 gibba015 bash[29377]: cluster 2021-03-10T14:06:05.645834+0000 mgr.gibba045.orlgmj (mgr.34412) 955 : cluster [DBG] pgmap v531: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:07.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:06:06 gibba015 bash[30343]: cluster 2021-03-10T14:06:05.645834+0000 mgr.gibba045.orlgmj (mgr.34412) 955 : cluster [DBG] pgmap v531: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:07.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:06:06 gibba045 bash[25517]: cluster 2021-03-10T14:06:05.645834+0000 mgr.gibba045.orlgmj (mgr.34412) 955 : cluster [DBG] pgmap v531: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:09.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:06:08 gibba045 bash[25517]: cluster 2021-03-10T14:06:07.647614+0000 mgr.gibba045.orlgmj (mgr.34412) 956 : cluster [DBG] pgmap v532: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:09.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:06:08 gibba015 bash[29377]: cluster 2021-03-10T14:06:07.647614+0000 mgr.gibba045.orlgmj (mgr.34412) 956 : cluster [DBG] pgmap v532: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:09.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:06:08 gibba015 bash[30343]: cluster 2021-03-10T14:06:07.647614+0000 mgr.gibba045.orlgmj (mgr.34412) 956 : cluster [DBG] pgmap v532: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:11.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:06:10 gibba045 bash[25517]: cluster 2021-03-10T14:06:09.648123+0000 mgr.gibba045.orlgmj (mgr.34412) 957 : cluster [DBG] pgmap v533: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:11.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:06:10 gibba015 bash[29377]: cluster 2021-03-10T14:06:09.648123+0000 mgr.gibba045.orlgmj (mgr.34412) 957 : cluster [DBG] pgmap v533: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:11.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:06:10 gibba015 bash[30343]: cluster 2021-03-10T14:06:09.648123+0000 mgr.gibba045.orlgmj (mgr.34412) 957 : cluster [DBG] pgmap v533: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:13.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:06:12 gibba045 bash[25517]: cluster 2021-03-10T14:06:11.649945+0000 mgr.gibba045.orlgmj (mgr.34412) 958 : cluster [DBG] pgmap v534: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:13.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:06:12 gibba015 bash[29377]: cluster 2021-03-10T14:06:11.649945+0000 mgr.gibba045.orlgmj (mgr.34412) 958 : cluster [DBG] pgmap v534: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:13.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:06:12 gibba015 bash[30343]: cluster 2021-03-10T14:06:11.649945+0000 mgr.gibba045.orlgmj (mgr.34412) 958 : cluster [DBG] pgmap v534: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:14.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:06:14 gibba045 bash[25517]: audit 2021-03-10T14:06:13.136198+0000 mon.c (mon.1) 332 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:06:14.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:06:14 gibba045 bash[25517]: audit 2021-03-10T14:06:13.353743+0000 mon.a (mon.0) 678 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:06:14.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:06:14 gibba045 bash[25517]: audit 2021-03-10T14:06:13.357283+0000 mon.c (mon.1) 333 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:06:14.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:06:14 gibba045 bash[25517]: audit 2021-03-10T14:06:13.358566+0000 mon.c (mon.1) 334 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:06:14.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:06:14 gibba045 bash[25517]: audit 2021-03-10T14:06:13.359741+0000 mon.c (mon.1) 335 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:06:14.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:06:14 gibba045 bash[25517]: audit 2021-03-10T14:06:13.361001+0000 mon.c (mon.1) 336 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:06:14.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:06:14 gibba045 bash[25517]: audit 2021-03-10T14:06:13.364931+0000 mon.c (mon.1) 337 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:06:14.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:06:14 gibba045 bash[25517]: audit 2021-03-10T14:06:13.366392+0000 mon.c (mon.1) 338 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:06:14.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:06:13 gibba015 bash[29377]: audit 2021-03-10T14:06:13.136198+0000 mon.c (mon.1) 332 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:06:14.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:06:13 gibba015 bash[29377]: audit 2021-03-10T14:06:13.353743+0000 mon.a (mon.0) 678 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:06:14.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:06:13 gibba015 bash[29377]: audit 2021-03-10T14:06:13.357283+0000 mon.c (mon.1) 333 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:06:14.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:06:13 gibba015 bash[29377]: audit 2021-03-10T14:06:13.358566+0000 mon.c (mon.1) 334 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:06:14.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:06:13 gibba015 bash[29377]: audit 2021-03-10T14:06:13.359741+0000 mon.c (mon.1) 335 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:06:14.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:06:13 gibba015 bash[29377]: audit 2021-03-10T14:06:13.361001+0000 mon.c (mon.1) 336 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:06:14.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:06:13 gibba015 bash[29377]: audit 2021-03-10T14:06:13.364931+0000 mon.c (mon.1) 337 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:06:14.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:06:13 gibba015 bash[29377]: audit 2021-03-10T14:06:13.366392+0000 mon.c (mon.1) 338 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:06:14.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:06:13 gibba015 bash[30343]: audit 2021-03-10T14:06:13.136198+0000 mon.c (mon.1) 332 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:06:14.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:06:13 gibba015 bash[30343]: audit 2021-03-10T14:06:13.353743+0000 mon.a (mon.0) 678 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:06:14.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:06:13 gibba015 bash[30343]: audit 2021-03-10T14:06:13.357283+0000 mon.c (mon.1) 333 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:06:14.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:06:13 gibba015 bash[30343]: audit 2021-03-10T14:06:13.358566+0000 mon.c (mon.1) 334 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:06:14.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:06:13 gibba015 bash[30343]: audit 2021-03-10T14:06:13.359741+0000 mon.c (mon.1) 335 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:06:14.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:06:13 gibba015 bash[30343]: audit 2021-03-10T14:06:13.361001+0000 mon.c (mon.1) 336 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:06:14.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:06:13 gibba015 bash[30343]: audit 2021-03-10T14:06:13.364931+0000 mon.c (mon.1) 337 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:06:14.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:06:13 gibba015 bash[30343]: audit 2021-03-10T14:06:13.366392+0000 mon.c (mon.1) 338 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:06:15.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:06:15 gibba045 bash[25517]: cephadm 2021-03-10T14:06:13.144354+0000 mgr.gibba045.orlgmj (mgr.34412) 959 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:06:15.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:06:15 gibba045 bash[25517]: cephadm 2021-03-10T14:06:13.146166+0000 mgr.gibba045.orlgmj (mgr.34412) 960 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:06:15.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:06:15 gibba045 bash[25517]: cephadm 2021-03-10T14:06:13.359200+0000 mgr.gibba045.orlgmj (mgr.34412) 961 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:06:15.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:06:15 gibba045 bash[25517]: cephadm 2021-03-10T14:06:13.360897+0000 mgr.gibba045.orlgmj (mgr.34412) 962 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:06:15.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:06:15 gibba045 bash[25517]: cephadm 2021-03-10T14:06:13.361929+0000 mgr.gibba045.orlgmj (mgr.34412) 963 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:06:15.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:06:15 gibba045 bash[25517]: cephadm 2021-03-10T14:06:13.361967+0000 mgr.gibba045.orlgmj (mgr.34412) 964 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:06:15.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:06:15 gibba045 bash[25517]: cephadm 2021-03-10T14:06:13.363230+0000 mgr.gibba045.orlgmj (mgr.34412) 965 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:06:15.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:06:15 gibba045 bash[25517]: cephadm 2021-03-10T14:06:13.363269+0000 mgr.gibba045.orlgmj (mgr.34412) 966 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:06:15.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:06:15 gibba045 bash[25517]: cephadm 2021-03-10T14:06:13.364880+0000 mgr.gibba045.orlgmj (mgr.34412) 967 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:06:15.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:06:15 gibba045 bash[25517]: cephadm 2021-03-10T14:06:13.367005+0000 mgr.gibba045.orlgmj (mgr.34412) 968 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:06:15.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:06:15 gibba045 bash[25517]: cephadm 2021-03-10T14:06:13.367044+0000 mgr.gibba045.orlgmj (mgr.34412) 969 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:06:15.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:06:15 gibba045 bash[25517]: cephadm 2021-03-10T14:06:13.368461+0000 mgr.gibba045.orlgmj (mgr.34412) 970 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:06:15.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:06:15 gibba045 bash[25517]: cephadm 2021-03-10T14:06:13.368805+0000 mgr.gibba045.orlgmj (mgr.34412) 971 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:06:15.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:06:15 gibba045 bash[25517]: cephadm 2021-03-10T14:06:13.370482+0000 mgr.gibba045.orlgmj (mgr.34412) 972 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:06:15.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:06:15 gibba045 bash[25517]: cephadm 2021-03-10T14:06:13.370530+0000 mgr.gibba045.orlgmj (mgr.34412) 973 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:06:15.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:06:15 gibba045 bash[25517]: cephadm 2021-03-10T14:06:13.370668+0000 mgr.gibba045.orlgmj (mgr.34412) 974 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:06:15.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:06:15 gibba045 bash[25517]: cluster 2021-03-10T14:06:13.651230+0000 mgr.gibba045.orlgmj (mgr.34412) 975 : cluster [DBG] pgmap v535: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:15.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:06:15 gibba015 bash[29377]: cephadm 2021-03-10T14:06:13.144354+0000 mgr.gibba045.orlgmj (mgr.34412) 959 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:06:15.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:06:15 gibba015 bash[29377]: cephadm 2021-03-10T14:06:13.146166+0000 mgr.gibba045.orlgmj (mgr.34412) 960 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:06:15.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:06:15 gibba015 bash[29377]: cephadm 2021-03-10T14:06:13.359200+0000 mgr.gibba045.orlgmj (mgr.34412) 961 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:06:15.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:06:15 gibba015 bash[29377]: cephadm 2021-03-10T14:06:13.360897+0000 mgr.gibba045.orlgmj (mgr.34412) 962 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:06:15.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:06:15 gibba015 bash[29377]: cephadm 2021-03-10T14:06:13.361929+0000 mgr.gibba045.orlgmj (mgr.34412) 963 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:06:15.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:06:15 gibba015 bash[29377]: cephadm 2021-03-10T14:06:13.361967+0000 mgr.gibba045.orlgmj (mgr.34412) 964 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:06:15.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:06:15 gibba015 bash[29377]: cephadm 2021-03-10T14:06:13.363230+0000 mgr.gibba045.orlgmj (mgr.34412) 965 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:06:15.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:06:15 gibba015 bash[29377]: cephadm 2021-03-10T14:06:13.363269+0000 mgr.gibba045.orlgmj (mgr.34412) 966 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:06:15.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:06:15 gibba015 bash[29377]: cephadm 2021-03-10T14:06:13.364880+0000 mgr.gibba045.orlgmj (mgr.34412) 967 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:06:15.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:06:15 gibba015 bash[29377]: cephadm 2021-03-10T14:06:13.367005+0000 mgr.gibba045.orlgmj (mgr.34412) 968 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:06:15.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:06:15 gibba015 bash[29377]: cephadm 2021-03-10T14:06:13.367044+0000 mgr.gibba045.orlgmj (mgr.34412) 969 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:06:15.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:06:15 gibba015 bash[29377]: cephadm 2021-03-10T14:06:13.368461+0000 mgr.gibba045.orlgmj (mgr.34412) 970 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:06:15.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:06:15 gibba015 bash[29377]: cephadm 2021-03-10T14:06:13.368805+0000 mgr.gibba045.orlgmj (mgr.34412) 971 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:06:15.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:06:15 gibba015 bash[29377]: cephadm 2021-03-10T14:06:13.370482+0000 mgr.gibba045.orlgmj (mgr.34412) 972 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:06:15.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:06:15 gibba015 bash[29377]: cephadm 2021-03-10T14:06:13.370530+0000 mgr.gibba045.orlgmj (mgr.34412) 973 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:06:15.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:06:15 gibba015 bash[29377]: cephadm 2021-03-10T14:06:13.370668+0000 mgr.gibba045.orlgmj (mgr.34412) 974 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:06:15.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:06:15 gibba015 bash[29377]: cluster 2021-03-10T14:06:13.651230+0000 mgr.gibba045.orlgmj (mgr.34412) 975 : cluster [DBG] pgmap v535: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:15.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:06:15 gibba015 bash[30343]: cephadm 2021-03-10T14:06:13.144354+0000 mgr.gibba045.orlgmj (mgr.34412) 959 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:06:15.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:06:15 gibba015 bash[30343]: cephadm 2021-03-10T14:06:13.146166+0000 mgr.gibba045.orlgmj (mgr.34412) 960 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:06:15.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:06:15 gibba015 bash[30343]: cephadm 2021-03-10T14:06:13.359200+0000 mgr.gibba045.orlgmj (mgr.34412) 961 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:06:15.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:06:15 gibba015 bash[30343]: cephadm 2021-03-10T14:06:13.360897+0000 mgr.gibba045.orlgmj (mgr.34412) 962 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:06:15.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:06:15 gibba015 bash[30343]: cephadm 2021-03-10T14:06:13.361929+0000 mgr.gibba045.orlgmj (mgr.34412) 963 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:06:15.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:06:15 gibba015 bash[30343]: cephadm 2021-03-10T14:06:13.361967+0000 mgr.gibba045.orlgmj (mgr.34412) 964 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:06:15.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:06:15 gibba015 bash[30343]: cephadm 2021-03-10T14:06:13.363230+0000 mgr.gibba045.orlgmj (mgr.34412) 965 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:06:15.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:06:15 gibba015 bash[30343]: cephadm 2021-03-10T14:06:13.363269+0000 mgr.gibba045.orlgmj (mgr.34412) 966 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:06:15.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:06:15 gibba015 bash[30343]: cephadm 2021-03-10T14:06:13.364880+0000 mgr.gibba045.orlgmj (mgr.34412) 967 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:06:15.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:06:15 gibba015 bash[30343]: cephadm 2021-03-10T14:06:13.367005+0000 mgr.gibba045.orlgmj (mgr.34412) 968 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:06:15.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:06:15 gibba015 bash[30343]: cephadm 2021-03-10T14:06:13.367044+0000 mgr.gibba045.orlgmj (mgr.34412) 969 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:06:15.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:06:15 gibba015 bash[30343]: cephadm 2021-03-10T14:06:13.368461+0000 mgr.gibba045.orlgmj (mgr.34412) 970 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:06:15.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:06:15 gibba015 bash[30343]: cephadm 2021-03-10T14:06:13.368805+0000 mgr.gibba045.orlgmj (mgr.34412) 971 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:06:15.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:06:15 gibba015 bash[30343]: cephadm 2021-03-10T14:06:13.370482+0000 mgr.gibba045.orlgmj (mgr.34412) 972 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:06:15.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:06:15 gibba015 bash[30343]: cephadm 2021-03-10T14:06:13.370530+0000 mgr.gibba045.orlgmj (mgr.34412) 973 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:06:15.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:06:15 gibba015 bash[30343]: cephadm 2021-03-10T14:06:13.370668+0000 mgr.gibba045.orlgmj (mgr.34412) 974 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:06:15.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:06:15 gibba015 bash[30343]: cluster 2021-03-10T14:06:13.651230+0000 mgr.gibba045.orlgmj (mgr.34412) 975 : cluster [DBG] pgmap v535: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:17.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:06:17 gibba045 bash[25517]: cluster 2021-03-10T14:06:15.652844+0000 mgr.gibba045.orlgmj (mgr.34412) 976 : cluster [DBG] pgmap v536: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:17.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:06:17 gibba015 bash[29377]: cluster 2021-03-10T14:06:15.652844+0000 mgr.gibba045.orlgmj (mgr.34412) 976 : cluster [DBG] pgmap v536: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:17.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:06:17 gibba015 bash[30343]: cluster 2021-03-10T14:06:15.652844+0000 mgr.gibba045.orlgmj (mgr.34412) 976 : cluster [DBG] pgmap v536: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:19.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:06:19 gibba045 bash[25517]: cluster 2021-03-10T14:06:17.654638+0000 mgr.gibba045.orlgmj (mgr.34412) 977 : cluster [DBG] pgmap v537: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:19.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:06:19 gibba015 bash[30343]: cluster 2021-03-10T14:06:17.654638+0000 mgr.gibba045.orlgmj (mgr.34412) 977 : cluster [DBG] pgmap v537: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:19.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:06:19 gibba015 bash[29377]: cluster 2021-03-10T14:06:17.654638+0000 mgr.gibba045.orlgmj (mgr.34412) 977 : cluster [DBG] pgmap v537: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:21.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:06:21 gibba045 bash[25517]: cluster 2021-03-10T14:06:19.655517+0000 mgr.gibba045.orlgmj (mgr.34412) 978 : cluster [DBG] pgmap v538: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:21.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:06:21 gibba015 bash[29377]: cluster 2021-03-10T14:06:19.655517+0000 mgr.gibba045.orlgmj (mgr.34412) 978 : cluster [DBG] pgmap v538: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:21.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:06:21 gibba015 bash[30343]: cluster 2021-03-10T14:06:19.655517+0000 mgr.gibba045.orlgmj (mgr.34412) 978 : cluster [DBG] pgmap v538: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:23.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:06:23 gibba045 bash[25517]: cluster 2021-03-10T14:06:21.657343+0000 mgr.gibba045.orlgmj (mgr.34412) 979 : cluster [DBG] pgmap v539: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:23.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:06:23 gibba015 bash[29377]: cluster 2021-03-10T14:06:21.657343+0000 mgr.gibba045.orlgmj (mgr.34412) 979 : cluster [DBG] pgmap v539: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:23.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:06:23 gibba015 bash[30343]: cluster 2021-03-10T14:06:21.657343+0000 mgr.gibba045.orlgmj (mgr.34412) 979 : cluster [DBG] pgmap v539: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:25.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:06:25 gibba045 bash[25517]: cluster 2021-03-10T14:06:23.658574+0000 mgr.gibba045.orlgmj (mgr.34412) 980 : cluster [DBG] pgmap v540: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:25.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:06:25 gibba015 bash[29377]: cluster 2021-03-10T14:06:23.658574+0000 mgr.gibba045.orlgmj (mgr.34412) 980 : cluster [DBG] pgmap v540: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:25.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:06:25 gibba015 bash[30343]: cluster 2021-03-10T14:06:23.658574+0000 mgr.gibba045.orlgmj (mgr.34412) 980 : cluster [DBG] pgmap v540: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:27.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:06:27 gibba045 bash[25517]: cluster 2021-03-10T14:06:25.659838+0000 mgr.gibba045.orlgmj (mgr.34412) 981 : cluster [DBG] pgmap v541: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:27.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:06:27 gibba015 bash[29377]: cluster 2021-03-10T14:06:25.659838+0000 mgr.gibba045.orlgmj (mgr.34412) 981 : cluster [DBG] pgmap v541: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:27.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:06:27 gibba015 bash[30343]: cluster 2021-03-10T14:06:25.659838+0000 mgr.gibba045.orlgmj (mgr.34412) 981 : cluster [DBG] pgmap v541: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:29.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:06:29 gibba015 bash[29377]: cluster 2021-03-10T14:06:27.661345+0000 mgr.gibba045.orlgmj (mgr.34412) 982 : cluster [DBG] pgmap v542: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:29.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:06:29 gibba015 bash[30343]: cluster 2021-03-10T14:06:27.661345+0000 mgr.gibba045.orlgmj (mgr.34412) 982 : cluster [DBG] pgmap v542: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:29.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:06:29 gibba045 bash[25517]: cluster 2021-03-10T14:06:27.661345+0000 mgr.gibba045.orlgmj (mgr.34412) 982 : cluster [DBG] pgmap v542: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:30.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:06:30 gibba015 bash[29377]: cephadm 2021-03-10T14:06:28.373357+0000 mgr.gibba045.orlgmj (mgr.34412) 983 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:06:30.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:06:30 gibba015 bash[30343]: cephadm 2021-03-10T14:06:28.373357+0000 mgr.gibba045.orlgmj (mgr.34412) 983 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:06:30.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:06:30 gibba045 bash[25517]: cephadm 2021-03-10T14:06:28.373357+0000 mgr.gibba045.orlgmj (mgr.34412) 983 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:06:31.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:06:31 gibba015 bash[29377]: cluster 2021-03-10T14:06:29.662087+0000 mgr.gibba045.orlgmj (mgr.34412) 984 : cluster [DBG] pgmap v543: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:31.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:06:31 gibba015 bash[30343]: cluster 2021-03-10T14:06:29.662087+0000 mgr.gibba045.orlgmj (mgr.34412) 984 : cluster [DBG] pgmap v543: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:31.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:06:31 gibba045 bash[25517]: cluster 2021-03-10T14:06:29.662087+0000 mgr.gibba045.orlgmj (mgr.34412) 984 : cluster [DBG] pgmap v543: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:32.543 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:06:32.770 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:06:32.770 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (17m) 3m ago 22m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:06:32.770 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (22m) 2m ago 22m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:06:32.771 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (17m) 2m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:06:32.771 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (17m) 2m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:06:32.771 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (16m) 3m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:06:32.771 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (16m) 3m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:06:32.772 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (16m) 2m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:06:32.772 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (16m) 3m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:06:32.772 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (22m) 3m ago 22m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:06:32.772 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (22m) 2m ago 22m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:06:32.773 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (15m) 3m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:06:32.773 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (15m) 3m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:06:32.773 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (14m) 3m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:06:32.773 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (14m) 3m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:06:32.773 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (13m) 2m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:06:32.774 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (13m) 2m ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:06:32.774 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (13m) 2m ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:06:32.774 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (12m) 2m ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:06:32.774 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (22m) 2m ago 22m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:06:32.775 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 2m ago 20m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:06:33.017 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:06:33.018 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:06:33.018 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:06:33.018 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:06:33.018 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:06:33.019 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:06:33.019 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:06:33.019 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:06:33.019 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:06:33.020 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:06:33.020 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:06:33.020 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:06:33.020 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:06:33.020 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:06:33.021 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:06:33.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:06:33 gibba015 bash[29377]: cluster 2021-03-10T14:06:31.663715+0000 mgr.gibba045.orlgmj (mgr.34412) 985 : cluster [DBG] pgmap v544: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:33.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:06:33 gibba015 bash[29377]: audit 2021-03-10T14:06:33.015054+0000 mon.a (mon.0) 679 : audit [DBG] from='client.? 172.21.2.115:0/3776363349' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:06:33.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:06:33 gibba015 bash[30343]: cluster 2021-03-10T14:06:31.663715+0000 mgr.gibba045.orlgmj (mgr.34412) 985 : cluster [DBG] pgmap v544: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:33.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:06:33 gibba015 bash[30343]: audit 2021-03-10T14:06:33.015054+0000 mon.a (mon.0) 679 : audit [DBG] from='client.? 172.21.2.115:0/3776363349' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:06:33.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:06:33 gibba045 bash[25517]: cluster 2021-03-10T14:06:31.663715+0000 mgr.gibba045.orlgmj (mgr.34412) 985 : cluster [DBG] pgmap v544: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:33.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:06:33 gibba045 bash[25517]: audit 2021-03-10T14:06:33.015054+0000 mon.a (mon.0) 679 : audit [DBG] from='client.? 172.21.2.115:0/3776363349' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:06:34.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:06:34 gibba015 bash[29377]: audit 2021-03-10T14:06:32.534252+0000 mgr.gibba045.orlgmj (mgr.34412) 986 : audit [DBG] from='client.54706 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:06:34.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:06:34 gibba015 bash[29377]: audit 2021-03-10T14:06:32.757818+0000 mgr.gibba045.orlgmj (mgr.34412) 987 : audit [DBG] from='client.44724 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:06:34.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:06:34 gibba015 bash[30343]: audit 2021-03-10T14:06:32.534252+0000 mgr.gibba045.orlgmj (mgr.34412) 986 : audit [DBG] from='client.54706 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:06:34.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:06:34 gibba015 bash[30343]: audit 2021-03-10T14:06:32.757818+0000 mgr.gibba045.orlgmj (mgr.34412) 987 : audit [DBG] from='client.44724 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:06:34.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:06:34 gibba045 bash[25517]: audit 2021-03-10T14:06:32.534252+0000 mgr.gibba045.orlgmj (mgr.34412) 986 : audit [DBG] from='client.54706 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:06:34.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:06:34 gibba045 bash[25517]: audit 2021-03-10T14:06:32.757818+0000 mgr.gibba045.orlgmj (mgr.34412) 987 : audit [DBG] from='client.44724 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:06:35.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:06:35 gibba015 bash[29377]: cluster 2021-03-10T14:06:33.664962+0000 mgr.gibba045.orlgmj (mgr.34412) 988 : cluster [DBG] pgmap v545: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:35.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:06:35 gibba015 bash[30343]: cluster 2021-03-10T14:06:33.664962+0000 mgr.gibba045.orlgmj (mgr.34412) 988 : cluster [DBG] pgmap v545: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:35.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:06:35 gibba045 bash[25517]: cluster 2021-03-10T14:06:33.664962+0000 mgr.gibba045.orlgmj (mgr.34412) 988 : cluster [DBG] pgmap v545: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:37.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:06:37 gibba015 bash[29377]: cluster 2021-03-10T14:06:35.666432+0000 mgr.gibba045.orlgmj (mgr.34412) 989 : cluster [DBG] pgmap v546: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:37.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:06:37 gibba015 bash[30343]: cluster 2021-03-10T14:06:35.666432+0000 mgr.gibba045.orlgmj (mgr.34412) 989 : cluster [DBG] pgmap v546: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:37.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:06:37 gibba045 bash[25517]: cluster 2021-03-10T14:06:35.666432+0000 mgr.gibba045.orlgmj (mgr.34412) 989 : cluster [DBG] pgmap v546: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:39.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:06:39 gibba015 bash[29377]: cluster 2021-03-10T14:06:37.668072+0000 mgr.gibba045.orlgmj (mgr.34412) 990 : cluster [DBG] pgmap v547: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:39.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:06:39 gibba015 bash[30343]: cluster 2021-03-10T14:06:37.668072+0000 mgr.gibba045.orlgmj (mgr.34412) 990 : cluster [DBG] pgmap v547: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:39.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:06:39 gibba045 bash[25517]: cluster 2021-03-10T14:06:37.668072+0000 mgr.gibba045.orlgmj (mgr.34412) 990 : cluster [DBG] pgmap v547: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:41.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:06:41 gibba015 bash[29377]: cluster 2021-03-10T14:06:39.668948+0000 mgr.gibba045.orlgmj (mgr.34412) 991 : cluster [DBG] pgmap v548: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:41.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:06:41 gibba015 bash[30343]: cluster 2021-03-10T14:06:39.668948+0000 mgr.gibba045.orlgmj (mgr.34412) 991 : cluster [DBG] pgmap v548: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:41.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:06:41 gibba045 bash[25517]: cluster 2021-03-10T14:06:39.668948+0000 mgr.gibba045.orlgmj (mgr.34412) 991 : cluster [DBG] pgmap v548: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:43.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:06:43 gibba015 bash[29377]: cluster 2021-03-10T14:06:41.670299+0000 mgr.gibba045.orlgmj (mgr.34412) 992 : cluster [DBG] pgmap v549: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:43.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:06:43 gibba015 bash[30343]: cluster 2021-03-10T14:06:41.670299+0000 mgr.gibba045.orlgmj (mgr.34412) 992 : cluster [DBG] pgmap v549: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:43.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:06:43 gibba045 bash[25517]: cluster 2021-03-10T14:06:41.670299+0000 mgr.gibba045.orlgmj (mgr.34412) 992 : cluster [DBG] pgmap v549: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:45.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:06:45 gibba015 bash[29377]: cephadm 2021-03-10T14:06:43.378144+0000 mgr.gibba045.orlgmj (mgr.34412) 993 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:06:45.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:06:45 gibba015 bash[29377]: cluster 2021-03-10T14:06:43.671839+0000 mgr.gibba045.orlgmj (mgr.34412) 994 : cluster [DBG] pgmap v550: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:45.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:06:45 gibba015 bash[30343]: cephadm 2021-03-10T14:06:43.378144+0000 mgr.gibba045.orlgmj (mgr.34412) 993 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:06:45.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:06:45 gibba015 bash[30343]: cluster 2021-03-10T14:06:43.671839+0000 mgr.gibba045.orlgmj (mgr.34412) 994 : cluster [DBG] pgmap v550: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:45.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:06:45 gibba045 bash[25517]: cephadm 2021-03-10T14:06:43.378144+0000 mgr.gibba045.orlgmj (mgr.34412) 993 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:06:45.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:06:45 gibba045 bash[25517]: cluster 2021-03-10T14:06:43.671839+0000 mgr.gibba045.orlgmj (mgr.34412) 994 : cluster [DBG] pgmap v550: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:47.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:06:47 gibba015 bash[29377]: cluster 2021-03-10T14:06:45.673253+0000 mgr.gibba045.orlgmj (mgr.34412) 995 : cluster [DBG] pgmap v551: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:47.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:06:47 gibba015 bash[30343]: cluster 2021-03-10T14:06:45.673253+0000 mgr.gibba045.orlgmj (mgr.34412) 995 : cluster [DBG] pgmap v551: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:47.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:06:47 gibba045 bash[25517]: cluster 2021-03-10T14:06:45.673253+0000 mgr.gibba045.orlgmj (mgr.34412) 995 : cluster [DBG] pgmap v551: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:48.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:06:48 gibba015 bash[29377]: cluster 2021-03-10T14:06:47.674978+0000 mgr.gibba045.orlgmj (mgr.34412) 996 : cluster [DBG] pgmap v552: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:48.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:06:48 gibba015 bash[30343]: cluster 2021-03-10T14:06:47.674978+0000 mgr.gibba045.orlgmj (mgr.34412) 996 : cluster [DBG] pgmap v552: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:48.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:06:48 gibba045 bash[25517]: cluster 2021-03-10T14:06:47.674978+0000 mgr.gibba045.orlgmj (mgr.34412) 996 : cluster [DBG] pgmap v552: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:51.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:06:50 gibba045 bash[25517]: cluster 2021-03-10T14:06:49.675907+0000 mgr.gibba045.orlgmj (mgr.34412) 997 : cluster [DBG] pgmap v553: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:51.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:06:50 gibba015 bash[29377]: cluster 2021-03-10T14:06:49.675907+0000 mgr.gibba045.orlgmj (mgr.34412) 997 : cluster [DBG] pgmap v553: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:51.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:06:50 gibba015 bash[30343]: cluster 2021-03-10T14:06:49.675907+0000 mgr.gibba045.orlgmj (mgr.34412) 997 : cluster [DBG] pgmap v553: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:53.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:06:52 gibba015 bash[29377]: cluster 2021-03-10T14:06:51.677776+0000 mgr.gibba045.orlgmj (mgr.34412) 998 : cluster [DBG] pgmap v554: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:53.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:06:52 gibba015 bash[29377]: audit 2021-03-10T14:06:52.508087+0000 mon.c (mon.1) 339 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T14:06:53.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:06:52 gibba015 bash[29377]: audit 2021-03-10T14:06:52.508816+0000 mon.c (mon.1) 340 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:06:53.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:06:52 gibba015 bash[29377]: audit 2021-03-10T14:06:52.509374+0000 mon.a (mon.0) 680 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T14:06:53.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:06:52 gibba015 bash[29377]: audit 2021-03-10T14:06:52.509521+0000 mon.c (mon.1) 341 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T14:06:53.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:06:52 gibba015 bash[29377]: audit 2021-03-10T14:06:52.510182+0000 mon.c (mon.1) 342 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:06:53.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:06:52 gibba015 bash[29377]: audit 2021-03-10T14:06:52.511359+0000 mon.a (mon.0) 681 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:06:53.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:06:52 gibba015 bash[29377]: audit 2021-03-10T14:06:52.512480+0000 mon.a (mon.0) 682 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T14:06:53.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:06:52 gibba015 bash[29377]: audit 2021-03-10T14:06:52.513410+0000 mon.a (mon.0) 683 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:06:53.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:06:52 gibba015 bash[29377]: audit 2021-03-10T14:06:52.569806+0000 mon.c (mon.1) 343 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:06:53.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:06:52 gibba015 bash[29377]: audit 2021-03-10T14:06:52.570082+0000 mon.c (mon.1) 344 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:06:53.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:06:52 gibba015 bash[29377]: audit 2021-03-10T14:06:52.570415+0000 mon.a (mon.0) 684 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:06:53.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:06:52 gibba015 bash[29377]: audit 2021-03-10T14:06:52.570946+0000 mon.a (mon.0) 685 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:06:53.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:06:52 gibba015 bash[30343]: cluster 2021-03-10T14:06:51.677776+0000 mgr.gibba045.orlgmj (mgr.34412) 998 : cluster [DBG] pgmap v554: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:53.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:06:52 gibba015 bash[30343]: audit 2021-03-10T14:06:52.508087+0000 mon.c (mon.1) 339 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T14:06:53.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:06:52 gibba015 bash[30343]: audit 2021-03-10T14:06:52.508816+0000 mon.c (mon.1) 340 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:06:53.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:06:52 gibba015 bash[30343]: audit 2021-03-10T14:06:52.509374+0000 mon.a (mon.0) 680 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T14:06:53.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:06:52 gibba015 bash[30343]: audit 2021-03-10T14:06:52.509521+0000 mon.c (mon.1) 341 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T14:06:53.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:06:52 gibba015 bash[30343]: audit 2021-03-10T14:06:52.510182+0000 mon.c (mon.1) 342 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:06:53.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:06:52 gibba015 bash[30343]: audit 2021-03-10T14:06:52.511359+0000 mon.a (mon.0) 681 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:06:53.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:06:52 gibba015 bash[30343]: audit 2021-03-10T14:06:52.512480+0000 mon.a (mon.0) 682 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T14:06:53.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:06:52 gibba015 bash[30343]: audit 2021-03-10T14:06:52.513410+0000 mon.a (mon.0) 683 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:06:53.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:06:52 gibba015 bash[30343]: audit 2021-03-10T14:06:52.569806+0000 mon.c (mon.1) 343 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:06:53.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:06:52 gibba015 bash[30343]: audit 2021-03-10T14:06:52.570082+0000 mon.c (mon.1) 344 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:06:53.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:06:52 gibba015 bash[30343]: audit 2021-03-10T14:06:52.570415+0000 mon.a (mon.0) 684 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:06:53.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:06:52 gibba015 bash[30343]: audit 2021-03-10T14:06:52.570946+0000 mon.a (mon.0) 685 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:06:53.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:06:52 gibba045 bash[25517]: cluster 2021-03-10T14:06:51.677776+0000 mgr.gibba045.orlgmj (mgr.34412) 998 : cluster [DBG] pgmap v554: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:53.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:06:52 gibba045 bash[25517]: audit 2021-03-10T14:06:52.508087+0000 mon.c (mon.1) 339 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T14:06:53.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:06:52 gibba045 bash[25517]: audit 2021-03-10T14:06:52.508816+0000 mon.c (mon.1) 340 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:06:53.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:06:52 gibba045 bash[25517]: audit 2021-03-10T14:06:52.509374+0000 mon.a (mon.0) 680 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T14:06:53.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:06:52 gibba045 bash[25517]: audit 2021-03-10T14:06:52.509521+0000 mon.c (mon.1) 341 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T14:06:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:06:52 gibba045 bash[25517]: audit 2021-03-10T14:06:52.510182+0000 mon.c (mon.1) 342 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:06:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:06:52 gibba045 bash[25517]: audit 2021-03-10T14:06:52.511359+0000 mon.a (mon.0) 681 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:06:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:06:52 gibba045 bash[25517]: audit 2021-03-10T14:06:52.512480+0000 mon.a (mon.0) 682 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T14:06:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:06:52 gibba045 bash[25517]: audit 2021-03-10T14:06:52.513410+0000 mon.a (mon.0) 683 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:06:53.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:06:52 gibba045 bash[25517]: audit 2021-03-10T14:06:52.569806+0000 mon.c (mon.1) 343 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:06:53.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:06:52 gibba045 bash[25517]: audit 2021-03-10T14:06:52.570082+0000 mon.c (mon.1) 344 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:06:53.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:06:52 gibba045 bash[25517]: audit 2021-03-10T14:06:52.570415+0000 mon.a (mon.0) 684 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:06:53.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:06:52 gibba045 bash[25517]: audit 2021-03-10T14:06:52.570946+0000 mon.a (mon.0) 685 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:06:55.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:06:54 gibba015 bash[29377]: cluster 2021-03-10T14:06:53.679309+0000 mgr.gibba045.orlgmj (mgr.34412) 999 : cluster [DBG] pgmap v555: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:55.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:06:54 gibba015 bash[30343]: cluster 2021-03-10T14:06:53.679309+0000 mgr.gibba045.orlgmj (mgr.34412) 999 : cluster [DBG] pgmap v555: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:55.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:06:54 gibba045 bash[25517]: cluster 2021-03-10T14:06:53.679309+0000 mgr.gibba045.orlgmj (mgr.34412) 999 : cluster [DBG] pgmap v555: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:57.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:06:56 gibba015 bash[29377]: cluster 2021-03-10T14:06:55.680953+0000 mgr.gibba045.orlgmj (mgr.34412) 1000 : cluster [DBG] pgmap v556: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:57.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:06:56 gibba015 bash[30343]: cluster 2021-03-10T14:06:55.680953+0000 mgr.gibba045.orlgmj (mgr.34412) 1000 : cluster [DBG] pgmap v556: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:57.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:06:56 gibba045 bash[25517]: cluster 2021-03-10T14:06:55.680953+0000 mgr.gibba045.orlgmj (mgr.34412) 1000 : cluster [DBG] pgmap v556: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:59.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:06:58 gibba015 bash[29377]: cluster 2021-03-10T14:06:57.682565+0000 mgr.gibba045.orlgmj (mgr.34412) 1001 : cluster [DBG] pgmap v557: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:59.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:06:58 gibba015 bash[30343]: cluster 2021-03-10T14:06:57.682565+0000 mgr.gibba045.orlgmj (mgr.34412) 1001 : cluster [DBG] pgmap v557: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:59.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:06:58 gibba045 bash[25517]: cluster 2021-03-10T14:06:57.682565+0000 mgr.gibba045.orlgmj (mgr.34412) 1001 : cluster [DBG] pgmap v557: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:00.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:06:59 gibba015 bash[29377]: cephadm 2021-03-10T14:06:58.394043+0000 mgr.gibba045.orlgmj (mgr.34412) 1002 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:07:00.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:06:59 gibba015 bash[30343]: cephadm 2021-03-10T14:06:58.394043+0000 mgr.gibba045.orlgmj (mgr.34412) 1002 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:07:00.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:06:59 gibba045 bash[25517]: cephadm 2021-03-10T14:06:58.394043+0000 mgr.gibba045.orlgmj (mgr.34412) 1002 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:07:01.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:07:00 gibba015 bash[29377]: cluster 2021-03-10T14:06:59.683553+0000 mgr.gibba045.orlgmj (mgr.34412) 1003 : cluster [DBG] pgmap v558: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:01.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:07:00 gibba015 bash[30343]: cluster 2021-03-10T14:06:59.683553+0000 mgr.gibba045.orlgmj (mgr.34412) 1003 : cluster [DBG] pgmap v558: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:01.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:07:00 gibba045 bash[25517]: cluster 2021-03-10T14:06:59.683553+0000 mgr.gibba045.orlgmj (mgr.34412) 1003 : cluster [DBG] pgmap v558: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:03.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:07:02 gibba015 bash[29377]: cluster 2021-03-10T14:07:01.685383+0000 mgr.gibba045.orlgmj (mgr.34412) 1004 : cluster [DBG] pgmap v559: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:03.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:07:02 gibba015 bash[30343]: cluster 2021-03-10T14:07:01.685383+0000 mgr.gibba045.orlgmj (mgr.34412) 1004 : cluster [DBG] pgmap v559: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:03.262 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:07:03.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:07:02 gibba045 bash[25517]: cluster 2021-03-10T14:07:01.685383+0000 mgr.gibba045.orlgmj (mgr.34412) 1004 : cluster [DBG] pgmap v559: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:03.491 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:07:03.491 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (17m) 3m ago 23m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:07:03.492 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (22m) 2m ago 22m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:07:03.492 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (18m) 2m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:07:03.492 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (18m) 2m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:07:03.492 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (17m) 3m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:07:03.493 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (17m) 3m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:07:03.493 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (16m) 2m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:07:03.493 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (17m) 3m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:07:03.493 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (23m) 3m ago 23m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:07:03.493 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (23m) 2m ago 23m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:07:03.493 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (16m) 3m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:07:03.494 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (15m) 3m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:07:03.494 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (15m) 3m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:07:03.494 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (14m) 3m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:07:03.494 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (14m) 2m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:07:03.495 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (13m) 2m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:07:03.495 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (13m) 2m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:07:03.495 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (13m) 2m ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:07:03.495 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (22m) 2m ago 23m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:07:03.495 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 2m ago 21m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:07:03.742 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:07:03.742 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:07:03.743 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:07:03.743 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:07:03.743 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:07:03.743 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:07:03.743 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:07:03.744 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:07:03.744 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:07:03.744 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:07:03.744 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:07:03.744 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:07:03.745 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:07:03.745 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:07:03.745 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:07:04.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:07:03 gibba015 bash[29377]: audit 2021-03-10T14:07:03.740211+0000 mon.a (mon.0) 686 : audit [DBG] from='client.? 172.21.2.115:0/2220853428' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:07:04.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:07:03 gibba015 bash[30343]: audit 2021-03-10T14:07:03.740211+0000 mon.a (mon.0) 686 : audit [DBG] from='client.? 172.21.2.115:0/2220853428' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:07:04.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:07:03 gibba045 bash[25517]: audit 2021-03-10T14:07:03.740211+0000 mon.a (mon.0) 686 : audit [DBG] from='client.? 172.21.2.115:0/2220853428' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:07:05.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:07:04 gibba015 bash[29377]: audit 2021-03-10T14:07:03.254213+0000 mgr.gibba045.orlgmj (mgr.34412) 1005 : audit [DBG] from='client.44736 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:07:05.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:07:04 gibba015 bash[29377]: audit 2021-03-10T14:07:03.479557+0000 mgr.gibba045.orlgmj (mgr.34412) 1006 : audit [DBG] from='client.54730 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:07:05.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:07:04 gibba015 bash[29377]: cluster 2021-03-10T14:07:03.687008+0000 mgr.gibba045.orlgmj (mgr.34412) 1007 : cluster [DBG] pgmap v560: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:05.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:07:04 gibba015 bash[30343]: audit 2021-03-10T14:07:03.254213+0000 mgr.gibba045.orlgmj (mgr.34412) 1005 : audit [DBG] from='client.44736 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:07:05.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:07:04 gibba015 bash[30343]: audit 2021-03-10T14:07:03.479557+0000 mgr.gibba045.orlgmj (mgr.34412) 1006 : audit [DBG] from='client.54730 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:07:05.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:07:04 gibba015 bash[30343]: cluster 2021-03-10T14:07:03.687008+0000 mgr.gibba045.orlgmj (mgr.34412) 1007 : cluster [DBG] pgmap v560: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:05.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:07:04 gibba045 bash[25517]: audit 2021-03-10T14:07:03.254213+0000 mgr.gibba045.orlgmj (mgr.34412) 1005 : audit [DBG] from='client.44736 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:07:05.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:07:04 gibba045 bash[25517]: audit 2021-03-10T14:07:03.479557+0000 mgr.gibba045.orlgmj (mgr.34412) 1006 : audit [DBG] from='client.54730 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:07:05.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:07:04 gibba045 bash[25517]: cluster 2021-03-10T14:07:03.687008+0000 mgr.gibba045.orlgmj (mgr.34412) 1007 : cluster [DBG] pgmap v560: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:07.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:07:06 gibba015 bash[29377]: cluster 2021-03-10T14:07:05.688644+0000 mgr.gibba045.orlgmj (mgr.34412) 1008 : cluster [DBG] pgmap v561: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:07.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:07:06 gibba015 bash[30343]: cluster 2021-03-10T14:07:05.688644+0000 mgr.gibba045.orlgmj (mgr.34412) 1008 : cluster [DBG] pgmap v561: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:07.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:07:06 gibba045 bash[25517]: cluster 2021-03-10T14:07:05.688644+0000 mgr.gibba045.orlgmj (mgr.34412) 1008 : cluster [DBG] pgmap v561: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:09.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:07:08 gibba015 bash[29377]: cluster 2021-03-10T14:07:07.690483+0000 mgr.gibba045.orlgmj (mgr.34412) 1009 : cluster [DBG] pgmap v562: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:09.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:07:08 gibba015 bash[30343]: cluster 2021-03-10T14:07:07.690483+0000 mgr.gibba045.orlgmj (mgr.34412) 1009 : cluster [DBG] pgmap v562: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:09.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:07:08 gibba045 bash[25517]: cluster 2021-03-10T14:07:07.690483+0000 mgr.gibba045.orlgmj (mgr.34412) 1009 : cluster [DBG] pgmap v562: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:11.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:07:10 gibba015 bash[29377]: cluster 2021-03-10T14:07:09.691753+0000 mgr.gibba045.orlgmj (mgr.34412) 1010 : cluster [DBG] pgmap v563: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:11.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:07:10 gibba015 bash[30343]: cluster 2021-03-10T14:07:09.691753+0000 mgr.gibba045.orlgmj (mgr.34412) 1010 : cluster [DBG] pgmap v563: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:11.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:07:10 gibba045 bash[25517]: cluster 2021-03-10T14:07:09.691753+0000 mgr.gibba045.orlgmj (mgr.34412) 1010 : cluster [DBG] pgmap v563: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:13.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:07:12 gibba015 bash[29377]: cluster 2021-03-10T14:07:11.693336+0000 mgr.gibba045.orlgmj (mgr.34412) 1011 : cluster [DBG] pgmap v564: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:13.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:07:12 gibba015 bash[30343]: cluster 2021-03-10T14:07:11.693336+0000 mgr.gibba045.orlgmj (mgr.34412) 1011 : cluster [DBG] pgmap v564: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:13.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:07:12 gibba045 bash[25517]: cluster 2021-03-10T14:07:11.693336+0000 mgr.gibba045.orlgmj (mgr.34412) 1011 : cluster [DBG] pgmap v564: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:14.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:07:13 gibba015 bash[29377]: audit 2021-03-10T14:07:13.408295+0000 mon.c (mon.1) 345 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:07:14.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:07:13 gibba015 bash[29377]: audit 2021-03-10T14:07:13.636998+0000 mon.a (mon.0) 687 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:07:14.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:07:13 gibba015 bash[29377]: audit 2021-03-10T14:07:13.640940+0000 mon.c (mon.1) 346 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:07:14.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:07:13 gibba015 bash[29377]: audit 2021-03-10T14:07:13.642593+0000 mon.c (mon.1) 347 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:07:14.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:07:13 gibba015 bash[29377]: audit 2021-03-10T14:07:13.644144+0000 mon.c (mon.1) 348 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:07:14.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:07:13 gibba015 bash[29377]: audit 2021-03-10T14:07:13.645615+0000 mon.c (mon.1) 349 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:07:14.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:07:13 gibba015 bash[29377]: audit 2021-03-10T14:07:13.649078+0000 mon.c (mon.1) 350 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:07:14.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:07:13 gibba015 bash[29377]: audit 2021-03-10T14:07:13.650856+0000 mon.c (mon.1) 351 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:07:14.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:07:13 gibba015 bash[30343]: audit 2021-03-10T14:07:13.408295+0000 mon.c (mon.1) 345 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:07:14.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:07:13 gibba015 bash[30343]: audit 2021-03-10T14:07:13.636998+0000 mon.a (mon.0) 687 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:07:14.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:07:13 gibba015 bash[30343]: audit 2021-03-10T14:07:13.640940+0000 mon.c (mon.1) 346 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:07:14.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:07:13 gibba015 bash[30343]: audit 2021-03-10T14:07:13.642593+0000 mon.c (mon.1) 347 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:07:14.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:07:13 gibba015 bash[30343]: audit 2021-03-10T14:07:13.644144+0000 mon.c (mon.1) 348 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:07:14.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:07:13 gibba015 bash[30343]: audit 2021-03-10T14:07:13.645615+0000 mon.c (mon.1) 349 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:07:14.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:07:13 gibba015 bash[30343]: audit 2021-03-10T14:07:13.649078+0000 mon.c (mon.1) 350 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:07:14.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:07:13 gibba015 bash[30343]: audit 2021-03-10T14:07:13.650856+0000 mon.c (mon.1) 351 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:07:14.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:07:13 gibba045 bash[25517]: audit 2021-03-10T14:07:13.408295+0000 mon.c (mon.1) 345 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:07:14.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:07:13 gibba045 bash[25517]: audit 2021-03-10T14:07:13.636998+0000 mon.a (mon.0) 687 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:07:14.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:07:13 gibba045 bash[25517]: audit 2021-03-10T14:07:13.640940+0000 mon.c (mon.1) 346 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:07:14.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:07:13 gibba045 bash[25517]: audit 2021-03-10T14:07:13.642593+0000 mon.c (mon.1) 347 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:07:14.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:07:13 gibba045 bash[25517]: audit 2021-03-10T14:07:13.644144+0000 mon.c (mon.1) 348 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:07:14.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:07:13 gibba045 bash[25517]: audit 2021-03-10T14:07:13.645615+0000 mon.c (mon.1) 349 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:07:14.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:07:13 gibba045 bash[25517]: audit 2021-03-10T14:07:13.649078+0000 mon.c (mon.1) 350 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:07:14.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:07:13 gibba045 bash[25517]: audit 2021-03-10T14:07:13.650856+0000 mon.c (mon.1) 351 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:07:15.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:07:14 gibba015 bash[29377]: cephadm 2021-03-10T14:07:13.416154+0000 mgr.gibba045.orlgmj (mgr.34412) 1012 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:07:15.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:07:14 gibba015 bash[29377]: cephadm 2021-03-10T14:07:13.417874+0000 mgr.gibba045.orlgmj (mgr.34412) 1013 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:07:15.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:07:14 gibba015 bash[29377]: cephadm 2021-03-10T14:07:13.642427+0000 mgr.gibba045.orlgmj (mgr.34412) 1014 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:07:15.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:07:14 gibba015 bash[29377]: cephadm 2021-03-10T14:07:13.644379+0000 mgr.gibba045.orlgmj (mgr.34412) 1015 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:07:15.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:07:14 gibba015 bash[29377]: cephadm 2021-03-10T14:07:13.645967+0000 mgr.gibba045.orlgmj (mgr.34412) 1016 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:07:15.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:07:14 gibba015 bash[29377]: cephadm 2021-03-10T14:07:13.646005+0000 mgr.gibba045.orlgmj (mgr.34412) 1017 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:07:15.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:07:14 gibba015 bash[29377]: cephadm 2021-03-10T14:07:13.647468+0000 mgr.gibba045.orlgmj (mgr.34412) 1018 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:07:15.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:07:14 gibba015 bash[29377]: cephadm 2021-03-10T14:07:13.647505+0000 mgr.gibba045.orlgmj (mgr.34412) 1019 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:07:15.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:07:14 gibba015 bash[29377]: cephadm 2021-03-10T14:07:13.648985+0000 mgr.gibba045.orlgmj (mgr.34412) 1020 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:07:15.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:07:14 gibba015 bash[29377]: cephadm 2021-03-10T14:07:13.650815+0000 mgr.gibba045.orlgmj (mgr.34412) 1021 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:07:15.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:07:14 gibba015 bash[29377]: cephadm 2021-03-10T14:07:13.650851+0000 mgr.gibba045.orlgmj (mgr.34412) 1022 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:07:15.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:07:14 gibba015 bash[29377]: cephadm 2021-03-10T14:07:13.652368+0000 mgr.gibba045.orlgmj (mgr.34412) 1023 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:07:15.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:07:14 gibba015 bash[29377]: cephadm 2021-03-10T14:07:13.652760+0000 mgr.gibba045.orlgmj (mgr.34412) 1024 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:07:15.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:07:14 gibba015 bash[29377]: cephadm 2021-03-10T14:07:13.654204+0000 mgr.gibba045.orlgmj (mgr.34412) 1025 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:07:15.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:07:14 gibba015 bash[29377]: cephadm 2021-03-10T14:07:13.654240+0000 mgr.gibba045.orlgmj (mgr.34412) 1026 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:07:15.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:07:14 gibba015 bash[29377]: cephadm 2021-03-10T14:07:13.654342+0000 mgr.gibba045.orlgmj (mgr.34412) 1027 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:07:15.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:07:14 gibba015 bash[29377]: cluster 2021-03-10T14:07:13.694708+0000 mgr.gibba045.orlgmj (mgr.34412) 1028 : cluster [DBG] pgmap v565: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:15.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:07:14 gibba015 bash[30343]: cephadm 2021-03-10T14:07:13.416154+0000 mgr.gibba045.orlgmj (mgr.34412) 1012 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:07:15.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:07:14 gibba015 bash[30343]: cephadm 2021-03-10T14:07:13.417874+0000 mgr.gibba045.orlgmj (mgr.34412) 1013 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:07:15.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:07:14 gibba015 bash[30343]: cephadm 2021-03-10T14:07:13.642427+0000 mgr.gibba045.orlgmj (mgr.34412) 1014 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:07:15.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:07:14 gibba015 bash[30343]: cephadm 2021-03-10T14:07:13.644379+0000 mgr.gibba045.orlgmj (mgr.34412) 1015 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:07:15.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:07:14 gibba015 bash[30343]: cephadm 2021-03-10T14:07:13.645967+0000 mgr.gibba045.orlgmj (mgr.34412) 1016 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:07:15.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:07:14 gibba015 bash[30343]: cephadm 2021-03-10T14:07:13.646005+0000 mgr.gibba045.orlgmj (mgr.34412) 1017 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:07:15.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:07:14 gibba015 bash[30343]: cephadm 2021-03-10T14:07:13.647468+0000 mgr.gibba045.orlgmj (mgr.34412) 1018 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:07:15.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:07:14 gibba015 bash[30343]: cephadm 2021-03-10T14:07:13.647505+0000 mgr.gibba045.orlgmj (mgr.34412) 1019 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:07:15.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:07:14 gibba015 bash[30343]: cephadm 2021-03-10T14:07:13.648985+0000 mgr.gibba045.orlgmj (mgr.34412) 1020 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:07:15.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:07:14 gibba015 bash[30343]: cephadm 2021-03-10T14:07:13.650815+0000 mgr.gibba045.orlgmj (mgr.34412) 1021 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:07:15.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:07:14 gibba015 bash[30343]: cephadm 2021-03-10T14:07:13.650851+0000 mgr.gibba045.orlgmj (mgr.34412) 1022 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:07:15.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:07:14 gibba015 bash[30343]: cephadm 2021-03-10T14:07:13.652368+0000 mgr.gibba045.orlgmj (mgr.34412) 1023 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:07:15.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:07:14 gibba015 bash[30343]: cephadm 2021-03-10T14:07:13.652760+0000 mgr.gibba045.orlgmj (mgr.34412) 1024 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:07:15.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:07:14 gibba015 bash[30343]: cephadm 2021-03-10T14:07:13.654204+0000 mgr.gibba045.orlgmj (mgr.34412) 1025 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:07:15.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:07:14 gibba015 bash[30343]: cephadm 2021-03-10T14:07:13.654240+0000 mgr.gibba045.orlgmj (mgr.34412) 1026 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:07:15.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:07:14 gibba015 bash[30343]: cephadm 2021-03-10T14:07:13.654342+0000 mgr.gibba045.orlgmj (mgr.34412) 1027 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:07:15.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:07:14 gibba015 bash[30343]: cluster 2021-03-10T14:07:13.694708+0000 mgr.gibba045.orlgmj (mgr.34412) 1028 : cluster [DBG] pgmap v565: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:15.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:07:14 gibba045 bash[25517]: cephadm 2021-03-10T14:07:13.416154+0000 mgr.gibba045.orlgmj (mgr.34412) 1012 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:07:15.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:07:14 gibba045 bash[25517]: cephadm 2021-03-10T14:07:13.417874+0000 mgr.gibba045.orlgmj (mgr.34412) 1013 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:07:15.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:07:14 gibba045 bash[25517]: cephadm 2021-03-10T14:07:13.642427+0000 mgr.gibba045.orlgmj (mgr.34412) 1014 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:07:15.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:07:14 gibba045 bash[25517]: cephadm 2021-03-10T14:07:13.644379+0000 mgr.gibba045.orlgmj (mgr.34412) 1015 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:07:15.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:07:14 gibba045 bash[25517]: cephadm 2021-03-10T14:07:13.645967+0000 mgr.gibba045.orlgmj (mgr.34412) 1016 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:07:15.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:07:14 gibba045 bash[25517]: cephadm 2021-03-10T14:07:13.646005+0000 mgr.gibba045.orlgmj (mgr.34412) 1017 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:07:15.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:07:14 gibba045 bash[25517]: cephadm 2021-03-10T14:07:13.647468+0000 mgr.gibba045.orlgmj (mgr.34412) 1018 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:07:15.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:07:14 gibba045 bash[25517]: cephadm 2021-03-10T14:07:13.647505+0000 mgr.gibba045.orlgmj (mgr.34412) 1019 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:07:15.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:07:14 gibba045 bash[25517]: cephadm 2021-03-10T14:07:13.648985+0000 mgr.gibba045.orlgmj (mgr.34412) 1020 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:07:15.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:07:14 gibba045 bash[25517]: cephadm 2021-03-10T14:07:13.650815+0000 mgr.gibba045.orlgmj (mgr.34412) 1021 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:07:15.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:07:14 gibba045 bash[25517]: cephadm 2021-03-10T14:07:13.650851+0000 mgr.gibba045.orlgmj (mgr.34412) 1022 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:07:15.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:07:14 gibba045 bash[25517]: cephadm 2021-03-10T14:07:13.652368+0000 mgr.gibba045.orlgmj (mgr.34412) 1023 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:07:15.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:07:14 gibba045 bash[25517]: cephadm 2021-03-10T14:07:13.652760+0000 mgr.gibba045.orlgmj (mgr.34412) 1024 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:07:15.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:07:14 gibba045 bash[25517]: cephadm 2021-03-10T14:07:13.654204+0000 mgr.gibba045.orlgmj (mgr.34412) 1025 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:07:15.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:07:14 gibba045 bash[25517]: cephadm 2021-03-10T14:07:13.654240+0000 mgr.gibba045.orlgmj (mgr.34412) 1026 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:07:15.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:07:14 gibba045 bash[25517]: cephadm 2021-03-10T14:07:13.654342+0000 mgr.gibba045.orlgmj (mgr.34412) 1027 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:07:15.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:07:14 gibba045 bash[25517]: cluster 2021-03-10T14:07:13.694708+0000 mgr.gibba045.orlgmj (mgr.34412) 1028 : cluster [DBG] pgmap v565: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:17.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:07:16 gibba015 bash[29377]: cluster 2021-03-10T14:07:15.696191+0000 mgr.gibba045.orlgmj (mgr.34412) 1029 : cluster [DBG] pgmap v566: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:17.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:07:16 gibba015 bash[30343]: cluster 2021-03-10T14:07:15.696191+0000 mgr.gibba045.orlgmj (mgr.34412) 1029 : cluster [DBG] pgmap v566: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:17.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:07:16 gibba045 bash[25517]: cluster 2021-03-10T14:07:15.696191+0000 mgr.gibba045.orlgmj (mgr.34412) 1029 : cluster [DBG] pgmap v566: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:19.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:07:18 gibba015 bash[29377]: cluster 2021-03-10T14:07:17.697925+0000 mgr.gibba045.orlgmj (mgr.34412) 1030 : cluster [DBG] pgmap v567: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:19.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:07:18 gibba015 bash[30343]: cluster 2021-03-10T14:07:17.697925+0000 mgr.gibba045.orlgmj (mgr.34412) 1030 : cluster [DBG] pgmap v567: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:19.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:07:18 gibba045 bash[25517]: cluster 2021-03-10T14:07:17.697925+0000 mgr.gibba045.orlgmj (mgr.34412) 1030 : cluster [DBG] pgmap v567: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:21.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:07:20 gibba015 bash[29377]: cluster 2021-03-10T14:07:19.698869+0000 mgr.gibba045.orlgmj (mgr.34412) 1031 : cluster [DBG] pgmap v568: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:21.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:07:20 gibba015 bash[30343]: cluster 2021-03-10T14:07:19.698869+0000 mgr.gibba045.orlgmj (mgr.34412) 1031 : cluster [DBG] pgmap v568: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:21.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:07:20 gibba045 bash[25517]: cluster 2021-03-10T14:07:19.698869+0000 mgr.gibba045.orlgmj (mgr.34412) 1031 : cluster [DBG] pgmap v568: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:23.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:07:22 gibba015 bash[29377]: cluster 2021-03-10T14:07:21.700723+0000 mgr.gibba045.orlgmj (mgr.34412) 1032 : cluster [DBG] pgmap v569: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:23.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:07:22 gibba015 bash[30343]: cluster 2021-03-10T14:07:21.700723+0000 mgr.gibba045.orlgmj (mgr.34412) 1032 : cluster [DBG] pgmap v569: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:23.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:07:22 gibba045 bash[25517]: cluster 2021-03-10T14:07:21.700723+0000 mgr.gibba045.orlgmj (mgr.34412) 1032 : cluster [DBG] pgmap v569: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:25.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:07:24 gibba045 bash[25517]: cluster 2021-03-10T14:07:23.702213+0000 mgr.gibba045.orlgmj (mgr.34412) 1033 : cluster [DBG] pgmap v570: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:25.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:07:24 gibba015 bash[29377]: cluster 2021-03-10T14:07:23.702213+0000 mgr.gibba045.orlgmj (mgr.34412) 1033 : cluster [DBG] pgmap v570: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:25.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:07:24 gibba015 bash[30343]: cluster 2021-03-10T14:07:23.702213+0000 mgr.gibba045.orlgmj (mgr.34412) 1033 : cluster [DBG] pgmap v570: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:27.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:07:26 gibba045 bash[25517]: cluster 2021-03-10T14:07:25.703878+0000 mgr.gibba045.orlgmj (mgr.34412) 1034 : cluster [DBG] pgmap v571: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:27.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:07:26 gibba015 bash[29377]: cluster 2021-03-10T14:07:25.703878+0000 mgr.gibba045.orlgmj (mgr.34412) 1034 : cluster [DBG] pgmap v571: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:27.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:07:26 gibba015 bash[30343]: cluster 2021-03-10T14:07:25.703878+0000 mgr.gibba045.orlgmj (mgr.34412) 1034 : cluster [DBG] pgmap v571: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:29.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:07:28 gibba045 bash[25517]: cluster 2021-03-10T14:07:27.705599+0000 mgr.gibba045.orlgmj (mgr.34412) 1035 : cluster [DBG] pgmap v572: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:29.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:07:28 gibba015 bash[29377]: cluster 2021-03-10T14:07:27.705599+0000 mgr.gibba045.orlgmj (mgr.34412) 1035 : cluster [DBG] pgmap v572: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:29.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:07:28 gibba015 bash[30343]: cluster 2021-03-10T14:07:27.705599+0000 mgr.gibba045.orlgmj (mgr.34412) 1035 : cluster [DBG] pgmap v572: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:30.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:07:30 gibba045 bash[25517]: cephadm 2021-03-10T14:07:28.670422+0000 mgr.gibba045.orlgmj (mgr.34412) 1036 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:07:30.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:07:30 gibba015 bash[29377]: cephadm 2021-03-10T14:07:28.670422+0000 mgr.gibba045.orlgmj (mgr.34412) 1036 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:07:30.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:07:30 gibba015 bash[30343]: cephadm 2021-03-10T14:07:28.670422+0000 mgr.gibba045.orlgmj (mgr.34412) 1036 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:07:31.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:07:31 gibba045 bash[25517]: cluster 2021-03-10T14:07:29.706739+0000 mgr.gibba045.orlgmj (mgr.34412) 1037 : cluster [DBG] pgmap v573: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:31.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:07:31 gibba015 bash[29377]: cluster 2021-03-10T14:07:29.706739+0000 mgr.gibba045.orlgmj (mgr.34412) 1037 : cluster [DBG] pgmap v573: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:31.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:07:31 gibba015 bash[30343]: cluster 2021-03-10T14:07:29.706739+0000 mgr.gibba045.orlgmj (mgr.34412) 1037 : cluster [DBG] pgmap v573: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:33.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:07:33 gibba045 bash[25517]: cluster 2021-03-10T14:07:31.708412+0000 mgr.gibba045.orlgmj (mgr.34412) 1038 : cluster [DBG] pgmap v574: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:33.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:07:33 gibba015 bash[29377]: cluster 2021-03-10T14:07:31.708412+0000 mgr.gibba045.orlgmj (mgr.34412) 1038 : cluster [DBG] pgmap v574: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:33.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:07:33 gibba015 bash[30343]: cluster 2021-03-10T14:07:31.708412+0000 mgr.gibba045.orlgmj (mgr.34412) 1038 : cluster [DBG] pgmap v574: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:33.986 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:07:34.217 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:07:34.217 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (18m) 4m ago 23m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:07:34.218 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (23m) 3m ago 23m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:07:34.218 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (18m) 3m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:07:34.218 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (19m) 3m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:07:34.218 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (17m) 4m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:07:34.219 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (17m) 4m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:07:34.219 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (17m) 3m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:07:34.219 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (17m) 4m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:07:34.219 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (23m) 4m ago 23m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:07:34.220 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (23m) 3m ago 23m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:07:34.220 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (16m) 4m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:07:34.220 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (16m) 4m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:07:34.220 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (15m) 4m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:07:34.220 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (15m) 4m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:07:34.221 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (14m) 3m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:07:34.221 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (14m) 3m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:07:34.221 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (14m) 3m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:07:34.221 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (13m) 3m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:07:34.221 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (23m) 3m ago 23m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:07:34.222 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 3m ago 21m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:07:34.464 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:07:34.465 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:07:34.465 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:07:34.465 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:07:34.465 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:07:34.465 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:07:34.466 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:07:34.466 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:07:34.466 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:07:34.466 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:07:34.467 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:07:34.467 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:07:34.467 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:07:34.467 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:07:34.467 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:07:35.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:07:35 gibba045 bash[25517]: cluster 2021-03-10T14:07:33.709619+0000 mgr.gibba045.orlgmj (mgr.34412) 1039 : cluster [DBG] pgmap v575: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:35.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:07:35 gibba045 bash[25517]: audit 2021-03-10T14:07:33.976748+0000 mgr.gibba045.orlgmj (mgr.34412) 1040 : audit [DBG] from='client.64172 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:07:35.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:07:35 gibba045 bash[25517]: audit 2021-03-10T14:07:34.462387+0000 mon.c (mon.1) 352 : audit [DBG] from='client.? 172.21.2.115:0/3156908289' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:07:35.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:07:35 gibba015 bash[29377]: cluster 2021-03-10T14:07:33.709619+0000 mgr.gibba045.orlgmj (mgr.34412) 1039 : cluster [DBG] pgmap v575: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:35.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:07:35 gibba015 bash[29377]: audit 2021-03-10T14:07:33.976748+0000 mgr.gibba045.orlgmj (mgr.34412) 1040 : audit [DBG] from='client.64172 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:07:35.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:07:35 gibba015 bash[29377]: audit 2021-03-10T14:07:34.462387+0000 mon.c (mon.1) 352 : audit [DBG] from='client.? 172.21.2.115:0/3156908289' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:07:35.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:07:35 gibba015 bash[30343]: cluster 2021-03-10T14:07:33.709619+0000 mgr.gibba045.orlgmj (mgr.34412) 1039 : cluster [DBG] pgmap v575: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:35.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:07:35 gibba015 bash[30343]: audit 2021-03-10T14:07:33.976748+0000 mgr.gibba045.orlgmj (mgr.34412) 1040 : audit [DBG] from='client.64172 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:07:35.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:07:35 gibba015 bash[30343]: audit 2021-03-10T14:07:34.462387+0000 mon.c (mon.1) 352 : audit [DBG] from='client.? 172.21.2.115:0/3156908289' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:07:36.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:07:36 gibba045 bash[25517]: audit 2021-03-10T14:07:34.204499+0000 mgr.gibba045.orlgmj (mgr.34412) 1041 : audit [DBG] from='client.44760 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:07:36.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:07:36 gibba015 bash[29377]: audit 2021-03-10T14:07:34.204499+0000 mgr.gibba045.orlgmj (mgr.34412) 1041 : audit [DBG] from='client.44760 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:07:36.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:07:36 gibba015 bash[30343]: audit 2021-03-10T14:07:34.204499+0000 mgr.gibba045.orlgmj (mgr.34412) 1041 : audit [DBG] from='client.44760 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:07:37.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:07:37 gibba045 bash[25517]: cluster 2021-03-10T14:07:35.711207+0000 mgr.gibba045.orlgmj (mgr.34412) 1042 : cluster [DBG] pgmap v576: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:37.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:07:37 gibba015 bash[29377]: cluster 2021-03-10T14:07:35.711207+0000 mgr.gibba045.orlgmj (mgr.34412) 1042 : cluster [DBG] pgmap v576: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:37.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:07:37 gibba015 bash[30343]: cluster 2021-03-10T14:07:35.711207+0000 mgr.gibba045.orlgmj (mgr.34412) 1042 : cluster [DBG] pgmap v576: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:39.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:07:39 gibba045 bash[25517]: cluster 2021-03-10T14:07:37.712909+0000 mgr.gibba045.orlgmj (mgr.34412) 1043 : cluster [DBG] pgmap v577: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:39.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:07:39 gibba015 bash[29377]: cluster 2021-03-10T14:07:37.712909+0000 mgr.gibba045.orlgmj (mgr.34412) 1043 : cluster [DBG] pgmap v577: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:39.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:07:39 gibba015 bash[30343]: cluster 2021-03-10T14:07:37.712909+0000 mgr.gibba045.orlgmj (mgr.34412) 1043 : cluster [DBG] pgmap v577: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:41.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:07:41 gibba015 bash[29377]: cluster 2021-03-10T14:07:39.714078+0000 mgr.gibba045.orlgmj (mgr.34412) 1044 : cluster [DBG] pgmap v578: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:41.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:07:41 gibba015 bash[30343]: cluster 2021-03-10T14:07:39.714078+0000 mgr.gibba045.orlgmj (mgr.34412) 1044 : cluster [DBG] pgmap v578: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:41.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:07:41 gibba045 bash[25517]: cluster 2021-03-10T14:07:39.714078+0000 mgr.gibba045.orlgmj (mgr.34412) 1044 : cluster [DBG] pgmap v578: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:43.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:07:43 gibba015 bash[29377]: cluster 2021-03-10T14:07:41.715463+0000 mgr.gibba045.orlgmj (mgr.34412) 1045 : cluster [DBG] pgmap v579: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:43.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:07:43 gibba015 bash[30343]: cluster 2021-03-10T14:07:41.715463+0000 mgr.gibba045.orlgmj (mgr.34412) 1045 : cluster [DBG] pgmap v579: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:43.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:07:43 gibba045 bash[25517]: cluster 2021-03-10T14:07:41.715463+0000 mgr.gibba045.orlgmj (mgr.34412) 1045 : cluster [DBG] pgmap v579: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:45.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:07:45 gibba015 bash[29377]: cephadm 2021-03-10T14:07:43.686490+0000 mgr.gibba045.orlgmj (mgr.34412) 1046 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:07:45.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:07:45 gibba015 bash[29377]: cluster 2021-03-10T14:07:43.716852+0000 mgr.gibba045.orlgmj (mgr.34412) 1047 : cluster [DBG] pgmap v580: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:45.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:07:45 gibba015 bash[30343]: cephadm 2021-03-10T14:07:43.686490+0000 mgr.gibba045.orlgmj (mgr.34412) 1046 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:07:45.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:07:45 gibba015 bash[30343]: cluster 2021-03-10T14:07:43.716852+0000 mgr.gibba045.orlgmj (mgr.34412) 1047 : cluster [DBG] pgmap v580: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:45.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:07:45 gibba045 bash[25517]: cephadm 2021-03-10T14:07:43.686490+0000 mgr.gibba045.orlgmj (mgr.34412) 1046 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:07:45.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:07:45 gibba045 bash[25517]: cluster 2021-03-10T14:07:43.716852+0000 mgr.gibba045.orlgmj (mgr.34412) 1047 : cluster [DBG] pgmap v580: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:47.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:07:47 gibba015 bash[29377]: cluster 2021-03-10T14:07:45.718577+0000 mgr.gibba045.orlgmj (mgr.34412) 1048 : cluster [DBG] pgmap v581: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:47.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:07:47 gibba015 bash[30343]: cluster 2021-03-10T14:07:45.718577+0000 mgr.gibba045.orlgmj (mgr.34412) 1048 : cluster [DBG] pgmap v581: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:47.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:07:47 gibba045 bash[25517]: cluster 2021-03-10T14:07:45.718577+0000 mgr.gibba045.orlgmj (mgr.34412) 1048 : cluster [DBG] pgmap v581: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:49.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:07:49 gibba015 bash[29377]: cluster 2021-03-10T14:07:47.720127+0000 mgr.gibba045.orlgmj (mgr.34412) 1049 : cluster [DBG] pgmap v582: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:49.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:07:49 gibba015 bash[30343]: cluster 2021-03-10T14:07:47.720127+0000 mgr.gibba045.orlgmj (mgr.34412) 1049 : cluster [DBG] pgmap v582: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:49.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:07:49 gibba045 bash[25517]: cluster 2021-03-10T14:07:47.720127+0000 mgr.gibba045.orlgmj (mgr.34412) 1049 : cluster [DBG] pgmap v582: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:51.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:07:51 gibba015 bash[29377]: cluster 2021-03-10T14:07:49.721421+0000 mgr.gibba045.orlgmj (mgr.34412) 1050 : cluster [DBG] pgmap v583: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:51.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:07:51 gibba015 bash[30343]: cluster 2021-03-10T14:07:49.721421+0000 mgr.gibba045.orlgmj (mgr.34412) 1050 : cluster [DBG] pgmap v583: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:51.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:07:51 gibba045 bash[25517]: cluster 2021-03-10T14:07:49.721421+0000 mgr.gibba045.orlgmj (mgr.34412) 1050 : cluster [DBG] pgmap v583: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:53.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:07:53 gibba015 bash[29377]: cluster 2021-03-10T14:07:51.722840+0000 mgr.gibba045.orlgmj (mgr.34412) 1051 : cluster [DBG] pgmap v584: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:53.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:07:53 gibba015 bash[29377]: audit 2021-03-10T14:07:52.519182+0000 mon.c (mon.1) 353 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T14:07:53.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:07:53 gibba015 bash[29377]: audit 2021-03-10T14:07:52.519893+0000 mon.c (mon.1) 354 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:07:53.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:07:53 gibba015 bash[29377]: audit 2021-03-10T14:07:52.520398+0000 mon.a (mon.0) 688 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T14:07:53.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:07:53 gibba015 bash[29377]: audit 2021-03-10T14:07:52.520596+0000 mon.c (mon.1) 355 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:07:53.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:07:53 gibba015 bash[29377]: audit 2021-03-10T14:07:52.521253+0000 mon.c (mon.1) 356 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T14:07:53.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:07:53 gibba015 bash[29377]: audit 2021-03-10T14:07:52.521909+0000 mon.a (mon.0) 689 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:07:53.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:07:53 gibba015 bash[29377]: audit 2021-03-10T14:07:52.522929+0000 mon.a (mon.0) 690 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:07:53.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:07:53 gibba015 bash[29377]: audit 2021-03-10T14:07:52.523726+0000 mon.a (mon.0) 691 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T14:07:53.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:07:53 gibba015 bash[29377]: audit 2021-03-10T14:07:52.576308+0000 mon.c (mon.1) 357 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:07:53.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:07:53 gibba015 bash[29377]: audit 2021-03-10T14:07:52.576945+0000 mon.c (mon.1) 358 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:07:53.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:07:53 gibba015 bash[29377]: audit 2021-03-10T14:07:52.577396+0000 mon.a (mon.0) 692 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:07:53.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:07:53 gibba015 bash[29377]: audit 2021-03-10T14:07:52.578522+0000 mon.a (mon.0) 693 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:07:53.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:07:53 gibba015 bash[30343]: cluster 2021-03-10T14:07:51.722840+0000 mgr.gibba045.orlgmj (mgr.34412) 1051 : cluster [DBG] pgmap v584: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:53.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:07:53 gibba015 bash[30343]: audit 2021-03-10T14:07:52.519182+0000 mon.c (mon.1) 353 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T14:07:53.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:07:53 gibba015 bash[30343]: audit 2021-03-10T14:07:52.519893+0000 mon.c (mon.1) 354 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:07:53.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:07:53 gibba015 bash[30343]: audit 2021-03-10T14:07:52.520398+0000 mon.a (mon.0) 688 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T14:07:53.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:07:53 gibba015 bash[30343]: audit 2021-03-10T14:07:52.520596+0000 mon.c (mon.1) 355 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:07:53.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:07:53 gibba015 bash[30343]: audit 2021-03-10T14:07:52.521253+0000 mon.c (mon.1) 356 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T14:07:53.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:07:53 gibba015 bash[30343]: audit 2021-03-10T14:07:52.521909+0000 mon.a (mon.0) 689 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:07:53.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:07:53 gibba015 bash[30343]: audit 2021-03-10T14:07:52.522929+0000 mon.a (mon.0) 690 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:07:53.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:07:53 gibba015 bash[30343]: audit 2021-03-10T14:07:52.523726+0000 mon.a (mon.0) 691 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T14:07:53.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:07:53 gibba015 bash[30343]: audit 2021-03-10T14:07:52.576308+0000 mon.c (mon.1) 357 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:07:53.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:07:53 gibba015 bash[30343]: audit 2021-03-10T14:07:52.576945+0000 mon.c (mon.1) 358 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:07:53.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:07:53 gibba015 bash[30343]: audit 2021-03-10T14:07:52.577396+0000 mon.a (mon.0) 692 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:07:53.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:07:53 gibba015 bash[30343]: audit 2021-03-10T14:07:52.578522+0000 mon.a (mon.0) 693 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:07:53.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:07:53 gibba045 bash[25517]: cluster 2021-03-10T14:07:51.722840+0000 mgr.gibba045.orlgmj (mgr.34412) 1051 : cluster [DBG] pgmap v584: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:53.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:07:53 gibba045 bash[25517]: audit 2021-03-10T14:07:52.519182+0000 mon.c (mon.1) 353 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T14:07:53.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:07:53 gibba045 bash[25517]: audit 2021-03-10T14:07:52.519893+0000 mon.c (mon.1) 354 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:07:53.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:07:53 gibba045 bash[25517]: audit 2021-03-10T14:07:52.520398+0000 mon.a (mon.0) 688 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T14:07:53.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:07:53 gibba045 bash[25517]: audit 2021-03-10T14:07:52.520596+0000 mon.c (mon.1) 355 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:07:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:07:53 gibba045 bash[25517]: audit 2021-03-10T14:07:52.521253+0000 mon.c (mon.1) 356 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T14:07:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:07:53 gibba045 bash[25517]: audit 2021-03-10T14:07:52.521909+0000 mon.a (mon.0) 689 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:07:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:07:53 gibba045 bash[25517]: audit 2021-03-10T14:07:52.522929+0000 mon.a (mon.0) 690 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:07:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:07:53 gibba045 bash[25517]: audit 2021-03-10T14:07:52.523726+0000 mon.a (mon.0) 691 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T14:07:53.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:07:53 gibba045 bash[25517]: audit 2021-03-10T14:07:52.576308+0000 mon.c (mon.1) 357 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:07:53.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:07:53 gibba045 bash[25517]: audit 2021-03-10T14:07:52.576945+0000 mon.c (mon.1) 358 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:07:53.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:07:53 gibba045 bash[25517]: audit 2021-03-10T14:07:52.577396+0000 mon.a (mon.0) 692 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:07:53.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:07:53 gibba045 bash[25517]: audit 2021-03-10T14:07:52.578522+0000 mon.a (mon.0) 693 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:07:55.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:07:55 gibba015 bash[29377]: cluster 2021-03-10T14:07:53.724216+0000 mgr.gibba045.orlgmj (mgr.34412) 1052 : cluster [DBG] pgmap v585: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:55.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:07:55 gibba015 bash[30343]: cluster 2021-03-10T14:07:53.724216+0000 mgr.gibba045.orlgmj (mgr.34412) 1052 : cluster [DBG] pgmap v585: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:55.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:07:55 gibba045 bash[25517]: cluster 2021-03-10T14:07:53.724216+0000 mgr.gibba045.orlgmj (mgr.34412) 1052 : cluster [DBG] pgmap v585: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:57.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:07:57 gibba015 bash[29377]: cluster 2021-03-10T14:07:55.725751+0000 mgr.gibba045.orlgmj (mgr.34412) 1053 : cluster [DBG] pgmap v586: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:57.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:07:57 gibba015 bash[30343]: cluster 2021-03-10T14:07:55.725751+0000 mgr.gibba045.orlgmj (mgr.34412) 1053 : cluster [DBG] pgmap v586: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:57.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:07:57 gibba045 bash[25517]: cluster 2021-03-10T14:07:55.725751+0000 mgr.gibba045.orlgmj (mgr.34412) 1053 : cluster [DBG] pgmap v586: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:59.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:07:59 gibba015 bash[29377]: cluster 2021-03-10T14:07:57.727180+0000 mgr.gibba045.orlgmj (mgr.34412) 1054 : cluster [DBG] pgmap v587: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:59.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:07:59 gibba015 bash[30343]: cluster 2021-03-10T14:07:57.727180+0000 mgr.gibba045.orlgmj (mgr.34412) 1054 : cluster [DBG] pgmap v587: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:59.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:07:59 gibba045 bash[25517]: cluster 2021-03-10T14:07:57.727180+0000 mgr.gibba045.orlgmj (mgr.34412) 1054 : cluster [DBG] pgmap v587: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:00.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:08:00 gibba015 bash[29377]: cephadm 2021-03-10T14:07:58.699566+0000 mgr.gibba045.orlgmj (mgr.34412) 1055 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:08:00.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:08:00 gibba015 bash[30343]: cephadm 2021-03-10T14:07:58.699566+0000 mgr.gibba045.orlgmj (mgr.34412) 1055 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:08:00.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:08:00 gibba045 bash[25517]: cephadm 2021-03-10T14:07:58.699566+0000 mgr.gibba045.orlgmj (mgr.34412) 1055 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:08:01.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:08:01 gibba015 bash[29377]: cluster 2021-03-10T14:07:59.728232+0000 mgr.gibba045.orlgmj (mgr.34412) 1056 : cluster [DBG] pgmap v588: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:01.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:08:01 gibba015 bash[30343]: cluster 2021-03-10T14:07:59.728232+0000 mgr.gibba045.orlgmj (mgr.34412) 1056 : cluster [DBG] pgmap v588: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:01.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:08:01 gibba045 bash[25517]: cluster 2021-03-10T14:07:59.728232+0000 mgr.gibba045.orlgmj (mgr.34412) 1056 : cluster [DBG] pgmap v588: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:03.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:08:03 gibba015 bash[29377]: cluster 2021-03-10T14:08:01.729646+0000 mgr.gibba045.orlgmj (mgr.34412) 1057 : cluster [DBG] pgmap v589: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:03.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:08:03 gibba015 bash[30343]: cluster 2021-03-10T14:08:01.729646+0000 mgr.gibba045.orlgmj (mgr.34412) 1057 : cluster [DBG] pgmap v589: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:03.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:08:03 gibba045 bash[25517]: cluster 2021-03-10T14:08:01.729646+0000 mgr.gibba045.orlgmj (mgr.34412) 1057 : cluster [DBG] pgmap v589: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:04.712 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:08:04.943 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:08:04.943 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (18m) 4m ago 24m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:08:04.943 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (23m) 3m ago 23m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:08:04.944 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (19m) 3m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:08:04.944 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (19m) 3m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:08:04.944 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (18m) 4m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:08:04.944 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (18m) 4m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:08:04.944 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (17m) 3m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:08:04.945 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (18m) 4m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:08:04.945 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (24m) 4m ago 24m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:08:04.945 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (24m) 3m ago 24m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:08:04.945 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (17m) 4m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:08:04.946 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (16m) 4m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:08:04.946 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (16m) 4m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:08:04.946 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (15m) 4m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:08:04.946 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (15m) 3m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:08:04.946 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (14m) 3m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:08:04.947 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (14m) 3m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:08:04.947 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (14m) 3m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:08:04.947 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (23m) 3m ago 24m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:08:04.947 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 3m ago 22m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:08:05.193 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:08:05.193 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:08:05.194 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:08:05.194 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:08:05.194 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:08:05.194 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:08:05.194 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:08:05.195 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:08:05.195 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:08:05.195 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:08:05.195 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:08:05.196 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:08:05.196 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:08:05.196 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:08:05.196 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:08:05.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:08:05 gibba015 bash[29377]: cluster 2021-03-10T14:08:03.730913+0000 mgr.gibba045.orlgmj (mgr.34412) 1058 : cluster [DBG] pgmap v590: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:05.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:08:05 gibba015 bash[30343]: cluster 2021-03-10T14:08:03.730913+0000 mgr.gibba045.orlgmj (mgr.34412) 1058 : cluster [DBG] pgmap v590: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:05.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:08:05 gibba045 bash[25517]: cluster 2021-03-10T14:08:03.730913+0000 mgr.gibba045.orlgmj (mgr.34412) 1058 : cluster [DBG] pgmap v590: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:06.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:08:06 gibba015 bash[29377]: audit 2021-03-10T14:08:04.703594+0000 mgr.gibba045.orlgmj (mgr.34412) 1059 : audit [DBG] from='client.54760 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:08:06.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:08:06 gibba015 bash[29377]: audit 2021-03-10T14:08:04.929682+0000 mgr.gibba045.orlgmj (mgr.34412) 1060 : audit [DBG] from='client.54766 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:08:06.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:08:06 gibba015 bash[29377]: audit 2021-03-10T14:08:05.191146+0000 mon.c (mon.1) 359 : audit [DBG] from='client.? 172.21.2.115:0/4106269076' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:08:06.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:08:06 gibba015 bash[30343]: audit 2021-03-10T14:08:04.703594+0000 mgr.gibba045.orlgmj (mgr.34412) 1059 : audit [DBG] from='client.54760 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:08:06.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:08:06 gibba015 bash[30343]: audit 2021-03-10T14:08:04.929682+0000 mgr.gibba045.orlgmj (mgr.34412) 1060 : audit [DBG] from='client.54766 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:08:06.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:08:06 gibba015 bash[30343]: audit 2021-03-10T14:08:05.191146+0000 mon.c (mon.1) 359 : audit [DBG] from='client.? 172.21.2.115:0/4106269076' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:08:06.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:08:06 gibba045 bash[25517]: audit 2021-03-10T14:08:04.703594+0000 mgr.gibba045.orlgmj (mgr.34412) 1059 : audit [DBG] from='client.54760 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:08:06.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:08:06 gibba045 bash[25517]: audit 2021-03-10T14:08:04.929682+0000 mgr.gibba045.orlgmj (mgr.34412) 1060 : audit [DBG] from='client.54766 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:08:06.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:08:06 gibba045 bash[25517]: audit 2021-03-10T14:08:05.191146+0000 mon.c (mon.1) 359 : audit [DBG] from='client.? 172.21.2.115:0/4106269076' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:08:07.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:08:07 gibba015 bash[29377]: cluster 2021-03-10T14:08:05.732696+0000 mgr.gibba045.orlgmj (mgr.34412) 1061 : cluster [DBG] pgmap v591: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:07.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:08:07 gibba015 bash[30343]: cluster 2021-03-10T14:08:05.732696+0000 mgr.gibba045.orlgmj (mgr.34412) 1061 : cluster [DBG] pgmap v591: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:07.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:08:07 gibba045 bash[25517]: cluster 2021-03-10T14:08:05.732696+0000 mgr.gibba045.orlgmj (mgr.34412) 1061 : cluster [DBG] pgmap v591: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:08.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:08:08 gibba015 bash[29377]: cluster 2021-03-10T14:08:07.734104+0000 mgr.gibba045.orlgmj (mgr.34412) 1062 : cluster [DBG] pgmap v592: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:08.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:08:08 gibba015 bash[30343]: cluster 2021-03-10T14:08:07.734104+0000 mgr.gibba045.orlgmj (mgr.34412) 1062 : cluster [DBG] pgmap v592: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:08.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:08:08 gibba045 bash[25517]: cluster 2021-03-10T14:08:07.734104+0000 mgr.gibba045.orlgmj (mgr.34412) 1062 : cluster [DBG] pgmap v592: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:11.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:08:10 gibba045 bash[25517]: cluster 2021-03-10T14:08:09.735877+0000 mgr.gibba045.orlgmj (mgr.34412) 1063 : cluster [DBG] pgmap v593: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:11.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:08:10 gibba015 bash[29377]: cluster 2021-03-10T14:08:09.735877+0000 mgr.gibba045.orlgmj (mgr.34412) 1063 : cluster [DBG] pgmap v593: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:11.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:08:10 gibba015 bash[30343]: cluster 2021-03-10T14:08:09.735877+0000 mgr.gibba045.orlgmj (mgr.34412) 1063 : cluster [DBG] pgmap v593: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:13.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:08:12 gibba015 bash[29377]: cluster 2021-03-10T14:08:11.737728+0000 mgr.gibba045.orlgmj (mgr.34412) 1064 : cluster [DBG] pgmap v594: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:13.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:08:12 gibba015 bash[30343]: cluster 2021-03-10T14:08:11.737728+0000 mgr.gibba045.orlgmj (mgr.34412) 1064 : cluster [DBG] pgmap v594: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:13.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:08:12 gibba045 bash[25517]: cluster 2021-03-10T14:08:11.737728+0000 mgr.gibba045.orlgmj (mgr.34412) 1064 : cluster [DBG] pgmap v594: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:14.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:08:13 gibba015 bash[29377]: audit 2021-03-10T14:08:13.713976+0000 mon.c (mon.1) 360 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:08:14.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:08:13 gibba015 bash[30343]: audit 2021-03-10T14:08:13.713976+0000 mon.c (mon.1) 360 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:08:14.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:08:13 gibba045 bash[25517]: audit 2021-03-10T14:08:13.713976+0000 mon.c (mon.1) 360 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:08:15.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:08:14 gibba015 bash[29377]: cephadm 2021-03-10T14:08:13.721241+0000 mgr.gibba045.orlgmj (mgr.34412) 1065 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:08:15.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:08:14 gibba015 bash[29377]: cephadm 2021-03-10T14:08:13.723032+0000 mgr.gibba045.orlgmj (mgr.34412) 1066 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:08:15.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:08:14 gibba015 bash[29377]: cluster 2021-03-10T14:08:13.738953+0000 mgr.gibba045.orlgmj (mgr.34412) 1067 : cluster [DBG] pgmap v595: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:15.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:08:14 gibba015 bash[29377]: audit 2021-03-10T14:08:13.950356+0000 mon.a (mon.0) 694 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:08:15.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:08:14 gibba015 bash[29377]: audit 2021-03-10T14:08:13.957878+0000 mon.c (mon.1) 361 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:08:15.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:08:14 gibba015 bash[29377]: cephadm 2021-03-10T14:08:13.959133+0000 mgr.gibba045.orlgmj (mgr.34412) 1068 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:08:15.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:08:14 gibba015 bash[29377]: audit 2021-03-10T14:08:13.959911+0000 mon.c (mon.1) 362 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:08:15.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:08:14 gibba015 bash[29377]: cephadm 2021-03-10T14:08:13.961315+0000 mgr.gibba045.orlgmj (mgr.34412) 1069 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:08:15.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:08:14 gibba015 bash[29377]: audit 2021-03-10T14:08:13.961394+0000 mon.c (mon.1) 363 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:08:15.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:08:14 gibba015 bash[29377]: audit 2021-03-10T14:08:13.963001+0000 mon.c (mon.1) 364 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:08:15.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:08:14 gibba015 bash[29377]: cephadm 2021-03-10T14:08:13.963023+0000 mgr.gibba045.orlgmj (mgr.34412) 1070 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:08:15.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:08:14 gibba015 bash[29377]: cephadm 2021-03-10T14:08:13.963063+0000 mgr.gibba045.orlgmj (mgr.34412) 1071 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:08:15.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:08:14 gibba015 bash[29377]: cephadm 2021-03-10T14:08:13.964598+0000 mgr.gibba045.orlgmj (mgr.34412) 1072 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:08:15.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:08:14 gibba015 bash[29377]: cephadm 2021-03-10T14:08:13.964638+0000 mgr.gibba045.orlgmj (mgr.34412) 1073 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:08:15.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:08:14 gibba015 bash[29377]: audit 2021-03-10T14:08:13.966241+0000 mon.c (mon.1) 365 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:08:15.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:08:14 gibba015 bash[29377]: cephadm 2021-03-10T14:08:13.966291+0000 mgr.gibba045.orlgmj (mgr.34412) 1074 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:08:15.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:08:14 gibba015 bash[29377]: cephadm 2021-03-10T14:08:13.967889+0000 mgr.gibba045.orlgmj (mgr.34412) 1075 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:08:15.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:08:14 gibba015 bash[29377]: cephadm 2021-03-10T14:08:13.967930+0000 mgr.gibba045.orlgmj (mgr.34412) 1076 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:08:15.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:08:14 gibba015 bash[29377]: audit 2021-03-10T14:08:13.968539+0000 mon.c (mon.1) 366 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:08:15.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:08:14 gibba015 bash[29377]: cephadm 2021-03-10T14:08:13.969728+0000 mgr.gibba045.orlgmj (mgr.34412) 1077 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:08:15.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:08:14 gibba015 bash[30343]: cephadm 2021-03-10T14:08:13.721241+0000 mgr.gibba045.orlgmj (mgr.34412) 1065 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:08:15.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:08:14 gibba015 bash[30343]: cephadm 2021-03-10T14:08:13.723032+0000 mgr.gibba045.orlgmj (mgr.34412) 1066 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:08:15.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:08:14 gibba015 bash[30343]: cluster 2021-03-10T14:08:13.738953+0000 mgr.gibba045.orlgmj (mgr.34412) 1067 : cluster [DBG] pgmap v595: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:15.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:08:14 gibba015 bash[30343]: audit 2021-03-10T14:08:13.950356+0000 mon.a (mon.0) 694 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:08:15.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:08:14 gibba015 bash[30343]: audit 2021-03-10T14:08:13.957878+0000 mon.c (mon.1) 361 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:08:15.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:08:14 gibba015 bash[30343]: cephadm 2021-03-10T14:08:13.959133+0000 mgr.gibba045.orlgmj (mgr.34412) 1068 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:08:15.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:08:14 gibba015 bash[30343]: audit 2021-03-10T14:08:13.959911+0000 mon.c (mon.1) 362 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:08:15.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:08:14 gibba015 bash[30343]: cephadm 2021-03-10T14:08:13.961315+0000 mgr.gibba045.orlgmj (mgr.34412) 1069 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:08:15.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:08:14 gibba015 bash[30343]: audit 2021-03-10T14:08:13.961394+0000 mon.c (mon.1) 363 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:08:15.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:08:14 gibba015 bash[30343]: audit 2021-03-10T14:08:13.963001+0000 mon.c (mon.1) 364 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:08:15.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:08:14 gibba015 bash[30343]: cephadm 2021-03-10T14:08:13.963023+0000 mgr.gibba045.orlgmj (mgr.34412) 1070 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:08:15.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:08:14 gibba015 bash[30343]: cephadm 2021-03-10T14:08:13.963063+0000 mgr.gibba045.orlgmj (mgr.34412) 1071 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:08:15.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:08:14 gibba015 bash[30343]: cephadm 2021-03-10T14:08:13.964598+0000 mgr.gibba045.orlgmj (mgr.34412) 1072 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:08:15.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:08:14 gibba015 bash[30343]: cephadm 2021-03-10T14:08:13.964638+0000 mgr.gibba045.orlgmj (mgr.34412) 1073 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:08:15.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:08:14 gibba015 bash[30343]: audit 2021-03-10T14:08:13.966241+0000 mon.c (mon.1) 365 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:08:15.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:08:14 gibba015 bash[30343]: cephadm 2021-03-10T14:08:13.966291+0000 mgr.gibba045.orlgmj (mgr.34412) 1074 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:08:15.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:08:14 gibba015 bash[30343]: cephadm 2021-03-10T14:08:13.967889+0000 mgr.gibba045.orlgmj (mgr.34412) 1075 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:08:15.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:08:14 gibba015 bash[30343]: cephadm 2021-03-10T14:08:13.967930+0000 mgr.gibba045.orlgmj (mgr.34412) 1076 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:08:15.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:08:14 gibba015 bash[30343]: audit 2021-03-10T14:08:13.968539+0000 mon.c (mon.1) 366 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:08:15.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:08:14 gibba015 bash[30343]: cephadm 2021-03-10T14:08:13.969728+0000 mgr.gibba045.orlgmj (mgr.34412) 1077 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:08:15.233 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:08:14 gibba015 bash[29377]: cephadm 2021-03-10T14:08:13.970215+0000 mgr.gibba045.orlgmj (mgr.34412) 1078 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:08:15.233 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:08:14 gibba015 bash[29377]: cephadm 2021-03-10T14:08:13.971480+0000 mgr.gibba045.orlgmj (mgr.34412) 1079 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:08:15.234 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:08:14 gibba015 bash[29377]: cephadm 2021-03-10T14:08:13.971529+0000 mgr.gibba045.orlgmj (mgr.34412) 1080 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:08:15.234 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:08:14 gibba015 bash[29377]: cephadm 2021-03-10T14:08:13.971670+0000 mgr.gibba045.orlgmj (mgr.34412) 1081 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:08:15.234 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:08:14 gibba015 bash[30343]: cephadm 2021-03-10T14:08:13.970215+0000 mgr.gibba045.orlgmj (mgr.34412) 1078 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:08:15.235 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:08:14 gibba015 bash[30343]: cephadm 2021-03-10T14:08:13.971480+0000 mgr.gibba045.orlgmj (mgr.34412) 1079 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:08:15.235 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:08:14 gibba015 bash[30343]: cephadm 2021-03-10T14:08:13.971529+0000 mgr.gibba045.orlgmj (mgr.34412) 1080 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:08:15.235 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:08:14 gibba015 bash[30343]: cephadm 2021-03-10T14:08:13.971670+0000 mgr.gibba045.orlgmj (mgr.34412) 1081 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:08:15.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:08:14 gibba045 bash[25517]: cephadm 2021-03-10T14:08:13.721241+0000 mgr.gibba045.orlgmj (mgr.34412) 1065 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:08:15.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:08:14 gibba045 bash[25517]: cephadm 2021-03-10T14:08:13.723032+0000 mgr.gibba045.orlgmj (mgr.34412) 1066 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:08:15.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:08:14 gibba045 bash[25517]: cluster 2021-03-10T14:08:13.738953+0000 mgr.gibba045.orlgmj (mgr.34412) 1067 : cluster [DBG] pgmap v595: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:15.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:08:14 gibba045 bash[25517]: audit 2021-03-10T14:08:13.950356+0000 mon.a (mon.0) 694 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:08:15.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:08:14 gibba045 bash[25517]: audit 2021-03-10T14:08:13.957878+0000 mon.c (mon.1) 361 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:08:15.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:08:14 gibba045 bash[25517]: cephadm 2021-03-10T14:08:13.959133+0000 mgr.gibba045.orlgmj (mgr.34412) 1068 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:08:15.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:08:14 gibba045 bash[25517]: audit 2021-03-10T14:08:13.959911+0000 mon.c (mon.1) 362 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:08:15.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:08:14 gibba045 bash[25517]: cephadm 2021-03-10T14:08:13.961315+0000 mgr.gibba045.orlgmj (mgr.34412) 1069 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:08:15.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:08:14 gibba045 bash[25517]: audit 2021-03-10T14:08:13.961394+0000 mon.c (mon.1) 363 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:08:15.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:08:14 gibba045 bash[25517]: audit 2021-03-10T14:08:13.963001+0000 mon.c (mon.1) 364 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:08:15.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:08:14 gibba045 bash[25517]: cephadm 2021-03-10T14:08:13.963023+0000 mgr.gibba045.orlgmj (mgr.34412) 1070 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:08:15.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:08:14 gibba045 bash[25517]: cephadm 2021-03-10T14:08:13.963063+0000 mgr.gibba045.orlgmj (mgr.34412) 1071 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:08:15.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:08:14 gibba045 bash[25517]: cephadm 2021-03-10T14:08:13.964598+0000 mgr.gibba045.orlgmj (mgr.34412) 1072 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:08:15.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:08:14 gibba045 bash[25517]: cephadm 2021-03-10T14:08:13.964638+0000 mgr.gibba045.orlgmj (mgr.34412) 1073 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:08:15.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:08:14 gibba045 bash[25517]: audit 2021-03-10T14:08:13.966241+0000 mon.c (mon.1) 365 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:08:15.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:08:14 gibba045 bash[25517]: cephadm 2021-03-10T14:08:13.966291+0000 mgr.gibba045.orlgmj (mgr.34412) 1074 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:08:15.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:08:14 gibba045 bash[25517]: cephadm 2021-03-10T14:08:13.967889+0000 mgr.gibba045.orlgmj (mgr.34412) 1075 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:08:15.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:08:14 gibba045 bash[25517]: cephadm 2021-03-10T14:08:13.967930+0000 mgr.gibba045.orlgmj (mgr.34412) 1076 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:08:15.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:08:14 gibba045 bash[25517]: audit 2021-03-10T14:08:13.968539+0000 mon.c (mon.1) 366 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:08:15.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:08:14 gibba045 bash[25517]: cephadm 2021-03-10T14:08:13.969728+0000 mgr.gibba045.orlgmj (mgr.34412) 1077 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:08:15.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:08:14 gibba045 bash[25517]: cephadm 2021-03-10T14:08:13.970215+0000 mgr.gibba045.orlgmj (mgr.34412) 1078 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:08:15.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:08:14 gibba045 bash[25517]: cephadm 2021-03-10T14:08:13.971480+0000 mgr.gibba045.orlgmj (mgr.34412) 1079 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:08:15.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:08:14 gibba045 bash[25517]: cephadm 2021-03-10T14:08:13.971529+0000 mgr.gibba045.orlgmj (mgr.34412) 1080 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:08:15.312 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:08:14 gibba045 bash[25517]: cephadm 2021-03-10T14:08:13.971670+0000 mgr.gibba045.orlgmj (mgr.34412) 1081 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:08:17.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:08:16 gibba015 bash[29377]: cluster 2021-03-10T14:08:15.740721+0000 mgr.gibba045.orlgmj (mgr.34412) 1082 : cluster [DBG] pgmap v596: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:17.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:08:16 gibba015 bash[30343]: cluster 2021-03-10T14:08:15.740721+0000 mgr.gibba045.orlgmj (mgr.34412) 1082 : cluster [DBG] pgmap v596: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:17.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:08:16 gibba045 bash[25517]: cluster 2021-03-10T14:08:15.740721+0000 mgr.gibba045.orlgmj (mgr.34412) 1082 : cluster [DBG] pgmap v596: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:19.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:08:18 gibba045 bash[25517]: cluster 2021-03-10T14:08:17.741995+0000 mgr.gibba045.orlgmj (mgr.34412) 1083 : cluster [DBG] pgmap v597: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:19.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:08:18 gibba015 bash[29377]: cluster 2021-03-10T14:08:17.741995+0000 mgr.gibba045.orlgmj (mgr.34412) 1083 : cluster [DBG] pgmap v597: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:19.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:08:18 gibba015 bash[30343]: cluster 2021-03-10T14:08:17.741995+0000 mgr.gibba045.orlgmj (mgr.34412) 1083 : cluster [DBG] pgmap v597: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:21.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:08:20 gibba045 bash[25517]: cluster 2021-03-10T14:08:19.743867+0000 mgr.gibba045.orlgmj (mgr.34412) 1084 : cluster [DBG] pgmap v598: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:21.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:08:20 gibba015 bash[29377]: cluster 2021-03-10T14:08:19.743867+0000 mgr.gibba045.orlgmj (mgr.34412) 1084 : cluster [DBG] pgmap v598: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:21.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:08:20 gibba015 bash[30343]: cluster 2021-03-10T14:08:19.743867+0000 mgr.gibba045.orlgmj (mgr.34412) 1084 : cluster [DBG] pgmap v598: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:23.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:08:22 gibba045 bash[25517]: cluster 2021-03-10T14:08:21.745588+0000 mgr.gibba045.orlgmj (mgr.34412) 1085 : cluster [DBG] pgmap v599: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:23.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:08:22 gibba015 bash[29377]: cluster 2021-03-10T14:08:21.745588+0000 mgr.gibba045.orlgmj (mgr.34412) 1085 : cluster [DBG] pgmap v599: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:23.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:08:22 gibba015 bash[30343]: cluster 2021-03-10T14:08:21.745588+0000 mgr.gibba045.orlgmj (mgr.34412) 1085 : cluster [DBG] pgmap v599: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:25.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:08:25 gibba045 bash[25517]: cluster 2021-03-10T14:08:23.746920+0000 mgr.gibba045.orlgmj (mgr.34412) 1086 : cluster [DBG] pgmap v600: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:25.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:08:24 gibba015 bash[29377]: cluster 2021-03-10T14:08:23.746920+0000 mgr.gibba045.orlgmj (mgr.34412) 1086 : cluster [DBG] pgmap v600: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:25.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:08:24 gibba015 bash[30343]: cluster 2021-03-10T14:08:23.746920+0000 mgr.gibba045.orlgmj (mgr.34412) 1086 : cluster [DBG] pgmap v600: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:27.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:08:27 gibba045 bash[25517]: cluster 2021-03-10T14:08:25.748415+0000 mgr.gibba045.orlgmj (mgr.34412) 1087 : cluster [DBG] pgmap v601: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:27.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:08:27 gibba015 bash[29377]: cluster 2021-03-10T14:08:25.748415+0000 mgr.gibba045.orlgmj (mgr.34412) 1087 : cluster [DBG] pgmap v601: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:27.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:08:27 gibba015 bash[30343]: cluster 2021-03-10T14:08:25.748415+0000 mgr.gibba045.orlgmj (mgr.34412) 1087 : cluster [DBG] pgmap v601: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:29.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:08:29 gibba045 bash[25517]: cluster 2021-03-10T14:08:27.749981+0000 mgr.gibba045.orlgmj (mgr.34412) 1088 : cluster [DBG] pgmap v602: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:29.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:08:29 gibba015 bash[29377]: cluster 2021-03-10T14:08:27.749981+0000 mgr.gibba045.orlgmj (mgr.34412) 1088 : cluster [DBG] pgmap v602: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:29.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:08:29 gibba015 bash[30343]: cluster 2021-03-10T14:08:27.749981+0000 mgr.gibba045.orlgmj (mgr.34412) 1088 : cluster [DBG] pgmap v602: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:30.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:08:30 gibba045 bash[25517]: cephadm 2021-03-10T14:08:28.982164+0000 mgr.gibba045.orlgmj (mgr.34412) 1089 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:08:30.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:08:30 gibba015 bash[29377]: cephadm 2021-03-10T14:08:28.982164+0000 mgr.gibba045.orlgmj (mgr.34412) 1089 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:08:30.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:08:30 gibba015 bash[30343]: cephadm 2021-03-10T14:08:28.982164+0000 mgr.gibba045.orlgmj (mgr.34412) 1089 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:08:31.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:08:31 gibba045 bash[25517]: cluster 2021-03-10T14:08:29.751732+0000 mgr.gibba045.orlgmj (mgr.34412) 1090 : cluster [DBG] pgmap v603: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:31.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:08:31 gibba015 bash[29377]: cluster 2021-03-10T14:08:29.751732+0000 mgr.gibba045.orlgmj (mgr.34412) 1090 : cluster [DBG] pgmap v603: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:31.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:08:31 gibba015 bash[30343]: cluster 2021-03-10T14:08:29.751732+0000 mgr.gibba045.orlgmj (mgr.34412) 1090 : cluster [DBG] pgmap v603: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:33.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:08:33 gibba045 bash[25517]: cluster 2021-03-10T14:08:31.753475+0000 mgr.gibba045.orlgmj (mgr.34412) 1091 : cluster [DBG] pgmap v604: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:33.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:08:33 gibba015 bash[29377]: cluster 2021-03-10T14:08:31.753475+0000 mgr.gibba045.orlgmj (mgr.34412) 1091 : cluster [DBG] pgmap v604: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:33.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:08:33 gibba015 bash[30343]: cluster 2021-03-10T14:08:31.753475+0000 mgr.gibba045.orlgmj (mgr.34412) 1091 : cluster [DBG] pgmap v604: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:35.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:08:35 gibba045 bash[25517]: cluster 2021-03-10T14:08:33.754820+0000 mgr.gibba045.orlgmj (mgr.34412) 1092 : cluster [DBG] pgmap v605: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:35.437 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:08:35.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:08:35 gibba015 bash[29377]: cluster 2021-03-10T14:08:33.754820+0000 mgr.gibba045.orlgmj (mgr.34412) 1092 : cluster [DBG] pgmap v605: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:35.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:08:35 gibba015 bash[30343]: cluster 2021-03-10T14:08:33.754820+0000 mgr.gibba045.orlgmj (mgr.34412) 1092 : cluster [DBG] pgmap v605: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:35.669 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:08:35.670 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (19m) 5m ago 24m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:08:35.670 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (24m) 4m ago 24m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:08:35.670 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (19m) 4m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:08:35.670 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (20m) 4m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:08:35.671 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (18m) 5m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:08:35.671 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (18m) 5m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:08:35.671 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (18m) 4m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:08:35.671 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (18m) 5m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:08:35.671 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (24m) 5m ago 24m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:08:35.672 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (24m) 4m ago 24m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:08:35.672 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (17m) 5m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:08:35.672 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (17m) 5m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:08:35.672 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (16m) 5m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:08:35.672 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (16m) 5m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:08:35.672 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (15m) 4m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:08:35.673 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (15m) 4m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:08:35.673 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (15m) 4m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:08:35.673 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (14m) 4m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:08:35.673 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (24m) 4m ago 24m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:08:35.673 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 4m ago 22m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:08:35.923 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:08:35.924 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:08:35.924 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:08:35.924 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:08:35.924 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:08:35.925 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:08:35.925 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:08:35.925 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:08:35.925 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:08:35.926 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:08:35.926 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:08:35.926 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:08:35.926 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:08:35.926 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:08:35.927 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:08:36.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:08:36 gibba015 bash[29377]: audit 2021-03-10T14:08:35.921230+0000 mon.c (mon.1) 367 : audit [DBG] from='client.? 172.21.2.115:0/2723467942' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:08:36.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:08:36 gibba015 bash[30343]: audit 2021-03-10T14:08:35.921230+0000 mon.c (mon.1) 367 : audit [DBG] from='client.? 172.21.2.115:0/2723467942' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:08:36.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:08:36 gibba045 bash[25517]: audit 2021-03-10T14:08:35.921230+0000 mon.c (mon.1) 367 : audit [DBG] from='client.? 172.21.2.115:0/2723467942' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:08:37.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:08:37 gibba015 bash[29377]: audit 2021-03-10T14:08:35.428069+0000 mgr.gibba045.orlgmj (mgr.34412) 1093 : audit [DBG] from='client.44790 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:08:37.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:08:37 gibba015 bash[29377]: audit 2021-03-10T14:08:35.657349+0000 mgr.gibba045.orlgmj (mgr.34412) 1094 : audit [DBG] from='client.54784 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:08:37.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:08:37 gibba015 bash[29377]: cluster 2021-03-10T14:08:35.756267+0000 mgr.gibba045.orlgmj (mgr.34412) 1095 : cluster [DBG] pgmap v606: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:37.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:08:37 gibba015 bash[30343]: audit 2021-03-10T14:08:35.428069+0000 mgr.gibba045.orlgmj (mgr.34412) 1093 : audit [DBG] from='client.44790 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:08:37.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:08:37 gibba015 bash[30343]: audit 2021-03-10T14:08:35.657349+0000 mgr.gibba045.orlgmj (mgr.34412) 1094 : audit [DBG] from='client.54784 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:08:37.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:08:37 gibba015 bash[30343]: cluster 2021-03-10T14:08:35.756267+0000 mgr.gibba045.orlgmj (mgr.34412) 1095 : cluster [DBG] pgmap v606: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:37.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:08:37 gibba045 bash[25517]: audit 2021-03-10T14:08:35.428069+0000 mgr.gibba045.orlgmj (mgr.34412) 1093 : audit [DBG] from='client.44790 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:08:37.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:08:37 gibba045 bash[25517]: audit 2021-03-10T14:08:35.657349+0000 mgr.gibba045.orlgmj (mgr.34412) 1094 : audit [DBG] from='client.54784 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:08:37.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:08:37 gibba045 bash[25517]: cluster 2021-03-10T14:08:35.756267+0000 mgr.gibba045.orlgmj (mgr.34412) 1095 : cluster [DBG] pgmap v606: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:39.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:08:39 gibba015 bash[29377]: cluster 2021-03-10T14:08:37.757869+0000 mgr.gibba045.orlgmj (mgr.34412) 1096 : cluster [DBG] pgmap v607: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:39.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:08:39 gibba015 bash[30343]: cluster 2021-03-10T14:08:37.757869+0000 mgr.gibba045.orlgmj (mgr.34412) 1096 : cluster [DBG] pgmap v607: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:39.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:08:39 gibba045 bash[25517]: cluster 2021-03-10T14:08:37.757869+0000 mgr.gibba045.orlgmj (mgr.34412) 1096 : cluster [DBG] pgmap v607: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:41.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:08:41 gibba015 bash[29377]: cluster 2021-03-10T14:08:39.759569+0000 mgr.gibba045.orlgmj (mgr.34412) 1097 : cluster [DBG] pgmap v608: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:41.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:08:41 gibba015 bash[30343]: cluster 2021-03-10T14:08:39.759569+0000 mgr.gibba045.orlgmj (mgr.34412) 1097 : cluster [DBG] pgmap v608: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:41.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:08:41 gibba045 bash[25517]: cluster 2021-03-10T14:08:39.759569+0000 mgr.gibba045.orlgmj (mgr.34412) 1097 : cluster [DBG] pgmap v608: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:43.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:08:43 gibba015 bash[29377]: cluster 2021-03-10T14:08:41.761371+0000 mgr.gibba045.orlgmj (mgr.34412) 1098 : cluster [DBG] pgmap v609: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:43.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:08:43 gibba015 bash[30343]: cluster 2021-03-10T14:08:41.761371+0000 mgr.gibba045.orlgmj (mgr.34412) 1098 : cluster [DBG] pgmap v609: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:43.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:08:43 gibba045 bash[25517]: cluster 2021-03-10T14:08:41.761371+0000 mgr.gibba045.orlgmj (mgr.34412) 1098 : cluster [DBG] pgmap v609: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:45.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:08:45 gibba015 bash[29377]: cluster 2021-03-10T14:08:43.762718+0000 mgr.gibba045.orlgmj (mgr.34412) 1099 : cluster [DBG] pgmap v610: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:45.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:08:45 gibba015 bash[29377]: cephadm 2021-03-10T14:08:43.998052+0000 mgr.gibba045.orlgmj (mgr.34412) 1100 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:08:45.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:08:45 gibba015 bash[30343]: cluster 2021-03-10T14:08:43.762718+0000 mgr.gibba045.orlgmj (mgr.34412) 1099 : cluster [DBG] pgmap v610: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:45.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:08:45 gibba015 bash[30343]: cephadm 2021-03-10T14:08:43.998052+0000 mgr.gibba045.orlgmj (mgr.34412) 1100 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:08:45.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:08:45 gibba045 bash[25517]: cluster 2021-03-10T14:08:43.762718+0000 mgr.gibba045.orlgmj (mgr.34412) 1099 : cluster [DBG] pgmap v610: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:45.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:08:45 gibba045 bash[25517]: cephadm 2021-03-10T14:08:43.998052+0000 mgr.gibba045.orlgmj (mgr.34412) 1100 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:08:47.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:08:47 gibba015 bash[29377]: cluster 2021-03-10T14:08:45.764389+0000 mgr.gibba045.orlgmj (mgr.34412) 1101 : cluster [DBG] pgmap v611: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:47.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:08:47 gibba015 bash[30343]: cluster 2021-03-10T14:08:45.764389+0000 mgr.gibba045.orlgmj (mgr.34412) 1101 : cluster [DBG] pgmap v611: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:47.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:08:47 gibba045 bash[25517]: cluster 2021-03-10T14:08:45.764389+0000 mgr.gibba045.orlgmj (mgr.34412) 1101 : cluster [DBG] pgmap v611: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:49.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:08:49 gibba015 bash[29377]: cluster 2021-03-10T14:08:47.765732+0000 mgr.gibba045.orlgmj (mgr.34412) 1102 : cluster [DBG] pgmap v612: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:49.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:08:49 gibba015 bash[30343]: cluster 2021-03-10T14:08:47.765732+0000 mgr.gibba045.orlgmj (mgr.34412) 1102 : cluster [DBG] pgmap v612: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:49.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:08:49 gibba045 bash[25517]: cluster 2021-03-10T14:08:47.765732+0000 mgr.gibba045.orlgmj (mgr.34412) 1102 : cluster [DBG] pgmap v612: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:51.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:08:51 gibba015 bash[29377]: cluster 2021-03-10T14:08:49.767397+0000 mgr.gibba045.orlgmj (mgr.34412) 1103 : cluster [DBG] pgmap v613: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:51.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:08:51 gibba015 bash[30343]: cluster 2021-03-10T14:08:49.767397+0000 mgr.gibba045.orlgmj (mgr.34412) 1103 : cluster [DBG] pgmap v613: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:51.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:08:51 gibba045 bash[25517]: cluster 2021-03-10T14:08:49.767397+0000 mgr.gibba045.orlgmj (mgr.34412) 1103 : cluster [DBG] pgmap v613: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:53.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:08:53 gibba015 bash[29377]: cluster 2021-03-10T14:08:51.769148+0000 mgr.gibba045.orlgmj (mgr.34412) 1104 : cluster [DBG] pgmap v614: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:53.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:08:53 gibba015 bash[29377]: audit 2021-03-10T14:08:52.529631+0000 mon.c (mon.1) 368 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T14:08:53.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:08:53 gibba015 bash[29377]: audit 2021-03-10T14:08:52.530560+0000 mon.c (mon.1) 369 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:08:53.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:08:53 gibba015 bash[29377]: audit 2021-03-10T14:08:52.530885+0000 mon.a (mon.0) 695 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T14:08:53.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:08:53 gibba015 bash[29377]: audit 2021-03-10T14:08:52.531473+0000 mon.c (mon.1) 370 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:08:53.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:08:53 gibba015 bash[29377]: audit 2021-03-10T14:08:52.532210+0000 mon.a (mon.0) 696 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:08:53.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:08:53 gibba015 bash[29377]: audit 2021-03-10T14:08:52.532506+0000 mon.c (mon.1) 371 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:08:53.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:08:53 gibba015 bash[29377]: audit 2021-03-10T14:08:52.533513+0000 mon.a (mon.0) 697 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:08:53.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:08:53 gibba015 bash[29377]: audit 2021-03-10T14:08:52.534510+0000 mon.a (mon.0) 698 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:08:53.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:08:53 gibba015 bash[29377]: audit 2021-03-10T14:08:52.581268+0000 mon.c (mon.1) 372 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:08:53.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:08:53 gibba015 bash[29377]: audit 2021-03-10T14:08:52.582294+0000 mon.a (mon.0) 699 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:08:53.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:08:53 gibba015 bash[29377]: audit 2021-03-10T14:08:52.582314+0000 mon.c (mon.1) 373 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:08:53.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:08:53 gibba015 bash[29377]: audit 2021-03-10T14:08:52.583312+0000 mon.a (mon.0) 700 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:08:53.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:08:53 gibba015 bash[30343]: cluster 2021-03-10T14:08:51.769148+0000 mgr.gibba045.orlgmj (mgr.34412) 1104 : cluster [DBG] pgmap v614: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:53.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:08:53 gibba015 bash[30343]: audit 2021-03-10T14:08:52.529631+0000 mon.c (mon.1) 368 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T14:08:53.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:08:53 gibba015 bash[30343]: audit 2021-03-10T14:08:52.530560+0000 mon.c (mon.1) 369 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:08:53.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:08:53 gibba015 bash[30343]: audit 2021-03-10T14:08:52.530885+0000 mon.a (mon.0) 695 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T14:08:53.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:08:53 gibba015 bash[30343]: audit 2021-03-10T14:08:52.531473+0000 mon.c (mon.1) 370 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:08:53.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:08:53 gibba015 bash[30343]: audit 2021-03-10T14:08:52.532210+0000 mon.a (mon.0) 696 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:08:53.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:08:53 gibba015 bash[30343]: audit 2021-03-10T14:08:52.532506+0000 mon.c (mon.1) 371 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:08:53.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:08:53 gibba015 bash[30343]: audit 2021-03-10T14:08:52.533513+0000 mon.a (mon.0) 697 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:08:53.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:08:53 gibba015 bash[30343]: audit 2021-03-10T14:08:52.534510+0000 mon.a (mon.0) 698 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:08:53.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:08:53 gibba015 bash[30343]: audit 2021-03-10T14:08:52.581268+0000 mon.c (mon.1) 372 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:08:53.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:08:53 gibba015 bash[30343]: audit 2021-03-10T14:08:52.582294+0000 mon.a (mon.0) 699 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:08:53.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:08:53 gibba015 bash[30343]: audit 2021-03-10T14:08:52.582314+0000 mon.c (mon.1) 373 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:08:53.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:08:53 gibba015 bash[30343]: audit 2021-03-10T14:08:52.583312+0000 mon.a (mon.0) 700 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:08:53.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:08:53 gibba045 bash[25517]: cluster 2021-03-10T14:08:51.769148+0000 mgr.gibba045.orlgmj (mgr.34412) 1104 : cluster [DBG] pgmap v614: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:53.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:08:53 gibba045 bash[25517]: audit 2021-03-10T14:08:52.529631+0000 mon.c (mon.1) 368 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T14:08:53.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:08:53 gibba045 bash[25517]: audit 2021-03-10T14:08:52.530560+0000 mon.c (mon.1) 369 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:08:53.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:08:53 gibba045 bash[25517]: audit 2021-03-10T14:08:52.530885+0000 mon.a (mon.0) 695 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T14:08:53.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:08:53 gibba045 bash[25517]: audit 2021-03-10T14:08:52.531473+0000 mon.c (mon.1) 370 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:08:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:08:53 gibba045 bash[25517]: audit 2021-03-10T14:08:52.532210+0000 mon.a (mon.0) 696 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:08:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:08:53 gibba045 bash[25517]: audit 2021-03-10T14:08:52.532506+0000 mon.c (mon.1) 371 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:08:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:08:53 gibba045 bash[25517]: audit 2021-03-10T14:08:52.533513+0000 mon.a (mon.0) 697 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:08:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:08:53 gibba045 bash[25517]: audit 2021-03-10T14:08:52.534510+0000 mon.a (mon.0) 698 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:08:53.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:08:53 gibba045 bash[25517]: audit 2021-03-10T14:08:52.581268+0000 mon.c (mon.1) 372 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:08:53.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:08:53 gibba045 bash[25517]: audit 2021-03-10T14:08:52.582294+0000 mon.a (mon.0) 699 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:08:53.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:08:53 gibba045 bash[25517]: audit 2021-03-10T14:08:52.582314+0000 mon.c (mon.1) 373 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:08:53.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:08:53 gibba045 bash[25517]: audit 2021-03-10T14:08:52.583312+0000 mon.a (mon.0) 700 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:08:55.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:08:55 gibba015 bash[29377]: cluster 2021-03-10T14:08:53.770405+0000 mgr.gibba045.orlgmj (mgr.34412) 1105 : cluster [DBG] pgmap v615: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:55.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:08:55 gibba015 bash[30343]: cluster 2021-03-10T14:08:53.770405+0000 mgr.gibba045.orlgmj (mgr.34412) 1105 : cluster [DBG] pgmap v615: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:55.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:08:55 gibba045 bash[25517]: cluster 2021-03-10T14:08:53.770405+0000 mgr.gibba045.orlgmj (mgr.34412) 1105 : cluster [DBG] pgmap v615: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:57.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:08:57 gibba015 bash[29377]: cluster 2021-03-10T14:08:55.772126+0000 mgr.gibba045.orlgmj (mgr.34412) 1106 : cluster [DBG] pgmap v616: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:57.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:08:57 gibba015 bash[30343]: cluster 2021-03-10T14:08:55.772126+0000 mgr.gibba045.orlgmj (mgr.34412) 1106 : cluster [DBG] pgmap v616: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:57.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:08:57 gibba045 bash[25517]: cluster 2021-03-10T14:08:55.772126+0000 mgr.gibba045.orlgmj (mgr.34412) 1106 : cluster [DBG] pgmap v616: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:59.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:08:59 gibba045 bash[25517]: cluster 2021-03-10T14:08:57.773491+0000 mgr.gibba045.orlgmj (mgr.34412) 1107 : cluster [DBG] pgmap v617: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:59.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:08:59 gibba015 bash[29377]: cluster 2021-03-10T14:08:57.773491+0000 mgr.gibba045.orlgmj (mgr.34412) 1107 : cluster [DBG] pgmap v617: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:59.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:08:59 gibba015 bash[30343]: cluster 2021-03-10T14:08:57.773491+0000 mgr.gibba045.orlgmj (mgr.34412) 1107 : cluster [DBG] pgmap v617: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:00.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:09:00 gibba015 bash[29377]: cephadm 2021-03-10T14:08:59.002327+0000 mgr.gibba045.orlgmj (mgr.34412) 1108 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:09:00.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:09:00 gibba015 bash[30343]: cephadm 2021-03-10T14:08:59.002327+0000 mgr.gibba045.orlgmj (mgr.34412) 1108 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:09:00.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:09:00 gibba045 bash[25517]: cephadm 2021-03-10T14:08:59.002327+0000 mgr.gibba045.orlgmj (mgr.34412) 1108 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:09:01.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:09:01 gibba015 bash[29377]: cluster 2021-03-10T14:08:59.774019+0000 mgr.gibba045.orlgmj (mgr.34412) 1109 : cluster [DBG] pgmap v618: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:01.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:09:01 gibba015 bash[30343]: cluster 2021-03-10T14:08:59.774019+0000 mgr.gibba045.orlgmj (mgr.34412) 1109 : cluster [DBG] pgmap v618: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:01.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:09:01 gibba045 bash[25517]: cluster 2021-03-10T14:08:59.774019+0000 mgr.gibba045.orlgmj (mgr.34412) 1109 : cluster [DBG] pgmap v618: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:03.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:09:03 gibba015 bash[29377]: cluster 2021-03-10T14:09:01.775521+0000 mgr.gibba045.orlgmj (mgr.34412) 1110 : cluster [DBG] pgmap v619: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:03.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:09:03 gibba015 bash[30343]: cluster 2021-03-10T14:09:01.775521+0000 mgr.gibba045.orlgmj (mgr.34412) 1110 : cluster [DBG] pgmap v619: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:03.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:09:03 gibba045 bash[25517]: cluster 2021-03-10T14:09:01.775521+0000 mgr.gibba045.orlgmj (mgr.34412) 1110 : cluster [DBG] pgmap v619: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:05.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:09:05 gibba015 bash[29377]: cluster 2021-03-10T14:09:03.777076+0000 mgr.gibba045.orlgmj (mgr.34412) 1111 : cluster [DBG] pgmap v620: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:05.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:09:05 gibba015 bash[30343]: cluster 2021-03-10T14:09:03.777076+0000 mgr.gibba045.orlgmj (mgr.34412) 1111 : cluster [DBG] pgmap v620: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:05.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:09:05 gibba045 bash[25517]: cluster 2021-03-10T14:09:03.777076+0000 mgr.gibba045.orlgmj (mgr.34412) 1111 : cluster [DBG] pgmap v620: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:06.163 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:09:06.395 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:09:06.395 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (19m) 5m ago 25m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:09:06.395 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (24m) 4m ago 24m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:09:06.395 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (20m) 4m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:09:06.396 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (20m) 4m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:09:06.396 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (19m) 5m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:09:06.396 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (19m) 5m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:09:06.396 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (18m) 4m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:09:06.396 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (19m) 5m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:09:06.397 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (25m) 5m ago 25m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:09:06.397 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (25m) 4m ago 25m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:09:06.397 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (18m) 5m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:09:06.397 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (17m) 5m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:09:06.397 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (17m) 5m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:09:06.398 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (16m) 5m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:09:06.398 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (16m) 4m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:09:06.398 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (16m) 4m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:09:06.398 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (15m) 4m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:09:06.398 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (15m) 4m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:09:06.399 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (24m) 4m ago 25m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:09:06.399 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 4m ago 23m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:09:06.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:09:06 gibba045 bash[25517]: cluster 2021-03-10T14:09:05.778758+0000 mgr.gibba045.orlgmj (mgr.34412) 1112 : cluster [DBG] pgmap v621: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:06.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:09:06 gibba045 bash[25517]: audit 2021-03-10T14:09:06.155077+0000 mgr.gibba045.orlgmj (mgr.34412) 1113 : audit [DBG] from='client.54796 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:09:06.640 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:09:06.641 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:09:06.641 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:09:06.641 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:09:06.641 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:09:06.641 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:09:06.642 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:09:06.642 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:09:06.642 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:09:06.642 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:09:06.643 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:09:06.643 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:09:06.643 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:09:06.643 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:09:06.643 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:09:06.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:09:06 gibba015 bash[29377]: cluster 2021-03-10T14:09:05.778758+0000 mgr.gibba045.orlgmj (mgr.34412) 1112 : cluster [DBG] pgmap v621: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:06.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:09:06 gibba015 bash[29377]: audit 2021-03-10T14:09:06.155077+0000 mgr.gibba045.orlgmj (mgr.34412) 1113 : audit [DBG] from='client.54796 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:09:06.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:09:06 gibba015 bash[30343]: cluster 2021-03-10T14:09:05.778758+0000 mgr.gibba045.orlgmj (mgr.34412) 1112 : cluster [DBG] pgmap v621: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:06.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:09:06 gibba015 bash[30343]: audit 2021-03-10T14:09:06.155077+0000 mgr.gibba045.orlgmj (mgr.34412) 1113 : audit [DBG] from='client.54796 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:09:07.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:09:07 gibba045 bash[25517]: audit 2021-03-10T14:09:06.382448+0000 mgr.gibba045.orlgmj (mgr.34412) 1114 : audit [DBG] from='client.54802 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:09:07.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:09:07 gibba045 bash[25517]: audit 2021-03-10T14:09:06.638964+0000 mon.a (mon.0) 701 : audit [DBG] from='client.? 172.21.2.115:0/3314729140' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:09:07.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:09:07 gibba015 bash[29377]: audit 2021-03-10T14:09:06.382448+0000 mgr.gibba045.orlgmj (mgr.34412) 1114 : audit [DBG] from='client.54802 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:09:07.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:09:07 gibba015 bash[29377]: audit 2021-03-10T14:09:06.638964+0000 mon.a (mon.0) 701 : audit [DBG] from='client.? 172.21.2.115:0/3314729140' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:09:07.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:09:07 gibba015 bash[30343]: audit 2021-03-10T14:09:06.382448+0000 mgr.gibba045.orlgmj (mgr.34412) 1114 : audit [DBG] from='client.54802 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:09:07.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:09:07 gibba015 bash[30343]: audit 2021-03-10T14:09:06.638964+0000 mon.a (mon.0) 701 : audit [DBG] from='client.? 172.21.2.115:0/3314729140' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:09:08.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:09:08 gibba045 bash[25517]: cluster 2021-03-10T14:09:07.779265+0000 mgr.gibba045.orlgmj (mgr.34412) 1115 : cluster [DBG] pgmap v622: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:08.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:09:08 gibba015 bash[29377]: cluster 2021-03-10T14:09:07.779265+0000 mgr.gibba045.orlgmj (mgr.34412) 1115 : cluster [DBG] pgmap v622: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:08.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:09:08 gibba015 bash[30343]: cluster 2021-03-10T14:09:07.779265+0000 mgr.gibba045.orlgmj (mgr.34412) 1115 : cluster [DBG] pgmap v622: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:11.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:09:10 gibba015 bash[29377]: cluster 2021-03-10T14:09:09.780971+0000 mgr.gibba045.orlgmj (mgr.34412) 1116 : cluster [DBG] pgmap v623: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:11.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:09:10 gibba015 bash[30343]: cluster 2021-03-10T14:09:09.780971+0000 mgr.gibba045.orlgmj (mgr.34412) 1116 : cluster [DBG] pgmap v623: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:11.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:09:10 gibba045 bash[25517]: cluster 2021-03-10T14:09:09.780971+0000 mgr.gibba045.orlgmj (mgr.34412) 1116 : cluster [DBG] pgmap v623: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:13.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:09:12 gibba015 bash[29377]: cluster 2021-03-10T14:09:11.782501+0000 mgr.gibba045.orlgmj (mgr.34412) 1117 : cluster [DBG] pgmap v624: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:13.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:09:12 gibba015 bash[30343]: cluster 2021-03-10T14:09:11.782501+0000 mgr.gibba045.orlgmj (mgr.34412) 1117 : cluster [DBG] pgmap v624: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:13.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:09:12 gibba045 bash[25517]: cluster 2021-03-10T14:09:11.782501+0000 mgr.gibba045.orlgmj (mgr.34412) 1117 : cluster [DBG] pgmap v624: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:15.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:09:14 gibba015 bash[29377]: cluster 2021-03-10T14:09:13.783848+0000 mgr.gibba045.orlgmj (mgr.34412) 1118 : cluster [DBG] pgmap v625: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:15.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:09:14 gibba015 bash[29377]: audit 2021-03-10T14:09:14.016028+0000 mon.c (mon.1) 374 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:09:15.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:09:14 gibba015 bash[29377]: cephadm 2021-03-10T14:09:14.022297+0000 mgr.gibba045.orlgmj (mgr.34412) 1119 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:09:15.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:09:14 gibba015 bash[29377]: cephadm 2021-03-10T14:09:14.024168+0000 mgr.gibba045.orlgmj (mgr.34412) 1120 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:09:15.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:09:14 gibba015 bash[29377]: audit 2021-03-10T14:09:14.244160+0000 mon.a (mon.0) 702 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:09:15.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:09:14 gibba015 bash[29377]: audit 2021-03-10T14:09:14.248050+0000 mon.c (mon.1) 375 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:09:15.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:09:14 gibba015 bash[29377]: audit 2021-03-10T14:09:14.249653+0000 mon.c (mon.1) 376 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:09:15.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:09:14 gibba015 bash[29377]: audit 2021-03-10T14:09:14.251172+0000 mon.c (mon.1) 377 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:09:15.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:09:14 gibba015 bash[29377]: audit 2021-03-10T14:09:14.252611+0000 mon.c (mon.1) 378 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:09:15.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:09:14 gibba015 bash[29377]: audit 2021-03-10T14:09:14.255757+0000 mon.c (mon.1) 379 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:09:15.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:09:14 gibba015 bash[29377]: audit 2021-03-10T14:09:14.257316+0000 mon.c (mon.1) 380 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:09:15.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:09:14 gibba015 bash[30343]: cluster 2021-03-10T14:09:13.783848+0000 mgr.gibba045.orlgmj (mgr.34412) 1118 : cluster [DBG] pgmap v625: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:15.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:09:14 gibba015 bash[30343]: audit 2021-03-10T14:09:14.016028+0000 mon.c (mon.1) 374 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:09:15.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:09:14 gibba015 bash[30343]: cephadm 2021-03-10T14:09:14.022297+0000 mgr.gibba045.orlgmj (mgr.34412) 1119 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:09:15.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:09:14 gibba015 bash[30343]: cephadm 2021-03-10T14:09:14.024168+0000 mgr.gibba045.orlgmj (mgr.34412) 1120 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:09:15.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:09:14 gibba015 bash[30343]: audit 2021-03-10T14:09:14.244160+0000 mon.a (mon.0) 702 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:09:15.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:09:14 gibba015 bash[30343]: audit 2021-03-10T14:09:14.248050+0000 mon.c (mon.1) 375 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:09:15.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:09:14 gibba015 bash[30343]: audit 2021-03-10T14:09:14.249653+0000 mon.c (mon.1) 376 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:09:15.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:09:14 gibba015 bash[30343]: audit 2021-03-10T14:09:14.251172+0000 mon.c (mon.1) 377 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:09:15.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:09:14 gibba015 bash[30343]: audit 2021-03-10T14:09:14.252611+0000 mon.c (mon.1) 378 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:09:15.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:09:14 gibba015 bash[30343]: audit 2021-03-10T14:09:14.255757+0000 mon.c (mon.1) 379 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:09:15.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:09:14 gibba015 bash[30343]: audit 2021-03-10T14:09:14.257316+0000 mon.c (mon.1) 380 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:09:15.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:09:14 gibba045 bash[25517]: cluster 2021-03-10T14:09:13.783848+0000 mgr.gibba045.orlgmj (mgr.34412) 1118 : cluster [DBG] pgmap v625: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:15.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:09:14 gibba045 bash[25517]: audit 2021-03-10T14:09:14.016028+0000 mon.c (mon.1) 374 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:09:15.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:09:14 gibba045 bash[25517]: cephadm 2021-03-10T14:09:14.022297+0000 mgr.gibba045.orlgmj (mgr.34412) 1119 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:09:15.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:09:14 gibba045 bash[25517]: cephadm 2021-03-10T14:09:14.024168+0000 mgr.gibba045.orlgmj (mgr.34412) 1120 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:09:15.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:09:14 gibba045 bash[25517]: audit 2021-03-10T14:09:14.244160+0000 mon.a (mon.0) 702 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:09:15.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:09:14 gibba045 bash[25517]: audit 2021-03-10T14:09:14.248050+0000 mon.c (mon.1) 375 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:09:15.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:09:14 gibba045 bash[25517]: audit 2021-03-10T14:09:14.249653+0000 mon.c (mon.1) 376 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:09:15.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:09:14 gibba045 bash[25517]: audit 2021-03-10T14:09:14.251172+0000 mon.c (mon.1) 377 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:09:15.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:09:14 gibba045 bash[25517]: audit 2021-03-10T14:09:14.252611+0000 mon.c (mon.1) 378 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:09:15.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:09:14 gibba045 bash[25517]: audit 2021-03-10T14:09:14.255757+0000 mon.c (mon.1) 379 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:09:15.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:09:14 gibba045 bash[25517]: audit 2021-03-10T14:09:14.257316+0000 mon.c (mon.1) 380 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:09:16.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:09:15 gibba015 bash[29377]: cephadm 2021-03-10T14:09:14.248908+0000 mgr.gibba045.orlgmj (mgr.34412) 1121 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:09:16.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:09:15 gibba015 bash[29377]: cephadm 2021-03-10T14:09:14.251049+0000 mgr.gibba045.orlgmj (mgr.34412) 1122 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:09:16.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:09:15 gibba015 bash[29377]: cephadm 2021-03-10T14:09:14.252463+0000 mgr.gibba045.orlgmj (mgr.34412) 1123 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:09:16.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:09:15 gibba015 bash[29377]: cephadm 2021-03-10T14:09:14.252538+0000 mgr.gibba045.orlgmj (mgr.34412) 1124 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:09:16.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:09:15 gibba015 bash[29377]: cephadm 2021-03-10T14:09:14.253991+0000 mgr.gibba045.orlgmj (mgr.34412) 1125 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:09:16.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:09:15 gibba015 bash[29377]: cephadm 2021-03-10T14:09:14.254055+0000 mgr.gibba045.orlgmj (mgr.34412) 1126 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:09:16.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:09:15 gibba015 bash[29377]: cephadm 2021-03-10T14:09:14.255390+0000 mgr.gibba045.orlgmj (mgr.34412) 1127 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:09:16.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:09:15 gibba015 bash[29377]: cephadm 2021-03-10T14:09:14.257002+0000 mgr.gibba045.orlgmj (mgr.34412) 1128 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:09:16.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:09:15 gibba015 bash[29377]: cephadm 2021-03-10T14:09:14.257087+0000 mgr.gibba045.orlgmj (mgr.34412) 1129 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:09:16.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:09:15 gibba015 bash[29377]: cephadm 2021-03-10T14:09:14.258500+0000 mgr.gibba045.orlgmj (mgr.34412) 1130 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:09:16.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:09:15 gibba015 bash[29377]: cephadm 2021-03-10T14:09:14.258882+0000 mgr.gibba045.orlgmj (mgr.34412) 1131 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:09:16.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:09:15 gibba015 bash[29377]: cephadm 2021-03-10T14:09:14.260046+0000 mgr.gibba045.orlgmj (mgr.34412) 1132 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:09:16.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:09:15 gibba015 bash[29377]: cephadm 2021-03-10T14:09:14.260116+0000 mgr.gibba045.orlgmj (mgr.34412) 1133 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:09:16.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:09:15 gibba015 bash[29377]: cephadm 2021-03-10T14:09:14.260276+0000 mgr.gibba045.orlgmj (mgr.34412) 1134 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:09:16.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:09:15 gibba015 bash[30343]: cephadm 2021-03-10T14:09:14.248908+0000 mgr.gibba045.orlgmj (mgr.34412) 1121 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:09:16.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:09:15 gibba015 bash[30343]: cephadm 2021-03-10T14:09:14.251049+0000 mgr.gibba045.orlgmj (mgr.34412) 1122 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:09:16.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:09:15 gibba015 bash[30343]: cephadm 2021-03-10T14:09:14.252463+0000 mgr.gibba045.orlgmj (mgr.34412) 1123 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:09:16.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:09:15 gibba015 bash[30343]: cephadm 2021-03-10T14:09:14.252538+0000 mgr.gibba045.orlgmj (mgr.34412) 1124 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:09:16.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:09:15 gibba015 bash[30343]: cephadm 2021-03-10T14:09:14.253991+0000 mgr.gibba045.orlgmj (mgr.34412) 1125 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:09:16.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:09:15 gibba015 bash[30343]: cephadm 2021-03-10T14:09:14.254055+0000 mgr.gibba045.orlgmj (mgr.34412) 1126 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:09:16.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:09:15 gibba015 bash[30343]: cephadm 2021-03-10T14:09:14.255390+0000 mgr.gibba045.orlgmj (mgr.34412) 1127 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:09:16.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:09:15 gibba015 bash[30343]: cephadm 2021-03-10T14:09:14.257002+0000 mgr.gibba045.orlgmj (mgr.34412) 1128 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:09:16.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:09:15 gibba015 bash[30343]: cephadm 2021-03-10T14:09:14.257087+0000 mgr.gibba045.orlgmj (mgr.34412) 1129 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:09:16.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:09:15 gibba015 bash[30343]: cephadm 2021-03-10T14:09:14.258500+0000 mgr.gibba045.orlgmj (mgr.34412) 1130 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:09:16.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:09:15 gibba015 bash[30343]: cephadm 2021-03-10T14:09:14.258882+0000 mgr.gibba045.orlgmj (mgr.34412) 1131 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:09:16.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:09:15 gibba015 bash[30343]: cephadm 2021-03-10T14:09:14.260046+0000 mgr.gibba045.orlgmj (mgr.34412) 1132 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:09:16.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:09:15 gibba015 bash[30343]: cephadm 2021-03-10T14:09:14.260116+0000 mgr.gibba045.orlgmj (mgr.34412) 1133 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:09:16.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:09:15 gibba015 bash[30343]: cephadm 2021-03-10T14:09:14.260276+0000 mgr.gibba045.orlgmj (mgr.34412) 1134 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:09:16.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:09:15 gibba045 bash[25517]: cephadm 2021-03-10T14:09:14.248908+0000 mgr.gibba045.orlgmj (mgr.34412) 1121 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:09:16.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:09:15 gibba045 bash[25517]: cephadm 2021-03-10T14:09:14.251049+0000 mgr.gibba045.orlgmj (mgr.34412) 1122 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:09:16.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:09:15 gibba045 bash[25517]: cephadm 2021-03-10T14:09:14.252463+0000 mgr.gibba045.orlgmj (mgr.34412) 1123 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:09:16.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:09:15 gibba045 bash[25517]: cephadm 2021-03-10T14:09:14.252538+0000 mgr.gibba045.orlgmj (mgr.34412) 1124 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:09:16.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:09:15 gibba045 bash[25517]: cephadm 2021-03-10T14:09:14.253991+0000 mgr.gibba045.orlgmj (mgr.34412) 1125 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:09:16.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:09:15 gibba045 bash[25517]: cephadm 2021-03-10T14:09:14.254055+0000 mgr.gibba045.orlgmj (mgr.34412) 1126 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:09:16.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:09:15 gibba045 bash[25517]: cephadm 2021-03-10T14:09:14.255390+0000 mgr.gibba045.orlgmj (mgr.34412) 1127 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:09:16.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:09:15 gibba045 bash[25517]: cephadm 2021-03-10T14:09:14.257002+0000 mgr.gibba045.orlgmj (mgr.34412) 1128 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:09:16.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:09:15 gibba045 bash[25517]: cephadm 2021-03-10T14:09:14.257087+0000 mgr.gibba045.orlgmj (mgr.34412) 1129 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:09:16.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:09:15 gibba045 bash[25517]: cephadm 2021-03-10T14:09:14.258500+0000 mgr.gibba045.orlgmj (mgr.34412) 1130 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:09:16.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:09:15 gibba045 bash[25517]: cephadm 2021-03-10T14:09:14.258882+0000 mgr.gibba045.orlgmj (mgr.34412) 1131 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:09:16.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:09:15 gibba045 bash[25517]: cephadm 2021-03-10T14:09:14.260046+0000 mgr.gibba045.orlgmj (mgr.34412) 1132 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:09:16.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:09:15 gibba045 bash[25517]: cephadm 2021-03-10T14:09:14.260116+0000 mgr.gibba045.orlgmj (mgr.34412) 1133 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:09:16.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:09:15 gibba045 bash[25517]: cephadm 2021-03-10T14:09:14.260276+0000 mgr.gibba045.orlgmj (mgr.34412) 1134 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:09:17.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:09:16 gibba015 bash[29377]: cluster 2021-03-10T14:09:15.785500+0000 mgr.gibba045.orlgmj (mgr.34412) 1135 : cluster [DBG] pgmap v626: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:17.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:09:16 gibba015 bash[30343]: cluster 2021-03-10T14:09:15.785500+0000 mgr.gibba045.orlgmj (mgr.34412) 1135 : cluster [DBG] pgmap v626: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:17.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:09:16 gibba045 bash[25517]: cluster 2021-03-10T14:09:15.785500+0000 mgr.gibba045.orlgmj (mgr.34412) 1135 : cluster [DBG] pgmap v626: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:19.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:09:18 gibba015 bash[29377]: cluster 2021-03-10T14:09:17.787138+0000 mgr.gibba045.orlgmj (mgr.34412) 1136 : cluster [DBG] pgmap v627: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:19.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:09:18 gibba015 bash[30343]: cluster 2021-03-10T14:09:17.787138+0000 mgr.gibba045.orlgmj (mgr.34412) 1136 : cluster [DBG] pgmap v627: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:19.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:09:18 gibba045 bash[25517]: cluster 2021-03-10T14:09:17.787138+0000 mgr.gibba045.orlgmj (mgr.34412) 1136 : cluster [DBG] pgmap v627: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:21.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:09:20 gibba015 bash[29377]: cluster 2021-03-10T14:09:19.788992+0000 mgr.gibba045.orlgmj (mgr.34412) 1137 : cluster [DBG] pgmap v628: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:21.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:09:20 gibba015 bash[30343]: cluster 2021-03-10T14:09:19.788992+0000 mgr.gibba045.orlgmj (mgr.34412) 1137 : cluster [DBG] pgmap v628: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:21.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:09:20 gibba045 bash[25517]: cluster 2021-03-10T14:09:19.788992+0000 mgr.gibba045.orlgmj (mgr.34412) 1137 : cluster [DBG] pgmap v628: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:23.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:09:22 gibba015 bash[29377]: cluster 2021-03-10T14:09:21.790772+0000 mgr.gibba045.orlgmj (mgr.34412) 1138 : cluster [DBG] pgmap v629: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:23.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:09:22 gibba015 bash[30343]: cluster 2021-03-10T14:09:21.790772+0000 mgr.gibba045.orlgmj (mgr.34412) 1138 : cluster [DBG] pgmap v629: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:23.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:09:22 gibba045 bash[25517]: cluster 2021-03-10T14:09:21.790772+0000 mgr.gibba045.orlgmj (mgr.34412) 1138 : cluster [DBG] pgmap v629: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:25.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:09:24 gibba015 bash[29377]: cluster 2021-03-10T14:09:23.792244+0000 mgr.gibba045.orlgmj (mgr.34412) 1139 : cluster [DBG] pgmap v630: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:25.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:09:24 gibba015 bash[30343]: cluster 2021-03-10T14:09:23.792244+0000 mgr.gibba045.orlgmj (mgr.34412) 1139 : cluster [DBG] pgmap v630: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:25.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:09:24 gibba045 bash[25517]: cluster 2021-03-10T14:09:23.792244+0000 mgr.gibba045.orlgmj (mgr.34412) 1139 : cluster [DBG] pgmap v630: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:27.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:09:26 gibba015 bash[29377]: cluster 2021-03-10T14:09:25.794127+0000 mgr.gibba045.orlgmj (mgr.34412) 1140 : cluster [DBG] pgmap v631: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:27.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:09:26 gibba015 bash[30343]: cluster 2021-03-10T14:09:25.794127+0000 mgr.gibba045.orlgmj (mgr.34412) 1140 : cluster [DBG] pgmap v631: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:27.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:09:26 gibba045 bash[25517]: cluster 2021-03-10T14:09:25.794127+0000 mgr.gibba045.orlgmj (mgr.34412) 1140 : cluster [DBG] pgmap v631: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:29.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:09:28 gibba015 bash[29377]: cluster 2021-03-10T14:09:27.795911+0000 mgr.gibba045.orlgmj (mgr.34412) 1141 : cluster [DBG] pgmap v632: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:29.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:09:28 gibba015 bash[30343]: cluster 2021-03-10T14:09:27.795911+0000 mgr.gibba045.orlgmj (mgr.34412) 1141 : cluster [DBG] pgmap v632: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:29.268 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:09:28 gibba045 bash[25517]: cluster 2021-03-10T14:09:27.795911+0000 mgr.gibba045.orlgmj (mgr.34412) 1141 : cluster [DBG] pgmap v632: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:31.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:09:30 gibba045 bash[25517]: cephadm 2021-03-10T14:09:29.267855+0000 mgr.gibba045.orlgmj (mgr.34412) 1142 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:09:31.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:09:30 gibba045 bash[25517]: cluster 2021-03-10T14:09:29.797652+0000 mgr.gibba045.orlgmj (mgr.34412) 1143 : cluster [DBG] pgmap v633: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:31.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:09:30 gibba015 bash[29377]: cephadm 2021-03-10T14:09:29.267855+0000 mgr.gibba045.orlgmj (mgr.34412) 1142 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:09:31.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:09:30 gibba015 bash[29377]: cluster 2021-03-10T14:09:29.797652+0000 mgr.gibba045.orlgmj (mgr.34412) 1143 : cluster [DBG] pgmap v633: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:31.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:09:30 gibba015 bash[30343]: cephadm 2021-03-10T14:09:29.267855+0000 mgr.gibba045.orlgmj (mgr.34412) 1142 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:09:31.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:09:30 gibba015 bash[30343]: cluster 2021-03-10T14:09:29.797652+0000 mgr.gibba045.orlgmj (mgr.34412) 1143 : cluster [DBG] pgmap v633: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:33.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:09:32 gibba045 bash[25517]: cluster 2021-03-10T14:09:31.799441+0000 mgr.gibba045.orlgmj (mgr.34412) 1144 : cluster [DBG] pgmap v634: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:33.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:09:32 gibba015 bash[29377]: cluster 2021-03-10T14:09:31.799441+0000 mgr.gibba045.orlgmj (mgr.34412) 1144 : cluster [DBG] pgmap v634: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:33.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:09:32 gibba015 bash[30343]: cluster 2021-03-10T14:09:31.799441+0000 mgr.gibba045.orlgmj (mgr.34412) 1144 : cluster [DBG] pgmap v634: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:35.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:09:34 gibba045 bash[25517]: cluster 2021-03-10T14:09:33.799900+0000 mgr.gibba045.orlgmj (mgr.34412) 1145 : cluster [DBG] pgmap v635: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:35.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:09:34 gibba015 bash[29377]: cluster 2021-03-10T14:09:33.799900+0000 mgr.gibba045.orlgmj (mgr.34412) 1145 : cluster [DBG] pgmap v635: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:35.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:09:34 gibba015 bash[30343]: cluster 2021-03-10T14:09:33.799900+0000 mgr.gibba045.orlgmj (mgr.34412) 1145 : cluster [DBG] pgmap v635: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:36.881 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:09:37.112 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:09:37.113 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (20m) 6m ago 25m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:09:37.113 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (25m) 5m ago 25m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:09:37.113 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (20m) 5m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:09:37.113 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (21m) 5m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:09:37.113 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (20m) 6m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:09:37.114 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (19m) 6m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:09:37.114 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (19m) 5m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:09:37.114 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (19m) 6m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:09:37.114 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (25m) 6m ago 25m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:09:37.115 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (25m) 5m ago 25m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:09:37.115 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (18m) 6m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:09:37.115 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (18m) 6m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:09:37.115 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (17m) 6m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:09:37.115 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (17m) 6m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:09:37.116 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (16m) 5m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:09:37.116 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (16m) 5m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:09:37.116 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (16m) 5m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:09:37.116 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (15m) 5m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:09:37.117 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (25m) 5m ago 25m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:09:37.117 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 5m ago 23m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:09:37.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:09:37 gibba045 bash[25517]: cluster 2021-03-10T14:09:35.801526+0000 mgr.gibba045.orlgmj (mgr.34412) 1146 : cluster [DBG] pgmap v636: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:37.361 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:09:37.361 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:09:37.361 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:09:37.361 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:09:37.362 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:09:37.362 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:09:37.362 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:09:37.362 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:09:37.362 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:09:37.363 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:09:37.363 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:09:37.363 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:09:37.363 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:09:37.364 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:09:37.364 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:09:37.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:09:37 gibba015 bash[29377]: cluster 2021-03-10T14:09:35.801526+0000 mgr.gibba045.orlgmj (mgr.34412) 1146 : cluster [DBG] pgmap v636: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:37.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:09:37 gibba015 bash[30343]: cluster 2021-03-10T14:09:35.801526+0000 mgr.gibba045.orlgmj (mgr.34412) 1146 : cluster [DBG] pgmap v636: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:38.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:09:38 gibba045 bash[25517]: audit 2021-03-10T14:09:36.872325+0000 mgr.gibba045.orlgmj (mgr.34412) 1147 : audit [DBG] from='client.44826 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:09:38.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:09:38 gibba045 bash[25517]: audit 2021-03-10T14:09:37.100337+0000 mgr.gibba045.orlgmj (mgr.34412) 1148 : audit [DBG] from='client.54820 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:09:38.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:09:38 gibba045 bash[25517]: audit 2021-03-10T14:09:37.359213+0000 mon.a (mon.0) 703 : audit [DBG] from='client.? 172.21.2.115:0/1302961038' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:09:38.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:09:38 gibba015 bash[29377]: audit 2021-03-10T14:09:36.872325+0000 mgr.gibba045.orlgmj (mgr.34412) 1147 : audit [DBG] from='client.44826 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:09:38.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:09:38 gibba015 bash[29377]: audit 2021-03-10T14:09:37.100337+0000 mgr.gibba045.orlgmj (mgr.34412) 1148 : audit [DBG] from='client.54820 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:09:38.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:09:38 gibba015 bash[29377]: audit 2021-03-10T14:09:37.359213+0000 mon.a (mon.0) 703 : audit [DBG] from='client.? 172.21.2.115:0/1302961038' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:09:38.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:09:38 gibba015 bash[30343]: audit 2021-03-10T14:09:36.872325+0000 mgr.gibba045.orlgmj (mgr.34412) 1147 : audit [DBG] from='client.44826 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:09:38.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:09:38 gibba015 bash[30343]: audit 2021-03-10T14:09:37.100337+0000 mgr.gibba045.orlgmj (mgr.34412) 1148 : audit [DBG] from='client.54820 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:09:38.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:09:38 gibba015 bash[30343]: audit 2021-03-10T14:09:37.359213+0000 mon.a (mon.0) 703 : audit [DBG] from='client.? 172.21.2.115:0/1302961038' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:09:39.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:09:39 gibba045 bash[25517]: cluster 2021-03-10T14:09:37.803191+0000 mgr.gibba045.orlgmj (mgr.34412) 1149 : cluster [DBG] pgmap v637: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:39.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:09:39 gibba015 bash[29377]: cluster 2021-03-10T14:09:37.803191+0000 mgr.gibba045.orlgmj (mgr.34412) 1149 : cluster [DBG] pgmap v637: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:39.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:09:39 gibba015 bash[30343]: cluster 2021-03-10T14:09:37.803191+0000 mgr.gibba045.orlgmj (mgr.34412) 1149 : cluster [DBG] pgmap v637: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:41.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:09:41 gibba045 bash[25517]: cluster 2021-03-10T14:09:39.804185+0000 mgr.gibba045.orlgmj (mgr.34412) 1150 : cluster [DBG] pgmap v638: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:41.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:09:41 gibba015 bash[29377]: cluster 2021-03-10T14:09:39.804185+0000 mgr.gibba045.orlgmj (mgr.34412) 1150 : cluster [DBG] pgmap v638: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:41.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:09:41 gibba015 bash[30343]: cluster 2021-03-10T14:09:39.804185+0000 mgr.gibba045.orlgmj (mgr.34412) 1150 : cluster [DBG] pgmap v638: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:43.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:09:43 gibba045 bash[25517]: cluster 2021-03-10T14:09:41.805826+0000 mgr.gibba045.orlgmj (mgr.34412) 1151 : cluster [DBG] pgmap v639: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:43.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:09:43 gibba015 bash[29377]: cluster 2021-03-10T14:09:41.805826+0000 mgr.gibba045.orlgmj (mgr.34412) 1151 : cluster [DBG] pgmap v639: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:43.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:09:43 gibba015 bash[30343]: cluster 2021-03-10T14:09:41.805826+0000 mgr.gibba045.orlgmj (mgr.34412) 1151 : cluster [DBG] pgmap v639: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:45.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:09:45 gibba045 bash[25517]: cluster 2021-03-10T14:09:43.806350+0000 mgr.gibba045.orlgmj (mgr.34412) 1152 : cluster [DBG] pgmap v640: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:45.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:09:45 gibba015 bash[29377]: cluster 2021-03-10T14:09:43.806350+0000 mgr.gibba045.orlgmj (mgr.34412) 1152 : cluster [DBG] pgmap v640: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:45.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:09:45 gibba015 bash[30343]: cluster 2021-03-10T14:09:43.806350+0000 mgr.gibba045.orlgmj (mgr.34412) 1152 : cluster [DBG] pgmap v640: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:46.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:09:46 gibba015 bash[29377]: cephadm 2021-03-10T14:09:44.283974+0000 mgr.gibba045.orlgmj (mgr.34412) 1153 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:09:46.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:09:46 gibba015 bash[30343]: cephadm 2021-03-10T14:09:44.283974+0000 mgr.gibba045.orlgmj (mgr.34412) 1153 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:09:46.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:09:46 gibba045 bash[25517]: cephadm 2021-03-10T14:09:44.283974+0000 mgr.gibba045.orlgmj (mgr.34412) 1153 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:09:47.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:09:47 gibba015 bash[29377]: cluster 2021-03-10T14:09:45.807684+0000 mgr.gibba045.orlgmj (mgr.34412) 1154 : cluster [DBG] pgmap v641: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:47.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:09:47 gibba015 bash[30343]: cluster 2021-03-10T14:09:45.807684+0000 mgr.gibba045.orlgmj (mgr.34412) 1154 : cluster [DBG] pgmap v641: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:47.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:09:47 gibba045 bash[25517]: cluster 2021-03-10T14:09:45.807684+0000 mgr.gibba045.orlgmj (mgr.34412) 1154 : cluster [DBG] pgmap v641: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:49.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:09:49 gibba015 bash[29377]: cluster 2021-03-10T14:09:47.808494+0000 mgr.gibba045.orlgmj (mgr.34412) 1155 : cluster [DBG] pgmap v642: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:49.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:09:49 gibba015 bash[30343]: cluster 2021-03-10T14:09:47.808494+0000 mgr.gibba045.orlgmj (mgr.34412) 1155 : cluster [DBG] pgmap v642: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:49.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:09:49 gibba045 bash[25517]: cluster 2021-03-10T14:09:47.808494+0000 mgr.gibba045.orlgmj (mgr.34412) 1155 : cluster [DBG] pgmap v642: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:51.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:09:51 gibba015 bash[29377]: cluster 2021-03-10T14:09:49.810063+0000 mgr.gibba045.orlgmj (mgr.34412) 1156 : cluster [DBG] pgmap v643: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:51.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:09:51 gibba015 bash[30343]: cluster 2021-03-10T14:09:49.810063+0000 mgr.gibba045.orlgmj (mgr.34412) 1156 : cluster [DBG] pgmap v643: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:51.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:09:51 gibba045 bash[25517]: cluster 2021-03-10T14:09:49.810063+0000 mgr.gibba045.orlgmj (mgr.34412) 1156 : cluster [DBG] pgmap v643: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:53.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:09:53 gibba015 bash[29377]: cluster 2021-03-10T14:09:51.811667+0000 mgr.gibba045.orlgmj (mgr.34412) 1157 : cluster [DBG] pgmap v644: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:53.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:09:53 gibba015 bash[29377]: audit 2021-03-10T14:09:52.539667+0000 mon.c (mon.1) 381 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T14:09:53.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:09:53 gibba015 bash[29377]: audit 2021-03-10T14:09:52.540396+0000 mon.c (mon.1) 382 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T14:09:53.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:09:53 gibba015 bash[29377]: audit 2021-03-10T14:09:52.540871+0000 mon.a (mon.0) 704 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T14:09:53.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:09:53 gibba015 bash[29377]: audit 2021-03-10T14:09:52.541097+0000 mon.c (mon.1) 383 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:09:53.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:09:53 gibba015 bash[29377]: audit 2021-03-10T14:09:52.541773+0000 mon.c (mon.1) 384 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:09:53.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:09:53 gibba015 bash[29377]: audit 2021-03-10T14:09:52.542304+0000 mon.a (mon.0) 705 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T14:09:53.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:09:53 gibba015 bash[29377]: audit 2021-03-10T14:09:52.543597+0000 mon.a (mon.0) 706 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:09:53.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:09:53 gibba015 bash[29377]: audit 2021-03-10T14:09:52.544512+0000 mon.a (mon.0) 707 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:09:53.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:09:53 gibba015 bash[29377]: audit 2021-03-10T14:09:52.585700+0000 mon.c (mon.1) 385 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:09:53.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:09:53 gibba015 bash[29377]: audit 2021-03-10T14:09:52.586350+0000 mon.c (mon.1) 386 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:09:53.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:09:53 gibba015 bash[29377]: audit 2021-03-10T14:09:52.586835+0000 mon.a (mon.0) 708 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:09:53.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:09:53 gibba015 bash[29377]: audit 2021-03-10T14:09:52.587973+0000 mon.a (mon.0) 709 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:09:53.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:09:53 gibba015 bash[30343]: cluster 2021-03-10T14:09:51.811667+0000 mgr.gibba045.orlgmj (mgr.34412) 1157 : cluster [DBG] pgmap v644: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:53.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:09:53 gibba015 bash[30343]: audit 2021-03-10T14:09:52.539667+0000 mon.c (mon.1) 381 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T14:09:53.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:09:53 gibba015 bash[30343]: audit 2021-03-10T14:09:52.540396+0000 mon.c (mon.1) 382 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T14:09:53.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:09:53 gibba015 bash[30343]: audit 2021-03-10T14:09:52.540871+0000 mon.a (mon.0) 704 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T14:09:53.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:09:53 gibba015 bash[30343]: audit 2021-03-10T14:09:52.541097+0000 mon.c (mon.1) 383 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:09:53.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:09:53 gibba015 bash[30343]: audit 2021-03-10T14:09:52.541773+0000 mon.c (mon.1) 384 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:09:53.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:09:53 gibba015 bash[30343]: audit 2021-03-10T14:09:52.542304+0000 mon.a (mon.0) 705 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T14:09:53.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:09:53 gibba015 bash[30343]: audit 2021-03-10T14:09:52.543597+0000 mon.a (mon.0) 706 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:09:53.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:09:53 gibba015 bash[30343]: audit 2021-03-10T14:09:52.544512+0000 mon.a (mon.0) 707 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:09:53.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:09:53 gibba015 bash[30343]: audit 2021-03-10T14:09:52.585700+0000 mon.c (mon.1) 385 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:09:53.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:09:53 gibba015 bash[30343]: audit 2021-03-10T14:09:52.586350+0000 mon.c (mon.1) 386 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:09:53.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:09:53 gibba015 bash[30343]: audit 2021-03-10T14:09:52.586835+0000 mon.a (mon.0) 708 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:09:53.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:09:53 gibba015 bash[30343]: audit 2021-03-10T14:09:52.587973+0000 mon.a (mon.0) 709 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:09:53.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:09:53 gibba045 bash[25517]: cluster 2021-03-10T14:09:51.811667+0000 mgr.gibba045.orlgmj (mgr.34412) 1157 : cluster [DBG] pgmap v644: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:53.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:09:53 gibba045 bash[25517]: audit 2021-03-10T14:09:52.539667+0000 mon.c (mon.1) 381 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T14:09:53.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:09:53 gibba045 bash[25517]: audit 2021-03-10T14:09:52.540396+0000 mon.c (mon.1) 382 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T14:09:53.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:09:53 gibba045 bash[25517]: audit 2021-03-10T14:09:52.540871+0000 mon.a (mon.0) 704 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T14:09:53.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:09:53 gibba045 bash[25517]: audit 2021-03-10T14:09:52.541097+0000 mon.c (mon.1) 383 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:09:53.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:09:53 gibba045 bash[25517]: audit 2021-03-10T14:09:52.541773+0000 mon.c (mon.1) 384 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:09:53.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:09:53 gibba045 bash[25517]: audit 2021-03-10T14:09:52.542304+0000 mon.a (mon.0) 705 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T14:09:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:09:53 gibba045 bash[25517]: audit 2021-03-10T14:09:52.543597+0000 mon.a (mon.0) 706 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:09:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:09:53 gibba045 bash[25517]: audit 2021-03-10T14:09:52.544512+0000 mon.a (mon.0) 707 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:09:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:09:53 gibba045 bash[25517]: audit 2021-03-10T14:09:52.585700+0000 mon.c (mon.1) 385 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:09:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:09:53 gibba045 bash[25517]: audit 2021-03-10T14:09:52.586350+0000 mon.c (mon.1) 386 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:09:53.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:09:53 gibba045 bash[25517]: audit 2021-03-10T14:09:52.586835+0000 mon.a (mon.0) 708 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:09:53.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:09:53 gibba045 bash[25517]: audit 2021-03-10T14:09:52.587973+0000 mon.a (mon.0) 709 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:09:55.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:09:55 gibba015 bash[29377]: cluster 2021-03-10T14:09:53.812894+0000 mgr.gibba045.orlgmj (mgr.34412) 1158 : cluster [DBG] pgmap v645: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:55.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:09:55 gibba015 bash[30343]: cluster 2021-03-10T14:09:53.812894+0000 mgr.gibba045.orlgmj (mgr.34412) 1158 : cluster [DBG] pgmap v645: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:55.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:09:55 gibba045 bash[25517]: cluster 2021-03-10T14:09:53.812894+0000 mgr.gibba045.orlgmj (mgr.34412) 1158 : cluster [DBG] pgmap v645: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:57.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:09:57 gibba015 bash[29377]: cluster 2021-03-10T14:09:55.814472+0000 mgr.gibba045.orlgmj (mgr.34412) 1159 : cluster [DBG] pgmap v646: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:57.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:09:57 gibba015 bash[30343]: cluster 2021-03-10T14:09:55.814472+0000 mgr.gibba045.orlgmj (mgr.34412) 1159 : cluster [DBG] pgmap v646: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:57.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:09:57 gibba045 bash[25517]: cluster 2021-03-10T14:09:55.814472+0000 mgr.gibba045.orlgmj (mgr.34412) 1159 : cluster [DBG] pgmap v646: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:59.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:09:59 gibba015 bash[29377]: cluster 2021-03-10T14:09:57.816087+0000 mgr.gibba045.orlgmj (mgr.34412) 1160 : cluster [DBG] pgmap v647: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:59.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:09:59 gibba015 bash[30343]: cluster 2021-03-10T14:09:57.816087+0000 mgr.gibba045.orlgmj (mgr.34412) 1160 : cluster [DBG] pgmap v647: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:59.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:09:59 gibba045 bash[25517]: cluster 2021-03-10T14:09:57.816087+0000 mgr.gibba045.orlgmj (mgr.34412) 1160 : cluster [DBG] pgmap v647: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:00.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:00 gibba015 bash[29377]: debug 2021-03-10T14:09:59.994+0000 7f21beb4f700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T14:10:00.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:00 gibba015 bash[29377]: cluster 2021-03-10T14:10:00.000228+0000 mon.a (mon.0) 710 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T14:10:00.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:10:00 gibba015 bash[30343]: cluster 2021-03-10T14:10:00.000228+0000 mon.a (mon.0) 710 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T14:10:00.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:10:00 gibba045 bash[25517]: cluster 2021-03-10T14:10:00.000228+0000 mon.a (mon.0) 710 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T14:10:01.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:01 gibba015 bash[29377]: cephadm 2021-03-10T14:09:59.297218+0000 mgr.gibba045.orlgmj (mgr.34412) 1161 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:10:01.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:01 gibba015 bash[29377]: cluster 2021-03-10T14:09:59.817525+0000 mgr.gibba045.orlgmj (mgr.34412) 1162 : cluster [DBG] pgmap v648: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:01.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:10:01 gibba015 bash[30343]: cephadm 2021-03-10T14:09:59.297218+0000 mgr.gibba045.orlgmj (mgr.34412) 1161 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:10:01.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:10:01 gibba015 bash[30343]: cluster 2021-03-10T14:09:59.817525+0000 mgr.gibba045.orlgmj (mgr.34412) 1162 : cluster [DBG] pgmap v648: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:01.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:10:01 gibba045 bash[25517]: cephadm 2021-03-10T14:09:59.297218+0000 mgr.gibba045.orlgmj (mgr.34412) 1161 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:10:01.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:10:01 gibba045 bash[25517]: cluster 2021-03-10T14:09:59.817525+0000 mgr.gibba045.orlgmj (mgr.34412) 1162 : cluster [DBG] pgmap v648: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:03.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:03 gibba015 bash[29377]: cluster 2021-03-10T14:10:01.819136+0000 mgr.gibba045.orlgmj (mgr.34412) 1163 : cluster [DBG] pgmap v649: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:03.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:10:03 gibba015 bash[30343]: cluster 2021-03-10T14:10:01.819136+0000 mgr.gibba045.orlgmj (mgr.34412) 1163 : cluster [DBG] pgmap v649: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:03.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:10:03 gibba045 bash[25517]: cluster 2021-03-10T14:10:01.819136+0000 mgr.gibba045.orlgmj (mgr.34412) 1163 : cluster [DBG] pgmap v649: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:05.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:05 gibba015 bash[29377]: cluster 2021-03-10T14:10:03.819605+0000 mgr.gibba045.orlgmj (mgr.34412) 1164 : cluster [DBG] pgmap v650: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:05.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:10:05 gibba015 bash[30343]: cluster 2021-03-10T14:10:03.819605+0000 mgr.gibba045.orlgmj (mgr.34412) 1164 : cluster [DBG] pgmap v650: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:05.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:10:05 gibba045 bash[25517]: cluster 2021-03-10T14:10:03.819605+0000 mgr.gibba045.orlgmj (mgr.34412) 1164 : cluster [DBG] pgmap v650: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:07.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:07 gibba015 bash[29377]: cluster 2021-03-10T14:10:05.821276+0000 mgr.gibba045.orlgmj (mgr.34412) 1165 : cluster [DBG] pgmap v651: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:07.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:10:07 gibba015 bash[30343]: cluster 2021-03-10T14:10:05.821276+0000 mgr.gibba045.orlgmj (mgr.34412) 1165 : cluster [DBG] pgmap v651: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:07.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:10:07 gibba045 bash[25517]: cluster 2021-03-10T14:10:05.821276+0000 mgr.gibba045.orlgmj (mgr.34412) 1165 : cluster [DBG] pgmap v651: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:07.607 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:10:07.834 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:10:07.834 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (20m) 6m ago 26m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:10:07.834 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (25m) 5m ago 25m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:10:07.834 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (21m) 5m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:10:07.835 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (21m) 5m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:10:07.835 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (20m) 6m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:10:07.835 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (20m) 6m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:10:07.835 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (19m) 5m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:10:07.836 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (20m) 6m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:10:07.836 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (26m) 6m ago 26m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:10:07.836 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (26m) 5m ago 26m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:10:07.836 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (19m) 6m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:10:07.836 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (18m) 6m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:10:07.837 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (18m) 6m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:10:07.837 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (17m) 6m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:10:07.837 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (17m) 5m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:10:07.837 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (17m) 5m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:10:07.838 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (16m) 5m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:10:07.838 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (16m) 5m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:10:07.838 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (25m) 5m ago 26m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:10:07.838 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 5m ago 24m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:10:08.081 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:10:08.081 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:10:08.082 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:10:08.082 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:10:08.082 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:10:08.082 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:10:08.083 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:10:08.083 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:10:08.083 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:10:08.083 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:10:08.083 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:10:08.084 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:10:08.084 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:10:08.084 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:10:08.084 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:10:08.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:08 gibba015 bash[29377]: audit 2021-03-10T14:10:08.079804+0000 mon.c (mon.1) 387 : audit [DBG] from='client.? 172.21.2.115:0/125377740' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:10:08.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:10:08 gibba015 bash[30343]: audit 2021-03-10T14:10:08.079804+0000 mon.c (mon.1) 387 : audit [DBG] from='client.? 172.21.2.115:0/125377740' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:10:08.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:10:08 gibba045 bash[25517]: audit 2021-03-10T14:10:08.079804+0000 mon.c (mon.1) 387 : audit [DBG] from='client.? 172.21.2.115:0/125377740' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:10:09.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:09 gibba015 bash[29377]: audit 2021-03-10T14:10:07.598197+0000 mgr.gibba045.orlgmj (mgr.34412) 1166 : audit [DBG] from='client.44844 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:10:09.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:09 gibba015 bash[29377]: audit 2021-03-10T14:10:07.821428+0000 mgr.gibba045.orlgmj (mgr.34412) 1167 : audit [DBG] from='client.54838 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:10:09.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:09 gibba015 bash[29377]: cluster 2021-03-10T14:10:07.822616+0000 mgr.gibba045.orlgmj (mgr.34412) 1168 : cluster [DBG] pgmap v652: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:09.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:10:09 gibba015 bash[30343]: audit 2021-03-10T14:10:07.598197+0000 mgr.gibba045.orlgmj (mgr.34412) 1166 : audit [DBG] from='client.44844 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:10:09.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:10:09 gibba015 bash[30343]: audit 2021-03-10T14:10:07.821428+0000 mgr.gibba045.orlgmj (mgr.34412) 1167 : audit [DBG] from='client.54838 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:10:09.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:10:09 gibba015 bash[30343]: cluster 2021-03-10T14:10:07.822616+0000 mgr.gibba045.orlgmj (mgr.34412) 1168 : cluster [DBG] pgmap v652: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:09.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:10:09 gibba045 bash[25517]: audit 2021-03-10T14:10:07.598197+0000 mgr.gibba045.orlgmj (mgr.34412) 1166 : audit [DBG] from='client.44844 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:10:09.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:10:09 gibba045 bash[25517]: audit 2021-03-10T14:10:07.821428+0000 mgr.gibba045.orlgmj (mgr.34412) 1167 : audit [DBG] from='client.54838 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:10:09.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:10:09 gibba045 bash[25517]: cluster 2021-03-10T14:10:07.822616+0000 mgr.gibba045.orlgmj (mgr.34412) 1168 : cluster [DBG] pgmap v652: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:11.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:11 gibba015 bash[29377]: cluster 2021-03-10T14:10:09.824298+0000 mgr.gibba045.orlgmj (mgr.34412) 1169 : cluster [DBG] pgmap v653: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:11.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:10:11 gibba015 bash[30343]: cluster 2021-03-10T14:10:09.824298+0000 mgr.gibba045.orlgmj (mgr.34412) 1169 : cluster [DBG] pgmap v653: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:11.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:10:11 gibba045 bash[25517]: cluster 2021-03-10T14:10:09.824298+0000 mgr.gibba045.orlgmj (mgr.34412) 1169 : cluster [DBG] pgmap v653: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:13.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:13 gibba015 bash[29377]: cluster 2021-03-10T14:10:11.825048+0000 mgr.gibba045.orlgmj (mgr.34412) 1170 : cluster [DBG] pgmap v654: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:13.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:10:13 gibba015 bash[30343]: cluster 2021-03-10T14:10:11.825048+0000 mgr.gibba045.orlgmj (mgr.34412) 1170 : cluster [DBG] pgmap v654: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:13.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:10:13 gibba045 bash[25517]: cluster 2021-03-10T14:10:11.825048+0000 mgr.gibba045.orlgmj (mgr.34412) 1170 : cluster [DBG] pgmap v654: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:15.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:15 gibba015 bash[29377]: cluster 2021-03-10T14:10:13.825612+0000 mgr.gibba045.orlgmj (mgr.34412) 1171 : cluster [DBG] pgmap v655: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:15.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:15 gibba015 bash[29377]: audit 2021-03-10T14:10:14.312322+0000 mon.c (mon.1) 388 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:10:15.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:15 gibba015 bash[29377]: audit 2021-03-10T14:10:14.519264+0000 mon.a (mon.0) 711 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:10:15.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:15 gibba015 bash[29377]: audit 2021-03-10T14:10:14.521766+0000 mon.a (mon.0) 712 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:10:15.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:15 gibba015 bash[29377]: audit 2021-03-10T14:10:14.713505+0000 mon.a (mon.0) 713 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:10:15.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:15 gibba015 bash[29377]: audit 2021-03-10T14:10:14.717054+0000 mon.c (mon.1) 389 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:10:15.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:15 gibba015 bash[29377]: audit 2021-03-10T14:10:14.718328+0000 mon.c (mon.1) 390 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:10:15.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:15 gibba015 bash[29377]: audit 2021-03-10T14:10:14.719602+0000 mon.c (mon.1) 391 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:10:15.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:15 gibba015 bash[29377]: audit 2021-03-10T14:10:14.720672+0000 mon.c (mon.1) 392 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:10:15.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:15 gibba015 bash[29377]: audit 2021-03-10T14:10:14.723218+0000 mon.c (mon.1) 393 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:10:15.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:15 gibba015 bash[29377]: audit 2021-03-10T14:10:14.724501+0000 mon.c (mon.1) 394 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:10:15.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:10:15 gibba015 bash[30343]: cluster 2021-03-10T14:10:13.825612+0000 mgr.gibba045.orlgmj (mgr.34412) 1171 : cluster [DBG] pgmap v655: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:15.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:10:15 gibba015 bash[30343]: audit 2021-03-10T14:10:14.312322+0000 mon.c (mon.1) 388 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:10:15.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:10:15 gibba015 bash[30343]: audit 2021-03-10T14:10:14.519264+0000 mon.a (mon.0) 711 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:10:15.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:10:15 gibba015 bash[30343]: audit 2021-03-10T14:10:14.521766+0000 mon.a (mon.0) 712 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:10:15.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:10:15 gibba015 bash[30343]: audit 2021-03-10T14:10:14.713505+0000 mon.a (mon.0) 713 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:10:15.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:10:15 gibba015 bash[30343]: audit 2021-03-10T14:10:14.717054+0000 mon.c (mon.1) 389 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:10:15.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:10:15 gibba015 bash[30343]: audit 2021-03-10T14:10:14.718328+0000 mon.c (mon.1) 390 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:10:15.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:10:15 gibba015 bash[30343]: audit 2021-03-10T14:10:14.719602+0000 mon.c (mon.1) 391 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:10:15.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:10:15 gibba015 bash[30343]: audit 2021-03-10T14:10:14.720672+0000 mon.c (mon.1) 392 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:10:15.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:10:15 gibba015 bash[30343]: audit 2021-03-10T14:10:14.723218+0000 mon.c (mon.1) 393 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:10:15.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:10:15 gibba015 bash[30343]: audit 2021-03-10T14:10:14.724501+0000 mon.c (mon.1) 394 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:10:15.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:10:15 gibba045 bash[25517]: cluster 2021-03-10T14:10:13.825612+0000 mgr.gibba045.orlgmj (mgr.34412) 1171 : cluster [DBG] pgmap v655: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:15.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:10:15 gibba045 bash[25517]: audit 2021-03-10T14:10:14.312322+0000 mon.c (mon.1) 388 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:10:15.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:10:15 gibba045 bash[25517]: audit 2021-03-10T14:10:14.519264+0000 mon.a (mon.0) 711 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:10:15.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:10:15 gibba045 bash[25517]: audit 2021-03-10T14:10:14.521766+0000 mon.a (mon.0) 712 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:10:15.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:10:15 gibba045 bash[25517]: audit 2021-03-10T14:10:14.713505+0000 mon.a (mon.0) 713 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:10:15.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:10:15 gibba045 bash[25517]: audit 2021-03-10T14:10:14.717054+0000 mon.c (mon.1) 389 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:10:15.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:10:15 gibba045 bash[25517]: audit 2021-03-10T14:10:14.718328+0000 mon.c (mon.1) 390 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:10:15.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:10:15 gibba045 bash[25517]: audit 2021-03-10T14:10:14.719602+0000 mon.c (mon.1) 391 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:10:15.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:10:15 gibba045 bash[25517]: audit 2021-03-10T14:10:14.720672+0000 mon.c (mon.1) 392 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:10:15.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:10:15 gibba045 bash[25517]: audit 2021-03-10T14:10:14.723218+0000 mon.c (mon.1) 393 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:10:15.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:10:15 gibba045 bash[25517]: audit 2021-03-10T14:10:14.724501+0000 mon.c (mon.1) 394 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:10:16.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:16 gibba015 bash[29377]: cephadm 2021-03-10T14:10:14.522037+0000 mgr.gibba045.orlgmj (mgr.34412) 1172 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:10:16.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:16 gibba015 bash[29377]: cephadm 2021-03-10T14:10:14.524917+0000 mgr.gibba045.orlgmj (mgr.34412) 1173 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:10:16.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:16 gibba015 bash[29377]: cephadm 2021-03-10T14:10:14.718242+0000 mgr.gibba045.orlgmj (mgr.34412) 1174 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:10:16.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:16 gibba015 bash[29377]: cephadm 2021-03-10T14:10:14.719798+0000 mgr.gibba045.orlgmj (mgr.34412) 1175 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:10:16.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:16 gibba015 bash[29377]: cephadm 2021-03-10T14:10:14.720930+0000 mgr.gibba045.orlgmj (mgr.34412) 1176 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:10:16.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:16 gibba015 bash[29377]: cephadm 2021-03-10T14:10:14.720968+0000 mgr.gibba045.orlgmj (mgr.34412) 1177 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:10:16.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:16 gibba015 bash[29377]: cephadm 2021-03-10T14:10:14.722197+0000 mgr.gibba045.orlgmj (mgr.34412) 1178 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:10:16.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:16 gibba015 bash[29377]: cephadm 2021-03-10T14:10:14.722237+0000 mgr.gibba045.orlgmj (mgr.34412) 1179 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:10:16.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:16 gibba015 bash[29377]: cephadm 2021-03-10T14:10:14.723141+0000 mgr.gibba045.orlgmj (mgr.34412) 1180 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:10:16.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:16 gibba015 bash[29377]: cephadm 2021-03-10T14:10:14.724538+0000 mgr.gibba045.orlgmj (mgr.34412) 1181 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:10:16.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:16 gibba015 bash[29377]: cephadm 2021-03-10T14:10:14.724574+0000 mgr.gibba045.orlgmj (mgr.34412) 1182 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:10:16.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:16 gibba015 bash[29377]: cephadm 2021-03-10T14:10:14.725776+0000 mgr.gibba045.orlgmj (mgr.34412) 1183 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:10:16.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:16 gibba015 bash[29377]: cephadm 2021-03-10T14:10:14.726093+0000 mgr.gibba045.orlgmj (mgr.34412) 1184 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:10:16.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:16 gibba015 bash[29377]: cephadm 2021-03-10T14:10:14.726997+0000 mgr.gibba045.orlgmj (mgr.34412) 1185 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:10:16.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:16 gibba015 bash[29377]: cephadm 2021-03-10T14:10:14.727037+0000 mgr.gibba045.orlgmj (mgr.34412) 1186 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:10:16.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:16 gibba015 bash[29377]: cephadm 2021-03-10T14:10:14.727144+0000 mgr.gibba045.orlgmj (mgr.34412) 1187 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:10:16.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:10:16 gibba015 bash[30343]: cephadm 2021-03-10T14:10:14.522037+0000 mgr.gibba045.orlgmj (mgr.34412) 1172 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:10:16.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:10:16 gibba015 bash[30343]: cephadm 2021-03-10T14:10:14.524917+0000 mgr.gibba045.orlgmj (mgr.34412) 1173 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:10:16.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:10:16 gibba015 bash[30343]: cephadm 2021-03-10T14:10:14.718242+0000 mgr.gibba045.orlgmj (mgr.34412) 1174 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:10:16.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:10:16 gibba015 bash[30343]: cephadm 2021-03-10T14:10:14.719798+0000 mgr.gibba045.orlgmj (mgr.34412) 1175 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:10:16.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:10:16 gibba015 bash[30343]: cephadm 2021-03-10T14:10:14.720930+0000 mgr.gibba045.orlgmj (mgr.34412) 1176 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:10:16.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:10:16 gibba015 bash[30343]: cephadm 2021-03-10T14:10:14.720968+0000 mgr.gibba045.orlgmj (mgr.34412) 1177 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:10:16.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:10:16 gibba015 bash[30343]: cephadm 2021-03-10T14:10:14.722197+0000 mgr.gibba045.orlgmj (mgr.34412) 1178 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:10:16.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:10:16 gibba015 bash[30343]: cephadm 2021-03-10T14:10:14.722237+0000 mgr.gibba045.orlgmj (mgr.34412) 1179 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:10:16.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:10:16 gibba015 bash[30343]: cephadm 2021-03-10T14:10:14.723141+0000 mgr.gibba045.orlgmj (mgr.34412) 1180 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:10:16.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:10:16 gibba015 bash[30343]: cephadm 2021-03-10T14:10:14.724538+0000 mgr.gibba045.orlgmj (mgr.34412) 1181 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:10:16.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:10:16 gibba015 bash[30343]: cephadm 2021-03-10T14:10:14.724574+0000 mgr.gibba045.orlgmj (mgr.34412) 1182 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:10:16.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:10:16 gibba015 bash[30343]: cephadm 2021-03-10T14:10:14.725776+0000 mgr.gibba045.orlgmj (mgr.34412) 1183 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:10:16.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:10:16 gibba015 bash[30343]: cephadm 2021-03-10T14:10:14.726093+0000 mgr.gibba045.orlgmj (mgr.34412) 1184 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:10:16.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:10:16 gibba015 bash[30343]: cephadm 2021-03-10T14:10:14.726997+0000 mgr.gibba045.orlgmj (mgr.34412) 1185 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:10:16.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:10:16 gibba015 bash[30343]: cephadm 2021-03-10T14:10:14.727037+0000 mgr.gibba045.orlgmj (mgr.34412) 1186 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:10:16.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:10:16 gibba015 bash[30343]: cephadm 2021-03-10T14:10:14.727144+0000 mgr.gibba045.orlgmj (mgr.34412) 1187 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:10:16.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:10:16 gibba045 bash[25517]: cephadm 2021-03-10T14:10:14.522037+0000 mgr.gibba045.orlgmj (mgr.34412) 1172 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:10:16.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:10:16 gibba045 bash[25517]: cephadm 2021-03-10T14:10:14.524917+0000 mgr.gibba045.orlgmj (mgr.34412) 1173 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:10:16.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:10:16 gibba045 bash[25517]: cephadm 2021-03-10T14:10:14.718242+0000 mgr.gibba045.orlgmj (mgr.34412) 1174 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:10:16.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:10:16 gibba045 bash[25517]: cephadm 2021-03-10T14:10:14.719798+0000 mgr.gibba045.orlgmj (mgr.34412) 1175 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:10:16.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:10:16 gibba045 bash[25517]: cephadm 2021-03-10T14:10:14.720930+0000 mgr.gibba045.orlgmj (mgr.34412) 1176 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:10:16.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:10:16 gibba045 bash[25517]: cephadm 2021-03-10T14:10:14.720968+0000 mgr.gibba045.orlgmj (mgr.34412) 1177 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:10:16.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:10:16 gibba045 bash[25517]: cephadm 2021-03-10T14:10:14.722197+0000 mgr.gibba045.orlgmj (mgr.34412) 1178 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:10:16.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:10:16 gibba045 bash[25517]: cephadm 2021-03-10T14:10:14.722237+0000 mgr.gibba045.orlgmj (mgr.34412) 1179 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:10:16.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:10:16 gibba045 bash[25517]: cephadm 2021-03-10T14:10:14.723141+0000 mgr.gibba045.orlgmj (mgr.34412) 1180 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:10:16.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:10:16 gibba045 bash[25517]: cephadm 2021-03-10T14:10:14.724538+0000 mgr.gibba045.orlgmj (mgr.34412) 1181 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:10:16.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:10:16 gibba045 bash[25517]: cephadm 2021-03-10T14:10:14.724574+0000 mgr.gibba045.orlgmj (mgr.34412) 1182 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:10:16.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:10:16 gibba045 bash[25517]: cephadm 2021-03-10T14:10:14.725776+0000 mgr.gibba045.orlgmj (mgr.34412) 1183 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:10:16.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:10:16 gibba045 bash[25517]: cephadm 2021-03-10T14:10:14.726093+0000 mgr.gibba045.orlgmj (mgr.34412) 1184 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:10:16.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:10:16 gibba045 bash[25517]: cephadm 2021-03-10T14:10:14.726997+0000 mgr.gibba045.orlgmj (mgr.34412) 1185 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:10:16.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:10:16 gibba045 bash[25517]: cephadm 2021-03-10T14:10:14.727037+0000 mgr.gibba045.orlgmj (mgr.34412) 1186 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:10:16.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:10:16 gibba045 bash[25517]: cephadm 2021-03-10T14:10:14.727144+0000 mgr.gibba045.orlgmj (mgr.34412) 1187 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:10:17.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:17 gibba015 bash[29377]: cluster 2021-03-10T14:10:15.827189+0000 mgr.gibba045.orlgmj (mgr.34412) 1188 : cluster [DBG] pgmap v656: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:17.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:10:17 gibba015 bash[30343]: cluster 2021-03-10T14:10:15.827189+0000 mgr.gibba045.orlgmj (mgr.34412) 1188 : cluster [DBG] pgmap v656: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:17.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:10:17 gibba045 bash[25517]: cluster 2021-03-10T14:10:15.827189+0000 mgr.gibba045.orlgmj (mgr.34412) 1188 : cluster [DBG] pgmap v656: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:19.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:19 gibba015 bash[29377]: cluster 2021-03-10T14:10:17.828800+0000 mgr.gibba045.orlgmj (mgr.34412) 1189 : cluster [DBG] pgmap v657: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:19.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:10:19 gibba015 bash[30343]: cluster 2021-03-10T14:10:17.828800+0000 mgr.gibba045.orlgmj (mgr.34412) 1189 : cluster [DBG] pgmap v657: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:19.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:10:19 gibba045 bash[25517]: cluster 2021-03-10T14:10:17.828800+0000 mgr.gibba045.orlgmj (mgr.34412) 1189 : cluster [DBG] pgmap v657: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:21.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:10:21 gibba045 bash[25517]: cluster 2021-03-10T14:10:19.830188+0000 mgr.gibba045.orlgmj (mgr.34412) 1190 : cluster [DBG] pgmap v658: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:21.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:21 gibba015 bash[29377]: cluster 2021-03-10T14:10:19.830188+0000 mgr.gibba045.orlgmj (mgr.34412) 1190 : cluster [DBG] pgmap v658: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:21.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:10:21 gibba015 bash[30343]: cluster 2021-03-10T14:10:19.830188+0000 mgr.gibba045.orlgmj (mgr.34412) 1190 : cluster [DBG] pgmap v658: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:23.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:22 gibba015 bash[29377]: cluster 2021-03-10T14:10:21.831756+0000 mgr.gibba045.orlgmj (mgr.34412) 1191 : cluster [DBG] pgmap v659: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:23.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:10:22 gibba015 bash[30343]: cluster 2021-03-10T14:10:21.831756+0000 mgr.gibba045.orlgmj (mgr.34412) 1191 : cluster [DBG] pgmap v659: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:23.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:10:22 gibba045 bash[25517]: cluster 2021-03-10T14:10:21.831756+0000 mgr.gibba045.orlgmj (mgr.34412) 1191 : cluster [DBG] pgmap v659: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:25.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:24 gibba015 bash[29377]: cluster 2021-03-10T14:10:23.832321+0000 mgr.gibba045.orlgmj (mgr.34412) 1192 : cluster [DBG] pgmap v660: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:25.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:10:24 gibba015 bash[30343]: cluster 2021-03-10T14:10:23.832321+0000 mgr.gibba045.orlgmj (mgr.34412) 1192 : cluster [DBG] pgmap v660: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:25.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:10:24 gibba045 bash[25517]: cluster 2021-03-10T14:10:23.832321+0000 mgr.gibba045.orlgmj (mgr.34412) 1192 : cluster [DBG] pgmap v660: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:27.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:26 gibba015 bash[29377]: cluster 2021-03-10T14:10:25.833970+0000 mgr.gibba045.orlgmj (mgr.34412) 1193 : cluster [DBG] pgmap v661: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:27.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:10:26 gibba015 bash[30343]: cluster 2021-03-10T14:10:25.833970+0000 mgr.gibba045.orlgmj (mgr.34412) 1193 : cluster [DBG] pgmap v661: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:27.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:10:26 gibba045 bash[25517]: cluster 2021-03-10T14:10:25.833970+0000 mgr.gibba045.orlgmj (mgr.34412) 1193 : cluster [DBG] pgmap v661: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:29.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:28 gibba015 bash[29377]: cluster 2021-03-10T14:10:27.835142+0000 mgr.gibba045.orlgmj (mgr.34412) 1194 : cluster [DBG] pgmap v662: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:29.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:10:28 gibba015 bash[30343]: cluster 2021-03-10T14:10:27.835142+0000 mgr.gibba045.orlgmj (mgr.34412) 1194 : cluster [DBG] pgmap v662: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:29.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:10:28 gibba045 bash[25517]: cluster 2021-03-10T14:10:27.835142+0000 mgr.gibba045.orlgmj (mgr.34412) 1194 : cluster [DBG] pgmap v662: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:31.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:30 gibba015 bash[29377]: cephadm 2021-03-10T14:10:29.743039+0000 mgr.gibba045.orlgmj (mgr.34412) 1195 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:10:31.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:30 gibba015 bash[29377]: cluster 2021-03-10T14:10:29.836615+0000 mgr.gibba045.orlgmj (mgr.34412) 1196 : cluster [DBG] pgmap v663: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:31.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:10:30 gibba015 bash[30343]: cephadm 2021-03-10T14:10:29.743039+0000 mgr.gibba045.orlgmj (mgr.34412) 1195 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:10:31.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:10:30 gibba015 bash[30343]: cluster 2021-03-10T14:10:29.836615+0000 mgr.gibba045.orlgmj (mgr.34412) 1196 : cluster [DBG] pgmap v663: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:31.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:10:30 gibba045 bash[25517]: cephadm 2021-03-10T14:10:29.743039+0000 mgr.gibba045.orlgmj (mgr.34412) 1195 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:10:31.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:10:30 gibba045 bash[25517]: cluster 2021-03-10T14:10:29.836615+0000 mgr.gibba045.orlgmj (mgr.34412) 1196 : cluster [DBG] pgmap v663: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:33.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:32 gibba015 bash[29377]: cluster 2021-03-10T14:10:31.838057+0000 mgr.gibba045.orlgmj (mgr.34412) 1197 : cluster [DBG] pgmap v664: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:33.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:10:32 gibba015 bash[30343]: cluster 2021-03-10T14:10:31.838057+0000 mgr.gibba045.orlgmj (mgr.34412) 1197 : cluster [DBG] pgmap v664: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:33.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:10:32 gibba045 bash[25517]: cluster 2021-03-10T14:10:31.838057+0000 mgr.gibba045.orlgmj (mgr.34412) 1197 : cluster [DBG] pgmap v664: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:35.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:10:34 gibba045 bash[25517]: cluster 2021-03-10T14:10:33.839277+0000 mgr.gibba045.orlgmj (mgr.34412) 1198 : cluster [DBG] pgmap v665: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:35.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:34 gibba015 bash[29377]: cluster 2021-03-10T14:10:33.839277+0000 mgr.gibba045.orlgmj (mgr.34412) 1198 : cluster [DBG] pgmap v665: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:35.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:10:34 gibba015 bash[30343]: cluster 2021-03-10T14:10:33.839277+0000 mgr.gibba045.orlgmj (mgr.34412) 1198 : cluster [DBG] pgmap v665: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:37.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:10:36 gibba045 bash[25517]: cluster 2021-03-10T14:10:35.840972+0000 mgr.gibba045.orlgmj (mgr.34412) 1199 : cluster [DBG] pgmap v666: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:37.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:36 gibba015 bash[29377]: cluster 2021-03-10T14:10:35.840972+0000 mgr.gibba045.orlgmj (mgr.34412) 1199 : cluster [DBG] pgmap v666: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:37.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:10:36 gibba015 bash[30343]: cluster 2021-03-10T14:10:35.840972+0000 mgr.gibba045.orlgmj (mgr.34412) 1199 : cluster [DBG] pgmap v666: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:38.324 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:10:38.549 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:10:38.550 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (21m) 7m ago 26m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:10:38.550 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (26m) 6m ago 26m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:10:38.550 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (21m) 6m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:10:38.551 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (22m) 6m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:10:38.551 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (21m) 7m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:10:38.551 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (20m) 7m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:10:38.551 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (20m) 6m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:10:38.552 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (20m) 7m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:10:38.552 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (26m) 7m ago 26m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:10:38.552 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (26m) 6m ago 26m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:10:38.552 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (19m) 7m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:10:38.552 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (19m) 7m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:10:38.553 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (18m) 7m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:10:38.553 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (18m) 7m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:10:38.553 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (17m) 6m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:10:38.553 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (17m) 6m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:10:38.554 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (17m) 6m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:10:38.554 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (16m) 6m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:10:38.554 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (26m) 6m ago 26m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:10:38.554 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 6m ago 24m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:10:38.798 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:10:38.798 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:10:38.798 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:10:38.799 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:10:38.799 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:10:38.799 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:10:38.799 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:10:38.800 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:10:38.800 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:10:38.800 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:10:38.800 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:10:38.800 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:10:38.801 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:10:38.801 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:10:38.801 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:10:39.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:10:38 gibba045 bash[25517]: cluster 2021-03-10T14:10:37.842485+0000 mgr.gibba045.orlgmj (mgr.34412) 1200 : cluster [DBG] pgmap v667: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:39.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:10:38 gibba045 bash[25517]: audit 2021-03-10T14:10:38.796589+0000 mon.c (mon.1) 395 : audit [DBG] from='client.? 172.21.2.115:0/1039891842' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:10:39.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:38 gibba015 bash[29377]: cluster 2021-03-10T14:10:37.842485+0000 mgr.gibba045.orlgmj (mgr.34412) 1200 : cluster [DBG] pgmap v667: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:39.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:38 gibba015 bash[29377]: audit 2021-03-10T14:10:38.796589+0000 mon.c (mon.1) 395 : audit [DBG] from='client.? 172.21.2.115:0/1039891842' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:10:39.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:10:38 gibba015 bash[30343]: cluster 2021-03-10T14:10:37.842485+0000 mgr.gibba045.orlgmj (mgr.34412) 1200 : cluster [DBG] pgmap v667: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:39.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:10:38 gibba015 bash[30343]: audit 2021-03-10T14:10:38.796589+0000 mon.c (mon.1) 395 : audit [DBG] from='client.? 172.21.2.115:0/1039891842' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:10:40.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:10:40 gibba045 bash[25517]: audit 2021-03-10T14:10:38.314890+0000 mgr.gibba045.orlgmj (mgr.34412) 1201 : audit [DBG] from='client.54850 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:10:40.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:10:40 gibba045 bash[25517]: audit 2021-03-10T14:10:38.538215+0000 mgr.gibba045.orlgmj (mgr.34412) 1202 : audit [DBG] from='client.54856 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:10:40.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:40 gibba015 bash[29377]: audit 2021-03-10T14:10:38.314890+0000 mgr.gibba045.orlgmj (mgr.34412) 1201 : audit [DBG] from='client.54850 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:10:40.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:40 gibba015 bash[29377]: audit 2021-03-10T14:10:38.538215+0000 mgr.gibba045.orlgmj (mgr.34412) 1202 : audit [DBG] from='client.54856 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:10:40.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:10:40 gibba015 bash[30343]: audit 2021-03-10T14:10:38.314890+0000 mgr.gibba045.orlgmj (mgr.34412) 1201 : audit [DBG] from='client.54850 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:10:40.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:10:40 gibba015 bash[30343]: audit 2021-03-10T14:10:38.538215+0000 mgr.gibba045.orlgmj (mgr.34412) 1202 : audit [DBG] from='client.54856 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:10:41.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:10:41 gibba045 bash[25517]: cluster 2021-03-10T14:10:39.844053+0000 mgr.gibba045.orlgmj (mgr.34412) 1203 : cluster [DBG] pgmap v668: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:41.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:41 gibba015 bash[29377]: cluster 2021-03-10T14:10:39.844053+0000 mgr.gibba045.orlgmj (mgr.34412) 1203 : cluster [DBG] pgmap v668: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:41.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:10:41 gibba015 bash[30343]: cluster 2021-03-10T14:10:39.844053+0000 mgr.gibba045.orlgmj (mgr.34412) 1203 : cluster [DBG] pgmap v668: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:43.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:10:43 gibba045 bash[25517]: cluster 2021-03-10T14:10:41.845798+0000 mgr.gibba045.orlgmj (mgr.34412) 1204 : cluster [DBG] pgmap v669: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:43.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:43 gibba015 bash[29377]: cluster 2021-03-10T14:10:41.845798+0000 mgr.gibba045.orlgmj (mgr.34412) 1204 : cluster [DBG] pgmap v669: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:43.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:10:43 gibba015 bash[30343]: cluster 2021-03-10T14:10:41.845798+0000 mgr.gibba045.orlgmj (mgr.34412) 1204 : cluster [DBG] pgmap v669: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:45.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:10:45 gibba045 bash[25517]: cluster 2021-03-10T14:10:43.847063+0000 mgr.gibba045.orlgmj (mgr.34412) 1205 : cluster [DBG] pgmap v670: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:45.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:45 gibba015 bash[29377]: cluster 2021-03-10T14:10:43.847063+0000 mgr.gibba045.orlgmj (mgr.34412) 1205 : cluster [DBG] pgmap v670: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:45.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:10:45 gibba015 bash[30343]: cluster 2021-03-10T14:10:43.847063+0000 mgr.gibba045.orlgmj (mgr.34412) 1205 : cluster [DBG] pgmap v670: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:46.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:10:46 gibba045 bash[25517]: cephadm 2021-03-10T14:10:44.759098+0000 mgr.gibba045.orlgmj (mgr.34412) 1206 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:10:46.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:46 gibba015 bash[29377]: cephadm 2021-03-10T14:10:44.759098+0000 mgr.gibba045.orlgmj (mgr.34412) 1206 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:10:46.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:10:46 gibba015 bash[30343]: cephadm 2021-03-10T14:10:44.759098+0000 mgr.gibba045.orlgmj (mgr.34412) 1206 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:10:47.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:10:47 gibba045 bash[25517]: cluster 2021-03-10T14:10:45.848720+0000 mgr.gibba045.orlgmj (mgr.34412) 1207 : cluster [DBG] pgmap v671: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:47.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:47 gibba015 bash[29377]: cluster 2021-03-10T14:10:45.848720+0000 mgr.gibba045.orlgmj (mgr.34412) 1207 : cluster [DBG] pgmap v671: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:47.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:10:47 gibba015 bash[30343]: cluster 2021-03-10T14:10:45.848720+0000 mgr.gibba045.orlgmj (mgr.34412) 1207 : cluster [DBG] pgmap v671: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:49.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:10:49 gibba045 bash[25517]: cluster 2021-03-10T14:10:47.850271+0000 mgr.gibba045.orlgmj (mgr.34412) 1208 : cluster [DBG] pgmap v672: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:49.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:49 gibba015 bash[29377]: cluster 2021-03-10T14:10:47.850271+0000 mgr.gibba045.orlgmj (mgr.34412) 1208 : cluster [DBG] pgmap v672: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:49.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:10:49 gibba015 bash[30343]: cluster 2021-03-10T14:10:47.850271+0000 mgr.gibba045.orlgmj (mgr.34412) 1208 : cluster [DBG] pgmap v672: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:51.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:51 gibba015 bash[29377]: cluster 2021-03-10T14:10:49.851938+0000 mgr.gibba045.orlgmj (mgr.34412) 1209 : cluster [DBG] pgmap v673: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:51.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:10:51 gibba015 bash[30343]: cluster 2021-03-10T14:10:49.851938+0000 mgr.gibba045.orlgmj (mgr.34412) 1209 : cluster [DBG] pgmap v673: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:51.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:10:51 gibba045 bash[25517]: cluster 2021-03-10T14:10:49.851938+0000 mgr.gibba045.orlgmj (mgr.34412) 1209 : cluster [DBG] pgmap v673: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:53.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:53 gibba015 bash[29377]: cluster 2021-03-10T14:10:51.853603+0000 mgr.gibba045.orlgmj (mgr.34412) 1210 : cluster [DBG] pgmap v674: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:53.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:53 gibba015 bash[29377]: audit 2021-03-10T14:10:52.548939+0000 mon.c (mon.1) 396 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T14:10:53.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:53 gibba015 bash[29377]: audit 2021-03-10T14:10:52.549955+0000 mon.c (mon.1) 397 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T14:10:53.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:53 gibba015 bash[29377]: audit 2021-03-10T14:10:52.550188+0000 mon.a (mon.0) 714 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T14:10:53.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:53 gibba015 bash[29377]: audit 2021-03-10T14:10:52.550698+0000 mon.c (mon.1) 398 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:10:53.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:53 gibba015 bash[29377]: audit 2021-03-10T14:10:52.551631+0000 mon.c (mon.1) 399 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:10:53.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:53 gibba015 bash[29377]: audit 2021-03-10T14:10:52.551670+0000 mon.a (mon.0) 715 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T14:10:53.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:53 gibba015 bash[29377]: audit 2021-03-10T14:10:52.553034+0000 mon.a (mon.0) 716 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:10:53.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:53 gibba015 bash[29377]: audit 2021-03-10T14:10:52.554022+0000 mon.a (mon.0) 717 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:10:53.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:53 gibba015 bash[29377]: audit 2021-03-10T14:10:52.590326+0000 mon.c (mon.1) 400 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:10:53.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:53 gibba015 bash[29377]: audit 2021-03-10T14:10:52.590949+0000 mon.c (mon.1) 401 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:10:53.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:53 gibba015 bash[29377]: audit 2021-03-10T14:10:52.591436+0000 mon.a (mon.0) 718 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:10:53.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:53 gibba015 bash[29377]: audit 2021-03-10T14:10:52.592587+0000 mon.a (mon.0) 719 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:10:53.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:10:53 gibba015 bash[30343]: cluster 2021-03-10T14:10:51.853603+0000 mgr.gibba045.orlgmj (mgr.34412) 1210 : cluster [DBG] pgmap v674: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:53.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:10:53 gibba015 bash[30343]: audit 2021-03-10T14:10:52.548939+0000 mon.c (mon.1) 396 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T14:10:53.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:10:53 gibba015 bash[30343]: audit 2021-03-10T14:10:52.549955+0000 mon.c (mon.1) 397 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T14:10:53.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:10:53 gibba015 bash[30343]: audit 2021-03-10T14:10:52.550188+0000 mon.a (mon.0) 714 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T14:10:53.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:10:53 gibba015 bash[30343]: audit 2021-03-10T14:10:52.550698+0000 mon.c (mon.1) 398 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:10:53.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:10:53 gibba015 bash[30343]: audit 2021-03-10T14:10:52.551631+0000 mon.c (mon.1) 399 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:10:53.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:10:53 gibba015 bash[30343]: audit 2021-03-10T14:10:52.551670+0000 mon.a (mon.0) 715 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T14:10:53.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:10:53 gibba015 bash[30343]: audit 2021-03-10T14:10:52.553034+0000 mon.a (mon.0) 716 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:10:53.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:10:53 gibba015 bash[30343]: audit 2021-03-10T14:10:52.554022+0000 mon.a (mon.0) 717 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:10:53.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:10:53 gibba015 bash[30343]: audit 2021-03-10T14:10:52.590326+0000 mon.c (mon.1) 400 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:10:53.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:10:53 gibba015 bash[30343]: audit 2021-03-10T14:10:52.590949+0000 mon.c (mon.1) 401 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:10:53.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:10:53 gibba015 bash[30343]: audit 2021-03-10T14:10:52.591436+0000 mon.a (mon.0) 718 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:10:53.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:10:53 gibba015 bash[30343]: audit 2021-03-10T14:10:52.592587+0000 mon.a (mon.0) 719 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:10:53.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:10:53 gibba045 bash[25517]: cluster 2021-03-10T14:10:51.853603+0000 mgr.gibba045.orlgmj (mgr.34412) 1210 : cluster [DBG] pgmap v674: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:53.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:10:53 gibba045 bash[25517]: audit 2021-03-10T14:10:52.548939+0000 mon.c (mon.1) 396 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T14:10:53.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:10:53 gibba045 bash[25517]: audit 2021-03-10T14:10:52.549955+0000 mon.c (mon.1) 397 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T14:10:53.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:10:53 gibba045 bash[25517]: audit 2021-03-10T14:10:52.550188+0000 mon.a (mon.0) 714 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T14:10:53.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:10:53 gibba045 bash[25517]: audit 2021-03-10T14:10:52.550698+0000 mon.c (mon.1) 398 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:10:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:10:53 gibba045 bash[25517]: audit 2021-03-10T14:10:52.551631+0000 mon.c (mon.1) 399 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:10:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:10:53 gibba045 bash[25517]: audit 2021-03-10T14:10:52.551670+0000 mon.a (mon.0) 715 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T14:10:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:10:53 gibba045 bash[25517]: audit 2021-03-10T14:10:52.553034+0000 mon.a (mon.0) 716 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:10:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:10:53 gibba045 bash[25517]: audit 2021-03-10T14:10:52.554022+0000 mon.a (mon.0) 717 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:10:53.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:10:53 gibba045 bash[25517]: audit 2021-03-10T14:10:52.590326+0000 mon.c (mon.1) 400 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:10:53.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:10:53 gibba045 bash[25517]: audit 2021-03-10T14:10:52.590949+0000 mon.c (mon.1) 401 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:10:53.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:10:53 gibba045 bash[25517]: audit 2021-03-10T14:10:52.591436+0000 mon.a (mon.0) 718 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:10:53.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:10:53 gibba045 bash[25517]: audit 2021-03-10T14:10:52.592587+0000 mon.a (mon.0) 719 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:10:55.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:55 gibba015 bash[29377]: cluster 2021-03-10T14:10:53.854792+0000 mgr.gibba045.orlgmj (mgr.34412) 1211 : cluster [DBG] pgmap v675: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:55.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:10:55 gibba015 bash[30343]: cluster 2021-03-10T14:10:53.854792+0000 mgr.gibba045.orlgmj (mgr.34412) 1211 : cluster [DBG] pgmap v675: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:55.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:10:55 gibba045 bash[25517]: cluster 2021-03-10T14:10:53.854792+0000 mgr.gibba045.orlgmj (mgr.34412) 1211 : cluster [DBG] pgmap v675: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:57.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:57 gibba015 bash[29377]: cluster 2021-03-10T14:10:55.856415+0000 mgr.gibba045.orlgmj (mgr.34412) 1212 : cluster [DBG] pgmap v676: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:57.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:10:57 gibba015 bash[30343]: cluster 2021-03-10T14:10:55.856415+0000 mgr.gibba045.orlgmj (mgr.34412) 1212 : cluster [DBG] pgmap v676: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:57.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:10:57 gibba045 bash[25517]: cluster 2021-03-10T14:10:55.856415+0000 mgr.gibba045.orlgmj (mgr.34412) 1212 : cluster [DBG] pgmap v676: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:59.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:10:59 gibba015 bash[29377]: cluster 2021-03-10T14:10:57.858059+0000 mgr.gibba045.orlgmj (mgr.34412) 1213 : cluster [DBG] pgmap v677: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:59.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:10:59 gibba015 bash[30343]: cluster 2021-03-10T14:10:57.858059+0000 mgr.gibba045.orlgmj (mgr.34412) 1213 : cluster [DBG] pgmap v677: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:59.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:10:59 gibba045 bash[25517]: cluster 2021-03-10T14:10:57.858059+0000 mgr.gibba045.orlgmj (mgr.34412) 1213 : cluster [DBG] pgmap v677: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:01.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:11:01 gibba015 bash[29377]: cephadm 2021-03-10T14:10:59.764328+0000 mgr.gibba045.orlgmj (mgr.34412) 1214 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:11:01.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:11:01 gibba015 bash[29377]: cluster 2021-03-10T14:10:59.859594+0000 mgr.gibba045.orlgmj (mgr.34412) 1215 : cluster [DBG] pgmap v678: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:01.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:11:01 gibba015 bash[30343]: cephadm 2021-03-10T14:10:59.764328+0000 mgr.gibba045.orlgmj (mgr.34412) 1214 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:11:01.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:11:01 gibba015 bash[30343]: cluster 2021-03-10T14:10:59.859594+0000 mgr.gibba045.orlgmj (mgr.34412) 1215 : cluster [DBG] pgmap v678: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:01.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:11:01 gibba045 bash[25517]: cephadm 2021-03-10T14:10:59.764328+0000 mgr.gibba045.orlgmj (mgr.34412) 1214 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:11:01.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:11:01 gibba045 bash[25517]: cluster 2021-03-10T14:10:59.859594+0000 mgr.gibba045.orlgmj (mgr.34412) 1215 : cluster [DBG] pgmap v678: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:03.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:11:03 gibba015 bash[29377]: cluster 2021-03-10T14:11:01.861347+0000 mgr.gibba045.orlgmj (mgr.34412) 1216 : cluster [DBG] pgmap v679: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:03.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:11:03 gibba015 bash[30343]: cluster 2021-03-10T14:11:01.861347+0000 mgr.gibba045.orlgmj (mgr.34412) 1216 : cluster [DBG] pgmap v679: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:03.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:11:03 gibba045 bash[25517]: cluster 2021-03-10T14:11:01.861347+0000 mgr.gibba045.orlgmj (mgr.34412) 1216 : cluster [DBG] pgmap v679: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:05.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:11:05 gibba015 bash[29377]: cluster 2021-03-10T14:11:03.862541+0000 mgr.gibba045.orlgmj (mgr.34412) 1217 : cluster [DBG] pgmap v680: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:05.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:11:05 gibba015 bash[30343]: cluster 2021-03-10T14:11:03.862541+0000 mgr.gibba045.orlgmj (mgr.34412) 1217 : cluster [DBG] pgmap v680: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:05.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:11:05 gibba045 bash[25517]: cluster 2021-03-10T14:11:03.862541+0000 mgr.gibba045.orlgmj (mgr.34412) 1217 : cluster [DBG] pgmap v680: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:07.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:11:07 gibba015 bash[29377]: cluster 2021-03-10T14:11:05.864256+0000 mgr.gibba045.orlgmj (mgr.34412) 1218 : cluster [DBG] pgmap v681: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:07.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:11:07 gibba015 bash[30343]: cluster 2021-03-10T14:11:05.864256+0000 mgr.gibba045.orlgmj (mgr.34412) 1218 : cluster [DBG] pgmap v681: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:07.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:11:07 gibba045 bash[25517]: cluster 2021-03-10T14:11:05.864256+0000 mgr.gibba045.orlgmj (mgr.34412) 1218 : cluster [DBG] pgmap v681: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:09.039 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:11:09.268 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:11:09.268 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (21m) 8m ago 27m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:11:09.268 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (27m) 6m ago 27m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:11:09.269 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (22m) 6m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:11:09.269 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (22m) 6m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:11:09.269 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (21m) 8m ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:11:09.269 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (21m) 8m ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:11:09.270 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (20m) 6m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:11:09.270 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (21m) 8m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:11:09.270 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (27m) 8m ago 27m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:11:09.270 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (27m) 6m ago 27m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:11:09.270 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (20m) 8m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:11:09.271 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (19m) 8m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:11:09.271 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (19m) 8m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:11:09.271 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (18m) 8m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:11:09.271 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (18m) 6m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:11:09.272 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (18m) 6m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:11:09.272 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (17m) 6m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:11:09.272 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (17m) 6m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:11:09.272 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (26m) 6m ago 27m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:11:09.272 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 6m ago 25m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:11:09.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:11:09 gibba015 bash[29377]: cluster 2021-03-10T14:11:07.865866+0000 mgr.gibba045.orlgmj (mgr.34412) 1219 : cluster [DBG] pgmap v682: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:09.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:11:09 gibba015 bash[30343]: cluster 2021-03-10T14:11:07.865866+0000 mgr.gibba045.orlgmj (mgr.34412) 1219 : cluster [DBG] pgmap v682: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:09.516 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:11:09.516 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:11:09.516 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:11:09.516 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:11:09.516 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:11:09.517 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:11:09.517 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:11:09.517 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:11:09.517 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:11:09.517 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:11:09.518 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:11:09.518 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:11:09.518 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:11:09.518 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:11:09.519 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:11:09.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:11:09 gibba045 bash[25517]: cluster 2021-03-10T14:11:07.865866+0000 mgr.gibba045.orlgmj (mgr.34412) 1219 : cluster [DBG] pgmap v682: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:10.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:11:10 gibba015 bash[29377]: audit 2021-03-10T14:11:09.030409+0000 mgr.gibba045.orlgmj (mgr.34412) 1220 : audit [DBG] from='client.54868 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:11:10.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:11:10 gibba015 bash[29377]: audit 2021-03-10T14:11:09.514329+0000 mon.a (mon.0) 720 : audit [DBG] from='client.? 172.21.2.115:0/2669898515' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:11:10.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:11:10 gibba015 bash[30343]: audit 2021-03-10T14:11:09.030409+0000 mgr.gibba045.orlgmj (mgr.34412) 1220 : audit [DBG] from='client.54868 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:11:10.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:11:10 gibba015 bash[30343]: audit 2021-03-10T14:11:09.514329+0000 mon.a (mon.0) 720 : audit [DBG] from='client.? 172.21.2.115:0/2669898515' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:11:10.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:11:10 gibba045 bash[25517]: audit 2021-03-10T14:11:09.030409+0000 mgr.gibba045.orlgmj (mgr.34412) 1220 : audit [DBG] from='client.54868 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:11:10.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:11:10 gibba045 bash[25517]: audit 2021-03-10T14:11:09.514329+0000 mon.a (mon.0) 720 : audit [DBG] from='client.? 172.21.2.115:0/2669898515' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:11:11.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:11:11 gibba015 bash[29377]: audit 2021-03-10T14:11:09.255374+0000 mgr.gibba045.orlgmj (mgr.34412) 1221 : audit [DBG] from='client.44886 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:11:11.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:11:11 gibba015 bash[29377]: cluster 2021-03-10T14:11:09.867399+0000 mgr.gibba045.orlgmj (mgr.34412) 1222 : cluster [DBG] pgmap v683: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:11.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:11:11 gibba015 bash[30343]: audit 2021-03-10T14:11:09.255374+0000 mgr.gibba045.orlgmj (mgr.34412) 1221 : audit [DBG] from='client.44886 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:11:11.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:11:11 gibba015 bash[30343]: cluster 2021-03-10T14:11:09.867399+0000 mgr.gibba045.orlgmj (mgr.34412) 1222 : cluster [DBG] pgmap v683: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:11.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:11:11 gibba045 bash[25517]: audit 2021-03-10T14:11:09.255374+0000 mgr.gibba045.orlgmj (mgr.34412) 1221 : audit [DBG] from='client.44886 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:11:11.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:11:11 gibba045 bash[25517]: cluster 2021-03-10T14:11:09.867399+0000 mgr.gibba045.orlgmj (mgr.34412) 1222 : cluster [DBG] pgmap v683: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:13.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:11:13 gibba015 bash[29377]: cluster 2021-03-10T14:11:11.869168+0000 mgr.gibba045.orlgmj (mgr.34412) 1223 : cluster [DBG] pgmap v684: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:13.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:11:13 gibba015 bash[30343]: cluster 2021-03-10T14:11:11.869168+0000 mgr.gibba045.orlgmj (mgr.34412) 1223 : cluster [DBG] pgmap v684: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:13.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:11:13 gibba045 bash[25517]: cluster 2021-03-10T14:11:11.869168+0000 mgr.gibba045.orlgmj (mgr.34412) 1223 : cluster [DBG] pgmap v684: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:15.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:11:15 gibba045 bash[25517]: cluster 2021-03-10T14:11:13.870388+0000 mgr.gibba045.orlgmj (mgr.34412) 1224 : cluster [DBG] pgmap v685: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:15.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:11:15 gibba045 bash[25517]: audit 2021-03-10T14:11:14.779339+0000 mon.c (mon.1) 402 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:11:15.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:11:15 gibba045 bash[25517]: audit 2021-03-10T14:11:14.993386+0000 mon.a (mon.0) 721 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:11:15.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:11:15 gibba045 bash[25517]: audit 2021-03-10T14:11:14.997327+0000 mon.c (mon.1) 403 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:11:15.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:11:15 gibba045 bash[25517]: audit 2021-03-10T14:11:14.999016+0000 mon.c (mon.1) 404 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:11:15.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:11:15 gibba045 bash[25517]: audit 2021-03-10T14:11:15.000285+0000 mon.c (mon.1) 405 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:11:15.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:11:15 gibba045 bash[25517]: audit 2021-03-10T14:11:15.001434+0000 mon.c (mon.1) 406 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:11:15.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:11:15 gibba045 bash[25517]: audit 2021-03-10T14:11:15.004761+0000 mon.c (mon.1) 407 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:11:15.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:11:15 gibba045 bash[25517]: audit 2021-03-10T14:11:15.006404+0000 mon.c (mon.1) 408 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:11:15.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:11:15 gibba015 bash[29377]: cluster 2021-03-10T14:11:13.870388+0000 mgr.gibba045.orlgmj (mgr.34412) 1224 : cluster [DBG] pgmap v685: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:15.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:11:15 gibba015 bash[29377]: audit 2021-03-10T14:11:14.779339+0000 mon.c (mon.1) 402 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:11:15.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:11:15 gibba015 bash[29377]: audit 2021-03-10T14:11:14.993386+0000 mon.a (mon.0) 721 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:11:15.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:11:15 gibba015 bash[29377]: audit 2021-03-10T14:11:14.997327+0000 mon.c (mon.1) 403 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:11:15.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:11:15 gibba015 bash[29377]: audit 2021-03-10T14:11:14.999016+0000 mon.c (mon.1) 404 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:11:15.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:11:15 gibba015 bash[29377]: audit 2021-03-10T14:11:15.000285+0000 mon.c (mon.1) 405 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:11:15.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:11:15 gibba015 bash[29377]: audit 2021-03-10T14:11:15.001434+0000 mon.c (mon.1) 406 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:11:15.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:11:15 gibba015 bash[29377]: audit 2021-03-10T14:11:15.004761+0000 mon.c (mon.1) 407 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:11:15.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:11:15 gibba015 bash[29377]: audit 2021-03-10T14:11:15.006404+0000 mon.c (mon.1) 408 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:11:15.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:11:15 gibba015 bash[30343]: cluster 2021-03-10T14:11:13.870388+0000 mgr.gibba045.orlgmj (mgr.34412) 1224 : cluster [DBG] pgmap v685: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:15.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:11:15 gibba015 bash[30343]: audit 2021-03-10T14:11:14.779339+0000 mon.c (mon.1) 402 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:11:15.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:11:15 gibba015 bash[30343]: audit 2021-03-10T14:11:14.993386+0000 mon.a (mon.0) 721 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:11:15.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:11:15 gibba015 bash[30343]: audit 2021-03-10T14:11:14.997327+0000 mon.c (mon.1) 403 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:11:15.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:11:15 gibba015 bash[30343]: audit 2021-03-10T14:11:14.999016+0000 mon.c (mon.1) 404 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:11:15.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:11:15 gibba015 bash[30343]: audit 2021-03-10T14:11:15.000285+0000 mon.c (mon.1) 405 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:11:15.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:11:15 gibba015 bash[30343]: audit 2021-03-10T14:11:15.001434+0000 mon.c (mon.1) 406 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:11:15.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:11:15 gibba015 bash[30343]: audit 2021-03-10T14:11:15.004761+0000 mon.c (mon.1) 407 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:11:15.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:11:15 gibba015 bash[30343]: audit 2021-03-10T14:11:15.006404+0000 mon.c (mon.1) 408 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:11:16.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:11:16 gibba015 bash[29377]: cephadm 2021-03-10T14:11:14.786198+0000 mgr.gibba045.orlgmj (mgr.34412) 1225 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:11:16.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:11:16 gibba015 bash[29377]: cephadm 2021-03-10T14:11:14.788022+0000 mgr.gibba045.orlgmj (mgr.34412) 1226 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:11:16.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:11:16 gibba015 bash[29377]: cephadm 2021-03-10T14:11:14.998196+0000 mgr.gibba045.orlgmj (mgr.34412) 1227 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:11:16.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:11:16 gibba015 bash[29377]: cephadm 2021-03-10T14:11:15.000303+0000 mgr.gibba045.orlgmj (mgr.34412) 1228 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:11:16.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:11:16 gibba015 bash[29377]: cephadm 2021-03-10T14:11:15.001724+0000 mgr.gibba045.orlgmj (mgr.34412) 1229 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:11:16.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:11:16 gibba015 bash[29377]: cephadm 2021-03-10T14:11:15.001761+0000 mgr.gibba045.orlgmj (mgr.34412) 1230 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:11:16.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:11:16 gibba015 bash[29377]: cephadm 2021-03-10T14:11:15.002777+0000 mgr.gibba045.orlgmj (mgr.34412) 1231 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:11:16.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:11:16 gibba015 bash[29377]: cephadm 2021-03-10T14:11:15.002814+0000 mgr.gibba045.orlgmj (mgr.34412) 1232 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:11:16.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:11:16 gibba015 bash[29377]: cephadm 2021-03-10T14:11:15.004303+0000 mgr.gibba045.orlgmj (mgr.34412) 1233 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:11:16.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:11:16 gibba015 bash[29377]: cephadm 2021-03-10T14:11:15.005970+0000 mgr.gibba045.orlgmj (mgr.34412) 1234 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:11:16.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:11:16 gibba015 bash[29377]: cephadm 2021-03-10T14:11:15.006005+0000 mgr.gibba045.orlgmj (mgr.34412) 1235 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:11:16.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:11:16 gibba015 bash[29377]: cephadm 2021-03-10T14:11:15.007479+0000 mgr.gibba045.orlgmj (mgr.34412) 1236 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:11:16.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:11:16 gibba015 bash[29377]: cephadm 2021-03-10T14:11:15.007798+0000 mgr.gibba045.orlgmj (mgr.34412) 1237 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:11:16.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:11:16 gibba015 bash[29377]: cephadm 2021-03-10T14:11:15.009269+0000 mgr.gibba045.orlgmj (mgr.34412) 1238 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:11:16.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:11:16 gibba015 bash[29377]: cephadm 2021-03-10T14:11:15.009306+0000 mgr.gibba045.orlgmj (mgr.34412) 1239 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:11:16.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:11:16 gibba015 bash[29377]: cephadm 2021-03-10T14:11:15.009414+0000 mgr.gibba045.orlgmj (mgr.34412) 1240 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:11:16.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:11:16 gibba015 bash[30343]: cephadm 2021-03-10T14:11:14.786198+0000 mgr.gibba045.orlgmj (mgr.34412) 1225 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:11:16.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:11:16 gibba015 bash[30343]: cephadm 2021-03-10T14:11:14.788022+0000 mgr.gibba045.orlgmj (mgr.34412) 1226 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:11:16.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:11:16 gibba015 bash[30343]: cephadm 2021-03-10T14:11:14.998196+0000 mgr.gibba045.orlgmj (mgr.34412) 1227 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:11:16.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:11:16 gibba015 bash[30343]: cephadm 2021-03-10T14:11:15.000303+0000 mgr.gibba045.orlgmj (mgr.34412) 1228 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:11:16.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:11:16 gibba015 bash[30343]: cephadm 2021-03-10T14:11:15.001724+0000 mgr.gibba045.orlgmj (mgr.34412) 1229 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:11:16.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:11:16 gibba015 bash[30343]: cephadm 2021-03-10T14:11:15.001761+0000 mgr.gibba045.orlgmj (mgr.34412) 1230 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:11:16.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:11:16 gibba015 bash[30343]: cephadm 2021-03-10T14:11:15.002777+0000 mgr.gibba045.orlgmj (mgr.34412) 1231 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:11:16.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:11:16 gibba015 bash[30343]: cephadm 2021-03-10T14:11:15.002814+0000 mgr.gibba045.orlgmj (mgr.34412) 1232 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:11:16.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:11:16 gibba015 bash[30343]: cephadm 2021-03-10T14:11:15.004303+0000 mgr.gibba045.orlgmj (mgr.34412) 1233 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:11:16.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:11:16 gibba015 bash[30343]: cephadm 2021-03-10T14:11:15.005970+0000 mgr.gibba045.orlgmj (mgr.34412) 1234 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:11:16.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:11:16 gibba015 bash[30343]: cephadm 2021-03-10T14:11:15.006005+0000 mgr.gibba045.orlgmj (mgr.34412) 1235 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:11:16.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:11:16 gibba015 bash[30343]: cephadm 2021-03-10T14:11:15.007479+0000 mgr.gibba045.orlgmj (mgr.34412) 1236 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:11:16.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:11:16 gibba015 bash[30343]: cephadm 2021-03-10T14:11:15.007798+0000 mgr.gibba045.orlgmj (mgr.34412) 1237 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:11:16.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:11:16 gibba015 bash[30343]: cephadm 2021-03-10T14:11:15.009269+0000 mgr.gibba045.orlgmj (mgr.34412) 1238 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:11:16.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:11:16 gibba015 bash[30343]: cephadm 2021-03-10T14:11:15.009306+0000 mgr.gibba045.orlgmj (mgr.34412) 1239 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:11:16.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:11:16 gibba015 bash[30343]: cephadm 2021-03-10T14:11:15.009414+0000 mgr.gibba045.orlgmj (mgr.34412) 1240 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:11:16.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:11:16 gibba045 bash[25517]: cephadm 2021-03-10T14:11:14.786198+0000 mgr.gibba045.orlgmj (mgr.34412) 1225 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:11:16.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:11:16 gibba045 bash[25517]: cephadm 2021-03-10T14:11:14.788022+0000 mgr.gibba045.orlgmj (mgr.34412) 1226 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:11:16.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:11:16 gibba045 bash[25517]: cephadm 2021-03-10T14:11:14.998196+0000 mgr.gibba045.orlgmj (mgr.34412) 1227 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:11:16.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:11:16 gibba045 bash[25517]: cephadm 2021-03-10T14:11:15.000303+0000 mgr.gibba045.orlgmj (mgr.34412) 1228 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:11:16.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:11:16 gibba045 bash[25517]: cephadm 2021-03-10T14:11:15.001724+0000 mgr.gibba045.orlgmj (mgr.34412) 1229 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:11:16.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:11:16 gibba045 bash[25517]: cephadm 2021-03-10T14:11:15.001761+0000 mgr.gibba045.orlgmj (mgr.34412) 1230 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:11:16.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:11:16 gibba045 bash[25517]: cephadm 2021-03-10T14:11:15.002777+0000 mgr.gibba045.orlgmj (mgr.34412) 1231 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:11:16.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:11:16 gibba045 bash[25517]: cephadm 2021-03-10T14:11:15.002814+0000 mgr.gibba045.orlgmj (mgr.34412) 1232 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:11:16.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:11:16 gibba045 bash[25517]: cephadm 2021-03-10T14:11:15.004303+0000 mgr.gibba045.orlgmj (mgr.34412) 1233 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:11:16.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:11:16 gibba045 bash[25517]: cephadm 2021-03-10T14:11:15.005970+0000 mgr.gibba045.orlgmj (mgr.34412) 1234 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:11:16.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:11:16 gibba045 bash[25517]: cephadm 2021-03-10T14:11:15.006005+0000 mgr.gibba045.orlgmj (mgr.34412) 1235 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:11:16.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:11:16 gibba045 bash[25517]: cephadm 2021-03-10T14:11:15.007479+0000 mgr.gibba045.orlgmj (mgr.34412) 1236 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:11:16.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:11:16 gibba045 bash[25517]: cephadm 2021-03-10T14:11:15.007798+0000 mgr.gibba045.orlgmj (mgr.34412) 1237 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:11:16.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:11:16 gibba045 bash[25517]: cephadm 2021-03-10T14:11:15.009269+0000 mgr.gibba045.orlgmj (mgr.34412) 1238 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:11:16.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:11:16 gibba045 bash[25517]: cephadm 2021-03-10T14:11:15.009306+0000 mgr.gibba045.orlgmj (mgr.34412) 1239 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:11:16.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:11:16 gibba045 bash[25517]: cephadm 2021-03-10T14:11:15.009414+0000 mgr.gibba045.orlgmj (mgr.34412) 1240 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:11:17.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:11:17 gibba015 bash[29377]: cluster 2021-03-10T14:11:15.872134+0000 mgr.gibba045.orlgmj (mgr.34412) 1241 : cluster [DBG] pgmap v686: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:17.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:11:17 gibba015 bash[30343]: cluster 2021-03-10T14:11:15.872134+0000 mgr.gibba045.orlgmj (mgr.34412) 1241 : cluster [DBG] pgmap v686: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:17.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:11:17 gibba045 bash[25517]: cluster 2021-03-10T14:11:15.872134+0000 mgr.gibba045.orlgmj (mgr.34412) 1241 : cluster [DBG] pgmap v686: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:19.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:11:19 gibba015 bash[29377]: cluster 2021-03-10T14:11:17.873746+0000 mgr.gibba045.orlgmj (mgr.34412) 1242 : cluster [DBG] pgmap v687: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:19.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:11:19 gibba015 bash[30343]: cluster 2021-03-10T14:11:17.873746+0000 mgr.gibba045.orlgmj (mgr.34412) 1242 : cluster [DBG] pgmap v687: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:19.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:11:19 gibba045 bash[25517]: cluster 2021-03-10T14:11:17.873746+0000 mgr.gibba045.orlgmj (mgr.34412) 1242 : cluster [DBG] pgmap v687: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:21.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:11:21 gibba015 bash[29377]: cluster 2021-03-10T14:11:19.875457+0000 mgr.gibba045.orlgmj (mgr.34412) 1243 : cluster [DBG] pgmap v688: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:21.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:11:21 gibba015 bash[30343]: cluster 2021-03-10T14:11:19.875457+0000 mgr.gibba045.orlgmj (mgr.34412) 1243 : cluster [DBG] pgmap v688: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:21.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:11:21 gibba045 bash[25517]: cluster 2021-03-10T14:11:19.875457+0000 mgr.gibba045.orlgmj (mgr.34412) 1243 : cluster [DBG] pgmap v688: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:23.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:11:23 gibba015 bash[29377]: cluster 2021-03-10T14:11:21.877224+0000 mgr.gibba045.orlgmj (mgr.34412) 1244 : cluster [DBG] pgmap v689: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:23.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:11:23 gibba015 bash[30343]: cluster 2021-03-10T14:11:21.877224+0000 mgr.gibba045.orlgmj (mgr.34412) 1244 : cluster [DBG] pgmap v689: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:23.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:11:23 gibba045 bash[25517]: cluster 2021-03-10T14:11:21.877224+0000 mgr.gibba045.orlgmj (mgr.34412) 1244 : cluster [DBG] pgmap v689: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:25.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:11:25 gibba045 bash[25517]: cluster 2021-03-10T14:11:23.878401+0000 mgr.gibba045.orlgmj (mgr.34412) 1245 : cluster [DBG] pgmap v690: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:25.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:11:25 gibba015 bash[29377]: cluster 2021-03-10T14:11:23.878401+0000 mgr.gibba045.orlgmj (mgr.34412) 1245 : cluster [DBG] pgmap v690: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:25.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:11:25 gibba015 bash[30343]: cluster 2021-03-10T14:11:23.878401+0000 mgr.gibba045.orlgmj (mgr.34412) 1245 : cluster [DBG] pgmap v690: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:27.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:11:27 gibba045 bash[25517]: cluster 2021-03-10T14:11:25.880123+0000 mgr.gibba045.orlgmj (mgr.34412) 1246 : cluster [DBG] pgmap v691: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:27.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:11:27 gibba015 bash[29377]: cluster 2021-03-10T14:11:25.880123+0000 mgr.gibba045.orlgmj (mgr.34412) 1246 : cluster [DBG] pgmap v691: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:27.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:11:27 gibba015 bash[30343]: cluster 2021-03-10T14:11:25.880123+0000 mgr.gibba045.orlgmj (mgr.34412) 1246 : cluster [DBG] pgmap v691: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:29.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:11:29 gibba045 bash[25517]: cluster 2021-03-10T14:11:27.881526+0000 mgr.gibba045.orlgmj (mgr.34412) 1247 : cluster [DBG] pgmap v692: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:29.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:11:29 gibba015 bash[29377]: cluster 2021-03-10T14:11:27.881526+0000 mgr.gibba045.orlgmj (mgr.34412) 1247 : cluster [DBG] pgmap v692: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:29.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:11:29 gibba015 bash[30343]: cluster 2021-03-10T14:11:27.881526+0000 mgr.gibba045.orlgmj (mgr.34412) 1247 : cluster [DBG] pgmap v692: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:31.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:11:31 gibba045 bash[25517]: cluster 2021-03-10T14:11:29.883035+0000 mgr.gibba045.orlgmj (mgr.34412) 1248 : cluster [DBG] pgmap v693: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:31.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:11:31 gibba045 bash[25517]: cephadm 2021-03-10T14:11:30.024911+0000 mgr.gibba045.orlgmj (mgr.34412) 1249 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:11:31.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:11:31 gibba015 bash[29377]: cluster 2021-03-10T14:11:29.883035+0000 mgr.gibba045.orlgmj (mgr.34412) 1248 : cluster [DBG] pgmap v693: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:31.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:11:31 gibba015 bash[29377]: cephadm 2021-03-10T14:11:30.024911+0000 mgr.gibba045.orlgmj (mgr.34412) 1249 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:11:31.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:11:31 gibba015 bash[30343]: cluster 2021-03-10T14:11:29.883035+0000 mgr.gibba045.orlgmj (mgr.34412) 1248 : cluster [DBG] pgmap v693: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:31.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:11:31 gibba015 bash[30343]: cephadm 2021-03-10T14:11:30.024911+0000 mgr.gibba045.orlgmj (mgr.34412) 1249 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:11:33.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:11:33 gibba045 bash[25517]: cluster 2021-03-10T14:11:31.884529+0000 mgr.gibba045.orlgmj (mgr.34412) 1250 : cluster [DBG] pgmap v694: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:33.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:11:33 gibba015 bash[29377]: cluster 2021-03-10T14:11:31.884529+0000 mgr.gibba045.orlgmj (mgr.34412) 1250 : cluster [DBG] pgmap v694: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:33.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:11:33 gibba015 bash[30343]: cluster 2021-03-10T14:11:31.884529+0000 mgr.gibba045.orlgmj (mgr.34412) 1250 : cluster [DBG] pgmap v694: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:34.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:11:34 gibba045 bash[25517]: cluster 2021-03-10T14:11:33.885708+0000 mgr.gibba045.orlgmj (mgr.34412) 1251 : cluster [DBG] pgmap v695: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:34.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:11:34 gibba015 bash[29377]: cluster 2021-03-10T14:11:33.885708+0000 mgr.gibba045.orlgmj (mgr.34412) 1251 : cluster [DBG] pgmap v695: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:34.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:11:34 gibba015 bash[30343]: cluster 2021-03-10T14:11:33.885708+0000 mgr.gibba045.orlgmj (mgr.34412) 1251 : cluster [DBG] pgmap v695: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:37.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:11:36 gibba015 bash[29377]: cluster 2021-03-10T14:11:35.887223+0000 mgr.gibba045.orlgmj (mgr.34412) 1252 : cluster [DBG] pgmap v696: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:37.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:11:36 gibba015 bash[30343]: cluster 2021-03-10T14:11:35.887223+0000 mgr.gibba045.orlgmj (mgr.34412) 1252 : cluster [DBG] pgmap v696: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:37.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:11:36 gibba045 bash[25517]: cluster 2021-03-10T14:11:35.887223+0000 mgr.gibba045.orlgmj (mgr.34412) 1252 : cluster [DBG] pgmap v696: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:39.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:11:38 gibba015 bash[29377]: cluster 2021-03-10T14:11:37.888781+0000 mgr.gibba045.orlgmj (mgr.34412) 1253 : cluster [DBG] pgmap v697: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:39.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:11:38 gibba015 bash[30343]: cluster 2021-03-10T14:11:37.888781+0000 mgr.gibba045.orlgmj (mgr.34412) 1253 : cluster [DBG] pgmap v697: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:39.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:11:38 gibba045 bash[25517]: cluster 2021-03-10T14:11:37.888781+0000 mgr.gibba045.orlgmj (mgr.34412) 1253 : cluster [DBG] pgmap v697: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:39.764 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:11:40.010 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:11:40.011 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (22m) 8m ago 27m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:11:40.011 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (27m) 7m ago 27m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:11:40.012 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (22m) 7m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:11:40.012 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (23m) 7m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:11:40.012 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (22m) 8m ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:11:40.012 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (21m) 8m ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:11:40.013 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (21m) 7m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:11:40.013 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (21m) 8m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:11:40.013 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (27m) 8m ago 27m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:11:40.013 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (27m) 7m ago 27m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:11:40.013 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (20m) 8m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:11:40.014 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (20m) 8m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:11:40.014 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (19m) 8m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:11:40.014 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (19m) 8m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:11:40.014 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (18m) 7m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:11:40.015 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (18m) 7m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:11:40.015 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (18m) 7m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:11:40.015 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (17m) 7m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:11:40.015 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (27m) 7m ago 27m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:11:40.016 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 7m ago 25m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:11:40.256 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:11:40.257 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:11:40.257 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:11:40.257 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:11:40.258 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:11:40.258 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:11:40.258 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:11:40.258 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:11:40.259 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:11:40.259 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:11:40.259 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:11:40.259 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:11:40.260 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:11:40.260 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:11:40.260 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:11:41.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:11:40 gibba045 bash[25517]: audit 2021-03-10T14:11:39.755547+0000 mgr.gibba045.orlgmj (mgr.34412) 1254 : audit [DBG] from='client.44898 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:11:41.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:11:40 gibba045 bash[25517]: cluster 2021-03-10T14:11:39.890417+0000 mgr.gibba045.orlgmj (mgr.34412) 1255 : cluster [DBG] pgmap v698: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:41.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:11:40 gibba045 bash[25517]: audit 2021-03-10T14:11:39.981999+0000 mgr.gibba045.orlgmj (mgr.34412) 1256 : audit [DBG] from='client.54892 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:11:41.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:11:40 gibba045 bash[25517]: audit 2021-03-10T14:11:40.254661+0000 mon.a (mon.0) 722 : audit [DBG] from='client.? 172.21.2.115:0/4159000586' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:11:41.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:11:40 gibba015 bash[29377]: audit 2021-03-10T14:11:39.755547+0000 mgr.gibba045.orlgmj (mgr.34412) 1254 : audit [DBG] from='client.44898 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:11:41.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:11:40 gibba015 bash[29377]: cluster 2021-03-10T14:11:39.890417+0000 mgr.gibba045.orlgmj (mgr.34412) 1255 : cluster [DBG] pgmap v698: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:41.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:11:40 gibba015 bash[29377]: audit 2021-03-10T14:11:39.981999+0000 mgr.gibba045.orlgmj (mgr.34412) 1256 : audit [DBG] from='client.54892 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:11:41.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:11:40 gibba015 bash[29377]: audit 2021-03-10T14:11:40.254661+0000 mon.a (mon.0) 722 : audit [DBG] from='client.? 172.21.2.115:0/4159000586' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:11:41.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:11:40 gibba015 bash[30343]: audit 2021-03-10T14:11:39.755547+0000 mgr.gibba045.orlgmj (mgr.34412) 1254 : audit [DBG] from='client.44898 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:11:41.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:11:40 gibba015 bash[30343]: cluster 2021-03-10T14:11:39.890417+0000 mgr.gibba045.orlgmj (mgr.34412) 1255 : cluster [DBG] pgmap v698: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:41.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:11:40 gibba015 bash[30343]: audit 2021-03-10T14:11:39.981999+0000 mgr.gibba045.orlgmj (mgr.34412) 1256 : audit [DBG] from='client.54892 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:11:41.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:11:40 gibba015 bash[30343]: audit 2021-03-10T14:11:40.254661+0000 mon.a (mon.0) 722 : audit [DBG] from='client.? 172.21.2.115:0/4159000586' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:11:43.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:11:42 gibba045 bash[25517]: cluster 2021-03-10T14:11:41.892152+0000 mgr.gibba045.orlgmj (mgr.34412) 1257 : cluster [DBG] pgmap v699: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:43.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:11:42 gibba015 bash[29377]: cluster 2021-03-10T14:11:41.892152+0000 mgr.gibba045.orlgmj (mgr.34412) 1257 : cluster [DBG] pgmap v699: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:43.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:11:42 gibba015 bash[30343]: cluster 2021-03-10T14:11:41.892152+0000 mgr.gibba045.orlgmj (mgr.34412) 1257 : cluster [DBG] pgmap v699: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:45.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:11:44 gibba045 bash[25517]: cluster 2021-03-10T14:11:43.893387+0000 mgr.gibba045.orlgmj (mgr.34412) 1258 : cluster [DBG] pgmap v700: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:45.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:11:44 gibba015 bash[29377]: cluster 2021-03-10T14:11:43.893387+0000 mgr.gibba045.orlgmj (mgr.34412) 1258 : cluster [DBG] pgmap v700: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:45.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:11:44 gibba015 bash[30343]: cluster 2021-03-10T14:11:43.893387+0000 mgr.gibba045.orlgmj (mgr.34412) 1258 : cluster [DBG] pgmap v700: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:46.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:11:46 gibba045 bash[25517]: cephadm 2021-03-10T14:11:45.028841+0000 mgr.gibba045.orlgmj (mgr.34412) 1259 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:11:46.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:11:46 gibba015 bash[29377]: cephadm 2021-03-10T14:11:45.028841+0000 mgr.gibba045.orlgmj (mgr.34412) 1259 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:11:46.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:11:46 gibba015 bash[30343]: cephadm 2021-03-10T14:11:45.028841+0000 mgr.gibba045.orlgmj (mgr.34412) 1259 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:11:47.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:11:47 gibba045 bash[25517]: cluster 2021-03-10T14:11:45.895111+0000 mgr.gibba045.orlgmj (mgr.34412) 1260 : cluster [DBG] pgmap v701: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:47.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:11:47 gibba015 bash[29377]: cluster 2021-03-10T14:11:45.895111+0000 mgr.gibba045.orlgmj (mgr.34412) 1260 : cluster [DBG] pgmap v701: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:47.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:11:47 gibba015 bash[30343]: cluster 2021-03-10T14:11:45.895111+0000 mgr.gibba045.orlgmj (mgr.34412) 1260 : cluster [DBG] pgmap v701: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:49.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:11:49 gibba045 bash[25517]: cluster 2021-03-10T14:11:47.896686+0000 mgr.gibba045.orlgmj (mgr.34412) 1261 : cluster [DBG] pgmap v702: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:49.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:11:49 gibba015 bash[29377]: cluster 2021-03-10T14:11:47.896686+0000 mgr.gibba045.orlgmj (mgr.34412) 1261 : cluster [DBG] pgmap v702: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:49.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:11:49 gibba015 bash[30343]: cluster 2021-03-10T14:11:47.896686+0000 mgr.gibba045.orlgmj (mgr.34412) 1261 : cluster [DBG] pgmap v702: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:51.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:11:51 gibba045 bash[25517]: cluster 2021-03-10T14:11:49.898176+0000 mgr.gibba045.orlgmj (mgr.34412) 1262 : cluster [DBG] pgmap v703: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:51.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:11:51 gibba015 bash[29377]: cluster 2021-03-10T14:11:49.898176+0000 mgr.gibba045.orlgmj (mgr.34412) 1262 : cluster [DBG] pgmap v703: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:51.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:11:51 gibba015 bash[30343]: cluster 2021-03-10T14:11:49.898176+0000 mgr.gibba045.orlgmj (mgr.34412) 1262 : cluster [DBG] pgmap v703: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:53.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:11:53 gibba045 bash[25517]: cluster 2021-03-10T14:11:51.899907+0000 mgr.gibba045.orlgmj (mgr.34412) 1263 : cluster [DBG] pgmap v704: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:53.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:11:53 gibba045 bash[25517]: audit 2021-03-10T14:11:52.559955+0000 mon.c (mon.1) 409 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T14:11:53.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:11:53 gibba045 bash[25517]: audit 2021-03-10T14:11:52.560656+0000 mon.c (mon.1) 410 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:11:53.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:11:53 gibba045 bash[25517]: audit 2021-03-10T14:11:52.561385+0000 mon.c (mon.1) 411 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T14:11:53.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:11:53 gibba045 bash[25517]: audit 2021-03-10T14:11:52.561401+0000 mon.a (mon.0) 723 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T14:11:53.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:11:53 gibba045 bash[25517]: audit 2021-03-10T14:11:52.562038+0000 mon.c (mon.1) 412 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:11:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:11:53 gibba045 bash[25517]: audit 2021-03-10T14:11:52.563460+0000 mon.a (mon.0) 724 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:11:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:11:53 gibba045 bash[25517]: audit 2021-03-10T14:11:52.564365+0000 mon.a (mon.0) 725 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T14:11:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:11:53 gibba045 bash[25517]: audit 2021-03-10T14:11:52.565299+0000 mon.a (mon.0) 726 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:11:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:11:53 gibba045 bash[25517]: audit 2021-03-10T14:11:52.595142+0000 mon.c (mon.1) 413 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:11:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:11:53 gibba045 bash[25517]: audit 2021-03-10T14:11:52.595807+0000 mon.c (mon.1) 414 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:11:53.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:11:53 gibba045 bash[25517]: audit 2021-03-10T14:11:52.596443+0000 mon.a (mon.0) 727 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:11:53.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:11:53 gibba045 bash[25517]: audit 2021-03-10T14:11:52.597757+0000 mon.a (mon.0) 728 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:11:53.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:11:53 gibba015 bash[29377]: cluster 2021-03-10T14:11:51.899907+0000 mgr.gibba045.orlgmj (mgr.34412) 1263 : cluster [DBG] pgmap v704: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:53.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:11:53 gibba015 bash[29377]: audit 2021-03-10T14:11:52.559955+0000 mon.c (mon.1) 409 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T14:11:53.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:11:53 gibba015 bash[29377]: audit 2021-03-10T14:11:52.560656+0000 mon.c (mon.1) 410 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:11:53.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:11:53 gibba015 bash[29377]: audit 2021-03-10T14:11:52.561385+0000 mon.c (mon.1) 411 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T14:11:53.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:11:53 gibba015 bash[29377]: audit 2021-03-10T14:11:52.561401+0000 mon.a (mon.0) 723 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T14:11:53.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:11:53 gibba015 bash[29377]: audit 2021-03-10T14:11:52.562038+0000 mon.c (mon.1) 412 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:11:53.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:11:53 gibba015 bash[29377]: audit 2021-03-10T14:11:52.563460+0000 mon.a (mon.0) 724 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:11:53.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:11:53 gibba015 bash[29377]: audit 2021-03-10T14:11:52.564365+0000 mon.a (mon.0) 725 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T14:11:53.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:11:53 gibba015 bash[29377]: audit 2021-03-10T14:11:52.565299+0000 mon.a (mon.0) 726 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:11:53.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:11:53 gibba015 bash[29377]: audit 2021-03-10T14:11:52.595142+0000 mon.c (mon.1) 413 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:11:53.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:11:53 gibba015 bash[29377]: audit 2021-03-10T14:11:52.595807+0000 mon.c (mon.1) 414 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:11:53.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:11:53 gibba015 bash[29377]: audit 2021-03-10T14:11:52.596443+0000 mon.a (mon.0) 727 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:11:53.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:11:53 gibba015 bash[29377]: audit 2021-03-10T14:11:52.597757+0000 mon.a (mon.0) 728 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:11:53.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:11:53 gibba015 bash[30343]: cluster 2021-03-10T14:11:51.899907+0000 mgr.gibba045.orlgmj (mgr.34412) 1263 : cluster [DBG] pgmap v704: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:53.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:11:53 gibba015 bash[30343]: audit 2021-03-10T14:11:52.559955+0000 mon.c (mon.1) 409 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T14:11:53.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:11:53 gibba015 bash[30343]: audit 2021-03-10T14:11:52.560656+0000 mon.c (mon.1) 410 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:11:53.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:11:53 gibba015 bash[30343]: audit 2021-03-10T14:11:52.561385+0000 mon.c (mon.1) 411 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T14:11:53.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:11:53 gibba015 bash[30343]: audit 2021-03-10T14:11:52.561401+0000 mon.a (mon.0) 723 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T14:11:53.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:11:53 gibba015 bash[30343]: audit 2021-03-10T14:11:52.562038+0000 mon.c (mon.1) 412 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:11:53.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:11:53 gibba015 bash[30343]: audit 2021-03-10T14:11:52.563460+0000 mon.a (mon.0) 724 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:11:53.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:11:53 gibba015 bash[30343]: audit 2021-03-10T14:11:52.564365+0000 mon.a (mon.0) 725 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T14:11:53.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:11:53 gibba015 bash[30343]: audit 2021-03-10T14:11:52.565299+0000 mon.a (mon.0) 726 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:11:53.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:11:53 gibba015 bash[30343]: audit 2021-03-10T14:11:52.595142+0000 mon.c (mon.1) 413 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:11:53.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:11:53 gibba015 bash[30343]: audit 2021-03-10T14:11:52.595807+0000 mon.c (mon.1) 414 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:11:53.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:11:53 gibba015 bash[30343]: audit 2021-03-10T14:11:52.596443+0000 mon.a (mon.0) 727 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:11:53.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:11:53 gibba015 bash[30343]: audit 2021-03-10T14:11:52.597757+0000 mon.a (mon.0) 728 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:11:55.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:11:55 gibba045 bash[25517]: cluster 2021-03-10T14:11:53.901177+0000 mgr.gibba045.orlgmj (mgr.34412) 1264 : cluster [DBG] pgmap v705: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:55.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:11:55 gibba015 bash[29377]: cluster 2021-03-10T14:11:53.901177+0000 mgr.gibba045.orlgmj (mgr.34412) 1264 : cluster [DBG] pgmap v705: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:55.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:11:55 gibba015 bash[30343]: cluster 2021-03-10T14:11:53.901177+0000 mgr.gibba045.orlgmj (mgr.34412) 1264 : cluster [DBG] pgmap v705: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:57.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:11:57 gibba045 bash[25517]: cluster 2021-03-10T14:11:55.902885+0000 mgr.gibba045.orlgmj (mgr.34412) 1265 : cluster [DBG] pgmap v706: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:57.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:11:57 gibba015 bash[29377]: cluster 2021-03-10T14:11:55.902885+0000 mgr.gibba045.orlgmj (mgr.34412) 1265 : cluster [DBG] pgmap v706: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:57.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:11:57 gibba015 bash[30343]: cluster 2021-03-10T14:11:55.902885+0000 mgr.gibba045.orlgmj (mgr.34412) 1265 : cluster [DBG] pgmap v706: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:59.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:11:59 gibba015 bash[29377]: cluster 2021-03-10T14:11:57.904486+0000 mgr.gibba045.orlgmj (mgr.34412) 1266 : cluster [DBG] pgmap v707: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:59.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:11:59 gibba015 bash[30343]: cluster 2021-03-10T14:11:57.904486+0000 mgr.gibba045.orlgmj (mgr.34412) 1266 : cluster [DBG] pgmap v707: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:59.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:11:59 gibba045 bash[25517]: cluster 2021-03-10T14:11:57.904486+0000 mgr.gibba045.orlgmj (mgr.34412) 1266 : cluster [DBG] pgmap v707: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:01.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:12:01 gibba015 bash[29377]: cluster 2021-03-10T14:11:59.905873+0000 mgr.gibba045.orlgmj (mgr.34412) 1267 : cluster [DBG] pgmap v708: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:01.497 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:12:01 gibba015 bash[29377]: cephadm 2021-03-10T14:12:00.044533+0000 mgr.gibba045.orlgmj (mgr.34412) 1268 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:12:01.498 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:12:01 gibba015 bash[30343]: cluster 2021-03-10T14:11:59.905873+0000 mgr.gibba045.orlgmj (mgr.34412) 1267 : cluster [DBG] pgmap v708: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:01.498 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:12:01 gibba015 bash[30343]: cephadm 2021-03-10T14:12:00.044533+0000 mgr.gibba045.orlgmj (mgr.34412) 1268 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:12:01.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:12:01 gibba045 bash[25517]: cluster 2021-03-10T14:11:59.905873+0000 mgr.gibba045.orlgmj (mgr.34412) 1267 : cluster [DBG] pgmap v708: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:01.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:12:01 gibba045 bash[25517]: cephadm 2021-03-10T14:12:00.044533+0000 mgr.gibba045.orlgmj (mgr.34412) 1268 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:12:03.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:12:03 gibba015 bash[29377]: cluster 2021-03-10T14:12:01.907354+0000 mgr.gibba045.orlgmj (mgr.34412) 1269 : cluster [DBG] pgmap v709: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:03.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:12:03 gibba015 bash[30343]: cluster 2021-03-10T14:12:01.907354+0000 mgr.gibba045.orlgmj (mgr.34412) 1269 : cluster [DBG] pgmap v709: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:03.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:12:03 gibba045 bash[25517]: cluster 2021-03-10T14:12:01.907354+0000 mgr.gibba045.orlgmj (mgr.34412) 1269 : cluster [DBG] pgmap v709: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:05.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:12:05 gibba015 bash[29377]: cluster 2021-03-10T14:12:03.908540+0000 mgr.gibba045.orlgmj (mgr.34412) 1270 : cluster [DBG] pgmap v710: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:05.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:12:05 gibba015 bash[30343]: cluster 2021-03-10T14:12:03.908540+0000 mgr.gibba045.orlgmj (mgr.34412) 1270 : cluster [DBG] pgmap v710: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:05.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:12:05 gibba045 bash[25517]: cluster 2021-03-10T14:12:03.908540+0000 mgr.gibba045.orlgmj (mgr.34412) 1270 : cluster [DBG] pgmap v710: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:07.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:12:07 gibba015 bash[29377]: cluster 2021-03-10T14:12:05.909949+0000 mgr.gibba045.orlgmj (mgr.34412) 1271 : cluster [DBG] pgmap v711: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:07.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:12:07 gibba015 bash[30343]: cluster 2021-03-10T14:12:05.909949+0000 mgr.gibba045.orlgmj (mgr.34412) 1271 : cluster [DBG] pgmap v711: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:07.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:12:07 gibba045 bash[25517]: cluster 2021-03-10T14:12:05.909949+0000 mgr.gibba045.orlgmj (mgr.34412) 1271 : cluster [DBG] pgmap v711: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:09.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:12:09 gibba015 bash[29377]: cluster 2021-03-10T14:12:07.911433+0000 mgr.gibba045.orlgmj (mgr.34412) 1272 : cluster [DBG] pgmap v712: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:09.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:12:09 gibba015 bash[30343]: cluster 2021-03-10T14:12:07.911433+0000 mgr.gibba045.orlgmj (mgr.34412) 1272 : cluster [DBG] pgmap v712: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:09.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:12:09 gibba045 bash[25517]: cluster 2021-03-10T14:12:07.911433+0000 mgr.gibba045.orlgmj (mgr.34412) 1272 : cluster [DBG] pgmap v712: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:10.497 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:12:10.725 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:12:10.726 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (22m) 9m ago 28m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:12:10.726 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (28m) 7m ago 28m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:12:10.726 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (23m) 7m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:12:10.726 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (23m) 7m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:12:10.727 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (22m) 9m ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:12:10.727 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (22m) 9m ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:12:10.727 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (21m) 7m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:12:10.727 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (22m) 9m ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:12:10.727 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (28m) 9m ago 28m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:12:10.728 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (28m) 7m ago 28m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:12:10.728 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (21m) 9m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:12:10.728 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (20m) 9m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:12:10.728 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (20m) 9m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:12:10.729 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (19m) 9m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:12:10.729 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (19m) 7m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:12:10.729 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (19m) 7m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:12:10.729 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (18m) 7m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:12:10.729 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (18m) 7m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:12:10.730 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (27m) 7m ago 28m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:12:10.730 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 7m ago 26m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:12:10.973 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:12:10.973 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:12:10.973 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:12:10.973 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:12:10.974 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:12:10.974 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:12:10.974 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:12:10.974 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:12:10.975 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:12:10.975 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:12:10.975 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:12:10.975 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:12:10.975 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:12:10.976 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:12:10.976 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:12:11.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:12:11 gibba015 bash[29377]: cluster 2021-03-10T14:12:09.913154+0000 mgr.gibba045.orlgmj (mgr.34412) 1273 : cluster [DBG] pgmap v713: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:11.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:12:11 gibba015 bash[29377]: audit 2021-03-10T14:12:10.971272+0000 mon.c (mon.1) 415 : audit [DBG] from='client.? 172.21.2.115:0/1983552154' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:12:11.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:12:11 gibba015 bash[30343]: cluster 2021-03-10T14:12:09.913154+0000 mgr.gibba045.orlgmj (mgr.34412) 1273 : cluster [DBG] pgmap v713: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:11.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:12:11 gibba015 bash[30343]: audit 2021-03-10T14:12:10.971272+0000 mon.c (mon.1) 415 : audit [DBG] from='client.? 172.21.2.115:0/1983552154' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:12:11.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:12:11 gibba045 bash[25517]: cluster 2021-03-10T14:12:09.913154+0000 mgr.gibba045.orlgmj (mgr.34412) 1273 : cluster [DBG] pgmap v713: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:11.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:12:11 gibba045 bash[25517]: audit 2021-03-10T14:12:10.971272+0000 mon.c (mon.1) 415 : audit [DBG] from='client.? 172.21.2.115:0/1983552154' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:12:12.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:12:12 gibba015 bash[29377]: audit 2021-03-10T14:12:10.489183+0000 mgr.gibba045.orlgmj (mgr.34412) 1274 : audit [DBG] from='client.54904 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:12:12.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:12:12 gibba015 bash[29377]: audit 2021-03-10T14:12:10.713528+0000 mgr.gibba045.orlgmj (mgr.34412) 1275 : audit [DBG] from='client.44922 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:12:12.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:12:12 gibba015 bash[30343]: audit 2021-03-10T14:12:10.489183+0000 mgr.gibba045.orlgmj (mgr.34412) 1274 : audit [DBG] from='client.54904 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:12:12.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:12:12 gibba015 bash[30343]: audit 2021-03-10T14:12:10.713528+0000 mgr.gibba045.orlgmj (mgr.34412) 1275 : audit [DBG] from='client.44922 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:12:12.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:12:12 gibba045 bash[25517]: audit 2021-03-10T14:12:10.489183+0000 mgr.gibba045.orlgmj (mgr.34412) 1274 : audit [DBG] from='client.54904 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:12:12.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:12:12 gibba045 bash[25517]: audit 2021-03-10T14:12:10.713528+0000 mgr.gibba045.orlgmj (mgr.34412) 1275 : audit [DBG] from='client.44922 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:12:13.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:12:13 gibba015 bash[29377]: cluster 2021-03-10T14:12:11.914632+0000 mgr.gibba045.orlgmj (mgr.34412) 1276 : cluster [DBG] pgmap v714: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:13.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:12:13 gibba015 bash[30343]: cluster 2021-03-10T14:12:11.914632+0000 mgr.gibba045.orlgmj (mgr.34412) 1276 : cluster [DBG] pgmap v714: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:13.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:12:13 gibba045 bash[25517]: cluster 2021-03-10T14:12:11.914632+0000 mgr.gibba045.orlgmj (mgr.34412) 1276 : cluster [DBG] pgmap v714: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:15.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:12:15 gibba015 bash[29377]: cluster 2021-03-10T14:12:13.915849+0000 mgr.gibba045.orlgmj (mgr.34412) 1277 : cluster [DBG] pgmap v715: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:15.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:12:15 gibba015 bash[29377]: audit 2021-03-10T14:12:15.047745+0000 mon.c (mon.1) 416 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:12:15.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:12:15 gibba015 bash[29377]: audit 2021-03-10T14:12:15.053700+0000 mon.c (mon.1) 417 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T14:12:15.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:12:15 gibba015 bash[30343]: cluster 2021-03-10T14:12:13.915849+0000 mgr.gibba045.orlgmj (mgr.34412) 1277 : cluster [DBG] pgmap v715: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:15.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:12:15 gibba015 bash[30343]: audit 2021-03-10T14:12:15.047745+0000 mon.c (mon.1) 416 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:12:15.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:12:15 gibba015 bash[30343]: audit 2021-03-10T14:12:15.053700+0000 mon.c (mon.1) 417 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T14:12:15.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:12:15 gibba045 bash[25517]: cluster 2021-03-10T14:12:13.915849+0000 mgr.gibba045.orlgmj (mgr.34412) 1277 : cluster [DBG] pgmap v715: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:15.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:12:15 gibba045 bash[25517]: audit 2021-03-10T14:12:15.047745+0000 mon.c (mon.1) 416 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:12:15.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:12:15 gibba045 bash[25517]: audit 2021-03-10T14:12:15.053700+0000 mon.c (mon.1) 417 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T14:12:16.403 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:12:16 gibba015 bash[30343]: cephadm 2021-03-10T14:12:15.055319+0000 mgr.gibba045.orlgmj (mgr.34412) 1278 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:12:16.404 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:12:16 gibba015 bash[29377]: cephadm 2021-03-10T14:12:15.055319+0000 mgr.gibba045.orlgmj (mgr.34412) 1278 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:12:16.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:12:16 gibba045 bash[25517]: cephadm 2021-03-10T14:12:15.055319+0000 mgr.gibba045.orlgmj (mgr.34412) 1278 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:12:17.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:12:17 gibba015 bash[29377]: cluster 2021-03-10T14:12:15.917611+0000 mgr.gibba045.orlgmj (mgr.34412) 1279 : cluster [DBG] pgmap v716: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:17.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:12:17 gibba015 bash[30343]: cluster 2021-03-10T14:12:15.917611+0000 mgr.gibba045.orlgmj (mgr.34412) 1279 : cluster [DBG] pgmap v716: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:17.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:12:17 gibba045 bash[25517]: cluster 2021-03-10T14:12:15.917611+0000 mgr.gibba045.orlgmj (mgr.34412) 1279 : cluster [DBG] pgmap v716: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:19.415 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:12:19 gibba015 bash[29377]: cluster 2021-03-10T14:12:17.919121+0000 mgr.gibba045.orlgmj (mgr.34412) 1280 : cluster [DBG] pgmap v717: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:19.416 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:12:19 gibba015 bash[30343]: cluster 2021-03-10T14:12:17.919121+0000 mgr.gibba045.orlgmj (mgr.34412) 1280 : cluster [DBG] pgmap v717: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:19.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:12:19 gibba045 bash[25517]: cluster 2021-03-10T14:12:17.919121+0000 mgr.gibba045.orlgmj (mgr.34412) 1280 : cluster [DBG] pgmap v717: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:20.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:12:20 gibba015 bash[29377]: audit 2021-03-10T14:12:19.916478+0000 mon.c (mon.1) 418 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:12:20.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:12:20 gibba015 bash[29377]: audit 2021-03-10T14:12:20.100212+0000 mon.a (mon.0) 729 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:12:20.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:12:20 gibba015 bash[30343]: audit 2021-03-10T14:12:19.916478+0000 mon.c (mon.1) 418 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:12:20.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:12:20 gibba015 bash[30343]: audit 2021-03-10T14:12:20.100212+0000 mon.a (mon.0) 729 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:12:20.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:12:20 gibba045 bash[25517]: audit 2021-03-10T14:12:19.916478+0000 mon.c (mon.1) 418 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:12:20.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:12:20 gibba045 bash[25517]: audit 2021-03-10T14:12:20.100212+0000 mon.a (mon.0) 729 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:12:21.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:12:21 gibba015 bash[29377]: cluster 2021-03-10T14:12:19.920640+0000 mgr.gibba045.orlgmj (mgr.34412) 1281 : cluster [DBG] pgmap v718: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:21.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:12:21 gibba015 bash[29377]: cephadm 2021-03-10T14:12:20.104017+0000 mgr.gibba045.orlgmj (mgr.34412) 1282 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:12:21.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:12:21 gibba015 bash[29377]: audit 2021-03-10T14:12:20.296932+0000 mon.a (mon.0) 730 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:12:21.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:12:21 gibba015 bash[29377]: audit 2021-03-10T14:12:20.304667+0000 mon.c (mon.1) 419 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:12:21.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:12:21 gibba015 bash[29377]: audit 2021-03-10T14:12:20.306350+0000 mon.c (mon.1) 420 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:12:21.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:12:21 gibba015 bash[29377]: audit 2021-03-10T14:12:20.307791+0000 mon.c (mon.1) 421 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:12:21.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:12:21 gibba015 bash[29377]: audit 2021-03-10T14:12:20.309177+0000 mon.c (mon.1) 422 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:12:21.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:12:21 gibba015 bash[29377]: audit 2021-03-10T14:12:20.312164+0000 mon.c (mon.1) 423 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:12:21.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:12:21 gibba015 bash[29377]: audit 2021-03-10T14:12:20.313682+0000 mon.c (mon.1) 424 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:12:21.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:12:21 gibba015 bash[30343]: cluster 2021-03-10T14:12:19.920640+0000 mgr.gibba045.orlgmj (mgr.34412) 1281 : cluster [DBG] pgmap v718: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:21.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:12:21 gibba015 bash[30343]: cephadm 2021-03-10T14:12:20.104017+0000 mgr.gibba045.orlgmj (mgr.34412) 1282 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:12:21.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:12:21 gibba015 bash[30343]: audit 2021-03-10T14:12:20.296932+0000 mon.a (mon.0) 730 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:12:21.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:12:21 gibba015 bash[30343]: audit 2021-03-10T14:12:20.304667+0000 mon.c (mon.1) 419 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:12:21.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:12:21 gibba015 bash[30343]: audit 2021-03-10T14:12:20.306350+0000 mon.c (mon.1) 420 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:12:21.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:12:21 gibba015 bash[30343]: audit 2021-03-10T14:12:20.307791+0000 mon.c (mon.1) 421 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:12:21.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:12:21 gibba015 bash[30343]: audit 2021-03-10T14:12:20.309177+0000 mon.c (mon.1) 422 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:12:21.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:12:21 gibba015 bash[30343]: audit 2021-03-10T14:12:20.312164+0000 mon.c (mon.1) 423 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:12:21.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:12:21 gibba015 bash[30343]: audit 2021-03-10T14:12:20.313682+0000 mon.c (mon.1) 424 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:12:21.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:12:21 gibba045 bash[25517]: cluster 2021-03-10T14:12:19.920640+0000 mgr.gibba045.orlgmj (mgr.34412) 1281 : cluster [DBG] pgmap v718: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:21.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:12:21 gibba045 bash[25517]: cephadm 2021-03-10T14:12:20.104017+0000 mgr.gibba045.orlgmj (mgr.34412) 1282 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:12:21.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:12:21 gibba045 bash[25517]: audit 2021-03-10T14:12:20.296932+0000 mon.a (mon.0) 730 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:12:21.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:12:21 gibba045 bash[25517]: audit 2021-03-10T14:12:20.304667+0000 mon.c (mon.1) 419 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:12:21.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:12:21 gibba045 bash[25517]: audit 2021-03-10T14:12:20.306350+0000 mon.c (mon.1) 420 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:12:21.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:12:21 gibba045 bash[25517]: audit 2021-03-10T14:12:20.307791+0000 mon.c (mon.1) 421 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:12:21.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:12:21 gibba045 bash[25517]: audit 2021-03-10T14:12:20.309177+0000 mon.c (mon.1) 422 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:12:21.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:12:21 gibba045 bash[25517]: audit 2021-03-10T14:12:20.312164+0000 mon.c (mon.1) 423 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:12:21.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:12:21 gibba045 bash[25517]: audit 2021-03-10T14:12:20.313682+0000 mon.c (mon.1) 424 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:12:22.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:12:22 gibba015 bash[29377]: cephadm 2021-03-10T14:12:20.305519+0000 mgr.gibba045.orlgmj (mgr.34412) 1283 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:12:22.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:12:22 gibba015 bash[29377]: cephadm 2021-03-10T14:12:20.307676+0000 mgr.gibba045.orlgmj (mgr.34412) 1284 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:12:22.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:12:22 gibba015 bash[29377]: cephadm 2021-03-10T14:12:20.309060+0000 mgr.gibba045.orlgmj (mgr.34412) 1285 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:12:22.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:12:22 gibba015 bash[29377]: cephadm 2021-03-10T14:12:20.309099+0000 mgr.gibba045.orlgmj (mgr.34412) 1286 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:12:22.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:12:22 gibba015 bash[29377]: cephadm 2021-03-10T14:12:20.310462+0000 mgr.gibba045.orlgmj (mgr.34412) 1287 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:12:22.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:12:22 gibba015 bash[29377]: cephadm 2021-03-10T14:12:20.310501+0000 mgr.gibba045.orlgmj (mgr.34412) 1288 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:12:22.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:12:22 gibba015 bash[29377]: cephadm 2021-03-10T14:12:20.311821+0000 mgr.gibba045.orlgmj (mgr.34412) 1289 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:12:22.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:12:22 gibba015 bash[29377]: cephadm 2021-03-10T14:12:20.313395+0000 mgr.gibba045.orlgmj (mgr.34412) 1290 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:12:22.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:12:22 gibba015 bash[29377]: cephadm 2021-03-10T14:12:20.313432+0000 mgr.gibba045.orlgmj (mgr.34412) 1291 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:12:22.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:12:22 gibba015 bash[29377]: cephadm 2021-03-10T14:12:20.314959+0000 mgr.gibba045.orlgmj (mgr.34412) 1292 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:12:22.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:12:22 gibba015 bash[29377]: cephadm 2021-03-10T14:12:20.315305+0000 mgr.gibba045.orlgmj (mgr.34412) 1293 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:12:22.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:12:22 gibba015 bash[29377]: cephadm 2021-03-10T14:12:20.316774+0000 mgr.gibba045.orlgmj (mgr.34412) 1294 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:12:22.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:12:22 gibba015 bash[29377]: cephadm 2021-03-10T14:12:20.316817+0000 mgr.gibba045.orlgmj (mgr.34412) 1295 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:12:22.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:12:22 gibba015 bash[29377]: cephadm 2021-03-10T14:12:20.317003+0000 mgr.gibba045.orlgmj (mgr.34412) 1296 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:12:22.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:12:22 gibba015 bash[30343]: cephadm 2021-03-10T14:12:20.305519+0000 mgr.gibba045.orlgmj (mgr.34412) 1283 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:12:22.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:12:22 gibba015 bash[30343]: cephadm 2021-03-10T14:12:20.307676+0000 mgr.gibba045.orlgmj (mgr.34412) 1284 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:12:22.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:12:22 gibba015 bash[30343]: cephadm 2021-03-10T14:12:20.309060+0000 mgr.gibba045.orlgmj (mgr.34412) 1285 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:12:22.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:12:22 gibba015 bash[30343]: cephadm 2021-03-10T14:12:20.309099+0000 mgr.gibba045.orlgmj (mgr.34412) 1286 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:12:22.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:12:22 gibba015 bash[30343]: cephadm 2021-03-10T14:12:20.310462+0000 mgr.gibba045.orlgmj (mgr.34412) 1287 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:12:22.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:12:22 gibba015 bash[30343]: cephadm 2021-03-10T14:12:20.310501+0000 mgr.gibba045.orlgmj (mgr.34412) 1288 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:12:22.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:12:22 gibba015 bash[30343]: cephadm 2021-03-10T14:12:20.311821+0000 mgr.gibba045.orlgmj (mgr.34412) 1289 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:12:22.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:12:22 gibba015 bash[30343]: cephadm 2021-03-10T14:12:20.313395+0000 mgr.gibba045.orlgmj (mgr.34412) 1290 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:12:22.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:12:22 gibba015 bash[30343]: cephadm 2021-03-10T14:12:20.313432+0000 mgr.gibba045.orlgmj (mgr.34412) 1291 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:12:22.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:12:22 gibba015 bash[30343]: cephadm 2021-03-10T14:12:20.314959+0000 mgr.gibba045.orlgmj (mgr.34412) 1292 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:12:22.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:12:22 gibba015 bash[30343]: cephadm 2021-03-10T14:12:20.315305+0000 mgr.gibba045.orlgmj (mgr.34412) 1293 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:12:22.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:12:22 gibba015 bash[30343]: cephadm 2021-03-10T14:12:20.316774+0000 mgr.gibba045.orlgmj (mgr.34412) 1294 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:12:22.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:12:22 gibba015 bash[30343]: cephadm 2021-03-10T14:12:20.316817+0000 mgr.gibba045.orlgmj (mgr.34412) 1295 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:12:22.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:12:22 gibba015 bash[30343]: cephadm 2021-03-10T14:12:20.317003+0000 mgr.gibba045.orlgmj (mgr.34412) 1296 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:12:22.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:12:22 gibba045 bash[25517]: cephadm 2021-03-10T14:12:20.305519+0000 mgr.gibba045.orlgmj (mgr.34412) 1283 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:12:22.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:12:22 gibba045 bash[25517]: cephadm 2021-03-10T14:12:20.307676+0000 mgr.gibba045.orlgmj (mgr.34412) 1284 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:12:22.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:12:22 gibba045 bash[25517]: cephadm 2021-03-10T14:12:20.309060+0000 mgr.gibba045.orlgmj (mgr.34412) 1285 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:12:22.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:12:22 gibba045 bash[25517]: cephadm 2021-03-10T14:12:20.309099+0000 mgr.gibba045.orlgmj (mgr.34412) 1286 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:12:22.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:12:22 gibba045 bash[25517]: cephadm 2021-03-10T14:12:20.310462+0000 mgr.gibba045.orlgmj (mgr.34412) 1287 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:12:22.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:12:22 gibba045 bash[25517]: cephadm 2021-03-10T14:12:20.310501+0000 mgr.gibba045.orlgmj (mgr.34412) 1288 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:12:22.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:12:22 gibba045 bash[25517]: cephadm 2021-03-10T14:12:20.311821+0000 mgr.gibba045.orlgmj (mgr.34412) 1289 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:12:22.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:12:22 gibba045 bash[25517]: cephadm 2021-03-10T14:12:20.313395+0000 mgr.gibba045.orlgmj (mgr.34412) 1290 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:12:22.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:12:22 gibba045 bash[25517]: cephadm 2021-03-10T14:12:20.313432+0000 mgr.gibba045.orlgmj (mgr.34412) 1291 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:12:22.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:12:22 gibba045 bash[25517]: cephadm 2021-03-10T14:12:20.314959+0000 mgr.gibba045.orlgmj (mgr.34412) 1292 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:12:22.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:12:22 gibba045 bash[25517]: cephadm 2021-03-10T14:12:20.315305+0000 mgr.gibba045.orlgmj (mgr.34412) 1293 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:12:22.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:12:22 gibba045 bash[25517]: cephadm 2021-03-10T14:12:20.316774+0000 mgr.gibba045.orlgmj (mgr.34412) 1294 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:12:22.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:12:22 gibba045 bash[25517]: cephadm 2021-03-10T14:12:20.316817+0000 mgr.gibba045.orlgmj (mgr.34412) 1295 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:12:22.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:12:22 gibba045 bash[25517]: cephadm 2021-03-10T14:12:20.317003+0000 mgr.gibba045.orlgmj (mgr.34412) 1296 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:12:23.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:12:23 gibba015 bash[29377]: cluster 2021-03-10T14:12:21.922091+0000 mgr.gibba045.orlgmj (mgr.34412) 1297 : cluster [DBG] pgmap v719: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:23.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:12:23 gibba015 bash[30343]: cluster 2021-03-10T14:12:21.922091+0000 mgr.gibba045.orlgmj (mgr.34412) 1297 : cluster [DBG] pgmap v719: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:23.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:12:23 gibba045 bash[25517]: cluster 2021-03-10T14:12:21.922091+0000 mgr.gibba045.orlgmj (mgr.34412) 1297 : cluster [DBG] pgmap v719: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:25.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:12:25 gibba015 bash[29377]: cluster 2021-03-10T14:12:23.923432+0000 mgr.gibba045.orlgmj (mgr.34412) 1298 : cluster [DBG] pgmap v720: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:25.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:12:25 gibba015 bash[30343]: cluster 2021-03-10T14:12:23.923432+0000 mgr.gibba045.orlgmj (mgr.34412) 1298 : cluster [DBG] pgmap v720: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:25.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:12:25 gibba045 bash[25517]: cluster 2021-03-10T14:12:23.923432+0000 mgr.gibba045.orlgmj (mgr.34412) 1298 : cluster [DBG] pgmap v720: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:27.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:12:27 gibba015 bash[29377]: cluster 2021-03-10T14:12:25.925092+0000 mgr.gibba045.orlgmj (mgr.34412) 1299 : cluster [DBG] pgmap v721: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:27.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:12:27 gibba015 bash[30343]: cluster 2021-03-10T14:12:25.925092+0000 mgr.gibba045.orlgmj (mgr.34412) 1299 : cluster [DBG] pgmap v721: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:27.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:12:27 gibba045 bash[25517]: cluster 2021-03-10T14:12:25.925092+0000 mgr.gibba045.orlgmj (mgr.34412) 1299 : cluster [DBG] pgmap v721: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:29.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:12:29 gibba015 bash[29377]: cluster 2021-03-10T14:12:27.926468+0000 mgr.gibba045.orlgmj (mgr.34412) 1300 : cluster [DBG] pgmap v722: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:29.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:12:29 gibba015 bash[30343]: cluster 2021-03-10T14:12:27.926468+0000 mgr.gibba045.orlgmj (mgr.34412) 1300 : cluster [DBG] pgmap v722: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:29.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:12:29 gibba045 bash[25517]: cluster 2021-03-10T14:12:27.926468+0000 mgr.gibba045.orlgmj (mgr.34412) 1300 : cluster [DBG] pgmap v722: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:31.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:12:31 gibba015 bash[29377]: cluster 2021-03-10T14:12:29.927946+0000 mgr.gibba045.orlgmj (mgr.34412) 1301 : cluster [DBG] pgmap v723: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:31.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:12:31 gibba015 bash[30343]: cluster 2021-03-10T14:12:29.927946+0000 mgr.gibba045.orlgmj (mgr.34412) 1301 : cluster [DBG] pgmap v723: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:31.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:12:31 gibba045 bash[25517]: cluster 2021-03-10T14:12:29.927946+0000 mgr.gibba045.orlgmj (mgr.34412) 1301 : cluster [DBG] pgmap v723: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:33.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:12:33 gibba045 bash[25517]: cluster 2021-03-10T14:12:31.929753+0000 mgr.gibba045.orlgmj (mgr.34412) 1302 : cluster [DBG] pgmap v724: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:33.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:12:33 gibba015 bash[29377]: cluster 2021-03-10T14:12:31.929753+0000 mgr.gibba045.orlgmj (mgr.34412) 1302 : cluster [DBG] pgmap v724: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:33.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:12:33 gibba015 bash[30343]: cluster 2021-03-10T14:12:31.929753+0000 mgr.gibba045.orlgmj (mgr.34412) 1302 : cluster [DBG] pgmap v724: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:35.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:12:35 gibba045 bash[25517]: cluster 2021-03-10T14:12:33.931132+0000 mgr.gibba045.orlgmj (mgr.34412) 1303 : cluster [DBG] pgmap v725: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:35.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:12:35 gibba015 bash[29377]: cluster 2021-03-10T14:12:33.931132+0000 mgr.gibba045.orlgmj (mgr.34412) 1303 : cluster [DBG] pgmap v725: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:35.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:12:35 gibba015 bash[30343]: cluster 2021-03-10T14:12:33.931132+0000 mgr.gibba045.orlgmj (mgr.34412) 1303 : cluster [DBG] pgmap v725: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:37.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:12:37 gibba045 bash[25517]: cephadm 2021-03-10T14:12:35.332805+0000 mgr.gibba045.orlgmj (mgr.34412) 1304 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:12:37.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:12:37 gibba045 bash[25517]: cluster 2021-03-10T14:12:35.933059+0000 mgr.gibba045.orlgmj (mgr.34412) 1305 : cluster [DBG] pgmap v726: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:37.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:12:37 gibba015 bash[29377]: cephadm 2021-03-10T14:12:35.332805+0000 mgr.gibba045.orlgmj (mgr.34412) 1304 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:12:37.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:12:37 gibba015 bash[29377]: cluster 2021-03-10T14:12:35.933059+0000 mgr.gibba045.orlgmj (mgr.34412) 1305 : cluster [DBG] pgmap v726: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:37.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:12:37 gibba015 bash[30343]: cephadm 2021-03-10T14:12:35.332805+0000 mgr.gibba045.orlgmj (mgr.34412) 1304 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:12:37.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:12:37 gibba015 bash[30343]: cluster 2021-03-10T14:12:35.933059+0000 mgr.gibba045.orlgmj (mgr.34412) 1305 : cluster [DBG] pgmap v726: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:39.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:12:39 gibba045 bash[25517]: cluster 2021-03-10T14:12:37.934596+0000 mgr.gibba045.orlgmj (mgr.34412) 1306 : cluster [DBG] pgmap v727: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:39.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:12:39 gibba015 bash[29377]: cluster 2021-03-10T14:12:37.934596+0000 mgr.gibba045.orlgmj (mgr.34412) 1306 : cluster [DBG] pgmap v727: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:39.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:12:39 gibba015 bash[30343]: cluster 2021-03-10T14:12:37.934596+0000 mgr.gibba045.orlgmj (mgr.34412) 1306 : cluster [DBG] pgmap v727: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:41.215 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:12:41.444 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:12:41.445 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (23m) 9m ago 28m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:12:41.445 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (28m) 8m ago 28m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:12:41.445 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (23m) 8m ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:12:41.446 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (24m) 8m ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:12:41.446 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (23m) 9m ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:12:41.446 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (22m) 9m ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:12:41.446 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (22m) 8m ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:12:41.446 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (22m) 9m ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:12:41.447 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (28m) 9m ago 28m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:12:41.447 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (28m) 8m ago 28m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:12:41.447 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (21m) 9m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:12:41.447 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (21m) 9m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:12:41.448 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (20m) 9m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:12:41.448 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (20m) 9m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:12:41.448 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (20m) 8m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:12:41.448 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (19m) 8m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:12:41.448 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (19m) 8m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:12:41.449 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (18m) 8m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:12:41.449 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (28m) 8m ago 28m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:12:41.449 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 8m ago 26m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:12:41.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:12:41 gibba045 bash[25517]: cluster 2021-03-10T14:12:39.936272+0000 mgr.gibba045.orlgmj (mgr.34412) 1307 : cluster [DBG] pgmap v728: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:41.697 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:12:41.698 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:12:41.698 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:12:41.698 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:12:41.699 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:12:41.699 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:12:41.699 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:12:41.699 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:12:41.699 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:12:41.700 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:12:41.700 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:12:41.700 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:12:41.700 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:12:41.700 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:12:41.701 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:12:41.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:12:41 gibba015 bash[29377]: cluster 2021-03-10T14:12:39.936272+0000 mgr.gibba045.orlgmj (mgr.34412) 1307 : cluster [DBG] pgmap v728: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:41.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:12:41 gibba015 bash[30343]: cluster 2021-03-10T14:12:39.936272+0000 mgr.gibba045.orlgmj (mgr.34412) 1307 : cluster [DBG] pgmap v728: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:42.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:12:42 gibba045 bash[25517]: audit 2021-03-10T14:12:41.205553+0000 mgr.gibba045.orlgmj (mgr.34412) 1308 : audit [DBG] from='client.54922 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:12:42.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:12:42 gibba045 bash[25517]: audit 2021-03-10T14:12:41.695967+0000 mon.c (mon.1) 425 : audit [DBG] from='client.? 172.21.2.115:0/2497963925' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:12:42.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:12:42 gibba015 bash[29377]: audit 2021-03-10T14:12:41.205553+0000 mgr.gibba045.orlgmj (mgr.34412) 1308 : audit [DBG] from='client.54922 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:12:42.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:12:42 gibba015 bash[29377]: audit 2021-03-10T14:12:41.695967+0000 mon.c (mon.1) 425 : audit [DBG] from='client.? 172.21.2.115:0/2497963925' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:12:42.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:12:42 gibba015 bash[30343]: audit 2021-03-10T14:12:41.205553+0000 mgr.gibba045.orlgmj (mgr.34412) 1308 : audit [DBG] from='client.54922 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:12:42.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:12:42 gibba015 bash[30343]: audit 2021-03-10T14:12:41.695967+0000 mon.c (mon.1) 425 : audit [DBG] from='client.? 172.21.2.115:0/2497963925' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:12:43.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:12:43 gibba045 bash[25517]: audit 2021-03-10T14:12:41.432023+0000 mgr.gibba045.orlgmj (mgr.34412) 1309 : audit [DBG] from='client.54928 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:12:43.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:12:43 gibba045 bash[25517]: cluster 2021-03-10T14:12:41.937985+0000 mgr.gibba045.orlgmj (mgr.34412) 1310 : cluster [DBG] pgmap v729: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:43.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:12:43 gibba015 bash[29377]: audit 2021-03-10T14:12:41.432023+0000 mgr.gibba045.orlgmj (mgr.34412) 1309 : audit [DBG] from='client.54928 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:12:43.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:12:43 gibba015 bash[29377]: cluster 2021-03-10T14:12:41.937985+0000 mgr.gibba045.orlgmj (mgr.34412) 1310 : cluster [DBG] pgmap v729: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:43.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:12:43 gibba015 bash[30343]: audit 2021-03-10T14:12:41.432023+0000 mgr.gibba045.orlgmj (mgr.34412) 1309 : audit [DBG] from='client.54928 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:12:43.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:12:43 gibba015 bash[30343]: cluster 2021-03-10T14:12:41.937985+0000 mgr.gibba045.orlgmj (mgr.34412) 1310 : cluster [DBG] pgmap v729: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:45.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:12:45 gibba045 bash[25517]: cluster 2021-03-10T14:12:43.939219+0000 mgr.gibba045.orlgmj (mgr.34412) 1311 : cluster [DBG] pgmap v730: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:45.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:12:45 gibba015 bash[29377]: cluster 2021-03-10T14:12:43.939219+0000 mgr.gibba045.orlgmj (mgr.34412) 1311 : cluster [DBG] pgmap v730: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:45.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:12:45 gibba015 bash[30343]: cluster 2021-03-10T14:12:43.939219+0000 mgr.gibba045.orlgmj (mgr.34412) 1311 : cluster [DBG] pgmap v730: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:46.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:12:46 gibba015 bash[29377]: cluster 2021-03-10T14:12:45.940964+0000 mgr.gibba045.orlgmj (mgr.34412) 1312 : cluster [DBG] pgmap v731: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:46.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:12:46 gibba015 bash[30343]: cluster 2021-03-10T14:12:45.940964+0000 mgr.gibba045.orlgmj (mgr.34412) 1312 : cluster [DBG] pgmap v731: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:46.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:12:46 gibba045 bash[25517]: cluster 2021-03-10T14:12:45.940964+0000 mgr.gibba045.orlgmj (mgr.34412) 1312 : cluster [DBG] pgmap v731: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:49.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:12:49 gibba045 bash[25517]: cluster 2021-03-10T14:12:47.942428+0000 mgr.gibba045.orlgmj (mgr.34412) 1313 : cluster [DBG] pgmap v732: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:49.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:12:49 gibba015 bash[29377]: cluster 2021-03-10T14:12:47.942428+0000 mgr.gibba045.orlgmj (mgr.34412) 1313 : cluster [DBG] pgmap v732: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:49.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:12:49 gibba015 bash[30343]: cluster 2021-03-10T14:12:47.942428+0000 mgr.gibba045.orlgmj (mgr.34412) 1313 : cluster [DBG] pgmap v732: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:51.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:12:51 gibba045 bash[25517]: cluster 2021-03-10T14:12:49.943998+0000 mgr.gibba045.orlgmj (mgr.34412) 1314 : cluster [DBG] pgmap v733: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:51.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:12:51 gibba015 bash[29377]: cluster 2021-03-10T14:12:49.943998+0000 mgr.gibba045.orlgmj (mgr.34412) 1314 : cluster [DBG] pgmap v733: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:51.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:12:51 gibba015 bash[30343]: cluster 2021-03-10T14:12:49.943998+0000 mgr.gibba045.orlgmj (mgr.34412) 1314 : cluster [DBG] pgmap v733: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:52.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:12:52 gibba045 bash[25517]: cephadm 2021-03-10T14:12:50.348771+0000 mgr.gibba045.orlgmj (mgr.34412) 1315 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:12:52.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:12:52 gibba015 bash[29377]: cephadm 2021-03-10T14:12:50.348771+0000 mgr.gibba045.orlgmj (mgr.34412) 1315 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:12:52.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:12:52 gibba015 bash[30343]: cephadm 2021-03-10T14:12:50.348771+0000 mgr.gibba045.orlgmj (mgr.34412) 1315 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:12:53.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:12:53 gibba045 bash[25517]: cluster 2021-03-10T14:12:51.945820+0000 mgr.gibba045.orlgmj (mgr.34412) 1316 : cluster [DBG] pgmap v734: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:53.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:12:53 gibba045 bash[25517]: audit 2021-03-10T14:12:52.571018+0000 mon.c (mon.1) 426 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T14:12:53.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:12:53 gibba045 bash[25517]: audit 2021-03-10T14:12:52.571775+0000 mon.c (mon.1) 427 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:12:53.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:12:53 gibba045 bash[25517]: audit 2021-03-10T14:12:52.572328+0000 mon.a (mon.0) 731 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T14:12:53.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:12:53 gibba045 bash[25517]: audit 2021-03-10T14:12:52.572455+0000 mon.c (mon.1) 428 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:12:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:12:53 gibba045 bash[25517]: audit 2021-03-10T14:12:52.573155+0000 mon.c (mon.1) 429 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T14:12:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:12:53 gibba045 bash[25517]: audit 2021-03-10T14:12:52.574612+0000 mon.a (mon.0) 732 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:12:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:12:53 gibba045 bash[25517]: audit 2021-03-10T14:12:52.575558+0000 mon.a (mon.0) 733 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:12:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:12:53 gibba045 bash[25517]: audit 2021-03-10T14:12:52.576484+0000 mon.a (mon.0) 734 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T14:12:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:12:53 gibba045 bash[25517]: audit 2021-03-10T14:12:52.599728+0000 mon.c (mon.1) 430 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:12:53.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:12:53 gibba045 bash[25517]: audit 2021-03-10T14:12:52.600166+0000 mon.a (mon.0) 735 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:12:53.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:12:53 gibba045 bash[25517]: audit 2021-03-10T14:12:52.600355+0000 mon.c (mon.1) 431 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:12:53.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:12:53 gibba045 bash[25517]: audit 2021-03-10T14:12:52.600670+0000 mon.a (mon.0) 736 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:12:53.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:12:53 gibba015 bash[29377]: cluster 2021-03-10T14:12:51.945820+0000 mgr.gibba045.orlgmj (mgr.34412) 1316 : cluster [DBG] pgmap v734: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:53.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:12:53 gibba015 bash[29377]: audit 2021-03-10T14:12:52.571018+0000 mon.c (mon.1) 426 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T14:12:53.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:12:53 gibba015 bash[29377]: audit 2021-03-10T14:12:52.571775+0000 mon.c (mon.1) 427 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:12:53.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:12:53 gibba015 bash[29377]: audit 2021-03-10T14:12:52.572328+0000 mon.a (mon.0) 731 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T14:12:53.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:12:53 gibba015 bash[29377]: audit 2021-03-10T14:12:52.572455+0000 mon.c (mon.1) 428 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:12:53.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:12:53 gibba015 bash[29377]: audit 2021-03-10T14:12:52.573155+0000 mon.c (mon.1) 429 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T14:12:53.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:12:53 gibba015 bash[29377]: audit 2021-03-10T14:12:52.574612+0000 mon.a (mon.0) 732 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:12:53.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:12:53 gibba015 bash[29377]: audit 2021-03-10T14:12:52.575558+0000 mon.a (mon.0) 733 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:12:53.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:12:53 gibba015 bash[29377]: audit 2021-03-10T14:12:52.576484+0000 mon.a (mon.0) 734 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T14:12:53.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:12:53 gibba015 bash[29377]: audit 2021-03-10T14:12:52.599728+0000 mon.c (mon.1) 430 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:12:53.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:12:53 gibba015 bash[29377]: audit 2021-03-10T14:12:52.600166+0000 mon.a (mon.0) 735 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:12:53.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:12:53 gibba015 bash[29377]: audit 2021-03-10T14:12:52.600355+0000 mon.c (mon.1) 431 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:12:53.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:12:53 gibba015 bash[29377]: audit 2021-03-10T14:12:52.600670+0000 mon.a (mon.0) 736 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:12:53.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:12:53 gibba015 bash[30343]: cluster 2021-03-10T14:12:51.945820+0000 mgr.gibba045.orlgmj (mgr.34412) 1316 : cluster [DBG] pgmap v734: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:53.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:12:53 gibba015 bash[30343]: audit 2021-03-10T14:12:52.571018+0000 mon.c (mon.1) 426 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T14:12:53.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:12:53 gibba015 bash[30343]: audit 2021-03-10T14:12:52.571775+0000 mon.c (mon.1) 427 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:12:53.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:12:53 gibba015 bash[30343]: audit 2021-03-10T14:12:52.572328+0000 mon.a (mon.0) 731 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T14:12:53.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:12:53 gibba015 bash[30343]: audit 2021-03-10T14:12:52.572455+0000 mon.c (mon.1) 428 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:12:53.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:12:53 gibba015 bash[30343]: audit 2021-03-10T14:12:52.573155+0000 mon.c (mon.1) 429 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T14:12:53.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:12:53 gibba015 bash[30343]: audit 2021-03-10T14:12:52.574612+0000 mon.a (mon.0) 732 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:12:53.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:12:53 gibba015 bash[30343]: audit 2021-03-10T14:12:52.575558+0000 mon.a (mon.0) 733 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:12:53.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:12:53 gibba015 bash[30343]: audit 2021-03-10T14:12:52.576484+0000 mon.a (mon.0) 734 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T14:12:53.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:12:53 gibba015 bash[30343]: audit 2021-03-10T14:12:52.599728+0000 mon.c (mon.1) 430 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:12:53.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:12:53 gibba015 bash[30343]: audit 2021-03-10T14:12:52.600166+0000 mon.a (mon.0) 735 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:12:53.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:12:53 gibba015 bash[30343]: audit 2021-03-10T14:12:52.600355+0000 mon.c (mon.1) 431 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:12:53.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:12:53 gibba015 bash[30343]: audit 2021-03-10T14:12:52.600670+0000 mon.a (mon.0) 736 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:12:55.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:12:55 gibba045 bash[25517]: cluster 2021-03-10T14:12:53.947226+0000 mgr.gibba045.orlgmj (mgr.34412) 1317 : cluster [DBG] pgmap v735: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:55.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:12:55 gibba015 bash[29377]: cluster 2021-03-10T14:12:53.947226+0000 mgr.gibba045.orlgmj (mgr.34412) 1317 : cluster [DBG] pgmap v735: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:55.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:12:55 gibba015 bash[30343]: cluster 2021-03-10T14:12:53.947226+0000 mgr.gibba045.orlgmj (mgr.34412) 1317 : cluster [DBG] pgmap v735: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:57.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:12:57 gibba045 bash[25517]: cluster 2021-03-10T14:12:55.949208+0000 mgr.gibba045.orlgmj (mgr.34412) 1318 : cluster [DBG] pgmap v736: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:57.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:12:57 gibba015 bash[29377]: cluster 2021-03-10T14:12:55.949208+0000 mgr.gibba045.orlgmj (mgr.34412) 1318 : cluster [DBG] pgmap v736: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:57.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:12:57 gibba015 bash[30343]: cluster 2021-03-10T14:12:55.949208+0000 mgr.gibba045.orlgmj (mgr.34412) 1318 : cluster [DBG] pgmap v736: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:59.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:12:59 gibba045 bash[25517]: cluster 2021-03-10T14:12:57.950568+0000 mgr.gibba045.orlgmj (mgr.34412) 1319 : cluster [DBG] pgmap v737: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:59.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:12:59 gibba015 bash[29377]: cluster 2021-03-10T14:12:57.950568+0000 mgr.gibba045.orlgmj (mgr.34412) 1319 : cluster [DBG] pgmap v737: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:59.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:12:59 gibba015 bash[30343]: cluster 2021-03-10T14:12:57.950568+0000 mgr.gibba045.orlgmj (mgr.34412) 1319 : cluster [DBG] pgmap v737: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:01.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:13:01 gibba015 bash[29377]: cluster 2021-03-10T14:12:59.952269+0000 mgr.gibba045.orlgmj (mgr.34412) 1320 : cluster [DBG] pgmap v738: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:01.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:13:01 gibba015 bash[30343]: cluster 2021-03-10T14:12:59.952269+0000 mgr.gibba045.orlgmj (mgr.34412) 1320 : cluster [DBG] pgmap v738: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:01.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:13:01 gibba045 bash[25517]: cluster 2021-03-10T14:12:59.952269+0000 mgr.gibba045.orlgmj (mgr.34412) 1320 : cluster [DBG] pgmap v738: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:03.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:13:03 gibba015 bash[29377]: cluster 2021-03-10T14:13:01.954020+0000 mgr.gibba045.orlgmj (mgr.34412) 1321 : cluster [DBG] pgmap v739: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:03.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:13:03 gibba015 bash[30343]: cluster 2021-03-10T14:13:01.954020+0000 mgr.gibba045.orlgmj (mgr.34412) 1321 : cluster [DBG] pgmap v739: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:03.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:13:03 gibba045 bash[25517]: cluster 2021-03-10T14:13:01.954020+0000 mgr.gibba045.orlgmj (mgr.34412) 1321 : cluster [DBG] pgmap v739: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:05.365 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:13:05 gibba045 bash[25517]: cluster 2021-03-10T14:13:03.955276+0000 mgr.gibba045.orlgmj (mgr.34412) 1322 : cluster [DBG] pgmap v740: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:05.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:13:05 gibba015 bash[29377]: cluster 2021-03-10T14:13:03.955276+0000 mgr.gibba045.orlgmj (mgr.34412) 1322 : cluster [DBG] pgmap v740: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:05.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:13:05 gibba015 bash[30343]: cluster 2021-03-10T14:13:03.955276+0000 mgr.gibba045.orlgmj (mgr.34412) 1322 : cluster [DBG] pgmap v740: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:07.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:13:07 gibba015 bash[29377]: cephadm 2021-03-10T14:13:05.364950+0000 mgr.gibba045.orlgmj (mgr.34412) 1323 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:13:07.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:13:07 gibba015 bash[29377]: cluster 2021-03-10T14:13:05.956942+0000 mgr.gibba045.orlgmj (mgr.34412) 1324 : cluster [DBG] pgmap v741: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:07.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:13:07 gibba015 bash[30343]: cephadm 2021-03-10T14:13:05.364950+0000 mgr.gibba045.orlgmj (mgr.34412) 1323 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:13:07.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:13:07 gibba015 bash[30343]: cluster 2021-03-10T14:13:05.956942+0000 mgr.gibba045.orlgmj (mgr.34412) 1324 : cluster [DBG] pgmap v741: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:07.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:13:07 gibba045 bash[25517]: cephadm 2021-03-10T14:13:05.364950+0000 mgr.gibba045.orlgmj (mgr.34412) 1323 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:13:07.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:13:07 gibba045 bash[25517]: cluster 2021-03-10T14:13:05.956942+0000 mgr.gibba045.orlgmj (mgr.34412) 1324 : cluster [DBG] pgmap v741: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:09.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:13:09 gibba015 bash[29377]: cluster 2021-03-10T14:13:07.958415+0000 mgr.gibba045.orlgmj (mgr.34412) 1325 : cluster [DBG] pgmap v742: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:09.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:13:09 gibba015 bash[30343]: cluster 2021-03-10T14:13:07.958415+0000 mgr.gibba045.orlgmj (mgr.34412) 1325 : cluster [DBG] pgmap v742: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:09.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:13:09 gibba045 bash[25517]: cluster 2021-03-10T14:13:07.958415+0000 mgr.gibba045.orlgmj (mgr.34412) 1325 : cluster [DBG] pgmap v742: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:11.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:13:11 gibba015 bash[29377]: cluster 2021-03-10T14:13:09.959977+0000 mgr.gibba045.orlgmj (mgr.34412) 1326 : cluster [DBG] pgmap v743: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:11.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:13:11 gibba015 bash[30343]: cluster 2021-03-10T14:13:09.959977+0000 mgr.gibba045.orlgmj (mgr.34412) 1326 : cluster [DBG] pgmap v743: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:11.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:13:11 gibba045 bash[25517]: cluster 2021-03-10T14:13:09.959977+0000 mgr.gibba045.orlgmj (mgr.34412) 1326 : cluster [DBG] pgmap v743: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:11.939 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:13:12.161 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:13:12.162 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (23m) 10m ago 29m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:13:12.162 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (29m) 8m ago 29m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:13:12.162 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (24m) 8m ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:13:12.162 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (24m) 8m ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:13:12.162 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (23m) 10m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:13:12.163 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (23m) 10m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:13:12.163 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (22m) 8m ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:13:12.163 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (23m) 10m ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:13:12.163 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (29m) 10m ago 29m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:13:12.163 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (29m) 8m ago 29m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:13:12.164 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (22m) 10m ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:13:12.164 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (21m) 10m ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:13:12.164 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (21m) 10m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:13:12.164 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (20m) 10m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:13:12.164 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (20m) 8m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:13:12.165 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (20m) 8m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:13:12.165 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (19m) 8m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:13:12.165 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (19m) 8m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:13:12.165 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (28m) 8m ago 29m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:13:12.165 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 8m ago 27m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:13:12.413 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:13:12.413 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:13:12.413 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:13:12.413 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:13:12.414 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:13:12.414 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:13:12.414 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:13:12.414 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:13:12.414 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:13:12.415 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:13:12.415 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:13:12.415 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:13:12.415 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:13:12.416 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:13:12.416 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:13:13.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:13:13 gibba015 bash[29377]: audit 2021-03-10T14:13:11.930052+0000 mgr.gibba045.orlgmj (mgr.34412) 1327 : audit [DBG] from='client.54940 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:13:13.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:13:13 gibba015 bash[29377]: cluster 2021-03-10T14:13:11.961637+0000 mgr.gibba045.orlgmj (mgr.34412) 1328 : cluster [DBG] pgmap v744: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:13.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:13:13 gibba015 bash[29377]: audit 2021-03-10T14:13:12.152770+0000 mgr.gibba045.orlgmj (mgr.34412) 1329 : audit [DBG] from='client.54946 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:13:13.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:13:13 gibba015 bash[29377]: audit 2021-03-10T14:13:12.411266+0000 mon.a (mon.0) 737 : audit [DBG] from='client.? 172.21.2.115:0/2094627955' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:13:13.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:13:13 gibba015 bash[30343]: audit 2021-03-10T14:13:11.930052+0000 mgr.gibba045.orlgmj (mgr.34412) 1327 : audit [DBG] from='client.54940 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:13:13.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:13:13 gibba015 bash[30343]: cluster 2021-03-10T14:13:11.961637+0000 mgr.gibba045.orlgmj (mgr.34412) 1328 : cluster [DBG] pgmap v744: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:13.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:13:13 gibba015 bash[30343]: audit 2021-03-10T14:13:12.152770+0000 mgr.gibba045.orlgmj (mgr.34412) 1329 : audit [DBG] from='client.54946 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:13:13.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:13:13 gibba015 bash[30343]: audit 2021-03-10T14:13:12.411266+0000 mon.a (mon.0) 737 : audit [DBG] from='client.? 172.21.2.115:0/2094627955' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:13:13.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:13:13 gibba045 bash[25517]: audit 2021-03-10T14:13:11.930052+0000 mgr.gibba045.orlgmj (mgr.34412) 1327 : audit [DBG] from='client.54940 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:13:13.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:13:13 gibba045 bash[25517]: cluster 2021-03-10T14:13:11.961637+0000 mgr.gibba045.orlgmj (mgr.34412) 1328 : cluster [DBG] pgmap v744: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:13.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:13:13 gibba045 bash[25517]: audit 2021-03-10T14:13:12.152770+0000 mgr.gibba045.orlgmj (mgr.34412) 1329 : audit [DBG] from='client.54946 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:13:13.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:13:13 gibba045 bash[25517]: audit 2021-03-10T14:13:12.411266+0000 mon.a (mon.0) 737 : audit [DBG] from='client.? 172.21.2.115:0/2094627955' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:13:15.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:13:15 gibba015 bash[29377]: cluster 2021-03-10T14:13:13.962854+0000 mgr.gibba045.orlgmj (mgr.34412) 1330 : cluster [DBG] pgmap v745: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:15.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:13:15 gibba015 bash[30343]: cluster 2021-03-10T14:13:13.962854+0000 mgr.gibba045.orlgmj (mgr.34412) 1330 : cluster [DBG] pgmap v745: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:15.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:13:15 gibba045 bash[25517]: cluster 2021-03-10T14:13:13.962854+0000 mgr.gibba045.orlgmj (mgr.34412) 1330 : cluster [DBG] pgmap v745: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:17.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:13:17 gibba015 bash[29377]: cluster 2021-03-10T14:13:15.964493+0000 mgr.gibba045.orlgmj (mgr.34412) 1331 : cluster [DBG] pgmap v746: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:17.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:13:17 gibba015 bash[30343]: cluster 2021-03-10T14:13:15.964493+0000 mgr.gibba045.orlgmj (mgr.34412) 1331 : cluster [DBG] pgmap v746: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:17.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:13:17 gibba045 bash[25517]: cluster 2021-03-10T14:13:15.964493+0000 mgr.gibba045.orlgmj (mgr.34412) 1331 : cluster [DBG] pgmap v746: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:19.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:13:19 gibba015 bash[29377]: cluster 2021-03-10T14:13:17.966100+0000 mgr.gibba045.orlgmj (mgr.34412) 1332 : cluster [DBG] pgmap v747: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:19.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:13:19 gibba015 bash[30343]: cluster 2021-03-10T14:13:17.966100+0000 mgr.gibba045.orlgmj (mgr.34412) 1332 : cluster [DBG] pgmap v747: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:19.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:13:19 gibba045 bash[25517]: cluster 2021-03-10T14:13:17.966100+0000 mgr.gibba045.orlgmj (mgr.34412) 1332 : cluster [DBG] pgmap v747: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:21.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:13:21 gibba015 bash[29377]: cluster 2021-03-10T14:13:19.967491+0000 mgr.gibba045.orlgmj (mgr.34412) 1333 : cluster [DBG] pgmap v748: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:21.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:13:21 gibba015 bash[29377]: audit 2021-03-10T14:13:20.380049+0000 mon.c (mon.1) 432 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:13:21.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:13:21 gibba015 bash[29377]: audit 2021-03-10T14:13:20.387168+0000 mon.c (mon.1) 433 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:13:21.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:13:21 gibba015 bash[30343]: cluster 2021-03-10T14:13:19.967491+0000 mgr.gibba045.orlgmj (mgr.34412) 1333 : cluster [DBG] pgmap v748: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:21.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:13:21 gibba015 bash[30343]: audit 2021-03-10T14:13:20.380049+0000 mon.c (mon.1) 432 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:13:21.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:13:21 gibba015 bash[30343]: audit 2021-03-10T14:13:20.387168+0000 mon.c (mon.1) 433 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:13:21.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:13:21 gibba045 bash[25517]: cluster 2021-03-10T14:13:19.967491+0000 mgr.gibba045.orlgmj (mgr.34412) 1333 : cluster [DBG] pgmap v748: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:21.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:13:21 gibba045 bash[25517]: audit 2021-03-10T14:13:20.380049+0000 mon.c (mon.1) 432 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:13:21.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:13:21 gibba045 bash[25517]: audit 2021-03-10T14:13:20.387168+0000 mon.c (mon.1) 433 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:13:22.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:13:22 gibba015 bash[29377]: cephadm 2021-03-10T14:13:20.388770+0000 mgr.gibba045.orlgmj (mgr.34412) 1334 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:13:22.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:13:22 gibba015 bash[30343]: cephadm 2021-03-10T14:13:20.388770+0000 mgr.gibba045.orlgmj (mgr.34412) 1334 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:13:22.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:13:22 gibba045 bash[25517]: cephadm 2021-03-10T14:13:20.388770+0000 mgr.gibba045.orlgmj (mgr.34412) 1334 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:13:23.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:13:23 gibba015 bash[29377]: cluster 2021-03-10T14:13:21.969174+0000 mgr.gibba045.orlgmj (mgr.34412) 1335 : cluster [DBG] pgmap v749: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:23.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:13:23 gibba015 bash[30343]: cluster 2021-03-10T14:13:21.969174+0000 mgr.gibba045.orlgmj (mgr.34412) 1335 : cluster [DBG] pgmap v749: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:23.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:13:23 gibba045 bash[25517]: cluster 2021-03-10T14:13:21.969174+0000 mgr.gibba045.orlgmj (mgr.34412) 1335 : cluster [DBG] pgmap v749: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:25.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:13:24 gibba015 bash[29377]: audit 2021-03-10T14:13:23.863202+0000 mon.a (mon.0) 738 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:13:25.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:13:24 gibba015 bash[29377]: cephadm 2021-03-10T14:13:23.867028+0000 mgr.gibba045.orlgmj (mgr.34412) 1336 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:13:25.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:13:24 gibba015 bash[29377]: cluster 2021-03-10T14:13:23.970489+0000 mgr.gibba045.orlgmj (mgr.34412) 1337 : cluster [DBG] pgmap v750: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:25.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:13:24 gibba015 bash[29377]: audit 2021-03-10T14:13:24.141754+0000 mon.a (mon.0) 739 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:13:25.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:13:24 gibba015 bash[29377]: cephadm 2021-03-10T14:13:24.157464+0000 mgr.gibba045.orlgmj (mgr.34412) 1338 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:13:25.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:13:24 gibba015 bash[29377]: audit 2021-03-10T14:13:24.158571+0000 mon.c (mon.1) 434 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:13:25.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:13:24 gibba015 bash[29377]: audit 2021-03-10T14:13:24.163022+0000 mon.c (mon.1) 435 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:13:25.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:13:24 gibba015 bash[29377]: cephadm 2021-03-10T14:13:24.163163+0000 mgr.gibba045.orlgmj (mgr.34412) 1339 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:13:25.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:13:24 gibba015 bash[29377]: cephadm 2021-03-10T14:13:24.167105+0000 mgr.gibba045.orlgmj (mgr.34412) 1340 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:13:25.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:13:24 gibba015 bash[29377]: audit 2021-03-10T14:13:24.167120+0000 mon.c (mon.1) 436 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:13:25.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:13:24 gibba015 bash[29377]: cephadm 2021-03-10T14:13:24.167520+0000 mgr.gibba045.orlgmj (mgr.34412) 1341 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:13:25.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:13:24 gibba015 bash[29377]: audit 2021-03-10T14:13:24.170551+0000 mon.c (mon.1) 437 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:13:25.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:13:24 gibba015 bash[29377]: cephadm 2021-03-10T14:13:24.171040+0000 mgr.gibba045.orlgmj (mgr.34412) 1342 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:13:25.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:13:24 gibba015 bash[29377]: cephadm 2021-03-10T14:13:24.171628+0000 mgr.gibba045.orlgmj (mgr.34412) 1343 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:13:25.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:13:24 gibba015 bash[29377]: cephadm 2021-03-10T14:13:24.174475+0000 mgr.gibba045.orlgmj (mgr.34412) 1344 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:13:25.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:13:24 gibba015 bash[29377]: cephadm 2021-03-10T14:13:24.178144+0000 mgr.gibba045.orlgmj (mgr.34412) 1345 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:13:25.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:13:24 gibba015 bash[29377]: audit 2021-03-10T14:13:24.178305+0000 mon.c (mon.1) 438 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:13:25.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:13:24 gibba015 bash[29377]: cephadm 2021-03-10T14:13:24.178369+0000 mgr.gibba045.orlgmj (mgr.34412) 1346 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:13:25.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:13:24 gibba015 bash[29377]: cephadm 2021-03-10T14:13:24.182397+0000 mgr.gibba045.orlgmj (mgr.34412) 1347 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:13:25.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:13:24 gibba015 bash[29377]: audit 2021-03-10T14:13:24.183453+0000 mon.c (mon.1) 439 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:13:25.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:13:24 gibba015 bash[30343]: audit 2021-03-10T14:13:23.863202+0000 mon.a (mon.0) 738 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:13:25.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:13:24 gibba015 bash[30343]: cephadm 2021-03-10T14:13:23.867028+0000 mgr.gibba045.orlgmj (mgr.34412) 1336 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:13:25.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:13:24 gibba015 bash[30343]: cluster 2021-03-10T14:13:23.970489+0000 mgr.gibba045.orlgmj (mgr.34412) 1337 : cluster [DBG] pgmap v750: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:25.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:13:24 gibba015 bash[30343]: audit 2021-03-10T14:13:24.141754+0000 mon.a (mon.0) 739 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:13:25.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:13:24 gibba015 bash[30343]: cephadm 2021-03-10T14:13:24.157464+0000 mgr.gibba045.orlgmj (mgr.34412) 1338 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:13:25.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:13:24 gibba015 bash[30343]: audit 2021-03-10T14:13:24.158571+0000 mon.c (mon.1) 434 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:13:25.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:13:24 gibba015 bash[30343]: audit 2021-03-10T14:13:24.163022+0000 mon.c (mon.1) 435 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:13:25.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:13:24 gibba015 bash[30343]: cephadm 2021-03-10T14:13:24.163163+0000 mgr.gibba045.orlgmj (mgr.34412) 1339 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:13:25.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:13:24 gibba015 bash[30343]: cephadm 2021-03-10T14:13:24.167105+0000 mgr.gibba045.orlgmj (mgr.34412) 1340 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:13:25.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:13:24 gibba015 bash[30343]: audit 2021-03-10T14:13:24.167120+0000 mon.c (mon.1) 436 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:13:25.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:13:24 gibba015 bash[30343]: cephadm 2021-03-10T14:13:24.167520+0000 mgr.gibba045.orlgmj (mgr.34412) 1341 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:13:25.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:13:24 gibba015 bash[30343]: audit 2021-03-10T14:13:24.170551+0000 mon.c (mon.1) 437 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:13:25.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:13:24 gibba015 bash[30343]: cephadm 2021-03-10T14:13:24.171040+0000 mgr.gibba045.orlgmj (mgr.34412) 1342 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:13:25.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:13:24 gibba015 bash[30343]: cephadm 2021-03-10T14:13:24.171628+0000 mgr.gibba045.orlgmj (mgr.34412) 1343 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:13:25.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:13:24 gibba015 bash[30343]: cephadm 2021-03-10T14:13:24.174475+0000 mgr.gibba045.orlgmj (mgr.34412) 1344 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:13:25.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:13:24 gibba015 bash[30343]: cephadm 2021-03-10T14:13:24.178144+0000 mgr.gibba045.orlgmj (mgr.34412) 1345 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:13:25.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:13:24 gibba015 bash[30343]: audit 2021-03-10T14:13:24.178305+0000 mon.c (mon.1) 438 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:13:25.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:13:24 gibba015 bash[30343]: cephadm 2021-03-10T14:13:24.178369+0000 mgr.gibba045.orlgmj (mgr.34412) 1346 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:13:25.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:13:24 gibba015 bash[30343]: cephadm 2021-03-10T14:13:24.182397+0000 mgr.gibba045.orlgmj (mgr.34412) 1347 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:13:25.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:13:24 gibba015 bash[30343]: audit 2021-03-10T14:13:24.183453+0000 mon.c (mon.1) 439 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:13:25.231 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:13:24 gibba015 bash[29377]: cephadm 2021-03-10T14:13:24.184335+0000 mgr.gibba045.orlgmj (mgr.34412) 1348 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:13:25.232 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:13:24 gibba015 bash[29377]: cephadm 2021-03-10T14:13:24.187401+0000 mgr.gibba045.orlgmj (mgr.34412) 1349 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:13:25.232 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:13:24 gibba015 bash[29377]: cephadm 2021-03-10T14:13:24.187874+0000 mgr.gibba045.orlgmj (mgr.34412) 1350 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:13:25.232 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:13:24 gibba015 bash[29377]: cephadm 2021-03-10T14:13:24.188557+0000 mgr.gibba045.orlgmj (mgr.34412) 1351 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:13:25.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:13:24 gibba015 bash[30343]: cephadm 2021-03-10T14:13:24.184335+0000 mgr.gibba045.orlgmj (mgr.34412) 1348 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:13:25.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:13:24 gibba015 bash[30343]: cephadm 2021-03-10T14:13:24.187401+0000 mgr.gibba045.orlgmj (mgr.34412) 1349 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:13:25.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:13:24 gibba015 bash[30343]: cephadm 2021-03-10T14:13:24.187874+0000 mgr.gibba045.orlgmj (mgr.34412) 1350 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:13:25.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:13:24 gibba015 bash[30343]: cephadm 2021-03-10T14:13:24.188557+0000 mgr.gibba045.orlgmj (mgr.34412) 1351 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:13:25.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:13:24 gibba045 bash[25517]: audit 2021-03-10T14:13:23.863202+0000 mon.a (mon.0) 738 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:13:25.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:13:24 gibba045 bash[25517]: cephadm 2021-03-10T14:13:23.867028+0000 mgr.gibba045.orlgmj (mgr.34412) 1336 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:13:25.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:13:24 gibba045 bash[25517]: cluster 2021-03-10T14:13:23.970489+0000 mgr.gibba045.orlgmj (mgr.34412) 1337 : cluster [DBG] pgmap v750: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:25.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:13:24 gibba045 bash[25517]: audit 2021-03-10T14:13:24.141754+0000 mon.a (mon.0) 739 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:13:25.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:13:24 gibba045 bash[25517]: cephadm 2021-03-10T14:13:24.157464+0000 mgr.gibba045.orlgmj (mgr.34412) 1338 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:13:25.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:13:24 gibba045 bash[25517]: audit 2021-03-10T14:13:24.158571+0000 mon.c (mon.1) 434 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:13:25.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:13:24 gibba045 bash[25517]: audit 2021-03-10T14:13:24.163022+0000 mon.c (mon.1) 435 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:13:25.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:13:24 gibba045 bash[25517]: cephadm 2021-03-10T14:13:24.163163+0000 mgr.gibba045.orlgmj (mgr.34412) 1339 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:13:25.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:13:24 gibba045 bash[25517]: cephadm 2021-03-10T14:13:24.167105+0000 mgr.gibba045.orlgmj (mgr.34412) 1340 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:13:25.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:13:24 gibba045 bash[25517]: audit 2021-03-10T14:13:24.167120+0000 mon.c (mon.1) 436 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:13:25.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:13:24 gibba045 bash[25517]: cephadm 2021-03-10T14:13:24.167520+0000 mgr.gibba045.orlgmj (mgr.34412) 1341 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:13:25.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:13:24 gibba045 bash[25517]: audit 2021-03-10T14:13:24.170551+0000 mon.c (mon.1) 437 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:13:25.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:13:24 gibba045 bash[25517]: cephadm 2021-03-10T14:13:24.171040+0000 mgr.gibba045.orlgmj (mgr.34412) 1342 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:13:25.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:13:24 gibba045 bash[25517]: cephadm 2021-03-10T14:13:24.171628+0000 mgr.gibba045.orlgmj (mgr.34412) 1343 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:13:25.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:13:24 gibba045 bash[25517]: cephadm 2021-03-10T14:13:24.174475+0000 mgr.gibba045.orlgmj (mgr.34412) 1344 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:13:25.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:13:24 gibba045 bash[25517]: cephadm 2021-03-10T14:13:24.178144+0000 mgr.gibba045.orlgmj (mgr.34412) 1345 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:13:25.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:13:24 gibba045 bash[25517]: audit 2021-03-10T14:13:24.178305+0000 mon.c (mon.1) 438 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:13:25.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:13:24 gibba045 bash[25517]: cephadm 2021-03-10T14:13:24.178369+0000 mgr.gibba045.orlgmj (mgr.34412) 1346 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:13:25.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:13:24 gibba045 bash[25517]: cephadm 2021-03-10T14:13:24.182397+0000 mgr.gibba045.orlgmj (mgr.34412) 1347 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:13:25.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:13:24 gibba045 bash[25517]: audit 2021-03-10T14:13:24.183453+0000 mon.c (mon.1) 439 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:13:25.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:13:24 gibba045 bash[25517]: cephadm 2021-03-10T14:13:24.184335+0000 mgr.gibba045.orlgmj (mgr.34412) 1348 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:13:25.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:13:24 gibba045 bash[25517]: cephadm 2021-03-10T14:13:24.187401+0000 mgr.gibba045.orlgmj (mgr.34412) 1349 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:13:25.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:13:24 gibba045 bash[25517]: cephadm 2021-03-10T14:13:24.187874+0000 mgr.gibba045.orlgmj (mgr.34412) 1350 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:13:25.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:13:24 gibba045 bash[25517]: cephadm 2021-03-10T14:13:24.188557+0000 mgr.gibba045.orlgmj (mgr.34412) 1351 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:13:27.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:13:27 gibba045 bash[25517]: cluster 2021-03-10T14:13:25.972107+0000 mgr.gibba045.orlgmj (mgr.34412) 1352 : cluster [DBG] pgmap v751: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:27.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:13:27 gibba015 bash[29377]: cluster 2021-03-10T14:13:25.972107+0000 mgr.gibba045.orlgmj (mgr.34412) 1352 : cluster [DBG] pgmap v751: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:27.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:13:27 gibba015 bash[30343]: cluster 2021-03-10T14:13:25.972107+0000 mgr.gibba045.orlgmj (mgr.34412) 1352 : cluster [DBG] pgmap v751: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:29.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:13:29 gibba045 bash[25517]: cluster 2021-03-10T14:13:27.973583+0000 mgr.gibba045.orlgmj (mgr.34412) 1353 : cluster [DBG] pgmap v752: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:29.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:13:29 gibba015 bash[29377]: cluster 2021-03-10T14:13:27.973583+0000 mgr.gibba045.orlgmj (mgr.34412) 1353 : cluster [DBG] pgmap v752: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:29.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:13:29 gibba015 bash[30343]: cluster 2021-03-10T14:13:27.973583+0000 mgr.gibba045.orlgmj (mgr.34412) 1353 : cluster [DBG] pgmap v752: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:31.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:13:31 gibba045 bash[25517]: cluster 2021-03-10T14:13:29.974926+0000 mgr.gibba045.orlgmj (mgr.34412) 1354 : cluster [DBG] pgmap v753: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:31.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:13:31 gibba015 bash[29377]: cluster 2021-03-10T14:13:29.974926+0000 mgr.gibba045.orlgmj (mgr.34412) 1354 : cluster [DBG] pgmap v753: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:31.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:13:31 gibba015 bash[30343]: cluster 2021-03-10T14:13:29.974926+0000 mgr.gibba045.orlgmj (mgr.34412) 1354 : cluster [DBG] pgmap v753: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:33.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:13:33 gibba015 bash[29377]: cluster 2021-03-10T14:13:31.976759+0000 mgr.gibba045.orlgmj (mgr.34412) 1355 : cluster [DBG] pgmap v754: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:33.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:13:33 gibba015 bash[30343]: cluster 2021-03-10T14:13:31.976759+0000 mgr.gibba045.orlgmj (mgr.34412) 1355 : cluster [DBG] pgmap v754: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:33.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:13:33 gibba045 bash[25517]: cluster 2021-03-10T14:13:31.976759+0000 mgr.gibba045.orlgmj (mgr.34412) 1355 : cluster [DBG] pgmap v754: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:35.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:13:35 gibba015 bash[29377]: cluster 2021-03-10T14:13:33.978036+0000 mgr.gibba045.orlgmj (mgr.34412) 1356 : cluster [DBG] pgmap v755: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:35.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:13:35 gibba015 bash[30343]: cluster 2021-03-10T14:13:33.978036+0000 mgr.gibba045.orlgmj (mgr.34412) 1356 : cluster [DBG] pgmap v755: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:35.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:13:35 gibba045 bash[25517]: cluster 2021-03-10T14:13:33.978036+0000 mgr.gibba045.orlgmj (mgr.34412) 1356 : cluster [DBG] pgmap v755: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:37.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:13:37 gibba015 bash[29377]: cluster 2021-03-10T14:13:35.979067+0000 mgr.gibba045.orlgmj (mgr.34412) 1357 : cluster [DBG] pgmap v756: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:37.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:13:37 gibba015 bash[30343]: cluster 2021-03-10T14:13:35.979067+0000 mgr.gibba045.orlgmj (mgr.34412) 1357 : cluster [DBG] pgmap v756: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:37.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:13:37 gibba045 bash[25517]: cluster 2021-03-10T14:13:35.979067+0000 mgr.gibba045.orlgmj (mgr.34412) 1357 : cluster [DBG] pgmap v756: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:39.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:13:39 gibba015 bash[29377]: cluster 2021-03-10T14:13:37.980335+0000 mgr.gibba045.orlgmj (mgr.34412) 1358 : cluster [DBG] pgmap v757: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:39.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:13:39 gibba015 bash[30343]: cluster 2021-03-10T14:13:37.980335+0000 mgr.gibba045.orlgmj (mgr.34412) 1358 : cluster [DBG] pgmap v757: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:39.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:13:39 gibba045 bash[25517]: cluster 2021-03-10T14:13:37.980335+0000 mgr.gibba045.orlgmj (mgr.34412) 1358 : cluster [DBG] pgmap v757: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:40.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:13:40 gibba015 bash[29377]: cephadm 2021-03-10T14:13:39.191357+0000 mgr.gibba045.orlgmj (mgr.34412) 1359 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:13:40.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:13:40 gibba015 bash[30343]: cephadm 2021-03-10T14:13:39.191357+0000 mgr.gibba045.orlgmj (mgr.34412) 1359 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:13:40.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:13:40 gibba045 bash[25517]: cephadm 2021-03-10T14:13:39.191357+0000 mgr.gibba045.orlgmj (mgr.34412) 1359 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:13:41.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:13:41 gibba015 bash[29377]: cluster 2021-03-10T14:13:39.982024+0000 mgr.gibba045.orlgmj (mgr.34412) 1360 : cluster [DBG] pgmap v758: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:41.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:13:41 gibba015 bash[30343]: cluster 2021-03-10T14:13:39.982024+0000 mgr.gibba045.orlgmj (mgr.34412) 1360 : cluster [DBG] pgmap v758: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:41.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:13:41 gibba045 bash[25517]: cluster 2021-03-10T14:13:39.982024+0000 mgr.gibba045.orlgmj (mgr.34412) 1360 : cluster [DBG] pgmap v758: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:42.661 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:13:42.890 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:13:42.890 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (24m) 19s ago 29m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:13:42.891 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (29m) 9m ago 29m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:13:42.891 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (24m) 9m ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:13:42.891 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (25m) 9m ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:13:42.891 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (24m) 19s ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:13:42.892 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (23m) 19s ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:13:42.892 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (23m) 9m ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:13:42.892 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (23m) 19s ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:13:42.892 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (29m) 19s ago 29m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:13:42.892 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (29m) 9m ago 29m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:13:42.893 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (22m) 19s ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:13:42.893 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (22m) 19s ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:13:42.893 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (21m) 19s ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:13:42.893 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (21m) 19s ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:13:42.893 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (21m) 9m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:13:42.894 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (20m) 9m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:13:42.894 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (20m) 9m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:13:42.894 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (19m) 9m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:13:42.894 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (29m) 9m ago 30m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:13:42.895 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 9m ago 27m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:13:43.140 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:13:43.140 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:13:43.140 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:13:43.141 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:13:43.141 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:13:43.141 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:13:43.141 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:13:43.141 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:13:43.142 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:13:43.142 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:13:43.142 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:13:43.142 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:13:43.143 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:13:43.143 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:13:43.143 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:13:43.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:13:43 gibba015 bash[29377]: cluster 2021-03-10T14:13:41.983718+0000 mgr.gibba045.orlgmj (mgr.34412) 1361 : cluster [DBG] pgmap v759: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:43.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:13:43 gibba015 bash[30343]: cluster 2021-03-10T14:13:41.983718+0000 mgr.gibba045.orlgmj (mgr.34412) 1361 : cluster [DBG] pgmap v759: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:43.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:13:43 gibba045 bash[25517]: cluster 2021-03-10T14:13:41.983718+0000 mgr.gibba045.orlgmj (mgr.34412) 1361 : cluster [DBG] pgmap v759: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:44.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:13:44 gibba015 bash[29377]: audit 2021-03-10T14:13:42.652236+0000 mgr.gibba045.orlgmj (mgr.34412) 1362 : audit [DBG] from='client.44970 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:13:44.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:13:44 gibba015 bash[29377]: audit 2021-03-10T14:13:42.878434+0000 mgr.gibba045.orlgmj (mgr.34412) 1363 : audit [DBG] from='client.44976 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:13:44.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:13:44 gibba015 bash[29377]: audit 2021-03-10T14:13:43.138222+0000 mon.c (mon.1) 440 : audit [DBG] from='client.? 172.21.2.115:0/2023420319' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:13:44.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:13:44 gibba015 bash[30343]: audit 2021-03-10T14:13:42.652236+0000 mgr.gibba045.orlgmj (mgr.34412) 1362 : audit [DBG] from='client.44970 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:13:44.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:13:44 gibba015 bash[30343]: audit 2021-03-10T14:13:42.878434+0000 mgr.gibba045.orlgmj (mgr.34412) 1363 : audit [DBG] from='client.44976 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:13:44.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:13:44 gibba015 bash[30343]: audit 2021-03-10T14:13:43.138222+0000 mon.c (mon.1) 440 : audit [DBG] from='client.? 172.21.2.115:0/2023420319' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:13:44.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:13:44 gibba045 bash[25517]: audit 2021-03-10T14:13:42.652236+0000 mgr.gibba045.orlgmj (mgr.34412) 1362 : audit [DBG] from='client.44970 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:13:44.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:13:44 gibba045 bash[25517]: audit 2021-03-10T14:13:42.878434+0000 mgr.gibba045.orlgmj (mgr.34412) 1363 : audit [DBG] from='client.44976 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:13:44.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:13:44 gibba045 bash[25517]: audit 2021-03-10T14:13:43.138222+0000 mon.c (mon.1) 440 : audit [DBG] from='client.? 172.21.2.115:0/2023420319' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:13:45.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:13:45 gibba015 bash[29377]: cluster 2021-03-10T14:13:43.984978+0000 mgr.gibba045.orlgmj (mgr.34412) 1364 : cluster [DBG] pgmap v760: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:45.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:13:45 gibba015 bash[30343]: cluster 2021-03-10T14:13:43.984978+0000 mgr.gibba045.orlgmj (mgr.34412) 1364 : cluster [DBG] pgmap v760: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:45.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:13:45 gibba045 bash[25517]: cluster 2021-03-10T14:13:43.984978+0000 mgr.gibba045.orlgmj (mgr.34412) 1364 : cluster [DBG] pgmap v760: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:47.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:13:47 gibba015 bash[29377]: cluster 2021-03-10T14:13:45.986699+0000 mgr.gibba045.orlgmj (mgr.34412) 1365 : cluster [DBG] pgmap v761: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:47.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:13:47 gibba015 bash[30343]: cluster 2021-03-10T14:13:45.986699+0000 mgr.gibba045.orlgmj (mgr.34412) 1365 : cluster [DBG] pgmap v761: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:47.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:13:47 gibba045 bash[25517]: cluster 2021-03-10T14:13:45.986699+0000 mgr.gibba045.orlgmj (mgr.34412) 1365 : cluster [DBG] pgmap v761: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:49.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:13:49 gibba015 bash[29377]: cluster 2021-03-10T14:13:47.988221+0000 mgr.gibba045.orlgmj (mgr.34412) 1366 : cluster [DBG] pgmap v762: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:49.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:13:49 gibba015 bash[30343]: cluster 2021-03-10T14:13:47.988221+0000 mgr.gibba045.orlgmj (mgr.34412) 1366 : cluster [DBG] pgmap v762: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:49.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:13:49 gibba045 bash[25517]: cluster 2021-03-10T14:13:47.988221+0000 mgr.gibba045.orlgmj (mgr.34412) 1366 : cluster [DBG] pgmap v762: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:51.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:13:51 gibba015 bash[29377]: cluster 2021-03-10T14:13:49.989890+0000 mgr.gibba045.orlgmj (mgr.34412) 1367 : cluster [DBG] pgmap v763: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:51.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:13:51 gibba015 bash[30343]: cluster 2021-03-10T14:13:49.989890+0000 mgr.gibba045.orlgmj (mgr.34412) 1367 : cluster [DBG] pgmap v763: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:51.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:13:51 gibba045 bash[25517]: cluster 2021-03-10T14:13:49.989890+0000 mgr.gibba045.orlgmj (mgr.34412) 1367 : cluster [DBG] pgmap v763: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:53.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:13:53 gibba015 bash[29377]: cluster 2021-03-10T14:13:51.991626+0000 mgr.gibba045.orlgmj (mgr.34412) 1368 : cluster [DBG] pgmap v764: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:53.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:13:53 gibba015 bash[29377]: audit 2021-03-10T14:13:52.581799+0000 mon.c (mon.1) 441 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T14:13:53.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:13:53 gibba015 bash[29377]: audit 2021-03-10T14:13:52.582563+0000 mon.c (mon.1) 442 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:13:53.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:13:53 gibba015 bash[29377]: audit 2021-03-10T14:13:52.582993+0000 mon.a (mon.0) 740 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T14:13:53.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:13:53 gibba015 bash[29377]: audit 2021-03-10T14:13:52.583220+0000 mon.c (mon.1) 443 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T14:13:53.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:13:53 gibba015 bash[29377]: audit 2021-03-10T14:13:52.584085+0000 mon.c (mon.1) 444 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:13:53.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:13:53 gibba015 bash[29377]: audit 2021-03-10T14:13:52.584447+0000 mon.a (mon.0) 741 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:13:53.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:13:53 gibba015 bash[29377]: audit 2021-03-10T14:13:52.585467+0000 mon.a (mon.0) 742 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T14:13:53.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:13:53 gibba015 bash[29377]: audit 2021-03-10T14:13:52.586253+0000 mon.a (mon.0) 743 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:13:53.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:13:53 gibba015 bash[29377]: audit 2021-03-10T14:13:52.602717+0000 mon.c (mon.1) 445 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:13:53.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:13:53 gibba015 bash[29377]: audit 2021-03-10T14:13:52.603391+0000 mon.c (mon.1) 446 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:13:53.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:13:53 gibba015 bash[29377]: audit 2021-03-10T14:13:52.603772+0000 mon.a (mon.0) 744 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:13:53.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:13:53 gibba015 bash[29377]: audit 2021-03-10T14:13:52.604839+0000 mon.a (mon.0) 745 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:13:53.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:13:53 gibba015 bash[30343]: cluster 2021-03-10T14:13:51.991626+0000 mgr.gibba045.orlgmj (mgr.34412) 1368 : cluster [DBG] pgmap v764: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:53.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:13:53 gibba015 bash[30343]: audit 2021-03-10T14:13:52.581799+0000 mon.c (mon.1) 441 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T14:13:53.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:13:53 gibba015 bash[30343]: audit 2021-03-10T14:13:52.582563+0000 mon.c (mon.1) 442 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:13:53.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:13:53 gibba015 bash[30343]: audit 2021-03-10T14:13:52.582993+0000 mon.a (mon.0) 740 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T14:13:53.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:13:53 gibba015 bash[30343]: audit 2021-03-10T14:13:52.583220+0000 mon.c (mon.1) 443 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T14:13:53.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:13:53 gibba015 bash[30343]: audit 2021-03-10T14:13:52.584085+0000 mon.c (mon.1) 444 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:13:53.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:13:53 gibba015 bash[30343]: audit 2021-03-10T14:13:52.584447+0000 mon.a (mon.0) 741 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:13:53.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:13:53 gibba015 bash[30343]: audit 2021-03-10T14:13:52.585467+0000 mon.a (mon.0) 742 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T14:13:53.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:13:53 gibba015 bash[30343]: audit 2021-03-10T14:13:52.586253+0000 mon.a (mon.0) 743 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:13:53.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:13:53 gibba015 bash[30343]: audit 2021-03-10T14:13:52.602717+0000 mon.c (mon.1) 445 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:13:53.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:13:53 gibba015 bash[30343]: audit 2021-03-10T14:13:52.603391+0000 mon.c (mon.1) 446 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:13:53.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:13:53 gibba015 bash[30343]: audit 2021-03-10T14:13:52.603772+0000 mon.a (mon.0) 744 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:13:53.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:13:53 gibba015 bash[30343]: audit 2021-03-10T14:13:52.604839+0000 mon.a (mon.0) 745 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:13:53.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:13:53 gibba045 bash[25517]: cluster 2021-03-10T14:13:51.991626+0000 mgr.gibba045.orlgmj (mgr.34412) 1368 : cluster [DBG] pgmap v764: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:53.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:13:53 gibba045 bash[25517]: audit 2021-03-10T14:13:52.581799+0000 mon.c (mon.1) 441 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T14:13:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:13:53 gibba045 bash[25517]: audit 2021-03-10T14:13:52.582563+0000 mon.c (mon.1) 442 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:13:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:13:53 gibba045 bash[25517]: audit 2021-03-10T14:13:52.582993+0000 mon.a (mon.0) 740 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T14:13:53.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:13:53 gibba045 bash[25517]: audit 2021-03-10T14:13:52.583220+0000 mon.c (mon.1) 443 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T14:13:53.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:13:53 gibba045 bash[25517]: audit 2021-03-10T14:13:52.584085+0000 mon.c (mon.1) 444 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:13:53.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:13:53 gibba045 bash[25517]: audit 2021-03-10T14:13:52.584447+0000 mon.a (mon.0) 741 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:13:53.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:13:53 gibba045 bash[25517]: audit 2021-03-10T14:13:52.585467+0000 mon.a (mon.0) 742 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T14:13:53.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:13:53 gibba045 bash[25517]: audit 2021-03-10T14:13:52.586253+0000 mon.a (mon.0) 743 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:13:53.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:13:53 gibba045 bash[25517]: audit 2021-03-10T14:13:52.602717+0000 mon.c (mon.1) 445 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:13:53.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:13:53 gibba045 bash[25517]: audit 2021-03-10T14:13:52.603391+0000 mon.c (mon.1) 446 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:13:53.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:13:53 gibba045 bash[25517]: audit 2021-03-10T14:13:52.603772+0000 mon.a (mon.0) 744 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:13:53.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:13:53 gibba045 bash[25517]: audit 2021-03-10T14:13:52.604839+0000 mon.a (mon.0) 745 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:13:55.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:13:55 gibba015 bash[29377]: cluster 2021-03-10T14:13:53.992815+0000 mgr.gibba045.orlgmj (mgr.34412) 1369 : cluster [DBG] pgmap v765: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:55.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:13:55 gibba015 bash[29377]: cephadm 2021-03-10T14:13:54.198100+0000 mgr.gibba045.orlgmj (mgr.34412) 1370 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:13:55.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:13:55 gibba015 bash[30343]: cluster 2021-03-10T14:13:53.992815+0000 mgr.gibba045.orlgmj (mgr.34412) 1369 : cluster [DBG] pgmap v765: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:55.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:13:55 gibba015 bash[30343]: cephadm 2021-03-10T14:13:54.198100+0000 mgr.gibba045.orlgmj (mgr.34412) 1370 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:13:55.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:13:55 gibba045 bash[25517]: cluster 2021-03-10T14:13:53.992815+0000 mgr.gibba045.orlgmj (mgr.34412) 1369 : cluster [DBG] pgmap v765: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:55.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:13:55 gibba045 bash[25517]: cephadm 2021-03-10T14:13:54.198100+0000 mgr.gibba045.orlgmj (mgr.34412) 1370 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:13:57.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:13:57 gibba015 bash[29377]: cluster 2021-03-10T14:13:55.994505+0000 mgr.gibba045.orlgmj (mgr.34412) 1371 : cluster [DBG] pgmap v766: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:57.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:13:57 gibba015 bash[30343]: cluster 2021-03-10T14:13:55.994505+0000 mgr.gibba045.orlgmj (mgr.34412) 1371 : cluster [DBG] pgmap v766: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:57.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:13:57 gibba045 bash[25517]: cluster 2021-03-10T14:13:55.994505+0000 mgr.gibba045.orlgmj (mgr.34412) 1371 : cluster [DBG] pgmap v766: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:59.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:13:59 gibba015 bash[29377]: cluster 2021-03-10T14:13:57.995894+0000 mgr.gibba045.orlgmj (mgr.34412) 1372 : cluster [DBG] pgmap v767: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:59.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:13:59 gibba015 bash[30343]: cluster 2021-03-10T14:13:57.995894+0000 mgr.gibba045.orlgmj (mgr.34412) 1372 : cluster [DBG] pgmap v767: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:59.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:13:59 gibba045 bash[25517]: cluster 2021-03-10T14:13:57.995894+0000 mgr.gibba045.orlgmj (mgr.34412) 1372 : cluster [DBG] pgmap v767: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:01.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:01 gibba015 bash[29377]: cluster 2021-03-10T14:13:59.997549+0000 mgr.gibba045.orlgmj (mgr.34412) 1373 : cluster [DBG] pgmap v768: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:01.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:01 gibba015 bash[30343]: cluster 2021-03-10T14:13:59.997549+0000 mgr.gibba045.orlgmj (mgr.34412) 1373 : cluster [DBG] pgmap v768: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:01.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:01 gibba045 bash[25517]: cluster 2021-03-10T14:13:59.997549+0000 mgr.gibba045.orlgmj (mgr.34412) 1373 : cluster [DBG] pgmap v768: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:03.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:03 gibba015 bash[29377]: cluster 2021-03-10T14:14:01.999193+0000 mgr.gibba045.orlgmj (mgr.34412) 1374 : cluster [DBG] pgmap v769: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:03.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:03 gibba015 bash[30343]: cluster 2021-03-10T14:14:01.999193+0000 mgr.gibba045.orlgmj (mgr.34412) 1374 : cluster [DBG] pgmap v769: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:03.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:03 gibba045 bash[25517]: cluster 2021-03-10T14:14:01.999193+0000 mgr.gibba045.orlgmj (mgr.34412) 1374 : cluster [DBG] pgmap v769: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:05.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:05 gibba015 bash[29377]: cluster 2021-03-10T14:14:04.000371+0000 mgr.gibba045.orlgmj (mgr.34412) 1375 : cluster [DBG] pgmap v770: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:05.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:05 gibba015 bash[30343]: cluster 2021-03-10T14:14:04.000371+0000 mgr.gibba045.orlgmj (mgr.34412) 1375 : cluster [DBG] pgmap v770: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:05.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:05 gibba045 bash[25517]: cluster 2021-03-10T14:14:04.000371+0000 mgr.gibba045.orlgmj (mgr.34412) 1375 : cluster [DBG] pgmap v770: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:07.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:07 gibba015 bash[29377]: cluster 2021-03-10T14:14:06.002081+0000 mgr.gibba045.orlgmj (mgr.34412) 1376 : cluster [DBG] pgmap v771: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:07.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:07 gibba015 bash[30343]: cluster 2021-03-10T14:14:06.002081+0000 mgr.gibba045.orlgmj (mgr.34412) 1376 : cluster [DBG] pgmap v771: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:07.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:07 gibba045 bash[25517]: cluster 2021-03-10T14:14:06.002081+0000 mgr.gibba045.orlgmj (mgr.34412) 1376 : cluster [DBG] pgmap v771: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:09.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:09 gibba015 bash[29377]: cluster 2021-03-10T14:14:08.003440+0000 mgr.gibba045.orlgmj (mgr.34412) 1377 : cluster [DBG] pgmap v772: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:09.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:09 gibba015 bash[30343]: cluster 2021-03-10T14:14:08.003440+0000 mgr.gibba045.orlgmj (mgr.34412) 1377 : cluster [DBG] pgmap v772: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:09.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:09 gibba045 bash[25517]: cluster 2021-03-10T14:14:08.003440+0000 mgr.gibba045.orlgmj (mgr.34412) 1377 : cluster [DBG] pgmap v772: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:10.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:10 gibba045 bash[25517]: cephadm 2021-03-10T14:14:09.213911+0000 mgr.gibba045.orlgmj (mgr.34412) 1378 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:14:10.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:10 gibba015 bash[29377]: cephadm 2021-03-10T14:14:09.213911+0000 mgr.gibba045.orlgmj (mgr.34412) 1378 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:14:10.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:10 gibba015 bash[30343]: cephadm 2021-03-10T14:14:09.213911+0000 mgr.gibba045.orlgmj (mgr.34412) 1378 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:14:11.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:11 gibba045 bash[25517]: cluster 2021-03-10T14:14:10.004853+0000 mgr.gibba045.orlgmj (mgr.34412) 1379 : cluster [DBG] pgmap v773: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:11.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:11 gibba015 bash[29377]: cluster 2021-03-10T14:14:10.004853+0000 mgr.gibba045.orlgmj (mgr.34412) 1379 : cluster [DBG] pgmap v773: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:11.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:11 gibba015 bash[30343]: cluster 2021-03-10T14:14:10.004853+0000 mgr.gibba045.orlgmj (mgr.34412) 1379 : cluster [DBG] pgmap v773: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:13.382 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:14:13.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:13 gibba045 bash[25517]: cluster 2021-03-10T14:14:12.006333+0000 mgr.gibba045.orlgmj (mgr.34412) 1380 : cluster [DBG] pgmap v774: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:13.608 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:14:13.609 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (24m) 49s ago 30m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:14:13.609 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (30m) 10m ago 30m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:14:13.609 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (25m) 10m ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:14:13.609 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (25m) 10m ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:14:13.609 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (24m) 49s ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:14:13.610 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (24m) 49s ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:14:13.610 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (24m) 10m ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:14:13.610 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (24m) 49s ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:14:13.610 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (30m) 49s ago 30m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:14:13.611 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (30m) 10m ago 30m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:14:13.611 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (23m) 49s ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:14:13.612 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (22m) 49s ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:14:13.612 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (22m) 49s ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:14:13.612 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (21m) 49s ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:14:13.612 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (21m) 10m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:14:13.612 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (21m) 10m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:14:13.613 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (20m) 10m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:14:13.613 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (20m) 10m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:14:13.613 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (29m) 10m ago 30m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:14:13.613 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 10m ago 28m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:14:13.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:13 gibba015 bash[29377]: cluster 2021-03-10T14:14:12.006333+0000 mgr.gibba045.orlgmj (mgr.34412) 1380 : cluster [DBG] pgmap v774: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:13.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:13 gibba015 bash[30343]: cluster 2021-03-10T14:14:12.006333+0000 mgr.gibba045.orlgmj (mgr.34412) 1380 : cluster [DBG] pgmap v774: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:13.859 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:14:13.860 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:14:13.860 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:14:13.860 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:14:13.861 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:14:13.861 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:14:13.861 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:14:13.861 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:14:13.861 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:14:13.862 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:14:13.862 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:14:13.862 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:14:13.862 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:14:13.863 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:14:13.863 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:14:14.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:14 gibba045 bash[25517]: audit 2021-03-10T14:14:13.858161+0000 mon.c (mon.1) 447 : audit [DBG] from='client.? 172.21.2.115:0/947551731' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:14:14.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:14 gibba015 bash[29377]: audit 2021-03-10T14:14:13.858161+0000 mon.c (mon.1) 447 : audit [DBG] from='client.? 172.21.2.115:0/947551731' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:14:14.837 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:14 gibba015 bash[30343]: audit 2021-03-10T14:14:13.858161+0000 mon.c (mon.1) 447 : audit [DBG] from='client.? 172.21.2.115:0/947551731' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:14:15.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:15 gibba045 bash[25517]: audit 2021-03-10T14:14:13.373911+0000 mgr.gibba045.orlgmj (mgr.34412) 1381 : audit [DBG] from='client.44988 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:14:15.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:15 gibba045 bash[25517]: audit 2021-03-10T14:14:13.596321+0000 mgr.gibba045.orlgmj (mgr.34412) 1382 : audit [DBG] from='client.44994 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:14:15.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:15 gibba045 bash[25517]: cluster 2021-03-10T14:14:14.007672+0000 mgr.gibba045.orlgmj (mgr.34412) 1383 : cluster [DBG] pgmap v775: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:15.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:15 gibba015 bash[29377]: audit 2021-03-10T14:14:13.373911+0000 mgr.gibba045.orlgmj (mgr.34412) 1381 : audit [DBG] from='client.44988 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:14:15.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:15 gibba015 bash[29377]: audit 2021-03-10T14:14:13.596321+0000 mgr.gibba045.orlgmj (mgr.34412) 1382 : audit [DBG] from='client.44994 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:14:15.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:15 gibba015 bash[29377]: cluster 2021-03-10T14:14:14.007672+0000 mgr.gibba045.orlgmj (mgr.34412) 1383 : cluster [DBG] pgmap v775: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:15.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:15 gibba015 bash[30343]: audit 2021-03-10T14:14:13.373911+0000 mgr.gibba045.orlgmj (mgr.34412) 1381 : audit [DBG] from='client.44988 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:14:15.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:15 gibba015 bash[30343]: audit 2021-03-10T14:14:13.596321+0000 mgr.gibba045.orlgmj (mgr.34412) 1382 : audit [DBG] from='client.44994 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:14:15.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:15 gibba015 bash[30343]: cluster 2021-03-10T14:14:14.007672+0000 mgr.gibba045.orlgmj (mgr.34412) 1383 : cluster [DBG] pgmap v775: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:17.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:17 gibba045 bash[25517]: cluster 2021-03-10T14:14:16.009424+0000 mgr.gibba045.orlgmj (mgr.34412) 1384 : cluster [DBG] pgmap v776: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:17.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:17 gibba015 bash[29377]: cluster 2021-03-10T14:14:16.009424+0000 mgr.gibba045.orlgmj (mgr.34412) 1384 : cluster [DBG] pgmap v776: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:17.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:17 gibba015 bash[30343]: cluster 2021-03-10T14:14:16.009424+0000 mgr.gibba045.orlgmj (mgr.34412) 1384 : cluster [DBG] pgmap v776: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:19.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:19 gibba045 bash[25517]: cluster 2021-03-10T14:14:18.011037+0000 mgr.gibba045.orlgmj (mgr.34412) 1385 : cluster [DBG] pgmap v777: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:19.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:19 gibba015 bash[29377]: cluster 2021-03-10T14:14:18.011037+0000 mgr.gibba045.orlgmj (mgr.34412) 1385 : cluster [DBG] pgmap v777: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:19.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:19 gibba015 bash[30343]: cluster 2021-03-10T14:14:18.011037+0000 mgr.gibba045.orlgmj (mgr.34412) 1385 : cluster [DBG] pgmap v777: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:21.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:21 gibba045 bash[25517]: cluster 2021-03-10T14:14:20.011819+0000 mgr.gibba045.orlgmj (mgr.34412) 1386 : cluster [DBG] pgmap v778: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:21.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:21 gibba015 bash[29377]: cluster 2021-03-10T14:14:20.011819+0000 mgr.gibba045.orlgmj (mgr.34412) 1386 : cluster [DBG] pgmap v778: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:21.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:21 gibba015 bash[30343]: cluster 2021-03-10T14:14:20.011819+0000 mgr.gibba045.orlgmj (mgr.34412) 1386 : cluster [DBG] pgmap v778: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:23.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:23 gibba045 bash[25517]: cluster 2021-03-10T14:14:22.013514+0000 mgr.gibba045.orlgmj (mgr.34412) 1387 : cluster [DBG] pgmap v779: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:23.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:23 gibba015 bash[29377]: cluster 2021-03-10T14:14:22.013514+0000 mgr.gibba045.orlgmj (mgr.34412) 1387 : cluster [DBG] pgmap v779: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:23.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:23 gibba015 bash[30343]: cluster 2021-03-10T14:14:22.013514+0000 mgr.gibba045.orlgmj (mgr.34412) 1387 : cluster [DBG] pgmap v779: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:24.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:24 gibba045 bash[25517]: audit 2021-03-10T14:14:24.228903+0000 mon.c (mon.1) 448 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:14:24.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:24 gibba045 bash[25517]: audit 2021-03-10T14:14:24.236547+0000 mon.c (mon.1) 449 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:14:24.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:24 gibba015 bash[29377]: audit 2021-03-10T14:14:24.228903+0000 mon.c (mon.1) 448 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:14:24.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:24 gibba015 bash[29377]: audit 2021-03-10T14:14:24.236547+0000 mon.c (mon.1) 449 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:14:24.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:24 gibba015 bash[30343]: audit 2021-03-10T14:14:24.228903+0000 mon.c (mon.1) 448 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:14:24.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:24 gibba015 bash[30343]: audit 2021-03-10T14:14:24.236547+0000 mon.c (mon.1) 449 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:14:25.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:25 gibba015 bash[29377]: cluster 2021-03-10T14:14:24.014794+0000 mgr.gibba045.orlgmj (mgr.34412) 1388 : cluster [DBG] pgmap v780: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:25.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:25 gibba015 bash[29377]: cephadm 2021-03-10T14:14:24.236515+0000 mgr.gibba045.orlgmj (mgr.34412) 1389 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:14:25.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:25 gibba015 bash[30343]: cluster 2021-03-10T14:14:24.014794+0000 mgr.gibba045.orlgmj (mgr.34412) 1388 : cluster [DBG] pgmap v780: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:25.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:25 gibba015 bash[30343]: cephadm 2021-03-10T14:14:24.236515+0000 mgr.gibba045.orlgmj (mgr.34412) 1389 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:14:25.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:25 gibba045 bash[25517]: cluster 2021-03-10T14:14:24.014794+0000 mgr.gibba045.orlgmj (mgr.34412) 1388 : cluster [DBG] pgmap v780: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:25.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:25 gibba045 bash[25517]: cephadm 2021-03-10T14:14:24.236515+0000 mgr.gibba045.orlgmj (mgr.34412) 1389 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:14:27.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:27 gibba015 bash[29377]: cluster 2021-03-10T14:14:26.016387+0000 mgr.gibba045.orlgmj (mgr.34412) 1390 : cluster [DBG] pgmap v781: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:27.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:27 gibba015 bash[30343]: cluster 2021-03-10T14:14:26.016387+0000 mgr.gibba045.orlgmj (mgr.34412) 1390 : cluster [DBG] pgmap v781: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:27.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:27 gibba045 bash[25517]: cluster 2021-03-10T14:14:26.016387+0000 mgr.gibba045.orlgmj (mgr.34412) 1390 : cluster [DBG] pgmap v781: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:29.199 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:28 gibba045 bash[25517]: audit 2021-03-10T14:14:27.935715+0000 mon.a (mon.0) 746 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:14:29.199 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:28 gibba045 bash[25517]: audit 2021-03-10T14:14:27.937056+0000 mon.c (mon.1) 450 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T14:14:29.199 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:28 gibba045 bash[25517]: cluster 2021-03-10T14:14:28.016893+0000 mgr.gibba045.orlgmj (mgr.34412) 1391 : cluster [DBG] pgmap v782: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:29.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:28 gibba015 bash[29377]: audit 2021-03-10T14:14:27.935715+0000 mon.a (mon.0) 746 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:14:29.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:28 gibba015 bash[29377]: audit 2021-03-10T14:14:27.937056+0000 mon.c (mon.1) 450 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T14:14:29.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:28 gibba015 bash[29377]: cluster 2021-03-10T14:14:28.016893+0000 mgr.gibba045.orlgmj (mgr.34412) 1391 : cluster [DBG] pgmap v782: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:29.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:28 gibba015 bash[30343]: audit 2021-03-10T14:14:27.935715+0000 mon.a (mon.0) 746 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:14:29.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:28 gibba015 bash[30343]: audit 2021-03-10T14:14:27.937056+0000 mon.c (mon.1) 450 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T14:14:29.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:28 gibba015 bash[30343]: cluster 2021-03-10T14:14:28.016893+0000 mgr.gibba045.orlgmj (mgr.34412) 1391 : cluster [DBG] pgmap v782: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:31.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:31 gibba015 bash[29377]: cluster 2021-03-10T14:14:30.017438+0000 mgr.gibba045.orlgmj (mgr.34412) 1392 : cluster [DBG] pgmap v783: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:31.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:31 gibba015 bash[30343]: cluster 2021-03-10T14:14:30.017438+0000 mgr.gibba045.orlgmj (mgr.34412) 1392 : cluster [DBG] pgmap v783: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:31.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:31 gibba045 bash[25517]: cluster 2021-03-10T14:14:30.017438+0000 mgr.gibba045.orlgmj (mgr.34412) 1392 : cluster [DBG] pgmap v783: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:33.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:33 gibba045 bash[25517]: cluster 2021-03-10T14:14:32.018836+0000 mgr.gibba045.orlgmj (mgr.34412) 1393 : cluster [DBG] pgmap v784: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:33.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:33 gibba045 bash[25517]: audit 2021-03-10T14:14:32.519240+0000 mon.c (mon.1) 451 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:14:33.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:33 gibba045 bash[25517]: audit 2021-03-10T14:14:32.694640+0000 mon.a (mon.0) 747 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:14:33.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:33 gibba045 bash[25517]: audit 2021-03-10T14:14:32.883631+0000 mon.a (mon.0) 748 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:14:33.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:33 gibba045 bash[25517]: audit 2021-03-10T14:14:32.887441+0000 mon.c (mon.1) 452 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:14:33.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:33 gibba045 bash[25517]: audit 2021-03-10T14:14:32.888938+0000 mon.c (mon.1) 453 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:14:33.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:33 gibba045 bash[25517]: audit 2021-03-10T14:14:32.890119+0000 mon.c (mon.1) 454 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:14:33.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:33 gibba045 bash[25517]: audit 2021-03-10T14:14:32.891380+0000 mon.c (mon.1) 455 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:14:33.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:33 gibba045 bash[25517]: audit 2021-03-10T14:14:32.894489+0000 mon.c (mon.1) 456 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:14:33.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:33 gibba045 bash[25517]: audit 2021-03-10T14:14:32.896236+0000 mon.c (mon.1) 457 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:14:33.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:33 gibba015 bash[29377]: cluster 2021-03-10T14:14:32.018836+0000 mgr.gibba045.orlgmj (mgr.34412) 1393 : cluster [DBG] pgmap v784: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:33.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:33 gibba015 bash[29377]: audit 2021-03-10T14:14:32.519240+0000 mon.c (mon.1) 451 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:14:33.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:33 gibba015 bash[29377]: audit 2021-03-10T14:14:32.694640+0000 mon.a (mon.0) 747 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:14:33.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:33 gibba015 bash[29377]: audit 2021-03-10T14:14:32.883631+0000 mon.a (mon.0) 748 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:14:33.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:33 gibba015 bash[29377]: audit 2021-03-10T14:14:32.887441+0000 mon.c (mon.1) 452 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:14:33.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:33 gibba015 bash[29377]: audit 2021-03-10T14:14:32.888938+0000 mon.c (mon.1) 453 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:14:33.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:33 gibba015 bash[29377]: audit 2021-03-10T14:14:32.890119+0000 mon.c (mon.1) 454 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:14:33.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:33 gibba015 bash[29377]: audit 2021-03-10T14:14:32.891380+0000 mon.c (mon.1) 455 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:14:33.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:33 gibba015 bash[29377]: audit 2021-03-10T14:14:32.894489+0000 mon.c (mon.1) 456 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:14:33.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:33 gibba015 bash[29377]: audit 2021-03-10T14:14:32.896236+0000 mon.c (mon.1) 457 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:14:33.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:33 gibba015 bash[30343]: cluster 2021-03-10T14:14:32.018836+0000 mgr.gibba045.orlgmj (mgr.34412) 1393 : cluster [DBG] pgmap v784: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:33.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:33 gibba015 bash[30343]: audit 2021-03-10T14:14:32.519240+0000 mon.c (mon.1) 451 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:14:33.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:33 gibba015 bash[30343]: audit 2021-03-10T14:14:32.694640+0000 mon.a (mon.0) 747 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:14:33.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:33 gibba015 bash[30343]: audit 2021-03-10T14:14:32.883631+0000 mon.a (mon.0) 748 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:14:33.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:33 gibba015 bash[30343]: audit 2021-03-10T14:14:32.887441+0000 mon.c (mon.1) 452 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:14:33.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:33 gibba015 bash[30343]: audit 2021-03-10T14:14:32.888938+0000 mon.c (mon.1) 453 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:14:33.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:33 gibba015 bash[30343]: audit 2021-03-10T14:14:32.890119+0000 mon.c (mon.1) 454 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:14:33.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:33 gibba015 bash[30343]: audit 2021-03-10T14:14:32.891380+0000 mon.c (mon.1) 455 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:14:33.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:33 gibba015 bash[30343]: audit 2021-03-10T14:14:32.894489+0000 mon.c (mon.1) 456 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:14:33.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:33 gibba015 bash[30343]: audit 2021-03-10T14:14:32.896236+0000 mon.c (mon.1) 457 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:14:34.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:34 gibba015 bash[29377]: cephadm 2021-03-10T14:14:32.697927+0000 mgr.gibba045.orlgmj (mgr.34412) 1394 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:14:34.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:34 gibba015 bash[29377]: cephadm 2021-03-10T14:14:32.888417+0000 mgr.gibba045.orlgmj (mgr.34412) 1395 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:14:34.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:34 gibba015 bash[29377]: cephadm 2021-03-10T14:14:32.890411+0000 mgr.gibba045.orlgmj (mgr.34412) 1396 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:14:34.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:34 gibba015 bash[29377]: cephadm 2021-03-10T14:14:32.891591+0000 mgr.gibba045.orlgmj (mgr.34412) 1397 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:14:34.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:34 gibba015 bash[29377]: cephadm 2021-03-10T14:14:32.891649+0000 mgr.gibba045.orlgmj (mgr.34412) 1398 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:14:34.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:34 gibba015 bash[29377]: cephadm 2021-03-10T14:14:32.892786+0000 mgr.gibba045.orlgmj (mgr.34412) 1399 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:14:34.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:34 gibba015 bash[29377]: cephadm 2021-03-10T14:14:32.892848+0000 mgr.gibba045.orlgmj (mgr.34412) 1400 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:14:34.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:34 gibba015 bash[29377]: cephadm 2021-03-10T14:14:32.893931+0000 mgr.gibba045.orlgmj (mgr.34412) 1401 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:14:34.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:34 gibba015 bash[29377]: cephadm 2021-03-10T14:14:32.895762+0000 mgr.gibba045.orlgmj (mgr.34412) 1402 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:14:34.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:34 gibba015 bash[29377]: cephadm 2021-03-10T14:14:32.895826+0000 mgr.gibba045.orlgmj (mgr.34412) 1403 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:14:34.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:34 gibba015 bash[29377]: cephadm 2021-03-10T14:14:32.897370+0000 mgr.gibba045.orlgmj (mgr.34412) 1404 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:14:34.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:34 gibba015 bash[29377]: cephadm 2021-03-10T14:14:32.897700+0000 mgr.gibba045.orlgmj (mgr.34412) 1405 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:14:34.479 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:34 gibba015 bash[29377]: cephadm 2021-03-10T14:14:32.898910+0000 mgr.gibba045.orlgmj (mgr.34412) 1406 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:14:34.479 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:34 gibba015 bash[29377]: cephadm 2021-03-10T14:14:32.898968+0000 mgr.gibba045.orlgmj (mgr.34412) 1407 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:14:34.479 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:34 gibba015 bash[29377]: cephadm 2021-03-10T14:14:32.899094+0000 mgr.gibba045.orlgmj (mgr.34412) 1408 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:14:34.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:34 gibba015 bash[30343]: cephadm 2021-03-10T14:14:32.697927+0000 mgr.gibba045.orlgmj (mgr.34412) 1394 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:14:34.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:34 gibba015 bash[30343]: cephadm 2021-03-10T14:14:32.888417+0000 mgr.gibba045.orlgmj (mgr.34412) 1395 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:14:34.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:34 gibba015 bash[30343]: cephadm 2021-03-10T14:14:32.890411+0000 mgr.gibba045.orlgmj (mgr.34412) 1396 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:14:34.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:34 gibba015 bash[30343]: cephadm 2021-03-10T14:14:32.891591+0000 mgr.gibba045.orlgmj (mgr.34412) 1397 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:14:34.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:34 gibba015 bash[30343]: cephadm 2021-03-10T14:14:32.891649+0000 mgr.gibba045.orlgmj (mgr.34412) 1398 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:14:34.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:34 gibba015 bash[30343]: cephadm 2021-03-10T14:14:32.892786+0000 mgr.gibba045.orlgmj (mgr.34412) 1399 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:14:34.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:34 gibba015 bash[30343]: cephadm 2021-03-10T14:14:32.892848+0000 mgr.gibba045.orlgmj (mgr.34412) 1400 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:14:34.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:34 gibba015 bash[30343]: cephadm 2021-03-10T14:14:32.893931+0000 mgr.gibba045.orlgmj (mgr.34412) 1401 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:14:34.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:34 gibba015 bash[30343]: cephadm 2021-03-10T14:14:32.895762+0000 mgr.gibba045.orlgmj (mgr.34412) 1402 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:14:34.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:34 gibba015 bash[30343]: cephadm 2021-03-10T14:14:32.895826+0000 mgr.gibba045.orlgmj (mgr.34412) 1403 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:14:34.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:34 gibba015 bash[30343]: cephadm 2021-03-10T14:14:32.897370+0000 mgr.gibba045.orlgmj (mgr.34412) 1404 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:14:34.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:34 gibba015 bash[30343]: cephadm 2021-03-10T14:14:32.897700+0000 mgr.gibba045.orlgmj (mgr.34412) 1405 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:14:34.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:34 gibba015 bash[30343]: cephadm 2021-03-10T14:14:32.898910+0000 mgr.gibba045.orlgmj (mgr.34412) 1406 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:14:34.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:34 gibba015 bash[30343]: cephadm 2021-03-10T14:14:32.898968+0000 mgr.gibba045.orlgmj (mgr.34412) 1407 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:14:34.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:34 gibba015 bash[30343]: cephadm 2021-03-10T14:14:32.899094+0000 mgr.gibba045.orlgmj (mgr.34412) 1408 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:14:34.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:34 gibba045 bash[25517]: cephadm 2021-03-10T14:14:32.697927+0000 mgr.gibba045.orlgmj (mgr.34412) 1394 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:14:34.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:34 gibba045 bash[25517]: cephadm 2021-03-10T14:14:32.888417+0000 mgr.gibba045.orlgmj (mgr.34412) 1395 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:14:34.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:34 gibba045 bash[25517]: cephadm 2021-03-10T14:14:32.890411+0000 mgr.gibba045.orlgmj (mgr.34412) 1396 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:14:34.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:34 gibba045 bash[25517]: cephadm 2021-03-10T14:14:32.891591+0000 mgr.gibba045.orlgmj (mgr.34412) 1397 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:14:34.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:34 gibba045 bash[25517]: cephadm 2021-03-10T14:14:32.891649+0000 mgr.gibba045.orlgmj (mgr.34412) 1398 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:14:34.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:34 gibba045 bash[25517]: cephadm 2021-03-10T14:14:32.892786+0000 mgr.gibba045.orlgmj (mgr.34412) 1399 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:14:34.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:34 gibba045 bash[25517]: cephadm 2021-03-10T14:14:32.892848+0000 mgr.gibba045.orlgmj (mgr.34412) 1400 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:14:34.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:34 gibba045 bash[25517]: cephadm 2021-03-10T14:14:32.893931+0000 mgr.gibba045.orlgmj (mgr.34412) 1401 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:14:34.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:34 gibba045 bash[25517]: cephadm 2021-03-10T14:14:32.895762+0000 mgr.gibba045.orlgmj (mgr.34412) 1402 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:14:34.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:34 gibba045 bash[25517]: cephadm 2021-03-10T14:14:32.895826+0000 mgr.gibba045.orlgmj (mgr.34412) 1403 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:14:34.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:34 gibba045 bash[25517]: cephadm 2021-03-10T14:14:32.897370+0000 mgr.gibba045.orlgmj (mgr.34412) 1404 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:14:34.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:34 gibba045 bash[25517]: cephadm 2021-03-10T14:14:32.897700+0000 mgr.gibba045.orlgmj (mgr.34412) 1405 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:14:34.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:34 gibba045 bash[25517]: cephadm 2021-03-10T14:14:32.898910+0000 mgr.gibba045.orlgmj (mgr.34412) 1406 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:14:34.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:34 gibba045 bash[25517]: cephadm 2021-03-10T14:14:32.898968+0000 mgr.gibba045.orlgmj (mgr.34412) 1407 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:14:34.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:34 gibba045 bash[25517]: cephadm 2021-03-10T14:14:32.899094+0000 mgr.gibba045.orlgmj (mgr.34412) 1408 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:14:35.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:35 gibba015 bash[29377]: cluster 2021-03-10T14:14:34.020162+0000 mgr.gibba045.orlgmj (mgr.34412) 1409 : cluster [DBG] pgmap v785: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:35.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:35 gibba015 bash[30343]: cluster 2021-03-10T14:14:34.020162+0000 mgr.gibba045.orlgmj (mgr.34412) 1409 : cluster [DBG] pgmap v785: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:35.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:35 gibba045 bash[25517]: cluster 2021-03-10T14:14:34.020162+0000 mgr.gibba045.orlgmj (mgr.34412) 1409 : cluster [DBG] pgmap v785: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:37.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:37 gibba015 bash[29377]: cluster 2021-03-10T14:14:36.021826+0000 mgr.gibba045.orlgmj (mgr.34412) 1410 : cluster [DBG] pgmap v786: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:37.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:37 gibba015 bash[30343]: cluster 2021-03-10T14:14:36.021826+0000 mgr.gibba045.orlgmj (mgr.34412) 1410 : cluster [DBG] pgmap v786: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:37.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:37 gibba045 bash[25517]: cluster 2021-03-10T14:14:36.021826+0000 mgr.gibba045.orlgmj (mgr.34412) 1410 : cluster [DBG] pgmap v786: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:39.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:39 gibba015 bash[29377]: cluster 2021-03-10T14:14:38.023344+0000 mgr.gibba045.orlgmj (mgr.34412) 1411 : cluster [DBG] pgmap v787: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:39.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:39 gibba015 bash[30343]: cluster 2021-03-10T14:14:38.023344+0000 mgr.gibba045.orlgmj (mgr.34412) 1411 : cluster [DBG] pgmap v787: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:39.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:39 gibba045 bash[25517]: cluster 2021-03-10T14:14:38.023344+0000 mgr.gibba045.orlgmj (mgr.34412) 1411 : cluster [DBG] pgmap v787: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:41.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:41 gibba015 bash[29377]: cluster 2021-03-10T14:14:40.024083+0000 mgr.gibba045.orlgmj (mgr.34412) 1412 : cluster [DBG] pgmap v788: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:41.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:41 gibba015 bash[30343]: cluster 2021-03-10T14:14:40.024083+0000 mgr.gibba045.orlgmj (mgr.34412) 1412 : cluster [DBG] pgmap v788: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:41.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:41 gibba045 bash[25517]: cluster 2021-03-10T14:14:40.024083+0000 mgr.gibba045.orlgmj (mgr.34412) 1412 : cluster [DBG] pgmap v788: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:43.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:43 gibba015 bash[29377]: cluster 2021-03-10T14:14:42.025649+0000 mgr.gibba045.orlgmj (mgr.34412) 1413 : cluster [DBG] pgmap v789: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:43.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:43 gibba015 bash[30343]: cluster 2021-03-10T14:14:42.025649+0000 mgr.gibba045.orlgmj (mgr.34412) 1413 : cluster [DBG] pgmap v789: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:43.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:43 gibba045 bash[25517]: cluster 2021-03-10T14:14:42.025649+0000 mgr.gibba045.orlgmj (mgr.34412) 1413 : cluster [DBG] pgmap v789: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:44.103 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:14:44.332 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:14:44.332 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (25m) 80s ago 30m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:14:44.333 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (30m) 16s ago 30m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:14:44.333 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (25m) 16s ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:14:44.334 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (26m) 16s ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:14:44.334 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (25m) 80s ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:14:44.334 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (24m) 80s ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:14:44.335 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (24m) 16s ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:14:44.335 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (24m) 80s ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:14:44.336 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (30m) 80s ago 31m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:14:44.336 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (30m) 16s ago 31m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:14:44.337 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (23m) 80s ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:14:44.337 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (23m) 80s ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:14:44.337 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (22m) 80s ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:14:44.338 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (22m) 80s ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:14:44.338 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (22m) 16s ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:14:44.339 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (21m) 16s ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:14:44.339 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (21m) 16s ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:14:44.339 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (20m) 16s ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:14:44.340 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (30m) 16s ago 31m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:14:44.340 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 16s ago 28m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:14:44.580 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:14:44.581 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:14:44.581 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:14:44.581 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:14:44.581 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:14:44.581 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:14:44.582 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:14:44.582 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:14:44.582 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:14:44.582 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:14:44.582 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:14:44.583 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:14:44.583 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:14:44.583 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:14:44.583 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:14:45.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:45 gibba015 bash[29377]: cluster 2021-03-10T14:14:44.027006+0000 mgr.gibba045.orlgmj (mgr.34412) 1414 : cluster [DBG] pgmap v790: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:45.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:45 gibba015 bash[29377]: audit 2021-03-10T14:14:44.094524+0000 mgr.gibba045.orlgmj (mgr.34412) 1415 : audit [DBG] from='client.45006 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:14:45.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:45 gibba015 bash[29377]: audit 2021-03-10T14:14:44.318854+0000 mgr.gibba045.orlgmj (mgr.34412) 1416 : audit [DBG] from='client.45012 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:14:45.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:45 gibba015 bash[29377]: audit 2021-03-10T14:14:44.578877+0000 mon.c (mon.1) 458 : audit [DBG] from='client.? 172.21.2.115:0/310318578' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:14:45.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:45 gibba015 bash[30343]: cluster 2021-03-10T14:14:44.027006+0000 mgr.gibba045.orlgmj (mgr.34412) 1414 : cluster [DBG] pgmap v790: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:45.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:45 gibba015 bash[30343]: audit 2021-03-10T14:14:44.094524+0000 mgr.gibba045.orlgmj (mgr.34412) 1415 : audit [DBG] from='client.45006 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:14:45.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:45 gibba015 bash[30343]: audit 2021-03-10T14:14:44.318854+0000 mgr.gibba045.orlgmj (mgr.34412) 1416 : audit [DBG] from='client.45012 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:14:45.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:45 gibba015 bash[30343]: audit 2021-03-10T14:14:44.578877+0000 mon.c (mon.1) 458 : audit [DBG] from='client.? 172.21.2.115:0/310318578' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:14:45.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:45 gibba045 bash[25517]: cluster 2021-03-10T14:14:44.027006+0000 mgr.gibba045.orlgmj (mgr.34412) 1414 : cluster [DBG] pgmap v790: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:45.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:45 gibba045 bash[25517]: audit 2021-03-10T14:14:44.094524+0000 mgr.gibba045.orlgmj (mgr.34412) 1415 : audit [DBG] from='client.45006 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:14:45.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:45 gibba045 bash[25517]: audit 2021-03-10T14:14:44.318854+0000 mgr.gibba045.orlgmj (mgr.34412) 1416 : audit [DBG] from='client.45012 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:14:45.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:45 gibba045 bash[25517]: audit 2021-03-10T14:14:44.578877+0000 mon.c (mon.1) 458 : audit [DBG] from='client.? 172.21.2.115:0/310318578' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:14:47.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:47 gibba015 bash[29377]: cluster 2021-03-10T14:14:46.028828+0000 mgr.gibba045.orlgmj (mgr.34412) 1417 : cluster [DBG] pgmap v791: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:47.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:47 gibba015 bash[30343]: cluster 2021-03-10T14:14:46.028828+0000 mgr.gibba045.orlgmj (mgr.34412) 1417 : cluster [DBG] pgmap v791: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:47.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:47 gibba045 bash[25517]: cluster 2021-03-10T14:14:46.028828+0000 mgr.gibba045.orlgmj (mgr.34412) 1417 : cluster [DBG] pgmap v791: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:49.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:49 gibba015 bash[29377]: cephadm 2021-03-10T14:14:47.904846+0000 mgr.gibba045.orlgmj (mgr.34412) 1418 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:14:49.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:49 gibba015 bash[29377]: cluster 2021-03-10T14:14:48.030371+0000 mgr.gibba045.orlgmj (mgr.34412) 1419 : cluster [DBG] pgmap v792: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:49.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:49 gibba015 bash[30343]: cephadm 2021-03-10T14:14:47.904846+0000 mgr.gibba045.orlgmj (mgr.34412) 1418 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:14:49.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:49 gibba015 bash[30343]: cluster 2021-03-10T14:14:48.030371+0000 mgr.gibba045.orlgmj (mgr.34412) 1419 : cluster [DBG] pgmap v792: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:49.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:49 gibba045 bash[25517]: cephadm 2021-03-10T14:14:47.904846+0000 mgr.gibba045.orlgmj (mgr.34412) 1418 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:14:49.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:49 gibba045 bash[25517]: cluster 2021-03-10T14:14:48.030371+0000 mgr.gibba045.orlgmj (mgr.34412) 1419 : cluster [DBG] pgmap v792: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:51.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:51 gibba015 bash[29377]: cluster 2021-03-10T14:14:50.030882+0000 mgr.gibba045.orlgmj (mgr.34412) 1420 : cluster [DBG] pgmap v793: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:51.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:51 gibba015 bash[30343]: cluster 2021-03-10T14:14:50.030882+0000 mgr.gibba045.orlgmj (mgr.34412) 1420 : cluster [DBG] pgmap v793: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:51.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:51 gibba045 bash[25517]: cluster 2021-03-10T14:14:50.030882+0000 mgr.gibba045.orlgmj (mgr.34412) 1420 : cluster [DBG] pgmap v793: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:53.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:53 gibba015 bash[29377]: cluster 2021-03-10T14:14:52.032582+0000 mgr.gibba045.orlgmj (mgr.34412) 1421 : cluster [DBG] pgmap v794: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:53.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:53 gibba015 bash[29377]: audit 2021-03-10T14:14:52.592460+0000 mon.c (mon.1) 459 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T14:14:53.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:53 gibba015 bash[29377]: audit 2021-03-10T14:14:52.593199+0000 mon.c (mon.1) 460 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:14:53.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:53 gibba015 bash[29377]: audit 2021-03-10T14:14:52.593725+0000 mon.a (mon.0) 749 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T14:14:53.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:53 gibba015 bash[29377]: audit 2021-03-10T14:14:52.593890+0000 mon.c (mon.1) 461 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:14:53.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:53 gibba015 bash[29377]: audit 2021-03-10T14:14:52.594577+0000 mon.c (mon.1) 462 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:14:53.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:53 gibba015 bash[29377]: audit 2021-03-10T14:14:52.595123+0000 mon.a (mon.0) 750 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:14:53.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:53 gibba015 bash[29377]: audit 2021-03-10T14:14:52.596142+0000 mon.a (mon.0) 751 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:14:53.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:53 gibba015 bash[29377]: audit 2021-03-10T14:14:52.596943+0000 mon.a (mon.0) 752 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:14:53.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:53 gibba015 bash[29377]: audit 2021-03-10T14:14:52.606376+0000 mon.c (mon.1) 463 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:14:53.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:53 gibba015 bash[29377]: audit 2021-03-10T14:14:52.606984+0000 mon.c (mon.1) 464 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:14:53.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:53 gibba015 bash[29377]: audit 2021-03-10T14:14:52.607376+0000 mon.a (mon.0) 753 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:14:53.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:53 gibba015 bash[29377]: audit 2021-03-10T14:14:52.608548+0000 mon.a (mon.0) 754 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:14:53.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:53 gibba015 bash[30343]: cluster 2021-03-10T14:14:52.032582+0000 mgr.gibba045.orlgmj (mgr.34412) 1421 : cluster [DBG] pgmap v794: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:53.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:53 gibba015 bash[30343]: audit 2021-03-10T14:14:52.592460+0000 mon.c (mon.1) 459 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T14:14:53.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:53 gibba015 bash[30343]: audit 2021-03-10T14:14:52.593199+0000 mon.c (mon.1) 460 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:14:53.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:53 gibba015 bash[30343]: audit 2021-03-10T14:14:52.593725+0000 mon.a (mon.0) 749 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T14:14:53.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:53 gibba015 bash[30343]: audit 2021-03-10T14:14:52.593890+0000 mon.c (mon.1) 461 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:14:53.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:53 gibba015 bash[30343]: audit 2021-03-10T14:14:52.594577+0000 mon.c (mon.1) 462 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:14:53.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:53 gibba015 bash[30343]: audit 2021-03-10T14:14:52.595123+0000 mon.a (mon.0) 750 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:14:53.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:53 gibba015 bash[30343]: audit 2021-03-10T14:14:52.596142+0000 mon.a (mon.0) 751 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:14:53.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:53 gibba015 bash[30343]: audit 2021-03-10T14:14:52.596943+0000 mon.a (mon.0) 752 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:14:53.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:53 gibba015 bash[30343]: audit 2021-03-10T14:14:52.606376+0000 mon.c (mon.1) 463 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:14:53.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:53 gibba015 bash[30343]: audit 2021-03-10T14:14:52.606984+0000 mon.c (mon.1) 464 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:14:53.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:53 gibba015 bash[30343]: audit 2021-03-10T14:14:52.607376+0000 mon.a (mon.0) 753 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:14:53.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:53 gibba015 bash[30343]: audit 2021-03-10T14:14:52.608548+0000 mon.a (mon.0) 754 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:14:53.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:53 gibba045 bash[25517]: cluster 2021-03-10T14:14:52.032582+0000 mgr.gibba045.orlgmj (mgr.34412) 1421 : cluster [DBG] pgmap v794: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:53.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:53 gibba045 bash[25517]: audit 2021-03-10T14:14:52.592460+0000 mon.c (mon.1) 459 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T14:14:53.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:53 gibba045 bash[25517]: audit 2021-03-10T14:14:52.593199+0000 mon.c (mon.1) 460 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:14:53.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:53 gibba045 bash[25517]: audit 2021-03-10T14:14:52.593725+0000 mon.a (mon.0) 749 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T14:14:53.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:53 gibba045 bash[25517]: audit 2021-03-10T14:14:52.593890+0000 mon.c (mon.1) 461 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:14:53.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:53 gibba045 bash[25517]: audit 2021-03-10T14:14:52.594577+0000 mon.c (mon.1) 462 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:14:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:53 gibba045 bash[25517]: audit 2021-03-10T14:14:52.595123+0000 mon.a (mon.0) 750 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:14:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:53 gibba045 bash[25517]: audit 2021-03-10T14:14:52.596142+0000 mon.a (mon.0) 751 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:14:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:53 gibba045 bash[25517]: audit 2021-03-10T14:14:52.596943+0000 mon.a (mon.0) 752 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:14:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:53 gibba045 bash[25517]: audit 2021-03-10T14:14:52.606376+0000 mon.c (mon.1) 463 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:14:53.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:53 gibba045 bash[25517]: audit 2021-03-10T14:14:52.606984+0000 mon.c (mon.1) 464 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:14:53.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:53 gibba045 bash[25517]: audit 2021-03-10T14:14:52.607376+0000 mon.a (mon.0) 753 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:14:53.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:53 gibba045 bash[25517]: audit 2021-03-10T14:14:52.608548+0000 mon.a (mon.0) 754 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:14:55.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:55 gibba015 bash[29377]: cluster 2021-03-10T14:14:54.033908+0000 mgr.gibba045.orlgmj (mgr.34412) 1422 : cluster [DBG] pgmap v795: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:55.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:55 gibba015 bash[30343]: cluster 2021-03-10T14:14:54.033908+0000 mgr.gibba045.orlgmj (mgr.34412) 1422 : cluster [DBG] pgmap v795: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:55.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:55 gibba045 bash[25517]: cluster 2021-03-10T14:14:54.033908+0000 mgr.gibba045.orlgmj (mgr.34412) 1422 : cluster [DBG] pgmap v795: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:57.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:57 gibba015 bash[29377]: cluster 2021-03-10T14:14:56.035629+0000 mgr.gibba045.orlgmj (mgr.34412) 1423 : cluster [DBG] pgmap v796: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:57.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:57 gibba015 bash[30343]: cluster 2021-03-10T14:14:56.035629+0000 mgr.gibba045.orlgmj (mgr.34412) 1423 : cluster [DBG] pgmap v796: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:57.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:57 gibba045 bash[25517]: cluster 2021-03-10T14:14:56.035629+0000 mgr.gibba045.orlgmj (mgr.34412) 1423 : cluster [DBG] pgmap v796: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:59.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:14:59 gibba015 bash[29377]: cluster 2021-03-10T14:14:58.037102+0000 mgr.gibba045.orlgmj (mgr.34412) 1424 : cluster [DBG] pgmap v797: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:59.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:14:59 gibba015 bash[30343]: cluster 2021-03-10T14:14:58.037102+0000 mgr.gibba045.orlgmj (mgr.34412) 1424 : cluster [DBG] pgmap v797: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:59.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:14:59 gibba045 bash[25517]: cluster 2021-03-10T14:14:58.037102+0000 mgr.gibba045.orlgmj (mgr.34412) 1424 : cluster [DBG] pgmap v797: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:01.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:15:01 gibba015 bash[29377]: cluster 2021-03-10T14:15:00.038040+0000 mgr.gibba045.orlgmj (mgr.34412) 1425 : cluster [DBG] pgmap v798: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:01.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:15:01 gibba015 bash[30343]: cluster 2021-03-10T14:15:00.038040+0000 mgr.gibba045.orlgmj (mgr.34412) 1425 : cluster [DBG] pgmap v798: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:01.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:15:01 gibba045 bash[25517]: cluster 2021-03-10T14:15:00.038040+0000 mgr.gibba045.orlgmj (mgr.34412) 1425 : cluster [DBG] pgmap v798: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:03.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:15:03 gibba015 bash[29377]: cluster 2021-03-10T14:15:02.039667+0000 mgr.gibba045.orlgmj (mgr.34412) 1426 : cluster [DBG] pgmap v799: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:03.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:15:03 gibba015 bash[30343]: cluster 2021-03-10T14:15:02.039667+0000 mgr.gibba045.orlgmj (mgr.34412) 1426 : cluster [DBG] pgmap v799: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:03.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:15:03 gibba045 bash[25517]: cluster 2021-03-10T14:15:02.039667+0000 mgr.gibba045.orlgmj (mgr.34412) 1426 : cluster [DBG] pgmap v799: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:04.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:15:04 gibba045 bash[25517]: cephadm 2021-03-10T14:15:02.920971+0000 mgr.gibba045.orlgmj (mgr.34412) 1427 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:15:04.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:15:04 gibba015 bash[29377]: cephadm 2021-03-10T14:15:02.920971+0000 mgr.gibba045.orlgmj (mgr.34412) 1427 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:15:04.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:15:04 gibba015 bash[30343]: cephadm 2021-03-10T14:15:02.920971+0000 mgr.gibba045.orlgmj (mgr.34412) 1427 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:15:05.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:15:05 gibba045 bash[25517]: cluster 2021-03-10T14:15:04.041025+0000 mgr.gibba045.orlgmj (mgr.34412) 1428 : cluster [DBG] pgmap v800: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:05.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:15:05 gibba015 bash[29377]: cluster 2021-03-10T14:15:04.041025+0000 mgr.gibba045.orlgmj (mgr.34412) 1428 : cluster [DBG] pgmap v800: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:05.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:15:05 gibba015 bash[30343]: cluster 2021-03-10T14:15:04.041025+0000 mgr.gibba045.orlgmj (mgr.34412) 1428 : cluster [DBG] pgmap v800: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:07.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:15:07 gibba045 bash[25517]: cluster 2021-03-10T14:15:06.042564+0000 mgr.gibba045.orlgmj (mgr.34412) 1429 : cluster [DBG] pgmap v801: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:07.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:15:07 gibba015 bash[29377]: cluster 2021-03-10T14:15:06.042564+0000 mgr.gibba045.orlgmj (mgr.34412) 1429 : cluster [DBG] pgmap v801: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:07.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:15:07 gibba015 bash[30343]: cluster 2021-03-10T14:15:06.042564+0000 mgr.gibba045.orlgmj (mgr.34412) 1429 : cluster [DBG] pgmap v801: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:09.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:15:09 gibba045 bash[25517]: cluster 2021-03-10T14:15:08.044135+0000 mgr.gibba045.orlgmj (mgr.34412) 1430 : cluster [DBG] pgmap v802: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:09.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:15:09 gibba015 bash[29377]: cluster 2021-03-10T14:15:08.044135+0000 mgr.gibba045.orlgmj (mgr.34412) 1430 : cluster [DBG] pgmap v802: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:09.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:15:09 gibba015 bash[30343]: cluster 2021-03-10T14:15:08.044135+0000 mgr.gibba045.orlgmj (mgr.34412) 1430 : cluster [DBG] pgmap v802: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:11.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:15:11 gibba045 bash[25517]: cluster 2021-03-10T14:15:10.045828+0000 mgr.gibba045.orlgmj (mgr.34412) 1431 : cluster [DBG] pgmap v803: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:11.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:15:11 gibba015 bash[29377]: cluster 2021-03-10T14:15:10.045828+0000 mgr.gibba045.orlgmj (mgr.34412) 1431 : cluster [DBG] pgmap v803: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:11.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:15:11 gibba015 bash[30343]: cluster 2021-03-10T14:15:10.045828+0000 mgr.gibba045.orlgmj (mgr.34412) 1431 : cluster [DBG] pgmap v803: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:13.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:15:13 gibba045 bash[25517]: cluster 2021-03-10T14:15:12.047458+0000 mgr.gibba045.orlgmj (mgr.34412) 1432 : cluster [DBG] pgmap v804: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:13.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:15:13 gibba015 bash[29377]: cluster 2021-03-10T14:15:12.047458+0000 mgr.gibba045.orlgmj (mgr.34412) 1432 : cluster [DBG] pgmap v804: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:13.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:15:13 gibba015 bash[30343]: cluster 2021-03-10T14:15:12.047458+0000 mgr.gibba045.orlgmj (mgr.34412) 1432 : cluster [DBG] pgmap v804: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:14.834 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:15:15.062 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:15:15.062 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (25m) 111s ago 31m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:15:15.063 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (31m) 47s ago 31m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:15:15.063 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (26m) 47s ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:15:15.063 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (26m) 47s ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:15:15.063 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (25m) 111s ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:15:15.064 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (25m) 111s ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:15:15.064 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (25m) 47s ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:15:15.064 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (25m) 111s ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:15:15.064 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (31m) 111s ago 31m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:15:15.064 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (31m) 47s ago 31m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:15:15.065 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (24m) 111s ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:15:15.065 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (23m) 111s ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:15:15.065 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (23m) 111s ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:15:15.065 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (22m) 111s ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:15:15.066 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (22m) 47s ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:15:15.066 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (22m) 47s ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:15:15.066 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (21m) 47s ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:15:15.066 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (21m) 47s ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:15:15.066 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (30m) 47s ago 31m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:15:15.067 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 47s ago 29m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:15:15.310 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:15:15.310 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:15:15.310 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:15:15.311 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:15:15.311 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:15:15.311 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:15:15.311 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:15:15.311 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:15:15.312 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:15:15.312 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:15:15.312 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:15:15.312 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:15:15.313 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:15:15.313 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:15:15.313 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:15:15.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:15:15 gibba045 bash[25517]: cluster 2021-03-10T14:15:14.048716+0000 mgr.gibba045.orlgmj (mgr.34412) 1433 : cluster [DBG] pgmap v805: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:15.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:15:15 gibba015 bash[29377]: cluster 2021-03-10T14:15:14.048716+0000 mgr.gibba045.orlgmj (mgr.34412) 1433 : cluster [DBG] pgmap v805: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:15.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:15:15 gibba015 bash[30343]: cluster 2021-03-10T14:15:14.048716+0000 mgr.gibba045.orlgmj (mgr.34412) 1433 : cluster [DBG] pgmap v805: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:16.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:15:16 gibba045 bash[25517]: audit 2021-03-10T14:15:14.825438+0000 mgr.gibba045.orlgmj (mgr.34412) 1434 : audit [DBG] from='client.45024 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:15:16.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:15:16 gibba045 bash[25517]: audit 2021-03-10T14:15:15.050387+0000 mgr.gibba045.orlgmj (mgr.34412) 1435 : audit [DBG] from='client.45030 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:15:16.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:15:16 gibba045 bash[25517]: audit 2021-03-10T14:15:15.308172+0000 mon.a (mon.0) 755 : audit [DBG] from='client.? 172.21.2.115:0/3186965935' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:15:16.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:15:16 gibba015 bash[29377]: audit 2021-03-10T14:15:14.825438+0000 mgr.gibba045.orlgmj (mgr.34412) 1434 : audit [DBG] from='client.45024 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:15:16.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:15:16 gibba015 bash[29377]: audit 2021-03-10T14:15:15.050387+0000 mgr.gibba045.orlgmj (mgr.34412) 1435 : audit [DBG] from='client.45030 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:15:16.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:15:16 gibba015 bash[29377]: audit 2021-03-10T14:15:15.308172+0000 mon.a (mon.0) 755 : audit [DBG] from='client.? 172.21.2.115:0/3186965935' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:15:16.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:15:16 gibba015 bash[30343]: audit 2021-03-10T14:15:14.825438+0000 mgr.gibba045.orlgmj (mgr.34412) 1434 : audit [DBG] from='client.45024 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:15:16.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:15:16 gibba015 bash[30343]: audit 2021-03-10T14:15:15.050387+0000 mgr.gibba045.orlgmj (mgr.34412) 1435 : audit [DBG] from='client.45030 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:15:16.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:15:16 gibba015 bash[30343]: audit 2021-03-10T14:15:15.308172+0000 mon.a (mon.0) 755 : audit [DBG] from='client.? 172.21.2.115:0/3186965935' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:15:17.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:15:17 gibba045 bash[25517]: cluster 2021-03-10T14:15:16.050507+0000 mgr.gibba045.orlgmj (mgr.34412) 1436 : cluster [DBG] pgmap v806: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:17.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:15:17 gibba015 bash[29377]: cluster 2021-03-10T14:15:16.050507+0000 mgr.gibba045.orlgmj (mgr.34412) 1436 : cluster [DBG] pgmap v806: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:17.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:15:17 gibba015 bash[30343]: cluster 2021-03-10T14:15:16.050507+0000 mgr.gibba045.orlgmj (mgr.34412) 1436 : cluster [DBG] pgmap v806: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:19.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:15:19 gibba015 bash[29377]: cephadm 2021-03-10T14:15:17.936806+0000 mgr.gibba045.orlgmj (mgr.34412) 1437 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:15:19.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:15:19 gibba015 bash[29377]: cluster 2021-03-10T14:15:18.052082+0000 mgr.gibba045.orlgmj (mgr.34412) 1438 : cluster [DBG] pgmap v807: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:19.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:15:19 gibba015 bash[30343]: cephadm 2021-03-10T14:15:17.936806+0000 mgr.gibba045.orlgmj (mgr.34412) 1437 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:15:19.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:15:19 gibba015 bash[30343]: cluster 2021-03-10T14:15:18.052082+0000 mgr.gibba045.orlgmj (mgr.34412) 1438 : cluster [DBG] pgmap v807: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:19.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:15:19 gibba045 bash[25517]: cephadm 2021-03-10T14:15:17.936806+0000 mgr.gibba045.orlgmj (mgr.34412) 1437 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:15:19.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:15:19 gibba045 bash[25517]: cluster 2021-03-10T14:15:18.052082+0000 mgr.gibba045.orlgmj (mgr.34412) 1438 : cluster [DBG] pgmap v807: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:21.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:15:21 gibba015 bash[29377]: cluster 2021-03-10T14:15:20.053075+0000 mgr.gibba045.orlgmj (mgr.34412) 1439 : cluster [DBG] pgmap v808: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:21.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:15:21 gibba015 bash[30343]: cluster 2021-03-10T14:15:20.053075+0000 mgr.gibba045.orlgmj (mgr.34412) 1439 : cluster [DBG] pgmap v808: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:21.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:15:21 gibba045 bash[25517]: cluster 2021-03-10T14:15:20.053075+0000 mgr.gibba045.orlgmj (mgr.34412) 1439 : cluster [DBG] pgmap v808: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:23.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:15:23 gibba015 bash[29377]: cluster 2021-03-10T14:15:22.054380+0000 mgr.gibba045.orlgmj (mgr.34412) 1440 : cluster [DBG] pgmap v809: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:23.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:15:23 gibba015 bash[30343]: cluster 2021-03-10T14:15:22.054380+0000 mgr.gibba045.orlgmj (mgr.34412) 1440 : cluster [DBG] pgmap v809: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:23.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:15:23 gibba045 bash[25517]: cluster 2021-03-10T14:15:22.054380+0000 mgr.gibba045.orlgmj (mgr.34412) 1440 : cluster [DBG] pgmap v809: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:25.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:15:25 gibba015 bash[29377]: cluster 2021-03-10T14:15:24.055606+0000 mgr.gibba045.orlgmj (mgr.34412) 1441 : cluster [DBG] pgmap v810: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:25.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:15:25 gibba015 bash[30343]: cluster 2021-03-10T14:15:24.055606+0000 mgr.gibba045.orlgmj (mgr.34412) 1441 : cluster [DBG] pgmap v810: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:25.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:15:25 gibba045 bash[25517]: cluster 2021-03-10T14:15:24.055606+0000 mgr.gibba045.orlgmj (mgr.34412) 1441 : cluster [DBG] pgmap v810: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:27.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:15:27 gibba015 bash[29377]: cluster 2021-03-10T14:15:26.057462+0000 mgr.gibba045.orlgmj (mgr.34412) 1442 : cluster [DBG] pgmap v811: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:27.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:15:27 gibba015 bash[30343]: cluster 2021-03-10T14:15:26.057462+0000 mgr.gibba045.orlgmj (mgr.34412) 1442 : cluster [DBG] pgmap v811: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:27.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:15:27 gibba045 bash[25517]: cluster 2021-03-10T14:15:26.057462+0000 mgr.gibba045.orlgmj (mgr.34412) 1442 : cluster [DBG] pgmap v811: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:29.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:15:29 gibba015 bash[29377]: cluster 2021-03-10T14:15:28.059075+0000 mgr.gibba045.orlgmj (mgr.34412) 1443 : cluster [DBG] pgmap v812: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:29.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:15:29 gibba015 bash[30343]: cluster 2021-03-10T14:15:28.059075+0000 mgr.gibba045.orlgmj (mgr.34412) 1443 : cluster [DBG] pgmap v812: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:29.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:15:29 gibba045 bash[25517]: cluster 2021-03-10T14:15:28.059075+0000 mgr.gibba045.orlgmj (mgr.34412) 1443 : cluster [DBG] pgmap v812: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:30.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:15:30 gibba015 bash[29377]: cluster 2021-03-10T14:15:30.060023+0000 mgr.gibba045.orlgmj (mgr.34412) 1444 : cluster [DBG] pgmap v813: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:30.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:15:30 gibba015 bash[30343]: cluster 2021-03-10T14:15:30.060023+0000 mgr.gibba045.orlgmj (mgr.34412) 1444 : cluster [DBG] pgmap v813: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:30.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:15:30 gibba045 bash[25517]: cluster 2021-03-10T14:15:30.060023+0000 mgr.gibba045.orlgmj (mgr.34412) 1444 : cluster [DBG] pgmap v813: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:33.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:15:33 gibba015 bash[29377]: cluster 2021-03-10T14:15:32.061677+0000 mgr.gibba045.orlgmj (mgr.34412) 1445 : cluster [DBG] pgmap v814: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:33.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:15:33 gibba015 bash[29377]: audit 2021-03-10T14:15:32.951691+0000 mon.c (mon.1) 465 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:15:33.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:15:33 gibba015 bash[30343]: cluster 2021-03-10T14:15:32.061677+0000 mgr.gibba045.orlgmj (mgr.34412) 1445 : cluster [DBG] pgmap v814: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:33.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:15:33 gibba015 bash[30343]: audit 2021-03-10T14:15:32.951691+0000 mon.c (mon.1) 465 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:15:33.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:15:33 gibba045 bash[25517]: cluster 2021-03-10T14:15:32.061677+0000 mgr.gibba045.orlgmj (mgr.34412) 1445 : cluster [DBG] pgmap v814: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:33.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:15:33 gibba045 bash[25517]: audit 2021-03-10T14:15:32.951691+0000 mon.c (mon.1) 465 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:15:34.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:15:34 gibba015 bash[29377]: cephadm 2021-03-10T14:15:32.959009+0000 mgr.gibba045.orlgmj (mgr.34412) 1446 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:15:34.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:15:34 gibba015 bash[29377]: cephadm 2021-03-10T14:15:32.960677+0000 mgr.gibba045.orlgmj (mgr.34412) 1447 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:15:34.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:15:34 gibba015 bash[29377]: audit 2021-03-10T14:15:33.188328+0000 mon.a (mon.0) 756 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:15:34.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:15:34 gibba015 bash[29377]: audit 2021-03-10T14:15:33.192143+0000 mon.c (mon.1) 466 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:15:34.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:15:34 gibba015 bash[29377]: cephadm 2021-03-10T14:15:33.193382+0000 mgr.gibba045.orlgmj (mgr.34412) 1448 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:15:34.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:15:34 gibba015 bash[29377]: audit 2021-03-10T14:15:33.193762+0000 mon.c (mon.1) 467 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:15:34.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:15:34 gibba015 bash[29377]: audit 2021-03-10T14:15:33.194973+0000 mon.c (mon.1) 468 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:15:34.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:15:34 gibba015 bash[29377]: cephadm 2021-03-10T14:15:33.195226+0000 mgr.gibba045.orlgmj (mgr.34412) 1449 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:15:34.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:15:34 gibba015 bash[29377]: audit 2021-03-10T14:15:33.196243+0000 mon.c (mon.1) 469 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:15:34.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:15:34 gibba015 bash[29377]: cephadm 2021-03-10T14:15:33.196512+0000 mgr.gibba045.orlgmj (mgr.34412) 1450 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:15:34.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:15:34 gibba015 bash[29377]: cephadm 2021-03-10T14:15:33.196576+0000 mgr.gibba045.orlgmj (mgr.34412) 1451 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:15:34.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:15:34 gibba015 bash[29377]: cephadm 2021-03-10T14:15:33.197735+0000 mgr.gibba045.orlgmj (mgr.34412) 1452 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:15:34.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:15:34 gibba015 bash[29377]: cephadm 2021-03-10T14:15:33.197800+0000 mgr.gibba045.orlgmj (mgr.34412) 1453 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:15:34.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:15:34 gibba015 bash[29377]: cephadm 2021-03-10T14:15:33.198860+0000 mgr.gibba045.orlgmj (mgr.34412) 1454 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:15:34.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:15:34 gibba015 bash[29377]: audit 2021-03-10T14:15:33.199202+0000 mon.c (mon.1) 470 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:15:34.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:15:34 gibba015 bash[29377]: cephadm 2021-03-10T14:15:33.200493+0000 mgr.gibba045.orlgmj (mgr.34412) 1455 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:15:34.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:15:34 gibba015 bash[29377]: cephadm 2021-03-10T14:15:33.200555+0000 mgr.gibba045.orlgmj (mgr.34412) 1456 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:15:34.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:15:34 gibba015 bash[29377]: audit 2021-03-10T14:15:33.200704+0000 mon.c (mon.1) 471 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:15:34.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:15:34 gibba015 bash[29377]: cephadm 2021-03-10T14:15:33.202013+0000 mgr.gibba045.orlgmj (mgr.34412) 1457 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:15:34.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:15:34 gibba015 bash[29377]: cephadm 2021-03-10T14:15:33.202388+0000 mgr.gibba045.orlgmj (mgr.34412) 1458 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:15:34.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:15:34 gibba015 bash[29377]: cephadm 2021-03-10T14:15:33.203418+0000 mgr.gibba045.orlgmj (mgr.34412) 1459 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:15:34.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:15:34 gibba015 bash[29377]: cephadm 2021-03-10T14:15:33.203471+0000 mgr.gibba045.orlgmj (mgr.34412) 1460 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:15:34.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:15:34 gibba015 bash[29377]: cephadm 2021-03-10T14:15:33.203614+0000 mgr.gibba045.orlgmj (mgr.34412) 1461 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:15:34.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:15:34 gibba015 bash[30343]: cephadm 2021-03-10T14:15:32.959009+0000 mgr.gibba045.orlgmj (mgr.34412) 1446 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:15:34.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:15:34 gibba015 bash[30343]: cephadm 2021-03-10T14:15:32.960677+0000 mgr.gibba045.orlgmj (mgr.34412) 1447 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:15:34.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:15:34 gibba015 bash[30343]: audit 2021-03-10T14:15:33.188328+0000 mon.a (mon.0) 756 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:15:34.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:15:34 gibba015 bash[30343]: audit 2021-03-10T14:15:33.192143+0000 mon.c (mon.1) 466 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:15:34.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:15:34 gibba015 bash[30343]: cephadm 2021-03-10T14:15:33.193382+0000 mgr.gibba045.orlgmj (mgr.34412) 1448 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:15:34.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:15:34 gibba015 bash[30343]: audit 2021-03-10T14:15:33.193762+0000 mon.c (mon.1) 467 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:15:34.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:15:34 gibba015 bash[30343]: audit 2021-03-10T14:15:33.194973+0000 mon.c (mon.1) 468 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:15:34.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:15:34 gibba015 bash[30343]: cephadm 2021-03-10T14:15:33.195226+0000 mgr.gibba045.orlgmj (mgr.34412) 1449 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:15:34.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:15:34 gibba015 bash[30343]: audit 2021-03-10T14:15:33.196243+0000 mon.c (mon.1) 469 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:15:34.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:15:34 gibba015 bash[30343]: cephadm 2021-03-10T14:15:33.196512+0000 mgr.gibba045.orlgmj (mgr.34412) 1450 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:15:34.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:15:34 gibba015 bash[30343]: cephadm 2021-03-10T14:15:33.196576+0000 mgr.gibba045.orlgmj (mgr.34412) 1451 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:15:34.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:15:34 gibba015 bash[30343]: cephadm 2021-03-10T14:15:33.197735+0000 mgr.gibba045.orlgmj (mgr.34412) 1452 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:15:34.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:15:34 gibba015 bash[30343]: cephadm 2021-03-10T14:15:33.197800+0000 mgr.gibba045.orlgmj (mgr.34412) 1453 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:15:34.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:15:34 gibba015 bash[30343]: cephadm 2021-03-10T14:15:33.198860+0000 mgr.gibba045.orlgmj (mgr.34412) 1454 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:15:34.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:15:34 gibba015 bash[30343]: audit 2021-03-10T14:15:33.199202+0000 mon.c (mon.1) 470 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:15:34.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:15:34 gibba015 bash[30343]: cephadm 2021-03-10T14:15:33.200493+0000 mgr.gibba045.orlgmj (mgr.34412) 1455 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:15:34.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:15:34 gibba015 bash[30343]: cephadm 2021-03-10T14:15:33.200555+0000 mgr.gibba045.orlgmj (mgr.34412) 1456 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:15:34.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:15:34 gibba015 bash[30343]: audit 2021-03-10T14:15:33.200704+0000 mon.c (mon.1) 471 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:15:34.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:15:34 gibba015 bash[30343]: cephadm 2021-03-10T14:15:33.202013+0000 mgr.gibba045.orlgmj (mgr.34412) 1457 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:15:34.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:15:34 gibba015 bash[30343]: cephadm 2021-03-10T14:15:33.202388+0000 mgr.gibba045.orlgmj (mgr.34412) 1458 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:15:34.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:15:34 gibba015 bash[30343]: cephadm 2021-03-10T14:15:33.203418+0000 mgr.gibba045.orlgmj (mgr.34412) 1459 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:15:34.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:15:34 gibba015 bash[30343]: cephadm 2021-03-10T14:15:33.203471+0000 mgr.gibba045.orlgmj (mgr.34412) 1460 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:15:34.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:15:34 gibba015 bash[30343]: cephadm 2021-03-10T14:15:33.203614+0000 mgr.gibba045.orlgmj (mgr.34412) 1461 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:15:34.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:15:34 gibba045 bash[25517]: cephadm 2021-03-10T14:15:32.959009+0000 mgr.gibba045.orlgmj (mgr.34412) 1446 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:15:34.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:15:34 gibba045 bash[25517]: cephadm 2021-03-10T14:15:32.960677+0000 mgr.gibba045.orlgmj (mgr.34412) 1447 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:15:34.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:15:34 gibba045 bash[25517]: audit 2021-03-10T14:15:33.188328+0000 mon.a (mon.0) 756 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:15:34.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:15:34 gibba045 bash[25517]: audit 2021-03-10T14:15:33.192143+0000 mon.c (mon.1) 466 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:15:34.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:15:34 gibba045 bash[25517]: cephadm 2021-03-10T14:15:33.193382+0000 mgr.gibba045.orlgmj (mgr.34412) 1448 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:15:34.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:15:34 gibba045 bash[25517]: audit 2021-03-10T14:15:33.193762+0000 mon.c (mon.1) 467 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:15:34.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:15:34 gibba045 bash[25517]: audit 2021-03-10T14:15:33.194973+0000 mon.c (mon.1) 468 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:15:34.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:15:34 gibba045 bash[25517]: cephadm 2021-03-10T14:15:33.195226+0000 mgr.gibba045.orlgmj (mgr.34412) 1449 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:15:34.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:15:34 gibba045 bash[25517]: audit 2021-03-10T14:15:33.196243+0000 mon.c (mon.1) 469 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:15:34.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:15:34 gibba045 bash[25517]: cephadm 2021-03-10T14:15:33.196512+0000 mgr.gibba045.orlgmj (mgr.34412) 1450 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:15:34.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:15:34 gibba045 bash[25517]: cephadm 2021-03-10T14:15:33.196576+0000 mgr.gibba045.orlgmj (mgr.34412) 1451 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:15:34.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:15:34 gibba045 bash[25517]: cephadm 2021-03-10T14:15:33.197735+0000 mgr.gibba045.orlgmj (mgr.34412) 1452 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:15:34.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:15:34 gibba045 bash[25517]: cephadm 2021-03-10T14:15:33.197800+0000 mgr.gibba045.orlgmj (mgr.34412) 1453 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:15:34.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:15:34 gibba045 bash[25517]: cephadm 2021-03-10T14:15:33.198860+0000 mgr.gibba045.orlgmj (mgr.34412) 1454 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:15:34.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:15:34 gibba045 bash[25517]: audit 2021-03-10T14:15:33.199202+0000 mon.c (mon.1) 470 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:15:34.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:15:34 gibba045 bash[25517]: cephadm 2021-03-10T14:15:33.200493+0000 mgr.gibba045.orlgmj (mgr.34412) 1455 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:15:34.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:15:34 gibba045 bash[25517]: cephadm 2021-03-10T14:15:33.200555+0000 mgr.gibba045.orlgmj (mgr.34412) 1456 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:15:34.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:15:34 gibba045 bash[25517]: audit 2021-03-10T14:15:33.200704+0000 mon.c (mon.1) 471 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:15:34.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:15:34 gibba045 bash[25517]: cephadm 2021-03-10T14:15:33.202013+0000 mgr.gibba045.orlgmj (mgr.34412) 1457 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:15:34.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:15:34 gibba045 bash[25517]: cephadm 2021-03-10T14:15:33.202388+0000 mgr.gibba045.orlgmj (mgr.34412) 1458 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:15:34.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:15:34 gibba045 bash[25517]: cephadm 2021-03-10T14:15:33.203418+0000 mgr.gibba045.orlgmj (mgr.34412) 1459 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:15:34.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:15:34 gibba045 bash[25517]: cephadm 2021-03-10T14:15:33.203471+0000 mgr.gibba045.orlgmj (mgr.34412) 1460 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:15:34.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:15:34 gibba045 bash[25517]: cephadm 2021-03-10T14:15:33.203614+0000 mgr.gibba045.orlgmj (mgr.34412) 1461 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:15:35.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:15:35 gibba015 bash[29377]: cluster 2021-03-10T14:15:34.062911+0000 mgr.gibba045.orlgmj (mgr.34412) 1462 : cluster [DBG] pgmap v815: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:35.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:15:35 gibba015 bash[30343]: cluster 2021-03-10T14:15:34.062911+0000 mgr.gibba045.orlgmj (mgr.34412) 1462 : cluster [DBG] pgmap v815: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:35.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:15:35 gibba045 bash[25517]: cluster 2021-03-10T14:15:34.062911+0000 mgr.gibba045.orlgmj (mgr.34412) 1462 : cluster [DBG] pgmap v815: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:37.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:15:37 gibba015 bash[29377]: cluster 2021-03-10T14:15:36.064892+0000 mgr.gibba045.orlgmj (mgr.34412) 1463 : cluster [DBG] pgmap v816: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:37.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:15:37 gibba015 bash[30343]: cluster 2021-03-10T14:15:36.064892+0000 mgr.gibba045.orlgmj (mgr.34412) 1463 : cluster [DBG] pgmap v816: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:37.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:15:37 gibba045 bash[25517]: cluster 2021-03-10T14:15:36.064892+0000 mgr.gibba045.orlgmj (mgr.34412) 1463 : cluster [DBG] pgmap v816: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:39.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:15:39 gibba045 bash[25517]: cluster 2021-03-10T14:15:38.066299+0000 mgr.gibba045.orlgmj (mgr.34412) 1464 : cluster [DBG] pgmap v817: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:39.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:15:39 gibba015 bash[29377]: cluster 2021-03-10T14:15:38.066299+0000 mgr.gibba045.orlgmj (mgr.34412) 1464 : cluster [DBG] pgmap v817: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:39.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:15:39 gibba015 bash[30343]: cluster 2021-03-10T14:15:38.066299+0000 mgr.gibba045.orlgmj (mgr.34412) 1464 : cluster [DBG] pgmap v817: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:41.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:15:41 gibba045 bash[25517]: cluster 2021-03-10T14:15:40.067345+0000 mgr.gibba045.orlgmj (mgr.34412) 1465 : cluster [DBG] pgmap v818: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:41.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:15:41 gibba015 bash[29377]: cluster 2021-03-10T14:15:40.067345+0000 mgr.gibba045.orlgmj (mgr.34412) 1465 : cluster [DBG] pgmap v818: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:41.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:15:41 gibba015 bash[30343]: cluster 2021-03-10T14:15:40.067345+0000 mgr.gibba045.orlgmj (mgr.34412) 1465 : cluster [DBG] pgmap v818: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:43.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:15:43 gibba045 bash[25517]: cluster 2021-03-10T14:15:42.068784+0000 mgr.gibba045.orlgmj (mgr.34412) 1466 : cluster [DBG] pgmap v819: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:43.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:15:43 gibba015 bash[29377]: cluster 2021-03-10T14:15:42.068784+0000 mgr.gibba045.orlgmj (mgr.34412) 1466 : cluster [DBG] pgmap v819: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:43.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:15:43 gibba015 bash[30343]: cluster 2021-03-10T14:15:42.068784+0000 mgr.gibba045.orlgmj (mgr.34412) 1466 : cluster [DBG] pgmap v819: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:45.549 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:15:45.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:15:45 gibba045 bash[25517]: cluster 2021-03-10T14:15:44.069997+0000 mgr.gibba045.orlgmj (mgr.34412) 1467 : cluster [DBG] pgmap v820: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:45.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:15:45 gibba015 bash[29377]: cluster 2021-03-10T14:15:44.069997+0000 mgr.gibba045.orlgmj (mgr.34412) 1467 : cluster [DBG] pgmap v820: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:45.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:15:45 gibba015 bash[30343]: cluster 2021-03-10T14:15:44.069997+0000 mgr.gibba045.orlgmj (mgr.34412) 1467 : cluster [DBG] pgmap v820: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:45.780 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:15:45.781 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (26m) 2m ago 31m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:15:45.781 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (31m) 77s ago 31m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:15:45.781 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (26m) 77s ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:15:45.782 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (27m) 77s ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:15:45.782 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (26m) 2m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:15:45.782 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (26m) 2m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:15:45.782 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (25m) 77s ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:15:45.782 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (25m) 2m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:15:45.783 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (31m) 2m ago 32m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:15:45.783 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (32m) 77s ago 32m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:15:45.783 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (24m) 2m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:15:45.783 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (24m) 2m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:15:45.784 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (23m) 2m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:15:45.784 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (23m) 2m ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:15:45.784 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (23m) 77s ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:15:45.784 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (22m) 77s ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:15:45.785 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (22m) 77s ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:15:45.785 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (21m) 77s ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:15:45.785 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (31m) 77s ago 32m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:15:45.785 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 77s ago 29m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:15:46.030 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:15:46.030 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:15:46.031 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:15:46.031 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:15:46.031 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:15:46.031 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:15:46.031 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:15:46.032 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:15:46.032 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:15:46.032 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:15:46.033 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:15:46.033 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:15:46.033 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:15:46.033 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:15:46.033 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:15:46.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:15:46 gibba045 bash[25517]: audit 2021-03-10T14:15:46.028169+0000 mon.a (mon.0) 757 : audit [DBG] from='client.? 172.21.2.115:0/459108225' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:15:46.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:15:46 gibba015 bash[29377]: audit 2021-03-10T14:15:46.028169+0000 mon.a (mon.0) 757 : audit [DBG] from='client.? 172.21.2.115:0/459108225' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:15:46.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:15:46 gibba015 bash[30343]: audit 2021-03-10T14:15:46.028169+0000 mon.a (mon.0) 757 : audit [DBG] from='client.? 172.21.2.115:0/459108225' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:15:47.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:15:47 gibba045 bash[25517]: audit 2021-03-10T14:15:45.539926+0000 mgr.gibba045.orlgmj (mgr.34412) 1468 : audit [DBG] from='client.45042 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:15:47.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:15:47 gibba045 bash[25517]: audit 2021-03-10T14:15:45.767923+0000 mgr.gibba045.orlgmj (mgr.34412) 1469 : audit [DBG] from='client.45048 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:15:47.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:15:47 gibba045 bash[25517]: cluster 2021-03-10T14:15:46.071614+0000 mgr.gibba045.orlgmj (mgr.34412) 1470 : cluster [DBG] pgmap v821: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:47.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:15:47 gibba015 bash[29377]: audit 2021-03-10T14:15:45.539926+0000 mgr.gibba045.orlgmj (mgr.34412) 1468 : audit [DBG] from='client.45042 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:15:47.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:15:47 gibba015 bash[29377]: audit 2021-03-10T14:15:45.767923+0000 mgr.gibba045.orlgmj (mgr.34412) 1469 : audit [DBG] from='client.45048 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:15:47.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:15:47 gibba015 bash[29377]: cluster 2021-03-10T14:15:46.071614+0000 mgr.gibba045.orlgmj (mgr.34412) 1470 : cluster [DBG] pgmap v821: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:47.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:15:47 gibba015 bash[30343]: audit 2021-03-10T14:15:45.539926+0000 mgr.gibba045.orlgmj (mgr.34412) 1468 : audit [DBG] from='client.45042 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:15:47.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:15:47 gibba015 bash[30343]: audit 2021-03-10T14:15:45.767923+0000 mgr.gibba045.orlgmj (mgr.34412) 1469 : audit [DBG] from='client.45048 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:15:47.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:15:47 gibba015 bash[30343]: cluster 2021-03-10T14:15:46.071614+0000 mgr.gibba045.orlgmj (mgr.34412) 1470 : cluster [DBG] pgmap v821: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:49.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:15:49 gibba045 bash[25517]: cluster 2021-03-10T14:15:48.073034+0000 mgr.gibba045.orlgmj (mgr.34412) 1471 : cluster [DBG] pgmap v822: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:49.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:15:49 gibba045 bash[25517]: cephadm 2021-03-10T14:15:48.213227+0000 mgr.gibba045.orlgmj (mgr.34412) 1472 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:15:49.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:15:49 gibba015 bash[29377]: cluster 2021-03-10T14:15:48.073034+0000 mgr.gibba045.orlgmj (mgr.34412) 1471 : cluster [DBG] pgmap v822: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:49.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:15:49 gibba015 bash[29377]: cephadm 2021-03-10T14:15:48.213227+0000 mgr.gibba045.orlgmj (mgr.34412) 1472 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:15:49.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:15:49 gibba015 bash[30343]: cluster 2021-03-10T14:15:48.073034+0000 mgr.gibba045.orlgmj (mgr.34412) 1471 : cluster [DBG] pgmap v822: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:49.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:15:49 gibba015 bash[30343]: cephadm 2021-03-10T14:15:48.213227+0000 mgr.gibba045.orlgmj (mgr.34412) 1472 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:15:51.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:15:51 gibba045 bash[25517]: cluster 2021-03-10T14:15:50.073831+0000 mgr.gibba045.orlgmj (mgr.34412) 1473 : cluster [DBG] pgmap v823: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:51.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:15:51 gibba015 bash[29377]: cluster 2021-03-10T14:15:50.073831+0000 mgr.gibba045.orlgmj (mgr.34412) 1473 : cluster [DBG] pgmap v823: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:51.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:15:51 gibba015 bash[30343]: cluster 2021-03-10T14:15:50.073831+0000 mgr.gibba045.orlgmj (mgr.34412) 1473 : cluster [DBG] pgmap v823: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:53.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:15:53 gibba045 bash[25517]: cluster 2021-03-10T14:15:52.075459+0000 mgr.gibba045.orlgmj (mgr.34412) 1474 : cluster [DBG] pgmap v824: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:53.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:15:53 gibba045 bash[25517]: audit 2021-03-10T14:15:52.602196+0000 mon.c (mon.1) 472 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T14:15:53.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:15:53 gibba045 bash[25517]: audit 2021-03-10T14:15:52.602976+0000 mon.c (mon.1) 473 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:15:53.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:15:53 gibba045 bash[25517]: audit 2021-03-10T14:15:52.603399+0000 mon.a (mon.0) 758 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T14:15:53.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:15:53 gibba045 bash[25517]: audit 2021-03-10T14:15:52.603667+0000 mon.c (mon.1) 474 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T14:15:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:15:53 gibba045 bash[25517]: audit 2021-03-10T14:15:52.604466+0000 mon.c (mon.1) 475 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:15:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:15:53 gibba045 bash[25517]: audit 2021-03-10T14:15:52.604623+0000 mon.a (mon.0) 759 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:15:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:15:53 gibba045 bash[25517]: audit 2021-03-10T14:15:52.605795+0000 mon.a (mon.0) 760 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T14:15:53.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:15:53 gibba045 bash[25517]: audit 2021-03-10T14:15:52.606641+0000 mon.a (mon.0) 761 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:15:53.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:15:53 gibba045 bash[25517]: audit 2021-03-10T14:15:52.610080+0000 mon.c (mon.1) 476 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:15:53.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:15:53 gibba045 bash[25517]: audit 2021-03-10T14:15:52.611049+0000 mon.c (mon.1) 477 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:15:53.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:15:53 gibba045 bash[25517]: audit 2021-03-10T14:15:52.611227+0000 mon.a (mon.0) 762 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:15:53.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:15:53 gibba045 bash[25517]: audit 2021-03-10T14:15:52.612404+0000 mon.a (mon.0) 763 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:15:53.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:15:53 gibba015 bash[29377]: cluster 2021-03-10T14:15:52.075459+0000 mgr.gibba045.orlgmj (mgr.34412) 1474 : cluster [DBG] pgmap v824: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:53.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:15:53 gibba015 bash[29377]: audit 2021-03-10T14:15:52.602196+0000 mon.c (mon.1) 472 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T14:15:53.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:15:53 gibba015 bash[29377]: audit 2021-03-10T14:15:52.602976+0000 mon.c (mon.1) 473 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:15:53.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:15:53 gibba015 bash[29377]: audit 2021-03-10T14:15:52.603399+0000 mon.a (mon.0) 758 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T14:15:53.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:15:53 gibba015 bash[29377]: audit 2021-03-10T14:15:52.603667+0000 mon.c (mon.1) 474 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T14:15:53.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:15:53 gibba015 bash[29377]: audit 2021-03-10T14:15:52.604466+0000 mon.c (mon.1) 475 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:15:53.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:15:53 gibba015 bash[29377]: audit 2021-03-10T14:15:52.604623+0000 mon.a (mon.0) 759 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:15:53.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:15:53 gibba015 bash[29377]: audit 2021-03-10T14:15:52.605795+0000 mon.a (mon.0) 760 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T14:15:53.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:15:53 gibba015 bash[29377]: audit 2021-03-10T14:15:52.606641+0000 mon.a (mon.0) 761 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:15:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:15:53 gibba015 bash[29377]: audit 2021-03-10T14:15:52.610080+0000 mon.c (mon.1) 476 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:15:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:15:53 gibba015 bash[29377]: audit 2021-03-10T14:15:52.611049+0000 mon.c (mon.1) 477 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:15:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:15:53 gibba015 bash[29377]: audit 2021-03-10T14:15:52.611227+0000 mon.a (mon.0) 762 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:15:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:15:53 gibba015 bash[29377]: audit 2021-03-10T14:15:52.612404+0000 mon.a (mon.0) 763 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:15:53.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:15:53 gibba015 bash[30343]: cluster 2021-03-10T14:15:52.075459+0000 mgr.gibba045.orlgmj (mgr.34412) 1474 : cluster [DBG] pgmap v824: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:53.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:15:53 gibba015 bash[30343]: audit 2021-03-10T14:15:52.602196+0000 mon.c (mon.1) 472 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T14:15:53.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:15:53 gibba015 bash[30343]: audit 2021-03-10T14:15:52.602976+0000 mon.c (mon.1) 473 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:15:53.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:15:53 gibba015 bash[30343]: audit 2021-03-10T14:15:52.603399+0000 mon.a (mon.0) 758 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T14:15:53.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:15:53 gibba015 bash[30343]: audit 2021-03-10T14:15:52.603667+0000 mon.c (mon.1) 474 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T14:15:53.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:15:53 gibba015 bash[30343]: audit 2021-03-10T14:15:52.604466+0000 mon.c (mon.1) 475 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:15:53.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:15:53 gibba015 bash[30343]: audit 2021-03-10T14:15:52.604623+0000 mon.a (mon.0) 759 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:15:53.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:15:53 gibba015 bash[30343]: audit 2021-03-10T14:15:52.605795+0000 mon.a (mon.0) 760 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T14:15:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:15:53 gibba015 bash[30343]: audit 2021-03-10T14:15:52.606641+0000 mon.a (mon.0) 761 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:15:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:15:53 gibba015 bash[30343]: audit 2021-03-10T14:15:52.610080+0000 mon.c (mon.1) 476 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:15:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:15:53 gibba015 bash[30343]: audit 2021-03-10T14:15:52.611049+0000 mon.c (mon.1) 477 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:15:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:15:53 gibba015 bash[30343]: audit 2021-03-10T14:15:52.611227+0000 mon.a (mon.0) 762 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:15:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:15:53 gibba015 bash[30343]: audit 2021-03-10T14:15:52.612404+0000 mon.a (mon.0) 763 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:15:55.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:15:55 gibba015 bash[29377]: cluster 2021-03-10T14:15:54.076735+0000 mgr.gibba045.orlgmj (mgr.34412) 1475 : cluster [DBG] pgmap v825: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:55.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:15:55 gibba015 bash[30343]: cluster 2021-03-10T14:15:54.076735+0000 mgr.gibba045.orlgmj (mgr.34412) 1475 : cluster [DBG] pgmap v825: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:55.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:15:55 gibba045 bash[25517]: cluster 2021-03-10T14:15:54.076735+0000 mgr.gibba045.orlgmj (mgr.34412) 1475 : cluster [DBG] pgmap v825: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:57.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:15:57 gibba015 bash[29377]: cluster 2021-03-10T14:15:56.078222+0000 mgr.gibba045.orlgmj (mgr.34412) 1476 : cluster [DBG] pgmap v826: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:57.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:15:57 gibba015 bash[30343]: cluster 2021-03-10T14:15:56.078222+0000 mgr.gibba045.orlgmj (mgr.34412) 1476 : cluster [DBG] pgmap v826: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:57.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:15:57 gibba045 bash[25517]: cluster 2021-03-10T14:15:56.078222+0000 mgr.gibba045.orlgmj (mgr.34412) 1476 : cluster [DBG] pgmap v826: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:59.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:15:59 gibba015 bash[29377]: cluster 2021-03-10T14:15:58.079761+0000 mgr.gibba045.orlgmj (mgr.34412) 1477 : cluster [DBG] pgmap v827: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:59.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:15:59 gibba015 bash[30343]: cluster 2021-03-10T14:15:58.079761+0000 mgr.gibba045.orlgmj (mgr.34412) 1477 : cluster [DBG] pgmap v827: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:59.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:15:59 gibba045 bash[25517]: cluster 2021-03-10T14:15:58.079761+0000 mgr.gibba045.orlgmj (mgr.34412) 1477 : cluster [DBG] pgmap v827: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:01.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:16:01 gibba015 bash[29377]: cluster 2021-03-10T14:16:00.080568+0000 mgr.gibba045.orlgmj (mgr.34412) 1478 : cluster [DBG] pgmap v828: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:01.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:16:01 gibba015 bash[30343]: cluster 2021-03-10T14:16:00.080568+0000 mgr.gibba045.orlgmj (mgr.34412) 1478 : cluster [DBG] pgmap v828: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:01.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:16:01 gibba045 bash[25517]: cluster 2021-03-10T14:16:00.080568+0000 mgr.gibba045.orlgmj (mgr.34412) 1478 : cluster [DBG] pgmap v828: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:03.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:16:03 gibba045 bash[25517]: cluster 2021-03-10T14:16:02.082270+0000 mgr.gibba045.orlgmj (mgr.34412) 1479 : cluster [DBG] pgmap v829: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:03.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:16:03 gibba015 bash[29377]: cluster 2021-03-10T14:16:02.082270+0000 mgr.gibba045.orlgmj (mgr.34412) 1479 : cluster [DBG] pgmap v829: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:03.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:16:03 gibba015 bash[30343]: cluster 2021-03-10T14:16:02.082270+0000 mgr.gibba045.orlgmj (mgr.34412) 1479 : cluster [DBG] pgmap v829: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:04.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:16:04 gibba015 bash[29377]: cephadm 2021-03-10T14:16:03.229144+0000 mgr.gibba045.orlgmj (mgr.34412) 1480 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:16:04.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:16:04 gibba015 bash[30343]: cephadm 2021-03-10T14:16:03.229144+0000 mgr.gibba045.orlgmj (mgr.34412) 1480 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:16:04.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:16:04 gibba045 bash[25517]: cephadm 2021-03-10T14:16:03.229144+0000 mgr.gibba045.orlgmj (mgr.34412) 1480 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:16:05.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:16:05 gibba015 bash[29377]: cluster 2021-03-10T14:16:04.083507+0000 mgr.gibba045.orlgmj (mgr.34412) 1481 : cluster [DBG] pgmap v830: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:05.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:16:05 gibba015 bash[30343]: cluster 2021-03-10T14:16:04.083507+0000 mgr.gibba045.orlgmj (mgr.34412) 1481 : cluster [DBG] pgmap v830: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:05.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:16:05 gibba045 bash[25517]: cluster 2021-03-10T14:16:04.083507+0000 mgr.gibba045.orlgmj (mgr.34412) 1481 : cluster [DBG] pgmap v830: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:06.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:16:06 gibba015 bash[29377]: cluster 2021-03-10T14:16:06.085335+0000 mgr.gibba045.orlgmj (mgr.34412) 1482 : cluster [DBG] pgmap v831: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:06.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:16:06 gibba015 bash[30343]: cluster 2021-03-10T14:16:06.085335+0000 mgr.gibba045.orlgmj (mgr.34412) 1482 : cluster [DBG] pgmap v831: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:06.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:16:06 gibba045 bash[25517]: cluster 2021-03-10T14:16:06.085335+0000 mgr.gibba045.orlgmj (mgr.34412) 1482 : cluster [DBG] pgmap v831: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:09.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:16:09 gibba015 bash[29377]: cluster 2021-03-10T14:16:08.086924+0000 mgr.gibba045.orlgmj (mgr.34412) 1483 : cluster [DBG] pgmap v832: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:09.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:16:09 gibba015 bash[30343]: cluster 2021-03-10T14:16:08.086924+0000 mgr.gibba045.orlgmj (mgr.34412) 1483 : cluster [DBG] pgmap v832: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:09.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:16:09 gibba045 bash[25517]: cluster 2021-03-10T14:16:08.086924+0000 mgr.gibba045.orlgmj (mgr.34412) 1483 : cluster [DBG] pgmap v832: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:11.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:16:11 gibba015 bash[29377]: cluster 2021-03-10T14:16:10.087686+0000 mgr.gibba045.orlgmj (mgr.34412) 1484 : cluster [DBG] pgmap v833: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:11.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:16:11 gibba015 bash[30343]: cluster 2021-03-10T14:16:10.087686+0000 mgr.gibba045.orlgmj (mgr.34412) 1484 : cluster [DBG] pgmap v833: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:11.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:16:11 gibba045 bash[25517]: cluster 2021-03-10T14:16:10.087686+0000 mgr.gibba045.orlgmj (mgr.34412) 1484 : cluster [DBG] pgmap v833: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:13.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:16:13 gibba015 bash[29377]: cluster 2021-03-10T14:16:12.089311+0000 mgr.gibba045.orlgmj (mgr.34412) 1485 : cluster [DBG] pgmap v834: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:13.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:16:13 gibba015 bash[30343]: cluster 2021-03-10T14:16:12.089311+0000 mgr.gibba045.orlgmj (mgr.34412) 1485 : cluster [DBG] pgmap v834: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:13.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:16:13 gibba045 bash[25517]: cluster 2021-03-10T14:16:12.089311+0000 mgr.gibba045.orlgmj (mgr.34412) 1485 : cluster [DBG] pgmap v834: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:15.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:16:15 gibba015 bash[29377]: cluster 2021-03-10T14:16:14.090651+0000 mgr.gibba045.orlgmj (mgr.34412) 1486 : cluster [DBG] pgmap v835: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:15.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:16:15 gibba015 bash[30343]: cluster 2021-03-10T14:16:14.090651+0000 mgr.gibba045.orlgmj (mgr.34412) 1486 : cluster [DBG] pgmap v835: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:15.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:16:15 gibba045 bash[25517]: cluster 2021-03-10T14:16:14.090651+0000 mgr.gibba045.orlgmj (mgr.34412) 1486 : cluster [DBG] pgmap v835: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:16.274 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:16:16.502 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:16:16.502 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (26m) 2m ago 32m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:16:16.503 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (32m) 108s ago 32m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:16:16.503 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (27m) 108s ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:16:16.503 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (27m) 108s ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:16:16.503 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (26m) 2m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:16:16.504 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (26m) 2m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:16:16.504 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (26m) 108s ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:16:16.504 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (26m) 2m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:16:16.504 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (32m) 2m ago 32m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:16:16.505 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (32m) 108s ago 32m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:16:16.505 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (25m) 2m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:16:16.505 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (24m) 2m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:16:16.505 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (24m) 2m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:16:16.505 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (24m) 2m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:16:16.506 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (23m) 108s ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:16:16.506 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (23m) 108s ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:16:16.506 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (22m) 108s ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:16:16.506 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (22m) 108s ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:16:16.507 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (31m) 108s ago 32m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:16:16.507 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 108s ago 30m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:16:16.750 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:16:16.750 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:16:16.750 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:16:16.751 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:16:16.751 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:16:16.751 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:16:16.751 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:16:16.752 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:16:16.752 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:16:16.752 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:16:16.752 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:16:16.752 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:16:16.753 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:16:16.753 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:16:16.753 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:16:17.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:16:17 gibba015 bash[29377]: cluster 2021-03-10T14:16:16.092388+0000 mgr.gibba045.orlgmj (mgr.34412) 1487 : cluster [DBG] pgmap v836: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:17.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:16:17 gibba015 bash[29377]: audit 2021-03-10T14:16:16.265395+0000 mgr.gibba045.orlgmj (mgr.34412) 1488 : audit [DBG] from='client.45060 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:16:17.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:16:17 gibba015 bash[29377]: audit 2021-03-10T14:16:16.748335+0000 mon.a (mon.0) 764 : audit [DBG] from='client.? 172.21.2.115:0/3072277824' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:16:17.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:16:17 gibba015 bash[30343]: cluster 2021-03-10T14:16:16.092388+0000 mgr.gibba045.orlgmj (mgr.34412) 1487 : cluster [DBG] pgmap v836: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:17.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:16:17 gibba015 bash[30343]: audit 2021-03-10T14:16:16.265395+0000 mgr.gibba045.orlgmj (mgr.34412) 1488 : audit [DBG] from='client.45060 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:16:17.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:16:17 gibba015 bash[30343]: audit 2021-03-10T14:16:16.748335+0000 mon.a (mon.0) 764 : audit [DBG] from='client.? 172.21.2.115:0/3072277824' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:16:17.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:16:17 gibba045 bash[25517]: cluster 2021-03-10T14:16:16.092388+0000 mgr.gibba045.orlgmj (mgr.34412) 1487 : cluster [DBG] pgmap v836: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:17.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:16:17 gibba045 bash[25517]: audit 2021-03-10T14:16:16.265395+0000 mgr.gibba045.orlgmj (mgr.34412) 1488 : audit [DBG] from='client.45060 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:16:17.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:16:17 gibba045 bash[25517]: audit 2021-03-10T14:16:16.748335+0000 mon.a (mon.0) 764 : audit [DBG] from='client.? 172.21.2.115:0/3072277824' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:16:18.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:16:18 gibba015 bash[29377]: audit 2021-03-10T14:16:16.489732+0000 mgr.gibba045.orlgmj (mgr.34412) 1489 : audit [DBG] from='client.45066 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:16:18.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:16:18 gibba015 bash[30343]: audit 2021-03-10T14:16:16.489732+0000 mgr.gibba045.orlgmj (mgr.34412) 1489 : audit [DBG] from='client.45066 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:16:18.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:16:18 gibba045 bash[25517]: audit 2021-03-10T14:16:16.489732+0000 mgr.gibba045.orlgmj (mgr.34412) 1489 : audit [DBG] from='client.45066 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:16:19.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:16:19 gibba015 bash[29377]: cluster 2021-03-10T14:16:18.093942+0000 mgr.gibba045.orlgmj (mgr.34412) 1490 : cluster [DBG] pgmap v837: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:19.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:16:19 gibba015 bash[29377]: cephadm 2021-03-10T14:16:18.245179+0000 mgr.gibba045.orlgmj (mgr.34412) 1491 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:16:19.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:16:19 gibba015 bash[30343]: cluster 2021-03-10T14:16:18.093942+0000 mgr.gibba045.orlgmj (mgr.34412) 1490 : cluster [DBG] pgmap v837: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:19.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:16:19 gibba015 bash[30343]: cephadm 2021-03-10T14:16:18.245179+0000 mgr.gibba045.orlgmj (mgr.34412) 1491 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:16:19.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:16:19 gibba045 bash[25517]: cluster 2021-03-10T14:16:18.093942+0000 mgr.gibba045.orlgmj (mgr.34412) 1490 : cluster [DBG] pgmap v837: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:19.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:16:19 gibba045 bash[25517]: cephadm 2021-03-10T14:16:18.245179+0000 mgr.gibba045.orlgmj (mgr.34412) 1491 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:16:21.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:16:21 gibba015 bash[29377]: cluster 2021-03-10T14:16:20.095655+0000 mgr.gibba045.orlgmj (mgr.34412) 1492 : cluster [DBG] pgmap v838: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:21.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:16:21 gibba015 bash[30343]: cluster 2021-03-10T14:16:20.095655+0000 mgr.gibba045.orlgmj (mgr.34412) 1492 : cluster [DBG] pgmap v838: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:21.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:16:21 gibba045 bash[25517]: cluster 2021-03-10T14:16:20.095655+0000 mgr.gibba045.orlgmj (mgr.34412) 1492 : cluster [DBG] pgmap v838: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:23.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:16:23 gibba015 bash[29377]: cluster 2021-03-10T14:16:22.097463+0000 mgr.gibba045.orlgmj (mgr.34412) 1493 : cluster [DBG] pgmap v839: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:23.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:16:23 gibba015 bash[30343]: cluster 2021-03-10T14:16:22.097463+0000 mgr.gibba045.orlgmj (mgr.34412) 1493 : cluster [DBG] pgmap v839: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:23.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:16:23 gibba045 bash[25517]: cluster 2021-03-10T14:16:22.097463+0000 mgr.gibba045.orlgmj (mgr.34412) 1493 : cluster [DBG] pgmap v839: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:25.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:16:25 gibba015 bash[29377]: cluster 2021-03-10T14:16:24.098652+0000 mgr.gibba045.orlgmj (mgr.34412) 1494 : cluster [DBG] pgmap v840: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:25.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:16:25 gibba015 bash[30343]: cluster 2021-03-10T14:16:24.098652+0000 mgr.gibba045.orlgmj (mgr.34412) 1494 : cluster [DBG] pgmap v840: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:25.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:16:25 gibba045 bash[25517]: cluster 2021-03-10T14:16:24.098652+0000 mgr.gibba045.orlgmj (mgr.34412) 1494 : cluster [DBG] pgmap v840: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:27.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:16:27 gibba015 bash[29377]: cluster 2021-03-10T14:16:26.100269+0000 mgr.gibba045.orlgmj (mgr.34412) 1495 : cluster [DBG] pgmap v841: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:27.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:16:27 gibba015 bash[30343]: cluster 2021-03-10T14:16:26.100269+0000 mgr.gibba045.orlgmj (mgr.34412) 1495 : cluster [DBG] pgmap v841: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:27.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:16:27 gibba045 bash[25517]: cluster 2021-03-10T14:16:26.100269+0000 mgr.gibba045.orlgmj (mgr.34412) 1495 : cluster [DBG] pgmap v841: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:29.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:16:29 gibba015 bash[29377]: cluster 2021-03-10T14:16:28.101696+0000 mgr.gibba045.orlgmj (mgr.34412) 1496 : cluster [DBG] pgmap v842: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:29.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:16:29 gibba015 bash[30343]: cluster 2021-03-10T14:16:28.101696+0000 mgr.gibba045.orlgmj (mgr.34412) 1496 : cluster [DBG] pgmap v842: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:29.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:16:29 gibba045 bash[25517]: cluster 2021-03-10T14:16:28.101696+0000 mgr.gibba045.orlgmj (mgr.34412) 1496 : cluster [DBG] pgmap v842: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:31.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:16:31 gibba015 bash[29377]: cluster 2021-03-10T14:16:30.103218+0000 mgr.gibba045.orlgmj (mgr.34412) 1497 : cluster [DBG] pgmap v843: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:31.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:16:31 gibba015 bash[30343]: cluster 2021-03-10T14:16:30.103218+0000 mgr.gibba045.orlgmj (mgr.34412) 1497 : cluster [DBG] pgmap v843: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:31.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:16:31 gibba045 bash[25517]: cluster 2021-03-10T14:16:30.103218+0000 mgr.gibba045.orlgmj (mgr.34412) 1497 : cluster [DBG] pgmap v843: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:33.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:16:33 gibba015 bash[29377]: cluster 2021-03-10T14:16:32.104820+0000 mgr.gibba045.orlgmj (mgr.34412) 1498 : cluster [DBG] pgmap v844: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:33.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:16:33 gibba015 bash[30343]: cluster 2021-03-10T14:16:32.104820+0000 mgr.gibba045.orlgmj (mgr.34412) 1498 : cluster [DBG] pgmap v844: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:33.498 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:16:33 gibba045 bash[25517]: cluster 2021-03-10T14:16:32.104820+0000 mgr.gibba045.orlgmj (mgr.34412) 1498 : cluster [DBG] pgmap v844: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:34.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:16:34 gibba015 bash[29377]: audit 2021-03-10T14:16:33.259738+0000 mon.c (mon.1) 478 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:16:34.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:16:34 gibba015 bash[29377]: cephadm 2021-03-10T14:16:33.266627+0000 mgr.gibba045.orlgmj (mgr.34412) 1499 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:16:34.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:16:34 gibba015 bash[29377]: cephadm 2021-03-10T14:16:33.268207+0000 mgr.gibba045.orlgmj (mgr.34412) 1500 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:16:34.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:16:34 gibba015 bash[29377]: audit 2021-03-10T14:16:33.484038+0000 mon.a (mon.0) 765 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:16:34.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:16:34 gibba015 bash[29377]: audit 2021-03-10T14:16:33.487514+0000 mon.c (mon.1) 479 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:16:34.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:16:34 gibba015 bash[29377]: audit 2021-03-10T14:16:33.488892+0000 mon.c (mon.1) 480 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:16:34.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:16:34 gibba015 bash[29377]: audit 2021-03-10T14:16:33.489981+0000 mon.c (mon.1) 481 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:16:34.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:16:34 gibba015 bash[29377]: audit 2021-03-10T14:16:33.491187+0000 mon.c (mon.1) 482 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:16:34.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:16:34 gibba015 bash[29377]: audit 2021-03-10T14:16:33.493981+0000 mon.c (mon.1) 483 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:16:34.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:16:34 gibba015 bash[29377]: audit 2021-03-10T14:16:33.495491+0000 mon.c (mon.1) 484 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:16:34.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:16:34 gibba015 bash[30343]: audit 2021-03-10T14:16:33.259738+0000 mon.c (mon.1) 478 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:16:34.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:16:34 gibba015 bash[30343]: cephadm 2021-03-10T14:16:33.266627+0000 mgr.gibba045.orlgmj (mgr.34412) 1499 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:16:34.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:16:34 gibba015 bash[30343]: cephadm 2021-03-10T14:16:33.268207+0000 mgr.gibba045.orlgmj (mgr.34412) 1500 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:16:34.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:16:34 gibba015 bash[30343]: audit 2021-03-10T14:16:33.484038+0000 mon.a (mon.0) 765 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:16:34.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:16:34 gibba015 bash[30343]: audit 2021-03-10T14:16:33.487514+0000 mon.c (mon.1) 479 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:16:34.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:16:34 gibba015 bash[30343]: audit 2021-03-10T14:16:33.488892+0000 mon.c (mon.1) 480 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:16:34.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:16:34 gibba015 bash[30343]: audit 2021-03-10T14:16:33.489981+0000 mon.c (mon.1) 481 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:16:34.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:16:34 gibba015 bash[30343]: audit 2021-03-10T14:16:33.491187+0000 mon.c (mon.1) 482 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:16:34.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:16:34 gibba015 bash[30343]: audit 2021-03-10T14:16:33.493981+0000 mon.c (mon.1) 483 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:16:34.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:16:34 gibba015 bash[30343]: audit 2021-03-10T14:16:33.495491+0000 mon.c (mon.1) 484 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:16:34.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:16:34 gibba045 bash[25517]: audit 2021-03-10T14:16:33.259738+0000 mon.c (mon.1) 478 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:16:34.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:16:34 gibba045 bash[25517]: cephadm 2021-03-10T14:16:33.266627+0000 mgr.gibba045.orlgmj (mgr.34412) 1499 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:16:34.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:16:34 gibba045 bash[25517]: cephadm 2021-03-10T14:16:33.268207+0000 mgr.gibba045.orlgmj (mgr.34412) 1500 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:16:34.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:16:34 gibba045 bash[25517]: audit 2021-03-10T14:16:33.484038+0000 mon.a (mon.0) 765 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:16:34.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:16:34 gibba045 bash[25517]: audit 2021-03-10T14:16:33.487514+0000 mon.c (mon.1) 479 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:16:34.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:16:34 gibba045 bash[25517]: audit 2021-03-10T14:16:33.488892+0000 mon.c (mon.1) 480 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:16:34.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:16:34 gibba045 bash[25517]: audit 2021-03-10T14:16:33.489981+0000 mon.c (mon.1) 481 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:16:34.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:16:34 gibba045 bash[25517]: audit 2021-03-10T14:16:33.491187+0000 mon.c (mon.1) 482 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:16:34.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:16:34 gibba045 bash[25517]: audit 2021-03-10T14:16:33.493981+0000 mon.c (mon.1) 483 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:16:34.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:16:34 gibba045 bash[25517]: audit 2021-03-10T14:16:33.495491+0000 mon.c (mon.1) 484 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:16:35.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:16:35 gibba015 bash[29377]: cephadm 2021-03-10T14:16:33.488893+0000 mgr.gibba045.orlgmj (mgr.34412) 1501 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:16:35.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:16:35 gibba015 bash[29377]: cephadm 2021-03-10T14:16:33.490440+0000 mgr.gibba045.orlgmj (mgr.34412) 1502 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:16:35.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:16:35 gibba015 bash[29377]: cephadm 2021-03-10T14:16:33.491699+0000 mgr.gibba045.orlgmj (mgr.34412) 1503 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:16:35.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:16:35 gibba015 bash[29377]: cephadm 2021-03-10T14:16:33.491739+0000 mgr.gibba045.orlgmj (mgr.34412) 1504 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:16:35.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:16:35 gibba015 bash[29377]: cephadm 2021-03-10T14:16:33.492814+0000 mgr.gibba045.orlgmj (mgr.34412) 1505 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:16:35.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:16:35 gibba015 bash[29377]: cephadm 2021-03-10T14:16:33.492852+0000 mgr.gibba045.orlgmj (mgr.34412) 1506 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:16:35.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:16:35 gibba015 bash[29377]: cephadm 2021-03-10T14:16:33.493989+0000 mgr.gibba045.orlgmj (mgr.34412) 1507 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:16:35.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:16:35 gibba015 bash[29377]: cephadm 2021-03-10T14:16:33.495481+0000 mgr.gibba045.orlgmj (mgr.34412) 1508 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:16:35.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:16:35 gibba015 bash[29377]: cephadm 2021-03-10T14:16:33.495521+0000 mgr.gibba045.orlgmj (mgr.34412) 1509 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:16:35.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:16:35 gibba015 bash[29377]: cephadm 2021-03-10T14:16:33.496782+0000 mgr.gibba045.orlgmj (mgr.34412) 1510 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:16:35.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:16:35 gibba015 bash[29377]: cephadm 2021-03-10T14:16:33.497133+0000 mgr.gibba045.orlgmj (mgr.34412) 1511 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:16:35.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:16:35 gibba015 bash[29377]: cephadm 2021-03-10T14:16:33.498635+0000 mgr.gibba045.orlgmj (mgr.34412) 1512 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:16:35.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:16:35 gibba015 bash[29377]: cephadm 2021-03-10T14:16:33.498680+0000 mgr.gibba045.orlgmj (mgr.34412) 1513 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:16:35.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:16:35 gibba015 bash[29377]: cephadm 2021-03-10T14:16:33.498799+0000 mgr.gibba045.orlgmj (mgr.34412) 1514 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:16:35.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:16:35 gibba015 bash[29377]: cluster 2021-03-10T14:16:34.106059+0000 mgr.gibba045.orlgmj (mgr.34412) 1515 : cluster [DBG] pgmap v845: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:35.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:16:35 gibba015 bash[30343]: cephadm 2021-03-10T14:16:33.488893+0000 mgr.gibba045.orlgmj (mgr.34412) 1501 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:16:35.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:16:35 gibba015 bash[30343]: cephadm 2021-03-10T14:16:33.490440+0000 mgr.gibba045.orlgmj (mgr.34412) 1502 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:16:35.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:16:35 gibba015 bash[30343]: cephadm 2021-03-10T14:16:33.491699+0000 mgr.gibba045.orlgmj (mgr.34412) 1503 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:16:35.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:16:35 gibba015 bash[30343]: cephadm 2021-03-10T14:16:33.491739+0000 mgr.gibba045.orlgmj (mgr.34412) 1504 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:16:35.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:16:35 gibba015 bash[30343]: cephadm 2021-03-10T14:16:33.492814+0000 mgr.gibba045.orlgmj (mgr.34412) 1505 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:16:35.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:16:35 gibba015 bash[30343]: cephadm 2021-03-10T14:16:33.492852+0000 mgr.gibba045.orlgmj (mgr.34412) 1506 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:16:35.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:16:35 gibba015 bash[30343]: cephadm 2021-03-10T14:16:33.493989+0000 mgr.gibba045.orlgmj (mgr.34412) 1507 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:16:35.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:16:35 gibba015 bash[30343]: cephadm 2021-03-10T14:16:33.495481+0000 mgr.gibba045.orlgmj (mgr.34412) 1508 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:16:35.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:16:35 gibba015 bash[30343]: cephadm 2021-03-10T14:16:33.495521+0000 mgr.gibba045.orlgmj (mgr.34412) 1509 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:16:35.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:16:35 gibba015 bash[30343]: cephadm 2021-03-10T14:16:33.496782+0000 mgr.gibba045.orlgmj (mgr.34412) 1510 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:16:35.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:16:35 gibba015 bash[30343]: cephadm 2021-03-10T14:16:33.497133+0000 mgr.gibba045.orlgmj (mgr.34412) 1511 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:16:35.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:16:35 gibba015 bash[30343]: cephadm 2021-03-10T14:16:33.498635+0000 mgr.gibba045.orlgmj (mgr.34412) 1512 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:16:35.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:16:35 gibba015 bash[30343]: cephadm 2021-03-10T14:16:33.498680+0000 mgr.gibba045.orlgmj (mgr.34412) 1513 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:16:35.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:16:35 gibba015 bash[30343]: cephadm 2021-03-10T14:16:33.498799+0000 mgr.gibba045.orlgmj (mgr.34412) 1514 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:16:35.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:16:35 gibba015 bash[30343]: cluster 2021-03-10T14:16:34.106059+0000 mgr.gibba045.orlgmj (mgr.34412) 1515 : cluster [DBG] pgmap v845: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:35.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:16:35 gibba045 bash[25517]: cephadm 2021-03-10T14:16:33.488893+0000 mgr.gibba045.orlgmj (mgr.34412) 1501 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:16:35.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:16:35 gibba045 bash[25517]: cephadm 2021-03-10T14:16:33.490440+0000 mgr.gibba045.orlgmj (mgr.34412) 1502 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:16:35.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:16:35 gibba045 bash[25517]: cephadm 2021-03-10T14:16:33.491699+0000 mgr.gibba045.orlgmj (mgr.34412) 1503 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:16:35.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:16:35 gibba045 bash[25517]: cephadm 2021-03-10T14:16:33.491739+0000 mgr.gibba045.orlgmj (mgr.34412) 1504 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:16:35.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:16:35 gibba045 bash[25517]: cephadm 2021-03-10T14:16:33.492814+0000 mgr.gibba045.orlgmj (mgr.34412) 1505 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:16:35.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:16:35 gibba045 bash[25517]: cephadm 2021-03-10T14:16:33.492852+0000 mgr.gibba045.orlgmj (mgr.34412) 1506 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:16:35.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:16:35 gibba045 bash[25517]: cephadm 2021-03-10T14:16:33.493989+0000 mgr.gibba045.orlgmj (mgr.34412) 1507 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:16:35.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:16:35 gibba045 bash[25517]: cephadm 2021-03-10T14:16:33.495481+0000 mgr.gibba045.orlgmj (mgr.34412) 1508 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:16:35.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:16:35 gibba045 bash[25517]: cephadm 2021-03-10T14:16:33.495521+0000 mgr.gibba045.orlgmj (mgr.34412) 1509 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:16:35.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:16:35 gibba045 bash[25517]: cephadm 2021-03-10T14:16:33.496782+0000 mgr.gibba045.orlgmj (mgr.34412) 1510 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:16:35.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:16:35 gibba045 bash[25517]: cephadm 2021-03-10T14:16:33.497133+0000 mgr.gibba045.orlgmj (mgr.34412) 1511 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:16:35.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:16:35 gibba045 bash[25517]: cephadm 2021-03-10T14:16:33.498635+0000 mgr.gibba045.orlgmj (mgr.34412) 1512 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:16:35.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:16:35 gibba045 bash[25517]: cephadm 2021-03-10T14:16:33.498680+0000 mgr.gibba045.orlgmj (mgr.34412) 1513 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:16:35.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:16:35 gibba045 bash[25517]: cephadm 2021-03-10T14:16:33.498799+0000 mgr.gibba045.orlgmj (mgr.34412) 1514 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:16:35.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:16:35 gibba045 bash[25517]: cluster 2021-03-10T14:16:34.106059+0000 mgr.gibba045.orlgmj (mgr.34412) 1515 : cluster [DBG] pgmap v845: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:37.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:16:37 gibba045 bash[25517]: cluster 2021-03-10T14:16:36.107767+0000 mgr.gibba045.orlgmj (mgr.34412) 1516 : cluster [DBG] pgmap v846: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:37.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:16:37 gibba015 bash[29377]: cluster 2021-03-10T14:16:36.107767+0000 mgr.gibba045.orlgmj (mgr.34412) 1516 : cluster [DBG] pgmap v846: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:37.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:16:37 gibba015 bash[30343]: cluster 2021-03-10T14:16:36.107767+0000 mgr.gibba045.orlgmj (mgr.34412) 1516 : cluster [DBG] pgmap v846: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:39.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:16:39 gibba045 bash[25517]: cluster 2021-03-10T14:16:38.109171+0000 mgr.gibba045.orlgmj (mgr.34412) 1517 : cluster [DBG] pgmap v847: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:39.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:16:39 gibba015 bash[29377]: cluster 2021-03-10T14:16:38.109171+0000 mgr.gibba045.orlgmj (mgr.34412) 1517 : cluster [DBG] pgmap v847: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:39.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:16:39 gibba015 bash[30343]: cluster 2021-03-10T14:16:38.109171+0000 mgr.gibba045.orlgmj (mgr.34412) 1517 : cluster [DBG] pgmap v847: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:41.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:16:41 gibba045 bash[25517]: cluster 2021-03-10T14:16:40.110568+0000 mgr.gibba045.orlgmj (mgr.34412) 1518 : cluster [DBG] pgmap v848: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:41.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:16:41 gibba015 bash[29377]: cluster 2021-03-10T14:16:40.110568+0000 mgr.gibba045.orlgmj (mgr.34412) 1518 : cluster [DBG] pgmap v848: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:41.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:16:41 gibba015 bash[30343]: cluster 2021-03-10T14:16:40.110568+0000 mgr.gibba045.orlgmj (mgr.34412) 1518 : cluster [DBG] pgmap v848: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:43.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:16:43 gibba045 bash[25517]: cluster 2021-03-10T14:16:42.112252+0000 mgr.gibba045.orlgmj (mgr.34412) 1519 : cluster [DBG] pgmap v849: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:43.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:16:43 gibba015 bash[29377]: cluster 2021-03-10T14:16:42.112252+0000 mgr.gibba045.orlgmj (mgr.34412) 1519 : cluster [DBG] pgmap v849: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:43.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:16:43 gibba015 bash[30343]: cluster 2021-03-10T14:16:42.112252+0000 mgr.gibba045.orlgmj (mgr.34412) 1519 : cluster [DBG] pgmap v849: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:45.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:16:45 gibba045 bash[25517]: cluster 2021-03-10T14:16:44.113457+0000 mgr.gibba045.orlgmj (mgr.34412) 1520 : cluster [DBG] pgmap v850: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:45.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:16:45 gibba015 bash[29377]: cluster 2021-03-10T14:16:44.113457+0000 mgr.gibba045.orlgmj (mgr.34412) 1520 : cluster [DBG] pgmap v850: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:45.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:16:45 gibba015 bash[30343]: cluster 2021-03-10T14:16:44.113457+0000 mgr.gibba045.orlgmj (mgr.34412) 1520 : cluster [DBG] pgmap v850: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:46.993 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:16:47.219 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:16:47.219 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (27m) 3m ago 32m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:16:47.219 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (32m) 2m ago 32m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:16:47.220 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (27m) 2m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:16:47.220 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (28m) 2m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:16:47.220 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (27m) 3m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:16:47.220 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (27m) 3m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:16:47.221 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (26m) 2m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:16:47.221 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (26m) 3m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:16:47.221 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (32m) 3m ago 33m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:16:47.222 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (33m) 2m ago 33m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:16:47.222 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (25m) 3m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:16:47.222 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (25m) 3m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:16:47.222 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (24m) 3m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:16:47.223 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (24m) 3m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:16:47.223 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (24m) 2m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:16:47.223 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (23m) 2m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:16:47.223 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (23m) 2m ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:16:47.223 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (22m) 2m ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:16:47.224 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (32m) 2m ago 33m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:16:47.224 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 2m ago 31m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:16:47.473 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:16:47.473 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:16:47.474 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:16:47.474 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:16:47.474 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:16:47.475 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:16:47.475 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:16:47.475 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:16:47.476 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:16:47.476 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:16:47.476 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:16:47.477 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:16:47.477 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:16:47.477 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:16:47.477 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:16:47.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:16:47 gibba045 bash[25517]: cluster 2021-03-10T14:16:46.115123+0000 mgr.gibba045.orlgmj (mgr.34412) 1521 : cluster [DBG] pgmap v851: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:47.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:16:47 gibba015 bash[29377]: cluster 2021-03-10T14:16:46.115123+0000 mgr.gibba045.orlgmj (mgr.34412) 1521 : cluster [DBG] pgmap v851: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:47.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:16:47 gibba015 bash[30343]: cluster 2021-03-10T14:16:46.115123+0000 mgr.gibba045.orlgmj (mgr.34412) 1521 : cluster [DBG] pgmap v851: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:48.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:16:48 gibba045 bash[25517]: audit 2021-03-10T14:16:46.984334+0000 mgr.gibba045.orlgmj (mgr.34412) 1522 : audit [DBG] from='client.45078 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:16:48.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:16:48 gibba045 bash[25517]: audit 2021-03-10T14:16:47.207738+0000 mgr.gibba045.orlgmj (mgr.34412) 1523 : audit [DBG] from='client.45084 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:16:48.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:16:48 gibba045 bash[25517]: audit 2021-03-10T14:16:47.471499+0000 mon.a (mon.0) 766 : audit [DBG] from='client.? 172.21.2.115:0/2417150197' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:16:48.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:16:48 gibba015 bash[29377]: audit 2021-03-10T14:16:46.984334+0000 mgr.gibba045.orlgmj (mgr.34412) 1522 : audit [DBG] from='client.45078 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:16:48.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:16:48 gibba015 bash[29377]: audit 2021-03-10T14:16:47.207738+0000 mgr.gibba045.orlgmj (mgr.34412) 1523 : audit [DBG] from='client.45084 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:16:48.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:16:48 gibba015 bash[29377]: audit 2021-03-10T14:16:47.471499+0000 mon.a (mon.0) 766 : audit [DBG] from='client.? 172.21.2.115:0/2417150197' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:16:48.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:16:48 gibba015 bash[30343]: audit 2021-03-10T14:16:46.984334+0000 mgr.gibba045.orlgmj (mgr.34412) 1522 : audit [DBG] from='client.45078 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:16:48.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:16:48 gibba015 bash[30343]: audit 2021-03-10T14:16:47.207738+0000 mgr.gibba045.orlgmj (mgr.34412) 1523 : audit [DBG] from='client.45084 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:16:48.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:16:48 gibba015 bash[30343]: audit 2021-03-10T14:16:47.471499+0000 mon.a (mon.0) 766 : audit [DBG] from='client.? 172.21.2.115:0/2417150197' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:16:49.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:16:49 gibba045 bash[25517]: cluster 2021-03-10T14:16:48.116642+0000 mgr.gibba045.orlgmj (mgr.34412) 1524 : cluster [DBG] pgmap v852: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:49.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:16:49 gibba015 bash[29377]: cluster 2021-03-10T14:16:48.116642+0000 mgr.gibba045.orlgmj (mgr.34412) 1524 : cluster [DBG] pgmap v852: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:49.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:16:49 gibba015 bash[30343]: cluster 2021-03-10T14:16:48.116642+0000 mgr.gibba045.orlgmj (mgr.34412) 1524 : cluster [DBG] pgmap v852: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:50.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:16:50 gibba045 bash[25517]: cephadm 2021-03-10T14:16:48.514824+0000 mgr.gibba045.orlgmj (mgr.34412) 1525 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:16:50.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:16:50 gibba015 bash[29377]: cephadm 2021-03-10T14:16:48.514824+0000 mgr.gibba045.orlgmj (mgr.34412) 1525 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:16:50.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:16:50 gibba015 bash[30343]: cephadm 2021-03-10T14:16:48.514824+0000 mgr.gibba045.orlgmj (mgr.34412) 1525 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:16:51.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:16:51 gibba015 bash[29377]: cluster 2021-03-10T14:16:50.117370+0000 mgr.gibba045.orlgmj (mgr.34412) 1526 : cluster [DBG] pgmap v853: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:51.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:16:51 gibba015 bash[30343]: cluster 2021-03-10T14:16:50.117370+0000 mgr.gibba045.orlgmj (mgr.34412) 1526 : cluster [DBG] pgmap v853: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:51.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:16:51 gibba045 bash[25517]: cluster 2021-03-10T14:16:50.117370+0000 mgr.gibba045.orlgmj (mgr.34412) 1526 : cluster [DBG] pgmap v853: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:53.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:16:53 gibba015 bash[29377]: cluster 2021-03-10T14:16:52.118936+0000 mgr.gibba045.orlgmj (mgr.34412) 1527 : cluster [DBG] pgmap v854: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:53.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:16:53 gibba015 bash[29377]: audit 2021-03-10T14:16:52.615677+0000 mon.c (mon.1) 485 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:16:53.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:16:53 gibba015 bash[29377]: audit 2021-03-10T14:16:52.616560+0000 mon.c (mon.1) 486 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:16:53.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:16:53 gibba015 bash[29377]: audit 2021-03-10T14:16:52.616759+0000 mon.a (mon.0) 767 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:16:53.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:16:53 gibba015 bash[29377]: audit 2021-03-10T14:16:52.617478+0000 mon.c (mon.1) 487 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T14:16:53.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:16:53 gibba015 bash[29377]: audit 2021-03-10T14:16:52.617843+0000 mon.a (mon.0) 768 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:16:53.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:16:53 gibba015 bash[29377]: audit 2021-03-10T14:16:52.618587+0000 mon.c (mon.1) 488 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:16:53.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:16:53 gibba015 bash[29377]: audit 2021-03-10T14:16:52.619012+0000 mon.a (mon.0) 769 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T14:16:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:16:53 gibba015 bash[29377]: audit 2021-03-10T14:16:52.619622+0000 mon.c (mon.1) 489 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:16:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:16:53 gibba015 bash[29377]: audit 2021-03-10T14:16:52.620141+0000 mon.a (mon.0) 770 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:16:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:16:53 gibba015 bash[29377]: audit 2021-03-10T14:16:52.620787+0000 mon.c (mon.1) 490 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:16:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:16:53 gibba015 bash[29377]: audit 2021-03-10T14:16:52.621008+0000 mon.a (mon.0) 771 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:16:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:16:53 gibba015 bash[29377]: audit 2021-03-10T14:16:52.621324+0000 mon.a (mon.0) 772 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:16:53.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:16:53 gibba015 bash[30343]: cluster 2021-03-10T14:16:52.118936+0000 mgr.gibba045.orlgmj (mgr.34412) 1527 : cluster [DBG] pgmap v854: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:53.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:16:53 gibba015 bash[30343]: audit 2021-03-10T14:16:52.615677+0000 mon.c (mon.1) 485 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:16:53.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:16:53 gibba015 bash[30343]: audit 2021-03-10T14:16:52.616560+0000 mon.c (mon.1) 486 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:16:53.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:16:53 gibba015 bash[30343]: audit 2021-03-10T14:16:52.616759+0000 mon.a (mon.0) 767 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:16:53.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:16:53 gibba015 bash[30343]: audit 2021-03-10T14:16:52.617478+0000 mon.c (mon.1) 487 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T14:16:53.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:16:53 gibba015 bash[30343]: audit 2021-03-10T14:16:52.617843+0000 mon.a (mon.0) 768 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:16:53.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:16:53 gibba015 bash[30343]: audit 2021-03-10T14:16:52.618587+0000 mon.c (mon.1) 488 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:16:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:16:53 gibba015 bash[30343]: audit 2021-03-10T14:16:52.619012+0000 mon.a (mon.0) 769 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T14:16:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:16:53 gibba015 bash[30343]: audit 2021-03-10T14:16:52.619622+0000 mon.c (mon.1) 489 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:16:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:16:53 gibba015 bash[30343]: audit 2021-03-10T14:16:52.620141+0000 mon.a (mon.0) 770 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:16:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:16:53 gibba015 bash[30343]: audit 2021-03-10T14:16:52.620787+0000 mon.c (mon.1) 490 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:16:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:16:53 gibba015 bash[30343]: audit 2021-03-10T14:16:52.621008+0000 mon.a (mon.0) 771 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:16:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:16:53 gibba015 bash[30343]: audit 2021-03-10T14:16:52.621324+0000 mon.a (mon.0) 772 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:16:53.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:16:53 gibba045 bash[25517]: cluster 2021-03-10T14:16:52.118936+0000 mgr.gibba045.orlgmj (mgr.34412) 1527 : cluster [DBG] pgmap v854: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:16:53 gibba045 bash[25517]: audit 2021-03-10T14:16:52.615677+0000 mon.c (mon.1) 485 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:16:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:16:53 gibba045 bash[25517]: audit 2021-03-10T14:16:52.616560+0000 mon.c (mon.1) 486 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:16:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:16:53 gibba045 bash[25517]: audit 2021-03-10T14:16:52.616759+0000 mon.a (mon.0) 767 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:16:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:16:53 gibba045 bash[25517]: audit 2021-03-10T14:16:52.617478+0000 mon.c (mon.1) 487 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T14:16:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:16:53 gibba045 bash[25517]: audit 2021-03-10T14:16:52.617843+0000 mon.a (mon.0) 768 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:16:53.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:16:53 gibba045 bash[25517]: audit 2021-03-10T14:16:52.618587+0000 mon.c (mon.1) 488 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:16:53.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:16:53 gibba045 bash[25517]: audit 2021-03-10T14:16:52.619012+0000 mon.a (mon.0) 769 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T14:16:53.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:16:53 gibba045 bash[25517]: audit 2021-03-10T14:16:52.619622+0000 mon.c (mon.1) 489 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:16:53.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:16:53 gibba045 bash[25517]: audit 2021-03-10T14:16:52.620141+0000 mon.a (mon.0) 770 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:16:53.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:16:53 gibba045 bash[25517]: audit 2021-03-10T14:16:52.620787+0000 mon.c (mon.1) 490 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:16:53.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:16:53 gibba045 bash[25517]: audit 2021-03-10T14:16:52.621008+0000 mon.a (mon.0) 771 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:16:53.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:16:53 gibba045 bash[25517]: audit 2021-03-10T14:16:52.621324+0000 mon.a (mon.0) 772 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:16:55.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:16:55 gibba015 bash[29377]: cluster 2021-03-10T14:16:54.120175+0000 mgr.gibba045.orlgmj (mgr.34412) 1528 : cluster [DBG] pgmap v855: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:55.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:16:55 gibba015 bash[30343]: cluster 2021-03-10T14:16:54.120175+0000 mgr.gibba045.orlgmj (mgr.34412) 1528 : cluster [DBG] pgmap v855: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:55.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:16:55 gibba045 bash[25517]: cluster 2021-03-10T14:16:54.120175+0000 mgr.gibba045.orlgmj (mgr.34412) 1528 : cluster [DBG] pgmap v855: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:57.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:16:57 gibba015 bash[29377]: cluster 2021-03-10T14:16:56.121889+0000 mgr.gibba045.orlgmj (mgr.34412) 1529 : cluster [DBG] pgmap v856: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:57.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:16:57 gibba015 bash[30343]: cluster 2021-03-10T14:16:56.121889+0000 mgr.gibba045.orlgmj (mgr.34412) 1529 : cluster [DBG] pgmap v856: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:57.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:16:57 gibba045 bash[25517]: cluster 2021-03-10T14:16:56.121889+0000 mgr.gibba045.orlgmj (mgr.34412) 1529 : cluster [DBG] pgmap v856: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:59.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:16:59 gibba015 bash[29377]: cluster 2021-03-10T14:16:58.123360+0000 mgr.gibba045.orlgmj (mgr.34412) 1530 : cluster [DBG] pgmap v857: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:59.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:16:59 gibba015 bash[30343]: cluster 2021-03-10T14:16:58.123360+0000 mgr.gibba045.orlgmj (mgr.34412) 1530 : cluster [DBG] pgmap v857: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:59.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:16:59 gibba045 bash[25517]: cluster 2021-03-10T14:16:58.123360+0000 mgr.gibba045.orlgmj (mgr.34412) 1530 : cluster [DBG] pgmap v857: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:01.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:17:01 gibba015 bash[29377]: cluster 2021-03-10T14:17:00.124805+0000 mgr.gibba045.orlgmj (mgr.34412) 1531 : cluster [DBG] pgmap v858: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:01.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:17:01 gibba015 bash[30343]: cluster 2021-03-10T14:17:00.124805+0000 mgr.gibba045.orlgmj (mgr.34412) 1531 : cluster [DBG] pgmap v858: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:01.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:17:01 gibba045 bash[25517]: cluster 2021-03-10T14:17:00.124805+0000 mgr.gibba045.orlgmj (mgr.34412) 1531 : cluster [DBG] pgmap v858: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:03.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:17:03 gibba015 bash[29377]: cluster 2021-03-10T14:17:02.126509+0000 mgr.gibba045.orlgmj (mgr.34412) 1532 : cluster [DBG] pgmap v859: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:03.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:17:03 gibba015 bash[30343]: cluster 2021-03-10T14:17:02.126509+0000 mgr.gibba045.orlgmj (mgr.34412) 1532 : cluster [DBG] pgmap v859: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:03.531 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:17:03 gibba045 bash[25517]: cluster 2021-03-10T14:17:02.126509+0000 mgr.gibba045.orlgmj (mgr.34412) 1532 : cluster [DBG] pgmap v859: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:05.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:17:05 gibba015 bash[29377]: cephadm 2021-03-10T14:17:03.530869+0000 mgr.gibba045.orlgmj (mgr.34412) 1533 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:17:05.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:17:05 gibba015 bash[29377]: cluster 2021-03-10T14:17:04.127829+0000 mgr.gibba045.orlgmj (mgr.34412) 1534 : cluster [DBG] pgmap v860: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:05.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:17:05 gibba015 bash[30343]: cephadm 2021-03-10T14:17:03.530869+0000 mgr.gibba045.orlgmj (mgr.34412) 1533 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:17:05.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:17:05 gibba015 bash[30343]: cluster 2021-03-10T14:17:04.127829+0000 mgr.gibba045.orlgmj (mgr.34412) 1534 : cluster [DBG] pgmap v860: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:05.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:17:05 gibba045 bash[25517]: cephadm 2021-03-10T14:17:03.530869+0000 mgr.gibba045.orlgmj (mgr.34412) 1533 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:17:05.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:17:05 gibba045 bash[25517]: cluster 2021-03-10T14:17:04.127829+0000 mgr.gibba045.orlgmj (mgr.34412) 1534 : cluster [DBG] pgmap v860: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:07.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:17:07 gibba015 bash[29377]: cluster 2021-03-10T14:17:06.129500+0000 mgr.gibba045.orlgmj (mgr.34412) 1535 : cluster [DBG] pgmap v861: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:07.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:17:07 gibba015 bash[30343]: cluster 2021-03-10T14:17:06.129500+0000 mgr.gibba045.orlgmj (mgr.34412) 1535 : cluster [DBG] pgmap v861: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:07.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:17:07 gibba045 bash[25517]: cluster 2021-03-10T14:17:06.129500+0000 mgr.gibba045.orlgmj (mgr.34412) 1535 : cluster [DBG] pgmap v861: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:09.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:17:09 gibba015 bash[29377]: cluster 2021-03-10T14:17:08.130976+0000 mgr.gibba045.orlgmj (mgr.34412) 1536 : cluster [DBG] pgmap v862: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:09.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:17:09 gibba015 bash[30343]: cluster 2021-03-10T14:17:08.130976+0000 mgr.gibba045.orlgmj (mgr.34412) 1536 : cluster [DBG] pgmap v862: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:09.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:17:09 gibba045 bash[25517]: cluster 2021-03-10T14:17:08.130976+0000 mgr.gibba045.orlgmj (mgr.34412) 1536 : cluster [DBG] pgmap v862: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:11.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:17:11 gibba015 bash[29377]: cluster 2021-03-10T14:17:10.132727+0000 mgr.gibba045.orlgmj (mgr.34412) 1537 : cluster [DBG] pgmap v863: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:11.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:17:11 gibba015 bash[30343]: cluster 2021-03-10T14:17:10.132727+0000 mgr.gibba045.orlgmj (mgr.34412) 1537 : cluster [DBG] pgmap v863: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:11.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:17:11 gibba045 bash[25517]: cluster 2021-03-10T14:17:10.132727+0000 mgr.gibba045.orlgmj (mgr.34412) 1537 : cluster [DBG] pgmap v863: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:13.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:17:13 gibba015 bash[29377]: cluster 2021-03-10T14:17:12.133485+0000 mgr.gibba045.orlgmj (mgr.34412) 1538 : cluster [DBG] pgmap v864: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:13.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:17:13 gibba015 bash[30343]: cluster 2021-03-10T14:17:12.133485+0000 mgr.gibba045.orlgmj (mgr.34412) 1538 : cluster [DBG] pgmap v864: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:13.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:17:13 gibba045 bash[25517]: cluster 2021-03-10T14:17:12.133485+0000 mgr.gibba045.orlgmj (mgr.34412) 1538 : cluster [DBG] pgmap v864: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:15.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:17:15 gibba015 bash[29377]: cluster 2021-03-10T14:17:14.134618+0000 mgr.gibba045.orlgmj (mgr.34412) 1539 : cluster [DBG] pgmap v865: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:15.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:17:15 gibba015 bash[30343]: cluster 2021-03-10T14:17:14.134618+0000 mgr.gibba045.orlgmj (mgr.34412) 1539 : cluster [DBG] pgmap v865: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:15.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:17:15 gibba045 bash[25517]: cluster 2021-03-10T14:17:14.134618+0000 mgr.gibba045.orlgmj (mgr.34412) 1539 : cluster [DBG] pgmap v865: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:17.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:17:17 gibba015 bash[29377]: cluster 2021-03-10T14:17:16.136378+0000 mgr.gibba045.orlgmj (mgr.34412) 1540 : cluster [DBG] pgmap v866: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:17.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:17:17 gibba015 bash[30343]: cluster 2021-03-10T14:17:16.136378+0000 mgr.gibba045.orlgmj (mgr.34412) 1540 : cluster [DBG] pgmap v866: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:17.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:17:17 gibba045 bash[25517]: cluster 2021-03-10T14:17:16.136378+0000 mgr.gibba045.orlgmj (mgr.34412) 1540 : cluster [DBG] pgmap v866: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:17.715 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:17:17.943 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:17:17.944 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (28m) 3m ago 33m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:17:17.944 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (33m) 2m ago 33m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:17:17.944 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (28m) 2m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:17:17.944 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (28m) 2m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:17:17.944 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (27m) 3m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:17:17.945 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (27m) 3m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:17:17.945 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (27m) 2m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:17:17.945 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (27m) 3m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:17:17.945 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (33m) 3m ago 33m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:17:17.945 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (33m) 2m ago 33m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:17:17.946 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (26m) 3m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:17:17.946 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (25m) 3m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:17:17.946 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (25m) 3m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:17:17.946 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (25m) 3m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:17:17.947 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (24m) 2m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:17:17.947 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (24m) 2m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:17:17.947 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (23m) 2m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:17:17.947 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (23m) 2m ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:17:17.947 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (32m) 2m ago 33m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:17:17.948 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 2m ago 31m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:17:18.191 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:17:18.191 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:17:18.192 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:17:18.192 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:17:18.192 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:17:18.192 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:17:18.193 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:17:18.193 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:17:18.193 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:17:18.193 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:17:18.193 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:17:18.194 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:17:18.194 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:17:18.194 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:17:18.194 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:17:19.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:17:19 gibba015 bash[29377]: audit 2021-03-10T14:17:17.706424+0000 mgr.gibba045.orlgmj (mgr.34412) 1541 : audit [DBG] from='client.45096 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:17:19.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:17:19 gibba015 bash[29377]: audit 2021-03-10T14:17:17.931257+0000 mgr.gibba045.orlgmj (mgr.34412) 1542 : audit [DBG] from='client.55090 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:17:19.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:17:19 gibba015 bash[29377]: cluster 2021-03-10T14:17:18.136942+0000 mgr.gibba045.orlgmj (mgr.34412) 1543 : cluster [DBG] pgmap v867: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:19.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:17:19 gibba015 bash[29377]: audit 2021-03-10T14:17:18.189549+0000 mon.a (mon.0) 773 : audit [DBG] from='client.? 172.21.2.115:0/1694746850' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:17:19.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:17:19 gibba015 bash[30343]: audit 2021-03-10T14:17:17.706424+0000 mgr.gibba045.orlgmj (mgr.34412) 1541 : audit [DBG] from='client.45096 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:17:19.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:17:19 gibba015 bash[30343]: audit 2021-03-10T14:17:17.931257+0000 mgr.gibba045.orlgmj (mgr.34412) 1542 : audit [DBG] from='client.55090 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:17:19.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:17:19 gibba015 bash[30343]: cluster 2021-03-10T14:17:18.136942+0000 mgr.gibba045.orlgmj (mgr.34412) 1543 : cluster [DBG] pgmap v867: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:19.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:17:19 gibba015 bash[30343]: audit 2021-03-10T14:17:18.189549+0000 mon.a (mon.0) 773 : audit [DBG] from='client.? 172.21.2.115:0/1694746850' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:17:19.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:17:19 gibba045 bash[25517]: audit 2021-03-10T14:17:17.706424+0000 mgr.gibba045.orlgmj (mgr.34412) 1541 : audit [DBG] from='client.45096 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:17:19.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:17:19 gibba045 bash[25517]: audit 2021-03-10T14:17:17.931257+0000 mgr.gibba045.orlgmj (mgr.34412) 1542 : audit [DBG] from='client.55090 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:17:19.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:17:19 gibba045 bash[25517]: cluster 2021-03-10T14:17:18.136942+0000 mgr.gibba045.orlgmj (mgr.34412) 1543 : cluster [DBG] pgmap v867: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:19.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:17:19 gibba045 bash[25517]: audit 2021-03-10T14:17:18.189549+0000 mon.a (mon.0) 773 : audit [DBG] from='client.? 172.21.2.115:0/1694746850' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:17:20.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:17:20 gibba015 bash[29377]: cephadm 2021-03-10T14:17:18.538889+0000 mgr.gibba045.orlgmj (mgr.34412) 1544 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:17:20.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:17:20 gibba015 bash[30343]: cephadm 2021-03-10T14:17:18.538889+0000 mgr.gibba045.orlgmj (mgr.34412) 1544 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:17:20.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:17:20 gibba045 bash[25517]: cephadm 2021-03-10T14:17:18.538889+0000 mgr.gibba045.orlgmj (mgr.34412) 1544 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:17:21.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:17:21 gibba015 bash[29377]: cluster 2021-03-10T14:17:20.138521+0000 mgr.gibba045.orlgmj (mgr.34412) 1545 : cluster [DBG] pgmap v868: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:21.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:17:21 gibba015 bash[30343]: cluster 2021-03-10T14:17:20.138521+0000 mgr.gibba045.orlgmj (mgr.34412) 1545 : cluster [DBG] pgmap v868: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:21.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:17:21 gibba045 bash[25517]: cluster 2021-03-10T14:17:20.138521+0000 mgr.gibba045.orlgmj (mgr.34412) 1545 : cluster [DBG] pgmap v868: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:23.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:17:23 gibba015 bash[29377]: cluster 2021-03-10T14:17:22.140003+0000 mgr.gibba045.orlgmj (mgr.34412) 1546 : cluster [DBG] pgmap v869: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:23.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:17:23 gibba015 bash[30343]: cluster 2021-03-10T14:17:22.140003+0000 mgr.gibba045.orlgmj (mgr.34412) 1546 : cluster [DBG] pgmap v869: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:23.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:17:23 gibba045 bash[25517]: cluster 2021-03-10T14:17:22.140003+0000 mgr.gibba045.orlgmj (mgr.34412) 1546 : cluster [DBG] pgmap v869: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:25.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:17:25 gibba015 bash[29377]: cluster 2021-03-10T14:17:24.140508+0000 mgr.gibba045.orlgmj (mgr.34412) 1547 : cluster [DBG] pgmap v870: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:25.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:17:25 gibba015 bash[30343]: cluster 2021-03-10T14:17:24.140508+0000 mgr.gibba045.orlgmj (mgr.34412) 1547 : cluster [DBG] pgmap v870: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:25.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:17:25 gibba045 bash[25517]: cluster 2021-03-10T14:17:24.140508+0000 mgr.gibba045.orlgmj (mgr.34412) 1547 : cluster [DBG] pgmap v870: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:27.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:17:27 gibba015 bash[29377]: cluster 2021-03-10T14:17:26.142166+0000 mgr.gibba045.orlgmj (mgr.34412) 1548 : cluster [DBG] pgmap v871: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:27.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:17:27 gibba015 bash[30343]: cluster 2021-03-10T14:17:26.142166+0000 mgr.gibba045.orlgmj (mgr.34412) 1548 : cluster [DBG] pgmap v871: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:27.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:17:27 gibba045 bash[25517]: cluster 2021-03-10T14:17:26.142166+0000 mgr.gibba045.orlgmj (mgr.34412) 1548 : cluster [DBG] pgmap v871: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:29.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:17:29 gibba015 bash[29377]: cluster 2021-03-10T14:17:28.143663+0000 mgr.gibba045.orlgmj (mgr.34412) 1549 : cluster [DBG] pgmap v872: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:29.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:17:29 gibba015 bash[30343]: cluster 2021-03-10T14:17:28.143663+0000 mgr.gibba045.orlgmj (mgr.34412) 1549 : cluster [DBG] pgmap v872: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:29.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:17:29 gibba045 bash[25517]: cluster 2021-03-10T14:17:28.143663+0000 mgr.gibba045.orlgmj (mgr.34412) 1549 : cluster [DBG] pgmap v872: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:31.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:17:31 gibba015 bash[29377]: cluster 2021-03-10T14:17:30.144491+0000 mgr.gibba045.orlgmj (mgr.34412) 1550 : cluster [DBG] pgmap v873: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:31.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:17:31 gibba015 bash[30343]: cluster 2021-03-10T14:17:30.144491+0000 mgr.gibba045.orlgmj (mgr.34412) 1550 : cluster [DBG] pgmap v873: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:31.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:17:31 gibba045 bash[25517]: cluster 2021-03-10T14:17:30.144491+0000 mgr.gibba045.orlgmj (mgr.34412) 1550 : cluster [DBG] pgmap v873: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:33.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:17:33 gibba015 bash[29377]: cluster 2021-03-10T14:17:32.145889+0000 mgr.gibba045.orlgmj (mgr.34412) 1551 : cluster [DBG] pgmap v874: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:33.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:17:33 gibba015 bash[30343]: cluster 2021-03-10T14:17:32.145889+0000 mgr.gibba045.orlgmj (mgr.34412) 1551 : cluster [DBG] pgmap v874: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:33.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:17:33 gibba045 bash[25517]: cluster 2021-03-10T14:17:32.145889+0000 mgr.gibba045.orlgmj (mgr.34412) 1551 : cluster [DBG] pgmap v874: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:34.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:17:34 gibba015 bash[29377]: audit 2021-03-10T14:17:33.553616+0000 mon.c (mon.1) 491 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:17:34.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:17:34 gibba015 bash[29377]: audit 2021-03-10T14:17:33.773745+0000 mon.a (mon.0) 774 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:17:34.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:17:34 gibba015 bash[29377]: audit 2021-03-10T14:17:33.777303+0000 mon.c (mon.1) 492 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:17:34.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:17:34 gibba015 bash[29377]: audit 2021-03-10T14:17:33.778705+0000 mon.c (mon.1) 493 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:17:34.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:17:34 gibba015 bash[29377]: audit 2021-03-10T14:17:33.779953+0000 mon.c (mon.1) 494 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:17:34.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:17:34 gibba015 bash[29377]: audit 2021-03-10T14:17:33.781041+0000 mon.c (mon.1) 495 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:17:34.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:17:34 gibba015 bash[29377]: audit 2021-03-10T14:17:33.783980+0000 mon.c (mon.1) 496 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:17:34.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:17:34 gibba015 bash[29377]: audit 2021-03-10T14:17:33.785370+0000 mon.c (mon.1) 497 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:17:34.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:17:34 gibba015 bash[30343]: audit 2021-03-10T14:17:33.553616+0000 mon.c (mon.1) 491 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:17:34.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:17:34 gibba015 bash[30343]: audit 2021-03-10T14:17:33.773745+0000 mon.a (mon.0) 774 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:17:34.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:17:34 gibba015 bash[30343]: audit 2021-03-10T14:17:33.777303+0000 mon.c (mon.1) 492 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:17:34.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:17:34 gibba015 bash[30343]: audit 2021-03-10T14:17:33.778705+0000 mon.c (mon.1) 493 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:17:34.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:17:34 gibba015 bash[30343]: audit 2021-03-10T14:17:33.779953+0000 mon.c (mon.1) 494 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:17:34.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:17:34 gibba015 bash[30343]: audit 2021-03-10T14:17:33.781041+0000 mon.c (mon.1) 495 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:17:34.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:17:34 gibba015 bash[30343]: audit 2021-03-10T14:17:33.783980+0000 mon.c (mon.1) 496 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:17:34.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:17:34 gibba015 bash[30343]: audit 2021-03-10T14:17:33.785370+0000 mon.c (mon.1) 497 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:17:34.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:17:34 gibba045 bash[25517]: audit 2021-03-10T14:17:33.553616+0000 mon.c (mon.1) 491 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:17:34.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:17:34 gibba045 bash[25517]: audit 2021-03-10T14:17:33.773745+0000 mon.a (mon.0) 774 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:17:34.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:17:34 gibba045 bash[25517]: audit 2021-03-10T14:17:33.777303+0000 mon.c (mon.1) 492 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:17:34.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:17:34 gibba045 bash[25517]: audit 2021-03-10T14:17:33.778705+0000 mon.c (mon.1) 493 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:17:34.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:17:34 gibba045 bash[25517]: audit 2021-03-10T14:17:33.779953+0000 mon.c (mon.1) 494 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:17:34.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:17:34 gibba045 bash[25517]: audit 2021-03-10T14:17:33.781041+0000 mon.c (mon.1) 495 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:17:34.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:17:34 gibba045 bash[25517]: audit 2021-03-10T14:17:33.783980+0000 mon.c (mon.1) 496 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:17:34.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:17:34 gibba045 bash[25517]: audit 2021-03-10T14:17:33.785370+0000 mon.c (mon.1) 497 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:17:35.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:17:35 gibba015 bash[29377]: cephadm 2021-03-10T14:17:33.561243+0000 mgr.gibba045.orlgmj (mgr.34412) 1552 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:17:35.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:17:35 gibba015 bash[29377]: cephadm 2021-03-10T14:17:33.562605+0000 mgr.gibba045.orlgmj (mgr.34412) 1553 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:17:35.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:17:35 gibba015 bash[29377]: cephadm 2021-03-10T14:17:33.778829+0000 mgr.gibba045.orlgmj (mgr.34412) 1554 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:17:35.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:17:35 gibba015 bash[29377]: cephadm 2021-03-10T14:17:33.780542+0000 mgr.gibba045.orlgmj (mgr.34412) 1555 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:17:35.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:17:35 gibba015 bash[29377]: cephadm 2021-03-10T14:17:33.781810+0000 mgr.gibba045.orlgmj (mgr.34412) 1556 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:17:35.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:17:35 gibba015 bash[29377]: cephadm 2021-03-10T14:17:33.781864+0000 mgr.gibba045.orlgmj (mgr.34412) 1557 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:17:35.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:17:35 gibba015 bash[29377]: cephadm 2021-03-10T14:17:33.783026+0000 mgr.gibba045.orlgmj (mgr.34412) 1558 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:17:35.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:17:35 gibba015 bash[29377]: cephadm 2021-03-10T14:17:33.783065+0000 mgr.gibba045.orlgmj (mgr.34412) 1559 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:17:35.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:17:35 gibba015 bash[29377]: cephadm 2021-03-10T14:17:33.784153+0000 mgr.gibba045.orlgmj (mgr.34412) 1560 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:17:35.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:17:35 gibba015 bash[29377]: cephadm 2021-03-10T14:17:33.785749+0000 mgr.gibba045.orlgmj (mgr.34412) 1561 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:17:35.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:17:35 gibba015 bash[29377]: cephadm 2021-03-10T14:17:33.785788+0000 mgr.gibba045.orlgmj (mgr.34412) 1562 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:17:35.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:17:35 gibba015 bash[29377]: cephadm 2021-03-10T14:17:33.786962+0000 mgr.gibba045.orlgmj (mgr.34412) 1563 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:17:35.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:17:35 gibba015 bash[29377]: cephadm 2021-03-10T14:17:33.787297+0000 mgr.gibba045.orlgmj (mgr.34412) 1564 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:17:35.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:17:35 gibba015 bash[29377]: cephadm 2021-03-10T14:17:33.788577+0000 mgr.gibba045.orlgmj (mgr.34412) 1565 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:17:35.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:17:35 gibba015 bash[29377]: cephadm 2021-03-10T14:17:33.788628+0000 mgr.gibba045.orlgmj (mgr.34412) 1566 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:17:35.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:17:35 gibba015 bash[29377]: cephadm 2021-03-10T14:17:33.788755+0000 mgr.gibba045.orlgmj (mgr.34412) 1567 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:17:35.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:17:35 gibba015 bash[29377]: cluster 2021-03-10T14:17:34.147051+0000 mgr.gibba045.orlgmj (mgr.34412) 1568 : cluster [DBG] pgmap v875: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:35.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:17:35 gibba015 bash[30343]: cephadm 2021-03-10T14:17:33.561243+0000 mgr.gibba045.orlgmj (mgr.34412) 1552 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:17:35.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:17:35 gibba015 bash[30343]: cephadm 2021-03-10T14:17:33.562605+0000 mgr.gibba045.orlgmj (mgr.34412) 1553 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:17:35.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:17:35 gibba015 bash[30343]: cephadm 2021-03-10T14:17:33.778829+0000 mgr.gibba045.orlgmj (mgr.34412) 1554 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:17:35.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:17:35 gibba015 bash[30343]: cephadm 2021-03-10T14:17:33.780542+0000 mgr.gibba045.orlgmj (mgr.34412) 1555 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:17:35.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:17:35 gibba015 bash[30343]: cephadm 2021-03-10T14:17:33.781810+0000 mgr.gibba045.orlgmj (mgr.34412) 1556 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:17:35.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:17:35 gibba015 bash[30343]: cephadm 2021-03-10T14:17:33.781864+0000 mgr.gibba045.orlgmj (mgr.34412) 1557 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:17:35.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:17:35 gibba015 bash[30343]: cephadm 2021-03-10T14:17:33.783026+0000 mgr.gibba045.orlgmj (mgr.34412) 1558 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:17:35.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:17:35 gibba015 bash[30343]: cephadm 2021-03-10T14:17:33.783065+0000 mgr.gibba045.orlgmj (mgr.34412) 1559 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:17:35.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:17:35 gibba015 bash[30343]: cephadm 2021-03-10T14:17:33.784153+0000 mgr.gibba045.orlgmj (mgr.34412) 1560 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:17:35.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:17:35 gibba015 bash[30343]: cephadm 2021-03-10T14:17:33.785749+0000 mgr.gibba045.orlgmj (mgr.34412) 1561 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:17:35.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:17:35 gibba015 bash[30343]: cephadm 2021-03-10T14:17:33.785788+0000 mgr.gibba045.orlgmj (mgr.34412) 1562 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:17:35.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:17:35 gibba015 bash[30343]: cephadm 2021-03-10T14:17:33.786962+0000 mgr.gibba045.orlgmj (mgr.34412) 1563 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:17:35.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:17:35 gibba015 bash[30343]: cephadm 2021-03-10T14:17:33.787297+0000 mgr.gibba045.orlgmj (mgr.34412) 1564 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:17:35.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:17:35 gibba015 bash[30343]: cephadm 2021-03-10T14:17:33.788577+0000 mgr.gibba045.orlgmj (mgr.34412) 1565 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:17:35.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:17:35 gibba015 bash[30343]: cephadm 2021-03-10T14:17:33.788628+0000 mgr.gibba045.orlgmj (mgr.34412) 1566 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:17:35.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:17:35 gibba015 bash[30343]: cephadm 2021-03-10T14:17:33.788755+0000 mgr.gibba045.orlgmj (mgr.34412) 1567 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:17:35.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:17:35 gibba015 bash[30343]: cluster 2021-03-10T14:17:34.147051+0000 mgr.gibba045.orlgmj (mgr.34412) 1568 : cluster [DBG] pgmap v875: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:35.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:17:35 gibba045 bash[25517]: cephadm 2021-03-10T14:17:33.561243+0000 mgr.gibba045.orlgmj (mgr.34412) 1552 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:17:35.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:17:35 gibba045 bash[25517]: cephadm 2021-03-10T14:17:33.562605+0000 mgr.gibba045.orlgmj (mgr.34412) 1553 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:17:35.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:17:35 gibba045 bash[25517]: cephadm 2021-03-10T14:17:33.778829+0000 mgr.gibba045.orlgmj (mgr.34412) 1554 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:17:35.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:17:35 gibba045 bash[25517]: cephadm 2021-03-10T14:17:33.780542+0000 mgr.gibba045.orlgmj (mgr.34412) 1555 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:17:35.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:17:35 gibba045 bash[25517]: cephadm 2021-03-10T14:17:33.781810+0000 mgr.gibba045.orlgmj (mgr.34412) 1556 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:17:35.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:17:35 gibba045 bash[25517]: cephadm 2021-03-10T14:17:33.781864+0000 mgr.gibba045.orlgmj (mgr.34412) 1557 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:17:35.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:17:35 gibba045 bash[25517]: cephadm 2021-03-10T14:17:33.783026+0000 mgr.gibba045.orlgmj (mgr.34412) 1558 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:17:35.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:17:35 gibba045 bash[25517]: cephadm 2021-03-10T14:17:33.783065+0000 mgr.gibba045.orlgmj (mgr.34412) 1559 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:17:35.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:17:35 gibba045 bash[25517]: cephadm 2021-03-10T14:17:33.784153+0000 mgr.gibba045.orlgmj (mgr.34412) 1560 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:17:35.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:17:35 gibba045 bash[25517]: cephadm 2021-03-10T14:17:33.785749+0000 mgr.gibba045.orlgmj (mgr.34412) 1561 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:17:35.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:17:35 gibba045 bash[25517]: cephadm 2021-03-10T14:17:33.785788+0000 mgr.gibba045.orlgmj (mgr.34412) 1562 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:17:35.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:17:35 gibba045 bash[25517]: cephadm 2021-03-10T14:17:33.786962+0000 mgr.gibba045.orlgmj (mgr.34412) 1563 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:17:35.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:17:35 gibba045 bash[25517]: cephadm 2021-03-10T14:17:33.787297+0000 mgr.gibba045.orlgmj (mgr.34412) 1564 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:17:35.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:17:35 gibba045 bash[25517]: cephadm 2021-03-10T14:17:33.788577+0000 mgr.gibba045.orlgmj (mgr.34412) 1565 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:17:35.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:17:35 gibba045 bash[25517]: cephadm 2021-03-10T14:17:33.788628+0000 mgr.gibba045.orlgmj (mgr.34412) 1566 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:17:35.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:17:35 gibba045 bash[25517]: cephadm 2021-03-10T14:17:33.788755+0000 mgr.gibba045.orlgmj (mgr.34412) 1567 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:17:35.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:17:35 gibba045 bash[25517]: cluster 2021-03-10T14:17:34.147051+0000 mgr.gibba045.orlgmj (mgr.34412) 1568 : cluster [DBG] pgmap v875: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:37.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:17:37 gibba015 bash[29377]: cluster 2021-03-10T14:17:36.147782+0000 mgr.gibba045.orlgmj (mgr.34412) 1569 : cluster [DBG] pgmap v876: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:37.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:17:37 gibba015 bash[30343]: cluster 2021-03-10T14:17:36.147782+0000 mgr.gibba045.orlgmj (mgr.34412) 1569 : cluster [DBG] pgmap v876: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:37.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:17:37 gibba045 bash[25517]: cluster 2021-03-10T14:17:36.147782+0000 mgr.gibba045.orlgmj (mgr.34412) 1569 : cluster [DBG] pgmap v876: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:39.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:17:39 gibba015 bash[29377]: cluster 2021-03-10T14:17:38.149321+0000 mgr.gibba045.orlgmj (mgr.34412) 1570 : cluster [DBG] pgmap v877: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:39.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:17:39 gibba015 bash[30343]: cluster 2021-03-10T14:17:38.149321+0000 mgr.gibba045.orlgmj (mgr.34412) 1570 : cluster [DBG] pgmap v877: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:39.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:17:39 gibba045 bash[25517]: cluster 2021-03-10T14:17:38.149321+0000 mgr.gibba045.orlgmj (mgr.34412) 1570 : cluster [DBG] pgmap v877: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:41.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:17:41 gibba015 bash[29377]: cluster 2021-03-10T14:17:40.150972+0000 mgr.gibba045.orlgmj (mgr.34412) 1571 : cluster [DBG] pgmap v878: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:41.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:17:41 gibba015 bash[30343]: cluster 2021-03-10T14:17:40.150972+0000 mgr.gibba045.orlgmj (mgr.34412) 1571 : cluster [DBG] pgmap v878: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:41.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:17:41 gibba045 bash[25517]: cluster 2021-03-10T14:17:40.150972+0000 mgr.gibba045.orlgmj (mgr.34412) 1571 : cluster [DBG] pgmap v878: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:43.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:17:43 gibba015 bash[29377]: cluster 2021-03-10T14:17:42.151523+0000 mgr.gibba045.orlgmj (mgr.34412) 1572 : cluster [DBG] pgmap v879: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:43.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:17:43 gibba015 bash[30343]: cluster 2021-03-10T14:17:42.151523+0000 mgr.gibba045.orlgmj (mgr.34412) 1572 : cluster [DBG] pgmap v879: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:43.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:17:43 gibba045 bash[25517]: cluster 2021-03-10T14:17:42.151523+0000 mgr.gibba045.orlgmj (mgr.34412) 1572 : cluster [DBG] pgmap v879: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:45.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:17:45 gibba015 bash[29377]: cluster 2021-03-10T14:17:44.152767+0000 mgr.gibba045.orlgmj (mgr.34412) 1573 : cluster [DBG] pgmap v880: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:45.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:17:45 gibba015 bash[30343]: cluster 2021-03-10T14:17:44.152767+0000 mgr.gibba045.orlgmj (mgr.34412) 1573 : cluster [DBG] pgmap v880: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:45.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:17:45 gibba045 bash[25517]: cluster 2021-03-10T14:17:44.152767+0000 mgr.gibba045.orlgmj (mgr.34412) 1573 : cluster [DBG] pgmap v880: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:47.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:17:47 gibba015 bash[29377]: cluster 2021-03-10T14:17:46.154472+0000 mgr.gibba045.orlgmj (mgr.34412) 1574 : cluster [DBG] pgmap v881: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:47.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:17:47 gibba015 bash[30343]: cluster 2021-03-10T14:17:46.154472+0000 mgr.gibba045.orlgmj (mgr.34412) 1574 : cluster [DBG] pgmap v881: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:47.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:17:47 gibba045 bash[25517]: cluster 2021-03-10T14:17:46.154472+0000 mgr.gibba045.orlgmj (mgr.34412) 1574 : cluster [DBG] pgmap v881: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:48.428 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:17:48.652 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:17:48.653 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (28m) 4m ago 33m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:17:48.653 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (33m) 3m ago 33m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:17:48.653 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (28m) 3m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:17:48.653 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (29m) 3m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:17:48.654 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (28m) 4m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:17:48.654 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (28m) 4m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:17:48.654 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (27m) 3m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:17:48.654 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (27m) 4m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:17:48.655 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (34m) 4m ago 34m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:17:48.655 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (34m) 3m ago 34m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:17:48.655 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (26m) 4m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:17:48.655 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (26m) 4m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:17:48.655 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (25m) 4m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:17:48.656 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (25m) 4m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:17:48.656 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (25m) 3m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:17:48.656 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (24m) 3m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:17:48.656 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (24m) 3m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:17:48.657 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (23m) 3m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:17:48.657 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (33m) 3m ago 34m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:17:48.657 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 3m ago 32m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:17:48.898 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:17:48.899 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:17:48.899 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:17:48.899 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:17:48.899 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:17:48.900 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:17:48.900 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:17:48.900 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:17:48.900 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:17:48.901 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:17:48.901 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:17:48.901 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:17:48.901 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:17:48.902 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:17:48.902 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:17:49.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:17:49 gibba015 bash[29377]: cluster 2021-03-10T14:17:48.155115+0000 mgr.gibba045.orlgmj (mgr.34412) 1575 : cluster [DBG] pgmap v882: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:49.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:17:49 gibba015 bash[29377]: audit 2021-03-10T14:17:48.896609+0000 mon.c (mon.1) 498 : audit [DBG] from='client.? 172.21.2.115:0/2233762917' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:17:49.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:17:49 gibba015 bash[30343]: cluster 2021-03-10T14:17:48.155115+0000 mgr.gibba045.orlgmj (mgr.34412) 1575 : cluster [DBG] pgmap v882: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:49.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:17:49 gibba015 bash[30343]: audit 2021-03-10T14:17:48.896609+0000 mon.c (mon.1) 498 : audit [DBG] from='client.? 172.21.2.115:0/2233762917' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:17:49.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:17:49 gibba045 bash[25517]: cluster 2021-03-10T14:17:48.155115+0000 mgr.gibba045.orlgmj (mgr.34412) 1575 : cluster [DBG] pgmap v882: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:49.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:17:49 gibba045 bash[25517]: audit 2021-03-10T14:17:48.896609+0000 mon.c (mon.1) 498 : audit [DBG] from='client.? 172.21.2.115:0/2233762917' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:17:50.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:17:50 gibba015 bash[29377]: audit 2021-03-10T14:17:48.418936+0000 mgr.gibba045.orlgmj (mgr.34412) 1576 : audit [DBG] from='client.55102 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:17:50.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:17:50 gibba015 bash[29377]: audit 2021-03-10T14:17:48.640909+0000 mgr.gibba045.orlgmj (mgr.34412) 1577 : audit [DBG] from='client.55108 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:17:50.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:17:50 gibba015 bash[29377]: cephadm 2021-03-10T14:17:48.800663+0000 mgr.gibba045.orlgmj (mgr.34412) 1578 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:17:50.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:17:50 gibba015 bash[30343]: audit 2021-03-10T14:17:48.418936+0000 mgr.gibba045.orlgmj (mgr.34412) 1576 : audit [DBG] from='client.55102 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:17:50.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:17:50 gibba015 bash[30343]: audit 2021-03-10T14:17:48.640909+0000 mgr.gibba045.orlgmj (mgr.34412) 1577 : audit [DBG] from='client.55108 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:17:50.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:17:50 gibba015 bash[30343]: cephadm 2021-03-10T14:17:48.800663+0000 mgr.gibba045.orlgmj (mgr.34412) 1578 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:17:50.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:17:50 gibba045 bash[25517]: audit 2021-03-10T14:17:48.418936+0000 mgr.gibba045.orlgmj (mgr.34412) 1576 : audit [DBG] from='client.55102 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:17:50.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:17:50 gibba045 bash[25517]: audit 2021-03-10T14:17:48.640909+0000 mgr.gibba045.orlgmj (mgr.34412) 1577 : audit [DBG] from='client.55108 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:17:50.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:17:50 gibba045 bash[25517]: cephadm 2021-03-10T14:17:48.800663+0000 mgr.gibba045.orlgmj (mgr.34412) 1578 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:17:51.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:17:51 gibba015 bash[29377]: cluster 2021-03-10T14:17:50.155938+0000 mgr.gibba045.orlgmj (mgr.34412) 1579 : cluster [DBG] pgmap v883: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:51.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:17:51 gibba015 bash[30343]: cluster 2021-03-10T14:17:50.155938+0000 mgr.gibba045.orlgmj (mgr.34412) 1579 : cluster [DBG] pgmap v883: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:51.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:17:51 gibba045 bash[25517]: cluster 2021-03-10T14:17:50.155938+0000 mgr.gibba045.orlgmj (mgr.34412) 1579 : cluster [DBG] pgmap v883: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:53.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:17:53 gibba015 bash[29377]: cluster 2021-03-10T14:17:52.157330+0000 mgr.gibba045.orlgmj (mgr.34412) 1580 : cluster [DBG] pgmap v884: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:53.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:17:53 gibba015 bash[29377]: audit 2021-03-10T14:17:52.620747+0000 mon.c (mon.1) 499 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:17:53.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:17:53 gibba015 bash[29377]: audit 2021-03-10T14:17:52.621562+0000 mon.c (mon.1) 500 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:17:53.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:17:53 gibba015 bash[29377]: audit 2021-03-10T14:17:52.621848+0000 mon.a (mon.0) 775 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:17:53.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:17:53 gibba015 bash[29377]: audit 2021-03-10T14:17:52.623135+0000 mon.a (mon.0) 776 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:17:53.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:17:53 gibba015 bash[29377]: audit 2021-03-10T14:17:52.623368+0000 mon.c (mon.1) 501 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T14:17:53.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:17:53 gibba015 bash[29377]: audit 2021-03-10T14:17:52.624531+0000 mon.c (mon.1) 502 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:17:53.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:17:53 gibba015 bash[29377]: audit 2021-03-10T14:17:52.624562+0000 mon.a (mon.0) 777 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T14:17:53.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:17:53 gibba015 bash[29377]: audit 2021-03-10T14:17:52.625427+0000 mon.c (mon.1) 503 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T14:17:53.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:17:53 gibba015 bash[29377]: audit 2021-03-10T14:17:52.625874+0000 mon.a (mon.0) 778 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:17:53.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:17:53 gibba015 bash[29377]: audit 2021-03-10T14:17:52.626418+0000 mon.c (mon.1) 504 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:17:53.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:17:53 gibba015 bash[29377]: audit 2021-03-10T14:17:52.626708+0000 mon.a (mon.0) 779 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T14:17:53.479 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:17:53 gibba015 bash[29377]: audit 2021-03-10T14:17:52.627893+0000 mon.a (mon.0) 780 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:17:53.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:17:53 gibba015 bash[30343]: cluster 2021-03-10T14:17:52.157330+0000 mgr.gibba045.orlgmj (mgr.34412) 1580 : cluster [DBG] pgmap v884: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:53.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:17:53 gibba015 bash[30343]: audit 2021-03-10T14:17:52.620747+0000 mon.c (mon.1) 499 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:17:53.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:17:53 gibba015 bash[30343]: audit 2021-03-10T14:17:52.621562+0000 mon.c (mon.1) 500 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:17:53.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:17:53 gibba015 bash[30343]: audit 2021-03-10T14:17:52.621848+0000 mon.a (mon.0) 775 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:17:53.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:17:53 gibba015 bash[30343]: audit 2021-03-10T14:17:52.623135+0000 mon.a (mon.0) 776 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:17:53.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:17:53 gibba015 bash[30343]: audit 2021-03-10T14:17:52.623368+0000 mon.c (mon.1) 501 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T14:17:53.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:17:53 gibba015 bash[30343]: audit 2021-03-10T14:17:52.624531+0000 mon.c (mon.1) 502 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:17:53.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:17:53 gibba015 bash[30343]: audit 2021-03-10T14:17:52.624562+0000 mon.a (mon.0) 777 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T14:17:53.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:17:53 gibba015 bash[30343]: audit 2021-03-10T14:17:52.625427+0000 mon.c (mon.1) 503 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T14:17:53.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:17:53 gibba015 bash[30343]: audit 2021-03-10T14:17:52.625874+0000 mon.a (mon.0) 778 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:17:53.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:17:53 gibba015 bash[30343]: audit 2021-03-10T14:17:52.626418+0000 mon.c (mon.1) 504 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:17:53.485 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:17:53 gibba015 bash[30343]: audit 2021-03-10T14:17:52.626708+0000 mon.a (mon.0) 779 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T14:17:53.485 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:17:53 gibba015 bash[30343]: audit 2021-03-10T14:17:52.627893+0000 mon.a (mon.0) 780 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:17:53.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:17:53 gibba045 bash[25517]: cluster 2021-03-10T14:17:52.157330+0000 mgr.gibba045.orlgmj (mgr.34412) 1580 : cluster [DBG] pgmap v884: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:53.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:17:53 gibba045 bash[25517]: audit 2021-03-10T14:17:52.620747+0000 mon.c (mon.1) 499 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:17:53.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:17:53 gibba045 bash[25517]: audit 2021-03-10T14:17:52.621562+0000 mon.c (mon.1) 500 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:17:53.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:17:53 gibba045 bash[25517]: audit 2021-03-10T14:17:52.621848+0000 mon.a (mon.0) 775 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:17:53.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:17:53 gibba045 bash[25517]: audit 2021-03-10T14:17:52.623135+0000 mon.a (mon.0) 776 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:17:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:17:53 gibba045 bash[25517]: audit 2021-03-10T14:17:52.623368+0000 mon.c (mon.1) 501 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T14:17:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:17:53 gibba045 bash[25517]: audit 2021-03-10T14:17:52.624531+0000 mon.c (mon.1) 502 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:17:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:17:53 gibba045 bash[25517]: audit 2021-03-10T14:17:52.624562+0000 mon.a (mon.0) 777 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T14:17:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:17:53 gibba045 bash[25517]: audit 2021-03-10T14:17:52.625427+0000 mon.c (mon.1) 503 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T14:17:53.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:17:53 gibba045 bash[25517]: audit 2021-03-10T14:17:52.625874+0000 mon.a (mon.0) 778 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:17:53.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:17:53 gibba045 bash[25517]: audit 2021-03-10T14:17:52.626418+0000 mon.c (mon.1) 504 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:17:53.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:17:53 gibba045 bash[25517]: audit 2021-03-10T14:17:52.626708+0000 mon.a (mon.0) 779 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T14:17:53.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:17:53 gibba045 bash[25517]: audit 2021-03-10T14:17:52.627893+0000 mon.a (mon.0) 780 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:17:55.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:17:55 gibba015 bash[29377]: cluster 2021-03-10T14:17:54.157959+0000 mgr.gibba045.orlgmj (mgr.34412) 1581 : cluster [DBG] pgmap v885: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:55.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:17:55 gibba015 bash[30343]: cluster 2021-03-10T14:17:54.157959+0000 mgr.gibba045.orlgmj (mgr.34412) 1581 : cluster [DBG] pgmap v885: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:55.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:17:55 gibba045 bash[25517]: cluster 2021-03-10T14:17:54.157959+0000 mgr.gibba045.orlgmj (mgr.34412) 1581 : cluster [DBG] pgmap v885: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:57.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:17:57 gibba015 bash[29377]: cluster 2021-03-10T14:17:56.159629+0000 mgr.gibba045.orlgmj (mgr.34412) 1582 : cluster [DBG] pgmap v886: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:57.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:17:57 gibba015 bash[30343]: cluster 2021-03-10T14:17:56.159629+0000 mgr.gibba045.orlgmj (mgr.34412) 1582 : cluster [DBG] pgmap v886: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:57.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:17:57 gibba045 bash[25517]: cluster 2021-03-10T14:17:56.159629+0000 mgr.gibba045.orlgmj (mgr.34412) 1582 : cluster [DBG] pgmap v886: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:59.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:17:59 gibba015 bash[29377]: cluster 2021-03-10T14:17:58.161185+0000 mgr.gibba045.orlgmj (mgr.34412) 1583 : cluster [DBG] pgmap v887: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:59.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:17:59 gibba015 bash[30343]: cluster 2021-03-10T14:17:58.161185+0000 mgr.gibba045.orlgmj (mgr.34412) 1583 : cluster [DBG] pgmap v887: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:59.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:17:59 gibba045 bash[25517]: cluster 2021-03-10T14:17:58.161185+0000 mgr.gibba045.orlgmj (mgr.34412) 1583 : cluster [DBG] pgmap v887: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:01.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:18:01 gibba015 bash[29377]: cluster 2021-03-10T14:18:00.162692+0000 mgr.gibba045.orlgmj (mgr.34412) 1584 : cluster [DBG] pgmap v888: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:01.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:18:01 gibba015 bash[30343]: cluster 2021-03-10T14:18:00.162692+0000 mgr.gibba045.orlgmj (mgr.34412) 1584 : cluster [DBG] pgmap v888: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:01.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:18:01 gibba045 bash[25517]: cluster 2021-03-10T14:18:00.162692+0000 mgr.gibba045.orlgmj (mgr.34412) 1584 : cluster [DBG] pgmap v888: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:03.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:18:03 gibba015 bash[29377]: cluster 2021-03-10T14:18:02.164154+0000 mgr.gibba045.orlgmj (mgr.34412) 1585 : cluster [DBG] pgmap v889: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:03.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:18:03 gibba015 bash[30343]: cluster 2021-03-10T14:18:02.164154+0000 mgr.gibba045.orlgmj (mgr.34412) 1585 : cluster [DBG] pgmap v889: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:03.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:18:03 gibba045 bash[25517]: cluster 2021-03-10T14:18:02.164154+0000 mgr.gibba045.orlgmj (mgr.34412) 1585 : cluster [DBG] pgmap v889: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:05.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:18:05 gibba015 bash[29377]: cephadm 2021-03-10T14:18:03.813501+0000 mgr.gibba045.orlgmj (mgr.34412) 1586 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:18:05.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:18:05 gibba015 bash[29377]: cluster 2021-03-10T14:18:04.165479+0000 mgr.gibba045.orlgmj (mgr.34412) 1587 : cluster [DBG] pgmap v890: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:05.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:18:05 gibba015 bash[30343]: cephadm 2021-03-10T14:18:03.813501+0000 mgr.gibba045.orlgmj (mgr.34412) 1586 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:18:05.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:18:05 gibba015 bash[30343]: cluster 2021-03-10T14:18:04.165479+0000 mgr.gibba045.orlgmj (mgr.34412) 1587 : cluster [DBG] pgmap v890: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:05.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:18:05 gibba045 bash[25517]: cephadm 2021-03-10T14:18:03.813501+0000 mgr.gibba045.orlgmj (mgr.34412) 1586 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:18:05.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:18:05 gibba045 bash[25517]: cluster 2021-03-10T14:18:04.165479+0000 mgr.gibba045.orlgmj (mgr.34412) 1587 : cluster [DBG] pgmap v890: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:07.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:18:07 gibba015 bash[29377]: cluster 2021-03-10T14:18:06.166154+0000 mgr.gibba045.orlgmj (mgr.34412) 1588 : cluster [DBG] pgmap v891: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:07.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:18:07 gibba015 bash[30343]: cluster 2021-03-10T14:18:06.166154+0000 mgr.gibba045.orlgmj (mgr.34412) 1588 : cluster [DBG] pgmap v891: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:07.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:18:07 gibba045 bash[25517]: cluster 2021-03-10T14:18:06.166154+0000 mgr.gibba045.orlgmj (mgr.34412) 1588 : cluster [DBG] pgmap v891: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:09.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:18:09 gibba015 bash[29377]: cluster 2021-03-10T14:18:08.167534+0000 mgr.gibba045.orlgmj (mgr.34412) 1589 : cluster [DBG] pgmap v892: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:09.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:18:09 gibba015 bash[30343]: cluster 2021-03-10T14:18:08.167534+0000 mgr.gibba045.orlgmj (mgr.34412) 1589 : cluster [DBG] pgmap v892: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:09.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:18:09 gibba045 bash[25517]: cluster 2021-03-10T14:18:08.167534+0000 mgr.gibba045.orlgmj (mgr.34412) 1589 : cluster [DBG] pgmap v892: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:11.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:18:11 gibba015 bash[29377]: cluster 2021-03-10T14:18:10.169197+0000 mgr.gibba045.orlgmj (mgr.34412) 1590 : cluster [DBG] pgmap v893: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:11.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:18:11 gibba015 bash[30343]: cluster 2021-03-10T14:18:10.169197+0000 mgr.gibba045.orlgmj (mgr.34412) 1590 : cluster [DBG] pgmap v893: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:11.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:18:11 gibba045 bash[25517]: cluster 2021-03-10T14:18:10.169197+0000 mgr.gibba045.orlgmj (mgr.34412) 1590 : cluster [DBG] pgmap v893: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:13.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:18:13 gibba015 bash[29377]: cluster 2021-03-10T14:18:12.169808+0000 mgr.gibba045.orlgmj (mgr.34412) 1591 : cluster [DBG] pgmap v894: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:13.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:18:13 gibba015 bash[30343]: cluster 2021-03-10T14:18:12.169808+0000 mgr.gibba045.orlgmj (mgr.34412) 1591 : cluster [DBG] pgmap v894: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:13.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:18:13 gibba045 bash[25517]: cluster 2021-03-10T14:18:12.169808+0000 mgr.gibba045.orlgmj (mgr.34412) 1591 : cluster [DBG] pgmap v894: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:15.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:18:15 gibba015 bash[29377]: cluster 2021-03-10T14:18:14.170931+0000 mgr.gibba045.orlgmj (mgr.34412) 1592 : cluster [DBG] pgmap v895: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:15.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:18:15 gibba015 bash[30343]: cluster 2021-03-10T14:18:14.170931+0000 mgr.gibba045.orlgmj (mgr.34412) 1592 : cluster [DBG] pgmap v895: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:15.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:18:15 gibba045 bash[25517]: cluster 2021-03-10T14:18:14.170931+0000 mgr.gibba045.orlgmj (mgr.34412) 1592 : cluster [DBG] pgmap v895: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:17.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:18:17 gibba015 bash[29377]: cluster 2021-03-10T14:18:16.172619+0000 mgr.gibba045.orlgmj (mgr.34412) 1593 : cluster [DBG] pgmap v896: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:17.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:18:17 gibba015 bash[30343]: cluster 2021-03-10T14:18:16.172619+0000 mgr.gibba045.orlgmj (mgr.34412) 1593 : cluster [DBG] pgmap v896: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:17.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:18:17 gibba045 bash[25517]: cluster 2021-03-10T14:18:16.172619+0000 mgr.gibba045.orlgmj (mgr.34412) 1593 : cluster [DBG] pgmap v896: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:19.142 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:18:19.369 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:18:19.369 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (29m) 4m ago 34m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:18:19.370 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (34m) 3m ago 34m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:18:19.370 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (29m) 3m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:18:19.370 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (29m) 3m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:18:19.370 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (28m) 4m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:18:19.371 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (28m) 4m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:18:19.371 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (28m) 3m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:18:19.371 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (28m) 4m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:18:19.371 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (34m) 4m ago 34m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:18:19.371 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (34m) 3m ago 34m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:18:19.372 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (27m) 4m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:18:19.372 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (26m) 4m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:18:19.372 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (26m) 4m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:18:19.372 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (26m) 4m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:18:19.373 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (25m) 3m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:18:19.373 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (25m) 3m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:18:19.373 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (24m) 3m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:18:19.373 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (24m) 3m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:18:19.374 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (33m) 3m ago 34m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:18:19.374 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 3m ago 32m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:18:19.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:18:19 gibba015 bash[29377]: cluster 2021-03-10T14:18:18.173200+0000 mgr.gibba045.orlgmj (mgr.34412) 1594 : cluster [DBG] pgmap v897: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:19.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:18:19 gibba015 bash[30343]: cluster 2021-03-10T14:18:18.173200+0000 mgr.gibba045.orlgmj (mgr.34412) 1594 : cluster [DBG] pgmap v897: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:19.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:18:19 gibba045 bash[25517]: cluster 2021-03-10T14:18:18.173200+0000 mgr.gibba045.orlgmj (mgr.34412) 1594 : cluster [DBG] pgmap v897: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:19.625 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:18:19.625 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:18:19.625 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:18:19.626 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:18:19.626 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:18:19.626 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:18:19.626 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:18:19.626 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:18:19.627 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:18:19.627 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:18:19.627 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:18:19.627 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:18:19.628 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:18:19.628 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:18:19.628 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:18:20.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:18:20 gibba015 bash[29377]: cephadm 2021-03-10T14:18:18.829171+0000 mgr.gibba045.orlgmj (mgr.34412) 1595 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:18:20.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:18:20 gibba015 bash[29377]: audit 2021-03-10T14:18:19.134108+0000 mgr.gibba045.orlgmj (mgr.34412) 1596 : audit [DBG] from='client.45132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:18:20.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:18:20 gibba015 bash[29377]: audit 2021-03-10T14:18:19.358467+0000 mgr.gibba045.orlgmj (mgr.34412) 1597 : audit [DBG] from='client.55126 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:18:20.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:18:20 gibba015 bash[29377]: audit 2021-03-10T14:18:19.622801+0000 mon.a (mon.0) 781 : audit [DBG] from='client.? 172.21.2.115:0/2527064102' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:18:20.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:18:20 gibba015 bash[30343]: cephadm 2021-03-10T14:18:18.829171+0000 mgr.gibba045.orlgmj (mgr.34412) 1595 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:18:20.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:18:20 gibba015 bash[30343]: audit 2021-03-10T14:18:19.134108+0000 mgr.gibba045.orlgmj (mgr.34412) 1596 : audit [DBG] from='client.45132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:18:20.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:18:20 gibba015 bash[30343]: audit 2021-03-10T14:18:19.358467+0000 mgr.gibba045.orlgmj (mgr.34412) 1597 : audit [DBG] from='client.55126 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:18:20.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:18:20 gibba015 bash[30343]: audit 2021-03-10T14:18:19.622801+0000 mon.a (mon.0) 781 : audit [DBG] from='client.? 172.21.2.115:0/2527064102' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:18:20.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:18:20 gibba045 bash[25517]: cephadm 2021-03-10T14:18:18.829171+0000 mgr.gibba045.orlgmj (mgr.34412) 1595 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:18:20.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:18:20 gibba045 bash[25517]: audit 2021-03-10T14:18:19.134108+0000 mgr.gibba045.orlgmj (mgr.34412) 1596 : audit [DBG] from='client.45132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:18:20.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:18:20 gibba045 bash[25517]: audit 2021-03-10T14:18:19.358467+0000 mgr.gibba045.orlgmj (mgr.34412) 1597 : audit [DBG] from='client.55126 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:18:20.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:18:20 gibba045 bash[25517]: audit 2021-03-10T14:18:19.622801+0000 mon.a (mon.0) 781 : audit [DBG] from='client.? 172.21.2.115:0/2527064102' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:18:21.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:18:21 gibba015 bash[29377]: cluster 2021-03-10T14:18:20.174573+0000 mgr.gibba045.orlgmj (mgr.34412) 1598 : cluster [DBG] pgmap v898: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:21.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:18:21 gibba015 bash[30343]: cluster 2021-03-10T14:18:20.174573+0000 mgr.gibba045.orlgmj (mgr.34412) 1598 : cluster [DBG] pgmap v898: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:21.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:18:21 gibba045 bash[25517]: cluster 2021-03-10T14:18:20.174573+0000 mgr.gibba045.orlgmj (mgr.34412) 1598 : cluster [DBG] pgmap v898: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:23.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:18:23 gibba015 bash[29377]: cluster 2021-03-10T14:18:22.175984+0000 mgr.gibba045.orlgmj (mgr.34412) 1599 : cluster [DBG] pgmap v899: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:23.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:18:23 gibba015 bash[30343]: cluster 2021-03-10T14:18:22.175984+0000 mgr.gibba045.orlgmj (mgr.34412) 1599 : cluster [DBG] pgmap v899: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:23.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:18:23 gibba045 bash[25517]: cluster 2021-03-10T14:18:22.175984+0000 mgr.gibba045.orlgmj (mgr.34412) 1599 : cluster [DBG] pgmap v899: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:25.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:18:25 gibba015 bash[29377]: cluster 2021-03-10T14:18:24.176517+0000 mgr.gibba045.orlgmj (mgr.34412) 1600 : cluster [DBG] pgmap v900: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:25.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:18:25 gibba015 bash[30343]: cluster 2021-03-10T14:18:24.176517+0000 mgr.gibba045.orlgmj (mgr.34412) 1600 : cluster [DBG] pgmap v900: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:25.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:18:25 gibba045 bash[25517]: cluster 2021-03-10T14:18:24.176517+0000 mgr.gibba045.orlgmj (mgr.34412) 1600 : cluster [DBG] pgmap v900: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:27.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:18:27 gibba015 bash[29377]: cluster 2021-03-10T14:18:26.177851+0000 mgr.gibba045.orlgmj (mgr.34412) 1601 : cluster [DBG] pgmap v901: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:27.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:18:27 gibba015 bash[30343]: cluster 2021-03-10T14:18:26.177851+0000 mgr.gibba045.orlgmj (mgr.34412) 1601 : cluster [DBG] pgmap v901: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:27.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:18:27 gibba045 bash[25517]: cluster 2021-03-10T14:18:26.177851+0000 mgr.gibba045.orlgmj (mgr.34412) 1601 : cluster [DBG] pgmap v901: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:29.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:18:29 gibba015 bash[29377]: cluster 2021-03-10T14:18:28.179329+0000 mgr.gibba045.orlgmj (mgr.34412) 1602 : cluster [DBG] pgmap v902: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:29.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:18:29 gibba015 bash[30343]: cluster 2021-03-10T14:18:28.179329+0000 mgr.gibba045.orlgmj (mgr.34412) 1602 : cluster [DBG] pgmap v902: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:29.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:18:29 gibba045 bash[25517]: cluster 2021-03-10T14:18:28.179329+0000 mgr.gibba045.orlgmj (mgr.34412) 1602 : cluster [DBG] pgmap v902: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:31.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:18:31 gibba015 bash[29377]: cluster 2021-03-10T14:18:30.180769+0000 mgr.gibba045.orlgmj (mgr.34412) 1603 : cluster [DBG] pgmap v903: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:31.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:18:31 gibba015 bash[30343]: cluster 2021-03-10T14:18:30.180769+0000 mgr.gibba045.orlgmj (mgr.34412) 1603 : cluster [DBG] pgmap v903: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:31.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:18:31 gibba045 bash[25517]: cluster 2021-03-10T14:18:30.180769+0000 mgr.gibba045.orlgmj (mgr.34412) 1603 : cluster [DBG] pgmap v903: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:33.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:18:33 gibba015 bash[29377]: cluster 2021-03-10T14:18:32.181416+0000 mgr.gibba045.orlgmj (mgr.34412) 1604 : cluster [DBG] pgmap v904: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:33.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:18:33 gibba015 bash[30343]: cluster 2021-03-10T14:18:32.181416+0000 mgr.gibba045.orlgmj (mgr.34412) 1604 : cluster [DBG] pgmap v904: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:33.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:18:33 gibba045 bash[25517]: cluster 2021-03-10T14:18:32.181416+0000 mgr.gibba045.orlgmj (mgr.34412) 1604 : cluster [DBG] pgmap v904: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:34.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:18:34 gibba015 bash[29377]: audit 2021-03-10T14:18:33.839846+0000 mon.c (mon.1) 505 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:18:34.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:18:34 gibba015 bash[29377]: audit 2021-03-10T14:18:34.051086+0000 mon.a (mon.0) 782 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:18:34.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:18:34 gibba015 bash[29377]: audit 2021-03-10T14:18:34.054886+0000 mon.c (mon.1) 506 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:18:34.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:18:34 gibba015 bash[29377]: audit 2021-03-10T14:18:34.056810+0000 mon.c (mon.1) 507 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:18:34.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:18:34 gibba015 bash[29377]: audit 2021-03-10T14:18:34.059379+0000 mon.c (mon.1) 508 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:18:34.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:18:34 gibba015 bash[29377]: audit 2021-03-10T14:18:34.061742+0000 mon.c (mon.1) 509 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:18:34.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:18:34 gibba015 bash[29377]: audit 2021-03-10T14:18:34.068085+0000 mon.c (mon.1) 510 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:18:34.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:18:34 gibba015 bash[29377]: audit 2021-03-10T14:18:34.070626+0000 mon.c (mon.1) 511 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:18:34.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:18:34 gibba015 bash[30343]: audit 2021-03-10T14:18:33.839846+0000 mon.c (mon.1) 505 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:18:34.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:18:34 gibba015 bash[30343]: audit 2021-03-10T14:18:34.051086+0000 mon.a (mon.0) 782 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:18:34.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:18:34 gibba015 bash[30343]: audit 2021-03-10T14:18:34.054886+0000 mon.c (mon.1) 506 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:18:34.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:18:34 gibba015 bash[30343]: audit 2021-03-10T14:18:34.056810+0000 mon.c (mon.1) 507 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:18:34.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:18:34 gibba015 bash[30343]: audit 2021-03-10T14:18:34.059379+0000 mon.c (mon.1) 508 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:18:34.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:18:34 gibba015 bash[30343]: audit 2021-03-10T14:18:34.061742+0000 mon.c (mon.1) 509 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:18:34.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:18:34 gibba015 bash[30343]: audit 2021-03-10T14:18:34.068085+0000 mon.c (mon.1) 510 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:18:34.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:18:34 gibba015 bash[30343]: audit 2021-03-10T14:18:34.070626+0000 mon.c (mon.1) 511 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:18:34.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:18:34 gibba045 bash[25517]: audit 2021-03-10T14:18:33.839846+0000 mon.c (mon.1) 505 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:18:34.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:18:34 gibba045 bash[25517]: audit 2021-03-10T14:18:34.051086+0000 mon.a (mon.0) 782 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:18:34.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:18:34 gibba045 bash[25517]: audit 2021-03-10T14:18:34.054886+0000 mon.c (mon.1) 506 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:18:34.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:18:34 gibba045 bash[25517]: audit 2021-03-10T14:18:34.056810+0000 mon.c (mon.1) 507 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:18:34.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:18:34 gibba045 bash[25517]: audit 2021-03-10T14:18:34.059379+0000 mon.c (mon.1) 508 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:18:34.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:18:34 gibba045 bash[25517]: audit 2021-03-10T14:18:34.061742+0000 mon.c (mon.1) 509 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:18:34.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:18:34 gibba045 bash[25517]: audit 2021-03-10T14:18:34.068085+0000 mon.c (mon.1) 510 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:18:34.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:18:34 gibba045 bash[25517]: audit 2021-03-10T14:18:34.070626+0000 mon.c (mon.1) 511 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:18:35.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:18:35 gibba015 bash[29377]: cephadm 2021-03-10T14:18:33.846711+0000 mgr.gibba045.orlgmj (mgr.34412) 1605 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:18:35.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:18:35 gibba015 bash[29377]: cephadm 2021-03-10T14:18:33.848632+0000 mgr.gibba045.orlgmj (mgr.34412) 1606 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:18:35.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:18:35 gibba015 bash[29377]: cephadm 2021-03-10T14:18:34.056356+0000 mgr.gibba045.orlgmj (mgr.34412) 1607 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:18:35.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:18:35 gibba015 bash[29377]: cephadm 2021-03-10T14:18:34.058452+0000 mgr.gibba045.orlgmj (mgr.34412) 1608 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:18:35.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:18:35 gibba015 bash[29377]: cephadm 2021-03-10T14:18:34.060990+0000 mgr.gibba045.orlgmj (mgr.34412) 1609 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:18:35.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:18:35 gibba015 bash[29377]: cephadm 2021-03-10T14:18:34.061030+0000 mgr.gibba045.orlgmj (mgr.34412) 1610 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:18:35.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:18:35 gibba015 bash[29377]: cephadm 2021-03-10T14:18:34.063504+0000 mgr.gibba045.orlgmj (mgr.34412) 1611 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:18:35.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:18:35 gibba015 bash[29377]: cephadm 2021-03-10T14:18:34.063542+0000 mgr.gibba045.orlgmj (mgr.34412) 1612 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:18:35.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:18:35 gibba015 bash[29377]: cephadm 2021-03-10T14:18:34.066013+0000 mgr.gibba045.orlgmj (mgr.34412) 1613 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:18:35.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:18:35 gibba015 bash[29377]: cephadm 2021-03-10T14:18:34.069686+0000 mgr.gibba045.orlgmj (mgr.34412) 1614 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:18:35.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:18:35 gibba015 bash[29377]: cephadm 2021-03-10T14:18:34.069724+0000 mgr.gibba045.orlgmj (mgr.34412) 1615 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:18:35.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:18:35 gibba015 bash[29377]: cephadm 2021-03-10T14:18:34.072090+0000 mgr.gibba045.orlgmj (mgr.34412) 1616 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:18:35.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:18:35 gibba015 bash[29377]: cephadm 2021-03-10T14:18:34.072421+0000 mgr.gibba045.orlgmj (mgr.34412) 1617 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:18:35.479 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:18:35 gibba015 bash[29377]: cephadm 2021-03-10T14:18:34.075005+0000 mgr.gibba045.orlgmj (mgr.34412) 1618 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:18:35.479 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:18:35 gibba015 bash[29377]: cephadm 2021-03-10T14:18:34.075043+0000 mgr.gibba045.orlgmj (mgr.34412) 1619 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:18:35.480 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:18:35 gibba015 bash[29377]: cephadm 2021-03-10T14:18:34.075151+0000 mgr.gibba045.orlgmj (mgr.34412) 1620 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:18:35.480 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:18:35 gibba015 bash[29377]: cluster 2021-03-10T14:18:34.182492+0000 mgr.gibba045.orlgmj (mgr.34412) 1621 : cluster [DBG] pgmap v905: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:35.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:18:35 gibba015 bash[30343]: cephadm 2021-03-10T14:18:33.846711+0000 mgr.gibba045.orlgmj (mgr.34412) 1605 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:18:35.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:18:35 gibba015 bash[30343]: cephadm 2021-03-10T14:18:33.848632+0000 mgr.gibba045.orlgmj (mgr.34412) 1606 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:18:35.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:18:35 gibba015 bash[30343]: cephadm 2021-03-10T14:18:34.056356+0000 mgr.gibba045.orlgmj (mgr.34412) 1607 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:18:35.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:18:35 gibba015 bash[30343]: cephadm 2021-03-10T14:18:34.058452+0000 mgr.gibba045.orlgmj (mgr.34412) 1608 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:18:35.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:18:35 gibba015 bash[30343]: cephadm 2021-03-10T14:18:34.060990+0000 mgr.gibba045.orlgmj (mgr.34412) 1609 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:18:35.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:18:35 gibba015 bash[30343]: cephadm 2021-03-10T14:18:34.061030+0000 mgr.gibba045.orlgmj (mgr.34412) 1610 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:18:35.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:18:35 gibba015 bash[30343]: cephadm 2021-03-10T14:18:34.063504+0000 mgr.gibba045.orlgmj (mgr.34412) 1611 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:18:35.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:18:35 gibba015 bash[30343]: cephadm 2021-03-10T14:18:34.063542+0000 mgr.gibba045.orlgmj (mgr.34412) 1612 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:18:35.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:18:35 gibba015 bash[30343]: cephadm 2021-03-10T14:18:34.066013+0000 mgr.gibba045.orlgmj (mgr.34412) 1613 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:18:35.485 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:18:35 gibba015 bash[30343]: cephadm 2021-03-10T14:18:34.069686+0000 mgr.gibba045.orlgmj (mgr.34412) 1614 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:18:35.485 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:18:35 gibba015 bash[30343]: cephadm 2021-03-10T14:18:34.069724+0000 mgr.gibba045.orlgmj (mgr.34412) 1615 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:18:35.485 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:18:35 gibba015 bash[30343]: cephadm 2021-03-10T14:18:34.072090+0000 mgr.gibba045.orlgmj (mgr.34412) 1616 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:18:35.486 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:18:35 gibba015 bash[30343]: cephadm 2021-03-10T14:18:34.072421+0000 mgr.gibba045.orlgmj (mgr.34412) 1617 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:18:35.486 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:18:35 gibba015 bash[30343]: cephadm 2021-03-10T14:18:34.075005+0000 mgr.gibba045.orlgmj (mgr.34412) 1618 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:18:35.487 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:18:35 gibba015 bash[30343]: cephadm 2021-03-10T14:18:34.075043+0000 mgr.gibba045.orlgmj (mgr.34412) 1619 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:18:35.487 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:18:35 gibba015 bash[30343]: cephadm 2021-03-10T14:18:34.075151+0000 mgr.gibba045.orlgmj (mgr.34412) 1620 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:18:35.487 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:18:35 gibba015 bash[30343]: cluster 2021-03-10T14:18:34.182492+0000 mgr.gibba045.orlgmj (mgr.34412) 1621 : cluster [DBG] pgmap v905: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:35.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:18:35 gibba045 bash[25517]: cephadm 2021-03-10T14:18:33.846711+0000 mgr.gibba045.orlgmj (mgr.34412) 1605 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:18:35.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:18:35 gibba045 bash[25517]: cephadm 2021-03-10T14:18:33.848632+0000 mgr.gibba045.orlgmj (mgr.34412) 1606 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:18:35.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:18:35 gibba045 bash[25517]: cephadm 2021-03-10T14:18:34.056356+0000 mgr.gibba045.orlgmj (mgr.34412) 1607 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:18:35.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:18:35 gibba045 bash[25517]: cephadm 2021-03-10T14:18:34.058452+0000 mgr.gibba045.orlgmj (mgr.34412) 1608 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:18:35.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:18:35 gibba045 bash[25517]: cephadm 2021-03-10T14:18:34.060990+0000 mgr.gibba045.orlgmj (mgr.34412) 1609 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:18:35.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:18:35 gibba045 bash[25517]: cephadm 2021-03-10T14:18:34.061030+0000 mgr.gibba045.orlgmj (mgr.34412) 1610 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:18:35.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:18:35 gibba045 bash[25517]: cephadm 2021-03-10T14:18:34.063504+0000 mgr.gibba045.orlgmj (mgr.34412) 1611 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:18:35.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:18:35 gibba045 bash[25517]: cephadm 2021-03-10T14:18:34.063542+0000 mgr.gibba045.orlgmj (mgr.34412) 1612 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:18:35.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:18:35 gibba045 bash[25517]: cephadm 2021-03-10T14:18:34.066013+0000 mgr.gibba045.orlgmj (mgr.34412) 1613 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:18:35.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:18:35 gibba045 bash[25517]: cephadm 2021-03-10T14:18:34.069686+0000 mgr.gibba045.orlgmj (mgr.34412) 1614 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:18:35.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:18:35 gibba045 bash[25517]: cephadm 2021-03-10T14:18:34.069724+0000 mgr.gibba045.orlgmj (mgr.34412) 1615 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:18:35.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:18:35 gibba045 bash[25517]: cephadm 2021-03-10T14:18:34.072090+0000 mgr.gibba045.orlgmj (mgr.34412) 1616 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:18:35.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:18:35 gibba045 bash[25517]: cephadm 2021-03-10T14:18:34.072421+0000 mgr.gibba045.orlgmj (mgr.34412) 1617 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:18:35.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:18:35 gibba045 bash[25517]: cephadm 2021-03-10T14:18:34.075005+0000 mgr.gibba045.orlgmj (mgr.34412) 1618 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:18:35.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:18:35 gibba045 bash[25517]: cephadm 2021-03-10T14:18:34.075043+0000 mgr.gibba045.orlgmj (mgr.34412) 1619 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:18:35.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:18:35 gibba045 bash[25517]: cephadm 2021-03-10T14:18:34.075151+0000 mgr.gibba045.orlgmj (mgr.34412) 1620 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:18:35.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:18:35 gibba045 bash[25517]: cluster 2021-03-10T14:18:34.182492+0000 mgr.gibba045.orlgmj (mgr.34412) 1621 : cluster [DBG] pgmap v905: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:37.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:18:37 gibba015 bash[29377]: cluster 2021-03-10T14:18:36.184090+0000 mgr.gibba045.orlgmj (mgr.34412) 1622 : cluster [DBG] pgmap v906: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:37.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:18:37 gibba015 bash[30343]: cluster 2021-03-10T14:18:36.184090+0000 mgr.gibba045.orlgmj (mgr.34412) 1622 : cluster [DBG] pgmap v906: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:37.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:18:37 gibba045 bash[25517]: cluster 2021-03-10T14:18:36.184090+0000 mgr.gibba045.orlgmj (mgr.34412) 1622 : cluster [DBG] pgmap v906: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:39.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:18:39 gibba015 bash[29377]: cluster 2021-03-10T14:18:38.185654+0000 mgr.gibba045.orlgmj (mgr.34412) 1623 : cluster [DBG] pgmap v907: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:39.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:18:39 gibba015 bash[30343]: cluster 2021-03-10T14:18:38.185654+0000 mgr.gibba045.orlgmj (mgr.34412) 1623 : cluster [DBG] pgmap v907: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:39.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:18:39 gibba045 bash[25517]: cluster 2021-03-10T14:18:38.185654+0000 mgr.gibba045.orlgmj (mgr.34412) 1623 : cluster [DBG] pgmap v907: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:41.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:18:41 gibba015 bash[29377]: cluster 2021-03-10T14:18:40.187202+0000 mgr.gibba045.orlgmj (mgr.34412) 1624 : cluster [DBG] pgmap v908: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:41.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:18:41 gibba015 bash[30343]: cluster 2021-03-10T14:18:40.187202+0000 mgr.gibba045.orlgmj (mgr.34412) 1624 : cluster [DBG] pgmap v908: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:41.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:18:41 gibba045 bash[25517]: cluster 2021-03-10T14:18:40.187202+0000 mgr.gibba045.orlgmj (mgr.34412) 1624 : cluster [DBG] pgmap v908: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:43.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:18:43 gibba015 bash[29377]: cluster 2021-03-10T14:18:42.188181+0000 mgr.gibba045.orlgmj (mgr.34412) 1625 : cluster [DBG] pgmap v909: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:43.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:18:43 gibba015 bash[30343]: cluster 2021-03-10T14:18:42.188181+0000 mgr.gibba045.orlgmj (mgr.34412) 1625 : cluster [DBG] pgmap v909: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:43.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:18:43 gibba045 bash[25517]: cluster 2021-03-10T14:18:42.188181+0000 mgr.gibba045.orlgmj (mgr.34412) 1625 : cluster [DBG] pgmap v909: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:45.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:18:45 gibba045 bash[25517]: cluster 2021-03-10T14:18:44.189522+0000 mgr.gibba045.orlgmj (mgr.34412) 1626 : cluster [DBG] pgmap v910: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:45.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:18:45 gibba015 bash[29377]: cluster 2021-03-10T14:18:44.189522+0000 mgr.gibba045.orlgmj (mgr.34412) 1626 : cluster [DBG] pgmap v910: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:45.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:18:45 gibba015 bash[30343]: cluster 2021-03-10T14:18:44.189522+0000 mgr.gibba045.orlgmj (mgr.34412) 1626 : cluster [DBG] pgmap v910: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:47.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:18:47 gibba045 bash[25517]: cluster 2021-03-10T14:18:46.191298+0000 mgr.gibba045.orlgmj (mgr.34412) 1627 : cluster [DBG] pgmap v911: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:47.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:18:47 gibba015 bash[29377]: cluster 2021-03-10T14:18:46.191298+0000 mgr.gibba045.orlgmj (mgr.34412) 1627 : cluster [DBG] pgmap v911: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:47.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:18:47 gibba015 bash[30343]: cluster 2021-03-10T14:18:46.191298+0000 mgr.gibba045.orlgmj (mgr.34412) 1627 : cluster [DBG] pgmap v911: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:49.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:18:49 gibba045 bash[25517]: cluster 2021-03-10T14:18:48.192505+0000 mgr.gibba045.orlgmj (mgr.34412) 1628 : cluster [DBG] pgmap v912: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:49.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:18:49 gibba015 bash[29377]: cluster 2021-03-10T14:18:48.192505+0000 mgr.gibba045.orlgmj (mgr.34412) 1628 : cluster [DBG] pgmap v912: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:49.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:18:49 gibba015 bash[30343]: cluster 2021-03-10T14:18:48.192505+0000 mgr.gibba045.orlgmj (mgr.34412) 1628 : cluster [DBG] pgmap v912: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:49.884 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:18:50.107 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:18:50.107 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (29m) 5m ago 34m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:18:50.107 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (34m) 4m ago 34m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:18:50.108 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (29m) 4m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:18:50.108 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (30m) 4m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:18:50.108 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (29m) 5m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:18:50.108 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (29m) 5m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:18:50.109 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (28m) 4m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:18:50.109 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (28m) 5m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:18:50.109 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (35m) 5m ago 35m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:18:50.109 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (35m) 4m ago 35m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:18:50.109 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (27m) 5m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:18:50.110 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (27m) 5m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:18:50.110 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (26m) 5m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:18:50.110 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (26m) 5m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:18:50.110 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (26m) 4m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:18:50.111 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (25m) 4m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:18:50.111 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (25m) 4m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:18:50.111 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (24m) 4m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:18:50.111 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (34m) 4m ago 35m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:18:50.111 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 4m ago 33m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:18:50.359 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:18:50.359 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:18:50.359 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:18:50.360 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:18:50.360 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:18:50.360 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:18:50.360 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:18:50.360 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:18:50.361 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:18:50.361 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:18:50.361 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:18:50.361 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:18:50.361 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:18:50.362 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:18:50.362 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:18:50.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:18:50 gibba045 bash[25517]: cephadm 2021-03-10T14:18:49.091014+0000 mgr.gibba045.orlgmj (mgr.34412) 1629 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:18:50.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:18:50 gibba015 bash[29377]: cephadm 2021-03-10T14:18:49.091014+0000 mgr.gibba045.orlgmj (mgr.34412) 1629 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:18:50.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:18:50 gibba015 bash[30343]: cephadm 2021-03-10T14:18:49.091014+0000 mgr.gibba045.orlgmj (mgr.34412) 1629 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:18:51.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:18:51 gibba045 bash[25517]: audit 2021-03-10T14:18:49.875536+0000 mgr.gibba045.orlgmj (mgr.34412) 1630 : audit [DBG] from='client.55138 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:18:51.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:18:51 gibba045 bash[25517]: audit 2021-03-10T14:18:50.099700+0000 mgr.gibba045.orlgmj (mgr.34412) 1631 : audit [DBG] from='client.55144 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:18:51.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:18:51 gibba045 bash[25517]: cluster 2021-03-10T14:18:50.193821+0000 mgr.gibba045.orlgmj (mgr.34412) 1632 : cluster [DBG] pgmap v913: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:51.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:18:51 gibba045 bash[25517]: audit 2021-03-10T14:18:50.356994+0000 mon.a (mon.0) 783 : audit [DBG] from='client.? 172.21.2.115:0/333251073' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:18:51.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:18:51 gibba015 bash[29377]: audit 2021-03-10T14:18:49.875536+0000 mgr.gibba045.orlgmj (mgr.34412) 1630 : audit [DBG] from='client.55138 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:18:51.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:18:51 gibba015 bash[29377]: audit 2021-03-10T14:18:50.099700+0000 mgr.gibba045.orlgmj (mgr.34412) 1631 : audit [DBG] from='client.55144 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:18:51.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:18:51 gibba015 bash[29377]: cluster 2021-03-10T14:18:50.193821+0000 mgr.gibba045.orlgmj (mgr.34412) 1632 : cluster [DBG] pgmap v913: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:51.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:18:51 gibba015 bash[29377]: audit 2021-03-10T14:18:50.356994+0000 mon.a (mon.0) 783 : audit [DBG] from='client.? 172.21.2.115:0/333251073' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:18:51.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:18:51 gibba015 bash[30343]: audit 2021-03-10T14:18:49.875536+0000 mgr.gibba045.orlgmj (mgr.34412) 1630 : audit [DBG] from='client.55138 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:18:51.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:18:51 gibba015 bash[30343]: audit 2021-03-10T14:18:50.099700+0000 mgr.gibba045.orlgmj (mgr.34412) 1631 : audit [DBG] from='client.55144 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:18:51.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:18:51 gibba015 bash[30343]: cluster 2021-03-10T14:18:50.193821+0000 mgr.gibba045.orlgmj (mgr.34412) 1632 : cluster [DBG] pgmap v913: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:51.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:18:51 gibba015 bash[30343]: audit 2021-03-10T14:18:50.356994+0000 mon.a (mon.0) 783 : audit [DBG] from='client.? 172.21.2.115:0/333251073' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:18:53.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:18:53 gibba015 bash[29377]: cluster 2021-03-10T14:18:52.195355+0000 mgr.gibba045.orlgmj (mgr.34412) 1633 : cluster [DBG] pgmap v914: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:53.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:18:53 gibba015 bash[29377]: audit 2021-03-10T14:18:52.627655+0000 mon.c (mon.1) 512 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:18:53.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:18:53 gibba015 bash[29377]: audit 2021-03-10T14:18:52.628340+0000 mon.c (mon.1) 513 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:18:53.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:18:53 gibba015 bash[29377]: audit 2021-03-10T14:18:52.628957+0000 mon.a (mon.0) 784 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:18:53.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:18:53 gibba015 bash[29377]: audit 2021-03-10T14:18:52.629635+0000 mon.c (mon.1) 514 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T14:18:53.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:18:53 gibba015 bash[29377]: audit 2021-03-10T14:18:52.630417+0000 mon.a (mon.0) 785 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:18:53.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:18:53 gibba015 bash[29377]: audit 2021-03-10T14:18:52.630548+0000 mon.c (mon.1) 515 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T14:18:53.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:18:53 gibba015 bash[29377]: audit 2021-03-10T14:18:52.631405+0000 mon.c (mon.1) 516 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:18:53.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:18:53 gibba015 bash[29377]: audit 2021-03-10T14:18:52.631956+0000 mon.a (mon.0) 786 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T14:18:53.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:18:53 gibba015 bash[29377]: audit 2021-03-10T14:18:52.632100+0000 mon.c (mon.1) 517 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:18:53.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:18:53 gibba015 bash[29377]: audit 2021-03-10T14:18:52.633556+0000 mon.a (mon.0) 787 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T14:18:53.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:18:53 gibba015 bash[29377]: audit 2021-03-10T14:18:52.634343+0000 mon.a (mon.0) 788 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:18:53.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:18:53 gibba015 bash[29377]: audit 2021-03-10T14:18:52.634613+0000 mon.a (mon.0) 789 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:18:53.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:18:53 gibba015 bash[30343]: cluster 2021-03-10T14:18:52.195355+0000 mgr.gibba045.orlgmj (mgr.34412) 1633 : cluster [DBG] pgmap v914: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:53.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:18:53 gibba015 bash[30343]: audit 2021-03-10T14:18:52.627655+0000 mon.c (mon.1) 512 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:18:53.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:18:53 gibba015 bash[30343]: audit 2021-03-10T14:18:52.628340+0000 mon.c (mon.1) 513 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:18:53.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:18:53 gibba015 bash[30343]: audit 2021-03-10T14:18:52.628957+0000 mon.a (mon.0) 784 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:18:53.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:18:53 gibba015 bash[30343]: audit 2021-03-10T14:18:52.629635+0000 mon.c (mon.1) 514 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T14:18:53.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:18:53 gibba015 bash[30343]: audit 2021-03-10T14:18:52.630417+0000 mon.a (mon.0) 785 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:18:53.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:18:53 gibba015 bash[30343]: audit 2021-03-10T14:18:52.630548+0000 mon.c (mon.1) 515 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T14:18:53.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:18:53 gibba015 bash[30343]: audit 2021-03-10T14:18:52.631405+0000 mon.c (mon.1) 516 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:18:53.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:18:53 gibba015 bash[30343]: audit 2021-03-10T14:18:52.631956+0000 mon.a (mon.0) 786 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T14:18:53.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:18:53 gibba015 bash[30343]: audit 2021-03-10T14:18:52.632100+0000 mon.c (mon.1) 517 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:18:53.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:18:53 gibba015 bash[30343]: audit 2021-03-10T14:18:52.633556+0000 mon.a (mon.0) 787 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T14:18:53.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:18:53 gibba015 bash[30343]: audit 2021-03-10T14:18:52.634343+0000 mon.a (mon.0) 788 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:18:53.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:18:53 gibba015 bash[30343]: audit 2021-03-10T14:18:52.634613+0000 mon.a (mon.0) 789 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:18:53.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:18:53 gibba045 bash[25517]: cluster 2021-03-10T14:18:52.195355+0000 mgr.gibba045.orlgmj (mgr.34412) 1633 : cluster [DBG] pgmap v914: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:53.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:18:53 gibba045 bash[25517]: audit 2021-03-10T14:18:52.627655+0000 mon.c (mon.1) 512 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:18:53.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:18:53 gibba045 bash[25517]: audit 2021-03-10T14:18:52.628340+0000 mon.c (mon.1) 513 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:18:53.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:18:53 gibba045 bash[25517]: audit 2021-03-10T14:18:52.628957+0000 mon.a (mon.0) 784 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:18:53.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:18:53 gibba045 bash[25517]: audit 2021-03-10T14:18:52.629635+0000 mon.c (mon.1) 514 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T14:18:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:18:53 gibba045 bash[25517]: audit 2021-03-10T14:18:52.630417+0000 mon.a (mon.0) 785 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:18:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:18:53 gibba045 bash[25517]: audit 2021-03-10T14:18:52.630548+0000 mon.c (mon.1) 515 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T14:18:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:18:53 gibba045 bash[25517]: audit 2021-03-10T14:18:52.631405+0000 mon.c (mon.1) 516 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:18:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:18:53 gibba045 bash[25517]: audit 2021-03-10T14:18:52.631956+0000 mon.a (mon.0) 786 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T14:18:53.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:18:53 gibba045 bash[25517]: audit 2021-03-10T14:18:52.632100+0000 mon.c (mon.1) 517 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:18:53.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:18:53 gibba045 bash[25517]: audit 2021-03-10T14:18:52.633556+0000 mon.a (mon.0) 787 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T14:18:53.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:18:53 gibba045 bash[25517]: audit 2021-03-10T14:18:52.634343+0000 mon.a (mon.0) 788 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:18:53.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:18:53 gibba045 bash[25517]: audit 2021-03-10T14:18:52.634613+0000 mon.a (mon.0) 789 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:18:55.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:18:55 gibba045 bash[25517]: cluster 2021-03-10T14:18:54.196597+0000 mgr.gibba045.orlgmj (mgr.34412) 1634 : cluster [DBG] pgmap v915: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:55.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:18:55 gibba015 bash[29377]: cluster 2021-03-10T14:18:54.196597+0000 mgr.gibba045.orlgmj (mgr.34412) 1634 : cluster [DBG] pgmap v915: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:55.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:18:55 gibba015 bash[30343]: cluster 2021-03-10T14:18:54.196597+0000 mgr.gibba045.orlgmj (mgr.34412) 1634 : cluster [DBG] pgmap v915: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:57.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:18:57 gibba045 bash[25517]: cluster 2021-03-10T14:18:56.198334+0000 mgr.gibba045.orlgmj (mgr.34412) 1635 : cluster [DBG] pgmap v916: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:57.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:18:57 gibba015 bash[29377]: cluster 2021-03-10T14:18:56.198334+0000 mgr.gibba045.orlgmj (mgr.34412) 1635 : cluster [DBG] pgmap v916: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:57.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:18:57 gibba015 bash[30343]: cluster 2021-03-10T14:18:56.198334+0000 mgr.gibba045.orlgmj (mgr.34412) 1635 : cluster [DBG] pgmap v916: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:59.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:18:59 gibba045 bash[25517]: cluster 2021-03-10T14:18:58.199913+0000 mgr.gibba045.orlgmj (mgr.34412) 1636 : cluster [DBG] pgmap v917: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:59.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:18:59 gibba015 bash[29377]: cluster 2021-03-10T14:18:58.199913+0000 mgr.gibba045.orlgmj (mgr.34412) 1636 : cluster [DBG] pgmap v917: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:59.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:18:59 gibba015 bash[30343]: cluster 2021-03-10T14:18:58.199913+0000 mgr.gibba045.orlgmj (mgr.34412) 1636 : cluster [DBG] pgmap v917: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:01.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:19:01 gibba045 bash[25517]: cluster 2021-03-10T14:19:00.200928+0000 mgr.gibba045.orlgmj (mgr.34412) 1637 : cluster [DBG] pgmap v918: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:01.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:19:01 gibba015 bash[29377]: cluster 2021-03-10T14:19:00.200928+0000 mgr.gibba045.orlgmj (mgr.34412) 1637 : cluster [DBG] pgmap v918: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:01.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:19:01 gibba015 bash[30343]: cluster 2021-03-10T14:19:00.200928+0000 mgr.gibba045.orlgmj (mgr.34412) 1637 : cluster [DBG] pgmap v918: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:03.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:19:03 gibba015 bash[29377]: cluster 2021-03-10T14:19:02.201503+0000 mgr.gibba045.orlgmj (mgr.34412) 1638 : cluster [DBG] pgmap v919: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:03.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:19:03 gibba015 bash[30343]: cluster 2021-03-10T14:19:02.201503+0000 mgr.gibba045.orlgmj (mgr.34412) 1638 : cluster [DBG] pgmap v919: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:03.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:19:03 gibba045 bash[25517]: cluster 2021-03-10T14:19:02.201503+0000 mgr.gibba045.orlgmj (mgr.34412) 1638 : cluster [DBG] pgmap v919: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:05.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:19:05 gibba045 bash[25517]: cephadm 2021-03-10T14:19:04.106800+0000 mgr.gibba045.orlgmj (mgr.34412) 1639 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:19:05.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:19:05 gibba045 bash[25517]: cluster 2021-03-10T14:19:04.202589+0000 mgr.gibba045.orlgmj (mgr.34412) 1640 : cluster [DBG] pgmap v920: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:05.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:19:05 gibba015 bash[29377]: cephadm 2021-03-10T14:19:04.106800+0000 mgr.gibba045.orlgmj (mgr.34412) 1639 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:19:05.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:19:05 gibba015 bash[29377]: cluster 2021-03-10T14:19:04.202589+0000 mgr.gibba045.orlgmj (mgr.34412) 1640 : cluster [DBG] pgmap v920: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:05.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:19:05 gibba015 bash[30343]: cephadm 2021-03-10T14:19:04.106800+0000 mgr.gibba045.orlgmj (mgr.34412) 1639 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:19:05.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:19:05 gibba015 bash[30343]: cluster 2021-03-10T14:19:04.202589+0000 mgr.gibba045.orlgmj (mgr.34412) 1640 : cluster [DBG] pgmap v920: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:07.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:19:07 gibba045 bash[25517]: cluster 2021-03-10T14:19:06.203578+0000 mgr.gibba045.orlgmj (mgr.34412) 1641 : cluster [DBG] pgmap v921: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:07.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:19:07 gibba015 bash[29377]: cluster 2021-03-10T14:19:06.203578+0000 mgr.gibba045.orlgmj (mgr.34412) 1641 : cluster [DBG] pgmap v921: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:07.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:19:07 gibba015 bash[30343]: cluster 2021-03-10T14:19:06.203578+0000 mgr.gibba045.orlgmj (mgr.34412) 1641 : cluster [DBG] pgmap v921: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:09.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:19:09 gibba045 bash[25517]: cluster 2021-03-10T14:19:08.205145+0000 mgr.gibba045.orlgmj (mgr.34412) 1642 : cluster [DBG] pgmap v922: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:09.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:19:09 gibba015 bash[29377]: cluster 2021-03-10T14:19:08.205145+0000 mgr.gibba045.orlgmj (mgr.34412) 1642 : cluster [DBG] pgmap v922: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:09.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:19:09 gibba015 bash[30343]: cluster 2021-03-10T14:19:08.205145+0000 mgr.gibba045.orlgmj (mgr.34412) 1642 : cluster [DBG] pgmap v922: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:11.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:19:11 gibba045 bash[25517]: cluster 2021-03-10T14:19:10.206841+0000 mgr.gibba045.orlgmj (mgr.34412) 1643 : cluster [DBG] pgmap v923: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:11.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:19:11 gibba015 bash[29377]: cluster 2021-03-10T14:19:10.206841+0000 mgr.gibba045.orlgmj (mgr.34412) 1643 : cluster [DBG] pgmap v923: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:11.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:19:11 gibba015 bash[30343]: cluster 2021-03-10T14:19:10.206841+0000 mgr.gibba045.orlgmj (mgr.34412) 1643 : cluster [DBG] pgmap v923: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:13.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:19:13 gibba015 bash[29377]: cluster 2021-03-10T14:19:12.208212+0000 mgr.gibba045.orlgmj (mgr.34412) 1644 : cluster [DBG] pgmap v924: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:13.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:19:13 gibba015 bash[30343]: cluster 2021-03-10T14:19:12.208212+0000 mgr.gibba045.orlgmj (mgr.34412) 1644 : cluster [DBG] pgmap v924: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:13.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:19:13 gibba045 bash[25517]: cluster 2021-03-10T14:19:12.208212+0000 mgr.gibba045.orlgmj (mgr.34412) 1644 : cluster [DBG] pgmap v924: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:15.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:19:15 gibba045 bash[25517]: cluster 2021-03-10T14:19:14.209386+0000 mgr.gibba045.orlgmj (mgr.34412) 1645 : cluster [DBG] pgmap v925: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:15.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:19:15 gibba015 bash[29377]: cluster 2021-03-10T14:19:14.209386+0000 mgr.gibba045.orlgmj (mgr.34412) 1645 : cluster [DBG] pgmap v925: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:15.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:19:15 gibba015 bash[30343]: cluster 2021-03-10T14:19:14.209386+0000 mgr.gibba045.orlgmj (mgr.34412) 1645 : cluster [DBG] pgmap v925: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:17.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:19:17 gibba045 bash[25517]: cluster 2021-03-10T14:19:16.211140+0000 mgr.gibba045.orlgmj (mgr.34412) 1646 : cluster [DBG] pgmap v926: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:17.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:19:17 gibba015 bash[29377]: cluster 2021-03-10T14:19:16.211140+0000 mgr.gibba045.orlgmj (mgr.34412) 1646 : cluster [DBG] pgmap v926: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:17.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:19:17 gibba015 bash[30343]: cluster 2021-03-10T14:19:16.211140+0000 mgr.gibba045.orlgmj (mgr.34412) 1646 : cluster [DBG] pgmap v926: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:19.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:19:19 gibba045 bash[25517]: cluster 2021-03-10T14:19:18.212370+0000 mgr.gibba045.orlgmj (mgr.34412) 1647 : cluster [DBG] pgmap v927: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:19.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:19:19 gibba015 bash[29377]: cluster 2021-03-10T14:19:18.212370+0000 mgr.gibba045.orlgmj (mgr.34412) 1647 : cluster [DBG] pgmap v927: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:19.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:19:19 gibba015 bash[30343]: cluster 2021-03-10T14:19:18.212370+0000 mgr.gibba045.orlgmj (mgr.34412) 1647 : cluster [DBG] pgmap v927: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:20.643 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:19:20.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:19:20 gibba015 bash[29377]: cephadm 2021-03-10T14:19:19.122200+0000 mgr.gibba045.orlgmj (mgr.34412) 1648 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:19:20.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:19:20 gibba015 bash[30343]: cephadm 2021-03-10T14:19:19.122200+0000 mgr.gibba045.orlgmj (mgr.34412) 1648 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:19:20.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:19:20 gibba045 bash[25517]: cephadm 2021-03-10T14:19:19.122200+0000 mgr.gibba045.orlgmj (mgr.34412) 1648 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:19:20.874 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:19:20.874 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (30m) 5m ago 35m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:19:20.874 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (35m) 4m ago 35m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:19:20.875 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (30m) 4m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:19:20.875 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (30m) 4m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:19:20.875 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (29m) 5m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:19:20.875 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (29m) 5m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:19:20.875 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (29m) 4m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:19:20.876 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (29m) 5m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:19:20.876 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (35m) 5m ago 35m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:19:20.876 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (35m) 4m ago 35m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:19:20.876 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (28m) 5m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:19:20.877 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (27m) 5m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:19:20.877 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (27m) 5m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:19:20.877 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (27m) 5m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:19:20.877 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (26m) 4m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:19:20.878 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (26m) 4m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:19:20.878 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (25m) 4m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:19:20.878 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (25m) 4m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:19:20.878 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (34m) 4m ago 35m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:19:20.878 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 4m ago 33m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:19:21.122 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:19:21.123 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:19:21.123 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:19:21.123 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:19:21.123 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:19:21.124 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:19:21.124 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:19:21.124 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:19:21.124 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:19:21.124 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:19:21.125 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:19:21.125 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:19:21.125 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:19:21.125 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:19:21.126 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:19:21.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:19:21 gibba015 bash[29377]: cluster 2021-03-10T14:19:20.213862+0000 mgr.gibba045.orlgmj (mgr.34412) 1649 : cluster [DBG] pgmap v928: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:21.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:19:21 gibba015 bash[29377]: audit 2021-03-10T14:19:21.120344+0000 mon.c (mon.1) 518 : audit [DBG] from='client.? 172.21.2.115:0/62457977' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:19:21.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:19:21 gibba015 bash[30343]: cluster 2021-03-10T14:19:20.213862+0000 mgr.gibba045.orlgmj (mgr.34412) 1649 : cluster [DBG] pgmap v928: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:21.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:19:21 gibba015 bash[30343]: audit 2021-03-10T14:19:21.120344+0000 mon.c (mon.1) 518 : audit [DBG] from='client.? 172.21.2.115:0/62457977' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:19:21.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:19:21 gibba045 bash[25517]: cluster 2021-03-10T14:19:20.213862+0000 mgr.gibba045.orlgmj (mgr.34412) 1649 : cluster [DBG] pgmap v928: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:21.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:19:21 gibba045 bash[25517]: audit 2021-03-10T14:19:21.120344+0000 mon.c (mon.1) 518 : audit [DBG] from='client.? 172.21.2.115:0/62457977' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:19:22.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:19:22 gibba015 bash[29377]: audit 2021-03-10T14:19:20.635004+0000 mgr.gibba045.orlgmj (mgr.34412) 1650 : audit [DBG] from='client.55156 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:19:22.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:19:22 gibba015 bash[29377]: audit 2021-03-10T14:19:20.861601+0000 mgr.gibba045.orlgmj (mgr.34412) 1651 : audit [DBG] from='client.55162 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:19:22.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:19:22 gibba015 bash[30343]: audit 2021-03-10T14:19:20.635004+0000 mgr.gibba045.orlgmj (mgr.34412) 1650 : audit [DBG] from='client.55156 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:19:22.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:19:22 gibba015 bash[30343]: audit 2021-03-10T14:19:20.861601+0000 mgr.gibba045.orlgmj (mgr.34412) 1651 : audit [DBG] from='client.55162 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:19:22.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:19:22 gibba045 bash[25517]: audit 2021-03-10T14:19:20.635004+0000 mgr.gibba045.orlgmj (mgr.34412) 1650 : audit [DBG] from='client.55156 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:19:22.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:19:22 gibba045 bash[25517]: audit 2021-03-10T14:19:20.861601+0000 mgr.gibba045.orlgmj (mgr.34412) 1651 : audit [DBG] from='client.55162 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:19:23.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:19:23 gibba015 bash[29377]: cluster 2021-03-10T14:19:22.214510+0000 mgr.gibba045.orlgmj (mgr.34412) 1652 : cluster [DBG] pgmap v929: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:23.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:19:23 gibba015 bash[30343]: cluster 2021-03-10T14:19:22.214510+0000 mgr.gibba045.orlgmj (mgr.34412) 1652 : cluster [DBG] pgmap v929: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:23.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:19:23 gibba045 bash[25517]: cluster 2021-03-10T14:19:22.214510+0000 mgr.gibba045.orlgmj (mgr.34412) 1652 : cluster [DBG] pgmap v929: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:25.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:19:25 gibba015 bash[29377]: cluster 2021-03-10T14:19:24.215594+0000 mgr.gibba045.orlgmj (mgr.34412) 1653 : cluster [DBG] pgmap v930: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:25.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:19:25 gibba015 bash[30343]: cluster 2021-03-10T14:19:24.215594+0000 mgr.gibba045.orlgmj (mgr.34412) 1653 : cluster [DBG] pgmap v930: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:25.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:19:25 gibba045 bash[25517]: cluster 2021-03-10T14:19:24.215594+0000 mgr.gibba045.orlgmj (mgr.34412) 1653 : cluster [DBG] pgmap v930: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:27.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:19:27 gibba015 bash[29377]: cluster 2021-03-10T14:19:26.217376+0000 mgr.gibba045.orlgmj (mgr.34412) 1654 : cluster [DBG] pgmap v931: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:27.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:19:27 gibba015 bash[30343]: cluster 2021-03-10T14:19:26.217376+0000 mgr.gibba045.orlgmj (mgr.34412) 1654 : cluster [DBG] pgmap v931: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:27.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:19:27 gibba045 bash[25517]: cluster 2021-03-10T14:19:26.217376+0000 mgr.gibba045.orlgmj (mgr.34412) 1654 : cluster [DBG] pgmap v931: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:29.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:19:29 gibba015 bash[29377]: cluster 2021-03-10T14:19:28.219080+0000 mgr.gibba045.orlgmj (mgr.34412) 1655 : cluster [DBG] pgmap v932: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:29.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:19:29 gibba015 bash[30343]: cluster 2021-03-10T14:19:28.219080+0000 mgr.gibba045.orlgmj (mgr.34412) 1655 : cluster [DBG] pgmap v932: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:29.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:19:29 gibba045 bash[25517]: cluster 2021-03-10T14:19:28.219080+0000 mgr.gibba045.orlgmj (mgr.34412) 1655 : cluster [DBG] pgmap v932: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:31.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:19:31 gibba015 bash[29377]: cluster 2021-03-10T14:19:30.220461+0000 mgr.gibba045.orlgmj (mgr.34412) 1656 : cluster [DBG] pgmap v933: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:31.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:19:31 gibba015 bash[30343]: cluster 2021-03-10T14:19:30.220461+0000 mgr.gibba045.orlgmj (mgr.34412) 1656 : cluster [DBG] pgmap v933: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:31.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:19:31 gibba045 bash[25517]: cluster 2021-03-10T14:19:30.220461+0000 mgr.gibba045.orlgmj (mgr.34412) 1656 : cluster [DBG] pgmap v933: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:33.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:19:33 gibba015 bash[29377]: cluster 2021-03-10T14:19:32.221039+0000 mgr.gibba045.orlgmj (mgr.34412) 1657 : cluster [DBG] pgmap v934: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:33.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:19:33 gibba015 bash[30343]: cluster 2021-03-10T14:19:32.221039+0000 mgr.gibba045.orlgmj (mgr.34412) 1657 : cluster [DBG] pgmap v934: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:33.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:19:33 gibba045 bash[25517]: cluster 2021-03-10T14:19:32.221039+0000 mgr.gibba045.orlgmj (mgr.34412) 1657 : cluster [DBG] pgmap v934: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:34.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:19:34 gibba015 bash[29377]: audit 2021-03-10T14:19:34.135465+0000 mon.c (mon.1) 519 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:19:34.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:19:34 gibba015 bash[30343]: audit 2021-03-10T14:19:34.135465+0000 mon.c (mon.1) 519 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:19:34.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:19:34 gibba045 bash[25517]: audit 2021-03-10T14:19:34.135465+0000 mon.c (mon.1) 519 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:19:35.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:19:35 gibba015 bash[29377]: cephadm 2021-03-10T14:19:34.142786+0000 mgr.gibba045.orlgmj (mgr.34412) 1658 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:19:35.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:19:35 gibba015 bash[29377]: cephadm 2021-03-10T14:19:34.144727+0000 mgr.gibba045.orlgmj (mgr.34412) 1659 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:19:35.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:19:35 gibba015 bash[29377]: cluster 2021-03-10T14:19:34.221369+0000 mgr.gibba045.orlgmj (mgr.34412) 1660 : cluster [DBG] pgmap v935: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:35.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:19:35 gibba015 bash[29377]: audit 2021-03-10T14:19:34.353725+0000 mon.a (mon.0) 790 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:19:35.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:19:35 gibba015 bash[29377]: audit 2021-03-10T14:19:34.357537+0000 mon.c (mon.1) 520 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:19:35.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:19:35 gibba015 bash[29377]: audit 2021-03-10T14:19:34.359018+0000 mon.c (mon.1) 521 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:19:35.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:19:35 gibba015 bash[29377]: cephadm 2021-03-10T14:19:34.359340+0000 mgr.gibba045.orlgmj (mgr.34412) 1661 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:19:35.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:19:35 gibba015 bash[29377]: audit 2021-03-10T14:19:34.360248+0000 mon.c (mon.1) 522 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:19:35.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:19:35 gibba015 bash[29377]: cephadm 2021-03-10T14:19:34.361088+0000 mgr.gibba045.orlgmj (mgr.34412) 1662 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:19:35.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:19:35 gibba015 bash[29377]: audit 2021-03-10T14:19:34.361636+0000 mon.c (mon.1) 523 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:19:35.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:19:35 gibba015 bash[29377]: cephadm 2021-03-10T14:19:34.362286+0000 mgr.gibba045.orlgmj (mgr.34412) 1663 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:19:35.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:19:35 gibba015 bash[29377]: cephadm 2021-03-10T14:19:34.362323+0000 mgr.gibba045.orlgmj (mgr.34412) 1664 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:19:35.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:19:35 gibba015 bash[29377]: cephadm 2021-03-10T14:19:34.363747+0000 mgr.gibba045.orlgmj (mgr.34412) 1665 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:19:35.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:19:35 gibba015 bash[29377]: cephadm 2021-03-10T14:19:34.363784+0000 mgr.gibba045.orlgmj (mgr.34412) 1666 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:19:35.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:19:35 gibba015 bash[29377]: audit 2021-03-10T14:19:34.364817+0000 mon.c (mon.1) 524 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:19:35.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:19:35 gibba015 bash[29377]: cephadm 2021-03-10T14:19:34.364843+0000 mgr.gibba045.orlgmj (mgr.34412) 1667 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:19:35.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:19:35 gibba015 bash[29377]: audit 2021-03-10T14:19:34.366300+0000 mon.c (mon.1) 525 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:19:35.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:19:35 gibba015 bash[29377]: cephadm 2021-03-10T14:19:34.366798+0000 mgr.gibba045.orlgmj (mgr.34412) 1668 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:19:35.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:19:35 gibba015 bash[29377]: cephadm 2021-03-10T14:19:34.366836+0000 mgr.gibba045.orlgmj (mgr.34412) 1669 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:19:35.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:19:35 gibba015 bash[29377]: cephadm 2021-03-10T14:19:34.368049+0000 mgr.gibba045.orlgmj (mgr.34412) 1670 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:19:35.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:19:35 gibba015 bash[30343]: cephadm 2021-03-10T14:19:34.142786+0000 mgr.gibba045.orlgmj (mgr.34412) 1658 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:19:35.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:19:35 gibba015 bash[30343]: cephadm 2021-03-10T14:19:34.144727+0000 mgr.gibba045.orlgmj (mgr.34412) 1659 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:19:35.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:19:35 gibba015 bash[30343]: cluster 2021-03-10T14:19:34.221369+0000 mgr.gibba045.orlgmj (mgr.34412) 1660 : cluster [DBG] pgmap v935: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:35.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:19:35 gibba015 bash[30343]: audit 2021-03-10T14:19:34.353725+0000 mon.a (mon.0) 790 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:19:35.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:19:35 gibba015 bash[30343]: audit 2021-03-10T14:19:34.357537+0000 mon.c (mon.1) 520 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:19:35.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:19:35 gibba015 bash[30343]: audit 2021-03-10T14:19:34.359018+0000 mon.c (mon.1) 521 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:19:35.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:19:35 gibba015 bash[30343]: cephadm 2021-03-10T14:19:34.359340+0000 mgr.gibba045.orlgmj (mgr.34412) 1661 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:19:35.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:19:35 gibba015 bash[30343]: audit 2021-03-10T14:19:34.360248+0000 mon.c (mon.1) 522 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:19:35.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:19:35 gibba015 bash[30343]: cephadm 2021-03-10T14:19:34.361088+0000 mgr.gibba045.orlgmj (mgr.34412) 1662 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:19:35.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:19:35 gibba015 bash[30343]: audit 2021-03-10T14:19:34.361636+0000 mon.c (mon.1) 523 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:19:35.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:19:35 gibba015 bash[30343]: cephadm 2021-03-10T14:19:34.362286+0000 mgr.gibba045.orlgmj (mgr.34412) 1663 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:19:35.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:19:35 gibba015 bash[30343]: cephadm 2021-03-10T14:19:34.362323+0000 mgr.gibba045.orlgmj (mgr.34412) 1664 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:19:35.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:19:35 gibba015 bash[30343]: cephadm 2021-03-10T14:19:34.363747+0000 mgr.gibba045.orlgmj (mgr.34412) 1665 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:19:35.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:19:35 gibba015 bash[30343]: cephadm 2021-03-10T14:19:34.363784+0000 mgr.gibba045.orlgmj (mgr.34412) 1666 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:19:35.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:19:35 gibba015 bash[30343]: audit 2021-03-10T14:19:34.364817+0000 mon.c (mon.1) 524 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:19:35.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:19:35 gibba015 bash[30343]: cephadm 2021-03-10T14:19:34.364843+0000 mgr.gibba045.orlgmj (mgr.34412) 1667 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:19:35.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:19:35 gibba015 bash[30343]: audit 2021-03-10T14:19:34.366300+0000 mon.c (mon.1) 525 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:19:35.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:19:35 gibba015 bash[30343]: cephadm 2021-03-10T14:19:34.366798+0000 mgr.gibba045.orlgmj (mgr.34412) 1668 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:19:35.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:19:35 gibba015 bash[30343]: cephadm 2021-03-10T14:19:34.366836+0000 mgr.gibba045.orlgmj (mgr.34412) 1669 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:19:35.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:19:35 gibba015 bash[30343]: cephadm 2021-03-10T14:19:34.368049+0000 mgr.gibba045.orlgmj (mgr.34412) 1670 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:19:35.732 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:19:35 gibba015 bash[29377]: cephadm 2021-03-10T14:19:34.368437+0000 mgr.gibba045.orlgmj (mgr.34412) 1671 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:19:35.732 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:19:35 gibba015 bash[29377]: cephadm 2021-03-10T14:19:34.369749+0000 mgr.gibba045.orlgmj (mgr.34412) 1672 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:19:35.732 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:19:35 gibba015 bash[29377]: cephadm 2021-03-10T14:19:34.369786+0000 mgr.gibba045.orlgmj (mgr.34412) 1673 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:19:35.732 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:19:35 gibba015 bash[29377]: cephadm 2021-03-10T14:19:34.369891+0000 mgr.gibba045.orlgmj (mgr.34412) 1674 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:19:35.733 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:19:35 gibba015 bash[30343]: cephadm 2021-03-10T14:19:34.368437+0000 mgr.gibba045.orlgmj (mgr.34412) 1671 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:19:35.733 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:19:35 gibba015 bash[30343]: cephadm 2021-03-10T14:19:34.369749+0000 mgr.gibba045.orlgmj (mgr.34412) 1672 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:19:35.733 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:19:35 gibba015 bash[30343]: cephadm 2021-03-10T14:19:34.369786+0000 mgr.gibba045.orlgmj (mgr.34412) 1673 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:19:35.733 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:19:35 gibba015 bash[30343]: cephadm 2021-03-10T14:19:34.369891+0000 mgr.gibba045.orlgmj (mgr.34412) 1674 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:19:35.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:19:35 gibba045 bash[25517]: cephadm 2021-03-10T14:19:34.142786+0000 mgr.gibba045.orlgmj (mgr.34412) 1658 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:19:35.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:19:35 gibba045 bash[25517]: cephadm 2021-03-10T14:19:34.144727+0000 mgr.gibba045.orlgmj (mgr.34412) 1659 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:19:35.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:19:35 gibba045 bash[25517]: cluster 2021-03-10T14:19:34.221369+0000 mgr.gibba045.orlgmj (mgr.34412) 1660 : cluster [DBG] pgmap v935: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:35.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:19:35 gibba045 bash[25517]: audit 2021-03-10T14:19:34.353725+0000 mon.a (mon.0) 790 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:19:35.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:19:35 gibba045 bash[25517]: audit 2021-03-10T14:19:34.357537+0000 mon.c (mon.1) 520 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:19:35.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:19:35 gibba045 bash[25517]: audit 2021-03-10T14:19:34.359018+0000 mon.c (mon.1) 521 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:19:35.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:19:35 gibba045 bash[25517]: cephadm 2021-03-10T14:19:34.359340+0000 mgr.gibba045.orlgmj (mgr.34412) 1661 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:19:35.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:19:35 gibba045 bash[25517]: audit 2021-03-10T14:19:34.360248+0000 mon.c (mon.1) 522 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:19:35.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:19:35 gibba045 bash[25517]: cephadm 2021-03-10T14:19:34.361088+0000 mgr.gibba045.orlgmj (mgr.34412) 1662 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:19:35.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:19:35 gibba045 bash[25517]: audit 2021-03-10T14:19:34.361636+0000 mon.c (mon.1) 523 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:19:35.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:19:35 gibba045 bash[25517]: cephadm 2021-03-10T14:19:34.362286+0000 mgr.gibba045.orlgmj (mgr.34412) 1663 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:19:35.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:19:35 gibba045 bash[25517]: cephadm 2021-03-10T14:19:34.362323+0000 mgr.gibba045.orlgmj (mgr.34412) 1664 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:19:35.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:19:35 gibba045 bash[25517]: cephadm 2021-03-10T14:19:34.363747+0000 mgr.gibba045.orlgmj (mgr.34412) 1665 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:19:35.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:19:35 gibba045 bash[25517]: cephadm 2021-03-10T14:19:34.363784+0000 mgr.gibba045.orlgmj (mgr.34412) 1666 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:19:35.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:19:35 gibba045 bash[25517]: audit 2021-03-10T14:19:34.364817+0000 mon.c (mon.1) 524 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:19:35.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:19:35 gibba045 bash[25517]: cephadm 2021-03-10T14:19:34.364843+0000 mgr.gibba045.orlgmj (mgr.34412) 1667 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:19:35.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:19:35 gibba045 bash[25517]: audit 2021-03-10T14:19:34.366300+0000 mon.c (mon.1) 525 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:19:35.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:19:35 gibba045 bash[25517]: cephadm 2021-03-10T14:19:34.366798+0000 mgr.gibba045.orlgmj (mgr.34412) 1668 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:19:35.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:19:35 gibba045 bash[25517]: cephadm 2021-03-10T14:19:34.366836+0000 mgr.gibba045.orlgmj (mgr.34412) 1669 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:19:35.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:19:35 gibba045 bash[25517]: cephadm 2021-03-10T14:19:34.368049+0000 mgr.gibba045.orlgmj (mgr.34412) 1670 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:19:35.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:19:35 gibba045 bash[25517]: cephadm 2021-03-10T14:19:34.368437+0000 mgr.gibba045.orlgmj (mgr.34412) 1671 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:19:35.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:19:35 gibba045 bash[25517]: cephadm 2021-03-10T14:19:34.369749+0000 mgr.gibba045.orlgmj (mgr.34412) 1672 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:19:35.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:19:35 gibba045 bash[25517]: cephadm 2021-03-10T14:19:34.369786+0000 mgr.gibba045.orlgmj (mgr.34412) 1673 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:19:35.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:19:35 gibba045 bash[25517]: cephadm 2021-03-10T14:19:34.369891+0000 mgr.gibba045.orlgmj (mgr.34412) 1674 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:19:37.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:19:37 gibba015 bash[29377]: cluster 2021-03-10T14:19:36.222732+0000 mgr.gibba045.orlgmj (mgr.34412) 1675 : cluster [DBG] pgmap v936: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:37.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:19:37 gibba015 bash[30343]: cluster 2021-03-10T14:19:36.222732+0000 mgr.gibba045.orlgmj (mgr.34412) 1675 : cluster [DBG] pgmap v936: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:37.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:19:37 gibba045 bash[25517]: cluster 2021-03-10T14:19:36.222732+0000 mgr.gibba045.orlgmj (mgr.34412) 1675 : cluster [DBG] pgmap v936: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:39.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:19:39 gibba015 bash[29377]: cluster 2021-03-10T14:19:38.224584+0000 mgr.gibba045.orlgmj (mgr.34412) 1676 : cluster [DBG] pgmap v937: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:39.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:19:39 gibba015 bash[30343]: cluster 2021-03-10T14:19:38.224584+0000 mgr.gibba045.orlgmj (mgr.34412) 1676 : cluster [DBG] pgmap v937: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:39.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:19:39 gibba045 bash[25517]: cluster 2021-03-10T14:19:38.224584+0000 mgr.gibba045.orlgmj (mgr.34412) 1676 : cluster [DBG] pgmap v937: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:41.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:19:41 gibba015 bash[29377]: cluster 2021-03-10T14:19:40.225917+0000 mgr.gibba045.orlgmj (mgr.34412) 1677 : cluster [DBG] pgmap v938: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:41.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:19:41 gibba015 bash[30343]: cluster 2021-03-10T14:19:40.225917+0000 mgr.gibba045.orlgmj (mgr.34412) 1677 : cluster [DBG] pgmap v938: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:41.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:19:41 gibba045 bash[25517]: cluster 2021-03-10T14:19:40.225917+0000 mgr.gibba045.orlgmj (mgr.34412) 1677 : cluster [DBG] pgmap v938: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:43.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:19:43 gibba015 bash[29377]: cluster 2021-03-10T14:19:42.227537+0000 mgr.gibba045.orlgmj (mgr.34412) 1678 : cluster [DBG] pgmap v939: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:43.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:19:43 gibba015 bash[30343]: cluster 2021-03-10T14:19:42.227537+0000 mgr.gibba045.orlgmj (mgr.34412) 1678 : cluster [DBG] pgmap v939: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:43.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:19:43 gibba045 bash[25517]: cluster 2021-03-10T14:19:42.227537+0000 mgr.gibba045.orlgmj (mgr.34412) 1678 : cluster [DBG] pgmap v939: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:45.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:19:45 gibba045 bash[25517]: cluster 2021-03-10T14:19:44.228806+0000 mgr.gibba045.orlgmj (mgr.34412) 1679 : cluster [DBG] pgmap v940: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:45.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:19:45 gibba015 bash[29377]: cluster 2021-03-10T14:19:44.228806+0000 mgr.gibba045.orlgmj (mgr.34412) 1679 : cluster [DBG] pgmap v940: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:45.754 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:19:45 gibba015 bash[30343]: cluster 2021-03-10T14:19:44.228806+0000 mgr.gibba045.orlgmj (mgr.34412) 1679 : cluster [DBG] pgmap v940: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:47.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:19:47 gibba045 bash[25517]: cluster 2021-03-10T14:19:46.230540+0000 mgr.gibba045.orlgmj (mgr.34412) 1680 : cluster [DBG] pgmap v941: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:47.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:19:47 gibba015 bash[29377]: cluster 2021-03-10T14:19:46.230540+0000 mgr.gibba045.orlgmj (mgr.34412) 1680 : cluster [DBG] pgmap v941: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:47.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:19:47 gibba015 bash[30343]: cluster 2021-03-10T14:19:46.230540+0000 mgr.gibba045.orlgmj (mgr.34412) 1680 : cluster [DBG] pgmap v941: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:49.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:19:49 gibba015 bash[29377]: cluster 2021-03-10T14:19:48.232143+0000 mgr.gibba045.orlgmj (mgr.34412) 1681 : cluster [DBG] pgmap v942: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:49.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:19:49 gibba015 bash[30343]: cluster 2021-03-10T14:19:48.232143+0000 mgr.gibba045.orlgmj (mgr.34412) 1681 : cluster [DBG] pgmap v942: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:49.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:19:49 gibba045 bash[25517]: cluster 2021-03-10T14:19:48.232143+0000 mgr.gibba045.orlgmj (mgr.34412) 1681 : cluster [DBG] pgmap v942: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:50.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:19:50 gibba015 bash[29377]: cephadm 2021-03-10T14:19:49.385623+0000 mgr.gibba045.orlgmj (mgr.34412) 1682 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:19:50.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:19:50 gibba015 bash[30343]: cephadm 2021-03-10T14:19:49.385623+0000 mgr.gibba045.orlgmj (mgr.34412) 1682 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:19:50.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:19:50 gibba045 bash[25517]: cephadm 2021-03-10T14:19:49.385623+0000 mgr.gibba045.orlgmj (mgr.34412) 1682 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:19:51.364 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:19:51.593 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:19:51.594 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (30m) 6m ago 35m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:19:51.594 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (35m) 5m ago 35m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:19:51.594 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (31m) 5m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:19:51.595 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (31m) 5m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:19:51.595 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (30m) 6m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:19:51.595 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (30m) 6m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:19:51.595 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (29m) 5m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:19:51.595 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (29m) 6m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:19:51.596 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (36m) 6m ago 36m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:19:51.596 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (36m) 5m ago 36m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:19:51.596 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (28m) 6m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:19:51.596 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (28m) 6m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:19:51.597 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (28m) 6m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:19:51.597 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (27m) 6m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:19:51.597 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (27m) 5m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:19:51.597 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (26m) 5m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:19:51.597 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (26m) 5m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:19:51.598 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (25m) 5m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:19:51.598 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (35m) 5m ago 36m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:19:51.598 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 5m ago 34m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:19:51.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:19:51 gibba015 bash[29377]: cluster 2021-03-10T14:19:50.233874+0000 mgr.gibba045.orlgmj (mgr.34412) 1683 : cluster [DBG] pgmap v943: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:51.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:19:51 gibba015 bash[30343]: cluster 2021-03-10T14:19:50.233874+0000 mgr.gibba045.orlgmj (mgr.34412) 1683 : cluster [DBG] pgmap v943: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:51.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:19:51 gibba045 bash[25517]: cluster 2021-03-10T14:19:50.233874+0000 mgr.gibba045.orlgmj (mgr.34412) 1683 : cluster [DBG] pgmap v943: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:51.844 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:19:51.844 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:19:51.844 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:19:51.844 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:19:51.845 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:19:51.845 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:19:51.845 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:19:51.845 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:19:51.846 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:19:51.846 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:19:51.846 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:19:51.846 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:19:51.846 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:19:51.847 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:19:51.847 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:19:52.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:19:52 gibba015 bash[29377]: audit 2021-03-10T14:19:51.356670+0000 mgr.gibba045.orlgmj (mgr.34412) 1684 : audit [DBG] from='client.45186 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:19:52.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:19:52 gibba015 bash[29377]: audit 2021-03-10T14:19:51.842041+0000 mon.a (mon.0) 791 : audit [DBG] from='client.? 172.21.2.115:0/3244012866' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:19:52.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:19:52 gibba015 bash[30343]: audit 2021-03-10T14:19:51.356670+0000 mgr.gibba045.orlgmj (mgr.34412) 1684 : audit [DBG] from='client.45186 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:19:52.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:19:52 gibba015 bash[30343]: audit 2021-03-10T14:19:51.842041+0000 mon.a (mon.0) 791 : audit [DBG] from='client.? 172.21.2.115:0/3244012866' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:19:52.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:19:52 gibba045 bash[25517]: audit 2021-03-10T14:19:51.356670+0000 mgr.gibba045.orlgmj (mgr.34412) 1684 : audit [DBG] from='client.45186 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:19:52.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:19:52 gibba045 bash[25517]: audit 2021-03-10T14:19:51.842041+0000 mon.a (mon.0) 791 : audit [DBG] from='client.? 172.21.2.115:0/3244012866' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:19:53.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:19:53 gibba015 bash[29377]: audit 2021-03-10T14:19:51.581363+0000 mgr.gibba045.orlgmj (mgr.34412) 1685 : audit [DBG] from='client.45192 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:19:53.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:19:53 gibba015 bash[29377]: cluster 2021-03-10T14:19:52.235495+0000 mgr.gibba045.orlgmj (mgr.34412) 1686 : cluster [DBG] pgmap v944: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:53.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:19:53 gibba015 bash[29377]: audit 2021-03-10T14:19:52.635102+0000 mon.c (mon.1) 526 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:19:53.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:19:53 gibba015 bash[29377]: audit 2021-03-10T14:19:52.635794+0000 mon.c (mon.1) 527 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:19:53.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:19:53 gibba015 bash[29377]: audit 2021-03-10T14:19:52.636309+0000 mon.a (mon.0) 792 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:19:53.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:19:53 gibba015 bash[29377]: audit 2021-03-10T14:19:52.636450+0000 mon.c (mon.1) 528 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T14:19:53.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:19:53 gibba015 bash[29377]: audit 2021-03-10T14:19:52.637307+0000 mon.c (mon.1) 529 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:19:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:19:53 gibba015 bash[29377]: audit 2021-03-10T14:19:52.637387+0000 mon.a (mon.0) 793 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:19:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:19:53 gibba015 bash[29377]: audit 2021-03-10T14:19:52.638012+0000 mon.c (mon.1) 530 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:19:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:19:53 gibba015 bash[29377]: audit 2021-03-10T14:19:52.638278+0000 mon.a (mon.0) 794 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T14:19:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:19:53 gibba015 bash[29377]: audit 2021-03-10T14:19:52.638843+0000 mon.c (mon.1) 531 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:19:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:19:53 gibba015 bash[29377]: audit 2021-03-10T14:19:52.639714+0000 mon.a (mon.0) 795 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:19:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:19:53 gibba015 bash[29377]: audit 2021-03-10T14:19:52.639912+0000 mon.a (mon.0) 796 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:19:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:19:53 gibba015 bash[29377]: audit 2021-03-10T14:19:52.640154+0000 mon.a (mon.0) 797 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:19:53.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:19:53 gibba015 bash[30343]: audit 2021-03-10T14:19:51.581363+0000 mgr.gibba045.orlgmj (mgr.34412) 1685 : audit [DBG] from='client.45192 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:19:53.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:19:53 gibba015 bash[30343]: cluster 2021-03-10T14:19:52.235495+0000 mgr.gibba045.orlgmj (mgr.34412) 1686 : cluster [DBG] pgmap v944: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:53.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:19:53 gibba015 bash[30343]: audit 2021-03-10T14:19:52.635102+0000 mon.c (mon.1) 526 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:19:53.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:19:53 gibba015 bash[30343]: audit 2021-03-10T14:19:52.635794+0000 mon.c (mon.1) 527 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:19:53.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:19:53 gibba015 bash[30343]: audit 2021-03-10T14:19:52.636309+0000 mon.a (mon.0) 792 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:19:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:19:53 gibba015 bash[30343]: audit 2021-03-10T14:19:52.636450+0000 mon.c (mon.1) 528 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T14:19:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:19:53 gibba015 bash[30343]: audit 2021-03-10T14:19:52.637307+0000 mon.c (mon.1) 529 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:19:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:19:53 gibba015 bash[30343]: audit 2021-03-10T14:19:52.637387+0000 mon.a (mon.0) 793 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:19:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:19:53 gibba015 bash[30343]: audit 2021-03-10T14:19:52.638012+0000 mon.c (mon.1) 530 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:19:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:19:53 gibba015 bash[30343]: audit 2021-03-10T14:19:52.638278+0000 mon.a (mon.0) 794 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T14:19:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:19:53 gibba015 bash[30343]: audit 2021-03-10T14:19:52.638843+0000 mon.c (mon.1) 531 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:19:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:19:53 gibba015 bash[30343]: audit 2021-03-10T14:19:52.639714+0000 mon.a (mon.0) 795 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:19:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:19:53 gibba015 bash[30343]: audit 2021-03-10T14:19:52.639912+0000 mon.a (mon.0) 796 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:19:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:19:53 gibba015 bash[30343]: audit 2021-03-10T14:19:52.640154+0000 mon.a (mon.0) 797 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:19:53.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:19:53 gibba045 bash[25517]: audit 2021-03-10T14:19:51.581363+0000 mgr.gibba045.orlgmj (mgr.34412) 1685 : audit [DBG] from='client.45192 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:19:53.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:19:53 gibba045 bash[25517]: cluster 2021-03-10T14:19:52.235495+0000 mgr.gibba045.orlgmj (mgr.34412) 1686 : cluster [DBG] pgmap v944: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:19:53 gibba045 bash[25517]: audit 2021-03-10T14:19:52.635102+0000 mon.c (mon.1) 526 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:19:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:19:53 gibba045 bash[25517]: audit 2021-03-10T14:19:52.635794+0000 mon.c (mon.1) 527 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:19:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:19:53 gibba045 bash[25517]: audit 2021-03-10T14:19:52.636309+0000 mon.a (mon.0) 792 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:19:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:19:53 gibba045 bash[25517]: audit 2021-03-10T14:19:52.636450+0000 mon.c (mon.1) 528 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T14:19:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:19:53 gibba045 bash[25517]: audit 2021-03-10T14:19:52.637307+0000 mon.c (mon.1) 529 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:19:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:19:53 gibba045 bash[25517]: audit 2021-03-10T14:19:52.637387+0000 mon.a (mon.0) 793 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:19:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:19:53 gibba045 bash[25517]: audit 2021-03-10T14:19:52.638012+0000 mon.c (mon.1) 530 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:19:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:19:53 gibba045 bash[25517]: audit 2021-03-10T14:19:52.638278+0000 mon.a (mon.0) 794 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T14:19:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:19:53 gibba045 bash[25517]: audit 2021-03-10T14:19:52.638843+0000 mon.c (mon.1) 531 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:19:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:19:53 gibba045 bash[25517]: audit 2021-03-10T14:19:52.639714+0000 mon.a (mon.0) 795 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:19:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:19:53 gibba045 bash[25517]: audit 2021-03-10T14:19:52.639912+0000 mon.a (mon.0) 796 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:19:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:19:53 gibba045 bash[25517]: audit 2021-03-10T14:19:52.640154+0000 mon.a (mon.0) 797 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:19:55.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:19:55 gibba015 bash[29377]: cluster 2021-03-10T14:19:54.236923+0000 mgr.gibba045.orlgmj (mgr.34412) 1687 : cluster [DBG] pgmap v945: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:55.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:19:55 gibba015 bash[30343]: cluster 2021-03-10T14:19:54.236923+0000 mgr.gibba045.orlgmj (mgr.34412) 1687 : cluster [DBG] pgmap v945: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:55.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:19:55 gibba045 bash[25517]: cluster 2021-03-10T14:19:54.236923+0000 mgr.gibba045.orlgmj (mgr.34412) 1687 : cluster [DBG] pgmap v945: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:57.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:19:57 gibba015 bash[29377]: cluster 2021-03-10T14:19:56.238660+0000 mgr.gibba045.orlgmj (mgr.34412) 1688 : cluster [DBG] pgmap v946: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:57.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:19:57 gibba015 bash[30343]: cluster 2021-03-10T14:19:56.238660+0000 mgr.gibba045.orlgmj (mgr.34412) 1688 : cluster [DBG] pgmap v946: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:57.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:19:57 gibba045 bash[25517]: cluster 2021-03-10T14:19:56.238660+0000 mgr.gibba045.orlgmj (mgr.34412) 1688 : cluster [DBG] pgmap v946: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:59.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:19:59 gibba015 bash[29377]: cluster 2021-03-10T14:19:58.240355+0000 mgr.gibba045.orlgmj (mgr.34412) 1689 : cluster [DBG] pgmap v947: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:59.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:19:59 gibba015 bash[30343]: cluster 2021-03-10T14:19:58.240355+0000 mgr.gibba045.orlgmj (mgr.34412) 1689 : cluster [DBG] pgmap v947: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:59.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:19:59 gibba045 bash[25517]: cluster 2021-03-10T14:19:58.240355+0000 mgr.gibba045.orlgmj (mgr.34412) 1689 : cluster [DBG] pgmap v947: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:00.370 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:00 gibba015 bash[29377]: debug 2021-03-10T14:19:59.996+0000 7f21beb4f700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T14:20:00.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:00 gibba015 bash[29377]: cluster 2021-03-10T14:20:00.000227+0000 mon.a (mon.0) 798 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T14:20:00.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:20:00 gibba015 bash[30343]: cluster 2021-03-10T14:20:00.000227+0000 mon.a (mon.0) 798 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T14:20:00.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:20:00 gibba045 bash[25517]: cluster 2021-03-10T14:20:00.000227+0000 mon.a (mon.0) 798 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T14:20:01.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:01 gibba015 bash[29377]: cluster 2021-03-10T14:20:00.241946+0000 mgr.gibba045.orlgmj (mgr.34412) 1690 : cluster [DBG] pgmap v948: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:01.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:20:01 gibba015 bash[30343]: cluster 2021-03-10T14:20:00.241946+0000 mgr.gibba045.orlgmj (mgr.34412) 1690 : cluster [DBG] pgmap v948: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:01.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:20:01 gibba045 bash[25517]: cluster 2021-03-10T14:20:00.241946+0000 mgr.gibba045.orlgmj (mgr.34412) 1690 : cluster [DBG] pgmap v948: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:03.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:20:03 gibba045 bash[25517]: cluster 2021-03-10T14:20:02.242883+0000 mgr.gibba045.orlgmj (mgr.34412) 1691 : cluster [DBG] pgmap v949: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:03.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:03 gibba015 bash[29377]: cluster 2021-03-10T14:20:02.242883+0000 mgr.gibba045.orlgmj (mgr.34412) 1691 : cluster [DBG] pgmap v949: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:03.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:20:03 gibba015 bash[30343]: cluster 2021-03-10T14:20:02.242883+0000 mgr.gibba045.orlgmj (mgr.34412) 1691 : cluster [DBG] pgmap v949: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:05.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:05 gibba015 bash[29377]: cluster 2021-03-10T14:20:04.243983+0000 mgr.gibba045.orlgmj (mgr.34412) 1692 : cluster [DBG] pgmap v950: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:05.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:05 gibba015 bash[29377]: cephadm 2021-03-10T14:20:04.397308+0000 mgr.gibba045.orlgmj (mgr.34412) 1693 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:20:05.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:20:05 gibba015 bash[30343]: cluster 2021-03-10T14:20:04.243983+0000 mgr.gibba045.orlgmj (mgr.34412) 1692 : cluster [DBG] pgmap v950: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:05.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:20:05 gibba015 bash[30343]: cephadm 2021-03-10T14:20:04.397308+0000 mgr.gibba045.orlgmj (mgr.34412) 1693 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:20:05.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:20:05 gibba045 bash[25517]: cluster 2021-03-10T14:20:04.243983+0000 mgr.gibba045.orlgmj (mgr.34412) 1692 : cluster [DBG] pgmap v950: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:05.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:20:05 gibba045 bash[25517]: cephadm 2021-03-10T14:20:04.397308+0000 mgr.gibba045.orlgmj (mgr.34412) 1693 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:20:07.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:07 gibba015 bash[29377]: cluster 2021-03-10T14:20:06.245775+0000 mgr.gibba045.orlgmj (mgr.34412) 1694 : cluster [DBG] pgmap v951: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:07.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:20:07 gibba015 bash[30343]: cluster 2021-03-10T14:20:06.245775+0000 mgr.gibba045.orlgmj (mgr.34412) 1694 : cluster [DBG] pgmap v951: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:07.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:20:07 gibba045 bash[25517]: cluster 2021-03-10T14:20:06.245775+0000 mgr.gibba045.orlgmj (mgr.34412) 1694 : cluster [DBG] pgmap v951: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:09.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:09 gibba015 bash[29377]: cluster 2021-03-10T14:20:08.247457+0000 mgr.gibba045.orlgmj (mgr.34412) 1695 : cluster [DBG] pgmap v952: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:09.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:20:09 gibba015 bash[30343]: cluster 2021-03-10T14:20:08.247457+0000 mgr.gibba045.orlgmj (mgr.34412) 1695 : cluster [DBG] pgmap v952: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:09.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:20:09 gibba045 bash[25517]: cluster 2021-03-10T14:20:08.247457+0000 mgr.gibba045.orlgmj (mgr.34412) 1695 : cluster [DBG] pgmap v952: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:11.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:11 gibba015 bash[29377]: cluster 2021-03-10T14:20:10.249147+0000 mgr.gibba045.orlgmj (mgr.34412) 1696 : cluster [DBG] pgmap v953: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:11.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:20:11 gibba015 bash[30343]: cluster 2021-03-10T14:20:10.249147+0000 mgr.gibba045.orlgmj (mgr.34412) 1696 : cluster [DBG] pgmap v953: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:11.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:20:11 gibba045 bash[25517]: cluster 2021-03-10T14:20:10.249147+0000 mgr.gibba045.orlgmj (mgr.34412) 1696 : cluster [DBG] pgmap v953: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:13.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:20:13 gibba045 bash[25517]: cluster 2021-03-10T14:20:12.250035+0000 mgr.gibba045.orlgmj (mgr.34412) 1697 : cluster [DBG] pgmap v954: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:13.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:13 gibba015 bash[29377]: cluster 2021-03-10T14:20:12.250035+0000 mgr.gibba045.orlgmj (mgr.34412) 1697 : cluster [DBG] pgmap v954: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:13.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:20:13 gibba015 bash[30343]: cluster 2021-03-10T14:20:12.250035+0000 mgr.gibba045.orlgmj (mgr.34412) 1697 : cluster [DBG] pgmap v954: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:15.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:15 gibba015 bash[29377]: cluster 2021-03-10T14:20:14.251188+0000 mgr.gibba045.orlgmj (mgr.34412) 1698 : cluster [DBG] pgmap v955: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:15.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:20:15 gibba015 bash[30343]: cluster 2021-03-10T14:20:14.251188+0000 mgr.gibba045.orlgmj (mgr.34412) 1698 : cluster [DBG] pgmap v955: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:15.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:20:15 gibba045 bash[25517]: cluster 2021-03-10T14:20:14.251188+0000 mgr.gibba045.orlgmj (mgr.34412) 1698 : cluster [DBG] pgmap v955: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:17.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:17 gibba015 bash[29377]: cluster 2021-03-10T14:20:16.253040+0000 mgr.gibba045.orlgmj (mgr.34412) 1699 : cluster [DBG] pgmap v956: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:17.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:20:17 gibba015 bash[30343]: cluster 2021-03-10T14:20:16.253040+0000 mgr.gibba045.orlgmj (mgr.34412) 1699 : cluster [DBG] pgmap v956: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:17.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:20:17 gibba045 bash[25517]: cluster 2021-03-10T14:20:16.253040+0000 mgr.gibba045.orlgmj (mgr.34412) 1699 : cluster [DBG] pgmap v956: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:19.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:19 gibba015 bash[29377]: cluster 2021-03-10T14:20:18.254525+0000 mgr.gibba045.orlgmj (mgr.34412) 1700 : cluster [DBG] pgmap v957: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:19.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:20:19 gibba015 bash[30343]: cluster 2021-03-10T14:20:18.254525+0000 mgr.gibba045.orlgmj (mgr.34412) 1700 : cluster [DBG] pgmap v957: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:19.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:20:19 gibba045 bash[25517]: cluster 2021-03-10T14:20:18.254525+0000 mgr.gibba045.orlgmj (mgr.34412) 1700 : cluster [DBG] pgmap v957: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:20.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:20 gibba015 bash[29377]: cephadm 2021-03-10T14:20:19.413009+0000 mgr.gibba045.orlgmj (mgr.34412) 1701 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:20:20.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:20:20 gibba015 bash[30343]: cephadm 2021-03-10T14:20:19.413009+0000 mgr.gibba045.orlgmj (mgr.34412) 1701 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:20:20.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:20:20 gibba045 bash[25517]: cephadm 2021-03-10T14:20:19.413009+0000 mgr.gibba045.orlgmj (mgr.34412) 1701 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:20:21.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:21 gibba015 bash[29377]: cluster 2021-03-10T14:20:20.256175+0000 mgr.gibba045.orlgmj (mgr.34412) 1702 : cluster [DBG] pgmap v958: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:21.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:20:21 gibba015 bash[30343]: cluster 2021-03-10T14:20:20.256175+0000 mgr.gibba045.orlgmj (mgr.34412) 1702 : cluster [DBG] pgmap v958: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:21.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:20:21 gibba045 bash[25517]: cluster 2021-03-10T14:20:20.256175+0000 mgr.gibba045.orlgmj (mgr.34412) 1702 : cluster [DBG] pgmap v958: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:22.088 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:20:22.311 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:20:22.312 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (31m) 6m ago 36m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:20:22.312 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (36m) 5m ago 36m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:20:22.312 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (31m) 5m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:20:22.312 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (31m) 5m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:20:22.313 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (30m) 6m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:20:22.313 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (30m) 6m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:20:22.313 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (30m) 5m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:20:22.313 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (30m) 6m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:20:22.313 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (36m) 6m ago 36m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:20:22.314 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (36m) 5m ago 36m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:20:22.314 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (29m) 6m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:20:22.314 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (28m) 6m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:20:22.314 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (28m) 6m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:20:22.315 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (28m) 6m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:20:22.315 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (27m) 5m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:20:22.315 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (27m) 5m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:20:22.315 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (26m) 5m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:20:22.316 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (26m) 5m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:20:22.316 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (35m) 5m ago 36m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:20:22.316 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 5m ago 34m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:20:22.563 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:20:22.563 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:20:22.563 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:20:22.563 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:20:22.564 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:20:22.564 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:20:22.564 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:20:22.564 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:20:22.564 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:20:22.565 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:20:22.565 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:20:22.565 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:20:22.565 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:20:22.565 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:20:22.566 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:20:23.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:20:23 gibba045 bash[25517]: audit 2021-03-10T14:20:22.080076+0000 mgr.gibba045.orlgmj (mgr.34412) 1703 : audit [DBG] from='client.55192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:20:23.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:20:23 gibba045 bash[25517]: cluster 2021-03-10T14:20:22.256960+0000 mgr.gibba045.orlgmj (mgr.34412) 1704 : cluster [DBG] pgmap v959: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:23.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:20:23 gibba045 bash[25517]: audit 2021-03-10T14:20:22.300864+0000 mgr.gibba045.orlgmj (mgr.34412) 1705 : audit [DBG] from='client.45210 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:20:23.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:20:23 gibba045 bash[25517]: audit 2021-03-10T14:20:22.560686+0000 mon.c (mon.1) 532 : audit [DBG] from='client.? 172.21.2.115:0/215730643' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:20:23.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:23 gibba015 bash[29377]: audit 2021-03-10T14:20:22.080076+0000 mgr.gibba045.orlgmj (mgr.34412) 1703 : audit [DBG] from='client.55192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:20:23.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:23 gibba015 bash[29377]: cluster 2021-03-10T14:20:22.256960+0000 mgr.gibba045.orlgmj (mgr.34412) 1704 : cluster [DBG] pgmap v959: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:23.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:23 gibba015 bash[29377]: audit 2021-03-10T14:20:22.300864+0000 mgr.gibba045.orlgmj (mgr.34412) 1705 : audit [DBG] from='client.45210 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:20:23.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:23 gibba015 bash[29377]: audit 2021-03-10T14:20:22.560686+0000 mon.c (mon.1) 532 : audit [DBG] from='client.? 172.21.2.115:0/215730643' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:20:23.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:20:23 gibba015 bash[30343]: audit 2021-03-10T14:20:22.080076+0000 mgr.gibba045.orlgmj (mgr.34412) 1703 : audit [DBG] from='client.55192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:20:23.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:20:23 gibba015 bash[30343]: cluster 2021-03-10T14:20:22.256960+0000 mgr.gibba045.orlgmj (mgr.34412) 1704 : cluster [DBG] pgmap v959: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:23.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:20:23 gibba015 bash[30343]: audit 2021-03-10T14:20:22.300864+0000 mgr.gibba045.orlgmj (mgr.34412) 1705 : audit [DBG] from='client.45210 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:20:23.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:20:23 gibba015 bash[30343]: audit 2021-03-10T14:20:22.560686+0000 mon.c (mon.1) 532 : audit [DBG] from='client.? 172.21.2.115:0/215730643' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:20:25.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:25 gibba015 bash[29377]: cluster 2021-03-10T14:20:24.258377+0000 mgr.gibba045.orlgmj (mgr.34412) 1706 : cluster [DBG] pgmap v960: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:25.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:20:25 gibba015 bash[30343]: cluster 2021-03-10T14:20:24.258377+0000 mgr.gibba045.orlgmj (mgr.34412) 1706 : cluster [DBG] pgmap v960: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:25.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:20:25 gibba045 bash[25517]: cluster 2021-03-10T14:20:24.258377+0000 mgr.gibba045.orlgmj (mgr.34412) 1706 : cluster [DBG] pgmap v960: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:27.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:27 gibba015 bash[29377]: cluster 2021-03-10T14:20:26.260029+0000 mgr.gibba045.orlgmj (mgr.34412) 1707 : cluster [DBG] pgmap v961: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:27.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:20:27 gibba015 bash[30343]: cluster 2021-03-10T14:20:26.260029+0000 mgr.gibba045.orlgmj (mgr.34412) 1707 : cluster [DBG] pgmap v961: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:27.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:20:27 gibba045 bash[25517]: cluster 2021-03-10T14:20:26.260029+0000 mgr.gibba045.orlgmj (mgr.34412) 1707 : cluster [DBG] pgmap v961: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:29.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:29 gibba015 bash[29377]: cluster 2021-03-10T14:20:28.261443+0000 mgr.gibba045.orlgmj (mgr.34412) 1708 : cluster [DBG] pgmap v962: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:29.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:20:29 gibba015 bash[30343]: cluster 2021-03-10T14:20:28.261443+0000 mgr.gibba045.orlgmj (mgr.34412) 1708 : cluster [DBG] pgmap v962: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:29.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:20:29 gibba045 bash[25517]: cluster 2021-03-10T14:20:28.261443+0000 mgr.gibba045.orlgmj (mgr.34412) 1708 : cluster [DBG] pgmap v962: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:31.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:31 gibba015 bash[29377]: cluster 2021-03-10T14:20:30.263044+0000 mgr.gibba045.orlgmj (mgr.34412) 1709 : cluster [DBG] pgmap v963: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:31.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:20:31 gibba015 bash[30343]: cluster 2021-03-10T14:20:30.263044+0000 mgr.gibba045.orlgmj (mgr.34412) 1709 : cluster [DBG] pgmap v963: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:31.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:20:31 gibba045 bash[25517]: cluster 2021-03-10T14:20:30.263044+0000 mgr.gibba045.orlgmj (mgr.34412) 1709 : cluster [DBG] pgmap v963: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:33.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:20:33 gibba045 bash[25517]: cluster 2021-03-10T14:20:32.263854+0000 mgr.gibba045.orlgmj (mgr.34412) 1710 : cluster [DBG] pgmap v964: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:33.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:33 gibba015 bash[29377]: cluster 2021-03-10T14:20:32.263854+0000 mgr.gibba045.orlgmj (mgr.34412) 1710 : cluster [DBG] pgmap v964: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:33.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:20:33 gibba015 bash[30343]: cluster 2021-03-10T14:20:32.263854+0000 mgr.gibba045.orlgmj (mgr.34412) 1710 : cluster [DBG] pgmap v964: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:35.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:35 gibba015 bash[29377]: cluster 2021-03-10T14:20:34.265120+0000 mgr.gibba045.orlgmj (mgr.34412) 1711 : cluster [DBG] pgmap v965: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:35.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:35 gibba015 bash[29377]: audit 2021-03-10T14:20:34.426981+0000 mon.c (mon.1) 533 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:20:35.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:35 gibba015 bash[29377]: audit 2021-03-10T14:20:34.637058+0000 mon.a (mon.0) 799 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:20:35.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:35 gibba015 bash[29377]: audit 2021-03-10T14:20:34.645969+0000 mon.a (mon.0) 800 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:20:35.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:35 gibba015 bash[29377]: audit 2021-03-10T14:20:34.835311+0000 mon.a (mon.0) 801 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:20:35.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:35 gibba015 bash[29377]: audit 2021-03-10T14:20:34.839334+0000 mon.c (mon.1) 534 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:20:35.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:35 gibba015 bash[29377]: audit 2021-03-10T14:20:34.840953+0000 mon.c (mon.1) 535 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:20:35.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:35 gibba015 bash[29377]: audit 2021-03-10T14:20:34.842328+0000 mon.c (mon.1) 536 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:20:35.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:35 gibba015 bash[29377]: audit 2021-03-10T14:20:34.843658+0000 mon.c (mon.1) 537 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:20:35.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:35 gibba015 bash[29377]: audit 2021-03-10T14:20:34.846427+0000 mon.c (mon.1) 538 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:20:35.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:35 gibba015 bash[29377]: audit 2021-03-10T14:20:34.847948+0000 mon.c (mon.1) 539 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:20:35.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:20:35 gibba015 bash[30343]: cluster 2021-03-10T14:20:34.265120+0000 mgr.gibba045.orlgmj (mgr.34412) 1711 : cluster [DBG] pgmap v965: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:35.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:20:35 gibba015 bash[30343]: audit 2021-03-10T14:20:34.426981+0000 mon.c (mon.1) 533 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:20:35.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:20:35 gibba015 bash[30343]: audit 2021-03-10T14:20:34.637058+0000 mon.a (mon.0) 799 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:20:35.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:20:35 gibba015 bash[30343]: audit 2021-03-10T14:20:34.645969+0000 mon.a (mon.0) 800 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:20:35.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:20:35 gibba015 bash[30343]: audit 2021-03-10T14:20:34.835311+0000 mon.a (mon.0) 801 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:20:35.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:20:35 gibba015 bash[30343]: audit 2021-03-10T14:20:34.839334+0000 mon.c (mon.1) 534 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:20:35.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:20:35 gibba015 bash[30343]: audit 2021-03-10T14:20:34.840953+0000 mon.c (mon.1) 535 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:20:35.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:20:35 gibba015 bash[30343]: audit 2021-03-10T14:20:34.842328+0000 mon.c (mon.1) 536 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:20:35.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:20:35 gibba015 bash[30343]: audit 2021-03-10T14:20:34.843658+0000 mon.c (mon.1) 537 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:20:35.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:20:35 gibba015 bash[30343]: audit 2021-03-10T14:20:34.846427+0000 mon.c (mon.1) 538 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:20:35.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:20:35 gibba015 bash[30343]: audit 2021-03-10T14:20:34.847948+0000 mon.c (mon.1) 539 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:20:35.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:20:35 gibba045 bash[25517]: cluster 2021-03-10T14:20:34.265120+0000 mgr.gibba045.orlgmj (mgr.34412) 1711 : cluster [DBG] pgmap v965: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:35.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:20:35 gibba045 bash[25517]: audit 2021-03-10T14:20:34.426981+0000 mon.c (mon.1) 533 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:20:35.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:20:35 gibba045 bash[25517]: audit 2021-03-10T14:20:34.637058+0000 mon.a (mon.0) 799 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:20:35.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:20:35 gibba045 bash[25517]: audit 2021-03-10T14:20:34.645969+0000 mon.a (mon.0) 800 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:20:35.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:20:35 gibba045 bash[25517]: audit 2021-03-10T14:20:34.835311+0000 mon.a (mon.0) 801 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:20:35.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:20:35 gibba045 bash[25517]: audit 2021-03-10T14:20:34.839334+0000 mon.c (mon.1) 534 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:20:35.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:20:35 gibba045 bash[25517]: audit 2021-03-10T14:20:34.840953+0000 mon.c (mon.1) 535 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:20:35.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:20:35 gibba045 bash[25517]: audit 2021-03-10T14:20:34.842328+0000 mon.c (mon.1) 536 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:20:35.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:20:35 gibba045 bash[25517]: audit 2021-03-10T14:20:34.843658+0000 mon.c (mon.1) 537 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:20:35.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:20:35 gibba045 bash[25517]: audit 2021-03-10T14:20:34.846427+0000 mon.c (mon.1) 538 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:20:35.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:20:35 gibba045 bash[25517]: audit 2021-03-10T14:20:34.847948+0000 mon.c (mon.1) 539 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:20:36.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:36 gibba015 bash[29377]: cephadm 2021-03-10T14:20:34.640847+0000 mgr.gibba045.orlgmj (mgr.34412) 1712 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:20:36.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:36 gibba015 bash[29377]: cephadm 2021-03-10T14:20:34.649770+0000 mgr.gibba045.orlgmj (mgr.34412) 1713 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:20:36.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:36 gibba015 bash[29377]: cephadm 2021-03-10T14:20:34.841208+0000 mgr.gibba045.orlgmj (mgr.34412) 1714 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:20:36.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:36 gibba015 bash[29377]: cephadm 2021-03-10T14:20:34.843177+0000 mgr.gibba045.orlgmj (mgr.34412) 1715 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:20:36.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:36 gibba015 bash[29377]: cephadm 2021-03-10T14:20:34.844434+0000 mgr.gibba045.orlgmj (mgr.34412) 1716 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:20:36.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:36 gibba015 bash[29377]: cephadm 2021-03-10T14:20:34.844575+0000 mgr.gibba045.orlgmj (mgr.34412) 1717 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:20:36.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:36 gibba015 bash[29377]: cephadm 2021-03-10T14:20:34.845937+0000 mgr.gibba045.orlgmj (mgr.34412) 1718 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:20:36.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:36 gibba015 bash[29377]: cephadm 2021-03-10T14:20:34.845975+0000 mgr.gibba045.orlgmj (mgr.34412) 1719 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:20:36.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:36 gibba015 bash[29377]: cephadm 2021-03-10T14:20:34.847162+0000 mgr.gibba045.orlgmj (mgr.34412) 1720 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:20:36.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:36 gibba015 bash[29377]: cephadm 2021-03-10T14:20:34.848743+0000 mgr.gibba045.orlgmj (mgr.34412) 1721 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:20:36.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:36 gibba015 bash[29377]: cephadm 2021-03-10T14:20:34.848780+0000 mgr.gibba045.orlgmj (mgr.34412) 1722 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:20:36.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:36 gibba015 bash[29377]: cephadm 2021-03-10T14:20:34.849909+0000 mgr.gibba045.orlgmj (mgr.34412) 1723 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:20:36.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:36 gibba015 bash[29377]: cephadm 2021-03-10T14:20:34.850253+0000 mgr.gibba045.orlgmj (mgr.34412) 1724 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:20:36.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:36 gibba015 bash[29377]: cephadm 2021-03-10T14:20:34.851426+0000 mgr.gibba045.orlgmj (mgr.34412) 1725 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:20:36.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:36 gibba015 bash[29377]: cephadm 2021-03-10T14:20:34.851502+0000 mgr.gibba045.orlgmj (mgr.34412) 1726 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:20:36.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:36 gibba015 bash[29377]: cephadm 2021-03-10T14:20:34.851722+0000 mgr.gibba045.orlgmj (mgr.34412) 1727 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:20:36.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:20:36 gibba015 bash[30343]: cephadm 2021-03-10T14:20:34.640847+0000 mgr.gibba045.orlgmj (mgr.34412) 1712 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:20:36.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:20:36 gibba015 bash[30343]: cephadm 2021-03-10T14:20:34.649770+0000 mgr.gibba045.orlgmj (mgr.34412) 1713 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:20:36.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:20:36 gibba015 bash[30343]: cephadm 2021-03-10T14:20:34.841208+0000 mgr.gibba045.orlgmj (mgr.34412) 1714 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:20:36.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:20:36 gibba015 bash[30343]: cephadm 2021-03-10T14:20:34.843177+0000 mgr.gibba045.orlgmj (mgr.34412) 1715 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:20:36.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:20:36 gibba015 bash[30343]: cephadm 2021-03-10T14:20:34.844434+0000 mgr.gibba045.orlgmj (mgr.34412) 1716 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:20:36.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:20:36 gibba015 bash[30343]: cephadm 2021-03-10T14:20:34.844575+0000 mgr.gibba045.orlgmj (mgr.34412) 1717 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:20:36.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:20:36 gibba015 bash[30343]: cephadm 2021-03-10T14:20:34.845937+0000 mgr.gibba045.orlgmj (mgr.34412) 1718 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:20:36.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:20:36 gibba015 bash[30343]: cephadm 2021-03-10T14:20:34.845975+0000 mgr.gibba045.orlgmj (mgr.34412) 1719 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:20:36.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:20:36 gibba015 bash[30343]: cephadm 2021-03-10T14:20:34.847162+0000 mgr.gibba045.orlgmj (mgr.34412) 1720 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:20:36.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:20:36 gibba015 bash[30343]: cephadm 2021-03-10T14:20:34.848743+0000 mgr.gibba045.orlgmj (mgr.34412) 1721 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:20:36.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:20:36 gibba015 bash[30343]: cephadm 2021-03-10T14:20:34.848780+0000 mgr.gibba045.orlgmj (mgr.34412) 1722 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:20:36.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:20:36 gibba015 bash[30343]: cephadm 2021-03-10T14:20:34.849909+0000 mgr.gibba045.orlgmj (mgr.34412) 1723 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:20:36.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:20:36 gibba015 bash[30343]: cephadm 2021-03-10T14:20:34.850253+0000 mgr.gibba045.orlgmj (mgr.34412) 1724 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:20:36.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:20:36 gibba015 bash[30343]: cephadm 2021-03-10T14:20:34.851426+0000 mgr.gibba045.orlgmj (mgr.34412) 1725 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:20:36.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:20:36 gibba015 bash[30343]: cephadm 2021-03-10T14:20:34.851502+0000 mgr.gibba045.orlgmj (mgr.34412) 1726 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:20:36.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:20:36 gibba015 bash[30343]: cephadm 2021-03-10T14:20:34.851722+0000 mgr.gibba045.orlgmj (mgr.34412) 1727 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:20:36.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:20:36 gibba045 bash[25517]: cephadm 2021-03-10T14:20:34.640847+0000 mgr.gibba045.orlgmj (mgr.34412) 1712 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:20:36.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:20:36 gibba045 bash[25517]: cephadm 2021-03-10T14:20:34.649770+0000 mgr.gibba045.orlgmj (mgr.34412) 1713 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:20:36.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:20:36 gibba045 bash[25517]: cephadm 2021-03-10T14:20:34.841208+0000 mgr.gibba045.orlgmj (mgr.34412) 1714 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:20:36.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:20:36 gibba045 bash[25517]: cephadm 2021-03-10T14:20:34.843177+0000 mgr.gibba045.orlgmj (mgr.34412) 1715 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:20:36.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:20:36 gibba045 bash[25517]: cephadm 2021-03-10T14:20:34.844434+0000 mgr.gibba045.orlgmj (mgr.34412) 1716 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:20:36.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:20:36 gibba045 bash[25517]: cephadm 2021-03-10T14:20:34.844575+0000 mgr.gibba045.orlgmj (mgr.34412) 1717 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:20:36.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:20:36 gibba045 bash[25517]: cephadm 2021-03-10T14:20:34.845937+0000 mgr.gibba045.orlgmj (mgr.34412) 1718 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:20:36.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:20:36 gibba045 bash[25517]: cephadm 2021-03-10T14:20:34.845975+0000 mgr.gibba045.orlgmj (mgr.34412) 1719 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:20:36.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:20:36 gibba045 bash[25517]: cephadm 2021-03-10T14:20:34.847162+0000 mgr.gibba045.orlgmj (mgr.34412) 1720 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:20:36.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:20:36 gibba045 bash[25517]: cephadm 2021-03-10T14:20:34.848743+0000 mgr.gibba045.orlgmj (mgr.34412) 1721 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:20:36.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:20:36 gibba045 bash[25517]: cephadm 2021-03-10T14:20:34.848780+0000 mgr.gibba045.orlgmj (mgr.34412) 1722 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:20:36.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:20:36 gibba045 bash[25517]: cephadm 2021-03-10T14:20:34.849909+0000 mgr.gibba045.orlgmj (mgr.34412) 1723 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:20:36.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:20:36 gibba045 bash[25517]: cephadm 2021-03-10T14:20:34.850253+0000 mgr.gibba045.orlgmj (mgr.34412) 1724 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:20:36.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:20:36 gibba045 bash[25517]: cephadm 2021-03-10T14:20:34.851426+0000 mgr.gibba045.orlgmj (mgr.34412) 1725 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:20:36.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:20:36 gibba045 bash[25517]: cephadm 2021-03-10T14:20:34.851502+0000 mgr.gibba045.orlgmj (mgr.34412) 1726 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:20:36.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:20:36 gibba045 bash[25517]: cephadm 2021-03-10T14:20:34.851722+0000 mgr.gibba045.orlgmj (mgr.34412) 1727 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:20:37.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:37 gibba015 bash[29377]: cluster 2021-03-10T14:20:36.266634+0000 mgr.gibba045.orlgmj (mgr.34412) 1728 : cluster [DBG] pgmap v966: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:37.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:20:37 gibba015 bash[30343]: cluster 2021-03-10T14:20:36.266634+0000 mgr.gibba045.orlgmj (mgr.34412) 1728 : cluster [DBG] pgmap v966: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:37.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:20:37 gibba045 bash[25517]: cluster 2021-03-10T14:20:36.266634+0000 mgr.gibba045.orlgmj (mgr.34412) 1728 : cluster [DBG] pgmap v966: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:39.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:39 gibba015 bash[29377]: cluster 2021-03-10T14:20:38.268007+0000 mgr.gibba045.orlgmj (mgr.34412) 1729 : cluster [DBG] pgmap v967: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:39.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:20:39 gibba015 bash[30343]: cluster 2021-03-10T14:20:38.268007+0000 mgr.gibba045.orlgmj (mgr.34412) 1729 : cluster [DBG] pgmap v967: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:39.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:20:39 gibba045 bash[25517]: cluster 2021-03-10T14:20:38.268007+0000 mgr.gibba045.orlgmj (mgr.34412) 1729 : cluster [DBG] pgmap v967: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:41.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:41 gibba015 bash[29377]: cluster 2021-03-10T14:20:40.269707+0000 mgr.gibba045.orlgmj (mgr.34412) 1730 : cluster [DBG] pgmap v968: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:41.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:20:41 gibba015 bash[30343]: cluster 2021-03-10T14:20:40.269707+0000 mgr.gibba045.orlgmj (mgr.34412) 1730 : cluster [DBG] pgmap v968: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:41.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:20:41 gibba045 bash[25517]: cluster 2021-03-10T14:20:40.269707+0000 mgr.gibba045.orlgmj (mgr.34412) 1730 : cluster [DBG] pgmap v968: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:43.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:20:43 gibba045 bash[25517]: cluster 2021-03-10T14:20:42.270643+0000 mgr.gibba045.orlgmj (mgr.34412) 1731 : cluster [DBG] pgmap v969: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:43.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:43 gibba015 bash[29377]: cluster 2021-03-10T14:20:42.270643+0000 mgr.gibba045.orlgmj (mgr.34412) 1731 : cluster [DBG] pgmap v969: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:43.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:20:43 gibba015 bash[30343]: cluster 2021-03-10T14:20:42.270643+0000 mgr.gibba045.orlgmj (mgr.34412) 1731 : cluster [DBG] pgmap v969: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:45.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:45 gibba015 bash[29377]: cluster 2021-03-10T14:20:44.271875+0000 mgr.gibba045.orlgmj (mgr.34412) 1732 : cluster [DBG] pgmap v970: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:45.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:20:45 gibba015 bash[30343]: cluster 2021-03-10T14:20:44.271875+0000 mgr.gibba045.orlgmj (mgr.34412) 1732 : cluster [DBG] pgmap v970: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:45.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:20:45 gibba045 bash[25517]: cluster 2021-03-10T14:20:44.271875+0000 mgr.gibba045.orlgmj (mgr.34412) 1732 : cluster [DBG] pgmap v970: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:47.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:47 gibba015 bash[29377]: cluster 2021-03-10T14:20:46.273622+0000 mgr.gibba045.orlgmj (mgr.34412) 1733 : cluster [DBG] pgmap v971: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:47.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:20:47 gibba015 bash[30343]: cluster 2021-03-10T14:20:46.273622+0000 mgr.gibba045.orlgmj (mgr.34412) 1733 : cluster [DBG] pgmap v971: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:47.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:20:47 gibba045 bash[25517]: cluster 2021-03-10T14:20:46.273622+0000 mgr.gibba045.orlgmj (mgr.34412) 1733 : cluster [DBG] pgmap v971: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:49.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:49 gibba015 bash[29377]: cluster 2021-03-10T14:20:48.275275+0000 mgr.gibba045.orlgmj (mgr.34412) 1734 : cluster [DBG] pgmap v972: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:49.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:20:49 gibba015 bash[30343]: cluster 2021-03-10T14:20:48.275275+0000 mgr.gibba045.orlgmj (mgr.34412) 1734 : cluster [DBG] pgmap v972: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:49.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:20:49 gibba045 bash[25517]: cluster 2021-03-10T14:20:48.275275+0000 mgr.gibba045.orlgmj (mgr.34412) 1734 : cluster [DBG] pgmap v972: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:51.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:51 gibba015 bash[29377]: cephadm 2021-03-10T14:20:49.867768+0000 mgr.gibba045.orlgmj (mgr.34412) 1735 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:20:51.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:51 gibba015 bash[29377]: cluster 2021-03-10T14:20:50.277002+0000 mgr.gibba045.orlgmj (mgr.34412) 1736 : cluster [DBG] pgmap v973: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:51.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:20:51 gibba015 bash[30343]: cephadm 2021-03-10T14:20:49.867768+0000 mgr.gibba045.orlgmj (mgr.34412) 1735 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:20:51.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:20:51 gibba015 bash[30343]: cluster 2021-03-10T14:20:50.277002+0000 mgr.gibba045.orlgmj (mgr.34412) 1736 : cluster [DBG] pgmap v973: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:51.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:20:51 gibba045 bash[25517]: cephadm 2021-03-10T14:20:49.867768+0000 mgr.gibba045.orlgmj (mgr.34412) 1735 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:20:51.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:20:51 gibba045 bash[25517]: cluster 2021-03-10T14:20:50.277002+0000 mgr.gibba045.orlgmj (mgr.34412) 1736 : cluster [DBG] pgmap v973: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:52.809 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:20:53.038 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:20:53.038 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (31m) 7m ago 36m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:20:53.038 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (36m) 6m ago 36m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:20:53.039 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (32m) 6m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:20:53.039 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (32m) 6m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:20:53.039 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (31m) 7m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:20:53.039 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (31m) 7m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:20:53.039 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (30m) 6m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:20:53.040 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (30m) 7m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:20:53.040 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (37m) 7m ago 37m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:20:53.040 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (37m) 6m ago 37m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:20:53.040 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (29m) 7m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:20:53.041 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (29m) 7m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:20:53.041 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (29m) 7m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:20:53.041 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (28m) 7m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:20:53.041 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (28m) 6m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:20:53.041 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (27m) 6m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:20:53.042 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (27m) 6m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:20:53.042 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (26m) 6m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:20:53.042 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (36m) 6m ago 37m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:20:53.042 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 6m ago 35m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:20:53.287 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:20:53.288 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:20:53.288 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:20:53.288 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:20:53.288 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:20:53.289 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:20:53.289 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:20:53.289 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:20:53.289 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:20:53.289 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:20:53.290 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:20:53.290 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:20:53.290 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:20:53.290 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:20:53.291 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:20:53.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:20:53 gibba045 bash[25517]: cluster 2021-03-10T14:20:52.277776+0000 mgr.gibba045.orlgmj (mgr.34412) 1737 : cluster [DBG] pgmap v974: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:53.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:20:53 gibba045 bash[25517]: audit 2021-03-10T14:20:52.642763+0000 mon.c (mon.1) 540 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:20:53.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:20:53 gibba045 bash[25517]: audit 2021-03-10T14:20:52.642984+0000 mon.c (mon.1) 541 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:20:53.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:20:53 gibba045 bash[25517]: audit 2021-03-10T14:20:52.643156+0000 mon.a (mon.0) 802 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:20:53.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:20:53 gibba045 bash[25517]: audit 2021-03-10T14:20:52.643446+0000 mon.a (mon.0) 803 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:20:53.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:20:53 gibba045 bash[25517]: audit 2021-03-10T14:20:52.644046+0000 mon.c (mon.1) 542 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T14:20:53.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:20:53 gibba045 bash[25517]: audit 2021-03-10T14:20:52.644404+0000 mon.a (mon.0) 804 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T14:20:53.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:20:53 gibba045 bash[25517]: audit 2021-03-10T14:20:52.645072+0000 mon.c (mon.1) 543 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:20:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:20:53 gibba045 bash[25517]: audit 2021-03-10T14:20:52.645257+0000 mon.c (mon.1) 544 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:20:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:20:53 gibba045 bash[25517]: audit 2021-03-10T14:20:52.645449+0000 mon.c (mon.1) 545 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:20:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:20:53 gibba045 bash[25517]: audit 2021-03-10T14:20:52.645476+0000 mon.a (mon.0) 805 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:20:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:20:53 gibba045 bash[25517]: audit 2021-03-10T14:20:52.645771+0000 mon.a (mon.0) 806 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:20:53.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:20:53 gibba045 bash[25517]: audit 2021-03-10T14:20:52.646038+0000 mon.a (mon.0) 807 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:20:53.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:53 gibba015 bash[29377]: cluster 2021-03-10T14:20:52.277776+0000 mgr.gibba045.orlgmj (mgr.34412) 1737 : cluster [DBG] pgmap v974: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:53.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:53 gibba015 bash[29377]: audit 2021-03-10T14:20:52.642763+0000 mon.c (mon.1) 540 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:20:53.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:53 gibba015 bash[29377]: audit 2021-03-10T14:20:52.642984+0000 mon.c (mon.1) 541 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:20:53.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:53 gibba015 bash[29377]: audit 2021-03-10T14:20:52.643156+0000 mon.a (mon.0) 802 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:20:53.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:53 gibba015 bash[29377]: audit 2021-03-10T14:20:52.643446+0000 mon.a (mon.0) 803 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:20:53.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:53 gibba015 bash[29377]: audit 2021-03-10T14:20:52.644046+0000 mon.c (mon.1) 542 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T14:20:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:53 gibba015 bash[29377]: audit 2021-03-10T14:20:52.644404+0000 mon.a (mon.0) 804 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T14:20:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:53 gibba015 bash[29377]: audit 2021-03-10T14:20:52.645072+0000 mon.c (mon.1) 543 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:20:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:53 gibba015 bash[29377]: audit 2021-03-10T14:20:52.645257+0000 mon.c (mon.1) 544 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:20:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:53 gibba015 bash[29377]: audit 2021-03-10T14:20:52.645449+0000 mon.c (mon.1) 545 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:20:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:53 gibba015 bash[29377]: audit 2021-03-10T14:20:52.645476+0000 mon.a (mon.0) 805 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:20:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:53 gibba015 bash[29377]: audit 2021-03-10T14:20:52.645771+0000 mon.a (mon.0) 806 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:20:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:53 gibba015 bash[29377]: audit 2021-03-10T14:20:52.646038+0000 mon.a (mon.0) 807 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:20:53.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:20:53 gibba015 bash[30343]: cluster 2021-03-10T14:20:52.277776+0000 mgr.gibba045.orlgmj (mgr.34412) 1737 : cluster [DBG] pgmap v974: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:53.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:20:53 gibba015 bash[30343]: audit 2021-03-10T14:20:52.642763+0000 mon.c (mon.1) 540 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:20:53.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:20:53 gibba015 bash[30343]: audit 2021-03-10T14:20:52.642984+0000 mon.c (mon.1) 541 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:20:53.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:20:53 gibba015 bash[30343]: audit 2021-03-10T14:20:52.643156+0000 mon.a (mon.0) 802 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:20:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:20:53 gibba015 bash[30343]: audit 2021-03-10T14:20:52.643446+0000 mon.a (mon.0) 803 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:20:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:20:53 gibba015 bash[30343]: audit 2021-03-10T14:20:52.644046+0000 mon.c (mon.1) 542 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T14:20:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:20:53 gibba015 bash[30343]: audit 2021-03-10T14:20:52.644404+0000 mon.a (mon.0) 804 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T14:20:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:20:53 gibba015 bash[30343]: audit 2021-03-10T14:20:52.645072+0000 mon.c (mon.1) 543 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:20:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:20:53 gibba015 bash[30343]: audit 2021-03-10T14:20:52.645257+0000 mon.c (mon.1) 544 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:20:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:20:53 gibba015 bash[30343]: audit 2021-03-10T14:20:52.645449+0000 mon.c (mon.1) 545 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:20:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:20:53 gibba015 bash[30343]: audit 2021-03-10T14:20:52.645476+0000 mon.a (mon.0) 805 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:20:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:20:53 gibba015 bash[30343]: audit 2021-03-10T14:20:52.645771+0000 mon.a (mon.0) 806 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:20:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:20:53 gibba015 bash[30343]: audit 2021-03-10T14:20:52.646038+0000 mon.a (mon.0) 807 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:20:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:20:54 gibba045 bash[25517]: audit 2021-03-10T14:20:52.800585+0000 mgr.gibba045.orlgmj (mgr.34412) 1738 : audit [DBG] from='client.45222 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:20:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:20:54 gibba045 bash[25517]: audit 2021-03-10T14:20:53.025951+0000 mgr.gibba045.orlgmj (mgr.34412) 1739 : audit [DBG] from='client.55216 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:20:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:20:54 gibba045 bash[25517]: audit 2021-03-10T14:20:53.285379+0000 mon.a (mon.0) 808 : audit [DBG] from='client.? 172.21.2.115:0/2246760303' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:20:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:54 gibba015 bash[29377]: audit 2021-03-10T14:20:52.800585+0000 mgr.gibba045.orlgmj (mgr.34412) 1738 : audit [DBG] from='client.45222 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:20:54.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:54 gibba015 bash[29377]: audit 2021-03-10T14:20:53.025951+0000 mgr.gibba045.orlgmj (mgr.34412) 1739 : audit [DBG] from='client.55216 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:20:54.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:54 gibba015 bash[29377]: audit 2021-03-10T14:20:53.285379+0000 mon.a (mon.0) 808 : audit [DBG] from='client.? 172.21.2.115:0/2246760303' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:20:54.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:20:54 gibba015 bash[30343]: audit 2021-03-10T14:20:52.800585+0000 mgr.gibba045.orlgmj (mgr.34412) 1738 : audit [DBG] from='client.45222 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:20:54.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:20:54 gibba015 bash[30343]: audit 2021-03-10T14:20:53.025951+0000 mgr.gibba045.orlgmj (mgr.34412) 1739 : audit [DBG] from='client.55216 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:20:54.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:20:54 gibba015 bash[30343]: audit 2021-03-10T14:20:53.285379+0000 mon.a (mon.0) 808 : audit [DBG] from='client.? 172.21.2.115:0/2246760303' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:20:55.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:20:55 gibba045 bash[25517]: cluster 2021-03-10T14:20:54.278202+0000 mgr.gibba045.orlgmj (mgr.34412) 1740 : cluster [DBG] pgmap v975: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:55.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:55 gibba015 bash[29377]: cluster 2021-03-10T14:20:54.278202+0000 mgr.gibba045.orlgmj (mgr.34412) 1740 : cluster [DBG] pgmap v975: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:55.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:20:55 gibba015 bash[30343]: cluster 2021-03-10T14:20:54.278202+0000 mgr.gibba045.orlgmj (mgr.34412) 1740 : cluster [DBG] pgmap v975: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:57.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:57 gibba015 bash[29377]: cluster 2021-03-10T14:20:56.279804+0000 mgr.gibba045.orlgmj (mgr.34412) 1741 : cluster [DBG] pgmap v976: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:57.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:20:57 gibba015 bash[30343]: cluster 2021-03-10T14:20:56.279804+0000 mgr.gibba045.orlgmj (mgr.34412) 1741 : cluster [DBG] pgmap v976: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:57.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:20:57 gibba045 bash[25517]: cluster 2021-03-10T14:20:56.279804+0000 mgr.gibba045.orlgmj (mgr.34412) 1741 : cluster [DBG] pgmap v976: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:59.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:20:59 gibba015 bash[29377]: cluster 2021-03-10T14:20:58.281483+0000 mgr.gibba045.orlgmj (mgr.34412) 1742 : cluster [DBG] pgmap v977: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:59.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:20:59 gibba015 bash[30343]: cluster 2021-03-10T14:20:58.281483+0000 mgr.gibba045.orlgmj (mgr.34412) 1742 : cluster [DBG] pgmap v977: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:59.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:20:59 gibba045 bash[25517]: cluster 2021-03-10T14:20:58.281483+0000 mgr.gibba045.orlgmj (mgr.34412) 1742 : cluster [DBG] pgmap v977: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:01.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:21:01 gibba015 bash[29377]: cluster 2021-03-10T14:21:00.282985+0000 mgr.gibba045.orlgmj (mgr.34412) 1743 : cluster [DBG] pgmap v978: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:01.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:21:01 gibba015 bash[30343]: cluster 2021-03-10T14:21:00.282985+0000 mgr.gibba045.orlgmj (mgr.34412) 1743 : cluster [DBG] pgmap v978: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:01.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:21:01 gibba045 bash[25517]: cluster 2021-03-10T14:21:00.282985+0000 mgr.gibba045.orlgmj (mgr.34412) 1743 : cluster [DBG] pgmap v978: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:03.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:21:03 gibba045 bash[25517]: cluster 2021-03-10T14:21:02.283845+0000 mgr.gibba045.orlgmj (mgr.34412) 1744 : cluster [DBG] pgmap v979: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:03.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:21:03 gibba015 bash[29377]: cluster 2021-03-10T14:21:02.283845+0000 mgr.gibba045.orlgmj (mgr.34412) 1744 : cluster [DBG] pgmap v979: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:03.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:21:03 gibba015 bash[30343]: cluster 2021-03-10T14:21:02.283845+0000 mgr.gibba045.orlgmj (mgr.34412) 1744 : cluster [DBG] pgmap v979: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:05.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:21:05 gibba015 bash[29377]: cluster 2021-03-10T14:21:04.285325+0000 mgr.gibba045.orlgmj (mgr.34412) 1745 : cluster [DBG] pgmap v980: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:05.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:21:05 gibba015 bash[30343]: cluster 2021-03-10T14:21:04.285325+0000 mgr.gibba045.orlgmj (mgr.34412) 1745 : cluster [DBG] pgmap v980: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:05.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:21:05 gibba045 bash[25517]: cluster 2021-03-10T14:21:04.285325+0000 mgr.gibba045.orlgmj (mgr.34412) 1745 : cluster [DBG] pgmap v980: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:06.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:21:06 gibba015 bash[29377]: cephadm 2021-03-10T14:21:04.883829+0000 mgr.gibba045.orlgmj (mgr.34412) 1746 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:21:06.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:21:06 gibba015 bash[30343]: cephadm 2021-03-10T14:21:04.883829+0000 mgr.gibba045.orlgmj (mgr.34412) 1746 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:21:06.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:21:06 gibba045 bash[25517]: cephadm 2021-03-10T14:21:04.883829+0000 mgr.gibba045.orlgmj (mgr.34412) 1746 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:21:07.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:21:07 gibba015 bash[29377]: cluster 2021-03-10T14:21:06.287028+0000 mgr.gibba045.orlgmj (mgr.34412) 1747 : cluster [DBG] pgmap v981: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:07.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:21:07 gibba015 bash[30343]: cluster 2021-03-10T14:21:06.287028+0000 mgr.gibba045.orlgmj (mgr.34412) 1747 : cluster [DBG] pgmap v981: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:07.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:21:07 gibba045 bash[25517]: cluster 2021-03-10T14:21:06.287028+0000 mgr.gibba045.orlgmj (mgr.34412) 1747 : cluster [DBG] pgmap v981: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:09.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:21:09 gibba015 bash[29377]: cluster 2021-03-10T14:21:08.288713+0000 mgr.gibba045.orlgmj (mgr.34412) 1748 : cluster [DBG] pgmap v982: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:09.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:21:09 gibba015 bash[30343]: cluster 2021-03-10T14:21:08.288713+0000 mgr.gibba045.orlgmj (mgr.34412) 1748 : cluster [DBG] pgmap v982: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:09.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:21:09 gibba045 bash[25517]: cluster 2021-03-10T14:21:08.288713+0000 mgr.gibba045.orlgmj (mgr.34412) 1748 : cluster [DBG] pgmap v982: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:11.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:21:11 gibba015 bash[29377]: cluster 2021-03-10T14:21:10.290322+0000 mgr.gibba045.orlgmj (mgr.34412) 1749 : cluster [DBG] pgmap v983: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:11.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:21:11 gibba015 bash[30343]: cluster 2021-03-10T14:21:10.290322+0000 mgr.gibba045.orlgmj (mgr.34412) 1749 : cluster [DBG] pgmap v983: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:11.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:21:11 gibba045 bash[25517]: cluster 2021-03-10T14:21:10.290322+0000 mgr.gibba045.orlgmj (mgr.34412) 1749 : cluster [DBG] pgmap v983: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:13.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:21:13 gibba045 bash[25517]: cluster 2021-03-10T14:21:12.292019+0000 mgr.gibba045.orlgmj (mgr.34412) 1750 : cluster [DBG] pgmap v984: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:13.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:21:13 gibba015 bash[29377]: cluster 2021-03-10T14:21:12.292019+0000 mgr.gibba045.orlgmj (mgr.34412) 1750 : cluster [DBG] pgmap v984: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:13.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:21:13 gibba015 bash[30343]: cluster 2021-03-10T14:21:12.292019+0000 mgr.gibba045.orlgmj (mgr.34412) 1750 : cluster [DBG] pgmap v984: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:15.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:21:15 gibba015 bash[29377]: cluster 2021-03-10T14:21:14.293301+0000 mgr.gibba045.orlgmj (mgr.34412) 1751 : cluster [DBG] pgmap v985: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:15.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:21:15 gibba015 bash[30343]: cluster 2021-03-10T14:21:14.293301+0000 mgr.gibba045.orlgmj (mgr.34412) 1751 : cluster [DBG] pgmap v985: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:15.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:21:15 gibba045 bash[25517]: cluster 2021-03-10T14:21:14.293301+0000 mgr.gibba045.orlgmj (mgr.34412) 1751 : cluster [DBG] pgmap v985: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:17.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:21:17 gibba015 bash[29377]: cluster 2021-03-10T14:21:16.294976+0000 mgr.gibba045.orlgmj (mgr.34412) 1752 : cluster [DBG] pgmap v986: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:17.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:21:17 gibba015 bash[30343]: cluster 2021-03-10T14:21:16.294976+0000 mgr.gibba045.orlgmj (mgr.34412) 1752 : cluster [DBG] pgmap v986: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:17.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:21:17 gibba045 bash[25517]: cluster 2021-03-10T14:21:16.294976+0000 mgr.gibba045.orlgmj (mgr.34412) 1752 : cluster [DBG] pgmap v986: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:19.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:21:19 gibba015 bash[29377]: cluster 2021-03-10T14:21:18.296628+0000 mgr.gibba045.orlgmj (mgr.34412) 1753 : cluster [DBG] pgmap v987: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:19.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:21:19 gibba015 bash[30343]: cluster 2021-03-10T14:21:18.296628+0000 mgr.gibba045.orlgmj (mgr.34412) 1753 : cluster [DBG] pgmap v987: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:19.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:21:19 gibba045 bash[25517]: cluster 2021-03-10T14:21:18.296628+0000 mgr.gibba045.orlgmj (mgr.34412) 1753 : cluster [DBG] pgmap v987: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:21.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:21:21 gibba015 bash[29377]: cephadm 2021-03-10T14:21:19.899872+0000 mgr.gibba045.orlgmj (mgr.34412) 1754 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:21:21.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:21:21 gibba015 bash[29377]: cluster 2021-03-10T14:21:20.298267+0000 mgr.gibba045.orlgmj (mgr.34412) 1755 : cluster [DBG] pgmap v988: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:21.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:21:21 gibba015 bash[30343]: cephadm 2021-03-10T14:21:19.899872+0000 mgr.gibba045.orlgmj (mgr.34412) 1754 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:21:21.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:21:21 gibba015 bash[30343]: cluster 2021-03-10T14:21:20.298267+0000 mgr.gibba045.orlgmj (mgr.34412) 1755 : cluster [DBG] pgmap v988: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:21.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:21:21 gibba045 bash[25517]: cephadm 2021-03-10T14:21:19.899872+0000 mgr.gibba045.orlgmj (mgr.34412) 1754 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:21:21.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:21:21 gibba045 bash[25517]: cluster 2021-03-10T14:21:20.298267+0000 mgr.gibba045.orlgmj (mgr.34412) 1755 : cluster [DBG] pgmap v988: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:23.538 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:21:23.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:21:23 gibba045 bash[25517]: cluster 2021-03-10T14:21:22.299065+0000 mgr.gibba045.orlgmj (mgr.34412) 1756 : cluster [DBG] pgmap v989: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:23.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:21:23 gibba015 bash[29377]: cluster 2021-03-10T14:21:22.299065+0000 mgr.gibba045.orlgmj (mgr.34412) 1756 : cluster [DBG] pgmap v989: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:23.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:21:23 gibba015 bash[30343]: cluster 2021-03-10T14:21:22.299065+0000 mgr.gibba045.orlgmj (mgr.34412) 1756 : cluster [DBG] pgmap v989: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:23.763 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:21:23.763 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (32m) 7m ago 37m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:21:23.763 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (37m) 6m ago 37m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:21:23.763 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (32m) 6m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:21:23.764 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (32m) 6m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:21:23.764 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (31m) 7m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:21:23.764 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (31m) 7m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:21:23.764 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (31m) 6m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:21:23.764 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (31m) 7m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:21:23.765 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (37m) 7m ago 37m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:21:23.765 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (37m) 6m ago 37m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:21:23.765 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (30m) 7m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:21:23.765 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (29m) 7m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:21:23.765 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (29m) 7m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:21:23.766 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (29m) 7m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:21:23.766 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (28m) 6m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:21:23.766 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (28m) 6m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:21:23.766 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (27m) 6m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:21:23.767 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (27m) 6m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:21:23.767 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (36m) 6m ago 37m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:21:23.767 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 6m ago 35m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:21:24.016 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:21:24.016 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:21:24.016 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:21:24.016 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:21:24.017 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:21:24.017 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:21:24.017 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:21:24.017 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:21:24.018 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:21:24.018 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:21:24.018 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:21:24.018 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:21:24.018 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:21:24.019 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:21:24.019 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:21:24.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:21:24 gibba045 bash[25517]: audit 2021-03-10T14:21:24.013780+0000 mon.a (mon.0) 809 : audit [DBG] from='client.? 172.21.2.115:0/527935794' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:21:24.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:21:24 gibba015 bash[29377]: audit 2021-03-10T14:21:24.013780+0000 mon.a (mon.0) 809 : audit [DBG] from='client.? 172.21.2.115:0/527935794' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:21:24.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:21:24 gibba015 bash[30343]: audit 2021-03-10T14:21:24.013780+0000 mon.a (mon.0) 809 : audit [DBG] from='client.? 172.21.2.115:0/527935794' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:21:25.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:21:25 gibba045 bash[25517]: audit 2021-03-10T14:21:23.529727+0000 mgr.gibba045.orlgmj (mgr.34412) 1757 : audit [DBG] from='client.55228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:21:25.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:21:25 gibba045 bash[25517]: audit 2021-03-10T14:21:23.751367+0000 mgr.gibba045.orlgmj (mgr.34412) 1758 : audit [DBG] from='client.55234 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:21:25.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:21:25 gibba045 bash[25517]: cluster 2021-03-10T14:21:24.300257+0000 mgr.gibba045.orlgmj (mgr.34412) 1759 : cluster [DBG] pgmap v990: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:25.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:21:25 gibba015 bash[29377]: audit 2021-03-10T14:21:23.529727+0000 mgr.gibba045.orlgmj (mgr.34412) 1757 : audit [DBG] from='client.55228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:21:25.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:21:25 gibba015 bash[29377]: audit 2021-03-10T14:21:23.751367+0000 mgr.gibba045.orlgmj (mgr.34412) 1758 : audit [DBG] from='client.55234 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:21:25.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:21:25 gibba015 bash[29377]: cluster 2021-03-10T14:21:24.300257+0000 mgr.gibba045.orlgmj (mgr.34412) 1759 : cluster [DBG] pgmap v990: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:25.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:21:25 gibba015 bash[30343]: audit 2021-03-10T14:21:23.529727+0000 mgr.gibba045.orlgmj (mgr.34412) 1757 : audit [DBG] from='client.55228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:21:25.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:21:25 gibba015 bash[30343]: audit 2021-03-10T14:21:23.751367+0000 mgr.gibba045.orlgmj (mgr.34412) 1758 : audit [DBG] from='client.55234 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:21:25.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:21:25 gibba015 bash[30343]: cluster 2021-03-10T14:21:24.300257+0000 mgr.gibba045.orlgmj (mgr.34412) 1759 : cluster [DBG] pgmap v990: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:27.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:21:27 gibba015 bash[29377]: cluster 2021-03-10T14:21:26.302070+0000 mgr.gibba045.orlgmj (mgr.34412) 1760 : cluster [DBG] pgmap v991: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:27.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:21:27 gibba015 bash[30343]: cluster 2021-03-10T14:21:26.302070+0000 mgr.gibba045.orlgmj (mgr.34412) 1760 : cluster [DBG] pgmap v991: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:27.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:21:27 gibba045 bash[25517]: cluster 2021-03-10T14:21:26.302070+0000 mgr.gibba045.orlgmj (mgr.34412) 1760 : cluster [DBG] pgmap v991: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:29.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:21:29 gibba015 bash[29377]: cluster 2021-03-10T14:21:28.303566+0000 mgr.gibba045.orlgmj (mgr.34412) 1761 : cluster [DBG] pgmap v992: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:29.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:21:29 gibba015 bash[30343]: cluster 2021-03-10T14:21:28.303566+0000 mgr.gibba045.orlgmj (mgr.34412) 1761 : cluster [DBG] pgmap v992: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:29.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:21:29 gibba045 bash[25517]: cluster 2021-03-10T14:21:28.303566+0000 mgr.gibba045.orlgmj (mgr.34412) 1761 : cluster [DBG] pgmap v992: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:31.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:21:31 gibba015 bash[29377]: cluster 2021-03-10T14:21:30.305235+0000 mgr.gibba045.orlgmj (mgr.34412) 1762 : cluster [DBG] pgmap v993: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:31.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:21:31 gibba015 bash[30343]: cluster 2021-03-10T14:21:30.305235+0000 mgr.gibba045.orlgmj (mgr.34412) 1762 : cluster [DBG] pgmap v993: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:31.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:21:31 gibba045 bash[25517]: cluster 2021-03-10T14:21:30.305235+0000 mgr.gibba045.orlgmj (mgr.34412) 1762 : cluster [DBG] pgmap v993: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:33.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:21:33 gibba045 bash[25517]: cluster 2021-03-10T14:21:32.306164+0000 mgr.gibba045.orlgmj (mgr.34412) 1763 : cluster [DBG] pgmap v994: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:33.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:21:33 gibba015 bash[29377]: cluster 2021-03-10T14:21:32.306164+0000 mgr.gibba045.orlgmj (mgr.34412) 1763 : cluster [DBG] pgmap v994: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:33.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:21:33 gibba015 bash[30343]: cluster 2021-03-10T14:21:32.306164+0000 mgr.gibba045.orlgmj (mgr.34412) 1763 : cluster [DBG] pgmap v994: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:35.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:21:35 gibba045 bash[25517]: cluster 2021-03-10T14:21:34.307513+0000 mgr.gibba045.orlgmj (mgr.34412) 1764 : cluster [DBG] pgmap v995: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:35.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:21:35 gibba045 bash[25517]: audit 2021-03-10T14:21:34.903034+0000 mon.c (mon.1) 546 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:21:35.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:21:35 gibba045 bash[25517]: audit 2021-03-10T14:21:35.187471+0000 mon.a (mon.0) 810 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:21:35.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:21:35 gibba045 bash[25517]: audit 2021-03-10T14:21:35.191209+0000 mon.c (mon.1) 547 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:21:35.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:21:35 gibba045 bash[25517]: audit 2021-03-10T14:21:35.192931+0000 mon.c (mon.1) 548 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:21:35.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:21:35 gibba045 bash[25517]: audit 2021-03-10T14:21:35.194399+0000 mon.c (mon.1) 549 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:21:35.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:21:35 gibba045 bash[25517]: audit 2021-03-10T14:21:35.195706+0000 mon.c (mon.1) 550 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:21:35.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:21:35 gibba045 bash[25517]: audit 2021-03-10T14:21:35.198297+0000 mon.c (mon.1) 551 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:21:35.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:21:35 gibba045 bash[25517]: audit 2021-03-10T14:21:35.199613+0000 mon.c (mon.1) 552 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:21:35.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:21:35 gibba015 bash[29377]: cluster 2021-03-10T14:21:34.307513+0000 mgr.gibba045.orlgmj (mgr.34412) 1764 : cluster [DBG] pgmap v995: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:35.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:21:35 gibba015 bash[29377]: audit 2021-03-10T14:21:34.903034+0000 mon.c (mon.1) 546 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:21:35.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:21:35 gibba015 bash[29377]: audit 2021-03-10T14:21:35.187471+0000 mon.a (mon.0) 810 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:21:35.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:21:35 gibba015 bash[29377]: audit 2021-03-10T14:21:35.191209+0000 mon.c (mon.1) 547 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:21:35.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:21:35 gibba015 bash[29377]: audit 2021-03-10T14:21:35.192931+0000 mon.c (mon.1) 548 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:21:35.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:21:35 gibba015 bash[29377]: audit 2021-03-10T14:21:35.194399+0000 mon.c (mon.1) 549 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:21:35.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:21:35 gibba015 bash[29377]: audit 2021-03-10T14:21:35.195706+0000 mon.c (mon.1) 550 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:21:35.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:21:35 gibba015 bash[29377]: audit 2021-03-10T14:21:35.198297+0000 mon.c (mon.1) 551 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:21:35.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:21:35 gibba015 bash[29377]: audit 2021-03-10T14:21:35.199613+0000 mon.c (mon.1) 552 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:21:35.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:21:35 gibba015 bash[30343]: cluster 2021-03-10T14:21:34.307513+0000 mgr.gibba045.orlgmj (mgr.34412) 1764 : cluster [DBG] pgmap v995: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:35.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:21:35 gibba015 bash[30343]: audit 2021-03-10T14:21:34.903034+0000 mon.c (mon.1) 546 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:21:35.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:21:35 gibba015 bash[30343]: audit 2021-03-10T14:21:35.187471+0000 mon.a (mon.0) 810 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:21:35.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:21:35 gibba015 bash[30343]: audit 2021-03-10T14:21:35.191209+0000 mon.c (mon.1) 547 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:21:35.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:21:35 gibba015 bash[30343]: audit 2021-03-10T14:21:35.192931+0000 mon.c (mon.1) 548 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:21:35.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:21:35 gibba015 bash[30343]: audit 2021-03-10T14:21:35.194399+0000 mon.c (mon.1) 549 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:21:35.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:21:35 gibba015 bash[30343]: audit 2021-03-10T14:21:35.195706+0000 mon.c (mon.1) 550 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:21:35.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:21:35 gibba015 bash[30343]: audit 2021-03-10T14:21:35.198297+0000 mon.c (mon.1) 551 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:21:35.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:21:35 gibba015 bash[30343]: audit 2021-03-10T14:21:35.199613+0000 mon.c (mon.1) 552 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:21:36.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:21:36 gibba015 bash[29377]: cephadm 2021-03-10T14:21:34.911253+0000 mgr.gibba045.orlgmj (mgr.34412) 1765 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:21:36.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:21:36 gibba015 bash[29377]: cephadm 2021-03-10T14:21:34.913194+0000 mgr.gibba045.orlgmj (mgr.34412) 1766 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:21:36.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:21:36 gibba015 bash[29377]: cephadm 2021-03-10T14:21:35.193197+0000 mgr.gibba045.orlgmj (mgr.34412) 1767 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:21:36.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:21:36 gibba015 bash[29377]: cephadm 2021-03-10T14:21:35.195372+0000 mgr.gibba045.orlgmj (mgr.34412) 1768 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:21:36.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:21:36 gibba015 bash[29377]: cephadm 2021-03-10T14:21:35.196704+0000 mgr.gibba045.orlgmj (mgr.34412) 1769 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:21:36.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:21:36 gibba015 bash[29377]: cephadm 2021-03-10T14:21:35.196743+0000 mgr.gibba045.orlgmj (mgr.34412) 1770 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:21:36.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:21:36 gibba015 bash[29377]: cephadm 2021-03-10T14:21:35.198145+0000 mgr.gibba045.orlgmj (mgr.34412) 1771 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:21:36.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:21:36 gibba015 bash[29377]: cephadm 2021-03-10T14:21:35.198184+0000 mgr.gibba045.orlgmj (mgr.34412) 1772 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:21:36.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:21:36 gibba015 bash[29377]: cephadm 2021-03-10T14:21:35.199393+0000 mgr.gibba045.orlgmj (mgr.34412) 1773 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:21:36.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:21:36 gibba015 bash[29377]: cephadm 2021-03-10T14:21:35.200800+0000 mgr.gibba045.orlgmj (mgr.34412) 1774 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:21:36.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:21:36 gibba015 bash[29377]: cephadm 2021-03-10T14:21:35.200838+0000 mgr.gibba045.orlgmj (mgr.34412) 1775 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:21:36.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:21:36 gibba015 bash[29377]: cephadm 2021-03-10T14:21:35.201973+0000 mgr.gibba045.orlgmj (mgr.34412) 1776 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:21:36.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:21:36 gibba015 bash[29377]: cephadm 2021-03-10T14:21:35.202288+0000 mgr.gibba045.orlgmj (mgr.34412) 1777 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:21:36.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:21:36 gibba015 bash[29377]: cephadm 2021-03-10T14:21:35.203202+0000 mgr.gibba045.orlgmj (mgr.34412) 1778 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:21:36.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:21:36 gibba015 bash[29377]: cephadm 2021-03-10T14:21:35.203241+0000 mgr.gibba045.orlgmj (mgr.34412) 1779 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:21:36.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:21:36 gibba015 bash[29377]: cephadm 2021-03-10T14:21:35.203397+0000 mgr.gibba045.orlgmj (mgr.34412) 1780 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:21:36.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:21:36 gibba015 bash[30343]: cephadm 2021-03-10T14:21:34.911253+0000 mgr.gibba045.orlgmj (mgr.34412) 1765 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:21:36.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:21:36 gibba015 bash[30343]: cephadm 2021-03-10T14:21:34.913194+0000 mgr.gibba045.orlgmj (mgr.34412) 1766 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:21:36.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:21:36 gibba015 bash[30343]: cephadm 2021-03-10T14:21:35.193197+0000 mgr.gibba045.orlgmj (mgr.34412) 1767 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:21:36.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:21:36 gibba015 bash[30343]: cephadm 2021-03-10T14:21:35.195372+0000 mgr.gibba045.orlgmj (mgr.34412) 1768 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:21:36.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:21:36 gibba015 bash[30343]: cephadm 2021-03-10T14:21:35.196704+0000 mgr.gibba045.orlgmj (mgr.34412) 1769 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:21:36.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:21:36 gibba015 bash[30343]: cephadm 2021-03-10T14:21:35.196743+0000 mgr.gibba045.orlgmj (mgr.34412) 1770 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:21:36.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:21:36 gibba015 bash[30343]: cephadm 2021-03-10T14:21:35.198145+0000 mgr.gibba045.orlgmj (mgr.34412) 1771 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:21:36.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:21:36 gibba015 bash[30343]: cephadm 2021-03-10T14:21:35.198184+0000 mgr.gibba045.orlgmj (mgr.34412) 1772 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:21:36.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:21:36 gibba015 bash[30343]: cephadm 2021-03-10T14:21:35.199393+0000 mgr.gibba045.orlgmj (mgr.34412) 1773 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:21:36.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:21:36 gibba015 bash[30343]: cephadm 2021-03-10T14:21:35.200800+0000 mgr.gibba045.orlgmj (mgr.34412) 1774 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:21:36.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:21:36 gibba015 bash[30343]: cephadm 2021-03-10T14:21:35.200838+0000 mgr.gibba045.orlgmj (mgr.34412) 1775 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:21:36.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:21:36 gibba015 bash[30343]: cephadm 2021-03-10T14:21:35.201973+0000 mgr.gibba045.orlgmj (mgr.34412) 1776 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:21:36.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:21:36 gibba015 bash[30343]: cephadm 2021-03-10T14:21:35.202288+0000 mgr.gibba045.orlgmj (mgr.34412) 1777 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:21:36.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:21:36 gibba015 bash[30343]: cephadm 2021-03-10T14:21:35.203202+0000 mgr.gibba045.orlgmj (mgr.34412) 1778 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:21:36.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:21:36 gibba015 bash[30343]: cephadm 2021-03-10T14:21:35.203241+0000 mgr.gibba045.orlgmj (mgr.34412) 1779 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:21:36.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:21:36 gibba015 bash[30343]: cephadm 2021-03-10T14:21:35.203397+0000 mgr.gibba045.orlgmj (mgr.34412) 1780 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:21:36.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:21:36 gibba045 bash[25517]: cephadm 2021-03-10T14:21:34.911253+0000 mgr.gibba045.orlgmj (mgr.34412) 1765 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:21:36.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:21:36 gibba045 bash[25517]: cephadm 2021-03-10T14:21:34.913194+0000 mgr.gibba045.orlgmj (mgr.34412) 1766 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:21:36.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:21:36 gibba045 bash[25517]: cephadm 2021-03-10T14:21:35.193197+0000 mgr.gibba045.orlgmj (mgr.34412) 1767 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:21:36.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:21:36 gibba045 bash[25517]: cephadm 2021-03-10T14:21:35.195372+0000 mgr.gibba045.orlgmj (mgr.34412) 1768 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:21:36.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:21:36 gibba045 bash[25517]: cephadm 2021-03-10T14:21:35.196704+0000 mgr.gibba045.orlgmj (mgr.34412) 1769 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:21:36.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:21:36 gibba045 bash[25517]: cephadm 2021-03-10T14:21:35.196743+0000 mgr.gibba045.orlgmj (mgr.34412) 1770 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:21:36.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:21:36 gibba045 bash[25517]: cephadm 2021-03-10T14:21:35.198145+0000 mgr.gibba045.orlgmj (mgr.34412) 1771 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:21:36.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:21:36 gibba045 bash[25517]: cephadm 2021-03-10T14:21:35.198184+0000 mgr.gibba045.orlgmj (mgr.34412) 1772 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:21:36.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:21:36 gibba045 bash[25517]: cephadm 2021-03-10T14:21:35.199393+0000 mgr.gibba045.orlgmj (mgr.34412) 1773 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:21:36.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:21:36 gibba045 bash[25517]: cephadm 2021-03-10T14:21:35.200800+0000 mgr.gibba045.orlgmj (mgr.34412) 1774 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:21:36.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:21:36 gibba045 bash[25517]: cephadm 2021-03-10T14:21:35.200838+0000 mgr.gibba045.orlgmj (mgr.34412) 1775 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:21:36.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:21:36 gibba045 bash[25517]: cephadm 2021-03-10T14:21:35.201973+0000 mgr.gibba045.orlgmj (mgr.34412) 1776 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:21:36.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:21:36 gibba045 bash[25517]: cephadm 2021-03-10T14:21:35.202288+0000 mgr.gibba045.orlgmj (mgr.34412) 1777 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:21:36.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:21:36 gibba045 bash[25517]: cephadm 2021-03-10T14:21:35.203202+0000 mgr.gibba045.orlgmj (mgr.34412) 1778 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:21:36.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:21:36 gibba045 bash[25517]: cephadm 2021-03-10T14:21:35.203241+0000 mgr.gibba045.orlgmj (mgr.34412) 1779 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:21:36.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:21:36 gibba045 bash[25517]: cephadm 2021-03-10T14:21:35.203397+0000 mgr.gibba045.orlgmj (mgr.34412) 1780 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:21:37.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:21:37 gibba015 bash[29377]: cluster 2021-03-10T14:21:36.309422+0000 mgr.gibba045.orlgmj (mgr.34412) 1781 : cluster [DBG] pgmap v996: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:37.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:21:37 gibba015 bash[30343]: cluster 2021-03-10T14:21:36.309422+0000 mgr.gibba045.orlgmj (mgr.34412) 1781 : cluster [DBG] pgmap v996: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:37.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:21:37 gibba045 bash[25517]: cluster 2021-03-10T14:21:36.309422+0000 mgr.gibba045.orlgmj (mgr.34412) 1781 : cluster [DBG] pgmap v996: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:39.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:21:39 gibba015 bash[29377]: cluster 2021-03-10T14:21:38.310979+0000 mgr.gibba045.orlgmj (mgr.34412) 1782 : cluster [DBG] pgmap v997: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:39.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:21:39 gibba015 bash[30343]: cluster 2021-03-10T14:21:38.310979+0000 mgr.gibba045.orlgmj (mgr.34412) 1782 : cluster [DBG] pgmap v997: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:39.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:21:39 gibba045 bash[25517]: cluster 2021-03-10T14:21:38.310979+0000 mgr.gibba045.orlgmj (mgr.34412) 1782 : cluster [DBG] pgmap v997: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:41.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:21:41 gibba015 bash[29377]: cluster 2021-03-10T14:21:40.312728+0000 mgr.gibba045.orlgmj (mgr.34412) 1783 : cluster [DBG] pgmap v998: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:41.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:21:41 gibba015 bash[30343]: cluster 2021-03-10T14:21:40.312728+0000 mgr.gibba045.orlgmj (mgr.34412) 1783 : cluster [DBG] pgmap v998: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:41.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:21:41 gibba045 bash[25517]: cluster 2021-03-10T14:21:40.312728+0000 mgr.gibba045.orlgmj (mgr.34412) 1783 : cluster [DBG] pgmap v998: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:43.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:21:43 gibba045 bash[25517]: cluster 2021-03-10T14:21:42.313381+0000 mgr.gibba045.orlgmj (mgr.34412) 1784 : cluster [DBG] pgmap v999: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:43.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:21:43 gibba015 bash[29377]: cluster 2021-03-10T14:21:42.313381+0000 mgr.gibba045.orlgmj (mgr.34412) 1784 : cluster [DBG] pgmap v999: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:43.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:21:43 gibba015 bash[30343]: cluster 2021-03-10T14:21:42.313381+0000 mgr.gibba045.orlgmj (mgr.34412) 1784 : cluster [DBG] pgmap v999: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:45.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:21:45 gibba015 bash[29377]: cluster 2021-03-10T14:21:44.314497+0000 mgr.gibba045.orlgmj (mgr.34412) 1785 : cluster [DBG] pgmap v1000: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:45.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:21:45 gibba015 bash[30343]: cluster 2021-03-10T14:21:44.314497+0000 mgr.gibba045.orlgmj (mgr.34412) 1785 : cluster [DBG] pgmap v1000: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:45.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:21:45 gibba045 bash[25517]: cluster 2021-03-10T14:21:44.314497+0000 mgr.gibba045.orlgmj (mgr.34412) 1785 : cluster [DBG] pgmap v1000: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:47.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:21:47 gibba015 bash[29377]: cluster 2021-03-10T14:21:46.315999+0000 mgr.gibba045.orlgmj (mgr.34412) 1786 : cluster [DBG] pgmap v1001: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:47.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:21:47 gibba015 bash[30343]: cluster 2021-03-10T14:21:46.315999+0000 mgr.gibba045.orlgmj (mgr.34412) 1786 : cluster [DBG] pgmap v1001: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:47.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:21:47 gibba045 bash[25517]: cluster 2021-03-10T14:21:46.315999+0000 mgr.gibba045.orlgmj (mgr.34412) 1786 : cluster [DBG] pgmap v1001: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:49.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:21:49 gibba015 bash[29377]: cluster 2021-03-10T14:21:48.317694+0000 mgr.gibba045.orlgmj (mgr.34412) 1787 : cluster [DBG] pgmap v1002: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:49.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:21:49 gibba015 bash[30343]: cluster 2021-03-10T14:21:48.317694+0000 mgr.gibba045.orlgmj (mgr.34412) 1787 : cluster [DBG] pgmap v1002: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:49.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:21:49 gibba045 bash[25517]: cluster 2021-03-10T14:21:48.317694+0000 mgr.gibba045.orlgmj (mgr.34412) 1787 : cluster [DBG] pgmap v1002: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:51.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:21:51 gibba015 bash[29377]: cephadm 2021-03-10T14:21:50.217383+0000 mgr.gibba045.orlgmj (mgr.34412) 1788 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:21:51.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:21:51 gibba015 bash[29377]: cluster 2021-03-10T14:21:50.319102+0000 mgr.gibba045.orlgmj (mgr.34412) 1789 : cluster [DBG] pgmap v1003: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:51.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:21:51 gibba015 bash[30343]: cephadm 2021-03-10T14:21:50.217383+0000 mgr.gibba045.orlgmj (mgr.34412) 1788 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:21:51.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:21:51 gibba015 bash[30343]: cluster 2021-03-10T14:21:50.319102+0000 mgr.gibba045.orlgmj (mgr.34412) 1789 : cluster [DBG] pgmap v1003: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:51.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:21:51 gibba045 bash[25517]: cephadm 2021-03-10T14:21:50.217383+0000 mgr.gibba045.orlgmj (mgr.34412) 1788 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:21:51.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:21:51 gibba045 bash[25517]: cluster 2021-03-10T14:21:50.319102+0000 mgr.gibba045.orlgmj (mgr.34412) 1789 : cluster [DBG] pgmap v1003: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:53.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:21:53 gibba045 bash[25517]: cluster 2021-03-10T14:21:52.320754+0000 mgr.gibba045.orlgmj (mgr.34412) 1790 : cluster [DBG] pgmap v1004: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:53.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:21:53 gibba045 bash[25517]: audit 2021-03-10T14:21:52.650965+0000 mon.c (mon.1) 553 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:21:53.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:21:53 gibba045 bash[25517]: audit 2021-03-10T14:21:52.651663+0000 mon.c (mon.1) 554 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:21:53.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:21:53 gibba045 bash[25517]: audit 2021-03-10T14:21:52.652094+0000 mon.a (mon.0) 811 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:21:53.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:21:53 gibba045 bash[25517]: audit 2021-03-10T14:21:52.652274+0000 mon.c (mon.1) 555 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T14:21:53.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:21:53 gibba045 bash[25517]: audit 2021-03-10T14:21:52.653177+0000 mon.c (mon.1) 556 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:21:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:21:53 gibba045 bash[25517]: audit 2021-03-10T14:21:52.653228+0000 mon.a (mon.0) 812 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:21:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:21:53 gibba045 bash[25517]: audit 2021-03-10T14:21:52.653859+0000 mon.c (mon.1) 557 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:21:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:21:53 gibba045 bash[25517]: audit 2021-03-10T14:21:52.654142+0000 mon.a (mon.0) 813 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T14:21:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:21:53 gibba045 bash[25517]: audit 2021-03-10T14:21:52.654659+0000 mon.c (mon.1) 558 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:21:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:21:53 gibba045 bash[25517]: audit 2021-03-10T14:21:52.655565+0000 mon.a (mon.0) 814 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:21:53.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:21:53 gibba045 bash[25517]: audit 2021-03-10T14:21:52.656567+0000 mon.a (mon.0) 815 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:21:53.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:21:53 gibba045 bash[25517]: audit 2021-03-10T14:21:52.657378+0000 mon.a (mon.0) 816 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:21:53.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:21:53 gibba015 bash[29377]: cluster 2021-03-10T14:21:52.320754+0000 mgr.gibba045.orlgmj (mgr.34412) 1790 : cluster [DBG] pgmap v1004: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:53.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:21:53 gibba015 bash[29377]: audit 2021-03-10T14:21:52.650965+0000 mon.c (mon.1) 553 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:21:53.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:21:53 gibba015 bash[29377]: audit 2021-03-10T14:21:52.651663+0000 mon.c (mon.1) 554 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:21:53.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:21:53 gibba015 bash[29377]: audit 2021-03-10T14:21:52.652094+0000 mon.a (mon.0) 811 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:21:53.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:21:53 gibba015 bash[29377]: audit 2021-03-10T14:21:52.652274+0000 mon.c (mon.1) 555 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T14:21:53.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:21:53 gibba015 bash[29377]: audit 2021-03-10T14:21:52.653177+0000 mon.c (mon.1) 556 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:21:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:21:53 gibba015 bash[29377]: audit 2021-03-10T14:21:52.653228+0000 mon.a (mon.0) 812 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:21:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:21:53 gibba015 bash[29377]: audit 2021-03-10T14:21:52.653859+0000 mon.c (mon.1) 557 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:21:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:21:53 gibba015 bash[29377]: audit 2021-03-10T14:21:52.654142+0000 mon.a (mon.0) 813 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T14:21:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:21:53 gibba015 bash[29377]: audit 2021-03-10T14:21:52.654659+0000 mon.c (mon.1) 558 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:21:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:21:53 gibba015 bash[29377]: audit 2021-03-10T14:21:52.655565+0000 mon.a (mon.0) 814 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:21:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:21:53 gibba015 bash[29377]: audit 2021-03-10T14:21:52.656567+0000 mon.a (mon.0) 815 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:21:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:21:53 gibba015 bash[29377]: audit 2021-03-10T14:21:52.657378+0000 mon.a (mon.0) 816 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:21:53.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:21:53 gibba015 bash[30343]: cluster 2021-03-10T14:21:52.320754+0000 mgr.gibba045.orlgmj (mgr.34412) 1790 : cluster [DBG] pgmap v1004: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:53.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:21:53 gibba015 bash[30343]: audit 2021-03-10T14:21:52.650965+0000 mon.c (mon.1) 553 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:21:53.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:21:53 gibba015 bash[30343]: audit 2021-03-10T14:21:52.651663+0000 mon.c (mon.1) 554 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:21:53.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:21:53 gibba015 bash[30343]: audit 2021-03-10T14:21:52.652094+0000 mon.a (mon.0) 811 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:21:53.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:21:53 gibba015 bash[30343]: audit 2021-03-10T14:21:52.652274+0000 mon.c (mon.1) 555 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T14:21:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:21:53 gibba015 bash[30343]: audit 2021-03-10T14:21:52.653177+0000 mon.c (mon.1) 556 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:21:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:21:53 gibba015 bash[30343]: audit 2021-03-10T14:21:52.653228+0000 mon.a (mon.0) 812 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:21:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:21:53 gibba015 bash[30343]: audit 2021-03-10T14:21:52.653859+0000 mon.c (mon.1) 557 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:21:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:21:53 gibba015 bash[30343]: audit 2021-03-10T14:21:52.654142+0000 mon.a (mon.0) 813 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T14:21:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:21:53 gibba015 bash[30343]: audit 2021-03-10T14:21:52.654659+0000 mon.c (mon.1) 558 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:21:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:21:53 gibba015 bash[30343]: audit 2021-03-10T14:21:52.655565+0000 mon.a (mon.0) 814 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:21:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:21:53 gibba015 bash[30343]: audit 2021-03-10T14:21:52.656567+0000 mon.a (mon.0) 815 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:21:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:21:53 gibba015 bash[30343]: audit 2021-03-10T14:21:52.657378+0000 mon.a (mon.0) 816 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:21:54.263 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:21:54.491 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:21:54.491 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (32m) 8m ago 37m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:21:54.491 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (37m) 7m ago 37m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:21:54.492 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (33m) 7m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:21:54.492 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (33m) 7m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:21:54.492 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (32m) 8m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:21:54.492 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (32m) 8m ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:21:54.493 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (31m) 7m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:21:54.493 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (31m) 8m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:21:54.493 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (38m) 8m ago 38m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:21:54.493 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (38m) 7m ago 38m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:21:54.494 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (30m) 8m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:21:54.494 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (30m) 8m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:21:54.494 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (30m) 8m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:21:54.494 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (29m) 8m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:21:54.495 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (29m) 7m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:21:54.495 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (28m) 7m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:21:54.495 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (28m) 7m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:21:54.495 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (27m) 7m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:21:54.495 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (37m) 7m ago 38m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:21:54.496 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 7m ago 36m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:21:54.746 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:21:54.747 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:21:54.747 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:21:54.747 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:21:54.747 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:21:54.747 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:21:54.748 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:21:54.748 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:21:54.748 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:21:54.748 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:21:54.749 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:21:54.749 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:21:54.749 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:21:54.749 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:21:54.749 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:21:55.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:21:55 gibba015 bash[29377]: audit 2021-03-10T14:21:54.254932+0000 mgr.gibba045.orlgmj (mgr.34412) 1791 : audit [DBG] from='client.55246 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:21:55.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:21:55 gibba015 bash[29377]: cluster 2021-03-10T14:21:54.322096+0000 mgr.gibba045.orlgmj (mgr.34412) 1792 : cluster [DBG] pgmap v1005: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:55.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:21:55 gibba015 bash[29377]: audit 2021-03-10T14:21:54.479241+0000 mgr.gibba045.orlgmj (mgr.34412) 1793 : audit [DBG] from='client.45264 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:21:55.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:21:55 gibba015 bash[29377]: audit 2021-03-10T14:21:54.743850+0000 mon.c (mon.1) 559 : audit [DBG] from='client.? 172.21.2.115:0/3262314269' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:21:55.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:21:55 gibba015 bash[30343]: audit 2021-03-10T14:21:54.254932+0000 mgr.gibba045.orlgmj (mgr.34412) 1791 : audit [DBG] from='client.55246 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:21:55.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:21:55 gibba015 bash[30343]: cluster 2021-03-10T14:21:54.322096+0000 mgr.gibba045.orlgmj (mgr.34412) 1792 : cluster [DBG] pgmap v1005: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:55.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:21:55 gibba015 bash[30343]: audit 2021-03-10T14:21:54.479241+0000 mgr.gibba045.orlgmj (mgr.34412) 1793 : audit [DBG] from='client.45264 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:21:55.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:21:55 gibba015 bash[30343]: audit 2021-03-10T14:21:54.743850+0000 mon.c (mon.1) 559 : audit [DBG] from='client.? 172.21.2.115:0/3262314269' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:21:55.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:21:55 gibba045 bash[25517]: audit 2021-03-10T14:21:54.254932+0000 mgr.gibba045.orlgmj (mgr.34412) 1791 : audit [DBG] from='client.55246 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:21:55.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:21:55 gibba045 bash[25517]: cluster 2021-03-10T14:21:54.322096+0000 mgr.gibba045.orlgmj (mgr.34412) 1792 : cluster [DBG] pgmap v1005: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:55.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:21:55 gibba045 bash[25517]: audit 2021-03-10T14:21:54.479241+0000 mgr.gibba045.orlgmj (mgr.34412) 1793 : audit [DBG] from='client.45264 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:21:55.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:21:55 gibba045 bash[25517]: audit 2021-03-10T14:21:54.743850+0000 mon.c (mon.1) 559 : audit [DBG] from='client.? 172.21.2.115:0/3262314269' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:21:57.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:21:57 gibba015 bash[29377]: cluster 2021-03-10T14:21:56.323818+0000 mgr.gibba045.orlgmj (mgr.34412) 1794 : cluster [DBG] pgmap v1006: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:57.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:21:57 gibba015 bash[30343]: cluster 2021-03-10T14:21:56.323818+0000 mgr.gibba045.orlgmj (mgr.34412) 1794 : cluster [DBG] pgmap v1006: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:57.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:21:57 gibba045 bash[25517]: cluster 2021-03-10T14:21:56.323818+0000 mgr.gibba045.orlgmj (mgr.34412) 1794 : cluster [DBG] pgmap v1006: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:59.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:21:59 gibba015 bash[29377]: cluster 2021-03-10T14:21:58.325594+0000 mgr.gibba045.orlgmj (mgr.34412) 1795 : cluster [DBG] pgmap v1007: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:59.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:21:59 gibba015 bash[30343]: cluster 2021-03-10T14:21:58.325594+0000 mgr.gibba045.orlgmj (mgr.34412) 1795 : cluster [DBG] pgmap v1007: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:59.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:21:59 gibba045 bash[25517]: cluster 2021-03-10T14:21:58.325594+0000 mgr.gibba045.orlgmj (mgr.34412) 1795 : cluster [DBG] pgmap v1007: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:01.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:22:01 gibba015 bash[29377]: cluster 2021-03-10T14:22:00.327115+0000 mgr.gibba045.orlgmj (mgr.34412) 1796 : cluster [DBG] pgmap v1008: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:01.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:22:01 gibba015 bash[30343]: cluster 2021-03-10T14:22:00.327115+0000 mgr.gibba045.orlgmj (mgr.34412) 1796 : cluster [DBG] pgmap v1008: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:01.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:22:01 gibba045 bash[25517]: cluster 2021-03-10T14:22:00.327115+0000 mgr.gibba045.orlgmj (mgr.34412) 1796 : cluster [DBG] pgmap v1008: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:03.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:22:03 gibba045 bash[25517]: cluster 2021-03-10T14:22:02.327966+0000 mgr.gibba045.orlgmj (mgr.34412) 1797 : cluster [DBG] pgmap v1009: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:03.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:22:03 gibba015 bash[29377]: cluster 2021-03-10T14:22:02.327966+0000 mgr.gibba045.orlgmj (mgr.34412) 1797 : cluster [DBG] pgmap v1009: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:03.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:22:03 gibba015 bash[30343]: cluster 2021-03-10T14:22:02.327966+0000 mgr.gibba045.orlgmj (mgr.34412) 1797 : cluster [DBG] pgmap v1009: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:05.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:22:05 gibba045 bash[25517]: cluster 2021-03-10T14:22:04.329115+0000 mgr.gibba045.orlgmj (mgr.34412) 1798 : cluster [DBG] pgmap v1010: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:05.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:22:05 gibba015 bash[29377]: cluster 2021-03-10T14:22:04.329115+0000 mgr.gibba045.orlgmj (mgr.34412) 1798 : cluster [DBG] pgmap v1010: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:05.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:22:05 gibba015 bash[30343]: cluster 2021-03-10T14:22:04.329115+0000 mgr.gibba045.orlgmj (mgr.34412) 1798 : cluster [DBG] pgmap v1010: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:06.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:22:06 gibba015 bash[29377]: cephadm 2021-03-10T14:22:05.232847+0000 mgr.gibba045.orlgmj (mgr.34412) 1799 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:22:06.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:22:06 gibba015 bash[30343]: cephadm 2021-03-10T14:22:05.232847+0000 mgr.gibba045.orlgmj (mgr.34412) 1799 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:22:06.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:22:06 gibba045 bash[25517]: cephadm 2021-03-10T14:22:05.232847+0000 mgr.gibba045.orlgmj (mgr.34412) 1799 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:22:07.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:22:07 gibba015 bash[29377]: cluster 2021-03-10T14:22:06.330858+0000 mgr.gibba045.orlgmj (mgr.34412) 1800 : cluster [DBG] pgmap v1011: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:07.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:22:07 gibba015 bash[30343]: cluster 2021-03-10T14:22:06.330858+0000 mgr.gibba045.orlgmj (mgr.34412) 1800 : cluster [DBG] pgmap v1011: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:07.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:22:07 gibba045 bash[25517]: cluster 2021-03-10T14:22:06.330858+0000 mgr.gibba045.orlgmj (mgr.34412) 1800 : cluster [DBG] pgmap v1011: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:09.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:22:09 gibba015 bash[29377]: cluster 2021-03-10T14:22:08.332573+0000 mgr.gibba045.orlgmj (mgr.34412) 1801 : cluster [DBG] pgmap v1012: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:09.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:22:09 gibba015 bash[30343]: cluster 2021-03-10T14:22:08.332573+0000 mgr.gibba045.orlgmj (mgr.34412) 1801 : cluster [DBG] pgmap v1012: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:09.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:22:09 gibba045 bash[25517]: cluster 2021-03-10T14:22:08.332573+0000 mgr.gibba045.orlgmj (mgr.34412) 1801 : cluster [DBG] pgmap v1012: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:11.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:22:11 gibba015 bash[29377]: cluster 2021-03-10T14:22:10.334216+0000 mgr.gibba045.orlgmj (mgr.34412) 1802 : cluster [DBG] pgmap v1013: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:11.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:22:11 gibba015 bash[30343]: cluster 2021-03-10T14:22:10.334216+0000 mgr.gibba045.orlgmj (mgr.34412) 1802 : cluster [DBG] pgmap v1013: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:11.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:22:11 gibba045 bash[25517]: cluster 2021-03-10T14:22:10.334216+0000 mgr.gibba045.orlgmj (mgr.34412) 1802 : cluster [DBG] pgmap v1013: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:13.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:22:13 gibba045 bash[25517]: cluster 2021-03-10T14:22:12.335042+0000 mgr.gibba045.orlgmj (mgr.34412) 1803 : cluster [DBG] pgmap v1014: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:13.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:22:13 gibba015 bash[29377]: cluster 2021-03-10T14:22:12.335042+0000 mgr.gibba045.orlgmj (mgr.34412) 1803 : cluster [DBG] pgmap v1014: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:13.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:22:13 gibba015 bash[30343]: cluster 2021-03-10T14:22:12.335042+0000 mgr.gibba045.orlgmj (mgr.34412) 1803 : cluster [DBG] pgmap v1014: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:15.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:22:15 gibba015 bash[29377]: cluster 2021-03-10T14:22:14.336129+0000 mgr.gibba045.orlgmj (mgr.34412) 1804 : cluster [DBG] pgmap v1015: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:15.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:22:15 gibba015 bash[30343]: cluster 2021-03-10T14:22:14.336129+0000 mgr.gibba045.orlgmj (mgr.34412) 1804 : cluster [DBG] pgmap v1015: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:15.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:22:15 gibba045 bash[25517]: cluster 2021-03-10T14:22:14.336129+0000 mgr.gibba045.orlgmj (mgr.34412) 1804 : cluster [DBG] pgmap v1015: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:17.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:22:17 gibba015 bash[29377]: cluster 2021-03-10T14:22:16.337663+0000 mgr.gibba045.orlgmj (mgr.34412) 1805 : cluster [DBG] pgmap v1016: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:17.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:22:17 gibba015 bash[30343]: cluster 2021-03-10T14:22:16.337663+0000 mgr.gibba045.orlgmj (mgr.34412) 1805 : cluster [DBG] pgmap v1016: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:17.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:22:17 gibba045 bash[25517]: cluster 2021-03-10T14:22:16.337663+0000 mgr.gibba045.orlgmj (mgr.34412) 1805 : cluster [DBG] pgmap v1016: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:19.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:22:19 gibba015 bash[29377]: cluster 2021-03-10T14:22:18.339307+0000 mgr.gibba045.orlgmj (mgr.34412) 1806 : cluster [DBG] pgmap v1017: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:19.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:22:19 gibba015 bash[30343]: cluster 2021-03-10T14:22:18.339307+0000 mgr.gibba045.orlgmj (mgr.34412) 1806 : cluster [DBG] pgmap v1017: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:19.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:22:19 gibba045 bash[25517]: cluster 2021-03-10T14:22:18.339307+0000 mgr.gibba045.orlgmj (mgr.34412) 1806 : cluster [DBG] pgmap v1017: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:21.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:22:21 gibba015 bash[29377]: cephadm 2021-03-10T14:22:20.238056+0000 mgr.gibba045.orlgmj (mgr.34412) 1807 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:22:21.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:22:21 gibba015 bash[29377]: cluster 2021-03-10T14:22:20.341009+0000 mgr.gibba045.orlgmj (mgr.34412) 1808 : cluster [DBG] pgmap v1018: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:21.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:22:21 gibba015 bash[30343]: cephadm 2021-03-10T14:22:20.238056+0000 mgr.gibba045.orlgmj (mgr.34412) 1807 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:22:21.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:22:21 gibba015 bash[30343]: cluster 2021-03-10T14:22:20.341009+0000 mgr.gibba045.orlgmj (mgr.34412) 1808 : cluster [DBG] pgmap v1018: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:21.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:22:21 gibba045 bash[25517]: cephadm 2021-03-10T14:22:20.238056+0000 mgr.gibba045.orlgmj (mgr.34412) 1807 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:22:21.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:22:21 gibba045 bash[25517]: cluster 2021-03-10T14:22:20.341009+0000 mgr.gibba045.orlgmj (mgr.34412) 1808 : cluster [DBG] pgmap v1018: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:23.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:22:23 gibba015 bash[29377]: cluster 2021-03-10T14:22:22.342608+0000 mgr.gibba045.orlgmj (mgr.34412) 1809 : cluster [DBG] pgmap v1019: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:23.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:22:23 gibba015 bash[30343]: cluster 2021-03-10T14:22:22.342608+0000 mgr.gibba045.orlgmj (mgr.34412) 1809 : cluster [DBG] pgmap v1019: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:23.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:22:23 gibba045 bash[25517]: cluster 2021-03-10T14:22:22.342608+0000 mgr.gibba045.orlgmj (mgr.34412) 1809 : cluster [DBG] pgmap v1019: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:24.992 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:22:25.221 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:22:25.221 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (33m) 9m ago 38m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:22:25.221 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (38m) 7m ago 38m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:22:25.222 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (33m) 7m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:22:25.222 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (33m) 7m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:22:25.222 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (32m) 9m ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:22:25.222 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (32m) 9m ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:22:25.223 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (32m) 7m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:22:25.223 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (32m) 9m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:22:25.223 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (38m) 9m ago 38m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:22:25.223 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (38m) 7m ago 38m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:22:25.223 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (31m) 9m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:22:25.224 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (31m) 9m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:22:25.224 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (30m) 9m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:22:25.224 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (30m) 9m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:22:25.224 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (29m) 7m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:22:25.225 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (29m) 7m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:22:25.225 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (28m) 7m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:22:25.225 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (28m) 7m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:22:25.225 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (38m) 7m ago 38m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:22:25.225 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 7m ago 36m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:22:25.472 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:22:25.473 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:22:25.473 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:22:25.474 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:22:25.474 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:22:25.475 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:22:25.475 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:22:25.476 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:22:25.477 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:22:25.477 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:22:25.478 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:22:25.482 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:22:25.483 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:22:25.484 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:22:25.484 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:22:25.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:22:25 gibba015 bash[29377]: cluster 2021-03-10T14:22:24.344081+0000 mgr.gibba045.orlgmj (mgr.34412) 1810 : cluster [DBG] pgmap v1020: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:25.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:22:25 gibba015 bash[30343]: cluster 2021-03-10T14:22:24.344081+0000 mgr.gibba045.orlgmj (mgr.34412) 1810 : cluster [DBG] pgmap v1020: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:25.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:22:25 gibba045 bash[25517]: cluster 2021-03-10T14:22:24.344081+0000 mgr.gibba045.orlgmj (mgr.34412) 1810 : cluster [DBG] pgmap v1020: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:26.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:22:26 gibba015 bash[29377]: audit 2021-03-10T14:22:24.984127+0000 mgr.gibba045.orlgmj (mgr.34412) 1811 : audit [DBG] from='client.55264 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:22:26.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:22:26 gibba015 bash[29377]: audit 2021-03-10T14:22:25.209529+0000 mgr.gibba045.orlgmj (mgr.34412) 1812 : audit [DBG] from='client.45282 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:22:26.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:22:26 gibba015 bash[29377]: audit 2021-03-10T14:22:25.469054+0000 mon.c (mon.1) 560 : audit [DBG] from='client.? 172.21.2.115:0/2559121139' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:22:26.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:22:26 gibba015 bash[30343]: audit 2021-03-10T14:22:24.984127+0000 mgr.gibba045.orlgmj (mgr.34412) 1811 : audit [DBG] from='client.55264 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:22:26.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:22:26 gibba015 bash[30343]: audit 2021-03-10T14:22:25.209529+0000 mgr.gibba045.orlgmj (mgr.34412) 1812 : audit [DBG] from='client.45282 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:22:26.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:22:26 gibba015 bash[30343]: audit 2021-03-10T14:22:25.469054+0000 mon.c (mon.1) 560 : audit [DBG] from='client.? 172.21.2.115:0/2559121139' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:22:26.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:22:26 gibba045 bash[25517]: audit 2021-03-10T14:22:24.984127+0000 mgr.gibba045.orlgmj (mgr.34412) 1811 : audit [DBG] from='client.55264 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:22:26.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:22:26 gibba045 bash[25517]: audit 2021-03-10T14:22:25.209529+0000 mgr.gibba045.orlgmj (mgr.34412) 1812 : audit [DBG] from='client.45282 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:22:26.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:22:26 gibba045 bash[25517]: audit 2021-03-10T14:22:25.469054+0000 mon.c (mon.1) 560 : audit [DBG] from='client.? 172.21.2.115:0/2559121139' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:22:27.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:22:27 gibba015 bash[29377]: cluster 2021-03-10T14:22:26.346010+0000 mgr.gibba045.orlgmj (mgr.34412) 1813 : cluster [DBG] pgmap v1021: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:27.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:22:27 gibba015 bash[30343]: cluster 2021-03-10T14:22:26.346010+0000 mgr.gibba045.orlgmj (mgr.34412) 1813 : cluster [DBG] pgmap v1021: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:27.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:22:27 gibba045 bash[25517]: cluster 2021-03-10T14:22:26.346010+0000 mgr.gibba045.orlgmj (mgr.34412) 1813 : cluster [DBG] pgmap v1021: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:29.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:22:29 gibba015 bash[29377]: cluster 2021-03-10T14:22:28.347426+0000 mgr.gibba045.orlgmj (mgr.34412) 1814 : cluster [DBG] pgmap v1022: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:29.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:22:29 gibba015 bash[30343]: cluster 2021-03-10T14:22:28.347426+0000 mgr.gibba045.orlgmj (mgr.34412) 1814 : cluster [DBG] pgmap v1022: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:29.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:22:29 gibba045 bash[25517]: cluster 2021-03-10T14:22:28.347426+0000 mgr.gibba045.orlgmj (mgr.34412) 1814 : cluster [DBG] pgmap v1022: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:31.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:22:31 gibba015 bash[29377]: cluster 2021-03-10T14:22:30.348930+0000 mgr.gibba045.orlgmj (mgr.34412) 1815 : cluster [DBG] pgmap v1023: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:31.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:22:31 gibba015 bash[30343]: cluster 2021-03-10T14:22:30.348930+0000 mgr.gibba045.orlgmj (mgr.34412) 1815 : cluster [DBG] pgmap v1023: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:31.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:22:31 gibba045 bash[25517]: cluster 2021-03-10T14:22:30.348930+0000 mgr.gibba045.orlgmj (mgr.34412) 1815 : cluster [DBG] pgmap v1023: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:33.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:22:33 gibba015 bash[29377]: cluster 2021-03-10T14:22:32.349974+0000 mgr.gibba045.orlgmj (mgr.34412) 1816 : cluster [DBG] pgmap v1024: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:33.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:22:33 gibba015 bash[30343]: cluster 2021-03-10T14:22:32.349974+0000 mgr.gibba045.orlgmj (mgr.34412) 1816 : cluster [DBG] pgmap v1024: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:33.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:22:33 gibba045 bash[25517]: cluster 2021-03-10T14:22:32.349974+0000 mgr.gibba045.orlgmj (mgr.34412) 1816 : cluster [DBG] pgmap v1024: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:35.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:22:35 gibba015 bash[29377]: cluster 2021-03-10T14:22:34.351111+0000 mgr.gibba045.orlgmj (mgr.34412) 1817 : cluster [DBG] pgmap v1025: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:35.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:22:35 gibba015 bash[29377]: audit 2021-03-10T14:22:35.251583+0000 mon.c (mon.1) 561 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:22:35.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:22:35 gibba015 bash[30343]: cluster 2021-03-10T14:22:34.351111+0000 mgr.gibba045.orlgmj (mgr.34412) 1817 : cluster [DBG] pgmap v1025: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:35.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:22:35 gibba015 bash[30343]: audit 2021-03-10T14:22:35.251583+0000 mon.c (mon.1) 561 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:22:35.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:22:35 gibba045 bash[25517]: cluster 2021-03-10T14:22:34.351111+0000 mgr.gibba045.orlgmj (mgr.34412) 1817 : cluster [DBG] pgmap v1025: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:35.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:22:35 gibba045 bash[25517]: audit 2021-03-10T14:22:35.251583+0000 mon.c (mon.1) 561 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:22:36.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:22:36 gibba045 bash[25517]: cephadm 2021-03-10T14:22:35.260266+0000 mgr.gibba045.orlgmj (mgr.34412) 1818 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:22:36.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:22:36 gibba045 bash[25517]: cephadm 2021-03-10T14:22:35.261841+0000 mgr.gibba045.orlgmj (mgr.34412) 1819 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:22:36.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:22:36 gibba045 bash[25517]: audit 2021-03-10T14:22:35.477225+0000 mon.a (mon.0) 817 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:22:36.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:22:36 gibba045 bash[25517]: audit 2021-03-10T14:22:35.481216+0000 mon.c (mon.1) 562 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:22:36.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:22:36 gibba045 bash[25517]: cephadm 2021-03-10T14:22:35.483274+0000 mgr.gibba045.orlgmj (mgr.34412) 1820 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:22:36.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:22:36 gibba045 bash[25517]: audit 2021-03-10T14:22:35.484354+0000 mon.c (mon.1) 563 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:22:36.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:22:36 gibba045 bash[25517]: cephadm 2021-03-10T14:22:35.486747+0000 mgr.gibba045.orlgmj (mgr.34412) 1821 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:22:36.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:22:36 gibba045 bash[25517]: audit 2021-03-10T14:22:35.486978+0000 mon.c (mon.1) 564 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:22:36.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:22:36 gibba045 bash[25517]: cephadm 2021-03-10T14:22:35.489387+0000 mgr.gibba045.orlgmj (mgr.34412) 1822 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:22:36.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:22:36 gibba045 bash[25517]: cephadm 2021-03-10T14:22:35.489426+0000 mgr.gibba045.orlgmj (mgr.34412) 1823 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:22:36.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:22:36 gibba045 bash[25517]: audit 2021-03-10T14:22:35.489491+0000 mon.c (mon.1) 565 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:22:36.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:22:36 gibba045 bash[25517]: cephadm 2021-03-10T14:22:35.492037+0000 mgr.gibba045.orlgmj (mgr.34412) 1824 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:22:36.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:22:36 gibba045 bash[25517]: cephadm 2021-03-10T14:22:35.492091+0000 mgr.gibba045.orlgmj (mgr.34412) 1825 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:22:36.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:22:36 gibba045 bash[25517]: cephadm 2021-03-10T14:22:35.494199+0000 mgr.gibba045.orlgmj (mgr.34412) 1826 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:22:36.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:22:36 gibba045 bash[25517]: audit 2021-03-10T14:22:35.495469+0000 mon.c (mon.1) 566 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:22:36.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:22:36 gibba045 bash[25517]: cephadm 2021-03-10T14:22:35.497850+0000 mgr.gibba045.orlgmj (mgr.34412) 1827 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:22:36.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:22:36 gibba045 bash[25517]: cephadm 2021-03-10T14:22:35.497888+0000 mgr.gibba045.orlgmj (mgr.34412) 1828 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:22:36.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:22:36 gibba045 bash[25517]: audit 2021-03-10T14:22:35.498138+0000 mon.c (mon.1) 567 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:22:36.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:22:36 gibba045 bash[25517]: cephadm 2021-03-10T14:22:35.500254+0000 mgr.gibba045.orlgmj (mgr.34412) 1829 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:22:36.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:22:36 gibba045 bash[25517]: cephadm 2021-03-10T14:22:35.500709+0000 mgr.gibba045.orlgmj (mgr.34412) 1830 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:22:36.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:22:36 gibba045 bash[25517]: cephadm 2021-03-10T14:22:35.504019+0000 mgr.gibba045.orlgmj (mgr.34412) 1831 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:22:36.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:22:36 gibba045 bash[25517]: cephadm 2021-03-10T14:22:35.504343+0000 mgr.gibba045.orlgmj (mgr.34412) 1832 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:22:36.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:22:36 gibba045 bash[25517]: cephadm 2021-03-10T14:22:35.505251+0000 mgr.gibba045.orlgmj (mgr.34412) 1833 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:22:36.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:22:36 gibba015 bash[29377]: cephadm 2021-03-10T14:22:35.260266+0000 mgr.gibba045.orlgmj (mgr.34412) 1818 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:22:36.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:22:36 gibba015 bash[29377]: cephadm 2021-03-10T14:22:35.261841+0000 mgr.gibba045.orlgmj (mgr.34412) 1819 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:22:36.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:22:36 gibba015 bash[29377]: audit 2021-03-10T14:22:35.477225+0000 mon.a (mon.0) 817 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:22:36.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:22:36 gibba015 bash[29377]: audit 2021-03-10T14:22:35.481216+0000 mon.c (mon.1) 562 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:22:36.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:22:36 gibba015 bash[29377]: cephadm 2021-03-10T14:22:35.483274+0000 mgr.gibba045.orlgmj (mgr.34412) 1820 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:22:36.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:22:36 gibba015 bash[29377]: audit 2021-03-10T14:22:35.484354+0000 mon.c (mon.1) 563 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:22:36.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:22:36 gibba015 bash[29377]: cephadm 2021-03-10T14:22:35.486747+0000 mgr.gibba045.orlgmj (mgr.34412) 1821 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:22:36.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:22:36 gibba015 bash[29377]: audit 2021-03-10T14:22:35.486978+0000 mon.c (mon.1) 564 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:22:36.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:22:36 gibba015 bash[29377]: cephadm 2021-03-10T14:22:35.489387+0000 mgr.gibba045.orlgmj (mgr.34412) 1822 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:22:36.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:22:36 gibba015 bash[29377]: cephadm 2021-03-10T14:22:35.489426+0000 mgr.gibba045.orlgmj (mgr.34412) 1823 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:22:36.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:22:36 gibba015 bash[29377]: audit 2021-03-10T14:22:35.489491+0000 mon.c (mon.1) 565 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:22:36.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:22:36 gibba015 bash[29377]: cephadm 2021-03-10T14:22:35.492037+0000 mgr.gibba045.orlgmj (mgr.34412) 1824 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:22:36.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:22:36 gibba015 bash[29377]: cephadm 2021-03-10T14:22:35.492091+0000 mgr.gibba045.orlgmj (mgr.34412) 1825 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:22:36.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:22:36 gibba015 bash[29377]: cephadm 2021-03-10T14:22:35.494199+0000 mgr.gibba045.orlgmj (mgr.34412) 1826 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:22:36.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:22:36 gibba015 bash[29377]: audit 2021-03-10T14:22:35.495469+0000 mon.c (mon.1) 566 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:22:36.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:22:36 gibba015 bash[29377]: cephadm 2021-03-10T14:22:35.497850+0000 mgr.gibba045.orlgmj (mgr.34412) 1827 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:22:36.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:22:36 gibba015 bash[29377]: cephadm 2021-03-10T14:22:35.497888+0000 mgr.gibba045.orlgmj (mgr.34412) 1828 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:22:36.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:22:36 gibba015 bash[29377]: audit 2021-03-10T14:22:35.498138+0000 mon.c (mon.1) 567 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:22:36.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:22:36 gibba015 bash[29377]: cephadm 2021-03-10T14:22:35.500254+0000 mgr.gibba045.orlgmj (mgr.34412) 1829 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:22:36.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:22:36 gibba015 bash[29377]: cephadm 2021-03-10T14:22:35.500709+0000 mgr.gibba045.orlgmj (mgr.34412) 1830 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:22:36.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:22:36 gibba015 bash[29377]: cephadm 2021-03-10T14:22:35.504019+0000 mgr.gibba045.orlgmj (mgr.34412) 1831 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:22:36.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:22:36 gibba015 bash[29377]: cephadm 2021-03-10T14:22:35.504343+0000 mgr.gibba045.orlgmj (mgr.34412) 1832 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:22:36.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:22:36 gibba015 bash[29377]: cephadm 2021-03-10T14:22:35.505251+0000 mgr.gibba045.orlgmj (mgr.34412) 1833 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:22:36.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:22:36 gibba015 bash[30343]: cephadm 2021-03-10T14:22:35.260266+0000 mgr.gibba045.orlgmj (mgr.34412) 1818 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:22:36.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:22:36 gibba015 bash[30343]: cephadm 2021-03-10T14:22:35.261841+0000 mgr.gibba045.orlgmj (mgr.34412) 1819 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:22:36.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:22:36 gibba015 bash[30343]: audit 2021-03-10T14:22:35.477225+0000 mon.a (mon.0) 817 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:22:36.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:22:36 gibba015 bash[30343]: audit 2021-03-10T14:22:35.481216+0000 mon.c (mon.1) 562 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:22:36.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:22:36 gibba015 bash[30343]: cephadm 2021-03-10T14:22:35.483274+0000 mgr.gibba045.orlgmj (mgr.34412) 1820 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:22:36.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:22:36 gibba015 bash[30343]: audit 2021-03-10T14:22:35.484354+0000 mon.c (mon.1) 563 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:22:36.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:22:36 gibba015 bash[30343]: cephadm 2021-03-10T14:22:35.486747+0000 mgr.gibba045.orlgmj (mgr.34412) 1821 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:22:36.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:22:36 gibba015 bash[30343]: audit 2021-03-10T14:22:35.486978+0000 mon.c (mon.1) 564 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:22:36.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:22:36 gibba015 bash[30343]: cephadm 2021-03-10T14:22:35.489387+0000 mgr.gibba045.orlgmj (mgr.34412) 1822 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:22:36.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:22:36 gibba015 bash[30343]: cephadm 2021-03-10T14:22:35.489426+0000 mgr.gibba045.orlgmj (mgr.34412) 1823 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:22:36.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:22:36 gibba015 bash[30343]: audit 2021-03-10T14:22:35.489491+0000 mon.c (mon.1) 565 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:22:36.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:22:36 gibba015 bash[30343]: cephadm 2021-03-10T14:22:35.492037+0000 mgr.gibba045.orlgmj (mgr.34412) 1824 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:22:36.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:22:36 gibba015 bash[30343]: cephadm 2021-03-10T14:22:35.492091+0000 mgr.gibba045.orlgmj (mgr.34412) 1825 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:22:36.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:22:36 gibba015 bash[30343]: cephadm 2021-03-10T14:22:35.494199+0000 mgr.gibba045.orlgmj (mgr.34412) 1826 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:22:36.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:22:36 gibba015 bash[30343]: audit 2021-03-10T14:22:35.495469+0000 mon.c (mon.1) 566 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:22:36.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:22:36 gibba015 bash[30343]: cephadm 2021-03-10T14:22:35.497850+0000 mgr.gibba045.orlgmj (mgr.34412) 1827 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:22:36.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:22:36 gibba015 bash[30343]: cephadm 2021-03-10T14:22:35.497888+0000 mgr.gibba045.orlgmj (mgr.34412) 1828 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:22:36.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:22:36 gibba015 bash[30343]: audit 2021-03-10T14:22:35.498138+0000 mon.c (mon.1) 567 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:22:36.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:22:36 gibba015 bash[30343]: cephadm 2021-03-10T14:22:35.500254+0000 mgr.gibba045.orlgmj (mgr.34412) 1829 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:22:36.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:22:36 gibba015 bash[30343]: cephadm 2021-03-10T14:22:35.500709+0000 mgr.gibba045.orlgmj (mgr.34412) 1830 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:22:36.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:22:36 gibba015 bash[30343]: cephadm 2021-03-10T14:22:35.504019+0000 mgr.gibba045.orlgmj (mgr.34412) 1831 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:22:36.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:22:36 gibba015 bash[30343]: cephadm 2021-03-10T14:22:35.504343+0000 mgr.gibba045.orlgmj (mgr.34412) 1832 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:22:36.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:22:36 gibba015 bash[30343]: cephadm 2021-03-10T14:22:35.505251+0000 mgr.gibba045.orlgmj (mgr.34412) 1833 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:22:37.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:22:37 gibba045 bash[25517]: cluster 2021-03-10T14:22:36.353174+0000 mgr.gibba045.orlgmj (mgr.34412) 1834 : cluster [DBG] pgmap v1026: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:37.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:22:37 gibba015 bash[29377]: cluster 2021-03-10T14:22:36.353174+0000 mgr.gibba045.orlgmj (mgr.34412) 1834 : cluster [DBG] pgmap v1026: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:37.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:22:37 gibba015 bash[30343]: cluster 2021-03-10T14:22:36.353174+0000 mgr.gibba045.orlgmj (mgr.34412) 1834 : cluster [DBG] pgmap v1026: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:39.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:22:39 gibba045 bash[25517]: cluster 2021-03-10T14:22:38.354684+0000 mgr.gibba045.orlgmj (mgr.34412) 1835 : cluster [DBG] pgmap v1027: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:39.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:22:39 gibba015 bash[29377]: cluster 2021-03-10T14:22:38.354684+0000 mgr.gibba045.orlgmj (mgr.34412) 1835 : cluster [DBG] pgmap v1027: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:39.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:22:39 gibba015 bash[30343]: cluster 2021-03-10T14:22:38.354684+0000 mgr.gibba045.orlgmj (mgr.34412) 1835 : cluster [DBG] pgmap v1027: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:41.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:22:41 gibba045 bash[25517]: cluster 2021-03-10T14:22:40.356309+0000 mgr.gibba045.orlgmj (mgr.34412) 1836 : cluster [DBG] pgmap v1028: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:41.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:22:41 gibba015 bash[29377]: cluster 2021-03-10T14:22:40.356309+0000 mgr.gibba045.orlgmj (mgr.34412) 1836 : cluster [DBG] pgmap v1028: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:41.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:22:41 gibba015 bash[30343]: cluster 2021-03-10T14:22:40.356309+0000 mgr.gibba045.orlgmj (mgr.34412) 1836 : cluster [DBG] pgmap v1028: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:43.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:22:43 gibba015 bash[29377]: cluster 2021-03-10T14:22:42.357857+0000 mgr.gibba045.orlgmj (mgr.34412) 1837 : cluster [DBG] pgmap v1029: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:43.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:22:43 gibba015 bash[30343]: cluster 2021-03-10T14:22:42.357857+0000 mgr.gibba045.orlgmj (mgr.34412) 1837 : cluster [DBG] pgmap v1029: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:43.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:22:43 gibba045 bash[25517]: cluster 2021-03-10T14:22:42.357857+0000 mgr.gibba045.orlgmj (mgr.34412) 1837 : cluster [DBG] pgmap v1029: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:45.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:22:45 gibba015 bash[29377]: cluster 2021-03-10T14:22:44.359375+0000 mgr.gibba045.orlgmj (mgr.34412) 1838 : cluster [DBG] pgmap v1030: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:45.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:22:45 gibba015 bash[30343]: cluster 2021-03-10T14:22:44.359375+0000 mgr.gibba045.orlgmj (mgr.34412) 1838 : cluster [DBG] pgmap v1030: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:45.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:22:45 gibba045 bash[25517]: cluster 2021-03-10T14:22:44.359375+0000 mgr.gibba045.orlgmj (mgr.34412) 1838 : cluster [DBG] pgmap v1030: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:47.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:22:47 gibba015 bash[29377]: cluster 2021-03-10T14:22:46.361260+0000 mgr.gibba045.orlgmj (mgr.34412) 1839 : cluster [DBG] pgmap v1031: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:47.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:22:47 gibba015 bash[30343]: cluster 2021-03-10T14:22:46.361260+0000 mgr.gibba045.orlgmj (mgr.34412) 1839 : cluster [DBG] pgmap v1031: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:47.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:22:47 gibba045 bash[25517]: cluster 2021-03-10T14:22:46.361260+0000 mgr.gibba045.orlgmj (mgr.34412) 1839 : cluster [DBG] pgmap v1031: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:49.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:22:49 gibba015 bash[29377]: cluster 2021-03-10T14:22:48.362788+0000 mgr.gibba045.orlgmj (mgr.34412) 1840 : cluster [DBG] pgmap v1032: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:49.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:22:49 gibba015 bash[30343]: cluster 2021-03-10T14:22:48.362788+0000 mgr.gibba045.orlgmj (mgr.34412) 1840 : cluster [DBG] pgmap v1032: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:49.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:22:49 gibba045 bash[25517]: cluster 2021-03-10T14:22:48.362788+0000 mgr.gibba045.orlgmj (mgr.34412) 1840 : cluster [DBG] pgmap v1032: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:51.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:22:51 gibba015 bash[29377]: cluster 2021-03-10T14:22:50.364503+0000 mgr.gibba045.orlgmj (mgr.34412) 1841 : cluster [DBG] pgmap v1033: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:51.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:22:51 gibba015 bash[29377]: cephadm 2021-03-10T14:22:50.521401+0000 mgr.gibba045.orlgmj (mgr.34412) 1842 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:22:51.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:22:51 gibba015 bash[30343]: cluster 2021-03-10T14:22:50.364503+0000 mgr.gibba045.orlgmj (mgr.34412) 1841 : cluster [DBG] pgmap v1033: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:51.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:22:51 gibba015 bash[30343]: cephadm 2021-03-10T14:22:50.521401+0000 mgr.gibba045.orlgmj (mgr.34412) 1842 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:22:51.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:22:51 gibba045 bash[25517]: cluster 2021-03-10T14:22:50.364503+0000 mgr.gibba045.orlgmj (mgr.34412) 1841 : cluster [DBG] pgmap v1033: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:51.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:22:51 gibba045 bash[25517]: cephadm 2021-03-10T14:22:50.521401+0000 mgr.gibba045.orlgmj (mgr.34412) 1842 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:22:53.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:22:53 gibba015 bash[29377]: cluster 2021-03-10T14:22:52.365597+0000 mgr.gibba045.orlgmj (mgr.34412) 1843 : cluster [DBG] pgmap v1034: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:53.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:22:53 gibba015 bash[29377]: audit 2021-03-10T14:22:52.656799+0000 mon.c (mon.1) 568 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:22:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:22:53 gibba015 bash[29377]: audit 2021-03-10T14:22:52.657491+0000 mon.c (mon.1) 569 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:22:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:22:53 gibba015 bash[29377]: audit 2021-03-10T14:22:52.658078+0000 mon.a (mon.0) 818 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:22:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:22:53 gibba015 bash[29377]: audit 2021-03-10T14:22:52.658271+0000 mon.c (mon.1) 570 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T14:22:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:22:53 gibba015 bash[29377]: audit 2021-03-10T14:22:52.659094+0000 mon.c (mon.1) 571 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:22:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:22:53 gibba015 bash[29377]: audit 2021-03-10T14:22:52.659161+0000 mon.a (mon.0) 819 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:22:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:22:53 gibba015 bash[29377]: audit 2021-03-10T14:22:52.659766+0000 mon.c (mon.1) 572 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:22:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:22:53 gibba015 bash[29377]: audit 2021-03-10T14:22:52.660062+0000 mon.a (mon.0) 820 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T14:22:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:22:53 gibba015 bash[29377]: audit 2021-03-10T14:22:52.660600+0000 mon.c (mon.1) 573 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:22:53.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:22:53 gibba015 bash[29377]: audit 2021-03-10T14:22:52.661278+0000 mon.a (mon.0) 821 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:22:53.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:22:53 gibba015 bash[29377]: audit 2021-03-10T14:22:52.662257+0000 mon.a (mon.0) 822 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:22:53.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:22:53 gibba015 bash[29377]: audit 2021-03-10T14:22:52.663014+0000 mon.a (mon.0) 823 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:22:53.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:22:53 gibba015 bash[30343]: cluster 2021-03-10T14:22:52.365597+0000 mgr.gibba045.orlgmj (mgr.34412) 1843 : cluster [DBG] pgmap v1034: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:22:53 gibba015 bash[30343]: audit 2021-03-10T14:22:52.656799+0000 mon.c (mon.1) 568 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:22:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:22:53 gibba015 bash[30343]: audit 2021-03-10T14:22:52.657491+0000 mon.c (mon.1) 569 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:22:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:22:53 gibba015 bash[30343]: audit 2021-03-10T14:22:52.658078+0000 mon.a (mon.0) 818 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:22:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:22:53 gibba015 bash[30343]: audit 2021-03-10T14:22:52.658271+0000 mon.c (mon.1) 570 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T14:22:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:22:53 gibba015 bash[30343]: audit 2021-03-10T14:22:52.659094+0000 mon.c (mon.1) 571 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:22:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:22:53 gibba015 bash[30343]: audit 2021-03-10T14:22:52.659161+0000 mon.a (mon.0) 819 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:22:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:22:53 gibba015 bash[30343]: audit 2021-03-10T14:22:52.659766+0000 mon.c (mon.1) 572 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:22:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:22:53 gibba015 bash[30343]: audit 2021-03-10T14:22:52.660062+0000 mon.a (mon.0) 820 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T14:22:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:22:53 gibba015 bash[30343]: audit 2021-03-10T14:22:52.660600+0000 mon.c (mon.1) 573 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:22:53.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:22:53 gibba015 bash[30343]: audit 2021-03-10T14:22:52.661278+0000 mon.a (mon.0) 821 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:22:53.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:22:53 gibba015 bash[30343]: audit 2021-03-10T14:22:52.662257+0000 mon.a (mon.0) 822 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:22:53.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:22:53 gibba015 bash[30343]: audit 2021-03-10T14:22:52.663014+0000 mon.a (mon.0) 823 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:22:53.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:22:53 gibba045 bash[25517]: cluster 2021-03-10T14:22:52.365597+0000 mgr.gibba045.orlgmj (mgr.34412) 1843 : cluster [DBG] pgmap v1034: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:53.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:22:53 gibba045 bash[25517]: audit 2021-03-10T14:22:52.656799+0000 mon.c (mon.1) 568 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:22:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:22:53 gibba045 bash[25517]: audit 2021-03-10T14:22:52.657491+0000 mon.c (mon.1) 569 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:22:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:22:53 gibba045 bash[25517]: audit 2021-03-10T14:22:52.658078+0000 mon.a (mon.0) 818 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:22:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:22:53 gibba045 bash[25517]: audit 2021-03-10T14:22:52.658271+0000 mon.c (mon.1) 570 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T14:22:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:22:53 gibba045 bash[25517]: audit 2021-03-10T14:22:52.659094+0000 mon.c (mon.1) 571 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:22:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:22:53 gibba045 bash[25517]: audit 2021-03-10T14:22:52.659161+0000 mon.a (mon.0) 819 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:22:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:22:53 gibba045 bash[25517]: audit 2021-03-10T14:22:52.659766+0000 mon.c (mon.1) 572 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:22:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:22:53 gibba045 bash[25517]: audit 2021-03-10T14:22:52.660062+0000 mon.a (mon.0) 820 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T14:22:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:22:53 gibba045 bash[25517]: audit 2021-03-10T14:22:52.660600+0000 mon.c (mon.1) 573 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:22:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:22:53 gibba045 bash[25517]: audit 2021-03-10T14:22:52.661278+0000 mon.a (mon.0) 821 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:22:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:22:53 gibba045 bash[25517]: audit 2021-03-10T14:22:52.662257+0000 mon.a (mon.0) 822 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:22:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:22:53 gibba045 bash[25517]: audit 2021-03-10T14:22:52.663014+0000 mon.a (mon.0) 823 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:22:55.712 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:22:55.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:22:55 gibba015 bash[30343]: cluster 2021-03-10T14:22:54.367037+0000 mgr.gibba045.orlgmj (mgr.34412) 1844 : cluster [DBG] pgmap v1035: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:55.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:22:55 gibba015 bash[29377]: cluster 2021-03-10T14:22:54.367037+0000 mgr.gibba045.orlgmj (mgr.34412) 1844 : cluster [DBG] pgmap v1035: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:55.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:22:55 gibba045 bash[25517]: cluster 2021-03-10T14:22:54.367037+0000 mgr.gibba045.orlgmj (mgr.34412) 1844 : cluster [DBG] pgmap v1035: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:55.944 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:22:55.944 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (33m) 9m ago 39m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:22:55.945 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (38m) 8m ago 38m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:22:55.945 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (34m) 8m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:22:55.945 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (34m) 8m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:22:55.945 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (33m) 9m ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:22:55.946 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (33m) 9m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:22:55.946 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (32m) 8m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:22:55.946 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (32m) 9m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:22:55.947 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (39m) 9m ago 39m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:22:55.947 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (39m) 8m ago 39m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:22:55.947 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (31m) 9m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:22:55.947 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (31m) 9m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:22:55.948 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (31m) 9m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:22:55.948 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (30m) 9m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:22:55.948 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (30m) 8m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:22:55.948 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (29m) 8m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:22:55.949 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (29m) 8m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:22:55.949 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (28m) 8m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:22:55.949 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (38m) 8m ago 39m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:22:55.949 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 8m ago 37m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:22:56.194 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:22:56.194 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:22:56.195 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:22:56.195 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:22:56.195 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:22:56.378 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:22:56.379 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:22:56.379 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:22:56.380 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:22:56.380 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:22:56.381 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:22:56.381 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:22:56.381 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:22:56.382 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:22:56.383 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:22:56.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:22:56 gibba015 bash[29377]: audit 2021-03-10T14:22:56.192080+0000 mon.a (mon.0) 824 : audit [DBG] from='client.? 172.21.2.115:0/2306745058' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:22:56.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:22:56 gibba015 bash[30343]: audit 2021-03-10T14:22:56.192080+0000 mon.a (mon.0) 824 : audit [DBG] from='client.? 172.21.2.115:0/2306745058' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:22:56.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:22:56 gibba045 bash[25517]: audit 2021-03-10T14:22:56.192080+0000 mon.a (mon.0) 824 : audit [DBG] from='client.? 172.21.2.115:0/2306745058' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:22:57.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:22:57 gibba015 bash[29377]: audit 2021-03-10T14:22:55.703806+0000 mgr.gibba045.orlgmj (mgr.34412) 1845 : audit [DBG] from='client.45294 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:22:57.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:22:57 gibba015 bash[29377]: audit 2021-03-10T14:22:55.932831+0000 mgr.gibba045.orlgmj (mgr.34412) 1846 : audit [DBG] from='client.55288 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:22:57.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:22:57 gibba015 bash[29377]: cluster 2021-03-10T14:22:56.369041+0000 mgr.gibba045.orlgmj (mgr.34412) 1847 : cluster [DBG] pgmap v1036: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:57.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:22:57 gibba015 bash[30343]: audit 2021-03-10T14:22:55.703806+0000 mgr.gibba045.orlgmj (mgr.34412) 1845 : audit [DBG] from='client.45294 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:22:57.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:22:57 gibba015 bash[30343]: audit 2021-03-10T14:22:55.932831+0000 mgr.gibba045.orlgmj (mgr.34412) 1846 : audit [DBG] from='client.55288 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:22:57.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:22:57 gibba015 bash[30343]: cluster 2021-03-10T14:22:56.369041+0000 mgr.gibba045.orlgmj (mgr.34412) 1847 : cluster [DBG] pgmap v1036: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:57.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:22:57 gibba045 bash[25517]: audit 2021-03-10T14:22:55.703806+0000 mgr.gibba045.orlgmj (mgr.34412) 1845 : audit [DBG] from='client.45294 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:22:57.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:22:57 gibba045 bash[25517]: audit 2021-03-10T14:22:55.932831+0000 mgr.gibba045.orlgmj (mgr.34412) 1846 : audit [DBG] from='client.55288 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:22:57.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:22:57 gibba045 bash[25517]: cluster 2021-03-10T14:22:56.369041+0000 mgr.gibba045.orlgmj (mgr.34412) 1847 : cluster [DBG] pgmap v1036: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:59.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:22:59 gibba015 bash[29377]: cluster 2021-03-10T14:22:58.370290+0000 mgr.gibba045.orlgmj (mgr.34412) 1848 : cluster [DBG] pgmap v1037: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:59.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:22:59 gibba015 bash[30343]: cluster 2021-03-10T14:22:58.370290+0000 mgr.gibba045.orlgmj (mgr.34412) 1848 : cluster [DBG] pgmap v1037: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:59.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:22:59 gibba045 bash[25517]: cluster 2021-03-10T14:22:58.370290+0000 mgr.gibba045.orlgmj (mgr.34412) 1848 : cluster [DBG] pgmap v1037: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:01.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:23:01 gibba015 bash[29377]: cluster 2021-03-10T14:23:00.371717+0000 mgr.gibba045.orlgmj (mgr.34412) 1849 : cluster [DBG] pgmap v1038: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:01.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:23:01 gibba015 bash[30343]: cluster 2021-03-10T14:23:00.371717+0000 mgr.gibba045.orlgmj (mgr.34412) 1849 : cluster [DBG] pgmap v1038: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:01.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:23:01 gibba045 bash[25517]: cluster 2021-03-10T14:23:00.371717+0000 mgr.gibba045.orlgmj (mgr.34412) 1849 : cluster [DBG] pgmap v1038: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:03.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:23:03 gibba015 bash[29377]: cluster 2021-03-10T14:23:02.372689+0000 mgr.gibba045.orlgmj (mgr.34412) 1850 : cluster [DBG] pgmap v1039: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:03.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:23:03 gibba015 bash[30343]: cluster 2021-03-10T14:23:02.372689+0000 mgr.gibba045.orlgmj (mgr.34412) 1850 : cluster [DBG] pgmap v1039: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:03.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:23:03 gibba045 bash[25517]: cluster 2021-03-10T14:23:02.372689+0000 mgr.gibba045.orlgmj (mgr.34412) 1850 : cluster [DBG] pgmap v1039: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:05.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:23:05 gibba015 bash[29377]: cluster 2021-03-10T14:23:04.373775+0000 mgr.gibba045.orlgmj (mgr.34412) 1851 : cluster [DBG] pgmap v1040: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:05.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:23:05 gibba015 bash[30343]: cluster 2021-03-10T14:23:04.373775+0000 mgr.gibba045.orlgmj (mgr.34412) 1851 : cluster [DBG] pgmap v1040: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:05.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:23:05 gibba045 bash[25517]: cluster 2021-03-10T14:23:04.373775+0000 mgr.gibba045.orlgmj (mgr.34412) 1851 : cluster [DBG] pgmap v1040: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:07.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:23:07 gibba015 bash[29377]: cephadm 2021-03-10T14:23:05.532616+0000 mgr.gibba045.orlgmj (mgr.34412) 1852 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:23:07.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:23:07 gibba015 bash[29377]: cluster 2021-03-10T14:23:06.375700+0000 mgr.gibba045.orlgmj (mgr.34412) 1853 : cluster [DBG] pgmap v1041: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:07.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:23:07 gibba015 bash[30343]: cephadm 2021-03-10T14:23:05.532616+0000 mgr.gibba045.orlgmj (mgr.34412) 1852 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:23:07.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:23:07 gibba015 bash[30343]: cluster 2021-03-10T14:23:06.375700+0000 mgr.gibba045.orlgmj (mgr.34412) 1853 : cluster [DBG] pgmap v1041: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:07.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:23:07 gibba045 bash[25517]: cephadm 2021-03-10T14:23:05.532616+0000 mgr.gibba045.orlgmj (mgr.34412) 1852 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:23:07.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:23:07 gibba045 bash[25517]: cluster 2021-03-10T14:23:06.375700+0000 mgr.gibba045.orlgmj (mgr.34412) 1853 : cluster [DBG] pgmap v1041: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:09.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:23:09 gibba015 bash[29377]: cluster 2021-03-10T14:23:08.377222+0000 mgr.gibba045.orlgmj (mgr.34412) 1854 : cluster [DBG] pgmap v1042: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:09.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:23:09 gibba015 bash[30343]: cluster 2021-03-10T14:23:08.377222+0000 mgr.gibba045.orlgmj (mgr.34412) 1854 : cluster [DBG] pgmap v1042: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:09.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:23:09 gibba045 bash[25517]: cluster 2021-03-10T14:23:08.377222+0000 mgr.gibba045.orlgmj (mgr.34412) 1854 : cluster [DBG] pgmap v1042: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:11.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:23:11 gibba015 bash[29377]: cluster 2021-03-10T14:23:10.378774+0000 mgr.gibba045.orlgmj (mgr.34412) 1855 : cluster [DBG] pgmap v1043: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:11.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:23:11 gibba015 bash[30343]: cluster 2021-03-10T14:23:10.378774+0000 mgr.gibba045.orlgmj (mgr.34412) 1855 : cluster [DBG] pgmap v1043: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:11.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:23:11 gibba045 bash[25517]: cluster 2021-03-10T14:23:10.378774+0000 mgr.gibba045.orlgmj (mgr.34412) 1855 : cluster [DBG] pgmap v1043: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:13.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:23:13 gibba015 bash[29377]: cluster 2021-03-10T14:23:12.380402+0000 mgr.gibba045.orlgmj (mgr.34412) 1856 : cluster [DBG] pgmap v1044: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:13.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:23:13 gibba015 bash[30343]: cluster 2021-03-10T14:23:12.380402+0000 mgr.gibba045.orlgmj (mgr.34412) 1856 : cluster [DBG] pgmap v1044: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:13.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:23:13 gibba045 bash[25517]: cluster 2021-03-10T14:23:12.380402+0000 mgr.gibba045.orlgmj (mgr.34412) 1856 : cluster [DBG] pgmap v1044: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:15.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:23:15 gibba015 bash[29377]: cluster 2021-03-10T14:23:14.381648+0000 mgr.gibba045.orlgmj (mgr.34412) 1857 : cluster [DBG] pgmap v1045: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:15.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:23:15 gibba015 bash[30343]: cluster 2021-03-10T14:23:14.381648+0000 mgr.gibba045.orlgmj (mgr.34412) 1857 : cluster [DBG] pgmap v1045: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:15.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:23:15 gibba045 bash[25517]: cluster 2021-03-10T14:23:14.381648+0000 mgr.gibba045.orlgmj (mgr.34412) 1857 : cluster [DBG] pgmap v1045: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:17.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:23:17 gibba015 bash[29377]: cluster 2021-03-10T14:23:16.383408+0000 mgr.gibba045.orlgmj (mgr.34412) 1858 : cluster [DBG] pgmap v1046: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:17.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:23:17 gibba015 bash[30343]: cluster 2021-03-10T14:23:16.383408+0000 mgr.gibba045.orlgmj (mgr.34412) 1858 : cluster [DBG] pgmap v1046: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:17.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:23:17 gibba045 bash[25517]: cluster 2021-03-10T14:23:16.383408+0000 mgr.gibba045.orlgmj (mgr.34412) 1858 : cluster [DBG] pgmap v1046: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:19.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:23:19 gibba015 bash[29377]: cluster 2021-03-10T14:23:18.384377+0000 mgr.gibba045.orlgmj (mgr.34412) 1859 : cluster [DBG] pgmap v1047: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:19.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:23:19 gibba015 bash[30343]: cluster 2021-03-10T14:23:18.384377+0000 mgr.gibba045.orlgmj (mgr.34412) 1859 : cluster [DBG] pgmap v1047: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:19.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:23:19 gibba045 bash[25517]: cluster 2021-03-10T14:23:18.384377+0000 mgr.gibba045.orlgmj (mgr.34412) 1859 : cluster [DBG] pgmap v1047: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:21.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:23:21 gibba015 bash[29377]: cluster 2021-03-10T14:23:20.385884+0000 mgr.gibba045.orlgmj (mgr.34412) 1860 : cluster [DBG] pgmap v1048: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:21.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:23:21 gibba015 bash[30343]: cluster 2021-03-10T14:23:20.385884+0000 mgr.gibba045.orlgmj (mgr.34412) 1860 : cluster [DBG] pgmap v1048: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:21.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:23:21 gibba045 bash[25517]: cluster 2021-03-10T14:23:20.385884+0000 mgr.gibba045.orlgmj (mgr.34412) 1860 : cluster [DBG] pgmap v1048: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:22.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:23:22 gibba045 bash[25517]: cephadm 2021-03-10T14:23:20.548442+0000 mgr.gibba045.orlgmj (mgr.34412) 1861 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:23:22.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:23:22 gibba015 bash[29377]: cephadm 2021-03-10T14:23:20.548442+0000 mgr.gibba045.orlgmj (mgr.34412) 1861 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:23:22.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:23:22 gibba015 bash[30343]: cephadm 2021-03-10T14:23:20.548442+0000 mgr.gibba045.orlgmj (mgr.34412) 1861 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:23:23.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:23:23 gibba045 bash[25517]: cluster 2021-03-10T14:23:22.386866+0000 mgr.gibba045.orlgmj (mgr.34412) 1862 : cluster [DBG] pgmap v1049: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:23.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:23:23 gibba015 bash[29377]: cluster 2021-03-10T14:23:22.386866+0000 mgr.gibba045.orlgmj (mgr.34412) 1862 : cluster [DBG] pgmap v1049: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:23.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:23:23 gibba015 bash[30343]: cluster 2021-03-10T14:23:22.386866+0000 mgr.gibba045.orlgmj (mgr.34412) 1862 : cluster [DBG] pgmap v1049: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:25.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:23:25 gibba045 bash[25517]: cluster 2021-03-10T14:23:24.387979+0000 mgr.gibba045.orlgmj (mgr.34412) 1863 : cluster [DBG] pgmap v1050: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:25.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:23:25 gibba015 bash[29377]: cluster 2021-03-10T14:23:24.387979+0000 mgr.gibba045.orlgmj (mgr.34412) 1863 : cluster [DBG] pgmap v1050: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:25.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:23:25 gibba015 bash[30343]: cluster 2021-03-10T14:23:24.387979+0000 mgr.gibba045.orlgmj (mgr.34412) 1863 : cluster [DBG] pgmap v1050: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:26.438 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:23:26.699 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:23:26.699 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (34m) 10m ago 39m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:23:26.699 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (39m) 8m ago 39m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:23:26.699 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (34m) 8m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:23:26.700 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (34m) 8m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:23:26.700 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (33m) 10m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:23:26.700 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (33m) 10m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:23:26.700 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (33m) 8m ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:23:26.701 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (33m) 10m ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:23:26.701 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (39m) 10m ago 39m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:23:26.701 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (39m) 8m ago 39m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:23:26.701 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (32m) 10m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:23:26.701 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (32m) 10m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:23:26.702 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (31m) 10m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:23:26.702 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (31m) 10m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:23:26.702 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (30m) 8m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:23:26.702 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (30m) 8m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:23:26.703 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (29m) 8m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:23:26.703 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (29m) 8m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:23:26.703 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (39m) 8m ago 39m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:23:26.703 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 8m ago 37m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:23:26.954 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:23:27.043 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:23:27.043 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:23:27.043 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:23:27.044 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:23:27.044 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:23:27.044 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:23:27.044 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:23:27.045 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:23:27.045 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:23:27.045 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:23:27.045 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:23:27.045 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:23:27.046 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:23:27.046 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:23:27.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:23:27 gibba045 bash[25517]: cluster 2021-03-10T14:23:26.389999+0000 mgr.gibba045.orlgmj (mgr.34412) 1864 : cluster [DBG] pgmap v1051: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:27.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:23:27 gibba045 bash[25517]: audit 2021-03-10T14:23:26.430181+0000 mgr.gibba045.orlgmj (mgr.34412) 1865 : audit [DBG] from='client.55300 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:23:27.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:23:27 gibba045 bash[25517]: audit 2021-03-10T14:23:26.951471+0000 mon.a (mon.0) 825 : audit [DBG] from='client.? 172.21.2.115:0/3713340279' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:23:27.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:23:27 gibba015 bash[29377]: cluster 2021-03-10T14:23:26.389999+0000 mgr.gibba045.orlgmj (mgr.34412) 1864 : cluster [DBG] pgmap v1051: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:27.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:23:27 gibba015 bash[29377]: audit 2021-03-10T14:23:26.430181+0000 mgr.gibba045.orlgmj (mgr.34412) 1865 : audit [DBG] from='client.55300 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:23:27.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:23:27 gibba015 bash[29377]: audit 2021-03-10T14:23:26.951471+0000 mon.a (mon.0) 825 : audit [DBG] from='client.? 172.21.2.115:0/3713340279' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:23:27.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:23:27 gibba015 bash[30343]: cluster 2021-03-10T14:23:26.389999+0000 mgr.gibba045.orlgmj (mgr.34412) 1864 : cluster [DBG] pgmap v1051: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:27.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:23:27 gibba015 bash[30343]: audit 2021-03-10T14:23:26.430181+0000 mgr.gibba045.orlgmj (mgr.34412) 1865 : audit [DBG] from='client.55300 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:23:27.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:23:27 gibba015 bash[30343]: audit 2021-03-10T14:23:26.951471+0000 mon.a (mon.0) 825 : audit [DBG] from='client.? 172.21.2.115:0/3713340279' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:23:28.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:23:28 gibba045 bash[25517]: audit 2021-03-10T14:23:26.658608+0000 mgr.gibba045.orlgmj (mgr.34412) 1866 : audit [DBG] from='client.55306 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:23:28.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:23:28 gibba015 bash[29377]: audit 2021-03-10T14:23:26.658608+0000 mgr.gibba045.orlgmj (mgr.34412) 1866 : audit [DBG] from='client.55306 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:23:28.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:23:28 gibba015 bash[30343]: audit 2021-03-10T14:23:26.658608+0000 mgr.gibba045.orlgmj (mgr.34412) 1866 : audit [DBG] from='client.55306 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:23:29.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:23:29 gibba045 bash[25517]: cluster 2021-03-10T14:23:28.391195+0000 mgr.gibba045.orlgmj (mgr.34412) 1867 : cluster [DBG] pgmap v1052: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:29.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:23:29 gibba015 bash[29377]: cluster 2021-03-10T14:23:28.391195+0000 mgr.gibba045.orlgmj (mgr.34412) 1867 : cluster [DBG] pgmap v1052: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:29.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:23:29 gibba015 bash[30343]: cluster 2021-03-10T14:23:28.391195+0000 mgr.gibba045.orlgmj (mgr.34412) 1867 : cluster [DBG] pgmap v1052: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:31.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:23:31 gibba045 bash[25517]: cluster 2021-03-10T14:23:30.392851+0000 mgr.gibba045.orlgmj (mgr.34412) 1868 : cluster [DBG] pgmap v1053: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:31.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:23:31 gibba015 bash[29377]: cluster 2021-03-10T14:23:30.392851+0000 mgr.gibba045.orlgmj (mgr.34412) 1868 : cluster [DBG] pgmap v1053: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:31.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:23:31 gibba015 bash[30343]: cluster 2021-03-10T14:23:30.392851+0000 mgr.gibba045.orlgmj (mgr.34412) 1868 : cluster [DBG] pgmap v1053: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:33.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:23:33 gibba015 bash[29377]: cluster 2021-03-10T14:23:32.393819+0000 mgr.gibba045.orlgmj (mgr.34412) 1869 : cluster [DBG] pgmap v1054: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:33.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:23:33 gibba015 bash[30343]: cluster 2021-03-10T14:23:32.393819+0000 mgr.gibba045.orlgmj (mgr.34412) 1869 : cluster [DBG] pgmap v1054: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:33.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:23:33 gibba045 bash[25517]: cluster 2021-03-10T14:23:32.393819+0000 mgr.gibba045.orlgmj (mgr.34412) 1869 : cluster [DBG] pgmap v1054: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:35.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:23:35 gibba015 bash[29377]: cluster 2021-03-10T14:23:34.394939+0000 mgr.gibba045.orlgmj (mgr.34412) 1870 : cluster [DBG] pgmap v1055: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:35.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:23:35 gibba015 bash[30343]: cluster 2021-03-10T14:23:34.394939+0000 mgr.gibba045.orlgmj (mgr.34412) 1870 : cluster [DBG] pgmap v1055: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:35.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:23:35 gibba045 bash[25517]: cluster 2021-03-10T14:23:34.394939+0000 mgr.gibba045.orlgmj (mgr.34412) 1870 : cluster [DBG] pgmap v1055: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:36.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:23:36 gibba015 bash[29377]: audit 2021-03-10T14:23:35.562230+0000 mon.c (mon.1) 574 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:23:36.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:23:36 gibba015 bash[29377]: audit 2021-03-10T14:23:35.569312+0000 mon.c (mon.1) 575 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:23:36.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:23:36 gibba015 bash[30343]: audit 2021-03-10T14:23:35.562230+0000 mon.c (mon.1) 574 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:23:36.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:23:36 gibba015 bash[30343]: audit 2021-03-10T14:23:35.569312+0000 mon.c (mon.1) 575 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:23:36.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:23:36 gibba045 bash[25517]: audit 2021-03-10T14:23:35.562230+0000 mon.c (mon.1) 574 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:23:36.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:23:36 gibba045 bash[25517]: audit 2021-03-10T14:23:35.569312+0000 mon.c (mon.1) 575 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:23:37.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:23:37 gibba045 bash[25517]: cephadm 2021-03-10T14:23:35.572077+0000 mgr.gibba045.orlgmj (mgr.34412) 1871 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:23:37.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:23:37 gibba045 bash[25517]: cluster 2021-03-10T14:23:36.397008+0000 mgr.gibba045.orlgmj (mgr.34412) 1872 : cluster [DBG] pgmap v1056: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:37.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:23:37 gibba015 bash[29377]: cephadm 2021-03-10T14:23:35.572077+0000 mgr.gibba045.orlgmj (mgr.34412) 1871 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:23:37.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:23:37 gibba015 bash[29377]: cluster 2021-03-10T14:23:36.397008+0000 mgr.gibba045.orlgmj (mgr.34412) 1872 : cluster [DBG] pgmap v1056: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:37.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:23:37 gibba015 bash[30343]: cephadm 2021-03-10T14:23:35.572077+0000 mgr.gibba045.orlgmj (mgr.34412) 1871 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:23:37.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:23:37 gibba015 bash[30343]: cluster 2021-03-10T14:23:36.397008+0000 mgr.gibba045.orlgmj (mgr.34412) 1872 : cluster [DBG] pgmap v1056: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:39.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:23:39 gibba045 bash[25517]: cluster 2021-03-10T14:23:38.398242+0000 mgr.gibba045.orlgmj (mgr.34412) 1873 : cluster [DBG] pgmap v1057: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:39.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:23:39 gibba045 bash[25517]: audit 2021-03-10T14:23:39.102913+0000 mon.a (mon.0) 826 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:23:39.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:23:39 gibba045 bash[25517]: audit 2021-03-10T14:23:39.338928+0000 mon.a (mon.0) 827 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:23:39.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:23:39 gibba045 bash[25517]: audit 2021-03-10T14:23:39.355753+0000 mon.c (mon.1) 576 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:23:39.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:23:39 gibba045 bash[25517]: audit 2021-03-10T14:23:39.360553+0000 mon.c (mon.1) 577 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:23:39.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:23:39 gibba045 bash[25517]: audit 2021-03-10T14:23:39.365263+0000 mon.c (mon.1) 578 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:23:39.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:23:39 gibba045 bash[25517]: audit 2021-03-10T14:23:39.368413+0000 mon.c (mon.1) 579 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:23:39.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:23:39 gibba045 bash[25517]: audit 2021-03-10T14:23:39.376180+0000 mon.c (mon.1) 580 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:23:39.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:23:39 gibba045 bash[25517]: audit 2021-03-10T14:23:39.381313+0000 mon.c (mon.1) 581 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:23:39.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:23:39 gibba015 bash[29377]: cluster 2021-03-10T14:23:38.398242+0000 mgr.gibba045.orlgmj (mgr.34412) 1873 : cluster [DBG] pgmap v1057: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:39.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:23:39 gibba015 bash[29377]: audit 2021-03-10T14:23:39.102913+0000 mon.a (mon.0) 826 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:23:39.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:23:39 gibba015 bash[29377]: audit 2021-03-10T14:23:39.338928+0000 mon.a (mon.0) 827 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:23:39.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:23:39 gibba015 bash[29377]: audit 2021-03-10T14:23:39.355753+0000 mon.c (mon.1) 576 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:23:39.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:23:39 gibba015 bash[29377]: audit 2021-03-10T14:23:39.360553+0000 mon.c (mon.1) 577 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:23:39.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:23:39 gibba015 bash[29377]: audit 2021-03-10T14:23:39.365263+0000 mon.c (mon.1) 578 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:23:39.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:23:39 gibba015 bash[29377]: audit 2021-03-10T14:23:39.368413+0000 mon.c (mon.1) 579 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:23:39.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:23:39 gibba015 bash[29377]: audit 2021-03-10T14:23:39.376180+0000 mon.c (mon.1) 580 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:23:39.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:23:39 gibba015 bash[29377]: audit 2021-03-10T14:23:39.381313+0000 mon.c (mon.1) 581 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:23:39.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:23:39 gibba015 bash[30343]: cluster 2021-03-10T14:23:38.398242+0000 mgr.gibba045.orlgmj (mgr.34412) 1873 : cluster [DBG] pgmap v1057: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:39.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:23:39 gibba015 bash[30343]: audit 2021-03-10T14:23:39.102913+0000 mon.a (mon.0) 826 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:23:39.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:23:39 gibba015 bash[30343]: audit 2021-03-10T14:23:39.338928+0000 mon.a (mon.0) 827 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:23:39.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:23:39 gibba015 bash[30343]: audit 2021-03-10T14:23:39.355753+0000 mon.c (mon.1) 576 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:23:39.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:23:39 gibba015 bash[30343]: audit 2021-03-10T14:23:39.360553+0000 mon.c (mon.1) 577 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:23:39.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:23:39 gibba015 bash[30343]: audit 2021-03-10T14:23:39.365263+0000 mon.c (mon.1) 578 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:23:39.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:23:39 gibba015 bash[30343]: audit 2021-03-10T14:23:39.368413+0000 mon.c (mon.1) 579 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:23:39.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:23:39 gibba015 bash[30343]: audit 2021-03-10T14:23:39.376180+0000 mon.c (mon.1) 580 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:23:39.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:23:39 gibba015 bash[30343]: audit 2021-03-10T14:23:39.381313+0000 mon.c (mon.1) 581 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:23:40.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:23:40 gibba045 bash[25517]: cephadm 2021-03-10T14:23:39.107177+0000 mgr.gibba045.orlgmj (mgr.34412) 1874 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:23:40.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:23:40 gibba045 bash[25517]: cephadm 2021-03-10T14:23:39.356026+0000 mgr.gibba045.orlgmj (mgr.34412) 1875 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:23:40.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:23:40 gibba045 bash[25517]: cephadm 2021-03-10T14:23:39.362218+0000 mgr.gibba045.orlgmj (mgr.34412) 1876 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:23:40.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:23:40 gibba045 bash[25517]: cephadm 2021-03-10T14:23:39.366600+0000 mgr.gibba045.orlgmj (mgr.34412) 1877 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:23:40.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:23:40 gibba045 bash[25517]: cephadm 2021-03-10T14:23:39.367198+0000 mgr.gibba045.orlgmj (mgr.34412) 1878 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:23:40.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:23:40 gibba045 bash[25517]: cephadm 2021-03-10T14:23:39.370799+0000 mgr.gibba045.orlgmj (mgr.34412) 1879 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:23:40.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:23:40 gibba045 bash[25517]: cephadm 2021-03-10T14:23:39.371011+0000 mgr.gibba045.orlgmj (mgr.34412) 1880 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:23:40.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:23:40 gibba045 bash[25517]: cephadm 2021-03-10T14:23:39.373662+0000 mgr.gibba045.orlgmj (mgr.34412) 1881 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:23:40.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:23:40 gibba045 bash[25517]: cephadm 2021-03-10T14:23:39.377159+0000 mgr.gibba045.orlgmj (mgr.34412) 1882 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:23:40.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:23:40 gibba045 bash[25517]: cephadm 2021-03-10T14:23:39.377658+0000 mgr.gibba045.orlgmj (mgr.34412) 1883 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:23:40.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:23:40 gibba045 bash[25517]: cephadm 2021-03-10T14:23:39.381536+0000 mgr.gibba045.orlgmj (mgr.34412) 1884 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:23:40.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:23:40 gibba045 bash[25517]: cephadm 2021-03-10T14:23:39.383618+0000 mgr.gibba045.orlgmj (mgr.34412) 1885 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:23:40.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:23:40 gibba045 bash[25517]: cephadm 2021-03-10T14:23:39.386674+0000 mgr.gibba045.orlgmj (mgr.34412) 1886 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:23:40.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:23:40 gibba045 bash[25517]: cephadm 2021-03-10T14:23:39.387066+0000 mgr.gibba045.orlgmj (mgr.34412) 1887 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:23:40.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:23:40 gibba045 bash[25517]: cephadm 2021-03-10T14:23:39.387869+0000 mgr.gibba045.orlgmj (mgr.34412) 1888 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:23:40.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:23:40 gibba015 bash[29377]: cephadm 2021-03-10T14:23:39.107177+0000 mgr.gibba045.orlgmj (mgr.34412) 1874 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:23:40.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:23:40 gibba015 bash[29377]: cephadm 2021-03-10T14:23:39.356026+0000 mgr.gibba045.orlgmj (mgr.34412) 1875 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:23:40.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:23:40 gibba015 bash[29377]: cephadm 2021-03-10T14:23:39.362218+0000 mgr.gibba045.orlgmj (mgr.34412) 1876 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:23:40.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:23:40 gibba015 bash[29377]: cephadm 2021-03-10T14:23:39.366600+0000 mgr.gibba045.orlgmj (mgr.34412) 1877 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:23:40.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:23:40 gibba015 bash[29377]: cephadm 2021-03-10T14:23:39.367198+0000 mgr.gibba045.orlgmj (mgr.34412) 1878 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:23:40.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:23:40 gibba015 bash[29377]: cephadm 2021-03-10T14:23:39.370799+0000 mgr.gibba045.orlgmj (mgr.34412) 1879 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:23:40.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:23:40 gibba015 bash[29377]: cephadm 2021-03-10T14:23:39.371011+0000 mgr.gibba045.orlgmj (mgr.34412) 1880 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:23:40.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:23:40 gibba015 bash[29377]: cephadm 2021-03-10T14:23:39.373662+0000 mgr.gibba045.orlgmj (mgr.34412) 1881 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:23:40.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:23:40 gibba015 bash[29377]: cephadm 2021-03-10T14:23:39.377159+0000 mgr.gibba045.orlgmj (mgr.34412) 1882 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:23:40.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:23:40 gibba015 bash[29377]: cephadm 2021-03-10T14:23:39.377658+0000 mgr.gibba045.orlgmj (mgr.34412) 1883 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:23:40.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:23:40 gibba015 bash[29377]: cephadm 2021-03-10T14:23:39.381536+0000 mgr.gibba045.orlgmj (mgr.34412) 1884 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:23:40.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:23:40 gibba015 bash[29377]: cephadm 2021-03-10T14:23:39.383618+0000 mgr.gibba045.orlgmj (mgr.34412) 1885 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:23:40.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:23:40 gibba015 bash[29377]: cephadm 2021-03-10T14:23:39.386674+0000 mgr.gibba045.orlgmj (mgr.34412) 1886 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:23:40.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:23:40 gibba015 bash[29377]: cephadm 2021-03-10T14:23:39.387066+0000 mgr.gibba045.orlgmj (mgr.34412) 1887 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:23:40.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:23:40 gibba015 bash[29377]: cephadm 2021-03-10T14:23:39.387869+0000 mgr.gibba045.orlgmj (mgr.34412) 1888 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:23:40.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:23:40 gibba015 bash[30343]: cephadm 2021-03-10T14:23:39.107177+0000 mgr.gibba045.orlgmj (mgr.34412) 1874 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:23:40.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:23:40 gibba015 bash[30343]: cephadm 2021-03-10T14:23:39.356026+0000 mgr.gibba045.orlgmj (mgr.34412) 1875 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:23:40.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:23:40 gibba015 bash[30343]: cephadm 2021-03-10T14:23:39.362218+0000 mgr.gibba045.orlgmj (mgr.34412) 1876 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:23:40.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:23:40 gibba015 bash[30343]: cephadm 2021-03-10T14:23:39.366600+0000 mgr.gibba045.orlgmj (mgr.34412) 1877 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:23:40.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:23:40 gibba015 bash[30343]: cephadm 2021-03-10T14:23:39.367198+0000 mgr.gibba045.orlgmj (mgr.34412) 1878 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:23:40.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:23:40 gibba015 bash[30343]: cephadm 2021-03-10T14:23:39.370799+0000 mgr.gibba045.orlgmj (mgr.34412) 1879 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:23:40.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:23:40 gibba015 bash[30343]: cephadm 2021-03-10T14:23:39.371011+0000 mgr.gibba045.orlgmj (mgr.34412) 1880 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:23:40.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:23:40 gibba015 bash[30343]: cephadm 2021-03-10T14:23:39.373662+0000 mgr.gibba045.orlgmj (mgr.34412) 1881 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:23:40.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:23:40 gibba015 bash[30343]: cephadm 2021-03-10T14:23:39.377159+0000 mgr.gibba045.orlgmj (mgr.34412) 1882 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:23:40.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:23:40 gibba015 bash[30343]: cephadm 2021-03-10T14:23:39.377658+0000 mgr.gibba045.orlgmj (mgr.34412) 1883 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:23:40.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:23:40 gibba015 bash[30343]: cephadm 2021-03-10T14:23:39.381536+0000 mgr.gibba045.orlgmj (mgr.34412) 1884 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:23:40.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:23:40 gibba015 bash[30343]: cephadm 2021-03-10T14:23:39.383618+0000 mgr.gibba045.orlgmj (mgr.34412) 1885 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:23:40.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:23:40 gibba015 bash[30343]: cephadm 2021-03-10T14:23:39.386674+0000 mgr.gibba045.orlgmj (mgr.34412) 1886 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:23:40.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:23:40 gibba015 bash[30343]: cephadm 2021-03-10T14:23:39.387066+0000 mgr.gibba045.orlgmj (mgr.34412) 1887 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:23:40.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:23:40 gibba015 bash[30343]: cephadm 2021-03-10T14:23:39.387869+0000 mgr.gibba045.orlgmj (mgr.34412) 1888 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:23:41.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:23:41 gibba045 bash[25517]: cluster 2021-03-10T14:23:40.399912+0000 mgr.gibba045.orlgmj (mgr.34412) 1889 : cluster [DBG] pgmap v1058: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:41.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:23:41 gibba015 bash[29377]: cluster 2021-03-10T14:23:40.399912+0000 mgr.gibba045.orlgmj (mgr.34412) 1889 : cluster [DBG] pgmap v1058: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:41.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:23:41 gibba015 bash[30343]: cluster 2021-03-10T14:23:40.399912+0000 mgr.gibba045.orlgmj (mgr.34412) 1889 : cluster [DBG] pgmap v1058: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:43.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:23:43 gibba015 bash[29377]: cluster 2021-03-10T14:23:42.400967+0000 mgr.gibba045.orlgmj (mgr.34412) 1890 : cluster [DBG] pgmap v1059: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:43.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:23:43 gibba015 bash[30343]: cluster 2021-03-10T14:23:42.400967+0000 mgr.gibba045.orlgmj (mgr.34412) 1890 : cluster [DBG] pgmap v1059: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:43.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:23:43 gibba045 bash[25517]: cluster 2021-03-10T14:23:42.400967+0000 mgr.gibba045.orlgmj (mgr.34412) 1890 : cluster [DBG] pgmap v1059: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:45.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:23:45 gibba015 bash[29377]: cluster 2021-03-10T14:23:44.402119+0000 mgr.gibba045.orlgmj (mgr.34412) 1891 : cluster [DBG] pgmap v1060: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:45.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:23:45 gibba015 bash[30343]: cluster 2021-03-10T14:23:44.402119+0000 mgr.gibba045.orlgmj (mgr.34412) 1891 : cluster [DBG] pgmap v1060: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:45.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:23:45 gibba045 bash[25517]: cluster 2021-03-10T14:23:44.402119+0000 mgr.gibba045.orlgmj (mgr.34412) 1891 : cluster [DBG] pgmap v1060: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:47.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:23:47 gibba045 bash[25517]: cluster 2021-03-10T14:23:46.403913+0000 mgr.gibba045.orlgmj (mgr.34412) 1892 : cluster [DBG] pgmap v1061: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:47.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:23:47 gibba015 bash[29377]: cluster 2021-03-10T14:23:46.403913+0000 mgr.gibba045.orlgmj (mgr.34412) 1892 : cluster [DBG] pgmap v1061: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:47.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:23:47 gibba015 bash[30343]: cluster 2021-03-10T14:23:46.403913+0000 mgr.gibba045.orlgmj (mgr.34412) 1892 : cluster [DBG] pgmap v1061: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:49.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:23:49 gibba045 bash[25517]: cluster 2021-03-10T14:23:48.405180+0000 mgr.gibba045.orlgmj (mgr.34412) 1893 : cluster [DBG] pgmap v1062: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:49.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:23:49 gibba015 bash[29377]: cluster 2021-03-10T14:23:48.405180+0000 mgr.gibba045.orlgmj (mgr.34412) 1893 : cluster [DBG] pgmap v1062: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:49.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:23:49 gibba015 bash[30343]: cluster 2021-03-10T14:23:48.405180+0000 mgr.gibba045.orlgmj (mgr.34412) 1893 : cluster [DBG] pgmap v1062: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:51.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:23:51 gibba045 bash[25517]: cluster 2021-03-10T14:23:50.406595+0000 mgr.gibba045.orlgmj (mgr.34412) 1894 : cluster [DBG] pgmap v1063: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:51.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:23:51 gibba015 bash[29377]: cluster 2021-03-10T14:23:50.406595+0000 mgr.gibba045.orlgmj (mgr.34412) 1894 : cluster [DBG] pgmap v1063: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:51.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:23:51 gibba015 bash[30343]: cluster 2021-03-10T14:23:50.406595+0000 mgr.gibba045.orlgmj (mgr.34412) 1894 : cluster [DBG] pgmap v1063: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:53.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:23:53 gibba015 bash[29377]: cluster 2021-03-10T14:23:52.407835+0000 mgr.gibba045.orlgmj (mgr.34412) 1895 : cluster [DBG] pgmap v1064: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:53.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:23:53 gibba015 bash[29377]: audit 2021-03-10T14:23:52.671281+0000 mon.c (mon.1) 582 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:23:53.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:23:53 gibba015 bash[29377]: audit 2021-03-10T14:23:52.672343+0000 mon.a (mon.0) 828 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:23:53.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:23:53 gibba015 bash[29377]: audit 2021-03-10T14:23:52.673813+0000 mon.c (mon.1) 583 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:23:53.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:23:53 gibba015 bash[29377]: audit 2021-03-10T14:23:52.674806+0000 mon.a (mon.0) 829 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:23:53.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:23:53 gibba015 bash[29377]: audit 2021-03-10T14:23:52.680151+0000 mon.c (mon.1) 584 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T14:23:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:23:53 gibba015 bash[29377]: audit 2021-03-10T14:23:52.680875+0000 mon.c (mon.1) 585 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:23:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:23:53 gibba015 bash[29377]: audit 2021-03-10T14:23:52.681337+0000 mon.a (mon.0) 830 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T14:23:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:23:53 gibba015 bash[29377]: audit 2021-03-10T14:23:52.681644+0000 mon.c (mon.1) 586 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:23:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:23:53 gibba015 bash[29377]: audit 2021-03-10T14:23:52.682525+0000 mon.c (mon.1) 587 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:23:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:23:53 gibba015 bash[29377]: audit 2021-03-10T14:23:52.682994+0000 mon.a (mon.0) 831 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:23:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:23:53 gibba015 bash[29377]: audit 2021-03-10T14:23:52.684061+0000 mon.a (mon.0) 832 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:23:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:23:53 gibba015 bash[29377]: audit 2021-03-10T14:23:52.684968+0000 mon.a (mon.0) 833 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:23:53.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:23:53 gibba015 bash[30343]: cluster 2021-03-10T14:23:52.407835+0000 mgr.gibba045.orlgmj (mgr.34412) 1895 : cluster [DBG] pgmap v1064: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:53.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:23:53 gibba015 bash[30343]: audit 2021-03-10T14:23:52.671281+0000 mon.c (mon.1) 582 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:23:53.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:23:53 gibba015 bash[30343]: audit 2021-03-10T14:23:52.672343+0000 mon.a (mon.0) 828 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:23:53.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:23:53 gibba015 bash[30343]: audit 2021-03-10T14:23:52.673813+0000 mon.c (mon.1) 583 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:23:53.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:23:53 gibba015 bash[30343]: audit 2021-03-10T14:23:52.674806+0000 mon.a (mon.0) 829 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:23:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:23:53 gibba015 bash[30343]: audit 2021-03-10T14:23:52.680151+0000 mon.c (mon.1) 584 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T14:23:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:23:53 gibba015 bash[30343]: audit 2021-03-10T14:23:52.680875+0000 mon.c (mon.1) 585 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:23:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:23:53 gibba015 bash[30343]: audit 2021-03-10T14:23:52.681337+0000 mon.a (mon.0) 830 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T14:23:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:23:53 gibba015 bash[30343]: audit 2021-03-10T14:23:52.681644+0000 mon.c (mon.1) 586 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:23:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:23:53 gibba015 bash[30343]: audit 2021-03-10T14:23:52.682525+0000 mon.c (mon.1) 587 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:23:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:23:53 gibba015 bash[30343]: audit 2021-03-10T14:23:52.682994+0000 mon.a (mon.0) 831 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:23:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:23:53 gibba015 bash[30343]: audit 2021-03-10T14:23:52.684061+0000 mon.a (mon.0) 832 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:23:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:23:53 gibba015 bash[30343]: audit 2021-03-10T14:23:52.684968+0000 mon.a (mon.0) 833 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:23:53.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:23:53 gibba045 bash[25517]: cluster 2021-03-10T14:23:52.407835+0000 mgr.gibba045.orlgmj (mgr.34412) 1895 : cluster [DBG] pgmap v1064: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:53.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:23:53 gibba045 bash[25517]: audit 2021-03-10T14:23:52.671281+0000 mon.c (mon.1) 582 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:23:53.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:23:53 gibba045 bash[25517]: audit 2021-03-10T14:23:52.672343+0000 mon.a (mon.0) 828 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:23:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:23:53 gibba045 bash[25517]: audit 2021-03-10T14:23:52.673813+0000 mon.c (mon.1) 583 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:23:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:23:53 gibba045 bash[25517]: audit 2021-03-10T14:23:52.674806+0000 mon.a (mon.0) 829 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:23:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:23:53 gibba045 bash[25517]: audit 2021-03-10T14:23:52.680151+0000 mon.c (mon.1) 584 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T14:23:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:23:53 gibba045 bash[25517]: audit 2021-03-10T14:23:52.680875+0000 mon.c (mon.1) 585 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:23:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:23:53 gibba045 bash[25517]: audit 2021-03-10T14:23:52.681337+0000 mon.a (mon.0) 830 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T14:23:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:23:53 gibba045 bash[25517]: audit 2021-03-10T14:23:52.681644+0000 mon.c (mon.1) 586 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:23:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:23:53 gibba045 bash[25517]: audit 2021-03-10T14:23:52.682525+0000 mon.c (mon.1) 587 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:23:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:23:53 gibba045 bash[25517]: audit 2021-03-10T14:23:52.682994+0000 mon.a (mon.0) 831 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:23:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:23:53 gibba045 bash[25517]: audit 2021-03-10T14:23:52.684061+0000 mon.a (mon.0) 832 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:23:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:23:53 gibba045 bash[25517]: audit 2021-03-10T14:23:52.684968+0000 mon.a (mon.0) 833 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:23:55.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:23:55 gibba015 bash[29377]: cephadm 2021-03-10T14:23:54.404057+0000 mgr.gibba045.orlgmj (mgr.34412) 1896 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:23:55.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:23:55 gibba015 bash[29377]: cluster 2021-03-10T14:23:54.409153+0000 mgr.gibba045.orlgmj (mgr.34412) 1897 : cluster [DBG] pgmap v1065: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:55.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:23:55 gibba015 bash[30343]: cephadm 2021-03-10T14:23:54.404057+0000 mgr.gibba045.orlgmj (mgr.34412) 1896 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:23:55.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:23:55 gibba015 bash[30343]: cluster 2021-03-10T14:23:54.409153+0000 mgr.gibba045.orlgmj (mgr.34412) 1897 : cluster [DBG] pgmap v1065: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:55.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:23:55 gibba045 bash[25517]: cephadm 2021-03-10T14:23:54.404057+0000 mgr.gibba045.orlgmj (mgr.34412) 1896 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:23:55.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:23:55 gibba045 bash[25517]: cluster 2021-03-10T14:23:54.409153+0000 mgr.gibba045.orlgmj (mgr.34412) 1897 : cluster [DBG] pgmap v1065: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:57.197 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:23:57.424 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:23:57.424 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (34m) 18s ago 40m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:23:57.424 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (39m) 9m ago 39m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:23:57.424 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (35m) 9m ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:23:57.425 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (35m) 9m ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:23:57.425 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (34m) 18s ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:23:57.425 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (34m) 18s ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:23:57.425 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (33m) 9m ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:23:57.425 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (33m) 18s ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:23:57.426 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (40m) 18s ago 40m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:23:57.426 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (40m) 9m ago 40m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:23:57.426 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (32m) 18s ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:23:57.426 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (32m) 18s ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:23:57.427 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (32m) 18s ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:23:57.427 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (31m) 18s ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:23:57.427 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (31m) 9m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:23:57.427 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (30m) 9m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:23:57.427 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (30m) 9m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:23:57.428 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (29m) 9m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:23:57.428 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (39m) 9m ago 40m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:23:57.428 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 9m ago 38m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:23:57.675 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:23:57.675 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:23:57.675 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:23:57.676 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:23:57.676 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:23:57.676 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:23:57.676 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:23:57.676 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:23:57.677 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:23:57.677 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:23:57.677 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:23:57.677 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:23:57.678 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:23:57.678 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:23:57.678 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:23:57.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:23:57 gibba045 bash[25517]: cluster 2021-03-10T14:23:56.411189+0000 mgr.gibba045.orlgmj (mgr.34412) 1898 : cluster [DBG] pgmap v1066: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:57.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:23:57 gibba015 bash[29377]: cluster 2021-03-10T14:23:56.411189+0000 mgr.gibba045.orlgmj (mgr.34412) 1898 : cluster [DBG] pgmap v1066: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:57.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:23:57 gibba015 bash[30343]: cluster 2021-03-10T14:23:56.411189+0000 mgr.gibba045.orlgmj (mgr.34412) 1898 : cluster [DBG] pgmap v1066: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:58.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:23:58 gibba045 bash[25517]: audit 2021-03-10T14:23:57.189009+0000 mgr.gibba045.orlgmj (mgr.34412) 1899 : audit [DBG] from='client.45330 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:23:58.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:23:58 gibba045 bash[25517]: audit 2021-03-10T14:23:57.412166+0000 mgr.gibba045.orlgmj (mgr.34412) 1900 : audit [DBG] from='client.45336 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:23:58.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:23:58 gibba045 bash[25517]: audit 2021-03-10T14:23:57.672469+0000 mon.c (mon.1) 588 : audit [DBG] from='client.? 172.21.2.115:0/1969159857' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:23:58.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:23:58 gibba015 bash[29377]: audit 2021-03-10T14:23:57.189009+0000 mgr.gibba045.orlgmj (mgr.34412) 1899 : audit [DBG] from='client.45330 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:23:58.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:23:58 gibba015 bash[29377]: audit 2021-03-10T14:23:57.412166+0000 mgr.gibba045.orlgmj (mgr.34412) 1900 : audit [DBG] from='client.45336 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:23:58.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:23:58 gibba015 bash[29377]: audit 2021-03-10T14:23:57.672469+0000 mon.c (mon.1) 588 : audit [DBG] from='client.? 172.21.2.115:0/1969159857' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:23:58.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:23:58 gibba015 bash[30343]: audit 2021-03-10T14:23:57.189009+0000 mgr.gibba045.orlgmj (mgr.34412) 1899 : audit [DBG] from='client.45330 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:23:58.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:23:58 gibba015 bash[30343]: audit 2021-03-10T14:23:57.412166+0000 mgr.gibba045.orlgmj (mgr.34412) 1900 : audit [DBG] from='client.45336 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:23:58.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:23:58 gibba015 bash[30343]: audit 2021-03-10T14:23:57.672469+0000 mon.c (mon.1) 588 : audit [DBG] from='client.? 172.21.2.115:0/1969159857' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:23:59.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:23:59 gibba045 bash[25517]: cluster 2021-03-10T14:23:58.412404+0000 mgr.gibba045.orlgmj (mgr.34412) 1901 : cluster [DBG] pgmap v1067: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:59.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:23:59 gibba015 bash[29377]: cluster 2021-03-10T14:23:58.412404+0000 mgr.gibba045.orlgmj (mgr.34412) 1901 : cluster [DBG] pgmap v1067: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:59.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:23:59 gibba015 bash[30343]: cluster 2021-03-10T14:23:58.412404+0000 mgr.gibba045.orlgmj (mgr.34412) 1901 : cluster [DBG] pgmap v1067: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:01.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:24:01 gibba045 bash[25517]: cluster 2021-03-10T14:24:00.413925+0000 mgr.gibba045.orlgmj (mgr.34412) 1902 : cluster [DBG] pgmap v1068: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:01.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:24:01 gibba015 bash[29377]: cluster 2021-03-10T14:24:00.413925+0000 mgr.gibba045.orlgmj (mgr.34412) 1902 : cluster [DBG] pgmap v1068: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:01.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:24:01 gibba015 bash[30343]: cluster 2021-03-10T14:24:00.413925+0000 mgr.gibba045.orlgmj (mgr.34412) 1902 : cluster [DBG] pgmap v1068: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:03.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:24:03 gibba015 bash[29377]: cluster 2021-03-10T14:24:02.414880+0000 mgr.gibba045.orlgmj (mgr.34412) 1903 : cluster [DBG] pgmap v1069: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:03.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:24:03 gibba015 bash[30343]: cluster 2021-03-10T14:24:02.414880+0000 mgr.gibba045.orlgmj (mgr.34412) 1903 : cluster [DBG] pgmap v1069: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:03.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:24:03 gibba045 bash[25517]: cluster 2021-03-10T14:24:02.414880+0000 mgr.gibba045.orlgmj (mgr.34412) 1903 : cluster [DBG] pgmap v1069: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:05.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:24:05 gibba045 bash[25517]: cluster 2021-03-10T14:24:04.416187+0000 mgr.gibba045.orlgmj (mgr.34412) 1904 : cluster [DBG] pgmap v1070: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:05.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:24:05 gibba015 bash[29377]: cluster 2021-03-10T14:24:04.416187+0000 mgr.gibba045.orlgmj (mgr.34412) 1904 : cluster [DBG] pgmap v1070: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:05.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:24:05 gibba015 bash[30343]: cluster 2021-03-10T14:24:04.416187+0000 mgr.gibba045.orlgmj (mgr.34412) 1904 : cluster [DBG] pgmap v1070: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:07.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:24:07 gibba045 bash[25517]: cluster 2021-03-10T14:24:06.417819+0000 mgr.gibba045.orlgmj (mgr.34412) 1905 : cluster [DBG] pgmap v1071: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:07.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:24:07 gibba015 bash[29377]: cluster 2021-03-10T14:24:06.417819+0000 mgr.gibba045.orlgmj (mgr.34412) 1905 : cluster [DBG] pgmap v1071: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:07.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:24:07 gibba015 bash[30343]: cluster 2021-03-10T14:24:06.417819+0000 mgr.gibba045.orlgmj (mgr.34412) 1905 : cluster [DBG] pgmap v1071: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:09.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:24:09 gibba045 bash[25517]: cluster 2021-03-10T14:24:08.419064+0000 mgr.gibba045.orlgmj (mgr.34412) 1906 : cluster [DBG] pgmap v1072: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:09.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:24:09 gibba015 bash[29377]: cluster 2021-03-10T14:24:08.419064+0000 mgr.gibba045.orlgmj (mgr.34412) 1906 : cluster [DBG] pgmap v1072: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:09.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:24:09 gibba015 bash[30343]: cluster 2021-03-10T14:24:08.419064+0000 mgr.gibba045.orlgmj (mgr.34412) 1906 : cluster [DBG] pgmap v1072: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:10.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:24:10 gibba045 bash[25517]: cephadm 2021-03-10T14:24:09.420144+0000 mgr.gibba045.orlgmj (mgr.34412) 1907 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:24:10.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:24:10 gibba015 bash[29377]: cephadm 2021-03-10T14:24:09.420144+0000 mgr.gibba045.orlgmj (mgr.34412) 1907 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:24:10.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:24:10 gibba015 bash[30343]: cephadm 2021-03-10T14:24:09.420144+0000 mgr.gibba045.orlgmj (mgr.34412) 1907 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:24:11.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:24:11 gibba045 bash[25517]: cluster 2021-03-10T14:24:10.420805+0000 mgr.gibba045.orlgmj (mgr.34412) 1908 : cluster [DBG] pgmap v1073: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:11.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:24:11 gibba015 bash[29377]: cluster 2021-03-10T14:24:10.420805+0000 mgr.gibba045.orlgmj (mgr.34412) 1908 : cluster [DBG] pgmap v1073: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:11.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:24:11 gibba015 bash[30343]: cluster 2021-03-10T14:24:10.420805+0000 mgr.gibba045.orlgmj (mgr.34412) 1908 : cluster [DBG] pgmap v1073: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:13.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:24:13 gibba015 bash[29377]: cluster 2021-03-10T14:24:12.421956+0000 mgr.gibba045.orlgmj (mgr.34412) 1909 : cluster [DBG] pgmap v1074: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:13.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:24:13 gibba015 bash[30343]: cluster 2021-03-10T14:24:12.421956+0000 mgr.gibba045.orlgmj (mgr.34412) 1909 : cluster [DBG] pgmap v1074: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:13.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:24:13 gibba045 bash[25517]: cluster 2021-03-10T14:24:12.421956+0000 mgr.gibba045.orlgmj (mgr.34412) 1909 : cluster [DBG] pgmap v1074: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:15.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:24:15 gibba045 bash[25517]: cluster 2021-03-10T14:24:14.423323+0000 mgr.gibba045.orlgmj (mgr.34412) 1910 : cluster [DBG] pgmap v1075: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:15.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:24:15 gibba015 bash[29377]: cluster 2021-03-10T14:24:14.423323+0000 mgr.gibba045.orlgmj (mgr.34412) 1910 : cluster [DBG] pgmap v1075: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:15.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:24:15 gibba015 bash[30343]: cluster 2021-03-10T14:24:14.423323+0000 mgr.gibba045.orlgmj (mgr.34412) 1910 : cluster [DBG] pgmap v1075: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:17.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:24:17 gibba045 bash[25517]: cluster 2021-03-10T14:24:16.425315+0000 mgr.gibba045.orlgmj (mgr.34412) 1911 : cluster [DBG] pgmap v1076: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:17.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:24:17 gibba015 bash[29377]: cluster 2021-03-10T14:24:16.425315+0000 mgr.gibba045.orlgmj (mgr.34412) 1911 : cluster [DBG] pgmap v1076: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:17.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:24:17 gibba015 bash[30343]: cluster 2021-03-10T14:24:16.425315+0000 mgr.gibba045.orlgmj (mgr.34412) 1911 : cluster [DBG] pgmap v1076: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:19.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:24:19 gibba045 bash[25517]: cluster 2021-03-10T14:24:18.426605+0000 mgr.gibba045.orlgmj (mgr.34412) 1912 : cluster [DBG] pgmap v1077: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:19.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:24:19 gibba015 bash[29377]: cluster 2021-03-10T14:24:18.426605+0000 mgr.gibba045.orlgmj (mgr.34412) 1912 : cluster [DBG] pgmap v1077: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:19.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:24:19 gibba015 bash[30343]: cluster 2021-03-10T14:24:18.426605+0000 mgr.gibba045.orlgmj (mgr.34412) 1912 : cluster [DBG] pgmap v1077: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:21.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:24:21 gibba045 bash[25517]: cluster 2021-03-10T14:24:20.428225+0000 mgr.gibba045.orlgmj (mgr.34412) 1913 : cluster [DBG] pgmap v1078: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:21.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:24:21 gibba015 bash[29377]: cluster 2021-03-10T14:24:20.428225+0000 mgr.gibba045.orlgmj (mgr.34412) 1913 : cluster [DBG] pgmap v1078: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:21.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:24:21 gibba015 bash[30343]: cluster 2021-03-10T14:24:20.428225+0000 mgr.gibba045.orlgmj (mgr.34412) 1913 : cluster [DBG] pgmap v1078: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:23.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:24:23 gibba015 bash[29377]: cluster 2021-03-10T14:24:22.429428+0000 mgr.gibba045.orlgmj (mgr.34412) 1914 : cluster [DBG] pgmap v1079: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:23.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:24:23 gibba015 bash[30343]: cluster 2021-03-10T14:24:22.429428+0000 mgr.gibba045.orlgmj (mgr.34412) 1914 : cluster [DBG] pgmap v1079: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:23.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:24:23 gibba045 bash[25517]: cluster 2021-03-10T14:24:22.429428+0000 mgr.gibba045.orlgmj (mgr.34412) 1914 : cluster [DBG] pgmap v1079: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:25.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:24:25 gibba045 bash[25517]: cluster 2021-03-10T14:24:24.430929+0000 mgr.gibba045.orlgmj (mgr.34412) 1915 : cluster [DBG] pgmap v1080: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:25.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:24:25 gibba045 bash[25517]: cephadm 2021-03-10T14:24:24.436213+0000 mgr.gibba045.orlgmj (mgr.34412) 1916 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:24:25.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:24:25 gibba015 bash[29377]: cluster 2021-03-10T14:24:24.430929+0000 mgr.gibba045.orlgmj (mgr.34412) 1915 : cluster [DBG] pgmap v1080: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:25.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:24:25 gibba015 bash[29377]: cephadm 2021-03-10T14:24:24.436213+0000 mgr.gibba045.orlgmj (mgr.34412) 1916 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:24:25.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:24:25 gibba015 bash[30343]: cluster 2021-03-10T14:24:24.430929+0000 mgr.gibba045.orlgmj (mgr.34412) 1915 : cluster [DBG] pgmap v1080: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:25.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:24:25 gibba015 bash[30343]: cephadm 2021-03-10T14:24:24.436213+0000 mgr.gibba045.orlgmj (mgr.34412) 1916 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:24:27.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:24:27 gibba045 bash[25517]: cluster 2021-03-10T14:24:26.432917+0000 mgr.gibba045.orlgmj (mgr.34412) 1917 : cluster [DBG] pgmap v1081: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:27.921 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:24:27.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:24:27 gibba015 bash[29377]: cluster 2021-03-10T14:24:26.432917+0000 mgr.gibba045.orlgmj (mgr.34412) 1917 : cluster [DBG] pgmap v1081: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:27.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:24:27 gibba015 bash[30343]: cluster 2021-03-10T14:24:26.432917+0000 mgr.gibba045.orlgmj (mgr.34412) 1917 : cluster [DBG] pgmap v1081: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:28.180 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:24:28.181 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (35m) 49s ago 40m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:24:28.181 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (40m) 10m ago 40m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:24:28.181 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (35m) 10m ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:24:28.181 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (35m) 10m ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:24:28.182 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (34m) 49s ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:24:28.182 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (34m) 49s ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:24:28.182 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (34m) 10m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:24:28.182 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (34m) 49s ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:24:28.182 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (40m) 49s ago 40m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:24:28.183 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (40m) 10m ago 40m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:24:28.183 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (33m) 49s ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:24:28.183 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (33m) 49s ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:24:28.183 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (32m) 49s ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:24:28.184 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (32m) 49s ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:24:28.184 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (31m) 10m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:24:28.184 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (31m) 10m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:24:28.184 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (30m) 10m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:24:28.184 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (30m) 10m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:24:28.185 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (40m) 10m ago 40m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:24:28.185 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 10m ago 38m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:24:28.429 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:24:28.430 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:24:28.430 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:24:28.430 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:24:28.431 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:24:28.431 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:24:28.431 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:24:28.431 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:24:28.431 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:24:28.432 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:24:28.432 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:24:28.432 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:24:28.432 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:24:28.433 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:24:28.433 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:24:28.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:24:28 gibba045 bash[25517]: audit 2021-03-10T14:24:28.427067+0000 mon.c (mon.1) 589 : audit [DBG] from='client.? 172.21.2.115:0/2405626376' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:24:28.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:24:28 gibba015 bash[29377]: audit 2021-03-10T14:24:28.427067+0000 mon.c (mon.1) 589 : audit [DBG] from='client.? 172.21.2.115:0/2405626376' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:24:28.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:24:28 gibba015 bash[30343]: audit 2021-03-10T14:24:28.427067+0000 mon.c (mon.1) 589 : audit [DBG] from='client.? 172.21.2.115:0/2405626376' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:24:29.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:24:29 gibba045 bash[25517]: audit 2021-03-10T14:24:27.913958+0000 mgr.gibba045.orlgmj (mgr.34412) 1918 : audit [DBG] from='client.55336 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:24:29.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:24:29 gibba045 bash[25517]: audit 2021-03-10T14:24:28.139649+0000 mgr.gibba045.orlgmj (mgr.34412) 1919 : audit [DBG] from='client.55342 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:24:29.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:24:29 gibba045 bash[25517]: cluster 2021-03-10T14:24:28.433916+0000 mgr.gibba045.orlgmj (mgr.34412) 1920 : cluster [DBG] pgmap v1082: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:29.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:24:29 gibba015 bash[29377]: audit 2021-03-10T14:24:27.913958+0000 mgr.gibba045.orlgmj (mgr.34412) 1918 : audit [DBG] from='client.55336 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:24:29.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:24:29 gibba015 bash[29377]: audit 2021-03-10T14:24:28.139649+0000 mgr.gibba045.orlgmj (mgr.34412) 1919 : audit [DBG] from='client.55342 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:24:29.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:24:29 gibba015 bash[29377]: cluster 2021-03-10T14:24:28.433916+0000 mgr.gibba045.orlgmj (mgr.34412) 1920 : cluster [DBG] pgmap v1082: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:29.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:24:29 gibba015 bash[30343]: audit 2021-03-10T14:24:27.913958+0000 mgr.gibba045.orlgmj (mgr.34412) 1918 : audit [DBG] from='client.55336 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:24:29.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:24:29 gibba015 bash[30343]: audit 2021-03-10T14:24:28.139649+0000 mgr.gibba045.orlgmj (mgr.34412) 1919 : audit [DBG] from='client.55342 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:24:29.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:24:29 gibba015 bash[30343]: cluster 2021-03-10T14:24:28.433916+0000 mgr.gibba045.orlgmj (mgr.34412) 1920 : cluster [DBG] pgmap v1082: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:31.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:24:31 gibba045 bash[25517]: cluster 2021-03-10T14:24:30.435571+0000 mgr.gibba045.orlgmj (mgr.34412) 1921 : cluster [DBG] pgmap v1083: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:31.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:24:31 gibba015 bash[29377]: cluster 2021-03-10T14:24:30.435571+0000 mgr.gibba045.orlgmj (mgr.34412) 1921 : cluster [DBG] pgmap v1083: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:31.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:24:31 gibba015 bash[30343]: cluster 2021-03-10T14:24:30.435571+0000 mgr.gibba045.orlgmj (mgr.34412) 1921 : cluster [DBG] pgmap v1083: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:33.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:24:33 gibba015 bash[29377]: cluster 2021-03-10T14:24:32.436758+0000 mgr.gibba045.orlgmj (mgr.34412) 1922 : cluster [DBG] pgmap v1084: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:33.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:24:33 gibba015 bash[30343]: cluster 2021-03-10T14:24:32.436758+0000 mgr.gibba045.orlgmj (mgr.34412) 1922 : cluster [DBG] pgmap v1084: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:33.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:24:33 gibba045 bash[25517]: cluster 2021-03-10T14:24:32.436758+0000 mgr.gibba045.orlgmj (mgr.34412) 1922 : cluster [DBG] pgmap v1084: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:35.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:24:35 gibba045 bash[25517]: cluster 2021-03-10T14:24:34.438123+0000 mgr.gibba045.orlgmj (mgr.34412) 1923 : cluster [DBG] pgmap v1085: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:35.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:24:35 gibba015 bash[29377]: cluster 2021-03-10T14:24:34.438123+0000 mgr.gibba045.orlgmj (mgr.34412) 1923 : cluster [DBG] pgmap v1085: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:35.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:24:35 gibba015 bash[30343]: cluster 2021-03-10T14:24:34.438123+0000 mgr.gibba045.orlgmj (mgr.34412) 1923 : cluster [DBG] pgmap v1085: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:37.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:24:37 gibba045 bash[25517]: cluster 2021-03-10T14:24:36.439764+0000 mgr.gibba045.orlgmj (mgr.34412) 1924 : cluster [DBG] pgmap v1086: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:37.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:24:37 gibba015 bash[29377]: cluster 2021-03-10T14:24:36.439764+0000 mgr.gibba045.orlgmj (mgr.34412) 1924 : cluster [DBG] pgmap v1086: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:37.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:24:37 gibba015 bash[30343]: cluster 2021-03-10T14:24:36.439764+0000 mgr.gibba045.orlgmj (mgr.34412) 1924 : cluster [DBG] pgmap v1086: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:39.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:24:39 gibba045 bash[25517]: cluster 2021-03-10T14:24:38.441145+0000 mgr.gibba045.orlgmj (mgr.34412) 1925 : cluster [DBG] pgmap v1087: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:39.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:24:39 gibba045 bash[25517]: audit 2021-03-10T14:24:39.449310+0000 mon.c (mon.1) 590 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:24:39.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:24:39 gibba045 bash[25517]: audit 2021-03-10T14:24:39.456402+0000 mon.c (mon.1) 591 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:24:39.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:24:39 gibba015 bash[29377]: cluster 2021-03-10T14:24:38.441145+0000 mgr.gibba045.orlgmj (mgr.34412) 1925 : cluster [DBG] pgmap v1087: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:39.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:24:39 gibba015 bash[29377]: audit 2021-03-10T14:24:39.449310+0000 mon.c (mon.1) 590 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:24:39.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:24:39 gibba015 bash[29377]: audit 2021-03-10T14:24:39.456402+0000 mon.c (mon.1) 591 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:24:39.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:24:39 gibba015 bash[30343]: cluster 2021-03-10T14:24:38.441145+0000 mgr.gibba045.orlgmj (mgr.34412) 1925 : cluster [DBG] pgmap v1087: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:39.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:24:39 gibba015 bash[30343]: audit 2021-03-10T14:24:39.449310+0000 mon.c (mon.1) 590 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:24:39.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:24:39 gibba015 bash[30343]: audit 2021-03-10T14:24:39.456402+0000 mon.c (mon.1) 591 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:24:40.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:24:40 gibba045 bash[25517]: cephadm 2021-03-10T14:24:39.457887+0000 mgr.gibba045.orlgmj (mgr.34412) 1926 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:24:40.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:24:40 gibba015 bash[29377]: cephadm 2021-03-10T14:24:39.457887+0000 mgr.gibba045.orlgmj (mgr.34412) 1926 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:24:40.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:24:40 gibba015 bash[30343]: cephadm 2021-03-10T14:24:39.457887+0000 mgr.gibba045.orlgmj (mgr.34412) 1926 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:24:41.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:24:41 gibba045 bash[25517]: cluster 2021-03-10T14:24:40.442682+0000 mgr.gibba045.orlgmj (mgr.34412) 1927 : cluster [DBG] pgmap v1088: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:41.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:24:41 gibba015 bash[29377]: cluster 2021-03-10T14:24:40.442682+0000 mgr.gibba045.orlgmj (mgr.34412) 1927 : cluster [DBG] pgmap v1088: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:41.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:24:41 gibba015 bash[30343]: cluster 2021-03-10T14:24:40.442682+0000 mgr.gibba045.orlgmj (mgr.34412) 1927 : cluster [DBG] pgmap v1088: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:43.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:24:43 gibba015 bash[29377]: cluster 2021-03-10T14:24:42.443200+0000 mgr.gibba045.orlgmj (mgr.34412) 1928 : cluster [DBG] pgmap v1089: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:43.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:24:43 gibba015 bash[29377]: audit 2021-03-10T14:24:43.255537+0000 mon.a (mon.0) 834 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:24:43.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:24:43 gibba015 bash[30343]: cluster 2021-03-10T14:24:42.443200+0000 mgr.gibba045.orlgmj (mgr.34412) 1928 : cluster [DBG] pgmap v1089: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:43.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:24:43 gibba015 bash[30343]: audit 2021-03-10T14:24:43.255537+0000 mon.a (mon.0) 834 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:24:43.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:24:43 gibba045 bash[25517]: cluster 2021-03-10T14:24:42.443200+0000 mgr.gibba045.orlgmj (mgr.34412) 1928 : cluster [DBG] pgmap v1089: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:43.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:24:43 gibba045 bash[25517]: audit 2021-03-10T14:24:43.255537+0000 mon.a (mon.0) 834 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:24:44.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:24:44 gibba045 bash[25517]: cephadm 2021-03-10T14:24:43.260047+0000 mgr.gibba045.orlgmj (mgr.34412) 1929 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:24:44.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:24:44 gibba045 bash[25517]: audit 2021-03-10T14:24:43.472348+0000 mon.a (mon.0) 835 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:24:44.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:24:44 gibba045 bash[25517]: audit 2021-03-10T14:24:43.476383+0000 mon.c (mon.1) 592 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:24:44.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:24:44 gibba045 bash[25517]: audit 2021-03-10T14:24:43.477824+0000 mon.c (mon.1) 593 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:24:44.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:24:44 gibba045 bash[25517]: cephadm 2021-03-10T14:24:43.478656+0000 mgr.gibba045.orlgmj (mgr.34412) 1930 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:24:44.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:24:44 gibba045 bash[25517]: audit 2021-03-10T14:24:43.479108+0000 mon.c (mon.1) 594 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:24:44.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:24:44 gibba045 bash[25517]: audit 2021-03-10T14:24:43.480274+0000 mon.c (mon.1) 595 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:24:44.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:24:44 gibba045 bash[25517]: cephadm 2021-03-10T14:24:43.480680+0000 mgr.gibba045.orlgmj (mgr.34412) 1931 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:24:44.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:24:44 gibba045 bash[25517]: cephadm 2021-03-10T14:24:43.481960+0000 mgr.gibba045.orlgmj (mgr.34412) 1932 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:24:44.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:24:44 gibba045 bash[25517]: cephadm 2021-03-10T14:24:43.481996+0000 mgr.gibba045.orlgmj (mgr.34412) 1933 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:24:44.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:24:44 gibba045 bash[25517]: cephadm 2021-03-10T14:24:43.483147+0000 mgr.gibba045.orlgmj (mgr.34412) 1934 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:24:44.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:24:44 gibba045 bash[25517]: cephadm 2021-03-10T14:24:43.483182+0000 mgr.gibba045.orlgmj (mgr.34412) 1935 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:24:44.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:24:44 gibba045 bash[25517]: audit 2021-03-10T14:24:43.483244+0000 mon.c (mon.1) 596 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:24:44.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:24:44 gibba045 bash[25517]: cephadm 2021-03-10T14:24:43.484391+0000 mgr.gibba045.orlgmj (mgr.34412) 1936 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:24:44.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:24:44 gibba045 bash[25517]: audit 2021-03-10T14:24:43.484649+0000 mon.c (mon.1) 597 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:24:44.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:24:44 gibba045 bash[25517]: cephadm 2021-03-10T14:24:43.486006+0000 mgr.gibba045.orlgmj (mgr.34412) 1937 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:24:44.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:24:44 gibba045 bash[25517]: cephadm 2021-03-10T14:24:43.486045+0000 mgr.gibba045.orlgmj (mgr.34412) 1938 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:24:44.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:24:44 gibba045 bash[25517]: cephadm 2021-03-10T14:24:43.487309+0000 mgr.gibba045.orlgmj (mgr.34412) 1939 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:24:44.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:24:44 gibba045 bash[25517]: cephadm 2021-03-10T14:24:43.487636+0000 mgr.gibba045.orlgmj (mgr.34412) 1940 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:24:44.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:24:44 gibba045 bash[25517]: cephadm 2021-03-10T14:24:43.488779+0000 mgr.gibba045.orlgmj (mgr.34412) 1941 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:24:44.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:24:44 gibba045 bash[25517]: cephadm 2021-03-10T14:24:43.488816+0000 mgr.gibba045.orlgmj (mgr.34412) 1942 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:24:44.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:24:44 gibba045 bash[25517]: cephadm 2021-03-10T14:24:43.488923+0000 mgr.gibba045.orlgmj (mgr.34412) 1943 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:24:44.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:24:44 gibba015 bash[29377]: cephadm 2021-03-10T14:24:43.260047+0000 mgr.gibba045.orlgmj (mgr.34412) 1929 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:24:44.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:24:44 gibba015 bash[29377]: audit 2021-03-10T14:24:43.472348+0000 mon.a (mon.0) 835 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:24:44.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:24:44 gibba015 bash[29377]: audit 2021-03-10T14:24:43.476383+0000 mon.c (mon.1) 592 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:24:44.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:24:44 gibba015 bash[29377]: audit 2021-03-10T14:24:43.477824+0000 mon.c (mon.1) 593 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:24:44.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:24:44 gibba015 bash[29377]: cephadm 2021-03-10T14:24:43.478656+0000 mgr.gibba045.orlgmj (mgr.34412) 1930 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:24:44.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:24:44 gibba015 bash[29377]: audit 2021-03-10T14:24:43.479108+0000 mon.c (mon.1) 594 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:24:44.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:24:44 gibba015 bash[29377]: audit 2021-03-10T14:24:43.480274+0000 mon.c (mon.1) 595 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:24:44.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:24:44 gibba015 bash[29377]: cephadm 2021-03-10T14:24:43.480680+0000 mgr.gibba045.orlgmj (mgr.34412) 1931 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:24:44.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:24:44 gibba015 bash[29377]: cephadm 2021-03-10T14:24:43.481960+0000 mgr.gibba045.orlgmj (mgr.34412) 1932 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:24:44.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:24:44 gibba015 bash[29377]: cephadm 2021-03-10T14:24:43.481996+0000 mgr.gibba045.orlgmj (mgr.34412) 1933 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:24:44.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:24:44 gibba015 bash[29377]: cephadm 2021-03-10T14:24:43.483147+0000 mgr.gibba045.orlgmj (mgr.34412) 1934 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:24:44.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:24:44 gibba015 bash[29377]: cephadm 2021-03-10T14:24:43.483182+0000 mgr.gibba045.orlgmj (mgr.34412) 1935 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:24:44.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:24:44 gibba015 bash[29377]: audit 2021-03-10T14:24:43.483244+0000 mon.c (mon.1) 596 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:24:44.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:24:44 gibba015 bash[29377]: cephadm 2021-03-10T14:24:43.484391+0000 mgr.gibba045.orlgmj (mgr.34412) 1936 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:24:44.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:24:44 gibba015 bash[29377]: audit 2021-03-10T14:24:43.484649+0000 mon.c (mon.1) 597 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:24:44.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:24:44 gibba015 bash[29377]: cephadm 2021-03-10T14:24:43.486006+0000 mgr.gibba045.orlgmj (mgr.34412) 1937 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:24:44.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:24:44 gibba015 bash[29377]: cephadm 2021-03-10T14:24:43.486045+0000 mgr.gibba045.orlgmj (mgr.34412) 1938 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:24:44.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:24:44 gibba015 bash[29377]: cephadm 2021-03-10T14:24:43.487309+0000 mgr.gibba045.orlgmj (mgr.34412) 1939 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:24:44.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:24:44 gibba015 bash[29377]: cephadm 2021-03-10T14:24:43.487636+0000 mgr.gibba045.orlgmj (mgr.34412) 1940 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:24:44.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:24:44 gibba015 bash[29377]: cephadm 2021-03-10T14:24:43.488779+0000 mgr.gibba045.orlgmj (mgr.34412) 1941 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:24:44.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:24:44 gibba015 bash[29377]: cephadm 2021-03-10T14:24:43.488816+0000 mgr.gibba045.orlgmj (mgr.34412) 1942 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:24:44.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:24:44 gibba015 bash[29377]: cephadm 2021-03-10T14:24:43.488923+0000 mgr.gibba045.orlgmj (mgr.34412) 1943 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:24:44.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:24:44 gibba015 bash[30343]: cephadm 2021-03-10T14:24:43.260047+0000 mgr.gibba045.orlgmj (mgr.34412) 1929 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:24:44.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:24:44 gibba015 bash[30343]: audit 2021-03-10T14:24:43.472348+0000 mon.a (mon.0) 835 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:24:44.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:24:44 gibba015 bash[30343]: audit 2021-03-10T14:24:43.476383+0000 mon.c (mon.1) 592 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:24:44.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:24:44 gibba015 bash[30343]: audit 2021-03-10T14:24:43.477824+0000 mon.c (mon.1) 593 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:24:44.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:24:44 gibba015 bash[30343]: cephadm 2021-03-10T14:24:43.478656+0000 mgr.gibba045.orlgmj (mgr.34412) 1930 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:24:44.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:24:44 gibba015 bash[30343]: audit 2021-03-10T14:24:43.479108+0000 mon.c (mon.1) 594 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:24:44.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:24:44 gibba015 bash[30343]: audit 2021-03-10T14:24:43.480274+0000 mon.c (mon.1) 595 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:24:44.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:24:44 gibba015 bash[30343]: cephadm 2021-03-10T14:24:43.480680+0000 mgr.gibba045.orlgmj (mgr.34412) 1931 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:24:44.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:24:44 gibba015 bash[30343]: cephadm 2021-03-10T14:24:43.481960+0000 mgr.gibba045.orlgmj (mgr.34412) 1932 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:24:44.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:24:44 gibba015 bash[30343]: cephadm 2021-03-10T14:24:43.481996+0000 mgr.gibba045.orlgmj (mgr.34412) 1933 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:24:44.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:24:44 gibba015 bash[30343]: cephadm 2021-03-10T14:24:43.483147+0000 mgr.gibba045.orlgmj (mgr.34412) 1934 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:24:44.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:24:44 gibba015 bash[30343]: cephadm 2021-03-10T14:24:43.483182+0000 mgr.gibba045.orlgmj (mgr.34412) 1935 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:24:44.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:24:44 gibba015 bash[30343]: audit 2021-03-10T14:24:43.483244+0000 mon.c (mon.1) 596 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:24:44.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:24:44 gibba015 bash[30343]: cephadm 2021-03-10T14:24:43.484391+0000 mgr.gibba045.orlgmj (mgr.34412) 1936 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:24:44.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:24:44 gibba015 bash[30343]: audit 2021-03-10T14:24:43.484649+0000 mon.c (mon.1) 597 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:24:44.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:24:44 gibba015 bash[30343]: cephadm 2021-03-10T14:24:43.486006+0000 mgr.gibba045.orlgmj (mgr.34412) 1937 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:24:44.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:24:44 gibba015 bash[30343]: cephadm 2021-03-10T14:24:43.486045+0000 mgr.gibba045.orlgmj (mgr.34412) 1938 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:24:44.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:24:44 gibba015 bash[30343]: cephadm 2021-03-10T14:24:43.487309+0000 mgr.gibba045.orlgmj (mgr.34412) 1939 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:24:44.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:24:44 gibba015 bash[30343]: cephadm 2021-03-10T14:24:43.487636+0000 mgr.gibba045.orlgmj (mgr.34412) 1940 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:24:44.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:24:44 gibba015 bash[30343]: cephadm 2021-03-10T14:24:43.488779+0000 mgr.gibba045.orlgmj (mgr.34412) 1941 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:24:44.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:24:44 gibba015 bash[30343]: cephadm 2021-03-10T14:24:43.488816+0000 mgr.gibba045.orlgmj (mgr.34412) 1942 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:24:44.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:24:44 gibba015 bash[30343]: cephadm 2021-03-10T14:24:43.488923+0000 mgr.gibba045.orlgmj (mgr.34412) 1943 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:24:45.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:24:45 gibba045 bash[25517]: cluster 2021-03-10T14:24:44.444469+0000 mgr.gibba045.orlgmj (mgr.34412) 1944 : cluster [DBG] pgmap v1090: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:45.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:24:45 gibba015 bash[29377]: cluster 2021-03-10T14:24:44.444469+0000 mgr.gibba045.orlgmj (mgr.34412) 1944 : cluster [DBG] pgmap v1090: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:45.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:24:45 gibba015 bash[30343]: cluster 2021-03-10T14:24:44.444469+0000 mgr.gibba045.orlgmj (mgr.34412) 1944 : cluster [DBG] pgmap v1090: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:47.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:24:47 gibba045 bash[25517]: cluster 2021-03-10T14:24:46.446183+0000 mgr.gibba045.orlgmj (mgr.34412) 1945 : cluster [DBG] pgmap v1091: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:47.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:24:47 gibba015 bash[29377]: cluster 2021-03-10T14:24:46.446183+0000 mgr.gibba045.orlgmj (mgr.34412) 1945 : cluster [DBG] pgmap v1091: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:47.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:24:47 gibba015 bash[30343]: cluster 2021-03-10T14:24:46.446183+0000 mgr.gibba045.orlgmj (mgr.34412) 1945 : cluster [DBG] pgmap v1091: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:49.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:24:49 gibba045 bash[25517]: cluster 2021-03-10T14:24:48.447230+0000 mgr.gibba045.orlgmj (mgr.34412) 1946 : cluster [DBG] pgmap v1092: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:49.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:24:49 gibba015 bash[29377]: cluster 2021-03-10T14:24:48.447230+0000 mgr.gibba045.orlgmj (mgr.34412) 1946 : cluster [DBG] pgmap v1092: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:49.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:24:49 gibba015 bash[30343]: cluster 2021-03-10T14:24:48.447230+0000 mgr.gibba045.orlgmj (mgr.34412) 1946 : cluster [DBG] pgmap v1092: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:51.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:24:51 gibba045 bash[25517]: cluster 2021-03-10T14:24:50.448818+0000 mgr.gibba045.orlgmj (mgr.34412) 1947 : cluster [DBG] pgmap v1093: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:51.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:24:51 gibba015 bash[29377]: cluster 2021-03-10T14:24:50.448818+0000 mgr.gibba045.orlgmj (mgr.34412) 1947 : cluster [DBG] pgmap v1093: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:51.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:24:51 gibba015 bash[30343]: cluster 2021-03-10T14:24:50.448818+0000 mgr.gibba045.orlgmj (mgr.34412) 1947 : cluster [DBG] pgmap v1093: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:53.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:24:53 gibba015 bash[29377]: cluster 2021-03-10T14:24:52.449836+0000 mgr.gibba045.orlgmj (mgr.34412) 1948 : cluster [DBG] pgmap v1094: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:53.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:24:53 gibba015 bash[29377]: audit 2021-03-10T14:24:52.680254+0000 mon.c (mon.1) 598 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:24:53.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:24:53 gibba015 bash[29377]: audit 2021-03-10T14:24:52.680906+0000 mon.c (mon.1) 599 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:24:53.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:24:53 gibba015 bash[29377]: audit 2021-03-10T14:24:52.681367+0000 mon.a (mon.0) 836 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:24:53.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:24:53 gibba015 bash[29377]: audit 2021-03-10T14:24:52.682531+0000 mon.a (mon.0) 837 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:24:53.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:24:53 gibba015 bash[29377]: audit 2021-03-10T14:24:52.685705+0000 mon.c (mon.1) 600 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T14:24:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:24:53 gibba015 bash[29377]: audit 2021-03-10T14:24:52.686403+0000 mon.c (mon.1) 601 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:24:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:24:53 gibba015 bash[29377]: audit 2021-03-10T14:24:52.686835+0000 mon.a (mon.0) 838 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T14:24:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:24:53 gibba015 bash[29377]: audit 2021-03-10T14:24:52.687132+0000 mon.c (mon.1) 602 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T14:24:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:24:53 gibba015 bash[29377]: audit 2021-03-10T14:24:52.687957+0000 mon.c (mon.1) 603 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:24:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:24:53 gibba015 bash[29377]: audit 2021-03-10T14:24:52.688347+0000 mon.a (mon.0) 839 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:24:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:24:53 gibba015 bash[29377]: audit 2021-03-10T14:24:52.689396+0000 mon.a (mon.0) 840 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T14:24:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:24:53 gibba015 bash[29377]: audit 2021-03-10T14:24:52.690204+0000 mon.a (mon.0) 841 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:24:53.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:24:53 gibba015 bash[30343]: cluster 2021-03-10T14:24:52.449836+0000 mgr.gibba045.orlgmj (mgr.34412) 1948 : cluster [DBG] pgmap v1094: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:53.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:24:53 gibba015 bash[30343]: audit 2021-03-10T14:24:52.680254+0000 mon.c (mon.1) 598 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:24:53.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:24:53 gibba015 bash[30343]: audit 2021-03-10T14:24:52.680906+0000 mon.c (mon.1) 599 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:24:53.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:24:53 gibba015 bash[30343]: audit 2021-03-10T14:24:52.681367+0000 mon.a (mon.0) 836 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:24:53.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:24:53 gibba015 bash[30343]: audit 2021-03-10T14:24:52.682531+0000 mon.a (mon.0) 837 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:24:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:24:53 gibba015 bash[30343]: audit 2021-03-10T14:24:52.685705+0000 mon.c (mon.1) 600 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T14:24:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:24:53 gibba015 bash[30343]: audit 2021-03-10T14:24:52.686403+0000 mon.c (mon.1) 601 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:24:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:24:53 gibba015 bash[30343]: audit 2021-03-10T14:24:52.686835+0000 mon.a (mon.0) 838 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T14:24:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:24:53 gibba015 bash[30343]: audit 2021-03-10T14:24:52.687132+0000 mon.c (mon.1) 602 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T14:24:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:24:53 gibba015 bash[30343]: audit 2021-03-10T14:24:52.687957+0000 mon.c (mon.1) 603 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:24:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:24:53 gibba015 bash[30343]: audit 2021-03-10T14:24:52.688347+0000 mon.a (mon.0) 839 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:24:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:24:53 gibba015 bash[30343]: audit 2021-03-10T14:24:52.689396+0000 mon.a (mon.0) 840 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T14:24:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:24:53 gibba015 bash[30343]: audit 2021-03-10T14:24:52.690204+0000 mon.a (mon.0) 841 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:24:53.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:24:53 gibba045 bash[25517]: cluster 2021-03-10T14:24:52.449836+0000 mgr.gibba045.orlgmj (mgr.34412) 1948 : cluster [DBG] pgmap v1094: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:53.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:24:53 gibba045 bash[25517]: audit 2021-03-10T14:24:52.680254+0000 mon.c (mon.1) 598 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:24:53.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:24:53 gibba045 bash[25517]: audit 2021-03-10T14:24:52.680906+0000 mon.c (mon.1) 599 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:24:53.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:24:53 gibba045 bash[25517]: audit 2021-03-10T14:24:52.681367+0000 mon.a (mon.0) 836 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:24:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:24:53 gibba045 bash[25517]: audit 2021-03-10T14:24:52.682531+0000 mon.a (mon.0) 837 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:24:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:24:53 gibba045 bash[25517]: audit 2021-03-10T14:24:52.685705+0000 mon.c (mon.1) 600 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T14:24:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:24:53 gibba045 bash[25517]: audit 2021-03-10T14:24:52.686403+0000 mon.c (mon.1) 601 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:24:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:24:53 gibba045 bash[25517]: audit 2021-03-10T14:24:52.686835+0000 mon.a (mon.0) 838 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T14:24:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:24:53 gibba045 bash[25517]: audit 2021-03-10T14:24:52.687132+0000 mon.c (mon.1) 602 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T14:24:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:24:53 gibba045 bash[25517]: audit 2021-03-10T14:24:52.687957+0000 mon.c (mon.1) 603 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:24:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:24:53 gibba045 bash[25517]: audit 2021-03-10T14:24:52.688347+0000 mon.a (mon.0) 839 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:24:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:24:53 gibba045 bash[25517]: audit 2021-03-10T14:24:52.689396+0000 mon.a (mon.0) 840 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T14:24:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:24:53 gibba045 bash[25517]: audit 2021-03-10T14:24:52.690204+0000 mon.a (mon.0) 841 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:24:55.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:24:55 gibba045 bash[25517]: cluster 2021-03-10T14:24:54.451011+0000 mgr.gibba045.orlgmj (mgr.34412) 1949 : cluster [DBG] pgmap v1095: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:55.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:24:55 gibba015 bash[29377]: cluster 2021-03-10T14:24:54.451011+0000 mgr.gibba045.orlgmj (mgr.34412) 1949 : cluster [DBG] pgmap v1095: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:55.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:24:55 gibba015 bash[30343]: cluster 2021-03-10T14:24:54.451011+0000 mgr.gibba045.orlgmj (mgr.34412) 1949 : cluster [DBG] pgmap v1095: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:57.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:24:57 gibba045 bash[25517]: cluster 2021-03-10T14:24:56.452985+0000 mgr.gibba045.orlgmj (mgr.34412) 1950 : cluster [DBG] pgmap v1096: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:57.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:24:57 gibba015 bash[29377]: cluster 2021-03-10T14:24:56.452985+0000 mgr.gibba045.orlgmj (mgr.34412) 1950 : cluster [DBG] pgmap v1096: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:57.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:24:57 gibba015 bash[30343]: cluster 2021-03-10T14:24:56.452985+0000 mgr.gibba045.orlgmj (mgr.34412) 1950 : cluster [DBG] pgmap v1096: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:58.671 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:24:58.900 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:24:58.900 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (35m) 79s ago 41m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:24:58.901 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (40m) 15s ago 40m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:24:58.901 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (36m) 15s ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:24:58.901 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (36m) 15s ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:24:58.901 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (35m) 79s ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:24:58.901 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (35m) 79s ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:24:58.902 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (34m) 15s ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:24:58.902 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (34m) 79s ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:24:58.902 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (41m) 79s ago 41m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:24:58.902 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (41m) 15s ago 41m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:24:58.903 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (34m) 79s ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:24:58.903 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (33m) 79s ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:24:58.903 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (33m) 79s ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:24:58.903 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (32m) 79s ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:24:58.903 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (32m) 15s ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:24:58.904 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (31m) 15s ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:24:58.904 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (31m) 15s ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:24:58.904 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (30m) 15s ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:24:58.904 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (40m) 15s ago 41m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:24:58.904 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 15s ago 39m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:24:59.151 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:24:59.151 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:24:59.152 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:24:59.152 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:24:59.152 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:24:59.152 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:24:59.152 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:24:59.153 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:24:59.153 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:24:59.153 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:24:59.153 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:24:59.153 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:24:59.154 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:24:59.154 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:24:59.154 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:24:59.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:24:59 gibba045 bash[25517]: cluster 2021-03-10T14:24:58.454342+0000 mgr.gibba045.orlgmj (mgr.34412) 1951 : cluster [DBG] pgmap v1097: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:59.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:24:59 gibba045 bash[25517]: cephadm 2021-03-10T14:24:58.497411+0000 mgr.gibba045.orlgmj (mgr.34412) 1952 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:24:59.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:24:59 gibba045 bash[25517]: audit 2021-03-10T14:24:59.149014+0000 mon.a (mon.0) 842 : audit [DBG] from='client.? 172.21.2.115:0/1089353486' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:24:59.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:24:59 gibba015 bash[29377]: cluster 2021-03-10T14:24:58.454342+0000 mgr.gibba045.orlgmj (mgr.34412) 1951 : cluster [DBG] pgmap v1097: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:59.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:24:59 gibba015 bash[29377]: cephadm 2021-03-10T14:24:58.497411+0000 mgr.gibba045.orlgmj (mgr.34412) 1952 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:24:59.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:24:59 gibba015 bash[29377]: audit 2021-03-10T14:24:59.149014+0000 mon.a (mon.0) 842 : audit [DBG] from='client.? 172.21.2.115:0/1089353486' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:24:59.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:24:59 gibba015 bash[30343]: cluster 2021-03-10T14:24:58.454342+0000 mgr.gibba045.orlgmj (mgr.34412) 1951 : cluster [DBG] pgmap v1097: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:59.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:24:59 gibba015 bash[30343]: cephadm 2021-03-10T14:24:58.497411+0000 mgr.gibba045.orlgmj (mgr.34412) 1952 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:24:59.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:24:59 gibba015 bash[30343]: audit 2021-03-10T14:24:59.149014+0000 mon.a (mon.0) 842 : audit [DBG] from='client.? 172.21.2.115:0/1089353486' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:25:00.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:25:00 gibba045 bash[25517]: audit 2021-03-10T14:24:58.663554+0000 mgr.gibba045.orlgmj (mgr.34412) 1953 : audit [DBG] from='client.55354 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:25:00.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:25:00 gibba045 bash[25517]: audit 2021-03-10T14:24:58.888558+0000 mgr.gibba045.orlgmj (mgr.34412) 1954 : audit [DBG] from='client.45372 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:25:00.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:25:00 gibba015 bash[29377]: audit 2021-03-10T14:24:58.663554+0000 mgr.gibba045.orlgmj (mgr.34412) 1953 : audit [DBG] from='client.55354 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:25:00.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:25:00 gibba015 bash[29377]: audit 2021-03-10T14:24:58.888558+0000 mgr.gibba045.orlgmj (mgr.34412) 1954 : audit [DBG] from='client.45372 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:25:00.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:25:00 gibba015 bash[30343]: audit 2021-03-10T14:24:58.663554+0000 mgr.gibba045.orlgmj (mgr.34412) 1953 : audit [DBG] from='client.55354 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:25:00.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:25:00 gibba015 bash[30343]: audit 2021-03-10T14:24:58.888558+0000 mgr.gibba045.orlgmj (mgr.34412) 1954 : audit [DBG] from='client.45372 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:25:01.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:25:01 gibba045 bash[25517]: cluster 2021-03-10T14:25:00.456030+0000 mgr.gibba045.orlgmj (mgr.34412) 1955 : cluster [DBG] pgmap v1098: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:01.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:25:01 gibba015 bash[29377]: cluster 2021-03-10T14:25:00.456030+0000 mgr.gibba045.orlgmj (mgr.34412) 1955 : cluster [DBG] pgmap v1098: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:01.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:25:01 gibba015 bash[30343]: cluster 2021-03-10T14:25:00.456030+0000 mgr.gibba045.orlgmj (mgr.34412) 1955 : cluster [DBG] pgmap v1098: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:03.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:25:03 gibba015 bash[29377]: cluster 2021-03-10T14:25:02.457210+0000 mgr.gibba045.orlgmj (mgr.34412) 1956 : cluster [DBG] pgmap v1099: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:03.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:25:03 gibba015 bash[30343]: cluster 2021-03-10T14:25:02.457210+0000 mgr.gibba045.orlgmj (mgr.34412) 1956 : cluster [DBG] pgmap v1099: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:03.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:25:03 gibba045 bash[25517]: cluster 2021-03-10T14:25:02.457210+0000 mgr.gibba045.orlgmj (mgr.34412) 1956 : cluster [DBG] pgmap v1099: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:05.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:25:05 gibba045 bash[25517]: cluster 2021-03-10T14:25:04.458875+0000 mgr.gibba045.orlgmj (mgr.34412) 1957 : cluster [DBG] pgmap v1100: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:05.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:25:05 gibba015 bash[29377]: cluster 2021-03-10T14:25:04.458875+0000 mgr.gibba045.orlgmj (mgr.34412) 1957 : cluster [DBG] pgmap v1100: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:05.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:25:05 gibba015 bash[30343]: cluster 2021-03-10T14:25:04.458875+0000 mgr.gibba045.orlgmj (mgr.34412) 1957 : cluster [DBG] pgmap v1100: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:07.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:25:07 gibba045 bash[25517]: cluster 2021-03-10T14:25:06.461003+0000 mgr.gibba045.orlgmj (mgr.34412) 1958 : cluster [DBG] pgmap v1101: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:07.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:25:07 gibba015 bash[29377]: cluster 2021-03-10T14:25:06.461003+0000 mgr.gibba045.orlgmj (mgr.34412) 1958 : cluster [DBG] pgmap v1101: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:07.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:25:07 gibba015 bash[30343]: cluster 2021-03-10T14:25:06.461003+0000 mgr.gibba045.orlgmj (mgr.34412) 1958 : cluster [DBG] pgmap v1101: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:09.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:25:09 gibba045 bash[25517]: cluster 2021-03-10T14:25:08.462358+0000 mgr.gibba045.orlgmj (mgr.34412) 1959 : cluster [DBG] pgmap v1102: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:09.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:25:09 gibba015 bash[29377]: cluster 2021-03-10T14:25:08.462358+0000 mgr.gibba045.orlgmj (mgr.34412) 1959 : cluster [DBG] pgmap v1102: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:09.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:25:09 gibba015 bash[30343]: cluster 2021-03-10T14:25:08.462358+0000 mgr.gibba045.orlgmj (mgr.34412) 1959 : cluster [DBG] pgmap v1102: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:11.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:25:11 gibba045 bash[25517]: cluster 2021-03-10T14:25:10.464028+0000 mgr.gibba045.orlgmj (mgr.34412) 1960 : cluster [DBG] pgmap v1103: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:11.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:25:11 gibba015 bash[29377]: cluster 2021-03-10T14:25:10.464028+0000 mgr.gibba045.orlgmj (mgr.34412) 1960 : cluster [DBG] pgmap v1103: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:11.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:25:11 gibba015 bash[30343]: cluster 2021-03-10T14:25:10.464028+0000 mgr.gibba045.orlgmj (mgr.34412) 1960 : cluster [DBG] pgmap v1103: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:13.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:25:13 gibba015 bash[29377]: cluster 2021-03-10T14:25:12.465180+0000 mgr.gibba045.orlgmj (mgr.34412) 1961 : cluster [DBG] pgmap v1104: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:13.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:25:13 gibba015 bash[30343]: cluster 2021-03-10T14:25:12.465180+0000 mgr.gibba045.orlgmj (mgr.34412) 1961 : cluster [DBG] pgmap v1104: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:13.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:25:13 gibba045 bash[25517]: cluster 2021-03-10T14:25:12.465180+0000 mgr.gibba045.orlgmj (mgr.34412) 1961 : cluster [DBG] pgmap v1104: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:14.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:25:14 gibba015 bash[29377]: cephadm 2021-03-10T14:25:13.513453+0000 mgr.gibba045.orlgmj (mgr.34412) 1962 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:25:14.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:25:14 gibba015 bash[30343]: cephadm 2021-03-10T14:25:13.513453+0000 mgr.gibba045.orlgmj (mgr.34412) 1962 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:25:14.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:25:14 gibba045 bash[25517]: cephadm 2021-03-10T14:25:13.513453+0000 mgr.gibba045.orlgmj (mgr.34412) 1962 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:25:15.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:25:15 gibba015 bash[29377]: cluster 2021-03-10T14:25:14.466291+0000 mgr.gibba045.orlgmj (mgr.34412) 1963 : cluster [DBG] pgmap v1105: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:15.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:25:15 gibba015 bash[30343]: cluster 2021-03-10T14:25:14.466291+0000 mgr.gibba045.orlgmj (mgr.34412) 1963 : cluster [DBG] pgmap v1105: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:15.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:25:15 gibba045 bash[25517]: cluster 2021-03-10T14:25:14.466291+0000 mgr.gibba045.orlgmj (mgr.34412) 1963 : cluster [DBG] pgmap v1105: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:17.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:25:17 gibba045 bash[25517]: cluster 2021-03-10T14:25:16.468167+0000 mgr.gibba045.orlgmj (mgr.34412) 1964 : cluster [DBG] pgmap v1106: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:17.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:25:17 gibba015 bash[29377]: cluster 2021-03-10T14:25:16.468167+0000 mgr.gibba045.orlgmj (mgr.34412) 1964 : cluster [DBG] pgmap v1106: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:17.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:25:17 gibba015 bash[30343]: cluster 2021-03-10T14:25:16.468167+0000 mgr.gibba045.orlgmj (mgr.34412) 1964 : cluster [DBG] pgmap v1106: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:19.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:25:19 gibba045 bash[25517]: cluster 2021-03-10T14:25:18.469318+0000 mgr.gibba045.orlgmj (mgr.34412) 1965 : cluster [DBG] pgmap v1107: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:19.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:25:19 gibba015 bash[29377]: cluster 2021-03-10T14:25:18.469318+0000 mgr.gibba045.orlgmj (mgr.34412) 1965 : cluster [DBG] pgmap v1107: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:19.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:25:19 gibba015 bash[30343]: cluster 2021-03-10T14:25:18.469318+0000 mgr.gibba045.orlgmj (mgr.34412) 1965 : cluster [DBG] pgmap v1107: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:21.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:25:21 gibba045 bash[25517]: cluster 2021-03-10T14:25:20.471010+0000 mgr.gibba045.orlgmj (mgr.34412) 1966 : cluster [DBG] pgmap v1108: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:21.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:25:21 gibba015 bash[29377]: cluster 2021-03-10T14:25:20.471010+0000 mgr.gibba045.orlgmj (mgr.34412) 1966 : cluster [DBG] pgmap v1108: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:21.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:25:21 gibba015 bash[30343]: cluster 2021-03-10T14:25:20.471010+0000 mgr.gibba045.orlgmj (mgr.34412) 1966 : cluster [DBG] pgmap v1108: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:23.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:25:23 gibba015 bash[29377]: cluster 2021-03-10T14:25:22.472392+0000 mgr.gibba045.orlgmj (mgr.34412) 1967 : cluster [DBG] pgmap v1109: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:23.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:25:23 gibba015 bash[30343]: cluster 2021-03-10T14:25:22.472392+0000 mgr.gibba045.orlgmj (mgr.34412) 1967 : cluster [DBG] pgmap v1109: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:23.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:25:23 gibba045 bash[25517]: cluster 2021-03-10T14:25:22.472392+0000 mgr.gibba045.orlgmj (mgr.34412) 1967 : cluster [DBG] pgmap v1109: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:25.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:25:25 gibba045 bash[25517]: cluster 2021-03-10T14:25:24.474090+0000 mgr.gibba045.orlgmj (mgr.34412) 1968 : cluster [DBG] pgmap v1110: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:25.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:25:25 gibba015 bash[29377]: cluster 2021-03-10T14:25:24.474090+0000 mgr.gibba045.orlgmj (mgr.34412) 1968 : cluster [DBG] pgmap v1110: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:25.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:25:25 gibba015 bash[30343]: cluster 2021-03-10T14:25:24.474090+0000 mgr.gibba045.orlgmj (mgr.34412) 1968 : cluster [DBG] pgmap v1110: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:27.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:25:27 gibba045 bash[25517]: cluster 2021-03-10T14:25:26.475940+0000 mgr.gibba045.orlgmj (mgr.34412) 1969 : cluster [DBG] pgmap v1111: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:27.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:25:27 gibba015 bash[29377]: cluster 2021-03-10T14:25:26.475940+0000 mgr.gibba045.orlgmj (mgr.34412) 1969 : cluster [DBG] pgmap v1111: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:27.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:25:27 gibba015 bash[30343]: cluster 2021-03-10T14:25:26.475940+0000 mgr.gibba045.orlgmj (mgr.34412) 1969 : cluster [DBG] pgmap v1111: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:29.393 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:25:29.622 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:25:29.622 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (36m) 110s ago 41m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:25:29.622 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (41m) 46s ago 41m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:25:29.622 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (36m) 46s ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:25:29.623 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (36m) 46s ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:25:29.623 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (35m) 110s ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:25:29.623 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (35m) 110s ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:25:29.623 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (35m) 46s ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:25:29.624 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (35m) 110s ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:25:29.624 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (41m) 110s ago 41m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:25:29.624 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (41m) 46s ago 41m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:25:29.624 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (34m) 110s ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:25:29.624 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (34m) 110s ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:25:29.624 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (33m) 110s ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:25:29.625 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (33m) 110s ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:25:29.625 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (32m) 46s ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:25:29.625 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (32m) 46s ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:25:29.625 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (31m) 46s ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:25:29.626 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (31m) 46s ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:25:29.626 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (41m) 46s ago 41m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:25:29.626 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 46s ago 39m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:25:29.875 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:25:29.875 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:25:29.876 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:25:29.876 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:25:29.876 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:25:29.877 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:25:29.877 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:25:29.877 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:25:29.877 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:25:29.878 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:25:29.878 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:25:29.878 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:25:29.878 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:25:29.879 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:25:29.879 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:25:29.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:25:29 gibba015 bash[29377]: cluster 2021-03-10T14:25:28.477017+0000 mgr.gibba045.orlgmj (mgr.34412) 1970 : cluster [DBG] pgmap v1112: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:29.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:25:29 gibba015 bash[29377]: cephadm 2021-03-10T14:25:28.529455+0000 mgr.gibba045.orlgmj (mgr.34412) 1971 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:25:29.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:25:29 gibba015 bash[30343]: cluster 2021-03-10T14:25:28.477017+0000 mgr.gibba045.orlgmj (mgr.34412) 1970 : cluster [DBG] pgmap v1112: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:29.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:25:29 gibba015 bash[30343]: cephadm 2021-03-10T14:25:28.529455+0000 mgr.gibba045.orlgmj (mgr.34412) 1971 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:25:30.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:25:29 gibba045 bash[25517]: cluster 2021-03-10T14:25:28.477017+0000 mgr.gibba045.orlgmj (mgr.34412) 1970 : cluster [DBG] pgmap v1112: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:30.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:25:29 gibba045 bash[25517]: cephadm 2021-03-10T14:25:28.529455+0000 mgr.gibba045.orlgmj (mgr.34412) 1971 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:25:30.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:25:30 gibba015 bash[29377]: audit 2021-03-10T14:25:29.385343+0000 mgr.gibba045.orlgmj (mgr.34412) 1972 : audit [DBG] from='client.45384 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:25:30.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:25:30 gibba015 bash[29377]: audit 2021-03-10T14:25:29.872691+0000 mon.a (mon.0) 843 : audit [DBG] from='client.? 172.21.2.115:0/1813294272' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:25:30.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:25:30 gibba015 bash[30343]: audit 2021-03-10T14:25:29.385343+0000 mgr.gibba045.orlgmj (mgr.34412) 1972 : audit [DBG] from='client.45384 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:25:30.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:25:30 gibba015 bash[30343]: audit 2021-03-10T14:25:29.872691+0000 mon.a (mon.0) 843 : audit [DBG] from='client.? 172.21.2.115:0/1813294272' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:25:31.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:25:30 gibba045 bash[25517]: audit 2021-03-10T14:25:29.385343+0000 mgr.gibba045.orlgmj (mgr.34412) 1972 : audit [DBG] from='client.45384 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:25:31.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:25:30 gibba045 bash[25517]: audit 2021-03-10T14:25:29.872691+0000 mon.a (mon.0) 843 : audit [DBG] from='client.? 172.21.2.115:0/1813294272' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:25:31.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:25:31 gibba015 bash[29377]: audit 2021-03-10T14:25:29.611942+0000 mgr.gibba045.orlgmj (mgr.34412) 1973 : audit [DBG] from='client.55378 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:25:31.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:25:31 gibba015 bash[29377]: cluster 2021-03-10T14:25:30.478615+0000 mgr.gibba045.orlgmj (mgr.34412) 1974 : cluster [DBG] pgmap v1113: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:31.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:25:31 gibba015 bash[30343]: audit 2021-03-10T14:25:29.611942+0000 mgr.gibba045.orlgmj (mgr.34412) 1973 : audit [DBG] from='client.55378 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:25:31.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:25:31 gibba015 bash[30343]: cluster 2021-03-10T14:25:30.478615+0000 mgr.gibba045.orlgmj (mgr.34412) 1974 : cluster [DBG] pgmap v1113: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:32.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:25:31 gibba045 bash[25517]: audit 2021-03-10T14:25:29.611942+0000 mgr.gibba045.orlgmj (mgr.34412) 1973 : audit [DBG] from='client.55378 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:25:32.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:25:31 gibba045 bash[25517]: cluster 2021-03-10T14:25:30.478615+0000 mgr.gibba045.orlgmj (mgr.34412) 1974 : cluster [DBG] pgmap v1113: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:33.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:25:33 gibba015 bash[29377]: cluster 2021-03-10T14:25:32.479701+0000 mgr.gibba045.orlgmj (mgr.34412) 1975 : cluster [DBG] pgmap v1114: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:33.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:25:33 gibba015 bash[30343]: cluster 2021-03-10T14:25:32.479701+0000 mgr.gibba045.orlgmj (mgr.34412) 1975 : cluster [DBG] pgmap v1114: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:33.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:25:33 gibba045 bash[25517]: cluster 2021-03-10T14:25:32.479701+0000 mgr.gibba045.orlgmj (mgr.34412) 1975 : cluster [DBG] pgmap v1114: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:35.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:25:35 gibba045 bash[25517]: cluster 2021-03-10T14:25:34.481022+0000 mgr.gibba045.orlgmj (mgr.34412) 1976 : cluster [DBG] pgmap v1115: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:35.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:25:35 gibba015 bash[29377]: cluster 2021-03-10T14:25:34.481022+0000 mgr.gibba045.orlgmj (mgr.34412) 1976 : cluster [DBG] pgmap v1115: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:35.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:25:35 gibba015 bash[30343]: cluster 2021-03-10T14:25:34.481022+0000 mgr.gibba045.orlgmj (mgr.34412) 1976 : cluster [DBG] pgmap v1115: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:37.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:25:37 gibba015 bash[29377]: cluster 2021-03-10T14:25:36.482912+0000 mgr.gibba045.orlgmj (mgr.34412) 1977 : cluster [DBG] pgmap v1116: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:37.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:25:37 gibba015 bash[30343]: cluster 2021-03-10T14:25:36.482912+0000 mgr.gibba045.orlgmj (mgr.34412) 1977 : cluster [DBG] pgmap v1116: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:38.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:25:37 gibba045 bash[25517]: cluster 2021-03-10T14:25:36.482912+0000 mgr.gibba045.orlgmj (mgr.34412) 1977 : cluster [DBG] pgmap v1116: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:39.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:25:39 gibba015 bash[29377]: cluster 2021-03-10T14:25:38.484261+0000 mgr.gibba045.orlgmj (mgr.34412) 1978 : cluster [DBG] pgmap v1117: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:39.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:25:39 gibba015 bash[30343]: cluster 2021-03-10T14:25:38.484261+0000 mgr.gibba045.orlgmj (mgr.34412) 1978 : cluster [DBG] pgmap v1117: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:40.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:25:39 gibba045 bash[25517]: cluster 2021-03-10T14:25:38.484261+0000 mgr.gibba045.orlgmj (mgr.34412) 1978 : cluster [DBG] pgmap v1117: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:41.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:25:41 gibba015 bash[29377]: cluster 2021-03-10T14:25:40.485923+0000 mgr.gibba045.orlgmj (mgr.34412) 1979 : cluster [DBG] pgmap v1118: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:41.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:25:41 gibba015 bash[30343]: cluster 2021-03-10T14:25:40.485923+0000 mgr.gibba045.orlgmj (mgr.34412) 1979 : cluster [DBG] pgmap v1118: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:42.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:25:41 gibba045 bash[25517]: cluster 2021-03-10T14:25:40.485923+0000 mgr.gibba045.orlgmj (mgr.34412) 1979 : cluster [DBG] pgmap v1118: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:43.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:25:43 gibba015 bash[29377]: cluster 2021-03-10T14:25:42.487431+0000 mgr.gibba045.orlgmj (mgr.34412) 1980 : cluster [DBG] pgmap v1119: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:43.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:25:43 gibba015 bash[30343]: cluster 2021-03-10T14:25:42.487431+0000 mgr.gibba045.orlgmj (mgr.34412) 1980 : cluster [DBG] pgmap v1119: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:43.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:25:43 gibba045 bash[25517]: cluster 2021-03-10T14:25:42.487431+0000 mgr.gibba045.orlgmj (mgr.34412) 1980 : cluster [DBG] pgmap v1119: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:44.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:25:44 gibba015 bash[29377]: audit 2021-03-10T14:25:43.543157+0000 mon.c (mon.1) 604 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:25:44.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:25:44 gibba015 bash[29377]: cephadm 2021-03-10T14:25:43.552839+0000 mgr.gibba045.orlgmj (mgr.34412) 1981 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:25:44.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:25:44 gibba015 bash[29377]: cephadm 2021-03-10T14:25:43.554282+0000 mgr.gibba045.orlgmj (mgr.34412) 1982 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:25:44.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:25:44 gibba015 bash[29377]: audit 2021-03-10T14:25:43.781381+0000 mon.a (mon.0) 844 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:25:44.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:25:44 gibba015 bash[29377]: audit 2021-03-10T14:25:43.784942+0000 mon.c (mon.1) 605 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:25:44.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:25:44 gibba015 bash[29377]: audit 2021-03-10T14:25:43.786769+0000 mon.c (mon.1) 606 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:25:44.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:25:44 gibba015 bash[29377]: audit 2021-03-10T14:25:43.788862+0000 mon.c (mon.1) 607 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:25:44.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:25:44 gibba015 bash[29377]: audit 2021-03-10T14:25:43.790837+0000 mon.c (mon.1) 608 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:25:44.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:25:44 gibba015 bash[29377]: audit 2021-03-10T14:25:43.796395+0000 mon.c (mon.1) 609 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:25:44.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:25:44 gibba015 bash[29377]: audit 2021-03-10T14:25:43.799029+0000 mon.c (mon.1) 610 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:25:44.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:25:44 gibba015 bash[30343]: audit 2021-03-10T14:25:43.543157+0000 mon.c (mon.1) 604 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:25:44.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:25:44 gibba015 bash[30343]: cephadm 2021-03-10T14:25:43.552839+0000 mgr.gibba045.orlgmj (mgr.34412) 1981 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:25:44.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:25:44 gibba015 bash[30343]: cephadm 2021-03-10T14:25:43.554282+0000 mgr.gibba045.orlgmj (mgr.34412) 1982 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:25:44.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:25:44 gibba015 bash[30343]: audit 2021-03-10T14:25:43.781381+0000 mon.a (mon.0) 844 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:25:44.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:25:44 gibba015 bash[30343]: audit 2021-03-10T14:25:43.784942+0000 mon.c (mon.1) 605 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:25:44.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:25:44 gibba015 bash[30343]: audit 2021-03-10T14:25:43.786769+0000 mon.c (mon.1) 606 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:25:44.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:25:44 gibba015 bash[30343]: audit 2021-03-10T14:25:43.788862+0000 mon.c (mon.1) 607 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:25:44.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:25:44 gibba015 bash[30343]: audit 2021-03-10T14:25:43.790837+0000 mon.c (mon.1) 608 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:25:44.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:25:44 gibba015 bash[30343]: audit 2021-03-10T14:25:43.796395+0000 mon.c (mon.1) 609 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:25:44.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:25:44 gibba015 bash[30343]: audit 2021-03-10T14:25:43.799029+0000 mon.c (mon.1) 610 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:25:44.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:25:44 gibba045 bash[25517]: audit 2021-03-10T14:25:43.543157+0000 mon.c (mon.1) 604 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:25:44.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:25:44 gibba045 bash[25517]: cephadm 2021-03-10T14:25:43.552839+0000 mgr.gibba045.orlgmj (mgr.34412) 1981 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:25:44.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:25:44 gibba045 bash[25517]: cephadm 2021-03-10T14:25:43.554282+0000 mgr.gibba045.orlgmj (mgr.34412) 1982 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:25:44.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:25:44 gibba045 bash[25517]: audit 2021-03-10T14:25:43.781381+0000 mon.a (mon.0) 844 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:25:44.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:25:44 gibba045 bash[25517]: audit 2021-03-10T14:25:43.784942+0000 mon.c (mon.1) 605 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:25:44.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:25:44 gibba045 bash[25517]: audit 2021-03-10T14:25:43.786769+0000 mon.c (mon.1) 606 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:25:44.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:25:44 gibba045 bash[25517]: audit 2021-03-10T14:25:43.788862+0000 mon.c (mon.1) 607 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:25:44.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:25:44 gibba045 bash[25517]: audit 2021-03-10T14:25:43.790837+0000 mon.c (mon.1) 608 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:25:44.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:25:44 gibba045 bash[25517]: audit 2021-03-10T14:25:43.796395+0000 mon.c (mon.1) 609 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:25:44.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:25:44 gibba045 bash[25517]: audit 2021-03-10T14:25:43.799029+0000 mon.c (mon.1) 610 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:25:45.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:25:45 gibba015 bash[29377]: cephadm 2021-03-10T14:25:43.787648+0000 mgr.gibba045.orlgmj (mgr.34412) 1983 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:25:45.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:25:45 gibba015 bash[29377]: cephadm 2021-03-10T14:25:43.789304+0000 mgr.gibba045.orlgmj (mgr.34412) 1984 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:25:45.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:25:45 gibba015 bash[29377]: cephadm 2021-03-10T14:25:43.791596+0000 mgr.gibba045.orlgmj (mgr.34412) 1985 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:25:45.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:25:45 gibba015 bash[29377]: cephadm 2021-03-10T14:25:43.791638+0000 mgr.gibba045.orlgmj (mgr.34412) 1986 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:25:45.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:25:45 gibba015 bash[29377]: cephadm 2021-03-10T14:25:43.793682+0000 mgr.gibba045.orlgmj (mgr.34412) 1987 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:25:45.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:25:45 gibba015 bash[29377]: cephadm 2021-03-10T14:25:43.793723+0000 mgr.gibba045.orlgmj (mgr.34412) 1988 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:25:45.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:25:45 gibba015 bash[29377]: cephadm 2021-03-10T14:25:43.795622+0000 mgr.gibba045.orlgmj (mgr.34412) 1989 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:25:45.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:25:45 gibba015 bash[29377]: cephadm 2021-03-10T14:25:43.799067+0000 mgr.gibba045.orlgmj (mgr.34412) 1990 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:25:45.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:25:45 gibba015 bash[29377]: cephadm 2021-03-10T14:25:43.799107+0000 mgr.gibba045.orlgmj (mgr.34412) 1991 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:25:45.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:25:45 gibba015 bash[29377]: cephadm 2021-03-10T14:25:43.801513+0000 mgr.gibba045.orlgmj (mgr.34412) 1992 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:25:45.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:25:45 gibba015 bash[29377]: cephadm 2021-03-10T14:25:43.801890+0000 mgr.gibba045.orlgmj (mgr.34412) 1993 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:25:45.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:25:45 gibba015 bash[29377]: cephadm 2021-03-10T14:25:43.804128+0000 mgr.gibba045.orlgmj (mgr.34412) 1994 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:25:45.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:25:45 gibba015 bash[29377]: cephadm 2021-03-10T14:25:43.804166+0000 mgr.gibba045.orlgmj (mgr.34412) 1995 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:25:45.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:25:45 gibba015 bash[29377]: cephadm 2021-03-10T14:25:43.804274+0000 mgr.gibba045.orlgmj (mgr.34412) 1996 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:25:45.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:25:45 gibba015 bash[29377]: cluster 2021-03-10T14:25:44.489051+0000 mgr.gibba045.orlgmj (mgr.34412) 1997 : cluster [DBG] pgmap v1120: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:45.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:25:45 gibba015 bash[30343]: cephadm 2021-03-10T14:25:43.787648+0000 mgr.gibba045.orlgmj (mgr.34412) 1983 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:25:45.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:25:45 gibba015 bash[30343]: cephadm 2021-03-10T14:25:43.789304+0000 mgr.gibba045.orlgmj (mgr.34412) 1984 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:25:45.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:25:45 gibba015 bash[30343]: cephadm 2021-03-10T14:25:43.791596+0000 mgr.gibba045.orlgmj (mgr.34412) 1985 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:25:45.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:25:45 gibba015 bash[30343]: cephadm 2021-03-10T14:25:43.791638+0000 mgr.gibba045.orlgmj (mgr.34412) 1986 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:25:45.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:25:45 gibba015 bash[30343]: cephadm 2021-03-10T14:25:43.793682+0000 mgr.gibba045.orlgmj (mgr.34412) 1987 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:25:45.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:25:45 gibba015 bash[30343]: cephadm 2021-03-10T14:25:43.793723+0000 mgr.gibba045.orlgmj (mgr.34412) 1988 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:25:45.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:25:45 gibba015 bash[30343]: cephadm 2021-03-10T14:25:43.795622+0000 mgr.gibba045.orlgmj (mgr.34412) 1989 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:25:45.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:25:45 gibba015 bash[30343]: cephadm 2021-03-10T14:25:43.799067+0000 mgr.gibba045.orlgmj (mgr.34412) 1990 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:25:45.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:25:45 gibba015 bash[30343]: cephadm 2021-03-10T14:25:43.799107+0000 mgr.gibba045.orlgmj (mgr.34412) 1991 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:25:45.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:25:45 gibba015 bash[30343]: cephadm 2021-03-10T14:25:43.801513+0000 mgr.gibba045.orlgmj (mgr.34412) 1992 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:25:45.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:25:45 gibba015 bash[30343]: cephadm 2021-03-10T14:25:43.801890+0000 mgr.gibba045.orlgmj (mgr.34412) 1993 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:25:45.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:25:45 gibba015 bash[30343]: cephadm 2021-03-10T14:25:43.804128+0000 mgr.gibba045.orlgmj (mgr.34412) 1994 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:25:45.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:25:45 gibba015 bash[30343]: cephadm 2021-03-10T14:25:43.804166+0000 mgr.gibba045.orlgmj (mgr.34412) 1995 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:25:45.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:25:45 gibba015 bash[30343]: cephadm 2021-03-10T14:25:43.804274+0000 mgr.gibba045.orlgmj (mgr.34412) 1996 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:25:45.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:25:45 gibba015 bash[30343]: cluster 2021-03-10T14:25:44.489051+0000 mgr.gibba045.orlgmj (mgr.34412) 1997 : cluster [DBG] pgmap v1120: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:45.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:25:45 gibba045 bash[25517]: cephadm 2021-03-10T14:25:43.787648+0000 mgr.gibba045.orlgmj (mgr.34412) 1983 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:25:45.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:25:45 gibba045 bash[25517]: cephadm 2021-03-10T14:25:43.789304+0000 mgr.gibba045.orlgmj (mgr.34412) 1984 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:25:45.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:25:45 gibba045 bash[25517]: cephadm 2021-03-10T14:25:43.791596+0000 mgr.gibba045.orlgmj (mgr.34412) 1985 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:25:45.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:25:45 gibba045 bash[25517]: cephadm 2021-03-10T14:25:43.791638+0000 mgr.gibba045.orlgmj (mgr.34412) 1986 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:25:45.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:25:45 gibba045 bash[25517]: cephadm 2021-03-10T14:25:43.793682+0000 mgr.gibba045.orlgmj (mgr.34412) 1987 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:25:45.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:25:45 gibba045 bash[25517]: cephadm 2021-03-10T14:25:43.793723+0000 mgr.gibba045.orlgmj (mgr.34412) 1988 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:25:45.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:25:45 gibba045 bash[25517]: cephadm 2021-03-10T14:25:43.795622+0000 mgr.gibba045.orlgmj (mgr.34412) 1989 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:25:45.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:25:45 gibba045 bash[25517]: cephadm 2021-03-10T14:25:43.799067+0000 mgr.gibba045.orlgmj (mgr.34412) 1990 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:25:45.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:25:45 gibba045 bash[25517]: cephadm 2021-03-10T14:25:43.799107+0000 mgr.gibba045.orlgmj (mgr.34412) 1991 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:25:45.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:25:45 gibba045 bash[25517]: cephadm 2021-03-10T14:25:43.801513+0000 mgr.gibba045.orlgmj (mgr.34412) 1992 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:25:45.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:25:45 gibba045 bash[25517]: cephadm 2021-03-10T14:25:43.801890+0000 mgr.gibba045.orlgmj (mgr.34412) 1993 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:25:45.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:25:45 gibba045 bash[25517]: cephadm 2021-03-10T14:25:43.804128+0000 mgr.gibba045.orlgmj (mgr.34412) 1994 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:25:45.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:25:45 gibba045 bash[25517]: cephadm 2021-03-10T14:25:43.804166+0000 mgr.gibba045.orlgmj (mgr.34412) 1995 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:25:45.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:25:45 gibba045 bash[25517]: cephadm 2021-03-10T14:25:43.804274+0000 mgr.gibba045.orlgmj (mgr.34412) 1996 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:25:45.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:25:45 gibba045 bash[25517]: cluster 2021-03-10T14:25:44.489051+0000 mgr.gibba045.orlgmj (mgr.34412) 1997 : cluster [DBG] pgmap v1120: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:47.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:25:47 gibba015 bash[29377]: cluster 2021-03-10T14:25:46.490802+0000 mgr.gibba045.orlgmj (mgr.34412) 1998 : cluster [DBG] pgmap v1121: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:47.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:25:47 gibba015 bash[30343]: cluster 2021-03-10T14:25:46.490802+0000 mgr.gibba045.orlgmj (mgr.34412) 1998 : cluster [DBG] pgmap v1121: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:48.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:25:47 gibba045 bash[25517]: cluster 2021-03-10T14:25:46.490802+0000 mgr.gibba045.orlgmj (mgr.34412) 1998 : cluster [DBG] pgmap v1121: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:49.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:25:49 gibba015 bash[29377]: cluster 2021-03-10T14:25:48.492190+0000 mgr.gibba045.orlgmj (mgr.34412) 1999 : cluster [DBG] pgmap v1122: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:49.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:25:49 gibba015 bash[30343]: cluster 2021-03-10T14:25:48.492190+0000 mgr.gibba045.orlgmj (mgr.34412) 1999 : cluster [DBG] pgmap v1122: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:50.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:25:49 gibba045 bash[25517]: cluster 2021-03-10T14:25:48.492190+0000 mgr.gibba045.orlgmj (mgr.34412) 1999 : cluster [DBG] pgmap v1122: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:51.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:25:51 gibba015 bash[29377]: cluster 2021-03-10T14:25:50.493867+0000 mgr.gibba045.orlgmj (mgr.34412) 2000 : cluster [DBG] pgmap v1123: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:51.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:25:51 gibba015 bash[30343]: cluster 2021-03-10T14:25:50.493867+0000 mgr.gibba045.orlgmj (mgr.34412) 2000 : cluster [DBG] pgmap v1123: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:52.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:25:51 gibba045 bash[25517]: cluster 2021-03-10T14:25:50.493867+0000 mgr.gibba045.orlgmj (mgr.34412) 2000 : cluster [DBG] pgmap v1123: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:53.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:25:53 gibba015 bash[29377]: cluster 2021-03-10T14:25:52.495146+0000 mgr.gibba045.orlgmj (mgr.34412) 2001 : cluster [DBG] pgmap v1124: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:53.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:25:53 gibba015 bash[29377]: audit 2021-03-10T14:25:52.688055+0000 mon.c (mon.1) 611 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:25:53.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:25:53 gibba015 bash[29377]: audit 2021-03-10T14:25:52.688835+0000 mon.c (mon.1) 612 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:25:53.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:25:53 gibba015 bash[29377]: audit 2021-03-10T14:25:52.689222+0000 mon.a (mon.0) 845 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:25:53.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:25:53 gibba015 bash[29377]: audit 2021-03-10T14:25:52.690577+0000 mon.a (mon.0) 846 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:25:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:25:53 gibba015 bash[29377]: audit 2021-03-10T14:25:52.690841+0000 mon.c (mon.1) 613 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T14:25:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:25:53 gibba015 bash[29377]: audit 2021-03-10T14:25:52.691987+0000 mon.a (mon.0) 847 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T14:25:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:25:53 gibba015 bash[29377]: audit 2021-03-10T14:25:52.692088+0000 mon.c (mon.1) 614 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:25:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:25:53 gibba015 bash[29377]: audit 2021-03-10T14:25:52.693020+0000 mon.a (mon.0) 848 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:25:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:25:53 gibba015 bash[29377]: audit 2021-03-10T14:25:52.693283+0000 mon.c (mon.1) 615 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:25:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:25:53 gibba015 bash[29377]: audit 2021-03-10T14:25:52.694474+0000 mon.a (mon.0) 849 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:25:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:25:53 gibba015 bash[29377]: audit 2021-03-10T14:25:52.694624+0000 mon.c (mon.1) 616 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:25:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:25:53 gibba015 bash[29377]: audit 2021-03-10T14:25:52.695301+0000 mon.a (mon.0) 850 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:25:53.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:25:53 gibba015 bash[30343]: cluster 2021-03-10T14:25:52.495146+0000 mgr.gibba045.orlgmj (mgr.34412) 2001 : cluster [DBG] pgmap v1124: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:53.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:25:53 gibba015 bash[30343]: audit 2021-03-10T14:25:52.688055+0000 mon.c (mon.1) 611 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:25:53.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:25:53 gibba015 bash[30343]: audit 2021-03-10T14:25:52.688835+0000 mon.c (mon.1) 612 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:25:53.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:25:53 gibba015 bash[30343]: audit 2021-03-10T14:25:52.689222+0000 mon.a (mon.0) 845 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:25:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:25:53 gibba015 bash[30343]: audit 2021-03-10T14:25:52.690577+0000 mon.a (mon.0) 846 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:25:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:25:53 gibba015 bash[30343]: audit 2021-03-10T14:25:52.690841+0000 mon.c (mon.1) 613 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T14:25:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:25:53 gibba015 bash[30343]: audit 2021-03-10T14:25:52.691987+0000 mon.a (mon.0) 847 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T14:25:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:25:53 gibba015 bash[30343]: audit 2021-03-10T14:25:52.692088+0000 mon.c (mon.1) 614 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:25:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:25:53 gibba015 bash[30343]: audit 2021-03-10T14:25:52.693020+0000 mon.a (mon.0) 848 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:25:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:25:53 gibba015 bash[30343]: audit 2021-03-10T14:25:52.693283+0000 mon.c (mon.1) 615 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:25:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:25:53 gibba015 bash[30343]: audit 2021-03-10T14:25:52.694474+0000 mon.a (mon.0) 849 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:25:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:25:53 gibba015 bash[30343]: audit 2021-03-10T14:25:52.694624+0000 mon.c (mon.1) 616 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:25:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:25:53 gibba015 bash[30343]: audit 2021-03-10T14:25:52.695301+0000 mon.a (mon.0) 850 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:25:53.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:25:53 gibba045 bash[25517]: cluster 2021-03-10T14:25:52.495146+0000 mgr.gibba045.orlgmj (mgr.34412) 2001 : cluster [DBG] pgmap v1124: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:53.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:25:53 gibba045 bash[25517]: audit 2021-03-10T14:25:52.688055+0000 mon.c (mon.1) 611 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:25:53.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:25:53 gibba045 bash[25517]: audit 2021-03-10T14:25:52.688835+0000 mon.c (mon.1) 612 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:25:53.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:25:53 gibba045 bash[25517]: audit 2021-03-10T14:25:52.689222+0000 mon.a (mon.0) 845 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:25:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:25:53 gibba045 bash[25517]: audit 2021-03-10T14:25:52.690577+0000 mon.a (mon.0) 846 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:25:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:25:53 gibba045 bash[25517]: audit 2021-03-10T14:25:52.690841+0000 mon.c (mon.1) 613 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T14:25:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:25:53 gibba045 bash[25517]: audit 2021-03-10T14:25:52.691987+0000 mon.a (mon.0) 847 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T14:25:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:25:53 gibba045 bash[25517]: audit 2021-03-10T14:25:52.692088+0000 mon.c (mon.1) 614 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:25:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:25:53 gibba045 bash[25517]: audit 2021-03-10T14:25:52.693020+0000 mon.a (mon.0) 848 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:25:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:25:53 gibba045 bash[25517]: audit 2021-03-10T14:25:52.693283+0000 mon.c (mon.1) 615 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:25:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:25:53 gibba045 bash[25517]: audit 2021-03-10T14:25:52.694474+0000 mon.a (mon.0) 849 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:25:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:25:53 gibba045 bash[25517]: audit 2021-03-10T14:25:52.694624+0000 mon.c (mon.1) 616 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:25:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:25:53 gibba045 bash[25517]: audit 2021-03-10T14:25:52.695301+0000 mon.a (mon.0) 850 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:25:55.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:25:55 gibba015 bash[29377]: cluster 2021-03-10T14:25:54.496740+0000 mgr.gibba045.orlgmj (mgr.34412) 2002 : cluster [DBG] pgmap v1125: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:55.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:25:55 gibba015 bash[30343]: cluster 2021-03-10T14:25:54.496740+0000 mgr.gibba045.orlgmj (mgr.34412) 2002 : cluster [DBG] pgmap v1125: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:56.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:25:55 gibba045 bash[25517]: cluster 2021-03-10T14:25:54.496740+0000 mgr.gibba045.orlgmj (mgr.34412) 2002 : cluster [DBG] pgmap v1125: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:57.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:25:57 gibba015 bash[29377]: cluster 2021-03-10T14:25:56.498396+0000 mgr.gibba045.orlgmj (mgr.34412) 2003 : cluster [DBG] pgmap v1126: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:57.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:25:57 gibba015 bash[30343]: cluster 2021-03-10T14:25:56.498396+0000 mgr.gibba045.orlgmj (mgr.34412) 2003 : cluster [DBG] pgmap v1126: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:58.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:25:57 gibba045 bash[25517]: cluster 2021-03-10T14:25:56.498396+0000 mgr.gibba045.orlgmj (mgr.34412) 2003 : cluster [DBG] pgmap v1126: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:59.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:25:59 gibba015 bash[29377]: cluster 2021-03-10T14:25:58.499735+0000 mgr.gibba045.orlgmj (mgr.34412) 2004 : cluster [DBG] pgmap v1127: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:59.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:25:59 gibba015 bash[30343]: cluster 2021-03-10T14:25:58.499735+0000 mgr.gibba045.orlgmj (mgr.34412) 2004 : cluster [DBG] pgmap v1127: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:00.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:25:59 gibba045 bash[25517]: cluster 2021-03-10T14:25:58.499735+0000 mgr.gibba045.orlgmj (mgr.34412) 2004 : cluster [DBG] pgmap v1127: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:00.122 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:26:00.377 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:26:00.378 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (36m) 2m ago 42m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:26:00.378 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (41m) 77s ago 41m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:26:00.378 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (37m) 77s ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:26:00.379 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (37m) 77s ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:26:00.379 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (36m) 2m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:26:00.379 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (36m) 2m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:26:00.379 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (35m) 77s ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:26:00.380 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (35m) 2m ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:26:00.380 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (42m) 2m ago 42m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:26:00.380 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (42m) 77s ago 42m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:26:00.380 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (35m) 2m ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:26:00.380 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (34m) 2m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:26:00.381 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (34m) 2m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:26:00.381 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (33m) 2m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:26:00.381 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (33m) 77s ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:26:00.381 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (32m) 77s ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:26:00.382 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (32m) 77s ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:26:00.382 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (32m) 77s ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:26:00.382 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (41m) 77s ago 42m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:26:00.382 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 77s ago 40m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:26:00.639 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:26:00.640 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:26:00.640 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:26:00.640 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:26:00.640 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:26:00.641 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:26:00.641 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:26:00.641 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:26:00.641 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:26:00.641 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:26:00.642 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:26:00.642 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:26:00.642 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:26:00.642 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:26:00.642 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:26:00.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:26:00 gibba015 bash[29377]: cephadm 2021-03-10T14:25:58.817221+0000 mgr.gibba045.orlgmj (mgr.34412) 2005 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:26:00.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:26:00 gibba015 bash[30343]: cephadm 2021-03-10T14:25:58.817221+0000 mgr.gibba045.orlgmj (mgr.34412) 2005 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:26:01.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:26:00 gibba045 bash[25517]: cephadm 2021-03-10T14:25:58.817221+0000 mgr.gibba045.orlgmj (mgr.34412) 2005 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:26:01.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:26:01 gibba015 bash[29377]: audit 2021-03-10T14:26:00.114563+0000 mgr.gibba045.orlgmj (mgr.34412) 2006 : audit [DBG] from='client.55390 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:26:01.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:26:01 gibba015 bash[29377]: audit 2021-03-10T14:26:00.339198+0000 mgr.gibba045.orlgmj (mgr.34412) 2007 : audit [DBG] from='client.55396 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:26:01.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:26:01 gibba015 bash[29377]: cluster 2021-03-10T14:26:00.501457+0000 mgr.gibba045.orlgmj (mgr.34412) 2008 : cluster [DBG] pgmap v1128: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:01.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:26:01 gibba015 bash[29377]: audit 2021-03-10T14:26:00.637321+0000 mon.a (mon.0) 851 : audit [DBG] from='client.? 172.21.2.115:0/3994224870' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:26:01.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:26:01 gibba015 bash[30343]: audit 2021-03-10T14:26:00.114563+0000 mgr.gibba045.orlgmj (mgr.34412) 2006 : audit [DBG] from='client.55390 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:26:01.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:26:01 gibba015 bash[30343]: audit 2021-03-10T14:26:00.339198+0000 mgr.gibba045.orlgmj (mgr.34412) 2007 : audit [DBG] from='client.55396 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:26:01.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:26:01 gibba015 bash[30343]: cluster 2021-03-10T14:26:00.501457+0000 mgr.gibba045.orlgmj (mgr.34412) 2008 : cluster [DBG] pgmap v1128: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:01.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:26:01 gibba015 bash[30343]: audit 2021-03-10T14:26:00.637321+0000 mon.a (mon.0) 851 : audit [DBG] from='client.? 172.21.2.115:0/3994224870' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:26:02.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:26:01 gibba045 bash[25517]: audit 2021-03-10T14:26:00.114563+0000 mgr.gibba045.orlgmj (mgr.34412) 2006 : audit [DBG] from='client.55390 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:26:02.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:26:01 gibba045 bash[25517]: audit 2021-03-10T14:26:00.339198+0000 mgr.gibba045.orlgmj (mgr.34412) 2007 : audit [DBG] from='client.55396 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:26:02.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:26:01 gibba045 bash[25517]: cluster 2021-03-10T14:26:00.501457+0000 mgr.gibba045.orlgmj (mgr.34412) 2008 : cluster [DBG] pgmap v1128: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:02.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:26:01 gibba045 bash[25517]: audit 2021-03-10T14:26:00.637321+0000 mon.a (mon.0) 851 : audit [DBG] from='client.? 172.21.2.115:0/3994224870' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:26:03.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:26:03 gibba015 bash[29377]: cluster 2021-03-10T14:26:02.503134+0000 mgr.gibba045.orlgmj (mgr.34412) 2009 : cluster [DBG] pgmap v1129: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:03.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:26:03 gibba015 bash[30343]: cluster 2021-03-10T14:26:02.503134+0000 mgr.gibba045.orlgmj (mgr.34412) 2009 : cluster [DBG] pgmap v1129: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:03.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:26:03 gibba045 bash[25517]: cluster 2021-03-10T14:26:02.503134+0000 mgr.gibba045.orlgmj (mgr.34412) 2009 : cluster [DBG] pgmap v1129: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:05.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:26:05 gibba015 bash[29377]: cluster 2021-03-10T14:26:04.504695+0000 mgr.gibba045.orlgmj (mgr.34412) 2010 : cluster [DBG] pgmap v1130: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:05.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:26:05 gibba015 bash[30343]: cluster 2021-03-10T14:26:04.504695+0000 mgr.gibba045.orlgmj (mgr.34412) 2010 : cluster [DBG] pgmap v1130: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:06.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:26:05 gibba045 bash[25517]: cluster 2021-03-10T14:26:04.504695+0000 mgr.gibba045.orlgmj (mgr.34412) 2010 : cluster [DBG] pgmap v1130: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:07.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:26:07 gibba015 bash[29377]: cluster 2021-03-10T14:26:06.506356+0000 mgr.gibba045.orlgmj (mgr.34412) 2011 : cluster [DBG] pgmap v1131: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:07.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:26:07 gibba015 bash[30343]: cluster 2021-03-10T14:26:06.506356+0000 mgr.gibba045.orlgmj (mgr.34412) 2011 : cluster [DBG] pgmap v1131: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:08.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:26:07 gibba045 bash[25517]: cluster 2021-03-10T14:26:06.506356+0000 mgr.gibba045.orlgmj (mgr.34412) 2011 : cluster [DBG] pgmap v1131: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:09.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:26:09 gibba015 bash[29377]: cluster 2021-03-10T14:26:08.507746+0000 mgr.gibba045.orlgmj (mgr.34412) 2012 : cluster [DBG] pgmap v1132: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:09.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:26:09 gibba015 bash[30343]: cluster 2021-03-10T14:26:08.507746+0000 mgr.gibba045.orlgmj (mgr.34412) 2012 : cluster [DBG] pgmap v1132: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:10.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:26:09 gibba045 bash[25517]: cluster 2021-03-10T14:26:08.507746+0000 mgr.gibba045.orlgmj (mgr.34412) 2012 : cluster [DBG] pgmap v1132: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:11.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:26:11 gibba015 bash[29377]: cluster 2021-03-10T14:26:10.509439+0000 mgr.gibba045.orlgmj (mgr.34412) 2013 : cluster [DBG] pgmap v1133: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:11.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:26:11 gibba015 bash[30343]: cluster 2021-03-10T14:26:10.509439+0000 mgr.gibba045.orlgmj (mgr.34412) 2013 : cluster [DBG] pgmap v1133: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:12.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:26:11 gibba045 bash[25517]: cluster 2021-03-10T14:26:10.509439+0000 mgr.gibba045.orlgmj (mgr.34412) 2013 : cluster [DBG] pgmap v1133: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:13.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:26:13 gibba015 bash[29377]: cluster 2021-03-10T14:26:12.511021+0000 mgr.gibba045.orlgmj (mgr.34412) 2014 : cluster [DBG] pgmap v1134: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:13.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:26:13 gibba015 bash[30343]: cluster 2021-03-10T14:26:12.511021+0000 mgr.gibba045.orlgmj (mgr.34412) 2014 : cluster [DBG] pgmap v1134: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:13.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:26:13 gibba045 bash[25517]: cluster 2021-03-10T14:26:12.511021+0000 mgr.gibba045.orlgmj (mgr.34412) 2014 : cluster [DBG] pgmap v1134: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:15.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:26:15 gibba015 bash[29377]: cephadm 2021-03-10T14:26:13.828773+0000 mgr.gibba045.orlgmj (mgr.34412) 2015 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:26:15.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:26:15 gibba015 bash[29377]: cluster 2021-03-10T14:26:14.512386+0000 mgr.gibba045.orlgmj (mgr.34412) 2016 : cluster [DBG] pgmap v1135: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:15.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:26:15 gibba015 bash[30343]: cephadm 2021-03-10T14:26:13.828773+0000 mgr.gibba045.orlgmj (mgr.34412) 2015 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:26:15.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:26:15 gibba015 bash[30343]: cluster 2021-03-10T14:26:14.512386+0000 mgr.gibba045.orlgmj (mgr.34412) 2016 : cluster [DBG] pgmap v1135: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:16.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:26:15 gibba045 bash[25517]: cephadm 2021-03-10T14:26:13.828773+0000 mgr.gibba045.orlgmj (mgr.34412) 2015 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:26:16.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:26:15 gibba045 bash[25517]: cluster 2021-03-10T14:26:14.512386+0000 mgr.gibba045.orlgmj (mgr.34412) 2016 : cluster [DBG] pgmap v1135: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:17.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:26:17 gibba015 bash[29377]: cluster 2021-03-10T14:26:16.514054+0000 mgr.gibba045.orlgmj (mgr.34412) 2017 : cluster [DBG] pgmap v1136: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:17.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:26:17 gibba015 bash[30343]: cluster 2021-03-10T14:26:16.514054+0000 mgr.gibba045.orlgmj (mgr.34412) 2017 : cluster [DBG] pgmap v1136: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:18.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:26:17 gibba045 bash[25517]: cluster 2021-03-10T14:26:16.514054+0000 mgr.gibba045.orlgmj (mgr.34412) 2017 : cluster [DBG] pgmap v1136: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:19.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:26:19 gibba015 bash[29377]: cluster 2021-03-10T14:26:18.515371+0000 mgr.gibba045.orlgmj (mgr.34412) 2018 : cluster [DBG] pgmap v1137: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:19.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:26:19 gibba015 bash[30343]: cluster 2021-03-10T14:26:18.515371+0000 mgr.gibba045.orlgmj (mgr.34412) 2018 : cluster [DBG] pgmap v1137: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:20.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:26:19 gibba045 bash[25517]: cluster 2021-03-10T14:26:18.515371+0000 mgr.gibba045.orlgmj (mgr.34412) 2018 : cluster [DBG] pgmap v1137: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:21.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:26:21 gibba015 bash[29377]: cluster 2021-03-10T14:26:20.516949+0000 mgr.gibba045.orlgmj (mgr.34412) 2019 : cluster [DBG] pgmap v1138: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:21.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:26:21 gibba015 bash[30343]: cluster 2021-03-10T14:26:20.516949+0000 mgr.gibba045.orlgmj (mgr.34412) 2019 : cluster [DBG] pgmap v1138: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:22.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:26:21 gibba045 bash[25517]: cluster 2021-03-10T14:26:20.516949+0000 mgr.gibba045.orlgmj (mgr.34412) 2019 : cluster [DBG] pgmap v1138: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:23.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:26:23 gibba015 bash[29377]: cluster 2021-03-10T14:26:22.518736+0000 mgr.gibba045.orlgmj (mgr.34412) 2020 : cluster [DBG] pgmap v1139: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:23.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:26:23 gibba015 bash[30343]: cluster 2021-03-10T14:26:22.518736+0000 mgr.gibba045.orlgmj (mgr.34412) 2020 : cluster [DBG] pgmap v1139: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:23.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:26:23 gibba045 bash[25517]: cluster 2021-03-10T14:26:22.518736+0000 mgr.gibba045.orlgmj (mgr.34412) 2020 : cluster [DBG] pgmap v1139: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:25.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:26:25 gibba015 bash[29377]: cluster 2021-03-10T14:26:24.520258+0000 mgr.gibba045.orlgmj (mgr.34412) 2021 : cluster [DBG] pgmap v1140: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:25.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:26:25 gibba015 bash[30343]: cluster 2021-03-10T14:26:24.520258+0000 mgr.gibba045.orlgmj (mgr.34412) 2021 : cluster [DBG] pgmap v1140: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:26.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:26:25 gibba045 bash[25517]: cluster 2021-03-10T14:26:24.520258+0000 mgr.gibba045.orlgmj (mgr.34412) 2021 : cluster [DBG] pgmap v1140: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:27.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:26:27 gibba015 bash[29377]: cluster 2021-03-10T14:26:26.521982+0000 mgr.gibba045.orlgmj (mgr.34412) 2022 : cluster [DBG] pgmap v1141: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:27.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:26:27 gibba015 bash[30343]: cluster 2021-03-10T14:26:26.521982+0000 mgr.gibba045.orlgmj (mgr.34412) 2022 : cluster [DBG] pgmap v1141: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:28.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:26:27 gibba045 bash[25517]: cluster 2021-03-10T14:26:26.521982+0000 mgr.gibba045.orlgmj (mgr.34412) 2022 : cluster [DBG] pgmap v1141: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:29.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:26:29 gibba015 bash[29377]: cluster 2021-03-10T14:26:28.523400+0000 mgr.gibba045.orlgmj (mgr.34412) 2023 : cluster [DBG] pgmap v1142: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:29.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:26:29 gibba015 bash[30343]: cluster 2021-03-10T14:26:28.523400+0000 mgr.gibba045.orlgmj (mgr.34412) 2023 : cluster [DBG] pgmap v1142: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:30.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:26:29 gibba045 bash[25517]: cluster 2021-03-10T14:26:28.523400+0000 mgr.gibba045.orlgmj (mgr.34412) 2023 : cluster [DBG] pgmap v1142: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:30.884 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:26:30.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:26:30 gibba015 bash[29377]: cephadm 2021-03-10T14:26:28.844580+0000 mgr.gibba045.orlgmj (mgr.34412) 2024 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:26:30.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:26:30 gibba015 bash[30343]: cephadm 2021-03-10T14:26:28.844580+0000 mgr.gibba045.orlgmj (mgr.34412) 2024 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:26:31.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:26:30 gibba045 bash[25517]: cephadm 2021-03-10T14:26:28.844580+0000 mgr.gibba045.orlgmj (mgr.34412) 2024 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:26:31.143 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:26:31.143 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (37m) 2m ago 42m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:26:31.144 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (42m) 107s ago 42m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:26:31.144 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (37m) 107s ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:26:31.144 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (37m) 107s ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:26:31.144 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (36m) 2m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:26:31.145 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (36m) 2m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:26:31.145 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (36m) 107s ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:26:31.145 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (36m) 2m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:26:31.145 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (42m) 2m ago 42m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:26:31.146 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (42m) 107s ago 42m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:26:31.146 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (35m) 2m ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:26:31.146 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (35m) 2m ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:26:31.146 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (34m) 2m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:26:31.147 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (34m) 2m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:26:31.147 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (33m) 107s ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:26:31.147 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (33m) 107s ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:26:31.147 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (32m) 107s ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:26:31.148 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (32m) 107s ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:26:31.148 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (42m) 107s ago 42m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:26:31.148 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 107s ago 40m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:26:31.394 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:26:31.395 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:26:31.395 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:26:31.395 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:26:31.395 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:26:31.396 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:26:31.396 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:26:31.396 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:26:31.396 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:26:31.397 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:26:31.397 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:26:31.397 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:26:31.397 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:26:31.397 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:26:31.398 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:26:31.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:26:31 gibba015 bash[29377]: cluster 2021-03-10T14:26:30.525146+0000 mgr.gibba045.orlgmj (mgr.34412) 2025 : cluster [DBG] pgmap v1143: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:31.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:26:31 gibba015 bash[29377]: audit 2021-03-10T14:26:31.392385+0000 mon.a (mon.0) 852 : audit [DBG] from='client.? 172.21.2.115:0/839501699' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:26:31.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:26:31 gibba015 bash[30343]: cluster 2021-03-10T14:26:30.525146+0000 mgr.gibba045.orlgmj (mgr.34412) 2025 : cluster [DBG] pgmap v1143: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:31.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:26:31 gibba015 bash[30343]: audit 2021-03-10T14:26:31.392385+0000 mon.a (mon.0) 852 : audit [DBG] from='client.? 172.21.2.115:0/839501699' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:26:32.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:26:31 gibba045 bash[25517]: cluster 2021-03-10T14:26:30.525146+0000 mgr.gibba045.orlgmj (mgr.34412) 2025 : cluster [DBG] pgmap v1143: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:32.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:26:31 gibba045 bash[25517]: audit 2021-03-10T14:26:31.392385+0000 mon.a (mon.0) 852 : audit [DBG] from='client.? 172.21.2.115:0/839501699' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:26:32.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:26:32 gibba015 bash[29377]: audit 2021-03-10T14:26:30.876596+0000 mgr.gibba045.orlgmj (mgr.34412) 2026 : audit [DBG] from='client.55408 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:26:32.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:26:32 gibba015 bash[29377]: audit 2021-03-10T14:26:31.105358+0000 mgr.gibba045.orlgmj (mgr.34412) 2027 : audit [DBG] from='client.55414 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:26:32.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:26:32 gibba015 bash[29377]: cluster 2021-03-10T14:26:32.526967+0000 mgr.gibba045.orlgmj (mgr.34412) 2028 : cluster [DBG] pgmap v1144: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:32.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:26:32 gibba015 bash[30343]: audit 2021-03-10T14:26:30.876596+0000 mgr.gibba045.orlgmj (mgr.34412) 2026 : audit [DBG] from='client.55408 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:26:32.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:26:32 gibba015 bash[30343]: audit 2021-03-10T14:26:31.105358+0000 mgr.gibba045.orlgmj (mgr.34412) 2027 : audit [DBG] from='client.55414 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:26:32.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:26:32 gibba015 bash[30343]: cluster 2021-03-10T14:26:32.526967+0000 mgr.gibba045.orlgmj (mgr.34412) 2028 : cluster [DBG] pgmap v1144: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:33.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:26:32 gibba045 bash[25517]: audit 2021-03-10T14:26:30.876596+0000 mgr.gibba045.orlgmj (mgr.34412) 2026 : audit [DBG] from='client.55408 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:26:33.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:26:32 gibba045 bash[25517]: audit 2021-03-10T14:26:31.105358+0000 mgr.gibba045.orlgmj (mgr.34412) 2027 : audit [DBG] from='client.55414 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:26:33.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:26:32 gibba045 bash[25517]: cluster 2021-03-10T14:26:32.526967+0000 mgr.gibba045.orlgmj (mgr.34412) 2028 : cluster [DBG] pgmap v1144: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:35.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:26:35 gibba015 bash[29377]: cluster 2021-03-10T14:26:34.528686+0000 mgr.gibba045.orlgmj (mgr.34412) 2029 : cluster [DBG] pgmap v1145: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:35.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:26:35 gibba015 bash[30343]: cluster 2021-03-10T14:26:34.528686+0000 mgr.gibba045.orlgmj (mgr.34412) 2029 : cluster [DBG] pgmap v1145: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:36.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:26:35 gibba045 bash[25517]: cluster 2021-03-10T14:26:34.528686+0000 mgr.gibba045.orlgmj (mgr.34412) 2029 : cluster [DBG] pgmap v1145: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:37.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:26:37 gibba015 bash[29377]: cluster 2021-03-10T14:26:36.530680+0000 mgr.gibba045.orlgmj (mgr.34412) 2030 : cluster [DBG] pgmap v1146: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:37.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:26:37 gibba015 bash[30343]: cluster 2021-03-10T14:26:36.530680+0000 mgr.gibba045.orlgmj (mgr.34412) 2030 : cluster [DBG] pgmap v1146: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:38.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:26:37 gibba045 bash[25517]: cluster 2021-03-10T14:26:36.530680+0000 mgr.gibba045.orlgmj (mgr.34412) 2030 : cluster [DBG] pgmap v1146: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:39.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:26:39 gibba015 bash[29377]: cluster 2021-03-10T14:26:38.532031+0000 mgr.gibba045.orlgmj (mgr.34412) 2031 : cluster [DBG] pgmap v1147: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:39.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:26:39 gibba015 bash[30343]: cluster 2021-03-10T14:26:38.532031+0000 mgr.gibba045.orlgmj (mgr.34412) 2031 : cluster [DBG] pgmap v1147: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:40.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:26:39 gibba045 bash[25517]: cluster 2021-03-10T14:26:38.532031+0000 mgr.gibba045.orlgmj (mgr.34412) 2031 : cluster [DBG] pgmap v1147: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:41.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:26:41 gibba015 bash[29377]: cluster 2021-03-10T14:26:40.533658+0000 mgr.gibba045.orlgmj (mgr.34412) 2032 : cluster [DBG] pgmap v1148: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:41.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:26:41 gibba015 bash[30343]: cluster 2021-03-10T14:26:40.533658+0000 mgr.gibba045.orlgmj (mgr.34412) 2032 : cluster [DBG] pgmap v1148: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:42.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:26:41 gibba045 bash[25517]: cluster 2021-03-10T14:26:40.533658+0000 mgr.gibba045.orlgmj (mgr.34412) 2032 : cluster [DBG] pgmap v1148: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:43.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:26:43 gibba015 bash[29377]: cluster 2021-03-10T14:26:42.535294+0000 mgr.gibba045.orlgmj (mgr.34412) 2033 : cluster [DBG] pgmap v1149: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:43.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:26:43 gibba015 bash[30343]: cluster 2021-03-10T14:26:42.535294+0000 mgr.gibba045.orlgmj (mgr.34412) 2033 : cluster [DBG] pgmap v1149: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:43.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:26:43 gibba045 bash[25517]: cluster 2021-03-10T14:26:42.535294+0000 mgr.gibba045.orlgmj (mgr.34412) 2033 : cluster [DBG] pgmap v1149: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:44.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:26:44 gibba015 bash[29377]: audit 2021-03-10T14:26:43.854312+0000 mon.c (mon.1) 617 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:26:44.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:26:44 gibba015 bash[29377]: audit 2021-03-10T14:26:44.116159+0000 mon.a (mon.0) 853 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:26:44.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:26:44 gibba015 bash[29377]: audit 2021-03-10T14:26:44.120312+0000 mon.c (mon.1) 618 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:26:44.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:26:44 gibba015 bash[29377]: audit 2021-03-10T14:26:44.122122+0000 mon.c (mon.1) 619 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:26:44.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:26:44 gibba015 bash[29377]: audit 2021-03-10T14:26:44.123742+0000 mon.c (mon.1) 620 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:26:44.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:26:44 gibba015 bash[29377]: audit 2021-03-10T14:26:44.125350+0000 mon.c (mon.1) 621 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:26:44.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:26:44 gibba015 bash[29377]: audit 2021-03-10T14:26:44.128718+0000 mon.c (mon.1) 622 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:26:44.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:26:44 gibba015 bash[29377]: audit 2021-03-10T14:26:44.130381+0000 mon.c (mon.1) 623 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:26:44.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:26:44 gibba015 bash[30343]: audit 2021-03-10T14:26:43.854312+0000 mon.c (mon.1) 617 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:26:44.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:26:44 gibba015 bash[30343]: audit 2021-03-10T14:26:44.116159+0000 mon.a (mon.0) 853 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:26:44.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:26:44 gibba015 bash[30343]: audit 2021-03-10T14:26:44.120312+0000 mon.c (mon.1) 618 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:26:44.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:26:44 gibba015 bash[30343]: audit 2021-03-10T14:26:44.122122+0000 mon.c (mon.1) 619 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:26:44.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:26:44 gibba015 bash[30343]: audit 2021-03-10T14:26:44.123742+0000 mon.c (mon.1) 620 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:26:44.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:26:44 gibba015 bash[30343]: audit 2021-03-10T14:26:44.125350+0000 mon.c (mon.1) 621 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:26:44.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:26:44 gibba015 bash[30343]: audit 2021-03-10T14:26:44.128718+0000 mon.c (mon.1) 622 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:26:44.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:26:44 gibba015 bash[30343]: audit 2021-03-10T14:26:44.130381+0000 mon.c (mon.1) 623 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:26:44.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:26:44 gibba045 bash[25517]: audit 2021-03-10T14:26:43.854312+0000 mon.c (mon.1) 617 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:26:44.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:26:44 gibba045 bash[25517]: audit 2021-03-10T14:26:44.116159+0000 mon.a (mon.0) 853 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:26:44.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:26:44 gibba045 bash[25517]: audit 2021-03-10T14:26:44.120312+0000 mon.c (mon.1) 618 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:26:44.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:26:44 gibba045 bash[25517]: audit 2021-03-10T14:26:44.122122+0000 mon.c (mon.1) 619 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:26:44.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:26:44 gibba045 bash[25517]: audit 2021-03-10T14:26:44.123742+0000 mon.c (mon.1) 620 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:26:44.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:26:44 gibba045 bash[25517]: audit 2021-03-10T14:26:44.125350+0000 mon.c (mon.1) 621 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:26:44.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:26:44 gibba045 bash[25517]: audit 2021-03-10T14:26:44.128718+0000 mon.c (mon.1) 622 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:26:44.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:26:44 gibba045 bash[25517]: audit 2021-03-10T14:26:44.130381+0000 mon.c (mon.1) 623 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:26:45.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:26:45 gibba015 bash[29377]: cephadm 2021-03-10T14:26:43.862519+0000 mgr.gibba045.orlgmj (mgr.34412) 2034 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:26:45.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:26:45 gibba015 bash[29377]: cephadm 2021-03-10T14:26:43.864191+0000 mgr.gibba045.orlgmj (mgr.34412) 2035 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:26:45.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:26:45 gibba015 bash[29377]: cephadm 2021-03-10T14:26:44.122708+0000 mgr.gibba045.orlgmj (mgr.34412) 2036 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:26:45.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:26:45 gibba015 bash[29377]: cephadm 2021-03-10T14:26:44.124880+0000 mgr.gibba045.orlgmj (mgr.34412) 2037 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:26:45.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:26:45 gibba015 bash[29377]: cephadm 2021-03-10T14:26:44.126454+0000 mgr.gibba045.orlgmj (mgr.34412) 2038 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:26:45.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:26:45 gibba015 bash[29377]: cephadm 2021-03-10T14:26:44.126498+0000 mgr.gibba045.orlgmj (mgr.34412) 2039 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:26:45.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:26:45 gibba015 bash[29377]: cephadm 2021-03-10T14:26:44.128242+0000 mgr.gibba045.orlgmj (mgr.34412) 2040 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:26:45.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:26:45 gibba015 bash[29377]: cephadm 2021-03-10T14:26:44.128288+0000 mgr.gibba045.orlgmj (mgr.34412) 2041 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:26:45.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:26:45 gibba015 bash[29377]: cephadm 2021-03-10T14:26:44.129785+0000 mgr.gibba045.orlgmj (mgr.34412) 2042 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:26:45.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:26:45 gibba015 bash[29377]: cephadm 2021-03-10T14:26:44.131482+0000 mgr.gibba045.orlgmj (mgr.34412) 2043 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:26:45.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:26:45 gibba015 bash[29377]: cephadm 2021-03-10T14:26:44.131527+0000 mgr.gibba045.orlgmj (mgr.34412) 2044 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:26:45.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:26:45 gibba015 bash[29377]: cephadm 2021-03-10T14:26:44.133185+0000 mgr.gibba045.orlgmj (mgr.34412) 2045 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:26:45.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:26:45 gibba015 bash[29377]: cephadm 2021-03-10T14:26:44.133503+0000 mgr.gibba045.orlgmj (mgr.34412) 2046 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:26:45.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:26:45 gibba015 bash[29377]: cephadm 2021-03-10T14:26:44.134746+0000 mgr.gibba045.orlgmj (mgr.34412) 2047 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:26:45.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:26:45 gibba015 bash[29377]: cephadm 2021-03-10T14:26:44.134790+0000 mgr.gibba045.orlgmj (mgr.34412) 2048 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:26:45.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:26:45 gibba015 bash[29377]: cephadm 2021-03-10T14:26:44.134904+0000 mgr.gibba045.orlgmj (mgr.34412) 2049 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:26:45.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:26:45 gibba015 bash[29377]: cluster 2021-03-10T14:26:44.536970+0000 mgr.gibba045.orlgmj (mgr.34412) 2050 : cluster [DBG] pgmap v1150: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:45.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:26:45 gibba015 bash[30343]: cephadm 2021-03-10T14:26:43.862519+0000 mgr.gibba045.orlgmj (mgr.34412) 2034 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:26:45.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:26:45 gibba015 bash[30343]: cephadm 2021-03-10T14:26:43.864191+0000 mgr.gibba045.orlgmj (mgr.34412) 2035 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:26:45.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:26:45 gibba015 bash[30343]: cephadm 2021-03-10T14:26:44.122708+0000 mgr.gibba045.orlgmj (mgr.34412) 2036 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:26:45.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:26:45 gibba015 bash[30343]: cephadm 2021-03-10T14:26:44.124880+0000 mgr.gibba045.orlgmj (mgr.34412) 2037 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:26:45.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:26:45 gibba015 bash[30343]: cephadm 2021-03-10T14:26:44.126454+0000 mgr.gibba045.orlgmj (mgr.34412) 2038 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:26:45.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:26:45 gibba015 bash[30343]: cephadm 2021-03-10T14:26:44.126498+0000 mgr.gibba045.orlgmj (mgr.34412) 2039 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:26:45.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:26:45 gibba015 bash[30343]: cephadm 2021-03-10T14:26:44.128242+0000 mgr.gibba045.orlgmj (mgr.34412) 2040 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:26:45.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:26:45 gibba015 bash[30343]: cephadm 2021-03-10T14:26:44.128288+0000 mgr.gibba045.orlgmj (mgr.34412) 2041 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:26:45.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:26:45 gibba015 bash[30343]: cephadm 2021-03-10T14:26:44.129785+0000 mgr.gibba045.orlgmj (mgr.34412) 2042 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:26:45.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:26:45 gibba015 bash[30343]: cephadm 2021-03-10T14:26:44.131482+0000 mgr.gibba045.orlgmj (mgr.34412) 2043 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:26:45.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:26:45 gibba015 bash[30343]: cephadm 2021-03-10T14:26:44.131527+0000 mgr.gibba045.orlgmj (mgr.34412) 2044 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:26:45.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:26:45 gibba015 bash[30343]: cephadm 2021-03-10T14:26:44.133185+0000 mgr.gibba045.orlgmj (mgr.34412) 2045 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:26:45.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:26:45 gibba015 bash[30343]: cephadm 2021-03-10T14:26:44.133503+0000 mgr.gibba045.orlgmj (mgr.34412) 2046 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:26:45.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:26:45 gibba015 bash[30343]: cephadm 2021-03-10T14:26:44.134746+0000 mgr.gibba045.orlgmj (mgr.34412) 2047 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:26:45.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:26:45 gibba015 bash[30343]: cephadm 2021-03-10T14:26:44.134790+0000 mgr.gibba045.orlgmj (mgr.34412) 2048 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:26:45.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:26:45 gibba015 bash[30343]: cephadm 2021-03-10T14:26:44.134904+0000 mgr.gibba045.orlgmj (mgr.34412) 2049 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:26:45.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:26:45 gibba015 bash[30343]: cluster 2021-03-10T14:26:44.536970+0000 mgr.gibba045.orlgmj (mgr.34412) 2050 : cluster [DBG] pgmap v1150: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:45.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:26:45 gibba045 bash[25517]: cephadm 2021-03-10T14:26:43.862519+0000 mgr.gibba045.orlgmj (mgr.34412) 2034 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:26:45.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:26:45 gibba045 bash[25517]: cephadm 2021-03-10T14:26:43.864191+0000 mgr.gibba045.orlgmj (mgr.34412) 2035 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:26:45.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:26:45 gibba045 bash[25517]: cephadm 2021-03-10T14:26:44.122708+0000 mgr.gibba045.orlgmj (mgr.34412) 2036 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:26:45.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:26:45 gibba045 bash[25517]: cephadm 2021-03-10T14:26:44.124880+0000 mgr.gibba045.orlgmj (mgr.34412) 2037 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:26:45.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:26:45 gibba045 bash[25517]: cephadm 2021-03-10T14:26:44.126454+0000 mgr.gibba045.orlgmj (mgr.34412) 2038 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:26:45.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:26:45 gibba045 bash[25517]: cephadm 2021-03-10T14:26:44.126498+0000 mgr.gibba045.orlgmj (mgr.34412) 2039 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:26:45.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:26:45 gibba045 bash[25517]: cephadm 2021-03-10T14:26:44.128242+0000 mgr.gibba045.orlgmj (mgr.34412) 2040 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:26:45.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:26:45 gibba045 bash[25517]: cephadm 2021-03-10T14:26:44.128288+0000 mgr.gibba045.orlgmj (mgr.34412) 2041 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:26:45.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:26:45 gibba045 bash[25517]: cephadm 2021-03-10T14:26:44.129785+0000 mgr.gibba045.orlgmj (mgr.34412) 2042 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:26:45.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:26:45 gibba045 bash[25517]: cephadm 2021-03-10T14:26:44.131482+0000 mgr.gibba045.orlgmj (mgr.34412) 2043 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:26:45.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:26:45 gibba045 bash[25517]: cephadm 2021-03-10T14:26:44.131527+0000 mgr.gibba045.orlgmj (mgr.34412) 2044 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:26:45.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:26:45 gibba045 bash[25517]: cephadm 2021-03-10T14:26:44.133185+0000 mgr.gibba045.orlgmj (mgr.34412) 2045 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:26:45.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:26:45 gibba045 bash[25517]: cephadm 2021-03-10T14:26:44.133503+0000 mgr.gibba045.orlgmj (mgr.34412) 2046 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:26:45.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:26:45 gibba045 bash[25517]: cephadm 2021-03-10T14:26:44.134746+0000 mgr.gibba045.orlgmj (mgr.34412) 2047 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:26:45.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:26:45 gibba045 bash[25517]: cephadm 2021-03-10T14:26:44.134790+0000 mgr.gibba045.orlgmj (mgr.34412) 2048 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:26:45.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:26:45 gibba045 bash[25517]: cephadm 2021-03-10T14:26:44.134904+0000 mgr.gibba045.orlgmj (mgr.34412) 2049 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:26:45.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:26:45 gibba045 bash[25517]: cluster 2021-03-10T14:26:44.536970+0000 mgr.gibba045.orlgmj (mgr.34412) 2050 : cluster [DBG] pgmap v1150: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:47.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:26:47 gibba015 bash[29377]: cluster 2021-03-10T14:26:46.538150+0000 mgr.gibba045.orlgmj (mgr.34412) 2051 : cluster [DBG] pgmap v1151: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:47.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:26:47 gibba015 bash[30343]: cluster 2021-03-10T14:26:46.538150+0000 mgr.gibba045.orlgmj (mgr.34412) 2051 : cluster [DBG] pgmap v1151: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:48.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:26:47 gibba045 bash[25517]: cluster 2021-03-10T14:26:46.538150+0000 mgr.gibba045.orlgmj (mgr.34412) 2051 : cluster [DBG] pgmap v1151: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:49.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:26:49 gibba015 bash[29377]: cluster 2021-03-10T14:26:48.539329+0000 mgr.gibba045.orlgmj (mgr.34412) 2052 : cluster [DBG] pgmap v1152: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:49.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:26:49 gibba015 bash[30343]: cluster 2021-03-10T14:26:48.539329+0000 mgr.gibba045.orlgmj (mgr.34412) 2052 : cluster [DBG] pgmap v1152: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:50.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:26:49 gibba045 bash[25517]: cluster 2021-03-10T14:26:48.539329+0000 mgr.gibba045.orlgmj (mgr.34412) 2052 : cluster [DBG] pgmap v1152: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:51.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:26:51 gibba015 bash[29377]: cluster 2021-03-10T14:26:50.541041+0000 mgr.gibba045.orlgmj (mgr.34412) 2053 : cluster [DBG] pgmap v1153: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:51.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:26:51 gibba015 bash[30343]: cluster 2021-03-10T14:26:50.541041+0000 mgr.gibba045.orlgmj (mgr.34412) 2053 : cluster [DBG] pgmap v1153: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:52.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:26:51 gibba045 bash[25517]: cluster 2021-03-10T14:26:50.541041+0000 mgr.gibba045.orlgmj (mgr.34412) 2053 : cluster [DBG] pgmap v1153: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:53.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:26:53 gibba015 bash[29377]: cluster 2021-03-10T14:26:52.542753+0000 mgr.gibba045.orlgmj (mgr.34412) 2054 : cluster [DBG] pgmap v1154: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:53.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:26:53 gibba015 bash[29377]: audit 2021-03-10T14:26:52.694716+0000 mon.c (mon.1) 624 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:26:53.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:26:53 gibba015 bash[29377]: audit 2021-03-10T14:26:52.695348+0000 mon.c (mon.1) 625 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:26:53.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:26:53 gibba015 bash[29377]: audit 2021-03-10T14:26:52.695890+0000 mon.a (mon.0) 854 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:26:53.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:26:53 gibba015 bash[29377]: audit 2021-03-10T14:26:52.697106+0000 mon.a (mon.0) 855 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:26:53.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:26:53 gibba015 bash[29377]: audit 2021-03-10T14:26:52.698152+0000 mon.c (mon.1) 626 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T14:26:53.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:26:53 gibba015 bash[29377]: audit 2021-03-10T14:26:52.698883+0000 mon.c (mon.1) 627 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:26:53.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:26:53 gibba015 bash[29377]: audit 2021-03-10T14:26:52.699345+0000 mon.a (mon.0) 856 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T14:26:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:26:53 gibba015 bash[29377]: audit 2021-03-10T14:26:52.699547+0000 mon.c (mon.1) 628 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:26:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:26:53 gibba015 bash[29377]: audit 2021-03-10T14:26:52.700571+0000 mon.c (mon.1) 629 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:26:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:26:53 gibba015 bash[29377]: audit 2021-03-10T14:26:52.700764+0000 mon.a (mon.0) 857 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:26:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:26:53 gibba015 bash[29377]: audit 2021-03-10T14:26:52.702211+0000 mon.a (mon.0) 858 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:26:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:26:53 gibba015 bash[29377]: audit 2021-03-10T14:26:52.703155+0000 mon.a (mon.0) 859 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:26:53.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:26:53 gibba015 bash[30343]: cluster 2021-03-10T14:26:52.542753+0000 mgr.gibba045.orlgmj (mgr.34412) 2054 : cluster [DBG] pgmap v1154: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:53.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:26:53 gibba015 bash[30343]: audit 2021-03-10T14:26:52.694716+0000 mon.c (mon.1) 624 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:26:53.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:26:53 gibba015 bash[30343]: audit 2021-03-10T14:26:52.695348+0000 mon.c (mon.1) 625 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:26:53.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:26:53 gibba015 bash[30343]: audit 2021-03-10T14:26:52.695890+0000 mon.a (mon.0) 854 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:26:53.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:26:53 gibba015 bash[30343]: audit 2021-03-10T14:26:52.697106+0000 mon.a (mon.0) 855 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:26:53.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:26:53 gibba015 bash[30343]: audit 2021-03-10T14:26:52.698152+0000 mon.c (mon.1) 626 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T14:26:53.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:26:53 gibba015 bash[30343]: audit 2021-03-10T14:26:52.698883+0000 mon.c (mon.1) 627 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:26:53.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:26:53 gibba015 bash[30343]: audit 2021-03-10T14:26:52.699345+0000 mon.a (mon.0) 856 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T14:26:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:26:53 gibba015 bash[30343]: audit 2021-03-10T14:26:52.699547+0000 mon.c (mon.1) 628 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:26:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:26:53 gibba015 bash[30343]: audit 2021-03-10T14:26:52.700571+0000 mon.c (mon.1) 629 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:26:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:26:53 gibba015 bash[30343]: audit 2021-03-10T14:26:52.700764+0000 mon.a (mon.0) 857 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:26:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:26:53 gibba015 bash[30343]: audit 2021-03-10T14:26:52.702211+0000 mon.a (mon.0) 858 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:26:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:26:53 gibba015 bash[30343]: audit 2021-03-10T14:26:52.703155+0000 mon.a (mon.0) 859 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:26:53.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:26:53 gibba045 bash[25517]: cluster 2021-03-10T14:26:52.542753+0000 mgr.gibba045.orlgmj (mgr.34412) 2054 : cluster [DBG] pgmap v1154: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:53.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:26:53 gibba045 bash[25517]: audit 2021-03-10T14:26:52.694716+0000 mon.c (mon.1) 624 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:26:53.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:26:53 gibba045 bash[25517]: audit 2021-03-10T14:26:52.695348+0000 mon.c (mon.1) 625 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:26:53.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:26:53 gibba045 bash[25517]: audit 2021-03-10T14:26:52.695890+0000 mon.a (mon.0) 854 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:26:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:26:53 gibba045 bash[25517]: audit 2021-03-10T14:26:52.697106+0000 mon.a (mon.0) 855 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:26:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:26:53 gibba045 bash[25517]: audit 2021-03-10T14:26:52.698152+0000 mon.c (mon.1) 626 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T14:26:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:26:53 gibba045 bash[25517]: audit 2021-03-10T14:26:52.698883+0000 mon.c (mon.1) 627 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:26:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:26:53 gibba045 bash[25517]: audit 2021-03-10T14:26:52.699345+0000 mon.a (mon.0) 856 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T14:26:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:26:53 gibba045 bash[25517]: audit 2021-03-10T14:26:52.699547+0000 mon.c (mon.1) 628 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:26:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:26:53 gibba045 bash[25517]: audit 2021-03-10T14:26:52.700571+0000 mon.c (mon.1) 629 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:26:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:26:53 gibba045 bash[25517]: audit 2021-03-10T14:26:52.700764+0000 mon.a (mon.0) 857 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:26:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:26:53 gibba045 bash[25517]: audit 2021-03-10T14:26:52.702211+0000 mon.a (mon.0) 858 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:26:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:26:53 gibba045 bash[25517]: audit 2021-03-10T14:26:52.703155+0000 mon.a (mon.0) 859 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:26:55.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:26:55 gibba015 bash[29377]: cluster 2021-03-10T14:26:54.544408+0000 mgr.gibba045.orlgmj (mgr.34412) 2055 : cluster [DBG] pgmap v1155: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:55.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:26:55 gibba015 bash[30343]: cluster 2021-03-10T14:26:54.544408+0000 mgr.gibba045.orlgmj (mgr.34412) 2055 : cluster [DBG] pgmap v1155: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:56.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:26:55 gibba045 bash[25517]: cluster 2021-03-10T14:26:54.544408+0000 mgr.gibba045.orlgmj (mgr.34412) 2055 : cluster [DBG] pgmap v1155: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:57.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:26:57 gibba015 bash[29377]: cluster 2021-03-10T14:26:56.546348+0000 mgr.gibba045.orlgmj (mgr.34412) 2056 : cluster [DBG] pgmap v1156: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:57.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:26:57 gibba015 bash[30343]: cluster 2021-03-10T14:26:56.546348+0000 mgr.gibba045.orlgmj (mgr.34412) 2056 : cluster [DBG] pgmap v1156: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:58.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:26:57 gibba045 bash[25517]: cluster 2021-03-10T14:26:56.546348+0000 mgr.gibba045.orlgmj (mgr.34412) 2056 : cluster [DBG] pgmap v1156: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:58.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:26:58 gibba015 bash[29377]: cluster 2021-03-10T14:26:58.547753+0000 mgr.gibba045.orlgmj (mgr.34412) 2057 : cluster [DBG] pgmap v1157: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:58.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:26:58 gibba015 bash[30343]: cluster 2021-03-10T14:26:58.547753+0000 mgr.gibba045.orlgmj (mgr.34412) 2057 : cluster [DBG] pgmap v1157: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:59.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:26:58 gibba045 bash[25517]: cluster 2021-03-10T14:26:58.547753+0000 mgr.gibba045.orlgmj (mgr.34412) 2057 : cluster [DBG] pgmap v1157: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:59.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:26:59 gibba015 bash[29377]: cephadm 2021-03-10T14:26:59.150858+0000 mgr.gibba045.orlgmj (mgr.34412) 2058 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:26:59.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:26:59 gibba015 bash[30343]: cephadm 2021-03-10T14:26:59.150858+0000 mgr.gibba045.orlgmj (mgr.34412) 2058 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:27:00.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:26:59 gibba045 bash[25517]: cephadm 2021-03-10T14:26:59.150858+0000 mgr.gibba045.orlgmj (mgr.34412) 2058 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:27:00.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:27:00 gibba015 bash[29377]: cluster 2021-03-10T14:27:00.549630+0000 mgr.gibba045.orlgmj (mgr.34412) 2059 : cluster [DBG] pgmap v1158: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:00.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:27:00 gibba015 bash[30343]: cluster 2021-03-10T14:27:00.549630+0000 mgr.gibba045.orlgmj (mgr.34412) 2059 : cluster [DBG] pgmap v1158: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:01.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:27:00 gibba045 bash[25517]: cluster 2021-03-10T14:27:00.549630+0000 mgr.gibba045.orlgmj (mgr.34412) 2059 : cluster [DBG] pgmap v1158: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:01.643 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:27:01.893 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:27:01.893 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (37m) 3m ago 43m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:27:01.894 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (42m) 2m ago 42m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:27:01.894 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (38m) 2m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:27:01.894 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (38m) 2m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:27:01.894 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (37m) 3m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:27:01.894 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (37m) 3m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:27:01.895 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (36m) 2m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:27:01.895 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (36m) 3m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:27:01.895 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (43m) 3m ago 43m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:27:01.895 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (43m) 2m ago 43m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:27:01.896 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (36m) 3m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:27:01.896 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (35m) 3m ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:27:01.896 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (35m) 3m ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:27:01.896 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (34m) 3m ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:27:01.896 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (34m) 2m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:27:01.897 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (33m) 2m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:27:01.897 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (33m) 2m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:27:01.897 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (33m) 2m ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:27:01.897 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (42m) 2m ago 43m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:27:01.898 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 2m ago 41m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:27:02.145 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:27:02.146 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:27:02.146 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:27:02.146 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:27:02.147 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:27:02.147 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:27:02.147 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:27:02.147 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:27:02.147 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:27:02.148 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:27:02.148 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:27:02.148 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:27:02.148 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:27:02.149 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:27:02.149 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:27:02.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:27:02 gibba015 bash[29377]: audit 2021-03-10T14:27:02.143085+0000 mon.a (mon.0) 860 : audit [DBG] from='client.? 172.21.2.115:0/3919299652' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:27:02.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:27:02 gibba015 bash[30343]: audit 2021-03-10T14:27:02.143085+0000 mon.a (mon.0) 860 : audit [DBG] from='client.? 172.21.2.115:0/3919299652' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:27:02.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:27:02 gibba045 bash[25517]: audit 2021-03-10T14:27:02.143085+0000 mon.a (mon.0) 860 : audit [DBG] from='client.? 172.21.2.115:0/3919299652' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:27:03.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:27:03 gibba015 bash[29377]: audit 2021-03-10T14:27:01.634923+0000 mgr.gibba045.orlgmj (mgr.34412) 2060 : audit [DBG] from='client.45438 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:27:03.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:27:03 gibba015 bash[29377]: audit 2021-03-10T14:27:01.860255+0000 mgr.gibba045.orlgmj (mgr.34412) 2061 : audit [DBG] from='client.55432 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:27:03.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:27:03 gibba015 bash[29377]: cluster 2021-03-10T14:27:02.551409+0000 mgr.gibba045.orlgmj (mgr.34412) 2062 : cluster [DBG] pgmap v1159: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:03.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:27:03 gibba015 bash[30343]: audit 2021-03-10T14:27:01.634923+0000 mgr.gibba045.orlgmj (mgr.34412) 2060 : audit [DBG] from='client.45438 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:27:03.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:27:03 gibba015 bash[30343]: audit 2021-03-10T14:27:01.860255+0000 mgr.gibba045.orlgmj (mgr.34412) 2061 : audit [DBG] from='client.55432 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:27:03.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:27:03 gibba015 bash[30343]: cluster 2021-03-10T14:27:02.551409+0000 mgr.gibba045.orlgmj (mgr.34412) 2062 : cluster [DBG] pgmap v1159: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:03.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:27:03 gibba045 bash[25517]: audit 2021-03-10T14:27:01.634923+0000 mgr.gibba045.orlgmj (mgr.34412) 2060 : audit [DBG] from='client.45438 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:27:03.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:27:03 gibba045 bash[25517]: audit 2021-03-10T14:27:01.860255+0000 mgr.gibba045.orlgmj (mgr.34412) 2061 : audit [DBG] from='client.55432 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:27:03.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:27:03 gibba045 bash[25517]: cluster 2021-03-10T14:27:02.551409+0000 mgr.gibba045.orlgmj (mgr.34412) 2062 : cluster [DBG] pgmap v1159: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:05.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:27:05 gibba015 bash[29377]: cluster 2021-03-10T14:27:04.553071+0000 mgr.gibba045.orlgmj (mgr.34412) 2063 : cluster [DBG] pgmap v1160: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:05.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:27:05 gibba015 bash[30343]: cluster 2021-03-10T14:27:04.553071+0000 mgr.gibba045.orlgmj (mgr.34412) 2063 : cluster [DBG] pgmap v1160: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:06.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:27:05 gibba045 bash[25517]: cluster 2021-03-10T14:27:04.553071+0000 mgr.gibba045.orlgmj (mgr.34412) 2063 : cluster [DBG] pgmap v1160: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:07.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:27:07 gibba015 bash[29377]: cluster 2021-03-10T14:27:06.555213+0000 mgr.gibba045.orlgmj (mgr.34412) 2064 : cluster [DBG] pgmap v1161: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:07.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:27:07 gibba015 bash[30343]: cluster 2021-03-10T14:27:06.555213+0000 mgr.gibba045.orlgmj (mgr.34412) 2064 : cluster [DBG] pgmap v1161: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:08.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:27:07 gibba045 bash[25517]: cluster 2021-03-10T14:27:06.555213+0000 mgr.gibba045.orlgmj (mgr.34412) 2064 : cluster [DBG] pgmap v1161: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:08.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:27:08 gibba015 bash[29377]: cluster 2021-03-10T14:27:08.556819+0000 mgr.gibba045.orlgmj (mgr.34412) 2065 : cluster [DBG] pgmap v1162: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:08.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:27:08 gibba015 bash[30343]: cluster 2021-03-10T14:27:08.556819+0000 mgr.gibba045.orlgmj (mgr.34412) 2065 : cluster [DBG] pgmap v1162: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:09.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:27:08 gibba045 bash[25517]: cluster 2021-03-10T14:27:08.556819+0000 mgr.gibba045.orlgmj (mgr.34412) 2065 : cluster [DBG] pgmap v1162: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:11.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:27:11 gibba015 bash[29377]: cluster 2021-03-10T14:27:10.558568+0000 mgr.gibba045.orlgmj (mgr.34412) 2066 : cluster [DBG] pgmap v1163: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:11.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:27:11 gibba015 bash[30343]: cluster 2021-03-10T14:27:10.558568+0000 mgr.gibba045.orlgmj (mgr.34412) 2066 : cluster [DBG] pgmap v1163: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:12.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:27:11 gibba045 bash[25517]: cluster 2021-03-10T14:27:10.558568+0000 mgr.gibba045.orlgmj (mgr.34412) 2066 : cluster [DBG] pgmap v1163: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:13.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:27:13 gibba015 bash[29377]: cluster 2021-03-10T14:27:12.560512+0000 mgr.gibba045.orlgmj (mgr.34412) 2067 : cluster [DBG] pgmap v1164: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:13.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:27:13 gibba015 bash[30343]: cluster 2021-03-10T14:27:12.560512+0000 mgr.gibba045.orlgmj (mgr.34412) 2067 : cluster [DBG] pgmap v1164: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:13.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:27:13 gibba045 bash[25517]: cluster 2021-03-10T14:27:12.560512+0000 mgr.gibba045.orlgmj (mgr.34412) 2067 : cluster [DBG] pgmap v1164: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:15.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:27:15 gibba015 bash[29377]: cephadm 2021-03-10T14:27:14.165175+0000 mgr.gibba045.orlgmj (mgr.34412) 2068 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:27:15.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:27:15 gibba015 bash[29377]: cluster 2021-03-10T14:27:14.561871+0000 mgr.gibba045.orlgmj (mgr.34412) 2069 : cluster [DBG] pgmap v1165: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:15.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:27:15 gibba015 bash[30343]: cephadm 2021-03-10T14:27:14.165175+0000 mgr.gibba045.orlgmj (mgr.34412) 2068 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:27:15.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:27:15 gibba015 bash[30343]: cluster 2021-03-10T14:27:14.561871+0000 mgr.gibba045.orlgmj (mgr.34412) 2069 : cluster [DBG] pgmap v1165: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:16.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:27:15 gibba045 bash[25517]: cephadm 2021-03-10T14:27:14.165175+0000 mgr.gibba045.orlgmj (mgr.34412) 2068 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:27:16.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:27:15 gibba045 bash[25517]: cluster 2021-03-10T14:27:14.561871+0000 mgr.gibba045.orlgmj (mgr.34412) 2069 : cluster [DBG] pgmap v1165: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:16.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:27:16 gibba015 bash[29377]: cluster 2021-03-10T14:27:16.563796+0000 mgr.gibba045.orlgmj (mgr.34412) 2070 : cluster [DBG] pgmap v1166: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:16.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:27:16 gibba015 bash[30343]: cluster 2021-03-10T14:27:16.563796+0000 mgr.gibba045.orlgmj (mgr.34412) 2070 : cluster [DBG] pgmap v1166: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:17.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:27:16 gibba045 bash[25517]: cluster 2021-03-10T14:27:16.563796+0000 mgr.gibba045.orlgmj (mgr.34412) 2070 : cluster [DBG] pgmap v1166: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:19.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:27:19 gibba015 bash[29377]: cluster 2021-03-10T14:27:18.565197+0000 mgr.gibba045.orlgmj (mgr.34412) 2071 : cluster [DBG] pgmap v1167: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:19.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:27:19 gibba015 bash[30343]: cluster 2021-03-10T14:27:18.565197+0000 mgr.gibba045.orlgmj (mgr.34412) 2071 : cluster [DBG] pgmap v1167: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:20.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:27:19 gibba045 bash[25517]: cluster 2021-03-10T14:27:18.565197+0000 mgr.gibba045.orlgmj (mgr.34412) 2071 : cluster [DBG] pgmap v1167: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:20.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:27:20 gibba015 bash[29377]: cluster 2021-03-10T14:27:20.566919+0000 mgr.gibba045.orlgmj (mgr.34412) 2072 : cluster [DBG] pgmap v1168: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:20.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:27:20 gibba015 bash[30343]: cluster 2021-03-10T14:27:20.566919+0000 mgr.gibba045.orlgmj (mgr.34412) 2072 : cluster [DBG] pgmap v1168: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:21.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:27:20 gibba045 bash[25517]: cluster 2021-03-10T14:27:20.566919+0000 mgr.gibba045.orlgmj (mgr.34412) 2072 : cluster [DBG] pgmap v1168: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:23.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:27:23 gibba015 bash[29377]: cluster 2021-03-10T14:27:22.568473+0000 mgr.gibba045.orlgmj (mgr.34412) 2073 : cluster [DBG] pgmap v1169: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:23.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:27:23 gibba015 bash[30343]: cluster 2021-03-10T14:27:22.568473+0000 mgr.gibba045.orlgmj (mgr.34412) 2073 : cluster [DBG] pgmap v1169: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:23.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:27:23 gibba045 bash[25517]: cluster 2021-03-10T14:27:22.568473+0000 mgr.gibba045.orlgmj (mgr.34412) 2073 : cluster [DBG] pgmap v1169: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:25.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:27:25 gibba015 bash[29377]: cluster 2021-03-10T14:27:24.570155+0000 mgr.gibba045.orlgmj (mgr.34412) 2074 : cluster [DBG] pgmap v1170: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:25.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:27:25 gibba015 bash[30343]: cluster 2021-03-10T14:27:24.570155+0000 mgr.gibba045.orlgmj (mgr.34412) 2074 : cluster [DBG] pgmap v1170: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:26.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:27:25 gibba045 bash[25517]: cluster 2021-03-10T14:27:24.570155+0000 mgr.gibba045.orlgmj (mgr.34412) 2074 : cluster [DBG] pgmap v1170: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:26.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:27:26 gibba015 bash[29377]: cluster 2021-03-10T14:27:26.572042+0000 mgr.gibba045.orlgmj (mgr.34412) 2075 : cluster [DBG] pgmap v1171: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:26.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:27:26 gibba015 bash[30343]: cluster 2021-03-10T14:27:26.572042+0000 mgr.gibba045.orlgmj (mgr.34412) 2075 : cluster [DBG] pgmap v1171: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:27.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:27:26 gibba045 bash[25517]: cluster 2021-03-10T14:27:26.572042+0000 mgr.gibba045.orlgmj (mgr.34412) 2075 : cluster [DBG] pgmap v1171: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:28.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:27:28 gibba015 bash[29377]: cluster 2021-03-10T14:27:28.573389+0000 mgr.gibba045.orlgmj (mgr.34412) 2076 : cluster [DBG] pgmap v1172: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:28.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:27:28 gibba015 bash[30343]: cluster 2021-03-10T14:27:28.573389+0000 mgr.gibba045.orlgmj (mgr.34412) 2076 : cluster [DBG] pgmap v1172: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:29.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:27:28 gibba045 bash[25517]: cluster 2021-03-10T14:27:28.573389+0000 mgr.gibba045.orlgmj (mgr.34412) 2076 : cluster [DBG] pgmap v1172: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:29.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:27:29 gibba015 bash[29377]: cephadm 2021-03-10T14:27:29.180983+0000 mgr.gibba045.orlgmj (mgr.34412) 2077 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:27:29.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:27:29 gibba015 bash[30343]: cephadm 2021-03-10T14:27:29.180983+0000 mgr.gibba045.orlgmj (mgr.34412) 2077 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:27:30.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:27:29 gibba045 bash[25517]: cephadm 2021-03-10T14:27:29.180983+0000 mgr.gibba045.orlgmj (mgr.34412) 2077 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:27:30.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:27:30 gibba015 bash[29377]: cluster 2021-03-10T14:27:30.574818+0000 mgr.gibba045.orlgmj (mgr.34412) 2078 : cluster [DBG] pgmap v1173: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:30.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:27:30 gibba015 bash[30343]: cluster 2021-03-10T14:27:30.574818+0000 mgr.gibba045.orlgmj (mgr.34412) 2078 : cluster [DBG] pgmap v1173: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:31.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:27:30 gibba045 bash[25517]: cluster 2021-03-10T14:27:30.574818+0000 mgr.gibba045.orlgmj (mgr.34412) 2078 : cluster [DBG] pgmap v1173: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:32.389 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:27:32.620 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:27:32.620 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (38m) 3m ago 43m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:27:32.620 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (43m) 2m ago 43m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:27:32.620 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (38m) 2m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:27:32.621 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (38m) 2m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:27:32.621 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (37m) 3m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:27:32.621 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (37m) 3m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:27:32.621 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (37m) 2m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:27:32.622 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (37m) 3m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:27:32.622 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (43m) 3m ago 43m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:27:32.622 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (43m) 2m ago 43m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:27:32.622 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (36m) 3m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:27:32.622 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (36m) 3m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:27:32.623 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (35m) 3m ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:27:32.623 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (35m) 3m ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:27:32.623 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (34m) 2m ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:27:32.623 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (34m) 2m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:27:32.624 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (34m) 2m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:27:32.624 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (33m) 2m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:27:32.624 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (43m) 2m ago 43m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:27:32.624 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 2m ago 41m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:27:32.870 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:27:32.870 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:27:32.871 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:27:32.871 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:27:32.871 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:27:32.871 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:27:32.871 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:27:32.872 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:27:32.872 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:27:32.872 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:27:32.872 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:27:32.873 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:27:32.873 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:27:32.873 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:27:32.873 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:27:33.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:27:33 gibba015 bash[29377]: audit 2021-03-10T14:27:32.380893+0000 mgr.gibba045.orlgmj (mgr.34412) 2079 : audit [DBG] from='client.45456 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:27:33.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:27:33 gibba015 bash[29377]: cluster 2021-03-10T14:27:32.576703+0000 mgr.gibba045.orlgmj (mgr.34412) 2080 : cluster [DBG] pgmap v1174: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:33.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:27:33 gibba015 bash[29377]: audit 2021-03-10T14:27:32.610077+0000 mgr.gibba045.orlgmj (mgr.34412) 2081 : audit [DBG] from='client.55450 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:27:33.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:27:33 gibba015 bash[29377]: audit 2021-03-10T14:27:32.867750+0000 mon.c (mon.1) 630 : audit [DBG] from='client.? 172.21.2.115:0/255856188' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:27:33.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:27:33 gibba015 bash[30343]: audit 2021-03-10T14:27:32.380893+0000 mgr.gibba045.orlgmj (mgr.34412) 2079 : audit [DBG] from='client.45456 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:27:33.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:27:33 gibba015 bash[30343]: cluster 2021-03-10T14:27:32.576703+0000 mgr.gibba045.orlgmj (mgr.34412) 2080 : cluster [DBG] pgmap v1174: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:33.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:27:33 gibba015 bash[30343]: audit 2021-03-10T14:27:32.610077+0000 mgr.gibba045.orlgmj (mgr.34412) 2081 : audit [DBG] from='client.55450 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:27:33.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:27:33 gibba015 bash[30343]: audit 2021-03-10T14:27:32.867750+0000 mon.c (mon.1) 630 : audit [DBG] from='client.? 172.21.2.115:0/255856188' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:27:33.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:27:33 gibba045 bash[25517]: audit 2021-03-10T14:27:32.380893+0000 mgr.gibba045.orlgmj (mgr.34412) 2079 : audit [DBG] from='client.45456 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:27:33.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:27:33 gibba045 bash[25517]: cluster 2021-03-10T14:27:32.576703+0000 mgr.gibba045.orlgmj (mgr.34412) 2080 : cluster [DBG] pgmap v1174: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:33.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:27:33 gibba045 bash[25517]: audit 2021-03-10T14:27:32.610077+0000 mgr.gibba045.orlgmj (mgr.34412) 2081 : audit [DBG] from='client.55450 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:27:33.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:27:33 gibba045 bash[25517]: audit 2021-03-10T14:27:32.867750+0000 mon.c (mon.1) 630 : audit [DBG] from='client.? 172.21.2.115:0/255856188' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:27:34.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:27:34 gibba015 bash[29377]: cluster 2021-03-10T14:27:34.578025+0000 mgr.gibba045.orlgmj (mgr.34412) 2082 : cluster [DBG] pgmap v1175: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:34.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:27:34 gibba015 bash[30343]: cluster 2021-03-10T14:27:34.578025+0000 mgr.gibba045.orlgmj (mgr.34412) 2082 : cluster [DBG] pgmap v1175: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:35.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:27:34 gibba045 bash[25517]: cluster 2021-03-10T14:27:34.578025+0000 mgr.gibba045.orlgmj (mgr.34412) 2082 : cluster [DBG] pgmap v1175: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:36.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:27:36 gibba015 bash[29377]: cluster 2021-03-10T14:27:36.579882+0000 mgr.gibba045.orlgmj (mgr.34412) 2083 : cluster [DBG] pgmap v1176: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:36.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:27:36 gibba015 bash[30343]: cluster 2021-03-10T14:27:36.579882+0000 mgr.gibba045.orlgmj (mgr.34412) 2083 : cluster [DBG] pgmap v1176: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:37.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:27:36 gibba045 bash[25517]: cluster 2021-03-10T14:27:36.579882+0000 mgr.gibba045.orlgmj (mgr.34412) 2083 : cluster [DBG] pgmap v1176: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:38.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:27:38 gibba015 bash[29377]: cluster 2021-03-10T14:27:38.581096+0000 mgr.gibba045.orlgmj (mgr.34412) 2084 : cluster [DBG] pgmap v1177: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:38.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:27:38 gibba015 bash[30343]: cluster 2021-03-10T14:27:38.581096+0000 mgr.gibba045.orlgmj (mgr.34412) 2084 : cluster [DBG] pgmap v1177: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:39.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:27:38 gibba045 bash[25517]: cluster 2021-03-10T14:27:38.581096+0000 mgr.gibba045.orlgmj (mgr.34412) 2084 : cluster [DBG] pgmap v1177: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:40.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:27:40 gibba015 bash[29377]: cluster 2021-03-10T14:27:40.582583+0000 mgr.gibba045.orlgmj (mgr.34412) 2085 : cluster [DBG] pgmap v1178: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:40.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:27:40 gibba015 bash[30343]: cluster 2021-03-10T14:27:40.582583+0000 mgr.gibba045.orlgmj (mgr.34412) 2085 : cluster [DBG] pgmap v1178: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:41.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:27:40 gibba045 bash[25517]: cluster 2021-03-10T14:27:40.582583+0000 mgr.gibba045.orlgmj (mgr.34412) 2085 : cluster [DBG] pgmap v1178: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:43.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:27:43 gibba015 bash[29377]: cluster 2021-03-10T14:27:42.584317+0000 mgr.gibba045.orlgmj (mgr.34412) 2086 : cluster [DBG] pgmap v1179: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:43.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:27:43 gibba015 bash[30343]: cluster 2021-03-10T14:27:42.584317+0000 mgr.gibba045.orlgmj (mgr.34412) 2086 : cluster [DBG] pgmap v1179: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:43.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:27:43 gibba045 bash[25517]: cluster 2021-03-10T14:27:42.584317+0000 mgr.gibba045.orlgmj (mgr.34412) 2086 : cluster [DBG] pgmap v1179: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:44.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:27:44 gibba045 bash[25517]: audit 2021-03-10T14:27:44.194499+0000 mon.c (mon.1) 631 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:27:44.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:27:44 gibba045 bash[25517]: audit 2021-03-10T14:27:44.432673+0000 mon.a (mon.0) 861 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:27:44.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:27:44 gibba045 bash[25517]: audit 2021-03-10T14:27:44.436242+0000 mon.c (mon.1) 632 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:27:44.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:27:44 gibba045 bash[25517]: audit 2021-03-10T14:27:44.437523+0000 mon.c (mon.1) 633 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:27:44.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:27:44 gibba045 bash[25517]: audit 2021-03-10T14:27:44.439110+0000 mon.c (mon.1) 634 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:27:44.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:27:44 gibba045 bash[25517]: audit 2021-03-10T14:27:44.440455+0000 mon.c (mon.1) 635 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:27:44.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:27:44 gibba045 bash[25517]: audit 2021-03-10T14:27:44.443858+0000 mon.c (mon.1) 636 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:27:44.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:27:44 gibba045 bash[25517]: audit 2021-03-10T14:27:44.445700+0000 mon.c (mon.1) 637 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:27:44.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:27:44 gibba015 bash[29377]: audit 2021-03-10T14:27:44.194499+0000 mon.c (mon.1) 631 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:27:44.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:27:44 gibba015 bash[29377]: audit 2021-03-10T14:27:44.432673+0000 mon.a (mon.0) 861 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:27:44.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:27:44 gibba015 bash[29377]: audit 2021-03-10T14:27:44.436242+0000 mon.c (mon.1) 632 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:27:44.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:27:44 gibba015 bash[29377]: audit 2021-03-10T14:27:44.437523+0000 mon.c (mon.1) 633 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:27:44.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:27:44 gibba015 bash[29377]: audit 2021-03-10T14:27:44.439110+0000 mon.c (mon.1) 634 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:27:44.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:27:44 gibba015 bash[29377]: audit 2021-03-10T14:27:44.440455+0000 mon.c (mon.1) 635 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:27:44.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:27:44 gibba015 bash[29377]: audit 2021-03-10T14:27:44.443858+0000 mon.c (mon.1) 636 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:27:44.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:27:44 gibba015 bash[29377]: audit 2021-03-10T14:27:44.445700+0000 mon.c (mon.1) 637 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:27:44.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:27:44 gibba015 bash[30343]: audit 2021-03-10T14:27:44.194499+0000 mon.c (mon.1) 631 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:27:44.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:27:44 gibba015 bash[30343]: audit 2021-03-10T14:27:44.432673+0000 mon.a (mon.0) 861 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:27:44.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:27:44 gibba015 bash[30343]: audit 2021-03-10T14:27:44.436242+0000 mon.c (mon.1) 632 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:27:44.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:27:44 gibba015 bash[30343]: audit 2021-03-10T14:27:44.437523+0000 mon.c (mon.1) 633 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:27:44.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:27:44 gibba015 bash[30343]: audit 2021-03-10T14:27:44.439110+0000 mon.c (mon.1) 634 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:27:44.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:27:44 gibba015 bash[30343]: audit 2021-03-10T14:27:44.440455+0000 mon.c (mon.1) 635 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:27:44.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:27:44 gibba015 bash[30343]: audit 2021-03-10T14:27:44.443858+0000 mon.c (mon.1) 636 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:27:44.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:27:44 gibba015 bash[30343]: audit 2021-03-10T14:27:44.445700+0000 mon.c (mon.1) 637 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:27:45.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:27:45 gibba045 bash[25517]: cephadm 2021-03-10T14:27:44.203837+0000 mgr.gibba045.orlgmj (mgr.34412) 2087 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:27:45.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:27:45 gibba045 bash[25517]: cephadm 2021-03-10T14:27:44.205486+0000 mgr.gibba045.orlgmj (mgr.34412) 2088 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:27:45.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:27:45 gibba045 bash[25517]: cephadm 2021-03-10T14:27:44.439008+0000 mgr.gibba045.orlgmj (mgr.34412) 2089 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:27:45.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:27:45 gibba045 bash[25517]: cephadm 2021-03-10T14:27:44.440630+0000 mgr.gibba045.orlgmj (mgr.34412) 2090 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:27:45.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:27:45 gibba045 bash[25517]: cephadm 2021-03-10T14:27:44.442036+0000 mgr.gibba045.orlgmj (mgr.34412) 2091 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:27:45.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:27:45 gibba045 bash[25517]: cephadm 2021-03-10T14:27:44.442078+0000 mgr.gibba045.orlgmj (mgr.34412) 2092 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:27:45.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:27:45 gibba045 bash[25517]: cephadm 2021-03-10T14:27:44.443403+0000 mgr.gibba045.orlgmj (mgr.34412) 2093 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:27:45.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:27:45 gibba045 bash[25517]: cephadm 2021-03-10T14:27:44.443441+0000 mgr.gibba045.orlgmj (mgr.34412) 2094 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:27:45.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:27:45 gibba045 bash[25517]: cephadm 2021-03-10T14:27:44.444786+0000 mgr.gibba045.orlgmj (mgr.34412) 2095 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:27:45.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:27:45 gibba045 bash[25517]: cephadm 2021-03-10T14:27:44.446734+0000 mgr.gibba045.orlgmj (mgr.34412) 2096 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:27:45.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:27:45 gibba045 bash[25517]: cephadm 2021-03-10T14:27:44.446771+0000 mgr.gibba045.orlgmj (mgr.34412) 2097 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:27:45.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:27:45 gibba045 bash[25517]: cephadm 2021-03-10T14:27:44.448335+0000 mgr.gibba045.orlgmj (mgr.34412) 2098 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:27:45.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:27:45 gibba045 bash[25517]: cephadm 2021-03-10T14:27:44.448726+0000 mgr.gibba045.orlgmj (mgr.34412) 2099 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:27:45.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:27:45 gibba045 bash[25517]: cephadm 2021-03-10T14:27:44.449899+0000 mgr.gibba045.orlgmj (mgr.34412) 2100 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:27:45.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:27:45 gibba045 bash[25517]: cephadm 2021-03-10T14:27:44.449937+0000 mgr.gibba045.orlgmj (mgr.34412) 2101 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:27:45.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:27:45 gibba045 bash[25517]: cephadm 2021-03-10T14:27:44.450048+0000 mgr.gibba045.orlgmj (mgr.34412) 2102 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:27:45.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:27:45 gibba045 bash[25517]: cluster 2021-03-10T14:27:44.586156+0000 mgr.gibba045.orlgmj (mgr.34412) 2103 : cluster [DBG] pgmap v1180: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:45.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:27:45 gibba015 bash[29377]: cephadm 2021-03-10T14:27:44.203837+0000 mgr.gibba045.orlgmj (mgr.34412) 2087 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:27:45.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:27:45 gibba015 bash[29377]: cephadm 2021-03-10T14:27:44.205486+0000 mgr.gibba045.orlgmj (mgr.34412) 2088 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:27:45.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:27:45 gibba015 bash[29377]: cephadm 2021-03-10T14:27:44.439008+0000 mgr.gibba045.orlgmj (mgr.34412) 2089 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:27:45.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:27:45 gibba015 bash[29377]: cephadm 2021-03-10T14:27:44.440630+0000 mgr.gibba045.orlgmj (mgr.34412) 2090 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:27:45.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:27:45 gibba015 bash[29377]: cephadm 2021-03-10T14:27:44.442036+0000 mgr.gibba045.orlgmj (mgr.34412) 2091 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:27:45.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:27:45 gibba015 bash[29377]: cephadm 2021-03-10T14:27:44.442078+0000 mgr.gibba045.orlgmj (mgr.34412) 2092 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:27:45.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:27:45 gibba015 bash[29377]: cephadm 2021-03-10T14:27:44.443403+0000 mgr.gibba045.orlgmj (mgr.34412) 2093 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:27:45.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:27:45 gibba015 bash[29377]: cephadm 2021-03-10T14:27:44.443441+0000 mgr.gibba045.orlgmj (mgr.34412) 2094 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:27:45.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:27:45 gibba015 bash[29377]: cephadm 2021-03-10T14:27:44.444786+0000 mgr.gibba045.orlgmj (mgr.34412) 2095 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:27:45.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:27:45 gibba015 bash[29377]: cephadm 2021-03-10T14:27:44.446734+0000 mgr.gibba045.orlgmj (mgr.34412) 2096 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:27:45.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:27:45 gibba015 bash[29377]: cephadm 2021-03-10T14:27:44.446771+0000 mgr.gibba045.orlgmj (mgr.34412) 2097 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:27:45.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:27:45 gibba015 bash[29377]: cephadm 2021-03-10T14:27:44.448335+0000 mgr.gibba045.orlgmj (mgr.34412) 2098 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:27:45.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:27:45 gibba015 bash[29377]: cephadm 2021-03-10T14:27:44.448726+0000 mgr.gibba045.orlgmj (mgr.34412) 2099 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:27:45.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:27:45 gibba015 bash[29377]: cephadm 2021-03-10T14:27:44.449899+0000 mgr.gibba045.orlgmj (mgr.34412) 2100 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:27:45.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:27:45 gibba015 bash[29377]: cephadm 2021-03-10T14:27:44.449937+0000 mgr.gibba045.orlgmj (mgr.34412) 2101 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:27:45.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:27:45 gibba015 bash[29377]: cephadm 2021-03-10T14:27:44.450048+0000 mgr.gibba045.orlgmj (mgr.34412) 2102 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:27:45.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:27:45 gibba015 bash[29377]: cluster 2021-03-10T14:27:44.586156+0000 mgr.gibba045.orlgmj (mgr.34412) 2103 : cluster [DBG] pgmap v1180: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:45.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:27:45 gibba015 bash[30343]: cephadm 2021-03-10T14:27:44.203837+0000 mgr.gibba045.orlgmj (mgr.34412) 2087 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:27:45.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:27:45 gibba015 bash[30343]: cephadm 2021-03-10T14:27:44.205486+0000 mgr.gibba045.orlgmj (mgr.34412) 2088 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:27:45.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:27:45 gibba015 bash[30343]: cephadm 2021-03-10T14:27:44.439008+0000 mgr.gibba045.orlgmj (mgr.34412) 2089 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:27:45.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:27:45 gibba015 bash[30343]: cephadm 2021-03-10T14:27:44.440630+0000 mgr.gibba045.orlgmj (mgr.34412) 2090 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:27:45.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:27:45 gibba015 bash[30343]: cephadm 2021-03-10T14:27:44.442036+0000 mgr.gibba045.orlgmj (mgr.34412) 2091 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:27:45.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:27:45 gibba015 bash[30343]: cephadm 2021-03-10T14:27:44.442078+0000 mgr.gibba045.orlgmj (mgr.34412) 2092 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:27:45.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:27:45 gibba015 bash[30343]: cephadm 2021-03-10T14:27:44.443403+0000 mgr.gibba045.orlgmj (mgr.34412) 2093 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:27:45.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:27:45 gibba015 bash[30343]: cephadm 2021-03-10T14:27:44.443441+0000 mgr.gibba045.orlgmj (mgr.34412) 2094 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:27:45.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:27:45 gibba015 bash[30343]: cephadm 2021-03-10T14:27:44.444786+0000 mgr.gibba045.orlgmj (mgr.34412) 2095 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:27:45.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:27:45 gibba015 bash[30343]: cephadm 2021-03-10T14:27:44.446734+0000 mgr.gibba045.orlgmj (mgr.34412) 2096 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:27:45.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:27:45 gibba015 bash[30343]: cephadm 2021-03-10T14:27:44.446771+0000 mgr.gibba045.orlgmj (mgr.34412) 2097 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:27:45.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:27:45 gibba015 bash[30343]: cephadm 2021-03-10T14:27:44.448335+0000 mgr.gibba045.orlgmj (mgr.34412) 2098 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:27:45.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:27:45 gibba015 bash[30343]: cephadm 2021-03-10T14:27:44.448726+0000 mgr.gibba045.orlgmj (mgr.34412) 2099 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:27:45.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:27:45 gibba015 bash[30343]: cephadm 2021-03-10T14:27:44.449899+0000 mgr.gibba045.orlgmj (mgr.34412) 2100 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:27:45.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:27:45 gibba015 bash[30343]: cephadm 2021-03-10T14:27:44.449937+0000 mgr.gibba045.orlgmj (mgr.34412) 2101 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:27:45.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:27:45 gibba015 bash[30343]: cephadm 2021-03-10T14:27:44.450048+0000 mgr.gibba045.orlgmj (mgr.34412) 2102 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:27:45.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:27:45 gibba015 bash[30343]: cluster 2021-03-10T14:27:44.586156+0000 mgr.gibba045.orlgmj (mgr.34412) 2103 : cluster [DBG] pgmap v1180: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:46.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:27:46 gibba015 bash[29377]: cluster 2021-03-10T14:27:46.587854+0000 mgr.gibba045.orlgmj (mgr.34412) 2104 : cluster [DBG] pgmap v1181: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:46.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:27:46 gibba015 bash[30343]: cluster 2021-03-10T14:27:46.587854+0000 mgr.gibba045.orlgmj (mgr.34412) 2104 : cluster [DBG] pgmap v1181: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:47.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:27:46 gibba045 bash[25517]: cluster 2021-03-10T14:27:46.587854+0000 mgr.gibba045.orlgmj (mgr.34412) 2104 : cluster [DBG] pgmap v1181: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:48.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:27:48 gibba015 bash[29377]: cluster 2021-03-10T14:27:48.589247+0000 mgr.gibba045.orlgmj (mgr.34412) 2105 : cluster [DBG] pgmap v1182: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:48.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:27:48 gibba015 bash[30343]: cluster 2021-03-10T14:27:48.589247+0000 mgr.gibba045.orlgmj (mgr.34412) 2105 : cluster [DBG] pgmap v1182: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:49.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:27:48 gibba045 bash[25517]: cluster 2021-03-10T14:27:48.589247+0000 mgr.gibba045.orlgmj (mgr.34412) 2105 : cluster [DBG] pgmap v1182: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:50.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:27:50 gibba015 bash[29377]: cluster 2021-03-10T14:27:50.590985+0000 mgr.gibba045.orlgmj (mgr.34412) 2106 : cluster [DBG] pgmap v1183: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:50.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:27:50 gibba015 bash[30343]: cluster 2021-03-10T14:27:50.590985+0000 mgr.gibba045.orlgmj (mgr.34412) 2106 : cluster [DBG] pgmap v1183: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:51.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:27:50 gibba045 bash[25517]: cluster 2021-03-10T14:27:50.590985+0000 mgr.gibba045.orlgmj (mgr.34412) 2106 : cluster [DBG] pgmap v1183: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:53.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:27:53 gibba045 bash[25517]: cluster 2021-03-10T14:27:52.592811+0000 mgr.gibba045.orlgmj (mgr.34412) 2107 : cluster [DBG] pgmap v1184: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:53.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:27:53 gibba045 bash[25517]: audit 2021-03-10T14:27:52.701554+0000 mon.c (mon.1) 638 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:27:53.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:27:53 gibba045 bash[25517]: audit 2021-03-10T14:27:52.702181+0000 mon.c (mon.1) 639 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:27:53.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:27:53 gibba045 bash[25517]: audit 2021-03-10T14:27:52.702703+0000 mon.a (mon.0) 862 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:27:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:27:53 gibba045 bash[25517]: audit 2021-03-10T14:27:52.703702+0000 mon.c (mon.1) 640 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T14:27:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:27:53 gibba045 bash[25517]: audit 2021-03-10T14:27:52.704049+0000 mon.a (mon.0) 863 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:27:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:27:53 gibba045 bash[25517]: audit 2021-03-10T14:27:52.704495+0000 mon.c (mon.1) 641 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:27:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:27:53 gibba045 bash[25517]: audit 2021-03-10T14:27:52.705012+0000 mon.a (mon.0) 864 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T14:27:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:27:53 gibba045 bash[25517]: audit 2021-03-10T14:27:52.705356+0000 mon.c (mon.1) 642 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:27:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:27:53 gibba045 bash[25517]: audit 2021-03-10T14:27:52.706155+0000 mon.c (mon.1) 643 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:27:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:27:53 gibba045 bash[25517]: audit 2021-03-10T14:27:52.706235+0000 mon.a (mon.0) 865 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:27:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:27:53 gibba045 bash[25517]: audit 2021-03-10T14:27:52.707685+0000 mon.a (mon.0) 866 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:27:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:27:53 gibba045 bash[25517]: audit 2021-03-10T14:27:52.708011+0000 mon.a (mon.0) 867 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:27:53.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:27:53 gibba015 bash[29377]: cluster 2021-03-10T14:27:52.592811+0000 mgr.gibba045.orlgmj (mgr.34412) 2107 : cluster [DBG] pgmap v1184: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:53.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:27:53 gibba015 bash[29377]: audit 2021-03-10T14:27:52.701554+0000 mon.c (mon.1) 638 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:27:53.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:27:53 gibba015 bash[29377]: audit 2021-03-10T14:27:52.702181+0000 mon.c (mon.1) 639 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:27:53.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:27:53 gibba015 bash[29377]: audit 2021-03-10T14:27:52.702703+0000 mon.a (mon.0) 862 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:27:53.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:27:53 gibba015 bash[29377]: audit 2021-03-10T14:27:52.703702+0000 mon.c (mon.1) 640 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T14:27:53.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:27:53 gibba015 bash[29377]: audit 2021-03-10T14:27:52.704049+0000 mon.a (mon.0) 863 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:27:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:27:53 gibba015 bash[29377]: audit 2021-03-10T14:27:52.704495+0000 mon.c (mon.1) 641 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:27:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:27:53 gibba015 bash[29377]: audit 2021-03-10T14:27:52.705012+0000 mon.a (mon.0) 864 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T14:27:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:27:53 gibba015 bash[29377]: audit 2021-03-10T14:27:52.705356+0000 mon.c (mon.1) 642 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:27:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:27:53 gibba015 bash[29377]: audit 2021-03-10T14:27:52.706155+0000 mon.c (mon.1) 643 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:27:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:27:53 gibba015 bash[29377]: audit 2021-03-10T14:27:52.706235+0000 mon.a (mon.0) 865 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:27:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:27:53 gibba015 bash[29377]: audit 2021-03-10T14:27:52.707685+0000 mon.a (mon.0) 866 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:27:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:27:53 gibba015 bash[29377]: audit 2021-03-10T14:27:52.708011+0000 mon.a (mon.0) 867 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:27:53.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:27:53 gibba015 bash[30343]: cluster 2021-03-10T14:27:52.592811+0000 mgr.gibba045.orlgmj (mgr.34412) 2107 : cluster [DBG] pgmap v1184: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:53.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:27:53 gibba015 bash[30343]: audit 2021-03-10T14:27:52.701554+0000 mon.c (mon.1) 638 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:27:53.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:27:53 gibba015 bash[30343]: audit 2021-03-10T14:27:52.702181+0000 mon.c (mon.1) 639 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:27:53.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:27:53 gibba015 bash[30343]: audit 2021-03-10T14:27:52.702703+0000 mon.a (mon.0) 862 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:27:53.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:27:53 gibba015 bash[30343]: audit 2021-03-10T14:27:52.703702+0000 mon.c (mon.1) 640 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T14:27:53.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:27:53 gibba015 bash[30343]: audit 2021-03-10T14:27:52.704049+0000 mon.a (mon.0) 863 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:27:53.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:27:53 gibba015 bash[30343]: audit 2021-03-10T14:27:52.704495+0000 mon.c (mon.1) 641 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:27:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:27:53 gibba015 bash[30343]: audit 2021-03-10T14:27:52.705012+0000 mon.a (mon.0) 864 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T14:27:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:27:53 gibba015 bash[30343]: audit 2021-03-10T14:27:52.705356+0000 mon.c (mon.1) 642 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:27:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:27:53 gibba015 bash[30343]: audit 2021-03-10T14:27:52.706155+0000 mon.c (mon.1) 643 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:27:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:27:53 gibba015 bash[30343]: audit 2021-03-10T14:27:52.706235+0000 mon.a (mon.0) 865 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:27:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:27:53 gibba015 bash[30343]: audit 2021-03-10T14:27:52.707685+0000 mon.a (mon.0) 866 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:27:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:27:53 gibba015 bash[30343]: audit 2021-03-10T14:27:52.708011+0000 mon.a (mon.0) 867 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:27:54.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:27:54 gibba015 bash[29377]: cluster 2021-03-10T14:27:54.594399+0000 mgr.gibba045.orlgmj (mgr.34412) 2108 : cluster [DBG] pgmap v1185: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:54.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:27:54 gibba015 bash[30343]: cluster 2021-03-10T14:27:54.594399+0000 mgr.gibba045.orlgmj (mgr.34412) 2108 : cluster [DBG] pgmap v1185: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:55.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:27:54 gibba045 bash[25517]: cluster 2021-03-10T14:27:54.594399+0000 mgr.gibba045.orlgmj (mgr.34412) 2108 : cluster [DBG] pgmap v1185: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:56.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:27:56 gibba015 bash[29377]: cluster 2021-03-10T14:27:56.596249+0000 mgr.gibba045.orlgmj (mgr.34412) 2109 : cluster [DBG] pgmap v1186: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:56.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:27:56 gibba015 bash[30343]: cluster 2021-03-10T14:27:56.596249+0000 mgr.gibba045.orlgmj (mgr.34412) 2109 : cluster [DBG] pgmap v1186: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:57.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:27:56 gibba045 bash[25517]: cluster 2021-03-10T14:27:56.596249+0000 mgr.gibba045.orlgmj (mgr.34412) 2109 : cluster [DBG] pgmap v1186: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:58.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:27:58 gibba015 bash[29377]: cluster 2021-03-10T14:27:58.597567+0000 mgr.gibba045.orlgmj (mgr.34412) 2110 : cluster [DBG] pgmap v1187: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:58.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:27:58 gibba015 bash[30343]: cluster 2021-03-10T14:27:58.597567+0000 mgr.gibba045.orlgmj (mgr.34412) 2110 : cluster [DBG] pgmap v1187: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:59.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:27:58 gibba045 bash[25517]: cluster 2021-03-10T14:27:58.597567+0000 mgr.gibba045.orlgmj (mgr.34412) 2110 : cluster [DBG] pgmap v1187: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:59.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:27:59 gibba045 bash[25517]: cephadm 2021-03-10T14:27:59.465819+0000 mgr.gibba045.orlgmj (mgr.34412) 2111 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:27:59.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:27:59 gibba015 bash[29377]: cephadm 2021-03-10T14:27:59.465819+0000 mgr.gibba045.orlgmj (mgr.34412) 2111 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:27:59.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:27:59 gibba015 bash[30343]: cephadm 2021-03-10T14:27:59.465819+0000 mgr.gibba045.orlgmj (mgr.34412) 2111 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:28:00.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:28:00 gibba015 bash[29377]: cluster 2021-03-10T14:28:00.599272+0000 mgr.gibba045.orlgmj (mgr.34412) 2112 : cluster [DBG] pgmap v1188: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:00.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:28:00 gibba015 bash[30343]: cluster 2021-03-10T14:28:00.599272+0000 mgr.gibba045.orlgmj (mgr.34412) 2112 : cluster [DBG] pgmap v1188: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:01.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:28:00 gibba045 bash[25517]: cluster 2021-03-10T14:28:00.599272+0000 mgr.gibba045.orlgmj (mgr.34412) 2112 : cluster [DBG] pgmap v1188: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:03.114 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:28:03.342 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:28:03.342 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (38m) 4m ago 44m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:28:03.343 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (43m) 3m ago 43m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:28:03.343 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (39m) 3m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:28:03.343 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (39m) 3m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:28:03.343 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (38m) 4m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:28:03.343 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (38m) 4m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:28:03.344 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (37m) 3m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:28:03.344 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (38m) 4m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:28:03.344 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (44m) 4m ago 44m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:28:03.344 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (44m) 3m ago 44m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:28:03.345 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (37m) 4m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:28:03.345 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (36m) 4m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:28:03.345 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (36m) 4m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:28:03.345 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (35m) 4m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:28:03.345 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (35m) 3m ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:28:03.346 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (34m) 3m ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:28:03.346 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (34m) 3m ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:28:03.346 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (34m) 3m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:28:03.346 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (43m) 3m ago 44m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:28:03.346 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 3m ago 42m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:28:03.596 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:28:03.597 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:28:03.597 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:28:03.598 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:28:03.599 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:28:03.600 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:28:03.600 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:28:03.601 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:28:03.601 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:28:03.602 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:28:03.603 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:28:03.605 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:28:03.605 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:28:03.606 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:28:03.606 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:28:03.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:28:03 gibba045 bash[25517]: cluster 2021-03-10T14:28:02.600921+0000 mgr.gibba045.orlgmj (mgr.34412) 2113 : cluster [DBG] pgmap v1189: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:03.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:28:03 gibba015 bash[29377]: cluster 2021-03-10T14:28:02.600921+0000 mgr.gibba045.orlgmj (mgr.34412) 2113 : cluster [DBG] pgmap v1189: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:03.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:28:03 gibba015 bash[30343]: cluster 2021-03-10T14:28:02.600921+0000 mgr.gibba045.orlgmj (mgr.34412) 2113 : cluster [DBG] pgmap v1189: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:04.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:28:04 gibba045 bash[25517]: audit 2021-03-10T14:28:03.105868+0000 mgr.gibba045.orlgmj (mgr.34412) 2114 : audit [DBG] from='client.55462 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:28:04.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:28:04 gibba045 bash[25517]: audit 2021-03-10T14:28:03.330791+0000 mgr.gibba045.orlgmj (mgr.34412) 2115 : audit [DBG] from='client.45480 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:28:04.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:28:04 gibba045 bash[25517]: audit 2021-03-10T14:28:03.593122+0000 mon.c (mon.1) 644 : audit [DBG] from='client.? 172.21.2.115:0/1810811614' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:28:04.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:28:04 gibba015 bash[29377]: audit 2021-03-10T14:28:03.105868+0000 mgr.gibba045.orlgmj (mgr.34412) 2114 : audit [DBG] from='client.55462 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:28:04.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:28:04 gibba015 bash[29377]: audit 2021-03-10T14:28:03.330791+0000 mgr.gibba045.orlgmj (mgr.34412) 2115 : audit [DBG] from='client.45480 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:28:04.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:28:04 gibba015 bash[29377]: audit 2021-03-10T14:28:03.593122+0000 mon.c (mon.1) 644 : audit [DBG] from='client.? 172.21.2.115:0/1810811614' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:28:04.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:28:04 gibba015 bash[30343]: audit 2021-03-10T14:28:03.105868+0000 mgr.gibba045.orlgmj (mgr.34412) 2114 : audit [DBG] from='client.55462 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:28:04.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:28:04 gibba015 bash[30343]: audit 2021-03-10T14:28:03.330791+0000 mgr.gibba045.orlgmj (mgr.34412) 2115 : audit [DBG] from='client.45480 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:28:04.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:28:04 gibba015 bash[30343]: audit 2021-03-10T14:28:03.593122+0000 mon.c (mon.1) 644 : audit [DBG] from='client.? 172.21.2.115:0/1810811614' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:28:05.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:28:05 gibba045 bash[25517]: cluster 2021-03-10T14:28:04.602552+0000 mgr.gibba045.orlgmj (mgr.34412) 2116 : cluster [DBG] pgmap v1190: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:05.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:28:05 gibba015 bash[29377]: cluster 2021-03-10T14:28:04.602552+0000 mgr.gibba045.orlgmj (mgr.34412) 2116 : cluster [DBG] pgmap v1190: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:05.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:28:05 gibba015 bash[30343]: cluster 2021-03-10T14:28:04.602552+0000 mgr.gibba045.orlgmj (mgr.34412) 2116 : cluster [DBG] pgmap v1190: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:06.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:28:06 gibba015 bash[29377]: cluster 2021-03-10T14:28:06.604540+0000 mgr.gibba045.orlgmj (mgr.34412) 2117 : cluster [DBG] pgmap v1191: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:06.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:28:06 gibba015 bash[30343]: cluster 2021-03-10T14:28:06.604540+0000 mgr.gibba045.orlgmj (mgr.34412) 2117 : cluster [DBG] pgmap v1191: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:07.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:28:06 gibba045 bash[25517]: cluster 2021-03-10T14:28:06.604540+0000 mgr.gibba045.orlgmj (mgr.34412) 2117 : cluster [DBG] pgmap v1191: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:08.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:28:08 gibba015 bash[29377]: cluster 2021-03-10T14:28:08.605703+0000 mgr.gibba045.orlgmj (mgr.34412) 2118 : cluster [DBG] pgmap v1192: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:08.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:28:08 gibba015 bash[30343]: cluster 2021-03-10T14:28:08.605703+0000 mgr.gibba045.orlgmj (mgr.34412) 2118 : cluster [DBG] pgmap v1192: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:09.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:28:08 gibba045 bash[25517]: cluster 2021-03-10T14:28:08.605703+0000 mgr.gibba045.orlgmj (mgr.34412) 2118 : cluster [DBG] pgmap v1192: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:10.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:28:10 gibba015 bash[29377]: cluster 2021-03-10T14:28:10.607383+0000 mgr.gibba045.orlgmj (mgr.34412) 2119 : cluster [DBG] pgmap v1193: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:10.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:28:10 gibba015 bash[30343]: cluster 2021-03-10T14:28:10.607383+0000 mgr.gibba045.orlgmj (mgr.34412) 2119 : cluster [DBG] pgmap v1193: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:11.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:28:10 gibba045 bash[25517]: cluster 2021-03-10T14:28:10.607383+0000 mgr.gibba045.orlgmj (mgr.34412) 2119 : cluster [DBG] pgmap v1193: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:13.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:28:13 gibba045 bash[25517]: cluster 2021-03-10T14:28:12.609160+0000 mgr.gibba045.orlgmj (mgr.34412) 2120 : cluster [DBG] pgmap v1194: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:13.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:28:13 gibba015 bash[29377]: cluster 2021-03-10T14:28:12.609160+0000 mgr.gibba045.orlgmj (mgr.34412) 2120 : cluster [DBG] pgmap v1194: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:13.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:28:13 gibba015 bash[30343]: cluster 2021-03-10T14:28:12.609160+0000 mgr.gibba045.orlgmj (mgr.34412) 2120 : cluster [DBG] pgmap v1194: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:14.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:28:14 gibba045 bash[25517]: cephadm 2021-03-10T14:28:14.481234+0000 mgr.gibba045.orlgmj (mgr.34412) 2121 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:28:14.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:28:14 gibba045 bash[25517]: cluster 2021-03-10T14:28:14.610188+0000 mgr.gibba045.orlgmj (mgr.34412) 2122 : cluster [DBG] pgmap v1195: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:14.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:28:14 gibba015 bash[29377]: cephadm 2021-03-10T14:28:14.481234+0000 mgr.gibba045.orlgmj (mgr.34412) 2121 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:28:14.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:28:14 gibba015 bash[29377]: cluster 2021-03-10T14:28:14.610188+0000 mgr.gibba045.orlgmj (mgr.34412) 2122 : cluster [DBG] pgmap v1195: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:14.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:28:14 gibba015 bash[30343]: cephadm 2021-03-10T14:28:14.481234+0000 mgr.gibba045.orlgmj (mgr.34412) 2121 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:28:14.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:28:14 gibba015 bash[30343]: cluster 2021-03-10T14:28:14.610188+0000 mgr.gibba045.orlgmj (mgr.34412) 2122 : cluster [DBG] pgmap v1195: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:16.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:28:16 gibba015 bash[29377]: cluster 2021-03-10T14:28:16.611941+0000 mgr.gibba045.orlgmj (mgr.34412) 2123 : cluster [DBG] pgmap v1196: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:16.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:28:16 gibba015 bash[30343]: cluster 2021-03-10T14:28:16.611941+0000 mgr.gibba045.orlgmj (mgr.34412) 2123 : cluster [DBG] pgmap v1196: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:17.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:28:16 gibba045 bash[25517]: cluster 2021-03-10T14:28:16.611941+0000 mgr.gibba045.orlgmj (mgr.34412) 2123 : cluster [DBG] pgmap v1196: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:18.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:28:18 gibba015 bash[29377]: cluster 2021-03-10T14:28:18.612986+0000 mgr.gibba045.orlgmj (mgr.34412) 2124 : cluster [DBG] pgmap v1197: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:18.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:28:18 gibba015 bash[30343]: cluster 2021-03-10T14:28:18.612986+0000 mgr.gibba045.orlgmj (mgr.34412) 2124 : cluster [DBG] pgmap v1197: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:19.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:28:18 gibba045 bash[25517]: cluster 2021-03-10T14:28:18.612986+0000 mgr.gibba045.orlgmj (mgr.34412) 2124 : cluster [DBG] pgmap v1197: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:20.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:28:20 gibba015 bash[29377]: cluster 2021-03-10T14:28:20.614597+0000 mgr.gibba045.orlgmj (mgr.34412) 2125 : cluster [DBG] pgmap v1198: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:20.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:28:20 gibba015 bash[30343]: cluster 2021-03-10T14:28:20.614597+0000 mgr.gibba045.orlgmj (mgr.34412) 2125 : cluster [DBG] pgmap v1198: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:21.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:28:20 gibba045 bash[25517]: cluster 2021-03-10T14:28:20.614597+0000 mgr.gibba045.orlgmj (mgr.34412) 2125 : cluster [DBG] pgmap v1198: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:23.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:28:23 gibba045 bash[25517]: cluster 2021-03-10T14:28:22.615087+0000 mgr.gibba045.orlgmj (mgr.34412) 2126 : cluster [DBG] pgmap v1199: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:23.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:28:23 gibba015 bash[29377]: cluster 2021-03-10T14:28:22.615087+0000 mgr.gibba045.orlgmj (mgr.34412) 2126 : cluster [DBG] pgmap v1199: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:23.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:28:23 gibba015 bash[30343]: cluster 2021-03-10T14:28:22.615087+0000 mgr.gibba045.orlgmj (mgr.34412) 2126 : cluster [DBG] pgmap v1199: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:24.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:28:24 gibba015 bash[29377]: cluster 2021-03-10T14:28:24.616649+0000 mgr.gibba045.orlgmj (mgr.34412) 2127 : cluster [DBG] pgmap v1200: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:24.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:28:24 gibba015 bash[30343]: cluster 2021-03-10T14:28:24.616649+0000 mgr.gibba045.orlgmj (mgr.34412) 2127 : cluster [DBG] pgmap v1200: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:25.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:28:24 gibba045 bash[25517]: cluster 2021-03-10T14:28:24.616649+0000 mgr.gibba045.orlgmj (mgr.34412) 2127 : cluster [DBG] pgmap v1200: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:26.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:28:26 gibba015 bash[29377]: cluster 2021-03-10T14:28:26.618324+0000 mgr.gibba045.orlgmj (mgr.34412) 2128 : cluster [DBG] pgmap v1201: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:26.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:28:26 gibba015 bash[30343]: cluster 2021-03-10T14:28:26.618324+0000 mgr.gibba045.orlgmj (mgr.34412) 2128 : cluster [DBG] pgmap v1201: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:27.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:28:26 gibba045 bash[25517]: cluster 2021-03-10T14:28:26.618324+0000 mgr.gibba045.orlgmj (mgr.34412) 2128 : cluster [DBG] pgmap v1201: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:28.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:28:28 gibba015 bash[29377]: cluster 2021-03-10T14:28:28.619614+0000 mgr.gibba045.orlgmj (mgr.34412) 2129 : cluster [DBG] pgmap v1202: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:28.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:28:28 gibba015 bash[30343]: cluster 2021-03-10T14:28:28.619614+0000 mgr.gibba045.orlgmj (mgr.34412) 2129 : cluster [DBG] pgmap v1202: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:29.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:28:28 gibba045 bash[25517]: cluster 2021-03-10T14:28:28.619614+0000 mgr.gibba045.orlgmj (mgr.34412) 2129 : cluster [DBG] pgmap v1202: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:29.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:28:29 gibba045 bash[25517]: cephadm 2021-03-10T14:28:29.497348+0000 mgr.gibba045.orlgmj (mgr.34412) 2130 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:28:29.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:28:29 gibba015 bash[29377]: cephadm 2021-03-10T14:28:29.497348+0000 mgr.gibba045.orlgmj (mgr.34412) 2130 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:28:29.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:28:29 gibba015 bash[30343]: cephadm 2021-03-10T14:28:29.497348+0000 mgr.gibba045.orlgmj (mgr.34412) 2130 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:28:30.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:28:30 gibba015 bash[29377]: cluster 2021-03-10T14:28:30.620109+0000 mgr.gibba045.orlgmj (mgr.34412) 2131 : cluster [DBG] pgmap v1203: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:30.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:28:30 gibba015 bash[30343]: cluster 2021-03-10T14:28:30.620109+0000 mgr.gibba045.orlgmj (mgr.34412) 2131 : cluster [DBG] pgmap v1203: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:31.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:28:30 gibba045 bash[25517]: cluster 2021-03-10T14:28:30.620109+0000 mgr.gibba045.orlgmj (mgr.34412) 2131 : cluster [DBG] pgmap v1203: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:33.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:28:33 gibba045 bash[25517]: cluster 2021-03-10T14:28:32.621669+0000 mgr.gibba045.orlgmj (mgr.34412) 2132 : cluster [DBG] pgmap v1204: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:33.834 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:28:33.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:28:33 gibba015 bash[29377]: cluster 2021-03-10T14:28:32.621669+0000 mgr.gibba045.orlgmj (mgr.34412) 2132 : cluster [DBG] pgmap v1204: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:33.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:28:33 gibba015 bash[30343]: cluster 2021-03-10T14:28:32.621669+0000 mgr.gibba045.orlgmj (mgr.34412) 2132 : cluster [DBG] pgmap v1204: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:34.090 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:28:34.090 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (39m) 4m ago 44m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:28:34.090 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (44m) 3m ago 44m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:28:34.091 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (39m) 3m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:28:34.091 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (40m) 3m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:28:34.091 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (38m) 4m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:28:34.091 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (38m) 4m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:28:34.092 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (38m) 3m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:28:34.092 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (38m) 4m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:28:34.092 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (44m) 4m ago 44m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:28:34.092 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (44m) 3m ago 44m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:28:34.093 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (37m) 4m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:28:34.093 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (37m) 4m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:28:34.093 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (36m) 4m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:28:34.093 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (36m) 4m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:28:34.093 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (35m) 3m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:28:34.094 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (35m) 3m ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:28:34.094 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (35m) 3m ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:28:34.094 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (34m) 3m ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:28:34.094 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (44m) 3m ago 44m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:28:34.095 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 3m ago 42m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:28:34.344 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:28:34.345 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:28:34.345 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:28:34.345 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:28:34.345 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:28:34.346 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:28:34.346 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:28:34.346 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:28:34.347 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:28:34.347 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:28:34.347 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:28:34.347 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:28:34.348 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:28:34.348 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:28:34.348 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:28:34.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:28:34 gibba045 bash[25517]: audit 2021-03-10T14:28:34.341653+0000 mon.c (mon.1) 645 : audit [DBG] from='client.? 172.21.2.115:0/4097042584' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:28:34.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:28:34 gibba015 bash[29377]: audit 2021-03-10T14:28:34.341653+0000 mon.c (mon.1) 645 : audit [DBG] from='client.? 172.21.2.115:0/4097042584' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:28:34.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:28:34 gibba015 bash[30343]: audit 2021-03-10T14:28:34.341653+0000 mon.c (mon.1) 645 : audit [DBG] from='client.? 172.21.2.115:0/4097042584' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:28:35.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:28:35 gibba045 bash[25517]: audit 2021-03-10T14:28:33.826812+0000 mgr.gibba045.orlgmj (mgr.34412) 2133 : audit [DBG] from='client.45492 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:28:35.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:28:35 gibba045 bash[25517]: audit 2021-03-10T14:28:34.050102+0000 mgr.gibba045.orlgmj (mgr.34412) 2134 : audit [DBG] from='client.55486 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:28:35.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:28:35 gibba045 bash[25517]: cluster 2021-03-10T14:28:34.623032+0000 mgr.gibba045.orlgmj (mgr.34412) 2135 : cluster [DBG] pgmap v1205: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:35.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:28:35 gibba015 bash[29377]: audit 2021-03-10T14:28:33.826812+0000 mgr.gibba045.orlgmj (mgr.34412) 2133 : audit [DBG] from='client.45492 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:28:35.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:28:35 gibba015 bash[29377]: audit 2021-03-10T14:28:34.050102+0000 mgr.gibba045.orlgmj (mgr.34412) 2134 : audit [DBG] from='client.55486 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:28:35.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:28:35 gibba015 bash[29377]: cluster 2021-03-10T14:28:34.623032+0000 mgr.gibba045.orlgmj (mgr.34412) 2135 : cluster [DBG] pgmap v1205: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:35.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:28:35 gibba015 bash[30343]: audit 2021-03-10T14:28:33.826812+0000 mgr.gibba045.orlgmj (mgr.34412) 2133 : audit [DBG] from='client.45492 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:28:35.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:28:35 gibba015 bash[30343]: audit 2021-03-10T14:28:34.050102+0000 mgr.gibba045.orlgmj (mgr.34412) 2134 : audit [DBG] from='client.55486 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:28:35.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:28:35 gibba015 bash[30343]: cluster 2021-03-10T14:28:34.623032+0000 mgr.gibba045.orlgmj (mgr.34412) 2135 : cluster [DBG] pgmap v1205: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:36.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:28:36 gibba015 bash[29377]: cluster 2021-03-10T14:28:36.624916+0000 mgr.gibba045.orlgmj (mgr.34412) 2136 : cluster [DBG] pgmap v1206: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:36.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:28:36 gibba015 bash[30343]: cluster 2021-03-10T14:28:36.624916+0000 mgr.gibba045.orlgmj (mgr.34412) 2136 : cluster [DBG] pgmap v1206: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:37.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:28:36 gibba045 bash[25517]: cluster 2021-03-10T14:28:36.624916+0000 mgr.gibba045.orlgmj (mgr.34412) 2136 : cluster [DBG] pgmap v1206: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:38.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:28:38 gibba015 bash[29377]: cluster 2021-03-10T14:28:38.625451+0000 mgr.gibba045.orlgmj (mgr.34412) 2137 : cluster [DBG] pgmap v1207: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:38.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:28:38 gibba015 bash[30343]: cluster 2021-03-10T14:28:38.625451+0000 mgr.gibba045.orlgmj (mgr.34412) 2137 : cluster [DBG] pgmap v1207: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:39.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:28:38 gibba045 bash[25517]: cluster 2021-03-10T14:28:38.625451+0000 mgr.gibba045.orlgmj (mgr.34412) 2137 : cluster [DBG] pgmap v1207: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:40.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:28:40 gibba015 bash[29377]: cluster 2021-03-10T14:28:40.626728+0000 mgr.gibba045.orlgmj (mgr.34412) 2138 : cluster [DBG] pgmap v1208: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:40.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:28:40 gibba015 bash[30343]: cluster 2021-03-10T14:28:40.626728+0000 mgr.gibba045.orlgmj (mgr.34412) 2138 : cluster [DBG] pgmap v1208: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:41.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:28:40 gibba045 bash[25517]: cluster 2021-03-10T14:28:40.626728+0000 mgr.gibba045.orlgmj (mgr.34412) 2138 : cluster [DBG] pgmap v1208: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:43.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:28:43 gibba045 bash[25517]: cluster 2021-03-10T14:28:42.628326+0000 mgr.gibba045.orlgmj (mgr.34412) 2139 : cluster [DBG] pgmap v1209: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:43.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:28:43 gibba015 bash[29377]: cluster 2021-03-10T14:28:42.628326+0000 mgr.gibba045.orlgmj (mgr.34412) 2139 : cluster [DBG] pgmap v1209: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:43.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:28:43 gibba015 bash[30343]: cluster 2021-03-10T14:28:42.628326+0000 mgr.gibba045.orlgmj (mgr.34412) 2139 : cluster [DBG] pgmap v1209: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:44.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:28:44 gibba015 bash[29377]: audit 2021-03-10T14:28:44.510575+0000 mon.c (mon.1) 646 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:28:44.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:28:44 gibba015 bash[30343]: audit 2021-03-10T14:28:44.510575+0000 mon.c (mon.1) 646 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:28:45.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:28:44 gibba045 bash[25517]: audit 2021-03-10T14:28:44.510575+0000 mon.c (mon.1) 646 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:28:45.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:28:45 gibba015 bash[29377]: cephadm 2021-03-10T14:28:44.519607+0000 mgr.gibba045.orlgmj (mgr.34412) 2140 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:28:45.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:28:45 gibba015 bash[29377]: cephadm 2021-03-10T14:28:44.521136+0000 mgr.gibba045.orlgmj (mgr.34412) 2141 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:28:45.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:28:45 gibba015 bash[29377]: cluster 2021-03-10T14:28:44.628878+0000 mgr.gibba045.orlgmj (mgr.34412) 2142 : cluster [DBG] pgmap v1210: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:45.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:28:45 gibba015 bash[29377]: audit 2021-03-10T14:28:44.733448+0000 mon.a (mon.0) 868 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:28:45.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:28:45 gibba015 bash[29377]: audit 2021-03-10T14:28:44.737365+0000 mon.c (mon.1) 647 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:28:45.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:28:45 gibba015 bash[29377]: audit 2021-03-10T14:28:44.739056+0000 mon.c (mon.1) 648 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:28:45.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:28:45 gibba015 bash[29377]: audit 2021-03-10T14:28:44.740362+0000 mon.c (mon.1) 649 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:28:45.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:28:45 gibba015 bash[29377]: audit 2021-03-10T14:28:44.741458+0000 mon.c (mon.1) 650 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:28:45.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:28:45 gibba015 bash[29377]: audit 2021-03-10T14:28:44.744011+0000 mon.c (mon.1) 651 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:28:45.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:28:45 gibba015 bash[29377]: audit 2021-03-10T14:28:44.745347+0000 mon.c (mon.1) 652 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:28:45.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:28:45 gibba015 bash[30343]: cephadm 2021-03-10T14:28:44.519607+0000 mgr.gibba045.orlgmj (mgr.34412) 2140 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:28:45.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:28:45 gibba015 bash[30343]: cephadm 2021-03-10T14:28:44.521136+0000 mgr.gibba045.orlgmj (mgr.34412) 2141 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:28:45.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:28:45 gibba015 bash[30343]: cluster 2021-03-10T14:28:44.628878+0000 mgr.gibba045.orlgmj (mgr.34412) 2142 : cluster [DBG] pgmap v1210: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:45.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:28:45 gibba015 bash[30343]: audit 2021-03-10T14:28:44.733448+0000 mon.a (mon.0) 868 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:28:45.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:28:45 gibba015 bash[30343]: audit 2021-03-10T14:28:44.737365+0000 mon.c (mon.1) 647 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:28:45.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:28:45 gibba015 bash[30343]: audit 2021-03-10T14:28:44.739056+0000 mon.c (mon.1) 648 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:28:45.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:28:45 gibba015 bash[30343]: audit 2021-03-10T14:28:44.740362+0000 mon.c (mon.1) 649 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:28:45.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:28:45 gibba015 bash[30343]: audit 2021-03-10T14:28:44.741458+0000 mon.c (mon.1) 650 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:28:45.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:28:45 gibba015 bash[30343]: audit 2021-03-10T14:28:44.744011+0000 mon.c (mon.1) 651 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:28:45.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:28:45 gibba015 bash[30343]: audit 2021-03-10T14:28:44.745347+0000 mon.c (mon.1) 652 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:28:46.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:28:45 gibba045 bash[25517]: cephadm 2021-03-10T14:28:44.519607+0000 mgr.gibba045.orlgmj (mgr.34412) 2140 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:28:46.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:28:45 gibba045 bash[25517]: cephadm 2021-03-10T14:28:44.521136+0000 mgr.gibba045.orlgmj (mgr.34412) 2141 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:28:46.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:28:45 gibba045 bash[25517]: cluster 2021-03-10T14:28:44.628878+0000 mgr.gibba045.orlgmj (mgr.34412) 2142 : cluster [DBG] pgmap v1210: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:46.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:28:45 gibba045 bash[25517]: audit 2021-03-10T14:28:44.733448+0000 mon.a (mon.0) 868 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:28:46.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:28:45 gibba045 bash[25517]: audit 2021-03-10T14:28:44.737365+0000 mon.c (mon.1) 647 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:28:46.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:28:45 gibba045 bash[25517]: audit 2021-03-10T14:28:44.739056+0000 mon.c (mon.1) 648 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:28:46.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:28:45 gibba045 bash[25517]: audit 2021-03-10T14:28:44.740362+0000 mon.c (mon.1) 649 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:28:46.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:28:45 gibba045 bash[25517]: audit 2021-03-10T14:28:44.741458+0000 mon.c (mon.1) 650 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:28:46.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:28:45 gibba045 bash[25517]: audit 2021-03-10T14:28:44.744011+0000 mon.c (mon.1) 651 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:28:46.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:28:45 gibba045 bash[25517]: audit 2021-03-10T14:28:44.745347+0000 mon.c (mon.1) 652 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:28:46.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:28:46 gibba015 bash[29377]: cephadm 2021-03-10T14:28:44.739955+0000 mgr.gibba045.orlgmj (mgr.34412) 2143 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:28:46.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:28:46 gibba015 bash[29377]: cephadm 2021-03-10T14:28:44.742116+0000 mgr.gibba045.orlgmj (mgr.34412) 2144 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:28:46.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:28:46 gibba015 bash[29377]: cephadm 2021-03-10T14:28:44.743568+0000 mgr.gibba045.orlgmj (mgr.34412) 2145 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:28:46.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:28:46 gibba015 bash[29377]: cephadm 2021-03-10T14:28:44.743607+0000 mgr.gibba045.orlgmj (mgr.34412) 2146 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:28:46.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:28:46 gibba015 bash[29377]: cephadm 2021-03-10T14:28:44.744639+0000 mgr.gibba045.orlgmj (mgr.34412) 2147 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:28:46.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:28:46 gibba015 bash[29377]: cephadm 2021-03-10T14:28:44.744739+0000 mgr.gibba045.orlgmj (mgr.34412) 2148 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:28:46.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:28:46 gibba015 bash[29377]: cephadm 2021-03-10T14:28:44.745814+0000 mgr.gibba045.orlgmj (mgr.34412) 2149 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:28:46.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:28:46 gibba015 bash[29377]: cephadm 2021-03-10T14:28:44.747074+0000 mgr.gibba045.orlgmj (mgr.34412) 2150 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:28:46.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:28:46 gibba015 bash[29377]: cephadm 2021-03-10T14:28:44.747112+0000 mgr.gibba045.orlgmj (mgr.34412) 2151 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:28:46.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:28:46 gibba015 bash[29377]: cephadm 2021-03-10T14:28:44.748290+0000 mgr.gibba045.orlgmj (mgr.34412) 2152 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:28:46.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:28:46 gibba015 bash[29377]: cephadm 2021-03-10T14:28:44.748628+0000 mgr.gibba045.orlgmj (mgr.34412) 2153 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:28:46.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:28:46 gibba015 bash[29377]: cephadm 2021-03-10T14:28:44.749662+0000 mgr.gibba045.orlgmj (mgr.34412) 2154 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:28:46.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:28:46 gibba015 bash[29377]: cephadm 2021-03-10T14:28:44.749702+0000 mgr.gibba045.orlgmj (mgr.34412) 2155 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:28:46.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:28:46 gibba015 bash[29377]: cephadm 2021-03-10T14:28:44.749815+0000 mgr.gibba045.orlgmj (mgr.34412) 2156 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:28:46.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:28:46 gibba015 bash[30343]: cephadm 2021-03-10T14:28:44.739955+0000 mgr.gibba045.orlgmj (mgr.34412) 2143 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:28:46.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:28:46 gibba015 bash[30343]: cephadm 2021-03-10T14:28:44.742116+0000 mgr.gibba045.orlgmj (mgr.34412) 2144 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:28:46.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:28:46 gibba015 bash[30343]: cephadm 2021-03-10T14:28:44.743568+0000 mgr.gibba045.orlgmj (mgr.34412) 2145 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:28:46.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:28:46 gibba015 bash[30343]: cephadm 2021-03-10T14:28:44.743607+0000 mgr.gibba045.orlgmj (mgr.34412) 2146 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:28:46.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:28:46 gibba015 bash[30343]: cephadm 2021-03-10T14:28:44.744639+0000 mgr.gibba045.orlgmj (mgr.34412) 2147 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:28:46.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:28:46 gibba015 bash[30343]: cephadm 2021-03-10T14:28:44.744739+0000 mgr.gibba045.orlgmj (mgr.34412) 2148 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:28:46.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:28:46 gibba015 bash[30343]: cephadm 2021-03-10T14:28:44.745814+0000 mgr.gibba045.orlgmj (mgr.34412) 2149 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:28:46.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:28:46 gibba015 bash[30343]: cephadm 2021-03-10T14:28:44.747074+0000 mgr.gibba045.orlgmj (mgr.34412) 2150 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:28:46.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:28:46 gibba015 bash[30343]: cephadm 2021-03-10T14:28:44.747112+0000 mgr.gibba045.orlgmj (mgr.34412) 2151 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:28:46.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:28:46 gibba015 bash[30343]: cephadm 2021-03-10T14:28:44.748290+0000 mgr.gibba045.orlgmj (mgr.34412) 2152 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:28:46.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:28:46 gibba015 bash[30343]: cephadm 2021-03-10T14:28:44.748628+0000 mgr.gibba045.orlgmj (mgr.34412) 2153 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:28:46.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:28:46 gibba015 bash[30343]: cephadm 2021-03-10T14:28:44.749662+0000 mgr.gibba045.orlgmj (mgr.34412) 2154 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:28:46.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:28:46 gibba015 bash[30343]: cephadm 2021-03-10T14:28:44.749702+0000 mgr.gibba045.orlgmj (mgr.34412) 2155 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:28:46.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:28:46 gibba015 bash[30343]: cephadm 2021-03-10T14:28:44.749815+0000 mgr.gibba045.orlgmj (mgr.34412) 2156 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:28:47.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:28:46 gibba045 bash[25517]: cephadm 2021-03-10T14:28:44.739955+0000 mgr.gibba045.orlgmj (mgr.34412) 2143 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:28:47.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:28:46 gibba045 bash[25517]: cephadm 2021-03-10T14:28:44.742116+0000 mgr.gibba045.orlgmj (mgr.34412) 2144 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:28:47.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:28:46 gibba045 bash[25517]: cephadm 2021-03-10T14:28:44.743568+0000 mgr.gibba045.orlgmj (mgr.34412) 2145 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:28:47.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:28:46 gibba045 bash[25517]: cephadm 2021-03-10T14:28:44.743607+0000 mgr.gibba045.orlgmj (mgr.34412) 2146 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:28:47.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:28:46 gibba045 bash[25517]: cephadm 2021-03-10T14:28:44.744639+0000 mgr.gibba045.orlgmj (mgr.34412) 2147 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:28:47.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:28:46 gibba045 bash[25517]: cephadm 2021-03-10T14:28:44.744739+0000 mgr.gibba045.orlgmj (mgr.34412) 2148 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:28:47.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:28:46 gibba045 bash[25517]: cephadm 2021-03-10T14:28:44.745814+0000 mgr.gibba045.orlgmj (mgr.34412) 2149 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:28:47.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:28:46 gibba045 bash[25517]: cephadm 2021-03-10T14:28:44.747074+0000 mgr.gibba045.orlgmj (mgr.34412) 2150 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:28:47.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:28:46 gibba045 bash[25517]: cephadm 2021-03-10T14:28:44.747112+0000 mgr.gibba045.orlgmj (mgr.34412) 2151 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:28:47.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:28:46 gibba045 bash[25517]: cephadm 2021-03-10T14:28:44.748290+0000 mgr.gibba045.orlgmj (mgr.34412) 2152 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:28:47.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:28:46 gibba045 bash[25517]: cephadm 2021-03-10T14:28:44.748628+0000 mgr.gibba045.orlgmj (mgr.34412) 2153 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:28:47.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:28:46 gibba045 bash[25517]: cephadm 2021-03-10T14:28:44.749662+0000 mgr.gibba045.orlgmj (mgr.34412) 2154 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:28:47.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:28:46 gibba045 bash[25517]: cephadm 2021-03-10T14:28:44.749702+0000 mgr.gibba045.orlgmj (mgr.34412) 2155 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:28:47.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:28:46 gibba045 bash[25517]: cephadm 2021-03-10T14:28:44.749815+0000 mgr.gibba045.orlgmj (mgr.34412) 2156 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:28:47.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:28:47 gibba015 bash[29377]: cluster 2021-03-10T14:28:46.629556+0000 mgr.gibba045.orlgmj (mgr.34412) 2157 : cluster [DBG] pgmap v1211: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:47.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:28:47 gibba015 bash[30343]: cluster 2021-03-10T14:28:46.629556+0000 mgr.gibba045.orlgmj (mgr.34412) 2157 : cluster [DBG] pgmap v1211: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:48.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:28:47 gibba045 bash[25517]: cluster 2021-03-10T14:28:46.629556+0000 mgr.gibba045.orlgmj (mgr.34412) 2157 : cluster [DBG] pgmap v1211: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:48.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:28:48 gibba015 bash[29377]: cluster 2021-03-10T14:28:48.630737+0000 mgr.gibba045.orlgmj (mgr.34412) 2158 : cluster [DBG] pgmap v1212: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:48.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:28:48 gibba015 bash[30343]: cluster 2021-03-10T14:28:48.630737+0000 mgr.gibba045.orlgmj (mgr.34412) 2158 : cluster [DBG] pgmap v1212: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:49.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:28:48 gibba045 bash[25517]: cluster 2021-03-10T14:28:48.630737+0000 mgr.gibba045.orlgmj (mgr.34412) 2158 : cluster [DBG] pgmap v1212: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:50.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:28:50 gibba015 bash[29377]: cluster 2021-03-10T14:28:50.632412+0000 mgr.gibba045.orlgmj (mgr.34412) 2159 : cluster [DBG] pgmap v1213: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:50.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:28:50 gibba015 bash[30343]: cluster 2021-03-10T14:28:50.632412+0000 mgr.gibba045.orlgmj (mgr.34412) 2159 : cluster [DBG] pgmap v1213: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:51.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:28:50 gibba045 bash[25517]: cluster 2021-03-10T14:28:50.632412+0000 mgr.gibba045.orlgmj (mgr.34412) 2159 : cluster [DBG] pgmap v1213: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:53.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:28:53 gibba045 bash[25517]: cluster 2021-03-10T14:28:52.633885+0000 mgr.gibba045.orlgmj (mgr.34412) 2160 : cluster [DBG] pgmap v1214: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:53.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:28:53 gibba045 bash[25517]: audit 2021-03-10T14:28:52.708919+0000 mon.c (mon.1) 653 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:28:53.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:28:53 gibba045 bash[25517]: audit 2021-03-10T14:28:52.709764+0000 mon.c (mon.1) 654 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:28:53.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:28:53 gibba045 bash[25517]: audit 2021-03-10T14:28:52.710218+0000 mon.a (mon.0) 869 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:28:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:28:53 gibba045 bash[25517]: audit 2021-03-10T14:28:52.710668+0000 mon.c (mon.1) 655 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T14:28:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:28:53 gibba045 bash[25517]: audit 2021-03-10T14:28:52.711353+0000 mon.a (mon.0) 870 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:28:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:28:53 gibba045 bash[25517]: audit 2021-03-10T14:28:52.711748+0000 mon.c (mon.1) 656 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:28:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:28:53 gibba045 bash[25517]: audit 2021-03-10T14:28:52.712311+0000 mon.a (mon.0) 871 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T14:28:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:28:53 gibba045 bash[25517]: audit 2021-03-10T14:28:52.712899+0000 mon.c (mon.1) 657 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:28:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:28:53 gibba045 bash[25517]: audit 2021-03-10T14:28:52.713380+0000 mon.a (mon.0) 872 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:28:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:28:53 gibba045 bash[25517]: audit 2021-03-10T14:28:52.714067+0000 mon.c (mon.1) 658 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:28:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:28:53 gibba045 bash[25517]: audit 2021-03-10T14:28:52.714189+0000 mon.a (mon.0) 873 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:28:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:28:53 gibba045 bash[25517]: audit 2021-03-10T14:28:52.714702+0000 mon.a (mon.0) 874 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:28:53.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:28:53 gibba015 bash[30343]: cluster 2021-03-10T14:28:52.633885+0000 mgr.gibba045.orlgmj (mgr.34412) 2160 : cluster [DBG] pgmap v1214: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:53.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:28:53 gibba015 bash[30343]: audit 2021-03-10T14:28:52.708919+0000 mon.c (mon.1) 653 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:28:53.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:28:53 gibba015 bash[30343]: audit 2021-03-10T14:28:52.709764+0000 mon.c (mon.1) 654 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:28:53.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:28:53 gibba015 bash[30343]: audit 2021-03-10T14:28:52.710218+0000 mon.a (mon.0) 869 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:28:53.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:28:53 gibba015 bash[30343]: audit 2021-03-10T14:28:52.710668+0000 mon.c (mon.1) 655 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T14:28:53.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:28:53 gibba015 bash[30343]: audit 2021-03-10T14:28:52.711353+0000 mon.a (mon.0) 870 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:28:53.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:28:53 gibba015 bash[30343]: audit 2021-03-10T14:28:52.711748+0000 mon.c (mon.1) 656 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:28:53.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:28:53 gibba015 bash[30343]: audit 2021-03-10T14:28:52.712311+0000 mon.a (mon.0) 871 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T14:28:53.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:28:53 gibba015 bash[30343]: audit 2021-03-10T14:28:52.712899+0000 mon.c (mon.1) 657 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:28:53.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:28:53 gibba015 bash[30343]: audit 2021-03-10T14:28:52.713380+0000 mon.a (mon.0) 872 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:28:53.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:28:53 gibba015 bash[30343]: audit 2021-03-10T14:28:52.714067+0000 mon.c (mon.1) 658 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:28:53.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:28:53 gibba015 bash[30343]: audit 2021-03-10T14:28:52.714189+0000 mon.a (mon.0) 873 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:28:53.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:28:53 gibba015 bash[30343]: audit 2021-03-10T14:28:52.714702+0000 mon.a (mon.0) 874 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:28:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:28:53 gibba015 bash[29377]: cluster 2021-03-10T14:28:52.633885+0000 mgr.gibba045.orlgmj (mgr.34412) 2160 : cluster [DBG] pgmap v1214: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:28:53 gibba015 bash[29377]: audit 2021-03-10T14:28:52.708919+0000 mon.c (mon.1) 653 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:28:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:28:53 gibba015 bash[29377]: audit 2021-03-10T14:28:52.709764+0000 mon.c (mon.1) 654 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:28:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:28:53 gibba015 bash[29377]: audit 2021-03-10T14:28:52.710218+0000 mon.a (mon.0) 869 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:28:53.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:28:53 gibba015 bash[29377]: audit 2021-03-10T14:28:52.710668+0000 mon.c (mon.1) 655 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T14:28:53.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:28:53 gibba015 bash[29377]: audit 2021-03-10T14:28:52.711353+0000 mon.a (mon.0) 870 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:28:53.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:28:53 gibba015 bash[29377]: audit 2021-03-10T14:28:52.711748+0000 mon.c (mon.1) 656 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:28:53.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:28:53 gibba015 bash[29377]: audit 2021-03-10T14:28:52.712311+0000 mon.a (mon.0) 871 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T14:28:53.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:28:53 gibba015 bash[29377]: audit 2021-03-10T14:28:52.712899+0000 mon.c (mon.1) 657 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:28:53.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:28:53 gibba015 bash[29377]: audit 2021-03-10T14:28:52.713380+0000 mon.a (mon.0) 872 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:28:53.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:28:53 gibba015 bash[29377]: audit 2021-03-10T14:28:52.714067+0000 mon.c (mon.1) 658 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:28:53.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:28:53 gibba015 bash[29377]: audit 2021-03-10T14:28:52.714189+0000 mon.a (mon.0) 873 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:28:53.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:28:53 gibba015 bash[29377]: audit 2021-03-10T14:28:52.714702+0000 mon.a (mon.0) 874 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:28:54.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:28:54 gibba015 bash[29377]: cluster 2021-03-10T14:28:54.635206+0000 mgr.gibba045.orlgmj (mgr.34412) 2161 : cluster [DBG] pgmap v1215: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:54.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:28:54 gibba015 bash[30343]: cluster 2021-03-10T14:28:54.635206+0000 mgr.gibba045.orlgmj (mgr.34412) 2161 : cluster [DBG] pgmap v1215: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:55.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:28:54 gibba045 bash[25517]: cluster 2021-03-10T14:28:54.635206+0000 mgr.gibba045.orlgmj (mgr.34412) 2161 : cluster [DBG] pgmap v1215: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:56.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:28:56 gibba015 bash[29377]: cluster 2021-03-10T14:28:56.636964+0000 mgr.gibba045.orlgmj (mgr.34412) 2162 : cluster [DBG] pgmap v1216: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:56.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:28:56 gibba015 bash[30343]: cluster 2021-03-10T14:28:56.636964+0000 mgr.gibba045.orlgmj (mgr.34412) 2162 : cluster [DBG] pgmap v1216: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:57.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:28:56 gibba045 bash[25517]: cluster 2021-03-10T14:28:56.636964+0000 mgr.gibba045.orlgmj (mgr.34412) 2162 : cluster [DBG] pgmap v1216: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:58.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:28:58 gibba015 bash[29377]: cluster 2021-03-10T14:28:58.638014+0000 mgr.gibba045.orlgmj (mgr.34412) 2163 : cluster [DBG] pgmap v1217: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:58.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:28:58 gibba015 bash[30343]: cluster 2021-03-10T14:28:58.638014+0000 mgr.gibba045.orlgmj (mgr.34412) 2163 : cluster [DBG] pgmap v1217: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:59.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:28:58 gibba045 bash[25517]: cluster 2021-03-10T14:28:58.638014+0000 mgr.gibba045.orlgmj (mgr.34412) 2163 : cluster [DBG] pgmap v1217: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:00.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:29:00 gibba015 bash[29377]: cephadm 2021-03-10T14:28:59.765844+0000 mgr.gibba045.orlgmj (mgr.34412) 2164 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:29:00.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:29:00 gibba015 bash[29377]: cluster 2021-03-10T14:29:00.639769+0000 mgr.gibba045.orlgmj (mgr.34412) 2165 : cluster [DBG] pgmap v1218: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:00.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:29:00 gibba015 bash[30343]: cephadm 2021-03-10T14:28:59.765844+0000 mgr.gibba045.orlgmj (mgr.34412) 2164 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:29:00.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:29:00 gibba015 bash[30343]: cluster 2021-03-10T14:29:00.639769+0000 mgr.gibba045.orlgmj (mgr.34412) 2165 : cluster [DBG] pgmap v1218: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:01.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:29:00 gibba045 bash[25517]: cephadm 2021-03-10T14:28:59.765844+0000 mgr.gibba045.orlgmj (mgr.34412) 2164 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:29:01.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:29:00 gibba045 bash[25517]: cluster 2021-03-10T14:29:00.639769+0000 mgr.gibba045.orlgmj (mgr.34412) 2165 : cluster [DBG] pgmap v1218: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:03.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:29:03 gibba045 bash[25517]: cluster 2021-03-10T14:29:02.640638+0000 mgr.gibba045.orlgmj (mgr.34412) 2166 : cluster [DBG] pgmap v1219: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:03.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:29:03 gibba015 bash[29377]: cluster 2021-03-10T14:29:02.640638+0000 mgr.gibba045.orlgmj (mgr.34412) 2166 : cluster [DBG] pgmap v1219: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:03.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:29:03 gibba015 bash[30343]: cluster 2021-03-10T14:29:02.640638+0000 mgr.gibba045.orlgmj (mgr.34412) 2166 : cluster [DBG] pgmap v1219: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:04.588 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:29:04.849 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:29:04.850 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (39m) 5m ago 45m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:29:04.850 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (44m) 4m ago 44m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:29:04.850 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (40m) 4m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:29:04.851 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (40m) 4m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:29:04.851 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (39m) 5m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:29:04.851 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (39m) 5m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:29:04.851 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (38m) 4m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:29:04.851 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (39m) 5m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:29:04.852 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (45m) 5m ago 45m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:29:04.852 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (45m) 4m ago 45m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:29:04.852 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (38m) 5m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:29:04.852 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (37m) 5m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:29:04.853 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (37m) 5m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:29:04.853 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (36m) 5m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:29:04.853 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (36m) 4m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:29:04.853 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (35m) 4m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:29:04.853 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (35m) 4m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:29:04.854 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (35m) 4m ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:29:04.854 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (44m) 4m ago 45m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:29:04.854 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 4m ago 43m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:29:04.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:29:04 gibba015 bash[29377]: audit 2021-03-10T14:29:04.580457+0000 mgr.gibba045.orlgmj (mgr.34412) 2167 : audit [DBG] from='client.45510 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:29:04.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:29:04 gibba015 bash[29377]: cluster 2021-03-10T14:29:04.641860+0000 mgr.gibba045.orlgmj (mgr.34412) 2168 : cluster [DBG] pgmap v1220: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:04.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:29:04 gibba015 bash[30343]: audit 2021-03-10T14:29:04.580457+0000 mgr.gibba045.orlgmj (mgr.34412) 2167 : audit [DBG] from='client.45510 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:29:04.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:29:04 gibba015 bash[30343]: cluster 2021-03-10T14:29:04.641860+0000 mgr.gibba045.orlgmj (mgr.34412) 2168 : cluster [DBG] pgmap v1220: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:05.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:29:04 gibba045 bash[25517]: audit 2021-03-10T14:29:04.580457+0000 mgr.gibba045.orlgmj (mgr.34412) 2167 : audit [DBG] from='client.45510 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:29:05.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:29:04 gibba045 bash[25517]: cluster 2021-03-10T14:29:04.641860+0000 mgr.gibba045.orlgmj (mgr.34412) 2168 : cluster [DBG] pgmap v1220: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:05.102 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:29:05.102 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:29:05.102 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:29:05.102 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:29:05.103 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:29:05.103 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:29:05.103 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:29:05.103 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:29:05.103 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:29:05.104 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:29:05.104 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:29:05.104 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:29:05.104 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:29:05.105 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:29:05.105 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:29:05.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:29:05 gibba015 bash[29377]: audit 2021-03-10T14:29:04.810429+0000 mgr.gibba045.orlgmj (mgr.34412) 2169 : audit [DBG] from='client.45516 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:29:05.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:29:05 gibba015 bash[29377]: audit 2021-03-10T14:29:05.099561+0000 mon.c (mon.1) 659 : audit [DBG] from='client.? 172.21.2.115:0/3891124959' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:29:05.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:29:05 gibba015 bash[30343]: audit 2021-03-10T14:29:04.810429+0000 mgr.gibba045.orlgmj (mgr.34412) 2169 : audit [DBG] from='client.45516 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:29:05.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:29:05 gibba015 bash[30343]: audit 2021-03-10T14:29:05.099561+0000 mon.c (mon.1) 659 : audit [DBG] from='client.? 172.21.2.115:0/3891124959' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:29:06.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:29:05 gibba045 bash[25517]: audit 2021-03-10T14:29:04.810429+0000 mgr.gibba045.orlgmj (mgr.34412) 2169 : audit [DBG] from='client.45516 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:29:06.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:29:05 gibba045 bash[25517]: audit 2021-03-10T14:29:05.099561+0000 mon.c (mon.1) 659 : audit [DBG] from='client.? 172.21.2.115:0/3891124959' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:29:07.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:29:06 gibba045 bash[25517]: cluster 2021-03-10T14:29:06.643699+0000 mgr.gibba045.orlgmj (mgr.34412) 2170 : cluster [DBG] pgmap v1221: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:07.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:29:06 gibba015 bash[29377]: cluster 2021-03-10T14:29:06.643699+0000 mgr.gibba045.orlgmj (mgr.34412) 2170 : cluster [DBG] pgmap v1221: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:07.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:29:06 gibba015 bash[30343]: cluster 2021-03-10T14:29:06.643699+0000 mgr.gibba045.orlgmj (mgr.34412) 2170 : cluster [DBG] pgmap v1221: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:08.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:29:08 gibba015 bash[29377]: cluster 2021-03-10T14:29:08.645110+0000 mgr.gibba045.orlgmj (mgr.34412) 2171 : cluster [DBG] pgmap v1222: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:08.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:29:08 gibba015 bash[30343]: cluster 2021-03-10T14:29:08.645110+0000 mgr.gibba045.orlgmj (mgr.34412) 2171 : cluster [DBG] pgmap v1222: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:09.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:29:08 gibba045 bash[25517]: cluster 2021-03-10T14:29:08.645110+0000 mgr.gibba045.orlgmj (mgr.34412) 2171 : cluster [DBG] pgmap v1222: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:10.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:29:10 gibba015 bash[29377]: cluster 2021-03-10T14:29:10.645913+0000 mgr.gibba045.orlgmj (mgr.34412) 2172 : cluster [DBG] pgmap v1223: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:10.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:29:10 gibba015 bash[30343]: cluster 2021-03-10T14:29:10.645913+0000 mgr.gibba045.orlgmj (mgr.34412) 2172 : cluster [DBG] pgmap v1223: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:11.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:29:10 gibba045 bash[25517]: cluster 2021-03-10T14:29:10.645913+0000 mgr.gibba045.orlgmj (mgr.34412) 2172 : cluster [DBG] pgmap v1223: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:13.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:29:13 gibba045 bash[25517]: cluster 2021-03-10T14:29:12.647550+0000 mgr.gibba045.orlgmj (mgr.34412) 2173 : cluster [DBG] pgmap v1224: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:13.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:29:13 gibba015 bash[29377]: cluster 2021-03-10T14:29:12.647550+0000 mgr.gibba045.orlgmj (mgr.34412) 2173 : cluster [DBG] pgmap v1224: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:13.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:29:13 gibba015 bash[30343]: cluster 2021-03-10T14:29:12.647550+0000 mgr.gibba045.orlgmj (mgr.34412) 2173 : cluster [DBG] pgmap v1224: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:14.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:29:14 gibba015 bash[29377]: cluster 2021-03-10T14:29:14.648346+0000 mgr.gibba045.orlgmj (mgr.34412) 2174 : cluster [DBG] pgmap v1225: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:14.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:29:14 gibba015 bash[30343]: cluster 2021-03-10T14:29:14.648346+0000 mgr.gibba045.orlgmj (mgr.34412) 2174 : cluster [DBG] pgmap v1225: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:15.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:29:14 gibba045 bash[25517]: cluster 2021-03-10T14:29:14.648346+0000 mgr.gibba045.orlgmj (mgr.34412) 2174 : cluster [DBG] pgmap v1225: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:16.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:29:15 gibba045 bash[25517]: cephadm 2021-03-10T14:29:14.777062+0000 mgr.gibba045.orlgmj (mgr.34412) 2175 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:29:16.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:29:15 gibba015 bash[29377]: cephadm 2021-03-10T14:29:14.777062+0000 mgr.gibba045.orlgmj (mgr.34412) 2175 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:29:16.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:29:15 gibba015 bash[30343]: cephadm 2021-03-10T14:29:14.777062+0000 mgr.gibba045.orlgmj (mgr.34412) 2175 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:29:17.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:29:16 gibba045 bash[25517]: cluster 2021-03-10T14:29:16.649848+0000 mgr.gibba045.orlgmj (mgr.34412) 2176 : cluster [DBG] pgmap v1226: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:17.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:29:16 gibba015 bash[29377]: cluster 2021-03-10T14:29:16.649848+0000 mgr.gibba045.orlgmj (mgr.34412) 2176 : cluster [DBG] pgmap v1226: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:17.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:29:16 gibba015 bash[30343]: cluster 2021-03-10T14:29:16.649848+0000 mgr.gibba045.orlgmj (mgr.34412) 2176 : cluster [DBG] pgmap v1226: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:19.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:29:18 gibba045 bash[25517]: cluster 2021-03-10T14:29:18.650450+0000 mgr.gibba045.orlgmj (mgr.34412) 2177 : cluster [DBG] pgmap v1227: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:19.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:29:18 gibba015 bash[29377]: cluster 2021-03-10T14:29:18.650450+0000 mgr.gibba045.orlgmj (mgr.34412) 2177 : cluster [DBG] pgmap v1227: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:19.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:29:18 gibba015 bash[30343]: cluster 2021-03-10T14:29:18.650450+0000 mgr.gibba045.orlgmj (mgr.34412) 2177 : cluster [DBG] pgmap v1227: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:21.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:29:20 gibba045 bash[25517]: cluster 2021-03-10T14:29:20.651857+0000 mgr.gibba045.orlgmj (mgr.34412) 2178 : cluster [DBG] pgmap v1228: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:21.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:29:20 gibba015 bash[29377]: cluster 2021-03-10T14:29:20.651857+0000 mgr.gibba045.orlgmj (mgr.34412) 2178 : cluster [DBG] pgmap v1228: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:21.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:29:20 gibba015 bash[30343]: cluster 2021-03-10T14:29:20.651857+0000 mgr.gibba045.orlgmj (mgr.34412) 2178 : cluster [DBG] pgmap v1228: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:23.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:29:23 gibba045 bash[25517]: cluster 2021-03-10T14:29:22.653661+0000 mgr.gibba045.orlgmj (mgr.34412) 2179 : cluster [DBG] pgmap v1229: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:23.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:29:23 gibba015 bash[29377]: cluster 2021-03-10T14:29:22.653661+0000 mgr.gibba045.orlgmj (mgr.34412) 2179 : cluster [DBG] pgmap v1229: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:23.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:29:23 gibba015 bash[30343]: cluster 2021-03-10T14:29:22.653661+0000 mgr.gibba045.orlgmj (mgr.34412) 2179 : cluster [DBG] pgmap v1229: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:25.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:29:24 gibba045 bash[25517]: cluster 2021-03-10T14:29:24.654443+0000 mgr.gibba045.orlgmj (mgr.34412) 2180 : cluster [DBG] pgmap v1230: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:25.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:29:24 gibba015 bash[29377]: cluster 2021-03-10T14:29:24.654443+0000 mgr.gibba045.orlgmj (mgr.34412) 2180 : cluster [DBG] pgmap v1230: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:25.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:29:24 gibba015 bash[30343]: cluster 2021-03-10T14:29:24.654443+0000 mgr.gibba045.orlgmj (mgr.34412) 2180 : cluster [DBG] pgmap v1230: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:27.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:29:26 gibba045 bash[25517]: cluster 2021-03-10T14:29:26.655209+0000 mgr.gibba045.orlgmj (mgr.34412) 2181 : cluster [DBG] pgmap v1231: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:27.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:29:26 gibba015 bash[29377]: cluster 2021-03-10T14:29:26.655209+0000 mgr.gibba045.orlgmj (mgr.34412) 2181 : cluster [DBG] pgmap v1231: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:27.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:29:26 gibba015 bash[30343]: cluster 2021-03-10T14:29:26.655209+0000 mgr.gibba045.orlgmj (mgr.34412) 2181 : cluster [DBG] pgmap v1231: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:29.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:29:28 gibba045 bash[25517]: cluster 2021-03-10T14:29:28.656313+0000 mgr.gibba045.orlgmj (mgr.34412) 2182 : cluster [DBG] pgmap v1232: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:29.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:29:28 gibba015 bash[29377]: cluster 2021-03-10T14:29:28.656313+0000 mgr.gibba045.orlgmj (mgr.34412) 2182 : cluster [DBG] pgmap v1232: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:29.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:29:28 gibba015 bash[30343]: cluster 2021-03-10T14:29:28.656313+0000 mgr.gibba045.orlgmj (mgr.34412) 2182 : cluster [DBG] pgmap v1232: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:31.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:29:30 gibba045 bash[25517]: cephadm 2021-03-10T14:29:29.792942+0000 mgr.gibba045.orlgmj (mgr.34412) 2183 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:29:31.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:29:30 gibba045 bash[25517]: cluster 2021-03-10T14:29:30.657864+0000 mgr.gibba045.orlgmj (mgr.34412) 2184 : cluster [DBG] pgmap v1233: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:31.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:29:30 gibba015 bash[29377]: cephadm 2021-03-10T14:29:29.792942+0000 mgr.gibba045.orlgmj (mgr.34412) 2183 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:29:31.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:29:30 gibba015 bash[29377]: cluster 2021-03-10T14:29:30.657864+0000 mgr.gibba045.orlgmj (mgr.34412) 2184 : cluster [DBG] pgmap v1233: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:31.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:29:30 gibba015 bash[30343]: cephadm 2021-03-10T14:29:29.792942+0000 mgr.gibba045.orlgmj (mgr.34412) 2183 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:29:31.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:29:30 gibba015 bash[30343]: cluster 2021-03-10T14:29:30.657864+0000 mgr.gibba045.orlgmj (mgr.34412) 2184 : cluster [DBG] pgmap v1233: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:33.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:29:33 gibba045 bash[25517]: cluster 2021-03-10T14:29:32.659475+0000 mgr.gibba045.orlgmj (mgr.34412) 2185 : cluster [DBG] pgmap v1234: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:33.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:29:33 gibba015 bash[29377]: cluster 2021-03-10T14:29:32.659475+0000 mgr.gibba045.orlgmj (mgr.34412) 2185 : cluster [DBG] pgmap v1234: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:33.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:29:33 gibba015 bash[30343]: cluster 2021-03-10T14:29:32.659475+0000 mgr.gibba045.orlgmj (mgr.34412) 2185 : cluster [DBG] pgmap v1234: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:35.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:29:34 gibba045 bash[25517]: cluster 2021-03-10T14:29:34.661048+0000 mgr.gibba045.orlgmj (mgr.34412) 2186 : cluster [DBG] pgmap v1235: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:35.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:29:34 gibba015 bash[29377]: cluster 2021-03-10T14:29:34.661048+0000 mgr.gibba045.orlgmj (mgr.34412) 2186 : cluster [DBG] pgmap v1235: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:35.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:29:34 gibba015 bash[30343]: cluster 2021-03-10T14:29:34.661048+0000 mgr.gibba045.orlgmj (mgr.34412) 2186 : cluster [DBG] pgmap v1235: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:35.345 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:29:35.574 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:29:35.575 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (40m) 5m ago 45m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:29:35.575 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (45m) 4m ago 45m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:29:35.575 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (40m) 4m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:29:35.575 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (41m) 4m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:29:35.576 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (39m) 5m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:29:35.576 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (39m) 5m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:29:35.576 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (39m) 4m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:29:35.576 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (39m) 5m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:29:35.576 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (45m) 5m ago 45m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:29:35.577 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (45m) 4m ago 45m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:29:35.577 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (38m) 5m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:29:35.577 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (38m) 5m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:29:35.577 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (37m) 5m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:29:35.578 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (37m) 5m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:29:35.578 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (36m) 4m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:29:35.578 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (36m) 4m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:29:35.578 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (36m) 4m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:29:35.578 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (35m) 4m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:29:35.579 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (45m) 4m ago 45m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:29:35.579 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 4m ago 43m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:29:35.827 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:29:35.828 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:29:35.828 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:29:35.828 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:29:35.828 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:29:35.829 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:29:35.829 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:29:35.829 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:29:35.829 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:29:35.830 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:29:35.830 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:29:35.830 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:29:35.830 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:29:35.830 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:29:35.831 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:29:36.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:29:35 gibba045 bash[25517]: audit 2021-03-10T14:29:35.337513+0000 mgr.gibba045.orlgmj (mgr.34412) 2187 : audit [DBG] from='client.55516 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:29:36.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:29:35 gibba045 bash[25517]: audit 2021-03-10T14:29:35.563075+0000 mgr.gibba045.orlgmj (mgr.34412) 2188 : audit [DBG] from='client.45534 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:29:36.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:29:35 gibba015 bash[29377]: audit 2021-03-10T14:29:35.337513+0000 mgr.gibba045.orlgmj (mgr.34412) 2187 : audit [DBG] from='client.55516 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:29:36.311 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:29:35 gibba015 bash[29377]: audit 2021-03-10T14:29:35.563075+0000 mgr.gibba045.orlgmj (mgr.34412) 2188 : audit [DBG] from='client.45534 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:29:36.312 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:29:35 gibba015 bash[30343]: audit 2021-03-10T14:29:35.337513+0000 mgr.gibba045.orlgmj (mgr.34412) 2187 : audit [DBG] from='client.55516 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:29:36.312 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:29:35 gibba015 bash[30343]: audit 2021-03-10T14:29:35.563075+0000 mgr.gibba045.orlgmj (mgr.34412) 2188 : audit [DBG] from='client.45534 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:29:37.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:29:36 gibba045 bash[25517]: audit 2021-03-10T14:29:35.825379+0000 mon.a (mon.0) 875 : audit [DBG] from='client.? 172.21.2.115:0/2076278781' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:29:37.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:29:36 gibba045 bash[25517]: cluster 2021-03-10T14:29:36.662873+0000 mgr.gibba045.orlgmj (mgr.34412) 2189 : cluster [DBG] pgmap v1236: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:37.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:29:36 gibba015 bash[29377]: audit 2021-03-10T14:29:35.825379+0000 mon.a (mon.0) 875 : audit [DBG] from='client.? 172.21.2.115:0/2076278781' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:29:37.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:29:36 gibba015 bash[29377]: cluster 2021-03-10T14:29:36.662873+0000 mgr.gibba045.orlgmj (mgr.34412) 2189 : cluster [DBG] pgmap v1236: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:37.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:29:36 gibba015 bash[30343]: audit 2021-03-10T14:29:35.825379+0000 mon.a (mon.0) 875 : audit [DBG] from='client.? 172.21.2.115:0/2076278781' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:29:37.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:29:36 gibba015 bash[30343]: cluster 2021-03-10T14:29:36.662873+0000 mgr.gibba045.orlgmj (mgr.34412) 2189 : cluster [DBG] pgmap v1236: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:39.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:29:38 gibba045 bash[25517]: cluster 2021-03-10T14:29:38.664156+0000 mgr.gibba045.orlgmj (mgr.34412) 2190 : cluster [DBG] pgmap v1237: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:39.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:29:38 gibba015 bash[29377]: cluster 2021-03-10T14:29:38.664156+0000 mgr.gibba045.orlgmj (mgr.34412) 2190 : cluster [DBG] pgmap v1237: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:39.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:29:38 gibba015 bash[30343]: cluster 2021-03-10T14:29:38.664156+0000 mgr.gibba045.orlgmj (mgr.34412) 2190 : cluster [DBG] pgmap v1237: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:41.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:29:40 gibba045 bash[25517]: cluster 2021-03-10T14:29:40.665575+0000 mgr.gibba045.orlgmj (mgr.34412) 2191 : cluster [DBG] pgmap v1238: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:41.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:29:40 gibba015 bash[30343]: cluster 2021-03-10T14:29:40.665575+0000 mgr.gibba045.orlgmj (mgr.34412) 2191 : cluster [DBG] pgmap v1238: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:41.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:29:40 gibba015 bash[29377]: cluster 2021-03-10T14:29:40.665575+0000 mgr.gibba045.orlgmj (mgr.34412) 2191 : cluster [DBG] pgmap v1238: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:43.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:29:43 gibba045 bash[25517]: cluster 2021-03-10T14:29:42.666447+0000 mgr.gibba045.orlgmj (mgr.34412) 2192 : cluster [DBG] pgmap v1239: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:43.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:29:43 gibba015 bash[29377]: cluster 2021-03-10T14:29:42.666447+0000 mgr.gibba045.orlgmj (mgr.34412) 2192 : cluster [DBG] pgmap v1239: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:43.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:29:43 gibba015 bash[30343]: cluster 2021-03-10T14:29:42.666447+0000 mgr.gibba045.orlgmj (mgr.34412) 2192 : cluster [DBG] pgmap v1239: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:45.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:29:44 gibba045 bash[25517]: cluster 2021-03-10T14:29:44.667716+0000 mgr.gibba045.orlgmj (mgr.34412) 2193 : cluster [DBG] pgmap v1240: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:45.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:29:44 gibba015 bash[29377]: cluster 2021-03-10T14:29:44.667716+0000 mgr.gibba045.orlgmj (mgr.34412) 2193 : cluster [DBG] pgmap v1240: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:45.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:29:44 gibba015 bash[30343]: cluster 2021-03-10T14:29:44.667716+0000 mgr.gibba045.orlgmj (mgr.34412) 2193 : cluster [DBG] pgmap v1240: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:46.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:29:45 gibba045 bash[25517]: audit 2021-03-10T14:29:44.805755+0000 mon.c (mon.1) 660 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:29:46.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:29:45 gibba045 bash[25517]: cephadm 2021-03-10T14:29:44.813906+0000 mgr.gibba045.orlgmj (mgr.34412) 2194 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:29:46.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:29:45 gibba045 bash[25517]: cephadm 2021-03-10T14:29:44.815017+0000 mgr.gibba045.orlgmj (mgr.34412) 2195 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:29:46.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:29:45 gibba045 bash[25517]: audit 2021-03-10T14:29:45.097962+0000 mon.a (mon.0) 876 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:29:46.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:29:45 gibba045 bash[25517]: audit 2021-03-10T14:29:45.102856+0000 mon.c (mon.1) 661 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:29:46.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:29:45 gibba045 bash[25517]: audit 2021-03-10T14:29:45.104448+0000 mon.c (mon.1) 662 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:29:46.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:29:45 gibba045 bash[25517]: cephadm 2021-03-10T14:29:45.105354+0000 mgr.gibba045.orlgmj (mgr.34412) 2196 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:29:46.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:29:45 gibba045 bash[25517]: audit 2021-03-10T14:29:45.105954+0000 mon.c (mon.1) 663 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:29:46.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:29:45 gibba045 bash[25517]: audit 2021-03-10T14:29:45.107476+0000 mon.c (mon.1) 664 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:29:46.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:29:45 gibba045 bash[25517]: cephadm 2021-03-10T14:29:45.107541+0000 mgr.gibba045.orlgmj (mgr.34412) 2197 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:29:46.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:29:45 gibba045 bash[25517]: cephadm 2021-03-10T14:29:45.108966+0000 mgr.gibba045.orlgmj (mgr.34412) 2198 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:29:46.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:29:45 gibba045 bash[25517]: cephadm 2021-03-10T14:29:45.109059+0000 mgr.gibba045.orlgmj (mgr.34412) 2199 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:29:46.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:29:45 gibba045 bash[25517]: cephadm 2021-03-10T14:29:45.110484+0000 mgr.gibba045.orlgmj (mgr.34412) 2200 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:29:46.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:29:45 gibba045 bash[25517]: cephadm 2021-03-10T14:29:45.110581+0000 mgr.gibba045.orlgmj (mgr.34412) 2201 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:29:46.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:29:45 gibba045 bash[25517]: audit 2021-03-10T14:29:45.111357+0000 mon.c (mon.1) 665 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:29:46.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:29:45 gibba045 bash[25517]: cephadm 2021-03-10T14:29:45.112169+0000 mgr.gibba045.orlgmj (mgr.34412) 2202 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:29:46.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:29:45 gibba045 bash[25517]: audit 2021-03-10T14:29:45.113714+0000 mon.c (mon.1) 666 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:29:46.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:29:45 gibba045 bash[25517]: cephadm 2021-03-10T14:29:45.114079+0000 mgr.gibba045.orlgmj (mgr.34412) 2203 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:29:46.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:29:45 gibba045 bash[25517]: cephadm 2021-03-10T14:29:45.114181+0000 mgr.gibba045.orlgmj (mgr.34412) 2204 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:29:46.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:29:45 gibba045 bash[25517]: cephadm 2021-03-10T14:29:45.116091+0000 mgr.gibba045.orlgmj (mgr.34412) 2205 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:29:46.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:29:45 gibba045 bash[25517]: cephadm 2021-03-10T14:29:45.116815+0000 mgr.gibba045.orlgmj (mgr.34412) 2206 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:29:46.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:29:45 gibba045 bash[25517]: cephadm 2021-03-10T14:29:45.118420+0000 mgr.gibba045.orlgmj (mgr.34412) 2207 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:29:46.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:29:45 gibba045 bash[25517]: cephadm 2021-03-10T14:29:45.118605+0000 mgr.gibba045.orlgmj (mgr.34412) 2208 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:29:46.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:29:45 gibba045 bash[25517]: cephadm 2021-03-10T14:29:45.118806+0000 mgr.gibba045.orlgmj (mgr.34412) 2209 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:29:46.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:29:45 gibba015 bash[29377]: audit 2021-03-10T14:29:44.805755+0000 mon.c (mon.1) 660 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:29:46.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:29:45 gibba015 bash[29377]: cephadm 2021-03-10T14:29:44.813906+0000 mgr.gibba045.orlgmj (mgr.34412) 2194 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:29:46.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:29:45 gibba015 bash[29377]: cephadm 2021-03-10T14:29:44.815017+0000 mgr.gibba045.orlgmj (mgr.34412) 2195 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:29:46.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:29:45 gibba015 bash[29377]: audit 2021-03-10T14:29:45.097962+0000 mon.a (mon.0) 876 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:29:46.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:29:45 gibba015 bash[29377]: audit 2021-03-10T14:29:45.102856+0000 mon.c (mon.1) 661 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:29:46.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:29:45 gibba015 bash[29377]: audit 2021-03-10T14:29:45.104448+0000 mon.c (mon.1) 662 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:29:46.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:29:45 gibba015 bash[29377]: cephadm 2021-03-10T14:29:45.105354+0000 mgr.gibba045.orlgmj (mgr.34412) 2196 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:29:46.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:29:45 gibba015 bash[29377]: audit 2021-03-10T14:29:45.105954+0000 mon.c (mon.1) 663 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:29:46.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:29:45 gibba015 bash[29377]: audit 2021-03-10T14:29:45.107476+0000 mon.c (mon.1) 664 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:29:46.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:29:45 gibba015 bash[29377]: cephadm 2021-03-10T14:29:45.107541+0000 mgr.gibba045.orlgmj (mgr.34412) 2197 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:29:46.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:29:45 gibba015 bash[29377]: cephadm 2021-03-10T14:29:45.108966+0000 mgr.gibba045.orlgmj (mgr.34412) 2198 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:29:46.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:29:45 gibba015 bash[29377]: cephadm 2021-03-10T14:29:45.109059+0000 mgr.gibba045.orlgmj (mgr.34412) 2199 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:29:46.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:29:45 gibba015 bash[29377]: cephadm 2021-03-10T14:29:45.110484+0000 mgr.gibba045.orlgmj (mgr.34412) 2200 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:29:46.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:29:45 gibba015 bash[29377]: cephadm 2021-03-10T14:29:45.110581+0000 mgr.gibba045.orlgmj (mgr.34412) 2201 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:29:46.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:29:45 gibba015 bash[29377]: audit 2021-03-10T14:29:45.111357+0000 mon.c (mon.1) 665 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:29:46.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:29:45 gibba015 bash[29377]: cephadm 2021-03-10T14:29:45.112169+0000 mgr.gibba045.orlgmj (mgr.34412) 2202 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:29:46.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:29:45 gibba015 bash[29377]: audit 2021-03-10T14:29:45.113714+0000 mon.c (mon.1) 666 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:29:46.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:29:45 gibba015 bash[29377]: cephadm 2021-03-10T14:29:45.114079+0000 mgr.gibba045.orlgmj (mgr.34412) 2203 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:29:46.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:29:45 gibba015 bash[29377]: cephadm 2021-03-10T14:29:45.114181+0000 mgr.gibba045.orlgmj (mgr.34412) 2204 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:29:46.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:29:45 gibba015 bash[29377]: cephadm 2021-03-10T14:29:45.116091+0000 mgr.gibba045.orlgmj (mgr.34412) 2205 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:29:46.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:29:45 gibba015 bash[30343]: audit 2021-03-10T14:29:44.805755+0000 mon.c (mon.1) 660 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:29:46.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:29:45 gibba015 bash[30343]: cephadm 2021-03-10T14:29:44.813906+0000 mgr.gibba045.orlgmj (mgr.34412) 2194 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:29:46.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:29:45 gibba015 bash[30343]: cephadm 2021-03-10T14:29:44.815017+0000 mgr.gibba045.orlgmj (mgr.34412) 2195 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:29:46.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:29:45 gibba015 bash[30343]: audit 2021-03-10T14:29:45.097962+0000 mon.a (mon.0) 876 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:29:46.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:29:45 gibba015 bash[30343]: audit 2021-03-10T14:29:45.102856+0000 mon.c (mon.1) 661 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:29:46.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:29:45 gibba015 bash[30343]: audit 2021-03-10T14:29:45.104448+0000 mon.c (mon.1) 662 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:29:46.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:29:45 gibba015 bash[30343]: cephadm 2021-03-10T14:29:45.105354+0000 mgr.gibba045.orlgmj (mgr.34412) 2196 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:29:46.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:29:45 gibba015 bash[30343]: audit 2021-03-10T14:29:45.105954+0000 mon.c (mon.1) 663 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:29:46.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:29:45 gibba015 bash[30343]: audit 2021-03-10T14:29:45.107476+0000 mon.c (mon.1) 664 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:29:46.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:29:45 gibba015 bash[30343]: cephadm 2021-03-10T14:29:45.107541+0000 mgr.gibba045.orlgmj (mgr.34412) 2197 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:29:46.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:29:45 gibba015 bash[30343]: cephadm 2021-03-10T14:29:45.108966+0000 mgr.gibba045.orlgmj (mgr.34412) 2198 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:29:46.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:29:45 gibba015 bash[30343]: cephadm 2021-03-10T14:29:45.109059+0000 mgr.gibba045.orlgmj (mgr.34412) 2199 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:29:46.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:29:45 gibba015 bash[30343]: cephadm 2021-03-10T14:29:45.110484+0000 mgr.gibba045.orlgmj (mgr.34412) 2200 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:29:46.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:29:45 gibba015 bash[30343]: cephadm 2021-03-10T14:29:45.110581+0000 mgr.gibba045.orlgmj (mgr.34412) 2201 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:29:46.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:29:45 gibba015 bash[30343]: audit 2021-03-10T14:29:45.111357+0000 mon.c (mon.1) 665 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:29:46.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:29:45 gibba015 bash[30343]: cephadm 2021-03-10T14:29:45.112169+0000 mgr.gibba045.orlgmj (mgr.34412) 2202 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:29:46.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:29:45 gibba015 bash[30343]: audit 2021-03-10T14:29:45.113714+0000 mon.c (mon.1) 666 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:29:46.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:29:45 gibba015 bash[30343]: cephadm 2021-03-10T14:29:45.114079+0000 mgr.gibba045.orlgmj (mgr.34412) 2203 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:29:46.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:29:45 gibba015 bash[30343]: cephadm 2021-03-10T14:29:45.114181+0000 mgr.gibba045.orlgmj (mgr.34412) 2204 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:29:46.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:29:45 gibba015 bash[30343]: cephadm 2021-03-10T14:29:45.116091+0000 mgr.gibba045.orlgmj (mgr.34412) 2205 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:29:46.234 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:29:45 gibba015 bash[29377]: cephadm 2021-03-10T14:29:45.116815+0000 mgr.gibba045.orlgmj (mgr.34412) 2206 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:29:46.234 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:29:45 gibba015 bash[29377]: cephadm 2021-03-10T14:29:45.118420+0000 mgr.gibba045.orlgmj (mgr.34412) 2207 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:29:46.234 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:29:45 gibba015 bash[29377]: cephadm 2021-03-10T14:29:45.118605+0000 mgr.gibba045.orlgmj (mgr.34412) 2208 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:29:46.235 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:29:45 gibba015 bash[29377]: cephadm 2021-03-10T14:29:45.118806+0000 mgr.gibba045.orlgmj (mgr.34412) 2209 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:29:46.235 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:29:45 gibba015 bash[30343]: cephadm 2021-03-10T14:29:45.116815+0000 mgr.gibba045.orlgmj (mgr.34412) 2206 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:29:46.235 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:29:45 gibba015 bash[30343]: cephadm 2021-03-10T14:29:45.118420+0000 mgr.gibba045.orlgmj (mgr.34412) 2207 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:29:46.236 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:29:45 gibba015 bash[30343]: cephadm 2021-03-10T14:29:45.118605+0000 mgr.gibba045.orlgmj (mgr.34412) 2208 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:29:46.236 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:29:45 gibba015 bash[30343]: cephadm 2021-03-10T14:29:45.118806+0000 mgr.gibba045.orlgmj (mgr.34412) 2209 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:29:47.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:29:46 gibba045 bash[25517]: cluster 2021-03-10T14:29:46.669713+0000 mgr.gibba045.orlgmj (mgr.34412) 2210 : cluster [DBG] pgmap v1241: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:47.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:29:46 gibba015 bash[29377]: cluster 2021-03-10T14:29:46.669713+0000 mgr.gibba045.orlgmj (mgr.34412) 2210 : cluster [DBG] pgmap v1241: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:47.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:29:46 gibba015 bash[30343]: cluster 2021-03-10T14:29:46.669713+0000 mgr.gibba045.orlgmj (mgr.34412) 2210 : cluster [DBG] pgmap v1241: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:49.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:29:48 gibba045 bash[25517]: cluster 2021-03-10T14:29:48.670988+0000 mgr.gibba045.orlgmj (mgr.34412) 2211 : cluster [DBG] pgmap v1242: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:49.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:29:48 gibba015 bash[29377]: cluster 2021-03-10T14:29:48.670988+0000 mgr.gibba045.orlgmj (mgr.34412) 2211 : cluster [DBG] pgmap v1242: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:49.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:29:48 gibba015 bash[30343]: cluster 2021-03-10T14:29:48.670988+0000 mgr.gibba045.orlgmj (mgr.34412) 2211 : cluster [DBG] pgmap v1242: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:51.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:29:50 gibba045 bash[25517]: cluster 2021-03-10T14:29:50.672043+0000 mgr.gibba045.orlgmj (mgr.34412) 2212 : cluster [DBG] pgmap v1243: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:51.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:29:50 gibba015 bash[29377]: cluster 2021-03-10T14:29:50.672043+0000 mgr.gibba045.orlgmj (mgr.34412) 2212 : cluster [DBG] pgmap v1243: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:51.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:29:50 gibba015 bash[30343]: cluster 2021-03-10T14:29:50.672043+0000 mgr.gibba045.orlgmj (mgr.34412) 2212 : cluster [DBG] pgmap v1243: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:53.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:29:53 gibba045 bash[25517]: cluster 2021-03-10T14:29:52.673444+0000 mgr.gibba045.orlgmj (mgr.34412) 2213 : cluster [DBG] pgmap v1244: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:29:53 gibba045 bash[25517]: audit 2021-03-10T14:29:52.714639+0000 mon.c (mon.1) 667 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:29:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:29:53 gibba045 bash[25517]: audit 2021-03-10T14:29:52.715429+0000 mon.c (mon.1) 668 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:29:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:29:53 gibba045 bash[25517]: audit 2021-03-10T14:29:52.715710+0000 mon.a (mon.0) 877 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:29:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:29:53 gibba045 bash[25517]: audit 2021-03-10T14:29:52.716751+0000 mon.a (mon.0) 878 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:29:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:29:53 gibba045 bash[25517]: audit 2021-03-10T14:29:52.716975+0000 mon.c (mon.1) 669 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T14:29:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:29:53 gibba045 bash[25517]: audit 2021-03-10T14:29:52.718262+0000 mon.a (mon.0) 879 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T14:29:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:29:53 gibba045 bash[25517]: audit 2021-03-10T14:29:52.718275+0000 mon.c (mon.1) 670 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:29:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:29:53 gibba045 bash[25517]: audit 2021-03-10T14:29:52.719165+0000 mon.c (mon.1) 671 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:29:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:29:53 gibba045 bash[25517]: audit 2021-03-10T14:29:52.719508+0000 mon.a (mon.0) 880 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:29:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:29:53 gibba045 bash[25517]: audit 2021-03-10T14:29:52.719803+0000 mon.c (mon.1) 672 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:29:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:29:53 gibba045 bash[25517]: audit 2021-03-10T14:29:52.719815+0000 mon.a (mon.0) 881 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:29:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:29:53 gibba045 bash[25517]: audit 2021-03-10T14:29:52.720149+0000 mon.a (mon.0) 882 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:29:53.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:29:53 gibba015 bash[29377]: cluster 2021-03-10T14:29:52.673444+0000 mgr.gibba045.orlgmj (mgr.34412) 2213 : cluster [DBG] pgmap v1244: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:53.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:29:53 gibba015 bash[29377]: audit 2021-03-10T14:29:52.714639+0000 mon.c (mon.1) 667 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:29:53.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:29:53 gibba015 bash[29377]: audit 2021-03-10T14:29:52.715429+0000 mon.c (mon.1) 668 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:29:53.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:29:53 gibba015 bash[29377]: audit 2021-03-10T14:29:52.715710+0000 mon.a (mon.0) 877 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:29:53.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:29:53 gibba015 bash[29377]: audit 2021-03-10T14:29:52.716751+0000 mon.a (mon.0) 878 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:29:53.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:29:53 gibba015 bash[29377]: audit 2021-03-10T14:29:52.716975+0000 mon.c (mon.1) 669 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T14:29:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:29:53 gibba015 bash[29377]: audit 2021-03-10T14:29:52.718262+0000 mon.a (mon.0) 879 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T14:29:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:29:53 gibba015 bash[29377]: audit 2021-03-10T14:29:52.718275+0000 mon.c (mon.1) 670 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:29:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:29:53 gibba015 bash[29377]: audit 2021-03-10T14:29:52.719165+0000 mon.c (mon.1) 671 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:29:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:29:53 gibba015 bash[29377]: audit 2021-03-10T14:29:52.719508+0000 mon.a (mon.0) 880 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:29:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:29:53 gibba015 bash[29377]: audit 2021-03-10T14:29:52.719803+0000 mon.c (mon.1) 672 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:29:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:29:53 gibba015 bash[29377]: audit 2021-03-10T14:29:52.719815+0000 mon.a (mon.0) 881 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:29:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:29:53 gibba015 bash[29377]: audit 2021-03-10T14:29:52.720149+0000 mon.a (mon.0) 882 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:29:53.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:29:53 gibba015 bash[30343]: cluster 2021-03-10T14:29:52.673444+0000 mgr.gibba045.orlgmj (mgr.34412) 2213 : cluster [DBG] pgmap v1244: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:53.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:29:53 gibba015 bash[30343]: audit 2021-03-10T14:29:52.714639+0000 mon.c (mon.1) 667 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:29:53.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:29:53 gibba015 bash[30343]: audit 2021-03-10T14:29:52.715429+0000 mon.c (mon.1) 668 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:29:53.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:29:53 gibba015 bash[30343]: audit 2021-03-10T14:29:52.715710+0000 mon.a (mon.0) 877 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:29:53.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:29:53 gibba015 bash[30343]: audit 2021-03-10T14:29:52.716751+0000 mon.a (mon.0) 878 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:29:53.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:29:53 gibba015 bash[30343]: audit 2021-03-10T14:29:52.716975+0000 mon.c (mon.1) 669 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T14:29:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:29:53 gibba015 bash[30343]: audit 2021-03-10T14:29:52.718262+0000 mon.a (mon.0) 879 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T14:29:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:29:53 gibba015 bash[30343]: audit 2021-03-10T14:29:52.718275+0000 mon.c (mon.1) 670 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:29:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:29:53 gibba015 bash[30343]: audit 2021-03-10T14:29:52.719165+0000 mon.c (mon.1) 671 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:29:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:29:53 gibba015 bash[30343]: audit 2021-03-10T14:29:52.719508+0000 mon.a (mon.0) 880 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:29:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:29:53 gibba015 bash[30343]: audit 2021-03-10T14:29:52.719803+0000 mon.c (mon.1) 672 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:29:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:29:53 gibba015 bash[30343]: audit 2021-03-10T14:29:52.719815+0000 mon.a (mon.0) 881 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:29:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:29:53 gibba015 bash[30343]: audit 2021-03-10T14:29:52.720149+0000 mon.a (mon.0) 882 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:29:55.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:29:54 gibba045 bash[25517]: cluster 2021-03-10T14:29:54.674284+0000 mgr.gibba045.orlgmj (mgr.34412) 2214 : cluster [DBG] pgmap v1245: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:55.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:29:54 gibba015 bash[29377]: cluster 2021-03-10T14:29:54.674284+0000 mgr.gibba045.orlgmj (mgr.34412) 2214 : cluster [DBG] pgmap v1245: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:55.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:29:54 gibba015 bash[30343]: cluster 2021-03-10T14:29:54.674284+0000 mgr.gibba045.orlgmj (mgr.34412) 2214 : cluster [DBG] pgmap v1245: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:57.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:29:56 gibba045 bash[25517]: cluster 2021-03-10T14:29:56.676032+0000 mgr.gibba045.orlgmj (mgr.34412) 2215 : cluster [DBG] pgmap v1246: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:57.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:29:56 gibba015 bash[29377]: cluster 2021-03-10T14:29:56.676032+0000 mgr.gibba045.orlgmj (mgr.34412) 2215 : cluster [DBG] pgmap v1246: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:57.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:29:56 gibba015 bash[30343]: cluster 2021-03-10T14:29:56.676032+0000 mgr.gibba045.orlgmj (mgr.34412) 2215 : cluster [DBG] pgmap v1246: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:59.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:29:58 gibba045 bash[25517]: cluster 2021-03-10T14:29:58.676909+0000 mgr.gibba045.orlgmj (mgr.34412) 2216 : cluster [DBG] pgmap v1247: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:59.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:29:58 gibba015 bash[29377]: cluster 2021-03-10T14:29:58.676909+0000 mgr.gibba045.orlgmj (mgr.34412) 2216 : cluster [DBG] pgmap v1247: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:59.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:29:58 gibba015 bash[30343]: cluster 2021-03-10T14:29:58.676909+0000 mgr.gibba045.orlgmj (mgr.34412) 2216 : cluster [DBG] pgmap v1247: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:00.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:30:00 gibba015 bash[30343]: cluster 2021-03-10T14:30:00.000206+0000 mon.a (mon.0) 883 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T14:30:00.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:30:00 gibba015 bash[29377]: debug 2021-03-10T14:29:59.993+0000 7f21beb4f700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T14:30:00.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:30:00 gibba015 bash[29377]: cluster 2021-03-10T14:30:00.000206+0000 mon.a (mon.0) 883 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T14:30:00.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:30:00 gibba045 bash[25517]: cluster 2021-03-10T14:30:00.000206+0000 mon.a (mon.0) 883 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T14:30:01.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:30:01 gibba015 bash[29377]: cephadm 2021-03-10T14:30:00.133168+0000 mgr.gibba045.orlgmj (mgr.34412) 2217 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:30:01.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:30:01 gibba015 bash[29377]: cluster 2021-03-10T14:30:00.678477+0000 mgr.gibba045.orlgmj (mgr.34412) 2218 : cluster [DBG] pgmap v1248: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:01.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:30:01 gibba015 bash[30343]: cephadm 2021-03-10T14:30:00.133168+0000 mgr.gibba045.orlgmj (mgr.34412) 2217 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:30:01.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:30:01 gibba015 bash[30343]: cluster 2021-03-10T14:30:00.678477+0000 mgr.gibba045.orlgmj (mgr.34412) 2218 : cluster [DBG] pgmap v1248: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:01.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:30:01 gibba045 bash[25517]: cephadm 2021-03-10T14:30:00.133168+0000 mgr.gibba045.orlgmj (mgr.34412) 2217 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:30:01.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:30:01 gibba045 bash[25517]: cluster 2021-03-10T14:30:00.678477+0000 mgr.gibba045.orlgmj (mgr.34412) 2218 : cluster [DBG] pgmap v1248: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:03.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:30:03 gibba045 bash[25517]: cluster 2021-03-10T14:30:02.679964+0000 mgr.gibba045.orlgmj (mgr.34412) 2219 : cluster [DBG] pgmap v1249: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:03.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:30:03 gibba015 bash[29377]: cluster 2021-03-10T14:30:02.679964+0000 mgr.gibba045.orlgmj (mgr.34412) 2219 : cluster [DBG] pgmap v1249: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:03.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:30:03 gibba015 bash[30343]: cluster 2021-03-10T14:30:02.679964+0000 mgr.gibba045.orlgmj (mgr.34412) 2219 : cluster [DBG] pgmap v1249: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:05.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:30:04 gibba045 bash[25517]: cluster 2021-03-10T14:30:04.680954+0000 mgr.gibba045.orlgmj (mgr.34412) 2220 : cluster [DBG] pgmap v1250: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:05.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:30:04 gibba015 bash[29377]: cluster 2021-03-10T14:30:04.680954+0000 mgr.gibba045.orlgmj (mgr.34412) 2220 : cluster [DBG] pgmap v1250: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:05.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:30:04 gibba015 bash[30343]: cluster 2021-03-10T14:30:04.680954+0000 mgr.gibba045.orlgmj (mgr.34412) 2220 : cluster [DBG] pgmap v1250: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:06.070 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:30:06.300 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:30:06.301 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (40m) 6m ago 46m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:30:06.301 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (45m) 5m ago 45m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:30:06.301 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (41m) 5m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:30:06.301 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (41m) 5m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:30:06.302 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (40m) 6m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:30:06.302 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (40m) 6m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:30:06.302 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (39m) 5m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:30:06.302 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (40m) 6m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:30:06.303 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (46m) 6m ago 46m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:30:06.303 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (46m) 5m ago 46m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:30:06.303 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (39m) 6m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:30:06.303 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (38m) 6m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:30:06.303 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (38m) 6m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:30:06.304 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (37m) 6m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:30:06.304 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (37m) 5m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:30:06.304 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (37m) 5m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:30:06.304 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (36m) 5m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:30:06.304 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (36m) 5m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:30:06.305 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (45m) 5m ago 46m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:30:06.305 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 5m ago 44m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:30:06.550 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:30:06.550 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:30:06.551 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:30:06.551 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:30:06.551 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:30:06.551 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:30:06.552 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:30:06.552 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:30:06.552 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:30:06.552 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:30:06.553 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:30:06.553 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:30:06.553 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:30:06.553 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:30:06.553 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:30:06.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:30:06 gibba015 bash[29377]: audit 2021-03-10T14:30:06.547621+0000 mon.a (mon.0) 884 : audit [DBG] from='client.? 172.21.2.115:0/35018572' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:30:06.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:30:06 gibba015 bash[30343]: audit 2021-03-10T14:30:06.547621+0000 mon.a (mon.0) 884 : audit [DBG] from='client.? 172.21.2.115:0/35018572' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:30:07.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:30:06 gibba045 bash[25517]: audit 2021-03-10T14:30:06.547621+0000 mon.a (mon.0) 884 : audit [DBG] from='client.? 172.21.2.115:0/35018572' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:30:07.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:30:07 gibba015 bash[29377]: audit 2021-03-10T14:30:06.062320+0000 mgr.gibba045.orlgmj (mgr.34412) 2221 : audit [DBG] from='client.55534 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:30:07.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:30:07 gibba015 bash[29377]: audit 2021-03-10T14:30:06.289083+0000 mgr.gibba045.orlgmj (mgr.34412) 2222 : audit [DBG] from='client.55540 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:30:07.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:30:07 gibba015 bash[29377]: cluster 2021-03-10T14:30:06.682172+0000 mgr.gibba045.orlgmj (mgr.34412) 2223 : cluster [DBG] pgmap v1251: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:07.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:30:07 gibba015 bash[30343]: audit 2021-03-10T14:30:06.062320+0000 mgr.gibba045.orlgmj (mgr.34412) 2221 : audit [DBG] from='client.55534 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:30:07.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:30:07 gibba015 bash[30343]: audit 2021-03-10T14:30:06.289083+0000 mgr.gibba045.orlgmj (mgr.34412) 2222 : audit [DBG] from='client.55540 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:30:07.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:30:07 gibba015 bash[30343]: cluster 2021-03-10T14:30:06.682172+0000 mgr.gibba045.orlgmj (mgr.34412) 2223 : cluster [DBG] pgmap v1251: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:08.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:30:07 gibba045 bash[25517]: audit 2021-03-10T14:30:06.062320+0000 mgr.gibba045.orlgmj (mgr.34412) 2221 : audit [DBG] from='client.55534 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:30:08.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:30:07 gibba045 bash[25517]: audit 2021-03-10T14:30:06.289083+0000 mgr.gibba045.orlgmj (mgr.34412) 2222 : audit [DBG] from='client.55540 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:30:08.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:30:07 gibba045 bash[25517]: cluster 2021-03-10T14:30:06.682172+0000 mgr.gibba045.orlgmj (mgr.34412) 2223 : cluster [DBG] pgmap v1251: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:09.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:30:08 gibba045 bash[25517]: cluster 2021-03-10T14:30:08.683328+0000 mgr.gibba045.orlgmj (mgr.34412) 2224 : cluster [DBG] pgmap v1252: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:09.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:30:08 gibba015 bash[29377]: cluster 2021-03-10T14:30:08.683328+0000 mgr.gibba045.orlgmj (mgr.34412) 2224 : cluster [DBG] pgmap v1252: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:09.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:30:08 gibba015 bash[30343]: cluster 2021-03-10T14:30:08.683328+0000 mgr.gibba045.orlgmj (mgr.34412) 2224 : cluster [DBG] pgmap v1252: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:11.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:30:10 gibba045 bash[25517]: cluster 2021-03-10T14:30:10.684984+0000 mgr.gibba045.orlgmj (mgr.34412) 2225 : cluster [DBG] pgmap v1253: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:11.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:30:10 gibba015 bash[29377]: cluster 2021-03-10T14:30:10.684984+0000 mgr.gibba045.orlgmj (mgr.34412) 2225 : cluster [DBG] pgmap v1253: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:11.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:30:10 gibba015 bash[30343]: cluster 2021-03-10T14:30:10.684984+0000 mgr.gibba045.orlgmj (mgr.34412) 2225 : cluster [DBG] pgmap v1253: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:13.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:30:13 gibba045 bash[25517]: cluster 2021-03-10T14:30:12.686568+0000 mgr.gibba045.orlgmj (mgr.34412) 2226 : cluster [DBG] pgmap v1254: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:13.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:30:13 gibba015 bash[29377]: cluster 2021-03-10T14:30:12.686568+0000 mgr.gibba045.orlgmj (mgr.34412) 2226 : cluster [DBG] pgmap v1254: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:13.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:30:13 gibba015 bash[30343]: cluster 2021-03-10T14:30:12.686568+0000 mgr.gibba045.orlgmj (mgr.34412) 2226 : cluster [DBG] pgmap v1254: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:15.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:30:14 gibba045 bash[25517]: cluster 2021-03-10T14:30:14.688053+0000 mgr.gibba045.orlgmj (mgr.34412) 2227 : cluster [DBG] pgmap v1255: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:15.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:30:14 gibba015 bash[29377]: cluster 2021-03-10T14:30:14.688053+0000 mgr.gibba045.orlgmj (mgr.34412) 2227 : cluster [DBG] pgmap v1255: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:15.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:30:14 gibba015 bash[30343]: cluster 2021-03-10T14:30:14.688053+0000 mgr.gibba045.orlgmj (mgr.34412) 2227 : cluster [DBG] pgmap v1255: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:16.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:30:15 gibba045 bash[25517]: cephadm 2021-03-10T14:30:15.147378+0000 mgr.gibba045.orlgmj (mgr.34412) 2228 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:30:16.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:30:15 gibba015 bash[29377]: cephadm 2021-03-10T14:30:15.147378+0000 mgr.gibba045.orlgmj (mgr.34412) 2228 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:30:16.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:30:15 gibba015 bash[30343]: cephadm 2021-03-10T14:30:15.147378+0000 mgr.gibba045.orlgmj (mgr.34412) 2228 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:30:17.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:30:16 gibba045 bash[25517]: cluster 2021-03-10T14:30:16.689873+0000 mgr.gibba045.orlgmj (mgr.34412) 2229 : cluster [DBG] pgmap v1256: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:17.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:30:16 gibba015 bash[29377]: cluster 2021-03-10T14:30:16.689873+0000 mgr.gibba045.orlgmj (mgr.34412) 2229 : cluster [DBG] pgmap v1256: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:17.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:30:16 gibba015 bash[30343]: cluster 2021-03-10T14:30:16.689873+0000 mgr.gibba045.orlgmj (mgr.34412) 2229 : cluster [DBG] pgmap v1256: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:20.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:30:19 gibba045 bash[25517]: cluster 2021-03-10T14:30:18.690935+0000 mgr.gibba045.orlgmj (mgr.34412) 2230 : cluster [DBG] pgmap v1257: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:20.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:30:19 gibba015 bash[29377]: cluster 2021-03-10T14:30:18.690935+0000 mgr.gibba045.orlgmj (mgr.34412) 2230 : cluster [DBG] pgmap v1257: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:20.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:30:19 gibba015 bash[30343]: cluster 2021-03-10T14:30:18.690935+0000 mgr.gibba045.orlgmj (mgr.34412) 2230 : cluster [DBG] pgmap v1257: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:22.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:30:21 gibba045 bash[25517]: cluster 2021-03-10T14:30:20.692262+0000 mgr.gibba045.orlgmj (mgr.34412) 2231 : cluster [DBG] pgmap v1258: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:22.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:30:21 gibba015 bash[29377]: cluster 2021-03-10T14:30:20.692262+0000 mgr.gibba045.orlgmj (mgr.34412) 2231 : cluster [DBG] pgmap v1258: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:22.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:30:21 gibba015 bash[30343]: cluster 2021-03-10T14:30:20.692262+0000 mgr.gibba045.orlgmj (mgr.34412) 2231 : cluster [DBG] pgmap v1258: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:24.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:30:24 gibba045 bash[25517]: cluster 2021-03-10T14:30:22.693572+0000 mgr.gibba045.orlgmj (mgr.34412) 2232 : cluster [DBG] pgmap v1259: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:24.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:30:24 gibba015 bash[29377]: cluster 2021-03-10T14:30:22.693572+0000 mgr.gibba045.orlgmj (mgr.34412) 2232 : cluster [DBG] pgmap v1259: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:24.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:30:24 gibba015 bash[30343]: cluster 2021-03-10T14:30:22.693572+0000 mgr.gibba045.orlgmj (mgr.34412) 2232 : cluster [DBG] pgmap v1259: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:26.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:30:26 gibba015 bash[29377]: cluster 2021-03-10T14:30:24.694982+0000 mgr.gibba045.orlgmj (mgr.34412) 2233 : cluster [DBG] pgmap v1260: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:26.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:30:26 gibba015 bash[30343]: cluster 2021-03-10T14:30:24.694982+0000 mgr.gibba045.orlgmj (mgr.34412) 2233 : cluster [DBG] pgmap v1260: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:27.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:30:26 gibba045 bash[25517]: cluster 2021-03-10T14:30:24.694982+0000 mgr.gibba045.orlgmj (mgr.34412) 2233 : cluster [DBG] pgmap v1260: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:28.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:30:28 gibba015 bash[29377]: cluster 2021-03-10T14:30:26.696862+0000 mgr.gibba045.orlgmj (mgr.34412) 2234 : cluster [DBG] pgmap v1261: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:28.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:30:28 gibba015 bash[30343]: cluster 2021-03-10T14:30:26.696862+0000 mgr.gibba045.orlgmj (mgr.34412) 2234 : cluster [DBG] pgmap v1261: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:29.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:30:28 gibba045 bash[25517]: cluster 2021-03-10T14:30:26.696862+0000 mgr.gibba045.orlgmj (mgr.34412) 2234 : cluster [DBG] pgmap v1261: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:30.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:30:30 gibba015 bash[29377]: cluster 2021-03-10T14:30:28.698030+0000 mgr.gibba045.orlgmj (mgr.34412) 2235 : cluster [DBG] pgmap v1262: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:30.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:30:30 gibba015 bash[30343]: cluster 2021-03-10T14:30:28.698030+0000 mgr.gibba045.orlgmj (mgr.34412) 2235 : cluster [DBG] pgmap v1262: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:31.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:30:30 gibba045 bash[25517]: cluster 2021-03-10T14:30:28.698030+0000 mgr.gibba045.orlgmj (mgr.34412) 2235 : cluster [DBG] pgmap v1262: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:31.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:30:31 gibba015 bash[29377]: cephadm 2021-03-10T14:30:30.162858+0000 mgr.gibba045.orlgmj (mgr.34412) 2236 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:30:31.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:30:31 gibba015 bash[30343]: cephadm 2021-03-10T14:30:30.162858+0000 mgr.gibba045.orlgmj (mgr.34412) 2236 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:30:32.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:30:31 gibba045 bash[25517]: cephadm 2021-03-10T14:30:30.162858+0000 mgr.gibba045.orlgmj (mgr.34412) 2236 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:30:32.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:30:32 gibba015 bash[29377]: cluster 2021-03-10T14:30:30.699394+0000 mgr.gibba045.orlgmj (mgr.34412) 2237 : cluster [DBG] pgmap v1263: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:32.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:30:32 gibba015 bash[30343]: cluster 2021-03-10T14:30:30.699394+0000 mgr.gibba045.orlgmj (mgr.34412) 2237 : cluster [DBG] pgmap v1263: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:33.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:30:32 gibba045 bash[25517]: cluster 2021-03-10T14:30:30.699394+0000 mgr.gibba045.orlgmj (mgr.34412) 2237 : cluster [DBG] pgmap v1263: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:34.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:30:34 gibba015 bash[29377]: cluster 2021-03-10T14:30:32.701126+0000 mgr.gibba045.orlgmj (mgr.34412) 2238 : cluster [DBG] pgmap v1264: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:34.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:30:34 gibba015 bash[30343]: cluster 2021-03-10T14:30:32.701126+0000 mgr.gibba045.orlgmj (mgr.34412) 2238 : cluster [DBG] pgmap v1264: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:35.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:30:34 gibba045 bash[25517]: cluster 2021-03-10T14:30:32.701126+0000 mgr.gibba045.orlgmj (mgr.34412) 2238 : cluster [DBG] pgmap v1264: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:36.796 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:30:36.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:30:36 gibba015 bash[29377]: cluster 2021-03-10T14:30:34.702466+0000 mgr.gibba045.orlgmj (mgr.34412) 2239 : cluster [DBG] pgmap v1265: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:36.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:30:36 gibba015 bash[30343]: cluster 2021-03-10T14:30:34.702466+0000 mgr.gibba045.orlgmj (mgr.34412) 2239 : cluster [DBG] pgmap v1265: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:37.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:30:36 gibba045 bash[25517]: cluster 2021-03-10T14:30:34.702466+0000 mgr.gibba045.orlgmj (mgr.34412) 2239 : cluster [DBG] pgmap v1265: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:37.055 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:30:37.056 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (41m) 6m ago 46m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:30:37.056 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (46m) 5m ago 46m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:30:37.056 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (41m) 5m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:30:37.056 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (42m) 5m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:30:37.057 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (41m) 6m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:30:37.057 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (40m) 6m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:30:37.057 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (40m) 5m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:30:37.057 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (40m) 6m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:30:37.058 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (46m) 6m ago 46m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:30:37.058 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (46m) 5m ago 46m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:30:37.058 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (39m) 6m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:30:37.058 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (39m) 6m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:30:37.059 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (38m) 6m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:30:37.059 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (38m) 6m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:30:37.059 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (37m) 5m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:30:37.059 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (37m) 5m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:30:37.060 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (37m) 5m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:30:37.060 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (36m) 5m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:30:37.060 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (46m) 5m ago 46m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:30:37.060 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 5m ago 44m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:30:37.307 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:30:37.307 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:30:37.308 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:30:37.308 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:30:37.308 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:30:37.308 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:30:37.309 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:30:37.309 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:30:37.309 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:30:37.309 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:30:37.310 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:30:37.310 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:30:37.310 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:30:37.310 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:30:37.311 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:30:37.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:30:37 gibba015 bash[29377]: audit 2021-03-10T14:30:37.304459+0000 mon.c (mon.1) 673 : audit [DBG] from='client.? 172.21.2.115:0/1339957936' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:30:37.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:30:37 gibba015 bash[30343]: audit 2021-03-10T14:30:37.304459+0000 mon.c (mon.1) 673 : audit [DBG] from='client.? 172.21.2.115:0/1339957936' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:30:38.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:30:37 gibba045 bash[25517]: audit 2021-03-10T14:30:37.304459+0000 mon.c (mon.1) 673 : audit [DBG] from='client.? 172.21.2.115:0/1339957936' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:30:38.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:30:38 gibba015 bash[29377]: cluster 2021-03-10T14:30:36.704215+0000 mgr.gibba045.orlgmj (mgr.34412) 2240 : cluster [DBG] pgmap v1266: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:38.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:30:38 gibba015 bash[29377]: audit 2021-03-10T14:30:36.788203+0000 mgr.gibba045.orlgmj (mgr.34412) 2241 : audit [DBG] from='client.55552 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:30:38.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:30:38 gibba015 bash[29377]: audit 2021-03-10T14:30:37.016050+0000 mgr.gibba045.orlgmj (mgr.34412) 2242 : audit [DBG] from='client.55558 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:30:38.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:30:38 gibba015 bash[30343]: cluster 2021-03-10T14:30:36.704215+0000 mgr.gibba045.orlgmj (mgr.34412) 2240 : cluster [DBG] pgmap v1266: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:38.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:30:38 gibba015 bash[30343]: audit 2021-03-10T14:30:36.788203+0000 mgr.gibba045.orlgmj (mgr.34412) 2241 : audit [DBG] from='client.55552 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:30:38.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:30:38 gibba015 bash[30343]: audit 2021-03-10T14:30:37.016050+0000 mgr.gibba045.orlgmj (mgr.34412) 2242 : audit [DBG] from='client.55558 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:30:39.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:30:38 gibba045 bash[25517]: cluster 2021-03-10T14:30:36.704215+0000 mgr.gibba045.orlgmj (mgr.34412) 2240 : cluster [DBG] pgmap v1266: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:39.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:30:38 gibba045 bash[25517]: audit 2021-03-10T14:30:36.788203+0000 mgr.gibba045.orlgmj (mgr.34412) 2241 : audit [DBG] from='client.55552 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:30:39.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:30:38 gibba045 bash[25517]: audit 2021-03-10T14:30:37.016050+0000 mgr.gibba045.orlgmj (mgr.34412) 2242 : audit [DBG] from='client.55558 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:30:40.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:30:40 gibba015 bash[29377]: cluster 2021-03-10T14:30:38.705422+0000 mgr.gibba045.orlgmj (mgr.34412) 2243 : cluster [DBG] pgmap v1267: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:40.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:30:40 gibba015 bash[30343]: cluster 2021-03-10T14:30:38.705422+0000 mgr.gibba045.orlgmj (mgr.34412) 2243 : cluster [DBG] pgmap v1267: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:41.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:30:40 gibba045 bash[25517]: cluster 2021-03-10T14:30:38.705422+0000 mgr.gibba045.orlgmj (mgr.34412) 2243 : cluster [DBG] pgmap v1267: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:42.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:30:42 gibba015 bash[29377]: cluster 2021-03-10T14:30:40.706355+0000 mgr.gibba045.orlgmj (mgr.34412) 2244 : cluster [DBG] pgmap v1268: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:42.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:30:42 gibba015 bash[30343]: cluster 2021-03-10T14:30:40.706355+0000 mgr.gibba045.orlgmj (mgr.34412) 2244 : cluster [DBG] pgmap v1268: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:43.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:30:42 gibba045 bash[25517]: cluster 2021-03-10T14:30:40.706355+0000 mgr.gibba045.orlgmj (mgr.34412) 2244 : cluster [DBG] pgmap v1268: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:44.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:30:44 gibba015 bash[29377]: cluster 2021-03-10T14:30:42.707877+0000 mgr.gibba045.orlgmj (mgr.34412) 2245 : cluster [DBG] pgmap v1269: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:44.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:30:44 gibba015 bash[30343]: cluster 2021-03-10T14:30:42.707877+0000 mgr.gibba045.orlgmj (mgr.34412) 2245 : cluster [DBG] pgmap v1269: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:45.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:30:44 gibba045 bash[25517]: cluster 2021-03-10T14:30:42.707877+0000 mgr.gibba045.orlgmj (mgr.34412) 2245 : cluster [DBG] pgmap v1269: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:45.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:30:45 gibba015 bash[29377]: audit 2021-03-10T14:30:45.167907+0000 mon.c (mon.1) 674 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:30:45.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:30:45 gibba015 bash[29377]: audit 2021-03-10T14:30:45.355598+0000 mon.a (mon.0) 885 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:30:45.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:30:45 gibba015 bash[29377]: audit 2021-03-10T14:30:45.362064+0000 mon.a (mon.0) 886 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:30:45.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:30:45 gibba015 bash[29377]: audit 2021-03-10T14:30:45.547519+0000 mon.a (mon.0) 887 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:30:45.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:30:45 gibba015 bash[29377]: audit 2021-03-10T14:30:45.551027+0000 mon.c (mon.1) 675 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:30:45.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:30:45 gibba015 bash[29377]: audit 2021-03-10T14:30:45.552589+0000 mon.c (mon.1) 676 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:30:45.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:30:45 gibba015 bash[29377]: audit 2021-03-10T14:30:45.553747+0000 mon.c (mon.1) 677 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:30:45.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:30:45 gibba015 bash[29377]: audit 2021-03-10T14:30:45.554791+0000 mon.c (mon.1) 678 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:30:45.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:30:45 gibba015 bash[29377]: audit 2021-03-10T14:30:45.557968+0000 mon.c (mon.1) 679 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:30:45.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:30:45 gibba015 bash[29377]: audit 2021-03-10T14:30:45.559616+0000 mon.c (mon.1) 680 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:30:45.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:30:45 gibba015 bash[30343]: audit 2021-03-10T14:30:45.167907+0000 mon.c (mon.1) 674 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:30:45.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:30:45 gibba015 bash[30343]: audit 2021-03-10T14:30:45.355598+0000 mon.a (mon.0) 885 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:30:45.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:30:45 gibba015 bash[30343]: audit 2021-03-10T14:30:45.362064+0000 mon.a (mon.0) 886 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:30:45.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:30:45 gibba015 bash[30343]: audit 2021-03-10T14:30:45.547519+0000 mon.a (mon.0) 887 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:30:45.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:30:45 gibba015 bash[30343]: audit 2021-03-10T14:30:45.551027+0000 mon.c (mon.1) 675 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:30:45.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:30:45 gibba015 bash[30343]: audit 2021-03-10T14:30:45.552589+0000 mon.c (mon.1) 676 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:30:45.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:30:45 gibba015 bash[30343]: audit 2021-03-10T14:30:45.553747+0000 mon.c (mon.1) 677 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:30:45.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:30:45 gibba015 bash[30343]: audit 2021-03-10T14:30:45.554791+0000 mon.c (mon.1) 678 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:30:45.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:30:45 gibba015 bash[30343]: audit 2021-03-10T14:30:45.557968+0000 mon.c (mon.1) 679 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:30:45.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:30:45 gibba015 bash[30343]: audit 2021-03-10T14:30:45.559616+0000 mon.c (mon.1) 680 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:30:46.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:30:45 gibba045 bash[25517]: audit 2021-03-10T14:30:45.167907+0000 mon.c (mon.1) 674 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:30:46.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:30:45 gibba045 bash[25517]: audit 2021-03-10T14:30:45.355598+0000 mon.a (mon.0) 885 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:30:46.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:30:45 gibba045 bash[25517]: audit 2021-03-10T14:30:45.362064+0000 mon.a (mon.0) 886 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:30:46.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:30:45 gibba045 bash[25517]: audit 2021-03-10T14:30:45.547519+0000 mon.a (mon.0) 887 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:30:46.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:30:45 gibba045 bash[25517]: audit 2021-03-10T14:30:45.551027+0000 mon.c (mon.1) 675 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:30:46.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:30:45 gibba045 bash[25517]: audit 2021-03-10T14:30:45.552589+0000 mon.c (mon.1) 676 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:30:46.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:30:45 gibba045 bash[25517]: audit 2021-03-10T14:30:45.553747+0000 mon.c (mon.1) 677 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:30:46.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:30:45 gibba045 bash[25517]: audit 2021-03-10T14:30:45.554791+0000 mon.c (mon.1) 678 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:30:46.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:30:45 gibba045 bash[25517]: audit 2021-03-10T14:30:45.557968+0000 mon.c (mon.1) 679 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:30:46.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:30:45 gibba045 bash[25517]: audit 2021-03-10T14:30:45.559616+0000 mon.c (mon.1) 680 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:30:46.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:30:46 gibba015 bash[29377]: cluster 2021-03-10T14:30:44.709289+0000 mgr.gibba045.orlgmj (mgr.34412) 2246 : cluster [DBG] pgmap v1270: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:46.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:30:46 gibba015 bash[29377]: cephadm 2021-03-10T14:30:45.360712+0000 mgr.gibba045.orlgmj (mgr.34412) 2247 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:30:46.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:30:46 gibba015 bash[29377]: cephadm 2021-03-10T14:30:45.366533+0000 mgr.gibba045.orlgmj (mgr.34412) 2248 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:30:46.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:30:46 gibba015 bash[29377]: cephadm 2021-03-10T14:30:45.553965+0000 mgr.gibba045.orlgmj (mgr.34412) 2249 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:30:46.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:30:46 gibba015 bash[29377]: cephadm 2021-03-10T14:30:45.555721+0000 mgr.gibba045.orlgmj (mgr.34412) 2250 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:30:46.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:30:46 gibba015 bash[29377]: cephadm 2021-03-10T14:30:45.557018+0000 mgr.gibba045.orlgmj (mgr.34412) 2251 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:30:46.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:30:46 gibba015 bash[29377]: cephadm 2021-03-10T14:30:45.557056+0000 mgr.gibba045.orlgmj (mgr.34412) 2252 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:30:46.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:30:46 gibba015 bash[29377]: cephadm 2021-03-10T14:30:45.558156+0000 mgr.gibba045.orlgmj (mgr.34412) 2253 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:30:46.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:30:46 gibba015 bash[29377]: cephadm 2021-03-10T14:30:45.558194+0000 mgr.gibba045.orlgmj (mgr.34412) 2254 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:30:46.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:30:46 gibba015 bash[29377]: cephadm 2021-03-10T14:30:45.559397+0000 mgr.gibba045.orlgmj (mgr.34412) 2255 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:30:46.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:30:46 gibba015 bash[29377]: cephadm 2021-03-10T14:30:45.561009+0000 mgr.gibba045.orlgmj (mgr.34412) 2256 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:30:46.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:30:46 gibba015 bash[29377]: cephadm 2021-03-10T14:30:45.561046+0000 mgr.gibba045.orlgmj (mgr.34412) 2257 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:30:46.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:30:46 gibba015 bash[29377]: cephadm 2021-03-10T14:30:45.562533+0000 mgr.gibba045.orlgmj (mgr.34412) 2258 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:30:46.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:30:46 gibba015 bash[29377]: cephadm 2021-03-10T14:30:45.562842+0000 mgr.gibba045.orlgmj (mgr.34412) 2259 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:30:46.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:30:46 gibba015 bash[29377]: cephadm 2021-03-10T14:30:45.563957+0000 mgr.gibba045.orlgmj (mgr.34412) 2260 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:30:46.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:30:46 gibba015 bash[29377]: cephadm 2021-03-10T14:30:45.563995+0000 mgr.gibba045.orlgmj (mgr.34412) 2261 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:30:46.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:30:46 gibba015 bash[29377]: cephadm 2021-03-10T14:30:45.564098+0000 mgr.gibba045.orlgmj (mgr.34412) 2262 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:30:46.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:30:46 gibba015 bash[30343]: cluster 2021-03-10T14:30:44.709289+0000 mgr.gibba045.orlgmj (mgr.34412) 2246 : cluster [DBG] pgmap v1270: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:46.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:30:46 gibba015 bash[30343]: cephadm 2021-03-10T14:30:45.360712+0000 mgr.gibba045.orlgmj (mgr.34412) 2247 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:30:46.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:30:46 gibba015 bash[30343]: cephadm 2021-03-10T14:30:45.366533+0000 mgr.gibba045.orlgmj (mgr.34412) 2248 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:30:46.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:30:46 gibba015 bash[30343]: cephadm 2021-03-10T14:30:45.553965+0000 mgr.gibba045.orlgmj (mgr.34412) 2249 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:30:46.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:30:46 gibba015 bash[30343]: cephadm 2021-03-10T14:30:45.555721+0000 mgr.gibba045.orlgmj (mgr.34412) 2250 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:30:46.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:30:46 gibba015 bash[30343]: cephadm 2021-03-10T14:30:45.557018+0000 mgr.gibba045.orlgmj (mgr.34412) 2251 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:30:46.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:30:46 gibba015 bash[30343]: cephadm 2021-03-10T14:30:45.557056+0000 mgr.gibba045.orlgmj (mgr.34412) 2252 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:30:46.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:30:46 gibba015 bash[30343]: cephadm 2021-03-10T14:30:45.558156+0000 mgr.gibba045.orlgmj (mgr.34412) 2253 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:30:46.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:30:46 gibba015 bash[30343]: cephadm 2021-03-10T14:30:45.558194+0000 mgr.gibba045.orlgmj (mgr.34412) 2254 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:30:46.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:30:46 gibba015 bash[30343]: cephadm 2021-03-10T14:30:45.559397+0000 mgr.gibba045.orlgmj (mgr.34412) 2255 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:30:46.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:30:46 gibba015 bash[30343]: cephadm 2021-03-10T14:30:45.561009+0000 mgr.gibba045.orlgmj (mgr.34412) 2256 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:30:46.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:30:46 gibba015 bash[30343]: cephadm 2021-03-10T14:30:45.561046+0000 mgr.gibba045.orlgmj (mgr.34412) 2257 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:30:46.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:30:46 gibba015 bash[30343]: cephadm 2021-03-10T14:30:45.562533+0000 mgr.gibba045.orlgmj (mgr.34412) 2258 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:30:46.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:30:46 gibba015 bash[30343]: cephadm 2021-03-10T14:30:45.562842+0000 mgr.gibba045.orlgmj (mgr.34412) 2259 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:30:46.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:30:46 gibba015 bash[30343]: cephadm 2021-03-10T14:30:45.563957+0000 mgr.gibba045.orlgmj (mgr.34412) 2260 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:30:46.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:30:46 gibba015 bash[30343]: cephadm 2021-03-10T14:30:45.563995+0000 mgr.gibba045.orlgmj (mgr.34412) 2261 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:30:46.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:30:46 gibba015 bash[30343]: cephadm 2021-03-10T14:30:45.564098+0000 mgr.gibba045.orlgmj (mgr.34412) 2262 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:30:47.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:30:46 gibba045 bash[25517]: cluster 2021-03-10T14:30:44.709289+0000 mgr.gibba045.orlgmj (mgr.34412) 2246 : cluster [DBG] pgmap v1270: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:47.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:30:46 gibba045 bash[25517]: cephadm 2021-03-10T14:30:45.360712+0000 mgr.gibba045.orlgmj (mgr.34412) 2247 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:30:47.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:30:46 gibba045 bash[25517]: cephadm 2021-03-10T14:30:45.366533+0000 mgr.gibba045.orlgmj (mgr.34412) 2248 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:30:47.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:30:46 gibba045 bash[25517]: cephadm 2021-03-10T14:30:45.553965+0000 mgr.gibba045.orlgmj (mgr.34412) 2249 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:30:47.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:30:46 gibba045 bash[25517]: cephadm 2021-03-10T14:30:45.555721+0000 mgr.gibba045.orlgmj (mgr.34412) 2250 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:30:47.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:30:46 gibba045 bash[25517]: cephadm 2021-03-10T14:30:45.557018+0000 mgr.gibba045.orlgmj (mgr.34412) 2251 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:30:47.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:30:46 gibba045 bash[25517]: cephadm 2021-03-10T14:30:45.557056+0000 mgr.gibba045.orlgmj (mgr.34412) 2252 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:30:47.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:30:46 gibba045 bash[25517]: cephadm 2021-03-10T14:30:45.558156+0000 mgr.gibba045.orlgmj (mgr.34412) 2253 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:30:47.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:30:46 gibba045 bash[25517]: cephadm 2021-03-10T14:30:45.558194+0000 mgr.gibba045.orlgmj (mgr.34412) 2254 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:30:47.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:30:46 gibba045 bash[25517]: cephadm 2021-03-10T14:30:45.559397+0000 mgr.gibba045.orlgmj (mgr.34412) 2255 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:30:47.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:30:46 gibba045 bash[25517]: cephadm 2021-03-10T14:30:45.561009+0000 mgr.gibba045.orlgmj (mgr.34412) 2256 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:30:47.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:30:46 gibba045 bash[25517]: cephadm 2021-03-10T14:30:45.561046+0000 mgr.gibba045.orlgmj (mgr.34412) 2257 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:30:47.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:30:46 gibba045 bash[25517]: cephadm 2021-03-10T14:30:45.562533+0000 mgr.gibba045.orlgmj (mgr.34412) 2258 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:30:47.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:30:46 gibba045 bash[25517]: cephadm 2021-03-10T14:30:45.562842+0000 mgr.gibba045.orlgmj (mgr.34412) 2259 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:30:47.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:30:46 gibba045 bash[25517]: cephadm 2021-03-10T14:30:45.563957+0000 mgr.gibba045.orlgmj (mgr.34412) 2260 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:30:47.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:30:46 gibba045 bash[25517]: cephadm 2021-03-10T14:30:45.563995+0000 mgr.gibba045.orlgmj (mgr.34412) 2261 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:30:47.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:30:46 gibba045 bash[25517]: cephadm 2021-03-10T14:30:45.564098+0000 mgr.gibba045.orlgmj (mgr.34412) 2262 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:30:48.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:30:48 gibba015 bash[29377]: cluster 2021-03-10T14:30:46.710865+0000 mgr.gibba045.orlgmj (mgr.34412) 2263 : cluster [DBG] pgmap v1271: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:48.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:30:48 gibba015 bash[30343]: cluster 2021-03-10T14:30:46.710865+0000 mgr.gibba045.orlgmj (mgr.34412) 2263 : cluster [DBG] pgmap v1271: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:49.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:30:48 gibba045 bash[25517]: cluster 2021-03-10T14:30:46.710865+0000 mgr.gibba045.orlgmj (mgr.34412) 2263 : cluster [DBG] pgmap v1271: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:50.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:30:50 gibba015 bash[29377]: cluster 2021-03-10T14:30:48.711581+0000 mgr.gibba045.orlgmj (mgr.34412) 2264 : cluster [DBG] pgmap v1272: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:50.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:30:50 gibba015 bash[30343]: cluster 2021-03-10T14:30:48.711581+0000 mgr.gibba045.orlgmj (mgr.34412) 2264 : cluster [DBG] pgmap v1272: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:51.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:30:50 gibba045 bash[25517]: cluster 2021-03-10T14:30:48.711581+0000 mgr.gibba045.orlgmj (mgr.34412) 2264 : cluster [DBG] pgmap v1272: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:52.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:30:52 gibba015 bash[29377]: cluster 2021-03-10T14:30:50.712237+0000 mgr.gibba045.orlgmj (mgr.34412) 2265 : cluster [DBG] pgmap v1273: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:52.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:30:52 gibba015 bash[30343]: cluster 2021-03-10T14:30:50.712237+0000 mgr.gibba045.orlgmj (mgr.34412) 2265 : cluster [DBG] pgmap v1273: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:53.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:30:52 gibba045 bash[25517]: cluster 2021-03-10T14:30:50.712237+0000 mgr.gibba045.orlgmj (mgr.34412) 2265 : cluster [DBG] pgmap v1273: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:53.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:30:53 gibba015 bash[29377]: audit 2021-03-10T14:30:52.718529+0000 mon.c (mon.1) 681 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:30:53.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:30:53 gibba015 bash[29377]: audit 2021-03-10T14:30:52.718996+0000 mon.a (mon.0) 888 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:30:53.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:30:53 gibba015 bash[29377]: audit 2021-03-10T14:30:52.719131+0000 mon.c (mon.1) 682 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:30:53.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:30:53 gibba015 bash[29377]: audit 2021-03-10T14:30:52.719446+0000 mon.a (mon.0) 889 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:30:53.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:30:53 gibba015 bash[29377]: audit 2021-03-10T14:30:52.722694+0000 mon.c (mon.1) 683 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T14:30:53.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:30:53 gibba015 bash[29377]: audit 2021-03-10T14:30:52.722867+0000 mon.c (mon.1) 684 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:30:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:30:53 gibba015 bash[29377]: audit 2021-03-10T14:30:52.722990+0000 mon.a (mon.0) 890 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T14:30:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:30:53 gibba015 bash[29377]: audit 2021-03-10T14:30:52.723033+0000 mon.c (mon.1) 685 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T14:30:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:30:53 gibba015 bash[29377]: audit 2021-03-10T14:30:52.723239+0000 mon.c (mon.1) 686 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:30:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:30:53 gibba015 bash[29377]: audit 2021-03-10T14:30:52.723360+0000 mon.a (mon.0) 891 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:30:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:30:53 gibba015 bash[29377]: audit 2021-03-10T14:30:52.723615+0000 mon.a (mon.0) 892 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T14:30:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:30:53 gibba015 bash[29377]: audit 2021-03-10T14:30:52.723818+0000 mon.a (mon.0) 893 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:30:53.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:30:53 gibba015 bash[30343]: audit 2021-03-10T14:30:52.718529+0000 mon.c (mon.1) 681 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:30:53.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:30:53 gibba015 bash[30343]: audit 2021-03-10T14:30:52.718996+0000 mon.a (mon.0) 888 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:30:53.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:30:53 gibba015 bash[30343]: audit 2021-03-10T14:30:52.719131+0000 mon.c (mon.1) 682 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:30:53.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:30:53 gibba015 bash[30343]: audit 2021-03-10T14:30:52.719446+0000 mon.a (mon.0) 889 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:30:53.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:30:53 gibba015 bash[30343]: audit 2021-03-10T14:30:52.722694+0000 mon.c (mon.1) 683 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T14:30:53.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:30:53 gibba015 bash[30343]: audit 2021-03-10T14:30:52.722867+0000 mon.c (mon.1) 684 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:30:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:30:53 gibba015 bash[30343]: audit 2021-03-10T14:30:52.722990+0000 mon.a (mon.0) 890 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T14:30:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:30:53 gibba015 bash[30343]: audit 2021-03-10T14:30:52.723033+0000 mon.c (mon.1) 685 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T14:30:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:30:53 gibba015 bash[30343]: audit 2021-03-10T14:30:52.723239+0000 mon.c (mon.1) 686 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:30:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:30:53 gibba015 bash[30343]: audit 2021-03-10T14:30:52.723360+0000 mon.a (mon.0) 891 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:30:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:30:53 gibba015 bash[30343]: audit 2021-03-10T14:30:52.723615+0000 mon.a (mon.0) 892 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T14:30:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:30:53 gibba015 bash[30343]: audit 2021-03-10T14:30:52.723818+0000 mon.a (mon.0) 893 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:30:54.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:30:53 gibba045 bash[25517]: audit 2021-03-10T14:30:52.718529+0000 mon.c (mon.1) 681 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:30:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:30:53 gibba045 bash[25517]: audit 2021-03-10T14:30:52.718996+0000 mon.a (mon.0) 888 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:30:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:30:53 gibba045 bash[25517]: audit 2021-03-10T14:30:52.719131+0000 mon.c (mon.1) 682 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:30:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:30:53 gibba045 bash[25517]: audit 2021-03-10T14:30:52.719446+0000 mon.a (mon.0) 889 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:30:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:30:53 gibba045 bash[25517]: audit 2021-03-10T14:30:52.722694+0000 mon.c (mon.1) 683 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T14:30:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:30:53 gibba045 bash[25517]: audit 2021-03-10T14:30:52.722867+0000 mon.c (mon.1) 684 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:30:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:30:53 gibba045 bash[25517]: audit 2021-03-10T14:30:52.722990+0000 mon.a (mon.0) 890 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T14:30:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:30:53 gibba045 bash[25517]: audit 2021-03-10T14:30:52.723033+0000 mon.c (mon.1) 685 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T14:30:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:30:53 gibba045 bash[25517]: audit 2021-03-10T14:30:52.723239+0000 mon.c (mon.1) 686 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:30:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:30:53 gibba045 bash[25517]: audit 2021-03-10T14:30:52.723360+0000 mon.a (mon.0) 891 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:30:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:30:53 gibba045 bash[25517]: audit 2021-03-10T14:30:52.723615+0000 mon.a (mon.0) 892 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T14:30:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:30:53 gibba045 bash[25517]: audit 2021-03-10T14:30:52.723818+0000 mon.a (mon.0) 893 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:30:54.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:30:54 gibba015 bash[29377]: cluster 2021-03-10T14:30:52.712902+0000 mgr.gibba045.orlgmj (mgr.34412) 2266 : cluster [DBG] pgmap v1274: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:54.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:30:54 gibba015 bash[30343]: cluster 2021-03-10T14:30:52.712902+0000 mgr.gibba045.orlgmj (mgr.34412) 2266 : cluster [DBG] pgmap v1274: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:55.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:30:54 gibba045 bash[25517]: cluster 2021-03-10T14:30:52.712902+0000 mgr.gibba045.orlgmj (mgr.34412) 2266 : cluster [DBG] pgmap v1274: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:56.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:30:55 gibba045 bash[25517]: cluster 2021-03-10T14:30:54.714247+0000 mgr.gibba045.orlgmj (mgr.34412) 2267 : cluster [DBG] pgmap v1275: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:56.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:30:55 gibba015 bash[29377]: cluster 2021-03-10T14:30:54.714247+0000 mgr.gibba045.orlgmj (mgr.34412) 2267 : cluster [DBG] pgmap v1275: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:56.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:30:55 gibba015 bash[30343]: cluster 2021-03-10T14:30:54.714247+0000 mgr.gibba045.orlgmj (mgr.34412) 2267 : cluster [DBG] pgmap v1275: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:58.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:30:58 gibba015 bash[29377]: cluster 2021-03-10T14:30:56.716159+0000 mgr.gibba045.orlgmj (mgr.34412) 2268 : cluster [DBG] pgmap v1276: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:58.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:30:58 gibba015 bash[30343]: cluster 2021-03-10T14:30:56.716159+0000 mgr.gibba045.orlgmj (mgr.34412) 2268 : cluster [DBG] pgmap v1276: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:59.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:30:58 gibba045 bash[25517]: cluster 2021-03-10T14:30:56.716159+0000 mgr.gibba045.orlgmj (mgr.34412) 2268 : cluster [DBG] pgmap v1276: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:00.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:31:00 gibba015 bash[29377]: cluster 2021-03-10T14:30:58.717453+0000 mgr.gibba045.orlgmj (mgr.34412) 2269 : cluster [DBG] pgmap v1277: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:00.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:31:00 gibba015 bash[30343]: cluster 2021-03-10T14:30:58.717453+0000 mgr.gibba045.orlgmj (mgr.34412) 2269 : cluster [DBG] pgmap v1277: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:01.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:31:00 gibba045 bash[25517]: cluster 2021-03-10T14:30:58.717453+0000 mgr.gibba045.orlgmj (mgr.34412) 2269 : cluster [DBG] pgmap v1277: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:01.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:31:01 gibba015 bash[29377]: cephadm 2021-03-10T14:31:00.578841+0000 mgr.gibba045.orlgmj (mgr.34412) 2270 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:31:01.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:31:01 gibba015 bash[30343]: cephadm 2021-03-10T14:31:00.578841+0000 mgr.gibba045.orlgmj (mgr.34412) 2270 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:31:02.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:31:01 gibba045 bash[25517]: cephadm 2021-03-10T14:31:00.578841+0000 mgr.gibba045.orlgmj (mgr.34412) 2270 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:31:02.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:31:02 gibba015 bash[29377]: cluster 2021-03-10T14:31:00.719139+0000 mgr.gibba045.orlgmj (mgr.34412) 2271 : cluster [DBG] pgmap v1278: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:02.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:31:02 gibba015 bash[30343]: cluster 2021-03-10T14:31:00.719139+0000 mgr.gibba045.orlgmj (mgr.34412) 2271 : cluster [DBG] pgmap v1278: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:03.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:31:02 gibba045 bash[25517]: cluster 2021-03-10T14:31:00.719139+0000 mgr.gibba045.orlgmj (mgr.34412) 2271 : cluster [DBG] pgmap v1278: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:04.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:31:04 gibba015 bash[29377]: cluster 2021-03-10T14:31:02.720835+0000 mgr.gibba045.orlgmj (mgr.34412) 2272 : cluster [DBG] pgmap v1279: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:04.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:31:04 gibba015 bash[30343]: cluster 2021-03-10T14:31:02.720835+0000 mgr.gibba045.orlgmj (mgr.34412) 2272 : cluster [DBG] pgmap v1279: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:05.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:31:04 gibba045 bash[25517]: cluster 2021-03-10T14:31:02.720835+0000 mgr.gibba045.orlgmj (mgr.34412) 2272 : cluster [DBG] pgmap v1279: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:06.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:31:06 gibba015 bash[29377]: cluster 2021-03-10T14:31:04.722302+0000 mgr.gibba045.orlgmj (mgr.34412) 2273 : cluster [DBG] pgmap v1280: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:06.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:31:06 gibba015 bash[30343]: cluster 2021-03-10T14:31:04.722302+0000 mgr.gibba045.orlgmj (mgr.34412) 2273 : cluster [DBG] pgmap v1280: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:07.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:31:06 gibba045 bash[25517]: cluster 2021-03-10T14:31:04.722302+0000 mgr.gibba045.orlgmj (mgr.34412) 2273 : cluster [DBG] pgmap v1280: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:07.551 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:31:07.783 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:31:07.783 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (41m) 7m ago 47m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:31:07.784 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (46m) 6m ago 46m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:31:07.784 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (42m) 6m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:31:07.784 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (42m) 6m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:31:07.784 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (41m) 7m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:31:07.785 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (41m) 7m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:31:07.785 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (40m) 6m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:31:07.785 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (41m) 7m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:31:07.785 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (47m) 7m ago 47m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:31:07.785 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (47m) 6m ago 47m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:31:07.786 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (40m) 7m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:31:07.786 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (39m) 7m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:31:07.786 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (39m) 7m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:31:07.786 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (38m) 7m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:31:07.787 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (38m) 6m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:31:07.787 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (38m) 6m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:31:07.787 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (37m) 6m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:31:07.787 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (37m) 6m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:31:07.788 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (46m) 6m ago 47m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:31:07.788 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 6m ago 45m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:31:08.038 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:31:08.039 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:31:08.039 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:31:08.039 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:31:08.039 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:31:08.039 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:31:08.040 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:31:08.040 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:31:08.040 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:31:08.040 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:31:08.041 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:31:08.041 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:31:08.041 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:31:08.041 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:31:08.041 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:31:08.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:31:08 gibba015 bash[29377]: cluster 2021-03-10T14:31:06.724053+0000 mgr.gibba045.orlgmj (mgr.34412) 2274 : cluster [DBG] pgmap v1281: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:08.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:31:08 gibba015 bash[29377]: audit 2021-03-10T14:31:07.542749+0000 mgr.gibba045.orlgmj (mgr.34412) 2275 : audit [DBG] from='client.55570 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:31:08.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:31:08 gibba015 bash[29377]: audit 2021-03-10T14:31:08.035592+0000 mon.a (mon.0) 894 : audit [DBG] from='client.? 172.21.2.115:0/1385513586' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:31:08.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:31:08 gibba015 bash[30343]: cluster 2021-03-10T14:31:06.724053+0000 mgr.gibba045.orlgmj (mgr.34412) 2274 : cluster [DBG] pgmap v1281: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:08.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:31:08 gibba015 bash[30343]: audit 2021-03-10T14:31:07.542749+0000 mgr.gibba045.orlgmj (mgr.34412) 2275 : audit [DBG] from='client.55570 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:31:08.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:31:08 gibba015 bash[30343]: audit 2021-03-10T14:31:08.035592+0000 mon.a (mon.0) 894 : audit [DBG] from='client.? 172.21.2.115:0/1385513586' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:31:09.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:31:08 gibba045 bash[25517]: cluster 2021-03-10T14:31:06.724053+0000 mgr.gibba045.orlgmj (mgr.34412) 2274 : cluster [DBG] pgmap v1281: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:09.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:31:08 gibba045 bash[25517]: audit 2021-03-10T14:31:07.542749+0000 mgr.gibba045.orlgmj (mgr.34412) 2275 : audit [DBG] from='client.55570 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:31:09.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:31:08 gibba045 bash[25517]: audit 2021-03-10T14:31:08.035592+0000 mon.a (mon.0) 894 : audit [DBG] from='client.? 172.21.2.115:0/1385513586' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:31:09.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:31:09 gibba015 bash[29377]: audit 2021-03-10T14:31:07.771952+0000 mgr.gibba045.orlgmj (mgr.34412) 2276 : audit [DBG] from='client.45588 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:31:09.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:31:09 gibba015 bash[30343]: audit 2021-03-10T14:31:07.771952+0000 mgr.gibba045.orlgmj (mgr.34412) 2276 : audit [DBG] from='client.45588 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:31:10.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:31:09 gibba045 bash[25517]: audit 2021-03-10T14:31:07.771952+0000 mgr.gibba045.orlgmj (mgr.34412) 2276 : audit [DBG] from='client.45588 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:31:10.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:31:10 gibba015 bash[29377]: cluster 2021-03-10T14:31:08.725328+0000 mgr.gibba045.orlgmj (mgr.34412) 2277 : cluster [DBG] pgmap v1282: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:10.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:31:10 gibba015 bash[30343]: cluster 2021-03-10T14:31:08.725328+0000 mgr.gibba045.orlgmj (mgr.34412) 2277 : cluster [DBG] pgmap v1282: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:11.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:31:10 gibba045 bash[25517]: cluster 2021-03-10T14:31:08.725328+0000 mgr.gibba045.orlgmj (mgr.34412) 2277 : cluster [DBG] pgmap v1282: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:12.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:31:12 gibba015 bash[29377]: cluster 2021-03-10T14:31:10.726967+0000 mgr.gibba045.orlgmj (mgr.34412) 2278 : cluster [DBG] pgmap v1283: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:12.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:31:12 gibba015 bash[30343]: cluster 2021-03-10T14:31:10.726967+0000 mgr.gibba045.orlgmj (mgr.34412) 2278 : cluster [DBG] pgmap v1283: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:13.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:31:12 gibba045 bash[25517]: cluster 2021-03-10T14:31:10.726967+0000 mgr.gibba045.orlgmj (mgr.34412) 2278 : cluster [DBG] pgmap v1283: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:14.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:31:14 gibba015 bash[29377]: cluster 2021-03-10T14:31:12.728600+0000 mgr.gibba045.orlgmj (mgr.34412) 2279 : cluster [DBG] pgmap v1284: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:14.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:31:14 gibba015 bash[30343]: cluster 2021-03-10T14:31:12.728600+0000 mgr.gibba045.orlgmj (mgr.34412) 2279 : cluster [DBG] pgmap v1284: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:15.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:31:14 gibba045 bash[25517]: cluster 2021-03-10T14:31:12.728600+0000 mgr.gibba045.orlgmj (mgr.34412) 2279 : cluster [DBG] pgmap v1284: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:16.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:31:16 gibba015 bash[29377]: cluster 2021-03-10T14:31:14.730277+0000 mgr.gibba045.orlgmj (mgr.34412) 2280 : cluster [DBG] pgmap v1285: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:16.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:31:16 gibba015 bash[29377]: cephadm 2021-03-10T14:31:15.585385+0000 mgr.gibba045.orlgmj (mgr.34412) 2281 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:31:16.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:31:16 gibba015 bash[30343]: cluster 2021-03-10T14:31:14.730277+0000 mgr.gibba045.orlgmj (mgr.34412) 2280 : cluster [DBG] pgmap v1285: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:16.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:31:16 gibba015 bash[30343]: cephadm 2021-03-10T14:31:15.585385+0000 mgr.gibba045.orlgmj (mgr.34412) 2281 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:31:17.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:31:16 gibba045 bash[25517]: cluster 2021-03-10T14:31:14.730277+0000 mgr.gibba045.orlgmj (mgr.34412) 2280 : cluster [DBG] pgmap v1285: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:17.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:31:16 gibba045 bash[25517]: cephadm 2021-03-10T14:31:15.585385+0000 mgr.gibba045.orlgmj (mgr.34412) 2281 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:31:18.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:31:18 gibba015 bash[29377]: cluster 2021-03-10T14:31:16.732007+0000 mgr.gibba045.orlgmj (mgr.34412) 2282 : cluster [DBG] pgmap v1286: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:18.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:31:18 gibba015 bash[30343]: cluster 2021-03-10T14:31:16.732007+0000 mgr.gibba045.orlgmj (mgr.34412) 2282 : cluster [DBG] pgmap v1286: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:19.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:31:18 gibba045 bash[25517]: cluster 2021-03-10T14:31:16.732007+0000 mgr.gibba045.orlgmj (mgr.34412) 2282 : cluster [DBG] pgmap v1286: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:20.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:31:20 gibba015 bash[29377]: cluster 2021-03-10T14:31:18.733355+0000 mgr.gibba045.orlgmj (mgr.34412) 2283 : cluster [DBG] pgmap v1287: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:20.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:31:20 gibba015 bash[30343]: cluster 2021-03-10T14:31:18.733355+0000 mgr.gibba045.orlgmj (mgr.34412) 2283 : cluster [DBG] pgmap v1287: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:21.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:31:20 gibba045 bash[25517]: cluster 2021-03-10T14:31:18.733355+0000 mgr.gibba045.orlgmj (mgr.34412) 2283 : cluster [DBG] pgmap v1287: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:22.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:31:22 gibba015 bash[29377]: cluster 2021-03-10T14:31:20.734703+0000 mgr.gibba045.orlgmj (mgr.34412) 2284 : cluster [DBG] pgmap v1288: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:22.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:31:22 gibba015 bash[30343]: cluster 2021-03-10T14:31:20.734703+0000 mgr.gibba045.orlgmj (mgr.34412) 2284 : cluster [DBG] pgmap v1288: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:23.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:31:22 gibba045 bash[25517]: cluster 2021-03-10T14:31:20.734703+0000 mgr.gibba045.orlgmj (mgr.34412) 2284 : cluster [DBG] pgmap v1288: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:24.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:31:24 gibba015 bash[29377]: cluster 2021-03-10T14:31:22.735644+0000 mgr.gibba045.orlgmj (mgr.34412) 2285 : cluster [DBG] pgmap v1289: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:24.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:31:24 gibba015 bash[30343]: cluster 2021-03-10T14:31:22.735644+0000 mgr.gibba045.orlgmj (mgr.34412) 2285 : cluster [DBG] pgmap v1289: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:25.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:31:24 gibba045 bash[25517]: cluster 2021-03-10T14:31:22.735644+0000 mgr.gibba045.orlgmj (mgr.34412) 2285 : cluster [DBG] pgmap v1289: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:26.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:31:26 gibba015 bash[29377]: cluster 2021-03-10T14:31:24.736945+0000 mgr.gibba045.orlgmj (mgr.34412) 2286 : cluster [DBG] pgmap v1290: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:26.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:31:26 gibba015 bash[30343]: cluster 2021-03-10T14:31:24.736945+0000 mgr.gibba045.orlgmj (mgr.34412) 2286 : cluster [DBG] pgmap v1290: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:27.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:31:26 gibba045 bash[25517]: cluster 2021-03-10T14:31:24.736945+0000 mgr.gibba045.orlgmj (mgr.34412) 2286 : cluster [DBG] pgmap v1290: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:28.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:31:28 gibba015 bash[29377]: cluster 2021-03-10T14:31:26.738407+0000 mgr.gibba045.orlgmj (mgr.34412) 2287 : cluster [DBG] pgmap v1291: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:29.014 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:31:28 gibba015 bash[30343]: cluster 2021-03-10T14:31:26.738407+0000 mgr.gibba045.orlgmj (mgr.34412) 2287 : cluster [DBG] pgmap v1291: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:29.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:31:28 gibba045 bash[25517]: cluster 2021-03-10T14:31:26.738407+0000 mgr.gibba045.orlgmj (mgr.34412) 2287 : cluster [DBG] pgmap v1291: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:30.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:31:30 gibba015 bash[29377]: cluster 2021-03-10T14:31:28.739088+0000 mgr.gibba045.orlgmj (mgr.34412) 2288 : cluster [DBG] pgmap v1292: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:30.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:31:30 gibba015 bash[30343]: cluster 2021-03-10T14:31:28.739088+0000 mgr.gibba045.orlgmj (mgr.34412) 2288 : cluster [DBG] pgmap v1292: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:31.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:31:30 gibba045 bash[25517]: cluster 2021-03-10T14:31:28.739088+0000 mgr.gibba045.orlgmj (mgr.34412) 2288 : cluster [DBG] pgmap v1292: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:31.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:31:31 gibba015 bash[29377]: cephadm 2021-03-10T14:31:30.601392+0000 mgr.gibba045.orlgmj (mgr.34412) 2289 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:31:31.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:31:31 gibba015 bash[30343]: cephadm 2021-03-10T14:31:30.601392+0000 mgr.gibba045.orlgmj (mgr.34412) 2289 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:31:32.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:31:31 gibba045 bash[25517]: cephadm 2021-03-10T14:31:30.601392+0000 mgr.gibba045.orlgmj (mgr.34412) 2289 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:31:32.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:31:32 gibba015 bash[29377]: cluster 2021-03-10T14:31:30.739870+0000 mgr.gibba045.orlgmj (mgr.34412) 2290 : cluster [DBG] pgmap v1293: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:32.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:31:32 gibba015 bash[30343]: cluster 2021-03-10T14:31:30.739870+0000 mgr.gibba045.orlgmj (mgr.34412) 2290 : cluster [DBG] pgmap v1293: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:33.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:31:32 gibba045 bash[25517]: cluster 2021-03-10T14:31:30.739870+0000 mgr.gibba045.orlgmj (mgr.34412) 2290 : cluster [DBG] pgmap v1293: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:35.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:31:34 gibba045 bash[25517]: cluster 2021-03-10T14:31:32.740493+0000 mgr.gibba045.orlgmj (mgr.34412) 2291 : cluster [DBG] pgmap v1294: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:35.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:31:34 gibba015 bash[29377]: cluster 2021-03-10T14:31:32.740493+0000 mgr.gibba045.orlgmj (mgr.34412) 2291 : cluster [DBG] pgmap v1294: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:35.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:31:34 gibba015 bash[30343]: cluster 2021-03-10T14:31:32.740493+0000 mgr.gibba045.orlgmj (mgr.34412) 2291 : cluster [DBG] pgmap v1294: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:36.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:31:35 gibba045 bash[25517]: cluster 2021-03-10T14:31:34.741007+0000 mgr.gibba045.orlgmj (mgr.34412) 2292 : cluster [DBG] pgmap v1295: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:36.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:31:35 gibba015 bash[29377]: cluster 2021-03-10T14:31:34.741007+0000 mgr.gibba045.orlgmj (mgr.34412) 2292 : cluster [DBG] pgmap v1295: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:36.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:31:35 gibba015 bash[30343]: cluster 2021-03-10T14:31:34.741007+0000 mgr.gibba045.orlgmj (mgr.34412) 2292 : cluster [DBG] pgmap v1295: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:38.283 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:31:38.512 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:31:38.512 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (42m) 7m ago 47m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:31:38.512 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (47m) 6m ago 47m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:31:38.513 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (42m) 6m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:31:38.513 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (43m) 6m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:31:38.513 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (42m) 7m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:31:38.513 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (41m) 7m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:31:38.514 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (41m) 6m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:31:38.514 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (41m) 7m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:31:38.514 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (47m) 7m ago 47m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:31:38.514 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (47m) 6m ago 47m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:31:38.514 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (40m) 7m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:31:38.515 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (40m) 7m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:31:38.515 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (39m) 7m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:31:38.515 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (39m) 7m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:31:38.515 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (38m) 6m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:31:38.516 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (38m) 6m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:31:38.516 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (38m) 6m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:31:38.516 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (37m) 6m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:31:38.516 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (47m) 6m ago 47m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:31:38.517 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 6m ago 45m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:31:38.763 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:31:38.763 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:31:38.764 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:31:38.764 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:31:38.764 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:31:38.764 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:31:38.765 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:31:38.765 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:31:38.765 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:31:38.765 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:31:38.765 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:31:38.766 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:31:38.766 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:31:38.766 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:31:38.766 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:31:38.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:31:38 gibba015 bash[29377]: cluster 2021-03-10T14:31:36.742598+0000 mgr.gibba045.orlgmj (mgr.34412) 2293 : cluster [DBG] pgmap v1296: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:38.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:31:38 gibba015 bash[30343]: cluster 2021-03-10T14:31:36.742598+0000 mgr.gibba045.orlgmj (mgr.34412) 2293 : cluster [DBG] pgmap v1296: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:39.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:31:38 gibba045 bash[25517]: cluster 2021-03-10T14:31:36.742598+0000 mgr.gibba045.orlgmj (mgr.34412) 2293 : cluster [DBG] pgmap v1296: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:39.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:31:39 gibba015 bash[29377]: audit 2021-03-10T14:31:38.275412+0000 mgr.gibba045.orlgmj (mgr.34412) 2294 : audit [DBG] from='client.45600 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:31:39.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:31:39 gibba015 bash[29377]: audit 2021-03-10T14:31:38.500649+0000 mgr.gibba045.orlgmj (mgr.34412) 2295 : audit [DBG] from='client.45606 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:31:39.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:31:39 gibba015 bash[29377]: audit 2021-03-10T14:31:38.760740+0000 mon.a (mon.0) 895 : audit [DBG] from='client.? 172.21.2.115:0/2063952011' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:31:39.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:31:39 gibba015 bash[30343]: audit 2021-03-10T14:31:38.275412+0000 mgr.gibba045.orlgmj (mgr.34412) 2294 : audit [DBG] from='client.45600 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:31:39.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:31:39 gibba015 bash[30343]: audit 2021-03-10T14:31:38.500649+0000 mgr.gibba045.orlgmj (mgr.34412) 2295 : audit [DBG] from='client.45606 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:31:39.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:31:39 gibba015 bash[30343]: audit 2021-03-10T14:31:38.760740+0000 mon.a (mon.0) 895 : audit [DBG] from='client.? 172.21.2.115:0/2063952011' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:31:40.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:31:39 gibba045 bash[25517]: audit 2021-03-10T14:31:38.275412+0000 mgr.gibba045.orlgmj (mgr.34412) 2294 : audit [DBG] from='client.45600 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:31:40.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:31:39 gibba045 bash[25517]: audit 2021-03-10T14:31:38.500649+0000 mgr.gibba045.orlgmj (mgr.34412) 2295 : audit [DBG] from='client.45606 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:31:40.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:31:39 gibba045 bash[25517]: audit 2021-03-10T14:31:38.760740+0000 mon.a (mon.0) 895 : audit [DBG] from='client.? 172.21.2.115:0/2063952011' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:31:40.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:31:40 gibba015 bash[29377]: cluster 2021-03-10T14:31:38.743886+0000 mgr.gibba045.orlgmj (mgr.34412) 2296 : cluster [DBG] pgmap v1297: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:40.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:31:40 gibba015 bash[30343]: cluster 2021-03-10T14:31:38.743886+0000 mgr.gibba045.orlgmj (mgr.34412) 2296 : cluster [DBG] pgmap v1297: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:41.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:31:40 gibba045 bash[25517]: cluster 2021-03-10T14:31:38.743886+0000 mgr.gibba045.orlgmj (mgr.34412) 2296 : cluster [DBG] pgmap v1297: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:42.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:31:42 gibba015 bash[29377]: cluster 2021-03-10T14:31:40.745673+0000 mgr.gibba045.orlgmj (mgr.34412) 2297 : cluster [DBG] pgmap v1298: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:42.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:31:42 gibba015 bash[30343]: cluster 2021-03-10T14:31:40.745673+0000 mgr.gibba045.orlgmj (mgr.34412) 2297 : cluster [DBG] pgmap v1298: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:43.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:31:42 gibba045 bash[25517]: cluster 2021-03-10T14:31:40.745673+0000 mgr.gibba045.orlgmj (mgr.34412) 2297 : cluster [DBG] pgmap v1298: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:44.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:31:44 gibba015 bash[29377]: cluster 2021-03-10T14:31:42.747266+0000 mgr.gibba045.orlgmj (mgr.34412) 2298 : cluster [DBG] pgmap v1299: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:44.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:31:44 gibba015 bash[30343]: cluster 2021-03-10T14:31:42.747266+0000 mgr.gibba045.orlgmj (mgr.34412) 2298 : cluster [DBG] pgmap v1299: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:45.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:31:44 gibba045 bash[25517]: cluster 2021-03-10T14:31:42.747266+0000 mgr.gibba045.orlgmj (mgr.34412) 2298 : cluster [DBG] pgmap v1299: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:45.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:31:45 gibba015 bash[29377]: audit 2021-03-10T14:31:45.609387+0000 mon.c (mon.1) 687 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:31:45.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:31:45 gibba015 bash[30343]: audit 2021-03-10T14:31:45.609387+0000 mon.c (mon.1) 687 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:31:46.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:31:45 gibba045 bash[25517]: audit 2021-03-10T14:31:45.609387+0000 mon.c (mon.1) 687 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:31:46.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:31:46 gibba015 bash[29377]: cluster 2021-03-10T14:31:44.748783+0000 mgr.gibba045.orlgmj (mgr.34412) 2299 : cluster [DBG] pgmap v1300: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:46.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:31:46 gibba015 bash[29377]: cephadm 2021-03-10T14:31:45.618669+0000 mgr.gibba045.orlgmj (mgr.34412) 2300 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:31:46.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:31:46 gibba015 bash[29377]: cephadm 2021-03-10T14:31:45.620569+0000 mgr.gibba045.orlgmj (mgr.34412) 2301 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:31:46.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:31:46 gibba015 bash[29377]: audit 2021-03-10T14:31:45.810487+0000 mon.a (mon.0) 896 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:31:46.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:31:46 gibba015 bash[29377]: audit 2021-03-10T14:31:45.814390+0000 mon.c (mon.1) 688 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:31:46.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:31:46 gibba015 bash[29377]: audit 2021-03-10T14:31:45.815668+0000 mon.c (mon.1) 689 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:31:46.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:31:46 gibba015 bash[29377]: audit 2021-03-10T14:31:45.816846+0000 mon.c (mon.1) 690 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:31:46.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:31:46 gibba015 bash[29377]: audit 2021-03-10T14:31:45.818039+0000 mon.c (mon.1) 691 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:31:46.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:31:46 gibba015 bash[29377]: audit 2021-03-10T14:31:45.820736+0000 mon.c (mon.1) 692 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:31:46.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:31:46 gibba015 bash[29377]: audit 2021-03-10T14:31:45.822139+0000 mon.c (mon.1) 693 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:31:46.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:31:46 gibba015 bash[30343]: cluster 2021-03-10T14:31:44.748783+0000 mgr.gibba045.orlgmj (mgr.34412) 2299 : cluster [DBG] pgmap v1300: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:46.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:31:46 gibba015 bash[30343]: cephadm 2021-03-10T14:31:45.618669+0000 mgr.gibba045.orlgmj (mgr.34412) 2300 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:31:46.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:31:46 gibba015 bash[30343]: cephadm 2021-03-10T14:31:45.620569+0000 mgr.gibba045.orlgmj (mgr.34412) 2301 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:31:46.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:31:46 gibba015 bash[30343]: audit 2021-03-10T14:31:45.810487+0000 mon.a (mon.0) 896 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:31:46.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:31:46 gibba015 bash[30343]: audit 2021-03-10T14:31:45.814390+0000 mon.c (mon.1) 688 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:31:46.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:31:46 gibba015 bash[30343]: audit 2021-03-10T14:31:45.815668+0000 mon.c (mon.1) 689 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:31:46.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:31:46 gibba015 bash[30343]: audit 2021-03-10T14:31:45.816846+0000 mon.c (mon.1) 690 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:31:46.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:31:46 gibba015 bash[30343]: audit 2021-03-10T14:31:45.818039+0000 mon.c (mon.1) 691 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:31:46.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:31:46 gibba015 bash[30343]: audit 2021-03-10T14:31:45.820736+0000 mon.c (mon.1) 692 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:31:46.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:31:46 gibba015 bash[30343]: audit 2021-03-10T14:31:45.822139+0000 mon.c (mon.1) 693 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:31:47.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:31:46 gibba045 bash[25517]: cluster 2021-03-10T14:31:44.748783+0000 mgr.gibba045.orlgmj (mgr.34412) 2299 : cluster [DBG] pgmap v1300: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:47.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:31:46 gibba045 bash[25517]: cephadm 2021-03-10T14:31:45.618669+0000 mgr.gibba045.orlgmj (mgr.34412) 2300 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:31:47.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:31:46 gibba045 bash[25517]: cephadm 2021-03-10T14:31:45.620569+0000 mgr.gibba045.orlgmj (mgr.34412) 2301 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:31:47.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:31:46 gibba045 bash[25517]: audit 2021-03-10T14:31:45.810487+0000 mon.a (mon.0) 896 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:31:47.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:31:46 gibba045 bash[25517]: audit 2021-03-10T14:31:45.814390+0000 mon.c (mon.1) 688 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:31:47.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:31:46 gibba045 bash[25517]: audit 2021-03-10T14:31:45.815668+0000 mon.c (mon.1) 689 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:31:47.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:31:46 gibba045 bash[25517]: audit 2021-03-10T14:31:45.816846+0000 mon.c (mon.1) 690 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:31:47.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:31:46 gibba045 bash[25517]: audit 2021-03-10T14:31:45.818039+0000 mon.c (mon.1) 691 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:31:47.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:31:46 gibba045 bash[25517]: audit 2021-03-10T14:31:45.820736+0000 mon.c (mon.1) 692 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:31:47.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:31:46 gibba045 bash[25517]: audit 2021-03-10T14:31:45.822139+0000 mon.c (mon.1) 693 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:31:47.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:31:47 gibba015 bash[29377]: cephadm 2021-03-10T14:31:45.817188+0000 mgr.gibba045.orlgmj (mgr.34412) 2302 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:31:47.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:31:47 gibba015 bash[29377]: cephadm 2021-03-10T14:31:45.818851+0000 mgr.gibba045.orlgmj (mgr.34412) 2303 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:31:47.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:31:47 gibba015 bash[29377]: cephadm 2021-03-10T14:31:45.820004+0000 mgr.gibba045.orlgmj (mgr.34412) 2304 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:31:47.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:31:47 gibba015 bash[29377]: cephadm 2021-03-10T14:31:45.820040+0000 mgr.gibba045.orlgmj (mgr.34412) 2305 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:31:47.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:31:47 gibba015 bash[29377]: cephadm 2021-03-10T14:31:45.821211+0000 mgr.gibba045.orlgmj (mgr.34412) 2306 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:31:47.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:31:47 gibba015 bash[29377]: cephadm 2021-03-10T14:31:45.821250+0000 mgr.gibba045.orlgmj (mgr.34412) 2307 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:31:47.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:31:47 gibba015 bash[29377]: cephadm 2021-03-10T14:31:45.822333+0000 mgr.gibba045.orlgmj (mgr.34412) 2308 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:31:47.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:31:47 gibba015 bash[29377]: cephadm 2021-03-10T14:31:45.823807+0000 mgr.gibba045.orlgmj (mgr.34412) 2309 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:31:47.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:31:47 gibba015 bash[29377]: cephadm 2021-03-10T14:31:45.823844+0000 mgr.gibba045.orlgmj (mgr.34412) 2310 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:31:47.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:31:47 gibba015 bash[29377]: cephadm 2021-03-10T14:31:45.825080+0000 mgr.gibba045.orlgmj (mgr.34412) 2311 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:31:47.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:31:47 gibba015 bash[29377]: cephadm 2021-03-10T14:31:45.825400+0000 mgr.gibba045.orlgmj (mgr.34412) 2312 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:31:47.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:31:47 gibba015 bash[29377]: cephadm 2021-03-10T14:31:45.826744+0000 mgr.gibba045.orlgmj (mgr.34412) 2313 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:31:47.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:31:47 gibba015 bash[29377]: cephadm 2021-03-10T14:31:45.826781+0000 mgr.gibba045.orlgmj (mgr.34412) 2314 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:31:47.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:31:47 gibba015 bash[29377]: cephadm 2021-03-10T14:31:45.826888+0000 mgr.gibba045.orlgmj (mgr.34412) 2315 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:31:47.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:31:47 gibba015 bash[30343]: cephadm 2021-03-10T14:31:45.817188+0000 mgr.gibba045.orlgmj (mgr.34412) 2302 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:31:47.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:31:47 gibba015 bash[30343]: cephadm 2021-03-10T14:31:45.818851+0000 mgr.gibba045.orlgmj (mgr.34412) 2303 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:31:47.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:31:47 gibba015 bash[30343]: cephadm 2021-03-10T14:31:45.820004+0000 mgr.gibba045.orlgmj (mgr.34412) 2304 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:31:47.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:31:47 gibba015 bash[30343]: cephadm 2021-03-10T14:31:45.820040+0000 mgr.gibba045.orlgmj (mgr.34412) 2305 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:31:47.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:31:47 gibba015 bash[30343]: cephadm 2021-03-10T14:31:45.821211+0000 mgr.gibba045.orlgmj (mgr.34412) 2306 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:31:47.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:31:47 gibba015 bash[30343]: cephadm 2021-03-10T14:31:45.821250+0000 mgr.gibba045.orlgmj (mgr.34412) 2307 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:31:47.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:31:47 gibba015 bash[30343]: cephadm 2021-03-10T14:31:45.822333+0000 mgr.gibba045.orlgmj (mgr.34412) 2308 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:31:47.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:31:47 gibba015 bash[30343]: cephadm 2021-03-10T14:31:45.823807+0000 mgr.gibba045.orlgmj (mgr.34412) 2309 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:31:47.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:31:47 gibba015 bash[30343]: cephadm 2021-03-10T14:31:45.823844+0000 mgr.gibba045.orlgmj (mgr.34412) 2310 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:31:47.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:31:47 gibba015 bash[30343]: cephadm 2021-03-10T14:31:45.825080+0000 mgr.gibba045.orlgmj (mgr.34412) 2311 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:31:47.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:31:47 gibba015 bash[30343]: cephadm 2021-03-10T14:31:45.825400+0000 mgr.gibba045.orlgmj (mgr.34412) 2312 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:31:47.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:31:47 gibba015 bash[30343]: cephadm 2021-03-10T14:31:45.826744+0000 mgr.gibba045.orlgmj (mgr.34412) 2313 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:31:47.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:31:47 gibba015 bash[30343]: cephadm 2021-03-10T14:31:45.826781+0000 mgr.gibba045.orlgmj (mgr.34412) 2314 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:31:47.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:31:47 gibba015 bash[30343]: cephadm 2021-03-10T14:31:45.826888+0000 mgr.gibba045.orlgmj (mgr.34412) 2315 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:31:48.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:31:47 gibba045 bash[25517]: cephadm 2021-03-10T14:31:45.817188+0000 mgr.gibba045.orlgmj (mgr.34412) 2302 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:31:48.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:31:47 gibba045 bash[25517]: cephadm 2021-03-10T14:31:45.818851+0000 mgr.gibba045.orlgmj (mgr.34412) 2303 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:31:48.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:31:47 gibba045 bash[25517]: cephadm 2021-03-10T14:31:45.820004+0000 mgr.gibba045.orlgmj (mgr.34412) 2304 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:31:48.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:31:47 gibba045 bash[25517]: cephadm 2021-03-10T14:31:45.820040+0000 mgr.gibba045.orlgmj (mgr.34412) 2305 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:31:48.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:31:47 gibba045 bash[25517]: cephadm 2021-03-10T14:31:45.821211+0000 mgr.gibba045.orlgmj (mgr.34412) 2306 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:31:48.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:31:47 gibba045 bash[25517]: cephadm 2021-03-10T14:31:45.821250+0000 mgr.gibba045.orlgmj (mgr.34412) 2307 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:31:48.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:31:47 gibba045 bash[25517]: cephadm 2021-03-10T14:31:45.822333+0000 mgr.gibba045.orlgmj (mgr.34412) 2308 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:31:48.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:31:47 gibba045 bash[25517]: cephadm 2021-03-10T14:31:45.823807+0000 mgr.gibba045.orlgmj (mgr.34412) 2309 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:31:48.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:31:47 gibba045 bash[25517]: cephadm 2021-03-10T14:31:45.823844+0000 mgr.gibba045.orlgmj (mgr.34412) 2310 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:31:48.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:31:47 gibba045 bash[25517]: cephadm 2021-03-10T14:31:45.825080+0000 mgr.gibba045.orlgmj (mgr.34412) 2311 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:31:48.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:31:47 gibba045 bash[25517]: cephadm 2021-03-10T14:31:45.825400+0000 mgr.gibba045.orlgmj (mgr.34412) 2312 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:31:48.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:31:47 gibba045 bash[25517]: cephadm 2021-03-10T14:31:45.826744+0000 mgr.gibba045.orlgmj (mgr.34412) 2313 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:31:48.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:31:47 gibba045 bash[25517]: cephadm 2021-03-10T14:31:45.826781+0000 mgr.gibba045.orlgmj (mgr.34412) 2314 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:31:48.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:31:47 gibba045 bash[25517]: cephadm 2021-03-10T14:31:45.826888+0000 mgr.gibba045.orlgmj (mgr.34412) 2315 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:31:48.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:31:48 gibba015 bash[29377]: cluster 2021-03-10T14:31:46.750251+0000 mgr.gibba045.orlgmj (mgr.34412) 2316 : cluster [DBG] pgmap v1301: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:48.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:31:48 gibba015 bash[30343]: cluster 2021-03-10T14:31:46.750251+0000 mgr.gibba045.orlgmj (mgr.34412) 2316 : cluster [DBG] pgmap v1301: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:49.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:31:48 gibba045 bash[25517]: cluster 2021-03-10T14:31:46.750251+0000 mgr.gibba045.orlgmj (mgr.34412) 2316 : cluster [DBG] pgmap v1301: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:50.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:31:50 gibba015 bash[29377]: cluster 2021-03-10T14:31:48.751518+0000 mgr.gibba045.orlgmj (mgr.34412) 2317 : cluster [DBG] pgmap v1302: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:50.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:31:50 gibba015 bash[30343]: cluster 2021-03-10T14:31:48.751518+0000 mgr.gibba045.orlgmj (mgr.34412) 2317 : cluster [DBG] pgmap v1302: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:51.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:31:50 gibba045 bash[25517]: cluster 2021-03-10T14:31:48.751518+0000 mgr.gibba045.orlgmj (mgr.34412) 2317 : cluster [DBG] pgmap v1302: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:52.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:31:52 gibba015 bash[29377]: cluster 2021-03-10T14:31:50.753224+0000 mgr.gibba045.orlgmj (mgr.34412) 2318 : cluster [DBG] pgmap v1303: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:52.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:31:52 gibba015 bash[30343]: cluster 2021-03-10T14:31:50.753224+0000 mgr.gibba045.orlgmj (mgr.34412) 2318 : cluster [DBG] pgmap v1303: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:53.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:31:52 gibba045 bash[25517]: cluster 2021-03-10T14:31:50.753224+0000 mgr.gibba045.orlgmj (mgr.34412) 2318 : cluster [DBG] pgmap v1303: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:53.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:31:53 gibba015 bash[29377]: audit 2021-03-10T14:31:52.725808+0000 mon.c (mon.1) 694 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:31:53.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:31:53 gibba015 bash[29377]: audit 2021-03-10T14:31:52.726497+0000 mon.c (mon.1) 695 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:31:53.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:31:53 gibba015 bash[29377]: audit 2021-03-10T14:31:52.727054+0000 mon.a (mon.0) 897 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:31:53.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:31:53 gibba015 bash[29377]: audit 2021-03-10T14:31:52.727097+0000 mon.c (mon.1) 696 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T14:31:53.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:31:53 gibba015 bash[29377]: audit 2021-03-10T14:31:52.727987+0000 mon.c (mon.1) 697 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:31:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:31:53 gibba015 bash[29377]: audit 2021-03-10T14:31:52.728350+0000 mon.a (mon.0) 898 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:31:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:31:53 gibba015 bash[29377]: audit 2021-03-10T14:31:52.728656+0000 mon.c (mon.1) 698 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:31:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:31:53 gibba015 bash[29377]: audit 2021-03-10T14:31:52.729181+0000 mon.a (mon.0) 899 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T14:31:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:31:53 gibba015 bash[29377]: audit 2021-03-10T14:31:52.729239+0000 mon.c (mon.1) 699 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:31:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:31:53 gibba015 bash[29377]: audit 2021-03-10T14:31:52.729489+0000 mon.a (mon.0) 900 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:31:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:31:53 gibba015 bash[29377]: audit 2021-03-10T14:31:52.729775+0000 mon.a (mon.0) 901 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:31:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:31:53 gibba015 bash[29377]: audit 2021-03-10T14:31:52.729999+0000 mon.a (mon.0) 902 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:31:53.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:31:53 gibba015 bash[30343]: audit 2021-03-10T14:31:52.725808+0000 mon.c (mon.1) 694 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:31:53.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:31:53 gibba015 bash[30343]: audit 2021-03-10T14:31:52.726497+0000 mon.c (mon.1) 695 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:31:53.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:31:53 gibba015 bash[30343]: audit 2021-03-10T14:31:52.727054+0000 mon.a (mon.0) 897 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:31:53.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:31:53 gibba015 bash[30343]: audit 2021-03-10T14:31:52.727097+0000 mon.c (mon.1) 696 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T14:31:53.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:31:53 gibba015 bash[30343]: audit 2021-03-10T14:31:52.727987+0000 mon.c (mon.1) 697 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:31:53.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:31:53 gibba015 bash[30343]: audit 2021-03-10T14:31:52.728350+0000 mon.a (mon.0) 898 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:31:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:31:53 gibba015 bash[30343]: audit 2021-03-10T14:31:52.728656+0000 mon.c (mon.1) 698 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:31:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:31:53 gibba015 bash[30343]: audit 2021-03-10T14:31:52.729181+0000 mon.a (mon.0) 899 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T14:31:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:31:53 gibba015 bash[30343]: audit 2021-03-10T14:31:52.729239+0000 mon.c (mon.1) 699 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:31:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:31:53 gibba015 bash[30343]: audit 2021-03-10T14:31:52.729489+0000 mon.a (mon.0) 900 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:31:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:31:53 gibba015 bash[30343]: audit 2021-03-10T14:31:52.729775+0000 mon.a (mon.0) 901 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:31:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:31:53 gibba015 bash[30343]: audit 2021-03-10T14:31:52.729999+0000 mon.a (mon.0) 902 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:31:54.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:31:53 gibba045 bash[25517]: audit 2021-03-10T14:31:52.725808+0000 mon.c (mon.1) 694 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:31:54.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:31:53 gibba045 bash[25517]: audit 2021-03-10T14:31:52.726497+0000 mon.c (mon.1) 695 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:31:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:31:53 gibba045 bash[25517]: audit 2021-03-10T14:31:52.727054+0000 mon.a (mon.0) 897 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:31:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:31:53 gibba045 bash[25517]: audit 2021-03-10T14:31:52.727097+0000 mon.c (mon.1) 696 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T14:31:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:31:53 gibba045 bash[25517]: audit 2021-03-10T14:31:52.727987+0000 mon.c (mon.1) 697 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:31:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:31:53 gibba045 bash[25517]: audit 2021-03-10T14:31:52.728350+0000 mon.a (mon.0) 898 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:31:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:31:53 gibba045 bash[25517]: audit 2021-03-10T14:31:52.728656+0000 mon.c (mon.1) 698 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:31:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:31:53 gibba045 bash[25517]: audit 2021-03-10T14:31:52.729181+0000 mon.a (mon.0) 899 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T14:31:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:31:53 gibba045 bash[25517]: audit 2021-03-10T14:31:52.729239+0000 mon.c (mon.1) 699 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:31:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:31:53 gibba045 bash[25517]: audit 2021-03-10T14:31:52.729489+0000 mon.a (mon.0) 900 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:31:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:31:53 gibba045 bash[25517]: audit 2021-03-10T14:31:52.729775+0000 mon.a (mon.0) 901 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:31:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:31:53 gibba045 bash[25517]: audit 2021-03-10T14:31:52.729999+0000 mon.a (mon.0) 902 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:31:54.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:31:54 gibba015 bash[29377]: cluster 2021-03-10T14:31:52.753889+0000 mgr.gibba045.orlgmj (mgr.34412) 2319 : cluster [DBG] pgmap v1304: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:54.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:31:54 gibba015 bash[30343]: cluster 2021-03-10T14:31:52.753889+0000 mgr.gibba045.orlgmj (mgr.34412) 2319 : cluster [DBG] pgmap v1304: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:55.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:31:54 gibba045 bash[25517]: cluster 2021-03-10T14:31:52.753889+0000 mgr.gibba045.orlgmj (mgr.34412) 2319 : cluster [DBG] pgmap v1304: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:56.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:31:56 gibba015 bash[29377]: cluster 2021-03-10T14:31:54.755271+0000 mgr.gibba045.orlgmj (mgr.34412) 2320 : cluster [DBG] pgmap v1305: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:56.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:31:56 gibba015 bash[30343]: cluster 2021-03-10T14:31:54.755271+0000 mgr.gibba045.orlgmj (mgr.34412) 2320 : cluster [DBG] pgmap v1305: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:57.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:31:56 gibba045 bash[25517]: cluster 2021-03-10T14:31:54.755271+0000 mgr.gibba045.orlgmj (mgr.34412) 2320 : cluster [DBG] pgmap v1305: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:58.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:31:58 gibba015 bash[29377]: cluster 2021-03-10T14:31:56.756456+0000 mgr.gibba045.orlgmj (mgr.34412) 2321 : cluster [DBG] pgmap v1306: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:58.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:31:58 gibba015 bash[30343]: cluster 2021-03-10T14:31:56.756456+0000 mgr.gibba045.orlgmj (mgr.34412) 2321 : cluster [DBG] pgmap v1306: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:59.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:31:58 gibba045 bash[25517]: cluster 2021-03-10T14:31:56.756456+0000 mgr.gibba045.orlgmj (mgr.34412) 2321 : cluster [DBG] pgmap v1306: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:00.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:32:00 gibba015 bash[29377]: cluster 2021-03-10T14:31:58.757628+0000 mgr.gibba045.orlgmj (mgr.34412) 2322 : cluster [DBG] pgmap v1307: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:00.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:32:00 gibba015 bash[30343]: cluster 2021-03-10T14:31:58.757628+0000 mgr.gibba045.orlgmj (mgr.34412) 2322 : cluster [DBG] pgmap v1307: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:01.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:32:00 gibba045 bash[25517]: cluster 2021-03-10T14:31:58.757628+0000 mgr.gibba045.orlgmj (mgr.34412) 2322 : cluster [DBG] pgmap v1307: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:02.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:32:02 gibba015 bash[29377]: cluster 2021-03-10T14:32:00.759110+0000 mgr.gibba045.orlgmj (mgr.34412) 2323 : cluster [DBG] pgmap v1308: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:02.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:32:02 gibba015 bash[29377]: cephadm 2021-03-10T14:32:00.842936+0000 mgr.gibba045.orlgmj (mgr.34412) 2324 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:32:02.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:32:02 gibba015 bash[30343]: cluster 2021-03-10T14:32:00.759110+0000 mgr.gibba045.orlgmj (mgr.34412) 2323 : cluster [DBG] pgmap v1308: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:02.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:32:02 gibba015 bash[30343]: cephadm 2021-03-10T14:32:00.842936+0000 mgr.gibba045.orlgmj (mgr.34412) 2324 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:32:03.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:32:02 gibba045 bash[25517]: cluster 2021-03-10T14:32:00.759110+0000 mgr.gibba045.orlgmj (mgr.34412) 2323 : cluster [DBG] pgmap v1308: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:03.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:32:02 gibba045 bash[25517]: cephadm 2021-03-10T14:32:00.842936+0000 mgr.gibba045.orlgmj (mgr.34412) 2324 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:32:05.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:32:04 gibba045 bash[25517]: cluster 2021-03-10T14:32:02.760519+0000 mgr.gibba045.orlgmj (mgr.34412) 2325 : cluster [DBG] pgmap v1309: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:05.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:32:04 gibba015 bash[29377]: cluster 2021-03-10T14:32:02.760519+0000 mgr.gibba045.orlgmj (mgr.34412) 2325 : cluster [DBG] pgmap v1309: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:05.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:32:04 gibba015 bash[30343]: cluster 2021-03-10T14:32:02.760519+0000 mgr.gibba045.orlgmj (mgr.34412) 2325 : cluster [DBG] pgmap v1309: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:07.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:32:06 gibba045 bash[25517]: cluster 2021-03-10T14:32:04.762267+0000 mgr.gibba045.orlgmj (mgr.34412) 2326 : cluster [DBG] pgmap v1310: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:07.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:32:06 gibba015 bash[29377]: cluster 2021-03-10T14:32:04.762267+0000 mgr.gibba045.orlgmj (mgr.34412) 2326 : cluster [DBG] pgmap v1310: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:07.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:32:06 gibba015 bash[30343]: cluster 2021-03-10T14:32:04.762267+0000 mgr.gibba045.orlgmj (mgr.34412) 2326 : cluster [DBG] pgmap v1310: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:08.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:32:08 gibba015 bash[29377]: cluster 2021-03-10T14:32:06.763734+0000 mgr.gibba045.orlgmj (mgr.34412) 2327 : cluster [DBG] pgmap v1311: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:08.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:32:08 gibba015 bash[30343]: cluster 2021-03-10T14:32:06.763734+0000 mgr.gibba045.orlgmj (mgr.34412) 2327 : cluster [DBG] pgmap v1311: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:09.007 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:32:09.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:32:08 gibba045 bash[25517]: cluster 2021-03-10T14:32:06.763734+0000 mgr.gibba045.orlgmj (mgr.34412) 2327 : cluster [DBG] pgmap v1311: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:09.238 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:32:09.238 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (42m) 8m ago 48m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:32:09.239 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (48m) 7m ago 48m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:32:09.239 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (43m) 7m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:32:09.239 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (43m) 7m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:32:09.239 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (42m) 8m ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:32:09.239 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (42m) 8m ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:32:09.240 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (41m) 7m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:32:09.240 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (42m) 8m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:32:09.240 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (48m) 8m ago 48m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:32:09.240 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (48m) 7m ago 48m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:32:09.240 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (41m) 8m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:32:09.241 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (40m) 8m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:32:09.241 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (40m) 8m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:32:09.241 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (39m) 8m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:32:09.241 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (39m) 7m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:32:09.241 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (39m) 7m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:32:09.242 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (38m) 7m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:32:09.242 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (38m) 7m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:32:09.242 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (47m) 7m ago 48m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:32:09.242 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 7m ago 46m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:32:09.486 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:32:09.487 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:32:09.487 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:32:09.487 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:32:09.487 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:32:09.488 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:32:09.488 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:32:09.488 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:32:09.488 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:32:09.488 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:32:09.489 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:32:09.489 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:32:09.489 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:32:09.489 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:32:09.489 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:32:09.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:32:09 gibba015 bash[29377]: audit 2021-03-10T14:32:09.484342+0000 mon.a (mon.0) 903 : audit [DBG] from='client.? 172.21.2.115:0/2748378036' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:32:09.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:32:09 gibba015 bash[30343]: audit 2021-03-10T14:32:09.484342+0000 mon.a (mon.0) 903 : audit [DBG] from='client.? 172.21.2.115:0/2748378036' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:32:10.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:32:09 gibba045 bash[25517]: audit 2021-03-10T14:32:09.484342+0000 mon.a (mon.0) 903 : audit [DBG] from='client.? 172.21.2.115:0/2748378036' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:32:10.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:32:10 gibba015 bash[29377]: cluster 2021-03-10T14:32:08.765026+0000 mgr.gibba045.orlgmj (mgr.34412) 2328 : cluster [DBG] pgmap v1312: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:10.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:32:10 gibba015 bash[29377]: audit 2021-03-10T14:32:08.998940+0000 mgr.gibba045.orlgmj (mgr.34412) 2329 : audit [DBG] from='client.55606 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:32:10.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:32:10 gibba015 bash[29377]: audit 2021-03-10T14:32:09.227037+0000 mgr.gibba045.orlgmj (mgr.34412) 2330 : audit [DBG] from='client.45624 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:32:10.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:32:10 gibba015 bash[30343]: cluster 2021-03-10T14:32:08.765026+0000 mgr.gibba045.orlgmj (mgr.34412) 2328 : cluster [DBG] pgmap v1312: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:10.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:32:10 gibba015 bash[30343]: audit 2021-03-10T14:32:08.998940+0000 mgr.gibba045.orlgmj (mgr.34412) 2329 : audit [DBG] from='client.55606 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:32:10.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:32:10 gibba015 bash[30343]: audit 2021-03-10T14:32:09.227037+0000 mgr.gibba045.orlgmj (mgr.34412) 2330 : audit [DBG] from='client.45624 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:32:11.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:32:10 gibba045 bash[25517]: cluster 2021-03-10T14:32:08.765026+0000 mgr.gibba045.orlgmj (mgr.34412) 2328 : cluster [DBG] pgmap v1312: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:11.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:32:10 gibba045 bash[25517]: audit 2021-03-10T14:32:08.998940+0000 mgr.gibba045.orlgmj (mgr.34412) 2329 : audit [DBG] from='client.55606 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:32:11.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:32:10 gibba045 bash[25517]: audit 2021-03-10T14:32:09.227037+0000 mgr.gibba045.orlgmj (mgr.34412) 2330 : audit [DBG] from='client.45624 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:32:12.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:32:12 gibba015 bash[29377]: cluster 2021-03-10T14:32:10.766675+0000 mgr.gibba045.orlgmj (mgr.34412) 2331 : cluster [DBG] pgmap v1313: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:12.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:32:12 gibba015 bash[30343]: cluster 2021-03-10T14:32:10.766675+0000 mgr.gibba045.orlgmj (mgr.34412) 2331 : cluster [DBG] pgmap v1313: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:13.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:32:12 gibba045 bash[25517]: cluster 2021-03-10T14:32:10.766675+0000 mgr.gibba045.orlgmj (mgr.34412) 2331 : cluster [DBG] pgmap v1313: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:14.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:32:14 gibba015 bash[29377]: cluster 2021-03-10T14:32:12.768286+0000 mgr.gibba045.orlgmj (mgr.34412) 2332 : cluster [DBG] pgmap v1314: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:14.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:32:14 gibba015 bash[30343]: cluster 2021-03-10T14:32:12.768286+0000 mgr.gibba045.orlgmj (mgr.34412) 2332 : cluster [DBG] pgmap v1314: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:15.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:32:14 gibba045 bash[25517]: cluster 2021-03-10T14:32:12.768286+0000 mgr.gibba045.orlgmj (mgr.34412) 2332 : cluster [DBG] pgmap v1314: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:16.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:32:16 gibba015 bash[29377]: cluster 2021-03-10T14:32:14.770081+0000 mgr.gibba045.orlgmj (mgr.34412) 2333 : cluster [DBG] pgmap v1315: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:16.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:32:16 gibba015 bash[30343]: cluster 2021-03-10T14:32:14.770081+0000 mgr.gibba045.orlgmj (mgr.34412) 2333 : cluster [DBG] pgmap v1315: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:17.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:32:16 gibba045 bash[25517]: cluster 2021-03-10T14:32:14.770081+0000 mgr.gibba045.orlgmj (mgr.34412) 2333 : cluster [DBG] pgmap v1315: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:17.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:32:17 gibba015 bash[29377]: cephadm 2021-03-10T14:32:15.858967+0000 mgr.gibba045.orlgmj (mgr.34412) 2334 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:32:17.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:32:17 gibba015 bash[30343]: cephadm 2021-03-10T14:32:15.858967+0000 mgr.gibba045.orlgmj (mgr.34412) 2334 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:32:18.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:32:17 gibba045 bash[25517]: cephadm 2021-03-10T14:32:15.858967+0000 mgr.gibba045.orlgmj (mgr.34412) 2334 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:32:18.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:32:18 gibba015 bash[29377]: cluster 2021-03-10T14:32:16.771872+0000 mgr.gibba045.orlgmj (mgr.34412) 2335 : cluster [DBG] pgmap v1316: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:18.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:32:18 gibba015 bash[30343]: cluster 2021-03-10T14:32:16.771872+0000 mgr.gibba045.orlgmj (mgr.34412) 2335 : cluster [DBG] pgmap v1316: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:19.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:32:18 gibba045 bash[25517]: cluster 2021-03-10T14:32:16.771872+0000 mgr.gibba045.orlgmj (mgr.34412) 2335 : cluster [DBG] pgmap v1316: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:20.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:32:20 gibba015 bash[29377]: cluster 2021-03-10T14:32:18.773351+0000 mgr.gibba045.orlgmj (mgr.34412) 2336 : cluster [DBG] pgmap v1317: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:20.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:32:20 gibba015 bash[30343]: cluster 2021-03-10T14:32:18.773351+0000 mgr.gibba045.orlgmj (mgr.34412) 2336 : cluster [DBG] pgmap v1317: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:21.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:32:20 gibba045 bash[25517]: cluster 2021-03-10T14:32:18.773351+0000 mgr.gibba045.orlgmj (mgr.34412) 2336 : cluster [DBG] pgmap v1317: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:22.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:32:22 gibba015 bash[29377]: cluster 2021-03-10T14:32:20.774921+0000 mgr.gibba045.orlgmj (mgr.34412) 2337 : cluster [DBG] pgmap v1318: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:22.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:32:22 gibba015 bash[30343]: cluster 2021-03-10T14:32:20.774921+0000 mgr.gibba045.orlgmj (mgr.34412) 2337 : cluster [DBG] pgmap v1318: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:23.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:32:22 gibba045 bash[25517]: cluster 2021-03-10T14:32:20.774921+0000 mgr.gibba045.orlgmj (mgr.34412) 2337 : cluster [DBG] pgmap v1318: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:24.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:32:24 gibba015 bash[29377]: cluster 2021-03-10T14:32:22.776680+0000 mgr.gibba045.orlgmj (mgr.34412) 2338 : cluster [DBG] pgmap v1319: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:24.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:32:24 gibba015 bash[30343]: cluster 2021-03-10T14:32:22.776680+0000 mgr.gibba045.orlgmj (mgr.34412) 2338 : cluster [DBG] pgmap v1319: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:25.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:32:24 gibba045 bash[25517]: cluster 2021-03-10T14:32:22.776680+0000 mgr.gibba045.orlgmj (mgr.34412) 2338 : cluster [DBG] pgmap v1319: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:26.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:32:26 gibba015 bash[29377]: cluster 2021-03-10T14:32:24.778438+0000 mgr.gibba045.orlgmj (mgr.34412) 2339 : cluster [DBG] pgmap v1320: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:26.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:32:26 gibba015 bash[30343]: cluster 2021-03-10T14:32:24.778438+0000 mgr.gibba045.orlgmj (mgr.34412) 2339 : cluster [DBG] pgmap v1320: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:27.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:32:26 gibba045 bash[25517]: cluster 2021-03-10T14:32:24.778438+0000 mgr.gibba045.orlgmj (mgr.34412) 2339 : cluster [DBG] pgmap v1320: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:28.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:32:28 gibba015 bash[29377]: cluster 2021-03-10T14:32:26.780171+0000 mgr.gibba045.orlgmj (mgr.34412) 2340 : cluster [DBG] pgmap v1321: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:28.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:32:28 gibba015 bash[30343]: cluster 2021-03-10T14:32:26.780171+0000 mgr.gibba045.orlgmj (mgr.34412) 2340 : cluster [DBG] pgmap v1321: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:29.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:32:28 gibba045 bash[25517]: cluster 2021-03-10T14:32:26.780171+0000 mgr.gibba045.orlgmj (mgr.34412) 2340 : cluster [DBG] pgmap v1321: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:30.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:32:30 gibba015 bash[29377]: cluster 2021-03-10T14:32:28.781281+0000 mgr.gibba045.orlgmj (mgr.34412) 2341 : cluster [DBG] pgmap v1322: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:30.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:32:30 gibba015 bash[30343]: cluster 2021-03-10T14:32:28.781281+0000 mgr.gibba045.orlgmj (mgr.34412) 2341 : cluster [DBG] pgmap v1322: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:31.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:32:30 gibba045 bash[25517]: cluster 2021-03-10T14:32:28.781281+0000 mgr.gibba045.orlgmj (mgr.34412) 2341 : cluster [DBG] pgmap v1322: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:32.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:32:32 gibba015 bash[29377]: cluster 2021-03-10T14:32:30.782869+0000 mgr.gibba045.orlgmj (mgr.34412) 2342 : cluster [DBG] pgmap v1323: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:32.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:32:32 gibba015 bash[29377]: cephadm 2021-03-10T14:32:30.875080+0000 mgr.gibba045.orlgmj (mgr.34412) 2343 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:32:32.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:32:32 gibba015 bash[30343]: cluster 2021-03-10T14:32:30.782869+0000 mgr.gibba045.orlgmj (mgr.34412) 2342 : cluster [DBG] pgmap v1323: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:32.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:32:32 gibba015 bash[30343]: cephadm 2021-03-10T14:32:30.875080+0000 mgr.gibba045.orlgmj (mgr.34412) 2343 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:32:33.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:32:32 gibba045 bash[25517]: cluster 2021-03-10T14:32:30.782869+0000 mgr.gibba045.orlgmj (mgr.34412) 2342 : cluster [DBG] pgmap v1323: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:33.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:32:32 gibba045 bash[25517]: cephadm 2021-03-10T14:32:30.875080+0000 mgr.gibba045.orlgmj (mgr.34412) 2343 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:32:34.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:32:34 gibba015 bash[29377]: cluster 2021-03-10T14:32:32.784308+0000 mgr.gibba045.orlgmj (mgr.34412) 2344 : cluster [DBG] pgmap v1324: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:34.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:32:34 gibba015 bash[30343]: cluster 2021-03-10T14:32:32.784308+0000 mgr.gibba045.orlgmj (mgr.34412) 2344 : cluster [DBG] pgmap v1324: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:35.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:32:34 gibba045 bash[25517]: cluster 2021-03-10T14:32:32.784308+0000 mgr.gibba045.orlgmj (mgr.34412) 2344 : cluster [DBG] pgmap v1324: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:37.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:32:36 gibba045 bash[25517]: cluster 2021-03-10T14:32:34.785753+0000 mgr.gibba045.orlgmj (mgr.34412) 2345 : cluster [DBG] pgmap v1325: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:37.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:32:36 gibba015 bash[29377]: cluster 2021-03-10T14:32:34.785753+0000 mgr.gibba045.orlgmj (mgr.34412) 2345 : cluster [DBG] pgmap v1325: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:37.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:32:36 gibba015 bash[30343]: cluster 2021-03-10T14:32:34.785753+0000 mgr.gibba045.orlgmj (mgr.34412) 2345 : cluster [DBG] pgmap v1325: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:39.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:32:38 gibba045 bash[25517]: cluster 2021-03-10T14:32:36.786629+0000 mgr.gibba045.orlgmj (mgr.34412) 2346 : cluster [DBG] pgmap v1326: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:39.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:32:38 gibba015 bash[29377]: cluster 2021-03-10T14:32:36.786629+0000 mgr.gibba045.orlgmj (mgr.34412) 2346 : cluster [DBG] pgmap v1326: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:39.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:32:38 gibba015 bash[30343]: cluster 2021-03-10T14:32:36.786629+0000 mgr.gibba045.orlgmj (mgr.34412) 2346 : cluster [DBG] pgmap v1326: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:39.733 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:32:39.965 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:32:39.965 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (43m) 9m ago 48m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:32:39.966 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (48m) 7m ago 48m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:32:39.966 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (43m) 7m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:32:39.966 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (44m) 7m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:32:39.966 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (43m) 9m ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:32:39.967 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (42m) 9m ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:32:39.967 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (42m) 7m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:32:39.967 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (42m) 9m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:32:39.967 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (48m) 9m ago 48m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:32:39.967 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (48m) 7m ago 48m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:32:39.968 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (41m) 9m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:32:39.968 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (41m) 9m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:32:39.968 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (40m) 9m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:32:39.968 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (40m) 9m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:32:39.968 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (39m) 7m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:32:39.969 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (39m) 7m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:32:39.969 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (39m) 7m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:32:39.969 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (38m) 7m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:32:39.969 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (48m) 7m ago 48m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:32:39.969 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 7m ago 46m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:32:40.217 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:32:40.217 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:32:40.218 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:32:40.218 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:32:40.218 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:32:40.218 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:32:40.218 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:32:40.219 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:32:40.219 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:32:40.219 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:32:40.219 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:32:40.219 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:32:40.220 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:32:40.220 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:32:40.220 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:32:41.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:32:40 gibba045 bash[25517]: cluster 2021-03-10T14:32:38.787645+0000 mgr.gibba045.orlgmj (mgr.34412) 2347 : cluster [DBG] pgmap v1327: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:41.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:32:40 gibba045 bash[25517]: audit 2021-03-10T14:32:39.725927+0000 mgr.gibba045.orlgmj (mgr.34412) 2348 : audit [DBG] from='client.45636 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:32:41.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:32:40 gibba045 bash[25517]: audit 2021-03-10T14:32:40.214598+0000 mon.a (mon.0) 904 : audit [DBG] from='client.? 172.21.2.115:0/302391583' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:32:41.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:32:40 gibba015 bash[30343]: cluster 2021-03-10T14:32:38.787645+0000 mgr.gibba045.orlgmj (mgr.34412) 2347 : cluster [DBG] pgmap v1327: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:41.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:32:40 gibba015 bash[30343]: audit 2021-03-10T14:32:39.725927+0000 mgr.gibba045.orlgmj (mgr.34412) 2348 : audit [DBG] from='client.45636 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:32:41.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:32:40 gibba015 bash[30343]: audit 2021-03-10T14:32:40.214598+0000 mon.a (mon.0) 904 : audit [DBG] from='client.? 172.21.2.115:0/302391583' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:32:41.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:32:40 gibba015 bash[29377]: cluster 2021-03-10T14:32:38.787645+0000 mgr.gibba045.orlgmj (mgr.34412) 2347 : cluster [DBG] pgmap v1327: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:41.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:32:40 gibba015 bash[29377]: audit 2021-03-10T14:32:39.725927+0000 mgr.gibba045.orlgmj (mgr.34412) 2348 : audit [DBG] from='client.45636 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:32:41.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:32:40 gibba015 bash[29377]: audit 2021-03-10T14:32:40.214598+0000 mon.a (mon.0) 904 : audit [DBG] from='client.? 172.21.2.115:0/302391583' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:32:42.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:32:41 gibba045 bash[25517]: audit 2021-03-10T14:32:39.955846+0000 mgr.gibba045.orlgmj (mgr.34412) 2349 : audit [DBG] from='client.55630 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:32:42.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:32:41 gibba015 bash[29377]: audit 2021-03-10T14:32:39.955846+0000 mgr.gibba045.orlgmj (mgr.34412) 2349 : audit [DBG] from='client.55630 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:32:42.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:32:41 gibba015 bash[30343]: audit 2021-03-10T14:32:39.955846+0000 mgr.gibba045.orlgmj (mgr.34412) 2349 : audit [DBG] from='client.55630 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:32:43.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:32:42 gibba045 bash[25517]: cluster 2021-03-10T14:32:40.788578+0000 mgr.gibba045.orlgmj (mgr.34412) 2350 : cluster [DBG] pgmap v1328: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:43.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:32:42 gibba015 bash[29377]: cluster 2021-03-10T14:32:40.788578+0000 mgr.gibba045.orlgmj (mgr.34412) 2350 : cluster [DBG] pgmap v1328: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:43.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:32:42 gibba015 bash[30343]: cluster 2021-03-10T14:32:40.788578+0000 mgr.gibba045.orlgmj (mgr.34412) 2350 : cluster [DBG] pgmap v1328: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:44.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:32:43 gibba045 bash[25517]: cluster 2021-03-10T14:32:42.789196+0000 mgr.gibba045.orlgmj (mgr.34412) 2351 : cluster [DBG] pgmap v1329: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:44.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:32:43 gibba015 bash[29377]: cluster 2021-03-10T14:32:42.789196+0000 mgr.gibba045.orlgmj (mgr.34412) 2351 : cluster [DBG] pgmap v1329: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:44.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:32:43 gibba015 bash[30343]: cluster 2021-03-10T14:32:42.789196+0000 mgr.gibba045.orlgmj (mgr.34412) 2351 : cluster [DBG] pgmap v1329: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:46.103 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:32:45 gibba045 bash[25517]: cluster 2021-03-10T14:32:44.790676+0000 mgr.gibba045.orlgmj (mgr.34412) 2352 : cluster [DBG] pgmap v1330: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:46.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:32:45 gibba015 bash[29377]: cluster 2021-03-10T14:32:44.790676+0000 mgr.gibba045.orlgmj (mgr.34412) 2352 : cluster [DBG] pgmap v1330: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:46.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:32:45 gibba015 bash[30343]: cluster 2021-03-10T14:32:44.790676+0000 mgr.gibba045.orlgmj (mgr.34412) 2352 : cluster [DBG] pgmap v1330: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:47.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:32:46 gibba015 bash[29377]: audit 2021-03-10T14:32:45.887593+0000 mon.c (mon.1) 700 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:32:47.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:32:46 gibba015 bash[29377]: cephadm 2021-03-10T14:32:45.893323+0000 mgr.gibba045.orlgmj (mgr.34412) 2353 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:32:47.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:32:46 gibba015 bash[29377]: cephadm 2021-03-10T14:32:45.893900+0000 mgr.gibba045.orlgmj (mgr.34412) 2354 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:32:47.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:32:46 gibba015 bash[29377]: audit 2021-03-10T14:32:46.086209+0000 mon.a (mon.0) 905 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:32:47.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:32:46 gibba015 bash[29377]: audit 2021-03-10T14:32:46.090285+0000 mon.c (mon.1) 701 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:32:47.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:32:46 gibba015 bash[29377]: audit 2021-03-10T14:32:46.091946+0000 mon.c (mon.1) 702 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:32:47.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:32:46 gibba015 bash[29377]: cephadm 2021-03-10T14:32:46.093127+0000 mgr.gibba045.orlgmj (mgr.34412) 2355 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:32:47.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:32:46 gibba015 bash[29377]: audit 2021-03-10T14:32:46.093618+0000 mon.c (mon.1) 703 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:32:47.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:32:46 gibba015 bash[29377]: cephadm 2021-03-10T14:32:46.095129+0000 mgr.gibba045.orlgmj (mgr.34412) 2356 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:32:47.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:32:46 gibba015 bash[29377]: audit 2021-03-10T14:32:46.095192+0000 mon.c (mon.1) 704 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:32:47.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:32:46 gibba015 bash[29377]: cephadm 2021-03-10T14:32:46.096771+0000 mgr.gibba045.orlgmj (mgr.34412) 2357 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:32:47.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:32:46 gibba015 bash[29377]: cephadm 2021-03-10T14:32:46.096817+0000 mgr.gibba045.orlgmj (mgr.34412) 2358 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:32:47.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:32:46 gibba015 bash[29377]: cephadm 2021-03-10T14:32:46.098402+0000 mgr.gibba045.orlgmj (mgr.34412) 2359 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:32:47.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:32:46 gibba015 bash[29377]: cephadm 2021-03-10T14:32:46.098449+0000 mgr.gibba045.orlgmj (mgr.34412) 2360 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:32:47.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:32:46 gibba015 bash[29377]: audit 2021-03-10T14:32:46.098467+0000 mon.c (mon.1) 705 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:32:47.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:32:46 gibba015 bash[29377]: cephadm 2021-03-10T14:32:46.099952+0000 mgr.gibba045.orlgmj (mgr.34412) 2361 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:32:47.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:32:46 gibba015 bash[29377]: audit 2021-03-10T14:32:46.099996+0000 mon.c (mon.1) 706 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:32:47.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:32:46 gibba015 bash[29377]: cephadm 2021-03-10T14:32:46.101665+0000 mgr.gibba045.orlgmj (mgr.34412) 2362 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:32:47.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:32:46 gibba015 bash[29377]: cephadm 2021-03-10T14:32:46.101712+0000 mgr.gibba045.orlgmj (mgr.34412) 2363 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:32:47.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:32:46 gibba015 bash[29377]: cephadm 2021-03-10T14:32:46.103011+0000 mgr.gibba045.orlgmj (mgr.34412) 2364 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:32:47.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:32:46 gibba015 bash[30343]: audit 2021-03-10T14:32:45.887593+0000 mon.c (mon.1) 700 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:32:47.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:32:46 gibba015 bash[30343]: cephadm 2021-03-10T14:32:45.893323+0000 mgr.gibba045.orlgmj (mgr.34412) 2353 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:32:47.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:32:46 gibba015 bash[30343]: cephadm 2021-03-10T14:32:45.893900+0000 mgr.gibba045.orlgmj (mgr.34412) 2354 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:32:47.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:32:46 gibba015 bash[30343]: audit 2021-03-10T14:32:46.086209+0000 mon.a (mon.0) 905 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:32:47.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:32:46 gibba015 bash[30343]: audit 2021-03-10T14:32:46.090285+0000 mon.c (mon.1) 701 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:32:47.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:32:46 gibba015 bash[30343]: audit 2021-03-10T14:32:46.091946+0000 mon.c (mon.1) 702 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:32:47.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:32:46 gibba015 bash[30343]: cephadm 2021-03-10T14:32:46.093127+0000 mgr.gibba045.orlgmj (mgr.34412) 2355 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:32:47.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:32:46 gibba015 bash[30343]: audit 2021-03-10T14:32:46.093618+0000 mon.c (mon.1) 703 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:32:47.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:32:46 gibba015 bash[30343]: cephadm 2021-03-10T14:32:46.095129+0000 mgr.gibba045.orlgmj (mgr.34412) 2356 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:32:47.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:32:46 gibba015 bash[30343]: audit 2021-03-10T14:32:46.095192+0000 mon.c (mon.1) 704 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:32:47.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:32:46 gibba015 bash[30343]: cephadm 2021-03-10T14:32:46.096771+0000 mgr.gibba045.orlgmj (mgr.34412) 2357 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:32:47.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:32:46 gibba015 bash[30343]: cephadm 2021-03-10T14:32:46.096817+0000 mgr.gibba045.orlgmj (mgr.34412) 2358 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:32:47.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:32:46 gibba015 bash[30343]: cephadm 2021-03-10T14:32:46.098402+0000 mgr.gibba045.orlgmj (mgr.34412) 2359 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:32:47.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:32:46 gibba015 bash[30343]: cephadm 2021-03-10T14:32:46.098449+0000 mgr.gibba045.orlgmj (mgr.34412) 2360 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:32:47.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:32:46 gibba015 bash[30343]: audit 2021-03-10T14:32:46.098467+0000 mon.c (mon.1) 705 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:32:47.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:32:46 gibba015 bash[30343]: cephadm 2021-03-10T14:32:46.099952+0000 mgr.gibba045.orlgmj (mgr.34412) 2361 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:32:47.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:32:46 gibba015 bash[30343]: audit 2021-03-10T14:32:46.099996+0000 mon.c (mon.1) 706 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:32:47.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:32:46 gibba015 bash[30343]: cephadm 2021-03-10T14:32:46.101665+0000 mgr.gibba045.orlgmj (mgr.34412) 2362 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:32:47.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:32:46 gibba015 bash[30343]: cephadm 2021-03-10T14:32:46.101712+0000 mgr.gibba045.orlgmj (mgr.34412) 2363 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:32:47.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:32:46 gibba015 bash[30343]: cephadm 2021-03-10T14:32:46.103011+0000 mgr.gibba045.orlgmj (mgr.34412) 2364 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:32:47.233 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:32:46 gibba015 bash[29377]: cephadm 2021-03-10T14:32:46.103362+0000 mgr.gibba045.orlgmj (mgr.34412) 2365 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:32:47.233 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:32:46 gibba015 bash[29377]: cephadm 2021-03-10T14:32:46.104717+0000 mgr.gibba045.orlgmj (mgr.34412) 2366 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:32:47.233 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:32:46 gibba015 bash[29377]: cephadm 2021-03-10T14:32:46.104764+0000 mgr.gibba045.orlgmj (mgr.34412) 2367 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:32:47.234 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:32:46 gibba015 bash[29377]: cephadm 2021-03-10T14:32:46.104881+0000 mgr.gibba045.orlgmj (mgr.34412) 2368 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:32:47.234 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:32:46 gibba015 bash[30343]: cephadm 2021-03-10T14:32:46.103362+0000 mgr.gibba045.orlgmj (mgr.34412) 2365 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:32:47.234 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:32:46 gibba015 bash[30343]: cephadm 2021-03-10T14:32:46.104717+0000 mgr.gibba045.orlgmj (mgr.34412) 2366 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:32:47.235 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:32:46 gibba015 bash[30343]: cephadm 2021-03-10T14:32:46.104764+0000 mgr.gibba045.orlgmj (mgr.34412) 2367 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:32:47.235 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:32:46 gibba015 bash[30343]: cephadm 2021-03-10T14:32:46.104881+0000 mgr.gibba045.orlgmj (mgr.34412) 2368 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:32:47.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:32:46 gibba045 bash[25517]: audit 2021-03-10T14:32:45.887593+0000 mon.c (mon.1) 700 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:32:47.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:32:46 gibba045 bash[25517]: cephadm 2021-03-10T14:32:45.893323+0000 mgr.gibba045.orlgmj (mgr.34412) 2353 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:32:47.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:32:46 gibba045 bash[25517]: cephadm 2021-03-10T14:32:45.893900+0000 mgr.gibba045.orlgmj (mgr.34412) 2354 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:32:47.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:32:46 gibba045 bash[25517]: audit 2021-03-10T14:32:46.086209+0000 mon.a (mon.0) 905 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:32:47.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:32:46 gibba045 bash[25517]: audit 2021-03-10T14:32:46.090285+0000 mon.c (mon.1) 701 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:32:47.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:32:46 gibba045 bash[25517]: audit 2021-03-10T14:32:46.091946+0000 mon.c (mon.1) 702 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:32:47.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:32:46 gibba045 bash[25517]: cephadm 2021-03-10T14:32:46.093127+0000 mgr.gibba045.orlgmj (mgr.34412) 2355 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:32:47.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:32:46 gibba045 bash[25517]: audit 2021-03-10T14:32:46.093618+0000 mon.c (mon.1) 703 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:32:47.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:32:46 gibba045 bash[25517]: cephadm 2021-03-10T14:32:46.095129+0000 mgr.gibba045.orlgmj (mgr.34412) 2356 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:32:47.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:32:46 gibba045 bash[25517]: audit 2021-03-10T14:32:46.095192+0000 mon.c (mon.1) 704 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:32:47.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:32:46 gibba045 bash[25517]: cephadm 2021-03-10T14:32:46.096771+0000 mgr.gibba045.orlgmj (mgr.34412) 2357 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:32:47.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:32:46 gibba045 bash[25517]: cephadm 2021-03-10T14:32:46.096817+0000 mgr.gibba045.orlgmj (mgr.34412) 2358 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:32:47.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:32:46 gibba045 bash[25517]: cephadm 2021-03-10T14:32:46.098402+0000 mgr.gibba045.orlgmj (mgr.34412) 2359 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:32:47.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:32:46 gibba045 bash[25517]: cephadm 2021-03-10T14:32:46.098449+0000 mgr.gibba045.orlgmj (mgr.34412) 2360 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:32:47.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:32:46 gibba045 bash[25517]: audit 2021-03-10T14:32:46.098467+0000 mon.c (mon.1) 705 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:32:47.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:32:46 gibba045 bash[25517]: cephadm 2021-03-10T14:32:46.099952+0000 mgr.gibba045.orlgmj (mgr.34412) 2361 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:32:47.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:32:46 gibba045 bash[25517]: audit 2021-03-10T14:32:46.099996+0000 mon.c (mon.1) 706 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:32:47.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:32:46 gibba045 bash[25517]: cephadm 2021-03-10T14:32:46.101665+0000 mgr.gibba045.orlgmj (mgr.34412) 2362 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:32:47.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:32:46 gibba045 bash[25517]: cephadm 2021-03-10T14:32:46.101712+0000 mgr.gibba045.orlgmj (mgr.34412) 2363 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:32:47.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:32:46 gibba045 bash[25517]: cephadm 2021-03-10T14:32:46.103011+0000 mgr.gibba045.orlgmj (mgr.34412) 2364 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:32:47.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:32:46 gibba045 bash[25517]: cephadm 2021-03-10T14:32:46.103362+0000 mgr.gibba045.orlgmj (mgr.34412) 2365 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:32:47.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:32:46 gibba045 bash[25517]: cephadm 2021-03-10T14:32:46.104717+0000 mgr.gibba045.orlgmj (mgr.34412) 2366 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:32:47.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:32:46 gibba045 bash[25517]: cephadm 2021-03-10T14:32:46.104764+0000 mgr.gibba045.orlgmj (mgr.34412) 2367 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:32:47.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:32:46 gibba045 bash[25517]: cephadm 2021-03-10T14:32:46.104881+0000 mgr.gibba045.orlgmj (mgr.34412) 2368 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:32:48.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:32:48 gibba015 bash[29377]: cluster 2021-03-10T14:32:46.792381+0000 mgr.gibba045.orlgmj (mgr.34412) 2369 : cluster [DBG] pgmap v1331: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:48.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:32:48 gibba015 bash[30343]: cluster 2021-03-10T14:32:46.792381+0000 mgr.gibba045.orlgmj (mgr.34412) 2369 : cluster [DBG] pgmap v1331: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:49.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:32:48 gibba045 bash[25517]: cluster 2021-03-10T14:32:46.792381+0000 mgr.gibba045.orlgmj (mgr.34412) 2369 : cluster [DBG] pgmap v1331: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:50.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:32:50 gibba015 bash[29377]: cluster 2021-03-10T14:32:48.793687+0000 mgr.gibba045.orlgmj (mgr.34412) 2370 : cluster [DBG] pgmap v1332: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:50.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:32:50 gibba015 bash[30343]: cluster 2021-03-10T14:32:48.793687+0000 mgr.gibba045.orlgmj (mgr.34412) 2370 : cluster [DBG] pgmap v1332: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:51.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:32:50 gibba045 bash[25517]: cluster 2021-03-10T14:32:48.793687+0000 mgr.gibba045.orlgmj (mgr.34412) 2370 : cluster [DBG] pgmap v1332: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:52.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:32:52 gibba015 bash[29377]: cluster 2021-03-10T14:32:50.795451+0000 mgr.gibba045.orlgmj (mgr.34412) 2371 : cluster [DBG] pgmap v1333: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:52.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:32:52 gibba015 bash[30343]: cluster 2021-03-10T14:32:50.795451+0000 mgr.gibba045.orlgmj (mgr.34412) 2371 : cluster [DBG] pgmap v1333: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:53.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:32:52 gibba045 bash[25517]: cluster 2021-03-10T14:32:50.795451+0000 mgr.gibba045.orlgmj (mgr.34412) 2371 : cluster [DBG] pgmap v1333: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:53.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:32:53 gibba015 bash[29377]: audit 2021-03-10T14:32:52.733394+0000 mon.c (mon.1) 707 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:32:53.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:32:53 gibba015 bash[29377]: audit 2021-03-10T14:32:52.734193+0000 mon.c (mon.1) 708 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:32:53.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:32:53 gibba015 bash[29377]: audit 2021-03-10T14:32:52.734500+0000 mon.a (mon.0) 906 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:32:53.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:32:53 gibba015 bash[29377]: audit 2021-03-10T14:32:52.735096+0000 mon.c (mon.1) 709 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T14:32:53.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:32:53 gibba015 bash[29377]: audit 2021-03-10T14:32:52.735627+0000 mon.a (mon.0) 907 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:32:53.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:32:53 gibba015 bash[29377]: audit 2021-03-10T14:32:52.736143+0000 mon.c (mon.1) 710 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:32:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:32:53 gibba015 bash[29377]: audit 2021-03-10T14:32:52.736335+0000 mon.a (mon.0) 908 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T14:32:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:32:53 gibba015 bash[29377]: audit 2021-03-10T14:32:52.737273+0000 mon.c (mon.1) 711 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:32:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:32:53 gibba015 bash[29377]: audit 2021-03-10T14:32:52.737404+0000 mon.a (mon.0) 909 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:32:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:32:53 gibba015 bash[29377]: audit 2021-03-10T14:32:52.738337+0000 mon.c (mon.1) 712 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:32:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:32:53 gibba015 bash[29377]: audit 2021-03-10T14:32:52.738422+0000 mon.a (mon.0) 910 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:32:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:32:53 gibba015 bash[29377]: audit 2021-03-10T14:32:52.739073+0000 mon.a (mon.0) 911 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:32:53.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:32:53 gibba015 bash[30343]: audit 2021-03-10T14:32:52.733394+0000 mon.c (mon.1) 707 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:32:53.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:32:53 gibba015 bash[30343]: audit 2021-03-10T14:32:52.734193+0000 mon.c (mon.1) 708 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:32:53.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:32:53 gibba015 bash[30343]: audit 2021-03-10T14:32:52.734500+0000 mon.a (mon.0) 906 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:32:53.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:32:53 gibba015 bash[30343]: audit 2021-03-10T14:32:52.735096+0000 mon.c (mon.1) 709 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T14:32:53.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:32:53 gibba015 bash[30343]: audit 2021-03-10T14:32:52.735627+0000 mon.a (mon.0) 907 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:32:53.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:32:53 gibba015 bash[30343]: audit 2021-03-10T14:32:52.736143+0000 mon.c (mon.1) 710 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:32:53.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:32:53 gibba015 bash[30343]: audit 2021-03-10T14:32:52.736335+0000 mon.a (mon.0) 908 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T14:32:53.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:32:53 gibba015 bash[30343]: audit 2021-03-10T14:32:52.737273+0000 mon.c (mon.1) 711 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:32:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:32:53 gibba015 bash[30343]: audit 2021-03-10T14:32:52.737404+0000 mon.a (mon.0) 909 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:32:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:32:53 gibba015 bash[30343]: audit 2021-03-10T14:32:52.738337+0000 mon.c (mon.1) 712 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:32:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:32:53 gibba015 bash[30343]: audit 2021-03-10T14:32:52.738422+0000 mon.a (mon.0) 910 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:32:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:32:53 gibba015 bash[30343]: audit 2021-03-10T14:32:52.739073+0000 mon.a (mon.0) 911 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:32:54.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:32:53 gibba045 bash[25517]: audit 2021-03-10T14:32:52.733394+0000 mon.c (mon.1) 707 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:32:54.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:32:53 gibba045 bash[25517]: audit 2021-03-10T14:32:52.734193+0000 mon.c (mon.1) 708 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:32:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:32:53 gibba045 bash[25517]: audit 2021-03-10T14:32:52.734500+0000 mon.a (mon.0) 906 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:32:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:32:53 gibba045 bash[25517]: audit 2021-03-10T14:32:52.735096+0000 mon.c (mon.1) 709 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T14:32:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:32:53 gibba045 bash[25517]: audit 2021-03-10T14:32:52.735627+0000 mon.a (mon.0) 907 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:32:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:32:53 gibba045 bash[25517]: audit 2021-03-10T14:32:52.736143+0000 mon.c (mon.1) 710 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:32:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:32:53 gibba045 bash[25517]: audit 2021-03-10T14:32:52.736335+0000 mon.a (mon.0) 908 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T14:32:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:32:53 gibba045 bash[25517]: audit 2021-03-10T14:32:52.737273+0000 mon.c (mon.1) 711 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:32:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:32:53 gibba045 bash[25517]: audit 2021-03-10T14:32:52.737404+0000 mon.a (mon.0) 909 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:32:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:32:53 gibba045 bash[25517]: audit 2021-03-10T14:32:52.738337+0000 mon.c (mon.1) 712 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:32:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:32:53 gibba045 bash[25517]: audit 2021-03-10T14:32:52.738422+0000 mon.a (mon.0) 910 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:32:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:32:53 gibba045 bash[25517]: audit 2021-03-10T14:32:52.739073+0000 mon.a (mon.0) 911 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:32:54.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:32:54 gibba015 bash[29377]: cluster 2021-03-10T14:32:52.796713+0000 mgr.gibba045.orlgmj (mgr.34412) 2372 : cluster [DBG] pgmap v1334: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:54.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:32:54 gibba015 bash[30343]: cluster 2021-03-10T14:32:52.796713+0000 mgr.gibba045.orlgmj (mgr.34412) 2372 : cluster [DBG] pgmap v1334: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:55.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:32:54 gibba045 bash[25517]: cluster 2021-03-10T14:32:52.796713+0000 mgr.gibba045.orlgmj (mgr.34412) 2372 : cluster [DBG] pgmap v1334: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:56.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:32:56 gibba015 bash[29377]: cluster 2021-03-10T14:32:54.798260+0000 mgr.gibba045.orlgmj (mgr.34412) 2373 : cluster [DBG] pgmap v1335: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:56.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:32:56 gibba015 bash[30343]: cluster 2021-03-10T14:32:54.798260+0000 mgr.gibba045.orlgmj (mgr.34412) 2373 : cluster [DBG] pgmap v1335: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:57.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:32:56 gibba045 bash[25517]: cluster 2021-03-10T14:32:54.798260+0000 mgr.gibba045.orlgmj (mgr.34412) 2373 : cluster [DBG] pgmap v1335: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:58.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:32:58 gibba015 bash[29377]: cluster 2021-03-10T14:32:56.800025+0000 mgr.gibba045.orlgmj (mgr.34412) 2374 : cluster [DBG] pgmap v1336: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:58.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:32:58 gibba015 bash[30343]: cluster 2021-03-10T14:32:56.800025+0000 mgr.gibba045.orlgmj (mgr.34412) 2374 : cluster [DBG] pgmap v1336: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:59.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:32:58 gibba045 bash[25517]: cluster 2021-03-10T14:32:56.800025+0000 mgr.gibba045.orlgmj (mgr.34412) 2374 : cluster [DBG] pgmap v1336: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:00.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:33:00 gibba015 bash[29377]: cluster 2021-03-10T14:32:58.801029+0000 mgr.gibba045.orlgmj (mgr.34412) 2375 : cluster [DBG] pgmap v1337: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:00.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:33:00 gibba015 bash[30343]: cluster 2021-03-10T14:32:58.801029+0000 mgr.gibba045.orlgmj (mgr.34412) 2375 : cluster [DBG] pgmap v1337: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:01.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:33:00 gibba045 bash[25517]: cluster 2021-03-10T14:32:58.801029+0000 mgr.gibba045.orlgmj (mgr.34412) 2375 : cluster [DBG] pgmap v1337: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:02.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:33:02 gibba015 bash[29377]: cluster 2021-03-10T14:33:00.802472+0000 mgr.gibba045.orlgmj (mgr.34412) 2376 : cluster [DBG] pgmap v1338: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:02.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:33:02 gibba015 bash[29377]: cephadm 2021-03-10T14:33:01.120850+0000 mgr.gibba045.orlgmj (mgr.34412) 2377 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:33:02.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:33:02 gibba015 bash[30343]: cluster 2021-03-10T14:33:00.802472+0000 mgr.gibba045.orlgmj (mgr.34412) 2376 : cluster [DBG] pgmap v1338: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:02.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:33:02 gibba015 bash[30343]: cephadm 2021-03-10T14:33:01.120850+0000 mgr.gibba045.orlgmj (mgr.34412) 2377 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:33:03.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:33:02 gibba045 bash[25517]: cluster 2021-03-10T14:33:00.802472+0000 mgr.gibba045.orlgmj (mgr.34412) 2376 : cluster [DBG] pgmap v1338: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:03.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:33:02 gibba045 bash[25517]: cephadm 2021-03-10T14:33:01.120850+0000 mgr.gibba045.orlgmj (mgr.34412) 2377 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:33:04.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:33:04 gibba015 bash[29377]: cluster 2021-03-10T14:33:02.803802+0000 mgr.gibba045.orlgmj (mgr.34412) 2378 : cluster [DBG] pgmap v1339: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:04.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:33:04 gibba015 bash[30343]: cluster 2021-03-10T14:33:02.803802+0000 mgr.gibba045.orlgmj (mgr.34412) 2378 : cluster [DBG] pgmap v1339: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:05.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:33:04 gibba045 bash[25517]: cluster 2021-03-10T14:33:02.803802+0000 mgr.gibba045.orlgmj (mgr.34412) 2378 : cluster [DBG] pgmap v1339: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:06.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:33:06 gibba015 bash[29377]: cluster 2021-03-10T14:33:04.805452+0000 mgr.gibba045.orlgmj (mgr.34412) 2379 : cluster [DBG] pgmap v1340: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:06.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:33:06 gibba015 bash[30343]: cluster 2021-03-10T14:33:04.805452+0000 mgr.gibba045.orlgmj (mgr.34412) 2379 : cluster [DBG] pgmap v1340: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:07.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:33:06 gibba045 bash[25517]: cluster 2021-03-10T14:33:04.805452+0000 mgr.gibba045.orlgmj (mgr.34412) 2379 : cluster [DBG] pgmap v1340: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:08.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:33:08 gibba015 bash[29377]: cluster 2021-03-10T14:33:06.807240+0000 mgr.gibba045.orlgmj (mgr.34412) 2380 : cluster [DBG] pgmap v1341: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:08.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:33:08 gibba015 bash[30343]: cluster 2021-03-10T14:33:06.807240+0000 mgr.gibba045.orlgmj (mgr.34412) 2380 : cluster [DBG] pgmap v1341: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:09.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:33:08 gibba045 bash[25517]: cluster 2021-03-10T14:33:06.807240+0000 mgr.gibba045.orlgmj (mgr.34412) 2380 : cluster [DBG] pgmap v1341: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:10.458 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:33:10.688 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:33:10.688 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (43m) 9m ago 49m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:33:10.688 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (49m) 8m ago 49m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:33:10.688 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (44m) 8m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:33:10.689 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (44m) 8m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:33:10.689 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (43m) 9m ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:33:10.689 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (43m) 9m ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:33:10.689 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (42m) 8m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:33:10.689 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (43m) 9m ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:33:10.690 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (49m) 9m ago 49m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:33:10.690 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (49m) 8m ago 49m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:33:10.690 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (42m) 9m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:33:10.690 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (41m) 9m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:33:10.690 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (41m) 9m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:33:10.691 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (40m) 9m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:33:10.691 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (40m) 8m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:33:10.691 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (40m) 8m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:33:10.691 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (39m) 8m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:33:10.692 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (39m) 8m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:33:10.692 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (48m) 8m ago 49m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:33:10.692 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 8m ago 47m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:33:10.941 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:33:10.941 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:33:10.941 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:33:10.941 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:33:10.942 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:33:10.942 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:33:10.942 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:33:10.942 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:33:10.942 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:33:10.943 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:33:10.943 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:33:10.943 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:33:10.943 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:33:10.943 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:33:10.944 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:33:10.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:33:10 gibba015 bash[29377]: cluster 2021-03-10T14:33:08.807714+0000 mgr.gibba045.orlgmj (mgr.34412) 2381 : cluster [DBG] pgmap v1342: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:10.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:33:10 gibba015 bash[30343]: cluster 2021-03-10T14:33:08.807714+0000 mgr.gibba045.orlgmj (mgr.34412) 2381 : cluster [DBG] pgmap v1342: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:11.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:33:10 gibba045 bash[25517]: cluster 2021-03-10T14:33:08.807714+0000 mgr.gibba045.orlgmj (mgr.34412) 2381 : cluster [DBG] pgmap v1342: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:12.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:33:11 gibba045 bash[25517]: audit 2021-03-10T14:33:10.450690+0000 mgr.gibba045.orlgmj (mgr.34412) 2382 : audit [DBG] from='client.45654 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:33:12.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:33:11 gibba045 bash[25517]: audit 2021-03-10T14:33:10.678108+0000 mgr.gibba045.orlgmj (mgr.34412) 2383 : audit [DBG] from='client.55648 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:33:12.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:33:11 gibba045 bash[25517]: audit 2021-03-10T14:33:10.938241+0000 mon.a (mon.0) 912 : audit [DBG] from='client.? 172.21.2.115:0/130189692' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:33:12.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:33:11 gibba015 bash[29377]: audit 2021-03-10T14:33:10.450690+0000 mgr.gibba045.orlgmj (mgr.34412) 2382 : audit [DBG] from='client.45654 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:33:12.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:33:11 gibba015 bash[29377]: audit 2021-03-10T14:33:10.678108+0000 mgr.gibba045.orlgmj (mgr.34412) 2383 : audit [DBG] from='client.55648 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:33:12.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:33:11 gibba015 bash[29377]: audit 2021-03-10T14:33:10.938241+0000 mon.a (mon.0) 912 : audit [DBG] from='client.? 172.21.2.115:0/130189692' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:33:12.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:33:11 gibba015 bash[30343]: audit 2021-03-10T14:33:10.450690+0000 mgr.gibba045.orlgmj (mgr.34412) 2382 : audit [DBG] from='client.45654 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:33:12.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:33:11 gibba015 bash[30343]: audit 2021-03-10T14:33:10.678108+0000 mgr.gibba045.orlgmj (mgr.34412) 2383 : audit [DBG] from='client.55648 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:33:12.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:33:11 gibba015 bash[30343]: audit 2021-03-10T14:33:10.938241+0000 mon.a (mon.0) 912 : audit [DBG] from='client.? 172.21.2.115:0/130189692' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:33:13.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:33:12 gibba045 bash[25517]: cluster 2021-03-10T14:33:10.809450+0000 mgr.gibba045.orlgmj (mgr.34412) 2384 : cluster [DBG] pgmap v1343: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:13.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:33:12 gibba015 bash[29377]: cluster 2021-03-10T14:33:10.809450+0000 mgr.gibba045.orlgmj (mgr.34412) 2384 : cluster [DBG] pgmap v1343: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:13.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:33:12 gibba015 bash[30343]: cluster 2021-03-10T14:33:10.809450+0000 mgr.gibba045.orlgmj (mgr.34412) 2384 : cluster [DBG] pgmap v1343: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:15.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:33:14 gibba045 bash[25517]: cluster 2021-03-10T14:33:12.811083+0000 mgr.gibba045.orlgmj (mgr.34412) 2385 : cluster [DBG] pgmap v1344: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:15.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:33:14 gibba015 bash[29377]: cluster 2021-03-10T14:33:12.811083+0000 mgr.gibba045.orlgmj (mgr.34412) 2385 : cluster [DBG] pgmap v1344: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:15.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:33:14 gibba015 bash[30343]: cluster 2021-03-10T14:33:12.811083+0000 mgr.gibba045.orlgmj (mgr.34412) 2385 : cluster [DBG] pgmap v1344: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:17.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:33:16 gibba045 bash[25517]: cluster 2021-03-10T14:33:14.812248+0000 mgr.gibba045.orlgmj (mgr.34412) 2386 : cluster [DBG] pgmap v1345: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:17.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:33:16 gibba015 bash[29377]: cluster 2021-03-10T14:33:14.812248+0000 mgr.gibba045.orlgmj (mgr.34412) 2386 : cluster [DBG] pgmap v1345: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:17.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:33:16 gibba015 bash[30343]: cluster 2021-03-10T14:33:14.812248+0000 mgr.gibba045.orlgmj (mgr.34412) 2386 : cluster [DBG] pgmap v1345: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:18.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:33:17 gibba045 bash[25517]: cephadm 2021-03-10T14:33:16.133227+0000 mgr.gibba045.orlgmj (mgr.34412) 2387 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:33:18.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:33:17 gibba015 bash[29377]: cephadm 2021-03-10T14:33:16.133227+0000 mgr.gibba045.orlgmj (mgr.34412) 2387 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:33:18.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:33:17 gibba015 bash[30343]: cephadm 2021-03-10T14:33:16.133227+0000 mgr.gibba045.orlgmj (mgr.34412) 2387 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:33:19.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:33:18 gibba045 bash[25517]: cluster 2021-03-10T14:33:16.813287+0000 mgr.gibba045.orlgmj (mgr.34412) 2388 : cluster [DBG] pgmap v1346: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:19.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:33:18 gibba015 bash[29377]: cluster 2021-03-10T14:33:16.813287+0000 mgr.gibba045.orlgmj (mgr.34412) 2388 : cluster [DBG] pgmap v1346: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:19.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:33:18 gibba015 bash[30343]: cluster 2021-03-10T14:33:16.813287+0000 mgr.gibba045.orlgmj (mgr.34412) 2388 : cluster [DBG] pgmap v1346: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:20.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:33:19 gibba045 bash[25517]: cluster 2021-03-10T14:33:18.814194+0000 mgr.gibba045.orlgmj (mgr.34412) 2389 : cluster [DBG] pgmap v1347: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:20.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:33:19 gibba015 bash[29377]: cluster 2021-03-10T14:33:18.814194+0000 mgr.gibba045.orlgmj (mgr.34412) 2389 : cluster [DBG] pgmap v1347: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:20.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:33:19 gibba015 bash[30343]: cluster 2021-03-10T14:33:18.814194+0000 mgr.gibba045.orlgmj (mgr.34412) 2389 : cluster [DBG] pgmap v1347: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:22.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:33:21 gibba015 bash[29377]: cluster 2021-03-10T14:33:20.816096+0000 mgr.gibba045.orlgmj (mgr.34412) 2390 : cluster [DBG] pgmap v1348: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:22.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:33:21 gibba015 bash[30343]: cluster 2021-03-10T14:33:20.816096+0000 mgr.gibba045.orlgmj (mgr.34412) 2390 : cluster [DBG] pgmap v1348: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:22.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:33:21 gibba045 bash[25517]: cluster 2021-03-10T14:33:20.816096+0000 mgr.gibba045.orlgmj (mgr.34412) 2390 : cluster [DBG] pgmap v1348: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:24.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:33:24 gibba015 bash[29377]: cluster 2021-03-10T14:33:22.817614+0000 mgr.gibba045.orlgmj (mgr.34412) 2391 : cluster [DBG] pgmap v1349: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:24.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:33:24 gibba015 bash[30343]: cluster 2021-03-10T14:33:22.817614+0000 mgr.gibba045.orlgmj (mgr.34412) 2391 : cluster [DBG] pgmap v1349: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:25.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:33:24 gibba045 bash[25517]: cluster 2021-03-10T14:33:22.817614+0000 mgr.gibba045.orlgmj (mgr.34412) 2391 : cluster [DBG] pgmap v1349: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:26.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:33:26 gibba015 bash[29377]: cluster 2021-03-10T14:33:24.819261+0000 mgr.gibba045.orlgmj (mgr.34412) 2392 : cluster [DBG] pgmap v1350: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:26.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:33:26 gibba015 bash[30343]: cluster 2021-03-10T14:33:24.819261+0000 mgr.gibba045.orlgmj (mgr.34412) 2392 : cluster [DBG] pgmap v1350: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:27.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:33:26 gibba045 bash[25517]: cluster 2021-03-10T14:33:24.819261+0000 mgr.gibba045.orlgmj (mgr.34412) 2392 : cluster [DBG] pgmap v1350: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:28.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:33:28 gibba015 bash[29377]: cluster 2021-03-10T14:33:26.820793+0000 mgr.gibba045.orlgmj (mgr.34412) 2393 : cluster [DBG] pgmap v1351: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:28.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:33:28 gibba015 bash[30343]: cluster 2021-03-10T14:33:26.820793+0000 mgr.gibba045.orlgmj (mgr.34412) 2393 : cluster [DBG] pgmap v1351: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:29.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:33:28 gibba045 bash[25517]: cluster 2021-03-10T14:33:26.820793+0000 mgr.gibba045.orlgmj (mgr.34412) 2393 : cluster [DBG] pgmap v1351: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:30.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:33:30 gibba015 bash[29377]: cluster 2021-03-10T14:33:28.821867+0000 mgr.gibba045.orlgmj (mgr.34412) 2394 : cluster [DBG] pgmap v1352: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:30.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:33:30 gibba015 bash[30343]: cluster 2021-03-10T14:33:28.821867+0000 mgr.gibba045.orlgmj (mgr.34412) 2394 : cluster [DBG] pgmap v1352: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:31.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:33:30 gibba045 bash[25517]: cluster 2021-03-10T14:33:28.821867+0000 mgr.gibba045.orlgmj (mgr.34412) 2394 : cluster [DBG] pgmap v1352: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:32.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:33:32 gibba015 bash[29377]: cluster 2021-03-10T14:33:30.823415+0000 mgr.gibba045.orlgmj (mgr.34412) 2395 : cluster [DBG] pgmap v1353: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:32.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:33:32 gibba015 bash[29377]: cephadm 2021-03-10T14:33:31.149334+0000 mgr.gibba045.orlgmj (mgr.34412) 2396 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:33:32.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:33:32 gibba015 bash[30343]: cluster 2021-03-10T14:33:30.823415+0000 mgr.gibba045.orlgmj (mgr.34412) 2395 : cluster [DBG] pgmap v1353: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:32.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:33:32 gibba015 bash[30343]: cephadm 2021-03-10T14:33:31.149334+0000 mgr.gibba045.orlgmj (mgr.34412) 2396 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:33:33.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:33:32 gibba045 bash[25517]: cluster 2021-03-10T14:33:30.823415+0000 mgr.gibba045.orlgmj (mgr.34412) 2395 : cluster [DBG] pgmap v1353: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:33.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:33:32 gibba045 bash[25517]: cephadm 2021-03-10T14:33:31.149334+0000 mgr.gibba045.orlgmj (mgr.34412) 2396 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:33:34.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:33:34 gibba015 bash[29377]: cluster 2021-03-10T14:33:32.825145+0000 mgr.gibba045.orlgmj (mgr.34412) 2397 : cluster [DBG] pgmap v1354: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:34.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:33:34 gibba015 bash[30343]: cluster 2021-03-10T14:33:32.825145+0000 mgr.gibba045.orlgmj (mgr.34412) 2397 : cluster [DBG] pgmap v1354: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:35.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:33:34 gibba045 bash[25517]: cluster 2021-03-10T14:33:32.825145+0000 mgr.gibba045.orlgmj (mgr.34412) 2397 : cluster [DBG] pgmap v1354: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:36.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:33:36 gibba015 bash[29377]: cluster 2021-03-10T14:33:34.826690+0000 mgr.gibba045.orlgmj (mgr.34412) 2398 : cluster [DBG] pgmap v1355: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:36.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:33:36 gibba015 bash[30343]: cluster 2021-03-10T14:33:34.826690+0000 mgr.gibba045.orlgmj (mgr.34412) 2398 : cluster [DBG] pgmap v1355: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:37.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:33:36 gibba045 bash[25517]: cluster 2021-03-10T14:33:34.826690+0000 mgr.gibba045.orlgmj (mgr.34412) 2398 : cluster [DBG] pgmap v1355: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:38.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:33:38 gibba015 bash[29377]: cluster 2021-03-10T14:33:36.828538+0000 mgr.gibba045.orlgmj (mgr.34412) 2399 : cluster [DBG] pgmap v1356: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:38.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:33:38 gibba015 bash[30343]: cluster 2021-03-10T14:33:36.828538+0000 mgr.gibba045.orlgmj (mgr.34412) 2399 : cluster [DBG] pgmap v1356: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:39.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:33:38 gibba045 bash[25517]: cluster 2021-03-10T14:33:36.828538+0000 mgr.gibba045.orlgmj (mgr.34412) 2399 : cluster [DBG] pgmap v1356: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:40.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:33:40 gibba015 bash[29377]: cluster 2021-03-10T14:33:38.829727+0000 mgr.gibba045.orlgmj (mgr.34412) 2400 : cluster [DBG] pgmap v1357: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:40.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:33:40 gibba015 bash[30343]: cluster 2021-03-10T14:33:38.829727+0000 mgr.gibba045.orlgmj (mgr.34412) 2400 : cluster [DBG] pgmap v1357: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:41.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:33:40 gibba045 bash[25517]: cluster 2021-03-10T14:33:38.829727+0000 mgr.gibba045.orlgmj (mgr.34412) 2400 : cluster [DBG] pgmap v1357: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:41.186 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:33:41.413 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:33:41.414 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (44m) 10m ago 49m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:33:41.414 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (49m) 8m ago 49m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:33:41.414 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (44m) 8m ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:33:41.414 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (45m) 8m ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:33:41.415 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (44m) 10m ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:33:41.415 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (43m) 10m ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:33:41.415 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (43m) 8m ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:33:41.415 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (43m) 10m ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:33:41.416 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (49m) 10m ago 49m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:33:41.416 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (49m) 8m ago 49m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:33:41.416 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (42m) 10m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:33:41.416 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (42m) 10m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:33:41.416 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (41m) 10m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:33:41.417 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (41m) 10m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:33:41.417 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (41m) 8m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:33:41.417 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (40m) 8m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:33:41.417 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (40m) 8m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:33:41.418 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (39m) 8m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:33:41.418 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (49m) 8m ago 49m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:33:41.418 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 8m ago 47m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:33:41.662 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:33:41.662 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:33:41.662 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:33:41.662 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:33:41.662 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:33:41.663 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:33:41.663 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:33:41.663 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:33:41.663 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:33:41.664 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:33:41.664 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:33:41.664 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:33:41.664 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:33:41.664 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:33:41.665 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:33:41.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:33:41 gibba015 bash[29377]: audit 2021-03-10T14:33:41.659204+0000 mon.a (mon.0) 913 : audit [DBG] from='client.? 172.21.2.115:0/1988237595' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:33:41.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:33:41 gibba015 bash[30343]: audit 2021-03-10T14:33:41.659204+0000 mon.a (mon.0) 913 : audit [DBG] from='client.? 172.21.2.115:0/1988237595' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:33:42.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:33:41 gibba045 bash[25517]: audit 2021-03-10T14:33:41.659204+0000 mon.a (mon.0) 913 : audit [DBG] from='client.? 172.21.2.115:0/1988237595' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:33:43.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:33:42 gibba045 bash[25517]: cluster 2021-03-10T14:33:40.831807+0000 mgr.gibba045.orlgmj (mgr.34412) 2401 : cluster [DBG] pgmap v1358: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:43.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:33:42 gibba045 bash[25517]: audit 2021-03-10T14:33:41.178431+0000 mgr.gibba045.orlgmj (mgr.34412) 2402 : audit [DBG] from='client.55660 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:33:43.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:33:42 gibba045 bash[25517]: audit 2021-03-10T14:33:41.402380+0000 mgr.gibba045.orlgmj (mgr.34412) 2403 : audit [DBG] from='client.45678 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:33:43.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:33:42 gibba015 bash[29377]: cluster 2021-03-10T14:33:40.831807+0000 mgr.gibba045.orlgmj (mgr.34412) 2401 : cluster [DBG] pgmap v1358: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:43.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:33:42 gibba015 bash[29377]: audit 2021-03-10T14:33:41.178431+0000 mgr.gibba045.orlgmj (mgr.34412) 2402 : audit [DBG] from='client.55660 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:33:43.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:33:42 gibba015 bash[29377]: audit 2021-03-10T14:33:41.402380+0000 mgr.gibba045.orlgmj (mgr.34412) 2403 : audit [DBG] from='client.45678 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:33:43.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:33:42 gibba015 bash[30343]: cluster 2021-03-10T14:33:40.831807+0000 mgr.gibba045.orlgmj (mgr.34412) 2401 : cluster [DBG] pgmap v1358: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:43.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:33:42 gibba015 bash[30343]: audit 2021-03-10T14:33:41.178431+0000 mgr.gibba045.orlgmj (mgr.34412) 2402 : audit [DBG] from='client.55660 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:33:43.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:33:42 gibba015 bash[30343]: audit 2021-03-10T14:33:41.402380+0000 mgr.gibba045.orlgmj (mgr.34412) 2403 : audit [DBG] from='client.45678 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:33:45.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:33:44 gibba045 bash[25517]: cluster 2021-03-10T14:33:42.833526+0000 mgr.gibba045.orlgmj (mgr.34412) 2404 : cluster [DBG] pgmap v1359: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:45.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:33:44 gibba015 bash[29377]: cluster 2021-03-10T14:33:42.833526+0000 mgr.gibba045.orlgmj (mgr.34412) 2404 : cluster [DBG] pgmap v1359: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:45.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:33:44 gibba015 bash[30343]: cluster 2021-03-10T14:33:42.833526+0000 mgr.gibba045.orlgmj (mgr.34412) 2404 : cluster [DBG] pgmap v1359: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:47.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:33:46 gibba045 bash[25517]: cluster 2021-03-10T14:33:44.835132+0000 mgr.gibba045.orlgmj (mgr.34412) 2405 : cluster [DBG] pgmap v1360: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:47.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:33:46 gibba045 bash[25517]: audit 2021-03-10T14:33:46.162564+0000 mon.c (mon.1) 713 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:33:47.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:33:46 gibba045 bash[25517]: audit 2021-03-10T14:33:46.169204+0000 mon.c (mon.1) 714 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:33:47.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:33:46 gibba015 bash[29377]: cluster 2021-03-10T14:33:44.835132+0000 mgr.gibba045.orlgmj (mgr.34412) 2405 : cluster [DBG] pgmap v1360: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:47.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:33:46 gibba015 bash[29377]: audit 2021-03-10T14:33:46.162564+0000 mon.c (mon.1) 713 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:33:47.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:33:46 gibba015 bash[29377]: audit 2021-03-10T14:33:46.169204+0000 mon.c (mon.1) 714 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:33:47.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:33:46 gibba015 bash[30343]: cluster 2021-03-10T14:33:44.835132+0000 mgr.gibba045.orlgmj (mgr.34412) 2405 : cluster [DBG] pgmap v1360: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:47.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:33:46 gibba015 bash[30343]: audit 2021-03-10T14:33:46.162564+0000 mon.c (mon.1) 713 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:33:47.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:33:46 gibba015 bash[30343]: audit 2021-03-10T14:33:46.169204+0000 mon.c (mon.1) 714 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:33:48.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:33:47 gibba045 bash[25517]: cephadm 2021-03-10T14:33:46.172583+0000 mgr.gibba045.orlgmj (mgr.34412) 2406 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:33:48.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:33:47 gibba015 bash[29377]: cephadm 2021-03-10T14:33:46.172583+0000 mgr.gibba045.orlgmj (mgr.34412) 2406 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:33:48.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:33:47 gibba015 bash[30343]: cephadm 2021-03-10T14:33:46.172583+0000 mgr.gibba045.orlgmj (mgr.34412) 2406 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:33:49.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:33:48 gibba045 bash[25517]: cluster 2021-03-10T14:33:46.840289+0000 mgr.gibba045.orlgmj (mgr.34412) 2407 : cluster [DBG] pgmap v1361: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:49.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:33:48 gibba015 bash[29377]: cluster 2021-03-10T14:33:46.840289+0000 mgr.gibba045.orlgmj (mgr.34412) 2407 : cluster [DBG] pgmap v1361: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:49.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:33:48 gibba015 bash[30343]: cluster 2021-03-10T14:33:46.840289+0000 mgr.gibba045.orlgmj (mgr.34412) 2407 : cluster [DBG] pgmap v1361: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:50.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:33:50 gibba015 bash[29377]: cluster 2021-03-10T14:33:48.841273+0000 mgr.gibba045.orlgmj (mgr.34412) 2408 : cluster [DBG] pgmap v1362: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:50.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:33:50 gibba015 bash[29377]: audit 2021-03-10T14:33:49.705356+0000 mon.a (mon.0) 914 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:33:50.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:33:50 gibba015 bash[29377]: cephadm 2021-03-10T14:33:49.710165+0000 mgr.gibba045.orlgmj (mgr.34412) 2409 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:33:50.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:33:50 gibba015 bash[29377]: audit 2021-03-10T14:33:49.909518+0000 mon.a (mon.0) 915 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:33:50.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:33:50 gibba015 bash[29377]: audit 2021-03-10T14:33:49.916844+0000 mon.c (mon.1) 715 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:33:50.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:33:50 gibba015 bash[29377]: audit 2021-03-10T14:33:49.918445+0000 mon.c (mon.1) 716 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:33:50.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:33:50 gibba015 bash[29377]: audit 2021-03-10T14:33:49.920302+0000 mon.c (mon.1) 717 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:33:50.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:33:50 gibba015 bash[29377]: audit 2021-03-10T14:33:49.921724+0000 mon.c (mon.1) 718 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:33:50.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:33:50 gibba015 bash[29377]: audit 2021-03-10T14:33:49.925346+0000 mon.c (mon.1) 719 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:33:50.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:33:50 gibba015 bash[29377]: audit 2021-03-10T14:33:49.927116+0000 mon.c (mon.1) 720 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:33:50.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:33:50 gibba015 bash[30343]: cluster 2021-03-10T14:33:48.841273+0000 mgr.gibba045.orlgmj (mgr.34412) 2408 : cluster [DBG] pgmap v1362: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:50.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:33:50 gibba015 bash[30343]: audit 2021-03-10T14:33:49.705356+0000 mon.a (mon.0) 914 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:33:50.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:33:50 gibba015 bash[30343]: cephadm 2021-03-10T14:33:49.710165+0000 mgr.gibba045.orlgmj (mgr.34412) 2409 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:33:50.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:33:50 gibba015 bash[30343]: audit 2021-03-10T14:33:49.909518+0000 mon.a (mon.0) 915 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:33:50.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:33:50 gibba015 bash[30343]: audit 2021-03-10T14:33:49.916844+0000 mon.c (mon.1) 715 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:33:50.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:33:50 gibba015 bash[30343]: audit 2021-03-10T14:33:49.918445+0000 mon.c (mon.1) 716 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:33:50.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:33:50 gibba015 bash[30343]: audit 2021-03-10T14:33:49.920302+0000 mon.c (mon.1) 717 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:33:50.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:33:50 gibba015 bash[30343]: audit 2021-03-10T14:33:49.921724+0000 mon.c (mon.1) 718 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:33:50.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:33:50 gibba015 bash[30343]: audit 2021-03-10T14:33:49.925346+0000 mon.c (mon.1) 719 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:33:50.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:33:50 gibba015 bash[30343]: audit 2021-03-10T14:33:49.927116+0000 mon.c (mon.1) 720 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:33:51.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:33:50 gibba045 bash[25517]: cluster 2021-03-10T14:33:48.841273+0000 mgr.gibba045.orlgmj (mgr.34412) 2408 : cluster [DBG] pgmap v1362: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:51.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:33:50 gibba045 bash[25517]: audit 2021-03-10T14:33:49.705356+0000 mon.a (mon.0) 914 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:33:51.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:33:50 gibba045 bash[25517]: cephadm 2021-03-10T14:33:49.710165+0000 mgr.gibba045.orlgmj (mgr.34412) 2409 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:33:51.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:33:50 gibba045 bash[25517]: audit 2021-03-10T14:33:49.909518+0000 mon.a (mon.0) 915 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:33:51.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:33:50 gibba045 bash[25517]: audit 2021-03-10T14:33:49.916844+0000 mon.c (mon.1) 715 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:33:51.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:33:50 gibba045 bash[25517]: audit 2021-03-10T14:33:49.918445+0000 mon.c (mon.1) 716 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:33:51.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:33:50 gibba045 bash[25517]: audit 2021-03-10T14:33:49.920302+0000 mon.c (mon.1) 717 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:33:51.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:33:50 gibba045 bash[25517]: audit 2021-03-10T14:33:49.921724+0000 mon.c (mon.1) 718 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:33:51.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:33:50 gibba045 bash[25517]: audit 2021-03-10T14:33:49.925346+0000 mon.c (mon.1) 719 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:33:51.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:33:50 gibba045 bash[25517]: audit 2021-03-10T14:33:49.927116+0000 mon.c (mon.1) 720 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:33:52.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:33:51 gibba045 bash[25517]: cephadm 2021-03-10T14:33:49.919565+0000 mgr.gibba045.orlgmj (mgr.34412) 2410 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:33:52.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:33:51 gibba045 bash[25517]: cephadm 2021-03-10T14:33:49.921676+0000 mgr.gibba045.orlgmj (mgr.34412) 2411 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:33:52.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:33:51 gibba045 bash[25517]: cephadm 2021-03-10T14:33:49.923466+0000 mgr.gibba045.orlgmj (mgr.34412) 2412 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:33:52.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:33:51 gibba045 bash[25517]: cephadm 2021-03-10T14:33:49.923527+0000 mgr.gibba045.orlgmj (mgr.34412) 2413 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:33:52.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:33:51 gibba045 bash[25517]: cephadm 2021-03-10T14:33:49.924881+0000 mgr.gibba045.orlgmj (mgr.34412) 2414 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:33:52.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:33:51 gibba045 bash[25517]: cephadm 2021-03-10T14:33:49.924940+0000 mgr.gibba045.orlgmj (mgr.34412) 2415 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:33:52.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:33:51 gibba045 bash[25517]: cephadm 2021-03-10T14:33:49.926352+0000 mgr.gibba045.orlgmj (mgr.34412) 2416 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:33:52.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:33:51 gibba045 bash[25517]: cephadm 2021-03-10T14:33:49.928386+0000 mgr.gibba045.orlgmj (mgr.34412) 2417 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:33:52.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:33:51 gibba045 bash[25517]: cephadm 2021-03-10T14:33:49.928456+0000 mgr.gibba045.orlgmj (mgr.34412) 2418 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:33:52.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:33:51 gibba045 bash[25517]: cephadm 2021-03-10T14:33:49.930018+0000 mgr.gibba045.orlgmj (mgr.34412) 2419 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:33:52.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:33:51 gibba045 bash[25517]: cephadm 2021-03-10T14:33:49.930413+0000 mgr.gibba045.orlgmj (mgr.34412) 2420 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:33:52.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:33:51 gibba045 bash[25517]: cephadm 2021-03-10T14:33:49.931958+0000 mgr.gibba045.orlgmj (mgr.34412) 2421 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:33:52.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:33:51 gibba045 bash[25517]: cephadm 2021-03-10T14:33:49.932049+0000 mgr.gibba045.orlgmj (mgr.34412) 2422 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:33:52.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:33:51 gibba045 bash[25517]: cephadm 2021-03-10T14:33:49.932190+0000 mgr.gibba045.orlgmj (mgr.34412) 2423 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:33:52.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:33:51 gibba015 bash[29377]: cephadm 2021-03-10T14:33:49.919565+0000 mgr.gibba045.orlgmj (mgr.34412) 2410 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:33:52.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:33:51 gibba015 bash[29377]: cephadm 2021-03-10T14:33:49.921676+0000 mgr.gibba045.orlgmj (mgr.34412) 2411 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:33:52.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:33:51 gibba015 bash[29377]: cephadm 2021-03-10T14:33:49.923466+0000 mgr.gibba045.orlgmj (mgr.34412) 2412 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:33:52.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:33:51 gibba015 bash[29377]: cephadm 2021-03-10T14:33:49.923527+0000 mgr.gibba045.orlgmj (mgr.34412) 2413 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:33:52.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:33:51 gibba015 bash[29377]: cephadm 2021-03-10T14:33:49.924881+0000 mgr.gibba045.orlgmj (mgr.34412) 2414 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:33:52.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:33:51 gibba015 bash[29377]: cephadm 2021-03-10T14:33:49.924940+0000 mgr.gibba045.orlgmj (mgr.34412) 2415 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:33:52.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:33:51 gibba015 bash[29377]: cephadm 2021-03-10T14:33:49.926352+0000 mgr.gibba045.orlgmj (mgr.34412) 2416 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:33:52.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:33:51 gibba015 bash[29377]: cephadm 2021-03-10T14:33:49.928386+0000 mgr.gibba045.orlgmj (mgr.34412) 2417 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:33:52.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:33:51 gibba015 bash[29377]: cephadm 2021-03-10T14:33:49.928456+0000 mgr.gibba045.orlgmj (mgr.34412) 2418 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:33:52.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:33:51 gibba015 bash[29377]: cephadm 2021-03-10T14:33:49.930018+0000 mgr.gibba045.orlgmj (mgr.34412) 2419 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:33:52.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:33:51 gibba015 bash[29377]: cephadm 2021-03-10T14:33:49.930413+0000 mgr.gibba045.orlgmj (mgr.34412) 2420 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:33:52.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:33:51 gibba015 bash[29377]: cephadm 2021-03-10T14:33:49.931958+0000 mgr.gibba045.orlgmj (mgr.34412) 2421 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:33:52.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:33:51 gibba015 bash[29377]: cephadm 2021-03-10T14:33:49.932049+0000 mgr.gibba045.orlgmj (mgr.34412) 2422 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:33:52.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:33:51 gibba015 bash[29377]: cephadm 2021-03-10T14:33:49.932190+0000 mgr.gibba045.orlgmj (mgr.34412) 2423 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:33:52.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:33:51 gibba015 bash[30343]: cephadm 2021-03-10T14:33:49.919565+0000 mgr.gibba045.orlgmj (mgr.34412) 2410 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:33:52.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:33:51 gibba015 bash[30343]: cephadm 2021-03-10T14:33:49.921676+0000 mgr.gibba045.orlgmj (mgr.34412) 2411 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:33:52.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:33:51 gibba015 bash[30343]: cephadm 2021-03-10T14:33:49.923466+0000 mgr.gibba045.orlgmj (mgr.34412) 2412 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:33:52.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:33:51 gibba015 bash[30343]: cephadm 2021-03-10T14:33:49.923527+0000 mgr.gibba045.orlgmj (mgr.34412) 2413 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:33:52.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:33:51 gibba015 bash[30343]: cephadm 2021-03-10T14:33:49.924881+0000 mgr.gibba045.orlgmj (mgr.34412) 2414 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:33:52.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:33:51 gibba015 bash[30343]: cephadm 2021-03-10T14:33:49.924940+0000 mgr.gibba045.orlgmj (mgr.34412) 2415 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:33:52.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:33:51 gibba015 bash[30343]: cephadm 2021-03-10T14:33:49.926352+0000 mgr.gibba045.orlgmj (mgr.34412) 2416 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:33:52.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:33:51 gibba015 bash[30343]: cephadm 2021-03-10T14:33:49.928386+0000 mgr.gibba045.orlgmj (mgr.34412) 2417 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:33:52.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:33:51 gibba015 bash[30343]: cephadm 2021-03-10T14:33:49.928456+0000 mgr.gibba045.orlgmj (mgr.34412) 2418 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:33:52.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:33:51 gibba015 bash[30343]: cephadm 2021-03-10T14:33:49.930018+0000 mgr.gibba045.orlgmj (mgr.34412) 2419 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:33:52.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:33:51 gibba015 bash[30343]: cephadm 2021-03-10T14:33:49.930413+0000 mgr.gibba045.orlgmj (mgr.34412) 2420 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:33:52.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:33:51 gibba015 bash[30343]: cephadm 2021-03-10T14:33:49.931958+0000 mgr.gibba045.orlgmj (mgr.34412) 2421 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:33:52.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:33:51 gibba015 bash[30343]: cephadm 2021-03-10T14:33:49.932049+0000 mgr.gibba045.orlgmj (mgr.34412) 2422 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:33:52.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:33:51 gibba015 bash[30343]: cephadm 2021-03-10T14:33:49.932190+0000 mgr.gibba045.orlgmj (mgr.34412) 2423 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:33:53.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:33:52 gibba045 bash[25517]: cluster 2021-03-10T14:33:50.842895+0000 mgr.gibba045.orlgmj (mgr.34412) 2424 : cluster [DBG] pgmap v1363: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:53.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:33:52 gibba015 bash[29377]: cluster 2021-03-10T14:33:50.842895+0000 mgr.gibba045.orlgmj (mgr.34412) 2424 : cluster [DBG] pgmap v1363: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:53.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:33:52 gibba015 bash[30343]: cluster 2021-03-10T14:33:50.842895+0000 mgr.gibba045.orlgmj (mgr.34412) 2424 : cluster [DBG] pgmap v1363: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:54.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:33:53 gibba045 bash[25517]: audit 2021-03-10T14:33:52.747276+0000 mon.c (mon.1) 721 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:33:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:33:53 gibba045 bash[25517]: audit 2021-03-10T14:33:52.747962+0000 mon.c (mon.1) 722 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:33:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:33:53 gibba045 bash[25517]: audit 2021-03-10T14:33:52.748422+0000 mon.a (mon.0) 916 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:33:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:33:53 gibba045 bash[25517]: audit 2021-03-10T14:33:52.749583+0000 mon.a (mon.0) 917 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:33:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:33:53 gibba045 bash[25517]: audit 2021-03-10T14:33:52.755839+0000 mon.c (mon.1) 723 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T14:33:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:33:53 gibba045 bash[25517]: audit 2021-03-10T14:33:52.756555+0000 mon.c (mon.1) 724 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:33:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:33:53 gibba045 bash[25517]: audit 2021-03-10T14:33:52.756958+0000 mon.a (mon.0) 918 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T14:33:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:33:53 gibba045 bash[25517]: audit 2021-03-10T14:33:52.757276+0000 mon.c (mon.1) 725 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:33:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:33:53 gibba045 bash[25517]: audit 2021-03-10T14:33:52.758108+0000 mon.c (mon.1) 726 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:33:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:33:53 gibba045 bash[25517]: audit 2021-03-10T14:33:52.758241+0000 mon.a (mon.0) 919 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:33:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:33:53 gibba045 bash[25517]: audit 2021-03-10T14:33:52.759415+0000 mon.a (mon.0) 920 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:33:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:33:53 gibba045 bash[25517]: audit 2021-03-10T14:33:52.760208+0000 mon.a (mon.0) 921 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:33:54.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:33:53 gibba015 bash[29377]: audit 2021-03-10T14:33:52.747276+0000 mon.c (mon.1) 721 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:33:54.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:33:53 gibba015 bash[29377]: audit 2021-03-10T14:33:52.747962+0000 mon.c (mon.1) 722 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:33:54.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:33:53 gibba015 bash[29377]: audit 2021-03-10T14:33:52.748422+0000 mon.a (mon.0) 916 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:33:54.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:33:53 gibba015 bash[29377]: audit 2021-03-10T14:33:52.749583+0000 mon.a (mon.0) 917 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:33:54.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:33:53 gibba015 bash[29377]: audit 2021-03-10T14:33:52.755839+0000 mon.c (mon.1) 723 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T14:33:54.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:33:53 gibba015 bash[29377]: audit 2021-03-10T14:33:52.756555+0000 mon.c (mon.1) 724 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:33:54.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:33:53 gibba015 bash[29377]: audit 2021-03-10T14:33:52.756958+0000 mon.a (mon.0) 918 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T14:33:54.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:33:53 gibba015 bash[29377]: audit 2021-03-10T14:33:52.757276+0000 mon.c (mon.1) 725 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:33:54.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:33:53 gibba015 bash[29377]: audit 2021-03-10T14:33:52.758108+0000 mon.c (mon.1) 726 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:33:54.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:33:53 gibba015 bash[29377]: audit 2021-03-10T14:33:52.758241+0000 mon.a (mon.0) 919 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:33:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:33:53 gibba015 bash[29377]: audit 2021-03-10T14:33:52.759415+0000 mon.a (mon.0) 920 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:33:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:33:53 gibba015 bash[29377]: audit 2021-03-10T14:33:52.760208+0000 mon.a (mon.0) 921 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:33:54.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:33:53 gibba015 bash[30343]: audit 2021-03-10T14:33:52.747276+0000 mon.c (mon.1) 721 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:33:54.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:33:53 gibba015 bash[30343]: audit 2021-03-10T14:33:52.747962+0000 mon.c (mon.1) 722 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:33:54.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:33:53 gibba015 bash[30343]: audit 2021-03-10T14:33:52.748422+0000 mon.a (mon.0) 916 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:33:54.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:33:53 gibba015 bash[30343]: audit 2021-03-10T14:33:52.749583+0000 mon.a (mon.0) 917 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:33:54.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:33:53 gibba015 bash[30343]: audit 2021-03-10T14:33:52.755839+0000 mon.c (mon.1) 723 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T14:33:54.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:33:53 gibba015 bash[30343]: audit 2021-03-10T14:33:52.756555+0000 mon.c (mon.1) 724 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:33:54.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:33:53 gibba015 bash[30343]: audit 2021-03-10T14:33:52.756958+0000 mon.a (mon.0) 918 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T14:33:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:33:53 gibba015 bash[30343]: audit 2021-03-10T14:33:52.757276+0000 mon.c (mon.1) 725 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:33:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:33:53 gibba015 bash[30343]: audit 2021-03-10T14:33:52.758108+0000 mon.c (mon.1) 726 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:33:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:33:53 gibba015 bash[30343]: audit 2021-03-10T14:33:52.758241+0000 mon.a (mon.0) 919 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:33:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:33:53 gibba015 bash[30343]: audit 2021-03-10T14:33:52.759415+0000 mon.a (mon.0) 920 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:33:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:33:53 gibba015 bash[30343]: audit 2021-03-10T14:33:52.760208+0000 mon.a (mon.0) 921 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:33:55.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:33:54 gibba045 bash[25517]: cluster 2021-03-10T14:33:52.844635+0000 mgr.gibba045.orlgmj (mgr.34412) 2425 : cluster [DBG] pgmap v1364: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:55.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:33:54 gibba015 bash[29377]: cluster 2021-03-10T14:33:52.844635+0000 mgr.gibba045.orlgmj (mgr.34412) 2425 : cluster [DBG] pgmap v1364: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:55.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:33:54 gibba015 bash[30343]: cluster 2021-03-10T14:33:52.844635+0000 mgr.gibba045.orlgmj (mgr.34412) 2425 : cluster [DBG] pgmap v1364: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:57.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:33:56 gibba045 bash[25517]: cluster 2021-03-10T14:33:54.846101+0000 mgr.gibba045.orlgmj (mgr.34412) 2426 : cluster [DBG] pgmap v1365: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:57.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:33:56 gibba015 bash[29377]: cluster 2021-03-10T14:33:54.846101+0000 mgr.gibba045.orlgmj (mgr.34412) 2426 : cluster [DBG] pgmap v1365: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:57.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:33:56 gibba015 bash[30343]: cluster 2021-03-10T14:33:54.846101+0000 mgr.gibba045.orlgmj (mgr.34412) 2426 : cluster [DBG] pgmap v1365: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:59.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:33:58 gibba045 bash[25517]: cluster 2021-03-10T14:33:56.846882+0000 mgr.gibba045.orlgmj (mgr.34412) 2427 : cluster [DBG] pgmap v1366: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:59.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:33:58 gibba015 bash[29377]: cluster 2021-03-10T14:33:56.846882+0000 mgr.gibba045.orlgmj (mgr.34412) 2427 : cluster [DBG] pgmap v1366: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:59.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:33:58 gibba015 bash[30343]: cluster 2021-03-10T14:33:56.846882+0000 mgr.gibba045.orlgmj (mgr.34412) 2427 : cluster [DBG] pgmap v1366: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:01.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:34:00 gibba045 bash[25517]: cluster 2021-03-10T14:33:58.847841+0000 mgr.gibba045.orlgmj (mgr.34412) 2428 : cluster [DBG] pgmap v1367: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:01.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:34:00 gibba015 bash[29377]: cluster 2021-03-10T14:33:58.847841+0000 mgr.gibba045.orlgmj (mgr.34412) 2428 : cluster [DBG] pgmap v1367: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:01.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:34:00 gibba015 bash[30343]: cluster 2021-03-10T14:33:58.847841+0000 mgr.gibba045.orlgmj (mgr.34412) 2428 : cluster [DBG] pgmap v1367: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:03.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:34:02 gibba045 bash[25517]: cluster 2021-03-10T14:34:00.849015+0000 mgr.gibba045.orlgmj (mgr.34412) 2429 : cluster [DBG] pgmap v1368: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:03.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:34:02 gibba015 bash[29377]: cluster 2021-03-10T14:34:00.849015+0000 mgr.gibba045.orlgmj (mgr.34412) 2429 : cluster [DBG] pgmap v1368: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:03.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:34:02 gibba015 bash[30343]: cluster 2021-03-10T14:34:00.849015+0000 mgr.gibba045.orlgmj (mgr.34412) 2429 : cluster [DBG] pgmap v1368: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:04.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:34:03 gibba015 bash[29377]: cluster 2021-03-10T14:34:02.849921+0000 mgr.gibba045.orlgmj (mgr.34412) 2430 : cluster [DBG] pgmap v1369: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:04.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:34:03 gibba015 bash[30343]: cluster 2021-03-10T14:34:02.849921+0000 mgr.gibba045.orlgmj (mgr.34412) 2430 : cluster [DBG] pgmap v1369: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:04.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:34:03 gibba045 bash[25517]: cluster 2021-03-10T14:34:02.849921+0000 mgr.gibba045.orlgmj (mgr.34412) 2430 : cluster [DBG] pgmap v1369: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:06.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:34:05 gibba015 bash[29377]: cluster 2021-03-10T14:34:04.851438+0000 mgr.gibba045.orlgmj (mgr.34412) 2431 : cluster [DBG] pgmap v1370: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:06.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:34:05 gibba015 bash[29377]: cephadm 2021-03-10T14:34:04.947832+0000 mgr.gibba045.orlgmj (mgr.34412) 2432 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:34:06.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:34:05 gibba015 bash[30343]: cluster 2021-03-10T14:34:04.851438+0000 mgr.gibba045.orlgmj (mgr.34412) 2431 : cluster [DBG] pgmap v1370: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:06.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:34:05 gibba015 bash[30343]: cephadm 2021-03-10T14:34:04.947832+0000 mgr.gibba045.orlgmj (mgr.34412) 2432 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:34:06.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:34:05 gibba045 bash[25517]: cluster 2021-03-10T14:34:04.851438+0000 mgr.gibba045.orlgmj (mgr.34412) 2431 : cluster [DBG] pgmap v1370: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:06.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:34:05 gibba045 bash[25517]: cephadm 2021-03-10T14:34:04.947832+0000 mgr.gibba045.orlgmj (mgr.34412) 2432 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:34:08.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:34:08 gibba015 bash[29377]: cluster 2021-03-10T14:34:06.852345+0000 mgr.gibba045.orlgmj (mgr.34412) 2433 : cluster [DBG] pgmap v1371: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:08.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:34:08 gibba015 bash[30343]: cluster 2021-03-10T14:34:06.852345+0000 mgr.gibba045.orlgmj (mgr.34412) 2433 : cluster [DBG] pgmap v1371: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:09.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:34:08 gibba045 bash[25517]: cluster 2021-03-10T14:34:06.852345+0000 mgr.gibba045.orlgmj (mgr.34412) 2433 : cluster [DBG] pgmap v1371: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:10.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:34:10 gibba015 bash[29377]: cluster 2021-03-10T14:34:08.853329+0000 mgr.gibba045.orlgmj (mgr.34412) 2434 : cluster [DBG] pgmap v1372: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:10.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:34:10 gibba015 bash[30343]: cluster 2021-03-10T14:34:08.853329+0000 mgr.gibba045.orlgmj (mgr.34412) 2434 : cluster [DBG] pgmap v1372: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:11.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:34:10 gibba045 bash[25517]: cluster 2021-03-10T14:34:08.853329+0000 mgr.gibba045.orlgmj (mgr.34412) 2434 : cluster [DBG] pgmap v1372: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:11.905 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:34:12.140 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:34:12.140 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (44m) 22s ago 50m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:34:12.140 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (50m) 9m ago 50m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:34:12.141 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (45m) 9m ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:34:12.141 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (45m) 9m ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:34:12.141 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (44m) 22s ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:34:12.141 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (44m) 22s ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:34:12.142 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (43m) 9m ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:34:12.142 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (44m) 22s ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:34:12.142 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (50m) 22s ago 50m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:34:12.142 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (50m) 9m ago 50m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:34:12.142 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (43m) 22s ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:34:12.143 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (42m) 22s ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:34:12.143 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (42m) 22s ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:34:12.143 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (41m) 22s ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:34:12.143 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (41m) 9m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:34:12.143 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (41m) 9m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:34:12.144 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (40m) 9m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:34:12.144 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (40m) 9m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:34:12.144 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (49m) 9m ago 50m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:34:12.144 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 9m ago 48m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:34:12.390 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:34:12.391 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:34:12.391 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:34:12.391 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:34:12.391 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:34:12.392 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:34:12.392 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:34:12.392 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:34:12.392 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:34:12.392 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:34:12.393 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:34:12.393 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:34:12.393 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:34:12.393 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:34:12.393 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:34:12.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:34:12 gibba015 bash[29377]: cluster 2021-03-10T14:34:10.854941+0000 mgr.gibba045.orlgmj (mgr.34412) 2435 : cluster [DBG] pgmap v1373: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:12.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:34:12 gibba015 bash[29377]: audit 2021-03-10T14:34:12.387939+0000 mon.a (mon.0) 922 : audit [DBG] from='client.? 172.21.2.115:0/2310452383' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:34:12.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:34:12 gibba015 bash[30343]: cluster 2021-03-10T14:34:10.854941+0000 mgr.gibba045.orlgmj (mgr.34412) 2435 : cluster [DBG] pgmap v1373: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:12.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:34:12 gibba015 bash[30343]: audit 2021-03-10T14:34:12.387939+0000 mon.a (mon.0) 922 : audit [DBG] from='client.? 172.21.2.115:0/2310452383' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:34:13.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:34:12 gibba045 bash[25517]: cluster 2021-03-10T14:34:10.854941+0000 mgr.gibba045.orlgmj (mgr.34412) 2435 : cluster [DBG] pgmap v1373: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:13.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:34:12 gibba045 bash[25517]: audit 2021-03-10T14:34:12.387939+0000 mon.a (mon.0) 922 : audit [DBG] from='client.? 172.21.2.115:0/2310452383' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:34:13.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:34:13 gibba015 bash[29377]: audit 2021-03-10T14:34:11.898337+0000 mgr.gibba045.orlgmj (mgr.34412) 2436 : audit [DBG] from='client.45690 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:34:13.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:34:13 gibba015 bash[29377]: audit 2021-03-10T14:34:12.124011+0000 mgr.gibba045.orlgmj (mgr.34412) 2437 : audit [DBG] from='client.45696 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:34:13.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:34:13 gibba015 bash[30343]: audit 2021-03-10T14:34:11.898337+0000 mgr.gibba045.orlgmj (mgr.34412) 2436 : audit [DBG] from='client.45690 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:34:13.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:34:13 gibba015 bash[30343]: audit 2021-03-10T14:34:12.124011+0000 mgr.gibba045.orlgmj (mgr.34412) 2437 : audit [DBG] from='client.45696 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:34:14.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:34:13 gibba045 bash[25517]: audit 2021-03-10T14:34:11.898337+0000 mgr.gibba045.orlgmj (mgr.34412) 2436 : audit [DBG] from='client.45690 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:34:14.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:34:13 gibba045 bash[25517]: audit 2021-03-10T14:34:12.124011+0000 mgr.gibba045.orlgmj (mgr.34412) 2437 : audit [DBG] from='client.45696 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:34:14.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:34:14 gibba015 bash[29377]: cluster 2021-03-10T14:34:12.856691+0000 mgr.gibba045.orlgmj (mgr.34412) 2438 : cluster [DBG] pgmap v1374: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:14.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:34:14 gibba015 bash[30343]: cluster 2021-03-10T14:34:12.856691+0000 mgr.gibba045.orlgmj (mgr.34412) 2438 : cluster [DBG] pgmap v1374: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:15.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:34:14 gibba045 bash[25517]: cluster 2021-03-10T14:34:12.856691+0000 mgr.gibba045.orlgmj (mgr.34412) 2438 : cluster [DBG] pgmap v1374: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:16.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:34:16 gibba015 bash[29377]: cluster 2021-03-10T14:34:14.858325+0000 mgr.gibba045.orlgmj (mgr.34412) 2439 : cluster [DBG] pgmap v1375: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:16.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:34:16 gibba015 bash[30343]: cluster 2021-03-10T14:34:14.858325+0000 mgr.gibba045.orlgmj (mgr.34412) 2439 : cluster [DBG] pgmap v1375: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:17.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:34:16 gibba045 bash[25517]: cluster 2021-03-10T14:34:14.858325+0000 mgr.gibba045.orlgmj (mgr.34412) 2439 : cluster [DBG] pgmap v1375: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:18.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:34:18 gibba015 bash[29377]: cluster 2021-03-10T14:34:16.859228+0000 mgr.gibba045.orlgmj (mgr.34412) 2440 : cluster [DBG] pgmap v1376: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:18.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:34:18 gibba015 bash[30343]: cluster 2021-03-10T14:34:16.859228+0000 mgr.gibba045.orlgmj (mgr.34412) 2440 : cluster [DBG] pgmap v1376: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:19.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:34:18 gibba045 bash[25517]: cluster 2021-03-10T14:34:16.859228+0000 mgr.gibba045.orlgmj (mgr.34412) 2440 : cluster [DBG] pgmap v1376: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:20.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:34:20 gibba015 bash[29377]: cluster 2021-03-10T14:34:18.859858+0000 mgr.gibba045.orlgmj (mgr.34412) 2441 : cluster [DBG] pgmap v1377: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:20.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:34:20 gibba015 bash[30343]: cluster 2021-03-10T14:34:18.859858+0000 mgr.gibba045.orlgmj (mgr.34412) 2441 : cluster [DBG] pgmap v1377: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:21.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:34:20 gibba045 bash[25517]: cluster 2021-03-10T14:34:18.859858+0000 mgr.gibba045.orlgmj (mgr.34412) 2441 : cluster [DBG] pgmap v1377: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:22.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:34:21 gibba045 bash[25517]: cephadm 2021-03-10T14:34:19.963953+0000 mgr.gibba045.orlgmj (mgr.34412) 2442 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:34:22.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:34:21 gibba015 bash[29377]: cephadm 2021-03-10T14:34:19.963953+0000 mgr.gibba045.orlgmj (mgr.34412) 2442 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:34:22.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:34:21 gibba015 bash[30343]: cephadm 2021-03-10T14:34:19.963953+0000 mgr.gibba045.orlgmj (mgr.34412) 2442 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:34:23.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:34:22 gibba045 bash[25517]: cluster 2021-03-10T14:34:20.861653+0000 mgr.gibba045.orlgmj (mgr.34412) 2443 : cluster [DBG] pgmap v1378: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:23.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:34:22 gibba015 bash[29377]: cluster 2021-03-10T14:34:20.861653+0000 mgr.gibba045.orlgmj (mgr.34412) 2443 : cluster [DBG] pgmap v1378: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:23.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:34:22 gibba015 bash[30343]: cluster 2021-03-10T14:34:20.861653+0000 mgr.gibba045.orlgmj (mgr.34412) 2443 : cluster [DBG] pgmap v1378: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:25.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:34:24 gibba045 bash[25517]: cluster 2021-03-10T14:34:22.863240+0000 mgr.gibba045.orlgmj (mgr.34412) 2444 : cluster [DBG] pgmap v1379: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:25.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:34:24 gibba015 bash[29377]: cluster 2021-03-10T14:34:22.863240+0000 mgr.gibba045.orlgmj (mgr.34412) 2444 : cluster [DBG] pgmap v1379: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:25.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:34:24 gibba015 bash[30343]: cluster 2021-03-10T14:34:22.863240+0000 mgr.gibba045.orlgmj (mgr.34412) 2444 : cluster [DBG] pgmap v1379: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:27.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:34:26 gibba045 bash[25517]: cluster 2021-03-10T14:34:24.864917+0000 mgr.gibba045.orlgmj (mgr.34412) 2445 : cluster [DBG] pgmap v1380: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:27.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:34:26 gibba015 bash[29377]: cluster 2021-03-10T14:34:24.864917+0000 mgr.gibba045.orlgmj (mgr.34412) 2445 : cluster [DBG] pgmap v1380: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:27.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:34:26 gibba015 bash[30343]: cluster 2021-03-10T14:34:24.864917+0000 mgr.gibba045.orlgmj (mgr.34412) 2445 : cluster [DBG] pgmap v1380: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:29.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:34:28 gibba045 bash[25517]: cluster 2021-03-10T14:34:26.865668+0000 mgr.gibba045.orlgmj (mgr.34412) 2446 : cluster [DBG] pgmap v1381: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:29.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:34:28 gibba015 bash[29377]: cluster 2021-03-10T14:34:26.865668+0000 mgr.gibba045.orlgmj (mgr.34412) 2446 : cluster [DBG] pgmap v1381: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:29.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:34:28 gibba015 bash[30343]: cluster 2021-03-10T14:34:26.865668+0000 mgr.gibba045.orlgmj (mgr.34412) 2446 : cluster [DBG] pgmap v1381: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:31.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:34:30 gibba045 bash[25517]: cluster 2021-03-10T14:34:28.866615+0000 mgr.gibba045.orlgmj (mgr.34412) 2447 : cluster [DBG] pgmap v1382: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:31.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:34:30 gibba015 bash[29377]: cluster 2021-03-10T14:34:28.866615+0000 mgr.gibba045.orlgmj (mgr.34412) 2447 : cluster [DBG] pgmap v1382: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:31.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:34:30 gibba015 bash[30343]: cluster 2021-03-10T14:34:28.866615+0000 mgr.gibba045.orlgmj (mgr.34412) 2447 : cluster [DBG] pgmap v1382: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:33.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:34:32 gibba045 bash[25517]: cluster 2021-03-10T14:34:30.868493+0000 mgr.gibba045.orlgmj (mgr.34412) 2448 : cluster [DBG] pgmap v1383: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:33.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:34:32 gibba015 bash[29377]: cluster 2021-03-10T14:34:30.868493+0000 mgr.gibba045.orlgmj (mgr.34412) 2448 : cluster [DBG] pgmap v1383: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:33.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:34:32 gibba015 bash[30343]: cluster 2021-03-10T14:34:30.868493+0000 mgr.gibba045.orlgmj (mgr.34412) 2448 : cluster [DBG] pgmap v1383: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:35.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:34:34 gibba045 bash[25517]: cluster 2021-03-10T14:34:32.869995+0000 mgr.gibba045.orlgmj (mgr.34412) 2449 : cluster [DBG] pgmap v1384: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:35.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:34:34 gibba015 bash[29377]: cluster 2021-03-10T14:34:32.869995+0000 mgr.gibba045.orlgmj (mgr.34412) 2449 : cluster [DBG] pgmap v1384: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:35.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:34:34 gibba015 bash[30343]: cluster 2021-03-10T14:34:32.869995+0000 mgr.gibba045.orlgmj (mgr.34412) 2449 : cluster [DBG] pgmap v1384: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:37.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:34:36 gibba045 bash[25517]: cluster 2021-03-10T14:34:34.871549+0000 mgr.gibba045.orlgmj (mgr.34412) 2450 : cluster [DBG] pgmap v1385: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:37.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:34:36 gibba045 bash[25517]: cephadm 2021-03-10T14:34:34.979989+0000 mgr.gibba045.orlgmj (mgr.34412) 2451 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:34:37.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:34:36 gibba015 bash[29377]: cluster 2021-03-10T14:34:34.871549+0000 mgr.gibba045.orlgmj (mgr.34412) 2450 : cluster [DBG] pgmap v1385: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:37.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:34:36 gibba015 bash[29377]: cephadm 2021-03-10T14:34:34.979989+0000 mgr.gibba045.orlgmj (mgr.34412) 2451 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:34:37.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:34:36 gibba015 bash[30343]: cluster 2021-03-10T14:34:34.871549+0000 mgr.gibba045.orlgmj (mgr.34412) 2450 : cluster [DBG] pgmap v1385: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:37.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:34:36 gibba015 bash[30343]: cephadm 2021-03-10T14:34:34.979989+0000 mgr.gibba045.orlgmj (mgr.34412) 2451 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:34:38.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:34:38 gibba015 bash[29377]: cluster 2021-03-10T14:34:36.872814+0000 mgr.gibba045.orlgmj (mgr.34412) 2452 : cluster [DBG] pgmap v1386: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:38.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:34:38 gibba015 bash[30343]: cluster 2021-03-10T14:34:36.872814+0000 mgr.gibba045.orlgmj (mgr.34412) 2452 : cluster [DBG] pgmap v1386: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:39.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:34:38 gibba045 bash[25517]: cluster 2021-03-10T14:34:36.872814+0000 mgr.gibba045.orlgmj (mgr.34412) 2452 : cluster [DBG] pgmap v1386: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:40.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:34:40 gibba015 bash[29377]: cluster 2021-03-10T14:34:38.873843+0000 mgr.gibba045.orlgmj (mgr.34412) 2453 : cluster [DBG] pgmap v1387: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:40.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:34:40 gibba015 bash[30343]: cluster 2021-03-10T14:34:38.873843+0000 mgr.gibba045.orlgmj (mgr.34412) 2453 : cluster [DBG] pgmap v1387: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:41.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:34:40 gibba045 bash[25517]: cluster 2021-03-10T14:34:38.873843+0000 mgr.gibba045.orlgmj (mgr.34412) 2453 : cluster [DBG] pgmap v1387: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:42.634 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:34:42.863 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:34:42.863 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (45m) 53s ago 50m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:34:42.864 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (50m) 9m ago 50m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:34:42.864 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (45m) 9m ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:34:42.864 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (46m) 9m ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:34:42.864 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (45m) 53s ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:34:42.864 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (44m) 53s ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:34:42.865 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (44m) 9m ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:34:42.865 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (44m) 53s ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:34:42.865 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (50m) 53s ago 50m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:34:42.865 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (50m) 9m ago 50m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:34:42.866 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (43m) 53s ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:34:42.866 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (43m) 53s ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:34:42.866 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (42m) 53s ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:34:42.866 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (42m) 53s ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:34:42.867 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (42m) 9m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:34:42.867 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (41m) 9m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:34:42.867 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (41m) 9m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:34:42.867 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (40m) 9m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:34:42.867 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (50m) 9m ago 51m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:34:42.868 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 9m ago 48m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:34:42.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:34:42 gibba015 bash[29377]: cluster 2021-03-10T14:34:40.875400+0000 mgr.gibba045.orlgmj (mgr.34412) 2454 : cluster [DBG] pgmap v1388: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:42.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:34:42 gibba015 bash[30343]: cluster 2021-03-10T14:34:40.875400+0000 mgr.gibba045.orlgmj (mgr.34412) 2454 : cluster [DBG] pgmap v1388: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:43.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:34:42 gibba045 bash[25517]: cluster 2021-03-10T14:34:40.875400+0000 mgr.gibba045.orlgmj (mgr.34412) 2454 : cluster [DBG] pgmap v1388: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:43.114 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:34:43.114 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:34:43.114 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:34:43.115 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:34:43.115 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:34:43.115 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:34:43.115 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:34:43.115 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:34:43.116 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:34:43.116 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:34:43.116 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:34:43.116 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:34:43.117 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:34:43.117 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:34:43.117 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:34:43.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:34:43 gibba015 bash[29377]: audit 2021-03-10T14:34:42.625876+0000 mgr.gibba045.orlgmj (mgr.34412) 2455 : audit [DBG] from='client.45708 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:34:43.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:34:43 gibba015 bash[29377]: audit 2021-03-10T14:34:43.111044+0000 mon.c (mon.1) 727 : audit [DBG] from='client.? 172.21.2.115:0/1225653253' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:34:43.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:34:43 gibba015 bash[30343]: audit 2021-03-10T14:34:42.625876+0000 mgr.gibba045.orlgmj (mgr.34412) 2455 : audit [DBG] from='client.45708 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:34:43.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:34:43 gibba015 bash[30343]: audit 2021-03-10T14:34:43.111044+0000 mon.c (mon.1) 727 : audit [DBG] from='client.? 172.21.2.115:0/1225653253' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:34:44.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:34:43 gibba045 bash[25517]: audit 2021-03-10T14:34:42.625876+0000 mgr.gibba045.orlgmj (mgr.34412) 2455 : audit [DBG] from='client.45708 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:34:44.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:34:43 gibba045 bash[25517]: audit 2021-03-10T14:34:43.111044+0000 mon.c (mon.1) 727 : audit [DBG] from='client.? 172.21.2.115:0/1225653253' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:34:44.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:34:44 gibba015 bash[29377]: audit 2021-03-10T14:34:42.851735+0000 mgr.gibba045.orlgmj (mgr.34412) 2456 : audit [DBG] from='client.45714 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:34:44.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:34:44 gibba015 bash[29377]: cluster 2021-03-10T14:34:42.876210+0000 mgr.gibba045.orlgmj (mgr.34412) 2457 : cluster [DBG] pgmap v1389: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:44.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:34:44 gibba015 bash[30343]: audit 2021-03-10T14:34:42.851735+0000 mgr.gibba045.orlgmj (mgr.34412) 2456 : audit [DBG] from='client.45714 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:34:44.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:34:44 gibba015 bash[30343]: cluster 2021-03-10T14:34:42.876210+0000 mgr.gibba045.orlgmj (mgr.34412) 2457 : cluster [DBG] pgmap v1389: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:45.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:34:44 gibba045 bash[25517]: audit 2021-03-10T14:34:42.851735+0000 mgr.gibba045.orlgmj (mgr.34412) 2456 : audit [DBG] from='client.45714 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:34:45.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:34:44 gibba045 bash[25517]: cluster 2021-03-10T14:34:42.876210+0000 mgr.gibba045.orlgmj (mgr.34412) 2457 : cluster [DBG] pgmap v1389: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:46.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:34:46 gibba015 bash[29377]: cluster 2021-03-10T14:34:44.877792+0000 mgr.gibba045.orlgmj (mgr.34412) 2458 : cluster [DBG] pgmap v1390: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:46.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:34:46 gibba015 bash[30343]: cluster 2021-03-10T14:34:44.877792+0000 mgr.gibba045.orlgmj (mgr.34412) 2458 : cluster [DBG] pgmap v1390: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:47.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:34:46 gibba045 bash[25517]: cluster 2021-03-10T14:34:44.877792+0000 mgr.gibba045.orlgmj (mgr.34412) 2458 : cluster [DBG] pgmap v1390: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:49.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:34:48 gibba045 bash[25517]: cluster 2021-03-10T14:34:46.879536+0000 mgr.gibba045.orlgmj (mgr.34412) 2459 : cluster [DBG] pgmap v1391: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:49.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:34:48 gibba015 bash[29377]: cluster 2021-03-10T14:34:46.879536+0000 mgr.gibba045.orlgmj (mgr.34412) 2459 : cluster [DBG] pgmap v1391: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:49.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:34:48 gibba015 bash[30343]: cluster 2021-03-10T14:34:46.879536+0000 mgr.gibba045.orlgmj (mgr.34412) 2459 : cluster [DBG] pgmap v1391: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:51.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:34:50 gibba045 bash[25517]: cluster 2021-03-10T14:34:48.880787+0000 mgr.gibba045.orlgmj (mgr.34412) 2460 : cluster [DBG] pgmap v1392: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:51.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:34:50 gibba045 bash[25517]: audit 2021-03-10T14:34:49.993244+0000 mon.c (mon.1) 728 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:34:51.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:34:50 gibba045 bash[25517]: audit 2021-03-10T14:34:50.000064+0000 mon.c (mon.1) 729 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:34:51.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:34:50 gibba015 bash[29377]: cluster 2021-03-10T14:34:48.880787+0000 mgr.gibba045.orlgmj (mgr.34412) 2460 : cluster [DBG] pgmap v1392: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:51.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:34:50 gibba015 bash[29377]: audit 2021-03-10T14:34:49.993244+0000 mon.c (mon.1) 728 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:34:51.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:34:50 gibba015 bash[29377]: audit 2021-03-10T14:34:50.000064+0000 mon.c (mon.1) 729 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:34:51.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:34:50 gibba015 bash[30343]: cluster 2021-03-10T14:34:48.880787+0000 mgr.gibba045.orlgmj (mgr.34412) 2460 : cluster [DBG] pgmap v1392: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:51.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:34:50 gibba015 bash[30343]: audit 2021-03-10T14:34:49.993244+0000 mon.c (mon.1) 728 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:34:51.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:34:50 gibba015 bash[30343]: audit 2021-03-10T14:34:50.000064+0000 mon.c (mon.1) 729 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:34:52.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:34:51 gibba045 bash[25517]: cephadm 2021-03-10T14:34:50.002076+0000 mgr.gibba045.orlgmj (mgr.34412) 2461 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:34:52.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:34:51 gibba015 bash[29377]: cephadm 2021-03-10T14:34:50.002076+0000 mgr.gibba045.orlgmj (mgr.34412) 2461 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:34:52.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:34:51 gibba015 bash[30343]: cephadm 2021-03-10T14:34:50.002076+0000 mgr.gibba045.orlgmj (mgr.34412) 2461 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:34:53.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:34:52 gibba045 bash[25517]: cluster 2021-03-10T14:34:50.882663+0000 mgr.gibba045.orlgmj (mgr.34412) 2462 : cluster [DBG] pgmap v1393: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:53.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:34:52 gibba015 bash[29377]: cluster 2021-03-10T14:34:50.882663+0000 mgr.gibba045.orlgmj (mgr.34412) 2462 : cluster [DBG] pgmap v1393: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:53.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:34:52 gibba015 bash[30343]: cluster 2021-03-10T14:34:50.882663+0000 mgr.gibba045.orlgmj (mgr.34412) 2462 : cluster [DBG] pgmap v1393: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:34:53 gibba045 bash[25517]: audit 2021-03-10T14:34:52.756118+0000 mon.c (mon.1) 730 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:34:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:34:53 gibba045 bash[25517]: audit 2021-03-10T14:34:52.756414+0000 mon.c (mon.1) 731 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:34:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:34:53 gibba045 bash[25517]: audit 2021-03-10T14:34:52.756898+0000 mon.a (mon.0) 923 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:34:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:34:53 gibba045 bash[25517]: audit 2021-03-10T14:34:52.757383+0000 mon.a (mon.0) 924 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:34:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:34:53 gibba045 bash[25517]: audit 2021-03-10T14:34:52.760817+0000 mon.c (mon.1) 732 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T14:34:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:34:53 gibba045 bash[25517]: audit 2021-03-10T14:34:52.761215+0000 mon.c (mon.1) 733 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:34:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:34:53 gibba045 bash[25517]: audit 2021-03-10T14:34:52.761548+0000 mon.a (mon.0) 925 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T14:34:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:34:53 gibba045 bash[25517]: audit 2021-03-10T14:34:52.761579+0000 mon.c (mon.1) 734 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:34:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:34:53 gibba045 bash[25517]: audit 2021-03-10T14:34:52.761926+0000 mon.c (mon.1) 735 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:34:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:34:53 gibba045 bash[25517]: audit 2021-03-10T14:34:52.762680+0000 mon.a (mon.0) 926 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:34:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:34:53 gibba045 bash[25517]: audit 2021-03-10T14:34:52.763159+0000 mon.a (mon.0) 927 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:34:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:34:53 gibba045 bash[25517]: audit 2021-03-10T14:34:52.763725+0000 mon.a (mon.0) 928 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:34:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:34:53 gibba045 bash[25517]: audit 2021-03-10T14:34:53.738475+0000 mon.a (mon.0) 929 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:34:54.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:34:53 gibba015 bash[29377]: audit 2021-03-10T14:34:52.756118+0000 mon.c (mon.1) 730 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:34:54.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:34:53 gibba015 bash[29377]: audit 2021-03-10T14:34:52.756414+0000 mon.c (mon.1) 731 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:34:54.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:34:53 gibba015 bash[29377]: audit 2021-03-10T14:34:52.756898+0000 mon.a (mon.0) 923 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:34:54.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:34:53 gibba015 bash[29377]: audit 2021-03-10T14:34:52.757383+0000 mon.a (mon.0) 924 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:34:54.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:34:53 gibba015 bash[29377]: audit 2021-03-10T14:34:52.760817+0000 mon.c (mon.1) 732 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T14:34:54.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:34:53 gibba015 bash[29377]: audit 2021-03-10T14:34:52.761215+0000 mon.c (mon.1) 733 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:34:54.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:34:53 gibba015 bash[29377]: audit 2021-03-10T14:34:52.761548+0000 mon.a (mon.0) 925 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T14:34:54.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:34:53 gibba015 bash[29377]: audit 2021-03-10T14:34:52.761579+0000 mon.c (mon.1) 734 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:34:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:34:53 gibba015 bash[29377]: audit 2021-03-10T14:34:52.761926+0000 mon.c (mon.1) 735 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:34:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:34:53 gibba015 bash[29377]: audit 2021-03-10T14:34:52.762680+0000 mon.a (mon.0) 926 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:34:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:34:53 gibba015 bash[29377]: audit 2021-03-10T14:34:52.763159+0000 mon.a (mon.0) 927 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:34:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:34:53 gibba015 bash[29377]: audit 2021-03-10T14:34:52.763725+0000 mon.a (mon.0) 928 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:34:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:34:53 gibba015 bash[29377]: audit 2021-03-10T14:34:53.738475+0000 mon.a (mon.0) 929 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:34:54.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:34:53 gibba015 bash[30343]: audit 2021-03-10T14:34:52.756118+0000 mon.c (mon.1) 730 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:34:54.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:34:53 gibba015 bash[30343]: audit 2021-03-10T14:34:52.756414+0000 mon.c (mon.1) 731 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:34:54.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:34:53 gibba015 bash[30343]: audit 2021-03-10T14:34:52.756898+0000 mon.a (mon.0) 923 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:34:54.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:34:53 gibba015 bash[30343]: audit 2021-03-10T14:34:52.757383+0000 mon.a (mon.0) 924 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:34:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:34:53 gibba015 bash[30343]: audit 2021-03-10T14:34:52.760817+0000 mon.c (mon.1) 732 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T14:34:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:34:53 gibba015 bash[30343]: audit 2021-03-10T14:34:52.761215+0000 mon.c (mon.1) 733 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:34:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:34:53 gibba015 bash[30343]: audit 2021-03-10T14:34:52.761548+0000 mon.a (mon.0) 925 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T14:34:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:34:53 gibba015 bash[30343]: audit 2021-03-10T14:34:52.761579+0000 mon.c (mon.1) 734 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:34:54.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:34:53 gibba015 bash[30343]: audit 2021-03-10T14:34:52.761926+0000 mon.c (mon.1) 735 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:34:54.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:34:53 gibba015 bash[30343]: audit 2021-03-10T14:34:52.762680+0000 mon.a (mon.0) 926 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:34:54.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:34:53 gibba015 bash[30343]: audit 2021-03-10T14:34:52.763159+0000 mon.a (mon.0) 927 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:34:54.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:34:53 gibba015 bash[30343]: audit 2021-03-10T14:34:52.763725+0000 mon.a (mon.0) 928 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:34:54.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:34:53 gibba015 bash[30343]: audit 2021-03-10T14:34:53.738475+0000 mon.a (mon.0) 929 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:34:55.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:34:54 gibba045 bash[25517]: cluster 2021-03-10T14:34:52.883237+0000 mgr.gibba045.orlgmj (mgr.34412) 2463 : cluster [DBG] pgmap v1394: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:55.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:34:54 gibba045 bash[25517]: cephadm 2021-03-10T14:34:53.743644+0000 mgr.gibba045.orlgmj (mgr.34412) 2464 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:34:55.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:34:54 gibba045 bash[25517]: audit 2021-03-10T14:34:53.945314+0000 mon.a (mon.0) 930 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:34:55.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:34:54 gibba045 bash[25517]: audit 2021-03-10T14:34:53.949113+0000 mon.c (mon.1) 736 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:34:55.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:34:54 gibba045 bash[25517]: audit 2021-03-10T14:34:53.951191+0000 mon.c (mon.1) 737 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:34:55.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:34:54 gibba045 bash[25517]: audit 2021-03-10T14:34:53.952901+0000 mon.c (mon.1) 738 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:34:55.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:34:54 gibba045 bash[25517]: audit 2021-03-10T14:34:53.954007+0000 mon.c (mon.1) 739 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:34:55.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:34:54 gibba045 bash[25517]: audit 2021-03-10T14:34:53.957115+0000 mon.c (mon.1) 740 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:34:55.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:34:54 gibba045 bash[25517]: audit 2021-03-10T14:34:53.958673+0000 mon.c (mon.1) 741 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:34:55.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:34:54 gibba015 bash[29377]: cluster 2021-03-10T14:34:52.883237+0000 mgr.gibba045.orlgmj (mgr.34412) 2463 : cluster [DBG] pgmap v1394: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:55.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:34:54 gibba015 bash[29377]: cephadm 2021-03-10T14:34:53.743644+0000 mgr.gibba045.orlgmj (mgr.34412) 2464 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:34:55.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:34:54 gibba015 bash[29377]: audit 2021-03-10T14:34:53.945314+0000 mon.a (mon.0) 930 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:34:55.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:34:54 gibba015 bash[29377]: audit 2021-03-10T14:34:53.949113+0000 mon.c (mon.1) 736 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:34:55.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:34:54 gibba015 bash[29377]: audit 2021-03-10T14:34:53.951191+0000 mon.c (mon.1) 737 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:34:55.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:34:54 gibba015 bash[29377]: audit 2021-03-10T14:34:53.952901+0000 mon.c (mon.1) 738 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:34:55.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:34:54 gibba015 bash[29377]: audit 2021-03-10T14:34:53.954007+0000 mon.c (mon.1) 739 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:34:55.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:34:54 gibba015 bash[29377]: audit 2021-03-10T14:34:53.957115+0000 mon.c (mon.1) 740 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:34:55.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:34:54 gibba015 bash[29377]: audit 2021-03-10T14:34:53.958673+0000 mon.c (mon.1) 741 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:34:55.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:34:54 gibba015 bash[30343]: cluster 2021-03-10T14:34:52.883237+0000 mgr.gibba045.orlgmj (mgr.34412) 2463 : cluster [DBG] pgmap v1394: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:55.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:34:54 gibba015 bash[30343]: cephadm 2021-03-10T14:34:53.743644+0000 mgr.gibba045.orlgmj (mgr.34412) 2464 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:34:55.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:34:54 gibba015 bash[30343]: audit 2021-03-10T14:34:53.945314+0000 mon.a (mon.0) 930 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:34:55.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:34:54 gibba015 bash[30343]: audit 2021-03-10T14:34:53.949113+0000 mon.c (mon.1) 736 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:34:55.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:34:54 gibba015 bash[30343]: audit 2021-03-10T14:34:53.951191+0000 mon.c (mon.1) 737 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:34:55.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:34:54 gibba015 bash[30343]: audit 2021-03-10T14:34:53.952901+0000 mon.c (mon.1) 738 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:34:55.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:34:54 gibba015 bash[30343]: audit 2021-03-10T14:34:53.954007+0000 mon.c (mon.1) 739 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:34:55.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:34:54 gibba015 bash[30343]: audit 2021-03-10T14:34:53.957115+0000 mon.c (mon.1) 740 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:34:55.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:34:54 gibba015 bash[30343]: audit 2021-03-10T14:34:53.958673+0000 mon.c (mon.1) 741 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:34:56.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:34:55 gibba045 bash[25517]: cephadm 2021-03-10T14:34:53.952027+0000 mgr.gibba045.orlgmj (mgr.34412) 2465 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:34:56.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:34:55 gibba045 bash[25517]: cephadm 2021-03-10T14:34:53.954375+0000 mgr.gibba045.orlgmj (mgr.34412) 2466 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:34:56.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:34:55 gibba045 bash[25517]: cephadm 2021-03-10T14:34:53.956200+0000 mgr.gibba045.orlgmj (mgr.34412) 2467 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:34:56.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:34:55 gibba045 bash[25517]: cephadm 2021-03-10T14:34:53.956241+0000 mgr.gibba045.orlgmj (mgr.34412) 2468 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:34:56.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:34:55 gibba045 bash[25517]: cephadm 2021-03-10T14:34:53.957488+0000 mgr.gibba045.orlgmj (mgr.34412) 2469 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:34:56.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:34:55 gibba045 bash[25517]: cephadm 2021-03-10T14:34:53.957527+0000 mgr.gibba045.orlgmj (mgr.34412) 2470 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:34:56.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:34:55 gibba045 bash[25517]: cephadm 2021-03-10T14:34:53.958676+0000 mgr.gibba045.orlgmj (mgr.34412) 2471 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:34:56.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:34:55 gibba045 bash[25517]: cephadm 2021-03-10T14:34:53.960353+0000 mgr.gibba045.orlgmj (mgr.34412) 2472 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:34:56.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:34:55 gibba045 bash[25517]: cephadm 2021-03-10T14:34:53.960412+0000 mgr.gibba045.orlgmj (mgr.34412) 2473 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:34:56.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:34:55 gibba045 bash[25517]: cephadm 2021-03-10T14:34:53.961808+0000 mgr.gibba045.orlgmj (mgr.34412) 2474 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:34:56.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:34:55 gibba045 bash[25517]: cephadm 2021-03-10T14:34:53.962208+0000 mgr.gibba045.orlgmj (mgr.34412) 2475 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:34:56.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:34:55 gibba045 bash[25517]: cephadm 2021-03-10T14:34:53.963156+0000 mgr.gibba045.orlgmj (mgr.34412) 2476 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:34:56.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:34:55 gibba045 bash[25517]: cephadm 2021-03-10T14:34:53.963196+0000 mgr.gibba045.orlgmj (mgr.34412) 2477 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:34:56.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:34:55 gibba045 bash[25517]: cephadm 2021-03-10T14:34:53.963309+0000 mgr.gibba045.orlgmj (mgr.34412) 2478 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:34:56.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:34:55 gibba015 bash[29377]: cephadm 2021-03-10T14:34:53.952027+0000 mgr.gibba045.orlgmj (mgr.34412) 2465 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:34:56.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:34:55 gibba015 bash[29377]: cephadm 2021-03-10T14:34:53.954375+0000 mgr.gibba045.orlgmj (mgr.34412) 2466 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:34:56.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:34:55 gibba015 bash[29377]: cephadm 2021-03-10T14:34:53.956200+0000 mgr.gibba045.orlgmj (mgr.34412) 2467 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:34:56.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:34:55 gibba015 bash[29377]: cephadm 2021-03-10T14:34:53.956241+0000 mgr.gibba045.orlgmj (mgr.34412) 2468 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:34:56.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:34:55 gibba015 bash[29377]: cephadm 2021-03-10T14:34:53.957488+0000 mgr.gibba045.orlgmj (mgr.34412) 2469 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:34:56.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:34:55 gibba015 bash[29377]: cephadm 2021-03-10T14:34:53.957527+0000 mgr.gibba045.orlgmj (mgr.34412) 2470 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:34:56.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:34:55 gibba015 bash[29377]: cephadm 2021-03-10T14:34:53.958676+0000 mgr.gibba045.orlgmj (mgr.34412) 2471 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:34:56.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:34:55 gibba015 bash[29377]: cephadm 2021-03-10T14:34:53.960353+0000 mgr.gibba045.orlgmj (mgr.34412) 2472 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:34:56.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:34:55 gibba015 bash[29377]: cephadm 2021-03-10T14:34:53.960412+0000 mgr.gibba045.orlgmj (mgr.34412) 2473 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:34:56.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:34:55 gibba015 bash[29377]: cephadm 2021-03-10T14:34:53.961808+0000 mgr.gibba045.orlgmj (mgr.34412) 2474 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:34:56.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:34:55 gibba015 bash[29377]: cephadm 2021-03-10T14:34:53.962208+0000 mgr.gibba045.orlgmj (mgr.34412) 2475 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:34:56.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:34:55 gibba015 bash[29377]: cephadm 2021-03-10T14:34:53.963156+0000 mgr.gibba045.orlgmj (mgr.34412) 2476 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:34:56.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:34:55 gibba015 bash[29377]: cephadm 2021-03-10T14:34:53.963196+0000 mgr.gibba045.orlgmj (mgr.34412) 2477 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:34:56.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:34:55 gibba015 bash[29377]: cephadm 2021-03-10T14:34:53.963309+0000 mgr.gibba045.orlgmj (mgr.34412) 2478 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:34:56.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:34:55 gibba015 bash[30343]: cephadm 2021-03-10T14:34:53.952027+0000 mgr.gibba045.orlgmj (mgr.34412) 2465 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:34:56.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:34:55 gibba015 bash[30343]: cephadm 2021-03-10T14:34:53.954375+0000 mgr.gibba045.orlgmj (mgr.34412) 2466 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:34:56.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:34:55 gibba015 bash[30343]: cephadm 2021-03-10T14:34:53.956200+0000 mgr.gibba045.orlgmj (mgr.34412) 2467 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:34:56.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:34:55 gibba015 bash[30343]: cephadm 2021-03-10T14:34:53.956241+0000 mgr.gibba045.orlgmj (mgr.34412) 2468 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:34:56.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:34:55 gibba015 bash[30343]: cephadm 2021-03-10T14:34:53.957488+0000 mgr.gibba045.orlgmj (mgr.34412) 2469 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:34:56.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:34:55 gibba015 bash[30343]: cephadm 2021-03-10T14:34:53.957527+0000 mgr.gibba045.orlgmj (mgr.34412) 2470 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:34:56.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:34:55 gibba015 bash[30343]: cephadm 2021-03-10T14:34:53.958676+0000 mgr.gibba045.orlgmj (mgr.34412) 2471 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:34:56.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:34:55 gibba015 bash[30343]: cephadm 2021-03-10T14:34:53.960353+0000 mgr.gibba045.orlgmj (mgr.34412) 2472 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:34:56.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:34:55 gibba015 bash[30343]: cephadm 2021-03-10T14:34:53.960412+0000 mgr.gibba045.orlgmj (mgr.34412) 2473 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:34:56.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:34:55 gibba015 bash[30343]: cephadm 2021-03-10T14:34:53.961808+0000 mgr.gibba045.orlgmj (mgr.34412) 2474 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:34:56.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:34:55 gibba015 bash[30343]: cephadm 2021-03-10T14:34:53.962208+0000 mgr.gibba045.orlgmj (mgr.34412) 2475 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:34:56.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:34:55 gibba015 bash[30343]: cephadm 2021-03-10T14:34:53.963156+0000 mgr.gibba045.orlgmj (mgr.34412) 2476 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:34:56.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:34:55 gibba015 bash[30343]: cephadm 2021-03-10T14:34:53.963196+0000 mgr.gibba045.orlgmj (mgr.34412) 2477 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:34:56.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:34:55 gibba015 bash[30343]: cephadm 2021-03-10T14:34:53.963309+0000 mgr.gibba045.orlgmj (mgr.34412) 2478 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:34:57.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:34:56 gibba045 bash[25517]: cluster 2021-03-10T14:34:54.884880+0000 mgr.gibba045.orlgmj (mgr.34412) 2479 : cluster [DBG] pgmap v1395: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:57.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:34:56 gibba015 bash[29377]: cluster 2021-03-10T14:34:54.884880+0000 mgr.gibba045.orlgmj (mgr.34412) 2479 : cluster [DBG] pgmap v1395: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:57.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:34:56 gibba015 bash[30343]: cluster 2021-03-10T14:34:54.884880+0000 mgr.gibba045.orlgmj (mgr.34412) 2479 : cluster [DBG] pgmap v1395: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:59.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:34:58 gibba045 bash[25517]: cluster 2021-03-10T14:34:56.885757+0000 mgr.gibba045.orlgmj (mgr.34412) 2480 : cluster [DBG] pgmap v1396: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:59.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:34:58 gibba015 bash[29377]: cluster 2021-03-10T14:34:56.885757+0000 mgr.gibba045.orlgmj (mgr.34412) 2480 : cluster [DBG] pgmap v1396: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:59.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:34:58 gibba015 bash[30343]: cluster 2021-03-10T14:34:56.885757+0000 mgr.gibba045.orlgmj (mgr.34412) 2480 : cluster [DBG] pgmap v1396: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:01.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:35:00 gibba045 bash[25517]: cluster 2021-03-10T14:34:58.886715+0000 mgr.gibba045.orlgmj (mgr.34412) 2481 : cluster [DBG] pgmap v1397: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:01.203 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:35:00 gibba015 bash[29377]: cluster 2021-03-10T14:34:58.886715+0000 mgr.gibba045.orlgmj (mgr.34412) 2481 : cluster [DBG] pgmap v1397: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:01.203 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:35:00 gibba015 bash[30343]: cluster 2021-03-10T14:34:58.886715+0000 mgr.gibba045.orlgmj (mgr.34412) 2481 : cluster [DBG] pgmap v1397: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:03.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:35:02 gibba045 bash[25517]: cluster 2021-03-10T14:35:00.888506+0000 mgr.gibba045.orlgmj (mgr.34412) 2482 : cluster [DBG] pgmap v1398: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:03.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:35:02 gibba015 bash[29377]: cluster 2021-03-10T14:35:00.888506+0000 mgr.gibba045.orlgmj (mgr.34412) 2482 : cluster [DBG] pgmap v1398: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:03.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:35:02 gibba015 bash[30343]: cluster 2021-03-10T14:35:00.888506+0000 mgr.gibba045.orlgmj (mgr.34412) 2482 : cluster [DBG] pgmap v1398: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:05.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:35:04 gibba015 bash[29377]: cluster 2021-03-10T14:35:02.889896+0000 mgr.gibba045.orlgmj (mgr.34412) 2483 : cluster [DBG] pgmap v1399: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:05.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:35:04 gibba015 bash[30343]: cluster 2021-03-10T14:35:02.889896+0000 mgr.gibba045.orlgmj (mgr.34412) 2483 : cluster [DBG] pgmap v1399: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:05.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:35:04 gibba045 bash[25517]: cluster 2021-03-10T14:35:02.889896+0000 mgr.gibba045.orlgmj (mgr.34412) 2483 : cluster [DBG] pgmap v1399: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:06.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:35:05 gibba015 bash[29377]: cluster 2021-03-10T14:35:04.891151+0000 mgr.gibba045.orlgmj (mgr.34412) 2484 : cluster [DBG] pgmap v1400: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:06.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:35:05 gibba015 bash[30343]: cluster 2021-03-10T14:35:04.891151+0000 mgr.gibba045.orlgmj (mgr.34412) 2484 : cluster [DBG] pgmap v1400: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:06.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:35:05 gibba045 bash[25517]: cluster 2021-03-10T14:35:04.891151+0000 mgr.gibba045.orlgmj (mgr.34412) 2484 : cluster [DBG] pgmap v1400: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:08.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:35:08 gibba015 bash[29377]: cluster 2021-03-10T14:35:06.892056+0000 mgr.gibba045.orlgmj (mgr.34412) 2485 : cluster [DBG] pgmap v1401: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:08.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:35:08 gibba015 bash[30343]: cluster 2021-03-10T14:35:06.892056+0000 mgr.gibba045.orlgmj (mgr.34412) 2485 : cluster [DBG] pgmap v1401: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:08.978 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:35:08 gibba045 bash[25517]: cluster 2021-03-10T14:35:06.892056+0000 mgr.gibba045.orlgmj (mgr.34412) 2485 : cluster [DBG] pgmap v1401: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:10.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:35:10 gibba015 bash[29377]: cluster 2021-03-10T14:35:08.893033+0000 mgr.gibba045.orlgmj (mgr.34412) 2486 : cluster [DBG] pgmap v1402: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:10.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:35:10 gibba015 bash[29377]: cephadm 2021-03-10T14:35:08.979084+0000 mgr.gibba045.orlgmj (mgr.34412) 2487 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:35:10.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:35:10 gibba015 bash[30343]: cluster 2021-03-10T14:35:08.893033+0000 mgr.gibba045.orlgmj (mgr.34412) 2486 : cluster [DBG] pgmap v1402: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:10.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:35:10 gibba015 bash[30343]: cephadm 2021-03-10T14:35:08.979084+0000 mgr.gibba045.orlgmj (mgr.34412) 2487 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:35:11.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:35:10 gibba045 bash[25517]: cluster 2021-03-10T14:35:08.893033+0000 mgr.gibba045.orlgmj (mgr.34412) 2486 : cluster [DBG] pgmap v1402: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:11.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:35:10 gibba045 bash[25517]: cephadm 2021-03-10T14:35:08.979084+0000 mgr.gibba045.orlgmj (mgr.34412) 2487 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:35:12.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:35:12 gibba015 bash[29377]: cluster 2021-03-10T14:35:10.894763+0000 mgr.gibba045.orlgmj (mgr.34412) 2488 : cluster [DBG] pgmap v1403: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:12.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:35:12 gibba015 bash[30343]: cluster 2021-03-10T14:35:10.894763+0000 mgr.gibba045.orlgmj (mgr.34412) 2488 : cluster [DBG] pgmap v1403: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:13.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:35:12 gibba045 bash[25517]: cluster 2021-03-10T14:35:10.894763+0000 mgr.gibba045.orlgmj (mgr.34412) 2488 : cluster [DBG] pgmap v1403: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:13.360 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:35:13.591 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:35:13.591 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (45m) 83s ago 51m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:35:13.591 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (51m) 19s ago 51m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:35:13.591 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (46m) 19s ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:35:13.592 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (46m) 19s ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:35:13.592 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (45m) 83s ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:35:13.592 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (45m) 83s ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:35:13.592 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (45m) 19s ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:35:13.592 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (45m) 83s ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:35:13.593 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (51m) 83s ago 51m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:35:13.593 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (51m) 19s ago 51m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:35:13.593 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (44m) 83s ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:35:13.593 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (43m) 83s ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:35:13.594 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (43m) 83s ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:35:13.594 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (42m) 83s ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:35:13.594 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (42m) 19s ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:35:13.594 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (42m) 19s ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:35:13.595 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (41m) 19s ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:35:13.595 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (41m) 19s ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:35:13.595 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (50m) 19s ago 51m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:35:13.595 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 19s ago 49m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:35:13.839 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:35:13.839 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:35:13.839 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:35:13.840 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:35:13.840 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:35:13.840 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:35:13.840 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:35:13.841 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:35:13.841 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:35:13.841 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:35:13.841 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:35:13.842 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:35:13.842 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:35:13.842 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:35:13.842 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:35:14.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:35:14 gibba015 bash[29377]: cluster 2021-03-10T14:35:12.896506+0000 mgr.gibba045.orlgmj (mgr.34412) 2489 : cluster [DBG] pgmap v1404: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:14.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:35:14 gibba015 bash[29377]: audit 2021-03-10T14:35:13.351793+0000 mgr.gibba045.orlgmj (mgr.34412) 2490 : audit [DBG] from='client.55714 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:35:14.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:35:14 gibba015 bash[29377]: audit 2021-03-10T14:35:13.579315+0000 mgr.gibba045.orlgmj (mgr.34412) 2491 : audit [DBG] from='client.45732 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:35:14.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:35:14 gibba015 bash[29377]: audit 2021-03-10T14:35:13.836214+0000 mon.a (mon.0) 931 : audit [DBG] from='client.? 172.21.2.115:0/1665224495' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:35:14.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:35:14 gibba015 bash[30343]: cluster 2021-03-10T14:35:12.896506+0000 mgr.gibba045.orlgmj (mgr.34412) 2489 : cluster [DBG] pgmap v1404: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:14.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:35:14 gibba015 bash[30343]: audit 2021-03-10T14:35:13.351793+0000 mgr.gibba045.orlgmj (mgr.34412) 2490 : audit [DBG] from='client.55714 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:35:14.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:35:14 gibba015 bash[30343]: audit 2021-03-10T14:35:13.579315+0000 mgr.gibba045.orlgmj (mgr.34412) 2491 : audit [DBG] from='client.45732 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:35:14.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:35:14 gibba015 bash[30343]: audit 2021-03-10T14:35:13.836214+0000 mon.a (mon.0) 931 : audit [DBG] from='client.? 172.21.2.115:0/1665224495' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:35:15.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:35:14 gibba045 bash[25517]: cluster 2021-03-10T14:35:12.896506+0000 mgr.gibba045.orlgmj (mgr.34412) 2489 : cluster [DBG] pgmap v1404: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:15.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:35:14 gibba045 bash[25517]: audit 2021-03-10T14:35:13.351793+0000 mgr.gibba045.orlgmj (mgr.34412) 2490 : audit [DBG] from='client.55714 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:35:15.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:35:14 gibba045 bash[25517]: audit 2021-03-10T14:35:13.579315+0000 mgr.gibba045.orlgmj (mgr.34412) 2491 : audit [DBG] from='client.45732 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:35:15.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:35:14 gibba045 bash[25517]: audit 2021-03-10T14:35:13.836214+0000 mon.a (mon.0) 931 : audit [DBG] from='client.? 172.21.2.115:0/1665224495' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:35:17.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:35:16 gibba045 bash[25517]: cluster 2021-03-10T14:35:14.897016+0000 mgr.gibba045.orlgmj (mgr.34412) 2492 : cluster [DBG] pgmap v1405: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:17.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:35:16 gibba015 bash[29377]: cluster 2021-03-10T14:35:14.897016+0000 mgr.gibba045.orlgmj (mgr.34412) 2492 : cluster [DBG] pgmap v1405: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:17.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:35:16 gibba015 bash[30343]: cluster 2021-03-10T14:35:14.897016+0000 mgr.gibba045.orlgmj (mgr.34412) 2492 : cluster [DBG] pgmap v1405: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:19.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:35:18 gibba045 bash[25517]: cluster 2021-03-10T14:35:16.897737+0000 mgr.gibba045.orlgmj (mgr.34412) 2493 : cluster [DBG] pgmap v1406: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:19.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:35:18 gibba015 bash[29377]: cluster 2021-03-10T14:35:16.897737+0000 mgr.gibba045.orlgmj (mgr.34412) 2493 : cluster [DBG] pgmap v1406: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:19.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:35:18 gibba015 bash[30343]: cluster 2021-03-10T14:35:16.897737+0000 mgr.gibba045.orlgmj (mgr.34412) 2493 : cluster [DBG] pgmap v1406: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:21.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:35:20 gibba045 bash[25517]: cluster 2021-03-10T14:35:18.898743+0000 mgr.gibba045.orlgmj (mgr.34412) 2494 : cluster [DBG] pgmap v1407: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:21.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:35:20 gibba015 bash[29377]: cluster 2021-03-10T14:35:18.898743+0000 mgr.gibba045.orlgmj (mgr.34412) 2494 : cluster [DBG] pgmap v1407: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:21.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:35:20 gibba015 bash[30343]: cluster 2021-03-10T14:35:18.898743+0000 mgr.gibba045.orlgmj (mgr.34412) 2494 : cluster [DBG] pgmap v1407: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:23.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:35:22 gibba045 bash[25517]: cluster 2021-03-10T14:35:20.900653+0000 mgr.gibba045.orlgmj (mgr.34412) 2495 : cluster [DBG] pgmap v1408: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:23.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:35:22 gibba015 bash[29377]: cluster 2021-03-10T14:35:20.900653+0000 mgr.gibba045.orlgmj (mgr.34412) 2495 : cluster [DBG] pgmap v1408: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:23.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:35:22 gibba015 bash[30343]: cluster 2021-03-10T14:35:20.900653+0000 mgr.gibba045.orlgmj (mgr.34412) 2495 : cluster [DBG] pgmap v1408: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:25.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:35:24 gibba045 bash[25517]: cluster 2021-03-10T14:35:22.902097+0000 mgr.gibba045.orlgmj (mgr.34412) 2496 : cluster [DBG] pgmap v1409: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:25.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:35:24 gibba015 bash[29377]: cluster 2021-03-10T14:35:22.902097+0000 mgr.gibba045.orlgmj (mgr.34412) 2496 : cluster [DBG] pgmap v1409: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:25.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:35:24 gibba015 bash[30343]: cluster 2021-03-10T14:35:22.902097+0000 mgr.gibba045.orlgmj (mgr.34412) 2496 : cluster [DBG] pgmap v1409: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:26.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:35:25 gibba045 bash[25517]: cephadm 2021-03-10T14:35:23.993370+0000 mgr.gibba045.orlgmj (mgr.34412) 2497 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:35:26.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:35:25 gibba015 bash[29377]: cephadm 2021-03-10T14:35:23.993370+0000 mgr.gibba045.orlgmj (mgr.34412) 2497 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:35:26.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:35:25 gibba015 bash[30343]: cephadm 2021-03-10T14:35:23.993370+0000 mgr.gibba045.orlgmj (mgr.34412) 2497 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:35:27.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:35:26 gibba045 bash[25517]: cluster 2021-03-10T14:35:24.903634+0000 mgr.gibba045.orlgmj (mgr.34412) 2498 : cluster [DBG] pgmap v1410: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:27.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:35:26 gibba015 bash[29377]: cluster 2021-03-10T14:35:24.903634+0000 mgr.gibba045.orlgmj (mgr.34412) 2498 : cluster [DBG] pgmap v1410: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:27.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:35:26 gibba015 bash[30343]: cluster 2021-03-10T14:35:24.903634+0000 mgr.gibba045.orlgmj (mgr.34412) 2498 : cluster [DBG] pgmap v1410: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:29.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:35:28 gibba045 bash[25517]: cluster 2021-03-10T14:35:26.905314+0000 mgr.gibba045.orlgmj (mgr.34412) 2499 : cluster [DBG] pgmap v1411: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:29.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:35:28 gibba015 bash[29377]: cluster 2021-03-10T14:35:26.905314+0000 mgr.gibba045.orlgmj (mgr.34412) 2499 : cluster [DBG] pgmap v1411: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:29.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:35:28 gibba015 bash[30343]: cluster 2021-03-10T14:35:26.905314+0000 mgr.gibba045.orlgmj (mgr.34412) 2499 : cluster [DBG] pgmap v1411: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:31.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:35:30 gibba045 bash[25517]: cluster 2021-03-10T14:35:28.906485+0000 mgr.gibba045.orlgmj (mgr.34412) 2500 : cluster [DBG] pgmap v1412: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:31.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:35:30 gibba015 bash[29377]: cluster 2021-03-10T14:35:28.906485+0000 mgr.gibba045.orlgmj (mgr.34412) 2500 : cluster [DBG] pgmap v1412: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:31.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:35:30 gibba015 bash[30343]: cluster 2021-03-10T14:35:28.906485+0000 mgr.gibba045.orlgmj (mgr.34412) 2500 : cluster [DBG] pgmap v1412: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:33.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:35:32 gibba015 bash[29377]: cluster 2021-03-10T14:35:30.907973+0000 mgr.gibba045.orlgmj (mgr.34412) 2501 : cluster [DBG] pgmap v1413: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:33.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:35:32 gibba015 bash[30343]: cluster 2021-03-10T14:35:30.907973+0000 mgr.gibba045.orlgmj (mgr.34412) 2501 : cluster [DBG] pgmap v1413: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:33.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:35:32 gibba045 bash[25517]: cluster 2021-03-10T14:35:30.907973+0000 mgr.gibba045.orlgmj (mgr.34412) 2501 : cluster [DBG] pgmap v1413: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:35.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:35:34 gibba015 bash[29377]: cluster 2021-03-10T14:35:32.909302+0000 mgr.gibba045.orlgmj (mgr.34412) 2502 : cluster [DBG] pgmap v1414: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:35.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:35:34 gibba015 bash[30343]: cluster 2021-03-10T14:35:32.909302+0000 mgr.gibba045.orlgmj (mgr.34412) 2502 : cluster [DBG] pgmap v1414: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:35.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:35:34 gibba045 bash[25517]: cluster 2021-03-10T14:35:32.909302+0000 mgr.gibba045.orlgmj (mgr.34412) 2502 : cluster [DBG] pgmap v1414: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:37.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:35:36 gibba015 bash[29377]: cluster 2021-03-10T14:35:34.910653+0000 mgr.gibba045.orlgmj (mgr.34412) 2503 : cluster [DBG] pgmap v1415: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:37.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:35:36 gibba015 bash[30343]: cluster 2021-03-10T14:35:34.910653+0000 mgr.gibba045.orlgmj (mgr.34412) 2503 : cluster [DBG] pgmap v1415: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:37.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:35:36 gibba045 bash[25517]: cluster 2021-03-10T14:35:34.910653+0000 mgr.gibba045.orlgmj (mgr.34412) 2503 : cluster [DBG] pgmap v1415: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:38.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:35:38 gibba015 bash[29377]: cluster 2021-03-10T14:35:36.912148+0000 mgr.gibba045.orlgmj (mgr.34412) 2504 : cluster [DBG] pgmap v1416: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:38.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:35:38 gibba015 bash[30343]: cluster 2021-03-10T14:35:36.912148+0000 mgr.gibba045.orlgmj (mgr.34412) 2504 : cluster [DBG] pgmap v1416: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:39.008 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:35:38 gibba045 bash[25517]: cluster 2021-03-10T14:35:36.912148+0000 mgr.gibba045.orlgmj (mgr.34412) 2504 : cluster [DBG] pgmap v1416: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:40.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:35:40 gibba015 bash[29377]: cluster 2021-03-10T14:35:38.913329+0000 mgr.gibba045.orlgmj (mgr.34412) 2505 : cluster [DBG] pgmap v1417: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:40.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:35:40 gibba015 bash[29377]: cephadm 2021-03-10T14:35:39.009226+0000 mgr.gibba045.orlgmj (mgr.34412) 2506 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:35:40.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:35:40 gibba015 bash[30343]: cluster 2021-03-10T14:35:38.913329+0000 mgr.gibba045.orlgmj (mgr.34412) 2505 : cluster [DBG] pgmap v1417: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:40.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:35:40 gibba015 bash[30343]: cephadm 2021-03-10T14:35:39.009226+0000 mgr.gibba045.orlgmj (mgr.34412) 2506 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:35:41.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:35:40 gibba045 bash[25517]: cluster 2021-03-10T14:35:38.913329+0000 mgr.gibba045.orlgmj (mgr.34412) 2505 : cluster [DBG] pgmap v1417: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:41.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:35:40 gibba045 bash[25517]: cephadm 2021-03-10T14:35:39.009226+0000 mgr.gibba045.orlgmj (mgr.34412) 2506 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:35:43.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:35:42 gibba045 bash[25517]: cluster 2021-03-10T14:35:40.915186+0000 mgr.gibba045.orlgmj (mgr.34412) 2507 : cluster [DBG] pgmap v1418: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:43.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:35:42 gibba015 bash[29377]: cluster 2021-03-10T14:35:40.915186+0000 mgr.gibba045.orlgmj (mgr.34412) 2507 : cluster [DBG] pgmap v1418: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:43.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:35:42 gibba015 bash[30343]: cluster 2021-03-10T14:35:40.915186+0000 mgr.gibba045.orlgmj (mgr.34412) 2507 : cluster [DBG] pgmap v1418: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:44.080 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:35:44.310 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:35:44.311 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (46m) 114s ago 51m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:35:44.311 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (51m) 50s ago 51m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:35:44.311 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (46m) 50s ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:35:44.312 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (47m) 50s ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:35:44.312 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (46m) 114s ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:35:44.312 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (45m) 114s ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:35:44.312 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (45m) 50s ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:35:44.312 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (45m) 114s ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:35:44.313 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (51m) 114s ago 52m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:35:44.313 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (51m) 50s ago 52m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:35:44.313 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (44m) 114s ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:35:44.313 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (44m) 114s ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:35:44.314 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (43m) 114s ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:35:44.314 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (43m) 114s ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:35:44.314 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (43m) 50s ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:35:44.314 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (42m) 50s ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:35:44.315 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (42m) 50s ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:35:44.315 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (41m) 50s ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:35:44.315 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (51m) 50s ago 52m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:35:44.315 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 50s ago 49m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:35:44.559 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:35:44.559 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:35:44.560 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:35:44.560 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:35:44.560 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:35:44.560 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:35:44.561 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:35:44.561 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:35:44.561 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:35:44.561 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:35:44.561 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:35:44.562 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:35:44.562 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:35:44.562 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:35:44.562 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:35:45.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:35:44 gibba045 bash[25517]: cluster 2021-03-10T14:35:42.916896+0000 mgr.gibba045.orlgmj (mgr.34412) 2508 : cluster [DBG] pgmap v1419: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:45.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:35:44 gibba045 bash[25517]: audit 2021-03-10T14:35:44.556240+0000 mon.c (mon.1) 742 : audit [DBG] from='client.? 172.21.2.115:0/4690051' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:35:45.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:35:44 gibba015 bash[29377]: cluster 2021-03-10T14:35:42.916896+0000 mgr.gibba045.orlgmj (mgr.34412) 2508 : cluster [DBG] pgmap v1419: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:45.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:35:44 gibba015 bash[29377]: audit 2021-03-10T14:35:44.556240+0000 mon.c (mon.1) 742 : audit [DBG] from='client.? 172.21.2.115:0/4690051' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:35:45.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:35:44 gibba015 bash[30343]: cluster 2021-03-10T14:35:42.916896+0000 mgr.gibba045.orlgmj (mgr.34412) 2508 : cluster [DBG] pgmap v1419: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:45.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:35:44 gibba015 bash[30343]: audit 2021-03-10T14:35:44.556240+0000 mon.c (mon.1) 742 : audit [DBG] from='client.? 172.21.2.115:0/4690051' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:35:46.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:35:45 gibba045 bash[25517]: audit 2021-03-10T14:35:44.072356+0000 mgr.gibba045.orlgmj (mgr.34412) 2509 : audit [DBG] from='client.45744 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:35:46.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:35:45 gibba045 bash[25517]: audit 2021-03-10T14:35:44.298426+0000 mgr.gibba045.orlgmj (mgr.34412) 2510 : audit [DBG] from='client.55738 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:35:46.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:35:45 gibba015 bash[29377]: audit 2021-03-10T14:35:44.072356+0000 mgr.gibba045.orlgmj (mgr.34412) 2509 : audit [DBG] from='client.45744 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:35:46.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:35:45 gibba015 bash[29377]: audit 2021-03-10T14:35:44.298426+0000 mgr.gibba045.orlgmj (mgr.34412) 2510 : audit [DBG] from='client.55738 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:35:46.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:35:45 gibba015 bash[30343]: audit 2021-03-10T14:35:44.072356+0000 mgr.gibba045.orlgmj (mgr.34412) 2509 : audit [DBG] from='client.45744 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:35:46.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:35:45 gibba015 bash[30343]: audit 2021-03-10T14:35:44.298426+0000 mgr.gibba045.orlgmj (mgr.34412) 2510 : audit [DBG] from='client.55738 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:35:47.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:35:46 gibba045 bash[25517]: cluster 2021-03-10T14:35:44.918360+0000 mgr.gibba045.orlgmj (mgr.34412) 2511 : cluster [DBG] pgmap v1420: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:47.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:35:46 gibba015 bash[29377]: cluster 2021-03-10T14:35:44.918360+0000 mgr.gibba045.orlgmj (mgr.34412) 2511 : cluster [DBG] pgmap v1420: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:47.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:35:46 gibba015 bash[30343]: cluster 2021-03-10T14:35:44.918360+0000 mgr.gibba045.orlgmj (mgr.34412) 2511 : cluster [DBG] pgmap v1420: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:49.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:35:48 gibba045 bash[25517]: cluster 2021-03-10T14:35:46.919323+0000 mgr.gibba045.orlgmj (mgr.34412) 2512 : cluster [DBG] pgmap v1421: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:49.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:35:48 gibba015 bash[29377]: cluster 2021-03-10T14:35:46.919323+0000 mgr.gibba045.orlgmj (mgr.34412) 2512 : cluster [DBG] pgmap v1421: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:49.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:35:48 gibba015 bash[30343]: cluster 2021-03-10T14:35:46.919323+0000 mgr.gibba045.orlgmj (mgr.34412) 2512 : cluster [DBG] pgmap v1421: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:51.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:35:50 gibba045 bash[25517]: cluster 2021-03-10T14:35:48.920379+0000 mgr.gibba045.orlgmj (mgr.34412) 2513 : cluster [DBG] pgmap v1422: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:51.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:35:50 gibba015 bash[29377]: cluster 2021-03-10T14:35:48.920379+0000 mgr.gibba045.orlgmj (mgr.34412) 2513 : cluster [DBG] pgmap v1422: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:51.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:35:50 gibba015 bash[30343]: cluster 2021-03-10T14:35:48.920379+0000 mgr.gibba045.orlgmj (mgr.34412) 2513 : cluster [DBG] pgmap v1422: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:53.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:35:52 gibba045 bash[25517]: cluster 2021-03-10T14:35:50.921932+0000 mgr.gibba045.orlgmj (mgr.34412) 2514 : cluster [DBG] pgmap v1423: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:53.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:35:52 gibba045 bash[25517]: audit 2021-03-10T14:35:52.762587+0000 mon.c (mon.1) 743 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:35:53.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:35:52 gibba045 bash[25517]: audit 2021-03-10T14:35:52.763148+0000 mon.a (mon.0) 932 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:35:53.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:35:52 gibba045 bash[25517]: audit 2021-03-10T14:35:52.764548+0000 mon.c (mon.1) 744 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:35:53.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:35:52 gibba045 bash[25517]: audit 2021-03-10T14:35:52.765015+0000 mon.a (mon.0) 933 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:35:53.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:35:52 gibba015 bash[29377]: cluster 2021-03-10T14:35:50.921932+0000 mgr.gibba045.orlgmj (mgr.34412) 2514 : cluster [DBG] pgmap v1423: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:53.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:35:52 gibba015 bash[29377]: audit 2021-03-10T14:35:52.762587+0000 mon.c (mon.1) 743 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:35:53.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:35:52 gibba015 bash[29377]: audit 2021-03-10T14:35:52.763148+0000 mon.a (mon.0) 932 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:35:53.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:35:52 gibba015 bash[29377]: audit 2021-03-10T14:35:52.764548+0000 mon.c (mon.1) 744 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:35:53.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:35:52 gibba015 bash[29377]: audit 2021-03-10T14:35:52.765015+0000 mon.a (mon.0) 933 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:35:53.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:35:52 gibba015 bash[30343]: cluster 2021-03-10T14:35:50.921932+0000 mgr.gibba045.orlgmj (mgr.34412) 2514 : cluster [DBG] pgmap v1423: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:53.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:35:52 gibba015 bash[30343]: audit 2021-03-10T14:35:52.762587+0000 mon.c (mon.1) 743 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:35:53.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:35:52 gibba015 bash[30343]: audit 2021-03-10T14:35:52.763148+0000 mon.a (mon.0) 932 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:35:53.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:35:52 gibba015 bash[30343]: audit 2021-03-10T14:35:52.764548+0000 mon.c (mon.1) 744 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:35:53.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:35:52 gibba015 bash[30343]: audit 2021-03-10T14:35:52.765015+0000 mon.a (mon.0) 933 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:35:54.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:35:53 gibba045 bash[25517]: audit 2021-03-10T14:35:52.765942+0000 mon.c (mon.1) 745 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T14:35:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:35:53 gibba045 bash[25517]: audit 2021-03-10T14:35:52.766354+0000 mon.c (mon.1) 746 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:35:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:35:53 gibba045 bash[25517]: audit 2021-03-10T14:35:52.766534+0000 mon.a (mon.0) 934 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T14:35:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:35:53 gibba045 bash[25517]: audit 2021-03-10T14:35:52.767202+0000 mon.a (mon.0) 935 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:35:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:35:53 gibba045 bash[25517]: audit 2021-03-10T14:35:52.767261+0000 mon.c (mon.1) 747 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:35:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:35:53 gibba045 bash[25517]: audit 2021-03-10T14:35:52.767471+0000 mon.c (mon.1) 748 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:35:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:35:53 gibba045 bash[25517]: audit 2021-03-10T14:35:52.772993+0000 mon.a (mon.0) 936 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:35:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:35:53 gibba045 bash[25517]: audit 2021-03-10T14:35:52.773916+0000 mon.a (mon.0) 937 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:35:54.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:35:53 gibba015 bash[29377]: audit 2021-03-10T14:35:52.765942+0000 mon.c (mon.1) 745 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T14:35:54.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:35:53 gibba015 bash[29377]: audit 2021-03-10T14:35:52.766354+0000 mon.c (mon.1) 746 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:35:54.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:35:53 gibba015 bash[29377]: audit 2021-03-10T14:35:52.766534+0000 mon.a (mon.0) 934 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T14:35:54.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:35:53 gibba015 bash[29377]: audit 2021-03-10T14:35:52.767202+0000 mon.a (mon.0) 935 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:35:54.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:35:53 gibba015 bash[29377]: audit 2021-03-10T14:35:52.767261+0000 mon.c (mon.1) 747 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:35:54.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:35:53 gibba015 bash[29377]: audit 2021-03-10T14:35:52.767471+0000 mon.c (mon.1) 748 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:35:54.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:35:53 gibba015 bash[29377]: audit 2021-03-10T14:35:52.772993+0000 mon.a (mon.0) 936 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:35:54.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:35:53 gibba015 bash[29377]: audit 2021-03-10T14:35:52.773916+0000 mon.a (mon.0) 937 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:35:54.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:35:53 gibba015 bash[30343]: audit 2021-03-10T14:35:52.765942+0000 mon.c (mon.1) 745 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T14:35:54.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:35:53 gibba015 bash[30343]: audit 2021-03-10T14:35:52.766354+0000 mon.c (mon.1) 746 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:35:54.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:35:53 gibba015 bash[30343]: audit 2021-03-10T14:35:52.766534+0000 mon.a (mon.0) 934 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T14:35:54.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:35:53 gibba015 bash[30343]: audit 2021-03-10T14:35:52.767202+0000 mon.a (mon.0) 935 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:35:54.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:35:53 gibba015 bash[30343]: audit 2021-03-10T14:35:52.767261+0000 mon.c (mon.1) 747 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:35:54.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:35:53 gibba015 bash[30343]: audit 2021-03-10T14:35:52.767471+0000 mon.c (mon.1) 748 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:35:54.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:35:53 gibba015 bash[30343]: audit 2021-03-10T14:35:52.772993+0000 mon.a (mon.0) 936 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:35:54.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:35:53 gibba015 bash[30343]: audit 2021-03-10T14:35:52.773916+0000 mon.a (mon.0) 937 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:35:55.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:35:54 gibba045 bash[25517]: cluster 2021-03-10T14:35:52.923563+0000 mgr.gibba045.orlgmj (mgr.34412) 2515 : cluster [DBG] pgmap v1424: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:55.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:35:54 gibba045 bash[25517]: audit 2021-03-10T14:35:54.010222+0000 mon.c (mon.1) 749 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:35:55.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:35:54 gibba045 bash[25517]: audit 2021-03-10T14:35:54.258648+0000 mon.a (mon.0) 938 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:35:55.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:35:54 gibba045 bash[25517]: audit 2021-03-10T14:35:54.262345+0000 mon.c (mon.1) 750 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:35:55.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:35:54 gibba045 bash[25517]: audit 2021-03-10T14:35:54.263701+0000 mon.c (mon.1) 751 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:35:55.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:35:54 gibba045 bash[25517]: audit 2021-03-10T14:35:54.265232+0000 mon.c (mon.1) 752 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:35:55.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:35:54 gibba045 bash[25517]: audit 2021-03-10T14:35:54.266653+0000 mon.c (mon.1) 753 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:35:55.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:35:54 gibba045 bash[25517]: audit 2021-03-10T14:35:54.269593+0000 mon.c (mon.1) 754 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:35:55.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:35:54 gibba045 bash[25517]: audit 2021-03-10T14:35:54.270982+0000 mon.c (mon.1) 755 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:35:55.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:35:54 gibba015 bash[29377]: cluster 2021-03-10T14:35:52.923563+0000 mgr.gibba045.orlgmj (mgr.34412) 2515 : cluster [DBG] pgmap v1424: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:55.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:35:54 gibba015 bash[29377]: audit 2021-03-10T14:35:54.010222+0000 mon.c (mon.1) 749 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:35:55.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:35:54 gibba015 bash[29377]: audit 2021-03-10T14:35:54.258648+0000 mon.a (mon.0) 938 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:35:55.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:35:54 gibba015 bash[29377]: audit 2021-03-10T14:35:54.262345+0000 mon.c (mon.1) 750 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:35:55.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:35:54 gibba015 bash[29377]: audit 2021-03-10T14:35:54.263701+0000 mon.c (mon.1) 751 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:35:55.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:35:54 gibba015 bash[29377]: audit 2021-03-10T14:35:54.265232+0000 mon.c (mon.1) 752 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:35:55.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:35:54 gibba015 bash[29377]: audit 2021-03-10T14:35:54.266653+0000 mon.c (mon.1) 753 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:35:55.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:35:54 gibba015 bash[29377]: audit 2021-03-10T14:35:54.269593+0000 mon.c (mon.1) 754 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:35:55.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:35:54 gibba015 bash[29377]: audit 2021-03-10T14:35:54.270982+0000 mon.c (mon.1) 755 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:35:55.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:35:54 gibba015 bash[30343]: cluster 2021-03-10T14:35:52.923563+0000 mgr.gibba045.orlgmj (mgr.34412) 2515 : cluster [DBG] pgmap v1424: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:55.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:35:54 gibba015 bash[30343]: audit 2021-03-10T14:35:54.010222+0000 mon.c (mon.1) 749 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:35:55.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:35:54 gibba015 bash[30343]: audit 2021-03-10T14:35:54.258648+0000 mon.a (mon.0) 938 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:35:55.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:35:54 gibba015 bash[30343]: audit 2021-03-10T14:35:54.262345+0000 mon.c (mon.1) 750 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:35:55.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:35:54 gibba015 bash[30343]: audit 2021-03-10T14:35:54.263701+0000 mon.c (mon.1) 751 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:35:55.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:35:54 gibba015 bash[30343]: audit 2021-03-10T14:35:54.265232+0000 mon.c (mon.1) 752 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:35:55.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:35:54 gibba015 bash[30343]: audit 2021-03-10T14:35:54.266653+0000 mon.c (mon.1) 753 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:35:55.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:35:54 gibba015 bash[30343]: audit 2021-03-10T14:35:54.269593+0000 mon.c (mon.1) 754 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:35:55.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:35:54 gibba015 bash[30343]: audit 2021-03-10T14:35:54.270982+0000 mon.c (mon.1) 755 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:35:56.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:35:55 gibba045 bash[25517]: cephadm 2021-03-10T14:35:54.018676+0000 mgr.gibba045.orlgmj (mgr.34412) 2516 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:35:56.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:35:55 gibba045 bash[25517]: cephadm 2021-03-10T14:35:54.020395+0000 mgr.gibba045.orlgmj (mgr.34412) 2517 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:35:56.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:35:55 gibba045 bash[25517]: cephadm 2021-03-10T14:35:54.265487+0000 mgr.gibba045.orlgmj (mgr.34412) 2518 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:35:56.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:35:55 gibba045 bash[25517]: cephadm 2021-03-10T14:35:54.267233+0000 mgr.gibba045.orlgmj (mgr.34412) 2519 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:35:56.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:35:55 gibba045 bash[25517]: cephadm 2021-03-10T14:35:54.268472+0000 mgr.gibba045.orlgmj (mgr.34412) 2520 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:35:56.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:35:55 gibba045 bash[25517]: cephadm 2021-03-10T14:35:54.268559+0000 mgr.gibba045.orlgmj (mgr.34412) 2521 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:35:56.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:35:55 gibba045 bash[25517]: cephadm 2021-03-10T14:35:54.270050+0000 mgr.gibba045.orlgmj (mgr.34412) 2522 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:35:56.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:35:55 gibba045 bash[25517]: cephadm 2021-03-10T14:35:54.270089+0000 mgr.gibba045.orlgmj (mgr.34412) 2523 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:35:56.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:35:55 gibba045 bash[25517]: cephadm 2021-03-10T14:35:54.271342+0000 mgr.gibba045.orlgmj (mgr.34412) 2524 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:35:56.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:35:55 gibba045 bash[25517]: cephadm 2021-03-10T14:35:54.272861+0000 mgr.gibba045.orlgmj (mgr.34412) 2525 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:35:56.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:35:55 gibba045 bash[25517]: cephadm 2021-03-10T14:35:54.272897+0000 mgr.gibba045.orlgmj (mgr.34412) 2526 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:35:56.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:35:55 gibba045 bash[25517]: cephadm 2021-03-10T14:35:54.274114+0000 mgr.gibba045.orlgmj (mgr.34412) 2527 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:35:56.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:35:55 gibba045 bash[25517]: cephadm 2021-03-10T14:35:54.274434+0000 mgr.gibba045.orlgmj (mgr.34412) 2528 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:35:56.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:35:55 gibba045 bash[25517]: cephadm 2021-03-10T14:35:54.275606+0000 mgr.gibba045.orlgmj (mgr.34412) 2529 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:35:56.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:35:55 gibba045 bash[25517]: cephadm 2021-03-10T14:35:54.275645+0000 mgr.gibba045.orlgmj (mgr.34412) 2530 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:35:56.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:35:55 gibba045 bash[25517]: cephadm 2021-03-10T14:35:54.275753+0000 mgr.gibba045.orlgmj (mgr.34412) 2531 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:35:56.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:35:55 gibba015 bash[29377]: cephadm 2021-03-10T14:35:54.018676+0000 mgr.gibba045.orlgmj (mgr.34412) 2516 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:35:56.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:35:55 gibba015 bash[29377]: cephadm 2021-03-10T14:35:54.020395+0000 mgr.gibba045.orlgmj (mgr.34412) 2517 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:35:56.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:35:55 gibba015 bash[29377]: cephadm 2021-03-10T14:35:54.265487+0000 mgr.gibba045.orlgmj (mgr.34412) 2518 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:35:56.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:35:55 gibba015 bash[29377]: cephadm 2021-03-10T14:35:54.267233+0000 mgr.gibba045.orlgmj (mgr.34412) 2519 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:35:56.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:35:55 gibba015 bash[29377]: cephadm 2021-03-10T14:35:54.268472+0000 mgr.gibba045.orlgmj (mgr.34412) 2520 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:35:56.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:35:55 gibba015 bash[29377]: cephadm 2021-03-10T14:35:54.268559+0000 mgr.gibba045.orlgmj (mgr.34412) 2521 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:35:56.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:35:55 gibba015 bash[29377]: cephadm 2021-03-10T14:35:54.270050+0000 mgr.gibba045.orlgmj (mgr.34412) 2522 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:35:56.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:35:55 gibba015 bash[29377]: cephadm 2021-03-10T14:35:54.270089+0000 mgr.gibba045.orlgmj (mgr.34412) 2523 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:35:56.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:35:55 gibba015 bash[29377]: cephadm 2021-03-10T14:35:54.271342+0000 mgr.gibba045.orlgmj (mgr.34412) 2524 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:35:56.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:35:55 gibba015 bash[29377]: cephadm 2021-03-10T14:35:54.272861+0000 mgr.gibba045.orlgmj (mgr.34412) 2525 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:35:56.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:35:55 gibba015 bash[29377]: cephadm 2021-03-10T14:35:54.272897+0000 mgr.gibba045.orlgmj (mgr.34412) 2526 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:35:56.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:35:55 gibba015 bash[29377]: cephadm 2021-03-10T14:35:54.274114+0000 mgr.gibba045.orlgmj (mgr.34412) 2527 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:35:56.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:35:55 gibba015 bash[29377]: cephadm 2021-03-10T14:35:54.274434+0000 mgr.gibba045.orlgmj (mgr.34412) 2528 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:35:56.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:35:55 gibba015 bash[29377]: cephadm 2021-03-10T14:35:54.275606+0000 mgr.gibba045.orlgmj (mgr.34412) 2529 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:35:56.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:35:55 gibba015 bash[29377]: cephadm 2021-03-10T14:35:54.275645+0000 mgr.gibba045.orlgmj (mgr.34412) 2530 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:35:56.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:35:55 gibba015 bash[29377]: cephadm 2021-03-10T14:35:54.275753+0000 mgr.gibba045.orlgmj (mgr.34412) 2531 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:35:56.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:35:55 gibba015 bash[30343]: cephadm 2021-03-10T14:35:54.018676+0000 mgr.gibba045.orlgmj (mgr.34412) 2516 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:35:56.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:35:55 gibba015 bash[30343]: cephadm 2021-03-10T14:35:54.020395+0000 mgr.gibba045.orlgmj (mgr.34412) 2517 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:35:56.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:35:55 gibba015 bash[30343]: cephadm 2021-03-10T14:35:54.265487+0000 mgr.gibba045.orlgmj (mgr.34412) 2518 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:35:56.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:35:55 gibba015 bash[30343]: cephadm 2021-03-10T14:35:54.267233+0000 mgr.gibba045.orlgmj (mgr.34412) 2519 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:35:56.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:35:55 gibba015 bash[30343]: cephadm 2021-03-10T14:35:54.268472+0000 mgr.gibba045.orlgmj (mgr.34412) 2520 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:35:56.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:35:55 gibba015 bash[30343]: cephadm 2021-03-10T14:35:54.268559+0000 mgr.gibba045.orlgmj (mgr.34412) 2521 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:35:56.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:35:55 gibba015 bash[30343]: cephadm 2021-03-10T14:35:54.270050+0000 mgr.gibba045.orlgmj (mgr.34412) 2522 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:35:56.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:35:55 gibba015 bash[30343]: cephadm 2021-03-10T14:35:54.270089+0000 mgr.gibba045.orlgmj (mgr.34412) 2523 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:35:56.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:35:55 gibba015 bash[30343]: cephadm 2021-03-10T14:35:54.271342+0000 mgr.gibba045.orlgmj (mgr.34412) 2524 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:35:56.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:35:55 gibba015 bash[30343]: cephadm 2021-03-10T14:35:54.272861+0000 mgr.gibba045.orlgmj (mgr.34412) 2525 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:35:56.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:35:55 gibba015 bash[30343]: cephadm 2021-03-10T14:35:54.272897+0000 mgr.gibba045.orlgmj (mgr.34412) 2526 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:35:56.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:35:55 gibba015 bash[30343]: cephadm 2021-03-10T14:35:54.274114+0000 mgr.gibba045.orlgmj (mgr.34412) 2527 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:35:56.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:35:55 gibba015 bash[30343]: cephadm 2021-03-10T14:35:54.274434+0000 mgr.gibba045.orlgmj (mgr.34412) 2528 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:35:56.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:35:55 gibba015 bash[30343]: cephadm 2021-03-10T14:35:54.275606+0000 mgr.gibba045.orlgmj (mgr.34412) 2529 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:35:56.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:35:55 gibba015 bash[30343]: cephadm 2021-03-10T14:35:54.275645+0000 mgr.gibba045.orlgmj (mgr.34412) 2530 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:35:56.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:35:55 gibba015 bash[30343]: cephadm 2021-03-10T14:35:54.275753+0000 mgr.gibba045.orlgmj (mgr.34412) 2531 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:35:57.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:35:56 gibba015 bash[29377]: cluster 2021-03-10T14:35:54.925225+0000 mgr.gibba045.orlgmj (mgr.34412) 2532 : cluster [DBG] pgmap v1425: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:57.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:35:56 gibba015 bash[30343]: cluster 2021-03-10T14:35:54.925225+0000 mgr.gibba045.orlgmj (mgr.34412) 2532 : cluster [DBG] pgmap v1425: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:57.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:35:56 gibba045 bash[25517]: cluster 2021-03-10T14:35:54.925225+0000 mgr.gibba045.orlgmj (mgr.34412) 2532 : cluster [DBG] pgmap v1425: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:59.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:35:58 gibba015 bash[29377]: cluster 2021-03-10T14:35:56.926615+0000 mgr.gibba045.orlgmj (mgr.34412) 2533 : cluster [DBG] pgmap v1426: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:59.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:35:58 gibba015 bash[30343]: cluster 2021-03-10T14:35:56.926615+0000 mgr.gibba045.orlgmj (mgr.34412) 2533 : cluster [DBG] pgmap v1426: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:59.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:35:58 gibba045 bash[25517]: cluster 2021-03-10T14:35:56.926615+0000 mgr.gibba045.orlgmj (mgr.34412) 2533 : cluster [DBG] pgmap v1426: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:01.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:36:00 gibba015 bash[29377]: cluster 2021-03-10T14:35:58.927879+0000 mgr.gibba045.orlgmj (mgr.34412) 2534 : cluster [DBG] pgmap v1427: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:01.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:36:00 gibba015 bash[30343]: cluster 2021-03-10T14:35:58.927879+0000 mgr.gibba045.orlgmj (mgr.34412) 2534 : cluster [DBG] pgmap v1427: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:01.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:36:00 gibba045 bash[25517]: cluster 2021-03-10T14:35:58.927879+0000 mgr.gibba045.orlgmj (mgr.34412) 2534 : cluster [DBG] pgmap v1427: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:03.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:36:02 gibba015 bash[29377]: cluster 2021-03-10T14:36:00.929598+0000 mgr.gibba045.orlgmj (mgr.34412) 2535 : cluster [DBG] pgmap v1428: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:03.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:36:02 gibba015 bash[30343]: cluster 2021-03-10T14:36:00.929598+0000 mgr.gibba045.orlgmj (mgr.34412) 2535 : cluster [DBG] pgmap v1428: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:03.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:36:02 gibba045 bash[25517]: cluster 2021-03-10T14:36:00.929598+0000 mgr.gibba045.orlgmj (mgr.34412) 2535 : cluster [DBG] pgmap v1428: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:04.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:36:03 gibba015 bash[29377]: cluster 2021-03-10T14:36:02.931276+0000 mgr.gibba045.orlgmj (mgr.34412) 2536 : cluster [DBG] pgmap v1429: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:04.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:36:03 gibba015 bash[30343]: cluster 2021-03-10T14:36:02.931276+0000 mgr.gibba045.orlgmj (mgr.34412) 2536 : cluster [DBG] pgmap v1429: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:04.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:36:03 gibba045 bash[25517]: cluster 2021-03-10T14:36:02.931276+0000 mgr.gibba045.orlgmj (mgr.34412) 2536 : cluster [DBG] pgmap v1429: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:06.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:36:05 gibba045 bash[25517]: cluster 2021-03-10T14:36:04.932994+0000 mgr.gibba045.orlgmj (mgr.34412) 2537 : cluster [DBG] pgmap v1430: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:06.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:36:05 gibba015 bash[29377]: cluster 2021-03-10T14:36:04.932994+0000 mgr.gibba045.orlgmj (mgr.34412) 2537 : cluster [DBG] pgmap v1430: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:06.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:36:05 gibba015 bash[30343]: cluster 2021-03-10T14:36:04.932994+0000 mgr.gibba045.orlgmj (mgr.34412) 2537 : cluster [DBG] pgmap v1430: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:08.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:36:08 gibba015 bash[29377]: cluster 2021-03-10T14:36:06.934746+0000 mgr.gibba045.orlgmj (mgr.34412) 2538 : cluster [DBG] pgmap v1431: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:08.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:36:08 gibba015 bash[30343]: cluster 2021-03-10T14:36:06.934746+0000 mgr.gibba045.orlgmj (mgr.34412) 2538 : cluster [DBG] pgmap v1431: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:09.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:36:08 gibba045 bash[25517]: cluster 2021-03-10T14:36:06.934746+0000 mgr.gibba045.orlgmj (mgr.34412) 2538 : cluster [DBG] pgmap v1431: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:11.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:36:10 gibba045 bash[25517]: cluster 2021-03-10T14:36:08.935966+0000 mgr.gibba045.orlgmj (mgr.34412) 2539 : cluster [DBG] pgmap v1432: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:11.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:36:10 gibba045 bash[25517]: cephadm 2021-03-10T14:36:09.289239+0000 mgr.gibba045.orlgmj (mgr.34412) 2540 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:36:11.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:36:10 gibba015 bash[29377]: cluster 2021-03-10T14:36:08.935966+0000 mgr.gibba045.orlgmj (mgr.34412) 2539 : cluster [DBG] pgmap v1432: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:11.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:36:10 gibba015 bash[29377]: cephadm 2021-03-10T14:36:09.289239+0000 mgr.gibba045.orlgmj (mgr.34412) 2540 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:36:11.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:36:10 gibba015 bash[30343]: cluster 2021-03-10T14:36:08.935966+0000 mgr.gibba045.orlgmj (mgr.34412) 2539 : cluster [DBG] pgmap v1432: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:11.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:36:10 gibba015 bash[30343]: cephadm 2021-03-10T14:36:09.289239+0000 mgr.gibba045.orlgmj (mgr.34412) 2540 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:36:13.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:36:12 gibba045 bash[25517]: cluster 2021-03-10T14:36:10.937499+0000 mgr.gibba045.orlgmj (mgr.34412) 2541 : cluster [DBG] pgmap v1433: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:13.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:36:12 gibba015 bash[29377]: cluster 2021-03-10T14:36:10.937499+0000 mgr.gibba045.orlgmj (mgr.34412) 2541 : cluster [DBG] pgmap v1433: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:13.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:36:12 gibba015 bash[30343]: cluster 2021-03-10T14:36:10.937499+0000 mgr.gibba045.orlgmj (mgr.34412) 2541 : cluster [DBG] pgmap v1433: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:14.812 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:36:15.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:36:14 gibba045 bash[25517]: cluster 2021-03-10T14:36:12.939126+0000 mgr.gibba045.orlgmj (mgr.34412) 2542 : cluster [DBG] pgmap v1434: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:15.068 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:36:15.069 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (46m) 2m ago 52m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:36:15.069 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (52m) 81s ago 52m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:36:15.069 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (47m) 81s ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:36:15.069 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (47m) 81s ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:36:15.070 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (46m) 2m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:36:15.070 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (46m) 2m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:36:15.070 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (46m) 81s ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:36:15.070 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (46m) 2m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:36:15.071 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (52m) 2m ago 52m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:36:15.071 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (52m) 81s ago 52m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:36:15.071 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (45m) 2m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:36:15.071 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (44m) 2m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:36:15.071 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (44m) 2m ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:36:15.072 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (43m) 2m ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:36:15.072 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (43m) 81s ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:36:15.072 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (43m) 81s ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:36:15.072 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (42m) 81s ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:36:15.073 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (42m) 81s ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:36:15.073 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (51m) 81s ago 52m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:36:15.073 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 81s ago 50m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:36:15.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:36:14 gibba015 bash[29377]: cluster 2021-03-10T14:36:12.939126+0000 mgr.gibba045.orlgmj (mgr.34412) 2542 : cluster [DBG] pgmap v1434: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:15.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:36:14 gibba015 bash[30343]: cluster 2021-03-10T14:36:12.939126+0000 mgr.gibba045.orlgmj (mgr.34412) 2542 : cluster [DBG] pgmap v1434: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:15.320 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:36:15.321 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:36:15.321 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:36:15.321 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:36:15.321 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:36:15.322 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:36:15.322 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:36:15.322 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:36:15.322 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:36:15.322 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:36:15.323 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:36:15.323 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:36:15.323 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:36:15.323 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:36:15.323 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:36:16.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:36:15 gibba045 bash[25517]: audit 2021-03-10T14:36:14.805484+0000 mgr.gibba045.orlgmj (mgr.34412) 2543 : audit [DBG] from='client.55750 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:36:16.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:36:15 gibba045 bash[25517]: audit 2021-03-10T14:36:15.317416+0000 mon.a (mon.0) 939 : audit [DBG] from='client.? 172.21.2.115:0/3736585819' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:36:16.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:36:15 gibba015 bash[29377]: audit 2021-03-10T14:36:14.805484+0000 mgr.gibba045.orlgmj (mgr.34412) 2543 : audit [DBG] from='client.55750 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:36:16.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:36:15 gibba015 bash[29377]: audit 2021-03-10T14:36:15.317416+0000 mon.a (mon.0) 939 : audit [DBG] from='client.? 172.21.2.115:0/3736585819' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:36:16.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:36:15 gibba015 bash[30343]: audit 2021-03-10T14:36:14.805484+0000 mgr.gibba045.orlgmj (mgr.34412) 2543 : audit [DBG] from='client.55750 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:36:16.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:36:15 gibba015 bash[30343]: audit 2021-03-10T14:36:15.317416+0000 mon.a (mon.0) 939 : audit [DBG] from='client.? 172.21.2.115:0/3736585819' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:36:17.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:36:16 gibba045 bash[25517]: cluster 2021-03-10T14:36:14.940852+0000 mgr.gibba045.orlgmj (mgr.34412) 2544 : cluster [DBG] pgmap v1435: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:17.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:36:16 gibba045 bash[25517]: audit 2021-03-10T14:36:15.028171+0000 mgr.gibba045.orlgmj (mgr.34412) 2545 : audit [DBG] from='client.45768 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:36:17.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:36:16 gibba015 bash[29377]: cluster 2021-03-10T14:36:14.940852+0000 mgr.gibba045.orlgmj (mgr.34412) 2544 : cluster [DBG] pgmap v1435: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:17.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:36:16 gibba015 bash[29377]: audit 2021-03-10T14:36:15.028171+0000 mgr.gibba045.orlgmj (mgr.34412) 2545 : audit [DBG] from='client.45768 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:36:17.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:36:16 gibba015 bash[30343]: cluster 2021-03-10T14:36:14.940852+0000 mgr.gibba045.orlgmj (mgr.34412) 2544 : cluster [DBG] pgmap v1435: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:17.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:36:16 gibba015 bash[30343]: audit 2021-03-10T14:36:15.028171+0000 mgr.gibba045.orlgmj (mgr.34412) 2545 : audit [DBG] from='client.45768 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:36:19.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:36:18 gibba045 bash[25517]: cluster 2021-03-10T14:36:16.942066+0000 mgr.gibba045.orlgmj (mgr.34412) 2546 : cluster [DBG] pgmap v1436: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:19.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:36:18 gibba015 bash[29377]: cluster 2021-03-10T14:36:16.942066+0000 mgr.gibba045.orlgmj (mgr.34412) 2546 : cluster [DBG] pgmap v1436: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:19.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:36:18 gibba015 bash[30343]: cluster 2021-03-10T14:36:16.942066+0000 mgr.gibba045.orlgmj (mgr.34412) 2546 : cluster [DBG] pgmap v1436: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:21.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:36:20 gibba045 bash[25517]: cluster 2021-03-10T14:36:18.943200+0000 mgr.gibba045.orlgmj (mgr.34412) 2547 : cluster [DBG] pgmap v1437: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:21.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:36:20 gibba015 bash[29377]: cluster 2021-03-10T14:36:18.943200+0000 mgr.gibba045.orlgmj (mgr.34412) 2547 : cluster [DBG] pgmap v1437: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:21.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:36:20 gibba015 bash[30343]: cluster 2021-03-10T14:36:18.943200+0000 mgr.gibba045.orlgmj (mgr.34412) 2547 : cluster [DBG] pgmap v1437: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:23.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:36:22 gibba045 bash[25517]: cluster 2021-03-10T14:36:20.944912+0000 mgr.gibba045.orlgmj (mgr.34412) 2548 : cluster [DBG] pgmap v1438: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:23.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:36:22 gibba015 bash[29377]: cluster 2021-03-10T14:36:20.944912+0000 mgr.gibba045.orlgmj (mgr.34412) 2548 : cluster [DBG] pgmap v1438: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:23.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:36:22 gibba015 bash[30343]: cluster 2021-03-10T14:36:20.944912+0000 mgr.gibba045.orlgmj (mgr.34412) 2548 : cluster [DBG] pgmap v1438: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:25.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:36:24 gibba045 bash[25517]: cluster 2021-03-10T14:36:22.946300+0000 mgr.gibba045.orlgmj (mgr.34412) 2549 : cluster [DBG] pgmap v1439: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:25.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:36:24 gibba015 bash[29377]: cluster 2021-03-10T14:36:22.946300+0000 mgr.gibba045.orlgmj (mgr.34412) 2549 : cluster [DBG] pgmap v1439: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:25.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:36:24 gibba015 bash[30343]: cluster 2021-03-10T14:36:22.946300+0000 mgr.gibba045.orlgmj (mgr.34412) 2549 : cluster [DBG] pgmap v1439: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:26.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:36:25 gibba045 bash[25517]: cephadm 2021-03-10T14:36:24.301404+0000 mgr.gibba045.orlgmj (mgr.34412) 2550 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:36:26.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:36:25 gibba015 bash[29377]: cephadm 2021-03-10T14:36:24.301404+0000 mgr.gibba045.orlgmj (mgr.34412) 2550 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:36:26.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:36:25 gibba015 bash[30343]: cephadm 2021-03-10T14:36:24.301404+0000 mgr.gibba045.orlgmj (mgr.34412) 2550 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:36:27.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:36:26 gibba015 bash[29377]: cluster 2021-03-10T14:36:24.947835+0000 mgr.gibba045.orlgmj (mgr.34412) 2551 : cluster [DBG] pgmap v1440: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:27.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:36:26 gibba015 bash[30343]: cluster 2021-03-10T14:36:24.947835+0000 mgr.gibba045.orlgmj (mgr.34412) 2551 : cluster [DBG] pgmap v1440: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:27.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:36:26 gibba045 bash[25517]: cluster 2021-03-10T14:36:24.947835+0000 mgr.gibba045.orlgmj (mgr.34412) 2551 : cluster [DBG] pgmap v1440: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:29.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:36:28 gibba015 bash[29377]: cluster 2021-03-10T14:36:26.949594+0000 mgr.gibba045.orlgmj (mgr.34412) 2552 : cluster [DBG] pgmap v1441: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:29.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:36:28 gibba015 bash[30343]: cluster 2021-03-10T14:36:26.949594+0000 mgr.gibba045.orlgmj (mgr.34412) 2552 : cluster [DBG] pgmap v1441: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:29.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:36:28 gibba045 bash[25517]: cluster 2021-03-10T14:36:26.949594+0000 mgr.gibba045.orlgmj (mgr.34412) 2552 : cluster [DBG] pgmap v1441: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:31.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:36:30 gibba015 bash[29377]: cluster 2021-03-10T14:36:28.950814+0000 mgr.gibba045.orlgmj (mgr.34412) 2553 : cluster [DBG] pgmap v1442: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:31.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:36:30 gibba015 bash[30343]: cluster 2021-03-10T14:36:28.950814+0000 mgr.gibba045.orlgmj (mgr.34412) 2553 : cluster [DBG] pgmap v1442: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:31.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:36:30 gibba045 bash[25517]: cluster 2021-03-10T14:36:28.950814+0000 mgr.gibba045.orlgmj (mgr.34412) 2553 : cluster [DBG] pgmap v1442: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:33.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:36:32 gibba015 bash[29377]: cluster 2021-03-10T14:36:30.952663+0000 mgr.gibba045.orlgmj (mgr.34412) 2554 : cluster [DBG] pgmap v1443: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:33.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:36:32 gibba015 bash[30343]: cluster 2021-03-10T14:36:30.952663+0000 mgr.gibba045.orlgmj (mgr.34412) 2554 : cluster [DBG] pgmap v1443: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:33.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:36:32 gibba045 bash[25517]: cluster 2021-03-10T14:36:30.952663+0000 mgr.gibba045.orlgmj (mgr.34412) 2554 : cluster [DBG] pgmap v1443: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:34.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:36:33 gibba015 bash[29377]: cluster 2021-03-10T14:36:32.954311+0000 mgr.gibba045.orlgmj (mgr.34412) 2555 : cluster [DBG] pgmap v1444: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:34.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:36:33 gibba015 bash[30343]: cluster 2021-03-10T14:36:32.954311+0000 mgr.gibba045.orlgmj (mgr.34412) 2555 : cluster [DBG] pgmap v1444: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:34.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:36:33 gibba045 bash[25517]: cluster 2021-03-10T14:36:32.954311+0000 mgr.gibba045.orlgmj (mgr.34412) 2555 : cluster [DBG] pgmap v1444: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:36.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:36:36 gibba045 bash[25517]: cluster 2021-03-10T14:36:34.956010+0000 mgr.gibba045.orlgmj (mgr.34412) 2556 : cluster [DBG] pgmap v1445: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:36.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:36:36 gibba015 bash[29377]: cluster 2021-03-10T14:36:34.956010+0000 mgr.gibba045.orlgmj (mgr.34412) 2556 : cluster [DBG] pgmap v1445: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:36.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:36:36 gibba015 bash[30343]: cluster 2021-03-10T14:36:34.956010+0000 mgr.gibba045.orlgmj (mgr.34412) 2556 : cluster [DBG] pgmap v1445: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:39.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:36:38 gibba045 bash[25517]: cluster 2021-03-10T14:36:36.957563+0000 mgr.gibba045.orlgmj (mgr.34412) 2557 : cluster [DBG] pgmap v1446: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:39.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:36:38 gibba015 bash[29377]: cluster 2021-03-10T14:36:36.957563+0000 mgr.gibba045.orlgmj (mgr.34412) 2557 : cluster [DBG] pgmap v1446: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:39.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:36:38 gibba015 bash[30343]: cluster 2021-03-10T14:36:36.957563+0000 mgr.gibba045.orlgmj (mgr.34412) 2557 : cluster [DBG] pgmap v1446: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:41.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:36:40 gibba045 bash[25517]: cluster 2021-03-10T14:36:38.958969+0000 mgr.gibba045.orlgmj (mgr.34412) 2558 : cluster [DBG] pgmap v1447: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:41.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:36:40 gibba045 bash[25517]: cephadm 2021-03-10T14:36:39.317193+0000 mgr.gibba045.orlgmj (mgr.34412) 2559 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:36:41.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:36:40 gibba015 bash[29377]: cluster 2021-03-10T14:36:38.958969+0000 mgr.gibba045.orlgmj (mgr.34412) 2558 : cluster [DBG] pgmap v1447: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:41.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:36:40 gibba015 bash[29377]: cephadm 2021-03-10T14:36:39.317193+0000 mgr.gibba045.orlgmj (mgr.34412) 2559 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:36:41.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:36:40 gibba015 bash[30343]: cluster 2021-03-10T14:36:38.958969+0000 mgr.gibba045.orlgmj (mgr.34412) 2558 : cluster [DBG] pgmap v1447: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:41.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:36:40 gibba015 bash[30343]: cephadm 2021-03-10T14:36:39.317193+0000 mgr.gibba045.orlgmj (mgr.34412) 2559 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:36:43.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:36:42 gibba045 bash[25517]: cluster 2021-03-10T14:36:40.960779+0000 mgr.gibba045.orlgmj (mgr.34412) 2560 : cluster [DBG] pgmap v1448: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:43.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:36:42 gibba015 bash[29377]: cluster 2021-03-10T14:36:40.960779+0000 mgr.gibba045.orlgmj (mgr.34412) 2560 : cluster [DBG] pgmap v1448: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:43.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:36:42 gibba015 bash[30343]: cluster 2021-03-10T14:36:40.960779+0000 mgr.gibba045.orlgmj (mgr.34412) 2560 : cluster [DBG] pgmap v1448: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:45.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:36:44 gibba045 bash[25517]: cluster 2021-03-10T14:36:42.962165+0000 mgr.gibba045.orlgmj (mgr.34412) 2561 : cluster [DBG] pgmap v1449: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:45.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:36:44 gibba015 bash[29377]: cluster 2021-03-10T14:36:42.962165+0000 mgr.gibba045.orlgmj (mgr.34412) 2561 : cluster [DBG] pgmap v1449: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:45.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:36:44 gibba015 bash[30343]: cluster 2021-03-10T14:36:42.962165+0000 mgr.gibba045.orlgmj (mgr.34412) 2561 : cluster [DBG] pgmap v1449: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:45.562 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:36:45.784 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:36:45.785 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (47m) 2m ago 52m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:36:45.785 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (52m) 112s ago 52m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:36:45.785 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (47m) 112s ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:36:45.785 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (48m) 112s ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:36:45.786 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (47m) 2m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:36:45.786 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (47m) 2m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:36:45.786 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (46m) 112s ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:36:45.786 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (46m) 2m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:36:45.786 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (52m) 2m ago 53m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:36:45.787 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (53m) 112s ago 53m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:36:45.787 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (45m) 2m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:36:45.787 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (45m) 2m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:36:45.787 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (44m) 2m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:36:45.788 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (44m) 2m ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:36:45.788 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (44m) 112s ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:36:45.788 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (43m) 112s ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:36:45.788 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (43m) 112s ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:36:45.788 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (42m) 112s ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:36:45.789 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (52m) 112s ago 53m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:36:45.789 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 112s ago 50m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:36:46.035 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:36:46.035 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:36:46.035 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:36:46.035 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:36:46.036 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:36:46.036 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:36:46.036 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:36:46.036 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:36:46.037 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:36:46.037 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:36:46.037 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:36:46.037 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:36:46.037 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:36:46.038 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:36:46.038 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:36:47.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:36:46 gibba045 bash[25517]: cluster 2021-03-10T14:36:44.963707+0000 mgr.gibba045.orlgmj (mgr.34412) 2562 : cluster [DBG] pgmap v1450: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:47.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:36:46 gibba045 bash[25517]: audit 2021-03-10T14:36:45.554461+0000 mgr.gibba045.orlgmj (mgr.34412) 2563 : audit [DBG] from='client.55768 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:36:47.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:36:46 gibba045 bash[25517]: audit 2021-03-10T14:36:45.777161+0000 mgr.gibba045.orlgmj (mgr.34412) 2564 : audit [DBG] from='client.55774 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:36:47.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:36:46 gibba045 bash[25517]: audit 2021-03-10T14:36:46.031718+0000 mon.c (mon.1) 756 : audit [DBG] from='client.? 172.21.2.115:0/2295280982' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:36:47.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:36:46 gibba015 bash[29377]: cluster 2021-03-10T14:36:44.963707+0000 mgr.gibba045.orlgmj (mgr.34412) 2562 : cluster [DBG] pgmap v1450: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:47.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:36:46 gibba015 bash[29377]: audit 2021-03-10T14:36:45.554461+0000 mgr.gibba045.orlgmj (mgr.34412) 2563 : audit [DBG] from='client.55768 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:36:47.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:36:46 gibba015 bash[29377]: audit 2021-03-10T14:36:45.777161+0000 mgr.gibba045.orlgmj (mgr.34412) 2564 : audit [DBG] from='client.55774 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:36:47.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:36:46 gibba015 bash[29377]: audit 2021-03-10T14:36:46.031718+0000 mon.c (mon.1) 756 : audit [DBG] from='client.? 172.21.2.115:0/2295280982' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:36:47.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:36:46 gibba015 bash[30343]: cluster 2021-03-10T14:36:44.963707+0000 mgr.gibba045.orlgmj (mgr.34412) 2562 : cluster [DBG] pgmap v1450: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:47.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:36:46 gibba015 bash[30343]: audit 2021-03-10T14:36:45.554461+0000 mgr.gibba045.orlgmj (mgr.34412) 2563 : audit [DBG] from='client.55768 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:36:47.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:36:46 gibba015 bash[30343]: audit 2021-03-10T14:36:45.777161+0000 mgr.gibba045.orlgmj (mgr.34412) 2564 : audit [DBG] from='client.55774 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:36:47.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:36:46 gibba015 bash[30343]: audit 2021-03-10T14:36:46.031718+0000 mon.c (mon.1) 756 : audit [DBG] from='client.? 172.21.2.115:0/2295280982' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:36:49.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:36:48 gibba045 bash[25517]: cluster 2021-03-10T14:36:46.965484+0000 mgr.gibba045.orlgmj (mgr.34412) 2565 : cluster [DBG] pgmap v1451: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:49.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:36:48 gibba015 bash[29377]: cluster 2021-03-10T14:36:46.965484+0000 mgr.gibba045.orlgmj (mgr.34412) 2565 : cluster [DBG] pgmap v1451: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:49.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:36:48 gibba015 bash[30343]: cluster 2021-03-10T14:36:46.965484+0000 mgr.gibba045.orlgmj (mgr.34412) 2565 : cluster [DBG] pgmap v1451: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:51.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:36:50 gibba045 bash[25517]: cluster 2021-03-10T14:36:48.966718+0000 mgr.gibba045.orlgmj (mgr.34412) 2566 : cluster [DBG] pgmap v1452: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:51.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:36:50 gibba015 bash[29377]: cluster 2021-03-10T14:36:48.966718+0000 mgr.gibba045.orlgmj (mgr.34412) 2566 : cluster [DBG] pgmap v1452: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:51.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:36:50 gibba015 bash[30343]: cluster 2021-03-10T14:36:48.966718+0000 mgr.gibba045.orlgmj (mgr.34412) 2566 : cluster [DBG] pgmap v1452: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:53.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:36:52 gibba045 bash[25517]: cluster 2021-03-10T14:36:50.968398+0000 mgr.gibba045.orlgmj (mgr.34412) 2567 : cluster [DBG] pgmap v1453: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:53.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:36:52 gibba045 bash[25517]: audit 2021-03-10T14:36:52.767675+0000 mon.c (mon.1) 757 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:36:53.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:36:52 gibba045 bash[25517]: audit 2021-03-10T14:36:52.767831+0000 mon.c (mon.1) 758 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:36:53.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:36:52 gibba045 bash[25517]: audit 2021-03-10T14:36:52.768152+0000 mon.a (mon.0) 940 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:36:53.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:36:52 gibba045 bash[25517]: audit 2021-03-10T14:36:52.768308+0000 mon.a (mon.0) 941 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:36:53.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:36:52 gibba045 bash[25517]: audit 2021-03-10T14:36:52.776126+0000 mon.c (mon.1) 759 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T14:36:53.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:36:52 gibba045 bash[25517]: audit 2021-03-10T14:36:52.776320+0000 mon.c (mon.1) 760 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:36:53.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:36:52 gibba045 bash[25517]: audit 2021-03-10T14:36:52.776499+0000 mon.c (mon.1) 761 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:36:53.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:36:52 gibba045 bash[25517]: audit 2021-03-10T14:36:52.776635+0000 mon.a (mon.0) 942 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T14:36:53.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:36:52 gibba045 bash[25517]: audit 2021-03-10T14:36:52.776687+0000 mon.c (mon.1) 762 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:36:53.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:36:52 gibba045 bash[25517]: audit 2021-03-10T14:36:52.776964+0000 mon.a (mon.0) 943 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:36:53.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:36:52 gibba045 bash[25517]: audit 2021-03-10T14:36:52.777245+0000 mon.a (mon.0) 944 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:36:53.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:36:52 gibba045 bash[25517]: audit 2021-03-10T14:36:52.777460+0000 mon.a (mon.0) 945 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:36:53.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:36:52 gibba015 bash[29377]: cluster 2021-03-10T14:36:50.968398+0000 mgr.gibba045.orlgmj (mgr.34412) 2567 : cluster [DBG] pgmap v1453: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:53.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:36:52 gibba015 bash[29377]: audit 2021-03-10T14:36:52.767675+0000 mon.c (mon.1) 757 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:36:53.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:36:52 gibba015 bash[29377]: audit 2021-03-10T14:36:52.767831+0000 mon.c (mon.1) 758 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:36:53.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:36:52 gibba015 bash[29377]: audit 2021-03-10T14:36:52.768152+0000 mon.a (mon.0) 940 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:36:53.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:36:52 gibba015 bash[29377]: audit 2021-03-10T14:36:52.768308+0000 mon.a (mon.0) 941 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:36:53.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:36:52 gibba015 bash[29377]: audit 2021-03-10T14:36:52.776126+0000 mon.c (mon.1) 759 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T14:36:53.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:36:52 gibba015 bash[29377]: audit 2021-03-10T14:36:52.776320+0000 mon.c (mon.1) 760 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:36:53.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:36:52 gibba015 bash[29377]: audit 2021-03-10T14:36:52.776499+0000 mon.c (mon.1) 761 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:36:53.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:36:52 gibba015 bash[29377]: audit 2021-03-10T14:36:52.776635+0000 mon.a (mon.0) 942 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T14:36:53.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:36:52 gibba015 bash[29377]: audit 2021-03-10T14:36:52.776687+0000 mon.c (mon.1) 762 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:36:53.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:36:52 gibba015 bash[29377]: audit 2021-03-10T14:36:52.776964+0000 mon.a (mon.0) 943 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:36:53.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:36:52 gibba015 bash[29377]: audit 2021-03-10T14:36:52.777245+0000 mon.a (mon.0) 944 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:36:53.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:36:52 gibba015 bash[29377]: audit 2021-03-10T14:36:52.777460+0000 mon.a (mon.0) 945 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:36:53.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:36:52 gibba015 bash[30343]: cluster 2021-03-10T14:36:50.968398+0000 mgr.gibba045.orlgmj (mgr.34412) 2567 : cluster [DBG] pgmap v1453: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:53.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:36:52 gibba015 bash[30343]: audit 2021-03-10T14:36:52.767675+0000 mon.c (mon.1) 757 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:36:53.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:36:52 gibba015 bash[30343]: audit 2021-03-10T14:36:52.767831+0000 mon.c (mon.1) 758 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:36:53.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:36:52 gibba015 bash[30343]: audit 2021-03-10T14:36:52.768152+0000 mon.a (mon.0) 940 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:36:53.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:36:52 gibba015 bash[30343]: audit 2021-03-10T14:36:52.768308+0000 mon.a (mon.0) 941 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:36:53.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:36:52 gibba015 bash[30343]: audit 2021-03-10T14:36:52.776126+0000 mon.c (mon.1) 759 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T14:36:53.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:36:52 gibba015 bash[30343]: audit 2021-03-10T14:36:52.776320+0000 mon.c (mon.1) 760 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:36:53.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:36:52 gibba015 bash[30343]: audit 2021-03-10T14:36:52.776499+0000 mon.c (mon.1) 761 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:36:53.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:36:52 gibba015 bash[30343]: audit 2021-03-10T14:36:52.776635+0000 mon.a (mon.0) 942 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T14:36:53.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:36:52 gibba015 bash[30343]: audit 2021-03-10T14:36:52.776687+0000 mon.c (mon.1) 762 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:36:53.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:36:52 gibba015 bash[30343]: audit 2021-03-10T14:36:52.776964+0000 mon.a (mon.0) 943 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:36:53.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:36:52 gibba015 bash[30343]: audit 2021-03-10T14:36:52.777245+0000 mon.a (mon.0) 944 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:36:53.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:36:52 gibba015 bash[30343]: audit 2021-03-10T14:36:52.777460+0000 mon.a (mon.0) 945 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:36:55.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:36:54 gibba045 bash[25517]: cluster 2021-03-10T14:36:52.970083+0000 mgr.gibba045.orlgmj (mgr.34412) 2568 : cluster [DBG] pgmap v1454: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:55.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:36:54 gibba045 bash[25517]: audit 2021-03-10T14:36:54.330058+0000 mon.c (mon.1) 763 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:36:55.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:36:54 gibba045 bash[25517]: audit 2021-03-10T14:36:54.546081+0000 mon.a (mon.0) 946 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:36:55.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:36:54 gibba045 bash[25517]: audit 2021-03-10T14:36:54.549830+0000 mon.c (mon.1) 764 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:36:55.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:36:54 gibba045 bash[25517]: audit 2021-03-10T14:36:54.551163+0000 mon.c (mon.1) 765 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:36:55.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:36:54 gibba045 bash[25517]: audit 2021-03-10T14:36:54.552496+0000 mon.c (mon.1) 766 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:36:55.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:36:54 gibba045 bash[25517]: audit 2021-03-10T14:36:54.553448+0000 mon.c (mon.1) 767 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:36:55.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:36:54 gibba045 bash[25517]: audit 2021-03-10T14:36:54.555872+0000 mon.c (mon.1) 768 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:36:55.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:36:54 gibba045 bash[25517]: audit 2021-03-10T14:36:54.557365+0000 mon.c (mon.1) 769 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:36:55.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:36:54 gibba015 bash[29377]: cluster 2021-03-10T14:36:52.970083+0000 mgr.gibba045.orlgmj (mgr.34412) 2568 : cluster [DBG] pgmap v1454: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:55.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:36:54 gibba015 bash[29377]: audit 2021-03-10T14:36:54.330058+0000 mon.c (mon.1) 763 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:36:55.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:36:54 gibba015 bash[29377]: audit 2021-03-10T14:36:54.546081+0000 mon.a (mon.0) 946 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:36:55.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:36:54 gibba015 bash[29377]: audit 2021-03-10T14:36:54.549830+0000 mon.c (mon.1) 764 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:36:55.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:36:54 gibba015 bash[29377]: audit 2021-03-10T14:36:54.551163+0000 mon.c (mon.1) 765 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:36:55.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:36:54 gibba015 bash[29377]: audit 2021-03-10T14:36:54.552496+0000 mon.c (mon.1) 766 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:36:55.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:36:54 gibba015 bash[29377]: audit 2021-03-10T14:36:54.553448+0000 mon.c (mon.1) 767 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:36:55.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:36:54 gibba015 bash[29377]: audit 2021-03-10T14:36:54.555872+0000 mon.c (mon.1) 768 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:36:55.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:36:54 gibba015 bash[29377]: audit 2021-03-10T14:36:54.557365+0000 mon.c (mon.1) 769 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:36:55.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:36:54 gibba015 bash[30343]: cluster 2021-03-10T14:36:52.970083+0000 mgr.gibba045.orlgmj (mgr.34412) 2568 : cluster [DBG] pgmap v1454: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:55.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:36:54 gibba015 bash[30343]: audit 2021-03-10T14:36:54.330058+0000 mon.c (mon.1) 763 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:36:55.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:36:54 gibba015 bash[30343]: audit 2021-03-10T14:36:54.546081+0000 mon.a (mon.0) 946 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:36:55.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:36:54 gibba015 bash[30343]: audit 2021-03-10T14:36:54.549830+0000 mon.c (mon.1) 764 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:36:55.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:36:54 gibba015 bash[30343]: audit 2021-03-10T14:36:54.551163+0000 mon.c (mon.1) 765 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:36:55.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:36:54 gibba015 bash[30343]: audit 2021-03-10T14:36:54.552496+0000 mon.c (mon.1) 766 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:36:55.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:36:54 gibba015 bash[30343]: audit 2021-03-10T14:36:54.553448+0000 mon.c (mon.1) 767 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:36:55.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:36:54 gibba015 bash[30343]: audit 2021-03-10T14:36:54.555872+0000 mon.c (mon.1) 768 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:36:55.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:36:54 gibba015 bash[30343]: audit 2021-03-10T14:36:54.557365+0000 mon.c (mon.1) 769 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:36:56.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:36:55 gibba015 bash[29377]: cephadm 2021-03-10T14:36:54.339172+0000 mgr.gibba045.orlgmj (mgr.34412) 2569 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:36:56.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:36:55 gibba015 bash[29377]: cephadm 2021-03-10T14:36:54.341144+0000 mgr.gibba045.orlgmj (mgr.34412) 2570 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:36:56.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:36:55 gibba015 bash[29377]: cephadm 2021-03-10T14:36:54.553090+0000 mgr.gibba045.orlgmj (mgr.34412) 2571 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:36:56.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:36:55 gibba015 bash[29377]: cephadm 2021-03-10T14:36:54.554512+0000 mgr.gibba045.orlgmj (mgr.34412) 2572 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:36:56.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:36:55 gibba015 bash[29377]: cephadm 2021-03-10T14:36:54.555809+0000 mgr.gibba045.orlgmj (mgr.34412) 2573 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:36:56.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:36:55 gibba015 bash[29377]: cephadm 2021-03-10T14:36:54.555854+0000 mgr.gibba045.orlgmj (mgr.34412) 2574 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:36:56.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:36:55 gibba015 bash[29377]: cephadm 2021-03-10T14:36:54.557029+0000 mgr.gibba045.orlgmj (mgr.34412) 2575 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:36:56.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:36:55 gibba015 bash[29377]: cephadm 2021-03-10T14:36:54.557074+0000 mgr.gibba045.orlgmj (mgr.34412) 2576 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:36:56.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:36:55 gibba015 bash[29377]: cephadm 2021-03-10T14:36:54.557965+0000 mgr.gibba045.orlgmj (mgr.34412) 2577 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:36:56.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:36:55 gibba015 bash[29377]: cephadm 2021-03-10T14:36:54.559273+0000 mgr.gibba045.orlgmj (mgr.34412) 2578 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:36:56.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:36:55 gibba015 bash[29377]: cephadm 2021-03-10T14:36:54.559320+0000 mgr.gibba045.orlgmj (mgr.34412) 2579 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:36:56.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:36:55 gibba015 bash[29377]: cephadm 2021-03-10T14:36:54.560363+0000 mgr.gibba045.orlgmj (mgr.34412) 2580 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:36:56.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:36:55 gibba015 bash[29377]: cephadm 2021-03-10T14:36:54.560754+0000 mgr.gibba045.orlgmj (mgr.34412) 2581 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:36:56.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:36:55 gibba015 bash[29377]: cephadm 2021-03-10T14:36:54.562122+0000 mgr.gibba045.orlgmj (mgr.34412) 2582 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:36:56.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:36:55 gibba015 bash[29377]: cephadm 2021-03-10T14:36:54.562212+0000 mgr.gibba045.orlgmj (mgr.34412) 2583 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:36:56.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:36:55 gibba015 bash[29377]: cephadm 2021-03-10T14:36:54.562414+0000 mgr.gibba045.orlgmj (mgr.34412) 2584 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:36:56.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:36:55 gibba015 bash[30343]: cephadm 2021-03-10T14:36:54.339172+0000 mgr.gibba045.orlgmj (mgr.34412) 2569 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:36:56.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:36:55 gibba015 bash[30343]: cephadm 2021-03-10T14:36:54.341144+0000 mgr.gibba045.orlgmj (mgr.34412) 2570 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:36:56.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:36:55 gibba015 bash[30343]: cephadm 2021-03-10T14:36:54.553090+0000 mgr.gibba045.orlgmj (mgr.34412) 2571 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:36:56.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:36:55 gibba015 bash[30343]: cephadm 2021-03-10T14:36:54.554512+0000 mgr.gibba045.orlgmj (mgr.34412) 2572 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:36:56.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:36:55 gibba015 bash[30343]: cephadm 2021-03-10T14:36:54.555809+0000 mgr.gibba045.orlgmj (mgr.34412) 2573 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:36:56.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:36:55 gibba015 bash[30343]: cephadm 2021-03-10T14:36:54.555854+0000 mgr.gibba045.orlgmj (mgr.34412) 2574 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:36:56.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:36:55 gibba015 bash[30343]: cephadm 2021-03-10T14:36:54.557029+0000 mgr.gibba045.orlgmj (mgr.34412) 2575 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:36:56.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:36:55 gibba015 bash[30343]: cephadm 2021-03-10T14:36:54.557074+0000 mgr.gibba045.orlgmj (mgr.34412) 2576 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:36:56.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:36:55 gibba015 bash[30343]: cephadm 2021-03-10T14:36:54.557965+0000 mgr.gibba045.orlgmj (mgr.34412) 2577 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:36:56.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:36:55 gibba015 bash[30343]: cephadm 2021-03-10T14:36:54.559273+0000 mgr.gibba045.orlgmj (mgr.34412) 2578 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:36:56.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:36:55 gibba015 bash[30343]: cephadm 2021-03-10T14:36:54.559320+0000 mgr.gibba045.orlgmj (mgr.34412) 2579 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:36:56.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:36:55 gibba015 bash[30343]: cephadm 2021-03-10T14:36:54.560363+0000 mgr.gibba045.orlgmj (mgr.34412) 2580 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:36:56.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:36:55 gibba015 bash[30343]: cephadm 2021-03-10T14:36:54.560754+0000 mgr.gibba045.orlgmj (mgr.34412) 2581 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:36:56.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:36:55 gibba015 bash[30343]: cephadm 2021-03-10T14:36:54.562122+0000 mgr.gibba045.orlgmj (mgr.34412) 2582 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:36:56.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:36:55 gibba015 bash[30343]: cephadm 2021-03-10T14:36:54.562212+0000 mgr.gibba045.orlgmj (mgr.34412) 2583 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:36:56.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:36:55 gibba015 bash[30343]: cephadm 2021-03-10T14:36:54.562414+0000 mgr.gibba045.orlgmj (mgr.34412) 2584 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:36:56.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:36:55 gibba045 bash[25517]: cephadm 2021-03-10T14:36:54.339172+0000 mgr.gibba045.orlgmj (mgr.34412) 2569 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:36:56.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:36:55 gibba045 bash[25517]: cephadm 2021-03-10T14:36:54.341144+0000 mgr.gibba045.orlgmj (mgr.34412) 2570 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:36:56.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:36:55 gibba045 bash[25517]: cephadm 2021-03-10T14:36:54.553090+0000 mgr.gibba045.orlgmj (mgr.34412) 2571 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:36:56.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:36:55 gibba045 bash[25517]: cephadm 2021-03-10T14:36:54.554512+0000 mgr.gibba045.orlgmj (mgr.34412) 2572 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:36:56.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:36:55 gibba045 bash[25517]: cephadm 2021-03-10T14:36:54.555809+0000 mgr.gibba045.orlgmj (mgr.34412) 2573 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:36:56.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:36:55 gibba045 bash[25517]: cephadm 2021-03-10T14:36:54.555854+0000 mgr.gibba045.orlgmj (mgr.34412) 2574 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:36:56.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:36:55 gibba045 bash[25517]: cephadm 2021-03-10T14:36:54.557029+0000 mgr.gibba045.orlgmj (mgr.34412) 2575 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:36:56.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:36:55 gibba045 bash[25517]: cephadm 2021-03-10T14:36:54.557074+0000 mgr.gibba045.orlgmj (mgr.34412) 2576 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:36:56.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:36:55 gibba045 bash[25517]: cephadm 2021-03-10T14:36:54.557965+0000 mgr.gibba045.orlgmj (mgr.34412) 2577 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:36:56.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:36:55 gibba045 bash[25517]: cephadm 2021-03-10T14:36:54.559273+0000 mgr.gibba045.orlgmj (mgr.34412) 2578 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:36:56.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:36:55 gibba045 bash[25517]: cephadm 2021-03-10T14:36:54.559320+0000 mgr.gibba045.orlgmj (mgr.34412) 2579 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:36:56.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:36:55 gibba045 bash[25517]: cephadm 2021-03-10T14:36:54.560363+0000 mgr.gibba045.orlgmj (mgr.34412) 2580 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:36:56.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:36:55 gibba045 bash[25517]: cephadm 2021-03-10T14:36:54.560754+0000 mgr.gibba045.orlgmj (mgr.34412) 2581 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:36:56.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:36:55 gibba045 bash[25517]: cephadm 2021-03-10T14:36:54.562122+0000 mgr.gibba045.orlgmj (mgr.34412) 2582 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:36:56.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:36:55 gibba045 bash[25517]: cephadm 2021-03-10T14:36:54.562212+0000 mgr.gibba045.orlgmj (mgr.34412) 2583 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:36:56.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:36:55 gibba045 bash[25517]: cephadm 2021-03-10T14:36:54.562414+0000 mgr.gibba045.orlgmj (mgr.34412) 2584 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:36:57.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:36:56 gibba015 bash[29377]: cluster 2021-03-10T14:36:54.971620+0000 mgr.gibba045.orlgmj (mgr.34412) 2585 : cluster [DBG] pgmap v1455: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:57.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:36:56 gibba015 bash[30343]: cluster 2021-03-10T14:36:54.971620+0000 mgr.gibba045.orlgmj (mgr.34412) 2585 : cluster [DBG] pgmap v1455: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:57.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:36:56 gibba045 bash[25517]: cluster 2021-03-10T14:36:54.971620+0000 mgr.gibba045.orlgmj (mgr.34412) 2585 : cluster [DBG] pgmap v1455: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:59.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:36:58 gibba015 bash[29377]: cluster 2021-03-10T14:36:56.973379+0000 mgr.gibba045.orlgmj (mgr.34412) 2586 : cluster [DBG] pgmap v1456: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:59.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:36:58 gibba015 bash[30343]: cluster 2021-03-10T14:36:56.973379+0000 mgr.gibba045.orlgmj (mgr.34412) 2586 : cluster [DBG] pgmap v1456: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:59.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:36:58 gibba045 bash[25517]: cluster 2021-03-10T14:36:56.973379+0000 mgr.gibba045.orlgmj (mgr.34412) 2586 : cluster [DBG] pgmap v1456: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:01.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:37:00 gibba015 bash[29377]: cluster 2021-03-10T14:36:58.974558+0000 mgr.gibba045.orlgmj (mgr.34412) 2587 : cluster [DBG] pgmap v1457: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:01.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:37:00 gibba015 bash[30343]: cluster 2021-03-10T14:36:58.974558+0000 mgr.gibba045.orlgmj (mgr.34412) 2587 : cluster [DBG] pgmap v1457: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:01.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:37:00 gibba045 bash[25517]: cluster 2021-03-10T14:36:58.974558+0000 mgr.gibba045.orlgmj (mgr.34412) 2587 : cluster [DBG] pgmap v1457: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:03.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:37:02 gibba015 bash[29377]: cluster 2021-03-10T14:37:00.976301+0000 mgr.gibba045.orlgmj (mgr.34412) 2588 : cluster [DBG] pgmap v1458: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:03.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:37:02 gibba015 bash[30343]: cluster 2021-03-10T14:37:00.976301+0000 mgr.gibba045.orlgmj (mgr.34412) 2588 : cluster [DBG] pgmap v1458: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:03.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:37:02 gibba045 bash[25517]: cluster 2021-03-10T14:37:00.976301+0000 mgr.gibba045.orlgmj (mgr.34412) 2588 : cluster [DBG] pgmap v1458: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:05.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:37:04 gibba015 bash[29377]: cluster 2021-03-10T14:37:02.977754+0000 mgr.gibba045.orlgmj (mgr.34412) 2589 : cluster [DBG] pgmap v1459: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:05.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:37:04 gibba015 bash[30343]: cluster 2021-03-10T14:37:02.977754+0000 mgr.gibba045.orlgmj (mgr.34412) 2589 : cluster [DBG] pgmap v1459: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:05.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:37:04 gibba045 bash[25517]: cluster 2021-03-10T14:37:02.977754+0000 mgr.gibba045.orlgmj (mgr.34412) 2589 : cluster [DBG] pgmap v1459: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:06.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:37:05 gibba015 bash[29377]: cluster 2021-03-10T14:37:04.979451+0000 mgr.gibba045.orlgmj (mgr.34412) 2590 : cluster [DBG] pgmap v1460: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:06.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:37:05 gibba015 bash[30343]: cluster 2021-03-10T14:37:04.979451+0000 mgr.gibba045.orlgmj (mgr.34412) 2590 : cluster [DBG] pgmap v1460: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:06.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:37:05 gibba045 bash[25517]: cluster 2021-03-10T14:37:04.979451+0000 mgr.gibba045.orlgmj (mgr.34412) 2590 : cluster [DBG] pgmap v1460: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:09.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:37:08 gibba045 bash[25517]: cluster 2021-03-10T14:37:06.980972+0000 mgr.gibba045.orlgmj (mgr.34412) 2591 : cluster [DBG] pgmap v1461: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:09.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:37:08 gibba015 bash[29377]: cluster 2021-03-10T14:37:06.980972+0000 mgr.gibba045.orlgmj (mgr.34412) 2591 : cluster [DBG] pgmap v1461: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:09.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:37:08 gibba015 bash[30343]: cluster 2021-03-10T14:37:06.980972+0000 mgr.gibba045.orlgmj (mgr.34412) 2591 : cluster [DBG] pgmap v1461: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:11.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:37:10 gibba045 bash[25517]: cluster 2021-03-10T14:37:08.982198+0000 mgr.gibba045.orlgmj (mgr.34412) 2592 : cluster [DBG] pgmap v1462: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:11.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:37:10 gibba045 bash[25517]: cephadm 2021-03-10T14:37:09.577347+0000 mgr.gibba045.orlgmj (mgr.34412) 2593 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:37:11.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:37:10 gibba015 bash[29377]: cluster 2021-03-10T14:37:08.982198+0000 mgr.gibba045.orlgmj (mgr.34412) 2592 : cluster [DBG] pgmap v1462: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:11.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:37:10 gibba015 bash[29377]: cephadm 2021-03-10T14:37:09.577347+0000 mgr.gibba045.orlgmj (mgr.34412) 2593 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:37:11.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:37:10 gibba015 bash[30343]: cluster 2021-03-10T14:37:08.982198+0000 mgr.gibba045.orlgmj (mgr.34412) 2592 : cluster [DBG] pgmap v1462: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:11.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:37:10 gibba015 bash[30343]: cephadm 2021-03-10T14:37:09.577347+0000 mgr.gibba045.orlgmj (mgr.34412) 2593 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:37:13.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:37:12 gibba045 bash[25517]: cluster 2021-03-10T14:37:10.983904+0000 mgr.gibba045.orlgmj (mgr.34412) 2594 : cluster [DBG] pgmap v1463: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:13.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:37:12 gibba015 bash[29377]: cluster 2021-03-10T14:37:10.983904+0000 mgr.gibba045.orlgmj (mgr.34412) 2594 : cluster [DBG] pgmap v1463: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:13.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:37:12 gibba015 bash[30343]: cluster 2021-03-10T14:37:10.983904+0000 mgr.gibba045.orlgmj (mgr.34412) 2594 : cluster [DBG] pgmap v1463: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:15.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:37:14 gibba045 bash[25517]: cluster 2021-03-10T14:37:12.985573+0000 mgr.gibba045.orlgmj (mgr.34412) 2595 : cluster [DBG] pgmap v1464: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:15.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:37:14 gibba015 bash[29377]: cluster 2021-03-10T14:37:12.985573+0000 mgr.gibba045.orlgmj (mgr.34412) 2595 : cluster [DBG] pgmap v1464: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:15.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:37:14 gibba015 bash[30343]: cluster 2021-03-10T14:37:12.985573+0000 mgr.gibba045.orlgmj (mgr.34412) 2595 : cluster [DBG] pgmap v1464: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:16.280 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:37:16.507 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:37:16.508 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (47m) 3m ago 53m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:37:16.508 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (53m) 2m ago 53m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:37:16.508 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (48m) 2m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:37:16.509 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (48m) 2m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:37:16.509 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (47m) 3m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:37:16.509 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (47m) 3m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:37:16.509 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (47m) 2m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:37:16.510 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (47m) 3m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:37:16.510 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (53m) 3m ago 53m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:37:16.510 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (53m) 2m ago 53m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:37:16.510 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (46m) 3m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:37:16.510 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (45m) 3m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:37:16.511 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (45m) 3m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:37:16.511 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (45m) 3m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:37:16.511 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (44m) 2m ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:37:16.511 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (44m) 2m ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:37:16.512 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (43m) 2m ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:37:16.512 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (43m) 2m ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:37:16.512 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (52m) 2m ago 53m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:37:16.512 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 2m ago 51m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:37:16.766 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:37:16.766 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:37:16.766 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:37:16.767 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:37:16.767 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:37:16.767 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:37:16.767 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:37:16.768 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:37:16.768 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:37:16.768 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:37:16.768 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:37:16.768 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:37:16.769 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:37:16.769 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:37:16.769 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:37:17.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:37:16 gibba045 bash[25517]: cluster 2021-03-10T14:37:14.987077+0000 mgr.gibba045.orlgmj (mgr.34412) 2596 : cluster [DBG] pgmap v1465: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:17.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:37:16 gibba045 bash[25517]: audit 2021-03-10T14:37:16.762485+0000 mon.c (mon.1) 770 : audit [DBG] from='client.? 172.21.2.115:0/849275830' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:37:17.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:37:16 gibba015 bash[29377]: cluster 2021-03-10T14:37:14.987077+0000 mgr.gibba045.orlgmj (mgr.34412) 2596 : cluster [DBG] pgmap v1465: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:17.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:37:16 gibba015 bash[29377]: audit 2021-03-10T14:37:16.762485+0000 mon.c (mon.1) 770 : audit [DBG] from='client.? 172.21.2.115:0/849275830' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:37:17.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:37:16 gibba015 bash[30343]: cluster 2021-03-10T14:37:14.987077+0000 mgr.gibba045.orlgmj (mgr.34412) 2596 : cluster [DBG] pgmap v1465: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:17.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:37:16 gibba015 bash[30343]: audit 2021-03-10T14:37:16.762485+0000 mon.c (mon.1) 770 : audit [DBG] from='client.? 172.21.2.115:0/849275830' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:37:18.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:37:17 gibba045 bash[25517]: audit 2021-03-10T14:37:16.272107+0000 mgr.gibba045.orlgmj (mgr.34412) 2597 : audit [DBG] from='client.55786 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:37:18.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:37:17 gibba045 bash[25517]: audit 2021-03-10T14:37:16.495330+0000 mgr.gibba045.orlgmj (mgr.34412) 2598 : audit [DBG] from='client.55792 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:37:18.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:37:17 gibba015 bash[29377]: audit 2021-03-10T14:37:16.272107+0000 mgr.gibba045.orlgmj (mgr.34412) 2597 : audit [DBG] from='client.55786 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:37:18.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:37:17 gibba015 bash[29377]: audit 2021-03-10T14:37:16.495330+0000 mgr.gibba045.orlgmj (mgr.34412) 2598 : audit [DBG] from='client.55792 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:37:18.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:37:17 gibba015 bash[30343]: audit 2021-03-10T14:37:16.272107+0000 mgr.gibba045.orlgmj (mgr.34412) 2597 : audit [DBG] from='client.55786 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:37:18.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:37:17 gibba015 bash[30343]: audit 2021-03-10T14:37:16.495330+0000 mgr.gibba045.orlgmj (mgr.34412) 2598 : audit [DBG] from='client.55792 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:37:19.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:37:18 gibba045 bash[25517]: cluster 2021-03-10T14:37:16.988874+0000 mgr.gibba045.orlgmj (mgr.34412) 2599 : cluster [DBG] pgmap v1466: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:19.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:37:18 gibba015 bash[29377]: cluster 2021-03-10T14:37:16.988874+0000 mgr.gibba045.orlgmj (mgr.34412) 2599 : cluster [DBG] pgmap v1466: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:19.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:37:18 gibba015 bash[30343]: cluster 2021-03-10T14:37:16.988874+0000 mgr.gibba045.orlgmj (mgr.34412) 2599 : cluster [DBG] pgmap v1466: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:21.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:37:20 gibba015 bash[29377]: cluster 2021-03-10T14:37:18.990017+0000 mgr.gibba045.orlgmj (mgr.34412) 2600 : cluster [DBG] pgmap v1467: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:21.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:37:20 gibba015 bash[30343]: cluster 2021-03-10T14:37:18.990017+0000 mgr.gibba045.orlgmj (mgr.34412) 2600 : cluster [DBG] pgmap v1467: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:21.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:37:20 gibba045 bash[25517]: cluster 2021-03-10T14:37:18.990017+0000 mgr.gibba045.orlgmj (mgr.34412) 2600 : cluster [DBG] pgmap v1467: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:23.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:37:22 gibba015 bash[29377]: cluster 2021-03-10T14:37:20.991747+0000 mgr.gibba045.orlgmj (mgr.34412) 2601 : cluster [DBG] pgmap v1468: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:23.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:37:22 gibba015 bash[30343]: cluster 2021-03-10T14:37:20.991747+0000 mgr.gibba045.orlgmj (mgr.34412) 2601 : cluster [DBG] pgmap v1468: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:23.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:37:22 gibba045 bash[25517]: cluster 2021-03-10T14:37:20.991747+0000 mgr.gibba045.orlgmj (mgr.34412) 2601 : cluster [DBG] pgmap v1468: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:25.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:37:24 gibba045 bash[25517]: cluster 2021-03-10T14:37:22.993356+0000 mgr.gibba045.orlgmj (mgr.34412) 2602 : cluster [DBG] pgmap v1469: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:25.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:37:24 gibba015 bash[29377]: cluster 2021-03-10T14:37:22.993356+0000 mgr.gibba045.orlgmj (mgr.34412) 2602 : cluster [DBG] pgmap v1469: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:25.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:37:24 gibba015 bash[30343]: cluster 2021-03-10T14:37:22.993356+0000 mgr.gibba045.orlgmj (mgr.34412) 2602 : cluster [DBG] pgmap v1469: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:26.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:37:25 gibba015 bash[29377]: cephadm 2021-03-10T14:37:24.593384+0000 mgr.gibba045.orlgmj (mgr.34412) 2603 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:37:26.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:37:25 gibba015 bash[30343]: cephadm 2021-03-10T14:37:24.593384+0000 mgr.gibba045.orlgmj (mgr.34412) 2603 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:37:26.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:37:25 gibba045 bash[25517]: cephadm 2021-03-10T14:37:24.593384+0000 mgr.gibba045.orlgmj (mgr.34412) 2603 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:37:27.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:37:26 gibba015 bash[29377]: cluster 2021-03-10T14:37:24.994885+0000 mgr.gibba045.orlgmj (mgr.34412) 2604 : cluster [DBG] pgmap v1470: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:27.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:37:26 gibba015 bash[30343]: cluster 2021-03-10T14:37:24.994885+0000 mgr.gibba045.orlgmj (mgr.34412) 2604 : cluster [DBG] pgmap v1470: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:27.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:37:26 gibba045 bash[25517]: cluster 2021-03-10T14:37:24.994885+0000 mgr.gibba045.orlgmj (mgr.34412) 2604 : cluster [DBG] pgmap v1470: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:29.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:37:28 gibba015 bash[29377]: cluster 2021-03-10T14:37:26.996808+0000 mgr.gibba045.orlgmj (mgr.34412) 2605 : cluster [DBG] pgmap v1471: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:29.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:37:28 gibba015 bash[30343]: cluster 2021-03-10T14:37:26.996808+0000 mgr.gibba045.orlgmj (mgr.34412) 2605 : cluster [DBG] pgmap v1471: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:29.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:37:28 gibba045 bash[25517]: cluster 2021-03-10T14:37:26.996808+0000 mgr.gibba045.orlgmj (mgr.34412) 2605 : cluster [DBG] pgmap v1471: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:31.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:37:30 gibba015 bash[29377]: cluster 2021-03-10T14:37:28.998186+0000 mgr.gibba045.orlgmj (mgr.34412) 2606 : cluster [DBG] pgmap v1472: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:31.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:37:30 gibba015 bash[30343]: cluster 2021-03-10T14:37:28.998186+0000 mgr.gibba045.orlgmj (mgr.34412) 2606 : cluster [DBG] pgmap v1472: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:31.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:37:30 gibba045 bash[25517]: cluster 2021-03-10T14:37:28.998186+0000 mgr.gibba045.orlgmj (mgr.34412) 2606 : cluster [DBG] pgmap v1472: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:33.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:37:32 gibba015 bash[29377]: cluster 2021-03-10T14:37:30.999886+0000 mgr.gibba045.orlgmj (mgr.34412) 2607 : cluster [DBG] pgmap v1473: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:33.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:37:32 gibba015 bash[30343]: cluster 2021-03-10T14:37:30.999886+0000 mgr.gibba045.orlgmj (mgr.34412) 2607 : cluster [DBG] pgmap v1473: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:33.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:37:32 gibba045 bash[25517]: cluster 2021-03-10T14:37:30.999886+0000 mgr.gibba045.orlgmj (mgr.34412) 2607 : cluster [DBG] pgmap v1473: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:34.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:37:33 gibba015 bash[29377]: cluster 2021-03-10T14:37:33.001317+0000 mgr.gibba045.orlgmj (mgr.34412) 2608 : cluster [DBG] pgmap v1474: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:34.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:37:33 gibba015 bash[30343]: cluster 2021-03-10T14:37:33.001317+0000 mgr.gibba045.orlgmj (mgr.34412) 2608 : cluster [DBG] pgmap v1474: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:34.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:37:33 gibba045 bash[25517]: cluster 2021-03-10T14:37:33.001317+0000 mgr.gibba045.orlgmj (mgr.34412) 2608 : cluster [DBG] pgmap v1474: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:36.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:37:36 gibba015 bash[29377]: cluster 2021-03-10T14:37:35.002966+0000 mgr.gibba045.orlgmj (mgr.34412) 2609 : cluster [DBG] pgmap v1475: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:36.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:37:36 gibba015 bash[30343]: cluster 2021-03-10T14:37:35.002966+0000 mgr.gibba045.orlgmj (mgr.34412) 2609 : cluster [DBG] pgmap v1475: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:36.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:37:36 gibba045 bash[25517]: cluster 2021-03-10T14:37:35.002966+0000 mgr.gibba045.orlgmj (mgr.34412) 2609 : cluster [DBG] pgmap v1475: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:39.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:37:38 gibba045 bash[25517]: cluster 2021-03-10T14:37:37.004727+0000 mgr.gibba045.orlgmj (mgr.34412) 2610 : cluster [DBG] pgmap v1476: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:39.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:37:38 gibba015 bash[29377]: cluster 2021-03-10T14:37:37.004727+0000 mgr.gibba045.orlgmj (mgr.34412) 2610 : cluster [DBG] pgmap v1476: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:39.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:37:38 gibba015 bash[30343]: cluster 2021-03-10T14:37:37.004727+0000 mgr.gibba045.orlgmj (mgr.34412) 2610 : cluster [DBG] pgmap v1476: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:41.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:37:40 gibba045 bash[25517]: cluster 2021-03-10T14:37:39.006119+0000 mgr.gibba045.orlgmj (mgr.34412) 2611 : cluster [DBG] pgmap v1477: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:41.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:37:40 gibba045 bash[25517]: cephadm 2021-03-10T14:37:39.606636+0000 mgr.gibba045.orlgmj (mgr.34412) 2612 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:37:41.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:37:40 gibba015 bash[29377]: cluster 2021-03-10T14:37:39.006119+0000 mgr.gibba045.orlgmj (mgr.34412) 2611 : cluster [DBG] pgmap v1477: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:41.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:37:40 gibba015 bash[29377]: cephadm 2021-03-10T14:37:39.606636+0000 mgr.gibba045.orlgmj (mgr.34412) 2612 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:37:41.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:37:40 gibba015 bash[30343]: cluster 2021-03-10T14:37:39.006119+0000 mgr.gibba045.orlgmj (mgr.34412) 2611 : cluster [DBG] pgmap v1477: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:41.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:37:40 gibba015 bash[30343]: cephadm 2021-03-10T14:37:39.606636+0000 mgr.gibba045.orlgmj (mgr.34412) 2612 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:37:43.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:37:42 gibba045 bash[25517]: cluster 2021-03-10T14:37:41.008017+0000 mgr.gibba045.orlgmj (mgr.34412) 2613 : cluster [DBG] pgmap v1478: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:43.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:37:42 gibba015 bash[29377]: cluster 2021-03-10T14:37:41.008017+0000 mgr.gibba045.orlgmj (mgr.34412) 2613 : cluster [DBG] pgmap v1478: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:43.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:37:42 gibba015 bash[30343]: cluster 2021-03-10T14:37:41.008017+0000 mgr.gibba045.orlgmj (mgr.34412) 2613 : cluster [DBG] pgmap v1478: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:45.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:37:44 gibba045 bash[25517]: cluster 2021-03-10T14:37:43.009471+0000 mgr.gibba045.orlgmj (mgr.34412) 2614 : cluster [DBG] pgmap v1479: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:45.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:37:44 gibba015 bash[29377]: cluster 2021-03-10T14:37:43.009471+0000 mgr.gibba045.orlgmj (mgr.34412) 2614 : cluster [DBG] pgmap v1479: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:45.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:37:44 gibba015 bash[30343]: cluster 2021-03-10T14:37:43.009471+0000 mgr.gibba045.orlgmj (mgr.34412) 2614 : cluster [DBG] pgmap v1479: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:47.011 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:37:47.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:37:46 gibba045 bash[25517]: cluster 2021-03-10T14:37:45.011161+0000 mgr.gibba045.orlgmj (mgr.34412) 2615 : cluster [DBG] pgmap v1480: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:47.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:37:46 gibba015 bash[29377]: cluster 2021-03-10T14:37:45.011161+0000 mgr.gibba045.orlgmj (mgr.34412) 2615 : cluster [DBG] pgmap v1480: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:47.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:37:46 gibba015 bash[30343]: cluster 2021-03-10T14:37:45.011161+0000 mgr.gibba045.orlgmj (mgr.34412) 2615 : cluster [DBG] pgmap v1480: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:47.267 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:37:47.268 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (48m) 3m ago 53m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:37:47.268 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (53m) 2m ago 53m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:37:47.268 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (48m) 2m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:37:47.268 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (49m) 2m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:37:47.268 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (48m) 3m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:37:47.269 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (48m) 3m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:37:47.269 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (47m) 2m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:37:47.269 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (47m) 3m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:37:47.269 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (53m) 3m ago 54m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:37:47.270 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (54m) 2m ago 54m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:37:47.270 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (46m) 3m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:37:47.270 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (46m) 3m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:37:47.270 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (45m) 3m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:37:47.270 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (45m) 3m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:37:47.271 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (45m) 2m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:37:47.271 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (44m) 2m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:37:47.271 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (44m) 2m ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:37:47.271 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (43m) 2m ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:37:47.271 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (53m) 2m ago 54m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:37:47.272 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 2m ago 52m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:37:47.521 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:37:47.521 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:37:47.521 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:37:47.522 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:37:47.522 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:37:47.522 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:37:47.522 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:37:47.522 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:37:47.523 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:37:47.523 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:37:47.523 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:37:47.523 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:37:47.524 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:37:47.524 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:37:47.524 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:37:48.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:37:47 gibba015 bash[29377]: audit 2021-03-10T14:37:47.517866+0000 mon.a (mon.0) 947 : audit [DBG] from='client.? 172.21.2.115:0/1248139021' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:37:48.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:37:47 gibba015 bash[30343]: audit 2021-03-10T14:37:47.517866+0000 mon.a (mon.0) 947 : audit [DBG] from='client.? 172.21.2.115:0/1248139021' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:37:48.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:37:47 gibba045 bash[25517]: audit 2021-03-10T14:37:47.517866+0000 mon.a (mon.0) 947 : audit [DBG] from='client.? 172.21.2.115:0/1248139021' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:37:49.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:37:48 gibba015 bash[29377]: audit 2021-03-10T14:37:47.002230+0000 mgr.gibba045.orlgmj (mgr.34412) 2616 : audit [DBG] from='client.55804 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:37:49.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:37:48 gibba015 bash[29377]: cluster 2021-03-10T14:37:47.012867+0000 mgr.gibba045.orlgmj (mgr.34412) 2617 : cluster [DBG] pgmap v1481: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:49.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:37:48 gibba015 bash[29377]: audit 2021-03-10T14:37:47.227234+0000 mgr.gibba045.orlgmj (mgr.34412) 2618 : audit [DBG] from='client.45822 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:37:49.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:37:48 gibba015 bash[30343]: audit 2021-03-10T14:37:47.002230+0000 mgr.gibba045.orlgmj (mgr.34412) 2616 : audit [DBG] from='client.55804 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:37:49.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:37:48 gibba015 bash[30343]: cluster 2021-03-10T14:37:47.012867+0000 mgr.gibba045.orlgmj (mgr.34412) 2617 : cluster [DBG] pgmap v1481: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:49.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:37:48 gibba015 bash[30343]: audit 2021-03-10T14:37:47.227234+0000 mgr.gibba045.orlgmj (mgr.34412) 2618 : audit [DBG] from='client.45822 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:37:49.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:37:48 gibba045 bash[25517]: audit 2021-03-10T14:37:47.002230+0000 mgr.gibba045.orlgmj (mgr.34412) 2616 : audit [DBG] from='client.55804 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:37:49.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:37:48 gibba045 bash[25517]: cluster 2021-03-10T14:37:47.012867+0000 mgr.gibba045.orlgmj (mgr.34412) 2617 : cluster [DBG] pgmap v1481: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:49.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:37:48 gibba045 bash[25517]: audit 2021-03-10T14:37:47.227234+0000 mgr.gibba045.orlgmj (mgr.34412) 2618 : audit [DBG] from='client.45822 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:37:51.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:37:50 gibba015 bash[29377]: cluster 2021-03-10T14:37:49.014099+0000 mgr.gibba045.orlgmj (mgr.34412) 2619 : cluster [DBG] pgmap v1482: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:51.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:37:50 gibba015 bash[30343]: cluster 2021-03-10T14:37:49.014099+0000 mgr.gibba045.orlgmj (mgr.34412) 2619 : cluster [DBG] pgmap v1482: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:51.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:37:50 gibba045 bash[25517]: cluster 2021-03-10T14:37:49.014099+0000 mgr.gibba045.orlgmj (mgr.34412) 2619 : cluster [DBG] pgmap v1482: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:53.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:37:52 gibba015 bash[29377]: cluster 2021-03-10T14:37:51.015879+0000 mgr.gibba045.orlgmj (mgr.34412) 2620 : cluster [DBG] pgmap v1483: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:53.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:37:52 gibba015 bash[29377]: audit 2021-03-10T14:37:52.774245+0000 mon.c (mon.1) 771 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:37:53.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:37:52 gibba015 bash[29377]: audit 2021-03-10T14:37:52.774358+0000 mon.c (mon.1) 772 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:37:53.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:37:52 gibba015 bash[29377]: audit 2021-03-10T14:37:52.774605+0000 mon.a (mon.0) 948 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:37:53.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:37:52 gibba015 bash[29377]: audit 2021-03-10T14:37:52.774737+0000 mon.a (mon.0) 949 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:37:53.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:37:52 gibba015 bash[29377]: audit 2021-03-10T14:37:52.779506+0000 mon.c (mon.1) 773 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T14:37:53.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:37:52 gibba015 bash[29377]: audit 2021-03-10T14:37:52.779648+0000 mon.c (mon.1) 774 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:37:53.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:37:52 gibba015 bash[29377]: audit 2021-03-10T14:37:52.779760+0000 mon.a (mon.0) 950 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T14:37:53.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:37:52 gibba015 bash[29377]: audit 2021-03-10T14:37:52.779772+0000 mon.c (mon.1) 775 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:37:53.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:37:52 gibba015 bash[29377]: audit 2021-03-10T14:37:52.779901+0000 mon.c (mon.1) 776 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:37:53.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:37:52 gibba015 bash[29377]: audit 2021-03-10T14:37:52.780092+0000 mon.a (mon.0) 951 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:37:53.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:37:52 gibba015 bash[29377]: audit 2021-03-10T14:37:52.780300+0000 mon.a (mon.0) 952 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:37:53.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:37:52 gibba015 bash[29377]: audit 2021-03-10T14:37:52.780466+0000 mon.a (mon.0) 953 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:37:53.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:37:52 gibba015 bash[30343]: cluster 2021-03-10T14:37:51.015879+0000 mgr.gibba045.orlgmj (mgr.34412) 2620 : cluster [DBG] pgmap v1483: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:53.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:37:52 gibba015 bash[30343]: audit 2021-03-10T14:37:52.774245+0000 mon.c (mon.1) 771 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:37:53.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:37:52 gibba015 bash[30343]: audit 2021-03-10T14:37:52.774358+0000 mon.c (mon.1) 772 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:37:53.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:37:52 gibba015 bash[30343]: audit 2021-03-10T14:37:52.774605+0000 mon.a (mon.0) 948 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:37:53.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:37:52 gibba015 bash[30343]: audit 2021-03-10T14:37:52.774737+0000 mon.a (mon.0) 949 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:37:53.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:37:52 gibba015 bash[30343]: audit 2021-03-10T14:37:52.779506+0000 mon.c (mon.1) 773 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T14:37:53.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:37:52 gibba015 bash[30343]: audit 2021-03-10T14:37:52.779648+0000 mon.c (mon.1) 774 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:37:53.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:37:52 gibba015 bash[30343]: audit 2021-03-10T14:37:52.779760+0000 mon.a (mon.0) 950 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T14:37:53.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:37:52 gibba015 bash[30343]: audit 2021-03-10T14:37:52.779772+0000 mon.c (mon.1) 775 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:37:53.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:37:52 gibba015 bash[30343]: audit 2021-03-10T14:37:52.779901+0000 mon.c (mon.1) 776 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:37:53.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:37:52 gibba015 bash[30343]: audit 2021-03-10T14:37:52.780092+0000 mon.a (mon.0) 951 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:37:53.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:37:52 gibba015 bash[30343]: audit 2021-03-10T14:37:52.780300+0000 mon.a (mon.0) 952 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:37:53.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:37:52 gibba015 bash[30343]: audit 2021-03-10T14:37:52.780466+0000 mon.a (mon.0) 953 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:37:53.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:37:52 gibba045 bash[25517]: cluster 2021-03-10T14:37:51.015879+0000 mgr.gibba045.orlgmj (mgr.34412) 2620 : cluster [DBG] pgmap v1483: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:53.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:37:52 gibba045 bash[25517]: audit 2021-03-10T14:37:52.774245+0000 mon.c (mon.1) 771 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:37:53.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:37:52 gibba045 bash[25517]: audit 2021-03-10T14:37:52.774358+0000 mon.c (mon.1) 772 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:37:53.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:37:52 gibba045 bash[25517]: audit 2021-03-10T14:37:52.774605+0000 mon.a (mon.0) 948 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:37:53.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:37:52 gibba045 bash[25517]: audit 2021-03-10T14:37:52.774737+0000 mon.a (mon.0) 949 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:37:53.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:37:52 gibba045 bash[25517]: audit 2021-03-10T14:37:52.779506+0000 mon.c (mon.1) 773 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T14:37:53.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:37:52 gibba045 bash[25517]: audit 2021-03-10T14:37:52.779648+0000 mon.c (mon.1) 774 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:37:53.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:37:52 gibba045 bash[25517]: audit 2021-03-10T14:37:52.779760+0000 mon.a (mon.0) 950 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T14:37:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:37:52 gibba045 bash[25517]: audit 2021-03-10T14:37:52.779772+0000 mon.c (mon.1) 775 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:37:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:37:52 gibba045 bash[25517]: audit 2021-03-10T14:37:52.779901+0000 mon.c (mon.1) 776 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:37:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:37:52 gibba045 bash[25517]: audit 2021-03-10T14:37:52.780092+0000 mon.a (mon.0) 951 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:37:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:37:52 gibba045 bash[25517]: audit 2021-03-10T14:37:52.780300+0000 mon.a (mon.0) 952 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:37:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:37:52 gibba045 bash[25517]: audit 2021-03-10T14:37:52.780466+0000 mon.a (mon.0) 953 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:37:55.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:37:54 gibba015 bash[29377]: cluster 2021-03-10T14:37:53.017278+0000 mgr.gibba045.orlgmj (mgr.34412) 2621 : cluster [DBG] pgmap v1484: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:55.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:37:54 gibba015 bash[29377]: audit 2021-03-10T14:37:54.618177+0000 mon.c (mon.1) 777 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:37:55.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:37:54 gibba015 bash[29377]: audit 2021-03-10T14:37:54.810731+0000 mon.a (mon.0) 954 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:37:55.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:37:54 gibba015 bash[29377]: audit 2021-03-10T14:37:54.814632+0000 mon.c (mon.1) 778 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:37:55.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:37:54 gibba015 bash[29377]: audit 2021-03-10T14:37:54.816131+0000 mon.c (mon.1) 779 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:37:55.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:37:54 gibba015 bash[29377]: audit 2021-03-10T14:37:54.817440+0000 mon.c (mon.1) 780 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:37:55.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:37:54 gibba015 bash[29377]: audit 2021-03-10T14:37:54.818775+0000 mon.c (mon.1) 781 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:37:55.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:37:54 gibba015 bash[29377]: audit 2021-03-10T14:37:54.821656+0000 mon.c (mon.1) 782 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:37:55.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:37:54 gibba015 bash[29377]: audit 2021-03-10T14:37:54.823151+0000 mon.c (mon.1) 783 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:37:55.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:37:54 gibba015 bash[30343]: cluster 2021-03-10T14:37:53.017278+0000 mgr.gibba045.orlgmj (mgr.34412) 2621 : cluster [DBG] pgmap v1484: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:55.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:37:54 gibba015 bash[30343]: audit 2021-03-10T14:37:54.618177+0000 mon.c (mon.1) 777 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:37:55.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:37:54 gibba015 bash[30343]: audit 2021-03-10T14:37:54.810731+0000 mon.a (mon.0) 954 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:37:55.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:37:54 gibba015 bash[30343]: audit 2021-03-10T14:37:54.814632+0000 mon.c (mon.1) 778 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:37:55.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:37:54 gibba015 bash[30343]: audit 2021-03-10T14:37:54.816131+0000 mon.c (mon.1) 779 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:37:55.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:37:54 gibba015 bash[30343]: audit 2021-03-10T14:37:54.817440+0000 mon.c (mon.1) 780 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:37:55.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:37:54 gibba015 bash[30343]: audit 2021-03-10T14:37:54.818775+0000 mon.c (mon.1) 781 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:37:55.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:37:54 gibba015 bash[30343]: audit 2021-03-10T14:37:54.821656+0000 mon.c (mon.1) 782 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:37:55.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:37:54 gibba015 bash[30343]: audit 2021-03-10T14:37:54.823151+0000 mon.c (mon.1) 783 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:37:55.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:37:54 gibba045 bash[25517]: cluster 2021-03-10T14:37:53.017278+0000 mgr.gibba045.orlgmj (mgr.34412) 2621 : cluster [DBG] pgmap v1484: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:55.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:37:54 gibba045 bash[25517]: audit 2021-03-10T14:37:54.618177+0000 mon.c (mon.1) 777 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:37:55.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:37:54 gibba045 bash[25517]: audit 2021-03-10T14:37:54.810731+0000 mon.a (mon.0) 954 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:37:55.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:37:54 gibba045 bash[25517]: audit 2021-03-10T14:37:54.814632+0000 mon.c (mon.1) 778 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:37:55.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:37:54 gibba045 bash[25517]: audit 2021-03-10T14:37:54.816131+0000 mon.c (mon.1) 779 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:37:55.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:37:54 gibba045 bash[25517]: audit 2021-03-10T14:37:54.817440+0000 mon.c (mon.1) 780 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:37:55.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:37:54 gibba045 bash[25517]: audit 2021-03-10T14:37:54.818775+0000 mon.c (mon.1) 781 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:37:55.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:37:54 gibba045 bash[25517]: audit 2021-03-10T14:37:54.821656+0000 mon.c (mon.1) 782 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:37:55.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:37:54 gibba045 bash[25517]: audit 2021-03-10T14:37:54.823151+0000 mon.c (mon.1) 783 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:37:56.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:37:55 gibba015 bash[29377]: cephadm 2021-03-10T14:37:54.623532+0000 mgr.gibba045.orlgmj (mgr.34412) 2622 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:37:56.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:37:55 gibba015 bash[29377]: cephadm 2021-03-10T14:37:54.623888+0000 mgr.gibba045.orlgmj (mgr.34412) 2623 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:37:56.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:37:55 gibba015 bash[29377]: cephadm 2021-03-10T14:37:54.817497+0000 mgr.gibba045.orlgmj (mgr.34412) 2624 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:37:56.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:37:55 gibba015 bash[29377]: cephadm 2021-03-10T14:37:54.819489+0000 mgr.gibba045.orlgmj (mgr.34412) 2625 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:37:56.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:37:55 gibba015 bash[29377]: cephadm 2021-03-10T14:37:54.820914+0000 mgr.gibba045.orlgmj (mgr.34412) 2626 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:37:56.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:37:55 gibba015 bash[29377]: cephadm 2021-03-10T14:37:54.820954+0000 mgr.gibba045.orlgmj (mgr.34412) 2627 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:37:56.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:37:55 gibba015 bash[29377]: cephadm 2021-03-10T14:37:54.822196+0000 mgr.gibba045.orlgmj (mgr.34412) 2628 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:37:56.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:37:55 gibba015 bash[29377]: cephadm 2021-03-10T14:37:54.822235+0000 mgr.gibba045.orlgmj (mgr.34412) 2629 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:37:56.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:37:55 gibba015 bash[29377]: cephadm 2021-03-10T14:37:54.823520+0000 mgr.gibba045.orlgmj (mgr.34412) 2630 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:37:56.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:37:55 gibba015 bash[29377]: cephadm 2021-03-10T14:37:54.825094+0000 mgr.gibba045.orlgmj (mgr.34412) 2631 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:37:56.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:37:55 gibba015 bash[29377]: cephadm 2021-03-10T14:37:54.825129+0000 mgr.gibba045.orlgmj (mgr.34412) 2632 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:37:56.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:37:55 gibba015 bash[29377]: cephadm 2021-03-10T14:37:54.826309+0000 mgr.gibba045.orlgmj (mgr.34412) 2633 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:37:56.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:37:55 gibba015 bash[29377]: cephadm 2021-03-10T14:37:54.826621+0000 mgr.gibba045.orlgmj (mgr.34412) 2634 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:37:56.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:37:55 gibba015 bash[29377]: cephadm 2021-03-10T14:37:54.827763+0000 mgr.gibba045.orlgmj (mgr.34412) 2635 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:37:56.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:37:55 gibba015 bash[29377]: cephadm 2021-03-10T14:37:54.827803+0000 mgr.gibba045.orlgmj (mgr.34412) 2636 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:37:56.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:37:55 gibba015 bash[29377]: cephadm 2021-03-10T14:37:54.827909+0000 mgr.gibba045.orlgmj (mgr.34412) 2637 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:37:56.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:37:55 gibba015 bash[30343]: cephadm 2021-03-10T14:37:54.623532+0000 mgr.gibba045.orlgmj (mgr.34412) 2622 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:37:56.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:37:55 gibba015 bash[30343]: cephadm 2021-03-10T14:37:54.623888+0000 mgr.gibba045.orlgmj (mgr.34412) 2623 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:37:56.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:37:55 gibba015 bash[30343]: cephadm 2021-03-10T14:37:54.817497+0000 mgr.gibba045.orlgmj (mgr.34412) 2624 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:37:56.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:37:55 gibba015 bash[30343]: cephadm 2021-03-10T14:37:54.819489+0000 mgr.gibba045.orlgmj (mgr.34412) 2625 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:37:56.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:37:55 gibba015 bash[30343]: cephadm 2021-03-10T14:37:54.820914+0000 mgr.gibba045.orlgmj (mgr.34412) 2626 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:37:56.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:37:55 gibba015 bash[30343]: cephadm 2021-03-10T14:37:54.820954+0000 mgr.gibba045.orlgmj (mgr.34412) 2627 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:37:56.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:37:55 gibba015 bash[30343]: cephadm 2021-03-10T14:37:54.822196+0000 mgr.gibba045.orlgmj (mgr.34412) 2628 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:37:56.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:37:55 gibba015 bash[30343]: cephadm 2021-03-10T14:37:54.822235+0000 mgr.gibba045.orlgmj (mgr.34412) 2629 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:37:56.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:37:55 gibba015 bash[30343]: cephadm 2021-03-10T14:37:54.823520+0000 mgr.gibba045.orlgmj (mgr.34412) 2630 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:37:56.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:37:55 gibba015 bash[30343]: cephadm 2021-03-10T14:37:54.825094+0000 mgr.gibba045.orlgmj (mgr.34412) 2631 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:37:56.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:37:55 gibba015 bash[30343]: cephadm 2021-03-10T14:37:54.825129+0000 mgr.gibba045.orlgmj (mgr.34412) 2632 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:37:56.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:37:55 gibba015 bash[30343]: cephadm 2021-03-10T14:37:54.826309+0000 mgr.gibba045.orlgmj (mgr.34412) 2633 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:37:56.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:37:55 gibba015 bash[30343]: cephadm 2021-03-10T14:37:54.826621+0000 mgr.gibba045.orlgmj (mgr.34412) 2634 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:37:56.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:37:55 gibba015 bash[30343]: cephadm 2021-03-10T14:37:54.827763+0000 mgr.gibba045.orlgmj (mgr.34412) 2635 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:37:56.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:37:55 gibba015 bash[30343]: cephadm 2021-03-10T14:37:54.827803+0000 mgr.gibba045.orlgmj (mgr.34412) 2636 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:37:56.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:37:55 gibba015 bash[30343]: cephadm 2021-03-10T14:37:54.827909+0000 mgr.gibba045.orlgmj (mgr.34412) 2637 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:37:56.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:37:55 gibba045 bash[25517]: cephadm 2021-03-10T14:37:54.623532+0000 mgr.gibba045.orlgmj (mgr.34412) 2622 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:37:56.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:37:55 gibba045 bash[25517]: cephadm 2021-03-10T14:37:54.623888+0000 mgr.gibba045.orlgmj (mgr.34412) 2623 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:37:56.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:37:55 gibba045 bash[25517]: cephadm 2021-03-10T14:37:54.817497+0000 mgr.gibba045.orlgmj (mgr.34412) 2624 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:37:56.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:37:55 gibba045 bash[25517]: cephadm 2021-03-10T14:37:54.819489+0000 mgr.gibba045.orlgmj (mgr.34412) 2625 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:37:56.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:37:55 gibba045 bash[25517]: cephadm 2021-03-10T14:37:54.820914+0000 mgr.gibba045.orlgmj (mgr.34412) 2626 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:37:56.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:37:55 gibba045 bash[25517]: cephadm 2021-03-10T14:37:54.820954+0000 mgr.gibba045.orlgmj (mgr.34412) 2627 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:37:56.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:37:55 gibba045 bash[25517]: cephadm 2021-03-10T14:37:54.822196+0000 mgr.gibba045.orlgmj (mgr.34412) 2628 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:37:56.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:37:55 gibba045 bash[25517]: cephadm 2021-03-10T14:37:54.822235+0000 mgr.gibba045.orlgmj (mgr.34412) 2629 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:37:56.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:37:55 gibba045 bash[25517]: cephadm 2021-03-10T14:37:54.823520+0000 mgr.gibba045.orlgmj (mgr.34412) 2630 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:37:56.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:37:55 gibba045 bash[25517]: cephadm 2021-03-10T14:37:54.825094+0000 mgr.gibba045.orlgmj (mgr.34412) 2631 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:37:56.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:37:55 gibba045 bash[25517]: cephadm 2021-03-10T14:37:54.825129+0000 mgr.gibba045.orlgmj (mgr.34412) 2632 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:37:56.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:37:55 gibba045 bash[25517]: cephadm 2021-03-10T14:37:54.826309+0000 mgr.gibba045.orlgmj (mgr.34412) 2633 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:37:56.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:37:55 gibba045 bash[25517]: cephadm 2021-03-10T14:37:54.826621+0000 mgr.gibba045.orlgmj (mgr.34412) 2634 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:37:56.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:37:55 gibba045 bash[25517]: cephadm 2021-03-10T14:37:54.827763+0000 mgr.gibba045.orlgmj (mgr.34412) 2635 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:37:56.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:37:55 gibba045 bash[25517]: cephadm 2021-03-10T14:37:54.827803+0000 mgr.gibba045.orlgmj (mgr.34412) 2636 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:37:56.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:37:55 gibba045 bash[25517]: cephadm 2021-03-10T14:37:54.827909+0000 mgr.gibba045.orlgmj (mgr.34412) 2637 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:37:57.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:37:56 gibba015 bash[29377]: cluster 2021-03-10T14:37:55.018786+0000 mgr.gibba045.orlgmj (mgr.34412) 2638 : cluster [DBG] pgmap v1485: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:57.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:37:56 gibba015 bash[30343]: cluster 2021-03-10T14:37:55.018786+0000 mgr.gibba045.orlgmj (mgr.34412) 2638 : cluster [DBG] pgmap v1485: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:57.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:37:56 gibba045 bash[25517]: cluster 2021-03-10T14:37:55.018786+0000 mgr.gibba045.orlgmj (mgr.34412) 2638 : cluster [DBG] pgmap v1485: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:59.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:37:58 gibba015 bash[29377]: cluster 2021-03-10T14:37:57.020673+0000 mgr.gibba045.orlgmj (mgr.34412) 2639 : cluster [DBG] pgmap v1486: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:59.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:37:58 gibba015 bash[30343]: cluster 2021-03-10T14:37:57.020673+0000 mgr.gibba045.orlgmj (mgr.34412) 2639 : cluster [DBG] pgmap v1486: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:59.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:37:58 gibba045 bash[25517]: cluster 2021-03-10T14:37:57.020673+0000 mgr.gibba045.orlgmj (mgr.34412) 2639 : cluster [DBG] pgmap v1486: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:01.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:38:00 gibba015 bash[29377]: cluster 2021-03-10T14:37:59.021870+0000 mgr.gibba045.orlgmj (mgr.34412) 2640 : cluster [DBG] pgmap v1487: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:01.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:38:00 gibba015 bash[30343]: cluster 2021-03-10T14:37:59.021870+0000 mgr.gibba045.orlgmj (mgr.34412) 2640 : cluster [DBG] pgmap v1487: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:01.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:38:00 gibba045 bash[25517]: cluster 2021-03-10T14:37:59.021870+0000 mgr.gibba045.orlgmj (mgr.34412) 2640 : cluster [DBG] pgmap v1487: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:03.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:38:02 gibba015 bash[29377]: cluster 2021-03-10T14:38:01.023465+0000 mgr.gibba045.orlgmj (mgr.34412) 2641 : cluster [DBG] pgmap v1488: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:03.279 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:38:02 gibba015 bash[30343]: cluster 2021-03-10T14:38:01.023465+0000 mgr.gibba045.orlgmj (mgr.34412) 2641 : cluster [DBG] pgmap v1488: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:03.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:38:02 gibba045 bash[25517]: cluster 2021-03-10T14:38:01.023465+0000 mgr.gibba045.orlgmj (mgr.34412) 2641 : cluster [DBG] pgmap v1488: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:04.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:38:03 gibba015 bash[29377]: cluster 2021-03-10T14:38:03.025026+0000 mgr.gibba045.orlgmj (mgr.34412) 2642 : cluster [DBG] pgmap v1489: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:04.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:38:03 gibba015 bash[30343]: cluster 2021-03-10T14:38:03.025026+0000 mgr.gibba045.orlgmj (mgr.34412) 2642 : cluster [DBG] pgmap v1489: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:04.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:38:03 gibba045 bash[25517]: cluster 2021-03-10T14:38:03.025026+0000 mgr.gibba045.orlgmj (mgr.34412) 2642 : cluster [DBG] pgmap v1489: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:06.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:38:06 gibba015 bash[29377]: cluster 2021-03-10T14:38:05.026671+0000 mgr.gibba045.orlgmj (mgr.34412) 2643 : cluster [DBG] pgmap v1490: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:06.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:38:06 gibba015 bash[30343]: cluster 2021-03-10T14:38:05.026671+0000 mgr.gibba045.orlgmj (mgr.34412) 2643 : cluster [DBG] pgmap v1490: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:06.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:38:06 gibba045 bash[25517]: cluster 2021-03-10T14:38:05.026671+0000 mgr.gibba045.orlgmj (mgr.34412) 2643 : cluster [DBG] pgmap v1490: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:09.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:38:08 gibba045 bash[25517]: cluster 2021-03-10T14:38:07.028471+0000 mgr.gibba045.orlgmj (mgr.34412) 2644 : cluster [DBG] pgmap v1491: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:09.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:38:08 gibba015 bash[29377]: cluster 2021-03-10T14:38:07.028471+0000 mgr.gibba045.orlgmj (mgr.34412) 2644 : cluster [DBG] pgmap v1491: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:09.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:38:08 gibba015 bash[30343]: cluster 2021-03-10T14:38:07.028471+0000 mgr.gibba045.orlgmj (mgr.34412) 2644 : cluster [DBG] pgmap v1491: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:11.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:38:10 gibba045 bash[25517]: cluster 2021-03-10T14:38:09.029695+0000 mgr.gibba045.orlgmj (mgr.34412) 2645 : cluster [DBG] pgmap v1492: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:11.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:38:10 gibba045 bash[25517]: cephadm 2021-03-10T14:38:09.843554+0000 mgr.gibba045.orlgmj (mgr.34412) 2646 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:38:11.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:38:10 gibba015 bash[29377]: cluster 2021-03-10T14:38:09.029695+0000 mgr.gibba045.orlgmj (mgr.34412) 2645 : cluster [DBG] pgmap v1492: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:11.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:38:10 gibba015 bash[29377]: cephadm 2021-03-10T14:38:09.843554+0000 mgr.gibba045.orlgmj (mgr.34412) 2646 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:38:11.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:38:10 gibba015 bash[30343]: cluster 2021-03-10T14:38:09.029695+0000 mgr.gibba045.orlgmj (mgr.34412) 2645 : cluster [DBG] pgmap v1492: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:11.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:38:10 gibba015 bash[30343]: cephadm 2021-03-10T14:38:09.843554+0000 mgr.gibba045.orlgmj (mgr.34412) 2646 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:38:13.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:38:12 gibba045 bash[25517]: cluster 2021-03-10T14:38:11.031428+0000 mgr.gibba045.orlgmj (mgr.34412) 2647 : cluster [DBG] pgmap v1493: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:13.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:38:12 gibba015 bash[29377]: cluster 2021-03-10T14:38:11.031428+0000 mgr.gibba045.orlgmj (mgr.34412) 2647 : cluster [DBG] pgmap v1493: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:13.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:38:12 gibba015 bash[30343]: cluster 2021-03-10T14:38:11.031428+0000 mgr.gibba045.orlgmj (mgr.34412) 2647 : cluster [DBG] pgmap v1493: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:15.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:38:14 gibba015 bash[29377]: cluster 2021-03-10T14:38:13.033095+0000 mgr.gibba045.orlgmj (mgr.34412) 2648 : cluster [DBG] pgmap v1494: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:15.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:38:14 gibba015 bash[30343]: cluster 2021-03-10T14:38:13.033095+0000 mgr.gibba045.orlgmj (mgr.34412) 2648 : cluster [DBG] pgmap v1494: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:15.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:38:14 gibba045 bash[25517]: cluster 2021-03-10T14:38:13.033095+0000 mgr.gibba045.orlgmj (mgr.34412) 2648 : cluster [DBG] pgmap v1494: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:17.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:38:16 gibba015 bash[29377]: cluster 2021-03-10T14:38:15.034810+0000 mgr.gibba045.orlgmj (mgr.34412) 2649 : cluster [DBG] pgmap v1495: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:17.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:38:16 gibba015 bash[30343]: cluster 2021-03-10T14:38:15.034810+0000 mgr.gibba045.orlgmj (mgr.34412) 2649 : cluster [DBG] pgmap v1495: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:17.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:38:16 gibba045 bash[25517]: cluster 2021-03-10T14:38:15.034810+0000 mgr.gibba045.orlgmj (mgr.34412) 2649 : cluster [DBG] pgmap v1495: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:17.768 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:38:17.999 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:38:18.000 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (49m) 4m ago 54m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:38:18.000 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (54m) 3m ago 54m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:38:18.000 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (49m) 3m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:38:18.000 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (49m) 3m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:38:18.001 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (48m) 4m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:38:18.001 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (48m) 4m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:38:18.001 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (48m) 3m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:38:18.001 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (48m) 4m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:38:18.001 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (54m) 4m ago 54m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:38:18.002 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (54m) 3m ago 54m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:38:18.002 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (47m) 4m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:38:18.002 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (46m) 4m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:38:18.002 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (46m) 4m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:38:18.003 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (46m) 4m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:38:18.003 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (45m) 3m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:38:18.003 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (45m) 3m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:38:18.003 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (44m) 3m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:38:18.003 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (44m) 3m ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:38:18.004 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (53m) 3m ago 54m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:38:18.004 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 3m ago 52m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:38:18.249 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:38:18.250 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:38:18.250 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:38:18.250 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:38:18.250 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:38:18.251 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:38:18.251 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:38:18.251 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:38:18.251 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:38:18.251 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:38:18.252 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:38:18.252 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:38:18.252 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:38:18.252 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:38:18.252 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:38:19.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:38:18 gibba015 bash[29377]: cluster 2021-03-10T14:38:17.036593+0000 mgr.gibba045.orlgmj (mgr.34412) 2650 : cluster [DBG] pgmap v1496: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:19.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:38:18 gibba015 bash[29377]: audit 2021-03-10T14:38:17.759459+0000 mgr.gibba045.orlgmj (mgr.34412) 2651 : audit [DBG] from='client.55822 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:38:19.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:38:18 gibba015 bash[29377]: audit 2021-03-10T14:38:18.246072+0000 mon.c (mon.1) 784 : audit [DBG] from='client.? 172.21.2.115:0/3697031393' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:38:19.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:38:18 gibba015 bash[30343]: cluster 2021-03-10T14:38:17.036593+0000 mgr.gibba045.orlgmj (mgr.34412) 2650 : cluster [DBG] pgmap v1496: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:19.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:38:18 gibba015 bash[30343]: audit 2021-03-10T14:38:17.759459+0000 mgr.gibba045.orlgmj (mgr.34412) 2651 : audit [DBG] from='client.55822 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:38:19.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:38:18 gibba015 bash[30343]: audit 2021-03-10T14:38:18.246072+0000 mon.c (mon.1) 784 : audit [DBG] from='client.? 172.21.2.115:0/3697031393' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:38:19.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:38:18 gibba045 bash[25517]: cluster 2021-03-10T14:38:17.036593+0000 mgr.gibba045.orlgmj (mgr.34412) 2650 : cluster [DBG] pgmap v1496: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:19.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:38:18 gibba045 bash[25517]: audit 2021-03-10T14:38:17.759459+0000 mgr.gibba045.orlgmj (mgr.34412) 2651 : audit [DBG] from='client.55822 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:38:19.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:38:18 gibba045 bash[25517]: audit 2021-03-10T14:38:18.246072+0000 mon.c (mon.1) 784 : audit [DBG] from='client.? 172.21.2.115:0/3697031393' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:38:20.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:38:19 gibba015 bash[29377]: audit 2021-03-10T14:38:17.987649+0000 mgr.gibba045.orlgmj (mgr.34412) 2652 : audit [DBG] from='client.55828 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:38:20.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:38:19 gibba015 bash[30343]: audit 2021-03-10T14:38:17.987649+0000 mgr.gibba045.orlgmj (mgr.34412) 2652 : audit [DBG] from='client.55828 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:38:20.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:38:19 gibba045 bash[25517]: audit 2021-03-10T14:38:17.987649+0000 mgr.gibba045.orlgmj (mgr.34412) 2652 : audit [DBG] from='client.55828 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:38:21.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:38:20 gibba015 bash[29377]: cluster 2021-03-10T14:38:19.037796+0000 mgr.gibba045.orlgmj (mgr.34412) 2653 : cluster [DBG] pgmap v1497: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:21.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:38:20 gibba015 bash[30343]: cluster 2021-03-10T14:38:19.037796+0000 mgr.gibba045.orlgmj (mgr.34412) 2653 : cluster [DBG] pgmap v1497: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:21.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:38:20 gibba045 bash[25517]: cluster 2021-03-10T14:38:19.037796+0000 mgr.gibba045.orlgmj (mgr.34412) 2653 : cluster [DBG] pgmap v1497: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:23.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:38:22 gibba015 bash[29377]: cluster 2021-03-10T14:38:21.039540+0000 mgr.gibba045.orlgmj (mgr.34412) 2654 : cluster [DBG] pgmap v1498: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:23.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:38:22 gibba015 bash[30343]: cluster 2021-03-10T14:38:21.039540+0000 mgr.gibba045.orlgmj (mgr.34412) 2654 : cluster [DBG] pgmap v1498: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:23.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:38:22 gibba045 bash[25517]: cluster 2021-03-10T14:38:21.039540+0000 mgr.gibba045.orlgmj (mgr.34412) 2654 : cluster [DBG] pgmap v1498: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:25.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:38:24 gibba015 bash[29377]: cluster 2021-03-10T14:38:23.041234+0000 mgr.gibba045.orlgmj (mgr.34412) 2655 : cluster [DBG] pgmap v1499: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:25.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:38:24 gibba015 bash[30343]: cluster 2021-03-10T14:38:23.041234+0000 mgr.gibba045.orlgmj (mgr.34412) 2655 : cluster [DBG] pgmap v1499: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:25.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:38:24 gibba045 bash[25517]: cluster 2021-03-10T14:38:23.041234+0000 mgr.gibba045.orlgmj (mgr.34412) 2655 : cluster [DBG] pgmap v1499: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:26.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:38:25 gibba015 bash[29377]: cephadm 2021-03-10T14:38:24.847055+0000 mgr.gibba045.orlgmj (mgr.34412) 2656 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:38:26.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:38:25 gibba015 bash[30343]: cephadm 2021-03-10T14:38:24.847055+0000 mgr.gibba045.orlgmj (mgr.34412) 2656 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:38:26.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:38:25 gibba045 bash[25517]: cephadm 2021-03-10T14:38:24.847055+0000 mgr.gibba045.orlgmj (mgr.34412) 2656 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:38:27.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:38:26 gibba015 bash[29377]: cluster 2021-03-10T14:38:25.042901+0000 mgr.gibba045.orlgmj (mgr.34412) 2657 : cluster [DBG] pgmap v1500: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:27.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:38:26 gibba015 bash[30343]: cluster 2021-03-10T14:38:25.042901+0000 mgr.gibba045.orlgmj (mgr.34412) 2657 : cluster [DBG] pgmap v1500: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:27.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:38:26 gibba045 bash[25517]: cluster 2021-03-10T14:38:25.042901+0000 mgr.gibba045.orlgmj (mgr.34412) 2657 : cluster [DBG] pgmap v1500: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:29.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:38:28 gibba015 bash[29377]: cluster 2021-03-10T14:38:27.044608+0000 mgr.gibba045.orlgmj (mgr.34412) 2658 : cluster [DBG] pgmap v1501: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:29.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:38:28 gibba015 bash[30343]: cluster 2021-03-10T14:38:27.044608+0000 mgr.gibba045.orlgmj (mgr.34412) 2658 : cluster [DBG] pgmap v1501: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:29.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:38:28 gibba045 bash[25517]: cluster 2021-03-10T14:38:27.044608+0000 mgr.gibba045.orlgmj (mgr.34412) 2658 : cluster [DBG] pgmap v1501: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:30.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:38:29 gibba015 bash[29377]: cluster 2021-03-10T14:38:29.045813+0000 mgr.gibba045.orlgmj (mgr.34412) 2659 : cluster [DBG] pgmap v1502: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:30.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:38:29 gibba015 bash[30343]: cluster 2021-03-10T14:38:29.045813+0000 mgr.gibba045.orlgmj (mgr.34412) 2659 : cluster [DBG] pgmap v1502: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:30.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:38:29 gibba045 bash[25517]: cluster 2021-03-10T14:38:29.045813+0000 mgr.gibba045.orlgmj (mgr.34412) 2659 : cluster [DBG] pgmap v1502: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:32.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:38:32 gibba015 bash[29377]: cluster 2021-03-10T14:38:31.047598+0000 mgr.gibba045.orlgmj (mgr.34412) 2660 : cluster [DBG] pgmap v1503: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:32.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:38:32 gibba015 bash[30343]: cluster 2021-03-10T14:38:31.047598+0000 mgr.gibba045.orlgmj (mgr.34412) 2660 : cluster [DBG] pgmap v1503: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:32.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:38:32 gibba045 bash[25517]: cluster 2021-03-10T14:38:31.047598+0000 mgr.gibba045.orlgmj (mgr.34412) 2660 : cluster [DBG] pgmap v1503: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:35.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:38:34 gibba045 bash[25517]: cluster 2021-03-10T14:38:33.049242+0000 mgr.gibba045.orlgmj (mgr.34412) 2661 : cluster [DBG] pgmap v1504: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:35.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:38:34 gibba015 bash[29377]: cluster 2021-03-10T14:38:33.049242+0000 mgr.gibba045.orlgmj (mgr.34412) 2661 : cluster [DBG] pgmap v1504: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:35.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:38:34 gibba015 bash[30343]: cluster 2021-03-10T14:38:33.049242+0000 mgr.gibba045.orlgmj (mgr.34412) 2661 : cluster [DBG] pgmap v1504: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:37.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:38:36 gibba015 bash[29377]: cluster 2021-03-10T14:38:35.050666+0000 mgr.gibba045.orlgmj (mgr.34412) 2662 : cluster [DBG] pgmap v1505: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:37.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:38:36 gibba015 bash[30343]: cluster 2021-03-10T14:38:35.050666+0000 mgr.gibba045.orlgmj (mgr.34412) 2662 : cluster [DBG] pgmap v1505: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:37.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:38:36 gibba045 bash[25517]: cluster 2021-03-10T14:38:35.050666+0000 mgr.gibba045.orlgmj (mgr.34412) 2662 : cluster [DBG] pgmap v1505: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:39.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:38:38 gibba015 bash[29377]: cluster 2021-03-10T14:38:37.052164+0000 mgr.gibba045.orlgmj (mgr.34412) 2663 : cluster [DBG] pgmap v1506: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:39.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:38:38 gibba015 bash[30343]: cluster 2021-03-10T14:38:37.052164+0000 mgr.gibba045.orlgmj (mgr.34412) 2663 : cluster [DBG] pgmap v1506: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:39.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:38:38 gibba045 bash[25517]: cluster 2021-03-10T14:38:37.052164+0000 mgr.gibba045.orlgmj (mgr.34412) 2663 : cluster [DBG] pgmap v1506: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:41.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:38:40 gibba015 bash[29377]: cluster 2021-03-10T14:38:39.053414+0000 mgr.gibba045.orlgmj (mgr.34412) 2664 : cluster [DBG] pgmap v1507: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:41.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:38:40 gibba015 bash[29377]: cephadm 2021-03-10T14:38:39.862559+0000 mgr.gibba045.orlgmj (mgr.34412) 2665 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:38:41.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:38:40 gibba015 bash[30343]: cluster 2021-03-10T14:38:39.053414+0000 mgr.gibba045.orlgmj (mgr.34412) 2664 : cluster [DBG] pgmap v1507: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:41.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:38:40 gibba015 bash[30343]: cephadm 2021-03-10T14:38:39.862559+0000 mgr.gibba045.orlgmj (mgr.34412) 2665 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:38:41.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:38:40 gibba045 bash[25517]: cluster 2021-03-10T14:38:39.053414+0000 mgr.gibba045.orlgmj (mgr.34412) 2664 : cluster [DBG] pgmap v1507: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:41.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:38:40 gibba045 bash[25517]: cephadm 2021-03-10T14:38:39.862559+0000 mgr.gibba045.orlgmj (mgr.34412) 2665 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:38:43.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:38:42 gibba015 bash[29377]: cluster 2021-03-10T14:38:41.055199+0000 mgr.gibba045.orlgmj (mgr.34412) 2666 : cluster [DBG] pgmap v1508: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:43.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:38:42 gibba015 bash[30343]: cluster 2021-03-10T14:38:41.055199+0000 mgr.gibba045.orlgmj (mgr.34412) 2666 : cluster [DBG] pgmap v1508: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:43.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:38:42 gibba045 bash[25517]: cluster 2021-03-10T14:38:41.055199+0000 mgr.gibba045.orlgmj (mgr.34412) 2666 : cluster [DBG] pgmap v1508: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:45.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:38:44 gibba015 bash[29377]: cluster 2021-03-10T14:38:43.056691+0000 mgr.gibba045.orlgmj (mgr.34412) 2667 : cluster [DBG] pgmap v1509: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:45.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:38:44 gibba015 bash[30343]: cluster 2021-03-10T14:38:43.056691+0000 mgr.gibba045.orlgmj (mgr.34412) 2667 : cluster [DBG] pgmap v1509: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:45.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:38:44 gibba045 bash[25517]: cluster 2021-03-10T14:38:43.056691+0000 mgr.gibba045.orlgmj (mgr.34412) 2667 : cluster [DBG] pgmap v1509: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:47.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:38:46 gibba015 bash[29377]: cluster 2021-03-10T14:38:45.058371+0000 mgr.gibba045.orlgmj (mgr.34412) 2668 : cluster [DBG] pgmap v1510: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:47.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:38:46 gibba015 bash[30343]: cluster 2021-03-10T14:38:45.058371+0000 mgr.gibba045.orlgmj (mgr.34412) 2668 : cluster [DBG] pgmap v1510: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:47.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:38:46 gibba045 bash[25517]: cluster 2021-03-10T14:38:45.058371+0000 mgr.gibba045.orlgmj (mgr.34412) 2668 : cluster [DBG] pgmap v1510: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:48.491 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:38:48.720 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:38:48.721 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (49m) 4m ago 54m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:38:48.721 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (54m) 3m ago 54m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:38:48.721 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (49m) 3m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:38:48.721 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (50m) 3m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:38:48.722 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (49m) 4m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:38:48.722 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (49m) 4m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:38:48.722 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (48m) 3m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:38:48.722 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (48m) 4m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:38:48.722 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (55m) 4m ago 55m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:38:48.723 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (55m) 3m ago 55m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:38:48.723 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (47m) 4m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:38:48.723 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (47m) 4m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:38:48.723 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (46m) 4m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:38:48.723 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (46m) 4m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:38:48.724 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (46m) 3m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:38:48.724 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (45m) 3m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:38:48.724 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (45m) 3m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:38:48.724 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (44m) 3m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:38:48.725 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (54m) 3m ago 55m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:38:48.725 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 3m ago 53m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:38:48.972 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:38:48.972 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:38:48.972 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:38:48.972 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:38:48.973 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:38:48.973 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:38:48.973 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:38:48.973 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:38:48.974 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:38:48.974 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:38:48.974 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:38:48.974 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:38:48.974 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:38:48.975 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:38:48.975 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:38:49.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:38:48 gibba015 bash[29377]: cluster 2021-03-10T14:38:47.060086+0000 mgr.gibba045.orlgmj (mgr.34412) 2669 : cluster [DBG] pgmap v1511: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:49.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:38:48 gibba015 bash[30343]: cluster 2021-03-10T14:38:47.060086+0000 mgr.gibba045.orlgmj (mgr.34412) 2669 : cluster [DBG] pgmap v1511: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:49.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:38:48 gibba045 bash[25517]: cluster 2021-03-10T14:38:47.060086+0000 mgr.gibba045.orlgmj (mgr.34412) 2669 : cluster [DBG] pgmap v1511: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:50.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:38:49 gibba015 bash[29377]: audit 2021-03-10T14:38:48.482728+0000 mgr.gibba045.orlgmj (mgr.34412) 2670 : audit [DBG] from='client.45852 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:38:50.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:38:49 gibba015 bash[29377]: audit 2021-03-10T14:38:48.708223+0000 mgr.gibba045.orlgmj (mgr.34412) 2671 : audit [DBG] from='client.55846 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:38:50.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:38:49 gibba015 bash[29377]: audit 2021-03-10T14:38:48.968480+0000 mon.a (mon.0) 955 : audit [DBG] from='client.? 172.21.2.115:0/2494582977' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:38:50.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:38:49 gibba015 bash[30343]: audit 2021-03-10T14:38:48.482728+0000 mgr.gibba045.orlgmj (mgr.34412) 2670 : audit [DBG] from='client.45852 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:38:50.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:38:49 gibba015 bash[30343]: audit 2021-03-10T14:38:48.708223+0000 mgr.gibba045.orlgmj (mgr.34412) 2671 : audit [DBG] from='client.55846 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:38:50.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:38:49 gibba015 bash[30343]: audit 2021-03-10T14:38:48.968480+0000 mon.a (mon.0) 955 : audit [DBG] from='client.? 172.21.2.115:0/2494582977' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:38:50.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:38:49 gibba045 bash[25517]: audit 2021-03-10T14:38:48.482728+0000 mgr.gibba045.orlgmj (mgr.34412) 2670 : audit [DBG] from='client.45852 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:38:50.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:38:49 gibba045 bash[25517]: audit 2021-03-10T14:38:48.708223+0000 mgr.gibba045.orlgmj (mgr.34412) 2671 : audit [DBG] from='client.55846 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:38:50.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:38:49 gibba045 bash[25517]: audit 2021-03-10T14:38:48.968480+0000 mon.a (mon.0) 955 : audit [DBG] from='client.? 172.21.2.115:0/2494582977' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:38:51.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:38:50 gibba015 bash[30343]: cluster 2021-03-10T14:38:49.061382+0000 mgr.gibba045.orlgmj (mgr.34412) 2672 : cluster [DBG] pgmap v1512: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:51.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:38:50 gibba015 bash[29377]: cluster 2021-03-10T14:38:49.061382+0000 mgr.gibba045.orlgmj (mgr.34412) 2672 : cluster [DBG] pgmap v1512: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:51.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:38:50 gibba045 bash[25517]: cluster 2021-03-10T14:38:49.061382+0000 mgr.gibba045.orlgmj (mgr.34412) 2672 : cluster [DBG] pgmap v1512: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:53.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:38:52 gibba015 bash[29377]: cluster 2021-03-10T14:38:51.063012+0000 mgr.gibba045.orlgmj (mgr.34412) 2673 : cluster [DBG] pgmap v1513: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:53.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:38:52 gibba015 bash[29377]: audit 2021-03-10T14:38:52.782353+0000 mon.c (mon.1) 785 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:38:53.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:38:52 gibba015 bash[29377]: audit 2021-03-10T14:38:52.783003+0000 mon.c (mon.1) 786 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:38:53.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:38:52 gibba015 bash[29377]: audit 2021-03-10T14:38:52.783469+0000 mon.a (mon.0) 956 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:38:53.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:38:52 gibba015 bash[29377]: audit 2021-03-10T14:38:52.783599+0000 mon.c (mon.1) 787 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T14:38:53.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:38:52 gibba015 bash[29377]: audit 2021-03-10T14:38:52.784395+0000 mon.c (mon.1) 788 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:38:53.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:38:52 gibba015 bash[29377]: audit 2021-03-10T14:38:52.784645+0000 mon.a (mon.0) 957 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:38:53.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:38:52 gibba015 bash[29377]: audit 2021-03-10T14:38:52.785047+0000 mon.c (mon.1) 789 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:38:53.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:38:52 gibba015 bash[29377]: audit 2021-03-10T14:38:52.785790+0000 mon.a (mon.0) 958 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T14:38:53.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:38:52 gibba015 bash[29377]: audit 2021-03-10T14:38:52.786192+0000 mon.c (mon.1) 790 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:38:53.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:38:52 gibba015 bash[29377]: audit 2021-03-10T14:38:52.786874+0000 mon.a (mon.0) 959 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:38:53.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:38:52 gibba015 bash[29377]: audit 2021-03-10T14:38:52.787857+0000 mon.a (mon.0) 960 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:38:53.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:38:52 gibba015 bash[29377]: audit 2021-03-10T14:38:52.794952+0000 mon.a (mon.0) 961 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:38:53.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:38:52 gibba015 bash[30343]: cluster 2021-03-10T14:38:51.063012+0000 mgr.gibba045.orlgmj (mgr.34412) 2673 : cluster [DBG] pgmap v1513: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:53.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:38:52 gibba015 bash[30343]: audit 2021-03-10T14:38:52.782353+0000 mon.c (mon.1) 785 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:38:53.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:38:52 gibba015 bash[30343]: audit 2021-03-10T14:38:52.783003+0000 mon.c (mon.1) 786 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:38:53.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:38:52 gibba015 bash[30343]: audit 2021-03-10T14:38:52.783469+0000 mon.a (mon.0) 956 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:38:53.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:38:52 gibba015 bash[30343]: audit 2021-03-10T14:38:52.783599+0000 mon.c (mon.1) 787 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T14:38:53.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:38:52 gibba015 bash[30343]: audit 2021-03-10T14:38:52.784395+0000 mon.c (mon.1) 788 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:38:53.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:38:52 gibba015 bash[30343]: audit 2021-03-10T14:38:52.784645+0000 mon.a (mon.0) 957 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:38:53.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:38:52 gibba015 bash[30343]: audit 2021-03-10T14:38:52.785047+0000 mon.c (mon.1) 789 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:38:53.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:38:52 gibba015 bash[30343]: audit 2021-03-10T14:38:52.785790+0000 mon.a (mon.0) 958 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T14:38:53.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:38:52 gibba015 bash[30343]: audit 2021-03-10T14:38:52.786192+0000 mon.c (mon.1) 790 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:38:53.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:38:52 gibba015 bash[30343]: audit 2021-03-10T14:38:52.786874+0000 mon.a (mon.0) 959 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:38:53.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:38:52 gibba015 bash[30343]: audit 2021-03-10T14:38:52.787857+0000 mon.a (mon.0) 960 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:38:53.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:38:52 gibba015 bash[30343]: audit 2021-03-10T14:38:52.794952+0000 mon.a (mon.0) 961 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:38:53.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:38:52 gibba045 bash[25517]: cluster 2021-03-10T14:38:51.063012+0000 mgr.gibba045.orlgmj (mgr.34412) 2673 : cluster [DBG] pgmap v1513: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:53.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:38:52 gibba045 bash[25517]: audit 2021-03-10T14:38:52.782353+0000 mon.c (mon.1) 785 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:38:53.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:38:52 gibba045 bash[25517]: audit 2021-03-10T14:38:52.783003+0000 mon.c (mon.1) 786 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:38:53.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:38:52 gibba045 bash[25517]: audit 2021-03-10T14:38:52.783469+0000 mon.a (mon.0) 956 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:38:53.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:38:52 gibba045 bash[25517]: audit 2021-03-10T14:38:52.783599+0000 mon.c (mon.1) 787 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T14:38:53.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:38:52 gibba045 bash[25517]: audit 2021-03-10T14:38:52.784395+0000 mon.c (mon.1) 788 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:38:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:38:52 gibba045 bash[25517]: audit 2021-03-10T14:38:52.784645+0000 mon.a (mon.0) 957 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:38:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:38:52 gibba045 bash[25517]: audit 2021-03-10T14:38:52.785047+0000 mon.c (mon.1) 789 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:38:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:38:52 gibba045 bash[25517]: audit 2021-03-10T14:38:52.785790+0000 mon.a (mon.0) 958 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T14:38:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:38:52 gibba045 bash[25517]: audit 2021-03-10T14:38:52.786192+0000 mon.c (mon.1) 790 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:38:53.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:38:52 gibba045 bash[25517]: audit 2021-03-10T14:38:52.786874+0000 mon.a (mon.0) 959 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:38:53.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:38:52 gibba045 bash[25517]: audit 2021-03-10T14:38:52.787857+0000 mon.a (mon.0) 960 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:38:53.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:38:52 gibba045 bash[25517]: audit 2021-03-10T14:38:52.794952+0000 mon.a (mon.0) 961 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:38:55.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:38:54 gibba015 bash[29377]: cluster 2021-03-10T14:38:53.064568+0000 mgr.gibba045.orlgmj (mgr.34412) 2674 : cluster [DBG] pgmap v1514: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:55.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:38:54 gibba015 bash[30343]: cluster 2021-03-10T14:38:53.064568+0000 mgr.gibba045.orlgmj (mgr.34412) 2674 : cluster [DBG] pgmap v1514: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:55.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:38:54 gibba045 bash[25517]: cluster 2021-03-10T14:38:53.064568+0000 mgr.gibba045.orlgmj (mgr.34412) 2674 : cluster [DBG] pgmap v1514: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:56.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:38:55 gibba015 bash[29377]: audit 2021-03-10T14:38:54.873738+0000 mon.c (mon.1) 791 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:38:56.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:38:55 gibba015 bash[29377]: audit 2021-03-10T14:38:55.116481+0000 mon.a (mon.0) 962 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:38:56.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:38:55 gibba015 bash[29377]: audit 2021-03-10T14:38:55.120112+0000 mon.c (mon.1) 792 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:38:56.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:38:55 gibba015 bash[29377]: audit 2021-03-10T14:38:55.121431+0000 mon.c (mon.1) 793 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:38:56.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:38:55 gibba015 bash[29377]: audit 2021-03-10T14:38:55.123001+0000 mon.c (mon.1) 794 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:38:56.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:38:55 gibba015 bash[29377]: audit 2021-03-10T14:38:55.124263+0000 mon.c (mon.1) 795 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:38:56.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:38:55 gibba015 bash[29377]: audit 2021-03-10T14:38:55.127420+0000 mon.c (mon.1) 796 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:38:56.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:38:55 gibba015 bash[29377]: audit 2021-03-10T14:38:55.129297+0000 mon.c (mon.1) 797 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:38:56.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:38:55 gibba015 bash[30343]: audit 2021-03-10T14:38:54.873738+0000 mon.c (mon.1) 791 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:38:56.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:38:55 gibba015 bash[30343]: audit 2021-03-10T14:38:55.116481+0000 mon.a (mon.0) 962 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:38:56.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:38:55 gibba015 bash[30343]: audit 2021-03-10T14:38:55.120112+0000 mon.c (mon.1) 792 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:38:56.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:38:55 gibba015 bash[30343]: audit 2021-03-10T14:38:55.121431+0000 mon.c (mon.1) 793 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:38:56.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:38:55 gibba015 bash[30343]: audit 2021-03-10T14:38:55.123001+0000 mon.c (mon.1) 794 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:38:56.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:38:55 gibba015 bash[30343]: audit 2021-03-10T14:38:55.124263+0000 mon.c (mon.1) 795 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:38:56.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:38:55 gibba015 bash[30343]: audit 2021-03-10T14:38:55.127420+0000 mon.c (mon.1) 796 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:38:56.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:38:55 gibba015 bash[30343]: audit 2021-03-10T14:38:55.129297+0000 mon.c (mon.1) 797 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:38:56.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:38:55 gibba045 bash[25517]: audit 2021-03-10T14:38:54.873738+0000 mon.c (mon.1) 791 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:38:56.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:38:55 gibba045 bash[25517]: audit 2021-03-10T14:38:55.116481+0000 mon.a (mon.0) 962 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:38:56.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:38:55 gibba045 bash[25517]: audit 2021-03-10T14:38:55.120112+0000 mon.c (mon.1) 792 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:38:56.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:38:55 gibba045 bash[25517]: audit 2021-03-10T14:38:55.121431+0000 mon.c (mon.1) 793 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:38:56.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:38:55 gibba045 bash[25517]: audit 2021-03-10T14:38:55.123001+0000 mon.c (mon.1) 794 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:38:56.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:38:55 gibba045 bash[25517]: audit 2021-03-10T14:38:55.124263+0000 mon.c (mon.1) 795 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:38:56.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:38:55 gibba045 bash[25517]: audit 2021-03-10T14:38:55.127420+0000 mon.c (mon.1) 796 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:38:56.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:38:55 gibba045 bash[25517]: audit 2021-03-10T14:38:55.129297+0000 mon.c (mon.1) 797 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:38:57.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:38:56 gibba015 bash[29377]: cephadm 2021-03-10T14:38:54.892052+0000 mgr.gibba045.orlgmj (mgr.34412) 2675 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:38:57.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:38:56 gibba015 bash[29377]: cephadm 2021-03-10T14:38:54.893978+0000 mgr.gibba045.orlgmj (mgr.34412) 2676 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:38:57.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:38:56 gibba015 bash[29377]: cluster 2021-03-10T14:38:55.065100+0000 mgr.gibba045.orlgmj (mgr.34412) 2677 : cluster [DBG] pgmap v1515: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:57.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:38:56 gibba015 bash[29377]: cephadm 2021-03-10T14:38:55.123225+0000 mgr.gibba045.orlgmj (mgr.34412) 2678 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:38:57.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:38:56 gibba015 bash[29377]: cephadm 2021-03-10T14:38:55.124958+0000 mgr.gibba045.orlgmj (mgr.34412) 2679 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:38:57.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:38:56 gibba015 bash[29377]: cephadm 2021-03-10T14:38:55.126338+0000 mgr.gibba045.orlgmj (mgr.34412) 2680 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:38:57.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:38:56 gibba015 bash[29377]: cephadm 2021-03-10T14:38:55.126378+0000 mgr.gibba045.orlgmj (mgr.34412) 2681 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:38:57.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:38:56 gibba015 bash[29377]: cephadm 2021-03-10T14:38:55.127663+0000 mgr.gibba045.orlgmj (mgr.34412) 2682 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:38:57.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:38:56 gibba015 bash[29377]: cephadm 2021-03-10T14:38:55.127703+0000 mgr.gibba045.orlgmj (mgr.34412) 2683 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:38:57.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:38:56 gibba015 bash[29377]: cephadm 2021-03-10T14:38:55.128896+0000 mgr.gibba045.orlgmj (mgr.34412) 2684 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:38:57.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:38:56 gibba015 bash[29377]: cephadm 2021-03-10T14:38:55.130670+0000 mgr.gibba045.orlgmj (mgr.34412) 2685 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:38:57.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:38:56 gibba015 bash[29377]: cephadm 2021-03-10T14:38:55.130709+0000 mgr.gibba045.orlgmj (mgr.34412) 2686 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:38:57.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:38:56 gibba015 bash[29377]: cephadm 2021-03-10T14:38:55.132337+0000 mgr.gibba045.orlgmj (mgr.34412) 2687 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:38:57.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:38:56 gibba015 bash[29377]: cephadm 2021-03-10T14:38:55.132711+0000 mgr.gibba045.orlgmj (mgr.34412) 2688 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:38:57.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:38:56 gibba015 bash[29377]: cephadm 2021-03-10T14:38:55.134410+0000 mgr.gibba045.orlgmj (mgr.34412) 2689 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:38:57.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:38:56 gibba015 bash[29377]: cephadm 2021-03-10T14:38:55.134447+0000 mgr.gibba045.orlgmj (mgr.34412) 2690 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:38:57.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:38:56 gibba015 bash[29377]: cephadm 2021-03-10T14:38:55.134558+0000 mgr.gibba045.orlgmj (mgr.34412) 2691 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:38:57.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:38:56 gibba015 bash[30343]: cephadm 2021-03-10T14:38:54.892052+0000 mgr.gibba045.orlgmj (mgr.34412) 2675 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:38:57.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:38:56 gibba015 bash[30343]: cephadm 2021-03-10T14:38:54.893978+0000 mgr.gibba045.orlgmj (mgr.34412) 2676 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:38:57.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:38:56 gibba015 bash[30343]: cluster 2021-03-10T14:38:55.065100+0000 mgr.gibba045.orlgmj (mgr.34412) 2677 : cluster [DBG] pgmap v1515: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:57.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:38:56 gibba015 bash[30343]: cephadm 2021-03-10T14:38:55.123225+0000 mgr.gibba045.orlgmj (mgr.34412) 2678 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:38:57.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:38:56 gibba015 bash[30343]: cephadm 2021-03-10T14:38:55.124958+0000 mgr.gibba045.orlgmj (mgr.34412) 2679 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:38:57.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:38:56 gibba015 bash[30343]: cephadm 2021-03-10T14:38:55.126338+0000 mgr.gibba045.orlgmj (mgr.34412) 2680 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:38:57.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:38:56 gibba015 bash[30343]: cephadm 2021-03-10T14:38:55.126378+0000 mgr.gibba045.orlgmj (mgr.34412) 2681 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:38:57.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:38:56 gibba015 bash[30343]: cephadm 2021-03-10T14:38:55.127663+0000 mgr.gibba045.orlgmj (mgr.34412) 2682 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:38:57.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:38:56 gibba015 bash[30343]: cephadm 2021-03-10T14:38:55.127703+0000 mgr.gibba045.orlgmj (mgr.34412) 2683 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:38:57.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:38:56 gibba015 bash[30343]: cephadm 2021-03-10T14:38:55.128896+0000 mgr.gibba045.orlgmj (mgr.34412) 2684 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:38:57.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:38:56 gibba015 bash[30343]: cephadm 2021-03-10T14:38:55.130670+0000 mgr.gibba045.orlgmj (mgr.34412) 2685 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:38:57.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:38:56 gibba015 bash[30343]: cephadm 2021-03-10T14:38:55.130709+0000 mgr.gibba045.orlgmj (mgr.34412) 2686 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:38:57.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:38:56 gibba015 bash[30343]: cephadm 2021-03-10T14:38:55.132337+0000 mgr.gibba045.orlgmj (mgr.34412) 2687 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:38:57.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:38:56 gibba015 bash[30343]: cephadm 2021-03-10T14:38:55.132711+0000 mgr.gibba045.orlgmj (mgr.34412) 2688 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:38:57.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:38:56 gibba015 bash[30343]: cephadm 2021-03-10T14:38:55.134410+0000 mgr.gibba045.orlgmj (mgr.34412) 2689 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:38:57.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:38:56 gibba015 bash[30343]: cephadm 2021-03-10T14:38:55.134447+0000 mgr.gibba045.orlgmj (mgr.34412) 2690 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:38:57.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:38:56 gibba015 bash[30343]: cephadm 2021-03-10T14:38:55.134558+0000 mgr.gibba045.orlgmj (mgr.34412) 2691 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:38:57.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:38:56 gibba045 bash[25517]: cephadm 2021-03-10T14:38:54.892052+0000 mgr.gibba045.orlgmj (mgr.34412) 2675 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:38:57.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:38:56 gibba045 bash[25517]: cephadm 2021-03-10T14:38:54.893978+0000 mgr.gibba045.orlgmj (mgr.34412) 2676 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:38:57.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:38:56 gibba045 bash[25517]: cluster 2021-03-10T14:38:55.065100+0000 mgr.gibba045.orlgmj (mgr.34412) 2677 : cluster [DBG] pgmap v1515: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:57.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:38:56 gibba045 bash[25517]: cephadm 2021-03-10T14:38:55.123225+0000 mgr.gibba045.orlgmj (mgr.34412) 2678 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:38:57.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:38:56 gibba045 bash[25517]: cephadm 2021-03-10T14:38:55.124958+0000 mgr.gibba045.orlgmj (mgr.34412) 2679 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:38:57.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:38:56 gibba045 bash[25517]: cephadm 2021-03-10T14:38:55.126338+0000 mgr.gibba045.orlgmj (mgr.34412) 2680 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:38:57.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:38:56 gibba045 bash[25517]: cephadm 2021-03-10T14:38:55.126378+0000 mgr.gibba045.orlgmj (mgr.34412) 2681 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:38:57.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:38:56 gibba045 bash[25517]: cephadm 2021-03-10T14:38:55.127663+0000 mgr.gibba045.orlgmj (mgr.34412) 2682 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:38:57.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:38:56 gibba045 bash[25517]: cephadm 2021-03-10T14:38:55.127703+0000 mgr.gibba045.orlgmj (mgr.34412) 2683 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:38:57.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:38:56 gibba045 bash[25517]: cephadm 2021-03-10T14:38:55.128896+0000 mgr.gibba045.orlgmj (mgr.34412) 2684 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:38:57.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:38:56 gibba045 bash[25517]: cephadm 2021-03-10T14:38:55.130670+0000 mgr.gibba045.orlgmj (mgr.34412) 2685 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:38:57.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:38:56 gibba045 bash[25517]: cephadm 2021-03-10T14:38:55.130709+0000 mgr.gibba045.orlgmj (mgr.34412) 2686 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:38:57.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:38:56 gibba045 bash[25517]: cephadm 2021-03-10T14:38:55.132337+0000 mgr.gibba045.orlgmj (mgr.34412) 2687 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:38:57.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:38:56 gibba045 bash[25517]: cephadm 2021-03-10T14:38:55.132711+0000 mgr.gibba045.orlgmj (mgr.34412) 2688 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:38:57.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:38:56 gibba045 bash[25517]: cephadm 2021-03-10T14:38:55.134410+0000 mgr.gibba045.orlgmj (mgr.34412) 2689 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:38:57.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:38:56 gibba045 bash[25517]: cephadm 2021-03-10T14:38:55.134447+0000 mgr.gibba045.orlgmj (mgr.34412) 2690 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:38:57.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:38:56 gibba045 bash[25517]: cephadm 2021-03-10T14:38:55.134558+0000 mgr.gibba045.orlgmj (mgr.34412) 2691 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:38:59.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:38:58 gibba015 bash[29377]: cluster 2021-03-10T14:38:57.066926+0000 mgr.gibba045.orlgmj (mgr.34412) 2692 : cluster [DBG] pgmap v1516: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:59.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:38:58 gibba015 bash[30343]: cluster 2021-03-10T14:38:57.066926+0000 mgr.gibba045.orlgmj (mgr.34412) 2692 : cluster [DBG] pgmap v1516: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:59.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:38:58 gibba045 bash[25517]: cluster 2021-03-10T14:38:57.066926+0000 mgr.gibba045.orlgmj (mgr.34412) 2692 : cluster [DBG] pgmap v1516: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:01.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:39:00 gibba015 bash[29377]: cluster 2021-03-10T14:38:59.068178+0000 mgr.gibba045.orlgmj (mgr.34412) 2693 : cluster [DBG] pgmap v1517: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:01.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:39:00 gibba015 bash[30343]: cluster 2021-03-10T14:38:59.068178+0000 mgr.gibba045.orlgmj (mgr.34412) 2693 : cluster [DBG] pgmap v1517: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:01.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:39:00 gibba045 bash[25517]: cluster 2021-03-10T14:38:59.068178+0000 mgr.gibba045.orlgmj (mgr.34412) 2693 : cluster [DBG] pgmap v1517: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:03.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:39:02 gibba015 bash[29377]: cluster 2021-03-10T14:39:01.069985+0000 mgr.gibba045.orlgmj (mgr.34412) 2694 : cluster [DBG] pgmap v1518: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:03.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:39:02 gibba015 bash[30343]: cluster 2021-03-10T14:39:01.069985+0000 mgr.gibba045.orlgmj (mgr.34412) 2694 : cluster [DBG] pgmap v1518: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:03.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:39:02 gibba045 bash[25517]: cluster 2021-03-10T14:39:01.069985+0000 mgr.gibba045.orlgmj (mgr.34412) 2694 : cluster [DBG] pgmap v1518: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:05.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:39:04 gibba015 bash[29377]: cluster 2021-03-10T14:39:03.071604+0000 mgr.gibba045.orlgmj (mgr.34412) 2695 : cluster [DBG] pgmap v1519: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:05.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:39:04 gibba015 bash[30343]: cluster 2021-03-10T14:39:03.071604+0000 mgr.gibba045.orlgmj (mgr.34412) 2695 : cluster [DBG] pgmap v1519: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:05.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:39:04 gibba045 bash[25517]: cluster 2021-03-10T14:39:03.071604+0000 mgr.gibba045.orlgmj (mgr.34412) 2695 : cluster [DBG] pgmap v1519: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:07.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:39:06 gibba015 bash[29377]: cluster 2021-03-10T14:39:05.073284+0000 mgr.gibba045.orlgmj (mgr.34412) 2696 : cluster [DBG] pgmap v1520: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:07.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:39:06 gibba015 bash[30343]: cluster 2021-03-10T14:39:05.073284+0000 mgr.gibba045.orlgmj (mgr.34412) 2696 : cluster [DBG] pgmap v1520: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:07.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:39:06 gibba045 bash[25517]: cluster 2021-03-10T14:39:05.073284+0000 mgr.gibba045.orlgmj (mgr.34412) 2696 : cluster [DBG] pgmap v1520: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:09.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:39:08 gibba015 bash[29377]: cluster 2021-03-10T14:39:07.074802+0000 mgr.gibba045.orlgmj (mgr.34412) 2697 : cluster [DBG] pgmap v1521: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:09.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:39:08 gibba015 bash[30343]: cluster 2021-03-10T14:39:07.074802+0000 mgr.gibba045.orlgmj (mgr.34412) 2697 : cluster [DBG] pgmap v1521: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:09.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:39:08 gibba045 bash[25517]: cluster 2021-03-10T14:39:07.074802+0000 mgr.gibba045.orlgmj (mgr.34412) 2697 : cluster [DBG] pgmap v1521: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:11.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:39:10 gibba015 bash[29377]: cluster 2021-03-10T14:39:09.076049+0000 mgr.gibba045.orlgmj (mgr.34412) 2698 : cluster [DBG] pgmap v1522: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:11.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:39:10 gibba015 bash[30343]: cluster 2021-03-10T14:39:09.076049+0000 mgr.gibba045.orlgmj (mgr.34412) 2698 : cluster [DBG] pgmap v1522: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:11.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:39:10 gibba045 bash[25517]: cluster 2021-03-10T14:39:09.076049+0000 mgr.gibba045.orlgmj (mgr.34412) 2698 : cluster [DBG] pgmap v1522: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:12.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:39:11 gibba015 bash[29377]: cephadm 2021-03-10T14:39:10.150582+0000 mgr.gibba045.orlgmj (mgr.34412) 2699 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:39:12.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:39:11 gibba015 bash[30343]: cephadm 2021-03-10T14:39:10.150582+0000 mgr.gibba045.orlgmj (mgr.34412) 2699 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:39:12.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:39:11 gibba045 bash[25517]: cephadm 2021-03-10T14:39:10.150582+0000 mgr.gibba045.orlgmj (mgr.34412) 2699 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:39:13.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:39:12 gibba015 bash[29377]: cluster 2021-03-10T14:39:11.077659+0000 mgr.gibba045.orlgmj (mgr.34412) 2700 : cluster [DBG] pgmap v1523: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:13.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:39:12 gibba015 bash[30343]: cluster 2021-03-10T14:39:11.077659+0000 mgr.gibba045.orlgmj (mgr.34412) 2700 : cluster [DBG] pgmap v1523: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:13.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:39:12 gibba045 bash[25517]: cluster 2021-03-10T14:39:11.077659+0000 mgr.gibba045.orlgmj (mgr.34412) 2700 : cluster [DBG] pgmap v1523: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:15.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:39:14 gibba015 bash[29377]: cluster 2021-03-10T14:39:13.079164+0000 mgr.gibba045.orlgmj (mgr.34412) 2701 : cluster [DBG] pgmap v1524: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:15.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:39:14 gibba015 bash[30343]: cluster 2021-03-10T14:39:13.079164+0000 mgr.gibba045.orlgmj (mgr.34412) 2701 : cluster [DBG] pgmap v1524: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:15.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:39:14 gibba045 bash[25517]: cluster 2021-03-10T14:39:13.079164+0000 mgr.gibba045.orlgmj (mgr.34412) 2701 : cluster [DBG] pgmap v1524: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:17.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:39:16 gibba015 bash[29377]: cluster 2021-03-10T14:39:15.080883+0000 mgr.gibba045.orlgmj (mgr.34412) 2702 : cluster [DBG] pgmap v1525: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:17.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:39:16 gibba015 bash[30343]: cluster 2021-03-10T14:39:15.080883+0000 mgr.gibba045.orlgmj (mgr.34412) 2702 : cluster [DBG] pgmap v1525: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:17.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:39:16 gibba045 bash[25517]: cluster 2021-03-10T14:39:15.080883+0000 mgr.gibba045.orlgmj (mgr.34412) 2702 : cluster [DBG] pgmap v1525: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:19.218 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:39:19.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:39:18 gibba015 bash[29377]: cluster 2021-03-10T14:39:17.082489+0000 mgr.gibba045.orlgmj (mgr.34412) 2703 : cluster [DBG] pgmap v1526: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:19.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:39:18 gibba015 bash[30343]: cluster 2021-03-10T14:39:17.082489+0000 mgr.gibba045.orlgmj (mgr.34412) 2703 : cluster [DBG] pgmap v1526: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:19.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:39:18 gibba045 bash[25517]: cluster 2021-03-10T14:39:17.082489+0000 mgr.gibba045.orlgmj (mgr.34412) 2703 : cluster [DBG] pgmap v1526: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:19.445 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:39:19.446 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (50m) 5m ago 55m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:39:19.446 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (55m) 4m ago 55m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:39:19.446 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (50m) 4m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:39:19.447 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (50m) 4m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:39:19.447 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (49m) 5m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:39:19.448 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (49m) 5m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:39:19.448 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (49m) 4m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:39:19.448 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (49m) 5m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:39:19.448 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (55m) 5m ago 55m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:39:19.449 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (55m) 4m ago 55m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:39:19.449 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (48m) 5m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:39:19.449 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (47m) 5m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:39:19.449 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (47m) 5m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:39:19.450 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (47m) 5m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:39:19.450 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (46m) 4m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:39:19.450 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (46m) 4m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:39:19.450 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (45m) 4m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:39:19.450 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (45m) 4m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:39:19.451 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (54m) 4m ago 55m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:39:19.451 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 4m ago 53m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:39:19.701 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:39:19.701 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:39:19.702 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:39:19.702 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:39:19.702 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:39:19.703 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:39:19.703 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:39:19.703 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:39:19.703 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:39:19.704 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:39:19.704 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:39:19.704 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:39:19.704 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:39:19.705 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:39:19.705 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:39:20.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:39:19 gibba015 bash[29377]: cluster 2021-03-10T14:39:19.083699+0000 mgr.gibba045.orlgmj (mgr.34412) 2704 : cluster [DBG] pgmap v1527: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:20.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:39:19 gibba015 bash[29377]: audit 2021-03-10T14:39:19.208978+0000 mgr.gibba045.orlgmj (mgr.34412) 2705 : audit [DBG] from='client.45870 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:39:20.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:39:19 gibba015 bash[29377]: audit 2021-03-10T14:39:19.433098+0000 mgr.gibba045.orlgmj (mgr.34412) 2706 : audit [DBG] from='client.55864 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:39:20.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:39:19 gibba015 bash[29377]: audit 2021-03-10T14:39:19.697263+0000 mon.c (mon.1) 798 : audit [DBG] from='client.? 172.21.2.115:0/3007546507' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:39:20.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:39:19 gibba015 bash[30343]: cluster 2021-03-10T14:39:19.083699+0000 mgr.gibba045.orlgmj (mgr.34412) 2704 : cluster [DBG] pgmap v1527: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:20.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:39:19 gibba015 bash[30343]: audit 2021-03-10T14:39:19.208978+0000 mgr.gibba045.orlgmj (mgr.34412) 2705 : audit [DBG] from='client.45870 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:39:20.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:39:19 gibba015 bash[30343]: audit 2021-03-10T14:39:19.433098+0000 mgr.gibba045.orlgmj (mgr.34412) 2706 : audit [DBG] from='client.55864 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:39:20.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:39:19 gibba015 bash[30343]: audit 2021-03-10T14:39:19.697263+0000 mon.c (mon.1) 798 : audit [DBG] from='client.? 172.21.2.115:0/3007546507' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:39:20.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:39:19 gibba045 bash[25517]: cluster 2021-03-10T14:39:19.083699+0000 mgr.gibba045.orlgmj (mgr.34412) 2704 : cluster [DBG] pgmap v1527: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:20.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:39:19 gibba045 bash[25517]: audit 2021-03-10T14:39:19.208978+0000 mgr.gibba045.orlgmj (mgr.34412) 2705 : audit [DBG] from='client.45870 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:39:20.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:39:19 gibba045 bash[25517]: audit 2021-03-10T14:39:19.433098+0000 mgr.gibba045.orlgmj (mgr.34412) 2706 : audit [DBG] from='client.55864 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:39:20.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:39:19 gibba045 bash[25517]: audit 2021-03-10T14:39:19.697263+0000 mon.c (mon.1) 798 : audit [DBG] from='client.? 172.21.2.115:0/3007546507' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:39:22.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:39:22 gibba015 bash[29377]: cluster 2021-03-10T14:39:21.085487+0000 mgr.gibba045.orlgmj (mgr.34412) 2707 : cluster [DBG] pgmap v1528: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:22.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:39:22 gibba015 bash[30343]: cluster 2021-03-10T14:39:21.085487+0000 mgr.gibba045.orlgmj (mgr.34412) 2707 : cluster [DBG] pgmap v1528: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:22.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:39:22 gibba045 bash[25517]: cluster 2021-03-10T14:39:21.085487+0000 mgr.gibba045.orlgmj (mgr.34412) 2707 : cluster [DBG] pgmap v1528: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:25.161 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:39:24 gibba045 bash[25517]: cluster 2021-03-10T14:39:23.087072+0000 mgr.gibba045.orlgmj (mgr.34412) 2708 : cluster [DBG] pgmap v1529: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:25.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:39:24 gibba015 bash[29377]: cluster 2021-03-10T14:39:23.087072+0000 mgr.gibba045.orlgmj (mgr.34412) 2708 : cluster [DBG] pgmap v1529: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:25.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:39:24 gibba015 bash[30343]: cluster 2021-03-10T14:39:23.087072+0000 mgr.gibba045.orlgmj (mgr.34412) 2708 : cluster [DBG] pgmap v1529: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:27.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:39:26 gibba015 bash[29377]: cluster 2021-03-10T14:39:25.088767+0000 mgr.gibba045.orlgmj (mgr.34412) 2709 : cluster [DBG] pgmap v1530: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:27.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:39:26 gibba015 bash[29377]: cephadm 2021-03-10T14:39:25.161255+0000 mgr.gibba045.orlgmj (mgr.34412) 2710 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:39:27.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:39:26 gibba015 bash[30343]: cluster 2021-03-10T14:39:25.088767+0000 mgr.gibba045.orlgmj (mgr.34412) 2709 : cluster [DBG] pgmap v1530: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:27.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:39:26 gibba015 bash[30343]: cephadm 2021-03-10T14:39:25.161255+0000 mgr.gibba045.orlgmj (mgr.34412) 2710 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:39:27.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:39:26 gibba045 bash[25517]: cluster 2021-03-10T14:39:25.088767+0000 mgr.gibba045.orlgmj (mgr.34412) 2709 : cluster [DBG] pgmap v1530: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:27.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:39:26 gibba045 bash[25517]: cephadm 2021-03-10T14:39:25.161255+0000 mgr.gibba045.orlgmj (mgr.34412) 2710 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:39:29.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:39:28 gibba015 bash[29377]: cluster 2021-03-10T14:39:27.090466+0000 mgr.gibba045.orlgmj (mgr.34412) 2711 : cluster [DBG] pgmap v1531: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:29.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:39:28 gibba015 bash[30343]: cluster 2021-03-10T14:39:27.090466+0000 mgr.gibba045.orlgmj (mgr.34412) 2711 : cluster [DBG] pgmap v1531: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:29.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:39:28 gibba045 bash[25517]: cluster 2021-03-10T14:39:27.090466+0000 mgr.gibba045.orlgmj (mgr.34412) 2711 : cluster [DBG] pgmap v1531: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:31.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:39:30 gibba015 bash[29377]: cluster 2021-03-10T14:39:29.091654+0000 mgr.gibba045.orlgmj (mgr.34412) 2712 : cluster [DBG] pgmap v1532: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:31.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:39:30 gibba015 bash[30343]: cluster 2021-03-10T14:39:29.091654+0000 mgr.gibba045.orlgmj (mgr.34412) 2712 : cluster [DBG] pgmap v1532: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:31.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:39:30 gibba045 bash[25517]: cluster 2021-03-10T14:39:29.091654+0000 mgr.gibba045.orlgmj (mgr.34412) 2712 : cluster [DBG] pgmap v1532: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:33.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:39:32 gibba015 bash[29377]: cluster 2021-03-10T14:39:31.093330+0000 mgr.gibba045.orlgmj (mgr.34412) 2713 : cluster [DBG] pgmap v1533: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:33.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:39:32 gibba015 bash[30343]: cluster 2021-03-10T14:39:31.093330+0000 mgr.gibba045.orlgmj (mgr.34412) 2713 : cluster [DBG] pgmap v1533: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:33.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:39:32 gibba045 bash[25517]: cluster 2021-03-10T14:39:31.093330+0000 mgr.gibba045.orlgmj (mgr.34412) 2713 : cluster [DBG] pgmap v1533: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:35.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:39:34 gibba015 bash[29377]: cluster 2021-03-10T14:39:33.095062+0000 mgr.gibba045.orlgmj (mgr.34412) 2714 : cluster [DBG] pgmap v1534: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:35.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:39:34 gibba015 bash[30343]: cluster 2021-03-10T14:39:33.095062+0000 mgr.gibba045.orlgmj (mgr.34412) 2714 : cluster [DBG] pgmap v1534: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:35.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:39:34 gibba045 bash[25517]: cluster 2021-03-10T14:39:33.095062+0000 mgr.gibba045.orlgmj (mgr.34412) 2714 : cluster [DBG] pgmap v1534: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:37.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:39:36 gibba015 bash[30343]: cluster 2021-03-10T14:39:35.096839+0000 mgr.gibba045.orlgmj (mgr.34412) 2715 : cluster [DBG] pgmap v1535: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:37.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:39:36 gibba015 bash[29377]: cluster 2021-03-10T14:39:35.096839+0000 mgr.gibba045.orlgmj (mgr.34412) 2715 : cluster [DBG] pgmap v1535: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:37.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:39:36 gibba045 bash[25517]: cluster 2021-03-10T14:39:35.096839+0000 mgr.gibba045.orlgmj (mgr.34412) 2715 : cluster [DBG] pgmap v1535: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:39.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:39:38 gibba015 bash[29377]: cluster 2021-03-10T14:39:37.098626+0000 mgr.gibba045.orlgmj (mgr.34412) 2716 : cluster [DBG] pgmap v1536: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:39.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:39:38 gibba015 bash[30343]: cluster 2021-03-10T14:39:37.098626+0000 mgr.gibba045.orlgmj (mgr.34412) 2716 : cluster [DBG] pgmap v1536: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:39.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:39:38 gibba045 bash[25517]: cluster 2021-03-10T14:39:37.098626+0000 mgr.gibba045.orlgmj (mgr.34412) 2716 : cluster [DBG] pgmap v1536: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:41.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:39:40 gibba015 bash[29377]: cluster 2021-03-10T14:39:39.099933+0000 mgr.gibba045.orlgmj (mgr.34412) 2717 : cluster [DBG] pgmap v1537: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:41.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:39:40 gibba015 bash[30343]: cluster 2021-03-10T14:39:39.099933+0000 mgr.gibba045.orlgmj (mgr.34412) 2717 : cluster [DBG] pgmap v1537: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:41.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:39:40 gibba045 bash[25517]: cluster 2021-03-10T14:39:39.099933+0000 mgr.gibba045.orlgmj (mgr.34412) 2717 : cluster [DBG] pgmap v1537: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:42.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:39:41 gibba015 bash[29377]: cephadm 2021-03-10T14:39:40.177153+0000 mgr.gibba045.orlgmj (mgr.34412) 2718 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:39:42.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:39:41 gibba015 bash[30343]: cephadm 2021-03-10T14:39:40.177153+0000 mgr.gibba045.orlgmj (mgr.34412) 2718 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:39:42.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:39:41 gibba045 bash[25517]: cephadm 2021-03-10T14:39:40.177153+0000 mgr.gibba045.orlgmj (mgr.34412) 2718 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:39:43.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:39:42 gibba015 bash[29377]: cluster 2021-03-10T14:39:41.101785+0000 mgr.gibba045.orlgmj (mgr.34412) 2719 : cluster [DBG] pgmap v1538: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:43.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:39:42 gibba015 bash[30343]: cluster 2021-03-10T14:39:41.101785+0000 mgr.gibba045.orlgmj (mgr.34412) 2719 : cluster [DBG] pgmap v1538: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:43.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:39:42 gibba045 bash[25517]: cluster 2021-03-10T14:39:41.101785+0000 mgr.gibba045.orlgmj (mgr.34412) 2719 : cluster [DBG] pgmap v1538: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:44.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:39:43 gibba015 bash[29377]: cluster 2021-03-10T14:39:43.103450+0000 mgr.gibba045.orlgmj (mgr.34412) 2720 : cluster [DBG] pgmap v1539: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:44.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:39:43 gibba015 bash[30343]: cluster 2021-03-10T14:39:43.103450+0000 mgr.gibba045.orlgmj (mgr.34412) 2720 : cluster [DBG] pgmap v1539: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:44.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:39:43 gibba045 bash[25517]: cluster 2021-03-10T14:39:43.103450+0000 mgr.gibba045.orlgmj (mgr.34412) 2720 : cluster [DBG] pgmap v1539: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:46.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:39:46 gibba015 bash[29377]: cluster 2021-03-10T14:39:45.105137+0000 mgr.gibba045.orlgmj (mgr.34412) 2721 : cluster [DBG] pgmap v1540: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:46.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:39:46 gibba015 bash[30343]: cluster 2021-03-10T14:39:45.105137+0000 mgr.gibba045.orlgmj (mgr.34412) 2721 : cluster [DBG] pgmap v1540: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:46.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:39:46 gibba045 bash[25517]: cluster 2021-03-10T14:39:45.105137+0000 mgr.gibba045.orlgmj (mgr.34412) 2721 : cluster [DBG] pgmap v1540: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:49.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:39:48 gibba015 bash[29377]: cluster 2021-03-10T14:39:47.106789+0000 mgr.gibba045.orlgmj (mgr.34412) 2722 : cluster [DBG] pgmap v1541: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:49.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:39:48 gibba015 bash[30343]: cluster 2021-03-10T14:39:47.106789+0000 mgr.gibba045.orlgmj (mgr.34412) 2722 : cluster [DBG] pgmap v1541: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:49.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:39:48 gibba045 bash[25517]: cluster 2021-03-10T14:39:47.106789+0000 mgr.gibba045.orlgmj (mgr.34412) 2722 : cluster [DBG] pgmap v1541: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:49.947 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:39:50.196 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:39:50.196 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (50m) 6m ago 55m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:39:50.196 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (55m) 4m ago 55m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:39:50.197 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (50m) 4m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:39:50.197 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (51m) 4m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:39:50.197 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (50m) 6m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:39:50.197 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (50m) 6m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:39:50.197 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (49m) 4m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:39:50.198 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (49m) 6m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:39:50.198 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (56m) 6m ago 56m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:39:50.198 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (56m) 4m ago 56m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:39:50.198 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (48m) 6m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:39:50.199 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (48m) 6m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:39:50.199 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (47m) 6m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:39:50.199 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (47m) 6m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:39:50.199 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (47m) 4m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:39:50.199 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (46m) 4m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:39:50.200 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (46m) 4m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:39:50.200 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (45m) 4m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:39:50.200 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (55m) 4m ago 56m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:39:50.200 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 4m ago 54m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:39:50.444 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:39:50.444 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:39:50.444 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:39:50.444 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:39:50.445 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:39:50.445 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:39:50.445 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:39:50.445 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:39:50.445 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:39:50.446 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:39:50.446 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:39:50.446 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:39:50.446 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:39:50.447 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:39:50.447 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:39:51.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:39:50 gibba015 bash[29377]: cluster 2021-03-10T14:39:49.108053+0000 mgr.gibba045.orlgmj (mgr.34412) 2723 : cluster [DBG] pgmap v1542: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:51.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:39:50 gibba015 bash[29377]: audit 2021-03-10T14:39:50.439988+0000 mon.a (mon.0) 963 : audit [DBG] from='client.? 172.21.2.115:0/2642716243' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:39:51.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:39:50 gibba015 bash[30343]: cluster 2021-03-10T14:39:49.108053+0000 mgr.gibba045.orlgmj (mgr.34412) 2723 : cluster [DBG] pgmap v1542: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:51.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:39:50 gibba015 bash[30343]: audit 2021-03-10T14:39:50.439988+0000 mon.a (mon.0) 963 : audit [DBG] from='client.? 172.21.2.115:0/2642716243' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:39:51.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:39:50 gibba045 bash[25517]: cluster 2021-03-10T14:39:49.108053+0000 mgr.gibba045.orlgmj (mgr.34412) 2723 : cluster [DBG] pgmap v1542: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:51.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:39:50 gibba045 bash[25517]: audit 2021-03-10T14:39:50.439988+0000 mon.a (mon.0) 963 : audit [DBG] from='client.? 172.21.2.115:0/2642716243' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:39:52.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:39:51 gibba015 bash[29377]: audit 2021-03-10T14:39:49.938274+0000 mgr.gibba045.orlgmj (mgr.34412) 2724 : audit [DBG] from='client.45888 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:39:52.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:39:51 gibba015 bash[29377]: audit 2021-03-10T14:39:50.163288+0000 mgr.gibba045.orlgmj (mgr.34412) 2725 : audit [DBG] from='client.55882 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:39:52.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:39:51 gibba015 bash[30343]: audit 2021-03-10T14:39:49.938274+0000 mgr.gibba045.orlgmj (mgr.34412) 2724 : audit [DBG] from='client.45888 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:39:52.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:39:51 gibba015 bash[30343]: audit 2021-03-10T14:39:50.163288+0000 mgr.gibba045.orlgmj (mgr.34412) 2725 : audit [DBG] from='client.55882 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:39:52.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:39:51 gibba045 bash[25517]: audit 2021-03-10T14:39:49.938274+0000 mgr.gibba045.orlgmj (mgr.34412) 2724 : audit [DBG] from='client.45888 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:39:52.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:39:51 gibba045 bash[25517]: audit 2021-03-10T14:39:50.163288+0000 mgr.gibba045.orlgmj (mgr.34412) 2725 : audit [DBG] from='client.55882 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:39:53.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:39:52 gibba015 bash[29377]: cluster 2021-03-10T14:39:51.109812+0000 mgr.gibba045.orlgmj (mgr.34412) 2726 : cluster [DBG] pgmap v1543: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:53.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:39:52 gibba015 bash[29377]: audit 2021-03-10T14:39:52.786979+0000 mon.c (mon.1) 799 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:39:53.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:39:52 gibba015 bash[29377]: audit 2021-03-10T14:39:52.787788+0000 mon.c (mon.1) 800 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:39:53.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:39:52 gibba015 bash[29377]: audit 2021-03-10T14:39:52.788078+0000 mon.a (mon.0) 964 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:39:53.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:39:52 gibba015 bash[29377]: audit 2021-03-10T14:39:52.789287+0000 mon.a (mon.0) 965 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:39:53.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:39:52 gibba015 bash[29377]: audit 2021-03-10T14:39:52.790605+0000 mon.c (mon.1) 801 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T14:39:53.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:39:52 gibba015 bash[29377]: audit 2021-03-10T14:39:52.791541+0000 mon.c (mon.1) 802 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:39:53.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:39:52 gibba015 bash[29377]: audit 2021-03-10T14:39:52.791705+0000 mon.a (mon.0) 966 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T14:39:53.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:39:52 gibba015 bash[29377]: audit 2021-03-10T14:39:52.792470+0000 mon.c (mon.1) 803 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T14:39:53.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:39:52 gibba015 bash[29377]: audit 2021-03-10T14:39:52.792927+0000 mon.a (mon.0) 967 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:39:53.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:39:52 gibba015 bash[29377]: audit 2021-03-10T14:39:52.793527+0000 mon.c (mon.1) 804 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:39:53.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:39:52 gibba015 bash[29377]: audit 2021-03-10T14:39:52.793873+0000 mon.a (mon.0) 968 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T14:39:53.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:39:52 gibba015 bash[29377]: audit 2021-03-10T14:39:52.795115+0000 mon.a (mon.0) 969 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:39:53.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:39:52 gibba015 bash[30343]: cluster 2021-03-10T14:39:51.109812+0000 mgr.gibba045.orlgmj (mgr.34412) 2726 : cluster [DBG] pgmap v1543: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:53.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:39:52 gibba015 bash[30343]: audit 2021-03-10T14:39:52.786979+0000 mon.c (mon.1) 799 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:39:53.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:39:52 gibba015 bash[30343]: audit 2021-03-10T14:39:52.787788+0000 mon.c (mon.1) 800 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:39:53.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:39:52 gibba015 bash[30343]: audit 2021-03-10T14:39:52.788078+0000 mon.a (mon.0) 964 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:39:53.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:39:52 gibba015 bash[30343]: audit 2021-03-10T14:39:52.789287+0000 mon.a (mon.0) 965 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:39:53.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:39:52 gibba015 bash[30343]: audit 2021-03-10T14:39:52.790605+0000 mon.c (mon.1) 801 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T14:39:53.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:39:52 gibba015 bash[30343]: audit 2021-03-10T14:39:52.791541+0000 mon.c (mon.1) 802 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:39:53.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:39:52 gibba015 bash[30343]: audit 2021-03-10T14:39:52.791705+0000 mon.a (mon.0) 966 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T14:39:53.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:39:52 gibba015 bash[30343]: audit 2021-03-10T14:39:52.792470+0000 mon.c (mon.1) 803 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T14:39:53.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:39:52 gibba015 bash[30343]: audit 2021-03-10T14:39:52.792927+0000 mon.a (mon.0) 967 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:39:53.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:39:52 gibba015 bash[30343]: audit 2021-03-10T14:39:52.793527+0000 mon.c (mon.1) 804 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:39:53.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:39:52 gibba015 bash[30343]: audit 2021-03-10T14:39:52.793873+0000 mon.a (mon.0) 968 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T14:39:53.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:39:52 gibba015 bash[30343]: audit 2021-03-10T14:39:52.795115+0000 mon.a (mon.0) 969 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:39:53.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:39:52 gibba045 bash[25517]: cluster 2021-03-10T14:39:51.109812+0000 mgr.gibba045.orlgmj (mgr.34412) 2726 : cluster [DBG] pgmap v1543: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:53.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:39:52 gibba045 bash[25517]: audit 2021-03-10T14:39:52.786979+0000 mon.c (mon.1) 799 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:39:53.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:39:52 gibba045 bash[25517]: audit 2021-03-10T14:39:52.787788+0000 mon.c (mon.1) 800 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:39:53.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:39:52 gibba045 bash[25517]: audit 2021-03-10T14:39:52.788078+0000 mon.a (mon.0) 964 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:39:53.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:39:52 gibba045 bash[25517]: audit 2021-03-10T14:39:52.789287+0000 mon.a (mon.0) 965 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:39:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:39:52 gibba045 bash[25517]: audit 2021-03-10T14:39:52.790605+0000 mon.c (mon.1) 801 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T14:39:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:39:52 gibba045 bash[25517]: audit 2021-03-10T14:39:52.791541+0000 mon.c (mon.1) 802 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:39:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:39:52 gibba045 bash[25517]: audit 2021-03-10T14:39:52.791705+0000 mon.a (mon.0) 966 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T14:39:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:39:52 gibba045 bash[25517]: audit 2021-03-10T14:39:52.792470+0000 mon.c (mon.1) 803 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T14:39:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:39:52 gibba045 bash[25517]: audit 2021-03-10T14:39:52.792927+0000 mon.a (mon.0) 967 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:39:53.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:39:52 gibba045 bash[25517]: audit 2021-03-10T14:39:52.793527+0000 mon.c (mon.1) 804 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:39:53.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:39:52 gibba045 bash[25517]: audit 2021-03-10T14:39:52.793873+0000 mon.a (mon.0) 968 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T14:39:53.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:39:52 gibba045 bash[25517]: audit 2021-03-10T14:39:52.795115+0000 mon.a (mon.0) 969 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:39:55.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:39:54 gibba015 bash[29377]: cluster 2021-03-10T14:39:53.111470+0000 mgr.gibba045.orlgmj (mgr.34412) 2727 : cluster [DBG] pgmap v1544: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:55.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:39:54 gibba015 bash[30343]: cluster 2021-03-10T14:39:53.111470+0000 mgr.gibba045.orlgmj (mgr.34412) 2727 : cluster [DBG] pgmap v1544: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:55.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:39:54 gibba045 bash[25517]: cluster 2021-03-10T14:39:53.111470+0000 mgr.gibba045.orlgmj (mgr.34412) 2727 : cluster [DBG] pgmap v1544: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:56.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:39:55 gibba015 bash[29377]: audit 2021-03-10T14:39:55.182974+0000 mon.c (mon.1) 805 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:39:56.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:39:55 gibba015 bash[29377]: audit 2021-03-10T14:39:55.403482+0000 mon.a (mon.0) 970 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:39:56.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:39:55 gibba015 bash[29377]: audit 2021-03-10T14:39:55.407290+0000 mon.c (mon.1) 806 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:39:56.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:39:55 gibba015 bash[29377]: audit 2021-03-10T14:39:55.408879+0000 mon.c (mon.1) 807 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:39:56.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:39:55 gibba015 bash[29377]: audit 2021-03-10T14:39:55.410408+0000 mon.c (mon.1) 808 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:39:56.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:39:55 gibba015 bash[29377]: audit 2021-03-10T14:39:55.412023+0000 mon.c (mon.1) 809 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:39:56.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:39:55 gibba015 bash[29377]: audit 2021-03-10T14:39:55.415078+0000 mon.c (mon.1) 810 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:39:56.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:39:55 gibba015 bash[29377]: audit 2021-03-10T14:39:55.416801+0000 mon.c (mon.1) 811 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:39:56.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:39:55 gibba015 bash[30343]: audit 2021-03-10T14:39:55.182974+0000 mon.c (mon.1) 805 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:39:56.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:39:55 gibba015 bash[30343]: audit 2021-03-10T14:39:55.403482+0000 mon.a (mon.0) 970 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:39:56.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:39:55 gibba015 bash[30343]: audit 2021-03-10T14:39:55.407290+0000 mon.c (mon.1) 806 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:39:56.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:39:55 gibba015 bash[30343]: audit 2021-03-10T14:39:55.408879+0000 mon.c (mon.1) 807 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:39:56.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:39:55 gibba015 bash[30343]: audit 2021-03-10T14:39:55.410408+0000 mon.c (mon.1) 808 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:39:56.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:39:55 gibba015 bash[30343]: audit 2021-03-10T14:39:55.412023+0000 mon.c (mon.1) 809 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:39:56.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:39:55 gibba015 bash[30343]: audit 2021-03-10T14:39:55.415078+0000 mon.c (mon.1) 810 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:39:56.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:39:55 gibba015 bash[30343]: audit 2021-03-10T14:39:55.416801+0000 mon.c (mon.1) 811 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:39:56.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:39:55 gibba045 bash[25517]: audit 2021-03-10T14:39:55.182974+0000 mon.c (mon.1) 805 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:39:56.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:39:55 gibba045 bash[25517]: audit 2021-03-10T14:39:55.403482+0000 mon.a (mon.0) 970 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:39:56.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:39:55 gibba045 bash[25517]: audit 2021-03-10T14:39:55.407290+0000 mon.c (mon.1) 806 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:39:56.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:39:55 gibba045 bash[25517]: audit 2021-03-10T14:39:55.408879+0000 mon.c (mon.1) 807 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:39:56.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:39:55 gibba045 bash[25517]: audit 2021-03-10T14:39:55.410408+0000 mon.c (mon.1) 808 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:39:56.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:39:55 gibba045 bash[25517]: audit 2021-03-10T14:39:55.412023+0000 mon.c (mon.1) 809 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:39:56.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:39:55 gibba045 bash[25517]: audit 2021-03-10T14:39:55.415078+0000 mon.c (mon.1) 810 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:39:56.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:39:55 gibba045 bash[25517]: audit 2021-03-10T14:39:55.416801+0000 mon.c (mon.1) 811 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:39:57.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:39:56 gibba015 bash[30343]: cluster 2021-03-10T14:39:55.113237+0000 mgr.gibba045.orlgmj (mgr.34412) 2728 : cluster [DBG] pgmap v1545: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:57.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:39:56 gibba015 bash[30343]: cephadm 2021-03-10T14:39:55.192243+0000 mgr.gibba045.orlgmj (mgr.34412) 2729 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:39:57.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:39:56 gibba015 bash[30343]: cephadm 2021-03-10T14:39:55.194165+0000 mgr.gibba045.orlgmj (mgr.34412) 2730 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:39:57.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:39:56 gibba015 bash[30343]: cephadm 2021-03-10T14:39:55.410227+0000 mgr.gibba045.orlgmj (mgr.34412) 2731 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:39:57.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:39:56 gibba015 bash[30343]: cephadm 2021-03-10T14:39:55.412241+0000 mgr.gibba045.orlgmj (mgr.34412) 2732 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:39:57.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:39:56 gibba015 bash[30343]: cephadm 2021-03-10T14:39:55.413695+0000 mgr.gibba045.orlgmj (mgr.34412) 2733 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:39:57.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:39:56 gibba015 bash[30343]: cephadm 2021-03-10T14:39:55.413734+0000 mgr.gibba045.orlgmj (mgr.34412) 2734 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:39:57.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:39:56 gibba015 bash[30343]: cephadm 2021-03-10T14:39:55.415383+0000 mgr.gibba045.orlgmj (mgr.34412) 2735 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:39:57.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:39:56 gibba015 bash[30343]: cephadm 2021-03-10T14:39:55.415420+0000 mgr.gibba045.orlgmj (mgr.34412) 2736 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:39:57.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:39:56 gibba015 bash[30343]: cephadm 2021-03-10T14:39:55.416784+0000 mgr.gibba045.orlgmj (mgr.34412) 2737 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:39:57.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:39:56 gibba015 bash[30343]: cephadm 2021-03-10T14:39:55.418294+0000 mgr.gibba045.orlgmj (mgr.34412) 2738 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:39:57.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:39:56 gibba015 bash[30343]: cephadm 2021-03-10T14:39:55.418332+0000 mgr.gibba045.orlgmj (mgr.34412) 2739 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:39:57.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:39:56 gibba015 bash[30343]: cephadm 2021-03-10T14:39:55.419872+0000 mgr.gibba045.orlgmj (mgr.34412) 2740 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:39:57.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:39:56 gibba015 bash[30343]: cephadm 2021-03-10T14:39:55.420221+0000 mgr.gibba045.orlgmj (mgr.34412) 2741 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:39:57.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:39:56 gibba015 bash[30343]: cephadm 2021-03-10T14:39:55.421652+0000 mgr.gibba045.orlgmj (mgr.34412) 2742 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:39:57.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:39:56 gibba015 bash[30343]: cephadm 2021-03-10T14:39:55.421690+0000 mgr.gibba045.orlgmj (mgr.34412) 2743 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:39:57.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:39:56 gibba015 bash[30343]: cephadm 2021-03-10T14:39:55.421800+0000 mgr.gibba045.orlgmj (mgr.34412) 2744 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:39:57.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:39:56 gibba015 bash[29377]: cluster 2021-03-10T14:39:55.113237+0000 mgr.gibba045.orlgmj (mgr.34412) 2728 : cluster [DBG] pgmap v1545: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:57.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:39:56 gibba015 bash[29377]: cephadm 2021-03-10T14:39:55.192243+0000 mgr.gibba045.orlgmj (mgr.34412) 2729 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:39:57.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:39:56 gibba015 bash[29377]: cephadm 2021-03-10T14:39:55.194165+0000 mgr.gibba045.orlgmj (mgr.34412) 2730 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:39:57.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:39:56 gibba015 bash[29377]: cephadm 2021-03-10T14:39:55.410227+0000 mgr.gibba045.orlgmj (mgr.34412) 2731 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:39:57.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:39:56 gibba015 bash[29377]: cephadm 2021-03-10T14:39:55.412241+0000 mgr.gibba045.orlgmj (mgr.34412) 2732 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:39:57.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:39:56 gibba015 bash[29377]: cephadm 2021-03-10T14:39:55.413695+0000 mgr.gibba045.orlgmj (mgr.34412) 2733 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:39:57.230 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:39:56 gibba015 bash[29377]: cephadm 2021-03-10T14:39:55.413734+0000 mgr.gibba045.orlgmj (mgr.34412) 2734 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:39:57.230 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:39:56 gibba015 bash[29377]: cephadm 2021-03-10T14:39:55.415383+0000 mgr.gibba045.orlgmj (mgr.34412) 2735 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:39:57.230 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:39:56 gibba015 bash[29377]: cephadm 2021-03-10T14:39:55.415420+0000 mgr.gibba045.orlgmj (mgr.34412) 2736 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:39:57.230 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:39:56 gibba015 bash[29377]: cephadm 2021-03-10T14:39:55.416784+0000 mgr.gibba045.orlgmj (mgr.34412) 2737 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:39:57.231 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:39:56 gibba015 bash[29377]: cephadm 2021-03-10T14:39:55.418294+0000 mgr.gibba045.orlgmj (mgr.34412) 2738 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:39:57.231 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:39:56 gibba015 bash[29377]: cephadm 2021-03-10T14:39:55.418332+0000 mgr.gibba045.orlgmj (mgr.34412) 2739 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:39:57.231 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:39:56 gibba015 bash[29377]: cephadm 2021-03-10T14:39:55.419872+0000 mgr.gibba045.orlgmj (mgr.34412) 2740 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:39:57.231 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:39:56 gibba015 bash[29377]: cephadm 2021-03-10T14:39:55.420221+0000 mgr.gibba045.orlgmj (mgr.34412) 2741 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:39:57.231 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:39:56 gibba015 bash[29377]: cephadm 2021-03-10T14:39:55.421652+0000 mgr.gibba045.orlgmj (mgr.34412) 2742 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:39:57.232 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:39:56 gibba015 bash[29377]: cephadm 2021-03-10T14:39:55.421690+0000 mgr.gibba045.orlgmj (mgr.34412) 2743 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:39:57.232 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:39:56 gibba015 bash[29377]: cephadm 2021-03-10T14:39:55.421800+0000 mgr.gibba045.orlgmj (mgr.34412) 2744 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:39:57.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:39:56 gibba045 bash[25517]: cluster 2021-03-10T14:39:55.113237+0000 mgr.gibba045.orlgmj (mgr.34412) 2728 : cluster [DBG] pgmap v1545: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:57.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:39:56 gibba045 bash[25517]: cephadm 2021-03-10T14:39:55.192243+0000 mgr.gibba045.orlgmj (mgr.34412) 2729 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:39:57.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:39:56 gibba045 bash[25517]: cephadm 2021-03-10T14:39:55.194165+0000 mgr.gibba045.orlgmj (mgr.34412) 2730 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:39:57.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:39:56 gibba045 bash[25517]: cephadm 2021-03-10T14:39:55.410227+0000 mgr.gibba045.orlgmj (mgr.34412) 2731 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:39:57.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:39:56 gibba045 bash[25517]: cephadm 2021-03-10T14:39:55.412241+0000 mgr.gibba045.orlgmj (mgr.34412) 2732 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:39:57.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:39:56 gibba045 bash[25517]: cephadm 2021-03-10T14:39:55.413695+0000 mgr.gibba045.orlgmj (mgr.34412) 2733 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:39:57.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:39:56 gibba045 bash[25517]: cephadm 2021-03-10T14:39:55.413734+0000 mgr.gibba045.orlgmj (mgr.34412) 2734 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:39:57.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:39:56 gibba045 bash[25517]: cephadm 2021-03-10T14:39:55.415383+0000 mgr.gibba045.orlgmj (mgr.34412) 2735 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:39:57.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:39:56 gibba045 bash[25517]: cephadm 2021-03-10T14:39:55.415420+0000 mgr.gibba045.orlgmj (mgr.34412) 2736 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:39:57.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:39:56 gibba045 bash[25517]: cephadm 2021-03-10T14:39:55.416784+0000 mgr.gibba045.orlgmj (mgr.34412) 2737 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:39:57.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:39:56 gibba045 bash[25517]: cephadm 2021-03-10T14:39:55.418294+0000 mgr.gibba045.orlgmj (mgr.34412) 2738 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:39:57.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:39:56 gibba045 bash[25517]: cephadm 2021-03-10T14:39:55.418332+0000 mgr.gibba045.orlgmj (mgr.34412) 2739 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:39:57.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:39:56 gibba045 bash[25517]: cephadm 2021-03-10T14:39:55.419872+0000 mgr.gibba045.orlgmj (mgr.34412) 2740 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:39:57.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:39:56 gibba045 bash[25517]: cephadm 2021-03-10T14:39:55.420221+0000 mgr.gibba045.orlgmj (mgr.34412) 2741 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:39:57.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:39:56 gibba045 bash[25517]: cephadm 2021-03-10T14:39:55.421652+0000 mgr.gibba045.orlgmj (mgr.34412) 2742 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:39:57.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:39:56 gibba045 bash[25517]: cephadm 2021-03-10T14:39:55.421690+0000 mgr.gibba045.orlgmj (mgr.34412) 2743 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:39:57.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:39:56 gibba045 bash[25517]: cephadm 2021-03-10T14:39:55.421800+0000 mgr.gibba045.orlgmj (mgr.34412) 2744 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:39:59.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:39:58 gibba015 bash[29377]: cluster 2021-03-10T14:39:57.115018+0000 mgr.gibba045.orlgmj (mgr.34412) 2745 : cluster [DBG] pgmap v1546: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:59.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:39:58 gibba015 bash[30343]: cluster 2021-03-10T14:39:57.115018+0000 mgr.gibba045.orlgmj (mgr.34412) 2745 : cluster [DBG] pgmap v1546: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:59.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:39:58 gibba045 bash[25517]: cluster 2021-03-10T14:39:57.115018+0000 mgr.gibba045.orlgmj (mgr.34412) 2745 : cluster [DBG] pgmap v1546: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:00.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:00 gibba015 bash[29377]: debug 2021-03-10T14:39:59.994+0000 7f21beb4f700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T14:40:01.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:00 gibba015 bash[29377]: cluster 2021-03-10T14:39:59.116246+0000 mgr.gibba045.orlgmj (mgr.34412) 2746 : cluster [DBG] pgmap v1547: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:01.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:00 gibba015 bash[29377]: cluster 2021-03-10T14:40:00.000284+0000 mon.a (mon.0) 971 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T14:40:01.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:40:00 gibba015 bash[30343]: cluster 2021-03-10T14:39:59.116246+0000 mgr.gibba045.orlgmj (mgr.34412) 2746 : cluster [DBG] pgmap v1547: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:01.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:40:00 gibba015 bash[30343]: cluster 2021-03-10T14:40:00.000284+0000 mon.a (mon.0) 971 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T14:40:01.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:40:00 gibba045 bash[25517]: cluster 2021-03-10T14:39:59.116246+0000 mgr.gibba045.orlgmj (mgr.34412) 2746 : cluster [DBG] pgmap v1547: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:01.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:40:00 gibba045 bash[25517]: cluster 2021-03-10T14:40:00.000284+0000 mon.a (mon.0) 971 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T14:40:03.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:02 gibba015 bash[29377]: cluster 2021-03-10T14:40:01.118056+0000 mgr.gibba045.orlgmj (mgr.34412) 2747 : cluster [DBG] pgmap v1548: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:03.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:40:02 gibba015 bash[30343]: cluster 2021-03-10T14:40:01.118056+0000 mgr.gibba045.orlgmj (mgr.34412) 2747 : cluster [DBG] pgmap v1548: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:03.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:40:02 gibba045 bash[25517]: cluster 2021-03-10T14:40:01.118056+0000 mgr.gibba045.orlgmj (mgr.34412) 2747 : cluster [DBG] pgmap v1548: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:05.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:04 gibba015 bash[29377]: cluster 2021-03-10T14:40:03.119796+0000 mgr.gibba045.orlgmj (mgr.34412) 2748 : cluster [DBG] pgmap v1549: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:05.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:40:04 gibba015 bash[30343]: cluster 2021-03-10T14:40:03.119796+0000 mgr.gibba045.orlgmj (mgr.34412) 2748 : cluster [DBG] pgmap v1549: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:05.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:40:04 gibba045 bash[25517]: cluster 2021-03-10T14:40:03.119796+0000 mgr.gibba045.orlgmj (mgr.34412) 2748 : cluster [DBG] pgmap v1549: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:06.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:05 gibba015 bash[29377]: cluster 2021-03-10T14:40:05.121573+0000 mgr.gibba045.orlgmj (mgr.34412) 2749 : cluster [DBG] pgmap v1550: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:06.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:40:05 gibba015 bash[30343]: cluster 2021-03-10T14:40:05.121573+0000 mgr.gibba045.orlgmj (mgr.34412) 2749 : cluster [DBG] pgmap v1550: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:06.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:40:05 gibba045 bash[25517]: cluster 2021-03-10T14:40:05.121573+0000 mgr.gibba045.orlgmj (mgr.34412) 2749 : cluster [DBG] pgmap v1550: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:09.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:08 gibba015 bash[29377]: cluster 2021-03-10T14:40:07.123398+0000 mgr.gibba045.orlgmj (mgr.34412) 2750 : cluster [DBG] pgmap v1551: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:09.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:40:08 gibba015 bash[30343]: cluster 2021-03-10T14:40:07.123398+0000 mgr.gibba045.orlgmj (mgr.34412) 2750 : cluster [DBG] pgmap v1551: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:09.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:40:08 gibba045 bash[25517]: cluster 2021-03-10T14:40:07.123398+0000 mgr.gibba045.orlgmj (mgr.34412) 2750 : cluster [DBG] pgmap v1551: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:11.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:10 gibba015 bash[29377]: cluster 2021-03-10T14:40:09.124863+0000 mgr.gibba045.orlgmj (mgr.34412) 2751 : cluster [DBG] pgmap v1552: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:11.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:40:10 gibba015 bash[30343]: cluster 2021-03-10T14:40:09.124863+0000 mgr.gibba045.orlgmj (mgr.34412) 2751 : cluster [DBG] pgmap v1552: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:11.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:40:10 gibba045 bash[25517]: cluster 2021-03-10T14:40:09.124863+0000 mgr.gibba045.orlgmj (mgr.34412) 2751 : cluster [DBG] pgmap v1552: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:12.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:11 gibba015 bash[29377]: cephadm 2021-03-10T14:40:10.437944+0000 mgr.gibba045.orlgmj (mgr.34412) 2752 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:40:12.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:40:11 gibba015 bash[30343]: cephadm 2021-03-10T14:40:10.437944+0000 mgr.gibba045.orlgmj (mgr.34412) 2752 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:40:12.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:40:11 gibba045 bash[25517]: cephadm 2021-03-10T14:40:10.437944+0000 mgr.gibba045.orlgmj (mgr.34412) 2752 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:40:13.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:12 gibba015 bash[29377]: cluster 2021-03-10T14:40:11.126452+0000 mgr.gibba045.orlgmj (mgr.34412) 2753 : cluster [DBG] pgmap v1553: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:13.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:40:12 gibba015 bash[30343]: cluster 2021-03-10T14:40:11.126452+0000 mgr.gibba045.orlgmj (mgr.34412) 2753 : cluster [DBG] pgmap v1553: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:13.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:40:12 gibba045 bash[25517]: cluster 2021-03-10T14:40:11.126452+0000 mgr.gibba045.orlgmj (mgr.34412) 2753 : cluster [DBG] pgmap v1553: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:15.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:14 gibba015 bash[29377]: cluster 2021-03-10T14:40:13.127997+0000 mgr.gibba045.orlgmj (mgr.34412) 2754 : cluster [DBG] pgmap v1554: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:15.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:40:14 gibba015 bash[30343]: cluster 2021-03-10T14:40:13.127997+0000 mgr.gibba045.orlgmj (mgr.34412) 2754 : cluster [DBG] pgmap v1554: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:15.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:40:14 gibba045 bash[25517]: cluster 2021-03-10T14:40:13.127997+0000 mgr.gibba045.orlgmj (mgr.34412) 2754 : cluster [DBG] pgmap v1554: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:17.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:16 gibba015 bash[29377]: cluster 2021-03-10T14:40:15.129698+0000 mgr.gibba045.orlgmj (mgr.34412) 2755 : cluster [DBG] pgmap v1555: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:17.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:40:16 gibba015 bash[30343]: cluster 2021-03-10T14:40:15.129698+0000 mgr.gibba045.orlgmj (mgr.34412) 2755 : cluster [DBG] pgmap v1555: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:17.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:40:16 gibba045 bash[25517]: cluster 2021-03-10T14:40:15.129698+0000 mgr.gibba045.orlgmj (mgr.34412) 2755 : cluster [DBG] pgmap v1555: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:19.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:18 gibba015 bash[29377]: cluster 2021-03-10T14:40:17.131336+0000 mgr.gibba045.orlgmj (mgr.34412) 2756 : cluster [DBG] pgmap v1556: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:19.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:40:18 gibba015 bash[30343]: cluster 2021-03-10T14:40:17.131336+0000 mgr.gibba045.orlgmj (mgr.34412) 2756 : cluster [DBG] pgmap v1556: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:19.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:40:18 gibba045 bash[25517]: cluster 2021-03-10T14:40:17.131336+0000 mgr.gibba045.orlgmj (mgr.34412) 2756 : cluster [DBG] pgmap v1556: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:20.687 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:40:20.909 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:40:20.910 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (51m) 6m ago 56m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:40:20.910 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (56m) 5m ago 56m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:40:20.910 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (51m) 5m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:40:20.910 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (51m) 5m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:40:20.911 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (50m) 6m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:40:20.911 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (50m) 6m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:40:20.911 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (50m) 5m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:40:20.911 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (50m) 6m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:40:20.911 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (56m) 6m ago 56m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:40:20.912 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (56m) 5m ago 56m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:40:20.912 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (49m) 6m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:40:20.912 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (48m) 6m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:40:20.912 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (48m) 6m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:40:20.913 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (48m) 6m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:40:20.913 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (47m) 5m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:40:20.913 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (47m) 5m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:40:20.913 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (46m) 5m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:40:20.913 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (46m) 5m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:40:20.914 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (55m) 5m ago 56m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:40:20.914 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 5m ago 54m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:40:21.162 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:40:21.163 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:40:21.163 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:40:21.163 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:40:21.163 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:40:21.164 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:40:21.164 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:40:21.164 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:40:21.164 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:40:21.165 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:40:21.165 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:40:21.165 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:40:21.165 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:40:21.165 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:40:21.166 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:40:21.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:20 gibba015 bash[29377]: cluster 2021-03-10T14:40:19.132622+0000 mgr.gibba045.orlgmj (mgr.34412) 2757 : cluster [DBG] pgmap v1557: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:21.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:40:20 gibba015 bash[30343]: cluster 2021-03-10T14:40:19.132622+0000 mgr.gibba045.orlgmj (mgr.34412) 2757 : cluster [DBG] pgmap v1557: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:21.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:40:20 gibba045 bash[25517]: cluster 2021-03-10T14:40:19.132622+0000 mgr.gibba045.orlgmj (mgr.34412) 2757 : cluster [DBG] pgmap v1557: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:22.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:21 gibba015 bash[29377]: audit 2021-03-10T14:40:20.678215+0000 mgr.gibba045.orlgmj (mgr.34412) 2758 : audit [DBG] from='client.55894 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:40:22.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:21 gibba015 bash[29377]: audit 2021-03-10T14:40:20.900718+0000 mgr.gibba045.orlgmj (mgr.34412) 2759 : audit [DBG] from='client.45912 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:40:22.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:21 gibba015 bash[29377]: audit 2021-03-10T14:40:21.157528+0000 mon.a (mon.0) 972 : audit [DBG] from='client.? 172.21.2.115:0/1433252579' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:40:22.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:40:21 gibba015 bash[30343]: audit 2021-03-10T14:40:20.678215+0000 mgr.gibba045.orlgmj (mgr.34412) 2758 : audit [DBG] from='client.55894 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:40:22.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:40:21 gibba015 bash[30343]: audit 2021-03-10T14:40:20.900718+0000 mgr.gibba045.orlgmj (mgr.34412) 2759 : audit [DBG] from='client.45912 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:40:22.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:40:21 gibba015 bash[30343]: audit 2021-03-10T14:40:21.157528+0000 mon.a (mon.0) 972 : audit [DBG] from='client.? 172.21.2.115:0/1433252579' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:40:22.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:40:21 gibba045 bash[25517]: audit 2021-03-10T14:40:20.678215+0000 mgr.gibba045.orlgmj (mgr.34412) 2758 : audit [DBG] from='client.55894 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:40:22.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:40:21 gibba045 bash[25517]: audit 2021-03-10T14:40:20.900718+0000 mgr.gibba045.orlgmj (mgr.34412) 2759 : audit [DBG] from='client.45912 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:40:22.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:40:21 gibba045 bash[25517]: audit 2021-03-10T14:40:21.157528+0000 mon.a (mon.0) 972 : audit [DBG] from='client.? 172.21.2.115:0/1433252579' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:40:23.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:22 gibba015 bash[29377]: cluster 2021-03-10T14:40:21.134129+0000 mgr.gibba045.orlgmj (mgr.34412) 2760 : cluster [DBG] pgmap v1558: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:23.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:40:22 gibba015 bash[30343]: cluster 2021-03-10T14:40:21.134129+0000 mgr.gibba045.orlgmj (mgr.34412) 2760 : cluster [DBG] pgmap v1558: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:23.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:40:22 gibba045 bash[25517]: cluster 2021-03-10T14:40:21.134129+0000 mgr.gibba045.orlgmj (mgr.34412) 2760 : cluster [DBG] pgmap v1558: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:25.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:24 gibba015 bash[29377]: cluster 2021-03-10T14:40:23.135835+0000 mgr.gibba045.orlgmj (mgr.34412) 2761 : cluster [DBG] pgmap v1559: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:25.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:40:24 gibba015 bash[30343]: cluster 2021-03-10T14:40:23.135835+0000 mgr.gibba045.orlgmj (mgr.34412) 2761 : cluster [DBG] pgmap v1559: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:25.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:40:24 gibba045 bash[25517]: cluster 2021-03-10T14:40:23.135835+0000 mgr.gibba045.orlgmj (mgr.34412) 2761 : cluster [DBG] pgmap v1559: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:26.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:25 gibba015 bash[29377]: cluster 2021-03-10T14:40:25.137579+0000 mgr.gibba045.orlgmj (mgr.34412) 2762 : cluster [DBG] pgmap v1560: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:26.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:25 gibba015 bash[29377]: cephadm 2021-03-10T14:40:25.453948+0000 mgr.gibba045.orlgmj (mgr.34412) 2763 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:40:26.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:40:25 gibba015 bash[30343]: cluster 2021-03-10T14:40:25.137579+0000 mgr.gibba045.orlgmj (mgr.34412) 2762 : cluster [DBG] pgmap v1560: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:26.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:40:25 gibba015 bash[30343]: cephadm 2021-03-10T14:40:25.453948+0000 mgr.gibba045.orlgmj (mgr.34412) 2763 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:40:26.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:40:25 gibba045 bash[25517]: cluster 2021-03-10T14:40:25.137579+0000 mgr.gibba045.orlgmj (mgr.34412) 2762 : cluster [DBG] pgmap v1560: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:26.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:40:25 gibba045 bash[25517]: cephadm 2021-03-10T14:40:25.453948+0000 mgr.gibba045.orlgmj (mgr.34412) 2763 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:40:29.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:28 gibba015 bash[29377]: cluster 2021-03-10T14:40:27.138363+0000 mgr.gibba045.orlgmj (mgr.34412) 2764 : cluster [DBG] pgmap v1561: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:29.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:40:28 gibba015 bash[30343]: cluster 2021-03-10T14:40:27.138363+0000 mgr.gibba045.orlgmj (mgr.34412) 2764 : cluster [DBG] pgmap v1561: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:29.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:40:28 gibba045 bash[25517]: cluster 2021-03-10T14:40:27.138363+0000 mgr.gibba045.orlgmj (mgr.34412) 2764 : cluster [DBG] pgmap v1561: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:31.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:30 gibba015 bash[29377]: cluster 2021-03-10T14:40:29.139439+0000 mgr.gibba045.orlgmj (mgr.34412) 2765 : cluster [DBG] pgmap v1562: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:31.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:40:30 gibba015 bash[30343]: cluster 2021-03-10T14:40:29.139439+0000 mgr.gibba045.orlgmj (mgr.34412) 2765 : cluster [DBG] pgmap v1562: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:31.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:40:30 gibba045 bash[25517]: cluster 2021-03-10T14:40:29.139439+0000 mgr.gibba045.orlgmj (mgr.34412) 2765 : cluster [DBG] pgmap v1562: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:33.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:32 gibba015 bash[29377]: cluster 2021-03-10T14:40:31.141260+0000 mgr.gibba045.orlgmj (mgr.34412) 2766 : cluster [DBG] pgmap v1563: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:33.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:40:32 gibba015 bash[30343]: cluster 2021-03-10T14:40:31.141260+0000 mgr.gibba045.orlgmj (mgr.34412) 2766 : cluster [DBG] pgmap v1563: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:33.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:40:32 gibba045 bash[25517]: cluster 2021-03-10T14:40:31.141260+0000 mgr.gibba045.orlgmj (mgr.34412) 2766 : cluster [DBG] pgmap v1563: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:35.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:34 gibba015 bash[29377]: cluster 2021-03-10T14:40:33.142030+0000 mgr.gibba045.orlgmj (mgr.34412) 2767 : cluster [DBG] pgmap v1564: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:35.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:40:34 gibba015 bash[30343]: cluster 2021-03-10T14:40:33.142030+0000 mgr.gibba045.orlgmj (mgr.34412) 2767 : cluster [DBG] pgmap v1564: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:35.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:40:34 gibba045 bash[25517]: cluster 2021-03-10T14:40:33.142030+0000 mgr.gibba045.orlgmj (mgr.34412) 2767 : cluster [DBG] pgmap v1564: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:37.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:36 gibba015 bash[29377]: cluster 2021-03-10T14:40:35.143457+0000 mgr.gibba045.orlgmj (mgr.34412) 2768 : cluster [DBG] pgmap v1565: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:37.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:40:36 gibba015 bash[30343]: cluster 2021-03-10T14:40:35.143457+0000 mgr.gibba045.orlgmj (mgr.34412) 2768 : cluster [DBG] pgmap v1565: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:37.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:40:36 gibba045 bash[25517]: cluster 2021-03-10T14:40:35.143457+0000 mgr.gibba045.orlgmj (mgr.34412) 2768 : cluster [DBG] pgmap v1565: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:39.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:38 gibba015 bash[29377]: cluster 2021-03-10T14:40:37.145160+0000 mgr.gibba045.orlgmj (mgr.34412) 2769 : cluster [DBG] pgmap v1566: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:39.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:40:38 gibba015 bash[30343]: cluster 2021-03-10T14:40:37.145160+0000 mgr.gibba045.orlgmj (mgr.34412) 2769 : cluster [DBG] pgmap v1566: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:39.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:40:38 gibba045 bash[25517]: cluster 2021-03-10T14:40:37.145160+0000 mgr.gibba045.orlgmj (mgr.34412) 2769 : cluster [DBG] pgmap v1566: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:41.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:40 gibba015 bash[29377]: cluster 2021-03-10T14:40:39.146397+0000 mgr.gibba045.orlgmj (mgr.34412) 2770 : cluster [DBG] pgmap v1567: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:41.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:40:40 gibba015 bash[30343]: cluster 2021-03-10T14:40:39.146397+0000 mgr.gibba045.orlgmj (mgr.34412) 2770 : cluster [DBG] pgmap v1567: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:41.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:40:40 gibba045 bash[25517]: cluster 2021-03-10T14:40:39.146397+0000 mgr.gibba045.orlgmj (mgr.34412) 2770 : cluster [DBG] pgmap v1567: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:42.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:41 gibba015 bash[29377]: cephadm 2021-03-10T14:40:40.461311+0000 mgr.gibba045.orlgmj (mgr.34412) 2771 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:40:42.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:40:41 gibba015 bash[30343]: cephadm 2021-03-10T14:40:40.461311+0000 mgr.gibba045.orlgmj (mgr.34412) 2771 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:40:42.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:40:41 gibba045 bash[25517]: cephadm 2021-03-10T14:40:40.461311+0000 mgr.gibba045.orlgmj (mgr.34412) 2771 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:40:43.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:42 gibba015 bash[29377]: cluster 2021-03-10T14:40:41.148134+0000 mgr.gibba045.orlgmj (mgr.34412) 2772 : cluster [DBG] pgmap v1568: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:43.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:40:42 gibba015 bash[30343]: cluster 2021-03-10T14:40:41.148134+0000 mgr.gibba045.orlgmj (mgr.34412) 2772 : cluster [DBG] pgmap v1568: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:43.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:40:42 gibba045 bash[25517]: cluster 2021-03-10T14:40:41.148134+0000 mgr.gibba045.orlgmj (mgr.34412) 2772 : cluster [DBG] pgmap v1568: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:45.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:44 gibba015 bash[29377]: cluster 2021-03-10T14:40:43.149802+0000 mgr.gibba045.orlgmj (mgr.34412) 2773 : cluster [DBG] pgmap v1569: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:45.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:40:44 gibba015 bash[30343]: cluster 2021-03-10T14:40:43.149802+0000 mgr.gibba045.orlgmj (mgr.34412) 2773 : cluster [DBG] pgmap v1569: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:45.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:40:44 gibba045 bash[25517]: cluster 2021-03-10T14:40:43.149802+0000 mgr.gibba045.orlgmj (mgr.34412) 2773 : cluster [DBG] pgmap v1569: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:46.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:40:45 gibba045 bash[25517]: cluster 2021-03-10T14:40:45.150555+0000 mgr.gibba045.orlgmj (mgr.34412) 2774 : cluster [DBG] pgmap v1570: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:46.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:45 gibba015 bash[29377]: cluster 2021-03-10T14:40:45.150555+0000 mgr.gibba045.orlgmj (mgr.34412) 2774 : cluster [DBG] pgmap v1570: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:46.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:40:45 gibba015 bash[30343]: cluster 2021-03-10T14:40:45.150555+0000 mgr.gibba045.orlgmj (mgr.34412) 2774 : cluster [DBG] pgmap v1570: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:49.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:48 gibba015 bash[29377]: cluster 2021-03-10T14:40:47.152192+0000 mgr.gibba045.orlgmj (mgr.34412) 2775 : cluster [DBG] pgmap v1571: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:49.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:40:48 gibba015 bash[30343]: cluster 2021-03-10T14:40:47.152192+0000 mgr.gibba045.orlgmj (mgr.34412) 2775 : cluster [DBG] pgmap v1571: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:49.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:40:48 gibba045 bash[25517]: cluster 2021-03-10T14:40:47.152192+0000 mgr.gibba045.orlgmj (mgr.34412) 2775 : cluster [DBG] pgmap v1571: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:51.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:50 gibba015 bash[29377]: cluster 2021-03-10T14:40:49.153439+0000 mgr.gibba045.orlgmj (mgr.34412) 2776 : cluster [DBG] pgmap v1572: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:51.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:40:50 gibba015 bash[30343]: cluster 2021-03-10T14:40:49.153439+0000 mgr.gibba045.orlgmj (mgr.34412) 2776 : cluster [DBG] pgmap v1572: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:51.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:40:50 gibba045 bash[25517]: cluster 2021-03-10T14:40:49.153439+0000 mgr.gibba045.orlgmj (mgr.34412) 2776 : cluster [DBG] pgmap v1572: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:51.404 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:40:51.630 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:40:51.631 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (51m) 7m ago 56m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:40:51.631 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (56m) 5m ago 56m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:40:51.631 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (52m) 5m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:40:51.632 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (52m) 5m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:40:51.632 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (51m) 7m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:40:51.632 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (51m) 7m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:40:51.632 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (50m) 5m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:40:51.632 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (50m) 7m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:40:51.633 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (57m) 7m ago 57m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:40:51.633 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (57m) 5m ago 57m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:40:51.633 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (49m) 7m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:40:51.633 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (49m) 7m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:40:51.634 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (49m) 7m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:40:51.634 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (48m) 7m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:40:51.634 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (48m) 5m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:40:51.634 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (47m) 5m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:40:51.635 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (47m) 5m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:40:51.635 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (46m) 5m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:40:51.635 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (56m) 5m ago 57m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:40:51.635 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 5m ago 55m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:40:51.880 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:40:51.880 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:40:51.881 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:40:51.881 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:40:51.881 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:40:51.881 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:40:51.881 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:40:51.882 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:40:51.882 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:40:51.882 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:40:51.882 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:40:51.883 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:40:51.883 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:40:51.883 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:40:51.883 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:40:53.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:52 gibba015 bash[29377]: cluster 2021-03-10T14:40:51.154042+0000 mgr.gibba045.orlgmj (mgr.34412) 2777 : cluster [DBG] pgmap v1573: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:53.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:52 gibba015 bash[29377]: audit 2021-03-10T14:40:51.395426+0000 mgr.gibba045.orlgmj (mgr.34412) 2778 : audit [DBG] from='client.55912 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:40:53.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:52 gibba015 bash[29377]: audit 2021-03-10T14:40:51.618316+0000 mgr.gibba045.orlgmj (mgr.34412) 2779 : audit [DBG] from='client.45930 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:40:53.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:52 gibba015 bash[29377]: audit 2021-03-10T14:40:51.876512+0000 mon.a (mon.0) 973 : audit [DBG] from='client.? 172.21.2.115:0/2371995159' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:40:53.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:52 gibba015 bash[29377]: audit 2021-03-10T14:40:52.794296+0000 mon.c (mon.1) 812 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:40:53.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:52 gibba015 bash[29377]: audit 2021-03-10T14:40:52.794932+0000 mon.c (mon.1) 813 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:40:53.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:52 gibba015 bash[29377]: audit 2021-03-10T14:40:52.795409+0000 mon.a (mon.0) 974 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:40:53.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:52 gibba015 bash[29377]: audit 2021-03-10T14:40:52.796612+0000 mon.a (mon.0) 975 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:40:53.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:52 gibba015 bash[29377]: audit 2021-03-10T14:40:52.797870+0000 mon.c (mon.1) 814 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T14:40:53.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:52 gibba015 bash[29377]: audit 2021-03-10T14:40:52.798593+0000 mon.c (mon.1) 815 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:40:53.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:52 gibba015 bash[29377]: audit 2021-03-10T14:40:52.798976+0000 mon.a (mon.0) 976 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T14:40:53.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:52 gibba015 bash[29377]: audit 2021-03-10T14:40:52.799287+0000 mon.c (mon.1) 816 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:40:53.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:52 gibba015 bash[29377]: audit 2021-03-10T14:40:52.800157+0000 mon.c (mon.1) 817 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:40:53.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:52 gibba015 bash[29377]: audit 2021-03-10T14:40:52.800627+0000 mon.a (mon.0) 977 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:40:53.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:52 gibba015 bash[29377]: audit 2021-03-10T14:40:52.801814+0000 mon.a (mon.0) 978 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:40:53.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:52 gibba015 bash[29377]: audit 2021-03-10T14:40:52.802801+0000 mon.a (mon.0) 979 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:40:53.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:40:52 gibba015 bash[30343]: cluster 2021-03-10T14:40:51.154042+0000 mgr.gibba045.orlgmj (mgr.34412) 2777 : cluster [DBG] pgmap v1573: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:53.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:40:52 gibba015 bash[30343]: audit 2021-03-10T14:40:51.395426+0000 mgr.gibba045.orlgmj (mgr.34412) 2778 : audit [DBG] from='client.55912 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:40:53.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:40:52 gibba015 bash[30343]: audit 2021-03-10T14:40:51.618316+0000 mgr.gibba045.orlgmj (mgr.34412) 2779 : audit [DBG] from='client.45930 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:40:53.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:40:52 gibba015 bash[30343]: audit 2021-03-10T14:40:51.876512+0000 mon.a (mon.0) 973 : audit [DBG] from='client.? 172.21.2.115:0/2371995159' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:40:53.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:40:52 gibba015 bash[30343]: audit 2021-03-10T14:40:52.794296+0000 mon.c (mon.1) 812 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:40:53.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:40:52 gibba015 bash[30343]: audit 2021-03-10T14:40:52.794932+0000 mon.c (mon.1) 813 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:40:53.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:40:52 gibba015 bash[30343]: audit 2021-03-10T14:40:52.795409+0000 mon.a (mon.0) 974 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:40:53.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:40:52 gibba015 bash[30343]: audit 2021-03-10T14:40:52.796612+0000 mon.a (mon.0) 975 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:40:53.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:40:52 gibba015 bash[30343]: audit 2021-03-10T14:40:52.797870+0000 mon.c (mon.1) 814 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T14:40:53.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:40:52 gibba015 bash[30343]: audit 2021-03-10T14:40:52.798593+0000 mon.c (mon.1) 815 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:40:53.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:40:52 gibba015 bash[30343]: audit 2021-03-10T14:40:52.798976+0000 mon.a (mon.0) 976 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T14:40:53.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:40:52 gibba015 bash[30343]: audit 2021-03-10T14:40:52.799287+0000 mon.c (mon.1) 816 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:40:53.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:40:52 gibba015 bash[30343]: audit 2021-03-10T14:40:52.800157+0000 mon.c (mon.1) 817 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:40:53.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:40:52 gibba015 bash[30343]: audit 2021-03-10T14:40:52.800627+0000 mon.a (mon.0) 977 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:40:53.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:40:52 gibba015 bash[30343]: audit 2021-03-10T14:40:52.801814+0000 mon.a (mon.0) 978 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:40:53.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:40:52 gibba015 bash[30343]: audit 2021-03-10T14:40:52.802801+0000 mon.a (mon.0) 979 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:40:53.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:40:52 gibba045 bash[25517]: cluster 2021-03-10T14:40:51.154042+0000 mgr.gibba045.orlgmj (mgr.34412) 2777 : cluster [DBG] pgmap v1573: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:53.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:40:52 gibba045 bash[25517]: audit 2021-03-10T14:40:51.395426+0000 mgr.gibba045.orlgmj (mgr.34412) 2778 : audit [DBG] from='client.55912 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:40:53.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:40:52 gibba045 bash[25517]: audit 2021-03-10T14:40:51.618316+0000 mgr.gibba045.orlgmj (mgr.34412) 2779 : audit [DBG] from='client.45930 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:40:53.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:40:52 gibba045 bash[25517]: audit 2021-03-10T14:40:51.876512+0000 mon.a (mon.0) 973 : audit [DBG] from='client.? 172.21.2.115:0/2371995159' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:40:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:40:52 gibba045 bash[25517]: audit 2021-03-10T14:40:52.794296+0000 mon.c (mon.1) 812 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:40:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:40:52 gibba045 bash[25517]: audit 2021-03-10T14:40:52.794932+0000 mon.c (mon.1) 813 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:40:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:40:52 gibba045 bash[25517]: audit 2021-03-10T14:40:52.795409+0000 mon.a (mon.0) 974 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:40:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:40:52 gibba045 bash[25517]: audit 2021-03-10T14:40:52.796612+0000 mon.a (mon.0) 975 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:40:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:40:52 gibba045 bash[25517]: audit 2021-03-10T14:40:52.797870+0000 mon.c (mon.1) 814 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T14:40:53.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:40:52 gibba045 bash[25517]: audit 2021-03-10T14:40:52.798593+0000 mon.c (mon.1) 815 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:40:53.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:40:52 gibba045 bash[25517]: audit 2021-03-10T14:40:52.798976+0000 mon.a (mon.0) 976 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T14:40:53.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:40:52 gibba045 bash[25517]: audit 2021-03-10T14:40:52.799287+0000 mon.c (mon.1) 816 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:40:53.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:40:52 gibba045 bash[25517]: audit 2021-03-10T14:40:52.800157+0000 mon.c (mon.1) 817 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:40:53.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:40:52 gibba045 bash[25517]: audit 2021-03-10T14:40:52.800627+0000 mon.a (mon.0) 977 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:40:53.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:40:52 gibba045 bash[25517]: audit 2021-03-10T14:40:52.801814+0000 mon.a (mon.0) 978 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:40:53.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:40:52 gibba045 bash[25517]: audit 2021-03-10T14:40:52.802801+0000 mon.a (mon.0) 979 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:40:55.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:54 gibba015 bash[29377]: cluster 2021-03-10T14:40:53.155539+0000 mgr.gibba045.orlgmj (mgr.34412) 2780 : cluster [DBG] pgmap v1574: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:55.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:40:54 gibba015 bash[30343]: cluster 2021-03-10T14:40:53.155539+0000 mgr.gibba045.orlgmj (mgr.34412) 2780 : cluster [DBG] pgmap v1574: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:55.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:40:54 gibba045 bash[25517]: cluster 2021-03-10T14:40:53.155539+0000 mgr.gibba045.orlgmj (mgr.34412) 2780 : cluster [DBG] pgmap v1574: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:56.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:55 gibba015 bash[29377]: audit 2021-03-10T14:40:55.474382+0000 mon.c (mon.1) 818 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:40:56.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:55 gibba015 bash[29377]: audit 2021-03-10T14:40:55.668736+0000 mon.a (mon.0) 980 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:40:56.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:55 gibba015 bash[29377]: audit 2021-03-10T14:40:55.674947+0000 mon.a (mon.0) 981 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:40:56.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:55 gibba015 bash[29377]: audit 2021-03-10T14:40:55.875601+0000 mon.a (mon.0) 982 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:40:56.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:55 gibba015 bash[29377]: audit 2021-03-10T14:40:55.879139+0000 mon.c (mon.1) 819 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:40:56.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:55 gibba015 bash[29377]: audit 2021-03-10T14:40:55.880651+0000 mon.c (mon.1) 820 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:40:56.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:55 gibba015 bash[29377]: audit 2021-03-10T14:40:55.882036+0000 mon.c (mon.1) 821 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:40:56.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:55 gibba015 bash[29377]: audit 2021-03-10T14:40:55.883126+0000 mon.c (mon.1) 822 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:40:56.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:40:55 gibba015 bash[30343]: audit 2021-03-10T14:40:55.474382+0000 mon.c (mon.1) 818 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:40:56.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:40:55 gibba015 bash[30343]: audit 2021-03-10T14:40:55.668736+0000 mon.a (mon.0) 980 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:40:56.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:40:55 gibba015 bash[30343]: audit 2021-03-10T14:40:55.674947+0000 mon.a (mon.0) 981 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:40:56.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:40:55 gibba015 bash[30343]: audit 2021-03-10T14:40:55.875601+0000 mon.a (mon.0) 982 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:40:56.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:40:55 gibba015 bash[30343]: audit 2021-03-10T14:40:55.879139+0000 mon.c (mon.1) 819 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:40:56.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:40:55 gibba015 bash[30343]: audit 2021-03-10T14:40:55.880651+0000 mon.c (mon.1) 820 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:40:56.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:40:55 gibba015 bash[30343]: audit 2021-03-10T14:40:55.882036+0000 mon.c (mon.1) 821 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:40:56.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:40:55 gibba015 bash[30343]: audit 2021-03-10T14:40:55.883126+0000 mon.c (mon.1) 822 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:40:56.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:40:55 gibba045 bash[25517]: audit 2021-03-10T14:40:55.474382+0000 mon.c (mon.1) 818 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:40:56.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:40:55 gibba045 bash[25517]: audit 2021-03-10T14:40:55.668736+0000 mon.a (mon.0) 980 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:40:56.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:40:55 gibba045 bash[25517]: audit 2021-03-10T14:40:55.674947+0000 mon.a (mon.0) 981 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:40:56.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:40:55 gibba045 bash[25517]: audit 2021-03-10T14:40:55.875601+0000 mon.a (mon.0) 982 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:40:56.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:40:55 gibba045 bash[25517]: audit 2021-03-10T14:40:55.879139+0000 mon.c (mon.1) 819 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:40:56.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:40:55 gibba045 bash[25517]: audit 2021-03-10T14:40:55.880651+0000 mon.c (mon.1) 820 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:40:56.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:40:55 gibba045 bash[25517]: audit 2021-03-10T14:40:55.882036+0000 mon.c (mon.1) 821 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:40:56.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:40:55 gibba045 bash[25517]: audit 2021-03-10T14:40:55.883126+0000 mon.c (mon.1) 822 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:40:57.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:56 gibba015 bash[29377]: cluster 2021-03-10T14:40:55.157003+0000 mgr.gibba045.orlgmj (mgr.34412) 2781 : cluster [DBG] pgmap v1575: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:57.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:56 gibba015 bash[29377]: cephadm 2021-03-10T14:40:55.673407+0000 mgr.gibba045.orlgmj (mgr.34412) 2782 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:40:57.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:56 gibba015 bash[29377]: cephadm 2021-03-10T14:40:55.679634+0000 mgr.gibba045.orlgmj (mgr.34412) 2783 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:40:57.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:56 gibba015 bash[29377]: cephadm 2021-03-10T14:40:55.882167+0000 mgr.gibba045.orlgmj (mgr.34412) 2784 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:40:57.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:56 gibba015 bash[29377]: cephadm 2021-03-10T14:40:55.883875+0000 mgr.gibba045.orlgmj (mgr.34412) 2785 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:40:57.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:56 gibba015 bash[29377]: cephadm 2021-03-10T14:40:55.885122+0000 mgr.gibba045.orlgmj (mgr.34412) 2786 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:40:57.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:56 gibba015 bash[29377]: cephadm 2021-03-10T14:40:55.885156+0000 mgr.gibba045.orlgmj (mgr.34412) 2787 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:40:57.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:56 gibba015 bash[29377]: cephadm 2021-03-10T14:40:55.886407+0000 mgr.gibba045.orlgmj (mgr.34412) 2788 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:40:57.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:56 gibba015 bash[29377]: cephadm 2021-03-10T14:40:55.886446+0000 mgr.gibba045.orlgmj (mgr.34412) 2789 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:40:57.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:56 gibba015 bash[29377]: audit 2021-03-10T14:40:55.887347+0000 mon.c (mon.1) 823 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:40:57.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:56 gibba015 bash[29377]: cephadm 2021-03-10T14:40:55.887525+0000 mgr.gibba045.orlgmj (mgr.34412) 2790 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:40:57.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:56 gibba015 bash[29377]: audit 2021-03-10T14:40:55.889973+0000 mon.c (mon.1) 824 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:40:57.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:56 gibba015 bash[29377]: cephadm 2021-03-10T14:40:55.890415+0000 mgr.gibba045.orlgmj (mgr.34412) 2791 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:40:57.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:56 gibba015 bash[29377]: cephadm 2021-03-10T14:40:55.890501+0000 mgr.gibba045.orlgmj (mgr.34412) 2792 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:40:57.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:56 gibba015 bash[29377]: cephadm 2021-03-10T14:40:55.893043+0000 mgr.gibba045.orlgmj (mgr.34412) 2793 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:40:57.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:56 gibba015 bash[29377]: cephadm 2021-03-10T14:40:55.893391+0000 mgr.gibba045.orlgmj (mgr.34412) 2794 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:40:57.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:56 gibba015 bash[29377]: cephadm 2021-03-10T14:40:55.894161+0000 mgr.gibba045.orlgmj (mgr.34412) 2795 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:40:57.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:56 gibba015 bash[29377]: cephadm 2021-03-10T14:40:55.894200+0000 mgr.gibba045.orlgmj (mgr.34412) 2796 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:40:57.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:56 gibba015 bash[29377]: cephadm 2021-03-10T14:40:55.894340+0000 mgr.gibba045.orlgmj (mgr.34412) 2797 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:40:57.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:40:56 gibba015 bash[30343]: cluster 2021-03-10T14:40:55.157003+0000 mgr.gibba045.orlgmj (mgr.34412) 2781 : cluster [DBG] pgmap v1575: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:57.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:40:56 gibba015 bash[30343]: cephadm 2021-03-10T14:40:55.673407+0000 mgr.gibba045.orlgmj (mgr.34412) 2782 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:40:57.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:40:56 gibba015 bash[30343]: cephadm 2021-03-10T14:40:55.679634+0000 mgr.gibba045.orlgmj (mgr.34412) 2783 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:40:57.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:40:56 gibba015 bash[30343]: cephadm 2021-03-10T14:40:55.882167+0000 mgr.gibba045.orlgmj (mgr.34412) 2784 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:40:57.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:40:56 gibba015 bash[30343]: cephadm 2021-03-10T14:40:55.883875+0000 mgr.gibba045.orlgmj (mgr.34412) 2785 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:40:57.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:40:56 gibba015 bash[30343]: cephadm 2021-03-10T14:40:55.885122+0000 mgr.gibba045.orlgmj (mgr.34412) 2786 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:40:57.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:40:56 gibba015 bash[30343]: cephadm 2021-03-10T14:40:55.885156+0000 mgr.gibba045.orlgmj (mgr.34412) 2787 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:40:57.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:40:56 gibba015 bash[30343]: cephadm 2021-03-10T14:40:55.886407+0000 mgr.gibba045.orlgmj (mgr.34412) 2788 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:40:57.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:40:56 gibba015 bash[30343]: cephadm 2021-03-10T14:40:55.886446+0000 mgr.gibba045.orlgmj (mgr.34412) 2789 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:40:57.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:40:56 gibba015 bash[30343]: audit 2021-03-10T14:40:55.887347+0000 mon.c (mon.1) 823 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:40:57.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:40:56 gibba015 bash[30343]: cephadm 2021-03-10T14:40:55.887525+0000 mgr.gibba045.orlgmj (mgr.34412) 2790 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:40:57.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:40:56 gibba015 bash[30343]: audit 2021-03-10T14:40:55.889973+0000 mon.c (mon.1) 824 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:40:57.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:40:56 gibba015 bash[30343]: cephadm 2021-03-10T14:40:55.890415+0000 mgr.gibba045.orlgmj (mgr.34412) 2791 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:40:57.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:40:56 gibba015 bash[30343]: cephadm 2021-03-10T14:40:55.890501+0000 mgr.gibba045.orlgmj (mgr.34412) 2792 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:40:57.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:40:56 gibba015 bash[30343]: cephadm 2021-03-10T14:40:55.893043+0000 mgr.gibba045.orlgmj (mgr.34412) 2793 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:40:57.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:40:56 gibba015 bash[30343]: cephadm 2021-03-10T14:40:55.893391+0000 mgr.gibba045.orlgmj (mgr.34412) 2794 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:40:57.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:40:56 gibba015 bash[30343]: cephadm 2021-03-10T14:40:55.894161+0000 mgr.gibba045.orlgmj (mgr.34412) 2795 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:40:57.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:40:56 gibba015 bash[30343]: cephadm 2021-03-10T14:40:55.894200+0000 mgr.gibba045.orlgmj (mgr.34412) 2796 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:40:57.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:40:56 gibba015 bash[30343]: cephadm 2021-03-10T14:40:55.894340+0000 mgr.gibba045.orlgmj (mgr.34412) 2797 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:40:57.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:40:56 gibba045 bash[25517]: cluster 2021-03-10T14:40:55.157003+0000 mgr.gibba045.orlgmj (mgr.34412) 2781 : cluster [DBG] pgmap v1575: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:57.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:40:56 gibba045 bash[25517]: cephadm 2021-03-10T14:40:55.673407+0000 mgr.gibba045.orlgmj (mgr.34412) 2782 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:40:57.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:40:56 gibba045 bash[25517]: cephadm 2021-03-10T14:40:55.679634+0000 mgr.gibba045.orlgmj (mgr.34412) 2783 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:40:57.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:40:56 gibba045 bash[25517]: cephadm 2021-03-10T14:40:55.882167+0000 mgr.gibba045.orlgmj (mgr.34412) 2784 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:40:57.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:40:56 gibba045 bash[25517]: cephadm 2021-03-10T14:40:55.883875+0000 mgr.gibba045.orlgmj (mgr.34412) 2785 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:40:57.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:40:56 gibba045 bash[25517]: cephadm 2021-03-10T14:40:55.885122+0000 mgr.gibba045.orlgmj (mgr.34412) 2786 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:40:57.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:40:56 gibba045 bash[25517]: cephadm 2021-03-10T14:40:55.885156+0000 mgr.gibba045.orlgmj (mgr.34412) 2787 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:40:57.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:40:56 gibba045 bash[25517]: cephadm 2021-03-10T14:40:55.886407+0000 mgr.gibba045.orlgmj (mgr.34412) 2788 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:40:57.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:40:56 gibba045 bash[25517]: cephadm 2021-03-10T14:40:55.886446+0000 mgr.gibba045.orlgmj (mgr.34412) 2789 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:40:57.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:40:56 gibba045 bash[25517]: audit 2021-03-10T14:40:55.887347+0000 mon.c (mon.1) 823 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:40:57.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:40:56 gibba045 bash[25517]: cephadm 2021-03-10T14:40:55.887525+0000 mgr.gibba045.orlgmj (mgr.34412) 2790 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:40:57.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:40:56 gibba045 bash[25517]: audit 2021-03-10T14:40:55.889973+0000 mon.c (mon.1) 824 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:40:57.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:40:56 gibba045 bash[25517]: cephadm 2021-03-10T14:40:55.890415+0000 mgr.gibba045.orlgmj (mgr.34412) 2791 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:40:57.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:40:56 gibba045 bash[25517]: cephadm 2021-03-10T14:40:55.890501+0000 mgr.gibba045.orlgmj (mgr.34412) 2792 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:40:57.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:40:56 gibba045 bash[25517]: cephadm 2021-03-10T14:40:55.893043+0000 mgr.gibba045.orlgmj (mgr.34412) 2793 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:40:57.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:40:56 gibba045 bash[25517]: cephadm 2021-03-10T14:40:55.893391+0000 mgr.gibba045.orlgmj (mgr.34412) 2794 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:40:57.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:40:56 gibba045 bash[25517]: cephadm 2021-03-10T14:40:55.894161+0000 mgr.gibba045.orlgmj (mgr.34412) 2795 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:40:57.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:40:56 gibba045 bash[25517]: cephadm 2021-03-10T14:40:55.894200+0000 mgr.gibba045.orlgmj (mgr.34412) 2796 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:40:57.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:40:56 gibba045 bash[25517]: cephadm 2021-03-10T14:40:55.894340+0000 mgr.gibba045.orlgmj (mgr.34412) 2797 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:40:59.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:40:58 gibba015 bash[29377]: cluster 2021-03-10T14:40:57.158618+0000 mgr.gibba045.orlgmj (mgr.34412) 2798 : cluster [DBG] pgmap v1576: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:59.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:40:58 gibba015 bash[30343]: cluster 2021-03-10T14:40:57.158618+0000 mgr.gibba045.orlgmj (mgr.34412) 2798 : cluster [DBG] pgmap v1576: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:59.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:40:58 gibba045 bash[25517]: cluster 2021-03-10T14:40:57.158618+0000 mgr.gibba045.orlgmj (mgr.34412) 2798 : cluster [DBG] pgmap v1576: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:01.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:41:00 gibba015 bash[29377]: cluster 2021-03-10T14:40:59.159860+0000 mgr.gibba045.orlgmj (mgr.34412) 2799 : cluster [DBG] pgmap v1577: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:01.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:41:00 gibba015 bash[30343]: cluster 2021-03-10T14:40:59.159860+0000 mgr.gibba045.orlgmj (mgr.34412) 2799 : cluster [DBG] pgmap v1577: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:01.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:41:00 gibba045 bash[25517]: cluster 2021-03-10T14:40:59.159860+0000 mgr.gibba045.orlgmj (mgr.34412) 2799 : cluster [DBG] pgmap v1577: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:03.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:41:02 gibba015 bash[29377]: cluster 2021-03-10T14:41:01.161418+0000 mgr.gibba045.orlgmj (mgr.34412) 2800 : cluster [DBG] pgmap v1578: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:03.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:41:02 gibba015 bash[30343]: cluster 2021-03-10T14:41:01.161418+0000 mgr.gibba045.orlgmj (mgr.34412) 2800 : cluster [DBG] pgmap v1578: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:03.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:41:02 gibba045 bash[25517]: cluster 2021-03-10T14:41:01.161418+0000 mgr.gibba045.orlgmj (mgr.34412) 2800 : cluster [DBG] pgmap v1578: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:05.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:41:04 gibba015 bash[29377]: cluster 2021-03-10T14:41:03.162087+0000 mgr.gibba045.orlgmj (mgr.34412) 2801 : cluster [DBG] pgmap v1579: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:05.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:41:04 gibba015 bash[30343]: cluster 2021-03-10T14:41:03.162087+0000 mgr.gibba045.orlgmj (mgr.34412) 2801 : cluster [DBG] pgmap v1579: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:05.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:41:04 gibba045 bash[25517]: cluster 2021-03-10T14:41:03.162087+0000 mgr.gibba045.orlgmj (mgr.34412) 2801 : cluster [DBG] pgmap v1579: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:07.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:41:06 gibba015 bash[29377]: cluster 2021-03-10T14:41:05.163515+0000 mgr.gibba045.orlgmj (mgr.34412) 2802 : cluster [DBG] pgmap v1580: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:07.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:41:06 gibba015 bash[30343]: cluster 2021-03-10T14:41:05.163515+0000 mgr.gibba045.orlgmj (mgr.34412) 2802 : cluster [DBG] pgmap v1580: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:07.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:41:06 gibba045 bash[25517]: cluster 2021-03-10T14:41:05.163515+0000 mgr.gibba045.orlgmj (mgr.34412) 2802 : cluster [DBG] pgmap v1580: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:09.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:41:08 gibba015 bash[29377]: cluster 2021-03-10T14:41:07.165205+0000 mgr.gibba045.orlgmj (mgr.34412) 2803 : cluster [DBG] pgmap v1581: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:09.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:41:08 gibba015 bash[30343]: cluster 2021-03-10T14:41:07.165205+0000 mgr.gibba045.orlgmj (mgr.34412) 2803 : cluster [DBG] pgmap v1581: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:09.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:41:08 gibba045 bash[25517]: cluster 2021-03-10T14:41:07.165205+0000 mgr.gibba045.orlgmj (mgr.34412) 2803 : cluster [DBG] pgmap v1581: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:11.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:41:10 gibba015 bash[29377]: cluster 2021-03-10T14:41:09.165745+0000 mgr.gibba045.orlgmj (mgr.34412) 2804 : cluster [DBG] pgmap v1582: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:11.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:41:10 gibba015 bash[30343]: cluster 2021-03-10T14:41:09.165745+0000 mgr.gibba045.orlgmj (mgr.34412) 2804 : cluster [DBG] pgmap v1582: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:11.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:41:10 gibba045 bash[25517]: cluster 2021-03-10T14:41:09.165745+0000 mgr.gibba045.orlgmj (mgr.34412) 2804 : cluster [DBG] pgmap v1582: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:12.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:41:11 gibba015 bash[29377]: cephadm 2021-03-10T14:41:10.905674+0000 mgr.gibba045.orlgmj (mgr.34412) 2805 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:41:12.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:41:11 gibba015 bash[30343]: cephadm 2021-03-10T14:41:10.905674+0000 mgr.gibba045.orlgmj (mgr.34412) 2805 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:41:12.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:41:11 gibba045 bash[25517]: cephadm 2021-03-10T14:41:10.905674+0000 mgr.gibba045.orlgmj (mgr.34412) 2805 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:41:13.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:41:12 gibba015 bash[29377]: cluster 2021-03-10T14:41:11.167261+0000 mgr.gibba045.orlgmj (mgr.34412) 2806 : cluster [DBG] pgmap v1583: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:13.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:41:12 gibba015 bash[30343]: cluster 2021-03-10T14:41:11.167261+0000 mgr.gibba045.orlgmj (mgr.34412) 2806 : cluster [DBG] pgmap v1583: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:13.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:41:12 gibba045 bash[25517]: cluster 2021-03-10T14:41:11.167261+0000 mgr.gibba045.orlgmj (mgr.34412) 2806 : cluster [DBG] pgmap v1583: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:15.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:41:14 gibba015 bash[29377]: cluster 2021-03-10T14:41:13.168862+0000 mgr.gibba045.orlgmj (mgr.34412) 2807 : cluster [DBG] pgmap v1584: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:15.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:41:14 gibba015 bash[30343]: cluster 2021-03-10T14:41:13.168862+0000 mgr.gibba045.orlgmj (mgr.34412) 2807 : cluster [DBG] pgmap v1584: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:15.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:41:14 gibba045 bash[25517]: cluster 2021-03-10T14:41:13.168862+0000 mgr.gibba045.orlgmj (mgr.34412) 2807 : cluster [DBG] pgmap v1584: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:17.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:41:16 gibba015 bash[29377]: cluster 2021-03-10T14:41:15.169565+0000 mgr.gibba045.orlgmj (mgr.34412) 2808 : cluster [DBG] pgmap v1585: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:17.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:41:16 gibba015 bash[30343]: cluster 2021-03-10T14:41:15.169565+0000 mgr.gibba045.orlgmj (mgr.34412) 2808 : cluster [DBG] pgmap v1585: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:17.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:41:16 gibba045 bash[25517]: cluster 2021-03-10T14:41:15.169565+0000 mgr.gibba045.orlgmj (mgr.34412) 2808 : cluster [DBG] pgmap v1585: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:19.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:41:18 gibba015 bash[29377]: cluster 2021-03-10T14:41:17.170980+0000 mgr.gibba045.orlgmj (mgr.34412) 2809 : cluster [DBG] pgmap v1586: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:19.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:41:18 gibba015 bash[30343]: cluster 2021-03-10T14:41:17.170980+0000 mgr.gibba045.orlgmj (mgr.34412) 2809 : cluster [DBG] pgmap v1586: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:19.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:41:18 gibba045 bash[25517]: cluster 2021-03-10T14:41:17.170980+0000 mgr.gibba045.orlgmj (mgr.34412) 2809 : cluster [DBG] pgmap v1586: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:21.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:41:20 gibba015 bash[29377]: cluster 2021-03-10T14:41:19.172263+0000 mgr.gibba045.orlgmj (mgr.34412) 2810 : cluster [DBG] pgmap v1587: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:21.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:41:20 gibba015 bash[30343]: cluster 2021-03-10T14:41:19.172263+0000 mgr.gibba045.orlgmj (mgr.34412) 2810 : cluster [DBG] pgmap v1587: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:21.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:41:20 gibba045 bash[25517]: cluster 2021-03-10T14:41:19.172263+0000 mgr.gibba045.orlgmj (mgr.34412) 2810 : cluster [DBG] pgmap v1587: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:22.124 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:41:22.351 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:41:22.351 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (52m) 7m ago 57m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:41:22.351 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (57m) 6m ago 57m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:41:22.352 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (52m) 6m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:41:22.352 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (52m) 6m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:41:22.352 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (51m) 7m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:41:22.352 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (51m) 7m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:41:22.352 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (51m) 6m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:41:22.353 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (51m) 7m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:41:22.353 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (57m) 7m ago 57m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:41:22.353 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (57m) 6m ago 57m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:41:22.353 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (50m) 7m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:41:22.354 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (49m) 7m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:41:22.354 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (49m) 7m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:41:22.354 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (49m) 7m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:41:22.354 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (48m) 6m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:41:22.354 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (48m) 6m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:41:22.355 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (47m) 6m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:41:22.355 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (47m) 6m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:41:22.355 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (56m) 6m ago 57m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:41:22.355 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 6m ago 55m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:41:22.597 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:41:22.598 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:41:22.598 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:41:22.599 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:41:22.599 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:41:22.599 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:41:22.599 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:41:22.599 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:41:22.600 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:41:22.600 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:41:22.600 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:41:22.600 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:41:22.601 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:41:22.601 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:41:22.601 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:41:23.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:41:22 gibba015 bash[29377]: cluster 2021-03-10T14:41:21.173013+0000 mgr.gibba045.orlgmj (mgr.34412) 2811 : cluster [DBG] pgmap v1588: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:23.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:41:22 gibba015 bash[29377]: audit 2021-03-10T14:41:22.593924+0000 mon.a (mon.0) 983 : audit [DBG] from='client.? 172.21.2.115:0/3564261371' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:41:23.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:41:22 gibba015 bash[30343]: cluster 2021-03-10T14:41:21.173013+0000 mgr.gibba045.orlgmj (mgr.34412) 2811 : cluster [DBG] pgmap v1588: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:23.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:41:22 gibba015 bash[30343]: audit 2021-03-10T14:41:22.593924+0000 mon.a (mon.0) 983 : audit [DBG] from='client.? 172.21.2.115:0/3564261371' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:41:23.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:41:22 gibba045 bash[25517]: cluster 2021-03-10T14:41:21.173013+0000 mgr.gibba045.orlgmj (mgr.34412) 2811 : cluster [DBG] pgmap v1588: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:23.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:41:22 gibba045 bash[25517]: audit 2021-03-10T14:41:22.593924+0000 mon.a (mon.0) 983 : audit [DBG] from='client.? 172.21.2.115:0/3564261371' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:41:24.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:41:23 gibba015 bash[29377]: audit 2021-03-10T14:41:22.115512+0000 mgr.gibba045.orlgmj (mgr.34412) 2812 : audit [DBG] from='client.45942 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:41:24.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:41:23 gibba015 bash[29377]: audit 2021-03-10T14:41:22.338549+0000 mgr.gibba045.orlgmj (mgr.34412) 2813 : audit [DBG] from='client.55936 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:41:24.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:41:23 gibba015 bash[30343]: audit 2021-03-10T14:41:22.115512+0000 mgr.gibba045.orlgmj (mgr.34412) 2812 : audit [DBG] from='client.45942 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:41:24.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:41:23 gibba015 bash[30343]: audit 2021-03-10T14:41:22.338549+0000 mgr.gibba045.orlgmj (mgr.34412) 2813 : audit [DBG] from='client.55936 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:41:24.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:41:23 gibba045 bash[25517]: audit 2021-03-10T14:41:22.115512+0000 mgr.gibba045.orlgmj (mgr.34412) 2812 : audit [DBG] from='client.45942 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:41:24.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:41:23 gibba045 bash[25517]: audit 2021-03-10T14:41:22.338549+0000 mgr.gibba045.orlgmj (mgr.34412) 2813 : audit [DBG] from='client.55936 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:41:25.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:41:24 gibba015 bash[29377]: cluster 2021-03-10T14:41:23.174281+0000 mgr.gibba045.orlgmj (mgr.34412) 2814 : cluster [DBG] pgmap v1589: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:25.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:41:24 gibba015 bash[30343]: cluster 2021-03-10T14:41:23.174281+0000 mgr.gibba045.orlgmj (mgr.34412) 2814 : cluster [DBG] pgmap v1589: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:25.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:41:24 gibba045 bash[25517]: cluster 2021-03-10T14:41:23.174281+0000 mgr.gibba045.orlgmj (mgr.34412) 2814 : cluster [DBG] pgmap v1589: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:26.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:41:25 gibba015 bash[29377]: cluster 2021-03-10T14:41:25.176018+0000 mgr.gibba045.orlgmj (mgr.34412) 2815 : cluster [DBG] pgmap v1590: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:26.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:41:25 gibba015 bash[29377]: cephadm 2021-03-10T14:41:25.921551+0000 mgr.gibba045.orlgmj (mgr.34412) 2816 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:41:26.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:41:25 gibba015 bash[30343]: cluster 2021-03-10T14:41:25.176018+0000 mgr.gibba045.orlgmj (mgr.34412) 2815 : cluster [DBG] pgmap v1590: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:26.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:41:25 gibba015 bash[30343]: cephadm 2021-03-10T14:41:25.921551+0000 mgr.gibba045.orlgmj (mgr.34412) 2816 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:41:26.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:41:25 gibba045 bash[25517]: cluster 2021-03-10T14:41:25.176018+0000 mgr.gibba045.orlgmj (mgr.34412) 2815 : cluster [DBG] pgmap v1590: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:26.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:41:25 gibba045 bash[25517]: cephadm 2021-03-10T14:41:25.921551+0000 mgr.gibba045.orlgmj (mgr.34412) 2816 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:41:29.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:41:28 gibba015 bash[29377]: cluster 2021-03-10T14:41:27.176912+0000 mgr.gibba045.orlgmj (mgr.34412) 2817 : cluster [DBG] pgmap v1591: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:29.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:41:28 gibba015 bash[30343]: cluster 2021-03-10T14:41:27.176912+0000 mgr.gibba045.orlgmj (mgr.34412) 2817 : cluster [DBG] pgmap v1591: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:29.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:41:28 gibba045 bash[25517]: cluster 2021-03-10T14:41:27.176912+0000 mgr.gibba045.orlgmj (mgr.34412) 2817 : cluster [DBG] pgmap v1591: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:31.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:41:30 gibba015 bash[29377]: cluster 2021-03-10T14:41:29.178152+0000 mgr.gibba045.orlgmj (mgr.34412) 2818 : cluster [DBG] pgmap v1592: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:31.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:41:30 gibba015 bash[30343]: cluster 2021-03-10T14:41:29.178152+0000 mgr.gibba045.orlgmj (mgr.34412) 2818 : cluster [DBG] pgmap v1592: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:31.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:41:30 gibba045 bash[25517]: cluster 2021-03-10T14:41:29.178152+0000 mgr.gibba045.orlgmj (mgr.34412) 2818 : cluster [DBG] pgmap v1592: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:33.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:41:32 gibba015 bash[29377]: cluster 2021-03-10T14:41:31.179919+0000 mgr.gibba045.orlgmj (mgr.34412) 2819 : cluster [DBG] pgmap v1593: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:33.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:41:32 gibba015 bash[30343]: cluster 2021-03-10T14:41:31.179919+0000 mgr.gibba045.orlgmj (mgr.34412) 2819 : cluster [DBG] pgmap v1593: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:33.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:41:32 gibba045 bash[25517]: cluster 2021-03-10T14:41:31.179919+0000 mgr.gibba045.orlgmj (mgr.34412) 2819 : cluster [DBG] pgmap v1593: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:35.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:41:34 gibba015 bash[29377]: cluster 2021-03-10T14:41:33.181567+0000 mgr.gibba045.orlgmj (mgr.34412) 2820 : cluster [DBG] pgmap v1594: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:35.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:41:34 gibba015 bash[30343]: cluster 2021-03-10T14:41:33.181567+0000 mgr.gibba045.orlgmj (mgr.34412) 2820 : cluster [DBG] pgmap v1594: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:35.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:41:34 gibba045 bash[25517]: cluster 2021-03-10T14:41:33.181567+0000 mgr.gibba045.orlgmj (mgr.34412) 2820 : cluster [DBG] pgmap v1594: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:37.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:41:36 gibba015 bash[29377]: cluster 2021-03-10T14:41:35.183238+0000 mgr.gibba045.orlgmj (mgr.34412) 2821 : cluster [DBG] pgmap v1595: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:37.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:41:36 gibba015 bash[30343]: cluster 2021-03-10T14:41:35.183238+0000 mgr.gibba045.orlgmj (mgr.34412) 2821 : cluster [DBG] pgmap v1595: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:37.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:41:36 gibba045 bash[25517]: cluster 2021-03-10T14:41:35.183238+0000 mgr.gibba045.orlgmj (mgr.34412) 2821 : cluster [DBG] pgmap v1595: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:39.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:41:38 gibba015 bash[29377]: cluster 2021-03-10T14:41:37.184796+0000 mgr.gibba045.orlgmj (mgr.34412) 2822 : cluster [DBG] pgmap v1596: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:39.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:41:38 gibba015 bash[30343]: cluster 2021-03-10T14:41:37.184796+0000 mgr.gibba045.orlgmj (mgr.34412) 2822 : cluster [DBG] pgmap v1596: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:39.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:41:38 gibba045 bash[25517]: cluster 2021-03-10T14:41:37.184796+0000 mgr.gibba045.orlgmj (mgr.34412) 2822 : cluster [DBG] pgmap v1596: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:41.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:41:40 gibba015 bash[29377]: cluster 2021-03-10T14:41:39.185740+0000 mgr.gibba045.orlgmj (mgr.34412) 2823 : cluster [DBG] pgmap v1597: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:41.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:41:40 gibba015 bash[30343]: cluster 2021-03-10T14:41:39.185740+0000 mgr.gibba045.orlgmj (mgr.34412) 2823 : cluster [DBG] pgmap v1597: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:41.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:41:40 gibba045 bash[25517]: cluster 2021-03-10T14:41:39.185740+0000 mgr.gibba045.orlgmj (mgr.34412) 2823 : cluster [DBG] pgmap v1597: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:42.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:41:41 gibba015 bash[29377]: cephadm 2021-03-10T14:41:40.937339+0000 mgr.gibba045.orlgmj (mgr.34412) 2824 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:41:42.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:41:41 gibba015 bash[30343]: cephadm 2021-03-10T14:41:40.937339+0000 mgr.gibba045.orlgmj (mgr.34412) 2824 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:41:42.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:41:41 gibba045 bash[25517]: cephadm 2021-03-10T14:41:40.937339+0000 mgr.gibba045.orlgmj (mgr.34412) 2824 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:41:43.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:41:42 gibba015 bash[29377]: cluster 2021-03-10T14:41:41.187289+0000 mgr.gibba045.orlgmj (mgr.34412) 2825 : cluster [DBG] pgmap v1598: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:43.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:41:42 gibba015 bash[30343]: cluster 2021-03-10T14:41:41.187289+0000 mgr.gibba045.orlgmj (mgr.34412) 2825 : cluster [DBG] pgmap v1598: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:43.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:41:42 gibba045 bash[25517]: cluster 2021-03-10T14:41:41.187289+0000 mgr.gibba045.orlgmj (mgr.34412) 2825 : cluster [DBG] pgmap v1598: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:44.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:41:43 gibba015 bash[29377]: cluster 2021-03-10T14:41:43.189007+0000 mgr.gibba045.orlgmj (mgr.34412) 2826 : cluster [DBG] pgmap v1599: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:44.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:41:43 gibba015 bash[30343]: cluster 2021-03-10T14:41:43.189007+0000 mgr.gibba045.orlgmj (mgr.34412) 2826 : cluster [DBG] pgmap v1599: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:44.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:41:43 gibba045 bash[25517]: cluster 2021-03-10T14:41:43.189007+0000 mgr.gibba045.orlgmj (mgr.34412) 2826 : cluster [DBG] pgmap v1599: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:46.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:41:46 gibba045 bash[25517]: cluster 2021-03-10T14:41:45.190037+0000 mgr.gibba045.orlgmj (mgr.34412) 2827 : cluster [DBG] pgmap v1600: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:46.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:41:46 gibba015 bash[29377]: cluster 2021-03-10T14:41:45.190037+0000 mgr.gibba045.orlgmj (mgr.34412) 2827 : cluster [DBG] pgmap v1600: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:46.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:41:46 gibba015 bash[30343]: cluster 2021-03-10T14:41:45.190037+0000 mgr.gibba045.orlgmj (mgr.34412) 2827 : cluster [DBG] pgmap v1600: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:49.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:41:48 gibba015 bash[29377]: cluster 2021-03-10T14:41:47.191435+0000 mgr.gibba045.orlgmj (mgr.34412) 2828 : cluster [DBG] pgmap v1601: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:49.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:41:48 gibba015 bash[30343]: cluster 2021-03-10T14:41:47.191435+0000 mgr.gibba045.orlgmj (mgr.34412) 2828 : cluster [DBG] pgmap v1601: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:49.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:41:48 gibba045 bash[25517]: cluster 2021-03-10T14:41:47.191435+0000 mgr.gibba045.orlgmj (mgr.34412) 2828 : cluster [DBG] pgmap v1601: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:51.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:41:50 gibba015 bash[29377]: cluster 2021-03-10T14:41:49.192683+0000 mgr.gibba045.orlgmj (mgr.34412) 2829 : cluster [DBG] pgmap v1602: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:51.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:41:50 gibba015 bash[30343]: cluster 2021-03-10T14:41:49.192683+0000 mgr.gibba045.orlgmj (mgr.34412) 2829 : cluster [DBG] pgmap v1602: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:51.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:41:50 gibba045 bash[25517]: cluster 2021-03-10T14:41:49.192683+0000 mgr.gibba045.orlgmj (mgr.34412) 2829 : cluster [DBG] pgmap v1602: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:52.840 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:41:53.071 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:41:53.072 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (52m) 8m ago 57m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:41:53.072 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (57m) 6m ago 57m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:41:53.072 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (53m) 6m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:41:53.072 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (53m) 6m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:41:53.073 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (52m) 8m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:41:53.073 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (52m) 8m ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:41:53.073 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (51m) 6m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:41:53.073 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (51m) 8m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:41:53.073 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (58m) 8m ago 58m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:41:53.074 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (58m) 6m ago 58m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:41:53.074 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (50m) 8m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:41:53.074 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (50m) 8m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:41:53.074 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (50m) 8m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:41:53.075 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (49m) 8m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:41:53.075 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (49m) 6m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:41:53.075 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (48m) 6m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:41:53.075 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (48m) 6m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:41:53.075 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (47m) 6m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:41:53.076 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (57m) 6m ago 58m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:41:53.076 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 6m ago 56m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:41:53.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:41:52 gibba015 bash[29377]: cluster 2021-03-10T14:41:51.193447+0000 mgr.gibba045.orlgmj (mgr.34412) 2830 : cluster [DBG] pgmap v1603: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:53.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:41:52 gibba015 bash[29377]: audit 2021-03-10T14:41:52.801835+0000 mon.c (mon.1) 825 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:41:53.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:41:52 gibba015 bash[29377]: audit 2021-03-10T14:41:52.802262+0000 mon.a (mon.0) 984 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:41:53.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:41:52 gibba015 bash[29377]: audit 2021-03-10T14:41:52.802927+0000 mon.c (mon.1) 826 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:41:53.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:41:52 gibba015 bash[29377]: audit 2021-03-10T14:41:52.803190+0000 mon.a (mon.0) 985 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:41:53.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:41:52 gibba015 bash[29377]: audit 2021-03-10T14:41:52.803682+0000 mon.c (mon.1) 827 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T14:41:53.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:41:52 gibba015 bash[29377]: audit 2021-03-10T14:41:52.803812+0000 mon.c (mon.1) 828 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:41:53.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:41:52 gibba015 bash[29377]: audit 2021-03-10T14:41:52.804001+0000 mon.c (mon.1) 829 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:41:53.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:41:52 gibba015 bash[29377]: audit 2021-03-10T14:41:52.804054+0000 mon.a (mon.0) 986 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T14:41:53.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:41:52 gibba015 bash[29377]: audit 2021-03-10T14:41:52.804450+0000 mon.a (mon.0) 987 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:41:53.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:41:52 gibba015 bash[29377]: audit 2021-03-10T14:41:52.804528+0000 mon.c (mon.1) 830 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:41:53.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:41:52 gibba015 bash[29377]: audit 2021-03-10T14:41:52.804684+0000 mon.a (mon.0) 988 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:41:53.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:41:52 gibba015 bash[29377]: audit 2021-03-10T14:41:52.804936+0000 mon.a (mon.0) 989 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:41:53.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:41:52 gibba015 bash[30343]: cluster 2021-03-10T14:41:51.193447+0000 mgr.gibba045.orlgmj (mgr.34412) 2830 : cluster [DBG] pgmap v1603: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:53.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:41:52 gibba015 bash[30343]: audit 2021-03-10T14:41:52.801835+0000 mon.c (mon.1) 825 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:41:53.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:41:52 gibba015 bash[30343]: audit 2021-03-10T14:41:52.802262+0000 mon.a (mon.0) 984 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:41:53.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:41:52 gibba015 bash[30343]: audit 2021-03-10T14:41:52.802927+0000 mon.c (mon.1) 826 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:41:53.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:41:52 gibba015 bash[30343]: audit 2021-03-10T14:41:52.803190+0000 mon.a (mon.0) 985 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:41:53.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:41:52 gibba015 bash[30343]: audit 2021-03-10T14:41:52.803682+0000 mon.c (mon.1) 827 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T14:41:53.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:41:52 gibba015 bash[30343]: audit 2021-03-10T14:41:52.803812+0000 mon.c (mon.1) 828 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:41:53.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:41:52 gibba015 bash[30343]: audit 2021-03-10T14:41:52.804001+0000 mon.c (mon.1) 829 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:41:53.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:41:52 gibba015 bash[30343]: audit 2021-03-10T14:41:52.804054+0000 mon.a (mon.0) 986 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T14:41:53.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:41:52 gibba015 bash[30343]: audit 2021-03-10T14:41:52.804450+0000 mon.a (mon.0) 987 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:41:53.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:41:52 gibba015 bash[30343]: audit 2021-03-10T14:41:52.804528+0000 mon.c (mon.1) 830 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:41:53.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:41:52 gibba015 bash[30343]: audit 2021-03-10T14:41:52.804684+0000 mon.a (mon.0) 988 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:41:53.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:41:52 gibba015 bash[30343]: audit 2021-03-10T14:41:52.804936+0000 mon.a (mon.0) 989 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:41:53.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:41:52 gibba045 bash[25517]: cluster 2021-03-10T14:41:51.193447+0000 mgr.gibba045.orlgmj (mgr.34412) 2830 : cluster [DBG] pgmap v1603: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:53.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:41:52 gibba045 bash[25517]: audit 2021-03-10T14:41:52.801835+0000 mon.c (mon.1) 825 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:41:53.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:41:52 gibba045 bash[25517]: audit 2021-03-10T14:41:52.802262+0000 mon.a (mon.0) 984 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:41:53.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:41:52 gibba045 bash[25517]: audit 2021-03-10T14:41:52.802927+0000 mon.c (mon.1) 826 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:41:53.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:41:52 gibba045 bash[25517]: audit 2021-03-10T14:41:52.803190+0000 mon.a (mon.0) 985 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:41:53.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:41:52 gibba045 bash[25517]: audit 2021-03-10T14:41:52.803682+0000 mon.c (mon.1) 827 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T14:41:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:41:52 gibba045 bash[25517]: audit 2021-03-10T14:41:52.803812+0000 mon.c (mon.1) 828 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:41:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:41:52 gibba045 bash[25517]: audit 2021-03-10T14:41:52.804001+0000 mon.c (mon.1) 829 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:41:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:41:52 gibba045 bash[25517]: audit 2021-03-10T14:41:52.804054+0000 mon.a (mon.0) 986 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T14:41:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:41:52 gibba045 bash[25517]: audit 2021-03-10T14:41:52.804450+0000 mon.a (mon.0) 987 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:41:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:41:52 gibba045 bash[25517]: audit 2021-03-10T14:41:52.804528+0000 mon.c (mon.1) 830 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:41:53.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:41:52 gibba045 bash[25517]: audit 2021-03-10T14:41:52.804684+0000 mon.a (mon.0) 988 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:41:53.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:41:52 gibba045 bash[25517]: audit 2021-03-10T14:41:52.804936+0000 mon.a (mon.0) 989 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:41:53.322 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:41:53.322 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:41:53.322 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:41:53.322 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:41:53.323 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:41:53.323 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:41:53.323 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:41:53.323 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:41:53.323 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:41:53.324 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:41:53.324 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:41:53.324 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:41:53.324 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:41:53.324 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:41:53.325 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:41:54.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:41:53 gibba015 bash[29377]: audit 2021-03-10T14:41:52.831597+0000 mgr.gibba045.orlgmj (mgr.34412) 2831 : audit [DBG] from='client.55948 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:41:54.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:41:53 gibba015 bash[29377]: audit 2021-03-10T14:41:53.318377+0000 mon.a (mon.0) 990 : audit [DBG] from='client.? 172.21.2.115:0/4256777337' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:41:54.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:41:53 gibba015 bash[30343]: audit 2021-03-10T14:41:52.831597+0000 mgr.gibba045.orlgmj (mgr.34412) 2831 : audit [DBG] from='client.55948 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:41:54.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:41:53 gibba015 bash[30343]: audit 2021-03-10T14:41:53.318377+0000 mon.a (mon.0) 990 : audit [DBG] from='client.? 172.21.2.115:0/4256777337' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:41:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:41:53 gibba045 bash[25517]: audit 2021-03-10T14:41:52.831597+0000 mgr.gibba045.orlgmj (mgr.34412) 2831 : audit [DBG] from='client.55948 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:41:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:41:53 gibba045 bash[25517]: audit 2021-03-10T14:41:53.318377+0000 mon.a (mon.0) 990 : audit [DBG] from='client.? 172.21.2.115:0/4256777337' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:41:55.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:41:54 gibba015 bash[29377]: audit 2021-03-10T14:41:53.058800+0000 mgr.gibba045.orlgmj (mgr.34412) 2832 : audit [DBG] from='client.55954 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:41:55.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:41:54 gibba015 bash[29377]: cluster 2021-03-10T14:41:53.194976+0000 mgr.gibba045.orlgmj (mgr.34412) 2833 : cluster [DBG] pgmap v1604: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:55.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:41:54 gibba015 bash[30343]: audit 2021-03-10T14:41:53.058800+0000 mgr.gibba045.orlgmj (mgr.34412) 2832 : audit [DBG] from='client.55954 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:41:55.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:41:54 gibba015 bash[30343]: cluster 2021-03-10T14:41:53.194976+0000 mgr.gibba045.orlgmj (mgr.34412) 2833 : cluster [DBG] pgmap v1604: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:55.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:41:54 gibba045 bash[25517]: audit 2021-03-10T14:41:53.058800+0000 mgr.gibba045.orlgmj (mgr.34412) 2832 : audit [DBG] from='client.55954 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:41:55.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:41:54 gibba045 bash[25517]: cluster 2021-03-10T14:41:53.194976+0000 mgr.gibba045.orlgmj (mgr.34412) 2833 : cluster [DBG] pgmap v1604: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:56.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:41:55 gibba015 bash[29377]: cluster 2021-03-10T14:41:55.196665+0000 mgr.gibba045.orlgmj (mgr.34412) 2834 : cluster [DBG] pgmap v1605: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:56.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:41:55 gibba015 bash[29377]: audit 2021-03-10T14:41:55.946493+0000 mon.c (mon.1) 831 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:41:56.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:41:55 gibba015 bash[30343]: cluster 2021-03-10T14:41:55.196665+0000 mgr.gibba045.orlgmj (mgr.34412) 2834 : cluster [DBG] pgmap v1605: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:56.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:41:55 gibba015 bash[30343]: audit 2021-03-10T14:41:55.946493+0000 mon.c (mon.1) 831 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:41:56.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:41:55 gibba045 bash[25517]: cluster 2021-03-10T14:41:55.196665+0000 mgr.gibba045.orlgmj (mgr.34412) 2834 : cluster [DBG] pgmap v1605: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:56.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:41:55 gibba045 bash[25517]: audit 2021-03-10T14:41:55.946493+0000 mon.c (mon.1) 831 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:41:57.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:41:57 gibba015 bash[29377]: cephadm 2021-03-10T14:41:55.951849+0000 mgr.gibba045.orlgmj (mgr.34412) 2835 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:41:57.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:41:57 gibba015 bash[29377]: cephadm 2021-03-10T14:41:55.952267+0000 mgr.gibba045.orlgmj (mgr.34412) 2836 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:41:57.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:41:57 gibba015 bash[29377]: audit 2021-03-10T14:41:56.156524+0000 mon.a (mon.0) 991 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:41:57.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:41:57 gibba015 bash[29377]: audit 2021-03-10T14:41:56.160304+0000 mon.c (mon.1) 832 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:41:57.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:41:57 gibba015 bash[29377]: cephadm 2021-03-10T14:41:56.162830+0000 mgr.gibba045.orlgmj (mgr.34412) 2837 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:41:57.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:41:57 gibba015 bash[29377]: audit 2021-03-10T14:41:56.162968+0000 mon.c (mon.1) 833 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:41:57.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:41:57 gibba015 bash[29377]: audit 2021-03-10T14:41:56.165534+0000 mon.c (mon.1) 834 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:41:57.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:41:57 gibba015 bash[29377]: cephadm 2021-03-10T14:41:56.165838+0000 mgr.gibba045.orlgmj (mgr.34412) 2838 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:41:57.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:41:57 gibba015 bash[29377]: audit 2021-03-10T14:41:56.168097+0000 mon.c (mon.1) 835 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:41:57.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:41:57 gibba015 bash[29377]: cephadm 2021-03-10T14:41:56.168301+0000 mgr.gibba045.orlgmj (mgr.34412) 2839 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:41:57.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:41:57 gibba015 bash[29377]: cephadm 2021-03-10T14:41:56.168366+0000 mgr.gibba045.orlgmj (mgr.34412) 2840 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:41:57.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:41:57 gibba015 bash[29377]: cephadm 2021-03-10T14:41:56.170866+0000 mgr.gibba045.orlgmj (mgr.34412) 2841 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:41:57.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:41:57 gibba015 bash[29377]: cephadm 2021-03-10T14:41:56.171012+0000 mgr.gibba045.orlgmj (mgr.34412) 2842 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:41:57.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:41:57 gibba015 bash[29377]: cephadm 2021-03-10T14:41:56.173386+0000 mgr.gibba045.orlgmj (mgr.34412) 2843 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:41:57.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:41:57 gibba015 bash[29377]: audit 2021-03-10T14:41:56.174159+0000 mon.c (mon.1) 836 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:41:57.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:41:57 gibba015 bash[29377]: audit 2021-03-10T14:41:56.176719+0000 mon.c (mon.1) 837 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:41:57.479 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:41:57 gibba015 bash[29377]: cephadm 2021-03-10T14:41:56.176938+0000 mgr.gibba045.orlgmj (mgr.34412) 2844 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:41:57.479 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:41:57 gibba015 bash[29377]: cephadm 2021-03-10T14:41:56.176974+0000 mgr.gibba045.orlgmj (mgr.34412) 2845 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:41:57.479 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:41:57 gibba015 bash[29377]: cephadm 2021-03-10T14:41:56.179369+0000 mgr.gibba045.orlgmj (mgr.34412) 2846 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:41:57.479 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:41:57 gibba015 bash[29377]: cephadm 2021-03-10T14:41:56.179680+0000 mgr.gibba045.orlgmj (mgr.34412) 2847 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:41:57.479 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:41:57 gibba015 bash[29377]: cephadm 2021-03-10T14:41:56.181928+0000 mgr.gibba045.orlgmj (mgr.34412) 2848 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:41:57.480 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:41:57 gibba015 bash[29377]: cephadm 2021-03-10T14:41:56.181965+0000 mgr.gibba045.orlgmj (mgr.34412) 2849 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:41:57.480 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:41:57 gibba015 bash[29377]: cephadm 2021-03-10T14:41:56.182072+0000 mgr.gibba045.orlgmj (mgr.34412) 2850 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:41:57.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:41:57 gibba015 bash[30343]: cephadm 2021-03-10T14:41:55.951849+0000 mgr.gibba045.orlgmj (mgr.34412) 2835 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:41:57.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:41:57 gibba015 bash[30343]: cephadm 2021-03-10T14:41:55.952267+0000 mgr.gibba045.orlgmj (mgr.34412) 2836 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:41:57.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:41:57 gibba015 bash[30343]: audit 2021-03-10T14:41:56.156524+0000 mon.a (mon.0) 991 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:41:57.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:41:57 gibba015 bash[30343]: audit 2021-03-10T14:41:56.160304+0000 mon.c (mon.1) 832 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:41:57.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:41:57 gibba015 bash[30343]: cephadm 2021-03-10T14:41:56.162830+0000 mgr.gibba045.orlgmj (mgr.34412) 2837 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:41:57.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:41:57 gibba015 bash[30343]: audit 2021-03-10T14:41:56.162968+0000 mon.c (mon.1) 833 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:41:57.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:41:57 gibba015 bash[30343]: audit 2021-03-10T14:41:56.165534+0000 mon.c (mon.1) 834 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:41:57.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:41:57 gibba015 bash[30343]: cephadm 2021-03-10T14:41:56.165838+0000 mgr.gibba045.orlgmj (mgr.34412) 2838 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:41:57.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:41:57 gibba015 bash[30343]: audit 2021-03-10T14:41:56.168097+0000 mon.c (mon.1) 835 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:41:57.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:41:57 gibba015 bash[30343]: cephadm 2021-03-10T14:41:56.168301+0000 mgr.gibba045.orlgmj (mgr.34412) 2839 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:41:57.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:41:57 gibba015 bash[30343]: cephadm 2021-03-10T14:41:56.168366+0000 mgr.gibba045.orlgmj (mgr.34412) 2840 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:41:57.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:41:57 gibba015 bash[30343]: cephadm 2021-03-10T14:41:56.170866+0000 mgr.gibba045.orlgmj (mgr.34412) 2841 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:41:57.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:41:57 gibba015 bash[30343]: cephadm 2021-03-10T14:41:56.171012+0000 mgr.gibba045.orlgmj (mgr.34412) 2842 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:41:57.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:41:57 gibba015 bash[30343]: cephadm 2021-03-10T14:41:56.173386+0000 mgr.gibba045.orlgmj (mgr.34412) 2843 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:41:57.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:41:57 gibba015 bash[30343]: audit 2021-03-10T14:41:56.174159+0000 mon.c (mon.1) 836 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:41:57.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:41:57 gibba015 bash[30343]: audit 2021-03-10T14:41:56.176719+0000 mon.c (mon.1) 837 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:41:57.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:41:57 gibba015 bash[30343]: cephadm 2021-03-10T14:41:56.176938+0000 mgr.gibba045.orlgmj (mgr.34412) 2844 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:41:57.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:41:57 gibba015 bash[30343]: cephadm 2021-03-10T14:41:56.176974+0000 mgr.gibba045.orlgmj (mgr.34412) 2845 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:41:57.485 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:41:57 gibba015 bash[30343]: cephadm 2021-03-10T14:41:56.179369+0000 mgr.gibba045.orlgmj (mgr.34412) 2846 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:41:57.485 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:41:57 gibba015 bash[30343]: cephadm 2021-03-10T14:41:56.179680+0000 mgr.gibba045.orlgmj (mgr.34412) 2847 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:41:57.485 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:41:57 gibba015 bash[30343]: cephadm 2021-03-10T14:41:56.181928+0000 mgr.gibba045.orlgmj (mgr.34412) 2848 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:41:57.485 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:41:57 gibba015 bash[30343]: cephadm 2021-03-10T14:41:56.181965+0000 mgr.gibba045.orlgmj (mgr.34412) 2849 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:41:57.486 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:41:57 gibba015 bash[30343]: cephadm 2021-03-10T14:41:56.182072+0000 mgr.gibba045.orlgmj (mgr.34412) 2850 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:41:57.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:41:57 gibba045 bash[25517]: cephadm 2021-03-10T14:41:55.951849+0000 mgr.gibba045.orlgmj (mgr.34412) 2835 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:41:57.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:41:57 gibba045 bash[25517]: cephadm 2021-03-10T14:41:55.952267+0000 mgr.gibba045.orlgmj (mgr.34412) 2836 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:41:57.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:41:57 gibba045 bash[25517]: audit 2021-03-10T14:41:56.156524+0000 mon.a (mon.0) 991 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:41:57.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:41:57 gibba045 bash[25517]: audit 2021-03-10T14:41:56.160304+0000 mon.c (mon.1) 832 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:41:57.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:41:57 gibba045 bash[25517]: cephadm 2021-03-10T14:41:56.162830+0000 mgr.gibba045.orlgmj (mgr.34412) 2837 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:41:57.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:41:57 gibba045 bash[25517]: audit 2021-03-10T14:41:56.162968+0000 mon.c (mon.1) 833 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:41:57.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:41:57 gibba045 bash[25517]: audit 2021-03-10T14:41:56.165534+0000 mon.c (mon.1) 834 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:41:57.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:41:57 gibba045 bash[25517]: cephadm 2021-03-10T14:41:56.165838+0000 mgr.gibba045.orlgmj (mgr.34412) 2838 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:41:57.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:41:57 gibba045 bash[25517]: audit 2021-03-10T14:41:56.168097+0000 mon.c (mon.1) 835 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:41:57.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:41:57 gibba045 bash[25517]: cephadm 2021-03-10T14:41:56.168301+0000 mgr.gibba045.orlgmj (mgr.34412) 2839 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:41:57.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:41:57 gibba045 bash[25517]: cephadm 2021-03-10T14:41:56.168366+0000 mgr.gibba045.orlgmj (mgr.34412) 2840 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:41:57.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:41:57 gibba045 bash[25517]: cephadm 2021-03-10T14:41:56.170866+0000 mgr.gibba045.orlgmj (mgr.34412) 2841 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:41:57.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:41:57 gibba045 bash[25517]: cephadm 2021-03-10T14:41:56.171012+0000 mgr.gibba045.orlgmj (mgr.34412) 2842 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:41:57.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:41:57 gibba045 bash[25517]: cephadm 2021-03-10T14:41:56.173386+0000 mgr.gibba045.orlgmj (mgr.34412) 2843 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:41:57.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:41:57 gibba045 bash[25517]: audit 2021-03-10T14:41:56.174159+0000 mon.c (mon.1) 836 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:41:57.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:41:57 gibba045 bash[25517]: audit 2021-03-10T14:41:56.176719+0000 mon.c (mon.1) 837 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:41:57.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:41:57 gibba045 bash[25517]: cephadm 2021-03-10T14:41:56.176938+0000 mgr.gibba045.orlgmj (mgr.34412) 2844 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:41:57.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:41:57 gibba045 bash[25517]: cephadm 2021-03-10T14:41:56.176974+0000 mgr.gibba045.orlgmj (mgr.34412) 2845 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:41:57.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:41:57 gibba045 bash[25517]: cephadm 2021-03-10T14:41:56.179369+0000 mgr.gibba045.orlgmj (mgr.34412) 2846 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:41:57.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:41:57 gibba045 bash[25517]: cephadm 2021-03-10T14:41:56.179680+0000 mgr.gibba045.orlgmj (mgr.34412) 2847 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:41:57.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:41:57 gibba045 bash[25517]: cephadm 2021-03-10T14:41:56.181928+0000 mgr.gibba045.orlgmj (mgr.34412) 2848 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:41:57.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:41:57 gibba045 bash[25517]: cephadm 2021-03-10T14:41:56.181965+0000 mgr.gibba045.orlgmj (mgr.34412) 2849 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:41:57.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:41:57 gibba045 bash[25517]: cephadm 2021-03-10T14:41:56.182072+0000 mgr.gibba045.orlgmj (mgr.34412) 2850 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:41:59.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:41:58 gibba015 bash[29377]: cluster 2021-03-10T14:41:57.197249+0000 mgr.gibba045.orlgmj (mgr.34412) 2851 : cluster [DBG] pgmap v1606: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:59.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:41:58 gibba015 bash[30343]: cluster 2021-03-10T14:41:57.197249+0000 mgr.gibba045.orlgmj (mgr.34412) 2851 : cluster [DBG] pgmap v1606: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:59.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:41:58 gibba045 bash[25517]: cluster 2021-03-10T14:41:57.197249+0000 mgr.gibba045.orlgmj (mgr.34412) 2851 : cluster [DBG] pgmap v1606: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:01.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:42:00 gibba015 bash[29377]: cluster 2021-03-10T14:41:59.198352+0000 mgr.gibba045.orlgmj (mgr.34412) 2852 : cluster [DBG] pgmap v1607: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:01.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:42:00 gibba015 bash[30343]: cluster 2021-03-10T14:41:59.198352+0000 mgr.gibba045.orlgmj (mgr.34412) 2852 : cluster [DBG] pgmap v1607: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:01.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:42:00 gibba045 bash[25517]: cluster 2021-03-10T14:41:59.198352+0000 mgr.gibba045.orlgmj (mgr.34412) 2852 : cluster [DBG] pgmap v1607: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:03.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:42:02 gibba015 bash[29377]: cluster 2021-03-10T14:42:01.200139+0000 mgr.gibba045.orlgmj (mgr.34412) 2853 : cluster [DBG] pgmap v1608: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:03.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:42:02 gibba015 bash[30343]: cluster 2021-03-10T14:42:01.200139+0000 mgr.gibba045.orlgmj (mgr.34412) 2853 : cluster [DBG] pgmap v1608: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:03.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:42:02 gibba045 bash[25517]: cluster 2021-03-10T14:42:01.200139+0000 mgr.gibba045.orlgmj (mgr.34412) 2853 : cluster [DBG] pgmap v1608: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:05.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:42:04 gibba015 bash[29377]: cluster 2021-03-10T14:42:03.200902+0000 mgr.gibba045.orlgmj (mgr.34412) 2854 : cluster [DBG] pgmap v1609: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:05.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:42:04 gibba015 bash[30343]: cluster 2021-03-10T14:42:03.200902+0000 mgr.gibba045.orlgmj (mgr.34412) 2854 : cluster [DBG] pgmap v1609: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:05.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:42:04 gibba045 bash[25517]: cluster 2021-03-10T14:42:03.200902+0000 mgr.gibba045.orlgmj (mgr.34412) 2854 : cluster [DBG] pgmap v1609: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:07.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:42:06 gibba015 bash[29377]: cluster 2021-03-10T14:42:05.202465+0000 mgr.gibba045.orlgmj (mgr.34412) 2855 : cluster [DBG] pgmap v1610: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:07.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:42:06 gibba015 bash[30343]: cluster 2021-03-10T14:42:05.202465+0000 mgr.gibba045.orlgmj (mgr.34412) 2855 : cluster [DBG] pgmap v1610: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:07.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:42:06 gibba045 bash[25517]: cluster 2021-03-10T14:42:05.202465+0000 mgr.gibba045.orlgmj (mgr.34412) 2855 : cluster [DBG] pgmap v1610: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:09.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:42:08 gibba015 bash[29377]: cluster 2021-03-10T14:42:07.204092+0000 mgr.gibba045.orlgmj (mgr.34412) 2856 : cluster [DBG] pgmap v1611: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:09.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:42:08 gibba015 bash[30343]: cluster 2021-03-10T14:42:07.204092+0000 mgr.gibba045.orlgmj (mgr.34412) 2856 : cluster [DBG] pgmap v1611: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:09.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:42:08 gibba045 bash[25517]: cluster 2021-03-10T14:42:07.204092+0000 mgr.gibba045.orlgmj (mgr.34412) 2856 : cluster [DBG] pgmap v1611: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:11.198 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:42:10 gibba045 bash[25517]: cluster 2021-03-10T14:42:09.205273+0000 mgr.gibba045.orlgmj (mgr.34412) 2857 : cluster [DBG] pgmap v1612: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:11.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:42:10 gibba015 bash[29377]: cluster 2021-03-10T14:42:09.205273+0000 mgr.gibba045.orlgmj (mgr.34412) 2857 : cluster [DBG] pgmap v1612: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:11.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:42:10 gibba015 bash[30343]: cluster 2021-03-10T14:42:09.205273+0000 mgr.gibba045.orlgmj (mgr.34412) 2857 : cluster [DBG] pgmap v1612: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:13.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:42:12 gibba015 bash[29377]: cephadm 2021-03-10T14:42:11.197943+0000 mgr.gibba045.orlgmj (mgr.34412) 2858 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:42:13.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:42:12 gibba015 bash[29377]: cluster 2021-03-10T14:42:11.206779+0000 mgr.gibba045.orlgmj (mgr.34412) 2859 : cluster [DBG] pgmap v1613: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:13.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:42:12 gibba015 bash[30343]: cephadm 2021-03-10T14:42:11.197943+0000 mgr.gibba045.orlgmj (mgr.34412) 2858 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:42:13.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:42:12 gibba015 bash[30343]: cluster 2021-03-10T14:42:11.206779+0000 mgr.gibba045.orlgmj (mgr.34412) 2859 : cluster [DBG] pgmap v1613: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:13.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:42:12 gibba045 bash[25517]: cephadm 2021-03-10T14:42:11.197943+0000 mgr.gibba045.orlgmj (mgr.34412) 2858 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:42:13.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:42:12 gibba045 bash[25517]: cluster 2021-03-10T14:42:11.206779+0000 mgr.gibba045.orlgmj (mgr.34412) 2859 : cluster [DBG] pgmap v1613: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:15.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:42:14 gibba015 bash[29377]: cluster 2021-03-10T14:42:13.208609+0000 mgr.gibba045.orlgmj (mgr.34412) 2860 : cluster [DBG] pgmap v1614: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:15.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:42:14 gibba015 bash[30343]: cluster 2021-03-10T14:42:13.208609+0000 mgr.gibba045.orlgmj (mgr.34412) 2860 : cluster [DBG] pgmap v1614: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:15.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:42:14 gibba045 bash[25517]: cluster 2021-03-10T14:42:13.208609+0000 mgr.gibba045.orlgmj (mgr.34412) 2860 : cluster [DBG] pgmap v1614: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:17.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:42:16 gibba015 bash[29377]: cluster 2021-03-10T14:42:15.209792+0000 mgr.gibba045.orlgmj (mgr.34412) 2861 : cluster [DBG] pgmap v1615: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:17.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:42:16 gibba015 bash[30343]: cluster 2021-03-10T14:42:15.209792+0000 mgr.gibba045.orlgmj (mgr.34412) 2861 : cluster [DBG] pgmap v1615: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:17.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:42:16 gibba045 bash[25517]: cluster 2021-03-10T14:42:15.209792+0000 mgr.gibba045.orlgmj (mgr.34412) 2861 : cluster [DBG] pgmap v1615: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:19.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:42:18 gibba015 bash[29377]: cluster 2021-03-10T14:42:17.211331+0000 mgr.gibba045.orlgmj (mgr.34412) 2862 : cluster [DBG] pgmap v1616: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:19.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:42:18 gibba015 bash[30343]: cluster 2021-03-10T14:42:17.211331+0000 mgr.gibba045.orlgmj (mgr.34412) 2862 : cluster [DBG] pgmap v1616: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:19.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:42:18 gibba045 bash[25517]: cluster 2021-03-10T14:42:17.211331+0000 mgr.gibba045.orlgmj (mgr.34412) 2862 : cluster [DBG] pgmap v1616: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:21.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:42:20 gibba015 bash[29377]: cluster 2021-03-10T14:42:19.212582+0000 mgr.gibba045.orlgmj (mgr.34412) 2863 : cluster [DBG] pgmap v1617: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:21.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:42:20 gibba015 bash[30343]: cluster 2021-03-10T14:42:19.212582+0000 mgr.gibba045.orlgmj (mgr.34412) 2863 : cluster [DBG] pgmap v1617: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:21.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:42:20 gibba045 bash[25517]: cluster 2021-03-10T14:42:19.212582+0000 mgr.gibba045.orlgmj (mgr.34412) 2863 : cluster [DBG] pgmap v1617: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:23.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:42:22 gibba015 bash[29377]: cluster 2021-03-10T14:42:21.213838+0000 mgr.gibba045.orlgmj (mgr.34412) 2864 : cluster [DBG] pgmap v1618: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:23.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:42:22 gibba015 bash[30343]: cluster 2021-03-10T14:42:21.213838+0000 mgr.gibba045.orlgmj (mgr.34412) 2864 : cluster [DBG] pgmap v1618: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:23.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:42:22 gibba045 bash[25517]: cluster 2021-03-10T14:42:21.213838+0000 mgr.gibba045.orlgmj (mgr.34412) 2864 : cluster [DBG] pgmap v1618: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:23.563 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:42:23.791 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:42:23.791 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (53m) 8m ago 58m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:42:23.792 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (58m) 7m ago 58m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:42:23.792 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (53m) 7m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:42:23.792 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (53m) 7m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:42:23.792 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (52m) 8m ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:42:23.793 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (52m) 8m ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:42:23.793 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (52m) 7m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:42:23.793 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (52m) 8m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:42:23.793 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (58m) 8m ago 58m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:42:23.793 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (58m) 7m ago 58m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:42:23.794 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (51m) 8m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:42:23.794 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (50m) 8m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:42:23.794 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (50m) 8m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:42:23.794 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (50m) 8m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:42:23.795 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (49m) 7m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:42:23.795 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (49m) 7m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:42:23.795 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (48m) 7m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:42:23.795 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (48m) 7m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:42:23.796 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (57m) 7m ago 58m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:42:23.796 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 7m ago 56m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:42:24.041 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:42:24.042 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:42:24.042 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:42:24.042 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:42:24.042 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:42:24.043 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:42:24.043 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:42:24.043 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:42:24.043 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:42:24.044 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:42:24.044 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:42:24.044 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:42:24.044 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:42:24.044 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:42:24.045 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:42:25.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:42:24 gibba015 bash[29377]: cluster 2021-03-10T14:42:23.215454+0000 mgr.gibba045.orlgmj (mgr.34412) 2865 : cluster [DBG] pgmap v1619: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:25.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:42:24 gibba015 bash[29377]: audit 2021-03-10T14:42:23.555029+0000 mgr.gibba045.orlgmj (mgr.34412) 2866 : audit [DBG] from='client.55966 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:42:25.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:42:24 gibba015 bash[29377]: audit 2021-03-10T14:42:23.778042+0000 mgr.gibba045.orlgmj (mgr.34412) 2867 : audit [DBG] from='client.55972 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:42:25.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:42:24 gibba015 bash[29377]: audit 2021-03-10T14:42:24.037859+0000 mon.c (mon.1) 838 : audit [DBG] from='client.? 172.21.2.115:0/1840583848' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:42:25.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:42:24 gibba015 bash[30343]: cluster 2021-03-10T14:42:23.215454+0000 mgr.gibba045.orlgmj (mgr.34412) 2865 : cluster [DBG] pgmap v1619: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:25.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:42:24 gibba015 bash[30343]: audit 2021-03-10T14:42:23.555029+0000 mgr.gibba045.orlgmj (mgr.34412) 2866 : audit [DBG] from='client.55966 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:42:25.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:42:24 gibba015 bash[30343]: audit 2021-03-10T14:42:23.778042+0000 mgr.gibba045.orlgmj (mgr.34412) 2867 : audit [DBG] from='client.55972 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:42:25.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:42:24 gibba015 bash[30343]: audit 2021-03-10T14:42:24.037859+0000 mon.c (mon.1) 838 : audit [DBG] from='client.? 172.21.2.115:0/1840583848' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:42:25.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:42:24 gibba045 bash[25517]: cluster 2021-03-10T14:42:23.215454+0000 mgr.gibba045.orlgmj (mgr.34412) 2865 : cluster [DBG] pgmap v1619: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:25.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:42:24 gibba045 bash[25517]: audit 2021-03-10T14:42:23.555029+0000 mgr.gibba045.orlgmj (mgr.34412) 2866 : audit [DBG] from='client.55966 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:42:25.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:42:24 gibba045 bash[25517]: audit 2021-03-10T14:42:23.778042+0000 mgr.gibba045.orlgmj (mgr.34412) 2867 : audit [DBG] from='client.55972 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:42:25.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:42:24 gibba045 bash[25517]: audit 2021-03-10T14:42:24.037859+0000 mon.c (mon.1) 838 : audit [DBG] from='client.? 172.21.2.115:0/1840583848' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:42:27.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:42:26 gibba015 bash[29377]: cluster 2021-03-10T14:42:25.217021+0000 mgr.gibba045.orlgmj (mgr.34412) 2868 : cluster [DBG] pgmap v1620: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:27.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:42:26 gibba015 bash[30343]: cluster 2021-03-10T14:42:25.217021+0000 mgr.gibba045.orlgmj (mgr.34412) 2868 : cluster [DBG] pgmap v1620: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:27.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:42:26 gibba045 bash[25517]: cluster 2021-03-10T14:42:25.217021+0000 mgr.gibba045.orlgmj (mgr.34412) 2868 : cluster [DBG] pgmap v1620: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:28.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:42:27 gibba015 bash[29377]: cephadm 2021-03-10T14:42:26.213963+0000 mgr.gibba045.orlgmj (mgr.34412) 2869 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:42:28.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:42:27 gibba015 bash[29377]: cluster 2021-03-10T14:42:27.218162+0000 mgr.gibba045.orlgmj (mgr.34412) 2870 : cluster [DBG] pgmap v1621: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:28.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:42:27 gibba015 bash[30343]: cephadm 2021-03-10T14:42:26.213963+0000 mgr.gibba045.orlgmj (mgr.34412) 2869 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:42:28.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:42:27 gibba015 bash[30343]: cluster 2021-03-10T14:42:27.218162+0000 mgr.gibba045.orlgmj (mgr.34412) 2870 : cluster [DBG] pgmap v1621: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:28.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:42:27 gibba045 bash[25517]: cephadm 2021-03-10T14:42:26.213963+0000 mgr.gibba045.orlgmj (mgr.34412) 2869 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:42:28.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:42:27 gibba045 bash[25517]: cluster 2021-03-10T14:42:27.218162+0000 mgr.gibba045.orlgmj (mgr.34412) 2870 : cluster [DBG] pgmap v1621: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:30.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:42:30 gibba045 bash[25517]: cluster 2021-03-10T14:42:29.219459+0000 mgr.gibba045.orlgmj (mgr.34412) 2871 : cluster [DBG] pgmap v1622: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:30.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:42:30 gibba015 bash[29377]: cluster 2021-03-10T14:42:29.219459+0000 mgr.gibba045.orlgmj (mgr.34412) 2871 : cluster [DBG] pgmap v1622: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:30.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:42:30 gibba015 bash[30343]: cluster 2021-03-10T14:42:29.219459+0000 mgr.gibba045.orlgmj (mgr.34412) 2871 : cluster [DBG] pgmap v1622: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:32.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:42:32 gibba045 bash[25517]: cluster 2021-03-10T14:42:31.221291+0000 mgr.gibba045.orlgmj (mgr.34412) 2872 : cluster [DBG] pgmap v1623: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:32.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:42:32 gibba015 bash[29377]: cluster 2021-03-10T14:42:31.221291+0000 mgr.gibba045.orlgmj (mgr.34412) 2872 : cluster [DBG] pgmap v1623: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:32.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:42:32 gibba015 bash[30343]: cluster 2021-03-10T14:42:31.221291+0000 mgr.gibba045.orlgmj (mgr.34412) 2872 : cluster [DBG] pgmap v1623: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:35.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:42:34 gibba015 bash[29377]: cluster 2021-03-10T14:42:33.222972+0000 mgr.gibba045.orlgmj (mgr.34412) 2873 : cluster [DBG] pgmap v1624: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:35.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:42:34 gibba015 bash[30343]: cluster 2021-03-10T14:42:33.222972+0000 mgr.gibba045.orlgmj (mgr.34412) 2873 : cluster [DBG] pgmap v1624: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:35.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:42:34 gibba045 bash[25517]: cluster 2021-03-10T14:42:33.222972+0000 mgr.gibba045.orlgmj (mgr.34412) 2873 : cluster [DBG] pgmap v1624: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:37.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:42:36 gibba015 bash[29377]: cluster 2021-03-10T14:42:35.224689+0000 mgr.gibba045.orlgmj (mgr.34412) 2874 : cluster [DBG] pgmap v1625: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:37.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:42:36 gibba015 bash[30343]: cluster 2021-03-10T14:42:35.224689+0000 mgr.gibba045.orlgmj (mgr.34412) 2874 : cluster [DBG] pgmap v1625: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:37.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:42:36 gibba045 bash[25517]: cluster 2021-03-10T14:42:35.224689+0000 mgr.gibba045.orlgmj (mgr.34412) 2874 : cluster [DBG] pgmap v1625: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:39.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:42:38 gibba015 bash[29377]: cluster 2021-03-10T14:42:37.226467+0000 mgr.gibba045.orlgmj (mgr.34412) 2875 : cluster [DBG] pgmap v1626: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:39.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:42:38 gibba015 bash[30343]: cluster 2021-03-10T14:42:37.226467+0000 mgr.gibba045.orlgmj (mgr.34412) 2875 : cluster [DBG] pgmap v1626: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:39.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:42:38 gibba045 bash[25517]: cluster 2021-03-10T14:42:37.226467+0000 mgr.gibba045.orlgmj (mgr.34412) 2875 : cluster [DBG] pgmap v1626: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:41.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:42:40 gibba015 bash[29377]: cluster 2021-03-10T14:42:39.227821+0000 mgr.gibba045.orlgmj (mgr.34412) 2876 : cluster [DBG] pgmap v1627: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:41.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:42:40 gibba015 bash[30343]: cluster 2021-03-10T14:42:39.227821+0000 mgr.gibba045.orlgmj (mgr.34412) 2876 : cluster [DBG] pgmap v1627: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:41.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:42:40 gibba045 bash[25517]: cluster 2021-03-10T14:42:39.227821+0000 mgr.gibba045.orlgmj (mgr.34412) 2876 : cluster [DBG] pgmap v1627: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:42.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:42:41 gibba045 bash[25517]: cephadm 2021-03-10T14:42:41.217267+0000 mgr.gibba045.orlgmj (mgr.34412) 2877 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:42:42.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:42:41 gibba045 bash[25517]: cluster 2021-03-10T14:42:41.229422+0000 mgr.gibba045.orlgmj (mgr.34412) 2878 : cluster [DBG] pgmap v1628: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:42.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:42:41 gibba015 bash[29377]: cephadm 2021-03-10T14:42:41.217267+0000 mgr.gibba045.orlgmj (mgr.34412) 2877 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:42:42.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:42:41 gibba015 bash[29377]: cluster 2021-03-10T14:42:41.229422+0000 mgr.gibba045.orlgmj (mgr.34412) 2878 : cluster [DBG] pgmap v1628: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:42.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:42:41 gibba015 bash[30343]: cephadm 2021-03-10T14:42:41.217267+0000 mgr.gibba045.orlgmj (mgr.34412) 2877 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:42:42.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:42:41 gibba015 bash[30343]: cluster 2021-03-10T14:42:41.229422+0000 mgr.gibba045.orlgmj (mgr.34412) 2878 : cluster [DBG] pgmap v1628: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:45.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:42:44 gibba015 bash[29377]: cluster 2021-03-10T14:42:43.231021+0000 mgr.gibba045.orlgmj (mgr.34412) 2879 : cluster [DBG] pgmap v1629: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:45.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:42:44 gibba015 bash[30343]: cluster 2021-03-10T14:42:43.231021+0000 mgr.gibba045.orlgmj (mgr.34412) 2879 : cluster [DBG] pgmap v1629: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:45.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:42:44 gibba045 bash[25517]: cluster 2021-03-10T14:42:43.231021+0000 mgr.gibba045.orlgmj (mgr.34412) 2879 : cluster [DBG] pgmap v1629: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:47.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:42:46 gibba015 bash[29377]: cluster 2021-03-10T14:42:45.232611+0000 mgr.gibba045.orlgmj (mgr.34412) 2880 : cluster [DBG] pgmap v1630: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:47.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:42:46 gibba015 bash[30343]: cluster 2021-03-10T14:42:45.232611+0000 mgr.gibba045.orlgmj (mgr.34412) 2880 : cluster [DBG] pgmap v1630: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:47.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:42:46 gibba045 bash[25517]: cluster 2021-03-10T14:42:45.232611+0000 mgr.gibba045.orlgmj (mgr.34412) 2880 : cluster [DBG] pgmap v1630: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:49.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:42:48 gibba015 bash[29377]: cluster 2021-03-10T14:42:47.234091+0000 mgr.gibba045.orlgmj (mgr.34412) 2881 : cluster [DBG] pgmap v1631: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:49.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:42:48 gibba015 bash[30343]: cluster 2021-03-10T14:42:47.234091+0000 mgr.gibba045.orlgmj (mgr.34412) 2881 : cluster [DBG] pgmap v1631: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:49.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:42:48 gibba045 bash[25517]: cluster 2021-03-10T14:42:47.234091+0000 mgr.gibba045.orlgmj (mgr.34412) 2881 : cluster [DBG] pgmap v1631: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:50.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:42:50 gibba045 bash[25517]: cluster 2021-03-10T14:42:49.235397+0000 mgr.gibba045.orlgmj (mgr.34412) 2882 : cluster [DBG] pgmap v1632: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:50.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:42:50 gibba015 bash[29377]: cluster 2021-03-10T14:42:49.235397+0000 mgr.gibba045.orlgmj (mgr.34412) 2882 : cluster [DBG] pgmap v1632: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:50.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:42:50 gibba015 bash[30343]: cluster 2021-03-10T14:42:49.235397+0000 mgr.gibba045.orlgmj (mgr.34412) 2882 : cluster [DBG] pgmap v1632: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:52.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:42:52 gibba045 bash[25517]: cluster 2021-03-10T14:42:51.237186+0000 mgr.gibba045.orlgmj (mgr.34412) 2883 : cluster [DBG] pgmap v1633: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:52.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:42:52 gibba015 bash[29377]: cluster 2021-03-10T14:42:51.237186+0000 mgr.gibba045.orlgmj (mgr.34412) 2883 : cluster [DBG] pgmap v1633: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:52.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:42:52 gibba015 bash[30343]: cluster 2021-03-10T14:42:51.237186+0000 mgr.gibba045.orlgmj (mgr.34412) 2883 : cluster [DBG] pgmap v1633: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:53.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:42:53 gibba015 bash[29377]: audit 2021-03-10T14:42:52.809699+0000 mon.c (mon.1) 839 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:42:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:42:53 gibba015 bash[29377]: audit 2021-03-10T14:42:52.810716+0000 mon.c (mon.1) 840 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:42:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:42:53 gibba015 bash[29377]: audit 2021-03-10T14:42:52.810783+0000 mon.a (mon.0) 992 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:42:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:42:53 gibba015 bash[29377]: audit 2021-03-10T14:42:52.811566+0000 mon.c (mon.1) 841 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T14:42:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:42:53 gibba015 bash[29377]: audit 2021-03-10T14:42:52.812021+0000 mon.a (mon.0) 993 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:42:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:42:53 gibba015 bash[29377]: audit 2021-03-10T14:42:52.812648+0000 mon.c (mon.1) 842 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:42:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:42:53 gibba015 bash[29377]: audit 2021-03-10T14:42:52.812816+0000 mon.a (mon.0) 994 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T14:42:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:42:53 gibba015 bash[29377]: audit 2021-03-10T14:42:52.813731+0000 mon.c (mon.1) 843 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:42:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:42:53 gibba015 bash[29377]: audit 2021-03-10T14:42:52.813869+0000 mon.a (mon.0) 995 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:42:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:42:53 gibba015 bash[29377]: audit 2021-03-10T14:42:52.814811+0000 mon.c (mon.1) 844 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T14:42:53.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:42:53 gibba015 bash[29377]: audit 2021-03-10T14:42:52.814868+0000 mon.a (mon.0) 996 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:42:53.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:42:53 gibba015 bash[29377]: audit 2021-03-10T14:42:52.815325+0000 mon.a (mon.0) 997 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T14:42:53.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:42:53 gibba015 bash[30343]: audit 2021-03-10T14:42:52.809699+0000 mon.c (mon.1) 839 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:42:53.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:42:53 gibba015 bash[30343]: audit 2021-03-10T14:42:52.810716+0000 mon.c (mon.1) 840 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:42:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:42:53 gibba015 bash[30343]: audit 2021-03-10T14:42:52.810783+0000 mon.a (mon.0) 992 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:42:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:42:53 gibba015 bash[30343]: audit 2021-03-10T14:42:52.811566+0000 mon.c (mon.1) 841 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T14:42:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:42:53 gibba015 bash[30343]: audit 2021-03-10T14:42:52.812021+0000 mon.a (mon.0) 993 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:42:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:42:53 gibba015 bash[30343]: audit 2021-03-10T14:42:52.812648+0000 mon.c (mon.1) 842 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:42:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:42:53 gibba015 bash[30343]: audit 2021-03-10T14:42:52.812816+0000 mon.a (mon.0) 994 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T14:42:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:42:53 gibba015 bash[30343]: audit 2021-03-10T14:42:52.813731+0000 mon.c (mon.1) 843 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:42:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:42:53 gibba015 bash[30343]: audit 2021-03-10T14:42:52.813869+0000 mon.a (mon.0) 995 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:42:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:42:53 gibba015 bash[30343]: audit 2021-03-10T14:42:52.814811+0000 mon.c (mon.1) 844 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T14:42:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:42:53 gibba015 bash[30343]: audit 2021-03-10T14:42:52.814868+0000 mon.a (mon.0) 996 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:42:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:42:53 gibba015 bash[30343]: audit 2021-03-10T14:42:52.815325+0000 mon.a (mon.0) 997 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T14:42:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:42:53 gibba045 bash[25517]: audit 2021-03-10T14:42:52.809699+0000 mon.c (mon.1) 839 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:42:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:42:53 gibba045 bash[25517]: audit 2021-03-10T14:42:52.810716+0000 mon.c (mon.1) 840 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:42:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:42:53 gibba045 bash[25517]: audit 2021-03-10T14:42:52.810783+0000 mon.a (mon.0) 992 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:42:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:42:53 gibba045 bash[25517]: audit 2021-03-10T14:42:52.811566+0000 mon.c (mon.1) 841 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T14:42:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:42:53 gibba045 bash[25517]: audit 2021-03-10T14:42:52.812021+0000 mon.a (mon.0) 993 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:42:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:42:53 gibba045 bash[25517]: audit 2021-03-10T14:42:52.812648+0000 mon.c (mon.1) 842 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:42:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:42:53 gibba045 bash[25517]: audit 2021-03-10T14:42:52.812816+0000 mon.a (mon.0) 994 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T14:42:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:42:53 gibba045 bash[25517]: audit 2021-03-10T14:42:52.813731+0000 mon.c (mon.1) 843 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:42:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:42:53 gibba045 bash[25517]: audit 2021-03-10T14:42:52.813869+0000 mon.a (mon.0) 995 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:42:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:42:53 gibba045 bash[25517]: audit 2021-03-10T14:42:52.814811+0000 mon.c (mon.1) 844 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T14:42:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:42:53 gibba045 bash[25517]: audit 2021-03-10T14:42:52.814868+0000 mon.a (mon.0) 996 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:42:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:42:53 gibba045 bash[25517]: audit 2021-03-10T14:42:52.815325+0000 mon.a (mon.0) 997 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T14:42:54.283 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:42:54.513 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:42:54.513 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (53m) 9m ago 58m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:42:54.514 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (58m) 8m ago 58m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:42:54.514 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (54m) 8m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:42:54.514 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (54m) 8m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:42:54.514 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (53m) 9m ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:42:54.514 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (53m) 9m ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:42:54.515 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (52m) 8m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:42:54.515 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (52m) 9m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:42:54.515 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (59m) 9m ago 59m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:42:54.515 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (59m) 8m ago 59m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:42:54.515 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (51m) 9m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:42:54.516 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (51m) 9m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:42:54.516 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (51m) 9m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:42:54.516 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (50m) 9m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:42:54.516 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (50m) 8m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:42:54.516 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (49m) 8m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:42:54.517 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (49m) 8m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:42:54.517 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (48m) 8m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:42:54.517 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (58m) 8m ago 59m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:42:54.517 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 8m ago 57m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:42:54.771 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:42:54.771 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:42:54.771 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:42:54.771 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:42:54.772 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:42:54.772 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:42:54.772 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:42:54.772 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:42:54.772 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:42:54.773 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:42:54.773 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:42:54.773 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:42:54.773 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:42:54.773 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:42:54.773 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:42:55.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:42:54 gibba015 bash[29377]: cluster 2021-03-10T14:42:53.238840+0000 mgr.gibba045.orlgmj (mgr.34412) 2884 : cluster [DBG] pgmap v1634: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:55.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:42:54 gibba015 bash[29377]: audit 2021-03-10T14:42:54.767271+0000 mon.c (mon.1) 845 : audit [DBG] from='client.? 172.21.2.115:0/147102324' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:42:55.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:42:54 gibba015 bash[30343]: cluster 2021-03-10T14:42:53.238840+0000 mgr.gibba045.orlgmj (mgr.34412) 2884 : cluster [DBG] pgmap v1634: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:55.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:42:54 gibba015 bash[30343]: audit 2021-03-10T14:42:54.767271+0000 mon.c (mon.1) 845 : audit [DBG] from='client.? 172.21.2.115:0/147102324' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:42:55.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:42:54 gibba045 bash[25517]: cluster 2021-03-10T14:42:53.238840+0000 mgr.gibba045.orlgmj (mgr.34412) 2884 : cluster [DBG] pgmap v1634: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:55.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:42:54 gibba045 bash[25517]: audit 2021-03-10T14:42:54.767271+0000 mon.c (mon.1) 845 : audit [DBG] from='client.? 172.21.2.115:0/147102324' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:42:56.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:42:55 gibba015 bash[29377]: audit 2021-03-10T14:42:54.273925+0000 mgr.gibba045.orlgmj (mgr.34412) 2885 : audit [DBG] from='client.55984 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:42:56.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:42:55 gibba015 bash[29377]: audit 2021-03-10T14:42:54.500707+0000 mgr.gibba045.orlgmj (mgr.34412) 2886 : audit [DBG] from='client.46002 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:42:56.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:42:55 gibba015 bash[30343]: audit 2021-03-10T14:42:54.273925+0000 mgr.gibba045.orlgmj (mgr.34412) 2885 : audit [DBG] from='client.55984 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:42:56.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:42:55 gibba015 bash[30343]: audit 2021-03-10T14:42:54.500707+0000 mgr.gibba045.orlgmj (mgr.34412) 2886 : audit [DBG] from='client.46002 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:42:56.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:42:55 gibba045 bash[25517]: audit 2021-03-10T14:42:54.273925+0000 mgr.gibba045.orlgmj (mgr.34412) 2885 : audit [DBG] from='client.55984 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:42:56.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:42:55 gibba045 bash[25517]: audit 2021-03-10T14:42:54.500707+0000 mgr.gibba045.orlgmj (mgr.34412) 2886 : audit [DBG] from='client.46002 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:42:57.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:42:56 gibba015 bash[29377]: cluster 2021-03-10T14:42:55.240379+0000 mgr.gibba045.orlgmj (mgr.34412) 2887 : cluster [DBG] pgmap v1635: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:57.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:42:56 gibba015 bash[29377]: audit 2021-03-10T14:42:56.230682+0000 mon.c (mon.1) 846 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:42:57.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:42:56 gibba015 bash[29377]: audit 2021-03-10T14:42:56.236923+0000 mon.c (mon.1) 847 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T14:42:57.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:42:56 gibba015 bash[30343]: cluster 2021-03-10T14:42:55.240379+0000 mgr.gibba045.orlgmj (mgr.34412) 2887 : cluster [DBG] pgmap v1635: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:57.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:42:56 gibba015 bash[30343]: audit 2021-03-10T14:42:56.230682+0000 mon.c (mon.1) 846 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:42:57.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:42:56 gibba015 bash[30343]: audit 2021-03-10T14:42:56.236923+0000 mon.c (mon.1) 847 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T14:42:57.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:42:56 gibba045 bash[25517]: cluster 2021-03-10T14:42:55.240379+0000 mgr.gibba045.orlgmj (mgr.34412) 2887 : cluster [DBG] pgmap v1635: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:57.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:42:56 gibba045 bash[25517]: audit 2021-03-10T14:42:56.230682+0000 mon.c (mon.1) 846 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:42:57.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:42:56 gibba045 bash[25517]: audit 2021-03-10T14:42:56.236923+0000 mon.c (mon.1) 847 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T14:42:58.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:42:57 gibba045 bash[25517]: cephadm 2021-03-10T14:42:56.240130+0000 mgr.gibba045.orlgmj (mgr.34412) 2888 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:42:58.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:42:57 gibba045 bash[25517]: cluster 2021-03-10T14:42:57.242062+0000 mgr.gibba045.orlgmj (mgr.34412) 2889 : cluster [DBG] pgmap v1636: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:58.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:42:57 gibba015 bash[29377]: cephadm 2021-03-10T14:42:56.240130+0000 mgr.gibba045.orlgmj (mgr.34412) 2888 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:42:58.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:42:57 gibba015 bash[29377]: cluster 2021-03-10T14:42:57.242062+0000 mgr.gibba045.orlgmj (mgr.34412) 2889 : cluster [DBG] pgmap v1636: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:58.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:42:57 gibba015 bash[30343]: cephadm 2021-03-10T14:42:56.240130+0000 mgr.gibba045.orlgmj (mgr.34412) 2888 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:42:58.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:42:57 gibba015 bash[30343]: cluster 2021-03-10T14:42:57.242062+0000 mgr.gibba045.orlgmj (mgr.34412) 2889 : cluster [DBG] pgmap v1636: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:00.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:43:00 gibba045 bash[25517]: cluster 2021-03-10T14:42:59.243310+0000 mgr.gibba045.orlgmj (mgr.34412) 2890 : cluster [DBG] pgmap v1637: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:00.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:43:00 gibba015 bash[29377]: cluster 2021-03-10T14:42:59.243310+0000 mgr.gibba045.orlgmj (mgr.34412) 2890 : cluster [DBG] pgmap v1637: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:00.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:43:00 gibba015 bash[30343]: cluster 2021-03-10T14:42:59.243310+0000 mgr.gibba045.orlgmj (mgr.34412) 2890 : cluster [DBG] pgmap v1637: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:01.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:43:01 gibba045 bash[25517]: audit 2021-03-10T14:43:00.891750+0000 mon.c (mon.1) 848 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:43:01.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:43:01 gibba045 bash[25517]: audit 2021-03-10T14:43:01.067967+0000 mon.a (mon.0) 998 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:43:01.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:43:01 gibba045 bash[25517]: audit 2021-03-10T14:43:01.262096+0000 mon.a (mon.0) 999 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:43:01.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:43:01 gibba045 bash[25517]: audit 2021-03-10T14:43:01.269399+0000 mon.c (mon.1) 849 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:43:01.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:43:01 gibba045 bash[25517]: audit 2021-03-10T14:43:01.271544+0000 mon.c (mon.1) 850 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:43:01.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:43:01 gibba045 bash[25517]: audit 2021-03-10T14:43:01.273592+0000 mon.c (mon.1) 851 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:43:01.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:43:01 gibba045 bash[25517]: audit 2021-03-10T14:43:01.275135+0000 mon.c (mon.1) 852 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:43:01.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:43:01 gibba045 bash[25517]: audit 2021-03-10T14:43:01.278374+0000 mon.c (mon.1) 853 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:43:01.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:43:01 gibba045 bash[25517]: audit 2021-03-10T14:43:01.280333+0000 mon.c (mon.1) 854 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:43:01.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:43:01 gibba015 bash[29377]: audit 2021-03-10T14:43:00.891750+0000 mon.c (mon.1) 848 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:43:01.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:43:01 gibba015 bash[29377]: audit 2021-03-10T14:43:01.067967+0000 mon.a (mon.0) 998 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:43:01.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:43:01 gibba015 bash[29377]: audit 2021-03-10T14:43:01.262096+0000 mon.a (mon.0) 999 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:43:01.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:43:01 gibba015 bash[29377]: audit 2021-03-10T14:43:01.269399+0000 mon.c (mon.1) 849 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:43:01.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:43:01 gibba015 bash[29377]: audit 2021-03-10T14:43:01.271544+0000 mon.c (mon.1) 850 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:43:01.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:43:01 gibba015 bash[29377]: audit 2021-03-10T14:43:01.273592+0000 mon.c (mon.1) 851 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:43:01.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:43:01 gibba015 bash[29377]: audit 2021-03-10T14:43:01.275135+0000 mon.c (mon.1) 852 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:43:01.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:43:01 gibba015 bash[29377]: audit 2021-03-10T14:43:01.278374+0000 mon.c (mon.1) 853 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:43:01.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:43:01 gibba015 bash[29377]: audit 2021-03-10T14:43:01.280333+0000 mon.c (mon.1) 854 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:43:01.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:43:01 gibba015 bash[30343]: audit 2021-03-10T14:43:00.891750+0000 mon.c (mon.1) 848 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:43:01.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:43:01 gibba015 bash[30343]: audit 2021-03-10T14:43:01.067967+0000 mon.a (mon.0) 998 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:43:01.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:43:01 gibba015 bash[30343]: audit 2021-03-10T14:43:01.262096+0000 mon.a (mon.0) 999 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:43:01.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:43:01 gibba015 bash[30343]: audit 2021-03-10T14:43:01.269399+0000 mon.c (mon.1) 849 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:43:01.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:43:01 gibba015 bash[30343]: audit 2021-03-10T14:43:01.271544+0000 mon.c (mon.1) 850 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:43:01.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:43:01 gibba015 bash[30343]: audit 2021-03-10T14:43:01.273592+0000 mon.c (mon.1) 851 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:43:01.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:43:01 gibba015 bash[30343]: audit 2021-03-10T14:43:01.275135+0000 mon.c (mon.1) 852 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:43:01.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:43:01 gibba015 bash[30343]: audit 2021-03-10T14:43:01.278374+0000 mon.c (mon.1) 853 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:43:01.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:43:01 gibba015 bash[30343]: audit 2021-03-10T14:43:01.280333+0000 mon.c (mon.1) 854 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:43:02.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:43:02 gibba015 bash[29377]: cephadm 2021-03-10T14:43:01.073458+0000 mgr.gibba045.orlgmj (mgr.34412) 2891 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:43:02.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:43:02 gibba015 bash[29377]: cluster 2021-03-10T14:43:01.244814+0000 mgr.gibba045.orlgmj (mgr.34412) 2892 : cluster [DBG] pgmap v1638: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:02.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:43:02 gibba015 bash[29377]: cephadm 2021-03-10T14:43:01.272033+0000 mgr.gibba045.orlgmj (mgr.34412) 2893 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:43:02.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:43:02 gibba015 bash[29377]: cephadm 2021-03-10T14:43:01.274263+0000 mgr.gibba045.orlgmj (mgr.34412) 2894 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:43:02.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:43:02 gibba015 bash[29377]: cephadm 2021-03-10T14:43:01.276304+0000 mgr.gibba045.orlgmj (mgr.34412) 2895 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:43:02.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:43:02 gibba015 bash[29377]: cephadm 2021-03-10T14:43:01.276349+0000 mgr.gibba045.orlgmj (mgr.34412) 2896 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:43:02.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:43:02 gibba015 bash[29377]: cephadm 2021-03-10T14:43:01.278058+0000 mgr.gibba045.orlgmj (mgr.34412) 2897 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:43:02.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:43:02 gibba015 bash[29377]: cephadm 2021-03-10T14:43:01.278101+0000 mgr.gibba045.orlgmj (mgr.34412) 2898 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:43:02.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:43:02 gibba015 bash[29377]: cephadm 2021-03-10T14:43:01.279578+0000 mgr.gibba045.orlgmj (mgr.34412) 2899 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:43:02.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:43:02 gibba015 bash[29377]: cephadm 2021-03-10T14:43:01.281290+0000 mgr.gibba045.orlgmj (mgr.34412) 2900 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:43:02.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:43:02 gibba015 bash[29377]: cephadm 2021-03-10T14:43:01.281333+0000 mgr.gibba045.orlgmj (mgr.34412) 2901 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:43:02.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:43:02 gibba015 bash[29377]: cephadm 2021-03-10T14:43:01.282871+0000 mgr.gibba045.orlgmj (mgr.34412) 2902 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:43:02.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:43:02 gibba015 bash[29377]: cephadm 2021-03-10T14:43:01.283337+0000 mgr.gibba045.orlgmj (mgr.34412) 2903 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:43:02.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:43:02 gibba015 bash[29377]: cephadm 2021-03-10T14:43:01.284800+0000 mgr.gibba045.orlgmj (mgr.34412) 2904 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:43:02.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:43:02 gibba015 bash[29377]: cephadm 2021-03-10T14:43:01.284848+0000 mgr.gibba045.orlgmj (mgr.34412) 2905 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:43:02.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:43:02 gibba015 bash[29377]: cephadm 2021-03-10T14:43:01.284981+0000 mgr.gibba045.orlgmj (mgr.34412) 2906 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:43:02.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:43:02 gibba015 bash[30343]: cephadm 2021-03-10T14:43:01.073458+0000 mgr.gibba045.orlgmj (mgr.34412) 2891 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:43:02.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:43:02 gibba015 bash[30343]: cluster 2021-03-10T14:43:01.244814+0000 mgr.gibba045.orlgmj (mgr.34412) 2892 : cluster [DBG] pgmap v1638: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:02.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:43:02 gibba015 bash[30343]: cephadm 2021-03-10T14:43:01.272033+0000 mgr.gibba045.orlgmj (mgr.34412) 2893 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:43:02.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:43:02 gibba015 bash[30343]: cephadm 2021-03-10T14:43:01.274263+0000 mgr.gibba045.orlgmj (mgr.34412) 2894 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:43:02.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:43:02 gibba015 bash[30343]: cephadm 2021-03-10T14:43:01.276304+0000 mgr.gibba045.orlgmj (mgr.34412) 2895 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:43:02.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:43:02 gibba015 bash[30343]: cephadm 2021-03-10T14:43:01.276349+0000 mgr.gibba045.orlgmj (mgr.34412) 2896 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:43:02.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:43:02 gibba015 bash[30343]: cephadm 2021-03-10T14:43:01.278058+0000 mgr.gibba045.orlgmj (mgr.34412) 2897 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:43:02.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:43:02 gibba015 bash[30343]: cephadm 2021-03-10T14:43:01.278101+0000 mgr.gibba045.orlgmj (mgr.34412) 2898 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:43:02.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:43:02 gibba015 bash[30343]: cephadm 2021-03-10T14:43:01.279578+0000 mgr.gibba045.orlgmj (mgr.34412) 2899 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:43:02.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:43:02 gibba015 bash[30343]: cephadm 2021-03-10T14:43:01.281290+0000 mgr.gibba045.orlgmj (mgr.34412) 2900 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:43:02.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:43:02 gibba015 bash[30343]: cephadm 2021-03-10T14:43:01.281333+0000 mgr.gibba045.orlgmj (mgr.34412) 2901 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:43:02.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:43:02 gibba015 bash[30343]: cephadm 2021-03-10T14:43:01.282871+0000 mgr.gibba045.orlgmj (mgr.34412) 2902 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:43:02.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:43:02 gibba015 bash[30343]: cephadm 2021-03-10T14:43:01.283337+0000 mgr.gibba045.orlgmj (mgr.34412) 2903 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:43:02.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:43:02 gibba015 bash[30343]: cephadm 2021-03-10T14:43:01.284800+0000 mgr.gibba045.orlgmj (mgr.34412) 2904 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:43:02.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:43:02 gibba015 bash[30343]: cephadm 2021-03-10T14:43:01.284848+0000 mgr.gibba045.orlgmj (mgr.34412) 2905 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:43:02.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:43:02 gibba015 bash[30343]: cephadm 2021-03-10T14:43:01.284981+0000 mgr.gibba045.orlgmj (mgr.34412) 2906 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:43:02.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:43:02 gibba045 bash[25517]: cephadm 2021-03-10T14:43:01.073458+0000 mgr.gibba045.orlgmj (mgr.34412) 2891 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:43:02.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:43:02 gibba045 bash[25517]: cluster 2021-03-10T14:43:01.244814+0000 mgr.gibba045.orlgmj (mgr.34412) 2892 : cluster [DBG] pgmap v1638: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:02.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:43:02 gibba045 bash[25517]: cephadm 2021-03-10T14:43:01.272033+0000 mgr.gibba045.orlgmj (mgr.34412) 2893 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:43:02.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:43:02 gibba045 bash[25517]: cephadm 2021-03-10T14:43:01.274263+0000 mgr.gibba045.orlgmj (mgr.34412) 2894 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:43:02.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:43:02 gibba045 bash[25517]: cephadm 2021-03-10T14:43:01.276304+0000 mgr.gibba045.orlgmj (mgr.34412) 2895 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:43:02.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:43:02 gibba045 bash[25517]: cephadm 2021-03-10T14:43:01.276349+0000 mgr.gibba045.orlgmj (mgr.34412) 2896 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:43:02.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:43:02 gibba045 bash[25517]: cephadm 2021-03-10T14:43:01.278058+0000 mgr.gibba045.orlgmj (mgr.34412) 2897 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:43:02.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:43:02 gibba045 bash[25517]: cephadm 2021-03-10T14:43:01.278101+0000 mgr.gibba045.orlgmj (mgr.34412) 2898 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:43:02.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:43:02 gibba045 bash[25517]: cephadm 2021-03-10T14:43:01.279578+0000 mgr.gibba045.orlgmj (mgr.34412) 2899 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:43:02.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:43:02 gibba045 bash[25517]: cephadm 2021-03-10T14:43:01.281290+0000 mgr.gibba045.orlgmj (mgr.34412) 2900 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:43:02.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:43:02 gibba045 bash[25517]: cephadm 2021-03-10T14:43:01.281333+0000 mgr.gibba045.orlgmj (mgr.34412) 2901 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:43:02.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:43:02 gibba045 bash[25517]: cephadm 2021-03-10T14:43:01.282871+0000 mgr.gibba045.orlgmj (mgr.34412) 2902 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:43:02.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:43:02 gibba045 bash[25517]: cephadm 2021-03-10T14:43:01.283337+0000 mgr.gibba045.orlgmj (mgr.34412) 2903 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:43:02.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:43:02 gibba045 bash[25517]: cephadm 2021-03-10T14:43:01.284800+0000 mgr.gibba045.orlgmj (mgr.34412) 2904 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:43:02.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:43:02 gibba045 bash[25517]: cephadm 2021-03-10T14:43:01.284848+0000 mgr.gibba045.orlgmj (mgr.34412) 2905 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:43:02.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:43:02 gibba045 bash[25517]: cephadm 2021-03-10T14:43:01.284981+0000 mgr.gibba045.orlgmj (mgr.34412) 2906 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:43:05.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:43:04 gibba015 bash[29377]: cluster 2021-03-10T14:43:03.246197+0000 mgr.gibba045.orlgmj (mgr.34412) 2907 : cluster [DBG] pgmap v1639: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:05.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:43:04 gibba015 bash[30343]: cluster 2021-03-10T14:43:03.246197+0000 mgr.gibba045.orlgmj (mgr.34412) 2907 : cluster [DBG] pgmap v1639: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:05.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:43:04 gibba045 bash[25517]: cluster 2021-03-10T14:43:03.246197+0000 mgr.gibba045.orlgmj (mgr.34412) 2907 : cluster [DBG] pgmap v1639: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:07.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:43:06 gibba015 bash[29377]: cluster 2021-03-10T14:43:05.247718+0000 mgr.gibba045.orlgmj (mgr.34412) 2908 : cluster [DBG] pgmap v1640: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:07.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:43:06 gibba015 bash[30343]: cluster 2021-03-10T14:43:05.247718+0000 mgr.gibba045.orlgmj (mgr.34412) 2908 : cluster [DBG] pgmap v1640: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:07.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:43:06 gibba045 bash[25517]: cluster 2021-03-10T14:43:05.247718+0000 mgr.gibba045.orlgmj (mgr.34412) 2908 : cluster [DBG] pgmap v1640: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:09.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:43:08 gibba045 bash[25517]: cluster 2021-03-10T14:43:07.249514+0000 mgr.gibba045.orlgmj (mgr.34412) 2909 : cluster [DBG] pgmap v1641: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:09.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:43:08 gibba015 bash[29377]: cluster 2021-03-10T14:43:07.249514+0000 mgr.gibba045.orlgmj (mgr.34412) 2909 : cluster [DBG] pgmap v1641: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:09.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:43:08 gibba015 bash[30343]: cluster 2021-03-10T14:43:07.249514+0000 mgr.gibba045.orlgmj (mgr.34412) 2909 : cluster [DBG] pgmap v1641: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:10.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:43:09 gibba045 bash[25517]: cluster 2021-03-10T14:43:09.250889+0000 mgr.gibba045.orlgmj (mgr.34412) 2910 : cluster [DBG] pgmap v1642: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:10.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:43:09 gibba015 bash[29377]: cluster 2021-03-10T14:43:09.250889+0000 mgr.gibba045.orlgmj (mgr.34412) 2910 : cluster [DBG] pgmap v1642: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:10.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:43:09 gibba015 bash[30343]: cluster 2021-03-10T14:43:09.250889+0000 mgr.gibba045.orlgmj (mgr.34412) 2910 : cluster [DBG] pgmap v1642: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:12.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:43:12 gibba015 bash[29377]: cluster 2021-03-10T14:43:11.252724+0000 mgr.gibba045.orlgmj (mgr.34412) 2911 : cluster [DBG] pgmap v1643: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:12.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:43:12 gibba015 bash[30343]: cluster 2021-03-10T14:43:11.252724+0000 mgr.gibba045.orlgmj (mgr.34412) 2911 : cluster [DBG] pgmap v1643: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:12.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:43:12 gibba045 bash[25517]: cluster 2021-03-10T14:43:11.252724+0000 mgr.gibba045.orlgmj (mgr.34412) 2911 : cluster [DBG] pgmap v1643: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:15.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:43:14 gibba015 bash[29377]: cluster 2021-03-10T14:43:13.254346+0000 mgr.gibba045.orlgmj (mgr.34412) 2912 : cluster [DBG] pgmap v1644: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:15.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:43:14 gibba015 bash[30343]: cluster 2021-03-10T14:43:13.254346+0000 mgr.gibba045.orlgmj (mgr.34412) 2912 : cluster [DBG] pgmap v1644: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:15.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:43:14 gibba045 bash[25517]: cluster 2021-03-10T14:43:13.254346+0000 mgr.gibba045.orlgmj (mgr.34412) 2912 : cluster [DBG] pgmap v1644: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:17.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:43:16 gibba015 bash[29377]: cluster 2021-03-10T14:43:15.255877+0000 mgr.gibba045.orlgmj (mgr.34412) 2913 : cluster [DBG] pgmap v1645: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:17.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:43:16 gibba015 bash[30343]: cluster 2021-03-10T14:43:15.255877+0000 mgr.gibba045.orlgmj (mgr.34412) 2913 : cluster [DBG] pgmap v1645: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:17.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:43:16 gibba045 bash[25517]: cluster 2021-03-10T14:43:15.255877+0000 mgr.gibba045.orlgmj (mgr.34412) 2913 : cluster [DBG] pgmap v1645: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:18.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:43:17 gibba015 bash[29377]: cephadm 2021-03-10T14:43:16.300935+0000 mgr.gibba045.orlgmj (mgr.34412) 2914 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:43:18.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:43:17 gibba015 bash[30343]: cephadm 2021-03-10T14:43:16.300935+0000 mgr.gibba045.orlgmj (mgr.34412) 2914 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:43:18.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:43:17 gibba045 bash[25517]: cephadm 2021-03-10T14:43:16.300935+0000 mgr.gibba045.orlgmj (mgr.34412) 2914 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:43:19.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:43:18 gibba045 bash[25517]: cluster 2021-03-10T14:43:17.257520+0000 mgr.gibba045.orlgmj (mgr.34412) 2915 : cluster [DBG] pgmap v1646: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:19.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:43:18 gibba015 bash[29377]: cluster 2021-03-10T14:43:17.257520+0000 mgr.gibba045.orlgmj (mgr.34412) 2915 : cluster [DBG] pgmap v1646: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:19.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:43:18 gibba015 bash[30343]: cluster 2021-03-10T14:43:17.257520+0000 mgr.gibba045.orlgmj (mgr.34412) 2915 : cluster [DBG] pgmap v1646: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:20.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:43:19 gibba045 bash[25517]: cluster 2021-03-10T14:43:19.258755+0000 mgr.gibba045.orlgmj (mgr.34412) 2916 : cluster [DBG] pgmap v1647: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:20.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:43:19 gibba015 bash[29377]: cluster 2021-03-10T14:43:19.258755+0000 mgr.gibba045.orlgmj (mgr.34412) 2916 : cluster [DBG] pgmap v1647: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:20.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:43:19 gibba015 bash[30343]: cluster 2021-03-10T14:43:19.258755+0000 mgr.gibba045.orlgmj (mgr.34412) 2916 : cluster [DBG] pgmap v1647: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:22.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:43:22 gibba015 bash[29377]: cluster 2021-03-10T14:43:21.260538+0000 mgr.gibba045.orlgmj (mgr.34412) 2917 : cluster [DBG] pgmap v1648: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:22.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:43:22 gibba015 bash[30343]: cluster 2021-03-10T14:43:21.260538+0000 mgr.gibba045.orlgmj (mgr.34412) 2917 : cluster [DBG] pgmap v1648: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:22.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:43:22 gibba045 bash[25517]: cluster 2021-03-10T14:43:21.260538+0000 mgr.gibba045.orlgmj (mgr.34412) 2917 : cluster [DBG] pgmap v1648: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:25.015 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:43:25.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:43:24 gibba015 bash[29377]: cluster 2021-03-10T14:43:23.262187+0000 mgr.gibba045.orlgmj (mgr.34412) 2918 : cluster [DBG] pgmap v1649: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:25.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:43:24 gibba015 bash[30343]: cluster 2021-03-10T14:43:23.262187+0000 mgr.gibba045.orlgmj (mgr.34412) 2918 : cluster [DBG] pgmap v1649: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:25.245 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:43:25.245 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (54m) 9m ago 59m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:43:25.246 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (59m) 8m ago 59m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:43:25.246 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (54m) 8m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:43:25.246 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (54m) 8m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:43:25.246 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (53m) 9m ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:43:25.247 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (53m) 9m ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:43:25.247 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (53m) 8m ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:43:25.247 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (53m) 9m ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:43:25.247 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (59m) 9m ago 59m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:43:25.247 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (59m) 8m ago 59m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:43:25.248 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (52m) 9m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:43:25.248 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (52m) 9m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:43:25.248 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (51m) 9m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:43:25.248 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (51m) 9m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:43:25.248 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (50m) 8m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:43:25.249 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (50m) 8m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:43:25.249 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (49m) 8m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:43:25.249 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (49m) 8m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:43:25.249 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (59m) 8m ago 59m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:43:25.249 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 8m ago 57m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:43:25.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:43:24 gibba045 bash[25517]: cluster 2021-03-10T14:43:23.262187+0000 mgr.gibba045.orlgmj (mgr.34412) 2918 : cluster [DBG] pgmap v1649: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:25.498 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:43:25.499 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:43:25.499 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:43:25.499 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:43:25.499 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:43:25.500 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:43:25.500 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:43:25.500 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:43:25.500 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:43:25.501 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:43:25.501 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:43:25.501 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:43:25.501 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:43:25.502 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:43:25.502 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:43:26.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:43:25 gibba045 bash[25517]: audit 2021-03-10T14:43:25.494647+0000 mon.a (mon.0) 1000 : audit [DBG] from='client.? 172.21.2.115:0/1896205386' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:43:26.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:43:25 gibba015 bash[29377]: audit 2021-03-10T14:43:25.494647+0000 mon.a (mon.0) 1000 : audit [DBG] from='client.? 172.21.2.115:0/1896205386' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:43:26.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:43:25 gibba015 bash[30343]: audit 2021-03-10T14:43:25.494647+0000 mon.a (mon.0) 1000 : audit [DBG] from='client.? 172.21.2.115:0/1896205386' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:43:27.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:43:26 gibba045 bash[25517]: audit 2021-03-10T14:43:25.007244+0000 mgr.gibba045.orlgmj (mgr.34412) 2919 : audit [DBG] from='client.46014 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:43:27.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:43:26 gibba045 bash[25517]: audit 2021-03-10T14:43:25.232688+0000 mgr.gibba045.orlgmj (mgr.34412) 2920 : audit [DBG] from='client.56008 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:43:27.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:43:26 gibba045 bash[25517]: cluster 2021-03-10T14:43:25.262950+0000 mgr.gibba045.orlgmj (mgr.34412) 2921 : cluster [DBG] pgmap v1650: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:27.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:43:26 gibba015 bash[29377]: audit 2021-03-10T14:43:25.007244+0000 mgr.gibba045.orlgmj (mgr.34412) 2919 : audit [DBG] from='client.46014 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:43:27.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:43:26 gibba015 bash[29377]: audit 2021-03-10T14:43:25.232688+0000 mgr.gibba045.orlgmj (mgr.34412) 2920 : audit [DBG] from='client.56008 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:43:27.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:43:26 gibba015 bash[29377]: cluster 2021-03-10T14:43:25.262950+0000 mgr.gibba045.orlgmj (mgr.34412) 2921 : cluster [DBG] pgmap v1650: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:27.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:43:26 gibba015 bash[30343]: audit 2021-03-10T14:43:25.007244+0000 mgr.gibba045.orlgmj (mgr.34412) 2919 : audit [DBG] from='client.46014 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:43:27.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:43:26 gibba015 bash[30343]: audit 2021-03-10T14:43:25.232688+0000 mgr.gibba045.orlgmj (mgr.34412) 2920 : audit [DBG] from='client.56008 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:43:27.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:43:26 gibba015 bash[30343]: cluster 2021-03-10T14:43:25.262950+0000 mgr.gibba045.orlgmj (mgr.34412) 2921 : cluster [DBG] pgmap v1650: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:29.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:43:28 gibba015 bash[29377]: cluster 2021-03-10T14:43:27.264626+0000 mgr.gibba045.orlgmj (mgr.34412) 2922 : cluster [DBG] pgmap v1651: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:29.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:43:28 gibba015 bash[30343]: cluster 2021-03-10T14:43:27.264626+0000 mgr.gibba045.orlgmj (mgr.34412) 2922 : cluster [DBG] pgmap v1651: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:29.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:43:28 gibba045 bash[25517]: cluster 2021-03-10T14:43:27.264626+0000 mgr.gibba045.orlgmj (mgr.34412) 2922 : cluster [DBG] pgmap v1651: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:31.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:43:30 gibba045 bash[25517]: cluster 2021-03-10T14:43:29.266069+0000 mgr.gibba045.orlgmj (mgr.34412) 2923 : cluster [DBG] pgmap v1652: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:31.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:43:30 gibba015 bash[29377]: cluster 2021-03-10T14:43:29.266069+0000 mgr.gibba045.orlgmj (mgr.34412) 2923 : cluster [DBG] pgmap v1652: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:31.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:43:30 gibba015 bash[30343]: cluster 2021-03-10T14:43:29.266069+0000 mgr.gibba045.orlgmj (mgr.34412) 2923 : cluster [DBG] pgmap v1652: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:32.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:43:32 gibba045 bash[25517]: cluster 2021-03-10T14:43:31.267828+0000 mgr.gibba045.orlgmj (mgr.34412) 2924 : cluster [DBG] pgmap v1653: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:32.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:43:32 gibba045 bash[25517]: cephadm 2021-03-10T14:43:31.316925+0000 mgr.gibba045.orlgmj (mgr.34412) 2925 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:43:32.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:43:32 gibba015 bash[29377]: cluster 2021-03-10T14:43:31.267828+0000 mgr.gibba045.orlgmj (mgr.34412) 2924 : cluster [DBG] pgmap v1653: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:32.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:43:32 gibba015 bash[29377]: cephadm 2021-03-10T14:43:31.316925+0000 mgr.gibba045.orlgmj (mgr.34412) 2925 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:43:32.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:43:32 gibba015 bash[30343]: cluster 2021-03-10T14:43:31.267828+0000 mgr.gibba045.orlgmj (mgr.34412) 2924 : cluster [DBG] pgmap v1653: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:32.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:43:32 gibba015 bash[30343]: cephadm 2021-03-10T14:43:31.316925+0000 mgr.gibba045.orlgmj (mgr.34412) 2925 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:43:35.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:43:34 gibba015 bash[29377]: cluster 2021-03-10T14:43:33.269467+0000 mgr.gibba045.orlgmj (mgr.34412) 2926 : cluster [DBG] pgmap v1654: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:35.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:43:34 gibba015 bash[30343]: cluster 2021-03-10T14:43:33.269467+0000 mgr.gibba045.orlgmj (mgr.34412) 2926 : cluster [DBG] pgmap v1654: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:35.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:43:34 gibba045 bash[25517]: cluster 2021-03-10T14:43:33.269467+0000 mgr.gibba045.orlgmj (mgr.34412) 2926 : cluster [DBG] pgmap v1654: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:37.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:43:36 gibba045 bash[25517]: cluster 2021-03-10T14:43:35.271202+0000 mgr.gibba045.orlgmj (mgr.34412) 2927 : cluster [DBG] pgmap v1655: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:37.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:43:36 gibba015 bash[29377]: cluster 2021-03-10T14:43:35.271202+0000 mgr.gibba045.orlgmj (mgr.34412) 2927 : cluster [DBG] pgmap v1655: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:37.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:43:36 gibba015 bash[30343]: cluster 2021-03-10T14:43:35.271202+0000 mgr.gibba045.orlgmj (mgr.34412) 2927 : cluster [DBG] pgmap v1655: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:39.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:43:38 gibba015 bash[29377]: cluster 2021-03-10T14:43:37.273012+0000 mgr.gibba045.orlgmj (mgr.34412) 2928 : cluster [DBG] pgmap v1656: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:39.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:43:38 gibba015 bash[30343]: cluster 2021-03-10T14:43:37.273012+0000 mgr.gibba045.orlgmj (mgr.34412) 2928 : cluster [DBG] pgmap v1656: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:39.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:43:38 gibba045 bash[25517]: cluster 2021-03-10T14:43:37.273012+0000 mgr.gibba045.orlgmj (mgr.34412) 2928 : cluster [DBG] pgmap v1656: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:41.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:43:40 gibba045 bash[25517]: cluster 2021-03-10T14:43:39.274212+0000 mgr.gibba045.orlgmj (mgr.34412) 2929 : cluster [DBG] pgmap v1657: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:41.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:43:40 gibba015 bash[29377]: cluster 2021-03-10T14:43:39.274212+0000 mgr.gibba045.orlgmj (mgr.34412) 2929 : cluster [DBG] pgmap v1657: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:41.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:43:40 gibba015 bash[30343]: cluster 2021-03-10T14:43:39.274212+0000 mgr.gibba045.orlgmj (mgr.34412) 2929 : cluster [DBG] pgmap v1657: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:42.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:43:42 gibba045 bash[25517]: cluster 2021-03-10T14:43:41.275950+0000 mgr.gibba045.orlgmj (mgr.34412) 2930 : cluster [DBG] pgmap v1658: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:42.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:43:42 gibba015 bash[29377]: cluster 2021-03-10T14:43:41.275950+0000 mgr.gibba045.orlgmj (mgr.34412) 2930 : cluster [DBG] pgmap v1658: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:42.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:43:42 gibba015 bash[30343]: cluster 2021-03-10T14:43:41.275950+0000 mgr.gibba045.orlgmj (mgr.34412) 2930 : cluster [DBG] pgmap v1658: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:45.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:43:44 gibba045 bash[25517]: cluster 2021-03-10T14:43:43.277580+0000 mgr.gibba045.orlgmj (mgr.34412) 2931 : cluster [DBG] pgmap v1659: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:45.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:43:44 gibba015 bash[29377]: cluster 2021-03-10T14:43:43.277580+0000 mgr.gibba045.orlgmj (mgr.34412) 2931 : cluster [DBG] pgmap v1659: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:45.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:43:44 gibba015 bash[30343]: cluster 2021-03-10T14:43:43.277580+0000 mgr.gibba045.orlgmj (mgr.34412) 2931 : cluster [DBG] pgmap v1659: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:47.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:43:46 gibba045 bash[25517]: cluster 2021-03-10T14:43:45.279284+0000 mgr.gibba045.orlgmj (mgr.34412) 2932 : cluster [DBG] pgmap v1660: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:47.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:43:46 gibba045 bash[25517]: cephadm 2021-03-10T14:43:46.333001+0000 mgr.gibba045.orlgmj (mgr.34412) 2933 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:43:47.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:43:46 gibba015 bash[29377]: cluster 2021-03-10T14:43:45.279284+0000 mgr.gibba045.orlgmj (mgr.34412) 2932 : cluster [DBG] pgmap v1660: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:47.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:43:46 gibba015 bash[29377]: cephadm 2021-03-10T14:43:46.333001+0000 mgr.gibba045.orlgmj (mgr.34412) 2933 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:43:47.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:43:46 gibba015 bash[30343]: cluster 2021-03-10T14:43:45.279284+0000 mgr.gibba045.orlgmj (mgr.34412) 2932 : cluster [DBG] pgmap v1660: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:47.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:43:46 gibba015 bash[30343]: cephadm 2021-03-10T14:43:46.333001+0000 mgr.gibba045.orlgmj (mgr.34412) 2933 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:43:49.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:43:48 gibba045 bash[25517]: cluster 2021-03-10T14:43:47.281026+0000 mgr.gibba045.orlgmj (mgr.34412) 2934 : cluster [DBG] pgmap v1661: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:49.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:43:48 gibba015 bash[29377]: cluster 2021-03-10T14:43:47.281026+0000 mgr.gibba045.orlgmj (mgr.34412) 2934 : cluster [DBG] pgmap v1661: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:49.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:43:48 gibba015 bash[30343]: cluster 2021-03-10T14:43:47.281026+0000 mgr.gibba045.orlgmj (mgr.34412) 2934 : cluster [DBG] pgmap v1661: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:51.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:43:50 gibba045 bash[25517]: cluster 2021-03-10T14:43:49.282223+0000 mgr.gibba045.orlgmj (mgr.34412) 2935 : cluster [DBG] pgmap v1662: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:51.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:43:50 gibba015 bash[29377]: cluster 2021-03-10T14:43:49.282223+0000 mgr.gibba045.orlgmj (mgr.34412) 2935 : cluster [DBG] pgmap v1662: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:51.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:43:50 gibba015 bash[30343]: cluster 2021-03-10T14:43:49.282223+0000 mgr.gibba045.orlgmj (mgr.34412) 2935 : cluster [DBG] pgmap v1662: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:52.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:43:51 gibba045 bash[25517]: cluster 2021-03-10T14:43:51.283970+0000 mgr.gibba045.orlgmj (mgr.34412) 2936 : cluster [DBG] pgmap v1663: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:52.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:43:51 gibba015 bash[29377]: cluster 2021-03-10T14:43:51.283970+0000 mgr.gibba045.orlgmj (mgr.34412) 2936 : cluster [DBG] pgmap v1663: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:52.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:43:51 gibba015 bash[30343]: cluster 2021-03-10T14:43:51.283970+0000 mgr.gibba045.orlgmj (mgr.34412) 2936 : cluster [DBG] pgmap v1663: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:53.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:43:53 gibba045 bash[25517]: audit 2021-03-10T14:43:52.817369+0000 mon.c (mon.1) 855 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:43:53.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:43:53 gibba045 bash[25517]: audit 2021-03-10T14:43:52.818044+0000 mon.c (mon.1) 856 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:43:53.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:43:53 gibba045 bash[25517]: audit 2021-03-10T14:43:52.818496+0000 mon.a (mon.0) 1001 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:43:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:43:53 gibba045 bash[25517]: audit 2021-03-10T14:43:52.818648+0000 mon.c (mon.1) 857 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T14:43:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:43:53 gibba045 bash[25517]: audit 2021-03-10T14:43:52.819485+0000 mon.c (mon.1) 858 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:43:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:43:53 gibba045 bash[25517]: audit 2021-03-10T14:43:52.819974+0000 mon.a (mon.0) 1002 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:43:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:43:53 gibba045 bash[25517]: audit 2021-03-10T14:43:52.820195+0000 mon.c (mon.1) 859 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:43:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:43:53 gibba045 bash[25517]: audit 2021-03-10T14:43:52.820928+0000 mon.a (mon.0) 1003 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T14:43:53.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:43:53 gibba045 bash[25517]: audit 2021-03-10T14:43:52.821002+0000 mon.c (mon.1) 860 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:43:53.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:43:53 gibba045 bash[25517]: audit 2021-03-10T14:43:52.822151+0000 mon.a (mon.0) 1004 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:43:53.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:43:53 gibba045 bash[25517]: audit 2021-03-10T14:43:52.822932+0000 mon.a (mon.0) 1005 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:43:53.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:43:53 gibba045 bash[25517]: audit 2021-03-10T14:43:52.823706+0000 mon.a (mon.0) 1006 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:43:53.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:43:52 gibba015 bash[29377]: audit 2021-03-10T14:43:52.817369+0000 mon.c (mon.1) 855 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:43:53.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:43:52 gibba015 bash[29377]: audit 2021-03-10T14:43:52.818044+0000 mon.c (mon.1) 856 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:43:53.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:43:52 gibba015 bash[29377]: audit 2021-03-10T14:43:52.818496+0000 mon.a (mon.0) 1001 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:43:53.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:43:52 gibba015 bash[29377]: audit 2021-03-10T14:43:52.818648+0000 mon.c (mon.1) 857 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T14:43:53.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:43:52 gibba015 bash[29377]: audit 2021-03-10T14:43:52.819485+0000 mon.c (mon.1) 858 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:43:53.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:43:52 gibba015 bash[29377]: audit 2021-03-10T14:43:52.819974+0000 mon.a (mon.0) 1002 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:43:53.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:43:52 gibba015 bash[29377]: audit 2021-03-10T14:43:52.820195+0000 mon.c (mon.1) 859 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:43:53.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:43:52 gibba015 bash[29377]: audit 2021-03-10T14:43:52.820928+0000 mon.a (mon.0) 1003 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T14:43:53.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:43:52 gibba015 bash[29377]: audit 2021-03-10T14:43:52.821002+0000 mon.c (mon.1) 860 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:43:53.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:43:52 gibba015 bash[29377]: audit 2021-03-10T14:43:52.822151+0000 mon.a (mon.0) 1004 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:43:53.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:43:52 gibba015 bash[29377]: audit 2021-03-10T14:43:52.822932+0000 mon.a (mon.0) 1005 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:43:53.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:43:52 gibba015 bash[29377]: audit 2021-03-10T14:43:52.823706+0000 mon.a (mon.0) 1006 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:43:53.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:43:52 gibba015 bash[30343]: audit 2021-03-10T14:43:52.817369+0000 mon.c (mon.1) 855 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:43:53.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:43:52 gibba015 bash[30343]: audit 2021-03-10T14:43:52.818044+0000 mon.c (mon.1) 856 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:43:53.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:43:52 gibba015 bash[30343]: audit 2021-03-10T14:43:52.818496+0000 mon.a (mon.0) 1001 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:43:53.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:43:52 gibba015 bash[30343]: audit 2021-03-10T14:43:52.818648+0000 mon.c (mon.1) 857 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T14:43:53.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:43:52 gibba015 bash[30343]: audit 2021-03-10T14:43:52.819485+0000 mon.c (mon.1) 858 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:43:53.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:43:52 gibba015 bash[30343]: audit 2021-03-10T14:43:52.819974+0000 mon.a (mon.0) 1002 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:43:53.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:43:52 gibba015 bash[30343]: audit 2021-03-10T14:43:52.820195+0000 mon.c (mon.1) 859 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:43:53.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:43:52 gibba015 bash[30343]: audit 2021-03-10T14:43:52.820928+0000 mon.a (mon.0) 1003 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T14:43:53.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:43:52 gibba015 bash[30343]: audit 2021-03-10T14:43:52.821002+0000 mon.c (mon.1) 860 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:43:53.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:43:52 gibba015 bash[30343]: audit 2021-03-10T14:43:52.822151+0000 mon.a (mon.0) 1004 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:43:53.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:43:52 gibba015 bash[30343]: audit 2021-03-10T14:43:52.822932+0000 mon.a (mon.0) 1005 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:43:53.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:43:52 gibba015 bash[30343]: audit 2021-03-10T14:43:52.823706+0000 mon.a (mon.0) 1006 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:43:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:43:54 gibba045 bash[25517]: cluster 2021-03-10T14:43:53.285658+0000 mgr.gibba045.orlgmj (mgr.34412) 2937 : cluster [DBG] pgmap v1664: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:54.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:43:54 gibba015 bash[29377]: cluster 2021-03-10T14:43:53.285658+0000 mgr.gibba045.orlgmj (mgr.34412) 2937 : cluster [DBG] pgmap v1664: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:54.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:43:54 gibba015 bash[30343]: cluster 2021-03-10T14:43:53.285658+0000 mgr.gibba045.orlgmj (mgr.34412) 2937 : cluster [DBG] pgmap v1664: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:55.745 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:43:55.969 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:43:55.970 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (54m) 10m ago 60m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:43:55.970 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (59m) 9m ago 59m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:43:55.970 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (55m) 9m ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:43:55.970 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (55m) 9m ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:43:55.970 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (54m) 10m ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:43:55.971 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (54m) 10m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:43:55.971 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (53m) 9m ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:43:55.971 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (53m) 10m ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:43:55.971 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (60m) 10m ago 60m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:43:55.972 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (60m) 9m ago 60m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:43:55.972 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (52m) 10m ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:43:55.972 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (52m) 10m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:43:55.972 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (52m) 10m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:43:55.972 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (51m) 10m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:43:55.973 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (51m) 9m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:43:55.973 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (50m) 9m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:43:55.973 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (50m) 9m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:43:55.973 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (49m) 9m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:43:55.973 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (59m) 9m ago 60m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:43:55.974 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 9m ago 58m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:43:56.219 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:43:56.219 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:43:56.219 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:43:56.220 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:43:56.220 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:43:56.220 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:43:56.220 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:43:56.221 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:43:56.221 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:43:56.221 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:43:56.221 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:43:56.221 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:43:56.222 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:43:56.222 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:43:56.222 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:43:56.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:43:56 gibba015 bash[29377]: cluster 2021-03-10T14:43:55.287188+0000 mgr.gibba045.orlgmj (mgr.34412) 2938 : cluster [DBG] pgmap v1665: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:56.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:43:56 gibba015 bash[29377]: audit 2021-03-10T14:43:55.735875+0000 mgr.gibba045.orlgmj (mgr.34412) 2939 : audit [DBG] from='client.46032 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:43:56.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:43:56 gibba015 bash[29377]: audit 2021-03-10T14:43:55.960077+0000 mgr.gibba045.orlgmj (mgr.34412) 2940 : audit [DBG] from='client.56026 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:43:56.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:43:56 gibba015 bash[29377]: audit 2021-03-10T14:43:56.215521+0000 mon.a (mon.0) 1007 : audit [DBG] from='client.? 172.21.2.115:0/2243903253' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:43:56.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:43:56 gibba015 bash[30343]: cluster 2021-03-10T14:43:55.287188+0000 mgr.gibba045.orlgmj (mgr.34412) 2938 : cluster [DBG] pgmap v1665: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:56.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:43:56 gibba015 bash[30343]: audit 2021-03-10T14:43:55.735875+0000 mgr.gibba045.orlgmj (mgr.34412) 2939 : audit [DBG] from='client.46032 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:43:56.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:43:56 gibba015 bash[30343]: audit 2021-03-10T14:43:55.960077+0000 mgr.gibba045.orlgmj (mgr.34412) 2940 : audit [DBG] from='client.56026 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:43:56.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:43:56 gibba015 bash[30343]: audit 2021-03-10T14:43:56.215521+0000 mon.a (mon.0) 1007 : audit [DBG] from='client.? 172.21.2.115:0/2243903253' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:43:56.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:43:56 gibba045 bash[25517]: cluster 2021-03-10T14:43:55.287188+0000 mgr.gibba045.orlgmj (mgr.34412) 2938 : cluster [DBG] pgmap v1665: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:56.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:43:56 gibba045 bash[25517]: audit 2021-03-10T14:43:55.735875+0000 mgr.gibba045.orlgmj (mgr.34412) 2939 : audit [DBG] from='client.46032 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:43:56.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:43:56 gibba045 bash[25517]: audit 2021-03-10T14:43:55.960077+0000 mgr.gibba045.orlgmj (mgr.34412) 2940 : audit [DBG] from='client.56026 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:43:56.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:43:56 gibba045 bash[25517]: audit 2021-03-10T14:43:56.215521+0000 mon.a (mon.0) 1007 : audit [DBG] from='client.? 172.21.2.115:0/2243903253' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:43:59.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:43:58 gibba045 bash[25517]: cluster 2021-03-10T14:43:57.288954+0000 mgr.gibba045.orlgmj (mgr.34412) 2941 : cluster [DBG] pgmap v1666: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:59.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:43:58 gibba015 bash[29377]: cluster 2021-03-10T14:43:57.288954+0000 mgr.gibba045.orlgmj (mgr.34412) 2941 : cluster [DBG] pgmap v1666: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:59.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:43:58 gibba015 bash[30343]: cluster 2021-03-10T14:43:57.288954+0000 mgr.gibba045.orlgmj (mgr.34412) 2941 : cluster [DBG] pgmap v1666: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:01.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:44:00 gibba045 bash[25517]: cluster 2021-03-10T14:43:59.290265+0000 mgr.gibba045.orlgmj (mgr.34412) 2942 : cluster [DBG] pgmap v1667: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:01.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:44:00 gibba015 bash[29377]: cluster 2021-03-10T14:43:59.290265+0000 mgr.gibba045.orlgmj (mgr.34412) 2942 : cluster [DBG] pgmap v1667: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:01.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:44:00 gibba015 bash[30343]: cluster 2021-03-10T14:43:59.290265+0000 mgr.gibba045.orlgmj (mgr.34412) 2942 : cluster [DBG] pgmap v1667: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:02.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:44:02 gibba045 bash[25517]: cluster 2021-03-10T14:44:01.291775+0000 mgr.gibba045.orlgmj (mgr.34412) 2943 : cluster [DBG] pgmap v1668: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:02.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:44:02 gibba045 bash[25517]: audit 2021-03-10T14:44:01.346448+0000 mon.c (mon.1) 861 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:44:02.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:44:02 gibba045 bash[25517]: audit 2021-03-10T14:44:01.352734+0000 mon.c (mon.1) 862 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:44:02.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:44:02 gibba045 bash[25517]: cephadm 2021-03-10T14:44:01.355807+0000 mgr.gibba045.orlgmj (mgr.34412) 2944 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:44:02.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:44:01 gibba015 bash[29377]: cluster 2021-03-10T14:44:01.291775+0000 mgr.gibba045.orlgmj (mgr.34412) 2943 : cluster [DBG] pgmap v1668: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:02.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:44:01 gibba015 bash[29377]: audit 2021-03-10T14:44:01.346448+0000 mon.c (mon.1) 861 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:44:02.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:44:01 gibba015 bash[29377]: audit 2021-03-10T14:44:01.352734+0000 mon.c (mon.1) 862 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:44:02.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:44:01 gibba015 bash[29377]: cephadm 2021-03-10T14:44:01.355807+0000 mgr.gibba045.orlgmj (mgr.34412) 2944 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:44:02.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:44:01 gibba015 bash[30343]: cluster 2021-03-10T14:44:01.291775+0000 mgr.gibba045.orlgmj (mgr.34412) 2943 : cluster [DBG] pgmap v1668: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:02.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:44:01 gibba015 bash[30343]: audit 2021-03-10T14:44:01.346448+0000 mon.c (mon.1) 861 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:44:02.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:44:01 gibba015 bash[30343]: audit 2021-03-10T14:44:01.352734+0000 mon.c (mon.1) 862 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:44:02.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:44:01 gibba015 bash[30343]: cephadm 2021-03-10T14:44:01.355807+0000 mgr.gibba045.orlgmj (mgr.34412) 2944 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:44:05.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:44:04 gibba045 bash[25517]: cluster 2021-03-10T14:44:03.293333+0000 mgr.gibba045.orlgmj (mgr.34412) 2945 : cluster [DBG] pgmap v1669: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:05.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:44:04 gibba045 bash[25517]: audit 2021-03-10T14:44:04.872171+0000 mon.a (mon.0) 1008 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:44:05.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:44:04 gibba015 bash[29377]: cluster 2021-03-10T14:44:03.293333+0000 mgr.gibba045.orlgmj (mgr.34412) 2945 : cluster [DBG] pgmap v1669: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:05.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:44:04 gibba015 bash[29377]: audit 2021-03-10T14:44:04.872171+0000 mon.a (mon.0) 1008 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:44:05.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:44:04 gibba015 bash[30343]: cluster 2021-03-10T14:44:03.293333+0000 mgr.gibba045.orlgmj (mgr.34412) 2945 : cluster [DBG] pgmap v1669: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:05.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:44:04 gibba015 bash[30343]: audit 2021-03-10T14:44:04.872171+0000 mon.a (mon.0) 1008 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:44:06.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:44:05 gibba045 bash[25517]: cephadm 2021-03-10T14:44:04.877360+0000 mgr.gibba045.orlgmj (mgr.34412) 2946 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:44:06.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:44:05 gibba045 bash[25517]: audit 2021-03-10T14:44:05.081590+0000 mon.a (mon.0) 1009 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:44:06.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:44:05 gibba045 bash[25517]: audit 2021-03-10T14:44:05.100053+0000 mon.c (mon.1) 863 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:44:06.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:44:05 gibba045 bash[25517]: audit 2021-03-10T14:44:05.104669+0000 mon.c (mon.1) 864 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:44:06.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:44:05 gibba045 bash[25517]: audit 2021-03-10T14:44:05.109085+0000 mon.c (mon.1) 865 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:44:06.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:44:05 gibba045 bash[25517]: audit 2021-03-10T14:44:05.112395+0000 mon.c (mon.1) 866 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:44:06.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:44:05 gibba045 bash[25517]: audit 2021-03-10T14:44:05.119560+0000 mon.c (mon.1) 867 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:44:06.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:44:05 gibba045 bash[25517]: audit 2021-03-10T14:44:05.124691+0000 mon.c (mon.1) 868 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:44:06.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:44:05 gibba015 bash[29377]: cephadm 2021-03-10T14:44:04.877360+0000 mgr.gibba045.orlgmj (mgr.34412) 2946 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:44:06.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:44:05 gibba015 bash[29377]: audit 2021-03-10T14:44:05.081590+0000 mon.a (mon.0) 1009 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:44:06.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:44:05 gibba015 bash[29377]: audit 2021-03-10T14:44:05.100053+0000 mon.c (mon.1) 863 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:44:06.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:44:05 gibba015 bash[29377]: audit 2021-03-10T14:44:05.104669+0000 mon.c (mon.1) 864 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:44:06.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:44:05 gibba015 bash[29377]: audit 2021-03-10T14:44:05.109085+0000 mon.c (mon.1) 865 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:44:06.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:44:05 gibba015 bash[29377]: audit 2021-03-10T14:44:05.112395+0000 mon.c (mon.1) 866 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:44:06.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:44:05 gibba015 bash[29377]: audit 2021-03-10T14:44:05.119560+0000 mon.c (mon.1) 867 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:44:06.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:44:05 gibba015 bash[29377]: audit 2021-03-10T14:44:05.124691+0000 mon.c (mon.1) 868 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:44:06.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:44:05 gibba015 bash[30343]: cephadm 2021-03-10T14:44:04.877360+0000 mgr.gibba045.orlgmj (mgr.34412) 2946 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:44:06.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:44:05 gibba015 bash[30343]: audit 2021-03-10T14:44:05.081590+0000 mon.a (mon.0) 1009 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:44:06.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:44:05 gibba015 bash[30343]: audit 2021-03-10T14:44:05.100053+0000 mon.c (mon.1) 863 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:44:06.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:44:05 gibba015 bash[30343]: audit 2021-03-10T14:44:05.104669+0000 mon.c (mon.1) 864 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:44:06.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:44:05 gibba015 bash[30343]: audit 2021-03-10T14:44:05.109085+0000 mon.c (mon.1) 865 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:44:06.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:44:05 gibba015 bash[30343]: audit 2021-03-10T14:44:05.112395+0000 mon.c (mon.1) 866 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:44:06.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:44:05 gibba015 bash[30343]: audit 2021-03-10T14:44:05.119560+0000 mon.c (mon.1) 867 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:44:06.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:44:05 gibba015 bash[30343]: audit 2021-03-10T14:44:05.124691+0000 mon.c (mon.1) 868 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:44:07.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:44:06 gibba045 bash[25517]: cephadm 2021-03-10T14:44:05.100389+0000 mgr.gibba045.orlgmj (mgr.34412) 2947 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:44:07.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:44:06 gibba045 bash[25517]: cephadm 2021-03-10T14:44:05.106506+0000 mgr.gibba045.orlgmj (mgr.34412) 2948 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:44:07.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:44:06 gibba045 bash[25517]: cephadm 2021-03-10T14:44:05.110703+0000 mgr.gibba045.orlgmj (mgr.34412) 2949 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:44:07.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:44:06 gibba045 bash[25517]: cephadm 2021-03-10T14:44:05.111261+0000 mgr.gibba045.orlgmj (mgr.34412) 2950 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:44:07.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:44:06 gibba045 bash[25517]: cephadm 2021-03-10T14:44:05.114536+0000 mgr.gibba045.orlgmj (mgr.34412) 2951 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:44:07.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:44:06 gibba045 bash[25517]: cephadm 2021-03-10T14:44:05.114920+0000 mgr.gibba045.orlgmj (mgr.34412) 2952 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:44:07.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:44:06 gibba045 bash[25517]: cephadm 2021-03-10T14:44:05.117673+0000 mgr.gibba045.orlgmj (mgr.34412) 2953 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:44:07.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:44:06 gibba045 bash[25517]: cephadm 2021-03-10T14:44:05.120933+0000 mgr.gibba045.orlgmj (mgr.34412) 2954 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:44:07.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:44:06 gibba045 bash[25517]: cephadm 2021-03-10T14:44:05.121218+0000 mgr.gibba045.orlgmj (mgr.34412) 2955 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:44:07.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:44:06 gibba045 bash[25517]: cephadm 2021-03-10T14:44:05.125003+0000 mgr.gibba045.orlgmj (mgr.34412) 2956 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:44:07.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:44:06 gibba045 bash[25517]: cephadm 2021-03-10T14:44:05.127039+0000 mgr.gibba045.orlgmj (mgr.34412) 2957 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:44:07.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:44:06 gibba045 bash[25517]: cephadm 2021-03-10T14:44:05.130218+0000 mgr.gibba045.orlgmj (mgr.34412) 2958 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:44:07.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:44:06 gibba045 bash[25517]: cephadm 2021-03-10T14:44:05.130503+0000 mgr.gibba045.orlgmj (mgr.34412) 2959 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:44:07.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:44:06 gibba045 bash[25517]: cephadm 2021-03-10T14:44:05.131088+0000 mgr.gibba045.orlgmj (mgr.34412) 2960 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:44:07.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:44:06 gibba045 bash[25517]: cluster 2021-03-10T14:44:05.294954+0000 mgr.gibba045.orlgmj (mgr.34412) 2961 : cluster [DBG] pgmap v1670: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:07.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:44:06 gibba015 bash[29377]: cephadm 2021-03-10T14:44:05.100389+0000 mgr.gibba045.orlgmj (mgr.34412) 2947 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:44:07.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:44:06 gibba015 bash[29377]: cephadm 2021-03-10T14:44:05.106506+0000 mgr.gibba045.orlgmj (mgr.34412) 2948 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:44:07.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:44:06 gibba015 bash[29377]: cephadm 2021-03-10T14:44:05.110703+0000 mgr.gibba045.orlgmj (mgr.34412) 2949 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:44:07.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:44:06 gibba015 bash[29377]: cephadm 2021-03-10T14:44:05.111261+0000 mgr.gibba045.orlgmj (mgr.34412) 2950 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:44:07.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:44:06 gibba015 bash[29377]: cephadm 2021-03-10T14:44:05.114536+0000 mgr.gibba045.orlgmj (mgr.34412) 2951 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:44:07.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:44:06 gibba015 bash[29377]: cephadm 2021-03-10T14:44:05.114920+0000 mgr.gibba045.orlgmj (mgr.34412) 2952 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:44:07.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:44:06 gibba015 bash[29377]: cephadm 2021-03-10T14:44:05.117673+0000 mgr.gibba045.orlgmj (mgr.34412) 2953 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:44:07.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:44:06 gibba015 bash[29377]: cephadm 2021-03-10T14:44:05.120933+0000 mgr.gibba045.orlgmj (mgr.34412) 2954 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:44:07.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:44:06 gibba015 bash[29377]: cephadm 2021-03-10T14:44:05.121218+0000 mgr.gibba045.orlgmj (mgr.34412) 2955 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:44:07.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:44:06 gibba015 bash[29377]: cephadm 2021-03-10T14:44:05.125003+0000 mgr.gibba045.orlgmj (mgr.34412) 2956 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:44:07.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:44:06 gibba015 bash[29377]: cephadm 2021-03-10T14:44:05.127039+0000 mgr.gibba045.orlgmj (mgr.34412) 2957 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:44:07.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:44:06 gibba015 bash[29377]: cephadm 2021-03-10T14:44:05.130218+0000 mgr.gibba045.orlgmj (mgr.34412) 2958 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:44:07.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:44:06 gibba015 bash[29377]: cephadm 2021-03-10T14:44:05.130503+0000 mgr.gibba045.orlgmj (mgr.34412) 2959 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:44:07.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:44:06 gibba015 bash[29377]: cephadm 2021-03-10T14:44:05.131088+0000 mgr.gibba045.orlgmj (mgr.34412) 2960 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:44:07.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:44:06 gibba015 bash[29377]: cluster 2021-03-10T14:44:05.294954+0000 mgr.gibba045.orlgmj (mgr.34412) 2961 : cluster [DBG] pgmap v1670: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:07.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:44:06 gibba015 bash[30343]: cephadm 2021-03-10T14:44:05.100389+0000 mgr.gibba045.orlgmj (mgr.34412) 2947 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:44:07.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:44:06 gibba015 bash[30343]: cephadm 2021-03-10T14:44:05.106506+0000 mgr.gibba045.orlgmj (mgr.34412) 2948 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:44:07.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:44:06 gibba015 bash[30343]: cephadm 2021-03-10T14:44:05.110703+0000 mgr.gibba045.orlgmj (mgr.34412) 2949 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:44:07.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:44:06 gibba015 bash[30343]: cephadm 2021-03-10T14:44:05.111261+0000 mgr.gibba045.orlgmj (mgr.34412) 2950 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:44:07.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:44:06 gibba015 bash[30343]: cephadm 2021-03-10T14:44:05.114536+0000 mgr.gibba045.orlgmj (mgr.34412) 2951 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:44:07.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:44:06 gibba015 bash[30343]: cephadm 2021-03-10T14:44:05.114920+0000 mgr.gibba045.orlgmj (mgr.34412) 2952 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:44:07.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:44:06 gibba015 bash[30343]: cephadm 2021-03-10T14:44:05.117673+0000 mgr.gibba045.orlgmj (mgr.34412) 2953 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:44:07.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:44:06 gibba015 bash[30343]: cephadm 2021-03-10T14:44:05.120933+0000 mgr.gibba045.orlgmj (mgr.34412) 2954 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:44:07.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:44:06 gibba015 bash[30343]: cephadm 2021-03-10T14:44:05.121218+0000 mgr.gibba045.orlgmj (mgr.34412) 2955 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:44:07.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:44:06 gibba015 bash[30343]: cephadm 2021-03-10T14:44:05.125003+0000 mgr.gibba045.orlgmj (mgr.34412) 2956 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:44:07.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:44:06 gibba015 bash[30343]: cephadm 2021-03-10T14:44:05.127039+0000 mgr.gibba045.orlgmj (mgr.34412) 2957 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:44:07.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:44:06 gibba015 bash[30343]: cephadm 2021-03-10T14:44:05.130218+0000 mgr.gibba045.orlgmj (mgr.34412) 2958 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:44:07.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:44:06 gibba015 bash[30343]: cephadm 2021-03-10T14:44:05.130503+0000 mgr.gibba045.orlgmj (mgr.34412) 2959 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:44:07.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:44:06 gibba015 bash[30343]: cephadm 2021-03-10T14:44:05.131088+0000 mgr.gibba045.orlgmj (mgr.34412) 2960 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:44:07.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:44:06 gibba015 bash[30343]: cluster 2021-03-10T14:44:05.294954+0000 mgr.gibba045.orlgmj (mgr.34412) 2961 : cluster [DBG] pgmap v1670: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:09.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:44:08 gibba045 bash[25517]: cluster 2021-03-10T14:44:07.296630+0000 mgr.gibba045.orlgmj (mgr.34412) 2962 : cluster [DBG] pgmap v1671: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:09.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:44:08 gibba015 bash[29377]: cluster 2021-03-10T14:44:07.296630+0000 mgr.gibba045.orlgmj (mgr.34412) 2962 : cluster [DBG] pgmap v1671: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:09.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:44:08 gibba015 bash[30343]: cluster 2021-03-10T14:44:07.296630+0000 mgr.gibba045.orlgmj (mgr.34412) 2962 : cluster [DBG] pgmap v1671: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:10.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:44:10 gibba045 bash[25517]: cluster 2021-03-10T14:44:09.297875+0000 mgr.gibba045.orlgmj (mgr.34412) 2963 : cluster [DBG] pgmap v1672: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:10.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:44:10 gibba015 bash[29377]: cluster 2021-03-10T14:44:09.297875+0000 mgr.gibba045.orlgmj (mgr.34412) 2963 : cluster [DBG] pgmap v1672: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:10.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:44:10 gibba015 bash[30343]: cluster 2021-03-10T14:44:09.297875+0000 mgr.gibba045.orlgmj (mgr.34412) 2963 : cluster [DBG] pgmap v1672: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:12.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:44:12 gibba015 bash[29377]: cluster 2021-03-10T14:44:11.299354+0000 mgr.gibba045.orlgmj (mgr.34412) 2964 : cluster [DBG] pgmap v1673: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:12.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:44:12 gibba015 bash[30343]: cluster 2021-03-10T14:44:11.299354+0000 mgr.gibba045.orlgmj (mgr.34412) 2964 : cluster [DBG] pgmap v1673: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:12.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:44:12 gibba045 bash[25517]: cluster 2021-03-10T14:44:11.299354+0000 mgr.gibba045.orlgmj (mgr.34412) 2964 : cluster [DBG] pgmap v1673: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:15.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:44:14 gibba045 bash[25517]: cluster 2021-03-10T14:44:13.300926+0000 mgr.gibba045.orlgmj (mgr.34412) 2965 : cluster [DBG] pgmap v1674: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:15.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:44:14 gibba015 bash[29377]: cluster 2021-03-10T14:44:13.300926+0000 mgr.gibba045.orlgmj (mgr.34412) 2965 : cluster [DBG] pgmap v1674: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:15.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:44:14 gibba015 bash[30343]: cluster 2021-03-10T14:44:13.300926+0000 mgr.gibba045.orlgmj (mgr.34412) 2965 : cluster [DBG] pgmap v1674: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:16.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:44:16 gibba045 bash[25517]: cluster 2021-03-10T14:44:15.302614+0000 mgr.gibba045.orlgmj (mgr.34412) 2966 : cluster [DBG] pgmap v1675: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:16.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:44:15 gibba015 bash[29377]: cluster 2021-03-10T14:44:15.302614+0000 mgr.gibba045.orlgmj (mgr.34412) 2966 : cluster [DBG] pgmap v1675: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:16.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:44:16 gibba015 bash[30343]: cluster 2021-03-10T14:44:15.302614+0000 mgr.gibba045.orlgmj (mgr.34412) 2966 : cluster [DBG] pgmap v1675: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:19.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:44:18 gibba045 bash[25517]: cluster 2021-03-10T14:44:17.304374+0000 mgr.gibba045.orlgmj (mgr.34412) 2967 : cluster [DBG] pgmap v1676: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:19.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:44:18 gibba015 bash[29377]: cluster 2021-03-10T14:44:17.304374+0000 mgr.gibba045.orlgmj (mgr.34412) 2967 : cluster [DBG] pgmap v1676: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:19.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:44:18 gibba015 bash[30343]: cluster 2021-03-10T14:44:17.304374+0000 mgr.gibba045.orlgmj (mgr.34412) 2967 : cluster [DBG] pgmap v1676: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:20.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:44:20 gibba045 bash[25517]: cluster 2021-03-10T14:44:19.305607+0000 mgr.gibba045.orlgmj (mgr.34412) 2968 : cluster [DBG] pgmap v1677: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:20.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:44:19 gibba015 bash[29377]: cluster 2021-03-10T14:44:19.305607+0000 mgr.gibba045.orlgmj (mgr.34412) 2968 : cluster [DBG] pgmap v1677: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:20.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:44:19 gibba015 bash[30343]: cluster 2021-03-10T14:44:19.305607+0000 mgr.gibba045.orlgmj (mgr.34412) 2968 : cluster [DBG] pgmap v1677: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:21.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:44:21 gibba045 bash[25517]: cephadm 2021-03-10T14:44:20.145360+0000 mgr.gibba045.orlgmj (mgr.34412) 2969 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:44:21.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:44:21 gibba015 bash[29377]: cephadm 2021-03-10T14:44:20.145360+0000 mgr.gibba045.orlgmj (mgr.34412) 2969 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:44:21.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:44:21 gibba015 bash[30343]: cephadm 2021-03-10T14:44:20.145360+0000 mgr.gibba045.orlgmj (mgr.34412) 2969 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:44:22.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:44:22 gibba045 bash[25517]: cluster 2021-03-10T14:44:21.307431+0000 mgr.gibba045.orlgmj (mgr.34412) 2970 : cluster [DBG] pgmap v1678: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:22.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:44:22 gibba015 bash[29377]: cluster 2021-03-10T14:44:21.307431+0000 mgr.gibba045.orlgmj (mgr.34412) 2970 : cluster [DBG] pgmap v1678: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:22.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:44:22 gibba015 bash[30343]: cluster 2021-03-10T14:44:21.307431+0000 mgr.gibba045.orlgmj (mgr.34412) 2970 : cluster [DBG] pgmap v1678: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:24.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:44:24 gibba045 bash[25517]: cluster 2021-03-10T14:44:23.308954+0000 mgr.gibba045.orlgmj (mgr.34412) 2971 : cluster [DBG] pgmap v1679: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:24.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:44:24 gibba015 bash[29377]: cluster 2021-03-10T14:44:23.308954+0000 mgr.gibba045.orlgmj (mgr.34412) 2971 : cluster [DBG] pgmap v1679: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:24.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:44:24 gibba015 bash[30343]: cluster 2021-03-10T14:44:23.308954+0000 mgr.gibba045.orlgmj (mgr.34412) 2971 : cluster [DBG] pgmap v1679: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:26.460 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:44:26.716 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:44:26.717 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (55m) 21s ago 60m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:44:26.717 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (60m) 9m ago 60m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:44:26.717 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (55m) 9m ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:44:26.718 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (55m) 9m ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:44:26.718 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (54m) 21s ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:44:26.718 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (54m) 21s ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:44:26.718 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (54m) 9m ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:44:26.718 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (54m) 21s ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:44:26.719 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (60m) 21s ago 60m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:44:26.719 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (60m) 9m ago 60m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:44:26.719 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (53m) 21s ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:44:26.719 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (53m) 21s ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:44:26.719 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (52m) 21s ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:44:26.720 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (52m) 21s ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:44:26.720 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (51m) 9m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:44:26.720 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (51m) 9m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:44:26.720 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (50m) 9m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:44:26.720 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (50m) 9m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:44:26.721 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (60m) 9m ago 60m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:44:26.721 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 9m ago 58m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:44:26.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:44:26 gibba015 bash[29377]: cluster 2021-03-10T14:44:25.310474+0000 mgr.gibba045.orlgmj (mgr.34412) 2972 : cluster [DBG] pgmap v1680: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:26.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:44:26 gibba015 bash[30343]: cluster 2021-03-10T14:44:25.310474+0000 mgr.gibba045.orlgmj (mgr.34412) 2972 : cluster [DBG] pgmap v1680: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:26.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:44:26 gibba045 bash[25517]: cluster 2021-03-10T14:44:25.310474+0000 mgr.gibba045.orlgmj (mgr.34412) 2972 : cluster [DBG] pgmap v1680: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:26.966 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:44:26.966 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:44:26.966 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:44:26.966 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:44:26.967 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:44:26.967 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:44:26.967 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:44:26.967 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:44:26.968 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:44:26.968 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:44:26.968 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:44:26.968 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:44:26.968 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:44:26.969 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:44:26.969 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:44:27.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:44:27 gibba015 bash[29377]: audit 2021-03-10T14:44:26.451151+0000 mgr.gibba045.orlgmj (mgr.34412) 2973 : audit [DBG] from='client.46050 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:44:27.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:44:27 gibba015 bash[29377]: audit 2021-03-10T14:44:26.676243+0000 mgr.gibba045.orlgmj (mgr.34412) 2974 : audit [DBG] from='client.46056 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:44:27.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:44:27 gibba015 bash[29377]: audit 2021-03-10T14:44:26.962488+0000 mon.c (mon.1) 869 : audit [DBG] from='client.? 172.21.2.115:0/3431281123' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:44:27.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:44:27 gibba015 bash[30343]: audit 2021-03-10T14:44:26.451151+0000 mgr.gibba045.orlgmj (mgr.34412) 2973 : audit [DBG] from='client.46050 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:44:27.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:44:27 gibba015 bash[30343]: audit 2021-03-10T14:44:26.676243+0000 mgr.gibba045.orlgmj (mgr.34412) 2974 : audit [DBG] from='client.46056 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:44:27.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:44:27 gibba015 bash[30343]: audit 2021-03-10T14:44:26.962488+0000 mon.c (mon.1) 869 : audit [DBG] from='client.? 172.21.2.115:0/3431281123' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:44:27.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:44:27 gibba045 bash[25517]: audit 2021-03-10T14:44:26.451151+0000 mgr.gibba045.orlgmj (mgr.34412) 2973 : audit [DBG] from='client.46050 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:44:27.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:44:27 gibba045 bash[25517]: audit 2021-03-10T14:44:26.676243+0000 mgr.gibba045.orlgmj (mgr.34412) 2974 : audit [DBG] from='client.46056 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:44:27.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:44:27 gibba045 bash[25517]: audit 2021-03-10T14:44:26.962488+0000 mon.c (mon.1) 869 : audit [DBG] from='client.? 172.21.2.115:0/3431281123' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:44:29.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:44:28 gibba045 bash[25517]: cluster 2021-03-10T14:44:27.312203+0000 mgr.gibba045.orlgmj (mgr.34412) 2975 : cluster [DBG] pgmap v1681: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:29.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:44:28 gibba015 bash[29377]: cluster 2021-03-10T14:44:27.312203+0000 mgr.gibba045.orlgmj (mgr.34412) 2975 : cluster [DBG] pgmap v1681: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:29.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:44:28 gibba015 bash[30343]: cluster 2021-03-10T14:44:27.312203+0000 mgr.gibba045.orlgmj (mgr.34412) 2975 : cluster [DBG] pgmap v1681: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:30.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:44:30 gibba045 bash[25517]: cluster 2021-03-10T14:44:29.313588+0000 mgr.gibba045.orlgmj (mgr.34412) 2976 : cluster [DBG] pgmap v1682: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:30.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:44:30 gibba015 bash[29377]: cluster 2021-03-10T14:44:29.313588+0000 mgr.gibba045.orlgmj (mgr.34412) 2976 : cluster [DBG] pgmap v1682: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:30.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:44:30 gibba015 bash[30343]: cluster 2021-03-10T14:44:29.313588+0000 mgr.gibba045.orlgmj (mgr.34412) 2976 : cluster [DBG] pgmap v1682: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:32.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:44:32 gibba015 bash[29377]: cluster 2021-03-10T14:44:31.315127+0000 mgr.gibba045.orlgmj (mgr.34412) 2977 : cluster [DBG] pgmap v1683: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:32.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:44:32 gibba015 bash[30343]: cluster 2021-03-10T14:44:31.315127+0000 mgr.gibba045.orlgmj (mgr.34412) 2977 : cluster [DBG] pgmap v1683: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:32.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:44:32 gibba045 bash[25517]: cluster 2021-03-10T14:44:31.315127+0000 mgr.gibba045.orlgmj (mgr.34412) 2977 : cluster [DBG] pgmap v1683: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:34.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:44:34 gibba045 bash[25517]: cluster 2021-03-10T14:44:33.316860+0000 mgr.gibba045.orlgmj (mgr.34412) 2978 : cluster [DBG] pgmap v1684: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:34.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:44:34 gibba015 bash[29377]: cluster 2021-03-10T14:44:33.316860+0000 mgr.gibba045.orlgmj (mgr.34412) 2978 : cluster [DBG] pgmap v1684: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:34.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:44:34 gibba015 bash[30343]: cluster 2021-03-10T14:44:33.316860+0000 mgr.gibba045.orlgmj (mgr.34412) 2978 : cluster [DBG] pgmap v1684: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:36.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:44:36 gibba015 bash[29377]: cephadm 2021-03-10T14:44:35.161391+0000 mgr.gibba045.orlgmj (mgr.34412) 2979 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:44:36.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:44:36 gibba015 bash[29377]: cluster 2021-03-10T14:44:35.318567+0000 mgr.gibba045.orlgmj (mgr.34412) 2980 : cluster [DBG] pgmap v1685: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:36.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:44:36 gibba015 bash[30343]: cephadm 2021-03-10T14:44:35.161391+0000 mgr.gibba045.orlgmj (mgr.34412) 2979 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:44:36.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:44:36 gibba015 bash[30343]: cluster 2021-03-10T14:44:35.318567+0000 mgr.gibba045.orlgmj (mgr.34412) 2980 : cluster [DBG] pgmap v1685: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:36.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:44:36 gibba045 bash[25517]: cephadm 2021-03-10T14:44:35.161391+0000 mgr.gibba045.orlgmj (mgr.34412) 2979 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:44:36.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:44:36 gibba045 bash[25517]: cluster 2021-03-10T14:44:35.318567+0000 mgr.gibba045.orlgmj (mgr.34412) 2980 : cluster [DBG] pgmap v1685: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:39.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:44:39 gibba045 bash[25517]: cluster 2021-03-10T14:44:37.320231+0000 mgr.gibba045.orlgmj (mgr.34412) 2981 : cluster [DBG] pgmap v1686: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:39.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:44:38 gibba015 bash[29377]: cluster 2021-03-10T14:44:37.320231+0000 mgr.gibba045.orlgmj (mgr.34412) 2981 : cluster [DBG] pgmap v1686: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:39.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:44:38 gibba015 bash[30343]: cluster 2021-03-10T14:44:37.320231+0000 mgr.gibba045.orlgmj (mgr.34412) 2981 : cluster [DBG] pgmap v1686: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:40.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:44:40 gibba045 bash[25517]: cluster 2021-03-10T14:44:39.321481+0000 mgr.gibba045.orlgmj (mgr.34412) 2982 : cluster [DBG] pgmap v1687: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:40.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:44:40 gibba015 bash[29377]: cluster 2021-03-10T14:44:39.321481+0000 mgr.gibba045.orlgmj (mgr.34412) 2982 : cluster [DBG] pgmap v1687: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:40.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:44:40 gibba015 bash[30343]: cluster 2021-03-10T14:44:39.321481+0000 mgr.gibba045.orlgmj (mgr.34412) 2982 : cluster [DBG] pgmap v1687: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:42.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:44:42 gibba015 bash[29377]: cluster 2021-03-10T14:44:41.323377+0000 mgr.gibba045.orlgmj (mgr.34412) 2983 : cluster [DBG] pgmap v1688: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:42.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:44:42 gibba015 bash[30343]: cluster 2021-03-10T14:44:41.323377+0000 mgr.gibba045.orlgmj (mgr.34412) 2983 : cluster [DBG] pgmap v1688: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:42.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:44:42 gibba045 bash[25517]: cluster 2021-03-10T14:44:41.323377+0000 mgr.gibba045.orlgmj (mgr.34412) 2983 : cluster [DBG] pgmap v1688: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:44.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:44:44 gibba045 bash[25517]: cluster 2021-03-10T14:44:43.325232+0000 mgr.gibba045.orlgmj (mgr.34412) 2984 : cluster [DBG] pgmap v1689: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:44.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:44:44 gibba015 bash[29377]: cluster 2021-03-10T14:44:43.325232+0000 mgr.gibba045.orlgmj (mgr.34412) 2984 : cluster [DBG] pgmap v1689: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:44.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:44:44 gibba015 bash[30343]: cluster 2021-03-10T14:44:43.325232+0000 mgr.gibba045.orlgmj (mgr.34412) 2984 : cluster [DBG] pgmap v1689: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:46.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:44:46 gibba015 bash[29377]: cluster 2021-03-10T14:44:45.326890+0000 mgr.gibba045.orlgmj (mgr.34412) 2985 : cluster [DBG] pgmap v1690: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:46.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:44:46 gibba015 bash[30343]: cluster 2021-03-10T14:44:45.326890+0000 mgr.gibba045.orlgmj (mgr.34412) 2985 : cluster [DBG] pgmap v1690: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:46.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:44:46 gibba045 bash[25517]: cluster 2021-03-10T14:44:45.326890+0000 mgr.gibba045.orlgmj (mgr.34412) 2985 : cluster [DBG] pgmap v1690: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:48.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:44:48 gibba015 bash[29377]: cluster 2021-03-10T14:44:47.328767+0000 mgr.gibba045.orlgmj (mgr.34412) 2986 : cluster [DBG] pgmap v1691: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:48.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:44:48 gibba015 bash[30343]: cluster 2021-03-10T14:44:47.328767+0000 mgr.gibba045.orlgmj (mgr.34412) 2986 : cluster [DBG] pgmap v1691: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:48.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:44:48 gibba045 bash[25517]: cluster 2021-03-10T14:44:47.328767+0000 mgr.gibba045.orlgmj (mgr.34412) 2986 : cluster [DBG] pgmap v1691: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:50.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:44:50 gibba045 bash[25517]: cluster 2021-03-10T14:44:49.329983+0000 mgr.gibba045.orlgmj (mgr.34412) 2987 : cluster [DBG] pgmap v1692: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:50.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:44:50 gibba015 bash[29377]: cluster 2021-03-10T14:44:49.329983+0000 mgr.gibba045.orlgmj (mgr.34412) 2987 : cluster [DBG] pgmap v1692: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:50.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:44:50 gibba015 bash[30343]: cluster 2021-03-10T14:44:49.329983+0000 mgr.gibba045.orlgmj (mgr.34412) 2987 : cluster [DBG] pgmap v1692: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:51.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:44:51 gibba015 bash[29377]: cephadm 2021-03-10T14:44:50.177140+0000 mgr.gibba045.orlgmj (mgr.34412) 2988 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:44:51.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:44:51 gibba015 bash[30343]: cephadm 2021-03-10T14:44:50.177140+0000 mgr.gibba045.orlgmj (mgr.34412) 2988 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:44:51.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:44:51 gibba045 bash[25517]: cephadm 2021-03-10T14:44:50.177140+0000 mgr.gibba045.orlgmj (mgr.34412) 2988 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:44:52.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:44:52 gibba015 bash[29377]: cluster 2021-03-10T14:44:51.331704+0000 mgr.gibba045.orlgmj (mgr.34412) 2989 : cluster [DBG] pgmap v1693: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:52.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:44:52 gibba015 bash[30343]: cluster 2021-03-10T14:44:51.331704+0000 mgr.gibba045.orlgmj (mgr.34412) 2989 : cluster [DBG] pgmap v1693: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:52.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:44:52 gibba045 bash[25517]: cluster 2021-03-10T14:44:51.331704+0000 mgr.gibba045.orlgmj (mgr.34412) 2989 : cluster [DBG] pgmap v1693: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:53.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:44:53 gibba015 bash[29377]: audit 2021-03-10T14:44:52.825183+0000 mon.c (mon.1) 870 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:44:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:44:53 gibba015 bash[29377]: audit 2021-03-10T14:44:52.825798+0000 mon.c (mon.1) 871 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:44:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:44:53 gibba015 bash[29377]: audit 2021-03-10T14:44:52.826292+0000 mon.a (mon.0) 1010 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:44:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:44:53 gibba015 bash[29377]: audit 2021-03-10T14:44:52.826461+0000 mon.c (mon.1) 872 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T14:44:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:44:53 gibba015 bash[29377]: audit 2021-03-10T14:44:52.827142+0000 mon.c (mon.1) 873 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:44:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:44:53 gibba015 bash[29377]: audit 2021-03-10T14:44:52.827753+0000 mon.a (mon.0) 1011 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:44:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:44:53 gibba015 bash[29377]: audit 2021-03-10T14:44:52.827940+0000 mon.c (mon.1) 874 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:44:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:44:53 gibba015 bash[29377]: audit 2021-03-10T14:44:52.828739+0000 mon.a (mon.0) 1012 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T14:44:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:44:53 gibba015 bash[29377]: audit 2021-03-10T14:44:52.828739+0000 mon.c (mon.1) 875 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:44:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:44:53 gibba015 bash[29377]: audit 2021-03-10T14:44:52.829779+0000 mon.a (mon.0) 1013 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:44:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:44:53 gibba015 bash[29377]: audit 2021-03-10T14:44:52.830855+0000 mon.a (mon.0) 1014 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:44:53.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:44:53 gibba015 bash[29377]: audit 2021-03-10T14:44:52.831575+0000 mon.a (mon.0) 1015 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:44:53.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:44:53 gibba015 bash[30343]: audit 2021-03-10T14:44:52.825183+0000 mon.c (mon.1) 870 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:44:53.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:44:53 gibba015 bash[30343]: audit 2021-03-10T14:44:52.825798+0000 mon.c (mon.1) 871 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:44:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:44:53 gibba015 bash[30343]: audit 2021-03-10T14:44:52.826292+0000 mon.a (mon.0) 1010 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:44:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:44:53 gibba015 bash[30343]: audit 2021-03-10T14:44:52.826461+0000 mon.c (mon.1) 872 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T14:44:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:44:53 gibba015 bash[30343]: audit 2021-03-10T14:44:52.827142+0000 mon.c (mon.1) 873 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:44:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:44:53 gibba015 bash[30343]: audit 2021-03-10T14:44:52.827753+0000 mon.a (mon.0) 1011 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:44:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:44:53 gibba015 bash[30343]: audit 2021-03-10T14:44:52.827940+0000 mon.c (mon.1) 874 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:44:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:44:53 gibba015 bash[30343]: audit 2021-03-10T14:44:52.828739+0000 mon.a (mon.0) 1012 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T14:44:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:44:53 gibba015 bash[30343]: audit 2021-03-10T14:44:52.828739+0000 mon.c (mon.1) 875 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:44:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:44:53 gibba015 bash[30343]: audit 2021-03-10T14:44:52.829779+0000 mon.a (mon.0) 1013 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:44:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:44:53 gibba015 bash[30343]: audit 2021-03-10T14:44:52.830855+0000 mon.a (mon.0) 1014 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:44:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:44:53 gibba015 bash[30343]: audit 2021-03-10T14:44:52.831575+0000 mon.a (mon.0) 1015 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:44:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:44:53 gibba045 bash[25517]: audit 2021-03-10T14:44:52.825183+0000 mon.c (mon.1) 870 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:44:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:44:53 gibba045 bash[25517]: audit 2021-03-10T14:44:52.825798+0000 mon.c (mon.1) 871 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:44:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:44:53 gibba045 bash[25517]: audit 2021-03-10T14:44:52.826292+0000 mon.a (mon.0) 1010 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:44:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:44:53 gibba045 bash[25517]: audit 2021-03-10T14:44:52.826461+0000 mon.c (mon.1) 872 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T14:44:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:44:53 gibba045 bash[25517]: audit 2021-03-10T14:44:52.827142+0000 mon.c (mon.1) 873 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:44:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:44:53 gibba045 bash[25517]: audit 2021-03-10T14:44:52.827753+0000 mon.a (mon.0) 1011 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:44:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:44:53 gibba045 bash[25517]: audit 2021-03-10T14:44:52.827940+0000 mon.c (mon.1) 874 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:44:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:44:53 gibba045 bash[25517]: audit 2021-03-10T14:44:52.828739+0000 mon.a (mon.0) 1012 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T14:44:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:44:53 gibba045 bash[25517]: audit 2021-03-10T14:44:52.828739+0000 mon.c (mon.1) 875 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:44:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:44:53 gibba045 bash[25517]: audit 2021-03-10T14:44:52.829779+0000 mon.a (mon.0) 1013 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:44:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:44:53 gibba045 bash[25517]: audit 2021-03-10T14:44:52.830855+0000 mon.a (mon.0) 1014 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:44:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:44:53 gibba045 bash[25517]: audit 2021-03-10T14:44:52.831575+0000 mon.a (mon.0) 1015 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:44:54.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:44:54 gibba015 bash[29377]: cluster 2021-03-10T14:44:53.333254+0000 mgr.gibba045.orlgmj (mgr.34412) 2990 : cluster [DBG] pgmap v1694: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:54.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:44:54 gibba015 bash[30343]: cluster 2021-03-10T14:44:53.333254+0000 mgr.gibba045.orlgmj (mgr.34412) 2990 : cluster [DBG] pgmap v1694: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:54.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:44:54 gibba045 bash[25517]: cluster 2021-03-10T14:44:53.333254+0000 mgr.gibba045.orlgmj (mgr.34412) 2990 : cluster [DBG] pgmap v1694: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:56.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:44:56 gibba015 bash[29377]: cluster 2021-03-10T14:44:55.334976+0000 mgr.gibba045.orlgmj (mgr.34412) 2991 : cluster [DBG] pgmap v1695: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:56.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:44:56 gibba015 bash[30343]: cluster 2021-03-10T14:44:55.334976+0000 mgr.gibba045.orlgmj (mgr.34412) 2991 : cluster [DBG] pgmap v1695: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:56.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:44:56 gibba045 bash[25517]: cluster 2021-03-10T14:44:55.334976+0000 mgr.gibba045.orlgmj (mgr.34412) 2991 : cluster [DBG] pgmap v1695: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:57.206 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:44:57.434 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:44:57.435 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (55m) 52s ago 61m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:44:57.435 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (60m) 10m ago 60m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:44:57.435 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (56m) 10m ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:44:57.435 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (56m) 10m ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:44:57.435 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (55m) 52s ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:44:57.436 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (55m) 52s ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:44:57.436 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (54m) 10m ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:44:57.436 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (54m) 52s ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:44:57.436 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (61m) 52s ago 61m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:44:57.436 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (61m) 10m ago 61m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:44:57.437 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (53m) 52s ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:44:57.437 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (53m) 52s ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:44:57.437 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (53m) 52s ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:44:57.437 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (52m) 52s ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:44:57.437 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (52m) 10m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:44:57.438 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (51m) 10m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:44:57.438 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (51m) 10m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:44:57.438 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (50m) 10m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:44:57.438 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (60m) 10m ago 61m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:44:57.438 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 10m ago 59m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:44:57.684 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:44:57.685 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:44:57.685 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:44:57.685 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:44:57.685 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:44:57.686 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:44:57.686 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:44:57.686 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:44:57.686 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:44:57.686 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:44:57.687 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:44:57.687 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:44:57.687 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:44:57.687 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:44:57.688 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:44:58.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:44:58 gibba015 bash[29377]: audit 2021-03-10T14:44:57.197214+0000 mgr.gibba045.orlgmj (mgr.34412) 2992 : audit [DBG] from='client.46068 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:44:58.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:44:58 gibba015 bash[29377]: cluster 2021-03-10T14:44:57.336665+0000 mgr.gibba045.orlgmj (mgr.34412) 2993 : cluster [DBG] pgmap v1696: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:58.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:44:58 gibba015 bash[29377]: audit 2021-03-10T14:44:57.421853+0000 mgr.gibba045.orlgmj (mgr.34412) 2994 : audit [DBG] from='client.46074 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:44:58.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:44:58 gibba015 bash[29377]: audit 2021-03-10T14:44:57.681142+0000 mon.a (mon.0) 1016 : audit [DBG] from='client.? 172.21.2.115:0/3926822338' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:44:58.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:44:58 gibba015 bash[30343]: audit 2021-03-10T14:44:57.197214+0000 mgr.gibba045.orlgmj (mgr.34412) 2992 : audit [DBG] from='client.46068 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:44:58.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:44:58 gibba015 bash[30343]: cluster 2021-03-10T14:44:57.336665+0000 mgr.gibba045.orlgmj (mgr.34412) 2993 : cluster [DBG] pgmap v1696: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:58.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:44:58 gibba015 bash[30343]: audit 2021-03-10T14:44:57.421853+0000 mgr.gibba045.orlgmj (mgr.34412) 2994 : audit [DBG] from='client.46074 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:44:58.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:44:58 gibba015 bash[30343]: audit 2021-03-10T14:44:57.681142+0000 mon.a (mon.0) 1016 : audit [DBG] from='client.? 172.21.2.115:0/3926822338' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:44:58.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:44:58 gibba045 bash[25517]: audit 2021-03-10T14:44:57.197214+0000 mgr.gibba045.orlgmj (mgr.34412) 2992 : audit [DBG] from='client.46068 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:44:58.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:44:58 gibba045 bash[25517]: cluster 2021-03-10T14:44:57.336665+0000 mgr.gibba045.orlgmj (mgr.34412) 2993 : cluster [DBG] pgmap v1696: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:58.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:44:58 gibba045 bash[25517]: audit 2021-03-10T14:44:57.421853+0000 mgr.gibba045.orlgmj (mgr.34412) 2994 : audit [DBG] from='client.46074 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:44:58.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:44:58 gibba045 bash[25517]: audit 2021-03-10T14:44:57.681142+0000 mon.a (mon.0) 1016 : audit [DBG] from='client.? 172.21.2.115:0/3926822338' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:45:00.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:00 gibba015 bash[29377]: cluster 2021-03-10T14:44:59.338023+0000 mgr.gibba045.orlgmj (mgr.34412) 2995 : cluster [DBG] pgmap v1697: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:00.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:00 gibba015 bash[30343]: cluster 2021-03-10T14:44:59.338023+0000 mgr.gibba045.orlgmj (mgr.34412) 2995 : cluster [DBG] pgmap v1697: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:00.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:00 gibba045 bash[25517]: cluster 2021-03-10T14:44:59.338023+0000 mgr.gibba045.orlgmj (mgr.34412) 2995 : cluster [DBG] pgmap v1697: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:02.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:02 gibba015 bash[29377]: cluster 2021-03-10T14:45:01.339517+0000 mgr.gibba045.orlgmj (mgr.34412) 2996 : cluster [DBG] pgmap v1698: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:02.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:02 gibba015 bash[30343]: cluster 2021-03-10T14:45:01.339517+0000 mgr.gibba045.orlgmj (mgr.34412) 2996 : cluster [DBG] pgmap v1698: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:02.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:02 gibba045 bash[25517]: cluster 2021-03-10T14:45:01.339517+0000 mgr.gibba045.orlgmj (mgr.34412) 2996 : cluster [DBG] pgmap v1698: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:04.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:04 gibba045 bash[25517]: cluster 2021-03-10T14:45:03.341067+0000 mgr.gibba045.orlgmj (mgr.34412) 2997 : cluster [DBG] pgmap v1699: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:04.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:04 gibba015 bash[29377]: cluster 2021-03-10T14:45:03.341067+0000 mgr.gibba045.orlgmj (mgr.34412) 2997 : cluster [DBG] pgmap v1699: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:04.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:04 gibba015 bash[30343]: cluster 2021-03-10T14:45:03.341067+0000 mgr.gibba045.orlgmj (mgr.34412) 2997 : cluster [DBG] pgmap v1699: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:05.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:05 gibba045 bash[25517]: audit 2021-03-10T14:45:05.190733+0000 mon.c (mon.1) 876 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:45:05.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:05 gibba045 bash[25517]: audit 2021-03-10T14:45:05.197433+0000 mon.c (mon.1) 877 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:45:05.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:05 gibba015 bash[29377]: audit 2021-03-10T14:45:05.190733+0000 mon.c (mon.1) 876 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:45:05.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:05 gibba015 bash[29377]: audit 2021-03-10T14:45:05.197433+0000 mon.c (mon.1) 877 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:45:05.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:05 gibba015 bash[30343]: audit 2021-03-10T14:45:05.190733+0000 mon.c (mon.1) 876 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:45:05.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:05 gibba015 bash[30343]: audit 2021-03-10T14:45:05.197433+0000 mon.c (mon.1) 877 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:45:06.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:06 gibba045 bash[25517]: cephadm 2021-03-10T14:45:05.198869+0000 mgr.gibba045.orlgmj (mgr.34412) 2998 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:45:06.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:06 gibba045 bash[25517]: cluster 2021-03-10T14:45:05.341605+0000 mgr.gibba045.orlgmj (mgr.34412) 2999 : cluster [DBG] pgmap v1700: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:06.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:06 gibba015 bash[29377]: cephadm 2021-03-10T14:45:05.198869+0000 mgr.gibba045.orlgmj (mgr.34412) 2998 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:45:06.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:06 gibba015 bash[29377]: cluster 2021-03-10T14:45:05.341605+0000 mgr.gibba045.orlgmj (mgr.34412) 2999 : cluster [DBG] pgmap v1700: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:06.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:06 gibba015 bash[30343]: cephadm 2021-03-10T14:45:05.198869+0000 mgr.gibba045.orlgmj (mgr.34412) 2998 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:45:06.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:06 gibba015 bash[30343]: cluster 2021-03-10T14:45:05.341605+0000 mgr.gibba045.orlgmj (mgr.34412) 2999 : cluster [DBG] pgmap v1700: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:08.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:08 gibba015 bash[29377]: cluster 2021-03-10T14:45:07.343157+0000 mgr.gibba045.orlgmj (mgr.34412) 3000 : cluster [DBG] pgmap v1701: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:08.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:08 gibba015 bash[30343]: cluster 2021-03-10T14:45:07.343157+0000 mgr.gibba045.orlgmj (mgr.34412) 3000 : cluster [DBG] pgmap v1701: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:08.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:08 gibba045 bash[25517]: cluster 2021-03-10T14:45:07.343157+0000 mgr.gibba045.orlgmj (mgr.34412) 3000 : cluster [DBG] pgmap v1701: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:10.294 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:09 gibba045 bash[25517]: audit 2021-03-10T14:45:08.974155+0000 mon.a (mon.0) 1017 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:45:10.294 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:09 gibba045 bash[25517]: audit 2021-03-10T14:45:08.977224+0000 mon.c (mon.1) 878 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T14:45:10.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:09 gibba015 bash[29377]: audit 2021-03-10T14:45:08.974155+0000 mon.a (mon.0) 1017 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:45:10.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:09 gibba015 bash[29377]: audit 2021-03-10T14:45:08.977224+0000 mon.c (mon.1) 878 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T14:45:10.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:09 gibba015 bash[30343]: audit 2021-03-10T14:45:08.974155+0000 mon.a (mon.0) 1017 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:45:10.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:09 gibba015 bash[30343]: audit 2021-03-10T14:45:08.977224+0000 mon.c (mon.1) 878 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T14:45:11.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:10 gibba045 bash[25517]: cluster 2021-03-10T14:45:09.344569+0000 mgr.gibba045.orlgmj (mgr.34412) 3001 : cluster [DBG] pgmap v1702: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:11.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:10 gibba015 bash[29377]: cluster 2021-03-10T14:45:09.344569+0000 mgr.gibba045.orlgmj (mgr.34412) 3001 : cluster [DBG] pgmap v1702: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:11.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:10 gibba015 bash[30343]: cluster 2021-03-10T14:45:09.344569+0000 mgr.gibba045.orlgmj (mgr.34412) 3001 : cluster [DBG] pgmap v1702: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:13.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:12 gibba045 bash[25517]: cluster 2021-03-10T14:45:11.346082+0000 mgr.gibba045.orlgmj (mgr.34412) 3002 : cluster [DBG] pgmap v1703: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:13.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:12 gibba015 bash[29377]: cluster 2021-03-10T14:45:11.346082+0000 mgr.gibba045.orlgmj (mgr.34412) 3002 : cluster [DBG] pgmap v1703: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:13.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:12 gibba015 bash[30343]: cluster 2021-03-10T14:45:11.346082+0000 mgr.gibba045.orlgmj (mgr.34412) 3002 : cluster [DBG] pgmap v1703: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:14.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:14 gibba045 bash[25517]: cluster 2021-03-10T14:45:13.347589+0000 mgr.gibba045.orlgmj (mgr.34412) 3003 : cluster [DBG] pgmap v1704: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:14.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:14 gibba045 bash[25517]: audit 2021-03-10T14:45:13.611265+0000 mon.c (mon.1) 879 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:45:14.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:14 gibba045 bash[25517]: audit 2021-03-10T14:45:13.786899+0000 mon.a (mon.0) 1018 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:45:14.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:14 gibba045 bash[25517]: cephadm 2021-03-10T14:45:13.791146+0000 mgr.gibba045.orlgmj (mgr.34412) 3004 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:45:14.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:14 gibba045 bash[25517]: audit 2021-03-10T14:45:13.985169+0000 mon.a (mon.0) 1019 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:45:14.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:14 gibba045 bash[25517]: audit 2021-03-10T14:45:13.988902+0000 mon.c (mon.1) 880 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:45:14.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:14 gibba045 bash[25517]: audit 2021-03-10T14:45:13.990197+0000 mon.c (mon.1) 881 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:45:14.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:14 gibba045 bash[25517]: cephadm 2021-03-10T14:45:13.991406+0000 mgr.gibba045.orlgmj (mgr.34412) 3005 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:45:14.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:14 gibba045 bash[25517]: audit 2021-03-10T14:45:13.991818+0000 mon.c (mon.1) 882 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:45:14.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:14 gibba045 bash[25517]: cephadm 2021-03-10T14:45:13.993055+0000 mgr.gibba045.orlgmj (mgr.34412) 3006 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:45:14.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:14 gibba045 bash[25517]: audit 2021-03-10T14:45:13.993113+0000 mon.c (mon.1) 883 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:45:14.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:14 gibba045 bash[25517]: cephadm 2021-03-10T14:45:13.994352+0000 mgr.gibba045.orlgmj (mgr.34412) 3007 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:45:14.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:14 gibba045 bash[25517]: cephadm 2021-03-10T14:45:13.994399+0000 mgr.gibba045.orlgmj (mgr.34412) 3008 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:45:14.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:14 gibba045 bash[25517]: cephadm 2021-03-10T14:45:13.995871+0000 mgr.gibba045.orlgmj (mgr.34412) 3009 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:45:14.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:14 gibba045 bash[25517]: cephadm 2021-03-10T14:45:13.995915+0000 mgr.gibba045.orlgmj (mgr.34412) 3010 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:45:14.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:14 gibba045 bash[25517]: audit 2021-03-10T14:45:13.996318+0000 mon.c (mon.1) 884 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:45:14.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:14 gibba045 bash[25517]: cephadm 2021-03-10T14:45:13.997330+0000 mgr.gibba045.orlgmj (mgr.34412) 3011 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:45:14.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:14 gibba045 bash[25517]: audit 2021-03-10T14:45:13.997744+0000 mon.c (mon.1) 885 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:45:14.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:14 gibba045 bash[25517]: cephadm 2021-03-10T14:45:13.998935+0000 mgr.gibba045.orlgmj (mgr.34412) 3012 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:45:14.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:14 gibba045 bash[25517]: cephadm 2021-03-10T14:45:13.998981+0000 mgr.gibba045.orlgmj (mgr.34412) 3013 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:45:14.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:14 gibba045 bash[25517]: cephadm 2021-03-10T14:45:14.000257+0000 mgr.gibba045.orlgmj (mgr.34412) 3014 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:45:14.312 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:14 gibba045 bash[25517]: cephadm 2021-03-10T14:45:14.000591+0000 mgr.gibba045.orlgmj (mgr.34412) 3015 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:45:14.312 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:14 gibba045 bash[25517]: cephadm 2021-03-10T14:45:14.001707+0000 mgr.gibba045.orlgmj (mgr.34412) 3016 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:45:14.312 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:14 gibba045 bash[25517]: cephadm 2021-03-10T14:45:14.001753+0000 mgr.gibba045.orlgmj (mgr.34412) 3017 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:45:14.312 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:14 gibba045 bash[25517]: cephadm 2021-03-10T14:45:14.001873+0000 mgr.gibba045.orlgmj (mgr.34412) 3018 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:45:14.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:14 gibba015 bash[29377]: cluster 2021-03-10T14:45:13.347589+0000 mgr.gibba045.orlgmj (mgr.34412) 3003 : cluster [DBG] pgmap v1704: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:14.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:14 gibba015 bash[29377]: audit 2021-03-10T14:45:13.611265+0000 mon.c (mon.1) 879 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:45:14.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:14 gibba015 bash[29377]: audit 2021-03-10T14:45:13.786899+0000 mon.a (mon.0) 1018 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:45:14.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:14 gibba015 bash[29377]: cephadm 2021-03-10T14:45:13.791146+0000 mgr.gibba045.orlgmj (mgr.34412) 3004 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:45:14.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:14 gibba015 bash[29377]: audit 2021-03-10T14:45:13.985169+0000 mon.a (mon.0) 1019 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:45:14.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:14 gibba015 bash[29377]: audit 2021-03-10T14:45:13.988902+0000 mon.c (mon.1) 880 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:45:14.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:14 gibba015 bash[29377]: audit 2021-03-10T14:45:13.990197+0000 mon.c (mon.1) 881 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:45:14.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:14 gibba015 bash[29377]: cephadm 2021-03-10T14:45:13.991406+0000 mgr.gibba045.orlgmj (mgr.34412) 3005 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:45:14.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:14 gibba015 bash[29377]: audit 2021-03-10T14:45:13.991818+0000 mon.c (mon.1) 882 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:45:14.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:14 gibba015 bash[29377]: cephadm 2021-03-10T14:45:13.993055+0000 mgr.gibba045.orlgmj (mgr.34412) 3006 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:45:14.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:14 gibba015 bash[29377]: audit 2021-03-10T14:45:13.993113+0000 mon.c (mon.1) 883 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:45:14.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:14 gibba015 bash[29377]: cephadm 2021-03-10T14:45:13.994352+0000 mgr.gibba045.orlgmj (mgr.34412) 3007 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:45:14.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:14 gibba015 bash[29377]: cephadm 2021-03-10T14:45:13.994399+0000 mgr.gibba045.orlgmj (mgr.34412) 3008 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:45:14.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:14 gibba015 bash[29377]: cephadm 2021-03-10T14:45:13.995871+0000 mgr.gibba045.orlgmj (mgr.34412) 3009 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:45:14.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:14 gibba015 bash[29377]: cephadm 2021-03-10T14:45:13.995915+0000 mgr.gibba045.orlgmj (mgr.34412) 3010 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:45:14.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:14 gibba015 bash[29377]: audit 2021-03-10T14:45:13.996318+0000 mon.c (mon.1) 884 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:45:14.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:14 gibba015 bash[29377]: cephadm 2021-03-10T14:45:13.997330+0000 mgr.gibba045.orlgmj (mgr.34412) 3011 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:45:14.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:14 gibba015 bash[29377]: audit 2021-03-10T14:45:13.997744+0000 mon.c (mon.1) 885 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:45:14.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:14 gibba015 bash[29377]: cephadm 2021-03-10T14:45:13.998935+0000 mgr.gibba045.orlgmj (mgr.34412) 3012 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:45:14.479 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:14 gibba015 bash[29377]: cephadm 2021-03-10T14:45:13.998981+0000 mgr.gibba045.orlgmj (mgr.34412) 3013 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:45:14.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:14 gibba015 bash[30343]: cluster 2021-03-10T14:45:13.347589+0000 mgr.gibba045.orlgmj (mgr.34412) 3003 : cluster [DBG] pgmap v1704: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:14.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:14 gibba015 bash[30343]: audit 2021-03-10T14:45:13.611265+0000 mon.c (mon.1) 879 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:45:14.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:14 gibba015 bash[30343]: audit 2021-03-10T14:45:13.786899+0000 mon.a (mon.0) 1018 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:45:14.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:14 gibba015 bash[30343]: cephadm 2021-03-10T14:45:13.791146+0000 mgr.gibba045.orlgmj (mgr.34412) 3004 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:45:14.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:14 gibba015 bash[30343]: audit 2021-03-10T14:45:13.985169+0000 mon.a (mon.0) 1019 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:45:14.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:14 gibba015 bash[30343]: audit 2021-03-10T14:45:13.988902+0000 mon.c (mon.1) 880 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:45:14.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:14 gibba015 bash[30343]: audit 2021-03-10T14:45:13.990197+0000 mon.c (mon.1) 881 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:45:14.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:14 gibba015 bash[30343]: cephadm 2021-03-10T14:45:13.991406+0000 mgr.gibba045.orlgmj (mgr.34412) 3005 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:45:14.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:14 gibba015 bash[30343]: audit 2021-03-10T14:45:13.991818+0000 mon.c (mon.1) 882 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:45:14.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:14 gibba015 bash[30343]: cephadm 2021-03-10T14:45:13.993055+0000 mgr.gibba045.orlgmj (mgr.34412) 3006 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:45:14.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:14 gibba015 bash[30343]: audit 2021-03-10T14:45:13.993113+0000 mon.c (mon.1) 883 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:45:14.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:14 gibba015 bash[30343]: cephadm 2021-03-10T14:45:13.994352+0000 mgr.gibba045.orlgmj (mgr.34412) 3007 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:45:14.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:14 gibba015 bash[30343]: cephadm 2021-03-10T14:45:13.994399+0000 mgr.gibba045.orlgmj (mgr.34412) 3008 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:45:14.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:14 gibba015 bash[30343]: cephadm 2021-03-10T14:45:13.995871+0000 mgr.gibba045.orlgmj (mgr.34412) 3009 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:45:14.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:14 gibba015 bash[30343]: cephadm 2021-03-10T14:45:13.995915+0000 mgr.gibba045.orlgmj (mgr.34412) 3010 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:45:14.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:14 gibba015 bash[30343]: audit 2021-03-10T14:45:13.996318+0000 mon.c (mon.1) 884 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:45:14.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:14 gibba015 bash[30343]: cephadm 2021-03-10T14:45:13.997330+0000 mgr.gibba045.orlgmj (mgr.34412) 3011 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:45:14.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:14 gibba015 bash[30343]: audit 2021-03-10T14:45:13.997744+0000 mon.c (mon.1) 885 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:45:14.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:14 gibba015 bash[30343]: cephadm 2021-03-10T14:45:13.998935+0000 mgr.gibba045.orlgmj (mgr.34412) 3012 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:45:14.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:14 gibba015 bash[30343]: cephadm 2021-03-10T14:45:13.998981+0000 mgr.gibba045.orlgmj (mgr.34412) 3013 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:45:14.484 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:14 gibba015 bash[29377]: cephadm 2021-03-10T14:45:14.000257+0000 mgr.gibba045.orlgmj (mgr.34412) 3014 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:45:14.484 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:14 gibba015 bash[29377]: cephadm 2021-03-10T14:45:14.000591+0000 mgr.gibba045.orlgmj (mgr.34412) 3015 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:45:14.484 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:14 gibba015 bash[29377]: cephadm 2021-03-10T14:45:14.001707+0000 mgr.gibba045.orlgmj (mgr.34412) 3016 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:45:14.484 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:14 gibba015 bash[29377]: cephadm 2021-03-10T14:45:14.001753+0000 mgr.gibba045.orlgmj (mgr.34412) 3017 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:45:14.485 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:14 gibba015 bash[29377]: cephadm 2021-03-10T14:45:14.001873+0000 mgr.gibba045.orlgmj (mgr.34412) 3018 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:45:14.485 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:14 gibba015 bash[30343]: cephadm 2021-03-10T14:45:14.000257+0000 mgr.gibba045.orlgmj (mgr.34412) 3014 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:45:14.485 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:14 gibba015 bash[30343]: cephadm 2021-03-10T14:45:14.000591+0000 mgr.gibba045.orlgmj (mgr.34412) 3015 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:45:14.485 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:14 gibba015 bash[30343]: cephadm 2021-03-10T14:45:14.001707+0000 mgr.gibba045.orlgmj (mgr.34412) 3016 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:45:14.486 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:14 gibba015 bash[30343]: cephadm 2021-03-10T14:45:14.001753+0000 mgr.gibba045.orlgmj (mgr.34412) 3017 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:45:14.486 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:14 gibba015 bash[30343]: cephadm 2021-03-10T14:45:14.001873+0000 mgr.gibba045.orlgmj (mgr.34412) 3018 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:45:16.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:16 gibba015 bash[29377]: cluster 2021-03-10T14:45:15.349173+0000 mgr.gibba045.orlgmj (mgr.34412) 3019 : cluster [DBG] pgmap v1705: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:16.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:16 gibba015 bash[30343]: cluster 2021-03-10T14:45:15.349173+0000 mgr.gibba045.orlgmj (mgr.34412) 3019 : cluster [DBG] pgmap v1705: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:16.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:16 gibba045 bash[25517]: cluster 2021-03-10T14:45:15.349173+0000 mgr.gibba045.orlgmj (mgr.34412) 3019 : cluster [DBG] pgmap v1705: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:18.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:18 gibba015 bash[29377]: cluster 2021-03-10T14:45:17.350733+0000 mgr.gibba045.orlgmj (mgr.34412) 3020 : cluster [DBG] pgmap v1706: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:18.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:18 gibba015 bash[30343]: cluster 2021-03-10T14:45:17.350733+0000 mgr.gibba045.orlgmj (mgr.34412) 3020 : cluster [DBG] pgmap v1706: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:18.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:18 gibba045 bash[25517]: cluster 2021-03-10T14:45:17.350733+0000 mgr.gibba045.orlgmj (mgr.34412) 3020 : cluster [DBG] pgmap v1706: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:20.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:20 gibba015 bash[29377]: cluster 2021-03-10T14:45:19.351933+0000 mgr.gibba045.orlgmj (mgr.34412) 3021 : cluster [DBG] pgmap v1707: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:20.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:20 gibba015 bash[30343]: cluster 2021-03-10T14:45:19.351933+0000 mgr.gibba045.orlgmj (mgr.34412) 3021 : cluster [DBG] pgmap v1707: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:20.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:20 gibba045 bash[25517]: cluster 2021-03-10T14:45:19.351933+0000 mgr.gibba045.orlgmj (mgr.34412) 3021 : cluster [DBG] pgmap v1707: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:22.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:22 gibba015 bash[29377]: cluster 2021-03-10T14:45:21.353679+0000 mgr.gibba045.orlgmj (mgr.34412) 3022 : cluster [DBG] pgmap v1708: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:22.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:22 gibba015 bash[30343]: cluster 2021-03-10T14:45:21.353679+0000 mgr.gibba045.orlgmj (mgr.34412) 3022 : cluster [DBG] pgmap v1708: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:22.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:22 gibba045 bash[25517]: cluster 2021-03-10T14:45:21.353679+0000 mgr.gibba045.orlgmj (mgr.34412) 3022 : cluster [DBG] pgmap v1708: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:24.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:24 gibba045 bash[25517]: cluster 2021-03-10T14:45:23.355286+0000 mgr.gibba045.orlgmj (mgr.34412) 3023 : cluster [DBG] pgmap v1709: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:24.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:24 gibba015 bash[29377]: cluster 2021-03-10T14:45:23.355286+0000 mgr.gibba045.orlgmj (mgr.34412) 3023 : cluster [DBG] pgmap v1709: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:24.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:24 gibba015 bash[30343]: cluster 2021-03-10T14:45:23.355286+0000 mgr.gibba045.orlgmj (mgr.34412) 3023 : cluster [DBG] pgmap v1709: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:26.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:26 gibba015 bash[29377]: cluster 2021-03-10T14:45:25.357037+0000 mgr.gibba045.orlgmj (mgr.34412) 3024 : cluster [DBG] pgmap v1710: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:26.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:26 gibba015 bash[30343]: cluster 2021-03-10T14:45:25.357037+0000 mgr.gibba045.orlgmj (mgr.34412) 3024 : cluster [DBG] pgmap v1710: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:26.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:26 gibba045 bash[25517]: cluster 2021-03-10T14:45:25.357037+0000 mgr.gibba045.orlgmj (mgr.34412) 3024 : cluster [DBG] pgmap v1710: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:27.928 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:45:28.156 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:45:28.156 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (56m) 83s ago 61m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:45:28.156 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (61m) 19s ago 61m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:45:28.156 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (56m) 19s ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:45:28.157 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (56m) 19s ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:45:28.157 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (55m) 83s ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:45:28.157 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (55m) 83s ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:45:28.157 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (55m) 19s ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:45:28.158 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (55m) 83s ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:45:28.158 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (61m) 83s ago 61m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:45:28.158 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (61m) 19s ago 61m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:45:28.158 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (54m) 83s ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:45:28.159 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (54m) 83s ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:45:28.159 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (53m) 83s ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:45:28.159 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (53m) 83s ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:45:28.159 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (52m) 19s ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:45:28.159 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (52m) 19s ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:45:28.160 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (51m) 19s ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:45:28.160 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (51m) 19s ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:45:28.160 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (61m) 19s ago 61m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:45:28.160 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 19s ago 59m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:45:28.406 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:45:28.406 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:45:28.407 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:45:28.407 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:45:28.407 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:45:28.407 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:45:28.407 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:45:28.408 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:45:28.408 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:45:28.408 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:45:28.408 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:45:28.409 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:45:28.409 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:45:28.409 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:45:28.409 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:45:28.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:28 gibba015 bash[29377]: cluster 2021-03-10T14:45:27.358823+0000 mgr.gibba045.orlgmj (mgr.34412) 3025 : cluster [DBG] pgmap v1711: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:28.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:28 gibba015 bash[29377]: audit 2021-03-10T14:45:27.918506+0000 mgr.gibba045.orlgmj (mgr.34412) 3026 : audit [DBG] from='client.56074 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:45:28.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:28 gibba015 bash[29377]: audit 2021-03-10T14:45:28.402653+0000 mon.a (mon.0) 1020 : audit [DBG] from='client.? 172.21.2.115:0/3499970140' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:45:28.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:28 gibba015 bash[30343]: cluster 2021-03-10T14:45:27.358823+0000 mgr.gibba045.orlgmj (mgr.34412) 3025 : cluster [DBG] pgmap v1711: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:28.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:28 gibba015 bash[30343]: audit 2021-03-10T14:45:27.918506+0000 mgr.gibba045.orlgmj (mgr.34412) 3026 : audit [DBG] from='client.56074 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:45:28.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:28 gibba015 bash[30343]: audit 2021-03-10T14:45:28.402653+0000 mon.a (mon.0) 1020 : audit [DBG] from='client.? 172.21.2.115:0/3499970140' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:45:28.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:28 gibba045 bash[25517]: cluster 2021-03-10T14:45:27.358823+0000 mgr.gibba045.orlgmj (mgr.34412) 3025 : cluster [DBG] pgmap v1711: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:28.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:28 gibba045 bash[25517]: audit 2021-03-10T14:45:27.918506+0000 mgr.gibba045.orlgmj (mgr.34412) 3026 : audit [DBG] from='client.56074 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:45:28.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:28 gibba045 bash[25517]: audit 2021-03-10T14:45:28.402653+0000 mon.a (mon.0) 1020 : audit [DBG] from='client.? 172.21.2.115:0/3499970140' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:45:29.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:29 gibba015 bash[29377]: audit 2021-03-10T14:45:28.143538+0000 mgr.gibba045.orlgmj (mgr.34412) 3027 : audit [DBG] from='client.56080 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:45:29.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:29 gibba015 bash[30343]: audit 2021-03-10T14:45:28.143538+0000 mgr.gibba045.orlgmj (mgr.34412) 3027 : audit [DBG] from='client.56080 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:45:29.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:29 gibba045 bash[25517]: audit 2021-03-10T14:45:28.143538+0000 mgr.gibba045.orlgmj (mgr.34412) 3027 : audit [DBG] from='client.56080 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:45:30.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:30 gibba015 bash[29377]: cephadm 2021-03-10T14:45:29.016501+0000 mgr.gibba045.orlgmj (mgr.34412) 3028 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:45:30.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:30 gibba015 bash[29377]: cluster 2021-03-10T14:45:29.360264+0000 mgr.gibba045.orlgmj (mgr.34412) 3029 : cluster [DBG] pgmap v1712: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:30.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:30 gibba015 bash[30343]: cephadm 2021-03-10T14:45:29.016501+0000 mgr.gibba045.orlgmj (mgr.34412) 3028 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:45:30.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:30 gibba015 bash[30343]: cluster 2021-03-10T14:45:29.360264+0000 mgr.gibba045.orlgmj (mgr.34412) 3029 : cluster [DBG] pgmap v1712: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:30.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:30 gibba045 bash[25517]: cephadm 2021-03-10T14:45:29.016501+0000 mgr.gibba045.orlgmj (mgr.34412) 3028 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:45:30.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:30 gibba045 bash[25517]: cluster 2021-03-10T14:45:29.360264+0000 mgr.gibba045.orlgmj (mgr.34412) 3029 : cluster [DBG] pgmap v1712: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:32.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:32 gibba015 bash[29377]: cluster 2021-03-10T14:45:31.362040+0000 mgr.gibba045.orlgmj (mgr.34412) 3030 : cluster [DBG] pgmap v1713: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:32.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:32 gibba015 bash[30343]: cluster 2021-03-10T14:45:31.362040+0000 mgr.gibba045.orlgmj (mgr.34412) 3030 : cluster [DBG] pgmap v1713: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:32.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:32 gibba045 bash[25517]: cluster 2021-03-10T14:45:31.362040+0000 mgr.gibba045.orlgmj (mgr.34412) 3030 : cluster [DBG] pgmap v1713: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:34.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:34 gibba045 bash[25517]: cluster 2021-03-10T14:45:33.363712+0000 mgr.gibba045.orlgmj (mgr.34412) 3031 : cluster [DBG] pgmap v1714: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:34.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:34 gibba015 bash[29377]: cluster 2021-03-10T14:45:33.363712+0000 mgr.gibba045.orlgmj (mgr.34412) 3031 : cluster [DBG] pgmap v1714: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:34.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:34 gibba015 bash[30343]: cluster 2021-03-10T14:45:33.363712+0000 mgr.gibba045.orlgmj (mgr.34412) 3031 : cluster [DBG] pgmap v1714: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:36.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:36 gibba015 bash[29377]: cluster 2021-03-10T14:45:35.365462+0000 mgr.gibba045.orlgmj (mgr.34412) 3032 : cluster [DBG] pgmap v1715: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:36.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:36 gibba015 bash[30343]: cluster 2021-03-10T14:45:35.365462+0000 mgr.gibba045.orlgmj (mgr.34412) 3032 : cluster [DBG] pgmap v1715: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:36.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:36 gibba045 bash[25517]: cluster 2021-03-10T14:45:35.365462+0000 mgr.gibba045.orlgmj (mgr.34412) 3032 : cluster [DBG] pgmap v1715: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:38.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:38 gibba015 bash[29377]: cluster 2021-03-10T14:45:37.367174+0000 mgr.gibba045.orlgmj (mgr.34412) 3033 : cluster [DBG] pgmap v1716: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:38.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:38 gibba015 bash[30343]: cluster 2021-03-10T14:45:37.367174+0000 mgr.gibba045.orlgmj (mgr.34412) 3033 : cluster [DBG] pgmap v1716: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:38.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:38 gibba045 bash[25517]: cluster 2021-03-10T14:45:37.367174+0000 mgr.gibba045.orlgmj (mgr.34412) 3033 : cluster [DBG] pgmap v1716: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:40.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:40 gibba015 bash[29377]: cluster 2021-03-10T14:45:39.368581+0000 mgr.gibba045.orlgmj (mgr.34412) 3034 : cluster [DBG] pgmap v1717: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:40.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:40 gibba015 bash[30343]: cluster 2021-03-10T14:45:39.368581+0000 mgr.gibba045.orlgmj (mgr.34412) 3034 : cluster [DBG] pgmap v1717: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:40.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:40 gibba045 bash[25517]: cluster 2021-03-10T14:45:39.368581+0000 mgr.gibba045.orlgmj (mgr.34412) 3034 : cluster [DBG] pgmap v1717: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:42.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:42 gibba015 bash[29377]: cluster 2021-03-10T14:45:41.370426+0000 mgr.gibba045.orlgmj (mgr.34412) 3035 : cluster [DBG] pgmap v1718: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:42.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:42 gibba015 bash[30343]: cluster 2021-03-10T14:45:41.370426+0000 mgr.gibba045.orlgmj (mgr.34412) 3035 : cluster [DBG] pgmap v1718: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:42.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:42 gibba045 bash[25517]: cluster 2021-03-10T14:45:41.370426+0000 mgr.gibba045.orlgmj (mgr.34412) 3035 : cluster [DBG] pgmap v1718: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:44.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:44 gibba045 bash[25517]: cluster 2021-03-10T14:45:43.371804+0000 mgr.gibba045.orlgmj (mgr.34412) 3036 : cluster [DBG] pgmap v1719: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:44.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:44 gibba015 bash[29377]: cluster 2021-03-10T14:45:43.371804+0000 mgr.gibba045.orlgmj (mgr.34412) 3036 : cluster [DBG] pgmap v1719: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:44.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:44 gibba015 bash[30343]: cluster 2021-03-10T14:45:43.371804+0000 mgr.gibba045.orlgmj (mgr.34412) 3036 : cluster [DBG] pgmap v1719: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:45.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:45 gibba045 bash[25517]: cephadm 2021-03-10T14:45:44.029202+0000 mgr.gibba045.orlgmj (mgr.34412) 3037 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:45:45.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:45 gibba015 bash[29377]: cephadm 2021-03-10T14:45:44.029202+0000 mgr.gibba045.orlgmj (mgr.34412) 3037 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:45:45.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:45 gibba015 bash[30343]: cephadm 2021-03-10T14:45:44.029202+0000 mgr.gibba045.orlgmj (mgr.34412) 3037 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:45:46.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:46 gibba045 bash[25517]: cluster 2021-03-10T14:45:45.373366+0000 mgr.gibba045.orlgmj (mgr.34412) 3038 : cluster [DBG] pgmap v1720: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:46.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:46 gibba015 bash[29377]: cluster 2021-03-10T14:45:45.373366+0000 mgr.gibba045.orlgmj (mgr.34412) 3038 : cluster [DBG] pgmap v1720: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:46.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:46 gibba015 bash[30343]: cluster 2021-03-10T14:45:45.373366+0000 mgr.gibba045.orlgmj (mgr.34412) 3038 : cluster [DBG] pgmap v1720: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:48.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:48 gibba015 bash[29377]: cluster 2021-03-10T14:45:47.375065+0000 mgr.gibba045.orlgmj (mgr.34412) 3039 : cluster [DBG] pgmap v1721: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:48.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:48 gibba015 bash[30343]: cluster 2021-03-10T14:45:47.375065+0000 mgr.gibba045.orlgmj (mgr.34412) 3039 : cluster [DBG] pgmap v1721: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:48.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:48 gibba045 bash[25517]: cluster 2021-03-10T14:45:47.375065+0000 mgr.gibba045.orlgmj (mgr.34412) 3039 : cluster [DBG] pgmap v1721: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:50.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:50 gibba015 bash[29377]: cluster 2021-03-10T14:45:49.376611+0000 mgr.gibba045.orlgmj (mgr.34412) 3040 : cluster [DBG] pgmap v1722: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:50.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:50 gibba015 bash[30343]: cluster 2021-03-10T14:45:49.376611+0000 mgr.gibba045.orlgmj (mgr.34412) 3040 : cluster [DBG] pgmap v1722: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:50.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:50 gibba045 bash[25517]: cluster 2021-03-10T14:45:49.376611+0000 mgr.gibba045.orlgmj (mgr.34412) 3040 : cluster [DBG] pgmap v1722: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:52.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:52 gibba015 bash[29377]: cluster 2021-03-10T14:45:51.378391+0000 mgr.gibba045.orlgmj (mgr.34412) 3041 : cluster [DBG] pgmap v1723: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:52.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:52 gibba015 bash[30343]: cluster 2021-03-10T14:45:51.378391+0000 mgr.gibba045.orlgmj (mgr.34412) 3041 : cluster [DBG] pgmap v1723: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:52.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:52 gibba045 bash[25517]: cluster 2021-03-10T14:45:51.378391+0000 mgr.gibba045.orlgmj (mgr.34412) 3041 : cluster [DBG] pgmap v1723: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:53.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:53 gibba015 bash[29377]: audit 2021-03-10T14:45:52.834402+0000 mon.c (mon.1) 886 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:45:53.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:53 gibba015 bash[29377]: audit 2021-03-10T14:45:52.835031+0000 mon.c (mon.1) 887 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:45:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:53 gibba015 bash[29377]: audit 2021-03-10T14:45:52.835492+0000 mon.a (mon.0) 1021 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:45:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:53 gibba015 bash[29377]: audit 2021-03-10T14:45:52.835711+0000 mon.c (mon.1) 888 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T14:45:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:53 gibba015 bash[29377]: audit 2021-03-10T14:45:52.836589+0000 mon.a (mon.0) 1022 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:45:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:53 gibba015 bash[29377]: audit 2021-03-10T14:45:52.836824+0000 mon.c (mon.1) 889 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:45:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:53 gibba015 bash[29377]: audit 2021-03-10T14:45:52.837530+0000 mon.a (mon.0) 1023 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T14:45:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:53 gibba015 bash[29377]: audit 2021-03-10T14:45:52.837705+0000 mon.c (mon.1) 890 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:45:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:53 gibba015 bash[29377]: audit 2021-03-10T14:45:52.838503+0000 mon.c (mon.1) 891 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:45:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:53 gibba015 bash[29377]: audit 2021-03-10T14:45:52.838588+0000 mon.a (mon.0) 1024 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:45:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:53 gibba015 bash[29377]: audit 2021-03-10T14:45:52.838985+0000 mon.a (mon.0) 1025 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:45:53.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:53 gibba015 bash[29377]: audit 2021-03-10T14:45:52.839200+0000 mon.a (mon.0) 1026 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:45:53.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:53 gibba015 bash[30343]: audit 2021-03-10T14:45:52.834402+0000 mon.c (mon.1) 886 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:45:53.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:53 gibba015 bash[30343]: audit 2021-03-10T14:45:52.835031+0000 mon.c (mon.1) 887 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:45:53.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:53 gibba015 bash[30343]: audit 2021-03-10T14:45:52.835492+0000 mon.a (mon.0) 1021 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:45:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:53 gibba015 bash[30343]: audit 2021-03-10T14:45:52.835711+0000 mon.c (mon.1) 888 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T14:45:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:53 gibba015 bash[30343]: audit 2021-03-10T14:45:52.836589+0000 mon.a (mon.0) 1022 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:45:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:53 gibba015 bash[30343]: audit 2021-03-10T14:45:52.836824+0000 mon.c (mon.1) 889 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:45:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:53 gibba015 bash[30343]: audit 2021-03-10T14:45:52.837530+0000 mon.a (mon.0) 1023 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T14:45:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:53 gibba015 bash[30343]: audit 2021-03-10T14:45:52.837705+0000 mon.c (mon.1) 890 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:45:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:53 gibba015 bash[30343]: audit 2021-03-10T14:45:52.838503+0000 mon.c (mon.1) 891 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:45:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:53 gibba015 bash[30343]: audit 2021-03-10T14:45:52.838588+0000 mon.a (mon.0) 1024 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:45:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:53 gibba015 bash[30343]: audit 2021-03-10T14:45:52.838985+0000 mon.a (mon.0) 1025 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:45:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:53 gibba015 bash[30343]: audit 2021-03-10T14:45:52.839200+0000 mon.a (mon.0) 1026 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:45:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:53 gibba045 bash[25517]: audit 2021-03-10T14:45:52.834402+0000 mon.c (mon.1) 886 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:45:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:53 gibba045 bash[25517]: audit 2021-03-10T14:45:52.835031+0000 mon.c (mon.1) 887 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:45:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:53 gibba045 bash[25517]: audit 2021-03-10T14:45:52.835492+0000 mon.a (mon.0) 1021 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:45:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:53 gibba045 bash[25517]: audit 2021-03-10T14:45:52.835711+0000 mon.c (mon.1) 888 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T14:45:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:53 gibba045 bash[25517]: audit 2021-03-10T14:45:52.836589+0000 mon.a (mon.0) 1022 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:45:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:53 gibba045 bash[25517]: audit 2021-03-10T14:45:52.836824+0000 mon.c (mon.1) 889 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:45:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:53 gibba045 bash[25517]: audit 2021-03-10T14:45:52.837530+0000 mon.a (mon.0) 1023 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T14:45:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:53 gibba045 bash[25517]: audit 2021-03-10T14:45:52.837705+0000 mon.c (mon.1) 890 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:45:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:53 gibba045 bash[25517]: audit 2021-03-10T14:45:52.838503+0000 mon.c (mon.1) 891 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:45:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:53 gibba045 bash[25517]: audit 2021-03-10T14:45:52.838588+0000 mon.a (mon.0) 1024 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:45:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:53 gibba045 bash[25517]: audit 2021-03-10T14:45:52.838985+0000 mon.a (mon.0) 1025 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:45:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:53 gibba045 bash[25517]: audit 2021-03-10T14:45:52.839200+0000 mon.a (mon.0) 1026 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:45:54.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:54 gibba015 bash[29377]: cluster 2021-03-10T14:45:53.379728+0000 mgr.gibba045.orlgmj (mgr.34412) 3042 : cluster [DBG] pgmap v1724: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:54.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:54 gibba015 bash[30343]: cluster 2021-03-10T14:45:53.379728+0000 mgr.gibba045.orlgmj (mgr.34412) 3042 : cluster [DBG] pgmap v1724: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:54.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:54 gibba045 bash[25517]: cluster 2021-03-10T14:45:53.379728+0000 mgr.gibba045.orlgmj (mgr.34412) 3042 : cluster [DBG] pgmap v1724: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:56.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:56 gibba045 bash[25517]: cluster 2021-03-10T14:45:55.381292+0000 mgr.gibba045.orlgmj (mgr.34412) 3043 : cluster [DBG] pgmap v1725: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:56.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:56 gibba015 bash[29377]: cluster 2021-03-10T14:45:55.381292+0000 mgr.gibba045.orlgmj (mgr.34412) 3043 : cluster [DBG] pgmap v1725: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:56.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:56 gibba015 bash[30343]: cluster 2021-03-10T14:45:55.381292+0000 mgr.gibba045.orlgmj (mgr.34412) 3043 : cluster [DBG] pgmap v1725: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:58.652 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:45:58.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:58 gibba045 bash[25517]: cluster 2021-03-10T14:45:57.383090+0000 mgr.gibba045.orlgmj (mgr.34412) 3044 : cluster [DBG] pgmap v1726: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:58.910 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:45:58.910 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (56m) 114s ago 62m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:45:58.911 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (61m) 49s ago 61m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:45:58.911 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (57m) 49s ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:45:58.911 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (57m) 49s ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:45:58.911 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (56m) 114s ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:45:58.912 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (56m) 114s ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:45:58.912 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (55m) 49s ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:45:58.912 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (55m) 114s ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:45:58.912 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (62m) 114s ago 62m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:45:58.913 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (62m) 49s ago 62m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:45:58.913 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (55m) 114s ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:45:58.913 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (54m) 114s ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:45:58.913 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (54m) 114s ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:45:58.913 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (53m) 114s ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:45:58.914 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (53m) 49s ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:45:58.914 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (52m) 49s ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:45:58.914 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (52m) 49s ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:45:58.914 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (51m) 49s ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:45:58.915 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (61m) 49s ago 62m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:45:58.915 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 49s ago 60m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:45:58.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:58 gibba015 bash[29377]: cluster 2021-03-10T14:45:57.383090+0000 mgr.gibba045.orlgmj (mgr.34412) 3044 : cluster [DBG] pgmap v1726: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:58.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:58 gibba015 bash[30343]: cluster 2021-03-10T14:45:57.383090+0000 mgr.gibba045.orlgmj (mgr.34412) 3044 : cluster [DBG] pgmap v1726: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:59.167 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:45:59.167 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:45:59.167 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:45:59.168 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:45:59.168 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:45:59.168 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:45:59.168 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:45:59.168 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:45:59.169 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:45:59.169 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:45:59.169 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:45:59.169 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:45:59.170 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:45:59.170 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:45:59.170 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:45:59.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:59 gibba045 bash[25517]: audit 2021-03-10T14:45:58.642350+0000 mgr.gibba045.orlgmj (mgr.34412) 3045 : audit [DBG] from='client.46104 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:45:59.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:59 gibba045 bash[25517]: audit 2021-03-10T14:45:58.871921+0000 mgr.gibba045.orlgmj (mgr.34412) 3046 : audit [DBG] from='client.56098 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:45:59.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:45:59 gibba045 bash[25517]: audit 2021-03-10T14:45:59.163308+0000 mon.c (mon.1) 892 : audit [DBG] from='client.? 172.21.2.115:0/2283357652' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:45:59.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:59 gibba015 bash[29377]: audit 2021-03-10T14:45:58.642350+0000 mgr.gibba045.orlgmj (mgr.34412) 3045 : audit [DBG] from='client.46104 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:45:59.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:59 gibba015 bash[29377]: audit 2021-03-10T14:45:58.871921+0000 mgr.gibba045.orlgmj (mgr.34412) 3046 : audit [DBG] from='client.56098 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:45:59.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:45:59 gibba015 bash[29377]: audit 2021-03-10T14:45:59.163308+0000 mon.c (mon.1) 892 : audit [DBG] from='client.? 172.21.2.115:0/2283357652' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:45:59.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:59 gibba015 bash[30343]: audit 2021-03-10T14:45:58.642350+0000 mgr.gibba045.orlgmj (mgr.34412) 3045 : audit [DBG] from='client.46104 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:45:59.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:59 gibba015 bash[30343]: audit 2021-03-10T14:45:58.871921+0000 mgr.gibba045.orlgmj (mgr.34412) 3046 : audit [DBG] from='client.56098 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:45:59.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:45:59 gibba015 bash[30343]: audit 2021-03-10T14:45:59.163308+0000 mon.c (mon.1) 892 : audit [DBG] from='client.? 172.21.2.115:0/2283357652' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:46:00.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:46:00 gibba045 bash[25517]: cephadm 2021-03-10T14:45:59.041731+0000 mgr.gibba045.orlgmj (mgr.34412) 3047 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:46:00.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:46:00 gibba045 bash[25517]: cluster 2021-03-10T14:45:59.384301+0000 mgr.gibba045.orlgmj (mgr.34412) 3048 : cluster [DBG] pgmap v1727: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:00.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:46:00 gibba015 bash[29377]: cephadm 2021-03-10T14:45:59.041731+0000 mgr.gibba045.orlgmj (mgr.34412) 3047 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:46:00.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:46:00 gibba015 bash[29377]: cluster 2021-03-10T14:45:59.384301+0000 mgr.gibba045.orlgmj (mgr.34412) 3048 : cluster [DBG] pgmap v1727: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:00.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:46:00 gibba015 bash[30343]: cephadm 2021-03-10T14:45:59.041731+0000 mgr.gibba045.orlgmj (mgr.34412) 3047 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:46:00.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:46:00 gibba015 bash[30343]: cluster 2021-03-10T14:45:59.384301+0000 mgr.gibba045.orlgmj (mgr.34412) 3048 : cluster [DBG] pgmap v1727: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:02.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:46:02 gibba045 bash[25517]: cluster 2021-03-10T14:46:01.386025+0000 mgr.gibba045.orlgmj (mgr.34412) 3049 : cluster [DBG] pgmap v1728: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:02.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:46:02 gibba015 bash[29377]: cluster 2021-03-10T14:46:01.386025+0000 mgr.gibba045.orlgmj (mgr.34412) 3049 : cluster [DBG] pgmap v1728: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:02.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:46:02 gibba015 bash[30343]: cluster 2021-03-10T14:46:01.386025+0000 mgr.gibba045.orlgmj (mgr.34412) 3049 : cluster [DBG] pgmap v1728: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:04.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:46:04 gibba045 bash[25517]: cluster 2021-03-10T14:46:03.387353+0000 mgr.gibba045.orlgmj (mgr.34412) 3050 : cluster [DBG] pgmap v1729: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:04.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:46:04 gibba015 bash[29377]: cluster 2021-03-10T14:46:03.387353+0000 mgr.gibba045.orlgmj (mgr.34412) 3050 : cluster [DBG] pgmap v1729: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:04.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:46:04 gibba015 bash[30343]: cluster 2021-03-10T14:46:03.387353+0000 mgr.gibba045.orlgmj (mgr.34412) 3050 : cluster [DBG] pgmap v1729: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:06.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:46:06 gibba015 bash[29377]: cluster 2021-03-10T14:46:05.389012+0000 mgr.gibba045.orlgmj (mgr.34412) 3051 : cluster [DBG] pgmap v1730: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:06.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:46:06 gibba015 bash[30343]: cluster 2021-03-10T14:46:05.389012+0000 mgr.gibba045.orlgmj (mgr.34412) 3051 : cluster [DBG] pgmap v1730: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:06.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:46:06 gibba045 bash[25517]: cluster 2021-03-10T14:46:05.389012+0000 mgr.gibba045.orlgmj (mgr.34412) 3051 : cluster [DBG] pgmap v1730: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:08.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:46:08 gibba015 bash[29377]: cluster 2021-03-10T14:46:07.390513+0000 mgr.gibba045.orlgmj (mgr.34412) 3052 : cluster [DBG] pgmap v1731: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:08.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:46:08 gibba015 bash[30343]: cluster 2021-03-10T14:46:07.390513+0000 mgr.gibba045.orlgmj (mgr.34412) 3052 : cluster [DBG] pgmap v1731: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:08.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:46:08 gibba045 bash[25517]: cluster 2021-03-10T14:46:07.390513+0000 mgr.gibba045.orlgmj (mgr.34412) 3052 : cluster [DBG] pgmap v1731: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:10.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:46:10 gibba015 bash[29377]: cluster 2021-03-10T14:46:09.391743+0000 mgr.gibba045.orlgmj (mgr.34412) 3053 : cluster [DBG] pgmap v1732: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:10.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:46:10 gibba015 bash[30343]: cluster 2021-03-10T14:46:09.391743+0000 mgr.gibba045.orlgmj (mgr.34412) 3053 : cluster [DBG] pgmap v1732: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:10.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:46:10 gibba045 bash[25517]: cluster 2021-03-10T14:46:09.391743+0000 mgr.gibba045.orlgmj (mgr.34412) 3053 : cluster [DBG] pgmap v1732: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:12.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:46:12 gibba045 bash[25517]: cluster 2021-03-10T14:46:11.393630+0000 mgr.gibba045.orlgmj (mgr.34412) 3054 : cluster [DBG] pgmap v1733: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:12.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:46:12 gibba015 bash[29377]: cluster 2021-03-10T14:46:11.393630+0000 mgr.gibba045.orlgmj (mgr.34412) 3054 : cluster [DBG] pgmap v1733: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:12.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:46:12 gibba015 bash[30343]: cluster 2021-03-10T14:46:11.393630+0000 mgr.gibba045.orlgmj (mgr.34412) 3054 : cluster [DBG] pgmap v1733: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:14.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:46:14 gibba045 bash[25517]: cluster 2021-03-10T14:46:13.394951+0000 mgr.gibba045.orlgmj (mgr.34412) 3055 : cluster [DBG] pgmap v1734: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:14.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:46:14 gibba015 bash[29377]: cluster 2021-03-10T14:46:13.394951+0000 mgr.gibba045.orlgmj (mgr.34412) 3055 : cluster [DBG] pgmap v1734: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:14.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:46:14 gibba015 bash[30343]: cluster 2021-03-10T14:46:13.394951+0000 mgr.gibba045.orlgmj (mgr.34412) 3055 : cluster [DBG] pgmap v1734: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:15.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:46:15 gibba045 bash[25517]: audit 2021-03-10T14:46:14.054277+0000 mon.c (mon.1) 893 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:46:15.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:46:15 gibba045 bash[25517]: cephadm 2021-03-10T14:46:14.058720+0000 mgr.gibba045.orlgmj (mgr.34412) 3056 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:46:15.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:46:15 gibba045 bash[25517]: cephadm 2021-03-10T14:46:14.059123+0000 mgr.gibba045.orlgmj (mgr.34412) 3057 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:46:15.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:46:15 gibba045 bash[25517]: audit 2021-03-10T14:46:14.260389+0000 mon.a (mon.0) 1027 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:46:15.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:46:15 gibba045 bash[25517]: audit 2021-03-10T14:46:14.264137+0000 mon.c (mon.1) 894 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:46:15.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:46:15 gibba045 bash[25517]: audit 2021-03-10T14:46:14.265732+0000 mon.c (mon.1) 895 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:46:15.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:46:15 gibba045 bash[25517]: cephadm 2021-03-10T14:46:14.266443+0000 mgr.gibba045.orlgmj (mgr.34412) 3058 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:46:15.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:46:15 gibba045 bash[25517]: audit 2021-03-10T14:46:14.266886+0000 mon.c (mon.1) 896 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:46:15.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:46:15 gibba045 bash[25517]: cephadm 2021-03-10T14:46:14.268326+0000 mgr.gibba045.orlgmj (mgr.34412) 3059 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:46:15.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:46:15 gibba045 bash[25517]: audit 2021-03-10T14:46:14.268377+0000 mon.c (mon.1) 897 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:46:15.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:46:15 gibba045 bash[25517]: cephadm 2021-03-10T14:46:14.269648+0000 mgr.gibba045.orlgmj (mgr.34412) 3060 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:46:15.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:46:15 gibba045 bash[25517]: cephadm 2021-03-10T14:46:14.269686+0000 mgr.gibba045.orlgmj (mgr.34412) 3061 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:46:15.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:46:15 gibba045 bash[25517]: cephadm 2021-03-10T14:46:14.271101+0000 mgr.gibba045.orlgmj (mgr.34412) 3062 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:46:15.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:46:15 gibba045 bash[25517]: cephadm 2021-03-10T14:46:14.271142+0000 mgr.gibba045.orlgmj (mgr.34412) 3063 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:46:15.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:46:15 gibba045 bash[25517]: audit 2021-03-10T14:46:14.271720+0000 mon.c (mon.1) 898 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:46:15.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:46:15 gibba045 bash[25517]: cephadm 2021-03-10T14:46:14.272377+0000 mgr.gibba045.orlgmj (mgr.34412) 3064 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:46:15.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:46:15 gibba045 bash[25517]: audit 2021-03-10T14:46:14.273225+0000 mon.c (mon.1) 899 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:46:15.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:46:15 gibba045 bash[25517]: cephadm 2021-03-10T14:46:14.274280+0000 mgr.gibba045.orlgmj (mgr.34412) 3065 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:46:15.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:46:15 gibba045 bash[25517]: cephadm 2021-03-10T14:46:14.274338+0000 mgr.gibba045.orlgmj (mgr.34412) 3066 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:46:15.312 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:46:15 gibba045 bash[25517]: cephadm 2021-03-10T14:46:14.275706+0000 mgr.gibba045.orlgmj (mgr.34412) 3067 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:46:15.312 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:46:15 gibba045 bash[25517]: cephadm 2021-03-10T14:46:14.276133+0000 mgr.gibba045.orlgmj (mgr.34412) 3068 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:46:15.312 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:46:15 gibba045 bash[25517]: cephadm 2021-03-10T14:46:14.277293+0000 mgr.gibba045.orlgmj (mgr.34412) 3069 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:46:15.312 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:46:15 gibba045 bash[25517]: cephadm 2021-03-10T14:46:14.277338+0000 mgr.gibba045.orlgmj (mgr.34412) 3070 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:46:15.312 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:46:15 gibba045 bash[25517]: cephadm 2021-03-10T14:46:14.277552+0000 mgr.gibba045.orlgmj (mgr.34412) 3071 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:46:15.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:46:15 gibba015 bash[29377]: audit 2021-03-10T14:46:14.054277+0000 mon.c (mon.1) 893 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:46:15.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:46:15 gibba015 bash[29377]: cephadm 2021-03-10T14:46:14.058720+0000 mgr.gibba045.orlgmj (mgr.34412) 3056 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:46:15.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:46:15 gibba015 bash[29377]: cephadm 2021-03-10T14:46:14.059123+0000 mgr.gibba045.orlgmj (mgr.34412) 3057 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:46:15.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:46:15 gibba015 bash[29377]: audit 2021-03-10T14:46:14.260389+0000 mon.a (mon.0) 1027 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:46:15.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:46:15 gibba015 bash[29377]: audit 2021-03-10T14:46:14.264137+0000 mon.c (mon.1) 894 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:46:15.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:46:15 gibba015 bash[29377]: audit 2021-03-10T14:46:14.265732+0000 mon.c (mon.1) 895 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:46:15.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:46:15 gibba015 bash[29377]: cephadm 2021-03-10T14:46:14.266443+0000 mgr.gibba045.orlgmj (mgr.34412) 3058 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:46:15.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:46:15 gibba015 bash[29377]: audit 2021-03-10T14:46:14.266886+0000 mon.c (mon.1) 896 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:46:15.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:46:15 gibba015 bash[29377]: cephadm 2021-03-10T14:46:14.268326+0000 mgr.gibba045.orlgmj (mgr.34412) 3059 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:46:15.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:46:15 gibba015 bash[29377]: audit 2021-03-10T14:46:14.268377+0000 mon.c (mon.1) 897 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:46:15.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:46:15 gibba015 bash[29377]: cephadm 2021-03-10T14:46:14.269648+0000 mgr.gibba045.orlgmj (mgr.34412) 3060 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:46:15.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:46:15 gibba015 bash[29377]: cephadm 2021-03-10T14:46:14.269686+0000 mgr.gibba045.orlgmj (mgr.34412) 3061 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:46:15.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:46:15 gibba015 bash[29377]: cephadm 2021-03-10T14:46:14.271101+0000 mgr.gibba045.orlgmj (mgr.34412) 3062 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:46:15.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:46:15 gibba015 bash[29377]: cephadm 2021-03-10T14:46:14.271142+0000 mgr.gibba045.orlgmj (mgr.34412) 3063 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:46:15.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:46:15 gibba015 bash[29377]: audit 2021-03-10T14:46:14.271720+0000 mon.c (mon.1) 898 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:46:15.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:46:15 gibba015 bash[29377]: cephadm 2021-03-10T14:46:14.272377+0000 mgr.gibba045.orlgmj (mgr.34412) 3064 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:46:15.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:46:15 gibba015 bash[29377]: audit 2021-03-10T14:46:14.273225+0000 mon.c (mon.1) 899 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:46:15.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:46:15 gibba015 bash[29377]: cephadm 2021-03-10T14:46:14.274280+0000 mgr.gibba045.orlgmj (mgr.34412) 3065 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:46:15.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:46:15 gibba015 bash[29377]: cephadm 2021-03-10T14:46:14.274338+0000 mgr.gibba045.orlgmj (mgr.34412) 3066 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:46:15.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:46:15 gibba015 bash[29377]: cephadm 2021-03-10T14:46:14.275706+0000 mgr.gibba045.orlgmj (mgr.34412) 3067 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:46:15.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:46:15 gibba015 bash[30343]: audit 2021-03-10T14:46:14.054277+0000 mon.c (mon.1) 893 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:46:15.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:46:15 gibba015 bash[30343]: cephadm 2021-03-10T14:46:14.058720+0000 mgr.gibba045.orlgmj (mgr.34412) 3056 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:46:15.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:46:15 gibba015 bash[30343]: cephadm 2021-03-10T14:46:14.059123+0000 mgr.gibba045.orlgmj (mgr.34412) 3057 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:46:15.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:46:15 gibba015 bash[30343]: audit 2021-03-10T14:46:14.260389+0000 mon.a (mon.0) 1027 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:46:15.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:46:15 gibba015 bash[30343]: audit 2021-03-10T14:46:14.264137+0000 mon.c (mon.1) 894 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:46:15.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:46:15 gibba015 bash[30343]: audit 2021-03-10T14:46:14.265732+0000 mon.c (mon.1) 895 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:46:15.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:46:15 gibba015 bash[30343]: cephadm 2021-03-10T14:46:14.266443+0000 mgr.gibba045.orlgmj (mgr.34412) 3058 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:46:15.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:46:15 gibba015 bash[30343]: audit 2021-03-10T14:46:14.266886+0000 mon.c (mon.1) 896 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:46:15.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:46:15 gibba015 bash[30343]: cephadm 2021-03-10T14:46:14.268326+0000 mgr.gibba045.orlgmj (mgr.34412) 3059 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:46:15.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:46:15 gibba015 bash[30343]: audit 2021-03-10T14:46:14.268377+0000 mon.c (mon.1) 897 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:46:15.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:46:15 gibba015 bash[30343]: cephadm 2021-03-10T14:46:14.269648+0000 mgr.gibba045.orlgmj (mgr.34412) 3060 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:46:15.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:46:15 gibba015 bash[30343]: cephadm 2021-03-10T14:46:14.269686+0000 mgr.gibba045.orlgmj (mgr.34412) 3061 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:46:15.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:46:15 gibba015 bash[30343]: cephadm 2021-03-10T14:46:14.271101+0000 mgr.gibba045.orlgmj (mgr.34412) 3062 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:46:15.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:46:15 gibba015 bash[30343]: cephadm 2021-03-10T14:46:14.271142+0000 mgr.gibba045.orlgmj (mgr.34412) 3063 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:46:15.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:46:15 gibba015 bash[30343]: audit 2021-03-10T14:46:14.271720+0000 mon.c (mon.1) 898 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:46:15.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:46:15 gibba015 bash[30343]: cephadm 2021-03-10T14:46:14.272377+0000 mgr.gibba045.orlgmj (mgr.34412) 3064 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:46:15.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:46:15 gibba015 bash[30343]: audit 2021-03-10T14:46:14.273225+0000 mon.c (mon.1) 899 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:46:15.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:46:15 gibba015 bash[30343]: cephadm 2021-03-10T14:46:14.274280+0000 mgr.gibba045.orlgmj (mgr.34412) 3065 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:46:15.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:46:15 gibba015 bash[30343]: cephadm 2021-03-10T14:46:14.274338+0000 mgr.gibba045.orlgmj (mgr.34412) 3066 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:46:15.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:46:15 gibba015 bash[30343]: cephadm 2021-03-10T14:46:14.275706+0000 mgr.gibba045.orlgmj (mgr.34412) 3067 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:46:15.483 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:46:15 gibba015 bash[29377]: cephadm 2021-03-10T14:46:14.276133+0000 mgr.gibba045.orlgmj (mgr.34412) 3068 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:46:15.483 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:46:15 gibba015 bash[29377]: cephadm 2021-03-10T14:46:14.277293+0000 mgr.gibba045.orlgmj (mgr.34412) 3069 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:46:15.483 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:46:15 gibba015 bash[29377]: cephadm 2021-03-10T14:46:14.277338+0000 mgr.gibba045.orlgmj (mgr.34412) 3070 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:46:15.484 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:46:15 gibba015 bash[29377]: cephadm 2021-03-10T14:46:14.277552+0000 mgr.gibba045.orlgmj (mgr.34412) 3071 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:46:15.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:46:15 gibba015 bash[30343]: cephadm 2021-03-10T14:46:14.276133+0000 mgr.gibba045.orlgmj (mgr.34412) 3068 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:46:15.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:46:15 gibba015 bash[30343]: cephadm 2021-03-10T14:46:14.277293+0000 mgr.gibba045.orlgmj (mgr.34412) 3069 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:46:15.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:46:15 gibba015 bash[30343]: cephadm 2021-03-10T14:46:14.277338+0000 mgr.gibba045.orlgmj (mgr.34412) 3070 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:46:15.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:46:15 gibba015 bash[30343]: cephadm 2021-03-10T14:46:14.277552+0000 mgr.gibba045.orlgmj (mgr.34412) 3071 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:46:16.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:46:16 gibba015 bash[29377]: cluster 2021-03-10T14:46:15.396621+0000 mgr.gibba045.orlgmj (mgr.34412) 3072 : cluster [DBG] pgmap v1735: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:16.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:46:16 gibba015 bash[30343]: cluster 2021-03-10T14:46:15.396621+0000 mgr.gibba045.orlgmj (mgr.34412) 3072 : cluster [DBG] pgmap v1735: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:16.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:46:16 gibba045 bash[25517]: cluster 2021-03-10T14:46:15.396621+0000 mgr.gibba045.orlgmj (mgr.34412) 3072 : cluster [DBG] pgmap v1735: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:18.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:46:18 gibba015 bash[29377]: cluster 2021-03-10T14:46:17.398358+0000 mgr.gibba045.orlgmj (mgr.34412) 3073 : cluster [DBG] pgmap v1736: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:18.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:46:18 gibba015 bash[30343]: cluster 2021-03-10T14:46:17.398358+0000 mgr.gibba045.orlgmj (mgr.34412) 3073 : cluster [DBG] pgmap v1736: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:18.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:46:18 gibba045 bash[25517]: cluster 2021-03-10T14:46:17.398358+0000 mgr.gibba045.orlgmj (mgr.34412) 3073 : cluster [DBG] pgmap v1736: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:20.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:46:20 gibba015 bash[29377]: cluster 2021-03-10T14:46:19.399727+0000 mgr.gibba045.orlgmj (mgr.34412) 3074 : cluster [DBG] pgmap v1737: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:20.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:46:20 gibba015 bash[30343]: cluster 2021-03-10T14:46:19.399727+0000 mgr.gibba045.orlgmj (mgr.34412) 3074 : cluster [DBG] pgmap v1737: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:20.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:46:20 gibba045 bash[25517]: cluster 2021-03-10T14:46:19.399727+0000 mgr.gibba045.orlgmj (mgr.34412) 3074 : cluster [DBG] pgmap v1737: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:22.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:46:22 gibba045 bash[25517]: cluster 2021-03-10T14:46:21.401978+0000 mgr.gibba045.orlgmj (mgr.34412) 3075 : cluster [DBG] pgmap v1738: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:22.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:46:22 gibba015 bash[29377]: cluster 2021-03-10T14:46:21.401978+0000 mgr.gibba045.orlgmj (mgr.34412) 3075 : cluster [DBG] pgmap v1738: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:22.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:46:22 gibba015 bash[30343]: cluster 2021-03-10T14:46:21.401978+0000 mgr.gibba045.orlgmj (mgr.34412) 3075 : cluster [DBG] pgmap v1738: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:24.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:46:24 gibba015 bash[29377]: cluster 2021-03-10T14:46:23.403238+0000 mgr.gibba045.orlgmj (mgr.34412) 3076 : cluster [DBG] pgmap v1739: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:24.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:46:24 gibba015 bash[30343]: cluster 2021-03-10T14:46:23.403238+0000 mgr.gibba045.orlgmj (mgr.34412) 3076 : cluster [DBG] pgmap v1739: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:24.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:46:24 gibba045 bash[25517]: cluster 2021-03-10T14:46:23.403238+0000 mgr.gibba045.orlgmj (mgr.34412) 3076 : cluster [DBG] pgmap v1739: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:26.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:46:26 gibba015 bash[29377]: cluster 2021-03-10T14:46:25.404939+0000 mgr.gibba045.orlgmj (mgr.34412) 3077 : cluster [DBG] pgmap v1740: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:26.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:46:26 gibba015 bash[30343]: cluster 2021-03-10T14:46:25.404939+0000 mgr.gibba045.orlgmj (mgr.34412) 3077 : cluster [DBG] pgmap v1740: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:26.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:46:26 gibba045 bash[25517]: cluster 2021-03-10T14:46:25.404939+0000 mgr.gibba045.orlgmj (mgr.34412) 3077 : cluster [DBG] pgmap v1740: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:28.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:46:28 gibba045 bash[25517]: cluster 2021-03-10T14:46:27.406693+0000 mgr.gibba045.orlgmj (mgr.34412) 3078 : cluster [DBG] pgmap v1741: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:28.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:46:28 gibba015 bash[29377]: cluster 2021-03-10T14:46:27.406693+0000 mgr.gibba045.orlgmj (mgr.34412) 3078 : cluster [DBG] pgmap v1741: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:28.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:46:28 gibba015 bash[30343]: cluster 2021-03-10T14:46:27.406693+0000 mgr.gibba045.orlgmj (mgr.34412) 3078 : cluster [DBG] pgmap v1741: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:29.411 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:46:29.640 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:46:29.641 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (57m) 2m ago 62m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:46:29.641 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (62m) 80s ago 62m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:46:29.641 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (57m) 80s ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:46:29.641 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (57m) 80s ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:46:29.641 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (56m) 2m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:46:29.642 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (56m) 2m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:46:29.642 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (56m) 80s ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:46:29.642 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (56m) 2m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:46:29.642 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (62m) 2m ago 62m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:46:29.642 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (62m) 80s ago 62m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:46:29.643 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (55m) 2m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:46:29.643 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (55m) 2m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:46:29.643 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (54m) 2m ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:46:29.643 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (54m) 2m ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:46:29.643 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (53m) 80s ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:46:29.644 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (53m) 80s ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:46:29.644 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (52m) 80s ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:46:29.644 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (52m) 80s ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:46:29.644 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (62m) 80s ago 62m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:46:29.644 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 80s ago 60m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:46:29.895 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:46:29.896 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:46:29.896 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:46:29.896 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:46:29.896 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:46:29.897 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:46:29.897 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:46:29.897 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:46:29.897 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:46:29.897 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:46:29.898 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:46:29.898 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:46:29.898 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:46:29.898 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:46:29.898 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:46:30.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:46:30 gibba045 bash[25517]: cephadm 2021-03-10T14:46:29.293243+0000 mgr.gibba045.orlgmj (mgr.34412) 3079 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:46:30.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:46:30 gibba045 bash[25517]: audit 2021-03-10T14:46:29.401396+0000 mgr.gibba045.orlgmj (mgr.34412) 3080 : audit [DBG] from='client.56110 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:46:30.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:46:30 gibba045 bash[25517]: cluster 2021-03-10T14:46:29.408187+0000 mgr.gibba045.orlgmj (mgr.34412) 3081 : cluster [DBG] pgmap v1742: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:30.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:46:30 gibba045 bash[25517]: audit 2021-03-10T14:46:29.629477+0000 mgr.gibba045.orlgmj (mgr.34412) 3082 : audit [DBG] from='client.46128 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:46:30.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:46:30 gibba045 bash[25517]: audit 2021-03-10T14:46:29.892395+0000 mon.a (mon.0) 1028 : audit [DBG] from='client.? 172.21.2.115:0/3430010949' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:46:30.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:46:30 gibba015 bash[29377]: cephadm 2021-03-10T14:46:29.293243+0000 mgr.gibba045.orlgmj (mgr.34412) 3079 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:46:30.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:46:30 gibba015 bash[29377]: audit 2021-03-10T14:46:29.401396+0000 mgr.gibba045.orlgmj (mgr.34412) 3080 : audit [DBG] from='client.56110 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:46:30.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:46:30 gibba015 bash[29377]: cluster 2021-03-10T14:46:29.408187+0000 mgr.gibba045.orlgmj (mgr.34412) 3081 : cluster [DBG] pgmap v1742: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:30.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:46:30 gibba015 bash[29377]: audit 2021-03-10T14:46:29.629477+0000 mgr.gibba045.orlgmj (mgr.34412) 3082 : audit [DBG] from='client.46128 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:46:30.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:46:30 gibba015 bash[29377]: audit 2021-03-10T14:46:29.892395+0000 mon.a (mon.0) 1028 : audit [DBG] from='client.? 172.21.2.115:0/3430010949' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:46:30.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:46:30 gibba015 bash[30343]: cephadm 2021-03-10T14:46:29.293243+0000 mgr.gibba045.orlgmj (mgr.34412) 3079 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:46:30.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:46:30 gibba015 bash[30343]: audit 2021-03-10T14:46:29.401396+0000 mgr.gibba045.orlgmj (mgr.34412) 3080 : audit [DBG] from='client.56110 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:46:30.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:46:30 gibba015 bash[30343]: cluster 2021-03-10T14:46:29.408187+0000 mgr.gibba045.orlgmj (mgr.34412) 3081 : cluster [DBG] pgmap v1742: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:30.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:46:30 gibba015 bash[30343]: audit 2021-03-10T14:46:29.629477+0000 mgr.gibba045.orlgmj (mgr.34412) 3082 : audit [DBG] from='client.46128 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:46:30.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:46:30 gibba015 bash[30343]: audit 2021-03-10T14:46:29.892395+0000 mon.a (mon.0) 1028 : audit [DBG] from='client.? 172.21.2.115:0/3430010949' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:46:32.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:46:32 gibba045 bash[25517]: cluster 2021-03-10T14:46:31.410342+0000 mgr.gibba045.orlgmj (mgr.34412) 3083 : cluster [DBG] pgmap v1743: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:32.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:46:32 gibba015 bash[29377]: cluster 2021-03-10T14:46:31.410342+0000 mgr.gibba045.orlgmj (mgr.34412) 3083 : cluster [DBG] pgmap v1743: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:32.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:46:32 gibba015 bash[30343]: cluster 2021-03-10T14:46:31.410342+0000 mgr.gibba045.orlgmj (mgr.34412) 3083 : cluster [DBG] pgmap v1743: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:34.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:46:34 gibba015 bash[29377]: cluster 2021-03-10T14:46:33.411844+0000 mgr.gibba045.orlgmj (mgr.34412) 3084 : cluster [DBG] pgmap v1744: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:34.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:46:34 gibba015 bash[30343]: cluster 2021-03-10T14:46:33.411844+0000 mgr.gibba045.orlgmj (mgr.34412) 3084 : cluster [DBG] pgmap v1744: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:34.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:46:34 gibba045 bash[25517]: cluster 2021-03-10T14:46:33.411844+0000 mgr.gibba045.orlgmj (mgr.34412) 3084 : cluster [DBG] pgmap v1744: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:36.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:46:36 gibba045 bash[25517]: cluster 2021-03-10T14:46:35.413420+0000 mgr.gibba045.orlgmj (mgr.34412) 3085 : cluster [DBG] pgmap v1745: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:36.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:46:36 gibba015 bash[29377]: cluster 2021-03-10T14:46:35.413420+0000 mgr.gibba045.orlgmj (mgr.34412) 3085 : cluster [DBG] pgmap v1745: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:36.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:46:36 gibba015 bash[30343]: cluster 2021-03-10T14:46:35.413420+0000 mgr.gibba045.orlgmj (mgr.34412) 3085 : cluster [DBG] pgmap v1745: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:38.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:46:38 gibba045 bash[25517]: cluster 2021-03-10T14:46:37.415191+0000 mgr.gibba045.orlgmj (mgr.34412) 3086 : cluster [DBG] pgmap v1746: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:38.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:46:38 gibba015 bash[29377]: cluster 2021-03-10T14:46:37.415191+0000 mgr.gibba045.orlgmj (mgr.34412) 3086 : cluster [DBG] pgmap v1746: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:38.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:46:38 gibba015 bash[30343]: cluster 2021-03-10T14:46:37.415191+0000 mgr.gibba045.orlgmj (mgr.34412) 3086 : cluster [DBG] pgmap v1746: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:40.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:46:40 gibba045 bash[25517]: cluster 2021-03-10T14:46:39.416390+0000 mgr.gibba045.orlgmj (mgr.34412) 3087 : cluster [DBG] pgmap v1747: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:40.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:46:40 gibba015 bash[29377]: cluster 2021-03-10T14:46:39.416390+0000 mgr.gibba045.orlgmj (mgr.34412) 3087 : cluster [DBG] pgmap v1747: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:40.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:46:40 gibba015 bash[30343]: cluster 2021-03-10T14:46:39.416390+0000 mgr.gibba045.orlgmj (mgr.34412) 3087 : cluster [DBG] pgmap v1747: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:42.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:46:42 gibba045 bash[25517]: cluster 2021-03-10T14:46:41.418223+0000 mgr.gibba045.orlgmj (mgr.34412) 3088 : cluster [DBG] pgmap v1748: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:42.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:46:42 gibba015 bash[29377]: cluster 2021-03-10T14:46:41.418223+0000 mgr.gibba045.orlgmj (mgr.34412) 3088 : cluster [DBG] pgmap v1748: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:42.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:46:42 gibba015 bash[30343]: cluster 2021-03-10T14:46:41.418223+0000 mgr.gibba045.orlgmj (mgr.34412) 3088 : cluster [DBG] pgmap v1748: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:44.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:46:44 gibba015 bash[29377]: cluster 2021-03-10T14:46:43.419520+0000 mgr.gibba045.orlgmj (mgr.34412) 3089 : cluster [DBG] pgmap v1749: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:44.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:46:44 gibba015 bash[30343]: cluster 2021-03-10T14:46:43.419520+0000 mgr.gibba045.orlgmj (mgr.34412) 3089 : cluster [DBG] pgmap v1749: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:44.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:46:44 gibba045 bash[25517]: cluster 2021-03-10T14:46:43.419520+0000 mgr.gibba045.orlgmj (mgr.34412) 3089 : cluster [DBG] pgmap v1749: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:45.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:46:45 gibba015 bash[29377]: cephadm 2021-03-10T14:46:44.299775+0000 mgr.gibba045.orlgmj (mgr.34412) 3090 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:46:45.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:46:45 gibba015 bash[30343]: cephadm 2021-03-10T14:46:44.299775+0000 mgr.gibba045.orlgmj (mgr.34412) 3090 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:46:45.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:46:45 gibba045 bash[25517]: cephadm 2021-03-10T14:46:44.299775+0000 mgr.gibba045.orlgmj (mgr.34412) 3090 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:46:46.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:46:46 gibba015 bash[29377]: cluster 2021-03-10T14:46:45.421212+0000 mgr.gibba045.orlgmj (mgr.34412) 3091 : cluster [DBG] pgmap v1750: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:46.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:46:46 gibba015 bash[30343]: cluster 2021-03-10T14:46:45.421212+0000 mgr.gibba045.orlgmj (mgr.34412) 3091 : cluster [DBG] pgmap v1750: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:46.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:46:46 gibba045 bash[25517]: cluster 2021-03-10T14:46:45.421212+0000 mgr.gibba045.orlgmj (mgr.34412) 3091 : cluster [DBG] pgmap v1750: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:48.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:46:48 gibba045 bash[25517]: cluster 2021-03-10T14:46:47.423008+0000 mgr.gibba045.orlgmj (mgr.34412) 3092 : cluster [DBG] pgmap v1751: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:48.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:46:48 gibba015 bash[29377]: cluster 2021-03-10T14:46:47.423008+0000 mgr.gibba045.orlgmj (mgr.34412) 3092 : cluster [DBG] pgmap v1751: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:48.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:46:48 gibba015 bash[30343]: cluster 2021-03-10T14:46:47.423008+0000 mgr.gibba045.orlgmj (mgr.34412) 3092 : cluster [DBG] pgmap v1751: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:50.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:46:50 gibba045 bash[25517]: cluster 2021-03-10T14:46:49.424187+0000 mgr.gibba045.orlgmj (mgr.34412) 3093 : cluster [DBG] pgmap v1752: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:50.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:46:50 gibba015 bash[29377]: cluster 2021-03-10T14:46:49.424187+0000 mgr.gibba045.orlgmj (mgr.34412) 3093 : cluster [DBG] pgmap v1752: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:50.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:46:50 gibba015 bash[30343]: cluster 2021-03-10T14:46:49.424187+0000 mgr.gibba045.orlgmj (mgr.34412) 3093 : cluster [DBG] pgmap v1752: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:52.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:46:52 gibba045 bash[25517]: cluster 2021-03-10T14:46:51.426155+0000 mgr.gibba045.orlgmj (mgr.34412) 3094 : cluster [DBG] pgmap v1753: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:52.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:46:52 gibba015 bash[29377]: cluster 2021-03-10T14:46:51.426155+0000 mgr.gibba045.orlgmj (mgr.34412) 3094 : cluster [DBG] pgmap v1753: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:52.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:46:52 gibba015 bash[30343]: cluster 2021-03-10T14:46:51.426155+0000 mgr.gibba045.orlgmj (mgr.34412) 3094 : cluster [DBG] pgmap v1753: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:46:53 gibba045 bash[25517]: audit 2021-03-10T14:46:52.840546+0000 mon.c (mon.1) 900 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:46:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:46:53 gibba045 bash[25517]: audit 2021-03-10T14:46:52.841425+0000 mon.c (mon.1) 901 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:46:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:46:53 gibba045 bash[25517]: audit 2021-03-10T14:46:52.841674+0000 mon.a (mon.0) 1029 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:46:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:46:53 gibba045 bash[25517]: audit 2021-03-10T14:46:52.842150+0000 mon.c (mon.1) 902 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T14:46:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:46:53 gibba045 bash[25517]: audit 2021-03-10T14:46:52.842790+0000 mon.a (mon.0) 1030 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:46:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:46:53 gibba045 bash[25517]: audit 2021-03-10T14:46:52.842989+0000 mon.c (mon.1) 903 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:46:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:46:53 gibba045 bash[25517]: audit 2021-03-10T14:46:52.843710+0000 mon.a (mon.0) 1031 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T14:46:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:46:53 gibba045 bash[25517]: audit 2021-03-10T14:46:52.843777+0000 mon.c (mon.1) 904 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T14:46:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:46:53 gibba045 bash[25517]: audit 2021-03-10T14:46:52.844458+0000 mon.c (mon.1) 905 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:46:53.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:46:53 gibba045 bash[25517]: audit 2021-03-10T14:46:52.844739+0000 mon.a (mon.0) 1032 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:46:53.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:46:53 gibba045 bash[25517]: audit 2021-03-10T14:46:52.845928+0000 mon.a (mon.0) 1033 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T14:46:53.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:46:53 gibba045 bash[25517]: audit 2021-03-10T14:46:52.846738+0000 mon.a (mon.0) 1034 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:46:53.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:46:53 gibba015 bash[29377]: audit 2021-03-10T14:46:52.840546+0000 mon.c (mon.1) 900 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:46:53.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:46:53 gibba015 bash[29377]: audit 2021-03-10T14:46:52.841425+0000 mon.c (mon.1) 901 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:46:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:46:53 gibba015 bash[29377]: audit 2021-03-10T14:46:52.841674+0000 mon.a (mon.0) 1029 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:46:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:46:53 gibba015 bash[29377]: audit 2021-03-10T14:46:52.842150+0000 mon.c (mon.1) 902 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T14:46:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:46:53 gibba015 bash[29377]: audit 2021-03-10T14:46:52.842790+0000 mon.a (mon.0) 1030 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:46:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:46:53 gibba015 bash[29377]: audit 2021-03-10T14:46:52.842989+0000 mon.c (mon.1) 903 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:46:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:46:53 gibba015 bash[29377]: audit 2021-03-10T14:46:52.843710+0000 mon.a (mon.0) 1031 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T14:46:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:46:53 gibba015 bash[29377]: audit 2021-03-10T14:46:52.843777+0000 mon.c (mon.1) 904 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T14:46:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:46:53 gibba015 bash[29377]: audit 2021-03-10T14:46:52.844458+0000 mon.c (mon.1) 905 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:46:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:46:53 gibba015 bash[29377]: audit 2021-03-10T14:46:52.844739+0000 mon.a (mon.0) 1032 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:46:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:46:53 gibba015 bash[29377]: audit 2021-03-10T14:46:52.845928+0000 mon.a (mon.0) 1033 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T14:46:53.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:46:53 gibba015 bash[29377]: audit 2021-03-10T14:46:52.846738+0000 mon.a (mon.0) 1034 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:46:53.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:46:53 gibba015 bash[30343]: audit 2021-03-10T14:46:52.840546+0000 mon.c (mon.1) 900 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:46:53.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:46:53 gibba015 bash[30343]: audit 2021-03-10T14:46:52.841425+0000 mon.c (mon.1) 901 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:46:53.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:46:53 gibba015 bash[30343]: audit 2021-03-10T14:46:52.841674+0000 mon.a (mon.0) 1029 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:46:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:46:53 gibba015 bash[30343]: audit 2021-03-10T14:46:52.842150+0000 mon.c (mon.1) 902 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T14:46:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:46:53 gibba015 bash[30343]: audit 2021-03-10T14:46:52.842790+0000 mon.a (mon.0) 1030 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:46:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:46:53 gibba015 bash[30343]: audit 2021-03-10T14:46:52.842989+0000 mon.c (mon.1) 903 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:46:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:46:53 gibba015 bash[30343]: audit 2021-03-10T14:46:52.843710+0000 mon.a (mon.0) 1031 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T14:46:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:46:53 gibba015 bash[30343]: audit 2021-03-10T14:46:52.843777+0000 mon.c (mon.1) 904 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T14:46:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:46:53 gibba015 bash[30343]: audit 2021-03-10T14:46:52.844458+0000 mon.c (mon.1) 905 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:46:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:46:53 gibba015 bash[30343]: audit 2021-03-10T14:46:52.844739+0000 mon.a (mon.0) 1032 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:46:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:46:53 gibba015 bash[30343]: audit 2021-03-10T14:46:52.845928+0000 mon.a (mon.0) 1033 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T14:46:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:46:53 gibba015 bash[30343]: audit 2021-03-10T14:46:52.846738+0000 mon.a (mon.0) 1034 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:46:54.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:46:54 gibba045 bash[25517]: cluster 2021-03-10T14:46:53.427444+0000 mgr.gibba045.orlgmj (mgr.34412) 3095 : cluster [DBG] pgmap v1754: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:54.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:46:54 gibba015 bash[29377]: cluster 2021-03-10T14:46:53.427444+0000 mgr.gibba045.orlgmj (mgr.34412) 3095 : cluster [DBG] pgmap v1754: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:54.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:46:54 gibba015 bash[30343]: cluster 2021-03-10T14:46:53.427444+0000 mgr.gibba045.orlgmj (mgr.34412) 3095 : cluster [DBG] pgmap v1754: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:56.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:46:56 gibba045 bash[25517]: cluster 2021-03-10T14:46:55.429069+0000 mgr.gibba045.orlgmj (mgr.34412) 3096 : cluster [DBG] pgmap v1755: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:56.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:46:56 gibba015 bash[29377]: cluster 2021-03-10T14:46:55.429069+0000 mgr.gibba045.orlgmj (mgr.34412) 3096 : cluster [DBG] pgmap v1755: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:56.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:46:56 gibba015 bash[30343]: cluster 2021-03-10T14:46:55.429069+0000 mgr.gibba045.orlgmj (mgr.34412) 3096 : cluster [DBG] pgmap v1755: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:58.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:46:58 gibba045 bash[25517]: cluster 2021-03-10T14:46:57.431003+0000 mgr.gibba045.orlgmj (mgr.34412) 3097 : cluster [DBG] pgmap v1756: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:58.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:46:58 gibba015 bash[29377]: cluster 2021-03-10T14:46:57.431003+0000 mgr.gibba045.orlgmj (mgr.34412) 3097 : cluster [DBG] pgmap v1756: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:58.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:46:58 gibba015 bash[30343]: cluster 2021-03-10T14:46:57.431003+0000 mgr.gibba045.orlgmj (mgr.34412) 3097 : cluster [DBG] pgmap v1756: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:00.143 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:47:00.370 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:47:00.370 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (57m) 2m ago 63m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:47:00.371 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (62m) 111s ago 62m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:47:00.371 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (58m) 111s ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:47:00.371 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (58m) 111s ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:47:00.371 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (57m) 2m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:47:00.372 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (57m) 2m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:47:00.372 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (56m) 111s ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:47:00.372 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (56m) 2m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:47:00.372 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (63m) 2m ago 63m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:47:00.372 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (63m) 111s ago 63m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:47:00.373 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (56m) 2m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:47:00.373 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (55m) 2m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:47:00.373 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (55m) 2m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:47:00.373 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (54m) 2m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:47:00.373 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (54m) 111s ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:47:00.374 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (53m) 111s ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:47:00.374 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (53m) 111s ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:47:00.374 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (53m) 111s ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:47:00.374 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (62m) 111s ago 63m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:47:00.374 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 111s ago 61m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:47:00.620 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:47:00.620 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:47:00.621 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:47:00.621 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:47:00.621 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:47:00.621 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:47:00.621 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:47:00.622 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:47:00.622 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:47:00.622 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:47:00.622 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:47:00.623 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:47:00.623 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:47:00.623 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:47:00.623 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:47:00.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:47:00 gibba045 bash[25517]: cephadm 2021-03-10T14:46:59.313361+0000 mgr.gibba045.orlgmj (mgr.34412) 3098 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:47:00.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:47:00 gibba045 bash[25517]: cluster 2021-03-10T14:46:59.432532+0000 mgr.gibba045.orlgmj (mgr.34412) 3099 : cluster [DBG] pgmap v1757: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:00.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:47:00 gibba015 bash[29377]: cephadm 2021-03-10T14:46:59.313361+0000 mgr.gibba045.orlgmj (mgr.34412) 3098 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:47:00.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:47:00 gibba015 bash[29377]: cluster 2021-03-10T14:46:59.432532+0000 mgr.gibba045.orlgmj (mgr.34412) 3099 : cluster [DBG] pgmap v1757: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:00.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:47:00 gibba015 bash[30343]: cephadm 2021-03-10T14:46:59.313361+0000 mgr.gibba045.orlgmj (mgr.34412) 3098 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:47:00.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:47:00 gibba015 bash[30343]: cluster 2021-03-10T14:46:59.432532+0000 mgr.gibba045.orlgmj (mgr.34412) 3099 : cluster [DBG] pgmap v1757: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:01.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:47:01 gibba045 bash[25517]: audit 2021-03-10T14:47:00.134280+0000 mgr.gibba045.orlgmj (mgr.34412) 3100 : audit [DBG] from='client.46140 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:47:01.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:47:01 gibba045 bash[25517]: audit 2021-03-10T14:47:00.357638+0000 mgr.gibba045.orlgmj (mgr.34412) 3101 : audit [DBG] from='client.56134 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:47:01.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:47:01 gibba045 bash[25517]: audit 2021-03-10T14:47:00.616897+0000 mon.c (mon.1) 906 : audit [DBG] from='client.? 172.21.2.115:0/190116461' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:47:01.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:47:01 gibba015 bash[29377]: audit 2021-03-10T14:47:00.134280+0000 mgr.gibba045.orlgmj (mgr.34412) 3100 : audit [DBG] from='client.46140 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:47:01.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:47:01 gibba015 bash[29377]: audit 2021-03-10T14:47:00.357638+0000 mgr.gibba045.orlgmj (mgr.34412) 3101 : audit [DBG] from='client.56134 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:47:01.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:47:01 gibba015 bash[29377]: audit 2021-03-10T14:47:00.616897+0000 mon.c (mon.1) 906 : audit [DBG] from='client.? 172.21.2.115:0/190116461' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:47:01.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:47:01 gibba015 bash[30343]: audit 2021-03-10T14:47:00.134280+0000 mgr.gibba045.orlgmj (mgr.34412) 3100 : audit [DBG] from='client.46140 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:47:01.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:47:01 gibba015 bash[30343]: audit 2021-03-10T14:47:00.357638+0000 mgr.gibba045.orlgmj (mgr.34412) 3101 : audit [DBG] from='client.56134 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:47:01.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:47:01 gibba015 bash[30343]: audit 2021-03-10T14:47:00.616897+0000 mon.c (mon.1) 906 : audit [DBG] from='client.? 172.21.2.115:0/190116461' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:47:02.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:47:02 gibba015 bash[29377]: cluster 2021-03-10T14:47:01.434715+0000 mgr.gibba045.orlgmj (mgr.34412) 3102 : cluster [DBG] pgmap v1758: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:02.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:47:02 gibba015 bash[30343]: cluster 2021-03-10T14:47:01.434715+0000 mgr.gibba045.orlgmj (mgr.34412) 3102 : cluster [DBG] pgmap v1758: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:03.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:47:02 gibba045 bash[25517]: cluster 2021-03-10T14:47:01.434715+0000 mgr.gibba045.orlgmj (mgr.34412) 3102 : cluster [DBG] pgmap v1758: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:04.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:47:04 gibba015 bash[29377]: cluster 2021-03-10T14:47:03.436047+0000 mgr.gibba045.orlgmj (mgr.34412) 3103 : cluster [DBG] pgmap v1759: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:04.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:47:04 gibba015 bash[30343]: cluster 2021-03-10T14:47:03.436047+0000 mgr.gibba045.orlgmj (mgr.34412) 3103 : cluster [DBG] pgmap v1759: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:04.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:47:04 gibba045 bash[25517]: cluster 2021-03-10T14:47:03.436047+0000 mgr.gibba045.orlgmj (mgr.34412) 3103 : cluster [DBG] pgmap v1759: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:06.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:47:06 gibba045 bash[25517]: cluster 2021-03-10T14:47:05.437764+0000 mgr.gibba045.orlgmj (mgr.34412) 3104 : cluster [DBG] pgmap v1760: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:06.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:47:06 gibba015 bash[29377]: cluster 2021-03-10T14:47:05.437764+0000 mgr.gibba045.orlgmj (mgr.34412) 3104 : cluster [DBG] pgmap v1760: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:06.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:47:06 gibba015 bash[30343]: cluster 2021-03-10T14:47:05.437764+0000 mgr.gibba045.orlgmj (mgr.34412) 3104 : cluster [DBG] pgmap v1760: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:08.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:47:08 gibba045 bash[25517]: cluster 2021-03-10T14:47:07.439528+0000 mgr.gibba045.orlgmj (mgr.34412) 3105 : cluster [DBG] pgmap v1761: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:08.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:47:08 gibba015 bash[29377]: cluster 2021-03-10T14:47:07.439528+0000 mgr.gibba045.orlgmj (mgr.34412) 3105 : cluster [DBG] pgmap v1761: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:08.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:47:08 gibba015 bash[30343]: cluster 2021-03-10T14:47:07.439528+0000 mgr.gibba045.orlgmj (mgr.34412) 3105 : cluster [DBG] pgmap v1761: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:10.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:47:10 gibba045 bash[25517]: cluster 2021-03-10T14:47:09.440793+0000 mgr.gibba045.orlgmj (mgr.34412) 3106 : cluster [DBG] pgmap v1762: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:10.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:47:10 gibba015 bash[29377]: cluster 2021-03-10T14:47:09.440793+0000 mgr.gibba045.orlgmj (mgr.34412) 3106 : cluster [DBG] pgmap v1762: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:10.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:47:10 gibba015 bash[30343]: cluster 2021-03-10T14:47:09.440793+0000 mgr.gibba045.orlgmj (mgr.34412) 3106 : cluster [DBG] pgmap v1762: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:12.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:47:12 gibba045 bash[25517]: cluster 2021-03-10T14:47:11.442600+0000 mgr.gibba045.orlgmj (mgr.34412) 3107 : cluster [DBG] pgmap v1763: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:12.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:47:12 gibba015 bash[29377]: cluster 2021-03-10T14:47:11.442600+0000 mgr.gibba045.orlgmj (mgr.34412) 3107 : cluster [DBG] pgmap v1763: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:12.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:47:12 gibba015 bash[30343]: cluster 2021-03-10T14:47:11.442600+0000 mgr.gibba045.orlgmj (mgr.34412) 3107 : cluster [DBG] pgmap v1763: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:14.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:47:14 gibba015 bash[29377]: cluster 2021-03-10T14:47:13.443806+0000 mgr.gibba045.orlgmj (mgr.34412) 3108 : cluster [DBG] pgmap v1764: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:14.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:47:14 gibba015 bash[30343]: cluster 2021-03-10T14:47:13.443806+0000 mgr.gibba045.orlgmj (mgr.34412) 3108 : cluster [DBG] pgmap v1764: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:14.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:47:14 gibba045 bash[25517]: cluster 2021-03-10T14:47:13.443806+0000 mgr.gibba045.orlgmj (mgr.34412) 3108 : cluster [DBG] pgmap v1764: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:15.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:47:15 gibba015 bash[29377]: audit 2021-03-10T14:47:14.323103+0000 mon.c (mon.1) 907 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:47:15.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:47:15 gibba015 bash[29377]: cephadm 2021-03-10T14:47:14.332019+0000 mgr.gibba045.orlgmj (mgr.34412) 3109 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:47:15.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:47:15 gibba015 bash[29377]: cephadm 2021-03-10T14:47:14.333988+0000 mgr.gibba045.orlgmj (mgr.34412) 3110 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:47:15.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:47:15 gibba015 bash[29377]: audit 2021-03-10T14:47:14.559936+0000 mon.a (mon.0) 1035 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:47:15.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:47:15 gibba015 bash[29377]: audit 2021-03-10T14:47:14.563421+0000 mon.c (mon.1) 908 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:47:15.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:47:15 gibba015 bash[29377]: audit 2021-03-10T14:47:14.565192+0000 mon.c (mon.1) 909 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:47:15.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:47:15 gibba015 bash[29377]: cephadm 2021-03-10T14:47:14.565919+0000 mgr.gibba045.orlgmj (mgr.34412) 3111 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:47:15.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:47:15 gibba015 bash[29377]: audit 2021-03-10T14:47:14.566833+0000 mon.c (mon.1) 910 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:47:15.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:47:15 gibba015 bash[29377]: cephadm 2021-03-10T14:47:14.567805+0000 mgr.gibba045.orlgmj (mgr.34412) 3112 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:47:15.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:47:15 gibba015 bash[29377]: audit 2021-03-10T14:47:14.568938+0000 mon.c (mon.1) 911 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:47:15.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:47:15 gibba015 bash[29377]: cephadm 2021-03-10T14:47:14.569374+0000 mgr.gibba045.orlgmj (mgr.34412) 3113 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:47:15.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:47:15 gibba015 bash[29377]: cephadm 2021-03-10T14:47:14.569413+0000 mgr.gibba045.orlgmj (mgr.34412) 3114 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:47:15.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:47:15 gibba015 bash[29377]: cephadm 2021-03-10T14:47:14.571479+0000 mgr.gibba045.orlgmj (mgr.34412) 3115 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:47:15.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:47:15 gibba015 bash[29377]: cephadm 2021-03-10T14:47:14.571518+0000 mgr.gibba045.orlgmj (mgr.34412) 3116 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:47:15.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:47:15 gibba015 bash[29377]: cephadm 2021-03-10T14:47:14.573964+0000 mgr.gibba045.orlgmj (mgr.34412) 3117 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:47:15.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:47:15 gibba015 bash[29377]: audit 2021-03-10T14:47:14.575220+0000 mon.c (mon.1) 912 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:47:15.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:47:15 gibba015 bash[29377]: cephadm 2021-03-10T14:47:14.577563+0000 mgr.gibba045.orlgmj (mgr.34412) 3118 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:47:15.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:47:15 gibba015 bash[29377]: cephadm 2021-03-10T14:47:14.577606+0000 mgr.gibba045.orlgmj (mgr.34412) 3119 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:47:15.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:47:15 gibba015 bash[29377]: audit 2021-03-10T14:47:14.577883+0000 mon.c (mon.1) 913 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:47:15.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:47:15 gibba015 bash[29377]: cephadm 2021-03-10T14:47:14.580054+0000 mgr.gibba045.orlgmj (mgr.34412) 3120 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:47:15.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:47:15 gibba015 bash[30343]: audit 2021-03-10T14:47:14.323103+0000 mon.c (mon.1) 907 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:47:15.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:47:15 gibba015 bash[30343]: cephadm 2021-03-10T14:47:14.332019+0000 mgr.gibba045.orlgmj (mgr.34412) 3109 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:47:15.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:47:15 gibba015 bash[30343]: cephadm 2021-03-10T14:47:14.333988+0000 mgr.gibba045.orlgmj (mgr.34412) 3110 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:47:15.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:47:15 gibba015 bash[30343]: audit 2021-03-10T14:47:14.559936+0000 mon.a (mon.0) 1035 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:47:15.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:47:15 gibba015 bash[30343]: audit 2021-03-10T14:47:14.563421+0000 mon.c (mon.1) 908 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:47:15.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:47:15 gibba015 bash[30343]: audit 2021-03-10T14:47:14.565192+0000 mon.c (mon.1) 909 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:47:15.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:47:15 gibba015 bash[30343]: cephadm 2021-03-10T14:47:14.565919+0000 mgr.gibba045.orlgmj (mgr.34412) 3111 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:47:15.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:47:15 gibba015 bash[30343]: audit 2021-03-10T14:47:14.566833+0000 mon.c (mon.1) 910 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:47:15.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:47:15 gibba015 bash[30343]: cephadm 2021-03-10T14:47:14.567805+0000 mgr.gibba045.orlgmj (mgr.34412) 3112 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:47:15.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:47:15 gibba015 bash[30343]: audit 2021-03-10T14:47:14.568938+0000 mon.c (mon.1) 911 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:47:15.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:47:15 gibba015 bash[30343]: cephadm 2021-03-10T14:47:14.569374+0000 mgr.gibba045.orlgmj (mgr.34412) 3113 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:47:15.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:47:15 gibba015 bash[30343]: cephadm 2021-03-10T14:47:14.569413+0000 mgr.gibba045.orlgmj (mgr.34412) 3114 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:47:15.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:47:15 gibba015 bash[30343]: cephadm 2021-03-10T14:47:14.571479+0000 mgr.gibba045.orlgmj (mgr.34412) 3115 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:47:15.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:47:15 gibba015 bash[30343]: cephadm 2021-03-10T14:47:14.571518+0000 mgr.gibba045.orlgmj (mgr.34412) 3116 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:47:15.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:47:15 gibba015 bash[30343]: cephadm 2021-03-10T14:47:14.573964+0000 mgr.gibba045.orlgmj (mgr.34412) 3117 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:47:15.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:47:15 gibba015 bash[30343]: audit 2021-03-10T14:47:14.575220+0000 mon.c (mon.1) 912 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:47:15.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:47:15 gibba015 bash[30343]: cephadm 2021-03-10T14:47:14.577563+0000 mgr.gibba045.orlgmj (mgr.34412) 3118 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:47:15.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:47:15 gibba015 bash[30343]: cephadm 2021-03-10T14:47:14.577606+0000 mgr.gibba045.orlgmj (mgr.34412) 3119 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:47:15.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:47:15 gibba015 bash[30343]: audit 2021-03-10T14:47:14.577883+0000 mon.c (mon.1) 913 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:47:15.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:47:15 gibba015 bash[30343]: cephadm 2021-03-10T14:47:14.580054+0000 mgr.gibba045.orlgmj (mgr.34412) 3120 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:47:15.483 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:47:15 gibba015 bash[29377]: cephadm 2021-03-10T14:47:14.580437+0000 mgr.gibba045.orlgmj (mgr.34412) 3121 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:47:15.483 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:47:15 gibba015 bash[29377]: cephadm 2021-03-10T14:47:14.582842+0000 mgr.gibba045.orlgmj (mgr.34412) 3122 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:47:15.483 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:47:15 gibba015 bash[29377]: cephadm 2021-03-10T14:47:14.582890+0000 mgr.gibba045.orlgmj (mgr.34412) 3123 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:47:15.484 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:47:15 gibba015 bash[29377]: cephadm 2021-03-10T14:47:14.583020+0000 mgr.gibba045.orlgmj (mgr.34412) 3124 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:47:15.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:47:15 gibba015 bash[30343]: cephadm 2021-03-10T14:47:14.580437+0000 mgr.gibba045.orlgmj (mgr.34412) 3121 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:47:15.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:47:15 gibba015 bash[30343]: cephadm 2021-03-10T14:47:14.582842+0000 mgr.gibba045.orlgmj (mgr.34412) 3122 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:47:15.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:47:15 gibba015 bash[30343]: cephadm 2021-03-10T14:47:14.582890+0000 mgr.gibba045.orlgmj (mgr.34412) 3123 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:47:15.485 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:47:15 gibba015 bash[30343]: cephadm 2021-03-10T14:47:14.583020+0000 mgr.gibba045.orlgmj (mgr.34412) 3124 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:47:15.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:47:15 gibba045 bash[25517]: audit 2021-03-10T14:47:14.323103+0000 mon.c (mon.1) 907 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:47:15.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:47:15 gibba045 bash[25517]: cephadm 2021-03-10T14:47:14.332019+0000 mgr.gibba045.orlgmj (mgr.34412) 3109 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:47:15.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:47:15 gibba045 bash[25517]: cephadm 2021-03-10T14:47:14.333988+0000 mgr.gibba045.orlgmj (mgr.34412) 3110 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:47:15.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:47:15 gibba045 bash[25517]: audit 2021-03-10T14:47:14.559936+0000 mon.a (mon.0) 1035 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:47:15.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:47:15 gibba045 bash[25517]: audit 2021-03-10T14:47:14.563421+0000 mon.c (mon.1) 908 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:47:15.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:47:15 gibba045 bash[25517]: audit 2021-03-10T14:47:14.565192+0000 mon.c (mon.1) 909 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:47:15.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:47:15 gibba045 bash[25517]: cephadm 2021-03-10T14:47:14.565919+0000 mgr.gibba045.orlgmj (mgr.34412) 3111 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:47:15.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:47:15 gibba045 bash[25517]: audit 2021-03-10T14:47:14.566833+0000 mon.c (mon.1) 910 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:47:15.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:47:15 gibba045 bash[25517]: cephadm 2021-03-10T14:47:14.567805+0000 mgr.gibba045.orlgmj (mgr.34412) 3112 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:47:15.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:47:15 gibba045 bash[25517]: audit 2021-03-10T14:47:14.568938+0000 mon.c (mon.1) 911 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:47:15.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:47:15 gibba045 bash[25517]: cephadm 2021-03-10T14:47:14.569374+0000 mgr.gibba045.orlgmj (mgr.34412) 3113 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:47:15.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:47:15 gibba045 bash[25517]: cephadm 2021-03-10T14:47:14.569413+0000 mgr.gibba045.orlgmj (mgr.34412) 3114 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:47:15.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:47:15 gibba045 bash[25517]: cephadm 2021-03-10T14:47:14.571479+0000 mgr.gibba045.orlgmj (mgr.34412) 3115 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:47:15.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:47:15 gibba045 bash[25517]: cephadm 2021-03-10T14:47:14.571518+0000 mgr.gibba045.orlgmj (mgr.34412) 3116 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:47:15.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:47:15 gibba045 bash[25517]: cephadm 2021-03-10T14:47:14.573964+0000 mgr.gibba045.orlgmj (mgr.34412) 3117 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:47:15.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:47:15 gibba045 bash[25517]: audit 2021-03-10T14:47:14.575220+0000 mon.c (mon.1) 912 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:47:15.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:47:15 gibba045 bash[25517]: cephadm 2021-03-10T14:47:14.577563+0000 mgr.gibba045.orlgmj (mgr.34412) 3118 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:47:15.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:47:15 gibba045 bash[25517]: cephadm 2021-03-10T14:47:14.577606+0000 mgr.gibba045.orlgmj (mgr.34412) 3119 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:47:15.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:47:15 gibba045 bash[25517]: audit 2021-03-10T14:47:14.577883+0000 mon.c (mon.1) 913 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:47:15.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:47:15 gibba045 bash[25517]: cephadm 2021-03-10T14:47:14.580054+0000 mgr.gibba045.orlgmj (mgr.34412) 3120 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:47:15.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:47:15 gibba045 bash[25517]: cephadm 2021-03-10T14:47:14.580437+0000 mgr.gibba045.orlgmj (mgr.34412) 3121 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:47:15.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:47:15 gibba045 bash[25517]: cephadm 2021-03-10T14:47:14.582842+0000 mgr.gibba045.orlgmj (mgr.34412) 3122 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:47:15.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:47:15 gibba045 bash[25517]: cephadm 2021-03-10T14:47:14.582890+0000 mgr.gibba045.orlgmj (mgr.34412) 3123 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:47:15.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:47:15 gibba045 bash[25517]: cephadm 2021-03-10T14:47:14.583020+0000 mgr.gibba045.orlgmj (mgr.34412) 3124 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:47:16.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:47:16 gibba015 bash[29377]: cluster 2021-03-10T14:47:15.445377+0000 mgr.gibba045.orlgmj (mgr.34412) 3125 : cluster [DBG] pgmap v1765: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:16.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:47:16 gibba015 bash[30343]: cluster 2021-03-10T14:47:15.445377+0000 mgr.gibba045.orlgmj (mgr.34412) 3125 : cluster [DBG] pgmap v1765: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:16.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:47:16 gibba045 bash[25517]: cluster 2021-03-10T14:47:15.445377+0000 mgr.gibba045.orlgmj (mgr.34412) 3125 : cluster [DBG] pgmap v1765: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:18.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:47:18 gibba045 bash[25517]: cluster 2021-03-10T14:47:17.446843+0000 mgr.gibba045.orlgmj (mgr.34412) 3126 : cluster [DBG] pgmap v1766: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:18.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:47:18 gibba015 bash[29377]: cluster 2021-03-10T14:47:17.446843+0000 mgr.gibba045.orlgmj (mgr.34412) 3126 : cluster [DBG] pgmap v1766: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:18.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:47:18 gibba015 bash[30343]: cluster 2021-03-10T14:47:17.446843+0000 mgr.gibba045.orlgmj (mgr.34412) 3126 : cluster [DBG] pgmap v1766: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:20.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:47:20 gibba045 bash[25517]: cluster 2021-03-10T14:47:19.448063+0000 mgr.gibba045.orlgmj (mgr.34412) 3127 : cluster [DBG] pgmap v1767: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:20.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:47:20 gibba015 bash[29377]: cluster 2021-03-10T14:47:19.448063+0000 mgr.gibba045.orlgmj (mgr.34412) 3127 : cluster [DBG] pgmap v1767: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:20.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:47:20 gibba015 bash[30343]: cluster 2021-03-10T14:47:19.448063+0000 mgr.gibba045.orlgmj (mgr.34412) 3127 : cluster [DBG] pgmap v1767: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:22.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:47:22 gibba045 bash[25517]: cluster 2021-03-10T14:47:21.449827+0000 mgr.gibba045.orlgmj (mgr.34412) 3128 : cluster [DBG] pgmap v1768: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:22.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:47:22 gibba015 bash[29377]: cluster 2021-03-10T14:47:21.449827+0000 mgr.gibba045.orlgmj (mgr.34412) 3128 : cluster [DBG] pgmap v1768: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:22.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:47:22 gibba015 bash[30343]: cluster 2021-03-10T14:47:21.449827+0000 mgr.gibba045.orlgmj (mgr.34412) 3128 : cluster [DBG] pgmap v1768: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:24.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:47:24 gibba015 bash[29377]: cluster 2021-03-10T14:47:23.450971+0000 mgr.gibba045.orlgmj (mgr.34412) 3129 : cluster [DBG] pgmap v1769: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:24.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:47:24 gibba015 bash[30343]: cluster 2021-03-10T14:47:23.450971+0000 mgr.gibba045.orlgmj (mgr.34412) 3129 : cluster [DBG] pgmap v1769: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:24.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:47:24 gibba045 bash[25517]: cluster 2021-03-10T14:47:23.450971+0000 mgr.gibba045.orlgmj (mgr.34412) 3129 : cluster [DBG] pgmap v1769: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:26.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:47:26 gibba045 bash[25517]: cluster 2021-03-10T14:47:25.452540+0000 mgr.gibba045.orlgmj (mgr.34412) 3130 : cluster [DBG] pgmap v1770: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:26.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:47:26 gibba015 bash[29377]: cluster 2021-03-10T14:47:25.452540+0000 mgr.gibba045.orlgmj (mgr.34412) 3130 : cluster [DBG] pgmap v1770: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:26.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:47:26 gibba015 bash[30343]: cluster 2021-03-10T14:47:25.452540+0000 mgr.gibba045.orlgmj (mgr.34412) 3130 : cluster [DBG] pgmap v1770: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:28.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:47:28 gibba045 bash[25517]: cluster 2021-03-10T14:47:27.453988+0000 mgr.gibba045.orlgmj (mgr.34412) 3131 : cluster [DBG] pgmap v1771: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:28.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:47:28 gibba015 bash[29377]: cluster 2021-03-10T14:47:27.453988+0000 mgr.gibba045.orlgmj (mgr.34412) 3131 : cluster [DBG] pgmap v1771: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:28.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:47:28 gibba015 bash[30343]: cluster 2021-03-10T14:47:27.453988+0000 mgr.gibba045.orlgmj (mgr.34412) 3131 : cluster [DBG] pgmap v1771: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:30.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:47:30 gibba045 bash[25517]: cluster 2021-03-10T14:47:29.455236+0000 mgr.gibba045.orlgmj (mgr.34412) 3132 : cluster [DBG] pgmap v1772: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:30.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:47:30 gibba045 bash[25517]: cephadm 2021-03-10T14:47:29.596767+0000 mgr.gibba045.orlgmj (mgr.34412) 3133 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:47:30.862 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:47:30.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:47:30 gibba015 bash[29377]: cluster 2021-03-10T14:47:29.455236+0000 mgr.gibba045.orlgmj (mgr.34412) 3132 : cluster [DBG] pgmap v1772: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:30.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:47:30 gibba015 bash[29377]: cephadm 2021-03-10T14:47:29.596767+0000 mgr.gibba045.orlgmj (mgr.34412) 3133 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:47:30.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:47:30 gibba015 bash[30343]: cluster 2021-03-10T14:47:29.455236+0000 mgr.gibba045.orlgmj (mgr.34412) 3132 : cluster [DBG] pgmap v1772: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:30.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:47:30 gibba015 bash[30343]: cephadm 2021-03-10T14:47:29.596767+0000 mgr.gibba045.orlgmj (mgr.34412) 3133 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:47:31.091 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:47:31.091 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (58m) 3m ago 63m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:47:31.091 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (63m) 2m ago 63m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:47:31.092 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (58m) 2m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:47:31.092 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (58m) 2m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:47:31.092 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (57m) 3m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:47:31.092 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (57m) 3m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:47:31.093 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (57m) 2m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:47:31.093 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (57m) 3m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:47:31.093 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (63m) 3m ago 63m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:47:31.093 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (63m) 2m ago 63m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:47:31.094 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (56m) 3m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:47:31.094 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (56m) 3m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:47:31.094 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (55m) 3m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:47:31.094 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (55m) 3m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:47:31.095 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (54m) 2m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:47:31.095 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (54m) 2m ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:47:31.095 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (53m) 2m ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:47:31.095 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (53m) 2m ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:47:31.096 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (63m) 2m ago 63m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:47:31.096 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 2m ago 61m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:47:31.340 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:47:31.340 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:47:31.341 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:47:31.341 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:47:31.341 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:47:31.341 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:47:31.342 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:47:31.342 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:47:31.342 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:47:31.342 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:47:31.342 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:47:31.343 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:47:31.343 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:47:31.343 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:47:31.343 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:47:31.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:47:31 gibba045 bash[25517]: audit 2021-03-10T14:47:30.853601+0000 mgr.gibba045.orlgmj (mgr.34412) 3134 : audit [DBG] from='client.46158 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:47:31.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:47:31 gibba045 bash[25517]: audit 2021-03-10T14:47:31.336693+0000 mon.c (mon.1) 914 : audit [DBG] from='client.? 172.21.2.115:0/3948974540' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:47:31.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:47:31 gibba015 bash[29377]: audit 2021-03-10T14:47:30.853601+0000 mgr.gibba045.orlgmj (mgr.34412) 3134 : audit [DBG] from='client.46158 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:47:31.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:47:31 gibba015 bash[29377]: audit 2021-03-10T14:47:31.336693+0000 mon.c (mon.1) 914 : audit [DBG] from='client.? 172.21.2.115:0/3948974540' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:47:31.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:47:31 gibba015 bash[30343]: audit 2021-03-10T14:47:30.853601+0000 mgr.gibba045.orlgmj (mgr.34412) 3134 : audit [DBG] from='client.46158 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:47:31.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:47:31 gibba015 bash[30343]: audit 2021-03-10T14:47:31.336693+0000 mon.c (mon.1) 914 : audit [DBG] from='client.? 172.21.2.115:0/3948974540' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:47:32.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:47:32 gibba045 bash[25517]: audit 2021-03-10T14:47:31.078491+0000 mgr.gibba045.orlgmj (mgr.34412) 3135 : audit [DBG] from='client.46164 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:47:32.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:47:32 gibba045 bash[25517]: cluster 2021-03-10T14:47:31.457151+0000 mgr.gibba045.orlgmj (mgr.34412) 3136 : cluster [DBG] pgmap v1773: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:32.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:47:32 gibba015 bash[29377]: audit 2021-03-10T14:47:31.078491+0000 mgr.gibba045.orlgmj (mgr.34412) 3135 : audit [DBG] from='client.46164 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:47:32.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:47:32 gibba015 bash[29377]: cluster 2021-03-10T14:47:31.457151+0000 mgr.gibba045.orlgmj (mgr.34412) 3136 : cluster [DBG] pgmap v1773: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:32.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:47:32 gibba015 bash[30343]: audit 2021-03-10T14:47:31.078491+0000 mgr.gibba045.orlgmj (mgr.34412) 3135 : audit [DBG] from='client.46164 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:47:32.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:47:32 gibba015 bash[30343]: cluster 2021-03-10T14:47:31.457151+0000 mgr.gibba045.orlgmj (mgr.34412) 3136 : cluster [DBG] pgmap v1773: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:34.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:47:34 gibba015 bash[29377]: cluster 2021-03-10T14:47:33.458330+0000 mgr.gibba045.orlgmj (mgr.34412) 3137 : cluster [DBG] pgmap v1774: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:34.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:47:34 gibba015 bash[30343]: cluster 2021-03-10T14:47:33.458330+0000 mgr.gibba045.orlgmj (mgr.34412) 3137 : cluster [DBG] pgmap v1774: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:34.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:47:34 gibba045 bash[25517]: cluster 2021-03-10T14:47:33.458330+0000 mgr.gibba045.orlgmj (mgr.34412) 3137 : cluster [DBG] pgmap v1774: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:36.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:47:36 gibba045 bash[25517]: cluster 2021-03-10T14:47:35.459844+0000 mgr.gibba045.orlgmj (mgr.34412) 3138 : cluster [DBG] pgmap v1775: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:36.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:47:36 gibba015 bash[29377]: cluster 2021-03-10T14:47:35.459844+0000 mgr.gibba045.orlgmj (mgr.34412) 3138 : cluster [DBG] pgmap v1775: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:36.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:47:36 gibba015 bash[30343]: cluster 2021-03-10T14:47:35.459844+0000 mgr.gibba045.orlgmj (mgr.34412) 3138 : cluster [DBG] pgmap v1775: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:38.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:47:38 gibba045 bash[25517]: cluster 2021-03-10T14:47:37.461305+0000 mgr.gibba045.orlgmj (mgr.34412) 3139 : cluster [DBG] pgmap v1776: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:38.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:47:38 gibba015 bash[29377]: cluster 2021-03-10T14:47:37.461305+0000 mgr.gibba045.orlgmj (mgr.34412) 3139 : cluster [DBG] pgmap v1776: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:38.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:47:38 gibba015 bash[30343]: cluster 2021-03-10T14:47:37.461305+0000 mgr.gibba045.orlgmj (mgr.34412) 3139 : cluster [DBG] pgmap v1776: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:40.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:47:40 gibba045 bash[25517]: cluster 2021-03-10T14:47:39.462848+0000 mgr.gibba045.orlgmj (mgr.34412) 3140 : cluster [DBG] pgmap v1777: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:40.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:47:40 gibba015 bash[29377]: cluster 2021-03-10T14:47:39.462848+0000 mgr.gibba045.orlgmj (mgr.34412) 3140 : cluster [DBG] pgmap v1777: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:40.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:47:40 gibba015 bash[30343]: cluster 2021-03-10T14:47:39.462848+0000 mgr.gibba045.orlgmj (mgr.34412) 3140 : cluster [DBG] pgmap v1777: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:42.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:47:42 gibba045 bash[25517]: cluster 2021-03-10T14:47:41.464933+0000 mgr.gibba045.orlgmj (mgr.34412) 3141 : cluster [DBG] pgmap v1778: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:42.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:47:42 gibba015 bash[29377]: cluster 2021-03-10T14:47:41.464933+0000 mgr.gibba045.orlgmj (mgr.34412) 3141 : cluster [DBG] pgmap v1778: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:42.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:47:42 gibba015 bash[30343]: cluster 2021-03-10T14:47:41.464933+0000 mgr.gibba045.orlgmj (mgr.34412) 3141 : cluster [DBG] pgmap v1778: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:44.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:47:44 gibba015 bash[29377]: cluster 2021-03-10T14:47:43.465965+0000 mgr.gibba045.orlgmj (mgr.34412) 3142 : cluster [DBG] pgmap v1779: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:44.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:47:44 gibba015 bash[30343]: cluster 2021-03-10T14:47:43.465965+0000 mgr.gibba045.orlgmj (mgr.34412) 3142 : cluster [DBG] pgmap v1779: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:44.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:47:44 gibba045 bash[25517]: cluster 2021-03-10T14:47:43.465965+0000 mgr.gibba045.orlgmj (mgr.34412) 3142 : cluster [DBG] pgmap v1779: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:45.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:47:45 gibba015 bash[29377]: cephadm 2021-03-10T14:47:44.609386+0000 mgr.gibba045.orlgmj (mgr.34412) 3143 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:47:45.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:47:45 gibba015 bash[30343]: cephadm 2021-03-10T14:47:44.609386+0000 mgr.gibba045.orlgmj (mgr.34412) 3143 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:47:45.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:47:45 gibba045 bash[25517]: cephadm 2021-03-10T14:47:44.609386+0000 mgr.gibba045.orlgmj (mgr.34412) 3143 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:47:46.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:47:46 gibba015 bash[29377]: cluster 2021-03-10T14:47:45.467648+0000 mgr.gibba045.orlgmj (mgr.34412) 3144 : cluster [DBG] pgmap v1780: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:46.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:47:46 gibba015 bash[30343]: cluster 2021-03-10T14:47:45.467648+0000 mgr.gibba045.orlgmj (mgr.34412) 3144 : cluster [DBG] pgmap v1780: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:46.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:47:46 gibba045 bash[25517]: cluster 2021-03-10T14:47:45.467648+0000 mgr.gibba045.orlgmj (mgr.34412) 3144 : cluster [DBG] pgmap v1780: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:48.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:47:48 gibba045 bash[25517]: cluster 2021-03-10T14:47:47.469158+0000 mgr.gibba045.orlgmj (mgr.34412) 3145 : cluster [DBG] pgmap v1781: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:48.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:47:48 gibba015 bash[29377]: cluster 2021-03-10T14:47:47.469158+0000 mgr.gibba045.orlgmj (mgr.34412) 3145 : cluster [DBG] pgmap v1781: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:48.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:47:48 gibba015 bash[30343]: cluster 2021-03-10T14:47:47.469158+0000 mgr.gibba045.orlgmj (mgr.34412) 3145 : cluster [DBG] pgmap v1781: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:50.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:47:50 gibba045 bash[25517]: cluster 2021-03-10T14:47:49.470537+0000 mgr.gibba045.orlgmj (mgr.34412) 3146 : cluster [DBG] pgmap v1782: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:50.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:47:50 gibba015 bash[29377]: cluster 2021-03-10T14:47:49.470537+0000 mgr.gibba045.orlgmj (mgr.34412) 3146 : cluster [DBG] pgmap v1782: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:50.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:47:50 gibba015 bash[30343]: cluster 2021-03-10T14:47:49.470537+0000 mgr.gibba045.orlgmj (mgr.34412) 3146 : cluster [DBG] pgmap v1782: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:52.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:47:52 gibba045 bash[25517]: cluster 2021-03-10T14:47:51.472449+0000 mgr.gibba045.orlgmj (mgr.34412) 3147 : cluster [DBG] pgmap v1783: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:52.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:47:52 gibba015 bash[29377]: cluster 2021-03-10T14:47:51.472449+0000 mgr.gibba045.orlgmj (mgr.34412) 3147 : cluster [DBG] pgmap v1783: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:52.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:47:52 gibba015 bash[30343]: cluster 2021-03-10T14:47:51.472449+0000 mgr.gibba045.orlgmj (mgr.34412) 3147 : cluster [DBG] pgmap v1783: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:53.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:47:53 gibba015 bash[29377]: audit 2021-03-10T14:47:52.849917+0000 mon.c (mon.1) 915 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:47:53.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:47:53 gibba015 bash[29377]: audit 2021-03-10T14:47:52.850712+0000 mon.c (mon.1) 916 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:47:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:47:53 gibba015 bash[29377]: audit 2021-03-10T14:47:52.850994+0000 mon.a (mon.0) 1036 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:47:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:47:53 gibba015 bash[29377]: audit 2021-03-10T14:47:52.851585+0000 mon.c (mon.1) 917 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T14:47:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:47:53 gibba015 bash[29377]: audit 2021-03-10T14:47:52.852091+0000 mon.a (mon.0) 1037 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:47:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:47:53 gibba015 bash[29377]: audit 2021-03-10T14:47:52.852715+0000 mon.c (mon.1) 918 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:47:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:47:53 gibba015 bash[29377]: audit 2021-03-10T14:47:52.852818+0000 mon.a (mon.0) 1038 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T14:47:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:47:53 gibba015 bash[29377]: audit 2021-03-10T14:47:52.853890+0000 mon.a (mon.0) 1039 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:47:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:47:53 gibba015 bash[29377]: audit 2021-03-10T14:47:52.854092+0000 mon.c (mon.1) 919 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:47:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:47:53 gibba015 bash[29377]: audit 2021-03-10T14:47:52.855111+0000 mon.a (mon.0) 1040 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:47:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:47:53 gibba015 bash[29377]: audit 2021-03-10T14:47:52.855154+0000 mon.c (mon.1) 920 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:47:53.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:47:53 gibba015 bash[29377]: audit 2021-03-10T14:47:52.855670+0000 mon.a (mon.0) 1041 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:47:53.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:47:53 gibba015 bash[30343]: audit 2021-03-10T14:47:52.849917+0000 mon.c (mon.1) 915 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:47:53.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:47:53 gibba015 bash[30343]: audit 2021-03-10T14:47:52.850712+0000 mon.c (mon.1) 916 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:47:53.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:47:53 gibba015 bash[30343]: audit 2021-03-10T14:47:52.850994+0000 mon.a (mon.0) 1036 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:47:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:47:53 gibba015 bash[30343]: audit 2021-03-10T14:47:52.851585+0000 mon.c (mon.1) 917 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T14:47:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:47:53 gibba015 bash[30343]: audit 2021-03-10T14:47:52.852091+0000 mon.a (mon.0) 1037 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:47:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:47:53 gibba015 bash[30343]: audit 2021-03-10T14:47:52.852715+0000 mon.c (mon.1) 918 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:47:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:47:53 gibba015 bash[30343]: audit 2021-03-10T14:47:52.852818+0000 mon.a (mon.0) 1038 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T14:47:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:47:53 gibba015 bash[30343]: audit 2021-03-10T14:47:52.853890+0000 mon.a (mon.0) 1039 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:47:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:47:53 gibba015 bash[30343]: audit 2021-03-10T14:47:52.854092+0000 mon.c (mon.1) 919 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:47:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:47:53 gibba015 bash[30343]: audit 2021-03-10T14:47:52.855111+0000 mon.a (mon.0) 1040 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:47:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:47:53 gibba015 bash[30343]: audit 2021-03-10T14:47:52.855154+0000 mon.c (mon.1) 920 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:47:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:47:53 gibba015 bash[30343]: audit 2021-03-10T14:47:52.855670+0000 mon.a (mon.0) 1041 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:47:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:47:53 gibba045 bash[25517]: audit 2021-03-10T14:47:52.849917+0000 mon.c (mon.1) 915 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:47:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:47:53 gibba045 bash[25517]: audit 2021-03-10T14:47:52.850712+0000 mon.c (mon.1) 916 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:47:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:47:53 gibba045 bash[25517]: audit 2021-03-10T14:47:52.850994+0000 mon.a (mon.0) 1036 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:47:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:47:53 gibba045 bash[25517]: audit 2021-03-10T14:47:52.851585+0000 mon.c (mon.1) 917 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T14:47:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:47:53 gibba045 bash[25517]: audit 2021-03-10T14:47:52.852091+0000 mon.a (mon.0) 1037 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:47:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:47:53 gibba045 bash[25517]: audit 2021-03-10T14:47:52.852715+0000 mon.c (mon.1) 918 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:47:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:47:53 gibba045 bash[25517]: audit 2021-03-10T14:47:52.852818+0000 mon.a (mon.0) 1038 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T14:47:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:47:53 gibba045 bash[25517]: audit 2021-03-10T14:47:52.853890+0000 mon.a (mon.0) 1039 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:47:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:47:53 gibba045 bash[25517]: audit 2021-03-10T14:47:52.854092+0000 mon.c (mon.1) 919 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:47:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:47:53 gibba045 bash[25517]: audit 2021-03-10T14:47:52.855111+0000 mon.a (mon.0) 1040 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:47:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:47:53 gibba045 bash[25517]: audit 2021-03-10T14:47:52.855154+0000 mon.c (mon.1) 920 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:47:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:47:53 gibba045 bash[25517]: audit 2021-03-10T14:47:52.855670+0000 mon.a (mon.0) 1041 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:47:54.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:47:54 gibba015 bash[29377]: cluster 2021-03-10T14:47:53.473463+0000 mgr.gibba045.orlgmj (mgr.34412) 3148 : cluster [DBG] pgmap v1784: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:54.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:47:54 gibba015 bash[30343]: cluster 2021-03-10T14:47:53.473463+0000 mgr.gibba045.orlgmj (mgr.34412) 3148 : cluster [DBG] pgmap v1784: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:55.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:47:54 gibba045 bash[25517]: cluster 2021-03-10T14:47:53.473463+0000 mgr.gibba045.orlgmj (mgr.34412) 3148 : cluster [DBG] pgmap v1784: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:56.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:47:56 gibba015 bash[29377]: cluster 2021-03-10T14:47:55.474891+0000 mgr.gibba045.orlgmj (mgr.34412) 3149 : cluster [DBG] pgmap v1785: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:56.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:47:56 gibba015 bash[30343]: cluster 2021-03-10T14:47:55.474891+0000 mgr.gibba045.orlgmj (mgr.34412) 3149 : cluster [DBG] pgmap v1785: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:57.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:47:56 gibba045 bash[25517]: cluster 2021-03-10T14:47:55.474891+0000 mgr.gibba045.orlgmj (mgr.34412) 3149 : cluster [DBG] pgmap v1785: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:58.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:47:58 gibba015 bash[29377]: cluster 2021-03-10T14:47:57.476646+0000 mgr.gibba045.orlgmj (mgr.34412) 3150 : cluster [DBG] pgmap v1786: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:58.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:47:58 gibba015 bash[30343]: cluster 2021-03-10T14:47:57.476646+0000 mgr.gibba045.orlgmj (mgr.34412) 3150 : cluster [DBG] pgmap v1786: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:59.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:47:58 gibba045 bash[25517]: cluster 2021-03-10T14:47:57.476646+0000 mgr.gibba045.orlgmj (mgr.34412) 3150 : cluster [DBG] pgmap v1786: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:00.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:48:00 gibba015 bash[29377]: cluster 2021-03-10T14:47:59.477803+0000 mgr.gibba045.orlgmj (mgr.34412) 3151 : cluster [DBG] pgmap v1787: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:00.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:48:00 gibba015 bash[29377]: cephadm 2021-03-10T14:47:59.625168+0000 mgr.gibba045.orlgmj (mgr.34412) 3152 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:48:00.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:48:00 gibba015 bash[30343]: cluster 2021-03-10T14:47:59.477803+0000 mgr.gibba045.orlgmj (mgr.34412) 3151 : cluster [DBG] pgmap v1787: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:00.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:48:00 gibba015 bash[30343]: cephadm 2021-03-10T14:47:59.625168+0000 mgr.gibba045.orlgmj (mgr.34412) 3152 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:48:01.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:48:00 gibba045 bash[25517]: cluster 2021-03-10T14:47:59.477803+0000 mgr.gibba045.orlgmj (mgr.34412) 3151 : cluster [DBG] pgmap v1787: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:01.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:48:00 gibba045 bash[25517]: cephadm 2021-03-10T14:47:59.625168+0000 mgr.gibba045.orlgmj (mgr.34412) 3152 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:48:01.582 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:48:01.814 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:48:01.814 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (58m) 3m ago 64m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:48:01.815 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (63m) 2m ago 63m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:48:01.815 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (59m) 2m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:48:01.815 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (59m) 2m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:48:01.815 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (58m) 3m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:48:01.816 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (58m) 3m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:48:01.816 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (57m) 2m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:48:01.816 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (57m) 3m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:48:01.816 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (64m) 3m ago 64m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:48:01.817 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (64m) 2m ago 64m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:48:01.817 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (57m) 3m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:48:01.817 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (56m) 3m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:48:01.817 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (56m) 3m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:48:01.817 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (55m) 3m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:48:01.818 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (55m) 2m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:48:01.818 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (54m) 2m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:48:01.818 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (54m) 2m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:48:01.818 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (54m) 2m ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:48:01.819 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (63m) 2m ago 64m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:48:01.819 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 2m ago 62m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:48:02.058 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:48:02.059 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:48:02.059 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:48:02.059 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:48:02.059 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:48:02.059 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:48:02.060 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:48:02.060 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:48:02.060 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:48:02.060 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:48:02.060 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:48:02.061 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:48:02.061 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:48:02.061 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:48:02.061 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:48:02.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:48:02 gibba015 bash[29377]: cluster 2021-03-10T14:48:01.479681+0000 mgr.gibba045.orlgmj (mgr.34412) 3153 : cluster [DBG] pgmap v1788: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:02.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:48:02 gibba015 bash[29377]: audit 2021-03-10T14:48:01.572852+0000 mgr.gibba045.orlgmj (mgr.34412) 3154 : audit [DBG] from='client.56164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:48:02.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:48:02 gibba015 bash[29377]: audit 2021-03-10T14:48:01.800832+0000 mgr.gibba045.orlgmj (mgr.34412) 3155 : audit [DBG] from='client.56170 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:48:02.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:48:02 gibba015 bash[29377]: audit 2021-03-10T14:48:02.054769+0000 mon.c (mon.1) 921 : audit [DBG] from='client.? 172.21.2.115:0/2718366514' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:48:02.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:48:02 gibba015 bash[30343]: cluster 2021-03-10T14:48:01.479681+0000 mgr.gibba045.orlgmj (mgr.34412) 3153 : cluster [DBG] pgmap v1788: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:02.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:48:02 gibba015 bash[30343]: audit 2021-03-10T14:48:01.572852+0000 mgr.gibba045.orlgmj (mgr.34412) 3154 : audit [DBG] from='client.56164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:48:02.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:48:02 gibba015 bash[30343]: audit 2021-03-10T14:48:01.800832+0000 mgr.gibba045.orlgmj (mgr.34412) 3155 : audit [DBG] from='client.56170 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:48:02.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:48:02 gibba015 bash[30343]: audit 2021-03-10T14:48:02.054769+0000 mon.c (mon.1) 921 : audit [DBG] from='client.? 172.21.2.115:0/2718366514' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:48:03.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:48:02 gibba045 bash[25517]: cluster 2021-03-10T14:48:01.479681+0000 mgr.gibba045.orlgmj (mgr.34412) 3153 : cluster [DBG] pgmap v1788: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:03.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:48:02 gibba045 bash[25517]: audit 2021-03-10T14:48:01.572852+0000 mgr.gibba045.orlgmj (mgr.34412) 3154 : audit [DBG] from='client.56164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:48:03.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:48:02 gibba045 bash[25517]: audit 2021-03-10T14:48:01.800832+0000 mgr.gibba045.orlgmj (mgr.34412) 3155 : audit [DBG] from='client.56170 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:48:03.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:48:02 gibba045 bash[25517]: audit 2021-03-10T14:48:02.054769+0000 mon.c (mon.1) 921 : audit [DBG] from='client.? 172.21.2.115:0/2718366514' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:48:04.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:48:04 gibba015 bash[29377]: cluster 2021-03-10T14:48:03.480905+0000 mgr.gibba045.orlgmj (mgr.34412) 3156 : cluster [DBG] pgmap v1789: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:04.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:48:04 gibba015 bash[30343]: cluster 2021-03-10T14:48:03.480905+0000 mgr.gibba045.orlgmj (mgr.34412) 3156 : cluster [DBG] pgmap v1789: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:04.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:48:04 gibba045 bash[25517]: cluster 2021-03-10T14:48:03.480905+0000 mgr.gibba045.orlgmj (mgr.34412) 3156 : cluster [DBG] pgmap v1789: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:06.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:48:06 gibba045 bash[25517]: cluster 2021-03-10T14:48:05.482550+0000 mgr.gibba045.orlgmj (mgr.34412) 3157 : cluster [DBG] pgmap v1790: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:06.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:48:06 gibba015 bash[29377]: cluster 2021-03-10T14:48:05.482550+0000 mgr.gibba045.orlgmj (mgr.34412) 3157 : cluster [DBG] pgmap v1790: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:06.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:48:06 gibba015 bash[30343]: cluster 2021-03-10T14:48:05.482550+0000 mgr.gibba045.orlgmj (mgr.34412) 3157 : cluster [DBG] pgmap v1790: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:08.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:48:08 gibba015 bash[29377]: cluster 2021-03-10T14:48:07.484319+0000 mgr.gibba045.orlgmj (mgr.34412) 3158 : cluster [DBG] pgmap v1791: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:08.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:48:08 gibba015 bash[30343]: cluster 2021-03-10T14:48:07.484319+0000 mgr.gibba045.orlgmj (mgr.34412) 3158 : cluster [DBG] pgmap v1791: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:09.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:48:08 gibba045 bash[25517]: cluster 2021-03-10T14:48:07.484319+0000 mgr.gibba045.orlgmj (mgr.34412) 3158 : cluster [DBG] pgmap v1791: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:10.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:48:10 gibba015 bash[29377]: cluster 2021-03-10T14:48:09.485496+0000 mgr.gibba045.orlgmj (mgr.34412) 3159 : cluster [DBG] pgmap v1792: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:10.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:48:10 gibba015 bash[30343]: cluster 2021-03-10T14:48:09.485496+0000 mgr.gibba045.orlgmj (mgr.34412) 3159 : cluster [DBG] pgmap v1792: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:11.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:48:10 gibba045 bash[25517]: cluster 2021-03-10T14:48:09.485496+0000 mgr.gibba045.orlgmj (mgr.34412) 3159 : cluster [DBG] pgmap v1792: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:12.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:48:12 gibba015 bash[29377]: cluster 2021-03-10T14:48:11.487380+0000 mgr.gibba045.orlgmj (mgr.34412) 3160 : cluster [DBG] pgmap v1793: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:12.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:48:12 gibba015 bash[30343]: cluster 2021-03-10T14:48:11.487380+0000 mgr.gibba045.orlgmj (mgr.34412) 3160 : cluster [DBG] pgmap v1793: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:13.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:48:12 gibba045 bash[25517]: cluster 2021-03-10T14:48:11.487380+0000 mgr.gibba045.orlgmj (mgr.34412) 3160 : cluster [DBG] pgmap v1793: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:14.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:48:14 gibba015 bash[29377]: cluster 2021-03-10T14:48:13.488778+0000 mgr.gibba045.orlgmj (mgr.34412) 3161 : cluster [DBG] pgmap v1794: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:14.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:48:14 gibba015 bash[30343]: cluster 2021-03-10T14:48:13.488778+0000 mgr.gibba045.orlgmj (mgr.34412) 3161 : cluster [DBG] pgmap v1794: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:14.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:48:14 gibba045 bash[25517]: cluster 2021-03-10T14:48:13.488778+0000 mgr.gibba045.orlgmj (mgr.34412) 3161 : cluster [DBG] pgmap v1794: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:15.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:48:15 gibba015 bash[29377]: audit 2021-03-10T14:48:14.624242+0000 mon.c (mon.1) 922 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:48:15.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:48:15 gibba015 bash[29377]: cephadm 2021-03-10T14:48:14.631227+0000 mgr.gibba045.orlgmj (mgr.34412) 3162 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:48:15.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:48:15 gibba015 bash[29377]: cephadm 2021-03-10T14:48:14.633157+0000 mgr.gibba045.orlgmj (mgr.34412) 3163 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:48:15.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:48:15 gibba015 bash[29377]: audit 2021-03-10T14:48:14.824711+0000 mon.a (mon.0) 1042 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:48:15.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:48:15 gibba015 bash[29377]: audit 2021-03-10T14:48:14.828251+0000 mon.c (mon.1) 923 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:48:15.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:48:15 gibba015 bash[29377]: audit 2021-03-10T14:48:14.829217+0000 mon.c (mon.1) 924 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:48:15.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:48:15 gibba015 bash[29377]: audit 2021-03-10T14:48:14.830351+0000 mon.c (mon.1) 925 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:48:15.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:48:15 gibba015 bash[29377]: cephadm 2021-03-10T14:48:14.830713+0000 mgr.gibba045.orlgmj (mgr.34412) 3164 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:48:15.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:48:15 gibba015 bash[29377]: audit 2021-03-10T14:48:14.831374+0000 mon.c (mon.1) 926 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:48:15.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:48:15 gibba015 bash[29377]: cephadm 2021-03-10T14:48:14.832059+0000 mgr.gibba045.orlgmj (mgr.34412) 3165 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:48:15.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:48:15 gibba015 bash[29377]: cephadm 2021-03-10T14:48:14.833002+0000 mgr.gibba045.orlgmj (mgr.34412) 3166 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:48:15.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:48:15 gibba015 bash[29377]: cephadm 2021-03-10T14:48:14.833041+0000 mgr.gibba045.orlgmj (mgr.34412) 3167 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:48:15.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:48:15 gibba015 bash[29377]: audit 2021-03-10T14:48:14.833941+0000 mon.c (mon.1) 927 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:48:15.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:48:15 gibba015 bash[29377]: cephadm 2021-03-10T14:48:14.834116+0000 mgr.gibba045.orlgmj (mgr.34412) 3168 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:48:15.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:48:15 gibba015 bash[29377]: cephadm 2021-03-10T14:48:14.834156+0000 mgr.gibba045.orlgmj (mgr.34412) 3169 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:48:15.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:48:15 gibba015 bash[29377]: cephadm 2021-03-10T14:48:14.835082+0000 mgr.gibba045.orlgmj (mgr.34412) 3170 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:48:15.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:48:15 gibba015 bash[29377]: audit 2021-03-10T14:48:14.835253+0000 mon.c (mon.1) 928 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:48:15.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:48:15 gibba015 bash[29377]: cephadm 2021-03-10T14:48:14.836476+0000 mgr.gibba045.orlgmj (mgr.34412) 3171 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:48:15.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:48:15 gibba015 bash[29377]: cephadm 2021-03-10T14:48:14.836551+0000 mgr.gibba045.orlgmj (mgr.34412) 3172 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:48:15.479 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:48:15 gibba015 bash[29377]: cephadm 2021-03-10T14:48:14.837694+0000 mgr.gibba045.orlgmj (mgr.34412) 3173 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:48:15.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:48:15 gibba015 bash[30343]: audit 2021-03-10T14:48:14.624242+0000 mon.c (mon.1) 922 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:48:15.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:48:15 gibba015 bash[30343]: cephadm 2021-03-10T14:48:14.631227+0000 mgr.gibba045.orlgmj (mgr.34412) 3162 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:48:15.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:48:15 gibba015 bash[30343]: cephadm 2021-03-10T14:48:14.633157+0000 mgr.gibba045.orlgmj (mgr.34412) 3163 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:48:15.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:48:15 gibba015 bash[30343]: audit 2021-03-10T14:48:14.824711+0000 mon.a (mon.0) 1042 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:48:15.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:48:15 gibba015 bash[30343]: audit 2021-03-10T14:48:14.828251+0000 mon.c (mon.1) 923 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:48:15.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:48:15 gibba015 bash[30343]: audit 2021-03-10T14:48:14.829217+0000 mon.c (mon.1) 924 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:48:15.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:48:15 gibba015 bash[30343]: audit 2021-03-10T14:48:14.830351+0000 mon.c (mon.1) 925 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:48:15.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:48:15 gibba015 bash[30343]: cephadm 2021-03-10T14:48:14.830713+0000 mgr.gibba045.orlgmj (mgr.34412) 3164 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:48:15.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:48:15 gibba015 bash[30343]: audit 2021-03-10T14:48:14.831374+0000 mon.c (mon.1) 926 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:48:15.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:48:15 gibba015 bash[30343]: cephadm 2021-03-10T14:48:14.832059+0000 mgr.gibba045.orlgmj (mgr.34412) 3165 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:48:15.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:48:15 gibba015 bash[30343]: cephadm 2021-03-10T14:48:14.833002+0000 mgr.gibba045.orlgmj (mgr.34412) 3166 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:48:15.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:48:15 gibba015 bash[30343]: cephadm 2021-03-10T14:48:14.833041+0000 mgr.gibba045.orlgmj (mgr.34412) 3167 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:48:15.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:48:15 gibba015 bash[30343]: audit 2021-03-10T14:48:14.833941+0000 mon.c (mon.1) 927 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:48:15.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:48:15 gibba015 bash[30343]: cephadm 2021-03-10T14:48:14.834116+0000 mgr.gibba045.orlgmj (mgr.34412) 3168 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:48:15.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:48:15 gibba015 bash[30343]: cephadm 2021-03-10T14:48:14.834156+0000 mgr.gibba045.orlgmj (mgr.34412) 3169 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:48:15.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:48:15 gibba015 bash[30343]: cephadm 2021-03-10T14:48:14.835082+0000 mgr.gibba045.orlgmj (mgr.34412) 3170 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:48:15.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:48:15 gibba015 bash[30343]: audit 2021-03-10T14:48:14.835253+0000 mon.c (mon.1) 928 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:48:15.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:48:15 gibba015 bash[30343]: cephadm 2021-03-10T14:48:14.836476+0000 mgr.gibba045.orlgmj (mgr.34412) 3171 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:48:15.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:48:15 gibba015 bash[30343]: cephadm 2021-03-10T14:48:14.836551+0000 mgr.gibba045.orlgmj (mgr.34412) 3172 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:48:15.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:48:15 gibba015 bash[30343]: cephadm 2021-03-10T14:48:14.837694+0000 mgr.gibba045.orlgmj (mgr.34412) 3173 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:48:15.484 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:48:15 gibba015 bash[29377]: cephadm 2021-03-10T14:48:14.838013+0000 mgr.gibba045.orlgmj (mgr.34412) 3174 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:48:15.484 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:48:15 gibba015 bash[29377]: cephadm 2021-03-10T14:48:14.838985+0000 mgr.gibba045.orlgmj (mgr.34412) 3175 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:48:15.484 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:48:15 gibba015 bash[29377]: cephadm 2021-03-10T14:48:14.839024+0000 mgr.gibba045.orlgmj (mgr.34412) 3176 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:48:15.484 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:48:15 gibba015 bash[29377]: cephadm 2021-03-10T14:48:14.839132+0000 mgr.gibba045.orlgmj (mgr.34412) 3177 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:48:15.485 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:48:15 gibba015 bash[30343]: cephadm 2021-03-10T14:48:14.838013+0000 mgr.gibba045.orlgmj (mgr.34412) 3174 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:48:15.485 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:48:15 gibba015 bash[30343]: cephadm 2021-03-10T14:48:14.838985+0000 mgr.gibba045.orlgmj (mgr.34412) 3175 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:48:15.485 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:48:15 gibba015 bash[30343]: cephadm 2021-03-10T14:48:14.839024+0000 mgr.gibba045.orlgmj (mgr.34412) 3176 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:48:15.485 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:48:15 gibba015 bash[30343]: cephadm 2021-03-10T14:48:14.839132+0000 mgr.gibba045.orlgmj (mgr.34412) 3177 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:48:15.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:48:15 gibba045 bash[25517]: audit 2021-03-10T14:48:14.624242+0000 mon.c (mon.1) 922 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:48:15.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:48:15 gibba045 bash[25517]: cephadm 2021-03-10T14:48:14.631227+0000 mgr.gibba045.orlgmj (mgr.34412) 3162 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:48:15.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:48:15 gibba045 bash[25517]: cephadm 2021-03-10T14:48:14.633157+0000 mgr.gibba045.orlgmj (mgr.34412) 3163 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:48:15.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:48:15 gibba045 bash[25517]: audit 2021-03-10T14:48:14.824711+0000 mon.a (mon.0) 1042 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:48:15.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:48:15 gibba045 bash[25517]: audit 2021-03-10T14:48:14.828251+0000 mon.c (mon.1) 923 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:48:15.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:48:15 gibba045 bash[25517]: audit 2021-03-10T14:48:14.829217+0000 mon.c (mon.1) 924 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:48:15.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:48:15 gibba045 bash[25517]: audit 2021-03-10T14:48:14.830351+0000 mon.c (mon.1) 925 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:48:15.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:48:15 gibba045 bash[25517]: cephadm 2021-03-10T14:48:14.830713+0000 mgr.gibba045.orlgmj (mgr.34412) 3164 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:48:15.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:48:15 gibba045 bash[25517]: audit 2021-03-10T14:48:14.831374+0000 mon.c (mon.1) 926 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:48:15.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:48:15 gibba045 bash[25517]: cephadm 2021-03-10T14:48:14.832059+0000 mgr.gibba045.orlgmj (mgr.34412) 3165 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:48:15.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:48:15 gibba045 bash[25517]: cephadm 2021-03-10T14:48:14.833002+0000 mgr.gibba045.orlgmj (mgr.34412) 3166 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:48:15.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:48:15 gibba045 bash[25517]: cephadm 2021-03-10T14:48:14.833041+0000 mgr.gibba045.orlgmj (mgr.34412) 3167 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:48:15.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:48:15 gibba045 bash[25517]: audit 2021-03-10T14:48:14.833941+0000 mon.c (mon.1) 927 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:48:15.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:48:15 gibba045 bash[25517]: cephadm 2021-03-10T14:48:14.834116+0000 mgr.gibba045.orlgmj (mgr.34412) 3168 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:48:15.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:48:15 gibba045 bash[25517]: cephadm 2021-03-10T14:48:14.834156+0000 mgr.gibba045.orlgmj (mgr.34412) 3169 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:48:15.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:48:15 gibba045 bash[25517]: cephadm 2021-03-10T14:48:14.835082+0000 mgr.gibba045.orlgmj (mgr.34412) 3170 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:48:15.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:48:15 gibba045 bash[25517]: audit 2021-03-10T14:48:14.835253+0000 mon.c (mon.1) 928 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:48:15.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:48:15 gibba045 bash[25517]: cephadm 2021-03-10T14:48:14.836476+0000 mgr.gibba045.orlgmj (mgr.34412) 3171 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:48:15.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:48:15 gibba045 bash[25517]: cephadm 2021-03-10T14:48:14.836551+0000 mgr.gibba045.orlgmj (mgr.34412) 3172 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:48:15.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:48:15 gibba045 bash[25517]: cephadm 2021-03-10T14:48:14.837694+0000 mgr.gibba045.orlgmj (mgr.34412) 3173 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:48:15.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:48:15 gibba045 bash[25517]: cephadm 2021-03-10T14:48:14.838013+0000 mgr.gibba045.orlgmj (mgr.34412) 3174 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:48:15.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:48:15 gibba045 bash[25517]: cephadm 2021-03-10T14:48:14.838985+0000 mgr.gibba045.orlgmj (mgr.34412) 3175 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:48:15.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:48:15 gibba045 bash[25517]: cephadm 2021-03-10T14:48:14.839024+0000 mgr.gibba045.orlgmj (mgr.34412) 3176 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:48:15.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:48:15 gibba045 bash[25517]: cephadm 2021-03-10T14:48:14.839132+0000 mgr.gibba045.orlgmj (mgr.34412) 3177 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:48:16.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:48:16 gibba015 bash[29377]: cluster 2021-03-10T14:48:15.490086+0000 mgr.gibba045.orlgmj (mgr.34412) 3178 : cluster [DBG] pgmap v1795: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:16.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:48:16 gibba015 bash[30343]: cluster 2021-03-10T14:48:15.490086+0000 mgr.gibba045.orlgmj (mgr.34412) 3178 : cluster [DBG] pgmap v1795: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:16.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:48:16 gibba045 bash[25517]: cluster 2021-03-10T14:48:15.490086+0000 mgr.gibba045.orlgmj (mgr.34412) 3178 : cluster [DBG] pgmap v1795: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:18.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:48:18 gibba015 bash[29377]: cluster 2021-03-10T14:48:17.491932+0000 mgr.gibba045.orlgmj (mgr.34412) 3179 : cluster [DBG] pgmap v1796: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:18.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:48:18 gibba015 bash[30343]: cluster 2021-03-10T14:48:17.491932+0000 mgr.gibba045.orlgmj (mgr.34412) 3179 : cluster [DBG] pgmap v1796: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:19.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:48:18 gibba045 bash[25517]: cluster 2021-03-10T14:48:17.491932+0000 mgr.gibba045.orlgmj (mgr.34412) 3179 : cluster [DBG] pgmap v1796: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:20.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:48:20 gibba015 bash[29377]: cluster 2021-03-10T14:48:19.493179+0000 mgr.gibba045.orlgmj (mgr.34412) 3180 : cluster [DBG] pgmap v1797: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:20.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:48:20 gibba015 bash[30343]: cluster 2021-03-10T14:48:19.493179+0000 mgr.gibba045.orlgmj (mgr.34412) 3180 : cluster [DBG] pgmap v1797: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:21.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:48:20 gibba045 bash[25517]: cluster 2021-03-10T14:48:19.493179+0000 mgr.gibba045.orlgmj (mgr.34412) 3180 : cluster [DBG] pgmap v1797: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:22.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:48:22 gibba015 bash[29377]: cluster 2021-03-10T14:48:21.495255+0000 mgr.gibba045.orlgmj (mgr.34412) 3181 : cluster [DBG] pgmap v1798: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:22.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:48:22 gibba015 bash[30343]: cluster 2021-03-10T14:48:21.495255+0000 mgr.gibba045.orlgmj (mgr.34412) 3181 : cluster [DBG] pgmap v1798: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:23.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:48:22 gibba045 bash[25517]: cluster 2021-03-10T14:48:21.495255+0000 mgr.gibba045.orlgmj (mgr.34412) 3181 : cluster [DBG] pgmap v1798: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:24.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:48:24 gibba015 bash[29377]: cluster 2021-03-10T14:48:23.496617+0000 mgr.gibba045.orlgmj (mgr.34412) 3182 : cluster [DBG] pgmap v1799: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:24.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:48:24 gibba015 bash[30343]: cluster 2021-03-10T14:48:23.496617+0000 mgr.gibba045.orlgmj (mgr.34412) 3182 : cluster [DBG] pgmap v1799: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:24.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:48:24 gibba045 bash[25517]: cluster 2021-03-10T14:48:23.496617+0000 mgr.gibba045.orlgmj (mgr.34412) 3182 : cluster [DBG] pgmap v1799: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:26.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:48:26 gibba015 bash[29377]: cluster 2021-03-10T14:48:25.498308+0000 mgr.gibba045.orlgmj (mgr.34412) 3183 : cluster [DBG] pgmap v1800: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:26.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:48:26 gibba015 bash[30343]: cluster 2021-03-10T14:48:25.498308+0000 mgr.gibba045.orlgmj (mgr.34412) 3183 : cluster [DBG] pgmap v1800: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:27.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:48:26 gibba045 bash[25517]: cluster 2021-03-10T14:48:25.498308+0000 mgr.gibba045.orlgmj (mgr.34412) 3183 : cluster [DBG] pgmap v1800: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:28.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:48:28 gibba015 bash[29377]: cluster 2021-03-10T14:48:27.500088+0000 mgr.gibba045.orlgmj (mgr.34412) 3184 : cluster [DBG] pgmap v1801: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:28.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:48:28 gibba015 bash[30343]: cluster 2021-03-10T14:48:27.500088+0000 mgr.gibba045.orlgmj (mgr.34412) 3184 : cluster [DBG] pgmap v1801: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:29.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:48:28 gibba045 bash[25517]: cluster 2021-03-10T14:48:27.500088+0000 mgr.gibba045.orlgmj (mgr.34412) 3184 : cluster [DBG] pgmap v1801: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:30.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:48:30 gibba015 bash[29377]: cluster 2021-03-10T14:48:29.501291+0000 mgr.gibba045.orlgmj (mgr.34412) 3185 : cluster [DBG] pgmap v1802: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:30.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:48:30 gibba015 bash[29377]: cephadm 2021-03-10T14:48:29.855163+0000 mgr.gibba045.orlgmj (mgr.34412) 3186 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:48:30.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:48:30 gibba015 bash[30343]: cluster 2021-03-10T14:48:29.501291+0000 mgr.gibba045.orlgmj (mgr.34412) 3185 : cluster [DBG] pgmap v1802: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:30.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:48:30 gibba015 bash[30343]: cephadm 2021-03-10T14:48:29.855163+0000 mgr.gibba045.orlgmj (mgr.34412) 3186 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:48:31.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:48:30 gibba045 bash[25517]: cluster 2021-03-10T14:48:29.501291+0000 mgr.gibba045.orlgmj (mgr.34412) 3185 : cluster [DBG] pgmap v1802: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:31.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:48:30 gibba045 bash[25517]: cephadm 2021-03-10T14:48:29.855163+0000 mgr.gibba045.orlgmj (mgr.34412) 3186 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:48:32.301 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:48:32.527 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:48:32.528 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (59m) 4m ago 64m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:48:32.528 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (64m) 3m ago 64m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:48:32.528 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (59m) 3m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:48:32.529 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (59m) 3m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:48:32.529 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (58m) 4m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:48:32.530 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (58m) 4m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:48:32.530 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (58m) 3m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:48:32.531 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (58m) 4m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:48:32.531 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (64m) 4m ago 64m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:48:32.531 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (64m) 3m ago 64m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:48:32.532 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (57m) 4m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:48:32.532 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (57m) 4m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:48:32.533 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (56m) 4m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:48:32.533 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (56m) 4m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:48:32.533 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (55m) 3m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:48:32.534 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (55m) 3m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:48:32.534 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (55m) 3m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:48:32.535 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (54m) 3m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:48:32.535 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (64m) 3m ago 64m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:48:32.536 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 3m ago 62m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:48:32.779 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:48:32.779 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:48:32.780 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:48:32.780 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:48:32.780 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:48:32.780 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:48:32.781 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:48:32.781 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:48:32.781 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:48:32.781 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:48:32.781 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:48:32.782 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:48:32.782 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:48:32.782 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:48:32.782 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:48:32.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:48:32 gibba015 bash[29377]: cluster 2021-03-10T14:48:31.503119+0000 mgr.gibba045.orlgmj (mgr.34412) 3187 : cluster [DBG] pgmap v1803: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:32.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:48:32 gibba015 bash[30343]: cluster 2021-03-10T14:48:31.503119+0000 mgr.gibba045.orlgmj (mgr.34412) 3187 : cluster [DBG] pgmap v1803: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:33.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:48:32 gibba045 bash[25517]: cluster 2021-03-10T14:48:31.503119+0000 mgr.gibba045.orlgmj (mgr.34412) 3187 : cluster [DBG] pgmap v1803: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:33.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:48:33 gibba015 bash[29377]: audit 2021-03-10T14:48:32.291661+0000 mgr.gibba045.orlgmj (mgr.34412) 3188 : audit [DBG] from='client.46194 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:48:33.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:48:33 gibba015 bash[29377]: audit 2021-03-10T14:48:32.513896+0000 mgr.gibba045.orlgmj (mgr.34412) 3189 : audit [DBG] from='client.46200 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:48:33.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:48:33 gibba015 bash[29377]: audit 2021-03-10T14:48:32.776001+0000 mon.c (mon.1) 929 : audit [DBG] from='client.? 172.21.2.115:0/3703114813' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:48:33.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:48:33 gibba015 bash[30343]: audit 2021-03-10T14:48:32.291661+0000 mgr.gibba045.orlgmj (mgr.34412) 3188 : audit [DBG] from='client.46194 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:48:33.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:48:33 gibba015 bash[30343]: audit 2021-03-10T14:48:32.513896+0000 mgr.gibba045.orlgmj (mgr.34412) 3189 : audit [DBG] from='client.46200 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:48:33.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:48:33 gibba015 bash[30343]: audit 2021-03-10T14:48:32.776001+0000 mon.c (mon.1) 929 : audit [DBG] from='client.? 172.21.2.115:0/3703114813' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:48:34.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:48:33 gibba045 bash[25517]: audit 2021-03-10T14:48:32.291661+0000 mgr.gibba045.orlgmj (mgr.34412) 3188 : audit [DBG] from='client.46194 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:48:34.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:48:33 gibba045 bash[25517]: audit 2021-03-10T14:48:32.513896+0000 mgr.gibba045.orlgmj (mgr.34412) 3189 : audit [DBG] from='client.46200 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:48:34.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:48:33 gibba045 bash[25517]: audit 2021-03-10T14:48:32.776001+0000 mon.c (mon.1) 929 : audit [DBG] from='client.? 172.21.2.115:0/3703114813' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:48:34.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:48:34 gibba015 bash[29377]: cluster 2021-03-10T14:48:33.504545+0000 mgr.gibba045.orlgmj (mgr.34412) 3190 : cluster [DBG] pgmap v1804: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:34.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:48:34 gibba015 bash[30343]: cluster 2021-03-10T14:48:33.504545+0000 mgr.gibba045.orlgmj (mgr.34412) 3190 : cluster [DBG] pgmap v1804: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:35.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:48:34 gibba045 bash[25517]: cluster 2021-03-10T14:48:33.504545+0000 mgr.gibba045.orlgmj (mgr.34412) 3190 : cluster [DBG] pgmap v1804: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:36.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:48:36 gibba015 bash[29377]: cluster 2021-03-10T14:48:35.505947+0000 mgr.gibba045.orlgmj (mgr.34412) 3191 : cluster [DBG] pgmap v1805: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:36.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:48:36 gibba015 bash[30343]: cluster 2021-03-10T14:48:35.505947+0000 mgr.gibba045.orlgmj (mgr.34412) 3191 : cluster [DBG] pgmap v1805: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:37.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:48:36 gibba045 bash[25517]: cluster 2021-03-10T14:48:35.505947+0000 mgr.gibba045.orlgmj (mgr.34412) 3191 : cluster [DBG] pgmap v1805: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:38.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:48:38 gibba015 bash[29377]: cluster 2021-03-10T14:48:37.507658+0000 mgr.gibba045.orlgmj (mgr.34412) 3192 : cluster [DBG] pgmap v1806: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:38.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:48:38 gibba015 bash[30343]: cluster 2021-03-10T14:48:37.507658+0000 mgr.gibba045.orlgmj (mgr.34412) 3192 : cluster [DBG] pgmap v1806: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:39.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:48:38 gibba045 bash[25517]: cluster 2021-03-10T14:48:37.507658+0000 mgr.gibba045.orlgmj (mgr.34412) 3192 : cluster [DBG] pgmap v1806: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:40.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:48:40 gibba015 bash[29377]: cluster 2021-03-10T14:48:39.509146+0000 mgr.gibba045.orlgmj (mgr.34412) 3193 : cluster [DBG] pgmap v1807: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:40.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:48:40 gibba015 bash[30343]: cluster 2021-03-10T14:48:39.509146+0000 mgr.gibba045.orlgmj (mgr.34412) 3193 : cluster [DBG] pgmap v1807: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:41.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:48:40 gibba045 bash[25517]: cluster 2021-03-10T14:48:39.509146+0000 mgr.gibba045.orlgmj (mgr.34412) 3193 : cluster [DBG] pgmap v1807: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:42.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:48:42 gibba015 bash[29377]: cluster 2021-03-10T14:48:41.510715+0000 mgr.gibba045.orlgmj (mgr.34412) 3194 : cluster [DBG] pgmap v1808: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:42.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:48:42 gibba015 bash[30343]: cluster 2021-03-10T14:48:41.510715+0000 mgr.gibba045.orlgmj (mgr.34412) 3194 : cluster [DBG] pgmap v1808: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:43.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:48:42 gibba045 bash[25517]: cluster 2021-03-10T14:48:41.510715+0000 mgr.gibba045.orlgmj (mgr.34412) 3194 : cluster [DBG] pgmap v1808: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:44.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:48:44 gibba015 bash[29377]: cluster 2021-03-10T14:48:43.512082+0000 mgr.gibba045.orlgmj (mgr.34412) 3195 : cluster [DBG] pgmap v1809: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:44.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:48:44 gibba015 bash[30343]: cluster 2021-03-10T14:48:43.512082+0000 mgr.gibba045.orlgmj (mgr.34412) 3195 : cluster [DBG] pgmap v1809: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:44.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:48:44 gibba045 bash[25517]: cluster 2021-03-10T14:48:43.512082+0000 mgr.gibba045.orlgmj (mgr.34412) 3195 : cluster [DBG] pgmap v1809: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:45.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:48:45 gibba015 bash[29377]: cephadm 2021-03-10T14:48:44.871160+0000 mgr.gibba045.orlgmj (mgr.34412) 3196 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:48:45.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:48:45 gibba015 bash[30343]: cephadm 2021-03-10T14:48:44.871160+0000 mgr.gibba045.orlgmj (mgr.34412) 3196 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:48:45.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:48:45 gibba045 bash[25517]: cephadm 2021-03-10T14:48:44.871160+0000 mgr.gibba045.orlgmj (mgr.34412) 3196 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:48:46.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:48:46 gibba015 bash[29377]: cluster 2021-03-10T14:48:45.513608+0000 mgr.gibba045.orlgmj (mgr.34412) 3197 : cluster [DBG] pgmap v1810: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:46.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:48:46 gibba015 bash[30343]: cluster 2021-03-10T14:48:45.513608+0000 mgr.gibba045.orlgmj (mgr.34412) 3197 : cluster [DBG] pgmap v1810: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:46.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:48:46 gibba045 bash[25517]: cluster 2021-03-10T14:48:45.513608+0000 mgr.gibba045.orlgmj (mgr.34412) 3197 : cluster [DBG] pgmap v1810: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:48.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:48:48 gibba015 bash[29377]: cluster 2021-03-10T14:48:47.515328+0000 mgr.gibba045.orlgmj (mgr.34412) 3198 : cluster [DBG] pgmap v1811: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:48.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:48:48 gibba015 bash[30343]: cluster 2021-03-10T14:48:47.515328+0000 mgr.gibba045.orlgmj (mgr.34412) 3198 : cluster [DBG] pgmap v1811: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:49.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:48:48 gibba045 bash[25517]: cluster 2021-03-10T14:48:47.515328+0000 mgr.gibba045.orlgmj (mgr.34412) 3198 : cluster [DBG] pgmap v1811: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:50.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:48:50 gibba015 bash[29377]: cluster 2021-03-10T14:48:49.516724+0000 mgr.gibba045.orlgmj (mgr.34412) 3199 : cluster [DBG] pgmap v1812: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:50.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:48:50 gibba015 bash[30343]: cluster 2021-03-10T14:48:49.516724+0000 mgr.gibba045.orlgmj (mgr.34412) 3199 : cluster [DBG] pgmap v1812: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:51.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:48:50 gibba045 bash[25517]: cluster 2021-03-10T14:48:49.516724+0000 mgr.gibba045.orlgmj (mgr.34412) 3199 : cluster [DBG] pgmap v1812: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:52.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:48:52 gibba015 bash[29377]: cluster 2021-03-10T14:48:51.518577+0000 mgr.gibba045.orlgmj (mgr.34412) 3200 : cluster [DBG] pgmap v1813: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:52.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:48:52 gibba015 bash[30343]: cluster 2021-03-10T14:48:51.518577+0000 mgr.gibba045.orlgmj (mgr.34412) 3200 : cluster [DBG] pgmap v1813: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:53.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:48:52 gibba045 bash[25517]: cluster 2021-03-10T14:48:51.518577+0000 mgr.gibba045.orlgmj (mgr.34412) 3200 : cluster [DBG] pgmap v1813: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:53.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:48:53 gibba015 bash[29377]: audit 2021-03-10T14:48:52.864905+0000 mon.c (mon.1) 930 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:48:53.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:48:53 gibba015 bash[29377]: audit 2021-03-10T14:48:52.865590+0000 mon.c (mon.1) 931 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:48:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:48:53 gibba015 bash[29377]: audit 2021-03-10T14:48:52.866068+0000 mon.a (mon.0) 1043 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:48:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:48:53 gibba015 bash[29377]: audit 2021-03-10T14:48:52.867239+0000 mon.a (mon.0) 1044 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:48:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:48:53 gibba015 bash[29377]: audit 2021-03-10T14:48:52.876551+0000 mon.c (mon.1) 932 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T14:48:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:48:53 gibba015 bash[29377]: audit 2021-03-10T14:48:52.877313+0000 mon.c (mon.1) 933 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:48:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:48:53 gibba015 bash[29377]: audit 2021-03-10T14:48:52.877759+0000 mon.a (mon.0) 1045 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T14:48:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:48:53 gibba015 bash[29377]: audit 2021-03-10T14:48:52.878039+0000 mon.c (mon.1) 934 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:48:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:48:53 gibba015 bash[29377]: audit 2021-03-10T14:48:52.878682+0000 mon.c (mon.1) 935 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:48:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:48:53 gibba015 bash[29377]: audit 2021-03-10T14:48:52.879335+0000 mon.a (mon.0) 1046 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:48:53.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:48:53 gibba015 bash[29377]: audit 2021-03-10T14:48:52.880626+0000 mon.a (mon.0) 1047 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:48:53.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:48:53 gibba015 bash[29377]: audit 2021-03-10T14:48:52.881496+0000 mon.a (mon.0) 1048 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:48:53.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:48:53 gibba015 bash[30343]: audit 2021-03-10T14:48:52.864905+0000 mon.c (mon.1) 930 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:48:53.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:48:53 gibba015 bash[30343]: audit 2021-03-10T14:48:52.865590+0000 mon.c (mon.1) 931 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:48:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:48:53 gibba015 bash[30343]: audit 2021-03-10T14:48:52.866068+0000 mon.a (mon.0) 1043 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:48:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:48:53 gibba015 bash[30343]: audit 2021-03-10T14:48:52.867239+0000 mon.a (mon.0) 1044 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:48:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:48:53 gibba015 bash[30343]: audit 2021-03-10T14:48:52.876551+0000 mon.c (mon.1) 932 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T14:48:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:48:53 gibba015 bash[30343]: audit 2021-03-10T14:48:52.877313+0000 mon.c (mon.1) 933 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:48:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:48:53 gibba015 bash[30343]: audit 2021-03-10T14:48:52.877759+0000 mon.a (mon.0) 1045 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T14:48:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:48:53 gibba015 bash[30343]: audit 2021-03-10T14:48:52.878039+0000 mon.c (mon.1) 934 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:48:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:48:53 gibba015 bash[30343]: audit 2021-03-10T14:48:52.878682+0000 mon.c (mon.1) 935 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:48:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:48:53 gibba015 bash[30343]: audit 2021-03-10T14:48:52.879335+0000 mon.a (mon.0) 1046 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:48:53.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:48:53 gibba015 bash[30343]: audit 2021-03-10T14:48:52.880626+0000 mon.a (mon.0) 1047 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:48:53.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:48:53 gibba015 bash[30343]: audit 2021-03-10T14:48:52.881496+0000 mon.a (mon.0) 1048 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:48:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:48:53 gibba045 bash[25517]: audit 2021-03-10T14:48:52.864905+0000 mon.c (mon.1) 930 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:48:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:48:53 gibba045 bash[25517]: audit 2021-03-10T14:48:52.865590+0000 mon.c (mon.1) 931 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:48:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:48:53 gibba045 bash[25517]: audit 2021-03-10T14:48:52.866068+0000 mon.a (mon.0) 1043 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:48:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:48:53 gibba045 bash[25517]: audit 2021-03-10T14:48:52.867239+0000 mon.a (mon.0) 1044 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:48:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:48:53 gibba045 bash[25517]: audit 2021-03-10T14:48:52.876551+0000 mon.c (mon.1) 932 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T14:48:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:48:53 gibba045 bash[25517]: audit 2021-03-10T14:48:52.877313+0000 mon.c (mon.1) 933 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:48:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:48:53 gibba045 bash[25517]: audit 2021-03-10T14:48:52.877759+0000 mon.a (mon.0) 1045 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T14:48:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:48:53 gibba045 bash[25517]: audit 2021-03-10T14:48:52.878039+0000 mon.c (mon.1) 934 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:48:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:48:53 gibba045 bash[25517]: audit 2021-03-10T14:48:52.878682+0000 mon.c (mon.1) 935 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:48:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:48:53 gibba045 bash[25517]: audit 2021-03-10T14:48:52.879335+0000 mon.a (mon.0) 1046 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:48:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:48:53 gibba045 bash[25517]: audit 2021-03-10T14:48:52.880626+0000 mon.a (mon.0) 1047 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:48:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:48:53 gibba045 bash[25517]: audit 2021-03-10T14:48:52.881496+0000 mon.a (mon.0) 1048 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:48:54.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:48:54 gibba015 bash[29377]: cluster 2021-03-10T14:48:53.519942+0000 mgr.gibba045.orlgmj (mgr.34412) 3201 : cluster [DBG] pgmap v1814: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:54.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:48:54 gibba015 bash[30343]: cluster 2021-03-10T14:48:53.519942+0000 mgr.gibba045.orlgmj (mgr.34412) 3201 : cluster [DBG] pgmap v1814: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:55.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:48:54 gibba045 bash[25517]: cluster 2021-03-10T14:48:53.519942+0000 mgr.gibba045.orlgmj (mgr.34412) 3201 : cluster [DBG] pgmap v1814: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:56.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:48:56 gibba015 bash[29377]: cluster 2021-03-10T14:48:55.521671+0000 mgr.gibba045.orlgmj (mgr.34412) 3202 : cluster [DBG] pgmap v1815: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:56.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:48:56 gibba015 bash[30343]: cluster 2021-03-10T14:48:55.521671+0000 mgr.gibba045.orlgmj (mgr.34412) 3202 : cluster [DBG] pgmap v1815: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:57.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:48:56 gibba045 bash[25517]: cluster 2021-03-10T14:48:55.521671+0000 mgr.gibba045.orlgmj (mgr.34412) 3202 : cluster [DBG] pgmap v1815: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:58.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:48:58 gibba015 bash[29377]: cluster 2021-03-10T14:48:57.523261+0000 mgr.gibba045.orlgmj (mgr.34412) 3203 : cluster [DBG] pgmap v1816: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:58.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:48:58 gibba015 bash[30343]: cluster 2021-03-10T14:48:57.523261+0000 mgr.gibba045.orlgmj (mgr.34412) 3203 : cluster [DBG] pgmap v1816: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:59.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:48:58 gibba045 bash[25517]: cluster 2021-03-10T14:48:57.523261+0000 mgr.gibba045.orlgmj (mgr.34412) 3203 : cluster [DBG] pgmap v1816: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:00.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:49:00 gibba015 bash[29377]: cluster 2021-03-10T14:48:59.524887+0000 mgr.gibba045.orlgmj (mgr.34412) 3204 : cluster [DBG] pgmap v1817: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:00.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:49:00 gibba015 bash[29377]: cephadm 2021-03-10T14:48:59.879660+0000 mgr.gibba045.orlgmj (mgr.34412) 3205 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:49:00.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:49:00 gibba015 bash[30343]: cluster 2021-03-10T14:48:59.524887+0000 mgr.gibba045.orlgmj (mgr.34412) 3204 : cluster [DBG] pgmap v1817: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:00.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:49:00 gibba015 bash[30343]: cephadm 2021-03-10T14:48:59.879660+0000 mgr.gibba045.orlgmj (mgr.34412) 3205 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:49:01.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:49:00 gibba045 bash[25517]: cluster 2021-03-10T14:48:59.524887+0000 mgr.gibba045.orlgmj (mgr.34412) 3204 : cluster [DBG] pgmap v1817: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:01.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:49:00 gibba045 bash[25517]: cephadm 2021-03-10T14:48:59.879660+0000 mgr.gibba045.orlgmj (mgr.34412) 3205 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:49:02.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:49:02 gibba015 bash[29377]: cluster 2021-03-10T14:49:01.526782+0000 mgr.gibba045.orlgmj (mgr.34412) 3206 : cluster [DBG] pgmap v1818: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:02.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:49:02 gibba015 bash[30343]: cluster 2021-03-10T14:49:01.526782+0000 mgr.gibba045.orlgmj (mgr.34412) 3206 : cluster [DBG] pgmap v1818: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:03.021 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:49:03.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:49:02 gibba045 bash[25517]: cluster 2021-03-10T14:49:01.526782+0000 mgr.gibba045.orlgmj (mgr.34412) 3206 : cluster [DBG] pgmap v1818: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:03.255 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:49:03.255 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (59m) 4m ago 65m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:49:03.255 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (64m) 3m ago 64m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:49:03.255 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (60m) 3m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:49:03.256 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (60m) 3m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:49:03.256 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (59m) 4m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:49:03.256 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (59m) 4m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:49:03.256 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (58m) 3m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:49:03.256 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (59m) 4m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:49:03.257 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (65m) 4m ago 65m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:49:03.257 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (65m) 3m ago 65m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:49:03.257 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (58m) 4m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:49:03.257 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (57m) 4m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:49:03.258 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (57m) 4m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:49:03.258 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (56m) 4m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:49:03.258 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (56m) 3m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:49:03.258 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (55m) 3m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:49:03.258 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (55m) 3m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:49:03.259 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (55m) 3m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:49:03.259 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (64m) 3m ago 65m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:49:03.259 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 3m ago 63m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:49:03.503 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:49:03.503 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:49:03.503 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:49:03.504 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:49:03.504 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:49:03.504 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:49:03.504 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:49:03.505 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:49:03.505 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:49:03.505 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:49:03.505 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:49:03.505 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:49:03.506 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:49:03.506 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:49:03.506 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:49:03.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:49:03 gibba015 bash[29377]: audit 2021-03-10T14:49:03.012071+0000 mgr.gibba045.orlgmj (mgr.34412) 3207 : audit [DBG] from='client.46212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:49:03.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:49:03 gibba015 bash[29377]: audit 2021-03-10T14:49:03.499677+0000 mon.a (mon.0) 1049 : audit [DBG] from='client.? 172.21.2.115:0/3515434380' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:49:03.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:49:03 gibba015 bash[30343]: audit 2021-03-10T14:49:03.012071+0000 mgr.gibba045.orlgmj (mgr.34412) 3207 : audit [DBG] from='client.46212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:49:03.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:49:03 gibba015 bash[30343]: audit 2021-03-10T14:49:03.499677+0000 mon.a (mon.0) 1049 : audit [DBG] from='client.? 172.21.2.115:0/3515434380' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:49:04.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:49:03 gibba045 bash[25517]: audit 2021-03-10T14:49:03.012071+0000 mgr.gibba045.orlgmj (mgr.34412) 3207 : audit [DBG] from='client.46212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:49:04.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:49:03 gibba045 bash[25517]: audit 2021-03-10T14:49:03.499677+0000 mon.a (mon.0) 1049 : audit [DBG] from='client.? 172.21.2.115:0/3515434380' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:49:04.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:49:04 gibba015 bash[29377]: audit 2021-03-10T14:49:03.242137+0000 mgr.gibba045.orlgmj (mgr.34412) 3208 : audit [DBG] from='client.56206 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:49:04.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:49:04 gibba015 bash[29377]: cluster 2021-03-10T14:49:03.528038+0000 mgr.gibba045.orlgmj (mgr.34412) 3209 : cluster [DBG] pgmap v1819: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:04.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:49:04 gibba015 bash[30343]: audit 2021-03-10T14:49:03.242137+0000 mgr.gibba045.orlgmj (mgr.34412) 3208 : audit [DBG] from='client.56206 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:49:04.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:49:04 gibba015 bash[30343]: cluster 2021-03-10T14:49:03.528038+0000 mgr.gibba045.orlgmj (mgr.34412) 3209 : cluster [DBG] pgmap v1819: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:05.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:49:04 gibba045 bash[25517]: audit 2021-03-10T14:49:03.242137+0000 mgr.gibba045.orlgmj (mgr.34412) 3208 : audit [DBG] from='client.56206 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:49:05.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:49:04 gibba045 bash[25517]: cluster 2021-03-10T14:49:03.528038+0000 mgr.gibba045.orlgmj (mgr.34412) 3209 : cluster [DBG] pgmap v1819: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:06.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:49:06 gibba015 bash[29377]: cluster 2021-03-10T14:49:05.529702+0000 mgr.gibba045.orlgmj (mgr.34412) 3210 : cluster [DBG] pgmap v1820: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:06.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:49:06 gibba015 bash[30343]: cluster 2021-03-10T14:49:05.529702+0000 mgr.gibba045.orlgmj (mgr.34412) 3210 : cluster [DBG] pgmap v1820: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:07.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:49:06 gibba045 bash[25517]: cluster 2021-03-10T14:49:05.529702+0000 mgr.gibba045.orlgmj (mgr.34412) 3210 : cluster [DBG] pgmap v1820: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:08.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:49:08 gibba015 bash[29377]: cluster 2021-03-10T14:49:07.531299+0000 mgr.gibba045.orlgmj (mgr.34412) 3211 : cluster [DBG] pgmap v1821: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:08.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:49:08 gibba015 bash[30343]: cluster 2021-03-10T14:49:07.531299+0000 mgr.gibba045.orlgmj (mgr.34412) 3211 : cluster [DBG] pgmap v1821: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:09.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:49:08 gibba045 bash[25517]: cluster 2021-03-10T14:49:07.531299+0000 mgr.gibba045.orlgmj (mgr.34412) 3211 : cluster [DBG] pgmap v1821: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:10.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:49:10 gibba015 bash[29377]: cluster 2021-03-10T14:49:09.532940+0000 mgr.gibba045.orlgmj (mgr.34412) 3212 : cluster [DBG] pgmap v1822: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:10.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:49:10 gibba015 bash[30343]: cluster 2021-03-10T14:49:09.532940+0000 mgr.gibba045.orlgmj (mgr.34412) 3212 : cluster [DBG] pgmap v1822: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:11.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:49:10 gibba045 bash[25517]: cluster 2021-03-10T14:49:09.532940+0000 mgr.gibba045.orlgmj (mgr.34412) 3212 : cluster [DBG] pgmap v1822: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:12.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:49:12 gibba015 bash[29377]: cluster 2021-03-10T14:49:11.534664+0000 mgr.gibba045.orlgmj (mgr.34412) 3213 : cluster [DBG] pgmap v1823: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:12.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:49:12 gibba015 bash[30343]: cluster 2021-03-10T14:49:11.534664+0000 mgr.gibba045.orlgmj (mgr.34412) 3213 : cluster [DBG] pgmap v1823: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:13.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:49:12 gibba045 bash[25517]: cluster 2021-03-10T14:49:11.534664+0000 mgr.gibba045.orlgmj (mgr.34412) 3213 : cluster [DBG] pgmap v1823: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:14.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:49:14 gibba015 bash[29377]: cluster 2021-03-10T14:49:13.535718+0000 mgr.gibba045.orlgmj (mgr.34412) 3214 : cluster [DBG] pgmap v1824: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:14.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:49:14 gibba015 bash[30343]: cluster 2021-03-10T14:49:13.535718+0000 mgr.gibba045.orlgmj (mgr.34412) 3214 : cluster [DBG] pgmap v1824: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:14.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:49:14 gibba045 bash[25517]: cluster 2021-03-10T14:49:13.535718+0000 mgr.gibba045.orlgmj (mgr.34412) 3214 : cluster [DBG] pgmap v1824: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:15.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:49:15 gibba015 bash[29377]: audit 2021-03-10T14:49:14.893215+0000 mon.c (mon.1) 936 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:49:15.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:49:15 gibba015 bash[29377]: cephadm 2021-03-10T14:49:14.901505+0000 mgr.gibba045.orlgmj (mgr.34412) 3215 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:49:15.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:49:15 gibba015 bash[29377]: cephadm 2021-03-10T14:49:14.903359+0000 mgr.gibba045.orlgmj (mgr.34412) 3216 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:49:15.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:49:15 gibba015 bash[29377]: audit 2021-03-10T14:49:15.119394+0000 mon.a (mon.0) 1050 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:49:15.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:49:15 gibba015 bash[29377]: audit 2021-03-10T14:49:15.123362+0000 mon.c (mon.1) 937 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:49:15.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:49:15 gibba015 bash[29377]: audit 2021-03-10T14:49:15.125264+0000 mon.c (mon.1) 938 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:49:15.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:49:15 gibba015 bash[29377]: audit 2021-03-10T14:49:15.127006+0000 mon.c (mon.1) 939 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:49:15.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:49:15 gibba015 bash[29377]: audit 2021-03-10T14:49:15.128409+0000 mon.c (mon.1) 940 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:49:15.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:49:15 gibba015 bash[29377]: audit 2021-03-10T14:49:15.132318+0000 mon.c (mon.1) 941 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:49:15.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:49:15 gibba015 bash[29377]: audit 2021-03-10T14:49:15.134295+0000 mon.c (mon.1) 942 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:49:15.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:49:15 gibba015 bash[30343]: audit 2021-03-10T14:49:14.893215+0000 mon.c (mon.1) 936 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:49:15.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:49:15 gibba015 bash[30343]: cephadm 2021-03-10T14:49:14.901505+0000 mgr.gibba045.orlgmj (mgr.34412) 3215 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:49:15.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:49:15 gibba015 bash[30343]: cephadm 2021-03-10T14:49:14.903359+0000 mgr.gibba045.orlgmj (mgr.34412) 3216 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:49:15.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:49:15 gibba015 bash[30343]: audit 2021-03-10T14:49:15.119394+0000 mon.a (mon.0) 1050 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:49:15.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:49:15 gibba015 bash[30343]: audit 2021-03-10T14:49:15.123362+0000 mon.c (mon.1) 937 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:49:15.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:49:15 gibba015 bash[30343]: audit 2021-03-10T14:49:15.125264+0000 mon.c (mon.1) 938 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:49:15.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:49:15 gibba015 bash[30343]: audit 2021-03-10T14:49:15.127006+0000 mon.c (mon.1) 939 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:49:15.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:49:15 gibba015 bash[30343]: audit 2021-03-10T14:49:15.128409+0000 mon.c (mon.1) 940 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:49:15.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:49:15 gibba015 bash[30343]: audit 2021-03-10T14:49:15.132318+0000 mon.c (mon.1) 941 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:49:15.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:49:15 gibba015 bash[30343]: audit 2021-03-10T14:49:15.134295+0000 mon.c (mon.1) 942 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:49:15.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:49:15 gibba045 bash[25517]: audit 2021-03-10T14:49:14.893215+0000 mon.c (mon.1) 936 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:49:15.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:49:15 gibba045 bash[25517]: cephadm 2021-03-10T14:49:14.901505+0000 mgr.gibba045.orlgmj (mgr.34412) 3215 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:49:15.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:49:15 gibba045 bash[25517]: cephadm 2021-03-10T14:49:14.903359+0000 mgr.gibba045.orlgmj (mgr.34412) 3216 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:49:15.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:49:15 gibba045 bash[25517]: audit 2021-03-10T14:49:15.119394+0000 mon.a (mon.0) 1050 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:49:15.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:49:15 gibba045 bash[25517]: audit 2021-03-10T14:49:15.123362+0000 mon.c (mon.1) 937 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:49:15.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:49:15 gibba045 bash[25517]: audit 2021-03-10T14:49:15.125264+0000 mon.c (mon.1) 938 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:49:15.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:49:15 gibba045 bash[25517]: audit 2021-03-10T14:49:15.127006+0000 mon.c (mon.1) 939 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:49:15.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:49:15 gibba045 bash[25517]: audit 2021-03-10T14:49:15.128409+0000 mon.c (mon.1) 940 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:49:15.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:49:15 gibba045 bash[25517]: audit 2021-03-10T14:49:15.132318+0000 mon.c (mon.1) 941 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:49:15.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:49:15 gibba045 bash[25517]: audit 2021-03-10T14:49:15.134295+0000 mon.c (mon.1) 942 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:49:16.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:49:16 gibba015 bash[29377]: cephadm 2021-03-10T14:49:15.125412+0000 mgr.gibba045.orlgmj (mgr.34412) 3217 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:49:16.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:49:16 gibba015 bash[29377]: cephadm 2021-03-10T14:49:15.127734+0000 mgr.gibba045.orlgmj (mgr.34412) 3218 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:49:16.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:49:16 gibba015 bash[29377]: cephadm 2021-03-10T14:49:15.129470+0000 mgr.gibba045.orlgmj (mgr.34412) 3219 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:49:16.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:49:16 gibba015 bash[29377]: cephadm 2021-03-10T14:49:15.129583+0000 mgr.gibba045.orlgmj (mgr.34412) 3220 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:49:16.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:49:16 gibba015 bash[29377]: cephadm 2021-03-10T14:49:15.130952+0000 mgr.gibba045.orlgmj (mgr.34412) 3221 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:49:16.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:49:16 gibba015 bash[29377]: cephadm 2021-03-10T14:49:15.131092+0000 mgr.gibba045.orlgmj (mgr.34412) 3222 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:49:16.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:49:16 gibba015 bash[29377]: cephadm 2021-03-10T14:49:15.132839+0000 mgr.gibba045.orlgmj (mgr.34412) 3223 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:49:16.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:49:16 gibba015 bash[29377]: cephadm 2021-03-10T14:49:15.134766+0000 mgr.gibba045.orlgmj (mgr.34412) 3224 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:49:16.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:49:16 gibba015 bash[29377]: cephadm 2021-03-10T14:49:15.134837+0000 mgr.gibba045.orlgmj (mgr.34412) 3225 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:49:16.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:49:16 gibba015 bash[29377]: cephadm 2021-03-10T14:49:15.136294+0000 mgr.gibba045.orlgmj (mgr.34412) 3226 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:49:16.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:49:16 gibba015 bash[29377]: cephadm 2021-03-10T14:49:15.136758+0000 mgr.gibba045.orlgmj (mgr.34412) 3227 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:49:16.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:49:16 gibba015 bash[29377]: cephadm 2021-03-10T14:49:15.138170+0000 mgr.gibba045.orlgmj (mgr.34412) 3228 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:49:16.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:49:16 gibba015 bash[29377]: cephadm 2021-03-10T14:49:15.138245+0000 mgr.gibba045.orlgmj (mgr.34412) 3229 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:49:16.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:49:16 gibba015 bash[29377]: cephadm 2021-03-10T14:49:15.138402+0000 mgr.gibba045.orlgmj (mgr.34412) 3230 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:49:16.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:49:16 gibba015 bash[29377]: cluster 2021-03-10T14:49:15.537474+0000 mgr.gibba045.orlgmj (mgr.34412) 3231 : cluster [DBG] pgmap v1825: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:16.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:49:16 gibba015 bash[30343]: cephadm 2021-03-10T14:49:15.125412+0000 mgr.gibba045.orlgmj (mgr.34412) 3217 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:49:16.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:49:16 gibba015 bash[30343]: cephadm 2021-03-10T14:49:15.127734+0000 mgr.gibba045.orlgmj (mgr.34412) 3218 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:49:16.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:49:16 gibba015 bash[30343]: cephadm 2021-03-10T14:49:15.129470+0000 mgr.gibba045.orlgmj (mgr.34412) 3219 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:49:16.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:49:16 gibba015 bash[30343]: cephadm 2021-03-10T14:49:15.129583+0000 mgr.gibba045.orlgmj (mgr.34412) 3220 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:49:16.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:49:16 gibba015 bash[30343]: cephadm 2021-03-10T14:49:15.130952+0000 mgr.gibba045.orlgmj (mgr.34412) 3221 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:49:16.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:49:16 gibba015 bash[30343]: cephadm 2021-03-10T14:49:15.131092+0000 mgr.gibba045.orlgmj (mgr.34412) 3222 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:49:16.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:49:16 gibba015 bash[30343]: cephadm 2021-03-10T14:49:15.132839+0000 mgr.gibba045.orlgmj (mgr.34412) 3223 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:49:16.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:49:16 gibba015 bash[30343]: cephadm 2021-03-10T14:49:15.134766+0000 mgr.gibba045.orlgmj (mgr.34412) 3224 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:49:16.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:49:16 gibba015 bash[30343]: cephadm 2021-03-10T14:49:15.134837+0000 mgr.gibba045.orlgmj (mgr.34412) 3225 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:49:16.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:49:16 gibba015 bash[30343]: cephadm 2021-03-10T14:49:15.136294+0000 mgr.gibba045.orlgmj (mgr.34412) 3226 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:49:16.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:49:16 gibba015 bash[30343]: cephadm 2021-03-10T14:49:15.136758+0000 mgr.gibba045.orlgmj (mgr.34412) 3227 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:49:16.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:49:16 gibba015 bash[30343]: cephadm 2021-03-10T14:49:15.138170+0000 mgr.gibba045.orlgmj (mgr.34412) 3228 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:49:16.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:49:16 gibba015 bash[30343]: cephadm 2021-03-10T14:49:15.138245+0000 mgr.gibba045.orlgmj (mgr.34412) 3229 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:49:16.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:49:16 gibba015 bash[30343]: cephadm 2021-03-10T14:49:15.138402+0000 mgr.gibba045.orlgmj (mgr.34412) 3230 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:49:16.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:49:16 gibba015 bash[30343]: cluster 2021-03-10T14:49:15.537474+0000 mgr.gibba045.orlgmj (mgr.34412) 3231 : cluster [DBG] pgmap v1825: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:16.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:49:16 gibba045 bash[25517]: cephadm 2021-03-10T14:49:15.125412+0000 mgr.gibba045.orlgmj (mgr.34412) 3217 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:49:16.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:49:16 gibba045 bash[25517]: cephadm 2021-03-10T14:49:15.127734+0000 mgr.gibba045.orlgmj (mgr.34412) 3218 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:49:16.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:49:16 gibba045 bash[25517]: cephadm 2021-03-10T14:49:15.129470+0000 mgr.gibba045.orlgmj (mgr.34412) 3219 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:49:16.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:49:16 gibba045 bash[25517]: cephadm 2021-03-10T14:49:15.129583+0000 mgr.gibba045.orlgmj (mgr.34412) 3220 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:49:16.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:49:16 gibba045 bash[25517]: cephadm 2021-03-10T14:49:15.130952+0000 mgr.gibba045.orlgmj (mgr.34412) 3221 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:49:16.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:49:16 gibba045 bash[25517]: cephadm 2021-03-10T14:49:15.131092+0000 mgr.gibba045.orlgmj (mgr.34412) 3222 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:49:16.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:49:16 gibba045 bash[25517]: cephadm 2021-03-10T14:49:15.132839+0000 mgr.gibba045.orlgmj (mgr.34412) 3223 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:49:16.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:49:16 gibba045 bash[25517]: cephadm 2021-03-10T14:49:15.134766+0000 mgr.gibba045.orlgmj (mgr.34412) 3224 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:49:16.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:49:16 gibba045 bash[25517]: cephadm 2021-03-10T14:49:15.134837+0000 mgr.gibba045.orlgmj (mgr.34412) 3225 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:49:16.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:49:16 gibba045 bash[25517]: cephadm 2021-03-10T14:49:15.136294+0000 mgr.gibba045.orlgmj (mgr.34412) 3226 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:49:16.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:49:16 gibba045 bash[25517]: cephadm 2021-03-10T14:49:15.136758+0000 mgr.gibba045.orlgmj (mgr.34412) 3227 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:49:16.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:49:16 gibba045 bash[25517]: cephadm 2021-03-10T14:49:15.138170+0000 mgr.gibba045.orlgmj (mgr.34412) 3228 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:49:16.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:49:16 gibba045 bash[25517]: cephadm 2021-03-10T14:49:15.138245+0000 mgr.gibba045.orlgmj (mgr.34412) 3229 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:49:16.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:49:16 gibba045 bash[25517]: cephadm 2021-03-10T14:49:15.138402+0000 mgr.gibba045.orlgmj (mgr.34412) 3230 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:49:16.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:49:16 gibba045 bash[25517]: cluster 2021-03-10T14:49:15.537474+0000 mgr.gibba045.orlgmj (mgr.34412) 3231 : cluster [DBG] pgmap v1825: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:18.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:49:18 gibba015 bash[29377]: cluster 2021-03-10T14:49:17.539203+0000 mgr.gibba045.orlgmj (mgr.34412) 3232 : cluster [DBG] pgmap v1826: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:18.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:49:18 gibba015 bash[30343]: cluster 2021-03-10T14:49:17.539203+0000 mgr.gibba045.orlgmj (mgr.34412) 3232 : cluster [DBG] pgmap v1826: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:19.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:49:18 gibba045 bash[25517]: cluster 2021-03-10T14:49:17.539203+0000 mgr.gibba045.orlgmj (mgr.34412) 3232 : cluster [DBG] pgmap v1826: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:20.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:49:20 gibba015 bash[29377]: cluster 2021-03-10T14:49:19.540839+0000 mgr.gibba045.orlgmj (mgr.34412) 3233 : cluster [DBG] pgmap v1827: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:20.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:49:20 gibba015 bash[30343]: cluster 2021-03-10T14:49:19.540839+0000 mgr.gibba045.orlgmj (mgr.34412) 3233 : cluster [DBG] pgmap v1827: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:21.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:49:20 gibba045 bash[25517]: cluster 2021-03-10T14:49:19.540839+0000 mgr.gibba045.orlgmj (mgr.34412) 3233 : cluster [DBG] pgmap v1827: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:22.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:49:22 gibba015 bash[29377]: cluster 2021-03-10T14:49:21.542819+0000 mgr.gibba045.orlgmj (mgr.34412) 3234 : cluster [DBG] pgmap v1828: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:22.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:49:22 gibba015 bash[30343]: cluster 2021-03-10T14:49:21.542819+0000 mgr.gibba045.orlgmj (mgr.34412) 3234 : cluster [DBG] pgmap v1828: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:23.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:49:22 gibba045 bash[25517]: cluster 2021-03-10T14:49:21.542819+0000 mgr.gibba045.orlgmj (mgr.34412) 3234 : cluster [DBG] pgmap v1828: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:24.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:49:24 gibba015 bash[29377]: cluster 2021-03-10T14:49:23.544115+0000 mgr.gibba045.orlgmj (mgr.34412) 3235 : cluster [DBG] pgmap v1829: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:24.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:49:24 gibba015 bash[30343]: cluster 2021-03-10T14:49:23.544115+0000 mgr.gibba045.orlgmj (mgr.34412) 3235 : cluster [DBG] pgmap v1829: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:24.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:49:24 gibba045 bash[25517]: cluster 2021-03-10T14:49:23.544115+0000 mgr.gibba045.orlgmj (mgr.34412) 3235 : cluster [DBG] pgmap v1829: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:26.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:49:26 gibba015 bash[29377]: cluster 2021-03-10T14:49:25.545765+0000 mgr.gibba045.orlgmj (mgr.34412) 3236 : cluster [DBG] pgmap v1830: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:26.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:49:26 gibba015 bash[30343]: cluster 2021-03-10T14:49:25.545765+0000 mgr.gibba045.orlgmj (mgr.34412) 3236 : cluster [DBG] pgmap v1830: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:27.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:49:26 gibba045 bash[25517]: cluster 2021-03-10T14:49:25.545765+0000 mgr.gibba045.orlgmj (mgr.34412) 3236 : cluster [DBG] pgmap v1830: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:28.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:49:28 gibba015 bash[29377]: cluster 2021-03-10T14:49:27.547528+0000 mgr.gibba045.orlgmj (mgr.34412) 3237 : cluster [DBG] pgmap v1831: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:28.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:49:28 gibba015 bash[30343]: cluster 2021-03-10T14:49:27.547528+0000 mgr.gibba045.orlgmj (mgr.34412) 3237 : cluster [DBG] pgmap v1831: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:29.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:49:28 gibba045 bash[25517]: cluster 2021-03-10T14:49:27.547528+0000 mgr.gibba045.orlgmj (mgr.34412) 3237 : cluster [DBG] pgmap v1831: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:30.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:49:30 gibba015 bash[29377]: cluster 2021-03-10T14:49:29.548901+0000 mgr.gibba045.orlgmj (mgr.34412) 3238 : cluster [DBG] pgmap v1832: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:30.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:49:30 gibba015 bash[30343]: cluster 2021-03-10T14:49:29.548901+0000 mgr.gibba045.orlgmj (mgr.34412) 3238 : cluster [DBG] pgmap v1832: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:31.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:49:30 gibba045 bash[25517]: cluster 2021-03-10T14:49:29.548901+0000 mgr.gibba045.orlgmj (mgr.34412) 3238 : cluster [DBG] pgmap v1832: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:31.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:49:31 gibba015 bash[29377]: cephadm 2021-03-10T14:49:30.152875+0000 mgr.gibba045.orlgmj (mgr.34412) 3239 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:49:31.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:49:31 gibba015 bash[30343]: cephadm 2021-03-10T14:49:30.152875+0000 mgr.gibba045.orlgmj (mgr.34412) 3239 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:49:32.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:49:31 gibba045 bash[25517]: cephadm 2021-03-10T14:49:30.152875+0000 mgr.gibba045.orlgmj (mgr.34412) 3239 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:49:32.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:49:32 gibba015 bash[29377]: cluster 2021-03-10T14:49:31.550552+0000 mgr.gibba045.orlgmj (mgr.34412) 3240 : cluster [DBG] pgmap v1833: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:32.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:49:32 gibba015 bash[30343]: cluster 2021-03-10T14:49:31.550552+0000 mgr.gibba045.orlgmj (mgr.34412) 3240 : cluster [DBG] pgmap v1833: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:33.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:49:32 gibba045 bash[25517]: cluster 2021-03-10T14:49:31.550552+0000 mgr.gibba045.orlgmj (mgr.34412) 3240 : cluster [DBG] pgmap v1833: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:33.748 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:49:33.979 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:49:33.979 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (60m) 5m ago 65m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:49:33.980 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (65m) 4m ago 65m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:49:33.980 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (60m) 4m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:49:33.980 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (61m) 4m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:49:33.981 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (59m) 5m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:49:33.981 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (59m) 5m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:49:33.981 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (59m) 4m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:49:33.982 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (59m) 5m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:49:33.982 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (65m) 5m ago 65m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:49:33.982 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (65m) 4m ago 65m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:49:33.983 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (58m) 5m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:49:33.983 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (58m) 5m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:49:33.983 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (57m) 5m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:49:33.984 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (57m) 5m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:49:33.984 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (56m) 4m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:49:33.984 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (56m) 4m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:49:33.984 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (56m) 4m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:49:33.985 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (55m) 4m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:49:33.985 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (65m) 4m ago 65m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:49:33.985 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 4m ago 63m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:49:34.233 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:49:34.233 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:49:34.234 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:49:34.234 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:49:34.234 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:49:34.234 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:49:34.235 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:49:34.235 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:49:34.235 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:49:34.235 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:49:34.235 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:49:34.236 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:49:34.236 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:49:34.236 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:49:34.236 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:49:34.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:49:34 gibba015 bash[29377]: cluster 2021-03-10T14:49:33.551757+0000 mgr.gibba045.orlgmj (mgr.34412) 3241 : cluster [DBG] pgmap v1834: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:34.483 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:49:34 gibba015 bash[29377]: audit 2021-03-10T14:49:33.738221+0000 mgr.gibba045.orlgmj (mgr.34412) 3242 : audit [DBG] from='client.46230 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:49:34.484 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:49:34 gibba015 bash[29377]: audit 2021-03-10T14:49:33.966028+0000 mgr.gibba045.orlgmj (mgr.34412) 3243 : audit [DBG] from='client.46236 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:49:34.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:49:34 gibba015 bash[30343]: cluster 2021-03-10T14:49:33.551757+0000 mgr.gibba045.orlgmj (mgr.34412) 3241 : cluster [DBG] pgmap v1834: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:34.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:49:34 gibba015 bash[30343]: audit 2021-03-10T14:49:33.738221+0000 mgr.gibba045.orlgmj (mgr.34412) 3242 : audit [DBG] from='client.46230 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:49:34.485 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:49:34 gibba015 bash[30343]: audit 2021-03-10T14:49:33.966028+0000 mgr.gibba045.orlgmj (mgr.34412) 3243 : audit [DBG] from='client.46236 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:49:34.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:49:34 gibba045 bash[25517]: cluster 2021-03-10T14:49:33.551757+0000 mgr.gibba045.orlgmj (mgr.34412) 3241 : cluster [DBG] pgmap v1834: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:34.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:49:34 gibba045 bash[25517]: audit 2021-03-10T14:49:33.738221+0000 mgr.gibba045.orlgmj (mgr.34412) 3242 : audit [DBG] from='client.46230 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:49:34.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:49:34 gibba045 bash[25517]: audit 2021-03-10T14:49:33.966028+0000 mgr.gibba045.orlgmj (mgr.34412) 3243 : audit [DBG] from='client.46236 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:49:35.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:49:35 gibba015 bash[29377]: audit 2021-03-10T14:49:34.229637+0000 mon.a (mon.0) 1051 : audit [DBG] from='client.? 172.21.2.115:0/685318165' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:49:35.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:49:35 gibba015 bash[30343]: audit 2021-03-10T14:49:34.229637+0000 mon.a (mon.0) 1051 : audit [DBG] from='client.? 172.21.2.115:0/685318165' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:49:35.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:49:35 gibba045 bash[25517]: audit 2021-03-10T14:49:34.229637+0000 mon.a (mon.0) 1051 : audit [DBG] from='client.? 172.21.2.115:0/685318165' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:49:36.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:49:36 gibba015 bash[29377]: cluster 2021-03-10T14:49:35.553420+0000 mgr.gibba045.orlgmj (mgr.34412) 3244 : cluster [DBG] pgmap v1835: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:36.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:49:36 gibba015 bash[30343]: cluster 2021-03-10T14:49:35.553420+0000 mgr.gibba045.orlgmj (mgr.34412) 3244 : cluster [DBG] pgmap v1835: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:36.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:49:36 gibba045 bash[25517]: cluster 2021-03-10T14:49:35.553420+0000 mgr.gibba045.orlgmj (mgr.34412) 3244 : cluster [DBG] pgmap v1835: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:38.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:49:38 gibba015 bash[29377]: cluster 2021-03-10T14:49:37.555142+0000 mgr.gibba045.orlgmj (mgr.34412) 3245 : cluster [DBG] pgmap v1836: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:38.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:49:38 gibba015 bash[30343]: cluster 2021-03-10T14:49:37.555142+0000 mgr.gibba045.orlgmj (mgr.34412) 3245 : cluster [DBG] pgmap v1836: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:39.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:49:38 gibba045 bash[25517]: cluster 2021-03-10T14:49:37.555142+0000 mgr.gibba045.orlgmj (mgr.34412) 3245 : cluster [DBG] pgmap v1836: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:40.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:49:40 gibba015 bash[29377]: cluster 2021-03-10T14:49:39.556507+0000 mgr.gibba045.orlgmj (mgr.34412) 3246 : cluster [DBG] pgmap v1837: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:40.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:49:40 gibba015 bash[30343]: cluster 2021-03-10T14:49:39.556507+0000 mgr.gibba045.orlgmj (mgr.34412) 3246 : cluster [DBG] pgmap v1837: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:41.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:49:40 gibba045 bash[25517]: cluster 2021-03-10T14:49:39.556507+0000 mgr.gibba045.orlgmj (mgr.34412) 3246 : cluster [DBG] pgmap v1837: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:42.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:49:42 gibba015 bash[29377]: cluster 2021-03-10T14:49:41.558154+0000 mgr.gibba045.orlgmj (mgr.34412) 3247 : cluster [DBG] pgmap v1838: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:42.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:49:42 gibba015 bash[30343]: cluster 2021-03-10T14:49:41.558154+0000 mgr.gibba045.orlgmj (mgr.34412) 3247 : cluster [DBG] pgmap v1838: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:43.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:49:42 gibba045 bash[25517]: cluster 2021-03-10T14:49:41.558154+0000 mgr.gibba045.orlgmj (mgr.34412) 3247 : cluster [DBG] pgmap v1838: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:44.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:49:44 gibba015 bash[29377]: cluster 2021-03-10T14:49:43.559446+0000 mgr.gibba045.orlgmj (mgr.34412) 3248 : cluster [DBG] pgmap v1839: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:44.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:49:44 gibba015 bash[30343]: cluster 2021-03-10T14:49:43.559446+0000 mgr.gibba045.orlgmj (mgr.34412) 3248 : cluster [DBG] pgmap v1839: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:44.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:49:44 gibba045 bash[25517]: cluster 2021-03-10T14:49:43.559446+0000 mgr.gibba045.orlgmj (mgr.34412) 3248 : cluster [DBG] pgmap v1839: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:46.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:49:46 gibba015 bash[29377]: cephadm 2021-03-10T14:49:45.159896+0000 mgr.gibba045.orlgmj (mgr.34412) 3249 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:49:46.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:49:46 gibba015 bash[29377]: cluster 2021-03-10T14:49:45.561009+0000 mgr.gibba045.orlgmj (mgr.34412) 3250 : cluster [DBG] pgmap v1840: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:46.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:49:46 gibba015 bash[30343]: cephadm 2021-03-10T14:49:45.159896+0000 mgr.gibba045.orlgmj (mgr.34412) 3249 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:49:46.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:49:46 gibba015 bash[30343]: cluster 2021-03-10T14:49:45.561009+0000 mgr.gibba045.orlgmj (mgr.34412) 3250 : cluster [DBG] pgmap v1840: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:47.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:49:46 gibba045 bash[25517]: cephadm 2021-03-10T14:49:45.159896+0000 mgr.gibba045.orlgmj (mgr.34412) 3249 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:49:47.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:49:46 gibba045 bash[25517]: cluster 2021-03-10T14:49:45.561009+0000 mgr.gibba045.orlgmj (mgr.34412) 3250 : cluster [DBG] pgmap v1840: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:48.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:49:48 gibba015 bash[29377]: cluster 2021-03-10T14:49:47.562693+0000 mgr.gibba045.orlgmj (mgr.34412) 3251 : cluster [DBG] pgmap v1841: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:48.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:49:48 gibba015 bash[30343]: cluster 2021-03-10T14:49:47.562693+0000 mgr.gibba045.orlgmj (mgr.34412) 3251 : cluster [DBG] pgmap v1841: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:49.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:49:48 gibba045 bash[25517]: cluster 2021-03-10T14:49:47.562693+0000 mgr.gibba045.orlgmj (mgr.34412) 3251 : cluster [DBG] pgmap v1841: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:50.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:49:50 gibba015 bash[29377]: cluster 2021-03-10T14:49:49.564210+0000 mgr.gibba045.orlgmj (mgr.34412) 3252 : cluster [DBG] pgmap v1842: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:50.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:49:50 gibba015 bash[30343]: cluster 2021-03-10T14:49:49.564210+0000 mgr.gibba045.orlgmj (mgr.34412) 3252 : cluster [DBG] pgmap v1842: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:51.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:49:50 gibba045 bash[25517]: cluster 2021-03-10T14:49:49.564210+0000 mgr.gibba045.orlgmj (mgr.34412) 3252 : cluster [DBG] pgmap v1842: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:52.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:49:52 gibba015 bash[29377]: cluster 2021-03-10T14:49:51.565997+0000 mgr.gibba045.orlgmj (mgr.34412) 3253 : cluster [DBG] pgmap v1843: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:52.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:49:52 gibba015 bash[30343]: cluster 2021-03-10T14:49:51.565997+0000 mgr.gibba045.orlgmj (mgr.34412) 3253 : cluster [DBG] pgmap v1843: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:53.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:49:52 gibba045 bash[25517]: cluster 2021-03-10T14:49:51.565997+0000 mgr.gibba045.orlgmj (mgr.34412) 3253 : cluster [DBG] pgmap v1843: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:53.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:49:53 gibba015 bash[29377]: audit 2021-03-10T14:49:52.872697+0000 mon.c (mon.1) 943 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:49:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:49:53 gibba015 bash[29377]: audit 2021-03-10T14:49:52.873790+0000 mon.a (mon.0) 1052 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:49:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:49:53 gibba015 bash[29377]: audit 2021-03-10T14:49:52.874020+0000 mon.c (mon.1) 944 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:49:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:49:53 gibba015 bash[29377]: audit 2021-03-10T14:49:52.875001+0000 mon.a (mon.0) 1053 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:49:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:49:53 gibba015 bash[29377]: audit 2021-03-10T14:49:52.884848+0000 mon.c (mon.1) 945 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T14:49:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:49:53 gibba015 bash[29377]: audit 2021-03-10T14:49:52.885779+0000 mon.c (mon.1) 946 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:49:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:49:53 gibba015 bash[29377]: audit 2021-03-10T14:49:52.886068+0000 mon.a (mon.0) 1054 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T14:49:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:49:53 gibba015 bash[29377]: audit 2021-03-10T14:49:52.886637+0000 mon.c (mon.1) 947 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:49:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:49:53 gibba015 bash[29377]: audit 2021-03-10T14:49:52.887317+0000 mon.a (mon.0) 1055 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:49:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:49:53 gibba015 bash[29377]: audit 2021-03-10T14:49:52.887720+0000 mon.c (mon.1) 948 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:49:53.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:49:53 gibba015 bash[29377]: audit 2021-03-10T14:49:52.888275+0000 mon.a (mon.0) 1056 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:49:53.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:49:53 gibba015 bash[29377]: audit 2021-03-10T14:49:52.889403+0000 mon.a (mon.0) 1057 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:49:53.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:49:53 gibba015 bash[30343]: audit 2021-03-10T14:49:52.872697+0000 mon.c (mon.1) 943 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:49:53.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:49:53 gibba015 bash[30343]: audit 2021-03-10T14:49:52.873790+0000 mon.a (mon.0) 1052 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:49:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:49:53 gibba015 bash[30343]: audit 2021-03-10T14:49:52.874020+0000 mon.c (mon.1) 944 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:49:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:49:53 gibba015 bash[30343]: audit 2021-03-10T14:49:52.875001+0000 mon.a (mon.0) 1053 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:49:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:49:53 gibba015 bash[30343]: audit 2021-03-10T14:49:52.884848+0000 mon.c (mon.1) 945 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T14:49:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:49:53 gibba015 bash[30343]: audit 2021-03-10T14:49:52.885779+0000 mon.c (mon.1) 946 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:49:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:49:53 gibba015 bash[30343]: audit 2021-03-10T14:49:52.886068+0000 mon.a (mon.0) 1054 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T14:49:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:49:53 gibba015 bash[30343]: audit 2021-03-10T14:49:52.886637+0000 mon.c (mon.1) 947 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:49:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:49:53 gibba015 bash[30343]: audit 2021-03-10T14:49:52.887317+0000 mon.a (mon.0) 1055 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:49:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:49:53 gibba015 bash[30343]: audit 2021-03-10T14:49:52.887720+0000 mon.c (mon.1) 948 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:49:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:49:53 gibba015 bash[30343]: audit 2021-03-10T14:49:52.888275+0000 mon.a (mon.0) 1056 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:49:53.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:49:53 gibba015 bash[30343]: audit 2021-03-10T14:49:52.889403+0000 mon.a (mon.0) 1057 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:49:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:49:53 gibba045 bash[25517]: audit 2021-03-10T14:49:52.872697+0000 mon.c (mon.1) 943 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:49:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:49:53 gibba045 bash[25517]: audit 2021-03-10T14:49:52.873790+0000 mon.a (mon.0) 1052 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:49:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:49:53 gibba045 bash[25517]: audit 2021-03-10T14:49:52.874020+0000 mon.c (mon.1) 944 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:49:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:49:53 gibba045 bash[25517]: audit 2021-03-10T14:49:52.875001+0000 mon.a (mon.0) 1053 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:49:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:49:53 gibba045 bash[25517]: audit 2021-03-10T14:49:52.884848+0000 mon.c (mon.1) 945 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T14:49:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:49:53 gibba045 bash[25517]: audit 2021-03-10T14:49:52.885779+0000 mon.c (mon.1) 946 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:49:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:49:53 gibba045 bash[25517]: audit 2021-03-10T14:49:52.886068+0000 mon.a (mon.0) 1054 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T14:49:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:49:53 gibba045 bash[25517]: audit 2021-03-10T14:49:52.886637+0000 mon.c (mon.1) 947 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:49:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:49:53 gibba045 bash[25517]: audit 2021-03-10T14:49:52.887317+0000 mon.a (mon.0) 1055 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:49:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:49:53 gibba045 bash[25517]: audit 2021-03-10T14:49:52.887720+0000 mon.c (mon.1) 948 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:49:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:49:53 gibba045 bash[25517]: audit 2021-03-10T14:49:52.888275+0000 mon.a (mon.0) 1056 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:49:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:49:53 gibba045 bash[25517]: audit 2021-03-10T14:49:52.889403+0000 mon.a (mon.0) 1057 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:49:54.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:49:54 gibba015 bash[29377]: cluster 2021-03-10T14:49:53.567385+0000 mgr.gibba045.orlgmj (mgr.34412) 3254 : cluster [DBG] pgmap v1844: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:54.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:49:54 gibba015 bash[30343]: cluster 2021-03-10T14:49:53.567385+0000 mgr.gibba045.orlgmj (mgr.34412) 3254 : cluster [DBG] pgmap v1844: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:55.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:49:54 gibba045 bash[25517]: cluster 2021-03-10T14:49:53.567385+0000 mgr.gibba045.orlgmj (mgr.34412) 3254 : cluster [DBG] pgmap v1844: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:56.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:49:56 gibba015 bash[29377]: cluster 2021-03-10T14:49:55.569123+0000 mgr.gibba045.orlgmj (mgr.34412) 3255 : cluster [DBG] pgmap v1845: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:56.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:49:56 gibba015 bash[30343]: cluster 2021-03-10T14:49:55.569123+0000 mgr.gibba045.orlgmj (mgr.34412) 3255 : cluster [DBG] pgmap v1845: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:57.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:49:56 gibba045 bash[25517]: cluster 2021-03-10T14:49:55.569123+0000 mgr.gibba045.orlgmj (mgr.34412) 3255 : cluster [DBG] pgmap v1845: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:58.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:49:58 gibba015 bash[29377]: cluster 2021-03-10T14:49:57.570907+0000 mgr.gibba045.orlgmj (mgr.34412) 3256 : cluster [DBG] pgmap v1846: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:58.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:49:58 gibba015 bash[30343]: cluster 2021-03-10T14:49:57.570907+0000 mgr.gibba045.orlgmj (mgr.34412) 3256 : cluster [DBG] pgmap v1846: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:59.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:49:58 gibba045 bash[25517]: cluster 2021-03-10T14:49:57.570907+0000 mgr.gibba045.orlgmj (mgr.34412) 3256 : cluster [DBG] pgmap v1846: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:00.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:50:00 gibba015 bash[29377]: debug 2021-03-10T14:49:59.993+0000 7f21beb4f700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T14:50:00.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:50:00 gibba015 bash[29377]: cluster 2021-03-10T14:49:59.572546+0000 mgr.gibba045.orlgmj (mgr.34412) 3257 : cluster [DBG] pgmap v1847: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:00.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:50:00 gibba015 bash[29377]: cluster 2021-03-10T14:50:00.000207+0000 mon.a (mon.0) 1058 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T14:50:00.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:50:00 gibba015 bash[30343]: cluster 2021-03-10T14:49:59.572546+0000 mgr.gibba045.orlgmj (mgr.34412) 3257 : cluster [DBG] pgmap v1847: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:00.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:50:00 gibba015 bash[30343]: cluster 2021-03-10T14:50:00.000207+0000 mon.a (mon.0) 1058 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T14:50:01.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:50:00 gibba045 bash[25517]: cluster 2021-03-10T14:49:59.572546+0000 mgr.gibba045.orlgmj (mgr.34412) 3257 : cluster [DBG] pgmap v1847: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:01.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:50:00 gibba045 bash[25517]: cluster 2021-03-10T14:50:00.000207+0000 mon.a (mon.0) 1058 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T14:50:01.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:50:01 gibba015 bash[29377]: cephadm 2021-03-10T14:50:00.175434+0000 mgr.gibba045.orlgmj (mgr.34412) 3258 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:50:01.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:50:01 gibba015 bash[30343]: cephadm 2021-03-10T14:50:00.175434+0000 mgr.gibba045.orlgmj (mgr.34412) 3258 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:50:02.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:50:01 gibba045 bash[25517]: cephadm 2021-03-10T14:50:00.175434+0000 mgr.gibba045.orlgmj (mgr.34412) 3258 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:50:02.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:50:02 gibba015 bash[29377]: cluster 2021-03-10T14:50:01.574277+0000 mgr.gibba045.orlgmj (mgr.34412) 3259 : cluster [DBG] pgmap v1848: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:02.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:50:02 gibba015 bash[30343]: cluster 2021-03-10T14:50:01.574277+0000 mgr.gibba045.orlgmj (mgr.34412) 3259 : cluster [DBG] pgmap v1848: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:03.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:50:02 gibba045 bash[25517]: cluster 2021-03-10T14:50:01.574277+0000 mgr.gibba045.orlgmj (mgr.34412) 3259 : cluster [DBG] pgmap v1848: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:04.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:50:04 gibba015 bash[30343]: cluster 2021-03-10T14:50:03.575488+0000 mgr.gibba045.orlgmj (mgr.34412) 3260 : cluster [DBG] pgmap v1849: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:04.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:50:04 gibba015 bash[29377]: cluster 2021-03-10T14:50:03.575488+0000 mgr.gibba045.orlgmj (mgr.34412) 3260 : cluster [DBG] pgmap v1849: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:04.474 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:50:04.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:50:04 gibba045 bash[25517]: cluster 2021-03-10T14:50:03.575488+0000 mgr.gibba045.orlgmj (mgr.34412) 3260 : cluster [DBG] pgmap v1849: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:04.703 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:50:04.704 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (60m) 5m ago 66m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:50:04.704 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (65m) 4m ago 65m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:50:04.704 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (61m) 4m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:50:04.705 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (61m) 4m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:50:04.705 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (60m) 5m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:50:04.705 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (60m) 5m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:50:04.705 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (59m) 4m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:50:04.705 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (60m) 5m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:50:04.706 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (66m) 5m ago 66m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:50:04.706 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (66m) 4m ago 66m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:50:04.706 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (59m) 5m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:50:04.706 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (58m) 5m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:50:04.707 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (58m) 5m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:50:04.707 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (57m) 5m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:50:04.707 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (57m) 4m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:50:04.707 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (56m) 4m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:50:04.707 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (56m) 4m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:50:04.708 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (56m) 4m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:50:04.708 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (65m) 4m ago 66m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:50:04.708 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 4m ago 64m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:50:04.950 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:50:04.950 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:50:04.950 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:50:04.951 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:50:04.951 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:50:04.951 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:50:04.951 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:50:04.951 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:50:04.952 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:50:04.952 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:50:04.952 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:50:04.952 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:50:04.953 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:50:04.953 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:50:04.953 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:50:05.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:50:05 gibba015 bash[29377]: audit 2021-03-10T14:50:04.465144+0000 mgr.gibba045.orlgmj (mgr.34412) 3261 : audit [DBG] from='client.56236 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:50:05.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:50:05 gibba015 bash[29377]: audit 2021-03-10T14:50:04.691792+0000 mgr.gibba045.orlgmj (mgr.34412) 3262 : audit [DBG] from='client.46254 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:50:05.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:50:05 gibba015 bash[29377]: audit 2021-03-10T14:50:04.946315+0000 mon.a (mon.0) 1059 : audit [DBG] from='client.? 172.21.2.115:0/1028302328' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:50:05.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:50:05 gibba015 bash[30343]: audit 2021-03-10T14:50:04.465144+0000 mgr.gibba045.orlgmj (mgr.34412) 3261 : audit [DBG] from='client.56236 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:50:05.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:50:05 gibba015 bash[30343]: audit 2021-03-10T14:50:04.691792+0000 mgr.gibba045.orlgmj (mgr.34412) 3262 : audit [DBG] from='client.46254 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:50:05.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:50:05 gibba015 bash[30343]: audit 2021-03-10T14:50:04.946315+0000 mon.a (mon.0) 1059 : audit [DBG] from='client.? 172.21.2.115:0/1028302328' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:50:05.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:50:05 gibba045 bash[25517]: audit 2021-03-10T14:50:04.465144+0000 mgr.gibba045.orlgmj (mgr.34412) 3261 : audit [DBG] from='client.56236 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:50:05.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:50:05 gibba045 bash[25517]: audit 2021-03-10T14:50:04.691792+0000 mgr.gibba045.orlgmj (mgr.34412) 3262 : audit [DBG] from='client.46254 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:50:05.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:50:05 gibba045 bash[25517]: audit 2021-03-10T14:50:04.946315+0000 mon.a (mon.0) 1059 : audit [DBG] from='client.? 172.21.2.115:0/1028302328' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:50:06.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:50:06 gibba015 bash[29377]: cluster 2021-03-10T14:50:05.577104+0000 mgr.gibba045.orlgmj (mgr.34412) 3263 : cluster [DBG] pgmap v1850: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:06.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:50:06 gibba015 bash[30343]: cluster 2021-03-10T14:50:05.577104+0000 mgr.gibba045.orlgmj (mgr.34412) 3263 : cluster [DBG] pgmap v1850: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:06.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:50:06 gibba045 bash[25517]: cluster 2021-03-10T14:50:05.577104+0000 mgr.gibba045.orlgmj (mgr.34412) 3263 : cluster [DBG] pgmap v1850: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:08.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:50:08 gibba015 bash[29377]: cluster 2021-03-10T14:50:07.578905+0000 mgr.gibba045.orlgmj (mgr.34412) 3264 : cluster [DBG] pgmap v1851: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:08.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:50:08 gibba015 bash[30343]: cluster 2021-03-10T14:50:07.578905+0000 mgr.gibba045.orlgmj (mgr.34412) 3264 : cluster [DBG] pgmap v1851: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:09.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:50:08 gibba045 bash[25517]: cluster 2021-03-10T14:50:07.578905+0000 mgr.gibba045.orlgmj (mgr.34412) 3264 : cluster [DBG] pgmap v1851: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:10.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:50:10 gibba015 bash[29377]: cluster 2021-03-10T14:50:09.580271+0000 mgr.gibba045.orlgmj (mgr.34412) 3265 : cluster [DBG] pgmap v1852: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:10.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:50:10 gibba015 bash[30343]: cluster 2021-03-10T14:50:09.580271+0000 mgr.gibba045.orlgmj (mgr.34412) 3265 : cluster [DBG] pgmap v1852: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:11.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:50:10 gibba045 bash[25517]: cluster 2021-03-10T14:50:09.580271+0000 mgr.gibba045.orlgmj (mgr.34412) 3265 : cluster [DBG] pgmap v1852: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:12.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:50:12 gibba015 bash[29377]: cluster 2021-03-10T14:50:11.581872+0000 mgr.gibba045.orlgmj (mgr.34412) 3266 : cluster [DBG] pgmap v1853: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:12.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:50:12 gibba015 bash[30343]: cluster 2021-03-10T14:50:11.581872+0000 mgr.gibba045.orlgmj (mgr.34412) 3266 : cluster [DBG] pgmap v1853: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:13.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:50:12 gibba045 bash[25517]: cluster 2021-03-10T14:50:11.581872+0000 mgr.gibba045.orlgmj (mgr.34412) 3266 : cluster [DBG] pgmap v1853: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:14.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:50:14 gibba015 bash[29377]: cluster 2021-03-10T14:50:13.583024+0000 mgr.gibba045.orlgmj (mgr.34412) 3267 : cluster [DBG] pgmap v1854: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:14.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:50:14 gibba015 bash[30343]: cluster 2021-03-10T14:50:13.583024+0000 mgr.gibba045.orlgmj (mgr.34412) 3267 : cluster [DBG] pgmap v1854: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:14.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:50:14 gibba045 bash[25517]: cluster 2021-03-10T14:50:13.583024+0000 mgr.gibba045.orlgmj (mgr.34412) 3267 : cluster [DBG] pgmap v1854: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:15.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:50:15 gibba045 bash[25517]: audit 2021-03-10T14:50:15.188434+0000 mon.c (mon.1) 949 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:50:15.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:50:15 gibba015 bash[29377]: audit 2021-03-10T14:50:15.188434+0000 mon.c (mon.1) 949 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:50:15.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:50:15 gibba015 bash[30343]: audit 2021-03-10T14:50:15.188434+0000 mon.c (mon.1) 949 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:50:16.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:50:16 gibba015 bash[29377]: cephadm 2021-03-10T14:50:15.194722+0000 mgr.gibba045.orlgmj (mgr.34412) 3268 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:50:16.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:50:16 gibba015 bash[29377]: cephadm 2021-03-10T14:50:15.195612+0000 mgr.gibba045.orlgmj (mgr.34412) 3269 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:50:16.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:50:16 gibba015 bash[29377]: audit 2021-03-10T14:50:15.400275+0000 mon.a (mon.0) 1060 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:50:16.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:50:16 gibba015 bash[29377]: audit 2021-03-10T14:50:15.404034+0000 mon.c (mon.1) 950 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:50:16.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:50:16 gibba015 bash[29377]: audit 2021-03-10T14:50:15.405986+0000 mon.c (mon.1) 951 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:50:16.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:50:16 gibba015 bash[29377]: cephadm 2021-03-10T14:50:15.406464+0000 mgr.gibba045.orlgmj (mgr.34412) 3270 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:50:16.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:50:16 gibba015 bash[29377]: audit 2021-03-10T14:50:15.407576+0000 mon.c (mon.1) 952 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:50:16.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:50:16 gibba015 bash[29377]: cephadm 2021-03-10T14:50:15.408393+0000 mgr.gibba045.orlgmj (mgr.34412) 3271 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:50:16.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:50:16 gibba015 bash[29377]: audit 2021-03-10T14:50:15.409326+0000 mon.c (mon.1) 953 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:50:16.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:50:16 gibba015 bash[29377]: cephadm 2021-03-10T14:50:15.409995+0000 mgr.gibba045.orlgmj (mgr.34412) 3272 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:50:16.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:50:16 gibba015 bash[29377]: cephadm 2021-03-10T14:50:15.410035+0000 mgr.gibba045.orlgmj (mgr.34412) 3273 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:50:16.729 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:50:16 gibba015 bash[29377]: cephadm 2021-03-10T14:50:15.411954+0000 mgr.gibba045.orlgmj (mgr.34412) 3274 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:50:16.729 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:50:16 gibba015 bash[29377]: cephadm 2021-03-10T14:50:15.411993+0000 mgr.gibba045.orlgmj (mgr.34412) 3275 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:50:16.729 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:50:16 gibba015 bash[29377]: audit 2021-03-10T14:50:15.412953+0000 mon.c (mon.1) 954 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:50:16.730 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:50:16 gibba015 bash[29377]: cephadm 2021-03-10T14:50:15.413402+0000 mgr.gibba045.orlgmj (mgr.34412) 3276 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:50:16.730 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:50:16 gibba015 bash[29377]: audit 2021-03-10T14:50:15.414657+0000 mon.c (mon.1) 955 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:50:16.730 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:50:16 gibba015 bash[29377]: cephadm 2021-03-10T14:50:15.415443+0000 mgr.gibba045.orlgmj (mgr.34412) 3277 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:50:16.731 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:50:16 gibba015 bash[29377]: cephadm 2021-03-10T14:50:15.415482+0000 mgr.gibba045.orlgmj (mgr.34412) 3278 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:50:16.731 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:50:16 gibba015 bash[29377]: cephadm 2021-03-10T14:50:15.417001+0000 mgr.gibba045.orlgmj (mgr.34412) 3279 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:50:16.731 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:50:16 gibba015 bash[29377]: cephadm 2021-03-10T14:50:15.417314+0000 mgr.gibba045.orlgmj (mgr.34412) 3280 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:50:16.731 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:50:16 gibba015 bash[29377]: cephadm 2021-03-10T14:50:15.419055+0000 mgr.gibba045.orlgmj (mgr.34412) 3281 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:50:16.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:50:16 gibba015 bash[30343]: cephadm 2021-03-10T14:50:15.194722+0000 mgr.gibba045.orlgmj (mgr.34412) 3268 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:50:16.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:50:16 gibba015 bash[30343]: cephadm 2021-03-10T14:50:15.195612+0000 mgr.gibba045.orlgmj (mgr.34412) 3269 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:50:16.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:50:16 gibba015 bash[30343]: audit 2021-03-10T14:50:15.400275+0000 mon.a (mon.0) 1060 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:50:16.733 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:50:16 gibba015 bash[30343]: audit 2021-03-10T14:50:15.404034+0000 mon.c (mon.1) 950 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:50:16.733 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:50:16 gibba015 bash[30343]: audit 2021-03-10T14:50:15.405986+0000 mon.c (mon.1) 951 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:50:16.733 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:50:16 gibba015 bash[30343]: cephadm 2021-03-10T14:50:15.406464+0000 mgr.gibba045.orlgmj (mgr.34412) 3270 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:50:16.734 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:50:16 gibba015 bash[30343]: audit 2021-03-10T14:50:15.407576+0000 mon.c (mon.1) 952 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:50:16.734 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:50:16 gibba015 bash[30343]: cephadm 2021-03-10T14:50:15.408393+0000 mgr.gibba045.orlgmj (mgr.34412) 3271 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:50:16.734 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:50:16 gibba015 bash[30343]: audit 2021-03-10T14:50:15.409326+0000 mon.c (mon.1) 953 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:50:16.735 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:50:16 gibba015 bash[30343]: cephadm 2021-03-10T14:50:15.409995+0000 mgr.gibba045.orlgmj (mgr.34412) 3272 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:50:16.735 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:50:16 gibba015 bash[30343]: cephadm 2021-03-10T14:50:15.410035+0000 mgr.gibba045.orlgmj (mgr.34412) 3273 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:50:16.735 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:50:16 gibba015 bash[30343]: cephadm 2021-03-10T14:50:15.411954+0000 mgr.gibba045.orlgmj (mgr.34412) 3274 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:50:16.736 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:50:16 gibba015 bash[30343]: cephadm 2021-03-10T14:50:15.411993+0000 mgr.gibba045.orlgmj (mgr.34412) 3275 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:50:16.736 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:50:16 gibba015 bash[30343]: audit 2021-03-10T14:50:15.412953+0000 mon.c (mon.1) 954 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:50:16.736 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:50:16 gibba015 bash[30343]: cephadm 2021-03-10T14:50:15.413402+0000 mgr.gibba045.orlgmj (mgr.34412) 3276 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:50:16.736 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:50:16 gibba015 bash[30343]: audit 2021-03-10T14:50:15.414657+0000 mon.c (mon.1) 955 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:50:16.737 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:50:16 gibba015 bash[30343]: cephadm 2021-03-10T14:50:15.415443+0000 mgr.gibba045.orlgmj (mgr.34412) 3277 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:50:16.737 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:50:16 gibba015 bash[30343]: cephadm 2021-03-10T14:50:15.415482+0000 mgr.gibba045.orlgmj (mgr.34412) 3278 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:50:16.737 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:50:16 gibba015 bash[30343]: cephadm 2021-03-10T14:50:15.417001+0000 mgr.gibba045.orlgmj (mgr.34412) 3279 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:50:16.738 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:50:16 gibba015 bash[30343]: cephadm 2021-03-10T14:50:15.417314+0000 mgr.gibba045.orlgmj (mgr.34412) 3280 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:50:16.738 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:50:16 gibba015 bash[30343]: cephadm 2021-03-10T14:50:15.419055+0000 mgr.gibba045.orlgmj (mgr.34412) 3281 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:50:16.738 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:50:16 gibba015 bash[30343]: cephadm 2021-03-10T14:50:15.419093+0000 mgr.gibba045.orlgmj (mgr.34412) 3282 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:50:16.738 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:50:16 gibba015 bash[30343]: cephadm 2021-03-10T14:50:15.419197+0000 mgr.gibba045.orlgmj (mgr.34412) 3283 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:50:16.739 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:50:16 gibba015 bash[30343]: cluster 2021-03-10T14:50:15.584620+0000 mgr.gibba045.orlgmj (mgr.34412) 3284 : cluster [DBG] pgmap v1855: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:16.739 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:50:16 gibba015 bash[29377]: cephadm 2021-03-10T14:50:15.419093+0000 mgr.gibba045.orlgmj (mgr.34412) 3282 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:50:16.739 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:50:16 gibba015 bash[29377]: cephadm 2021-03-10T14:50:15.419197+0000 mgr.gibba045.orlgmj (mgr.34412) 3283 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:50:16.739 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:50:16 gibba015 bash[29377]: cluster 2021-03-10T14:50:15.584620+0000 mgr.gibba045.orlgmj (mgr.34412) 3284 : cluster [DBG] pgmap v1855: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:16.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:50:16 gibba045 bash[25517]: cephadm 2021-03-10T14:50:15.194722+0000 mgr.gibba045.orlgmj (mgr.34412) 3268 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:50:16.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:50:16 gibba045 bash[25517]: cephadm 2021-03-10T14:50:15.195612+0000 mgr.gibba045.orlgmj (mgr.34412) 3269 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:50:16.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:50:16 gibba045 bash[25517]: audit 2021-03-10T14:50:15.400275+0000 mon.a (mon.0) 1060 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:50:16.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:50:16 gibba045 bash[25517]: audit 2021-03-10T14:50:15.404034+0000 mon.c (mon.1) 950 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:50:16.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:50:16 gibba045 bash[25517]: audit 2021-03-10T14:50:15.405986+0000 mon.c (mon.1) 951 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:50:16.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:50:16 gibba045 bash[25517]: cephadm 2021-03-10T14:50:15.406464+0000 mgr.gibba045.orlgmj (mgr.34412) 3270 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:50:16.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:50:16 gibba045 bash[25517]: audit 2021-03-10T14:50:15.407576+0000 mon.c (mon.1) 952 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:50:16.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:50:16 gibba045 bash[25517]: cephadm 2021-03-10T14:50:15.408393+0000 mgr.gibba045.orlgmj (mgr.34412) 3271 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:50:16.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:50:16 gibba045 bash[25517]: audit 2021-03-10T14:50:15.409326+0000 mon.c (mon.1) 953 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:50:16.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:50:16 gibba045 bash[25517]: cephadm 2021-03-10T14:50:15.409995+0000 mgr.gibba045.orlgmj (mgr.34412) 3272 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:50:16.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:50:16 gibba045 bash[25517]: cephadm 2021-03-10T14:50:15.410035+0000 mgr.gibba045.orlgmj (mgr.34412) 3273 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:50:16.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:50:16 gibba045 bash[25517]: cephadm 2021-03-10T14:50:15.411954+0000 mgr.gibba045.orlgmj (mgr.34412) 3274 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:50:16.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:50:16 gibba045 bash[25517]: cephadm 2021-03-10T14:50:15.411993+0000 mgr.gibba045.orlgmj (mgr.34412) 3275 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:50:16.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:50:16 gibba045 bash[25517]: audit 2021-03-10T14:50:15.412953+0000 mon.c (mon.1) 954 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:50:16.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:50:16 gibba045 bash[25517]: cephadm 2021-03-10T14:50:15.413402+0000 mgr.gibba045.orlgmj (mgr.34412) 3276 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:50:16.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:50:16 gibba045 bash[25517]: audit 2021-03-10T14:50:15.414657+0000 mon.c (mon.1) 955 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:50:16.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:50:16 gibba045 bash[25517]: cephadm 2021-03-10T14:50:15.415443+0000 mgr.gibba045.orlgmj (mgr.34412) 3277 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:50:16.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:50:16 gibba045 bash[25517]: cephadm 2021-03-10T14:50:15.415482+0000 mgr.gibba045.orlgmj (mgr.34412) 3278 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:50:16.812 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:50:16 gibba045 bash[25517]: cephadm 2021-03-10T14:50:15.417001+0000 mgr.gibba045.orlgmj (mgr.34412) 3279 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:50:16.812 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:50:16 gibba045 bash[25517]: cephadm 2021-03-10T14:50:15.417314+0000 mgr.gibba045.orlgmj (mgr.34412) 3280 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:50:16.812 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:50:16 gibba045 bash[25517]: cephadm 2021-03-10T14:50:15.419055+0000 mgr.gibba045.orlgmj (mgr.34412) 3281 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:50:16.812 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:50:16 gibba045 bash[25517]: cephadm 2021-03-10T14:50:15.419093+0000 mgr.gibba045.orlgmj (mgr.34412) 3282 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:50:16.812 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:50:16 gibba045 bash[25517]: cephadm 2021-03-10T14:50:15.419197+0000 mgr.gibba045.orlgmj (mgr.34412) 3283 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:50:16.813 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:50:16 gibba045 bash[25517]: cluster 2021-03-10T14:50:15.584620+0000 mgr.gibba045.orlgmj (mgr.34412) 3284 : cluster [DBG] pgmap v1855: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:18.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:50:18 gibba015 bash[29377]: cluster 2021-03-10T14:50:17.586399+0000 mgr.gibba045.orlgmj (mgr.34412) 3285 : cluster [DBG] pgmap v1856: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:18.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:50:18 gibba015 bash[30343]: cluster 2021-03-10T14:50:17.586399+0000 mgr.gibba045.orlgmj (mgr.34412) 3285 : cluster [DBG] pgmap v1856: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:19.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:50:18 gibba045 bash[25517]: cluster 2021-03-10T14:50:17.586399+0000 mgr.gibba045.orlgmj (mgr.34412) 3285 : cluster [DBG] pgmap v1856: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:20.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:50:20 gibba015 bash[29377]: cluster 2021-03-10T14:50:19.587834+0000 mgr.gibba045.orlgmj (mgr.34412) 3286 : cluster [DBG] pgmap v1857: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:20.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:50:20 gibba015 bash[30343]: cluster 2021-03-10T14:50:19.587834+0000 mgr.gibba045.orlgmj (mgr.34412) 3286 : cluster [DBG] pgmap v1857: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:21.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:50:20 gibba045 bash[25517]: cluster 2021-03-10T14:50:19.587834+0000 mgr.gibba045.orlgmj (mgr.34412) 3286 : cluster [DBG] pgmap v1857: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:22.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:50:22 gibba015 bash[29377]: cluster 2021-03-10T14:50:21.589795+0000 mgr.gibba045.orlgmj (mgr.34412) 3287 : cluster [DBG] pgmap v1858: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:22.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:50:22 gibba015 bash[30343]: cluster 2021-03-10T14:50:21.589795+0000 mgr.gibba045.orlgmj (mgr.34412) 3287 : cluster [DBG] pgmap v1858: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:23.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:50:22 gibba045 bash[25517]: cluster 2021-03-10T14:50:21.589795+0000 mgr.gibba045.orlgmj (mgr.34412) 3287 : cluster [DBG] pgmap v1858: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:24.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:50:24 gibba015 bash[29377]: cluster 2021-03-10T14:50:23.591121+0000 mgr.gibba045.orlgmj (mgr.34412) 3288 : cluster [DBG] pgmap v1859: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:24.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:50:24 gibba015 bash[30343]: cluster 2021-03-10T14:50:23.591121+0000 mgr.gibba045.orlgmj (mgr.34412) 3288 : cluster [DBG] pgmap v1859: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:24.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:50:24 gibba045 bash[25517]: cluster 2021-03-10T14:50:23.591121+0000 mgr.gibba045.orlgmj (mgr.34412) 3288 : cluster [DBG] pgmap v1859: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:26.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:50:26 gibba015 bash[29377]: cluster 2021-03-10T14:50:25.592700+0000 mgr.gibba045.orlgmj (mgr.34412) 3289 : cluster [DBG] pgmap v1860: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:26.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:50:26 gibba015 bash[30343]: cluster 2021-03-10T14:50:25.592700+0000 mgr.gibba045.orlgmj (mgr.34412) 3289 : cluster [DBG] pgmap v1860: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:27.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:50:26 gibba045 bash[25517]: cluster 2021-03-10T14:50:25.592700+0000 mgr.gibba045.orlgmj (mgr.34412) 3289 : cluster [DBG] pgmap v1860: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:28.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:50:28 gibba015 bash[29377]: cluster 2021-03-10T14:50:27.594498+0000 mgr.gibba045.orlgmj (mgr.34412) 3290 : cluster [DBG] pgmap v1861: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:28.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:50:28 gibba015 bash[30343]: cluster 2021-03-10T14:50:27.594498+0000 mgr.gibba045.orlgmj (mgr.34412) 3290 : cluster [DBG] pgmap v1861: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:29.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:50:28 gibba045 bash[25517]: cluster 2021-03-10T14:50:27.594498+0000 mgr.gibba045.orlgmj (mgr.34412) 3290 : cluster [DBG] pgmap v1861: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:30.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:50:30 gibba045 bash[25517]: cluster 2021-03-10T14:50:29.595797+0000 mgr.gibba045.orlgmj (mgr.34412) 3291 : cluster [DBG] pgmap v1862: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:30.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:50:30 gibba015 bash[29377]: cluster 2021-03-10T14:50:29.595797+0000 mgr.gibba045.orlgmj (mgr.34412) 3291 : cluster [DBG] pgmap v1862: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:30.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:50:30 gibba015 bash[30343]: cluster 2021-03-10T14:50:29.595797+0000 mgr.gibba045.orlgmj (mgr.34412) 3291 : cluster [DBG] pgmap v1862: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:31.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:50:31 gibba015 bash[29377]: cephadm 2021-03-10T14:50:30.435105+0000 mgr.gibba045.orlgmj (mgr.34412) 3292 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:50:31.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:50:31 gibba015 bash[30343]: cephadm 2021-03-10T14:50:30.435105+0000 mgr.gibba045.orlgmj (mgr.34412) 3292 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:50:32.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:50:31 gibba045 bash[25517]: cephadm 2021-03-10T14:50:30.435105+0000 mgr.gibba045.orlgmj (mgr.34412) 3292 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:50:32.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:50:32 gibba015 bash[29377]: cluster 2021-03-10T14:50:31.597684+0000 mgr.gibba045.orlgmj (mgr.34412) 3293 : cluster [DBG] pgmap v1863: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:32.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:50:32 gibba015 bash[30343]: cluster 2021-03-10T14:50:31.597684+0000 mgr.gibba045.orlgmj (mgr.34412) 3293 : cluster [DBG] pgmap v1863: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:33.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:50:32 gibba045 bash[25517]: cluster 2021-03-10T14:50:31.597684+0000 mgr.gibba045.orlgmj (mgr.34412) 3293 : cluster [DBG] pgmap v1863: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:34.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:50:34 gibba015 bash[29377]: cluster 2021-03-10T14:50:33.598977+0000 mgr.gibba045.orlgmj (mgr.34412) 3294 : cluster [DBG] pgmap v1864: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:34.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:50:34 gibba015 bash[30343]: cluster 2021-03-10T14:50:33.598977+0000 mgr.gibba045.orlgmj (mgr.34412) 3294 : cluster [DBG] pgmap v1864: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:34.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:50:34 gibba045 bash[25517]: cluster 2021-03-10T14:50:33.598977+0000 mgr.gibba045.orlgmj (mgr.34412) 3294 : cluster [DBG] pgmap v1864: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:35.196 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:50:35.425 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:50:35.425 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (61m) 6m ago 66m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:50:35.425 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (66m) 5m ago 66m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:50:35.426 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (61m) 5m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:50:35.426 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (62m) 5m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:50:35.426 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (60m) 6m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:50:35.426 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (60m) 6m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:50:35.427 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (60m) 5m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:50:35.427 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (60m) 6m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:50:35.427 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (66m) 6m ago 66m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:50:35.427 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (66m) 5m ago 66m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:50:35.427 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (59m) 6m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:50:35.428 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (59m) 6m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:50:35.428 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (58m) 6m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:50:35.428 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (58m) 6m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:50:35.428 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (57m) 5m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:50:35.428 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (57m) 5m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:50:35.429 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (57m) 5m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:50:35.429 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (56m) 5m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:50:35.429 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (66m) 5m ago 66m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:50:35.429 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 5m ago 64m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:50:35.674 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:50:35.674 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:50:35.674 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:50:35.675 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:50:35.675 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:50:35.675 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:50:35.675 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:50:35.676 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:50:35.676 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:50:35.676 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:50:35.676 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:50:35.676 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:50:35.677 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:50:35.677 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:50:35.677 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:50:36.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:50:36 gibba015 bash[29377]: audit 2021-03-10T14:50:35.186612+0000 mgr.gibba045.orlgmj (mgr.34412) 3295 : audit [DBG] from='client.46266 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:50:36.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:50:36 gibba015 bash[29377]: audit 2021-03-10T14:50:35.412116+0000 mgr.gibba045.orlgmj (mgr.34412) 3296 : audit [DBG] from='client.56260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:50:36.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:50:36 gibba015 bash[29377]: cluster 2021-03-10T14:50:35.600668+0000 mgr.gibba045.orlgmj (mgr.34412) 3297 : cluster [DBG] pgmap v1865: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:36.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:50:36 gibba015 bash[29377]: audit 2021-03-10T14:50:35.670431+0000 mon.a (mon.0) 1061 : audit [DBG] from='client.? 172.21.2.115:0/2984633308' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:50:36.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:50:36 gibba015 bash[30343]: audit 2021-03-10T14:50:35.186612+0000 mgr.gibba045.orlgmj (mgr.34412) 3295 : audit [DBG] from='client.46266 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:50:36.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:50:36 gibba015 bash[30343]: audit 2021-03-10T14:50:35.412116+0000 mgr.gibba045.orlgmj (mgr.34412) 3296 : audit [DBG] from='client.56260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:50:36.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:50:36 gibba015 bash[30343]: cluster 2021-03-10T14:50:35.600668+0000 mgr.gibba045.orlgmj (mgr.34412) 3297 : cluster [DBG] pgmap v1865: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:36.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:50:36 gibba015 bash[30343]: audit 2021-03-10T14:50:35.670431+0000 mon.a (mon.0) 1061 : audit [DBG] from='client.? 172.21.2.115:0/2984633308' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:50:37.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:50:36 gibba045 bash[25517]: audit 2021-03-10T14:50:35.186612+0000 mgr.gibba045.orlgmj (mgr.34412) 3295 : audit [DBG] from='client.46266 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:50:37.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:50:36 gibba045 bash[25517]: audit 2021-03-10T14:50:35.412116+0000 mgr.gibba045.orlgmj (mgr.34412) 3296 : audit [DBG] from='client.56260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:50:37.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:50:36 gibba045 bash[25517]: cluster 2021-03-10T14:50:35.600668+0000 mgr.gibba045.orlgmj (mgr.34412) 3297 : cluster [DBG] pgmap v1865: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:37.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:50:36 gibba045 bash[25517]: audit 2021-03-10T14:50:35.670431+0000 mon.a (mon.0) 1061 : audit [DBG] from='client.? 172.21.2.115:0/2984633308' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:50:38.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:50:38 gibba015 bash[29377]: cluster 2021-03-10T14:50:37.602428+0000 mgr.gibba045.orlgmj (mgr.34412) 3298 : cluster [DBG] pgmap v1866: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:38.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:50:38 gibba015 bash[30343]: cluster 2021-03-10T14:50:37.602428+0000 mgr.gibba045.orlgmj (mgr.34412) 3298 : cluster [DBG] pgmap v1866: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:39.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:50:38 gibba045 bash[25517]: cluster 2021-03-10T14:50:37.602428+0000 mgr.gibba045.orlgmj (mgr.34412) 3298 : cluster [DBG] pgmap v1866: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:40.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:50:40 gibba015 bash[29377]: cluster 2021-03-10T14:50:39.604017+0000 mgr.gibba045.orlgmj (mgr.34412) 3299 : cluster [DBG] pgmap v1867: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:40.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:50:40 gibba015 bash[30343]: cluster 2021-03-10T14:50:39.604017+0000 mgr.gibba045.orlgmj (mgr.34412) 3299 : cluster [DBG] pgmap v1867: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:41.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:50:40 gibba045 bash[25517]: cluster 2021-03-10T14:50:39.604017+0000 mgr.gibba045.orlgmj (mgr.34412) 3299 : cluster [DBG] pgmap v1867: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:42.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:50:42 gibba015 bash[29377]: cluster 2021-03-10T14:50:41.605801+0000 mgr.gibba045.orlgmj (mgr.34412) 3300 : cluster [DBG] pgmap v1868: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:42.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:50:42 gibba015 bash[30343]: cluster 2021-03-10T14:50:41.605801+0000 mgr.gibba045.orlgmj (mgr.34412) 3300 : cluster [DBG] pgmap v1868: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:43.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:50:42 gibba045 bash[25517]: cluster 2021-03-10T14:50:41.605801+0000 mgr.gibba045.orlgmj (mgr.34412) 3300 : cluster [DBG] pgmap v1868: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:44.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:50:44 gibba015 bash[29377]: cluster 2021-03-10T14:50:43.607147+0000 mgr.gibba045.orlgmj (mgr.34412) 3301 : cluster [DBG] pgmap v1869: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:44.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:50:44 gibba015 bash[30343]: cluster 2021-03-10T14:50:43.607147+0000 mgr.gibba045.orlgmj (mgr.34412) 3301 : cluster [DBG] pgmap v1869: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:44.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:50:44 gibba045 bash[25517]: cluster 2021-03-10T14:50:43.607147+0000 mgr.gibba045.orlgmj (mgr.34412) 3301 : cluster [DBG] pgmap v1869: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:46.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:50:46 gibba015 bash[29377]: cephadm 2021-03-10T14:50:45.450794+0000 mgr.gibba045.orlgmj (mgr.34412) 3302 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:50:46.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:50:46 gibba015 bash[29377]: cluster 2021-03-10T14:50:45.608613+0000 mgr.gibba045.orlgmj (mgr.34412) 3303 : cluster [DBG] pgmap v1870: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:46.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:50:46 gibba015 bash[30343]: cephadm 2021-03-10T14:50:45.450794+0000 mgr.gibba045.orlgmj (mgr.34412) 3302 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:50:46.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:50:46 gibba015 bash[30343]: cluster 2021-03-10T14:50:45.608613+0000 mgr.gibba045.orlgmj (mgr.34412) 3303 : cluster [DBG] pgmap v1870: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:47.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:50:46 gibba045 bash[25517]: cephadm 2021-03-10T14:50:45.450794+0000 mgr.gibba045.orlgmj (mgr.34412) 3302 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:50:47.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:50:46 gibba045 bash[25517]: cluster 2021-03-10T14:50:45.608613+0000 mgr.gibba045.orlgmj (mgr.34412) 3303 : cluster [DBG] pgmap v1870: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:48.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:50:48 gibba015 bash[29377]: cluster 2021-03-10T14:50:47.610070+0000 mgr.gibba045.orlgmj (mgr.34412) 3304 : cluster [DBG] pgmap v1871: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:48.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:50:48 gibba015 bash[30343]: cluster 2021-03-10T14:50:47.610070+0000 mgr.gibba045.orlgmj (mgr.34412) 3304 : cluster [DBG] pgmap v1871: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:49.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:50:48 gibba045 bash[25517]: cluster 2021-03-10T14:50:47.610070+0000 mgr.gibba045.orlgmj (mgr.34412) 3304 : cluster [DBG] pgmap v1871: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:50.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:50:50 gibba015 bash[29377]: cluster 2021-03-10T14:50:49.611873+0000 mgr.gibba045.orlgmj (mgr.34412) 3305 : cluster [DBG] pgmap v1872: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:50.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:50:50 gibba015 bash[30343]: cluster 2021-03-10T14:50:49.611873+0000 mgr.gibba045.orlgmj (mgr.34412) 3305 : cluster [DBG] pgmap v1872: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:51.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:50:50 gibba045 bash[25517]: cluster 2021-03-10T14:50:49.611873+0000 mgr.gibba045.orlgmj (mgr.34412) 3305 : cluster [DBG] pgmap v1872: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:52.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:50:52 gibba015 bash[29377]: cluster 2021-03-10T14:50:51.613820+0000 mgr.gibba045.orlgmj (mgr.34412) 3306 : cluster [DBG] pgmap v1873: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:52.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:50:52 gibba015 bash[30343]: cluster 2021-03-10T14:50:51.613820+0000 mgr.gibba045.orlgmj (mgr.34412) 3306 : cluster [DBG] pgmap v1873: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:53.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:50:52 gibba045 bash[25517]: cluster 2021-03-10T14:50:51.613820+0000 mgr.gibba045.orlgmj (mgr.34412) 3306 : cluster [DBG] pgmap v1873: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:53.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:50:53 gibba015 bash[29377]: audit 2021-03-10T14:50:52.879776+0000 mon.c (mon.1) 956 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:50:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:50:53 gibba015 bash[29377]: audit 2021-03-10T14:50:52.880420+0000 mon.c (mon.1) 957 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:50:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:50:53 gibba015 bash[29377]: audit 2021-03-10T14:50:52.880940+0000 mon.a (mon.0) 1062 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:50:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:50:53 gibba015 bash[29377]: audit 2021-03-10T14:50:52.882200+0000 mon.a (mon.0) 1063 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:50:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:50:53 gibba015 bash[29377]: audit 2021-03-10T14:50:52.891340+0000 mon.c (mon.1) 958 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T14:50:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:50:53 gibba015 bash[29377]: audit 2021-03-10T14:50:52.892073+0000 mon.c (mon.1) 959 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:50:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:50:53 gibba015 bash[29377]: audit 2021-03-10T14:50:52.892477+0000 mon.a (mon.0) 1064 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T14:50:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:50:53 gibba015 bash[29377]: audit 2021-03-10T14:50:52.892787+0000 mon.c (mon.1) 960 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:50:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:50:53 gibba015 bash[29377]: audit 2021-03-10T14:50:52.893683+0000 mon.c (mon.1) 961 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:50:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:50:53 gibba015 bash[29377]: audit 2021-03-10T14:50:52.893969+0000 mon.a (mon.0) 1065 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:50:53.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:50:53 gibba015 bash[29377]: audit 2021-03-10T14:50:52.895320+0000 mon.a (mon.0) 1066 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:50:53.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:50:53 gibba015 bash[29377]: audit 2021-03-10T14:50:52.896338+0000 mon.a (mon.0) 1067 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:50:53.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:50:53 gibba015 bash[30343]: audit 2021-03-10T14:50:52.879776+0000 mon.c (mon.1) 956 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:50:53.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:50:53 gibba015 bash[30343]: audit 2021-03-10T14:50:52.880420+0000 mon.c (mon.1) 957 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:50:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:50:53 gibba015 bash[30343]: audit 2021-03-10T14:50:52.880940+0000 mon.a (mon.0) 1062 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:50:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:50:53 gibba015 bash[30343]: audit 2021-03-10T14:50:52.882200+0000 mon.a (mon.0) 1063 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:50:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:50:53 gibba015 bash[30343]: audit 2021-03-10T14:50:52.891340+0000 mon.c (mon.1) 958 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T14:50:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:50:53 gibba015 bash[30343]: audit 2021-03-10T14:50:52.892073+0000 mon.c (mon.1) 959 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:50:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:50:53 gibba015 bash[30343]: audit 2021-03-10T14:50:52.892477+0000 mon.a (mon.0) 1064 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T14:50:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:50:53 gibba015 bash[30343]: audit 2021-03-10T14:50:52.892787+0000 mon.c (mon.1) 960 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:50:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:50:53 gibba015 bash[30343]: audit 2021-03-10T14:50:52.893683+0000 mon.c (mon.1) 961 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:50:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:50:53 gibba015 bash[30343]: audit 2021-03-10T14:50:52.893969+0000 mon.a (mon.0) 1065 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:50:53.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:50:53 gibba015 bash[30343]: audit 2021-03-10T14:50:52.895320+0000 mon.a (mon.0) 1066 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:50:53.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:50:53 gibba015 bash[30343]: audit 2021-03-10T14:50:52.896338+0000 mon.a (mon.0) 1067 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:50:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:50:53 gibba045 bash[25517]: audit 2021-03-10T14:50:52.879776+0000 mon.c (mon.1) 956 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:50:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:50:53 gibba045 bash[25517]: audit 2021-03-10T14:50:52.880420+0000 mon.c (mon.1) 957 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:50:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:50:53 gibba045 bash[25517]: audit 2021-03-10T14:50:52.880940+0000 mon.a (mon.0) 1062 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:50:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:50:53 gibba045 bash[25517]: audit 2021-03-10T14:50:52.882200+0000 mon.a (mon.0) 1063 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:50:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:50:53 gibba045 bash[25517]: audit 2021-03-10T14:50:52.891340+0000 mon.c (mon.1) 958 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T14:50:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:50:53 gibba045 bash[25517]: audit 2021-03-10T14:50:52.892073+0000 mon.c (mon.1) 959 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:50:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:50:53 gibba045 bash[25517]: audit 2021-03-10T14:50:52.892477+0000 mon.a (mon.0) 1064 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T14:50:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:50:53 gibba045 bash[25517]: audit 2021-03-10T14:50:52.892787+0000 mon.c (mon.1) 960 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:50:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:50:53 gibba045 bash[25517]: audit 2021-03-10T14:50:52.893683+0000 mon.c (mon.1) 961 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:50:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:50:53 gibba045 bash[25517]: audit 2021-03-10T14:50:52.893969+0000 mon.a (mon.0) 1065 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:50:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:50:53 gibba045 bash[25517]: audit 2021-03-10T14:50:52.895320+0000 mon.a (mon.0) 1066 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:50:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:50:53 gibba045 bash[25517]: audit 2021-03-10T14:50:52.896338+0000 mon.a (mon.0) 1067 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:50:54.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:50:54 gibba015 bash[29377]: cluster 2021-03-10T14:50:53.615199+0000 mgr.gibba045.orlgmj (mgr.34412) 3307 : cluster [DBG] pgmap v1874: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:54.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:50:54 gibba015 bash[30343]: cluster 2021-03-10T14:50:53.615199+0000 mgr.gibba045.orlgmj (mgr.34412) 3307 : cluster [DBG] pgmap v1874: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:55.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:50:54 gibba045 bash[25517]: cluster 2021-03-10T14:50:53.615199+0000 mgr.gibba045.orlgmj (mgr.34412) 3307 : cluster [DBG] pgmap v1874: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:56.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:50:56 gibba015 bash[29377]: cluster 2021-03-10T14:50:55.616574+0000 mgr.gibba045.orlgmj (mgr.34412) 3308 : cluster [DBG] pgmap v1875: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:56.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:50:56 gibba015 bash[30343]: cluster 2021-03-10T14:50:55.616574+0000 mgr.gibba045.orlgmj (mgr.34412) 3308 : cluster [DBG] pgmap v1875: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:57.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:50:56 gibba045 bash[25517]: cluster 2021-03-10T14:50:55.616574+0000 mgr.gibba045.orlgmj (mgr.34412) 3308 : cluster [DBG] pgmap v1875: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:59.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:50:58 gibba045 bash[25517]: cluster 2021-03-10T14:50:57.618052+0000 mgr.gibba045.orlgmj (mgr.34412) 3309 : cluster [DBG] pgmap v1876: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:59.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:50:58 gibba015 bash[29377]: cluster 2021-03-10T14:50:57.618052+0000 mgr.gibba045.orlgmj (mgr.34412) 3309 : cluster [DBG] pgmap v1876: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:59.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:50:58 gibba015 bash[30343]: cluster 2021-03-10T14:50:57.618052+0000 mgr.gibba045.orlgmj (mgr.34412) 3309 : cluster [DBG] pgmap v1876: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:01.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:51:00 gibba045 bash[25517]: cluster 2021-03-10T14:50:59.619619+0000 mgr.gibba045.orlgmj (mgr.34412) 3310 : cluster [DBG] pgmap v1877: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:01.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:51:00 gibba015 bash[29377]: cluster 2021-03-10T14:50:59.619619+0000 mgr.gibba045.orlgmj (mgr.34412) 3310 : cluster [DBG] pgmap v1877: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:01.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:51:00 gibba015 bash[30343]: cluster 2021-03-10T14:50:59.619619+0000 mgr.gibba045.orlgmj (mgr.34412) 3310 : cluster [DBG] pgmap v1877: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:02.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:51:01 gibba045 bash[25517]: cephadm 2021-03-10T14:51:00.466956+0000 mgr.gibba045.orlgmj (mgr.34412) 3311 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:51:02.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:51:01 gibba015 bash[29377]: cephadm 2021-03-10T14:51:00.466956+0000 mgr.gibba045.orlgmj (mgr.34412) 3311 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:51:02.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:51:01 gibba015 bash[30343]: cephadm 2021-03-10T14:51:00.466956+0000 mgr.gibba045.orlgmj (mgr.34412) 3311 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:51:03.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:51:02 gibba045 bash[25517]: cluster 2021-03-10T14:51:01.621549+0000 mgr.gibba045.orlgmj (mgr.34412) 3312 : cluster [DBG] pgmap v1878: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:03.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:51:02 gibba015 bash[29377]: cluster 2021-03-10T14:51:01.621549+0000 mgr.gibba045.orlgmj (mgr.34412) 3312 : cluster [DBG] pgmap v1878: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:03.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:51:02 gibba015 bash[30343]: cluster 2021-03-10T14:51:01.621549+0000 mgr.gibba045.orlgmj (mgr.34412) 3312 : cluster [DBG] pgmap v1878: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:04.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:51:04 gibba015 bash[29377]: cluster 2021-03-10T14:51:03.622123+0000 mgr.gibba045.orlgmj (mgr.34412) 3313 : cluster [DBG] pgmap v1879: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:04.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:51:04 gibba015 bash[30343]: cluster 2021-03-10T14:51:03.622123+0000 mgr.gibba045.orlgmj (mgr.34412) 3313 : cluster [DBG] pgmap v1879: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:04.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:51:04 gibba045 bash[25517]: cluster 2021-03-10T14:51:03.622123+0000 mgr.gibba045.orlgmj (mgr.34412) 3313 : cluster [DBG] pgmap v1879: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:05.915 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:51:06.140 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:51:06.141 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (61m) 7m ago 67m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:51:06.141 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (66m) 5m ago 66m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:51:06.141 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (62m) 5m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:51:06.141 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (62m) 5m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:51:06.142 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (61m) 7m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:51:06.142 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (61m) 7m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:51:06.142 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (60m) 5m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:51:06.142 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (61m) 7m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:51:06.143 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (67m) 7m ago 67m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:51:06.143 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (67m) 5m ago 67m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:51:06.143 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (60m) 7m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:51:06.143 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (59m) 7m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:51:06.143 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (59m) 7m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:51:06.144 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (58m) 7m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:51:06.144 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (58m) 5m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:51:06.144 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (58m) 5m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:51:06.144 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (57m) 5m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:51:06.144 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (57m) 5m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:51:06.145 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (66m) 5m ago 67m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:51:06.145 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 5m ago 65m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:51:06.388 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:51:06.389 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:51:06.389 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:51:06.389 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:51:06.390 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:51:06.390 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:51:06.390 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:51:06.390 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:51:06.391 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:51:06.391 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:51:06.391 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:51:06.391 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:51:06.392 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:51:06.392 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:51:06.392 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:51:06.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:51:06 gibba015 bash[29377]: cluster 2021-03-10T14:51:05.623323+0000 mgr.gibba045.orlgmj (mgr.34412) 3314 : cluster [DBG] pgmap v1880: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:06.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:51:06 gibba015 bash[29377]: audit 2021-03-10T14:51:05.905308+0000 mgr.gibba045.orlgmj (mgr.34412) 3315 : audit [DBG] from='client.56272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:51:06.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:51:06 gibba015 bash[29377]: audit 2021-03-10T14:51:06.384969+0000 mon.c (mon.1) 962 : audit [DBG] from='client.? 172.21.2.115:0/2307565588' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:51:06.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:51:06 gibba015 bash[30343]: cluster 2021-03-10T14:51:05.623323+0000 mgr.gibba045.orlgmj (mgr.34412) 3314 : cluster [DBG] pgmap v1880: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:06.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:51:06 gibba015 bash[30343]: audit 2021-03-10T14:51:05.905308+0000 mgr.gibba045.orlgmj (mgr.34412) 3315 : audit [DBG] from='client.56272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:51:06.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:51:06 gibba015 bash[30343]: audit 2021-03-10T14:51:06.384969+0000 mon.c (mon.1) 962 : audit [DBG] from='client.? 172.21.2.115:0/2307565588' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:51:07.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:51:06 gibba045 bash[25517]: cluster 2021-03-10T14:51:05.623323+0000 mgr.gibba045.orlgmj (mgr.34412) 3314 : cluster [DBG] pgmap v1880: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:07.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:51:06 gibba045 bash[25517]: audit 2021-03-10T14:51:05.905308+0000 mgr.gibba045.orlgmj (mgr.34412) 3315 : audit [DBG] from='client.56272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:51:07.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:51:06 gibba045 bash[25517]: audit 2021-03-10T14:51:06.384969+0000 mon.c (mon.1) 962 : audit [DBG] from='client.? 172.21.2.115:0/2307565588' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:51:07.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:51:07 gibba015 bash[29377]: audit 2021-03-10T14:51:06.127372+0000 mgr.gibba045.orlgmj (mgr.34412) 3316 : audit [DBG] from='client.56278 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:51:07.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:51:07 gibba015 bash[30343]: audit 2021-03-10T14:51:06.127372+0000 mgr.gibba045.orlgmj (mgr.34412) 3316 : audit [DBG] from='client.56278 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:51:08.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:51:07 gibba045 bash[25517]: audit 2021-03-10T14:51:06.127372+0000 mgr.gibba045.orlgmj (mgr.34412) 3316 : audit [DBG] from='client.56278 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:51:08.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:51:08 gibba015 bash[29377]: cluster 2021-03-10T14:51:07.625102+0000 mgr.gibba045.orlgmj (mgr.34412) 3317 : cluster [DBG] pgmap v1881: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:08.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:51:08 gibba015 bash[30343]: cluster 2021-03-10T14:51:07.625102+0000 mgr.gibba045.orlgmj (mgr.34412) 3317 : cluster [DBG] pgmap v1881: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:09.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:51:08 gibba045 bash[25517]: cluster 2021-03-10T14:51:07.625102+0000 mgr.gibba045.orlgmj (mgr.34412) 3317 : cluster [DBG] pgmap v1881: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:10.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:51:10 gibba015 bash[29377]: cluster 2021-03-10T14:51:09.626485+0000 mgr.gibba045.orlgmj (mgr.34412) 3318 : cluster [DBG] pgmap v1882: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:10.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:51:10 gibba015 bash[30343]: cluster 2021-03-10T14:51:09.626485+0000 mgr.gibba045.orlgmj (mgr.34412) 3318 : cluster [DBG] pgmap v1882: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:11.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:51:10 gibba045 bash[25517]: cluster 2021-03-10T14:51:09.626485+0000 mgr.gibba045.orlgmj (mgr.34412) 3318 : cluster [DBG] pgmap v1882: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:12.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:51:12 gibba015 bash[29377]: cluster 2021-03-10T14:51:11.628214+0000 mgr.gibba045.orlgmj (mgr.34412) 3319 : cluster [DBG] pgmap v1883: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:12.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:51:12 gibba015 bash[30343]: cluster 2021-03-10T14:51:11.628214+0000 mgr.gibba045.orlgmj (mgr.34412) 3319 : cluster [DBG] pgmap v1883: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:13.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:51:12 gibba045 bash[25517]: cluster 2021-03-10T14:51:11.628214+0000 mgr.gibba045.orlgmj (mgr.34412) 3319 : cluster [DBG] pgmap v1883: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:14.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:51:14 gibba015 bash[29377]: cluster 2021-03-10T14:51:13.629486+0000 mgr.gibba045.orlgmj (mgr.34412) 3320 : cluster [DBG] pgmap v1884: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:14.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:51:14 gibba015 bash[30343]: cluster 2021-03-10T14:51:13.629486+0000 mgr.gibba045.orlgmj (mgr.34412) 3320 : cluster [DBG] pgmap v1884: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:14.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:51:14 gibba045 bash[25517]: cluster 2021-03-10T14:51:13.629486+0000 mgr.gibba045.orlgmj (mgr.34412) 3320 : cluster [DBG] pgmap v1884: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:15.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:51:15 gibba045 bash[25517]: audit 2021-03-10T14:51:15.480822+0000 mon.c (mon.1) 963 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:51:15.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:51:15 gibba015 bash[29377]: audit 2021-03-10T14:51:15.480822+0000 mon.c (mon.1) 963 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:51:15.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:51:15 gibba015 bash[30343]: audit 2021-03-10T14:51:15.480822+0000 mon.c (mon.1) 963 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:51:16.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:51:16 gibba015 bash[30343]: cluster 2021-03-10T14:51:15.630080+0000 mgr.gibba045.orlgmj (mgr.34412) 3321 : cluster [DBG] pgmap v1885: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:16.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:51:16 gibba015 bash[30343]: audit 2021-03-10T14:51:15.675874+0000 mon.a (mon.0) 1068 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:51:16.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:51:16 gibba015 bash[30343]: audit 2021-03-10T14:51:15.679139+0000 mon.a (mon.0) 1069 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:51:16.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:51:16 gibba015 bash[30343]: cephadm 2021-03-10T14:51:15.680013+0000 mgr.gibba045.orlgmj (mgr.34412) 3322 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:51:16.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:51:16 gibba015 bash[30343]: cephadm 2021-03-10T14:51:15.683355+0000 mgr.gibba045.orlgmj (mgr.34412) 3323 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:51:16.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:51:16 gibba015 bash[30343]: audit 2021-03-10T14:51:15.881592+0000 mon.a (mon.0) 1070 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:51:16.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:51:16 gibba015 bash[30343]: audit 2021-03-10T14:51:15.885309+0000 mon.c (mon.1) 964 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:51:16.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:51:16 gibba015 bash[30343]: audit 2021-03-10T14:51:15.887163+0000 mon.c (mon.1) 965 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:51:16.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:51:16 gibba015 bash[30343]: cephadm 2021-03-10T14:51:15.887715+0000 mgr.gibba045.orlgmj (mgr.34412) 3324 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:51:16.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:51:16 gibba015 bash[30343]: audit 2021-03-10T14:51:15.888448+0000 mon.c (mon.1) 966 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:51:16.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:51:16 gibba015 bash[30343]: cephadm 2021-03-10T14:51:15.889669+0000 mgr.gibba045.orlgmj (mgr.34412) 3325 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:51:16.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:51:16 gibba015 bash[30343]: audit 2021-03-10T14:51:15.889942+0000 mon.c (mon.1) 967 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:51:16.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:51:16 gibba015 bash[30343]: cephadm 2021-03-10T14:51:15.891164+0000 mgr.gibba045.orlgmj (mgr.34412) 3326 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:51:16.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:51:16 gibba015 bash[30343]: cephadm 2021-03-10T14:51:15.891203+0000 mgr.gibba045.orlgmj (mgr.34412) 3327 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:51:16.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:51:16 gibba015 bash[30343]: cephadm 2021-03-10T14:51:15.892346+0000 mgr.gibba045.orlgmj (mgr.34412) 3328 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:51:16.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:51:16 gibba015 bash[30343]: cephadm 2021-03-10T14:51:15.892406+0000 mgr.gibba045.orlgmj (mgr.34412) 3329 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:51:16.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:51:16 gibba015 bash[30343]: audit 2021-03-10T14:51:15.893117+0000 mon.c (mon.1) 968 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:51:16.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:51:16 gibba015 bash[30343]: cephadm 2021-03-10T14:51:15.894085+0000 mgr.gibba045.orlgmj (mgr.34412) 3330 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:51:16.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:51:16 gibba015 bash[30343]: audit 2021-03-10T14:51:15.894855+0000 mon.c (mon.1) 969 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:51:16.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:51:16 gibba015 bash[30343]: cephadm 2021-03-10T14:51:15.895799+0000 mgr.gibba045.orlgmj (mgr.34412) 3331 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:51:16.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:51:16 gibba015 bash[30343]: cephadm 2021-03-10T14:51:15.895836+0000 mgr.gibba045.orlgmj (mgr.34412) 3332 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:51:16.980 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:51:16 gibba015 bash[29377]: cluster 2021-03-10T14:51:15.630080+0000 mgr.gibba045.orlgmj (mgr.34412) 3321 : cluster [DBG] pgmap v1885: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:16.980 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:51:16 gibba015 bash[29377]: audit 2021-03-10T14:51:15.675874+0000 mon.a (mon.0) 1068 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:51:16.980 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:51:16 gibba015 bash[29377]: audit 2021-03-10T14:51:15.679139+0000 mon.a (mon.0) 1069 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:51:16.980 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:51:16 gibba015 bash[29377]: cephadm 2021-03-10T14:51:15.680013+0000 mgr.gibba045.orlgmj (mgr.34412) 3322 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:51:16.981 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:51:16 gibba015 bash[29377]: cephadm 2021-03-10T14:51:15.683355+0000 mgr.gibba045.orlgmj (mgr.34412) 3323 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:51:16.981 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:51:16 gibba015 bash[29377]: audit 2021-03-10T14:51:15.881592+0000 mon.a (mon.0) 1070 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:51:16.981 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:51:16 gibba015 bash[29377]: audit 2021-03-10T14:51:15.885309+0000 mon.c (mon.1) 964 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:51:16.981 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:51:16 gibba015 bash[29377]: audit 2021-03-10T14:51:15.887163+0000 mon.c (mon.1) 965 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:51:16.981 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:51:16 gibba015 bash[29377]: cephadm 2021-03-10T14:51:15.887715+0000 mgr.gibba045.orlgmj (mgr.34412) 3324 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:51:16.982 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:51:16 gibba015 bash[29377]: audit 2021-03-10T14:51:15.888448+0000 mon.c (mon.1) 966 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:51:16.982 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:51:16 gibba015 bash[29377]: cephadm 2021-03-10T14:51:15.889669+0000 mgr.gibba045.orlgmj (mgr.34412) 3325 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:51:16.982 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:51:16 gibba015 bash[29377]: audit 2021-03-10T14:51:15.889942+0000 mon.c (mon.1) 967 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:51:16.982 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:51:16 gibba015 bash[29377]: cephadm 2021-03-10T14:51:15.891164+0000 mgr.gibba045.orlgmj (mgr.34412) 3326 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:51:16.983 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:51:16 gibba015 bash[29377]: cephadm 2021-03-10T14:51:15.891203+0000 mgr.gibba045.orlgmj (mgr.34412) 3327 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:51:16.983 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:51:16 gibba015 bash[29377]: cephadm 2021-03-10T14:51:15.892346+0000 mgr.gibba045.orlgmj (mgr.34412) 3328 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:51:16.983 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:51:16 gibba015 bash[29377]: cephadm 2021-03-10T14:51:15.892406+0000 mgr.gibba045.orlgmj (mgr.34412) 3329 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:51:16.983 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:51:16 gibba015 bash[29377]: audit 2021-03-10T14:51:15.893117+0000 mon.c (mon.1) 968 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:51:16.983 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:51:16 gibba015 bash[29377]: cephadm 2021-03-10T14:51:15.894085+0000 mgr.gibba045.orlgmj (mgr.34412) 3330 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:51:16.984 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:51:16 gibba015 bash[29377]: audit 2021-03-10T14:51:15.894855+0000 mon.c (mon.1) 969 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:51:16.984 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:51:16 gibba015 bash[29377]: cephadm 2021-03-10T14:51:15.895799+0000 mgr.gibba045.orlgmj (mgr.34412) 3331 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:51:16.984 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:51:16 gibba015 bash[29377]: cephadm 2021-03-10T14:51:15.895836+0000 mgr.gibba045.orlgmj (mgr.34412) 3332 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:51:16.984 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:51:16 gibba015 bash[29377]: cephadm 2021-03-10T14:51:15.897298+0000 mgr.gibba045.orlgmj (mgr.34412) 3333 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:51:16.985 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:51:16 gibba015 bash[29377]: cephadm 2021-03-10T14:51:15.897619+0000 mgr.gibba045.orlgmj (mgr.34412) 3334 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:51:16.985 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:51:16 gibba015 bash[29377]: cephadm 2021-03-10T14:51:15.899118+0000 mgr.gibba045.orlgmj (mgr.34412) 3335 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:51:16.985 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:51:16 gibba015 bash[29377]: cephadm 2021-03-10T14:51:15.899158+0000 mgr.gibba045.orlgmj (mgr.34412) 3336 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:51:16.985 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:51:16 gibba015 bash[29377]: cephadm 2021-03-10T14:51:15.899266+0000 mgr.gibba045.orlgmj (mgr.34412) 3337 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:51:16.986 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:51:16 gibba015 bash[30343]: cephadm 2021-03-10T14:51:15.897298+0000 mgr.gibba045.orlgmj (mgr.34412) 3333 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:51:16.986 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:51:16 gibba015 bash[30343]: cephadm 2021-03-10T14:51:15.897619+0000 mgr.gibba045.orlgmj (mgr.34412) 3334 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:51:16.986 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:51:16 gibba015 bash[30343]: cephadm 2021-03-10T14:51:15.899118+0000 mgr.gibba045.orlgmj (mgr.34412) 3335 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:51:16.986 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:51:16 gibba015 bash[30343]: cephadm 2021-03-10T14:51:15.899158+0000 mgr.gibba045.orlgmj (mgr.34412) 3336 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:51:16.987 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:51:16 gibba015 bash[30343]: cephadm 2021-03-10T14:51:15.899266+0000 mgr.gibba045.orlgmj (mgr.34412) 3337 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:51:17.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:51:16 gibba045 bash[25517]: cluster 2021-03-10T14:51:15.630080+0000 mgr.gibba045.orlgmj (mgr.34412) 3321 : cluster [DBG] pgmap v1885: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:17.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:51:16 gibba045 bash[25517]: audit 2021-03-10T14:51:15.675874+0000 mon.a (mon.0) 1068 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:51:17.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:51:16 gibba045 bash[25517]: audit 2021-03-10T14:51:15.679139+0000 mon.a (mon.0) 1069 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:51:17.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:51:16 gibba045 bash[25517]: cephadm 2021-03-10T14:51:15.680013+0000 mgr.gibba045.orlgmj (mgr.34412) 3322 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:51:17.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:51:16 gibba045 bash[25517]: cephadm 2021-03-10T14:51:15.683355+0000 mgr.gibba045.orlgmj (mgr.34412) 3323 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:51:17.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:51:16 gibba045 bash[25517]: audit 2021-03-10T14:51:15.881592+0000 mon.a (mon.0) 1070 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:51:17.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:51:16 gibba045 bash[25517]: audit 2021-03-10T14:51:15.885309+0000 mon.c (mon.1) 964 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:51:17.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:51:16 gibba045 bash[25517]: audit 2021-03-10T14:51:15.887163+0000 mon.c (mon.1) 965 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:51:17.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:51:16 gibba045 bash[25517]: cephadm 2021-03-10T14:51:15.887715+0000 mgr.gibba045.orlgmj (mgr.34412) 3324 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:51:17.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:51:16 gibba045 bash[25517]: audit 2021-03-10T14:51:15.888448+0000 mon.c (mon.1) 966 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:51:17.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:51:16 gibba045 bash[25517]: cephadm 2021-03-10T14:51:15.889669+0000 mgr.gibba045.orlgmj (mgr.34412) 3325 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:51:17.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:51:16 gibba045 bash[25517]: audit 2021-03-10T14:51:15.889942+0000 mon.c (mon.1) 967 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:51:17.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:51:16 gibba045 bash[25517]: cephadm 2021-03-10T14:51:15.891164+0000 mgr.gibba045.orlgmj (mgr.34412) 3326 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:51:17.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:51:16 gibba045 bash[25517]: cephadm 2021-03-10T14:51:15.891203+0000 mgr.gibba045.orlgmj (mgr.34412) 3327 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:51:17.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:51:16 gibba045 bash[25517]: cephadm 2021-03-10T14:51:15.892346+0000 mgr.gibba045.orlgmj (mgr.34412) 3328 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:51:17.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:51:16 gibba045 bash[25517]: cephadm 2021-03-10T14:51:15.892406+0000 mgr.gibba045.orlgmj (mgr.34412) 3329 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:51:17.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:51:16 gibba045 bash[25517]: audit 2021-03-10T14:51:15.893117+0000 mon.c (mon.1) 968 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:51:17.062 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:51:16 gibba045 bash[25517]: cephadm 2021-03-10T14:51:15.894085+0000 mgr.gibba045.orlgmj (mgr.34412) 3330 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:51:17.062 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:51:16 gibba045 bash[25517]: audit 2021-03-10T14:51:15.894855+0000 mon.c (mon.1) 969 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:51:17.062 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:51:16 gibba045 bash[25517]: cephadm 2021-03-10T14:51:15.895799+0000 mgr.gibba045.orlgmj (mgr.34412) 3331 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:51:17.062 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:51:16 gibba045 bash[25517]: cephadm 2021-03-10T14:51:15.895836+0000 mgr.gibba045.orlgmj (mgr.34412) 3332 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:51:17.063 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:51:16 gibba045 bash[25517]: cephadm 2021-03-10T14:51:15.897298+0000 mgr.gibba045.orlgmj (mgr.34412) 3333 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:51:17.063 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:51:16 gibba045 bash[25517]: cephadm 2021-03-10T14:51:15.897619+0000 mgr.gibba045.orlgmj (mgr.34412) 3334 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:51:17.063 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:51:16 gibba045 bash[25517]: cephadm 2021-03-10T14:51:15.899118+0000 mgr.gibba045.orlgmj (mgr.34412) 3335 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:51:17.063 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:51:16 gibba045 bash[25517]: cephadm 2021-03-10T14:51:15.899158+0000 mgr.gibba045.orlgmj (mgr.34412) 3336 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:51:17.064 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:51:16 gibba045 bash[25517]: cephadm 2021-03-10T14:51:15.899266+0000 mgr.gibba045.orlgmj (mgr.34412) 3337 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:51:18.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:51:18 gibba015 bash[29377]: cluster 2021-03-10T14:51:17.631747+0000 mgr.gibba045.orlgmj (mgr.34412) 3338 : cluster [DBG] pgmap v1886: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:18.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:51:18 gibba015 bash[30343]: cluster 2021-03-10T14:51:17.631747+0000 mgr.gibba045.orlgmj (mgr.34412) 3338 : cluster [DBG] pgmap v1886: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:19.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:51:18 gibba045 bash[25517]: cluster 2021-03-10T14:51:17.631747+0000 mgr.gibba045.orlgmj (mgr.34412) 3338 : cluster [DBG] pgmap v1886: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:20.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:51:20 gibba015 bash[29377]: cluster 2021-03-10T14:51:19.632626+0000 mgr.gibba045.orlgmj (mgr.34412) 3339 : cluster [DBG] pgmap v1887: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:20.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:51:20 gibba015 bash[30343]: cluster 2021-03-10T14:51:19.632626+0000 mgr.gibba045.orlgmj (mgr.34412) 3339 : cluster [DBG] pgmap v1887: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:21.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:51:20 gibba045 bash[25517]: cluster 2021-03-10T14:51:19.632626+0000 mgr.gibba045.orlgmj (mgr.34412) 3339 : cluster [DBG] pgmap v1887: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:22.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:51:22 gibba015 bash[29377]: cluster 2021-03-10T14:51:21.633113+0000 mgr.gibba045.orlgmj (mgr.34412) 3340 : cluster [DBG] pgmap v1888: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:22.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:51:22 gibba015 bash[30343]: cluster 2021-03-10T14:51:21.633113+0000 mgr.gibba045.orlgmj (mgr.34412) 3340 : cluster [DBG] pgmap v1888: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:23.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:51:22 gibba045 bash[25517]: cluster 2021-03-10T14:51:21.633113+0000 mgr.gibba045.orlgmj (mgr.34412) 3340 : cluster [DBG] pgmap v1888: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:24.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:51:24 gibba015 bash[29377]: cluster 2021-03-10T14:51:23.634283+0000 mgr.gibba045.orlgmj (mgr.34412) 3341 : cluster [DBG] pgmap v1889: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:24.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:51:24 gibba015 bash[30343]: cluster 2021-03-10T14:51:23.634283+0000 mgr.gibba045.orlgmj (mgr.34412) 3341 : cluster [DBG] pgmap v1889: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:24.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:51:24 gibba045 bash[25517]: cluster 2021-03-10T14:51:23.634283+0000 mgr.gibba045.orlgmj (mgr.34412) 3341 : cluster [DBG] pgmap v1889: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:26.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:51:26 gibba015 bash[29377]: cluster 2021-03-10T14:51:25.635660+0000 mgr.gibba045.orlgmj (mgr.34412) 3342 : cluster [DBG] pgmap v1890: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:26.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:51:26 gibba015 bash[30343]: cluster 2021-03-10T14:51:25.635660+0000 mgr.gibba045.orlgmj (mgr.34412) 3342 : cluster [DBG] pgmap v1890: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:27.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:51:26 gibba045 bash[25517]: cluster 2021-03-10T14:51:25.635660+0000 mgr.gibba045.orlgmj (mgr.34412) 3342 : cluster [DBG] pgmap v1890: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:28.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:51:28 gibba015 bash[29377]: cluster 2021-03-10T14:51:27.637319+0000 mgr.gibba045.orlgmj (mgr.34412) 3343 : cluster [DBG] pgmap v1891: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:28.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:51:28 gibba015 bash[30343]: cluster 2021-03-10T14:51:27.637319+0000 mgr.gibba045.orlgmj (mgr.34412) 3343 : cluster [DBG] pgmap v1891: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:29.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:51:28 gibba045 bash[25517]: cluster 2021-03-10T14:51:27.637319+0000 mgr.gibba045.orlgmj (mgr.34412) 3343 : cluster [DBG] pgmap v1891: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:30.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:51:30 gibba015 bash[29377]: cluster 2021-03-10T14:51:29.637813+0000 mgr.gibba045.orlgmj (mgr.34412) 3344 : cluster [DBG] pgmap v1892: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:30.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:51:30 gibba015 bash[30343]: cluster 2021-03-10T14:51:29.637813+0000 mgr.gibba045.orlgmj (mgr.34412) 3344 : cluster [DBG] pgmap v1892: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:31.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:51:30 gibba045 bash[25517]: cluster 2021-03-10T14:51:29.637813+0000 mgr.gibba045.orlgmj (mgr.34412) 3344 : cluster [DBG] pgmap v1892: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:32.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:51:31 gibba045 bash[25517]: cephadm 2021-03-10T14:51:30.905742+0000 mgr.gibba045.orlgmj (mgr.34412) 3345 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:51:32.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:51:31 gibba015 bash[29377]: cephadm 2021-03-10T14:51:30.905742+0000 mgr.gibba045.orlgmj (mgr.34412) 3345 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:51:32.259 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:51:31 gibba015 bash[30343]: cephadm 2021-03-10T14:51:30.905742+0000 mgr.gibba045.orlgmj (mgr.34412) 3345 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:51:33.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:51:32 gibba045 bash[25517]: cluster 2021-03-10T14:51:31.639583+0000 mgr.gibba045.orlgmj (mgr.34412) 3346 : cluster [DBG] pgmap v1893: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:33.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:51:32 gibba015 bash[29377]: cluster 2021-03-10T14:51:31.639583+0000 mgr.gibba045.orlgmj (mgr.34412) 3346 : cluster [DBG] pgmap v1893: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:33.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:51:32 gibba015 bash[30343]: cluster 2021-03-10T14:51:31.639583+0000 mgr.gibba045.orlgmj (mgr.34412) 3346 : cluster [DBG] pgmap v1893: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:34.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:51:34 gibba015 bash[29377]: cluster 2021-03-10T14:51:33.640839+0000 mgr.gibba045.orlgmj (mgr.34412) 3347 : cluster [DBG] pgmap v1894: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:34.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:51:34 gibba015 bash[30343]: cluster 2021-03-10T14:51:33.640839+0000 mgr.gibba045.orlgmj (mgr.34412) 3347 : cluster [DBG] pgmap v1894: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:34.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:51:34 gibba045 bash[25517]: cluster 2021-03-10T14:51:33.640839+0000 mgr.gibba045.orlgmj (mgr.34412) 3347 : cluster [DBG] pgmap v1894: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:36.633 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:51:36.861 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:51:36.862 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (62m) 7m ago 67m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:51:36.862 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (67m) 6m ago 67m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:51:36.862 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (62m) 6m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:51:36.862 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (63m) 6m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:51:36.862 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (62m) 7m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:51:36.863 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (61m) 7m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:51:36.863 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (61m) 6m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:51:36.863 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (61m) 7m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:51:36.863 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (67m) 7m ago 67m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:51:36.863 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (67m) 6m ago 67m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:51:36.864 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (60m) 7m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:51:36.864 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (60m) 7m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:51:36.864 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (59m) 7m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:51:36.864 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (59m) 7m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:51:36.864 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (58m) 6m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:51:36.865 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (58m) 6m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:51:36.865 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (58m) 6m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:51:36.865 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (57m) 6m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:51:36.865 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (67m) 6m ago 67m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:51:36.865 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 6m ago 65m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:51:36.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:51:36 gibba015 bash[29377]: cluster 2021-03-10T14:51:35.642468+0000 mgr.gibba045.orlgmj (mgr.34412) 3348 : cluster [DBG] pgmap v1895: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:36.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:51:36 gibba015 bash[30343]: cluster 2021-03-10T14:51:35.642468+0000 mgr.gibba045.orlgmj (mgr.34412) 3348 : cluster [DBG] pgmap v1895: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:37.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:51:36 gibba045 bash[25517]: cluster 2021-03-10T14:51:35.642468+0000 mgr.gibba045.orlgmj (mgr.34412) 3348 : cluster [DBG] pgmap v1895: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:37.115 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:51:37.115 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:51:37.115 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:51:37.115 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:51:37.115 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:51:37.116 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:51:37.116 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:51:37.116 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:51:37.116 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:51:37.116 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:51:37.117 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:51:37.117 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:51:37.117 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:51:37.117 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:51:37.117 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:51:37.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:51:37 gibba015 bash[29377]: audit 2021-03-10T14:51:36.623385+0000 mgr.gibba045.orlgmj (mgr.34412) 3349 : audit [DBG] from='client.46302 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:51:37.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:51:37 gibba015 bash[29377]: audit 2021-03-10T14:51:36.849063+0000 mgr.gibba045.orlgmj (mgr.34412) 3350 : audit [DBG] from='client.46308 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:51:37.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:51:37 gibba015 bash[29377]: audit 2021-03-10T14:51:37.111247+0000 mon.a (mon.0) 1071 : audit [DBG] from='client.? 172.21.2.115:0/2374001955' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:51:37.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:51:37 gibba015 bash[30343]: audit 2021-03-10T14:51:36.623385+0000 mgr.gibba045.orlgmj (mgr.34412) 3349 : audit [DBG] from='client.46302 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:51:37.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:51:37 gibba015 bash[30343]: audit 2021-03-10T14:51:36.849063+0000 mgr.gibba045.orlgmj (mgr.34412) 3350 : audit [DBG] from='client.46308 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:51:37.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:51:37 gibba015 bash[30343]: audit 2021-03-10T14:51:37.111247+0000 mon.a (mon.0) 1071 : audit [DBG] from='client.? 172.21.2.115:0/2374001955' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:51:38.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:51:37 gibba045 bash[25517]: audit 2021-03-10T14:51:36.623385+0000 mgr.gibba045.orlgmj (mgr.34412) 3349 : audit [DBG] from='client.46302 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:51:38.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:51:37 gibba045 bash[25517]: audit 2021-03-10T14:51:36.849063+0000 mgr.gibba045.orlgmj (mgr.34412) 3350 : audit [DBG] from='client.46308 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:51:38.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:51:37 gibba045 bash[25517]: audit 2021-03-10T14:51:37.111247+0000 mon.a (mon.0) 1071 : audit [DBG] from='client.? 172.21.2.115:0/2374001955' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:51:38.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:51:38 gibba015 bash[29377]: cluster 2021-03-10T14:51:37.644083+0000 mgr.gibba045.orlgmj (mgr.34412) 3351 : cluster [DBG] pgmap v1896: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:38.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:51:38 gibba015 bash[30343]: cluster 2021-03-10T14:51:37.644083+0000 mgr.gibba045.orlgmj (mgr.34412) 3351 : cluster [DBG] pgmap v1896: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:39.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:51:38 gibba045 bash[25517]: cluster 2021-03-10T14:51:37.644083+0000 mgr.gibba045.orlgmj (mgr.34412) 3351 : cluster [DBG] pgmap v1896: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:41.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:51:40 gibba045 bash[25517]: cluster 2021-03-10T14:51:39.644887+0000 mgr.gibba045.orlgmj (mgr.34412) 3352 : cluster [DBG] pgmap v1897: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:41.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:51:40 gibba015 bash[29377]: cluster 2021-03-10T14:51:39.644887+0000 mgr.gibba045.orlgmj (mgr.34412) 3352 : cluster [DBG] pgmap v1897: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:41.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:51:40 gibba015 bash[30343]: cluster 2021-03-10T14:51:39.644887+0000 mgr.gibba045.orlgmj (mgr.34412) 3352 : cluster [DBG] pgmap v1897: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:43.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:51:42 gibba045 bash[25517]: cluster 2021-03-10T14:51:41.646614+0000 mgr.gibba045.orlgmj (mgr.34412) 3353 : cluster [DBG] pgmap v1898: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:43.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:51:42 gibba015 bash[29377]: cluster 2021-03-10T14:51:41.646614+0000 mgr.gibba045.orlgmj (mgr.34412) 3353 : cluster [DBG] pgmap v1898: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:43.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:51:42 gibba015 bash[30343]: cluster 2021-03-10T14:51:41.646614+0000 mgr.gibba045.orlgmj (mgr.34412) 3353 : cluster [DBG] pgmap v1898: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:44.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:51:44 gibba015 bash[29377]: cluster 2021-03-10T14:51:43.647813+0000 mgr.gibba045.orlgmj (mgr.34412) 3354 : cluster [DBG] pgmap v1899: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:44.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:51:44 gibba015 bash[30343]: cluster 2021-03-10T14:51:43.647813+0000 mgr.gibba045.orlgmj (mgr.34412) 3354 : cluster [DBG] pgmap v1899: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:44.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:51:44 gibba045 bash[25517]: cluster 2021-03-10T14:51:43.647813+0000 mgr.gibba045.orlgmj (mgr.34412) 3354 : cluster [DBG] pgmap v1899: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:46.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:51:46 gibba015 bash[29377]: cluster 2021-03-10T14:51:45.649411+0000 mgr.gibba045.orlgmj (mgr.34412) 3355 : cluster [DBG] pgmap v1900: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:46.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:51:46 gibba015 bash[29377]: cephadm 2021-03-10T14:51:45.908011+0000 mgr.gibba045.orlgmj (mgr.34412) 3356 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:51:46.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:51:46 gibba015 bash[30343]: cluster 2021-03-10T14:51:45.649411+0000 mgr.gibba045.orlgmj (mgr.34412) 3355 : cluster [DBG] pgmap v1900: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:46.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:51:46 gibba015 bash[30343]: cephadm 2021-03-10T14:51:45.908011+0000 mgr.gibba045.orlgmj (mgr.34412) 3356 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:51:47.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:51:46 gibba045 bash[25517]: cluster 2021-03-10T14:51:45.649411+0000 mgr.gibba045.orlgmj (mgr.34412) 3355 : cluster [DBG] pgmap v1900: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:47.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:51:46 gibba045 bash[25517]: cephadm 2021-03-10T14:51:45.908011+0000 mgr.gibba045.orlgmj (mgr.34412) 3356 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:51:48.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:51:48 gibba015 bash[29377]: cluster 2021-03-10T14:51:47.651165+0000 mgr.gibba045.orlgmj (mgr.34412) 3357 : cluster [DBG] pgmap v1901: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:48.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:51:48 gibba015 bash[30343]: cluster 2021-03-10T14:51:47.651165+0000 mgr.gibba045.orlgmj (mgr.34412) 3357 : cluster [DBG] pgmap v1901: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:49.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:51:48 gibba045 bash[25517]: cluster 2021-03-10T14:51:47.651165+0000 mgr.gibba045.orlgmj (mgr.34412) 3357 : cluster [DBG] pgmap v1901: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:51.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:51:50 gibba045 bash[25517]: cluster 2021-03-10T14:51:49.652884+0000 mgr.gibba045.orlgmj (mgr.34412) 3358 : cluster [DBG] pgmap v1902: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:51.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:51:50 gibba015 bash[29377]: cluster 2021-03-10T14:51:49.652884+0000 mgr.gibba045.orlgmj (mgr.34412) 3358 : cluster [DBG] pgmap v1902: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:51.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:51:50 gibba015 bash[30343]: cluster 2021-03-10T14:51:49.652884+0000 mgr.gibba045.orlgmj (mgr.34412) 3358 : cluster [DBG] pgmap v1902: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:53.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:51:52 gibba045 bash[25517]: cluster 2021-03-10T14:51:51.654770+0000 mgr.gibba045.orlgmj (mgr.34412) 3359 : cluster [DBG] pgmap v1903: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:53.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:51:52 gibba015 bash[29377]: cluster 2021-03-10T14:51:51.654770+0000 mgr.gibba045.orlgmj (mgr.34412) 3359 : cluster [DBG] pgmap v1903: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:53.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:51:52 gibba015 bash[30343]: cluster 2021-03-10T14:51:51.654770+0000 mgr.gibba045.orlgmj (mgr.34412) 3359 : cluster [DBG] pgmap v1903: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:51:53 gibba045 bash[25517]: audit 2021-03-10T14:51:52.886023+0000 mon.c (mon.1) 970 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:51:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:51:53 gibba045 bash[25517]: audit 2021-03-10T14:51:52.886700+0000 mon.c (mon.1) 971 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:51:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:51:53 gibba045 bash[25517]: audit 2021-03-10T14:51:52.887140+0000 mon.a (mon.0) 1072 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:51:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:51:53 gibba045 bash[25517]: audit 2021-03-10T14:51:52.888359+0000 mon.a (mon.0) 1073 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:51:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:51:53 gibba045 bash[25517]: audit 2021-03-10T14:51:52.896664+0000 mon.c (mon.1) 972 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T14:51:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:51:53 gibba045 bash[25517]: audit 2021-03-10T14:51:52.897396+0000 mon.c (mon.1) 973 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:51:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:51:53 gibba045 bash[25517]: audit 2021-03-10T14:51:52.897792+0000 mon.a (mon.0) 1074 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T14:51:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:51:53 gibba045 bash[25517]: audit 2021-03-10T14:51:52.898083+0000 mon.c (mon.1) 974 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:51:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:51:53 gibba045 bash[25517]: audit 2021-03-10T14:51:52.898948+0000 mon.c (mon.1) 975 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:51:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:51:53 gibba045 bash[25517]: audit 2021-03-10T14:51:52.899389+0000 mon.a (mon.0) 1075 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:51:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:51:53 gibba045 bash[25517]: audit 2021-03-10T14:51:52.900697+0000 mon.a (mon.0) 1076 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:51:54.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:51:53 gibba045 bash[25517]: audit 2021-03-10T14:51:52.901591+0000 mon.a (mon.0) 1077 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:51:54.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:51:53 gibba015 bash[29377]: audit 2021-03-10T14:51:52.886023+0000 mon.c (mon.1) 970 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:51:54.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:51:53 gibba015 bash[29377]: audit 2021-03-10T14:51:52.886700+0000 mon.c (mon.1) 971 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:51:54.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:51:53 gibba015 bash[29377]: audit 2021-03-10T14:51:52.887140+0000 mon.a (mon.0) 1072 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:51:54.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:51:53 gibba015 bash[29377]: audit 2021-03-10T14:51:52.888359+0000 mon.a (mon.0) 1073 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:51:54.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:51:53 gibba015 bash[29377]: audit 2021-03-10T14:51:52.896664+0000 mon.c (mon.1) 972 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T14:51:54.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:51:53 gibba015 bash[29377]: audit 2021-03-10T14:51:52.897396+0000 mon.c (mon.1) 973 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:51:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:51:53 gibba015 bash[29377]: audit 2021-03-10T14:51:52.897792+0000 mon.a (mon.0) 1074 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T14:51:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:51:53 gibba015 bash[29377]: audit 2021-03-10T14:51:52.898083+0000 mon.c (mon.1) 974 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:51:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:51:53 gibba015 bash[29377]: audit 2021-03-10T14:51:52.898948+0000 mon.c (mon.1) 975 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:51:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:51:53 gibba015 bash[29377]: audit 2021-03-10T14:51:52.899389+0000 mon.a (mon.0) 1075 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:51:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:51:53 gibba015 bash[29377]: audit 2021-03-10T14:51:52.900697+0000 mon.a (mon.0) 1076 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:51:54.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:51:53 gibba015 bash[29377]: audit 2021-03-10T14:51:52.901591+0000 mon.a (mon.0) 1077 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:51:54.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:51:53 gibba015 bash[30343]: audit 2021-03-10T14:51:52.886023+0000 mon.c (mon.1) 970 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:51:54.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:51:53 gibba015 bash[30343]: audit 2021-03-10T14:51:52.886700+0000 mon.c (mon.1) 971 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:51:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:51:53 gibba015 bash[30343]: audit 2021-03-10T14:51:52.887140+0000 mon.a (mon.0) 1072 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:51:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:51:53 gibba015 bash[30343]: audit 2021-03-10T14:51:52.888359+0000 mon.a (mon.0) 1073 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:51:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:51:53 gibba015 bash[30343]: audit 2021-03-10T14:51:52.896664+0000 mon.c (mon.1) 972 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T14:51:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:51:53 gibba015 bash[30343]: audit 2021-03-10T14:51:52.897396+0000 mon.c (mon.1) 973 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:51:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:51:53 gibba015 bash[30343]: audit 2021-03-10T14:51:52.897792+0000 mon.a (mon.0) 1074 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T14:51:54.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:51:53 gibba015 bash[30343]: audit 2021-03-10T14:51:52.898083+0000 mon.c (mon.1) 974 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:51:54.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:51:53 gibba015 bash[30343]: audit 2021-03-10T14:51:52.898948+0000 mon.c (mon.1) 975 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:51:54.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:51:53 gibba015 bash[30343]: audit 2021-03-10T14:51:52.899389+0000 mon.a (mon.0) 1075 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:51:54.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:51:53 gibba015 bash[30343]: audit 2021-03-10T14:51:52.900697+0000 mon.a (mon.0) 1076 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:51:54.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:51:53 gibba015 bash[30343]: audit 2021-03-10T14:51:52.901591+0000 mon.a (mon.0) 1077 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:51:55.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:51:54 gibba045 bash[25517]: cluster 2021-03-10T14:51:53.656001+0000 mgr.gibba045.orlgmj (mgr.34412) 3360 : cluster [DBG] pgmap v1904: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:55.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:51:54 gibba015 bash[29377]: cluster 2021-03-10T14:51:53.656001+0000 mgr.gibba045.orlgmj (mgr.34412) 3360 : cluster [DBG] pgmap v1904: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:55.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:51:54 gibba015 bash[30343]: cluster 2021-03-10T14:51:53.656001+0000 mgr.gibba045.orlgmj (mgr.34412) 3360 : cluster [DBG] pgmap v1904: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:57.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:51:56 gibba045 bash[25517]: cluster 2021-03-10T14:51:55.657662+0000 mgr.gibba045.orlgmj (mgr.34412) 3361 : cluster [DBG] pgmap v1905: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:57.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:51:56 gibba015 bash[29377]: cluster 2021-03-10T14:51:55.657662+0000 mgr.gibba045.orlgmj (mgr.34412) 3361 : cluster [DBG] pgmap v1905: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:57.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:51:56 gibba015 bash[30343]: cluster 2021-03-10T14:51:55.657662+0000 mgr.gibba045.orlgmj (mgr.34412) 3361 : cluster [DBG] pgmap v1905: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:59.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:51:58 gibba045 bash[25517]: cluster 2021-03-10T14:51:57.659394+0000 mgr.gibba045.orlgmj (mgr.34412) 3362 : cluster [DBG] pgmap v1906: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:59.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:51:58 gibba015 bash[29377]: cluster 2021-03-10T14:51:57.659394+0000 mgr.gibba045.orlgmj (mgr.34412) 3362 : cluster [DBG] pgmap v1906: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:59.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:51:58 gibba015 bash[30343]: cluster 2021-03-10T14:51:57.659394+0000 mgr.gibba045.orlgmj (mgr.34412) 3362 : cluster [DBG] pgmap v1906: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:01.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:52:00 gibba045 bash[25517]: cluster 2021-03-10T14:51:59.660194+0000 mgr.gibba045.orlgmj (mgr.34412) 3363 : cluster [DBG] pgmap v1907: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:01.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:52:00 gibba015 bash[29377]: cluster 2021-03-10T14:51:59.660194+0000 mgr.gibba045.orlgmj (mgr.34412) 3363 : cluster [DBG] pgmap v1907: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:01.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:52:00 gibba015 bash[30343]: cluster 2021-03-10T14:51:59.660194+0000 mgr.gibba045.orlgmj (mgr.34412) 3363 : cluster [DBG] pgmap v1907: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:02.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:52:01 gibba045 bash[25517]: cephadm 2021-03-10T14:52:00.923803+0000 mgr.gibba045.orlgmj (mgr.34412) 3364 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:52:02.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:52:01 gibba015 bash[29377]: cephadm 2021-03-10T14:52:00.923803+0000 mgr.gibba045.orlgmj (mgr.34412) 3364 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:52:02.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:52:01 gibba015 bash[30343]: cephadm 2021-03-10T14:52:00.923803+0000 mgr.gibba045.orlgmj (mgr.34412) 3364 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:52:03.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:52:02 gibba045 bash[25517]: cluster 2021-03-10T14:52:01.661855+0000 mgr.gibba045.orlgmj (mgr.34412) 3365 : cluster [DBG] pgmap v1908: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:03.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:52:02 gibba015 bash[29377]: cluster 2021-03-10T14:52:01.661855+0000 mgr.gibba045.orlgmj (mgr.34412) 3365 : cluster [DBG] pgmap v1908: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:03.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:52:02 gibba015 bash[30343]: cluster 2021-03-10T14:52:01.661855+0000 mgr.gibba045.orlgmj (mgr.34412) 3365 : cluster [DBG] pgmap v1908: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:04.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:52:04 gibba045 bash[25517]: cluster 2021-03-10T14:52:03.663042+0000 mgr.gibba045.orlgmj (mgr.34412) 3366 : cluster [DBG] pgmap v1909: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:04.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:52:04 gibba015 bash[29377]: cluster 2021-03-10T14:52:03.663042+0000 mgr.gibba045.orlgmj (mgr.34412) 3366 : cluster [DBG] pgmap v1909: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:04.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:52:04 gibba015 bash[30343]: cluster 2021-03-10T14:52:03.663042+0000 mgr.gibba045.orlgmj (mgr.34412) 3366 : cluster [DBG] pgmap v1909: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:07.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:52:06 gibba045 bash[25517]: cluster 2021-03-10T14:52:05.664793+0000 mgr.gibba045.orlgmj (mgr.34412) 3367 : cluster [DBG] pgmap v1910: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:07.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:52:06 gibba015 bash[29377]: cluster 2021-03-10T14:52:05.664793+0000 mgr.gibba045.orlgmj (mgr.34412) 3367 : cluster [DBG] pgmap v1910: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:07.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:52:06 gibba015 bash[30343]: cluster 2021-03-10T14:52:05.664793+0000 mgr.gibba045.orlgmj (mgr.34412) 3367 : cluster [DBG] pgmap v1910: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:07.358 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:52:07.585 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:52:07.586 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (62m) 8m ago 68m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:52:07.586 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (67m) 6m ago 67m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:52:07.586 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (63m) 6m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:52:07.586 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (63m) 6m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:52:07.587 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (62m) 8m ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:52:07.587 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (62m) 8m ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:52:07.587 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (61m) 6m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:52:07.587 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (62m) 8m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:52:07.587 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (68m) 8m ago 68m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:52:07.588 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (68m) 6m ago 68m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:52:07.588 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (61m) 8m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:52:07.588 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (60m) 8m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:52:07.588 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (60m) 8m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:52:07.589 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (59m) 8m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:52:07.589 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (59m) 6m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:52:07.589 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (59m) 6m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:52:07.589 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (58m) 6m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:52:07.589 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (58m) 6m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:52:07.590 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (67m) 6m ago 68m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:52:07.590 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 6m ago 66m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:52:07.833 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:52:07.833 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:52:07.833 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:52:07.833 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:52:07.834 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:52:07.834 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:52:07.834 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:52:07.834 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:52:07.835 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:52:07.835 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:52:07.835 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:52:07.835 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:52:07.835 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:52:07.836 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:52:07.836 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:52:09.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:52:08 gibba045 bash[25517]: audit 2021-03-10T14:52:07.348743+0000 mgr.gibba045.orlgmj (mgr.34412) 3368 : audit [DBG] from='client.56308 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:52:09.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:52:08 gibba045 bash[25517]: audit 2021-03-10T14:52:07.572676+0000 mgr.gibba045.orlgmj (mgr.34412) 3369 : audit [DBG] from='client.46326 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:52:09.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:52:08 gibba045 bash[25517]: cluster 2021-03-10T14:52:07.666045+0000 mgr.gibba045.orlgmj (mgr.34412) 3370 : cluster [DBG] pgmap v1911: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:09.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:52:08 gibba045 bash[25517]: audit 2021-03-10T14:52:07.829243+0000 mon.a (mon.0) 1078 : audit [DBG] from='client.? 172.21.2.115:0/3378957158' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:52:09.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:52:08 gibba015 bash[29377]: audit 2021-03-10T14:52:07.348743+0000 mgr.gibba045.orlgmj (mgr.34412) 3368 : audit [DBG] from='client.56308 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:52:09.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:52:08 gibba015 bash[29377]: audit 2021-03-10T14:52:07.572676+0000 mgr.gibba045.orlgmj (mgr.34412) 3369 : audit [DBG] from='client.46326 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:52:09.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:52:08 gibba015 bash[29377]: cluster 2021-03-10T14:52:07.666045+0000 mgr.gibba045.orlgmj (mgr.34412) 3370 : cluster [DBG] pgmap v1911: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:09.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:52:08 gibba015 bash[29377]: audit 2021-03-10T14:52:07.829243+0000 mon.a (mon.0) 1078 : audit [DBG] from='client.? 172.21.2.115:0/3378957158' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:52:09.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:52:08 gibba015 bash[30343]: audit 2021-03-10T14:52:07.348743+0000 mgr.gibba045.orlgmj (mgr.34412) 3368 : audit [DBG] from='client.56308 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:52:09.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:52:08 gibba015 bash[30343]: audit 2021-03-10T14:52:07.572676+0000 mgr.gibba045.orlgmj (mgr.34412) 3369 : audit [DBG] from='client.46326 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:52:09.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:52:08 gibba015 bash[30343]: cluster 2021-03-10T14:52:07.666045+0000 mgr.gibba045.orlgmj (mgr.34412) 3370 : cluster [DBG] pgmap v1911: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:09.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:52:08 gibba015 bash[30343]: audit 2021-03-10T14:52:07.829243+0000 mon.a (mon.0) 1078 : audit [DBG] from='client.? 172.21.2.115:0/3378957158' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:52:11.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:52:10 gibba045 bash[25517]: cluster 2021-03-10T14:52:09.666930+0000 mgr.gibba045.orlgmj (mgr.34412) 3371 : cluster [DBG] pgmap v1912: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:11.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:52:10 gibba015 bash[29377]: cluster 2021-03-10T14:52:09.666930+0000 mgr.gibba045.orlgmj (mgr.34412) 3371 : cluster [DBG] pgmap v1912: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:11.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:52:10 gibba015 bash[30343]: cluster 2021-03-10T14:52:09.666930+0000 mgr.gibba045.orlgmj (mgr.34412) 3371 : cluster [DBG] pgmap v1912: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:13.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:52:12 gibba045 bash[25517]: cluster 2021-03-10T14:52:11.668264+0000 mgr.gibba045.orlgmj (mgr.34412) 3372 : cluster [DBG] pgmap v1913: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:13.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:52:12 gibba015 bash[29377]: cluster 2021-03-10T14:52:11.668264+0000 mgr.gibba045.orlgmj (mgr.34412) 3372 : cluster [DBG] pgmap v1913: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:13.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:52:12 gibba015 bash[30343]: cluster 2021-03-10T14:52:11.668264+0000 mgr.gibba045.orlgmj (mgr.34412) 3372 : cluster [DBG] pgmap v1913: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:14.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:52:14 gibba045 bash[25517]: cluster 2021-03-10T14:52:13.669632+0000 mgr.gibba045.orlgmj (mgr.34412) 3373 : cluster [DBG] pgmap v1914: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:14.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:52:14 gibba015 bash[29377]: cluster 2021-03-10T14:52:13.669632+0000 mgr.gibba045.orlgmj (mgr.34412) 3373 : cluster [DBG] pgmap v1914: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:14.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:52:14 gibba015 bash[30343]: cluster 2021-03-10T14:52:13.669632+0000 mgr.gibba045.orlgmj (mgr.34412) 3373 : cluster [DBG] pgmap v1914: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:17.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:52:16 gibba045 bash[25517]: cluster 2021-03-10T14:52:15.671035+0000 mgr.gibba045.orlgmj (mgr.34412) 3374 : cluster [DBG] pgmap v1915: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:17.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:52:16 gibba045 bash[25517]: audit 2021-03-10T14:52:15.930490+0000 mon.c (mon.1) 976 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:52:17.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:52:16 gibba045 bash[25517]: cephadm 2021-03-10T14:52:15.938614+0000 mgr.gibba045.orlgmj (mgr.34412) 3375 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:52:17.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:52:16 gibba045 bash[25517]: cephadm 2021-03-10T14:52:15.940010+0000 mgr.gibba045.orlgmj (mgr.34412) 3376 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:52:17.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:52:16 gibba045 bash[25517]: audit 2021-03-10T14:52:16.147242+0000 mon.a (mon.0) 1079 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:52:17.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:52:16 gibba045 bash[25517]: audit 2021-03-10T14:52:16.150903+0000 mon.c (mon.1) 977 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:52:17.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:52:16 gibba045 bash[25517]: audit 2021-03-10T14:52:16.152687+0000 mon.c (mon.1) 978 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:52:17.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:52:16 gibba045 bash[25517]: audit 2021-03-10T14:52:16.153872+0000 mon.c (mon.1) 979 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:52:17.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:52:16 gibba045 bash[25517]: audit 2021-03-10T14:52:16.155172+0000 mon.c (mon.1) 980 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:52:17.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:52:16 gibba045 bash[25517]: audit 2021-03-10T14:52:16.157569+0000 mon.c (mon.1) 981 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:52:17.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:52:16 gibba045 bash[25517]: audit 2021-03-10T14:52:16.158948+0000 mon.c (mon.1) 982 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:52:17.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:52:16 gibba015 bash[29377]: cluster 2021-03-10T14:52:15.671035+0000 mgr.gibba045.orlgmj (mgr.34412) 3374 : cluster [DBG] pgmap v1915: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:17.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:52:16 gibba015 bash[29377]: audit 2021-03-10T14:52:15.930490+0000 mon.c (mon.1) 976 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:52:17.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:52:16 gibba015 bash[29377]: cephadm 2021-03-10T14:52:15.938614+0000 mgr.gibba045.orlgmj (mgr.34412) 3375 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:52:17.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:52:16 gibba015 bash[29377]: cephadm 2021-03-10T14:52:15.940010+0000 mgr.gibba045.orlgmj (mgr.34412) 3376 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:52:17.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:52:16 gibba015 bash[29377]: audit 2021-03-10T14:52:16.147242+0000 mon.a (mon.0) 1079 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:52:17.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:52:16 gibba015 bash[29377]: audit 2021-03-10T14:52:16.150903+0000 mon.c (mon.1) 977 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:52:17.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:52:16 gibba015 bash[29377]: audit 2021-03-10T14:52:16.152687+0000 mon.c (mon.1) 978 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:52:17.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:52:16 gibba015 bash[29377]: audit 2021-03-10T14:52:16.153872+0000 mon.c (mon.1) 979 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:52:17.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:52:16 gibba015 bash[29377]: audit 2021-03-10T14:52:16.155172+0000 mon.c (mon.1) 980 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:52:17.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:52:16 gibba015 bash[29377]: audit 2021-03-10T14:52:16.157569+0000 mon.c (mon.1) 981 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:52:17.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:52:16 gibba015 bash[29377]: audit 2021-03-10T14:52:16.158948+0000 mon.c (mon.1) 982 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:52:17.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:52:16 gibba015 bash[30343]: cluster 2021-03-10T14:52:15.671035+0000 mgr.gibba045.orlgmj (mgr.34412) 3374 : cluster [DBG] pgmap v1915: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:17.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:52:16 gibba015 bash[30343]: audit 2021-03-10T14:52:15.930490+0000 mon.c (mon.1) 976 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:52:17.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:52:16 gibba015 bash[30343]: cephadm 2021-03-10T14:52:15.938614+0000 mgr.gibba045.orlgmj (mgr.34412) 3375 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:52:17.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:52:16 gibba015 bash[30343]: cephadm 2021-03-10T14:52:15.940010+0000 mgr.gibba045.orlgmj (mgr.34412) 3376 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:52:17.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:52:16 gibba015 bash[30343]: audit 2021-03-10T14:52:16.147242+0000 mon.a (mon.0) 1079 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:52:17.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:52:16 gibba015 bash[30343]: audit 2021-03-10T14:52:16.150903+0000 mon.c (mon.1) 977 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:52:17.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:52:16 gibba015 bash[30343]: audit 2021-03-10T14:52:16.152687+0000 mon.c (mon.1) 978 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:52:17.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:52:16 gibba015 bash[30343]: audit 2021-03-10T14:52:16.153872+0000 mon.c (mon.1) 979 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:52:17.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:52:16 gibba015 bash[30343]: audit 2021-03-10T14:52:16.155172+0000 mon.c (mon.1) 980 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:52:17.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:52:16 gibba015 bash[30343]: audit 2021-03-10T14:52:16.157569+0000 mon.c (mon.1) 981 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:52:17.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:52:16 gibba015 bash[30343]: audit 2021-03-10T14:52:16.158948+0000 mon.c (mon.1) 982 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:52:18.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:52:17 gibba045 bash[25517]: cephadm 2021-03-10T14:52:16.153223+0000 mgr.gibba045.orlgmj (mgr.34412) 3377 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:52:18.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:52:17 gibba045 bash[25517]: cephadm 2021-03-10T14:52:16.155379+0000 mgr.gibba045.orlgmj (mgr.34412) 3378 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:52:18.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:52:17 gibba045 bash[25517]: cephadm 2021-03-10T14:52:16.156651+0000 mgr.gibba045.orlgmj (mgr.34412) 3379 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:52:18.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:52:17 gibba045 bash[25517]: cephadm 2021-03-10T14:52:16.156688+0000 mgr.gibba045.orlgmj (mgr.34412) 3380 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:52:18.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:52:17 gibba045 bash[25517]: cephadm 2021-03-10T14:52:16.157923+0000 mgr.gibba045.orlgmj (mgr.34412) 3381 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:52:18.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:52:17 gibba045 bash[25517]: cephadm 2021-03-10T14:52:16.157962+0000 mgr.gibba045.orlgmj (mgr.34412) 3382 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:52:18.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:52:17 gibba045 bash[25517]: cephadm 2021-03-10T14:52:16.158960+0000 mgr.gibba045.orlgmj (mgr.34412) 3383 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:52:18.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:52:17 gibba045 bash[25517]: cephadm 2021-03-10T14:52:16.160133+0000 mgr.gibba045.orlgmj (mgr.34412) 3384 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:52:18.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:52:17 gibba045 bash[25517]: cephadm 2021-03-10T14:52:16.160170+0000 mgr.gibba045.orlgmj (mgr.34412) 3385 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:52:18.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:52:17 gibba045 bash[25517]: cephadm 2021-03-10T14:52:16.161422+0000 mgr.gibba045.orlgmj (mgr.34412) 3386 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:52:18.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:52:17 gibba045 bash[25517]: cephadm 2021-03-10T14:52:16.161740+0000 mgr.gibba045.orlgmj (mgr.34412) 3387 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:52:18.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:52:17 gibba045 bash[25517]: cephadm 2021-03-10T14:52:16.162911+0000 mgr.gibba045.orlgmj (mgr.34412) 3388 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:52:18.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:52:17 gibba045 bash[25517]: cephadm 2021-03-10T14:52:16.162950+0000 mgr.gibba045.orlgmj (mgr.34412) 3389 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:52:18.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:52:17 gibba045 bash[25517]: cephadm 2021-03-10T14:52:16.163058+0000 mgr.gibba045.orlgmj (mgr.34412) 3390 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:52:18.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:52:17 gibba015 bash[29377]: cephadm 2021-03-10T14:52:16.153223+0000 mgr.gibba045.orlgmj (mgr.34412) 3377 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:52:18.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:52:17 gibba015 bash[29377]: cephadm 2021-03-10T14:52:16.155379+0000 mgr.gibba045.orlgmj (mgr.34412) 3378 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:52:18.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:52:17 gibba015 bash[29377]: cephadm 2021-03-10T14:52:16.156651+0000 mgr.gibba045.orlgmj (mgr.34412) 3379 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:52:18.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:52:17 gibba015 bash[29377]: cephadm 2021-03-10T14:52:16.156688+0000 mgr.gibba045.orlgmj (mgr.34412) 3380 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:52:18.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:52:17 gibba015 bash[29377]: cephadm 2021-03-10T14:52:16.157923+0000 mgr.gibba045.orlgmj (mgr.34412) 3381 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:52:18.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:52:17 gibba015 bash[29377]: cephadm 2021-03-10T14:52:16.157962+0000 mgr.gibba045.orlgmj (mgr.34412) 3382 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:52:18.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:52:17 gibba015 bash[29377]: cephadm 2021-03-10T14:52:16.158960+0000 mgr.gibba045.orlgmj (mgr.34412) 3383 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:52:18.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:52:17 gibba015 bash[29377]: cephadm 2021-03-10T14:52:16.160133+0000 mgr.gibba045.orlgmj (mgr.34412) 3384 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:52:18.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:52:17 gibba015 bash[29377]: cephadm 2021-03-10T14:52:16.160170+0000 mgr.gibba045.orlgmj (mgr.34412) 3385 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:52:18.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:52:17 gibba015 bash[29377]: cephadm 2021-03-10T14:52:16.161422+0000 mgr.gibba045.orlgmj (mgr.34412) 3386 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:52:18.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:52:17 gibba015 bash[29377]: cephadm 2021-03-10T14:52:16.161740+0000 mgr.gibba045.orlgmj (mgr.34412) 3387 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:52:18.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:52:17 gibba015 bash[29377]: cephadm 2021-03-10T14:52:16.162911+0000 mgr.gibba045.orlgmj (mgr.34412) 3388 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:52:18.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:52:17 gibba015 bash[29377]: cephadm 2021-03-10T14:52:16.162950+0000 mgr.gibba045.orlgmj (mgr.34412) 3389 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:52:18.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:52:17 gibba015 bash[29377]: cephadm 2021-03-10T14:52:16.163058+0000 mgr.gibba045.orlgmj (mgr.34412) 3390 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:52:18.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:52:17 gibba015 bash[30343]: cephadm 2021-03-10T14:52:16.153223+0000 mgr.gibba045.orlgmj (mgr.34412) 3377 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:52:18.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:52:17 gibba015 bash[30343]: cephadm 2021-03-10T14:52:16.155379+0000 mgr.gibba045.orlgmj (mgr.34412) 3378 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:52:18.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:52:17 gibba015 bash[30343]: cephadm 2021-03-10T14:52:16.156651+0000 mgr.gibba045.orlgmj (mgr.34412) 3379 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:52:18.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:52:17 gibba015 bash[30343]: cephadm 2021-03-10T14:52:16.156688+0000 mgr.gibba045.orlgmj (mgr.34412) 3380 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:52:18.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:52:17 gibba015 bash[30343]: cephadm 2021-03-10T14:52:16.157923+0000 mgr.gibba045.orlgmj (mgr.34412) 3381 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:52:18.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:52:17 gibba015 bash[30343]: cephadm 2021-03-10T14:52:16.157962+0000 mgr.gibba045.orlgmj (mgr.34412) 3382 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:52:18.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:52:17 gibba015 bash[30343]: cephadm 2021-03-10T14:52:16.158960+0000 mgr.gibba045.orlgmj (mgr.34412) 3383 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:52:18.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:52:17 gibba015 bash[30343]: cephadm 2021-03-10T14:52:16.160133+0000 mgr.gibba045.orlgmj (mgr.34412) 3384 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:52:18.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:52:17 gibba015 bash[30343]: cephadm 2021-03-10T14:52:16.160170+0000 mgr.gibba045.orlgmj (mgr.34412) 3385 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:52:18.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:52:17 gibba015 bash[30343]: cephadm 2021-03-10T14:52:16.161422+0000 mgr.gibba045.orlgmj (mgr.34412) 3386 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:52:18.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:52:17 gibba015 bash[30343]: cephadm 2021-03-10T14:52:16.161740+0000 mgr.gibba045.orlgmj (mgr.34412) 3387 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:52:18.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:52:17 gibba015 bash[30343]: cephadm 2021-03-10T14:52:16.162911+0000 mgr.gibba045.orlgmj (mgr.34412) 3388 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:52:18.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:52:17 gibba015 bash[30343]: cephadm 2021-03-10T14:52:16.162950+0000 mgr.gibba045.orlgmj (mgr.34412) 3389 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:52:18.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:52:17 gibba015 bash[30343]: cephadm 2021-03-10T14:52:16.163058+0000 mgr.gibba045.orlgmj (mgr.34412) 3390 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:52:19.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:52:18 gibba045 bash[25517]: cluster 2021-03-10T14:52:17.672868+0000 mgr.gibba045.orlgmj (mgr.34412) 3391 : cluster [DBG] pgmap v1916: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:19.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:52:18 gibba015 bash[29377]: cluster 2021-03-10T14:52:17.672868+0000 mgr.gibba045.orlgmj (mgr.34412) 3391 : cluster [DBG] pgmap v1916: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:19.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:52:18 gibba015 bash[30343]: cluster 2021-03-10T14:52:17.672868+0000 mgr.gibba045.orlgmj (mgr.34412) 3391 : cluster [DBG] pgmap v1916: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:21.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:52:20 gibba045 bash[25517]: cluster 2021-03-10T14:52:19.673950+0000 mgr.gibba045.orlgmj (mgr.34412) 3392 : cluster [DBG] pgmap v1917: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:21.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:52:20 gibba015 bash[29377]: cluster 2021-03-10T14:52:19.673950+0000 mgr.gibba045.orlgmj (mgr.34412) 3392 : cluster [DBG] pgmap v1917: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:21.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:52:20 gibba015 bash[30343]: cluster 2021-03-10T14:52:19.673950+0000 mgr.gibba045.orlgmj (mgr.34412) 3392 : cluster [DBG] pgmap v1917: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:23.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:52:22 gibba045 bash[25517]: cluster 2021-03-10T14:52:21.675587+0000 mgr.gibba045.orlgmj (mgr.34412) 3393 : cluster [DBG] pgmap v1918: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:23.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:52:22 gibba015 bash[29377]: cluster 2021-03-10T14:52:21.675587+0000 mgr.gibba045.orlgmj (mgr.34412) 3393 : cluster [DBG] pgmap v1918: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:23.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:52:22 gibba015 bash[30343]: cluster 2021-03-10T14:52:21.675587+0000 mgr.gibba045.orlgmj (mgr.34412) 3393 : cluster [DBG] pgmap v1918: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:24.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:52:24 gibba045 bash[25517]: cluster 2021-03-10T14:52:23.676841+0000 mgr.gibba045.orlgmj (mgr.34412) 3394 : cluster [DBG] pgmap v1919: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:24.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:52:24 gibba015 bash[29377]: cluster 2021-03-10T14:52:23.676841+0000 mgr.gibba045.orlgmj (mgr.34412) 3394 : cluster [DBG] pgmap v1919: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:24.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:52:24 gibba015 bash[30343]: cluster 2021-03-10T14:52:23.676841+0000 mgr.gibba045.orlgmj (mgr.34412) 3394 : cluster [DBG] pgmap v1919: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:27.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:52:26 gibba045 bash[25517]: cluster 2021-03-10T14:52:25.678224+0000 mgr.gibba045.orlgmj (mgr.34412) 3395 : cluster [DBG] pgmap v1920: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:27.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:52:26 gibba015 bash[29377]: cluster 2021-03-10T14:52:25.678224+0000 mgr.gibba045.orlgmj (mgr.34412) 3395 : cluster [DBG] pgmap v1920: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:27.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:52:26 gibba015 bash[30343]: cluster 2021-03-10T14:52:25.678224+0000 mgr.gibba045.orlgmj (mgr.34412) 3395 : cluster [DBG] pgmap v1920: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:29.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:52:28 gibba045 bash[25517]: cluster 2021-03-10T14:52:27.679928+0000 mgr.gibba045.orlgmj (mgr.34412) 3396 : cluster [DBG] pgmap v1921: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:29.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:52:28 gibba015 bash[29377]: cluster 2021-03-10T14:52:27.679928+0000 mgr.gibba045.orlgmj (mgr.34412) 3396 : cluster [DBG] pgmap v1921: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:29.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:52:28 gibba015 bash[30343]: cluster 2021-03-10T14:52:27.679928+0000 mgr.gibba045.orlgmj (mgr.34412) 3396 : cluster [DBG] pgmap v1921: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:31.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:52:30 gibba045 bash[25517]: cluster 2021-03-10T14:52:29.681469+0000 mgr.gibba045.orlgmj (mgr.34412) 3397 : cluster [DBG] pgmap v1922: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:31.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:52:30 gibba015 bash[29377]: cluster 2021-03-10T14:52:29.681469+0000 mgr.gibba045.orlgmj (mgr.34412) 3397 : cluster [DBG] pgmap v1922: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:31.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:52:30 gibba015 bash[30343]: cluster 2021-03-10T14:52:29.681469+0000 mgr.gibba045.orlgmj (mgr.34412) 3397 : cluster [DBG] pgmap v1922: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:33.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:52:32 gibba045 bash[25517]: cephadm 2021-03-10T14:52:31.179126+0000 mgr.gibba045.orlgmj (mgr.34412) 3398 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:52:33.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:52:32 gibba045 bash[25517]: cluster 2021-03-10T14:52:31.682967+0000 mgr.gibba045.orlgmj (mgr.34412) 3399 : cluster [DBG] pgmap v1923: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:33.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:52:32 gibba015 bash[29377]: cephadm 2021-03-10T14:52:31.179126+0000 mgr.gibba045.orlgmj (mgr.34412) 3398 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:52:33.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:52:32 gibba015 bash[29377]: cluster 2021-03-10T14:52:31.682967+0000 mgr.gibba045.orlgmj (mgr.34412) 3399 : cluster [DBG] pgmap v1923: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:33.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:52:32 gibba015 bash[30343]: cephadm 2021-03-10T14:52:31.179126+0000 mgr.gibba045.orlgmj (mgr.34412) 3398 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:52:33.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:52:32 gibba015 bash[30343]: cluster 2021-03-10T14:52:31.682967+0000 mgr.gibba045.orlgmj (mgr.34412) 3399 : cluster [DBG] pgmap v1923: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:34.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:52:34 gibba045 bash[25517]: cluster 2021-03-10T14:52:33.684043+0000 mgr.gibba045.orlgmj (mgr.34412) 3400 : cluster [DBG] pgmap v1924: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:34.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:52:34 gibba015 bash[29377]: cluster 2021-03-10T14:52:33.684043+0000 mgr.gibba045.orlgmj (mgr.34412) 3400 : cluster [DBG] pgmap v1924: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:34.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:52:34 gibba015 bash[30343]: cluster 2021-03-10T14:52:33.684043+0000 mgr.gibba045.orlgmj (mgr.34412) 3400 : cluster [DBG] pgmap v1924: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:37.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:52:36 gibba045 bash[25517]: cluster 2021-03-10T14:52:35.685638+0000 mgr.gibba045.orlgmj (mgr.34412) 3401 : cluster [DBG] pgmap v1925: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:37.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:52:36 gibba015 bash[29377]: cluster 2021-03-10T14:52:35.685638+0000 mgr.gibba045.orlgmj (mgr.34412) 3401 : cluster [DBG] pgmap v1925: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:37.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:52:36 gibba015 bash[30343]: cluster 2021-03-10T14:52:35.685638+0000 mgr.gibba045.orlgmj (mgr.34412) 3401 : cluster [DBG] pgmap v1925: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:38.075 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:52:38.299 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:52:38.300 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (63m) 8m ago 68m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:52:38.300 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (68m) 7m ago 68m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:52:38.300 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (63m) 7m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:52:38.301 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (64m) 7m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:52:38.301 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (63m) 8m ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:52:38.302 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (62m) 8m ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:52:38.302 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (62m) 7m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:52:38.302 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (62m) 8m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:52:38.303 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (68m) 8m ago 68m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:52:38.303 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (68m) 7m ago 68m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:52:38.304 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (61m) 8m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:52:38.304 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (61m) 8m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:52:38.304 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (60m) 8m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:52:38.305 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (60m) 8m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:52:38.305 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (59m) 7m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:52:38.306 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (59m) 7m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:52:38.306 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (59m) 7m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:52:38.306 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (58m) 7m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:52:38.307 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (68m) 7m ago 68m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:52:38.307 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 7m ago 66m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:52:38.550 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:52:38.551 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:52:38.551 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:52:38.551 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:52:38.551 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:52:38.552 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:52:38.552 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:52:38.552 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:52:38.552 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:52:38.552 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:52:38.553 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:52:38.553 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:52:38.553 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:52:38.553 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:52:38.554 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:52:39.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:52:38 gibba045 bash[25517]: cluster 2021-03-10T14:52:37.687296+0000 mgr.gibba045.orlgmj (mgr.34412) 3402 : cluster [DBG] pgmap v1926: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:39.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:52:38 gibba045 bash[25517]: audit 2021-03-10T14:52:38.065503+0000 mgr.gibba045.orlgmj (mgr.34412) 3403 : audit [DBG] from='client.56326 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:52:39.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:52:38 gibba045 bash[25517]: audit 2021-03-10T14:52:38.546732+0000 mon.a (mon.0) 1080 : audit [DBG] from='client.? 172.21.2.115:0/2111830018' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:52:39.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:52:38 gibba015 bash[29377]: cluster 2021-03-10T14:52:37.687296+0000 mgr.gibba045.orlgmj (mgr.34412) 3402 : cluster [DBG] pgmap v1926: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:39.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:52:38 gibba015 bash[29377]: audit 2021-03-10T14:52:38.065503+0000 mgr.gibba045.orlgmj (mgr.34412) 3403 : audit [DBG] from='client.56326 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:52:39.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:52:38 gibba015 bash[29377]: audit 2021-03-10T14:52:38.546732+0000 mon.a (mon.0) 1080 : audit [DBG] from='client.? 172.21.2.115:0/2111830018' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:52:39.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:52:38 gibba015 bash[30343]: cluster 2021-03-10T14:52:37.687296+0000 mgr.gibba045.orlgmj (mgr.34412) 3402 : cluster [DBG] pgmap v1926: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:39.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:52:38 gibba015 bash[30343]: audit 2021-03-10T14:52:38.065503+0000 mgr.gibba045.orlgmj (mgr.34412) 3403 : audit [DBG] from='client.56326 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:52:39.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:52:38 gibba015 bash[30343]: audit 2021-03-10T14:52:38.546732+0000 mon.a (mon.0) 1080 : audit [DBG] from='client.? 172.21.2.115:0/2111830018' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:52:40.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:52:39 gibba045 bash[25517]: audit 2021-03-10T14:52:38.289415+0000 mgr.gibba045.orlgmj (mgr.34412) 3404 : audit [DBG] from='client.56332 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:52:40.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:52:39 gibba015 bash[29377]: audit 2021-03-10T14:52:38.289415+0000 mgr.gibba045.orlgmj (mgr.34412) 3404 : audit [DBG] from='client.56332 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:52:40.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:52:39 gibba015 bash[30343]: audit 2021-03-10T14:52:38.289415+0000 mgr.gibba045.orlgmj (mgr.34412) 3404 : audit [DBG] from='client.56332 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:52:41.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:52:40 gibba045 bash[25517]: cluster 2021-03-10T14:52:39.688754+0000 mgr.gibba045.orlgmj (mgr.34412) 3405 : cluster [DBG] pgmap v1927: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:41.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:52:40 gibba015 bash[29377]: cluster 2021-03-10T14:52:39.688754+0000 mgr.gibba045.orlgmj (mgr.34412) 3405 : cluster [DBG] pgmap v1927: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:41.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:52:40 gibba015 bash[30343]: cluster 2021-03-10T14:52:39.688754+0000 mgr.gibba045.orlgmj (mgr.34412) 3405 : cluster [DBG] pgmap v1927: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:43.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:52:42 gibba045 bash[25517]: cluster 2021-03-10T14:52:41.690336+0000 mgr.gibba045.orlgmj (mgr.34412) 3406 : cluster [DBG] pgmap v1928: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:43.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:52:42 gibba015 bash[29377]: cluster 2021-03-10T14:52:41.690336+0000 mgr.gibba045.orlgmj (mgr.34412) 3406 : cluster [DBG] pgmap v1928: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:43.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:52:42 gibba015 bash[30343]: cluster 2021-03-10T14:52:41.690336+0000 mgr.gibba045.orlgmj (mgr.34412) 3406 : cluster [DBG] pgmap v1928: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:44.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:52:44 gibba045 bash[25517]: cluster 2021-03-10T14:52:43.691605+0000 mgr.gibba045.orlgmj (mgr.34412) 3407 : cluster [DBG] pgmap v1929: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:44.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:52:44 gibba015 bash[29377]: cluster 2021-03-10T14:52:43.691605+0000 mgr.gibba045.orlgmj (mgr.34412) 3407 : cluster [DBG] pgmap v1929: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:44.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:52:44 gibba015 bash[30343]: cluster 2021-03-10T14:52:43.691605+0000 mgr.gibba045.orlgmj (mgr.34412) 3407 : cluster [DBG] pgmap v1929: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:47.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:52:46 gibba045 bash[25517]: cluster 2021-03-10T14:52:45.692501+0000 mgr.gibba045.orlgmj (mgr.34412) 3408 : cluster [DBG] pgmap v1930: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:47.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:52:46 gibba015 bash[29377]: cluster 2021-03-10T14:52:45.692501+0000 mgr.gibba045.orlgmj (mgr.34412) 3408 : cluster [DBG] pgmap v1930: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:47.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:52:46 gibba015 bash[30343]: cluster 2021-03-10T14:52:45.692501+0000 mgr.gibba045.orlgmj (mgr.34412) 3408 : cluster [DBG] pgmap v1930: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:48.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:52:47 gibba045 bash[25517]: cephadm 2021-03-10T14:52:46.195163+0000 mgr.gibba045.orlgmj (mgr.34412) 3409 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:52:48.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:52:47 gibba015 bash[29377]: cephadm 2021-03-10T14:52:46.195163+0000 mgr.gibba045.orlgmj (mgr.34412) 3409 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:52:48.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:52:47 gibba015 bash[30343]: cephadm 2021-03-10T14:52:46.195163+0000 mgr.gibba045.orlgmj (mgr.34412) 3409 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:52:49.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:52:48 gibba045 bash[25517]: cluster 2021-03-10T14:52:47.693918+0000 mgr.gibba045.orlgmj (mgr.34412) 3410 : cluster [DBG] pgmap v1931: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:49.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:52:48 gibba015 bash[29377]: cluster 2021-03-10T14:52:47.693918+0000 mgr.gibba045.orlgmj (mgr.34412) 3410 : cluster [DBG] pgmap v1931: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:49.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:52:48 gibba015 bash[30343]: cluster 2021-03-10T14:52:47.693918+0000 mgr.gibba045.orlgmj (mgr.34412) 3410 : cluster [DBG] pgmap v1931: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:51.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:52:50 gibba045 bash[25517]: cluster 2021-03-10T14:52:49.694578+0000 mgr.gibba045.orlgmj (mgr.34412) 3411 : cluster [DBG] pgmap v1932: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:51.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:52:50 gibba015 bash[29377]: cluster 2021-03-10T14:52:49.694578+0000 mgr.gibba045.orlgmj (mgr.34412) 3411 : cluster [DBG] pgmap v1932: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:51.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:52:50 gibba015 bash[30343]: cluster 2021-03-10T14:52:49.694578+0000 mgr.gibba045.orlgmj (mgr.34412) 3411 : cluster [DBG] pgmap v1932: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:53.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:52:52 gibba045 bash[25517]: cluster 2021-03-10T14:52:51.696213+0000 mgr.gibba045.orlgmj (mgr.34412) 3412 : cluster [DBG] pgmap v1933: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:53.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:52:52 gibba015 bash[29377]: cluster 2021-03-10T14:52:51.696213+0000 mgr.gibba045.orlgmj (mgr.34412) 3412 : cluster [DBG] pgmap v1933: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:53.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:52:52 gibba015 bash[30343]: cluster 2021-03-10T14:52:51.696213+0000 mgr.gibba045.orlgmj (mgr.34412) 3412 : cluster [DBG] pgmap v1933: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:52:53 gibba045 bash[25517]: audit 2021-03-10T14:52:52.893658+0000 mon.c (mon.1) 983 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:52:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:52:53 gibba045 bash[25517]: audit 2021-03-10T14:52:52.894276+0000 mon.c (mon.1) 984 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:52:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:52:53 gibba045 bash[25517]: audit 2021-03-10T14:52:52.895020+0000 mon.a (mon.0) 1081 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:52:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:52:53 gibba045 bash[25517]: audit 2021-03-10T14:52:52.895897+0000 mon.a (mon.0) 1082 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:52:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:52:53 gibba045 bash[25517]: audit 2021-03-10T14:52:52.902664+0000 mon.c (mon.1) 985 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T14:52:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:52:53 gibba045 bash[25517]: audit 2021-03-10T14:52:52.903413+0000 mon.c (mon.1) 986 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:52:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:52:53 gibba045 bash[25517]: audit 2021-03-10T14:52:52.903802+0000 mon.a (mon.0) 1083 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T14:52:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:52:53 gibba045 bash[25517]: audit 2021-03-10T14:52:52.904128+0000 mon.c (mon.1) 987 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T14:52:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:52:53 gibba045 bash[25517]: audit 2021-03-10T14:52:52.905032+0000 mon.a (mon.0) 1084 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:52:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:52:53 gibba045 bash[25517]: audit 2021-03-10T14:52:52.905215+0000 mon.c (mon.1) 988 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:52:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:52:53 gibba045 bash[25517]: audit 2021-03-10T14:52:52.906206+0000 mon.a (mon.0) 1085 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T14:52:54.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:52:53 gibba045 bash[25517]: audit 2021-03-10T14:52:52.907159+0000 mon.a (mon.0) 1086 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:52:54.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:52:53 gibba015 bash[29377]: audit 2021-03-10T14:52:52.893658+0000 mon.c (mon.1) 983 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:52:54.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:52:53 gibba015 bash[29377]: audit 2021-03-10T14:52:52.894276+0000 mon.c (mon.1) 984 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:52:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:52:53 gibba015 bash[29377]: audit 2021-03-10T14:52:52.895020+0000 mon.a (mon.0) 1081 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:52:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:52:53 gibba015 bash[29377]: audit 2021-03-10T14:52:52.895897+0000 mon.a (mon.0) 1082 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:52:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:52:53 gibba015 bash[29377]: audit 2021-03-10T14:52:52.902664+0000 mon.c (mon.1) 985 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T14:52:54.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:52:53 gibba015 bash[29377]: audit 2021-03-10T14:52:52.903413+0000 mon.c (mon.1) 986 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:52:54.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:52:53 gibba015 bash[29377]: audit 2021-03-10T14:52:52.903802+0000 mon.a (mon.0) 1083 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T14:52:54.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:52:53 gibba015 bash[29377]: audit 2021-03-10T14:52:52.904128+0000 mon.c (mon.1) 987 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T14:52:54.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:52:53 gibba015 bash[29377]: audit 2021-03-10T14:52:52.905032+0000 mon.a (mon.0) 1084 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:52:54.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:52:53 gibba015 bash[29377]: audit 2021-03-10T14:52:52.905215+0000 mon.c (mon.1) 988 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:52:54.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:52:53 gibba015 bash[29377]: audit 2021-03-10T14:52:52.906206+0000 mon.a (mon.0) 1085 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T14:52:54.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:52:53 gibba015 bash[29377]: audit 2021-03-10T14:52:52.907159+0000 mon.a (mon.0) 1086 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:52:54.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:52:53 gibba015 bash[30343]: audit 2021-03-10T14:52:52.893658+0000 mon.c (mon.1) 983 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:52:54.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:52:53 gibba015 bash[30343]: audit 2021-03-10T14:52:52.894276+0000 mon.c (mon.1) 984 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:52:54.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:52:53 gibba015 bash[30343]: audit 2021-03-10T14:52:52.895020+0000 mon.a (mon.0) 1081 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:52:54.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:52:53 gibba015 bash[30343]: audit 2021-03-10T14:52:52.895897+0000 mon.a (mon.0) 1082 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:52:54.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:52:53 gibba015 bash[30343]: audit 2021-03-10T14:52:52.902664+0000 mon.c (mon.1) 985 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T14:52:54.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:52:53 gibba015 bash[30343]: audit 2021-03-10T14:52:52.903413+0000 mon.c (mon.1) 986 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:52:54.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:52:53 gibba015 bash[30343]: audit 2021-03-10T14:52:52.903802+0000 mon.a (mon.0) 1083 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T14:52:54.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:52:53 gibba015 bash[30343]: audit 2021-03-10T14:52:52.904128+0000 mon.c (mon.1) 987 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T14:52:54.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:52:53 gibba015 bash[30343]: audit 2021-03-10T14:52:52.905032+0000 mon.a (mon.0) 1084 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:52:54.234 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:52:53 gibba015 bash[30343]: audit 2021-03-10T14:52:52.905215+0000 mon.c (mon.1) 988 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:52:54.234 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:52:53 gibba015 bash[30343]: audit 2021-03-10T14:52:52.906206+0000 mon.a (mon.0) 1085 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T14:52:54.234 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:52:53 gibba015 bash[30343]: audit 2021-03-10T14:52:52.907159+0000 mon.a (mon.0) 1086 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:52:55.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:52:54 gibba045 bash[25517]: cluster 2021-03-10T14:52:53.697423+0000 mgr.gibba045.orlgmj (mgr.34412) 3413 : cluster [DBG] pgmap v1934: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:55.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:52:54 gibba015 bash[29377]: cluster 2021-03-10T14:52:53.697423+0000 mgr.gibba045.orlgmj (mgr.34412) 3413 : cluster [DBG] pgmap v1934: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:55.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:52:54 gibba015 bash[30343]: cluster 2021-03-10T14:52:53.697423+0000 mgr.gibba045.orlgmj (mgr.34412) 3413 : cluster [DBG] pgmap v1934: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:57.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:52:56 gibba015 bash[29377]: cluster 2021-03-10T14:52:55.699417+0000 mgr.gibba045.orlgmj (mgr.34412) 3414 : cluster [DBG] pgmap v1935: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:57.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:52:56 gibba015 bash[30343]: cluster 2021-03-10T14:52:55.699417+0000 mgr.gibba045.orlgmj (mgr.34412) 3414 : cluster [DBG] pgmap v1935: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:57.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:52:56 gibba045 bash[25517]: cluster 2021-03-10T14:52:55.699417+0000 mgr.gibba045.orlgmj (mgr.34412) 3414 : cluster [DBG] pgmap v1935: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:59.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:52:58 gibba015 bash[29377]: cluster 2021-03-10T14:52:57.700766+0000 mgr.gibba045.orlgmj (mgr.34412) 3415 : cluster [DBG] pgmap v1936: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:59.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:52:58 gibba015 bash[30343]: cluster 2021-03-10T14:52:57.700766+0000 mgr.gibba045.orlgmj (mgr.34412) 3415 : cluster [DBG] pgmap v1936: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:59.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:52:58 gibba045 bash[25517]: cluster 2021-03-10T14:52:57.700766+0000 mgr.gibba045.orlgmj (mgr.34412) 3415 : cluster [DBG] pgmap v1936: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:01.212 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:53:00 gibba045 bash[25517]: cluster 2021-03-10T14:52:59.701812+0000 mgr.gibba045.orlgmj (mgr.34412) 3416 : cluster [DBG] pgmap v1937: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:01.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:53:00 gibba015 bash[29377]: cluster 2021-03-10T14:52:59.701812+0000 mgr.gibba045.orlgmj (mgr.34412) 3416 : cluster [DBG] pgmap v1937: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:01.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:53:00 gibba015 bash[30343]: cluster 2021-03-10T14:52:59.701812+0000 mgr.gibba045.orlgmj (mgr.34412) 3416 : cluster [DBG] pgmap v1937: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:03.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:53:02 gibba015 bash[29377]: cephadm 2021-03-10T14:53:01.211290+0000 mgr.gibba045.orlgmj (mgr.34412) 3417 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:53:03.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:53:02 gibba015 bash[29377]: cluster 2021-03-10T14:53:01.703437+0000 mgr.gibba045.orlgmj (mgr.34412) 3418 : cluster [DBG] pgmap v1938: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:03.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:53:02 gibba015 bash[30343]: cephadm 2021-03-10T14:53:01.211290+0000 mgr.gibba045.orlgmj (mgr.34412) 3417 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:53:03.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:53:02 gibba015 bash[30343]: cluster 2021-03-10T14:53:01.703437+0000 mgr.gibba045.orlgmj (mgr.34412) 3418 : cluster [DBG] pgmap v1938: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:03.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:53:02 gibba045 bash[25517]: cephadm 2021-03-10T14:53:01.211290+0000 mgr.gibba045.orlgmj (mgr.34412) 3417 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:53:03.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:53:02 gibba045 bash[25517]: cluster 2021-03-10T14:53:01.703437+0000 mgr.gibba045.orlgmj (mgr.34412) 3418 : cluster [DBG] pgmap v1938: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:04.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:53:04 gibba045 bash[25517]: cluster 2021-03-10T14:53:03.704758+0000 mgr.gibba045.orlgmj (mgr.34412) 3419 : cluster [DBG] pgmap v1939: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:04.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:53:04 gibba015 bash[29377]: cluster 2021-03-10T14:53:03.704758+0000 mgr.gibba045.orlgmj (mgr.34412) 3419 : cluster [DBG] pgmap v1939: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:04.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:53:04 gibba015 bash[30343]: cluster 2021-03-10T14:53:03.704758+0000 mgr.gibba045.orlgmj (mgr.34412) 3419 : cluster [DBG] pgmap v1939: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:07.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:53:06 gibba045 bash[25517]: cluster 2021-03-10T14:53:05.706610+0000 mgr.gibba045.orlgmj (mgr.34412) 3420 : cluster [DBG] pgmap v1940: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:07.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:53:06 gibba015 bash[29377]: cluster 2021-03-10T14:53:05.706610+0000 mgr.gibba045.orlgmj (mgr.34412) 3420 : cluster [DBG] pgmap v1940: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:07.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:53:06 gibba015 bash[30343]: cluster 2021-03-10T14:53:05.706610+0000 mgr.gibba045.orlgmj (mgr.34412) 3420 : cluster [DBG] pgmap v1940: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:08.792 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:53:09.048 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:53:09.048 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (63m) 9m ago 69m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:53:09.049 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (69m) 8m ago 69m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:53:09.049 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (64m) 8m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:53:09.049 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (64m) 8m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:53:09.049 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (63m) 9m ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:53:09.049 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (63m) 9m ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:53:09.050 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (62m) 8m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:53:09.050 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (63m) 9m ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:53:09.050 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (69m) 9m ago 69m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:53:09.050 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (69m) 8m ago 69m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:53:09.051 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (62m) 9m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:53:09.051 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (61m) 9m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:53:09.051 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (61m) 9m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:53:09.051 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (60m) 9m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:53:09.051 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (60m) 8m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:53:09.052 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (60m) 8m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:53:09.052 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (59m) 8m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:53:09.052 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (59m) 8m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:53:09.052 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (68m) 8m ago 69m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:53:09.052 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 8m ago 67m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:53:09.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:53:08 gibba045 bash[25517]: cluster 2021-03-10T14:53:07.708036+0000 mgr.gibba045.orlgmj (mgr.34412) 3421 : cluster [DBG] pgmap v1941: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:09.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:53:08 gibba015 bash[29377]: cluster 2021-03-10T14:53:07.708036+0000 mgr.gibba045.orlgmj (mgr.34412) 3421 : cluster [DBG] pgmap v1941: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:09.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:53:08 gibba015 bash[30343]: cluster 2021-03-10T14:53:07.708036+0000 mgr.gibba045.orlgmj (mgr.34412) 3421 : cluster [DBG] pgmap v1941: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:09.305 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:53:09.305 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:53:09.305 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:53:09.305 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:53:09.306 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:53:09.306 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:53:09.306 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:53:09.306 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:53:09.307 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:53:09.307 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:53:09.307 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:53:09.307 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:53:09.307 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:53:09.308 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:53:09.308 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:53:10.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:53:09 gibba045 bash[25517]: audit 2021-03-10T14:53:08.782622+0000 mgr.gibba045.orlgmj (mgr.34412) 3422 : audit [DBG] from='client.56344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:53:10.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:53:09 gibba045 bash[25517]: audit 2021-03-10T14:53:09.006828+0000 mgr.gibba045.orlgmj (mgr.34412) 3423 : audit [DBG] from='client.56350 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:53:10.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:53:09 gibba045 bash[25517]: audit 2021-03-10T14:53:09.301252+0000 mon.a (mon.0) 1087 : audit [DBG] from='client.? 172.21.2.115:0/2967627992' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:53:10.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:53:09 gibba015 bash[29377]: audit 2021-03-10T14:53:08.782622+0000 mgr.gibba045.orlgmj (mgr.34412) 3422 : audit [DBG] from='client.56344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:53:10.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:53:09 gibba015 bash[29377]: audit 2021-03-10T14:53:09.006828+0000 mgr.gibba045.orlgmj (mgr.34412) 3423 : audit [DBG] from='client.56350 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:53:10.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:53:09 gibba015 bash[29377]: audit 2021-03-10T14:53:09.301252+0000 mon.a (mon.0) 1087 : audit [DBG] from='client.? 172.21.2.115:0/2967627992' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:53:10.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:53:09 gibba015 bash[30343]: audit 2021-03-10T14:53:08.782622+0000 mgr.gibba045.orlgmj (mgr.34412) 3422 : audit [DBG] from='client.56344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:53:10.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:53:09 gibba015 bash[30343]: audit 2021-03-10T14:53:09.006828+0000 mgr.gibba045.orlgmj (mgr.34412) 3423 : audit [DBG] from='client.56350 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:53:10.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:53:09 gibba015 bash[30343]: audit 2021-03-10T14:53:09.301252+0000 mon.a (mon.0) 1087 : audit [DBG] from='client.? 172.21.2.115:0/2967627992' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:53:11.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:53:10 gibba045 bash[25517]: cluster 2021-03-10T14:53:09.709075+0000 mgr.gibba045.orlgmj (mgr.34412) 3424 : cluster [DBG] pgmap v1942: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:11.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:53:10 gibba015 bash[29377]: cluster 2021-03-10T14:53:09.709075+0000 mgr.gibba045.orlgmj (mgr.34412) 3424 : cluster [DBG] pgmap v1942: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:11.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:53:10 gibba015 bash[30343]: cluster 2021-03-10T14:53:09.709075+0000 mgr.gibba045.orlgmj (mgr.34412) 3424 : cluster [DBG] pgmap v1942: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:13.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:53:12 gibba045 bash[25517]: cluster 2021-03-10T14:53:11.710772+0000 mgr.gibba045.orlgmj (mgr.34412) 3425 : cluster [DBG] pgmap v1943: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:13.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:53:12 gibba015 bash[29377]: cluster 2021-03-10T14:53:11.710772+0000 mgr.gibba045.orlgmj (mgr.34412) 3425 : cluster [DBG] pgmap v1943: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:13.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:53:12 gibba015 bash[30343]: cluster 2021-03-10T14:53:11.710772+0000 mgr.gibba045.orlgmj (mgr.34412) 3425 : cluster [DBG] pgmap v1943: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:14.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:53:14 gibba045 bash[25517]: cluster 2021-03-10T14:53:13.712079+0000 mgr.gibba045.orlgmj (mgr.34412) 3426 : cluster [DBG] pgmap v1944: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:14.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:53:14 gibba015 bash[29377]: cluster 2021-03-10T14:53:13.712079+0000 mgr.gibba045.orlgmj (mgr.34412) 3426 : cluster [DBG] pgmap v1944: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:14.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:53:14 gibba015 bash[30343]: cluster 2021-03-10T14:53:13.712079+0000 mgr.gibba045.orlgmj (mgr.34412) 3426 : cluster [DBG] pgmap v1944: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:17.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:53:16 gibba045 bash[25517]: cluster 2021-03-10T14:53:15.713989+0000 mgr.gibba045.orlgmj (mgr.34412) 3427 : cluster [DBG] pgmap v1945: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:17.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:53:16 gibba045 bash[25517]: audit 2021-03-10T14:53:16.225164+0000 mon.c (mon.1) 989 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:53:17.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:53:16 gibba045 bash[25517]: audit 2021-03-10T14:53:16.427224+0000 mon.a (mon.0) 1088 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:53:17.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:53:16 gibba045 bash[25517]: audit 2021-03-10T14:53:16.431223+0000 mon.c (mon.1) 990 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:53:17.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:53:16 gibba045 bash[25517]: audit 2021-03-10T14:53:16.432583+0000 mon.c (mon.1) 991 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:53:17.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:53:16 gibba045 bash[25517]: audit 2021-03-10T14:53:16.434007+0000 mon.c (mon.1) 992 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:53:17.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:53:16 gibba045 bash[25517]: audit 2021-03-10T14:53:16.435559+0000 mon.c (mon.1) 993 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:53:17.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:53:16 gibba045 bash[25517]: audit 2021-03-10T14:53:16.438722+0000 mon.c (mon.1) 994 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:53:17.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:53:16 gibba045 bash[25517]: audit 2021-03-10T14:53:16.440195+0000 mon.c (mon.1) 995 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:53:17.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:53:16 gibba015 bash[29377]: cluster 2021-03-10T14:53:15.713989+0000 mgr.gibba045.orlgmj (mgr.34412) 3427 : cluster [DBG] pgmap v1945: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:17.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:53:16 gibba015 bash[29377]: audit 2021-03-10T14:53:16.225164+0000 mon.c (mon.1) 989 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:53:17.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:53:16 gibba015 bash[29377]: audit 2021-03-10T14:53:16.427224+0000 mon.a (mon.0) 1088 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:53:17.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:53:16 gibba015 bash[29377]: audit 2021-03-10T14:53:16.431223+0000 mon.c (mon.1) 990 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:53:17.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:53:16 gibba015 bash[29377]: audit 2021-03-10T14:53:16.432583+0000 mon.c (mon.1) 991 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:53:17.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:53:16 gibba015 bash[29377]: audit 2021-03-10T14:53:16.434007+0000 mon.c (mon.1) 992 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:53:17.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:53:16 gibba015 bash[29377]: audit 2021-03-10T14:53:16.435559+0000 mon.c (mon.1) 993 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:53:17.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:53:16 gibba015 bash[29377]: audit 2021-03-10T14:53:16.438722+0000 mon.c (mon.1) 994 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:53:17.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:53:16 gibba015 bash[29377]: audit 2021-03-10T14:53:16.440195+0000 mon.c (mon.1) 995 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:53:17.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:53:16 gibba015 bash[30343]: cluster 2021-03-10T14:53:15.713989+0000 mgr.gibba045.orlgmj (mgr.34412) 3427 : cluster [DBG] pgmap v1945: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:17.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:53:16 gibba015 bash[30343]: audit 2021-03-10T14:53:16.225164+0000 mon.c (mon.1) 989 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:53:17.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:53:16 gibba015 bash[30343]: audit 2021-03-10T14:53:16.427224+0000 mon.a (mon.0) 1088 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:53:17.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:53:16 gibba015 bash[30343]: audit 2021-03-10T14:53:16.431223+0000 mon.c (mon.1) 990 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:53:17.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:53:16 gibba015 bash[30343]: audit 2021-03-10T14:53:16.432583+0000 mon.c (mon.1) 991 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:53:17.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:53:16 gibba015 bash[30343]: audit 2021-03-10T14:53:16.434007+0000 mon.c (mon.1) 992 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:53:17.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:53:16 gibba015 bash[30343]: audit 2021-03-10T14:53:16.435559+0000 mon.c (mon.1) 993 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:53:17.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:53:16 gibba015 bash[30343]: audit 2021-03-10T14:53:16.438722+0000 mon.c (mon.1) 994 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:53:17.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:53:16 gibba015 bash[30343]: audit 2021-03-10T14:53:16.440195+0000 mon.c (mon.1) 995 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:53:18.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:53:17 gibba045 bash[25517]: cephadm 2021-03-10T14:53:16.234431+0000 mgr.gibba045.orlgmj (mgr.34412) 3428 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:53:18.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:53:17 gibba045 bash[25517]: cephadm 2021-03-10T14:53:16.235939+0000 mgr.gibba045.orlgmj (mgr.34412) 3429 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:53:18.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:53:17 gibba045 bash[25517]: cephadm 2021-03-10T14:53:16.433412+0000 mgr.gibba045.orlgmj (mgr.34412) 3430 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:53:18.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:53:17 gibba045 bash[25517]: cephadm 2021-03-10T14:53:16.435447+0000 mgr.gibba045.orlgmj (mgr.34412) 3431 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:53:18.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:53:17 gibba045 bash[25517]: cephadm 2021-03-10T14:53:16.436707+0000 mgr.gibba045.orlgmj (mgr.34412) 3432 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:53:18.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:53:17 gibba045 bash[25517]: cephadm 2021-03-10T14:53:16.436752+0000 mgr.gibba045.orlgmj (mgr.34412) 3433 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:53:18.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:53:17 gibba045 bash[25517]: cephadm 2021-03-10T14:53:16.438339+0000 mgr.gibba045.orlgmj (mgr.34412) 3434 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:53:18.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:53:17 gibba045 bash[25517]: cephadm 2021-03-10T14:53:16.438385+0000 mgr.gibba045.orlgmj (mgr.34412) 3435 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:53:18.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:53:17 gibba045 bash[25517]: cephadm 2021-03-10T14:53:16.439613+0000 mgr.gibba045.orlgmj (mgr.34412) 3436 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:53:18.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:53:17 gibba045 bash[25517]: cephadm 2021-03-10T14:53:16.441293+0000 mgr.gibba045.orlgmj (mgr.34412) 3437 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:53:18.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:53:17 gibba045 bash[25517]: cephadm 2021-03-10T14:53:16.441361+0000 mgr.gibba045.orlgmj (mgr.34412) 3438 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:53:18.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:53:17 gibba045 bash[25517]: cephadm 2021-03-10T14:53:16.442719+0000 mgr.gibba045.orlgmj (mgr.34412) 3439 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:53:18.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:53:17 gibba045 bash[25517]: cephadm 2021-03-10T14:53:16.443032+0000 mgr.gibba045.orlgmj (mgr.34412) 3440 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:53:18.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:53:17 gibba045 bash[25517]: cephadm 2021-03-10T14:53:16.444213+0000 mgr.gibba045.orlgmj (mgr.34412) 3441 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:53:18.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:53:17 gibba045 bash[25517]: cephadm 2021-03-10T14:53:16.444259+0000 mgr.gibba045.orlgmj (mgr.34412) 3442 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:53:18.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:53:17 gibba045 bash[25517]: cephadm 2021-03-10T14:53:16.444392+0000 mgr.gibba045.orlgmj (mgr.34412) 3443 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:53:18.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:53:17 gibba015 bash[29377]: cephadm 2021-03-10T14:53:16.234431+0000 mgr.gibba045.orlgmj (mgr.34412) 3428 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:53:18.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:53:17 gibba015 bash[29377]: cephadm 2021-03-10T14:53:16.235939+0000 mgr.gibba045.orlgmj (mgr.34412) 3429 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:53:18.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:53:17 gibba015 bash[29377]: cephadm 2021-03-10T14:53:16.433412+0000 mgr.gibba045.orlgmj (mgr.34412) 3430 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:53:18.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:53:17 gibba015 bash[29377]: cephadm 2021-03-10T14:53:16.435447+0000 mgr.gibba045.orlgmj (mgr.34412) 3431 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:53:18.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:53:17 gibba015 bash[29377]: cephadm 2021-03-10T14:53:16.436707+0000 mgr.gibba045.orlgmj (mgr.34412) 3432 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:53:18.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:53:17 gibba015 bash[29377]: cephadm 2021-03-10T14:53:16.436752+0000 mgr.gibba045.orlgmj (mgr.34412) 3433 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:53:18.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:53:17 gibba015 bash[29377]: cephadm 2021-03-10T14:53:16.438339+0000 mgr.gibba045.orlgmj (mgr.34412) 3434 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:53:18.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:53:17 gibba015 bash[29377]: cephadm 2021-03-10T14:53:16.438385+0000 mgr.gibba045.orlgmj (mgr.34412) 3435 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:53:18.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:53:17 gibba015 bash[29377]: cephadm 2021-03-10T14:53:16.439613+0000 mgr.gibba045.orlgmj (mgr.34412) 3436 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:53:18.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:53:17 gibba015 bash[29377]: cephadm 2021-03-10T14:53:16.441293+0000 mgr.gibba045.orlgmj (mgr.34412) 3437 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:53:18.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:53:17 gibba015 bash[29377]: cephadm 2021-03-10T14:53:16.441361+0000 mgr.gibba045.orlgmj (mgr.34412) 3438 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:53:18.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:53:17 gibba015 bash[29377]: cephadm 2021-03-10T14:53:16.442719+0000 mgr.gibba045.orlgmj (mgr.34412) 3439 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:53:18.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:53:17 gibba015 bash[29377]: cephadm 2021-03-10T14:53:16.443032+0000 mgr.gibba045.orlgmj (mgr.34412) 3440 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:53:18.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:53:17 gibba015 bash[29377]: cephadm 2021-03-10T14:53:16.444213+0000 mgr.gibba045.orlgmj (mgr.34412) 3441 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:53:18.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:53:17 gibba015 bash[29377]: cephadm 2021-03-10T14:53:16.444259+0000 mgr.gibba045.orlgmj (mgr.34412) 3442 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:53:18.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:53:17 gibba015 bash[29377]: cephadm 2021-03-10T14:53:16.444392+0000 mgr.gibba045.orlgmj (mgr.34412) 3443 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:53:18.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:53:17 gibba015 bash[30343]: cephadm 2021-03-10T14:53:16.234431+0000 mgr.gibba045.orlgmj (mgr.34412) 3428 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:53:18.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:53:17 gibba015 bash[30343]: cephadm 2021-03-10T14:53:16.235939+0000 mgr.gibba045.orlgmj (mgr.34412) 3429 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:53:18.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:53:17 gibba015 bash[30343]: cephadm 2021-03-10T14:53:16.433412+0000 mgr.gibba045.orlgmj (mgr.34412) 3430 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:53:18.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:53:17 gibba015 bash[30343]: cephadm 2021-03-10T14:53:16.435447+0000 mgr.gibba045.orlgmj (mgr.34412) 3431 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:53:18.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:53:17 gibba015 bash[30343]: cephadm 2021-03-10T14:53:16.436707+0000 mgr.gibba045.orlgmj (mgr.34412) 3432 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:53:18.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:53:17 gibba015 bash[30343]: cephadm 2021-03-10T14:53:16.436752+0000 mgr.gibba045.orlgmj (mgr.34412) 3433 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:53:18.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:53:17 gibba015 bash[30343]: cephadm 2021-03-10T14:53:16.438339+0000 mgr.gibba045.orlgmj (mgr.34412) 3434 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:53:18.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:53:17 gibba015 bash[30343]: cephadm 2021-03-10T14:53:16.438385+0000 mgr.gibba045.orlgmj (mgr.34412) 3435 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:53:18.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:53:17 gibba015 bash[30343]: cephadm 2021-03-10T14:53:16.439613+0000 mgr.gibba045.orlgmj (mgr.34412) 3436 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:53:18.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:53:17 gibba015 bash[30343]: cephadm 2021-03-10T14:53:16.441293+0000 mgr.gibba045.orlgmj (mgr.34412) 3437 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:53:18.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:53:17 gibba015 bash[30343]: cephadm 2021-03-10T14:53:16.441361+0000 mgr.gibba045.orlgmj (mgr.34412) 3438 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:53:18.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:53:17 gibba015 bash[30343]: cephadm 2021-03-10T14:53:16.442719+0000 mgr.gibba045.orlgmj (mgr.34412) 3439 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:53:18.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:53:17 gibba015 bash[30343]: cephadm 2021-03-10T14:53:16.443032+0000 mgr.gibba045.orlgmj (mgr.34412) 3440 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:53:18.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:53:17 gibba015 bash[30343]: cephadm 2021-03-10T14:53:16.444213+0000 mgr.gibba045.orlgmj (mgr.34412) 3441 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:53:18.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:53:17 gibba015 bash[30343]: cephadm 2021-03-10T14:53:16.444259+0000 mgr.gibba045.orlgmj (mgr.34412) 3442 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:53:18.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:53:17 gibba015 bash[30343]: cephadm 2021-03-10T14:53:16.444392+0000 mgr.gibba045.orlgmj (mgr.34412) 3443 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:53:19.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:53:18 gibba045 bash[25517]: cluster 2021-03-10T14:53:17.715525+0000 mgr.gibba045.orlgmj (mgr.34412) 3444 : cluster [DBG] pgmap v1946: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:19.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:53:18 gibba015 bash[29377]: cluster 2021-03-10T14:53:17.715525+0000 mgr.gibba045.orlgmj (mgr.34412) 3444 : cluster [DBG] pgmap v1946: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:19.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:53:18 gibba015 bash[30343]: cluster 2021-03-10T14:53:17.715525+0000 mgr.gibba045.orlgmj (mgr.34412) 3444 : cluster [DBG] pgmap v1946: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:21.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:53:20 gibba045 bash[25517]: cluster 2021-03-10T14:53:19.716502+0000 mgr.gibba045.orlgmj (mgr.34412) 3445 : cluster [DBG] pgmap v1947: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:21.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:53:20 gibba015 bash[29377]: cluster 2021-03-10T14:53:19.716502+0000 mgr.gibba045.orlgmj (mgr.34412) 3445 : cluster [DBG] pgmap v1947: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:21.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:53:20 gibba015 bash[30343]: cluster 2021-03-10T14:53:19.716502+0000 mgr.gibba045.orlgmj (mgr.34412) 3445 : cluster [DBG] pgmap v1947: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:23.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:53:22 gibba015 bash[29377]: cluster 2021-03-10T14:53:21.718187+0000 mgr.gibba045.orlgmj (mgr.34412) 3446 : cluster [DBG] pgmap v1948: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:23.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:53:22 gibba015 bash[30343]: cluster 2021-03-10T14:53:21.718187+0000 mgr.gibba045.orlgmj (mgr.34412) 3446 : cluster [DBG] pgmap v1948: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:23.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:53:22 gibba045 bash[25517]: cluster 2021-03-10T14:53:21.718187+0000 mgr.gibba045.orlgmj (mgr.34412) 3446 : cluster [DBG] pgmap v1948: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:24.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:53:24 gibba045 bash[25517]: cluster 2021-03-10T14:53:23.719574+0000 mgr.gibba045.orlgmj (mgr.34412) 3447 : cluster [DBG] pgmap v1949: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:24.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:53:24 gibba015 bash[29377]: cluster 2021-03-10T14:53:23.719574+0000 mgr.gibba045.orlgmj (mgr.34412) 3447 : cluster [DBG] pgmap v1949: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:24.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:53:24 gibba015 bash[30343]: cluster 2021-03-10T14:53:23.719574+0000 mgr.gibba045.orlgmj (mgr.34412) 3447 : cluster [DBG] pgmap v1949: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:27.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:53:26 gibba045 bash[25517]: cluster 2021-03-10T14:53:25.721371+0000 mgr.gibba045.orlgmj (mgr.34412) 3448 : cluster [DBG] pgmap v1950: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:27.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:53:26 gibba015 bash[29377]: cluster 2021-03-10T14:53:25.721371+0000 mgr.gibba045.orlgmj (mgr.34412) 3448 : cluster [DBG] pgmap v1950: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:27.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:53:26 gibba015 bash[30343]: cluster 2021-03-10T14:53:25.721371+0000 mgr.gibba045.orlgmj (mgr.34412) 3448 : cluster [DBG] pgmap v1950: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:29.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:53:28 gibba045 bash[25517]: cluster 2021-03-10T14:53:27.722901+0000 mgr.gibba045.orlgmj (mgr.34412) 3449 : cluster [DBG] pgmap v1951: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:29.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:53:28 gibba015 bash[29377]: cluster 2021-03-10T14:53:27.722901+0000 mgr.gibba045.orlgmj (mgr.34412) 3449 : cluster [DBG] pgmap v1951: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:29.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:53:28 gibba015 bash[30343]: cluster 2021-03-10T14:53:27.722901+0000 mgr.gibba045.orlgmj (mgr.34412) 3449 : cluster [DBG] pgmap v1951: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:31.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:53:30 gibba045 bash[25517]: cluster 2021-03-10T14:53:29.723803+0000 mgr.gibba045.orlgmj (mgr.34412) 3450 : cluster [DBG] pgmap v1952: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:31.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:53:30 gibba015 bash[29377]: cluster 2021-03-10T14:53:29.723803+0000 mgr.gibba045.orlgmj (mgr.34412) 3450 : cluster [DBG] pgmap v1952: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:31.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:53:30 gibba015 bash[30343]: cluster 2021-03-10T14:53:29.723803+0000 mgr.gibba045.orlgmj (mgr.34412) 3450 : cluster [DBG] pgmap v1952: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:33.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:53:32 gibba015 bash[29377]: cephadm 2021-03-10T14:53:31.460404+0000 mgr.gibba045.orlgmj (mgr.34412) 3451 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:53:33.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:53:32 gibba015 bash[29377]: cluster 2021-03-10T14:53:31.725264+0000 mgr.gibba045.orlgmj (mgr.34412) 3452 : cluster [DBG] pgmap v1953: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:33.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:53:32 gibba015 bash[30343]: cephadm 2021-03-10T14:53:31.460404+0000 mgr.gibba045.orlgmj (mgr.34412) 3451 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:53:33.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:53:32 gibba015 bash[30343]: cluster 2021-03-10T14:53:31.725264+0000 mgr.gibba045.orlgmj (mgr.34412) 3452 : cluster [DBG] pgmap v1953: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:33.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:53:32 gibba045 bash[25517]: cephadm 2021-03-10T14:53:31.460404+0000 mgr.gibba045.orlgmj (mgr.34412) 3451 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:53:33.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:53:32 gibba045 bash[25517]: cluster 2021-03-10T14:53:31.725264+0000 mgr.gibba045.orlgmj (mgr.34412) 3452 : cluster [DBG] pgmap v1953: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:34.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:53:34 gibba045 bash[25517]: cluster 2021-03-10T14:53:33.726595+0000 mgr.gibba045.orlgmj (mgr.34412) 3453 : cluster [DBG] pgmap v1954: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:34.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:53:34 gibba015 bash[29377]: cluster 2021-03-10T14:53:33.726595+0000 mgr.gibba045.orlgmj (mgr.34412) 3453 : cluster [DBG] pgmap v1954: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:34.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:53:34 gibba015 bash[30343]: cluster 2021-03-10T14:53:33.726595+0000 mgr.gibba045.orlgmj (mgr.34412) 3453 : cluster [DBG] pgmap v1954: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:37.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:53:36 gibba045 bash[25517]: cluster 2021-03-10T14:53:35.728564+0000 mgr.gibba045.orlgmj (mgr.34412) 3454 : cluster [DBG] pgmap v1955: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:37.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:53:36 gibba015 bash[29377]: cluster 2021-03-10T14:53:35.728564+0000 mgr.gibba045.orlgmj (mgr.34412) 3454 : cluster [DBG] pgmap v1955: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:37.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:53:36 gibba015 bash[30343]: cluster 2021-03-10T14:53:35.728564+0000 mgr.gibba045.orlgmj (mgr.34412) 3454 : cluster [DBG] pgmap v1955: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:39.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:53:38 gibba045 bash[25517]: cluster 2021-03-10T14:53:37.730155+0000 mgr.gibba045.orlgmj (mgr.34412) 3455 : cluster [DBG] pgmap v1956: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:39.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:53:38 gibba015 bash[29377]: cluster 2021-03-10T14:53:37.730155+0000 mgr.gibba045.orlgmj (mgr.34412) 3455 : cluster [DBG] pgmap v1956: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:39.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:53:38 gibba015 bash[30343]: cluster 2021-03-10T14:53:37.730155+0000 mgr.gibba045.orlgmj (mgr.34412) 3455 : cluster [DBG] pgmap v1956: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:39.557 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:53:39.813 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:53:39.813 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (64m) 9m ago 69m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:53:39.813 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (69m) 8m ago 69m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:53:39.814 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (64m) 8m ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:53:39.814 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (65m) 8m ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:53:39.814 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (64m) 9m ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:53:39.814 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (63m) 9m ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:53:39.815 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (63m) 8m ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:53:39.815 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (63m) 9m ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:53:39.815 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (69m) 9m ago 69m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:53:39.815 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (69m) 8m ago 69m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:53:39.816 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (62m) 9m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:53:39.816 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (62m) 9m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:53:39.816 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (61m) 9m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:53:39.816 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (61m) 9m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:53:39.817 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (60m) 8m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:53:39.817 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (60m) 8m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:53:39.817 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (60m) 8m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:53:39.817 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (59m) 8m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:53:39.817 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (69m) 8m ago 69m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:53:39.818 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 8m ago 67m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:53:40.065 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:53:40.065 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:53:40.066 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:53:40.066 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:53:40.066 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:53:40.066 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:53:40.066 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:53:40.067 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:53:40.067 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:53:40.067 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:53:40.067 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:53:40.068 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:53:40.068 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:53:40.068 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:53:40.068 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:53:41.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:53:40 gibba015 bash[29377]: audit 2021-03-10T14:53:39.538985+0000 mgr.gibba045.orlgmj (mgr.34412) 3456 : audit [DBG] from='client.46374 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:53:41.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:53:40 gibba015 bash[29377]: cluster 2021-03-10T14:53:39.731852+0000 mgr.gibba045.orlgmj (mgr.34412) 3457 : cluster [DBG] pgmap v1957: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:41.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:53:40 gibba015 bash[29377]: audit 2021-03-10T14:53:39.791398+0000 mgr.gibba045.orlgmj (mgr.34412) 3458 : audit [DBG] from='client.46380 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:53:41.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:53:40 gibba015 bash[29377]: audit 2021-03-10T14:53:40.061544+0000 mon.a (mon.0) 1089 : audit [DBG] from='client.? 172.21.2.115:0/539627190' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:53:41.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:53:40 gibba015 bash[30343]: audit 2021-03-10T14:53:39.538985+0000 mgr.gibba045.orlgmj (mgr.34412) 3456 : audit [DBG] from='client.46374 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:53:41.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:53:40 gibba015 bash[30343]: cluster 2021-03-10T14:53:39.731852+0000 mgr.gibba045.orlgmj (mgr.34412) 3457 : cluster [DBG] pgmap v1957: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:41.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:53:40 gibba015 bash[30343]: audit 2021-03-10T14:53:39.791398+0000 mgr.gibba045.orlgmj (mgr.34412) 3458 : audit [DBG] from='client.46380 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:53:41.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:53:40 gibba015 bash[30343]: audit 2021-03-10T14:53:40.061544+0000 mon.a (mon.0) 1089 : audit [DBG] from='client.? 172.21.2.115:0/539627190' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:53:41.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:53:40 gibba045 bash[25517]: audit 2021-03-10T14:53:39.538985+0000 mgr.gibba045.orlgmj (mgr.34412) 3456 : audit [DBG] from='client.46374 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:53:41.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:53:40 gibba045 bash[25517]: cluster 2021-03-10T14:53:39.731852+0000 mgr.gibba045.orlgmj (mgr.34412) 3457 : cluster [DBG] pgmap v1957: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:41.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:53:40 gibba045 bash[25517]: audit 2021-03-10T14:53:39.791398+0000 mgr.gibba045.orlgmj (mgr.34412) 3458 : audit [DBG] from='client.46380 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:53:41.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:53:40 gibba045 bash[25517]: audit 2021-03-10T14:53:40.061544+0000 mon.a (mon.0) 1089 : audit [DBG] from='client.? 172.21.2.115:0/539627190' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:53:43.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:53:42 gibba015 bash[29377]: cluster 2021-03-10T14:53:41.733638+0000 mgr.gibba045.orlgmj (mgr.34412) 3459 : cluster [DBG] pgmap v1958: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:43.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:53:42 gibba015 bash[30343]: cluster 2021-03-10T14:53:41.733638+0000 mgr.gibba045.orlgmj (mgr.34412) 3459 : cluster [DBG] pgmap v1958: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:43.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:53:42 gibba045 bash[25517]: cluster 2021-03-10T14:53:41.733638+0000 mgr.gibba045.orlgmj (mgr.34412) 3459 : cluster [DBG] pgmap v1958: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:44.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:53:44 gibba045 bash[25517]: cluster 2021-03-10T14:53:43.734936+0000 mgr.gibba045.orlgmj (mgr.34412) 3460 : cluster [DBG] pgmap v1959: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:44.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:53:44 gibba015 bash[29377]: cluster 2021-03-10T14:53:43.734936+0000 mgr.gibba045.orlgmj (mgr.34412) 3460 : cluster [DBG] pgmap v1959: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:44.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:53:44 gibba015 bash[30343]: cluster 2021-03-10T14:53:43.734936+0000 mgr.gibba045.orlgmj (mgr.34412) 3460 : cluster [DBG] pgmap v1959: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:47.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:53:46 gibba045 bash[25517]: cluster 2021-03-10T14:53:45.736770+0000 mgr.gibba045.orlgmj (mgr.34412) 3461 : cluster [DBG] pgmap v1960: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:47.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:53:46 gibba015 bash[29377]: cluster 2021-03-10T14:53:45.736770+0000 mgr.gibba045.orlgmj (mgr.34412) 3461 : cluster [DBG] pgmap v1960: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:47.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:53:46 gibba015 bash[30343]: cluster 2021-03-10T14:53:45.736770+0000 mgr.gibba045.orlgmj (mgr.34412) 3461 : cluster [DBG] pgmap v1960: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:48.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:53:47 gibba015 bash[29377]: cephadm 2021-03-10T14:53:46.476513+0000 mgr.gibba045.orlgmj (mgr.34412) 3462 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:53:48.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:53:47 gibba015 bash[30343]: cephadm 2021-03-10T14:53:46.476513+0000 mgr.gibba045.orlgmj (mgr.34412) 3462 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:53:48.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:53:47 gibba045 bash[25517]: cephadm 2021-03-10T14:53:46.476513+0000 mgr.gibba045.orlgmj (mgr.34412) 3462 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:53:49.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:53:48 gibba015 bash[29377]: cluster 2021-03-10T14:53:47.738485+0000 mgr.gibba045.orlgmj (mgr.34412) 3463 : cluster [DBG] pgmap v1961: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:49.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:53:48 gibba015 bash[30343]: cluster 2021-03-10T14:53:47.738485+0000 mgr.gibba045.orlgmj (mgr.34412) 3463 : cluster [DBG] pgmap v1961: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:49.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:53:48 gibba045 bash[25517]: cluster 2021-03-10T14:53:47.738485+0000 mgr.gibba045.orlgmj (mgr.34412) 3463 : cluster [DBG] pgmap v1961: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:51.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:53:50 gibba015 bash[29377]: cluster 2021-03-10T14:53:49.740221+0000 mgr.gibba045.orlgmj (mgr.34412) 3464 : cluster [DBG] pgmap v1962: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:51.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:53:50 gibba015 bash[30343]: cluster 2021-03-10T14:53:49.740221+0000 mgr.gibba045.orlgmj (mgr.34412) 3464 : cluster [DBG] pgmap v1962: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:51.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:53:50 gibba045 bash[25517]: cluster 2021-03-10T14:53:49.740221+0000 mgr.gibba045.orlgmj (mgr.34412) 3464 : cluster [DBG] pgmap v1962: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:53.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:53:52 gibba015 bash[29377]: cluster 2021-03-10T14:53:51.741633+0000 mgr.gibba045.orlgmj (mgr.34412) 3465 : cluster [DBG] pgmap v1963: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:53.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:53:52 gibba015 bash[30343]: cluster 2021-03-10T14:53:51.741633+0000 mgr.gibba045.orlgmj (mgr.34412) 3465 : cluster [DBG] pgmap v1963: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:53.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:53:52 gibba045 bash[25517]: cluster 2021-03-10T14:53:51.741633+0000 mgr.gibba045.orlgmj (mgr.34412) 3465 : cluster [DBG] pgmap v1963: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:54.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:53:53 gibba015 bash[29377]: audit 2021-03-10T14:53:52.899255+0000 mon.c (mon.1) 996 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:53:54.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:53:53 gibba015 bash[29377]: audit 2021-03-10T14:53:52.899885+0000 mon.c (mon.1) 997 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:53:54.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:53:53 gibba015 bash[29377]: audit 2021-03-10T14:53:52.900427+0000 mon.a (mon.0) 1090 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:53:54.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:53:53 gibba015 bash[29377]: audit 2021-03-10T14:53:52.901655+0000 mon.a (mon.0) 1091 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:53:54.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:53:53 gibba015 bash[29377]: audit 2021-03-10T14:53:52.908495+0000 mon.c (mon.1) 998 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T14:53:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:53:53 gibba015 bash[29377]: audit 2021-03-10T14:53:52.909254+0000 mon.c (mon.1) 999 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:53:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:53:53 gibba015 bash[29377]: audit 2021-03-10T14:53:52.909631+0000 mon.a (mon.0) 1092 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T14:53:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:53:53 gibba015 bash[29377]: audit 2021-03-10T14:53:52.909938+0000 mon.c (mon.1) 1000 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:53:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:53:53 gibba015 bash[29377]: audit 2021-03-10T14:53:52.910967+0000 mon.a (mon.0) 1093 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:53:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:53:53 gibba015 bash[29377]: audit 2021-03-10T14:53:52.911044+0000 mon.c (mon.1) 1001 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:53:54.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:53:53 gibba015 bash[29377]: audit 2021-03-10T14:53:52.911975+0000 mon.a (mon.0) 1094 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:53:54.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:53:53 gibba015 bash[29377]: audit 2021-03-10T14:53:52.913035+0000 mon.a (mon.0) 1095 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:53:54.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:53:53 gibba015 bash[30343]: audit 2021-03-10T14:53:52.899255+0000 mon.c (mon.1) 996 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:53:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:53:53 gibba015 bash[30343]: audit 2021-03-10T14:53:52.899885+0000 mon.c (mon.1) 997 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:53:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:53:53 gibba015 bash[30343]: audit 2021-03-10T14:53:52.900427+0000 mon.a (mon.0) 1090 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:53:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:53:53 gibba015 bash[30343]: audit 2021-03-10T14:53:52.901655+0000 mon.a (mon.0) 1091 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:53:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:53:53 gibba015 bash[30343]: audit 2021-03-10T14:53:52.908495+0000 mon.c (mon.1) 998 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T14:53:54.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:53:53 gibba015 bash[30343]: audit 2021-03-10T14:53:52.909254+0000 mon.c (mon.1) 999 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:53:54.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:53:53 gibba015 bash[30343]: audit 2021-03-10T14:53:52.909631+0000 mon.a (mon.0) 1092 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T14:53:54.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:53:53 gibba015 bash[30343]: audit 2021-03-10T14:53:52.909938+0000 mon.c (mon.1) 1000 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:53:54.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:53:53 gibba015 bash[30343]: audit 2021-03-10T14:53:52.910967+0000 mon.a (mon.0) 1093 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:53:54.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:53:53 gibba015 bash[30343]: audit 2021-03-10T14:53:52.911044+0000 mon.c (mon.1) 1001 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:53:54.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:53:53 gibba015 bash[30343]: audit 2021-03-10T14:53:52.911975+0000 mon.a (mon.0) 1094 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:53:54.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:53:53 gibba015 bash[30343]: audit 2021-03-10T14:53:52.913035+0000 mon.a (mon.0) 1095 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:53:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:53:53 gibba045 bash[25517]: audit 2021-03-10T14:53:52.899255+0000 mon.c (mon.1) 996 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:53:54.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:53:53 gibba045 bash[25517]: audit 2021-03-10T14:53:52.899885+0000 mon.c (mon.1) 997 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:53:54.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:53:53 gibba045 bash[25517]: audit 2021-03-10T14:53:52.900427+0000 mon.a (mon.0) 1090 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:53:54.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:53:53 gibba045 bash[25517]: audit 2021-03-10T14:53:52.901655+0000 mon.a (mon.0) 1091 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:53:54.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:53:53 gibba045 bash[25517]: audit 2021-03-10T14:53:52.908495+0000 mon.c (mon.1) 998 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T14:53:54.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:53:53 gibba045 bash[25517]: audit 2021-03-10T14:53:52.909254+0000 mon.c (mon.1) 999 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:53:54.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:53:53 gibba045 bash[25517]: audit 2021-03-10T14:53:52.909631+0000 mon.a (mon.0) 1092 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T14:53:54.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:53:53 gibba045 bash[25517]: audit 2021-03-10T14:53:52.909938+0000 mon.c (mon.1) 1000 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:53:54.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:53:53 gibba045 bash[25517]: audit 2021-03-10T14:53:52.910967+0000 mon.a (mon.0) 1093 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:53:54.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:53:53 gibba045 bash[25517]: audit 2021-03-10T14:53:52.911044+0000 mon.c (mon.1) 1001 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:53:54.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:53:53 gibba045 bash[25517]: audit 2021-03-10T14:53:52.911975+0000 mon.a (mon.0) 1094 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:53:54.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:53:53 gibba045 bash[25517]: audit 2021-03-10T14:53:52.913035+0000 mon.a (mon.0) 1095 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:53:55.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:53:54 gibba015 bash[29377]: cluster 2021-03-10T14:53:53.742830+0000 mgr.gibba045.orlgmj (mgr.34412) 3466 : cluster [DBG] pgmap v1964: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:55.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:53:54 gibba015 bash[30343]: cluster 2021-03-10T14:53:53.742830+0000 mgr.gibba045.orlgmj (mgr.34412) 3466 : cluster [DBG] pgmap v1964: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:55.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:53:54 gibba045 bash[25517]: cluster 2021-03-10T14:53:53.742830+0000 mgr.gibba045.orlgmj (mgr.34412) 3466 : cluster [DBG] pgmap v1964: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:57.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:53:56 gibba015 bash[29377]: cluster 2021-03-10T14:53:55.744652+0000 mgr.gibba045.orlgmj (mgr.34412) 3467 : cluster [DBG] pgmap v1965: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:57.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:53:56 gibba015 bash[30343]: cluster 2021-03-10T14:53:55.744652+0000 mgr.gibba045.orlgmj (mgr.34412) 3467 : cluster [DBG] pgmap v1965: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:57.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:53:56 gibba045 bash[25517]: cluster 2021-03-10T14:53:55.744652+0000 mgr.gibba045.orlgmj (mgr.34412) 3467 : cluster [DBG] pgmap v1965: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:59.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:53:58 gibba015 bash[29377]: cluster 2021-03-10T14:53:57.746110+0000 mgr.gibba045.orlgmj (mgr.34412) 3468 : cluster [DBG] pgmap v1966: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:59.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:53:58 gibba015 bash[30343]: cluster 2021-03-10T14:53:57.746110+0000 mgr.gibba045.orlgmj (mgr.34412) 3468 : cluster [DBG] pgmap v1966: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:59.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:53:58 gibba045 bash[25517]: cluster 2021-03-10T14:53:57.746110+0000 mgr.gibba045.orlgmj (mgr.34412) 3468 : cluster [DBG] pgmap v1966: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:01.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:54:00 gibba015 bash[29377]: cluster 2021-03-10T14:53:59.747447+0000 mgr.gibba045.orlgmj (mgr.34412) 3469 : cluster [DBG] pgmap v1967: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:01.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:54:00 gibba015 bash[30343]: cluster 2021-03-10T14:53:59.747447+0000 mgr.gibba045.orlgmj (mgr.34412) 3469 : cluster [DBG] pgmap v1967: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:01.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:54:00 gibba045 bash[25517]: cluster 2021-03-10T14:53:59.747447+0000 mgr.gibba045.orlgmj (mgr.34412) 3469 : cluster [DBG] pgmap v1967: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:03.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:54:02 gibba015 bash[29377]: cephadm 2021-03-10T14:54:01.492652+0000 mgr.gibba045.orlgmj (mgr.34412) 3470 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:54:03.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:54:02 gibba015 bash[29377]: cluster 2021-03-10T14:54:01.749177+0000 mgr.gibba045.orlgmj (mgr.34412) 3471 : cluster [DBG] pgmap v1968: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:03.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:54:02 gibba015 bash[30343]: cephadm 2021-03-10T14:54:01.492652+0000 mgr.gibba045.orlgmj (mgr.34412) 3470 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:54:03.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:54:02 gibba015 bash[30343]: cluster 2021-03-10T14:54:01.749177+0000 mgr.gibba045.orlgmj (mgr.34412) 3471 : cluster [DBG] pgmap v1968: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:03.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:54:02 gibba045 bash[25517]: cephadm 2021-03-10T14:54:01.492652+0000 mgr.gibba045.orlgmj (mgr.34412) 3470 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:54:03.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:54:02 gibba045 bash[25517]: cluster 2021-03-10T14:54:01.749177+0000 mgr.gibba045.orlgmj (mgr.34412) 3471 : cluster [DBG] pgmap v1968: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:04.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:54:04 gibba045 bash[25517]: cluster 2021-03-10T14:54:03.750551+0000 mgr.gibba045.orlgmj (mgr.34412) 3472 : cluster [DBG] pgmap v1969: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:04.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:54:04 gibba015 bash[29377]: cluster 2021-03-10T14:54:03.750551+0000 mgr.gibba045.orlgmj (mgr.34412) 3472 : cluster [DBG] pgmap v1969: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:04.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:54:04 gibba015 bash[30343]: cluster 2021-03-10T14:54:03.750551+0000 mgr.gibba045.orlgmj (mgr.34412) 3472 : cluster [DBG] pgmap v1969: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:07.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:54:06 gibba015 bash[29377]: cluster 2021-03-10T14:54:05.752395+0000 mgr.gibba045.orlgmj (mgr.34412) 3473 : cluster [DBG] pgmap v1970: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:07.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:54:06 gibba015 bash[30343]: cluster 2021-03-10T14:54:05.752395+0000 mgr.gibba045.orlgmj (mgr.34412) 3473 : cluster [DBG] pgmap v1970: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:07.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:54:06 gibba045 bash[25517]: cluster 2021-03-10T14:54:05.752395+0000 mgr.gibba045.orlgmj (mgr.34412) 3473 : cluster [DBG] pgmap v1970: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:09.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:54:08 gibba015 bash[29377]: cluster 2021-03-10T14:54:07.754135+0000 mgr.gibba045.orlgmj (mgr.34412) 3474 : cluster [DBG] pgmap v1971: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:09.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:54:08 gibba015 bash[30343]: cluster 2021-03-10T14:54:07.754135+0000 mgr.gibba045.orlgmj (mgr.34412) 3474 : cluster [DBG] pgmap v1971: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:09.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:54:08 gibba045 bash[25517]: cluster 2021-03-10T14:54:07.754135+0000 mgr.gibba045.orlgmj (mgr.34412) 3474 : cluster [DBG] pgmap v1971: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:10.306 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:54:10.531 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:54:10.532 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (64m) 10m ago 70m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:54:10.532 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (70m) 9m ago 70m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:54:10.532 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (65m) 9m ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:54:10.533 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (65m) 9m ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:54:10.533 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (64m) 10m ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:54:10.533 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (64m) 10m ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:54:10.533 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (63m) 9m ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:54:10.533 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (64m) 10m ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:54:10.534 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (70m) 10m ago 70m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:54:10.534 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (70m) 9m ago 70m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:54:10.534 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (63m) 10m ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:54:10.534 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (62m) 10m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:54:10.535 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (62m) 10m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:54:10.535 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (61m) 10m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:54:10.535 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (61m) 9m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:54:10.535 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (61m) 9m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:54:10.535 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (60m) 9m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:54:10.536 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (60m) 9m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:54:10.536 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (69m) 9m ago 70m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:54:10.536 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 9m ago 68m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:54:10.777 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:54:10.777 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:54:10.777 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:54:10.778 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:54:10.778 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:54:10.778 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:54:10.778 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:54:10.779 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:54:10.779 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:54:10.779 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:54:10.779 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:54:10.779 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:54:10.780 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:54:10.780 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:54:10.780 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:54:11.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:54:10 gibba015 bash[29377]: cluster 2021-03-10T14:54:09.755885+0000 mgr.gibba045.orlgmj (mgr.34412) 3475 : cluster [DBG] pgmap v1972: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:11.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:54:10 gibba015 bash[29377]: audit 2021-03-10T14:54:10.773183+0000 mon.c (mon.1) 1002 : audit [DBG] from='client.? 172.21.2.115:0/2052802665' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:54:11.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:54:10 gibba015 bash[30343]: cluster 2021-03-10T14:54:09.755885+0000 mgr.gibba045.orlgmj (mgr.34412) 3475 : cluster [DBG] pgmap v1972: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:11.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:54:10 gibba015 bash[30343]: audit 2021-03-10T14:54:10.773183+0000 mon.c (mon.1) 1002 : audit [DBG] from='client.? 172.21.2.115:0/2052802665' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:54:11.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:54:10 gibba045 bash[25517]: cluster 2021-03-10T14:54:09.755885+0000 mgr.gibba045.orlgmj (mgr.34412) 3475 : cluster [DBG] pgmap v1972: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:11.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:54:10 gibba045 bash[25517]: audit 2021-03-10T14:54:10.773183+0000 mon.c (mon.1) 1002 : audit [DBG] from='client.? 172.21.2.115:0/2052802665' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:54:12.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:54:11 gibba015 bash[29377]: audit 2021-03-10T14:54:10.296273+0000 mgr.gibba045.orlgmj (mgr.34412) 3476 : audit [DBG] from='client.46392 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:54:12.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:54:11 gibba015 bash[29377]: audit 2021-03-10T14:54:10.518797+0000 mgr.gibba045.orlgmj (mgr.34412) 3477 : audit [DBG] from='client.46398 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:54:12.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:54:11 gibba015 bash[30343]: audit 2021-03-10T14:54:10.296273+0000 mgr.gibba045.orlgmj (mgr.34412) 3476 : audit [DBG] from='client.46392 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:54:12.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:54:11 gibba015 bash[30343]: audit 2021-03-10T14:54:10.518797+0000 mgr.gibba045.orlgmj (mgr.34412) 3477 : audit [DBG] from='client.46398 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:54:12.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:54:11 gibba045 bash[25517]: audit 2021-03-10T14:54:10.296273+0000 mgr.gibba045.orlgmj (mgr.34412) 3476 : audit [DBG] from='client.46392 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:54:12.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:54:11 gibba045 bash[25517]: audit 2021-03-10T14:54:10.518797+0000 mgr.gibba045.orlgmj (mgr.34412) 3477 : audit [DBG] from='client.46398 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:54:13.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:54:12 gibba015 bash[29377]: cluster 2021-03-10T14:54:11.757688+0000 mgr.gibba045.orlgmj (mgr.34412) 3478 : cluster [DBG] pgmap v1973: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:13.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:54:12 gibba015 bash[30343]: cluster 2021-03-10T14:54:11.757688+0000 mgr.gibba045.orlgmj (mgr.34412) 3478 : cluster [DBG] pgmap v1973: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:13.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:54:12 gibba045 bash[25517]: cluster 2021-03-10T14:54:11.757688+0000 mgr.gibba045.orlgmj (mgr.34412) 3478 : cluster [DBG] pgmap v1973: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:14.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:54:14 gibba045 bash[25517]: cluster 2021-03-10T14:54:13.758880+0000 mgr.gibba045.orlgmj (mgr.34412) 3479 : cluster [DBG] pgmap v1974: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:14.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:54:14 gibba015 bash[29377]: cluster 2021-03-10T14:54:13.758880+0000 mgr.gibba045.orlgmj (mgr.34412) 3479 : cluster [DBG] pgmap v1974: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:14.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:54:14 gibba015 bash[30343]: cluster 2021-03-10T14:54:13.758880+0000 mgr.gibba045.orlgmj (mgr.34412) 3479 : cluster [DBG] pgmap v1974: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:17.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:54:16 gibba015 bash[29377]: cluster 2021-03-10T14:54:15.760646+0000 mgr.gibba045.orlgmj (mgr.34412) 3480 : cluster [DBG] pgmap v1975: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:17.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:54:16 gibba015 bash[29377]: audit 2021-03-10T14:54:16.506409+0000 mon.c (mon.1) 1003 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:54:17.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:54:16 gibba015 bash[29377]: audit 2021-03-10T14:54:16.513551+0000 mon.c (mon.1) 1004 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:54:17.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:54:16 gibba015 bash[30343]: cluster 2021-03-10T14:54:15.760646+0000 mgr.gibba045.orlgmj (mgr.34412) 3480 : cluster [DBG] pgmap v1975: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:17.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:54:16 gibba015 bash[30343]: audit 2021-03-10T14:54:16.506409+0000 mon.c (mon.1) 1003 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:54:17.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:54:16 gibba015 bash[30343]: audit 2021-03-10T14:54:16.513551+0000 mon.c (mon.1) 1004 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:54:17.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:54:16 gibba045 bash[25517]: cluster 2021-03-10T14:54:15.760646+0000 mgr.gibba045.orlgmj (mgr.34412) 3480 : cluster [DBG] pgmap v1975: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:17.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:54:16 gibba045 bash[25517]: audit 2021-03-10T14:54:16.506409+0000 mon.c (mon.1) 1003 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:54:17.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:54:16 gibba045 bash[25517]: audit 2021-03-10T14:54:16.513551+0000 mon.c (mon.1) 1004 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:54:18.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:54:17 gibba015 bash[29377]: cephadm 2021-03-10T14:54:16.516283+0000 mgr.gibba045.orlgmj (mgr.34412) 3481 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:54:18.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:54:17 gibba015 bash[30343]: cephadm 2021-03-10T14:54:16.516283+0000 mgr.gibba045.orlgmj (mgr.34412) 3481 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:54:18.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:54:17 gibba045 bash[25517]: cephadm 2021-03-10T14:54:16.516283+0000 mgr.gibba045.orlgmj (mgr.34412) 3481 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:54:19.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:54:18 gibba015 bash[29377]: cluster 2021-03-10T14:54:17.761991+0000 mgr.gibba045.orlgmj (mgr.34412) 3482 : cluster [DBG] pgmap v1976: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:19.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:54:18 gibba015 bash[30343]: cluster 2021-03-10T14:54:17.761991+0000 mgr.gibba045.orlgmj (mgr.34412) 3482 : cluster [DBG] pgmap v1976: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:19.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:54:18 gibba045 bash[25517]: cluster 2021-03-10T14:54:17.761991+0000 mgr.gibba045.orlgmj (mgr.34412) 3482 : cluster [DBG] pgmap v1976: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:21.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:54:21 gibba015 bash[29377]: cluster 2021-03-10T14:54:19.763680+0000 mgr.gibba045.orlgmj (mgr.34412) 3483 : cluster [DBG] pgmap v1977: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:21.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:54:21 gibba015 bash[29377]: audit 2021-03-10T14:54:20.071994+0000 mon.a (mon.0) 1096 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:54:21.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:54:21 gibba015 bash[29377]: cephadm 2021-03-10T14:54:20.076331+0000 mgr.gibba045.orlgmj (mgr.34412) 3484 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:54:21.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:54:21 gibba015 bash[29377]: audit 2021-03-10T14:54:20.285917+0000 mon.a (mon.0) 1097 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:54:21.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:54:21 gibba015 bash[29377]: audit 2021-03-10T14:54:20.293239+0000 mon.c (mon.1) 1005 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:54:21.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:54:21 gibba015 bash[29377]: audit 2021-03-10T14:54:20.295135+0000 mon.c (mon.1) 1006 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:54:21.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:54:21 gibba015 bash[29377]: audit 2021-03-10T14:54:20.296852+0000 mon.c (mon.1) 1007 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:54:21.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:54:21 gibba015 bash[29377]: audit 2021-03-10T14:54:20.298329+0000 mon.c (mon.1) 1008 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:54:21.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:54:21 gibba015 bash[29377]: audit 2021-03-10T14:54:20.301880+0000 mon.c (mon.1) 1009 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:54:21.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:54:21 gibba015 bash[29377]: audit 2021-03-10T14:54:20.303650+0000 mon.c (mon.1) 1010 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:54:21.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:54:21 gibba015 bash[30343]: cluster 2021-03-10T14:54:19.763680+0000 mgr.gibba045.orlgmj (mgr.34412) 3483 : cluster [DBG] pgmap v1977: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:21.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:54:21 gibba015 bash[30343]: audit 2021-03-10T14:54:20.071994+0000 mon.a (mon.0) 1096 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:54:21.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:54:21 gibba015 bash[30343]: cephadm 2021-03-10T14:54:20.076331+0000 mgr.gibba045.orlgmj (mgr.34412) 3484 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:54:21.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:54:21 gibba015 bash[30343]: audit 2021-03-10T14:54:20.285917+0000 mon.a (mon.0) 1097 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:54:21.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:54:21 gibba015 bash[30343]: audit 2021-03-10T14:54:20.293239+0000 mon.c (mon.1) 1005 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:54:21.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:54:21 gibba015 bash[30343]: audit 2021-03-10T14:54:20.295135+0000 mon.c (mon.1) 1006 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:54:21.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:54:21 gibba015 bash[30343]: audit 2021-03-10T14:54:20.296852+0000 mon.c (mon.1) 1007 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:54:21.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:54:21 gibba015 bash[30343]: audit 2021-03-10T14:54:20.298329+0000 mon.c (mon.1) 1008 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:54:21.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:54:21 gibba015 bash[30343]: audit 2021-03-10T14:54:20.301880+0000 mon.c (mon.1) 1009 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:54:21.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:54:21 gibba015 bash[30343]: audit 2021-03-10T14:54:20.303650+0000 mon.c (mon.1) 1010 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:54:21.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:54:21 gibba045 bash[25517]: cluster 2021-03-10T14:54:19.763680+0000 mgr.gibba045.orlgmj (mgr.34412) 3483 : cluster [DBG] pgmap v1977: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:21.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:54:21 gibba045 bash[25517]: audit 2021-03-10T14:54:20.071994+0000 mon.a (mon.0) 1096 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:54:21.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:54:21 gibba045 bash[25517]: cephadm 2021-03-10T14:54:20.076331+0000 mgr.gibba045.orlgmj (mgr.34412) 3484 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:54:21.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:54:21 gibba045 bash[25517]: audit 2021-03-10T14:54:20.285917+0000 mon.a (mon.0) 1097 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:54:21.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:54:21 gibba045 bash[25517]: audit 2021-03-10T14:54:20.293239+0000 mon.c (mon.1) 1005 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:54:21.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:54:21 gibba045 bash[25517]: audit 2021-03-10T14:54:20.295135+0000 mon.c (mon.1) 1006 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:54:21.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:54:21 gibba045 bash[25517]: audit 2021-03-10T14:54:20.296852+0000 mon.c (mon.1) 1007 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:54:21.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:54:21 gibba045 bash[25517]: audit 2021-03-10T14:54:20.298329+0000 mon.c (mon.1) 1008 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:54:21.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:54:21 gibba045 bash[25517]: audit 2021-03-10T14:54:20.301880+0000 mon.c (mon.1) 1009 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:54:21.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:54:21 gibba045 bash[25517]: audit 2021-03-10T14:54:20.303650+0000 mon.c (mon.1) 1010 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:54:22.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:54:22 gibba015 bash[29377]: cephadm 2021-03-10T14:54:20.295435+0000 mgr.gibba045.orlgmj (mgr.34412) 3485 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:54:22.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:54:22 gibba015 bash[29377]: cephadm 2021-03-10T14:54:20.298002+0000 mgr.gibba045.orlgmj (mgr.34412) 3486 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:54:22.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:54:22 gibba015 bash[29377]: cephadm 2021-03-10T14:54:20.299519+0000 mgr.gibba045.orlgmj (mgr.34412) 3487 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:54:22.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:54:22 gibba015 bash[29377]: cephadm 2021-03-10T14:54:20.299557+0000 mgr.gibba045.orlgmj (mgr.34412) 3488 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:54:22.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:54:22 gibba015 bash[29377]: cephadm 2021-03-10T14:54:20.301140+0000 mgr.gibba045.orlgmj (mgr.34412) 3489 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:54:22.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:54:22 gibba015 bash[29377]: cephadm 2021-03-10T14:54:20.301183+0000 mgr.gibba045.orlgmj (mgr.34412) 3490 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:54:22.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:54:22 gibba015 bash[29377]: cephadm 2021-03-10T14:54:20.302656+0000 mgr.gibba045.orlgmj (mgr.34412) 3491 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:54:22.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:54:22 gibba015 bash[29377]: cephadm 2021-03-10T14:54:20.304535+0000 mgr.gibba045.orlgmj (mgr.34412) 3492 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:54:22.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:54:22 gibba015 bash[29377]: cephadm 2021-03-10T14:54:20.304574+0000 mgr.gibba045.orlgmj (mgr.34412) 3493 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:54:22.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:54:22 gibba015 bash[29377]: cephadm 2021-03-10T14:54:20.306053+0000 mgr.gibba045.orlgmj (mgr.34412) 3494 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:54:22.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:54:22 gibba015 bash[29377]: cephadm 2021-03-10T14:54:20.306486+0000 mgr.gibba045.orlgmj (mgr.34412) 3495 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:54:22.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:54:22 gibba015 bash[29377]: cephadm 2021-03-10T14:54:20.308117+0000 mgr.gibba045.orlgmj (mgr.34412) 3496 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:54:22.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:54:22 gibba015 bash[29377]: cephadm 2021-03-10T14:54:20.308158+0000 mgr.gibba045.orlgmj (mgr.34412) 3497 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:54:22.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:54:22 gibba015 bash[29377]: cephadm 2021-03-10T14:54:20.308280+0000 mgr.gibba045.orlgmj (mgr.34412) 3498 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:54:22.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:54:22 gibba015 bash[30343]: cephadm 2021-03-10T14:54:20.295435+0000 mgr.gibba045.orlgmj (mgr.34412) 3485 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:54:22.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:54:22 gibba015 bash[30343]: cephadm 2021-03-10T14:54:20.298002+0000 mgr.gibba045.orlgmj (mgr.34412) 3486 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:54:22.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:54:22 gibba015 bash[30343]: cephadm 2021-03-10T14:54:20.299519+0000 mgr.gibba045.orlgmj (mgr.34412) 3487 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:54:22.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:54:22 gibba015 bash[30343]: cephadm 2021-03-10T14:54:20.299557+0000 mgr.gibba045.orlgmj (mgr.34412) 3488 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:54:22.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:54:22 gibba015 bash[30343]: cephadm 2021-03-10T14:54:20.301140+0000 mgr.gibba045.orlgmj (mgr.34412) 3489 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:54:22.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:54:22 gibba015 bash[30343]: cephadm 2021-03-10T14:54:20.301183+0000 mgr.gibba045.orlgmj (mgr.34412) 3490 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:54:22.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:54:22 gibba015 bash[30343]: cephadm 2021-03-10T14:54:20.302656+0000 mgr.gibba045.orlgmj (mgr.34412) 3491 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:54:22.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:54:22 gibba015 bash[30343]: cephadm 2021-03-10T14:54:20.304535+0000 mgr.gibba045.orlgmj (mgr.34412) 3492 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:54:22.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:54:22 gibba015 bash[30343]: cephadm 2021-03-10T14:54:20.304574+0000 mgr.gibba045.orlgmj (mgr.34412) 3493 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:54:22.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:54:22 gibba015 bash[30343]: cephadm 2021-03-10T14:54:20.306053+0000 mgr.gibba045.orlgmj (mgr.34412) 3494 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:54:22.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:54:22 gibba015 bash[30343]: cephadm 2021-03-10T14:54:20.306486+0000 mgr.gibba045.orlgmj (mgr.34412) 3495 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:54:22.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:54:22 gibba015 bash[30343]: cephadm 2021-03-10T14:54:20.308117+0000 mgr.gibba045.orlgmj (mgr.34412) 3496 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:54:22.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:54:22 gibba015 bash[30343]: cephadm 2021-03-10T14:54:20.308158+0000 mgr.gibba045.orlgmj (mgr.34412) 3497 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:54:22.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:54:22 gibba015 bash[30343]: cephadm 2021-03-10T14:54:20.308280+0000 mgr.gibba045.orlgmj (mgr.34412) 3498 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:54:22.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:54:22 gibba045 bash[25517]: cephadm 2021-03-10T14:54:20.295435+0000 mgr.gibba045.orlgmj (mgr.34412) 3485 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:54:22.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:54:22 gibba045 bash[25517]: cephadm 2021-03-10T14:54:20.298002+0000 mgr.gibba045.orlgmj (mgr.34412) 3486 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:54:22.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:54:22 gibba045 bash[25517]: cephadm 2021-03-10T14:54:20.299519+0000 mgr.gibba045.orlgmj (mgr.34412) 3487 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:54:22.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:54:22 gibba045 bash[25517]: cephadm 2021-03-10T14:54:20.299557+0000 mgr.gibba045.orlgmj (mgr.34412) 3488 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:54:22.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:54:22 gibba045 bash[25517]: cephadm 2021-03-10T14:54:20.301140+0000 mgr.gibba045.orlgmj (mgr.34412) 3489 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:54:22.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:54:22 gibba045 bash[25517]: cephadm 2021-03-10T14:54:20.301183+0000 mgr.gibba045.orlgmj (mgr.34412) 3490 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:54:22.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:54:22 gibba045 bash[25517]: cephadm 2021-03-10T14:54:20.302656+0000 mgr.gibba045.orlgmj (mgr.34412) 3491 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:54:22.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:54:22 gibba045 bash[25517]: cephadm 2021-03-10T14:54:20.304535+0000 mgr.gibba045.orlgmj (mgr.34412) 3492 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:54:22.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:54:22 gibba045 bash[25517]: cephadm 2021-03-10T14:54:20.304574+0000 mgr.gibba045.orlgmj (mgr.34412) 3493 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:54:22.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:54:22 gibba045 bash[25517]: cephadm 2021-03-10T14:54:20.306053+0000 mgr.gibba045.orlgmj (mgr.34412) 3494 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:54:22.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:54:22 gibba045 bash[25517]: cephadm 2021-03-10T14:54:20.306486+0000 mgr.gibba045.orlgmj (mgr.34412) 3495 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:54:22.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:54:22 gibba045 bash[25517]: cephadm 2021-03-10T14:54:20.308117+0000 mgr.gibba045.orlgmj (mgr.34412) 3496 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:54:22.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:54:22 gibba045 bash[25517]: cephadm 2021-03-10T14:54:20.308158+0000 mgr.gibba045.orlgmj (mgr.34412) 3497 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:54:22.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:54:22 gibba045 bash[25517]: cephadm 2021-03-10T14:54:20.308280+0000 mgr.gibba045.orlgmj (mgr.34412) 3498 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:54:23.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:54:23 gibba015 bash[29377]: cluster 2021-03-10T14:54:21.765414+0000 mgr.gibba045.orlgmj (mgr.34412) 3499 : cluster [DBG] pgmap v1978: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:23.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:54:23 gibba015 bash[30343]: cluster 2021-03-10T14:54:21.765414+0000 mgr.gibba045.orlgmj (mgr.34412) 3499 : cluster [DBG] pgmap v1978: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:23.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:54:23 gibba045 bash[25517]: cluster 2021-03-10T14:54:21.765414+0000 mgr.gibba045.orlgmj (mgr.34412) 3499 : cluster [DBG] pgmap v1978: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:24.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:54:24 gibba015 bash[29377]: cluster 2021-03-10T14:54:23.766679+0000 mgr.gibba045.orlgmj (mgr.34412) 3500 : cluster [DBG] pgmap v1979: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:24.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:54:24 gibba015 bash[30343]: cluster 2021-03-10T14:54:23.766679+0000 mgr.gibba045.orlgmj (mgr.34412) 3500 : cluster [DBG] pgmap v1979: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:24.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:54:24 gibba045 bash[25517]: cluster 2021-03-10T14:54:23.766679+0000 mgr.gibba045.orlgmj (mgr.34412) 3500 : cluster [DBG] pgmap v1979: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:27.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:54:26 gibba015 bash[29377]: cluster 2021-03-10T14:54:25.768273+0000 mgr.gibba045.orlgmj (mgr.34412) 3501 : cluster [DBG] pgmap v1980: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:27.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:54:26 gibba015 bash[30343]: cluster 2021-03-10T14:54:25.768273+0000 mgr.gibba045.orlgmj (mgr.34412) 3501 : cluster [DBG] pgmap v1980: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:27.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:54:26 gibba045 bash[25517]: cluster 2021-03-10T14:54:25.768273+0000 mgr.gibba045.orlgmj (mgr.34412) 3501 : cluster [DBG] pgmap v1980: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:29.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:54:28 gibba015 bash[29377]: cluster 2021-03-10T14:54:27.769969+0000 mgr.gibba045.orlgmj (mgr.34412) 3502 : cluster [DBG] pgmap v1981: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:29.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:54:28 gibba015 bash[30343]: cluster 2021-03-10T14:54:27.769969+0000 mgr.gibba045.orlgmj (mgr.34412) 3502 : cluster [DBG] pgmap v1981: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:29.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:54:28 gibba045 bash[25517]: cluster 2021-03-10T14:54:27.769969+0000 mgr.gibba045.orlgmj (mgr.34412) 3502 : cluster [DBG] pgmap v1981: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:31.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:54:30 gibba015 bash[29377]: cluster 2021-03-10T14:54:29.771635+0000 mgr.gibba045.orlgmj (mgr.34412) 3503 : cluster [DBG] pgmap v1982: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:31.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:54:30 gibba015 bash[30343]: cluster 2021-03-10T14:54:29.771635+0000 mgr.gibba045.orlgmj (mgr.34412) 3503 : cluster [DBG] pgmap v1982: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:31.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:54:30 gibba045 bash[25517]: cluster 2021-03-10T14:54:29.771635+0000 mgr.gibba045.orlgmj (mgr.34412) 3503 : cluster [DBG] pgmap v1982: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:33.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:54:32 gibba015 bash[29377]: cluster 2021-03-10T14:54:31.773155+0000 mgr.gibba045.orlgmj (mgr.34412) 3504 : cluster [DBG] pgmap v1983: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:33.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:54:32 gibba015 bash[30343]: cluster 2021-03-10T14:54:31.773155+0000 mgr.gibba045.orlgmj (mgr.34412) 3504 : cluster [DBG] pgmap v1983: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:33.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:54:32 gibba045 bash[25517]: cluster 2021-03-10T14:54:31.773155+0000 mgr.gibba045.orlgmj (mgr.34412) 3504 : cluster [DBG] pgmap v1983: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:34.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:54:34 gibba015 bash[29377]: cluster 2021-03-10T14:54:33.774385+0000 mgr.gibba045.orlgmj (mgr.34412) 3505 : cluster [DBG] pgmap v1984: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:34.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:54:34 gibba015 bash[30343]: cluster 2021-03-10T14:54:33.774385+0000 mgr.gibba045.orlgmj (mgr.34412) 3505 : cluster [DBG] pgmap v1984: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:34.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:54:34 gibba045 bash[25517]: cluster 2021-03-10T14:54:33.774385+0000 mgr.gibba045.orlgmj (mgr.34412) 3505 : cluster [DBG] pgmap v1984: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:37.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:54:36 gibba015 bash[29377]: cephadm 2021-03-10T14:54:35.321692+0000 mgr.gibba045.orlgmj (mgr.34412) 3506 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:54:37.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:54:36 gibba015 bash[29377]: cluster 2021-03-10T14:54:35.775922+0000 mgr.gibba045.orlgmj (mgr.34412) 3507 : cluster [DBG] pgmap v1985: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:37.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:54:36 gibba015 bash[30343]: cephadm 2021-03-10T14:54:35.321692+0000 mgr.gibba045.orlgmj (mgr.34412) 3506 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:54:37.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:54:36 gibba015 bash[30343]: cluster 2021-03-10T14:54:35.775922+0000 mgr.gibba045.orlgmj (mgr.34412) 3507 : cluster [DBG] pgmap v1985: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:37.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:54:36 gibba045 bash[25517]: cephadm 2021-03-10T14:54:35.321692+0000 mgr.gibba045.orlgmj (mgr.34412) 3506 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:54:37.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:54:36 gibba045 bash[25517]: cluster 2021-03-10T14:54:35.775922+0000 mgr.gibba045.orlgmj (mgr.34412) 3507 : cluster [DBG] pgmap v1985: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:39.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:54:38 gibba015 bash[29377]: cluster 2021-03-10T14:54:37.777586+0000 mgr.gibba045.orlgmj (mgr.34412) 3508 : cluster [DBG] pgmap v1986: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:39.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:54:38 gibba015 bash[30343]: cluster 2021-03-10T14:54:37.777586+0000 mgr.gibba045.orlgmj (mgr.34412) 3508 : cluster [DBG] pgmap v1986: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:39.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:54:38 gibba045 bash[25517]: cluster 2021-03-10T14:54:37.777586+0000 mgr.gibba045.orlgmj (mgr.34412) 3508 : cluster [DBG] pgmap v1986: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:41.022 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:54:41.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:54:40 gibba015 bash[29377]: cluster 2021-03-10T14:54:39.779172+0000 mgr.gibba045.orlgmj (mgr.34412) 3509 : cluster [DBG] pgmap v1987: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:41.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:54:40 gibba015 bash[30343]: cluster 2021-03-10T14:54:39.779172+0000 mgr.gibba045.orlgmj (mgr.34412) 3509 : cluster [DBG] pgmap v1987: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:41.249 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:54:41.249 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (65m) 21s ago 70m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:54:41.249 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (70m) 9m ago 70m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:54:41.250 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (65m) 9m ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:54:41.250 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (66m) 9m ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:54:41.250 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (65m) 21s ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:54:41.250 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (64m) 21s ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:54:41.251 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (64m) 9m ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:54:41.251 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (64m) 21s ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:54:41.251 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (70m) 21s ago 70m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:54:41.251 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (70m) 9m ago 70m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:54:41.252 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (63m) 21s ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:54:41.252 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (63m) 21s ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:54:41.252 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (62m) 21s ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:54:41.252 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (62m) 21s ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:54:41.253 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (62m) 9m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:54:41.253 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (61m) 9m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:54:41.253 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (61m) 9m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:54:41.253 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (60m) 9m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:54:41.254 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (70m) 9m ago 70m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:54:41.254 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 9m ago 68m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:54:41.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:54:40 gibba045 bash[25517]: cluster 2021-03-10T14:54:39.779172+0000 mgr.gibba045.orlgmj (mgr.34412) 3509 : cluster [DBG] pgmap v1987: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:41.496 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:54:41.496 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:54:41.496 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:54:41.496 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:54:41.497 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:54:41.497 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:54:41.497 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:54:41.497 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:54:41.497 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:54:41.498 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:54:41.498 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:54:41.498 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:54:41.498 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:54:41.499 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:54:41.499 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:54:42.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:54:41 gibba015 bash[29377]: audit 2021-03-10T14:54:41.013013+0000 mgr.gibba045.orlgmj (mgr.34412) 3510 : audit [DBG] from='client.56398 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:54:42.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:54:41 gibba015 bash[29377]: audit 2021-03-10T14:54:41.492060+0000 mon.a (mon.0) 1098 : audit [DBG] from='client.? 172.21.2.115:0/742348684' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:54:42.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:54:41 gibba015 bash[30343]: audit 2021-03-10T14:54:41.013013+0000 mgr.gibba045.orlgmj (mgr.34412) 3510 : audit [DBG] from='client.56398 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:54:42.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:54:41 gibba015 bash[30343]: audit 2021-03-10T14:54:41.492060+0000 mon.a (mon.0) 1098 : audit [DBG] from='client.? 172.21.2.115:0/742348684' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:54:42.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:54:41 gibba045 bash[25517]: audit 2021-03-10T14:54:41.013013+0000 mgr.gibba045.orlgmj (mgr.34412) 3510 : audit [DBG] from='client.56398 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:54:42.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:54:41 gibba045 bash[25517]: audit 2021-03-10T14:54:41.492060+0000 mon.a (mon.0) 1098 : audit [DBG] from='client.? 172.21.2.115:0/742348684' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:54:43.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:54:42 gibba015 bash[29377]: audit 2021-03-10T14:54:41.236162+0000 mgr.gibba045.orlgmj (mgr.34412) 3511 : audit [DBG] from='client.46416 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:54:43.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:54:42 gibba015 bash[29377]: cluster 2021-03-10T14:54:41.780923+0000 mgr.gibba045.orlgmj (mgr.34412) 3512 : cluster [DBG] pgmap v1988: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:43.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:54:42 gibba015 bash[30343]: audit 2021-03-10T14:54:41.236162+0000 mgr.gibba045.orlgmj (mgr.34412) 3511 : audit [DBG] from='client.46416 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:54:43.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:54:42 gibba015 bash[30343]: cluster 2021-03-10T14:54:41.780923+0000 mgr.gibba045.orlgmj (mgr.34412) 3512 : cluster [DBG] pgmap v1988: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:43.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:54:42 gibba045 bash[25517]: audit 2021-03-10T14:54:41.236162+0000 mgr.gibba045.orlgmj (mgr.34412) 3511 : audit [DBG] from='client.46416 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:54:43.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:54:42 gibba045 bash[25517]: cluster 2021-03-10T14:54:41.780923+0000 mgr.gibba045.orlgmj (mgr.34412) 3512 : cluster [DBG] pgmap v1988: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:44.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:54:44 gibba015 bash[29377]: cluster 2021-03-10T14:54:43.781960+0000 mgr.gibba045.orlgmj (mgr.34412) 3513 : cluster [DBG] pgmap v1989: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:44.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:54:44 gibba015 bash[30343]: cluster 2021-03-10T14:54:43.781960+0000 mgr.gibba045.orlgmj (mgr.34412) 3513 : cluster [DBG] pgmap v1989: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:44.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:54:44 gibba045 bash[25517]: cluster 2021-03-10T14:54:43.781960+0000 mgr.gibba045.orlgmj (mgr.34412) 3513 : cluster [DBG] pgmap v1989: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:47.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:54:46 gibba015 bash[29377]: cluster 2021-03-10T14:54:45.783541+0000 mgr.gibba045.orlgmj (mgr.34412) 3514 : cluster [DBG] pgmap v1990: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:47.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:54:46 gibba015 bash[30343]: cluster 2021-03-10T14:54:45.783541+0000 mgr.gibba045.orlgmj (mgr.34412) 3514 : cluster [DBG] pgmap v1990: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:47.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:54:46 gibba045 bash[25517]: cluster 2021-03-10T14:54:45.783541+0000 mgr.gibba045.orlgmj (mgr.34412) 3514 : cluster [DBG] pgmap v1990: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:49.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:54:48 gibba015 bash[29377]: cluster 2021-03-10T14:54:47.785144+0000 mgr.gibba045.orlgmj (mgr.34412) 3515 : cluster [DBG] pgmap v1991: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:49.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:54:48 gibba015 bash[30343]: cluster 2021-03-10T14:54:47.785144+0000 mgr.gibba045.orlgmj (mgr.34412) 3515 : cluster [DBG] pgmap v1991: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:49.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:54:48 gibba045 bash[25517]: cluster 2021-03-10T14:54:47.785144+0000 mgr.gibba045.orlgmj (mgr.34412) 3515 : cluster [DBG] pgmap v1991: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:51.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:54:50 gibba015 bash[29377]: cluster 2021-03-10T14:54:49.786646+0000 mgr.gibba045.orlgmj (mgr.34412) 3516 : cluster [DBG] pgmap v1992: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:51.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:54:50 gibba015 bash[30343]: cluster 2021-03-10T14:54:49.786646+0000 mgr.gibba045.orlgmj (mgr.34412) 3516 : cluster [DBG] pgmap v1992: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:51.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:54:50 gibba045 bash[25517]: cluster 2021-03-10T14:54:49.786646+0000 mgr.gibba045.orlgmj (mgr.34412) 3516 : cluster [DBG] pgmap v1992: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:52.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:54:51 gibba015 bash[29377]: cephadm 2021-03-10T14:54:50.337845+0000 mgr.gibba045.orlgmj (mgr.34412) 3517 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:54:52.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:54:51 gibba015 bash[30343]: cephadm 2021-03-10T14:54:50.337845+0000 mgr.gibba045.orlgmj (mgr.34412) 3517 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:54:52.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:54:51 gibba045 bash[25517]: cephadm 2021-03-10T14:54:50.337845+0000 mgr.gibba045.orlgmj (mgr.34412) 3517 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:54:53.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:54:52 gibba015 bash[29377]: cluster 2021-03-10T14:54:51.788130+0000 mgr.gibba045.orlgmj (mgr.34412) 3518 : cluster [DBG] pgmap v1993: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:53.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:54:52 gibba015 bash[30343]: cluster 2021-03-10T14:54:51.788130+0000 mgr.gibba045.orlgmj (mgr.34412) 3518 : cluster [DBG] pgmap v1993: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:53.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:54:52 gibba045 bash[25517]: cluster 2021-03-10T14:54:51.788130+0000 mgr.gibba045.orlgmj (mgr.34412) 3518 : cluster [DBG] pgmap v1993: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:54.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:54:53 gibba015 bash[29377]: audit 2021-03-10T14:54:52.902774+0000 mon.c (mon.1) 1011 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:54:54.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:54:53 gibba015 bash[29377]: audit 2021-03-10T14:54:52.903278+0000 mon.a (mon.0) 1099 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:54:54.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:54:53 gibba015 bash[29377]: audit 2021-03-10T14:54:52.903753+0000 mon.c (mon.1) 1012 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:54:54.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:54:53 gibba015 bash[29377]: audit 2021-03-10T14:54:52.904027+0000 mon.a (mon.0) 1100 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:54:54.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:54:53 gibba015 bash[29377]: audit 2021-03-10T14:54:52.914564+0000 mon.c (mon.1) 1013 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T14:54:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:54:53 gibba015 bash[29377]: audit 2021-03-10T14:54:52.914842+0000 mon.c (mon.1) 1014 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:54:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:54:53 gibba015 bash[29377]: audit 2021-03-10T14:54:52.915127+0000 mon.c (mon.1) 1015 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:54:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:54:53 gibba015 bash[29377]: audit 2021-03-10T14:54:52.915161+0000 mon.a (mon.0) 1101 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T14:54:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:54:53 gibba015 bash[29377]: audit 2021-03-10T14:54:52.915396+0000 mon.c (mon.1) 1016 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:54:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:54:53 gibba015 bash[29377]: audit 2021-03-10T14:54:52.915741+0000 mon.a (mon.0) 1102 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:54:54.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:54:53 gibba015 bash[29377]: audit 2021-03-10T14:54:52.916189+0000 mon.a (mon.0) 1103 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:54:54.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:54:53 gibba015 bash[29377]: audit 2021-03-10T14:54:52.916560+0000 mon.a (mon.0) 1104 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:54:54.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:54:53 gibba015 bash[30343]: audit 2021-03-10T14:54:52.902774+0000 mon.c (mon.1) 1011 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:54:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:54:53 gibba015 bash[30343]: audit 2021-03-10T14:54:52.903278+0000 mon.a (mon.0) 1099 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:54:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:54:53 gibba015 bash[30343]: audit 2021-03-10T14:54:52.903753+0000 mon.c (mon.1) 1012 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:54:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:54:53 gibba015 bash[30343]: audit 2021-03-10T14:54:52.904027+0000 mon.a (mon.0) 1100 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:54:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:54:53 gibba015 bash[30343]: audit 2021-03-10T14:54:52.914564+0000 mon.c (mon.1) 1013 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T14:54:54.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:54:53 gibba015 bash[30343]: audit 2021-03-10T14:54:52.914842+0000 mon.c (mon.1) 1014 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:54:54.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:54:53 gibba015 bash[30343]: audit 2021-03-10T14:54:52.915127+0000 mon.c (mon.1) 1015 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:54:54.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:54:53 gibba015 bash[30343]: audit 2021-03-10T14:54:52.915161+0000 mon.a (mon.0) 1101 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T14:54:54.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:54:53 gibba015 bash[30343]: audit 2021-03-10T14:54:52.915396+0000 mon.c (mon.1) 1016 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:54:54.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:54:53 gibba015 bash[30343]: audit 2021-03-10T14:54:52.915741+0000 mon.a (mon.0) 1102 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:54:54.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:54:53 gibba015 bash[30343]: audit 2021-03-10T14:54:52.916189+0000 mon.a (mon.0) 1103 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:54:54.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:54:53 gibba015 bash[30343]: audit 2021-03-10T14:54:52.916560+0000 mon.a (mon.0) 1104 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:54:54.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:54:53 gibba045 bash[25517]: audit 2021-03-10T14:54:52.902774+0000 mon.c (mon.1) 1011 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:54:54.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:54:53 gibba045 bash[25517]: audit 2021-03-10T14:54:52.903278+0000 mon.a (mon.0) 1099 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:54:54.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:54:53 gibba045 bash[25517]: audit 2021-03-10T14:54:52.903753+0000 mon.c (mon.1) 1012 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:54:54.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:54:53 gibba045 bash[25517]: audit 2021-03-10T14:54:52.904027+0000 mon.a (mon.0) 1100 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:54:54.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:54:53 gibba045 bash[25517]: audit 2021-03-10T14:54:52.914564+0000 mon.c (mon.1) 1013 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T14:54:54.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:54:53 gibba045 bash[25517]: audit 2021-03-10T14:54:52.914842+0000 mon.c (mon.1) 1014 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:54:54.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:54:53 gibba045 bash[25517]: audit 2021-03-10T14:54:52.915127+0000 mon.c (mon.1) 1015 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:54:54.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:54:53 gibba045 bash[25517]: audit 2021-03-10T14:54:52.915161+0000 mon.a (mon.0) 1101 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T14:54:54.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:54:53 gibba045 bash[25517]: audit 2021-03-10T14:54:52.915396+0000 mon.c (mon.1) 1016 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:54:54.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:54:53 gibba045 bash[25517]: audit 2021-03-10T14:54:52.915741+0000 mon.a (mon.0) 1102 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:54:54.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:54:53 gibba045 bash[25517]: audit 2021-03-10T14:54:52.916189+0000 mon.a (mon.0) 1103 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:54:54.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:54:53 gibba045 bash[25517]: audit 2021-03-10T14:54:52.916560+0000 mon.a (mon.0) 1104 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:54:55.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:54:54 gibba015 bash[29377]: cluster 2021-03-10T14:54:53.789330+0000 mgr.gibba045.orlgmj (mgr.34412) 3519 : cluster [DBG] pgmap v1994: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:55.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:54:54 gibba015 bash[30343]: cluster 2021-03-10T14:54:53.789330+0000 mgr.gibba045.orlgmj (mgr.34412) 3519 : cluster [DBG] pgmap v1994: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:55.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:54:54 gibba045 bash[25517]: cluster 2021-03-10T14:54:53.789330+0000 mgr.gibba045.orlgmj (mgr.34412) 3519 : cluster [DBG] pgmap v1994: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:57.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:54:56 gibba015 bash[29377]: cluster 2021-03-10T14:54:55.790977+0000 mgr.gibba045.orlgmj (mgr.34412) 3520 : cluster [DBG] pgmap v1995: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:57.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:54:56 gibba015 bash[30343]: cluster 2021-03-10T14:54:55.790977+0000 mgr.gibba045.orlgmj (mgr.34412) 3520 : cluster [DBG] pgmap v1995: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:57.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:54:56 gibba045 bash[25517]: cluster 2021-03-10T14:54:55.790977+0000 mgr.gibba045.orlgmj (mgr.34412) 3520 : cluster [DBG] pgmap v1995: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:59.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:54:58 gibba015 bash[29377]: cluster 2021-03-10T14:54:57.792544+0000 mgr.gibba045.orlgmj (mgr.34412) 3521 : cluster [DBG] pgmap v1996: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:59.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:54:58 gibba015 bash[30343]: cluster 2021-03-10T14:54:57.792544+0000 mgr.gibba045.orlgmj (mgr.34412) 3521 : cluster [DBG] pgmap v1996: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:59.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:54:58 gibba045 bash[25517]: cluster 2021-03-10T14:54:57.792544+0000 mgr.gibba045.orlgmj (mgr.34412) 3521 : cluster [DBG] pgmap v1996: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:01.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:55:00 gibba015 bash[29377]: cluster 2021-03-10T14:54:59.794202+0000 mgr.gibba045.orlgmj (mgr.34412) 3522 : cluster [DBG] pgmap v1997: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:01.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:55:00 gibba015 bash[30343]: cluster 2021-03-10T14:54:59.794202+0000 mgr.gibba045.orlgmj (mgr.34412) 3522 : cluster [DBG] pgmap v1997: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:01.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:55:00 gibba045 bash[25517]: cluster 2021-03-10T14:54:59.794202+0000 mgr.gibba045.orlgmj (mgr.34412) 3522 : cluster [DBG] pgmap v1997: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:03.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:55:02 gibba015 bash[29377]: cluster 2021-03-10T14:55:01.796012+0000 mgr.gibba045.orlgmj (mgr.34412) 3523 : cluster [DBG] pgmap v1998: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:03.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:55:02 gibba015 bash[30343]: cluster 2021-03-10T14:55:01.796012+0000 mgr.gibba045.orlgmj (mgr.34412) 3523 : cluster [DBG] pgmap v1998: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:03.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:55:02 gibba045 bash[25517]: cluster 2021-03-10T14:55:01.796012+0000 mgr.gibba045.orlgmj (mgr.34412) 3523 : cluster [DBG] pgmap v1998: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:04.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:55:04 gibba015 bash[29377]: cluster 2021-03-10T14:55:03.797291+0000 mgr.gibba045.orlgmj (mgr.34412) 3524 : cluster [DBG] pgmap v1999: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:04.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:55:04 gibba015 bash[30343]: cluster 2021-03-10T14:55:03.797291+0000 mgr.gibba045.orlgmj (mgr.34412) 3524 : cluster [DBG] pgmap v1999: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:04.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:55:04 gibba045 bash[25517]: cluster 2021-03-10T14:55:03.797291+0000 mgr.gibba045.orlgmj (mgr.34412) 3524 : cluster [DBG] pgmap v1999: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:07.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:55:06 gibba015 bash[29377]: cephadm 2021-03-10T14:55:05.353735+0000 mgr.gibba045.orlgmj (mgr.34412) 3525 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:55:07.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:55:06 gibba015 bash[29377]: cluster 2021-03-10T14:55:05.799329+0000 mgr.gibba045.orlgmj (mgr.34412) 3526 : cluster [DBG] pgmap v2000: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:07.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:55:06 gibba015 bash[30343]: cephadm 2021-03-10T14:55:05.353735+0000 mgr.gibba045.orlgmj (mgr.34412) 3525 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:55:07.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:55:06 gibba015 bash[30343]: cluster 2021-03-10T14:55:05.799329+0000 mgr.gibba045.orlgmj (mgr.34412) 3526 : cluster [DBG] pgmap v2000: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:07.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:55:06 gibba045 bash[25517]: cephadm 2021-03-10T14:55:05.353735+0000 mgr.gibba045.orlgmj (mgr.34412) 3525 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:55:07.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:55:06 gibba045 bash[25517]: cluster 2021-03-10T14:55:05.799329+0000 mgr.gibba045.orlgmj (mgr.34412) 3526 : cluster [DBG] pgmap v2000: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:09.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:55:08 gibba015 bash[29377]: cluster 2021-03-10T14:55:07.800982+0000 mgr.gibba045.orlgmj (mgr.34412) 3527 : cluster [DBG] pgmap v2001: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:09.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:55:08 gibba015 bash[30343]: cluster 2021-03-10T14:55:07.800982+0000 mgr.gibba045.orlgmj (mgr.34412) 3527 : cluster [DBG] pgmap v2001: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:09.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:55:08 gibba045 bash[25517]: cluster 2021-03-10T14:55:07.800982+0000 mgr.gibba045.orlgmj (mgr.34412) 3527 : cluster [DBG] pgmap v2001: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:11.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:55:10 gibba015 bash[29377]: cluster 2021-03-10T14:55:09.802653+0000 mgr.gibba045.orlgmj (mgr.34412) 3528 : cluster [DBG] pgmap v2002: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:11.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:55:10 gibba015 bash[30343]: cluster 2021-03-10T14:55:09.802653+0000 mgr.gibba045.orlgmj (mgr.34412) 3528 : cluster [DBG] pgmap v2002: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:11.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:55:10 gibba045 bash[25517]: cluster 2021-03-10T14:55:09.802653+0000 mgr.gibba045.orlgmj (mgr.34412) 3528 : cluster [DBG] pgmap v2002: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:11.737 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:55:11.964 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:55:11.964 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (65m) 51s ago 71m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:55:11.964 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (71m) 10m ago 71m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:55:11.964 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (66m) 10m ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:55:11.965 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (66m) 10m ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:55:11.965 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (65m) 51s ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:55:11.965 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (65m) 51s ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:55:11.965 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (64m) 10m ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:55:11.966 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (65m) 51s ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:55:11.966 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (71m) 51s ago 71m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:55:11.966 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (71m) 10m ago 71m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:55:11.966 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (64m) 51s ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:55:11.967 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (63m) 51s ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:55:11.967 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (63m) 51s ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:55:11.967 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (62m) 51s ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:55:11.967 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (62m) 10m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:55:11.967 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (62m) 10m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:55:11.968 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (61m) 10m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:55:11.968 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (61m) 10m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:55:11.968 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (70m) 10m ago 71m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:55:11.968 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 10m ago 69m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:55:12.230 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:55:12.231 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:55:12.231 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:55:12.231 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:55:12.232 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:55:12.232 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:55:12.232 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:55:12.232 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:55:12.233 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:55:12.233 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:55:12.233 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:55:12.233 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:55:12.233 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:55:12.234 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:55:12.234 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:55:13.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:55:12 gibba015 bash[29377]: audit 2021-03-10T14:55:11.727499+0000 mgr.gibba045.orlgmj (mgr.34412) 3529 : audit [DBG] from='client.46428 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:55:13.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:55:12 gibba015 bash[29377]: cluster 2021-03-10T14:55:11.804271+0000 mgr.gibba045.orlgmj (mgr.34412) 3530 : cluster [DBG] pgmap v2003: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:13.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:55:12 gibba015 bash[29377]: audit 2021-03-10T14:55:11.951699+0000 mgr.gibba045.orlgmj (mgr.34412) 3531 : audit [DBG] from='client.46434 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:55:13.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:55:12 gibba015 bash[29377]: audit 2021-03-10T14:55:12.226887+0000 mon.a (mon.0) 1105 : audit [DBG] from='client.? 172.21.2.115:0/3424907936' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:55:13.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:55:12 gibba015 bash[30343]: audit 2021-03-10T14:55:11.727499+0000 mgr.gibba045.orlgmj (mgr.34412) 3529 : audit [DBG] from='client.46428 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:55:13.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:55:12 gibba015 bash[30343]: cluster 2021-03-10T14:55:11.804271+0000 mgr.gibba045.orlgmj (mgr.34412) 3530 : cluster [DBG] pgmap v2003: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:13.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:55:12 gibba015 bash[30343]: audit 2021-03-10T14:55:11.951699+0000 mgr.gibba045.orlgmj (mgr.34412) 3531 : audit [DBG] from='client.46434 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:55:13.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:55:12 gibba015 bash[30343]: audit 2021-03-10T14:55:12.226887+0000 mon.a (mon.0) 1105 : audit [DBG] from='client.? 172.21.2.115:0/3424907936' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:55:13.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:55:12 gibba045 bash[25517]: audit 2021-03-10T14:55:11.727499+0000 mgr.gibba045.orlgmj (mgr.34412) 3529 : audit [DBG] from='client.46428 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:55:13.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:55:12 gibba045 bash[25517]: cluster 2021-03-10T14:55:11.804271+0000 mgr.gibba045.orlgmj (mgr.34412) 3530 : cluster [DBG] pgmap v2003: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:13.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:55:12 gibba045 bash[25517]: audit 2021-03-10T14:55:11.951699+0000 mgr.gibba045.orlgmj (mgr.34412) 3531 : audit [DBG] from='client.46434 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:55:13.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:55:12 gibba045 bash[25517]: audit 2021-03-10T14:55:12.226887+0000 mon.a (mon.0) 1105 : audit [DBG] from='client.? 172.21.2.115:0/3424907936' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:55:14.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:55:14 gibba015 bash[29377]: cluster 2021-03-10T14:55:13.804756+0000 mgr.gibba045.orlgmj (mgr.34412) 3532 : cluster [DBG] pgmap v2004: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:14.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:55:14 gibba015 bash[30343]: cluster 2021-03-10T14:55:13.804756+0000 mgr.gibba045.orlgmj (mgr.34412) 3532 : cluster [DBG] pgmap v2004: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:14.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:55:14 gibba045 bash[25517]: cluster 2021-03-10T14:55:13.804756+0000 mgr.gibba045.orlgmj (mgr.34412) 3532 : cluster [DBG] pgmap v2004: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:17.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:55:16 gibba015 bash[29377]: cluster 2021-03-10T14:55:15.806402+0000 mgr.gibba045.orlgmj (mgr.34412) 3533 : cluster [DBG] pgmap v2005: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:17.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:55:16 gibba015 bash[30343]: cluster 2021-03-10T14:55:15.806402+0000 mgr.gibba045.orlgmj (mgr.34412) 3533 : cluster [DBG] pgmap v2005: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:17.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:55:16 gibba045 bash[25517]: cluster 2021-03-10T14:55:15.806402+0000 mgr.gibba045.orlgmj (mgr.34412) 3533 : cluster [DBG] pgmap v2005: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:19.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:55:18 gibba015 bash[29377]: cluster 2021-03-10T14:55:17.807991+0000 mgr.gibba045.orlgmj (mgr.34412) 3534 : cluster [DBG] pgmap v2006: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:19.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:55:18 gibba015 bash[30343]: cluster 2021-03-10T14:55:17.807991+0000 mgr.gibba045.orlgmj (mgr.34412) 3534 : cluster [DBG] pgmap v2006: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:19.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:55:18 gibba045 bash[25517]: cluster 2021-03-10T14:55:17.807991+0000 mgr.gibba045.orlgmj (mgr.34412) 3534 : cluster [DBG] pgmap v2006: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:21.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:55:20 gibba015 bash[30343]: cluster 2021-03-10T14:55:19.809677+0000 mgr.gibba045.orlgmj (mgr.34412) 3535 : cluster [DBG] pgmap v2007: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:21.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:55:20 gibba015 bash[30343]: audit 2021-03-10T14:55:20.367203+0000 mon.c (mon.1) 1017 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:55:21.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:55:20 gibba015 bash[30343]: audit 2021-03-10T14:55:20.374790+0000 mon.c (mon.1) 1018 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:55:21.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:55:20 gibba015 bash[29377]: cluster 2021-03-10T14:55:19.809677+0000 mgr.gibba045.orlgmj (mgr.34412) 3535 : cluster [DBG] pgmap v2007: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:21.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:55:20 gibba015 bash[29377]: audit 2021-03-10T14:55:20.367203+0000 mon.c (mon.1) 1017 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:55:21.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:55:20 gibba015 bash[29377]: audit 2021-03-10T14:55:20.374790+0000 mon.c (mon.1) 1018 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:55:21.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:55:20 gibba045 bash[25517]: cluster 2021-03-10T14:55:19.809677+0000 mgr.gibba045.orlgmj (mgr.34412) 3535 : cluster [DBG] pgmap v2007: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:21.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:55:20 gibba045 bash[25517]: audit 2021-03-10T14:55:20.367203+0000 mon.c (mon.1) 1017 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:55:21.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:55:20 gibba045 bash[25517]: audit 2021-03-10T14:55:20.374790+0000 mon.c (mon.1) 1018 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:55:22.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:55:21 gibba015 bash[29377]: cephadm 2021-03-10T14:55:20.376425+0000 mgr.gibba045.orlgmj (mgr.34412) 3536 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:55:22.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:55:21 gibba015 bash[30343]: cephadm 2021-03-10T14:55:20.376425+0000 mgr.gibba045.orlgmj (mgr.34412) 3536 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:55:22.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:55:21 gibba045 bash[25517]: cephadm 2021-03-10T14:55:20.376425+0000 mgr.gibba045.orlgmj (mgr.34412) 3536 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:55:23.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:55:22 gibba015 bash[29377]: cluster 2021-03-10T14:55:21.811280+0000 mgr.gibba045.orlgmj (mgr.34412) 3537 : cluster [DBG] pgmap v2008: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:23.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:55:22 gibba015 bash[30343]: cluster 2021-03-10T14:55:21.811280+0000 mgr.gibba045.orlgmj (mgr.34412) 3537 : cluster [DBG] pgmap v2008: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:23.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:55:22 gibba045 bash[25517]: cluster 2021-03-10T14:55:21.811280+0000 mgr.gibba045.orlgmj (mgr.34412) 3537 : cluster [DBG] pgmap v2008: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:25.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:55:25 gibba015 bash[29377]: cluster 2021-03-10T14:55:23.811721+0000 mgr.gibba045.orlgmj (mgr.34412) 3538 : cluster [DBG] pgmap v2009: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:25.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:55:25 gibba015 bash[29377]: audit 2021-03-10T14:55:24.051869+0000 mon.a (mon.0) 1106 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:55:25.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:55:25 gibba015 bash[29377]: cephadm 2021-03-10T14:55:24.057250+0000 mgr.gibba045.orlgmj (mgr.34412) 3539 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:55:25.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:55:25 gibba015 bash[29377]: audit 2021-03-10T14:55:24.261619+0000 mon.a (mon.0) 1107 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:55:25.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:55:25 gibba015 bash[29377]: audit 2021-03-10T14:55:24.265175+0000 mon.c (mon.1) 1019 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:55:25.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:55:25 gibba015 bash[29377]: audit 2021-03-10T14:55:24.266864+0000 mon.c (mon.1) 1020 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:55:25.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:55:25 gibba015 bash[29377]: audit 2021-03-10T14:55:24.268158+0000 mon.c (mon.1) 1021 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:55:25.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:55:25 gibba015 bash[29377]: audit 2021-03-10T14:55:24.269384+0000 mon.c (mon.1) 1022 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:55:25.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:55:25 gibba015 bash[29377]: audit 2021-03-10T14:55:24.272344+0000 mon.c (mon.1) 1023 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:55:25.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:55:25 gibba015 bash[29377]: audit 2021-03-10T14:55:24.273826+0000 mon.c (mon.1) 1024 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:55:25.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:55:25 gibba015 bash[30343]: cluster 2021-03-10T14:55:23.811721+0000 mgr.gibba045.orlgmj (mgr.34412) 3538 : cluster [DBG] pgmap v2009: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:25.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:55:25 gibba015 bash[30343]: audit 2021-03-10T14:55:24.051869+0000 mon.a (mon.0) 1106 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:55:25.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:55:25 gibba015 bash[30343]: cephadm 2021-03-10T14:55:24.057250+0000 mgr.gibba045.orlgmj (mgr.34412) 3539 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:55:25.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:55:25 gibba015 bash[30343]: audit 2021-03-10T14:55:24.261619+0000 mon.a (mon.0) 1107 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:55:25.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:55:25 gibba015 bash[30343]: audit 2021-03-10T14:55:24.265175+0000 mon.c (mon.1) 1019 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:55:25.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:55:25 gibba015 bash[30343]: audit 2021-03-10T14:55:24.266864+0000 mon.c (mon.1) 1020 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:55:25.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:55:25 gibba015 bash[30343]: audit 2021-03-10T14:55:24.268158+0000 mon.c (mon.1) 1021 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:55:25.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:55:25 gibba015 bash[30343]: audit 2021-03-10T14:55:24.269384+0000 mon.c (mon.1) 1022 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:55:25.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:55:25 gibba015 bash[30343]: audit 2021-03-10T14:55:24.272344+0000 mon.c (mon.1) 1023 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:55:25.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:55:25 gibba015 bash[30343]: audit 2021-03-10T14:55:24.273826+0000 mon.c (mon.1) 1024 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:55:25.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:55:25 gibba045 bash[25517]: cluster 2021-03-10T14:55:23.811721+0000 mgr.gibba045.orlgmj (mgr.34412) 3538 : cluster [DBG] pgmap v2009: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:25.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:55:25 gibba045 bash[25517]: audit 2021-03-10T14:55:24.051869+0000 mon.a (mon.0) 1106 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:55:25.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:55:25 gibba045 bash[25517]: cephadm 2021-03-10T14:55:24.057250+0000 mgr.gibba045.orlgmj (mgr.34412) 3539 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:55:25.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:55:25 gibba045 bash[25517]: audit 2021-03-10T14:55:24.261619+0000 mon.a (mon.0) 1107 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:55:25.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:55:25 gibba045 bash[25517]: audit 2021-03-10T14:55:24.265175+0000 mon.c (mon.1) 1019 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:55:25.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:55:25 gibba045 bash[25517]: audit 2021-03-10T14:55:24.266864+0000 mon.c (mon.1) 1020 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:55:25.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:55:25 gibba045 bash[25517]: audit 2021-03-10T14:55:24.268158+0000 mon.c (mon.1) 1021 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:55:25.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:55:25 gibba045 bash[25517]: audit 2021-03-10T14:55:24.269384+0000 mon.c (mon.1) 1022 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:55:25.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:55:25 gibba045 bash[25517]: audit 2021-03-10T14:55:24.272344+0000 mon.c (mon.1) 1023 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:55:25.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:55:25 gibba045 bash[25517]: audit 2021-03-10T14:55:24.273826+0000 mon.c (mon.1) 1024 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:55:26.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:55:26 gibba015 bash[29377]: cephadm 2021-03-10T14:55:24.267840+0000 mgr.gibba045.orlgmj (mgr.34412) 3540 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:55:26.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:55:26 gibba015 bash[29377]: cephadm 2021-03-10T14:55:24.269896+0000 mgr.gibba045.orlgmj (mgr.34412) 3541 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:55:26.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:55:26 gibba015 bash[29377]: cephadm 2021-03-10T14:55:24.271085+0000 mgr.gibba045.orlgmj (mgr.34412) 3542 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:55:26.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:55:26 gibba015 bash[29377]: cephadm 2021-03-10T14:55:24.271121+0000 mgr.gibba045.orlgmj (mgr.34412) 3543 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:55:26.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:55:26 gibba015 bash[29377]: cephadm 2021-03-10T14:55:24.272343+0000 mgr.gibba045.orlgmj (mgr.34412) 3544 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:55:26.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:55:26 gibba015 bash[29377]: cephadm 2021-03-10T14:55:24.272380+0000 mgr.gibba045.orlgmj (mgr.34412) 3545 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:55:26.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:55:26 gibba015 bash[29377]: cephadm 2021-03-10T14:55:24.273713+0000 mgr.gibba045.orlgmj (mgr.34412) 3546 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:55:26.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:55:26 gibba015 bash[29377]: cephadm 2021-03-10T14:55:24.275143+0000 mgr.gibba045.orlgmj (mgr.34412) 3547 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:55:26.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:55:26 gibba015 bash[29377]: cephadm 2021-03-10T14:55:24.275181+0000 mgr.gibba045.orlgmj (mgr.34412) 3548 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:55:26.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:55:26 gibba015 bash[29377]: cephadm 2021-03-10T14:55:24.276493+0000 mgr.gibba045.orlgmj (mgr.34412) 3549 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:55:26.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:55:26 gibba015 bash[29377]: cephadm 2021-03-10T14:55:24.276925+0000 mgr.gibba045.orlgmj (mgr.34412) 3550 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:55:26.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:55:26 gibba015 bash[29377]: cephadm 2021-03-10T14:55:24.278234+0000 mgr.gibba045.orlgmj (mgr.34412) 3551 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:55:26.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:55:26 gibba015 bash[29377]: cephadm 2021-03-10T14:55:24.278273+0000 mgr.gibba045.orlgmj (mgr.34412) 3552 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:55:26.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:55:26 gibba015 bash[29377]: cephadm 2021-03-10T14:55:24.278383+0000 mgr.gibba045.orlgmj (mgr.34412) 3553 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:55:26.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:55:26 gibba015 bash[30343]: cephadm 2021-03-10T14:55:24.267840+0000 mgr.gibba045.orlgmj (mgr.34412) 3540 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:55:26.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:55:26 gibba015 bash[30343]: cephadm 2021-03-10T14:55:24.269896+0000 mgr.gibba045.orlgmj (mgr.34412) 3541 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:55:26.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:55:26 gibba015 bash[30343]: cephadm 2021-03-10T14:55:24.271085+0000 mgr.gibba045.orlgmj (mgr.34412) 3542 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:55:26.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:55:26 gibba015 bash[30343]: cephadm 2021-03-10T14:55:24.271121+0000 mgr.gibba045.orlgmj (mgr.34412) 3543 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:55:26.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:55:26 gibba015 bash[30343]: cephadm 2021-03-10T14:55:24.272343+0000 mgr.gibba045.orlgmj (mgr.34412) 3544 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:55:26.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:55:26 gibba015 bash[30343]: cephadm 2021-03-10T14:55:24.272380+0000 mgr.gibba045.orlgmj (mgr.34412) 3545 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:55:26.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:55:26 gibba015 bash[30343]: cephadm 2021-03-10T14:55:24.273713+0000 mgr.gibba045.orlgmj (mgr.34412) 3546 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:55:26.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:55:26 gibba015 bash[30343]: cephadm 2021-03-10T14:55:24.275143+0000 mgr.gibba045.orlgmj (mgr.34412) 3547 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:55:26.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:55:26 gibba015 bash[30343]: cephadm 2021-03-10T14:55:24.275181+0000 mgr.gibba045.orlgmj (mgr.34412) 3548 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:55:26.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:55:26 gibba015 bash[30343]: cephadm 2021-03-10T14:55:24.276493+0000 mgr.gibba045.orlgmj (mgr.34412) 3549 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:55:26.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:55:26 gibba015 bash[30343]: cephadm 2021-03-10T14:55:24.276925+0000 mgr.gibba045.orlgmj (mgr.34412) 3550 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:55:26.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:55:26 gibba015 bash[30343]: cephadm 2021-03-10T14:55:24.278234+0000 mgr.gibba045.orlgmj (mgr.34412) 3551 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:55:26.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:55:26 gibba015 bash[30343]: cephadm 2021-03-10T14:55:24.278273+0000 mgr.gibba045.orlgmj (mgr.34412) 3552 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:55:26.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:55:26 gibba015 bash[30343]: cephadm 2021-03-10T14:55:24.278383+0000 mgr.gibba045.orlgmj (mgr.34412) 3553 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:55:26.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:55:26 gibba045 bash[25517]: cephadm 2021-03-10T14:55:24.267840+0000 mgr.gibba045.orlgmj (mgr.34412) 3540 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:55:26.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:55:26 gibba045 bash[25517]: cephadm 2021-03-10T14:55:24.269896+0000 mgr.gibba045.orlgmj (mgr.34412) 3541 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:55:26.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:55:26 gibba045 bash[25517]: cephadm 2021-03-10T14:55:24.271085+0000 mgr.gibba045.orlgmj (mgr.34412) 3542 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:55:26.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:55:26 gibba045 bash[25517]: cephadm 2021-03-10T14:55:24.271121+0000 mgr.gibba045.orlgmj (mgr.34412) 3543 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:55:26.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:55:26 gibba045 bash[25517]: cephadm 2021-03-10T14:55:24.272343+0000 mgr.gibba045.orlgmj (mgr.34412) 3544 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:55:26.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:55:26 gibba045 bash[25517]: cephadm 2021-03-10T14:55:24.272380+0000 mgr.gibba045.orlgmj (mgr.34412) 3545 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:55:26.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:55:26 gibba045 bash[25517]: cephadm 2021-03-10T14:55:24.273713+0000 mgr.gibba045.orlgmj (mgr.34412) 3546 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:55:26.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:55:26 gibba045 bash[25517]: cephadm 2021-03-10T14:55:24.275143+0000 mgr.gibba045.orlgmj (mgr.34412) 3547 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:55:26.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:55:26 gibba045 bash[25517]: cephadm 2021-03-10T14:55:24.275181+0000 mgr.gibba045.orlgmj (mgr.34412) 3548 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:55:26.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:55:26 gibba045 bash[25517]: cephadm 2021-03-10T14:55:24.276493+0000 mgr.gibba045.orlgmj (mgr.34412) 3549 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:55:26.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:55:26 gibba045 bash[25517]: cephadm 2021-03-10T14:55:24.276925+0000 mgr.gibba045.orlgmj (mgr.34412) 3550 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:55:26.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:55:26 gibba045 bash[25517]: cephadm 2021-03-10T14:55:24.278234+0000 mgr.gibba045.orlgmj (mgr.34412) 3551 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:55:26.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:55:26 gibba045 bash[25517]: cephadm 2021-03-10T14:55:24.278273+0000 mgr.gibba045.orlgmj (mgr.34412) 3552 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:55:26.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:55:26 gibba045 bash[25517]: cephadm 2021-03-10T14:55:24.278383+0000 mgr.gibba045.orlgmj (mgr.34412) 3553 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:55:27.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:55:27 gibba015 bash[29377]: cluster 2021-03-10T14:55:25.813411+0000 mgr.gibba045.orlgmj (mgr.34412) 3554 : cluster [DBG] pgmap v2010: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:27.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:55:27 gibba015 bash[30343]: cluster 2021-03-10T14:55:25.813411+0000 mgr.gibba045.orlgmj (mgr.34412) 3554 : cluster [DBG] pgmap v2010: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:27.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:55:27 gibba045 bash[25517]: cluster 2021-03-10T14:55:25.813411+0000 mgr.gibba045.orlgmj (mgr.34412) 3554 : cluster [DBG] pgmap v2010: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:29.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:55:29 gibba015 bash[29377]: cluster 2021-03-10T14:55:27.815060+0000 mgr.gibba045.orlgmj (mgr.34412) 3555 : cluster [DBG] pgmap v2011: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:29.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:55:29 gibba015 bash[30343]: cluster 2021-03-10T14:55:27.815060+0000 mgr.gibba045.orlgmj (mgr.34412) 3555 : cluster [DBG] pgmap v2011: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:29.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:55:29 gibba045 bash[25517]: cluster 2021-03-10T14:55:27.815060+0000 mgr.gibba045.orlgmj (mgr.34412) 3555 : cluster [DBG] pgmap v2011: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:31.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:55:31 gibba015 bash[29377]: cluster 2021-03-10T14:55:29.816997+0000 mgr.gibba045.orlgmj (mgr.34412) 3556 : cluster [DBG] pgmap v2012: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:31.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:55:31 gibba015 bash[30343]: cluster 2021-03-10T14:55:29.816997+0000 mgr.gibba045.orlgmj (mgr.34412) 3556 : cluster [DBG] pgmap v2012: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:31.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:55:31 gibba045 bash[25517]: cluster 2021-03-10T14:55:29.816997+0000 mgr.gibba045.orlgmj (mgr.34412) 3556 : cluster [DBG] pgmap v2012: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:33.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:55:33 gibba015 bash[29377]: cluster 2021-03-10T14:55:31.818652+0000 mgr.gibba045.orlgmj (mgr.34412) 3557 : cluster [DBG] pgmap v2013: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:33.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:55:33 gibba015 bash[30343]: cluster 2021-03-10T14:55:31.818652+0000 mgr.gibba045.orlgmj (mgr.34412) 3557 : cluster [DBG] pgmap v2013: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:33.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:55:33 gibba045 bash[25517]: cluster 2021-03-10T14:55:31.818652+0000 mgr.gibba045.orlgmj (mgr.34412) 3557 : cluster [DBG] pgmap v2013: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:34.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:55:34 gibba015 bash[29377]: cluster 2021-03-10T14:55:33.819228+0000 mgr.gibba045.orlgmj (mgr.34412) 3558 : cluster [DBG] pgmap v2014: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:34.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:55:34 gibba015 bash[30343]: cluster 2021-03-10T14:55:33.819228+0000 mgr.gibba045.orlgmj (mgr.34412) 3558 : cluster [DBG] pgmap v2014: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:34.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:55:34 gibba045 bash[25517]: cluster 2021-03-10T14:55:33.819228+0000 mgr.gibba045.orlgmj (mgr.34412) 3558 : cluster [DBG] pgmap v2014: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:37.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:55:36 gibba015 bash[29377]: cluster 2021-03-10T14:55:35.820931+0000 mgr.gibba045.orlgmj (mgr.34412) 3559 : cluster [DBG] pgmap v2015: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:37.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:55:36 gibba015 bash[30343]: cluster 2021-03-10T14:55:35.820931+0000 mgr.gibba045.orlgmj (mgr.34412) 3559 : cluster [DBG] pgmap v2015: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:37.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:55:36 gibba045 bash[25517]: cluster 2021-03-10T14:55:35.820931+0000 mgr.gibba045.orlgmj (mgr.34412) 3559 : cluster [DBG] pgmap v2015: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:39.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:55:38 gibba015 bash[29377]: cluster 2021-03-10T14:55:37.822495+0000 mgr.gibba045.orlgmj (mgr.34412) 3560 : cluster [DBG] pgmap v2016: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:39.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:55:38 gibba015 bash[30343]: cluster 2021-03-10T14:55:37.822495+0000 mgr.gibba045.orlgmj (mgr.34412) 3560 : cluster [DBG] pgmap v2016: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:39.295 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:55:38 gibba045 bash[25517]: cluster 2021-03-10T14:55:37.822495+0000 mgr.gibba045.orlgmj (mgr.34412) 3560 : cluster [DBG] pgmap v2016: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:41.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:55:40 gibba015 bash[29377]: cephadm 2021-03-10T14:55:39.294145+0000 mgr.gibba045.orlgmj (mgr.34412) 3561 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:55:41.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:55:40 gibba015 bash[29377]: cluster 2021-03-10T14:55:39.824216+0000 mgr.gibba045.orlgmj (mgr.34412) 3562 : cluster [DBG] pgmap v2017: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:41.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:55:40 gibba015 bash[30343]: cephadm 2021-03-10T14:55:39.294145+0000 mgr.gibba045.orlgmj (mgr.34412) 3561 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:55:41.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:55:40 gibba015 bash[30343]: cluster 2021-03-10T14:55:39.824216+0000 mgr.gibba045.orlgmj (mgr.34412) 3562 : cluster [DBG] pgmap v2017: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:41.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:55:40 gibba045 bash[25517]: cephadm 2021-03-10T14:55:39.294145+0000 mgr.gibba045.orlgmj (mgr.34412) 3561 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:55:41.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:55:40 gibba045 bash[25517]: cluster 2021-03-10T14:55:39.824216+0000 mgr.gibba045.orlgmj (mgr.34412) 3562 : cluster [DBG] pgmap v2017: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:42.471 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:55:42.700 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:55:42.701 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (66m) 82s ago 71m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:55:42.701 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (71m) 18s ago 71m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:55:42.701 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (66m) 18s ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:55:42.701 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (67m) 18s ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:55:42.701 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (66m) 82s ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:55:42.702 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (65m) 82s ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:55:42.702 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (65m) 18s ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:55:42.702 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (65m) 82s ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:55:42.702 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (71m) 82s ago 71m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:55:42.703 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (71m) 18s ago 71m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:55:42.703 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (64m) 82s ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:55:42.703 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (64m) 82s ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:55:42.703 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (63m) 82s ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:55:42.703 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (63m) 82s ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:55:42.704 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (63m) 18s ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:55:42.704 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (62m) 18s ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:55:42.704 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (62m) 18s ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:55:42.704 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (61m) 18s ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:55:42.704 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (71m) 18s ago 71m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:55:42.705 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 18s ago 69m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:55:42.952 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:55:42.952 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:55:42.952 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:55:42.953 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:55:42.953 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:55:42.953 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:55:42.953 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:55:42.954 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:55:42.954 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:55:42.954 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:55:42.954 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:55:42.955 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:55:42.955 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:55:42.955 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:55:42.955 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:55:43.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:55:42 gibba015 bash[29377]: cluster 2021-03-10T14:55:41.825915+0000 mgr.gibba045.orlgmj (mgr.34412) 3563 : cluster [DBG] pgmap v2018: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:43.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:55:42 gibba015 bash[30343]: cluster 2021-03-10T14:55:41.825915+0000 mgr.gibba045.orlgmj (mgr.34412) 3563 : cluster [DBG] pgmap v2018: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:43.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:55:42 gibba045 bash[25517]: cluster 2021-03-10T14:55:41.825915+0000 mgr.gibba045.orlgmj (mgr.34412) 3563 : cluster [DBG] pgmap v2018: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:44.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:55:43 gibba015 bash[29377]: audit 2021-03-10T14:55:42.460996+0000 mgr.gibba045.orlgmj (mgr.34412) 3564 : audit [DBG] from='client.46446 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:55:44.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:55:43 gibba015 bash[29377]: audit 2021-03-10T14:55:42.687129+0000 mgr.gibba045.orlgmj (mgr.34412) 3565 : audit [DBG] from='client.56440 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:55:44.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:55:43 gibba015 bash[29377]: audit 2021-03-10T14:55:42.948009+0000 mon.c (mon.1) 1025 : audit [DBG] from='client.? 172.21.2.115:0/3575808532' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:55:44.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:55:43 gibba015 bash[30343]: audit 2021-03-10T14:55:42.460996+0000 mgr.gibba045.orlgmj (mgr.34412) 3564 : audit [DBG] from='client.46446 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:55:44.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:55:43 gibba015 bash[30343]: audit 2021-03-10T14:55:42.687129+0000 mgr.gibba045.orlgmj (mgr.34412) 3565 : audit [DBG] from='client.56440 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:55:44.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:55:43 gibba015 bash[30343]: audit 2021-03-10T14:55:42.948009+0000 mon.c (mon.1) 1025 : audit [DBG] from='client.? 172.21.2.115:0/3575808532' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:55:44.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:55:43 gibba045 bash[25517]: audit 2021-03-10T14:55:42.460996+0000 mgr.gibba045.orlgmj (mgr.34412) 3564 : audit [DBG] from='client.46446 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:55:44.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:55:43 gibba045 bash[25517]: audit 2021-03-10T14:55:42.687129+0000 mgr.gibba045.orlgmj (mgr.34412) 3565 : audit [DBG] from='client.56440 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:55:44.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:55:43 gibba045 bash[25517]: audit 2021-03-10T14:55:42.948009+0000 mon.c (mon.1) 1025 : audit [DBG] from='client.? 172.21.2.115:0/3575808532' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:55:45.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:55:44 gibba015 bash[29377]: cluster 2021-03-10T14:55:43.826439+0000 mgr.gibba045.orlgmj (mgr.34412) 3566 : cluster [DBG] pgmap v2019: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:45.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:55:44 gibba015 bash[30343]: cluster 2021-03-10T14:55:43.826439+0000 mgr.gibba045.orlgmj (mgr.34412) 3566 : cluster [DBG] pgmap v2019: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:45.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:55:44 gibba045 bash[25517]: cluster 2021-03-10T14:55:43.826439+0000 mgr.gibba045.orlgmj (mgr.34412) 3566 : cluster [DBG] pgmap v2019: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:47.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:55:46 gibba015 bash[29377]: cluster 2021-03-10T14:55:45.828060+0000 mgr.gibba045.orlgmj (mgr.34412) 3567 : cluster [DBG] pgmap v2020: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:47.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:55:46 gibba015 bash[30343]: cluster 2021-03-10T14:55:45.828060+0000 mgr.gibba045.orlgmj (mgr.34412) 3567 : cluster [DBG] pgmap v2020: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:47.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:55:46 gibba045 bash[25517]: cluster 2021-03-10T14:55:45.828060+0000 mgr.gibba045.orlgmj (mgr.34412) 3567 : cluster [DBG] pgmap v2020: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:49.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:55:48 gibba015 bash[29377]: cluster 2021-03-10T14:55:47.829727+0000 mgr.gibba045.orlgmj (mgr.34412) 3568 : cluster [DBG] pgmap v2021: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:49.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:55:48 gibba015 bash[30343]: cluster 2021-03-10T14:55:47.829727+0000 mgr.gibba045.orlgmj (mgr.34412) 3568 : cluster [DBG] pgmap v2021: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:49.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:55:48 gibba045 bash[25517]: cluster 2021-03-10T14:55:47.829727+0000 mgr.gibba045.orlgmj (mgr.34412) 3568 : cluster [DBG] pgmap v2021: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:51.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:55:50 gibba015 bash[29377]: cluster 2021-03-10T14:55:49.831283+0000 mgr.gibba045.orlgmj (mgr.34412) 3569 : cluster [DBG] pgmap v2022: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:51.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:55:50 gibba015 bash[30343]: cluster 2021-03-10T14:55:49.831283+0000 mgr.gibba045.orlgmj (mgr.34412) 3569 : cluster [DBG] pgmap v2022: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:51.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:55:50 gibba045 bash[25517]: cluster 2021-03-10T14:55:49.831283+0000 mgr.gibba045.orlgmj (mgr.34412) 3569 : cluster [DBG] pgmap v2022: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:53.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:55:52 gibba015 bash[29377]: cluster 2021-03-10T14:55:51.832820+0000 mgr.gibba045.orlgmj (mgr.34412) 3570 : cluster [DBG] pgmap v2023: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:53.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:55:52 gibba015 bash[29377]: audit 2021-03-10T14:55:52.909025+0000 mon.c (mon.1) 1026 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:55:53.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:55:52 gibba015 bash[29377]: audit 2021-03-10T14:55:52.909763+0000 mon.c (mon.1) 1027 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:55:53.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:55:52 gibba015 bash[29377]: audit 2021-03-10T14:55:52.910173+0000 mon.a (mon.0) 1108 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:55:53.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:55:52 gibba015 bash[29377]: audit 2021-03-10T14:55:52.911468+0000 mon.a (mon.0) 1109 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:55:53.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:55:52 gibba015 bash[29377]: audit 2021-03-10T14:55:52.918566+0000 mon.c (mon.1) 1028 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T14:55:53.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:55:52 gibba015 bash[29377]: audit 2021-03-10T14:55:52.919282+0000 mon.c (mon.1) 1029 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:55:53.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:55:52 gibba015 bash[29377]: audit 2021-03-10T14:55:52.919624+0000 mon.a (mon.0) 1110 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T14:55:53.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:55:52 gibba015 bash[29377]: audit 2021-03-10T14:55:52.919986+0000 mon.c (mon.1) 1030 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:55:53.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:55:52 gibba015 bash[29377]: audit 2021-03-10T14:55:52.920795+0000 mon.c (mon.1) 1031 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:55:53.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:55:52 gibba015 bash[29377]: audit 2021-03-10T14:55:52.920840+0000 mon.a (mon.0) 1111 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:55:53.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:55:52 gibba015 bash[29377]: audit 2021-03-10T14:55:52.922109+0000 mon.a (mon.0) 1112 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:55:53.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:55:52 gibba015 bash[29377]: audit 2021-03-10T14:55:52.922895+0000 mon.a (mon.0) 1113 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:55:53.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:55:52 gibba015 bash[30343]: cluster 2021-03-10T14:55:51.832820+0000 mgr.gibba045.orlgmj (mgr.34412) 3570 : cluster [DBG] pgmap v2023: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:53.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:55:52 gibba015 bash[30343]: audit 2021-03-10T14:55:52.909025+0000 mon.c (mon.1) 1026 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:55:53.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:55:52 gibba015 bash[30343]: audit 2021-03-10T14:55:52.909763+0000 mon.c (mon.1) 1027 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:55:53.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:55:52 gibba015 bash[30343]: audit 2021-03-10T14:55:52.910173+0000 mon.a (mon.0) 1108 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:55:53.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:55:52 gibba015 bash[30343]: audit 2021-03-10T14:55:52.911468+0000 mon.a (mon.0) 1109 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:55:53.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:55:52 gibba015 bash[30343]: audit 2021-03-10T14:55:52.918566+0000 mon.c (mon.1) 1028 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T14:55:53.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:55:52 gibba015 bash[30343]: audit 2021-03-10T14:55:52.919282+0000 mon.c (mon.1) 1029 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:55:53.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:55:52 gibba015 bash[30343]: audit 2021-03-10T14:55:52.919624+0000 mon.a (mon.0) 1110 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T14:55:53.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:55:52 gibba015 bash[30343]: audit 2021-03-10T14:55:52.919986+0000 mon.c (mon.1) 1030 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:55:53.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:55:52 gibba015 bash[30343]: audit 2021-03-10T14:55:52.920795+0000 mon.c (mon.1) 1031 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:55:53.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:55:52 gibba015 bash[30343]: audit 2021-03-10T14:55:52.920840+0000 mon.a (mon.0) 1111 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:55:53.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:55:52 gibba015 bash[30343]: audit 2021-03-10T14:55:52.922109+0000 mon.a (mon.0) 1112 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:55:53.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:55:52 gibba015 bash[30343]: audit 2021-03-10T14:55:52.922895+0000 mon.a (mon.0) 1113 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:55:53.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:55:52 gibba045 bash[25517]: cluster 2021-03-10T14:55:51.832820+0000 mgr.gibba045.orlgmj (mgr.34412) 3570 : cluster [DBG] pgmap v2023: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:53.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:55:52 gibba045 bash[25517]: audit 2021-03-10T14:55:52.909025+0000 mon.c (mon.1) 1026 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:55:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:55:52 gibba045 bash[25517]: audit 2021-03-10T14:55:52.909763+0000 mon.c (mon.1) 1027 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:55:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:55:52 gibba045 bash[25517]: audit 2021-03-10T14:55:52.910173+0000 mon.a (mon.0) 1108 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:55:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:55:52 gibba045 bash[25517]: audit 2021-03-10T14:55:52.911468+0000 mon.a (mon.0) 1109 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:55:53.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:55:52 gibba045 bash[25517]: audit 2021-03-10T14:55:52.918566+0000 mon.c (mon.1) 1028 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T14:55:53.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:55:52 gibba045 bash[25517]: audit 2021-03-10T14:55:52.919282+0000 mon.c (mon.1) 1029 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:55:53.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:55:52 gibba045 bash[25517]: audit 2021-03-10T14:55:52.919624+0000 mon.a (mon.0) 1110 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T14:55:53.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:55:52 gibba045 bash[25517]: audit 2021-03-10T14:55:52.919986+0000 mon.c (mon.1) 1030 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:55:53.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:55:52 gibba045 bash[25517]: audit 2021-03-10T14:55:52.920795+0000 mon.c (mon.1) 1031 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:55:53.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:55:52 gibba045 bash[25517]: audit 2021-03-10T14:55:52.920840+0000 mon.a (mon.0) 1111 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:55:53.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:55:52 gibba045 bash[25517]: audit 2021-03-10T14:55:52.922109+0000 mon.a (mon.0) 1112 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:55:53.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:55:52 gibba045 bash[25517]: audit 2021-03-10T14:55:52.922895+0000 mon.a (mon.0) 1113 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:55:54.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:55:54 gibba015 bash[29377]: cluster 2021-03-10T14:55:53.833401+0000 mgr.gibba045.orlgmj (mgr.34412) 3571 : cluster [DBG] pgmap v2024: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:54.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:55:54 gibba015 bash[30343]: cluster 2021-03-10T14:55:53.833401+0000 mgr.gibba045.orlgmj (mgr.34412) 3571 : cluster [DBG] pgmap v2024: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:54.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:55:54 gibba045 bash[25517]: cluster 2021-03-10T14:55:53.833401+0000 mgr.gibba045.orlgmj (mgr.34412) 3571 : cluster [DBG] pgmap v2024: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:55.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:55:55 gibba015 bash[29377]: cephadm 2021-03-10T14:55:54.310183+0000 mgr.gibba045.orlgmj (mgr.34412) 3572 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:55:55.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:55:55 gibba015 bash[30343]: cephadm 2021-03-10T14:55:54.310183+0000 mgr.gibba045.orlgmj (mgr.34412) 3572 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:55:55.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:55:55 gibba045 bash[25517]: cephadm 2021-03-10T14:55:54.310183+0000 mgr.gibba045.orlgmj (mgr.34412) 3572 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:55:56.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:55:56 gibba015 bash[29377]: cluster 2021-03-10T14:55:55.834894+0000 mgr.gibba045.orlgmj (mgr.34412) 3573 : cluster [DBG] pgmap v2025: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:56.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:55:56 gibba015 bash[30343]: cluster 2021-03-10T14:55:55.834894+0000 mgr.gibba045.orlgmj (mgr.34412) 3573 : cluster [DBG] pgmap v2025: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:56.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:55:56 gibba045 bash[25517]: cluster 2021-03-10T14:55:55.834894+0000 mgr.gibba045.orlgmj (mgr.34412) 3573 : cluster [DBG] pgmap v2025: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:59.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:55:58 gibba015 bash[29377]: cluster 2021-03-10T14:55:57.836541+0000 mgr.gibba045.orlgmj (mgr.34412) 3574 : cluster [DBG] pgmap v2026: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:59.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:55:58 gibba015 bash[30343]: cluster 2021-03-10T14:55:57.836541+0000 mgr.gibba045.orlgmj (mgr.34412) 3574 : cluster [DBG] pgmap v2026: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:59.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:55:58 gibba045 bash[25517]: cluster 2021-03-10T14:55:57.836541+0000 mgr.gibba045.orlgmj (mgr.34412) 3574 : cluster [DBG] pgmap v2026: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:01.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:56:00 gibba015 bash[29377]: cluster 2021-03-10T14:55:59.838051+0000 mgr.gibba045.orlgmj (mgr.34412) 3575 : cluster [DBG] pgmap v2027: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:01.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:56:00 gibba015 bash[30343]: cluster 2021-03-10T14:55:59.838051+0000 mgr.gibba045.orlgmj (mgr.34412) 3575 : cluster [DBG] pgmap v2027: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:01.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:56:00 gibba045 bash[25517]: cluster 2021-03-10T14:55:59.838051+0000 mgr.gibba045.orlgmj (mgr.34412) 3575 : cluster [DBG] pgmap v2027: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:03.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:56:02 gibba015 bash[29377]: cluster 2021-03-10T14:56:01.839666+0000 mgr.gibba045.orlgmj (mgr.34412) 3576 : cluster [DBG] pgmap v2028: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:03.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:56:02 gibba015 bash[30343]: cluster 2021-03-10T14:56:01.839666+0000 mgr.gibba045.orlgmj (mgr.34412) 3576 : cluster [DBG] pgmap v2028: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:03.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:56:02 gibba045 bash[25517]: cluster 2021-03-10T14:56:01.839666+0000 mgr.gibba045.orlgmj (mgr.34412) 3576 : cluster [DBG] pgmap v2028: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:04.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:56:04 gibba015 bash[29377]: cluster 2021-03-10T14:56:03.840402+0000 mgr.gibba045.orlgmj (mgr.34412) 3577 : cluster [DBG] pgmap v2029: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:04.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:56:04 gibba015 bash[30343]: cluster 2021-03-10T14:56:03.840402+0000 mgr.gibba045.orlgmj (mgr.34412) 3577 : cluster [DBG] pgmap v2029: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:04.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:56:04 gibba045 bash[25517]: cluster 2021-03-10T14:56:03.840402+0000 mgr.gibba045.orlgmj (mgr.34412) 3577 : cluster [DBG] pgmap v2029: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:07.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:56:06 gibba015 bash[29377]: cluster 2021-03-10T14:56:05.841843+0000 mgr.gibba045.orlgmj (mgr.34412) 3578 : cluster [DBG] pgmap v2030: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:07.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:56:06 gibba015 bash[30343]: cluster 2021-03-10T14:56:05.841843+0000 mgr.gibba045.orlgmj (mgr.34412) 3578 : cluster [DBG] pgmap v2030: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:07.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:56:06 gibba045 bash[25517]: cluster 2021-03-10T14:56:05.841843+0000 mgr.gibba045.orlgmj (mgr.34412) 3578 : cluster [DBG] pgmap v2030: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:09.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:56:08 gibba015 bash[29377]: cluster 2021-03-10T14:56:07.843455+0000 mgr.gibba045.orlgmj (mgr.34412) 3579 : cluster [DBG] pgmap v2031: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:09.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:56:08 gibba015 bash[30343]: cluster 2021-03-10T14:56:07.843455+0000 mgr.gibba045.orlgmj (mgr.34412) 3579 : cluster [DBG] pgmap v2031: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:09.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:56:08 gibba045 bash[25517]: cluster 2021-03-10T14:56:07.843455+0000 mgr.gibba045.orlgmj (mgr.34412) 3579 : cluster [DBG] pgmap v2031: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:11.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:56:10 gibba015 bash[29377]: cephadm 2021-03-10T14:56:09.325990+0000 mgr.gibba045.orlgmj (mgr.34412) 3580 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:56:11.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:56:10 gibba015 bash[29377]: cluster 2021-03-10T14:56:09.845025+0000 mgr.gibba045.orlgmj (mgr.34412) 3581 : cluster [DBG] pgmap v2032: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:11.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:56:10 gibba015 bash[30343]: cephadm 2021-03-10T14:56:09.325990+0000 mgr.gibba045.orlgmj (mgr.34412) 3580 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:56:11.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:56:10 gibba015 bash[30343]: cluster 2021-03-10T14:56:09.845025+0000 mgr.gibba045.orlgmj (mgr.34412) 3581 : cluster [DBG] pgmap v2032: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:11.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:56:10 gibba045 bash[25517]: cephadm 2021-03-10T14:56:09.325990+0000 mgr.gibba045.orlgmj (mgr.34412) 3580 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:56:11.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:56:10 gibba045 bash[25517]: cluster 2021-03-10T14:56:09.845025+0000 mgr.gibba045.orlgmj (mgr.34412) 3581 : cluster [DBG] pgmap v2032: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:13.192 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:56:13.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:56:12 gibba015 bash[29377]: cluster 2021-03-10T14:56:11.846536+0000 mgr.gibba045.orlgmj (mgr.34412) 3582 : cluster [DBG] pgmap v2033: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:13.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:56:12 gibba015 bash[30343]: cluster 2021-03-10T14:56:11.846536+0000 mgr.gibba045.orlgmj (mgr.34412) 3582 : cluster [DBG] pgmap v2033: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:13.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:56:12 gibba045 bash[25517]: cluster 2021-03-10T14:56:11.846536+0000 mgr.gibba045.orlgmj (mgr.34412) 3582 : cluster [DBG] pgmap v2033: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:13.423 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:56:13.423 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (66m) 113s ago 72m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:56:13.424 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (72m) 49s ago 72m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:56:13.424 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (67m) 49s ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:56:13.424 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (67m) 49s ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:56:13.424 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (66m) 113s ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:56:13.425 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (66m) 113s ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:56:13.425 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (66m) 49s ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:56:13.425 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (66m) 113s ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:56:13.425 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (72m) 113s ago 72m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:56:13.425 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (72m) 49s ago 72m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:56:13.426 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (65m) 113s ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:56:13.426 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (64m) 113s ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:56:13.426 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (64m) 113s ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:56:13.426 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (63m) 113s ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:56:13.427 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (63m) 49s ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:56:13.427 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (63m) 49s ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:56:13.427 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (62m) 49s ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:56:13.427 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (62m) 49s ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:56:13.428 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (71m) 49s ago 72m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:56:13.428 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 49s ago 70m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:56:13.673 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:56:13.673 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:56:13.673 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:56:13.673 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:56:13.674 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:56:13.674 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:56:13.674 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:56:13.674 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:56:13.675 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:56:13.675 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:56:13.675 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:56:13.675 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:56:13.675 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:56:13.676 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:56:13.676 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:56:14.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:56:13 gibba015 bash[29377]: audit 2021-03-10T14:56:13.182215+0000 mgr.gibba045.orlgmj (mgr.34412) 3583 : audit [DBG] from='client.56452 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:56:14.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:56:13 gibba015 bash[29377]: audit 2021-03-10T14:56:13.668865+0000 mon.a (mon.0) 1114 : audit [DBG] from='client.? 172.21.2.115:0/360628404' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:56:14.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:56:13 gibba015 bash[30343]: audit 2021-03-10T14:56:13.182215+0000 mgr.gibba045.orlgmj (mgr.34412) 3583 : audit [DBG] from='client.56452 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:56:14.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:56:13 gibba015 bash[30343]: audit 2021-03-10T14:56:13.668865+0000 mon.a (mon.0) 1114 : audit [DBG] from='client.? 172.21.2.115:0/360628404' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:56:14.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:56:13 gibba045 bash[25517]: audit 2021-03-10T14:56:13.182215+0000 mgr.gibba045.orlgmj (mgr.34412) 3583 : audit [DBG] from='client.56452 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:56:14.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:56:13 gibba045 bash[25517]: audit 2021-03-10T14:56:13.668865+0000 mon.a (mon.0) 1114 : audit [DBG] from='client.? 172.21.2.115:0/360628404' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:56:15.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:56:14 gibba015 bash[29377]: audit 2021-03-10T14:56:13.410699+0000 mgr.gibba045.orlgmj (mgr.34412) 3584 : audit [DBG] from='client.56458 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:56:15.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:56:14 gibba015 bash[29377]: cluster 2021-03-10T14:56:13.847721+0000 mgr.gibba045.orlgmj (mgr.34412) 3585 : cluster [DBG] pgmap v2034: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:15.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:56:14 gibba015 bash[30343]: audit 2021-03-10T14:56:13.410699+0000 mgr.gibba045.orlgmj (mgr.34412) 3584 : audit [DBG] from='client.56458 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:56:15.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:56:14 gibba015 bash[30343]: cluster 2021-03-10T14:56:13.847721+0000 mgr.gibba045.orlgmj (mgr.34412) 3585 : cluster [DBG] pgmap v2034: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:15.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:56:14 gibba045 bash[25517]: audit 2021-03-10T14:56:13.410699+0000 mgr.gibba045.orlgmj (mgr.34412) 3584 : audit [DBG] from='client.56458 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:56:15.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:56:14 gibba045 bash[25517]: cluster 2021-03-10T14:56:13.847721+0000 mgr.gibba045.orlgmj (mgr.34412) 3585 : cluster [DBG] pgmap v2034: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:17.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:56:16 gibba015 bash[29377]: cluster 2021-03-10T14:56:15.849422+0000 mgr.gibba045.orlgmj (mgr.34412) 3586 : cluster [DBG] pgmap v2035: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:17.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:56:16 gibba015 bash[30343]: cluster 2021-03-10T14:56:15.849422+0000 mgr.gibba045.orlgmj (mgr.34412) 3586 : cluster [DBG] pgmap v2035: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:17.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:56:16 gibba045 bash[25517]: cluster 2021-03-10T14:56:15.849422+0000 mgr.gibba045.orlgmj (mgr.34412) 3586 : cluster [DBG] pgmap v2035: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:19.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:56:18 gibba015 bash[29377]: cluster 2021-03-10T14:56:17.850901+0000 mgr.gibba045.orlgmj (mgr.34412) 3587 : cluster [DBG] pgmap v2036: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:19.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:56:18 gibba015 bash[30343]: cluster 2021-03-10T14:56:17.850901+0000 mgr.gibba045.orlgmj (mgr.34412) 3587 : cluster [DBG] pgmap v2036: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:19.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:56:18 gibba045 bash[25517]: cluster 2021-03-10T14:56:17.850901+0000 mgr.gibba045.orlgmj (mgr.34412) 3587 : cluster [DBG] pgmap v2036: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:21.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:56:20 gibba015 bash[29377]: cluster 2021-03-10T14:56:19.852557+0000 mgr.gibba045.orlgmj (mgr.34412) 3588 : cluster [DBG] pgmap v2037: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:21.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:56:20 gibba015 bash[30343]: cluster 2021-03-10T14:56:19.852557+0000 mgr.gibba045.orlgmj (mgr.34412) 3588 : cluster [DBG] pgmap v2037: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:21.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:56:20 gibba045 bash[25517]: cluster 2021-03-10T14:56:19.852557+0000 mgr.gibba045.orlgmj (mgr.34412) 3588 : cluster [DBG] pgmap v2037: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:23.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:56:22 gibba045 bash[25517]: cluster 2021-03-10T14:56:21.853989+0000 mgr.gibba045.orlgmj (mgr.34412) 3589 : cluster [DBG] pgmap v2038: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:23.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:56:22 gibba015 bash[29377]: cluster 2021-03-10T14:56:21.853989+0000 mgr.gibba045.orlgmj (mgr.34412) 3589 : cluster [DBG] pgmap v2038: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:23.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:56:22 gibba015 bash[30343]: cluster 2021-03-10T14:56:21.853989+0000 mgr.gibba045.orlgmj (mgr.34412) 3589 : cluster [DBG] pgmap v2038: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:24.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:56:24 gibba015 bash[29377]: cluster 2021-03-10T14:56:23.854899+0000 mgr.gibba045.orlgmj (mgr.34412) 3590 : cluster [DBG] pgmap v2039: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:24.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:56:24 gibba015 bash[29377]: audit 2021-03-10T14:56:24.331115+0000 mon.c (mon.1) 1032 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:56:24.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:56:24 gibba015 bash[30343]: cluster 2021-03-10T14:56:23.854899+0000 mgr.gibba045.orlgmj (mgr.34412) 3590 : cluster [DBG] pgmap v2039: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:24.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:56:24 gibba015 bash[30343]: audit 2021-03-10T14:56:24.331115+0000 mon.c (mon.1) 1032 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:56:24.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:56:24 gibba045 bash[25517]: cluster 2021-03-10T14:56:23.854899+0000 mgr.gibba045.orlgmj (mgr.34412) 3590 : cluster [DBG] pgmap v2039: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:24.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:56:24 gibba045 bash[25517]: audit 2021-03-10T14:56:24.331115+0000 mon.c (mon.1) 1032 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:56:25.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:56:25 gibba015 bash[29377]: cephadm 2021-03-10T14:56:24.339887+0000 mgr.gibba045.orlgmj (mgr.34412) 3591 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:56:25.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:56:25 gibba015 bash[29377]: cephadm 2021-03-10T14:56:24.341880+0000 mgr.gibba045.orlgmj (mgr.34412) 3592 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:56:25.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:56:25 gibba015 bash[29377]: audit 2021-03-10T14:56:24.548158+0000 mon.a (mon.0) 1115 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:56:25.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:56:25 gibba015 bash[29377]: audit 2021-03-10T14:56:24.552052+0000 mon.c (mon.1) 1033 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:56:25.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:56:25 gibba015 bash[29377]: audit 2021-03-10T14:56:24.553719+0000 mon.c (mon.1) 1034 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:56:25.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:56:25 gibba015 bash[29377]: cephadm 2021-03-10T14:56:24.554631+0000 mgr.gibba045.orlgmj (mgr.34412) 3593 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:56:25.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:56:25 gibba015 bash[29377]: audit 2021-03-10T14:56:24.555247+0000 mon.c (mon.1) 1035 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:56:25.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:56:25 gibba015 bash[29377]: audit 2021-03-10T14:56:24.556519+0000 mon.c (mon.1) 1036 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:56:25.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:56:25 gibba015 bash[29377]: cephadm 2021-03-10T14:56:24.556671+0000 mgr.gibba045.orlgmj (mgr.34412) 3594 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:56:25.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:56:25 gibba015 bash[29377]: cephadm 2021-03-10T14:56:24.558190+0000 mgr.gibba045.orlgmj (mgr.34412) 3595 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:56:25.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:56:25 gibba015 bash[29377]: cephadm 2021-03-10T14:56:24.558228+0000 mgr.gibba045.orlgmj (mgr.34412) 3596 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:56:25.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:56:25 gibba015 bash[29377]: cephadm 2021-03-10T14:56:24.559524+0000 mgr.gibba045.orlgmj (mgr.34412) 3597 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:56:25.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:56:25 gibba015 bash[29377]: cephadm 2021-03-10T14:56:24.559562+0000 mgr.gibba045.orlgmj (mgr.34412) 3598 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:56:25.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:56:25 gibba015 bash[29377]: audit 2021-03-10T14:56:24.559903+0000 mon.c (mon.1) 1037 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:56:25.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:56:25 gibba015 bash[29377]: cephadm 2021-03-10T14:56:24.560976+0000 mgr.gibba045.orlgmj (mgr.34412) 3599 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:56:25.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:56:25 gibba015 bash[29377]: audit 2021-03-10T14:56:24.561365+0000 mon.c (mon.1) 1038 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:56:25.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:56:25 gibba015 bash[29377]: cephadm 2021-03-10T14:56:24.562754+0000 mgr.gibba045.orlgmj (mgr.34412) 3600 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:56:25.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:56:25 gibba015 bash[29377]: cephadm 2021-03-10T14:56:24.562792+0000 mgr.gibba045.orlgmj (mgr.34412) 3601 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:56:25.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:56:25 gibba015 bash[29377]: cephadm 2021-03-10T14:56:24.564109+0000 mgr.gibba045.orlgmj (mgr.34412) 3602 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:56:25.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:56:25 gibba015 bash[29377]: cephadm 2021-03-10T14:56:24.564418+0000 mgr.gibba045.orlgmj (mgr.34412) 3603 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:56:25.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:56:25 gibba015 bash[29377]: cephadm 2021-03-10T14:56:24.565543+0000 mgr.gibba045.orlgmj (mgr.34412) 3604 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:56:25.980 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:56:25 gibba015 bash[29377]: cephadm 2021-03-10T14:56:24.565581+0000 mgr.gibba045.orlgmj (mgr.34412) 3605 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:56:25.980 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:56:25 gibba015 bash[29377]: cephadm 2021-03-10T14:56:24.565684+0000 mgr.gibba045.orlgmj (mgr.34412) 3606 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:56:25.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:56:25 gibba015 bash[30343]: cephadm 2021-03-10T14:56:24.339887+0000 mgr.gibba045.orlgmj (mgr.34412) 3591 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:56:25.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:56:25 gibba015 bash[30343]: cephadm 2021-03-10T14:56:24.341880+0000 mgr.gibba045.orlgmj (mgr.34412) 3592 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:56:25.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:56:25 gibba015 bash[30343]: audit 2021-03-10T14:56:24.548158+0000 mon.a (mon.0) 1115 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:56:25.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:56:25 gibba015 bash[30343]: audit 2021-03-10T14:56:24.552052+0000 mon.c (mon.1) 1033 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:56:25.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:56:25 gibba015 bash[30343]: audit 2021-03-10T14:56:24.553719+0000 mon.c (mon.1) 1034 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:56:25.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:56:25 gibba015 bash[30343]: cephadm 2021-03-10T14:56:24.554631+0000 mgr.gibba045.orlgmj (mgr.34412) 3593 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:56:25.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:56:25 gibba015 bash[30343]: audit 2021-03-10T14:56:24.555247+0000 mon.c (mon.1) 1035 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:56:25.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:56:25 gibba015 bash[30343]: audit 2021-03-10T14:56:24.556519+0000 mon.c (mon.1) 1036 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:56:25.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:56:25 gibba015 bash[30343]: cephadm 2021-03-10T14:56:24.556671+0000 mgr.gibba045.orlgmj (mgr.34412) 3594 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:56:25.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:56:25 gibba015 bash[30343]: cephadm 2021-03-10T14:56:24.558190+0000 mgr.gibba045.orlgmj (mgr.34412) 3595 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:56:25.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:56:25 gibba015 bash[30343]: cephadm 2021-03-10T14:56:24.558228+0000 mgr.gibba045.orlgmj (mgr.34412) 3596 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:56:25.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:56:25 gibba015 bash[30343]: cephadm 2021-03-10T14:56:24.559524+0000 mgr.gibba045.orlgmj (mgr.34412) 3597 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:56:25.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:56:25 gibba015 bash[30343]: cephadm 2021-03-10T14:56:24.559562+0000 mgr.gibba045.orlgmj (mgr.34412) 3598 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:56:25.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:56:25 gibba015 bash[30343]: audit 2021-03-10T14:56:24.559903+0000 mon.c (mon.1) 1037 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:56:25.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:56:25 gibba015 bash[30343]: cephadm 2021-03-10T14:56:24.560976+0000 mgr.gibba045.orlgmj (mgr.34412) 3599 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:56:25.984 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:56:25 gibba015 bash[30343]: audit 2021-03-10T14:56:24.561365+0000 mon.c (mon.1) 1038 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:56:25.984 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:56:25 gibba015 bash[30343]: cephadm 2021-03-10T14:56:24.562754+0000 mgr.gibba045.orlgmj (mgr.34412) 3600 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:56:25.984 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:56:25 gibba015 bash[30343]: cephadm 2021-03-10T14:56:24.562792+0000 mgr.gibba045.orlgmj (mgr.34412) 3601 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:56:25.984 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:56:25 gibba015 bash[30343]: cephadm 2021-03-10T14:56:24.564109+0000 mgr.gibba045.orlgmj (mgr.34412) 3602 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:56:25.984 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:56:25 gibba015 bash[30343]: cephadm 2021-03-10T14:56:24.564418+0000 mgr.gibba045.orlgmj (mgr.34412) 3603 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:56:25.985 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:56:25 gibba015 bash[30343]: cephadm 2021-03-10T14:56:24.565543+0000 mgr.gibba045.orlgmj (mgr.34412) 3604 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:56:25.985 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:56:25 gibba015 bash[30343]: cephadm 2021-03-10T14:56:24.565581+0000 mgr.gibba045.orlgmj (mgr.34412) 3605 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:56:25.985 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:56:25 gibba015 bash[30343]: cephadm 2021-03-10T14:56:24.565684+0000 mgr.gibba045.orlgmj (mgr.34412) 3606 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:56:26.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:56:25 gibba045 bash[25517]: cephadm 2021-03-10T14:56:24.339887+0000 mgr.gibba045.orlgmj (mgr.34412) 3591 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:56:26.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:56:25 gibba045 bash[25517]: cephadm 2021-03-10T14:56:24.341880+0000 mgr.gibba045.orlgmj (mgr.34412) 3592 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:56:26.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:56:25 gibba045 bash[25517]: audit 2021-03-10T14:56:24.548158+0000 mon.a (mon.0) 1115 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:56:26.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:56:25 gibba045 bash[25517]: audit 2021-03-10T14:56:24.552052+0000 mon.c (mon.1) 1033 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:56:26.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:56:25 gibba045 bash[25517]: audit 2021-03-10T14:56:24.553719+0000 mon.c (mon.1) 1034 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:56:26.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:56:25 gibba045 bash[25517]: cephadm 2021-03-10T14:56:24.554631+0000 mgr.gibba045.orlgmj (mgr.34412) 3593 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:56:26.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:56:25 gibba045 bash[25517]: audit 2021-03-10T14:56:24.555247+0000 mon.c (mon.1) 1035 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:56:26.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:56:25 gibba045 bash[25517]: audit 2021-03-10T14:56:24.556519+0000 mon.c (mon.1) 1036 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:56:26.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:56:25 gibba045 bash[25517]: cephadm 2021-03-10T14:56:24.556671+0000 mgr.gibba045.orlgmj (mgr.34412) 3594 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:56:26.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:56:25 gibba045 bash[25517]: cephadm 2021-03-10T14:56:24.558190+0000 mgr.gibba045.orlgmj (mgr.34412) 3595 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:56:26.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:56:25 gibba045 bash[25517]: cephadm 2021-03-10T14:56:24.558228+0000 mgr.gibba045.orlgmj (mgr.34412) 3596 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:56:26.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:56:25 gibba045 bash[25517]: cephadm 2021-03-10T14:56:24.559524+0000 mgr.gibba045.orlgmj (mgr.34412) 3597 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:56:26.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:56:25 gibba045 bash[25517]: cephadm 2021-03-10T14:56:24.559562+0000 mgr.gibba045.orlgmj (mgr.34412) 3598 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:56:26.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:56:25 gibba045 bash[25517]: audit 2021-03-10T14:56:24.559903+0000 mon.c (mon.1) 1037 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:56:26.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:56:25 gibba045 bash[25517]: cephadm 2021-03-10T14:56:24.560976+0000 mgr.gibba045.orlgmj (mgr.34412) 3599 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:56:26.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:56:25 gibba045 bash[25517]: audit 2021-03-10T14:56:24.561365+0000 mon.c (mon.1) 1038 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:56:26.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:56:25 gibba045 bash[25517]: cephadm 2021-03-10T14:56:24.562754+0000 mgr.gibba045.orlgmj (mgr.34412) 3600 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:56:26.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:56:25 gibba045 bash[25517]: cephadm 2021-03-10T14:56:24.562792+0000 mgr.gibba045.orlgmj (mgr.34412) 3601 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:56:26.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:56:25 gibba045 bash[25517]: cephadm 2021-03-10T14:56:24.564109+0000 mgr.gibba045.orlgmj (mgr.34412) 3602 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:56:26.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:56:25 gibba045 bash[25517]: cephadm 2021-03-10T14:56:24.564418+0000 mgr.gibba045.orlgmj (mgr.34412) 3603 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:56:26.062 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:56:25 gibba045 bash[25517]: cephadm 2021-03-10T14:56:24.565543+0000 mgr.gibba045.orlgmj (mgr.34412) 3604 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:56:26.062 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:56:25 gibba045 bash[25517]: cephadm 2021-03-10T14:56:24.565581+0000 mgr.gibba045.orlgmj (mgr.34412) 3605 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:56:26.062 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:56:25 gibba045 bash[25517]: cephadm 2021-03-10T14:56:24.565684+0000 mgr.gibba045.orlgmj (mgr.34412) 3606 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:56:26.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:56:26 gibba015 bash[29377]: cluster 2021-03-10T14:56:25.856597+0000 mgr.gibba045.orlgmj (mgr.34412) 3607 : cluster [DBG] pgmap v2040: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:26.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:56:26 gibba015 bash[30343]: cluster 2021-03-10T14:56:25.856597+0000 mgr.gibba045.orlgmj (mgr.34412) 3607 : cluster [DBG] pgmap v2040: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:27.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:56:26 gibba045 bash[25517]: cluster 2021-03-10T14:56:25.856597+0000 mgr.gibba045.orlgmj (mgr.34412) 3607 : cluster [DBG] pgmap v2040: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:29.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:56:28 gibba015 bash[29377]: cluster 2021-03-10T14:56:27.858263+0000 mgr.gibba045.orlgmj (mgr.34412) 3608 : cluster [DBG] pgmap v2041: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:29.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:56:28 gibba015 bash[30343]: cluster 2021-03-10T14:56:27.858263+0000 mgr.gibba045.orlgmj (mgr.34412) 3608 : cluster [DBG] pgmap v2041: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:29.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:56:28 gibba045 bash[25517]: cluster 2021-03-10T14:56:27.858263+0000 mgr.gibba045.orlgmj (mgr.34412) 3608 : cluster [DBG] pgmap v2041: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:31.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:56:30 gibba015 bash[29377]: cluster 2021-03-10T14:56:29.859940+0000 mgr.gibba045.orlgmj (mgr.34412) 3609 : cluster [DBG] pgmap v2042: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:31.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:56:30 gibba015 bash[30343]: cluster 2021-03-10T14:56:29.859940+0000 mgr.gibba045.orlgmj (mgr.34412) 3609 : cluster [DBG] pgmap v2042: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:31.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:56:30 gibba045 bash[25517]: cluster 2021-03-10T14:56:29.859940+0000 mgr.gibba045.orlgmj (mgr.34412) 3609 : cluster [DBG] pgmap v2042: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:33.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:56:32 gibba015 bash[29377]: cluster 2021-03-10T14:56:31.861579+0000 mgr.gibba045.orlgmj (mgr.34412) 3610 : cluster [DBG] pgmap v2043: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:33.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:56:32 gibba015 bash[30343]: cluster 2021-03-10T14:56:31.861579+0000 mgr.gibba045.orlgmj (mgr.34412) 3610 : cluster [DBG] pgmap v2043: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:33.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:56:32 gibba045 bash[25517]: cluster 2021-03-10T14:56:31.861579+0000 mgr.gibba045.orlgmj (mgr.34412) 3610 : cluster [DBG] pgmap v2043: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:34.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:56:34 gibba015 bash[29377]: cluster 2021-03-10T14:56:33.862863+0000 mgr.gibba045.orlgmj (mgr.34412) 3611 : cluster [DBG] pgmap v2044: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:34.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:56:34 gibba015 bash[30343]: cluster 2021-03-10T14:56:33.862863+0000 mgr.gibba045.orlgmj (mgr.34412) 3611 : cluster [DBG] pgmap v2044: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:34.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:56:34 gibba045 bash[25517]: cluster 2021-03-10T14:56:33.862863+0000 mgr.gibba045.orlgmj (mgr.34412) 3611 : cluster [DBG] pgmap v2044: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:37.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:56:36 gibba015 bash[29377]: cluster 2021-03-10T14:56:35.864654+0000 mgr.gibba045.orlgmj (mgr.34412) 3612 : cluster [DBG] pgmap v2045: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:37.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:56:36 gibba015 bash[30343]: cluster 2021-03-10T14:56:35.864654+0000 mgr.gibba045.orlgmj (mgr.34412) 3612 : cluster [DBG] pgmap v2045: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:37.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:56:36 gibba045 bash[25517]: cluster 2021-03-10T14:56:35.864654+0000 mgr.gibba045.orlgmj (mgr.34412) 3612 : cluster [DBG] pgmap v2045: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:39.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:56:38 gibba015 bash[29377]: cluster 2021-03-10T14:56:37.866030+0000 mgr.gibba045.orlgmj (mgr.34412) 3613 : cluster [DBG] pgmap v2046: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:39.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:56:38 gibba015 bash[30343]: cluster 2021-03-10T14:56:37.866030+0000 mgr.gibba045.orlgmj (mgr.34412) 3613 : cluster [DBG] pgmap v2046: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:39.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:56:38 gibba045 bash[25517]: cluster 2021-03-10T14:56:37.866030+0000 mgr.gibba045.orlgmj (mgr.34412) 3613 : cluster [DBG] pgmap v2046: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:41.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:56:40 gibba015 bash[29377]: cephadm 2021-03-10T14:56:39.581749+0000 mgr.gibba045.orlgmj (mgr.34412) 3614 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:56:41.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:56:40 gibba015 bash[29377]: cluster 2021-03-10T14:56:39.867683+0000 mgr.gibba045.orlgmj (mgr.34412) 3615 : cluster [DBG] pgmap v2047: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:41.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:56:40 gibba015 bash[30343]: cephadm 2021-03-10T14:56:39.581749+0000 mgr.gibba045.orlgmj (mgr.34412) 3614 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:56:41.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:56:40 gibba015 bash[30343]: cluster 2021-03-10T14:56:39.867683+0000 mgr.gibba045.orlgmj (mgr.34412) 3615 : cluster [DBG] pgmap v2047: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:41.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:56:40 gibba045 bash[25517]: cephadm 2021-03-10T14:56:39.581749+0000 mgr.gibba045.orlgmj (mgr.34412) 3614 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:56:41.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:56:40 gibba045 bash[25517]: cluster 2021-03-10T14:56:39.867683+0000 mgr.gibba045.orlgmj (mgr.34412) 3615 : cluster [DBG] pgmap v2047: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:43.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:56:42 gibba015 bash[29377]: cluster 2021-03-10T14:56:41.869174+0000 mgr.gibba045.orlgmj (mgr.34412) 3616 : cluster [DBG] pgmap v2048: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:43.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:56:42 gibba015 bash[30343]: cluster 2021-03-10T14:56:41.869174+0000 mgr.gibba045.orlgmj (mgr.34412) 3616 : cluster [DBG] pgmap v2048: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:43.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:56:42 gibba045 bash[25517]: cluster 2021-03-10T14:56:41.869174+0000 mgr.gibba045.orlgmj (mgr.34412) 3616 : cluster [DBG] pgmap v2048: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:43.916 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:56:44.172 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:56:44.173 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (67m) 2m ago 72m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:56:44.173 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (72m) 80s ago 72m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:56:44.173 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (67m) 80s ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:56:44.174 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (68m) 80s ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:56:44.174 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (67m) 2m ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:56:44.174 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (66m) 2m ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:56:44.174 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (66m) 80s ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:56:44.175 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (66m) 2m ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:56:44.175 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (72m) 2m ago 72m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:56:44.175 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (72m) 80s ago 73m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:56:44.175 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (65m) 2m ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:56:44.175 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (65m) 2m ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:56:44.176 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (64m) 2m ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:56:44.176 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (64m) 2m ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:56:44.176 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (64m) 80s ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:56:44.176 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (63m) 80s ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:56:44.177 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (63m) 80s ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:56:44.177 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (62m) 80s ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:56:44.177 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (72m) 80s ago 73m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:56:44.177 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 80s ago 70m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:56:44.430 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:56:44.431 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:56:44.431 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:56:44.431 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:56:44.432 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:56:44.432 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:56:44.432 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:56:44.432 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:56:44.433 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:56:44.433 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:56:44.433 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:56:44.433 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:56:44.433 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:56:44.434 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:56:44.434 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:56:44.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:56:44 gibba015 bash[29377]: cluster 2021-03-10T14:56:43.870017+0000 mgr.gibba045.orlgmj (mgr.34412) 3617 : cluster [DBG] pgmap v2049: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:44.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:56:44 gibba015 bash[29377]: audit 2021-03-10T14:56:43.906063+0000 mgr.gibba045.orlgmj (mgr.34412) 3618 : audit [DBG] from='client.46482 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:56:44.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:56:44 gibba015 bash[29377]: audit 2021-03-10T14:56:44.131408+0000 mgr.gibba045.orlgmj (mgr.34412) 3619 : audit [DBG] from='client.56476 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:56:44.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:56:44 gibba015 bash[30343]: cluster 2021-03-10T14:56:43.870017+0000 mgr.gibba045.orlgmj (mgr.34412) 3617 : cluster [DBG] pgmap v2049: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:44.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:56:44 gibba015 bash[30343]: audit 2021-03-10T14:56:43.906063+0000 mgr.gibba045.orlgmj (mgr.34412) 3618 : audit [DBG] from='client.46482 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:56:44.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:56:44 gibba015 bash[30343]: audit 2021-03-10T14:56:44.131408+0000 mgr.gibba045.orlgmj (mgr.34412) 3619 : audit [DBG] from='client.56476 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:56:44.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:56:44 gibba045 bash[25517]: cluster 2021-03-10T14:56:43.870017+0000 mgr.gibba045.orlgmj (mgr.34412) 3617 : cluster [DBG] pgmap v2049: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:44.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:56:44 gibba045 bash[25517]: audit 2021-03-10T14:56:43.906063+0000 mgr.gibba045.orlgmj (mgr.34412) 3618 : audit [DBG] from='client.46482 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:56:44.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:56:44 gibba045 bash[25517]: audit 2021-03-10T14:56:44.131408+0000 mgr.gibba045.orlgmj (mgr.34412) 3619 : audit [DBG] from='client.56476 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:56:45.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:56:45 gibba015 bash[29377]: audit 2021-03-10T14:56:44.426918+0000 mon.a (mon.0) 1116 : audit [DBG] from='client.? 172.21.2.115:0/2879157577' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:56:45.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:56:45 gibba015 bash[30343]: audit 2021-03-10T14:56:44.426918+0000 mon.a (mon.0) 1116 : audit [DBG] from='client.? 172.21.2.115:0/2879157577' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:56:45.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:56:45 gibba045 bash[25517]: audit 2021-03-10T14:56:44.426918+0000 mon.a (mon.0) 1116 : audit [DBG] from='client.? 172.21.2.115:0/2879157577' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:56:46.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:56:46 gibba015 bash[29377]: cluster 2021-03-10T14:56:45.871673+0000 mgr.gibba045.orlgmj (mgr.34412) 3620 : cluster [DBG] pgmap v2050: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:46.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:56:46 gibba015 bash[30343]: cluster 2021-03-10T14:56:45.871673+0000 mgr.gibba045.orlgmj (mgr.34412) 3620 : cluster [DBG] pgmap v2050: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:46.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:56:46 gibba045 bash[25517]: cluster 2021-03-10T14:56:45.871673+0000 mgr.gibba045.orlgmj (mgr.34412) 3620 : cluster [DBG] pgmap v2050: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:49.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:56:48 gibba015 bash[29377]: cluster 2021-03-10T14:56:47.873389+0000 mgr.gibba045.orlgmj (mgr.34412) 3621 : cluster [DBG] pgmap v2051: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:49.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:56:48 gibba015 bash[30343]: cluster 2021-03-10T14:56:47.873389+0000 mgr.gibba045.orlgmj (mgr.34412) 3621 : cluster [DBG] pgmap v2051: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:49.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:56:48 gibba045 bash[25517]: cluster 2021-03-10T14:56:47.873389+0000 mgr.gibba045.orlgmj (mgr.34412) 3621 : cluster [DBG] pgmap v2051: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:51.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:56:50 gibba015 bash[29377]: cluster 2021-03-10T14:56:49.875037+0000 mgr.gibba045.orlgmj (mgr.34412) 3622 : cluster [DBG] pgmap v2052: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:51.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:56:50 gibba015 bash[30343]: cluster 2021-03-10T14:56:49.875037+0000 mgr.gibba045.orlgmj (mgr.34412) 3622 : cluster [DBG] pgmap v2052: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:51.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:56:50 gibba045 bash[25517]: cluster 2021-03-10T14:56:49.875037+0000 mgr.gibba045.orlgmj (mgr.34412) 3622 : cluster [DBG] pgmap v2052: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:53.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:56:52 gibba015 bash[29377]: cluster 2021-03-10T14:56:51.876858+0000 mgr.gibba045.orlgmj (mgr.34412) 3623 : cluster [DBG] pgmap v2053: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:53.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:56:52 gibba015 bash[29377]: audit 2021-03-10T14:56:52.914170+0000 mon.c (mon.1) 1039 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:56:53.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:56:52 gibba015 bash[29377]: audit 2021-03-10T14:56:52.914865+0000 mon.c (mon.1) 1040 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:56:53.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:56:52 gibba015 bash[29377]: audit 2021-03-10T14:56:52.915307+0000 mon.a (mon.0) 1117 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:56:53.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:56:52 gibba015 bash[29377]: audit 2021-03-10T14:56:52.916424+0000 mon.a (mon.0) 1118 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:56:53.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:56:52 gibba015 bash[29377]: audit 2021-03-10T14:56:52.924221+0000 mon.c (mon.1) 1041 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T14:56:53.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:56:52 gibba015 bash[29377]: audit 2021-03-10T14:56:52.924945+0000 mon.c (mon.1) 1042 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:56:53.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:56:52 gibba015 bash[29377]: audit 2021-03-10T14:56:52.925429+0000 mon.a (mon.0) 1119 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T14:56:53.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:56:52 gibba015 bash[29377]: audit 2021-03-10T14:56:52.925690+0000 mon.c (mon.1) 1043 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:56:53.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:56:52 gibba015 bash[29377]: audit 2021-03-10T14:56:52.926501+0000 mon.c (mon.1) 1044 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:56:53.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:56:52 gibba015 bash[29377]: audit 2021-03-10T14:56:52.926704+0000 mon.a (mon.0) 1120 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:56:53.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:56:52 gibba015 bash[29377]: audit 2021-03-10T14:56:52.927866+0000 mon.a (mon.0) 1121 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:56:53.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:56:52 gibba015 bash[29377]: audit 2021-03-10T14:56:52.928643+0000 mon.a (mon.0) 1122 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:56:53.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:56:52 gibba015 bash[30343]: cluster 2021-03-10T14:56:51.876858+0000 mgr.gibba045.orlgmj (mgr.34412) 3623 : cluster [DBG] pgmap v2053: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:53.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:56:52 gibba015 bash[30343]: audit 2021-03-10T14:56:52.914170+0000 mon.c (mon.1) 1039 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:56:53.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:56:52 gibba015 bash[30343]: audit 2021-03-10T14:56:52.914865+0000 mon.c (mon.1) 1040 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:56:53.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:56:52 gibba015 bash[30343]: audit 2021-03-10T14:56:52.915307+0000 mon.a (mon.0) 1117 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:56:53.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:56:52 gibba015 bash[30343]: audit 2021-03-10T14:56:52.916424+0000 mon.a (mon.0) 1118 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:56:53.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:56:52 gibba015 bash[30343]: audit 2021-03-10T14:56:52.924221+0000 mon.c (mon.1) 1041 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T14:56:53.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:56:52 gibba015 bash[30343]: audit 2021-03-10T14:56:52.924945+0000 mon.c (mon.1) 1042 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:56:53.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:56:52 gibba015 bash[30343]: audit 2021-03-10T14:56:52.925429+0000 mon.a (mon.0) 1119 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T14:56:53.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:56:52 gibba015 bash[30343]: audit 2021-03-10T14:56:52.925690+0000 mon.c (mon.1) 1043 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:56:53.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:56:52 gibba015 bash[30343]: audit 2021-03-10T14:56:52.926501+0000 mon.c (mon.1) 1044 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:56:53.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:56:52 gibba015 bash[30343]: audit 2021-03-10T14:56:52.926704+0000 mon.a (mon.0) 1120 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:56:53.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:56:52 gibba015 bash[30343]: audit 2021-03-10T14:56:52.927866+0000 mon.a (mon.0) 1121 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:56:53.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:56:52 gibba015 bash[30343]: audit 2021-03-10T14:56:52.928643+0000 mon.a (mon.0) 1122 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:56:53.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:56:52 gibba045 bash[25517]: cluster 2021-03-10T14:56:51.876858+0000 mgr.gibba045.orlgmj (mgr.34412) 3623 : cluster [DBG] pgmap v2053: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:53.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:56:52 gibba045 bash[25517]: audit 2021-03-10T14:56:52.914170+0000 mon.c (mon.1) 1039 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:56:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:56:52 gibba045 bash[25517]: audit 2021-03-10T14:56:52.914865+0000 mon.c (mon.1) 1040 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:56:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:56:52 gibba045 bash[25517]: audit 2021-03-10T14:56:52.915307+0000 mon.a (mon.0) 1117 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:56:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:56:52 gibba045 bash[25517]: audit 2021-03-10T14:56:52.916424+0000 mon.a (mon.0) 1118 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:56:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:56:52 gibba045 bash[25517]: audit 2021-03-10T14:56:52.924221+0000 mon.c (mon.1) 1041 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T14:56:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:56:52 gibba045 bash[25517]: audit 2021-03-10T14:56:52.924945+0000 mon.c (mon.1) 1042 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:56:53.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:56:52 gibba045 bash[25517]: audit 2021-03-10T14:56:52.925429+0000 mon.a (mon.0) 1119 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T14:56:53.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:56:52 gibba045 bash[25517]: audit 2021-03-10T14:56:52.925690+0000 mon.c (mon.1) 1043 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:56:53.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:56:52 gibba045 bash[25517]: audit 2021-03-10T14:56:52.926501+0000 mon.c (mon.1) 1044 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:56:53.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:56:52 gibba045 bash[25517]: audit 2021-03-10T14:56:52.926704+0000 mon.a (mon.0) 1120 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:56:53.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:56:52 gibba045 bash[25517]: audit 2021-03-10T14:56:52.927866+0000 mon.a (mon.0) 1121 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:56:53.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:56:52 gibba045 bash[25517]: audit 2021-03-10T14:56:52.928643+0000 mon.a (mon.0) 1122 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:56:54.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:56:54 gibba015 bash[29377]: cluster 2021-03-10T14:56:53.878082+0000 mgr.gibba045.orlgmj (mgr.34412) 3624 : cluster [DBG] pgmap v2054: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:54.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:56:54 gibba015 bash[30343]: cluster 2021-03-10T14:56:53.878082+0000 mgr.gibba045.orlgmj (mgr.34412) 3624 : cluster [DBG] pgmap v2054: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:54.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:56:54 gibba045 bash[25517]: cluster 2021-03-10T14:56:53.878082+0000 mgr.gibba045.orlgmj (mgr.34412) 3624 : cluster [DBG] pgmap v2054: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:55.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:56:55 gibba015 bash[29377]: cephadm 2021-03-10T14:56:54.589431+0000 mgr.gibba045.orlgmj (mgr.34412) 3625 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:56:55.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:56:55 gibba015 bash[30343]: cephadm 2021-03-10T14:56:54.589431+0000 mgr.gibba045.orlgmj (mgr.34412) 3625 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:56:55.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:56:55 gibba045 bash[25517]: cephadm 2021-03-10T14:56:54.589431+0000 mgr.gibba045.orlgmj (mgr.34412) 3625 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:56:56.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:56:56 gibba015 bash[29377]: cluster 2021-03-10T14:56:55.879917+0000 mgr.gibba045.orlgmj (mgr.34412) 3626 : cluster [DBG] pgmap v2055: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:56.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:56:56 gibba015 bash[30343]: cluster 2021-03-10T14:56:55.879917+0000 mgr.gibba045.orlgmj (mgr.34412) 3626 : cluster [DBG] pgmap v2055: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:56.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:56:56 gibba045 bash[25517]: cluster 2021-03-10T14:56:55.879917+0000 mgr.gibba045.orlgmj (mgr.34412) 3626 : cluster [DBG] pgmap v2055: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:59.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:56:58 gibba015 bash[29377]: cluster 2021-03-10T14:56:57.881583+0000 mgr.gibba045.orlgmj (mgr.34412) 3627 : cluster [DBG] pgmap v2056: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:59.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:56:58 gibba015 bash[30343]: cluster 2021-03-10T14:56:57.881583+0000 mgr.gibba045.orlgmj (mgr.34412) 3627 : cluster [DBG] pgmap v2056: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:59.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:56:58 gibba045 bash[25517]: cluster 2021-03-10T14:56:57.881583+0000 mgr.gibba045.orlgmj (mgr.34412) 3627 : cluster [DBG] pgmap v2056: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:01.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:57:00 gibba015 bash[29377]: cluster 2021-03-10T14:56:59.883212+0000 mgr.gibba045.orlgmj (mgr.34412) 3628 : cluster [DBG] pgmap v2057: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:01.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:57:00 gibba015 bash[30343]: cluster 2021-03-10T14:56:59.883212+0000 mgr.gibba045.orlgmj (mgr.34412) 3628 : cluster [DBG] pgmap v2057: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:01.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:57:00 gibba045 bash[25517]: cluster 2021-03-10T14:56:59.883212+0000 mgr.gibba045.orlgmj (mgr.34412) 3628 : cluster [DBG] pgmap v2057: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:03.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:57:02 gibba015 bash[29377]: cluster 2021-03-10T14:57:01.885021+0000 mgr.gibba045.orlgmj (mgr.34412) 3629 : cluster [DBG] pgmap v2058: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:03.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:57:02 gibba015 bash[30343]: cluster 2021-03-10T14:57:01.885021+0000 mgr.gibba045.orlgmj (mgr.34412) 3629 : cluster [DBG] pgmap v2058: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:03.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:57:02 gibba045 bash[25517]: cluster 2021-03-10T14:57:01.885021+0000 mgr.gibba045.orlgmj (mgr.34412) 3629 : cluster [DBG] pgmap v2058: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:04.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:57:04 gibba015 bash[29377]: cluster 2021-03-10T14:57:03.886230+0000 mgr.gibba045.orlgmj (mgr.34412) 3630 : cluster [DBG] pgmap v2059: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:04.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:57:04 gibba015 bash[30343]: cluster 2021-03-10T14:57:03.886230+0000 mgr.gibba045.orlgmj (mgr.34412) 3630 : cluster [DBG] pgmap v2059: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:04.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:57:04 gibba045 bash[25517]: cluster 2021-03-10T14:57:03.886230+0000 mgr.gibba045.orlgmj (mgr.34412) 3630 : cluster [DBG] pgmap v2059: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:07.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:57:06 gibba015 bash[29377]: cluster 2021-03-10T14:57:05.887913+0000 mgr.gibba045.orlgmj (mgr.34412) 3631 : cluster [DBG] pgmap v2060: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:07.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:57:06 gibba015 bash[30343]: cluster 2021-03-10T14:57:05.887913+0000 mgr.gibba045.orlgmj (mgr.34412) 3631 : cluster [DBG] pgmap v2060: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:07.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:57:06 gibba045 bash[25517]: cluster 2021-03-10T14:57:05.887913+0000 mgr.gibba045.orlgmj (mgr.34412) 3631 : cluster [DBG] pgmap v2060: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:09.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:57:08 gibba015 bash[29377]: cluster 2021-03-10T14:57:07.889548+0000 mgr.gibba045.orlgmj (mgr.34412) 3632 : cluster [DBG] pgmap v2061: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:09.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:57:08 gibba015 bash[30343]: cluster 2021-03-10T14:57:07.889548+0000 mgr.gibba045.orlgmj (mgr.34412) 3632 : cluster [DBG] pgmap v2061: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:09.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:57:08 gibba045 bash[25517]: cluster 2021-03-10T14:57:07.889548+0000 mgr.gibba045.orlgmj (mgr.34412) 3632 : cluster [DBG] pgmap v2061: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:11.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:57:10 gibba015 bash[29377]: cephadm 2021-03-10T14:57:09.605243+0000 mgr.gibba045.orlgmj (mgr.34412) 3633 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:57:11.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:57:10 gibba015 bash[29377]: cluster 2021-03-10T14:57:09.891439+0000 mgr.gibba045.orlgmj (mgr.34412) 3634 : cluster [DBG] pgmap v2062: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:11.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:57:10 gibba015 bash[30343]: cephadm 2021-03-10T14:57:09.605243+0000 mgr.gibba045.orlgmj (mgr.34412) 3633 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:57:11.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:57:10 gibba015 bash[30343]: cluster 2021-03-10T14:57:09.891439+0000 mgr.gibba045.orlgmj (mgr.34412) 3634 : cluster [DBG] pgmap v2062: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:11.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:57:10 gibba045 bash[25517]: cephadm 2021-03-10T14:57:09.605243+0000 mgr.gibba045.orlgmj (mgr.34412) 3633 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:57:11.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:57:10 gibba045 bash[25517]: cluster 2021-03-10T14:57:09.891439+0000 mgr.gibba045.orlgmj (mgr.34412) 3634 : cluster [DBG] pgmap v2062: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:13.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:57:12 gibba045 bash[25517]: cluster 2021-03-10T14:57:11.893327+0000 mgr.gibba045.orlgmj (mgr.34412) 3635 : cluster [DBG] pgmap v2063: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:13.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:57:12 gibba015 bash[29377]: cluster 2021-03-10T14:57:11.893327+0000 mgr.gibba045.orlgmj (mgr.34412) 3635 : cluster [DBG] pgmap v2063: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:13.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:57:12 gibba015 bash[30343]: cluster 2021-03-10T14:57:11.893327+0000 mgr.gibba045.orlgmj (mgr.34412) 3635 : cluster [DBG] pgmap v2063: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:14.672 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:57:14.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:57:14 gibba015 bash[29377]: cluster 2021-03-10T14:57:13.894657+0000 mgr.gibba045.orlgmj (mgr.34412) 3636 : cluster [DBG] pgmap v2064: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:14.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:57:14 gibba015 bash[30343]: cluster 2021-03-10T14:57:13.894657+0000 mgr.gibba045.orlgmj (mgr.34412) 3636 : cluster [DBG] pgmap v2064: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:14.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:57:14 gibba045 bash[25517]: cluster 2021-03-10T14:57:13.894657+0000 mgr.gibba045.orlgmj (mgr.34412) 3636 : cluster [DBG] pgmap v2064: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:14.903 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:57:14.903 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (67m) 2m ago 73m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:57:14.904 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (73m) 110s ago 73m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:57:14.904 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (68m) 110s ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:57:14.904 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (68m) 110s ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:57:14.904 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (67m) 2m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:57:14.904 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (67m) 2m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:57:14.905 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (67m) 110s ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:57:14.905 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (67m) 2m ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:57:14.905 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (73m) 2m ago 73m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:57:14.905 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (73m) 110s ago 73m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:57:14.906 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (66m) 2m ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:57:14.906 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (65m) 2m ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:57:14.906 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (65m) 2m ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:57:14.906 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (64m) 2m ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:57:14.907 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (64m) 110s ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:57:14.907 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (64m) 110s ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:57:14.907 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (63m) 110s ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:57:14.907 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (63m) 110s ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:57:14.907 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (72m) 110s ago 73m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:57:14.908 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 110s ago 71m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:57:15.151 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:57:15.152 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:57:15.152 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:57:15.152 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:57:15.152 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:57:15.153 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:57:15.153 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:57:15.153 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:57:15.153 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:57:15.154 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:57:15.154 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:57:15.154 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:57:15.154 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:57:15.155 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:57:15.155 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:57:15.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:57:15 gibba015 bash[29377]: audit 2021-03-10T14:57:14.663786+0000 mgr.gibba045.orlgmj (mgr.34412) 3637 : audit [DBG] from='client.56488 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:57:15.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:57:15 gibba015 bash[29377]: audit 2021-03-10T14:57:14.890182+0000 mgr.gibba045.orlgmj (mgr.34412) 3638 : audit [DBG] from='client.46506 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:57:15.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:57:15 gibba015 bash[29377]: audit 2021-03-10T14:57:15.147844+0000 mon.c (mon.1) 1045 : audit [DBG] from='client.? 172.21.2.115:0/2407106204' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:57:15.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:57:15 gibba015 bash[30343]: audit 2021-03-10T14:57:14.663786+0000 mgr.gibba045.orlgmj (mgr.34412) 3637 : audit [DBG] from='client.56488 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:57:15.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:57:15 gibba015 bash[30343]: audit 2021-03-10T14:57:14.890182+0000 mgr.gibba045.orlgmj (mgr.34412) 3638 : audit [DBG] from='client.46506 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:57:15.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:57:15 gibba015 bash[30343]: audit 2021-03-10T14:57:15.147844+0000 mon.c (mon.1) 1045 : audit [DBG] from='client.? 172.21.2.115:0/2407106204' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:57:15.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:57:15 gibba045 bash[25517]: audit 2021-03-10T14:57:14.663786+0000 mgr.gibba045.orlgmj (mgr.34412) 3637 : audit [DBG] from='client.56488 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:57:15.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:57:15 gibba045 bash[25517]: audit 2021-03-10T14:57:14.890182+0000 mgr.gibba045.orlgmj (mgr.34412) 3638 : audit [DBG] from='client.46506 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:57:15.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:57:15 gibba045 bash[25517]: audit 2021-03-10T14:57:15.147844+0000 mon.c (mon.1) 1045 : audit [DBG] from='client.? 172.21.2.115:0/2407106204' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:57:16.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:57:16 gibba015 bash[29377]: cluster 2021-03-10T14:57:15.896390+0000 mgr.gibba045.orlgmj (mgr.34412) 3639 : cluster [DBG] pgmap v2065: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:16.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:57:16 gibba015 bash[30343]: cluster 2021-03-10T14:57:15.896390+0000 mgr.gibba045.orlgmj (mgr.34412) 3639 : cluster [DBG] pgmap v2065: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:16.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:57:16 gibba045 bash[25517]: cluster 2021-03-10T14:57:15.896390+0000 mgr.gibba045.orlgmj (mgr.34412) 3639 : cluster [DBG] pgmap v2065: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:19.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:57:18 gibba015 bash[29377]: cluster 2021-03-10T14:57:17.897976+0000 mgr.gibba045.orlgmj (mgr.34412) 3640 : cluster [DBG] pgmap v2066: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:19.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:57:18 gibba015 bash[30343]: cluster 2021-03-10T14:57:17.897976+0000 mgr.gibba045.orlgmj (mgr.34412) 3640 : cluster [DBG] pgmap v2066: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:19.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:57:18 gibba045 bash[25517]: cluster 2021-03-10T14:57:17.897976+0000 mgr.gibba045.orlgmj (mgr.34412) 3640 : cluster [DBG] pgmap v2066: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:21.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:57:20 gibba015 bash[29377]: cluster 2021-03-10T14:57:19.899598+0000 mgr.gibba045.orlgmj (mgr.34412) 3641 : cluster [DBG] pgmap v2067: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:21.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:57:20 gibba015 bash[30343]: cluster 2021-03-10T14:57:19.899598+0000 mgr.gibba045.orlgmj (mgr.34412) 3641 : cluster [DBG] pgmap v2067: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:21.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:57:20 gibba045 bash[25517]: cluster 2021-03-10T14:57:19.899598+0000 mgr.gibba045.orlgmj (mgr.34412) 3641 : cluster [DBG] pgmap v2067: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:23.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:57:22 gibba045 bash[25517]: cluster 2021-03-10T14:57:21.901196+0000 mgr.gibba045.orlgmj (mgr.34412) 3642 : cluster [DBG] pgmap v2068: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:23.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:57:22 gibba015 bash[29377]: cluster 2021-03-10T14:57:21.901196+0000 mgr.gibba045.orlgmj (mgr.34412) 3642 : cluster [DBG] pgmap v2068: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:23.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:57:22 gibba015 bash[30343]: cluster 2021-03-10T14:57:21.901196+0000 mgr.gibba045.orlgmj (mgr.34412) 3642 : cluster [DBG] pgmap v2068: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:24.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:57:24 gibba015 bash[29377]: cluster 2021-03-10T14:57:23.902424+0000 mgr.gibba045.orlgmj (mgr.34412) 3643 : cluster [DBG] pgmap v2069: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:24.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:57:24 gibba015 bash[30343]: cluster 2021-03-10T14:57:23.902424+0000 mgr.gibba045.orlgmj (mgr.34412) 3643 : cluster [DBG] pgmap v2069: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:24.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:57:24 gibba045 bash[25517]: cluster 2021-03-10T14:57:23.902424+0000 mgr.gibba045.orlgmj (mgr.34412) 3643 : cluster [DBG] pgmap v2069: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:25.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:57:25 gibba015 bash[29377]: audit 2021-03-10T14:57:24.617899+0000 mon.c (mon.1) 1046 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:57:25.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:57:25 gibba015 bash[29377]: cephadm 2021-03-10T14:57:24.623473+0000 mgr.gibba045.orlgmj (mgr.34412) 3644 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:57:25.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:57:25 gibba015 bash[29377]: cephadm 2021-03-10T14:57:24.624187+0000 mgr.gibba045.orlgmj (mgr.34412) 3645 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:57:25.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:57:25 gibba015 bash[29377]: audit 2021-03-10T14:57:24.862867+0000 mon.a (mon.0) 1123 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:57:25.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:57:25 gibba015 bash[29377]: audit 2021-03-10T14:57:24.868286+0000 mon.c (mon.1) 1047 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:57:25.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:57:25 gibba015 bash[29377]: audit 2021-03-10T14:57:24.869993+0000 mon.c (mon.1) 1048 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:57:25.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:57:25 gibba015 bash[29377]: cephadm 2021-03-10T14:57:24.870485+0000 mgr.gibba045.orlgmj (mgr.34412) 3646 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:57:25.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:57:25 gibba015 bash[29377]: audit 2021-03-10T14:57:24.871840+0000 mon.c (mon.1) 1049 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:57:25.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:57:25 gibba015 bash[29377]: cephadm 2021-03-10T14:57:24.872924+0000 mgr.gibba045.orlgmj (mgr.34412) 3647 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:57:25.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:57:25 gibba015 bash[29377]: audit 2021-03-10T14:57:24.873401+0000 mon.c (mon.1) 1050 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:57:25.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:57:25 gibba015 bash[29377]: cephadm 2021-03-10T14:57:24.874699+0000 mgr.gibba045.orlgmj (mgr.34412) 3648 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:57:25.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:57:25 gibba015 bash[29377]: cephadm 2021-03-10T14:57:24.874767+0000 mgr.gibba045.orlgmj (mgr.34412) 3649 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:57:25.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:57:25 gibba015 bash[29377]: cephadm 2021-03-10T14:57:24.876505+0000 mgr.gibba045.orlgmj (mgr.34412) 3650 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:57:25.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:57:25 gibba015 bash[29377]: cephadm 2021-03-10T14:57:24.876578+0000 mgr.gibba045.orlgmj (mgr.34412) 3651 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:57:25.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:57:25 gibba015 bash[29377]: audit 2021-03-10T14:57:24.876763+0000 mon.c (mon.1) 1051 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:57:25.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:57:25 gibba015 bash[29377]: cephadm 2021-03-10T14:57:24.877792+0000 mgr.gibba045.orlgmj (mgr.34412) 3652 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:57:25.729 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:57:25 gibba015 bash[29377]: audit 2021-03-10T14:57:24.878803+0000 mon.c (mon.1) 1052 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:57:25.729 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:57:25 gibba015 bash[29377]: cephadm 2021-03-10T14:57:24.879489+0000 mgr.gibba045.orlgmj (mgr.34412) 3653 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:57:25.729 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:57:25 gibba015 bash[29377]: cephadm 2021-03-10T14:57:24.879561+0000 mgr.gibba045.orlgmj (mgr.34412) 3654 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:57:25.729 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:57:25 gibba015 bash[29377]: cephadm 2021-03-10T14:57:24.881247+0000 mgr.gibba045.orlgmj (mgr.34412) 3655 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:57:25.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:57:25 gibba015 bash[30343]: audit 2021-03-10T14:57:24.617899+0000 mon.c (mon.1) 1046 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:57:25.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:57:25 gibba015 bash[30343]: cephadm 2021-03-10T14:57:24.623473+0000 mgr.gibba045.orlgmj (mgr.34412) 3644 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:57:25.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:57:25 gibba015 bash[30343]: cephadm 2021-03-10T14:57:24.624187+0000 mgr.gibba045.orlgmj (mgr.34412) 3645 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:57:25.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:57:25 gibba015 bash[30343]: audit 2021-03-10T14:57:24.862867+0000 mon.a (mon.0) 1123 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:57:25.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:57:25 gibba015 bash[30343]: audit 2021-03-10T14:57:24.868286+0000 mon.c (mon.1) 1047 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:57:25.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:57:25 gibba015 bash[30343]: audit 2021-03-10T14:57:24.869993+0000 mon.c (mon.1) 1048 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:57:25.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:57:25 gibba015 bash[30343]: cephadm 2021-03-10T14:57:24.870485+0000 mgr.gibba045.orlgmj (mgr.34412) 3646 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:57:25.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:57:25 gibba015 bash[30343]: audit 2021-03-10T14:57:24.871840+0000 mon.c (mon.1) 1049 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:57:25.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:57:25 gibba015 bash[30343]: cephadm 2021-03-10T14:57:24.872924+0000 mgr.gibba045.orlgmj (mgr.34412) 3647 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:57:25.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:57:25 gibba015 bash[30343]: audit 2021-03-10T14:57:24.873401+0000 mon.c (mon.1) 1050 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:57:25.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:57:25 gibba015 bash[30343]: cephadm 2021-03-10T14:57:24.874699+0000 mgr.gibba045.orlgmj (mgr.34412) 3648 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:57:25.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:57:25 gibba015 bash[30343]: cephadm 2021-03-10T14:57:24.874767+0000 mgr.gibba045.orlgmj (mgr.34412) 3649 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:57:25.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:57:25 gibba015 bash[30343]: cephadm 2021-03-10T14:57:24.876505+0000 mgr.gibba045.orlgmj (mgr.34412) 3650 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:57:25.733 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:57:25 gibba015 bash[30343]: cephadm 2021-03-10T14:57:24.876578+0000 mgr.gibba045.orlgmj (mgr.34412) 3651 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:57:25.733 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:57:25 gibba015 bash[30343]: audit 2021-03-10T14:57:24.876763+0000 mon.c (mon.1) 1051 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:57:25.733 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:57:25 gibba015 bash[30343]: cephadm 2021-03-10T14:57:24.877792+0000 mgr.gibba045.orlgmj (mgr.34412) 3652 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:57:25.733 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:57:25 gibba015 bash[30343]: audit 2021-03-10T14:57:24.878803+0000 mon.c (mon.1) 1052 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:57:25.733 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:57:25 gibba015 bash[30343]: cephadm 2021-03-10T14:57:24.879489+0000 mgr.gibba045.orlgmj (mgr.34412) 3653 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:57:25.734 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:57:25 gibba015 bash[30343]: cephadm 2021-03-10T14:57:24.879561+0000 mgr.gibba045.orlgmj (mgr.34412) 3654 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:57:25.734 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:57:25 gibba015 bash[30343]: cephadm 2021-03-10T14:57:24.881247+0000 mgr.gibba045.orlgmj (mgr.34412) 3655 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:57:25.734 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:57:25 gibba015 bash[29377]: cephadm 2021-03-10T14:57:24.881935+0000 mgr.gibba045.orlgmj (mgr.34412) 3656 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:57:25.735 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:57:25 gibba015 bash[29377]: cephadm 2021-03-10T14:57:24.883409+0000 mgr.gibba045.orlgmj (mgr.34412) 3657 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:57:25.735 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:57:25 gibba015 bash[29377]: cephadm 2021-03-10T14:57:24.883494+0000 mgr.gibba045.orlgmj (mgr.34412) 3658 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:57:25.735 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:57:25 gibba015 bash[29377]: cephadm 2021-03-10T14:57:24.883719+0000 mgr.gibba045.orlgmj (mgr.34412) 3659 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:57:25.735 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:57:25 gibba015 bash[30343]: cephadm 2021-03-10T14:57:24.881935+0000 mgr.gibba045.orlgmj (mgr.34412) 3656 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:57:25.736 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:57:25 gibba015 bash[30343]: cephadm 2021-03-10T14:57:24.883409+0000 mgr.gibba045.orlgmj (mgr.34412) 3657 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:57:25.736 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:57:25 gibba015 bash[30343]: cephadm 2021-03-10T14:57:24.883494+0000 mgr.gibba045.orlgmj (mgr.34412) 3658 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:57:25.736 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:57:25 gibba015 bash[30343]: cephadm 2021-03-10T14:57:24.883719+0000 mgr.gibba045.orlgmj (mgr.34412) 3659 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:57:25.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:57:25 gibba045 bash[25517]: audit 2021-03-10T14:57:24.617899+0000 mon.c (mon.1) 1046 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:57:25.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:57:25 gibba045 bash[25517]: cephadm 2021-03-10T14:57:24.623473+0000 mgr.gibba045.orlgmj (mgr.34412) 3644 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:57:25.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:57:25 gibba045 bash[25517]: cephadm 2021-03-10T14:57:24.624187+0000 mgr.gibba045.orlgmj (mgr.34412) 3645 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:57:25.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:57:25 gibba045 bash[25517]: audit 2021-03-10T14:57:24.862867+0000 mon.a (mon.0) 1123 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:57:25.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:57:25 gibba045 bash[25517]: audit 2021-03-10T14:57:24.868286+0000 mon.c (mon.1) 1047 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:57:25.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:57:25 gibba045 bash[25517]: audit 2021-03-10T14:57:24.869993+0000 mon.c (mon.1) 1048 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:57:25.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:57:25 gibba045 bash[25517]: cephadm 2021-03-10T14:57:24.870485+0000 mgr.gibba045.orlgmj (mgr.34412) 3646 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:57:25.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:57:25 gibba045 bash[25517]: audit 2021-03-10T14:57:24.871840+0000 mon.c (mon.1) 1049 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:57:25.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:57:25 gibba045 bash[25517]: cephadm 2021-03-10T14:57:24.872924+0000 mgr.gibba045.orlgmj (mgr.34412) 3647 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:57:25.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:57:25 gibba045 bash[25517]: audit 2021-03-10T14:57:24.873401+0000 mon.c (mon.1) 1050 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:57:25.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:57:25 gibba045 bash[25517]: cephadm 2021-03-10T14:57:24.874699+0000 mgr.gibba045.orlgmj (mgr.34412) 3648 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:57:25.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:57:25 gibba045 bash[25517]: cephadm 2021-03-10T14:57:24.874767+0000 mgr.gibba045.orlgmj (mgr.34412) 3649 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:57:25.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:57:25 gibba045 bash[25517]: cephadm 2021-03-10T14:57:24.876505+0000 mgr.gibba045.orlgmj (mgr.34412) 3650 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:57:25.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:57:25 gibba045 bash[25517]: cephadm 2021-03-10T14:57:24.876578+0000 mgr.gibba045.orlgmj (mgr.34412) 3651 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:57:25.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:57:25 gibba045 bash[25517]: audit 2021-03-10T14:57:24.876763+0000 mon.c (mon.1) 1051 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:57:25.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:57:25 gibba045 bash[25517]: cephadm 2021-03-10T14:57:24.877792+0000 mgr.gibba045.orlgmj (mgr.34412) 3652 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:57:25.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:57:25 gibba045 bash[25517]: audit 2021-03-10T14:57:24.878803+0000 mon.c (mon.1) 1052 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:57:25.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:57:25 gibba045 bash[25517]: cephadm 2021-03-10T14:57:24.879489+0000 mgr.gibba045.orlgmj (mgr.34412) 3653 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:57:25.812 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:57:25 gibba045 bash[25517]: cephadm 2021-03-10T14:57:24.879561+0000 mgr.gibba045.orlgmj (mgr.34412) 3654 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:57:25.812 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:57:25 gibba045 bash[25517]: cephadm 2021-03-10T14:57:24.881247+0000 mgr.gibba045.orlgmj (mgr.34412) 3655 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:57:25.812 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:57:25 gibba045 bash[25517]: cephadm 2021-03-10T14:57:24.881935+0000 mgr.gibba045.orlgmj (mgr.34412) 3656 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:57:25.812 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:57:25 gibba045 bash[25517]: cephadm 2021-03-10T14:57:24.883409+0000 mgr.gibba045.orlgmj (mgr.34412) 3657 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:57:25.813 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:57:25 gibba045 bash[25517]: cephadm 2021-03-10T14:57:24.883494+0000 mgr.gibba045.orlgmj (mgr.34412) 3658 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:57:25.813 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:57:25 gibba045 bash[25517]: cephadm 2021-03-10T14:57:24.883719+0000 mgr.gibba045.orlgmj (mgr.34412) 3659 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:57:26.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:57:26 gibba015 bash[29377]: cluster 2021-03-10T14:57:25.904050+0000 mgr.gibba045.orlgmj (mgr.34412) 3660 : cluster [DBG] pgmap v2070: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:26.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:57:26 gibba015 bash[30343]: cluster 2021-03-10T14:57:25.904050+0000 mgr.gibba045.orlgmj (mgr.34412) 3660 : cluster [DBG] pgmap v2070: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:26.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:57:26 gibba045 bash[25517]: cluster 2021-03-10T14:57:25.904050+0000 mgr.gibba045.orlgmj (mgr.34412) 3660 : cluster [DBG] pgmap v2070: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:29.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:57:28 gibba015 bash[29377]: cluster 2021-03-10T14:57:27.905635+0000 mgr.gibba045.orlgmj (mgr.34412) 3661 : cluster [DBG] pgmap v2071: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:29.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:57:28 gibba015 bash[30343]: cluster 2021-03-10T14:57:27.905635+0000 mgr.gibba045.orlgmj (mgr.34412) 3661 : cluster [DBG] pgmap v2071: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:29.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:57:28 gibba045 bash[25517]: cluster 2021-03-10T14:57:27.905635+0000 mgr.gibba045.orlgmj (mgr.34412) 3661 : cluster [DBG] pgmap v2071: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:31.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:57:30 gibba045 bash[25517]: cluster 2021-03-10T14:57:29.907149+0000 mgr.gibba045.orlgmj (mgr.34412) 3662 : cluster [DBG] pgmap v2072: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:31.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:57:30 gibba015 bash[29377]: cluster 2021-03-10T14:57:29.907149+0000 mgr.gibba045.orlgmj (mgr.34412) 3662 : cluster [DBG] pgmap v2072: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:31.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:57:30 gibba015 bash[30343]: cluster 2021-03-10T14:57:29.907149+0000 mgr.gibba045.orlgmj (mgr.34412) 3662 : cluster [DBG] pgmap v2072: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:33.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:57:32 gibba045 bash[25517]: cluster 2021-03-10T14:57:31.908676+0000 mgr.gibba045.orlgmj (mgr.34412) 3663 : cluster [DBG] pgmap v2073: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:33.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:57:32 gibba015 bash[29377]: cluster 2021-03-10T14:57:31.908676+0000 mgr.gibba045.orlgmj (mgr.34412) 3663 : cluster [DBG] pgmap v2073: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:33.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:57:32 gibba015 bash[30343]: cluster 2021-03-10T14:57:31.908676+0000 mgr.gibba045.orlgmj (mgr.34412) 3663 : cluster [DBG] pgmap v2073: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:34.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:57:34 gibba015 bash[29377]: cluster 2021-03-10T14:57:33.909890+0000 mgr.gibba045.orlgmj (mgr.34412) 3664 : cluster [DBG] pgmap v2074: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:34.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:57:34 gibba015 bash[30343]: cluster 2021-03-10T14:57:33.909890+0000 mgr.gibba045.orlgmj (mgr.34412) 3664 : cluster [DBG] pgmap v2074: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:34.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:57:34 gibba045 bash[25517]: cluster 2021-03-10T14:57:33.909890+0000 mgr.gibba045.orlgmj (mgr.34412) 3664 : cluster [DBG] pgmap v2074: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:37.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:57:36 gibba045 bash[25517]: cluster 2021-03-10T14:57:35.911631+0000 mgr.gibba045.orlgmj (mgr.34412) 3665 : cluster [DBG] pgmap v2075: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:37.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:57:36 gibba015 bash[29377]: cluster 2021-03-10T14:57:35.911631+0000 mgr.gibba045.orlgmj (mgr.34412) 3665 : cluster [DBG] pgmap v2075: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:37.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:57:36 gibba015 bash[30343]: cluster 2021-03-10T14:57:35.911631+0000 mgr.gibba045.orlgmj (mgr.34412) 3665 : cluster [DBG] pgmap v2075: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:39.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:57:38 gibba045 bash[25517]: cluster 2021-03-10T14:57:37.913326+0000 mgr.gibba045.orlgmj (mgr.34412) 3666 : cluster [DBG] pgmap v2076: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:39.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:57:38 gibba015 bash[29377]: cluster 2021-03-10T14:57:37.913326+0000 mgr.gibba045.orlgmj (mgr.34412) 3666 : cluster [DBG] pgmap v2076: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:39.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:57:38 gibba015 bash[30343]: cluster 2021-03-10T14:57:37.913326+0000 mgr.gibba045.orlgmj (mgr.34412) 3666 : cluster [DBG] pgmap v2076: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:41.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:57:41 gibba045 bash[25517]: cephadm 2021-03-10T14:57:39.899635+0000 mgr.gibba045.orlgmj (mgr.34412) 3667 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:57:41.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:57:41 gibba045 bash[25517]: cluster 2021-03-10T14:57:39.914859+0000 mgr.gibba045.orlgmj (mgr.34412) 3668 : cluster [DBG] pgmap v2077: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:41.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:57:40 gibba015 bash[29377]: cephadm 2021-03-10T14:57:39.899635+0000 mgr.gibba045.orlgmj (mgr.34412) 3667 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:57:41.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:57:40 gibba015 bash[29377]: cluster 2021-03-10T14:57:39.914859+0000 mgr.gibba045.orlgmj (mgr.34412) 3668 : cluster [DBG] pgmap v2077: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:41.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:57:40 gibba015 bash[30343]: cephadm 2021-03-10T14:57:39.899635+0000 mgr.gibba045.orlgmj (mgr.34412) 3667 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:57:41.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:57:40 gibba015 bash[30343]: cluster 2021-03-10T14:57:39.914859+0000 mgr.gibba045.orlgmj (mgr.34412) 3668 : cluster [DBG] pgmap v2077: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:43.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:57:43 gibba045 bash[25517]: cluster 2021-03-10T14:57:41.916591+0000 mgr.gibba045.orlgmj (mgr.34412) 3669 : cluster [DBG] pgmap v2078: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:43.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:57:43 gibba015 bash[29377]: cluster 2021-03-10T14:57:41.916591+0000 mgr.gibba045.orlgmj (mgr.34412) 3669 : cluster [DBG] pgmap v2078: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:43.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:57:43 gibba015 bash[30343]: cluster 2021-03-10T14:57:41.916591+0000 mgr.gibba045.orlgmj (mgr.34412) 3669 : cluster [DBG] pgmap v2078: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:44.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:57:44 gibba015 bash[29377]: cluster 2021-03-10T14:57:43.917760+0000 mgr.gibba045.orlgmj (mgr.34412) 3670 : cluster [DBG] pgmap v2079: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:44.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:57:44 gibba015 bash[30343]: cluster 2021-03-10T14:57:43.917760+0000 mgr.gibba045.orlgmj (mgr.34412) 3670 : cluster [DBG] pgmap v2079: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:44.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:57:44 gibba045 bash[25517]: cluster 2021-03-10T14:57:43.917760+0000 mgr.gibba045.orlgmj (mgr.34412) 3670 : cluster [DBG] pgmap v2079: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:45.398 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:57:45.627 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:57:45.627 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (68m) 3m ago 73m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:57:45.627 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (73m) 2m ago 73m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:57:45.628 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (68m) 2m ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:57:45.628 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (69m) 2m ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:57:45.628 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (68m) 3m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:57:45.628 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (68m) 3m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:57:45.629 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (67m) 2m ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:57:45.629 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (67m) 3m ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:57:45.629 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (73m) 3m ago 74m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:57:45.629 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (74m) 2m ago 74m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:57:45.629 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (66m) 3m ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:57:45.630 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (66m) 3m ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:57:45.630 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (65m) 3m ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:57:45.630 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (65m) 3m ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:57:45.630 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (65m) 2m ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:57:45.631 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (64m) 2m ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:57:45.631 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (64m) 2m ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:57:45.631 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (63m) 2m ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:57:45.631 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (73m) 2m ago 74m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:57:45.631 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 2m ago 71m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:57:45.883 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:57:45.883 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:57:45.883 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:57:45.884 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:57:45.884 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:57:45.884 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:57:45.884 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:57:45.885 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:57:45.885 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:57:45.885 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:57:45.885 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:57:45.885 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:57:45.886 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:57:45.886 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:57:45.886 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:57:46.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:57:45 gibba015 bash[29377]: audit 2021-03-10T14:57:45.879083+0000 mon.c (mon.1) 1053 : audit [DBG] from='client.? 172.21.2.115:0/3046125201' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:57:46.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:57:45 gibba015 bash[30343]: audit 2021-03-10T14:57:45.879083+0000 mon.c (mon.1) 1053 : audit [DBG] from='client.? 172.21.2.115:0/3046125201' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:57:46.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:57:45 gibba045 bash[25517]: audit 2021-03-10T14:57:45.879083+0000 mon.c (mon.1) 1053 : audit [DBG] from='client.? 172.21.2.115:0/3046125201' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:57:47.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:57:46 gibba045 bash[25517]: audit 2021-03-10T14:57:45.387952+0000 mgr.gibba045.orlgmj (mgr.34412) 3671 : audit [DBG] from='client.56506 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:57:47.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:57:46 gibba045 bash[25517]: audit 2021-03-10T14:57:45.613958+0000 mgr.gibba045.orlgmj (mgr.34412) 3672 : audit [DBG] from='client.46524 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:57:47.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:57:46 gibba045 bash[25517]: cluster 2021-03-10T14:57:45.919258+0000 mgr.gibba045.orlgmj (mgr.34412) 3673 : cluster [DBG] pgmap v2080: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:47.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:57:46 gibba015 bash[29377]: audit 2021-03-10T14:57:45.387952+0000 mgr.gibba045.orlgmj (mgr.34412) 3671 : audit [DBG] from='client.56506 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:57:47.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:57:46 gibba015 bash[29377]: audit 2021-03-10T14:57:45.613958+0000 mgr.gibba045.orlgmj (mgr.34412) 3672 : audit [DBG] from='client.46524 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:57:47.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:57:46 gibba015 bash[29377]: cluster 2021-03-10T14:57:45.919258+0000 mgr.gibba045.orlgmj (mgr.34412) 3673 : cluster [DBG] pgmap v2080: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:47.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:57:46 gibba015 bash[30343]: audit 2021-03-10T14:57:45.387952+0000 mgr.gibba045.orlgmj (mgr.34412) 3671 : audit [DBG] from='client.56506 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:57:47.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:57:46 gibba015 bash[30343]: audit 2021-03-10T14:57:45.613958+0000 mgr.gibba045.orlgmj (mgr.34412) 3672 : audit [DBG] from='client.46524 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:57:47.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:57:46 gibba015 bash[30343]: cluster 2021-03-10T14:57:45.919258+0000 mgr.gibba045.orlgmj (mgr.34412) 3673 : cluster [DBG] pgmap v2080: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:49.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:57:48 gibba045 bash[25517]: cluster 2021-03-10T14:57:47.920675+0000 mgr.gibba045.orlgmj (mgr.34412) 3674 : cluster [DBG] pgmap v2081: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:49.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:57:48 gibba015 bash[29377]: cluster 2021-03-10T14:57:47.920675+0000 mgr.gibba045.orlgmj (mgr.34412) 3674 : cluster [DBG] pgmap v2081: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:49.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:57:48 gibba015 bash[30343]: cluster 2021-03-10T14:57:47.920675+0000 mgr.gibba045.orlgmj (mgr.34412) 3674 : cluster [DBG] pgmap v2081: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:51.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:57:50 gibba045 bash[25517]: cluster 2021-03-10T14:57:49.922291+0000 mgr.gibba045.orlgmj (mgr.34412) 3675 : cluster [DBG] pgmap v2082: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:51.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:57:50 gibba015 bash[29377]: cluster 2021-03-10T14:57:49.922291+0000 mgr.gibba045.orlgmj (mgr.34412) 3675 : cluster [DBG] pgmap v2082: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:51.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:57:50 gibba015 bash[30343]: cluster 2021-03-10T14:57:49.922291+0000 mgr.gibba045.orlgmj (mgr.34412) 3675 : cluster [DBG] pgmap v2082: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:53.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:57:53 gibba045 bash[25517]: cluster 2021-03-10T14:57:51.924020+0000 mgr.gibba045.orlgmj (mgr.34412) 3676 : cluster [DBG] pgmap v2083: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:57:53 gibba045 bash[25517]: audit 2021-03-10T14:57:52.919001+0000 mon.c (mon.1) 1054 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:57:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:57:53 gibba045 bash[25517]: audit 2021-03-10T14:57:52.919657+0000 mon.c (mon.1) 1055 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:57:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:57:53 gibba045 bash[25517]: audit 2021-03-10T14:57:52.920135+0000 mon.a (mon.0) 1124 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:57:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:57:53 gibba045 bash[25517]: audit 2021-03-10T14:57:52.921283+0000 mon.a (mon.0) 1125 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:57:53.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:57:53 gibba045 bash[25517]: audit 2021-03-10T14:57:52.930367+0000 mon.c (mon.1) 1056 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T14:57:53.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:57:53 gibba045 bash[25517]: audit 2021-03-10T14:57:52.931098+0000 mon.c (mon.1) 1057 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:57:53.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:57:53 gibba045 bash[25517]: audit 2021-03-10T14:57:52.931500+0000 mon.a (mon.0) 1126 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T14:57:53.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:57:53 gibba045 bash[25517]: audit 2021-03-10T14:57:52.931800+0000 mon.c (mon.1) 1058 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:57:53.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:57:53 gibba045 bash[25517]: audit 2021-03-10T14:57:52.932659+0000 mon.a (mon.0) 1127 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:57:53.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:57:53 gibba045 bash[25517]: audit 2021-03-10T14:57:52.932894+0000 mon.c (mon.1) 1059 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:57:53.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:57:53 gibba045 bash[25517]: audit 2021-03-10T14:57:52.933664+0000 mon.a (mon.0) 1128 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:57:53.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:57:53 gibba045 bash[25517]: audit 2021-03-10T14:57:52.934663+0000 mon.a (mon.0) 1129 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:57:53.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:57:53 gibba015 bash[29377]: cluster 2021-03-10T14:57:51.924020+0000 mgr.gibba045.orlgmj (mgr.34412) 3676 : cluster [DBG] pgmap v2083: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:53.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:57:53 gibba015 bash[29377]: audit 2021-03-10T14:57:52.919001+0000 mon.c (mon.1) 1054 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:57:53.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:57:53 gibba015 bash[29377]: audit 2021-03-10T14:57:52.919657+0000 mon.c (mon.1) 1055 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:57:53.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:57:53 gibba015 bash[29377]: audit 2021-03-10T14:57:52.920135+0000 mon.a (mon.0) 1124 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:57:53.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:57:53 gibba015 bash[29377]: audit 2021-03-10T14:57:52.921283+0000 mon.a (mon.0) 1125 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:57:53.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:57:53 gibba015 bash[29377]: audit 2021-03-10T14:57:52.930367+0000 mon.c (mon.1) 1056 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T14:57:53.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:57:53 gibba015 bash[29377]: audit 2021-03-10T14:57:52.931098+0000 mon.c (mon.1) 1057 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:57:53.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:57:53 gibba015 bash[29377]: audit 2021-03-10T14:57:52.931500+0000 mon.a (mon.0) 1126 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T14:57:53.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:57:53 gibba015 bash[29377]: audit 2021-03-10T14:57:52.931800+0000 mon.c (mon.1) 1058 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:57:53.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:57:53 gibba015 bash[29377]: audit 2021-03-10T14:57:52.932659+0000 mon.a (mon.0) 1127 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:57:53.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:57:53 gibba015 bash[29377]: audit 2021-03-10T14:57:52.932894+0000 mon.c (mon.1) 1059 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:57:53.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:57:53 gibba015 bash[29377]: audit 2021-03-10T14:57:52.933664+0000 mon.a (mon.0) 1128 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:57:53.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:57:53 gibba015 bash[29377]: audit 2021-03-10T14:57:52.934663+0000 mon.a (mon.0) 1129 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:57:53.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:57:53 gibba015 bash[30343]: cluster 2021-03-10T14:57:51.924020+0000 mgr.gibba045.orlgmj (mgr.34412) 3676 : cluster [DBG] pgmap v2083: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:53.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:57:53 gibba015 bash[30343]: audit 2021-03-10T14:57:52.919001+0000 mon.c (mon.1) 1054 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:57:53.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:57:53 gibba015 bash[30343]: audit 2021-03-10T14:57:52.919657+0000 mon.c (mon.1) 1055 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:57:53.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:57:53 gibba015 bash[30343]: audit 2021-03-10T14:57:52.920135+0000 mon.a (mon.0) 1124 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:57:53.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:57:53 gibba015 bash[30343]: audit 2021-03-10T14:57:52.921283+0000 mon.a (mon.0) 1125 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:57:53.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:57:53 gibba015 bash[30343]: audit 2021-03-10T14:57:52.930367+0000 mon.c (mon.1) 1056 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T14:57:53.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:57:53 gibba015 bash[30343]: audit 2021-03-10T14:57:52.931098+0000 mon.c (mon.1) 1057 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:57:53.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:57:53 gibba015 bash[30343]: audit 2021-03-10T14:57:52.931500+0000 mon.a (mon.0) 1126 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T14:57:53.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:57:53 gibba015 bash[30343]: audit 2021-03-10T14:57:52.931800+0000 mon.c (mon.1) 1058 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:57:53.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:57:53 gibba015 bash[30343]: audit 2021-03-10T14:57:52.932659+0000 mon.a (mon.0) 1127 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:57:53.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:57:53 gibba015 bash[30343]: audit 2021-03-10T14:57:52.932894+0000 mon.c (mon.1) 1059 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:57:53.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:57:53 gibba015 bash[30343]: audit 2021-03-10T14:57:52.933664+0000 mon.a (mon.0) 1128 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:57:53.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:57:53 gibba015 bash[30343]: audit 2021-03-10T14:57:52.934663+0000 mon.a (mon.0) 1129 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:57:54.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:57:54 gibba015 bash[30343]: cluster 2021-03-10T14:57:53.925296+0000 mgr.gibba045.orlgmj (mgr.34412) 3677 : cluster [DBG] pgmap v2084: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:54.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:57:54 gibba015 bash[29377]: cluster 2021-03-10T14:57:53.925296+0000 mgr.gibba045.orlgmj (mgr.34412) 3677 : cluster [DBG] pgmap v2084: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:54.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:57:54 gibba045 bash[25517]: cluster 2021-03-10T14:57:53.925296+0000 mgr.gibba045.orlgmj (mgr.34412) 3677 : cluster [DBG] pgmap v2084: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:55.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:57:55 gibba015 bash[29377]: cephadm 2021-03-10T14:57:54.909444+0000 mgr.gibba045.orlgmj (mgr.34412) 3678 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:57:55.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:57:55 gibba015 bash[30343]: cephadm 2021-03-10T14:57:54.909444+0000 mgr.gibba045.orlgmj (mgr.34412) 3678 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:57:55.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:57:55 gibba045 bash[25517]: cephadm 2021-03-10T14:57:54.909444+0000 mgr.gibba045.orlgmj (mgr.34412) 3678 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:57:56.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:57:56 gibba015 bash[29377]: cluster 2021-03-10T14:57:55.926904+0000 mgr.gibba045.orlgmj (mgr.34412) 3679 : cluster [DBG] pgmap v2085: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:56.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:57:56 gibba015 bash[30343]: cluster 2021-03-10T14:57:55.926904+0000 mgr.gibba045.orlgmj (mgr.34412) 3679 : cluster [DBG] pgmap v2085: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:56.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:57:56 gibba045 bash[25517]: cluster 2021-03-10T14:57:55.926904+0000 mgr.gibba045.orlgmj (mgr.34412) 3679 : cluster [DBG] pgmap v2085: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:59.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:57:58 gibba045 bash[25517]: cluster 2021-03-10T14:57:57.928359+0000 mgr.gibba045.orlgmj (mgr.34412) 3680 : cluster [DBG] pgmap v2086: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:59.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:57:58 gibba015 bash[29377]: cluster 2021-03-10T14:57:57.928359+0000 mgr.gibba045.orlgmj (mgr.34412) 3680 : cluster [DBG] pgmap v2086: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:59.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:57:58 gibba015 bash[30343]: cluster 2021-03-10T14:57:57.928359+0000 mgr.gibba045.orlgmj (mgr.34412) 3680 : cluster [DBG] pgmap v2086: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:01.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:58:01 gibba045 bash[25517]: cluster 2021-03-10T14:57:59.929745+0000 mgr.gibba045.orlgmj (mgr.34412) 3681 : cluster [DBG] pgmap v2087: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:01.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:58:00 gibba015 bash[29377]: cluster 2021-03-10T14:57:59.929745+0000 mgr.gibba045.orlgmj (mgr.34412) 3681 : cluster [DBG] pgmap v2087: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:01.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:58:00 gibba015 bash[30343]: cluster 2021-03-10T14:57:59.929745+0000 mgr.gibba045.orlgmj (mgr.34412) 3681 : cluster [DBG] pgmap v2087: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:03.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:58:03 gibba045 bash[25517]: cluster 2021-03-10T14:58:01.931510+0000 mgr.gibba045.orlgmj (mgr.34412) 3682 : cluster [DBG] pgmap v2088: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:03.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:58:03 gibba015 bash[29377]: cluster 2021-03-10T14:58:01.931510+0000 mgr.gibba045.orlgmj (mgr.34412) 3682 : cluster [DBG] pgmap v2088: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:03.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:58:03 gibba015 bash[30343]: cluster 2021-03-10T14:58:01.931510+0000 mgr.gibba045.orlgmj (mgr.34412) 3682 : cluster [DBG] pgmap v2088: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:04.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:58:04 gibba015 bash[29377]: cluster 2021-03-10T14:58:03.932812+0000 mgr.gibba045.orlgmj (mgr.34412) 3683 : cluster [DBG] pgmap v2089: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:04.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:58:04 gibba015 bash[30343]: cluster 2021-03-10T14:58:03.932812+0000 mgr.gibba045.orlgmj (mgr.34412) 3683 : cluster [DBG] pgmap v2089: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:04.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:58:04 gibba045 bash[25517]: cluster 2021-03-10T14:58:03.932812+0000 mgr.gibba045.orlgmj (mgr.34412) 3683 : cluster [DBG] pgmap v2089: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:07.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:58:07 gibba045 bash[25517]: cluster 2021-03-10T14:58:05.934504+0000 mgr.gibba045.orlgmj (mgr.34412) 3684 : cluster [DBG] pgmap v2090: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:07.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:58:06 gibba015 bash[29377]: cluster 2021-03-10T14:58:05.934504+0000 mgr.gibba045.orlgmj (mgr.34412) 3684 : cluster [DBG] pgmap v2090: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:07.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:58:06 gibba015 bash[30343]: cluster 2021-03-10T14:58:05.934504+0000 mgr.gibba045.orlgmj (mgr.34412) 3684 : cluster [DBG] pgmap v2090: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:09.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:58:09 gibba045 bash[25517]: cluster 2021-03-10T14:58:07.935898+0000 mgr.gibba045.orlgmj (mgr.34412) 3685 : cluster [DBG] pgmap v2091: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:09.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:58:09 gibba015 bash[29377]: cluster 2021-03-10T14:58:07.935898+0000 mgr.gibba045.orlgmj (mgr.34412) 3685 : cluster [DBG] pgmap v2091: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:09.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:58:09 gibba015 bash[30343]: cluster 2021-03-10T14:58:07.935898+0000 mgr.gibba045.orlgmj (mgr.34412) 3685 : cluster [DBG] pgmap v2091: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:11.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:58:11 gibba045 bash[25517]: cephadm 2021-03-10T14:58:09.925533+0000 mgr.gibba045.orlgmj (mgr.34412) 3686 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:58:11.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:58:11 gibba045 bash[25517]: cluster 2021-03-10T14:58:09.937306+0000 mgr.gibba045.orlgmj (mgr.34412) 3687 : cluster [DBG] pgmap v2092: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:11.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:58:11 gibba015 bash[29377]: cephadm 2021-03-10T14:58:09.925533+0000 mgr.gibba045.orlgmj (mgr.34412) 3686 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:58:11.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:58:11 gibba015 bash[29377]: cluster 2021-03-10T14:58:09.937306+0000 mgr.gibba045.orlgmj (mgr.34412) 3687 : cluster [DBG] pgmap v2092: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:11.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:58:11 gibba015 bash[30343]: cephadm 2021-03-10T14:58:09.925533+0000 mgr.gibba045.orlgmj (mgr.34412) 3686 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:58:11.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:58:11 gibba015 bash[30343]: cluster 2021-03-10T14:58:09.937306+0000 mgr.gibba045.orlgmj (mgr.34412) 3687 : cluster [DBG] pgmap v2092: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:13.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:58:13 gibba045 bash[25517]: cluster 2021-03-10T14:58:11.939040+0000 mgr.gibba045.orlgmj (mgr.34412) 3688 : cluster [DBG] pgmap v2093: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:13.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:58:13 gibba015 bash[29377]: cluster 2021-03-10T14:58:11.939040+0000 mgr.gibba045.orlgmj (mgr.34412) 3688 : cluster [DBG] pgmap v2093: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:13.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:58:13 gibba015 bash[30343]: cluster 2021-03-10T14:58:11.939040+0000 mgr.gibba045.orlgmj (mgr.34412) 3688 : cluster [DBG] pgmap v2093: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:14.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:58:14 gibba015 bash[29377]: cluster 2021-03-10T14:58:13.940339+0000 mgr.gibba045.orlgmj (mgr.34412) 3689 : cluster [DBG] pgmap v2094: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:14.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:58:14 gibba015 bash[30343]: cluster 2021-03-10T14:58:13.940339+0000 mgr.gibba045.orlgmj (mgr.34412) 3689 : cluster [DBG] pgmap v2094: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:14.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:58:14 gibba045 bash[25517]: cluster 2021-03-10T14:58:13.940339+0000 mgr.gibba045.orlgmj (mgr.34412) 3689 : cluster [DBG] pgmap v2094: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:16.135 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:58:16.363 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:58:16.363 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (68m) 3m ago 74m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:58:16.363 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (74m) 2m ago 74m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:58:16.364 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (69m) 2m ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:58:16.364 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (69m) 2m ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:58:16.364 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (68m) 3m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:58:16.364 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (68m) 3m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:58:16.365 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (68m) 2m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:58:16.365 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (68m) 3m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:58:16.365 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (74m) 3m ago 74m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:58:16.365 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (74m) 2m ago 74m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:58:16.366 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (67m) 3m ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:58:16.366 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (66m) 3m ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:58:16.366 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (66m) 3m ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:58:16.366 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (66m) 3m ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:58:16.366 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (65m) 2m ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:58:16.367 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (65m) 2m ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:58:16.367 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (64m) 2m ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:58:16.367 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (64m) 2m ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:58:16.367 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (73m) 2m ago 74m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:58:16.368 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 2m ago 72m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:58:16.612 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:58:16.612 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:58:16.613 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:58:16.613 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:58:16.613 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:58:16.613 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:58:16.613 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:58:16.614 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:58:16.614 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:58:16.614 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:58:16.614 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:58:16.615 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:58:16.615 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:58:16.615 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:58:16.615 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:58:17.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:58:17 gibba045 bash[25517]: cluster 2021-03-10T14:58:15.942122+0000 mgr.gibba045.orlgmj (mgr.34412) 3690 : cluster [DBG] pgmap v2095: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:17.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:58:17 gibba045 bash[25517]: audit 2021-03-10T14:58:16.126749+0000 mgr.gibba045.orlgmj (mgr.34412) 3691 : audit [DBG] from='client.46536 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:58:17.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:58:17 gibba045 bash[25517]: audit 2021-03-10T14:58:16.608047+0000 mon.a (mon.0) 1130 : audit [DBG] from='client.? 172.21.2.115:0/2253886467' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:58:17.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:58:16 gibba015 bash[29377]: cluster 2021-03-10T14:58:15.942122+0000 mgr.gibba045.orlgmj (mgr.34412) 3690 : cluster [DBG] pgmap v2095: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:17.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:58:16 gibba015 bash[29377]: audit 2021-03-10T14:58:16.126749+0000 mgr.gibba045.orlgmj (mgr.34412) 3691 : audit [DBG] from='client.46536 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:58:17.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:58:16 gibba015 bash[29377]: audit 2021-03-10T14:58:16.608047+0000 mon.a (mon.0) 1130 : audit [DBG] from='client.? 172.21.2.115:0/2253886467' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:58:17.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:58:16 gibba015 bash[30343]: cluster 2021-03-10T14:58:15.942122+0000 mgr.gibba045.orlgmj (mgr.34412) 3690 : cluster [DBG] pgmap v2095: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:17.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:58:16 gibba015 bash[30343]: audit 2021-03-10T14:58:16.126749+0000 mgr.gibba045.orlgmj (mgr.34412) 3691 : audit [DBG] from='client.46536 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:58:17.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:58:16 gibba015 bash[30343]: audit 2021-03-10T14:58:16.608047+0000 mon.a (mon.0) 1130 : audit [DBG] from='client.? 172.21.2.115:0/2253886467' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:58:18.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:58:18 gibba045 bash[25517]: audit 2021-03-10T14:58:16.350157+0000 mgr.gibba045.orlgmj (mgr.34412) 3692 : audit [DBG] from='client.46542 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:58:18.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:58:18 gibba015 bash[29377]: audit 2021-03-10T14:58:16.350157+0000 mgr.gibba045.orlgmj (mgr.34412) 3692 : audit [DBG] from='client.46542 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:58:18.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:58:18 gibba015 bash[30343]: audit 2021-03-10T14:58:16.350157+0000 mgr.gibba045.orlgmj (mgr.34412) 3692 : audit [DBG] from='client.46542 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:58:19.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:58:19 gibba045 bash[25517]: cluster 2021-03-10T14:58:17.943638+0000 mgr.gibba045.orlgmj (mgr.34412) 3693 : cluster [DBG] pgmap v2096: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:19.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:58:19 gibba015 bash[29377]: cluster 2021-03-10T14:58:17.943638+0000 mgr.gibba045.orlgmj (mgr.34412) 3693 : cluster [DBG] pgmap v2096: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:19.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:58:19 gibba015 bash[30343]: cluster 2021-03-10T14:58:17.943638+0000 mgr.gibba045.orlgmj (mgr.34412) 3693 : cluster [DBG] pgmap v2096: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:21.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:58:21 gibba045 bash[25517]: cluster 2021-03-10T14:58:19.945254+0000 mgr.gibba045.orlgmj (mgr.34412) 3694 : cluster [DBG] pgmap v2097: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:21.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:58:21 gibba015 bash[29377]: cluster 2021-03-10T14:58:19.945254+0000 mgr.gibba045.orlgmj (mgr.34412) 3694 : cluster [DBG] pgmap v2097: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:21.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:58:21 gibba015 bash[30343]: cluster 2021-03-10T14:58:19.945254+0000 mgr.gibba045.orlgmj (mgr.34412) 3694 : cluster [DBG] pgmap v2097: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:23.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:58:23 gibba045 bash[25517]: cluster 2021-03-10T14:58:21.946974+0000 mgr.gibba045.orlgmj (mgr.34412) 3695 : cluster [DBG] pgmap v2098: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:23.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:58:23 gibba015 bash[29377]: cluster 2021-03-10T14:58:21.946974+0000 mgr.gibba045.orlgmj (mgr.34412) 3695 : cluster [DBG] pgmap v2098: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:23.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:58:23 gibba015 bash[30343]: cluster 2021-03-10T14:58:21.946974+0000 mgr.gibba045.orlgmj (mgr.34412) 3695 : cluster [DBG] pgmap v2098: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:24.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:58:24 gibba015 bash[29377]: cluster 2021-03-10T14:58:23.948273+0000 mgr.gibba045.orlgmj (mgr.34412) 3696 : cluster [DBG] pgmap v2099: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:24.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:58:24 gibba015 bash[30343]: cluster 2021-03-10T14:58:23.948273+0000 mgr.gibba045.orlgmj (mgr.34412) 3696 : cluster [DBG] pgmap v2099: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:24.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:58:24 gibba045 bash[25517]: cluster 2021-03-10T14:58:23.948273+0000 mgr.gibba045.orlgmj (mgr.34412) 3696 : cluster [DBG] pgmap v2099: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:25.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:58:25 gibba045 bash[25517]: audit 2021-03-10T14:58:24.930556+0000 mon.c (mon.1) 1060 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:58:25.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:58:25 gibba045 bash[25517]: cephadm 2021-03-10T14:58:24.939562+0000 mgr.gibba045.orlgmj (mgr.34412) 3697 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:58:25.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:58:25 gibba045 bash[25517]: cephadm 2021-03-10T14:58:24.941480+0000 mgr.gibba045.orlgmj (mgr.34412) 3698 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:58:25.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:58:25 gibba045 bash[25517]: audit 2021-03-10T14:58:25.179843+0000 mon.a (mon.0) 1131 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:58:25.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:58:25 gibba045 bash[25517]: audit 2021-03-10T14:58:25.183368+0000 mon.c (mon.1) 1061 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:58:25.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:58:25 gibba045 bash[25517]: audit 2021-03-10T14:58:25.184924+0000 mon.c (mon.1) 1062 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:58:25.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:58:25 gibba045 bash[25517]: cephadm 2021-03-10T14:58:25.186318+0000 mgr.gibba045.orlgmj (mgr.34412) 3699 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:58:25.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:58:25 gibba045 bash[25517]: audit 2021-03-10T14:58:25.186351+0000 mon.c (mon.1) 1063 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:58:25.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:58:25 gibba045 bash[25517]: audit 2021-03-10T14:58:25.187468+0000 mon.c (mon.1) 1064 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:58:25.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:58:25 gibba045 bash[25517]: cephadm 2021-03-10T14:58:25.188086+0000 mgr.gibba045.orlgmj (mgr.34412) 3700 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:58:25.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:58:25 gibba045 bash[25517]: cephadm 2021-03-10T14:58:25.189583+0000 mgr.gibba045.orlgmj (mgr.34412) 3701 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:58:25.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:58:25 gibba045 bash[25517]: cephadm 2021-03-10T14:58:25.189622+0000 mgr.gibba045.orlgmj (mgr.34412) 3702 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:58:25.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:58:25 gibba045 bash[25517]: audit 2021-03-10T14:58:25.190270+0000 mon.c (mon.1) 1065 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:58:25.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:58:25 gibba045 bash[25517]: cephadm 2021-03-10T14:58:25.190795+0000 mgr.gibba045.orlgmj (mgr.34412) 3703 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:58:25.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:58:25 gibba045 bash[25517]: cephadm 2021-03-10T14:58:25.190831+0000 mgr.gibba045.orlgmj (mgr.34412) 3704 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:58:25.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:58:25 gibba045 bash[25517]: audit 2021-03-10T14:58:25.191813+0000 mon.c (mon.1) 1066 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:58:25.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:58:25 gibba045 bash[25517]: cephadm 2021-03-10T14:58:25.191979+0000 mgr.gibba045.orlgmj (mgr.34412) 3705 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:58:25.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:58:25 gibba045 bash[25517]: cephadm 2021-03-10T14:58:25.193467+0000 mgr.gibba045.orlgmj (mgr.34412) 3706 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:58:25.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:58:25 gibba045 bash[25517]: cephadm 2021-03-10T14:58:25.193505+0000 mgr.gibba045.orlgmj (mgr.34412) 3707 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:58:25.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:58:25 gibba045 bash[25517]: cephadm 2021-03-10T14:58:25.194661+0000 mgr.gibba045.orlgmj (mgr.34412) 3708 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:58:25.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:58:25 gibba045 bash[25517]: cephadm 2021-03-10T14:58:25.195045+0000 mgr.gibba045.orlgmj (mgr.34412) 3709 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:58:25.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:58:25 gibba045 bash[25517]: cephadm 2021-03-10T14:58:25.196498+0000 mgr.gibba045.orlgmj (mgr.34412) 3710 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:58:25.563 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:58:25 gibba045 bash[25517]: cephadm 2021-03-10T14:58:25.196582+0000 mgr.gibba045.orlgmj (mgr.34412) 3711 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:58:25.563 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:58:25 gibba045 bash[25517]: cephadm 2021-03-10T14:58:25.196693+0000 mgr.gibba045.orlgmj (mgr.34412) 3712 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:58:25.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:58:25 gibba015 bash[29377]: audit 2021-03-10T14:58:24.930556+0000 mon.c (mon.1) 1060 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:58:25.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:58:25 gibba015 bash[29377]: cephadm 2021-03-10T14:58:24.939562+0000 mgr.gibba045.orlgmj (mgr.34412) 3697 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:58:25.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:58:25 gibba015 bash[29377]: cephadm 2021-03-10T14:58:24.941480+0000 mgr.gibba045.orlgmj (mgr.34412) 3698 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:58:25.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:58:25 gibba015 bash[29377]: audit 2021-03-10T14:58:25.179843+0000 mon.a (mon.0) 1131 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:58:25.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:58:25 gibba015 bash[29377]: audit 2021-03-10T14:58:25.183368+0000 mon.c (mon.1) 1061 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:58:25.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:58:25 gibba015 bash[29377]: audit 2021-03-10T14:58:25.184924+0000 mon.c (mon.1) 1062 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:58:25.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:58:25 gibba015 bash[29377]: cephadm 2021-03-10T14:58:25.186318+0000 mgr.gibba045.orlgmj (mgr.34412) 3699 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:58:25.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:58:25 gibba015 bash[29377]: audit 2021-03-10T14:58:25.186351+0000 mon.c (mon.1) 1063 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:58:25.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:58:25 gibba015 bash[29377]: audit 2021-03-10T14:58:25.187468+0000 mon.c (mon.1) 1064 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:58:25.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:58:25 gibba015 bash[29377]: cephadm 2021-03-10T14:58:25.188086+0000 mgr.gibba045.orlgmj (mgr.34412) 3700 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:58:25.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:58:25 gibba015 bash[29377]: cephadm 2021-03-10T14:58:25.189583+0000 mgr.gibba045.orlgmj (mgr.34412) 3701 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:58:25.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:58:25 gibba015 bash[29377]: cephadm 2021-03-10T14:58:25.189622+0000 mgr.gibba045.orlgmj (mgr.34412) 3702 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:58:25.729 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:58:25 gibba015 bash[29377]: audit 2021-03-10T14:58:25.190270+0000 mon.c (mon.1) 1065 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:58:25.729 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:58:25 gibba015 bash[29377]: cephadm 2021-03-10T14:58:25.190795+0000 mgr.gibba045.orlgmj (mgr.34412) 3703 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:58:25.729 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:58:25 gibba015 bash[29377]: cephadm 2021-03-10T14:58:25.190831+0000 mgr.gibba045.orlgmj (mgr.34412) 3704 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:58:25.729 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:58:25 gibba015 bash[29377]: audit 2021-03-10T14:58:25.191813+0000 mon.c (mon.1) 1066 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:58:25.730 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:58:25 gibba015 bash[29377]: cephadm 2021-03-10T14:58:25.191979+0000 mgr.gibba045.orlgmj (mgr.34412) 3705 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:58:25.730 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:58:25 gibba015 bash[29377]: cephadm 2021-03-10T14:58:25.193467+0000 mgr.gibba045.orlgmj (mgr.34412) 3706 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:58:25.730 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:58:25 gibba015 bash[29377]: cephadm 2021-03-10T14:58:25.193505+0000 mgr.gibba045.orlgmj (mgr.34412) 3707 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:58:25.730 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:58:25 gibba015 bash[29377]: cephadm 2021-03-10T14:58:25.194661+0000 mgr.gibba045.orlgmj (mgr.34412) 3708 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:58:25.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:58:25 gibba015 bash[30343]: audit 2021-03-10T14:58:24.930556+0000 mon.c (mon.1) 1060 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:58:25.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:58:25 gibba015 bash[30343]: cephadm 2021-03-10T14:58:24.939562+0000 mgr.gibba045.orlgmj (mgr.34412) 3697 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:58:25.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:58:25 gibba015 bash[30343]: cephadm 2021-03-10T14:58:24.941480+0000 mgr.gibba045.orlgmj (mgr.34412) 3698 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:58:25.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:58:25 gibba015 bash[30343]: audit 2021-03-10T14:58:25.179843+0000 mon.a (mon.0) 1131 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:58:25.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:58:25 gibba015 bash[30343]: audit 2021-03-10T14:58:25.183368+0000 mon.c (mon.1) 1061 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:58:25.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:58:25 gibba015 bash[30343]: audit 2021-03-10T14:58:25.184924+0000 mon.c (mon.1) 1062 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:58:25.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:58:25 gibba015 bash[30343]: cephadm 2021-03-10T14:58:25.186318+0000 mgr.gibba045.orlgmj (mgr.34412) 3699 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:58:25.733 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:58:25 gibba015 bash[30343]: audit 2021-03-10T14:58:25.186351+0000 mon.c (mon.1) 1063 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:58:25.733 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:58:25 gibba015 bash[30343]: audit 2021-03-10T14:58:25.187468+0000 mon.c (mon.1) 1064 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:58:25.733 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:58:25 gibba015 bash[30343]: cephadm 2021-03-10T14:58:25.188086+0000 mgr.gibba045.orlgmj (mgr.34412) 3700 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:58:25.733 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:58:25 gibba015 bash[30343]: cephadm 2021-03-10T14:58:25.189583+0000 mgr.gibba045.orlgmj (mgr.34412) 3701 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:58:25.734 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:58:25 gibba015 bash[30343]: cephadm 2021-03-10T14:58:25.189622+0000 mgr.gibba045.orlgmj (mgr.34412) 3702 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:58:25.734 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:58:25 gibba015 bash[30343]: audit 2021-03-10T14:58:25.190270+0000 mon.c (mon.1) 1065 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:58:25.734 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:58:25 gibba015 bash[30343]: cephadm 2021-03-10T14:58:25.190795+0000 mgr.gibba045.orlgmj (mgr.34412) 3703 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:58:25.734 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:58:25 gibba015 bash[30343]: cephadm 2021-03-10T14:58:25.190831+0000 mgr.gibba045.orlgmj (mgr.34412) 3704 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:58:25.735 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:58:25 gibba015 bash[30343]: audit 2021-03-10T14:58:25.191813+0000 mon.c (mon.1) 1066 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:58:25.735 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:58:25 gibba015 bash[30343]: cephadm 2021-03-10T14:58:25.191979+0000 mgr.gibba045.orlgmj (mgr.34412) 3705 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:58:25.735 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:58:25 gibba015 bash[30343]: cephadm 2021-03-10T14:58:25.193467+0000 mgr.gibba045.orlgmj (mgr.34412) 3706 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:58:25.735 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:58:25 gibba015 bash[30343]: cephadm 2021-03-10T14:58:25.193505+0000 mgr.gibba045.orlgmj (mgr.34412) 3707 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:58:25.735 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:58:25 gibba015 bash[30343]: cephadm 2021-03-10T14:58:25.194661+0000 mgr.gibba045.orlgmj (mgr.34412) 3708 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:58:25.736 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:58:25 gibba015 bash[29377]: cephadm 2021-03-10T14:58:25.195045+0000 mgr.gibba045.orlgmj (mgr.34412) 3709 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:58:25.736 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:58:25 gibba015 bash[29377]: cephadm 2021-03-10T14:58:25.196498+0000 mgr.gibba045.orlgmj (mgr.34412) 3710 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:58:25.736 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:58:25 gibba015 bash[29377]: cephadm 2021-03-10T14:58:25.196582+0000 mgr.gibba045.orlgmj (mgr.34412) 3711 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:58:25.736 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:58:25 gibba015 bash[29377]: cephadm 2021-03-10T14:58:25.196693+0000 mgr.gibba045.orlgmj (mgr.34412) 3712 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:58:25.737 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:58:25 gibba015 bash[30343]: cephadm 2021-03-10T14:58:25.195045+0000 mgr.gibba045.orlgmj (mgr.34412) 3709 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:58:25.737 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:58:25 gibba015 bash[30343]: cephadm 2021-03-10T14:58:25.196498+0000 mgr.gibba045.orlgmj (mgr.34412) 3710 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:58:25.737 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:58:25 gibba015 bash[30343]: cephadm 2021-03-10T14:58:25.196582+0000 mgr.gibba045.orlgmj (mgr.34412) 3711 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:58:25.737 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:58:25 gibba015 bash[30343]: cephadm 2021-03-10T14:58:25.196693+0000 mgr.gibba045.orlgmj (mgr.34412) 3712 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:58:26.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:58:26 gibba015 bash[29377]: cluster 2021-03-10T14:58:25.949746+0000 mgr.gibba045.orlgmj (mgr.34412) 3713 : cluster [DBG] pgmap v2100: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:26.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:58:26 gibba015 bash[30343]: cluster 2021-03-10T14:58:25.949746+0000 mgr.gibba045.orlgmj (mgr.34412) 3713 : cluster [DBG] pgmap v2100: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:26.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:58:26 gibba045 bash[25517]: cluster 2021-03-10T14:58:25.949746+0000 mgr.gibba045.orlgmj (mgr.34412) 3713 : cluster [DBG] pgmap v2100: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:29.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:58:29 gibba045 bash[25517]: cluster 2021-03-10T14:58:27.951238+0000 mgr.gibba045.orlgmj (mgr.34412) 3714 : cluster [DBG] pgmap v2101: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:29.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:58:29 gibba015 bash[29377]: cluster 2021-03-10T14:58:27.951238+0000 mgr.gibba045.orlgmj (mgr.34412) 3714 : cluster [DBG] pgmap v2101: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:29.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:58:29 gibba015 bash[30343]: cluster 2021-03-10T14:58:27.951238+0000 mgr.gibba045.orlgmj (mgr.34412) 3714 : cluster [DBG] pgmap v2101: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:31.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:58:31 gibba045 bash[25517]: cluster 2021-03-10T14:58:29.952892+0000 mgr.gibba045.orlgmj (mgr.34412) 3715 : cluster [DBG] pgmap v2102: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:31.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:58:31 gibba015 bash[29377]: cluster 2021-03-10T14:58:29.952892+0000 mgr.gibba045.orlgmj (mgr.34412) 3715 : cluster [DBG] pgmap v2102: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:31.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:58:31 gibba015 bash[30343]: cluster 2021-03-10T14:58:29.952892+0000 mgr.gibba045.orlgmj (mgr.34412) 3715 : cluster [DBG] pgmap v2102: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:33.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:58:33 gibba045 bash[25517]: cluster 2021-03-10T14:58:31.954628+0000 mgr.gibba045.orlgmj (mgr.34412) 3716 : cluster [DBG] pgmap v2103: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:33.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:58:33 gibba015 bash[29377]: cluster 2021-03-10T14:58:31.954628+0000 mgr.gibba045.orlgmj (mgr.34412) 3716 : cluster [DBG] pgmap v2103: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:33.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:58:33 gibba015 bash[30343]: cluster 2021-03-10T14:58:31.954628+0000 mgr.gibba045.orlgmj (mgr.34412) 3716 : cluster [DBG] pgmap v2103: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:34.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:58:34 gibba015 bash[29377]: cluster 2021-03-10T14:58:33.955838+0000 mgr.gibba045.orlgmj (mgr.34412) 3717 : cluster [DBG] pgmap v2104: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:34.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:58:34 gibba015 bash[30343]: cluster 2021-03-10T14:58:33.955838+0000 mgr.gibba045.orlgmj (mgr.34412) 3717 : cluster [DBG] pgmap v2104: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:34.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:58:34 gibba045 bash[25517]: cluster 2021-03-10T14:58:33.955838+0000 mgr.gibba045.orlgmj (mgr.34412) 3717 : cluster [DBG] pgmap v2104: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:37.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:58:37 gibba045 bash[25517]: cluster 2021-03-10T14:58:35.957603+0000 mgr.gibba045.orlgmj (mgr.34412) 3718 : cluster [DBG] pgmap v2105: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:37.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:58:37 gibba015 bash[29377]: cluster 2021-03-10T14:58:35.957603+0000 mgr.gibba045.orlgmj (mgr.34412) 3718 : cluster [DBG] pgmap v2105: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:37.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:58:37 gibba015 bash[30343]: cluster 2021-03-10T14:58:35.957603+0000 mgr.gibba045.orlgmj (mgr.34412) 3718 : cluster [DBG] pgmap v2105: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:39.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:58:39 gibba045 bash[25517]: cluster 2021-03-10T14:58:37.959144+0000 mgr.gibba045.orlgmj (mgr.34412) 3719 : cluster [DBG] pgmap v2106: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:39.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:58:39 gibba015 bash[29377]: cluster 2021-03-10T14:58:37.959144+0000 mgr.gibba045.orlgmj (mgr.34412) 3719 : cluster [DBG] pgmap v2106: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:39.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:58:39 gibba015 bash[30343]: cluster 2021-03-10T14:58:37.959144+0000 mgr.gibba045.orlgmj (mgr.34412) 3719 : cluster [DBG] pgmap v2106: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:41.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:58:41 gibba045 bash[25517]: cluster 2021-03-10T14:58:39.960797+0000 mgr.gibba045.orlgmj (mgr.34412) 3720 : cluster [DBG] pgmap v2107: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:41.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:58:41 gibba045 bash[25517]: cephadm 2021-03-10T14:58:40.212848+0000 mgr.gibba045.orlgmj (mgr.34412) 3721 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:58:41.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:58:41 gibba015 bash[29377]: cluster 2021-03-10T14:58:39.960797+0000 mgr.gibba045.orlgmj (mgr.34412) 3720 : cluster [DBG] pgmap v2107: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:41.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:58:41 gibba015 bash[29377]: cephadm 2021-03-10T14:58:40.212848+0000 mgr.gibba045.orlgmj (mgr.34412) 3721 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:58:41.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:58:41 gibba015 bash[30343]: cluster 2021-03-10T14:58:39.960797+0000 mgr.gibba045.orlgmj (mgr.34412) 3720 : cluster [DBG] pgmap v2107: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:41.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:58:41 gibba015 bash[30343]: cephadm 2021-03-10T14:58:40.212848+0000 mgr.gibba045.orlgmj (mgr.34412) 3721 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:58:43.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:58:43 gibba045 bash[25517]: cluster 2021-03-10T14:58:41.962554+0000 mgr.gibba045.orlgmj (mgr.34412) 3722 : cluster [DBG] pgmap v2108: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:43.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:58:43 gibba015 bash[29377]: cluster 2021-03-10T14:58:41.962554+0000 mgr.gibba045.orlgmj (mgr.34412) 3722 : cluster [DBG] pgmap v2108: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:43.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:58:43 gibba015 bash[30343]: cluster 2021-03-10T14:58:41.962554+0000 mgr.gibba045.orlgmj (mgr.34412) 3722 : cluster [DBG] pgmap v2108: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:44.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:58:44 gibba015 bash[29377]: cluster 2021-03-10T14:58:43.963778+0000 mgr.gibba045.orlgmj (mgr.34412) 3723 : cluster [DBG] pgmap v2109: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:44.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:58:44 gibba015 bash[30343]: cluster 2021-03-10T14:58:43.963778+0000 mgr.gibba045.orlgmj (mgr.34412) 3723 : cluster [DBG] pgmap v2109: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:44.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:58:44 gibba045 bash[25517]: cluster 2021-03-10T14:58:43.963778+0000 mgr.gibba045.orlgmj (mgr.34412) 3723 : cluster [DBG] pgmap v2109: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:46.861 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:58:47.117 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:58:47.118 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (69m) 4m ago 74m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:58:47.118 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (74m) 3m ago 74m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:58:47.118 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (69m) 3m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:58:47.118 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (70m) 3m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:58:47.119 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (69m) 4m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:58:47.119 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (69m) 4m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:58:47.119 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (68m) 3m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:58:47.119 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (68m) 4m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:58:47.119 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (74m) 4m ago 75m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:58:47.120 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (75m) 3m ago 75m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:58:47.120 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (67m) 4m ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:58:47.120 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (67m) 4m ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:58:47.120 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (66m) 4m ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:58:47.120 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (66m) 4m ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:58:47.121 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (66m) 3m ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:58:47.121 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (65m) 3m ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:58:47.121 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (65m) 3m ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:58:47.121 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (64m) 3m ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:58:47.121 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (74m) 3m ago 75m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:58:47.121 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 3m ago 73m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:58:47.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:58:47 gibba045 bash[25517]: cluster 2021-03-10T14:58:45.965414+0000 mgr.gibba045.orlgmj (mgr.34412) 3724 : cluster [DBG] pgmap v2110: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:47.373 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:58:47.374 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:58:47.374 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:58:47.374 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:58:47.374 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:58:47.375 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:58:47.375 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:58:47.375 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:58:47.375 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:58:47.375 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:58:47.376 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:58:47.376 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:58:47.376 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:58:47.376 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:58:47.376 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:58:47.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:58:47 gibba015 bash[29377]: cluster 2021-03-10T14:58:45.965414+0000 mgr.gibba045.orlgmj (mgr.34412) 3724 : cluster [DBG] pgmap v2110: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:47.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:58:47 gibba015 bash[30343]: cluster 2021-03-10T14:58:45.965414+0000 mgr.gibba045.orlgmj (mgr.34412) 3724 : cluster [DBG] pgmap v2110: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:48.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:58:48 gibba045 bash[25517]: audit 2021-03-10T14:58:46.851474+0000 mgr.gibba045.orlgmj (mgr.34412) 3725 : audit [DBG] from='client.46554 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:58:48.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:58:48 gibba045 bash[25517]: audit 2021-03-10T14:58:47.080122+0000 mgr.gibba045.orlgmj (mgr.34412) 3726 : audit [DBG] from='client.56548 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:58:48.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:58:48 gibba045 bash[25517]: audit 2021-03-10T14:58:47.369780+0000 mon.c (mon.1) 1067 : audit [DBG] from='client.? 172.21.2.115:0/3604613265' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:58:48.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:58:48 gibba015 bash[29377]: audit 2021-03-10T14:58:46.851474+0000 mgr.gibba045.orlgmj (mgr.34412) 3725 : audit [DBG] from='client.46554 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:58:48.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:58:48 gibba015 bash[29377]: audit 2021-03-10T14:58:47.080122+0000 mgr.gibba045.orlgmj (mgr.34412) 3726 : audit [DBG] from='client.56548 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:58:48.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:58:48 gibba015 bash[29377]: audit 2021-03-10T14:58:47.369780+0000 mon.c (mon.1) 1067 : audit [DBG] from='client.? 172.21.2.115:0/3604613265' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:58:48.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:58:48 gibba015 bash[30343]: audit 2021-03-10T14:58:46.851474+0000 mgr.gibba045.orlgmj (mgr.34412) 3725 : audit [DBG] from='client.46554 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:58:48.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:58:48 gibba015 bash[30343]: audit 2021-03-10T14:58:47.080122+0000 mgr.gibba045.orlgmj (mgr.34412) 3726 : audit [DBG] from='client.56548 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:58:48.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:58:48 gibba015 bash[30343]: audit 2021-03-10T14:58:47.369780+0000 mon.c (mon.1) 1067 : audit [DBG] from='client.? 172.21.2.115:0/3604613265' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:58:49.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:58:49 gibba045 bash[25517]: cluster 2021-03-10T14:58:47.967031+0000 mgr.gibba045.orlgmj (mgr.34412) 3727 : cluster [DBG] pgmap v2111: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:49.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:58:49 gibba015 bash[29377]: cluster 2021-03-10T14:58:47.967031+0000 mgr.gibba045.orlgmj (mgr.34412) 3727 : cluster [DBG] pgmap v2111: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:49.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:58:49 gibba015 bash[30343]: cluster 2021-03-10T14:58:47.967031+0000 mgr.gibba045.orlgmj (mgr.34412) 3727 : cluster [DBG] pgmap v2111: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:51.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:58:51 gibba045 bash[25517]: cluster 2021-03-10T14:58:49.968705+0000 mgr.gibba045.orlgmj (mgr.34412) 3728 : cluster [DBG] pgmap v2112: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:51.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:58:51 gibba015 bash[29377]: cluster 2021-03-10T14:58:49.968705+0000 mgr.gibba045.orlgmj (mgr.34412) 3728 : cluster [DBG] pgmap v2112: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:51.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:58:51 gibba015 bash[30343]: cluster 2021-03-10T14:58:49.968705+0000 mgr.gibba045.orlgmj (mgr.34412) 3728 : cluster [DBG] pgmap v2112: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:53.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:58:53 gibba015 bash[29377]: cluster 2021-03-10T14:58:51.970192+0000 mgr.gibba045.orlgmj (mgr.34412) 3729 : cluster [DBG] pgmap v2113: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:53.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:58:53 gibba015 bash[29377]: audit 2021-03-10T14:58:52.925575+0000 mon.c (mon.1) 1068 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:58:53.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:58:53 gibba015 bash[29377]: audit 2021-03-10T14:58:52.926364+0000 mon.c (mon.1) 1069 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:58:53.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:58:53 gibba015 bash[29377]: audit 2021-03-10T14:58:52.926646+0000 mon.a (mon.0) 1132 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:58:53.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:58:53 gibba015 bash[29377]: audit 2021-03-10T14:58:52.927703+0000 mon.a (mon.0) 1133 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:58:53.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:58:53 gibba015 bash[29377]: audit 2021-03-10T14:58:52.936231+0000 mon.c (mon.1) 1070 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T14:58:53.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:58:53 gibba015 bash[29377]: audit 2021-03-10T14:58:52.937191+0000 mon.c (mon.1) 1071 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:58:53.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:58:53 gibba015 bash[29377]: audit 2021-03-10T14:58:52.937327+0000 mon.a (mon.0) 1134 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T14:58:53.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:58:53 gibba015 bash[29377]: audit 2021-03-10T14:58:52.938068+0000 mon.c (mon.1) 1072 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:58:53.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:58:53 gibba015 bash[29377]: audit 2021-03-10T14:58:52.938570+0000 mon.a (mon.0) 1135 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:58:53.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:58:53 gibba015 bash[29377]: audit 2021-03-10T14:58:52.939117+0000 mon.c (mon.1) 1073 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:58:53.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:58:53 gibba015 bash[29377]: audit 2021-03-10T14:58:52.939627+0000 mon.a (mon.0) 1136 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:58:53.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:58:53 gibba015 bash[29377]: audit 2021-03-10T14:58:52.940864+0000 mon.a (mon.0) 1137 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:58:53.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:58:53 gibba015 bash[30343]: cluster 2021-03-10T14:58:51.970192+0000 mgr.gibba045.orlgmj (mgr.34412) 3729 : cluster [DBG] pgmap v2113: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:53.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:58:53 gibba015 bash[30343]: audit 2021-03-10T14:58:52.925575+0000 mon.c (mon.1) 1068 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:58:53.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:58:53 gibba015 bash[30343]: audit 2021-03-10T14:58:52.926364+0000 mon.c (mon.1) 1069 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:58:53.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:58:53 gibba015 bash[30343]: audit 2021-03-10T14:58:52.926646+0000 mon.a (mon.0) 1132 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:58:53.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:58:53 gibba015 bash[30343]: audit 2021-03-10T14:58:52.927703+0000 mon.a (mon.0) 1133 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:58:53.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:58:53 gibba015 bash[30343]: audit 2021-03-10T14:58:52.936231+0000 mon.c (mon.1) 1070 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T14:58:53.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:58:53 gibba015 bash[30343]: audit 2021-03-10T14:58:52.937191+0000 mon.c (mon.1) 1071 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:58:53.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:58:53 gibba015 bash[30343]: audit 2021-03-10T14:58:52.937327+0000 mon.a (mon.0) 1134 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T14:58:53.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:58:53 gibba015 bash[30343]: audit 2021-03-10T14:58:52.938068+0000 mon.c (mon.1) 1072 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:58:53.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:58:53 gibba015 bash[30343]: audit 2021-03-10T14:58:52.938570+0000 mon.a (mon.0) 1135 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:58:53.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:58:53 gibba015 bash[30343]: audit 2021-03-10T14:58:52.939117+0000 mon.c (mon.1) 1073 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:58:53.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:58:53 gibba015 bash[30343]: audit 2021-03-10T14:58:52.939627+0000 mon.a (mon.0) 1136 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:58:53.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:58:53 gibba015 bash[30343]: audit 2021-03-10T14:58:52.940864+0000 mon.a (mon.0) 1137 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:58:53.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:58:53 gibba045 bash[25517]: cluster 2021-03-10T14:58:51.970192+0000 mgr.gibba045.orlgmj (mgr.34412) 3729 : cluster [DBG] pgmap v2113: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:53.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:58:53 gibba045 bash[25517]: audit 2021-03-10T14:58:52.925575+0000 mon.c (mon.1) 1068 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:58:53.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:58:53 gibba045 bash[25517]: audit 2021-03-10T14:58:52.926364+0000 mon.c (mon.1) 1069 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:58:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:58:53 gibba045 bash[25517]: audit 2021-03-10T14:58:52.926646+0000 mon.a (mon.0) 1132 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:58:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:58:53 gibba045 bash[25517]: audit 2021-03-10T14:58:52.927703+0000 mon.a (mon.0) 1133 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:58:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:58:53 gibba045 bash[25517]: audit 2021-03-10T14:58:52.936231+0000 mon.c (mon.1) 1070 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T14:58:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:58:53 gibba045 bash[25517]: audit 2021-03-10T14:58:52.937191+0000 mon.c (mon.1) 1071 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:58:53.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:58:53 gibba045 bash[25517]: audit 2021-03-10T14:58:52.937327+0000 mon.a (mon.0) 1134 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T14:58:53.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:58:53 gibba045 bash[25517]: audit 2021-03-10T14:58:52.938068+0000 mon.c (mon.1) 1072 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:58:53.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:58:53 gibba045 bash[25517]: audit 2021-03-10T14:58:52.938570+0000 mon.a (mon.0) 1135 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:58:53.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:58:53 gibba045 bash[25517]: audit 2021-03-10T14:58:52.939117+0000 mon.c (mon.1) 1073 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:58:53.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:58:53 gibba045 bash[25517]: audit 2021-03-10T14:58:52.939627+0000 mon.a (mon.0) 1136 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:58:53.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:58:53 gibba045 bash[25517]: audit 2021-03-10T14:58:52.940864+0000 mon.a (mon.0) 1137 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:58:54.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:58:54 gibba015 bash[29377]: cluster 2021-03-10T14:58:53.971421+0000 mgr.gibba045.orlgmj (mgr.34412) 3730 : cluster [DBG] pgmap v2114: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:58:54 gibba015 bash[30343]: cluster 2021-03-10T14:58:53.971421+0000 mgr.gibba045.orlgmj (mgr.34412) 3730 : cluster [DBG] pgmap v2114: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:54.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:58:54 gibba045 bash[25517]: cluster 2021-03-10T14:58:53.971421+0000 mgr.gibba045.orlgmj (mgr.34412) 3730 : cluster [DBG] pgmap v2114: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:55.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:58:55 gibba045 bash[25517]: cephadm 2021-03-10T14:58:55.228963+0000 mgr.gibba045.orlgmj (mgr.34412) 3731 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:58:55.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:58:55 gibba015 bash[29377]: cephadm 2021-03-10T14:58:55.228963+0000 mgr.gibba045.orlgmj (mgr.34412) 3731 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:58:55.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:58:55 gibba015 bash[30343]: cephadm 2021-03-10T14:58:55.228963+0000 mgr.gibba045.orlgmj (mgr.34412) 3731 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:58:56.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:58:56 gibba015 bash[29377]: cluster 2021-03-10T14:58:55.972935+0000 mgr.gibba045.orlgmj (mgr.34412) 3732 : cluster [DBG] pgmap v2115: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:56.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:58:56 gibba015 bash[30343]: cluster 2021-03-10T14:58:55.972935+0000 mgr.gibba045.orlgmj (mgr.34412) 3732 : cluster [DBG] pgmap v2115: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:56.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:58:56 gibba045 bash[25517]: cluster 2021-03-10T14:58:55.972935+0000 mgr.gibba045.orlgmj (mgr.34412) 3732 : cluster [DBG] pgmap v2115: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:59.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:58:59 gibba045 bash[25517]: cluster 2021-03-10T14:58:57.974308+0000 mgr.gibba045.orlgmj (mgr.34412) 3733 : cluster [DBG] pgmap v2116: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:59.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:58:59 gibba015 bash[29377]: cluster 2021-03-10T14:58:57.974308+0000 mgr.gibba045.orlgmj (mgr.34412) 3733 : cluster [DBG] pgmap v2116: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:59.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:58:59 gibba015 bash[30343]: cluster 2021-03-10T14:58:57.974308+0000 mgr.gibba045.orlgmj (mgr.34412) 3733 : cluster [DBG] pgmap v2116: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:01.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:59:01 gibba045 bash[25517]: cluster 2021-03-10T14:58:59.975845+0000 mgr.gibba045.orlgmj (mgr.34412) 3734 : cluster [DBG] pgmap v2117: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:01.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:59:01 gibba015 bash[29377]: cluster 2021-03-10T14:58:59.975845+0000 mgr.gibba045.orlgmj (mgr.34412) 3734 : cluster [DBG] pgmap v2117: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:01.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:59:01 gibba015 bash[30343]: cluster 2021-03-10T14:58:59.975845+0000 mgr.gibba045.orlgmj (mgr.34412) 3734 : cluster [DBG] pgmap v2117: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:03.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:59:03 gibba045 bash[25517]: cluster 2021-03-10T14:59:01.977649+0000 mgr.gibba045.orlgmj (mgr.34412) 3735 : cluster [DBG] pgmap v2118: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:03.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:59:03 gibba015 bash[29377]: cluster 2021-03-10T14:59:01.977649+0000 mgr.gibba045.orlgmj (mgr.34412) 3735 : cluster [DBG] pgmap v2118: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:03.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:59:03 gibba015 bash[30343]: cluster 2021-03-10T14:59:01.977649+0000 mgr.gibba045.orlgmj (mgr.34412) 3735 : cluster [DBG] pgmap v2118: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:04.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:59:04 gibba015 bash[29377]: cluster 2021-03-10T14:59:03.978896+0000 mgr.gibba045.orlgmj (mgr.34412) 3736 : cluster [DBG] pgmap v2119: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:04.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:59:04 gibba015 bash[30343]: cluster 2021-03-10T14:59:03.978896+0000 mgr.gibba045.orlgmj (mgr.34412) 3736 : cluster [DBG] pgmap v2119: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:04.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:59:04 gibba045 bash[25517]: cluster 2021-03-10T14:59:03.978896+0000 mgr.gibba045.orlgmj (mgr.34412) 3736 : cluster [DBG] pgmap v2119: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:07.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:59:07 gibba045 bash[25517]: cluster 2021-03-10T14:59:05.980649+0000 mgr.gibba045.orlgmj (mgr.34412) 3737 : cluster [DBG] pgmap v2120: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:07.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:59:07 gibba015 bash[29377]: cluster 2021-03-10T14:59:05.980649+0000 mgr.gibba045.orlgmj (mgr.34412) 3737 : cluster [DBG] pgmap v2120: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:07.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:59:07 gibba015 bash[30343]: cluster 2021-03-10T14:59:05.980649+0000 mgr.gibba045.orlgmj (mgr.34412) 3737 : cluster [DBG] pgmap v2120: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:09.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:59:09 gibba045 bash[25517]: cluster 2021-03-10T14:59:07.982014+0000 mgr.gibba045.orlgmj (mgr.34412) 3738 : cluster [DBG] pgmap v2121: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:09.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:59:09 gibba015 bash[29377]: cluster 2021-03-10T14:59:07.982014+0000 mgr.gibba045.orlgmj (mgr.34412) 3738 : cluster [DBG] pgmap v2121: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:09.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:59:09 gibba015 bash[30343]: cluster 2021-03-10T14:59:07.982014+0000 mgr.gibba045.orlgmj (mgr.34412) 3738 : cluster [DBG] pgmap v2121: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:11.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:59:11 gibba015 bash[29377]: cluster 2021-03-10T14:59:09.983578+0000 mgr.gibba045.orlgmj (mgr.34412) 3739 : cluster [DBG] pgmap v2122: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:11.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:59:11 gibba015 bash[29377]: cephadm 2021-03-10T14:59:10.245038+0000 mgr.gibba045.orlgmj (mgr.34412) 3740 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:59:11.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:59:11 gibba015 bash[30343]: cluster 2021-03-10T14:59:09.983578+0000 mgr.gibba045.orlgmj (mgr.34412) 3739 : cluster [DBG] pgmap v2122: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:11.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:59:11 gibba015 bash[30343]: cephadm 2021-03-10T14:59:10.245038+0000 mgr.gibba045.orlgmj (mgr.34412) 3740 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:59:11.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:59:11 gibba045 bash[25517]: cluster 2021-03-10T14:59:09.983578+0000 mgr.gibba045.orlgmj (mgr.34412) 3739 : cluster [DBG] pgmap v2122: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:11.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:59:11 gibba045 bash[25517]: cephadm 2021-03-10T14:59:10.245038+0000 mgr.gibba045.orlgmj (mgr.34412) 3740 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:59:13.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:59:13 gibba015 bash[29377]: cluster 2021-03-10T14:59:11.985085+0000 mgr.gibba045.orlgmj (mgr.34412) 3741 : cluster [DBG] pgmap v2123: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:13.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:59:13 gibba015 bash[30343]: cluster 2021-03-10T14:59:11.985085+0000 mgr.gibba045.orlgmj (mgr.34412) 3741 : cluster [DBG] pgmap v2123: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:13.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:59:13 gibba045 bash[25517]: cluster 2021-03-10T14:59:11.985085+0000 mgr.gibba045.orlgmj (mgr.34412) 3741 : cluster [DBG] pgmap v2123: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:14.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:59:14 gibba015 bash[29377]: cluster 2021-03-10T14:59:13.986319+0000 mgr.gibba045.orlgmj (mgr.34412) 3742 : cluster [DBG] pgmap v2124: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:14.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:59:14 gibba015 bash[30343]: cluster 2021-03-10T14:59:13.986319+0000 mgr.gibba045.orlgmj (mgr.34412) 3742 : cluster [DBG] pgmap v2124: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:14.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:59:14 gibba045 bash[25517]: cluster 2021-03-10T14:59:13.986319+0000 mgr.gibba045.orlgmj (mgr.34412) 3742 : cluster [DBG] pgmap v2124: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:17.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:59:17 gibba045 bash[25517]: cluster 2021-03-10T14:59:15.987832+0000 mgr.gibba045.orlgmj (mgr.34412) 3743 : cluster [DBG] pgmap v2125: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:17.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:59:17 gibba015 bash[29377]: cluster 2021-03-10T14:59:15.987832+0000 mgr.gibba045.orlgmj (mgr.34412) 3743 : cluster [DBG] pgmap v2125: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:17.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:59:17 gibba015 bash[30343]: cluster 2021-03-10T14:59:15.987832+0000 mgr.gibba045.orlgmj (mgr.34412) 3743 : cluster [DBG] pgmap v2125: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:17.616 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:59:17.842 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:59:17.842 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (70m) 4m ago 75m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:59:17.843 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (75m) 3m ago 75m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:59:17.843 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (70m) 3m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:59:17.843 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (70m) 3m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:59:17.843 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (69m) 4m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:59:17.843 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (69m) 4m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:59:17.844 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (69m) 3m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:59:17.844 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (69m) 4m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:59:17.844 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (75m) 4m ago 75m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:59:17.844 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (75m) 3m ago 75m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:59:17.845 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (68m) 4m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:59:17.845 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (67m) 4m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:59:17.845 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (67m) 4m ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:59:17.845 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (67m) 4m ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:59:17.845 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (66m) 3m ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:59:17.846 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (66m) 3m ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:59:17.846 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (65m) 3m ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:59:17.846 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (65m) 3m ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:59:17.846 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (74m) 3m ago 75m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:59:17.846 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 3m ago 73m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:59:18.093 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:59:18.114 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:59:18.114 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:59:18.114 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:59:18.115 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:59:18.115 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:59:18.115 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:59:18.115 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:59:18.116 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:59:18.116 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:59:18.116 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:59:18.116 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:59:18.117 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:59:18.117 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:59:18.117 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:59:19.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:59:19 gibba015 bash[29377]: audit 2021-03-10T14:59:17.607598+0000 mgr.gibba045.orlgmj (mgr.34412) 3744 : audit [DBG] from='client.56560 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:59:19.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:59:19 gibba015 bash[29377]: audit 2021-03-10T14:59:17.829509+0000 mgr.gibba045.orlgmj (mgr.34412) 3745 : audit [DBG] from='client.46578 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:59:19.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:59:19 gibba015 bash[29377]: cluster 2021-03-10T14:59:17.989513+0000 mgr.gibba045.orlgmj (mgr.34412) 3746 : cluster [DBG] pgmap v2126: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:19.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:59:19 gibba015 bash[29377]: audit 2021-03-10T14:59:18.089305+0000 mon.c (mon.1) 1074 : audit [DBG] from='client.? 172.21.2.115:0/2191037150' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:59:19.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:59:19 gibba015 bash[30343]: audit 2021-03-10T14:59:17.607598+0000 mgr.gibba045.orlgmj (mgr.34412) 3744 : audit [DBG] from='client.56560 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:59:19.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:59:19 gibba015 bash[30343]: audit 2021-03-10T14:59:17.829509+0000 mgr.gibba045.orlgmj (mgr.34412) 3745 : audit [DBG] from='client.46578 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:59:19.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:59:19 gibba015 bash[30343]: cluster 2021-03-10T14:59:17.989513+0000 mgr.gibba045.orlgmj (mgr.34412) 3746 : cluster [DBG] pgmap v2126: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:19.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:59:19 gibba015 bash[30343]: audit 2021-03-10T14:59:18.089305+0000 mon.c (mon.1) 1074 : audit [DBG] from='client.? 172.21.2.115:0/2191037150' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:59:19.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:59:19 gibba045 bash[25517]: audit 2021-03-10T14:59:17.607598+0000 mgr.gibba045.orlgmj (mgr.34412) 3744 : audit [DBG] from='client.56560 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:59:19.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:59:19 gibba045 bash[25517]: audit 2021-03-10T14:59:17.829509+0000 mgr.gibba045.orlgmj (mgr.34412) 3745 : audit [DBG] from='client.46578 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:59:19.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:59:19 gibba045 bash[25517]: cluster 2021-03-10T14:59:17.989513+0000 mgr.gibba045.orlgmj (mgr.34412) 3746 : cluster [DBG] pgmap v2126: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:19.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:59:19 gibba045 bash[25517]: audit 2021-03-10T14:59:18.089305+0000 mon.c (mon.1) 1074 : audit [DBG] from='client.? 172.21.2.115:0/2191037150' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:59:21.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:59:21 gibba015 bash[29377]: cluster 2021-03-10T14:59:19.991063+0000 mgr.gibba045.orlgmj (mgr.34412) 3747 : cluster [DBG] pgmap v2127: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:21.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:59:21 gibba015 bash[30343]: cluster 2021-03-10T14:59:19.991063+0000 mgr.gibba045.orlgmj (mgr.34412) 3747 : cluster [DBG] pgmap v2127: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:21.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:59:21 gibba045 bash[25517]: cluster 2021-03-10T14:59:19.991063+0000 mgr.gibba045.orlgmj (mgr.34412) 3747 : cluster [DBG] pgmap v2127: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:23.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:59:23 gibba015 bash[29377]: cluster 2021-03-10T14:59:21.992867+0000 mgr.gibba045.orlgmj (mgr.34412) 3748 : cluster [DBG] pgmap v2128: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:23.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:59:23 gibba015 bash[30343]: cluster 2021-03-10T14:59:21.992867+0000 mgr.gibba045.orlgmj (mgr.34412) 3748 : cluster [DBG] pgmap v2128: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:23.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:59:23 gibba045 bash[25517]: cluster 2021-03-10T14:59:21.992867+0000 mgr.gibba045.orlgmj (mgr.34412) 3748 : cluster [DBG] pgmap v2128: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:24.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:59:24 gibba015 bash[29377]: cluster 2021-03-10T14:59:23.994103+0000 mgr.gibba045.orlgmj (mgr.34412) 3749 : cluster [DBG] pgmap v2129: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:24.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:59:24 gibba015 bash[30343]: cluster 2021-03-10T14:59:23.994103+0000 mgr.gibba045.orlgmj (mgr.34412) 3749 : cluster [DBG] pgmap v2129: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:24.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:59:24 gibba045 bash[25517]: cluster 2021-03-10T14:59:23.994103+0000 mgr.gibba045.orlgmj (mgr.34412) 3749 : cluster [DBG] pgmap v2129: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:25.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:59:25 gibba015 bash[29377]: audit 2021-03-10T14:59:25.258473+0000 mon.c (mon.1) 1075 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:59:25.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:59:25 gibba015 bash[29377]: cephadm 2021-03-10T14:59:25.267672+0000 mgr.gibba045.orlgmj (mgr.34412) 3750 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:59:25.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:59:25 gibba015 bash[29377]: cephadm 2021-03-10T14:59:25.269668+0000 mgr.gibba045.orlgmj (mgr.34412) 3751 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:59:25.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:59:25 gibba015 bash[30343]: audit 2021-03-10T14:59:25.258473+0000 mon.c (mon.1) 1075 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:59:25.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:59:25 gibba015 bash[30343]: cephadm 2021-03-10T14:59:25.267672+0000 mgr.gibba045.orlgmj (mgr.34412) 3750 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:59:25.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:59:25 gibba015 bash[30343]: cephadm 2021-03-10T14:59:25.269668+0000 mgr.gibba045.orlgmj (mgr.34412) 3751 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:59:25.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:59:25 gibba045 bash[25517]: audit 2021-03-10T14:59:25.258473+0000 mon.c (mon.1) 1075 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:59:25.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:59:25 gibba045 bash[25517]: cephadm 2021-03-10T14:59:25.267672+0000 mgr.gibba045.orlgmj (mgr.34412) 3750 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T14:59:25.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:59:25 gibba045 bash[25517]: cephadm 2021-03-10T14:59:25.269668+0000 mgr.gibba045.orlgmj (mgr.34412) 3751 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T14:59:26.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:59:26 gibba045 bash[25517]: audit 2021-03-10T14:59:25.488860+0000 mon.a (mon.0) 1138 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:59:26.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:59:26 gibba045 bash[25517]: audit 2021-03-10T14:59:25.492849+0000 mon.c (mon.1) 1076 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:59:26.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:59:26 gibba045 bash[25517]: audit 2021-03-10T14:59:25.494215+0000 mon.c (mon.1) 1077 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:59:26.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:59:26 gibba045 bash[25517]: cephadm 2021-03-10T14:59:25.495438+0000 mgr.gibba045.orlgmj (mgr.34412) 3752 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:59:26.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:59:26 gibba045 bash[25517]: audit 2021-03-10T14:59:25.495704+0000 mon.c (mon.1) 1078 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:59:26.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:59:26 gibba045 bash[25517]: audit 2021-03-10T14:59:25.497016+0000 mon.c (mon.1) 1079 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:59:26.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:59:26 gibba045 bash[25517]: cephadm 2021-03-10T14:59:25.497537+0000 mgr.gibba045.orlgmj (mgr.34412) 3753 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:59:26.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:59:26 gibba045 bash[25517]: cephadm 2021-03-10T14:59:25.498931+0000 mgr.gibba045.orlgmj (mgr.34412) 3754 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:59:26.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:59:26 gibba045 bash[25517]: cephadm 2021-03-10T14:59:25.498977+0000 mgr.gibba045.orlgmj (mgr.34412) 3755 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:59:26.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:59:26 gibba045 bash[25517]: audit 2021-03-10T14:59:25.499707+0000 mon.c (mon.1) 1080 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:59:26.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:59:26 gibba045 bash[25517]: cephadm 2021-03-10T14:59:25.500199+0000 mgr.gibba045.orlgmj (mgr.34412) 3756 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:59:26.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:59:26 gibba045 bash[25517]: cephadm 2021-03-10T14:59:25.500242+0000 mgr.gibba045.orlgmj (mgr.34412) 3757 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:59:26.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:59:26 gibba045 bash[25517]: audit 2021-03-10T14:59:25.501368+0000 mon.c (mon.1) 1081 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:59:26.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:59:26 gibba045 bash[25517]: cephadm 2021-03-10T14:59:25.501417+0000 mgr.gibba045.orlgmj (mgr.34412) 3758 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:59:26.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:59:26 gibba045 bash[25517]: cephadm 2021-03-10T14:59:25.502725+0000 mgr.gibba045.orlgmj (mgr.34412) 3759 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:59:26.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:59:26 gibba045 bash[25517]: cephadm 2021-03-10T14:59:25.502767+0000 mgr.gibba045.orlgmj (mgr.34412) 3760 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:59:26.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:59:26 gibba045 bash[25517]: cephadm 2021-03-10T14:59:25.504282+0000 mgr.gibba045.orlgmj (mgr.34412) 3761 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:59:26.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:59:26 gibba045 bash[25517]: cephadm 2021-03-10T14:59:25.504678+0000 mgr.gibba045.orlgmj (mgr.34412) 3762 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:59:26.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:59:26 gibba045 bash[25517]: cephadm 2021-03-10T14:59:25.505810+0000 mgr.gibba045.orlgmj (mgr.34412) 3763 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:59:26.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:59:26 gibba045 bash[25517]: cephadm 2021-03-10T14:59:25.505857+0000 mgr.gibba045.orlgmj (mgr.34412) 3764 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:59:26.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:59:26 gibba045 bash[25517]: cephadm 2021-03-10T14:59:25.505974+0000 mgr.gibba045.orlgmj (mgr.34412) 3765 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:59:26.812 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:59:26 gibba045 bash[25517]: cluster 2021-03-10T14:59:25.995811+0000 mgr.gibba045.orlgmj (mgr.34412) 3766 : cluster [DBG] pgmap v2130: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:26.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:59:26 gibba015 bash[29377]: audit 2021-03-10T14:59:25.488860+0000 mon.a (mon.0) 1138 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:59:26.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:59:26 gibba015 bash[29377]: audit 2021-03-10T14:59:25.492849+0000 mon.c (mon.1) 1076 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:59:26.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:59:26 gibba015 bash[29377]: audit 2021-03-10T14:59:25.494215+0000 mon.c (mon.1) 1077 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:59:26.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:59:26 gibba015 bash[29377]: cephadm 2021-03-10T14:59:25.495438+0000 mgr.gibba045.orlgmj (mgr.34412) 3752 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:59:26.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:59:26 gibba015 bash[29377]: audit 2021-03-10T14:59:25.495704+0000 mon.c (mon.1) 1078 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:59:26.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:59:26 gibba015 bash[29377]: audit 2021-03-10T14:59:25.497016+0000 mon.c (mon.1) 1079 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:59:26.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:59:26 gibba015 bash[29377]: cephadm 2021-03-10T14:59:25.497537+0000 mgr.gibba045.orlgmj (mgr.34412) 3753 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:59:26.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:59:26 gibba015 bash[29377]: cephadm 2021-03-10T14:59:25.498931+0000 mgr.gibba045.orlgmj (mgr.34412) 3754 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:59:26.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:59:26 gibba015 bash[29377]: cephadm 2021-03-10T14:59:25.498977+0000 mgr.gibba045.orlgmj (mgr.34412) 3755 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:59:26.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:59:26 gibba015 bash[29377]: audit 2021-03-10T14:59:25.499707+0000 mon.c (mon.1) 1080 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:59:26.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:59:26 gibba015 bash[29377]: cephadm 2021-03-10T14:59:25.500199+0000 mgr.gibba045.orlgmj (mgr.34412) 3756 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:59:26.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:59:26 gibba015 bash[29377]: cephadm 2021-03-10T14:59:25.500242+0000 mgr.gibba045.orlgmj (mgr.34412) 3757 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:59:26.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:59:26 gibba015 bash[29377]: audit 2021-03-10T14:59:25.501368+0000 mon.c (mon.1) 1081 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:59:26.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:59:26 gibba015 bash[29377]: cephadm 2021-03-10T14:59:25.501417+0000 mgr.gibba045.orlgmj (mgr.34412) 3758 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:59:26.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:59:26 gibba015 bash[29377]: cephadm 2021-03-10T14:59:25.502725+0000 mgr.gibba045.orlgmj (mgr.34412) 3759 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:59:26.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:59:26 gibba015 bash[29377]: cephadm 2021-03-10T14:59:25.502767+0000 mgr.gibba045.orlgmj (mgr.34412) 3760 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:59:26.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:59:26 gibba015 bash[29377]: cephadm 2021-03-10T14:59:25.504282+0000 mgr.gibba045.orlgmj (mgr.34412) 3761 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:59:26.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:59:26 gibba015 bash[29377]: cephadm 2021-03-10T14:59:25.504678+0000 mgr.gibba045.orlgmj (mgr.34412) 3762 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:59:26.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:59:26 gibba015 bash[29377]: cephadm 2021-03-10T14:59:25.505810+0000 mgr.gibba045.orlgmj (mgr.34412) 3763 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:59:26.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:59:26 gibba015 bash[29377]: cephadm 2021-03-10T14:59:25.505857+0000 mgr.gibba045.orlgmj (mgr.34412) 3764 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:59:26.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:59:26 gibba015 bash[29377]: cephadm 2021-03-10T14:59:25.505974+0000 mgr.gibba045.orlgmj (mgr.34412) 3765 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:59:26.980 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:59:26 gibba015 bash[29377]: cluster 2021-03-10T14:59:25.995811+0000 mgr.gibba045.orlgmj (mgr.34412) 3766 : cluster [DBG] pgmap v2130: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:26.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:59:26 gibba015 bash[30343]: audit 2021-03-10T14:59:25.488860+0000 mon.a (mon.0) 1138 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T14:59:26.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:59:26 gibba015 bash[30343]: audit 2021-03-10T14:59:25.492849+0000 mon.c (mon.1) 1076 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:59:26.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:59:26 gibba015 bash[30343]: audit 2021-03-10T14:59:25.494215+0000 mon.c (mon.1) 1077 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:59:26.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:59:26 gibba015 bash[30343]: cephadm 2021-03-10T14:59:25.495438+0000 mgr.gibba045.orlgmj (mgr.34412) 3752 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:59:26.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:59:26 gibba015 bash[30343]: audit 2021-03-10T14:59:25.495704+0000 mon.c (mon.1) 1078 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:59:26.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:59:26 gibba015 bash[30343]: audit 2021-03-10T14:59:25.497016+0000 mon.c (mon.1) 1079 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:59:26.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:59:26 gibba015 bash[30343]: cephadm 2021-03-10T14:59:25.497537+0000 mgr.gibba045.orlgmj (mgr.34412) 3753 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:59:26.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:59:26 gibba015 bash[30343]: cephadm 2021-03-10T14:59:25.498931+0000 mgr.gibba045.orlgmj (mgr.34412) 3754 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:59:26.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:59:26 gibba015 bash[30343]: cephadm 2021-03-10T14:59:25.498977+0000 mgr.gibba045.orlgmj (mgr.34412) 3755 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:59:26.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:59:26 gibba015 bash[30343]: audit 2021-03-10T14:59:25.499707+0000 mon.c (mon.1) 1080 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:59:26.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:59:26 gibba015 bash[30343]: cephadm 2021-03-10T14:59:25.500199+0000 mgr.gibba045.orlgmj (mgr.34412) 3756 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:59:26.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:59:26 gibba015 bash[30343]: cephadm 2021-03-10T14:59:25.500242+0000 mgr.gibba045.orlgmj (mgr.34412) 3757 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:59:26.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:59:26 gibba015 bash[30343]: audit 2021-03-10T14:59:25.501368+0000 mon.c (mon.1) 1081 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:59:26.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:59:26 gibba015 bash[30343]: cephadm 2021-03-10T14:59:25.501417+0000 mgr.gibba045.orlgmj (mgr.34412) 3758 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:59:26.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:59:26 gibba015 bash[30343]: cephadm 2021-03-10T14:59:25.502725+0000 mgr.gibba045.orlgmj (mgr.34412) 3759 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:59:26.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:59:26 gibba015 bash[30343]: cephadm 2021-03-10T14:59:25.502767+0000 mgr.gibba045.orlgmj (mgr.34412) 3760 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:59:26.984 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:59:26 gibba015 bash[30343]: cephadm 2021-03-10T14:59:25.504282+0000 mgr.gibba045.orlgmj (mgr.34412) 3761 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:59:26.984 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:59:26 gibba015 bash[30343]: cephadm 2021-03-10T14:59:25.504678+0000 mgr.gibba045.orlgmj (mgr.34412) 3762 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:59:26.984 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:59:26 gibba015 bash[30343]: cephadm 2021-03-10T14:59:25.505810+0000 mgr.gibba045.orlgmj (mgr.34412) 3763 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:59:26.984 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:59:26 gibba015 bash[30343]: cephadm 2021-03-10T14:59:25.505857+0000 mgr.gibba045.orlgmj (mgr.34412) 3764 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:59:26.985 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:59:26 gibba015 bash[30343]: cephadm 2021-03-10T14:59:25.505974+0000 mgr.gibba045.orlgmj (mgr.34412) 3765 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:59:26.985 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:59:26 gibba015 bash[30343]: cluster 2021-03-10T14:59:25.995811+0000 mgr.gibba045.orlgmj (mgr.34412) 3766 : cluster [DBG] pgmap v2130: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:29.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:59:29 gibba015 bash[29377]: cluster 2021-03-10T14:59:27.997510+0000 mgr.gibba045.orlgmj (mgr.34412) 3767 : cluster [DBG] pgmap v2131: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:29.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:59:29 gibba015 bash[30343]: cluster 2021-03-10T14:59:27.997510+0000 mgr.gibba045.orlgmj (mgr.34412) 3767 : cluster [DBG] pgmap v2131: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:29.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:59:29 gibba045 bash[25517]: cluster 2021-03-10T14:59:27.997510+0000 mgr.gibba045.orlgmj (mgr.34412) 3767 : cluster [DBG] pgmap v2131: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:31.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:59:31 gibba015 bash[29377]: cluster 2021-03-10T14:59:29.999217+0000 mgr.gibba045.orlgmj (mgr.34412) 3768 : cluster [DBG] pgmap v2132: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:31.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:59:31 gibba015 bash[30343]: cluster 2021-03-10T14:59:29.999217+0000 mgr.gibba045.orlgmj (mgr.34412) 3768 : cluster [DBG] pgmap v2132: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:31.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:59:31 gibba045 bash[25517]: cluster 2021-03-10T14:59:29.999217+0000 mgr.gibba045.orlgmj (mgr.34412) 3768 : cluster [DBG] pgmap v2132: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:33.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:59:33 gibba015 bash[29377]: cluster 2021-03-10T14:59:32.000983+0000 mgr.gibba045.orlgmj (mgr.34412) 3769 : cluster [DBG] pgmap v2133: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:33.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:59:33 gibba015 bash[30343]: cluster 2021-03-10T14:59:32.000983+0000 mgr.gibba045.orlgmj (mgr.34412) 3769 : cluster [DBG] pgmap v2133: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:33.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:59:33 gibba045 bash[25517]: cluster 2021-03-10T14:59:32.000983+0000 mgr.gibba045.orlgmj (mgr.34412) 3769 : cluster [DBG] pgmap v2133: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:34.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:59:34 gibba015 bash[29377]: cluster 2021-03-10T14:59:34.002231+0000 mgr.gibba045.orlgmj (mgr.34412) 3770 : cluster [DBG] pgmap v2134: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:34.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:59:34 gibba015 bash[30343]: cluster 2021-03-10T14:59:34.002231+0000 mgr.gibba045.orlgmj (mgr.34412) 3770 : cluster [DBG] pgmap v2134: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:34.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:59:34 gibba045 bash[25517]: cluster 2021-03-10T14:59:34.002231+0000 mgr.gibba045.orlgmj (mgr.34412) 3770 : cluster [DBG] pgmap v2134: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:37.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:59:37 gibba015 bash[29377]: cluster 2021-03-10T14:59:36.003965+0000 mgr.gibba045.orlgmj (mgr.34412) 3771 : cluster [DBG] pgmap v2135: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:37.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:59:37 gibba015 bash[30343]: cluster 2021-03-10T14:59:36.003965+0000 mgr.gibba045.orlgmj (mgr.34412) 3771 : cluster [DBG] pgmap v2135: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:37.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:59:37 gibba045 bash[25517]: cluster 2021-03-10T14:59:36.003965+0000 mgr.gibba045.orlgmj (mgr.34412) 3771 : cluster [DBG] pgmap v2135: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:39.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:59:39 gibba015 bash[29377]: cluster 2021-03-10T14:59:38.005603+0000 mgr.gibba045.orlgmj (mgr.34412) 3772 : cluster [DBG] pgmap v2136: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:39.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:59:39 gibba015 bash[30343]: cluster 2021-03-10T14:59:38.005603+0000 mgr.gibba045.orlgmj (mgr.34412) 3772 : cluster [DBG] pgmap v2136: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:39.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:59:39 gibba045 bash[25517]: cluster 2021-03-10T14:59:38.005603+0000 mgr.gibba045.orlgmj (mgr.34412) 3772 : cluster [DBG] pgmap v2136: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:41.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:59:41 gibba015 bash[29377]: cluster 2021-03-10T14:59:40.006831+0000 mgr.gibba045.orlgmj (mgr.34412) 3773 : cluster [DBG] pgmap v2137: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:41.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:59:41 gibba015 bash[30343]: cluster 2021-03-10T14:59:40.006831+0000 mgr.gibba045.orlgmj (mgr.34412) 3773 : cluster [DBG] pgmap v2137: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:41.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:59:41 gibba045 bash[25517]: cluster 2021-03-10T14:59:40.006831+0000 mgr.gibba045.orlgmj (mgr.34412) 3773 : cluster [DBG] pgmap v2137: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:42.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:59:42 gibba015 bash[30343]: cephadm 2021-03-10T14:59:40.522041+0000 mgr.gibba045.orlgmj (mgr.34412) 3774 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:59:42.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:59:42 gibba015 bash[29377]: cephadm 2021-03-10T14:59:40.522041+0000 mgr.gibba045.orlgmj (mgr.34412) 3774 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:59:42.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:59:42 gibba045 bash[25517]: cephadm 2021-03-10T14:59:40.522041+0000 mgr.gibba045.orlgmj (mgr.34412) 3774 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:59:43.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:59:43 gibba015 bash[29377]: cluster 2021-03-10T14:59:42.008382+0000 mgr.gibba045.orlgmj (mgr.34412) 3775 : cluster [DBG] pgmap v2138: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:43.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:59:43 gibba015 bash[30343]: cluster 2021-03-10T14:59:42.008382+0000 mgr.gibba045.orlgmj (mgr.34412) 3775 : cluster [DBG] pgmap v2138: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:43.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:59:43 gibba045 bash[25517]: cluster 2021-03-10T14:59:42.008382+0000 mgr.gibba045.orlgmj (mgr.34412) 3775 : cluster [DBG] pgmap v2138: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:44.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:59:44 gibba015 bash[29377]: cluster 2021-03-10T14:59:44.009629+0000 mgr.gibba045.orlgmj (mgr.34412) 3776 : cluster [DBG] pgmap v2139: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:44.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:59:44 gibba015 bash[30343]: cluster 2021-03-10T14:59:44.009629+0000 mgr.gibba045.orlgmj (mgr.34412) 3776 : cluster [DBG] pgmap v2139: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:44.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:59:44 gibba045 bash[25517]: cluster 2021-03-10T14:59:44.009629+0000 mgr.gibba045.orlgmj (mgr.34412) 3776 : cluster [DBG] pgmap v2139: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:47.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:59:47 gibba015 bash[29377]: cluster 2021-03-10T14:59:46.011245+0000 mgr.gibba045.orlgmj (mgr.34412) 3777 : cluster [DBG] pgmap v2140: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:47.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:59:47 gibba015 bash[30343]: cluster 2021-03-10T14:59:46.011245+0000 mgr.gibba045.orlgmj (mgr.34412) 3777 : cluster [DBG] pgmap v2140: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:47.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:59:47 gibba045 bash[25517]: cluster 2021-03-10T14:59:46.011245+0000 mgr.gibba045.orlgmj (mgr.34412) 3777 : cluster [DBG] pgmap v2140: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:48.335 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T14:59:48.565 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:59:48.566 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (70m) 5m ago 75m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T14:59:48.566 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (75m) 4m ago 75m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T14:59:48.566 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (70m) 4m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T14:59:48.566 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (71m) 4m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T14:59:48.567 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (70m) 5m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T14:59:48.567 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (70m) 5m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T14:59:48.567 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (69m) 4m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T14:59:48.567 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (69m) 5m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T14:59:48.568 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (76m) 5m ago 76m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T14:59:48.568 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (76m) 4m ago 76m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T14:59:48.568 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (68m) 5m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T14:59:48.568 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (68m) 5m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T14:59:48.568 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (67m) 5m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T14:59:48.569 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (67m) 5m ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T14:59:48.569 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (67m) 4m ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T14:59:48.569 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (66m) 4m ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T14:59:48.569 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (66m) 4m ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T14:59:48.570 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (65m) 4m ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T14:59:48.570 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (75m) 4m ago 76m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T14:59:48.570 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 4m ago 74m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:59:48.815 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T14:59:48.816 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T14:59:48.816 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:59:48.816 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:59:48.816 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T14:59:48.817 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:59:48.817 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:59:48.817 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T14:59:48.817 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:59:48.817 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T14:59:48.818 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T14:59:48.818 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T14:59:48.818 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:59:48.818 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T14:59:48.819 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T14:59:49.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:59:49 gibba015 bash[29377]: cluster 2021-03-10T14:59:48.012947+0000 mgr.gibba045.orlgmj (mgr.34412) 3778 : cluster [DBG] pgmap v2141: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:49.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:59:49 gibba015 bash[29377]: audit 2021-03-10T14:59:48.325888+0000 mgr.gibba045.orlgmj (mgr.34412) 3779 : audit [DBG] from='client.56578 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:59:49.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:59:49 gibba015 bash[29377]: audit 2021-03-10T14:59:48.811322+0000 mon.a (mon.0) 1139 : audit [DBG] from='client.? 172.21.2.115:0/735756849' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:59:49.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:59:49 gibba015 bash[30343]: cluster 2021-03-10T14:59:48.012947+0000 mgr.gibba045.orlgmj (mgr.34412) 3778 : cluster [DBG] pgmap v2141: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:49.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:59:49 gibba015 bash[30343]: audit 2021-03-10T14:59:48.325888+0000 mgr.gibba045.orlgmj (mgr.34412) 3779 : audit [DBG] from='client.56578 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:59:49.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:59:49 gibba015 bash[30343]: audit 2021-03-10T14:59:48.811322+0000 mon.a (mon.0) 1139 : audit [DBG] from='client.? 172.21.2.115:0/735756849' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:59:49.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:59:49 gibba045 bash[25517]: cluster 2021-03-10T14:59:48.012947+0000 mgr.gibba045.orlgmj (mgr.34412) 3778 : cluster [DBG] pgmap v2141: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:49.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:59:49 gibba045 bash[25517]: audit 2021-03-10T14:59:48.325888+0000 mgr.gibba045.orlgmj (mgr.34412) 3779 : audit [DBG] from='client.56578 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:59:49.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:59:49 gibba045 bash[25517]: audit 2021-03-10T14:59:48.811322+0000 mon.a (mon.0) 1139 : audit [DBG] from='client.? 172.21.2.115:0/735756849' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:59:50.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:59:50 gibba015 bash[29377]: audit 2021-03-10T14:59:48.552892+0000 mgr.gibba045.orlgmj (mgr.34412) 3780 : audit [DBG] from='client.56584 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:59:50.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:59:50 gibba015 bash[30343]: audit 2021-03-10T14:59:48.552892+0000 mgr.gibba045.orlgmj (mgr.34412) 3780 : audit [DBG] from='client.56584 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:59:50.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:59:50 gibba045 bash[25517]: audit 2021-03-10T14:59:48.552892+0000 mgr.gibba045.orlgmj (mgr.34412) 3780 : audit [DBG] from='client.56584 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:59:51.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:59:51 gibba015 bash[29377]: cluster 2021-03-10T14:59:50.013613+0000 mgr.gibba045.orlgmj (mgr.34412) 3781 : cluster [DBG] pgmap v2142: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:51.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:59:51 gibba015 bash[30343]: cluster 2021-03-10T14:59:50.013613+0000 mgr.gibba045.orlgmj (mgr.34412) 3781 : cluster [DBG] pgmap v2142: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:51.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:59:51 gibba045 bash[25517]: cluster 2021-03-10T14:59:50.013613+0000 mgr.gibba045.orlgmj (mgr.34412) 3781 : cluster [DBG] pgmap v2142: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:53.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:59:53 gibba015 bash[29377]: cluster 2021-03-10T14:59:52.015215+0000 mgr.gibba045.orlgmj (mgr.34412) 3782 : cluster [DBG] pgmap v2143: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:53.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:59:53 gibba015 bash[29377]: audit 2021-03-10T14:59:52.932537+0000 mon.c (mon.1) 1082 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:59:53.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:59:53 gibba015 bash[29377]: audit 2021-03-10T14:59:52.933283+0000 mon.c (mon.1) 1083 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:59:53.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:59:53 gibba015 bash[29377]: audit 2021-03-10T14:59:52.933678+0000 mon.a (mon.0) 1140 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:59:53.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:59:53 gibba015 bash[29377]: audit 2021-03-10T14:59:52.934964+0000 mon.a (mon.0) 1141 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:59:53.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:59:53 gibba015 bash[29377]: audit 2021-03-10T14:59:52.943359+0000 mon.c (mon.1) 1084 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T14:59:53.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:59:53 gibba015 bash[29377]: audit 2021-03-10T14:59:52.944051+0000 mon.c (mon.1) 1085 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:59:53.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:59:53 gibba015 bash[29377]: audit 2021-03-10T14:59:52.944452+0000 mon.a (mon.0) 1142 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T14:59:53.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:59:53 gibba015 bash[29377]: audit 2021-03-10T14:59:52.944709+0000 mon.c (mon.1) 1086 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:59:53.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:59:53 gibba015 bash[29377]: audit 2021-03-10T14:59:52.945555+0000 mon.c (mon.1) 1087 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:59:53.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:59:53 gibba015 bash[29377]: audit 2021-03-10T14:59:52.945715+0000 mon.a (mon.0) 1143 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:59:53.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:59:53 gibba015 bash[29377]: audit 2021-03-10T14:59:52.946954+0000 mon.a (mon.0) 1144 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:59:53.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:59:53 gibba015 bash[29377]: audit 2021-03-10T14:59:52.947747+0000 mon.a (mon.0) 1145 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:59:53.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:59:53 gibba015 bash[30343]: cluster 2021-03-10T14:59:52.015215+0000 mgr.gibba045.orlgmj (mgr.34412) 3782 : cluster [DBG] pgmap v2143: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:53.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:59:53 gibba015 bash[30343]: audit 2021-03-10T14:59:52.932537+0000 mon.c (mon.1) 1082 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:59:53.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:59:53 gibba015 bash[30343]: audit 2021-03-10T14:59:52.933283+0000 mon.c (mon.1) 1083 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:59:53.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:59:53 gibba015 bash[30343]: audit 2021-03-10T14:59:52.933678+0000 mon.a (mon.0) 1140 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:59:53.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:59:53 gibba015 bash[30343]: audit 2021-03-10T14:59:52.934964+0000 mon.a (mon.0) 1141 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:59:53.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:59:53 gibba015 bash[30343]: audit 2021-03-10T14:59:52.943359+0000 mon.c (mon.1) 1084 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T14:59:53.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:59:53 gibba015 bash[30343]: audit 2021-03-10T14:59:52.944051+0000 mon.c (mon.1) 1085 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:59:53.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:59:53 gibba015 bash[30343]: audit 2021-03-10T14:59:52.944452+0000 mon.a (mon.0) 1142 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T14:59:53.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:59:53 gibba015 bash[30343]: audit 2021-03-10T14:59:52.944709+0000 mon.c (mon.1) 1086 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:59:53.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:59:53 gibba015 bash[30343]: audit 2021-03-10T14:59:52.945555+0000 mon.c (mon.1) 1087 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:59:53.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:59:53 gibba015 bash[30343]: audit 2021-03-10T14:59:52.945715+0000 mon.a (mon.0) 1143 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:59:53.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:59:53 gibba015 bash[30343]: audit 2021-03-10T14:59:52.946954+0000 mon.a (mon.0) 1144 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:59:53.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:59:53 gibba015 bash[30343]: audit 2021-03-10T14:59:52.947747+0000 mon.a (mon.0) 1145 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:59:53.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:59:53 gibba045 bash[25517]: cluster 2021-03-10T14:59:52.015215+0000 mgr.gibba045.orlgmj (mgr.34412) 3782 : cluster [DBG] pgmap v2143: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:53.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:59:53 gibba045 bash[25517]: audit 2021-03-10T14:59:52.932537+0000 mon.c (mon.1) 1082 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:59:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:59:53 gibba045 bash[25517]: audit 2021-03-10T14:59:52.933283+0000 mon.c (mon.1) 1083 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:59:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:59:53 gibba045 bash[25517]: audit 2021-03-10T14:59:52.933678+0000 mon.a (mon.0) 1140 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T14:59:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:59:53 gibba045 bash[25517]: audit 2021-03-10T14:59:52.934964+0000 mon.a (mon.0) 1141 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:59:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:59:53 gibba045 bash[25517]: audit 2021-03-10T14:59:52.943359+0000 mon.c (mon.1) 1084 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T14:59:53.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:59:53 gibba045 bash[25517]: audit 2021-03-10T14:59:52.944051+0000 mon.c (mon.1) 1085 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:59:53.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:59:53 gibba045 bash[25517]: audit 2021-03-10T14:59:52.944452+0000 mon.a (mon.0) 1142 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T14:59:53.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:59:53 gibba045 bash[25517]: audit 2021-03-10T14:59:52.944709+0000 mon.c (mon.1) 1086 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:59:53.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:59:53 gibba045 bash[25517]: audit 2021-03-10T14:59:52.945555+0000 mon.c (mon.1) 1087 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:59:53.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:59:53 gibba045 bash[25517]: audit 2021-03-10T14:59:52.945715+0000 mon.a (mon.0) 1143 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:59:53.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:59:53 gibba045 bash[25517]: audit 2021-03-10T14:59:52.946954+0000 mon.a (mon.0) 1144 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:59:53.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:59:53 gibba045 bash[25517]: audit 2021-03-10T14:59:52.947747+0000 mon.a (mon.0) 1145 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:59:54.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:59:54 gibba015 bash[29377]: cluster 2021-03-10T14:59:54.016482+0000 mgr.gibba045.orlgmj (mgr.34412) 3783 : cluster [DBG] pgmap v2144: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:59:54 gibba015 bash[30343]: cluster 2021-03-10T14:59:54.016482+0000 mgr.gibba045.orlgmj (mgr.34412) 3783 : cluster [DBG] pgmap v2144: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:54.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:59:54 gibba045 bash[25517]: cluster 2021-03-10T14:59:54.016482+0000 mgr.gibba045.orlgmj (mgr.34412) 3783 : cluster [DBG] pgmap v2144: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:57.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:59:57 gibba015 bash[29377]: cephadm 2021-03-10T14:59:55.538070+0000 mgr.gibba045.orlgmj (mgr.34412) 3784 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:59:57.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:59:57 gibba015 bash[29377]: cluster 2021-03-10T14:59:56.017023+0000 mgr.gibba045.orlgmj (mgr.34412) 3785 : cluster [DBG] pgmap v2145: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:57.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:59:57 gibba015 bash[30343]: cephadm 2021-03-10T14:59:55.538070+0000 mgr.gibba045.orlgmj (mgr.34412) 3784 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:59:57.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:59:57 gibba015 bash[30343]: cluster 2021-03-10T14:59:56.017023+0000 mgr.gibba045.orlgmj (mgr.34412) 3785 : cluster [DBG] pgmap v2145: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:57.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:59:57 gibba045 bash[25517]: cephadm 2021-03-10T14:59:55.538070+0000 mgr.gibba045.orlgmj (mgr.34412) 3784 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T14:59:57.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:59:57 gibba045 bash[25517]: cluster 2021-03-10T14:59:56.017023+0000 mgr.gibba045.orlgmj (mgr.34412) 3785 : cluster [DBG] pgmap v2145: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:59.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 14:59:59 gibba015 bash[29377]: cluster 2021-03-10T14:59:58.018252+0000 mgr.gibba045.orlgmj (mgr.34412) 3786 : cluster [DBG] pgmap v2146: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:59.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 14:59:59 gibba015 bash[30343]: cluster 2021-03-10T14:59:58.018252+0000 mgr.gibba045.orlgmj (mgr.34412) 3786 : cluster [DBG] pgmap v2146: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:59.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 14:59:59 gibba045 bash[25517]: cluster 2021-03-10T14:59:58.018252+0000 mgr.gibba045.orlgmj (mgr.34412) 3786 : cluster [DBG] pgmap v2146: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:00.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:00:00 gibba015 bash[29377]: debug 2021-03-10T14:59:59.994+0000 7f21beb4f700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T15:00:00.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:00:00 gibba015 bash[29377]: cluster 2021-03-10T15:00:00.000148+0000 mon.a (mon.0) 1146 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T15:00:00.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:00:00 gibba015 bash[30343]: cluster 2021-03-10T15:00:00.000148+0000 mon.a (mon.0) 1146 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T15:00:00.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:00:00 gibba045 bash[25517]: cluster 2021-03-10T15:00:00.000148+0000 mon.a (mon.0) 1146 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T15:00:01.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:00:01 gibba015 bash[29377]: cluster 2021-03-10T15:00:00.018907+0000 mgr.gibba045.orlgmj (mgr.34412) 3787 : cluster [DBG] pgmap v2147: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:01.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:00:01 gibba015 bash[30343]: cluster 2021-03-10T15:00:00.018907+0000 mgr.gibba045.orlgmj (mgr.34412) 3787 : cluster [DBG] pgmap v2147: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:01.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:00:01 gibba045 bash[25517]: cluster 2021-03-10T15:00:00.018907+0000 mgr.gibba045.orlgmj (mgr.34412) 3787 : cluster [DBG] pgmap v2147: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:03.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:00:03 gibba015 bash[29377]: cluster 2021-03-10T15:00:02.020610+0000 mgr.gibba045.orlgmj (mgr.34412) 3788 : cluster [DBG] pgmap v2148: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:03.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:00:03 gibba015 bash[30343]: cluster 2021-03-10T15:00:02.020610+0000 mgr.gibba045.orlgmj (mgr.34412) 3788 : cluster [DBG] pgmap v2148: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:03.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:00:03 gibba045 bash[25517]: cluster 2021-03-10T15:00:02.020610+0000 mgr.gibba045.orlgmj (mgr.34412) 3788 : cluster [DBG] pgmap v2148: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:04.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:00:04 gibba045 bash[25517]: cluster 2021-03-10T15:00:04.021769+0000 mgr.gibba045.orlgmj (mgr.34412) 3789 : cluster [DBG] pgmap v2149: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:04.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:00:04 gibba015 bash[29377]: cluster 2021-03-10T15:00:04.021769+0000 mgr.gibba045.orlgmj (mgr.34412) 3789 : cluster [DBG] pgmap v2149: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:04.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:00:04 gibba015 bash[30343]: cluster 2021-03-10T15:00:04.021769+0000 mgr.gibba045.orlgmj (mgr.34412) 3789 : cluster [DBG] pgmap v2149: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:07.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:00:07 gibba015 bash[29377]: cluster 2021-03-10T15:00:06.023508+0000 mgr.gibba045.orlgmj (mgr.34412) 3790 : cluster [DBG] pgmap v2150: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:07.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:00:07 gibba015 bash[30343]: cluster 2021-03-10T15:00:06.023508+0000 mgr.gibba045.orlgmj (mgr.34412) 3790 : cluster [DBG] pgmap v2150: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:07.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:00:07 gibba045 bash[25517]: cluster 2021-03-10T15:00:06.023508+0000 mgr.gibba045.orlgmj (mgr.34412) 3790 : cluster [DBG] pgmap v2150: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:09.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:00:09 gibba015 bash[29377]: cluster 2021-03-10T15:00:08.025167+0000 mgr.gibba045.orlgmj (mgr.34412) 3791 : cluster [DBG] pgmap v2151: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:09.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:00:09 gibba015 bash[30343]: cluster 2021-03-10T15:00:08.025167+0000 mgr.gibba045.orlgmj (mgr.34412) 3791 : cluster [DBG] pgmap v2151: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:09.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:00:09 gibba045 bash[25517]: cluster 2021-03-10T15:00:08.025167+0000 mgr.gibba045.orlgmj (mgr.34412) 3791 : cluster [DBG] pgmap v2151: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:11.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:00:11 gibba015 bash[29377]: cluster 2021-03-10T15:00:10.026030+0000 mgr.gibba045.orlgmj (mgr.34412) 3792 : cluster [DBG] pgmap v2152: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:11.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:00:11 gibba015 bash[30343]: cluster 2021-03-10T15:00:10.026030+0000 mgr.gibba045.orlgmj (mgr.34412) 3792 : cluster [DBG] pgmap v2152: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:11.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:00:11 gibba045 bash[25517]: cluster 2021-03-10T15:00:10.026030+0000 mgr.gibba045.orlgmj (mgr.34412) 3792 : cluster [DBG] pgmap v2152: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:12.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:00:12 gibba015 bash[29377]: cephadm 2021-03-10T15:00:10.554029+0000 mgr.gibba045.orlgmj (mgr.34412) 3793 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:00:12.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:00:12 gibba015 bash[30343]: cephadm 2021-03-10T15:00:10.554029+0000 mgr.gibba045.orlgmj (mgr.34412) 3793 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:00:12.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:00:12 gibba045 bash[25517]: cephadm 2021-03-10T15:00:10.554029+0000 mgr.gibba045.orlgmj (mgr.34412) 3793 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:00:13.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:00:13 gibba015 bash[29377]: cluster 2021-03-10T15:00:12.026465+0000 mgr.gibba045.orlgmj (mgr.34412) 3794 : cluster [DBG] pgmap v2153: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:13.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:00:13 gibba015 bash[30343]: cluster 2021-03-10T15:00:12.026465+0000 mgr.gibba045.orlgmj (mgr.34412) 3794 : cluster [DBG] pgmap v2153: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:13.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:00:13 gibba045 bash[25517]: cluster 2021-03-10T15:00:12.026465+0000 mgr.gibba045.orlgmj (mgr.34412) 3794 : cluster [DBG] pgmap v2153: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:14.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:00:14 gibba045 bash[25517]: cluster 2021-03-10T15:00:14.027637+0000 mgr.gibba045.orlgmj (mgr.34412) 3795 : cluster [DBG] pgmap v2154: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:14.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:00:14 gibba015 bash[29377]: cluster 2021-03-10T15:00:14.027637+0000 mgr.gibba045.orlgmj (mgr.34412) 3795 : cluster [DBG] pgmap v2154: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:14.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:00:14 gibba015 bash[30343]: cluster 2021-03-10T15:00:14.027637+0000 mgr.gibba045.orlgmj (mgr.34412) 3795 : cluster [DBG] pgmap v2154: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:17.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:00:17 gibba015 bash[29377]: cluster 2021-03-10T15:00:16.029493+0000 mgr.gibba045.orlgmj (mgr.34412) 3796 : cluster [DBG] pgmap v2155: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:17.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:00:17 gibba015 bash[30343]: cluster 2021-03-10T15:00:16.029493+0000 mgr.gibba045.orlgmj (mgr.34412) 3796 : cluster [DBG] pgmap v2155: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:17.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:00:17 gibba045 bash[25517]: cluster 2021-03-10T15:00:16.029493+0000 mgr.gibba045.orlgmj (mgr.34412) 3796 : cluster [DBG] pgmap v2155: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:19.059 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:00:19.287 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:00:19.288 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (71m) 5m ago 76m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:00:19.288 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (76m) 4m ago 76m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:00:19.288 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (71m) 4m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:00:19.289 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (71m) 4m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:00:19.289 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (70m) 5m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:00:19.289 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (70m) 5m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:00:19.289 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (70m) 4m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:00:19.290 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (70m) 5m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:00:19.290 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (76m) 5m ago 76m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:00:19.290 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (76m) 4m ago 76m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:00:19.291 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (69m) 5m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:00:19.291 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (68m) 5m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:00:19.291 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (68m) 5m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:00:19.291 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (68m) 5m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:00:19.292 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (67m) 4m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:00:19.292 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (67m) 4m ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:00:19.292 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (66m) 4m ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:00:19.292 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (66m) 4m ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:00:19.293 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (75m) 4m ago 76m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:00:19.293 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 4m ago 74m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:00:19.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:00:19 gibba015 bash[29377]: cluster 2021-03-10T15:00:18.030845+0000 mgr.gibba045.orlgmj (mgr.34412) 3797 : cluster [DBG] pgmap v2156: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:19.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:00:19 gibba015 bash[30343]: cluster 2021-03-10T15:00:18.030845+0000 mgr.gibba045.orlgmj (mgr.34412) 3797 : cluster [DBG] pgmap v2156: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:19.539 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:00:19.540 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:00:19.540 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:00:19.540 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:00:19.540 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:00:19.541 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:00:19.541 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:00:19.541 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:00:19.541 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:00:19.542 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:00:19.542 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:00:19.542 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:00:19.542 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:00:19.542 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:00:19.543 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:00:19.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:00:19 gibba045 bash[25517]: cluster 2021-03-10T15:00:18.030845+0000 mgr.gibba045.orlgmj (mgr.34412) 3797 : cluster [DBG] pgmap v2156: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:20.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:00:20 gibba015 bash[29377]: audit 2021-03-10T15:00:19.049433+0000 mgr.gibba045.orlgmj (mgr.34412) 3798 : audit [DBG] from='client.56596 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:00:20.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:00:20 gibba015 bash[29377]: audit 2021-03-10T15:00:19.276044+0000 mgr.gibba045.orlgmj (mgr.34412) 3799 : audit [DBG] from='client.56602 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:00:20.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:00:20 gibba015 bash[29377]: audit 2021-03-10T15:00:19.535594+0000 mon.a (mon.0) 1147 : audit [DBG] from='client.? 172.21.2.115:0/1458361242' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:00:20.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:00:20 gibba015 bash[30343]: audit 2021-03-10T15:00:19.049433+0000 mgr.gibba045.orlgmj (mgr.34412) 3798 : audit [DBG] from='client.56596 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:00:20.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:00:20 gibba015 bash[30343]: audit 2021-03-10T15:00:19.276044+0000 mgr.gibba045.orlgmj (mgr.34412) 3799 : audit [DBG] from='client.56602 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:00:20.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:00:20 gibba015 bash[30343]: audit 2021-03-10T15:00:19.535594+0000 mon.a (mon.0) 1147 : audit [DBG] from='client.? 172.21.2.115:0/1458361242' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:00:20.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:00:20 gibba045 bash[25517]: audit 2021-03-10T15:00:19.049433+0000 mgr.gibba045.orlgmj (mgr.34412) 3798 : audit [DBG] from='client.56596 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:00:20.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:00:20 gibba045 bash[25517]: audit 2021-03-10T15:00:19.276044+0000 mgr.gibba045.orlgmj (mgr.34412) 3799 : audit [DBG] from='client.56602 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:00:20.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:00:20 gibba045 bash[25517]: audit 2021-03-10T15:00:19.535594+0000 mon.a (mon.0) 1147 : audit [DBG] from='client.? 172.21.2.115:0/1458361242' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:00:21.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:00:21 gibba015 bash[29377]: cluster 2021-03-10T15:00:20.031657+0000 mgr.gibba045.orlgmj (mgr.34412) 3800 : cluster [DBG] pgmap v2157: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:21.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:00:21 gibba015 bash[30343]: cluster 2021-03-10T15:00:20.031657+0000 mgr.gibba045.orlgmj (mgr.34412) 3800 : cluster [DBG] pgmap v2157: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:21.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:00:21 gibba045 bash[25517]: cluster 2021-03-10T15:00:20.031657+0000 mgr.gibba045.orlgmj (mgr.34412) 3800 : cluster [DBG] pgmap v2157: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:23.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:00:23 gibba015 bash[29377]: cluster 2021-03-10T15:00:22.033306+0000 mgr.gibba045.orlgmj (mgr.34412) 3801 : cluster [DBG] pgmap v2158: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:23.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:00:23 gibba015 bash[30343]: cluster 2021-03-10T15:00:22.033306+0000 mgr.gibba045.orlgmj (mgr.34412) 3801 : cluster [DBG] pgmap v2158: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:23.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:00:23 gibba045 bash[25517]: cluster 2021-03-10T15:00:22.033306+0000 mgr.gibba045.orlgmj (mgr.34412) 3801 : cluster [DBG] pgmap v2158: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:24.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:00:24 gibba045 bash[25517]: cluster 2021-03-10T15:00:24.034525+0000 mgr.gibba045.orlgmj (mgr.34412) 3802 : cluster [DBG] pgmap v2159: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:24.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:00:24 gibba015 bash[29377]: cluster 2021-03-10T15:00:24.034525+0000 mgr.gibba045.orlgmj (mgr.34412) 3802 : cluster [DBG] pgmap v2159: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:24.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:00:24 gibba015 bash[30343]: cluster 2021-03-10T15:00:24.034525+0000 mgr.gibba045.orlgmj (mgr.34412) 3802 : cluster [DBG] pgmap v2159: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:25.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:00:25 gibba015 bash[29377]: audit 2021-03-10T15:00:25.554535+0000 mon.c (mon.1) 1088 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:00:25.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:00:25 gibba015 bash[30343]: audit 2021-03-10T15:00:25.554535+0000 mon.c (mon.1) 1088 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:00:26.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:00:25 gibba045 bash[25517]: audit 2021-03-10T15:00:25.554535+0000 mon.c (mon.1) 1088 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:00:27.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:00:26 gibba045 bash[25517]: cephadm 2021-03-10T15:00:25.563449+0000 mgr.gibba045.orlgmj (mgr.34412) 3803 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:00:27.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:00:26 gibba045 bash[25517]: cephadm 2021-03-10T15:00:25.565322+0000 mgr.gibba045.orlgmj (mgr.34412) 3804 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:00:27.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:00:26 gibba045 bash[25517]: audit 2021-03-10T15:00:25.787379+0000 mon.a (mon.0) 1148 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:00:27.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:00:26 gibba045 bash[25517]: audit 2021-03-10T15:00:25.791287+0000 mon.c (mon.1) 1089 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:00:27.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:00:26 gibba045 bash[25517]: audit 2021-03-10T15:00:25.792795+0000 mon.c (mon.1) 1090 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:00:27.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:00:26 gibba045 bash[25517]: cephadm 2021-03-10T15:00:25.793888+0000 mgr.gibba045.orlgmj (mgr.34412) 3805 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:00:27.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:00:26 gibba045 bash[25517]: audit 2021-03-10T15:00:25.794287+0000 mon.c (mon.1) 1091 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:00:27.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:00:26 gibba045 bash[25517]: audit 2021-03-10T15:00:25.795623+0000 mon.c (mon.1) 1092 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:00:27.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:00:26 gibba045 bash[25517]: cephadm 2021-03-10T15:00:25.795911+0000 mgr.gibba045.orlgmj (mgr.34412) 3806 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:00:27.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:00:26 gibba045 bash[25517]: cephadm 2021-03-10T15:00:25.797226+0000 mgr.gibba045.orlgmj (mgr.34412) 3807 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:00:27.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:00:26 gibba045 bash[25517]: cephadm 2021-03-10T15:00:25.797262+0000 mgr.gibba045.orlgmj (mgr.34412) 3808 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:00:27.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:00:26 gibba045 bash[25517]: cephadm 2021-03-10T15:00:25.798713+0000 mgr.gibba045.orlgmj (mgr.34412) 3809 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:00:27.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:00:26 gibba045 bash[25517]: cephadm 2021-03-10T15:00:25.798817+0000 mgr.gibba045.orlgmj (mgr.34412) 3810 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:00:27.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:00:26 gibba045 bash[25517]: audit 2021-03-10T15:00:25.799330+0000 mon.c (mon.1) 1093 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:00:27.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:00:26 gibba045 bash[25517]: cephadm 2021-03-10T15:00:25.800089+0000 mgr.gibba045.orlgmj (mgr.34412) 3811 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:00:27.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:00:26 gibba045 bash[25517]: audit 2021-03-10T15:00:25.800920+0000 mon.c (mon.1) 1094 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:00:27.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:00:26 gibba045 bash[25517]: cephadm 2021-03-10T15:00:25.802175+0000 mgr.gibba045.orlgmj (mgr.34412) 3812 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:00:27.062 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:00:26 gibba045 bash[25517]: cephadm 2021-03-10T15:00:25.802209+0000 mgr.gibba045.orlgmj (mgr.34412) 3813 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:00:27.062 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:00:26 gibba045 bash[25517]: cephadm 2021-03-10T15:00:25.803819+0000 mgr.gibba045.orlgmj (mgr.34412) 3814 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:00:27.062 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:00:26 gibba045 bash[25517]: cephadm 2021-03-10T15:00:25.804128+0000 mgr.gibba045.orlgmj (mgr.34412) 3815 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:00:27.062 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:00:26 gibba045 bash[25517]: cephadm 2021-03-10T15:00:25.805386+0000 mgr.gibba045.orlgmj (mgr.34412) 3816 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:00:27.063 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:00:26 gibba045 bash[25517]: cephadm 2021-03-10T15:00:25.805423+0000 mgr.gibba045.orlgmj (mgr.34412) 3817 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:00:27.063 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:00:26 gibba045 bash[25517]: cephadm 2021-03-10T15:00:25.805525+0000 mgr.gibba045.orlgmj (mgr.34412) 3818 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:00:27.063 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:00:26 gibba045 bash[25517]: cluster 2021-03-10T15:00:26.036319+0000 mgr.gibba045.orlgmj (mgr.34412) 3819 : cluster [DBG] pgmap v2160: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:27.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:00:26 gibba015 bash[29377]: cephadm 2021-03-10T15:00:25.563449+0000 mgr.gibba045.orlgmj (mgr.34412) 3803 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:00:27.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:00:26 gibba015 bash[29377]: cephadm 2021-03-10T15:00:25.565322+0000 mgr.gibba045.orlgmj (mgr.34412) 3804 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:00:27.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:00:26 gibba015 bash[29377]: audit 2021-03-10T15:00:25.787379+0000 mon.a (mon.0) 1148 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:00:27.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:00:26 gibba015 bash[29377]: audit 2021-03-10T15:00:25.791287+0000 mon.c (mon.1) 1089 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:00:27.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:00:26 gibba015 bash[29377]: audit 2021-03-10T15:00:25.792795+0000 mon.c (mon.1) 1090 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:00:27.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:00:26 gibba015 bash[29377]: cephadm 2021-03-10T15:00:25.793888+0000 mgr.gibba045.orlgmj (mgr.34412) 3805 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:00:27.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:00:26 gibba015 bash[29377]: audit 2021-03-10T15:00:25.794287+0000 mon.c (mon.1) 1091 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:00:27.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:00:26 gibba015 bash[29377]: audit 2021-03-10T15:00:25.795623+0000 mon.c (mon.1) 1092 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:00:27.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:00:26 gibba015 bash[29377]: cephadm 2021-03-10T15:00:25.795911+0000 mgr.gibba045.orlgmj (mgr.34412) 3806 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:00:27.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:00:26 gibba015 bash[29377]: cephadm 2021-03-10T15:00:25.797226+0000 mgr.gibba045.orlgmj (mgr.34412) 3807 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:00:27.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:00:26 gibba015 bash[29377]: cephadm 2021-03-10T15:00:25.797262+0000 mgr.gibba045.orlgmj (mgr.34412) 3808 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:00:27.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:00:26 gibba015 bash[29377]: cephadm 2021-03-10T15:00:25.798713+0000 mgr.gibba045.orlgmj (mgr.34412) 3809 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:00:27.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:00:26 gibba015 bash[29377]: cephadm 2021-03-10T15:00:25.798817+0000 mgr.gibba045.orlgmj (mgr.34412) 3810 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:00:27.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:00:26 gibba015 bash[29377]: audit 2021-03-10T15:00:25.799330+0000 mon.c (mon.1) 1093 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:00:27.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:00:26 gibba015 bash[29377]: cephadm 2021-03-10T15:00:25.800089+0000 mgr.gibba045.orlgmj (mgr.34412) 3811 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:00:27.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:00:26 gibba015 bash[29377]: audit 2021-03-10T15:00:25.800920+0000 mon.c (mon.1) 1094 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:00:27.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:00:26 gibba015 bash[29377]: cephadm 2021-03-10T15:00:25.802175+0000 mgr.gibba045.orlgmj (mgr.34412) 3812 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:00:27.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:00:26 gibba015 bash[29377]: cephadm 2021-03-10T15:00:25.802209+0000 mgr.gibba045.orlgmj (mgr.34412) 3813 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:00:27.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:00:26 gibba015 bash[29377]: cephadm 2021-03-10T15:00:25.803819+0000 mgr.gibba045.orlgmj (mgr.34412) 3814 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:00:27.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:00:26 gibba015 bash[29377]: cephadm 2021-03-10T15:00:25.804128+0000 mgr.gibba045.orlgmj (mgr.34412) 3815 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:00:27.230 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:00:26 gibba015 bash[29377]: cephadm 2021-03-10T15:00:25.805386+0000 mgr.gibba045.orlgmj (mgr.34412) 3816 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:00:27.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:00:26 gibba015 bash[30343]: cephadm 2021-03-10T15:00:25.563449+0000 mgr.gibba045.orlgmj (mgr.34412) 3803 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:00:27.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:00:26 gibba015 bash[30343]: cephadm 2021-03-10T15:00:25.565322+0000 mgr.gibba045.orlgmj (mgr.34412) 3804 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:00:27.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:00:26 gibba015 bash[30343]: audit 2021-03-10T15:00:25.787379+0000 mon.a (mon.0) 1148 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:00:27.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:00:26 gibba015 bash[30343]: audit 2021-03-10T15:00:25.791287+0000 mon.c (mon.1) 1089 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:00:27.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:00:26 gibba015 bash[30343]: audit 2021-03-10T15:00:25.792795+0000 mon.c (mon.1) 1090 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:00:27.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:00:26 gibba015 bash[30343]: cephadm 2021-03-10T15:00:25.793888+0000 mgr.gibba045.orlgmj (mgr.34412) 3805 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:00:27.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:00:26 gibba015 bash[30343]: audit 2021-03-10T15:00:25.794287+0000 mon.c (mon.1) 1091 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:00:27.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:00:26 gibba015 bash[30343]: audit 2021-03-10T15:00:25.795623+0000 mon.c (mon.1) 1092 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:00:27.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:00:26 gibba015 bash[30343]: cephadm 2021-03-10T15:00:25.795911+0000 mgr.gibba045.orlgmj (mgr.34412) 3806 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:00:27.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:00:26 gibba015 bash[30343]: cephadm 2021-03-10T15:00:25.797226+0000 mgr.gibba045.orlgmj (mgr.34412) 3807 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:00:27.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:00:26 gibba015 bash[30343]: cephadm 2021-03-10T15:00:25.797262+0000 mgr.gibba045.orlgmj (mgr.34412) 3808 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:00:27.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:00:26 gibba015 bash[30343]: cephadm 2021-03-10T15:00:25.798713+0000 mgr.gibba045.orlgmj (mgr.34412) 3809 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:00:27.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:00:26 gibba015 bash[30343]: cephadm 2021-03-10T15:00:25.798817+0000 mgr.gibba045.orlgmj (mgr.34412) 3810 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:00:27.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:00:26 gibba015 bash[30343]: audit 2021-03-10T15:00:25.799330+0000 mon.c (mon.1) 1093 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:00:27.234 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:00:26 gibba015 bash[30343]: cephadm 2021-03-10T15:00:25.800089+0000 mgr.gibba045.orlgmj (mgr.34412) 3811 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:00:27.234 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:00:26 gibba015 bash[30343]: audit 2021-03-10T15:00:25.800920+0000 mon.c (mon.1) 1094 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:00:27.234 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:00:26 gibba015 bash[30343]: cephadm 2021-03-10T15:00:25.802175+0000 mgr.gibba045.orlgmj (mgr.34412) 3812 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:00:27.234 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:00:26 gibba015 bash[30343]: cephadm 2021-03-10T15:00:25.802209+0000 mgr.gibba045.orlgmj (mgr.34412) 3813 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:00:27.235 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:00:26 gibba015 bash[30343]: cephadm 2021-03-10T15:00:25.803819+0000 mgr.gibba045.orlgmj (mgr.34412) 3814 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:00:27.235 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:00:26 gibba015 bash[30343]: cephadm 2021-03-10T15:00:25.804128+0000 mgr.gibba045.orlgmj (mgr.34412) 3815 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:00:27.235 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:00:26 gibba015 bash[30343]: cephadm 2021-03-10T15:00:25.805386+0000 mgr.gibba045.orlgmj (mgr.34412) 3816 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:00:27.235 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:00:26 gibba015 bash[29377]: cephadm 2021-03-10T15:00:25.805423+0000 mgr.gibba045.orlgmj (mgr.34412) 3817 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:00:27.236 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:00:26 gibba015 bash[29377]: cephadm 2021-03-10T15:00:25.805525+0000 mgr.gibba045.orlgmj (mgr.34412) 3818 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:00:27.236 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:00:26 gibba015 bash[29377]: cluster 2021-03-10T15:00:26.036319+0000 mgr.gibba045.orlgmj (mgr.34412) 3819 : cluster [DBG] pgmap v2160: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:27.236 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:00:26 gibba015 bash[30343]: cephadm 2021-03-10T15:00:25.805423+0000 mgr.gibba045.orlgmj (mgr.34412) 3817 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:00:27.237 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:00:26 gibba015 bash[30343]: cephadm 2021-03-10T15:00:25.805525+0000 mgr.gibba045.orlgmj (mgr.34412) 3818 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:00:27.237 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:00:26 gibba015 bash[30343]: cluster 2021-03-10T15:00:26.036319+0000 mgr.gibba045.orlgmj (mgr.34412) 3819 : cluster [DBG] pgmap v2160: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:29.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:00:29 gibba015 bash[29377]: cluster 2021-03-10T15:00:28.037013+0000 mgr.gibba045.orlgmj (mgr.34412) 3820 : cluster [DBG] pgmap v2161: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:29.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:00:29 gibba015 bash[30343]: cluster 2021-03-10T15:00:28.037013+0000 mgr.gibba045.orlgmj (mgr.34412) 3820 : cluster [DBG] pgmap v2161: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:29.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:00:29 gibba045 bash[25517]: cluster 2021-03-10T15:00:28.037013+0000 mgr.gibba045.orlgmj (mgr.34412) 3820 : cluster [DBG] pgmap v2161: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:31.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:00:31 gibba015 bash[29377]: cluster 2021-03-10T15:00:30.037555+0000 mgr.gibba045.orlgmj (mgr.34412) 3821 : cluster [DBG] pgmap v2162: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:31.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:00:31 gibba015 bash[30343]: cluster 2021-03-10T15:00:30.037555+0000 mgr.gibba045.orlgmj (mgr.34412) 3821 : cluster [DBG] pgmap v2162: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:31.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:00:31 gibba045 bash[25517]: cluster 2021-03-10T15:00:30.037555+0000 mgr.gibba045.orlgmj (mgr.34412) 3821 : cluster [DBG] pgmap v2162: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:33.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:00:33 gibba015 bash[29377]: cluster 2021-03-10T15:00:32.039048+0000 mgr.gibba045.orlgmj (mgr.34412) 3822 : cluster [DBG] pgmap v2163: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:33.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:00:33 gibba015 bash[30343]: cluster 2021-03-10T15:00:32.039048+0000 mgr.gibba045.orlgmj (mgr.34412) 3822 : cluster [DBG] pgmap v2163: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:33.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:00:33 gibba045 bash[25517]: cluster 2021-03-10T15:00:32.039048+0000 mgr.gibba045.orlgmj (mgr.34412) 3822 : cluster [DBG] pgmap v2163: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:34.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:00:34 gibba045 bash[25517]: cluster 2021-03-10T15:00:34.040369+0000 mgr.gibba045.orlgmj (mgr.34412) 3823 : cluster [DBG] pgmap v2164: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:34.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:00:34 gibba015 bash[29377]: cluster 2021-03-10T15:00:34.040369+0000 mgr.gibba045.orlgmj (mgr.34412) 3823 : cluster [DBG] pgmap v2164: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:34.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:00:34 gibba015 bash[30343]: cluster 2021-03-10T15:00:34.040369+0000 mgr.gibba045.orlgmj (mgr.34412) 3823 : cluster [DBG] pgmap v2164: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:37.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:00:37 gibba015 bash[29377]: cluster 2021-03-10T15:00:36.041897+0000 mgr.gibba045.orlgmj (mgr.34412) 3824 : cluster [DBG] pgmap v2165: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:37.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:00:37 gibba015 bash[30343]: cluster 2021-03-10T15:00:36.041897+0000 mgr.gibba045.orlgmj (mgr.34412) 3824 : cluster [DBG] pgmap v2165: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:37.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:00:37 gibba045 bash[25517]: cluster 2021-03-10T15:00:36.041897+0000 mgr.gibba045.orlgmj (mgr.34412) 3824 : cluster [DBG] pgmap v2165: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:39.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:00:39 gibba015 bash[29377]: cluster 2021-03-10T15:00:38.043221+0000 mgr.gibba045.orlgmj (mgr.34412) 3825 : cluster [DBG] pgmap v2166: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:39.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:00:39 gibba015 bash[30343]: cluster 2021-03-10T15:00:38.043221+0000 mgr.gibba045.orlgmj (mgr.34412) 3825 : cluster [DBG] pgmap v2166: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:39.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:00:39 gibba045 bash[25517]: cluster 2021-03-10T15:00:38.043221+0000 mgr.gibba045.orlgmj (mgr.34412) 3825 : cluster [DBG] pgmap v2166: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:41.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:00:41 gibba015 bash[29377]: cluster 2021-03-10T15:00:40.044161+0000 mgr.gibba045.orlgmj (mgr.34412) 3826 : cluster [DBG] pgmap v2167: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:41.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:00:41 gibba015 bash[30343]: cluster 2021-03-10T15:00:40.044161+0000 mgr.gibba045.orlgmj (mgr.34412) 3826 : cluster [DBG] pgmap v2167: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:41.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:00:41 gibba045 bash[25517]: cluster 2021-03-10T15:00:40.044161+0000 mgr.gibba045.orlgmj (mgr.34412) 3826 : cluster [DBG] pgmap v2167: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:42.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:00:42 gibba015 bash[29377]: cephadm 2021-03-10T15:00:40.821525+0000 mgr.gibba045.orlgmj (mgr.34412) 3827 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:00:42.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:00:42 gibba015 bash[30343]: cephadm 2021-03-10T15:00:40.821525+0000 mgr.gibba045.orlgmj (mgr.34412) 3827 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:00:42.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:00:42 gibba045 bash[25517]: cephadm 2021-03-10T15:00:40.821525+0000 mgr.gibba045.orlgmj (mgr.34412) 3827 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:00:43.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:00:43 gibba015 bash[29377]: cluster 2021-03-10T15:00:42.045797+0000 mgr.gibba045.orlgmj (mgr.34412) 3828 : cluster [DBG] pgmap v2168: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:43.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:00:43 gibba015 bash[30343]: cluster 2021-03-10T15:00:42.045797+0000 mgr.gibba045.orlgmj (mgr.34412) 3828 : cluster [DBG] pgmap v2168: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:43.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:00:43 gibba045 bash[25517]: cluster 2021-03-10T15:00:42.045797+0000 mgr.gibba045.orlgmj (mgr.34412) 3828 : cluster [DBG] pgmap v2168: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:44.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:00:44 gibba045 bash[25517]: cluster 2021-03-10T15:00:44.046989+0000 mgr.gibba045.orlgmj (mgr.34412) 3829 : cluster [DBG] pgmap v2169: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:44.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:00:44 gibba015 bash[29377]: cluster 2021-03-10T15:00:44.046989+0000 mgr.gibba045.orlgmj (mgr.34412) 3829 : cluster [DBG] pgmap v2169: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:44.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:00:44 gibba015 bash[30343]: cluster 2021-03-10T15:00:44.046989+0000 mgr.gibba045.orlgmj (mgr.34412) 3829 : cluster [DBG] pgmap v2169: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:47.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:00:47 gibba015 bash[29377]: cluster 2021-03-10T15:00:46.048762+0000 mgr.gibba045.orlgmj (mgr.34412) 3830 : cluster [DBG] pgmap v2170: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:47.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:00:47 gibba015 bash[30343]: cluster 2021-03-10T15:00:46.048762+0000 mgr.gibba045.orlgmj (mgr.34412) 3830 : cluster [DBG] pgmap v2170: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:47.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:00:47 gibba045 bash[25517]: cluster 2021-03-10T15:00:46.048762+0000 mgr.gibba045.orlgmj (mgr.34412) 3830 : cluster [DBG] pgmap v2170: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:49.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:00:49 gibba015 bash[29377]: cluster 2021-03-10T15:00:48.050057+0000 mgr.gibba045.orlgmj (mgr.34412) 3831 : cluster [DBG] pgmap v2171: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:49.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:00:49 gibba015 bash[30343]: cluster 2021-03-10T15:00:48.050057+0000 mgr.gibba045.orlgmj (mgr.34412) 3831 : cluster [DBG] pgmap v2171: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:49.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:00:49 gibba045 bash[25517]: cluster 2021-03-10T15:00:48.050057+0000 mgr.gibba045.orlgmj (mgr.34412) 3831 : cluster [DBG] pgmap v2171: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:49.793 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:00:50.014 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:00:50.015 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (71m) 6m ago 76m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:00:50.015 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (76m) 5m ago 76m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:00:50.015 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (71m) 5m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:00:50.016 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (72m) 5m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:00:50.016 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (71m) 6m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:00:50.016 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (71m) 6m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:00:50.016 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (70m) 5m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:00:50.017 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (70m) 6m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:00:50.017 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (77m) 6m ago 77m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:00:50.017 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (77m) 5m ago 77m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:00:50.017 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (69m) 6m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:00:50.017 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (69m) 6m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:00:50.018 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (68m) 6m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:00:50.018 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (68m) 6m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:00:50.018 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (68m) 5m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:00:50.018 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (67m) 5m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:00:50.019 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (67m) 5m ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:00:50.019 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (66m) 5m ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:00:50.019 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (76m) 5m ago 77m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:00:50.019 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 5m ago 75m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:00:50.268 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:00:50.268 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:00:50.268 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:00:50.268 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:00:50.269 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:00:50.269 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:00:50.269 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:00:50.270 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:00:50.270 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:00:50.270 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:00:50.270 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:00:50.271 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:00:50.271 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:00:50.271 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:00:50.271 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:00:51.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:00:51 gibba015 bash[29377]: audit 2021-03-10T15:00:49.784201+0000 mgr.gibba045.orlgmj (mgr.34412) 3832 : audit [DBG] from='client.56614 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:00:51.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:00:51 gibba015 bash[29377]: audit 2021-03-10T15:00:50.006476+0000 mgr.gibba045.orlgmj (mgr.34412) 3833 : audit [DBG] from='client.46632 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:00:51.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:00:51 gibba015 bash[29377]: cluster 2021-03-10T15:00:50.050632+0000 mgr.gibba045.orlgmj (mgr.34412) 3834 : cluster [DBG] pgmap v2172: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:51.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:00:51 gibba015 bash[29377]: audit 2021-03-10T15:00:50.263803+0000 mon.a (mon.0) 1149 : audit [DBG] from='client.? 172.21.2.115:0/2514931519' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:00:51.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:00:51 gibba015 bash[30343]: audit 2021-03-10T15:00:49.784201+0000 mgr.gibba045.orlgmj (mgr.34412) 3832 : audit [DBG] from='client.56614 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:00:51.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:00:51 gibba015 bash[30343]: audit 2021-03-10T15:00:50.006476+0000 mgr.gibba045.orlgmj (mgr.34412) 3833 : audit [DBG] from='client.46632 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:00:51.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:00:51 gibba015 bash[30343]: cluster 2021-03-10T15:00:50.050632+0000 mgr.gibba045.orlgmj (mgr.34412) 3834 : cluster [DBG] pgmap v2172: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:51.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:00:51 gibba015 bash[30343]: audit 2021-03-10T15:00:50.263803+0000 mon.a (mon.0) 1149 : audit [DBG] from='client.? 172.21.2.115:0/2514931519' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:00:51.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:00:51 gibba045 bash[25517]: audit 2021-03-10T15:00:49.784201+0000 mgr.gibba045.orlgmj (mgr.34412) 3832 : audit [DBG] from='client.56614 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:00:51.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:00:51 gibba045 bash[25517]: audit 2021-03-10T15:00:50.006476+0000 mgr.gibba045.orlgmj (mgr.34412) 3833 : audit [DBG] from='client.46632 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:00:51.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:00:51 gibba045 bash[25517]: cluster 2021-03-10T15:00:50.050632+0000 mgr.gibba045.orlgmj (mgr.34412) 3834 : cluster [DBG] pgmap v2172: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:51.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:00:51 gibba045 bash[25517]: audit 2021-03-10T15:00:50.263803+0000 mon.a (mon.0) 1149 : audit [DBG] from='client.? 172.21.2.115:0/2514931519' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:00:53.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:00:53 gibba015 bash[29377]: cluster 2021-03-10T15:00:52.051420+0000 mgr.gibba045.orlgmj (mgr.34412) 3835 : cluster [DBG] pgmap v2173: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:53.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:00:53 gibba015 bash[29377]: audit 2021-03-10T15:00:52.940657+0000 mon.c (mon.1) 1095 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:00:53.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:00:53 gibba015 bash[29377]: audit 2021-03-10T15:00:52.941480+0000 mon.c (mon.1) 1096 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:00:53.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:00:53 gibba015 bash[29377]: audit 2021-03-10T15:00:52.941920+0000 mon.a (mon.0) 1150 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:00:53.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:00:53 gibba015 bash[29377]: audit 2021-03-10T15:00:52.943182+0000 mon.a (mon.0) 1151 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:00:53.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:00:53 gibba015 bash[29377]: audit 2021-03-10T15:00:52.949098+0000 mon.c (mon.1) 1097 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T15:00:53.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:00:53 gibba015 bash[29377]: audit 2021-03-10T15:00:52.950006+0000 mon.c (mon.1) 1098 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:00:53.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:00:53 gibba015 bash[29377]: audit 2021-03-10T15:00:52.950280+0000 mon.a (mon.0) 1152 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T15:00:53.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:00:53 gibba015 bash[29377]: audit 2021-03-10T15:00:52.950873+0000 mon.c (mon.1) 1099 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:00:53.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:00:53 gibba015 bash[29377]: audit 2021-03-10T15:00:52.951963+0000 mon.c (mon.1) 1100 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:00:53.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:00:53 gibba015 bash[29377]: audit 2021-03-10T15:00:52.952429+0000 mon.a (mon.0) 1153 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:00:53.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:00:53 gibba015 bash[29377]: audit 2021-03-10T15:00:52.953629+0000 mon.a (mon.0) 1154 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:00:53.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:00:53 gibba015 bash[29377]: audit 2021-03-10T15:00:52.954592+0000 mon.a (mon.0) 1155 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:00:53.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:00:53 gibba015 bash[30343]: cluster 2021-03-10T15:00:52.051420+0000 mgr.gibba045.orlgmj (mgr.34412) 3835 : cluster [DBG] pgmap v2173: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:53.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:00:53 gibba015 bash[30343]: audit 2021-03-10T15:00:52.940657+0000 mon.c (mon.1) 1095 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:00:53.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:00:53 gibba015 bash[30343]: audit 2021-03-10T15:00:52.941480+0000 mon.c (mon.1) 1096 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:00:53.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:00:53 gibba015 bash[30343]: audit 2021-03-10T15:00:52.941920+0000 mon.a (mon.0) 1150 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:00:53.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:00:53 gibba015 bash[30343]: audit 2021-03-10T15:00:52.943182+0000 mon.a (mon.0) 1151 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:00:53.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:00:53 gibba015 bash[30343]: audit 2021-03-10T15:00:52.949098+0000 mon.c (mon.1) 1097 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T15:00:53.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:00:53 gibba015 bash[30343]: audit 2021-03-10T15:00:52.950006+0000 mon.c (mon.1) 1098 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:00:53.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:00:53 gibba015 bash[30343]: audit 2021-03-10T15:00:52.950280+0000 mon.a (mon.0) 1152 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T15:00:53.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:00:53 gibba015 bash[30343]: audit 2021-03-10T15:00:52.950873+0000 mon.c (mon.1) 1099 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:00:53.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:00:53 gibba015 bash[30343]: audit 2021-03-10T15:00:52.951963+0000 mon.c (mon.1) 1100 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:00:53.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:00:53 gibba015 bash[30343]: audit 2021-03-10T15:00:52.952429+0000 mon.a (mon.0) 1153 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:00:53.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:00:53 gibba015 bash[30343]: audit 2021-03-10T15:00:52.953629+0000 mon.a (mon.0) 1154 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:00:53.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:00:53 gibba015 bash[30343]: audit 2021-03-10T15:00:52.954592+0000 mon.a (mon.0) 1155 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:00:53.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:00:53 gibba045 bash[25517]: cluster 2021-03-10T15:00:52.051420+0000 mgr.gibba045.orlgmj (mgr.34412) 3835 : cluster [DBG] pgmap v2173: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:53.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:00:53 gibba045 bash[25517]: audit 2021-03-10T15:00:52.940657+0000 mon.c (mon.1) 1095 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:00:53.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:00:53 gibba045 bash[25517]: audit 2021-03-10T15:00:52.941480+0000 mon.c (mon.1) 1096 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:00:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:00:53 gibba045 bash[25517]: audit 2021-03-10T15:00:52.941920+0000 mon.a (mon.0) 1150 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:00:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:00:53 gibba045 bash[25517]: audit 2021-03-10T15:00:52.943182+0000 mon.a (mon.0) 1151 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:00:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:00:53 gibba045 bash[25517]: audit 2021-03-10T15:00:52.949098+0000 mon.c (mon.1) 1097 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T15:00:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:00:53 gibba045 bash[25517]: audit 2021-03-10T15:00:52.950006+0000 mon.c (mon.1) 1098 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:00:53.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:00:53 gibba045 bash[25517]: audit 2021-03-10T15:00:52.950280+0000 mon.a (mon.0) 1152 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T15:00:53.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:00:53 gibba045 bash[25517]: audit 2021-03-10T15:00:52.950873+0000 mon.c (mon.1) 1099 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:00:53.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:00:53 gibba045 bash[25517]: audit 2021-03-10T15:00:52.951963+0000 mon.c (mon.1) 1100 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:00:53.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:00:53 gibba045 bash[25517]: audit 2021-03-10T15:00:52.952429+0000 mon.a (mon.0) 1153 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:00:53.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:00:53 gibba045 bash[25517]: audit 2021-03-10T15:00:52.953629+0000 mon.a (mon.0) 1154 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:00:53.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:00:53 gibba045 bash[25517]: audit 2021-03-10T15:00:52.954592+0000 mon.a (mon.0) 1155 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:00:54.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:00:54 gibba045 bash[25517]: cluster 2021-03-10T15:00:54.052534+0000 mgr.gibba045.orlgmj (mgr.34412) 3836 : cluster [DBG] pgmap v2174: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:54.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:00:54 gibba015 bash[29377]: cluster 2021-03-10T15:00:54.052534+0000 mgr.gibba045.orlgmj (mgr.34412) 3836 : cluster [DBG] pgmap v2174: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:54.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:00:54 gibba015 bash[30343]: cluster 2021-03-10T15:00:54.052534+0000 mgr.gibba045.orlgmj (mgr.34412) 3836 : cluster [DBG] pgmap v2174: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:57.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:00:57 gibba015 bash[29377]: cephadm 2021-03-10T15:00:55.837535+0000 mgr.gibba045.orlgmj (mgr.34412) 3837 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:00:57.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:00:57 gibba015 bash[29377]: cluster 2021-03-10T15:00:56.053978+0000 mgr.gibba045.orlgmj (mgr.34412) 3838 : cluster [DBG] pgmap v2175: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:57.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:00:57 gibba015 bash[30343]: cephadm 2021-03-10T15:00:55.837535+0000 mgr.gibba045.orlgmj (mgr.34412) 3837 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:00:57.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:00:57 gibba015 bash[30343]: cluster 2021-03-10T15:00:56.053978+0000 mgr.gibba045.orlgmj (mgr.34412) 3838 : cluster [DBG] pgmap v2175: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:57.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:00:57 gibba045 bash[25517]: cephadm 2021-03-10T15:00:55.837535+0000 mgr.gibba045.orlgmj (mgr.34412) 3837 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:00:57.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:00:57 gibba045 bash[25517]: cluster 2021-03-10T15:00:56.053978+0000 mgr.gibba045.orlgmj (mgr.34412) 3838 : cluster [DBG] pgmap v2175: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:59.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:00:59 gibba015 bash[29377]: cluster 2021-03-10T15:00:58.055671+0000 mgr.gibba045.orlgmj (mgr.34412) 3839 : cluster [DBG] pgmap v2176: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:59.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:00:59 gibba015 bash[30343]: cluster 2021-03-10T15:00:58.055671+0000 mgr.gibba045.orlgmj (mgr.34412) 3839 : cluster [DBG] pgmap v2176: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:59.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:00:59 gibba045 bash[25517]: cluster 2021-03-10T15:00:58.055671+0000 mgr.gibba045.orlgmj (mgr.34412) 3839 : cluster [DBG] pgmap v2176: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:01.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:01:01 gibba015 bash[29377]: cluster 2021-03-10T15:01:00.056448+0000 mgr.gibba045.orlgmj (mgr.34412) 3840 : cluster [DBG] pgmap v2177: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:01.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:01:01 gibba015 bash[30343]: cluster 2021-03-10T15:01:00.056448+0000 mgr.gibba045.orlgmj (mgr.34412) 3840 : cluster [DBG] pgmap v2177: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:01.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:01:01 gibba045 bash[25517]: cluster 2021-03-10T15:01:00.056448+0000 mgr.gibba045.orlgmj (mgr.34412) 3840 : cluster [DBG] pgmap v2177: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:03.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:01:03 gibba015 bash[29377]: cluster 2021-03-10T15:01:02.057798+0000 mgr.gibba045.orlgmj (mgr.34412) 3841 : cluster [DBG] pgmap v2178: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:03.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:01:03 gibba015 bash[30343]: cluster 2021-03-10T15:01:02.057798+0000 mgr.gibba045.orlgmj (mgr.34412) 3841 : cluster [DBG] pgmap v2178: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:03.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:01:03 gibba045 bash[25517]: cluster 2021-03-10T15:01:02.057798+0000 mgr.gibba045.orlgmj (mgr.34412) 3841 : cluster [DBG] pgmap v2178: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:04.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:01:04 gibba045 bash[25517]: cluster 2021-03-10T15:01:04.059030+0000 mgr.gibba045.orlgmj (mgr.34412) 3842 : cluster [DBG] pgmap v2179: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:04.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:01:04 gibba015 bash[29377]: cluster 2021-03-10T15:01:04.059030+0000 mgr.gibba045.orlgmj (mgr.34412) 3842 : cluster [DBG] pgmap v2179: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:04.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:01:04 gibba015 bash[30343]: cluster 2021-03-10T15:01:04.059030+0000 mgr.gibba045.orlgmj (mgr.34412) 3842 : cluster [DBG] pgmap v2179: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:07.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:01:07 gibba015 bash[29377]: cluster 2021-03-10T15:01:06.060676+0000 mgr.gibba045.orlgmj (mgr.34412) 3843 : cluster [DBG] pgmap v2180: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:07.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:01:07 gibba015 bash[30343]: cluster 2021-03-10T15:01:06.060676+0000 mgr.gibba045.orlgmj (mgr.34412) 3843 : cluster [DBG] pgmap v2180: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:07.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:01:07 gibba045 bash[25517]: cluster 2021-03-10T15:01:06.060676+0000 mgr.gibba045.orlgmj (mgr.34412) 3843 : cluster [DBG] pgmap v2180: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:09.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:01:09 gibba015 bash[29377]: cluster 2021-03-10T15:01:08.061333+0000 mgr.gibba045.orlgmj (mgr.34412) 3844 : cluster [DBG] pgmap v2181: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:09.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:01:09 gibba015 bash[30343]: cluster 2021-03-10T15:01:08.061333+0000 mgr.gibba045.orlgmj (mgr.34412) 3844 : cluster [DBG] pgmap v2181: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:09.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:01:09 gibba045 bash[25517]: cluster 2021-03-10T15:01:08.061333+0000 mgr.gibba045.orlgmj (mgr.34412) 3844 : cluster [DBG] pgmap v2181: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:11.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:01:11 gibba015 bash[29377]: cluster 2021-03-10T15:01:10.061935+0000 mgr.gibba045.orlgmj (mgr.34412) 3845 : cluster [DBG] pgmap v2182: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:11.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:01:11 gibba015 bash[30343]: cluster 2021-03-10T15:01:10.061935+0000 mgr.gibba045.orlgmj (mgr.34412) 3845 : cluster [DBG] pgmap v2182: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:11.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:01:11 gibba045 bash[25517]: cluster 2021-03-10T15:01:10.061935+0000 mgr.gibba045.orlgmj (mgr.34412) 3845 : cluster [DBG] pgmap v2182: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:12.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:01:12 gibba015 bash[29377]: cephadm 2021-03-10T15:01:10.853590+0000 mgr.gibba045.orlgmj (mgr.34412) 3846 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:01:12.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:01:12 gibba015 bash[30343]: cephadm 2021-03-10T15:01:10.853590+0000 mgr.gibba045.orlgmj (mgr.34412) 3846 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:01:12.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:01:12 gibba045 bash[25517]: cephadm 2021-03-10T15:01:10.853590+0000 mgr.gibba045.orlgmj (mgr.34412) 3846 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:01:13.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:01:13 gibba015 bash[29377]: cluster 2021-03-10T15:01:12.068322+0000 mgr.gibba045.orlgmj (mgr.34412) 3847 : cluster [DBG] pgmap v2183: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:13.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:01:13 gibba015 bash[30343]: cluster 2021-03-10T15:01:12.068322+0000 mgr.gibba045.orlgmj (mgr.34412) 3847 : cluster [DBG] pgmap v2183: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:13.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:01:13 gibba045 bash[25517]: cluster 2021-03-10T15:01:12.068322+0000 mgr.gibba045.orlgmj (mgr.34412) 3847 : cluster [DBG] pgmap v2183: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:14.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:01:14 gibba045 bash[25517]: cluster 2021-03-10T15:01:14.069432+0000 mgr.gibba045.orlgmj (mgr.34412) 3848 : cluster [DBG] pgmap v2184: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:14.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:01:14 gibba015 bash[29377]: cluster 2021-03-10T15:01:14.069432+0000 mgr.gibba045.orlgmj (mgr.34412) 3848 : cluster [DBG] pgmap v2184: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:14.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:01:14 gibba015 bash[30343]: cluster 2021-03-10T15:01:14.069432+0000 mgr.gibba045.orlgmj (mgr.34412) 3848 : cluster [DBG] pgmap v2184: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:17.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:01:17 gibba015 bash[29377]: cluster 2021-03-10T15:01:16.070426+0000 mgr.gibba045.orlgmj (mgr.34412) 3849 : cluster [DBG] pgmap v2185: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:17.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:01:17 gibba015 bash[30343]: cluster 2021-03-10T15:01:16.070426+0000 mgr.gibba045.orlgmj (mgr.34412) 3849 : cluster [DBG] pgmap v2185: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:17.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:01:17 gibba045 bash[25517]: cluster 2021-03-10T15:01:16.070426+0000 mgr.gibba045.orlgmj (mgr.34412) 3849 : cluster [DBG] pgmap v2185: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:19.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:01:19 gibba015 bash[29377]: cluster 2021-03-10T15:01:18.071947+0000 mgr.gibba045.orlgmj (mgr.34412) 3850 : cluster [DBG] pgmap v2186: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:19.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:01:19 gibba015 bash[30343]: cluster 2021-03-10T15:01:18.071947+0000 mgr.gibba045.orlgmj (mgr.34412) 3850 : cluster [DBG] pgmap v2186: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:19.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:01:19 gibba045 bash[25517]: cluster 2021-03-10T15:01:18.071947+0000 mgr.gibba045.orlgmj (mgr.34412) 3850 : cluster [DBG] pgmap v2186: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:20.510 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:01:20.736 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:01:20.737 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (72m) 7m ago 77m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:01:20.737 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (77m) 5m ago 77m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:01:20.737 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (72m) 5m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:01:20.737 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (72m) 5m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:01:20.738 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (71m) 7m ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:01:20.738 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (71m) 7m ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:01:20.738 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (71m) 5m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:01:20.738 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (71m) 7m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:01:20.739 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (77m) 7m ago 77m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:01:20.739 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (77m) 5m ago 77m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:01:20.739 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (70m) 7m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:01:20.739 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (69m) 7m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:01:20.740 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (69m) 7m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:01:20.740 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (69m) 7m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:01:20.740 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (68m) 5m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:01:20.740 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (68m) 5m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:01:20.741 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (67m) 5m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:01:20.741 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (67m) 5m ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:01:20.741 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (76m) 5m ago 77m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:01:20.741 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 5m ago 75m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:01:20.984 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:01:20.984 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:01:20.984 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:01:20.985 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:01:20.985 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:01:20.985 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:01:20.985 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:01:20.986 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:01:20.986 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:01:20.986 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:01:20.986 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:01:20.987 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:01:20.987 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:01:20.987 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:01:20.987 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:01:21.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:01:21 gibba015 bash[29377]: cluster 2021-03-10T15:01:20.072984+0000 mgr.gibba045.orlgmj (mgr.34412) 3851 : cluster [DBG] pgmap v2187: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:21.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:01:21 gibba015 bash[29377]: audit 2021-03-10T15:01:20.980011+0000 mon.a (mon.0) 1156 : audit [DBG] from='client.? 172.21.2.115:0/2802442700' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:01:21.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:01:21 gibba015 bash[30343]: cluster 2021-03-10T15:01:20.072984+0000 mgr.gibba045.orlgmj (mgr.34412) 3851 : cluster [DBG] pgmap v2187: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:21.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:01:21 gibba015 bash[30343]: audit 2021-03-10T15:01:20.980011+0000 mon.a (mon.0) 1156 : audit [DBG] from='client.? 172.21.2.115:0/2802442700' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:01:21.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:01:21 gibba045 bash[25517]: cluster 2021-03-10T15:01:20.072984+0000 mgr.gibba045.orlgmj (mgr.34412) 3851 : cluster [DBG] pgmap v2187: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:21.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:01:21 gibba045 bash[25517]: audit 2021-03-10T15:01:20.980011+0000 mon.a (mon.0) 1156 : audit [DBG] from='client.? 172.21.2.115:0/2802442700' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:01:22.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:01:22 gibba015 bash[29377]: audit 2021-03-10T15:01:20.500864+0000 mgr.gibba045.orlgmj (mgr.34412) 3852 : audit [DBG] from='client.46644 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:01:22.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:01:22 gibba015 bash[29377]: audit 2021-03-10T15:01:20.723800+0000 mgr.gibba045.orlgmj (mgr.34412) 3853 : audit [DBG] from='client.56638 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:01:22.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:01:22 gibba015 bash[30343]: audit 2021-03-10T15:01:20.500864+0000 mgr.gibba045.orlgmj (mgr.34412) 3852 : audit [DBG] from='client.46644 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:01:22.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:01:22 gibba015 bash[30343]: audit 2021-03-10T15:01:20.723800+0000 mgr.gibba045.orlgmj (mgr.34412) 3853 : audit [DBG] from='client.56638 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:01:22.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:01:22 gibba045 bash[25517]: audit 2021-03-10T15:01:20.500864+0000 mgr.gibba045.orlgmj (mgr.34412) 3852 : audit [DBG] from='client.46644 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:01:22.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:01:22 gibba045 bash[25517]: audit 2021-03-10T15:01:20.723800+0000 mgr.gibba045.orlgmj (mgr.34412) 3853 : audit [DBG] from='client.56638 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:01:23.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:01:23 gibba015 bash[29377]: cluster 2021-03-10T15:01:22.073795+0000 mgr.gibba045.orlgmj (mgr.34412) 3854 : cluster [DBG] pgmap v2188: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:23.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:01:23 gibba015 bash[30343]: cluster 2021-03-10T15:01:22.073795+0000 mgr.gibba045.orlgmj (mgr.34412) 3854 : cluster [DBG] pgmap v2188: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:23.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:01:23 gibba045 bash[25517]: cluster 2021-03-10T15:01:22.073795+0000 mgr.gibba045.orlgmj (mgr.34412) 3854 : cluster [DBG] pgmap v2188: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:24.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:01:24 gibba045 bash[25517]: cluster 2021-03-10T15:01:24.074399+0000 mgr.gibba045.orlgmj (mgr.34412) 3855 : cluster [DBG] pgmap v2189: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:24.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:01:24 gibba015 bash[29377]: cluster 2021-03-10T15:01:24.074399+0000 mgr.gibba045.orlgmj (mgr.34412) 3855 : cluster [DBG] pgmap v2189: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:24.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:01:24 gibba015 bash[30343]: cluster 2021-03-10T15:01:24.074399+0000 mgr.gibba045.orlgmj (mgr.34412) 3855 : cluster [DBG] pgmap v2189: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:26.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:01:25 gibba015 bash[29377]: audit 2021-03-10T15:01:25.858537+0000 mon.c (mon.1) 1101 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:01:26.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:01:25 gibba015 bash[30343]: audit 2021-03-10T15:01:25.858537+0000 mon.c (mon.1) 1101 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:01:26.287 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:01:25 gibba045 bash[25517]: audit 2021-03-10T15:01:25.858537+0000 mon.c (mon.1) 1101 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:01:27.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:01:27 gibba015 bash[29377]: audit 2021-03-10T15:01:26.065468+0000 mon.a (mon.0) 1157 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:01:27.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:01:27 gibba015 bash[29377]: cephadm 2021-03-10T15:01:26.070275+0000 mgr.gibba045.orlgmj (mgr.34412) 3856 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:01:27.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:01:27 gibba015 bash[29377]: audit 2021-03-10T15:01:26.074153+0000 mon.a (mon.0) 1158 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:01:27.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:01:27 gibba015 bash[29377]: cluster 2021-03-10T15:01:26.074845+0000 mgr.gibba045.orlgmj (mgr.34412) 3857 : cluster [DBG] pgmap v2190: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:27.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:01:27 gibba015 bash[29377]: cephadm 2021-03-10T15:01:26.078696+0000 mgr.gibba045.orlgmj (mgr.34412) 3858 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:01:27.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:01:27 gibba015 bash[29377]: audit 2021-03-10T15:01:26.271962+0000 mon.a (mon.0) 1159 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:01:27.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:01:27 gibba015 bash[29377]: audit 2021-03-10T15:01:26.275584+0000 mon.c (mon.1) 1102 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:01:27.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:01:27 gibba015 bash[29377]: audit 2021-03-10T15:01:26.276761+0000 mon.c (mon.1) 1103 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:01:27.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:01:27 gibba015 bash[29377]: audit 2021-03-10T15:01:26.278028+0000 mon.c (mon.1) 1104 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:01:27.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:01:27 gibba015 bash[29377]: cephadm 2021-03-10T15:01:26.278375+0000 mgr.gibba045.orlgmj (mgr.34412) 3859 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:01:27.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:01:27 gibba015 bash[29377]: audit 2021-03-10T15:01:26.279082+0000 mon.c (mon.1) 1105 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:01:27.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:01:27 gibba015 bash[29377]: cephadm 2021-03-10T15:01:26.279875+0000 mgr.gibba045.orlgmj (mgr.34412) 3860 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:01:27.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:01:27 gibba015 bash[29377]: cephadm 2021-03-10T15:01:26.281060+0000 mgr.gibba045.orlgmj (mgr.34412) 3861 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:01:27.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:01:27 gibba015 bash[29377]: cephadm 2021-03-10T15:01:26.281099+0000 mgr.gibba045.orlgmj (mgr.34412) 3862 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:01:27.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:01:27 gibba015 bash[29377]: audit 2021-03-10T15:01:26.281704+0000 mon.c (mon.1) 1106 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:01:27.479 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:01:27 gibba015 bash[29377]: cephadm 2021-03-10T15:01:26.282192+0000 mgr.gibba045.orlgmj (mgr.34412) 3863 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:01:27.479 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:01:27 gibba015 bash[29377]: cephadm 2021-03-10T15:01:26.282231+0000 mgr.gibba045.orlgmj (mgr.34412) 3864 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:01:27.479 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:01:27 gibba015 bash[29377]: audit 2021-03-10T15:01:26.283083+0000 mon.c (mon.1) 1107 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:01:27.479 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:01:27 gibba015 bash[29377]: cephadm 2021-03-10T15:01:26.283204+0000 mgr.gibba045.orlgmj (mgr.34412) 3865 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:01:27.480 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:01:27 gibba015 bash[29377]: cephadm 2021-03-10T15:01:26.284566+0000 mgr.gibba045.orlgmj (mgr.34412) 3866 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:01:27.480 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:01:27 gibba015 bash[29377]: cephadm 2021-03-10T15:01:26.284605+0000 mgr.gibba045.orlgmj (mgr.34412) 3867 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:01:27.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:01:27 gibba015 bash[30343]: audit 2021-03-10T15:01:26.065468+0000 mon.a (mon.0) 1157 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:01:27.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:01:27 gibba015 bash[30343]: cephadm 2021-03-10T15:01:26.070275+0000 mgr.gibba045.orlgmj (mgr.34412) 3856 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:01:27.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:01:27 gibba015 bash[30343]: audit 2021-03-10T15:01:26.074153+0000 mon.a (mon.0) 1158 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:01:27.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:01:27 gibba015 bash[30343]: cluster 2021-03-10T15:01:26.074845+0000 mgr.gibba045.orlgmj (mgr.34412) 3857 : cluster [DBG] pgmap v2190: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:27.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:01:27 gibba015 bash[30343]: cephadm 2021-03-10T15:01:26.078696+0000 mgr.gibba045.orlgmj (mgr.34412) 3858 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:01:27.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:01:27 gibba015 bash[30343]: audit 2021-03-10T15:01:26.271962+0000 mon.a (mon.0) 1159 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:01:27.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:01:27 gibba015 bash[30343]: audit 2021-03-10T15:01:26.275584+0000 mon.c (mon.1) 1102 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:01:27.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:01:27 gibba015 bash[30343]: audit 2021-03-10T15:01:26.276761+0000 mon.c (mon.1) 1103 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:01:27.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:01:27 gibba015 bash[30343]: audit 2021-03-10T15:01:26.278028+0000 mon.c (mon.1) 1104 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:01:27.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:01:27 gibba015 bash[30343]: cephadm 2021-03-10T15:01:26.278375+0000 mgr.gibba045.orlgmj (mgr.34412) 3859 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:01:27.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:01:27 gibba015 bash[30343]: audit 2021-03-10T15:01:26.279082+0000 mon.c (mon.1) 1105 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:01:27.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:01:27 gibba015 bash[30343]: cephadm 2021-03-10T15:01:26.279875+0000 mgr.gibba045.orlgmj (mgr.34412) 3860 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:01:27.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:01:27 gibba015 bash[30343]: cephadm 2021-03-10T15:01:26.281060+0000 mgr.gibba045.orlgmj (mgr.34412) 3861 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:01:27.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:01:27 gibba015 bash[30343]: cephadm 2021-03-10T15:01:26.281099+0000 mgr.gibba045.orlgmj (mgr.34412) 3862 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:01:27.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:01:27 gibba015 bash[30343]: audit 2021-03-10T15:01:26.281704+0000 mon.c (mon.1) 1106 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:01:27.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:01:27 gibba015 bash[30343]: cephadm 2021-03-10T15:01:26.282192+0000 mgr.gibba045.orlgmj (mgr.34412) 3863 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:01:27.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:01:27 gibba015 bash[30343]: cephadm 2021-03-10T15:01:26.282231+0000 mgr.gibba045.orlgmj (mgr.34412) 3864 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:01:27.485 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:01:27 gibba015 bash[30343]: audit 2021-03-10T15:01:26.283083+0000 mon.c (mon.1) 1107 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:01:27.485 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:01:27 gibba015 bash[30343]: cephadm 2021-03-10T15:01:26.283204+0000 mgr.gibba045.orlgmj (mgr.34412) 3865 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:01:27.485 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:01:27 gibba015 bash[30343]: cephadm 2021-03-10T15:01:26.284566+0000 mgr.gibba045.orlgmj (mgr.34412) 3866 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:01:27.485 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:01:27 gibba015 bash[30343]: cephadm 2021-03-10T15:01:26.284605+0000 mgr.gibba045.orlgmj (mgr.34412) 3867 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:01:27.486 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:01:27 gibba015 bash[29377]: cephadm 2021-03-10T15:01:26.285871+0000 mgr.gibba045.orlgmj (mgr.34412) 3868 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:01:27.486 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:01:27 gibba015 bash[29377]: cephadm 2021-03-10T15:01:26.286185+0000 mgr.gibba045.orlgmj (mgr.34412) 3869 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:01:27.486 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:01:27 gibba015 bash[29377]: cephadm 2021-03-10T15:01:26.287271+0000 mgr.gibba045.orlgmj (mgr.34412) 3870 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:01:27.487 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:01:27 gibba015 bash[29377]: cephadm 2021-03-10T15:01:26.287310+0000 mgr.gibba045.orlgmj (mgr.34412) 3871 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:01:27.487 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:01:27 gibba015 bash[29377]: cephadm 2021-03-10T15:01:26.287416+0000 mgr.gibba045.orlgmj (mgr.34412) 3872 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:01:27.487 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:01:27 gibba015 bash[30343]: cephadm 2021-03-10T15:01:26.285871+0000 mgr.gibba045.orlgmj (mgr.34412) 3868 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:01:27.487 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:01:27 gibba015 bash[30343]: cephadm 2021-03-10T15:01:26.286185+0000 mgr.gibba045.orlgmj (mgr.34412) 3869 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:01:27.488 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:01:27 gibba015 bash[30343]: cephadm 2021-03-10T15:01:26.287271+0000 mgr.gibba045.orlgmj (mgr.34412) 3870 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:01:27.488 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:01:27 gibba015 bash[30343]: cephadm 2021-03-10T15:01:26.287310+0000 mgr.gibba045.orlgmj (mgr.34412) 3871 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:01:27.488 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:01:27 gibba015 bash[30343]: cephadm 2021-03-10T15:01:26.287416+0000 mgr.gibba045.orlgmj (mgr.34412) 3872 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:01:27.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:01:27 gibba045 bash[25517]: audit 2021-03-10T15:01:26.065468+0000 mon.a (mon.0) 1157 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:01:27.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:01:27 gibba045 bash[25517]: cephadm 2021-03-10T15:01:26.070275+0000 mgr.gibba045.orlgmj (mgr.34412) 3856 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:01:27.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:01:27 gibba045 bash[25517]: audit 2021-03-10T15:01:26.074153+0000 mon.a (mon.0) 1158 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:01:27.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:01:27 gibba045 bash[25517]: cluster 2021-03-10T15:01:26.074845+0000 mgr.gibba045.orlgmj (mgr.34412) 3857 : cluster [DBG] pgmap v2190: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:27.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:01:27 gibba045 bash[25517]: cephadm 2021-03-10T15:01:26.078696+0000 mgr.gibba045.orlgmj (mgr.34412) 3858 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:01:27.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:01:27 gibba045 bash[25517]: audit 2021-03-10T15:01:26.271962+0000 mon.a (mon.0) 1159 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:01:27.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:01:27 gibba045 bash[25517]: audit 2021-03-10T15:01:26.275584+0000 mon.c (mon.1) 1102 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:01:27.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:01:27 gibba045 bash[25517]: audit 2021-03-10T15:01:26.276761+0000 mon.c (mon.1) 1103 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:01:27.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:01:27 gibba045 bash[25517]: audit 2021-03-10T15:01:26.278028+0000 mon.c (mon.1) 1104 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:01:27.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:01:27 gibba045 bash[25517]: cephadm 2021-03-10T15:01:26.278375+0000 mgr.gibba045.orlgmj (mgr.34412) 3859 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:01:27.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:01:27 gibba045 bash[25517]: audit 2021-03-10T15:01:26.279082+0000 mon.c (mon.1) 1105 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:01:27.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:01:27 gibba045 bash[25517]: cephadm 2021-03-10T15:01:26.279875+0000 mgr.gibba045.orlgmj (mgr.34412) 3860 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:01:27.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:01:27 gibba045 bash[25517]: cephadm 2021-03-10T15:01:26.281060+0000 mgr.gibba045.orlgmj (mgr.34412) 3861 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:01:27.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:01:27 gibba045 bash[25517]: cephadm 2021-03-10T15:01:26.281099+0000 mgr.gibba045.orlgmj (mgr.34412) 3862 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:01:27.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:01:27 gibba045 bash[25517]: audit 2021-03-10T15:01:26.281704+0000 mon.c (mon.1) 1106 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:01:27.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:01:27 gibba045 bash[25517]: cephadm 2021-03-10T15:01:26.282192+0000 mgr.gibba045.orlgmj (mgr.34412) 3863 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:01:27.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:01:27 gibba045 bash[25517]: cephadm 2021-03-10T15:01:26.282231+0000 mgr.gibba045.orlgmj (mgr.34412) 3864 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:01:27.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:01:27 gibba045 bash[25517]: audit 2021-03-10T15:01:26.283083+0000 mon.c (mon.1) 1107 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:01:27.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:01:27 gibba045 bash[25517]: cephadm 2021-03-10T15:01:26.283204+0000 mgr.gibba045.orlgmj (mgr.34412) 3865 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:01:27.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:01:27 gibba045 bash[25517]: cephadm 2021-03-10T15:01:26.284566+0000 mgr.gibba045.orlgmj (mgr.34412) 3866 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:01:27.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:01:27 gibba045 bash[25517]: cephadm 2021-03-10T15:01:26.284605+0000 mgr.gibba045.orlgmj (mgr.34412) 3867 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:01:27.563 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:01:27 gibba045 bash[25517]: cephadm 2021-03-10T15:01:26.285871+0000 mgr.gibba045.orlgmj (mgr.34412) 3868 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:01:27.563 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:01:27 gibba045 bash[25517]: cephadm 2021-03-10T15:01:26.286185+0000 mgr.gibba045.orlgmj (mgr.34412) 3869 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:01:27.563 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:01:27 gibba045 bash[25517]: cephadm 2021-03-10T15:01:26.287271+0000 mgr.gibba045.orlgmj (mgr.34412) 3870 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:01:27.563 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:01:27 gibba045 bash[25517]: cephadm 2021-03-10T15:01:26.287310+0000 mgr.gibba045.orlgmj (mgr.34412) 3871 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:01:27.564 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:01:27 gibba045 bash[25517]: cephadm 2021-03-10T15:01:26.287416+0000 mgr.gibba045.orlgmj (mgr.34412) 3872 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:01:29.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:01:29 gibba015 bash[29377]: cluster 2021-03-10T15:01:28.076082+0000 mgr.gibba045.orlgmj (mgr.34412) 3873 : cluster [DBG] pgmap v2191: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:29.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:01:29 gibba015 bash[30343]: cluster 2021-03-10T15:01:28.076082+0000 mgr.gibba045.orlgmj (mgr.34412) 3873 : cluster [DBG] pgmap v2191: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:29.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:01:29 gibba045 bash[25517]: cluster 2021-03-10T15:01:28.076082+0000 mgr.gibba045.orlgmj (mgr.34412) 3873 : cluster [DBG] pgmap v2191: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:31.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:01:31 gibba015 bash[29377]: cluster 2021-03-10T15:01:30.076815+0000 mgr.gibba045.orlgmj (mgr.34412) 3874 : cluster [DBG] pgmap v2192: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:31.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:01:31 gibba015 bash[30343]: cluster 2021-03-10T15:01:30.076815+0000 mgr.gibba045.orlgmj (mgr.34412) 3874 : cluster [DBG] pgmap v2192: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:31.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:01:31 gibba045 bash[25517]: cluster 2021-03-10T15:01:30.076815+0000 mgr.gibba045.orlgmj (mgr.34412) 3874 : cluster [DBG] pgmap v2192: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:33.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:01:33 gibba015 bash[29377]: cluster 2021-03-10T15:01:32.077690+0000 mgr.gibba045.orlgmj (mgr.34412) 3875 : cluster [DBG] pgmap v2193: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:33.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:01:33 gibba015 bash[30343]: cluster 2021-03-10T15:01:32.077690+0000 mgr.gibba045.orlgmj (mgr.34412) 3875 : cluster [DBG] pgmap v2193: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:33.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:01:33 gibba045 bash[25517]: cluster 2021-03-10T15:01:32.077690+0000 mgr.gibba045.orlgmj (mgr.34412) 3875 : cluster [DBG] pgmap v2193: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:34.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:01:34 gibba045 bash[25517]: cluster 2021-03-10T15:01:34.078788+0000 mgr.gibba045.orlgmj (mgr.34412) 3876 : cluster [DBG] pgmap v2194: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:34.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:01:34 gibba015 bash[29377]: cluster 2021-03-10T15:01:34.078788+0000 mgr.gibba045.orlgmj (mgr.34412) 3876 : cluster [DBG] pgmap v2194: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:34.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:01:34 gibba015 bash[30343]: cluster 2021-03-10T15:01:34.078788+0000 mgr.gibba045.orlgmj (mgr.34412) 3876 : cluster [DBG] pgmap v2194: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:37.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:01:37 gibba015 bash[29377]: cluster 2021-03-10T15:01:36.080404+0000 mgr.gibba045.orlgmj (mgr.34412) 3877 : cluster [DBG] pgmap v2195: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:37.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:01:37 gibba015 bash[30343]: cluster 2021-03-10T15:01:36.080404+0000 mgr.gibba045.orlgmj (mgr.34412) 3877 : cluster [DBG] pgmap v2195: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:37.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:01:37 gibba045 bash[25517]: cluster 2021-03-10T15:01:36.080404+0000 mgr.gibba045.orlgmj (mgr.34412) 3877 : cluster [DBG] pgmap v2195: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:39.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:01:39 gibba015 bash[29377]: cluster 2021-03-10T15:01:38.081901+0000 mgr.gibba045.orlgmj (mgr.34412) 3878 : cluster [DBG] pgmap v2196: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:39.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:01:39 gibba015 bash[30343]: cluster 2021-03-10T15:01:38.081901+0000 mgr.gibba045.orlgmj (mgr.34412) 3878 : cluster [DBG] pgmap v2196: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:39.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:01:39 gibba045 bash[25517]: cluster 2021-03-10T15:01:38.081901+0000 mgr.gibba045.orlgmj (mgr.34412) 3878 : cluster [DBG] pgmap v2196: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:41.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:01:41 gibba015 bash[29377]: cluster 2021-03-10T15:01:40.082870+0000 mgr.gibba045.orlgmj (mgr.34412) 3879 : cluster [DBG] pgmap v2197: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:41.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:01:41 gibba015 bash[30343]: cluster 2021-03-10T15:01:40.082870+0000 mgr.gibba045.orlgmj (mgr.34412) 3879 : cluster [DBG] pgmap v2197: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:41.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:01:41 gibba045 bash[25517]: cluster 2021-03-10T15:01:40.082870+0000 mgr.gibba045.orlgmj (mgr.34412) 3879 : cluster [DBG] pgmap v2197: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:42.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:01:42 gibba015 bash[29377]: cephadm 2021-03-10T15:01:41.289701+0000 mgr.gibba045.orlgmj (mgr.34412) 3880 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:01:42.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:01:42 gibba015 bash[30343]: cephadm 2021-03-10T15:01:41.289701+0000 mgr.gibba045.orlgmj (mgr.34412) 3880 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:01:42.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:01:42 gibba045 bash[25517]: cephadm 2021-03-10T15:01:41.289701+0000 mgr.gibba045.orlgmj (mgr.34412) 3880 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:01:43.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:01:43 gibba015 bash[29377]: cluster 2021-03-10T15:01:42.083735+0000 mgr.gibba045.orlgmj (mgr.34412) 3881 : cluster [DBG] pgmap v2198: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:43.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:01:43 gibba015 bash[30343]: cluster 2021-03-10T15:01:42.083735+0000 mgr.gibba045.orlgmj (mgr.34412) 3881 : cluster [DBG] pgmap v2198: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:43.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:01:43 gibba045 bash[25517]: cluster 2021-03-10T15:01:42.083735+0000 mgr.gibba045.orlgmj (mgr.34412) 3881 : cluster [DBG] pgmap v2198: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:44.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:01:44 gibba045 bash[25517]: cluster 2021-03-10T15:01:44.084881+0000 mgr.gibba045.orlgmj (mgr.34412) 3882 : cluster [DBG] pgmap v2199: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:44.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:01:44 gibba015 bash[29377]: cluster 2021-03-10T15:01:44.084881+0000 mgr.gibba045.orlgmj (mgr.34412) 3882 : cluster [DBG] pgmap v2199: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:44.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:01:44 gibba015 bash[30343]: cluster 2021-03-10T15:01:44.084881+0000 mgr.gibba045.orlgmj (mgr.34412) 3882 : cluster [DBG] pgmap v2199: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:47.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:01:47 gibba015 bash[29377]: cluster 2021-03-10T15:01:46.086384+0000 mgr.gibba045.orlgmj (mgr.34412) 3883 : cluster [DBG] pgmap v2200: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:47.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:01:47 gibba015 bash[30343]: cluster 2021-03-10T15:01:46.086384+0000 mgr.gibba045.orlgmj (mgr.34412) 3883 : cluster [DBG] pgmap v2200: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:47.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:01:47 gibba045 bash[25517]: cluster 2021-03-10T15:01:46.086384+0000 mgr.gibba045.orlgmj (mgr.34412) 3883 : cluster [DBG] pgmap v2200: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:49.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:01:49 gibba015 bash[29377]: cluster 2021-03-10T15:01:48.087366+0000 mgr.gibba045.orlgmj (mgr.34412) 3884 : cluster [DBG] pgmap v2201: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:49.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:01:49 gibba015 bash[30343]: cluster 2021-03-10T15:01:48.087366+0000 mgr.gibba045.orlgmj (mgr.34412) 3884 : cluster [DBG] pgmap v2201: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:49.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:01:49 gibba045 bash[25517]: cluster 2021-03-10T15:01:48.087366+0000 mgr.gibba045.orlgmj (mgr.34412) 3884 : cluster [DBG] pgmap v2201: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:51.231 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:01:51.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:01:51 gibba015 bash[29377]: cluster 2021-03-10T15:01:50.088084+0000 mgr.gibba045.orlgmj (mgr.34412) 3885 : cluster [DBG] pgmap v2202: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:51.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:01:51 gibba015 bash[30343]: cluster 2021-03-10T15:01:50.088084+0000 mgr.gibba045.orlgmj (mgr.34412) 3885 : cluster [DBG] pgmap v2202: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:51.486 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:01:51.487 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (72m) 7m ago 77m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:01:51.487 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (77m) 6m ago 77m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:01:51.488 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (73m) 6m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:01:51.488 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (73m) 6m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:01:51.488 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (72m) 7m ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:01:51.489 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (72m) 7m ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:01:51.489 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (71m) 6m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:01:51.490 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (71m) 7m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:01:51.490 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (78m) 7m ago 78m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:01:51.491 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (78m) 6m ago 78m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:01:51.491 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (70m) 7m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:01:51.492 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (70m) 7m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:01:51.492 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (70m) 7m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:01:51.492 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (69m) 7m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:01:51.493 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (69m) 6m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:01:51.493 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (68m) 6m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:01:51.494 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (68m) 6m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:01:51.494 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (67m) 6m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:01:51.495 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (77m) 6m ago 78m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:01:51.495 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 6m ago 76m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:01:51.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:01:51 gibba045 bash[25517]: cluster 2021-03-10T15:01:50.088084+0000 mgr.gibba045.orlgmj (mgr.34412) 3885 : cluster [DBG] pgmap v2202: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:51.742 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:01:51.743 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:01:51.743 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:01:51.743 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:01:51.744 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:01:51.744 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:01:51.744 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:01:51.744 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:01:51.744 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:01:51.745 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:01:51.745 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:01:51.745 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:01:51.745 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:01:51.746 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:01:51.746 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:01:52.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:01:52 gibba015 bash[29377]: audit 2021-03-10T15:01:51.222105+0000 mgr.gibba045.orlgmj (mgr.34412) 3886 : audit [DBG] from='client.46662 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:01:52.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:01:52 gibba015 bash[29377]: audit 2021-03-10T15:01:51.738785+0000 mon.c (mon.1) 1108 : audit [DBG] from='client.? 172.21.2.115:0/3440591984' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:01:52.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:01:52 gibba015 bash[30343]: audit 2021-03-10T15:01:51.222105+0000 mgr.gibba045.orlgmj (mgr.34412) 3886 : audit [DBG] from='client.46662 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:01:52.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:01:52 gibba015 bash[30343]: audit 2021-03-10T15:01:51.738785+0000 mon.c (mon.1) 1108 : audit [DBG] from='client.? 172.21.2.115:0/3440591984' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:01:52.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:01:52 gibba045 bash[25517]: audit 2021-03-10T15:01:51.222105+0000 mgr.gibba045.orlgmj (mgr.34412) 3886 : audit [DBG] from='client.46662 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:01:52.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:01:52 gibba045 bash[25517]: audit 2021-03-10T15:01:51.738785+0000 mon.c (mon.1) 1108 : audit [DBG] from='client.? 172.21.2.115:0/3440591984' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:01:53.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:01:53 gibba015 bash[29377]: audit 2021-03-10T15:01:51.445570+0000 mgr.gibba045.orlgmj (mgr.34412) 3887 : audit [DBG] from='client.56656 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:01:53.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:01:53 gibba015 bash[29377]: cluster 2021-03-10T15:01:52.088851+0000 mgr.gibba045.orlgmj (mgr.34412) 3888 : cluster [DBG] pgmap v2203: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:53.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:01:53 gibba015 bash[29377]: audit 2021-03-10T15:01:52.949000+0000 mon.c (mon.1) 1109 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:01:53.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:01:53 gibba015 bash[29377]: audit 2021-03-10T15:01:52.949662+0000 mon.c (mon.1) 1110 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:01:53.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:01:53 gibba015 bash[29377]: audit 2021-03-10T15:01:52.950465+0000 mon.a (mon.0) 1160 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:01:53.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:01:53 gibba015 bash[29377]: audit 2021-03-10T15:01:52.951360+0000 mon.a (mon.0) 1161 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:01:53.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:01:53 gibba015 bash[29377]: audit 2021-03-10T15:01:52.955765+0000 mon.c (mon.1) 1111 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T15:01:53.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:01:53 gibba015 bash[29377]: audit 2021-03-10T15:01:52.956461+0000 mon.c (mon.1) 1112 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:01:53.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:01:53 gibba015 bash[29377]: audit 2021-03-10T15:01:52.956916+0000 mon.a (mon.0) 1162 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T15:01:53.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:01:53 gibba015 bash[29377]: audit 2021-03-10T15:01:52.957165+0000 mon.c (mon.1) 1113 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:01:53.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:01:53 gibba015 bash[29377]: audit 2021-03-10T15:01:52.957977+0000 mon.c (mon.1) 1114 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:01:53.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:01:53 gibba015 bash[29377]: audit 2021-03-10T15:01:52.958460+0000 mon.a (mon.0) 1163 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:01:53.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:01:53 gibba015 bash[29377]: audit 2021-03-10T15:01:52.959469+0000 mon.a (mon.0) 1164 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:01:53.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:01:53 gibba015 bash[29377]: audit 2021-03-10T15:01:52.960353+0000 mon.a (mon.0) 1165 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:01:53.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:01:53 gibba015 bash[30343]: audit 2021-03-10T15:01:51.445570+0000 mgr.gibba045.orlgmj (mgr.34412) 3887 : audit [DBG] from='client.56656 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:01:53.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:01:53 gibba015 bash[30343]: cluster 2021-03-10T15:01:52.088851+0000 mgr.gibba045.orlgmj (mgr.34412) 3888 : cluster [DBG] pgmap v2203: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:53.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:01:53 gibba015 bash[30343]: audit 2021-03-10T15:01:52.949000+0000 mon.c (mon.1) 1109 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:01:53.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:01:53 gibba015 bash[30343]: audit 2021-03-10T15:01:52.949662+0000 mon.c (mon.1) 1110 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:01:53.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:01:53 gibba015 bash[30343]: audit 2021-03-10T15:01:52.950465+0000 mon.a (mon.0) 1160 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:01:53.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:01:53 gibba015 bash[30343]: audit 2021-03-10T15:01:52.951360+0000 mon.a (mon.0) 1161 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:01:53.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:01:53 gibba015 bash[30343]: audit 2021-03-10T15:01:52.955765+0000 mon.c (mon.1) 1111 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T15:01:53.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:01:53 gibba015 bash[30343]: audit 2021-03-10T15:01:52.956461+0000 mon.c (mon.1) 1112 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:01:53.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:01:53 gibba015 bash[30343]: audit 2021-03-10T15:01:52.956916+0000 mon.a (mon.0) 1162 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T15:01:53.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:01:53 gibba015 bash[30343]: audit 2021-03-10T15:01:52.957165+0000 mon.c (mon.1) 1113 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:01:53.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:01:53 gibba015 bash[30343]: audit 2021-03-10T15:01:52.957977+0000 mon.c (mon.1) 1114 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:01:53.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:01:53 gibba015 bash[30343]: audit 2021-03-10T15:01:52.958460+0000 mon.a (mon.0) 1163 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:01:53.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:01:53 gibba015 bash[30343]: audit 2021-03-10T15:01:52.959469+0000 mon.a (mon.0) 1164 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:01:53.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:01:53 gibba015 bash[30343]: audit 2021-03-10T15:01:52.960353+0000 mon.a (mon.0) 1165 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:01:53.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:01:53 gibba045 bash[25517]: audit 2021-03-10T15:01:51.445570+0000 mgr.gibba045.orlgmj (mgr.34412) 3887 : audit [DBG] from='client.56656 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:01:53.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:01:53 gibba045 bash[25517]: cluster 2021-03-10T15:01:52.088851+0000 mgr.gibba045.orlgmj (mgr.34412) 3888 : cluster [DBG] pgmap v2203: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:53.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:01:53 gibba045 bash[25517]: audit 2021-03-10T15:01:52.949000+0000 mon.c (mon.1) 1109 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:01:53.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:01:53 gibba045 bash[25517]: audit 2021-03-10T15:01:52.949662+0000 mon.c (mon.1) 1110 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:01:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:01:53 gibba045 bash[25517]: audit 2021-03-10T15:01:52.950465+0000 mon.a (mon.0) 1160 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:01:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:01:53 gibba045 bash[25517]: audit 2021-03-10T15:01:52.951360+0000 mon.a (mon.0) 1161 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:01:53.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:01:53 gibba045 bash[25517]: audit 2021-03-10T15:01:52.955765+0000 mon.c (mon.1) 1111 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T15:01:53.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:01:53 gibba045 bash[25517]: audit 2021-03-10T15:01:52.956461+0000 mon.c (mon.1) 1112 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:01:53.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:01:53 gibba045 bash[25517]: audit 2021-03-10T15:01:52.956916+0000 mon.a (mon.0) 1162 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T15:01:53.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:01:53 gibba045 bash[25517]: audit 2021-03-10T15:01:52.957165+0000 mon.c (mon.1) 1113 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:01:53.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:01:53 gibba045 bash[25517]: audit 2021-03-10T15:01:52.957977+0000 mon.c (mon.1) 1114 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:01:53.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:01:53 gibba045 bash[25517]: audit 2021-03-10T15:01:52.958460+0000 mon.a (mon.0) 1163 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:01:53.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:01:53 gibba045 bash[25517]: audit 2021-03-10T15:01:52.959469+0000 mon.a (mon.0) 1164 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:01:53.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:01:53 gibba045 bash[25517]: audit 2021-03-10T15:01:52.960353+0000 mon.a (mon.0) 1165 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:01:54.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:01:54 gibba045 bash[25517]: cluster 2021-03-10T15:01:54.089975+0000 mgr.gibba045.orlgmj (mgr.34412) 3889 : cluster [DBG] pgmap v2204: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:54.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:01:54 gibba015 bash[29377]: cluster 2021-03-10T15:01:54.089975+0000 mgr.gibba045.orlgmj (mgr.34412) 3889 : cluster [DBG] pgmap v2204: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:54.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:01:54 gibba015 bash[30343]: cluster 2021-03-10T15:01:54.089975+0000 mgr.gibba045.orlgmj (mgr.34412) 3889 : cluster [DBG] pgmap v2204: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:57.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:01:57 gibba015 bash[29377]: cluster 2021-03-10T15:01:56.091316+0000 mgr.gibba045.orlgmj (mgr.34412) 3890 : cluster [DBG] pgmap v2205: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:57.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:01:57 gibba015 bash[29377]: cephadm 2021-03-10T15:01:56.305809+0000 mgr.gibba045.orlgmj (mgr.34412) 3891 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:01:57.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:01:57 gibba015 bash[30343]: cluster 2021-03-10T15:01:56.091316+0000 mgr.gibba045.orlgmj (mgr.34412) 3890 : cluster [DBG] pgmap v2205: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:57.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:01:57 gibba015 bash[30343]: cephadm 2021-03-10T15:01:56.305809+0000 mgr.gibba045.orlgmj (mgr.34412) 3891 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:01:57.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:01:57 gibba045 bash[25517]: cluster 2021-03-10T15:01:56.091316+0000 mgr.gibba045.orlgmj (mgr.34412) 3890 : cluster [DBG] pgmap v2205: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:57.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:01:57 gibba045 bash[25517]: cephadm 2021-03-10T15:01:56.305809+0000 mgr.gibba045.orlgmj (mgr.34412) 3891 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:01:59.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:01:59 gibba015 bash[29377]: cluster 2021-03-10T15:01:58.092871+0000 mgr.gibba045.orlgmj (mgr.34412) 3892 : cluster [DBG] pgmap v2206: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:59.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:01:59 gibba015 bash[30343]: cluster 2021-03-10T15:01:58.092871+0000 mgr.gibba045.orlgmj (mgr.34412) 3892 : cluster [DBG] pgmap v2206: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:59.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:01:59 gibba045 bash[25517]: cluster 2021-03-10T15:01:58.092871+0000 mgr.gibba045.orlgmj (mgr.34412) 3892 : cluster [DBG] pgmap v2206: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:01.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:02:01 gibba015 bash[29377]: cluster 2021-03-10T15:02:00.094210+0000 mgr.gibba045.orlgmj (mgr.34412) 3893 : cluster [DBG] pgmap v2207: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:01.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:02:01 gibba015 bash[30343]: cluster 2021-03-10T15:02:00.094210+0000 mgr.gibba045.orlgmj (mgr.34412) 3893 : cluster [DBG] pgmap v2207: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:01.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:02:01 gibba045 bash[25517]: cluster 2021-03-10T15:02:00.094210+0000 mgr.gibba045.orlgmj (mgr.34412) 3893 : cluster [DBG] pgmap v2207: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:03.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:02:03 gibba015 bash[29377]: cluster 2021-03-10T15:02:02.095154+0000 mgr.gibba045.orlgmj (mgr.34412) 3894 : cluster [DBG] pgmap v2208: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:03.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:02:03 gibba015 bash[30343]: cluster 2021-03-10T15:02:02.095154+0000 mgr.gibba045.orlgmj (mgr.34412) 3894 : cluster [DBG] pgmap v2208: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:03.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:02:03 gibba045 bash[25517]: cluster 2021-03-10T15:02:02.095154+0000 mgr.gibba045.orlgmj (mgr.34412) 3894 : cluster [DBG] pgmap v2208: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:04.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:02:04 gibba045 bash[25517]: cluster 2021-03-10T15:02:04.096214+0000 mgr.gibba045.orlgmj (mgr.34412) 3895 : cluster [DBG] pgmap v2209: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:04.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:02:04 gibba015 bash[29377]: cluster 2021-03-10T15:02:04.096214+0000 mgr.gibba045.orlgmj (mgr.34412) 3895 : cluster [DBG] pgmap v2209: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:04.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:02:04 gibba015 bash[30343]: cluster 2021-03-10T15:02:04.096214+0000 mgr.gibba045.orlgmj (mgr.34412) 3895 : cluster [DBG] pgmap v2209: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:07.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:02:07 gibba015 bash[29377]: cluster 2021-03-10T15:02:06.097932+0000 mgr.gibba045.orlgmj (mgr.34412) 3896 : cluster [DBG] pgmap v2210: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:07.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:02:07 gibba015 bash[30343]: cluster 2021-03-10T15:02:06.097932+0000 mgr.gibba045.orlgmj (mgr.34412) 3896 : cluster [DBG] pgmap v2210: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:07.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:02:07 gibba045 bash[25517]: cluster 2021-03-10T15:02:06.097932+0000 mgr.gibba045.orlgmj (mgr.34412) 3896 : cluster [DBG] pgmap v2210: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:09.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:02:09 gibba015 bash[29377]: cluster 2021-03-10T15:02:08.099533+0000 mgr.gibba045.orlgmj (mgr.34412) 3897 : cluster [DBG] pgmap v2211: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:09.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:02:09 gibba015 bash[30343]: cluster 2021-03-10T15:02:08.099533+0000 mgr.gibba045.orlgmj (mgr.34412) 3897 : cluster [DBG] pgmap v2211: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:09.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:02:09 gibba045 bash[25517]: cluster 2021-03-10T15:02:08.099533+0000 mgr.gibba045.orlgmj (mgr.34412) 3897 : cluster [DBG] pgmap v2211: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:11.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:02:11 gibba015 bash[29377]: cluster 2021-03-10T15:02:10.101270+0000 mgr.gibba045.orlgmj (mgr.34412) 3898 : cluster [DBG] pgmap v2212: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:11.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:02:11 gibba015 bash[30343]: cluster 2021-03-10T15:02:10.101270+0000 mgr.gibba045.orlgmj (mgr.34412) 3898 : cluster [DBG] pgmap v2212: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:11.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:02:11 gibba045 bash[25517]: cluster 2021-03-10T15:02:10.101270+0000 mgr.gibba045.orlgmj (mgr.34412) 3898 : cluster [DBG] pgmap v2212: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:12.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:02:12 gibba015 bash[29377]: cephadm 2021-03-10T15:02:11.321785+0000 mgr.gibba045.orlgmj (mgr.34412) 3899 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:02:12.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:02:12 gibba015 bash[30343]: cephadm 2021-03-10T15:02:11.321785+0000 mgr.gibba045.orlgmj (mgr.34412) 3899 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:02:12.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:02:12 gibba045 bash[25517]: cephadm 2021-03-10T15:02:11.321785+0000 mgr.gibba045.orlgmj (mgr.34412) 3899 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:02:13.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:02:13 gibba015 bash[29377]: cluster 2021-03-10T15:02:12.103031+0000 mgr.gibba045.orlgmj (mgr.34412) 3900 : cluster [DBG] pgmap v2213: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:13.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:02:13 gibba015 bash[30343]: cluster 2021-03-10T15:02:12.103031+0000 mgr.gibba045.orlgmj (mgr.34412) 3900 : cluster [DBG] pgmap v2213: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:13.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:02:13 gibba045 bash[25517]: cluster 2021-03-10T15:02:12.103031+0000 mgr.gibba045.orlgmj (mgr.34412) 3900 : cluster [DBG] pgmap v2213: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:14.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:02:14 gibba045 bash[25517]: cluster 2021-03-10T15:02:14.104364+0000 mgr.gibba045.orlgmj (mgr.34412) 3901 : cluster [DBG] pgmap v2214: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:14.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:02:14 gibba015 bash[29377]: cluster 2021-03-10T15:02:14.104364+0000 mgr.gibba045.orlgmj (mgr.34412) 3901 : cluster [DBG] pgmap v2214: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:14.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:02:14 gibba015 bash[30343]: cluster 2021-03-10T15:02:14.104364+0000 mgr.gibba045.orlgmj (mgr.34412) 3901 : cluster [DBG] pgmap v2214: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:17.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:02:17 gibba015 bash[29377]: cluster 2021-03-10T15:02:16.106077+0000 mgr.gibba045.orlgmj (mgr.34412) 3902 : cluster [DBG] pgmap v2215: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:17.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:02:17 gibba015 bash[30343]: cluster 2021-03-10T15:02:16.106077+0000 mgr.gibba045.orlgmj (mgr.34412) 3902 : cluster [DBG] pgmap v2215: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:17.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:02:17 gibba045 bash[25517]: cluster 2021-03-10T15:02:16.106077+0000 mgr.gibba045.orlgmj (mgr.34412) 3902 : cluster [DBG] pgmap v2215: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:19.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:02:19 gibba015 bash[29377]: cluster 2021-03-10T15:02:18.107704+0000 mgr.gibba045.orlgmj (mgr.34412) 3903 : cluster [DBG] pgmap v2216: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:19.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:02:19 gibba015 bash[30343]: cluster 2021-03-10T15:02:18.107704+0000 mgr.gibba045.orlgmj (mgr.34412) 3903 : cluster [DBG] pgmap v2216: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:19.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:02:19 gibba045 bash[25517]: cluster 2021-03-10T15:02:18.107704+0000 mgr.gibba045.orlgmj (mgr.34412) 3903 : cluster [DBG] pgmap v2216: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:21.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:02:21 gibba015 bash[29377]: cluster 2021-03-10T15:02:20.109325+0000 mgr.gibba045.orlgmj (mgr.34412) 3904 : cluster [DBG] pgmap v2217: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:21.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:02:21 gibba015 bash[30343]: cluster 2021-03-10T15:02:20.109325+0000 mgr.gibba045.orlgmj (mgr.34412) 3904 : cluster [DBG] pgmap v2217: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:21.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:02:21 gibba045 bash[25517]: cluster 2021-03-10T15:02:20.109325+0000 mgr.gibba045.orlgmj (mgr.34412) 3904 : cluster [DBG] pgmap v2217: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:21.988 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:02:22.245 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:02:22.246 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (73m) 8m ago 78m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:02:22.246 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (78m) 6m ago 78m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:02:22.246 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (73m) 6m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:02:22.247 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (73m) 6m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:02:22.247 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (72m) 8m ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:02:22.247 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (72m) 8m ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:02:22.248 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (72m) 6m ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:02:22.248 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (72m) 8m ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:02:22.248 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (78m) 8m ago 78m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:02:22.249 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (78m) 6m ago 78m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:02:22.249 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (71m) 8m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:02:22.249 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (70m) 8m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:02:22.250 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (70m) 8m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:02:22.250 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (70m) 8m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:02:22.250 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (69m) 6m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:02:22.251 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (69m) 6m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:02:22.251 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (68m) 6m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:02:22.251 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (68m) 6m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:02:22.252 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (77m) 6m ago 78m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:02:22.252 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 6m ago 76m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:02:22.498 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:02:22.498 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:02:22.499 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:02:22.499 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:02:22.499 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:02:22.499 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:02:22.500 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:02:22.500 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:02:22.500 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:02:22.500 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:02:22.501 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:02:22.501 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:02:22.501 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:02:22.501 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:02:22.502 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:02:23.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:02:23 gibba015 bash[29377]: audit 2021-03-10T15:02:21.978282+0000 mgr.gibba045.orlgmj (mgr.34412) 3905 : audit [DBG] from='client.56668 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:02:23.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:02:23 gibba015 bash[29377]: cluster 2021-03-10T15:02:22.110227+0000 mgr.gibba045.orlgmj (mgr.34412) 3906 : cluster [DBG] pgmap v2218: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:23.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:02:23 gibba015 bash[29377]: audit 2021-03-10T15:02:22.207023+0000 mgr.gibba045.orlgmj (mgr.34412) 3907 : audit [DBG] from='client.56674 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:02:23.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:02:23 gibba015 bash[29377]: audit 2021-03-10T15:02:22.494227+0000 mon.c (mon.1) 1115 : audit [DBG] from='client.? 172.21.2.115:0/2823716494' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:02:23.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:02:23 gibba015 bash[30343]: audit 2021-03-10T15:02:21.978282+0000 mgr.gibba045.orlgmj (mgr.34412) 3905 : audit [DBG] from='client.56668 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:02:23.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:02:23 gibba015 bash[30343]: cluster 2021-03-10T15:02:22.110227+0000 mgr.gibba045.orlgmj (mgr.34412) 3906 : cluster [DBG] pgmap v2218: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:23.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:02:23 gibba015 bash[30343]: audit 2021-03-10T15:02:22.207023+0000 mgr.gibba045.orlgmj (mgr.34412) 3907 : audit [DBG] from='client.56674 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:02:23.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:02:23 gibba015 bash[30343]: audit 2021-03-10T15:02:22.494227+0000 mon.c (mon.1) 1115 : audit [DBG] from='client.? 172.21.2.115:0/2823716494' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:02:23.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:02:23 gibba045 bash[25517]: audit 2021-03-10T15:02:21.978282+0000 mgr.gibba045.orlgmj (mgr.34412) 3905 : audit [DBG] from='client.56668 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:02:23.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:02:23 gibba045 bash[25517]: cluster 2021-03-10T15:02:22.110227+0000 mgr.gibba045.orlgmj (mgr.34412) 3906 : cluster [DBG] pgmap v2218: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:23.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:02:23 gibba045 bash[25517]: audit 2021-03-10T15:02:22.207023+0000 mgr.gibba045.orlgmj (mgr.34412) 3907 : audit [DBG] from='client.56674 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:02:23.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:02:23 gibba045 bash[25517]: audit 2021-03-10T15:02:22.494227+0000 mon.c (mon.1) 1115 : audit [DBG] from='client.? 172.21.2.115:0/2823716494' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:02:24.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:02:24 gibba045 bash[25517]: cluster 2021-03-10T15:02:24.111331+0000 mgr.gibba045.orlgmj (mgr.34412) 3908 : cluster [DBG] pgmap v2219: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:24.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:02:24 gibba015 bash[29377]: cluster 2021-03-10T15:02:24.111331+0000 mgr.gibba045.orlgmj (mgr.34412) 3908 : cluster [DBG] pgmap v2219: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:24.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:02:24 gibba015 bash[30343]: cluster 2021-03-10T15:02:24.111331+0000 mgr.gibba045.orlgmj (mgr.34412) 3908 : cluster [DBG] pgmap v2219: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:27.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:02:27 gibba015 bash[29377]: cluster 2021-03-10T15:02:26.113097+0000 mgr.gibba045.orlgmj (mgr.34412) 3909 : cluster [DBG] pgmap v2220: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:27.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:02:27 gibba015 bash[29377]: audit 2021-03-10T15:02:26.334987+0000 mon.c (mon.1) 1116 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:02:27.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:02:27 gibba015 bash[29377]: cephadm 2021-03-10T15:02:26.343662+0000 mgr.gibba045.orlgmj (mgr.34412) 3910 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:02:27.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:02:27 gibba015 bash[29377]: cephadm 2021-03-10T15:02:26.345553+0000 mgr.gibba045.orlgmj (mgr.34412) 3911 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:02:27.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:02:27 gibba015 bash[29377]: audit 2021-03-10T15:02:26.559113+0000 mon.a (mon.0) 1166 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:02:27.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:02:27 gibba015 bash[29377]: audit 2021-03-10T15:02:26.562780+0000 mon.c (mon.1) 1117 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:02:27.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:02:27 gibba015 bash[29377]: audit 2021-03-10T15:02:26.564242+0000 mon.c (mon.1) 1118 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:02:27.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:02:27 gibba015 bash[29377]: audit 2021-03-10T15:02:26.565427+0000 mon.c (mon.1) 1119 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:02:27.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:02:27 gibba015 bash[29377]: audit 2021-03-10T15:02:26.566929+0000 mon.c (mon.1) 1120 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:02:27.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:02:27 gibba015 bash[29377]: audit 2021-03-10T15:02:26.569699+0000 mon.c (mon.1) 1121 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:02:27.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:02:27 gibba015 bash[29377]: audit 2021-03-10T15:02:26.571225+0000 mon.c (mon.1) 1122 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:02:27.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:02:27 gibba015 bash[30343]: cluster 2021-03-10T15:02:26.113097+0000 mgr.gibba045.orlgmj (mgr.34412) 3909 : cluster [DBG] pgmap v2220: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:27.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:02:27 gibba015 bash[30343]: audit 2021-03-10T15:02:26.334987+0000 mon.c (mon.1) 1116 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:02:27.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:02:27 gibba015 bash[30343]: cephadm 2021-03-10T15:02:26.343662+0000 mgr.gibba045.orlgmj (mgr.34412) 3910 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:02:27.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:02:27 gibba015 bash[30343]: cephadm 2021-03-10T15:02:26.345553+0000 mgr.gibba045.orlgmj (mgr.34412) 3911 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:02:27.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:02:27 gibba015 bash[30343]: audit 2021-03-10T15:02:26.559113+0000 mon.a (mon.0) 1166 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:02:27.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:02:27 gibba015 bash[30343]: audit 2021-03-10T15:02:26.562780+0000 mon.c (mon.1) 1117 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:02:27.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:02:27 gibba015 bash[30343]: audit 2021-03-10T15:02:26.564242+0000 mon.c (mon.1) 1118 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:02:27.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:02:27 gibba015 bash[30343]: audit 2021-03-10T15:02:26.565427+0000 mon.c (mon.1) 1119 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:02:27.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:02:27 gibba015 bash[30343]: audit 2021-03-10T15:02:26.566929+0000 mon.c (mon.1) 1120 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:02:27.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:02:27 gibba015 bash[30343]: audit 2021-03-10T15:02:26.569699+0000 mon.c (mon.1) 1121 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:02:27.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:02:27 gibba015 bash[30343]: audit 2021-03-10T15:02:26.571225+0000 mon.c (mon.1) 1122 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:02:27.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:02:27 gibba045 bash[25517]: cluster 2021-03-10T15:02:26.113097+0000 mgr.gibba045.orlgmj (mgr.34412) 3909 : cluster [DBG] pgmap v2220: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:27.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:02:27 gibba045 bash[25517]: audit 2021-03-10T15:02:26.334987+0000 mon.c (mon.1) 1116 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:02:27.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:02:27 gibba045 bash[25517]: cephadm 2021-03-10T15:02:26.343662+0000 mgr.gibba045.orlgmj (mgr.34412) 3910 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:02:27.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:02:27 gibba045 bash[25517]: cephadm 2021-03-10T15:02:26.345553+0000 mgr.gibba045.orlgmj (mgr.34412) 3911 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:02:27.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:02:27 gibba045 bash[25517]: audit 2021-03-10T15:02:26.559113+0000 mon.a (mon.0) 1166 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:02:27.563 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:02:27 gibba045 bash[25517]: audit 2021-03-10T15:02:26.562780+0000 mon.c (mon.1) 1117 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:02:27.563 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:02:27 gibba045 bash[25517]: audit 2021-03-10T15:02:26.564242+0000 mon.c (mon.1) 1118 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:02:27.563 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:02:27 gibba045 bash[25517]: audit 2021-03-10T15:02:26.565427+0000 mon.c (mon.1) 1119 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:02:27.563 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:02:27 gibba045 bash[25517]: audit 2021-03-10T15:02:26.566929+0000 mon.c (mon.1) 1120 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:02:27.564 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:02:27 gibba045 bash[25517]: audit 2021-03-10T15:02:26.569699+0000 mon.c (mon.1) 1121 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:02:27.564 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:02:27 gibba045 bash[25517]: audit 2021-03-10T15:02:26.571225+0000 mon.c (mon.1) 1122 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:02:28.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:02:28 gibba015 bash[29377]: cephadm 2021-03-10T15:02:26.565635+0000 mgr.gibba045.orlgmj (mgr.34412) 3912 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:02:28.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:02:28 gibba015 bash[29377]: cephadm 2021-03-10T15:02:26.567199+0000 mgr.gibba045.orlgmj (mgr.34412) 3913 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:02:28.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:02:28 gibba015 bash[29377]: cephadm 2021-03-10T15:02:26.568488+0000 mgr.gibba045.orlgmj (mgr.34412) 3914 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:02:28.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:02:28 gibba015 bash[29377]: cephadm 2021-03-10T15:02:26.568548+0000 mgr.gibba045.orlgmj (mgr.34412) 3915 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:02:28.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:02:28 gibba015 bash[29377]: cephadm 2021-03-10T15:02:26.569958+0000 mgr.gibba045.orlgmj (mgr.34412) 3916 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:02:28.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:02:28 gibba015 bash[29377]: cephadm 2021-03-10T15:02:26.569994+0000 mgr.gibba045.orlgmj (mgr.34412) 3917 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:02:28.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:02:28 gibba015 bash[29377]: cephadm 2021-03-10T15:02:26.571326+0000 mgr.gibba045.orlgmj (mgr.34412) 3918 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:02:28.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:02:28 gibba015 bash[29377]: cephadm 2021-03-10T15:02:26.572764+0000 mgr.gibba045.orlgmj (mgr.34412) 3919 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:02:28.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:02:28 gibba015 bash[29377]: cephadm 2021-03-10T15:02:26.572800+0000 mgr.gibba045.orlgmj (mgr.34412) 3920 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:02:28.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:02:28 gibba015 bash[29377]: cephadm 2021-03-10T15:02:26.573999+0000 mgr.gibba045.orlgmj (mgr.34412) 3921 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:02:28.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:02:28 gibba015 bash[29377]: cephadm 2021-03-10T15:02:26.574313+0000 mgr.gibba045.orlgmj (mgr.34412) 3922 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:02:28.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:02:28 gibba015 bash[29377]: cephadm 2021-03-10T15:02:26.575583+0000 mgr.gibba045.orlgmj (mgr.34412) 3923 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:02:28.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:02:28 gibba015 bash[29377]: cephadm 2021-03-10T15:02:26.575622+0000 mgr.gibba045.orlgmj (mgr.34412) 3924 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:02:28.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:02:28 gibba015 bash[29377]: cephadm 2021-03-10T15:02:26.575808+0000 mgr.gibba045.orlgmj (mgr.34412) 3925 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:02:28.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:02:28 gibba015 bash[30343]: cephadm 2021-03-10T15:02:26.565635+0000 mgr.gibba045.orlgmj (mgr.34412) 3912 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:02:28.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:02:28 gibba015 bash[30343]: cephadm 2021-03-10T15:02:26.567199+0000 mgr.gibba045.orlgmj (mgr.34412) 3913 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:02:28.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:02:28 gibba015 bash[30343]: cephadm 2021-03-10T15:02:26.568488+0000 mgr.gibba045.orlgmj (mgr.34412) 3914 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:02:28.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:02:28 gibba015 bash[30343]: cephadm 2021-03-10T15:02:26.568548+0000 mgr.gibba045.orlgmj (mgr.34412) 3915 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:02:28.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:02:28 gibba015 bash[30343]: cephadm 2021-03-10T15:02:26.569958+0000 mgr.gibba045.orlgmj (mgr.34412) 3916 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:02:28.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:02:28 gibba015 bash[30343]: cephadm 2021-03-10T15:02:26.569994+0000 mgr.gibba045.orlgmj (mgr.34412) 3917 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:02:28.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:02:28 gibba015 bash[30343]: cephadm 2021-03-10T15:02:26.571326+0000 mgr.gibba045.orlgmj (mgr.34412) 3918 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:02:28.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:02:28 gibba015 bash[30343]: cephadm 2021-03-10T15:02:26.572764+0000 mgr.gibba045.orlgmj (mgr.34412) 3919 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:02:28.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:02:28 gibba015 bash[30343]: cephadm 2021-03-10T15:02:26.572800+0000 mgr.gibba045.orlgmj (mgr.34412) 3920 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:02:28.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:02:28 gibba015 bash[30343]: cephadm 2021-03-10T15:02:26.573999+0000 mgr.gibba045.orlgmj (mgr.34412) 3921 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:02:28.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:02:28 gibba015 bash[30343]: cephadm 2021-03-10T15:02:26.574313+0000 mgr.gibba045.orlgmj (mgr.34412) 3922 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:02:28.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:02:28 gibba015 bash[30343]: cephadm 2021-03-10T15:02:26.575583+0000 mgr.gibba045.orlgmj (mgr.34412) 3923 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:02:28.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:02:28 gibba015 bash[30343]: cephadm 2021-03-10T15:02:26.575622+0000 mgr.gibba045.orlgmj (mgr.34412) 3924 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:02:28.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:02:28 gibba015 bash[30343]: cephadm 2021-03-10T15:02:26.575808+0000 mgr.gibba045.orlgmj (mgr.34412) 3925 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:02:28.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:02:28 gibba045 bash[25517]: cephadm 2021-03-10T15:02:26.565635+0000 mgr.gibba045.orlgmj (mgr.34412) 3912 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:02:28.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:02:28 gibba045 bash[25517]: cephadm 2021-03-10T15:02:26.567199+0000 mgr.gibba045.orlgmj (mgr.34412) 3913 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:02:28.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:02:28 gibba045 bash[25517]: cephadm 2021-03-10T15:02:26.568488+0000 mgr.gibba045.orlgmj (mgr.34412) 3914 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:02:28.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:02:28 gibba045 bash[25517]: cephadm 2021-03-10T15:02:26.568548+0000 mgr.gibba045.orlgmj (mgr.34412) 3915 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:02:28.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:02:28 gibba045 bash[25517]: cephadm 2021-03-10T15:02:26.569958+0000 mgr.gibba045.orlgmj (mgr.34412) 3916 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:02:28.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:02:28 gibba045 bash[25517]: cephadm 2021-03-10T15:02:26.569994+0000 mgr.gibba045.orlgmj (mgr.34412) 3917 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:02:28.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:02:28 gibba045 bash[25517]: cephadm 2021-03-10T15:02:26.571326+0000 mgr.gibba045.orlgmj (mgr.34412) 3918 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:02:28.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:02:28 gibba045 bash[25517]: cephadm 2021-03-10T15:02:26.572764+0000 mgr.gibba045.orlgmj (mgr.34412) 3919 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:02:28.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:02:28 gibba045 bash[25517]: cephadm 2021-03-10T15:02:26.572800+0000 mgr.gibba045.orlgmj (mgr.34412) 3920 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:02:28.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:02:28 gibba045 bash[25517]: cephadm 2021-03-10T15:02:26.573999+0000 mgr.gibba045.orlgmj (mgr.34412) 3921 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:02:28.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:02:28 gibba045 bash[25517]: cephadm 2021-03-10T15:02:26.574313+0000 mgr.gibba045.orlgmj (mgr.34412) 3922 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:02:28.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:02:28 gibba045 bash[25517]: cephadm 2021-03-10T15:02:26.575583+0000 mgr.gibba045.orlgmj (mgr.34412) 3923 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:02:28.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:02:28 gibba045 bash[25517]: cephadm 2021-03-10T15:02:26.575622+0000 mgr.gibba045.orlgmj (mgr.34412) 3924 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:02:28.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:02:28 gibba045 bash[25517]: cephadm 2021-03-10T15:02:26.575808+0000 mgr.gibba045.orlgmj (mgr.34412) 3925 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:02:29.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:02:29 gibba015 bash[29377]: cluster 2021-03-10T15:02:28.114473+0000 mgr.gibba045.orlgmj (mgr.34412) 3926 : cluster [DBG] pgmap v2221: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:29.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:02:29 gibba015 bash[30343]: cluster 2021-03-10T15:02:28.114473+0000 mgr.gibba045.orlgmj (mgr.34412) 3926 : cluster [DBG] pgmap v2221: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:29.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:02:29 gibba045 bash[25517]: cluster 2021-03-10T15:02:28.114473+0000 mgr.gibba045.orlgmj (mgr.34412) 3926 : cluster [DBG] pgmap v2221: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:31.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:02:31 gibba015 bash[29377]: cluster 2021-03-10T15:02:30.116007+0000 mgr.gibba045.orlgmj (mgr.34412) 3927 : cluster [DBG] pgmap v2222: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:31.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:02:31 gibba015 bash[30343]: cluster 2021-03-10T15:02:30.116007+0000 mgr.gibba045.orlgmj (mgr.34412) 3927 : cluster [DBG] pgmap v2222: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:31.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:02:31 gibba045 bash[25517]: cluster 2021-03-10T15:02:30.116007+0000 mgr.gibba045.orlgmj (mgr.34412) 3927 : cluster [DBG] pgmap v2222: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:33.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:02:33 gibba015 bash[29377]: cluster 2021-03-10T15:02:32.117039+0000 mgr.gibba045.orlgmj (mgr.34412) 3928 : cluster [DBG] pgmap v2223: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:33.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:02:33 gibba015 bash[30343]: cluster 2021-03-10T15:02:32.117039+0000 mgr.gibba045.orlgmj (mgr.34412) 3928 : cluster [DBG] pgmap v2223: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:33.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:02:33 gibba045 bash[25517]: cluster 2021-03-10T15:02:32.117039+0000 mgr.gibba045.orlgmj (mgr.34412) 3928 : cluster [DBG] pgmap v2223: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:34.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:02:34 gibba045 bash[25517]: cluster 2021-03-10T15:02:34.118122+0000 mgr.gibba045.orlgmj (mgr.34412) 3929 : cluster [DBG] pgmap v2224: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:34.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:02:34 gibba015 bash[29377]: cluster 2021-03-10T15:02:34.118122+0000 mgr.gibba045.orlgmj (mgr.34412) 3929 : cluster [DBG] pgmap v2224: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:34.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:02:34 gibba015 bash[30343]: cluster 2021-03-10T15:02:34.118122+0000 mgr.gibba045.orlgmj (mgr.34412) 3929 : cluster [DBG] pgmap v2224: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:37.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:02:37 gibba015 bash[29377]: cluster 2021-03-10T15:02:36.119721+0000 mgr.gibba045.orlgmj (mgr.34412) 3930 : cluster [DBG] pgmap v2225: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:37.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:02:37 gibba015 bash[30343]: cluster 2021-03-10T15:02:36.119721+0000 mgr.gibba045.orlgmj (mgr.34412) 3930 : cluster [DBG] pgmap v2225: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:37.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:02:37 gibba045 bash[25517]: cluster 2021-03-10T15:02:36.119721+0000 mgr.gibba045.orlgmj (mgr.34412) 3930 : cluster [DBG] pgmap v2225: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:39.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:02:39 gibba015 bash[29377]: cluster 2021-03-10T15:02:38.121264+0000 mgr.gibba045.orlgmj (mgr.34412) 3931 : cluster [DBG] pgmap v2226: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:39.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:02:39 gibba015 bash[30343]: cluster 2021-03-10T15:02:38.121264+0000 mgr.gibba045.orlgmj (mgr.34412) 3931 : cluster [DBG] pgmap v2226: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:39.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:02:39 gibba045 bash[25517]: cluster 2021-03-10T15:02:38.121264+0000 mgr.gibba045.orlgmj (mgr.34412) 3931 : cluster [DBG] pgmap v2226: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:41.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:02:41 gibba015 bash[29377]: cluster 2021-03-10T15:02:40.122680+0000 mgr.gibba045.orlgmj (mgr.34412) 3932 : cluster [DBG] pgmap v2227: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:41.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:02:41 gibba015 bash[30343]: cluster 2021-03-10T15:02:40.122680+0000 mgr.gibba045.orlgmj (mgr.34412) 3932 : cluster [DBG] pgmap v2227: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:41.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:02:41 gibba045 bash[25517]: cluster 2021-03-10T15:02:40.122680+0000 mgr.gibba045.orlgmj (mgr.34412) 3932 : cluster [DBG] pgmap v2227: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:43.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:02:43 gibba015 bash[29377]: cephadm 2021-03-10T15:02:41.591304+0000 mgr.gibba045.orlgmj (mgr.34412) 3933 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:02:43.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:02:43 gibba015 bash[29377]: cluster 2021-03-10T15:02:42.123471+0000 mgr.gibba045.orlgmj (mgr.34412) 3934 : cluster [DBG] pgmap v2228: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:43.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:02:43 gibba015 bash[30343]: cephadm 2021-03-10T15:02:41.591304+0000 mgr.gibba045.orlgmj (mgr.34412) 3933 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:02:43.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:02:43 gibba015 bash[30343]: cluster 2021-03-10T15:02:42.123471+0000 mgr.gibba045.orlgmj (mgr.34412) 3934 : cluster [DBG] pgmap v2228: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:43.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:02:43 gibba045 bash[25517]: cephadm 2021-03-10T15:02:41.591304+0000 mgr.gibba045.orlgmj (mgr.34412) 3933 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:02:43.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:02:43 gibba045 bash[25517]: cluster 2021-03-10T15:02:42.123471+0000 mgr.gibba045.orlgmj (mgr.34412) 3934 : cluster [DBG] pgmap v2228: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:44.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:02:44 gibba015 bash[29377]: cluster 2021-03-10T15:02:44.124789+0000 mgr.gibba045.orlgmj (mgr.34412) 3935 : cluster [DBG] pgmap v2229: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:44.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:02:44 gibba015 bash[30343]: cluster 2021-03-10T15:02:44.124789+0000 mgr.gibba045.orlgmj (mgr.34412) 3935 : cluster [DBG] pgmap v2229: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:45.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:02:44 gibba045 bash[25517]: cluster 2021-03-10T15:02:44.124789+0000 mgr.gibba045.orlgmj (mgr.34412) 3935 : cluster [DBG] pgmap v2229: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:47.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:02:47 gibba015 bash[29377]: cluster 2021-03-10T15:02:46.126330+0000 mgr.gibba045.orlgmj (mgr.34412) 3936 : cluster [DBG] pgmap v2230: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:47.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:02:47 gibba015 bash[30343]: cluster 2021-03-10T15:02:46.126330+0000 mgr.gibba045.orlgmj (mgr.34412) 3936 : cluster [DBG] pgmap v2230: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:47.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:02:47 gibba045 bash[25517]: cluster 2021-03-10T15:02:46.126330+0000 mgr.gibba045.orlgmj (mgr.34412) 3936 : cluster [DBG] pgmap v2230: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:49.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:02:49 gibba015 bash[29377]: cluster 2021-03-10T15:02:48.127675+0000 mgr.gibba045.orlgmj (mgr.34412) 3937 : cluster [DBG] pgmap v2231: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:49.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:02:49 gibba015 bash[30343]: cluster 2021-03-10T15:02:48.127675+0000 mgr.gibba045.orlgmj (mgr.34412) 3937 : cluster [DBG] pgmap v2231: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:49.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:02:49 gibba045 bash[25517]: cluster 2021-03-10T15:02:48.127675+0000 mgr.gibba045.orlgmj (mgr.34412) 3937 : cluster [DBG] pgmap v2231: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:51.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:02:51 gibba015 bash[29377]: cluster 2021-03-10T15:02:50.128466+0000 mgr.gibba045.orlgmj (mgr.34412) 3938 : cluster [DBG] pgmap v2232: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:51.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:02:51 gibba015 bash[30343]: cluster 2021-03-10T15:02:50.128466+0000 mgr.gibba045.orlgmj (mgr.34412) 3938 : cluster [DBG] pgmap v2232: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:51.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:02:51 gibba045 bash[25517]: cluster 2021-03-10T15:02:50.128466+0000 mgr.gibba045.orlgmj (mgr.34412) 3938 : cluster [DBG] pgmap v2232: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:52.740 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:02:52.967 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:02:52.968 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (73m) 8m ago 78m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:02:52.968 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (78m) 7m ago 78m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:02:52.968 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (74m) 7m ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:02:52.969 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (74m) 7m ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:02:52.969 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (73m) 8m ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:02:52.969 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (73m) 8m ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:02:52.969 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (72m) 7m ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:02:52.970 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (72m) 8m ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:02:52.970 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (79m) 8m ago 79m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:02:52.970 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (79m) 7m ago 79m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:02:52.970 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (71m) 8m ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:02:52.971 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (71m) 8m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:02:52.971 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (71m) 8m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:02:52.971 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (70m) 8m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:02:52.971 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (70m) 7m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:02:52.972 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (69m) 7m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:02:52.972 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (69m) 7m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:02:52.972 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (68m) 7m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:02:52.972 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (78m) 7m ago 79m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:02:52.972 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 7m ago 77m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:02:53.219 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:02:53.219 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:02:53.219 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:02:53.220 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:02:53.220 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:02:53.220 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:02:53.220 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:02:53.221 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:02:53.221 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:02:53.221 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:02:53.221 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:02:53.222 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:02:53.222 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:02:53.222 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:02:53.222 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:02:53.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:02:53 gibba015 bash[29377]: cluster 2021-03-10T15:02:52.129358+0000 mgr.gibba045.orlgmj (mgr.34412) 3939 : cluster [DBG] pgmap v2233: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:53.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:02:53 gibba015 bash[29377]: audit 2021-03-10T15:02:52.956247+0000 mon.c (mon.1) 1123 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:02:53.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:02:53 gibba015 bash[29377]: audit 2021-03-10T15:02:52.956615+0000 mon.a (mon.0) 1167 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:02:53.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:02:53 gibba015 bash[29377]: audit 2021-03-10T15:02:52.963749+0000 mon.c (mon.1) 1124 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:02:53.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:02:53 gibba015 bash[29377]: audit 2021-03-10T15:02:52.964126+0000 mon.a (mon.0) 1168 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:02:53.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:02:53 gibba015 bash[29377]: audit 2021-03-10T15:02:52.966466+0000 mon.c (mon.1) 1125 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:02:53.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:02:53 gibba015 bash[29377]: audit 2021-03-10T15:02:52.966656+0000 mon.c (mon.1) 1126 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:02:53.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:02:53 gibba015 bash[29377]: audit 2021-03-10T15:02:52.966799+0000 mon.a (mon.0) 1169 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:02:53.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:02:53 gibba015 bash[29377]: audit 2021-03-10T15:02:52.966890+0000 mon.c (mon.1) 1127 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:02:53.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:02:53 gibba015 bash[29377]: audit 2021-03-10T15:02:52.967147+0000 mon.c (mon.1) 1128 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:02:53.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:02:53 gibba015 bash[29377]: audit 2021-03-10T15:02:52.967308+0000 mon.a (mon.0) 1170 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:02:53.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:02:53 gibba015 bash[29377]: audit 2021-03-10T15:02:52.967644+0000 mon.a (mon.0) 1171 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:02:53.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:02:53 gibba015 bash[29377]: audit 2021-03-10T15:02:52.967873+0000 mon.a (mon.0) 1172 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:02:53.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:02:53 gibba015 bash[30343]: cluster 2021-03-10T15:02:52.129358+0000 mgr.gibba045.orlgmj (mgr.34412) 3939 : cluster [DBG] pgmap v2233: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:53.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:02:53 gibba015 bash[30343]: audit 2021-03-10T15:02:52.956247+0000 mon.c (mon.1) 1123 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:02:53.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:02:53 gibba015 bash[30343]: audit 2021-03-10T15:02:52.956615+0000 mon.a (mon.0) 1167 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:02:53.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:02:53 gibba015 bash[30343]: audit 2021-03-10T15:02:52.963749+0000 mon.c (mon.1) 1124 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:02:53.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:02:53 gibba015 bash[30343]: audit 2021-03-10T15:02:52.964126+0000 mon.a (mon.0) 1168 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:02:53.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:02:53 gibba015 bash[30343]: audit 2021-03-10T15:02:52.966466+0000 mon.c (mon.1) 1125 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:02:53.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:02:53 gibba015 bash[30343]: audit 2021-03-10T15:02:52.966656+0000 mon.c (mon.1) 1126 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:02:53.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:02:53 gibba015 bash[30343]: audit 2021-03-10T15:02:52.966799+0000 mon.a (mon.0) 1169 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:02:53.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:02:53 gibba015 bash[30343]: audit 2021-03-10T15:02:52.966890+0000 mon.c (mon.1) 1127 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:02:53.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:02:53 gibba015 bash[30343]: audit 2021-03-10T15:02:52.967147+0000 mon.c (mon.1) 1128 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:02:53.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:02:53 gibba015 bash[30343]: audit 2021-03-10T15:02:52.967308+0000 mon.a (mon.0) 1170 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:02:53.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:02:53 gibba015 bash[30343]: audit 2021-03-10T15:02:52.967644+0000 mon.a (mon.0) 1171 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:02:53.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:02:53 gibba015 bash[30343]: audit 2021-03-10T15:02:52.967873+0000 mon.a (mon.0) 1172 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:02:53.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:02:53 gibba045 bash[25517]: cluster 2021-03-10T15:02:52.129358+0000 mgr.gibba045.orlgmj (mgr.34412) 3939 : cluster [DBG] pgmap v2233: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:53.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:02:53 gibba045 bash[25517]: audit 2021-03-10T15:02:52.956247+0000 mon.c (mon.1) 1123 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:02:53.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:02:53 gibba045 bash[25517]: audit 2021-03-10T15:02:52.956615+0000 mon.a (mon.0) 1167 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:02:53.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:02:53 gibba045 bash[25517]: audit 2021-03-10T15:02:52.963749+0000 mon.c (mon.1) 1124 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:02:53.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:02:53 gibba045 bash[25517]: audit 2021-03-10T15:02:52.964126+0000 mon.a (mon.0) 1168 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:02:53.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:02:53 gibba045 bash[25517]: audit 2021-03-10T15:02:52.966466+0000 mon.c (mon.1) 1125 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:02:53.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:02:53 gibba045 bash[25517]: audit 2021-03-10T15:02:52.966656+0000 mon.c (mon.1) 1126 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:02:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:02:53 gibba045 bash[25517]: audit 2021-03-10T15:02:52.966799+0000 mon.a (mon.0) 1169 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:02:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:02:53 gibba045 bash[25517]: audit 2021-03-10T15:02:52.966890+0000 mon.c (mon.1) 1127 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:02:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:02:53 gibba045 bash[25517]: audit 2021-03-10T15:02:52.967147+0000 mon.c (mon.1) 1128 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:02:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:02:53 gibba045 bash[25517]: audit 2021-03-10T15:02:52.967308+0000 mon.a (mon.0) 1170 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:02:53.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:02:53 gibba045 bash[25517]: audit 2021-03-10T15:02:52.967644+0000 mon.a (mon.0) 1171 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:02:53.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:02:53 gibba045 bash[25517]: audit 2021-03-10T15:02:52.967873+0000 mon.a (mon.0) 1172 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:02:54.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:02:54 gibba015 bash[29377]: audit 2021-03-10T15:02:52.730766+0000 mgr.gibba045.orlgmj (mgr.34412) 3940 : audit [DBG] from='client.56686 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:02:54.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:02:54 gibba015 bash[29377]: audit 2021-03-10T15:02:52.954206+0000 mgr.gibba045.orlgmj (mgr.34412) 3941 : audit [DBG] from='client.46704 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:02:54.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:02:54 gibba015 bash[29377]: audit 2021-03-10T15:02:53.215293+0000 mon.c (mon.1) 1129 : audit [DBG] from='client.? 172.21.2.115:0/1091042037' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:02:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:02:54 gibba015 bash[30343]: audit 2021-03-10T15:02:52.730766+0000 mgr.gibba045.orlgmj (mgr.34412) 3940 : audit [DBG] from='client.56686 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:02:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:02:54 gibba015 bash[30343]: audit 2021-03-10T15:02:52.954206+0000 mgr.gibba045.orlgmj (mgr.34412) 3941 : audit [DBG] from='client.46704 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:02:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:02:54 gibba015 bash[30343]: audit 2021-03-10T15:02:53.215293+0000 mon.c (mon.1) 1129 : audit [DBG] from='client.? 172.21.2.115:0/1091042037' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:02:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:02:54 gibba045 bash[25517]: audit 2021-03-10T15:02:52.730766+0000 mgr.gibba045.orlgmj (mgr.34412) 3940 : audit [DBG] from='client.56686 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:02:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:02:54 gibba045 bash[25517]: audit 2021-03-10T15:02:52.954206+0000 mgr.gibba045.orlgmj (mgr.34412) 3941 : audit [DBG] from='client.46704 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:02:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:02:54 gibba045 bash[25517]: audit 2021-03-10T15:02:53.215293+0000 mon.c (mon.1) 1129 : audit [DBG] from='client.? 172.21.2.115:0/1091042037' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:02:55.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:02:55 gibba015 bash[29377]: cluster 2021-03-10T15:02:54.130468+0000 mgr.gibba045.orlgmj (mgr.34412) 3942 : cluster [DBG] pgmap v2234: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:55.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:02:55 gibba015 bash[30343]: cluster 2021-03-10T15:02:54.130468+0000 mgr.gibba045.orlgmj (mgr.34412) 3942 : cluster [DBG] pgmap v2234: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:55.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:02:55 gibba045 bash[25517]: cluster 2021-03-10T15:02:54.130468+0000 mgr.gibba045.orlgmj (mgr.34412) 3942 : cluster [DBG] pgmap v2234: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:57.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:02:57 gibba045 bash[25517]: cluster 2021-03-10T15:02:56.132156+0000 mgr.gibba045.orlgmj (mgr.34412) 3943 : cluster [DBG] pgmap v2235: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:57.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:02:57 gibba015 bash[29377]: cluster 2021-03-10T15:02:56.132156+0000 mgr.gibba045.orlgmj (mgr.34412) 3943 : cluster [DBG] pgmap v2235: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:57.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:02:57 gibba015 bash[30343]: cluster 2021-03-10T15:02:56.132156+0000 mgr.gibba045.orlgmj (mgr.34412) 3943 : cluster [DBG] pgmap v2235: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:58.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:02:58 gibba045 bash[25517]: cephadm 2021-03-10T15:02:56.597479+0000 mgr.gibba045.orlgmj (mgr.34412) 3944 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:02:58.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:02:58 gibba015 bash[29377]: cephadm 2021-03-10T15:02:56.597479+0000 mgr.gibba045.orlgmj (mgr.34412) 3944 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:02:58.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:02:58 gibba015 bash[30343]: cephadm 2021-03-10T15:02:56.597479+0000 mgr.gibba045.orlgmj (mgr.34412) 3944 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:02:59.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:02:59 gibba045 bash[25517]: cluster 2021-03-10T15:02:58.133860+0000 mgr.gibba045.orlgmj (mgr.34412) 3945 : cluster [DBG] pgmap v2236: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:59.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:02:59 gibba015 bash[29377]: cluster 2021-03-10T15:02:58.133860+0000 mgr.gibba045.orlgmj (mgr.34412) 3945 : cluster [DBG] pgmap v2236: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:59.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:02:59 gibba015 bash[30343]: cluster 2021-03-10T15:02:58.133860+0000 mgr.gibba045.orlgmj (mgr.34412) 3945 : cluster [DBG] pgmap v2236: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:01.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:03:01 gibba045 bash[25517]: cluster 2021-03-10T15:03:00.134453+0000 mgr.gibba045.orlgmj (mgr.34412) 3946 : cluster [DBG] pgmap v2237: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:01.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:03:01 gibba015 bash[29377]: cluster 2021-03-10T15:03:00.134453+0000 mgr.gibba045.orlgmj (mgr.34412) 3946 : cluster [DBG] pgmap v2237: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:01.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:03:01 gibba015 bash[30343]: cluster 2021-03-10T15:03:00.134453+0000 mgr.gibba045.orlgmj (mgr.34412) 3946 : cluster [DBG] pgmap v2237: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:03.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:03:03 gibba045 bash[25517]: cluster 2021-03-10T15:03:02.135286+0000 mgr.gibba045.orlgmj (mgr.34412) 3947 : cluster [DBG] pgmap v2238: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:03.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:03:03 gibba015 bash[29377]: cluster 2021-03-10T15:03:02.135286+0000 mgr.gibba045.orlgmj (mgr.34412) 3947 : cluster [DBG] pgmap v2238: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:03.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:03:03 gibba015 bash[30343]: cluster 2021-03-10T15:03:02.135286+0000 mgr.gibba045.orlgmj (mgr.34412) 3947 : cluster [DBG] pgmap v2238: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:04.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:03:04 gibba015 bash[29377]: cluster 2021-03-10T15:03:04.136366+0000 mgr.gibba045.orlgmj (mgr.34412) 3948 : cluster [DBG] pgmap v2239: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:04.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:03:04 gibba015 bash[30343]: cluster 2021-03-10T15:03:04.136366+0000 mgr.gibba045.orlgmj (mgr.34412) 3948 : cluster [DBG] pgmap v2239: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:05.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:03:04 gibba045 bash[25517]: cluster 2021-03-10T15:03:04.136366+0000 mgr.gibba045.orlgmj (mgr.34412) 3948 : cluster [DBG] pgmap v2239: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:07.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:03:07 gibba015 bash[29377]: cluster 2021-03-10T15:03:06.137033+0000 mgr.gibba045.orlgmj (mgr.34412) 3949 : cluster [DBG] pgmap v2240: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:07.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:03:07 gibba015 bash[30343]: cluster 2021-03-10T15:03:06.137033+0000 mgr.gibba045.orlgmj (mgr.34412) 3949 : cluster [DBG] pgmap v2240: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:07.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:03:07 gibba045 bash[25517]: cluster 2021-03-10T15:03:06.137033+0000 mgr.gibba045.orlgmj (mgr.34412) 3949 : cluster [DBG] pgmap v2240: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:09.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:03:09 gibba015 bash[29377]: cluster 2021-03-10T15:03:08.138581+0000 mgr.gibba045.orlgmj (mgr.34412) 3950 : cluster [DBG] pgmap v2241: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:09.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:03:09 gibba015 bash[30343]: cluster 2021-03-10T15:03:08.138581+0000 mgr.gibba045.orlgmj (mgr.34412) 3950 : cluster [DBG] pgmap v2241: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:09.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:03:09 gibba045 bash[25517]: cluster 2021-03-10T15:03:08.138581+0000 mgr.gibba045.orlgmj (mgr.34412) 3950 : cluster [DBG] pgmap v2241: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:11.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:03:11 gibba015 bash[29377]: cluster 2021-03-10T15:03:10.140207+0000 mgr.gibba045.orlgmj (mgr.34412) 3951 : cluster [DBG] pgmap v2242: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:11.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:03:11 gibba015 bash[30343]: cluster 2021-03-10T15:03:10.140207+0000 mgr.gibba045.orlgmj (mgr.34412) 3951 : cluster [DBG] pgmap v2242: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:11.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:03:11 gibba045 bash[25517]: cluster 2021-03-10T15:03:10.140207+0000 mgr.gibba045.orlgmj (mgr.34412) 3951 : cluster [DBG] pgmap v2242: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:13.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:03:13 gibba045 bash[25517]: cephadm 2021-03-10T15:03:11.613339+0000 mgr.gibba045.orlgmj (mgr.34412) 3952 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:03:13.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:03:13 gibba045 bash[25517]: cluster 2021-03-10T15:03:12.140898+0000 mgr.gibba045.orlgmj (mgr.34412) 3953 : cluster [DBG] pgmap v2243: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:13.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:03:13 gibba015 bash[29377]: cephadm 2021-03-10T15:03:11.613339+0000 mgr.gibba045.orlgmj (mgr.34412) 3952 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:03:13.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:03:13 gibba015 bash[29377]: cluster 2021-03-10T15:03:12.140898+0000 mgr.gibba045.orlgmj (mgr.34412) 3953 : cluster [DBG] pgmap v2243: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:13.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:03:13 gibba015 bash[30343]: cephadm 2021-03-10T15:03:11.613339+0000 mgr.gibba045.orlgmj (mgr.34412) 3952 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:03:13.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:03:13 gibba015 bash[30343]: cluster 2021-03-10T15:03:12.140898+0000 mgr.gibba045.orlgmj (mgr.34412) 3953 : cluster [DBG] pgmap v2243: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:14.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:03:14 gibba015 bash[29377]: cluster 2021-03-10T15:03:14.142029+0000 mgr.gibba045.orlgmj (mgr.34412) 3954 : cluster [DBG] pgmap v2244: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:14.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:03:14 gibba015 bash[30343]: cluster 2021-03-10T15:03:14.142029+0000 mgr.gibba045.orlgmj (mgr.34412) 3954 : cluster [DBG] pgmap v2244: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:15.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:03:14 gibba045 bash[25517]: cluster 2021-03-10T15:03:14.142029+0000 mgr.gibba045.orlgmj (mgr.34412) 3954 : cluster [DBG] pgmap v2244: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:17.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:03:17 gibba015 bash[29377]: cluster 2021-03-10T15:03:16.143827+0000 mgr.gibba045.orlgmj (mgr.34412) 3955 : cluster [DBG] pgmap v2245: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:17.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:03:17 gibba015 bash[30343]: cluster 2021-03-10T15:03:16.143827+0000 mgr.gibba045.orlgmj (mgr.34412) 3955 : cluster [DBG] pgmap v2245: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:17.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:03:17 gibba045 bash[25517]: cluster 2021-03-10T15:03:16.143827+0000 mgr.gibba045.orlgmj (mgr.34412) 3955 : cluster [DBG] pgmap v2245: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:19.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:03:19 gibba015 bash[29377]: cluster 2021-03-10T15:03:18.144622+0000 mgr.gibba045.orlgmj (mgr.34412) 3956 : cluster [DBG] pgmap v2246: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:19.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:03:19 gibba015 bash[30343]: cluster 2021-03-10T15:03:18.144622+0000 mgr.gibba045.orlgmj (mgr.34412) 3956 : cluster [DBG] pgmap v2246: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:19.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:03:19 gibba045 bash[25517]: cluster 2021-03-10T15:03:18.144622+0000 mgr.gibba045.orlgmj (mgr.34412) 3956 : cluster [DBG] pgmap v2246: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:21.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:03:21 gibba045 bash[25517]: cluster 2021-03-10T15:03:20.146145+0000 mgr.gibba045.orlgmj (mgr.34412) 3957 : cluster [DBG] pgmap v2247: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:21.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:03:21 gibba015 bash[29377]: cluster 2021-03-10T15:03:20.146145+0000 mgr.gibba045.orlgmj (mgr.34412) 3957 : cluster [DBG] pgmap v2247: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:21.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:03:21 gibba015 bash[30343]: cluster 2021-03-10T15:03:20.146145+0000 mgr.gibba045.orlgmj (mgr.34412) 3957 : cluster [DBG] pgmap v2247: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:23.465 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:03:23.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:03:23 gibba045 bash[25517]: cluster 2021-03-10T15:03:22.147065+0000 mgr.gibba045.orlgmj (mgr.34412) 3958 : cluster [DBG] pgmap v2248: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:23.696 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:03:23.696 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (74m) 9m ago 79m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:03:23.696 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (79m) 7m ago 79m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:03:23.697 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (74m) 7m ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:03:23.697 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (74m) 7m ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:03:23.697 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (73m) 9m ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:03:23.697 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (73m) 9m ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:03:23.698 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (73m) 7m ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:03:23.698 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (73m) 9m ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:03:23.698 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (79m) 9m ago 79m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:03:23.698 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (79m) 7m ago 79m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:03:23.698 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (72m) 9m ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:03:23.699 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (71m) 9m ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:03:23.699 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (71m) 9m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:03:23.699 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (71m) 9m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:03:23.699 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (70m) 7m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:03:23.700 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (70m) 7m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:03:23.700 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (69m) 7m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:03:23.700 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (69m) 7m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:03:23.700 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (78m) 7m ago 79m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:03:23.701 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 7m ago 77m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:03:23.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:03:23 gibba015 bash[29377]: cluster 2021-03-10T15:03:22.147065+0000 mgr.gibba045.orlgmj (mgr.34412) 3958 : cluster [DBG] pgmap v2248: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:23.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:03:23 gibba015 bash[30343]: cluster 2021-03-10T15:03:22.147065+0000 mgr.gibba045.orlgmj (mgr.34412) 3958 : cluster [DBG] pgmap v2248: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:23.944 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:03:23.945 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:03:23.945 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:03:23.945 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:03:23.946 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:03:23.946 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:03:23.946 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:03:23.946 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:03:23.947 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:03:23.947 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:03:23.947 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:03:23.947 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:03:23.947 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:03:23.948 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:03:23.948 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:03:24.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:03:24 gibba015 bash[29377]: audit 2021-03-10T15:03:23.456339+0000 mgr.gibba045.orlgmj (mgr.34412) 3959 : audit [DBG] from='client.46716 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:03:24.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:03:24 gibba015 bash[29377]: audit 2021-03-10T15:03:23.682794+0000 mgr.gibba045.orlgmj (mgr.34412) 3960 : audit [DBG] from='client.46722 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:03:24.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:03:24 gibba015 bash[29377]: audit 2021-03-10T15:03:23.940844+0000 mon.c (mon.1) 1130 : audit [DBG] from='client.? 172.21.2.115:0/1330832294' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:03:24.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:03:24 gibba015 bash[29377]: cluster 2021-03-10T15:03:24.148173+0000 mgr.gibba045.orlgmj (mgr.34412) 3961 : cluster [DBG] pgmap v2249: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:24.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:03:24 gibba015 bash[30343]: audit 2021-03-10T15:03:23.456339+0000 mgr.gibba045.orlgmj (mgr.34412) 3959 : audit [DBG] from='client.46716 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:03:24.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:03:24 gibba015 bash[30343]: audit 2021-03-10T15:03:23.682794+0000 mgr.gibba045.orlgmj (mgr.34412) 3960 : audit [DBG] from='client.46722 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:03:24.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:03:24 gibba015 bash[30343]: audit 2021-03-10T15:03:23.940844+0000 mon.c (mon.1) 1130 : audit [DBG] from='client.? 172.21.2.115:0/1330832294' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:03:24.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:03:24 gibba015 bash[30343]: cluster 2021-03-10T15:03:24.148173+0000 mgr.gibba045.orlgmj (mgr.34412) 3961 : cluster [DBG] pgmap v2249: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:25.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:03:24 gibba045 bash[25517]: audit 2021-03-10T15:03:23.456339+0000 mgr.gibba045.orlgmj (mgr.34412) 3959 : audit [DBG] from='client.46716 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:03:25.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:03:24 gibba045 bash[25517]: audit 2021-03-10T15:03:23.682794+0000 mgr.gibba045.orlgmj (mgr.34412) 3960 : audit [DBG] from='client.46722 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:03:25.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:03:24 gibba045 bash[25517]: audit 2021-03-10T15:03:23.940844+0000 mon.c (mon.1) 1130 : audit [DBG] from='client.? 172.21.2.115:0/1330832294' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:03:25.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:03:24 gibba045 bash[25517]: cluster 2021-03-10T15:03:24.148173+0000 mgr.gibba045.orlgmj (mgr.34412) 3961 : cluster [DBG] pgmap v2249: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:27.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:03:27 gibba015 bash[29377]: cluster 2021-03-10T15:03:26.149926+0000 mgr.gibba045.orlgmj (mgr.34412) 3962 : cluster [DBG] pgmap v2250: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:27.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:03:27 gibba015 bash[29377]: audit 2021-03-10T15:03:26.626868+0000 mon.c (mon.1) 1131 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:03:27.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:03:27 gibba015 bash[29377]: audit 2021-03-10T15:03:26.830673+0000 mon.a (mon.0) 1173 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:03:27.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:03:27 gibba015 bash[29377]: audit 2021-03-10T15:03:26.834573+0000 mon.c (mon.1) 1132 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:03:27.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:03:27 gibba015 bash[29377]: audit 2021-03-10T15:03:26.836097+0000 mon.c (mon.1) 1133 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:03:27.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:03:27 gibba015 bash[29377]: audit 2021-03-10T15:03:26.837453+0000 mon.c (mon.1) 1134 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:03:27.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:03:27 gibba015 bash[29377]: audit 2021-03-10T15:03:26.839134+0000 mon.c (mon.1) 1135 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:03:27.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:03:27 gibba015 bash[29377]: audit 2021-03-10T15:03:26.842616+0000 mon.c (mon.1) 1136 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:03:27.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:03:27 gibba015 bash[29377]: audit 2021-03-10T15:03:26.843882+0000 mon.c (mon.1) 1137 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:03:27.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:03:27 gibba015 bash[30343]: cluster 2021-03-10T15:03:26.149926+0000 mgr.gibba045.orlgmj (mgr.34412) 3962 : cluster [DBG] pgmap v2250: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:27.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:03:27 gibba015 bash[30343]: audit 2021-03-10T15:03:26.626868+0000 mon.c (mon.1) 1131 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:03:27.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:03:27 gibba015 bash[30343]: audit 2021-03-10T15:03:26.830673+0000 mon.a (mon.0) 1173 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:03:27.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:03:27 gibba015 bash[30343]: audit 2021-03-10T15:03:26.834573+0000 mon.c (mon.1) 1132 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:03:27.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:03:27 gibba015 bash[30343]: audit 2021-03-10T15:03:26.836097+0000 mon.c (mon.1) 1133 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:03:27.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:03:27 gibba015 bash[30343]: audit 2021-03-10T15:03:26.837453+0000 mon.c (mon.1) 1134 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:03:27.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:03:27 gibba015 bash[30343]: audit 2021-03-10T15:03:26.839134+0000 mon.c (mon.1) 1135 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:03:27.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:03:27 gibba015 bash[30343]: audit 2021-03-10T15:03:26.842616+0000 mon.c (mon.1) 1136 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:03:27.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:03:27 gibba015 bash[30343]: audit 2021-03-10T15:03:26.843882+0000 mon.c (mon.1) 1137 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:03:27.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:03:27 gibba045 bash[25517]: cluster 2021-03-10T15:03:26.149926+0000 mgr.gibba045.orlgmj (mgr.34412) 3962 : cluster [DBG] pgmap v2250: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:27.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:03:27 gibba045 bash[25517]: audit 2021-03-10T15:03:26.626868+0000 mon.c (mon.1) 1131 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:03:27.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:03:27 gibba045 bash[25517]: audit 2021-03-10T15:03:26.830673+0000 mon.a (mon.0) 1173 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:03:27.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:03:27 gibba045 bash[25517]: audit 2021-03-10T15:03:26.834573+0000 mon.c (mon.1) 1132 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:03:27.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:03:27 gibba045 bash[25517]: audit 2021-03-10T15:03:26.836097+0000 mon.c (mon.1) 1133 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:03:27.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:03:27 gibba045 bash[25517]: audit 2021-03-10T15:03:26.837453+0000 mon.c (mon.1) 1134 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:03:27.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:03:27 gibba045 bash[25517]: audit 2021-03-10T15:03:26.839134+0000 mon.c (mon.1) 1135 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:03:27.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:03:27 gibba045 bash[25517]: audit 2021-03-10T15:03:26.842616+0000 mon.c (mon.1) 1136 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:03:27.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:03:27 gibba045 bash[25517]: audit 2021-03-10T15:03:26.843882+0000 mon.c (mon.1) 1137 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:03:28.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:03:28 gibba045 bash[25517]: cephadm 2021-03-10T15:03:26.635849+0000 mgr.gibba045.orlgmj (mgr.34412) 3963 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:03:28.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:03:28 gibba045 bash[25517]: cephadm 2021-03-10T15:03:26.637637+0000 mgr.gibba045.orlgmj (mgr.34412) 3964 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:03:28.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:03:28 gibba045 bash[25517]: cephadm 2021-03-10T15:03:26.837160+0000 mgr.gibba045.orlgmj (mgr.34412) 3965 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:03:28.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:03:28 gibba045 bash[25517]: cephadm 2021-03-10T15:03:26.839045+0000 mgr.gibba045.orlgmj (mgr.34412) 3966 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:03:28.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:03:28 gibba045 bash[25517]: cephadm 2021-03-10T15:03:26.840500+0000 mgr.gibba045.orlgmj (mgr.34412) 3967 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:03:28.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:03:28 gibba045 bash[25517]: cephadm 2021-03-10T15:03:26.840539+0000 mgr.gibba045.orlgmj (mgr.34412) 3968 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:03:28.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:03:28 gibba045 bash[25517]: cephadm 2021-03-10T15:03:26.841981+0000 mgr.gibba045.orlgmj (mgr.34412) 3969 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:03:28.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:03:28 gibba045 bash[25517]: cephadm 2021-03-10T15:03:26.842017+0000 mgr.gibba045.orlgmj (mgr.34412) 3970 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:03:28.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:03:28 gibba045 bash[25517]: cephadm 2021-03-10T15:03:26.843743+0000 mgr.gibba045.orlgmj (mgr.34412) 3971 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:03:28.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:03:28 gibba045 bash[25517]: cephadm 2021-03-10T15:03:26.845677+0000 mgr.gibba045.orlgmj (mgr.34412) 3972 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:03:28.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:03:28 gibba045 bash[25517]: cephadm 2021-03-10T15:03:26.845713+0000 mgr.gibba045.orlgmj (mgr.34412) 3973 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:03:28.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:03:28 gibba045 bash[25517]: cephadm 2021-03-10T15:03:26.846808+0000 mgr.gibba045.orlgmj (mgr.34412) 3974 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:03:28.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:03:28 gibba045 bash[25517]: cephadm 2021-03-10T15:03:26.847123+0000 mgr.gibba045.orlgmj (mgr.34412) 3975 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:03:28.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:03:28 gibba045 bash[25517]: cephadm 2021-03-10T15:03:26.848036+0000 mgr.gibba045.orlgmj (mgr.34412) 3976 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:03:28.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:03:28 gibba045 bash[25517]: cephadm 2021-03-10T15:03:26.848074+0000 mgr.gibba045.orlgmj (mgr.34412) 3977 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:03:28.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:03:28 gibba045 bash[25517]: cephadm 2021-03-10T15:03:26.848180+0000 mgr.gibba045.orlgmj (mgr.34412) 3978 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:03:28.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:03:28 gibba015 bash[29377]: cephadm 2021-03-10T15:03:26.635849+0000 mgr.gibba045.orlgmj (mgr.34412) 3963 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:03:28.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:03:28 gibba015 bash[29377]: cephadm 2021-03-10T15:03:26.637637+0000 mgr.gibba045.orlgmj (mgr.34412) 3964 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:03:28.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:03:28 gibba015 bash[29377]: cephadm 2021-03-10T15:03:26.837160+0000 mgr.gibba045.orlgmj (mgr.34412) 3965 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:03:28.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:03:28 gibba015 bash[29377]: cephadm 2021-03-10T15:03:26.839045+0000 mgr.gibba045.orlgmj (mgr.34412) 3966 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:03:28.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:03:28 gibba015 bash[29377]: cephadm 2021-03-10T15:03:26.840500+0000 mgr.gibba045.orlgmj (mgr.34412) 3967 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:03:28.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:03:28 gibba015 bash[29377]: cephadm 2021-03-10T15:03:26.840539+0000 mgr.gibba045.orlgmj (mgr.34412) 3968 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:03:28.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:03:28 gibba015 bash[29377]: cephadm 2021-03-10T15:03:26.841981+0000 mgr.gibba045.orlgmj (mgr.34412) 3969 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:03:28.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:03:28 gibba015 bash[29377]: cephadm 2021-03-10T15:03:26.842017+0000 mgr.gibba045.orlgmj (mgr.34412) 3970 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:03:28.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:03:28 gibba015 bash[29377]: cephadm 2021-03-10T15:03:26.843743+0000 mgr.gibba045.orlgmj (mgr.34412) 3971 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:03:28.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:03:28 gibba015 bash[29377]: cephadm 2021-03-10T15:03:26.845677+0000 mgr.gibba045.orlgmj (mgr.34412) 3972 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:03:28.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:03:28 gibba015 bash[29377]: cephadm 2021-03-10T15:03:26.845713+0000 mgr.gibba045.orlgmj (mgr.34412) 3973 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:03:28.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:03:28 gibba015 bash[29377]: cephadm 2021-03-10T15:03:26.846808+0000 mgr.gibba045.orlgmj (mgr.34412) 3974 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:03:28.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:03:28 gibba015 bash[29377]: cephadm 2021-03-10T15:03:26.847123+0000 mgr.gibba045.orlgmj (mgr.34412) 3975 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:03:28.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:03:28 gibba015 bash[29377]: cephadm 2021-03-10T15:03:26.848036+0000 mgr.gibba045.orlgmj (mgr.34412) 3976 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:03:28.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:03:28 gibba015 bash[29377]: cephadm 2021-03-10T15:03:26.848074+0000 mgr.gibba045.orlgmj (mgr.34412) 3977 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:03:28.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:03:28 gibba015 bash[29377]: cephadm 2021-03-10T15:03:26.848180+0000 mgr.gibba045.orlgmj (mgr.34412) 3978 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:03:28.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:03:28 gibba015 bash[30343]: cephadm 2021-03-10T15:03:26.635849+0000 mgr.gibba045.orlgmj (mgr.34412) 3963 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:03:28.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:03:28 gibba015 bash[30343]: cephadm 2021-03-10T15:03:26.637637+0000 mgr.gibba045.orlgmj (mgr.34412) 3964 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:03:28.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:03:28 gibba015 bash[30343]: cephadm 2021-03-10T15:03:26.837160+0000 mgr.gibba045.orlgmj (mgr.34412) 3965 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:03:28.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:03:28 gibba015 bash[30343]: cephadm 2021-03-10T15:03:26.839045+0000 mgr.gibba045.orlgmj (mgr.34412) 3966 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:03:28.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:03:28 gibba015 bash[30343]: cephadm 2021-03-10T15:03:26.840500+0000 mgr.gibba045.orlgmj (mgr.34412) 3967 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:03:28.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:03:28 gibba015 bash[30343]: cephadm 2021-03-10T15:03:26.840539+0000 mgr.gibba045.orlgmj (mgr.34412) 3968 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:03:28.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:03:28 gibba015 bash[30343]: cephadm 2021-03-10T15:03:26.841981+0000 mgr.gibba045.orlgmj (mgr.34412) 3969 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:03:28.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:03:28 gibba015 bash[30343]: cephadm 2021-03-10T15:03:26.842017+0000 mgr.gibba045.orlgmj (mgr.34412) 3970 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:03:28.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:03:28 gibba015 bash[30343]: cephadm 2021-03-10T15:03:26.843743+0000 mgr.gibba045.orlgmj (mgr.34412) 3971 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:03:28.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:03:28 gibba015 bash[30343]: cephadm 2021-03-10T15:03:26.845677+0000 mgr.gibba045.orlgmj (mgr.34412) 3972 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:03:28.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:03:28 gibba015 bash[30343]: cephadm 2021-03-10T15:03:26.845713+0000 mgr.gibba045.orlgmj (mgr.34412) 3973 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:03:28.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:03:28 gibba015 bash[30343]: cephadm 2021-03-10T15:03:26.846808+0000 mgr.gibba045.orlgmj (mgr.34412) 3974 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:03:28.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:03:28 gibba015 bash[30343]: cephadm 2021-03-10T15:03:26.847123+0000 mgr.gibba045.orlgmj (mgr.34412) 3975 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:03:28.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:03:28 gibba015 bash[30343]: cephadm 2021-03-10T15:03:26.848036+0000 mgr.gibba045.orlgmj (mgr.34412) 3976 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:03:28.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:03:28 gibba015 bash[30343]: cephadm 2021-03-10T15:03:26.848074+0000 mgr.gibba045.orlgmj (mgr.34412) 3977 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:03:28.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:03:28 gibba015 bash[30343]: cephadm 2021-03-10T15:03:26.848180+0000 mgr.gibba045.orlgmj (mgr.34412) 3978 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:03:29.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:03:29 gibba045 bash[25517]: cluster 2021-03-10T15:03:28.151617+0000 mgr.gibba045.orlgmj (mgr.34412) 3979 : cluster [DBG] pgmap v2251: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:29.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:03:29 gibba015 bash[29377]: cluster 2021-03-10T15:03:28.151617+0000 mgr.gibba045.orlgmj (mgr.34412) 3979 : cluster [DBG] pgmap v2251: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:29.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:03:29 gibba015 bash[30343]: cluster 2021-03-10T15:03:28.151617+0000 mgr.gibba045.orlgmj (mgr.34412) 3979 : cluster [DBG] pgmap v2251: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:31.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:03:31 gibba045 bash[25517]: cluster 2021-03-10T15:03:30.152376+0000 mgr.gibba045.orlgmj (mgr.34412) 3980 : cluster [DBG] pgmap v2252: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:31.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:03:31 gibba015 bash[29377]: cluster 2021-03-10T15:03:30.152376+0000 mgr.gibba045.orlgmj (mgr.34412) 3980 : cluster [DBG] pgmap v2252: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:31.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:03:31 gibba015 bash[30343]: cluster 2021-03-10T15:03:30.152376+0000 mgr.gibba045.orlgmj (mgr.34412) 3980 : cluster [DBG] pgmap v2252: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:33.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:03:33 gibba045 bash[25517]: cluster 2021-03-10T15:03:32.153353+0000 mgr.gibba045.orlgmj (mgr.34412) 3981 : cluster [DBG] pgmap v2253: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:33.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:03:33 gibba015 bash[29377]: cluster 2021-03-10T15:03:32.153353+0000 mgr.gibba045.orlgmj (mgr.34412) 3981 : cluster [DBG] pgmap v2253: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:33.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:03:33 gibba015 bash[30343]: cluster 2021-03-10T15:03:32.153353+0000 mgr.gibba045.orlgmj (mgr.34412) 3981 : cluster [DBG] pgmap v2253: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:34.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:03:34 gibba015 bash[29377]: cluster 2021-03-10T15:03:34.154490+0000 mgr.gibba045.orlgmj (mgr.34412) 3982 : cluster [DBG] pgmap v2254: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:34.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:03:34 gibba015 bash[30343]: cluster 2021-03-10T15:03:34.154490+0000 mgr.gibba045.orlgmj (mgr.34412) 3982 : cluster [DBG] pgmap v2254: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:35.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:03:34 gibba045 bash[25517]: cluster 2021-03-10T15:03:34.154490+0000 mgr.gibba045.orlgmj (mgr.34412) 3982 : cluster [DBG] pgmap v2254: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:37.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:03:37 gibba015 bash[29377]: cluster 2021-03-10T15:03:36.155269+0000 mgr.gibba045.orlgmj (mgr.34412) 3983 : cluster [DBG] pgmap v2255: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:37.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:03:37 gibba015 bash[30343]: cluster 2021-03-10T15:03:36.155269+0000 mgr.gibba045.orlgmj (mgr.34412) 3983 : cluster [DBG] pgmap v2255: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:37.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:03:37 gibba045 bash[25517]: cluster 2021-03-10T15:03:36.155269+0000 mgr.gibba045.orlgmj (mgr.34412) 3983 : cluster [DBG] pgmap v2255: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:39.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:03:39 gibba045 bash[25517]: cluster 2021-03-10T15:03:38.156711+0000 mgr.gibba045.orlgmj (mgr.34412) 3984 : cluster [DBG] pgmap v2256: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:39.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:03:39 gibba015 bash[29377]: cluster 2021-03-10T15:03:38.156711+0000 mgr.gibba045.orlgmj (mgr.34412) 3984 : cluster [DBG] pgmap v2256: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:39.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:03:39 gibba015 bash[30343]: cluster 2021-03-10T15:03:38.156711+0000 mgr.gibba045.orlgmj (mgr.34412) 3984 : cluster [DBG] pgmap v2256: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:41.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:03:41 gibba045 bash[25517]: cluster 2021-03-10T15:03:40.158235+0000 mgr.gibba045.orlgmj (mgr.34412) 3985 : cluster [DBG] pgmap v2257: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:41.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:03:41 gibba015 bash[29377]: cluster 2021-03-10T15:03:40.158235+0000 mgr.gibba045.orlgmj (mgr.34412) 3985 : cluster [DBG] pgmap v2257: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:41.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:03:41 gibba015 bash[30343]: cluster 2021-03-10T15:03:40.158235+0000 mgr.gibba045.orlgmj (mgr.34412) 3985 : cluster [DBG] pgmap v2257: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:43.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:03:43 gibba045 bash[25517]: cephadm 2021-03-10T15:03:41.864208+0000 mgr.gibba045.orlgmj (mgr.34412) 3986 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:03:43.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:03:43 gibba045 bash[25517]: cluster 2021-03-10T15:03:42.159195+0000 mgr.gibba045.orlgmj (mgr.34412) 3987 : cluster [DBG] pgmap v2258: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:43.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:03:43 gibba015 bash[29377]: cephadm 2021-03-10T15:03:41.864208+0000 mgr.gibba045.orlgmj (mgr.34412) 3986 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:03:43.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:03:43 gibba015 bash[29377]: cluster 2021-03-10T15:03:42.159195+0000 mgr.gibba045.orlgmj (mgr.34412) 3987 : cluster [DBG] pgmap v2258: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:43.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:03:43 gibba015 bash[30343]: cephadm 2021-03-10T15:03:41.864208+0000 mgr.gibba045.orlgmj (mgr.34412) 3986 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:03:43.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:03:43 gibba015 bash[30343]: cluster 2021-03-10T15:03:42.159195+0000 mgr.gibba045.orlgmj (mgr.34412) 3987 : cluster [DBG] pgmap v2258: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:44.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:03:44 gibba015 bash[29377]: cluster 2021-03-10T15:03:44.160313+0000 mgr.gibba045.orlgmj (mgr.34412) 3988 : cluster [DBG] pgmap v2259: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:44.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:03:44 gibba015 bash[30343]: cluster 2021-03-10T15:03:44.160313+0000 mgr.gibba045.orlgmj (mgr.34412) 3988 : cluster [DBG] pgmap v2259: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:45.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:03:44 gibba045 bash[25517]: cluster 2021-03-10T15:03:44.160313+0000 mgr.gibba045.orlgmj (mgr.34412) 3988 : cluster [DBG] pgmap v2259: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:47.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:03:47 gibba045 bash[25517]: cluster 2021-03-10T15:03:46.162062+0000 mgr.gibba045.orlgmj (mgr.34412) 3989 : cluster [DBG] pgmap v2260: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:47.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:03:47 gibba015 bash[29377]: cluster 2021-03-10T15:03:46.162062+0000 mgr.gibba045.orlgmj (mgr.34412) 3989 : cluster [DBG] pgmap v2260: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:47.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:03:47 gibba015 bash[30343]: cluster 2021-03-10T15:03:46.162062+0000 mgr.gibba045.orlgmj (mgr.34412) 3989 : cluster [DBG] pgmap v2260: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:49.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:03:49 gibba045 bash[25517]: cluster 2021-03-10T15:03:48.162854+0000 mgr.gibba045.orlgmj (mgr.34412) 3990 : cluster [DBG] pgmap v2261: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:49.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:03:49 gibba015 bash[29377]: cluster 2021-03-10T15:03:48.162854+0000 mgr.gibba045.orlgmj (mgr.34412) 3990 : cluster [DBG] pgmap v2261: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:49.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:03:49 gibba015 bash[30343]: cluster 2021-03-10T15:03:48.162854+0000 mgr.gibba045.orlgmj (mgr.34412) 3990 : cluster [DBG] pgmap v2261: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:51.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:03:51 gibba045 bash[25517]: cluster 2021-03-10T15:03:50.163913+0000 mgr.gibba045.orlgmj (mgr.34412) 3991 : cluster [DBG] pgmap v2262: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:51.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:03:51 gibba015 bash[29377]: cluster 2021-03-10T15:03:50.163913+0000 mgr.gibba045.orlgmj (mgr.34412) 3991 : cluster [DBG] pgmap v2262: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:51.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:03:51 gibba015 bash[30343]: cluster 2021-03-10T15:03:50.163913+0000 mgr.gibba045.orlgmj (mgr.34412) 3991 : cluster [DBG] pgmap v2262: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:53.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:03:53 gibba045 bash[25517]: cluster 2021-03-10T15:03:52.164945+0000 mgr.gibba045.orlgmj (mgr.34412) 3992 : cluster [DBG] pgmap v2263: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:53.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:03:53 gibba045 bash[25517]: audit 2021-03-10T15:03:52.965562+0000 mon.c (mon.1) 1138 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:03:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:03:53 gibba045 bash[25517]: audit 2021-03-10T15:03:52.966574+0000 mon.c (mon.1) 1139 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:03:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:03:53 gibba045 bash[25517]: audit 2021-03-10T15:03:52.966767+0000 mon.a (mon.0) 1174 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:03:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:03:53 gibba045 bash[25517]: audit 2021-03-10T15:03:52.968493+0000 mon.a (mon.0) 1175 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:03:53.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:03:53 gibba045 bash[25517]: audit 2021-03-10T15:03:52.970147+0000 mon.c (mon.1) 1140 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T15:03:53.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:03:53 gibba045 bash[25517]: audit 2021-03-10T15:03:52.971084+0000 mon.c (mon.1) 1141 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:03:53.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:03:53 gibba045 bash[25517]: audit 2021-03-10T15:03:52.971294+0000 mon.a (mon.0) 1176 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T15:03:53.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:03:53 gibba045 bash[25517]: audit 2021-03-10T15:03:52.971959+0000 mon.c (mon.1) 1142 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:03:53.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:03:53 gibba045 bash[25517]: audit 2021-03-10T15:03:52.973142+0000 mon.c (mon.1) 1143 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T15:03:53.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:03:53 gibba045 bash[25517]: audit 2021-03-10T15:03:52.973208+0000 mon.a (mon.0) 1177 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:03:53.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:03:53 gibba045 bash[25517]: audit 2021-03-10T15:03:52.975098+0000 mon.a (mon.0) 1178 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:03:53.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:03:53 gibba045 bash[25517]: audit 2021-03-10T15:03:52.976234+0000 mon.a (mon.0) 1179 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T15:03:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:03:53 gibba015 bash[29377]: cluster 2021-03-10T15:03:52.164945+0000 mgr.gibba045.orlgmj (mgr.34412) 3992 : cluster [DBG] pgmap v2263: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:03:53 gibba015 bash[29377]: audit 2021-03-10T15:03:52.965562+0000 mon.c (mon.1) 1138 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:03:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:03:53 gibba015 bash[29377]: audit 2021-03-10T15:03:52.966574+0000 mon.c (mon.1) 1139 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:03:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:03:53 gibba015 bash[29377]: audit 2021-03-10T15:03:52.966767+0000 mon.a (mon.0) 1174 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:03:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:03:53 gibba015 bash[29377]: audit 2021-03-10T15:03:52.968493+0000 mon.a (mon.0) 1175 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:03:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:03:53 gibba015 bash[29377]: audit 2021-03-10T15:03:52.970147+0000 mon.c (mon.1) 1140 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T15:03:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:03:53 gibba015 bash[29377]: audit 2021-03-10T15:03:52.971084+0000 mon.c (mon.1) 1141 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:03:53.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:03:53 gibba015 bash[29377]: audit 2021-03-10T15:03:52.971294+0000 mon.a (mon.0) 1176 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T15:03:53.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:03:53 gibba015 bash[29377]: audit 2021-03-10T15:03:52.971959+0000 mon.c (mon.1) 1142 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:03:53.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:03:53 gibba015 bash[29377]: audit 2021-03-10T15:03:52.973142+0000 mon.c (mon.1) 1143 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T15:03:53.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:03:53 gibba015 bash[29377]: audit 2021-03-10T15:03:52.973208+0000 mon.a (mon.0) 1177 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:03:53.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:03:53 gibba015 bash[29377]: audit 2021-03-10T15:03:52.975098+0000 mon.a (mon.0) 1178 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:03:53.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:03:53 gibba015 bash[29377]: audit 2021-03-10T15:03:52.976234+0000 mon.a (mon.0) 1179 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T15:03:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:03:53 gibba015 bash[30343]: cluster 2021-03-10T15:03:52.164945+0000 mgr.gibba045.orlgmj (mgr.34412) 3992 : cluster [DBG] pgmap v2263: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:03:53 gibba015 bash[30343]: audit 2021-03-10T15:03:52.965562+0000 mon.c (mon.1) 1138 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:03:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:03:53 gibba015 bash[30343]: audit 2021-03-10T15:03:52.966574+0000 mon.c (mon.1) 1139 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:03:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:03:53 gibba015 bash[30343]: audit 2021-03-10T15:03:52.966767+0000 mon.a (mon.0) 1174 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:03:53.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:03:53 gibba015 bash[30343]: audit 2021-03-10T15:03:52.968493+0000 mon.a (mon.0) 1175 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:03:53.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:03:53 gibba015 bash[30343]: audit 2021-03-10T15:03:52.970147+0000 mon.c (mon.1) 1140 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T15:03:53.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:03:53 gibba015 bash[30343]: audit 2021-03-10T15:03:52.971084+0000 mon.c (mon.1) 1141 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:03:53.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:03:53 gibba015 bash[30343]: audit 2021-03-10T15:03:52.971294+0000 mon.a (mon.0) 1176 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T15:03:53.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:03:53 gibba015 bash[30343]: audit 2021-03-10T15:03:52.971959+0000 mon.c (mon.1) 1142 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:03:53.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:03:53 gibba015 bash[30343]: audit 2021-03-10T15:03:52.973142+0000 mon.c (mon.1) 1143 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T15:03:53.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:03:53 gibba015 bash[30343]: audit 2021-03-10T15:03:52.973208+0000 mon.a (mon.0) 1177 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:03:53.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:03:53 gibba015 bash[30343]: audit 2021-03-10T15:03:52.975098+0000 mon.a (mon.0) 1178 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:03:53.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:03:53 gibba015 bash[30343]: audit 2021-03-10T15:03:52.976234+0000 mon.a (mon.0) 1179 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T15:03:54.189 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:03:54.420 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:03:54.420 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (74m) 9m ago 79m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:03:54.420 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (79m) 8m ago 79m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:03:54.421 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (75m) 8m ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:03:54.421 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (75m) 8m ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:03:54.421 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (74m) 9m ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:03:54.421 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (74m) 9m ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:03:54.422 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (73m) 8m ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:03:54.422 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (73m) 9m ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:03:54.422 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (80m) 9m ago 80m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:03:54.423 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (80m) 8m ago 80m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:03:54.423 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (72m) 9m ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:03:54.423 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (72m) 9m ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:03:54.423 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (72m) 9m ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:03:54.424 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (71m) 9m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:03:54.424 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (71m) 8m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:03:54.424 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (70m) 8m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:03:54.424 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (70m) 8m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:03:54.425 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (69m) 8m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:03:54.425 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (79m) 8m ago 80m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:03:54.425 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 8m ago 78m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:03:54.673 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:03:54.673 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:03:54.673 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:03:54.673 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:03:54.674 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:03:54.674 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:03:54.674 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:03:54.674 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:03:54.675 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:03:54.675 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:03:54.675 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:03:54.675 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:03:54.676 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:03:54.676 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:03:54.676 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:03:54.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:03:54 gibba015 bash[29377]: cluster 2021-03-10T15:03:54.165463+0000 mgr.gibba045.orlgmj (mgr.34412) 3993 : cluster [DBG] pgmap v2264: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:54.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:03:54 gibba015 bash[29377]: audit 2021-03-10T15:03:54.179881+0000 mgr.gibba045.orlgmj (mgr.34412) 3994 : audit [DBG] from='client.56722 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:03:54.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:03:54 gibba015 bash[29377]: audit 2021-03-10T15:03:54.407550+0000 mgr.gibba045.orlgmj (mgr.34412) 3995 : audit [DBG] from='client.46740 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:03:54.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:03:54 gibba015 bash[30343]: cluster 2021-03-10T15:03:54.165463+0000 mgr.gibba045.orlgmj (mgr.34412) 3993 : cluster [DBG] pgmap v2264: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:54.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:03:54 gibba015 bash[30343]: audit 2021-03-10T15:03:54.179881+0000 mgr.gibba045.orlgmj (mgr.34412) 3994 : audit [DBG] from='client.56722 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:03:54.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:03:54 gibba015 bash[30343]: audit 2021-03-10T15:03:54.407550+0000 mgr.gibba045.orlgmj (mgr.34412) 3995 : audit [DBG] from='client.46740 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:03:55.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:03:54 gibba045 bash[25517]: cluster 2021-03-10T15:03:54.165463+0000 mgr.gibba045.orlgmj (mgr.34412) 3993 : cluster [DBG] pgmap v2264: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:55.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:03:54 gibba045 bash[25517]: audit 2021-03-10T15:03:54.179881+0000 mgr.gibba045.orlgmj (mgr.34412) 3994 : audit [DBG] from='client.56722 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:03:55.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:03:54 gibba045 bash[25517]: audit 2021-03-10T15:03:54.407550+0000 mgr.gibba045.orlgmj (mgr.34412) 3995 : audit [DBG] from='client.46740 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:03:55.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:03:55 gibba015 bash[29377]: audit 2021-03-10T15:03:54.669192+0000 mon.a (mon.0) 1180 : audit [DBG] from='client.? 172.21.2.115:0/1870130639' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:03:55.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:03:55 gibba015 bash[30343]: audit 2021-03-10T15:03:54.669192+0000 mon.a (mon.0) 1180 : audit [DBG] from='client.? 172.21.2.115:0/1870130639' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:03:56.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:03:55 gibba045 bash[25517]: audit 2021-03-10T15:03:54.669192+0000 mon.a (mon.0) 1180 : audit [DBG] from='client.? 172.21.2.115:0/1870130639' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:03:56.881 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:03:56 gibba045 bash[25517]: cluster 2021-03-10T15:03:56.167255+0000 mgr.gibba045.orlgmj (mgr.34412) 3996 : cluster [DBG] pgmap v2265: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:56.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:03:56 gibba015 bash[29377]: cluster 2021-03-10T15:03:56.167255+0000 mgr.gibba045.orlgmj (mgr.34412) 3996 : cluster [DBG] pgmap v2265: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:56.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:03:56 gibba015 bash[30343]: cluster 2021-03-10T15:03:56.167255+0000 mgr.gibba045.orlgmj (mgr.34412) 3996 : cluster [DBG] pgmap v2265: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:57.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:03:57 gibba015 bash[29377]: cephadm 2021-03-10T15:03:56.880233+0000 mgr.gibba045.orlgmj (mgr.34412) 3997 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:03:57.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:03:57 gibba015 bash[30343]: cephadm 2021-03-10T15:03:56.880233+0000 mgr.gibba045.orlgmj (mgr.34412) 3997 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:03:58.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:03:57 gibba045 bash[25517]: cephadm 2021-03-10T15:03:56.880233+0000 mgr.gibba045.orlgmj (mgr.34412) 3997 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:03:58.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:03:58 gibba015 bash[29377]: cluster 2021-03-10T15:03:58.168755+0000 mgr.gibba045.orlgmj (mgr.34412) 3998 : cluster [DBG] pgmap v2266: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:58.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:03:58 gibba015 bash[30343]: cluster 2021-03-10T15:03:58.168755+0000 mgr.gibba045.orlgmj (mgr.34412) 3998 : cluster [DBG] pgmap v2266: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:59.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:03:58 gibba045 bash[25517]: cluster 2021-03-10T15:03:58.168755+0000 mgr.gibba045.orlgmj (mgr.34412) 3998 : cluster [DBG] pgmap v2266: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:01.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:04:01 gibba045 bash[25517]: cluster 2021-03-10T15:04:00.170248+0000 mgr.gibba045.orlgmj (mgr.34412) 3999 : cluster [DBG] pgmap v2267: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:01.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:04:01 gibba015 bash[29377]: cluster 2021-03-10T15:04:00.170248+0000 mgr.gibba045.orlgmj (mgr.34412) 3999 : cluster [DBG] pgmap v2267: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:01.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:04:01 gibba015 bash[30343]: cluster 2021-03-10T15:04:00.170248+0000 mgr.gibba045.orlgmj (mgr.34412) 3999 : cluster [DBG] pgmap v2267: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:03.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:04:03 gibba045 bash[25517]: cluster 2021-03-10T15:04:02.171409+0000 mgr.gibba045.orlgmj (mgr.34412) 4000 : cluster [DBG] pgmap v2268: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:03.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:04:03 gibba015 bash[29377]: cluster 2021-03-10T15:04:02.171409+0000 mgr.gibba045.orlgmj (mgr.34412) 4000 : cluster [DBG] pgmap v2268: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:03.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:04:03 gibba015 bash[30343]: cluster 2021-03-10T15:04:02.171409+0000 mgr.gibba045.orlgmj (mgr.34412) 4000 : cluster [DBG] pgmap v2268: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:04.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:04:04 gibba015 bash[29377]: cluster 2021-03-10T15:04:04.172739+0000 mgr.gibba045.orlgmj (mgr.34412) 4001 : cluster [DBG] pgmap v2269: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:04.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:04:04 gibba015 bash[30343]: cluster 2021-03-10T15:04:04.172739+0000 mgr.gibba045.orlgmj (mgr.34412) 4001 : cluster [DBG] pgmap v2269: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:05.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:04:04 gibba045 bash[25517]: cluster 2021-03-10T15:04:04.172739+0000 mgr.gibba045.orlgmj (mgr.34412) 4001 : cluster [DBG] pgmap v2269: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:07.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:04:07 gibba045 bash[25517]: cluster 2021-03-10T15:04:06.173683+0000 mgr.gibba045.orlgmj (mgr.34412) 4002 : cluster [DBG] pgmap v2270: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:07.730 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:04:07 gibba015 bash[29377]: cluster 2021-03-10T15:04:06.173683+0000 mgr.gibba045.orlgmj (mgr.34412) 4002 : cluster [DBG] pgmap v2270: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:07.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:04:07 gibba015 bash[30343]: cluster 2021-03-10T15:04:06.173683+0000 mgr.gibba045.orlgmj (mgr.34412) 4002 : cluster [DBG] pgmap v2270: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:09.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:04:09 gibba045 bash[25517]: cluster 2021-03-10T15:04:08.175197+0000 mgr.gibba045.orlgmj (mgr.34412) 4003 : cluster [DBG] pgmap v2271: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:09.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:04:09 gibba015 bash[29377]: cluster 2021-03-10T15:04:08.175197+0000 mgr.gibba045.orlgmj (mgr.34412) 4003 : cluster [DBG] pgmap v2271: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:09.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:04:09 gibba015 bash[30343]: cluster 2021-03-10T15:04:08.175197+0000 mgr.gibba045.orlgmj (mgr.34412) 4003 : cluster [DBG] pgmap v2271: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:11.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:04:11 gibba045 bash[25517]: cluster 2021-03-10T15:04:10.176891+0000 mgr.gibba045.orlgmj (mgr.34412) 4004 : cluster [DBG] pgmap v2272: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:11.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:04:11 gibba015 bash[29377]: cluster 2021-03-10T15:04:10.176891+0000 mgr.gibba045.orlgmj (mgr.34412) 4004 : cluster [DBG] pgmap v2272: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:11.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:04:11 gibba015 bash[30343]: cluster 2021-03-10T15:04:10.176891+0000 mgr.gibba045.orlgmj (mgr.34412) 4004 : cluster [DBG] pgmap v2272: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:13.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:04:13 gibba045 bash[25517]: cephadm 2021-03-10T15:04:11.896324+0000 mgr.gibba045.orlgmj (mgr.34412) 4005 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:04:13.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:04:13 gibba045 bash[25517]: cluster 2021-03-10T15:04:12.178721+0000 mgr.gibba045.orlgmj (mgr.34412) 4006 : cluster [DBG] pgmap v2273: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:13.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:04:13 gibba015 bash[29377]: cephadm 2021-03-10T15:04:11.896324+0000 mgr.gibba045.orlgmj (mgr.34412) 4005 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:04:13.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:04:13 gibba015 bash[29377]: cluster 2021-03-10T15:04:12.178721+0000 mgr.gibba045.orlgmj (mgr.34412) 4006 : cluster [DBG] pgmap v2273: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:13.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:04:13 gibba015 bash[30343]: cephadm 2021-03-10T15:04:11.896324+0000 mgr.gibba045.orlgmj (mgr.34412) 4005 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:04:13.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:04:13 gibba015 bash[30343]: cluster 2021-03-10T15:04:12.178721+0000 mgr.gibba045.orlgmj (mgr.34412) 4006 : cluster [DBG] pgmap v2273: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:14.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:04:14 gibba015 bash[29377]: cluster 2021-03-10T15:04:14.180086+0000 mgr.gibba045.orlgmj (mgr.34412) 4007 : cluster [DBG] pgmap v2274: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:14.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:04:14 gibba015 bash[30343]: cluster 2021-03-10T15:04:14.180086+0000 mgr.gibba045.orlgmj (mgr.34412) 4007 : cluster [DBG] pgmap v2274: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:15.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:04:14 gibba045 bash[25517]: cluster 2021-03-10T15:04:14.180086+0000 mgr.gibba045.orlgmj (mgr.34412) 4007 : cluster [DBG] pgmap v2274: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:17.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:04:17 gibba045 bash[25517]: cluster 2021-03-10T15:04:16.181767+0000 mgr.gibba045.orlgmj (mgr.34412) 4008 : cluster [DBG] pgmap v2275: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:17.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:04:17 gibba015 bash[29377]: cluster 2021-03-10T15:04:16.181767+0000 mgr.gibba045.orlgmj (mgr.34412) 4008 : cluster [DBG] pgmap v2275: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:17.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:04:17 gibba015 bash[30343]: cluster 2021-03-10T15:04:16.181767+0000 mgr.gibba045.orlgmj (mgr.34412) 4008 : cluster [DBG] pgmap v2275: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:19.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:04:19 gibba045 bash[25517]: cluster 2021-03-10T15:04:18.182585+0000 mgr.gibba045.orlgmj (mgr.34412) 4009 : cluster [DBG] pgmap v2276: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:19.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:04:19 gibba015 bash[29377]: cluster 2021-03-10T15:04:18.182585+0000 mgr.gibba045.orlgmj (mgr.34412) 4009 : cluster [DBG] pgmap v2276: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:19.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:04:19 gibba015 bash[30343]: cluster 2021-03-10T15:04:18.182585+0000 mgr.gibba045.orlgmj (mgr.34412) 4009 : cluster [DBG] pgmap v2276: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:21.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:04:21 gibba045 bash[25517]: cluster 2021-03-10T15:04:20.184119+0000 mgr.gibba045.orlgmj (mgr.34412) 4010 : cluster [DBG] pgmap v2277: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:21.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:04:21 gibba015 bash[29377]: cluster 2021-03-10T15:04:20.184119+0000 mgr.gibba045.orlgmj (mgr.34412) 4010 : cluster [DBG] pgmap v2277: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:21.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:04:21 gibba015 bash[30343]: cluster 2021-03-10T15:04:20.184119+0000 mgr.gibba045.orlgmj (mgr.34412) 4010 : cluster [DBG] pgmap v2277: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:23.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:04:23 gibba045 bash[25517]: cluster 2021-03-10T15:04:22.185492+0000 mgr.gibba045.orlgmj (mgr.34412) 4011 : cluster [DBG] pgmap v2278: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:23.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:04:23 gibba015 bash[29377]: cluster 2021-03-10T15:04:22.185492+0000 mgr.gibba045.orlgmj (mgr.34412) 4011 : cluster [DBG] pgmap v2278: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:23.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:04:23 gibba015 bash[30343]: cluster 2021-03-10T15:04:22.185492+0000 mgr.gibba045.orlgmj (mgr.34412) 4011 : cluster [DBG] pgmap v2278: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:24.922 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:04:24.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:04:24 gibba015 bash[29377]: cluster 2021-03-10T15:04:24.186579+0000 mgr.gibba045.orlgmj (mgr.34412) 4012 : cluster [DBG] pgmap v2279: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:24.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:04:24 gibba015 bash[30343]: cluster 2021-03-10T15:04:24.186579+0000 mgr.gibba045.orlgmj (mgr.34412) 4012 : cluster [DBG] pgmap v2279: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:25.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:04:24 gibba045 bash[25517]: cluster 2021-03-10T15:04:24.186579+0000 mgr.gibba045.orlgmj (mgr.34412) 4012 : cluster [DBG] pgmap v2279: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:25.149 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:04:25.149 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (75m) 10m ago 80m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:04:25.149 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (80m) 9m ago 80m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:04:25.150 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (75m) 9m ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:04:25.150 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (75m) 9m ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:04:25.150 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (74m) 10m ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:04:25.151 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (74m) 10m ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:04:25.151 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (74m) 9m ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:04:25.151 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (74m) 10m ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:04:25.151 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (80m) 10m ago 80m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:04:25.152 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (80m) 9m ago 80m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:04:25.152 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (73m) 10m ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:04:25.152 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (73m) 10m ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:04:25.152 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (72m) 10m ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:04:25.153 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (72m) 10m ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:04:25.153 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (71m) 9m ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:04:25.153 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (71m) 9m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:04:25.153 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (70m) 9m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:04:25.154 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (70m) 9m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:04:25.154 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (80m) 9m ago 80m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:04:25.154 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 9m ago 78m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:04:25.396 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:04:25.396 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:04:25.397 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:04:25.397 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:04:25.397 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:04:25.397 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:04:25.398 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:04:25.398 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:04:25.398 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:04:25.398 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:04:25.399 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:04:25.399 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:04:25.399 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:04:25.399 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:04:25.400 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:04:25.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:04:25 gibba015 bash[29377]: audit 2021-03-10T15:04:24.912067+0000 mgr.gibba045.orlgmj (mgr.34412) 4013 : audit [DBG] from='client.46752 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:04:25.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:04:25 gibba015 bash[29377]: audit 2021-03-10T15:04:25.136551+0000 mgr.gibba045.orlgmj (mgr.34412) 4014 : audit [DBG] from='client.56746 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:04:25.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:04:25 gibba015 bash[29377]: audit 2021-03-10T15:04:25.392028+0000 mon.c (mon.1) 1144 : audit [DBG] from='client.? 172.21.2.115:0/3482287693' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:04:25.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:04:25 gibba015 bash[30343]: audit 2021-03-10T15:04:24.912067+0000 mgr.gibba045.orlgmj (mgr.34412) 4013 : audit [DBG] from='client.46752 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:04:25.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:04:25 gibba015 bash[30343]: audit 2021-03-10T15:04:25.136551+0000 mgr.gibba045.orlgmj (mgr.34412) 4014 : audit [DBG] from='client.56746 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:04:25.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:04:25 gibba015 bash[30343]: audit 2021-03-10T15:04:25.392028+0000 mon.c (mon.1) 1144 : audit [DBG] from='client.? 172.21.2.115:0/3482287693' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:04:26.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:04:25 gibba045 bash[25517]: audit 2021-03-10T15:04:24.912067+0000 mgr.gibba045.orlgmj (mgr.34412) 4013 : audit [DBG] from='client.46752 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:04:26.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:04:25 gibba045 bash[25517]: audit 2021-03-10T15:04:25.136551+0000 mgr.gibba045.orlgmj (mgr.34412) 4014 : audit [DBG] from='client.56746 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:04:26.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:04:25 gibba045 bash[25517]: audit 2021-03-10T15:04:25.392028+0000 mon.c (mon.1) 1144 : audit [DBG] from='client.? 172.21.2.115:0/3482287693' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:04:26.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:04:26 gibba015 bash[29377]: cluster 2021-03-10T15:04:26.188178+0000 mgr.gibba045.orlgmj (mgr.34412) 4015 : cluster [DBG] pgmap v2280: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:26.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:04:26 gibba015 bash[30343]: cluster 2021-03-10T15:04:26.188178+0000 mgr.gibba045.orlgmj (mgr.34412) 4015 : cluster [DBG] pgmap v2280: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:27.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:04:26 gibba045 bash[25517]: cluster 2021-03-10T15:04:26.188178+0000 mgr.gibba045.orlgmj (mgr.34412) 4015 : cluster [DBG] pgmap v2280: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:27.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:04:27 gibba015 bash[29377]: audit 2021-03-10T15:04:26.909884+0000 mon.c (mon.1) 1145 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:04:27.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:04:27 gibba015 bash[29377]: audit 2021-03-10T15:04:26.916949+0000 mon.c (mon.1) 1146 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:04:27.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:04:27 gibba015 bash[29377]: cephadm 2021-03-10T15:04:26.919864+0000 mgr.gibba045.orlgmj (mgr.34412) 4016 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:04:27.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:04:27 gibba015 bash[30343]: audit 2021-03-10T15:04:26.909884+0000 mon.c (mon.1) 1145 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:04:27.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:04:27 gibba015 bash[30343]: audit 2021-03-10T15:04:26.916949+0000 mon.c (mon.1) 1146 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:04:27.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:04:27 gibba015 bash[30343]: cephadm 2021-03-10T15:04:26.919864+0000 mgr.gibba045.orlgmj (mgr.34412) 4016 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:04:28.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:04:27 gibba045 bash[25517]: audit 2021-03-10T15:04:26.909884+0000 mon.c (mon.1) 1145 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:04:28.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:04:27 gibba045 bash[25517]: audit 2021-03-10T15:04:26.916949+0000 mon.c (mon.1) 1146 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:04:28.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:04:27 gibba045 bash[25517]: cephadm 2021-03-10T15:04:26.919864+0000 mgr.gibba045.orlgmj (mgr.34412) 4016 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:04:28.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:04:28 gibba015 bash[29377]: cluster 2021-03-10T15:04:28.189734+0000 mgr.gibba045.orlgmj (mgr.34412) 4017 : cluster [DBG] pgmap v2281: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:28.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:04:28 gibba015 bash[30343]: cluster 2021-03-10T15:04:28.189734+0000 mgr.gibba045.orlgmj (mgr.34412) 4017 : cluster [DBG] pgmap v2281: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:29.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:04:28 gibba045 bash[25517]: cluster 2021-03-10T15:04:28.189734+0000 mgr.gibba045.orlgmj (mgr.34412) 4017 : cluster [DBG] pgmap v2281: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:31.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:04:31 gibba045 bash[25517]: cluster 2021-03-10T15:04:30.190571+0000 mgr.gibba045.orlgmj (mgr.34412) 4018 : cluster [DBG] pgmap v2282: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:31.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:04:31 gibba045 bash[25517]: audit 2021-03-10T15:04:30.486515+0000 mon.a (mon.0) 1181 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:04:31.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:04:31 gibba045 bash[25517]: audit 2021-03-10T15:04:30.698380+0000 mon.a (mon.0) 1182 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:04:31.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:04:31 gibba045 bash[25517]: audit 2021-03-10T15:04:30.706091+0000 mon.c (mon.1) 1147 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:04:31.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:04:31 gibba045 bash[25517]: audit 2021-03-10T15:04:30.707825+0000 mon.c (mon.1) 1148 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:04:31.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:04:31 gibba045 bash[25517]: audit 2021-03-10T15:04:30.709390+0000 mon.c (mon.1) 1149 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:04:31.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:04:31 gibba045 bash[25517]: audit 2021-03-10T15:04:30.711101+0000 mon.c (mon.1) 1150 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:04:31.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:04:31 gibba045 bash[25517]: audit 2021-03-10T15:04:30.714619+0000 mon.c (mon.1) 1151 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:04:31.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:04:31 gibba045 bash[25517]: audit 2021-03-10T15:04:30.716175+0000 mon.c (mon.1) 1152 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:04:31.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:04:31 gibba015 bash[29377]: cluster 2021-03-10T15:04:30.190571+0000 mgr.gibba045.orlgmj (mgr.34412) 4018 : cluster [DBG] pgmap v2282: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:31.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:04:31 gibba015 bash[29377]: audit 2021-03-10T15:04:30.486515+0000 mon.a (mon.0) 1181 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:04:31.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:04:31 gibba015 bash[29377]: audit 2021-03-10T15:04:30.698380+0000 mon.a (mon.0) 1182 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:04:31.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:04:31 gibba015 bash[29377]: audit 2021-03-10T15:04:30.706091+0000 mon.c (mon.1) 1147 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:04:31.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:04:31 gibba015 bash[29377]: audit 2021-03-10T15:04:30.707825+0000 mon.c (mon.1) 1148 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:04:31.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:04:31 gibba015 bash[29377]: audit 2021-03-10T15:04:30.709390+0000 mon.c (mon.1) 1149 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:04:31.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:04:31 gibba015 bash[29377]: audit 2021-03-10T15:04:30.711101+0000 mon.c (mon.1) 1150 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:04:31.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:04:31 gibba015 bash[29377]: audit 2021-03-10T15:04:30.714619+0000 mon.c (mon.1) 1151 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:04:31.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:04:31 gibba015 bash[29377]: audit 2021-03-10T15:04:30.716175+0000 mon.c (mon.1) 1152 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:04:31.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:04:31 gibba015 bash[30343]: cluster 2021-03-10T15:04:30.190571+0000 mgr.gibba045.orlgmj (mgr.34412) 4018 : cluster [DBG] pgmap v2282: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:31.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:04:31 gibba015 bash[30343]: audit 2021-03-10T15:04:30.486515+0000 mon.a (mon.0) 1181 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:04:31.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:04:31 gibba015 bash[30343]: audit 2021-03-10T15:04:30.698380+0000 mon.a (mon.0) 1182 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:04:31.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:04:31 gibba015 bash[30343]: audit 2021-03-10T15:04:30.706091+0000 mon.c (mon.1) 1147 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:04:31.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:04:31 gibba015 bash[30343]: audit 2021-03-10T15:04:30.707825+0000 mon.c (mon.1) 1148 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:04:31.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:04:31 gibba015 bash[30343]: audit 2021-03-10T15:04:30.709390+0000 mon.c (mon.1) 1149 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:04:31.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:04:31 gibba015 bash[30343]: audit 2021-03-10T15:04:30.711101+0000 mon.c (mon.1) 1150 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:04:31.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:04:31 gibba015 bash[30343]: audit 2021-03-10T15:04:30.714619+0000 mon.c (mon.1) 1151 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:04:31.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:04:31 gibba015 bash[30343]: audit 2021-03-10T15:04:30.716175+0000 mon.c (mon.1) 1152 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:04:32.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:04:32 gibba045 bash[25517]: cephadm 2021-03-10T15:04:30.493282+0000 mgr.gibba045.orlgmj (mgr.34412) 4019 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:04:32.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:04:32 gibba045 bash[25517]: cephadm 2021-03-10T15:04:30.708517+0000 mgr.gibba045.orlgmj (mgr.34412) 4020 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:04:32.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:04:32 gibba045 bash[25517]: cephadm 2021-03-10T15:04:30.710666+0000 mgr.gibba045.orlgmj (mgr.34412) 4021 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:04:32.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:04:32 gibba045 bash[25517]: cephadm 2021-03-10T15:04:30.712417+0000 mgr.gibba045.orlgmj (mgr.34412) 4022 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:04:32.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:04:32 gibba045 bash[25517]: cephadm 2021-03-10T15:04:30.712472+0000 mgr.gibba045.orlgmj (mgr.34412) 4023 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:04:32.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:04:32 gibba045 bash[25517]: cephadm 2021-03-10T15:04:30.714086+0000 mgr.gibba045.orlgmj (mgr.34412) 4024 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:04:32.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:04:32 gibba045 bash[25517]: cephadm 2021-03-10T15:04:30.714129+0000 mgr.gibba045.orlgmj (mgr.34412) 4025 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:04:32.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:04:32 gibba045 bash[25517]: cephadm 2021-03-10T15:04:30.715755+0000 mgr.gibba045.orlgmj (mgr.34412) 4026 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:04:32.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:04:32 gibba045 bash[25517]: cephadm 2021-03-10T15:04:30.717578+0000 mgr.gibba045.orlgmj (mgr.34412) 4027 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:04:32.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:04:32 gibba045 bash[25517]: cephadm 2021-03-10T15:04:30.717616+0000 mgr.gibba045.orlgmj (mgr.34412) 4028 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:04:32.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:04:32 gibba045 bash[25517]: cephadm 2021-03-10T15:04:30.719009+0000 mgr.gibba045.orlgmj (mgr.34412) 4029 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:04:32.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:04:32 gibba045 bash[25517]: cephadm 2021-03-10T15:04:30.719380+0000 mgr.gibba045.orlgmj (mgr.34412) 4030 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:04:32.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:04:32 gibba045 bash[25517]: cephadm 2021-03-10T15:04:30.720328+0000 mgr.gibba045.orlgmj (mgr.34412) 4031 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:04:32.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:04:32 gibba045 bash[25517]: cephadm 2021-03-10T15:04:30.720371+0000 mgr.gibba045.orlgmj (mgr.34412) 4032 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:04:32.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:04:32 gibba045 bash[25517]: cephadm 2021-03-10T15:04:30.720525+0000 mgr.gibba045.orlgmj (mgr.34412) 4033 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:04:32.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:04:32 gibba015 bash[29377]: cephadm 2021-03-10T15:04:30.493282+0000 mgr.gibba045.orlgmj (mgr.34412) 4019 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:04:32.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:04:32 gibba015 bash[29377]: cephadm 2021-03-10T15:04:30.708517+0000 mgr.gibba045.orlgmj (mgr.34412) 4020 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:04:32.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:04:32 gibba015 bash[29377]: cephadm 2021-03-10T15:04:30.710666+0000 mgr.gibba045.orlgmj (mgr.34412) 4021 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:04:32.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:04:32 gibba015 bash[29377]: cephadm 2021-03-10T15:04:30.712417+0000 mgr.gibba045.orlgmj (mgr.34412) 4022 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:04:32.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:04:32 gibba015 bash[29377]: cephadm 2021-03-10T15:04:30.712472+0000 mgr.gibba045.orlgmj (mgr.34412) 4023 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:04:32.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:04:32 gibba015 bash[29377]: cephadm 2021-03-10T15:04:30.714086+0000 mgr.gibba045.orlgmj (mgr.34412) 4024 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:04:32.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:04:32 gibba015 bash[29377]: cephadm 2021-03-10T15:04:30.714129+0000 mgr.gibba045.orlgmj (mgr.34412) 4025 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:04:32.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:04:32 gibba015 bash[29377]: cephadm 2021-03-10T15:04:30.715755+0000 mgr.gibba045.orlgmj (mgr.34412) 4026 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:04:32.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:04:32 gibba015 bash[29377]: cephadm 2021-03-10T15:04:30.717578+0000 mgr.gibba045.orlgmj (mgr.34412) 4027 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:04:32.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:04:32 gibba015 bash[29377]: cephadm 2021-03-10T15:04:30.717616+0000 mgr.gibba045.orlgmj (mgr.34412) 4028 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:04:32.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:04:32 gibba015 bash[29377]: cephadm 2021-03-10T15:04:30.719009+0000 mgr.gibba045.orlgmj (mgr.34412) 4029 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:04:32.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:04:32 gibba015 bash[29377]: cephadm 2021-03-10T15:04:30.719380+0000 mgr.gibba045.orlgmj (mgr.34412) 4030 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:04:32.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:04:32 gibba015 bash[29377]: cephadm 2021-03-10T15:04:30.720328+0000 mgr.gibba045.orlgmj (mgr.34412) 4031 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:04:32.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:04:32 gibba015 bash[29377]: cephadm 2021-03-10T15:04:30.720371+0000 mgr.gibba045.orlgmj (mgr.34412) 4032 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:04:32.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:04:32 gibba015 bash[29377]: cephadm 2021-03-10T15:04:30.720525+0000 mgr.gibba045.orlgmj (mgr.34412) 4033 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:04:32.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:04:32 gibba015 bash[30343]: cephadm 2021-03-10T15:04:30.493282+0000 mgr.gibba045.orlgmj (mgr.34412) 4019 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:04:32.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:04:32 gibba015 bash[30343]: cephadm 2021-03-10T15:04:30.708517+0000 mgr.gibba045.orlgmj (mgr.34412) 4020 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:04:32.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:04:32 gibba015 bash[30343]: cephadm 2021-03-10T15:04:30.710666+0000 mgr.gibba045.orlgmj (mgr.34412) 4021 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:04:32.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:04:32 gibba015 bash[30343]: cephadm 2021-03-10T15:04:30.712417+0000 mgr.gibba045.orlgmj (mgr.34412) 4022 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:04:32.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:04:32 gibba015 bash[30343]: cephadm 2021-03-10T15:04:30.712472+0000 mgr.gibba045.orlgmj (mgr.34412) 4023 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:04:32.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:04:32 gibba015 bash[30343]: cephadm 2021-03-10T15:04:30.714086+0000 mgr.gibba045.orlgmj (mgr.34412) 4024 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:04:32.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:04:32 gibba015 bash[30343]: cephadm 2021-03-10T15:04:30.714129+0000 mgr.gibba045.orlgmj (mgr.34412) 4025 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:04:32.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:04:32 gibba015 bash[30343]: cephadm 2021-03-10T15:04:30.715755+0000 mgr.gibba045.orlgmj (mgr.34412) 4026 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:04:32.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:04:32 gibba015 bash[30343]: cephadm 2021-03-10T15:04:30.717578+0000 mgr.gibba045.orlgmj (mgr.34412) 4027 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:04:32.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:04:32 gibba015 bash[30343]: cephadm 2021-03-10T15:04:30.717616+0000 mgr.gibba045.orlgmj (mgr.34412) 4028 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:04:32.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:04:32 gibba015 bash[30343]: cephadm 2021-03-10T15:04:30.719009+0000 mgr.gibba045.orlgmj (mgr.34412) 4029 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:04:32.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:04:32 gibba015 bash[30343]: cephadm 2021-03-10T15:04:30.719380+0000 mgr.gibba045.orlgmj (mgr.34412) 4030 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:04:32.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:04:32 gibba015 bash[30343]: cephadm 2021-03-10T15:04:30.720328+0000 mgr.gibba045.orlgmj (mgr.34412) 4031 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:04:32.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:04:32 gibba015 bash[30343]: cephadm 2021-03-10T15:04:30.720371+0000 mgr.gibba045.orlgmj (mgr.34412) 4032 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:04:32.733 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:04:32 gibba015 bash[30343]: cephadm 2021-03-10T15:04:30.720525+0000 mgr.gibba045.orlgmj (mgr.34412) 4033 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:04:33.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:04:33 gibba045 bash[25517]: cluster 2021-03-10T15:04:32.192186+0000 mgr.gibba045.orlgmj (mgr.34412) 4034 : cluster [DBG] pgmap v2283: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:33.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:04:33 gibba015 bash[29377]: cluster 2021-03-10T15:04:32.192186+0000 mgr.gibba045.orlgmj (mgr.34412) 4034 : cluster [DBG] pgmap v2283: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:33.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:04:33 gibba015 bash[30343]: cluster 2021-03-10T15:04:32.192186+0000 mgr.gibba045.orlgmj (mgr.34412) 4034 : cluster [DBG] pgmap v2283: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:34.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:04:34 gibba015 bash[29377]: cluster 2021-03-10T15:04:34.193381+0000 mgr.gibba045.orlgmj (mgr.34412) 4035 : cluster [DBG] pgmap v2284: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:34.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:04:34 gibba015 bash[30343]: cluster 2021-03-10T15:04:34.193381+0000 mgr.gibba045.orlgmj (mgr.34412) 4035 : cluster [DBG] pgmap v2284: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:35.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:04:34 gibba045 bash[25517]: cluster 2021-03-10T15:04:34.193381+0000 mgr.gibba045.orlgmj (mgr.34412) 4035 : cluster [DBG] pgmap v2284: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:37.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:04:37 gibba045 bash[25517]: cluster 2021-03-10T15:04:36.194235+0000 mgr.gibba045.orlgmj (mgr.34412) 4036 : cluster [DBG] pgmap v2285: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:37.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:04:37 gibba015 bash[29377]: cluster 2021-03-10T15:04:36.194235+0000 mgr.gibba045.orlgmj (mgr.34412) 4036 : cluster [DBG] pgmap v2285: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:37.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:04:37 gibba015 bash[30343]: cluster 2021-03-10T15:04:36.194235+0000 mgr.gibba045.orlgmj (mgr.34412) 4036 : cluster [DBG] pgmap v2285: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:39.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:04:39 gibba045 bash[25517]: cluster 2021-03-10T15:04:38.195847+0000 mgr.gibba045.orlgmj (mgr.34412) 4037 : cluster [DBG] pgmap v2286: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:39.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:04:39 gibba015 bash[29377]: cluster 2021-03-10T15:04:38.195847+0000 mgr.gibba045.orlgmj (mgr.34412) 4037 : cluster [DBG] pgmap v2286: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:39.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:04:39 gibba015 bash[30343]: cluster 2021-03-10T15:04:38.195847+0000 mgr.gibba045.orlgmj (mgr.34412) 4037 : cluster [DBG] pgmap v2286: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:41.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:04:41 gibba045 bash[25517]: cluster 2021-03-10T15:04:40.197455+0000 mgr.gibba045.orlgmj (mgr.34412) 4038 : cluster [DBG] pgmap v2287: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:41.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:04:41 gibba015 bash[29377]: cluster 2021-03-10T15:04:40.197455+0000 mgr.gibba045.orlgmj (mgr.34412) 4038 : cluster [DBG] pgmap v2287: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:41.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:04:41 gibba015 bash[30343]: cluster 2021-03-10T15:04:40.197455+0000 mgr.gibba045.orlgmj (mgr.34412) 4038 : cluster [DBG] pgmap v2287: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:43.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:04:43 gibba045 bash[25517]: cluster 2021-03-10T15:04:42.199231+0000 mgr.gibba045.orlgmj (mgr.34412) 4039 : cluster [DBG] pgmap v2288: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:43.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:04:43 gibba015 bash[29377]: cluster 2021-03-10T15:04:42.199231+0000 mgr.gibba045.orlgmj (mgr.34412) 4039 : cluster [DBG] pgmap v2288: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:43.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:04:43 gibba015 bash[30343]: cluster 2021-03-10T15:04:42.199231+0000 mgr.gibba045.orlgmj (mgr.34412) 4039 : cluster [DBG] pgmap v2288: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:44.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:04:44 gibba015 bash[29377]: cluster 2021-03-10T15:04:44.200632+0000 mgr.gibba045.orlgmj (mgr.34412) 4040 : cluster [DBG] pgmap v2289: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:44.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:04:44 gibba015 bash[30343]: cluster 2021-03-10T15:04:44.200632+0000 mgr.gibba045.orlgmj (mgr.34412) 4040 : cluster [DBG] pgmap v2289: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:45.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:04:44 gibba045 bash[25517]: cluster 2021-03-10T15:04:44.200632+0000 mgr.gibba045.orlgmj (mgr.34412) 4040 : cluster [DBG] pgmap v2289: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:47.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:04:47 gibba045 bash[25517]: cephadm 2021-03-10T15:04:45.736620+0000 mgr.gibba045.orlgmj (mgr.34412) 4041 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:04:47.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:04:47 gibba045 bash[25517]: cluster 2021-03-10T15:04:46.202368+0000 mgr.gibba045.orlgmj (mgr.34412) 4042 : cluster [DBG] pgmap v2290: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:47.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:04:47 gibba015 bash[29377]: cephadm 2021-03-10T15:04:45.736620+0000 mgr.gibba045.orlgmj (mgr.34412) 4041 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:04:47.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:04:47 gibba015 bash[29377]: cluster 2021-03-10T15:04:46.202368+0000 mgr.gibba045.orlgmj (mgr.34412) 4042 : cluster [DBG] pgmap v2290: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:47.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:04:47 gibba015 bash[30343]: cephadm 2021-03-10T15:04:45.736620+0000 mgr.gibba045.orlgmj (mgr.34412) 4041 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:04:47.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:04:47 gibba015 bash[30343]: cluster 2021-03-10T15:04:46.202368+0000 mgr.gibba045.orlgmj (mgr.34412) 4042 : cluster [DBG] pgmap v2290: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:49.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:04:49 gibba045 bash[25517]: cluster 2021-03-10T15:04:48.203375+0000 mgr.gibba045.orlgmj (mgr.34412) 4043 : cluster [DBG] pgmap v2291: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:49.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:04:49 gibba015 bash[29377]: cluster 2021-03-10T15:04:48.203375+0000 mgr.gibba045.orlgmj (mgr.34412) 4043 : cluster [DBG] pgmap v2291: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:49.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:04:49 gibba015 bash[30343]: cluster 2021-03-10T15:04:48.203375+0000 mgr.gibba045.orlgmj (mgr.34412) 4043 : cluster [DBG] pgmap v2291: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:51.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:04:51 gibba045 bash[25517]: cluster 2021-03-10T15:04:50.204961+0000 mgr.gibba045.orlgmj (mgr.34412) 4044 : cluster [DBG] pgmap v2292: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:51.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:04:51 gibba015 bash[29377]: cluster 2021-03-10T15:04:50.204961+0000 mgr.gibba045.orlgmj (mgr.34412) 4044 : cluster [DBG] pgmap v2292: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:51.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:04:51 gibba015 bash[30343]: cluster 2021-03-10T15:04:50.204961+0000 mgr.gibba045.orlgmj (mgr.34412) 4044 : cluster [DBG] pgmap v2292: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:53.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:04:53 gibba045 bash[25517]: cluster 2021-03-10T15:04:52.206727+0000 mgr.gibba045.orlgmj (mgr.34412) 4045 : cluster [DBG] pgmap v2293: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:53.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:04:53 gibba045 bash[25517]: audit 2021-03-10T15:04:52.972033+0000 mon.c (mon.1) 1153 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:04:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:04:53 gibba045 bash[25517]: audit 2021-03-10T15:04:52.972647+0000 mon.c (mon.1) 1154 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:04:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:04:53 gibba045 bash[25517]: audit 2021-03-10T15:04:52.973234+0000 mon.a (mon.0) 1183 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:04:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:04:53 gibba045 bash[25517]: audit 2021-03-10T15:04:52.974472+0000 mon.a (mon.0) 1184 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:04:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:04:53 gibba045 bash[25517]: audit 2021-03-10T15:04:52.977190+0000 mon.c (mon.1) 1155 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T15:04:53.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:04:53 gibba045 bash[25517]: audit 2021-03-10T15:04:52.977960+0000 mon.c (mon.1) 1156 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T15:04:53.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:04:53 gibba045 bash[25517]: audit 2021-03-10T15:04:52.978343+0000 mon.a (mon.0) 1185 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T15:04:53.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:04:53 gibba045 bash[25517]: audit 2021-03-10T15:04:52.978650+0000 mon.c (mon.1) 1157 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:04:53.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:04:53 gibba045 bash[25517]: audit 2021-03-10T15:04:52.979324+0000 mon.c (mon.1) 1158 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:04:53.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:04:53 gibba045 bash[25517]: audit 2021-03-10T15:04:52.980026+0000 mon.a (mon.0) 1186 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T15:04:53.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:04:53 gibba045 bash[25517]: audit 2021-03-10T15:04:52.981268+0000 mon.a (mon.0) 1187 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:04:53.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:04:53 gibba045 bash[25517]: audit 2021-03-10T15:04:52.982243+0000 mon.a (mon.0) 1188 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:04:53.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:04:53 gibba015 bash[29377]: cluster 2021-03-10T15:04:52.206727+0000 mgr.gibba045.orlgmj (mgr.34412) 4045 : cluster [DBG] pgmap v2293: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:04:53 gibba015 bash[29377]: audit 2021-03-10T15:04:52.972033+0000 mon.c (mon.1) 1153 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:04:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:04:53 gibba015 bash[29377]: audit 2021-03-10T15:04:52.972647+0000 mon.c (mon.1) 1154 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:04:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:04:53 gibba015 bash[29377]: audit 2021-03-10T15:04:52.973234+0000 mon.a (mon.0) 1183 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:04:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:04:53 gibba015 bash[29377]: audit 2021-03-10T15:04:52.974472+0000 mon.a (mon.0) 1184 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:04:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:04:53 gibba015 bash[29377]: audit 2021-03-10T15:04:52.977190+0000 mon.c (mon.1) 1155 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T15:04:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:04:53 gibba015 bash[29377]: audit 2021-03-10T15:04:52.977960+0000 mon.c (mon.1) 1156 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T15:04:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:04:53 gibba015 bash[29377]: audit 2021-03-10T15:04:52.978343+0000 mon.a (mon.0) 1185 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T15:04:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:04:53 gibba015 bash[29377]: audit 2021-03-10T15:04:52.978650+0000 mon.c (mon.1) 1157 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:04:53.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:04:53 gibba015 bash[29377]: audit 2021-03-10T15:04:52.979324+0000 mon.c (mon.1) 1158 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:04:53.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:04:53 gibba015 bash[29377]: audit 2021-03-10T15:04:52.980026+0000 mon.a (mon.0) 1186 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T15:04:53.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:04:53 gibba015 bash[29377]: audit 2021-03-10T15:04:52.981268+0000 mon.a (mon.0) 1187 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:04:53.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:04:53 gibba015 bash[29377]: audit 2021-03-10T15:04:52.982243+0000 mon.a (mon.0) 1188 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:04:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:04:53 gibba015 bash[30343]: cluster 2021-03-10T15:04:52.206727+0000 mgr.gibba045.orlgmj (mgr.34412) 4045 : cluster [DBG] pgmap v2293: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:04:53 gibba015 bash[30343]: audit 2021-03-10T15:04:52.972033+0000 mon.c (mon.1) 1153 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:04:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:04:53 gibba015 bash[30343]: audit 2021-03-10T15:04:52.972647+0000 mon.c (mon.1) 1154 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:04:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:04:53 gibba015 bash[30343]: audit 2021-03-10T15:04:52.973234+0000 mon.a (mon.0) 1183 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:04:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:04:53 gibba015 bash[30343]: audit 2021-03-10T15:04:52.974472+0000 mon.a (mon.0) 1184 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:04:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:04:53 gibba015 bash[30343]: audit 2021-03-10T15:04:52.977190+0000 mon.c (mon.1) 1155 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T15:04:53.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:04:53 gibba015 bash[30343]: audit 2021-03-10T15:04:52.977960+0000 mon.c (mon.1) 1156 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T15:04:53.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:04:53 gibba015 bash[30343]: audit 2021-03-10T15:04:52.978343+0000 mon.a (mon.0) 1185 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T15:04:53.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:04:53 gibba015 bash[30343]: audit 2021-03-10T15:04:52.978650+0000 mon.c (mon.1) 1157 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:04:53.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:04:53 gibba015 bash[30343]: audit 2021-03-10T15:04:52.979324+0000 mon.c (mon.1) 1158 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:04:53.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:04:53 gibba015 bash[30343]: audit 2021-03-10T15:04:52.980026+0000 mon.a (mon.0) 1186 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T15:04:53.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:04:53 gibba015 bash[30343]: audit 2021-03-10T15:04:52.981268+0000 mon.a (mon.0) 1187 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:04:53.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:04:53 gibba015 bash[30343]: audit 2021-03-10T15:04:52.982243+0000 mon.a (mon.0) 1188 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:04:54.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:04:54 gibba015 bash[29377]: cluster 2021-03-10T15:04:54.207928+0000 mgr.gibba045.orlgmj (mgr.34412) 4046 : cluster [DBG] pgmap v2294: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:54.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:04:54 gibba015 bash[30343]: cluster 2021-03-10T15:04:54.207928+0000 mgr.gibba045.orlgmj (mgr.34412) 4046 : cluster [DBG] pgmap v2294: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:55.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:04:54 gibba045 bash[25517]: cluster 2021-03-10T15:04:54.207928+0000 mgr.gibba045.orlgmj (mgr.34412) 4046 : cluster [DBG] pgmap v2294: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:55.643 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:04:55.871 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:04:55.872 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (75m) 25s ago 81m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:04:55.872 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (80m) 9m ago 80m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:04:55.872 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (76m) 9m ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:04:55.872 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (76m) 9m ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:04:55.873 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (75m) 25s ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:04:55.873 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (75m) 25s ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:04:55.873 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (74m) 9m ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:04:55.873 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (74m) 25s ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:04:55.874 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (81m) 25s ago 81m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:04:55.874 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (81m) 9m ago 81m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:04:55.874 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (73m) 25s ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:04:55.874 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (73m) 25s ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:04:55.875 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (73m) 25s ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:04:55.875 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (72m) 25s ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:04:55.875 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (72m) 9m ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:04:55.875 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (71m) 9m ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:04:55.876 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (71m) 9m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:04:55.876 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (70m) 9m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:04:55.876 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (80m) 9m ago 81m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:04:55.876 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 9m ago 79m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:04:56.120 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:04:56.120 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:04:56.120 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:04:56.121 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:04:56.121 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:04:56.121 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:04:56.121 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:04:56.122 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:04:56.122 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:04:56.122 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:04:56.122 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:04:56.123 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:04:56.123 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:04:56.123 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:04:56.123 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:04:56.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:04:56 gibba015 bash[29377]: audit 2021-03-10T15:04:56.116264+0000 mon.a (mon.0) 1189 : audit [DBG] from='client.? 172.21.2.115:0/1204626092' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:04:56.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:04:56 gibba015 bash[30343]: audit 2021-03-10T15:04:56.116264+0000 mon.a (mon.0) 1189 : audit [DBG] from='client.? 172.21.2.115:0/1204626092' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:04:56.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:04:56 gibba045 bash[25517]: audit 2021-03-10T15:04:56.116264+0000 mon.a (mon.0) 1189 : audit [DBG] from='client.? 172.21.2.115:0/1204626092' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:04:57.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:04:57 gibba015 bash[29377]: audit 2021-03-10T15:04:55.633427+0000 mgr.gibba045.orlgmj (mgr.34412) 4047 : audit [DBG] from='client.56758 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:04:57.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:04:57 gibba015 bash[29377]: audit 2021-03-10T15:04:55.858774+0000 mgr.gibba045.orlgmj (mgr.34412) 4048 : audit [DBG] from='client.46776 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:04:57.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:04:57 gibba015 bash[29377]: cluster 2021-03-10T15:04:56.208864+0000 mgr.gibba045.orlgmj (mgr.34412) 4049 : cluster [DBG] pgmap v2295: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:57.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:04:57 gibba015 bash[30343]: audit 2021-03-10T15:04:55.633427+0000 mgr.gibba045.orlgmj (mgr.34412) 4047 : audit [DBG] from='client.56758 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:04:57.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:04:57 gibba015 bash[30343]: audit 2021-03-10T15:04:55.858774+0000 mgr.gibba045.orlgmj (mgr.34412) 4048 : audit [DBG] from='client.46776 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:04:57.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:04:57 gibba015 bash[30343]: cluster 2021-03-10T15:04:56.208864+0000 mgr.gibba045.orlgmj (mgr.34412) 4049 : cluster [DBG] pgmap v2295: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:57.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:04:57 gibba045 bash[25517]: audit 2021-03-10T15:04:55.633427+0000 mgr.gibba045.orlgmj (mgr.34412) 4047 : audit [DBG] from='client.56758 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:04:57.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:04:57 gibba045 bash[25517]: audit 2021-03-10T15:04:55.858774+0000 mgr.gibba045.orlgmj (mgr.34412) 4048 : audit [DBG] from='client.46776 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:04:57.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:04:57 gibba045 bash[25517]: cluster 2021-03-10T15:04:56.208864+0000 mgr.gibba045.orlgmj (mgr.34412) 4049 : cluster [DBG] pgmap v2295: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:59.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:04:59 gibba045 bash[25517]: cluster 2021-03-10T15:04:58.210456+0000 mgr.gibba045.orlgmj (mgr.34412) 4050 : cluster [DBG] pgmap v2296: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:59.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:04:59 gibba015 bash[29377]: cluster 2021-03-10T15:04:58.210456+0000 mgr.gibba045.orlgmj (mgr.34412) 4050 : cluster [DBG] pgmap v2296: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:59.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:04:59 gibba015 bash[30343]: cluster 2021-03-10T15:04:58.210456+0000 mgr.gibba045.orlgmj (mgr.34412) 4050 : cluster [DBG] pgmap v2296: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:01.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:05:01 gibba045 bash[25517]: cluster 2021-03-10T15:05:00.211966+0000 mgr.gibba045.orlgmj (mgr.34412) 4051 : cluster [DBG] pgmap v2297: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:01.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:05:01 gibba015 bash[29377]: cluster 2021-03-10T15:05:00.211966+0000 mgr.gibba045.orlgmj (mgr.34412) 4051 : cluster [DBG] pgmap v2297: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:01.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:05:01 gibba015 bash[30343]: cluster 2021-03-10T15:05:00.211966+0000 mgr.gibba045.orlgmj (mgr.34412) 4051 : cluster [DBG] pgmap v2297: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:02.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:05:02 gibba045 bash[25517]: cephadm 2021-03-10T15:05:00.745106+0000 mgr.gibba045.orlgmj (mgr.34412) 4052 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:05:02.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:05:02 gibba015 bash[29377]: cephadm 2021-03-10T15:05:00.745106+0000 mgr.gibba045.orlgmj (mgr.34412) 4052 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:05:02.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:05:02 gibba015 bash[30343]: cephadm 2021-03-10T15:05:00.745106+0000 mgr.gibba045.orlgmj (mgr.34412) 4052 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:05:03.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:05:03 gibba045 bash[25517]: cluster 2021-03-10T15:05:02.213540+0000 mgr.gibba045.orlgmj (mgr.34412) 4053 : cluster [DBG] pgmap v2298: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:03.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:05:03 gibba015 bash[29377]: cluster 2021-03-10T15:05:02.213540+0000 mgr.gibba045.orlgmj (mgr.34412) 4053 : cluster [DBG] pgmap v2298: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:03.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:05:03 gibba015 bash[30343]: cluster 2021-03-10T15:05:02.213540+0000 mgr.gibba045.orlgmj (mgr.34412) 4053 : cluster [DBG] pgmap v2298: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:04.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:05:04 gibba015 bash[29377]: cluster 2021-03-10T15:05:04.214753+0000 mgr.gibba045.orlgmj (mgr.34412) 4054 : cluster [DBG] pgmap v2299: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:04.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:05:04 gibba015 bash[30343]: cluster 2021-03-10T15:05:04.214753+0000 mgr.gibba045.orlgmj (mgr.34412) 4054 : cluster [DBG] pgmap v2299: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:05.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:05:04 gibba045 bash[25517]: cluster 2021-03-10T15:05:04.214753+0000 mgr.gibba045.orlgmj (mgr.34412) 4054 : cluster [DBG] pgmap v2299: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:07.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:05:07 gibba045 bash[25517]: cluster 2021-03-10T15:05:06.216329+0000 mgr.gibba045.orlgmj (mgr.34412) 4055 : cluster [DBG] pgmap v2300: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:07.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:05:07 gibba015 bash[29377]: cluster 2021-03-10T15:05:06.216329+0000 mgr.gibba045.orlgmj (mgr.34412) 4055 : cluster [DBG] pgmap v2300: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:07.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:05:07 gibba015 bash[30343]: cluster 2021-03-10T15:05:06.216329+0000 mgr.gibba045.orlgmj (mgr.34412) 4055 : cluster [DBG] pgmap v2300: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:09.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:05:09 gibba045 bash[25517]: cluster 2021-03-10T15:05:08.217989+0000 mgr.gibba045.orlgmj (mgr.34412) 4056 : cluster [DBG] pgmap v2301: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:09.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:05:09 gibba015 bash[29377]: cluster 2021-03-10T15:05:08.217989+0000 mgr.gibba045.orlgmj (mgr.34412) 4056 : cluster [DBG] pgmap v2301: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:09.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:05:09 gibba015 bash[30343]: cluster 2021-03-10T15:05:08.217989+0000 mgr.gibba045.orlgmj (mgr.34412) 4056 : cluster [DBG] pgmap v2301: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:11.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:05:11 gibba045 bash[25517]: cluster 2021-03-10T15:05:10.219390+0000 mgr.gibba045.orlgmj (mgr.34412) 4057 : cluster [DBG] pgmap v2302: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:11.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:05:11 gibba015 bash[29377]: cluster 2021-03-10T15:05:10.219390+0000 mgr.gibba045.orlgmj (mgr.34412) 4057 : cluster [DBG] pgmap v2302: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:11.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:05:11 gibba015 bash[30343]: cluster 2021-03-10T15:05:10.219390+0000 mgr.gibba045.orlgmj (mgr.34412) 4057 : cluster [DBG] pgmap v2302: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:13.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:05:13 gibba015 bash[29377]: cluster 2021-03-10T15:05:12.221075+0000 mgr.gibba045.orlgmj (mgr.34412) 4058 : cluster [DBG] pgmap v2303: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:13.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:05:13 gibba015 bash[30343]: cluster 2021-03-10T15:05:12.221075+0000 mgr.gibba045.orlgmj (mgr.34412) 4058 : cluster [DBG] pgmap v2303: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:13.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:05:13 gibba045 bash[25517]: cluster 2021-03-10T15:05:12.221075+0000 mgr.gibba045.orlgmj (mgr.34412) 4058 : cluster [DBG] pgmap v2303: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:14.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:05:14 gibba015 bash[29377]: cluster 2021-03-10T15:05:14.222354+0000 mgr.gibba045.orlgmj (mgr.34412) 4059 : cluster [DBG] pgmap v2304: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:14.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:05:14 gibba015 bash[30343]: cluster 2021-03-10T15:05:14.222354+0000 mgr.gibba045.orlgmj (mgr.34412) 4059 : cluster [DBG] pgmap v2304: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:15.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:05:14 gibba045 bash[25517]: cluster 2021-03-10T15:05:14.222354+0000 mgr.gibba045.orlgmj (mgr.34412) 4059 : cluster [DBG] pgmap v2304: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:17.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:05:17 gibba045 bash[25517]: cephadm 2021-03-10T15:05:15.761150+0000 mgr.gibba045.orlgmj (mgr.34412) 4060 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:05:17.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:05:17 gibba045 bash[25517]: cluster 2021-03-10T15:05:16.223981+0000 mgr.gibba045.orlgmj (mgr.34412) 4061 : cluster [DBG] pgmap v2305: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:17.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:05:17 gibba015 bash[29377]: cephadm 2021-03-10T15:05:15.761150+0000 mgr.gibba045.orlgmj (mgr.34412) 4060 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:05:17.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:05:17 gibba015 bash[29377]: cluster 2021-03-10T15:05:16.223981+0000 mgr.gibba045.orlgmj (mgr.34412) 4061 : cluster [DBG] pgmap v2305: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:17.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:05:17 gibba015 bash[30343]: cephadm 2021-03-10T15:05:15.761150+0000 mgr.gibba045.orlgmj (mgr.34412) 4060 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:05:17.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:05:17 gibba015 bash[30343]: cluster 2021-03-10T15:05:16.223981+0000 mgr.gibba045.orlgmj (mgr.34412) 4061 : cluster [DBG] pgmap v2305: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:19.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:05:19 gibba045 bash[25517]: cluster 2021-03-10T15:05:18.225199+0000 mgr.gibba045.orlgmj (mgr.34412) 4062 : cluster [DBG] pgmap v2306: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:19.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:05:19 gibba015 bash[29377]: cluster 2021-03-10T15:05:18.225199+0000 mgr.gibba045.orlgmj (mgr.34412) 4062 : cluster [DBG] pgmap v2306: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:19.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:05:19 gibba015 bash[30343]: cluster 2021-03-10T15:05:18.225199+0000 mgr.gibba045.orlgmj (mgr.34412) 4062 : cluster [DBG] pgmap v2306: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:21.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:05:21 gibba015 bash[29377]: cluster 2021-03-10T15:05:20.226841+0000 mgr.gibba045.orlgmj (mgr.34412) 4063 : cluster [DBG] pgmap v2307: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:21.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:05:21 gibba015 bash[30343]: cluster 2021-03-10T15:05:20.226841+0000 mgr.gibba045.orlgmj (mgr.34412) 4063 : cluster [DBG] pgmap v2307: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:21.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:05:21 gibba045 bash[25517]: cluster 2021-03-10T15:05:20.226841+0000 mgr.gibba045.orlgmj (mgr.34412) 4063 : cluster [DBG] pgmap v2307: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:23.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:05:23 gibba015 bash[29377]: cluster 2021-03-10T15:05:22.228632+0000 mgr.gibba045.orlgmj (mgr.34412) 4064 : cluster [DBG] pgmap v2308: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:23.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:05:23 gibba015 bash[30343]: cluster 2021-03-10T15:05:22.228632+0000 mgr.gibba045.orlgmj (mgr.34412) 4064 : cluster [DBG] pgmap v2308: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:23.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:05:23 gibba045 bash[25517]: cluster 2021-03-10T15:05:22.228632+0000 mgr.gibba045.orlgmj (mgr.34412) 4064 : cluster [DBG] pgmap v2308: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:24.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:05:24 gibba015 bash[29377]: cluster 2021-03-10T15:05:24.229994+0000 mgr.gibba045.orlgmj (mgr.34412) 4065 : cluster [DBG] pgmap v2309: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:24.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:05:24 gibba015 bash[30343]: cluster 2021-03-10T15:05:24.229994+0000 mgr.gibba045.orlgmj (mgr.34412) 4065 : cluster [DBG] pgmap v2309: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:25.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:05:24 gibba045 bash[25517]: cluster 2021-03-10T15:05:24.229994+0000 mgr.gibba045.orlgmj (mgr.34412) 4065 : cluster [DBG] pgmap v2309: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:26.362 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:05:26.588 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:05:26.589 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (76m) 56s ago 81m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:05:26.589 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (81m) 10m ago 81m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:05:26.589 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (76m) 10m ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:05:26.589 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (76m) 10m ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:05:26.590 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (75m) 56s ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:05:26.590 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (75m) 56s ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:05:26.590 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (75m) 10m ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:05:26.590 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (75m) 56s ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:05:26.591 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (81m) 56s ago 81m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:05:26.591 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (81m) 10m ago 81m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:05:26.591 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (74m) 56s ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:05:26.591 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (74m) 56s ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:05:26.591 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (73m) 56s ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:05:26.592 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (73m) 56s ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:05:26.592 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (72m) 10m ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:05:26.592 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (72m) 10m ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:05:26.592 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (71m) 10m ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:05:26.593 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (71m) 10m ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:05:26.593 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (81m) 10m ago 81m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:05:26.593 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 10m ago 79m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:05:26.839 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:05:26.839 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:05:26.839 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:05:26.840 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:05:26.840 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:05:26.840 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:05:26.840 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:05:26.841 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:05:26.841 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:05:26.841 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:05:26.841 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:05:26.842 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:05:26.842 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:05:26.842 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:05:26.842 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:05:27.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:05:27 gibba045 bash[25517]: cluster 2021-03-10T15:05:26.231510+0000 mgr.gibba045.orlgmj (mgr.34412) 4066 : cluster [DBG] pgmap v2310: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:27.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:05:27 gibba045 bash[25517]: audit 2021-03-10T15:05:26.352453+0000 mgr.gibba045.orlgmj (mgr.34412) 4067 : audit [DBG] from='client.46788 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:05:27.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:05:27 gibba045 bash[25517]: audit 2021-03-10T15:05:26.835278+0000 mon.a (mon.0) 1190 : audit [DBG] from='client.? 172.21.2.115:0/4180665743' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:05:27.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:05:27 gibba015 bash[29377]: cluster 2021-03-10T15:05:26.231510+0000 mgr.gibba045.orlgmj (mgr.34412) 4066 : cluster [DBG] pgmap v2310: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:27.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:05:27 gibba015 bash[29377]: audit 2021-03-10T15:05:26.352453+0000 mgr.gibba045.orlgmj (mgr.34412) 4067 : audit [DBG] from='client.46788 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:05:27.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:05:27 gibba015 bash[29377]: audit 2021-03-10T15:05:26.835278+0000 mon.a (mon.0) 1190 : audit [DBG] from='client.? 172.21.2.115:0/4180665743' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:05:27.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:05:27 gibba015 bash[30343]: cluster 2021-03-10T15:05:26.231510+0000 mgr.gibba045.orlgmj (mgr.34412) 4066 : cluster [DBG] pgmap v2310: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:27.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:05:27 gibba015 bash[30343]: audit 2021-03-10T15:05:26.352453+0000 mgr.gibba045.orlgmj (mgr.34412) 4067 : audit [DBG] from='client.46788 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:05:27.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:05:27 gibba015 bash[30343]: audit 2021-03-10T15:05:26.835278+0000 mon.a (mon.0) 1190 : audit [DBG] from='client.? 172.21.2.115:0/4180665743' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:05:28.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:05:28 gibba045 bash[25517]: audit 2021-03-10T15:05:26.576012+0000 mgr.gibba045.orlgmj (mgr.34412) 4068 : audit [DBG] from='client.46794 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:05:28.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:05:28 gibba015 bash[29377]: audit 2021-03-10T15:05:26.576012+0000 mgr.gibba045.orlgmj (mgr.34412) 4068 : audit [DBG] from='client.46794 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:05:28.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:05:28 gibba015 bash[30343]: audit 2021-03-10T15:05:26.576012+0000 mgr.gibba045.orlgmj (mgr.34412) 4068 : audit [DBG] from='client.46794 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:05:29.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:05:29 gibba015 bash[29377]: cluster 2021-03-10T15:05:28.232913+0000 mgr.gibba045.orlgmj (mgr.34412) 4069 : cluster [DBG] pgmap v2311: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:29.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:05:29 gibba015 bash[30343]: cluster 2021-03-10T15:05:28.232913+0000 mgr.gibba045.orlgmj (mgr.34412) 4069 : cluster [DBG] pgmap v2311: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:29.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:05:29 gibba045 bash[25517]: cluster 2021-03-10T15:05:28.232913+0000 mgr.gibba045.orlgmj (mgr.34412) 4069 : cluster [DBG] pgmap v2311: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:31.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:05:31 gibba015 bash[29377]: cluster 2021-03-10T15:05:30.234356+0000 mgr.gibba045.orlgmj (mgr.34412) 4070 : cluster [DBG] pgmap v2312: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:31.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:05:31 gibba015 bash[29377]: audit 2021-03-10T15:05:30.774394+0000 mon.c (mon.1) 1159 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:05:31.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:05:31 gibba015 bash[29377]: audit 2021-03-10T15:05:30.781393+0000 mon.c (mon.1) 1160 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:05:31.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:05:31 gibba015 bash[30343]: cluster 2021-03-10T15:05:30.234356+0000 mgr.gibba045.orlgmj (mgr.34412) 4070 : cluster [DBG] pgmap v2312: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:31.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:05:31 gibba015 bash[30343]: audit 2021-03-10T15:05:30.774394+0000 mon.c (mon.1) 1159 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:05:31.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:05:31 gibba015 bash[30343]: audit 2021-03-10T15:05:30.781393+0000 mon.c (mon.1) 1160 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:05:31.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:05:31 gibba045 bash[25517]: cluster 2021-03-10T15:05:30.234356+0000 mgr.gibba045.orlgmj (mgr.34412) 4070 : cluster [DBG] pgmap v2312: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:31.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:05:31 gibba045 bash[25517]: audit 2021-03-10T15:05:30.774394+0000 mon.c (mon.1) 1159 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:05:31.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:05:31 gibba045 bash[25517]: audit 2021-03-10T15:05:30.781393+0000 mon.c (mon.1) 1160 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:05:32.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:05:32 gibba015 bash[29377]: cephadm 2021-03-10T15:05:30.782672+0000 mgr.gibba045.orlgmj (mgr.34412) 4071 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:05:32.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:05:32 gibba015 bash[30343]: cephadm 2021-03-10T15:05:30.782672+0000 mgr.gibba045.orlgmj (mgr.34412) 4071 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:05:32.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:05:32 gibba045 bash[25517]: cephadm 2021-03-10T15:05:30.782672+0000 mgr.gibba045.orlgmj (mgr.34412) 4071 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:05:33.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:05:33 gibba015 bash[29377]: cluster 2021-03-10T15:05:32.236128+0000 mgr.gibba045.orlgmj (mgr.34412) 4072 : cluster [DBG] pgmap v2313: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:33.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:05:33 gibba015 bash[30343]: cluster 2021-03-10T15:05:32.236128+0000 mgr.gibba045.orlgmj (mgr.34412) 4072 : cluster [DBG] pgmap v2313: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:33.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:05:33 gibba045 bash[25517]: cluster 2021-03-10T15:05:32.236128+0000 mgr.gibba045.orlgmj (mgr.34412) 4072 : cluster [DBG] pgmap v2313: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:34.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:05:34 gibba015 bash[29377]: cluster 2021-03-10T15:05:34.236845+0000 mgr.gibba045.orlgmj (mgr.34412) 4073 : cluster [DBG] pgmap v2314: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:34.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:05:34 gibba015 bash[29377]: audit 2021-03-10T15:05:34.514331+0000 mon.a (mon.0) 1191 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:05:34.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:05:34 gibba015 bash[30343]: cluster 2021-03-10T15:05:34.236845+0000 mgr.gibba045.orlgmj (mgr.34412) 4073 : cluster [DBG] pgmap v2314: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:34.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:05:34 gibba015 bash[30343]: audit 2021-03-10T15:05:34.514331+0000 mon.a (mon.0) 1191 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:05:35.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:05:34 gibba045 bash[25517]: cluster 2021-03-10T15:05:34.236845+0000 mgr.gibba045.orlgmj (mgr.34412) 4073 : cluster [DBG] pgmap v2314: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:35.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:05:34 gibba045 bash[25517]: audit 2021-03-10T15:05:34.514331+0000 mon.a (mon.0) 1191 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:05:35.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:05:35 gibba015 bash[29377]: cephadm 2021-03-10T15:05:34.519024+0000 mgr.gibba045.orlgmj (mgr.34412) 4074 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:05:35.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:05:35 gibba015 bash[29377]: audit 2021-03-10T15:05:34.717602+0000 mon.a (mon.0) 1192 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:05:35.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:05:35 gibba015 bash[29377]: audit 2021-03-10T15:05:34.721106+0000 mon.c (mon.1) 1161 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:05:35.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:05:35 gibba015 bash[29377]: audit 2021-03-10T15:05:34.722585+0000 mon.c (mon.1) 1162 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:05:35.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:05:35 gibba015 bash[29377]: cephadm 2021-03-10T15:05:34.723857+0000 mgr.gibba045.orlgmj (mgr.34412) 4075 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:05:35.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:05:35 gibba015 bash[29377]: audit 2021-03-10T15:05:34.723893+0000 mon.c (mon.1) 1163 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:05:35.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:05:35 gibba015 bash[29377]: audit 2021-03-10T15:05:34.725147+0000 mon.c (mon.1) 1164 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:05:35.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:05:35 gibba015 bash[29377]: cephadm 2021-03-10T15:05:34.725703+0000 mgr.gibba045.orlgmj (mgr.34412) 4076 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:05:35.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:05:35 gibba015 bash[29377]: cephadm 2021-03-10T15:05:34.726840+0000 mgr.gibba045.orlgmj (mgr.34412) 4077 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:05:35.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:05:35 gibba015 bash[29377]: cephadm 2021-03-10T15:05:34.726878+0000 mgr.gibba045.orlgmj (mgr.34412) 4078 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:05:35.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:05:35 gibba015 bash[29377]: audit 2021-03-10T15:05:34.727957+0000 mon.c (mon.1) 1165 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:05:35.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:05:35 gibba015 bash[29377]: cephadm 2021-03-10T15:05:34.728185+0000 mgr.gibba045.orlgmj (mgr.34412) 4079 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:05:35.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:05:35 gibba015 bash[29377]: cephadm 2021-03-10T15:05:34.728222+0000 mgr.gibba045.orlgmj (mgr.34412) 4080 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:05:35.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:05:35 gibba015 bash[29377]: audit 2021-03-10T15:05:34.729412+0000 mon.c (mon.1) 1166 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:05:35.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:05:35 gibba015 bash[29377]: cephadm 2021-03-10T15:05:34.729447+0000 mgr.gibba045.orlgmj (mgr.34412) 4081 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:05:35.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:05:35 gibba015 bash[29377]: cephadm 2021-03-10T15:05:34.731005+0000 mgr.gibba045.orlgmj (mgr.34412) 4082 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:05:35.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:05:35 gibba015 bash[29377]: cephadm 2021-03-10T15:05:34.731043+0000 mgr.gibba045.orlgmj (mgr.34412) 4083 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:05:35.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:05:35 gibba015 bash[29377]: cephadm 2021-03-10T15:05:34.732154+0000 mgr.gibba045.orlgmj (mgr.34412) 4084 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:05:35.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:05:35 gibba015 bash[29377]: cephadm 2021-03-10T15:05:34.732597+0000 mgr.gibba045.orlgmj (mgr.34412) 4085 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:05:35.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:05:35 gibba015 bash[29377]: cephadm 2021-03-10T15:05:34.733833+0000 mgr.gibba045.orlgmj (mgr.34412) 4086 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:05:35.980 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:05:35 gibba015 bash[29377]: cephadm 2021-03-10T15:05:34.733872+0000 mgr.gibba045.orlgmj (mgr.34412) 4087 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:05:35.980 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:05:35 gibba015 bash[29377]: cephadm 2021-03-10T15:05:34.733981+0000 mgr.gibba045.orlgmj (mgr.34412) 4088 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:05:35.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:05:35 gibba015 bash[30343]: cephadm 2021-03-10T15:05:34.519024+0000 mgr.gibba045.orlgmj (mgr.34412) 4074 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:05:35.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:05:35 gibba015 bash[30343]: audit 2021-03-10T15:05:34.717602+0000 mon.a (mon.0) 1192 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:05:35.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:05:35 gibba015 bash[30343]: audit 2021-03-10T15:05:34.721106+0000 mon.c (mon.1) 1161 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:05:35.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:05:35 gibba015 bash[30343]: audit 2021-03-10T15:05:34.722585+0000 mon.c (mon.1) 1162 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:05:35.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:05:35 gibba015 bash[30343]: cephadm 2021-03-10T15:05:34.723857+0000 mgr.gibba045.orlgmj (mgr.34412) 4075 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:05:35.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:05:35 gibba015 bash[30343]: audit 2021-03-10T15:05:34.723893+0000 mon.c (mon.1) 1163 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:05:35.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:05:35 gibba015 bash[30343]: audit 2021-03-10T15:05:34.725147+0000 mon.c (mon.1) 1164 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:05:35.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:05:35 gibba015 bash[30343]: cephadm 2021-03-10T15:05:34.725703+0000 mgr.gibba045.orlgmj (mgr.34412) 4076 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:05:35.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:05:35 gibba015 bash[30343]: cephadm 2021-03-10T15:05:34.726840+0000 mgr.gibba045.orlgmj (mgr.34412) 4077 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:05:35.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:05:35 gibba015 bash[30343]: cephadm 2021-03-10T15:05:34.726878+0000 mgr.gibba045.orlgmj (mgr.34412) 4078 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:05:35.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:05:35 gibba015 bash[30343]: audit 2021-03-10T15:05:34.727957+0000 mon.c (mon.1) 1165 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:05:35.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:05:35 gibba015 bash[30343]: cephadm 2021-03-10T15:05:34.728185+0000 mgr.gibba045.orlgmj (mgr.34412) 4079 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:05:35.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:05:35 gibba015 bash[30343]: cephadm 2021-03-10T15:05:34.728222+0000 mgr.gibba045.orlgmj (mgr.34412) 4080 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:05:35.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:05:35 gibba015 bash[30343]: audit 2021-03-10T15:05:34.729412+0000 mon.c (mon.1) 1166 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:05:35.984 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:05:35 gibba015 bash[30343]: cephadm 2021-03-10T15:05:34.729447+0000 mgr.gibba045.orlgmj (mgr.34412) 4081 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:05:35.984 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:05:35 gibba015 bash[30343]: cephadm 2021-03-10T15:05:34.731005+0000 mgr.gibba045.orlgmj (mgr.34412) 4082 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:05:35.984 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:05:35 gibba015 bash[30343]: cephadm 2021-03-10T15:05:34.731043+0000 mgr.gibba045.orlgmj (mgr.34412) 4083 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:05:35.984 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:05:35 gibba015 bash[30343]: cephadm 2021-03-10T15:05:34.732154+0000 mgr.gibba045.orlgmj (mgr.34412) 4084 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:05:35.985 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:05:35 gibba015 bash[30343]: cephadm 2021-03-10T15:05:34.732597+0000 mgr.gibba045.orlgmj (mgr.34412) 4085 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:05:35.985 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:05:35 gibba015 bash[30343]: cephadm 2021-03-10T15:05:34.733833+0000 mgr.gibba045.orlgmj (mgr.34412) 4086 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:05:35.985 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:05:35 gibba015 bash[30343]: cephadm 2021-03-10T15:05:34.733872+0000 mgr.gibba045.orlgmj (mgr.34412) 4087 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:05:35.985 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:05:35 gibba015 bash[30343]: cephadm 2021-03-10T15:05:34.733981+0000 mgr.gibba045.orlgmj (mgr.34412) 4088 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:05:36.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:05:35 gibba045 bash[25517]: cephadm 2021-03-10T15:05:34.519024+0000 mgr.gibba045.orlgmj (mgr.34412) 4074 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:05:36.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:05:35 gibba045 bash[25517]: audit 2021-03-10T15:05:34.717602+0000 mon.a (mon.0) 1192 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:05:36.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:05:35 gibba045 bash[25517]: audit 2021-03-10T15:05:34.721106+0000 mon.c (mon.1) 1161 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:05:36.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:05:35 gibba045 bash[25517]: audit 2021-03-10T15:05:34.722585+0000 mon.c (mon.1) 1162 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:05:36.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:05:35 gibba045 bash[25517]: cephadm 2021-03-10T15:05:34.723857+0000 mgr.gibba045.orlgmj (mgr.34412) 4075 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:05:36.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:05:35 gibba045 bash[25517]: audit 2021-03-10T15:05:34.723893+0000 mon.c (mon.1) 1163 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:05:36.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:05:35 gibba045 bash[25517]: audit 2021-03-10T15:05:34.725147+0000 mon.c (mon.1) 1164 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:05:36.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:05:35 gibba045 bash[25517]: cephadm 2021-03-10T15:05:34.725703+0000 mgr.gibba045.orlgmj (mgr.34412) 4076 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:05:36.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:05:35 gibba045 bash[25517]: cephadm 2021-03-10T15:05:34.726840+0000 mgr.gibba045.orlgmj (mgr.34412) 4077 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:05:36.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:05:35 gibba045 bash[25517]: cephadm 2021-03-10T15:05:34.726878+0000 mgr.gibba045.orlgmj (mgr.34412) 4078 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:05:36.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:05:35 gibba045 bash[25517]: audit 2021-03-10T15:05:34.727957+0000 mon.c (mon.1) 1165 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:05:36.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:05:35 gibba045 bash[25517]: cephadm 2021-03-10T15:05:34.728185+0000 mgr.gibba045.orlgmj (mgr.34412) 4079 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:05:36.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:05:35 gibba045 bash[25517]: cephadm 2021-03-10T15:05:34.728222+0000 mgr.gibba045.orlgmj (mgr.34412) 4080 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:05:36.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:05:35 gibba045 bash[25517]: audit 2021-03-10T15:05:34.729412+0000 mon.c (mon.1) 1166 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:05:36.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:05:35 gibba045 bash[25517]: cephadm 2021-03-10T15:05:34.729447+0000 mgr.gibba045.orlgmj (mgr.34412) 4081 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:05:36.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:05:35 gibba045 bash[25517]: cephadm 2021-03-10T15:05:34.731005+0000 mgr.gibba045.orlgmj (mgr.34412) 4082 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:05:36.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:05:35 gibba045 bash[25517]: cephadm 2021-03-10T15:05:34.731043+0000 mgr.gibba045.orlgmj (mgr.34412) 4083 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:05:36.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:05:35 gibba045 bash[25517]: cephadm 2021-03-10T15:05:34.732154+0000 mgr.gibba045.orlgmj (mgr.34412) 4084 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:05:36.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:05:35 gibba045 bash[25517]: cephadm 2021-03-10T15:05:34.732597+0000 mgr.gibba045.orlgmj (mgr.34412) 4085 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:05:36.062 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:05:35 gibba045 bash[25517]: cephadm 2021-03-10T15:05:34.733833+0000 mgr.gibba045.orlgmj (mgr.34412) 4086 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:05:36.062 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:05:35 gibba045 bash[25517]: cephadm 2021-03-10T15:05:34.733872+0000 mgr.gibba045.orlgmj (mgr.34412) 4087 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:05:36.062 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:05:35 gibba045 bash[25517]: cephadm 2021-03-10T15:05:34.733981+0000 mgr.gibba045.orlgmj (mgr.34412) 4088 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:05:37.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:05:36 gibba045 bash[25517]: cluster 2021-03-10T15:05:36.238542+0000 mgr.gibba045.orlgmj (mgr.34412) 4089 : cluster [DBG] pgmap v2315: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:37.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:05:36 gibba015 bash[29377]: cluster 2021-03-10T15:05:36.238542+0000 mgr.gibba045.orlgmj (mgr.34412) 4089 : cluster [DBG] pgmap v2315: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:37.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:05:36 gibba015 bash[30343]: cluster 2021-03-10T15:05:36.238542+0000 mgr.gibba045.orlgmj (mgr.34412) 4089 : cluster [DBG] pgmap v2315: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:39.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:05:39 gibba045 bash[25517]: cluster 2021-03-10T15:05:38.240170+0000 mgr.gibba045.orlgmj (mgr.34412) 4090 : cluster [DBG] pgmap v2316: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:39.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:05:39 gibba015 bash[29377]: cluster 2021-03-10T15:05:38.240170+0000 mgr.gibba045.orlgmj (mgr.34412) 4090 : cluster [DBG] pgmap v2316: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:39.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:05:39 gibba015 bash[30343]: cluster 2021-03-10T15:05:38.240170+0000 mgr.gibba045.orlgmj (mgr.34412) 4090 : cluster [DBG] pgmap v2316: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:41.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:05:41 gibba015 bash[29377]: cluster 2021-03-10T15:05:40.241640+0000 mgr.gibba045.orlgmj (mgr.34412) 4091 : cluster [DBG] pgmap v2317: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:41.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:05:41 gibba015 bash[30343]: cluster 2021-03-10T15:05:40.241640+0000 mgr.gibba045.orlgmj (mgr.34412) 4091 : cluster [DBG] pgmap v2317: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:41.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:05:41 gibba045 bash[25517]: cluster 2021-03-10T15:05:40.241640+0000 mgr.gibba045.orlgmj (mgr.34412) 4091 : cluster [DBG] pgmap v2317: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:43.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:05:43 gibba015 bash[29377]: cluster 2021-03-10T15:05:42.243384+0000 mgr.gibba045.orlgmj (mgr.34412) 4092 : cluster [DBG] pgmap v2318: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:43.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:05:43 gibba015 bash[30343]: cluster 2021-03-10T15:05:42.243384+0000 mgr.gibba045.orlgmj (mgr.34412) 4092 : cluster [DBG] pgmap v2318: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:43.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:05:43 gibba045 bash[25517]: cluster 2021-03-10T15:05:42.243384+0000 mgr.gibba045.orlgmj (mgr.34412) 4092 : cluster [DBG] pgmap v2318: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:44.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:05:44 gibba015 bash[29377]: cluster 2021-03-10T15:05:44.244632+0000 mgr.gibba045.orlgmj (mgr.34412) 4093 : cluster [DBG] pgmap v2319: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:44.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:05:44 gibba015 bash[30343]: cluster 2021-03-10T15:05:44.244632+0000 mgr.gibba045.orlgmj (mgr.34412) 4093 : cluster [DBG] pgmap v2319: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:45.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:05:44 gibba045 bash[25517]: cluster 2021-03-10T15:05:44.244632+0000 mgr.gibba045.orlgmj (mgr.34412) 4093 : cluster [DBG] pgmap v2319: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:47.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:05:47 gibba015 bash[29377]: cluster 2021-03-10T15:05:46.246443+0000 mgr.gibba045.orlgmj (mgr.34412) 4094 : cluster [DBG] pgmap v2320: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:47.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:05:47 gibba015 bash[30343]: cluster 2021-03-10T15:05:46.246443+0000 mgr.gibba045.orlgmj (mgr.34412) 4094 : cluster [DBG] pgmap v2320: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:47.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:05:47 gibba045 bash[25517]: cluster 2021-03-10T15:05:46.246443+0000 mgr.gibba045.orlgmj (mgr.34412) 4094 : cluster [DBG] pgmap v2320: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:49.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:05:49 gibba015 bash[29377]: cluster 2021-03-10T15:05:48.248097+0000 mgr.gibba045.orlgmj (mgr.34412) 4095 : cluster [DBG] pgmap v2321: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:49.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:05:49 gibba015 bash[30343]: cluster 2021-03-10T15:05:48.248097+0000 mgr.gibba045.orlgmj (mgr.34412) 4095 : cluster [DBG] pgmap v2321: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:49.750 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:05:49 gibba045 bash[25517]: cluster 2021-03-10T15:05:48.248097+0000 mgr.gibba045.orlgmj (mgr.34412) 4095 : cluster [DBG] pgmap v2321: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:51.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:05:51 gibba015 bash[29377]: cephadm 2021-03-10T15:05:49.750028+0000 mgr.gibba045.orlgmj (mgr.34412) 4096 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:05:51.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:05:51 gibba015 bash[29377]: cluster 2021-03-10T15:05:50.249676+0000 mgr.gibba045.orlgmj (mgr.34412) 4097 : cluster [DBG] pgmap v2322: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:51.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:05:51 gibba015 bash[30343]: cephadm 2021-03-10T15:05:49.750028+0000 mgr.gibba045.orlgmj (mgr.34412) 4096 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:05:51.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:05:51 gibba015 bash[30343]: cluster 2021-03-10T15:05:50.249676+0000 mgr.gibba045.orlgmj (mgr.34412) 4097 : cluster [DBG] pgmap v2322: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:51.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:05:51 gibba045 bash[25517]: cephadm 2021-03-10T15:05:49.750028+0000 mgr.gibba045.orlgmj (mgr.34412) 4096 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:05:51.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:05:51 gibba045 bash[25517]: cluster 2021-03-10T15:05:50.249676+0000 mgr.gibba045.orlgmj (mgr.34412) 4097 : cluster [DBG] pgmap v2322: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:05:53 gibba015 bash[29377]: cluster 2021-03-10T15:05:52.251520+0000 mgr.gibba045.orlgmj (mgr.34412) 4098 : cluster [DBG] pgmap v2323: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:05:53 gibba015 bash[29377]: audit 2021-03-10T15:05:52.979358+0000 mon.c (mon.1) 1167 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:05:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:05:53 gibba015 bash[29377]: audit 2021-03-10T15:05:52.980058+0000 mon.c (mon.1) 1168 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:05:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:05:53 gibba015 bash[29377]: audit 2021-03-10T15:05:52.980467+0000 mon.a (mon.0) 1193 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:05:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:05:53 gibba015 bash[29377]: audit 2021-03-10T15:05:52.981663+0000 mon.a (mon.0) 1194 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:05:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:05:53 gibba015 bash[29377]: audit 2021-03-10T15:05:52.983144+0000 mon.c (mon.1) 1169 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:05:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:05:53 gibba015 bash[29377]: audit 2021-03-10T15:05:52.983866+0000 mon.c (mon.1) 1170 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:05:53.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:05:53 gibba015 bash[29377]: audit 2021-03-10T15:05:52.984253+0000 mon.a (mon.0) 1195 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:05:53.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:05:53 gibba015 bash[29377]: audit 2021-03-10T15:05:52.984593+0000 mon.c (mon.1) 1171 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T15:05:53.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:05:53 gibba015 bash[29377]: audit 2021-03-10T15:05:52.985562+0000 mon.c (mon.1) 1172 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:05:53.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:05:53 gibba015 bash[29377]: audit 2021-03-10T15:05:52.985614+0000 mon.a (mon.0) 1196 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:05:53.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:05:53 gibba015 bash[29377]: audit 2021-03-10T15:05:52.986829+0000 mon.a (mon.0) 1197 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T15:05:53.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:05:53 gibba015 bash[29377]: audit 2021-03-10T15:05:52.987614+0000 mon.a (mon.0) 1198 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:05:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:05:53 gibba015 bash[30343]: cluster 2021-03-10T15:05:52.251520+0000 mgr.gibba045.orlgmj (mgr.34412) 4098 : cluster [DBG] pgmap v2323: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:05:53 gibba015 bash[30343]: audit 2021-03-10T15:05:52.979358+0000 mon.c (mon.1) 1167 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:05:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:05:53 gibba015 bash[30343]: audit 2021-03-10T15:05:52.980058+0000 mon.c (mon.1) 1168 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:05:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:05:53 gibba015 bash[30343]: audit 2021-03-10T15:05:52.980467+0000 mon.a (mon.0) 1193 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:05:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:05:53 gibba015 bash[30343]: audit 2021-03-10T15:05:52.981663+0000 mon.a (mon.0) 1194 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:05:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:05:53 gibba015 bash[30343]: audit 2021-03-10T15:05:52.983144+0000 mon.c (mon.1) 1169 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:05:53.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:05:53 gibba015 bash[30343]: audit 2021-03-10T15:05:52.983866+0000 mon.c (mon.1) 1170 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:05:53.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:05:53 gibba015 bash[30343]: audit 2021-03-10T15:05:52.984253+0000 mon.a (mon.0) 1195 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:05:53.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:05:53 gibba015 bash[30343]: audit 2021-03-10T15:05:52.984593+0000 mon.c (mon.1) 1171 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T15:05:53.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:05:53 gibba015 bash[30343]: audit 2021-03-10T15:05:52.985562+0000 mon.c (mon.1) 1172 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:05:53.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:05:53 gibba015 bash[30343]: audit 2021-03-10T15:05:52.985614+0000 mon.a (mon.0) 1196 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:05:53.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:05:53 gibba015 bash[30343]: audit 2021-03-10T15:05:52.986829+0000 mon.a (mon.0) 1197 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T15:05:53.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:05:53 gibba015 bash[30343]: audit 2021-03-10T15:05:52.987614+0000 mon.a (mon.0) 1198 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:05:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:05:53 gibba045 bash[25517]: cluster 2021-03-10T15:05:52.251520+0000 mgr.gibba045.orlgmj (mgr.34412) 4098 : cluster [DBG] pgmap v2323: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:05:53 gibba045 bash[25517]: audit 2021-03-10T15:05:52.979358+0000 mon.c (mon.1) 1167 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:05:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:05:53 gibba045 bash[25517]: audit 2021-03-10T15:05:52.980058+0000 mon.c (mon.1) 1168 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:05:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:05:53 gibba045 bash[25517]: audit 2021-03-10T15:05:52.980467+0000 mon.a (mon.0) 1193 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:05:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:05:53 gibba045 bash[25517]: audit 2021-03-10T15:05:52.981663+0000 mon.a (mon.0) 1194 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:05:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:05:53 gibba045 bash[25517]: audit 2021-03-10T15:05:52.983144+0000 mon.c (mon.1) 1169 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:05:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:05:53 gibba045 bash[25517]: audit 2021-03-10T15:05:52.983866+0000 mon.c (mon.1) 1170 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:05:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:05:53 gibba045 bash[25517]: audit 2021-03-10T15:05:52.984253+0000 mon.a (mon.0) 1195 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:05:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:05:53 gibba045 bash[25517]: audit 2021-03-10T15:05:52.984593+0000 mon.c (mon.1) 1171 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T15:05:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:05:53 gibba045 bash[25517]: audit 2021-03-10T15:05:52.985562+0000 mon.c (mon.1) 1172 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:05:53.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:05:53 gibba045 bash[25517]: audit 2021-03-10T15:05:52.985614+0000 mon.a (mon.0) 1196 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:05:53.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:05:53 gibba045 bash[25517]: audit 2021-03-10T15:05:52.986829+0000 mon.a (mon.0) 1197 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T15:05:53.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:05:53 gibba045 bash[25517]: audit 2021-03-10T15:05:52.987614+0000 mon.a (mon.0) 1198 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:05:54.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:05:54 gibba015 bash[29377]: cluster 2021-03-10T15:05:54.253028+0000 mgr.gibba045.orlgmj (mgr.34412) 4099 : cluster [DBG] pgmap v2324: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:54.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:05:54 gibba015 bash[30343]: cluster 2021-03-10T15:05:54.253028+0000 mgr.gibba045.orlgmj (mgr.34412) 4099 : cluster [DBG] pgmap v2324: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:55.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:05:54 gibba045 bash[25517]: cluster 2021-03-10T15:05:54.253028+0000 mgr.gibba045.orlgmj (mgr.34412) 4099 : cluster [DBG] pgmap v2324: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:57.085 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:05:57.326 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:05:57.326 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (76m) 86s ago 82m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:05:57.327 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (81m) 22s ago 81m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:05:57.327 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (77m) 22s ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:05:57.327 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (77m) 22s ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:05:57.327 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (76m) 86s ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:05:57.328 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (76m) 86s ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:05:57.328 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (75m) 22s ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:05:57.328 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (75m) 86s ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:05:57.328 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (82m) 86s ago 82m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:05:57.329 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (82m) 22s ago 82m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:05:57.329 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (74m) 86s ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:05:57.329 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (74m) 86s ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:05:57.329 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (74m) 86s ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:05:57.329 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (73m) 86s ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:05:57.330 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (73m) 22s ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:05:57.330 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (72m) 22s ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:05:57.330 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (72m) 22s ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:05:57.330 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (71m) 22s ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:05:57.331 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (81m) 22s ago 82m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:05:57.331 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 22s ago 80m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:05:57.578 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:05:57.579 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:05:57.579 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:05:57.579 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:05:57.579 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:05:57.580 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:05:57.580 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:05:57.580 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:05:57.580 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:05:57.581 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:05:57.581 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:05:57.581 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:05:57.581 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:05:57.582 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:05:57.582 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:05:57.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:05:57 gibba015 bash[29377]: cluster 2021-03-10T15:05:56.254534+0000 mgr.gibba045.orlgmj (mgr.34412) 4100 : cluster [DBG] pgmap v2325: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:57.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:05:57 gibba015 bash[30343]: cluster 2021-03-10T15:05:56.254534+0000 mgr.gibba045.orlgmj (mgr.34412) 4100 : cluster [DBG] pgmap v2325: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:57.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:05:57 gibba045 bash[25517]: cluster 2021-03-10T15:05:56.254534+0000 mgr.gibba045.orlgmj (mgr.34412) 4100 : cluster [DBG] pgmap v2325: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:58.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:05:58 gibba015 bash[29377]: audit 2021-03-10T15:05:57.075788+0000 mgr.gibba045.orlgmj (mgr.34412) 4101 : audit [DBG] from='client.56794 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:05:58.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:05:58 gibba015 bash[29377]: audit 2021-03-10T15:05:57.299209+0000 mgr.gibba045.orlgmj (mgr.34412) 4102 : audit [DBG] from='client.56800 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:05:58.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:05:58 gibba015 bash[29377]: audit 2021-03-10T15:05:57.574781+0000 mon.c (mon.1) 1173 : audit [DBG] from='client.? 172.21.2.115:0/2275882121' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:05:58.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:05:58 gibba015 bash[30343]: audit 2021-03-10T15:05:57.075788+0000 mgr.gibba045.orlgmj (mgr.34412) 4101 : audit [DBG] from='client.56794 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:05:58.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:05:58 gibba015 bash[30343]: audit 2021-03-10T15:05:57.299209+0000 mgr.gibba045.orlgmj (mgr.34412) 4102 : audit [DBG] from='client.56800 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:05:58.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:05:58 gibba015 bash[30343]: audit 2021-03-10T15:05:57.574781+0000 mon.c (mon.1) 1173 : audit [DBG] from='client.? 172.21.2.115:0/2275882121' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:05:58.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:05:58 gibba045 bash[25517]: audit 2021-03-10T15:05:57.075788+0000 mgr.gibba045.orlgmj (mgr.34412) 4101 : audit [DBG] from='client.56794 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:05:58.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:05:58 gibba045 bash[25517]: audit 2021-03-10T15:05:57.299209+0000 mgr.gibba045.orlgmj (mgr.34412) 4102 : audit [DBG] from='client.56800 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:05:58.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:05:58 gibba045 bash[25517]: audit 2021-03-10T15:05:57.574781+0000 mon.c (mon.1) 1173 : audit [DBG] from='client.? 172.21.2.115:0/2275882121' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:05:59.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:05:59 gibba015 bash[29377]: cluster 2021-03-10T15:05:58.256118+0000 mgr.gibba045.orlgmj (mgr.34412) 4103 : cluster [DBG] pgmap v2326: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:59.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:05:59 gibba015 bash[30343]: cluster 2021-03-10T15:05:58.256118+0000 mgr.gibba045.orlgmj (mgr.34412) 4103 : cluster [DBG] pgmap v2326: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:59.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:05:59 gibba045 bash[25517]: cluster 2021-03-10T15:05:58.256118+0000 mgr.gibba045.orlgmj (mgr.34412) 4103 : cluster [DBG] pgmap v2326: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:01.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:06:01 gibba015 bash[29377]: cluster 2021-03-10T15:06:00.257693+0000 mgr.gibba045.orlgmj (mgr.34412) 4104 : cluster [DBG] pgmap v2327: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:01.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:06:01 gibba015 bash[30343]: cluster 2021-03-10T15:06:00.257693+0000 mgr.gibba045.orlgmj (mgr.34412) 4104 : cluster [DBG] pgmap v2327: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:01.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:06:01 gibba045 bash[25517]: cluster 2021-03-10T15:06:00.257693+0000 mgr.gibba045.orlgmj (mgr.34412) 4104 : cluster [DBG] pgmap v2327: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:03.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:06:03 gibba015 bash[29377]: cluster 2021-03-10T15:06:02.259403+0000 mgr.gibba045.orlgmj (mgr.34412) 4105 : cluster [DBG] pgmap v2328: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:03.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:06:03 gibba015 bash[30343]: cluster 2021-03-10T15:06:02.259403+0000 mgr.gibba045.orlgmj (mgr.34412) 4105 : cluster [DBG] pgmap v2328: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:03.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:06:03 gibba045 bash[25517]: cluster 2021-03-10T15:06:02.259403+0000 mgr.gibba045.orlgmj (mgr.34412) 4105 : cluster [DBG] pgmap v2328: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:04.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:06:04 gibba015 bash[29377]: cluster 2021-03-10T15:06:04.260735+0000 mgr.gibba045.orlgmj (mgr.34412) 4106 : cluster [DBG] pgmap v2329: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:04.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:06:04 gibba015 bash[30343]: cluster 2021-03-10T15:06:04.260735+0000 mgr.gibba045.orlgmj (mgr.34412) 4106 : cluster [DBG] pgmap v2329: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:05.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:06:04 gibba045 bash[25517]: cluster 2021-03-10T15:06:04.260735+0000 mgr.gibba045.orlgmj (mgr.34412) 4106 : cluster [DBG] pgmap v2329: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:05.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:06:05 gibba015 bash[29377]: cephadm 2021-03-10T15:06:04.766065+0000 mgr.gibba045.orlgmj (mgr.34412) 4107 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:06:05.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:06:05 gibba015 bash[30343]: cephadm 2021-03-10T15:06:04.766065+0000 mgr.gibba045.orlgmj (mgr.34412) 4107 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:06:06.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:06:05 gibba045 bash[25517]: cephadm 2021-03-10T15:06:04.766065+0000 mgr.gibba045.orlgmj (mgr.34412) 4107 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:06:06.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:06:06 gibba015 bash[29377]: cluster 2021-03-10T15:06:06.262449+0000 mgr.gibba045.orlgmj (mgr.34412) 4108 : cluster [DBG] pgmap v2330: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:06.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:06:06 gibba015 bash[30343]: cluster 2021-03-10T15:06:06.262449+0000 mgr.gibba045.orlgmj (mgr.34412) 4108 : cluster [DBG] pgmap v2330: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:07.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:06:06 gibba045 bash[25517]: cluster 2021-03-10T15:06:06.262449+0000 mgr.gibba045.orlgmj (mgr.34412) 4108 : cluster [DBG] pgmap v2330: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:09.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:06:09 gibba015 bash[29377]: cluster 2021-03-10T15:06:08.264068+0000 mgr.gibba045.orlgmj (mgr.34412) 4109 : cluster [DBG] pgmap v2331: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:09.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:06:09 gibba015 bash[30343]: cluster 2021-03-10T15:06:08.264068+0000 mgr.gibba045.orlgmj (mgr.34412) 4109 : cluster [DBG] pgmap v2331: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:09.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:06:09 gibba045 bash[25517]: cluster 2021-03-10T15:06:08.264068+0000 mgr.gibba045.orlgmj (mgr.34412) 4109 : cluster [DBG] pgmap v2331: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:11.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:06:11 gibba015 bash[29377]: cluster 2021-03-10T15:06:10.265653+0000 mgr.gibba045.orlgmj (mgr.34412) 4110 : cluster [DBG] pgmap v2332: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:11.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:06:11 gibba015 bash[30343]: cluster 2021-03-10T15:06:10.265653+0000 mgr.gibba045.orlgmj (mgr.34412) 4110 : cluster [DBG] pgmap v2332: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:11.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:06:11 gibba045 bash[25517]: cluster 2021-03-10T15:06:10.265653+0000 mgr.gibba045.orlgmj (mgr.34412) 4110 : cluster [DBG] pgmap v2332: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:13.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:06:13 gibba015 bash[30343]: cluster 2021-03-10T15:06:12.267270+0000 mgr.gibba045.orlgmj (mgr.34412) 4111 : cluster [DBG] pgmap v2333: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:13.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:06:13 gibba015 bash[29377]: cluster 2021-03-10T15:06:12.267270+0000 mgr.gibba045.orlgmj (mgr.34412) 4111 : cluster [DBG] pgmap v2333: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:13.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:06:13 gibba045 bash[25517]: cluster 2021-03-10T15:06:12.267270+0000 mgr.gibba045.orlgmj (mgr.34412) 4111 : cluster [DBG] pgmap v2333: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:14.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:06:14 gibba015 bash[29377]: cluster 2021-03-10T15:06:14.268657+0000 mgr.gibba045.orlgmj (mgr.34412) 4112 : cluster [DBG] pgmap v2334: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:14.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:06:14 gibba015 bash[30343]: cluster 2021-03-10T15:06:14.268657+0000 mgr.gibba045.orlgmj (mgr.34412) 4112 : cluster [DBG] pgmap v2334: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:15.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:06:14 gibba045 bash[25517]: cluster 2021-03-10T15:06:14.268657+0000 mgr.gibba045.orlgmj (mgr.34412) 4112 : cluster [DBG] pgmap v2334: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:17.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:06:17 gibba015 bash[29377]: cluster 2021-03-10T15:06:16.270123+0000 mgr.gibba045.orlgmj (mgr.34412) 4113 : cluster [DBG] pgmap v2335: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:17.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:06:17 gibba015 bash[30343]: cluster 2021-03-10T15:06:16.270123+0000 mgr.gibba045.orlgmj (mgr.34412) 4113 : cluster [DBG] pgmap v2335: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:17.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:06:17 gibba045 bash[25517]: cluster 2021-03-10T15:06:16.270123+0000 mgr.gibba045.orlgmj (mgr.34412) 4113 : cluster [DBG] pgmap v2335: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:19.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:06:19 gibba015 bash[29377]: cluster 2021-03-10T15:06:18.271622+0000 mgr.gibba045.orlgmj (mgr.34412) 4114 : cluster [DBG] pgmap v2336: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:19.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:06:19 gibba015 bash[30343]: cluster 2021-03-10T15:06:18.271622+0000 mgr.gibba045.orlgmj (mgr.34412) 4114 : cluster [DBG] pgmap v2336: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:19.781 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:06:19 gibba045 bash[25517]: cluster 2021-03-10T15:06:18.271622+0000 mgr.gibba045.orlgmj (mgr.34412) 4114 : cluster [DBG] pgmap v2336: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:21.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:06:21 gibba015 bash[29377]: cephadm 2021-03-10T15:06:19.781366+0000 mgr.gibba045.orlgmj (mgr.34412) 4115 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:06:21.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:06:21 gibba015 bash[29377]: cluster 2021-03-10T15:06:20.273364+0000 mgr.gibba045.orlgmj (mgr.34412) 4116 : cluster [DBG] pgmap v2337: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:21.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:06:21 gibba015 bash[30343]: cephadm 2021-03-10T15:06:19.781366+0000 mgr.gibba045.orlgmj (mgr.34412) 4115 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:06:21.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:06:21 gibba015 bash[30343]: cluster 2021-03-10T15:06:20.273364+0000 mgr.gibba045.orlgmj (mgr.34412) 4116 : cluster [DBG] pgmap v2337: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:21.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:06:21 gibba045 bash[25517]: cephadm 2021-03-10T15:06:19.781366+0000 mgr.gibba045.orlgmj (mgr.34412) 4115 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:06:21.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:06:21 gibba045 bash[25517]: cluster 2021-03-10T15:06:20.273364+0000 mgr.gibba045.orlgmj (mgr.34412) 4116 : cluster [DBG] pgmap v2337: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:23.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:06:23 gibba015 bash[29377]: cluster 2021-03-10T15:06:22.274879+0000 mgr.gibba045.orlgmj (mgr.34412) 4117 : cluster [DBG] pgmap v2338: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:23.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:06:23 gibba015 bash[30343]: cluster 2021-03-10T15:06:22.274879+0000 mgr.gibba045.orlgmj (mgr.34412) 4117 : cluster [DBG] pgmap v2338: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:23.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:06:23 gibba045 bash[25517]: cluster 2021-03-10T15:06:22.274879+0000 mgr.gibba045.orlgmj (mgr.34412) 4117 : cluster [DBG] pgmap v2338: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:24.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:06:24 gibba015 bash[29377]: cluster 2021-03-10T15:06:24.276274+0000 mgr.gibba045.orlgmj (mgr.34412) 4118 : cluster [DBG] pgmap v2339: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:24.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:06:24 gibba015 bash[30343]: cluster 2021-03-10T15:06:24.276274+0000 mgr.gibba045.orlgmj (mgr.34412) 4118 : cluster [DBG] pgmap v2339: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:25.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:06:24 gibba045 bash[25517]: cluster 2021-03-10T15:06:24.276274+0000 mgr.gibba045.orlgmj (mgr.34412) 4118 : cluster [DBG] pgmap v2339: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:27.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:06:27 gibba015 bash[30343]: cluster 2021-03-10T15:06:26.277810+0000 mgr.gibba045.orlgmj (mgr.34412) 4119 : cluster [DBG] pgmap v2340: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:27.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:06:27 gibba015 bash[29377]: cluster 2021-03-10T15:06:26.277810+0000 mgr.gibba045.orlgmj (mgr.34412) 4119 : cluster [DBG] pgmap v2340: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:27.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:06:27 gibba045 bash[25517]: cluster 2021-03-10T15:06:26.277810+0000 mgr.gibba045.orlgmj (mgr.34412) 4119 : cluster [DBG] pgmap v2340: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:27.822 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:06:28.047 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:06:28.048 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (77m) 117s ago 82m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:06:28.048 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (82m) 53s ago 82m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:06:28.048 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (77m) 53s ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:06:28.048 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (77m) 53s ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:06:28.049 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (76m) 117s ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:06:28.049 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (76m) 117s ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:06:28.049 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (76m) 53s ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:06:28.049 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (76m) 117s ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:06:28.050 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (82m) 117s ago 82m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:06:28.050 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (82m) 53s ago 82m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:06:28.050 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (75m) 117s ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:06:28.050 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (75m) 117s ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:06:28.051 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (74m) 117s ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:06:28.051 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (74m) 117s ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:06:28.051 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (73m) 53s ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:06:28.051 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (73m) 53s ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:06:28.052 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (72m) 53s ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:06:28.052 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (72m) 53s ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:06:28.052 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (82m) 53s ago 82m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:06:28.052 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 53s ago 80m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:06:28.295 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:06:28.295 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:06:28.296 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:06:28.296 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:06:28.296 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:06:28.296 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:06:28.297 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:06:28.297 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:06:28.297 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:06:28.297 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:06:28.297 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:06:28.298 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:06:28.298 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:06:28.298 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:06:28.298 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:06:28.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:06:28 gibba015 bash[29377]: audit 2021-03-10T15:06:28.291396+0000 mon.a (mon.0) 1199 : audit [DBG] from='client.? 172.21.2.115:0/1427834553' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:06:28.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:06:28 gibba015 bash[30343]: audit 2021-03-10T15:06:28.291396+0000 mon.a (mon.0) 1199 : audit [DBG] from='client.? 172.21.2.115:0/1427834553' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:06:28.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:06:28 gibba045 bash[25517]: audit 2021-03-10T15:06:28.291396+0000 mon.a (mon.0) 1199 : audit [DBG] from='client.? 172.21.2.115:0/1427834553' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:06:29.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:06:29 gibba015 bash[29377]: audit 2021-03-10T15:06:27.813265+0000 mgr.gibba045.orlgmj (mgr.34412) 4120 : audit [DBG] from='client.56812 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:06:29.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:06:29 gibba015 bash[29377]: audit 2021-03-10T15:06:28.035682+0000 mgr.gibba045.orlgmj (mgr.34412) 4121 : audit [DBG] from='client.46830 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:06:29.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:06:29 gibba015 bash[29377]: cluster 2021-03-10T15:06:28.279195+0000 mgr.gibba045.orlgmj (mgr.34412) 4122 : cluster [DBG] pgmap v2341: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:29.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:06:29 gibba015 bash[30343]: audit 2021-03-10T15:06:27.813265+0000 mgr.gibba045.orlgmj (mgr.34412) 4120 : audit [DBG] from='client.56812 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:06:29.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:06:29 gibba015 bash[30343]: audit 2021-03-10T15:06:28.035682+0000 mgr.gibba045.orlgmj (mgr.34412) 4121 : audit [DBG] from='client.46830 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:06:29.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:06:29 gibba015 bash[30343]: cluster 2021-03-10T15:06:28.279195+0000 mgr.gibba045.orlgmj (mgr.34412) 4122 : cluster [DBG] pgmap v2341: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:29.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:06:29 gibba045 bash[25517]: audit 2021-03-10T15:06:27.813265+0000 mgr.gibba045.orlgmj (mgr.34412) 4120 : audit [DBG] from='client.56812 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:06:29.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:06:29 gibba045 bash[25517]: audit 2021-03-10T15:06:28.035682+0000 mgr.gibba045.orlgmj (mgr.34412) 4121 : audit [DBG] from='client.46830 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:06:29.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:06:29 gibba045 bash[25517]: cluster 2021-03-10T15:06:28.279195+0000 mgr.gibba045.orlgmj (mgr.34412) 4122 : cluster [DBG] pgmap v2341: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:31.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:06:31 gibba015 bash[29377]: cluster 2021-03-10T15:06:30.280575+0000 mgr.gibba045.orlgmj (mgr.34412) 4123 : cluster [DBG] pgmap v2342: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:31.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:06:31 gibba015 bash[30343]: cluster 2021-03-10T15:06:30.280575+0000 mgr.gibba045.orlgmj (mgr.34412) 4123 : cluster [DBG] pgmap v2342: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:31.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:06:31 gibba045 bash[25517]: cluster 2021-03-10T15:06:30.280575+0000 mgr.gibba045.orlgmj (mgr.34412) 4123 : cluster [DBG] pgmap v2342: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:33.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:06:33 gibba015 bash[29377]: cluster 2021-03-10T15:06:32.282115+0000 mgr.gibba045.orlgmj (mgr.34412) 4124 : cluster [DBG] pgmap v2343: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:33.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:06:33 gibba015 bash[30343]: cluster 2021-03-10T15:06:32.282115+0000 mgr.gibba045.orlgmj (mgr.34412) 4124 : cluster [DBG] pgmap v2343: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:33.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:06:33 gibba045 bash[25517]: cluster 2021-03-10T15:06:32.282115+0000 mgr.gibba045.orlgmj (mgr.34412) 4124 : cluster [DBG] pgmap v2343: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:34.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:06:34 gibba015 bash[29377]: cluster 2021-03-10T15:06:34.283337+0000 mgr.gibba045.orlgmj (mgr.34412) 4125 : cluster [DBG] pgmap v2344: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:34.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:06:34 gibba015 bash[30343]: cluster 2021-03-10T15:06:34.283337+0000 mgr.gibba045.orlgmj (mgr.34412) 4125 : cluster [DBG] pgmap v2344: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:35.029 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:06:34 gibba045 bash[25517]: cluster 2021-03-10T15:06:34.283337+0000 mgr.gibba045.orlgmj (mgr.34412) 4125 : cluster [DBG] pgmap v2344: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:35.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:06:35 gibba015 bash[29377]: audit 2021-03-10T15:06:34.794378+0000 mon.c (mon.1) 1174 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:06:35.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:06:35 gibba015 bash[29377]: cephadm 2021-03-10T15:06:34.803750+0000 mgr.gibba045.orlgmj (mgr.34412) 4126 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:06:35.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:06:35 gibba015 bash[29377]: cephadm 2021-03-10T15:06:34.805664+0000 mgr.gibba045.orlgmj (mgr.34412) 4127 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:06:35.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:06:35 gibba015 bash[29377]: audit 2021-03-10T15:06:35.012562+0000 mon.a (mon.0) 1200 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:06:35.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:06:35 gibba015 bash[29377]: audit 2021-03-10T15:06:35.015899+0000 mon.c (mon.1) 1175 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:06:35.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:06:35 gibba015 bash[29377]: audit 2021-03-10T15:06:35.017400+0000 mon.c (mon.1) 1176 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:06:35.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:06:35 gibba015 bash[29377]: cephadm 2021-03-10T15:06:35.018730+0000 mgr.gibba045.orlgmj (mgr.34412) 4128 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:06:35.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:06:35 gibba015 bash[29377]: audit 2021-03-10T15:06:35.018873+0000 mon.c (mon.1) 1177 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:06:35.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:06:35 gibba015 bash[29377]: audit 2021-03-10T15:06:35.020412+0000 mon.c (mon.1) 1178 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:06:35.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:06:35 gibba015 bash[29377]: cephadm 2021-03-10T15:06:35.020502+0000 mgr.gibba045.orlgmj (mgr.34412) 4129 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:06:35.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:06:35 gibba015 bash[29377]: cephadm 2021-03-10T15:06:35.021630+0000 mgr.gibba045.orlgmj (mgr.34412) 4130 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:06:35.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:06:35 gibba015 bash[29377]: cephadm 2021-03-10T15:06:35.021666+0000 mgr.gibba045.orlgmj (mgr.34412) 4131 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:06:35.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:06:35 gibba015 bash[29377]: audit 2021-03-10T15:06:35.023395+0000 mon.c (mon.1) 1179 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:06:35.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:06:35 gibba015 bash[29377]: cephadm 2021-03-10T15:06:35.023415+0000 mgr.gibba045.orlgmj (mgr.34412) 4132 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:06:35.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:06:35 gibba015 bash[29377]: cephadm 2021-03-10T15:06:35.023452+0000 mgr.gibba045.orlgmj (mgr.34412) 4133 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:06:35.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:06:35 gibba015 bash[29377]: cephadm 2021-03-10T15:06:35.024648+0000 mgr.gibba045.orlgmj (mgr.34412) 4134 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:06:35.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:06:35 gibba015 bash[29377]: audit 2021-03-10T15:06:35.024728+0000 mon.c (mon.1) 1180 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:06:35.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:06:35 gibba015 bash[29377]: cephadm 2021-03-10T15:06:35.026424+0000 mgr.gibba045.orlgmj (mgr.34412) 4135 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:06:35.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:06:35 gibba015 bash[29377]: cephadm 2021-03-10T15:06:35.026461+0000 mgr.gibba045.orlgmj (mgr.34412) 4136 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:06:35.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:06:35 gibba015 bash[29377]: cephadm 2021-03-10T15:06:35.027610+0000 mgr.gibba045.orlgmj (mgr.34412) 4137 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:06:35.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:06:35 gibba015 bash[30343]: audit 2021-03-10T15:06:34.794378+0000 mon.c (mon.1) 1174 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:06:35.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:06:35 gibba015 bash[30343]: cephadm 2021-03-10T15:06:34.803750+0000 mgr.gibba045.orlgmj (mgr.34412) 4126 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:06:35.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:06:35 gibba015 bash[30343]: cephadm 2021-03-10T15:06:34.805664+0000 mgr.gibba045.orlgmj (mgr.34412) 4127 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:06:35.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:06:35 gibba015 bash[30343]: audit 2021-03-10T15:06:35.012562+0000 mon.a (mon.0) 1200 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:06:35.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:06:35 gibba015 bash[30343]: audit 2021-03-10T15:06:35.015899+0000 mon.c (mon.1) 1175 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:06:35.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:06:35 gibba015 bash[30343]: audit 2021-03-10T15:06:35.017400+0000 mon.c (mon.1) 1176 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:06:35.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:06:35 gibba015 bash[30343]: cephadm 2021-03-10T15:06:35.018730+0000 mgr.gibba045.orlgmj (mgr.34412) 4128 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:06:35.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:06:35 gibba015 bash[30343]: audit 2021-03-10T15:06:35.018873+0000 mon.c (mon.1) 1177 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:06:35.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:06:35 gibba015 bash[30343]: audit 2021-03-10T15:06:35.020412+0000 mon.c (mon.1) 1178 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:06:35.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:06:35 gibba015 bash[30343]: cephadm 2021-03-10T15:06:35.020502+0000 mgr.gibba045.orlgmj (mgr.34412) 4129 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:06:35.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:06:35 gibba015 bash[30343]: cephadm 2021-03-10T15:06:35.021630+0000 mgr.gibba045.orlgmj (mgr.34412) 4130 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:06:35.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:06:35 gibba015 bash[30343]: cephadm 2021-03-10T15:06:35.021666+0000 mgr.gibba045.orlgmj (mgr.34412) 4131 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:06:35.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:06:35 gibba015 bash[30343]: audit 2021-03-10T15:06:35.023395+0000 mon.c (mon.1) 1179 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:06:35.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:06:35 gibba015 bash[30343]: cephadm 2021-03-10T15:06:35.023415+0000 mgr.gibba045.orlgmj (mgr.34412) 4132 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:06:35.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:06:35 gibba015 bash[30343]: cephadm 2021-03-10T15:06:35.023452+0000 mgr.gibba045.orlgmj (mgr.34412) 4133 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:06:35.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:06:35 gibba015 bash[30343]: cephadm 2021-03-10T15:06:35.024648+0000 mgr.gibba045.orlgmj (mgr.34412) 4134 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:06:35.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:06:35 gibba015 bash[30343]: audit 2021-03-10T15:06:35.024728+0000 mon.c (mon.1) 1180 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:06:35.984 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:06:35 gibba015 bash[30343]: cephadm 2021-03-10T15:06:35.026424+0000 mgr.gibba045.orlgmj (mgr.34412) 4135 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:06:35.984 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:06:35 gibba015 bash[30343]: cephadm 2021-03-10T15:06:35.026461+0000 mgr.gibba045.orlgmj (mgr.34412) 4136 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:06:35.984 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:06:35 gibba015 bash[30343]: cephadm 2021-03-10T15:06:35.027610+0000 mgr.gibba045.orlgmj (mgr.34412) 4137 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:06:35.984 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:06:35 gibba015 bash[29377]: cephadm 2021-03-10T15:06:35.027926+0000 mgr.gibba045.orlgmj (mgr.34412) 4138 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:06:35.985 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:06:35 gibba015 bash[29377]: cephadm 2021-03-10T15:06:35.029030+0000 mgr.gibba045.orlgmj (mgr.34412) 4139 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:06:35.985 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:06:35 gibba015 bash[29377]: cephadm 2021-03-10T15:06:35.029068+0000 mgr.gibba045.orlgmj (mgr.34412) 4140 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:06:35.985 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:06:35 gibba015 bash[29377]: cephadm 2021-03-10T15:06:35.029174+0000 mgr.gibba045.orlgmj (mgr.34412) 4141 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:06:35.986 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:06:35 gibba015 bash[30343]: cephadm 2021-03-10T15:06:35.027926+0000 mgr.gibba045.orlgmj (mgr.34412) 4138 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:06:35.986 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:06:35 gibba015 bash[30343]: cephadm 2021-03-10T15:06:35.029030+0000 mgr.gibba045.orlgmj (mgr.34412) 4139 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:06:35.986 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:06:35 gibba015 bash[30343]: cephadm 2021-03-10T15:06:35.029068+0000 mgr.gibba045.orlgmj (mgr.34412) 4140 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:06:35.986 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:06:35 gibba015 bash[30343]: cephadm 2021-03-10T15:06:35.029174+0000 mgr.gibba045.orlgmj (mgr.34412) 4141 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:06:36.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:06:35 gibba045 bash[25517]: audit 2021-03-10T15:06:34.794378+0000 mon.c (mon.1) 1174 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:06:36.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:06:35 gibba045 bash[25517]: cephadm 2021-03-10T15:06:34.803750+0000 mgr.gibba045.orlgmj (mgr.34412) 4126 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:06:36.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:06:35 gibba045 bash[25517]: cephadm 2021-03-10T15:06:34.805664+0000 mgr.gibba045.orlgmj (mgr.34412) 4127 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:06:36.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:06:35 gibba045 bash[25517]: audit 2021-03-10T15:06:35.012562+0000 mon.a (mon.0) 1200 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:06:36.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:06:35 gibba045 bash[25517]: audit 2021-03-10T15:06:35.015899+0000 mon.c (mon.1) 1175 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:06:36.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:06:35 gibba045 bash[25517]: audit 2021-03-10T15:06:35.017400+0000 mon.c (mon.1) 1176 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:06:36.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:06:35 gibba045 bash[25517]: cephadm 2021-03-10T15:06:35.018730+0000 mgr.gibba045.orlgmj (mgr.34412) 4128 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:06:36.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:06:35 gibba045 bash[25517]: audit 2021-03-10T15:06:35.018873+0000 mon.c (mon.1) 1177 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:06:36.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:06:35 gibba045 bash[25517]: audit 2021-03-10T15:06:35.020412+0000 mon.c (mon.1) 1178 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:06:36.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:06:35 gibba045 bash[25517]: cephadm 2021-03-10T15:06:35.020502+0000 mgr.gibba045.orlgmj (mgr.34412) 4129 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:06:36.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:06:35 gibba045 bash[25517]: cephadm 2021-03-10T15:06:35.021630+0000 mgr.gibba045.orlgmj (mgr.34412) 4130 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:06:36.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:06:35 gibba045 bash[25517]: cephadm 2021-03-10T15:06:35.021666+0000 mgr.gibba045.orlgmj (mgr.34412) 4131 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:06:36.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:06:35 gibba045 bash[25517]: audit 2021-03-10T15:06:35.023395+0000 mon.c (mon.1) 1179 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:06:36.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:06:35 gibba045 bash[25517]: cephadm 2021-03-10T15:06:35.023415+0000 mgr.gibba045.orlgmj (mgr.34412) 4132 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:06:36.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:06:35 gibba045 bash[25517]: cephadm 2021-03-10T15:06:35.023452+0000 mgr.gibba045.orlgmj (mgr.34412) 4133 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:06:36.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:06:35 gibba045 bash[25517]: cephadm 2021-03-10T15:06:35.024648+0000 mgr.gibba045.orlgmj (mgr.34412) 4134 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:06:36.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:06:35 gibba045 bash[25517]: audit 2021-03-10T15:06:35.024728+0000 mon.c (mon.1) 1180 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:06:36.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:06:35 gibba045 bash[25517]: cephadm 2021-03-10T15:06:35.026424+0000 mgr.gibba045.orlgmj (mgr.34412) 4135 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:06:36.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:06:35 gibba045 bash[25517]: cephadm 2021-03-10T15:06:35.026461+0000 mgr.gibba045.orlgmj (mgr.34412) 4136 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:06:36.062 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:06:35 gibba045 bash[25517]: cephadm 2021-03-10T15:06:35.027610+0000 mgr.gibba045.orlgmj (mgr.34412) 4137 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:06:36.062 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:06:35 gibba045 bash[25517]: cephadm 2021-03-10T15:06:35.027926+0000 mgr.gibba045.orlgmj (mgr.34412) 4138 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:06:36.062 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:06:35 gibba045 bash[25517]: cephadm 2021-03-10T15:06:35.029030+0000 mgr.gibba045.orlgmj (mgr.34412) 4139 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:06:36.062 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:06:35 gibba045 bash[25517]: cephadm 2021-03-10T15:06:35.029068+0000 mgr.gibba045.orlgmj (mgr.34412) 4140 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:06:36.063 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:06:35 gibba045 bash[25517]: cephadm 2021-03-10T15:06:35.029174+0000 mgr.gibba045.orlgmj (mgr.34412) 4141 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:06:36.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:06:36 gibba015 bash[29377]: cluster 2021-03-10T15:06:36.285056+0000 mgr.gibba045.orlgmj (mgr.34412) 4142 : cluster [DBG] pgmap v2345: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:36.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:06:36 gibba015 bash[30343]: cluster 2021-03-10T15:06:36.285056+0000 mgr.gibba045.orlgmj (mgr.34412) 4142 : cluster [DBG] pgmap v2345: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:37.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:06:36 gibba045 bash[25517]: cluster 2021-03-10T15:06:36.285056+0000 mgr.gibba045.orlgmj (mgr.34412) 4142 : cluster [DBG] pgmap v2345: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:39.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:06:39 gibba015 bash[29377]: cluster 2021-03-10T15:06:38.286615+0000 mgr.gibba045.orlgmj (mgr.34412) 4143 : cluster [DBG] pgmap v2346: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:39.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:06:39 gibba015 bash[30343]: cluster 2021-03-10T15:06:38.286615+0000 mgr.gibba045.orlgmj (mgr.34412) 4143 : cluster [DBG] pgmap v2346: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:39.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:06:39 gibba045 bash[25517]: cluster 2021-03-10T15:06:38.286615+0000 mgr.gibba045.orlgmj (mgr.34412) 4143 : cluster [DBG] pgmap v2346: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:41.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:06:41 gibba015 bash[29377]: cluster 2021-03-10T15:06:40.288216+0000 mgr.gibba045.orlgmj (mgr.34412) 4144 : cluster [DBG] pgmap v2347: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:41.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:06:41 gibba015 bash[30343]: cluster 2021-03-10T15:06:40.288216+0000 mgr.gibba045.orlgmj (mgr.34412) 4144 : cluster [DBG] pgmap v2347: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:41.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:06:41 gibba045 bash[25517]: cluster 2021-03-10T15:06:40.288216+0000 mgr.gibba045.orlgmj (mgr.34412) 4144 : cluster [DBG] pgmap v2347: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:43.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:06:43 gibba015 bash[29377]: cluster 2021-03-10T15:06:42.289748+0000 mgr.gibba045.orlgmj (mgr.34412) 4145 : cluster [DBG] pgmap v2348: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:43.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:06:43 gibba015 bash[30343]: cluster 2021-03-10T15:06:42.289748+0000 mgr.gibba045.orlgmj (mgr.34412) 4145 : cluster [DBG] pgmap v2348: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:43.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:06:43 gibba045 bash[25517]: cluster 2021-03-10T15:06:42.289748+0000 mgr.gibba045.orlgmj (mgr.34412) 4145 : cluster [DBG] pgmap v2348: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:44.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:06:44 gibba015 bash[29377]: cluster 2021-03-10T15:06:44.290984+0000 mgr.gibba045.orlgmj (mgr.34412) 4146 : cluster [DBG] pgmap v2349: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:44.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:06:44 gibba015 bash[30343]: cluster 2021-03-10T15:06:44.290984+0000 mgr.gibba045.orlgmj (mgr.34412) 4146 : cluster [DBG] pgmap v2349: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:45.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:06:44 gibba045 bash[25517]: cluster 2021-03-10T15:06:44.290984+0000 mgr.gibba045.orlgmj (mgr.34412) 4146 : cluster [DBG] pgmap v2349: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:47.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:06:47 gibba015 bash[29377]: cluster 2021-03-10T15:06:46.292745+0000 mgr.gibba045.orlgmj (mgr.34412) 4147 : cluster [DBG] pgmap v2350: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:47.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:06:47 gibba015 bash[30343]: cluster 2021-03-10T15:06:46.292745+0000 mgr.gibba045.orlgmj (mgr.34412) 4147 : cluster [DBG] pgmap v2350: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:47.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:06:47 gibba045 bash[25517]: cluster 2021-03-10T15:06:46.292745+0000 mgr.gibba045.orlgmj (mgr.34412) 4147 : cluster [DBG] pgmap v2350: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:49.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:06:49 gibba015 bash[29377]: cluster 2021-03-10T15:06:48.294419+0000 mgr.gibba045.orlgmj (mgr.34412) 4148 : cluster [DBG] pgmap v2351: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:49.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:06:49 gibba015 bash[30343]: cluster 2021-03-10T15:06:48.294419+0000 mgr.gibba045.orlgmj (mgr.34412) 4148 : cluster [DBG] pgmap v2351: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:49.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:06:49 gibba045 bash[25517]: cluster 2021-03-10T15:06:48.294419+0000 mgr.gibba045.orlgmj (mgr.34412) 4148 : cluster [DBG] pgmap v2351: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:51.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:06:51 gibba015 bash[29377]: cephadm 2021-03-10T15:06:50.032638+0000 mgr.gibba045.orlgmj (mgr.34412) 4149 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:06:51.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:06:51 gibba015 bash[29377]: cluster 2021-03-10T15:06:50.296088+0000 mgr.gibba045.orlgmj (mgr.34412) 4150 : cluster [DBG] pgmap v2352: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:51.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:06:51 gibba015 bash[30343]: cephadm 2021-03-10T15:06:50.032638+0000 mgr.gibba045.orlgmj (mgr.34412) 4149 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:06:51.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:06:51 gibba015 bash[30343]: cluster 2021-03-10T15:06:50.296088+0000 mgr.gibba045.orlgmj (mgr.34412) 4150 : cluster [DBG] pgmap v2352: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:51.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:06:51 gibba045 bash[25517]: cephadm 2021-03-10T15:06:50.032638+0000 mgr.gibba045.orlgmj (mgr.34412) 4149 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:06:51.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:06:51 gibba045 bash[25517]: cluster 2021-03-10T15:06:50.296088+0000 mgr.gibba045.orlgmj (mgr.34412) 4150 : cluster [DBG] pgmap v2352: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:53.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:06:53 gibba015 bash[29377]: cluster 2021-03-10T15:06:52.298019+0000 mgr.gibba045.orlgmj (mgr.34412) 4151 : cluster [DBG] pgmap v2353: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:53.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:06:53 gibba015 bash[29377]: audit 2021-03-10T15:06:52.986974+0000 mon.c (mon.1) 1181 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:06:53.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:06:53 gibba015 bash[29377]: audit 2021-03-10T15:06:52.988006+0000 mon.c (mon.1) 1182 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:06:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:06:53 gibba015 bash[29377]: audit 2021-03-10T15:06:52.988353+0000 mon.a (mon.0) 1201 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:06:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:06:53 gibba015 bash[29377]: audit 2021-03-10T15:06:52.988987+0000 mon.c (mon.1) 1183 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T15:06:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:06:53 gibba015 bash[29377]: audit 2021-03-10T15:06:52.989984+0000 mon.a (mon.0) 1202 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:06:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:06:53 gibba015 bash[29377]: audit 2021-03-10T15:06:52.990282+0000 mon.c (mon.1) 1184 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:06:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:06:53 gibba015 bash[29377]: audit 2021-03-10T15:06:52.991316+0000 mon.a (mon.0) 1203 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T15:06:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:06:53 gibba015 bash[29377]: audit 2021-03-10T15:06:52.991513+0000 mon.c (mon.1) 1185 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:06:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:06:53 gibba015 bash[29377]: audit 2021-03-10T15:06:52.992652+0000 mon.c (mon.1) 1186 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:06:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:06:53 gibba015 bash[29377]: audit 2021-03-10T15:06:52.992655+0000 mon.a (mon.0) 1204 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:06:53.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:06:53 gibba015 bash[29377]: audit 2021-03-10T15:06:52.992980+0000 mon.a (mon.0) 1205 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:06:53.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:06:53 gibba015 bash[29377]: audit 2021-03-10T15:06:52.993261+0000 mon.a (mon.0) 1206 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:06:53.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:06:53 gibba015 bash[30343]: cluster 2021-03-10T15:06:52.298019+0000 mgr.gibba045.orlgmj (mgr.34412) 4151 : cluster [DBG] pgmap v2353: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:53.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:06:53 gibba015 bash[30343]: audit 2021-03-10T15:06:52.986974+0000 mon.c (mon.1) 1181 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:06:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:06:53 gibba015 bash[30343]: audit 2021-03-10T15:06:52.988006+0000 mon.c (mon.1) 1182 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:06:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:06:53 gibba015 bash[30343]: audit 2021-03-10T15:06:52.988353+0000 mon.a (mon.0) 1201 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:06:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:06:53 gibba015 bash[30343]: audit 2021-03-10T15:06:52.988987+0000 mon.c (mon.1) 1183 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T15:06:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:06:53 gibba015 bash[30343]: audit 2021-03-10T15:06:52.989984+0000 mon.a (mon.0) 1202 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:06:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:06:53 gibba015 bash[30343]: audit 2021-03-10T15:06:52.990282+0000 mon.c (mon.1) 1184 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:06:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:06:53 gibba015 bash[30343]: audit 2021-03-10T15:06:52.991316+0000 mon.a (mon.0) 1203 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T15:06:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:06:53 gibba015 bash[30343]: audit 2021-03-10T15:06:52.991513+0000 mon.c (mon.1) 1185 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:06:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:06:53 gibba015 bash[30343]: audit 2021-03-10T15:06:52.992652+0000 mon.c (mon.1) 1186 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:06:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:06:53 gibba015 bash[30343]: audit 2021-03-10T15:06:52.992655+0000 mon.a (mon.0) 1204 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:06:53.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:06:53 gibba015 bash[30343]: audit 2021-03-10T15:06:52.992980+0000 mon.a (mon.0) 1205 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:06:53.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:06:53 gibba015 bash[30343]: audit 2021-03-10T15:06:52.993261+0000 mon.a (mon.0) 1206 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:06:53.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:06:53 gibba045 bash[25517]: cluster 2021-03-10T15:06:52.298019+0000 mgr.gibba045.orlgmj (mgr.34412) 4151 : cluster [DBG] pgmap v2353: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:06:53 gibba045 bash[25517]: audit 2021-03-10T15:06:52.986974+0000 mon.c (mon.1) 1181 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:06:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:06:53 gibba045 bash[25517]: audit 2021-03-10T15:06:52.988006+0000 mon.c (mon.1) 1182 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:06:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:06:53 gibba045 bash[25517]: audit 2021-03-10T15:06:52.988353+0000 mon.a (mon.0) 1201 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:06:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:06:53 gibba045 bash[25517]: audit 2021-03-10T15:06:52.988987+0000 mon.c (mon.1) 1183 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T15:06:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:06:53 gibba045 bash[25517]: audit 2021-03-10T15:06:52.989984+0000 mon.a (mon.0) 1202 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:06:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:06:53 gibba045 bash[25517]: audit 2021-03-10T15:06:52.990282+0000 mon.c (mon.1) 1184 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:06:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:06:53 gibba045 bash[25517]: audit 2021-03-10T15:06:52.991316+0000 mon.a (mon.0) 1203 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T15:06:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:06:53 gibba045 bash[25517]: audit 2021-03-10T15:06:52.991513+0000 mon.c (mon.1) 1185 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:06:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:06:53 gibba045 bash[25517]: audit 2021-03-10T15:06:52.992652+0000 mon.c (mon.1) 1186 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:06:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:06:53 gibba045 bash[25517]: audit 2021-03-10T15:06:52.992655+0000 mon.a (mon.0) 1204 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:06:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:06:53 gibba045 bash[25517]: audit 2021-03-10T15:06:52.992980+0000 mon.a (mon.0) 1205 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:06:53.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:06:53 gibba045 bash[25517]: audit 2021-03-10T15:06:52.993261+0000 mon.a (mon.0) 1206 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:06:54.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:06:54 gibba015 bash[29377]: cluster 2021-03-10T15:06:54.299285+0000 mgr.gibba045.orlgmj (mgr.34412) 4152 : cluster [DBG] pgmap v2354: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:54.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:06:54 gibba015 bash[30343]: cluster 2021-03-10T15:06:54.299285+0000 mgr.gibba045.orlgmj (mgr.34412) 4152 : cluster [DBG] pgmap v2354: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:55.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:06:54 gibba045 bash[25517]: cluster 2021-03-10T15:06:54.299285+0000 mgr.gibba045.orlgmj (mgr.34412) 4152 : cluster [DBG] pgmap v2354: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:57.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:06:57 gibba015 bash[29377]: cluster 2021-03-10T15:06:56.301256+0000 mgr.gibba045.orlgmj (mgr.34412) 4153 : cluster [DBG] pgmap v2355: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:57.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:06:57 gibba015 bash[30343]: cluster 2021-03-10T15:06:56.301256+0000 mgr.gibba045.orlgmj (mgr.34412) 4153 : cluster [DBG] pgmap v2355: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:57.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:06:57 gibba045 bash[25517]: cluster 2021-03-10T15:06:56.301256+0000 mgr.gibba045.orlgmj (mgr.34412) 4153 : cluster [DBG] pgmap v2355: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:58.542 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:06:58.770 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:06:58.770 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (77m) 2m ago 83m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:06:58.771 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (82m) 84s ago 82m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:06:58.771 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (78m) 84s ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:06:58.771 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (78m) 84s ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:06:58.771 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (77m) 2m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:06:58.772 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (77m) 2m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:06:58.772 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (76m) 84s ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:06:58.772 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (76m) 2m ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:06:58.772 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (83m) 2m ago 83m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:06:58.772 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (83m) 84s ago 83m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:06:58.773 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (76m) 2m ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:06:58.773 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (75m) 2m ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:06:58.773 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (75m) 2m ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:06:58.773 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (74m) 2m ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:06:58.773 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (74m) 84s ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:06:58.774 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (73m) 84s ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:06:58.774 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (73m) 84s ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:06:58.774 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (72m) 84s ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:06:58.774 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (82m) 84s ago 83m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:06:58.775 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 84s ago 81m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:06:59.015 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:06:59.016 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:06:59.016 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:06:59.016 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:06:59.017 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:06:59.017 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:06:59.017 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:06:59.018 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:06:59.018 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:06:59.018 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:06:59.018 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:06:59.019 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:06:59.019 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:06:59.019 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:06:59.019 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:06:59.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:06:59 gibba015 bash[29377]: cluster 2021-03-10T15:06:58.302975+0000 mgr.gibba045.orlgmj (mgr.34412) 4154 : cluster [DBG] pgmap v2356: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:59.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:06:59 gibba015 bash[29377]: audit 2021-03-10T15:06:58.532419+0000 mgr.gibba045.orlgmj (mgr.34412) 4155 : audit [DBG] from='client.46842 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:06:59.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:06:59 gibba015 bash[29377]: audit 2021-03-10T15:06:59.011951+0000 mon.c (mon.1) 1187 : audit [DBG] from='client.? 172.21.2.115:0/3068881723' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:06:59.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:06:59 gibba015 bash[30343]: cluster 2021-03-10T15:06:58.302975+0000 mgr.gibba045.orlgmj (mgr.34412) 4154 : cluster [DBG] pgmap v2356: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:59.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:06:59 gibba015 bash[30343]: audit 2021-03-10T15:06:58.532419+0000 mgr.gibba045.orlgmj (mgr.34412) 4155 : audit [DBG] from='client.46842 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:06:59.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:06:59 gibba015 bash[30343]: audit 2021-03-10T15:06:59.011951+0000 mon.c (mon.1) 1187 : audit [DBG] from='client.? 172.21.2.115:0/3068881723' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:06:59.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:06:59 gibba045 bash[25517]: cluster 2021-03-10T15:06:58.302975+0000 mgr.gibba045.orlgmj (mgr.34412) 4154 : cluster [DBG] pgmap v2356: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:59.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:06:59 gibba045 bash[25517]: audit 2021-03-10T15:06:58.532419+0000 mgr.gibba045.orlgmj (mgr.34412) 4155 : audit [DBG] from='client.46842 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:06:59.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:06:59 gibba045 bash[25517]: audit 2021-03-10T15:06:59.011951+0000 mon.c (mon.1) 1187 : audit [DBG] from='client.? 172.21.2.115:0/3068881723' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:07:00.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:07:00 gibba015 bash[29377]: audit 2021-03-10T15:06:58.758458+0000 mgr.gibba045.orlgmj (mgr.34412) 4156 : audit [DBG] from='client.46848 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:07:00.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:07:00 gibba015 bash[30343]: audit 2021-03-10T15:06:58.758458+0000 mgr.gibba045.orlgmj (mgr.34412) 4156 : audit [DBG] from='client.46848 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:07:00.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:07:00 gibba045 bash[25517]: audit 2021-03-10T15:06:58.758458+0000 mgr.gibba045.orlgmj (mgr.34412) 4156 : audit [DBG] from='client.46848 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:07:01.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:07:01 gibba015 bash[29377]: cluster 2021-03-10T15:07:00.304344+0000 mgr.gibba045.orlgmj (mgr.34412) 4157 : cluster [DBG] pgmap v2357: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:01.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:07:01 gibba015 bash[30343]: cluster 2021-03-10T15:07:00.304344+0000 mgr.gibba045.orlgmj (mgr.34412) 4157 : cluster [DBG] pgmap v2357: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:01.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:07:01 gibba045 bash[25517]: cluster 2021-03-10T15:07:00.304344+0000 mgr.gibba045.orlgmj (mgr.34412) 4157 : cluster [DBG] pgmap v2357: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:03.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:07:03 gibba015 bash[29377]: cluster 2021-03-10T15:07:02.306082+0000 mgr.gibba045.orlgmj (mgr.34412) 4158 : cluster [DBG] pgmap v2358: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:03.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:07:03 gibba015 bash[30343]: cluster 2021-03-10T15:07:02.306082+0000 mgr.gibba045.orlgmj (mgr.34412) 4158 : cluster [DBG] pgmap v2358: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:03.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:07:03 gibba045 bash[25517]: cluster 2021-03-10T15:07:02.306082+0000 mgr.gibba045.orlgmj (mgr.34412) 4158 : cluster [DBG] pgmap v2358: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:04.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:07:04 gibba015 bash[29377]: cluster 2021-03-10T15:07:04.307274+0000 mgr.gibba045.orlgmj (mgr.34412) 4159 : cluster [DBG] pgmap v2359: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:04.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:07:04 gibba015 bash[30343]: cluster 2021-03-10T15:07:04.307274+0000 mgr.gibba045.orlgmj (mgr.34412) 4159 : cluster [DBG] pgmap v2359: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:05.049 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:07:04 gibba045 bash[25517]: cluster 2021-03-10T15:07:04.307274+0000 mgr.gibba045.orlgmj (mgr.34412) 4159 : cluster [DBG] pgmap v2359: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:05.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:07:05 gibba015 bash[29377]: cephadm 2021-03-10T15:07:05.048774+0000 mgr.gibba045.orlgmj (mgr.34412) 4160 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:07:05.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:07:05 gibba015 bash[30343]: cephadm 2021-03-10T15:07:05.048774+0000 mgr.gibba045.orlgmj (mgr.34412) 4160 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:07:06.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:07:05 gibba045 bash[25517]: cephadm 2021-03-10T15:07:05.048774+0000 mgr.gibba045.orlgmj (mgr.34412) 4160 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:07:06.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:07:06 gibba015 bash[29377]: cluster 2021-03-10T15:07:06.308783+0000 mgr.gibba045.orlgmj (mgr.34412) 4161 : cluster [DBG] pgmap v2360: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:06.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:07:06 gibba015 bash[30343]: cluster 2021-03-10T15:07:06.308783+0000 mgr.gibba045.orlgmj (mgr.34412) 4161 : cluster [DBG] pgmap v2360: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:07.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:07:06 gibba045 bash[25517]: cluster 2021-03-10T15:07:06.308783+0000 mgr.gibba045.orlgmj (mgr.34412) 4161 : cluster [DBG] pgmap v2360: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:09.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:07:09 gibba015 bash[29377]: cluster 2021-03-10T15:07:08.310484+0000 mgr.gibba045.orlgmj (mgr.34412) 4162 : cluster [DBG] pgmap v2361: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:09.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:07:09 gibba015 bash[30343]: cluster 2021-03-10T15:07:08.310484+0000 mgr.gibba045.orlgmj (mgr.34412) 4162 : cluster [DBG] pgmap v2361: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:09.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:07:09 gibba045 bash[25517]: cluster 2021-03-10T15:07:08.310484+0000 mgr.gibba045.orlgmj (mgr.34412) 4162 : cluster [DBG] pgmap v2361: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:11.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:07:11 gibba015 bash[29377]: cluster 2021-03-10T15:07:10.312032+0000 mgr.gibba045.orlgmj (mgr.34412) 4163 : cluster [DBG] pgmap v2362: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:11.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:07:11 gibba015 bash[30343]: cluster 2021-03-10T15:07:10.312032+0000 mgr.gibba045.orlgmj (mgr.34412) 4163 : cluster [DBG] pgmap v2362: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:11.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:07:11 gibba045 bash[25517]: cluster 2021-03-10T15:07:10.312032+0000 mgr.gibba045.orlgmj (mgr.34412) 4163 : cluster [DBG] pgmap v2362: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:13.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:07:13 gibba015 bash[29377]: cluster 2021-03-10T15:07:12.313623+0000 mgr.gibba045.orlgmj (mgr.34412) 4164 : cluster [DBG] pgmap v2363: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:13.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:07:13 gibba015 bash[30343]: cluster 2021-03-10T15:07:12.313623+0000 mgr.gibba045.orlgmj (mgr.34412) 4164 : cluster [DBG] pgmap v2363: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:13.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:07:13 gibba045 bash[25517]: cluster 2021-03-10T15:07:12.313623+0000 mgr.gibba045.orlgmj (mgr.34412) 4164 : cluster [DBG] pgmap v2363: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:14.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:07:14 gibba015 bash[29377]: cluster 2021-03-10T15:07:14.314844+0000 mgr.gibba045.orlgmj (mgr.34412) 4165 : cluster [DBG] pgmap v2364: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:14.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:07:14 gibba015 bash[30343]: cluster 2021-03-10T15:07:14.314844+0000 mgr.gibba045.orlgmj (mgr.34412) 4165 : cluster [DBG] pgmap v2364: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:15.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:07:14 gibba045 bash[25517]: cluster 2021-03-10T15:07:14.314844+0000 mgr.gibba045.orlgmj (mgr.34412) 4165 : cluster [DBG] pgmap v2364: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:17.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:07:17 gibba015 bash[29377]: cluster 2021-03-10T15:07:16.316653+0000 mgr.gibba045.orlgmj (mgr.34412) 4166 : cluster [DBG] pgmap v2365: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:17.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:07:17 gibba015 bash[30343]: cluster 2021-03-10T15:07:16.316653+0000 mgr.gibba045.orlgmj (mgr.34412) 4166 : cluster [DBG] pgmap v2365: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:17.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:07:17 gibba045 bash[25517]: cluster 2021-03-10T15:07:16.316653+0000 mgr.gibba045.orlgmj (mgr.34412) 4166 : cluster [DBG] pgmap v2365: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:19.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:07:19 gibba015 bash[29377]: cluster 2021-03-10T15:07:18.317963+0000 mgr.gibba045.orlgmj (mgr.34412) 4167 : cluster [DBG] pgmap v2366: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:19.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:07:19 gibba015 bash[30343]: cluster 2021-03-10T15:07:18.317963+0000 mgr.gibba045.orlgmj (mgr.34412) 4167 : cluster [DBG] pgmap v2366: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:19.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:07:19 gibba045 bash[25517]: cluster 2021-03-10T15:07:18.317963+0000 mgr.gibba045.orlgmj (mgr.34412) 4167 : cluster [DBG] pgmap v2366: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:21.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:07:21 gibba015 bash[29377]: cephadm 2021-03-10T15:07:20.064334+0000 mgr.gibba045.orlgmj (mgr.34412) 4168 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:07:21.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:07:21 gibba015 bash[29377]: cluster 2021-03-10T15:07:20.319611+0000 mgr.gibba045.orlgmj (mgr.34412) 4169 : cluster [DBG] pgmap v2367: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:21.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:07:21 gibba015 bash[30343]: cephadm 2021-03-10T15:07:20.064334+0000 mgr.gibba045.orlgmj (mgr.34412) 4168 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:07:21.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:07:21 gibba015 bash[30343]: cluster 2021-03-10T15:07:20.319611+0000 mgr.gibba045.orlgmj (mgr.34412) 4169 : cluster [DBG] pgmap v2367: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:21.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:07:21 gibba045 bash[25517]: cephadm 2021-03-10T15:07:20.064334+0000 mgr.gibba045.orlgmj (mgr.34412) 4168 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:07:21.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:07:21 gibba045 bash[25517]: cluster 2021-03-10T15:07:20.319611+0000 mgr.gibba045.orlgmj (mgr.34412) 4169 : cluster [DBG] pgmap v2367: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:23.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:07:23 gibba015 bash[29377]: cluster 2021-03-10T15:07:22.321332+0000 mgr.gibba045.orlgmj (mgr.34412) 4170 : cluster [DBG] pgmap v2368: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:23.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:07:23 gibba015 bash[30343]: cluster 2021-03-10T15:07:22.321332+0000 mgr.gibba045.orlgmj (mgr.34412) 4170 : cluster [DBG] pgmap v2368: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:23.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:07:23 gibba045 bash[25517]: cluster 2021-03-10T15:07:22.321332+0000 mgr.gibba045.orlgmj (mgr.34412) 4170 : cluster [DBG] pgmap v2368: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:24.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:07:24 gibba015 bash[29377]: cluster 2021-03-10T15:07:24.322509+0000 mgr.gibba045.orlgmj (mgr.34412) 4171 : cluster [DBG] pgmap v2369: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:24.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:07:24 gibba015 bash[30343]: cluster 2021-03-10T15:07:24.322509+0000 mgr.gibba045.orlgmj (mgr.34412) 4171 : cluster [DBG] pgmap v2369: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:25.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:07:24 gibba045 bash[25517]: cluster 2021-03-10T15:07:24.322509+0000 mgr.gibba045.orlgmj (mgr.34412) 4171 : cluster [DBG] pgmap v2369: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:27.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:07:27 gibba015 bash[29377]: cluster 2021-03-10T15:07:26.324638+0000 mgr.gibba045.orlgmj (mgr.34412) 4172 : cluster [DBG] pgmap v2370: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:27.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:07:27 gibba015 bash[30343]: cluster 2021-03-10T15:07:26.324638+0000 mgr.gibba045.orlgmj (mgr.34412) 4172 : cluster [DBG] pgmap v2370: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:27.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:07:27 gibba045 bash[25517]: cluster 2021-03-10T15:07:26.324638+0000 mgr.gibba045.orlgmj (mgr.34412) 4172 : cluster [DBG] pgmap v2370: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:29.258 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:07:29.489 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:07:29.489 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (78m) 2m ago 83m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:07:29.490 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (83m) 114s ago 83m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:07:29.490 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (78m) 114s ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:07:29.490 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (78m) 114s ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:07:29.491 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (77m) 2m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:07:29.491 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (77m) 2m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:07:29.491 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (77m) 114s ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:07:29.491 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (77m) 2m ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:07:29.492 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (83m) 2m ago 83m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:07:29.492 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (83m) 114s ago 83m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:07:29.492 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (76m) 2m ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:07:29.493 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (76m) 2m ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:07:29.493 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (75m) 2m ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:07:29.493 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (75m) 2m ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:07:29.493 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (74m) 114s ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:07:29.494 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (74m) 114s ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:07:29.494 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (73m) 114s ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:07:29.494 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (73m) 114s ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:07:29.495 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (83m) 114s ago 83m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:07:29.495 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 114s ago 81m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:07:29.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:07:29 gibba015 bash[29377]: cluster 2021-03-10T15:07:28.326324+0000 mgr.gibba045.orlgmj (mgr.34412) 4173 : cluster [DBG] pgmap v2371: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:29.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:07:29 gibba015 bash[30343]: cluster 2021-03-10T15:07:28.326324+0000 mgr.gibba045.orlgmj (mgr.34412) 4173 : cluster [DBG] pgmap v2371: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:29.747 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:07:29.747 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:07:29.748 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:07:29.748 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:07:29.748 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:07:29.749 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:07:29.749 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:07:29.749 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:07:29.750 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:07:29.750 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:07:29.750 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:07:29.750 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:07:29.751 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:07:29.751 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:07:29.751 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:07:29.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:07:29 gibba045 bash[25517]: cluster 2021-03-10T15:07:28.326324+0000 mgr.gibba045.orlgmj (mgr.34412) 4173 : cluster [DBG] pgmap v2371: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:30.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:07:30 gibba015 bash[29377]: audit 2021-03-10T15:07:29.248762+0000 mgr.gibba045.orlgmj (mgr.34412) 4174 : audit [DBG] from='client.56848 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:07:30.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:07:30 gibba015 bash[29377]: audit 2021-03-10T15:07:29.476271+0000 mgr.gibba045.orlgmj (mgr.34412) 4175 : audit [DBG] from='client.46866 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:07:30.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:07:30 gibba015 bash[29377]: audit 2021-03-10T15:07:29.743610+0000 mon.c (mon.1) 1188 : audit [DBG] from='client.? 172.21.2.115:0/3274004039' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:07:30.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:07:30 gibba015 bash[30343]: audit 2021-03-10T15:07:29.248762+0000 mgr.gibba045.orlgmj (mgr.34412) 4174 : audit [DBG] from='client.56848 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:07:30.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:07:30 gibba015 bash[30343]: audit 2021-03-10T15:07:29.476271+0000 mgr.gibba045.orlgmj (mgr.34412) 4175 : audit [DBG] from='client.46866 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:07:30.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:07:30 gibba015 bash[30343]: audit 2021-03-10T15:07:29.743610+0000 mon.c (mon.1) 1188 : audit [DBG] from='client.? 172.21.2.115:0/3274004039' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:07:30.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:07:30 gibba045 bash[25517]: audit 2021-03-10T15:07:29.248762+0000 mgr.gibba045.orlgmj (mgr.34412) 4174 : audit [DBG] from='client.56848 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:07:30.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:07:30 gibba045 bash[25517]: audit 2021-03-10T15:07:29.476271+0000 mgr.gibba045.orlgmj (mgr.34412) 4175 : audit [DBG] from='client.46866 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:07:30.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:07:30 gibba045 bash[25517]: audit 2021-03-10T15:07:29.743610+0000 mon.c (mon.1) 1188 : audit [DBG] from='client.? 172.21.2.115:0/3274004039' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:07:31.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:07:31 gibba015 bash[29377]: cluster 2021-03-10T15:07:30.328071+0000 mgr.gibba045.orlgmj (mgr.34412) 4176 : cluster [DBG] pgmap v2372: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:31.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:07:31 gibba015 bash[30343]: cluster 2021-03-10T15:07:30.328071+0000 mgr.gibba045.orlgmj (mgr.34412) 4176 : cluster [DBG] pgmap v2372: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:31.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:07:31 gibba045 bash[25517]: cluster 2021-03-10T15:07:30.328071+0000 mgr.gibba045.orlgmj (mgr.34412) 4176 : cluster [DBG] pgmap v2372: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:33.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:07:33 gibba015 bash[29377]: cluster 2021-03-10T15:07:32.329794+0000 mgr.gibba045.orlgmj (mgr.34412) 4177 : cluster [DBG] pgmap v2373: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:33.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:07:33 gibba015 bash[30343]: cluster 2021-03-10T15:07:32.329794+0000 mgr.gibba045.orlgmj (mgr.34412) 4177 : cluster [DBG] pgmap v2373: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:33.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:07:33 gibba045 bash[25517]: cluster 2021-03-10T15:07:32.329794+0000 mgr.gibba045.orlgmj (mgr.34412) 4177 : cluster [DBG] pgmap v2373: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:34.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:07:34 gibba015 bash[29377]: cluster 2021-03-10T15:07:34.331002+0000 mgr.gibba045.orlgmj (mgr.34412) 4178 : cluster [DBG] pgmap v2374: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:34.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:07:34 gibba015 bash[30343]: cluster 2021-03-10T15:07:34.331002+0000 mgr.gibba045.orlgmj (mgr.34412) 4178 : cluster [DBG] pgmap v2374: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:35.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:07:34 gibba045 bash[25517]: cluster 2021-03-10T15:07:34.331002+0000 mgr.gibba045.orlgmj (mgr.34412) 4178 : cluster [DBG] pgmap v2374: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:35.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:07:35 gibba015 bash[29377]: audit 2021-03-10T15:07:35.074521+0000 mon.c (mon.1) 1189 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:07:35.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:07:35 gibba015 bash[29377]: cephadm 2021-03-10T15:07:35.082706+0000 mgr.gibba045.orlgmj (mgr.34412) 4179 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:07:35.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:07:35 gibba015 bash[29377]: cephadm 2021-03-10T15:07:35.084538+0000 mgr.gibba045.orlgmj (mgr.34412) 4180 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:07:35.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:07:35 gibba015 bash[29377]: audit 2021-03-10T15:07:35.337996+0000 mon.a (mon.0) 1207 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:07:35.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:07:35 gibba015 bash[29377]: audit 2021-03-10T15:07:35.342901+0000 mon.c (mon.1) 1190 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:07:35.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:07:35 gibba015 bash[29377]: audit 2021-03-10T15:07:35.344746+0000 mon.c (mon.1) 1191 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:07:35.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:07:35 gibba015 bash[29377]: cephadm 2021-03-10T15:07:35.345482+0000 mgr.gibba045.orlgmj (mgr.34412) 4181 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:07:35.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:07:35 gibba015 bash[29377]: audit 2021-03-10T15:07:35.346828+0000 mon.c (mon.1) 1192 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:07:35.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:07:35 gibba015 bash[29377]: cephadm 2021-03-10T15:07:35.347691+0000 mgr.gibba045.orlgmj (mgr.34412) 4182 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:07:35.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:07:35 gibba015 bash[29377]: audit 2021-03-10T15:07:35.348524+0000 mon.c (mon.1) 1193 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:07:35.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:07:35 gibba015 bash[29377]: cephadm 2021-03-10T15:07:35.349510+0000 mgr.gibba045.orlgmj (mgr.34412) 4183 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:07:35.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:07:35 gibba015 bash[29377]: cephadm 2021-03-10T15:07:35.349574+0000 mgr.gibba045.orlgmj (mgr.34412) 4184 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:07:35.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:07:35 gibba015 bash[29377]: cephadm 2021-03-10T15:07:35.351490+0000 mgr.gibba045.orlgmj (mgr.34412) 4185 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:07:35.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:07:35 gibba015 bash[29377]: cephadm 2021-03-10T15:07:35.351556+0000 mgr.gibba045.orlgmj (mgr.34412) 4186 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:07:35.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:07:35 gibba015 bash[29377]: audit 2021-03-10T15:07:35.352875+0000 mon.c (mon.1) 1194 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:07:35.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:07:35 gibba015 bash[29377]: cephadm 2021-03-10T15:07:35.353162+0000 mgr.gibba045.orlgmj (mgr.34412) 4187 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:07:35.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:07:35 gibba015 bash[29377]: cephadm 2021-03-10T15:07:35.355549+0000 mgr.gibba045.orlgmj (mgr.34412) 4188 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:07:35.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:07:35 gibba015 bash[29377]: cephadm 2021-03-10T15:07:35.355620+0000 mgr.gibba045.orlgmj (mgr.34412) 4189 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:07:35.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:07:35 gibba015 bash[29377]: audit 2021-03-10T15:07:35.355752+0000 mon.c (mon.1) 1195 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:07:35.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:07:35 gibba015 bash[29377]: cephadm 2021-03-10T15:07:35.357892+0000 mgr.gibba045.orlgmj (mgr.34412) 4190 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:07:35.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:07:35 gibba015 bash[30343]: audit 2021-03-10T15:07:35.074521+0000 mon.c (mon.1) 1189 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:07:35.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:07:35 gibba015 bash[30343]: cephadm 2021-03-10T15:07:35.082706+0000 mgr.gibba045.orlgmj (mgr.34412) 4179 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:07:35.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:07:35 gibba015 bash[30343]: cephadm 2021-03-10T15:07:35.084538+0000 mgr.gibba045.orlgmj (mgr.34412) 4180 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:07:35.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:07:35 gibba015 bash[30343]: audit 2021-03-10T15:07:35.337996+0000 mon.a (mon.0) 1207 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:07:35.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:07:35 gibba015 bash[30343]: audit 2021-03-10T15:07:35.342901+0000 mon.c (mon.1) 1190 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:07:35.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:07:35 gibba015 bash[30343]: audit 2021-03-10T15:07:35.344746+0000 mon.c (mon.1) 1191 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:07:35.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:07:35 gibba015 bash[30343]: cephadm 2021-03-10T15:07:35.345482+0000 mgr.gibba045.orlgmj (mgr.34412) 4181 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:07:35.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:07:35 gibba015 bash[30343]: audit 2021-03-10T15:07:35.346828+0000 mon.c (mon.1) 1192 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:07:35.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:07:35 gibba015 bash[30343]: cephadm 2021-03-10T15:07:35.347691+0000 mgr.gibba045.orlgmj (mgr.34412) 4182 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:07:35.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:07:35 gibba015 bash[30343]: audit 2021-03-10T15:07:35.348524+0000 mon.c (mon.1) 1193 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:07:35.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:07:35 gibba015 bash[30343]: cephadm 2021-03-10T15:07:35.349510+0000 mgr.gibba045.orlgmj (mgr.34412) 4183 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:07:35.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:07:35 gibba015 bash[30343]: cephadm 2021-03-10T15:07:35.349574+0000 mgr.gibba045.orlgmj (mgr.34412) 4184 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:07:35.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:07:35 gibba015 bash[30343]: cephadm 2021-03-10T15:07:35.351490+0000 mgr.gibba045.orlgmj (mgr.34412) 4185 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:07:35.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:07:35 gibba015 bash[30343]: cephadm 2021-03-10T15:07:35.351556+0000 mgr.gibba045.orlgmj (mgr.34412) 4186 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:07:35.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:07:35 gibba015 bash[30343]: audit 2021-03-10T15:07:35.352875+0000 mon.c (mon.1) 1194 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:07:35.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:07:35 gibba015 bash[30343]: cephadm 2021-03-10T15:07:35.353162+0000 mgr.gibba045.orlgmj (mgr.34412) 4187 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:07:35.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:07:35 gibba015 bash[30343]: cephadm 2021-03-10T15:07:35.355549+0000 mgr.gibba045.orlgmj (mgr.34412) 4188 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:07:35.984 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:07:35 gibba015 bash[30343]: cephadm 2021-03-10T15:07:35.355620+0000 mgr.gibba045.orlgmj (mgr.34412) 4189 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:07:35.984 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:07:35 gibba015 bash[30343]: audit 2021-03-10T15:07:35.355752+0000 mon.c (mon.1) 1195 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:07:35.984 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:07:35 gibba015 bash[30343]: cephadm 2021-03-10T15:07:35.357892+0000 mgr.gibba045.orlgmj (mgr.34412) 4190 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:07:35.985 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:07:35 gibba015 bash[29377]: cephadm 2021-03-10T15:07:35.358746+0000 mgr.gibba045.orlgmj (mgr.34412) 4191 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:07:35.985 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:07:35 gibba015 bash[29377]: cephadm 2021-03-10T15:07:35.360494+0000 mgr.gibba045.orlgmj (mgr.34412) 4192 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:07:35.985 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:07:35 gibba015 bash[29377]: cephadm 2021-03-10T15:07:35.360574+0000 mgr.gibba045.orlgmj (mgr.34412) 4193 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:07:35.985 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:07:35 gibba015 bash[29377]: cephadm 2021-03-10T15:07:35.360809+0000 mgr.gibba045.orlgmj (mgr.34412) 4194 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:07:35.986 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:07:35 gibba015 bash[30343]: cephadm 2021-03-10T15:07:35.358746+0000 mgr.gibba045.orlgmj (mgr.34412) 4191 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:07:35.986 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:07:35 gibba015 bash[30343]: cephadm 2021-03-10T15:07:35.360494+0000 mgr.gibba045.orlgmj (mgr.34412) 4192 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:07:35.986 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:07:35 gibba015 bash[30343]: cephadm 2021-03-10T15:07:35.360574+0000 mgr.gibba045.orlgmj (mgr.34412) 4193 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:07:35.986 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:07:35 gibba015 bash[30343]: cephadm 2021-03-10T15:07:35.360809+0000 mgr.gibba045.orlgmj (mgr.34412) 4194 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:07:36.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:07:35 gibba045 bash[25517]: audit 2021-03-10T15:07:35.074521+0000 mon.c (mon.1) 1189 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:07:36.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:07:35 gibba045 bash[25517]: cephadm 2021-03-10T15:07:35.082706+0000 mgr.gibba045.orlgmj (mgr.34412) 4179 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:07:36.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:07:35 gibba045 bash[25517]: cephadm 2021-03-10T15:07:35.084538+0000 mgr.gibba045.orlgmj (mgr.34412) 4180 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:07:36.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:07:35 gibba045 bash[25517]: audit 2021-03-10T15:07:35.337996+0000 mon.a (mon.0) 1207 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:07:36.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:07:35 gibba045 bash[25517]: audit 2021-03-10T15:07:35.342901+0000 mon.c (mon.1) 1190 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:07:36.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:07:35 gibba045 bash[25517]: audit 2021-03-10T15:07:35.344746+0000 mon.c (mon.1) 1191 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:07:36.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:07:35 gibba045 bash[25517]: cephadm 2021-03-10T15:07:35.345482+0000 mgr.gibba045.orlgmj (mgr.34412) 4181 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:07:36.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:07:35 gibba045 bash[25517]: audit 2021-03-10T15:07:35.346828+0000 mon.c (mon.1) 1192 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:07:36.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:07:35 gibba045 bash[25517]: cephadm 2021-03-10T15:07:35.347691+0000 mgr.gibba045.orlgmj (mgr.34412) 4182 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:07:36.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:07:35 gibba045 bash[25517]: audit 2021-03-10T15:07:35.348524+0000 mon.c (mon.1) 1193 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:07:36.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:07:35 gibba045 bash[25517]: cephadm 2021-03-10T15:07:35.349510+0000 mgr.gibba045.orlgmj (mgr.34412) 4183 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:07:36.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:07:35 gibba045 bash[25517]: cephadm 2021-03-10T15:07:35.349574+0000 mgr.gibba045.orlgmj (mgr.34412) 4184 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:07:36.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:07:35 gibba045 bash[25517]: cephadm 2021-03-10T15:07:35.351490+0000 mgr.gibba045.orlgmj (mgr.34412) 4185 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:07:36.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:07:35 gibba045 bash[25517]: cephadm 2021-03-10T15:07:35.351556+0000 mgr.gibba045.orlgmj (mgr.34412) 4186 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:07:36.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:07:35 gibba045 bash[25517]: audit 2021-03-10T15:07:35.352875+0000 mon.c (mon.1) 1194 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:07:36.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:07:35 gibba045 bash[25517]: cephadm 2021-03-10T15:07:35.353162+0000 mgr.gibba045.orlgmj (mgr.34412) 4187 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:07:36.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:07:35 gibba045 bash[25517]: cephadm 2021-03-10T15:07:35.355549+0000 mgr.gibba045.orlgmj (mgr.34412) 4188 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:07:36.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:07:35 gibba045 bash[25517]: cephadm 2021-03-10T15:07:35.355620+0000 mgr.gibba045.orlgmj (mgr.34412) 4189 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:07:36.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:07:35 gibba045 bash[25517]: audit 2021-03-10T15:07:35.355752+0000 mon.c (mon.1) 1195 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:07:36.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:07:35 gibba045 bash[25517]: cephadm 2021-03-10T15:07:35.357892+0000 mgr.gibba045.orlgmj (mgr.34412) 4190 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:07:36.062 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:07:35 gibba045 bash[25517]: cephadm 2021-03-10T15:07:35.358746+0000 mgr.gibba045.orlgmj (mgr.34412) 4191 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:07:36.062 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:07:35 gibba045 bash[25517]: cephadm 2021-03-10T15:07:35.360494+0000 mgr.gibba045.orlgmj (mgr.34412) 4192 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:07:36.062 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:07:35 gibba045 bash[25517]: cephadm 2021-03-10T15:07:35.360574+0000 mgr.gibba045.orlgmj (mgr.34412) 4193 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:07:36.062 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:07:35 gibba045 bash[25517]: cephadm 2021-03-10T15:07:35.360809+0000 mgr.gibba045.orlgmj (mgr.34412) 4194 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:07:37.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:07:36 gibba045 bash[25517]: cluster 2021-03-10T15:07:36.332718+0000 mgr.gibba045.orlgmj (mgr.34412) 4195 : cluster [DBG] pgmap v2375: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:37.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:07:36 gibba015 bash[29377]: cluster 2021-03-10T15:07:36.332718+0000 mgr.gibba045.orlgmj (mgr.34412) 4195 : cluster [DBG] pgmap v2375: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:37.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:07:36 gibba015 bash[30343]: cluster 2021-03-10T15:07:36.332718+0000 mgr.gibba045.orlgmj (mgr.34412) 4195 : cluster [DBG] pgmap v2375: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:39.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:07:39 gibba015 bash[29377]: cluster 2021-03-10T15:07:38.334260+0000 mgr.gibba045.orlgmj (mgr.34412) 4196 : cluster [DBG] pgmap v2376: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:39.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:07:39 gibba015 bash[30343]: cluster 2021-03-10T15:07:38.334260+0000 mgr.gibba045.orlgmj (mgr.34412) 4196 : cluster [DBG] pgmap v2376: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:39.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:07:39 gibba045 bash[25517]: cluster 2021-03-10T15:07:38.334260+0000 mgr.gibba045.orlgmj (mgr.34412) 4196 : cluster [DBG] pgmap v2376: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:41.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:07:41 gibba015 bash[29377]: cluster 2021-03-10T15:07:40.335984+0000 mgr.gibba045.orlgmj (mgr.34412) 4197 : cluster [DBG] pgmap v2377: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:41.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:07:41 gibba015 bash[30343]: cluster 2021-03-10T15:07:40.335984+0000 mgr.gibba045.orlgmj (mgr.34412) 4197 : cluster [DBG] pgmap v2377: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:41.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:07:41 gibba045 bash[25517]: cluster 2021-03-10T15:07:40.335984+0000 mgr.gibba045.orlgmj (mgr.34412) 4197 : cluster [DBG] pgmap v2377: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:43.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:07:43 gibba015 bash[29377]: cluster 2021-03-10T15:07:42.337730+0000 mgr.gibba045.orlgmj (mgr.34412) 4198 : cluster [DBG] pgmap v2378: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:43.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:07:43 gibba015 bash[30343]: cluster 2021-03-10T15:07:42.337730+0000 mgr.gibba045.orlgmj (mgr.34412) 4198 : cluster [DBG] pgmap v2378: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:43.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:07:43 gibba045 bash[25517]: cluster 2021-03-10T15:07:42.337730+0000 mgr.gibba045.orlgmj (mgr.34412) 4198 : cluster [DBG] pgmap v2378: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:44.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:07:44 gibba015 bash[29377]: cluster 2021-03-10T15:07:44.339074+0000 mgr.gibba045.orlgmj (mgr.34412) 4199 : cluster [DBG] pgmap v2379: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:44.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:07:44 gibba015 bash[30343]: cluster 2021-03-10T15:07:44.339074+0000 mgr.gibba045.orlgmj (mgr.34412) 4199 : cluster [DBG] pgmap v2379: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:45.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:07:44 gibba045 bash[25517]: cluster 2021-03-10T15:07:44.339074+0000 mgr.gibba045.orlgmj (mgr.34412) 4199 : cluster [DBG] pgmap v2379: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:47.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:07:47 gibba015 bash[29377]: cluster 2021-03-10T15:07:46.340907+0000 mgr.gibba045.orlgmj (mgr.34412) 4200 : cluster [DBG] pgmap v2380: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:47.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:07:47 gibba015 bash[30343]: cluster 2021-03-10T15:07:46.340907+0000 mgr.gibba045.orlgmj (mgr.34412) 4200 : cluster [DBG] pgmap v2380: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:47.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:07:47 gibba045 bash[25517]: cluster 2021-03-10T15:07:46.340907+0000 mgr.gibba045.orlgmj (mgr.34412) 4200 : cluster [DBG] pgmap v2380: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:49.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:07:49 gibba015 bash[29377]: cluster 2021-03-10T15:07:48.342421+0000 mgr.gibba045.orlgmj (mgr.34412) 4201 : cluster [DBG] pgmap v2381: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:49.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:07:49 gibba015 bash[30343]: cluster 2021-03-10T15:07:48.342421+0000 mgr.gibba045.orlgmj (mgr.34412) 4201 : cluster [DBG] pgmap v2381: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:49.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:07:49 gibba045 bash[25517]: cluster 2021-03-10T15:07:48.342421+0000 mgr.gibba045.orlgmj (mgr.34412) 4201 : cluster [DBG] pgmap v2381: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:51.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:07:51 gibba015 bash[29377]: cluster 2021-03-10T15:07:50.343955+0000 mgr.gibba045.orlgmj (mgr.34412) 4202 : cluster [DBG] pgmap v2382: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:51.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:07:51 gibba015 bash[29377]: cephadm 2021-03-10T15:07:50.365668+0000 mgr.gibba045.orlgmj (mgr.34412) 4203 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:07:51.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:07:51 gibba015 bash[30343]: cluster 2021-03-10T15:07:50.343955+0000 mgr.gibba045.orlgmj (mgr.34412) 4202 : cluster [DBG] pgmap v2382: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:51.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:07:51 gibba015 bash[30343]: cephadm 2021-03-10T15:07:50.365668+0000 mgr.gibba045.orlgmj (mgr.34412) 4203 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:07:51.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:07:51 gibba045 bash[25517]: cluster 2021-03-10T15:07:50.343955+0000 mgr.gibba045.orlgmj (mgr.34412) 4202 : cluster [DBG] pgmap v2382: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:51.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:07:51 gibba045 bash[25517]: cephadm 2021-03-10T15:07:50.365668+0000 mgr.gibba045.orlgmj (mgr.34412) 4203 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:07:53.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:07:53 gibba015 bash[29377]: cluster 2021-03-10T15:07:52.345787+0000 mgr.gibba045.orlgmj (mgr.34412) 4204 : cluster [DBG] pgmap v2383: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:53.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:07:53 gibba015 bash[29377]: audit 2021-03-10T15:07:52.993777+0000 mon.c (mon.1) 1196 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:07:53.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:07:53 gibba015 bash[29377]: audit 2021-03-10T15:07:52.994448+0000 mon.c (mon.1) 1197 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:07:53.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:07:53 gibba015 bash[29377]: audit 2021-03-10T15:07:52.994985+0000 mon.a (mon.0) 1208 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:07:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:07:53 gibba015 bash[29377]: audit 2021-03-10T15:07:52.996221+0000 mon.c (mon.1) 1198 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T15:07:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:07:53 gibba015 bash[29377]: audit 2021-03-10T15:07:52.996767+0000 mon.a (mon.0) 1209 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:07:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:07:53 gibba015 bash[29377]: audit 2021-03-10T15:07:52.996955+0000 mon.c (mon.1) 1199 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:07:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:07:53 gibba015 bash[29377]: audit 2021-03-10T15:07:52.997673+0000 mon.c (mon.1) 1200 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:07:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:07:53 gibba015 bash[29377]: audit 2021-03-10T15:07:52.998470+0000 mon.c (mon.1) 1201 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:07:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:07:53 gibba015 bash[29377]: audit 2021-03-10T15:07:52.998611+0000 mon.a (mon.0) 1210 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T15:07:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:07:53 gibba015 bash[29377]: audit 2021-03-10T15:07:53.000442+0000 mon.a (mon.0) 1211 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:07:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:07:53 gibba015 bash[29377]: audit 2021-03-10T15:07:53.000725+0000 mon.a (mon.0) 1212 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:07:53.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:07:53 gibba015 bash[29377]: audit 2021-03-10T15:07:53.001031+0000 mon.a (mon.0) 1213 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:07:53.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:07:53 gibba015 bash[30343]: cluster 2021-03-10T15:07:52.345787+0000 mgr.gibba045.orlgmj (mgr.34412) 4204 : cluster [DBG] pgmap v2383: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:53.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:07:53 gibba015 bash[30343]: audit 2021-03-10T15:07:52.993777+0000 mon.c (mon.1) 1196 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:07:53.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:07:53 gibba015 bash[30343]: audit 2021-03-10T15:07:52.994448+0000 mon.c (mon.1) 1197 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:07:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:07:53 gibba015 bash[30343]: audit 2021-03-10T15:07:52.994985+0000 mon.a (mon.0) 1208 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:07:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:07:53 gibba015 bash[30343]: audit 2021-03-10T15:07:52.996221+0000 mon.c (mon.1) 1198 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T15:07:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:07:53 gibba015 bash[30343]: audit 2021-03-10T15:07:52.996767+0000 mon.a (mon.0) 1209 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:07:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:07:53 gibba015 bash[30343]: audit 2021-03-10T15:07:52.996955+0000 mon.c (mon.1) 1199 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:07:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:07:53 gibba015 bash[30343]: audit 2021-03-10T15:07:52.997673+0000 mon.c (mon.1) 1200 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:07:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:07:53 gibba015 bash[30343]: audit 2021-03-10T15:07:52.998470+0000 mon.c (mon.1) 1201 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:07:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:07:53 gibba015 bash[30343]: audit 2021-03-10T15:07:52.998611+0000 mon.a (mon.0) 1210 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T15:07:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:07:53 gibba015 bash[30343]: audit 2021-03-10T15:07:53.000442+0000 mon.a (mon.0) 1211 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:07:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:07:53 gibba015 bash[30343]: audit 2021-03-10T15:07:53.000725+0000 mon.a (mon.0) 1212 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:07:53.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:07:53 gibba015 bash[30343]: audit 2021-03-10T15:07:53.001031+0000 mon.a (mon.0) 1213 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:07:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:07:53 gibba045 bash[25517]: cluster 2021-03-10T15:07:52.345787+0000 mgr.gibba045.orlgmj (mgr.34412) 4204 : cluster [DBG] pgmap v2383: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:07:53 gibba045 bash[25517]: audit 2021-03-10T15:07:52.993777+0000 mon.c (mon.1) 1196 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:07:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:07:53 gibba045 bash[25517]: audit 2021-03-10T15:07:52.994448+0000 mon.c (mon.1) 1197 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:07:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:07:53 gibba045 bash[25517]: audit 2021-03-10T15:07:52.994985+0000 mon.a (mon.0) 1208 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:07:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:07:53 gibba045 bash[25517]: audit 2021-03-10T15:07:52.996221+0000 mon.c (mon.1) 1198 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T15:07:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:07:53 gibba045 bash[25517]: audit 2021-03-10T15:07:52.996767+0000 mon.a (mon.0) 1209 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:07:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:07:53 gibba045 bash[25517]: audit 2021-03-10T15:07:52.996955+0000 mon.c (mon.1) 1199 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:07:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:07:53 gibba045 bash[25517]: audit 2021-03-10T15:07:52.997673+0000 mon.c (mon.1) 1200 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:07:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:07:53 gibba045 bash[25517]: audit 2021-03-10T15:07:52.998470+0000 mon.c (mon.1) 1201 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:07:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:07:53 gibba045 bash[25517]: audit 2021-03-10T15:07:52.998611+0000 mon.a (mon.0) 1210 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T15:07:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:07:53 gibba045 bash[25517]: audit 2021-03-10T15:07:53.000442+0000 mon.a (mon.0) 1211 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:07:53.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:07:53 gibba045 bash[25517]: audit 2021-03-10T15:07:53.000725+0000 mon.a (mon.0) 1212 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:07:53.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:07:53 gibba045 bash[25517]: audit 2021-03-10T15:07:53.001031+0000 mon.a (mon.0) 1213 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:07:54.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:07:54 gibba015 bash[29377]: cluster 2021-03-10T15:07:54.347314+0000 mgr.gibba045.orlgmj (mgr.34412) 4205 : cluster [DBG] pgmap v2384: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:54.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:07:54 gibba015 bash[30343]: cluster 2021-03-10T15:07:54.347314+0000 mgr.gibba045.orlgmj (mgr.34412) 4205 : cluster [DBG] pgmap v2384: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:55.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:07:54 gibba045 bash[25517]: cluster 2021-03-10T15:07:54.347314+0000 mgr.gibba045.orlgmj (mgr.34412) 4205 : cluster [DBG] pgmap v2384: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:57.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:07:57 gibba015 bash[29377]: cluster 2021-03-10T15:07:56.349349+0000 mgr.gibba045.orlgmj (mgr.34412) 4206 : cluster [DBG] pgmap v2385: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:57.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:07:57 gibba015 bash[30343]: cluster 2021-03-10T15:07:56.349349+0000 mgr.gibba045.orlgmj (mgr.34412) 4206 : cluster [DBG] pgmap v2385: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:57.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:07:57 gibba045 bash[25517]: cluster 2021-03-10T15:07:56.349349+0000 mgr.gibba045.orlgmj (mgr.34412) 4206 : cluster [DBG] pgmap v2385: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:59.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:07:59 gibba015 bash[29377]: cluster 2021-03-10T15:07:58.350850+0000 mgr.gibba045.orlgmj (mgr.34412) 4207 : cluster [DBG] pgmap v2386: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:59.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:07:59 gibba015 bash[30343]: cluster 2021-03-10T15:07:58.350850+0000 mgr.gibba045.orlgmj (mgr.34412) 4207 : cluster [DBG] pgmap v2386: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:59.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:07:59 gibba045 bash[25517]: cluster 2021-03-10T15:07:58.350850+0000 mgr.gibba045.orlgmj (mgr.34412) 4207 : cluster [DBG] pgmap v2386: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:59.994 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:08:00.223 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:08:00.223 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (78m) 3m ago 84m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:08:00.223 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (83m) 2m ago 83m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:08:00.224 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (79m) 2m ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:08:00.224 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (79m) 2m ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:08:00.224 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (78m) 3m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:08:00.224 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (78m) 3m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:08:00.225 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (77m) 2m ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:08:00.225 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (77m) 3m ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:08:00.225 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (84m) 3m ago 84m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:08:00.225 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (84m) 2m ago 84m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:08:00.225 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (77m) 3m ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:08:00.226 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (76m) 3m ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:08:00.226 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (76m) 3m ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:08:00.226 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (75m) 3m ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:08:00.226 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (75m) 2m ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:08:00.227 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (74m) 2m ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:08:00.227 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (74m) 2m ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:08:00.227 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (74m) 2m ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:08:00.227 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (83m) 2m ago 84m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:08:00.228 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 2m ago 82m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:08:00.474 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:08:00.474 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:08:00.474 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:08:00.475 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:08:00.475 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:08:00.475 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:08:00.475 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:08:00.475 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:08:00.476 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:08:00.476 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:08:00.476 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:08:00.476 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:08:00.477 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:08:00.477 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:08:00.477 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:08:01.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:08:01 gibba015 bash[29377]: audit 2021-03-10T15:07:59.985020+0000 mgr.gibba045.orlgmj (mgr.34412) 4208 : audit [DBG] from='client.56866 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:08:01.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:08:01 gibba015 bash[29377]: audit 2021-03-10T15:08:00.211371+0000 mgr.gibba045.orlgmj (mgr.34412) 4209 : audit [DBG] from='client.46884 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:08:01.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:08:01 gibba015 bash[29377]: cluster 2021-03-10T15:08:00.352649+0000 mgr.gibba045.orlgmj (mgr.34412) 4210 : cluster [DBG] pgmap v2387: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:01.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:08:01 gibba015 bash[29377]: audit 2021-03-10T15:08:00.470107+0000 mon.a (mon.0) 1214 : audit [DBG] from='client.? 172.21.2.115:0/209524227' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:08:01.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:08:01 gibba015 bash[30343]: audit 2021-03-10T15:07:59.985020+0000 mgr.gibba045.orlgmj (mgr.34412) 4208 : audit [DBG] from='client.56866 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:08:01.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:08:01 gibba015 bash[30343]: audit 2021-03-10T15:08:00.211371+0000 mgr.gibba045.orlgmj (mgr.34412) 4209 : audit [DBG] from='client.46884 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:08:01.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:08:01 gibba015 bash[30343]: cluster 2021-03-10T15:08:00.352649+0000 mgr.gibba045.orlgmj (mgr.34412) 4210 : cluster [DBG] pgmap v2387: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:01.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:08:01 gibba015 bash[30343]: audit 2021-03-10T15:08:00.470107+0000 mon.a (mon.0) 1214 : audit [DBG] from='client.? 172.21.2.115:0/209524227' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:08:01.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:08:01 gibba045 bash[25517]: audit 2021-03-10T15:07:59.985020+0000 mgr.gibba045.orlgmj (mgr.34412) 4208 : audit [DBG] from='client.56866 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:08:01.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:08:01 gibba045 bash[25517]: audit 2021-03-10T15:08:00.211371+0000 mgr.gibba045.orlgmj (mgr.34412) 4209 : audit [DBG] from='client.46884 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:08:01.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:08:01 gibba045 bash[25517]: cluster 2021-03-10T15:08:00.352649+0000 mgr.gibba045.orlgmj (mgr.34412) 4210 : cluster [DBG] pgmap v2387: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:01.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:08:01 gibba045 bash[25517]: audit 2021-03-10T15:08:00.470107+0000 mon.a (mon.0) 1214 : audit [DBG] from='client.? 172.21.2.115:0/209524227' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:08:03.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:08:03 gibba015 bash[29377]: cluster 2021-03-10T15:08:02.354086+0000 mgr.gibba045.orlgmj (mgr.34412) 4211 : cluster [DBG] pgmap v2388: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:03.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:08:03 gibba015 bash[30343]: cluster 2021-03-10T15:08:02.354086+0000 mgr.gibba045.orlgmj (mgr.34412) 4211 : cluster [DBG] pgmap v2388: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:03.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:08:03 gibba045 bash[25517]: cluster 2021-03-10T15:08:02.354086+0000 mgr.gibba045.orlgmj (mgr.34412) 4211 : cluster [DBG] pgmap v2388: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:05.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:08:04 gibba045 bash[25517]: cluster 2021-03-10T15:08:04.355551+0000 mgr.gibba045.orlgmj (mgr.34412) 4212 : cluster [DBG] pgmap v2389: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:05.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:08:04 gibba015 bash[29377]: cluster 2021-03-10T15:08:04.355551+0000 mgr.gibba045.orlgmj (mgr.34412) 4212 : cluster [DBG] pgmap v2389: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:05.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:08:04 gibba015 bash[30343]: cluster 2021-03-10T15:08:04.355551+0000 mgr.gibba045.orlgmj (mgr.34412) 4212 : cluster [DBG] pgmap v2389: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:06.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:08:05 gibba045 bash[25517]: cephadm 2021-03-10T15:08:05.381385+0000 mgr.gibba045.orlgmj (mgr.34412) 4213 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:08:06.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:08:05 gibba015 bash[29377]: cephadm 2021-03-10T15:08:05.381385+0000 mgr.gibba045.orlgmj (mgr.34412) 4213 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:08:06.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:08:05 gibba015 bash[30343]: cephadm 2021-03-10T15:08:05.381385+0000 mgr.gibba045.orlgmj (mgr.34412) 4213 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:08:07.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:08:06 gibba045 bash[25517]: cluster 2021-03-10T15:08:06.357582+0000 mgr.gibba045.orlgmj (mgr.34412) 4214 : cluster [DBG] pgmap v2390: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:07.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:08:06 gibba015 bash[29377]: cluster 2021-03-10T15:08:06.357582+0000 mgr.gibba045.orlgmj (mgr.34412) 4214 : cluster [DBG] pgmap v2390: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:07.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:08:06 gibba015 bash[30343]: cluster 2021-03-10T15:08:06.357582+0000 mgr.gibba045.orlgmj (mgr.34412) 4214 : cluster [DBG] pgmap v2390: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:09.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:08:09 gibba015 bash[29377]: cluster 2021-03-10T15:08:08.359042+0000 mgr.gibba045.orlgmj (mgr.34412) 4215 : cluster [DBG] pgmap v2391: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:09.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:08:09 gibba015 bash[30343]: cluster 2021-03-10T15:08:08.359042+0000 mgr.gibba045.orlgmj (mgr.34412) 4215 : cluster [DBG] pgmap v2391: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:09.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:08:09 gibba045 bash[25517]: cluster 2021-03-10T15:08:08.359042+0000 mgr.gibba045.orlgmj (mgr.34412) 4215 : cluster [DBG] pgmap v2391: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:11.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:08:11 gibba015 bash[29377]: cluster 2021-03-10T15:08:10.360721+0000 mgr.gibba045.orlgmj (mgr.34412) 4216 : cluster [DBG] pgmap v2392: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:11.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:08:11 gibba015 bash[30343]: cluster 2021-03-10T15:08:10.360721+0000 mgr.gibba045.orlgmj (mgr.34412) 4216 : cluster [DBG] pgmap v2392: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:11.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:08:11 gibba045 bash[25517]: cluster 2021-03-10T15:08:10.360721+0000 mgr.gibba045.orlgmj (mgr.34412) 4216 : cluster [DBG] pgmap v2392: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:13.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:08:13 gibba015 bash[29377]: cluster 2021-03-10T15:08:12.362542+0000 mgr.gibba045.orlgmj (mgr.34412) 4217 : cluster [DBG] pgmap v2393: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:13.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:08:13 gibba015 bash[30343]: cluster 2021-03-10T15:08:12.362542+0000 mgr.gibba045.orlgmj (mgr.34412) 4217 : cluster [DBG] pgmap v2393: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:13.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:08:13 gibba045 bash[25517]: cluster 2021-03-10T15:08:12.362542+0000 mgr.gibba045.orlgmj (mgr.34412) 4217 : cluster [DBG] pgmap v2393: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:15.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:08:14 gibba045 bash[25517]: cluster 2021-03-10T15:08:14.363890+0000 mgr.gibba045.orlgmj (mgr.34412) 4218 : cluster [DBG] pgmap v2394: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:15.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:08:14 gibba015 bash[29377]: cluster 2021-03-10T15:08:14.363890+0000 mgr.gibba045.orlgmj (mgr.34412) 4218 : cluster [DBG] pgmap v2394: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:15.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:08:14 gibba015 bash[30343]: cluster 2021-03-10T15:08:14.363890+0000 mgr.gibba045.orlgmj (mgr.34412) 4218 : cluster [DBG] pgmap v2394: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:17.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:08:17 gibba015 bash[29377]: cluster 2021-03-10T15:08:16.365902+0000 mgr.gibba045.orlgmj (mgr.34412) 4219 : cluster [DBG] pgmap v2395: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:17.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:08:17 gibba015 bash[30343]: cluster 2021-03-10T15:08:16.365902+0000 mgr.gibba045.orlgmj (mgr.34412) 4219 : cluster [DBG] pgmap v2395: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:17.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:08:17 gibba045 bash[25517]: cluster 2021-03-10T15:08:16.365902+0000 mgr.gibba045.orlgmj (mgr.34412) 4219 : cluster [DBG] pgmap v2395: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:19.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:08:19 gibba015 bash[29377]: cluster 2021-03-10T15:08:18.367107+0000 mgr.gibba045.orlgmj (mgr.34412) 4220 : cluster [DBG] pgmap v2396: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:19.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:08:19 gibba015 bash[30343]: cluster 2021-03-10T15:08:18.367107+0000 mgr.gibba045.orlgmj (mgr.34412) 4220 : cluster [DBG] pgmap v2396: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:19.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:08:19 gibba045 bash[25517]: cluster 2021-03-10T15:08:18.367107+0000 mgr.gibba045.orlgmj (mgr.34412) 4220 : cluster [DBG] pgmap v2396: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:21.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:08:21 gibba015 bash[29377]: cluster 2021-03-10T15:08:20.368779+0000 mgr.gibba045.orlgmj (mgr.34412) 4221 : cluster [DBG] pgmap v2397: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:21.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:08:21 gibba015 bash[29377]: cephadm 2021-03-10T15:08:20.397386+0000 mgr.gibba045.orlgmj (mgr.34412) 4222 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:08:21.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:08:21 gibba015 bash[30343]: cluster 2021-03-10T15:08:20.368779+0000 mgr.gibba045.orlgmj (mgr.34412) 4221 : cluster [DBG] pgmap v2397: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:21.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:08:21 gibba015 bash[30343]: cephadm 2021-03-10T15:08:20.397386+0000 mgr.gibba045.orlgmj (mgr.34412) 4222 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:08:21.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:08:21 gibba045 bash[25517]: cluster 2021-03-10T15:08:20.368779+0000 mgr.gibba045.orlgmj (mgr.34412) 4221 : cluster [DBG] pgmap v2397: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:21.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:08:21 gibba045 bash[25517]: cephadm 2021-03-10T15:08:20.397386+0000 mgr.gibba045.orlgmj (mgr.34412) 4222 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:08:23.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:08:23 gibba015 bash[29377]: cluster 2021-03-10T15:08:22.370447+0000 mgr.gibba045.orlgmj (mgr.34412) 4223 : cluster [DBG] pgmap v2398: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:23.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:08:23 gibba015 bash[30343]: cluster 2021-03-10T15:08:22.370447+0000 mgr.gibba045.orlgmj (mgr.34412) 4223 : cluster [DBG] pgmap v2398: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:23.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:08:23 gibba045 bash[25517]: cluster 2021-03-10T15:08:22.370447+0000 mgr.gibba045.orlgmj (mgr.34412) 4223 : cluster [DBG] pgmap v2398: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:25.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:08:24 gibba045 bash[25517]: cluster 2021-03-10T15:08:24.371732+0000 mgr.gibba045.orlgmj (mgr.34412) 4224 : cluster [DBG] pgmap v2399: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:25.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:08:24 gibba015 bash[29377]: cluster 2021-03-10T15:08:24.371732+0000 mgr.gibba045.orlgmj (mgr.34412) 4224 : cluster [DBG] pgmap v2399: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:25.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:08:24 gibba015 bash[30343]: cluster 2021-03-10T15:08:24.371732+0000 mgr.gibba045.orlgmj (mgr.34412) 4224 : cluster [DBG] pgmap v2399: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:27.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:08:27 gibba015 bash[29377]: cluster 2021-03-10T15:08:26.373691+0000 mgr.gibba045.orlgmj (mgr.34412) 4225 : cluster [DBG] pgmap v2400: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:27.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:08:27 gibba015 bash[30343]: cluster 2021-03-10T15:08:26.373691+0000 mgr.gibba045.orlgmj (mgr.34412) 4225 : cluster [DBG] pgmap v2400: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:27.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:08:27 gibba045 bash[25517]: cluster 2021-03-10T15:08:26.373691+0000 mgr.gibba045.orlgmj (mgr.34412) 4225 : cluster [DBG] pgmap v2400: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:29.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:08:29 gibba015 bash[29377]: cluster 2021-03-10T15:08:28.374754+0000 mgr.gibba045.orlgmj (mgr.34412) 4226 : cluster [DBG] pgmap v2401: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:29.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:08:29 gibba015 bash[30343]: cluster 2021-03-10T15:08:28.374754+0000 mgr.gibba045.orlgmj (mgr.34412) 4226 : cluster [DBG] pgmap v2401: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:29.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:08:29 gibba045 bash[25517]: cluster 2021-03-10T15:08:28.374754+0000 mgr.gibba045.orlgmj (mgr.34412) 4226 : cluster [DBG] pgmap v2401: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:30.715 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:08:30.971 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:08:30.971 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (79m) 4m ago 84m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:08:30.971 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (84m) 2m ago 84m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:08:30.972 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (79m) 2m ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:08:30.972 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (79m) 2m ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:08:30.972 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (78m) 4m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:08:30.972 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (78m) 4m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:08:30.973 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (78m) 2m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:08:30.973 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (78m) 4m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:08:30.973 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (84m) 4m ago 84m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:08:30.973 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (84m) 2m ago 84m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:08:30.974 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (77m) 4m ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:08:30.974 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (77m) 4m ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:08:30.974 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (76m) 4m ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:08:30.974 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (76m) 4m ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:08:30.975 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (75m) 2m ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:08:30.975 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (75m) 2m ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:08:30.975 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (74m) 2m ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:08:30.975 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (74m) 2m ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:08:30.975 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (84m) 2m ago 84m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:08:30.976 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 2m ago 82m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:08:31.226 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:08:31.227 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:08:31.227 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:08:31.227 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:08:31.228 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:08:31.228 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:08:31.228 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:08:31.228 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:08:31.228 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:08:31.229 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:08:31.229 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:08:31.229 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:08:31.229 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:08:31.230 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:08:31.230 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:08:31.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:08:31 gibba015 bash[29377]: cluster 2021-03-10T15:08:30.376303+0000 mgr.gibba045.orlgmj (mgr.34412) 4227 : cluster [DBG] pgmap v2402: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:31.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:08:31 gibba015 bash[29377]: audit 2021-03-10T15:08:31.222737+0000 mon.c (mon.1) 1202 : audit [DBG] from='client.? 172.21.2.115:0/341212321' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:08:31.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:08:31 gibba015 bash[30343]: cluster 2021-03-10T15:08:30.376303+0000 mgr.gibba045.orlgmj (mgr.34412) 4227 : cluster [DBG] pgmap v2402: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:31.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:08:31 gibba015 bash[30343]: audit 2021-03-10T15:08:31.222737+0000 mon.c (mon.1) 1202 : audit [DBG] from='client.? 172.21.2.115:0/341212321' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:08:31.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:08:31 gibba045 bash[25517]: cluster 2021-03-10T15:08:30.376303+0000 mgr.gibba045.orlgmj (mgr.34412) 4227 : cluster [DBG] pgmap v2402: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:31.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:08:31 gibba045 bash[25517]: audit 2021-03-10T15:08:31.222737+0000 mon.c (mon.1) 1202 : audit [DBG] from='client.? 172.21.2.115:0/341212321' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:08:32.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:08:32 gibba015 bash[29377]: audit 2021-03-10T15:08:30.706025+0000 mgr.gibba045.orlgmj (mgr.34412) 4228 : audit [DBG] from='client.56884 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:08:32.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:08:32 gibba015 bash[29377]: audit 2021-03-10T15:08:30.930167+0000 mgr.gibba045.orlgmj (mgr.34412) 4229 : audit [DBG] from='client.56890 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:08:32.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:08:32 gibba015 bash[30343]: audit 2021-03-10T15:08:30.706025+0000 mgr.gibba045.orlgmj (mgr.34412) 4228 : audit [DBG] from='client.56884 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:08:32.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:08:32 gibba015 bash[30343]: audit 2021-03-10T15:08:30.930167+0000 mgr.gibba045.orlgmj (mgr.34412) 4229 : audit [DBG] from='client.56890 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:08:32.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:08:32 gibba045 bash[25517]: audit 2021-03-10T15:08:30.706025+0000 mgr.gibba045.orlgmj (mgr.34412) 4228 : audit [DBG] from='client.56884 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:08:32.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:08:32 gibba045 bash[25517]: audit 2021-03-10T15:08:30.930167+0000 mgr.gibba045.orlgmj (mgr.34412) 4229 : audit [DBG] from='client.56890 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:08:33.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:08:33 gibba015 bash[29377]: cluster 2021-03-10T15:08:32.378021+0000 mgr.gibba045.orlgmj (mgr.34412) 4230 : cluster [DBG] pgmap v2403: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:33.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:08:33 gibba015 bash[30343]: cluster 2021-03-10T15:08:32.378021+0000 mgr.gibba045.orlgmj (mgr.34412) 4230 : cluster [DBG] pgmap v2403: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:33.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:08:33 gibba045 bash[25517]: cluster 2021-03-10T15:08:32.378021+0000 mgr.gibba045.orlgmj (mgr.34412) 4230 : cluster [DBG] pgmap v2403: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:35.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:08:34 gibba045 bash[25517]: cluster 2021-03-10T15:08:34.379202+0000 mgr.gibba045.orlgmj (mgr.34412) 4231 : cluster [DBG] pgmap v2404: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:35.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:08:34 gibba015 bash[29377]: cluster 2021-03-10T15:08:34.379202+0000 mgr.gibba045.orlgmj (mgr.34412) 4231 : cluster [DBG] pgmap v2404: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:35.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:08:34 gibba015 bash[30343]: cluster 2021-03-10T15:08:34.379202+0000 mgr.gibba045.orlgmj (mgr.34412) 4231 : cluster [DBG] pgmap v2404: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:36.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:08:35 gibba045 bash[25517]: audit 2021-03-10T15:08:35.410688+0000 mon.c (mon.1) 1203 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:08:36.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:08:35 gibba045 bash[25517]: cephadm 2021-03-10T15:08:35.420046+0000 mgr.gibba045.orlgmj (mgr.34412) 4232 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:08:36.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:08:35 gibba045 bash[25517]: cephadm 2021-03-10T15:08:35.421571+0000 mgr.gibba045.orlgmj (mgr.34412) 4233 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:08:36.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:08:35 gibba045 bash[25517]: audit 2021-03-10T15:08:35.618190+0000 mon.a (mon.0) 1215 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:08:36.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:08:35 gibba045 bash[25517]: audit 2021-03-10T15:08:35.621679+0000 mon.c (mon.1) 1204 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:08:36.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:08:35 gibba045 bash[25517]: audit 2021-03-10T15:08:35.623293+0000 mon.c (mon.1) 1205 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:08:36.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:08:35 gibba045 bash[25517]: audit 2021-03-10T15:08:35.624478+0000 mon.c (mon.1) 1206 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:08:36.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:08:35 gibba045 bash[25517]: audit 2021-03-10T15:08:35.625587+0000 mon.c (mon.1) 1207 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:08:36.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:08:35 gibba045 bash[25517]: audit 2021-03-10T15:08:35.628298+0000 mon.c (mon.1) 1208 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:08:36.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:08:35 gibba045 bash[25517]: audit 2021-03-10T15:08:35.629616+0000 mon.c (mon.1) 1209 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:08:36.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:08:35 gibba015 bash[29377]: audit 2021-03-10T15:08:35.410688+0000 mon.c (mon.1) 1203 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:08:36.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:08:35 gibba015 bash[29377]: cephadm 2021-03-10T15:08:35.420046+0000 mgr.gibba045.orlgmj (mgr.34412) 4232 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:08:36.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:08:35 gibba015 bash[29377]: cephadm 2021-03-10T15:08:35.421571+0000 mgr.gibba045.orlgmj (mgr.34412) 4233 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:08:36.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:08:35 gibba015 bash[29377]: audit 2021-03-10T15:08:35.618190+0000 mon.a (mon.0) 1215 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:08:36.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:08:35 gibba015 bash[29377]: audit 2021-03-10T15:08:35.621679+0000 mon.c (mon.1) 1204 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:08:36.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:08:35 gibba015 bash[29377]: audit 2021-03-10T15:08:35.623293+0000 mon.c (mon.1) 1205 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:08:36.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:08:35 gibba015 bash[29377]: audit 2021-03-10T15:08:35.624478+0000 mon.c (mon.1) 1206 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:08:36.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:08:35 gibba015 bash[29377]: audit 2021-03-10T15:08:35.625587+0000 mon.c (mon.1) 1207 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:08:36.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:08:35 gibba015 bash[29377]: audit 2021-03-10T15:08:35.628298+0000 mon.c (mon.1) 1208 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:08:36.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:08:35 gibba015 bash[29377]: audit 2021-03-10T15:08:35.629616+0000 mon.c (mon.1) 1209 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:08:36.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:08:35 gibba015 bash[30343]: audit 2021-03-10T15:08:35.410688+0000 mon.c (mon.1) 1203 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:08:36.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:08:35 gibba015 bash[30343]: cephadm 2021-03-10T15:08:35.420046+0000 mgr.gibba045.orlgmj (mgr.34412) 4232 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:08:36.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:08:35 gibba015 bash[30343]: cephadm 2021-03-10T15:08:35.421571+0000 mgr.gibba045.orlgmj (mgr.34412) 4233 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:08:36.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:08:35 gibba015 bash[30343]: audit 2021-03-10T15:08:35.618190+0000 mon.a (mon.0) 1215 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:08:36.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:08:35 gibba015 bash[30343]: audit 2021-03-10T15:08:35.621679+0000 mon.c (mon.1) 1204 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:08:36.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:08:35 gibba015 bash[30343]: audit 2021-03-10T15:08:35.623293+0000 mon.c (mon.1) 1205 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:08:36.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:08:35 gibba015 bash[30343]: audit 2021-03-10T15:08:35.624478+0000 mon.c (mon.1) 1206 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:08:36.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:08:35 gibba015 bash[30343]: audit 2021-03-10T15:08:35.625587+0000 mon.c (mon.1) 1207 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:08:36.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:08:35 gibba015 bash[30343]: audit 2021-03-10T15:08:35.628298+0000 mon.c (mon.1) 1208 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:08:36.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:08:35 gibba015 bash[30343]: audit 2021-03-10T15:08:35.629616+0000 mon.c (mon.1) 1209 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:08:37.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:08:36 gibba045 bash[25517]: cephadm 2021-03-10T15:08:35.624581+0000 mgr.gibba045.orlgmj (mgr.34412) 4234 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:08:37.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:08:36 gibba045 bash[25517]: cephadm 2021-03-10T15:08:35.626403+0000 mgr.gibba045.orlgmj (mgr.34412) 4235 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:08:37.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:08:36 gibba045 bash[25517]: cephadm 2021-03-10T15:08:35.627499+0000 mgr.gibba045.orlgmj (mgr.34412) 4236 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:08:37.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:08:36 gibba045 bash[25517]: cephadm 2021-03-10T15:08:35.627537+0000 mgr.gibba045.orlgmj (mgr.34412) 4237 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:08:37.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:08:36 gibba045 bash[25517]: cephadm 2021-03-10T15:08:35.628699+0000 mgr.gibba045.orlgmj (mgr.34412) 4238 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:08:37.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:08:36 gibba045 bash[25517]: cephadm 2021-03-10T15:08:35.628741+0000 mgr.gibba045.orlgmj (mgr.34412) 4239 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:08:37.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:08:36 gibba045 bash[25517]: cephadm 2021-03-10T15:08:35.629754+0000 mgr.gibba045.orlgmj (mgr.34412) 4240 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:08:37.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:08:36 gibba045 bash[25517]: cephadm 2021-03-10T15:08:35.631229+0000 mgr.gibba045.orlgmj (mgr.34412) 4241 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:08:37.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:08:36 gibba045 bash[25517]: cephadm 2021-03-10T15:08:35.631267+0000 mgr.gibba045.orlgmj (mgr.34412) 4242 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:08:37.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:08:36 gibba045 bash[25517]: cephadm 2021-03-10T15:08:35.632546+0000 mgr.gibba045.orlgmj (mgr.34412) 4243 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:08:37.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:08:36 gibba045 bash[25517]: cephadm 2021-03-10T15:08:35.632866+0000 mgr.gibba045.orlgmj (mgr.34412) 4244 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:08:37.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:08:36 gibba045 bash[25517]: cephadm 2021-03-10T15:08:35.634302+0000 mgr.gibba045.orlgmj (mgr.34412) 4245 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:08:37.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:08:36 gibba045 bash[25517]: cephadm 2021-03-10T15:08:35.634345+0000 mgr.gibba045.orlgmj (mgr.34412) 4246 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:08:37.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:08:36 gibba045 bash[25517]: cephadm 2021-03-10T15:08:35.634449+0000 mgr.gibba045.orlgmj (mgr.34412) 4247 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:08:37.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:08:36 gibba045 bash[25517]: cluster 2021-03-10T15:08:36.381226+0000 mgr.gibba045.orlgmj (mgr.34412) 4248 : cluster [DBG] pgmap v2405: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:37.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:08:36 gibba015 bash[29377]: cephadm 2021-03-10T15:08:35.624581+0000 mgr.gibba045.orlgmj (mgr.34412) 4234 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:08:37.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:08:36 gibba015 bash[29377]: cephadm 2021-03-10T15:08:35.626403+0000 mgr.gibba045.orlgmj (mgr.34412) 4235 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:08:37.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:08:36 gibba015 bash[29377]: cephadm 2021-03-10T15:08:35.627499+0000 mgr.gibba045.orlgmj (mgr.34412) 4236 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:08:37.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:08:36 gibba015 bash[29377]: cephadm 2021-03-10T15:08:35.627537+0000 mgr.gibba045.orlgmj (mgr.34412) 4237 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:08:37.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:08:36 gibba015 bash[29377]: cephadm 2021-03-10T15:08:35.628699+0000 mgr.gibba045.orlgmj (mgr.34412) 4238 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:08:37.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:08:36 gibba015 bash[29377]: cephadm 2021-03-10T15:08:35.628741+0000 mgr.gibba045.orlgmj (mgr.34412) 4239 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:08:37.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:08:36 gibba015 bash[29377]: cephadm 2021-03-10T15:08:35.629754+0000 mgr.gibba045.orlgmj (mgr.34412) 4240 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:08:37.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:08:36 gibba015 bash[29377]: cephadm 2021-03-10T15:08:35.631229+0000 mgr.gibba045.orlgmj (mgr.34412) 4241 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:08:37.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:08:36 gibba015 bash[29377]: cephadm 2021-03-10T15:08:35.631267+0000 mgr.gibba045.orlgmj (mgr.34412) 4242 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:08:37.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:08:36 gibba015 bash[29377]: cephadm 2021-03-10T15:08:35.632546+0000 mgr.gibba045.orlgmj (mgr.34412) 4243 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:08:37.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:08:36 gibba015 bash[29377]: cephadm 2021-03-10T15:08:35.632866+0000 mgr.gibba045.orlgmj (mgr.34412) 4244 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:08:37.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:08:36 gibba015 bash[29377]: cephadm 2021-03-10T15:08:35.634302+0000 mgr.gibba045.orlgmj (mgr.34412) 4245 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:08:37.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:08:36 gibba015 bash[29377]: cephadm 2021-03-10T15:08:35.634345+0000 mgr.gibba045.orlgmj (mgr.34412) 4246 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:08:37.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:08:36 gibba015 bash[29377]: cephadm 2021-03-10T15:08:35.634449+0000 mgr.gibba045.orlgmj (mgr.34412) 4247 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:08:37.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:08:36 gibba015 bash[29377]: cluster 2021-03-10T15:08:36.381226+0000 mgr.gibba045.orlgmj (mgr.34412) 4248 : cluster [DBG] pgmap v2405: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:37.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:08:36 gibba015 bash[30343]: cephadm 2021-03-10T15:08:35.624581+0000 mgr.gibba045.orlgmj (mgr.34412) 4234 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:08:37.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:08:36 gibba015 bash[30343]: cephadm 2021-03-10T15:08:35.626403+0000 mgr.gibba045.orlgmj (mgr.34412) 4235 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:08:37.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:08:36 gibba015 bash[30343]: cephadm 2021-03-10T15:08:35.627499+0000 mgr.gibba045.orlgmj (mgr.34412) 4236 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:08:37.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:08:36 gibba015 bash[30343]: cephadm 2021-03-10T15:08:35.627537+0000 mgr.gibba045.orlgmj (mgr.34412) 4237 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:08:37.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:08:36 gibba015 bash[30343]: cephadm 2021-03-10T15:08:35.628699+0000 mgr.gibba045.orlgmj (mgr.34412) 4238 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:08:37.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:08:36 gibba015 bash[30343]: cephadm 2021-03-10T15:08:35.628741+0000 mgr.gibba045.orlgmj (mgr.34412) 4239 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:08:37.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:08:36 gibba015 bash[30343]: cephadm 2021-03-10T15:08:35.629754+0000 mgr.gibba045.orlgmj (mgr.34412) 4240 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:08:37.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:08:36 gibba015 bash[30343]: cephadm 2021-03-10T15:08:35.631229+0000 mgr.gibba045.orlgmj (mgr.34412) 4241 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:08:37.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:08:36 gibba015 bash[30343]: cephadm 2021-03-10T15:08:35.631267+0000 mgr.gibba045.orlgmj (mgr.34412) 4242 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:08:37.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:08:36 gibba015 bash[30343]: cephadm 2021-03-10T15:08:35.632546+0000 mgr.gibba045.orlgmj (mgr.34412) 4243 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:08:37.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:08:36 gibba015 bash[30343]: cephadm 2021-03-10T15:08:35.632866+0000 mgr.gibba045.orlgmj (mgr.34412) 4244 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:08:37.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:08:36 gibba015 bash[30343]: cephadm 2021-03-10T15:08:35.634302+0000 mgr.gibba045.orlgmj (mgr.34412) 4245 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:08:37.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:08:36 gibba015 bash[30343]: cephadm 2021-03-10T15:08:35.634345+0000 mgr.gibba045.orlgmj (mgr.34412) 4246 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:08:37.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:08:36 gibba015 bash[30343]: cephadm 2021-03-10T15:08:35.634449+0000 mgr.gibba045.orlgmj (mgr.34412) 4247 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:08:37.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:08:36 gibba015 bash[30343]: cluster 2021-03-10T15:08:36.381226+0000 mgr.gibba045.orlgmj (mgr.34412) 4248 : cluster [DBG] pgmap v2405: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:39.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:08:39 gibba015 bash[29377]: cluster 2021-03-10T15:08:38.382505+0000 mgr.gibba045.orlgmj (mgr.34412) 4249 : cluster [DBG] pgmap v2406: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:39.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:08:39 gibba015 bash[30343]: cluster 2021-03-10T15:08:38.382505+0000 mgr.gibba045.orlgmj (mgr.34412) 4249 : cluster [DBG] pgmap v2406: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:39.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:08:39 gibba045 bash[25517]: cluster 2021-03-10T15:08:38.382505+0000 mgr.gibba045.orlgmj (mgr.34412) 4249 : cluster [DBG] pgmap v2406: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:41.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:08:41 gibba015 bash[29377]: cluster 2021-03-10T15:08:40.384252+0000 mgr.gibba045.orlgmj (mgr.34412) 4250 : cluster [DBG] pgmap v2407: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:41.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:08:41 gibba015 bash[30343]: cluster 2021-03-10T15:08:40.384252+0000 mgr.gibba045.orlgmj (mgr.34412) 4250 : cluster [DBG] pgmap v2407: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:41.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:08:41 gibba045 bash[25517]: cluster 2021-03-10T15:08:40.384252+0000 mgr.gibba045.orlgmj (mgr.34412) 4250 : cluster [DBG] pgmap v2407: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:43.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:08:43 gibba015 bash[29377]: cluster 2021-03-10T15:08:42.386000+0000 mgr.gibba045.orlgmj (mgr.34412) 4251 : cluster [DBG] pgmap v2408: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:43.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:08:43 gibba015 bash[30343]: cluster 2021-03-10T15:08:42.386000+0000 mgr.gibba045.orlgmj (mgr.34412) 4251 : cluster [DBG] pgmap v2408: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:43.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:08:43 gibba045 bash[25517]: cluster 2021-03-10T15:08:42.386000+0000 mgr.gibba045.orlgmj (mgr.34412) 4251 : cluster [DBG] pgmap v2408: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:45.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:08:44 gibba045 bash[25517]: cluster 2021-03-10T15:08:44.387272+0000 mgr.gibba045.orlgmj (mgr.34412) 4252 : cluster [DBG] pgmap v2409: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:45.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:08:44 gibba015 bash[29377]: cluster 2021-03-10T15:08:44.387272+0000 mgr.gibba045.orlgmj (mgr.34412) 4252 : cluster [DBG] pgmap v2409: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:45.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:08:44 gibba015 bash[30343]: cluster 2021-03-10T15:08:44.387272+0000 mgr.gibba045.orlgmj (mgr.34412) 4252 : cluster [DBG] pgmap v2409: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:47.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:08:47 gibba015 bash[29377]: cluster 2021-03-10T15:08:46.389111+0000 mgr.gibba045.orlgmj (mgr.34412) 4253 : cluster [DBG] pgmap v2410: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:47.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:08:47 gibba015 bash[30343]: cluster 2021-03-10T15:08:46.389111+0000 mgr.gibba045.orlgmj (mgr.34412) 4253 : cluster [DBG] pgmap v2410: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:47.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:08:47 gibba045 bash[25517]: cluster 2021-03-10T15:08:46.389111+0000 mgr.gibba045.orlgmj (mgr.34412) 4253 : cluster [DBG] pgmap v2410: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:49.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:08:49 gibba015 bash[29377]: cluster 2021-03-10T15:08:48.390168+0000 mgr.gibba045.orlgmj (mgr.34412) 4254 : cluster [DBG] pgmap v2411: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:49.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:08:49 gibba015 bash[30343]: cluster 2021-03-10T15:08:48.390168+0000 mgr.gibba045.orlgmj (mgr.34412) 4254 : cluster [DBG] pgmap v2411: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:49.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:08:49 gibba045 bash[25517]: cluster 2021-03-10T15:08:48.390168+0000 mgr.gibba045.orlgmj (mgr.34412) 4254 : cluster [DBG] pgmap v2411: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:51.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:08:51 gibba015 bash[29377]: cluster 2021-03-10T15:08:50.391990+0000 mgr.gibba045.orlgmj (mgr.34412) 4255 : cluster [DBG] pgmap v2412: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:51.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:08:51 gibba015 bash[30343]: cluster 2021-03-10T15:08:50.391990+0000 mgr.gibba045.orlgmj (mgr.34412) 4255 : cluster [DBG] pgmap v2412: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:51.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:08:51 gibba045 bash[25517]: cluster 2021-03-10T15:08:50.391990+0000 mgr.gibba045.orlgmj (mgr.34412) 4255 : cluster [DBG] pgmap v2412: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:52.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:08:52 gibba045 bash[25517]: cephadm 2021-03-10T15:08:50.650430+0000 mgr.gibba045.orlgmj (mgr.34412) 4256 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:08:52.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:08:52 gibba015 bash[29377]: cephadm 2021-03-10T15:08:50.650430+0000 mgr.gibba045.orlgmj (mgr.34412) 4256 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:08:52.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:08:52 gibba015 bash[30343]: cephadm 2021-03-10T15:08:50.650430+0000 mgr.gibba045.orlgmj (mgr.34412) 4256 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:08:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:08:53 gibba045 bash[25517]: cluster 2021-03-10T15:08:52.393980+0000 mgr.gibba045.orlgmj (mgr.34412) 4257 : cluster [DBG] pgmap v2413: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:08:53 gibba045 bash[25517]: audit 2021-03-10T15:08:53.004113+0000 mon.c (mon.1) 1210 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:08:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:08:53 gibba045 bash[25517]: audit 2021-03-10T15:08:53.005185+0000 mon.c (mon.1) 1211 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:08:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:08:53 gibba045 bash[25517]: audit 2021-03-10T15:08:53.005452+0000 mon.a (mon.0) 1216 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:08:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:08:53 gibba045 bash[25517]: audit 2021-03-10T15:08:53.006155+0000 mon.c (mon.1) 1212 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T15:08:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:08:53 gibba045 bash[25517]: audit 2021-03-10T15:08:53.006326+0000 mon.a (mon.0) 1217 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:08:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:08:53 gibba045 bash[25517]: audit 2021-03-10T15:08:53.007280+0000 mon.a (mon.0) 1218 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T15:08:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:08:53 gibba045 bash[25517]: audit 2021-03-10T15:08:53.007685+0000 mon.c (mon.1) 1213 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T15:08:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:08:53 gibba045 bash[25517]: audit 2021-03-10T15:08:53.008889+0000 mon.a (mon.0) 1219 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T15:08:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:08:53 gibba045 bash[25517]: audit 2021-03-10T15:08:53.008944+0000 mon.c (mon.1) 1214 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:08:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:08:53 gibba045 bash[25517]: audit 2021-03-10T15:08:53.009732+0000 mon.c (mon.1) 1215 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:08:53.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:08:53 gibba045 bash[25517]: audit 2021-03-10T15:08:53.009843+0000 mon.a (mon.0) 1220 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:08:53.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:08:53 gibba045 bash[25517]: audit 2021-03-10T15:08:53.010135+0000 mon.a (mon.0) 1221 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:08:53.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:08:53 gibba015 bash[29377]: cluster 2021-03-10T15:08:52.393980+0000 mgr.gibba045.orlgmj (mgr.34412) 4257 : cluster [DBG] pgmap v2413: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:08:53 gibba015 bash[29377]: audit 2021-03-10T15:08:53.004113+0000 mon.c (mon.1) 1210 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:08:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:08:53 gibba015 bash[29377]: audit 2021-03-10T15:08:53.005185+0000 mon.c (mon.1) 1211 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:08:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:08:53 gibba015 bash[29377]: audit 2021-03-10T15:08:53.005452+0000 mon.a (mon.0) 1216 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:08:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:08:53 gibba015 bash[29377]: audit 2021-03-10T15:08:53.006155+0000 mon.c (mon.1) 1212 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T15:08:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:08:53 gibba015 bash[29377]: audit 2021-03-10T15:08:53.006326+0000 mon.a (mon.0) 1217 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:08:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:08:53 gibba015 bash[29377]: audit 2021-03-10T15:08:53.007280+0000 mon.a (mon.0) 1218 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T15:08:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:08:53 gibba015 bash[29377]: audit 2021-03-10T15:08:53.007685+0000 mon.c (mon.1) 1213 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T15:08:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:08:53 gibba015 bash[29377]: audit 2021-03-10T15:08:53.008889+0000 mon.a (mon.0) 1219 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T15:08:53.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:08:53 gibba015 bash[29377]: audit 2021-03-10T15:08:53.008944+0000 mon.c (mon.1) 1214 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:08:53.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:08:53 gibba015 bash[29377]: audit 2021-03-10T15:08:53.009732+0000 mon.c (mon.1) 1215 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:08:53.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:08:53 gibba015 bash[29377]: audit 2021-03-10T15:08:53.009843+0000 mon.a (mon.0) 1220 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:08:53.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:08:53 gibba015 bash[29377]: audit 2021-03-10T15:08:53.010135+0000 mon.a (mon.0) 1221 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:08:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:08:53 gibba015 bash[30343]: cluster 2021-03-10T15:08:52.393980+0000 mgr.gibba045.orlgmj (mgr.34412) 4257 : cluster [DBG] pgmap v2413: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:08:53 gibba015 bash[30343]: audit 2021-03-10T15:08:53.004113+0000 mon.c (mon.1) 1210 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:08:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:08:53 gibba015 bash[30343]: audit 2021-03-10T15:08:53.005185+0000 mon.c (mon.1) 1211 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:08:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:08:53 gibba015 bash[30343]: audit 2021-03-10T15:08:53.005452+0000 mon.a (mon.0) 1216 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:08:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:08:53 gibba015 bash[30343]: audit 2021-03-10T15:08:53.006155+0000 mon.c (mon.1) 1212 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T15:08:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:08:53 gibba015 bash[30343]: audit 2021-03-10T15:08:53.006326+0000 mon.a (mon.0) 1217 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:08:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:08:53 gibba015 bash[30343]: audit 2021-03-10T15:08:53.007280+0000 mon.a (mon.0) 1218 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T15:08:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:08:53 gibba015 bash[30343]: audit 2021-03-10T15:08:53.007685+0000 mon.c (mon.1) 1213 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T15:08:53.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:08:53 gibba015 bash[30343]: audit 2021-03-10T15:08:53.008889+0000 mon.a (mon.0) 1219 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T15:08:53.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:08:53 gibba015 bash[30343]: audit 2021-03-10T15:08:53.008944+0000 mon.c (mon.1) 1214 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:08:53.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:08:53 gibba015 bash[30343]: audit 2021-03-10T15:08:53.009732+0000 mon.c (mon.1) 1215 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:08:53.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:08:53 gibba015 bash[30343]: audit 2021-03-10T15:08:53.009843+0000 mon.a (mon.0) 1220 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:08:53.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:08:53 gibba015 bash[30343]: audit 2021-03-10T15:08:53.010135+0000 mon.a (mon.0) 1221 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:08:55.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:08:54 gibba045 bash[25517]: cluster 2021-03-10T15:08:54.395547+0000 mgr.gibba045.orlgmj (mgr.34412) 4258 : cluster [DBG] pgmap v2414: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:55.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:08:54 gibba015 bash[29377]: cluster 2021-03-10T15:08:54.395547+0000 mgr.gibba045.orlgmj (mgr.34412) 4258 : cluster [DBG] pgmap v2414: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:55.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:08:54 gibba015 bash[30343]: cluster 2021-03-10T15:08:54.395547+0000 mgr.gibba045.orlgmj (mgr.34412) 4258 : cluster [DBG] pgmap v2414: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:57.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:08:57 gibba015 bash[29377]: cluster 2021-03-10T15:08:56.397441+0000 mgr.gibba045.orlgmj (mgr.34412) 4259 : cluster [DBG] pgmap v2415: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:57.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:08:57 gibba015 bash[30343]: cluster 2021-03-10T15:08:56.397441+0000 mgr.gibba045.orlgmj (mgr.34412) 4259 : cluster [DBG] pgmap v2415: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:57.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:08:57 gibba045 bash[25517]: cluster 2021-03-10T15:08:56.397441+0000 mgr.gibba045.orlgmj (mgr.34412) 4259 : cluster [DBG] pgmap v2415: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:59.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:08:59 gibba015 bash[29377]: cluster 2021-03-10T15:08:58.398630+0000 mgr.gibba045.orlgmj (mgr.34412) 4260 : cluster [DBG] pgmap v2416: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:59.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:08:59 gibba015 bash[30343]: cluster 2021-03-10T15:08:58.398630+0000 mgr.gibba045.orlgmj (mgr.34412) 4260 : cluster [DBG] pgmap v2416: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:59.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:08:59 gibba045 bash[25517]: cluster 2021-03-10T15:08:58.398630+0000 mgr.gibba045.orlgmj (mgr.34412) 4260 : cluster [DBG] pgmap v2416: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:01.470 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:09:01.696 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:09:01.696 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (79m) 4m ago 85m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:09:01.697 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (84m) 3m ago 84m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:09:01.697 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (80m) 3m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:09:01.698 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (80m) 3m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:09:01.698 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (79m) 4m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:09:01.699 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (79m) 4m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:09:01.699 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (78m) 3m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:09:01.700 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (78m) 4m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:09:01.700 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (85m) 4m ago 85m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:09:01.701 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (85m) 3m ago 85m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:09:01.701 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (78m) 4m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:09:01.701 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (77m) 4m ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:09:01.702 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (77m) 4m ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:09:01.702 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (76m) 4m ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:09:01.703 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (76m) 3m ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:09:01.703 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (75m) 3m ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:09:01.704 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (75m) 3m ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:09:01.704 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (75m) 3m ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:09:01.705 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (84m) 3m ago 85m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:09:01.705 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 3m ago 83m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:09:01.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:09:01 gibba045 bash[25517]: cluster 2021-03-10T15:09:00.400299+0000 mgr.gibba045.orlgmj (mgr.34412) 4261 : cluster [DBG] pgmap v2417: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:01.944 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:09:01.945 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:09:01.946 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:09:01.946 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:09:01.946 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:09:01.947 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:09:01.947 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:09:01.948 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:09:01.948 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:09:01.949 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:09:01.949 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:09:01.950 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:09:01.950 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:09:01.951 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:09:01.951 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:09:01.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:09:01 gibba015 bash[29377]: cluster 2021-03-10T15:09:00.400299+0000 mgr.gibba045.orlgmj (mgr.34412) 4261 : cluster [DBG] pgmap v2417: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:01.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:09:01 gibba015 bash[30343]: cluster 2021-03-10T15:09:00.400299+0000 mgr.gibba045.orlgmj (mgr.34412) 4261 : cluster [DBG] pgmap v2417: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:02.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:09:02 gibba045 bash[25517]: audit 2021-03-10T15:09:01.460596+0000 mgr.gibba045.orlgmj (mgr.34412) 4262 : audit [DBG] from='client.56902 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:09:02.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:09:02 gibba045 bash[25517]: audit 2021-03-10T15:09:01.940785+0000 mon.c (mon.1) 1216 : audit [DBG] from='client.? 172.21.2.115:0/1236851231' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:09:02.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:09:02 gibba015 bash[29377]: audit 2021-03-10T15:09:01.460596+0000 mgr.gibba045.orlgmj (mgr.34412) 4262 : audit [DBG] from='client.56902 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:09:02.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:09:02 gibba015 bash[29377]: audit 2021-03-10T15:09:01.940785+0000 mon.c (mon.1) 1216 : audit [DBG] from='client.? 172.21.2.115:0/1236851231' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:09:02.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:09:02 gibba015 bash[30343]: audit 2021-03-10T15:09:01.460596+0000 mgr.gibba045.orlgmj (mgr.34412) 4262 : audit [DBG] from='client.56902 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:09:02.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:09:02 gibba015 bash[30343]: audit 2021-03-10T15:09:01.940785+0000 mon.c (mon.1) 1216 : audit [DBG] from='client.? 172.21.2.115:0/1236851231' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:09:03.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:09:03 gibba045 bash[25517]: audit 2021-03-10T15:09:01.683530+0000 mgr.gibba045.orlgmj (mgr.34412) 4263 : audit [DBG] from='client.46920 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:09:03.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:09:03 gibba045 bash[25517]: cluster 2021-03-10T15:09:02.401973+0000 mgr.gibba045.orlgmj (mgr.34412) 4264 : cluster [DBG] pgmap v2418: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:03.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:09:03 gibba015 bash[29377]: audit 2021-03-10T15:09:01.683530+0000 mgr.gibba045.orlgmj (mgr.34412) 4263 : audit [DBG] from='client.46920 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:09:03.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:09:03 gibba015 bash[29377]: cluster 2021-03-10T15:09:02.401973+0000 mgr.gibba045.orlgmj (mgr.34412) 4264 : cluster [DBG] pgmap v2418: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:03.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:09:03 gibba015 bash[30343]: audit 2021-03-10T15:09:01.683530+0000 mgr.gibba045.orlgmj (mgr.34412) 4263 : audit [DBG] from='client.46920 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:09:03.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:09:03 gibba015 bash[30343]: cluster 2021-03-10T15:09:02.401973+0000 mgr.gibba045.orlgmj (mgr.34412) 4264 : cluster [DBG] pgmap v2418: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:05.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:09:04 gibba045 bash[25517]: cluster 2021-03-10T15:09:04.403214+0000 mgr.gibba045.orlgmj (mgr.34412) 4265 : cluster [DBG] pgmap v2419: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:05.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:09:04 gibba015 bash[29377]: cluster 2021-03-10T15:09:04.403214+0000 mgr.gibba045.orlgmj (mgr.34412) 4265 : cluster [DBG] pgmap v2419: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:05.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:09:04 gibba015 bash[30343]: cluster 2021-03-10T15:09:04.403214+0000 mgr.gibba045.orlgmj (mgr.34412) 4265 : cluster [DBG] pgmap v2419: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:07.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:09:07 gibba015 bash[29377]: cephadm 2021-03-10T15:09:05.666349+0000 mgr.gibba045.orlgmj (mgr.34412) 4266 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:09:07.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:09:07 gibba015 bash[29377]: cluster 2021-03-10T15:09:06.405195+0000 mgr.gibba045.orlgmj (mgr.34412) 4267 : cluster [DBG] pgmap v2420: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:07.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:09:07 gibba015 bash[30343]: cephadm 2021-03-10T15:09:05.666349+0000 mgr.gibba045.orlgmj (mgr.34412) 4266 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:09:07.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:09:07 gibba015 bash[30343]: cluster 2021-03-10T15:09:06.405195+0000 mgr.gibba045.orlgmj (mgr.34412) 4267 : cluster [DBG] pgmap v2420: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:07.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:09:07 gibba045 bash[25517]: cephadm 2021-03-10T15:09:05.666349+0000 mgr.gibba045.orlgmj (mgr.34412) 4266 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:09:07.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:09:07 gibba045 bash[25517]: cluster 2021-03-10T15:09:06.405195+0000 mgr.gibba045.orlgmj (mgr.34412) 4267 : cluster [DBG] pgmap v2420: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:09.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:09:09 gibba045 bash[25517]: cluster 2021-03-10T15:09:08.406378+0000 mgr.gibba045.orlgmj (mgr.34412) 4268 : cluster [DBG] pgmap v2421: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:09.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:09:09 gibba015 bash[29377]: cluster 2021-03-10T15:09:08.406378+0000 mgr.gibba045.orlgmj (mgr.34412) 4268 : cluster [DBG] pgmap v2421: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:09.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:09:09 gibba015 bash[30343]: cluster 2021-03-10T15:09:08.406378+0000 mgr.gibba045.orlgmj (mgr.34412) 4268 : cluster [DBG] pgmap v2421: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:11.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:09:11 gibba045 bash[25517]: cluster 2021-03-10T15:09:10.408097+0000 mgr.gibba045.orlgmj (mgr.34412) 4269 : cluster [DBG] pgmap v2422: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:11.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:09:11 gibba015 bash[29377]: cluster 2021-03-10T15:09:10.408097+0000 mgr.gibba045.orlgmj (mgr.34412) 4269 : cluster [DBG] pgmap v2422: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:11.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:09:11 gibba015 bash[30343]: cluster 2021-03-10T15:09:10.408097+0000 mgr.gibba045.orlgmj (mgr.34412) 4269 : cluster [DBG] pgmap v2422: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:13.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:09:13 gibba045 bash[25517]: cluster 2021-03-10T15:09:12.409593+0000 mgr.gibba045.orlgmj (mgr.34412) 4270 : cluster [DBG] pgmap v2423: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:13.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:09:13 gibba015 bash[29377]: cluster 2021-03-10T15:09:12.409593+0000 mgr.gibba045.orlgmj (mgr.34412) 4270 : cluster [DBG] pgmap v2423: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:13.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:09:13 gibba015 bash[30343]: cluster 2021-03-10T15:09:12.409593+0000 mgr.gibba045.orlgmj (mgr.34412) 4270 : cluster [DBG] pgmap v2423: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:15.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:09:14 gibba045 bash[25517]: cluster 2021-03-10T15:09:14.410850+0000 mgr.gibba045.orlgmj (mgr.34412) 4271 : cluster [DBG] pgmap v2424: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:15.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:09:14 gibba015 bash[29377]: cluster 2021-03-10T15:09:14.410850+0000 mgr.gibba045.orlgmj (mgr.34412) 4271 : cluster [DBG] pgmap v2424: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:15.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:09:14 gibba015 bash[30343]: cluster 2021-03-10T15:09:14.410850+0000 mgr.gibba045.orlgmj (mgr.34412) 4271 : cluster [DBG] pgmap v2424: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:17.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:09:17 gibba045 bash[25517]: cluster 2021-03-10T15:09:16.412941+0000 mgr.gibba045.orlgmj (mgr.34412) 4272 : cluster [DBG] pgmap v2425: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:17.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:09:17 gibba015 bash[29377]: cluster 2021-03-10T15:09:16.412941+0000 mgr.gibba045.orlgmj (mgr.34412) 4272 : cluster [DBG] pgmap v2425: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:17.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:09:17 gibba015 bash[30343]: cluster 2021-03-10T15:09:16.412941+0000 mgr.gibba045.orlgmj (mgr.34412) 4272 : cluster [DBG] pgmap v2425: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:19.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:09:19 gibba045 bash[25517]: cluster 2021-03-10T15:09:18.414191+0000 mgr.gibba045.orlgmj (mgr.34412) 4273 : cluster [DBG] pgmap v2426: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:19.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:09:19 gibba015 bash[29377]: cluster 2021-03-10T15:09:18.414191+0000 mgr.gibba045.orlgmj (mgr.34412) 4273 : cluster [DBG] pgmap v2426: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:19.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:09:19 gibba015 bash[30343]: cluster 2021-03-10T15:09:18.414191+0000 mgr.gibba045.orlgmj (mgr.34412) 4273 : cluster [DBG] pgmap v2426: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:21.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:09:21 gibba045 bash[25517]: cluster 2021-03-10T15:09:20.415749+0000 mgr.gibba045.orlgmj (mgr.34412) 4274 : cluster [DBG] pgmap v2427: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:21.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:09:21 gibba015 bash[29377]: cluster 2021-03-10T15:09:20.415749+0000 mgr.gibba045.orlgmj (mgr.34412) 4274 : cluster [DBG] pgmap v2427: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:21.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:09:21 gibba015 bash[30343]: cluster 2021-03-10T15:09:20.415749+0000 mgr.gibba045.orlgmj (mgr.34412) 4274 : cluster [DBG] pgmap v2427: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:22.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:09:22 gibba045 bash[25517]: cephadm 2021-03-10T15:09:20.682451+0000 mgr.gibba045.orlgmj (mgr.34412) 4275 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:09:22.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:09:22 gibba015 bash[29377]: cephadm 2021-03-10T15:09:20.682451+0000 mgr.gibba045.orlgmj (mgr.34412) 4275 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:09:22.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:09:22 gibba015 bash[30343]: cephadm 2021-03-10T15:09:20.682451+0000 mgr.gibba045.orlgmj (mgr.34412) 4275 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:09:23.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:09:23 gibba045 bash[25517]: cluster 2021-03-10T15:09:22.417668+0000 mgr.gibba045.orlgmj (mgr.34412) 4276 : cluster [DBG] pgmap v2428: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:23.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:09:23 gibba015 bash[29377]: cluster 2021-03-10T15:09:22.417668+0000 mgr.gibba045.orlgmj (mgr.34412) 4276 : cluster [DBG] pgmap v2428: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:23.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:09:23 gibba015 bash[30343]: cluster 2021-03-10T15:09:22.417668+0000 mgr.gibba045.orlgmj (mgr.34412) 4276 : cluster [DBG] pgmap v2428: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:25.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:09:24 gibba045 bash[25517]: cluster 2021-03-10T15:09:24.419188+0000 mgr.gibba045.orlgmj (mgr.34412) 4277 : cluster [DBG] pgmap v2429: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:25.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:09:24 gibba015 bash[29377]: cluster 2021-03-10T15:09:24.419188+0000 mgr.gibba045.orlgmj (mgr.34412) 4277 : cluster [DBG] pgmap v2429: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:25.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:09:24 gibba015 bash[30343]: cluster 2021-03-10T15:09:24.419188+0000 mgr.gibba045.orlgmj (mgr.34412) 4277 : cluster [DBG] pgmap v2429: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:27.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:09:27 gibba045 bash[25517]: cluster 2021-03-10T15:09:26.420969+0000 mgr.gibba045.orlgmj (mgr.34412) 4278 : cluster [DBG] pgmap v2430: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:27.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:09:27 gibba015 bash[29377]: cluster 2021-03-10T15:09:26.420969+0000 mgr.gibba045.orlgmj (mgr.34412) 4278 : cluster [DBG] pgmap v2430: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:27.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:09:27 gibba015 bash[30343]: cluster 2021-03-10T15:09:26.420969+0000 mgr.gibba045.orlgmj (mgr.34412) 4278 : cluster [DBG] pgmap v2430: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:29.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:09:29 gibba045 bash[25517]: cluster 2021-03-10T15:09:28.422345+0000 mgr.gibba045.orlgmj (mgr.34412) 4279 : cluster [DBG] pgmap v2431: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:29.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:09:29 gibba015 bash[29377]: cluster 2021-03-10T15:09:28.422345+0000 mgr.gibba045.orlgmj (mgr.34412) 4279 : cluster [DBG] pgmap v2431: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:29.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:09:29 gibba015 bash[30343]: cluster 2021-03-10T15:09:28.422345+0000 mgr.gibba045.orlgmj (mgr.34412) 4279 : cluster [DBG] pgmap v2431: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:31.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:09:31 gibba045 bash[25517]: cluster 2021-03-10T15:09:30.424042+0000 mgr.gibba045.orlgmj (mgr.34412) 4280 : cluster [DBG] pgmap v2432: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:31.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:09:31 gibba015 bash[29377]: cluster 2021-03-10T15:09:30.424042+0000 mgr.gibba045.orlgmj (mgr.34412) 4280 : cluster [DBG] pgmap v2432: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:31.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:09:31 gibba015 bash[30343]: cluster 2021-03-10T15:09:30.424042+0000 mgr.gibba045.orlgmj (mgr.34412) 4280 : cluster [DBG] pgmap v2432: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:32.188 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:09:32.442 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:09:32.442 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (80m) 5m ago 85m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:09:32.443 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (85m) 3m ago 85m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:09:32.443 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (80m) 3m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:09:32.443 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (80m) 3m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:09:32.443 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (79m) 5m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:09:32.443 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (79m) 5m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:09:32.444 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (79m) 3m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:09:32.444 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (79m) 5m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:09:32.444 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (85m) 5m ago 85m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:09:32.444 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (85m) 3m ago 85m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:09:32.445 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (78m) 5m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:09:32.445 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (78m) 5m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:09:32.445 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (77m) 5m ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:09:32.445 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (77m) 5m ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:09:32.446 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (76m) 3m ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:09:32.446 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (76m) 3m ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:09:32.446 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (76m) 3m ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:09:32.446 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (75m) 3m ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:09:32.447 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (85m) 3m ago 85m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:09:32.447 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 3m ago 83m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:09:32.700 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:09:32.700 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:09:32.700 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:09:32.700 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:09:32.701 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:09:32.701 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:09:32.701 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:09:32.701 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:09:32.702 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:09:32.702 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:09:32.702 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:09:32.702 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:09:32.703 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:09:32.703 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:09:32.703 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:09:33.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:09:33 gibba045 bash[25517]: audit 2021-03-10T15:09:32.179890+0000 mgr.gibba045.orlgmj (mgr.34412) 4281 : audit [DBG] from='client.56920 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:09:33.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:09:33 gibba045 bash[25517]: audit 2021-03-10T15:09:32.401123+0000 mgr.gibba045.orlgmj (mgr.34412) 4282 : audit [DBG] from='client.46938 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:09:33.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:09:33 gibba045 bash[25517]: cluster 2021-03-10T15:09:32.425514+0000 mgr.gibba045.orlgmj (mgr.34412) 4283 : cluster [DBG] pgmap v2433: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:33.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:09:33 gibba045 bash[25517]: audit 2021-03-10T15:09:32.696277+0000 mon.c (mon.1) 1217 : audit [DBG] from='client.? 172.21.2.115:0/1954289819' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:09:33.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:09:33 gibba015 bash[29377]: audit 2021-03-10T15:09:32.179890+0000 mgr.gibba045.orlgmj (mgr.34412) 4281 : audit [DBG] from='client.56920 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:09:33.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:09:33 gibba015 bash[29377]: audit 2021-03-10T15:09:32.401123+0000 mgr.gibba045.orlgmj (mgr.34412) 4282 : audit [DBG] from='client.46938 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:09:33.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:09:33 gibba015 bash[29377]: cluster 2021-03-10T15:09:32.425514+0000 mgr.gibba045.orlgmj (mgr.34412) 4283 : cluster [DBG] pgmap v2433: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:33.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:09:33 gibba015 bash[29377]: audit 2021-03-10T15:09:32.696277+0000 mon.c (mon.1) 1217 : audit [DBG] from='client.? 172.21.2.115:0/1954289819' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:09:33.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:09:33 gibba015 bash[30343]: audit 2021-03-10T15:09:32.179890+0000 mgr.gibba045.orlgmj (mgr.34412) 4281 : audit [DBG] from='client.56920 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:09:33.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:09:33 gibba015 bash[30343]: audit 2021-03-10T15:09:32.401123+0000 mgr.gibba045.orlgmj (mgr.34412) 4282 : audit [DBG] from='client.46938 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:09:33.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:09:33 gibba015 bash[30343]: cluster 2021-03-10T15:09:32.425514+0000 mgr.gibba045.orlgmj (mgr.34412) 4283 : cluster [DBG] pgmap v2433: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:33.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:09:33 gibba015 bash[30343]: audit 2021-03-10T15:09:32.696277+0000 mon.c (mon.1) 1217 : audit [DBG] from='client.? 172.21.2.115:0/1954289819' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:09:35.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:09:34 gibba045 bash[25517]: cluster 2021-03-10T15:09:34.427033+0000 mgr.gibba045.orlgmj (mgr.34412) 4284 : cluster [DBG] pgmap v2434: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:35.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:09:34 gibba015 bash[29377]: cluster 2021-03-10T15:09:34.427033+0000 mgr.gibba045.orlgmj (mgr.34412) 4284 : cluster [DBG] pgmap v2434: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:35.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:09:34 gibba015 bash[30343]: cluster 2021-03-10T15:09:34.427033+0000 mgr.gibba045.orlgmj (mgr.34412) 4284 : cluster [DBG] pgmap v2434: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:36.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:09:35 gibba045 bash[25517]: audit 2021-03-10T15:09:35.695525+0000 mon.c (mon.1) 1218 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:09:36.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:09:35 gibba015 bash[29377]: audit 2021-03-10T15:09:35.695525+0000 mon.c (mon.1) 1218 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:09:36.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:09:35 gibba015 bash[30343]: audit 2021-03-10T15:09:35.695525+0000 mon.c (mon.1) 1218 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:09:37.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:09:36 gibba015 bash[29377]: cephadm 2021-03-10T15:09:35.704763+0000 mgr.gibba045.orlgmj (mgr.34412) 4285 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:09:37.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:09:36 gibba015 bash[29377]: cephadm 2021-03-10T15:09:35.706521+0000 mgr.gibba045.orlgmj (mgr.34412) 4286 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:09:37.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:09:36 gibba015 bash[29377]: audit 2021-03-10T15:09:35.910184+0000 mon.a (mon.0) 1222 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:09:37.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:09:36 gibba015 bash[29377]: audit 2021-03-10T15:09:35.913599+0000 mon.c (mon.1) 1219 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:09:37.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:09:36 gibba015 bash[29377]: audit 2021-03-10T15:09:35.915566+0000 mon.c (mon.1) 1220 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:09:37.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:09:36 gibba015 bash[29377]: cephadm 2021-03-10T15:09:35.916562+0000 mgr.gibba045.orlgmj (mgr.34412) 4287 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:09:37.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:09:36 gibba015 bash[29377]: audit 2021-03-10T15:09:35.917228+0000 mon.c (mon.1) 1221 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:09:37.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:09:36 gibba015 bash[29377]: audit 2021-03-10T15:09:35.918137+0000 mon.c (mon.1) 1222 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:09:37.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:09:36 gibba015 bash[29377]: cephadm 2021-03-10T15:09:35.918670+0000 mgr.gibba045.orlgmj (mgr.34412) 4288 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:09:37.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:09:36 gibba015 bash[29377]: cephadm 2021-03-10T15:09:35.920255+0000 mgr.gibba045.orlgmj (mgr.34412) 4289 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:09:37.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:09:36 gibba015 bash[29377]: cephadm 2021-03-10T15:09:35.920291+0000 mgr.gibba045.orlgmj (mgr.34412) 4290 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:09:37.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:09:36 gibba015 bash[29377]: audit 2021-03-10T15:09:35.920458+0000 mon.c (mon.1) 1223 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:09:37.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:09:36 gibba015 bash[29377]: cephadm 2021-03-10T15:09:35.921522+0000 mgr.gibba045.orlgmj (mgr.34412) 4291 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:09:37.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:09:36 gibba015 bash[29377]: cephadm 2021-03-10T15:09:35.921559+0000 mgr.gibba045.orlgmj (mgr.34412) 4292 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:09:37.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:09:36 gibba015 bash[29377]: audit 2021-03-10T15:09:35.921662+0000 mon.c (mon.1) 1224 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:09:37.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:09:36 gibba015 bash[29377]: cephadm 2021-03-10T15:09:35.922387+0000 mgr.gibba045.orlgmj (mgr.34412) 4293 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:09:37.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:09:36 gibba015 bash[29377]: cephadm 2021-03-10T15:09:35.923688+0000 mgr.gibba045.orlgmj (mgr.34412) 4294 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:09:37.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:09:36 gibba015 bash[29377]: cephadm 2021-03-10T15:09:35.923725+0000 mgr.gibba045.orlgmj (mgr.34412) 4295 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:09:37.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:09:36 gibba015 bash[29377]: cephadm 2021-03-10T15:09:35.924766+0000 mgr.gibba045.orlgmj (mgr.34412) 4296 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:09:37.230 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:09:36 gibba015 bash[29377]: cephadm 2021-03-10T15:09:35.925083+0000 mgr.gibba045.orlgmj (mgr.34412) 4297 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:09:37.230 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:09:36 gibba015 bash[29377]: cephadm 2021-03-10T15:09:35.926086+0000 mgr.gibba045.orlgmj (mgr.34412) 4298 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:09:37.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:09:36 gibba015 bash[30343]: cephadm 2021-03-10T15:09:35.704763+0000 mgr.gibba045.orlgmj (mgr.34412) 4285 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:09:37.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:09:36 gibba015 bash[30343]: cephadm 2021-03-10T15:09:35.706521+0000 mgr.gibba045.orlgmj (mgr.34412) 4286 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:09:37.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:09:36 gibba015 bash[30343]: audit 2021-03-10T15:09:35.910184+0000 mon.a (mon.0) 1222 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:09:37.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:09:36 gibba015 bash[30343]: audit 2021-03-10T15:09:35.913599+0000 mon.c (mon.1) 1219 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:09:37.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:09:36 gibba015 bash[30343]: audit 2021-03-10T15:09:35.915566+0000 mon.c (mon.1) 1220 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:09:37.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:09:36 gibba015 bash[30343]: cephadm 2021-03-10T15:09:35.916562+0000 mgr.gibba045.orlgmj (mgr.34412) 4287 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:09:37.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:09:36 gibba015 bash[30343]: audit 2021-03-10T15:09:35.917228+0000 mon.c (mon.1) 1221 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:09:37.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:09:36 gibba015 bash[30343]: audit 2021-03-10T15:09:35.918137+0000 mon.c (mon.1) 1222 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:09:37.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:09:36 gibba015 bash[30343]: cephadm 2021-03-10T15:09:35.918670+0000 mgr.gibba045.orlgmj (mgr.34412) 4288 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:09:37.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:09:36 gibba015 bash[30343]: cephadm 2021-03-10T15:09:35.920255+0000 mgr.gibba045.orlgmj (mgr.34412) 4289 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:09:37.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:09:36 gibba015 bash[30343]: cephadm 2021-03-10T15:09:35.920291+0000 mgr.gibba045.orlgmj (mgr.34412) 4290 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:09:37.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:09:36 gibba015 bash[30343]: audit 2021-03-10T15:09:35.920458+0000 mon.c (mon.1) 1223 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:09:37.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:09:36 gibba015 bash[30343]: cephadm 2021-03-10T15:09:35.921522+0000 mgr.gibba045.orlgmj (mgr.34412) 4291 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:09:37.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:09:36 gibba015 bash[30343]: cephadm 2021-03-10T15:09:35.921559+0000 mgr.gibba045.orlgmj (mgr.34412) 4292 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:09:37.234 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:09:36 gibba015 bash[30343]: audit 2021-03-10T15:09:35.921662+0000 mon.c (mon.1) 1224 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:09:37.234 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:09:36 gibba015 bash[30343]: cephadm 2021-03-10T15:09:35.922387+0000 mgr.gibba045.orlgmj (mgr.34412) 4293 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:09:37.234 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:09:36 gibba015 bash[30343]: cephadm 2021-03-10T15:09:35.923688+0000 mgr.gibba045.orlgmj (mgr.34412) 4294 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:09:37.234 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:09:36 gibba015 bash[30343]: cephadm 2021-03-10T15:09:35.923725+0000 mgr.gibba045.orlgmj (mgr.34412) 4295 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:09:37.235 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:09:36 gibba015 bash[30343]: cephadm 2021-03-10T15:09:35.924766+0000 mgr.gibba045.orlgmj (mgr.34412) 4296 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:09:37.235 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:09:36 gibba015 bash[30343]: cephadm 2021-03-10T15:09:35.925083+0000 mgr.gibba045.orlgmj (mgr.34412) 4297 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:09:37.235 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:09:36 gibba015 bash[30343]: cephadm 2021-03-10T15:09:35.926086+0000 mgr.gibba045.orlgmj (mgr.34412) 4298 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:09:37.235 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:09:36 gibba015 bash[30343]: cephadm 2021-03-10T15:09:35.926123+0000 mgr.gibba045.orlgmj (mgr.34412) 4299 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:09:37.235 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:09:36 gibba015 bash[30343]: cephadm 2021-03-10T15:09:35.926227+0000 mgr.gibba045.orlgmj (mgr.34412) 4300 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:09:37.236 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:09:36 gibba015 bash[30343]: cluster 2021-03-10T15:09:36.428669+0000 mgr.gibba045.orlgmj (mgr.34412) 4301 : cluster [DBG] pgmap v2435: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:37.236 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:09:36 gibba015 bash[29377]: cephadm 2021-03-10T15:09:35.926123+0000 mgr.gibba045.orlgmj (mgr.34412) 4299 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:09:37.236 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:09:36 gibba015 bash[29377]: cephadm 2021-03-10T15:09:35.926227+0000 mgr.gibba045.orlgmj (mgr.34412) 4300 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:09:37.237 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:09:36 gibba015 bash[29377]: cluster 2021-03-10T15:09:36.428669+0000 mgr.gibba045.orlgmj (mgr.34412) 4301 : cluster [DBG] pgmap v2435: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:37.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:09:36 gibba045 bash[25517]: cephadm 2021-03-10T15:09:35.704763+0000 mgr.gibba045.orlgmj (mgr.34412) 4285 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:09:37.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:09:36 gibba045 bash[25517]: cephadm 2021-03-10T15:09:35.706521+0000 mgr.gibba045.orlgmj (mgr.34412) 4286 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:09:37.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:09:36 gibba045 bash[25517]: audit 2021-03-10T15:09:35.910184+0000 mon.a (mon.0) 1222 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:09:37.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:09:36 gibba045 bash[25517]: audit 2021-03-10T15:09:35.913599+0000 mon.c (mon.1) 1219 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:09:37.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:09:36 gibba045 bash[25517]: audit 2021-03-10T15:09:35.915566+0000 mon.c (mon.1) 1220 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:09:37.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:09:36 gibba045 bash[25517]: cephadm 2021-03-10T15:09:35.916562+0000 mgr.gibba045.orlgmj (mgr.34412) 4287 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:09:37.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:09:36 gibba045 bash[25517]: audit 2021-03-10T15:09:35.917228+0000 mon.c (mon.1) 1221 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:09:37.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:09:36 gibba045 bash[25517]: audit 2021-03-10T15:09:35.918137+0000 mon.c (mon.1) 1222 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:09:37.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:09:36 gibba045 bash[25517]: cephadm 2021-03-10T15:09:35.918670+0000 mgr.gibba045.orlgmj (mgr.34412) 4288 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:09:37.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:09:36 gibba045 bash[25517]: cephadm 2021-03-10T15:09:35.920255+0000 mgr.gibba045.orlgmj (mgr.34412) 4289 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:09:37.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:09:36 gibba045 bash[25517]: cephadm 2021-03-10T15:09:35.920291+0000 mgr.gibba045.orlgmj (mgr.34412) 4290 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:09:37.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:09:36 gibba045 bash[25517]: audit 2021-03-10T15:09:35.920458+0000 mon.c (mon.1) 1223 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:09:37.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:09:36 gibba045 bash[25517]: cephadm 2021-03-10T15:09:35.921522+0000 mgr.gibba045.orlgmj (mgr.34412) 4291 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:09:37.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:09:36 gibba045 bash[25517]: cephadm 2021-03-10T15:09:35.921559+0000 mgr.gibba045.orlgmj (mgr.34412) 4292 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:09:37.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:09:36 gibba045 bash[25517]: audit 2021-03-10T15:09:35.921662+0000 mon.c (mon.1) 1224 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:09:37.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:09:36 gibba045 bash[25517]: cephadm 2021-03-10T15:09:35.922387+0000 mgr.gibba045.orlgmj (mgr.34412) 4293 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:09:37.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:09:36 gibba045 bash[25517]: cephadm 2021-03-10T15:09:35.923688+0000 mgr.gibba045.orlgmj (mgr.34412) 4294 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:09:37.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:09:36 gibba045 bash[25517]: cephadm 2021-03-10T15:09:35.923725+0000 mgr.gibba045.orlgmj (mgr.34412) 4295 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:09:37.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:09:36 gibba045 bash[25517]: cephadm 2021-03-10T15:09:35.924766+0000 mgr.gibba045.orlgmj (mgr.34412) 4296 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:09:37.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:09:36 gibba045 bash[25517]: cephadm 2021-03-10T15:09:35.925083+0000 mgr.gibba045.orlgmj (mgr.34412) 4297 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:09:37.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:09:36 gibba045 bash[25517]: cephadm 2021-03-10T15:09:35.926086+0000 mgr.gibba045.orlgmj (mgr.34412) 4298 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:09:37.312 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:09:36 gibba045 bash[25517]: cephadm 2021-03-10T15:09:35.926123+0000 mgr.gibba045.orlgmj (mgr.34412) 4299 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:09:37.312 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:09:36 gibba045 bash[25517]: cephadm 2021-03-10T15:09:35.926227+0000 mgr.gibba045.orlgmj (mgr.34412) 4300 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:09:37.312 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:09:36 gibba045 bash[25517]: cluster 2021-03-10T15:09:36.428669+0000 mgr.gibba045.orlgmj (mgr.34412) 4301 : cluster [DBG] pgmap v2435: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:39.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:09:39 gibba045 bash[25517]: cluster 2021-03-10T15:09:38.430012+0000 mgr.gibba045.orlgmj (mgr.34412) 4302 : cluster [DBG] pgmap v2436: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:39.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:09:39 gibba015 bash[29377]: cluster 2021-03-10T15:09:38.430012+0000 mgr.gibba045.orlgmj (mgr.34412) 4302 : cluster [DBG] pgmap v2436: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:39.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:09:39 gibba015 bash[30343]: cluster 2021-03-10T15:09:38.430012+0000 mgr.gibba045.orlgmj (mgr.34412) 4302 : cluster [DBG] pgmap v2436: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:41.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:09:41 gibba045 bash[25517]: cluster 2021-03-10T15:09:40.431624+0000 mgr.gibba045.orlgmj (mgr.34412) 4303 : cluster [DBG] pgmap v2437: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:41.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:09:41 gibba015 bash[29377]: cluster 2021-03-10T15:09:40.431624+0000 mgr.gibba045.orlgmj (mgr.34412) 4303 : cluster [DBG] pgmap v2437: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:41.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:09:41 gibba015 bash[30343]: cluster 2021-03-10T15:09:40.431624+0000 mgr.gibba045.orlgmj (mgr.34412) 4303 : cluster [DBG] pgmap v2437: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:43.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:09:43 gibba045 bash[25517]: cluster 2021-03-10T15:09:42.433416+0000 mgr.gibba045.orlgmj (mgr.34412) 4304 : cluster [DBG] pgmap v2438: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:43.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:09:43 gibba015 bash[29377]: cluster 2021-03-10T15:09:42.433416+0000 mgr.gibba045.orlgmj (mgr.34412) 4304 : cluster [DBG] pgmap v2438: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:43.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:09:43 gibba015 bash[30343]: cluster 2021-03-10T15:09:42.433416+0000 mgr.gibba045.orlgmj (mgr.34412) 4304 : cluster [DBG] pgmap v2438: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:45.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:09:44 gibba045 bash[25517]: cluster 2021-03-10T15:09:44.434799+0000 mgr.gibba045.orlgmj (mgr.34412) 4305 : cluster [DBG] pgmap v2439: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:45.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:09:44 gibba015 bash[29377]: cluster 2021-03-10T15:09:44.434799+0000 mgr.gibba045.orlgmj (mgr.34412) 4305 : cluster [DBG] pgmap v2439: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:45.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:09:44 gibba015 bash[30343]: cluster 2021-03-10T15:09:44.434799+0000 mgr.gibba045.orlgmj (mgr.34412) 4305 : cluster [DBG] pgmap v2439: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:47.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:09:47 gibba045 bash[25517]: cluster 2021-03-10T15:09:46.436483+0000 mgr.gibba045.orlgmj (mgr.34412) 4306 : cluster [DBG] pgmap v2440: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:47.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:09:47 gibba015 bash[29377]: cluster 2021-03-10T15:09:46.436483+0000 mgr.gibba045.orlgmj (mgr.34412) 4306 : cluster [DBG] pgmap v2440: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:47.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:09:47 gibba015 bash[30343]: cluster 2021-03-10T15:09:46.436483+0000 mgr.gibba045.orlgmj (mgr.34412) 4306 : cluster [DBG] pgmap v2440: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:49.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:09:49 gibba045 bash[25517]: cluster 2021-03-10T15:09:48.437863+0000 mgr.gibba045.orlgmj (mgr.34412) 4307 : cluster [DBG] pgmap v2441: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:49.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:09:49 gibba015 bash[29377]: cluster 2021-03-10T15:09:48.437863+0000 mgr.gibba045.orlgmj (mgr.34412) 4307 : cluster [DBG] pgmap v2441: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:49.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:09:49 gibba015 bash[30343]: cluster 2021-03-10T15:09:48.437863+0000 mgr.gibba045.orlgmj (mgr.34412) 4307 : cluster [DBG] pgmap v2441: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:51.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:09:51 gibba045 bash[25517]: cluster 2021-03-10T15:09:50.439269+0000 mgr.gibba045.orlgmj (mgr.34412) 4308 : cluster [DBG] pgmap v2442: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:51.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:09:51 gibba015 bash[29377]: cluster 2021-03-10T15:09:50.439269+0000 mgr.gibba045.orlgmj (mgr.34412) 4308 : cluster [DBG] pgmap v2442: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:51.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:09:51 gibba015 bash[30343]: cluster 2021-03-10T15:09:50.439269+0000 mgr.gibba045.orlgmj (mgr.34412) 4308 : cluster [DBG] pgmap v2442: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:52.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:09:52 gibba045 bash[25517]: cephadm 2021-03-10T15:09:50.942167+0000 mgr.gibba045.orlgmj (mgr.34412) 4309 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:09:52.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:09:52 gibba015 bash[29377]: cephadm 2021-03-10T15:09:50.942167+0000 mgr.gibba045.orlgmj (mgr.34412) 4309 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:09:52.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:09:52 gibba015 bash[30343]: cephadm 2021-03-10T15:09:50.942167+0000 mgr.gibba045.orlgmj (mgr.34412) 4309 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:09:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:09:53 gibba045 bash[25517]: cluster 2021-03-10T15:09:52.440901+0000 mgr.gibba045.orlgmj (mgr.34412) 4310 : cluster [DBG] pgmap v2443: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:09:53 gibba045 bash[25517]: audit 2021-03-10T15:09:53.009820+0000 mon.c (mon.1) 1225 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:09:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:09:53 gibba045 bash[25517]: audit 2021-03-10T15:09:53.010512+0000 mon.c (mon.1) 1226 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:09:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:09:53 gibba045 bash[25517]: audit 2021-03-10T15:09:53.010946+0000 mon.a (mon.0) 1223 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:09:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:09:53 gibba045 bash[25517]: audit 2021-03-10T15:09:53.012066+0000 mon.c (mon.1) 1227 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T15:09:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:09:53 gibba045 bash[25517]: audit 2021-03-10T15:09:53.012087+0000 mon.a (mon.0) 1224 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:09:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:09:53 gibba045 bash[25517]: audit 2021-03-10T15:09:53.012814+0000 mon.c (mon.1) 1228 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T15:09:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:09:53 gibba045 bash[25517]: audit 2021-03-10T15:09:53.013288+0000 mon.a (mon.0) 1225 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T15:09:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:09:53 gibba045 bash[25517]: audit 2021-03-10T15:09:53.013690+0000 mon.c (mon.1) 1229 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:09:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:09:53 gibba045 bash[25517]: audit 2021-03-10T15:09:53.014520+0000 mon.c (mon.1) 1230 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:09:53.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:09:53 gibba045 bash[25517]: audit 2021-03-10T15:09:53.014539+0000 mon.a (mon.0) 1226 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T15:09:53.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:09:53 gibba045 bash[25517]: audit 2021-03-10T15:09:53.015531+0000 mon.a (mon.0) 1227 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:09:53.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:09:53 gibba045 bash[25517]: audit 2021-03-10T15:09:53.016538+0000 mon.a (mon.0) 1228 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:09:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:09:53 gibba015 bash[29377]: cluster 2021-03-10T15:09:52.440901+0000 mgr.gibba045.orlgmj (mgr.34412) 4310 : cluster [DBG] pgmap v2443: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:09:53 gibba015 bash[29377]: audit 2021-03-10T15:09:53.009820+0000 mon.c (mon.1) 1225 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:09:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:09:53 gibba015 bash[29377]: audit 2021-03-10T15:09:53.010512+0000 mon.c (mon.1) 1226 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:09:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:09:53 gibba015 bash[29377]: audit 2021-03-10T15:09:53.010946+0000 mon.a (mon.0) 1223 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:09:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:09:53 gibba015 bash[29377]: audit 2021-03-10T15:09:53.012066+0000 mon.c (mon.1) 1227 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T15:09:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:09:53 gibba015 bash[29377]: audit 2021-03-10T15:09:53.012087+0000 mon.a (mon.0) 1224 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:09:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:09:53 gibba015 bash[29377]: audit 2021-03-10T15:09:53.012814+0000 mon.c (mon.1) 1228 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T15:09:53.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:09:53 gibba015 bash[29377]: audit 2021-03-10T15:09:53.013288+0000 mon.a (mon.0) 1225 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T15:09:53.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:09:53 gibba015 bash[29377]: audit 2021-03-10T15:09:53.013690+0000 mon.c (mon.1) 1229 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:09:53.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:09:53 gibba015 bash[29377]: audit 2021-03-10T15:09:53.014520+0000 mon.c (mon.1) 1230 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:09:53.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:09:53 gibba015 bash[29377]: audit 2021-03-10T15:09:53.014539+0000 mon.a (mon.0) 1226 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T15:09:53.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:09:53 gibba015 bash[29377]: audit 2021-03-10T15:09:53.015531+0000 mon.a (mon.0) 1227 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:09:53.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:09:53 gibba015 bash[29377]: audit 2021-03-10T15:09:53.016538+0000 mon.a (mon.0) 1228 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:09:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:09:53 gibba015 bash[30343]: cluster 2021-03-10T15:09:52.440901+0000 mgr.gibba045.orlgmj (mgr.34412) 4310 : cluster [DBG] pgmap v2443: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:09:53 gibba015 bash[30343]: audit 2021-03-10T15:09:53.009820+0000 mon.c (mon.1) 1225 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:09:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:09:53 gibba015 bash[30343]: audit 2021-03-10T15:09:53.010512+0000 mon.c (mon.1) 1226 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:09:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:09:53 gibba015 bash[30343]: audit 2021-03-10T15:09:53.010946+0000 mon.a (mon.0) 1223 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:09:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:09:53 gibba015 bash[30343]: audit 2021-03-10T15:09:53.012066+0000 mon.c (mon.1) 1227 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T15:09:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:09:53 gibba015 bash[30343]: audit 2021-03-10T15:09:53.012087+0000 mon.a (mon.0) 1224 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:09:53.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:09:53 gibba015 bash[30343]: audit 2021-03-10T15:09:53.012814+0000 mon.c (mon.1) 1228 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T15:09:53.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:09:53 gibba015 bash[30343]: audit 2021-03-10T15:09:53.013288+0000 mon.a (mon.0) 1225 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T15:09:53.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:09:53 gibba015 bash[30343]: audit 2021-03-10T15:09:53.013690+0000 mon.c (mon.1) 1229 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:09:53.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:09:53 gibba015 bash[30343]: audit 2021-03-10T15:09:53.014520+0000 mon.c (mon.1) 1230 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:09:53.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:09:53 gibba015 bash[30343]: audit 2021-03-10T15:09:53.014539+0000 mon.a (mon.0) 1226 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T15:09:53.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:09:53 gibba015 bash[30343]: audit 2021-03-10T15:09:53.015531+0000 mon.a (mon.0) 1227 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:09:53.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:09:53 gibba015 bash[30343]: audit 2021-03-10T15:09:53.016538+0000 mon.a (mon.0) 1228 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:09:55.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:09:54 gibba045 bash[25517]: cluster 2021-03-10T15:09:54.442507+0000 mgr.gibba045.orlgmj (mgr.34412) 4311 : cluster [DBG] pgmap v2444: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:55.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:09:54 gibba015 bash[29377]: cluster 2021-03-10T15:09:54.442507+0000 mgr.gibba045.orlgmj (mgr.34412) 4311 : cluster [DBG] pgmap v2444: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:55.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:09:54 gibba015 bash[30343]: cluster 2021-03-10T15:09:54.442507+0000 mgr.gibba045.orlgmj (mgr.34412) 4311 : cluster [DBG] pgmap v2444: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:57.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:09:57 gibba045 bash[25517]: cluster 2021-03-10T15:09:56.444314+0000 mgr.gibba045.orlgmj (mgr.34412) 4312 : cluster [DBG] pgmap v2445: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:57.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:09:57 gibba015 bash[29377]: cluster 2021-03-10T15:09:56.444314+0000 mgr.gibba045.orlgmj (mgr.34412) 4312 : cluster [DBG] pgmap v2445: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:57.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:09:57 gibba015 bash[30343]: cluster 2021-03-10T15:09:56.444314+0000 mgr.gibba045.orlgmj (mgr.34412) 4312 : cluster [DBG] pgmap v2445: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:59.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:09:59 gibba045 bash[25517]: cluster 2021-03-10T15:09:58.445666+0000 mgr.gibba045.orlgmj (mgr.34412) 4313 : cluster [DBG] pgmap v2446: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:59.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:09:59 gibba015 bash[29377]: cluster 2021-03-10T15:09:58.445666+0000 mgr.gibba045.orlgmj (mgr.34412) 4313 : cluster [DBG] pgmap v2446: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:59.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:09:59 gibba015 bash[30343]: cluster 2021-03-10T15:09:58.445666+0000 mgr.gibba045.orlgmj (mgr.34412) 4313 : cluster [DBG] pgmap v2446: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:00.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:10:00 gibba015 bash[29377]: debug 2021-03-10T15:09:59.997+0000 7f21beb4f700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T15:10:00.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:10:00 gibba045 bash[25517]: cluster 2021-03-10T15:10:00.000225+0000 mon.a (mon.0) 1229 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T15:10:00.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:10:00 gibba015 bash[29377]: cluster 2021-03-10T15:10:00.000225+0000 mon.a (mon.0) 1229 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T15:10:00.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:10:00 gibba015 bash[30343]: cluster 2021-03-10T15:10:00.000225+0000 mon.a (mon.0) 1229 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T15:10:01.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:10:01 gibba045 bash[25517]: cluster 2021-03-10T15:10:00.447200+0000 mgr.gibba045.orlgmj (mgr.34412) 4314 : cluster [DBG] pgmap v2447: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:01.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:10:01 gibba015 bash[29377]: cluster 2021-03-10T15:10:00.447200+0000 mgr.gibba045.orlgmj (mgr.34412) 4314 : cluster [DBG] pgmap v2447: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:01.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:10:01 gibba015 bash[30343]: cluster 2021-03-10T15:10:00.447200+0000 mgr.gibba045.orlgmj (mgr.34412) 4314 : cluster [DBG] pgmap v2447: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:02.944 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:10:03.165 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:10:03.166 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (80m) 5m ago 86m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:10:03.166 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (85m) 4m ago 85m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:10:03.166 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (81m) 4m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:10:03.166 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (81m) 4m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:10:03.167 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (80m) 5m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:10:03.167 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (80m) 5m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:10:03.167 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (79m) 4m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:10:03.167 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (80m) 5m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:10:03.168 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (86m) 5m ago 86m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:10:03.168 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (86m) 4m ago 86m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:10:03.168 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (79m) 5m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:10:03.168 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (78m) 5m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:10:03.169 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (78m) 5m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:10:03.169 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (77m) 5m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:10:03.169 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (77m) 4m ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:10:03.169 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (76m) 4m ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:10:03.170 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (76m) 4m ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:10:03.170 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (76m) 4m ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:10:03.170 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (85m) 4m ago 86m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:10:03.170 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 4m ago 84m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:10:03.414 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:10:03.414 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:10:03.414 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:10:03.415 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:10:03.415 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:10:03.415 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:10:03.415 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:10:03.415 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:10:03.416 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:10:03.416 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:10:03.416 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:10:03.416 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:10:03.417 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:10:03.417 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:10:03.417 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:10:03.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:10:03 gibba045 bash[25517]: cluster 2021-03-10T15:10:02.448959+0000 mgr.gibba045.orlgmj (mgr.34412) 4315 : cluster [DBG] pgmap v2448: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:03.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:10:03 gibba045 bash[25517]: audit 2021-03-10T15:10:03.410020+0000 mon.c (mon.1) 1231 : audit [DBG] from='client.? 172.21.2.115:0/3960018911' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:10:03.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:10:03 gibba015 bash[29377]: cluster 2021-03-10T15:10:02.448959+0000 mgr.gibba045.orlgmj (mgr.34412) 4315 : cluster [DBG] pgmap v2448: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:03.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:10:03 gibba015 bash[29377]: audit 2021-03-10T15:10:03.410020+0000 mon.c (mon.1) 1231 : audit [DBG] from='client.? 172.21.2.115:0/3960018911' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:10:03.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:10:03 gibba015 bash[30343]: cluster 2021-03-10T15:10:02.448959+0000 mgr.gibba045.orlgmj (mgr.34412) 4315 : cluster [DBG] pgmap v2448: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:03.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:10:03 gibba015 bash[30343]: audit 2021-03-10T15:10:03.410020+0000 mon.c (mon.1) 1231 : audit [DBG] from='client.? 172.21.2.115:0/3960018911' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:10:04.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:10:04 gibba045 bash[25517]: audit 2021-03-10T15:10:02.935272+0000 mgr.gibba045.orlgmj (mgr.34412) 4316 : audit [DBG] from='client.46950 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:10:04.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:10:04 gibba045 bash[25517]: audit 2021-03-10T15:10:03.156590+0000 mgr.gibba045.orlgmj (mgr.34412) 4317 : audit [DBG] from='client.46956 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:10:04.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:10:04 gibba015 bash[29377]: audit 2021-03-10T15:10:02.935272+0000 mgr.gibba045.orlgmj (mgr.34412) 4316 : audit [DBG] from='client.46950 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:10:04.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:10:04 gibba015 bash[29377]: audit 2021-03-10T15:10:03.156590+0000 mgr.gibba045.orlgmj (mgr.34412) 4317 : audit [DBG] from='client.46956 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:10:04.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:10:04 gibba015 bash[30343]: audit 2021-03-10T15:10:02.935272+0000 mgr.gibba045.orlgmj (mgr.34412) 4316 : audit [DBG] from='client.46950 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:10:04.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:10:04 gibba015 bash[30343]: audit 2021-03-10T15:10:03.156590+0000 mgr.gibba045.orlgmj (mgr.34412) 4317 : audit [DBG] from='client.46956 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:10:05.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:10:05 gibba045 bash[25517]: cluster 2021-03-10T15:10:04.450487+0000 mgr.gibba045.orlgmj (mgr.34412) 4318 : cluster [DBG] pgmap v2449: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:05.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:10:05 gibba015 bash[29377]: cluster 2021-03-10T15:10:04.450487+0000 mgr.gibba045.orlgmj (mgr.34412) 4318 : cluster [DBG] pgmap v2449: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:05.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:10:05 gibba015 bash[30343]: cluster 2021-03-10T15:10:04.450487+0000 mgr.gibba045.orlgmj (mgr.34412) 4318 : cluster [DBG] pgmap v2449: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:07.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:10:07 gibba015 bash[29377]: cephadm 2021-03-10T15:10:05.958084+0000 mgr.gibba045.orlgmj (mgr.34412) 4319 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:10:07.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:10:07 gibba015 bash[29377]: cluster 2021-03-10T15:10:06.452466+0000 mgr.gibba045.orlgmj (mgr.34412) 4320 : cluster [DBG] pgmap v2450: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:07.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:10:07 gibba015 bash[30343]: cephadm 2021-03-10T15:10:05.958084+0000 mgr.gibba045.orlgmj (mgr.34412) 4319 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:10:07.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:10:07 gibba015 bash[30343]: cluster 2021-03-10T15:10:06.452466+0000 mgr.gibba045.orlgmj (mgr.34412) 4320 : cluster [DBG] pgmap v2450: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:08.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:10:07 gibba045 bash[25517]: cephadm 2021-03-10T15:10:05.958084+0000 mgr.gibba045.orlgmj (mgr.34412) 4319 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:10:08.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:10:07 gibba045 bash[25517]: cluster 2021-03-10T15:10:06.452466+0000 mgr.gibba045.orlgmj (mgr.34412) 4320 : cluster [DBG] pgmap v2450: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:09.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:10:09 gibba015 bash[29377]: cluster 2021-03-10T15:10:08.453683+0000 mgr.gibba045.orlgmj (mgr.34412) 4321 : cluster [DBG] pgmap v2451: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:09.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:10:09 gibba015 bash[30343]: cluster 2021-03-10T15:10:08.453683+0000 mgr.gibba045.orlgmj (mgr.34412) 4321 : cluster [DBG] pgmap v2451: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:10.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:10:09 gibba045 bash[25517]: cluster 2021-03-10T15:10:08.453683+0000 mgr.gibba045.orlgmj (mgr.34412) 4321 : cluster [DBG] pgmap v2451: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:11.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:10:11 gibba015 bash[29377]: cluster 2021-03-10T15:10:10.455428+0000 mgr.gibba045.orlgmj (mgr.34412) 4322 : cluster [DBG] pgmap v2452: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:11.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:10:11 gibba015 bash[30343]: cluster 2021-03-10T15:10:10.455428+0000 mgr.gibba045.orlgmj (mgr.34412) 4322 : cluster [DBG] pgmap v2452: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:12.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:10:11 gibba045 bash[25517]: cluster 2021-03-10T15:10:10.455428+0000 mgr.gibba045.orlgmj (mgr.34412) 4322 : cluster [DBG] pgmap v2452: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:13.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:10:13 gibba015 bash[29377]: cluster 2021-03-10T15:10:12.457189+0000 mgr.gibba045.orlgmj (mgr.34412) 4323 : cluster [DBG] pgmap v2453: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:13.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:10:13 gibba015 bash[30343]: cluster 2021-03-10T15:10:12.457189+0000 mgr.gibba045.orlgmj (mgr.34412) 4323 : cluster [DBG] pgmap v2453: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:14.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:10:13 gibba045 bash[25517]: cluster 2021-03-10T15:10:12.457189+0000 mgr.gibba045.orlgmj (mgr.34412) 4323 : cluster [DBG] pgmap v2453: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:15.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:10:14 gibba045 bash[25517]: cluster 2021-03-10T15:10:14.458551+0000 mgr.gibba045.orlgmj (mgr.34412) 4324 : cluster [DBG] pgmap v2454: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:15.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:10:14 gibba015 bash[29377]: cluster 2021-03-10T15:10:14.458551+0000 mgr.gibba045.orlgmj (mgr.34412) 4324 : cluster [DBG] pgmap v2454: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:15.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:10:14 gibba015 bash[30343]: cluster 2021-03-10T15:10:14.458551+0000 mgr.gibba045.orlgmj (mgr.34412) 4324 : cluster [DBG] pgmap v2454: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:17.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:10:17 gibba045 bash[25517]: cluster 2021-03-10T15:10:16.460523+0000 mgr.gibba045.orlgmj (mgr.34412) 4325 : cluster [DBG] pgmap v2455: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:17.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:10:17 gibba015 bash[29377]: cluster 2021-03-10T15:10:16.460523+0000 mgr.gibba045.orlgmj (mgr.34412) 4325 : cluster [DBG] pgmap v2455: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:17.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:10:17 gibba015 bash[30343]: cluster 2021-03-10T15:10:16.460523+0000 mgr.gibba045.orlgmj (mgr.34412) 4325 : cluster [DBG] pgmap v2455: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:19.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:10:19 gibba045 bash[25517]: cluster 2021-03-10T15:10:18.461556+0000 mgr.gibba045.orlgmj (mgr.34412) 4326 : cluster [DBG] pgmap v2456: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:19.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:10:19 gibba015 bash[29377]: cluster 2021-03-10T15:10:18.461556+0000 mgr.gibba045.orlgmj (mgr.34412) 4326 : cluster [DBG] pgmap v2456: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:19.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:10:19 gibba015 bash[30343]: cluster 2021-03-10T15:10:18.461556+0000 mgr.gibba045.orlgmj (mgr.34412) 4326 : cluster [DBG] pgmap v2456: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:21.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:10:21 gibba045 bash[25517]: cluster 2021-03-10T15:10:20.463243+0000 mgr.gibba045.orlgmj (mgr.34412) 4327 : cluster [DBG] pgmap v2457: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:21.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:10:21 gibba015 bash[29377]: cluster 2021-03-10T15:10:20.463243+0000 mgr.gibba045.orlgmj (mgr.34412) 4327 : cluster [DBG] pgmap v2457: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:21.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:10:21 gibba015 bash[30343]: cluster 2021-03-10T15:10:20.463243+0000 mgr.gibba045.orlgmj (mgr.34412) 4327 : cluster [DBG] pgmap v2457: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:22.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:10:22 gibba015 bash[29377]: cephadm 2021-03-10T15:10:20.973990+0000 mgr.gibba045.orlgmj (mgr.34412) 4328 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:10:22.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:10:22 gibba015 bash[30343]: cephadm 2021-03-10T15:10:20.973990+0000 mgr.gibba045.orlgmj (mgr.34412) 4328 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:10:23.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:10:22 gibba045 bash[25517]: cephadm 2021-03-10T15:10:20.973990+0000 mgr.gibba045.orlgmj (mgr.34412) 4328 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:10:23.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:10:23 gibba015 bash[29377]: cluster 2021-03-10T15:10:22.464989+0000 mgr.gibba045.orlgmj (mgr.34412) 4329 : cluster [DBG] pgmap v2458: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:23.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:10:23 gibba015 bash[30343]: cluster 2021-03-10T15:10:22.464989+0000 mgr.gibba045.orlgmj (mgr.34412) 4329 : cluster [DBG] pgmap v2458: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:24.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:10:23 gibba045 bash[25517]: cluster 2021-03-10T15:10:22.464989+0000 mgr.gibba045.orlgmj (mgr.34412) 4329 : cluster [DBG] pgmap v2458: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:25.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:10:24 gibba045 bash[25517]: cluster 2021-03-10T15:10:24.466597+0000 mgr.gibba045.orlgmj (mgr.34412) 4330 : cluster [DBG] pgmap v2459: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:25.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:10:24 gibba015 bash[29377]: cluster 2021-03-10T15:10:24.466597+0000 mgr.gibba045.orlgmj (mgr.34412) 4330 : cluster [DBG] pgmap v2459: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:25.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:10:24 gibba015 bash[30343]: cluster 2021-03-10T15:10:24.466597+0000 mgr.gibba045.orlgmj (mgr.34412) 4330 : cluster [DBG] pgmap v2459: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:27.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:10:27 gibba045 bash[25517]: cluster 2021-03-10T15:10:26.468226+0000 mgr.gibba045.orlgmj (mgr.34412) 4331 : cluster [DBG] pgmap v2460: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:27.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:10:27 gibba015 bash[29377]: cluster 2021-03-10T15:10:26.468226+0000 mgr.gibba045.orlgmj (mgr.34412) 4331 : cluster [DBG] pgmap v2460: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:27.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:10:27 gibba015 bash[30343]: cluster 2021-03-10T15:10:26.468226+0000 mgr.gibba045.orlgmj (mgr.34412) 4331 : cluster [DBG] pgmap v2460: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:29.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:10:29 gibba045 bash[25517]: cluster 2021-03-10T15:10:28.469540+0000 mgr.gibba045.orlgmj (mgr.34412) 4332 : cluster [DBG] pgmap v2461: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:29.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:10:29 gibba015 bash[29377]: cluster 2021-03-10T15:10:28.469540+0000 mgr.gibba045.orlgmj (mgr.34412) 4332 : cluster [DBG] pgmap v2461: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:29.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:10:29 gibba015 bash[30343]: cluster 2021-03-10T15:10:28.469540+0000 mgr.gibba045.orlgmj (mgr.34412) 4332 : cluster [DBG] pgmap v2461: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:31.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:10:31 gibba045 bash[25517]: cluster 2021-03-10T15:10:30.471223+0000 mgr.gibba045.orlgmj (mgr.34412) 4333 : cluster [DBG] pgmap v2462: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:31.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:10:31 gibba015 bash[29377]: cluster 2021-03-10T15:10:30.471223+0000 mgr.gibba045.orlgmj (mgr.34412) 4333 : cluster [DBG] pgmap v2462: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:31.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:10:31 gibba015 bash[30343]: cluster 2021-03-10T15:10:30.471223+0000 mgr.gibba045.orlgmj (mgr.34412) 4333 : cluster [DBG] pgmap v2462: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:33.660 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:10:33.921 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:10:33.922 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (81m) 6m ago 86m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:10:33.922 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (86m) 4m ago 86m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:10:33.922 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (81m) 4m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:10:33.923 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (82m) 4m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:10:33.923 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (80m) 6m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:10:33.923 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (80m) 6m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:10:33.923 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (80m) 4m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:10:33.923 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (80m) 6m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:10:33.924 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (86m) 6m ago 86m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:10:33.924 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (86m) 4m ago 86m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:10:33.924 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (79m) 6m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:10:33.924 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (79m) 6m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:10:33.925 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (78m) 6m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:10:33.925 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (78m) 6m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:10:33.925 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (77m) 4m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:10:33.925 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (77m) 4m ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:10:33.926 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (77m) 4m ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:10:33.926 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (76m) 4m ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:10:33.926 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (86m) 4m ago 86m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:10:33.926 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 4m ago 84m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:10:33.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:10:33 gibba015 bash[29377]: cluster 2021-03-10T15:10:32.472954+0000 mgr.gibba045.orlgmj (mgr.34412) 4334 : cluster [DBG] pgmap v2463: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:33.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:10:33 gibba015 bash[30343]: cluster 2021-03-10T15:10:32.472954+0000 mgr.gibba045.orlgmj (mgr.34412) 4334 : cluster [DBG] pgmap v2463: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:34.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:10:33 gibba045 bash[25517]: cluster 2021-03-10T15:10:32.472954+0000 mgr.gibba045.orlgmj (mgr.34412) 4334 : cluster [DBG] pgmap v2463: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:34.172 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:10:34.172 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:10:34.172 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:10:34.172 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:10:34.173 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:10:34.173 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:10:34.173 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:10:34.173 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:10:34.174 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:10:34.174 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:10:34.174 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:10:34.174 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:10:34.175 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:10:34.175 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:10:34.175 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:10:35.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:10:34 gibba045 bash[25517]: audit 2021-03-10T15:10:33.650794+0000 mgr.gibba045.orlgmj (mgr.34412) 4335 : audit [DBG] from='client.46968 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:10:35.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:10:34 gibba045 bash[25517]: audit 2021-03-10T15:10:33.881796+0000 mgr.gibba045.orlgmj (mgr.34412) 4336 : audit [DBG] from='client.56962 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:10:35.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:10:34 gibba045 bash[25517]: audit 2021-03-10T15:10:34.168245+0000 mon.c (mon.1) 1232 : audit [DBG] from='client.? 172.21.2.115:0/459985241' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:10:35.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:10:34 gibba045 bash[25517]: cluster 2021-03-10T15:10:34.474257+0000 mgr.gibba045.orlgmj (mgr.34412) 4337 : cluster [DBG] pgmap v2464: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:35.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:10:34 gibba015 bash[29377]: audit 2021-03-10T15:10:33.650794+0000 mgr.gibba045.orlgmj (mgr.34412) 4335 : audit [DBG] from='client.46968 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:10:35.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:10:34 gibba015 bash[29377]: audit 2021-03-10T15:10:33.881796+0000 mgr.gibba045.orlgmj (mgr.34412) 4336 : audit [DBG] from='client.56962 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:10:35.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:10:34 gibba015 bash[29377]: audit 2021-03-10T15:10:34.168245+0000 mon.c (mon.1) 1232 : audit [DBG] from='client.? 172.21.2.115:0/459985241' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:10:35.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:10:34 gibba015 bash[29377]: cluster 2021-03-10T15:10:34.474257+0000 mgr.gibba045.orlgmj (mgr.34412) 4337 : cluster [DBG] pgmap v2464: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:35.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:10:34 gibba015 bash[30343]: audit 2021-03-10T15:10:33.650794+0000 mgr.gibba045.orlgmj (mgr.34412) 4335 : audit [DBG] from='client.46968 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:10:35.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:10:34 gibba015 bash[30343]: audit 2021-03-10T15:10:33.881796+0000 mgr.gibba045.orlgmj (mgr.34412) 4336 : audit [DBG] from='client.56962 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:10:35.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:10:34 gibba015 bash[30343]: audit 2021-03-10T15:10:34.168245+0000 mon.c (mon.1) 1232 : audit [DBG] from='client.? 172.21.2.115:0/459985241' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:10:35.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:10:34 gibba015 bash[30343]: cluster 2021-03-10T15:10:34.474257+0000 mgr.gibba045.orlgmj (mgr.34412) 4337 : cluster [DBG] pgmap v2464: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:36.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:10:36 gibba045 bash[25517]: audit 2021-03-10T15:10:35.987229+0000 mon.c (mon.1) 1233 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:10:36.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:10:36 gibba015 bash[29377]: audit 2021-03-10T15:10:35.987229+0000 mon.c (mon.1) 1233 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:10:36.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:10:36 gibba015 bash[30343]: audit 2021-03-10T15:10:35.987229+0000 mon.c (mon.1) 1233 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:10:37.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:10:37 gibba045 bash[25517]: cephadm 2021-03-10T15:10:35.995946+0000 mgr.gibba045.orlgmj (mgr.34412) 4338 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:10:37.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:10:37 gibba045 bash[25517]: cephadm 2021-03-10T15:10:35.997772+0000 mgr.gibba045.orlgmj (mgr.34412) 4339 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:10:37.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:10:37 gibba045 bash[25517]: audit 2021-03-10T15:10:36.229306+0000 mon.a (mon.0) 1230 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:10:37.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:10:37 gibba045 bash[25517]: audit 2021-03-10T15:10:36.233453+0000 mon.c (mon.1) 1234 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:10:37.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:10:37 gibba045 bash[25517]: audit 2021-03-10T15:10:36.234801+0000 mon.c (mon.1) 1235 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:10:37.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:10:37 gibba045 bash[25517]: audit 2021-03-10T15:10:36.236202+0000 mon.c (mon.1) 1236 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:10:37.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:10:37 gibba045 bash[25517]: cephadm 2021-03-10T15:10:36.236205+0000 mgr.gibba045.orlgmj (mgr.34412) 4340 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:10:37.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:10:37 gibba045 bash[25517]: audit 2021-03-10T15:10:36.237698+0000 mon.c (mon.1) 1237 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:10:37.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:10:37 gibba045 bash[25517]: cephadm 2021-03-10T15:10:36.237956+0000 mgr.gibba045.orlgmj (mgr.34412) 4341 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:10:37.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:10:37 gibba045 bash[25517]: cephadm 2021-03-10T15:10:36.239481+0000 mgr.gibba045.orlgmj (mgr.34412) 4342 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:10:37.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:10:37 gibba045 bash[25517]: cephadm 2021-03-10T15:10:36.239523+0000 mgr.gibba045.orlgmj (mgr.34412) 4343 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:10:37.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:10:37 gibba045 bash[25517]: audit 2021-03-10T15:10:36.240784+0000 mon.c (mon.1) 1238 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:10:37.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:10:37 gibba045 bash[25517]: cephadm 2021-03-10T15:10:36.240858+0000 mgr.gibba045.orlgmj (mgr.34412) 4344 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:10:37.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:10:37 gibba045 bash[25517]: cephadm 2021-03-10T15:10:36.240905+0000 mgr.gibba045.orlgmj (mgr.34412) 4345 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:10:37.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:10:37 gibba045 bash[25517]: cephadm 2021-03-10T15:10:36.242104+0000 mgr.gibba045.orlgmj (mgr.34412) 4346 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:10:37.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:10:37 gibba045 bash[25517]: audit 2021-03-10T15:10:36.242649+0000 mon.c (mon.1) 1239 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:10:37.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:10:37 gibba045 bash[25517]: cephadm 2021-03-10T15:10:36.243805+0000 mgr.gibba045.orlgmj (mgr.34412) 4347 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:10:37.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:10:37 gibba045 bash[25517]: cephadm 2021-03-10T15:10:36.243850+0000 mgr.gibba045.orlgmj (mgr.34412) 4348 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:10:37.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:10:37 gibba045 bash[25517]: cephadm 2021-03-10T15:10:36.245460+0000 mgr.gibba045.orlgmj (mgr.34412) 4349 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:10:37.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:10:37 gibba045 bash[25517]: cephadm 2021-03-10T15:10:36.245982+0000 mgr.gibba045.orlgmj (mgr.34412) 4350 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:10:37.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:10:37 gibba045 bash[25517]: cephadm 2021-03-10T15:10:36.247356+0000 mgr.gibba045.orlgmj (mgr.34412) 4351 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:10:37.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:10:37 gibba045 bash[25517]: cephadm 2021-03-10T15:10:36.247408+0000 mgr.gibba045.orlgmj (mgr.34412) 4352 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:10:37.563 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:10:37 gibba045 bash[25517]: cephadm 2021-03-10T15:10:36.247555+0000 mgr.gibba045.orlgmj (mgr.34412) 4353 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:10:37.563 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:10:37 gibba045 bash[25517]: cluster 2021-03-10T15:10:36.476188+0000 mgr.gibba045.orlgmj (mgr.34412) 4354 : cluster [DBG] pgmap v2465: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:37.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:10:37 gibba015 bash[29377]: cephadm 2021-03-10T15:10:35.995946+0000 mgr.gibba045.orlgmj (mgr.34412) 4338 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:10:37.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:10:37 gibba015 bash[29377]: cephadm 2021-03-10T15:10:35.997772+0000 mgr.gibba045.orlgmj (mgr.34412) 4339 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:10:37.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:10:37 gibba015 bash[29377]: audit 2021-03-10T15:10:36.229306+0000 mon.a (mon.0) 1230 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:10:37.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:10:37 gibba015 bash[29377]: audit 2021-03-10T15:10:36.233453+0000 mon.c (mon.1) 1234 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:10:37.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:10:37 gibba015 bash[29377]: audit 2021-03-10T15:10:36.234801+0000 mon.c (mon.1) 1235 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:10:37.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:10:37 gibba015 bash[29377]: audit 2021-03-10T15:10:36.236202+0000 mon.c (mon.1) 1236 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:10:37.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:10:37 gibba015 bash[29377]: cephadm 2021-03-10T15:10:36.236205+0000 mgr.gibba045.orlgmj (mgr.34412) 4340 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:10:37.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:10:37 gibba015 bash[29377]: audit 2021-03-10T15:10:36.237698+0000 mon.c (mon.1) 1237 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:10:37.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:10:37 gibba015 bash[29377]: cephadm 2021-03-10T15:10:36.237956+0000 mgr.gibba045.orlgmj (mgr.34412) 4341 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:10:37.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:10:37 gibba015 bash[29377]: cephadm 2021-03-10T15:10:36.239481+0000 mgr.gibba045.orlgmj (mgr.34412) 4342 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:10:37.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:10:37 gibba015 bash[29377]: cephadm 2021-03-10T15:10:36.239523+0000 mgr.gibba045.orlgmj (mgr.34412) 4343 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:10:37.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:10:37 gibba015 bash[29377]: audit 2021-03-10T15:10:36.240784+0000 mon.c (mon.1) 1238 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:10:37.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:10:37 gibba015 bash[29377]: cephadm 2021-03-10T15:10:36.240858+0000 mgr.gibba045.orlgmj (mgr.34412) 4344 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:10:37.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:10:37 gibba015 bash[29377]: cephadm 2021-03-10T15:10:36.240905+0000 mgr.gibba045.orlgmj (mgr.34412) 4345 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:10:37.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:10:37 gibba015 bash[29377]: cephadm 2021-03-10T15:10:36.242104+0000 mgr.gibba045.orlgmj (mgr.34412) 4346 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:10:37.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:10:37 gibba015 bash[29377]: audit 2021-03-10T15:10:36.242649+0000 mon.c (mon.1) 1239 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:10:37.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:10:37 gibba015 bash[29377]: cephadm 2021-03-10T15:10:36.243805+0000 mgr.gibba045.orlgmj (mgr.34412) 4347 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:10:37.729 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:10:37 gibba015 bash[29377]: cephadm 2021-03-10T15:10:36.243850+0000 mgr.gibba045.orlgmj (mgr.34412) 4348 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:10:37.729 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:10:37 gibba015 bash[29377]: cephadm 2021-03-10T15:10:36.245460+0000 mgr.gibba045.orlgmj (mgr.34412) 4349 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:10:37.729 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:10:37 gibba015 bash[29377]: cephadm 2021-03-10T15:10:36.245982+0000 mgr.gibba045.orlgmj (mgr.34412) 4350 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:10:37.729 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:10:37 gibba015 bash[29377]: cephadm 2021-03-10T15:10:36.247356+0000 mgr.gibba045.orlgmj (mgr.34412) 4351 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:10:37.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:10:37 gibba015 bash[30343]: cephadm 2021-03-10T15:10:35.995946+0000 mgr.gibba045.orlgmj (mgr.34412) 4338 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:10:37.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:10:37 gibba015 bash[30343]: cephadm 2021-03-10T15:10:35.997772+0000 mgr.gibba045.orlgmj (mgr.34412) 4339 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:10:37.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:10:37 gibba015 bash[30343]: audit 2021-03-10T15:10:36.229306+0000 mon.a (mon.0) 1230 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:10:37.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:10:37 gibba015 bash[30343]: audit 2021-03-10T15:10:36.233453+0000 mon.c (mon.1) 1234 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:10:37.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:10:37 gibba015 bash[30343]: audit 2021-03-10T15:10:36.234801+0000 mon.c (mon.1) 1235 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:10:37.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:10:37 gibba015 bash[30343]: audit 2021-03-10T15:10:36.236202+0000 mon.c (mon.1) 1236 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:10:37.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:10:37 gibba015 bash[30343]: cephadm 2021-03-10T15:10:36.236205+0000 mgr.gibba045.orlgmj (mgr.34412) 4340 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:10:37.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:10:37 gibba015 bash[30343]: audit 2021-03-10T15:10:36.237698+0000 mon.c (mon.1) 1237 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:10:37.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:10:37 gibba015 bash[30343]: cephadm 2021-03-10T15:10:36.237956+0000 mgr.gibba045.orlgmj (mgr.34412) 4341 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:10:37.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:10:37 gibba015 bash[30343]: cephadm 2021-03-10T15:10:36.239481+0000 mgr.gibba045.orlgmj (mgr.34412) 4342 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:10:37.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:10:37 gibba015 bash[30343]: cephadm 2021-03-10T15:10:36.239523+0000 mgr.gibba045.orlgmj (mgr.34412) 4343 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:10:37.733 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:10:37 gibba015 bash[30343]: audit 2021-03-10T15:10:36.240784+0000 mon.c (mon.1) 1238 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:10:37.733 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:10:37 gibba015 bash[30343]: cephadm 2021-03-10T15:10:36.240858+0000 mgr.gibba045.orlgmj (mgr.34412) 4344 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:10:37.733 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:10:37 gibba015 bash[30343]: cephadm 2021-03-10T15:10:36.240905+0000 mgr.gibba045.orlgmj (mgr.34412) 4345 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:10:37.733 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:10:37 gibba015 bash[30343]: cephadm 2021-03-10T15:10:36.242104+0000 mgr.gibba045.orlgmj (mgr.34412) 4346 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:10:37.734 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:10:37 gibba015 bash[30343]: audit 2021-03-10T15:10:36.242649+0000 mon.c (mon.1) 1239 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:10:37.734 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:10:37 gibba015 bash[30343]: cephadm 2021-03-10T15:10:36.243805+0000 mgr.gibba045.orlgmj (mgr.34412) 4347 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:10:37.734 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:10:37 gibba015 bash[30343]: cephadm 2021-03-10T15:10:36.243850+0000 mgr.gibba045.orlgmj (mgr.34412) 4348 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:10:37.734 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:10:37 gibba015 bash[30343]: cephadm 2021-03-10T15:10:36.245460+0000 mgr.gibba045.orlgmj (mgr.34412) 4349 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:10:37.734 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:10:37 gibba015 bash[30343]: cephadm 2021-03-10T15:10:36.245982+0000 mgr.gibba045.orlgmj (mgr.34412) 4350 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:10:37.735 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:10:37 gibba015 bash[30343]: cephadm 2021-03-10T15:10:36.247356+0000 mgr.gibba045.orlgmj (mgr.34412) 4351 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:10:37.735 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:10:37 gibba015 bash[29377]: cephadm 2021-03-10T15:10:36.247408+0000 mgr.gibba045.orlgmj (mgr.34412) 4352 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:10:37.735 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:10:37 gibba015 bash[29377]: cephadm 2021-03-10T15:10:36.247555+0000 mgr.gibba045.orlgmj (mgr.34412) 4353 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:10:37.736 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:10:37 gibba015 bash[29377]: cluster 2021-03-10T15:10:36.476188+0000 mgr.gibba045.orlgmj (mgr.34412) 4354 : cluster [DBG] pgmap v2465: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:37.736 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:10:37 gibba015 bash[30343]: cephadm 2021-03-10T15:10:36.247408+0000 mgr.gibba045.orlgmj (mgr.34412) 4352 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:10:37.736 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:10:37 gibba015 bash[30343]: cephadm 2021-03-10T15:10:36.247555+0000 mgr.gibba045.orlgmj (mgr.34412) 4353 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:10:37.737 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:10:37 gibba015 bash[30343]: cluster 2021-03-10T15:10:36.476188+0000 mgr.gibba045.orlgmj (mgr.34412) 4354 : cluster [DBG] pgmap v2465: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:39.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:10:39 gibba045 bash[25517]: cluster 2021-03-10T15:10:38.477502+0000 mgr.gibba045.orlgmj (mgr.34412) 4355 : cluster [DBG] pgmap v2466: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:39.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:10:39 gibba015 bash[29377]: cluster 2021-03-10T15:10:38.477502+0000 mgr.gibba045.orlgmj (mgr.34412) 4355 : cluster [DBG] pgmap v2466: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:39.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:10:39 gibba015 bash[30343]: cluster 2021-03-10T15:10:38.477502+0000 mgr.gibba045.orlgmj (mgr.34412) 4355 : cluster [DBG] pgmap v2466: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:41.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:10:41 gibba045 bash[25517]: cluster 2021-03-10T15:10:40.479172+0000 mgr.gibba045.orlgmj (mgr.34412) 4356 : cluster [DBG] pgmap v2467: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:41.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:10:41 gibba015 bash[29377]: cluster 2021-03-10T15:10:40.479172+0000 mgr.gibba045.orlgmj (mgr.34412) 4356 : cluster [DBG] pgmap v2467: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:41.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:10:41 gibba015 bash[30343]: cluster 2021-03-10T15:10:40.479172+0000 mgr.gibba045.orlgmj (mgr.34412) 4356 : cluster [DBG] pgmap v2467: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:43.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:10:43 gibba015 bash[29377]: cluster 2021-03-10T15:10:42.480846+0000 mgr.gibba045.orlgmj (mgr.34412) 4357 : cluster [DBG] pgmap v2468: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:43.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:10:43 gibba015 bash[30343]: cluster 2021-03-10T15:10:42.480846+0000 mgr.gibba045.orlgmj (mgr.34412) 4357 : cluster [DBG] pgmap v2468: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:44.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:10:43 gibba045 bash[25517]: cluster 2021-03-10T15:10:42.480846+0000 mgr.gibba045.orlgmj (mgr.34412) 4357 : cluster [DBG] pgmap v2468: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:45.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:10:44 gibba015 bash[29377]: cluster 2021-03-10T15:10:44.482186+0000 mgr.gibba045.orlgmj (mgr.34412) 4358 : cluster [DBG] pgmap v2469: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:45.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:10:44 gibba015 bash[30343]: cluster 2021-03-10T15:10:44.482186+0000 mgr.gibba045.orlgmj (mgr.34412) 4358 : cluster [DBG] pgmap v2469: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:45.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:10:44 gibba045 bash[25517]: cluster 2021-03-10T15:10:44.482186+0000 mgr.gibba045.orlgmj (mgr.34412) 4358 : cluster [DBG] pgmap v2469: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:47.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:10:47 gibba045 bash[25517]: cluster 2021-03-10T15:10:46.483995+0000 mgr.gibba045.orlgmj (mgr.34412) 4359 : cluster [DBG] pgmap v2470: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:47.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:10:47 gibba015 bash[29377]: cluster 2021-03-10T15:10:46.483995+0000 mgr.gibba045.orlgmj (mgr.34412) 4359 : cluster [DBG] pgmap v2470: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:47.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:10:47 gibba015 bash[30343]: cluster 2021-03-10T15:10:46.483995+0000 mgr.gibba045.orlgmj (mgr.34412) 4359 : cluster [DBG] pgmap v2470: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:49.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:10:49 gibba015 bash[29377]: cluster 2021-03-10T15:10:48.485370+0000 mgr.gibba045.orlgmj (mgr.34412) 4360 : cluster [DBG] pgmap v2471: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:49.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:10:49 gibba015 bash[30343]: cluster 2021-03-10T15:10:48.485370+0000 mgr.gibba045.orlgmj (mgr.34412) 4360 : cluster [DBG] pgmap v2471: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:50.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:10:49 gibba045 bash[25517]: cluster 2021-03-10T15:10:48.485370+0000 mgr.gibba045.orlgmj (mgr.34412) 4360 : cluster [DBG] pgmap v2471: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:51.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:10:51 gibba015 bash[29377]: cluster 2021-03-10T15:10:50.486999+0000 mgr.gibba045.orlgmj (mgr.34412) 4361 : cluster [DBG] pgmap v2472: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:51.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:10:51 gibba015 bash[30343]: cluster 2021-03-10T15:10:50.486999+0000 mgr.gibba045.orlgmj (mgr.34412) 4361 : cluster [DBG] pgmap v2472: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:52.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:10:51 gibba045 bash[25517]: cluster 2021-03-10T15:10:50.486999+0000 mgr.gibba045.orlgmj (mgr.34412) 4361 : cluster [DBG] pgmap v2472: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:52.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:10:52 gibba015 bash[29377]: cephadm 2021-03-10T15:10:51.263814+0000 mgr.gibba045.orlgmj (mgr.34412) 4362 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:10:52.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:10:52 gibba015 bash[30343]: cephadm 2021-03-10T15:10:51.263814+0000 mgr.gibba045.orlgmj (mgr.34412) 4362 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:10:53.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:10:52 gibba045 bash[25517]: cephadm 2021-03-10T15:10:51.263814+0000 mgr.gibba045.orlgmj (mgr.34412) 4362 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:10:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:10:53 gibba015 bash[29377]: cluster 2021-03-10T15:10:52.488842+0000 mgr.gibba045.orlgmj (mgr.34412) 4363 : cluster [DBG] pgmap v2473: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:10:53 gibba015 bash[29377]: audit 2021-03-10T15:10:53.018458+0000 mon.c (mon.1) 1240 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:10:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:10:53 gibba015 bash[29377]: audit 2021-03-10T15:10:53.019100+0000 mon.c (mon.1) 1241 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:10:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:10:53 gibba015 bash[29377]: audit 2021-03-10T15:10:53.019568+0000 mon.a (mon.0) 1231 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:10:53.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:10:53 gibba015 bash[29377]: audit 2021-03-10T15:10:53.019712+0000 mon.c (mon.1) 1242 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T15:10:53.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:10:53 gibba015 bash[29377]: audit 2021-03-10T15:10:53.020634+0000 mon.c (mon.1) 1243 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:10:53.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:10:53 gibba015 bash[29377]: audit 2021-03-10T15:10:53.020827+0000 mon.a (mon.0) 1232 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:10:53.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:10:53 gibba015 bash[29377]: audit 2021-03-10T15:10:53.021348+0000 mon.c (mon.1) 1244 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:10:53.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:10:53 gibba015 bash[29377]: audit 2021-03-10T15:10:53.021752+0000 mon.a (mon.0) 1233 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T15:10:53.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:10:53 gibba015 bash[29377]: audit 2021-03-10T15:10:53.022155+0000 mon.c (mon.1) 1245 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:10:53.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:10:53 gibba015 bash[29377]: audit 2021-03-10T15:10:53.022937+0000 mon.a (mon.0) 1234 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:10:53.980 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:10:53 gibba015 bash[29377]: audit 2021-03-10T15:10:53.023901+0000 mon.a (mon.0) 1235 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:10:53.980 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:10:53 gibba015 bash[29377]: audit 2021-03-10T15:10:53.024646+0000 mon.a (mon.0) 1236 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:10:53.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:10:53 gibba015 bash[30343]: cluster 2021-03-10T15:10:52.488842+0000 mgr.gibba045.orlgmj (mgr.34412) 4363 : cluster [DBG] pgmap v2473: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:53.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:10:53 gibba015 bash[30343]: audit 2021-03-10T15:10:53.018458+0000 mon.c (mon.1) 1240 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:10:53.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:10:53 gibba015 bash[30343]: audit 2021-03-10T15:10:53.019100+0000 mon.c (mon.1) 1241 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:10:53.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:10:53 gibba015 bash[30343]: audit 2021-03-10T15:10:53.019568+0000 mon.a (mon.0) 1231 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:10:53.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:10:53 gibba015 bash[30343]: audit 2021-03-10T15:10:53.019712+0000 mon.c (mon.1) 1242 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T15:10:53.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:10:53 gibba015 bash[30343]: audit 2021-03-10T15:10:53.020634+0000 mon.c (mon.1) 1243 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:10:53.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:10:53 gibba015 bash[30343]: audit 2021-03-10T15:10:53.020827+0000 mon.a (mon.0) 1232 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:10:53.984 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:10:53 gibba015 bash[30343]: audit 2021-03-10T15:10:53.021348+0000 mon.c (mon.1) 1244 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:10:53.984 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:10:53 gibba015 bash[30343]: audit 2021-03-10T15:10:53.021752+0000 mon.a (mon.0) 1233 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T15:10:53.985 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:10:53 gibba015 bash[30343]: audit 2021-03-10T15:10:53.022155+0000 mon.c (mon.1) 1245 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:10:53.985 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:10:53 gibba015 bash[30343]: audit 2021-03-10T15:10:53.022937+0000 mon.a (mon.0) 1234 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:10:53.985 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:10:53 gibba015 bash[30343]: audit 2021-03-10T15:10:53.023901+0000 mon.a (mon.0) 1235 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:10:53.986 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:10:53 gibba015 bash[30343]: audit 2021-03-10T15:10:53.024646+0000 mon.a (mon.0) 1236 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:10:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:10:53 gibba045 bash[25517]: cluster 2021-03-10T15:10:52.488842+0000 mgr.gibba045.orlgmj (mgr.34412) 4363 : cluster [DBG] pgmap v2473: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:10:53 gibba045 bash[25517]: audit 2021-03-10T15:10:53.018458+0000 mon.c (mon.1) 1240 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:10:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:10:53 gibba045 bash[25517]: audit 2021-03-10T15:10:53.019100+0000 mon.c (mon.1) 1241 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:10:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:10:53 gibba045 bash[25517]: audit 2021-03-10T15:10:53.019568+0000 mon.a (mon.0) 1231 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:10:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:10:53 gibba045 bash[25517]: audit 2021-03-10T15:10:53.019712+0000 mon.c (mon.1) 1242 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T15:10:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:10:53 gibba045 bash[25517]: audit 2021-03-10T15:10:53.020634+0000 mon.c (mon.1) 1243 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:10:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:10:53 gibba045 bash[25517]: audit 2021-03-10T15:10:53.020827+0000 mon.a (mon.0) 1232 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:10:54.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:10:53 gibba045 bash[25517]: audit 2021-03-10T15:10:53.021348+0000 mon.c (mon.1) 1244 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:10:54.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:10:53 gibba045 bash[25517]: audit 2021-03-10T15:10:53.021752+0000 mon.a (mon.0) 1233 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T15:10:54.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:10:53 gibba045 bash[25517]: audit 2021-03-10T15:10:53.022155+0000 mon.c (mon.1) 1245 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:10:54.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:10:53 gibba045 bash[25517]: audit 2021-03-10T15:10:53.022937+0000 mon.a (mon.0) 1234 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:10:54.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:10:53 gibba045 bash[25517]: audit 2021-03-10T15:10:53.023901+0000 mon.a (mon.0) 1235 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:10:54.062 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:10:53 gibba045 bash[25517]: audit 2021-03-10T15:10:53.024646+0000 mon.a (mon.0) 1236 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:10:55.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:10:54 gibba015 bash[29377]: cluster 2021-03-10T15:10:54.490310+0000 mgr.gibba045.orlgmj (mgr.34412) 4364 : cluster [DBG] pgmap v2474: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:55.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:10:54 gibba015 bash[30343]: cluster 2021-03-10T15:10:54.490310+0000 mgr.gibba045.orlgmj (mgr.34412) 4364 : cluster [DBG] pgmap v2474: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:55.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:10:54 gibba045 bash[25517]: cluster 2021-03-10T15:10:54.490310+0000 mgr.gibba045.orlgmj (mgr.34412) 4364 : cluster [DBG] pgmap v2474: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:57.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:10:57 gibba015 bash[29377]: cluster 2021-03-10T15:10:56.491901+0000 mgr.gibba045.orlgmj (mgr.34412) 4365 : cluster [DBG] pgmap v2475: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:57.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:10:57 gibba015 bash[30343]: cluster 2021-03-10T15:10:56.491901+0000 mgr.gibba045.orlgmj (mgr.34412) 4365 : cluster [DBG] pgmap v2475: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:58.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:10:57 gibba045 bash[25517]: cluster 2021-03-10T15:10:56.491901+0000 mgr.gibba045.orlgmj (mgr.34412) 4365 : cluster [DBG] pgmap v2475: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:59.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:10:59 gibba015 bash[29377]: cluster 2021-03-10T15:10:58.493227+0000 mgr.gibba045.orlgmj (mgr.34412) 4366 : cluster [DBG] pgmap v2476: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:59.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:10:59 gibba015 bash[30343]: cluster 2021-03-10T15:10:58.493227+0000 mgr.gibba045.orlgmj (mgr.34412) 4366 : cluster [DBG] pgmap v2476: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:00.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:10:59 gibba045 bash[25517]: cluster 2021-03-10T15:10:58.493227+0000 mgr.gibba045.orlgmj (mgr.34412) 4366 : cluster [DBG] pgmap v2476: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:01.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:11:01 gibba015 bash[29377]: cluster 2021-03-10T15:11:00.494831+0000 mgr.gibba045.orlgmj (mgr.34412) 4367 : cluster [DBG] pgmap v2477: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:01.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:11:01 gibba015 bash[30343]: cluster 2021-03-10T15:11:00.494831+0000 mgr.gibba045.orlgmj (mgr.34412) 4367 : cluster [DBG] pgmap v2477: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:02.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:11:01 gibba045 bash[25517]: cluster 2021-03-10T15:11:00.494831+0000 mgr.gibba045.orlgmj (mgr.34412) 4367 : cluster [DBG] pgmap v2477: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:03.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:11:03 gibba015 bash[29377]: cluster 2021-03-10T15:11:02.496593+0000 mgr.gibba045.orlgmj (mgr.34412) 4368 : cluster [DBG] pgmap v2478: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:03.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:11:03 gibba015 bash[30343]: cluster 2021-03-10T15:11:02.496593+0000 mgr.gibba045.orlgmj (mgr.34412) 4368 : cluster [DBG] pgmap v2478: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:04.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:11:03 gibba045 bash[25517]: cluster 2021-03-10T15:11:02.496593+0000 mgr.gibba045.orlgmj (mgr.34412) 4368 : cluster [DBG] pgmap v2478: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:04.414 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:11:04.639 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:11:04.640 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (81m) 6m ago 87m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:11:04.640 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (86m) 5m ago 86m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:11:04.640 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (82m) 5m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:11:04.640 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (82m) 5m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:11:04.641 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (81m) 6m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:11:04.641 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (81m) 6m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:11:04.641 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (80m) 5m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:11:04.641 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (81m) 6m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:11:04.641 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (87m) 6m ago 87m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:11:04.645 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (87m) 5m ago 87m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:11:04.645 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (80m) 6m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:11:04.646 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (79m) 6m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:11:04.646 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (79m) 6m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:11:04.714 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (78m) 6m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:11:04.715 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (78m) 5m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:11:04.715 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (77m) 5m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:11:04.715 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (77m) 5m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:11:04.715 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (77m) 5m ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:11:04.716 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (86m) 5m ago 87m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:11:04.716 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 5m ago 85m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:11:04.894 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:11:04.895 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:11:04.895 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:11:04.895 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:11:04.895 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:11:04.896 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:11:04.896 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:11:04.896 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:11:04.896 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:11:04.897 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:11:04.897 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:11:04.897 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:11:04.897 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:11:04.897 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:11:04.898 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:11:05.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:11:04 gibba015 bash[29377]: audit 2021-03-10T15:11:04.404989+0000 mgr.gibba045.orlgmj (mgr.34412) 4369 : audit [DBG] from='client.56974 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:11:05.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:11:04 gibba015 bash[29377]: cluster 2021-03-10T15:11:04.498020+0000 mgr.gibba045.orlgmj (mgr.34412) 4370 : cluster [DBG] pgmap v2479: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:05.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:11:04 gibba015 bash[29377]: audit 2021-03-10T15:11:04.631022+0000 mgr.gibba045.orlgmj (mgr.34412) 4371 : audit [DBG] from='client.46992 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:11:05.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:11:04 gibba015 bash[30343]: audit 2021-03-10T15:11:04.404989+0000 mgr.gibba045.orlgmj (mgr.34412) 4369 : audit [DBG] from='client.56974 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:11:05.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:11:04 gibba015 bash[30343]: cluster 2021-03-10T15:11:04.498020+0000 mgr.gibba045.orlgmj (mgr.34412) 4370 : cluster [DBG] pgmap v2479: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:05.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:11:04 gibba015 bash[30343]: audit 2021-03-10T15:11:04.631022+0000 mgr.gibba045.orlgmj (mgr.34412) 4371 : audit [DBG] from='client.46992 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:11:05.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:11:04 gibba045 bash[25517]: audit 2021-03-10T15:11:04.404989+0000 mgr.gibba045.orlgmj (mgr.34412) 4369 : audit [DBG] from='client.56974 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:11:05.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:11:04 gibba045 bash[25517]: cluster 2021-03-10T15:11:04.498020+0000 mgr.gibba045.orlgmj (mgr.34412) 4370 : cluster [DBG] pgmap v2479: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:05.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:11:04 gibba045 bash[25517]: audit 2021-03-10T15:11:04.631022+0000 mgr.gibba045.orlgmj (mgr.34412) 4371 : audit [DBG] from='client.46992 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:11:06.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:11:05 gibba015 bash[29377]: audit 2021-03-10T15:11:04.890907+0000 mon.a (mon.0) 1237 : audit [DBG] from='client.? 172.21.2.115:0/1306730816' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:11:06.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:11:05 gibba015 bash[30343]: audit 2021-03-10T15:11:04.890907+0000 mon.a (mon.0) 1237 : audit [DBG] from='client.? 172.21.2.115:0/1306730816' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:11:06.280 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:11:05 gibba045 bash[25517]: audit 2021-03-10T15:11:04.890907+0000 mon.a (mon.0) 1237 : audit [DBG] from='client.? 172.21.2.115:0/1306730816' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:11:07.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:11:06 gibba015 bash[29377]: cephadm 2021-03-10T15:11:06.279779+0000 mgr.gibba045.orlgmj (mgr.34412) 4372 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:11:07.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:11:06 gibba015 bash[29377]: cluster 2021-03-10T15:11:06.499974+0000 mgr.gibba045.orlgmj (mgr.34412) 4373 : cluster [DBG] pgmap v2480: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:07.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:11:06 gibba015 bash[30343]: cephadm 2021-03-10T15:11:06.279779+0000 mgr.gibba045.orlgmj (mgr.34412) 4372 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:11:07.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:11:06 gibba015 bash[30343]: cluster 2021-03-10T15:11:06.499974+0000 mgr.gibba045.orlgmj (mgr.34412) 4373 : cluster [DBG] pgmap v2480: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:07.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:11:06 gibba045 bash[25517]: cephadm 2021-03-10T15:11:06.279779+0000 mgr.gibba045.orlgmj (mgr.34412) 4372 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:11:07.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:11:06 gibba045 bash[25517]: cluster 2021-03-10T15:11:06.499974+0000 mgr.gibba045.orlgmj (mgr.34412) 4373 : cluster [DBG] pgmap v2480: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:09.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:11:09 gibba015 bash[29377]: cluster 2021-03-10T15:11:08.501076+0000 mgr.gibba045.orlgmj (mgr.34412) 4374 : cluster [DBG] pgmap v2481: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:09.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:11:09 gibba015 bash[30343]: cluster 2021-03-10T15:11:08.501076+0000 mgr.gibba045.orlgmj (mgr.34412) 4374 : cluster [DBG] pgmap v2481: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:10.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:11:09 gibba045 bash[25517]: cluster 2021-03-10T15:11:08.501076+0000 mgr.gibba045.orlgmj (mgr.34412) 4374 : cluster [DBG] pgmap v2481: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:11.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:11:11 gibba015 bash[29377]: cluster 2021-03-10T15:11:10.502673+0000 mgr.gibba045.orlgmj (mgr.34412) 4375 : cluster [DBG] pgmap v2482: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:11.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:11:11 gibba015 bash[30343]: cluster 2021-03-10T15:11:10.502673+0000 mgr.gibba045.orlgmj (mgr.34412) 4375 : cluster [DBG] pgmap v2482: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:12.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:11:11 gibba045 bash[25517]: cluster 2021-03-10T15:11:10.502673+0000 mgr.gibba045.orlgmj (mgr.34412) 4375 : cluster [DBG] pgmap v2482: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:13.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:11:13 gibba015 bash[29377]: cluster 2021-03-10T15:11:12.504404+0000 mgr.gibba045.orlgmj (mgr.34412) 4376 : cluster [DBG] pgmap v2483: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:13.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:11:13 gibba015 bash[30343]: cluster 2021-03-10T15:11:12.504404+0000 mgr.gibba045.orlgmj (mgr.34412) 4376 : cluster [DBG] pgmap v2483: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:14.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:11:13 gibba045 bash[25517]: cluster 2021-03-10T15:11:12.504404+0000 mgr.gibba045.orlgmj (mgr.34412) 4376 : cluster [DBG] pgmap v2483: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:15.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:11:14 gibba015 bash[29377]: cluster 2021-03-10T15:11:14.505756+0000 mgr.gibba045.orlgmj (mgr.34412) 4377 : cluster [DBG] pgmap v2484: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:15.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:11:14 gibba015 bash[30343]: cluster 2021-03-10T15:11:14.505756+0000 mgr.gibba045.orlgmj (mgr.34412) 4377 : cluster [DBG] pgmap v2484: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:15.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:11:14 gibba045 bash[25517]: cluster 2021-03-10T15:11:14.505756+0000 mgr.gibba045.orlgmj (mgr.34412) 4377 : cluster [DBG] pgmap v2484: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:17.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:11:17 gibba015 bash[29377]: cluster 2021-03-10T15:11:16.507478+0000 mgr.gibba045.orlgmj (mgr.34412) 4378 : cluster [DBG] pgmap v2485: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:17.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:11:17 gibba015 bash[30343]: cluster 2021-03-10T15:11:16.507478+0000 mgr.gibba045.orlgmj (mgr.34412) 4378 : cluster [DBG] pgmap v2485: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:18.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:11:17 gibba045 bash[25517]: cluster 2021-03-10T15:11:16.507478+0000 mgr.gibba045.orlgmj (mgr.34412) 4378 : cluster [DBG] pgmap v2485: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:19.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:11:19 gibba015 bash[29377]: cluster 2021-03-10T15:11:18.508827+0000 mgr.gibba045.orlgmj (mgr.34412) 4379 : cluster [DBG] pgmap v2486: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:19.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:11:19 gibba015 bash[30343]: cluster 2021-03-10T15:11:18.508827+0000 mgr.gibba045.orlgmj (mgr.34412) 4379 : cluster [DBG] pgmap v2486: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:20.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:11:19 gibba045 bash[25517]: cluster 2021-03-10T15:11:18.508827+0000 mgr.gibba045.orlgmj (mgr.34412) 4379 : cluster [DBG] pgmap v2486: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:21.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:11:21 gibba015 bash[29377]: cluster 2021-03-10T15:11:20.510629+0000 mgr.gibba045.orlgmj (mgr.34412) 4380 : cluster [DBG] pgmap v2487: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:21.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:11:21 gibba015 bash[30343]: cluster 2021-03-10T15:11:20.510629+0000 mgr.gibba045.orlgmj (mgr.34412) 4380 : cluster [DBG] pgmap v2487: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:22.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:11:21 gibba045 bash[25517]: cluster 2021-03-10T15:11:20.510629+0000 mgr.gibba045.orlgmj (mgr.34412) 4380 : cluster [DBG] pgmap v2487: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:22.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:11:22 gibba015 bash[29377]: cephadm 2021-03-10T15:11:21.295813+0000 mgr.gibba045.orlgmj (mgr.34412) 4381 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:11:22.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:11:22 gibba015 bash[30343]: cephadm 2021-03-10T15:11:21.295813+0000 mgr.gibba045.orlgmj (mgr.34412) 4381 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:11:23.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:11:22 gibba045 bash[25517]: cephadm 2021-03-10T15:11:21.295813+0000 mgr.gibba045.orlgmj (mgr.34412) 4381 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:11:23.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:11:23 gibba015 bash[29377]: cluster 2021-03-10T15:11:22.512559+0000 mgr.gibba045.orlgmj (mgr.34412) 4382 : cluster [DBG] pgmap v2488: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:23.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:11:23 gibba015 bash[30343]: cluster 2021-03-10T15:11:22.512559+0000 mgr.gibba045.orlgmj (mgr.34412) 4382 : cluster [DBG] pgmap v2488: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:24.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:11:23 gibba045 bash[25517]: cluster 2021-03-10T15:11:22.512559+0000 mgr.gibba045.orlgmj (mgr.34412) 4382 : cluster [DBG] pgmap v2488: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:25.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:11:24 gibba015 bash[29377]: cluster 2021-03-10T15:11:24.513893+0000 mgr.gibba045.orlgmj (mgr.34412) 4383 : cluster [DBG] pgmap v2489: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:25.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:11:24 gibba015 bash[30343]: cluster 2021-03-10T15:11:24.513893+0000 mgr.gibba045.orlgmj (mgr.34412) 4383 : cluster [DBG] pgmap v2489: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:25.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:11:24 gibba045 bash[25517]: cluster 2021-03-10T15:11:24.513893+0000 mgr.gibba045.orlgmj (mgr.34412) 4383 : cluster [DBG] pgmap v2489: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:27.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:11:27 gibba015 bash[29377]: cluster 2021-03-10T15:11:26.515768+0000 mgr.gibba045.orlgmj (mgr.34412) 4384 : cluster [DBG] pgmap v2490: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:27.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:11:27 gibba015 bash[30343]: cluster 2021-03-10T15:11:26.515768+0000 mgr.gibba045.orlgmj (mgr.34412) 4384 : cluster [DBG] pgmap v2490: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:28.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:11:27 gibba045 bash[25517]: cluster 2021-03-10T15:11:26.515768+0000 mgr.gibba045.orlgmj (mgr.34412) 4384 : cluster [DBG] pgmap v2490: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:29.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:11:29 gibba015 bash[29377]: cluster 2021-03-10T15:11:28.517020+0000 mgr.gibba045.orlgmj (mgr.34412) 4385 : cluster [DBG] pgmap v2491: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:29.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:11:29 gibba015 bash[30343]: cluster 2021-03-10T15:11:28.517020+0000 mgr.gibba045.orlgmj (mgr.34412) 4385 : cluster [DBG] pgmap v2491: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:30.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:11:29 gibba045 bash[25517]: cluster 2021-03-10T15:11:28.517020+0000 mgr.gibba045.orlgmj (mgr.34412) 4385 : cluster [DBG] pgmap v2491: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:31.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:11:31 gibba015 bash[29377]: cluster 2021-03-10T15:11:30.518596+0000 mgr.gibba045.orlgmj (mgr.34412) 4386 : cluster [DBG] pgmap v2492: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:31.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:11:31 gibba015 bash[30343]: cluster 2021-03-10T15:11:30.518596+0000 mgr.gibba045.orlgmj (mgr.34412) 4386 : cluster [DBG] pgmap v2492: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:32.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:11:31 gibba045 bash[25517]: cluster 2021-03-10T15:11:30.518596+0000 mgr.gibba045.orlgmj (mgr.34412) 4386 : cluster [DBG] pgmap v2492: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:33.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:11:33 gibba015 bash[29377]: cluster 2021-03-10T15:11:32.520393+0000 mgr.gibba045.orlgmj (mgr.34412) 4387 : cluster [DBG] pgmap v2493: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:33.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:11:33 gibba015 bash[30343]: cluster 2021-03-10T15:11:32.520393+0000 mgr.gibba045.orlgmj (mgr.34412) 4387 : cluster [DBG] pgmap v2493: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:34.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:11:33 gibba045 bash[25517]: cluster 2021-03-10T15:11:32.520393+0000 mgr.gibba045.orlgmj (mgr.34412) 4387 : cluster [DBG] pgmap v2493: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:35.180 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:11:35.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:11:34 gibba015 bash[29377]: cluster 2021-03-10T15:11:34.521834+0000 mgr.gibba045.orlgmj (mgr.34412) 4388 : cluster [DBG] pgmap v2494: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:35.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:11:34 gibba015 bash[30343]: cluster 2021-03-10T15:11:34.521834+0000 mgr.gibba045.orlgmj (mgr.34412) 4388 : cluster [DBG] pgmap v2494: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:35.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:11:34 gibba045 bash[25517]: cluster 2021-03-10T15:11:34.521834+0000 mgr.gibba045.orlgmj (mgr.34412) 4388 : cluster [DBG] pgmap v2494: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:35.406 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:11:35.407 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (82m) 7m ago 87m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:11:35.407 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (87m) 6m ago 87m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:11:35.407 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (82m) 6m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:11:35.408 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (83m) 6m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:11:35.408 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (81m) 7m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:11:35.408 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (81m) 7m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:11:35.408 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (81m) 6m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:11:35.409 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (81m) 7m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:11:35.409 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (87m) 7m ago 87m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:11:35.409 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (87m) 6m ago 87m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:11:35.409 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (80m) 7m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:11:35.409 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (80m) 7m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:11:35.410 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (79m) 7m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:11:35.410 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (79m) 7m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:11:35.410 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (78m) 6m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:11:35.410 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (78m) 6m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:11:35.411 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (78m) 6m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:11:35.411 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (77m) 6m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:11:35.411 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (87m) 6m ago 87m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:11:35.411 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 6m ago 85m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:11:35.655 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:11:35.656 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:11:35.656 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:11:35.656 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:11:35.657 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:11:35.657 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:11:35.658 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:11:35.658 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:11:35.659 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:11:35.659 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:11:35.659 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:11:35.660 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:11:35.660 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:11:35.661 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:11:35.661 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:11:36.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:11:35 gibba015 bash[29377]: audit 2021-03-10T15:11:35.170215+0000 mgr.gibba045.orlgmj (mgr.34412) 4389 : audit [DBG] from='client.56992 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:11:36.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:11:35 gibba015 bash[29377]: audit 2021-03-10T15:11:35.394095+0000 mgr.gibba045.orlgmj (mgr.34412) 4390 : audit [DBG] from='client.56998 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:11:36.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:11:35 gibba015 bash[29377]: audit 2021-03-10T15:11:35.651015+0000 mon.c (mon.1) 1246 : audit [DBG] from='client.? 172.21.2.115:0/3941923036' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:11:36.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:11:35 gibba015 bash[30343]: audit 2021-03-10T15:11:35.170215+0000 mgr.gibba045.orlgmj (mgr.34412) 4389 : audit [DBG] from='client.56992 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:11:36.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:11:35 gibba015 bash[30343]: audit 2021-03-10T15:11:35.394095+0000 mgr.gibba045.orlgmj (mgr.34412) 4390 : audit [DBG] from='client.56998 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:11:36.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:11:35 gibba015 bash[30343]: audit 2021-03-10T15:11:35.651015+0000 mon.c (mon.1) 1246 : audit [DBG] from='client.? 172.21.2.115:0/3941923036' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:11:36.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:11:35 gibba045 bash[25517]: audit 2021-03-10T15:11:35.170215+0000 mgr.gibba045.orlgmj (mgr.34412) 4389 : audit [DBG] from='client.56992 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:11:36.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:11:35 gibba045 bash[25517]: audit 2021-03-10T15:11:35.394095+0000 mgr.gibba045.orlgmj (mgr.34412) 4390 : audit [DBG] from='client.56998 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:11:36.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:11:35 gibba045 bash[25517]: audit 2021-03-10T15:11:35.651015+0000 mon.c (mon.1) 1246 : audit [DBG] from='client.? 172.21.2.115:0/3941923036' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:11:37.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:11:36 gibba045 bash[25517]: audit 2021-03-10T15:11:36.306604+0000 mon.c (mon.1) 1247 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:11:37.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:11:36 gibba045 bash[25517]: audit 2021-03-10T15:11:36.514706+0000 mon.a (mon.0) 1238 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:11:37.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:11:36 gibba045 bash[25517]: audit 2021-03-10T15:11:36.519050+0000 mon.a (mon.0) 1239 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:11:37.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:11:36 gibba045 bash[25517]: cephadm 2021-03-10T15:11:36.519522+0000 mgr.gibba045.orlgmj (mgr.34412) 4391 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:11:37.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:11:36 gibba045 bash[25517]: cluster 2021-03-10T15:11:36.522418+0000 mgr.gibba045.orlgmj (mgr.34412) 4392 : cluster [DBG] pgmap v2495: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:37.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:11:36 gibba045 bash[25517]: cephadm 2021-03-10T15:11:36.523996+0000 mgr.gibba045.orlgmj (mgr.34412) 4393 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:11:37.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:11:36 gibba045 bash[25517]: audit 2021-03-10T15:11:36.724926+0000 mon.a (mon.0) 1240 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:11:37.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:11:36 gibba045 bash[25517]: audit 2021-03-10T15:11:36.728628+0000 mon.c (mon.1) 1248 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:11:37.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:11:36 gibba045 bash[25517]: audit 2021-03-10T15:11:36.730104+0000 mon.c (mon.1) 1249 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:11:37.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:11:36 gibba045 bash[25517]: audit 2021-03-10T15:11:36.731507+0000 mon.c (mon.1) 1250 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:11:37.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:11:36 gibba045 bash[25517]: audit 2021-03-10T15:11:36.733154+0000 mon.c (mon.1) 1251 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:11:37.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:11:36 gibba045 bash[25517]: audit 2021-03-10T15:11:36.736582+0000 mon.c (mon.1) 1252 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:11:37.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:11:36 gibba045 bash[25517]: audit 2021-03-10T15:11:36.738436+0000 mon.c (mon.1) 1253 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:11:37.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:11:36 gibba015 bash[29377]: audit 2021-03-10T15:11:36.306604+0000 mon.c (mon.1) 1247 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:11:37.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:11:36 gibba015 bash[29377]: audit 2021-03-10T15:11:36.514706+0000 mon.a (mon.0) 1238 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:11:37.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:11:36 gibba015 bash[29377]: audit 2021-03-10T15:11:36.519050+0000 mon.a (mon.0) 1239 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:11:37.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:11:36 gibba015 bash[29377]: cephadm 2021-03-10T15:11:36.519522+0000 mgr.gibba045.orlgmj (mgr.34412) 4391 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:11:37.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:11:36 gibba015 bash[29377]: cluster 2021-03-10T15:11:36.522418+0000 mgr.gibba045.orlgmj (mgr.34412) 4392 : cluster [DBG] pgmap v2495: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:37.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:11:36 gibba015 bash[29377]: cephadm 2021-03-10T15:11:36.523996+0000 mgr.gibba045.orlgmj (mgr.34412) 4393 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:11:37.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:11:36 gibba015 bash[29377]: audit 2021-03-10T15:11:36.724926+0000 mon.a (mon.0) 1240 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:11:37.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:11:36 gibba015 bash[29377]: audit 2021-03-10T15:11:36.728628+0000 mon.c (mon.1) 1248 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:11:37.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:11:36 gibba015 bash[29377]: audit 2021-03-10T15:11:36.730104+0000 mon.c (mon.1) 1249 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:11:37.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:11:36 gibba015 bash[29377]: audit 2021-03-10T15:11:36.731507+0000 mon.c (mon.1) 1250 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:11:37.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:11:36 gibba015 bash[29377]: audit 2021-03-10T15:11:36.733154+0000 mon.c (mon.1) 1251 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:11:37.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:11:36 gibba015 bash[29377]: audit 2021-03-10T15:11:36.736582+0000 mon.c (mon.1) 1252 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:11:37.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:11:36 gibba015 bash[29377]: audit 2021-03-10T15:11:36.738436+0000 mon.c (mon.1) 1253 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:11:37.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:11:36 gibba015 bash[30343]: audit 2021-03-10T15:11:36.306604+0000 mon.c (mon.1) 1247 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:11:37.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:11:36 gibba015 bash[30343]: audit 2021-03-10T15:11:36.514706+0000 mon.a (mon.0) 1238 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:11:37.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:11:36 gibba015 bash[30343]: audit 2021-03-10T15:11:36.519050+0000 mon.a (mon.0) 1239 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:11:37.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:11:36 gibba015 bash[30343]: cephadm 2021-03-10T15:11:36.519522+0000 mgr.gibba045.orlgmj (mgr.34412) 4391 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:11:37.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:11:36 gibba015 bash[30343]: cluster 2021-03-10T15:11:36.522418+0000 mgr.gibba045.orlgmj (mgr.34412) 4392 : cluster [DBG] pgmap v2495: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:37.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:11:36 gibba015 bash[30343]: cephadm 2021-03-10T15:11:36.523996+0000 mgr.gibba045.orlgmj (mgr.34412) 4393 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:11:37.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:11:36 gibba015 bash[30343]: audit 2021-03-10T15:11:36.724926+0000 mon.a (mon.0) 1240 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:11:37.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:11:36 gibba015 bash[30343]: audit 2021-03-10T15:11:36.728628+0000 mon.c (mon.1) 1248 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:11:37.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:11:36 gibba015 bash[30343]: audit 2021-03-10T15:11:36.730104+0000 mon.c (mon.1) 1249 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:11:37.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:11:36 gibba015 bash[30343]: audit 2021-03-10T15:11:36.731507+0000 mon.c (mon.1) 1250 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:11:37.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:11:36 gibba015 bash[30343]: audit 2021-03-10T15:11:36.733154+0000 mon.c (mon.1) 1251 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:11:37.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:11:36 gibba015 bash[30343]: audit 2021-03-10T15:11:36.736582+0000 mon.c (mon.1) 1252 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:11:37.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:11:36 gibba015 bash[30343]: audit 2021-03-10T15:11:36.738436+0000 mon.c (mon.1) 1253 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:11:38.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:11:38 gibba045 bash[25517]: cephadm 2021-03-10T15:11:36.731614+0000 mgr.gibba045.orlgmj (mgr.34412) 4394 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:11:38.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:11:38 gibba045 bash[25517]: cephadm 2021-03-10T15:11:36.733307+0000 mgr.gibba045.orlgmj (mgr.34412) 4395 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:11:38.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:11:38 gibba045 bash[25517]: cephadm 2021-03-10T15:11:36.734814+0000 mgr.gibba045.orlgmj (mgr.34412) 4396 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:11:38.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:11:38 gibba045 bash[25517]: cephadm 2021-03-10T15:11:36.734860+0000 mgr.gibba045.orlgmj (mgr.34412) 4397 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:11:38.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:11:38 gibba045 bash[25517]: cephadm 2021-03-10T15:11:36.736300+0000 mgr.gibba045.orlgmj (mgr.34412) 4398 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:11:38.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:11:38 gibba045 bash[25517]: cephadm 2021-03-10T15:11:36.736349+0000 mgr.gibba045.orlgmj (mgr.34412) 4399 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:11:38.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:11:38 gibba045 bash[25517]: cephadm 2021-03-10T15:11:36.737932+0000 mgr.gibba045.orlgmj (mgr.34412) 4400 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:11:38.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:11:38 gibba045 bash[25517]: cephadm 2021-03-10T15:11:36.739728+0000 mgr.gibba045.orlgmj (mgr.34412) 4401 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:11:38.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:11:38 gibba045 bash[25517]: cephadm 2021-03-10T15:11:36.739774+0000 mgr.gibba045.orlgmj (mgr.34412) 4402 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:11:38.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:11:38 gibba045 bash[25517]: cephadm 2021-03-10T15:11:36.741355+0000 mgr.gibba045.orlgmj (mgr.34412) 4403 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:11:38.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:11:38 gibba045 bash[25517]: cephadm 2021-03-10T15:11:36.741776+0000 mgr.gibba045.orlgmj (mgr.34412) 4404 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:11:38.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:11:38 gibba045 bash[25517]: cephadm 2021-03-10T15:11:36.743264+0000 mgr.gibba045.orlgmj (mgr.34412) 4405 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:11:38.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:11:38 gibba045 bash[25517]: cephadm 2021-03-10T15:11:36.743313+0000 mgr.gibba045.orlgmj (mgr.34412) 4406 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:11:38.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:11:38 gibba045 bash[25517]: cephadm 2021-03-10T15:11:36.743452+0000 mgr.gibba045.orlgmj (mgr.34412) 4407 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:11:38.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:11:38 gibba015 bash[29377]: cephadm 2021-03-10T15:11:36.731614+0000 mgr.gibba045.orlgmj (mgr.34412) 4394 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:11:38.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:11:38 gibba015 bash[29377]: cephadm 2021-03-10T15:11:36.733307+0000 mgr.gibba045.orlgmj (mgr.34412) 4395 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:11:38.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:11:38 gibba015 bash[29377]: cephadm 2021-03-10T15:11:36.734814+0000 mgr.gibba045.orlgmj (mgr.34412) 4396 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:11:38.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:11:38 gibba015 bash[29377]: cephadm 2021-03-10T15:11:36.734860+0000 mgr.gibba045.orlgmj (mgr.34412) 4397 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:11:38.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:11:38 gibba015 bash[29377]: cephadm 2021-03-10T15:11:36.736300+0000 mgr.gibba045.orlgmj (mgr.34412) 4398 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:11:38.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:11:38 gibba015 bash[29377]: cephadm 2021-03-10T15:11:36.736349+0000 mgr.gibba045.orlgmj (mgr.34412) 4399 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:11:38.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:11:38 gibba015 bash[29377]: cephadm 2021-03-10T15:11:36.737932+0000 mgr.gibba045.orlgmj (mgr.34412) 4400 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:11:38.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:11:38 gibba015 bash[29377]: cephadm 2021-03-10T15:11:36.739728+0000 mgr.gibba045.orlgmj (mgr.34412) 4401 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:11:38.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:11:38 gibba015 bash[29377]: cephadm 2021-03-10T15:11:36.739774+0000 mgr.gibba045.orlgmj (mgr.34412) 4402 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:11:38.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:11:38 gibba015 bash[29377]: cephadm 2021-03-10T15:11:36.741355+0000 mgr.gibba045.orlgmj (mgr.34412) 4403 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:11:38.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:11:38 gibba015 bash[29377]: cephadm 2021-03-10T15:11:36.741776+0000 mgr.gibba045.orlgmj (mgr.34412) 4404 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:11:38.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:11:38 gibba015 bash[29377]: cephadm 2021-03-10T15:11:36.743264+0000 mgr.gibba045.orlgmj (mgr.34412) 4405 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:11:38.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:11:38 gibba015 bash[29377]: cephadm 2021-03-10T15:11:36.743313+0000 mgr.gibba045.orlgmj (mgr.34412) 4406 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:11:38.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:11:38 gibba015 bash[29377]: cephadm 2021-03-10T15:11:36.743452+0000 mgr.gibba045.orlgmj (mgr.34412) 4407 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:11:38.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:11:38 gibba015 bash[30343]: cephadm 2021-03-10T15:11:36.731614+0000 mgr.gibba045.orlgmj (mgr.34412) 4394 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:11:38.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:11:38 gibba015 bash[30343]: cephadm 2021-03-10T15:11:36.733307+0000 mgr.gibba045.orlgmj (mgr.34412) 4395 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:11:38.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:11:38 gibba015 bash[30343]: cephadm 2021-03-10T15:11:36.734814+0000 mgr.gibba045.orlgmj (mgr.34412) 4396 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:11:38.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:11:38 gibba015 bash[30343]: cephadm 2021-03-10T15:11:36.734860+0000 mgr.gibba045.orlgmj (mgr.34412) 4397 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:11:38.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:11:38 gibba015 bash[30343]: cephadm 2021-03-10T15:11:36.736300+0000 mgr.gibba045.orlgmj (mgr.34412) 4398 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:11:38.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:11:38 gibba015 bash[30343]: cephadm 2021-03-10T15:11:36.736349+0000 mgr.gibba045.orlgmj (mgr.34412) 4399 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:11:38.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:11:38 gibba015 bash[30343]: cephadm 2021-03-10T15:11:36.737932+0000 mgr.gibba045.orlgmj (mgr.34412) 4400 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:11:38.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:11:38 gibba015 bash[30343]: cephadm 2021-03-10T15:11:36.739728+0000 mgr.gibba045.orlgmj (mgr.34412) 4401 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:11:38.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:11:38 gibba015 bash[30343]: cephadm 2021-03-10T15:11:36.739774+0000 mgr.gibba045.orlgmj (mgr.34412) 4402 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:11:38.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:11:38 gibba015 bash[30343]: cephadm 2021-03-10T15:11:36.741355+0000 mgr.gibba045.orlgmj (mgr.34412) 4403 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:11:38.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:11:38 gibba015 bash[30343]: cephadm 2021-03-10T15:11:36.741776+0000 mgr.gibba045.orlgmj (mgr.34412) 4404 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:11:38.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:11:38 gibba015 bash[30343]: cephadm 2021-03-10T15:11:36.743264+0000 mgr.gibba045.orlgmj (mgr.34412) 4405 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:11:38.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:11:38 gibba015 bash[30343]: cephadm 2021-03-10T15:11:36.743313+0000 mgr.gibba045.orlgmj (mgr.34412) 4406 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:11:38.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:11:38 gibba015 bash[30343]: cephadm 2021-03-10T15:11:36.743452+0000 mgr.gibba045.orlgmj (mgr.34412) 4407 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:11:39.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:11:39 gibba015 bash[29377]: cluster 2021-03-10T15:11:38.523516+0000 mgr.gibba045.orlgmj (mgr.34412) 4408 : cluster [DBG] pgmap v2496: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:39.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:11:39 gibba015 bash[30343]: cluster 2021-03-10T15:11:38.523516+0000 mgr.gibba045.orlgmj (mgr.34412) 4408 : cluster [DBG] pgmap v2496: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:40.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:11:39 gibba045 bash[25517]: cluster 2021-03-10T15:11:38.523516+0000 mgr.gibba045.orlgmj (mgr.34412) 4408 : cluster [DBG] pgmap v2496: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:41.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:11:41 gibba015 bash[29377]: cluster 2021-03-10T15:11:40.525153+0000 mgr.gibba045.orlgmj (mgr.34412) 4409 : cluster [DBG] pgmap v2497: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:41.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:11:41 gibba015 bash[30343]: cluster 2021-03-10T15:11:40.525153+0000 mgr.gibba045.orlgmj (mgr.34412) 4409 : cluster [DBG] pgmap v2497: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:42.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:11:41 gibba045 bash[25517]: cluster 2021-03-10T15:11:40.525153+0000 mgr.gibba045.orlgmj (mgr.34412) 4409 : cluster [DBG] pgmap v2497: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:43.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:11:43 gibba015 bash[29377]: cluster 2021-03-10T15:11:42.526685+0000 mgr.gibba045.orlgmj (mgr.34412) 4410 : cluster [DBG] pgmap v2498: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:43.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:11:43 gibba015 bash[30343]: cluster 2021-03-10T15:11:42.526685+0000 mgr.gibba045.orlgmj (mgr.34412) 4410 : cluster [DBG] pgmap v2498: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:44.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:11:43 gibba045 bash[25517]: cluster 2021-03-10T15:11:42.526685+0000 mgr.gibba045.orlgmj (mgr.34412) 4410 : cluster [DBG] pgmap v2498: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:45.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:11:44 gibba015 bash[29377]: cluster 2021-03-10T15:11:44.528191+0000 mgr.gibba045.orlgmj (mgr.34412) 4411 : cluster [DBG] pgmap v2499: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:45.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:11:44 gibba015 bash[30343]: cluster 2021-03-10T15:11:44.528191+0000 mgr.gibba045.orlgmj (mgr.34412) 4411 : cluster [DBG] pgmap v2499: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:45.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:11:44 gibba045 bash[25517]: cluster 2021-03-10T15:11:44.528191+0000 mgr.gibba045.orlgmj (mgr.34412) 4411 : cluster [DBG] pgmap v2499: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:47.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:11:47 gibba015 bash[29377]: cluster 2021-03-10T15:11:46.530140+0000 mgr.gibba045.orlgmj (mgr.34412) 4412 : cluster [DBG] pgmap v2500: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:47.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:11:47 gibba015 bash[30343]: cluster 2021-03-10T15:11:46.530140+0000 mgr.gibba045.orlgmj (mgr.34412) 4412 : cluster [DBG] pgmap v2500: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:48.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:11:47 gibba045 bash[25517]: cluster 2021-03-10T15:11:46.530140+0000 mgr.gibba045.orlgmj (mgr.34412) 4412 : cluster [DBG] pgmap v2500: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:49.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:11:49 gibba015 bash[29377]: cluster 2021-03-10T15:11:48.531477+0000 mgr.gibba045.orlgmj (mgr.34412) 4413 : cluster [DBG] pgmap v2501: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:49.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:11:49 gibba015 bash[30343]: cluster 2021-03-10T15:11:48.531477+0000 mgr.gibba045.orlgmj (mgr.34412) 4413 : cluster [DBG] pgmap v2501: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:50.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:11:49 gibba045 bash[25517]: cluster 2021-03-10T15:11:48.531477+0000 mgr.gibba045.orlgmj (mgr.34412) 4413 : cluster [DBG] pgmap v2501: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:51.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:11:51 gibba015 bash[29377]: cluster 2021-03-10T15:11:50.532934+0000 mgr.gibba045.orlgmj (mgr.34412) 4414 : cluster [DBG] pgmap v2502: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:51.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:11:51 gibba015 bash[30343]: cluster 2021-03-10T15:11:50.532934+0000 mgr.gibba045.orlgmj (mgr.34412) 4414 : cluster [DBG] pgmap v2502: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:52.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:11:51 gibba045 bash[25517]: cluster 2021-03-10T15:11:50.532934+0000 mgr.gibba045.orlgmj (mgr.34412) 4414 : cluster [DBG] pgmap v2502: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:53.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:11:53 gibba015 bash[29377]: cephadm 2021-03-10T15:11:51.759375+0000 mgr.gibba045.orlgmj (mgr.34412) 4415 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:11:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:11:53 gibba015 bash[29377]: cluster 2021-03-10T15:11:52.534670+0000 mgr.gibba045.orlgmj (mgr.34412) 4416 : cluster [DBG] pgmap v2503: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:11:53 gibba015 bash[29377]: audit 2021-03-10T15:11:53.024286+0000 mon.c (mon.1) 1254 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:11:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:11:53 gibba015 bash[29377]: audit 2021-03-10T15:11:53.024967+0000 mon.c (mon.1) 1255 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:11:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:11:53 gibba015 bash[29377]: audit 2021-03-10T15:11:53.025469+0000 mon.a (mon.0) 1241 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:11:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:11:53 gibba015 bash[29377]: audit 2021-03-10T15:11:53.025815+0000 mon.c (mon.1) 1256 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T15:11:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:11:53 gibba015 bash[29377]: audit 2021-03-10T15:11:53.026622+0000 mon.a (mon.0) 1242 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:11:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:11:53 gibba015 bash[29377]: audit 2021-03-10T15:11:53.026681+0000 mon.c (mon.1) 1257 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:11:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:11:53 gibba015 bash[29377]: audit 2021-03-10T15:11:53.027495+0000 mon.a (mon.0) 1243 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T15:11:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:11:53 gibba015 bash[29377]: audit 2021-03-10T15:11:53.027731+0000 mon.c (mon.1) 1258 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:11:53.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:11:53 gibba015 bash[29377]: audit 2021-03-10T15:11:53.028484+0000 mon.a (mon.0) 1244 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:11:53.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:11:53 gibba015 bash[29377]: audit 2021-03-10T15:11:53.028601+0000 mon.c (mon.1) 1259 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:11:53.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:11:53 gibba015 bash[29377]: audit 2021-03-10T15:11:53.029391+0000 mon.a (mon.0) 1245 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:11:53.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:11:53 gibba015 bash[29377]: audit 2021-03-10T15:11:53.029686+0000 mon.a (mon.0) 1246 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:11:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:11:53 gibba015 bash[30343]: cephadm 2021-03-10T15:11:51.759375+0000 mgr.gibba045.orlgmj (mgr.34412) 4415 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:11:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:11:53 gibba015 bash[30343]: cluster 2021-03-10T15:11:52.534670+0000 mgr.gibba045.orlgmj (mgr.34412) 4416 : cluster [DBG] pgmap v2503: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:11:53 gibba015 bash[30343]: audit 2021-03-10T15:11:53.024286+0000 mon.c (mon.1) 1254 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:11:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:11:53 gibba015 bash[30343]: audit 2021-03-10T15:11:53.024967+0000 mon.c (mon.1) 1255 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:11:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:11:53 gibba015 bash[30343]: audit 2021-03-10T15:11:53.025469+0000 mon.a (mon.0) 1241 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:11:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:11:53 gibba015 bash[30343]: audit 2021-03-10T15:11:53.025815+0000 mon.c (mon.1) 1256 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T15:11:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:11:53 gibba015 bash[30343]: audit 2021-03-10T15:11:53.026622+0000 mon.a (mon.0) 1242 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:11:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:11:53 gibba015 bash[30343]: audit 2021-03-10T15:11:53.026681+0000 mon.c (mon.1) 1257 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:11:53.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:11:53 gibba015 bash[30343]: audit 2021-03-10T15:11:53.027495+0000 mon.a (mon.0) 1243 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T15:11:53.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:11:53 gibba015 bash[30343]: audit 2021-03-10T15:11:53.027731+0000 mon.c (mon.1) 1258 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:11:53.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:11:53 gibba015 bash[30343]: audit 2021-03-10T15:11:53.028484+0000 mon.a (mon.0) 1244 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:11:53.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:11:53 gibba015 bash[30343]: audit 2021-03-10T15:11:53.028601+0000 mon.c (mon.1) 1259 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:11:53.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:11:53 gibba015 bash[30343]: audit 2021-03-10T15:11:53.029391+0000 mon.a (mon.0) 1245 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:11:53.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:11:53 gibba015 bash[30343]: audit 2021-03-10T15:11:53.029686+0000 mon.a (mon.0) 1246 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:11:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:11:53 gibba045 bash[25517]: cephadm 2021-03-10T15:11:51.759375+0000 mgr.gibba045.orlgmj (mgr.34412) 4415 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:11:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:11:53 gibba045 bash[25517]: cluster 2021-03-10T15:11:52.534670+0000 mgr.gibba045.orlgmj (mgr.34412) 4416 : cluster [DBG] pgmap v2503: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:11:53 gibba045 bash[25517]: audit 2021-03-10T15:11:53.024286+0000 mon.c (mon.1) 1254 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:11:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:11:53 gibba045 bash[25517]: audit 2021-03-10T15:11:53.024967+0000 mon.c (mon.1) 1255 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:11:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:11:53 gibba045 bash[25517]: audit 2021-03-10T15:11:53.025469+0000 mon.a (mon.0) 1241 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:11:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:11:53 gibba045 bash[25517]: audit 2021-03-10T15:11:53.025815+0000 mon.c (mon.1) 1256 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T15:11:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:11:53 gibba045 bash[25517]: audit 2021-03-10T15:11:53.026622+0000 mon.a (mon.0) 1242 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:11:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:11:53 gibba045 bash[25517]: audit 2021-03-10T15:11:53.026681+0000 mon.c (mon.1) 1257 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:11:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:11:53 gibba045 bash[25517]: audit 2021-03-10T15:11:53.027495+0000 mon.a (mon.0) 1243 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T15:11:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:11:53 gibba045 bash[25517]: audit 2021-03-10T15:11:53.027731+0000 mon.c (mon.1) 1258 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:11:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:11:53 gibba045 bash[25517]: audit 2021-03-10T15:11:53.028484+0000 mon.a (mon.0) 1244 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:11:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:11:53 gibba045 bash[25517]: audit 2021-03-10T15:11:53.028601+0000 mon.c (mon.1) 1259 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:11:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:11:53 gibba045 bash[25517]: audit 2021-03-10T15:11:53.029391+0000 mon.a (mon.0) 1245 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:11:54.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:11:53 gibba045 bash[25517]: audit 2021-03-10T15:11:53.029686+0000 mon.a (mon.0) 1246 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:11:55.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:11:54 gibba015 bash[29377]: cluster 2021-03-10T15:11:54.536322+0000 mgr.gibba045.orlgmj (mgr.34412) 4417 : cluster [DBG] pgmap v2504: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:55.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:11:54 gibba015 bash[30343]: cluster 2021-03-10T15:11:54.536322+0000 mgr.gibba045.orlgmj (mgr.34412) 4417 : cluster [DBG] pgmap v2504: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:55.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:11:54 gibba045 bash[25517]: cluster 2021-03-10T15:11:54.536322+0000 mgr.gibba045.orlgmj (mgr.34412) 4417 : cluster [DBG] pgmap v2504: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:57.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:11:57 gibba015 bash[29377]: cluster 2021-03-10T15:11:56.538287+0000 mgr.gibba045.orlgmj (mgr.34412) 4418 : cluster [DBG] pgmap v2505: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:57.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:11:57 gibba015 bash[30343]: cluster 2021-03-10T15:11:56.538287+0000 mgr.gibba045.orlgmj (mgr.34412) 4418 : cluster [DBG] pgmap v2505: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:58.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:11:57 gibba045 bash[25517]: cluster 2021-03-10T15:11:56.538287+0000 mgr.gibba045.orlgmj (mgr.34412) 4418 : cluster [DBG] pgmap v2505: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:59.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:11:59 gibba015 bash[29377]: cluster 2021-03-10T15:11:58.539524+0000 mgr.gibba045.orlgmj (mgr.34412) 4419 : cluster [DBG] pgmap v2506: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:59.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:11:59 gibba015 bash[30343]: cluster 2021-03-10T15:11:58.539524+0000 mgr.gibba045.orlgmj (mgr.34412) 4419 : cluster [DBG] pgmap v2506: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:00.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:11:59 gibba045 bash[25517]: cluster 2021-03-10T15:11:58.539524+0000 mgr.gibba045.orlgmj (mgr.34412) 4419 : cluster [DBG] pgmap v2506: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:01.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:12:01 gibba015 bash[29377]: cluster 2021-03-10T15:12:00.541089+0000 mgr.gibba045.orlgmj (mgr.34412) 4420 : cluster [DBG] pgmap v2507: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:01.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:12:01 gibba015 bash[30343]: cluster 2021-03-10T15:12:00.541089+0000 mgr.gibba045.orlgmj (mgr.34412) 4420 : cluster [DBG] pgmap v2507: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:02.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:12:01 gibba045 bash[25517]: cluster 2021-03-10T15:12:00.541089+0000 mgr.gibba045.orlgmj (mgr.34412) 4420 : cluster [DBG] pgmap v2507: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:03.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:12:03 gibba015 bash[29377]: cluster 2021-03-10T15:12:02.542834+0000 mgr.gibba045.orlgmj (mgr.34412) 4421 : cluster [DBG] pgmap v2508: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:03.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:12:03 gibba015 bash[30343]: cluster 2021-03-10T15:12:02.542834+0000 mgr.gibba045.orlgmj (mgr.34412) 4421 : cluster [DBG] pgmap v2508: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:04.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:12:03 gibba045 bash[25517]: cluster 2021-03-10T15:12:02.542834+0000 mgr.gibba045.orlgmj (mgr.34412) 4421 : cluster [DBG] pgmap v2508: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:05.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:12:04 gibba015 bash[29377]: cluster 2021-03-10T15:12:04.544542+0000 mgr.gibba045.orlgmj (mgr.34412) 4422 : cluster [DBG] pgmap v2509: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:05.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:12:04 gibba015 bash[30343]: cluster 2021-03-10T15:12:04.544542+0000 mgr.gibba045.orlgmj (mgr.34412) 4422 : cluster [DBG] pgmap v2509: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:05.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:12:04 gibba045 bash[25517]: cluster 2021-03-10T15:12:04.544542+0000 mgr.gibba045.orlgmj (mgr.34412) 4422 : cluster [DBG] pgmap v2509: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:05.896 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:12:06.125 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:12:06.126 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (82m) 7m ago 88m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:12:06.126 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (87m) 6m ago 87m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:12:06.126 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (83m) 6m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:12:06.126 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (83m) 6m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:12:06.127 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (82m) 7m ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:12:06.127 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (82m) 7m ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:12:06.127 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (81m) 6m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:12:06.127 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (82m) 7m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:12:06.128 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (88m) 7m ago 88m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:12:06.128 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (88m) 6m ago 88m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:12:06.128 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (81m) 7m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:12:06.128 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (80m) 7m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:12:06.128 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (80m) 7m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:12:06.129 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (79m) 7m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:12:06.129 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (79m) 6m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:12:06.129 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (79m) 6m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:12:06.129 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (78m) 6m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:12:06.130 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (78m) 6m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:12:06.130 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (87m) 6m ago 88m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:12:06.130 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 6m ago 86m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:12:06.374 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:12:06.374 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:12:06.375 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:12:06.375 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:12:06.375 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:12:06.376 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:12:06.376 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:12:06.376 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:12:06.376 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:12:06.377 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:12:06.377 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:12:06.377 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:12:06.377 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:12:06.378 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:12:06.378 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:12:06.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:12:06 gibba015 bash[29377]: audit 2021-03-10T15:12:06.370485+0000 mon.c (mon.1) 1260 : audit [DBG] from='client.? 172.21.2.115:0/2423323213' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:12:06.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:12:06 gibba015 bash[30343]: audit 2021-03-10T15:12:06.370485+0000 mon.c (mon.1) 1260 : audit [DBG] from='client.? 172.21.2.115:0/2423323213' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:12:06.761 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:12:06 gibba045 bash[25517]: audit 2021-03-10T15:12:06.370485+0000 mon.c (mon.1) 1260 : audit [DBG] from='client.? 172.21.2.115:0/2423323213' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:12:07.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:12:07 gibba015 bash[29377]: audit 2021-03-10T15:12:05.886675+0000 mgr.gibba045.orlgmj (mgr.34412) 4423 : audit [DBG] from='client.47022 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:12:07.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:12:07 gibba015 bash[29377]: audit 2021-03-10T15:12:06.112871+0000 mgr.gibba045.orlgmj (mgr.34412) 4424 : audit [DBG] from='client.47028 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:12:07.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:12:07 gibba015 bash[29377]: cluster 2021-03-10T15:12:06.546414+0000 mgr.gibba045.orlgmj (mgr.34412) 4425 : cluster [DBG] pgmap v2510: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:07.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:12:07 gibba015 bash[30343]: audit 2021-03-10T15:12:05.886675+0000 mgr.gibba045.orlgmj (mgr.34412) 4423 : audit [DBG] from='client.47022 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:12:07.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:12:07 gibba015 bash[30343]: audit 2021-03-10T15:12:06.112871+0000 mgr.gibba045.orlgmj (mgr.34412) 4424 : audit [DBG] from='client.47028 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:12:07.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:12:07 gibba015 bash[30343]: cluster 2021-03-10T15:12:06.546414+0000 mgr.gibba045.orlgmj (mgr.34412) 4425 : cluster [DBG] pgmap v2510: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:07.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:12:07 gibba045 bash[25517]: audit 2021-03-10T15:12:05.886675+0000 mgr.gibba045.orlgmj (mgr.34412) 4423 : audit [DBG] from='client.47022 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:12:07.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:12:07 gibba045 bash[25517]: audit 2021-03-10T15:12:06.112871+0000 mgr.gibba045.orlgmj (mgr.34412) 4424 : audit [DBG] from='client.47028 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:12:07.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:12:07 gibba045 bash[25517]: cluster 2021-03-10T15:12:06.546414+0000 mgr.gibba045.orlgmj (mgr.34412) 4425 : cluster [DBG] pgmap v2510: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:08.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:12:08 gibba015 bash[29377]: cephadm 2021-03-10T15:12:06.760538+0000 mgr.gibba045.orlgmj (mgr.34412) 4426 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:12:08.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:12:08 gibba015 bash[30343]: cephadm 2021-03-10T15:12:06.760538+0000 mgr.gibba045.orlgmj (mgr.34412) 4426 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:12:08.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:12:08 gibba045 bash[25517]: cephadm 2021-03-10T15:12:06.760538+0000 mgr.gibba045.orlgmj (mgr.34412) 4426 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:12:09.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:12:09 gibba015 bash[29377]: cluster 2021-03-10T15:12:08.547598+0000 mgr.gibba045.orlgmj (mgr.34412) 4427 : cluster [DBG] pgmap v2511: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:09.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:12:09 gibba015 bash[30343]: cluster 2021-03-10T15:12:08.547598+0000 mgr.gibba045.orlgmj (mgr.34412) 4427 : cluster [DBG] pgmap v2511: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:09.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:12:09 gibba045 bash[25517]: cluster 2021-03-10T15:12:08.547598+0000 mgr.gibba045.orlgmj (mgr.34412) 4427 : cluster [DBG] pgmap v2511: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:11.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:12:11 gibba015 bash[29377]: cluster 2021-03-10T15:12:10.549182+0000 mgr.gibba045.orlgmj (mgr.34412) 4428 : cluster [DBG] pgmap v2512: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:11.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:12:11 gibba015 bash[30343]: cluster 2021-03-10T15:12:10.549182+0000 mgr.gibba045.orlgmj (mgr.34412) 4428 : cluster [DBG] pgmap v2512: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:12.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:12:11 gibba045 bash[25517]: cluster 2021-03-10T15:12:10.549182+0000 mgr.gibba045.orlgmj (mgr.34412) 4428 : cluster [DBG] pgmap v2512: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:13.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:12:13 gibba015 bash[29377]: cluster 2021-03-10T15:12:12.550925+0000 mgr.gibba045.orlgmj (mgr.34412) 4429 : cluster [DBG] pgmap v2513: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:13.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:12:13 gibba015 bash[30343]: cluster 2021-03-10T15:12:12.550925+0000 mgr.gibba045.orlgmj (mgr.34412) 4429 : cluster [DBG] pgmap v2513: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:14.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:12:13 gibba045 bash[25517]: cluster 2021-03-10T15:12:12.550925+0000 mgr.gibba045.orlgmj (mgr.34412) 4429 : cluster [DBG] pgmap v2513: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:15.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:12:14 gibba015 bash[29377]: cluster 2021-03-10T15:12:14.552559+0000 mgr.gibba045.orlgmj (mgr.34412) 4430 : cluster [DBG] pgmap v2514: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:15.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:12:14 gibba015 bash[30343]: cluster 2021-03-10T15:12:14.552559+0000 mgr.gibba045.orlgmj (mgr.34412) 4430 : cluster [DBG] pgmap v2514: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:15.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:12:14 gibba045 bash[25517]: cluster 2021-03-10T15:12:14.552559+0000 mgr.gibba045.orlgmj (mgr.34412) 4430 : cluster [DBG] pgmap v2514: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:17.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:12:17 gibba015 bash[29377]: cluster 2021-03-10T15:12:16.554484+0000 mgr.gibba045.orlgmj (mgr.34412) 4431 : cluster [DBG] pgmap v2515: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:17.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:12:17 gibba015 bash[30343]: cluster 2021-03-10T15:12:16.554484+0000 mgr.gibba045.orlgmj (mgr.34412) 4431 : cluster [DBG] pgmap v2515: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:18.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:12:17 gibba045 bash[25517]: cluster 2021-03-10T15:12:16.554484+0000 mgr.gibba045.orlgmj (mgr.34412) 4431 : cluster [DBG] pgmap v2515: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:19.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:12:19 gibba015 bash[29377]: cluster 2021-03-10T15:12:18.555621+0000 mgr.gibba045.orlgmj (mgr.34412) 4432 : cluster [DBG] pgmap v2516: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:19.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:12:19 gibba015 bash[30343]: cluster 2021-03-10T15:12:18.555621+0000 mgr.gibba045.orlgmj (mgr.34412) 4432 : cluster [DBG] pgmap v2516: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:20.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:12:19 gibba045 bash[25517]: cluster 2021-03-10T15:12:18.555621+0000 mgr.gibba045.orlgmj (mgr.34412) 4432 : cluster [DBG] pgmap v2516: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:21.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:12:21 gibba015 bash[29377]: cluster 2021-03-10T15:12:20.557371+0000 mgr.gibba045.orlgmj (mgr.34412) 4433 : cluster [DBG] pgmap v2517: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:21.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:12:21 gibba015 bash[30343]: cluster 2021-03-10T15:12:20.557371+0000 mgr.gibba045.orlgmj (mgr.34412) 4433 : cluster [DBG] pgmap v2517: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:22.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:12:21 gibba045 bash[25517]: cluster 2021-03-10T15:12:20.557371+0000 mgr.gibba045.orlgmj (mgr.34412) 4433 : cluster [DBG] pgmap v2517: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:23.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:12:23 gibba015 bash[29377]: cephadm 2021-03-10T15:12:21.776632+0000 mgr.gibba045.orlgmj (mgr.34412) 4434 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:12:23.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:12:23 gibba015 bash[29377]: cluster 2021-03-10T15:12:22.559109+0000 mgr.gibba045.orlgmj (mgr.34412) 4435 : cluster [DBG] pgmap v2518: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:23.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:12:23 gibba015 bash[30343]: cephadm 2021-03-10T15:12:21.776632+0000 mgr.gibba045.orlgmj (mgr.34412) 4434 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:12:23.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:12:23 gibba015 bash[30343]: cluster 2021-03-10T15:12:22.559109+0000 mgr.gibba045.orlgmj (mgr.34412) 4435 : cluster [DBG] pgmap v2518: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:24.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:12:23 gibba045 bash[25517]: cephadm 2021-03-10T15:12:21.776632+0000 mgr.gibba045.orlgmj (mgr.34412) 4434 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:12:24.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:12:23 gibba045 bash[25517]: cluster 2021-03-10T15:12:22.559109+0000 mgr.gibba045.orlgmj (mgr.34412) 4435 : cluster [DBG] pgmap v2518: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:25.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:12:24 gibba015 bash[29377]: cluster 2021-03-10T15:12:24.560748+0000 mgr.gibba045.orlgmj (mgr.34412) 4436 : cluster [DBG] pgmap v2519: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:25.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:12:24 gibba015 bash[30343]: cluster 2021-03-10T15:12:24.560748+0000 mgr.gibba045.orlgmj (mgr.34412) 4436 : cluster [DBG] pgmap v2519: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:25.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:12:24 gibba045 bash[25517]: cluster 2021-03-10T15:12:24.560748+0000 mgr.gibba045.orlgmj (mgr.34412) 4436 : cluster [DBG] pgmap v2519: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:27.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:12:27 gibba015 bash[29377]: cluster 2021-03-10T15:12:26.562699+0000 mgr.gibba045.orlgmj (mgr.34412) 4437 : cluster [DBG] pgmap v2520: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:27.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:12:27 gibba015 bash[30343]: cluster 2021-03-10T15:12:26.562699+0000 mgr.gibba045.orlgmj (mgr.34412) 4437 : cluster [DBG] pgmap v2520: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:28.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:12:27 gibba045 bash[25517]: cluster 2021-03-10T15:12:26.562699+0000 mgr.gibba045.orlgmj (mgr.34412) 4437 : cluster [DBG] pgmap v2520: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:29.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:12:29 gibba015 bash[29377]: cluster 2021-03-10T15:12:28.564203+0000 mgr.gibba045.orlgmj (mgr.34412) 4438 : cluster [DBG] pgmap v2521: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:29.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:12:29 gibba015 bash[30343]: cluster 2021-03-10T15:12:28.564203+0000 mgr.gibba045.orlgmj (mgr.34412) 4438 : cluster [DBG] pgmap v2521: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:30.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:12:29 gibba045 bash[25517]: cluster 2021-03-10T15:12:28.564203+0000 mgr.gibba045.orlgmj (mgr.34412) 4438 : cluster [DBG] pgmap v2521: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:31.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:12:31 gibba015 bash[29377]: cluster 2021-03-10T15:12:30.566052+0000 mgr.gibba045.orlgmj (mgr.34412) 4439 : cluster [DBG] pgmap v2522: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:31.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:12:31 gibba015 bash[30343]: cluster 2021-03-10T15:12:30.566052+0000 mgr.gibba045.orlgmj (mgr.34412) 4439 : cluster [DBG] pgmap v2522: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:32.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:12:31 gibba045 bash[25517]: cluster 2021-03-10T15:12:30.566052+0000 mgr.gibba045.orlgmj (mgr.34412) 4439 : cluster [DBG] pgmap v2522: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:33.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:12:33 gibba015 bash[29377]: cluster 2021-03-10T15:12:32.567602+0000 mgr.gibba045.orlgmj (mgr.34412) 4440 : cluster [DBG] pgmap v2523: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:33.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:12:33 gibba015 bash[30343]: cluster 2021-03-10T15:12:32.567602+0000 mgr.gibba045.orlgmj (mgr.34412) 4440 : cluster [DBG] pgmap v2523: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:34.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:12:33 gibba045 bash[25517]: cluster 2021-03-10T15:12:32.567602+0000 mgr.gibba045.orlgmj (mgr.34412) 4440 : cluster [DBG] pgmap v2523: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:35.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:12:34 gibba015 bash[29377]: cluster 2021-03-10T15:12:34.569263+0000 mgr.gibba045.orlgmj (mgr.34412) 4441 : cluster [DBG] pgmap v2524: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:35.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:12:34 gibba015 bash[30343]: cluster 2021-03-10T15:12:34.569263+0000 mgr.gibba045.orlgmj (mgr.34412) 4441 : cluster [DBG] pgmap v2524: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:35.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:12:34 gibba045 bash[25517]: cluster 2021-03-10T15:12:34.569263+0000 mgr.gibba045.orlgmj (mgr.34412) 4441 : cluster [DBG] pgmap v2524: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:36.617 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:12:36.840 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:12:36.841 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (83m) 8m ago 88m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:12:36.841 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (88m) 7m ago 88m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:12:36.841 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (83m) 7m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:12:36.842 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (84m) 7m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:12:36.842 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (83m) 8m ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:12:36.842 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (82m) 8m ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:12:36.842 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (82m) 7m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:12:36.843 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (82m) 8m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:12:36.843 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (88m) 8m ago 88m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:12:36.843 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (88m) 7m ago 88m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:12:36.843 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (81m) 8m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:12:36.843 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (81m) 8m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:12:36.844 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (80m) 8m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:12:36.844 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (80m) 8m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:12:36.844 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (79m) 7m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:12:36.844 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (79m) 7m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:12:36.844 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (79m) 7m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:12:36.845 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (78m) 7m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:12:36.845 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (88m) 7m ago 88m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:12:36.845 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 7m ago 86m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:12:37.095 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:12:37.096 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:12:37.096 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:12:37.096 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:12:37.096 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:12:37.096 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:12:37.097 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:12:37.097 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:12:37.097 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:12:37.097 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:12:37.098 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:12:37.098 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:12:37.098 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:12:37.098 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:12:37.099 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:12:37.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:12:37 gibba015 bash[29377]: cluster 2021-03-10T15:12:36.570966+0000 mgr.gibba045.orlgmj (mgr.34412) 4442 : cluster [DBG] pgmap v2525: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:37.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:12:37 gibba015 bash[29377]: audit 2021-03-10T15:12:36.607727+0000 mgr.gibba045.orlgmj (mgr.34412) 4443 : audit [DBG] from='client.57028 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:12:37.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:12:37 gibba015 bash[29377]: audit 2021-03-10T15:12:36.781985+0000 mon.c (mon.1) 1261 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:12:37.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:12:37 gibba015 bash[29377]: audit 2021-03-10T15:12:37.012647+0000 mon.a (mon.0) 1247 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:12:37.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:12:37 gibba015 bash[29377]: audit 2021-03-10T15:12:37.016133+0000 mon.c (mon.1) 1262 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:12:37.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:12:37 gibba015 bash[29377]: audit 2021-03-10T15:12:37.017328+0000 mon.c (mon.1) 1263 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:12:37.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:12:37 gibba015 bash[29377]: audit 2021-03-10T15:12:37.018501+0000 mon.c (mon.1) 1264 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:12:37.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:12:37 gibba015 bash[29377]: audit 2021-03-10T15:12:37.019639+0000 mon.c (mon.1) 1265 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:12:37.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:12:37 gibba015 bash[29377]: audit 2021-03-10T15:12:37.022340+0000 mon.c (mon.1) 1266 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:12:37.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:12:37 gibba015 bash[29377]: audit 2021-03-10T15:12:37.023784+0000 mon.c (mon.1) 1267 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:12:37.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:12:37 gibba015 bash[29377]: audit 2021-03-10T15:12:37.091530+0000 mon.c (mon.1) 1268 : audit [DBG] from='client.? 172.21.2.115:0/1753939261' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:12:37.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:12:37 gibba015 bash[30343]: cluster 2021-03-10T15:12:36.570966+0000 mgr.gibba045.orlgmj (mgr.34412) 4442 : cluster [DBG] pgmap v2525: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:37.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:12:37 gibba015 bash[30343]: audit 2021-03-10T15:12:36.607727+0000 mgr.gibba045.orlgmj (mgr.34412) 4443 : audit [DBG] from='client.57028 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:12:37.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:12:37 gibba015 bash[30343]: audit 2021-03-10T15:12:36.781985+0000 mon.c (mon.1) 1261 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:12:37.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:12:37 gibba015 bash[30343]: audit 2021-03-10T15:12:37.012647+0000 mon.a (mon.0) 1247 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:12:37.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:12:37 gibba015 bash[30343]: audit 2021-03-10T15:12:37.016133+0000 mon.c (mon.1) 1262 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:12:37.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:12:37 gibba015 bash[30343]: audit 2021-03-10T15:12:37.017328+0000 mon.c (mon.1) 1263 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:12:37.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:12:37 gibba015 bash[30343]: audit 2021-03-10T15:12:37.018501+0000 mon.c (mon.1) 1264 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:12:37.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:12:37 gibba015 bash[30343]: audit 2021-03-10T15:12:37.019639+0000 mon.c (mon.1) 1265 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:12:37.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:12:37 gibba015 bash[30343]: audit 2021-03-10T15:12:37.022340+0000 mon.c (mon.1) 1266 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:12:37.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:12:37 gibba015 bash[30343]: audit 2021-03-10T15:12:37.023784+0000 mon.c (mon.1) 1267 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:12:37.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:12:37 gibba015 bash[30343]: audit 2021-03-10T15:12:37.091530+0000 mon.c (mon.1) 1268 : audit [DBG] from='client.? 172.21.2.115:0/1753939261' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:12:38.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:12:37 gibba045 bash[25517]: cluster 2021-03-10T15:12:36.570966+0000 mgr.gibba045.orlgmj (mgr.34412) 4442 : cluster [DBG] pgmap v2525: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:38.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:12:37 gibba045 bash[25517]: audit 2021-03-10T15:12:36.607727+0000 mgr.gibba045.orlgmj (mgr.34412) 4443 : audit [DBG] from='client.57028 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:12:38.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:12:37 gibba045 bash[25517]: audit 2021-03-10T15:12:36.781985+0000 mon.c (mon.1) 1261 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:12:38.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:12:37 gibba045 bash[25517]: audit 2021-03-10T15:12:37.012647+0000 mon.a (mon.0) 1247 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:12:38.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:12:37 gibba045 bash[25517]: audit 2021-03-10T15:12:37.016133+0000 mon.c (mon.1) 1262 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:12:38.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:12:37 gibba045 bash[25517]: audit 2021-03-10T15:12:37.017328+0000 mon.c (mon.1) 1263 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:12:38.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:12:37 gibba045 bash[25517]: audit 2021-03-10T15:12:37.018501+0000 mon.c (mon.1) 1264 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:12:38.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:12:37 gibba045 bash[25517]: audit 2021-03-10T15:12:37.019639+0000 mon.c (mon.1) 1265 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:12:38.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:12:37 gibba045 bash[25517]: audit 2021-03-10T15:12:37.022340+0000 mon.c (mon.1) 1266 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:12:38.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:12:37 gibba045 bash[25517]: audit 2021-03-10T15:12:37.023784+0000 mon.c (mon.1) 1267 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:12:38.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:12:37 gibba045 bash[25517]: audit 2021-03-10T15:12:37.091530+0000 mon.c (mon.1) 1268 : audit [DBG] from='client.? 172.21.2.115:0/1753939261' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:12:38.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:12:38 gibba015 bash[29377]: cephadm 2021-03-10T15:12:36.789762+0000 mgr.gibba045.orlgmj (mgr.34412) 4444 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:12:38.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:12:38 gibba015 bash[29377]: cephadm 2021-03-10T15:12:36.791648+0000 mgr.gibba045.orlgmj (mgr.34412) 4445 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:12:38.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:12:38 gibba015 bash[29377]: audit 2021-03-10T15:12:36.833176+0000 mgr.gibba045.orlgmj (mgr.34412) 4446 : audit [DBG] from='client.47046 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:12:38.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:12:38 gibba015 bash[29377]: cephadm 2021-03-10T15:12:37.019270+0000 mgr.gibba045.orlgmj (mgr.34412) 4447 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:12:38.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:12:38 gibba015 bash[29377]: cephadm 2021-03-10T15:12:37.020811+0000 mgr.gibba045.orlgmj (mgr.34412) 4448 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:12:38.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:12:38 gibba015 bash[29377]: cephadm 2021-03-10T15:12:37.021956+0000 mgr.gibba045.orlgmj (mgr.34412) 4449 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:12:38.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:12:38 gibba015 bash[29377]: cephadm 2021-03-10T15:12:37.021992+0000 mgr.gibba045.orlgmj (mgr.34412) 4450 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:12:38.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:12:38 gibba015 bash[29377]: cephadm 2021-03-10T15:12:37.023161+0000 mgr.gibba045.orlgmj (mgr.34412) 4451 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:12:38.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:12:38 gibba015 bash[29377]: cephadm 2021-03-10T15:12:37.023205+0000 mgr.gibba045.orlgmj (mgr.34412) 4452 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:12:38.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:12:38 gibba015 bash[29377]: cephadm 2021-03-10T15:12:37.024230+0000 mgr.gibba045.orlgmj (mgr.34412) 4453 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:12:38.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:12:38 gibba015 bash[29377]: cephadm 2021-03-10T15:12:37.025709+0000 mgr.gibba045.orlgmj (mgr.34412) 4454 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:12:38.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:12:38 gibba015 bash[29377]: cephadm 2021-03-10T15:12:37.025745+0000 mgr.gibba045.orlgmj (mgr.34412) 4455 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:12:38.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:12:38 gibba015 bash[29377]: cephadm 2021-03-10T15:12:37.026946+0000 mgr.gibba045.orlgmj (mgr.34412) 4456 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:12:38.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:12:38 gibba015 bash[29377]: cephadm 2021-03-10T15:12:37.027259+0000 mgr.gibba045.orlgmj (mgr.34412) 4457 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:12:38.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:12:38 gibba015 bash[29377]: cephadm 2021-03-10T15:12:37.028644+0000 mgr.gibba045.orlgmj (mgr.34412) 4458 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:12:38.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:12:38 gibba015 bash[29377]: cephadm 2021-03-10T15:12:37.028681+0000 mgr.gibba045.orlgmj (mgr.34412) 4459 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:12:38.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:12:38 gibba015 bash[29377]: cephadm 2021-03-10T15:12:37.028841+0000 mgr.gibba045.orlgmj (mgr.34412) 4460 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:12:38.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:12:38 gibba015 bash[30343]: cephadm 2021-03-10T15:12:36.789762+0000 mgr.gibba045.orlgmj (mgr.34412) 4444 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:12:38.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:12:38 gibba015 bash[30343]: cephadm 2021-03-10T15:12:36.791648+0000 mgr.gibba045.orlgmj (mgr.34412) 4445 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:12:38.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:12:38 gibba015 bash[30343]: audit 2021-03-10T15:12:36.833176+0000 mgr.gibba045.orlgmj (mgr.34412) 4446 : audit [DBG] from='client.47046 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:12:38.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:12:38 gibba015 bash[30343]: cephadm 2021-03-10T15:12:37.019270+0000 mgr.gibba045.orlgmj (mgr.34412) 4447 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:12:38.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:12:38 gibba015 bash[30343]: cephadm 2021-03-10T15:12:37.020811+0000 mgr.gibba045.orlgmj (mgr.34412) 4448 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:12:38.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:12:38 gibba015 bash[30343]: cephadm 2021-03-10T15:12:37.021956+0000 mgr.gibba045.orlgmj (mgr.34412) 4449 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:12:38.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:12:38 gibba015 bash[30343]: cephadm 2021-03-10T15:12:37.021992+0000 mgr.gibba045.orlgmj (mgr.34412) 4450 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:12:38.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:12:38 gibba015 bash[30343]: cephadm 2021-03-10T15:12:37.023161+0000 mgr.gibba045.orlgmj (mgr.34412) 4451 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:12:38.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:12:38 gibba015 bash[30343]: cephadm 2021-03-10T15:12:37.023205+0000 mgr.gibba045.orlgmj (mgr.34412) 4452 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:12:38.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:12:38 gibba015 bash[30343]: cephadm 2021-03-10T15:12:37.024230+0000 mgr.gibba045.orlgmj (mgr.34412) 4453 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:12:38.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:12:38 gibba015 bash[30343]: cephadm 2021-03-10T15:12:37.025709+0000 mgr.gibba045.orlgmj (mgr.34412) 4454 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:12:38.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:12:38 gibba015 bash[30343]: cephadm 2021-03-10T15:12:37.025745+0000 mgr.gibba045.orlgmj (mgr.34412) 4455 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:12:38.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:12:38 gibba015 bash[30343]: cephadm 2021-03-10T15:12:37.026946+0000 mgr.gibba045.orlgmj (mgr.34412) 4456 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:12:38.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:12:38 gibba015 bash[30343]: cephadm 2021-03-10T15:12:37.027259+0000 mgr.gibba045.orlgmj (mgr.34412) 4457 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:12:38.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:12:38 gibba015 bash[30343]: cephadm 2021-03-10T15:12:37.028644+0000 mgr.gibba045.orlgmj (mgr.34412) 4458 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:12:38.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:12:38 gibba015 bash[30343]: cephadm 2021-03-10T15:12:37.028681+0000 mgr.gibba045.orlgmj (mgr.34412) 4459 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:12:38.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:12:38 gibba015 bash[30343]: cephadm 2021-03-10T15:12:37.028841+0000 mgr.gibba045.orlgmj (mgr.34412) 4460 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:12:39.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:12:38 gibba045 bash[25517]: cephadm 2021-03-10T15:12:36.789762+0000 mgr.gibba045.orlgmj (mgr.34412) 4444 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:12:39.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:12:38 gibba045 bash[25517]: cephadm 2021-03-10T15:12:36.791648+0000 mgr.gibba045.orlgmj (mgr.34412) 4445 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:12:39.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:12:38 gibba045 bash[25517]: audit 2021-03-10T15:12:36.833176+0000 mgr.gibba045.orlgmj (mgr.34412) 4446 : audit [DBG] from='client.47046 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:12:39.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:12:38 gibba045 bash[25517]: cephadm 2021-03-10T15:12:37.019270+0000 mgr.gibba045.orlgmj (mgr.34412) 4447 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:12:39.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:12:38 gibba045 bash[25517]: cephadm 2021-03-10T15:12:37.020811+0000 mgr.gibba045.orlgmj (mgr.34412) 4448 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:12:39.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:12:38 gibba045 bash[25517]: cephadm 2021-03-10T15:12:37.021956+0000 mgr.gibba045.orlgmj (mgr.34412) 4449 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:12:39.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:12:38 gibba045 bash[25517]: cephadm 2021-03-10T15:12:37.021992+0000 mgr.gibba045.orlgmj (mgr.34412) 4450 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:12:39.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:12:38 gibba045 bash[25517]: cephadm 2021-03-10T15:12:37.023161+0000 mgr.gibba045.orlgmj (mgr.34412) 4451 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:12:39.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:12:38 gibba045 bash[25517]: cephadm 2021-03-10T15:12:37.023205+0000 mgr.gibba045.orlgmj (mgr.34412) 4452 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:12:39.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:12:38 gibba045 bash[25517]: cephadm 2021-03-10T15:12:37.024230+0000 mgr.gibba045.orlgmj (mgr.34412) 4453 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:12:39.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:12:38 gibba045 bash[25517]: cephadm 2021-03-10T15:12:37.025709+0000 mgr.gibba045.orlgmj (mgr.34412) 4454 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:12:39.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:12:38 gibba045 bash[25517]: cephadm 2021-03-10T15:12:37.025745+0000 mgr.gibba045.orlgmj (mgr.34412) 4455 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:12:39.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:12:38 gibba045 bash[25517]: cephadm 2021-03-10T15:12:37.026946+0000 mgr.gibba045.orlgmj (mgr.34412) 4456 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:12:39.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:12:38 gibba045 bash[25517]: cephadm 2021-03-10T15:12:37.027259+0000 mgr.gibba045.orlgmj (mgr.34412) 4457 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:12:39.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:12:38 gibba045 bash[25517]: cephadm 2021-03-10T15:12:37.028644+0000 mgr.gibba045.orlgmj (mgr.34412) 4458 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:12:39.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:12:38 gibba045 bash[25517]: cephadm 2021-03-10T15:12:37.028681+0000 mgr.gibba045.orlgmj (mgr.34412) 4459 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:12:39.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:12:38 gibba045 bash[25517]: cephadm 2021-03-10T15:12:37.028841+0000 mgr.gibba045.orlgmj (mgr.34412) 4460 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:12:39.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:12:39 gibba015 bash[29377]: cluster 2021-03-10T15:12:38.572172+0000 mgr.gibba045.orlgmj (mgr.34412) 4461 : cluster [DBG] pgmap v2526: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:39.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:12:39 gibba015 bash[30343]: cluster 2021-03-10T15:12:38.572172+0000 mgr.gibba045.orlgmj (mgr.34412) 4461 : cluster [DBG] pgmap v2526: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:40.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:12:39 gibba045 bash[25517]: cluster 2021-03-10T15:12:38.572172+0000 mgr.gibba045.orlgmj (mgr.34412) 4461 : cluster [DBG] pgmap v2526: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:41.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:12:41 gibba015 bash[29377]: cluster 2021-03-10T15:12:40.573831+0000 mgr.gibba045.orlgmj (mgr.34412) 4462 : cluster [DBG] pgmap v2527: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:41.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:12:41 gibba015 bash[30343]: cluster 2021-03-10T15:12:40.573831+0000 mgr.gibba045.orlgmj (mgr.34412) 4462 : cluster [DBG] pgmap v2527: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:42.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:12:41 gibba045 bash[25517]: cluster 2021-03-10T15:12:40.573831+0000 mgr.gibba045.orlgmj (mgr.34412) 4462 : cluster [DBG] pgmap v2527: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:43.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:12:43 gibba015 bash[29377]: cluster 2021-03-10T15:12:42.575324+0000 mgr.gibba045.orlgmj (mgr.34412) 4463 : cluster [DBG] pgmap v2528: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:43.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:12:43 gibba015 bash[30343]: cluster 2021-03-10T15:12:42.575324+0000 mgr.gibba045.orlgmj (mgr.34412) 4463 : cluster [DBG] pgmap v2528: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:44.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:12:43 gibba045 bash[25517]: cluster 2021-03-10T15:12:42.575324+0000 mgr.gibba045.orlgmj (mgr.34412) 4463 : cluster [DBG] pgmap v2528: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:45.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:12:44 gibba015 bash[29377]: cluster 2021-03-10T15:12:44.576927+0000 mgr.gibba045.orlgmj (mgr.34412) 4464 : cluster [DBG] pgmap v2529: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:45.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:12:44 gibba015 bash[30343]: cluster 2021-03-10T15:12:44.576927+0000 mgr.gibba045.orlgmj (mgr.34412) 4464 : cluster [DBG] pgmap v2529: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:45.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:12:44 gibba045 bash[25517]: cluster 2021-03-10T15:12:44.576927+0000 mgr.gibba045.orlgmj (mgr.34412) 4464 : cluster [DBG] pgmap v2529: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:47.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:12:47 gibba015 bash[29377]: cluster 2021-03-10T15:12:46.578808+0000 mgr.gibba045.orlgmj (mgr.34412) 4465 : cluster [DBG] pgmap v2530: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:47.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:12:47 gibba015 bash[30343]: cluster 2021-03-10T15:12:46.578808+0000 mgr.gibba045.orlgmj (mgr.34412) 4465 : cluster [DBG] pgmap v2530: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:48.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:12:47 gibba045 bash[25517]: cluster 2021-03-10T15:12:46.578808+0000 mgr.gibba045.orlgmj (mgr.34412) 4465 : cluster [DBG] pgmap v2530: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:49.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:12:49 gibba015 bash[29377]: cluster 2021-03-10T15:12:48.580178+0000 mgr.gibba045.orlgmj (mgr.34412) 4466 : cluster [DBG] pgmap v2531: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:49.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:12:49 gibba015 bash[30343]: cluster 2021-03-10T15:12:48.580178+0000 mgr.gibba045.orlgmj (mgr.34412) 4466 : cluster [DBG] pgmap v2531: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:50.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:12:49 gibba045 bash[25517]: cluster 2021-03-10T15:12:48.580178+0000 mgr.gibba045.orlgmj (mgr.34412) 4466 : cluster [DBG] pgmap v2531: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:51.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:12:51 gibba015 bash[29377]: cluster 2021-03-10T15:12:50.581897+0000 mgr.gibba045.orlgmj (mgr.34412) 4467 : cluster [DBG] pgmap v2532: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:51.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:12:51 gibba015 bash[30343]: cluster 2021-03-10T15:12:50.581897+0000 mgr.gibba045.orlgmj (mgr.34412) 4467 : cluster [DBG] pgmap v2532: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:52.045 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:12:51 gibba045 bash[25517]: cluster 2021-03-10T15:12:50.581897+0000 mgr.gibba045.orlgmj (mgr.34412) 4467 : cluster [DBG] pgmap v2532: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:53.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:12:53 gibba015 bash[29377]: cephadm 2021-03-10T15:12:52.044669+0000 mgr.gibba045.orlgmj (mgr.34412) 4468 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:12:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:12:53 gibba015 bash[29377]: cluster 2021-03-10T15:12:52.583639+0000 mgr.gibba045.orlgmj (mgr.34412) 4469 : cluster [DBG] pgmap v2533: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:12:53 gibba015 bash[29377]: audit 2021-03-10T15:12:53.031414+0000 mon.c (mon.1) 1269 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:12:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:12:53 gibba015 bash[29377]: audit 2021-03-10T15:12:53.032041+0000 mon.c (mon.1) 1270 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:12:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:12:53 gibba015 bash[29377]: audit 2021-03-10T15:12:53.032507+0000 mon.a (mon.0) 1248 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:12:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:12:53 gibba015 bash[29377]: audit 2021-03-10T15:12:53.032903+0000 mon.c (mon.1) 1271 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T15:12:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:12:53 gibba015 bash[29377]: audit 2021-03-10T15:12:53.033686+0000 mon.a (mon.0) 1249 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:12:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:12:53 gibba015 bash[29377]: audit 2021-03-10T15:12:53.034284+0000 mon.c (mon.1) 1272 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T15:12:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:12:53 gibba015 bash[29377]: audit 2021-03-10T15:12:53.034549+0000 mon.a (mon.0) 1250 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T15:12:53.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:12:53 gibba015 bash[29377]: audit 2021-03-10T15:12:53.035521+0000 mon.c (mon.1) 1273 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:12:53.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:12:53 gibba015 bash[29377]: audit 2021-03-10T15:12:53.035613+0000 mon.a (mon.0) 1251 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T15:12:53.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:12:53 gibba015 bash[29377]: audit 2021-03-10T15:12:53.036415+0000 mon.a (mon.0) 1252 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:12:53.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:12:53 gibba015 bash[29377]: audit 2021-03-10T15:12:53.036492+0000 mon.c (mon.1) 1274 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:12:53.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:12:53 gibba015 bash[29377]: audit 2021-03-10T15:12:53.036826+0000 mon.a (mon.0) 1253 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:12:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:12:53 gibba015 bash[30343]: cephadm 2021-03-10T15:12:52.044669+0000 mgr.gibba045.orlgmj (mgr.34412) 4468 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:12:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:12:53 gibba015 bash[30343]: cluster 2021-03-10T15:12:52.583639+0000 mgr.gibba045.orlgmj (mgr.34412) 4469 : cluster [DBG] pgmap v2533: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:12:53 gibba015 bash[30343]: audit 2021-03-10T15:12:53.031414+0000 mon.c (mon.1) 1269 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:12:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:12:53 gibba015 bash[30343]: audit 2021-03-10T15:12:53.032041+0000 mon.c (mon.1) 1270 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:12:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:12:53 gibba015 bash[30343]: audit 2021-03-10T15:12:53.032507+0000 mon.a (mon.0) 1248 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:12:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:12:53 gibba015 bash[30343]: audit 2021-03-10T15:12:53.032903+0000 mon.c (mon.1) 1271 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T15:12:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:12:53 gibba015 bash[30343]: audit 2021-03-10T15:12:53.033686+0000 mon.a (mon.0) 1249 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:12:53.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:12:53 gibba015 bash[30343]: audit 2021-03-10T15:12:53.034284+0000 mon.c (mon.1) 1272 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T15:12:53.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:12:53 gibba015 bash[30343]: audit 2021-03-10T15:12:53.034549+0000 mon.a (mon.0) 1250 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T15:12:53.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:12:53 gibba015 bash[30343]: audit 2021-03-10T15:12:53.035521+0000 mon.c (mon.1) 1273 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:12:53.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:12:53 gibba015 bash[30343]: audit 2021-03-10T15:12:53.035613+0000 mon.a (mon.0) 1251 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T15:12:53.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:12:53 gibba015 bash[30343]: audit 2021-03-10T15:12:53.036415+0000 mon.a (mon.0) 1252 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:12:53.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:12:53 gibba015 bash[30343]: audit 2021-03-10T15:12:53.036492+0000 mon.c (mon.1) 1274 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:12:53.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:12:53 gibba015 bash[30343]: audit 2021-03-10T15:12:53.036826+0000 mon.a (mon.0) 1253 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:12:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:12:53 gibba045 bash[25517]: cephadm 2021-03-10T15:12:52.044669+0000 mgr.gibba045.orlgmj (mgr.34412) 4468 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:12:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:12:53 gibba045 bash[25517]: cluster 2021-03-10T15:12:52.583639+0000 mgr.gibba045.orlgmj (mgr.34412) 4469 : cluster [DBG] pgmap v2533: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:12:53 gibba045 bash[25517]: audit 2021-03-10T15:12:53.031414+0000 mon.c (mon.1) 1269 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:12:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:12:53 gibba045 bash[25517]: audit 2021-03-10T15:12:53.032041+0000 mon.c (mon.1) 1270 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:12:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:12:53 gibba045 bash[25517]: audit 2021-03-10T15:12:53.032507+0000 mon.a (mon.0) 1248 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:12:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:12:53 gibba045 bash[25517]: audit 2021-03-10T15:12:53.032903+0000 mon.c (mon.1) 1271 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T15:12:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:12:53 gibba045 bash[25517]: audit 2021-03-10T15:12:53.033686+0000 mon.a (mon.0) 1249 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:12:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:12:53 gibba045 bash[25517]: audit 2021-03-10T15:12:53.034284+0000 mon.c (mon.1) 1272 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T15:12:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:12:53 gibba045 bash[25517]: audit 2021-03-10T15:12:53.034549+0000 mon.a (mon.0) 1250 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T15:12:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:12:53 gibba045 bash[25517]: audit 2021-03-10T15:12:53.035521+0000 mon.c (mon.1) 1273 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:12:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:12:53 gibba045 bash[25517]: audit 2021-03-10T15:12:53.035613+0000 mon.a (mon.0) 1251 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T15:12:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:12:53 gibba045 bash[25517]: audit 2021-03-10T15:12:53.036415+0000 mon.a (mon.0) 1252 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:12:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:12:53 gibba045 bash[25517]: audit 2021-03-10T15:12:53.036492+0000 mon.c (mon.1) 1274 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:12:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:12:53 gibba045 bash[25517]: audit 2021-03-10T15:12:53.036826+0000 mon.a (mon.0) 1253 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:12:55.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:12:54 gibba015 bash[29377]: cluster 2021-03-10T15:12:54.585342+0000 mgr.gibba045.orlgmj (mgr.34412) 4470 : cluster [DBG] pgmap v2534: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:55.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:12:54 gibba015 bash[30343]: cluster 2021-03-10T15:12:54.585342+0000 mgr.gibba045.orlgmj (mgr.34412) 4470 : cluster [DBG] pgmap v2534: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:55.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:12:54 gibba045 bash[25517]: cluster 2021-03-10T15:12:54.585342+0000 mgr.gibba045.orlgmj (mgr.34412) 4470 : cluster [DBG] pgmap v2534: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:57.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:12:57 gibba015 bash[29377]: cluster 2021-03-10T15:12:56.587191+0000 mgr.gibba045.orlgmj (mgr.34412) 4471 : cluster [DBG] pgmap v2535: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:57.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:12:57 gibba015 bash[30343]: cluster 2021-03-10T15:12:56.587191+0000 mgr.gibba045.orlgmj (mgr.34412) 4471 : cluster [DBG] pgmap v2535: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:58.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:12:57 gibba045 bash[25517]: cluster 2021-03-10T15:12:56.587191+0000 mgr.gibba045.orlgmj (mgr.34412) 4471 : cluster [DBG] pgmap v2535: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:59.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:12:59 gibba015 bash[29377]: cluster 2021-03-10T15:12:58.588584+0000 mgr.gibba045.orlgmj (mgr.34412) 4472 : cluster [DBG] pgmap v2536: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:59.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:12:59 gibba015 bash[30343]: cluster 2021-03-10T15:12:58.588584+0000 mgr.gibba045.orlgmj (mgr.34412) 4472 : cluster [DBG] pgmap v2536: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:00.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:12:59 gibba045 bash[25517]: cluster 2021-03-10T15:12:58.588584+0000 mgr.gibba045.orlgmj (mgr.34412) 4472 : cluster [DBG] pgmap v2536: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:01.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:13:01 gibba015 bash[29377]: cluster 2021-03-10T15:13:00.590115+0000 mgr.gibba045.orlgmj (mgr.34412) 4473 : cluster [DBG] pgmap v2537: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:01.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:13:01 gibba015 bash[30343]: cluster 2021-03-10T15:13:00.590115+0000 mgr.gibba045.orlgmj (mgr.34412) 4473 : cluster [DBG] pgmap v2537: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:02.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:13:01 gibba045 bash[25517]: cluster 2021-03-10T15:13:00.590115+0000 mgr.gibba045.orlgmj (mgr.34412) 4473 : cluster [DBG] pgmap v2537: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:03.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:13:03 gibba015 bash[29377]: cluster 2021-03-10T15:13:02.591989+0000 mgr.gibba045.orlgmj (mgr.34412) 4474 : cluster [DBG] pgmap v2538: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:03.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:13:03 gibba015 bash[30343]: cluster 2021-03-10T15:13:02.591989+0000 mgr.gibba045.orlgmj (mgr.34412) 4474 : cluster [DBG] pgmap v2538: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:04.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:13:03 gibba045 bash[25517]: cluster 2021-03-10T15:13:02.591989+0000 mgr.gibba045.orlgmj (mgr.34412) 4474 : cluster [DBG] pgmap v2538: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:05.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:13:04 gibba015 bash[29377]: cluster 2021-03-10T15:13:04.593723+0000 mgr.gibba045.orlgmj (mgr.34412) 4475 : cluster [DBG] pgmap v2539: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:05.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:13:04 gibba015 bash[30343]: cluster 2021-03-10T15:13:04.593723+0000 mgr.gibba045.orlgmj (mgr.34412) 4475 : cluster [DBG] pgmap v2539: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:05.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:13:04 gibba045 bash[25517]: cluster 2021-03-10T15:13:04.593723+0000 mgr.gibba045.orlgmj (mgr.34412) 4475 : cluster [DBG] pgmap v2539: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:07.338 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:13:07.593 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:13:07.593 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (83m) 8m ago 89m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:13:07.594 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (88m) 7m ago 88m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:13:07.594 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (84m) 7m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:13:07.594 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (84m) 7m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:13:07.594 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (83m) 8m ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:13:07.595 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (83m) 8m ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:13:07.595 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (82m) 7m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:13:07.595 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (83m) 8m ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:13:07.595 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (89m) 8m ago 89m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:13:07.596 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (89m) 7m ago 89m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:13:07.596 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (82m) 8m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:13:07.596 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (81m) 8m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:13:07.596 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (81m) 8m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:13:07.597 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (80m) 8m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:13:07.597 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (80m) 7m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:13:07.597 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (80m) 7m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:13:07.597 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (79m) 7m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:13:07.598 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (79m) 7m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:13:07.598 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (88m) 7m ago 89m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:13:07.598 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 7m ago 87m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:13:07.859 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:13:07.859 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:13:07.859 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:13:07.860 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:13:07.860 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:13:07.860 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:13:07.860 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:13:07.860 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:13:07.861 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:13:07.861 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:13:07.861 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:13:07.861 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:13:07.862 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:13:07.862 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:13:07.862 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:13:07.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:13:07 gibba015 bash[29377]: cluster 2021-03-10T15:13:06.595600+0000 mgr.gibba045.orlgmj (mgr.34412) 4476 : cluster [DBG] pgmap v2540: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:07.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:13:07 gibba015 bash[30343]: cluster 2021-03-10T15:13:06.595600+0000 mgr.gibba045.orlgmj (mgr.34412) 4476 : cluster [DBG] pgmap v2540: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:08.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:13:07 gibba045 bash[25517]: cluster 2021-03-10T15:13:06.595600+0000 mgr.gibba045.orlgmj (mgr.34412) 4476 : cluster [DBG] pgmap v2540: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:08.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:13:08 gibba015 bash[29377]: cephadm 2021-03-10T15:13:07.060812+0000 mgr.gibba045.orlgmj (mgr.34412) 4477 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:13:08.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:13:08 gibba015 bash[29377]: audit 2021-03-10T15:13:07.329328+0000 mgr.gibba045.orlgmj (mgr.34412) 4478 : audit [DBG] from='client.57046 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:13:08.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:13:08 gibba015 bash[29377]: audit 2021-03-10T15:13:07.553214+0000 mgr.gibba045.orlgmj (mgr.34412) 4479 : audit [DBG] from='client.57052 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:13:08.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:13:08 gibba015 bash[29377]: audit 2021-03-10T15:13:07.855225+0000 mon.a (mon.0) 1254 : audit [DBG] from='client.? 172.21.2.115:0/1748755175' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:13:08.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:13:08 gibba015 bash[30343]: cephadm 2021-03-10T15:13:07.060812+0000 mgr.gibba045.orlgmj (mgr.34412) 4477 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:13:08.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:13:08 gibba015 bash[30343]: audit 2021-03-10T15:13:07.329328+0000 mgr.gibba045.orlgmj (mgr.34412) 4478 : audit [DBG] from='client.57046 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:13:08.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:13:08 gibba015 bash[30343]: audit 2021-03-10T15:13:07.553214+0000 mgr.gibba045.orlgmj (mgr.34412) 4479 : audit [DBG] from='client.57052 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:13:08.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:13:08 gibba015 bash[30343]: audit 2021-03-10T15:13:07.855225+0000 mon.a (mon.0) 1254 : audit [DBG] from='client.? 172.21.2.115:0/1748755175' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:13:09.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:13:08 gibba045 bash[25517]: cephadm 2021-03-10T15:13:07.060812+0000 mgr.gibba045.orlgmj (mgr.34412) 4477 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:13:09.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:13:08 gibba045 bash[25517]: audit 2021-03-10T15:13:07.329328+0000 mgr.gibba045.orlgmj (mgr.34412) 4478 : audit [DBG] from='client.57046 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:13:09.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:13:08 gibba045 bash[25517]: audit 2021-03-10T15:13:07.553214+0000 mgr.gibba045.orlgmj (mgr.34412) 4479 : audit [DBG] from='client.57052 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:13:09.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:13:08 gibba045 bash[25517]: audit 2021-03-10T15:13:07.855225+0000 mon.a (mon.0) 1254 : audit [DBG] from='client.? 172.21.2.115:0/1748755175' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:13:09.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:13:09 gibba015 bash[29377]: cluster 2021-03-10T15:13:08.597146+0000 mgr.gibba045.orlgmj (mgr.34412) 4480 : cluster [DBG] pgmap v2541: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:09.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:13:09 gibba015 bash[30343]: cluster 2021-03-10T15:13:08.597146+0000 mgr.gibba045.orlgmj (mgr.34412) 4480 : cluster [DBG] pgmap v2541: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:10.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:13:09 gibba045 bash[25517]: cluster 2021-03-10T15:13:08.597146+0000 mgr.gibba045.orlgmj (mgr.34412) 4480 : cluster [DBG] pgmap v2541: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:11.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:13:11 gibba015 bash[29377]: cluster 2021-03-10T15:13:10.598778+0000 mgr.gibba045.orlgmj (mgr.34412) 4481 : cluster [DBG] pgmap v2542: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:11.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:13:11 gibba015 bash[30343]: cluster 2021-03-10T15:13:10.598778+0000 mgr.gibba045.orlgmj (mgr.34412) 4481 : cluster [DBG] pgmap v2542: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:12.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:13:11 gibba045 bash[25517]: cluster 2021-03-10T15:13:10.598778+0000 mgr.gibba045.orlgmj (mgr.34412) 4481 : cluster [DBG] pgmap v2542: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:13.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:13:13 gibba015 bash[29377]: cluster 2021-03-10T15:13:12.600667+0000 mgr.gibba045.orlgmj (mgr.34412) 4482 : cluster [DBG] pgmap v2543: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:13.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:13:13 gibba015 bash[30343]: cluster 2021-03-10T15:13:12.600667+0000 mgr.gibba045.orlgmj (mgr.34412) 4482 : cluster [DBG] pgmap v2543: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:14.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:13:13 gibba045 bash[25517]: cluster 2021-03-10T15:13:12.600667+0000 mgr.gibba045.orlgmj (mgr.34412) 4482 : cluster [DBG] pgmap v2543: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:15.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:13:14 gibba015 bash[29377]: cluster 2021-03-10T15:13:14.602204+0000 mgr.gibba045.orlgmj (mgr.34412) 4483 : cluster [DBG] pgmap v2544: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:15.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:13:14 gibba015 bash[30343]: cluster 2021-03-10T15:13:14.602204+0000 mgr.gibba045.orlgmj (mgr.34412) 4483 : cluster [DBG] pgmap v2544: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:15.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:13:14 gibba045 bash[25517]: cluster 2021-03-10T15:13:14.602204+0000 mgr.gibba045.orlgmj (mgr.34412) 4483 : cluster [DBG] pgmap v2544: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:17.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:13:17 gibba015 bash[29377]: cluster 2021-03-10T15:13:16.603872+0000 mgr.gibba045.orlgmj (mgr.34412) 4484 : cluster [DBG] pgmap v2545: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:17.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:13:17 gibba015 bash[30343]: cluster 2021-03-10T15:13:16.603872+0000 mgr.gibba045.orlgmj (mgr.34412) 4484 : cluster [DBG] pgmap v2545: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:18.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:13:17 gibba045 bash[25517]: cluster 2021-03-10T15:13:16.603872+0000 mgr.gibba045.orlgmj (mgr.34412) 4484 : cluster [DBG] pgmap v2545: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:19.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:13:19 gibba015 bash[29377]: cluster 2021-03-10T15:13:18.604990+0000 mgr.gibba045.orlgmj (mgr.34412) 4485 : cluster [DBG] pgmap v2546: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:19.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:13:19 gibba015 bash[30343]: cluster 2021-03-10T15:13:18.604990+0000 mgr.gibba045.orlgmj (mgr.34412) 4485 : cluster [DBG] pgmap v2546: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:20.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:13:19 gibba045 bash[25517]: cluster 2021-03-10T15:13:18.604990+0000 mgr.gibba045.orlgmj (mgr.34412) 4485 : cluster [DBG] pgmap v2546: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:21.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:13:21 gibba015 bash[29377]: cluster 2021-03-10T15:13:20.606751+0000 mgr.gibba045.orlgmj (mgr.34412) 4486 : cluster [DBG] pgmap v2547: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:21.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:13:21 gibba015 bash[30343]: cluster 2021-03-10T15:13:20.606751+0000 mgr.gibba045.orlgmj (mgr.34412) 4486 : cluster [DBG] pgmap v2547: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:22.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:13:21 gibba045 bash[25517]: cluster 2021-03-10T15:13:20.606751+0000 mgr.gibba045.orlgmj (mgr.34412) 4486 : cluster [DBG] pgmap v2547: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:23.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:13:23 gibba015 bash[29377]: cephadm 2021-03-10T15:13:22.073398+0000 mgr.gibba045.orlgmj (mgr.34412) 4487 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:13:23.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:13:23 gibba015 bash[29377]: cluster 2021-03-10T15:13:22.608159+0000 mgr.gibba045.orlgmj (mgr.34412) 4488 : cluster [DBG] pgmap v2548: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:23.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:13:23 gibba015 bash[30343]: cephadm 2021-03-10T15:13:22.073398+0000 mgr.gibba045.orlgmj (mgr.34412) 4487 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:13:23.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:13:23 gibba015 bash[30343]: cluster 2021-03-10T15:13:22.608159+0000 mgr.gibba045.orlgmj (mgr.34412) 4488 : cluster [DBG] pgmap v2548: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:24.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:13:23 gibba045 bash[25517]: cephadm 2021-03-10T15:13:22.073398+0000 mgr.gibba045.orlgmj (mgr.34412) 4487 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:13:24.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:13:23 gibba045 bash[25517]: cluster 2021-03-10T15:13:22.608159+0000 mgr.gibba045.orlgmj (mgr.34412) 4488 : cluster [DBG] pgmap v2548: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:25.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:13:24 gibba015 bash[29377]: cluster 2021-03-10T15:13:24.609528+0000 mgr.gibba045.orlgmj (mgr.34412) 4489 : cluster [DBG] pgmap v2549: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:25.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:13:24 gibba015 bash[30343]: cluster 2021-03-10T15:13:24.609528+0000 mgr.gibba045.orlgmj (mgr.34412) 4489 : cluster [DBG] pgmap v2549: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:25.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:13:24 gibba045 bash[25517]: cluster 2021-03-10T15:13:24.609528+0000 mgr.gibba045.orlgmj (mgr.34412) 4489 : cluster [DBG] pgmap v2549: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:27.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:13:27 gibba015 bash[29377]: cluster 2021-03-10T15:13:26.611227+0000 mgr.gibba045.orlgmj (mgr.34412) 4490 : cluster [DBG] pgmap v2550: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:27.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:13:27 gibba015 bash[30343]: cluster 2021-03-10T15:13:26.611227+0000 mgr.gibba045.orlgmj (mgr.34412) 4490 : cluster [DBG] pgmap v2550: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:28.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:13:27 gibba045 bash[25517]: cluster 2021-03-10T15:13:26.611227+0000 mgr.gibba045.orlgmj (mgr.34412) 4490 : cluster [DBG] pgmap v2550: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:29.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:13:29 gibba015 bash[29377]: cluster 2021-03-10T15:13:28.612575+0000 mgr.gibba045.orlgmj (mgr.34412) 4491 : cluster [DBG] pgmap v2551: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:29.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:13:29 gibba015 bash[30343]: cluster 2021-03-10T15:13:28.612575+0000 mgr.gibba045.orlgmj (mgr.34412) 4491 : cluster [DBG] pgmap v2551: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:30.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:13:29 gibba045 bash[25517]: cluster 2021-03-10T15:13:28.612575+0000 mgr.gibba045.orlgmj (mgr.34412) 4491 : cluster [DBG] pgmap v2551: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:31.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:13:31 gibba015 bash[29377]: cluster 2021-03-10T15:13:30.614264+0000 mgr.gibba045.orlgmj (mgr.34412) 4492 : cluster [DBG] pgmap v2552: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:31.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:13:31 gibba015 bash[30343]: cluster 2021-03-10T15:13:30.614264+0000 mgr.gibba045.orlgmj (mgr.34412) 4492 : cluster [DBG] pgmap v2552: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:32.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:13:31 gibba045 bash[25517]: cluster 2021-03-10T15:13:30.614264+0000 mgr.gibba045.orlgmj (mgr.34412) 4492 : cluster [DBG] pgmap v2552: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:33.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:13:33 gibba015 bash[29377]: cluster 2021-03-10T15:13:32.615931+0000 mgr.gibba045.orlgmj (mgr.34412) 4493 : cluster [DBG] pgmap v2553: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:33.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:13:33 gibba015 bash[30343]: cluster 2021-03-10T15:13:32.615931+0000 mgr.gibba045.orlgmj (mgr.34412) 4493 : cluster [DBG] pgmap v2553: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:34.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:13:33 gibba045 bash[25517]: cluster 2021-03-10T15:13:32.615931+0000 mgr.gibba045.orlgmj (mgr.34412) 4493 : cluster [DBG] pgmap v2553: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:35.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:13:34 gibba015 bash[29377]: cluster 2021-03-10T15:13:34.617455+0000 mgr.gibba045.orlgmj (mgr.34412) 4494 : cluster [DBG] pgmap v2554: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:35.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:13:34 gibba015 bash[30343]: cluster 2021-03-10T15:13:34.617455+0000 mgr.gibba045.orlgmj (mgr.34412) 4494 : cluster [DBG] pgmap v2554: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:35.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:13:34 gibba045 bash[25517]: cluster 2021-03-10T15:13:34.617455+0000 mgr.gibba045.orlgmj (mgr.34412) 4494 : cluster [DBG] pgmap v2554: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:37.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:13:37 gibba015 bash[29377]: cluster 2021-03-10T15:13:36.619219+0000 mgr.gibba045.orlgmj (mgr.34412) 4495 : cluster [DBG] pgmap v2555: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:37.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:13:37 gibba015 bash[29377]: audit 2021-03-10T15:13:37.086416+0000 mon.c (mon.1) 1275 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:13:37.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:13:37 gibba015 bash[29377]: audit 2021-03-10T15:13:37.092441+0000 mon.c (mon.1) 1276 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T15:13:37.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:13:37 gibba015 bash[30343]: cluster 2021-03-10T15:13:36.619219+0000 mgr.gibba045.orlgmj (mgr.34412) 4495 : cluster [DBG] pgmap v2555: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:37.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:13:37 gibba015 bash[30343]: audit 2021-03-10T15:13:37.086416+0000 mon.c (mon.1) 1275 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:13:37.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:13:37 gibba015 bash[30343]: audit 2021-03-10T15:13:37.092441+0000 mon.c (mon.1) 1276 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T15:13:38.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:13:37 gibba045 bash[25517]: cluster 2021-03-10T15:13:36.619219+0000 mgr.gibba045.orlgmj (mgr.34412) 4495 : cluster [DBG] pgmap v2555: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:38.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:13:37 gibba045 bash[25517]: audit 2021-03-10T15:13:37.086416+0000 mon.c (mon.1) 1275 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:13:38.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:13:37 gibba045 bash[25517]: audit 2021-03-10T15:13:37.092441+0000 mon.c (mon.1) 1276 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T15:13:38.101 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:13:38.333 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:13:38.334 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (84m) 9m ago 89m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:13:38.334 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (89m) 8m ago 89m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:13:38.335 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (84m) 8m ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:13:38.335 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (85m) 8m ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:13:38.335 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (84m) 9m ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:13:38.335 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (83m) 9m ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:13:38.336 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (83m) 8m ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:13:38.336 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (83m) 9m ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:13:38.336 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (89m) 9m ago 89m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:13:38.336 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (89m) 8m ago 89m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:13:38.337 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (82m) 9m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:13:38.337 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (82m) 9m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:13:38.337 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (81m) 9m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:13:38.337 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (81m) 9m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:13:38.337 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (80m) 8m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:13:38.338 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (80m) 8m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:13:38.338 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (80m) 8m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:13:38.338 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (79m) 8m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:13:38.338 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (89m) 8m ago 89m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:13:38.338 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 8m ago 87m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:13:38.595 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:13:38.596 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:13:38.596 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:13:38.596 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:13:38.596 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:13:38.597 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:13:38.597 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:13:38.597 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:13:38.597 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:13:38.598 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:13:38.598 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:13:38.598 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:13:38.598 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:13:38.599 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:13:38.599 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:13:38.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:13:38 gibba015 bash[29377]: cephadm 2021-03-10T15:13:37.096090+0000 mgr.gibba045.orlgmj (mgr.34412) 4496 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:13:38.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:13:38 gibba015 bash[29377]: audit 2021-03-10T15:13:38.591626+0000 mon.a (mon.0) 1255 : audit [DBG] from='client.? 172.21.2.115:0/2295279648' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:13:38.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:13:38 gibba015 bash[30343]: cephadm 2021-03-10T15:13:37.096090+0000 mgr.gibba045.orlgmj (mgr.34412) 4496 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:13:38.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:13:38 gibba015 bash[30343]: audit 2021-03-10T15:13:38.591626+0000 mon.a (mon.0) 1255 : audit [DBG] from='client.? 172.21.2.115:0/2295279648' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:13:39.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:13:38 gibba045 bash[25517]: cephadm 2021-03-10T15:13:37.096090+0000 mgr.gibba045.orlgmj (mgr.34412) 4496 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:13:39.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:13:38 gibba045 bash[25517]: audit 2021-03-10T15:13:38.591626+0000 mon.a (mon.0) 1255 : audit [DBG] from='client.? 172.21.2.115:0/2295279648' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:13:39.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:13:39 gibba015 bash[29377]: audit 2021-03-10T15:13:38.092682+0000 mgr.gibba045.orlgmj (mgr.34412) 4497 : audit [DBG] from='client.57064 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:13:39.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:13:39 gibba015 bash[29377]: audit 2021-03-10T15:13:38.321932+0000 mgr.gibba045.orlgmj (mgr.34412) 4498 : audit [DBG] from='client.57070 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:13:39.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:13:39 gibba015 bash[29377]: cluster 2021-03-10T15:13:38.620460+0000 mgr.gibba045.orlgmj (mgr.34412) 4499 : cluster [DBG] pgmap v2556: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:39.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:13:39 gibba015 bash[30343]: audit 2021-03-10T15:13:38.092682+0000 mgr.gibba045.orlgmj (mgr.34412) 4497 : audit [DBG] from='client.57064 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:13:39.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:13:39 gibba015 bash[30343]: audit 2021-03-10T15:13:38.321932+0000 mgr.gibba045.orlgmj (mgr.34412) 4498 : audit [DBG] from='client.57070 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:13:39.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:13:39 gibba015 bash[30343]: cluster 2021-03-10T15:13:38.620460+0000 mgr.gibba045.orlgmj (mgr.34412) 4499 : cluster [DBG] pgmap v2556: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:40.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:13:39 gibba045 bash[25517]: audit 2021-03-10T15:13:38.092682+0000 mgr.gibba045.orlgmj (mgr.34412) 4497 : audit [DBG] from='client.57064 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:13:40.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:13:39 gibba045 bash[25517]: audit 2021-03-10T15:13:38.321932+0000 mgr.gibba045.orlgmj (mgr.34412) 4498 : audit [DBG] from='client.57070 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:13:40.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:13:39 gibba045 bash[25517]: cluster 2021-03-10T15:13:38.620460+0000 mgr.gibba045.orlgmj (mgr.34412) 4499 : cluster [DBG] pgmap v2556: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:40.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:13:40 gibba015 bash[29377]: cluster 2021-03-10T15:13:40.621951+0000 mgr.gibba045.orlgmj (mgr.34412) 4500 : cluster [DBG] pgmap v2557: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:40.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:13:40 gibba015 bash[30343]: cluster 2021-03-10T15:13:40.621951+0000 mgr.gibba045.orlgmj (mgr.34412) 4500 : cluster [DBG] pgmap v2557: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:41.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:13:40 gibba045 bash[25517]: cluster 2021-03-10T15:13:40.621951+0000 mgr.gibba045.orlgmj (mgr.34412) 4500 : cluster [DBG] pgmap v2557: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:42.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:13:41 gibba015 bash[29377]: audit 2021-03-10T15:13:41.895345+0000 mon.c (mon.1) 1277 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:13:42.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:13:41 gibba015 bash[30343]: audit 2021-03-10T15:13:41.895345+0000 mon.c (mon.1) 1277 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:13:42.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:13:41 gibba045 bash[25517]: audit 2021-03-10T15:13:41.895345+0000 mon.c (mon.1) 1277 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:13:43.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:13:43 gibba015 bash[29377]: audit 2021-03-10T15:13:42.075259+0000 mon.a (mon.0) 1256 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:13:43.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:13:43 gibba015 bash[29377]: cephadm 2021-03-10T15:13:42.081059+0000 mgr.gibba045.orlgmj (mgr.34412) 4501 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:13:43.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:13:43 gibba015 bash[29377]: audit 2021-03-10T15:13:42.279479+0000 mon.a (mon.0) 1257 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:13:43.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:13:43 gibba015 bash[29377]: audit 2021-03-10T15:13:42.295935+0000 mon.c (mon.1) 1278 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:13:43.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:13:43 gibba015 bash[29377]: cephadm 2021-03-10T15:13:42.296918+0000 mgr.gibba045.orlgmj (mgr.34412) 4502 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:13:43.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:13:43 gibba015 bash[29377]: audit 2021-03-10T15:13:42.300298+0000 mon.c (mon.1) 1279 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:13:43.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:13:43 gibba015 bash[29377]: cephadm 2021-03-10T15:13:42.303166+0000 mgr.gibba045.orlgmj (mgr.34412) 4503 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:13:43.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:13:43 gibba015 bash[29377]: audit 2021-03-10T15:13:42.304439+0000 mon.c (mon.1) 1280 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:13:43.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:13:43 gibba015 bash[29377]: cephadm 2021-03-10T15:13:42.306426+0000 mgr.gibba045.orlgmj (mgr.34412) 4504 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:13:43.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:13:43 gibba015 bash[29377]: cephadm 2021-03-10T15:13:42.307040+0000 mgr.gibba045.orlgmj (mgr.34412) 4505 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:13:43.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:13:43 gibba015 bash[29377]: audit 2021-03-10T15:13:42.308078+0000 mon.c (mon.1) 1281 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:13:43.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:13:43 gibba015 bash[29377]: cephadm 2021-03-10T15:13:42.310521+0000 mgr.gibba045.orlgmj (mgr.34412) 4506 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:13:43.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:13:43 gibba015 bash[29377]: cephadm 2021-03-10T15:13:42.311110+0000 mgr.gibba045.orlgmj (mgr.34412) 4507 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:13:43.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:13:43 gibba015 bash[29377]: cephadm 2021-03-10T15:13:42.314265+0000 mgr.gibba045.orlgmj (mgr.34412) 4508 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:13:43.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:13:43 gibba015 bash[29377]: audit 2021-03-10T15:13:42.316128+0000 mon.c (mon.1) 1282 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:13:43.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:13:43 gibba015 bash[29377]: cephadm 2021-03-10T15:13:42.317562+0000 mgr.gibba045.orlgmj (mgr.34412) 4509 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:13:43.479 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:13:43 gibba015 bash[29377]: cephadm 2021-03-10T15:13:42.318029+0000 mgr.gibba045.orlgmj (mgr.34412) 4510 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:13:43.479 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:13:43 gibba015 bash[29377]: audit 2021-03-10T15:13:42.321987+0000 mon.c (mon.1) 1283 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:13:43.479 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:13:43 gibba015 bash[29377]: cephadm 2021-03-10T15:13:42.322658+0000 mgr.gibba045.orlgmj (mgr.34412) 4511 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:13:43.479 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:13:43 gibba015 bash[29377]: cephadm 2021-03-10T15:13:42.325002+0000 mgr.gibba045.orlgmj (mgr.34412) 4512 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:13:43.479 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:13:43 gibba015 bash[29377]: cephadm 2021-03-10T15:13:42.328022+0000 mgr.gibba045.orlgmj (mgr.34412) 4513 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:13:43.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:13:43 gibba015 bash[30343]: audit 2021-03-10T15:13:42.075259+0000 mon.a (mon.0) 1256 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:13:43.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:13:43 gibba015 bash[30343]: cephadm 2021-03-10T15:13:42.081059+0000 mgr.gibba045.orlgmj (mgr.34412) 4501 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:13:43.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:13:43 gibba015 bash[30343]: audit 2021-03-10T15:13:42.279479+0000 mon.a (mon.0) 1257 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:13:43.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:13:43 gibba015 bash[30343]: audit 2021-03-10T15:13:42.295935+0000 mon.c (mon.1) 1278 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:13:43.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:13:43 gibba015 bash[30343]: cephadm 2021-03-10T15:13:42.296918+0000 mgr.gibba045.orlgmj (mgr.34412) 4502 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:13:43.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:13:43 gibba015 bash[30343]: audit 2021-03-10T15:13:42.300298+0000 mon.c (mon.1) 1279 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:13:43.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:13:43 gibba015 bash[30343]: cephadm 2021-03-10T15:13:42.303166+0000 mgr.gibba045.orlgmj (mgr.34412) 4503 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:13:43.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:13:43 gibba015 bash[30343]: audit 2021-03-10T15:13:42.304439+0000 mon.c (mon.1) 1280 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:13:43.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:13:43 gibba015 bash[30343]: cephadm 2021-03-10T15:13:42.306426+0000 mgr.gibba045.orlgmj (mgr.34412) 4504 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:13:43.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:13:43 gibba015 bash[30343]: cephadm 2021-03-10T15:13:42.307040+0000 mgr.gibba045.orlgmj (mgr.34412) 4505 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:13:43.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:13:43 gibba015 bash[30343]: audit 2021-03-10T15:13:42.308078+0000 mon.c (mon.1) 1281 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:13:43.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:13:43 gibba015 bash[30343]: cephadm 2021-03-10T15:13:42.310521+0000 mgr.gibba045.orlgmj (mgr.34412) 4506 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:13:43.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:13:43 gibba015 bash[30343]: cephadm 2021-03-10T15:13:42.311110+0000 mgr.gibba045.orlgmj (mgr.34412) 4507 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:13:43.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:13:43 gibba015 bash[30343]: cephadm 2021-03-10T15:13:42.314265+0000 mgr.gibba045.orlgmj (mgr.34412) 4508 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:13:43.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:13:43 gibba015 bash[30343]: audit 2021-03-10T15:13:42.316128+0000 mon.c (mon.1) 1282 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:13:43.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:13:43 gibba015 bash[30343]: cephadm 2021-03-10T15:13:42.317562+0000 mgr.gibba045.orlgmj (mgr.34412) 4509 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:13:43.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:13:43 gibba015 bash[30343]: cephadm 2021-03-10T15:13:42.318029+0000 mgr.gibba045.orlgmj (mgr.34412) 4510 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:13:43.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:13:43 gibba015 bash[30343]: audit 2021-03-10T15:13:42.321987+0000 mon.c (mon.1) 1283 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:13:43.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:13:43 gibba015 bash[30343]: cephadm 2021-03-10T15:13:42.322658+0000 mgr.gibba045.orlgmj (mgr.34412) 4511 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:13:43.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:13:43 gibba015 bash[30343]: cephadm 2021-03-10T15:13:42.325002+0000 mgr.gibba045.orlgmj (mgr.34412) 4512 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:13:43.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:13:43 gibba015 bash[30343]: cephadm 2021-03-10T15:13:42.328022+0000 mgr.gibba045.orlgmj (mgr.34412) 4513 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:13:43.485 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:13:43 gibba015 bash[29377]: cephadm 2021-03-10T15:13:42.328324+0000 mgr.gibba045.orlgmj (mgr.34412) 4514 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:13:43.485 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:13:43 gibba015 bash[29377]: cephadm 2021-03-10T15:13:42.328967+0000 mgr.gibba045.orlgmj (mgr.34412) 4515 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:13:43.485 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:13:43 gibba015 bash[29377]: cluster 2021-03-10T15:13:42.623670+0000 mgr.gibba045.orlgmj (mgr.34412) 4516 : cluster [DBG] pgmap v2558: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:43.486 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:13:43 gibba015 bash[30343]: cephadm 2021-03-10T15:13:42.328324+0000 mgr.gibba045.orlgmj (mgr.34412) 4514 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:13:43.486 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:13:43 gibba015 bash[30343]: cephadm 2021-03-10T15:13:42.328967+0000 mgr.gibba045.orlgmj (mgr.34412) 4515 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:13:43.486 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:13:43 gibba015 bash[30343]: cluster 2021-03-10T15:13:42.623670+0000 mgr.gibba045.orlgmj (mgr.34412) 4516 : cluster [DBG] pgmap v2558: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:43.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:13:43 gibba045 bash[25517]: audit 2021-03-10T15:13:42.075259+0000 mon.a (mon.0) 1256 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:13:43.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:13:43 gibba045 bash[25517]: cephadm 2021-03-10T15:13:42.081059+0000 mgr.gibba045.orlgmj (mgr.34412) 4501 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:13:43.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:13:43 gibba045 bash[25517]: audit 2021-03-10T15:13:42.279479+0000 mon.a (mon.0) 1257 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:13:43.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:13:43 gibba045 bash[25517]: audit 2021-03-10T15:13:42.295935+0000 mon.c (mon.1) 1278 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:13:43.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:13:43 gibba045 bash[25517]: cephadm 2021-03-10T15:13:42.296918+0000 mgr.gibba045.orlgmj (mgr.34412) 4502 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:13:43.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:13:43 gibba045 bash[25517]: audit 2021-03-10T15:13:42.300298+0000 mon.c (mon.1) 1279 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:13:43.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:13:43 gibba045 bash[25517]: cephadm 2021-03-10T15:13:42.303166+0000 mgr.gibba045.orlgmj (mgr.34412) 4503 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:13:43.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:13:43 gibba045 bash[25517]: audit 2021-03-10T15:13:42.304439+0000 mon.c (mon.1) 1280 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:13:43.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:13:43 gibba045 bash[25517]: cephadm 2021-03-10T15:13:42.306426+0000 mgr.gibba045.orlgmj (mgr.34412) 4504 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:13:43.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:13:43 gibba045 bash[25517]: cephadm 2021-03-10T15:13:42.307040+0000 mgr.gibba045.orlgmj (mgr.34412) 4505 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:13:43.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:13:43 gibba045 bash[25517]: audit 2021-03-10T15:13:42.308078+0000 mon.c (mon.1) 1281 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:13:43.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:13:43 gibba045 bash[25517]: cephadm 2021-03-10T15:13:42.310521+0000 mgr.gibba045.orlgmj (mgr.34412) 4506 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:13:43.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:13:43 gibba045 bash[25517]: cephadm 2021-03-10T15:13:42.311110+0000 mgr.gibba045.orlgmj (mgr.34412) 4507 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:13:43.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:13:43 gibba045 bash[25517]: cephadm 2021-03-10T15:13:42.314265+0000 mgr.gibba045.orlgmj (mgr.34412) 4508 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:13:43.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:13:43 gibba045 bash[25517]: audit 2021-03-10T15:13:42.316128+0000 mon.c (mon.1) 1282 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:13:43.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:13:43 gibba045 bash[25517]: cephadm 2021-03-10T15:13:42.317562+0000 mgr.gibba045.orlgmj (mgr.34412) 4509 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:13:43.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:13:43 gibba045 bash[25517]: cephadm 2021-03-10T15:13:42.318029+0000 mgr.gibba045.orlgmj (mgr.34412) 4510 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:13:43.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:13:43 gibba045 bash[25517]: audit 2021-03-10T15:13:42.321987+0000 mon.c (mon.1) 1283 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:13:43.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:13:43 gibba045 bash[25517]: cephadm 2021-03-10T15:13:42.322658+0000 mgr.gibba045.orlgmj (mgr.34412) 4511 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:13:43.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:13:43 gibba045 bash[25517]: cephadm 2021-03-10T15:13:42.325002+0000 mgr.gibba045.orlgmj (mgr.34412) 4512 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:13:43.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:13:43 gibba045 bash[25517]: cephadm 2021-03-10T15:13:42.328022+0000 mgr.gibba045.orlgmj (mgr.34412) 4513 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:13:43.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:13:43 gibba045 bash[25517]: cephadm 2021-03-10T15:13:42.328324+0000 mgr.gibba045.orlgmj (mgr.34412) 4514 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:13:43.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:13:43 gibba045 bash[25517]: cephadm 2021-03-10T15:13:42.328967+0000 mgr.gibba045.orlgmj (mgr.34412) 4515 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:13:43.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:13:43 gibba045 bash[25517]: cluster 2021-03-10T15:13:42.623670+0000 mgr.gibba045.orlgmj (mgr.34412) 4516 : cluster [DBG] pgmap v2558: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:45.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:13:44 gibba015 bash[29377]: cluster 2021-03-10T15:13:44.624488+0000 mgr.gibba045.orlgmj (mgr.34412) 4517 : cluster [DBG] pgmap v2559: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:45.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:13:44 gibba015 bash[30343]: cluster 2021-03-10T15:13:44.624488+0000 mgr.gibba045.orlgmj (mgr.34412) 4517 : cluster [DBG] pgmap v2559: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:45.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:13:44 gibba045 bash[25517]: cluster 2021-03-10T15:13:44.624488+0000 mgr.gibba045.orlgmj (mgr.34412) 4517 : cluster [DBG] pgmap v2559: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:47.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:13:47 gibba015 bash[29377]: cluster 2021-03-10T15:13:46.626252+0000 mgr.gibba045.orlgmj (mgr.34412) 4518 : cluster [DBG] pgmap v2560: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:47.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:13:47 gibba015 bash[30343]: cluster 2021-03-10T15:13:46.626252+0000 mgr.gibba045.orlgmj (mgr.34412) 4518 : cluster [DBG] pgmap v2560: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:48.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:13:47 gibba045 bash[25517]: cluster 2021-03-10T15:13:46.626252+0000 mgr.gibba045.orlgmj (mgr.34412) 4518 : cluster [DBG] pgmap v2560: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:49.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:13:49 gibba015 bash[29377]: cluster 2021-03-10T15:13:48.627349+0000 mgr.gibba045.orlgmj (mgr.34412) 4519 : cluster [DBG] pgmap v2561: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:49.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:13:49 gibba015 bash[30343]: cluster 2021-03-10T15:13:48.627349+0000 mgr.gibba045.orlgmj (mgr.34412) 4519 : cluster [DBG] pgmap v2561: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:50.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:13:49 gibba045 bash[25517]: cluster 2021-03-10T15:13:48.627349+0000 mgr.gibba045.orlgmj (mgr.34412) 4519 : cluster [DBG] pgmap v2561: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:51.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:13:51 gibba015 bash[29377]: cluster 2021-03-10T15:13:50.628980+0000 mgr.gibba045.orlgmj (mgr.34412) 4520 : cluster [DBG] pgmap v2562: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:51.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:13:51 gibba015 bash[30343]: cluster 2021-03-10T15:13:50.628980+0000 mgr.gibba045.orlgmj (mgr.34412) 4520 : cluster [DBG] pgmap v2562: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:52.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:13:51 gibba045 bash[25517]: cluster 2021-03-10T15:13:50.628980+0000 mgr.gibba045.orlgmj (mgr.34412) 4520 : cluster [DBG] pgmap v2562: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:52.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:13:52 gibba015 bash[29377]: cluster 2021-03-10T15:13:52.630386+0000 mgr.gibba045.orlgmj (mgr.34412) 4521 : cluster [DBG] pgmap v2563: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:52.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:13:52 gibba015 bash[30343]: cluster 2021-03-10T15:13:52.630386+0000 mgr.gibba045.orlgmj (mgr.34412) 4521 : cluster [DBG] pgmap v2563: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:53.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:13:52 gibba045 bash[25517]: cluster 2021-03-10T15:13:52.630386+0000 mgr.gibba045.orlgmj (mgr.34412) 4521 : cluster [DBG] pgmap v2563: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:53.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:13:53 gibba015 bash[29377]: audit 2021-03-10T15:13:53.036208+0000 mon.c (mon.1) 1284 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:13:53.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:13:53 gibba015 bash[29377]: audit 2021-03-10T15:13:53.037288+0000 mon.c (mon.1) 1285 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:13:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:13:53 gibba015 bash[29377]: audit 2021-03-10T15:13:53.037418+0000 mon.a (mon.0) 1258 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:13:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:13:53 gibba015 bash[29377]: audit 2021-03-10T15:13:53.038570+0000 mon.a (mon.0) 1259 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:13:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:13:53 gibba015 bash[29377]: audit 2021-03-10T15:13:53.038807+0000 mon.c (mon.1) 1286 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T15:13:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:13:53 gibba015 bash[29377]: audit 2021-03-10T15:13:53.039773+0000 mon.c (mon.1) 1287 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:13:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:13:53 gibba015 bash[29377]: audit 2021-03-10T15:13:53.039897+0000 mon.a (mon.0) 1260 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T15:13:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:13:53 gibba015 bash[29377]: audit 2021-03-10T15:13:53.040452+0000 mon.c (mon.1) 1288 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:13:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:13:53 gibba015 bash[29377]: audit 2021-03-10T15:13:53.041148+0000 mon.a (mon.0) 1261 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:13:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:13:53 gibba015 bash[29377]: audit 2021-03-10T15:13:53.041389+0000 mon.c (mon.1) 1289 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:13:53.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:13:53 gibba015 bash[29377]: audit 2021-03-10T15:13:53.042146+0000 mon.a (mon.0) 1262 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:13:53.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:13:53 gibba015 bash[29377]: audit 2021-03-10T15:13:53.043163+0000 mon.a (mon.0) 1263 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:13:53.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:13:53 gibba015 bash[30343]: audit 2021-03-10T15:13:53.036208+0000 mon.c (mon.1) 1284 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:13:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:13:53 gibba015 bash[30343]: audit 2021-03-10T15:13:53.037288+0000 mon.c (mon.1) 1285 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:13:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:13:53 gibba015 bash[30343]: audit 2021-03-10T15:13:53.037418+0000 mon.a (mon.0) 1258 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:13:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:13:53 gibba015 bash[30343]: audit 2021-03-10T15:13:53.038570+0000 mon.a (mon.0) 1259 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:13:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:13:53 gibba015 bash[30343]: audit 2021-03-10T15:13:53.038807+0000 mon.c (mon.1) 1286 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T15:13:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:13:53 gibba015 bash[30343]: audit 2021-03-10T15:13:53.039773+0000 mon.c (mon.1) 1287 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:13:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:13:53 gibba015 bash[30343]: audit 2021-03-10T15:13:53.039897+0000 mon.a (mon.0) 1260 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T15:13:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:13:53 gibba015 bash[30343]: audit 2021-03-10T15:13:53.040452+0000 mon.c (mon.1) 1288 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:13:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:13:53 gibba015 bash[30343]: audit 2021-03-10T15:13:53.041148+0000 mon.a (mon.0) 1261 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:13:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:13:53 gibba015 bash[30343]: audit 2021-03-10T15:13:53.041389+0000 mon.c (mon.1) 1289 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:13:53.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:13:53 gibba015 bash[30343]: audit 2021-03-10T15:13:53.042146+0000 mon.a (mon.0) 1262 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:13:53.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:13:53 gibba015 bash[30343]: audit 2021-03-10T15:13:53.043163+0000 mon.a (mon.0) 1263 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:13:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:13:53 gibba045 bash[25517]: audit 2021-03-10T15:13:53.036208+0000 mon.c (mon.1) 1284 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:13:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:13:53 gibba045 bash[25517]: audit 2021-03-10T15:13:53.037288+0000 mon.c (mon.1) 1285 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:13:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:13:53 gibba045 bash[25517]: audit 2021-03-10T15:13:53.037418+0000 mon.a (mon.0) 1258 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:13:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:13:53 gibba045 bash[25517]: audit 2021-03-10T15:13:53.038570+0000 mon.a (mon.0) 1259 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:13:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:13:53 gibba045 bash[25517]: audit 2021-03-10T15:13:53.038807+0000 mon.c (mon.1) 1286 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T15:13:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:13:53 gibba045 bash[25517]: audit 2021-03-10T15:13:53.039773+0000 mon.c (mon.1) 1287 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:13:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:13:53 gibba045 bash[25517]: audit 2021-03-10T15:13:53.039897+0000 mon.a (mon.0) 1260 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T15:13:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:13:53 gibba045 bash[25517]: audit 2021-03-10T15:13:53.040452+0000 mon.c (mon.1) 1288 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:13:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:13:53 gibba045 bash[25517]: audit 2021-03-10T15:13:53.041148+0000 mon.a (mon.0) 1261 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:13:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:13:53 gibba045 bash[25517]: audit 2021-03-10T15:13:53.041389+0000 mon.c (mon.1) 1289 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:13:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:13:53 gibba045 bash[25517]: audit 2021-03-10T15:13:53.042146+0000 mon.a (mon.0) 1262 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:13:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:13:53 gibba045 bash[25517]: audit 2021-03-10T15:13:53.043163+0000 mon.a (mon.0) 1263 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:13:55.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:13:54 gibba015 bash[29377]: cluster 2021-03-10T15:13:54.631038+0000 mgr.gibba045.orlgmj (mgr.34412) 4522 : cluster [DBG] pgmap v2564: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:55.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:13:54 gibba015 bash[30343]: cluster 2021-03-10T15:13:54.631038+0000 mgr.gibba045.orlgmj (mgr.34412) 4522 : cluster [DBG] pgmap v2564: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:55.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:13:54 gibba045 bash[25517]: cluster 2021-03-10T15:13:54.631038+0000 mgr.gibba045.orlgmj (mgr.34412) 4522 : cluster [DBG] pgmap v2564: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:57.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:13:57 gibba015 bash[29377]: cluster 2021-03-10T15:13:56.632818+0000 mgr.gibba045.orlgmj (mgr.34412) 4523 : cluster [DBG] pgmap v2565: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:57.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:13:57 gibba015 bash[30343]: cluster 2021-03-10T15:13:56.632818+0000 mgr.gibba045.orlgmj (mgr.34412) 4523 : cluster [DBG] pgmap v2565: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:58.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:13:57 gibba045 bash[25517]: cluster 2021-03-10T15:13:56.632818+0000 mgr.gibba045.orlgmj (mgr.34412) 4523 : cluster [DBG] pgmap v2565: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:58.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:13:58 gibba015 bash[29377]: cephadm 2021-03-10T15:13:57.345205+0000 mgr.gibba045.orlgmj (mgr.34412) 4524 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:13:58.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:13:58 gibba015 bash[30343]: cephadm 2021-03-10T15:13:57.345205+0000 mgr.gibba045.orlgmj (mgr.34412) 4524 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:13:59.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:13:58 gibba045 bash[25517]: cephadm 2021-03-10T15:13:57.345205+0000 mgr.gibba045.orlgmj (mgr.34412) 4524 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:13:59.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:13:59 gibba015 bash[29377]: cluster 2021-03-10T15:13:58.634248+0000 mgr.gibba045.orlgmj (mgr.34412) 4525 : cluster [DBG] pgmap v2566: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:59.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:13:59 gibba015 bash[30343]: cluster 2021-03-10T15:13:58.634248+0000 mgr.gibba045.orlgmj (mgr.34412) 4525 : cluster [DBG] pgmap v2566: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:00.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:13:59 gibba045 bash[25517]: cluster 2021-03-10T15:13:58.634248+0000 mgr.gibba045.orlgmj (mgr.34412) 4525 : cluster [DBG] pgmap v2566: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:01.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:14:00 gibba045 bash[25517]: cluster 2021-03-10T15:14:00.635984+0000 mgr.gibba045.orlgmj (mgr.34412) 4526 : cluster [DBG] pgmap v2567: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:01.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:14:00 gibba015 bash[29377]: cluster 2021-03-10T15:14:00.635984+0000 mgr.gibba045.orlgmj (mgr.34412) 4526 : cluster [DBG] pgmap v2567: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:01.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:14:00 gibba015 bash[30343]: cluster 2021-03-10T15:14:00.635984+0000 mgr.gibba045.orlgmj (mgr.34412) 4526 : cluster [DBG] pgmap v2567: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:03.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:14:03 gibba015 bash[29377]: cluster 2021-03-10T15:14:02.637593+0000 mgr.gibba045.orlgmj (mgr.34412) 4527 : cluster [DBG] pgmap v2568: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:03.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:14:03 gibba015 bash[30343]: cluster 2021-03-10T15:14:02.637593+0000 mgr.gibba045.orlgmj (mgr.34412) 4527 : cluster [DBG] pgmap v2568: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:04.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:14:03 gibba045 bash[25517]: cluster 2021-03-10T15:14:02.637593+0000 mgr.gibba045.orlgmj (mgr.34412) 4527 : cluster [DBG] pgmap v2568: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:05.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:14:04 gibba015 bash[29377]: cluster 2021-03-10T15:14:04.638327+0000 mgr.gibba045.orlgmj (mgr.34412) 4528 : cluster [DBG] pgmap v2569: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:05.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:14:04 gibba015 bash[30343]: cluster 2021-03-10T15:14:04.638327+0000 mgr.gibba045.orlgmj (mgr.34412) 4528 : cluster [DBG] pgmap v2569: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:05.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:14:04 gibba045 bash[25517]: cluster 2021-03-10T15:14:04.638327+0000 mgr.gibba045.orlgmj (mgr.34412) 4528 : cluster [DBG] pgmap v2569: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:07.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:14:07 gibba015 bash[29377]: cluster 2021-03-10T15:14:06.639820+0000 mgr.gibba045.orlgmj (mgr.34412) 4529 : cluster [DBG] pgmap v2570: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:07.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:14:07 gibba015 bash[30343]: cluster 2021-03-10T15:14:06.639820+0000 mgr.gibba045.orlgmj (mgr.34412) 4529 : cluster [DBG] pgmap v2570: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:08.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:14:07 gibba045 bash[25517]: cluster 2021-03-10T15:14:06.639820+0000 mgr.gibba045.orlgmj (mgr.34412) 4529 : cluster [DBG] pgmap v2570: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:08.837 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:14:09.067 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:14:09.067 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (84m) 9m ago 90m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:14:09.068 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (90m) 8m ago 90m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:14:09.068 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (85m) 8m ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:14:09.068 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (85m) 8m ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:14:09.068 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (84m) 9m ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:14:09.069 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (84m) 9m ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:14:09.069 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (83m) 8m ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:14:09.069 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (84m) 9m ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:14:09.069 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (90m) 9m ago 90m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:14:09.070 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (90m) 8m ago 90m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:14:09.070 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (83m) 9m ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:14:09.070 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (82m) 9m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:14:09.070 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (82m) 9m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:14:09.071 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (81m) 9m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:14:09.071 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (81m) 8m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:14:09.071 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (81m) 8m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:14:09.071 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (80m) 8m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:14:09.072 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (80m) 8m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:14:09.072 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (89m) 8m ago 90m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:14:09.072 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 8m ago 88m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:14:09.316 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:14:09.316 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:14:09.317 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:14:09.317 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:14:09.317 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:14:09.317 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:14:09.318 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:14:09.318 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:14:09.318 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:14:09.318 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:14:09.319 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:14:09.319 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:14:09.319 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:14:09.319 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:14:09.320 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:14:09.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:14:09 gibba015 bash[29377]: cluster 2021-03-10T15:14:08.641200+0000 mgr.gibba045.orlgmj (mgr.34412) 4530 : cluster [DBG] pgmap v2571: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:09.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:14:09 gibba015 bash[29377]: audit 2021-03-10T15:14:09.312467+0000 mon.a (mon.0) 1264 : audit [DBG] from='client.? 172.21.2.115:0/113393378' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:14:09.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:14:09 gibba015 bash[30343]: cluster 2021-03-10T15:14:08.641200+0000 mgr.gibba045.orlgmj (mgr.34412) 4530 : cluster [DBG] pgmap v2571: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:09.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:14:09 gibba015 bash[30343]: audit 2021-03-10T15:14:09.312467+0000 mon.a (mon.0) 1264 : audit [DBG] from='client.? 172.21.2.115:0/113393378' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:14:10.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:14:09 gibba045 bash[25517]: cluster 2021-03-10T15:14:08.641200+0000 mgr.gibba045.orlgmj (mgr.34412) 4530 : cluster [DBG] pgmap v2571: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:10.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:14:09 gibba045 bash[25517]: audit 2021-03-10T15:14:09.312467+0000 mon.a (mon.0) 1264 : audit [DBG] from='client.? 172.21.2.115:0/113393378' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:14:10.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:14:10 gibba015 bash[29377]: audit 2021-03-10T15:14:08.829031+0000 mgr.gibba045.orlgmj (mgr.34412) 4531 : audit [DBG] from='client.57082 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:14:10.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:14:10 gibba015 bash[29377]: audit 2021-03-10T15:14:09.054848+0000 mgr.gibba045.orlgmj (mgr.34412) 4532 : audit [DBG] from='client.57088 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:14:10.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:14:10 gibba015 bash[30343]: audit 2021-03-10T15:14:08.829031+0000 mgr.gibba045.orlgmj (mgr.34412) 4531 : audit [DBG] from='client.57082 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:14:10.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:14:10 gibba015 bash[30343]: audit 2021-03-10T15:14:09.054848+0000 mgr.gibba045.orlgmj (mgr.34412) 4532 : audit [DBG] from='client.57088 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:14:11.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:14:10 gibba045 bash[25517]: audit 2021-03-10T15:14:08.829031+0000 mgr.gibba045.orlgmj (mgr.34412) 4531 : audit [DBG] from='client.57082 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:14:11.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:14:10 gibba045 bash[25517]: audit 2021-03-10T15:14:09.054848+0000 mgr.gibba045.orlgmj (mgr.34412) 4532 : audit [DBG] from='client.57088 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:14:11.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:14:11 gibba015 bash[29377]: cluster 2021-03-10T15:14:10.642914+0000 mgr.gibba045.orlgmj (mgr.34412) 4533 : cluster [DBG] pgmap v2572: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:11.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:14:11 gibba015 bash[30343]: cluster 2021-03-10T15:14:10.642914+0000 mgr.gibba045.orlgmj (mgr.34412) 4533 : cluster [DBG] pgmap v2572: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:12.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:14:11 gibba045 bash[25517]: cluster 2021-03-10T15:14:10.642914+0000 mgr.gibba045.orlgmj (mgr.34412) 4533 : cluster [DBG] pgmap v2572: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:13.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:14:12 gibba045 bash[25517]: cephadm 2021-03-10T15:14:12.346823+0000 mgr.gibba045.orlgmj (mgr.34412) 4534 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:14:13.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:14:12 gibba045 bash[25517]: cluster 2021-03-10T15:14:12.644607+0000 mgr.gibba045.orlgmj (mgr.34412) 4535 : cluster [DBG] pgmap v2573: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:13.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:14:12 gibba015 bash[29377]: cephadm 2021-03-10T15:14:12.346823+0000 mgr.gibba045.orlgmj (mgr.34412) 4534 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:14:13.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:14:12 gibba015 bash[29377]: cluster 2021-03-10T15:14:12.644607+0000 mgr.gibba045.orlgmj (mgr.34412) 4535 : cluster [DBG] pgmap v2573: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:13.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:14:12 gibba015 bash[30343]: cephadm 2021-03-10T15:14:12.346823+0000 mgr.gibba045.orlgmj (mgr.34412) 4534 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:14:13.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:14:12 gibba015 bash[30343]: cluster 2021-03-10T15:14:12.644607+0000 mgr.gibba045.orlgmj (mgr.34412) 4535 : cluster [DBG] pgmap v2573: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:15.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:14:14 gibba015 bash[29377]: cluster 2021-03-10T15:14:14.645521+0000 mgr.gibba045.orlgmj (mgr.34412) 4536 : cluster [DBG] pgmap v2574: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:15.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:14:14 gibba015 bash[30343]: cluster 2021-03-10T15:14:14.645521+0000 mgr.gibba045.orlgmj (mgr.34412) 4536 : cluster [DBG] pgmap v2574: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:15.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:14:14 gibba045 bash[25517]: cluster 2021-03-10T15:14:14.645521+0000 mgr.gibba045.orlgmj (mgr.34412) 4536 : cluster [DBG] pgmap v2574: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:17.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:14:17 gibba015 bash[29377]: cluster 2021-03-10T15:14:16.647311+0000 mgr.gibba045.orlgmj (mgr.34412) 4537 : cluster [DBG] pgmap v2575: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:17.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:14:17 gibba015 bash[30343]: cluster 2021-03-10T15:14:16.647311+0000 mgr.gibba045.orlgmj (mgr.34412) 4537 : cluster [DBG] pgmap v2575: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:18.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:14:17 gibba045 bash[25517]: cluster 2021-03-10T15:14:16.647311+0000 mgr.gibba045.orlgmj (mgr.34412) 4537 : cluster [DBG] pgmap v2575: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:19.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:14:18 gibba045 bash[25517]: cluster 2021-03-10T15:14:18.648372+0000 mgr.gibba045.orlgmj (mgr.34412) 4538 : cluster [DBG] pgmap v2576: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:19.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:14:18 gibba015 bash[30343]: cluster 2021-03-10T15:14:18.648372+0000 mgr.gibba045.orlgmj (mgr.34412) 4538 : cluster [DBG] pgmap v2576: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:19.246 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:14:18 gibba015 bash[29377]: cluster 2021-03-10T15:14:18.648372+0000 mgr.gibba045.orlgmj (mgr.34412) 4538 : cluster [DBG] pgmap v2576: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:21.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:14:21 gibba015 bash[29377]: cluster 2021-03-10T15:14:20.649803+0000 mgr.gibba045.orlgmj (mgr.34412) 4539 : cluster [DBG] pgmap v2577: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:21.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:14:21 gibba015 bash[30343]: cluster 2021-03-10T15:14:20.649803+0000 mgr.gibba045.orlgmj (mgr.34412) 4539 : cluster [DBG] pgmap v2577: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:22.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:14:21 gibba045 bash[25517]: cluster 2021-03-10T15:14:20.649803+0000 mgr.gibba045.orlgmj (mgr.34412) 4539 : cluster [DBG] pgmap v2577: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:23.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:14:22 gibba045 bash[25517]: cluster 2021-03-10T15:14:22.651512+0000 mgr.gibba045.orlgmj (mgr.34412) 4540 : cluster [DBG] pgmap v2578: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:23.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:14:22 gibba015 bash[29377]: cluster 2021-03-10T15:14:22.651512+0000 mgr.gibba045.orlgmj (mgr.34412) 4540 : cluster [DBG] pgmap v2578: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:23.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:14:22 gibba015 bash[30343]: cluster 2021-03-10T15:14:22.651512+0000 mgr.gibba045.orlgmj (mgr.34412) 4540 : cluster [DBG] pgmap v2578: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:25.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:14:24 gibba015 bash[29377]: cluster 2021-03-10T15:14:24.652338+0000 mgr.gibba045.orlgmj (mgr.34412) 4541 : cluster [DBG] pgmap v2579: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:25.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:14:24 gibba015 bash[30343]: cluster 2021-03-10T15:14:24.652338+0000 mgr.gibba045.orlgmj (mgr.34412) 4541 : cluster [DBG] pgmap v2579: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:25.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:14:24 gibba045 bash[25517]: cluster 2021-03-10T15:14:24.652338+0000 mgr.gibba045.orlgmj (mgr.34412) 4541 : cluster [DBG] pgmap v2579: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:27.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:14:27 gibba015 bash[29377]: cluster 2021-03-10T15:14:26.654022+0000 mgr.gibba045.orlgmj (mgr.34412) 4542 : cluster [DBG] pgmap v2580: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:27.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:14:27 gibba015 bash[30343]: cluster 2021-03-10T15:14:26.654022+0000 mgr.gibba045.orlgmj (mgr.34412) 4542 : cluster [DBG] pgmap v2580: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:28.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:14:27 gibba045 bash[25517]: cluster 2021-03-10T15:14:26.654022+0000 mgr.gibba045.orlgmj (mgr.34412) 4542 : cluster [DBG] pgmap v2580: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:28.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:14:28 gibba015 bash[29377]: cephadm 2021-03-10T15:14:27.362814+0000 mgr.gibba045.orlgmj (mgr.34412) 4543 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:14:28.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:14:28 gibba015 bash[29377]: cluster 2021-03-10T15:14:28.655210+0000 mgr.gibba045.orlgmj (mgr.34412) 4544 : cluster [DBG] pgmap v2581: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:28.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:14:28 gibba015 bash[30343]: cephadm 2021-03-10T15:14:27.362814+0000 mgr.gibba045.orlgmj (mgr.34412) 4543 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:14:28.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:14:28 gibba015 bash[30343]: cluster 2021-03-10T15:14:28.655210+0000 mgr.gibba045.orlgmj (mgr.34412) 4544 : cluster [DBG] pgmap v2581: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:29.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:14:28 gibba045 bash[25517]: cephadm 2021-03-10T15:14:27.362814+0000 mgr.gibba045.orlgmj (mgr.34412) 4543 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:14:29.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:14:28 gibba045 bash[25517]: cluster 2021-03-10T15:14:28.655210+0000 mgr.gibba045.orlgmj (mgr.34412) 4544 : cluster [DBG] pgmap v2581: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:31.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:14:31 gibba015 bash[29377]: cluster 2021-03-10T15:14:30.656725+0000 mgr.gibba045.orlgmj (mgr.34412) 4545 : cluster [DBG] pgmap v2582: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:31.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:14:31 gibba015 bash[30343]: cluster 2021-03-10T15:14:30.656725+0000 mgr.gibba045.orlgmj (mgr.34412) 4545 : cluster [DBG] pgmap v2582: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:32.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:14:31 gibba045 bash[25517]: cluster 2021-03-10T15:14:30.656725+0000 mgr.gibba045.orlgmj (mgr.34412) 4545 : cluster [DBG] pgmap v2582: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:33.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:14:32 gibba045 bash[25517]: cluster 2021-03-10T15:14:32.658393+0000 mgr.gibba045.orlgmj (mgr.34412) 4546 : cluster [DBG] pgmap v2583: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:33.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:14:32 gibba015 bash[29377]: cluster 2021-03-10T15:14:32.658393+0000 mgr.gibba045.orlgmj (mgr.34412) 4546 : cluster [DBG] pgmap v2583: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:33.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:14:32 gibba015 bash[30343]: cluster 2021-03-10T15:14:32.658393+0000 mgr.gibba045.orlgmj (mgr.34412) 4546 : cluster [DBG] pgmap v2583: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:35.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:14:34 gibba015 bash[29377]: cluster 2021-03-10T15:14:34.659270+0000 mgr.gibba045.orlgmj (mgr.34412) 4547 : cluster [DBG] pgmap v2584: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:35.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:14:34 gibba015 bash[30343]: cluster 2021-03-10T15:14:34.659270+0000 mgr.gibba045.orlgmj (mgr.34412) 4547 : cluster [DBG] pgmap v2584: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:35.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:14:34 gibba045 bash[25517]: cluster 2021-03-10T15:14:34.659270+0000 mgr.gibba045.orlgmj (mgr.34412) 4547 : cluster [DBG] pgmap v2584: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:38.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:14:37 gibba045 bash[25517]: cluster 2021-03-10T15:14:36.661092+0000 mgr.gibba045.orlgmj (mgr.34412) 4548 : cluster [DBG] pgmap v2585: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:38.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:14:37 gibba015 bash[29377]: cluster 2021-03-10T15:14:36.661092+0000 mgr.gibba045.orlgmj (mgr.34412) 4548 : cluster [DBG] pgmap v2585: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:38.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:14:37 gibba015 bash[30343]: cluster 2021-03-10T15:14:36.661092+0000 mgr.gibba045.orlgmj (mgr.34412) 4548 : cluster [DBG] pgmap v2585: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:39.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:14:38 gibba045 bash[25517]: cluster 2021-03-10T15:14:38.662496+0000 mgr.gibba045.orlgmj (mgr.34412) 4549 : cluster [DBG] pgmap v2586: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:39.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:14:38 gibba015 bash[29377]: cluster 2021-03-10T15:14:38.662496+0000 mgr.gibba045.orlgmj (mgr.34412) 4549 : cluster [DBG] pgmap v2586: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:39.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:14:38 gibba015 bash[30343]: cluster 2021-03-10T15:14:38.662496+0000 mgr.gibba045.orlgmj (mgr.34412) 4549 : cluster [DBG] pgmap v2586: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:39.557 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:14:39.790 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:14:39.790 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (85m) 10m ago 90m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:14:39.791 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (90m) 9m ago 90m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:14:39.791 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (85m) 9m ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:14:39.791 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (86m) 9m ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:14:39.791 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (85m) 10m ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:14:39.792 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (84m) 10m ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:14:39.792 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (84m) 9m ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:14:39.792 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (84m) 10m ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:14:39.792 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (90m) 10m ago 90m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:14:39.793 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (90m) 9m ago 90m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:14:39.793 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (83m) 10m ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:14:39.793 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (83m) 10m ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:14:39.793 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (82m) 10m ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:14:39.794 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (82m) 10m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:14:39.794 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (81m) 9m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:14:39.794 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (81m) 9m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:14:39.794 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (81m) 9m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:14:39.795 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (80m) 9m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:14:39.795 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (90m) 9m ago 90m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:14:39.795 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 9m ago 88m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:14:40.039 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:14:40.040 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:14:40.040 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:14:40.040 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:14:40.040 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:14:40.041 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:14:40.041 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:14:40.041 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:14:40.041 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:14:40.042 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:14:40.042 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:14:40.042 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:14:40.042 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:14:40.043 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:14:40.043 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:14:40.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:14:39 gibba015 bash[29377]: audit 2021-03-10T15:14:39.548464+0000 mgr.gibba045.orlgmj (mgr.34412) 4550 : audit [DBG] from='client.57100 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:14:40.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:14:39 gibba015 bash[30343]: audit 2021-03-10T15:14:39.548464+0000 mgr.gibba045.orlgmj (mgr.34412) 4550 : audit [DBG] from='client.57100 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:14:40.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:14:39 gibba045 bash[25517]: audit 2021-03-10T15:14:39.548464+0000 mgr.gibba045.orlgmj (mgr.34412) 4550 : audit [DBG] from='client.57100 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:14:41.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:14:40 gibba015 bash[29377]: audit 2021-03-10T15:14:39.778617+0000 mgr.gibba045.orlgmj (mgr.34412) 4551 : audit [DBG] from='client.47118 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:14:41.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:14:40 gibba015 bash[29377]: audit 2021-03-10T15:14:40.035736+0000 mon.a (mon.0) 1265 : audit [DBG] from='client.? 172.21.2.115:0/425696795' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:14:41.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:14:40 gibba015 bash[29377]: cluster 2021-03-10T15:14:40.664058+0000 mgr.gibba045.orlgmj (mgr.34412) 4552 : cluster [DBG] pgmap v2587: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:41.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:14:40 gibba015 bash[30343]: audit 2021-03-10T15:14:39.778617+0000 mgr.gibba045.orlgmj (mgr.34412) 4551 : audit [DBG] from='client.47118 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:14:41.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:14:40 gibba015 bash[30343]: audit 2021-03-10T15:14:40.035736+0000 mon.a (mon.0) 1265 : audit [DBG] from='client.? 172.21.2.115:0/425696795' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:14:41.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:14:40 gibba015 bash[30343]: cluster 2021-03-10T15:14:40.664058+0000 mgr.gibba045.orlgmj (mgr.34412) 4552 : cluster [DBG] pgmap v2587: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:41.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:14:40 gibba045 bash[25517]: audit 2021-03-10T15:14:39.778617+0000 mgr.gibba045.orlgmj (mgr.34412) 4551 : audit [DBG] from='client.47118 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:14:41.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:14:40 gibba045 bash[25517]: audit 2021-03-10T15:14:40.035736+0000 mon.a (mon.0) 1265 : audit [DBG] from='client.? 172.21.2.115:0/425696795' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:14:41.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:14:40 gibba045 bash[25517]: cluster 2021-03-10T15:14:40.664058+0000 mgr.gibba045.orlgmj (mgr.34412) 4552 : cluster [DBG] pgmap v2587: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:42.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:14:42 gibba015 bash[29377]: audit 2021-03-10T15:14:42.375749+0000 mon.c (mon.1) 1290 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:14:42.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:14:42 gibba015 bash[29377]: audit 2021-03-10T15:14:42.382201+0000 mon.c (mon.1) 1291 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:14:42.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:14:42 gibba015 bash[30343]: audit 2021-03-10T15:14:42.375749+0000 mon.c (mon.1) 1290 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:14:42.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:14:42 gibba015 bash[30343]: audit 2021-03-10T15:14:42.382201+0000 mon.c (mon.1) 1291 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:14:42.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:14:42 gibba045 bash[25517]: audit 2021-03-10T15:14:42.375749+0000 mon.c (mon.1) 1290 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:14:42.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:14:42 gibba045 bash[25517]: audit 2021-03-10T15:14:42.382201+0000 mon.c (mon.1) 1291 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:14:43.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:14:43 gibba015 bash[29377]: cephadm 2021-03-10T15:14:42.385956+0000 mgr.gibba045.orlgmj (mgr.34412) 4553 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:14:43.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:14:43 gibba015 bash[29377]: cluster 2021-03-10T15:14:42.665048+0000 mgr.gibba045.orlgmj (mgr.34412) 4554 : cluster [DBG] pgmap v2588: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:43.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:14:43 gibba015 bash[30343]: cephadm 2021-03-10T15:14:42.385956+0000 mgr.gibba045.orlgmj (mgr.34412) 4553 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:14:43.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:14:43 gibba015 bash[30343]: cluster 2021-03-10T15:14:42.665048+0000 mgr.gibba045.orlgmj (mgr.34412) 4554 : cluster [DBG] pgmap v2588: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:43.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:14:43 gibba045 bash[25517]: cephadm 2021-03-10T15:14:42.385956+0000 mgr.gibba045.orlgmj (mgr.34412) 4553 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:14:43.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:14:43 gibba045 bash[25517]: cluster 2021-03-10T15:14:42.665048+0000 mgr.gibba045.orlgmj (mgr.34412) 4554 : cluster [DBG] pgmap v2588: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:45.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:14:44 gibba015 bash[29377]: cluster 2021-03-10T15:14:44.665655+0000 mgr.gibba045.orlgmj (mgr.34412) 4555 : cluster [DBG] pgmap v2589: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:45.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:14:44 gibba015 bash[30343]: cluster 2021-03-10T15:14:44.665655+0000 mgr.gibba045.orlgmj (mgr.34412) 4555 : cluster [DBG] pgmap v2589: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:45.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:14:44 gibba045 bash[25517]: cluster 2021-03-10T15:14:44.665655+0000 mgr.gibba045.orlgmj (mgr.34412) 4555 : cluster [DBG] pgmap v2589: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:47.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:14:46 gibba015 bash[29377]: audit 2021-03-10T15:14:45.892325+0000 mon.a (mon.0) 1266 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:14:47.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:14:46 gibba015 bash[29377]: cephadm 2021-03-10T15:14:45.901212+0000 mgr.gibba045.orlgmj (mgr.34412) 4556 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:14:47.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:14:46 gibba015 bash[29377]: audit 2021-03-10T15:14:46.093123+0000 mon.a (mon.0) 1267 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:14:47.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:14:46 gibba015 bash[29377]: audit 2021-03-10T15:14:46.100599+0000 mon.c (mon.1) 1292 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:14:47.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:14:46 gibba015 bash[29377]: audit 2021-03-10T15:14:46.102020+0000 mon.c (mon.1) 1293 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:14:47.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:14:46 gibba015 bash[29377]: audit 2021-03-10T15:14:46.103256+0000 mon.c (mon.1) 1294 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:14:47.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:14:46 gibba015 bash[29377]: cephadm 2021-03-10T15:14:46.103871+0000 mgr.gibba045.orlgmj (mgr.34412) 4557 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:14:47.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:14:46 gibba015 bash[29377]: audit 2021-03-10T15:14:46.104599+0000 mon.c (mon.1) 1295 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:14:47.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:14:46 gibba015 bash[29377]: cephadm 2021-03-10T15:14:46.105687+0000 mgr.gibba045.orlgmj (mgr.34412) 4558 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:14:47.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:14:46 gibba015 bash[29377]: cephadm 2021-03-10T15:14:46.106889+0000 mgr.gibba045.orlgmj (mgr.34412) 4559 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:14:47.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:14:46 gibba015 bash[29377]: cephadm 2021-03-10T15:14:46.106929+0000 mgr.gibba045.orlgmj (mgr.34412) 4560 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:14:47.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:14:46 gibba015 bash[29377]: audit 2021-03-10T15:14:46.107335+0000 mon.c (mon.1) 1296 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:14:47.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:14:46 gibba015 bash[29377]: cephadm 2021-03-10T15:14:46.108094+0000 mgr.gibba045.orlgmj (mgr.34412) 4561 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:14:47.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:14:46 gibba015 bash[29377]: cephadm 2021-03-10T15:14:46.108133+0000 mgr.gibba045.orlgmj (mgr.34412) 4562 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:14:47.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:14:46 gibba015 bash[29377]: audit 2021-03-10T15:14:46.108701+0000 mon.c (mon.1) 1297 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:14:47.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:14:46 gibba015 bash[29377]: cephadm 2021-03-10T15:14:46.109357+0000 mgr.gibba045.orlgmj (mgr.34412) 4563 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:14:47.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:14:46 gibba015 bash[29377]: cephadm 2021-03-10T15:14:46.110885+0000 mgr.gibba045.orlgmj (mgr.34412) 4564 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:14:47.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:14:46 gibba015 bash[29377]: cephadm 2021-03-10T15:14:46.110924+0000 mgr.gibba045.orlgmj (mgr.34412) 4565 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:14:47.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:14:46 gibba015 bash[29377]: cephadm 2021-03-10T15:14:46.112092+0000 mgr.gibba045.orlgmj (mgr.34412) 4566 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:14:47.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:14:46 gibba015 bash[29377]: cephadm 2021-03-10T15:14:46.112447+0000 mgr.gibba045.orlgmj (mgr.34412) 4567 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:14:47.230 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:14:46 gibba015 bash[29377]: cephadm 2021-03-10T15:14:46.113402+0000 mgr.gibba045.orlgmj (mgr.34412) 4568 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:14:47.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:14:46 gibba015 bash[30343]: audit 2021-03-10T15:14:45.892325+0000 mon.a (mon.0) 1266 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:14:47.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:14:46 gibba015 bash[30343]: cephadm 2021-03-10T15:14:45.901212+0000 mgr.gibba045.orlgmj (mgr.34412) 4556 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:14:47.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:14:46 gibba015 bash[30343]: audit 2021-03-10T15:14:46.093123+0000 mon.a (mon.0) 1267 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:14:47.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:14:46 gibba015 bash[30343]: audit 2021-03-10T15:14:46.100599+0000 mon.c (mon.1) 1292 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:14:47.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:14:46 gibba015 bash[30343]: audit 2021-03-10T15:14:46.102020+0000 mon.c (mon.1) 1293 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:14:47.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:14:46 gibba015 bash[30343]: audit 2021-03-10T15:14:46.103256+0000 mon.c (mon.1) 1294 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:14:47.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:14:46 gibba015 bash[30343]: cephadm 2021-03-10T15:14:46.103871+0000 mgr.gibba045.orlgmj (mgr.34412) 4557 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:14:47.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:14:46 gibba015 bash[30343]: audit 2021-03-10T15:14:46.104599+0000 mon.c (mon.1) 1295 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:14:47.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:14:46 gibba015 bash[30343]: cephadm 2021-03-10T15:14:46.105687+0000 mgr.gibba045.orlgmj (mgr.34412) 4558 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:14:47.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:14:46 gibba015 bash[30343]: cephadm 2021-03-10T15:14:46.106889+0000 mgr.gibba045.orlgmj (mgr.34412) 4559 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:14:47.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:14:46 gibba015 bash[30343]: cephadm 2021-03-10T15:14:46.106929+0000 mgr.gibba045.orlgmj (mgr.34412) 4560 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:14:47.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:14:46 gibba015 bash[30343]: audit 2021-03-10T15:14:46.107335+0000 mon.c (mon.1) 1296 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:14:47.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:14:46 gibba015 bash[30343]: cephadm 2021-03-10T15:14:46.108094+0000 mgr.gibba045.orlgmj (mgr.34412) 4561 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:14:47.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:14:46 gibba015 bash[30343]: cephadm 2021-03-10T15:14:46.108133+0000 mgr.gibba045.orlgmj (mgr.34412) 4562 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:14:47.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:14:46 gibba015 bash[30343]: audit 2021-03-10T15:14:46.108701+0000 mon.c (mon.1) 1297 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:14:47.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:14:46 gibba015 bash[30343]: cephadm 2021-03-10T15:14:46.109357+0000 mgr.gibba045.orlgmj (mgr.34412) 4563 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:14:47.234 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:14:46 gibba015 bash[30343]: cephadm 2021-03-10T15:14:46.110885+0000 mgr.gibba045.orlgmj (mgr.34412) 4564 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:14:47.234 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:14:46 gibba015 bash[30343]: cephadm 2021-03-10T15:14:46.110924+0000 mgr.gibba045.orlgmj (mgr.34412) 4565 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:14:47.234 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:14:46 gibba015 bash[30343]: cephadm 2021-03-10T15:14:46.112092+0000 mgr.gibba045.orlgmj (mgr.34412) 4566 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:14:47.234 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:14:46 gibba015 bash[30343]: cephadm 2021-03-10T15:14:46.112447+0000 mgr.gibba045.orlgmj (mgr.34412) 4567 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:14:47.235 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:14:46 gibba015 bash[30343]: cephadm 2021-03-10T15:14:46.113402+0000 mgr.gibba045.orlgmj (mgr.34412) 4568 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:14:47.235 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:14:46 gibba015 bash[30343]: cephadm 2021-03-10T15:14:46.113444+0000 mgr.gibba045.orlgmj (mgr.34412) 4569 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:14:47.235 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:14:46 gibba015 bash[30343]: cephadm 2021-03-10T15:14:46.113561+0000 mgr.gibba045.orlgmj (mgr.34412) 4570 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:14:47.235 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:14:46 gibba015 bash[30343]: cluster 2021-03-10T15:14:46.667448+0000 mgr.gibba045.orlgmj (mgr.34412) 4571 : cluster [DBG] pgmap v2590: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:47.236 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:14:46 gibba015 bash[29377]: cephadm 2021-03-10T15:14:46.113444+0000 mgr.gibba045.orlgmj (mgr.34412) 4569 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:14:47.236 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:14:46 gibba015 bash[29377]: cephadm 2021-03-10T15:14:46.113561+0000 mgr.gibba045.orlgmj (mgr.34412) 4570 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:14:47.236 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:14:46 gibba015 bash[29377]: cluster 2021-03-10T15:14:46.667448+0000 mgr.gibba045.orlgmj (mgr.34412) 4571 : cluster [DBG] pgmap v2590: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:47.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:14:46 gibba045 bash[25517]: audit 2021-03-10T15:14:45.892325+0000 mon.a (mon.0) 1266 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:14:47.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:14:46 gibba045 bash[25517]: cephadm 2021-03-10T15:14:45.901212+0000 mgr.gibba045.orlgmj (mgr.34412) 4556 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:14:47.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:14:46 gibba045 bash[25517]: audit 2021-03-10T15:14:46.093123+0000 mon.a (mon.0) 1267 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:14:47.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:14:46 gibba045 bash[25517]: audit 2021-03-10T15:14:46.100599+0000 mon.c (mon.1) 1292 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:14:47.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:14:46 gibba045 bash[25517]: audit 2021-03-10T15:14:46.102020+0000 mon.c (mon.1) 1293 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:14:47.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:14:46 gibba045 bash[25517]: audit 2021-03-10T15:14:46.103256+0000 mon.c (mon.1) 1294 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:14:47.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:14:46 gibba045 bash[25517]: cephadm 2021-03-10T15:14:46.103871+0000 mgr.gibba045.orlgmj (mgr.34412) 4557 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:14:47.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:14:46 gibba045 bash[25517]: audit 2021-03-10T15:14:46.104599+0000 mon.c (mon.1) 1295 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:14:47.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:14:46 gibba045 bash[25517]: cephadm 2021-03-10T15:14:46.105687+0000 mgr.gibba045.orlgmj (mgr.34412) 4558 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:14:47.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:14:46 gibba045 bash[25517]: cephadm 2021-03-10T15:14:46.106889+0000 mgr.gibba045.orlgmj (mgr.34412) 4559 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:14:47.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:14:46 gibba045 bash[25517]: cephadm 2021-03-10T15:14:46.106929+0000 mgr.gibba045.orlgmj (mgr.34412) 4560 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:14:47.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:14:46 gibba045 bash[25517]: audit 2021-03-10T15:14:46.107335+0000 mon.c (mon.1) 1296 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:14:47.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:14:46 gibba045 bash[25517]: cephadm 2021-03-10T15:14:46.108094+0000 mgr.gibba045.orlgmj (mgr.34412) 4561 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:14:47.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:14:46 gibba045 bash[25517]: cephadm 2021-03-10T15:14:46.108133+0000 mgr.gibba045.orlgmj (mgr.34412) 4562 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:14:47.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:14:46 gibba045 bash[25517]: audit 2021-03-10T15:14:46.108701+0000 mon.c (mon.1) 1297 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:14:47.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:14:46 gibba045 bash[25517]: cephadm 2021-03-10T15:14:46.109357+0000 mgr.gibba045.orlgmj (mgr.34412) 4563 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:14:47.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:14:46 gibba045 bash[25517]: cephadm 2021-03-10T15:14:46.110885+0000 mgr.gibba045.orlgmj (mgr.34412) 4564 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:14:47.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:14:46 gibba045 bash[25517]: cephadm 2021-03-10T15:14:46.110924+0000 mgr.gibba045.orlgmj (mgr.34412) 4565 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:14:47.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:14:46 gibba045 bash[25517]: cephadm 2021-03-10T15:14:46.112092+0000 mgr.gibba045.orlgmj (mgr.34412) 4566 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:14:47.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:14:46 gibba045 bash[25517]: cephadm 2021-03-10T15:14:46.112447+0000 mgr.gibba045.orlgmj (mgr.34412) 4567 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:14:47.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:14:46 gibba045 bash[25517]: cephadm 2021-03-10T15:14:46.113402+0000 mgr.gibba045.orlgmj (mgr.34412) 4568 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:14:47.312 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:14:46 gibba045 bash[25517]: cephadm 2021-03-10T15:14:46.113444+0000 mgr.gibba045.orlgmj (mgr.34412) 4569 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:14:47.312 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:14:46 gibba045 bash[25517]: cephadm 2021-03-10T15:14:46.113561+0000 mgr.gibba045.orlgmj (mgr.34412) 4570 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:14:47.312 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:14:46 gibba045 bash[25517]: cluster 2021-03-10T15:14:46.667448+0000 mgr.gibba045.orlgmj (mgr.34412) 4571 : cluster [DBG] pgmap v2590: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:49.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:14:48 gibba045 bash[25517]: cluster 2021-03-10T15:14:48.668802+0000 mgr.gibba045.orlgmj (mgr.34412) 4572 : cluster [DBG] pgmap v2591: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:49.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:14:48 gibba015 bash[29377]: cluster 2021-03-10T15:14:48.668802+0000 mgr.gibba045.orlgmj (mgr.34412) 4572 : cluster [DBG] pgmap v2591: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:49.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:14:48 gibba015 bash[30343]: cluster 2021-03-10T15:14:48.668802+0000 mgr.gibba045.orlgmj (mgr.34412) 4572 : cluster [DBG] pgmap v2591: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:51.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:14:50 gibba045 bash[25517]: cluster 2021-03-10T15:14:50.670257+0000 mgr.gibba045.orlgmj (mgr.34412) 4573 : cluster [DBG] pgmap v2592: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:51.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:14:50 gibba015 bash[29377]: cluster 2021-03-10T15:14:50.670257+0000 mgr.gibba045.orlgmj (mgr.34412) 4573 : cluster [DBG] pgmap v2592: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:51.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:14:50 gibba015 bash[30343]: cluster 2021-03-10T15:14:50.670257+0000 mgr.gibba045.orlgmj (mgr.34412) 4573 : cluster [DBG] pgmap v2592: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:53.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:14:52 gibba045 bash[25517]: cluster 2021-03-10T15:14:52.671927+0000 mgr.gibba045.orlgmj (mgr.34412) 4574 : cluster [DBG] pgmap v2593: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:53.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:14:52 gibba015 bash[29377]: cluster 2021-03-10T15:14:52.671927+0000 mgr.gibba045.orlgmj (mgr.34412) 4574 : cluster [DBG] pgmap v2593: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:53.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:14:52 gibba015 bash[30343]: cluster 2021-03-10T15:14:52.671927+0000 mgr.gibba045.orlgmj (mgr.34412) 4574 : cluster [DBG] pgmap v2593: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:14:53 gibba045 bash[25517]: audit 2021-03-10T15:14:53.043447+0000 mon.c (mon.1) 1298 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:14:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:14:53 gibba045 bash[25517]: audit 2021-03-10T15:14:53.044152+0000 mon.c (mon.1) 1299 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:14:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:14:53 gibba045 bash[25517]: audit 2021-03-10T15:14:53.044564+0000 mon.a (mon.0) 1268 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:14:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:14:53 gibba045 bash[25517]: audit 2021-03-10T15:14:53.044832+0000 mon.c (mon.1) 1300 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T15:14:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:14:53 gibba045 bash[25517]: audit 2021-03-10T15:14:53.045764+0000 mon.a (mon.0) 1269 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:14:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:14:53 gibba045 bash[25517]: audit 2021-03-10T15:14:53.045976+0000 mon.c (mon.1) 1301 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:14:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:14:53 gibba045 bash[25517]: audit 2021-03-10T15:14:53.046687+0000 mon.a (mon.0) 1270 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T15:14:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:14:53 gibba045 bash[25517]: audit 2021-03-10T15:14:53.046831+0000 mon.c (mon.1) 1302 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:14:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:14:53 gibba045 bash[25517]: audit 2021-03-10T15:14:53.047682+0000 mon.a (mon.0) 1271 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:14:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:14:53 gibba045 bash[25517]: audit 2021-03-10T15:14:53.047730+0000 mon.c (mon.1) 1303 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T15:14:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:14:53 gibba045 bash[25517]: audit 2021-03-10T15:14:53.048643+0000 mon.a (mon.0) 1272 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:14:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:14:53 gibba045 bash[25517]: audit 2021-03-10T15:14:53.048828+0000 mon.a (mon.0) 1273 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T15:14:54.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:14:53 gibba015 bash[29377]: audit 2021-03-10T15:14:53.043447+0000 mon.c (mon.1) 1298 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:14:54.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:14:53 gibba015 bash[29377]: audit 2021-03-10T15:14:53.044152+0000 mon.c (mon.1) 1299 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:14:54.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:14:53 gibba015 bash[29377]: audit 2021-03-10T15:14:53.044564+0000 mon.a (mon.0) 1268 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:14:54.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:14:53 gibba015 bash[29377]: audit 2021-03-10T15:14:53.044832+0000 mon.c (mon.1) 1300 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T15:14:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:14:53 gibba015 bash[29377]: audit 2021-03-10T15:14:53.045764+0000 mon.a (mon.0) 1269 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:14:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:14:53 gibba015 bash[29377]: audit 2021-03-10T15:14:53.045976+0000 mon.c (mon.1) 1301 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:14:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:14:53 gibba015 bash[29377]: audit 2021-03-10T15:14:53.046687+0000 mon.a (mon.0) 1270 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T15:14:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:14:53 gibba015 bash[29377]: audit 2021-03-10T15:14:53.046831+0000 mon.c (mon.1) 1302 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:14:54.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:14:53 gibba015 bash[29377]: audit 2021-03-10T15:14:53.047682+0000 mon.a (mon.0) 1271 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:14:54.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:14:53 gibba015 bash[29377]: audit 2021-03-10T15:14:53.047730+0000 mon.c (mon.1) 1303 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T15:14:54.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:14:53 gibba015 bash[29377]: audit 2021-03-10T15:14:53.048643+0000 mon.a (mon.0) 1272 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:14:54.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:14:53 gibba015 bash[29377]: audit 2021-03-10T15:14:53.048828+0000 mon.a (mon.0) 1273 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T15:14:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:14:53 gibba015 bash[30343]: audit 2021-03-10T15:14:53.043447+0000 mon.c (mon.1) 1298 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:14:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:14:53 gibba015 bash[30343]: audit 2021-03-10T15:14:53.044152+0000 mon.c (mon.1) 1299 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:14:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:14:53 gibba015 bash[30343]: audit 2021-03-10T15:14:53.044564+0000 mon.a (mon.0) 1268 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:14:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:14:53 gibba015 bash[30343]: audit 2021-03-10T15:14:53.044832+0000 mon.c (mon.1) 1300 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T15:14:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:14:53 gibba015 bash[30343]: audit 2021-03-10T15:14:53.045764+0000 mon.a (mon.0) 1269 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:14:54.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:14:53 gibba015 bash[30343]: audit 2021-03-10T15:14:53.045976+0000 mon.c (mon.1) 1301 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:14:54.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:14:53 gibba015 bash[30343]: audit 2021-03-10T15:14:53.046687+0000 mon.a (mon.0) 1270 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T15:14:54.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:14:53 gibba015 bash[30343]: audit 2021-03-10T15:14:53.046831+0000 mon.c (mon.1) 1302 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:14:54.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:14:53 gibba015 bash[30343]: audit 2021-03-10T15:14:53.047682+0000 mon.a (mon.0) 1271 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:14:54.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:14:53 gibba015 bash[30343]: audit 2021-03-10T15:14:53.047730+0000 mon.c (mon.1) 1303 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T15:14:54.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:14:53 gibba015 bash[30343]: audit 2021-03-10T15:14:53.048643+0000 mon.a (mon.0) 1272 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:14:54.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:14:53 gibba015 bash[30343]: audit 2021-03-10T15:14:53.048828+0000 mon.a (mon.0) 1273 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T15:14:55.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:14:54 gibba015 bash[29377]: cluster 2021-03-10T15:14:54.673589+0000 mgr.gibba045.orlgmj (mgr.34412) 4575 : cluster [DBG] pgmap v2594: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:55.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:14:54 gibba015 bash[30343]: cluster 2021-03-10T15:14:54.673589+0000 mgr.gibba045.orlgmj (mgr.34412) 4575 : cluster [DBG] pgmap v2594: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:55.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:14:54 gibba045 bash[25517]: cluster 2021-03-10T15:14:54.673589+0000 mgr.gibba045.orlgmj (mgr.34412) 4575 : cluster [DBG] pgmap v2594: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:57.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:14:56 gibba045 bash[25517]: cluster 2021-03-10T15:14:56.675289+0000 mgr.gibba045.orlgmj (mgr.34412) 4576 : cluster [DBG] pgmap v2595: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:57.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:14:56 gibba015 bash[29377]: cluster 2021-03-10T15:14:56.675289+0000 mgr.gibba045.orlgmj (mgr.34412) 4576 : cluster [DBG] pgmap v2595: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:57.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:14:56 gibba015 bash[30343]: cluster 2021-03-10T15:14:56.675289+0000 mgr.gibba045.orlgmj (mgr.34412) 4576 : cluster [DBG] pgmap v2595: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:59.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:14:58 gibba045 bash[25517]: cluster 2021-03-10T15:14:58.676674+0000 mgr.gibba045.orlgmj (mgr.34412) 4577 : cluster [DBG] pgmap v2596: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:59.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:14:58 gibba015 bash[29377]: cluster 2021-03-10T15:14:58.676674+0000 mgr.gibba045.orlgmj (mgr.34412) 4577 : cluster [DBG] pgmap v2596: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:59.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:14:58 gibba015 bash[30343]: cluster 2021-03-10T15:14:58.676674+0000 mgr.gibba045.orlgmj (mgr.34412) 4577 : cluster [DBG] pgmap v2596: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:01.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:00 gibba045 bash[25517]: cluster 2021-03-10T15:15:00.678385+0000 mgr.gibba045.orlgmj (mgr.34412) 4578 : cluster [DBG] pgmap v2597: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:01.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:00 gibba015 bash[29377]: cluster 2021-03-10T15:15:00.678385+0000 mgr.gibba045.orlgmj (mgr.34412) 4578 : cluster [DBG] pgmap v2597: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:01.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:00 gibba015 bash[30343]: cluster 2021-03-10T15:15:00.678385+0000 mgr.gibba045.orlgmj (mgr.34412) 4578 : cluster [DBG] pgmap v2597: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:02.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:01 gibba045 bash[25517]: cephadm 2021-03-10T15:15:01.129015+0000 mgr.gibba045.orlgmj (mgr.34412) 4579 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:15:02.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:01 gibba015 bash[29377]: cephadm 2021-03-10T15:15:01.129015+0000 mgr.gibba045.orlgmj (mgr.34412) 4579 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:15:02.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:01 gibba015 bash[30343]: cephadm 2021-03-10T15:15:01.129015+0000 mgr.gibba045.orlgmj (mgr.34412) 4579 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:15:03.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:02 gibba045 bash[25517]: cluster 2021-03-10T15:15:02.680052+0000 mgr.gibba045.orlgmj (mgr.34412) 4580 : cluster [DBG] pgmap v2598: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:03.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:02 gibba015 bash[29377]: cluster 2021-03-10T15:15:02.680052+0000 mgr.gibba045.orlgmj (mgr.34412) 4580 : cluster [DBG] pgmap v2598: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:03.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:02 gibba015 bash[30343]: cluster 2021-03-10T15:15:02.680052+0000 mgr.gibba045.orlgmj (mgr.34412) 4580 : cluster [DBG] pgmap v2598: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:05.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:04 gibba015 bash[29377]: cluster 2021-03-10T15:15:04.681713+0000 mgr.gibba045.orlgmj (mgr.34412) 4581 : cluster [DBG] pgmap v2599: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:05.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:04 gibba015 bash[30343]: cluster 2021-03-10T15:15:04.681713+0000 mgr.gibba045.orlgmj (mgr.34412) 4581 : cluster [DBG] pgmap v2599: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:05.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:04 gibba045 bash[25517]: cluster 2021-03-10T15:15:04.681713+0000 mgr.gibba045.orlgmj (mgr.34412) 4581 : cluster [DBG] pgmap v2599: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:07.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:06 gibba045 bash[25517]: cluster 2021-03-10T15:15:06.683608+0000 mgr.gibba045.orlgmj (mgr.34412) 4582 : cluster [DBG] pgmap v2600: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:07.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:06 gibba015 bash[29377]: cluster 2021-03-10T15:15:06.683608+0000 mgr.gibba045.orlgmj (mgr.34412) 4582 : cluster [DBG] pgmap v2600: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:07.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:06 gibba015 bash[30343]: cluster 2021-03-10T15:15:06.683608+0000 mgr.gibba045.orlgmj (mgr.34412) 4582 : cluster [DBG] pgmap v2600: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:09.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:08 gibba045 bash[25517]: cluster 2021-03-10T15:15:08.684929+0000 mgr.gibba045.orlgmj (mgr.34412) 4583 : cluster [DBG] pgmap v2601: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:09.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:08 gibba015 bash[29377]: cluster 2021-03-10T15:15:08.684929+0000 mgr.gibba045.orlgmj (mgr.34412) 4583 : cluster [DBG] pgmap v2601: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:09.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:08 gibba015 bash[30343]: cluster 2021-03-10T15:15:08.684929+0000 mgr.gibba045.orlgmj (mgr.34412) 4583 : cluster [DBG] pgmap v2601: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:10.287 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:15:10.514 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:15:10.515 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (85m) 24s ago 91m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:15:10.515 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (91m) 9m ago 91m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:15:10.515 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (86m) 9m ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:15:10.516 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (86m) 9m ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:15:10.516 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (85m) 24s ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:15:10.516 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (85m) 24s ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:15:10.516 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (84m) 9m ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:15:10.517 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (85m) 24s ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:15:10.517 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (91m) 24s ago 91m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:15:10.517 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (91m) 9m ago 91m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:15:10.517 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (84m) 24s ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:15:10.518 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (83m) 24s ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:15:10.518 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (83m) 24s ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:15:10.518 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (82m) 24s ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:15:10.518 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (82m) 9m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:15:10.519 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (82m) 9m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:15:10.519 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (81m) 9m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:15:10.519 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (81m) 9m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:15:10.519 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (90m) 9m ago 91m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:15:10.519 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 9m ago 89m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:15:10.762 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:15:10.763 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:15:10.763 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:15:10.763 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:15:10.763 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:15:10.764 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:15:10.764 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:15:10.764 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:15:10.764 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:15:10.765 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:15:10.765 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:15:10.765 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:15:10.765 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:15:10.766 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:15:10.766 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:15:11.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:10 gibba045 bash[25517]: audit 2021-03-10T15:15:10.278234+0000 mgr.gibba045.orlgmj (mgr.34412) 4584 : audit [DBG] from='client.57118 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:15:11.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:10 gibba045 bash[25517]: audit 2021-03-10T15:15:10.502928+0000 mgr.gibba045.orlgmj (mgr.34412) 4585 : audit [DBG] from='client.57124 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:15:11.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:10 gibba045 bash[25517]: cluster 2021-03-10T15:15:10.686402+0000 mgr.gibba045.orlgmj (mgr.34412) 4586 : cluster [DBG] pgmap v2602: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:11.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:10 gibba045 bash[25517]: audit 2021-03-10T15:15:10.758557+0000 mon.a (mon.0) 1274 : audit [DBG] from='client.? 172.21.2.115:0/2050238625' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:15:11.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:10 gibba015 bash[29377]: audit 2021-03-10T15:15:10.278234+0000 mgr.gibba045.orlgmj (mgr.34412) 4584 : audit [DBG] from='client.57118 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:15:11.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:10 gibba015 bash[29377]: audit 2021-03-10T15:15:10.502928+0000 mgr.gibba045.orlgmj (mgr.34412) 4585 : audit [DBG] from='client.57124 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:15:11.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:10 gibba015 bash[29377]: cluster 2021-03-10T15:15:10.686402+0000 mgr.gibba045.orlgmj (mgr.34412) 4586 : cluster [DBG] pgmap v2602: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:11.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:10 gibba015 bash[29377]: audit 2021-03-10T15:15:10.758557+0000 mon.a (mon.0) 1274 : audit [DBG] from='client.? 172.21.2.115:0/2050238625' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:15:11.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:10 gibba015 bash[30343]: audit 2021-03-10T15:15:10.278234+0000 mgr.gibba045.orlgmj (mgr.34412) 4584 : audit [DBG] from='client.57118 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:15:11.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:10 gibba015 bash[30343]: audit 2021-03-10T15:15:10.502928+0000 mgr.gibba045.orlgmj (mgr.34412) 4585 : audit [DBG] from='client.57124 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:15:11.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:10 gibba015 bash[30343]: cluster 2021-03-10T15:15:10.686402+0000 mgr.gibba045.orlgmj (mgr.34412) 4586 : cluster [DBG] pgmap v2602: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:11.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:10 gibba015 bash[30343]: audit 2021-03-10T15:15:10.758557+0000 mon.a (mon.0) 1274 : audit [DBG] from='client.? 172.21.2.115:0/2050238625' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:15:13.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:12 gibba045 bash[25517]: cluster 2021-03-10T15:15:12.688040+0000 mgr.gibba045.orlgmj (mgr.34412) 4587 : cluster [DBG] pgmap v2603: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:13.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:12 gibba015 bash[29377]: cluster 2021-03-10T15:15:12.688040+0000 mgr.gibba045.orlgmj (mgr.34412) 4587 : cluster [DBG] pgmap v2603: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:13.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:12 gibba015 bash[30343]: cluster 2021-03-10T15:15:12.688040+0000 mgr.gibba045.orlgmj (mgr.34412) 4587 : cluster [DBG] pgmap v2603: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:15.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:14 gibba015 bash[29377]: cluster 2021-03-10T15:15:14.689291+0000 mgr.gibba045.orlgmj (mgr.34412) 4588 : cluster [DBG] pgmap v2604: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:15.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:14 gibba015 bash[30343]: cluster 2021-03-10T15:15:14.689291+0000 mgr.gibba045.orlgmj (mgr.34412) 4588 : cluster [DBG] pgmap v2604: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:15.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:14 gibba045 bash[25517]: cluster 2021-03-10T15:15:14.689291+0000 mgr.gibba045.orlgmj (mgr.34412) 4588 : cluster [DBG] pgmap v2604: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:17.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:16 gibba045 bash[25517]: cephadm 2021-03-10T15:15:16.145001+0000 mgr.gibba045.orlgmj (mgr.34412) 4589 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:15:17.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:16 gibba045 bash[25517]: cluster 2021-03-10T15:15:16.691136+0000 mgr.gibba045.orlgmj (mgr.34412) 4590 : cluster [DBG] pgmap v2605: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:17.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:16 gibba015 bash[29377]: cephadm 2021-03-10T15:15:16.145001+0000 mgr.gibba045.orlgmj (mgr.34412) 4589 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:15:17.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:16 gibba015 bash[29377]: cluster 2021-03-10T15:15:16.691136+0000 mgr.gibba045.orlgmj (mgr.34412) 4590 : cluster [DBG] pgmap v2605: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:17.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:16 gibba015 bash[30343]: cephadm 2021-03-10T15:15:16.145001+0000 mgr.gibba045.orlgmj (mgr.34412) 4589 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:15:17.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:16 gibba015 bash[30343]: cluster 2021-03-10T15:15:16.691136+0000 mgr.gibba045.orlgmj (mgr.34412) 4590 : cluster [DBG] pgmap v2605: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:19.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:18 gibba045 bash[25517]: cluster 2021-03-10T15:15:18.692515+0000 mgr.gibba045.orlgmj (mgr.34412) 4591 : cluster [DBG] pgmap v2606: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:19.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:18 gibba015 bash[29377]: cluster 2021-03-10T15:15:18.692515+0000 mgr.gibba045.orlgmj (mgr.34412) 4591 : cluster [DBG] pgmap v2606: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:19.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:18 gibba015 bash[30343]: cluster 2021-03-10T15:15:18.692515+0000 mgr.gibba045.orlgmj (mgr.34412) 4591 : cluster [DBG] pgmap v2606: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:21.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:20 gibba045 bash[25517]: cluster 2021-03-10T15:15:20.694759+0000 mgr.gibba045.orlgmj (mgr.34412) 4592 : cluster [DBG] pgmap v2607: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:21.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:20 gibba015 bash[29377]: cluster 2021-03-10T15:15:20.694759+0000 mgr.gibba045.orlgmj (mgr.34412) 4592 : cluster [DBG] pgmap v2607: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:21.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:20 gibba015 bash[30343]: cluster 2021-03-10T15:15:20.694759+0000 mgr.gibba045.orlgmj (mgr.34412) 4592 : cluster [DBG] pgmap v2607: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:23.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:22 gibba045 bash[25517]: cluster 2021-03-10T15:15:22.696385+0000 mgr.gibba045.orlgmj (mgr.34412) 4593 : cluster [DBG] pgmap v2608: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:23.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:22 gibba015 bash[29377]: cluster 2021-03-10T15:15:22.696385+0000 mgr.gibba045.orlgmj (mgr.34412) 4593 : cluster [DBG] pgmap v2608: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:23.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:22 gibba015 bash[30343]: cluster 2021-03-10T15:15:22.696385+0000 mgr.gibba045.orlgmj (mgr.34412) 4593 : cluster [DBG] pgmap v2608: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:25.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:24 gibba015 bash[29377]: cluster 2021-03-10T15:15:24.697749+0000 mgr.gibba045.orlgmj (mgr.34412) 4594 : cluster [DBG] pgmap v2609: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:25.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:24 gibba015 bash[30343]: cluster 2021-03-10T15:15:24.697749+0000 mgr.gibba045.orlgmj (mgr.34412) 4594 : cluster [DBG] pgmap v2609: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:25.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:24 gibba045 bash[25517]: cluster 2021-03-10T15:15:24.697749+0000 mgr.gibba045.orlgmj (mgr.34412) 4594 : cluster [DBG] pgmap v2609: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:27.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:26 gibba045 bash[25517]: cluster 2021-03-10T15:15:26.699545+0000 mgr.gibba045.orlgmj (mgr.34412) 4595 : cluster [DBG] pgmap v2610: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:27.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:26 gibba015 bash[29377]: cluster 2021-03-10T15:15:26.699545+0000 mgr.gibba045.orlgmj (mgr.34412) 4595 : cluster [DBG] pgmap v2610: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:27.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:26 gibba015 bash[30343]: cluster 2021-03-10T15:15:26.699545+0000 mgr.gibba045.orlgmj (mgr.34412) 4595 : cluster [DBG] pgmap v2610: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:29.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:28 gibba045 bash[25517]: cluster 2021-03-10T15:15:28.700972+0000 mgr.gibba045.orlgmj (mgr.34412) 4596 : cluster [DBG] pgmap v2611: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:29.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:28 gibba015 bash[29377]: cluster 2021-03-10T15:15:28.700972+0000 mgr.gibba045.orlgmj (mgr.34412) 4596 : cluster [DBG] pgmap v2611: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:29.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:28 gibba015 bash[30343]: cluster 2021-03-10T15:15:28.700972+0000 mgr.gibba045.orlgmj (mgr.34412) 4596 : cluster [DBG] pgmap v2611: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:31.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:30 gibba045 bash[25517]: cluster 2021-03-10T15:15:30.702637+0000 mgr.gibba045.orlgmj (mgr.34412) 4597 : cluster [DBG] pgmap v2612: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:31.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:30 gibba015 bash[29377]: cluster 2021-03-10T15:15:30.702637+0000 mgr.gibba045.orlgmj (mgr.34412) 4597 : cluster [DBG] pgmap v2612: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:31.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:30 gibba015 bash[30343]: cluster 2021-03-10T15:15:30.702637+0000 mgr.gibba045.orlgmj (mgr.34412) 4597 : cluster [DBG] pgmap v2612: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:32.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:31 gibba045 bash[25517]: cephadm 2021-03-10T15:15:31.148173+0000 mgr.gibba045.orlgmj (mgr.34412) 4598 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:15:32.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:31 gibba015 bash[29377]: cephadm 2021-03-10T15:15:31.148173+0000 mgr.gibba045.orlgmj (mgr.34412) 4598 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:15:32.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:31 gibba015 bash[30343]: cephadm 2021-03-10T15:15:31.148173+0000 mgr.gibba045.orlgmj (mgr.34412) 4598 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:15:33.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:32 gibba015 bash[29377]: cluster 2021-03-10T15:15:32.704385+0000 mgr.gibba045.orlgmj (mgr.34412) 4599 : cluster [DBG] pgmap v2613: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:33.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:32 gibba015 bash[30343]: cluster 2021-03-10T15:15:32.704385+0000 mgr.gibba045.orlgmj (mgr.34412) 4599 : cluster [DBG] pgmap v2613: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:33.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:32 gibba045 bash[25517]: cluster 2021-03-10T15:15:32.704385+0000 mgr.gibba045.orlgmj (mgr.34412) 4599 : cluster [DBG] pgmap v2613: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:35.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:34 gibba015 bash[29377]: cluster 2021-03-10T15:15:34.705360+0000 mgr.gibba045.orlgmj (mgr.34412) 4600 : cluster [DBG] pgmap v2614: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:35.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:34 gibba015 bash[30343]: cluster 2021-03-10T15:15:34.705360+0000 mgr.gibba045.orlgmj (mgr.34412) 4600 : cluster [DBG] pgmap v2614: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:35.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:34 gibba045 bash[25517]: cluster 2021-03-10T15:15:34.705360+0000 mgr.gibba045.orlgmj (mgr.34412) 4600 : cluster [DBG] pgmap v2614: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:37.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:36 gibba045 bash[25517]: cluster 2021-03-10T15:15:36.707137+0000 mgr.gibba045.orlgmj (mgr.34412) 4601 : cluster [DBG] pgmap v2615: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:37.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:36 gibba015 bash[29377]: cluster 2021-03-10T15:15:36.707137+0000 mgr.gibba045.orlgmj (mgr.34412) 4601 : cluster [DBG] pgmap v2615: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:37.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:36 gibba015 bash[30343]: cluster 2021-03-10T15:15:36.707137+0000 mgr.gibba045.orlgmj (mgr.34412) 4601 : cluster [DBG] pgmap v2615: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:39.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:38 gibba045 bash[25517]: cluster 2021-03-10T15:15:38.708651+0000 mgr.gibba045.orlgmj (mgr.34412) 4602 : cluster [DBG] pgmap v2616: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:39.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:38 gibba015 bash[29377]: cluster 2021-03-10T15:15:38.708651+0000 mgr.gibba045.orlgmj (mgr.34412) 4602 : cluster [DBG] pgmap v2616: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:39.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:38 gibba015 bash[30343]: cluster 2021-03-10T15:15:38.708651+0000 mgr.gibba045.orlgmj (mgr.34412) 4602 : cluster [DBG] pgmap v2616: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:41.003 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:15:41.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:40 gibba045 bash[25517]: cluster 2021-03-10T15:15:40.710213+0000 mgr.gibba045.orlgmj (mgr.34412) 4603 : cluster [DBG] pgmap v2617: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:41.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:40 gibba015 bash[29377]: cluster 2021-03-10T15:15:40.710213+0000 mgr.gibba045.orlgmj (mgr.34412) 4603 : cluster [DBG] pgmap v2617: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:41.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:40 gibba015 bash[30343]: cluster 2021-03-10T15:15:40.710213+0000 mgr.gibba045.orlgmj (mgr.34412) 4603 : cluster [DBG] pgmap v2617: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:41.227 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:15:41.227 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (86m) 55s ago 91m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:15:41.227 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (91m) 10m ago 91m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:15:41.228 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (86m) 10m ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:15:41.228 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (87m) 10m ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:15:41.228 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (86m) 55s ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:15:41.228 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (85m) 55s ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:15:41.229 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (85m) 10m ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:15:41.229 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (85m) 55s ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:15:41.229 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (91m) 55s ago 91m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:15:41.229 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (91m) 10m ago 91m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:15:41.229 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (84m) 55s ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:15:41.230 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (84m) 55s ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:15:41.230 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (83m) 55s ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:15:41.230 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (83m) 55s ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:15:41.230 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (83m) 10m ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:15:41.231 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (82m) 10m ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:15:41.231 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (82m) 10m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:15:41.231 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (81m) 10m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:15:41.231 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (91m) 10m ago 91m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:15:41.232 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 10m ago 89m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:15:41.474 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:15:41.475 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:15:41.475 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:15:41.475 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:15:41.475 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:15:41.476 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:15:41.476 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:15:41.476 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:15:41.476 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:15:41.477 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:15:41.477 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:15:41.477 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:15:41.477 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:15:41.477 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:15:41.478 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:15:42.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:41 gibba045 bash[25517]: audit 2021-03-10T15:15:40.994594+0000 mgr.gibba045.orlgmj (mgr.34412) 4604 : audit [DBG] from='client.47148 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:15:42.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:41 gibba045 bash[25517]: audit 2021-03-10T15:15:41.215285+0000 mgr.gibba045.orlgmj (mgr.34412) 4605 : audit [DBG] from='client.57142 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:15:42.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:41 gibba045 bash[25517]: audit 2021-03-10T15:15:41.470487+0000 mon.c (mon.1) 1304 : audit [DBG] from='client.? 172.21.2.115:0/1524136004' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:15:42.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:41 gibba015 bash[29377]: audit 2021-03-10T15:15:40.994594+0000 mgr.gibba045.orlgmj (mgr.34412) 4604 : audit [DBG] from='client.47148 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:15:42.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:41 gibba015 bash[29377]: audit 2021-03-10T15:15:41.215285+0000 mgr.gibba045.orlgmj (mgr.34412) 4605 : audit [DBG] from='client.57142 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:15:42.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:41 gibba015 bash[29377]: audit 2021-03-10T15:15:41.470487+0000 mon.c (mon.1) 1304 : audit [DBG] from='client.? 172.21.2.115:0/1524136004' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:15:42.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:41 gibba015 bash[30343]: audit 2021-03-10T15:15:40.994594+0000 mgr.gibba045.orlgmj (mgr.34412) 4604 : audit [DBG] from='client.47148 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:15:42.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:41 gibba015 bash[30343]: audit 2021-03-10T15:15:41.215285+0000 mgr.gibba045.orlgmj (mgr.34412) 4605 : audit [DBG] from='client.57142 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:15:42.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:41 gibba015 bash[30343]: audit 2021-03-10T15:15:41.470487+0000 mon.c (mon.1) 1304 : audit [DBG] from='client.? 172.21.2.115:0/1524136004' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:15:43.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:42 gibba015 bash[29377]: cluster 2021-03-10T15:15:42.711770+0000 mgr.gibba045.orlgmj (mgr.34412) 4606 : cluster [DBG] pgmap v2618: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:43.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:42 gibba015 bash[30343]: cluster 2021-03-10T15:15:42.711770+0000 mgr.gibba045.orlgmj (mgr.34412) 4606 : cluster [DBG] pgmap v2618: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:43.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:42 gibba045 bash[25517]: cluster 2021-03-10T15:15:42.711770+0000 mgr.gibba045.orlgmj (mgr.34412) 4606 : cluster [DBG] pgmap v2618: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:45.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:44 gibba015 bash[29377]: cluster 2021-03-10T15:15:44.712761+0000 mgr.gibba045.orlgmj (mgr.34412) 4607 : cluster [DBG] pgmap v2619: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:45.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:44 gibba015 bash[30343]: cluster 2021-03-10T15:15:44.712761+0000 mgr.gibba045.orlgmj (mgr.34412) 4607 : cluster [DBG] pgmap v2619: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:45.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:44 gibba045 bash[25517]: cluster 2021-03-10T15:15:44.712761+0000 mgr.gibba045.orlgmj (mgr.34412) 4607 : cluster [DBG] pgmap v2619: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:46.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:46 gibba015 bash[29377]: audit 2021-03-10T15:15:46.160905+0000 mon.c (mon.1) 1305 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:15:46.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:46 gibba015 bash[29377]: audit 2021-03-10T15:15:46.168193+0000 mon.c (mon.1) 1306 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:15:46.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:46 gibba015 bash[30343]: audit 2021-03-10T15:15:46.160905+0000 mon.c (mon.1) 1305 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:15:46.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:46 gibba015 bash[30343]: audit 2021-03-10T15:15:46.168193+0000 mon.c (mon.1) 1306 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:15:46.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:46 gibba045 bash[25517]: audit 2021-03-10T15:15:46.160905+0000 mon.c (mon.1) 1305 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:15:46.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:46 gibba045 bash[25517]: audit 2021-03-10T15:15:46.168193+0000 mon.c (mon.1) 1306 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:15:47.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:47 gibba045 bash[25517]: cephadm 2021-03-10T15:15:46.170379+0000 mgr.gibba045.orlgmj (mgr.34412) 4608 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:15:47.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:47 gibba045 bash[25517]: cluster 2021-03-10T15:15:46.714335+0000 mgr.gibba045.orlgmj (mgr.34412) 4609 : cluster [DBG] pgmap v2620: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:47.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:47 gibba015 bash[29377]: cephadm 2021-03-10T15:15:46.170379+0000 mgr.gibba045.orlgmj (mgr.34412) 4608 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:15:47.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:47 gibba015 bash[29377]: cluster 2021-03-10T15:15:46.714335+0000 mgr.gibba045.orlgmj (mgr.34412) 4609 : cluster [DBG] pgmap v2620: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:47.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:47 gibba015 bash[30343]: cephadm 2021-03-10T15:15:46.170379+0000 mgr.gibba045.orlgmj (mgr.34412) 4608 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:15:47.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:47 gibba015 bash[30343]: cluster 2021-03-10T15:15:46.714335+0000 mgr.gibba045.orlgmj (mgr.34412) 4609 : cluster [DBG] pgmap v2620: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:49.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:48 gibba045 bash[25517]: cluster 2021-03-10T15:15:48.715476+0000 mgr.gibba045.orlgmj (mgr.34412) 4610 : cluster [DBG] pgmap v2621: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:49.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:48 gibba015 bash[29377]: cluster 2021-03-10T15:15:48.715476+0000 mgr.gibba045.orlgmj (mgr.34412) 4610 : cluster [DBG] pgmap v2621: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:49.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:48 gibba015 bash[30343]: cluster 2021-03-10T15:15:48.715476+0000 mgr.gibba045.orlgmj (mgr.34412) 4610 : cluster [DBG] pgmap v2621: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:51.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:50 gibba015 bash[29377]: audit 2021-03-10T15:15:49.898813+0000 mon.a (mon.0) 1275 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:15:51.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:50 gibba015 bash[29377]: audit 2021-03-10T15:15:49.900191+0000 mon.c (mon.1) 1307 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T15:15:51.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:50 gibba015 bash[29377]: cluster 2021-03-10T15:15:50.716988+0000 mgr.gibba045.orlgmj (mgr.34412) 4611 : cluster [DBG] pgmap v2622: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:51.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:50 gibba015 bash[30343]: audit 2021-03-10T15:15:49.898813+0000 mon.a (mon.0) 1275 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:15:51.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:50 gibba015 bash[30343]: audit 2021-03-10T15:15:49.900191+0000 mon.c (mon.1) 1307 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T15:15:51.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:50 gibba015 bash[30343]: cluster 2021-03-10T15:15:50.716988+0000 mgr.gibba045.orlgmj (mgr.34412) 4611 : cluster [DBG] pgmap v2622: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:51.233 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:50 gibba045 bash[25517]: audit 2021-03-10T15:15:49.898813+0000 mon.a (mon.0) 1275 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:15:51.233 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:50 gibba045 bash[25517]: audit 2021-03-10T15:15:49.900191+0000 mon.c (mon.1) 1307 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T15:15:51.233 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:50 gibba045 bash[25517]: cluster 2021-03-10T15:15:50.716988+0000 mgr.gibba045.orlgmj (mgr.34412) 4611 : cluster [DBG] pgmap v2622: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:53.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:52 gibba045 bash[25517]: cluster 2021-03-10T15:15:52.717620+0000 mgr.gibba045.orlgmj (mgr.34412) 4612 : cluster [DBG] pgmap v2623: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:53.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:52 gibba015 bash[29377]: cluster 2021-03-10T15:15:52.717620+0000 mgr.gibba045.orlgmj (mgr.34412) 4612 : cluster [DBG] pgmap v2623: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:53.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:52 gibba015 bash[30343]: cluster 2021-03-10T15:15:52.717620+0000 mgr.gibba045.orlgmj (mgr.34412) 4612 : cluster [DBG] pgmap v2623: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:53 gibba045 bash[25517]: audit 2021-03-10T15:15:53.047863+0000 mon.c (mon.1) 1308 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:15:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:53 gibba045 bash[25517]: audit 2021-03-10T15:15:53.048487+0000 mon.c (mon.1) 1309 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:15:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:53 gibba045 bash[25517]: audit 2021-03-10T15:15:53.048994+0000 mon.a (mon.0) 1276 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:15:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:53 gibba045 bash[25517]: audit 2021-03-10T15:15:53.050166+0000 mon.a (mon.0) 1277 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:15:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:53 gibba045 bash[25517]: audit 2021-03-10T15:15:53.050764+0000 mon.c (mon.1) 1310 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:15:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:53 gibba045 bash[25517]: audit 2021-03-10T15:15:53.051718+0000 mon.c (mon.1) 1311 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:15:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:53 gibba045 bash[25517]: audit 2021-03-10T15:15:53.051874+0000 mon.a (mon.0) 1278 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:15:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:53 gibba045 bash[25517]: audit 2021-03-10T15:15:53.052421+0000 mon.c (mon.1) 1312 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:15:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:53 gibba045 bash[25517]: audit 2021-03-10T15:15:53.053238+0000 mon.a (mon.0) 1279 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:15:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:53 gibba045 bash[25517]: audit 2021-03-10T15:15:53.053252+0000 mon.c (mon.1) 1313 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:15:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:53 gibba045 bash[25517]: audit 2021-03-10T15:15:53.054493+0000 mon.a (mon.0) 1280 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:15:54.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:53 gibba045 bash[25517]: audit 2021-03-10T15:15:53.055380+0000 mon.a (mon.0) 1281 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:15:54.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:53 gibba015 bash[29377]: audit 2021-03-10T15:15:53.047863+0000 mon.c (mon.1) 1308 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:15:54.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:53 gibba015 bash[29377]: audit 2021-03-10T15:15:53.048487+0000 mon.c (mon.1) 1309 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:15:54.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:53 gibba015 bash[29377]: audit 2021-03-10T15:15:53.048994+0000 mon.a (mon.0) 1276 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:15:54.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:53 gibba015 bash[29377]: audit 2021-03-10T15:15:53.050166+0000 mon.a (mon.0) 1277 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:15:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:53 gibba015 bash[29377]: audit 2021-03-10T15:15:53.050764+0000 mon.c (mon.1) 1310 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:15:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:53 gibba015 bash[29377]: audit 2021-03-10T15:15:53.051718+0000 mon.c (mon.1) 1311 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:15:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:53 gibba015 bash[29377]: audit 2021-03-10T15:15:53.051874+0000 mon.a (mon.0) 1278 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:15:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:53 gibba015 bash[29377]: audit 2021-03-10T15:15:53.052421+0000 mon.c (mon.1) 1312 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:15:54.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:53 gibba015 bash[29377]: audit 2021-03-10T15:15:53.053238+0000 mon.a (mon.0) 1279 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:15:54.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:53 gibba015 bash[29377]: audit 2021-03-10T15:15:53.053252+0000 mon.c (mon.1) 1313 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:15:54.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:53 gibba015 bash[29377]: audit 2021-03-10T15:15:53.054493+0000 mon.a (mon.0) 1280 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:15:54.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:53 gibba015 bash[29377]: audit 2021-03-10T15:15:53.055380+0000 mon.a (mon.0) 1281 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:15:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:53 gibba015 bash[30343]: audit 2021-03-10T15:15:53.047863+0000 mon.c (mon.1) 1308 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:15:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:53 gibba015 bash[30343]: audit 2021-03-10T15:15:53.048487+0000 mon.c (mon.1) 1309 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:15:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:53 gibba015 bash[30343]: audit 2021-03-10T15:15:53.048994+0000 mon.a (mon.0) 1276 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:15:54.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:53 gibba015 bash[30343]: audit 2021-03-10T15:15:53.050166+0000 mon.a (mon.0) 1277 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:15:54.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:53 gibba015 bash[30343]: audit 2021-03-10T15:15:53.050764+0000 mon.c (mon.1) 1310 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:15:54.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:53 gibba015 bash[30343]: audit 2021-03-10T15:15:53.051718+0000 mon.c (mon.1) 1311 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:15:54.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:53 gibba015 bash[30343]: audit 2021-03-10T15:15:53.051874+0000 mon.a (mon.0) 1278 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:15:54.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:53 gibba015 bash[30343]: audit 2021-03-10T15:15:53.052421+0000 mon.c (mon.1) 1312 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:15:54.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:53 gibba015 bash[30343]: audit 2021-03-10T15:15:53.053238+0000 mon.a (mon.0) 1279 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:15:54.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:53 gibba015 bash[30343]: audit 2021-03-10T15:15:53.053252+0000 mon.c (mon.1) 1313 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:15:54.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:53 gibba015 bash[30343]: audit 2021-03-10T15:15:53.054493+0000 mon.a (mon.0) 1280 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:15:54.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:53 gibba015 bash[30343]: audit 2021-03-10T15:15:53.055380+0000 mon.a (mon.0) 1281 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:15:55.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:54 gibba015 bash[29377]: audit 2021-03-10T15:15:54.454998+0000 mon.c (mon.1) 1314 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:15:55.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:54 gibba015 bash[29377]: audit 2021-03-10T15:15:54.621259+0000 mon.a (mon.0) 1282 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:15:55.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:54 gibba015 bash[29377]: cephadm 2021-03-10T15:15:54.626316+0000 mgr.gibba045.orlgmj (mgr.34412) 4613 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:15:55.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:54 gibba015 bash[29377]: cluster 2021-03-10T15:15:54.718025+0000 mgr.gibba045.orlgmj (mgr.34412) 4614 : cluster [DBG] pgmap v2624: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:55.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:54 gibba015 bash[29377]: audit 2021-03-10T15:15:54.813194+0000 mon.a (mon.0) 1283 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:15:55.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:54 gibba015 bash[29377]: audit 2021-03-10T15:15:54.817175+0000 mon.c (mon.1) 1315 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:15:55.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:54 gibba015 bash[29377]: audit 2021-03-10T15:15:54.818751+0000 mon.c (mon.1) 1316 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:15:55.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:54 gibba015 bash[29377]: audit 2021-03-10T15:15:54.820165+0000 mon.c (mon.1) 1317 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:15:55.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:54 gibba015 bash[29377]: audit 2021-03-10T15:15:54.821410+0000 mon.c (mon.1) 1318 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:15:55.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:54 gibba015 bash[29377]: audit 2021-03-10T15:15:54.824419+0000 mon.c (mon.1) 1319 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:15:55.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:54 gibba015 bash[29377]: audit 2021-03-10T15:15:54.826043+0000 mon.c (mon.1) 1320 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:15:55.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:54 gibba015 bash[30343]: audit 2021-03-10T15:15:54.454998+0000 mon.c (mon.1) 1314 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:15:55.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:54 gibba015 bash[30343]: audit 2021-03-10T15:15:54.621259+0000 mon.a (mon.0) 1282 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:15:55.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:54 gibba015 bash[30343]: cephadm 2021-03-10T15:15:54.626316+0000 mgr.gibba045.orlgmj (mgr.34412) 4613 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:15:55.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:54 gibba015 bash[30343]: cluster 2021-03-10T15:15:54.718025+0000 mgr.gibba045.orlgmj (mgr.34412) 4614 : cluster [DBG] pgmap v2624: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:55.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:54 gibba015 bash[30343]: audit 2021-03-10T15:15:54.813194+0000 mon.a (mon.0) 1283 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:15:55.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:54 gibba015 bash[30343]: audit 2021-03-10T15:15:54.817175+0000 mon.c (mon.1) 1315 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:15:55.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:54 gibba015 bash[30343]: audit 2021-03-10T15:15:54.818751+0000 mon.c (mon.1) 1316 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:15:55.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:54 gibba015 bash[30343]: audit 2021-03-10T15:15:54.820165+0000 mon.c (mon.1) 1317 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:15:55.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:54 gibba015 bash[30343]: audit 2021-03-10T15:15:54.821410+0000 mon.c (mon.1) 1318 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:15:55.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:54 gibba015 bash[30343]: audit 2021-03-10T15:15:54.824419+0000 mon.c (mon.1) 1319 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:15:55.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:54 gibba015 bash[30343]: audit 2021-03-10T15:15:54.826043+0000 mon.c (mon.1) 1320 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:15:55.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:54 gibba045 bash[25517]: audit 2021-03-10T15:15:54.454998+0000 mon.c (mon.1) 1314 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:15:55.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:54 gibba045 bash[25517]: audit 2021-03-10T15:15:54.621259+0000 mon.a (mon.0) 1282 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:15:55.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:54 gibba045 bash[25517]: cephadm 2021-03-10T15:15:54.626316+0000 mgr.gibba045.orlgmj (mgr.34412) 4613 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:15:55.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:54 gibba045 bash[25517]: cluster 2021-03-10T15:15:54.718025+0000 mgr.gibba045.orlgmj (mgr.34412) 4614 : cluster [DBG] pgmap v2624: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:55.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:54 gibba045 bash[25517]: audit 2021-03-10T15:15:54.813194+0000 mon.a (mon.0) 1283 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:15:55.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:54 gibba045 bash[25517]: audit 2021-03-10T15:15:54.817175+0000 mon.c (mon.1) 1315 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:15:55.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:54 gibba045 bash[25517]: audit 2021-03-10T15:15:54.818751+0000 mon.c (mon.1) 1316 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:15:55.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:54 gibba045 bash[25517]: audit 2021-03-10T15:15:54.820165+0000 mon.c (mon.1) 1317 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:15:55.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:54 gibba045 bash[25517]: audit 2021-03-10T15:15:54.821410+0000 mon.c (mon.1) 1318 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:15:55.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:54 gibba045 bash[25517]: audit 2021-03-10T15:15:54.824419+0000 mon.c (mon.1) 1319 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:15:55.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:54 gibba045 bash[25517]: audit 2021-03-10T15:15:54.826043+0000 mon.c (mon.1) 1320 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:15:56.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:56 gibba015 bash[29377]: cephadm 2021-03-10T15:15:54.820533+0000 mgr.gibba045.orlgmj (mgr.34412) 4615 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:15:56.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:56 gibba015 bash[29377]: cephadm 2021-03-10T15:15:54.822366+0000 mgr.gibba045.orlgmj (mgr.34412) 4616 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:15:56.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:56 gibba015 bash[29377]: cephadm 2021-03-10T15:15:54.823906+0000 mgr.gibba045.orlgmj (mgr.34412) 4617 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:15:56.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:56 gibba015 bash[29377]: cephadm 2021-03-10T15:15:54.823951+0000 mgr.gibba045.orlgmj (mgr.34412) 4618 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:15:56.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:56 gibba015 bash[29377]: cephadm 2021-03-10T15:15:54.825139+0000 mgr.gibba045.orlgmj (mgr.34412) 4619 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:15:56.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:56 gibba015 bash[29377]: cephadm 2021-03-10T15:15:54.825184+0000 mgr.gibba045.orlgmj (mgr.34412) 4620 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:15:56.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:56 gibba015 bash[29377]: cephadm 2021-03-10T15:15:54.826313+0000 mgr.gibba045.orlgmj (mgr.34412) 4621 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:15:56.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:56 gibba015 bash[29377]: cephadm 2021-03-10T15:15:54.828053+0000 mgr.gibba045.orlgmj (mgr.34412) 4622 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:15:56.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:56 gibba015 bash[29377]: cephadm 2021-03-10T15:15:54.828100+0000 mgr.gibba045.orlgmj (mgr.34412) 4623 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:15:56.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:56 gibba015 bash[29377]: cephadm 2021-03-10T15:15:54.829487+0000 mgr.gibba045.orlgmj (mgr.34412) 4624 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:15:56.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:56 gibba015 bash[29377]: cephadm 2021-03-10T15:15:54.829879+0000 mgr.gibba045.orlgmj (mgr.34412) 4625 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:15:56.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:56 gibba015 bash[29377]: cephadm 2021-03-10T15:15:54.831352+0000 mgr.gibba045.orlgmj (mgr.34412) 4626 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:15:56.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:56 gibba015 bash[29377]: cephadm 2021-03-10T15:15:54.831401+0000 mgr.gibba045.orlgmj (mgr.34412) 4627 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:15:56.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:56 gibba015 bash[29377]: cephadm 2021-03-10T15:15:54.831541+0000 mgr.gibba045.orlgmj (mgr.34412) 4628 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:15:56.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:56 gibba015 bash[30343]: cephadm 2021-03-10T15:15:54.820533+0000 mgr.gibba045.orlgmj (mgr.34412) 4615 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:15:56.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:56 gibba015 bash[30343]: cephadm 2021-03-10T15:15:54.822366+0000 mgr.gibba045.orlgmj (mgr.34412) 4616 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:15:56.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:56 gibba015 bash[30343]: cephadm 2021-03-10T15:15:54.823906+0000 mgr.gibba045.orlgmj (mgr.34412) 4617 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:15:56.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:56 gibba015 bash[30343]: cephadm 2021-03-10T15:15:54.823951+0000 mgr.gibba045.orlgmj (mgr.34412) 4618 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:15:56.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:56 gibba015 bash[30343]: cephadm 2021-03-10T15:15:54.825139+0000 mgr.gibba045.orlgmj (mgr.34412) 4619 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:15:56.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:56 gibba015 bash[30343]: cephadm 2021-03-10T15:15:54.825184+0000 mgr.gibba045.orlgmj (mgr.34412) 4620 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:15:56.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:56 gibba015 bash[30343]: cephadm 2021-03-10T15:15:54.826313+0000 mgr.gibba045.orlgmj (mgr.34412) 4621 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:15:56.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:56 gibba015 bash[30343]: cephadm 2021-03-10T15:15:54.828053+0000 mgr.gibba045.orlgmj (mgr.34412) 4622 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:15:56.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:56 gibba015 bash[30343]: cephadm 2021-03-10T15:15:54.828100+0000 mgr.gibba045.orlgmj (mgr.34412) 4623 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:15:56.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:56 gibba015 bash[30343]: cephadm 2021-03-10T15:15:54.829487+0000 mgr.gibba045.orlgmj (mgr.34412) 4624 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:15:56.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:56 gibba015 bash[30343]: cephadm 2021-03-10T15:15:54.829879+0000 mgr.gibba045.orlgmj (mgr.34412) 4625 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:15:56.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:56 gibba015 bash[30343]: cephadm 2021-03-10T15:15:54.831352+0000 mgr.gibba045.orlgmj (mgr.34412) 4626 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:15:56.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:56 gibba015 bash[30343]: cephadm 2021-03-10T15:15:54.831401+0000 mgr.gibba045.orlgmj (mgr.34412) 4627 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:15:56.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:56 gibba015 bash[30343]: cephadm 2021-03-10T15:15:54.831541+0000 mgr.gibba045.orlgmj (mgr.34412) 4628 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:15:57.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:56 gibba045 bash[25517]: cephadm 2021-03-10T15:15:54.820533+0000 mgr.gibba045.orlgmj (mgr.34412) 4615 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:15:57.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:56 gibba045 bash[25517]: cephadm 2021-03-10T15:15:54.822366+0000 mgr.gibba045.orlgmj (mgr.34412) 4616 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:15:57.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:56 gibba045 bash[25517]: cephadm 2021-03-10T15:15:54.823906+0000 mgr.gibba045.orlgmj (mgr.34412) 4617 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:15:57.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:56 gibba045 bash[25517]: cephadm 2021-03-10T15:15:54.823951+0000 mgr.gibba045.orlgmj (mgr.34412) 4618 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:15:57.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:56 gibba045 bash[25517]: cephadm 2021-03-10T15:15:54.825139+0000 mgr.gibba045.orlgmj (mgr.34412) 4619 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:15:57.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:56 gibba045 bash[25517]: cephadm 2021-03-10T15:15:54.825184+0000 mgr.gibba045.orlgmj (mgr.34412) 4620 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:15:57.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:56 gibba045 bash[25517]: cephadm 2021-03-10T15:15:54.826313+0000 mgr.gibba045.orlgmj (mgr.34412) 4621 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:15:57.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:56 gibba045 bash[25517]: cephadm 2021-03-10T15:15:54.828053+0000 mgr.gibba045.orlgmj (mgr.34412) 4622 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:15:57.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:56 gibba045 bash[25517]: cephadm 2021-03-10T15:15:54.828100+0000 mgr.gibba045.orlgmj (mgr.34412) 4623 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:15:57.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:56 gibba045 bash[25517]: cephadm 2021-03-10T15:15:54.829487+0000 mgr.gibba045.orlgmj (mgr.34412) 4624 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:15:57.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:56 gibba045 bash[25517]: cephadm 2021-03-10T15:15:54.829879+0000 mgr.gibba045.orlgmj (mgr.34412) 4625 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:15:57.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:56 gibba045 bash[25517]: cephadm 2021-03-10T15:15:54.831352+0000 mgr.gibba045.orlgmj (mgr.34412) 4626 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:15:57.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:56 gibba045 bash[25517]: cephadm 2021-03-10T15:15:54.831401+0000 mgr.gibba045.orlgmj (mgr.34412) 4627 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:15:57.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:56 gibba045 bash[25517]: cephadm 2021-03-10T15:15:54.831541+0000 mgr.gibba045.orlgmj (mgr.34412) 4628 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:15:57.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:57 gibba015 bash[29377]: cluster 2021-03-10T15:15:56.719846+0000 mgr.gibba045.orlgmj (mgr.34412) 4629 : cluster [DBG] pgmap v2625: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:57.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:57 gibba015 bash[30343]: cluster 2021-03-10T15:15:56.719846+0000 mgr.gibba045.orlgmj (mgr.34412) 4629 : cluster [DBG] pgmap v2625: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:58.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:57 gibba045 bash[25517]: cluster 2021-03-10T15:15:56.719846+0000 mgr.gibba045.orlgmj (mgr.34412) 4629 : cluster [DBG] pgmap v2625: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:59.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:15:58 gibba045 bash[25517]: cluster 2021-03-10T15:15:58.721237+0000 mgr.gibba045.orlgmj (mgr.34412) 4630 : cluster [DBG] pgmap v2626: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:59.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:15:58 gibba015 bash[29377]: cluster 2021-03-10T15:15:58.721237+0000 mgr.gibba045.orlgmj (mgr.34412) 4630 : cluster [DBG] pgmap v2626: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:59.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:15:58 gibba015 bash[30343]: cluster 2021-03-10T15:15:58.721237+0000 mgr.gibba045.orlgmj (mgr.34412) 4630 : cluster [DBG] pgmap v2626: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:01.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:16:00 gibba045 bash[25517]: cluster 2021-03-10T15:16:00.722714+0000 mgr.gibba045.orlgmj (mgr.34412) 4631 : cluster [DBG] pgmap v2627: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:01.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:16:00 gibba015 bash[29377]: cluster 2021-03-10T15:16:00.722714+0000 mgr.gibba045.orlgmj (mgr.34412) 4631 : cluster [DBG] pgmap v2627: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:01.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:16:00 gibba015 bash[30343]: cluster 2021-03-10T15:16:00.722714+0000 mgr.gibba045.orlgmj (mgr.34412) 4631 : cluster [DBG] pgmap v2627: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:03.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:16:02 gibba045 bash[25517]: cluster 2021-03-10T15:16:02.724397+0000 mgr.gibba045.orlgmj (mgr.34412) 4632 : cluster [DBG] pgmap v2628: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:03.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:16:02 gibba015 bash[29377]: cluster 2021-03-10T15:16:02.724397+0000 mgr.gibba045.orlgmj (mgr.34412) 4632 : cluster [DBG] pgmap v2628: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:03.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:16:02 gibba015 bash[30343]: cluster 2021-03-10T15:16:02.724397+0000 mgr.gibba045.orlgmj (mgr.34412) 4632 : cluster [DBG] pgmap v2628: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:05.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:16:04 gibba015 bash[29377]: cluster 2021-03-10T15:16:04.725801+0000 mgr.gibba045.orlgmj (mgr.34412) 4633 : cluster [DBG] pgmap v2629: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:05.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:16:04 gibba015 bash[30343]: cluster 2021-03-10T15:16:04.725801+0000 mgr.gibba045.orlgmj (mgr.34412) 4633 : cluster [DBG] pgmap v2629: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:05.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:16:04 gibba045 bash[25517]: cluster 2021-03-10T15:16:04.725801+0000 mgr.gibba045.orlgmj (mgr.34412) 4633 : cluster [DBG] pgmap v2629: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:07.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:16:06 gibba015 bash[29377]: cluster 2021-03-10T15:16:06.727524+0000 mgr.gibba045.orlgmj (mgr.34412) 4634 : cluster [DBG] pgmap v2630: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:07.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:16:06 gibba015 bash[30343]: cluster 2021-03-10T15:16:06.727524+0000 mgr.gibba045.orlgmj (mgr.34412) 4634 : cluster [DBG] pgmap v2630: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:07.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:16:06 gibba045 bash[25517]: cluster 2021-03-10T15:16:06.727524+0000 mgr.gibba045.orlgmj (mgr.34412) 4634 : cluster [DBG] pgmap v2630: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:09.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:16:08 gibba045 bash[25517]: cluster 2021-03-10T15:16:08.728925+0000 mgr.gibba045.orlgmj (mgr.34412) 4635 : cluster [DBG] pgmap v2631: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:09.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:16:08 gibba015 bash[29377]: cluster 2021-03-10T15:16:08.728925+0000 mgr.gibba045.orlgmj (mgr.34412) 4635 : cluster [DBG] pgmap v2631: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:09.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:16:08 gibba015 bash[30343]: cluster 2021-03-10T15:16:08.728925+0000 mgr.gibba045.orlgmj (mgr.34412) 4635 : cluster [DBG] pgmap v2631: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:11.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:16:10 gibba015 bash[29377]: cephadm 2021-03-10T15:16:09.847541+0000 mgr.gibba045.orlgmj (mgr.34412) 4636 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:16:11.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:16:10 gibba015 bash[29377]: cluster 2021-03-10T15:16:10.730501+0000 mgr.gibba045.orlgmj (mgr.34412) 4637 : cluster [DBG] pgmap v2632: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:11.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:16:10 gibba015 bash[30343]: cephadm 2021-03-10T15:16:09.847541+0000 mgr.gibba045.orlgmj (mgr.34412) 4636 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:16:11.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:16:10 gibba015 bash[30343]: cluster 2021-03-10T15:16:10.730501+0000 mgr.gibba045.orlgmj (mgr.34412) 4637 : cluster [DBG] pgmap v2632: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:11.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:16:10 gibba045 bash[25517]: cephadm 2021-03-10T15:16:09.847541+0000 mgr.gibba045.orlgmj (mgr.34412) 4636 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:16:11.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:16:10 gibba045 bash[25517]: cluster 2021-03-10T15:16:10.730501+0000 mgr.gibba045.orlgmj (mgr.34412) 4637 : cluster [DBG] pgmap v2632: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:11.714 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:16:11.943 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:16:11.943 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (86m) 86s ago 92m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:16:11.943 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (92m) 22s ago 92m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:16:11.944 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (87m) 22s ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:16:11.944 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (87m) 22s ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:16:11.944 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (86m) 86s ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:16:11.944 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (86m) 86s ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:16:11.945 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (85m) 22s ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:16:11.945 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (86m) 86s ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:16:11.945 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (92m) 86s ago 92m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:16:11.946 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (92m) 22s ago 92m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:16:11.946 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (85m) 86s ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:16:11.946 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (84m) 86s ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:16:11.946 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (84m) 86s ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:16:11.947 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (83m) 86s ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:16:11.947 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (83m) 22s ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:16:11.947 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (83m) 22s ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:16:11.947 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (82m) 22s ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:16:11.948 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (82m) 22s ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:16:11.948 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (91m) 22s ago 92m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:16:11.948 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 22s ago 90m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:16:12.192 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:16:12.193 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:16:12.193 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:16:12.193 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:16:12.193 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:16:12.194 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:16:12.194 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:16:12.194 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:16:12.194 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:16:12.195 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:16:12.195 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:16:12.195 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:16:12.195 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:16:12.196 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:16:12.196 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:16:12.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:16:11 gibba015 bash[30343]: audit 2021-03-10T15:16:11.705608+0000 mgr.gibba045.orlgmj (mgr.34412) 4638 : audit [DBG] from='client.57154 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:16:12.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:16:11 gibba015 bash[29377]: audit 2021-03-10T15:16:11.705608+0000 mgr.gibba045.orlgmj (mgr.34412) 4638 : audit [DBG] from='client.57154 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:16:12.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:16:11 gibba045 bash[25517]: audit 2021-03-10T15:16:11.705608+0000 mgr.gibba045.orlgmj (mgr.34412) 4638 : audit [DBG] from='client.57154 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:16:13.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:16:12 gibba015 bash[29377]: audit 2021-03-10T15:16:11.931056+0000 mgr.gibba045.orlgmj (mgr.34412) 4639 : audit [DBG] from='client.47172 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:16:13.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:16:12 gibba015 bash[29377]: audit 2021-03-10T15:16:12.188524+0000 mon.c (mon.1) 1321 : audit [DBG] from='client.? 172.21.2.115:0/3120565300' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:16:13.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:16:12 gibba015 bash[29377]: cluster 2021-03-10T15:16:12.731982+0000 mgr.gibba045.orlgmj (mgr.34412) 4640 : cluster [DBG] pgmap v2633: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:13.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:16:12 gibba015 bash[30343]: audit 2021-03-10T15:16:11.931056+0000 mgr.gibba045.orlgmj (mgr.34412) 4639 : audit [DBG] from='client.47172 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:16:13.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:16:12 gibba015 bash[30343]: audit 2021-03-10T15:16:12.188524+0000 mon.c (mon.1) 1321 : audit [DBG] from='client.? 172.21.2.115:0/3120565300' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:16:13.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:16:12 gibba015 bash[30343]: cluster 2021-03-10T15:16:12.731982+0000 mgr.gibba045.orlgmj (mgr.34412) 4640 : cluster [DBG] pgmap v2633: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:13.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:16:12 gibba045 bash[25517]: audit 2021-03-10T15:16:11.931056+0000 mgr.gibba045.orlgmj (mgr.34412) 4639 : audit [DBG] from='client.47172 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:16:13.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:16:12 gibba045 bash[25517]: audit 2021-03-10T15:16:12.188524+0000 mon.c (mon.1) 1321 : audit [DBG] from='client.? 172.21.2.115:0/3120565300' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:16:13.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:16:12 gibba045 bash[25517]: cluster 2021-03-10T15:16:12.731982+0000 mgr.gibba045.orlgmj (mgr.34412) 4640 : cluster [DBG] pgmap v2633: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:15.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:16:14 gibba045 bash[25517]: cluster 2021-03-10T15:16:14.733569+0000 mgr.gibba045.orlgmj (mgr.34412) 4641 : cluster [DBG] pgmap v2634: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:15.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:16:14 gibba015 bash[29377]: cluster 2021-03-10T15:16:14.733569+0000 mgr.gibba045.orlgmj (mgr.34412) 4641 : cluster [DBG] pgmap v2634: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:15.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:16:14 gibba015 bash[30343]: cluster 2021-03-10T15:16:14.733569+0000 mgr.gibba045.orlgmj (mgr.34412) 4641 : cluster [DBG] pgmap v2634: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:17.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:16:16 gibba015 bash[29377]: cluster 2021-03-10T15:16:16.735214+0000 mgr.gibba045.orlgmj (mgr.34412) 4642 : cluster [DBG] pgmap v2635: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:17.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:16:16 gibba015 bash[30343]: cluster 2021-03-10T15:16:16.735214+0000 mgr.gibba045.orlgmj (mgr.34412) 4642 : cluster [DBG] pgmap v2635: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:17.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:16:16 gibba045 bash[25517]: cluster 2021-03-10T15:16:16.735214+0000 mgr.gibba045.orlgmj (mgr.34412) 4642 : cluster [DBG] pgmap v2635: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:19.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:16:18 gibba045 bash[25517]: cluster 2021-03-10T15:16:18.736722+0000 mgr.gibba045.orlgmj (mgr.34412) 4643 : cluster [DBG] pgmap v2636: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:19.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:16:18 gibba015 bash[29377]: cluster 2021-03-10T15:16:18.736722+0000 mgr.gibba045.orlgmj (mgr.34412) 4643 : cluster [DBG] pgmap v2636: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:19.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:16:18 gibba015 bash[30343]: cluster 2021-03-10T15:16:18.736722+0000 mgr.gibba045.orlgmj (mgr.34412) 4643 : cluster [DBG] pgmap v2636: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:21.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:16:20 gibba015 bash[29377]: cluster 2021-03-10T15:16:20.738059+0000 mgr.gibba045.orlgmj (mgr.34412) 4644 : cluster [DBG] pgmap v2637: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:21.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:16:20 gibba015 bash[30343]: cluster 2021-03-10T15:16:20.738059+0000 mgr.gibba045.orlgmj (mgr.34412) 4644 : cluster [DBG] pgmap v2637: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:21.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:16:20 gibba045 bash[25517]: cluster 2021-03-10T15:16:20.738059+0000 mgr.gibba045.orlgmj (mgr.34412) 4644 : cluster [DBG] pgmap v2637: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:23.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:16:22 gibba015 bash[29377]: cluster 2021-03-10T15:16:22.739719+0000 mgr.gibba045.orlgmj (mgr.34412) 4645 : cluster [DBG] pgmap v2638: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:23.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:16:22 gibba015 bash[30343]: cluster 2021-03-10T15:16:22.739719+0000 mgr.gibba045.orlgmj (mgr.34412) 4645 : cluster [DBG] pgmap v2638: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:23.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:16:22 gibba045 bash[25517]: cluster 2021-03-10T15:16:22.739719+0000 mgr.gibba045.orlgmj (mgr.34412) 4645 : cluster [DBG] pgmap v2638: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:25.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:16:24 gibba045 bash[25517]: cluster 2021-03-10T15:16:24.741400+0000 mgr.gibba045.orlgmj (mgr.34412) 4646 : cluster [DBG] pgmap v2639: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:25.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:16:24 gibba015 bash[29377]: cluster 2021-03-10T15:16:24.741400+0000 mgr.gibba045.orlgmj (mgr.34412) 4646 : cluster [DBG] pgmap v2639: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:25.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:16:24 gibba015 bash[30343]: cluster 2021-03-10T15:16:24.741400+0000 mgr.gibba045.orlgmj (mgr.34412) 4646 : cluster [DBG] pgmap v2639: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:26.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:16:25 gibba045 bash[25517]: cephadm 2021-03-10T15:16:24.863322+0000 mgr.gibba045.orlgmj (mgr.34412) 4647 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:16:26.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:16:25 gibba015 bash[29377]: cephadm 2021-03-10T15:16:24.863322+0000 mgr.gibba045.orlgmj (mgr.34412) 4647 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:16:26.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:16:25 gibba015 bash[30343]: cephadm 2021-03-10T15:16:24.863322+0000 mgr.gibba045.orlgmj (mgr.34412) 4647 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:16:27.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:16:26 gibba045 bash[25517]: cluster 2021-03-10T15:16:26.743103+0000 mgr.gibba045.orlgmj (mgr.34412) 4648 : cluster [DBG] pgmap v2640: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:27.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:16:26 gibba015 bash[29377]: cluster 2021-03-10T15:16:26.743103+0000 mgr.gibba045.orlgmj (mgr.34412) 4648 : cluster [DBG] pgmap v2640: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:27.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:16:26 gibba015 bash[30343]: cluster 2021-03-10T15:16:26.743103+0000 mgr.gibba045.orlgmj (mgr.34412) 4648 : cluster [DBG] pgmap v2640: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:29.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:16:28 gibba015 bash[29377]: cluster 2021-03-10T15:16:28.744425+0000 mgr.gibba045.orlgmj (mgr.34412) 4649 : cluster [DBG] pgmap v2641: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:29.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:16:28 gibba015 bash[30343]: cluster 2021-03-10T15:16:28.744425+0000 mgr.gibba045.orlgmj (mgr.34412) 4649 : cluster [DBG] pgmap v2641: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:29.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:16:28 gibba045 bash[25517]: cluster 2021-03-10T15:16:28.744425+0000 mgr.gibba045.orlgmj (mgr.34412) 4649 : cluster [DBG] pgmap v2641: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:31.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:16:30 gibba015 bash[29377]: cluster 2021-03-10T15:16:30.745933+0000 mgr.gibba045.orlgmj (mgr.34412) 4650 : cluster [DBG] pgmap v2642: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:31.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:16:30 gibba015 bash[30343]: cluster 2021-03-10T15:16:30.745933+0000 mgr.gibba045.orlgmj (mgr.34412) 4650 : cluster [DBG] pgmap v2642: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:31.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:16:30 gibba045 bash[25517]: cluster 2021-03-10T15:16:30.745933+0000 mgr.gibba045.orlgmj (mgr.34412) 4650 : cluster [DBG] pgmap v2642: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:33.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:16:32 gibba015 bash[29377]: cluster 2021-03-10T15:16:32.747510+0000 mgr.gibba045.orlgmj (mgr.34412) 4651 : cluster [DBG] pgmap v2643: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:33.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:16:32 gibba015 bash[30343]: cluster 2021-03-10T15:16:32.747510+0000 mgr.gibba045.orlgmj (mgr.34412) 4651 : cluster [DBG] pgmap v2643: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:33.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:16:32 gibba045 bash[25517]: cluster 2021-03-10T15:16:32.747510+0000 mgr.gibba045.orlgmj (mgr.34412) 4651 : cluster [DBG] pgmap v2643: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:35.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:16:34 gibba045 bash[25517]: cluster 2021-03-10T15:16:34.749331+0000 mgr.gibba045.orlgmj (mgr.34412) 4652 : cluster [DBG] pgmap v2644: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:35.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:16:34 gibba015 bash[29377]: cluster 2021-03-10T15:16:34.749331+0000 mgr.gibba045.orlgmj (mgr.34412) 4652 : cluster [DBG] pgmap v2644: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:35.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:16:34 gibba015 bash[30343]: cluster 2021-03-10T15:16:34.749331+0000 mgr.gibba045.orlgmj (mgr.34412) 4652 : cluster [DBG] pgmap v2644: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:37.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:16:36 gibba015 bash[29377]: cluster 2021-03-10T15:16:36.751006+0000 mgr.gibba045.orlgmj (mgr.34412) 4653 : cluster [DBG] pgmap v2645: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:37.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:16:36 gibba015 bash[30343]: cluster 2021-03-10T15:16:36.751006+0000 mgr.gibba045.orlgmj (mgr.34412) 4653 : cluster [DBG] pgmap v2645: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:37.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:16:36 gibba045 bash[25517]: cluster 2021-03-10T15:16:36.751006+0000 mgr.gibba045.orlgmj (mgr.34412) 4653 : cluster [DBG] pgmap v2645: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:39.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:16:38 gibba015 bash[29377]: cluster 2021-03-10T15:16:38.752516+0000 mgr.gibba045.orlgmj (mgr.34412) 4654 : cluster [DBG] pgmap v2646: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:39.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:16:38 gibba015 bash[30343]: cluster 2021-03-10T15:16:38.752516+0000 mgr.gibba045.orlgmj (mgr.34412) 4654 : cluster [DBG] pgmap v2646: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:39.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:16:38 gibba045 bash[25517]: cluster 2021-03-10T15:16:38.752516+0000 mgr.gibba045.orlgmj (mgr.34412) 4654 : cluster [DBG] pgmap v2646: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:41.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:16:40 gibba015 bash[29377]: cephadm 2021-03-10T15:16:39.867494+0000 mgr.gibba045.orlgmj (mgr.34412) 4655 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:16:41.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:16:40 gibba015 bash[29377]: cluster 2021-03-10T15:16:40.754357+0000 mgr.gibba045.orlgmj (mgr.34412) 4656 : cluster [DBG] pgmap v2647: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:41.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:16:40 gibba015 bash[30343]: cephadm 2021-03-10T15:16:39.867494+0000 mgr.gibba045.orlgmj (mgr.34412) 4655 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:16:41.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:16:40 gibba015 bash[30343]: cluster 2021-03-10T15:16:40.754357+0000 mgr.gibba045.orlgmj (mgr.34412) 4656 : cluster [DBG] pgmap v2647: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:41.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:16:40 gibba045 bash[25517]: cephadm 2021-03-10T15:16:39.867494+0000 mgr.gibba045.orlgmj (mgr.34412) 4655 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:16:41.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:16:40 gibba045 bash[25517]: cluster 2021-03-10T15:16:40.754357+0000 mgr.gibba045.orlgmj (mgr.34412) 4656 : cluster [DBG] pgmap v2647: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:42.432 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:16:42.658 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:16:42.659 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (87m) 116s ago 92m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:16:42.659 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (92m) 52s ago 92m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:16:42.659 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (87m) 52s ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:16:42.659 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (88m) 52s ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:16:42.660 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (87m) 116s ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:16:42.660 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (86m) 116s ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:16:42.660 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (86m) 52s ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:16:42.660 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (86m) 116s ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:16:42.661 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (92m) 116s ago 92m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:16:42.661 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (92m) 52s ago 92m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:16:42.661 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (85m) 116s ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:16:42.661 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (85m) 116s ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:16:42.662 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (84m) 116s ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:16:42.662 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (84m) 116s ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:16:42.662 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (84m) 52s ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:16:42.662 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (83m) 52s ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:16:42.663 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (83m) 52s ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:16:42.663 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (82m) 52s ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:16:42.663 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (92m) 52s ago 92m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:16:42.663 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 52s ago 90m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:16:42.907 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:16:42.908 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:16:42.908 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:16:42.908 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:16:42.908 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:16:42.908 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:16:42.909 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:16:42.909 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:16:42.909 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:16:42.909 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:16:42.910 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:16:42.910 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:16:42.910 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:16:42.910 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:16:42.911 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:16:43.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:16:42 gibba015 bash[29377]: audit 2021-03-10T15:16:42.423321+0000 mgr.gibba045.orlgmj (mgr.34412) 4657 : audit [DBG] from='client.47184 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:16:43.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:16:42 gibba015 bash[29377]: audit 2021-03-10T15:16:42.645944+0000 mgr.gibba045.orlgmj (mgr.34412) 4658 : audit [DBG] from='client.57178 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:16:43.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:16:42 gibba015 bash[29377]: cluster 2021-03-10T15:16:42.755850+0000 mgr.gibba045.orlgmj (mgr.34412) 4659 : cluster [DBG] pgmap v2648: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:43.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:16:42 gibba015 bash[30343]: audit 2021-03-10T15:16:42.423321+0000 mgr.gibba045.orlgmj (mgr.34412) 4657 : audit [DBG] from='client.47184 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:16:43.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:16:42 gibba015 bash[30343]: audit 2021-03-10T15:16:42.645944+0000 mgr.gibba045.orlgmj (mgr.34412) 4658 : audit [DBG] from='client.57178 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:16:43.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:16:42 gibba015 bash[30343]: cluster 2021-03-10T15:16:42.755850+0000 mgr.gibba045.orlgmj (mgr.34412) 4659 : cluster [DBG] pgmap v2648: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:43.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:16:42 gibba045 bash[25517]: audit 2021-03-10T15:16:42.423321+0000 mgr.gibba045.orlgmj (mgr.34412) 4657 : audit [DBG] from='client.47184 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:16:43.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:16:42 gibba045 bash[25517]: audit 2021-03-10T15:16:42.645944+0000 mgr.gibba045.orlgmj (mgr.34412) 4658 : audit [DBG] from='client.57178 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:16:43.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:16:42 gibba045 bash[25517]: cluster 2021-03-10T15:16:42.755850+0000 mgr.gibba045.orlgmj (mgr.34412) 4659 : cluster [DBG] pgmap v2648: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:44.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:16:43 gibba015 bash[29377]: audit 2021-03-10T15:16:42.903526+0000 mon.c (mon.1) 1322 : audit [DBG] from='client.? 172.21.2.115:0/3571898767' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:16:44.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:16:43 gibba015 bash[30343]: audit 2021-03-10T15:16:42.903526+0000 mon.c (mon.1) 1322 : audit [DBG] from='client.? 172.21.2.115:0/3571898767' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:16:44.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:16:43 gibba045 bash[25517]: audit 2021-03-10T15:16:42.903526+0000 mon.c (mon.1) 1322 : audit [DBG] from='client.? 172.21.2.115:0/3571898767' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:16:45.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:16:44 gibba045 bash[25517]: cluster 2021-03-10T15:16:44.757533+0000 mgr.gibba045.orlgmj (mgr.34412) 4660 : cluster [DBG] pgmap v2649: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:45.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:16:44 gibba015 bash[29377]: cluster 2021-03-10T15:16:44.757533+0000 mgr.gibba045.orlgmj (mgr.34412) 4660 : cluster [DBG] pgmap v2649: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:45.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:16:44 gibba015 bash[30343]: cluster 2021-03-10T15:16:44.757533+0000 mgr.gibba045.orlgmj (mgr.34412) 4660 : cluster [DBG] pgmap v2649: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:47.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:16:46 gibba015 bash[29377]: cluster 2021-03-10T15:16:46.759314+0000 mgr.gibba045.orlgmj (mgr.34412) 4661 : cluster [DBG] pgmap v2650: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:47.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:16:46 gibba015 bash[30343]: cluster 2021-03-10T15:16:46.759314+0000 mgr.gibba045.orlgmj (mgr.34412) 4661 : cluster [DBG] pgmap v2650: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:47.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:16:46 gibba045 bash[25517]: cluster 2021-03-10T15:16:46.759314+0000 mgr.gibba045.orlgmj (mgr.34412) 4661 : cluster [DBG] pgmap v2650: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:49.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:16:48 gibba015 bash[29377]: cluster 2021-03-10T15:16:48.760584+0000 mgr.gibba045.orlgmj (mgr.34412) 4662 : cluster [DBG] pgmap v2651: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:49.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:16:48 gibba015 bash[30343]: cluster 2021-03-10T15:16:48.760584+0000 mgr.gibba045.orlgmj (mgr.34412) 4662 : cluster [DBG] pgmap v2651: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:49.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:16:48 gibba045 bash[25517]: cluster 2021-03-10T15:16:48.760584+0000 mgr.gibba045.orlgmj (mgr.34412) 4662 : cluster [DBG] pgmap v2651: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:51.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:16:50 gibba015 bash[29377]: cluster 2021-03-10T15:16:50.762014+0000 mgr.gibba045.orlgmj (mgr.34412) 4663 : cluster [DBG] pgmap v2652: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:51.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:16:50 gibba015 bash[30343]: cluster 2021-03-10T15:16:50.762014+0000 mgr.gibba045.orlgmj (mgr.34412) 4663 : cluster [DBG] pgmap v2652: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:51.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:16:50 gibba045 bash[25517]: cluster 2021-03-10T15:16:50.762014+0000 mgr.gibba045.orlgmj (mgr.34412) 4663 : cluster [DBG] pgmap v2652: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:53.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:16:52 gibba015 bash[29377]: cluster 2021-03-10T15:16:52.763416+0000 mgr.gibba045.orlgmj (mgr.34412) 4664 : cluster [DBG] pgmap v2653: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:53.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:16:52 gibba015 bash[30343]: cluster 2021-03-10T15:16:52.763416+0000 mgr.gibba045.orlgmj (mgr.34412) 4664 : cluster [DBG] pgmap v2653: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:53.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:16:52 gibba045 bash[25517]: cluster 2021-03-10T15:16:52.763416+0000 mgr.gibba045.orlgmj (mgr.34412) 4664 : cluster [DBG] pgmap v2653: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:54.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:16:53 gibba015 bash[29377]: audit 2021-03-10T15:16:53.052545+0000 mon.c (mon.1) 1323 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:16:54.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:16:53 gibba015 bash[29377]: audit 2021-03-10T15:16:53.053299+0000 mon.c (mon.1) 1324 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:16:54.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:16:53 gibba015 bash[29377]: audit 2021-03-10T15:16:53.053669+0000 mon.a (mon.0) 1284 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:16:54.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:16:53 gibba015 bash[29377]: audit 2021-03-10T15:16:53.055110+0000 mon.a (mon.0) 1285 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:16:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:16:53 gibba015 bash[29377]: audit 2021-03-10T15:16:53.056740+0000 mon.c (mon.1) 1325 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T15:16:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:16:53 gibba015 bash[29377]: audit 2021-03-10T15:16:53.057567+0000 mon.c (mon.1) 1326 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:16:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:16:53 gibba015 bash[29377]: audit 2021-03-10T15:16:53.057868+0000 mon.a (mon.0) 1286 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T15:16:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:16:53 gibba015 bash[29377]: audit 2021-03-10T15:16:53.058243+0000 mon.c (mon.1) 1327 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:16:54.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:16:53 gibba015 bash[29377]: audit 2021-03-10T15:16:53.059162+0000 mon.a (mon.0) 1287 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:16:54.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:16:53 gibba015 bash[29377]: audit 2021-03-10T15:16:53.059300+0000 mon.c (mon.1) 1328 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:16:54.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:16:53 gibba015 bash[29377]: audit 2021-03-10T15:16:53.060169+0000 mon.a (mon.0) 1288 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:16:54.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:16:53 gibba015 bash[29377]: audit 2021-03-10T15:16:53.061180+0000 mon.a (mon.0) 1289 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:16:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:16:53 gibba015 bash[30343]: audit 2021-03-10T15:16:53.052545+0000 mon.c (mon.1) 1323 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:16:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:16:53 gibba015 bash[30343]: audit 2021-03-10T15:16:53.053299+0000 mon.c (mon.1) 1324 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:16:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:16:53 gibba015 bash[30343]: audit 2021-03-10T15:16:53.053669+0000 mon.a (mon.0) 1284 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:16:54.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:16:53 gibba015 bash[30343]: audit 2021-03-10T15:16:53.055110+0000 mon.a (mon.0) 1285 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:16:54.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:16:53 gibba015 bash[30343]: audit 2021-03-10T15:16:53.056740+0000 mon.c (mon.1) 1325 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T15:16:54.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:16:53 gibba015 bash[30343]: audit 2021-03-10T15:16:53.057567+0000 mon.c (mon.1) 1326 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:16:54.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:16:53 gibba015 bash[30343]: audit 2021-03-10T15:16:53.057868+0000 mon.a (mon.0) 1286 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T15:16:54.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:16:53 gibba015 bash[30343]: audit 2021-03-10T15:16:53.058243+0000 mon.c (mon.1) 1327 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:16:54.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:16:53 gibba015 bash[30343]: audit 2021-03-10T15:16:53.059162+0000 mon.a (mon.0) 1287 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:16:54.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:16:53 gibba015 bash[30343]: audit 2021-03-10T15:16:53.059300+0000 mon.c (mon.1) 1328 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:16:54.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:16:53 gibba015 bash[30343]: audit 2021-03-10T15:16:53.060169+0000 mon.a (mon.0) 1288 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:16:54.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:16:53 gibba015 bash[30343]: audit 2021-03-10T15:16:53.061180+0000 mon.a (mon.0) 1289 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:16:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:16:53 gibba045 bash[25517]: audit 2021-03-10T15:16:53.052545+0000 mon.c (mon.1) 1323 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:16:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:16:53 gibba045 bash[25517]: audit 2021-03-10T15:16:53.053299+0000 mon.c (mon.1) 1324 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:16:54.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:16:53 gibba045 bash[25517]: audit 2021-03-10T15:16:53.053669+0000 mon.a (mon.0) 1284 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:16:54.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:16:53 gibba045 bash[25517]: audit 2021-03-10T15:16:53.055110+0000 mon.a (mon.0) 1285 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:16:54.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:16:53 gibba045 bash[25517]: audit 2021-03-10T15:16:53.056740+0000 mon.c (mon.1) 1325 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T15:16:54.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:16:53 gibba045 bash[25517]: audit 2021-03-10T15:16:53.057567+0000 mon.c (mon.1) 1326 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:16:54.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:16:53 gibba045 bash[25517]: audit 2021-03-10T15:16:53.057868+0000 mon.a (mon.0) 1286 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T15:16:54.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:16:53 gibba045 bash[25517]: audit 2021-03-10T15:16:53.058243+0000 mon.c (mon.1) 1327 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:16:54.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:16:53 gibba045 bash[25517]: audit 2021-03-10T15:16:53.059162+0000 mon.a (mon.0) 1287 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:16:54.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:16:53 gibba045 bash[25517]: audit 2021-03-10T15:16:53.059300+0000 mon.c (mon.1) 1328 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:16:54.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:16:53 gibba045 bash[25517]: audit 2021-03-10T15:16:53.060169+0000 mon.a (mon.0) 1288 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:16:54.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:16:53 gibba045 bash[25517]: audit 2021-03-10T15:16:53.061180+0000 mon.a (mon.0) 1289 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:16:55.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:16:54 gibba045 bash[25517]: audit 2021-03-10T15:16:54.879611+0000 mon.c (mon.1) 1329 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:16:55.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:16:54 gibba015 bash[29377]: audit 2021-03-10T15:16:54.879611+0000 mon.c (mon.1) 1329 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:16:55.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:16:54 gibba015 bash[30343]: audit 2021-03-10T15:16:54.879611+0000 mon.c (mon.1) 1329 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:16:56.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:16:56 gibba015 bash[29377]: cluster 2021-03-10T15:16:54.764962+0000 mgr.gibba045.orlgmj (mgr.34412) 4665 : cluster [DBG] pgmap v2654: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:56.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:16:56 gibba015 bash[29377]: cephadm 2021-03-10T15:16:54.886646+0000 mgr.gibba045.orlgmj (mgr.34412) 4666 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:16:56.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:16:56 gibba015 bash[29377]: cephadm 2021-03-10T15:16:54.887263+0000 mgr.gibba045.orlgmj (mgr.34412) 4667 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:16:56.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:16:56 gibba015 bash[29377]: audit 2021-03-10T15:16:55.103027+0000 mon.a (mon.0) 1290 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:16:56.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:16:56 gibba015 bash[29377]: audit 2021-03-10T15:16:55.106361+0000 mon.c (mon.1) 1330 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:16:56.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:16:56 gibba015 bash[29377]: audit 2021-03-10T15:16:55.107724+0000 mon.c (mon.1) 1331 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:16:56.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:16:56 gibba015 bash[29377]: audit 2021-03-10T15:16:55.108855+0000 mon.c (mon.1) 1332 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:16:56.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:16:56 gibba015 bash[29377]: cephadm 2021-03-10T15:16:55.109857+0000 mgr.gibba045.orlgmj (mgr.34412) 4668 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:16:56.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:16:56 gibba015 bash[29377]: audit 2021-03-10T15:16:55.110125+0000 mon.c (mon.1) 1333 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:16:56.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:16:56 gibba015 bash[29377]: cephadm 2021-03-10T15:16:55.111495+0000 mgr.gibba045.orlgmj (mgr.34412) 4669 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:16:56.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:16:56 gibba015 bash[29377]: cephadm 2021-03-10T15:16:55.112620+0000 mgr.gibba045.orlgmj (mgr.34412) 4670 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:16:56.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:16:56 gibba015 bash[29377]: cephadm 2021-03-10T15:16:55.112659+0000 mgr.gibba045.orlgmj (mgr.34412) 4671 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:16:56.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:16:56 gibba015 bash[29377]: audit 2021-03-10T15:16:55.113125+0000 mon.c (mon.1) 1334 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:16:56.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:16:56 gibba015 bash[29377]: cephadm 2021-03-10T15:16:55.113936+0000 mgr.gibba045.orlgmj (mgr.34412) 4672 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:16:56.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:16:56 gibba015 bash[29377]: cephadm 2021-03-10T15:16:55.113974+0000 mgr.gibba045.orlgmj (mgr.34412) 4673 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:16:56.479 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:16:56 gibba015 bash[29377]: audit 2021-03-10T15:16:55.114665+0000 mon.c (mon.1) 1335 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:16:56.479 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:16:56 gibba015 bash[29377]: cephadm 2021-03-10T15:16:55.115060+0000 mgr.gibba045.orlgmj (mgr.34412) 4674 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:16:56.479 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:16:56 gibba015 bash[29377]: cephadm 2021-03-10T15:16:55.116662+0000 mgr.gibba045.orlgmj (mgr.34412) 4675 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:16:56.479 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:16:56 gibba015 bash[29377]: cephadm 2021-03-10T15:16:55.116762+0000 mgr.gibba045.orlgmj (mgr.34412) 4676 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:16:56.480 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:16:56 gibba015 bash[29377]: cephadm 2021-03-10T15:16:55.118044+0000 mgr.gibba045.orlgmj (mgr.34412) 4677 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:16:56.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:16:56 gibba015 bash[30343]: cluster 2021-03-10T15:16:54.764962+0000 mgr.gibba045.orlgmj (mgr.34412) 4665 : cluster [DBG] pgmap v2654: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:56.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:16:56 gibba015 bash[30343]: cephadm 2021-03-10T15:16:54.886646+0000 mgr.gibba045.orlgmj (mgr.34412) 4666 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:16:56.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:16:56 gibba015 bash[30343]: cephadm 2021-03-10T15:16:54.887263+0000 mgr.gibba045.orlgmj (mgr.34412) 4667 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:16:56.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:16:56 gibba015 bash[30343]: audit 2021-03-10T15:16:55.103027+0000 mon.a (mon.0) 1290 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:16:56.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:16:56 gibba015 bash[30343]: audit 2021-03-10T15:16:55.106361+0000 mon.c (mon.1) 1330 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:16:56.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:16:56 gibba015 bash[30343]: audit 2021-03-10T15:16:55.107724+0000 mon.c (mon.1) 1331 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:16:56.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:16:56 gibba015 bash[30343]: audit 2021-03-10T15:16:55.108855+0000 mon.c (mon.1) 1332 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:16:56.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:16:56 gibba015 bash[30343]: cephadm 2021-03-10T15:16:55.109857+0000 mgr.gibba045.orlgmj (mgr.34412) 4668 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:16:56.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:16:56 gibba015 bash[30343]: audit 2021-03-10T15:16:55.110125+0000 mon.c (mon.1) 1333 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:16:56.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:16:56 gibba015 bash[30343]: cephadm 2021-03-10T15:16:55.111495+0000 mgr.gibba045.orlgmj (mgr.34412) 4669 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:16:56.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:16:56 gibba015 bash[30343]: cephadm 2021-03-10T15:16:55.112620+0000 mgr.gibba045.orlgmj (mgr.34412) 4670 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:16:56.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:16:56 gibba015 bash[30343]: cephadm 2021-03-10T15:16:55.112659+0000 mgr.gibba045.orlgmj (mgr.34412) 4671 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:16:56.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:16:56 gibba015 bash[30343]: audit 2021-03-10T15:16:55.113125+0000 mon.c (mon.1) 1334 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:16:56.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:16:56 gibba015 bash[30343]: cephadm 2021-03-10T15:16:55.113936+0000 mgr.gibba045.orlgmj (mgr.34412) 4672 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:16:56.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:16:56 gibba015 bash[30343]: cephadm 2021-03-10T15:16:55.113974+0000 mgr.gibba045.orlgmj (mgr.34412) 4673 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:16:56.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:16:56 gibba015 bash[30343]: audit 2021-03-10T15:16:55.114665+0000 mon.c (mon.1) 1335 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:16:56.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:16:56 gibba015 bash[30343]: cephadm 2021-03-10T15:16:55.115060+0000 mgr.gibba045.orlgmj (mgr.34412) 4674 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:16:56.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:16:56 gibba015 bash[30343]: cephadm 2021-03-10T15:16:55.116662+0000 mgr.gibba045.orlgmj (mgr.34412) 4675 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:16:56.485 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:16:56 gibba015 bash[30343]: cephadm 2021-03-10T15:16:55.116762+0000 mgr.gibba045.orlgmj (mgr.34412) 4676 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:16:56.485 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:16:56 gibba015 bash[30343]: cephadm 2021-03-10T15:16:55.118044+0000 mgr.gibba045.orlgmj (mgr.34412) 4677 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:16:56.485 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:16:56 gibba015 bash[29377]: cephadm 2021-03-10T15:16:55.118359+0000 mgr.gibba045.orlgmj (mgr.34412) 4678 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:16:56.485 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:16:56 gibba015 bash[29377]: cephadm 2021-03-10T15:16:55.120484+0000 mgr.gibba045.orlgmj (mgr.34412) 4679 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:16:56.486 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:16:56 gibba015 bash[29377]: cephadm 2021-03-10T15:16:55.120523+0000 mgr.gibba045.orlgmj (mgr.34412) 4680 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:16:56.486 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:16:56 gibba015 bash[29377]: cephadm 2021-03-10T15:16:55.120630+0000 mgr.gibba045.orlgmj (mgr.34412) 4681 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:16:56.486 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:16:56 gibba015 bash[30343]: cephadm 2021-03-10T15:16:55.118359+0000 mgr.gibba045.orlgmj (mgr.34412) 4678 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:16:56.487 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:16:56 gibba015 bash[30343]: cephadm 2021-03-10T15:16:55.120484+0000 mgr.gibba045.orlgmj (mgr.34412) 4679 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:16:56.487 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:16:56 gibba015 bash[30343]: cephadm 2021-03-10T15:16:55.120523+0000 mgr.gibba045.orlgmj (mgr.34412) 4680 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:16:56.487 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:16:56 gibba015 bash[30343]: cephadm 2021-03-10T15:16:55.120630+0000 mgr.gibba045.orlgmj (mgr.34412) 4681 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:16:56.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:16:56 gibba045 bash[25517]: cluster 2021-03-10T15:16:54.764962+0000 mgr.gibba045.orlgmj (mgr.34412) 4665 : cluster [DBG] pgmap v2654: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:56.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:16:56 gibba045 bash[25517]: cephadm 2021-03-10T15:16:54.886646+0000 mgr.gibba045.orlgmj (mgr.34412) 4666 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:16:56.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:16:56 gibba045 bash[25517]: cephadm 2021-03-10T15:16:54.887263+0000 mgr.gibba045.orlgmj (mgr.34412) 4667 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:16:56.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:16:56 gibba045 bash[25517]: audit 2021-03-10T15:16:55.103027+0000 mon.a (mon.0) 1290 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:16:56.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:16:56 gibba045 bash[25517]: audit 2021-03-10T15:16:55.106361+0000 mon.c (mon.1) 1330 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:16:56.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:16:56 gibba045 bash[25517]: audit 2021-03-10T15:16:55.107724+0000 mon.c (mon.1) 1331 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:16:56.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:16:56 gibba045 bash[25517]: audit 2021-03-10T15:16:55.108855+0000 mon.c (mon.1) 1332 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:16:56.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:16:56 gibba045 bash[25517]: cephadm 2021-03-10T15:16:55.109857+0000 mgr.gibba045.orlgmj (mgr.34412) 4668 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:16:56.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:16:56 gibba045 bash[25517]: audit 2021-03-10T15:16:55.110125+0000 mon.c (mon.1) 1333 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:16:56.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:16:56 gibba045 bash[25517]: cephadm 2021-03-10T15:16:55.111495+0000 mgr.gibba045.orlgmj (mgr.34412) 4669 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:16:56.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:16:56 gibba045 bash[25517]: cephadm 2021-03-10T15:16:55.112620+0000 mgr.gibba045.orlgmj (mgr.34412) 4670 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:16:56.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:16:56 gibba045 bash[25517]: cephadm 2021-03-10T15:16:55.112659+0000 mgr.gibba045.orlgmj (mgr.34412) 4671 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:16:56.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:16:56 gibba045 bash[25517]: audit 2021-03-10T15:16:55.113125+0000 mon.c (mon.1) 1334 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:16:56.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:16:56 gibba045 bash[25517]: cephadm 2021-03-10T15:16:55.113936+0000 mgr.gibba045.orlgmj (mgr.34412) 4672 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:16:56.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:16:56 gibba045 bash[25517]: cephadm 2021-03-10T15:16:55.113974+0000 mgr.gibba045.orlgmj (mgr.34412) 4673 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:16:56.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:16:56 gibba045 bash[25517]: audit 2021-03-10T15:16:55.114665+0000 mon.c (mon.1) 1335 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:16:56.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:16:56 gibba045 bash[25517]: cephadm 2021-03-10T15:16:55.115060+0000 mgr.gibba045.orlgmj (mgr.34412) 4674 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:16:56.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:16:56 gibba045 bash[25517]: cephadm 2021-03-10T15:16:55.116662+0000 mgr.gibba045.orlgmj (mgr.34412) 4675 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:16:56.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:16:56 gibba045 bash[25517]: cephadm 2021-03-10T15:16:55.116762+0000 mgr.gibba045.orlgmj (mgr.34412) 4676 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:16:56.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:16:56 gibba045 bash[25517]: cephadm 2021-03-10T15:16:55.118044+0000 mgr.gibba045.orlgmj (mgr.34412) 4677 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:16:56.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:16:56 gibba045 bash[25517]: cephadm 2021-03-10T15:16:55.118359+0000 mgr.gibba045.orlgmj (mgr.34412) 4678 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:16:56.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:16:56 gibba045 bash[25517]: cephadm 2021-03-10T15:16:55.120484+0000 mgr.gibba045.orlgmj (mgr.34412) 4679 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:16:56.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:16:56 gibba045 bash[25517]: cephadm 2021-03-10T15:16:55.120523+0000 mgr.gibba045.orlgmj (mgr.34412) 4680 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:16:56.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:16:56 gibba045 bash[25517]: cephadm 2021-03-10T15:16:55.120630+0000 mgr.gibba045.orlgmj (mgr.34412) 4681 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:16:58.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:16:58 gibba015 bash[29377]: cluster 2021-03-10T15:16:56.766433+0000 mgr.gibba045.orlgmj (mgr.34412) 4682 : cluster [DBG] pgmap v2655: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:58.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:16:58 gibba015 bash[30343]: cluster 2021-03-10T15:16:56.766433+0000 mgr.gibba045.orlgmj (mgr.34412) 4682 : cluster [DBG] pgmap v2655: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:58.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:16:58 gibba045 bash[25517]: cluster 2021-03-10T15:16:56.766433+0000 mgr.gibba045.orlgmj (mgr.34412) 4682 : cluster [DBG] pgmap v2655: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:00.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:17:00 gibba015 bash[29377]: cluster 2021-03-10T15:16:58.767777+0000 mgr.gibba045.orlgmj (mgr.34412) 4683 : cluster [DBG] pgmap v2656: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:00.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:17:00 gibba015 bash[30343]: cluster 2021-03-10T15:16:58.767777+0000 mgr.gibba045.orlgmj (mgr.34412) 4683 : cluster [DBG] pgmap v2656: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:00.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:17:00 gibba045 bash[25517]: cluster 2021-03-10T15:16:58.767777+0000 mgr.gibba045.orlgmj (mgr.34412) 4683 : cluster [DBG] pgmap v2656: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:02.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:17:02 gibba015 bash[29377]: cluster 2021-03-10T15:17:00.769432+0000 mgr.gibba045.orlgmj (mgr.34412) 4684 : cluster [DBG] pgmap v2657: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:02.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:17:02 gibba015 bash[30343]: cluster 2021-03-10T15:17:00.769432+0000 mgr.gibba045.orlgmj (mgr.34412) 4684 : cluster [DBG] pgmap v2657: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:02.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:17:02 gibba045 bash[25517]: cluster 2021-03-10T15:17:00.769432+0000 mgr.gibba045.orlgmj (mgr.34412) 4684 : cluster [DBG] pgmap v2657: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:04.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:17:04 gibba015 bash[29377]: cluster 2021-03-10T15:17:02.770848+0000 mgr.gibba045.orlgmj (mgr.34412) 4685 : cluster [DBG] pgmap v2658: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:04.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:17:04 gibba015 bash[30343]: cluster 2021-03-10T15:17:02.770848+0000 mgr.gibba045.orlgmj (mgr.34412) 4685 : cluster [DBG] pgmap v2658: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:04.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:17:04 gibba045 bash[25517]: cluster 2021-03-10T15:17:02.770848+0000 mgr.gibba045.orlgmj (mgr.34412) 4685 : cluster [DBG] pgmap v2658: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:06.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:17:06 gibba015 bash[29377]: cluster 2021-03-10T15:17:04.772545+0000 mgr.gibba045.orlgmj (mgr.34412) 4686 : cluster [DBG] pgmap v2659: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:06.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:17:06 gibba015 bash[30343]: cluster 2021-03-10T15:17:04.772545+0000 mgr.gibba045.orlgmj (mgr.34412) 4686 : cluster [DBG] pgmap v2659: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:06.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:17:06 gibba045 bash[25517]: cluster 2021-03-10T15:17:04.772545+0000 mgr.gibba045.orlgmj (mgr.34412) 4686 : cluster [DBG] pgmap v2659: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:08.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:17:08 gibba015 bash[29377]: cluster 2021-03-10T15:17:06.774040+0000 mgr.gibba045.orlgmj (mgr.34412) 4687 : cluster [DBG] pgmap v2660: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:08.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:17:08 gibba015 bash[30343]: cluster 2021-03-10T15:17:06.774040+0000 mgr.gibba045.orlgmj (mgr.34412) 4687 : cluster [DBG] pgmap v2660: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:08.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:17:08 gibba045 bash[25517]: cluster 2021-03-10T15:17:06.774040+0000 mgr.gibba045.orlgmj (mgr.34412) 4687 : cluster [DBG] pgmap v2660: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:10.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:17:10 gibba015 bash[29377]: cluster 2021-03-10T15:17:08.775513+0000 mgr.gibba045.orlgmj (mgr.34412) 4688 : cluster [DBG] pgmap v2661: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:10.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:17:10 gibba015 bash[30343]: cluster 2021-03-10T15:17:08.775513+0000 mgr.gibba045.orlgmj (mgr.34412) 4688 : cluster [DBG] pgmap v2661: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:10.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:17:10 gibba045 bash[25517]: cluster 2021-03-10T15:17:08.775513+0000 mgr.gibba045.orlgmj (mgr.34412) 4688 : cluster [DBG] pgmap v2661: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:11.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:17:11 gibba015 bash[29377]: cephadm 2021-03-10T15:17:10.136659+0000 mgr.gibba045.orlgmj (mgr.34412) 4689 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:17:11.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:17:11 gibba015 bash[30343]: cephadm 2021-03-10T15:17:10.136659+0000 mgr.gibba045.orlgmj (mgr.34412) 4689 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:17:11.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:17:11 gibba045 bash[25517]: cephadm 2021-03-10T15:17:10.136659+0000 mgr.gibba045.orlgmj (mgr.34412) 4689 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:17:12.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:17:12 gibba015 bash[29377]: cluster 2021-03-10T15:17:10.777313+0000 mgr.gibba045.orlgmj (mgr.34412) 4690 : cluster [DBG] pgmap v2662: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:12.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:17:12 gibba015 bash[30343]: cluster 2021-03-10T15:17:10.777313+0000 mgr.gibba045.orlgmj (mgr.34412) 4690 : cluster [DBG] pgmap v2662: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:12.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:17:12 gibba045 bash[25517]: cluster 2021-03-10T15:17:10.777313+0000 mgr.gibba045.orlgmj (mgr.34412) 4690 : cluster [DBG] pgmap v2662: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:13.149 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:17:13.379 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:17:13.380 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (87m) 2m ago 93m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:17:13.380 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (93m) 83s ago 93m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:17:13.380 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (88m) 83s ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:17:13.381 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (88m) 83s ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:17:13.381 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (87m) 2m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:17:13.381 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (87m) 2m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:17:13.381 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (87m) 83s ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:17:13.382 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (87m) 2m ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:17:13.382 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (93m) 2m ago 93m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:17:13.382 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (93m) 83s ago 93m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:17:13.382 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (86m) 2m ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:17:13.383 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (85m) 2m ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:17:13.383 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (85m) 2m ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:17:13.383 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (84m) 2m ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:17:13.383 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (84m) 83s ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:17:13.384 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (84m) 83s ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:17:13.384 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (83m) 83s ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:17:13.384 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (83m) 83s ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:17:13.384 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (92m) 83s ago 93m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:17:13.385 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 83s ago 91m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:17:13.625 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:17:13.626 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:17:13.626 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:17:13.626 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:17:13.627 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:17:13.627 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:17:13.627 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:17:13.627 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:17:13.628 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:17:13.628 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:17:13.628 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:17:13.628 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:17:13.628 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:17:13.629 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:17:13.629 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:17:14.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:17:14 gibba015 bash[29377]: cluster 2021-03-10T15:17:12.778838+0000 mgr.gibba045.orlgmj (mgr.34412) 4691 : cluster [DBG] pgmap v2663: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:14.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:17:14 gibba015 bash[29377]: audit 2021-03-10T15:17:13.140241+0000 mgr.gibba045.orlgmj (mgr.34412) 4692 : audit [DBG] from='client.47202 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:17:14.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:17:14 gibba015 bash[29377]: audit 2021-03-10T15:17:13.367639+0000 mgr.gibba045.orlgmj (mgr.34412) 4693 : audit [DBG] from='client.47208 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:17:14.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:17:14 gibba015 bash[29377]: audit 2021-03-10T15:17:13.621690+0000 mon.c (mon.1) 1336 : audit [DBG] from='client.? 172.21.2.115:0/3378807018' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:17:14.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:17:14 gibba015 bash[30343]: cluster 2021-03-10T15:17:12.778838+0000 mgr.gibba045.orlgmj (mgr.34412) 4691 : cluster [DBG] pgmap v2663: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:14.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:17:14 gibba015 bash[30343]: audit 2021-03-10T15:17:13.140241+0000 mgr.gibba045.orlgmj (mgr.34412) 4692 : audit [DBG] from='client.47202 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:17:14.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:17:14 gibba015 bash[30343]: audit 2021-03-10T15:17:13.367639+0000 mgr.gibba045.orlgmj (mgr.34412) 4693 : audit [DBG] from='client.47208 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:17:14.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:17:14 gibba015 bash[30343]: audit 2021-03-10T15:17:13.621690+0000 mon.c (mon.1) 1336 : audit [DBG] from='client.? 172.21.2.115:0/3378807018' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:17:14.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:17:14 gibba045 bash[25517]: cluster 2021-03-10T15:17:12.778838+0000 mgr.gibba045.orlgmj (mgr.34412) 4691 : cluster [DBG] pgmap v2663: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:14.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:17:14 gibba045 bash[25517]: audit 2021-03-10T15:17:13.140241+0000 mgr.gibba045.orlgmj (mgr.34412) 4692 : audit [DBG] from='client.47202 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:17:14.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:17:14 gibba045 bash[25517]: audit 2021-03-10T15:17:13.367639+0000 mgr.gibba045.orlgmj (mgr.34412) 4693 : audit [DBG] from='client.47208 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:17:14.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:17:14 gibba045 bash[25517]: audit 2021-03-10T15:17:13.621690+0000 mon.c (mon.1) 1336 : audit [DBG] from='client.? 172.21.2.115:0/3378807018' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:17:16.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:17:16 gibba015 bash[29377]: cluster 2021-03-10T15:17:14.780514+0000 mgr.gibba045.orlgmj (mgr.34412) 4694 : cluster [DBG] pgmap v2664: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:16.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:17:16 gibba015 bash[30343]: cluster 2021-03-10T15:17:14.780514+0000 mgr.gibba045.orlgmj (mgr.34412) 4694 : cluster [DBG] pgmap v2664: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:16.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:17:16 gibba045 bash[25517]: cluster 2021-03-10T15:17:14.780514+0000 mgr.gibba045.orlgmj (mgr.34412) 4694 : cluster [DBG] pgmap v2664: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:18.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:17:18 gibba015 bash[29377]: cluster 2021-03-10T15:17:16.782302+0000 mgr.gibba045.orlgmj (mgr.34412) 4695 : cluster [DBG] pgmap v2665: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:18.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:17:18 gibba015 bash[30343]: cluster 2021-03-10T15:17:16.782302+0000 mgr.gibba045.orlgmj (mgr.34412) 4695 : cluster [DBG] pgmap v2665: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:18.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:17:18 gibba045 bash[25517]: cluster 2021-03-10T15:17:16.782302+0000 mgr.gibba045.orlgmj (mgr.34412) 4695 : cluster [DBG] pgmap v2665: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:20.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:17:20 gibba015 bash[29377]: cluster 2021-03-10T15:17:18.783738+0000 mgr.gibba045.orlgmj (mgr.34412) 4696 : cluster [DBG] pgmap v2666: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:20.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:17:20 gibba015 bash[30343]: cluster 2021-03-10T15:17:18.783738+0000 mgr.gibba045.orlgmj (mgr.34412) 4696 : cluster [DBG] pgmap v2666: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:20.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:17:20 gibba045 bash[25517]: cluster 2021-03-10T15:17:18.783738+0000 mgr.gibba045.orlgmj (mgr.34412) 4696 : cluster [DBG] pgmap v2666: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:22.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:17:22 gibba045 bash[25517]: cluster 2021-03-10T15:17:20.785516+0000 mgr.gibba045.orlgmj (mgr.34412) 4697 : cluster [DBG] pgmap v2667: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:22.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:17:22 gibba015 bash[29377]: cluster 2021-03-10T15:17:20.785516+0000 mgr.gibba045.orlgmj (mgr.34412) 4697 : cluster [DBG] pgmap v2667: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:22.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:17:22 gibba015 bash[30343]: cluster 2021-03-10T15:17:20.785516+0000 mgr.gibba045.orlgmj (mgr.34412) 4697 : cluster [DBG] pgmap v2667: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:24.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:17:24 gibba045 bash[25517]: cluster 2021-03-10T15:17:22.787086+0000 mgr.gibba045.orlgmj (mgr.34412) 4698 : cluster [DBG] pgmap v2668: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:24.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:17:24 gibba015 bash[29377]: cluster 2021-03-10T15:17:22.787086+0000 mgr.gibba045.orlgmj (mgr.34412) 4698 : cluster [DBG] pgmap v2668: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:24.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:17:24 gibba015 bash[30343]: cluster 2021-03-10T15:17:22.787086+0000 mgr.gibba045.orlgmj (mgr.34412) 4698 : cluster [DBG] pgmap v2668: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:26.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:17:26 gibba045 bash[25517]: cluster 2021-03-10T15:17:24.788916+0000 mgr.gibba045.orlgmj (mgr.34412) 4699 : cluster [DBG] pgmap v2669: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:26.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:17:26 gibba045 bash[25517]: cephadm 2021-03-10T15:17:25.152759+0000 mgr.gibba045.orlgmj (mgr.34412) 4700 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:17:26.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:17:26 gibba015 bash[29377]: cluster 2021-03-10T15:17:24.788916+0000 mgr.gibba045.orlgmj (mgr.34412) 4699 : cluster [DBG] pgmap v2669: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:26.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:17:26 gibba015 bash[29377]: cephadm 2021-03-10T15:17:25.152759+0000 mgr.gibba045.orlgmj (mgr.34412) 4700 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:17:26.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:17:26 gibba015 bash[30343]: cluster 2021-03-10T15:17:24.788916+0000 mgr.gibba045.orlgmj (mgr.34412) 4699 : cluster [DBG] pgmap v2669: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:26.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:17:26 gibba015 bash[30343]: cephadm 2021-03-10T15:17:25.152759+0000 mgr.gibba045.orlgmj (mgr.34412) 4700 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:17:28.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:17:28 gibba045 bash[25517]: cluster 2021-03-10T15:17:26.790872+0000 mgr.gibba045.orlgmj (mgr.34412) 4701 : cluster [DBG] pgmap v2670: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:28.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:17:28 gibba015 bash[29377]: cluster 2021-03-10T15:17:26.790872+0000 mgr.gibba045.orlgmj (mgr.34412) 4701 : cluster [DBG] pgmap v2670: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:28.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:17:28 gibba015 bash[30343]: cluster 2021-03-10T15:17:26.790872+0000 mgr.gibba045.orlgmj (mgr.34412) 4701 : cluster [DBG] pgmap v2670: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:30.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:17:30 gibba045 bash[25517]: cluster 2021-03-10T15:17:28.792322+0000 mgr.gibba045.orlgmj (mgr.34412) 4702 : cluster [DBG] pgmap v2671: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:30.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:17:30 gibba015 bash[29377]: cluster 2021-03-10T15:17:28.792322+0000 mgr.gibba045.orlgmj (mgr.34412) 4702 : cluster [DBG] pgmap v2671: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:30.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:17:30 gibba015 bash[30343]: cluster 2021-03-10T15:17:28.792322+0000 mgr.gibba045.orlgmj (mgr.34412) 4702 : cluster [DBG] pgmap v2671: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:32.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:17:32 gibba045 bash[25517]: cluster 2021-03-10T15:17:30.794174+0000 mgr.gibba045.orlgmj (mgr.34412) 4703 : cluster [DBG] pgmap v2672: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:32.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:17:32 gibba015 bash[29377]: cluster 2021-03-10T15:17:30.794174+0000 mgr.gibba045.orlgmj (mgr.34412) 4703 : cluster [DBG] pgmap v2672: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:32.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:17:32 gibba015 bash[30343]: cluster 2021-03-10T15:17:30.794174+0000 mgr.gibba045.orlgmj (mgr.34412) 4703 : cluster [DBG] pgmap v2672: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:34.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:17:34 gibba045 bash[25517]: cluster 2021-03-10T15:17:32.795825+0000 mgr.gibba045.orlgmj (mgr.34412) 4704 : cluster [DBG] pgmap v2673: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:34.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:17:34 gibba015 bash[29377]: cluster 2021-03-10T15:17:32.795825+0000 mgr.gibba045.orlgmj (mgr.34412) 4704 : cluster [DBG] pgmap v2673: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:34.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:17:34 gibba015 bash[30343]: cluster 2021-03-10T15:17:32.795825+0000 mgr.gibba045.orlgmj (mgr.34412) 4704 : cluster [DBG] pgmap v2673: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:36.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:17:36 gibba045 bash[25517]: cluster 2021-03-10T15:17:34.797249+0000 mgr.gibba045.orlgmj (mgr.34412) 4705 : cluster [DBG] pgmap v2674: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:36.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:17:36 gibba015 bash[29377]: cluster 2021-03-10T15:17:34.797249+0000 mgr.gibba045.orlgmj (mgr.34412) 4705 : cluster [DBG] pgmap v2674: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:36.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:17:36 gibba015 bash[30343]: cluster 2021-03-10T15:17:34.797249+0000 mgr.gibba045.orlgmj (mgr.34412) 4705 : cluster [DBG] pgmap v2674: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:38.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:17:38 gibba045 bash[25517]: cluster 2021-03-10T15:17:36.798989+0000 mgr.gibba045.orlgmj (mgr.34412) 4706 : cluster [DBG] pgmap v2675: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:38.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:17:38 gibba015 bash[29377]: cluster 2021-03-10T15:17:36.798989+0000 mgr.gibba045.orlgmj (mgr.34412) 4706 : cluster [DBG] pgmap v2675: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:38.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:17:38 gibba015 bash[30343]: cluster 2021-03-10T15:17:36.798989+0000 mgr.gibba045.orlgmj (mgr.34412) 4706 : cluster [DBG] pgmap v2675: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:40.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:17:40 gibba045 bash[25517]: cluster 2021-03-10T15:17:38.799443+0000 mgr.gibba045.orlgmj (mgr.34412) 4707 : cluster [DBG] pgmap v2676: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:40.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:17:40 gibba015 bash[29377]: cluster 2021-03-10T15:17:38.799443+0000 mgr.gibba045.orlgmj (mgr.34412) 4707 : cluster [DBG] pgmap v2676: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:40.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:17:40 gibba015 bash[30343]: cluster 2021-03-10T15:17:38.799443+0000 mgr.gibba045.orlgmj (mgr.34412) 4707 : cluster [DBG] pgmap v2676: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:41.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:17:41 gibba015 bash[29377]: cephadm 2021-03-10T15:17:40.168475+0000 mgr.gibba045.orlgmj (mgr.34412) 4708 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:17:41.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:17:41 gibba015 bash[30343]: cephadm 2021-03-10T15:17:40.168475+0000 mgr.gibba045.orlgmj (mgr.34412) 4708 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:17:41.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:17:41 gibba045 bash[25517]: cephadm 2021-03-10T15:17:40.168475+0000 mgr.gibba045.orlgmj (mgr.34412) 4708 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:17:42.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:17:42 gibba015 bash[29377]: cluster 2021-03-10T15:17:40.801172+0000 mgr.gibba045.orlgmj (mgr.34412) 4709 : cluster [DBG] pgmap v2677: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:42.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:17:42 gibba015 bash[30343]: cluster 2021-03-10T15:17:40.801172+0000 mgr.gibba045.orlgmj (mgr.34412) 4709 : cluster [DBG] pgmap v2677: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:42.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:17:42 gibba045 bash[25517]: cluster 2021-03-10T15:17:40.801172+0000 mgr.gibba045.orlgmj (mgr.34412) 4709 : cluster [DBG] pgmap v2677: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:43.872 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:17:44.101 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:17:44.101 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (88m) 2m ago 93m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:17:44.102 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (93m) 114s ago 93m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:17:44.102 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (88m) 114s ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:17:44.102 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (89m) 114s ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:17:44.102 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (88m) 2m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:17:44.103 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (87m) 2m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:17:44.103 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (87m) 114s ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:17:44.103 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (87m) 2m ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:17:44.103 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (93m) 2m ago 93m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:17:44.104 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (93m) 114s ago 94m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:17:44.104 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (86m) 2m ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:17:44.104 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (86m) 2m ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:17:44.105 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (85m) 2m ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:17:44.105 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (85m) 2m ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:17:44.105 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (85m) 114s ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:17:44.105 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (84m) 114s ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:17:44.106 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (84m) 114s ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:17:44.106 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (83m) 114s ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:17:44.106 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (93m) 114s ago 94m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:17:44.106 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 114s ago 91m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:17:44.351 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:17:44.351 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:17:44.352 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:17:44.352 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:17:44.352 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:17:44.352 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:17:44.353 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:17:44.353 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:17:44.353 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:17:44.354 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:17:44.354 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:17:44.354 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:17:44.354 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:17:44.355 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:17:44.355 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:17:44.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:17:44 gibba015 bash[29377]: cluster 2021-03-10T15:17:42.802542+0000 mgr.gibba045.orlgmj (mgr.34412) 4710 : cluster [DBG] pgmap v2678: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:44.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:17:44 gibba015 bash[30343]: cluster 2021-03-10T15:17:42.802542+0000 mgr.gibba045.orlgmj (mgr.34412) 4710 : cluster [DBG] pgmap v2678: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:44.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:17:44 gibba045 bash[25517]: cluster 2021-03-10T15:17:42.802542+0000 mgr.gibba045.orlgmj (mgr.34412) 4710 : cluster [DBG] pgmap v2678: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:45.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:17:45 gibba015 bash[29377]: audit 2021-03-10T15:17:43.863413+0000 mgr.gibba045.orlgmj (mgr.34412) 4711 : audit [DBG] from='client.57208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:17:45.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:17:45 gibba015 bash[29377]: audit 2021-03-10T15:17:44.089361+0000 mgr.gibba045.orlgmj (mgr.34412) 4712 : audit [DBG] from='client.57214 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:17:45.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:17:45 gibba015 bash[29377]: audit 2021-03-10T15:17:44.347349+0000 mon.c (mon.1) 1337 : audit [DBG] from='client.? 172.21.2.115:0/3717358682' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:17:45.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:17:45 gibba015 bash[30343]: audit 2021-03-10T15:17:43.863413+0000 mgr.gibba045.orlgmj (mgr.34412) 4711 : audit [DBG] from='client.57208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:17:45.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:17:45 gibba015 bash[30343]: audit 2021-03-10T15:17:44.089361+0000 mgr.gibba045.orlgmj (mgr.34412) 4712 : audit [DBG] from='client.57214 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:17:45.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:17:45 gibba015 bash[30343]: audit 2021-03-10T15:17:44.347349+0000 mon.c (mon.1) 1337 : audit [DBG] from='client.? 172.21.2.115:0/3717358682' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:17:45.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:17:45 gibba045 bash[25517]: audit 2021-03-10T15:17:43.863413+0000 mgr.gibba045.orlgmj (mgr.34412) 4711 : audit [DBG] from='client.57208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:17:45.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:17:45 gibba045 bash[25517]: audit 2021-03-10T15:17:44.089361+0000 mgr.gibba045.orlgmj (mgr.34412) 4712 : audit [DBG] from='client.57214 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:17:45.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:17:45 gibba045 bash[25517]: audit 2021-03-10T15:17:44.347349+0000 mon.c (mon.1) 1337 : audit [DBG] from='client.? 172.21.2.115:0/3717358682' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:17:46.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:17:46 gibba015 bash[29377]: cluster 2021-03-10T15:17:44.803858+0000 mgr.gibba045.orlgmj (mgr.34412) 4713 : cluster [DBG] pgmap v2679: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:46.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:17:46 gibba015 bash[30343]: cluster 2021-03-10T15:17:44.803858+0000 mgr.gibba045.orlgmj (mgr.34412) 4713 : cluster [DBG] pgmap v2679: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:46.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:17:46 gibba045 bash[25517]: cluster 2021-03-10T15:17:44.803858+0000 mgr.gibba045.orlgmj (mgr.34412) 4713 : cluster [DBG] pgmap v2679: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:48.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:17:48 gibba015 bash[29377]: cluster 2021-03-10T15:17:46.805629+0000 mgr.gibba045.orlgmj (mgr.34412) 4714 : cluster [DBG] pgmap v2680: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:48.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:17:48 gibba015 bash[30343]: cluster 2021-03-10T15:17:46.805629+0000 mgr.gibba045.orlgmj (mgr.34412) 4714 : cluster [DBG] pgmap v2680: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:48.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:17:48 gibba045 bash[25517]: cluster 2021-03-10T15:17:46.805629+0000 mgr.gibba045.orlgmj (mgr.34412) 4714 : cluster [DBG] pgmap v2680: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:50.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:17:50 gibba015 bash[29377]: cluster 2021-03-10T15:17:48.806124+0000 mgr.gibba045.orlgmj (mgr.34412) 4715 : cluster [DBG] pgmap v2681: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:50.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:17:50 gibba015 bash[30343]: cluster 2021-03-10T15:17:48.806124+0000 mgr.gibba045.orlgmj (mgr.34412) 4715 : cluster [DBG] pgmap v2681: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:50.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:17:50 gibba045 bash[25517]: cluster 2021-03-10T15:17:48.806124+0000 mgr.gibba045.orlgmj (mgr.34412) 4715 : cluster [DBG] pgmap v2681: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:52.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:17:52 gibba015 bash[29377]: cluster 2021-03-10T15:17:50.807728+0000 mgr.gibba045.orlgmj (mgr.34412) 4716 : cluster [DBG] pgmap v2682: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:52.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:17:52 gibba015 bash[30343]: cluster 2021-03-10T15:17:50.807728+0000 mgr.gibba045.orlgmj (mgr.34412) 4716 : cluster [DBG] pgmap v2682: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:52.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:17:52 gibba045 bash[25517]: cluster 2021-03-10T15:17:50.807728+0000 mgr.gibba045.orlgmj (mgr.34412) 4716 : cluster [DBG] pgmap v2682: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:53.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:17:53 gibba015 bash[29377]: audit 2021-03-10T15:17:53.060119+0000 mon.c (mon.1) 1338 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:17:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:17:53 gibba015 bash[29377]: audit 2021-03-10T15:17:53.060768+0000 mon.c (mon.1) 1339 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:17:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:17:53 gibba015 bash[29377]: audit 2021-03-10T15:17:53.061374+0000 mon.a (mon.0) 1291 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:17:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:17:53 gibba015 bash[29377]: audit 2021-03-10T15:17:53.062395+0000 mon.c (mon.1) 1340 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T15:17:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:17:53 gibba015 bash[29377]: audit 2021-03-10T15:17:53.063012+0000 mon.a (mon.0) 1292 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:17:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:17:53 gibba015 bash[29377]: audit 2021-03-10T15:17:53.063782+0000 mon.c (mon.1) 1341 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:17:53.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:17:53 gibba015 bash[29377]: audit 2021-03-10T15:17:53.064630+0000 mon.a (mon.0) 1293 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T15:17:53.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:17:53 gibba015 bash[29377]: audit 2021-03-10T15:17:53.065200+0000 mon.c (mon.1) 1342 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:17:53.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:17:53 gibba015 bash[29377]: audit 2021-03-10T15:17:53.065511+0000 mon.a (mon.0) 1294 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:17:53.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:17:53 gibba015 bash[29377]: audit 2021-03-10T15:17:53.065573+0000 mon.c (mon.1) 1343 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:17:53.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:17:53 gibba015 bash[29377]: audit 2021-03-10T15:17:53.065887+0000 mon.a (mon.0) 1295 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:17:53.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:17:53 gibba015 bash[29377]: audit 2021-03-10T15:17:53.066231+0000 mon.a (mon.0) 1296 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:17:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:17:53 gibba015 bash[30343]: audit 2021-03-10T15:17:53.060119+0000 mon.c (mon.1) 1338 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:17:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:17:53 gibba015 bash[30343]: audit 2021-03-10T15:17:53.060768+0000 mon.c (mon.1) 1339 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:17:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:17:53 gibba015 bash[30343]: audit 2021-03-10T15:17:53.061374+0000 mon.a (mon.0) 1291 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:17:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:17:53 gibba015 bash[30343]: audit 2021-03-10T15:17:53.062395+0000 mon.c (mon.1) 1340 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T15:17:53.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:17:53 gibba015 bash[30343]: audit 2021-03-10T15:17:53.063012+0000 mon.a (mon.0) 1292 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:17:53.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:17:53 gibba015 bash[30343]: audit 2021-03-10T15:17:53.063782+0000 mon.c (mon.1) 1341 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:17:53.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:17:53 gibba015 bash[30343]: audit 2021-03-10T15:17:53.064630+0000 mon.a (mon.0) 1293 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T15:17:53.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:17:53 gibba015 bash[30343]: audit 2021-03-10T15:17:53.065200+0000 mon.c (mon.1) 1342 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:17:53.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:17:53 gibba015 bash[30343]: audit 2021-03-10T15:17:53.065511+0000 mon.a (mon.0) 1294 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:17:53.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:17:53 gibba015 bash[30343]: audit 2021-03-10T15:17:53.065573+0000 mon.c (mon.1) 1343 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:17:53.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:17:53 gibba015 bash[30343]: audit 2021-03-10T15:17:53.065887+0000 mon.a (mon.0) 1295 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:17:53.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:17:53 gibba015 bash[30343]: audit 2021-03-10T15:17:53.066231+0000 mon.a (mon.0) 1296 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:17:53.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:17:53 gibba045 bash[25517]: audit 2021-03-10T15:17:53.060119+0000 mon.c (mon.1) 1338 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:17:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:17:53 gibba045 bash[25517]: audit 2021-03-10T15:17:53.060768+0000 mon.c (mon.1) 1339 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:17:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:17:53 gibba045 bash[25517]: audit 2021-03-10T15:17:53.061374+0000 mon.a (mon.0) 1291 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:17:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:17:53 gibba045 bash[25517]: audit 2021-03-10T15:17:53.062395+0000 mon.c (mon.1) 1340 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T15:17:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:17:53 gibba045 bash[25517]: audit 2021-03-10T15:17:53.063012+0000 mon.a (mon.0) 1292 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:17:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:17:53 gibba045 bash[25517]: audit 2021-03-10T15:17:53.063782+0000 mon.c (mon.1) 1341 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:17:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:17:53 gibba045 bash[25517]: audit 2021-03-10T15:17:53.064630+0000 mon.a (mon.0) 1293 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T15:17:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:17:53 gibba045 bash[25517]: audit 2021-03-10T15:17:53.065200+0000 mon.c (mon.1) 1342 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:17:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:17:53 gibba045 bash[25517]: audit 2021-03-10T15:17:53.065511+0000 mon.a (mon.0) 1294 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:17:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:17:53 gibba045 bash[25517]: audit 2021-03-10T15:17:53.065573+0000 mon.c (mon.1) 1343 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:17:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:17:53 gibba045 bash[25517]: audit 2021-03-10T15:17:53.065887+0000 mon.a (mon.0) 1295 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:17:53.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:17:53 gibba045 bash[25517]: audit 2021-03-10T15:17:53.066231+0000 mon.a (mon.0) 1296 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:17:54.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:17:54 gibba015 bash[29377]: cluster 2021-03-10T15:17:52.809185+0000 mgr.gibba045.orlgmj (mgr.34412) 4717 : cluster [DBG] pgmap v2683: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:54.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:17:54 gibba015 bash[30343]: cluster 2021-03-10T15:17:52.809185+0000 mgr.gibba045.orlgmj (mgr.34412) 4717 : cluster [DBG] pgmap v2683: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:54.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:17:54 gibba045 bash[25517]: cluster 2021-03-10T15:17:52.809185+0000 mgr.gibba045.orlgmj (mgr.34412) 4717 : cluster [DBG] pgmap v2683: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:55.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:17:55 gibba015 bash[29377]: audit 2021-03-10T15:17:55.180520+0000 mon.c (mon.1) 1344 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:17:55.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:17:55 gibba015 bash[30343]: audit 2021-03-10T15:17:55.180520+0000 mon.c (mon.1) 1344 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:17:55.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:17:55 gibba045 bash[25517]: audit 2021-03-10T15:17:55.180520+0000 mon.c (mon.1) 1344 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:17:56.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:17:56 gibba015 bash[29377]: cluster 2021-03-10T15:17:54.810716+0000 mgr.gibba045.orlgmj (mgr.34412) 4718 : cluster [DBG] pgmap v2684: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:56.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:17:56 gibba015 bash[29377]: cephadm 2021-03-10T15:17:55.189368+0000 mgr.gibba045.orlgmj (mgr.34412) 4719 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:17:56.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:17:56 gibba015 bash[29377]: cephadm 2021-03-10T15:17:55.191136+0000 mgr.gibba045.orlgmj (mgr.34412) 4720 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:17:56.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:17:56 gibba015 bash[29377]: audit 2021-03-10T15:17:55.395699+0000 mon.a (mon.0) 1297 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:17:56.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:17:56 gibba015 bash[29377]: audit 2021-03-10T15:17:55.399441+0000 mon.c (mon.1) 1345 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:17:56.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:17:56 gibba015 bash[29377]: audit 2021-03-10T15:17:55.400801+0000 mon.c (mon.1) 1346 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:17:56.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:17:56 gibba015 bash[29377]: audit 2021-03-10T15:17:55.401977+0000 mon.c (mon.1) 1347 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:17:56.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:17:56 gibba015 bash[29377]: cephadm 2021-03-10T15:17:55.402890+0000 mgr.gibba045.orlgmj (mgr.34412) 4721 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:17:56.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:17:56 gibba015 bash[29377]: audit 2021-03-10T15:17:55.403199+0000 mon.c (mon.1) 1348 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:17:56.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:17:56 gibba015 bash[29377]: cephadm 2021-03-10T15:17:55.404598+0000 mgr.gibba045.orlgmj (mgr.34412) 4722 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:17:56.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:17:56 gibba015 bash[29377]: audit 2021-03-10T15:17:55.405420+0000 mon.c (mon.1) 1349 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:17:56.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:17:56 gibba015 bash[29377]: cephadm 2021-03-10T15:17:55.405767+0000 mgr.gibba045.orlgmj (mgr.34412) 4723 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:17:56.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:17:56 gibba015 bash[29377]: cephadm 2021-03-10T15:17:55.405802+0000 mgr.gibba045.orlgmj (mgr.34412) 4724 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:17:56.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:17:56 gibba015 bash[29377]: audit 2021-03-10T15:17:55.406668+0000 mon.c (mon.1) 1350 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:17:56.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:17:56 gibba015 bash[29377]: cephadm 2021-03-10T15:17:55.407004+0000 mgr.gibba045.orlgmj (mgr.34412) 4725 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:17:56.729 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:17:56 gibba015 bash[29377]: cephadm 2021-03-10T15:17:55.407041+0000 mgr.gibba045.orlgmj (mgr.34412) 4726 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:17:56.729 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:17:56 gibba015 bash[29377]: cephadm 2021-03-10T15:17:55.408145+0000 mgr.gibba045.orlgmj (mgr.34412) 4727 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:17:56.729 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:17:56 gibba015 bash[29377]: cephadm 2021-03-10T15:17:55.409237+0000 mgr.gibba045.orlgmj (mgr.34412) 4728 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:17:56.729 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:17:56 gibba015 bash[29377]: cephadm 2021-03-10T15:17:55.409273+0000 mgr.gibba045.orlgmj (mgr.34412) 4729 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:17:56.729 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:17:56 gibba015 bash[29377]: cephadm 2021-03-10T15:17:55.410285+0000 mgr.gibba045.orlgmj (mgr.34412) 4730 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:17:56.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:17:56 gibba015 bash[30343]: cluster 2021-03-10T15:17:54.810716+0000 mgr.gibba045.orlgmj (mgr.34412) 4718 : cluster [DBG] pgmap v2684: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:56.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:17:56 gibba015 bash[30343]: cephadm 2021-03-10T15:17:55.189368+0000 mgr.gibba045.orlgmj (mgr.34412) 4719 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:17:56.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:17:56 gibba015 bash[30343]: cephadm 2021-03-10T15:17:55.191136+0000 mgr.gibba045.orlgmj (mgr.34412) 4720 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:17:56.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:17:56 gibba015 bash[30343]: audit 2021-03-10T15:17:55.395699+0000 mon.a (mon.0) 1297 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:17:56.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:17:56 gibba015 bash[30343]: audit 2021-03-10T15:17:55.399441+0000 mon.c (mon.1) 1345 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:17:56.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:17:56 gibba015 bash[30343]: audit 2021-03-10T15:17:55.400801+0000 mon.c (mon.1) 1346 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:17:56.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:17:56 gibba015 bash[30343]: audit 2021-03-10T15:17:55.401977+0000 mon.c (mon.1) 1347 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:17:56.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:17:56 gibba015 bash[30343]: cephadm 2021-03-10T15:17:55.402890+0000 mgr.gibba045.orlgmj (mgr.34412) 4721 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:17:56.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:17:56 gibba015 bash[30343]: audit 2021-03-10T15:17:55.403199+0000 mon.c (mon.1) 1348 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:17:56.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:17:56 gibba015 bash[30343]: cephadm 2021-03-10T15:17:55.404598+0000 mgr.gibba045.orlgmj (mgr.34412) 4722 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:17:56.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:17:56 gibba015 bash[30343]: audit 2021-03-10T15:17:55.405420+0000 mon.c (mon.1) 1349 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:17:56.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:17:56 gibba015 bash[30343]: cephadm 2021-03-10T15:17:55.405767+0000 mgr.gibba045.orlgmj (mgr.34412) 4723 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:17:56.733 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:17:56 gibba015 bash[30343]: cephadm 2021-03-10T15:17:55.405802+0000 mgr.gibba045.orlgmj (mgr.34412) 4724 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:17:56.733 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:17:56 gibba015 bash[30343]: audit 2021-03-10T15:17:55.406668+0000 mon.c (mon.1) 1350 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:17:56.733 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:17:56 gibba015 bash[30343]: cephadm 2021-03-10T15:17:55.407004+0000 mgr.gibba045.orlgmj (mgr.34412) 4725 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:17:56.733 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:17:56 gibba015 bash[30343]: cephadm 2021-03-10T15:17:55.407041+0000 mgr.gibba045.orlgmj (mgr.34412) 4726 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:17:56.734 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:17:56 gibba015 bash[30343]: cephadm 2021-03-10T15:17:55.408145+0000 mgr.gibba045.orlgmj (mgr.34412) 4727 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:17:56.734 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:17:56 gibba015 bash[30343]: cephadm 2021-03-10T15:17:55.409237+0000 mgr.gibba045.orlgmj (mgr.34412) 4728 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:17:56.734 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:17:56 gibba015 bash[30343]: cephadm 2021-03-10T15:17:55.409273+0000 mgr.gibba045.orlgmj (mgr.34412) 4729 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:17:56.734 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:17:56 gibba015 bash[30343]: cephadm 2021-03-10T15:17:55.410285+0000 mgr.gibba045.orlgmj (mgr.34412) 4730 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:17:56.735 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:17:56 gibba015 bash[29377]: cephadm 2021-03-10T15:17:55.410599+0000 mgr.gibba045.orlgmj (mgr.34412) 4731 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:17:56.735 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:17:56 gibba015 bash[29377]: cephadm 2021-03-10T15:17:55.411560+0000 mgr.gibba045.orlgmj (mgr.34412) 4732 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:17:56.735 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:17:56 gibba015 bash[29377]: cephadm 2021-03-10T15:17:55.411635+0000 mgr.gibba045.orlgmj (mgr.34412) 4733 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:17:56.735 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:17:56 gibba015 bash[29377]: cephadm 2021-03-10T15:17:55.411866+0000 mgr.gibba045.orlgmj (mgr.34412) 4734 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:17:56.736 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:17:56 gibba015 bash[30343]: cephadm 2021-03-10T15:17:55.410599+0000 mgr.gibba045.orlgmj (mgr.34412) 4731 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:17:56.736 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:17:56 gibba015 bash[30343]: cephadm 2021-03-10T15:17:55.411560+0000 mgr.gibba045.orlgmj (mgr.34412) 4732 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:17:56.736 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:17:56 gibba015 bash[30343]: cephadm 2021-03-10T15:17:55.411635+0000 mgr.gibba045.orlgmj (mgr.34412) 4733 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:17:56.737 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:17:56 gibba015 bash[30343]: cephadm 2021-03-10T15:17:55.411866+0000 mgr.gibba045.orlgmj (mgr.34412) 4734 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:17:56.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:17:56 gibba045 bash[25517]: cluster 2021-03-10T15:17:54.810716+0000 mgr.gibba045.orlgmj (mgr.34412) 4718 : cluster [DBG] pgmap v2684: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:56.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:17:56 gibba045 bash[25517]: cephadm 2021-03-10T15:17:55.189368+0000 mgr.gibba045.orlgmj (mgr.34412) 4719 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:17:56.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:17:56 gibba045 bash[25517]: cephadm 2021-03-10T15:17:55.191136+0000 mgr.gibba045.orlgmj (mgr.34412) 4720 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:17:56.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:17:56 gibba045 bash[25517]: audit 2021-03-10T15:17:55.395699+0000 mon.a (mon.0) 1297 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:17:56.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:17:56 gibba045 bash[25517]: audit 2021-03-10T15:17:55.399441+0000 mon.c (mon.1) 1345 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:17:56.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:17:56 gibba045 bash[25517]: audit 2021-03-10T15:17:55.400801+0000 mon.c (mon.1) 1346 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:17:56.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:17:56 gibba045 bash[25517]: audit 2021-03-10T15:17:55.401977+0000 mon.c (mon.1) 1347 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:17:56.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:17:56 gibba045 bash[25517]: cephadm 2021-03-10T15:17:55.402890+0000 mgr.gibba045.orlgmj (mgr.34412) 4721 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:17:56.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:17:56 gibba045 bash[25517]: audit 2021-03-10T15:17:55.403199+0000 mon.c (mon.1) 1348 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:17:56.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:17:56 gibba045 bash[25517]: cephadm 2021-03-10T15:17:55.404598+0000 mgr.gibba045.orlgmj (mgr.34412) 4722 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:17:56.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:17:56 gibba045 bash[25517]: audit 2021-03-10T15:17:55.405420+0000 mon.c (mon.1) 1349 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:17:56.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:17:56 gibba045 bash[25517]: cephadm 2021-03-10T15:17:55.405767+0000 mgr.gibba045.orlgmj (mgr.34412) 4723 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:17:56.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:17:56 gibba045 bash[25517]: cephadm 2021-03-10T15:17:55.405802+0000 mgr.gibba045.orlgmj (mgr.34412) 4724 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:17:56.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:17:56 gibba045 bash[25517]: audit 2021-03-10T15:17:55.406668+0000 mon.c (mon.1) 1350 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:17:56.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:17:56 gibba045 bash[25517]: cephadm 2021-03-10T15:17:55.407004+0000 mgr.gibba045.orlgmj (mgr.34412) 4725 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:17:56.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:17:56 gibba045 bash[25517]: cephadm 2021-03-10T15:17:55.407041+0000 mgr.gibba045.orlgmj (mgr.34412) 4726 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:17:56.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:17:56 gibba045 bash[25517]: cephadm 2021-03-10T15:17:55.408145+0000 mgr.gibba045.orlgmj (mgr.34412) 4727 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:17:56.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:17:56 gibba045 bash[25517]: cephadm 2021-03-10T15:17:55.409237+0000 mgr.gibba045.orlgmj (mgr.34412) 4728 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:17:56.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:17:56 gibba045 bash[25517]: cephadm 2021-03-10T15:17:55.409273+0000 mgr.gibba045.orlgmj (mgr.34412) 4729 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:17:56.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:17:56 gibba045 bash[25517]: cephadm 2021-03-10T15:17:55.410285+0000 mgr.gibba045.orlgmj (mgr.34412) 4730 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:17:56.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:17:56 gibba045 bash[25517]: cephadm 2021-03-10T15:17:55.410599+0000 mgr.gibba045.orlgmj (mgr.34412) 4731 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:17:56.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:17:56 gibba045 bash[25517]: cephadm 2021-03-10T15:17:55.411560+0000 mgr.gibba045.orlgmj (mgr.34412) 4732 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:17:56.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:17:56 gibba045 bash[25517]: cephadm 2021-03-10T15:17:55.411635+0000 mgr.gibba045.orlgmj (mgr.34412) 4733 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:17:56.812 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:17:56 gibba045 bash[25517]: cephadm 2021-03-10T15:17:55.411866+0000 mgr.gibba045.orlgmj (mgr.34412) 4734 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:17:58.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:17:58 gibba015 bash[29377]: cluster 2021-03-10T15:17:56.812336+0000 mgr.gibba045.orlgmj (mgr.34412) 4735 : cluster [DBG] pgmap v2685: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:58.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:17:58 gibba015 bash[30343]: cluster 2021-03-10T15:17:56.812336+0000 mgr.gibba045.orlgmj (mgr.34412) 4735 : cluster [DBG] pgmap v2685: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:58.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:17:58 gibba045 bash[25517]: cluster 2021-03-10T15:17:56.812336+0000 mgr.gibba045.orlgmj (mgr.34412) 4735 : cluster [DBG] pgmap v2685: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:00.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:18:00 gibba015 bash[29377]: cluster 2021-03-10T15:17:58.812909+0000 mgr.gibba045.orlgmj (mgr.34412) 4736 : cluster [DBG] pgmap v2686: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:00.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:18:00 gibba015 bash[30343]: cluster 2021-03-10T15:17:58.812909+0000 mgr.gibba045.orlgmj (mgr.34412) 4736 : cluster [DBG] pgmap v2686: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:00.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:18:00 gibba045 bash[25517]: cluster 2021-03-10T15:17:58.812909+0000 mgr.gibba045.orlgmj (mgr.34412) 4736 : cluster [DBG] pgmap v2686: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:02.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:18:02 gibba015 bash[29377]: cluster 2021-03-10T15:18:00.814390+0000 mgr.gibba045.orlgmj (mgr.34412) 4737 : cluster [DBG] pgmap v2687: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:02.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:18:02 gibba015 bash[30343]: cluster 2021-03-10T15:18:00.814390+0000 mgr.gibba045.orlgmj (mgr.34412) 4737 : cluster [DBG] pgmap v2687: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:02.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:18:02 gibba045 bash[25517]: cluster 2021-03-10T15:18:00.814390+0000 mgr.gibba045.orlgmj (mgr.34412) 4737 : cluster [DBG] pgmap v2687: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:04.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:18:04 gibba015 bash[29377]: cluster 2021-03-10T15:18:02.815884+0000 mgr.gibba045.orlgmj (mgr.34412) 4738 : cluster [DBG] pgmap v2688: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:04.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:18:04 gibba015 bash[30343]: cluster 2021-03-10T15:18:02.815884+0000 mgr.gibba045.orlgmj (mgr.34412) 4738 : cluster [DBG] pgmap v2688: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:04.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:18:04 gibba045 bash[25517]: cluster 2021-03-10T15:18:02.815884+0000 mgr.gibba045.orlgmj (mgr.34412) 4738 : cluster [DBG] pgmap v2688: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:06.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:18:06 gibba015 bash[29377]: cluster 2021-03-10T15:18:04.817470+0000 mgr.gibba045.orlgmj (mgr.34412) 4739 : cluster [DBG] pgmap v2689: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:06.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:18:06 gibba015 bash[30343]: cluster 2021-03-10T15:18:04.817470+0000 mgr.gibba045.orlgmj (mgr.34412) 4739 : cluster [DBG] pgmap v2689: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:06.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:18:06 gibba045 bash[25517]: cluster 2021-03-10T15:18:04.817470+0000 mgr.gibba045.orlgmj (mgr.34412) 4739 : cluster [DBG] pgmap v2689: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:08.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:18:08 gibba015 bash[29377]: cluster 2021-03-10T15:18:06.819086+0000 mgr.gibba045.orlgmj (mgr.34412) 4740 : cluster [DBG] pgmap v2690: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:08.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:18:08 gibba015 bash[30343]: cluster 2021-03-10T15:18:06.819086+0000 mgr.gibba045.orlgmj (mgr.34412) 4740 : cluster [DBG] pgmap v2690: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:08.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:18:08 gibba045 bash[25517]: cluster 2021-03-10T15:18:06.819086+0000 mgr.gibba045.orlgmj (mgr.34412) 4740 : cluster [DBG] pgmap v2690: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:10.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:18:10 gibba015 bash[29377]: cluster 2021-03-10T15:18:08.819569+0000 mgr.gibba045.orlgmj (mgr.34412) 4741 : cluster [DBG] pgmap v2691: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:10.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:18:10 gibba015 bash[30343]: cluster 2021-03-10T15:18:08.819569+0000 mgr.gibba045.orlgmj (mgr.34412) 4741 : cluster [DBG] pgmap v2691: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:10.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:18:10 gibba045 bash[25517]: cluster 2021-03-10T15:18:08.819569+0000 mgr.gibba045.orlgmj (mgr.34412) 4741 : cluster [DBG] pgmap v2691: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:11.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:18:11 gibba045 bash[25517]: cephadm 2021-03-10T15:18:10.413890+0000 mgr.gibba045.orlgmj (mgr.34412) 4742 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:18:11.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:18:11 gibba015 bash[29377]: cephadm 2021-03-10T15:18:10.413890+0000 mgr.gibba045.orlgmj (mgr.34412) 4742 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:18:11.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:18:11 gibba015 bash[30343]: cephadm 2021-03-10T15:18:10.413890+0000 mgr.gibba045.orlgmj (mgr.34412) 4742 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:18:12.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:18:12 gibba045 bash[25517]: cluster 2021-03-10T15:18:10.821120+0000 mgr.gibba045.orlgmj (mgr.34412) 4743 : cluster [DBG] pgmap v2692: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:12.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:18:12 gibba015 bash[29377]: cluster 2021-03-10T15:18:10.821120+0000 mgr.gibba045.orlgmj (mgr.34412) 4743 : cluster [DBG] pgmap v2692: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:12.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:18:12 gibba015 bash[30343]: cluster 2021-03-10T15:18:10.821120+0000 mgr.gibba045.orlgmj (mgr.34412) 4743 : cluster [DBG] pgmap v2692: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:14.597 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:18:14.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:18:14 gibba045 bash[25517]: cluster 2021-03-10T15:18:12.822517+0000 mgr.gibba045.orlgmj (mgr.34412) 4744 : cluster [DBG] pgmap v2693: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:14.859 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:18:14.860 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (88m) 3m ago 94m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:18:14.860 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (94m) 2m ago 94m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:18:14.860 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (89m) 2m ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:18:14.861 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (89m) 2m ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:18:14.861 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (88m) 3m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:18:14.861 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (88m) 3m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:18:14.861 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (88m) 2m ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:18:14.862 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (88m) 3m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:18:14.862 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (94m) 3m ago 94m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:18:14.862 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (94m) 2m ago 94m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:18:14.862 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (87m) 3m ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:18:14.863 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (86m) 3m ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:18:14.863 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (86m) 3m ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:18:14.863 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (85m) 3m ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:18:14.863 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (85m) 2m ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:18:14.864 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (85m) 2m ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:18:14.864 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (84m) 2m ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:18:14.864 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (84m) 2m ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:18:14.864 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (93m) 2m ago 94m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:18:14.865 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 2m ago 92m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:18:14.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:18:14 gibba015 bash[29377]: cluster 2021-03-10T15:18:12.822517+0000 mgr.gibba045.orlgmj (mgr.34412) 4744 : cluster [DBG] pgmap v2693: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:14.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:18:14 gibba015 bash[30343]: cluster 2021-03-10T15:18:12.822517+0000 mgr.gibba045.orlgmj (mgr.34412) 4744 : cluster [DBG] pgmap v2693: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:15.115 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:18:15.116 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:18:15.116 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:18:15.116 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:18:15.116 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:18:15.117 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:18:15.117 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:18:15.117 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:18:15.117 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:18:15.117 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:18:15.118 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:18:15.118 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:18:15.118 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:18:15.118 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:18:15.119 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:18:15.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:18:15 gibba045 bash[25517]: audit 2021-03-10T15:18:14.588622+0000 mgr.gibba045.orlgmj (mgr.34412) 4745 : audit [DBG] from='client.47238 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:18:15.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:18:15 gibba045 bash[25517]: audit 2021-03-10T15:18:15.111554+0000 mon.a (mon.0) 1298 : audit [DBG] from='client.? 172.21.2.115:0/2272893438' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:18:15.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:18:15 gibba015 bash[29377]: audit 2021-03-10T15:18:14.588622+0000 mgr.gibba045.orlgmj (mgr.34412) 4745 : audit [DBG] from='client.47238 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:18:15.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:18:15 gibba015 bash[29377]: audit 2021-03-10T15:18:15.111554+0000 mon.a (mon.0) 1298 : audit [DBG] from='client.? 172.21.2.115:0/2272893438' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:18:15.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:18:15 gibba015 bash[30343]: audit 2021-03-10T15:18:14.588622+0000 mgr.gibba045.orlgmj (mgr.34412) 4745 : audit [DBG] from='client.47238 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:18:15.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:18:15 gibba015 bash[30343]: audit 2021-03-10T15:18:15.111554+0000 mon.a (mon.0) 1298 : audit [DBG] from='client.? 172.21.2.115:0/2272893438' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:18:16.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:18:16 gibba045 bash[25517]: audit 2021-03-10T15:18:14.819072+0000 mgr.gibba045.orlgmj (mgr.34412) 4746 : audit [DBG] from='client.57232 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:18:16.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:18:16 gibba045 bash[25517]: cluster 2021-03-10T15:18:14.823832+0000 mgr.gibba045.orlgmj (mgr.34412) 4747 : cluster [DBG] pgmap v2694: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:16.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:18:16 gibba015 bash[29377]: audit 2021-03-10T15:18:14.819072+0000 mgr.gibba045.orlgmj (mgr.34412) 4746 : audit [DBG] from='client.57232 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:18:16.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:18:16 gibba015 bash[29377]: cluster 2021-03-10T15:18:14.823832+0000 mgr.gibba045.orlgmj (mgr.34412) 4747 : cluster [DBG] pgmap v2694: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:16.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:18:16 gibba015 bash[30343]: audit 2021-03-10T15:18:14.819072+0000 mgr.gibba045.orlgmj (mgr.34412) 4746 : audit [DBG] from='client.57232 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:18:16.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:18:16 gibba015 bash[30343]: cluster 2021-03-10T15:18:14.823832+0000 mgr.gibba045.orlgmj (mgr.34412) 4747 : cluster [DBG] pgmap v2694: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:18.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:18:18 gibba045 bash[25517]: cluster 2021-03-10T15:18:16.825422+0000 mgr.gibba045.orlgmj (mgr.34412) 4748 : cluster [DBG] pgmap v2695: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:18.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:18:18 gibba015 bash[29377]: cluster 2021-03-10T15:18:16.825422+0000 mgr.gibba045.orlgmj (mgr.34412) 4748 : cluster [DBG] pgmap v2695: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:18.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:18:18 gibba015 bash[30343]: cluster 2021-03-10T15:18:16.825422+0000 mgr.gibba045.orlgmj (mgr.34412) 4748 : cluster [DBG] pgmap v2695: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:20.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:18:20 gibba045 bash[25517]: cluster 2021-03-10T15:18:18.826004+0000 mgr.gibba045.orlgmj (mgr.34412) 4749 : cluster [DBG] pgmap v2696: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:20.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:18:20 gibba015 bash[29377]: cluster 2021-03-10T15:18:18.826004+0000 mgr.gibba045.orlgmj (mgr.34412) 4749 : cluster [DBG] pgmap v2696: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:20.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:18:20 gibba015 bash[30343]: cluster 2021-03-10T15:18:18.826004+0000 mgr.gibba045.orlgmj (mgr.34412) 4749 : cluster [DBG] pgmap v2696: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:22.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:18:22 gibba045 bash[25517]: cluster 2021-03-10T15:18:20.827612+0000 mgr.gibba045.orlgmj (mgr.34412) 4750 : cluster [DBG] pgmap v2697: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:22.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:18:22 gibba015 bash[29377]: cluster 2021-03-10T15:18:20.827612+0000 mgr.gibba045.orlgmj (mgr.34412) 4750 : cluster [DBG] pgmap v2697: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:22.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:18:22 gibba015 bash[30343]: cluster 2021-03-10T15:18:20.827612+0000 mgr.gibba045.orlgmj (mgr.34412) 4750 : cluster [DBG] pgmap v2697: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:24.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:18:24 gibba045 bash[25517]: cluster 2021-03-10T15:18:22.829325+0000 mgr.gibba045.orlgmj (mgr.34412) 4751 : cluster [DBG] pgmap v2698: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:24.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:18:24 gibba015 bash[29377]: cluster 2021-03-10T15:18:22.829325+0000 mgr.gibba045.orlgmj (mgr.34412) 4751 : cluster [DBG] pgmap v2698: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:24.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:18:24 gibba015 bash[30343]: cluster 2021-03-10T15:18:22.829325+0000 mgr.gibba045.orlgmj (mgr.34412) 4751 : cluster [DBG] pgmap v2698: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:26.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:18:26 gibba015 bash[29377]: cluster 2021-03-10T15:18:24.830901+0000 mgr.gibba045.orlgmj (mgr.34412) 4752 : cluster [DBG] pgmap v2699: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:26.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:18:26 gibba015 bash[29377]: cephadm 2021-03-10T15:18:25.429917+0000 mgr.gibba045.orlgmj (mgr.34412) 4753 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:18:26.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:18:26 gibba015 bash[30343]: cluster 2021-03-10T15:18:24.830901+0000 mgr.gibba045.orlgmj (mgr.34412) 4752 : cluster [DBG] pgmap v2699: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:26.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:18:26 gibba015 bash[30343]: cephadm 2021-03-10T15:18:25.429917+0000 mgr.gibba045.orlgmj (mgr.34412) 4753 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:18:27.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:18:26 gibba045 bash[25517]: cluster 2021-03-10T15:18:24.830901+0000 mgr.gibba045.orlgmj (mgr.34412) 4752 : cluster [DBG] pgmap v2699: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:27.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:18:26 gibba045 bash[25517]: cephadm 2021-03-10T15:18:25.429917+0000 mgr.gibba045.orlgmj (mgr.34412) 4753 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:18:28.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:18:28 gibba015 bash[29377]: cluster 2021-03-10T15:18:26.832385+0000 mgr.gibba045.orlgmj (mgr.34412) 4754 : cluster [DBG] pgmap v2700: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:28.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:18:28 gibba015 bash[30343]: cluster 2021-03-10T15:18:26.832385+0000 mgr.gibba045.orlgmj (mgr.34412) 4754 : cluster [DBG] pgmap v2700: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:29.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:18:28 gibba045 bash[25517]: cluster 2021-03-10T15:18:26.832385+0000 mgr.gibba045.orlgmj (mgr.34412) 4754 : cluster [DBG] pgmap v2700: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:30.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:18:30 gibba015 bash[29377]: cluster 2021-03-10T15:18:28.832901+0000 mgr.gibba045.orlgmj (mgr.34412) 4755 : cluster [DBG] pgmap v2701: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:30.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:18:30 gibba015 bash[30343]: cluster 2021-03-10T15:18:28.832901+0000 mgr.gibba045.orlgmj (mgr.34412) 4755 : cluster [DBG] pgmap v2701: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:31.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:18:30 gibba045 bash[25517]: cluster 2021-03-10T15:18:28.832901+0000 mgr.gibba045.orlgmj (mgr.34412) 4755 : cluster [DBG] pgmap v2701: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:32.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:18:32 gibba015 bash[29377]: cluster 2021-03-10T15:18:30.834518+0000 mgr.gibba045.orlgmj (mgr.34412) 4756 : cluster [DBG] pgmap v2702: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:32.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:18:32 gibba015 bash[30343]: cluster 2021-03-10T15:18:30.834518+0000 mgr.gibba045.orlgmj (mgr.34412) 4756 : cluster [DBG] pgmap v2702: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:33.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:18:32 gibba045 bash[25517]: cluster 2021-03-10T15:18:30.834518+0000 mgr.gibba045.orlgmj (mgr.34412) 4756 : cluster [DBG] pgmap v2702: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:34.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:18:34 gibba015 bash[29377]: cluster 2021-03-10T15:18:32.836136+0000 mgr.gibba045.orlgmj (mgr.34412) 4757 : cluster [DBG] pgmap v2703: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:34.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:18:34 gibba015 bash[30343]: cluster 2021-03-10T15:18:32.836136+0000 mgr.gibba045.orlgmj (mgr.34412) 4757 : cluster [DBG] pgmap v2703: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:35.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:18:34 gibba045 bash[25517]: cluster 2021-03-10T15:18:32.836136+0000 mgr.gibba045.orlgmj (mgr.34412) 4757 : cluster [DBG] pgmap v2703: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:36.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:18:36 gibba015 bash[29377]: cluster 2021-03-10T15:18:34.837764+0000 mgr.gibba045.orlgmj (mgr.34412) 4758 : cluster [DBG] pgmap v2704: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:36.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:18:36 gibba015 bash[30343]: cluster 2021-03-10T15:18:34.837764+0000 mgr.gibba045.orlgmj (mgr.34412) 4758 : cluster [DBG] pgmap v2704: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:37.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:18:36 gibba045 bash[25517]: cluster 2021-03-10T15:18:34.837764+0000 mgr.gibba045.orlgmj (mgr.34412) 4758 : cluster [DBG] pgmap v2704: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:38.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:18:38 gibba015 bash[29377]: cluster 2021-03-10T15:18:36.839540+0000 mgr.gibba045.orlgmj (mgr.34412) 4759 : cluster [DBG] pgmap v2705: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:38.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:18:38 gibba015 bash[30343]: cluster 2021-03-10T15:18:36.839540+0000 mgr.gibba045.orlgmj (mgr.34412) 4759 : cluster [DBG] pgmap v2705: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:39.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:18:38 gibba045 bash[25517]: cluster 2021-03-10T15:18:36.839540+0000 mgr.gibba045.orlgmj (mgr.34412) 4759 : cluster [DBG] pgmap v2705: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:40.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:18:40 gibba045 bash[25517]: cluster 2021-03-10T15:18:38.840311+0000 mgr.gibba045.orlgmj (mgr.34412) 4760 : cluster [DBG] pgmap v2706: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:40.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:18:40 gibba015 bash[29377]: cluster 2021-03-10T15:18:38.840311+0000 mgr.gibba045.orlgmj (mgr.34412) 4760 : cluster [DBG] pgmap v2706: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:40.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:18:40 gibba015 bash[30343]: cluster 2021-03-10T15:18:38.840311+0000 mgr.gibba045.orlgmj (mgr.34412) 4760 : cluster [DBG] pgmap v2706: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:41.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:18:41 gibba015 bash[29377]: cephadm 2021-03-10T15:18:40.441506+0000 mgr.gibba045.orlgmj (mgr.34412) 4761 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:18:41.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:18:41 gibba015 bash[30343]: cephadm 2021-03-10T15:18:40.441506+0000 mgr.gibba045.orlgmj (mgr.34412) 4761 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:18:42.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:18:41 gibba045 bash[25517]: cephadm 2021-03-10T15:18:40.441506+0000 mgr.gibba045.orlgmj (mgr.34412) 4761 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:18:42.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:18:42 gibba015 bash[29377]: cluster 2021-03-10T15:18:40.841857+0000 mgr.gibba045.orlgmj (mgr.34412) 4762 : cluster [DBG] pgmap v2707: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:42.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:18:42 gibba015 bash[30343]: cluster 2021-03-10T15:18:40.841857+0000 mgr.gibba045.orlgmj (mgr.34412) 4762 : cluster [DBG] pgmap v2707: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:43.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:18:42 gibba045 bash[25517]: cluster 2021-03-10T15:18:40.841857+0000 mgr.gibba045.orlgmj (mgr.34412) 4762 : cluster [DBG] pgmap v2707: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:44.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:18:44 gibba015 bash[29377]: cluster 2021-03-10T15:18:42.843549+0000 mgr.gibba045.orlgmj (mgr.34412) 4763 : cluster [DBG] pgmap v2708: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:44.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:18:44 gibba015 bash[30343]: cluster 2021-03-10T15:18:42.843549+0000 mgr.gibba045.orlgmj (mgr.34412) 4763 : cluster [DBG] pgmap v2708: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:45.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:18:44 gibba045 bash[25517]: cluster 2021-03-10T15:18:42.843549+0000 mgr.gibba045.orlgmj (mgr.34412) 4763 : cluster [DBG] pgmap v2708: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:45.359 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:18:45.586 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:18:45.586 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (89m) 3m ago 94m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:18:45.586 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (94m) 2m ago 94m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:18:45.587 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (89m) 2m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:18:45.587 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (90m) 2m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:18:45.587 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (89m) 3m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:18:45.587 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (89m) 3m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:18:45.588 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (88m) 2m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:18:45.588 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (88m) 3m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:18:45.588 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (94m) 3m ago 95m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:18:45.588 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (95m) 2m ago 95m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:18:45.589 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (87m) 3m ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:18:45.589 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (87m) 3m ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:18:45.589 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (86m) 3m ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:18:45.589 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (86m) 3m ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:18:45.590 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (86m) 2m ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:18:45.590 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (85m) 2m ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:18:45.590 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (85m) 2m ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:18:45.590 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (84m) 2m ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:18:45.591 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (94m) 2m ago 95m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:18:45.591 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 2m ago 92m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:18:45.837 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:18:45.837 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:18:45.837 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:18:45.838 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:18:45.838 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:18:45.838 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:18:45.838 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:18:45.839 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:18:45.839 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:18:45.839 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:18:45.839 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:18:45.839 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:18:45.840 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:18:45.840 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:18:45.840 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:18:46.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:18:46 gibba015 bash[29377]: cluster 2021-03-10T15:18:44.845047+0000 mgr.gibba045.orlgmj (mgr.34412) 4764 : cluster [DBG] pgmap v2709: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:46.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:18:46 gibba015 bash[29377]: audit 2021-03-10T15:18:45.350850+0000 mgr.gibba045.orlgmj (mgr.34412) 4765 : audit [DBG] from='client.47256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:18:46.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:18:46 gibba015 bash[29377]: audit 2021-03-10T15:18:45.573857+0000 mgr.gibba045.orlgmj (mgr.34412) 4766 : audit [DBG] from='client.57250 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:18:46.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:18:46 gibba015 bash[29377]: audit 2021-03-10T15:18:45.832932+0000 mon.a (mon.0) 1299 : audit [DBG] from='client.? 172.21.2.115:0/4056449349' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:18:46.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:18:46 gibba015 bash[30343]: cluster 2021-03-10T15:18:44.845047+0000 mgr.gibba045.orlgmj (mgr.34412) 4764 : cluster [DBG] pgmap v2709: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:46.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:18:46 gibba015 bash[30343]: audit 2021-03-10T15:18:45.350850+0000 mgr.gibba045.orlgmj (mgr.34412) 4765 : audit [DBG] from='client.47256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:18:46.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:18:46 gibba015 bash[30343]: audit 2021-03-10T15:18:45.573857+0000 mgr.gibba045.orlgmj (mgr.34412) 4766 : audit [DBG] from='client.57250 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:18:46.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:18:46 gibba015 bash[30343]: audit 2021-03-10T15:18:45.832932+0000 mon.a (mon.0) 1299 : audit [DBG] from='client.? 172.21.2.115:0/4056449349' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:18:47.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:18:46 gibba045 bash[25517]: cluster 2021-03-10T15:18:44.845047+0000 mgr.gibba045.orlgmj (mgr.34412) 4764 : cluster [DBG] pgmap v2709: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:47.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:18:46 gibba045 bash[25517]: audit 2021-03-10T15:18:45.350850+0000 mgr.gibba045.orlgmj (mgr.34412) 4765 : audit [DBG] from='client.47256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:18:47.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:18:46 gibba045 bash[25517]: audit 2021-03-10T15:18:45.573857+0000 mgr.gibba045.orlgmj (mgr.34412) 4766 : audit [DBG] from='client.57250 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:18:47.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:18:46 gibba045 bash[25517]: audit 2021-03-10T15:18:45.832932+0000 mon.a (mon.0) 1299 : audit [DBG] from='client.? 172.21.2.115:0/4056449349' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:18:48.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:18:48 gibba015 bash[29377]: cluster 2021-03-10T15:18:46.846831+0000 mgr.gibba045.orlgmj (mgr.34412) 4767 : cluster [DBG] pgmap v2710: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:48.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:18:48 gibba015 bash[30343]: cluster 2021-03-10T15:18:46.846831+0000 mgr.gibba045.orlgmj (mgr.34412) 4767 : cluster [DBG] pgmap v2710: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:49.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:18:48 gibba045 bash[25517]: cluster 2021-03-10T15:18:46.846831+0000 mgr.gibba045.orlgmj (mgr.34412) 4767 : cluster [DBG] pgmap v2710: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:50.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:18:50 gibba015 bash[29377]: cluster 2021-03-10T15:18:48.848044+0000 mgr.gibba045.orlgmj (mgr.34412) 4768 : cluster [DBG] pgmap v2711: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:50.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:18:50 gibba015 bash[30343]: cluster 2021-03-10T15:18:48.848044+0000 mgr.gibba045.orlgmj (mgr.34412) 4768 : cluster [DBG] pgmap v2711: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:51.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:18:50 gibba045 bash[25517]: cluster 2021-03-10T15:18:48.848044+0000 mgr.gibba045.orlgmj (mgr.34412) 4768 : cluster [DBG] pgmap v2711: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:52.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:18:52 gibba015 bash[29377]: cluster 2021-03-10T15:18:50.849803+0000 mgr.gibba045.orlgmj (mgr.34412) 4769 : cluster [DBG] pgmap v2712: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:52.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:18:52 gibba015 bash[30343]: cluster 2021-03-10T15:18:50.849803+0000 mgr.gibba045.orlgmj (mgr.34412) 4769 : cluster [DBG] pgmap v2712: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:53.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:18:52 gibba045 bash[25517]: cluster 2021-03-10T15:18:50.849803+0000 mgr.gibba045.orlgmj (mgr.34412) 4769 : cluster [DBG] pgmap v2712: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:18:53 gibba015 bash[29377]: audit 2021-03-10T15:18:53.065614+0000 mon.c (mon.1) 1351 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:18:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:18:53 gibba015 bash[29377]: audit 2021-03-10T15:18:53.066408+0000 mon.c (mon.1) 1352 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:18:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:18:53 gibba015 bash[29377]: audit 2021-03-10T15:18:53.066747+0000 mon.a (mon.0) 1300 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:18:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:18:53 gibba015 bash[29377]: audit 2021-03-10T15:18:53.068090+0000 mon.a (mon.0) 1301 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:18:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:18:53 gibba015 bash[29377]: audit 2021-03-10T15:18:53.068304+0000 mon.c (mon.1) 1353 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T15:18:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:18:53 gibba015 bash[29377]: audit 2021-03-10T15:18:53.069508+0000 mon.a (mon.0) 1302 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T15:18:53.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:18:53 gibba015 bash[29377]: audit 2021-03-10T15:18:53.069513+0000 mon.c (mon.1) 1354 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:18:53.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:18:53 gibba015 bash[29377]: audit 2021-03-10T15:18:53.070482+0000 mon.c (mon.1) 1355 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T15:18:53.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:18:53 gibba015 bash[29377]: audit 2021-03-10T15:18:53.070602+0000 mon.a (mon.0) 1303 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:18:53.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:18:53 gibba015 bash[29377]: audit 2021-03-10T15:18:53.071539+0000 mon.c (mon.1) 1356 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:18:53.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:18:53 gibba015 bash[29377]: audit 2021-03-10T15:18:53.071677+0000 mon.a (mon.0) 1304 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T15:18:53.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:18:53 gibba015 bash[29377]: audit 2021-03-10T15:18:53.072820+0000 mon.a (mon.0) 1305 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:18:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:18:53 gibba015 bash[30343]: audit 2021-03-10T15:18:53.065614+0000 mon.c (mon.1) 1351 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:18:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:18:53 gibba015 bash[30343]: audit 2021-03-10T15:18:53.066408+0000 mon.c (mon.1) 1352 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:18:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:18:53 gibba015 bash[30343]: audit 2021-03-10T15:18:53.066747+0000 mon.a (mon.0) 1300 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:18:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:18:53 gibba015 bash[30343]: audit 2021-03-10T15:18:53.068090+0000 mon.a (mon.0) 1301 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:18:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:18:53 gibba015 bash[30343]: audit 2021-03-10T15:18:53.068304+0000 mon.c (mon.1) 1353 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T15:18:53.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:18:53 gibba015 bash[30343]: audit 2021-03-10T15:18:53.069508+0000 mon.a (mon.0) 1302 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T15:18:53.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:18:53 gibba015 bash[30343]: audit 2021-03-10T15:18:53.069513+0000 mon.c (mon.1) 1354 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:18:53.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:18:53 gibba015 bash[30343]: audit 2021-03-10T15:18:53.070482+0000 mon.c (mon.1) 1355 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T15:18:53.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:18:53 gibba015 bash[30343]: audit 2021-03-10T15:18:53.070602+0000 mon.a (mon.0) 1303 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:18:53.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:18:53 gibba015 bash[30343]: audit 2021-03-10T15:18:53.071539+0000 mon.c (mon.1) 1356 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:18:53.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:18:53 gibba015 bash[30343]: audit 2021-03-10T15:18:53.071677+0000 mon.a (mon.0) 1304 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T15:18:53.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:18:53 gibba015 bash[30343]: audit 2021-03-10T15:18:53.072820+0000 mon.a (mon.0) 1305 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:18:54.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:18:53 gibba045 bash[25517]: audit 2021-03-10T15:18:53.065614+0000 mon.c (mon.1) 1351 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:18:54.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:18:53 gibba045 bash[25517]: audit 2021-03-10T15:18:53.066408+0000 mon.c (mon.1) 1352 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:18:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:18:53 gibba045 bash[25517]: audit 2021-03-10T15:18:53.066747+0000 mon.a (mon.0) 1300 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:18:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:18:53 gibba045 bash[25517]: audit 2021-03-10T15:18:53.068090+0000 mon.a (mon.0) 1301 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:18:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:18:53 gibba045 bash[25517]: audit 2021-03-10T15:18:53.068304+0000 mon.c (mon.1) 1353 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T15:18:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:18:53 gibba045 bash[25517]: audit 2021-03-10T15:18:53.069508+0000 mon.a (mon.0) 1302 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T15:18:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:18:53 gibba045 bash[25517]: audit 2021-03-10T15:18:53.069513+0000 mon.c (mon.1) 1354 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:18:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:18:53 gibba045 bash[25517]: audit 2021-03-10T15:18:53.070482+0000 mon.c (mon.1) 1355 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T15:18:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:18:53 gibba045 bash[25517]: audit 2021-03-10T15:18:53.070602+0000 mon.a (mon.0) 1303 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:18:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:18:53 gibba045 bash[25517]: audit 2021-03-10T15:18:53.071539+0000 mon.c (mon.1) 1356 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:18:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:18:53 gibba045 bash[25517]: audit 2021-03-10T15:18:53.071677+0000 mon.a (mon.0) 1304 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T15:18:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:18:53 gibba045 bash[25517]: audit 2021-03-10T15:18:53.072820+0000 mon.a (mon.0) 1305 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:18:54.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:18:54 gibba015 bash[29377]: cluster 2021-03-10T15:18:52.851401+0000 mgr.gibba045.orlgmj (mgr.34412) 4770 : cluster [DBG] pgmap v2713: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:54.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:18:54 gibba015 bash[30343]: cluster 2021-03-10T15:18:52.851401+0000 mgr.gibba045.orlgmj (mgr.34412) 4770 : cluster [DBG] pgmap v2713: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:55.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:18:54 gibba045 bash[25517]: cluster 2021-03-10T15:18:52.851401+0000 mgr.gibba045.orlgmj (mgr.34412) 4770 : cluster [DBG] pgmap v2713: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:55.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:18:55 gibba015 bash[29377]: audit 2021-03-10T15:18:55.453882+0000 mon.c (mon.1) 1357 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:18:55.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:18:55 gibba015 bash[29377]: audit 2021-03-10T15:18:55.683759+0000 mon.a (mon.0) 1306 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:18:55.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:18:55 gibba015 bash[30343]: audit 2021-03-10T15:18:55.453882+0000 mon.c (mon.1) 1357 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:18:55.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:18:55 gibba015 bash[30343]: audit 2021-03-10T15:18:55.683759+0000 mon.a (mon.0) 1306 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:18:56.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:18:55 gibba045 bash[25517]: audit 2021-03-10T15:18:55.453882+0000 mon.c (mon.1) 1357 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:18:56.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:18:55 gibba045 bash[25517]: audit 2021-03-10T15:18:55.683759+0000 mon.a (mon.0) 1306 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:18:56.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:18:56 gibba015 bash[29377]: cluster 2021-03-10T15:18:54.852980+0000 mgr.gibba045.orlgmj (mgr.34412) 4771 : cluster [DBG] pgmap v2714: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:56.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:18:56 gibba015 bash[29377]: cephadm 2021-03-10T15:18:55.464177+0000 mgr.gibba045.orlgmj (mgr.34412) 4772 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:18:56.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:18:56 gibba015 bash[29377]: cephadm 2021-03-10T15:18:55.465812+0000 mgr.gibba045.orlgmj (mgr.34412) 4773 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:18:56.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:18:56 gibba015 bash[29377]: audit 2021-03-10T15:18:55.687343+0000 mon.c (mon.1) 1358 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:18:56.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:18:56 gibba015 bash[29377]: audit 2021-03-10T15:18:55.688750+0000 mon.c (mon.1) 1359 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:18:56.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:18:56 gibba015 bash[29377]: cephadm 2021-03-10T15:18:55.691051+0000 mgr.gibba045.orlgmj (mgr.34412) 4774 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:18:56.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:18:56 gibba015 bash[29377]: audit 2021-03-10T15:18:55.691117+0000 mon.c (mon.1) 1360 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:18:56.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:18:56 gibba015 bash[29377]: cephadm 2021-03-10T15:18:55.692838+0000 mgr.gibba045.orlgmj (mgr.34412) 4775 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:18:56.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:18:56 gibba015 bash[29377]: audit 2021-03-10T15:18:55.693952+0000 mon.c (mon.1) 1361 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:18:56.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:18:56 gibba015 bash[29377]: cephadm 2021-03-10T15:18:55.695062+0000 mgr.gibba045.orlgmj (mgr.34412) 4776 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:18:56.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:18:56 gibba015 bash[29377]: cephadm 2021-03-10T15:18:55.695195+0000 mgr.gibba045.orlgmj (mgr.34412) 4777 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:18:56.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:18:56 gibba015 bash[29377]: audit 2021-03-10T15:18:55.696596+0000 mon.c (mon.1) 1362 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:18:56.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:18:56 gibba015 bash[29377]: audit 2021-03-10T15:18:55.697880+0000 mon.c (mon.1) 1363 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:18:56.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:18:56 gibba015 bash[29377]: cephadm 2021-03-10T15:18:55.698018+0000 mgr.gibba045.orlgmj (mgr.34412) 4778 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:18:56.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:18:56 gibba015 bash[29377]: cephadm 2021-03-10T15:18:55.698083+0000 mgr.gibba045.orlgmj (mgr.34412) 4779 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:18:56.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:18:56 gibba015 bash[29377]: cephadm 2021-03-10T15:18:55.699074+0000 mgr.gibba045.orlgmj (mgr.34412) 4780 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:18:56.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:18:56 gibba015 bash[29377]: cephadm 2021-03-10T15:18:55.700419+0000 mgr.gibba045.orlgmj (mgr.34412) 4781 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:18:56.980 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:18:56 gibba015 bash[29377]: cephadm 2021-03-10T15:18:55.700499+0000 mgr.gibba045.orlgmj (mgr.34412) 4782 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:18:56.980 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:18:56 gibba015 bash[29377]: cephadm 2021-03-10T15:18:55.701689+0000 mgr.gibba045.orlgmj (mgr.34412) 4783 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:18:56.980 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:18:56 gibba015 bash[29377]: cephadm 2021-03-10T15:18:55.702047+0000 mgr.gibba045.orlgmj (mgr.34412) 4784 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:18:56.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:18:56 gibba015 bash[30343]: cluster 2021-03-10T15:18:54.852980+0000 mgr.gibba045.orlgmj (mgr.34412) 4771 : cluster [DBG] pgmap v2714: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:56.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:18:56 gibba015 bash[30343]: cephadm 2021-03-10T15:18:55.464177+0000 mgr.gibba045.orlgmj (mgr.34412) 4772 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:18:56.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:18:56 gibba015 bash[30343]: cephadm 2021-03-10T15:18:55.465812+0000 mgr.gibba045.orlgmj (mgr.34412) 4773 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:18:56.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:18:56 gibba015 bash[30343]: audit 2021-03-10T15:18:55.687343+0000 mon.c (mon.1) 1358 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:18:56.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:18:56 gibba015 bash[30343]: audit 2021-03-10T15:18:55.688750+0000 mon.c (mon.1) 1359 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:18:56.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:18:56 gibba015 bash[30343]: cephadm 2021-03-10T15:18:55.691051+0000 mgr.gibba045.orlgmj (mgr.34412) 4774 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:18:56.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:18:56 gibba015 bash[30343]: audit 2021-03-10T15:18:55.691117+0000 mon.c (mon.1) 1360 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:18:56.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:18:56 gibba015 bash[30343]: cephadm 2021-03-10T15:18:55.692838+0000 mgr.gibba045.orlgmj (mgr.34412) 4775 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:18:56.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:18:56 gibba015 bash[30343]: audit 2021-03-10T15:18:55.693952+0000 mon.c (mon.1) 1361 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:18:56.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:18:56 gibba015 bash[30343]: cephadm 2021-03-10T15:18:55.695062+0000 mgr.gibba045.orlgmj (mgr.34412) 4776 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:18:56.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:18:56 gibba015 bash[30343]: cephadm 2021-03-10T15:18:55.695195+0000 mgr.gibba045.orlgmj (mgr.34412) 4777 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:18:56.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:18:56 gibba015 bash[30343]: audit 2021-03-10T15:18:55.696596+0000 mon.c (mon.1) 1362 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:18:56.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:18:56 gibba015 bash[30343]: audit 2021-03-10T15:18:55.697880+0000 mon.c (mon.1) 1363 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:18:56.984 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:18:56 gibba015 bash[30343]: cephadm 2021-03-10T15:18:55.698018+0000 mgr.gibba045.orlgmj (mgr.34412) 4778 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:18:56.984 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:18:56 gibba015 bash[30343]: cephadm 2021-03-10T15:18:55.698083+0000 mgr.gibba045.orlgmj (mgr.34412) 4779 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:18:56.984 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:18:56 gibba015 bash[30343]: cephadm 2021-03-10T15:18:55.699074+0000 mgr.gibba045.orlgmj (mgr.34412) 4780 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:18:56.984 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:18:56 gibba015 bash[30343]: cephadm 2021-03-10T15:18:55.700419+0000 mgr.gibba045.orlgmj (mgr.34412) 4781 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:18:56.985 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:18:56 gibba015 bash[30343]: cephadm 2021-03-10T15:18:55.700499+0000 mgr.gibba045.orlgmj (mgr.34412) 4782 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:18:56.985 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:18:56 gibba015 bash[30343]: cephadm 2021-03-10T15:18:55.701689+0000 mgr.gibba045.orlgmj (mgr.34412) 4783 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:18:56.985 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:18:56 gibba015 bash[30343]: cephadm 2021-03-10T15:18:55.702047+0000 mgr.gibba045.orlgmj (mgr.34412) 4784 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:18:56.985 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:18:56 gibba015 bash[30343]: cephadm 2021-03-10T15:18:55.703223+0000 mgr.gibba045.orlgmj (mgr.34412) 4785 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:18:56.985 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:18:56 gibba015 bash[30343]: cephadm 2021-03-10T15:18:55.703259+0000 mgr.gibba045.orlgmj (mgr.34412) 4786 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:18:56.986 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:18:56 gibba015 bash[30343]: cephadm 2021-03-10T15:18:55.703365+0000 mgr.gibba045.orlgmj (mgr.34412) 4787 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:18:56.986 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:18:56 gibba015 bash[29377]: cephadm 2021-03-10T15:18:55.703223+0000 mgr.gibba045.orlgmj (mgr.34412) 4785 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:18:56.986 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:18:56 gibba015 bash[29377]: cephadm 2021-03-10T15:18:55.703259+0000 mgr.gibba045.orlgmj (mgr.34412) 4786 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:18:56.987 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:18:56 gibba015 bash[29377]: cephadm 2021-03-10T15:18:55.703365+0000 mgr.gibba045.orlgmj (mgr.34412) 4787 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:18:57.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:18:56 gibba045 bash[25517]: cluster 2021-03-10T15:18:54.852980+0000 mgr.gibba045.orlgmj (mgr.34412) 4771 : cluster [DBG] pgmap v2714: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:57.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:18:56 gibba045 bash[25517]: cephadm 2021-03-10T15:18:55.464177+0000 mgr.gibba045.orlgmj (mgr.34412) 4772 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:18:57.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:18:56 gibba045 bash[25517]: cephadm 2021-03-10T15:18:55.465812+0000 mgr.gibba045.orlgmj (mgr.34412) 4773 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:18:57.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:18:56 gibba045 bash[25517]: audit 2021-03-10T15:18:55.687343+0000 mon.c (mon.1) 1358 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:18:57.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:18:56 gibba045 bash[25517]: audit 2021-03-10T15:18:55.688750+0000 mon.c (mon.1) 1359 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:18:57.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:18:56 gibba045 bash[25517]: cephadm 2021-03-10T15:18:55.691051+0000 mgr.gibba045.orlgmj (mgr.34412) 4774 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:18:57.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:18:56 gibba045 bash[25517]: audit 2021-03-10T15:18:55.691117+0000 mon.c (mon.1) 1360 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:18:57.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:18:56 gibba045 bash[25517]: cephadm 2021-03-10T15:18:55.692838+0000 mgr.gibba045.orlgmj (mgr.34412) 4775 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:18:57.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:18:56 gibba045 bash[25517]: audit 2021-03-10T15:18:55.693952+0000 mon.c (mon.1) 1361 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:18:57.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:18:56 gibba045 bash[25517]: cephadm 2021-03-10T15:18:55.695062+0000 mgr.gibba045.orlgmj (mgr.34412) 4776 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:18:57.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:18:56 gibba045 bash[25517]: cephadm 2021-03-10T15:18:55.695195+0000 mgr.gibba045.orlgmj (mgr.34412) 4777 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:18:57.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:18:56 gibba045 bash[25517]: audit 2021-03-10T15:18:55.696596+0000 mon.c (mon.1) 1362 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:18:57.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:18:56 gibba045 bash[25517]: audit 2021-03-10T15:18:55.697880+0000 mon.c (mon.1) 1363 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:18:57.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:18:56 gibba045 bash[25517]: cephadm 2021-03-10T15:18:55.698018+0000 mgr.gibba045.orlgmj (mgr.34412) 4778 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:18:57.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:18:56 gibba045 bash[25517]: cephadm 2021-03-10T15:18:55.698083+0000 mgr.gibba045.orlgmj (mgr.34412) 4779 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:18:57.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:18:56 gibba045 bash[25517]: cephadm 2021-03-10T15:18:55.699074+0000 mgr.gibba045.orlgmj (mgr.34412) 4780 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:18:57.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:18:56 gibba045 bash[25517]: cephadm 2021-03-10T15:18:55.700419+0000 mgr.gibba045.orlgmj (mgr.34412) 4781 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:18:57.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:18:56 gibba045 bash[25517]: cephadm 2021-03-10T15:18:55.700499+0000 mgr.gibba045.orlgmj (mgr.34412) 4782 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:18:57.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:18:56 gibba045 bash[25517]: cephadm 2021-03-10T15:18:55.701689+0000 mgr.gibba045.orlgmj (mgr.34412) 4783 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:18:57.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:18:56 gibba045 bash[25517]: cephadm 2021-03-10T15:18:55.702047+0000 mgr.gibba045.orlgmj (mgr.34412) 4784 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:18:57.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:18:56 gibba045 bash[25517]: cephadm 2021-03-10T15:18:55.703223+0000 mgr.gibba045.orlgmj (mgr.34412) 4785 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:18:57.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:18:56 gibba045 bash[25517]: cephadm 2021-03-10T15:18:55.703259+0000 mgr.gibba045.orlgmj (mgr.34412) 4786 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:18:57.062 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:18:56 gibba045 bash[25517]: cephadm 2021-03-10T15:18:55.703365+0000 mgr.gibba045.orlgmj (mgr.34412) 4787 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:18:58.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:18:58 gibba015 bash[29377]: cluster 2021-03-10T15:18:56.854488+0000 mgr.gibba045.orlgmj (mgr.34412) 4788 : cluster [DBG] pgmap v2715: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:58.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:18:58 gibba015 bash[30343]: cluster 2021-03-10T15:18:56.854488+0000 mgr.gibba045.orlgmj (mgr.34412) 4788 : cluster [DBG] pgmap v2715: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:59.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:18:58 gibba045 bash[25517]: cluster 2021-03-10T15:18:56.854488+0000 mgr.gibba045.orlgmj (mgr.34412) 4788 : cluster [DBG] pgmap v2715: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:00.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:19:00 gibba015 bash[29377]: cluster 2021-03-10T15:18:58.855004+0000 mgr.gibba045.orlgmj (mgr.34412) 4789 : cluster [DBG] pgmap v2716: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:00.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:19:00 gibba015 bash[30343]: cluster 2021-03-10T15:18:58.855004+0000 mgr.gibba045.orlgmj (mgr.34412) 4789 : cluster [DBG] pgmap v2716: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:01.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:19:00 gibba045 bash[25517]: cluster 2021-03-10T15:18:58.855004+0000 mgr.gibba045.orlgmj (mgr.34412) 4789 : cluster [DBG] pgmap v2716: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:03.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:19:02 gibba045 bash[25517]: cluster 2021-03-10T15:19:00.856705+0000 mgr.gibba045.orlgmj (mgr.34412) 4790 : cluster [DBG] pgmap v2717: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:03.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:19:02 gibba015 bash[29377]: cluster 2021-03-10T15:19:00.856705+0000 mgr.gibba045.orlgmj (mgr.34412) 4790 : cluster [DBG] pgmap v2717: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:03.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:19:02 gibba015 bash[30343]: cluster 2021-03-10T15:19:00.856705+0000 mgr.gibba045.orlgmj (mgr.34412) 4790 : cluster [DBG] pgmap v2717: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:05.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:19:04 gibba045 bash[25517]: cluster 2021-03-10T15:19:02.858027+0000 mgr.gibba045.orlgmj (mgr.34412) 4791 : cluster [DBG] pgmap v2718: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:05.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:19:04 gibba015 bash[29377]: cluster 2021-03-10T15:19:02.858027+0000 mgr.gibba045.orlgmj (mgr.34412) 4791 : cluster [DBG] pgmap v2718: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:05.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:19:04 gibba015 bash[30343]: cluster 2021-03-10T15:19:02.858027+0000 mgr.gibba045.orlgmj (mgr.34412) 4791 : cluster [DBG] pgmap v2718: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:07.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:19:06 gibba045 bash[25517]: cluster 2021-03-10T15:19:04.859663+0000 mgr.gibba045.orlgmj (mgr.34412) 4792 : cluster [DBG] pgmap v2719: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:07.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:19:06 gibba015 bash[29377]: cluster 2021-03-10T15:19:04.859663+0000 mgr.gibba045.orlgmj (mgr.34412) 4792 : cluster [DBG] pgmap v2719: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:07.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:19:06 gibba015 bash[30343]: cluster 2021-03-10T15:19:04.859663+0000 mgr.gibba045.orlgmj (mgr.34412) 4792 : cluster [DBG] pgmap v2719: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:09.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:19:08 gibba045 bash[25517]: cluster 2021-03-10T15:19:06.861419+0000 mgr.gibba045.orlgmj (mgr.34412) 4793 : cluster [DBG] pgmap v2720: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:09.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:19:08 gibba015 bash[29377]: cluster 2021-03-10T15:19:06.861419+0000 mgr.gibba045.orlgmj (mgr.34412) 4793 : cluster [DBG] pgmap v2720: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:09.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:19:08 gibba015 bash[30343]: cluster 2021-03-10T15:19:06.861419+0000 mgr.gibba045.orlgmj (mgr.34412) 4793 : cluster [DBG] pgmap v2720: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:11.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:19:10 gibba045 bash[25517]: cluster 2021-03-10T15:19:08.862647+0000 mgr.gibba045.orlgmj (mgr.34412) 4794 : cluster [DBG] pgmap v2721: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:11.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:19:10 gibba015 bash[29377]: cluster 2021-03-10T15:19:08.862647+0000 mgr.gibba045.orlgmj (mgr.34412) 4794 : cluster [DBG] pgmap v2721: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:11.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:19:10 gibba015 bash[30343]: cluster 2021-03-10T15:19:08.862647+0000 mgr.gibba045.orlgmj (mgr.34412) 4794 : cluster [DBG] pgmap v2721: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:12.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:19:11 gibba045 bash[25517]: cephadm 2021-03-10T15:19:10.717402+0000 mgr.gibba045.orlgmj (mgr.34412) 4795 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:19:12.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:19:11 gibba015 bash[29377]: cephadm 2021-03-10T15:19:10.717402+0000 mgr.gibba045.orlgmj (mgr.34412) 4795 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:19:12.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:19:11 gibba015 bash[30343]: cephadm 2021-03-10T15:19:10.717402+0000 mgr.gibba045.orlgmj (mgr.34412) 4795 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:19:13.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:19:12 gibba045 bash[25517]: cluster 2021-03-10T15:19:10.864756+0000 mgr.gibba045.orlgmj (mgr.34412) 4796 : cluster [DBG] pgmap v2722: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:13.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:19:12 gibba015 bash[29377]: cluster 2021-03-10T15:19:10.864756+0000 mgr.gibba045.orlgmj (mgr.34412) 4796 : cluster [DBG] pgmap v2722: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:13.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:19:12 gibba015 bash[30343]: cluster 2021-03-10T15:19:10.864756+0000 mgr.gibba045.orlgmj (mgr.34412) 4796 : cluster [DBG] pgmap v2722: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:15.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:19:14 gibba045 bash[25517]: cluster 2021-03-10T15:19:12.866404+0000 mgr.gibba045.orlgmj (mgr.34412) 4797 : cluster [DBG] pgmap v2723: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:15.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:19:14 gibba015 bash[29377]: cluster 2021-03-10T15:19:12.866404+0000 mgr.gibba045.orlgmj (mgr.34412) 4797 : cluster [DBG] pgmap v2723: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:15.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:19:14 gibba015 bash[30343]: cluster 2021-03-10T15:19:12.866404+0000 mgr.gibba045.orlgmj (mgr.34412) 4797 : cluster [DBG] pgmap v2723: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:16.078 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:19:16.309 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:19:16.310 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (89m) 4m ago 95m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:19:16.310 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (95m) 3m ago 95m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:19:16.310 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (90m) 3m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:19:16.310 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (90m) 3m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:19:16.311 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (89m) 4m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:19:16.311 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (89m) 4m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:19:16.311 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (89m) 3m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:19:16.311 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (89m) 4m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:19:16.312 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (95m) 4m ago 95m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:19:16.312 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (95m) 3m ago 95m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:19:16.312 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (88m) 4m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:19:16.312 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (87m) 4m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:19:16.313 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (87m) 4m ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:19:16.313 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (87m) 4m ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:19:16.313 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (86m) 3m ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:19:16.313 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (86m) 3m ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:19:16.314 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (85m) 3m ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:19:16.314 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (85m) 3m ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:19:16.314 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (94m) 3m ago 95m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:19:16.314 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 3m ago 93m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:19:16.557 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:19:16.558 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:19:16.558 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:19:16.558 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:19:16.558 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:19:16.559 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:19:16.559 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:19:16.559 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:19:16.559 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:19:16.560 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:19:16.560 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:19:16.560 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:19:16.560 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:19:16.561 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:19:16.561 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:19:17.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:19:16 gibba045 bash[25517]: cluster 2021-03-10T15:19:14.867614+0000 mgr.gibba045.orlgmj (mgr.34412) 4798 : cluster [DBG] pgmap v2724: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:17.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:19:16 gibba045 bash[25517]: audit 2021-03-10T15:19:16.553332+0000 mon.a (mon.0) 1307 : audit [DBG] from='client.? 172.21.2.115:0/3642411944' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:19:17.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:19:16 gibba015 bash[29377]: cluster 2021-03-10T15:19:14.867614+0000 mgr.gibba045.orlgmj (mgr.34412) 4798 : cluster [DBG] pgmap v2724: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:17.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:19:16 gibba015 bash[29377]: audit 2021-03-10T15:19:16.553332+0000 mon.a (mon.0) 1307 : audit [DBG] from='client.? 172.21.2.115:0/3642411944' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:19:17.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:19:16 gibba015 bash[30343]: cluster 2021-03-10T15:19:14.867614+0000 mgr.gibba045.orlgmj (mgr.34412) 4798 : cluster [DBG] pgmap v2724: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:17.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:19:16 gibba015 bash[30343]: audit 2021-03-10T15:19:16.553332+0000 mon.a (mon.0) 1307 : audit [DBG] from='client.? 172.21.2.115:0/3642411944' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:19:18.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:19:17 gibba015 bash[29377]: audit 2021-03-10T15:19:16.069247+0000 mgr.gibba045.orlgmj (mgr.34412) 4799 : audit [DBG] from='client.47274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:19:18.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:19:17 gibba015 bash[29377]: audit 2021-03-10T15:19:16.297524+0000 mgr.gibba045.orlgmj (mgr.34412) 4800 : audit [DBG] from='client.47280 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:19:18.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:19:17 gibba015 bash[30343]: audit 2021-03-10T15:19:16.069247+0000 mgr.gibba045.orlgmj (mgr.34412) 4799 : audit [DBG] from='client.47274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:19:18.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:19:17 gibba015 bash[30343]: audit 2021-03-10T15:19:16.297524+0000 mgr.gibba045.orlgmj (mgr.34412) 4800 : audit [DBG] from='client.47280 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:19:18.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:19:17 gibba045 bash[25517]: audit 2021-03-10T15:19:16.069247+0000 mgr.gibba045.orlgmj (mgr.34412) 4799 : audit [DBG] from='client.47274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:19:18.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:19:17 gibba045 bash[25517]: audit 2021-03-10T15:19:16.297524+0000 mgr.gibba045.orlgmj (mgr.34412) 4800 : audit [DBG] from='client.47280 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:19:19.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:19:18 gibba015 bash[29377]: cluster 2021-03-10T15:19:16.868653+0000 mgr.gibba045.orlgmj (mgr.34412) 4801 : cluster [DBG] pgmap v2725: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:19.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:19:18 gibba015 bash[30343]: cluster 2021-03-10T15:19:16.868653+0000 mgr.gibba045.orlgmj (mgr.34412) 4801 : cluster [DBG] pgmap v2725: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:19.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:19:18 gibba045 bash[25517]: cluster 2021-03-10T15:19:16.868653+0000 mgr.gibba045.orlgmj (mgr.34412) 4801 : cluster [DBG] pgmap v2725: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:20.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:19:20 gibba015 bash[29377]: cluster 2021-03-10T15:19:18.868994+0000 mgr.gibba045.orlgmj (mgr.34412) 4802 : cluster [DBG] pgmap v2726: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:20.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:19:20 gibba015 bash[30343]: cluster 2021-03-10T15:19:18.868994+0000 mgr.gibba045.orlgmj (mgr.34412) 4802 : cluster [DBG] pgmap v2726: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:20.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:19:20 gibba045 bash[25517]: cluster 2021-03-10T15:19:18.868994+0000 mgr.gibba045.orlgmj (mgr.34412) 4802 : cluster [DBG] pgmap v2726: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:22.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:19:22 gibba015 bash[29377]: cluster 2021-03-10T15:19:20.870365+0000 mgr.gibba045.orlgmj (mgr.34412) 4803 : cluster [DBG] pgmap v2727: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:22.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:19:22 gibba015 bash[30343]: cluster 2021-03-10T15:19:20.870365+0000 mgr.gibba045.orlgmj (mgr.34412) 4803 : cluster [DBG] pgmap v2727: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:22.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:19:22 gibba045 bash[25517]: cluster 2021-03-10T15:19:20.870365+0000 mgr.gibba045.orlgmj (mgr.34412) 4803 : cluster [DBG] pgmap v2727: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:24.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:19:24 gibba015 bash[29377]: cluster 2021-03-10T15:19:22.871745+0000 mgr.gibba045.orlgmj (mgr.34412) 4804 : cluster [DBG] pgmap v2728: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:24.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:19:24 gibba015 bash[30343]: cluster 2021-03-10T15:19:22.871745+0000 mgr.gibba045.orlgmj (mgr.34412) 4804 : cluster [DBG] pgmap v2728: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:24.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:19:24 gibba045 bash[25517]: cluster 2021-03-10T15:19:22.871745+0000 mgr.gibba045.orlgmj (mgr.34412) 4804 : cluster [DBG] pgmap v2728: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:26.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:19:26 gibba015 bash[29377]: cluster 2021-03-10T15:19:24.873147+0000 mgr.gibba045.orlgmj (mgr.34412) 4805 : cluster [DBG] pgmap v2729: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:26.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:19:26 gibba015 bash[29377]: cephadm 2021-03-10T15:19:25.721660+0000 mgr.gibba045.orlgmj (mgr.34412) 4806 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:19:26.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:19:26 gibba015 bash[30343]: cluster 2021-03-10T15:19:24.873147+0000 mgr.gibba045.orlgmj (mgr.34412) 4805 : cluster [DBG] pgmap v2729: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:26.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:19:26 gibba015 bash[30343]: cephadm 2021-03-10T15:19:25.721660+0000 mgr.gibba045.orlgmj (mgr.34412) 4806 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:19:26.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:19:26 gibba045 bash[25517]: cluster 2021-03-10T15:19:24.873147+0000 mgr.gibba045.orlgmj (mgr.34412) 4805 : cluster [DBG] pgmap v2729: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:26.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:19:26 gibba045 bash[25517]: cephadm 2021-03-10T15:19:25.721660+0000 mgr.gibba045.orlgmj (mgr.34412) 4806 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:19:28.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:19:28 gibba015 bash[29377]: cluster 2021-03-10T15:19:26.873650+0000 mgr.gibba045.orlgmj (mgr.34412) 4807 : cluster [DBG] pgmap v2730: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:28.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:19:28 gibba015 bash[30343]: cluster 2021-03-10T15:19:26.873650+0000 mgr.gibba045.orlgmj (mgr.34412) 4807 : cluster [DBG] pgmap v2730: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:28.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:19:28 gibba045 bash[25517]: cluster 2021-03-10T15:19:26.873650+0000 mgr.gibba045.orlgmj (mgr.34412) 4807 : cluster [DBG] pgmap v2730: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:30.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:19:30 gibba015 bash[29377]: cluster 2021-03-10T15:19:28.874756+0000 mgr.gibba045.orlgmj (mgr.34412) 4808 : cluster [DBG] pgmap v2731: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:30.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:19:30 gibba015 bash[30343]: cluster 2021-03-10T15:19:28.874756+0000 mgr.gibba045.orlgmj (mgr.34412) 4808 : cluster [DBG] pgmap v2731: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:30.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:19:30 gibba045 bash[25517]: cluster 2021-03-10T15:19:28.874756+0000 mgr.gibba045.orlgmj (mgr.34412) 4808 : cluster [DBG] pgmap v2731: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:32.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:19:32 gibba015 bash[29377]: cluster 2021-03-10T15:19:30.876572+0000 mgr.gibba045.orlgmj (mgr.34412) 4809 : cluster [DBG] pgmap v2732: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:32.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:19:32 gibba015 bash[30343]: cluster 2021-03-10T15:19:30.876572+0000 mgr.gibba045.orlgmj (mgr.34412) 4809 : cluster [DBG] pgmap v2732: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:32.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:19:32 gibba045 bash[25517]: cluster 2021-03-10T15:19:30.876572+0000 mgr.gibba045.orlgmj (mgr.34412) 4809 : cluster [DBG] pgmap v2732: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:34.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:19:34 gibba015 bash[29377]: cluster 2021-03-10T15:19:32.878014+0000 mgr.gibba045.orlgmj (mgr.34412) 4810 : cluster [DBG] pgmap v2733: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:34.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:19:34 gibba015 bash[30343]: cluster 2021-03-10T15:19:32.878014+0000 mgr.gibba045.orlgmj (mgr.34412) 4810 : cluster [DBG] pgmap v2733: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:34.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:19:34 gibba045 bash[25517]: cluster 2021-03-10T15:19:32.878014+0000 mgr.gibba045.orlgmj (mgr.34412) 4810 : cluster [DBG] pgmap v2733: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:36.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:19:36 gibba015 bash[29377]: cluster 2021-03-10T15:19:34.878574+0000 mgr.gibba045.orlgmj (mgr.34412) 4811 : cluster [DBG] pgmap v2734: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:36.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:19:36 gibba015 bash[30343]: cluster 2021-03-10T15:19:34.878574+0000 mgr.gibba045.orlgmj (mgr.34412) 4811 : cluster [DBG] pgmap v2734: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:36.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:19:36 gibba045 bash[25517]: cluster 2021-03-10T15:19:34.878574+0000 mgr.gibba045.orlgmj (mgr.34412) 4811 : cluster [DBG] pgmap v2734: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:38.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:19:38 gibba015 bash[29377]: cluster 2021-03-10T15:19:36.880192+0000 mgr.gibba045.orlgmj (mgr.34412) 4812 : cluster [DBG] pgmap v2735: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:38.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:19:38 gibba015 bash[30343]: cluster 2021-03-10T15:19:36.880192+0000 mgr.gibba045.orlgmj (mgr.34412) 4812 : cluster [DBG] pgmap v2735: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:38.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:19:38 gibba045 bash[25517]: cluster 2021-03-10T15:19:36.880192+0000 mgr.gibba045.orlgmj (mgr.34412) 4812 : cluster [DBG] pgmap v2735: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:40.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:19:40 gibba015 bash[29377]: cluster 2021-03-10T15:19:38.881473+0000 mgr.gibba045.orlgmj (mgr.34412) 4813 : cluster [DBG] pgmap v2736: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:40.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:19:40 gibba015 bash[30343]: cluster 2021-03-10T15:19:38.881473+0000 mgr.gibba045.orlgmj (mgr.34412) 4813 : cluster [DBG] pgmap v2736: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:40.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:19:40 gibba045 bash[25517]: cluster 2021-03-10T15:19:38.881473+0000 mgr.gibba045.orlgmj (mgr.34412) 4813 : cluster [DBG] pgmap v2736: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:41.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:19:41 gibba015 bash[29377]: cephadm 2021-03-10T15:19:40.737750+0000 mgr.gibba045.orlgmj (mgr.34412) 4814 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:19:41.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:19:41 gibba015 bash[30343]: cephadm 2021-03-10T15:19:40.737750+0000 mgr.gibba045.orlgmj (mgr.34412) 4814 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:19:41.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:19:41 gibba045 bash[25517]: cephadm 2021-03-10T15:19:40.737750+0000 mgr.gibba045.orlgmj (mgr.34412) 4814 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:19:42.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:19:42 gibba015 bash[29377]: cluster 2021-03-10T15:19:40.883235+0000 mgr.gibba045.orlgmj (mgr.34412) 4815 : cluster [DBG] pgmap v2737: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:42.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:19:42 gibba015 bash[30343]: cluster 2021-03-10T15:19:40.883235+0000 mgr.gibba045.orlgmj (mgr.34412) 4815 : cluster [DBG] pgmap v2737: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:42.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:19:42 gibba045 bash[25517]: cluster 2021-03-10T15:19:40.883235+0000 mgr.gibba045.orlgmj (mgr.34412) 4815 : cluster [DBG] pgmap v2737: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:44.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:19:44 gibba015 bash[29377]: cluster 2021-03-10T15:19:42.884034+0000 mgr.gibba045.orlgmj (mgr.34412) 4816 : cluster [DBG] pgmap v2738: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:44.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:19:44 gibba015 bash[30343]: cluster 2021-03-10T15:19:42.884034+0000 mgr.gibba045.orlgmj (mgr.34412) 4816 : cluster [DBG] pgmap v2738: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:44.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:19:44 gibba045 bash[25517]: cluster 2021-03-10T15:19:42.884034+0000 mgr.gibba045.orlgmj (mgr.34412) 4816 : cluster [DBG] pgmap v2738: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:46.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:19:46 gibba015 bash[29377]: cluster 2021-03-10T15:19:44.885588+0000 mgr.gibba045.orlgmj (mgr.34412) 4817 : cluster [DBG] pgmap v2739: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:46.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:19:46 gibba015 bash[30343]: cluster 2021-03-10T15:19:44.885588+0000 mgr.gibba045.orlgmj (mgr.34412) 4817 : cluster [DBG] pgmap v2739: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:46.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:19:46 gibba045 bash[25517]: cluster 2021-03-10T15:19:44.885588+0000 mgr.gibba045.orlgmj (mgr.34412) 4817 : cluster [DBG] pgmap v2739: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:46.799 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:19:47.027 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:19:47.027 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (90m) 5m ago 95m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:19:47.027 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (95m) 3m ago 95m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:19:47.028 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (90m) 3m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:19:47.028 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (91m) 3m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:19:47.028 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (90m) 5m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:19:47.028 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (90m) 5m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:19:47.029 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (89m) 3m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:19:47.029 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (89m) 5m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:19:47.029 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (95m) 5m ago 96m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:19:47.029 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (96m) 3m ago 96m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:19:47.029 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (88m) 5m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:19:47.030 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (88m) 5m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:19:47.030 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (87m) 5m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:19:47.030 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (87m) 5m ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:19:47.030 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (87m) 3m ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:19:47.031 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (86m) 3m ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:19:47.031 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (86m) 3m ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:19:47.031 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (85m) 3m ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:19:47.031 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (95m) 3m ago 96m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:19:47.032 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 3m ago 94m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:19:47.311 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:19:47.311 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:19:47.311 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:19:47.312 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:19:47.312 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:19:47.312 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:19:47.312 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:19:47.312 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:19:47.313 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:19:47.313 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:19:47.313 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:19:47.313 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:19:47.314 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:19:47.314 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:19:47.314 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:19:47.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:19:47 gibba015 bash[29377]: audit 2021-03-10T15:19:46.790626+0000 mgr.gibba045.orlgmj (mgr.34412) 4818 : audit [DBG] from='client.47292 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:19:47.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:19:47 gibba015 bash[30343]: audit 2021-03-10T15:19:46.790626+0000 mgr.gibba045.orlgmj (mgr.34412) 4818 : audit [DBG] from='client.47292 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:19:47.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:19:47 gibba045 bash[25517]: audit 2021-03-10T15:19:46.790626+0000 mgr.gibba045.orlgmj (mgr.34412) 4818 : audit [DBG] from='client.47292 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:19:48.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:19:48 gibba015 bash[29377]: cluster 2021-03-10T15:19:46.887075+0000 mgr.gibba045.orlgmj (mgr.34412) 4819 : cluster [DBG] pgmap v2740: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:48.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:19:48 gibba015 bash[29377]: audit 2021-03-10T15:19:47.014126+0000 mgr.gibba045.orlgmj (mgr.34412) 4820 : audit [DBG] from='client.57286 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:19:48.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:19:48 gibba015 bash[29377]: audit 2021-03-10T15:19:47.306933+0000 mon.c (mon.1) 1364 : audit [DBG] from='client.? 172.21.2.115:0/2676979320' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:19:48.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:19:48 gibba015 bash[30343]: cluster 2021-03-10T15:19:46.887075+0000 mgr.gibba045.orlgmj (mgr.34412) 4819 : cluster [DBG] pgmap v2740: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:48.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:19:48 gibba015 bash[30343]: audit 2021-03-10T15:19:47.014126+0000 mgr.gibba045.orlgmj (mgr.34412) 4820 : audit [DBG] from='client.57286 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:19:48.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:19:48 gibba015 bash[30343]: audit 2021-03-10T15:19:47.306933+0000 mon.c (mon.1) 1364 : audit [DBG] from='client.? 172.21.2.115:0/2676979320' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:19:48.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:19:48 gibba045 bash[25517]: cluster 2021-03-10T15:19:46.887075+0000 mgr.gibba045.orlgmj (mgr.34412) 4819 : cluster [DBG] pgmap v2740: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:48.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:19:48 gibba045 bash[25517]: audit 2021-03-10T15:19:47.014126+0000 mgr.gibba045.orlgmj (mgr.34412) 4820 : audit [DBG] from='client.57286 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:19:48.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:19:48 gibba045 bash[25517]: audit 2021-03-10T15:19:47.306933+0000 mon.c (mon.1) 1364 : audit [DBG] from='client.? 172.21.2.115:0/2676979320' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:19:50.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:19:50 gibba015 bash[29377]: cluster 2021-03-10T15:19:48.888311+0000 mgr.gibba045.orlgmj (mgr.34412) 4821 : cluster [DBG] pgmap v2741: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:50.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:19:50 gibba015 bash[30343]: cluster 2021-03-10T15:19:48.888311+0000 mgr.gibba045.orlgmj (mgr.34412) 4821 : cluster [DBG] pgmap v2741: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:50.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:19:50 gibba045 bash[25517]: cluster 2021-03-10T15:19:48.888311+0000 mgr.gibba045.orlgmj (mgr.34412) 4821 : cluster [DBG] pgmap v2741: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:52.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:19:52 gibba015 bash[29377]: cluster 2021-03-10T15:19:50.889057+0000 mgr.gibba045.orlgmj (mgr.34412) 4822 : cluster [DBG] pgmap v2742: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:52.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:19:52 gibba015 bash[30343]: cluster 2021-03-10T15:19:50.889057+0000 mgr.gibba045.orlgmj (mgr.34412) 4822 : cluster [DBG] pgmap v2742: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:52.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:19:52 gibba045 bash[25517]: cluster 2021-03-10T15:19:50.889057+0000 mgr.gibba045.orlgmj (mgr.34412) 4822 : cluster [DBG] pgmap v2742: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:53.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:19:53 gibba015 bash[29377]: audit 2021-03-10T15:19:53.073281+0000 mon.c (mon.1) 1365 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:19:53.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:19:53 gibba015 bash[29377]: audit 2021-03-10T15:19:53.074063+0000 mon.c (mon.1) 1366 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:19:53.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:19:53 gibba015 bash[29377]: audit 2021-03-10T15:19:53.074502+0000 mon.a (mon.0) 1308 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:19:53.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:19:53 gibba015 bash[29377]: audit 2021-03-10T15:19:53.075740+0000 mon.c (mon.1) 1367 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T15:19:53.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:19:53 gibba015 bash[29377]: audit 2021-03-10T15:19:53.075857+0000 mon.a (mon.0) 1309 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:19:53.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:19:53 gibba015 bash[29377]: audit 2021-03-10T15:19:53.076710+0000 mon.c (mon.1) 1368 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:19:53.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:19:53 gibba015 bash[29377]: audit 2021-03-10T15:19:53.076872+0000 mon.a (mon.0) 1310 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T15:19:53.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:19:53 gibba015 bash[29377]: audit 2021-03-10T15:19:53.077867+0000 mon.c (mon.1) 1369 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T15:19:53.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:19:53 gibba015 bash[29377]: audit 2021-03-10T15:19:53.078224+0000 mon.a (mon.0) 1311 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:19:53.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:19:53 gibba015 bash[29377]: audit 2021-03-10T15:19:53.078959+0000 mon.c (mon.1) 1370 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:19:53.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:19:53 gibba015 bash[29377]: audit 2021-03-10T15:19:53.079090+0000 mon.a (mon.0) 1312 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T15:19:53.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:19:53 gibba015 bash[29377]: audit 2021-03-10T15:19:53.079359+0000 mon.a (mon.0) 1313 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:19:53.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:19:53 gibba015 bash[30343]: audit 2021-03-10T15:19:53.073281+0000 mon.c (mon.1) 1365 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:19:53.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:19:53 gibba015 bash[30343]: audit 2021-03-10T15:19:53.074063+0000 mon.c (mon.1) 1366 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:19:53.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:19:53 gibba015 bash[30343]: audit 2021-03-10T15:19:53.074502+0000 mon.a (mon.0) 1308 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:19:53.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:19:53 gibba015 bash[30343]: audit 2021-03-10T15:19:53.075740+0000 mon.c (mon.1) 1367 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T15:19:53.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:19:53 gibba015 bash[30343]: audit 2021-03-10T15:19:53.075857+0000 mon.a (mon.0) 1309 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:19:53.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:19:53 gibba015 bash[30343]: audit 2021-03-10T15:19:53.076710+0000 mon.c (mon.1) 1368 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:19:53.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:19:53 gibba015 bash[30343]: audit 2021-03-10T15:19:53.076872+0000 mon.a (mon.0) 1310 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T15:19:53.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:19:53 gibba015 bash[30343]: audit 2021-03-10T15:19:53.077867+0000 mon.c (mon.1) 1369 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T15:19:53.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:19:53 gibba015 bash[30343]: audit 2021-03-10T15:19:53.078224+0000 mon.a (mon.0) 1311 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:19:53.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:19:53 gibba015 bash[30343]: audit 2021-03-10T15:19:53.078959+0000 mon.c (mon.1) 1370 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:19:53.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:19:53 gibba015 bash[30343]: audit 2021-03-10T15:19:53.079090+0000 mon.a (mon.0) 1312 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T15:19:53.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:19:53 gibba015 bash[30343]: audit 2021-03-10T15:19:53.079359+0000 mon.a (mon.0) 1313 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:19:53.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:19:53 gibba045 bash[25517]: audit 2021-03-10T15:19:53.073281+0000 mon.c (mon.1) 1365 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:19:53.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:19:53 gibba045 bash[25517]: audit 2021-03-10T15:19:53.074063+0000 mon.c (mon.1) 1366 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:19:53.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:19:53 gibba045 bash[25517]: audit 2021-03-10T15:19:53.074502+0000 mon.a (mon.0) 1308 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:19:53.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:19:53 gibba045 bash[25517]: audit 2021-03-10T15:19:53.075740+0000 mon.c (mon.1) 1367 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T15:19:53.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:19:53 gibba045 bash[25517]: audit 2021-03-10T15:19:53.075857+0000 mon.a (mon.0) 1309 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:19:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:19:53 gibba045 bash[25517]: audit 2021-03-10T15:19:53.076710+0000 mon.c (mon.1) 1368 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:19:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:19:53 gibba045 bash[25517]: audit 2021-03-10T15:19:53.076872+0000 mon.a (mon.0) 1310 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T15:19:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:19:53 gibba045 bash[25517]: audit 2021-03-10T15:19:53.077867+0000 mon.c (mon.1) 1369 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T15:19:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:19:53 gibba045 bash[25517]: audit 2021-03-10T15:19:53.078224+0000 mon.a (mon.0) 1311 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:19:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:19:53 gibba045 bash[25517]: audit 2021-03-10T15:19:53.078959+0000 mon.c (mon.1) 1370 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:19:53.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:19:53 gibba045 bash[25517]: audit 2021-03-10T15:19:53.079090+0000 mon.a (mon.0) 1312 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T15:19:53.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:19:53 gibba045 bash[25517]: audit 2021-03-10T15:19:53.079359+0000 mon.a (mon.0) 1313 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:19:54.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:19:54 gibba015 bash[29377]: cluster 2021-03-10T15:19:52.890574+0000 mgr.gibba045.orlgmj (mgr.34412) 4823 : cluster [DBG] pgmap v2743: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:19:54 gibba015 bash[30343]: cluster 2021-03-10T15:19:52.890574+0000 mgr.gibba045.orlgmj (mgr.34412) 4823 : cluster [DBG] pgmap v2743: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:19:54 gibba045 bash[25517]: cluster 2021-03-10T15:19:52.890574+0000 mgr.gibba045.orlgmj (mgr.34412) 4823 : cluster [DBG] pgmap v2743: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:56.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:19:56 gibba045 bash[25517]: cluster 2021-03-10T15:19:54.892304+0000 mgr.gibba045.orlgmj (mgr.34412) 4824 : cluster [DBG] pgmap v2744: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:56.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:19:56 gibba045 bash[25517]: audit 2021-03-10T15:19:55.750148+0000 mon.c (mon.1) 1371 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:19:56.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:19:56 gibba045 bash[25517]: cephadm 2021-03-10T15:19:55.759456+0000 mgr.gibba045.orlgmj (mgr.34412) 4825 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:19:56.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:19:56 gibba045 bash[25517]: cephadm 2021-03-10T15:19:55.761428+0000 mgr.gibba045.orlgmj (mgr.34412) 4826 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:19:56.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:19:56 gibba045 bash[25517]: audit 2021-03-10T15:19:55.979075+0000 mon.a (mon.0) 1314 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:19:56.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:19:56 gibba045 bash[25517]: audit 2021-03-10T15:19:55.982651+0000 mon.c (mon.1) 1372 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:19:56.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:19:56 gibba045 bash[25517]: audit 2021-03-10T15:19:55.984118+0000 mon.c (mon.1) 1373 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:19:56.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:19:56 gibba045 bash[25517]: audit 2021-03-10T15:19:55.985421+0000 mon.c (mon.1) 1374 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:19:56.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:19:56 gibba045 bash[25517]: audit 2021-03-10T15:19:55.986909+0000 mon.c (mon.1) 1375 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:19:56.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:19:56 gibba045 bash[25517]: audit 2021-03-10T15:19:55.990005+0000 mon.c (mon.1) 1376 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:19:56.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:19:56 gibba045 bash[25517]: audit 2021-03-10T15:19:55.991696+0000 mon.c (mon.1) 1377 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:19:56.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:19:56 gibba015 bash[29377]: cluster 2021-03-10T15:19:54.892304+0000 mgr.gibba045.orlgmj (mgr.34412) 4824 : cluster [DBG] pgmap v2744: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:56.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:19:56 gibba015 bash[29377]: audit 2021-03-10T15:19:55.750148+0000 mon.c (mon.1) 1371 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:19:56.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:19:56 gibba015 bash[29377]: cephadm 2021-03-10T15:19:55.759456+0000 mgr.gibba045.orlgmj (mgr.34412) 4825 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:19:56.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:19:56 gibba015 bash[29377]: cephadm 2021-03-10T15:19:55.761428+0000 mgr.gibba045.orlgmj (mgr.34412) 4826 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:19:56.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:19:56 gibba015 bash[29377]: audit 2021-03-10T15:19:55.979075+0000 mon.a (mon.0) 1314 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:19:56.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:19:56 gibba015 bash[29377]: audit 2021-03-10T15:19:55.982651+0000 mon.c (mon.1) 1372 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:19:56.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:19:56 gibba015 bash[29377]: audit 2021-03-10T15:19:55.984118+0000 mon.c (mon.1) 1373 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:19:56.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:19:56 gibba015 bash[29377]: audit 2021-03-10T15:19:55.985421+0000 mon.c (mon.1) 1374 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:19:56.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:19:56 gibba015 bash[29377]: audit 2021-03-10T15:19:55.986909+0000 mon.c (mon.1) 1375 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:19:56.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:19:56 gibba015 bash[29377]: audit 2021-03-10T15:19:55.990005+0000 mon.c (mon.1) 1376 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:19:56.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:19:56 gibba015 bash[29377]: audit 2021-03-10T15:19:55.991696+0000 mon.c (mon.1) 1377 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:19:56.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:19:56 gibba015 bash[30343]: cluster 2021-03-10T15:19:54.892304+0000 mgr.gibba045.orlgmj (mgr.34412) 4824 : cluster [DBG] pgmap v2744: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:56.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:19:56 gibba015 bash[30343]: audit 2021-03-10T15:19:55.750148+0000 mon.c (mon.1) 1371 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:19:56.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:19:56 gibba015 bash[30343]: cephadm 2021-03-10T15:19:55.759456+0000 mgr.gibba045.orlgmj (mgr.34412) 4825 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:19:56.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:19:56 gibba015 bash[30343]: cephadm 2021-03-10T15:19:55.761428+0000 mgr.gibba045.orlgmj (mgr.34412) 4826 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:19:56.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:19:56 gibba015 bash[30343]: audit 2021-03-10T15:19:55.979075+0000 mon.a (mon.0) 1314 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:19:56.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:19:56 gibba015 bash[30343]: audit 2021-03-10T15:19:55.982651+0000 mon.c (mon.1) 1372 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:19:56.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:19:56 gibba015 bash[30343]: audit 2021-03-10T15:19:55.984118+0000 mon.c (mon.1) 1373 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:19:56.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:19:56 gibba015 bash[30343]: audit 2021-03-10T15:19:55.985421+0000 mon.c (mon.1) 1374 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:19:56.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:19:56 gibba015 bash[30343]: audit 2021-03-10T15:19:55.986909+0000 mon.c (mon.1) 1375 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:19:56.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:19:56 gibba015 bash[30343]: audit 2021-03-10T15:19:55.990005+0000 mon.c (mon.1) 1376 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:19:56.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:19:56 gibba015 bash[30343]: audit 2021-03-10T15:19:55.991696+0000 mon.c (mon.1) 1377 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:19:57.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:19:57 gibba045 bash[25517]: cephadm 2021-03-10T15:19:55.986414+0000 mgr.gibba045.orlgmj (mgr.34412) 4827 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:19:57.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:19:57 gibba045 bash[25517]: cephadm 2021-03-10T15:19:55.988055+0000 mgr.gibba045.orlgmj (mgr.34412) 4828 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:19:57.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:19:57 gibba045 bash[25517]: cephadm 2021-03-10T15:19:55.989480+0000 mgr.gibba045.orlgmj (mgr.34412) 4829 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:19:57.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:19:57 gibba045 bash[25517]: cephadm 2021-03-10T15:19:55.989517+0000 mgr.gibba045.orlgmj (mgr.34412) 4830 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:19:57.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:19:57 gibba045 bash[25517]: cephadm 2021-03-10T15:19:55.990911+0000 mgr.gibba045.orlgmj (mgr.34412) 4831 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:19:57.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:19:57 gibba045 bash[25517]: cephadm 2021-03-10T15:19:55.990947+0000 mgr.gibba045.orlgmj (mgr.34412) 4832 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:19:57.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:19:57 gibba045 bash[25517]: cephadm 2021-03-10T15:19:55.992112+0000 mgr.gibba045.orlgmj (mgr.34412) 4833 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:19:57.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:19:57 gibba045 bash[25517]: cephadm 2021-03-10T15:19:55.993854+0000 mgr.gibba045.orlgmj (mgr.34412) 4834 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:19:57.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:19:57 gibba045 bash[25517]: cephadm 2021-03-10T15:19:55.993889+0000 mgr.gibba045.orlgmj (mgr.34412) 4835 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:19:57.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:19:57 gibba045 bash[25517]: cephadm 2021-03-10T15:19:55.995408+0000 mgr.gibba045.orlgmj (mgr.34412) 4836 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:19:57.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:19:57 gibba045 bash[25517]: cephadm 2021-03-10T15:19:55.995717+0000 mgr.gibba045.orlgmj (mgr.34412) 4837 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:19:57.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:19:57 gibba045 bash[25517]: cephadm 2021-03-10T15:19:55.996877+0000 mgr.gibba045.orlgmj (mgr.34412) 4838 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:19:57.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:19:57 gibba045 bash[25517]: cephadm 2021-03-10T15:19:55.996914+0000 mgr.gibba045.orlgmj (mgr.34412) 4839 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:19:57.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:19:57 gibba045 bash[25517]: cephadm 2021-03-10T15:19:55.997019+0000 mgr.gibba045.orlgmj (mgr.34412) 4840 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:19:57.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:19:57 gibba015 bash[29377]: cephadm 2021-03-10T15:19:55.986414+0000 mgr.gibba045.orlgmj (mgr.34412) 4827 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:19:57.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:19:57 gibba015 bash[29377]: cephadm 2021-03-10T15:19:55.988055+0000 mgr.gibba045.orlgmj (mgr.34412) 4828 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:19:57.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:19:57 gibba015 bash[29377]: cephadm 2021-03-10T15:19:55.989480+0000 mgr.gibba045.orlgmj (mgr.34412) 4829 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:19:57.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:19:57 gibba015 bash[29377]: cephadm 2021-03-10T15:19:55.989517+0000 mgr.gibba045.orlgmj (mgr.34412) 4830 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:19:57.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:19:57 gibba015 bash[29377]: cephadm 2021-03-10T15:19:55.990911+0000 mgr.gibba045.orlgmj (mgr.34412) 4831 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:19:57.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:19:57 gibba015 bash[29377]: cephadm 2021-03-10T15:19:55.990947+0000 mgr.gibba045.orlgmj (mgr.34412) 4832 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:19:57.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:19:57 gibba015 bash[29377]: cephadm 2021-03-10T15:19:55.992112+0000 mgr.gibba045.orlgmj (mgr.34412) 4833 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:19:57.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:19:57 gibba015 bash[29377]: cephadm 2021-03-10T15:19:55.993854+0000 mgr.gibba045.orlgmj (mgr.34412) 4834 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:19:57.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:19:57 gibba015 bash[29377]: cephadm 2021-03-10T15:19:55.993889+0000 mgr.gibba045.orlgmj (mgr.34412) 4835 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:19:57.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:19:57 gibba015 bash[29377]: cephadm 2021-03-10T15:19:55.995408+0000 mgr.gibba045.orlgmj (mgr.34412) 4836 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:19:57.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:19:57 gibba015 bash[29377]: cephadm 2021-03-10T15:19:55.995717+0000 mgr.gibba045.orlgmj (mgr.34412) 4837 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:19:57.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:19:57 gibba015 bash[29377]: cephadm 2021-03-10T15:19:55.996877+0000 mgr.gibba045.orlgmj (mgr.34412) 4838 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:19:57.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:19:57 gibba015 bash[29377]: cephadm 2021-03-10T15:19:55.996914+0000 mgr.gibba045.orlgmj (mgr.34412) 4839 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:19:57.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:19:57 gibba015 bash[29377]: cephadm 2021-03-10T15:19:55.997019+0000 mgr.gibba045.orlgmj (mgr.34412) 4840 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:19:57.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:19:57 gibba015 bash[30343]: cephadm 2021-03-10T15:19:55.986414+0000 mgr.gibba045.orlgmj (mgr.34412) 4827 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:19:57.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:19:57 gibba015 bash[30343]: cephadm 2021-03-10T15:19:55.988055+0000 mgr.gibba045.orlgmj (mgr.34412) 4828 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:19:57.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:19:57 gibba015 bash[30343]: cephadm 2021-03-10T15:19:55.989480+0000 mgr.gibba045.orlgmj (mgr.34412) 4829 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:19:57.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:19:57 gibba015 bash[30343]: cephadm 2021-03-10T15:19:55.989517+0000 mgr.gibba045.orlgmj (mgr.34412) 4830 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:19:57.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:19:57 gibba015 bash[30343]: cephadm 2021-03-10T15:19:55.990911+0000 mgr.gibba045.orlgmj (mgr.34412) 4831 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:19:57.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:19:57 gibba015 bash[30343]: cephadm 2021-03-10T15:19:55.990947+0000 mgr.gibba045.orlgmj (mgr.34412) 4832 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:19:57.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:19:57 gibba015 bash[30343]: cephadm 2021-03-10T15:19:55.992112+0000 mgr.gibba045.orlgmj (mgr.34412) 4833 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:19:57.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:19:57 gibba015 bash[30343]: cephadm 2021-03-10T15:19:55.993854+0000 mgr.gibba045.orlgmj (mgr.34412) 4834 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:19:57.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:19:57 gibba015 bash[30343]: cephadm 2021-03-10T15:19:55.993889+0000 mgr.gibba045.orlgmj (mgr.34412) 4835 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:19:57.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:19:57 gibba015 bash[30343]: cephadm 2021-03-10T15:19:55.995408+0000 mgr.gibba045.orlgmj (mgr.34412) 4836 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:19:57.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:19:57 gibba015 bash[30343]: cephadm 2021-03-10T15:19:55.995717+0000 mgr.gibba045.orlgmj (mgr.34412) 4837 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:19:57.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:19:57 gibba015 bash[30343]: cephadm 2021-03-10T15:19:55.996877+0000 mgr.gibba045.orlgmj (mgr.34412) 4838 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:19:57.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:19:57 gibba015 bash[30343]: cephadm 2021-03-10T15:19:55.996914+0000 mgr.gibba045.orlgmj (mgr.34412) 4839 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:19:57.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:19:57 gibba015 bash[30343]: cephadm 2021-03-10T15:19:55.997019+0000 mgr.gibba045.orlgmj (mgr.34412) 4840 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:19:58.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:19:58 gibba045 bash[25517]: cluster 2021-03-10T15:19:56.894059+0000 mgr.gibba045.orlgmj (mgr.34412) 4841 : cluster [DBG] pgmap v2745: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:58.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:19:58 gibba015 bash[29377]: cluster 2021-03-10T15:19:56.894059+0000 mgr.gibba045.orlgmj (mgr.34412) 4841 : cluster [DBG] pgmap v2745: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:58.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:19:58 gibba015 bash[30343]: cluster 2021-03-10T15:19:56.894059+0000 mgr.gibba045.orlgmj (mgr.34412) 4841 : cluster [DBG] pgmap v2745: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:00.257 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:20:00 gibba015 bash[29377]: debug 2021-03-10T15:19:59.994+0000 7f21beb4f700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T15:20:00.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:20:00 gibba045 bash[25517]: cluster 2021-03-10T15:19:58.894580+0000 mgr.gibba045.orlgmj (mgr.34412) 4842 : cluster [DBG] pgmap v2746: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:00.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:20:00 gibba045 bash[25517]: cluster 2021-03-10T15:20:00.000224+0000 mon.a (mon.0) 1315 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T15:20:00.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:20:00 gibba015 bash[29377]: cluster 2021-03-10T15:19:58.894580+0000 mgr.gibba045.orlgmj (mgr.34412) 4842 : cluster [DBG] pgmap v2746: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:00.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:20:00 gibba015 bash[29377]: cluster 2021-03-10T15:20:00.000224+0000 mon.a (mon.0) 1315 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T15:20:00.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:20:00 gibba015 bash[30343]: cluster 2021-03-10T15:19:58.894580+0000 mgr.gibba045.orlgmj (mgr.34412) 4842 : cluster [DBG] pgmap v2746: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:00.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:20:00 gibba015 bash[30343]: cluster 2021-03-10T15:20:00.000224+0000 mon.a (mon.0) 1315 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T15:20:02.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:20:02 gibba045 bash[25517]: cluster 2021-03-10T15:20:00.895944+0000 mgr.gibba045.orlgmj (mgr.34412) 4843 : cluster [DBG] pgmap v2747: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:02.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:20:02 gibba015 bash[29377]: cluster 2021-03-10T15:20:00.895944+0000 mgr.gibba045.orlgmj (mgr.34412) 4843 : cluster [DBG] pgmap v2747: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:02.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:20:02 gibba015 bash[30343]: cluster 2021-03-10T15:20:00.895944+0000 mgr.gibba045.orlgmj (mgr.34412) 4843 : cluster [DBG] pgmap v2747: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:04.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:20:04 gibba045 bash[25517]: cluster 2021-03-10T15:20:02.897411+0000 mgr.gibba045.orlgmj (mgr.34412) 4844 : cluster [DBG] pgmap v2748: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:04.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:20:04 gibba015 bash[29377]: cluster 2021-03-10T15:20:02.897411+0000 mgr.gibba045.orlgmj (mgr.34412) 4844 : cluster [DBG] pgmap v2748: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:04.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:20:04 gibba015 bash[30343]: cluster 2021-03-10T15:20:02.897411+0000 mgr.gibba045.orlgmj (mgr.34412) 4844 : cluster [DBG] pgmap v2748: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:06.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:20:06 gibba045 bash[25517]: cluster 2021-03-10T15:20:04.899038+0000 mgr.gibba045.orlgmj (mgr.34412) 4845 : cluster [DBG] pgmap v2749: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:06.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:20:06 gibba015 bash[29377]: cluster 2021-03-10T15:20:04.899038+0000 mgr.gibba045.orlgmj (mgr.34412) 4845 : cluster [DBG] pgmap v2749: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:06.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:20:06 gibba015 bash[30343]: cluster 2021-03-10T15:20:04.899038+0000 mgr.gibba045.orlgmj (mgr.34412) 4845 : cluster [DBG] pgmap v2749: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:08.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:20:08 gibba045 bash[25517]: cluster 2021-03-10T15:20:06.899887+0000 mgr.gibba045.orlgmj (mgr.34412) 4846 : cluster [DBG] pgmap v2750: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:08.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:20:08 gibba015 bash[29377]: cluster 2021-03-10T15:20:06.899887+0000 mgr.gibba045.orlgmj (mgr.34412) 4846 : cluster [DBG] pgmap v2750: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:08.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:20:08 gibba015 bash[30343]: cluster 2021-03-10T15:20:06.899887+0000 mgr.gibba045.orlgmj (mgr.34412) 4846 : cluster [DBG] pgmap v2750: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:10.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:20:10 gibba015 bash[29377]: cluster 2021-03-10T15:20:08.901088+0000 mgr.gibba045.orlgmj (mgr.34412) 4847 : cluster [DBG] pgmap v2751: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:10.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:20:10 gibba015 bash[30343]: cluster 2021-03-10T15:20:08.901088+0000 mgr.gibba045.orlgmj (mgr.34412) 4847 : cluster [DBG] pgmap v2751: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:10.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:20:10 gibba045 bash[25517]: cluster 2021-03-10T15:20:08.901088+0000 mgr.gibba045.orlgmj (mgr.34412) 4847 : cluster [DBG] pgmap v2751: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:12.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:20:12 gibba015 bash[29377]: cluster 2021-03-10T15:20:10.902633+0000 mgr.gibba045.orlgmj (mgr.34412) 4848 : cluster [DBG] pgmap v2752: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:12.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:20:12 gibba015 bash[29377]: cephadm 2021-03-10T15:20:11.012792+0000 mgr.gibba045.orlgmj (mgr.34412) 4849 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:20:12.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:20:12 gibba015 bash[30343]: cluster 2021-03-10T15:20:10.902633+0000 mgr.gibba045.orlgmj (mgr.34412) 4848 : cluster [DBG] pgmap v2752: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:12.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:20:12 gibba015 bash[30343]: cephadm 2021-03-10T15:20:11.012792+0000 mgr.gibba045.orlgmj (mgr.34412) 4849 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:20:12.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:20:12 gibba045 bash[25517]: cluster 2021-03-10T15:20:10.902633+0000 mgr.gibba045.orlgmj (mgr.34412) 4848 : cluster [DBG] pgmap v2752: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:12.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:20:12 gibba045 bash[25517]: cephadm 2021-03-10T15:20:11.012792+0000 mgr.gibba045.orlgmj (mgr.34412) 4849 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:20:14.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:20:14 gibba015 bash[29377]: cluster 2021-03-10T15:20:12.904362+0000 mgr.gibba045.orlgmj (mgr.34412) 4850 : cluster [DBG] pgmap v2753: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:14.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:20:14 gibba015 bash[30343]: cluster 2021-03-10T15:20:12.904362+0000 mgr.gibba045.orlgmj (mgr.34412) 4850 : cluster [DBG] pgmap v2753: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:14.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:20:14 gibba045 bash[25517]: cluster 2021-03-10T15:20:12.904362+0000 mgr.gibba045.orlgmj (mgr.34412) 4850 : cluster [DBG] pgmap v2753: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:16.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:20:16 gibba015 bash[29377]: cluster 2021-03-10T15:20:14.904984+0000 mgr.gibba045.orlgmj (mgr.34412) 4851 : cluster [DBG] pgmap v2754: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:16.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:20:16 gibba015 bash[30343]: cluster 2021-03-10T15:20:14.904984+0000 mgr.gibba045.orlgmj (mgr.34412) 4851 : cluster [DBG] pgmap v2754: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:16.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:20:16 gibba045 bash[25517]: cluster 2021-03-10T15:20:14.904984+0000 mgr.gibba045.orlgmj (mgr.34412) 4851 : cluster [DBG] pgmap v2754: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:17.553 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:20:17.780 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:20:17.780 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (91m) 5m ago 96m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:20:17.780 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (96m) 4m ago 96m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:20:17.781 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (91m) 4m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:20:17.781 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (91m) 4m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:20:17.781 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (90m) 5m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:20:17.781 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (90m) 5m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:20:17.782 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (90m) 4m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:20:17.782 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (90m) 5m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:20:17.782 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (96m) 5m ago 96m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:20:17.783 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (96m) 4m ago 96m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:20:17.783 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (89m) 5m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:20:17.783 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (88m) 5m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:20:17.783 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (88m) 5m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:20:17.784 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (88m) 5m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:20:17.784 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (87m) 4m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:20:17.784 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (87m) 4m ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:20:17.784 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (86m) 4m ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:20:17.784 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (86m) 4m ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:20:17.785 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (95m) 4m ago 96m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:20:17.785 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 4m ago 94m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:20:18.029 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:20:18.029 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:20:18.029 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:20:18.029 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:20:18.030 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:20:18.030 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:20:18.030 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:20:18.031 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:20:18.031 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:20:18.031 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:20:18.031 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:20:18.032 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:20:18.032 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:20:18.032 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:20:18.032 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:20:18.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:20:18 gibba015 bash[29377]: cluster 2021-03-10T15:20:16.906393+0000 mgr.gibba045.orlgmj (mgr.34412) 4852 : cluster [DBG] pgmap v2755: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:18.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:20:18 gibba015 bash[29377]: audit 2021-03-10T15:20:17.544708+0000 mgr.gibba045.orlgmj (mgr.34412) 4853 : audit [DBG] from='client.57298 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:20:18.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:20:18 gibba015 bash[29377]: audit 2021-03-10T15:20:17.769778+0000 mgr.gibba045.orlgmj (mgr.34412) 4854 : audit [DBG] from='client.47316 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:20:18.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:20:18 gibba015 bash[29377]: audit 2021-03-10T15:20:18.024691+0000 mon.c (mon.1) 1378 : audit [DBG] from='client.? 172.21.2.115:0/1761657956' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:20:18.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:20:18 gibba015 bash[30343]: cluster 2021-03-10T15:20:16.906393+0000 mgr.gibba045.orlgmj (mgr.34412) 4852 : cluster [DBG] pgmap v2755: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:18.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:20:18 gibba015 bash[30343]: audit 2021-03-10T15:20:17.544708+0000 mgr.gibba045.orlgmj (mgr.34412) 4853 : audit [DBG] from='client.57298 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:20:18.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:20:18 gibba015 bash[30343]: audit 2021-03-10T15:20:17.769778+0000 mgr.gibba045.orlgmj (mgr.34412) 4854 : audit [DBG] from='client.47316 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:20:18.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:20:18 gibba015 bash[30343]: audit 2021-03-10T15:20:18.024691+0000 mon.c (mon.1) 1378 : audit [DBG] from='client.? 172.21.2.115:0/1761657956' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:20:18.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:20:18 gibba045 bash[25517]: cluster 2021-03-10T15:20:16.906393+0000 mgr.gibba045.orlgmj (mgr.34412) 4852 : cluster [DBG] pgmap v2755: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:18.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:20:18 gibba045 bash[25517]: audit 2021-03-10T15:20:17.544708+0000 mgr.gibba045.orlgmj (mgr.34412) 4853 : audit [DBG] from='client.57298 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:20:18.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:20:18 gibba045 bash[25517]: audit 2021-03-10T15:20:17.769778+0000 mgr.gibba045.orlgmj (mgr.34412) 4854 : audit [DBG] from='client.47316 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:20:18.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:20:18 gibba045 bash[25517]: audit 2021-03-10T15:20:18.024691+0000 mon.c (mon.1) 1378 : audit [DBG] from='client.? 172.21.2.115:0/1761657956' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:20:20.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:20:20 gibba015 bash[29377]: cluster 2021-03-10T15:20:18.907564+0000 mgr.gibba045.orlgmj (mgr.34412) 4855 : cluster [DBG] pgmap v2756: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:20.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:20:20 gibba015 bash[30343]: cluster 2021-03-10T15:20:18.907564+0000 mgr.gibba045.orlgmj (mgr.34412) 4855 : cluster [DBG] pgmap v2756: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:20.910 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:20:20 gibba045 bash[25517]: cluster 2021-03-10T15:20:18.907564+0000 mgr.gibba045.orlgmj (mgr.34412) 4855 : cluster [DBG] pgmap v2756: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:22.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:20:22 gibba015 bash[29377]: cluster 2021-03-10T15:20:20.909141+0000 mgr.gibba045.orlgmj (mgr.34412) 4856 : cluster [DBG] pgmap v2757: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:22.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:20:22 gibba015 bash[30343]: cluster 2021-03-10T15:20:20.909141+0000 mgr.gibba045.orlgmj (mgr.34412) 4856 : cluster [DBG] pgmap v2757: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:22.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:20:22 gibba045 bash[25517]: cluster 2021-03-10T15:20:20.909141+0000 mgr.gibba045.orlgmj (mgr.34412) 4856 : cluster [DBG] pgmap v2757: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:24.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:20:24 gibba015 bash[29377]: cluster 2021-03-10T15:20:22.910484+0000 mgr.gibba045.orlgmj (mgr.34412) 4857 : cluster [DBG] pgmap v2758: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:24.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:20:24 gibba015 bash[30343]: cluster 2021-03-10T15:20:22.910484+0000 mgr.gibba045.orlgmj (mgr.34412) 4857 : cluster [DBG] pgmap v2758: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:24.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:20:24 gibba045 bash[25517]: cluster 2021-03-10T15:20:22.910484+0000 mgr.gibba045.orlgmj (mgr.34412) 4857 : cluster [DBG] pgmap v2758: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:26.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:20:26 gibba015 bash[29377]: cluster 2021-03-10T15:20:24.912013+0000 mgr.gibba045.orlgmj (mgr.34412) 4858 : cluster [DBG] pgmap v2759: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:26.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:20:26 gibba015 bash[30343]: cluster 2021-03-10T15:20:24.912013+0000 mgr.gibba045.orlgmj (mgr.34412) 4858 : cluster [DBG] pgmap v2759: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:26.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:20:26 gibba045 bash[25517]: cluster 2021-03-10T15:20:24.912013+0000 mgr.gibba045.orlgmj (mgr.34412) 4858 : cluster [DBG] pgmap v2759: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:27.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:20:27 gibba015 bash[29377]: cephadm 2021-03-10T15:20:26.028926+0000 mgr.gibba045.orlgmj (mgr.34412) 4859 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:20:27.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:20:27 gibba015 bash[30343]: cephadm 2021-03-10T15:20:26.028926+0000 mgr.gibba045.orlgmj (mgr.34412) 4859 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:20:27.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:20:27 gibba045 bash[25517]: cephadm 2021-03-10T15:20:26.028926+0000 mgr.gibba045.orlgmj (mgr.34412) 4859 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:20:28.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:20:28 gibba015 bash[29377]: cluster 2021-03-10T15:20:26.913537+0000 mgr.gibba045.orlgmj (mgr.34412) 4860 : cluster [DBG] pgmap v2760: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:28.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:20:28 gibba015 bash[30343]: cluster 2021-03-10T15:20:26.913537+0000 mgr.gibba045.orlgmj (mgr.34412) 4860 : cluster [DBG] pgmap v2760: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:28.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:20:28 gibba045 bash[25517]: cluster 2021-03-10T15:20:26.913537+0000 mgr.gibba045.orlgmj (mgr.34412) 4860 : cluster [DBG] pgmap v2760: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:30.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:20:30 gibba015 bash[29377]: cluster 2021-03-10T15:20:28.914770+0000 mgr.gibba045.orlgmj (mgr.34412) 4861 : cluster [DBG] pgmap v2761: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:30.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:20:30 gibba015 bash[30343]: cluster 2021-03-10T15:20:28.914770+0000 mgr.gibba045.orlgmj (mgr.34412) 4861 : cluster [DBG] pgmap v2761: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:30.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:20:30 gibba045 bash[25517]: cluster 2021-03-10T15:20:28.914770+0000 mgr.gibba045.orlgmj (mgr.34412) 4861 : cluster [DBG] pgmap v2761: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:32.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:20:32 gibba015 bash[29377]: cluster 2021-03-10T15:20:30.915630+0000 mgr.gibba045.orlgmj (mgr.34412) 4862 : cluster [DBG] pgmap v2762: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:32.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:20:32 gibba015 bash[30343]: cluster 2021-03-10T15:20:30.915630+0000 mgr.gibba045.orlgmj (mgr.34412) 4862 : cluster [DBG] pgmap v2762: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:32.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:20:32 gibba045 bash[25517]: cluster 2021-03-10T15:20:30.915630+0000 mgr.gibba045.orlgmj (mgr.34412) 4862 : cluster [DBG] pgmap v2762: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:34.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:20:34 gibba015 bash[29377]: cluster 2021-03-10T15:20:32.917261+0000 mgr.gibba045.orlgmj (mgr.34412) 4863 : cluster [DBG] pgmap v2763: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:34.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:20:34 gibba015 bash[30343]: cluster 2021-03-10T15:20:32.917261+0000 mgr.gibba045.orlgmj (mgr.34412) 4863 : cluster [DBG] pgmap v2763: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:34.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:20:34 gibba045 bash[25517]: cluster 2021-03-10T15:20:32.917261+0000 mgr.gibba045.orlgmj (mgr.34412) 4863 : cluster [DBG] pgmap v2763: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:36.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:20:36 gibba015 bash[29377]: cluster 2021-03-10T15:20:34.918906+0000 mgr.gibba045.orlgmj (mgr.34412) 4864 : cluster [DBG] pgmap v2764: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:36.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:20:36 gibba015 bash[30343]: cluster 2021-03-10T15:20:34.918906+0000 mgr.gibba045.orlgmj (mgr.34412) 4864 : cluster [DBG] pgmap v2764: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:36.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:20:36 gibba045 bash[25517]: cluster 2021-03-10T15:20:34.918906+0000 mgr.gibba045.orlgmj (mgr.34412) 4864 : cluster [DBG] pgmap v2764: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:38.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:20:38 gibba015 bash[29377]: cluster 2021-03-10T15:20:36.920741+0000 mgr.gibba045.orlgmj (mgr.34412) 4865 : cluster [DBG] pgmap v2765: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:38.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:20:38 gibba015 bash[30343]: cluster 2021-03-10T15:20:36.920741+0000 mgr.gibba045.orlgmj (mgr.34412) 4865 : cluster [DBG] pgmap v2765: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:38.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:20:38 gibba045 bash[25517]: cluster 2021-03-10T15:20:36.920741+0000 mgr.gibba045.orlgmj (mgr.34412) 4865 : cluster [DBG] pgmap v2765: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:40.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:20:40 gibba015 bash[29377]: cluster 2021-03-10T15:20:38.921981+0000 mgr.gibba045.orlgmj (mgr.34412) 4866 : cluster [DBG] pgmap v2766: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:40.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:20:40 gibba015 bash[30343]: cluster 2021-03-10T15:20:38.921981+0000 mgr.gibba045.orlgmj (mgr.34412) 4866 : cluster [DBG] pgmap v2766: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:40.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:20:40 gibba045 bash[25517]: cluster 2021-03-10T15:20:38.921981+0000 mgr.gibba045.orlgmj (mgr.34412) 4866 : cluster [DBG] pgmap v2766: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:42.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:20:42 gibba015 bash[29377]: cluster 2021-03-10T15:20:40.923471+0000 mgr.gibba045.orlgmj (mgr.34412) 4867 : cluster [DBG] pgmap v2767: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:42.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:20:42 gibba015 bash[29377]: cephadm 2021-03-10T15:20:41.044889+0000 mgr.gibba045.orlgmj (mgr.34412) 4868 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:20:42.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:20:42 gibba015 bash[30343]: cluster 2021-03-10T15:20:40.923471+0000 mgr.gibba045.orlgmj (mgr.34412) 4867 : cluster [DBG] pgmap v2767: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:42.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:20:42 gibba015 bash[30343]: cephadm 2021-03-10T15:20:41.044889+0000 mgr.gibba045.orlgmj (mgr.34412) 4868 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:20:42.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:20:42 gibba045 bash[25517]: cluster 2021-03-10T15:20:40.923471+0000 mgr.gibba045.orlgmj (mgr.34412) 4867 : cluster [DBG] pgmap v2767: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:42.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:20:42 gibba045 bash[25517]: cephadm 2021-03-10T15:20:41.044889+0000 mgr.gibba045.orlgmj (mgr.34412) 4868 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:20:44.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:20:44 gibba015 bash[29377]: cluster 2021-03-10T15:20:42.925036+0000 mgr.gibba045.orlgmj (mgr.34412) 4869 : cluster [DBG] pgmap v2768: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:44.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:20:44 gibba015 bash[30343]: cluster 2021-03-10T15:20:42.925036+0000 mgr.gibba045.orlgmj (mgr.34412) 4869 : cluster [DBG] pgmap v2768: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:44.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:20:44 gibba045 bash[25517]: cluster 2021-03-10T15:20:42.925036+0000 mgr.gibba045.orlgmj (mgr.34412) 4869 : cluster [DBG] pgmap v2768: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:46.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:20:46 gibba045 bash[25517]: cluster 2021-03-10T15:20:44.926460+0000 mgr.gibba045.orlgmj (mgr.34412) 4870 : cluster [DBG] pgmap v2769: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:46.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:20:46 gibba015 bash[29377]: cluster 2021-03-10T15:20:44.926460+0000 mgr.gibba045.orlgmj (mgr.34412) 4870 : cluster [DBG] pgmap v2769: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:46.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:20:46 gibba015 bash[30343]: cluster 2021-03-10T15:20:44.926460+0000 mgr.gibba045.orlgmj (mgr.34412) 4870 : cluster [DBG] pgmap v2769: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:48.276 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:20:48.500 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:20:48.500 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (91m) 6m ago 96m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:20:48.500 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (96m) 4m ago 96m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:20:48.501 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (91m) 4m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:20:48.501 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (92m) 4m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:20:48.501 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (91m) 6m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:20:48.501 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (91m) 6m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:20:48.502 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (90m) 4m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:20:48.502 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (90m) 6m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:20:48.502 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (97m) 6m ago 97m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:20:48.502 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (97m) 4m ago 97m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:20:48.503 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (89m) 6m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:20:48.503 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (89m) 6m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:20:48.503 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (88m) 6m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:20:48.503 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (88m) 6m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:20:48.504 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (88m) 4m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:20:48.504 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (87m) 4m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:20:48.504 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (87m) 4m ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:20:48.504 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (86m) 4m ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:20:48.505 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (96m) 4m ago 97m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:20:48.505 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 4m ago 95m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:20:48.753 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:20:48.753 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:20:48.753 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:20:48.754 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:20:48.754 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:20:48.754 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:20:48.754 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:20:48.755 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:20:48.755 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:20:48.755 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:20:48.755 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:20:48.756 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:20:48.756 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:20:48.756 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:20:48.756 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:20:48.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:20:48 gibba045 bash[25517]: cluster 2021-03-10T15:20:46.927432+0000 mgr.gibba045.orlgmj (mgr.34412) 4871 : cluster [DBG] pgmap v2770: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:48.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:20:48 gibba015 bash[29377]: cluster 2021-03-10T15:20:46.927432+0000 mgr.gibba045.orlgmj (mgr.34412) 4871 : cluster [DBG] pgmap v2770: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:48.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:20:48 gibba015 bash[30343]: cluster 2021-03-10T15:20:46.927432+0000 mgr.gibba045.orlgmj (mgr.34412) 4871 : cluster [DBG] pgmap v2770: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:49.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:20:49 gibba045 bash[25517]: audit 2021-03-10T15:20:48.267435+0000 mgr.gibba045.orlgmj (mgr.34412) 4872 : audit [DBG] from='client.57316 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:20:49.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:20:49 gibba045 bash[25517]: audit 2021-03-10T15:20:48.492143+0000 mgr.gibba045.orlgmj (mgr.34412) 4873 : audit [DBG] from='client.57322 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:20:49.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:20:49 gibba045 bash[25517]: audit 2021-03-10T15:20:48.748817+0000 mon.a (mon.0) 1316 : audit [DBG] from='client.? 172.21.2.115:0/2628007941' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:20:49.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:20:49 gibba015 bash[29377]: audit 2021-03-10T15:20:48.267435+0000 mgr.gibba045.orlgmj (mgr.34412) 4872 : audit [DBG] from='client.57316 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:20:49.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:20:49 gibba015 bash[29377]: audit 2021-03-10T15:20:48.492143+0000 mgr.gibba045.orlgmj (mgr.34412) 4873 : audit [DBG] from='client.57322 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:20:49.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:20:49 gibba015 bash[29377]: audit 2021-03-10T15:20:48.748817+0000 mon.a (mon.0) 1316 : audit [DBG] from='client.? 172.21.2.115:0/2628007941' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:20:49.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:20:49 gibba015 bash[30343]: audit 2021-03-10T15:20:48.267435+0000 mgr.gibba045.orlgmj (mgr.34412) 4872 : audit [DBG] from='client.57316 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:20:49.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:20:49 gibba015 bash[30343]: audit 2021-03-10T15:20:48.492143+0000 mgr.gibba045.orlgmj (mgr.34412) 4873 : audit [DBG] from='client.57322 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:20:49.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:20:49 gibba015 bash[30343]: audit 2021-03-10T15:20:48.748817+0000 mon.a (mon.0) 1316 : audit [DBG] from='client.? 172.21.2.115:0/2628007941' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:20:50.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:20:50 gibba045 bash[25517]: cluster 2021-03-10T15:20:48.928655+0000 mgr.gibba045.orlgmj (mgr.34412) 4874 : cluster [DBG] pgmap v2771: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:50.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:20:50 gibba015 bash[29377]: cluster 2021-03-10T15:20:48.928655+0000 mgr.gibba045.orlgmj (mgr.34412) 4874 : cluster [DBG] pgmap v2771: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:50.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:20:50 gibba015 bash[30343]: cluster 2021-03-10T15:20:48.928655+0000 mgr.gibba045.orlgmj (mgr.34412) 4874 : cluster [DBG] pgmap v2771: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:52.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:20:52 gibba045 bash[25517]: cluster 2021-03-10T15:20:50.930111+0000 mgr.gibba045.orlgmj (mgr.34412) 4875 : cluster [DBG] pgmap v2772: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:52.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:20:52 gibba015 bash[29377]: cluster 2021-03-10T15:20:50.930111+0000 mgr.gibba045.orlgmj (mgr.34412) 4875 : cluster [DBG] pgmap v2772: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:52.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:20:52 gibba015 bash[30343]: cluster 2021-03-10T15:20:50.930111+0000 mgr.gibba045.orlgmj (mgr.34412) 4875 : cluster [DBG] pgmap v2772: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:53.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:20:53 gibba045 bash[25517]: audit 2021-03-10T15:20:53.079973+0000 mon.c (mon.1) 1379 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:20:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:20:53 gibba045 bash[25517]: audit 2021-03-10T15:20:53.080590+0000 mon.c (mon.1) 1380 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:20:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:20:53 gibba045 bash[25517]: audit 2021-03-10T15:20:53.081174+0000 mon.a (mon.0) 1317 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:20:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:20:53 gibba045 bash[25517]: audit 2021-03-10T15:20:53.081496+0000 mon.c (mon.1) 1381 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:20:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:20:53 gibba045 bash[25517]: audit 2021-03-10T15:20:53.082230+0000 mon.a (mon.0) 1318 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:20:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:20:53 gibba045 bash[25517]: audit 2021-03-10T15:20:53.082391+0000 mon.c (mon.1) 1382 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:20:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:20:53 gibba045 bash[25517]: audit 2021-03-10T15:20:53.083192+0000 mon.c (mon.1) 1383 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:20:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:20:53 gibba045 bash[25517]: audit 2021-03-10T15:20:53.083235+0000 mon.a (mon.0) 1319 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:20:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:20:53 gibba045 bash[25517]: audit 2021-03-10T15:20:53.083899+0000 mon.c (mon.1) 1384 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:20:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:20:53 gibba045 bash[25517]: audit 2021-03-10T15:20:53.084268+0000 mon.a (mon.0) 1320 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:20:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:20:53 gibba045 bash[25517]: audit 2021-03-10T15:20:53.085526+0000 mon.a (mon.0) 1321 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:20:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:20:53 gibba045 bash[25517]: audit 2021-03-10T15:20:53.086332+0000 mon.a (mon.0) 1322 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:20:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:20:53 gibba015 bash[29377]: audit 2021-03-10T15:20:53.079973+0000 mon.c (mon.1) 1379 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:20:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:20:53 gibba015 bash[29377]: audit 2021-03-10T15:20:53.080590+0000 mon.c (mon.1) 1380 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:20:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:20:53 gibba015 bash[29377]: audit 2021-03-10T15:20:53.081174+0000 mon.a (mon.0) 1317 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:20:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:20:53 gibba015 bash[29377]: audit 2021-03-10T15:20:53.081496+0000 mon.c (mon.1) 1381 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:20:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:20:53 gibba015 bash[29377]: audit 2021-03-10T15:20:53.082230+0000 mon.a (mon.0) 1318 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:20:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:20:53 gibba015 bash[29377]: audit 2021-03-10T15:20:53.082391+0000 mon.c (mon.1) 1382 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:20:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:20:53 gibba015 bash[29377]: audit 2021-03-10T15:20:53.083192+0000 mon.c (mon.1) 1383 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:20:53.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:20:53 gibba015 bash[29377]: audit 2021-03-10T15:20:53.083235+0000 mon.a (mon.0) 1319 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:20:53.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:20:53 gibba015 bash[29377]: audit 2021-03-10T15:20:53.083899+0000 mon.c (mon.1) 1384 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:20:53.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:20:53 gibba015 bash[29377]: audit 2021-03-10T15:20:53.084268+0000 mon.a (mon.0) 1320 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:20:53.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:20:53 gibba015 bash[29377]: audit 2021-03-10T15:20:53.085526+0000 mon.a (mon.0) 1321 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:20:53.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:20:53 gibba015 bash[29377]: audit 2021-03-10T15:20:53.086332+0000 mon.a (mon.0) 1322 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:20:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:20:53 gibba015 bash[30343]: audit 2021-03-10T15:20:53.079973+0000 mon.c (mon.1) 1379 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:20:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:20:53 gibba015 bash[30343]: audit 2021-03-10T15:20:53.080590+0000 mon.c (mon.1) 1380 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:20:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:20:53 gibba015 bash[30343]: audit 2021-03-10T15:20:53.081174+0000 mon.a (mon.0) 1317 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:20:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:20:53 gibba015 bash[30343]: audit 2021-03-10T15:20:53.081496+0000 mon.c (mon.1) 1381 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:20:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:20:53 gibba015 bash[30343]: audit 2021-03-10T15:20:53.082230+0000 mon.a (mon.0) 1318 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:20:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:20:53 gibba015 bash[30343]: audit 2021-03-10T15:20:53.082391+0000 mon.c (mon.1) 1382 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:20:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:20:53 gibba015 bash[30343]: audit 2021-03-10T15:20:53.083192+0000 mon.c (mon.1) 1383 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:20:53.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:20:53 gibba015 bash[30343]: audit 2021-03-10T15:20:53.083235+0000 mon.a (mon.0) 1319 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:20:53.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:20:53 gibba015 bash[30343]: audit 2021-03-10T15:20:53.083899+0000 mon.c (mon.1) 1384 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:20:53.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:20:53 gibba015 bash[30343]: audit 2021-03-10T15:20:53.084268+0000 mon.a (mon.0) 1320 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:20:53.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:20:53 gibba015 bash[30343]: audit 2021-03-10T15:20:53.085526+0000 mon.a (mon.0) 1321 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:20:53.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:20:53 gibba015 bash[30343]: audit 2021-03-10T15:20:53.086332+0000 mon.a (mon.0) 1322 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:20:54.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:20:54 gibba045 bash[25517]: cluster 2021-03-10T15:20:52.931603+0000 mgr.gibba045.orlgmj (mgr.34412) 4876 : cluster [DBG] pgmap v2773: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:54.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:20:54 gibba015 bash[29377]: cluster 2021-03-10T15:20:52.931603+0000 mgr.gibba045.orlgmj (mgr.34412) 4876 : cluster [DBG] pgmap v2773: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:54.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:20:54 gibba015 bash[30343]: cluster 2021-03-10T15:20:52.931603+0000 mgr.gibba045.orlgmj (mgr.34412) 4876 : cluster [DBG] pgmap v2773: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:56.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:20:56 gibba045 bash[25517]: cluster 2021-03-10T15:20:54.932626+0000 mgr.gibba045.orlgmj (mgr.34412) 4877 : cluster [DBG] pgmap v2774: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:56.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:20:56 gibba045 bash[25517]: audit 2021-03-10T15:20:56.057616+0000 mon.c (mon.1) 1385 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:20:56.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:20:56 gibba045 bash[25517]: audit 2021-03-10T15:20:56.288994+0000 mon.a (mon.0) 1323 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:20:56.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:20:56 gibba045 bash[25517]: audit 2021-03-10T15:20:56.293316+0000 mon.c (mon.1) 1386 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:20:56.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:20:56 gibba045 bash[25517]: audit 2021-03-10T15:20:56.295787+0000 mon.c (mon.1) 1387 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:20:56.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:20:56 gibba045 bash[25517]: audit 2021-03-10T15:20:56.298343+0000 mon.c (mon.1) 1388 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:20:56.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:20:56 gibba045 bash[25517]: audit 2021-03-10T15:20:56.300730+0000 mon.c (mon.1) 1389 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:20:56.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:20:56 gibba045 bash[25517]: audit 2021-03-10T15:20:56.307013+0000 mon.c (mon.1) 1390 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:20:56.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:20:56 gibba045 bash[25517]: audit 2021-03-10T15:20:56.310276+0000 mon.c (mon.1) 1391 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:20:56.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:20:56 gibba015 bash[29377]: cluster 2021-03-10T15:20:54.932626+0000 mgr.gibba045.orlgmj (mgr.34412) 4877 : cluster [DBG] pgmap v2774: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:56.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:20:56 gibba015 bash[29377]: audit 2021-03-10T15:20:56.057616+0000 mon.c (mon.1) 1385 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:20:56.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:20:56 gibba015 bash[29377]: audit 2021-03-10T15:20:56.288994+0000 mon.a (mon.0) 1323 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:20:56.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:20:56 gibba015 bash[29377]: audit 2021-03-10T15:20:56.293316+0000 mon.c (mon.1) 1386 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:20:56.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:20:56 gibba015 bash[29377]: audit 2021-03-10T15:20:56.295787+0000 mon.c (mon.1) 1387 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:20:56.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:20:56 gibba015 bash[29377]: audit 2021-03-10T15:20:56.298343+0000 mon.c (mon.1) 1388 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:20:56.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:20:56 gibba015 bash[29377]: audit 2021-03-10T15:20:56.300730+0000 mon.c (mon.1) 1389 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:20:56.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:20:56 gibba015 bash[29377]: audit 2021-03-10T15:20:56.307013+0000 mon.c (mon.1) 1390 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:20:56.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:20:56 gibba015 bash[29377]: audit 2021-03-10T15:20:56.310276+0000 mon.c (mon.1) 1391 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:20:56.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:20:56 gibba015 bash[30343]: cluster 2021-03-10T15:20:54.932626+0000 mgr.gibba045.orlgmj (mgr.34412) 4877 : cluster [DBG] pgmap v2774: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:56.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:20:56 gibba015 bash[30343]: audit 2021-03-10T15:20:56.057616+0000 mon.c (mon.1) 1385 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:20:56.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:20:56 gibba015 bash[30343]: audit 2021-03-10T15:20:56.288994+0000 mon.a (mon.0) 1323 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:20:56.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:20:56 gibba015 bash[30343]: audit 2021-03-10T15:20:56.293316+0000 mon.c (mon.1) 1386 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:20:56.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:20:56 gibba015 bash[30343]: audit 2021-03-10T15:20:56.295787+0000 mon.c (mon.1) 1387 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:20:56.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:20:56 gibba015 bash[30343]: audit 2021-03-10T15:20:56.298343+0000 mon.c (mon.1) 1388 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:20:56.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:20:56 gibba015 bash[30343]: audit 2021-03-10T15:20:56.300730+0000 mon.c (mon.1) 1389 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:20:56.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:20:56 gibba015 bash[30343]: audit 2021-03-10T15:20:56.307013+0000 mon.c (mon.1) 1390 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:20:56.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:20:56 gibba015 bash[30343]: audit 2021-03-10T15:20:56.310276+0000 mon.c (mon.1) 1391 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:20:57.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:20:57 gibba045 bash[25517]: cephadm 2021-03-10T15:20:56.067173+0000 mgr.gibba045.orlgmj (mgr.34412) 4878 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:20:57.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:20:57 gibba045 bash[25517]: cephadm 2021-03-10T15:20:56.069150+0000 mgr.gibba045.orlgmj (mgr.34412) 4879 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:20:57.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:20:57 gibba045 bash[25517]: cephadm 2021-03-10T15:20:56.296691+0000 mgr.gibba045.orlgmj (mgr.34412) 4880 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:20:57.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:20:57 gibba045 bash[25517]: cephadm 2021-03-10T15:20:56.299625+0000 mgr.gibba045.orlgmj (mgr.34412) 4881 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:20:57.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:20:57 gibba045 bash[25517]: cephadm 2021-03-10T15:20:56.302028+0000 mgr.gibba045.orlgmj (mgr.34412) 4882 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:20:57.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:20:57 gibba045 bash[25517]: cephadm 2021-03-10T15:20:56.302070+0000 mgr.gibba045.orlgmj (mgr.34412) 4883 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:20:57.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:20:57 gibba045 bash[25517]: cephadm 2021-03-10T15:20:56.304481+0000 mgr.gibba045.orlgmj (mgr.34412) 4884 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:20:57.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:20:57 gibba045 bash[25517]: cephadm 2021-03-10T15:20:56.304524+0000 mgr.gibba045.orlgmj (mgr.34412) 4885 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:20:57.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:20:57 gibba045 bash[25517]: cephadm 2021-03-10T15:20:56.306812+0000 mgr.gibba045.orlgmj (mgr.34412) 4886 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:20:57.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:20:57 gibba045 bash[25517]: cephadm 2021-03-10T15:20:56.310616+0000 mgr.gibba045.orlgmj (mgr.34412) 4887 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:20:57.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:20:57 gibba045 bash[25517]: cephadm 2021-03-10T15:20:56.310655+0000 mgr.gibba045.orlgmj (mgr.34412) 4888 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:20:57.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:20:57 gibba045 bash[25517]: cephadm 2021-03-10T15:20:56.313537+0000 mgr.gibba045.orlgmj (mgr.34412) 4889 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:20:57.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:20:57 gibba045 bash[25517]: cephadm 2021-03-10T15:20:56.314021+0000 mgr.gibba045.orlgmj (mgr.34412) 4890 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:20:57.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:20:57 gibba045 bash[25517]: cephadm 2021-03-10T15:20:56.316805+0000 mgr.gibba045.orlgmj (mgr.34412) 4891 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:20:57.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:20:57 gibba045 bash[25517]: cephadm 2021-03-10T15:20:56.316850+0000 mgr.gibba045.orlgmj (mgr.34412) 4892 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:20:57.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:20:57 gibba045 bash[25517]: cephadm 2021-03-10T15:20:56.316982+0000 mgr.gibba045.orlgmj (mgr.34412) 4893 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:20:57.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:20:57 gibba015 bash[29377]: cephadm 2021-03-10T15:20:56.067173+0000 mgr.gibba045.orlgmj (mgr.34412) 4878 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:20:57.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:20:57 gibba015 bash[29377]: cephadm 2021-03-10T15:20:56.069150+0000 mgr.gibba045.orlgmj (mgr.34412) 4879 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:20:57.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:20:57 gibba015 bash[29377]: cephadm 2021-03-10T15:20:56.296691+0000 mgr.gibba045.orlgmj (mgr.34412) 4880 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:20:57.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:20:57 gibba015 bash[29377]: cephadm 2021-03-10T15:20:56.299625+0000 mgr.gibba045.orlgmj (mgr.34412) 4881 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:20:57.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:20:57 gibba015 bash[29377]: cephadm 2021-03-10T15:20:56.302028+0000 mgr.gibba045.orlgmj (mgr.34412) 4882 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:20:57.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:20:57 gibba015 bash[29377]: cephadm 2021-03-10T15:20:56.302070+0000 mgr.gibba045.orlgmj (mgr.34412) 4883 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:20:57.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:20:57 gibba015 bash[29377]: cephadm 2021-03-10T15:20:56.304481+0000 mgr.gibba045.orlgmj (mgr.34412) 4884 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:20:57.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:20:57 gibba015 bash[29377]: cephadm 2021-03-10T15:20:56.304524+0000 mgr.gibba045.orlgmj (mgr.34412) 4885 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:20:57.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:20:57 gibba015 bash[29377]: cephadm 2021-03-10T15:20:56.306812+0000 mgr.gibba045.orlgmj (mgr.34412) 4886 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:20:57.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:20:57 gibba015 bash[29377]: cephadm 2021-03-10T15:20:56.310616+0000 mgr.gibba045.orlgmj (mgr.34412) 4887 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:20:57.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:20:57 gibba015 bash[29377]: cephadm 2021-03-10T15:20:56.310655+0000 mgr.gibba045.orlgmj (mgr.34412) 4888 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:20:57.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:20:57 gibba015 bash[29377]: cephadm 2021-03-10T15:20:56.313537+0000 mgr.gibba045.orlgmj (mgr.34412) 4889 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:20:57.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:20:57 gibba015 bash[29377]: cephadm 2021-03-10T15:20:56.314021+0000 mgr.gibba045.orlgmj (mgr.34412) 4890 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:20:57.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:20:57 gibba015 bash[29377]: cephadm 2021-03-10T15:20:56.316805+0000 mgr.gibba045.orlgmj (mgr.34412) 4891 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:20:57.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:20:57 gibba015 bash[29377]: cephadm 2021-03-10T15:20:56.316850+0000 mgr.gibba045.orlgmj (mgr.34412) 4892 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:20:57.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:20:57 gibba015 bash[29377]: cephadm 2021-03-10T15:20:56.316982+0000 mgr.gibba045.orlgmj (mgr.34412) 4893 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:20:57.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:20:57 gibba015 bash[30343]: cephadm 2021-03-10T15:20:56.067173+0000 mgr.gibba045.orlgmj (mgr.34412) 4878 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:20:57.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:20:57 gibba015 bash[30343]: cephadm 2021-03-10T15:20:56.069150+0000 mgr.gibba045.orlgmj (mgr.34412) 4879 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:20:57.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:20:57 gibba015 bash[30343]: cephadm 2021-03-10T15:20:56.296691+0000 mgr.gibba045.orlgmj (mgr.34412) 4880 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:20:57.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:20:57 gibba015 bash[30343]: cephadm 2021-03-10T15:20:56.299625+0000 mgr.gibba045.orlgmj (mgr.34412) 4881 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:20:57.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:20:57 gibba015 bash[30343]: cephadm 2021-03-10T15:20:56.302028+0000 mgr.gibba045.orlgmj (mgr.34412) 4882 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:20:57.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:20:57 gibba015 bash[30343]: cephadm 2021-03-10T15:20:56.302070+0000 mgr.gibba045.orlgmj (mgr.34412) 4883 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:20:57.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:20:57 gibba015 bash[30343]: cephadm 2021-03-10T15:20:56.304481+0000 mgr.gibba045.orlgmj (mgr.34412) 4884 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:20:57.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:20:57 gibba015 bash[30343]: cephadm 2021-03-10T15:20:56.304524+0000 mgr.gibba045.orlgmj (mgr.34412) 4885 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:20:57.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:20:57 gibba015 bash[30343]: cephadm 2021-03-10T15:20:56.306812+0000 mgr.gibba045.orlgmj (mgr.34412) 4886 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:20:57.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:20:57 gibba015 bash[30343]: cephadm 2021-03-10T15:20:56.310616+0000 mgr.gibba045.orlgmj (mgr.34412) 4887 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:20:57.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:20:57 gibba015 bash[30343]: cephadm 2021-03-10T15:20:56.310655+0000 mgr.gibba045.orlgmj (mgr.34412) 4888 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:20:57.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:20:57 gibba015 bash[30343]: cephadm 2021-03-10T15:20:56.313537+0000 mgr.gibba045.orlgmj (mgr.34412) 4889 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:20:57.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:20:57 gibba015 bash[30343]: cephadm 2021-03-10T15:20:56.314021+0000 mgr.gibba045.orlgmj (mgr.34412) 4890 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:20:57.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:20:57 gibba015 bash[30343]: cephadm 2021-03-10T15:20:56.316805+0000 mgr.gibba045.orlgmj (mgr.34412) 4891 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:20:57.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:20:57 gibba015 bash[30343]: cephadm 2021-03-10T15:20:56.316850+0000 mgr.gibba045.orlgmj (mgr.34412) 4892 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:20:57.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:20:57 gibba015 bash[30343]: cephadm 2021-03-10T15:20:56.316982+0000 mgr.gibba045.orlgmj (mgr.34412) 4893 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:20:58.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:20:58 gibba015 bash[30343]: cluster 2021-03-10T15:20:56.934288+0000 mgr.gibba045.orlgmj (mgr.34412) 4894 : cluster [DBG] pgmap v2775: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:58.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:20:58 gibba015 bash[29377]: cluster 2021-03-10T15:20:56.934288+0000 mgr.gibba045.orlgmj (mgr.34412) 4894 : cluster [DBG] pgmap v2775: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:59.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:20:58 gibba045 bash[25517]: cluster 2021-03-10T15:20:56.934288+0000 mgr.gibba045.orlgmj (mgr.34412) 4894 : cluster [DBG] pgmap v2775: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:00.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:21:00 gibba015 bash[29377]: cluster 2021-03-10T15:20:58.935519+0000 mgr.gibba045.orlgmj (mgr.34412) 4895 : cluster [DBG] pgmap v2776: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:00.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:21:00 gibba015 bash[30343]: cluster 2021-03-10T15:20:58.935519+0000 mgr.gibba045.orlgmj (mgr.34412) 4895 : cluster [DBG] pgmap v2776: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:01.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:21:00 gibba045 bash[25517]: cluster 2021-03-10T15:20:58.935519+0000 mgr.gibba045.orlgmj (mgr.34412) 4895 : cluster [DBG] pgmap v2776: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:02.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:21:02 gibba015 bash[29377]: cluster 2021-03-10T15:21:00.937179+0000 mgr.gibba045.orlgmj (mgr.34412) 4896 : cluster [DBG] pgmap v2777: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:02.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:21:02 gibba015 bash[30343]: cluster 2021-03-10T15:21:00.937179+0000 mgr.gibba045.orlgmj (mgr.34412) 4896 : cluster [DBG] pgmap v2777: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:03.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:21:02 gibba045 bash[25517]: cluster 2021-03-10T15:21:00.937179+0000 mgr.gibba045.orlgmj (mgr.34412) 4896 : cluster [DBG] pgmap v2777: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:04.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:21:04 gibba015 bash[29377]: cluster 2021-03-10T15:21:02.938287+0000 mgr.gibba045.orlgmj (mgr.34412) 4897 : cluster [DBG] pgmap v2778: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:04.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:21:04 gibba015 bash[30343]: cluster 2021-03-10T15:21:02.938287+0000 mgr.gibba045.orlgmj (mgr.34412) 4897 : cluster [DBG] pgmap v2778: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:05.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:21:04 gibba045 bash[25517]: cluster 2021-03-10T15:21:02.938287+0000 mgr.gibba045.orlgmj (mgr.34412) 4897 : cluster [DBG] pgmap v2778: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:06.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:21:06 gibba015 bash[29377]: cluster 2021-03-10T15:21:04.939824+0000 mgr.gibba045.orlgmj (mgr.34412) 4898 : cluster [DBG] pgmap v2779: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:06.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:21:06 gibba015 bash[30343]: cluster 2021-03-10T15:21:04.939824+0000 mgr.gibba045.orlgmj (mgr.34412) 4898 : cluster [DBG] pgmap v2779: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:07.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:21:06 gibba045 bash[25517]: cluster 2021-03-10T15:21:04.939824+0000 mgr.gibba045.orlgmj (mgr.34412) 4898 : cluster [DBG] pgmap v2779: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:08.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:21:08 gibba015 bash[29377]: cluster 2021-03-10T15:21:06.941524+0000 mgr.gibba045.orlgmj (mgr.34412) 4899 : cluster [DBG] pgmap v2780: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:08.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:21:08 gibba015 bash[30343]: cluster 2021-03-10T15:21:06.941524+0000 mgr.gibba045.orlgmj (mgr.34412) 4899 : cluster [DBG] pgmap v2780: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:09.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:21:08 gibba045 bash[25517]: cluster 2021-03-10T15:21:06.941524+0000 mgr.gibba045.orlgmj (mgr.34412) 4899 : cluster [DBG] pgmap v2780: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:10.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:21:10 gibba015 bash[29377]: cluster 2021-03-10T15:21:08.942738+0000 mgr.gibba045.orlgmj (mgr.34412) 4900 : cluster [DBG] pgmap v2781: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:10.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:21:10 gibba015 bash[30343]: cluster 2021-03-10T15:21:08.942738+0000 mgr.gibba045.orlgmj (mgr.34412) 4900 : cluster [DBG] pgmap v2781: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:11.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:21:10 gibba045 bash[25517]: cluster 2021-03-10T15:21:08.942738+0000 mgr.gibba045.orlgmj (mgr.34412) 4900 : cluster [DBG] pgmap v2781: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:12.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:21:12 gibba015 bash[29377]: cluster 2021-03-10T15:21:10.943941+0000 mgr.gibba045.orlgmj (mgr.34412) 4901 : cluster [DBG] pgmap v2782: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:12.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:21:12 gibba015 bash[29377]: cephadm 2021-03-10T15:21:11.333095+0000 mgr.gibba045.orlgmj (mgr.34412) 4902 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:21:12.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:21:12 gibba015 bash[30343]: cluster 2021-03-10T15:21:10.943941+0000 mgr.gibba045.orlgmj (mgr.34412) 4901 : cluster [DBG] pgmap v2782: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:12.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:21:12 gibba015 bash[30343]: cephadm 2021-03-10T15:21:11.333095+0000 mgr.gibba045.orlgmj (mgr.34412) 4902 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:21:13.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:21:12 gibba045 bash[25517]: cluster 2021-03-10T15:21:10.943941+0000 mgr.gibba045.orlgmj (mgr.34412) 4901 : cluster [DBG] pgmap v2782: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:13.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:21:12 gibba045 bash[25517]: cephadm 2021-03-10T15:21:11.333095+0000 mgr.gibba045.orlgmj (mgr.34412) 4902 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:21:14.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:21:14 gibba015 bash[29377]: cluster 2021-03-10T15:21:12.945574+0000 mgr.gibba045.orlgmj (mgr.34412) 4903 : cluster [DBG] pgmap v2783: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:14.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:21:14 gibba015 bash[30343]: cluster 2021-03-10T15:21:12.945574+0000 mgr.gibba045.orlgmj (mgr.34412) 4903 : cluster [DBG] pgmap v2783: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:15.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:21:14 gibba045 bash[25517]: cluster 2021-03-10T15:21:12.945574+0000 mgr.gibba045.orlgmj (mgr.34412) 4903 : cluster [DBG] pgmap v2783: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:16.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:21:16 gibba015 bash[29377]: cluster 2021-03-10T15:21:14.947027+0000 mgr.gibba045.orlgmj (mgr.34412) 4904 : cluster [DBG] pgmap v2784: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:16.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:21:16 gibba015 bash[30343]: cluster 2021-03-10T15:21:14.947027+0000 mgr.gibba045.orlgmj (mgr.34412) 4904 : cluster [DBG] pgmap v2784: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:17.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:21:16 gibba045 bash[25517]: cluster 2021-03-10T15:21:14.947027+0000 mgr.gibba045.orlgmj (mgr.34412) 4904 : cluster [DBG] pgmap v2784: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:18.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:21:18 gibba015 bash[29377]: cluster 2021-03-10T15:21:16.948822+0000 mgr.gibba045.orlgmj (mgr.34412) 4905 : cluster [DBG] pgmap v2785: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:18.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:21:18 gibba015 bash[30343]: cluster 2021-03-10T15:21:16.948822+0000 mgr.gibba045.orlgmj (mgr.34412) 4905 : cluster [DBG] pgmap v2785: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:19.002 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:21:19.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:21:18 gibba045 bash[25517]: cluster 2021-03-10T15:21:16.948822+0000 mgr.gibba045.orlgmj (mgr.34412) 4905 : cluster [DBG] pgmap v2785: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:19.257 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:21:19.257 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (92m) 6m ago 97m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:21:19.257 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (97m) 5m ago 97m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:21:19.257 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (92m) 5m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:21:19.258 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (92m) 5m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:21:19.258 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (91m) 6m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:21:19.258 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (91m) 6m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:21:19.258 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (91m) 5m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:21:19.259 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (91m) 6m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:21:19.259 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (97m) 6m ago 97m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:21:19.259 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (97m) 5m ago 97m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:21:19.259 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (90m) 6m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:21:19.259 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (89m) 6m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:21:19.260 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (89m) 6m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:21:19.260 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (89m) 6m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:21:19.260 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (88m) 5m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:21:19.260 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (88m) 5m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:21:19.260 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (87m) 5m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:21:19.261 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (87m) 5m ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:21:19.261 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (96m) 5m ago 97m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:21:19.261 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 5m ago 95m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:21:19.505 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:21:19.505 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:21:19.505 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:21:19.506 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:21:19.506 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:21:19.506 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:21:19.506 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:21:19.506 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:21:19.507 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:21:19.507 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:21:19.507 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:21:19.507 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:21:19.508 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:21:19.508 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:21:19.508 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:21:20.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:21:20 gibba015 bash[29377]: cluster 2021-03-10T15:21:18.950045+0000 mgr.gibba045.orlgmj (mgr.34412) 4906 : cluster [DBG] pgmap v2786: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:20.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:21:20 gibba015 bash[29377]: audit 2021-03-10T15:21:18.994084+0000 mgr.gibba045.orlgmj (mgr.34412) 4907 : audit [DBG] from='client.47346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:21:20.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:21:20 gibba015 bash[29377]: audit 2021-03-10T15:21:19.216040+0000 mgr.gibba045.orlgmj (mgr.34412) 4908 : audit [DBG] from='client.57340 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:21:20.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:21:20 gibba015 bash[29377]: audit 2021-03-10T15:21:19.500642+0000 mon.c (mon.1) 1392 : audit [DBG] from='client.? 172.21.2.115:0/757491480' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:21:20.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:21:20 gibba015 bash[30343]: cluster 2021-03-10T15:21:18.950045+0000 mgr.gibba045.orlgmj (mgr.34412) 4906 : cluster [DBG] pgmap v2786: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:20.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:21:20 gibba015 bash[30343]: audit 2021-03-10T15:21:18.994084+0000 mgr.gibba045.orlgmj (mgr.34412) 4907 : audit [DBG] from='client.47346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:21:20.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:21:20 gibba015 bash[30343]: audit 2021-03-10T15:21:19.216040+0000 mgr.gibba045.orlgmj (mgr.34412) 4908 : audit [DBG] from='client.57340 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:21:20.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:21:20 gibba015 bash[30343]: audit 2021-03-10T15:21:19.500642+0000 mon.c (mon.1) 1392 : audit [DBG] from='client.? 172.21.2.115:0/757491480' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:21:20.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:21:20 gibba045 bash[25517]: cluster 2021-03-10T15:21:18.950045+0000 mgr.gibba045.orlgmj (mgr.34412) 4906 : cluster [DBG] pgmap v2786: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:20.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:21:20 gibba045 bash[25517]: audit 2021-03-10T15:21:18.994084+0000 mgr.gibba045.orlgmj (mgr.34412) 4907 : audit [DBG] from='client.47346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:21:20.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:21:20 gibba045 bash[25517]: audit 2021-03-10T15:21:19.216040+0000 mgr.gibba045.orlgmj (mgr.34412) 4908 : audit [DBG] from='client.57340 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:21:20.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:21:20 gibba045 bash[25517]: audit 2021-03-10T15:21:19.500642+0000 mon.c (mon.1) 1392 : audit [DBG] from='client.? 172.21.2.115:0/757491480' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:21:22.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:21:22 gibba015 bash[29377]: cluster 2021-03-10T15:21:20.951674+0000 mgr.gibba045.orlgmj (mgr.34412) 4909 : cluster [DBG] pgmap v2787: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:22.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:21:22 gibba015 bash[30343]: cluster 2021-03-10T15:21:20.951674+0000 mgr.gibba045.orlgmj (mgr.34412) 4909 : cluster [DBG] pgmap v2787: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:22.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:21:22 gibba045 bash[25517]: cluster 2021-03-10T15:21:20.951674+0000 mgr.gibba045.orlgmj (mgr.34412) 4909 : cluster [DBG] pgmap v2787: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:24.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:21:24 gibba015 bash[29377]: cluster 2021-03-10T15:21:22.953306+0000 mgr.gibba045.orlgmj (mgr.34412) 4910 : cluster [DBG] pgmap v2788: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:24.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:21:24 gibba015 bash[30343]: cluster 2021-03-10T15:21:22.953306+0000 mgr.gibba045.orlgmj (mgr.34412) 4910 : cluster [DBG] pgmap v2788: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:24.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:21:24 gibba045 bash[25517]: cluster 2021-03-10T15:21:22.953306+0000 mgr.gibba045.orlgmj (mgr.34412) 4910 : cluster [DBG] pgmap v2788: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:26.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:21:26 gibba015 bash[29377]: cluster 2021-03-10T15:21:24.954964+0000 mgr.gibba045.orlgmj (mgr.34412) 4911 : cluster [DBG] pgmap v2789: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:26.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:21:26 gibba015 bash[30343]: cluster 2021-03-10T15:21:24.954964+0000 mgr.gibba045.orlgmj (mgr.34412) 4911 : cluster [DBG] pgmap v2789: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:26.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:21:26 gibba045 bash[25517]: cluster 2021-03-10T15:21:24.954964+0000 mgr.gibba045.orlgmj (mgr.34412) 4911 : cluster [DBG] pgmap v2789: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:27.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:21:27 gibba015 bash[29377]: cephadm 2021-03-10T15:21:26.348932+0000 mgr.gibba045.orlgmj (mgr.34412) 4912 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:21:27.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:21:27 gibba015 bash[30343]: cephadm 2021-03-10T15:21:26.348932+0000 mgr.gibba045.orlgmj (mgr.34412) 4912 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:21:27.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:21:27 gibba045 bash[25517]: cephadm 2021-03-10T15:21:26.348932+0000 mgr.gibba045.orlgmj (mgr.34412) 4912 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:21:28.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:21:28 gibba015 bash[29377]: cluster 2021-03-10T15:21:26.956765+0000 mgr.gibba045.orlgmj (mgr.34412) 4913 : cluster [DBG] pgmap v2790: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:28.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:21:28 gibba015 bash[30343]: cluster 2021-03-10T15:21:26.956765+0000 mgr.gibba045.orlgmj (mgr.34412) 4913 : cluster [DBG] pgmap v2790: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:28.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:21:28 gibba045 bash[25517]: cluster 2021-03-10T15:21:26.956765+0000 mgr.gibba045.orlgmj (mgr.34412) 4913 : cluster [DBG] pgmap v2790: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:30.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:21:30 gibba015 bash[29377]: cluster 2021-03-10T15:21:28.958016+0000 mgr.gibba045.orlgmj (mgr.34412) 4914 : cluster [DBG] pgmap v2791: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:30.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:21:30 gibba015 bash[30343]: cluster 2021-03-10T15:21:28.958016+0000 mgr.gibba045.orlgmj (mgr.34412) 4914 : cluster [DBG] pgmap v2791: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:30.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:21:30 gibba045 bash[25517]: cluster 2021-03-10T15:21:28.958016+0000 mgr.gibba045.orlgmj (mgr.34412) 4914 : cluster [DBG] pgmap v2791: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:32.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:21:32 gibba015 bash[29377]: cluster 2021-03-10T15:21:30.959808+0000 mgr.gibba045.orlgmj (mgr.34412) 4915 : cluster [DBG] pgmap v2792: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:32.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:21:32 gibba015 bash[30343]: cluster 2021-03-10T15:21:30.959808+0000 mgr.gibba045.orlgmj (mgr.34412) 4915 : cluster [DBG] pgmap v2792: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:32.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:21:32 gibba045 bash[25517]: cluster 2021-03-10T15:21:30.959808+0000 mgr.gibba045.orlgmj (mgr.34412) 4915 : cluster [DBG] pgmap v2792: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:34.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:21:34 gibba015 bash[29377]: cluster 2021-03-10T15:21:32.961521+0000 mgr.gibba045.orlgmj (mgr.34412) 4916 : cluster [DBG] pgmap v2793: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:34.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:21:34 gibba015 bash[30343]: cluster 2021-03-10T15:21:32.961521+0000 mgr.gibba045.orlgmj (mgr.34412) 4916 : cluster [DBG] pgmap v2793: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:34.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:21:34 gibba045 bash[25517]: cluster 2021-03-10T15:21:32.961521+0000 mgr.gibba045.orlgmj (mgr.34412) 4916 : cluster [DBG] pgmap v2793: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:36.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:21:36 gibba015 bash[29377]: cluster 2021-03-10T15:21:34.962927+0000 mgr.gibba045.orlgmj (mgr.34412) 4917 : cluster [DBG] pgmap v2794: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:36.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:21:36 gibba015 bash[30343]: cluster 2021-03-10T15:21:34.962927+0000 mgr.gibba045.orlgmj (mgr.34412) 4917 : cluster [DBG] pgmap v2794: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:36.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:21:36 gibba045 bash[25517]: cluster 2021-03-10T15:21:34.962927+0000 mgr.gibba045.orlgmj (mgr.34412) 4917 : cluster [DBG] pgmap v2794: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:38.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:21:38 gibba015 bash[29377]: cluster 2021-03-10T15:21:36.964776+0000 mgr.gibba045.orlgmj (mgr.34412) 4918 : cluster [DBG] pgmap v2795: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:38.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:21:38 gibba015 bash[30343]: cluster 2021-03-10T15:21:36.964776+0000 mgr.gibba045.orlgmj (mgr.34412) 4918 : cluster [DBG] pgmap v2795: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:38.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:21:38 gibba045 bash[25517]: cluster 2021-03-10T15:21:36.964776+0000 mgr.gibba045.orlgmj (mgr.34412) 4918 : cluster [DBG] pgmap v2795: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:40.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:21:40 gibba015 bash[29377]: cluster 2021-03-10T15:21:38.966004+0000 mgr.gibba045.orlgmj (mgr.34412) 4919 : cluster [DBG] pgmap v2796: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:40.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:21:40 gibba015 bash[30343]: cluster 2021-03-10T15:21:38.966004+0000 mgr.gibba045.orlgmj (mgr.34412) 4919 : cluster [DBG] pgmap v2796: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:40.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:21:40 gibba045 bash[25517]: cluster 2021-03-10T15:21:38.966004+0000 mgr.gibba045.orlgmj (mgr.34412) 4919 : cluster [DBG] pgmap v2796: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:42.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:21:42 gibba015 bash[29377]: cluster 2021-03-10T15:21:40.967639+0000 mgr.gibba045.orlgmj (mgr.34412) 4920 : cluster [DBG] pgmap v2797: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:42.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:21:42 gibba015 bash[29377]: cephadm 2021-03-10T15:21:41.365045+0000 mgr.gibba045.orlgmj (mgr.34412) 4921 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:21:42.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:21:42 gibba015 bash[30343]: cluster 2021-03-10T15:21:40.967639+0000 mgr.gibba045.orlgmj (mgr.34412) 4920 : cluster [DBG] pgmap v2797: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:42.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:21:42 gibba015 bash[30343]: cephadm 2021-03-10T15:21:41.365045+0000 mgr.gibba045.orlgmj (mgr.34412) 4921 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:21:42.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:21:42 gibba045 bash[25517]: cluster 2021-03-10T15:21:40.967639+0000 mgr.gibba045.orlgmj (mgr.34412) 4920 : cluster [DBG] pgmap v2797: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:42.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:21:42 gibba045 bash[25517]: cephadm 2021-03-10T15:21:41.365045+0000 mgr.gibba045.orlgmj (mgr.34412) 4921 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:21:44.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:21:44 gibba045 bash[25517]: cluster 2021-03-10T15:21:42.969314+0000 mgr.gibba045.orlgmj (mgr.34412) 4922 : cluster [DBG] pgmap v2798: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:44.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:21:44 gibba015 bash[29377]: cluster 2021-03-10T15:21:42.969314+0000 mgr.gibba045.orlgmj (mgr.34412) 4922 : cluster [DBG] pgmap v2798: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:44.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:21:44 gibba015 bash[30343]: cluster 2021-03-10T15:21:42.969314+0000 mgr.gibba045.orlgmj (mgr.34412) 4922 : cluster [DBG] pgmap v2798: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:46.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:21:46 gibba045 bash[25517]: cluster 2021-03-10T15:21:44.970842+0000 mgr.gibba045.orlgmj (mgr.34412) 4923 : cluster [DBG] pgmap v2799: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:46.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:21:46 gibba015 bash[29377]: cluster 2021-03-10T15:21:44.970842+0000 mgr.gibba045.orlgmj (mgr.34412) 4923 : cluster [DBG] pgmap v2799: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:46.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:21:46 gibba015 bash[30343]: cluster 2021-03-10T15:21:44.970842+0000 mgr.gibba045.orlgmj (mgr.34412) 4923 : cluster [DBG] pgmap v2799: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:48.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:21:48 gibba045 bash[25517]: cluster 2021-03-10T15:21:46.972637+0000 mgr.gibba045.orlgmj (mgr.34412) 4924 : cluster [DBG] pgmap v2800: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:48.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:21:48 gibba015 bash[29377]: cluster 2021-03-10T15:21:46.972637+0000 mgr.gibba045.orlgmj (mgr.34412) 4924 : cluster [DBG] pgmap v2800: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:48.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:21:48 gibba015 bash[30343]: cluster 2021-03-10T15:21:46.972637+0000 mgr.gibba045.orlgmj (mgr.34412) 4924 : cluster [DBG] pgmap v2800: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:49.754 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:21:49.982 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:21:49.983 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (92m) 7m ago 97m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:21:49.983 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (97m) 6m ago 97m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:21:49.983 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (92m) 6m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:21:49.984 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (93m) 6m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:21:49.984 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (92m) 7m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:21:49.984 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (92m) 7m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:21:49.984 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (91m) 6m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:21:49.985 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (91m) 7m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:21:49.985 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (98m) 7m ago 98m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:21:49.985 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (98m) 6m ago 98m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:21:49.985 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (90m) 7m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:21:49.986 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (90m) 7m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:21:49.986 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (89m) 7m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:21:49.986 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (89m) 7m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:21:49.986 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (89m) 6m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:21:49.987 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (88m) 6m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:21:49.987 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (88m) 6m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:21:49.987 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (87m) 6m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:21:49.988 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (97m) 6m ago 98m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:21:49.988 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 6m ago 96m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:21:50.231 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:21:50.231 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:21:50.231 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:21:50.232 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:21:50.232 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:21:50.232 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:21:50.232 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:21:50.232 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:21:50.233 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:21:50.233 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:21:50.233 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:21:50.233 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:21:50.234 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:21:50.234 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:21:50.234 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:21:50.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:21:50 gibba045 bash[25517]: cluster 2021-03-10T15:21:48.973851+0000 mgr.gibba045.orlgmj (mgr.34412) 4925 : cluster [DBG] pgmap v2801: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:50.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:21:50 gibba045 bash[25517]: audit 2021-03-10T15:21:49.745180+0000 mgr.gibba045.orlgmj (mgr.34412) 4926 : audit [DBG] from='client.57352 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:21:50.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:21:50 gibba045 bash[25517]: audit 2021-03-10T15:21:50.226678+0000 mon.a (mon.0) 1324 : audit [DBG] from='client.? 172.21.2.115:0/711705616' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:21:50.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:21:50 gibba015 bash[29377]: cluster 2021-03-10T15:21:48.973851+0000 mgr.gibba045.orlgmj (mgr.34412) 4925 : cluster [DBG] pgmap v2801: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:50.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:21:50 gibba015 bash[29377]: audit 2021-03-10T15:21:49.745180+0000 mgr.gibba045.orlgmj (mgr.34412) 4926 : audit [DBG] from='client.57352 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:21:50.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:21:50 gibba015 bash[29377]: audit 2021-03-10T15:21:50.226678+0000 mon.a (mon.0) 1324 : audit [DBG] from='client.? 172.21.2.115:0/711705616' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:21:50.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:21:50 gibba015 bash[30343]: cluster 2021-03-10T15:21:48.973851+0000 mgr.gibba045.orlgmj (mgr.34412) 4925 : cluster [DBG] pgmap v2801: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:50.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:21:50 gibba015 bash[30343]: audit 2021-03-10T15:21:49.745180+0000 mgr.gibba045.orlgmj (mgr.34412) 4926 : audit [DBG] from='client.57352 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:21:50.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:21:50 gibba015 bash[30343]: audit 2021-03-10T15:21:50.226678+0000 mon.a (mon.0) 1324 : audit [DBG] from='client.? 172.21.2.115:0/711705616' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:21:51.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:21:51 gibba045 bash[25517]: audit 2021-03-10T15:21:49.970796+0000 mgr.gibba045.orlgmj (mgr.34412) 4927 : audit [DBG] from='client.47370 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:21:51.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:21:51 gibba015 bash[29377]: audit 2021-03-10T15:21:49.970796+0000 mgr.gibba045.orlgmj (mgr.34412) 4927 : audit [DBG] from='client.47370 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:21:51.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:21:51 gibba015 bash[30343]: audit 2021-03-10T15:21:49.970796+0000 mgr.gibba045.orlgmj (mgr.34412) 4927 : audit [DBG] from='client.47370 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:21:52.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:21:52 gibba045 bash[25517]: cluster 2021-03-10T15:21:50.975471+0000 mgr.gibba045.orlgmj (mgr.34412) 4928 : cluster [DBG] pgmap v2802: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:52.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:21:52 gibba015 bash[29377]: cluster 2021-03-10T15:21:50.975471+0000 mgr.gibba045.orlgmj (mgr.34412) 4928 : cluster [DBG] pgmap v2802: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:52.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:21:52 gibba015 bash[30343]: cluster 2021-03-10T15:21:50.975471+0000 mgr.gibba045.orlgmj (mgr.34412) 4928 : cluster [DBG] pgmap v2802: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:53.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:21:53 gibba045 bash[25517]: audit 2021-03-10T15:21:53.087348+0000 mon.c (mon.1) 1393 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:21:53.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:21:53 gibba045 bash[25517]: audit 2021-03-10T15:21:53.087969+0000 mon.c (mon.1) 1394 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:21:53.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:21:53 gibba045 bash[25517]: audit 2021-03-10T15:21:53.088489+0000 mon.a (mon.0) 1325 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:21:53.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:21:53 gibba045 bash[25517]: audit 2021-03-10T15:21:53.088606+0000 mon.c (mon.1) 1395 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:21:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:21:53 gibba045 bash[25517]: audit 2021-03-10T15:21:53.089471+0000 mon.c (mon.1) 1396 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:21:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:21:53 gibba045 bash[25517]: audit 2021-03-10T15:21:53.089645+0000 mon.a (mon.0) 1326 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:21:53.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:21:53 gibba045 bash[25517]: audit 2021-03-10T15:21:53.090174+0000 mon.c (mon.1) 1397 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:21:53.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:21:53 gibba045 bash[25517]: audit 2021-03-10T15:21:53.090739+0000 mon.a (mon.0) 1327 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:21:53.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:21:53 gibba045 bash[25517]: audit 2021-03-10T15:21:53.090969+0000 mon.c (mon.1) 1398 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T15:21:53.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:21:53 gibba045 bash[25517]: audit 2021-03-10T15:21:53.091669+0000 mon.a (mon.0) 1328 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:21:53.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:21:53 gibba045 bash[25517]: audit 2021-03-10T15:21:53.092655+0000 mon.a (mon.0) 1329 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:21:53.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:21:53 gibba045 bash[25517]: audit 2021-03-10T15:21:53.093560+0000 mon.a (mon.0) 1330 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T15:21:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:21:53 gibba015 bash[29377]: audit 2021-03-10T15:21:53.087348+0000 mon.c (mon.1) 1393 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:21:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:21:53 gibba015 bash[29377]: audit 2021-03-10T15:21:53.087969+0000 mon.c (mon.1) 1394 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:21:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:21:53 gibba015 bash[29377]: audit 2021-03-10T15:21:53.088489+0000 mon.a (mon.0) 1325 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:21:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:21:53 gibba015 bash[29377]: audit 2021-03-10T15:21:53.088606+0000 mon.c (mon.1) 1395 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:21:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:21:53 gibba015 bash[29377]: audit 2021-03-10T15:21:53.089471+0000 mon.c (mon.1) 1396 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:21:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:21:53 gibba015 bash[29377]: audit 2021-03-10T15:21:53.089645+0000 mon.a (mon.0) 1326 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:21:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:21:53 gibba015 bash[29377]: audit 2021-03-10T15:21:53.090174+0000 mon.c (mon.1) 1397 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:21:53.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:21:53 gibba015 bash[29377]: audit 2021-03-10T15:21:53.090739+0000 mon.a (mon.0) 1327 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:21:53.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:21:53 gibba015 bash[29377]: audit 2021-03-10T15:21:53.090969+0000 mon.c (mon.1) 1398 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T15:21:53.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:21:53 gibba015 bash[29377]: audit 2021-03-10T15:21:53.091669+0000 mon.a (mon.0) 1328 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:21:53.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:21:53 gibba015 bash[29377]: audit 2021-03-10T15:21:53.092655+0000 mon.a (mon.0) 1329 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:21:53.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:21:53 gibba015 bash[29377]: audit 2021-03-10T15:21:53.093560+0000 mon.a (mon.0) 1330 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T15:21:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:21:53 gibba015 bash[30343]: audit 2021-03-10T15:21:53.087348+0000 mon.c (mon.1) 1393 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:21:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:21:53 gibba015 bash[30343]: audit 2021-03-10T15:21:53.087969+0000 mon.c (mon.1) 1394 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:21:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:21:53 gibba015 bash[30343]: audit 2021-03-10T15:21:53.088489+0000 mon.a (mon.0) 1325 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:21:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:21:53 gibba015 bash[30343]: audit 2021-03-10T15:21:53.088606+0000 mon.c (mon.1) 1395 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:21:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:21:53 gibba015 bash[30343]: audit 2021-03-10T15:21:53.089471+0000 mon.c (mon.1) 1396 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:21:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:21:53 gibba015 bash[30343]: audit 2021-03-10T15:21:53.089645+0000 mon.a (mon.0) 1326 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:21:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:21:53 gibba015 bash[30343]: audit 2021-03-10T15:21:53.090174+0000 mon.c (mon.1) 1397 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:21:53.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:21:53 gibba015 bash[30343]: audit 2021-03-10T15:21:53.090739+0000 mon.a (mon.0) 1327 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:21:53.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:21:53 gibba015 bash[30343]: audit 2021-03-10T15:21:53.090969+0000 mon.c (mon.1) 1398 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T15:21:53.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:21:53 gibba015 bash[30343]: audit 2021-03-10T15:21:53.091669+0000 mon.a (mon.0) 1328 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:21:53.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:21:53 gibba015 bash[30343]: audit 2021-03-10T15:21:53.092655+0000 mon.a (mon.0) 1329 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:21:53.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:21:53 gibba015 bash[30343]: audit 2021-03-10T15:21:53.093560+0000 mon.a (mon.0) 1330 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T15:21:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:21:54 gibba045 bash[25517]: cluster 2021-03-10T15:21:52.977056+0000 mgr.gibba045.orlgmj (mgr.34412) 4929 : cluster [DBG] pgmap v2803: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:54.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:21:54 gibba015 bash[29377]: cluster 2021-03-10T15:21:52.977056+0000 mgr.gibba045.orlgmj (mgr.34412) 4929 : cluster [DBG] pgmap v2803: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:54.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:21:54 gibba015 bash[30343]: cluster 2021-03-10T15:21:52.977056+0000 mgr.gibba045.orlgmj (mgr.34412) 4929 : cluster [DBG] pgmap v2803: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:56.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:21:56 gibba045 bash[25517]: cluster 2021-03-10T15:21:54.978718+0000 mgr.gibba045.orlgmj (mgr.34412) 4930 : cluster [DBG] pgmap v2804: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:56.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:21:56 gibba015 bash[29377]: cluster 2021-03-10T15:21:54.978718+0000 mgr.gibba045.orlgmj (mgr.34412) 4930 : cluster [DBG] pgmap v2804: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:56.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:21:56 gibba015 bash[30343]: cluster 2021-03-10T15:21:54.978718+0000 mgr.gibba045.orlgmj (mgr.34412) 4930 : cluster [DBG] pgmap v2804: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:57.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:21:57 gibba045 bash[25517]: audit 2021-03-10T15:21:56.377451+0000 mon.c (mon.1) 1399 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:21:57.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:21:57 gibba045 bash[25517]: audit 2021-03-10T15:21:56.584499+0000 mon.a (mon.0) 1331 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:21:57.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:21:57 gibba045 bash[25517]: audit 2021-03-10T15:21:56.588657+0000 mon.a (mon.0) 1332 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:21:57.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:21:57 gibba045 bash[25517]: cephadm 2021-03-10T15:21:56.589875+0000 mgr.gibba045.orlgmj (mgr.34412) 4931 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:21:57.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:21:57 gibba045 bash[25517]: cephadm 2021-03-10T15:21:56.594092+0000 mgr.gibba045.orlgmj (mgr.34412) 4932 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:21:57.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:21:57 gibba045 bash[25517]: audit 2021-03-10T15:21:56.792331+0000 mon.a (mon.0) 1333 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:21:57.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:21:57 gibba045 bash[25517]: audit 2021-03-10T15:21:56.796129+0000 mon.c (mon.1) 1400 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:21:57.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:21:57 gibba045 bash[25517]: audit 2021-03-10T15:21:56.797703+0000 mon.c (mon.1) 1401 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:21:57.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:21:57 gibba045 bash[25517]: audit 2021-03-10T15:21:56.799504+0000 mon.c (mon.1) 1402 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:21:57.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:21:57 gibba045 bash[25517]: cephadm 2021-03-10T15:21:56.799720+0000 mgr.gibba045.orlgmj (mgr.34412) 4933 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:21:57.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:21:57 gibba045 bash[25517]: audit 2021-03-10T15:21:56.800980+0000 mon.c (mon.1) 1403 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:21:57.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:21:57 gibba045 bash[25517]: cephadm 2021-03-10T15:21:56.801540+0000 mgr.gibba045.orlgmj (mgr.34412) 4934 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:21:57.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:21:57 gibba045 bash[25517]: cephadm 2021-03-10T15:21:56.803337+0000 mgr.gibba045.orlgmj (mgr.34412) 4935 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:21:57.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:21:57 gibba045 bash[25517]: cephadm 2021-03-10T15:21:56.803377+0000 mgr.gibba045.orlgmj (mgr.34412) 4936 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:21:57.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:21:57 gibba045 bash[25517]: audit 2021-03-10T15:21:56.804236+0000 mon.c (mon.1) 1404 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:21:57.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:21:57 gibba045 bash[25517]: cephadm 2021-03-10T15:21:56.804869+0000 mgr.gibba045.orlgmj (mgr.34412) 4937 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:21:57.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:21:57 gibba045 bash[25517]: cephadm 2021-03-10T15:21:56.804908+0000 mgr.gibba045.orlgmj (mgr.34412) 4938 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:21:57.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:21:57 gibba045 bash[25517]: audit 2021-03-10T15:21:56.806017+0000 mon.c (mon.1) 1405 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:21:57.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:21:57 gibba045 bash[25517]: cephadm 2021-03-10T15:21:56.806222+0000 mgr.gibba045.orlgmj (mgr.34412) 4939 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:21:57.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:21:57 gibba045 bash[25517]: cephadm 2021-03-10T15:21:56.807910+0000 mgr.gibba045.orlgmj (mgr.34412) 4940 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:21:57.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:21:57 gibba045 bash[25517]: cephadm 2021-03-10T15:21:56.807949+0000 mgr.gibba045.orlgmj (mgr.34412) 4941 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:21:57.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:21:57 gibba045 bash[25517]: cephadm 2021-03-10T15:21:56.809652+0000 mgr.gibba045.orlgmj (mgr.34412) 4942 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:21:57.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:21:57 gibba045 bash[25517]: cephadm 2021-03-10T15:21:56.809971+0000 mgr.gibba045.orlgmj (mgr.34412) 4943 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:21:57.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:21:57 gibba045 bash[25517]: cephadm 2021-03-10T15:21:56.811211+0000 mgr.gibba045.orlgmj (mgr.34412) 4944 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:21:57.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:21:57 gibba045 bash[25517]: cephadm 2021-03-10T15:21:56.811251+0000 mgr.gibba045.orlgmj (mgr.34412) 4945 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:21:57.563 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:21:57 gibba045 bash[25517]: cephadm 2021-03-10T15:21:56.811359+0000 mgr.gibba045.orlgmj (mgr.34412) 4946 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:21:57.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:21:57 gibba015 bash[29377]: audit 2021-03-10T15:21:56.377451+0000 mon.c (mon.1) 1399 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:21:57.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:21:57 gibba015 bash[29377]: audit 2021-03-10T15:21:56.584499+0000 mon.a (mon.0) 1331 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:21:57.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:21:57 gibba015 bash[29377]: audit 2021-03-10T15:21:56.588657+0000 mon.a (mon.0) 1332 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:21:57.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:21:57 gibba015 bash[29377]: cephadm 2021-03-10T15:21:56.589875+0000 mgr.gibba045.orlgmj (mgr.34412) 4931 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:21:57.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:21:57 gibba015 bash[29377]: cephadm 2021-03-10T15:21:56.594092+0000 mgr.gibba045.orlgmj (mgr.34412) 4932 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:21:57.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:21:57 gibba015 bash[29377]: audit 2021-03-10T15:21:56.792331+0000 mon.a (mon.0) 1333 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:21:57.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:21:57 gibba015 bash[29377]: audit 2021-03-10T15:21:56.796129+0000 mon.c (mon.1) 1400 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:21:57.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:21:57 gibba015 bash[29377]: audit 2021-03-10T15:21:56.797703+0000 mon.c (mon.1) 1401 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:21:57.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:21:57 gibba015 bash[29377]: audit 2021-03-10T15:21:56.799504+0000 mon.c (mon.1) 1402 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:21:57.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:21:57 gibba015 bash[29377]: cephadm 2021-03-10T15:21:56.799720+0000 mgr.gibba045.orlgmj (mgr.34412) 4933 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:21:57.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:21:57 gibba015 bash[29377]: audit 2021-03-10T15:21:56.800980+0000 mon.c (mon.1) 1403 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:21:57.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:21:57 gibba015 bash[29377]: cephadm 2021-03-10T15:21:56.801540+0000 mgr.gibba045.orlgmj (mgr.34412) 4934 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:21:57.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:21:57 gibba015 bash[29377]: cephadm 2021-03-10T15:21:56.803337+0000 mgr.gibba045.orlgmj (mgr.34412) 4935 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:21:57.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:21:57 gibba015 bash[29377]: cephadm 2021-03-10T15:21:56.803377+0000 mgr.gibba045.orlgmj (mgr.34412) 4936 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:21:57.729 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:21:57 gibba015 bash[29377]: audit 2021-03-10T15:21:56.804236+0000 mon.c (mon.1) 1404 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:21:57.729 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:21:57 gibba015 bash[29377]: cephadm 2021-03-10T15:21:56.804869+0000 mgr.gibba045.orlgmj (mgr.34412) 4937 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:21:57.729 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:21:57 gibba015 bash[29377]: cephadm 2021-03-10T15:21:56.804908+0000 mgr.gibba045.orlgmj (mgr.34412) 4938 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:21:57.729 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:21:57 gibba015 bash[29377]: audit 2021-03-10T15:21:56.806017+0000 mon.c (mon.1) 1405 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:21:57.730 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:21:57 gibba015 bash[29377]: cephadm 2021-03-10T15:21:56.806222+0000 mgr.gibba045.orlgmj (mgr.34412) 4939 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:21:57.730 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:21:57 gibba015 bash[29377]: cephadm 2021-03-10T15:21:56.807910+0000 mgr.gibba045.orlgmj (mgr.34412) 4940 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:21:57.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:21:57 gibba015 bash[30343]: audit 2021-03-10T15:21:56.377451+0000 mon.c (mon.1) 1399 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:21:57.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:21:57 gibba015 bash[30343]: audit 2021-03-10T15:21:56.584499+0000 mon.a (mon.0) 1331 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:21:57.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:21:57 gibba015 bash[30343]: audit 2021-03-10T15:21:56.588657+0000 mon.a (mon.0) 1332 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:21:57.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:21:57 gibba015 bash[30343]: cephadm 2021-03-10T15:21:56.589875+0000 mgr.gibba045.orlgmj (mgr.34412) 4931 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:21:57.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:21:57 gibba015 bash[30343]: cephadm 2021-03-10T15:21:56.594092+0000 mgr.gibba045.orlgmj (mgr.34412) 4932 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:21:57.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:21:57 gibba015 bash[30343]: audit 2021-03-10T15:21:56.792331+0000 mon.a (mon.0) 1333 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:21:57.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:21:57 gibba015 bash[30343]: audit 2021-03-10T15:21:56.796129+0000 mon.c (mon.1) 1400 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:21:57.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:21:57 gibba015 bash[30343]: audit 2021-03-10T15:21:56.797703+0000 mon.c (mon.1) 1401 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:21:57.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:21:57 gibba015 bash[30343]: audit 2021-03-10T15:21:56.799504+0000 mon.c (mon.1) 1402 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:21:57.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:21:57 gibba015 bash[30343]: cephadm 2021-03-10T15:21:56.799720+0000 mgr.gibba045.orlgmj (mgr.34412) 4933 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:21:57.733 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:21:57 gibba015 bash[30343]: audit 2021-03-10T15:21:56.800980+0000 mon.c (mon.1) 1403 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:21:57.733 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:21:57 gibba015 bash[30343]: cephadm 2021-03-10T15:21:56.801540+0000 mgr.gibba045.orlgmj (mgr.34412) 4934 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:21:57.733 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:21:57 gibba015 bash[30343]: cephadm 2021-03-10T15:21:56.803337+0000 mgr.gibba045.orlgmj (mgr.34412) 4935 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:21:57.733 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:21:57 gibba015 bash[30343]: cephadm 2021-03-10T15:21:56.803377+0000 mgr.gibba045.orlgmj (mgr.34412) 4936 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:21:57.733 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:21:57 gibba015 bash[30343]: audit 2021-03-10T15:21:56.804236+0000 mon.c (mon.1) 1404 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:21:57.734 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:21:57 gibba015 bash[30343]: cephadm 2021-03-10T15:21:56.804869+0000 mgr.gibba045.orlgmj (mgr.34412) 4937 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:21:57.734 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:21:57 gibba015 bash[30343]: cephadm 2021-03-10T15:21:56.804908+0000 mgr.gibba045.orlgmj (mgr.34412) 4938 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:21:57.734 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:21:57 gibba015 bash[30343]: audit 2021-03-10T15:21:56.806017+0000 mon.c (mon.1) 1405 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:21:57.734 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:21:57 gibba015 bash[30343]: cephadm 2021-03-10T15:21:56.806222+0000 mgr.gibba045.orlgmj (mgr.34412) 4939 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:21:57.735 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:21:57 gibba015 bash[30343]: cephadm 2021-03-10T15:21:56.807910+0000 mgr.gibba045.orlgmj (mgr.34412) 4940 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:21:57.735 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:21:57 gibba015 bash[29377]: cephadm 2021-03-10T15:21:56.807949+0000 mgr.gibba045.orlgmj (mgr.34412) 4941 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:21:57.735 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:21:57 gibba015 bash[29377]: cephadm 2021-03-10T15:21:56.809652+0000 mgr.gibba045.orlgmj (mgr.34412) 4942 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:21:57.736 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:21:57 gibba015 bash[29377]: cephadm 2021-03-10T15:21:56.809971+0000 mgr.gibba045.orlgmj (mgr.34412) 4943 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:21:57.736 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:21:57 gibba015 bash[29377]: cephadm 2021-03-10T15:21:56.811211+0000 mgr.gibba045.orlgmj (mgr.34412) 4944 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:21:57.736 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:21:57 gibba015 bash[29377]: cephadm 2021-03-10T15:21:56.811251+0000 mgr.gibba045.orlgmj (mgr.34412) 4945 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:21:57.736 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:21:57 gibba015 bash[29377]: cephadm 2021-03-10T15:21:56.811359+0000 mgr.gibba045.orlgmj (mgr.34412) 4946 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:21:57.737 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:21:57 gibba015 bash[30343]: cephadm 2021-03-10T15:21:56.807949+0000 mgr.gibba045.orlgmj (mgr.34412) 4941 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:21:57.737 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:21:57 gibba015 bash[30343]: cephadm 2021-03-10T15:21:56.809652+0000 mgr.gibba045.orlgmj (mgr.34412) 4942 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:21:57.737 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:21:57 gibba015 bash[30343]: cephadm 2021-03-10T15:21:56.809971+0000 mgr.gibba045.orlgmj (mgr.34412) 4943 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:21:57.737 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:21:57 gibba015 bash[30343]: cephadm 2021-03-10T15:21:56.811211+0000 mgr.gibba045.orlgmj (mgr.34412) 4944 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:21:57.738 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:21:57 gibba015 bash[30343]: cephadm 2021-03-10T15:21:56.811251+0000 mgr.gibba045.orlgmj (mgr.34412) 4945 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:21:57.738 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:21:57 gibba015 bash[30343]: cephadm 2021-03-10T15:21:56.811359+0000 mgr.gibba045.orlgmj (mgr.34412) 4946 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:21:59.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:21:58 gibba045 bash[25517]: cluster 2021-03-10T15:21:56.980550+0000 mgr.gibba045.orlgmj (mgr.34412) 4947 : cluster [DBG] pgmap v2805: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:59.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:21:58 gibba015 bash[29377]: cluster 2021-03-10T15:21:56.980550+0000 mgr.gibba045.orlgmj (mgr.34412) 4947 : cluster [DBG] pgmap v2805: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:59.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:21:58 gibba015 bash[30343]: cluster 2021-03-10T15:21:56.980550+0000 mgr.gibba045.orlgmj (mgr.34412) 4947 : cluster [DBG] pgmap v2805: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:01.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:22:00 gibba015 bash[29377]: cluster 2021-03-10T15:21:58.981744+0000 mgr.gibba045.orlgmj (mgr.34412) 4948 : cluster [DBG] pgmap v2806: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:01.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:22:00 gibba015 bash[30343]: cluster 2021-03-10T15:21:58.981744+0000 mgr.gibba045.orlgmj (mgr.34412) 4948 : cluster [DBG] pgmap v2806: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:01.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:22:00 gibba045 bash[25517]: cluster 2021-03-10T15:21:58.981744+0000 mgr.gibba045.orlgmj (mgr.34412) 4948 : cluster [DBG] pgmap v2806: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:03.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:22:02 gibba015 bash[29377]: cluster 2021-03-10T15:22:00.983502+0000 mgr.gibba045.orlgmj (mgr.34412) 4949 : cluster [DBG] pgmap v2807: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:03.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:22:02 gibba015 bash[30343]: cluster 2021-03-10T15:22:00.983502+0000 mgr.gibba045.orlgmj (mgr.34412) 4949 : cluster [DBG] pgmap v2807: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:03.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:22:02 gibba045 bash[25517]: cluster 2021-03-10T15:22:00.983502+0000 mgr.gibba045.orlgmj (mgr.34412) 4949 : cluster [DBG] pgmap v2807: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:05.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:22:04 gibba015 bash[29377]: cluster 2021-03-10T15:22:02.985225+0000 mgr.gibba045.orlgmj (mgr.34412) 4950 : cluster [DBG] pgmap v2808: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:05.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:22:04 gibba015 bash[30343]: cluster 2021-03-10T15:22:02.985225+0000 mgr.gibba045.orlgmj (mgr.34412) 4950 : cluster [DBG] pgmap v2808: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:05.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:22:04 gibba045 bash[25517]: cluster 2021-03-10T15:22:02.985225+0000 mgr.gibba045.orlgmj (mgr.34412) 4950 : cluster [DBG] pgmap v2808: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:07.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:22:06 gibba015 bash[29377]: cluster 2021-03-10T15:22:04.986666+0000 mgr.gibba045.orlgmj (mgr.34412) 4951 : cluster [DBG] pgmap v2809: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:07.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:22:06 gibba015 bash[30343]: cluster 2021-03-10T15:22:04.986666+0000 mgr.gibba045.orlgmj (mgr.34412) 4951 : cluster [DBG] pgmap v2809: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:07.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:22:06 gibba045 bash[25517]: cluster 2021-03-10T15:22:04.986666+0000 mgr.gibba045.orlgmj (mgr.34412) 4951 : cluster [DBG] pgmap v2809: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:09.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:22:08 gibba015 bash[29377]: cluster 2021-03-10T15:22:06.988312+0000 mgr.gibba045.orlgmj (mgr.34412) 4952 : cluster [DBG] pgmap v2810: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:09.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:22:08 gibba015 bash[30343]: cluster 2021-03-10T15:22:06.988312+0000 mgr.gibba045.orlgmj (mgr.34412) 4952 : cluster [DBG] pgmap v2810: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:09.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:22:08 gibba045 bash[25517]: cluster 2021-03-10T15:22:06.988312+0000 mgr.gibba045.orlgmj (mgr.34412) 4952 : cluster [DBG] pgmap v2810: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:11.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:22:10 gibba015 bash[29377]: cluster 2021-03-10T15:22:08.989542+0000 mgr.gibba045.orlgmj (mgr.34412) 4953 : cluster [DBG] pgmap v2811: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:11.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:22:10 gibba015 bash[30343]: cluster 2021-03-10T15:22:08.989542+0000 mgr.gibba045.orlgmj (mgr.34412) 4953 : cluster [DBG] pgmap v2811: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:11.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:22:10 gibba045 bash[25517]: cluster 2021-03-10T15:22:08.989542+0000 mgr.gibba045.orlgmj (mgr.34412) 4953 : cluster [DBG] pgmap v2811: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:13.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:22:12 gibba015 bash[29377]: cluster 2021-03-10T15:22:10.991298+0000 mgr.gibba045.orlgmj (mgr.34412) 4954 : cluster [DBG] pgmap v2812: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:13.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:22:12 gibba015 bash[29377]: cephadm 2021-03-10T15:22:11.818022+0000 mgr.gibba045.orlgmj (mgr.34412) 4955 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:22:13.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:22:12 gibba015 bash[30343]: cluster 2021-03-10T15:22:10.991298+0000 mgr.gibba045.orlgmj (mgr.34412) 4954 : cluster [DBG] pgmap v2812: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:13.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:22:12 gibba015 bash[30343]: cephadm 2021-03-10T15:22:11.818022+0000 mgr.gibba045.orlgmj (mgr.34412) 4955 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:22:13.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:22:12 gibba045 bash[25517]: cluster 2021-03-10T15:22:10.991298+0000 mgr.gibba045.orlgmj (mgr.34412) 4954 : cluster [DBG] pgmap v2812: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:13.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:22:12 gibba045 bash[25517]: cephadm 2021-03-10T15:22:11.818022+0000 mgr.gibba045.orlgmj (mgr.34412) 4955 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:22:15.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:22:14 gibba015 bash[29377]: cluster 2021-03-10T15:22:12.992854+0000 mgr.gibba045.orlgmj (mgr.34412) 4956 : cluster [DBG] pgmap v2813: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:15.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:22:14 gibba015 bash[30343]: cluster 2021-03-10T15:22:12.992854+0000 mgr.gibba045.orlgmj (mgr.34412) 4956 : cluster [DBG] pgmap v2813: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:15.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:22:14 gibba045 bash[25517]: cluster 2021-03-10T15:22:12.992854+0000 mgr.gibba045.orlgmj (mgr.34412) 4956 : cluster [DBG] pgmap v2813: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:16.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:22:15 gibba015 bash[29377]: cluster 2021-03-10T15:22:14.994230+0000 mgr.gibba045.orlgmj (mgr.34412) 4957 : cluster [DBG] pgmap v2814: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:16.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:22:15 gibba015 bash[30343]: cluster 2021-03-10T15:22:14.994230+0000 mgr.gibba045.orlgmj (mgr.34412) 4957 : cluster [DBG] pgmap v2814: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:16.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:22:15 gibba045 bash[25517]: cluster 2021-03-10T15:22:14.994230+0000 mgr.gibba045.orlgmj (mgr.34412) 4957 : cluster [DBG] pgmap v2814: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:18.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:22:18 gibba015 bash[29377]: cluster 2021-03-10T15:22:16.995656+0000 mgr.gibba045.orlgmj (mgr.34412) 4958 : cluster [DBG] pgmap v2815: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:18.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:22:18 gibba015 bash[30343]: cluster 2021-03-10T15:22:16.995656+0000 mgr.gibba045.orlgmj (mgr.34412) 4958 : cluster [DBG] pgmap v2815: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:18.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:22:18 gibba045 bash[25517]: cluster 2021-03-10T15:22:16.995656+0000 mgr.gibba045.orlgmj (mgr.34412) 4958 : cluster [DBG] pgmap v2815: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:20.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:22:20 gibba015 bash[29377]: cluster 2021-03-10T15:22:18.997031+0000 mgr.gibba045.orlgmj (mgr.34412) 4959 : cluster [DBG] pgmap v2816: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:20.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:22:20 gibba015 bash[30343]: cluster 2021-03-10T15:22:18.997031+0000 mgr.gibba045.orlgmj (mgr.34412) 4959 : cluster [DBG] pgmap v2816: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:20.475 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:22:20.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:22:20 gibba045 bash[25517]: cluster 2021-03-10T15:22:18.997031+0000 mgr.gibba045.orlgmj (mgr.34412) 4959 : cluster [DBG] pgmap v2816: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:20.699 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:22:20.699 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (93m) 7m ago 98m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:22:20.700 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (98m) 6m ago 98m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:22:20.700 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (93m) 6m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:22:20.700 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (93m) 6m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:22:20.700 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (92m) 7m ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:22:20.701 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (92m) 7m ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:22:20.701 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (92m) 6m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:22:20.701 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (92m) 7m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:22:20.701 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (98m) 7m ago 98m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:22:20.701 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (98m) 6m ago 98m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:22:20.702 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (91m) 7m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:22:20.702 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (90m) 7m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:22:20.702 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (90m) 7m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:22:20.702 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (90m) 7m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:22:20.703 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (89m) 6m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:22:20.703 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (89m) 6m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:22:20.703 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (88m) 6m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:22:20.703 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (88m) 6m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:22:20.704 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (97m) 6m ago 98m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:22:20.704 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 6m ago 96m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:22:20.946 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:22:20.947 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:22:20.947 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:22:20.947 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:22:20.947 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:22:20.948 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:22:20.948 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:22:20.948 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:22:20.948 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:22:20.948 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:22:20.949 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:22:20.949 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:22:20.949 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:22:20.949 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:22:20.950 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:22:21.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:22:21 gibba015 bash[29377]: audit 2021-03-10T15:22:20.465559+0000 mgr.gibba045.orlgmj (mgr.34412) 4960 : audit [DBG] from='client.57370 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:22:21.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:22:21 gibba015 bash[29377]: audit 2021-03-10T15:22:20.687153+0000 mgr.gibba045.orlgmj (mgr.34412) 4961 : audit [DBG] from='client.47388 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:22:21.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:22:21 gibba015 bash[29377]: audit 2021-03-10T15:22:20.942174+0000 mon.a (mon.0) 1334 : audit [DBG] from='client.? 172.21.2.115:0/3156710083' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:22:21.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:22:21 gibba015 bash[30343]: audit 2021-03-10T15:22:20.465559+0000 mgr.gibba045.orlgmj (mgr.34412) 4960 : audit [DBG] from='client.57370 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:22:21.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:22:21 gibba015 bash[30343]: audit 2021-03-10T15:22:20.687153+0000 mgr.gibba045.orlgmj (mgr.34412) 4961 : audit [DBG] from='client.47388 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:22:21.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:22:21 gibba015 bash[30343]: audit 2021-03-10T15:22:20.942174+0000 mon.a (mon.0) 1334 : audit [DBG] from='client.? 172.21.2.115:0/3156710083' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:22:21.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:22:21 gibba045 bash[25517]: audit 2021-03-10T15:22:20.465559+0000 mgr.gibba045.orlgmj (mgr.34412) 4960 : audit [DBG] from='client.57370 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:22:21.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:22:21 gibba045 bash[25517]: audit 2021-03-10T15:22:20.687153+0000 mgr.gibba045.orlgmj (mgr.34412) 4961 : audit [DBG] from='client.47388 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:22:21.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:22:21 gibba045 bash[25517]: audit 2021-03-10T15:22:20.942174+0000 mon.a (mon.0) 1334 : audit [DBG] from='client.? 172.21.2.115:0/3156710083' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:22:22.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:22:22 gibba015 bash[29377]: cluster 2021-03-10T15:22:20.998547+0000 mgr.gibba045.orlgmj (mgr.34412) 4962 : cluster [DBG] pgmap v2817: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:22.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:22:22 gibba015 bash[30343]: cluster 2021-03-10T15:22:20.998547+0000 mgr.gibba045.orlgmj (mgr.34412) 4962 : cluster [DBG] pgmap v2817: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:22.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:22:22 gibba045 bash[25517]: cluster 2021-03-10T15:22:20.998547+0000 mgr.gibba045.orlgmj (mgr.34412) 4962 : cluster [DBG] pgmap v2817: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:24.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:22:24 gibba015 bash[29377]: cluster 2021-03-10T15:22:23.000079+0000 mgr.gibba045.orlgmj (mgr.34412) 4963 : cluster [DBG] pgmap v2818: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:24.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:22:24 gibba015 bash[30343]: cluster 2021-03-10T15:22:23.000079+0000 mgr.gibba045.orlgmj (mgr.34412) 4963 : cluster [DBG] pgmap v2818: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:24.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:22:24 gibba045 bash[25517]: cluster 2021-03-10T15:22:23.000079+0000 mgr.gibba045.orlgmj (mgr.34412) 4963 : cluster [DBG] pgmap v2818: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:26.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:22:26 gibba015 bash[29377]: cluster 2021-03-10T15:22:25.001582+0000 mgr.gibba045.orlgmj (mgr.34412) 4964 : cluster [DBG] pgmap v2819: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:26.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:22:26 gibba015 bash[30343]: cluster 2021-03-10T15:22:25.001582+0000 mgr.gibba045.orlgmj (mgr.34412) 4964 : cluster [DBG] pgmap v2819: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:26.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:22:26 gibba045 bash[25517]: cluster 2021-03-10T15:22:25.001582+0000 mgr.gibba045.orlgmj (mgr.34412) 4964 : cluster [DBG] pgmap v2819: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:27.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:22:27 gibba015 bash[29377]: cephadm 2021-03-10T15:22:26.833106+0000 mgr.gibba045.orlgmj (mgr.34412) 4965 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:22:27.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:22:27 gibba015 bash[30343]: cephadm 2021-03-10T15:22:26.833106+0000 mgr.gibba045.orlgmj (mgr.34412) 4965 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:22:27.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:22:27 gibba045 bash[25517]: cephadm 2021-03-10T15:22:26.833106+0000 mgr.gibba045.orlgmj (mgr.34412) 4965 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:22:28.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:22:28 gibba015 bash[29377]: cluster 2021-03-10T15:22:27.003124+0000 mgr.gibba045.orlgmj (mgr.34412) 4966 : cluster [DBG] pgmap v2820: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:28.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:22:28 gibba015 bash[30343]: cluster 2021-03-10T15:22:27.003124+0000 mgr.gibba045.orlgmj (mgr.34412) 4966 : cluster [DBG] pgmap v2820: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:28.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:22:28 gibba045 bash[25517]: cluster 2021-03-10T15:22:27.003124+0000 mgr.gibba045.orlgmj (mgr.34412) 4966 : cluster [DBG] pgmap v2820: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:30.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:22:30 gibba015 bash[29377]: cluster 2021-03-10T15:22:29.004410+0000 mgr.gibba045.orlgmj (mgr.34412) 4967 : cluster [DBG] pgmap v2821: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:30.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:22:30 gibba015 bash[30343]: cluster 2021-03-10T15:22:29.004410+0000 mgr.gibba045.orlgmj (mgr.34412) 4967 : cluster [DBG] pgmap v2821: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:30.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:22:30 gibba045 bash[25517]: cluster 2021-03-10T15:22:29.004410+0000 mgr.gibba045.orlgmj (mgr.34412) 4967 : cluster [DBG] pgmap v2821: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:32.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:22:32 gibba015 bash[29377]: cluster 2021-03-10T15:22:31.006067+0000 mgr.gibba045.orlgmj (mgr.34412) 4968 : cluster [DBG] pgmap v2822: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:32.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:22:32 gibba015 bash[30343]: cluster 2021-03-10T15:22:31.006067+0000 mgr.gibba045.orlgmj (mgr.34412) 4968 : cluster [DBG] pgmap v2822: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:32.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:22:32 gibba045 bash[25517]: cluster 2021-03-10T15:22:31.006067+0000 mgr.gibba045.orlgmj (mgr.34412) 4968 : cluster [DBG] pgmap v2822: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:34.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:22:34 gibba015 bash[29377]: cluster 2021-03-10T15:22:33.007473+0000 mgr.gibba045.orlgmj (mgr.34412) 4969 : cluster [DBG] pgmap v2823: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:34.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:22:34 gibba015 bash[30343]: cluster 2021-03-10T15:22:33.007473+0000 mgr.gibba045.orlgmj (mgr.34412) 4969 : cluster [DBG] pgmap v2823: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:34.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:22:34 gibba045 bash[25517]: cluster 2021-03-10T15:22:33.007473+0000 mgr.gibba045.orlgmj (mgr.34412) 4969 : cluster [DBG] pgmap v2823: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:36.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:22:36 gibba045 bash[25517]: cluster 2021-03-10T15:22:35.008945+0000 mgr.gibba045.orlgmj (mgr.34412) 4970 : cluster [DBG] pgmap v2824: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:36.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:22:36 gibba015 bash[29377]: cluster 2021-03-10T15:22:35.008945+0000 mgr.gibba045.orlgmj (mgr.34412) 4970 : cluster [DBG] pgmap v2824: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:36.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:22:36 gibba015 bash[30343]: cluster 2021-03-10T15:22:35.008945+0000 mgr.gibba045.orlgmj (mgr.34412) 4970 : cluster [DBG] pgmap v2824: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:38.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:22:38 gibba045 bash[25517]: cluster 2021-03-10T15:22:37.010541+0000 mgr.gibba045.orlgmj (mgr.34412) 4971 : cluster [DBG] pgmap v2825: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:38.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:22:38 gibba015 bash[29377]: cluster 2021-03-10T15:22:37.010541+0000 mgr.gibba045.orlgmj (mgr.34412) 4971 : cluster [DBG] pgmap v2825: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:38.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:22:38 gibba015 bash[30343]: cluster 2021-03-10T15:22:37.010541+0000 mgr.gibba045.orlgmj (mgr.34412) 4971 : cluster [DBG] pgmap v2825: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:40.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:22:40 gibba045 bash[25517]: cluster 2021-03-10T15:22:39.011795+0000 mgr.gibba045.orlgmj (mgr.34412) 4972 : cluster [DBG] pgmap v2826: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:40.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:22:40 gibba015 bash[29377]: cluster 2021-03-10T15:22:39.011795+0000 mgr.gibba045.orlgmj (mgr.34412) 4972 : cluster [DBG] pgmap v2826: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:40.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:22:40 gibba015 bash[30343]: cluster 2021-03-10T15:22:39.011795+0000 mgr.gibba045.orlgmj (mgr.34412) 4972 : cluster [DBG] pgmap v2826: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:42.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:22:42 gibba045 bash[25517]: cluster 2021-03-10T15:22:41.013562+0000 mgr.gibba045.orlgmj (mgr.34412) 4973 : cluster [DBG] pgmap v2827: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:42.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:22:42 gibba045 bash[25517]: cephadm 2021-03-10T15:22:41.849042+0000 mgr.gibba045.orlgmj (mgr.34412) 4974 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:22:42.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:22:42 gibba015 bash[29377]: cluster 2021-03-10T15:22:41.013562+0000 mgr.gibba045.orlgmj (mgr.34412) 4973 : cluster [DBG] pgmap v2827: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:42.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:22:42 gibba015 bash[29377]: cephadm 2021-03-10T15:22:41.849042+0000 mgr.gibba045.orlgmj (mgr.34412) 4974 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:22:42.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:22:42 gibba015 bash[30343]: cluster 2021-03-10T15:22:41.013562+0000 mgr.gibba045.orlgmj (mgr.34412) 4973 : cluster [DBG] pgmap v2827: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:42.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:22:42 gibba015 bash[30343]: cephadm 2021-03-10T15:22:41.849042+0000 mgr.gibba045.orlgmj (mgr.34412) 4974 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:22:44.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:22:44 gibba045 bash[25517]: cluster 2021-03-10T15:22:43.014964+0000 mgr.gibba045.orlgmj (mgr.34412) 4975 : cluster [DBG] pgmap v2828: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:44.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:22:44 gibba015 bash[29377]: cluster 2021-03-10T15:22:43.014964+0000 mgr.gibba045.orlgmj (mgr.34412) 4975 : cluster [DBG] pgmap v2828: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:44.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:22:44 gibba015 bash[30343]: cluster 2021-03-10T15:22:43.014964+0000 mgr.gibba045.orlgmj (mgr.34412) 4975 : cluster [DBG] pgmap v2828: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:46.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:22:46 gibba045 bash[25517]: cluster 2021-03-10T15:22:45.016550+0000 mgr.gibba045.orlgmj (mgr.34412) 4976 : cluster [DBG] pgmap v2829: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:46.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:22:46 gibba015 bash[29377]: cluster 2021-03-10T15:22:45.016550+0000 mgr.gibba045.orlgmj (mgr.34412) 4976 : cluster [DBG] pgmap v2829: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:46.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:22:46 gibba015 bash[30343]: cluster 2021-03-10T15:22:45.016550+0000 mgr.gibba045.orlgmj (mgr.34412) 4976 : cluster [DBG] pgmap v2829: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:48.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:22:48 gibba045 bash[25517]: cluster 2021-03-10T15:22:47.018253+0000 mgr.gibba045.orlgmj (mgr.34412) 4977 : cluster [DBG] pgmap v2830: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:48.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:22:48 gibba015 bash[29377]: cluster 2021-03-10T15:22:47.018253+0000 mgr.gibba045.orlgmj (mgr.34412) 4977 : cluster [DBG] pgmap v2830: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:48.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:22:48 gibba015 bash[30343]: cluster 2021-03-10T15:22:47.018253+0000 mgr.gibba045.orlgmj (mgr.34412) 4977 : cluster [DBG] pgmap v2830: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:50.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:22:50 gibba045 bash[25517]: cluster 2021-03-10T15:22:49.019633+0000 mgr.gibba045.orlgmj (mgr.34412) 4978 : cluster [DBG] pgmap v2831: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:50.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:22:50 gibba015 bash[29377]: cluster 2021-03-10T15:22:49.019633+0000 mgr.gibba045.orlgmj (mgr.34412) 4978 : cluster [DBG] pgmap v2831: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:50.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:22:50 gibba015 bash[30343]: cluster 2021-03-10T15:22:49.019633+0000 mgr.gibba045.orlgmj (mgr.34412) 4978 : cluster [DBG] pgmap v2831: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:51.189 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:22:51.450 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:22:51.451 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (93m) 8m ago 98m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:22:51.451 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (98m) 7m ago 98m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:22:51.451 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (94m) 7m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:22:51.452 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (94m) 7m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:22:51.452 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (93m) 8m ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:22:51.452 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (93m) 8m ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:22:51.452 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (92m) 7m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:22:51.452 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (92m) 8m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:22:51.453 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (99m) 8m ago 99m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:22:51.453 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (99m) 7m ago 99m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:22:51.453 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (91m) 8m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:22:51.453 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (91m) 8m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:22:51.454 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (91m) 8m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:22:51.454 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (90m) 8m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:22:51.454 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (90m) 7m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:22:51.454 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (89m) 7m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:22:51.455 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (89m) 7m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:22:51.455 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (88m) 7m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:22:51.455 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (98m) 7m ago 99m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:22:51.455 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 7m ago 97m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:22:51.698 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:22:51.698 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:22:51.698 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:22:51.699 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:22:51.699 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:22:51.699 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:22:51.699 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:22:51.700 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:22:51.700 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:22:51.700 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:22:51.700 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:22:51.701 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:22:51.701 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:22:51.701 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:22:51.701 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:22:52.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:22:52 gibba045 bash[25517]: cluster 2021-03-10T15:22:51.021323+0000 mgr.gibba045.orlgmj (mgr.34412) 4979 : cluster [DBG] pgmap v2832: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:52.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:22:52 gibba045 bash[25517]: audit 2021-03-10T15:22:51.180348+0000 mgr.gibba045.orlgmj (mgr.34412) 4980 : audit [DBG] from='client.47400 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:22:52.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:22:52 gibba045 bash[25517]: audit 2021-03-10T15:22:51.408178+0000 mgr.gibba045.orlgmj (mgr.34412) 4981 : audit [DBG] from='client.47406 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:22:52.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:22:52 gibba045 bash[25517]: audit 2021-03-10T15:22:51.693535+0000 mon.a (mon.0) 1335 : audit [DBG] from='client.? 172.21.2.115:0/3709865717' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:22:52.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:22:52 gibba015 bash[29377]: cluster 2021-03-10T15:22:51.021323+0000 mgr.gibba045.orlgmj (mgr.34412) 4979 : cluster [DBG] pgmap v2832: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:52.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:22:52 gibba015 bash[29377]: audit 2021-03-10T15:22:51.180348+0000 mgr.gibba045.orlgmj (mgr.34412) 4980 : audit [DBG] from='client.47400 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:22:52.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:22:52 gibba015 bash[29377]: audit 2021-03-10T15:22:51.408178+0000 mgr.gibba045.orlgmj (mgr.34412) 4981 : audit [DBG] from='client.47406 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:22:52.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:22:52 gibba015 bash[29377]: audit 2021-03-10T15:22:51.693535+0000 mon.a (mon.0) 1335 : audit [DBG] from='client.? 172.21.2.115:0/3709865717' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:22:52.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:22:52 gibba015 bash[30343]: cluster 2021-03-10T15:22:51.021323+0000 mgr.gibba045.orlgmj (mgr.34412) 4979 : cluster [DBG] pgmap v2832: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:52.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:22:52 gibba015 bash[30343]: audit 2021-03-10T15:22:51.180348+0000 mgr.gibba045.orlgmj (mgr.34412) 4980 : audit [DBG] from='client.47400 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:22:52.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:22:52 gibba015 bash[30343]: audit 2021-03-10T15:22:51.408178+0000 mgr.gibba045.orlgmj (mgr.34412) 4981 : audit [DBG] from='client.47406 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:22:52.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:22:52 gibba015 bash[30343]: audit 2021-03-10T15:22:51.693535+0000 mon.a (mon.0) 1335 : audit [DBG] from='client.? 172.21.2.115:0/3709865717' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:22:53.313 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:22:53 gibba045 bash[25517]: audit 2021-03-10T15:22:53.093797+0000 mon.c (mon.1) 1406 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:22:53.313 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:22:53 gibba045 bash[25517]: audit 2021-03-10T15:22:53.094431+0000 mon.c (mon.1) 1407 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:22:53.313 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:22:53 gibba045 bash[25517]: audit 2021-03-10T15:22:53.094930+0000 mon.a (mon.0) 1336 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:22:53.313 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:22:53 gibba045 bash[25517]: audit 2021-03-10T15:22:53.095223+0000 mon.c (mon.1) 1408 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T15:22:53.314 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:22:53 gibba045 bash[25517]: audit 2021-03-10T15:22:53.096018+0000 mon.a (mon.0) 1337 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:22:53.314 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:22:53 gibba045 bash[25517]: audit 2021-03-10T15:22:53.096182+0000 mon.c (mon.1) 1409 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T15:22:53.314 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:22:53 gibba045 bash[25517]: audit 2021-03-10T15:22:53.096990+0000 mon.a (mon.0) 1338 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T15:22:53.314 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:22:53 gibba045 bash[25517]: audit 2021-03-10T15:22:53.097016+0000 mon.c (mon.1) 1410 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:22:53.315 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:22:53 gibba045 bash[25517]: audit 2021-03-10T15:22:53.097768+0000 mon.c (mon.1) 1411 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:22:53.315 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:22:53 gibba045 bash[25517]: audit 2021-03-10T15:22:53.098020+0000 mon.a (mon.0) 1339 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T15:22:53.315 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:22:53 gibba045 bash[25517]: audit 2021-03-10T15:22:53.099137+0000 mon.a (mon.0) 1340 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:22:53.315 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:22:53 gibba045 bash[25517]: audit 2021-03-10T15:22:53.099920+0000 mon.a (mon.0) 1341 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:22:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:22:53 gibba015 bash[29377]: audit 2021-03-10T15:22:53.093797+0000 mon.c (mon.1) 1406 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:22:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:22:53 gibba015 bash[29377]: audit 2021-03-10T15:22:53.094431+0000 mon.c (mon.1) 1407 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:22:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:22:53 gibba015 bash[29377]: audit 2021-03-10T15:22:53.094930+0000 mon.a (mon.0) 1336 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:22:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:22:53 gibba015 bash[29377]: audit 2021-03-10T15:22:53.095223+0000 mon.c (mon.1) 1408 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T15:22:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:22:53 gibba015 bash[29377]: audit 2021-03-10T15:22:53.096018+0000 mon.a (mon.0) 1337 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:22:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:22:53 gibba015 bash[29377]: audit 2021-03-10T15:22:53.096182+0000 mon.c (mon.1) 1409 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T15:22:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:22:53 gibba015 bash[29377]: audit 2021-03-10T15:22:53.096990+0000 mon.a (mon.0) 1338 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T15:22:53.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:22:53 gibba015 bash[29377]: audit 2021-03-10T15:22:53.097016+0000 mon.c (mon.1) 1410 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:22:53.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:22:53 gibba015 bash[29377]: audit 2021-03-10T15:22:53.097768+0000 mon.c (mon.1) 1411 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:22:53.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:22:53 gibba015 bash[29377]: audit 2021-03-10T15:22:53.098020+0000 mon.a (mon.0) 1339 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T15:22:53.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:22:53 gibba015 bash[29377]: audit 2021-03-10T15:22:53.099137+0000 mon.a (mon.0) 1340 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:22:53.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:22:53 gibba015 bash[29377]: audit 2021-03-10T15:22:53.099920+0000 mon.a (mon.0) 1341 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:22:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:22:53 gibba015 bash[30343]: audit 2021-03-10T15:22:53.093797+0000 mon.c (mon.1) 1406 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:22:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:22:53 gibba015 bash[30343]: audit 2021-03-10T15:22:53.094431+0000 mon.c (mon.1) 1407 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:22:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:22:53 gibba015 bash[30343]: audit 2021-03-10T15:22:53.094930+0000 mon.a (mon.0) 1336 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:22:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:22:53 gibba015 bash[30343]: audit 2021-03-10T15:22:53.095223+0000 mon.c (mon.1) 1408 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T15:22:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:22:53 gibba015 bash[30343]: audit 2021-03-10T15:22:53.096018+0000 mon.a (mon.0) 1337 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:22:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:22:53 gibba015 bash[30343]: audit 2021-03-10T15:22:53.096182+0000 mon.c (mon.1) 1409 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T15:22:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:22:53 gibba015 bash[30343]: audit 2021-03-10T15:22:53.096990+0000 mon.a (mon.0) 1338 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T15:22:53.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:22:53 gibba015 bash[30343]: audit 2021-03-10T15:22:53.097016+0000 mon.c (mon.1) 1410 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:22:53.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:22:53 gibba015 bash[30343]: audit 2021-03-10T15:22:53.097768+0000 mon.c (mon.1) 1411 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:22:53.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:22:53 gibba015 bash[30343]: audit 2021-03-10T15:22:53.098020+0000 mon.a (mon.0) 1339 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T15:22:53.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:22:53 gibba015 bash[30343]: audit 2021-03-10T15:22:53.099137+0000 mon.a (mon.0) 1340 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:22:53.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:22:53 gibba015 bash[30343]: audit 2021-03-10T15:22:53.099920+0000 mon.a (mon.0) 1341 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:22:54.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:22:54 gibba015 bash[29377]: cluster 2021-03-10T15:22:53.022955+0000 mgr.gibba045.orlgmj (mgr.34412) 4982 : cluster [DBG] pgmap v2833: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:22:54 gibba015 bash[30343]: cluster 2021-03-10T15:22:53.022955+0000 mgr.gibba045.orlgmj (mgr.34412) 4982 : cluster [DBG] pgmap v2833: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:54.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:22:54 gibba045 bash[25517]: cluster 2021-03-10T15:22:53.022955+0000 mgr.gibba045.orlgmj (mgr.34412) 4982 : cluster [DBG] pgmap v2833: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:56.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:22:56 gibba015 bash[29377]: cluster 2021-03-10T15:22:55.024642+0000 mgr.gibba045.orlgmj (mgr.34412) 4983 : cluster [DBG] pgmap v2834: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:56.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:22:56 gibba015 bash[30343]: cluster 2021-03-10T15:22:55.024642+0000 mgr.gibba045.orlgmj (mgr.34412) 4983 : cluster [DBG] pgmap v2834: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:56.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:22:56 gibba045 bash[25517]: cluster 2021-03-10T15:22:55.024642+0000 mgr.gibba045.orlgmj (mgr.34412) 4983 : cluster [DBG] pgmap v2834: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:57.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:22:57 gibba045 bash[25517]: audit 2021-03-10T15:22:56.861593+0000 mon.c (mon.1) 1412 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:22:57.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:22:57 gibba045 bash[25517]: cephadm 2021-03-10T15:22:56.871174+0000 mgr.gibba045.orlgmj (mgr.34412) 4984 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:22:57.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:22:57 gibba045 bash[25517]: cephadm 2021-03-10T15:22:56.873133+0000 mgr.gibba045.orlgmj (mgr.34412) 4985 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:22:57.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:22:57 gibba045 bash[25517]: audit 2021-03-10T15:22:57.090633+0000 mon.a (mon.0) 1342 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:22:57.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:22:57 gibba045 bash[25517]: audit 2021-03-10T15:22:57.094328+0000 mon.c (mon.1) 1413 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:22:57.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:22:57 gibba045 bash[25517]: audit 2021-03-10T15:22:57.095778+0000 mon.c (mon.1) 1414 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:22:57.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:22:57 gibba045 bash[25517]: audit 2021-03-10T15:22:57.097415+0000 mon.c (mon.1) 1415 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:22:57.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:22:57 gibba045 bash[25517]: audit 2021-03-10T15:22:57.098793+0000 mon.c (mon.1) 1416 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:22:57.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:22:57 gibba045 bash[25517]: audit 2021-03-10T15:22:57.102225+0000 mon.c (mon.1) 1417 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:22:57.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:22:57 gibba045 bash[25517]: audit 2021-03-10T15:22:57.103752+0000 mon.c (mon.1) 1418 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:22:57.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:22:57 gibba015 bash[29377]: audit 2021-03-10T15:22:56.861593+0000 mon.c (mon.1) 1412 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:22:57.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:22:57 gibba015 bash[29377]: cephadm 2021-03-10T15:22:56.871174+0000 mgr.gibba045.orlgmj (mgr.34412) 4984 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:22:57.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:22:57 gibba015 bash[29377]: cephadm 2021-03-10T15:22:56.873133+0000 mgr.gibba045.orlgmj (mgr.34412) 4985 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:22:57.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:22:57 gibba015 bash[29377]: audit 2021-03-10T15:22:57.090633+0000 mon.a (mon.0) 1342 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:22:57.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:22:57 gibba015 bash[29377]: audit 2021-03-10T15:22:57.094328+0000 mon.c (mon.1) 1413 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:22:57.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:22:57 gibba015 bash[29377]: audit 2021-03-10T15:22:57.095778+0000 mon.c (mon.1) 1414 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:22:57.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:22:57 gibba015 bash[29377]: audit 2021-03-10T15:22:57.097415+0000 mon.c (mon.1) 1415 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:22:57.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:22:57 gibba015 bash[29377]: audit 2021-03-10T15:22:57.098793+0000 mon.c (mon.1) 1416 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:22:57.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:22:57 gibba015 bash[29377]: audit 2021-03-10T15:22:57.102225+0000 mon.c (mon.1) 1417 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:22:57.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:22:57 gibba015 bash[29377]: audit 2021-03-10T15:22:57.103752+0000 mon.c (mon.1) 1418 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:22:57.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:22:57 gibba015 bash[30343]: audit 2021-03-10T15:22:56.861593+0000 mon.c (mon.1) 1412 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:22:57.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:22:57 gibba015 bash[30343]: cephadm 2021-03-10T15:22:56.871174+0000 mgr.gibba045.orlgmj (mgr.34412) 4984 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:22:57.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:22:57 gibba015 bash[30343]: cephadm 2021-03-10T15:22:56.873133+0000 mgr.gibba045.orlgmj (mgr.34412) 4985 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:22:57.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:22:57 gibba015 bash[30343]: audit 2021-03-10T15:22:57.090633+0000 mon.a (mon.0) 1342 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:22:57.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:22:57 gibba015 bash[30343]: audit 2021-03-10T15:22:57.094328+0000 mon.c (mon.1) 1413 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:22:57.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:22:57 gibba015 bash[30343]: audit 2021-03-10T15:22:57.095778+0000 mon.c (mon.1) 1414 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:22:57.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:22:57 gibba015 bash[30343]: audit 2021-03-10T15:22:57.097415+0000 mon.c (mon.1) 1415 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:22:57.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:22:57 gibba015 bash[30343]: audit 2021-03-10T15:22:57.098793+0000 mon.c (mon.1) 1416 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:22:57.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:22:57 gibba015 bash[30343]: audit 2021-03-10T15:22:57.102225+0000 mon.c (mon.1) 1417 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:22:57.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:22:57 gibba015 bash[30343]: audit 2021-03-10T15:22:57.103752+0000 mon.c (mon.1) 1418 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:22:58.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:22:58 gibba015 bash[29377]: cluster 2021-03-10T15:22:57.025169+0000 mgr.gibba045.orlgmj (mgr.34412) 4986 : cluster [DBG] pgmap v2835: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:58.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:22:58 gibba015 bash[29377]: cephadm 2021-03-10T15:22:57.097997+0000 mgr.gibba045.orlgmj (mgr.34412) 4987 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:22:58.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:22:58 gibba015 bash[29377]: cephadm 2021-03-10T15:22:57.099798+0000 mgr.gibba045.orlgmj (mgr.34412) 4988 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:22:58.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:22:58 gibba015 bash[29377]: cephadm 2021-03-10T15:22:57.101198+0000 mgr.gibba045.orlgmj (mgr.34412) 4989 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:22:58.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:22:58 gibba015 bash[29377]: cephadm 2021-03-10T15:22:57.101234+0000 mgr.gibba045.orlgmj (mgr.34412) 4990 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:22:58.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:22:58 gibba015 bash[29377]: cephadm 2021-03-10T15:22:57.102654+0000 mgr.gibba045.orlgmj (mgr.34412) 4991 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:22:58.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:22:58 gibba015 bash[29377]: cephadm 2021-03-10T15:22:57.102690+0000 mgr.gibba045.orlgmj (mgr.34412) 4992 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:22:58.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:22:58 gibba015 bash[29377]: cephadm 2021-03-10T15:22:57.103983+0000 mgr.gibba045.orlgmj (mgr.34412) 4993 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:22:58.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:22:58 gibba015 bash[29377]: cephadm 2021-03-10T15:22:57.105941+0000 mgr.gibba045.orlgmj (mgr.34412) 4994 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:22:58.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:22:58 gibba015 bash[29377]: cephadm 2021-03-10T15:22:57.105976+0000 mgr.gibba045.orlgmj (mgr.34412) 4995 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:22:58.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:22:58 gibba015 bash[29377]: cephadm 2021-03-10T15:22:57.107336+0000 mgr.gibba045.orlgmj (mgr.34412) 4996 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:22:58.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:22:58 gibba015 bash[29377]: cephadm 2021-03-10T15:22:57.107644+0000 mgr.gibba045.orlgmj (mgr.34412) 4997 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:22:58.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:22:58 gibba015 bash[29377]: cephadm 2021-03-10T15:22:57.109100+0000 mgr.gibba045.orlgmj (mgr.34412) 4998 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:22:58.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:22:58 gibba015 bash[29377]: cephadm 2021-03-10T15:22:57.109139+0000 mgr.gibba045.orlgmj (mgr.34412) 4999 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:22:58.729 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:22:58 gibba015 bash[29377]: cephadm 2021-03-10T15:22:57.109316+0000 mgr.gibba045.orlgmj (mgr.34412) 5000 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:22:58.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:22:58 gibba015 bash[30343]: cluster 2021-03-10T15:22:57.025169+0000 mgr.gibba045.orlgmj (mgr.34412) 4986 : cluster [DBG] pgmap v2835: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:58.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:22:58 gibba015 bash[30343]: cephadm 2021-03-10T15:22:57.097997+0000 mgr.gibba045.orlgmj (mgr.34412) 4987 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:22:58.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:22:58 gibba015 bash[30343]: cephadm 2021-03-10T15:22:57.099798+0000 mgr.gibba045.orlgmj (mgr.34412) 4988 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:22:58.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:22:58 gibba015 bash[30343]: cephadm 2021-03-10T15:22:57.101198+0000 mgr.gibba045.orlgmj (mgr.34412) 4989 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:22:58.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:22:58 gibba015 bash[30343]: cephadm 2021-03-10T15:22:57.101234+0000 mgr.gibba045.orlgmj (mgr.34412) 4990 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:22:58.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:22:58 gibba015 bash[30343]: cephadm 2021-03-10T15:22:57.102654+0000 mgr.gibba045.orlgmj (mgr.34412) 4991 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:22:58.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:22:58 gibba015 bash[30343]: cephadm 2021-03-10T15:22:57.102690+0000 mgr.gibba045.orlgmj (mgr.34412) 4992 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:22:58.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:22:58 gibba015 bash[30343]: cephadm 2021-03-10T15:22:57.103983+0000 mgr.gibba045.orlgmj (mgr.34412) 4993 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:22:58.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:22:58 gibba015 bash[30343]: cephadm 2021-03-10T15:22:57.105941+0000 mgr.gibba045.orlgmj (mgr.34412) 4994 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:22:58.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:22:58 gibba015 bash[30343]: cephadm 2021-03-10T15:22:57.105976+0000 mgr.gibba045.orlgmj (mgr.34412) 4995 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:22:58.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:22:58 gibba015 bash[30343]: cephadm 2021-03-10T15:22:57.107336+0000 mgr.gibba045.orlgmj (mgr.34412) 4996 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:22:58.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:22:58 gibba015 bash[30343]: cephadm 2021-03-10T15:22:57.107644+0000 mgr.gibba045.orlgmj (mgr.34412) 4997 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:22:58.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:22:58 gibba015 bash[30343]: cephadm 2021-03-10T15:22:57.109100+0000 mgr.gibba045.orlgmj (mgr.34412) 4998 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:22:58.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:22:58 gibba015 bash[30343]: cephadm 2021-03-10T15:22:57.109139+0000 mgr.gibba045.orlgmj (mgr.34412) 4999 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:22:58.733 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:22:58 gibba015 bash[30343]: cephadm 2021-03-10T15:22:57.109316+0000 mgr.gibba045.orlgmj (mgr.34412) 5000 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:22:58.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:22:58 gibba045 bash[25517]: cluster 2021-03-10T15:22:57.025169+0000 mgr.gibba045.orlgmj (mgr.34412) 4986 : cluster [DBG] pgmap v2835: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:58.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:22:58 gibba045 bash[25517]: cephadm 2021-03-10T15:22:57.097997+0000 mgr.gibba045.orlgmj (mgr.34412) 4987 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:22:58.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:22:58 gibba045 bash[25517]: cephadm 2021-03-10T15:22:57.099798+0000 mgr.gibba045.orlgmj (mgr.34412) 4988 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:22:58.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:22:58 gibba045 bash[25517]: cephadm 2021-03-10T15:22:57.101198+0000 mgr.gibba045.orlgmj (mgr.34412) 4989 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:22:58.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:22:58 gibba045 bash[25517]: cephadm 2021-03-10T15:22:57.101234+0000 mgr.gibba045.orlgmj (mgr.34412) 4990 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:22:58.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:22:58 gibba045 bash[25517]: cephadm 2021-03-10T15:22:57.102654+0000 mgr.gibba045.orlgmj (mgr.34412) 4991 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:22:58.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:22:58 gibba045 bash[25517]: cephadm 2021-03-10T15:22:57.102690+0000 mgr.gibba045.orlgmj (mgr.34412) 4992 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:22:58.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:22:58 gibba045 bash[25517]: cephadm 2021-03-10T15:22:57.103983+0000 mgr.gibba045.orlgmj (mgr.34412) 4993 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:22:58.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:22:58 gibba045 bash[25517]: cephadm 2021-03-10T15:22:57.105941+0000 mgr.gibba045.orlgmj (mgr.34412) 4994 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:22:58.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:22:58 gibba045 bash[25517]: cephadm 2021-03-10T15:22:57.105976+0000 mgr.gibba045.orlgmj (mgr.34412) 4995 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:22:58.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:22:58 gibba045 bash[25517]: cephadm 2021-03-10T15:22:57.107336+0000 mgr.gibba045.orlgmj (mgr.34412) 4996 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:22:58.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:22:58 gibba045 bash[25517]: cephadm 2021-03-10T15:22:57.107644+0000 mgr.gibba045.orlgmj (mgr.34412) 4997 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:22:58.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:22:58 gibba045 bash[25517]: cephadm 2021-03-10T15:22:57.109100+0000 mgr.gibba045.orlgmj (mgr.34412) 4998 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:22:58.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:22:58 gibba045 bash[25517]: cephadm 2021-03-10T15:22:57.109139+0000 mgr.gibba045.orlgmj (mgr.34412) 4999 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:22:58.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:22:58 gibba045 bash[25517]: cephadm 2021-03-10T15:22:57.109316+0000 mgr.gibba045.orlgmj (mgr.34412) 5000 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:23:00.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:23:00 gibba015 bash[29377]: cluster 2021-03-10T15:22:59.026307+0000 mgr.gibba045.orlgmj (mgr.34412) 5001 : cluster [DBG] pgmap v2836: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:00.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:23:00 gibba015 bash[30343]: cluster 2021-03-10T15:22:59.026307+0000 mgr.gibba045.orlgmj (mgr.34412) 5001 : cluster [DBG] pgmap v2836: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:00.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:23:00 gibba045 bash[25517]: cluster 2021-03-10T15:22:59.026307+0000 mgr.gibba045.orlgmj (mgr.34412) 5001 : cluster [DBG] pgmap v2836: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:02.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:23:02 gibba015 bash[29377]: cluster 2021-03-10T15:23:01.027831+0000 mgr.gibba045.orlgmj (mgr.34412) 5002 : cluster [DBG] pgmap v2837: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:02.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:23:02 gibba015 bash[30343]: cluster 2021-03-10T15:23:01.027831+0000 mgr.gibba045.orlgmj (mgr.34412) 5002 : cluster [DBG] pgmap v2837: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:02.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:23:02 gibba045 bash[25517]: cluster 2021-03-10T15:23:01.027831+0000 mgr.gibba045.orlgmj (mgr.34412) 5002 : cluster [DBG] pgmap v2837: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:04.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:23:04 gibba015 bash[29377]: cluster 2021-03-10T15:23:03.029269+0000 mgr.gibba045.orlgmj (mgr.34412) 5003 : cluster [DBG] pgmap v2838: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:04.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:23:04 gibba015 bash[30343]: cluster 2021-03-10T15:23:03.029269+0000 mgr.gibba045.orlgmj (mgr.34412) 5003 : cluster [DBG] pgmap v2838: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:04.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:23:04 gibba045 bash[25517]: cluster 2021-03-10T15:23:03.029269+0000 mgr.gibba045.orlgmj (mgr.34412) 5003 : cluster [DBG] pgmap v2838: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:06.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:23:06 gibba015 bash[29377]: cluster 2021-03-10T15:23:05.030802+0000 mgr.gibba045.orlgmj (mgr.34412) 5004 : cluster [DBG] pgmap v2839: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:06.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:23:06 gibba015 bash[30343]: cluster 2021-03-10T15:23:05.030802+0000 mgr.gibba045.orlgmj (mgr.34412) 5004 : cluster [DBG] pgmap v2839: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:06.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:23:06 gibba045 bash[25517]: cluster 2021-03-10T15:23:05.030802+0000 mgr.gibba045.orlgmj (mgr.34412) 5004 : cluster [DBG] pgmap v2839: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:08.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:23:08 gibba015 bash[29377]: cluster 2021-03-10T15:23:07.032658+0000 mgr.gibba045.orlgmj (mgr.34412) 5005 : cluster [DBG] pgmap v2840: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:08.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:23:08 gibba015 bash[30343]: cluster 2021-03-10T15:23:07.032658+0000 mgr.gibba045.orlgmj (mgr.34412) 5005 : cluster [DBG] pgmap v2840: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:08.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:23:08 gibba045 bash[25517]: cluster 2021-03-10T15:23:07.032658+0000 mgr.gibba045.orlgmj (mgr.34412) 5005 : cluster [DBG] pgmap v2840: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:10.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:23:10 gibba015 bash[29377]: cluster 2021-03-10T15:23:09.034061+0000 mgr.gibba045.orlgmj (mgr.34412) 5006 : cluster [DBG] pgmap v2841: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:10.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:23:10 gibba015 bash[30343]: cluster 2021-03-10T15:23:09.034061+0000 mgr.gibba045.orlgmj (mgr.34412) 5006 : cluster [DBG] pgmap v2841: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:10.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:23:10 gibba045 bash[25517]: cluster 2021-03-10T15:23:09.034061+0000 mgr.gibba045.orlgmj (mgr.34412) 5006 : cluster [DBG] pgmap v2841: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:12.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:23:12 gibba015 bash[29377]: cluster 2021-03-10T15:23:11.035810+0000 mgr.gibba045.orlgmj (mgr.34412) 5007 : cluster [DBG] pgmap v2842: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:12.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:23:12 gibba015 bash[30343]: cluster 2021-03-10T15:23:11.035810+0000 mgr.gibba045.orlgmj (mgr.34412) 5007 : cluster [DBG] pgmap v2842: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:12.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:23:12 gibba045 bash[25517]: cluster 2021-03-10T15:23:11.035810+0000 mgr.gibba045.orlgmj (mgr.34412) 5007 : cluster [DBG] pgmap v2842: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:13.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:23:13 gibba015 bash[29377]: cephadm 2021-03-10T15:23:12.125347+0000 mgr.gibba045.orlgmj (mgr.34412) 5008 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:23:13.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:23:13 gibba015 bash[30343]: cephadm 2021-03-10T15:23:12.125347+0000 mgr.gibba045.orlgmj (mgr.34412) 5008 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:23:13.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:23:13 gibba045 bash[25517]: cephadm 2021-03-10T15:23:12.125347+0000 mgr.gibba045.orlgmj (mgr.34412) 5008 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:23:14.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:23:14 gibba015 bash[29377]: cluster 2021-03-10T15:23:13.037400+0000 mgr.gibba045.orlgmj (mgr.34412) 5009 : cluster [DBG] pgmap v2843: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:14.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:23:14 gibba015 bash[30343]: cluster 2021-03-10T15:23:13.037400+0000 mgr.gibba045.orlgmj (mgr.34412) 5009 : cluster [DBG] pgmap v2843: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:14.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:23:14 gibba045 bash[25517]: cluster 2021-03-10T15:23:13.037400+0000 mgr.gibba045.orlgmj (mgr.34412) 5009 : cluster [DBG] pgmap v2843: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:16.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:23:16 gibba015 bash[29377]: cluster 2021-03-10T15:23:15.038931+0000 mgr.gibba045.orlgmj (mgr.34412) 5010 : cluster [DBG] pgmap v2844: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:16.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:23:16 gibba015 bash[30343]: cluster 2021-03-10T15:23:15.038931+0000 mgr.gibba045.orlgmj (mgr.34412) 5010 : cluster [DBG] pgmap v2844: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:16.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:23:16 gibba045 bash[25517]: cluster 2021-03-10T15:23:15.038931+0000 mgr.gibba045.orlgmj (mgr.34412) 5010 : cluster [DBG] pgmap v2844: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:18.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:23:18 gibba015 bash[29377]: cluster 2021-03-10T15:23:17.040684+0000 mgr.gibba045.orlgmj (mgr.34412) 5011 : cluster [DBG] pgmap v2845: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:18.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:23:18 gibba015 bash[30343]: cluster 2021-03-10T15:23:17.040684+0000 mgr.gibba045.orlgmj (mgr.34412) 5011 : cluster [DBG] pgmap v2845: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:18.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:23:18 gibba045 bash[25517]: cluster 2021-03-10T15:23:17.040684+0000 mgr.gibba045.orlgmj (mgr.34412) 5011 : cluster [DBG] pgmap v2845: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:20.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:23:20 gibba015 bash[29377]: cluster 2021-03-10T15:23:19.041913+0000 mgr.gibba045.orlgmj (mgr.34412) 5012 : cluster [DBG] pgmap v2846: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:20.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:23:20 gibba015 bash[30343]: cluster 2021-03-10T15:23:19.041913+0000 mgr.gibba045.orlgmj (mgr.34412) 5012 : cluster [DBG] pgmap v2846: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:20.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:23:20 gibba045 bash[25517]: cluster 2021-03-10T15:23:19.041913+0000 mgr.gibba045.orlgmj (mgr.34412) 5012 : cluster [DBG] pgmap v2846: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:21.942 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:23:22.169 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:23:22.169 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (94m) 8m ago 99m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:23:22.169 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (99m) 7m ago 99m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:23:22.170 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (94m) 7m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:23:22.170 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (94m) 7m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:23:22.170 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (93m) 8m ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:23:22.170 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (93m) 8m ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:23:22.171 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (93m) 7m ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:23:22.171 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (93m) 8m ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:23:22.171 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (99m) 8m ago 99m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:23:22.171 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (99m) 7m ago 99m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:23:22.172 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (92m) 8m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:23:22.172 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (91m) 8m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:23:22.172 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (91m) 8m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:23:22.172 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (91m) 8m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:23:22.173 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (90m) 7m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:23:22.173 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (90m) 7m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:23:22.173 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (89m) 7m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:23:22.173 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (89m) 7m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:23:22.173 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (98m) 7m ago 99m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:23:22.174 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 7m ago 97m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:23:22.421 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:23:22.421 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:23:22.422 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:23:22.422 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:23:22.423 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:23:22.423 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:23:22.423 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:23:22.424 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:23:22.424 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:23:22.424 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:23:22.424 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:23:22.425 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:23:22.425 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:23:22.425 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:23:22.425 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:23:22.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:23:22 gibba015 bash[29377]: cluster 2021-03-10T15:23:21.043771+0000 mgr.gibba045.orlgmj (mgr.34412) 5013 : cluster [DBG] pgmap v2847: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:22.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:23:22 gibba015 bash[29377]: audit 2021-03-10T15:23:22.416881+0000 mon.a (mon.0) 1343 : audit [DBG] from='client.? 172.21.2.115:0/1967817693' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:23:22.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:23:22 gibba015 bash[30343]: cluster 2021-03-10T15:23:21.043771+0000 mgr.gibba045.orlgmj (mgr.34412) 5013 : cluster [DBG] pgmap v2847: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:22.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:23:22 gibba015 bash[30343]: audit 2021-03-10T15:23:22.416881+0000 mon.a (mon.0) 1343 : audit [DBG] from='client.? 172.21.2.115:0/1967817693' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:23:22.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:23:22 gibba045 bash[25517]: cluster 2021-03-10T15:23:21.043771+0000 mgr.gibba045.orlgmj (mgr.34412) 5013 : cluster [DBG] pgmap v2847: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:22.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:23:22 gibba045 bash[25517]: audit 2021-03-10T15:23:22.416881+0000 mon.a (mon.0) 1343 : audit [DBG] from='client.? 172.21.2.115:0/1967817693' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:23:23.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:23:23 gibba015 bash[29377]: audit 2021-03-10T15:23:21.933150+0000 mgr.gibba045.orlgmj (mgr.34412) 5014 : audit [DBG] from='client.47418 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:23:23.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:23:23 gibba015 bash[29377]: audit 2021-03-10T15:23:22.156549+0000 mgr.gibba045.orlgmj (mgr.34412) 5015 : audit [DBG] from='client.47424 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:23:23.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:23:23 gibba015 bash[30343]: audit 2021-03-10T15:23:21.933150+0000 mgr.gibba045.orlgmj (mgr.34412) 5014 : audit [DBG] from='client.47418 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:23:23.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:23:23 gibba015 bash[30343]: audit 2021-03-10T15:23:22.156549+0000 mgr.gibba045.orlgmj (mgr.34412) 5015 : audit [DBG] from='client.47424 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:23:23.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:23:23 gibba045 bash[25517]: audit 2021-03-10T15:23:21.933150+0000 mgr.gibba045.orlgmj (mgr.34412) 5014 : audit [DBG] from='client.47418 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:23:23.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:23:23 gibba045 bash[25517]: audit 2021-03-10T15:23:22.156549+0000 mgr.gibba045.orlgmj (mgr.34412) 5015 : audit [DBG] from='client.47424 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:23:24.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:23:24 gibba015 bash[29377]: cluster 2021-03-10T15:23:23.045391+0000 mgr.gibba045.orlgmj (mgr.34412) 5016 : cluster [DBG] pgmap v2848: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:24.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:23:24 gibba015 bash[30343]: cluster 2021-03-10T15:23:23.045391+0000 mgr.gibba045.orlgmj (mgr.34412) 5016 : cluster [DBG] pgmap v2848: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:24.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:23:24 gibba045 bash[25517]: cluster 2021-03-10T15:23:23.045391+0000 mgr.gibba045.orlgmj (mgr.34412) 5016 : cluster [DBG] pgmap v2848: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:26.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:23:26 gibba045 bash[25517]: cluster 2021-03-10T15:23:25.047097+0000 mgr.gibba045.orlgmj (mgr.34412) 5017 : cluster [DBG] pgmap v2849: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:26.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:23:26 gibba015 bash[29377]: cluster 2021-03-10T15:23:25.047097+0000 mgr.gibba045.orlgmj (mgr.34412) 5017 : cluster [DBG] pgmap v2849: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:26.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:23:26 gibba015 bash[30343]: cluster 2021-03-10T15:23:25.047097+0000 mgr.gibba045.orlgmj (mgr.34412) 5017 : cluster [DBG] pgmap v2849: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:28.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:23:28 gibba045 bash[25517]: cluster 2021-03-10T15:23:27.048962+0000 mgr.gibba045.orlgmj (mgr.34412) 5018 : cluster [DBG] pgmap v2850: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:28.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:23:28 gibba045 bash[25517]: cephadm 2021-03-10T15:23:27.141143+0000 mgr.gibba045.orlgmj (mgr.34412) 5019 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:23:28.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:23:28 gibba015 bash[29377]: cluster 2021-03-10T15:23:27.048962+0000 mgr.gibba045.orlgmj (mgr.34412) 5018 : cluster [DBG] pgmap v2850: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:28.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:23:28 gibba015 bash[29377]: cephadm 2021-03-10T15:23:27.141143+0000 mgr.gibba045.orlgmj (mgr.34412) 5019 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:23:28.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:23:28 gibba015 bash[30343]: cluster 2021-03-10T15:23:27.048962+0000 mgr.gibba045.orlgmj (mgr.34412) 5018 : cluster [DBG] pgmap v2850: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:28.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:23:28 gibba015 bash[30343]: cephadm 2021-03-10T15:23:27.141143+0000 mgr.gibba045.orlgmj (mgr.34412) 5019 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:23:30.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:23:30 gibba045 bash[25517]: cluster 2021-03-10T15:23:29.050185+0000 mgr.gibba045.orlgmj (mgr.34412) 5020 : cluster [DBG] pgmap v2851: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:30.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:23:30 gibba015 bash[29377]: cluster 2021-03-10T15:23:29.050185+0000 mgr.gibba045.orlgmj (mgr.34412) 5020 : cluster [DBG] pgmap v2851: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:30.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:23:30 gibba015 bash[30343]: cluster 2021-03-10T15:23:29.050185+0000 mgr.gibba045.orlgmj (mgr.34412) 5020 : cluster [DBG] pgmap v2851: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:32.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:23:32 gibba045 bash[25517]: cluster 2021-03-10T15:23:31.051948+0000 mgr.gibba045.orlgmj (mgr.34412) 5021 : cluster [DBG] pgmap v2852: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:32.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:23:32 gibba015 bash[29377]: cluster 2021-03-10T15:23:31.051948+0000 mgr.gibba045.orlgmj (mgr.34412) 5021 : cluster [DBG] pgmap v2852: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:32.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:23:32 gibba015 bash[30343]: cluster 2021-03-10T15:23:31.051948+0000 mgr.gibba045.orlgmj (mgr.34412) 5021 : cluster [DBG] pgmap v2852: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:34.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:23:34 gibba045 bash[25517]: cluster 2021-03-10T15:23:33.053678+0000 mgr.gibba045.orlgmj (mgr.34412) 5022 : cluster [DBG] pgmap v2853: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:34.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:23:34 gibba015 bash[29377]: cluster 2021-03-10T15:23:33.053678+0000 mgr.gibba045.orlgmj (mgr.34412) 5022 : cluster [DBG] pgmap v2853: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:34.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:23:34 gibba015 bash[30343]: cluster 2021-03-10T15:23:33.053678+0000 mgr.gibba045.orlgmj (mgr.34412) 5022 : cluster [DBG] pgmap v2853: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:36.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:23:36 gibba045 bash[25517]: cluster 2021-03-10T15:23:35.055209+0000 mgr.gibba045.orlgmj (mgr.34412) 5023 : cluster [DBG] pgmap v2854: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:36.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:23:36 gibba015 bash[29377]: cluster 2021-03-10T15:23:35.055209+0000 mgr.gibba045.orlgmj (mgr.34412) 5023 : cluster [DBG] pgmap v2854: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:36.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:23:36 gibba015 bash[30343]: cluster 2021-03-10T15:23:35.055209+0000 mgr.gibba045.orlgmj (mgr.34412) 5023 : cluster [DBG] pgmap v2854: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:38.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:23:38 gibba045 bash[25517]: cluster 2021-03-10T15:23:37.057045+0000 mgr.gibba045.orlgmj (mgr.34412) 5024 : cluster [DBG] pgmap v2855: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:38.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:23:38 gibba015 bash[29377]: cluster 2021-03-10T15:23:37.057045+0000 mgr.gibba045.orlgmj (mgr.34412) 5024 : cluster [DBG] pgmap v2855: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:38.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:23:38 gibba015 bash[30343]: cluster 2021-03-10T15:23:37.057045+0000 mgr.gibba045.orlgmj (mgr.34412) 5024 : cluster [DBG] pgmap v2855: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:40.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:23:40 gibba045 bash[25517]: cluster 2021-03-10T15:23:39.058293+0000 mgr.gibba045.orlgmj (mgr.34412) 5025 : cluster [DBG] pgmap v2856: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:40.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:23:40 gibba015 bash[29377]: cluster 2021-03-10T15:23:39.058293+0000 mgr.gibba045.orlgmj (mgr.34412) 5025 : cluster [DBG] pgmap v2856: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:40.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:23:40 gibba015 bash[30343]: cluster 2021-03-10T15:23:39.058293+0000 mgr.gibba045.orlgmj (mgr.34412) 5025 : cluster [DBG] pgmap v2856: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:42.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:23:42 gibba045 bash[25517]: cluster 2021-03-10T15:23:41.059917+0000 mgr.gibba045.orlgmj (mgr.34412) 5026 : cluster [DBG] pgmap v2857: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:42.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:23:42 gibba015 bash[29377]: cluster 2021-03-10T15:23:41.059917+0000 mgr.gibba045.orlgmj (mgr.34412) 5026 : cluster [DBG] pgmap v2857: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:42.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:23:42 gibba015 bash[30343]: cluster 2021-03-10T15:23:41.059917+0000 mgr.gibba045.orlgmj (mgr.34412) 5026 : cluster [DBG] pgmap v2857: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:43.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:23:43 gibba015 bash[29377]: cephadm 2021-03-10T15:23:42.156676+0000 mgr.gibba045.orlgmj (mgr.34412) 5027 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:23:43.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:23:43 gibba015 bash[30343]: cephadm 2021-03-10T15:23:42.156676+0000 mgr.gibba045.orlgmj (mgr.34412) 5027 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:23:44.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:23:43 gibba045 bash[25517]: cephadm 2021-03-10T15:23:42.156676+0000 mgr.gibba045.orlgmj (mgr.34412) 5027 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:23:44.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:23:44 gibba015 bash[29377]: cluster 2021-03-10T15:23:43.061498+0000 mgr.gibba045.orlgmj (mgr.34412) 5028 : cluster [DBG] pgmap v2858: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:44.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:23:44 gibba015 bash[30343]: cluster 2021-03-10T15:23:43.061498+0000 mgr.gibba045.orlgmj (mgr.34412) 5028 : cluster [DBG] pgmap v2858: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:45.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:23:44 gibba045 bash[25517]: cluster 2021-03-10T15:23:43.061498+0000 mgr.gibba045.orlgmj (mgr.34412) 5028 : cluster [DBG] pgmap v2858: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:46.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:23:46 gibba015 bash[29377]: cluster 2021-03-10T15:23:45.063068+0000 mgr.gibba045.orlgmj (mgr.34412) 5029 : cluster [DBG] pgmap v2859: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:46.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:23:46 gibba015 bash[30343]: cluster 2021-03-10T15:23:45.063068+0000 mgr.gibba045.orlgmj (mgr.34412) 5029 : cluster [DBG] pgmap v2859: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:47.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:23:46 gibba045 bash[25517]: cluster 2021-03-10T15:23:45.063068+0000 mgr.gibba045.orlgmj (mgr.34412) 5029 : cluster [DBG] pgmap v2859: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:48.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:23:48 gibba015 bash[29377]: cluster 2021-03-10T15:23:47.064792+0000 mgr.gibba045.orlgmj (mgr.34412) 5030 : cluster [DBG] pgmap v2860: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:48.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:23:48 gibba015 bash[30343]: cluster 2021-03-10T15:23:47.064792+0000 mgr.gibba045.orlgmj (mgr.34412) 5030 : cluster [DBG] pgmap v2860: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:49.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:23:48 gibba045 bash[25517]: cluster 2021-03-10T15:23:47.064792+0000 mgr.gibba045.orlgmj (mgr.34412) 5030 : cluster [DBG] pgmap v2860: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:50.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:23:50 gibba015 bash[29377]: cluster 2021-03-10T15:23:49.066022+0000 mgr.gibba045.orlgmj (mgr.34412) 5031 : cluster [DBG] pgmap v2861: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:50.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:23:50 gibba015 bash[30343]: cluster 2021-03-10T15:23:49.066022+0000 mgr.gibba045.orlgmj (mgr.34412) 5031 : cluster [DBG] pgmap v2861: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:51.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:23:50 gibba045 bash[25517]: cluster 2021-03-10T15:23:49.066022+0000 mgr.gibba045.orlgmj (mgr.34412) 5031 : cluster [DBG] pgmap v2861: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:52.660 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:23:52.890 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:23:52.890 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (94m) 9m ago 99m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:23:52.890 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (99m) 8m ago 99m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:23:52.891 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (95m) 8m ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:23:52.891 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (95m) 8m ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:23:52.891 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (94m) 9m ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:23:52.891 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (94m) 9m ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:23:52.892 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (93m) 8m ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:23:52.892 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (93m) 9m ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:23:52.892 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (100m) 9m ago 100m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:23:52.892 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (100m) 8m ago 100m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:23:52.893 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (92m) 9m ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:23:52.893 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (92m) 9m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:23:52.893 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (92m) 9m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:23:52.893 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (91m) 9m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:23:52.893 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (91m) 8m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:23:52.894 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (90m) 8m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:23:52.894 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (90m) 8m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:23:52.894 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (89m) 8m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:23:52.894 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (99m) 8m ago 100m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:23:52.895 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 8m ago 98m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:23:52.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:23:52 gibba015 bash[29377]: cluster 2021-03-10T15:23:51.067679+0000 mgr.gibba045.orlgmj (mgr.34412) 5032 : cluster [DBG] pgmap v2862: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:52.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:23:52 gibba015 bash[30343]: cluster 2021-03-10T15:23:51.067679+0000 mgr.gibba045.orlgmj (mgr.34412) 5032 : cluster [DBG] pgmap v2862: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:53.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:23:52 gibba045 bash[25517]: cluster 2021-03-10T15:23:51.067679+0000 mgr.gibba045.orlgmj (mgr.34412) 5032 : cluster [DBG] pgmap v2862: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:53.138 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:23:53.138 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:23:53.138 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:23:53.138 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:23:53.139 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:23:53.139 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:23:53.139 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:23:53.139 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:23:53.139 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:23:53.140 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:23:53.140 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:23:53.140 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:23:53.140 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:23:53.141 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:23:53.141 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:23:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:23:53 gibba015 bash[29377]: audit 2021-03-10T15:23:52.651716+0000 mgr.gibba045.orlgmj (mgr.34412) 5033 : audit [DBG] from='client.47436 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:23:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:23:53 gibba015 bash[29377]: audit 2021-03-10T15:23:52.876940+0000 mgr.gibba045.orlgmj (mgr.34412) 5034 : audit [DBG] from='client.57430 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:23:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:23:53 gibba015 bash[29377]: audit 2021-03-10T15:23:53.101836+0000 mon.c (mon.1) 1419 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:23:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:23:53 gibba015 bash[29377]: audit 2021-03-10T15:23:53.101960+0000 mon.c (mon.1) 1420 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:23:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:23:53 gibba015 bash[29377]: audit 2021-03-10T15:23:53.102292+0000 mon.a (mon.0) 1344 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:23:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:23:53 gibba015 bash[29377]: audit 2021-03-10T15:23:53.102292+0000 mon.c (mon.1) 1421 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:23:53.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:23:53 gibba015 bash[29377]: audit 2021-03-10T15:23:53.102514+0000 mon.c (mon.1) 1422 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T15:23:53.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:23:53 gibba015 bash[29377]: audit 2021-03-10T15:23:53.102574+0000 mon.a (mon.0) 1345 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:23:53.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:23:53 gibba015 bash[29377]: audit 2021-03-10T15:23:53.102756+0000 mon.c (mon.1) 1423 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:23:53.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:23:53 gibba015 bash[29377]: audit 2021-03-10T15:23:53.102894+0000 mon.a (mon.0) 1346 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:23:53.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:23:53 gibba015 bash[29377]: audit 2021-03-10T15:23:53.102962+0000 mon.c (mon.1) 1424 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:23:53.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:23:53 gibba015 bash[29377]: audit 2021-03-10T15:23:53.103172+0000 mon.a (mon.0) 1347 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T15:23:53.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:23:53 gibba015 bash[29377]: audit 2021-03-10T15:23:53.103421+0000 mon.a (mon.0) 1348 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:23:53.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:23:53 gibba015 bash[29377]: audit 2021-03-10T15:23:53.103654+0000 mon.a (mon.0) 1349 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:23:53.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:23:53 gibba015 bash[29377]: audit 2021-03-10T15:23:53.133438+0000 mon.c (mon.1) 1425 : audit [DBG] from='client.? 172.21.2.115:0/3487062113' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:23:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:23:53 gibba015 bash[30343]: audit 2021-03-10T15:23:52.651716+0000 mgr.gibba045.orlgmj (mgr.34412) 5033 : audit [DBG] from='client.47436 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:23:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:23:53 gibba015 bash[30343]: audit 2021-03-10T15:23:52.876940+0000 mgr.gibba045.orlgmj (mgr.34412) 5034 : audit [DBG] from='client.57430 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:23:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:23:53 gibba015 bash[30343]: audit 2021-03-10T15:23:53.101836+0000 mon.c (mon.1) 1419 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:23:53.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:23:53 gibba015 bash[30343]: audit 2021-03-10T15:23:53.101960+0000 mon.c (mon.1) 1420 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:23:53.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:23:53 gibba015 bash[30343]: audit 2021-03-10T15:23:53.102292+0000 mon.a (mon.0) 1344 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:23:53.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:23:53 gibba015 bash[30343]: audit 2021-03-10T15:23:53.102292+0000 mon.c (mon.1) 1421 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:23:53.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:23:53 gibba015 bash[30343]: audit 2021-03-10T15:23:53.102514+0000 mon.c (mon.1) 1422 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T15:23:53.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:23:53 gibba015 bash[30343]: audit 2021-03-10T15:23:53.102574+0000 mon.a (mon.0) 1345 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:23:53.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:23:53 gibba015 bash[30343]: audit 2021-03-10T15:23:53.102756+0000 mon.c (mon.1) 1423 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:23:53.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:23:53 gibba015 bash[30343]: audit 2021-03-10T15:23:53.102894+0000 mon.a (mon.0) 1346 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:23:53.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:23:53 gibba015 bash[30343]: audit 2021-03-10T15:23:53.102962+0000 mon.c (mon.1) 1424 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:23:53.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:23:53 gibba015 bash[30343]: audit 2021-03-10T15:23:53.103172+0000 mon.a (mon.0) 1347 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T15:23:53.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:23:53 gibba015 bash[30343]: audit 2021-03-10T15:23:53.103421+0000 mon.a (mon.0) 1348 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:23:53.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:23:53 gibba015 bash[30343]: audit 2021-03-10T15:23:53.103654+0000 mon.a (mon.0) 1349 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:23:53.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:23:53 gibba015 bash[30343]: audit 2021-03-10T15:23:53.133438+0000 mon.c (mon.1) 1425 : audit [DBG] from='client.? 172.21.2.115:0/3487062113' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:23:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:23:53 gibba045 bash[25517]: audit 2021-03-10T15:23:52.651716+0000 mgr.gibba045.orlgmj (mgr.34412) 5033 : audit [DBG] from='client.47436 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:23:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:23:53 gibba045 bash[25517]: audit 2021-03-10T15:23:52.876940+0000 mgr.gibba045.orlgmj (mgr.34412) 5034 : audit [DBG] from='client.57430 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:23:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:23:53 gibba045 bash[25517]: audit 2021-03-10T15:23:53.101836+0000 mon.c (mon.1) 1419 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:23:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:23:53 gibba045 bash[25517]: audit 2021-03-10T15:23:53.101960+0000 mon.c (mon.1) 1420 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:23:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:23:53 gibba045 bash[25517]: audit 2021-03-10T15:23:53.102292+0000 mon.a (mon.0) 1344 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:23:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:23:53 gibba045 bash[25517]: audit 2021-03-10T15:23:53.102292+0000 mon.c (mon.1) 1421 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:23:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:23:53 gibba045 bash[25517]: audit 2021-03-10T15:23:53.102514+0000 mon.c (mon.1) 1422 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T15:23:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:23:53 gibba045 bash[25517]: audit 2021-03-10T15:23:53.102574+0000 mon.a (mon.0) 1345 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:23:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:23:53 gibba045 bash[25517]: audit 2021-03-10T15:23:53.102756+0000 mon.c (mon.1) 1423 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:23:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:23:53 gibba045 bash[25517]: audit 2021-03-10T15:23:53.102894+0000 mon.a (mon.0) 1346 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:23:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:23:53 gibba045 bash[25517]: audit 2021-03-10T15:23:53.102962+0000 mon.c (mon.1) 1424 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:23:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:23:53 gibba045 bash[25517]: audit 2021-03-10T15:23:53.103172+0000 mon.a (mon.0) 1347 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T15:23:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:23:53 gibba045 bash[25517]: audit 2021-03-10T15:23:53.103421+0000 mon.a (mon.0) 1348 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:23:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:23:53 gibba045 bash[25517]: audit 2021-03-10T15:23:53.103654+0000 mon.a (mon.0) 1349 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:23:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:23:53 gibba045 bash[25517]: audit 2021-03-10T15:23:53.133438+0000 mon.c (mon.1) 1425 : audit [DBG] from='client.? 172.21.2.115:0/3487062113' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:23:54.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:23:54 gibba015 bash[29377]: cluster 2021-03-10T15:23:53.069240+0000 mgr.gibba045.orlgmj (mgr.34412) 5035 : cluster [DBG] pgmap v2863: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:54.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:23:54 gibba015 bash[30343]: cluster 2021-03-10T15:23:53.069240+0000 mgr.gibba045.orlgmj (mgr.34412) 5035 : cluster [DBG] pgmap v2863: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:55.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:23:54 gibba045 bash[25517]: cluster 2021-03-10T15:23:53.069240+0000 mgr.gibba045.orlgmj (mgr.34412) 5035 : cluster [DBG] pgmap v2863: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:56.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:23:56 gibba015 bash[29377]: cluster 2021-03-10T15:23:55.070656+0000 mgr.gibba045.orlgmj (mgr.34412) 5036 : cluster [DBG] pgmap v2864: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:56.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:23:56 gibba015 bash[30343]: cluster 2021-03-10T15:23:55.070656+0000 mgr.gibba045.orlgmj (mgr.34412) 5036 : cluster [DBG] pgmap v2864: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:57.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:23:56 gibba045 bash[25517]: cluster 2021-03-10T15:23:55.070656+0000 mgr.gibba045.orlgmj (mgr.34412) 5036 : cluster [DBG] pgmap v2864: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:57.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:23:57 gibba045 bash[25517]: audit 2021-03-10T15:23:57.169047+0000 mon.c (mon.1) 1426 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:23:57.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:23:57 gibba045 bash[25517]: audit 2021-03-10T15:23:57.379965+0000 mon.a (mon.0) 1350 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:23:57.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:23:57 gibba045 bash[25517]: audit 2021-03-10T15:23:57.383542+0000 mon.c (mon.1) 1427 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:23:57.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:23:57 gibba045 bash[25517]: audit 2021-03-10T15:23:57.385386+0000 mon.c (mon.1) 1428 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:23:57.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:23:57 gibba045 bash[25517]: audit 2021-03-10T15:23:57.387241+0000 mon.c (mon.1) 1429 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:23:57.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:23:57 gibba045 bash[25517]: audit 2021-03-10T15:23:57.388808+0000 mon.c (mon.1) 1430 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:23:57.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:23:57 gibba045 bash[25517]: audit 2021-03-10T15:23:57.393070+0000 mon.c (mon.1) 1431 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:23:57.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:23:57 gibba045 bash[25517]: audit 2021-03-10T15:23:57.394912+0000 mon.c (mon.1) 1432 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:23:57.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:23:57 gibba015 bash[29377]: audit 2021-03-10T15:23:57.169047+0000 mon.c (mon.1) 1426 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:23:57.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:23:57 gibba015 bash[29377]: audit 2021-03-10T15:23:57.379965+0000 mon.a (mon.0) 1350 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:23:57.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:23:57 gibba015 bash[29377]: audit 2021-03-10T15:23:57.383542+0000 mon.c (mon.1) 1427 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:23:57.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:23:57 gibba015 bash[29377]: audit 2021-03-10T15:23:57.385386+0000 mon.c (mon.1) 1428 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:23:57.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:23:57 gibba015 bash[29377]: audit 2021-03-10T15:23:57.387241+0000 mon.c (mon.1) 1429 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:23:57.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:23:57 gibba015 bash[29377]: audit 2021-03-10T15:23:57.388808+0000 mon.c (mon.1) 1430 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:23:57.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:23:57 gibba015 bash[29377]: audit 2021-03-10T15:23:57.393070+0000 mon.c (mon.1) 1431 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:23:57.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:23:57 gibba015 bash[29377]: audit 2021-03-10T15:23:57.394912+0000 mon.c (mon.1) 1432 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:23:57.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:23:57 gibba015 bash[30343]: audit 2021-03-10T15:23:57.169047+0000 mon.c (mon.1) 1426 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:23:57.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:23:57 gibba015 bash[30343]: audit 2021-03-10T15:23:57.379965+0000 mon.a (mon.0) 1350 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:23:57.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:23:57 gibba015 bash[30343]: audit 2021-03-10T15:23:57.383542+0000 mon.c (mon.1) 1427 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:23:57.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:23:57 gibba015 bash[30343]: audit 2021-03-10T15:23:57.385386+0000 mon.c (mon.1) 1428 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:23:57.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:23:57 gibba015 bash[30343]: audit 2021-03-10T15:23:57.387241+0000 mon.c (mon.1) 1429 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:23:57.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:23:57 gibba015 bash[30343]: audit 2021-03-10T15:23:57.388808+0000 mon.c (mon.1) 1430 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:23:57.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:23:57 gibba015 bash[30343]: audit 2021-03-10T15:23:57.393070+0000 mon.c (mon.1) 1431 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:23:57.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:23:57 gibba015 bash[30343]: audit 2021-03-10T15:23:57.394912+0000 mon.c (mon.1) 1432 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:23:58.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:23:58 gibba015 bash[29377]: cluster 2021-03-10T15:23:57.072309+0000 mgr.gibba045.orlgmj (mgr.34412) 5037 : cluster [DBG] pgmap v2865: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:58.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:23:58 gibba015 bash[29377]: cephadm 2021-03-10T15:23:57.176655+0000 mgr.gibba045.orlgmj (mgr.34412) 5038 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:23:58.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:23:58 gibba015 bash[29377]: cephadm 2021-03-10T15:23:57.177210+0000 mgr.gibba045.orlgmj (mgr.34412) 5039 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:23:58.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:23:58 gibba015 bash[29377]: cephadm 2021-03-10T15:23:57.387071+0000 mgr.gibba045.orlgmj (mgr.34412) 5040 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:23:58.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:23:58 gibba015 bash[29377]: cephadm 2021-03-10T15:23:57.389234+0000 mgr.gibba045.orlgmj (mgr.34412) 5041 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:23:58.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:23:58 gibba015 bash[29377]: cephadm 2021-03-10T15:23:57.391057+0000 mgr.gibba045.orlgmj (mgr.34412) 5042 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:23:58.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:23:58 gibba015 bash[29377]: cephadm 2021-03-10T15:23:57.391092+0000 mgr.gibba045.orlgmj (mgr.34412) 5043 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:23:58.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:23:58 gibba015 bash[29377]: cephadm 2021-03-10T15:23:57.392675+0000 mgr.gibba045.orlgmj (mgr.34412) 5044 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:23:58.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:23:58 gibba015 bash[29377]: cephadm 2021-03-10T15:23:57.392709+0000 mgr.gibba045.orlgmj (mgr.34412) 5045 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:23:58.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:23:58 gibba015 bash[29377]: cephadm 2021-03-10T15:23:57.394372+0000 mgr.gibba045.orlgmj (mgr.34412) 5046 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:23:58.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:23:58 gibba015 bash[29377]: cephadm 2021-03-10T15:23:57.396642+0000 mgr.gibba045.orlgmj (mgr.34412) 5047 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:23:58.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:23:58 gibba015 bash[29377]: cephadm 2021-03-10T15:23:57.396677+0000 mgr.gibba045.orlgmj (mgr.34412) 5048 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:23:58.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:23:58 gibba015 bash[29377]: cephadm 2021-03-10T15:23:57.398462+0000 mgr.gibba045.orlgmj (mgr.34412) 5049 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:23:58.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:23:58 gibba015 bash[29377]: cephadm 2021-03-10T15:23:57.398790+0000 mgr.gibba045.orlgmj (mgr.34412) 5050 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:23:58.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:23:58 gibba015 bash[29377]: cephadm 2021-03-10T15:23:57.400154+0000 mgr.gibba045.orlgmj (mgr.34412) 5051 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:23:58.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:23:58 gibba015 bash[29377]: cephadm 2021-03-10T15:23:57.400191+0000 mgr.gibba045.orlgmj (mgr.34412) 5052 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:23:58.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:23:58 gibba015 bash[29377]: cephadm 2021-03-10T15:23:57.400296+0000 mgr.gibba045.orlgmj (mgr.34412) 5053 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:23:58.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:23:58 gibba015 bash[30343]: cluster 2021-03-10T15:23:57.072309+0000 mgr.gibba045.orlgmj (mgr.34412) 5037 : cluster [DBG] pgmap v2865: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:58.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:23:58 gibba015 bash[30343]: cephadm 2021-03-10T15:23:57.176655+0000 mgr.gibba045.orlgmj (mgr.34412) 5038 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:23:58.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:23:58 gibba015 bash[30343]: cephadm 2021-03-10T15:23:57.177210+0000 mgr.gibba045.orlgmj (mgr.34412) 5039 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:23:58.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:23:58 gibba015 bash[30343]: cephadm 2021-03-10T15:23:57.387071+0000 mgr.gibba045.orlgmj (mgr.34412) 5040 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:23:58.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:23:58 gibba015 bash[30343]: cephadm 2021-03-10T15:23:57.389234+0000 mgr.gibba045.orlgmj (mgr.34412) 5041 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:23:58.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:23:58 gibba015 bash[30343]: cephadm 2021-03-10T15:23:57.391057+0000 mgr.gibba045.orlgmj (mgr.34412) 5042 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:23:58.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:23:58 gibba015 bash[30343]: cephadm 2021-03-10T15:23:57.391092+0000 mgr.gibba045.orlgmj (mgr.34412) 5043 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:23:58.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:23:58 gibba015 bash[30343]: cephadm 2021-03-10T15:23:57.392675+0000 mgr.gibba045.orlgmj (mgr.34412) 5044 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:23:58.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:23:58 gibba015 bash[30343]: cephadm 2021-03-10T15:23:57.392709+0000 mgr.gibba045.orlgmj (mgr.34412) 5045 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:23:58.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:23:58 gibba015 bash[30343]: cephadm 2021-03-10T15:23:57.394372+0000 mgr.gibba045.orlgmj (mgr.34412) 5046 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:23:58.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:23:58 gibba015 bash[30343]: cephadm 2021-03-10T15:23:57.396642+0000 mgr.gibba045.orlgmj (mgr.34412) 5047 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:23:58.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:23:58 gibba015 bash[30343]: cephadm 2021-03-10T15:23:57.396677+0000 mgr.gibba045.orlgmj (mgr.34412) 5048 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:23:58.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:23:58 gibba015 bash[30343]: cephadm 2021-03-10T15:23:57.398462+0000 mgr.gibba045.orlgmj (mgr.34412) 5049 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:23:58.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:23:58 gibba015 bash[30343]: cephadm 2021-03-10T15:23:57.398790+0000 mgr.gibba045.orlgmj (mgr.34412) 5050 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:23:58.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:23:58 gibba015 bash[30343]: cephadm 2021-03-10T15:23:57.400154+0000 mgr.gibba045.orlgmj (mgr.34412) 5051 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:23:58.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:23:58 gibba015 bash[30343]: cephadm 2021-03-10T15:23:57.400191+0000 mgr.gibba045.orlgmj (mgr.34412) 5052 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:23:58.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:23:58 gibba015 bash[30343]: cephadm 2021-03-10T15:23:57.400296+0000 mgr.gibba045.orlgmj (mgr.34412) 5053 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:23:59.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:23:58 gibba045 bash[25517]: cluster 2021-03-10T15:23:57.072309+0000 mgr.gibba045.orlgmj (mgr.34412) 5037 : cluster [DBG] pgmap v2865: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:59.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:23:58 gibba045 bash[25517]: cephadm 2021-03-10T15:23:57.176655+0000 mgr.gibba045.orlgmj (mgr.34412) 5038 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:23:59.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:23:58 gibba045 bash[25517]: cephadm 2021-03-10T15:23:57.177210+0000 mgr.gibba045.orlgmj (mgr.34412) 5039 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:23:59.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:23:58 gibba045 bash[25517]: cephadm 2021-03-10T15:23:57.387071+0000 mgr.gibba045.orlgmj (mgr.34412) 5040 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:23:59.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:23:58 gibba045 bash[25517]: cephadm 2021-03-10T15:23:57.389234+0000 mgr.gibba045.orlgmj (mgr.34412) 5041 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:23:59.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:23:58 gibba045 bash[25517]: cephadm 2021-03-10T15:23:57.391057+0000 mgr.gibba045.orlgmj (mgr.34412) 5042 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:23:59.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:23:58 gibba045 bash[25517]: cephadm 2021-03-10T15:23:57.391092+0000 mgr.gibba045.orlgmj (mgr.34412) 5043 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:23:59.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:23:58 gibba045 bash[25517]: cephadm 2021-03-10T15:23:57.392675+0000 mgr.gibba045.orlgmj (mgr.34412) 5044 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:23:59.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:23:58 gibba045 bash[25517]: cephadm 2021-03-10T15:23:57.392709+0000 mgr.gibba045.orlgmj (mgr.34412) 5045 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:23:59.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:23:58 gibba045 bash[25517]: cephadm 2021-03-10T15:23:57.394372+0000 mgr.gibba045.orlgmj (mgr.34412) 5046 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:23:59.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:23:58 gibba045 bash[25517]: cephadm 2021-03-10T15:23:57.396642+0000 mgr.gibba045.orlgmj (mgr.34412) 5047 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:23:59.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:23:58 gibba045 bash[25517]: cephadm 2021-03-10T15:23:57.396677+0000 mgr.gibba045.orlgmj (mgr.34412) 5048 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:23:59.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:23:58 gibba045 bash[25517]: cephadm 2021-03-10T15:23:57.398462+0000 mgr.gibba045.orlgmj (mgr.34412) 5049 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:23:59.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:23:58 gibba045 bash[25517]: cephadm 2021-03-10T15:23:57.398790+0000 mgr.gibba045.orlgmj (mgr.34412) 5050 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:23:59.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:23:58 gibba045 bash[25517]: cephadm 2021-03-10T15:23:57.400154+0000 mgr.gibba045.orlgmj (mgr.34412) 5051 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:23:59.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:23:58 gibba045 bash[25517]: cephadm 2021-03-10T15:23:57.400191+0000 mgr.gibba045.orlgmj (mgr.34412) 5052 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:23:59.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:23:58 gibba045 bash[25517]: cephadm 2021-03-10T15:23:57.400296+0000 mgr.gibba045.orlgmj (mgr.34412) 5053 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:24:00.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:24:00 gibba015 bash[29377]: cluster 2021-03-10T15:23:59.073655+0000 mgr.gibba045.orlgmj (mgr.34412) 5054 : cluster [DBG] pgmap v2866: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:00.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:24:00 gibba015 bash[30343]: cluster 2021-03-10T15:23:59.073655+0000 mgr.gibba045.orlgmj (mgr.34412) 5054 : cluster [DBG] pgmap v2866: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:01.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:24:00 gibba045 bash[25517]: cluster 2021-03-10T15:23:59.073655+0000 mgr.gibba045.orlgmj (mgr.34412) 5054 : cluster [DBG] pgmap v2866: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:02.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:24:02 gibba015 bash[29377]: cluster 2021-03-10T15:24:01.075469+0000 mgr.gibba045.orlgmj (mgr.34412) 5055 : cluster [DBG] pgmap v2867: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:02.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:24:02 gibba015 bash[30343]: cluster 2021-03-10T15:24:01.075469+0000 mgr.gibba045.orlgmj (mgr.34412) 5055 : cluster [DBG] pgmap v2867: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:03.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:24:02 gibba045 bash[25517]: cluster 2021-03-10T15:24:01.075469+0000 mgr.gibba045.orlgmj (mgr.34412) 5055 : cluster [DBG] pgmap v2867: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:04.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:24:04 gibba015 bash[30343]: cluster 2021-03-10T15:24:03.077195+0000 mgr.gibba045.orlgmj (mgr.34412) 5056 : cluster [DBG] pgmap v2868: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:04.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:24:04 gibba015 bash[29377]: cluster 2021-03-10T15:24:03.077195+0000 mgr.gibba045.orlgmj (mgr.34412) 5056 : cluster [DBG] pgmap v2868: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:05.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:24:04 gibba045 bash[25517]: cluster 2021-03-10T15:24:03.077195+0000 mgr.gibba045.orlgmj (mgr.34412) 5056 : cluster [DBG] pgmap v2868: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:06.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:24:06 gibba015 bash[29377]: cluster 2021-03-10T15:24:05.078835+0000 mgr.gibba045.orlgmj (mgr.34412) 5057 : cluster [DBG] pgmap v2869: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:06.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:24:06 gibba015 bash[30343]: cluster 2021-03-10T15:24:05.078835+0000 mgr.gibba045.orlgmj (mgr.34412) 5057 : cluster [DBG] pgmap v2869: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:07.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:24:06 gibba045 bash[25517]: cluster 2021-03-10T15:24:05.078835+0000 mgr.gibba045.orlgmj (mgr.34412) 5057 : cluster [DBG] pgmap v2869: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:08.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:24:08 gibba015 bash[29377]: cluster 2021-03-10T15:24:07.080696+0000 mgr.gibba045.orlgmj (mgr.34412) 5058 : cluster [DBG] pgmap v2870: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:08.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:24:08 gibba015 bash[30343]: cluster 2021-03-10T15:24:07.080696+0000 mgr.gibba045.orlgmj (mgr.34412) 5058 : cluster [DBG] pgmap v2870: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:09.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:24:08 gibba045 bash[25517]: cluster 2021-03-10T15:24:07.080696+0000 mgr.gibba045.orlgmj (mgr.34412) 5058 : cluster [DBG] pgmap v2870: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:10.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:24:10 gibba015 bash[29377]: cluster 2021-03-10T15:24:09.081908+0000 mgr.gibba045.orlgmj (mgr.34412) 5059 : cluster [DBG] pgmap v2871: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:10.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:24:10 gibba015 bash[30343]: cluster 2021-03-10T15:24:09.081908+0000 mgr.gibba045.orlgmj (mgr.34412) 5059 : cluster [DBG] pgmap v2871: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:11.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:24:10 gibba045 bash[25517]: cluster 2021-03-10T15:24:09.081908+0000 mgr.gibba045.orlgmj (mgr.34412) 5059 : cluster [DBG] pgmap v2871: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:12.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:24:12 gibba015 bash[29377]: cluster 2021-03-10T15:24:11.083579+0000 mgr.gibba045.orlgmj (mgr.34412) 5060 : cluster [DBG] pgmap v2872: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:12.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:24:12 gibba015 bash[30343]: cluster 2021-03-10T15:24:11.083579+0000 mgr.gibba045.orlgmj (mgr.34412) 5060 : cluster [DBG] pgmap v2872: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:13.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:24:12 gibba045 bash[25517]: cluster 2021-03-10T15:24:11.083579+0000 mgr.gibba045.orlgmj (mgr.34412) 5060 : cluster [DBG] pgmap v2872: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:13.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:24:13 gibba015 bash[29377]: cephadm 2021-03-10T15:24:12.411773+0000 mgr.gibba045.orlgmj (mgr.34412) 5061 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:24:13.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:24:13 gibba015 bash[30343]: cephadm 2021-03-10T15:24:12.411773+0000 mgr.gibba045.orlgmj (mgr.34412) 5061 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:24:14.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:24:13 gibba045 bash[25517]: cephadm 2021-03-10T15:24:12.411773+0000 mgr.gibba045.orlgmj (mgr.34412) 5061 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:24:14.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:24:14 gibba015 bash[29377]: cluster 2021-03-10T15:24:13.085191+0000 mgr.gibba045.orlgmj (mgr.34412) 5062 : cluster [DBG] pgmap v2873: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:14.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:24:14 gibba015 bash[30343]: cluster 2021-03-10T15:24:13.085191+0000 mgr.gibba045.orlgmj (mgr.34412) 5062 : cluster [DBG] pgmap v2873: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:15.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:24:14 gibba045 bash[25517]: cluster 2021-03-10T15:24:13.085191+0000 mgr.gibba045.orlgmj (mgr.34412) 5062 : cluster [DBG] pgmap v2873: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:17.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:24:16 gibba045 bash[25517]: cluster 2021-03-10T15:24:15.086633+0000 mgr.gibba045.orlgmj (mgr.34412) 5063 : cluster [DBG] pgmap v2874: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:17.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:24:16 gibba015 bash[29377]: cluster 2021-03-10T15:24:15.086633+0000 mgr.gibba045.orlgmj (mgr.34412) 5063 : cluster [DBG] pgmap v2874: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:17.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:24:16 gibba015 bash[30343]: cluster 2021-03-10T15:24:15.086633+0000 mgr.gibba045.orlgmj (mgr.34412) 5063 : cluster [DBG] pgmap v2874: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:19.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:24:18 gibba045 bash[25517]: cluster 2021-03-10T15:24:17.088282+0000 mgr.gibba045.orlgmj (mgr.34412) 5064 : cluster [DBG] pgmap v2875: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:19.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:24:18 gibba015 bash[29377]: cluster 2021-03-10T15:24:17.088282+0000 mgr.gibba045.orlgmj (mgr.34412) 5064 : cluster [DBG] pgmap v2875: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:19.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:24:18 gibba015 bash[30343]: cluster 2021-03-10T15:24:17.088282+0000 mgr.gibba045.orlgmj (mgr.34412) 5064 : cluster [DBG] pgmap v2875: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:21.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:24:20 gibba045 bash[25517]: cluster 2021-03-10T15:24:19.089553+0000 mgr.gibba045.orlgmj (mgr.34412) 5065 : cluster [DBG] pgmap v2876: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:21.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:24:20 gibba015 bash[29377]: cluster 2021-03-10T15:24:19.089553+0000 mgr.gibba045.orlgmj (mgr.34412) 5065 : cluster [DBG] pgmap v2876: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:21.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:24:20 gibba015 bash[30343]: cluster 2021-03-10T15:24:19.089553+0000 mgr.gibba045.orlgmj (mgr.34412) 5065 : cluster [DBG] pgmap v2876: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:23.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:24:22 gibba045 bash[25517]: cluster 2021-03-10T15:24:21.091165+0000 mgr.gibba045.orlgmj (mgr.34412) 5066 : cluster [DBG] pgmap v2877: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:23.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:24:22 gibba015 bash[29377]: cluster 2021-03-10T15:24:21.091165+0000 mgr.gibba045.orlgmj (mgr.34412) 5066 : cluster [DBG] pgmap v2877: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:23.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:24:22 gibba015 bash[30343]: cluster 2021-03-10T15:24:21.091165+0000 mgr.gibba045.orlgmj (mgr.34412) 5066 : cluster [DBG] pgmap v2877: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:23.380 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:24:23.606 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:24:23.606 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (95m) 9m ago 100m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:24:23.606 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (100m) 8m ago 100m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:24:23.607 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (95m) 8m ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:24:23.607 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (95m) 8m ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:24:23.607 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (94m) 9m ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:24:23.607 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (94m) 9m ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:24:23.608 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (94m) 8m ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:24:23.608 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (94m) 9m ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:24:23.608 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (100m) 9m ago 100m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:24:23.609 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (100m) 8m ago 100m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:24:23.609 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (93m) 9m ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:24:23.609 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (92m) 9m ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:24:23.609 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (92m) 9m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:24:23.610 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (92m) 9m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:24:23.610 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (91m) 8m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:24:23.610 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (91m) 8m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:24:23.610 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (90m) 8m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:24:23.611 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (90m) 8m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:24:23.611 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (99m) 8m ago 100m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:24:23.611 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 8m ago 98m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:24:23.855 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:24:23.855 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:24:23.856 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:24:23.856 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:24:23.856 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:24:23.856 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:24:23.857 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:24:23.857 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:24:23.857 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:24:23.857 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:24:23.857 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:24:23.858 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:24:23.858 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:24:23.858 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:24:23.858 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:24:25.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:24:24 gibba045 bash[25517]: cluster 2021-03-10T15:24:23.092747+0000 mgr.gibba045.orlgmj (mgr.34412) 5067 : cluster [DBG] pgmap v2878: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:25.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:24:24 gibba045 bash[25517]: audit 2021-03-10T15:24:23.371243+0000 mgr.gibba045.orlgmj (mgr.34412) 5068 : audit [DBG] from='client.57442 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:24:25.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:24:24 gibba045 bash[25517]: audit 2021-03-10T15:24:23.593548+0000 mgr.gibba045.orlgmj (mgr.34412) 5069 : audit [DBG] from='client.57448 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:24:25.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:24:24 gibba045 bash[25517]: audit 2021-03-10T15:24:23.851059+0000 mon.c (mon.1) 1433 : audit [DBG] from='client.? 172.21.2.115:0/2536977418' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:24:25.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:24:24 gibba015 bash[29377]: cluster 2021-03-10T15:24:23.092747+0000 mgr.gibba045.orlgmj (mgr.34412) 5067 : cluster [DBG] pgmap v2878: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:25.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:24:24 gibba015 bash[29377]: audit 2021-03-10T15:24:23.371243+0000 mgr.gibba045.orlgmj (mgr.34412) 5068 : audit [DBG] from='client.57442 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:24:25.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:24:24 gibba015 bash[29377]: audit 2021-03-10T15:24:23.593548+0000 mgr.gibba045.orlgmj (mgr.34412) 5069 : audit [DBG] from='client.57448 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:24:25.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:24:24 gibba015 bash[29377]: audit 2021-03-10T15:24:23.851059+0000 mon.c (mon.1) 1433 : audit [DBG] from='client.? 172.21.2.115:0/2536977418' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:24:25.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:24:24 gibba015 bash[30343]: cluster 2021-03-10T15:24:23.092747+0000 mgr.gibba045.orlgmj (mgr.34412) 5067 : cluster [DBG] pgmap v2878: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:25.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:24:24 gibba015 bash[30343]: audit 2021-03-10T15:24:23.371243+0000 mgr.gibba045.orlgmj (mgr.34412) 5068 : audit [DBG] from='client.57442 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:24:25.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:24:24 gibba015 bash[30343]: audit 2021-03-10T15:24:23.593548+0000 mgr.gibba045.orlgmj (mgr.34412) 5069 : audit [DBG] from='client.57448 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:24:25.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:24:24 gibba015 bash[30343]: audit 2021-03-10T15:24:23.851059+0000 mon.c (mon.1) 1433 : audit [DBG] from='client.? 172.21.2.115:0/2536977418' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:24:27.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:24:26 gibba045 bash[25517]: cluster 2021-03-10T15:24:25.094161+0000 mgr.gibba045.orlgmj (mgr.34412) 5070 : cluster [DBG] pgmap v2879: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:27.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:24:26 gibba015 bash[29377]: cluster 2021-03-10T15:24:25.094161+0000 mgr.gibba045.orlgmj (mgr.34412) 5070 : cluster [DBG] pgmap v2879: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:27.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:24:26 gibba015 bash[30343]: cluster 2021-03-10T15:24:25.094161+0000 mgr.gibba045.orlgmj (mgr.34412) 5070 : cluster [DBG] pgmap v2879: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:29.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:24:28 gibba045 bash[25517]: cluster 2021-03-10T15:24:27.095806+0000 mgr.gibba045.orlgmj (mgr.34412) 5071 : cluster [DBG] pgmap v2880: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:29.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:24:28 gibba045 bash[25517]: cephadm 2021-03-10T15:24:27.425365+0000 mgr.gibba045.orlgmj (mgr.34412) 5072 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:24:29.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:24:28 gibba015 bash[29377]: cluster 2021-03-10T15:24:27.095806+0000 mgr.gibba045.orlgmj (mgr.34412) 5071 : cluster [DBG] pgmap v2880: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:29.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:24:28 gibba015 bash[29377]: cephadm 2021-03-10T15:24:27.425365+0000 mgr.gibba045.orlgmj (mgr.34412) 5072 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:24:29.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:24:28 gibba015 bash[30343]: cluster 2021-03-10T15:24:27.095806+0000 mgr.gibba045.orlgmj (mgr.34412) 5071 : cluster [DBG] pgmap v2880: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:29.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:24:28 gibba015 bash[30343]: cephadm 2021-03-10T15:24:27.425365+0000 mgr.gibba045.orlgmj (mgr.34412) 5072 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:24:31.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:24:30 gibba045 bash[25517]: cluster 2021-03-10T15:24:29.097041+0000 mgr.gibba045.orlgmj (mgr.34412) 5073 : cluster [DBG] pgmap v2881: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:31.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:24:30 gibba015 bash[29377]: cluster 2021-03-10T15:24:29.097041+0000 mgr.gibba045.orlgmj (mgr.34412) 5073 : cluster [DBG] pgmap v2881: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:31.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:24:30 gibba015 bash[30343]: cluster 2021-03-10T15:24:29.097041+0000 mgr.gibba045.orlgmj (mgr.34412) 5073 : cluster [DBG] pgmap v2881: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:33.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:24:32 gibba045 bash[25517]: cluster 2021-03-10T15:24:31.098581+0000 mgr.gibba045.orlgmj (mgr.34412) 5074 : cluster [DBG] pgmap v2882: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:33.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:24:32 gibba015 bash[29377]: cluster 2021-03-10T15:24:31.098581+0000 mgr.gibba045.orlgmj (mgr.34412) 5074 : cluster [DBG] pgmap v2882: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:33.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:24:32 gibba015 bash[30343]: cluster 2021-03-10T15:24:31.098581+0000 mgr.gibba045.orlgmj (mgr.34412) 5074 : cluster [DBG] pgmap v2882: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:35.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:24:34 gibba015 bash[29377]: cluster 2021-03-10T15:24:33.100037+0000 mgr.gibba045.orlgmj (mgr.34412) 5075 : cluster [DBG] pgmap v2883: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:35.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:24:34 gibba015 bash[30343]: cluster 2021-03-10T15:24:33.100037+0000 mgr.gibba045.orlgmj (mgr.34412) 5075 : cluster [DBG] pgmap v2883: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:35.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:24:34 gibba045 bash[25517]: cluster 2021-03-10T15:24:33.100037+0000 mgr.gibba045.orlgmj (mgr.34412) 5075 : cluster [DBG] pgmap v2883: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:37.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:24:36 gibba015 bash[29377]: cluster 2021-03-10T15:24:35.101766+0000 mgr.gibba045.orlgmj (mgr.34412) 5076 : cluster [DBG] pgmap v2884: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:37.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:24:36 gibba015 bash[30343]: cluster 2021-03-10T15:24:35.101766+0000 mgr.gibba045.orlgmj (mgr.34412) 5076 : cluster [DBG] pgmap v2884: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:37.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:24:36 gibba045 bash[25517]: cluster 2021-03-10T15:24:35.101766+0000 mgr.gibba045.orlgmj (mgr.34412) 5076 : cluster [DBG] pgmap v2884: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:39.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:24:38 gibba015 bash[29377]: cluster 2021-03-10T15:24:37.103582+0000 mgr.gibba045.orlgmj (mgr.34412) 5077 : cluster [DBG] pgmap v2885: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:39.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:24:38 gibba015 bash[30343]: cluster 2021-03-10T15:24:37.103582+0000 mgr.gibba045.orlgmj (mgr.34412) 5077 : cluster [DBG] pgmap v2885: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:39.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:24:38 gibba045 bash[25517]: cluster 2021-03-10T15:24:37.103582+0000 mgr.gibba045.orlgmj (mgr.34412) 5077 : cluster [DBG] pgmap v2885: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:41.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:24:40 gibba015 bash[29377]: cluster 2021-03-10T15:24:39.104826+0000 mgr.gibba045.orlgmj (mgr.34412) 5078 : cluster [DBG] pgmap v2886: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:41.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:24:40 gibba015 bash[30343]: cluster 2021-03-10T15:24:39.104826+0000 mgr.gibba045.orlgmj (mgr.34412) 5078 : cluster [DBG] pgmap v2886: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:41.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:24:40 gibba045 bash[25517]: cluster 2021-03-10T15:24:39.104826+0000 mgr.gibba045.orlgmj (mgr.34412) 5078 : cluster [DBG] pgmap v2886: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:43.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:24:42 gibba015 bash[29377]: cluster 2021-03-10T15:24:41.106592+0000 mgr.gibba045.orlgmj (mgr.34412) 5079 : cluster [DBG] pgmap v2887: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:43.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:24:42 gibba015 bash[30343]: cluster 2021-03-10T15:24:41.106592+0000 mgr.gibba045.orlgmj (mgr.34412) 5079 : cluster [DBG] pgmap v2887: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:43.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:24:42 gibba045 bash[25517]: cluster 2021-03-10T15:24:41.106592+0000 mgr.gibba045.orlgmj (mgr.34412) 5079 : cluster [DBG] pgmap v2887: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:44.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:24:43 gibba015 bash[29377]: cephadm 2021-03-10T15:24:42.426451+0000 mgr.gibba045.orlgmj (mgr.34412) 5080 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:24:44.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:24:43 gibba015 bash[30343]: cephadm 2021-03-10T15:24:42.426451+0000 mgr.gibba045.orlgmj (mgr.34412) 5080 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:24:44.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:24:43 gibba045 bash[25517]: cephadm 2021-03-10T15:24:42.426451+0000 mgr.gibba045.orlgmj (mgr.34412) 5080 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:24:45.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:24:44 gibba015 bash[29377]: cluster 2021-03-10T15:24:43.108309+0000 mgr.gibba045.orlgmj (mgr.34412) 5081 : cluster [DBG] pgmap v2888: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:45.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:24:44 gibba015 bash[30343]: cluster 2021-03-10T15:24:43.108309+0000 mgr.gibba045.orlgmj (mgr.34412) 5081 : cluster [DBG] pgmap v2888: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:45.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:24:44 gibba045 bash[25517]: cluster 2021-03-10T15:24:43.108309+0000 mgr.gibba045.orlgmj (mgr.34412) 5081 : cluster [DBG] pgmap v2888: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:47.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:24:46 gibba015 bash[29377]: cluster 2021-03-10T15:24:45.109732+0000 mgr.gibba045.orlgmj (mgr.34412) 5082 : cluster [DBG] pgmap v2889: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:47.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:24:46 gibba015 bash[30343]: cluster 2021-03-10T15:24:45.109732+0000 mgr.gibba045.orlgmj (mgr.34412) 5082 : cluster [DBG] pgmap v2889: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:47.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:24:46 gibba045 bash[25517]: cluster 2021-03-10T15:24:45.109732+0000 mgr.gibba045.orlgmj (mgr.34412) 5082 : cluster [DBG] pgmap v2889: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:49.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:24:48 gibba015 bash[29377]: cluster 2021-03-10T15:24:47.111394+0000 mgr.gibba045.orlgmj (mgr.34412) 5083 : cluster [DBG] pgmap v2890: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:49.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:24:48 gibba015 bash[30343]: cluster 2021-03-10T15:24:47.111394+0000 mgr.gibba045.orlgmj (mgr.34412) 5083 : cluster [DBG] pgmap v2890: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:49.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:24:48 gibba045 bash[25517]: cluster 2021-03-10T15:24:47.111394+0000 mgr.gibba045.orlgmj (mgr.34412) 5083 : cluster [DBG] pgmap v2890: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:51.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:24:50 gibba015 bash[29377]: cluster 2021-03-10T15:24:49.113026+0000 mgr.gibba045.orlgmj (mgr.34412) 5084 : cluster [DBG] pgmap v2891: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:51.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:24:50 gibba015 bash[30343]: cluster 2021-03-10T15:24:49.113026+0000 mgr.gibba045.orlgmj (mgr.34412) 5084 : cluster [DBG] pgmap v2891: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:51.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:24:50 gibba045 bash[25517]: cluster 2021-03-10T15:24:49.113026+0000 mgr.gibba045.orlgmj (mgr.34412) 5084 : cluster [DBG] pgmap v2891: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:53.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:24:52 gibba015 bash[29377]: cluster 2021-03-10T15:24:51.114974+0000 mgr.gibba045.orlgmj (mgr.34412) 5085 : cluster [DBG] pgmap v2892: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:53.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:24:52 gibba015 bash[30343]: cluster 2021-03-10T15:24:51.114974+0000 mgr.gibba045.orlgmj (mgr.34412) 5085 : cluster [DBG] pgmap v2892: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:53.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:24:52 gibba045 bash[25517]: cluster 2021-03-10T15:24:51.114974+0000 mgr.gibba045.orlgmj (mgr.34412) 5085 : cluster [DBG] pgmap v2892: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:54.104 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:24:54.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:24:53 gibba015 bash[29377]: audit 2021-03-10T15:24:53.109871+0000 mon.c (mon.1) 1434 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:24:54.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:24:53 gibba015 bash[29377]: audit 2021-03-10T15:24:53.110755+0000 mon.c (mon.1) 1435 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:24:54.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:24:53 gibba015 bash[29377]: audit 2021-03-10T15:24:53.110974+0000 mon.a (mon.0) 1351 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:24:54.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:24:53 gibba015 bash[29377]: audit 2021-03-10T15:24:53.111620+0000 mon.c (mon.1) 1436 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T15:24:54.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:24:53 gibba015 bash[29377]: audit 2021-03-10T15:24:53.112200+0000 mon.a (mon.0) 1352 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:24:54.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:24:53 gibba015 bash[29377]: audit 2021-03-10T15:24:53.112736+0000 mon.c (mon.1) 1437 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 5]}]: dispatch 2021-03-10T15:24:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:24:53 gibba015 bash[29377]: audit 2021-03-10T15:24:53.112913+0000 mon.a (mon.0) 1353 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T15:24:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:24:53 gibba015 bash[29377]: audit 2021-03-10T15:24:53.113900+0000 mon.c (mon.1) 1438 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:24:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:24:53 gibba015 bash[29377]: audit 2021-03-10T15:24:53.114242+0000 mon.a (mon.0) 1354 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 5]}]: dispatch 2021-03-10T15:24:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:24:53 gibba015 bash[29377]: audit 2021-03-10T15:24:53.114623+0000 mon.c (mon.1) 1439 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:24:54.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:24:53 gibba015 bash[29377]: audit 2021-03-10T15:24:53.114716+0000 mon.a (mon.0) 1355 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:24:54.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:24:53 gibba015 bash[29377]: audit 2021-03-10T15:24:53.115045+0000 mon.a (mon.0) 1356 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:24:54.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:24:53 gibba015 bash[30343]: audit 2021-03-10T15:24:53.109871+0000 mon.c (mon.1) 1434 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:24:54.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:24:53 gibba015 bash[30343]: audit 2021-03-10T15:24:53.110755+0000 mon.c (mon.1) 1435 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:24:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:24:53 gibba015 bash[30343]: audit 2021-03-10T15:24:53.110974+0000 mon.a (mon.0) 1351 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:24:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:24:53 gibba015 bash[30343]: audit 2021-03-10T15:24:53.111620+0000 mon.c (mon.1) 1436 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T15:24:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:24:53 gibba015 bash[30343]: audit 2021-03-10T15:24:53.112200+0000 mon.a (mon.0) 1352 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:24:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:24:53 gibba015 bash[30343]: audit 2021-03-10T15:24:53.112736+0000 mon.c (mon.1) 1437 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 5]}]: dispatch 2021-03-10T15:24:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:24:53 gibba015 bash[30343]: audit 2021-03-10T15:24:53.112913+0000 mon.a (mon.0) 1353 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T15:24:54.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:24:53 gibba015 bash[30343]: audit 2021-03-10T15:24:53.113900+0000 mon.c (mon.1) 1438 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:24:54.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:24:53 gibba015 bash[30343]: audit 2021-03-10T15:24:53.114242+0000 mon.a (mon.0) 1354 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 5]}]: dispatch 2021-03-10T15:24:54.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:24:53 gibba015 bash[30343]: audit 2021-03-10T15:24:53.114623+0000 mon.c (mon.1) 1439 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:24:54.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:24:53 gibba015 bash[30343]: audit 2021-03-10T15:24:53.114716+0000 mon.a (mon.0) 1355 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:24:54.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:24:53 gibba015 bash[30343]: audit 2021-03-10T15:24:53.115045+0000 mon.a (mon.0) 1356 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:24:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:24:53 gibba045 bash[25517]: audit 2021-03-10T15:24:53.109871+0000 mon.c (mon.1) 1434 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:24:54.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:24:53 gibba045 bash[25517]: audit 2021-03-10T15:24:53.110755+0000 mon.c (mon.1) 1435 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:24:54.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:24:53 gibba045 bash[25517]: audit 2021-03-10T15:24:53.110974+0000 mon.a (mon.0) 1351 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:24:54.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:24:53 gibba045 bash[25517]: audit 2021-03-10T15:24:53.111620+0000 mon.c (mon.1) 1436 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T15:24:54.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:24:53 gibba045 bash[25517]: audit 2021-03-10T15:24:53.112200+0000 mon.a (mon.0) 1352 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:24:54.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:24:53 gibba045 bash[25517]: audit 2021-03-10T15:24:53.112736+0000 mon.c (mon.1) 1437 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 5]}]: dispatch 2021-03-10T15:24:54.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:24:53 gibba045 bash[25517]: audit 2021-03-10T15:24:53.112913+0000 mon.a (mon.0) 1353 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T15:24:54.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:24:53 gibba045 bash[25517]: audit 2021-03-10T15:24:53.113900+0000 mon.c (mon.1) 1438 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:24:54.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:24:53 gibba045 bash[25517]: audit 2021-03-10T15:24:53.114242+0000 mon.a (mon.0) 1354 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 5]}]: dispatch 2021-03-10T15:24:54.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:24:53 gibba045 bash[25517]: audit 2021-03-10T15:24:53.114623+0000 mon.c (mon.1) 1439 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:24:54.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:24:53 gibba045 bash[25517]: audit 2021-03-10T15:24:53.114716+0000 mon.a (mon.0) 1355 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:24:54.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:24:53 gibba045 bash[25517]: audit 2021-03-10T15:24:53.115045+0000 mon.a (mon.0) 1356 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:24:54.332 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:24:54.332 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (95m) 10m ago 100m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:24:54.332 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (100m) 9m ago 100m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:24:54.332 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (96m) 9m ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:24:54.333 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (96m) 9m ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:24:54.333 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (95m) 10m ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:24:54.333 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (95m) 10m ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:24:54.333 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (94m) 9m ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:24:54.334 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (94m) 10m ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:24:54.334 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (101m) 10m ago 101m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:24:54.334 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (101m) 9m ago 101m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:24:54.334 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (93m) 10m ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:24:54.335 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (93m) 10m ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:24:54.335 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (93m) 10m ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:24:54.335 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (92m) 10m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:24:54.335 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (92m) 9m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:24:54.335 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (91m) 9m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:24:54.336 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (91m) 9m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:24:54.336 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (90m) 9m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:24:54.336 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (100m) 9m ago 101m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:24:54.336 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 9m ago 99m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:24:54.615 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:24:54.616 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:24:54.616 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:24:54.616 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:24:54.616 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:24:54.617 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:24:54.617 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:24:54.617 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:24:54.617 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:24:54.618 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:24:54.618 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:24:54.618 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:24:54.618 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:24:54.619 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:24:54.619 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:24:55.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:24:54 gibba015 bash[29377]: cluster 2021-03-10T15:24:53.115485+0000 mgr.gibba045.orlgmj (mgr.34412) 5086 : cluster [DBG] pgmap v2893: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:55.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:24:54 gibba015 bash[29377]: audit 2021-03-10T15:24:54.611110+0000 mon.c (mon.1) 1440 : audit [DBG] from='client.? 172.21.2.115:0/3873781130' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:24:55.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:24:54 gibba015 bash[30343]: cluster 2021-03-10T15:24:53.115485+0000 mgr.gibba045.orlgmj (mgr.34412) 5086 : cluster [DBG] pgmap v2893: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:55.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:24:54 gibba015 bash[30343]: audit 2021-03-10T15:24:54.611110+0000 mon.c (mon.1) 1440 : audit [DBG] from='client.? 172.21.2.115:0/3873781130' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:24:55.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:24:54 gibba045 bash[25517]: cluster 2021-03-10T15:24:53.115485+0000 mgr.gibba045.orlgmj (mgr.34412) 5086 : cluster [DBG] pgmap v2893: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:55.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:24:54 gibba045 bash[25517]: audit 2021-03-10T15:24:54.611110+0000 mon.c (mon.1) 1440 : audit [DBG] from='client.? 172.21.2.115:0/3873781130' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:24:56.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:24:55 gibba015 bash[29377]: audit 2021-03-10T15:24:54.093552+0000 mgr.gibba045.orlgmj (mgr.34412) 5087 : audit [DBG] from='client.47472 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:24:56.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:24:55 gibba015 bash[29377]: audit 2021-03-10T15:24:54.319100+0000 mgr.gibba045.orlgmj (mgr.34412) 5088 : audit [DBG] from='client.47478 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:24:56.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:24:55 gibba015 bash[30343]: audit 2021-03-10T15:24:54.093552+0000 mgr.gibba045.orlgmj (mgr.34412) 5087 : audit [DBG] from='client.47472 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:24:56.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:24:55 gibba015 bash[30343]: audit 2021-03-10T15:24:54.319100+0000 mgr.gibba045.orlgmj (mgr.34412) 5088 : audit [DBG] from='client.47478 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:24:56.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:24:55 gibba045 bash[25517]: audit 2021-03-10T15:24:54.093552+0000 mgr.gibba045.orlgmj (mgr.34412) 5087 : audit [DBG] from='client.47472 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:24:56.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:24:55 gibba045 bash[25517]: audit 2021-03-10T15:24:54.319100+0000 mgr.gibba045.orlgmj (mgr.34412) 5088 : audit [DBG] from='client.47478 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:24:57.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:24:56 gibba015 bash[29377]: cluster 2021-03-10T15:24:55.117032+0000 mgr.gibba045.orlgmj (mgr.34412) 5089 : cluster [DBG] pgmap v2894: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:57.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:24:56 gibba015 bash[30343]: cluster 2021-03-10T15:24:55.117032+0000 mgr.gibba045.orlgmj (mgr.34412) 5089 : cluster [DBG] pgmap v2894: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:57.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:24:56 gibba045 bash[25517]: cluster 2021-03-10T15:24:55.117032+0000 mgr.gibba045.orlgmj (mgr.34412) 5089 : cluster [DBG] pgmap v2894: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:58.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:24:57 gibba015 bash[29377]: audit 2021-03-10T15:24:57.439214+0000 mon.c (mon.1) 1441 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:24:58.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:24:57 gibba015 bash[29377]: audit 2021-03-10T15:24:57.446664+0000 mon.c (mon.1) 1442 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:24:58.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:24:57 gibba015 bash[30343]: audit 2021-03-10T15:24:57.439214+0000 mon.c (mon.1) 1441 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:24:58.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:24:57 gibba015 bash[30343]: audit 2021-03-10T15:24:57.446664+0000 mon.c (mon.1) 1442 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:24:58.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:24:57 gibba045 bash[25517]: audit 2021-03-10T15:24:57.439214+0000 mon.c (mon.1) 1441 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:24:58.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:24:57 gibba045 bash[25517]: audit 2021-03-10T15:24:57.446664+0000 mon.c (mon.1) 1442 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:24:59.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:24:58 gibba015 bash[29377]: cluster 2021-03-10T15:24:57.118677+0000 mgr.gibba045.orlgmj (mgr.34412) 5090 : cluster [DBG] pgmap v2895: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:59.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:24:58 gibba015 bash[29377]: cephadm 2021-03-10T15:24:57.450395+0000 mgr.gibba045.orlgmj (mgr.34412) 5091 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:24:59.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:24:58 gibba015 bash[30343]: cluster 2021-03-10T15:24:57.118677+0000 mgr.gibba045.orlgmj (mgr.34412) 5090 : cluster [DBG] pgmap v2895: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:59.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:24:58 gibba015 bash[30343]: cephadm 2021-03-10T15:24:57.450395+0000 mgr.gibba045.orlgmj (mgr.34412) 5091 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:24:59.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:24:58 gibba045 bash[25517]: cluster 2021-03-10T15:24:57.118677+0000 mgr.gibba045.orlgmj (mgr.34412) 5090 : cluster [DBG] pgmap v2895: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:59.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:24:58 gibba045 bash[25517]: cephadm 2021-03-10T15:24:57.450395+0000 mgr.gibba045.orlgmj (mgr.34412) 5091 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:25:00.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:25:00 gibba045 bash[25517]: cluster 2021-03-10T15:24:59.119931+0000 mgr.gibba045.orlgmj (mgr.34412) 5092 : cluster [DBG] pgmap v2896: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:00.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:25:00 gibba015 bash[29377]: cluster 2021-03-10T15:24:59.119931+0000 mgr.gibba045.orlgmj (mgr.34412) 5092 : cluster [DBG] pgmap v2896: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:00.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:25:00 gibba015 bash[30343]: cluster 2021-03-10T15:24:59.119931+0000 mgr.gibba045.orlgmj (mgr.34412) 5092 : cluster [DBG] pgmap v2896: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:02.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:25:01 gibba015 bash[29377]: audit 2021-03-10T15:25:00.917256+0000 mon.a (mon.0) 1357 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:25:02.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:25:01 gibba015 bash[29377]: cephadm 2021-03-10T15:25:00.922325+0000 mgr.gibba045.orlgmj (mgr.34412) 5093 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:25:02.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:25:01 gibba015 bash[29377]: audit 2021-03-10T15:25:01.115846+0000 mon.a (mon.0) 1358 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:25:02.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:25:01 gibba015 bash[29377]: audit 2021-03-10T15:25:01.124177+0000 mon.c (mon.1) 1443 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:25:02.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:25:01 gibba015 bash[29377]: audit 2021-03-10T15:25:01.125836+0000 mon.c (mon.1) 1444 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:25:02.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:25:01 gibba015 bash[29377]: audit 2021-03-10T15:25:01.127262+0000 mon.c (mon.1) 1445 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:25:02.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:25:01 gibba015 bash[29377]: audit 2021-03-10T15:25:01.128602+0000 mon.c (mon.1) 1446 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:25:02.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:25:01 gibba015 bash[29377]: audit 2021-03-10T15:25:01.132247+0000 mon.c (mon.1) 1447 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:25:02.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:25:01 gibba015 bash[29377]: audit 2021-03-10T15:25:01.134637+0000 mon.c (mon.1) 1448 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:25:02.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:25:01 gibba015 bash[30343]: audit 2021-03-10T15:25:00.917256+0000 mon.a (mon.0) 1357 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:25:02.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:25:01 gibba015 bash[30343]: cephadm 2021-03-10T15:25:00.922325+0000 mgr.gibba045.orlgmj (mgr.34412) 5093 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:25:02.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:25:01 gibba015 bash[30343]: audit 2021-03-10T15:25:01.115846+0000 mon.a (mon.0) 1358 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:25:02.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:25:01 gibba015 bash[30343]: audit 2021-03-10T15:25:01.124177+0000 mon.c (mon.1) 1443 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:25:02.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:25:01 gibba015 bash[30343]: audit 2021-03-10T15:25:01.125836+0000 mon.c (mon.1) 1444 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:25:02.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:25:01 gibba015 bash[30343]: audit 2021-03-10T15:25:01.127262+0000 mon.c (mon.1) 1445 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:25:02.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:25:01 gibba015 bash[30343]: audit 2021-03-10T15:25:01.128602+0000 mon.c (mon.1) 1446 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:25:02.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:25:01 gibba015 bash[30343]: audit 2021-03-10T15:25:01.132247+0000 mon.c (mon.1) 1447 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:25:02.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:25:01 gibba015 bash[30343]: audit 2021-03-10T15:25:01.134637+0000 mon.c (mon.1) 1448 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:25:02.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:25:01 gibba045 bash[25517]: audit 2021-03-10T15:25:00.917256+0000 mon.a (mon.0) 1357 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:25:02.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:25:01 gibba045 bash[25517]: cephadm 2021-03-10T15:25:00.922325+0000 mgr.gibba045.orlgmj (mgr.34412) 5093 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:25:02.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:25:01 gibba045 bash[25517]: audit 2021-03-10T15:25:01.115846+0000 mon.a (mon.0) 1358 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:25:02.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:25:01 gibba045 bash[25517]: audit 2021-03-10T15:25:01.124177+0000 mon.c (mon.1) 1443 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:25:02.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:25:01 gibba045 bash[25517]: audit 2021-03-10T15:25:01.125836+0000 mon.c (mon.1) 1444 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:25:02.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:25:01 gibba045 bash[25517]: audit 2021-03-10T15:25:01.127262+0000 mon.c (mon.1) 1445 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:25:02.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:25:01 gibba045 bash[25517]: audit 2021-03-10T15:25:01.128602+0000 mon.c (mon.1) 1446 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:25:02.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:25:01 gibba045 bash[25517]: audit 2021-03-10T15:25:01.132247+0000 mon.c (mon.1) 1447 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:25:02.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:25:01 gibba045 bash[25517]: audit 2021-03-10T15:25:01.134637+0000 mon.c (mon.1) 1448 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:25:03.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:25:02 gibba015 bash[29377]: cluster 2021-03-10T15:25:01.121470+0000 mgr.gibba045.orlgmj (mgr.34412) 5094 : cluster [DBG] pgmap v2897: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:03.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:25:02 gibba015 bash[29377]: cephadm 2021-03-10T15:25:01.127343+0000 mgr.gibba045.orlgmj (mgr.34412) 5095 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:25:03.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:25:02 gibba015 bash[29377]: cephadm 2021-03-10T15:25:01.129368+0000 mgr.gibba045.orlgmj (mgr.34412) 5096 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:25:03.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:25:02 gibba015 bash[29377]: cephadm 2021-03-10T15:25:01.130898+0000 mgr.gibba045.orlgmj (mgr.34412) 5097 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:25:03.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:25:02 gibba015 bash[29377]: cephadm 2021-03-10T15:25:01.130946+0000 mgr.gibba045.orlgmj (mgr.34412) 5098 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:25:03.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:25:02 gibba015 bash[29377]: cephadm 2021-03-10T15:25:01.132325+0000 mgr.gibba045.orlgmj (mgr.34412) 5099 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:25:03.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:25:02 gibba015 bash[29377]: cephadm 2021-03-10T15:25:01.132370+0000 mgr.gibba045.orlgmj (mgr.34412) 5100 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:25:03.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:25:02 gibba015 bash[29377]: cephadm 2021-03-10T15:25:01.133631+0000 mgr.gibba045.orlgmj (mgr.34412) 5101 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:25:03.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:25:02 gibba015 bash[29377]: cephadm 2021-03-10T15:25:01.135770+0000 mgr.gibba045.orlgmj (mgr.34412) 5102 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:25:03.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:25:02 gibba015 bash[29377]: cephadm 2021-03-10T15:25:01.135821+0000 mgr.gibba045.orlgmj (mgr.34412) 5103 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:25:03.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:25:02 gibba015 bash[29377]: cephadm 2021-03-10T15:25:01.137909+0000 mgr.gibba045.orlgmj (mgr.34412) 5104 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:25:03.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:25:02 gibba015 bash[29377]: cephadm 2021-03-10T15:25:01.138371+0000 mgr.gibba045.orlgmj (mgr.34412) 5105 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:25:03.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:25:02 gibba015 bash[29377]: cephadm 2021-03-10T15:25:01.139918+0000 mgr.gibba045.orlgmj (mgr.34412) 5106 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:25:03.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:25:02 gibba015 bash[29377]: cephadm 2021-03-10T15:25:01.139970+0000 mgr.gibba045.orlgmj (mgr.34412) 5107 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:25:03.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:25:02 gibba015 bash[29377]: cephadm 2021-03-10T15:25:01.140110+0000 mgr.gibba045.orlgmj (mgr.34412) 5108 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:25:03.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:25:02 gibba015 bash[30343]: cluster 2021-03-10T15:25:01.121470+0000 mgr.gibba045.orlgmj (mgr.34412) 5094 : cluster [DBG] pgmap v2897: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:03.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:25:02 gibba015 bash[30343]: cephadm 2021-03-10T15:25:01.127343+0000 mgr.gibba045.orlgmj (mgr.34412) 5095 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:25:03.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:25:02 gibba015 bash[30343]: cephadm 2021-03-10T15:25:01.129368+0000 mgr.gibba045.orlgmj (mgr.34412) 5096 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:25:03.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:25:02 gibba015 bash[30343]: cephadm 2021-03-10T15:25:01.130898+0000 mgr.gibba045.orlgmj (mgr.34412) 5097 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:25:03.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:25:02 gibba015 bash[30343]: cephadm 2021-03-10T15:25:01.130946+0000 mgr.gibba045.orlgmj (mgr.34412) 5098 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:25:03.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:25:02 gibba015 bash[30343]: cephadm 2021-03-10T15:25:01.132325+0000 mgr.gibba045.orlgmj (mgr.34412) 5099 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:25:03.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:25:02 gibba015 bash[30343]: cephadm 2021-03-10T15:25:01.132370+0000 mgr.gibba045.orlgmj (mgr.34412) 5100 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:25:03.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:25:02 gibba015 bash[30343]: cephadm 2021-03-10T15:25:01.133631+0000 mgr.gibba045.orlgmj (mgr.34412) 5101 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:25:03.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:25:02 gibba015 bash[30343]: cephadm 2021-03-10T15:25:01.135770+0000 mgr.gibba045.orlgmj (mgr.34412) 5102 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:25:03.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:25:02 gibba015 bash[30343]: cephadm 2021-03-10T15:25:01.135821+0000 mgr.gibba045.orlgmj (mgr.34412) 5103 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:25:03.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:25:02 gibba015 bash[30343]: cephadm 2021-03-10T15:25:01.137909+0000 mgr.gibba045.orlgmj (mgr.34412) 5104 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:25:03.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:25:02 gibba015 bash[30343]: cephadm 2021-03-10T15:25:01.138371+0000 mgr.gibba045.orlgmj (mgr.34412) 5105 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:25:03.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:25:02 gibba015 bash[30343]: cephadm 2021-03-10T15:25:01.139918+0000 mgr.gibba045.orlgmj (mgr.34412) 5106 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:25:03.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:25:02 gibba015 bash[30343]: cephadm 2021-03-10T15:25:01.139970+0000 mgr.gibba045.orlgmj (mgr.34412) 5107 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:25:03.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:25:02 gibba015 bash[30343]: cephadm 2021-03-10T15:25:01.140110+0000 mgr.gibba045.orlgmj (mgr.34412) 5108 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:25:03.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:25:02 gibba045 bash[25517]: cluster 2021-03-10T15:25:01.121470+0000 mgr.gibba045.orlgmj (mgr.34412) 5094 : cluster [DBG] pgmap v2897: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:03.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:25:02 gibba045 bash[25517]: cephadm 2021-03-10T15:25:01.127343+0000 mgr.gibba045.orlgmj (mgr.34412) 5095 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:25:03.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:25:02 gibba045 bash[25517]: cephadm 2021-03-10T15:25:01.129368+0000 mgr.gibba045.orlgmj (mgr.34412) 5096 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:25:03.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:25:02 gibba045 bash[25517]: cephadm 2021-03-10T15:25:01.130898+0000 mgr.gibba045.orlgmj (mgr.34412) 5097 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:25:03.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:25:02 gibba045 bash[25517]: cephadm 2021-03-10T15:25:01.130946+0000 mgr.gibba045.orlgmj (mgr.34412) 5098 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:25:03.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:25:02 gibba045 bash[25517]: cephadm 2021-03-10T15:25:01.132325+0000 mgr.gibba045.orlgmj (mgr.34412) 5099 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:25:03.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:25:02 gibba045 bash[25517]: cephadm 2021-03-10T15:25:01.132370+0000 mgr.gibba045.orlgmj (mgr.34412) 5100 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:25:03.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:25:02 gibba045 bash[25517]: cephadm 2021-03-10T15:25:01.133631+0000 mgr.gibba045.orlgmj (mgr.34412) 5101 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:25:03.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:25:02 gibba045 bash[25517]: cephadm 2021-03-10T15:25:01.135770+0000 mgr.gibba045.orlgmj (mgr.34412) 5102 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:25:03.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:25:02 gibba045 bash[25517]: cephadm 2021-03-10T15:25:01.135821+0000 mgr.gibba045.orlgmj (mgr.34412) 5103 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:25:03.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:25:02 gibba045 bash[25517]: cephadm 2021-03-10T15:25:01.137909+0000 mgr.gibba045.orlgmj (mgr.34412) 5104 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:25:03.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:25:02 gibba045 bash[25517]: cephadm 2021-03-10T15:25:01.138371+0000 mgr.gibba045.orlgmj (mgr.34412) 5105 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:25:03.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:25:02 gibba045 bash[25517]: cephadm 2021-03-10T15:25:01.139918+0000 mgr.gibba045.orlgmj (mgr.34412) 5106 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:25:03.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:25:02 gibba045 bash[25517]: cephadm 2021-03-10T15:25:01.139970+0000 mgr.gibba045.orlgmj (mgr.34412) 5107 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:25:03.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:25:02 gibba045 bash[25517]: cephadm 2021-03-10T15:25:01.140110+0000 mgr.gibba045.orlgmj (mgr.34412) 5108 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:25:05.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:25:04 gibba015 bash[29377]: cluster 2021-03-10T15:25:03.122954+0000 mgr.gibba045.orlgmj (mgr.34412) 5109 : cluster [DBG] pgmap v2898: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:05.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:25:04 gibba015 bash[30343]: cluster 2021-03-10T15:25:03.122954+0000 mgr.gibba045.orlgmj (mgr.34412) 5109 : cluster [DBG] pgmap v2898: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:05.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:25:04 gibba045 bash[25517]: cluster 2021-03-10T15:25:03.122954+0000 mgr.gibba045.orlgmj (mgr.34412) 5109 : cluster [DBG] pgmap v2898: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:06.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:25:05 gibba015 bash[29377]: cluster 2021-03-10T15:25:05.124685+0000 mgr.gibba045.orlgmj (mgr.34412) 5110 : cluster [DBG] pgmap v2899: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:06.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:25:05 gibba015 bash[30343]: cluster 2021-03-10T15:25:05.124685+0000 mgr.gibba045.orlgmj (mgr.34412) 5110 : cluster [DBG] pgmap v2899: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:06.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:25:05 gibba045 bash[25517]: cluster 2021-03-10T15:25:05.124685+0000 mgr.gibba045.orlgmj (mgr.34412) 5110 : cluster [DBG] pgmap v2899: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:08.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:25:08 gibba015 bash[29377]: cluster 2021-03-10T15:25:07.126263+0000 mgr.gibba045.orlgmj (mgr.34412) 5111 : cluster [DBG] pgmap v2900: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:08.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:25:08 gibba015 bash[30343]: cluster 2021-03-10T15:25:07.126263+0000 mgr.gibba045.orlgmj (mgr.34412) 5111 : cluster [DBG] pgmap v2900: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:08.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:25:08 gibba045 bash[25517]: cluster 2021-03-10T15:25:07.126263+0000 mgr.gibba045.orlgmj (mgr.34412) 5111 : cluster [DBG] pgmap v2900: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:10.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:25:10 gibba045 bash[25517]: cluster 2021-03-10T15:25:09.127506+0000 mgr.gibba045.orlgmj (mgr.34412) 5112 : cluster [DBG] pgmap v2901: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:10.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:25:10 gibba015 bash[29377]: cluster 2021-03-10T15:25:09.127506+0000 mgr.gibba045.orlgmj (mgr.34412) 5112 : cluster [DBG] pgmap v2901: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:10.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:25:10 gibba015 bash[30343]: cluster 2021-03-10T15:25:09.127506+0000 mgr.gibba045.orlgmj (mgr.34412) 5112 : cluster [DBG] pgmap v2901: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:12.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:25:12 gibba045 bash[25517]: cluster 2021-03-10T15:25:11.129105+0000 mgr.gibba045.orlgmj (mgr.34412) 5113 : cluster [DBG] pgmap v2902: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:12.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:25:12 gibba015 bash[29377]: cluster 2021-03-10T15:25:11.129105+0000 mgr.gibba045.orlgmj (mgr.34412) 5113 : cluster [DBG] pgmap v2902: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:12.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:25:12 gibba015 bash[30343]: cluster 2021-03-10T15:25:11.129105+0000 mgr.gibba045.orlgmj (mgr.34412) 5113 : cluster [DBG] pgmap v2902: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:14.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:25:14 gibba045 bash[25517]: cluster 2021-03-10T15:25:13.130758+0000 mgr.gibba045.orlgmj (mgr.34412) 5114 : cluster [DBG] pgmap v2903: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:14.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:25:14 gibba015 bash[29377]: cluster 2021-03-10T15:25:13.130758+0000 mgr.gibba045.orlgmj (mgr.34412) 5114 : cluster [DBG] pgmap v2903: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:14.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:25:14 gibba015 bash[30343]: cluster 2021-03-10T15:25:13.130758+0000 mgr.gibba045.orlgmj (mgr.34412) 5114 : cluster [DBG] pgmap v2903: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:16.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:25:16 gibba045 bash[25517]: cluster 2021-03-10T15:25:15.132099+0000 mgr.gibba045.orlgmj (mgr.34412) 5115 : cluster [DBG] pgmap v2904: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:16.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:25:16 gibba015 bash[29377]: cluster 2021-03-10T15:25:15.132099+0000 mgr.gibba045.orlgmj (mgr.34412) 5115 : cluster [DBG] pgmap v2904: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:16.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:25:16 gibba015 bash[30343]: cluster 2021-03-10T15:25:15.132099+0000 mgr.gibba045.orlgmj (mgr.34412) 5115 : cluster [DBG] pgmap v2904: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:17.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:25:17 gibba045 bash[25517]: cephadm 2021-03-10T15:25:16.152642+0000 mgr.gibba045.orlgmj (mgr.34412) 5116 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:25:17.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:25:17 gibba015 bash[29377]: cephadm 2021-03-10T15:25:16.152642+0000 mgr.gibba045.orlgmj (mgr.34412) 5116 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:25:17.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:25:17 gibba015 bash[30343]: cephadm 2021-03-10T15:25:16.152642+0000 mgr.gibba045.orlgmj (mgr.34412) 5116 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:25:18.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:25:18 gibba045 bash[25517]: cluster 2021-03-10T15:25:17.133740+0000 mgr.gibba045.orlgmj (mgr.34412) 5117 : cluster [DBG] pgmap v2905: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:18.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:25:18 gibba015 bash[29377]: cluster 2021-03-10T15:25:17.133740+0000 mgr.gibba045.orlgmj (mgr.34412) 5117 : cluster [DBG] pgmap v2905: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:18.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:25:18 gibba015 bash[30343]: cluster 2021-03-10T15:25:17.133740+0000 mgr.gibba045.orlgmj (mgr.34412) 5117 : cluster [DBG] pgmap v2905: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:20.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:25:20 gibba045 bash[25517]: cluster 2021-03-10T15:25:19.134934+0000 mgr.gibba045.orlgmj (mgr.34412) 5118 : cluster [DBG] pgmap v2906: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:20.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:25:20 gibba015 bash[29377]: cluster 2021-03-10T15:25:19.134934+0000 mgr.gibba045.orlgmj (mgr.34412) 5118 : cluster [DBG] pgmap v2906: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:20.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:25:20 gibba015 bash[30343]: cluster 2021-03-10T15:25:19.134934+0000 mgr.gibba045.orlgmj (mgr.34412) 5118 : cluster [DBG] pgmap v2906: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:22.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:25:22 gibba045 bash[25517]: cluster 2021-03-10T15:25:21.135535+0000 mgr.gibba045.orlgmj (mgr.34412) 5119 : cluster [DBG] pgmap v2907: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:22.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:25:22 gibba015 bash[29377]: cluster 2021-03-10T15:25:21.135535+0000 mgr.gibba045.orlgmj (mgr.34412) 5119 : cluster [DBG] pgmap v2907: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:22.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:25:22 gibba015 bash[30343]: cluster 2021-03-10T15:25:21.135535+0000 mgr.gibba045.orlgmj (mgr.34412) 5119 : cluster [DBG] pgmap v2907: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:24.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:25:24 gibba015 bash[29377]: cluster 2021-03-10T15:25:23.137056+0000 mgr.gibba045.orlgmj (mgr.34412) 5120 : cluster [DBG] pgmap v2908: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:24.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:25:24 gibba015 bash[30343]: cluster 2021-03-10T15:25:23.137056+0000 mgr.gibba045.orlgmj (mgr.34412) 5120 : cluster [DBG] pgmap v2908: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:24.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:25:24 gibba045 bash[25517]: cluster 2021-03-10T15:25:23.137056+0000 mgr.gibba045.orlgmj (mgr.34412) 5120 : cluster [DBG] pgmap v2908: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:24.870 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:25:25.097 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:25:25.098 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (96m) 24s ago 101m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:25:25.098 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (101m) 9m ago 101m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:25:25.098 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (96m) 9m ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:25:25.099 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (96m) 9m ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:25:25.099 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (95m) 24s ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:25:25.099 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (95m) 24s ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:25:25.099 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (95m) 9m ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:25:25.100 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (95m) 24s ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:25:25.100 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (101m) 24s ago 101m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:25:25.100 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (101m) 9m ago 101m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:25:25.100 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (94m) 24s ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:25:25.101 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (94m) 24s ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:25:25.101 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (93m) 24s ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:25:25.101 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (93m) 24s ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:25:25.101 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (92m) 9m ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:25:25.101 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (92m) 9m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:25:25.102 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (91m) 9m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:25:25.102 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (91m) 9m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:25:25.102 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (101m) 9m ago 101m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:25:25.102 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 9m ago 99m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:25:25.346 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:25:25.346 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:25:25.347 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:25:25.347 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:25:25.347 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:25:25.347 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:25:25.348 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:25:25.348 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:25:25.348 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:25:25.348 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:25:25.348 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:25:25.349 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:25:25.349 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:25:25.349 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:25:25.349 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:25:25.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:25:25 gibba015 bash[29377]: audit 2021-03-10T15:25:24.861185+0000 mgr.gibba045.orlgmj (mgr.34412) 5121 : audit [DBG] from='client.57478 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:25:25.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:25:25 gibba015 bash[30343]: audit 2021-03-10T15:25:24.861185+0000 mgr.gibba045.orlgmj (mgr.34412) 5121 : audit [DBG] from='client.57478 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:25:25.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:25:25 gibba045 bash[25517]: audit 2021-03-10T15:25:24.861185+0000 mgr.gibba045.orlgmj (mgr.34412) 5121 : audit [DBG] from='client.57478 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:25:26.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:25:26 gibba015 bash[29377]: audit 2021-03-10T15:25:25.085350+0000 mgr.gibba045.orlgmj (mgr.34412) 5122 : audit [DBG] from='client.57484 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:25:26.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:25:26 gibba015 bash[29377]: cluster 2021-03-10T15:25:25.137927+0000 mgr.gibba045.orlgmj (mgr.34412) 5123 : cluster [DBG] pgmap v2909: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:26.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:25:26 gibba015 bash[29377]: audit 2021-03-10T15:25:25.341960+0000 mon.a (mon.0) 1359 : audit [DBG] from='client.? 172.21.2.115:0/801704500' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:25:26.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:25:26 gibba015 bash[30343]: audit 2021-03-10T15:25:25.085350+0000 mgr.gibba045.orlgmj (mgr.34412) 5122 : audit [DBG] from='client.57484 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:25:26.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:25:26 gibba015 bash[30343]: cluster 2021-03-10T15:25:25.137927+0000 mgr.gibba045.orlgmj (mgr.34412) 5123 : cluster [DBG] pgmap v2909: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:26.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:25:26 gibba015 bash[30343]: audit 2021-03-10T15:25:25.341960+0000 mon.a (mon.0) 1359 : audit [DBG] from='client.? 172.21.2.115:0/801704500' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:25:26.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:25:26 gibba045 bash[25517]: audit 2021-03-10T15:25:25.085350+0000 mgr.gibba045.orlgmj (mgr.34412) 5122 : audit [DBG] from='client.57484 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:25:26.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:25:26 gibba045 bash[25517]: cluster 2021-03-10T15:25:25.137927+0000 mgr.gibba045.orlgmj (mgr.34412) 5123 : cluster [DBG] pgmap v2909: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:26.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:25:26 gibba045 bash[25517]: audit 2021-03-10T15:25:25.341960+0000 mon.a (mon.0) 1359 : audit [DBG] from='client.? 172.21.2.115:0/801704500' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:25:28.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:25:28 gibba015 bash[29377]: cluster 2021-03-10T15:25:27.139292+0000 mgr.gibba045.orlgmj (mgr.34412) 5124 : cluster [DBG] pgmap v2910: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:28.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:25:28 gibba015 bash[30343]: cluster 2021-03-10T15:25:27.139292+0000 mgr.gibba045.orlgmj (mgr.34412) 5124 : cluster [DBG] pgmap v2910: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:28.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:25:28 gibba045 bash[25517]: cluster 2021-03-10T15:25:27.139292+0000 mgr.gibba045.orlgmj (mgr.34412) 5124 : cluster [DBG] pgmap v2910: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:30.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:25:30 gibba015 bash[29377]: cluster 2021-03-10T15:25:29.140458+0000 mgr.gibba045.orlgmj (mgr.34412) 5125 : cluster [DBG] pgmap v2911: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:30.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:25:30 gibba015 bash[30343]: cluster 2021-03-10T15:25:29.140458+0000 mgr.gibba045.orlgmj (mgr.34412) 5125 : cluster [DBG] pgmap v2911: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:30.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:25:30 gibba045 bash[25517]: cluster 2021-03-10T15:25:29.140458+0000 mgr.gibba045.orlgmj (mgr.34412) 5125 : cluster [DBG] pgmap v2911: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:32.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:25:32 gibba015 bash[29377]: cluster 2021-03-10T15:25:31.142244+0000 mgr.gibba045.orlgmj (mgr.34412) 5126 : cluster [DBG] pgmap v2912: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:32.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:25:32 gibba015 bash[29377]: cephadm 2021-03-10T15:25:31.168413+0000 mgr.gibba045.orlgmj (mgr.34412) 5127 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:25:32.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:25:32 gibba015 bash[30343]: cluster 2021-03-10T15:25:31.142244+0000 mgr.gibba045.orlgmj (mgr.34412) 5126 : cluster [DBG] pgmap v2912: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:32.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:25:32 gibba015 bash[30343]: cephadm 2021-03-10T15:25:31.168413+0000 mgr.gibba045.orlgmj (mgr.34412) 5127 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:25:32.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:25:32 gibba045 bash[25517]: cluster 2021-03-10T15:25:31.142244+0000 mgr.gibba045.orlgmj (mgr.34412) 5126 : cluster [DBG] pgmap v2912: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:32.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:25:32 gibba045 bash[25517]: cephadm 2021-03-10T15:25:31.168413+0000 mgr.gibba045.orlgmj (mgr.34412) 5127 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:25:34.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:25:34 gibba015 bash[29377]: cluster 2021-03-10T15:25:33.142780+0000 mgr.gibba045.orlgmj (mgr.34412) 5128 : cluster [DBG] pgmap v2913: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:34.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:25:34 gibba015 bash[30343]: cluster 2021-03-10T15:25:33.142780+0000 mgr.gibba045.orlgmj (mgr.34412) 5128 : cluster [DBG] pgmap v2913: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:34.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:25:34 gibba045 bash[25517]: cluster 2021-03-10T15:25:33.142780+0000 mgr.gibba045.orlgmj (mgr.34412) 5128 : cluster [DBG] pgmap v2913: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:36.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:25:36 gibba015 bash[29377]: cluster 2021-03-10T15:25:35.144280+0000 mgr.gibba045.orlgmj (mgr.34412) 5129 : cluster [DBG] pgmap v2914: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:36.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:25:36 gibba015 bash[30343]: cluster 2021-03-10T15:25:35.144280+0000 mgr.gibba045.orlgmj (mgr.34412) 5129 : cluster [DBG] pgmap v2914: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:36.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:25:36 gibba045 bash[25517]: cluster 2021-03-10T15:25:35.144280+0000 mgr.gibba045.orlgmj (mgr.34412) 5129 : cluster [DBG] pgmap v2914: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:38.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:25:38 gibba015 bash[29377]: cluster 2021-03-10T15:25:37.146087+0000 mgr.gibba045.orlgmj (mgr.34412) 5130 : cluster [DBG] pgmap v2915: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:38.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:25:38 gibba015 bash[30343]: cluster 2021-03-10T15:25:37.146087+0000 mgr.gibba045.orlgmj (mgr.34412) 5130 : cluster [DBG] pgmap v2915: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:38.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:25:38 gibba045 bash[25517]: cluster 2021-03-10T15:25:37.146087+0000 mgr.gibba045.orlgmj (mgr.34412) 5130 : cluster [DBG] pgmap v2915: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:40.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:25:40 gibba015 bash[29377]: cluster 2021-03-10T15:25:39.147305+0000 mgr.gibba045.orlgmj (mgr.34412) 5131 : cluster [DBG] pgmap v2916: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:40.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:25:40 gibba015 bash[30343]: cluster 2021-03-10T15:25:39.147305+0000 mgr.gibba045.orlgmj (mgr.34412) 5131 : cluster [DBG] pgmap v2916: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:40.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:25:40 gibba045 bash[25517]: cluster 2021-03-10T15:25:39.147305+0000 mgr.gibba045.orlgmj (mgr.34412) 5131 : cluster [DBG] pgmap v2916: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:42.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:25:42 gibba015 bash[29377]: cluster 2021-03-10T15:25:41.148978+0000 mgr.gibba045.orlgmj (mgr.34412) 5132 : cluster [DBG] pgmap v2917: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:42.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:25:42 gibba015 bash[30343]: cluster 2021-03-10T15:25:41.148978+0000 mgr.gibba045.orlgmj (mgr.34412) 5132 : cluster [DBG] pgmap v2917: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:42.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:25:42 gibba045 bash[25517]: cluster 2021-03-10T15:25:41.148978+0000 mgr.gibba045.orlgmj (mgr.34412) 5132 : cluster [DBG] pgmap v2917: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:44.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:25:44 gibba015 bash[29377]: cluster 2021-03-10T15:25:43.150557+0000 mgr.gibba045.orlgmj (mgr.34412) 5133 : cluster [DBG] pgmap v2918: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:44.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:25:44 gibba015 bash[30343]: cluster 2021-03-10T15:25:43.150557+0000 mgr.gibba045.orlgmj (mgr.34412) 5133 : cluster [DBG] pgmap v2918: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:44.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:25:44 gibba045 bash[25517]: cluster 2021-03-10T15:25:43.150557+0000 mgr.gibba045.orlgmj (mgr.34412) 5133 : cluster [DBG] pgmap v2918: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:46.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:25:46 gibba045 bash[25517]: cluster 2021-03-10T15:25:45.151332+0000 mgr.gibba045.orlgmj (mgr.34412) 5134 : cluster [DBG] pgmap v2919: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:46.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:25:46 gibba015 bash[29377]: cluster 2021-03-10T15:25:45.151332+0000 mgr.gibba045.orlgmj (mgr.34412) 5134 : cluster [DBG] pgmap v2919: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:46.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:25:46 gibba015 bash[30343]: cluster 2021-03-10T15:25:45.151332+0000 mgr.gibba045.orlgmj (mgr.34412) 5134 : cluster [DBG] pgmap v2919: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:47.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:25:47 gibba015 bash[29377]: cephadm 2021-03-10T15:25:46.184357+0000 mgr.gibba045.orlgmj (mgr.34412) 5135 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:25:47.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:25:47 gibba015 bash[30343]: cephadm 2021-03-10T15:25:46.184357+0000 mgr.gibba045.orlgmj (mgr.34412) 5135 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:25:47.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:25:47 gibba045 bash[25517]: cephadm 2021-03-10T15:25:46.184357+0000 mgr.gibba045.orlgmj (mgr.34412) 5135 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:25:48.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:25:48 gibba015 bash[29377]: cluster 2021-03-10T15:25:47.152954+0000 mgr.gibba045.orlgmj (mgr.34412) 5136 : cluster [DBG] pgmap v2920: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:48.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:25:48 gibba015 bash[30343]: cluster 2021-03-10T15:25:47.152954+0000 mgr.gibba045.orlgmj (mgr.34412) 5136 : cluster [DBG] pgmap v2920: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:48.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:25:48 gibba045 bash[25517]: cluster 2021-03-10T15:25:47.152954+0000 mgr.gibba045.orlgmj (mgr.34412) 5136 : cluster [DBG] pgmap v2920: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:50.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:25:50 gibba015 bash[29377]: cluster 2021-03-10T15:25:49.154155+0000 mgr.gibba045.orlgmj (mgr.34412) 5137 : cluster [DBG] pgmap v2921: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:50.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:25:50 gibba015 bash[30343]: cluster 2021-03-10T15:25:49.154155+0000 mgr.gibba045.orlgmj (mgr.34412) 5137 : cluster [DBG] pgmap v2921: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:50.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:25:50 gibba045 bash[25517]: cluster 2021-03-10T15:25:49.154155+0000 mgr.gibba045.orlgmj (mgr.34412) 5137 : cluster [DBG] pgmap v2921: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:52.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:25:52 gibba015 bash[29377]: cluster 2021-03-10T15:25:51.155614+0000 mgr.gibba045.orlgmj (mgr.34412) 5138 : cluster [DBG] pgmap v2922: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:52.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:25:52 gibba015 bash[30343]: cluster 2021-03-10T15:25:51.155614+0000 mgr.gibba045.orlgmj (mgr.34412) 5138 : cluster [DBG] pgmap v2922: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:52.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:25:52 gibba045 bash[25517]: cluster 2021-03-10T15:25:51.155614+0000 mgr.gibba045.orlgmj (mgr.34412) 5138 : cluster [DBG] pgmap v2922: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:25:53 gibba015 bash[29377]: audit 2021-03-10T15:25:53.117443+0000 mon.c (mon.1) 1449 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:25:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:25:53 gibba015 bash[29377]: audit 2021-03-10T15:25:53.118063+0000 mon.c (mon.1) 1450 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:25:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:25:53 gibba015 bash[29377]: audit 2021-03-10T15:25:53.118495+0000 mon.a (mon.0) 1360 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:25:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:25:53 gibba015 bash[29377]: audit 2021-03-10T15:25:53.118693+0000 mon.c (mon.1) 1451 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T15:25:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:25:53 gibba015 bash[29377]: audit 2021-03-10T15:25:53.119529+0000 mon.c (mon.1) 1452 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:25:53.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:25:53 gibba015 bash[29377]: audit 2021-03-10T15:25:53.119979+0000 mon.a (mon.0) 1361 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:25:53.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:25:53 gibba015 bash[29377]: audit 2021-03-10T15:25:53.120205+0000 mon.c (mon.1) 1453 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:25:53.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:25:53 gibba015 bash[29377]: audit 2021-03-10T15:25:53.120917+0000 mon.a (mon.0) 1362 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T15:25:53.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:25:53 gibba015 bash[29377]: audit 2021-03-10T15:25:53.121056+0000 mon.c (mon.1) 1454 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:25:53.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:25:53 gibba015 bash[29377]: audit 2021-03-10T15:25:53.121741+0000 mon.a (mon.0) 1363 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:25:53.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:25:53 gibba015 bash[29377]: audit 2021-03-10T15:25:53.121997+0000 mon.a (mon.0) 1364 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:25:53.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:25:53 gibba015 bash[29377]: audit 2021-03-10T15:25:53.122236+0000 mon.a (mon.0) 1365 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:25:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:25:53 gibba015 bash[30343]: audit 2021-03-10T15:25:53.117443+0000 mon.c (mon.1) 1449 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:25:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:25:53 gibba015 bash[30343]: audit 2021-03-10T15:25:53.118063+0000 mon.c (mon.1) 1450 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:25:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:25:53 gibba015 bash[30343]: audit 2021-03-10T15:25:53.118495+0000 mon.a (mon.0) 1360 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:25:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:25:53 gibba015 bash[30343]: audit 2021-03-10T15:25:53.118693+0000 mon.c (mon.1) 1451 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T15:25:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:25:53 gibba015 bash[30343]: audit 2021-03-10T15:25:53.119529+0000 mon.c (mon.1) 1452 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:25:53.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:25:53 gibba015 bash[30343]: audit 2021-03-10T15:25:53.119979+0000 mon.a (mon.0) 1361 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:25:53.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:25:53 gibba015 bash[30343]: audit 2021-03-10T15:25:53.120205+0000 mon.c (mon.1) 1453 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:25:53.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:25:53 gibba015 bash[30343]: audit 2021-03-10T15:25:53.120917+0000 mon.a (mon.0) 1362 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T15:25:53.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:25:53 gibba015 bash[30343]: audit 2021-03-10T15:25:53.121056+0000 mon.c (mon.1) 1454 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:25:53.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:25:53 gibba015 bash[30343]: audit 2021-03-10T15:25:53.121741+0000 mon.a (mon.0) 1363 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:25:53.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:25:53 gibba015 bash[30343]: audit 2021-03-10T15:25:53.121997+0000 mon.a (mon.0) 1364 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:25:53.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:25:53 gibba015 bash[30343]: audit 2021-03-10T15:25:53.122236+0000 mon.a (mon.0) 1365 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:25:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:25:53 gibba045 bash[25517]: audit 2021-03-10T15:25:53.117443+0000 mon.c (mon.1) 1449 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:25:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:25:53 gibba045 bash[25517]: audit 2021-03-10T15:25:53.118063+0000 mon.c (mon.1) 1450 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:25:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:25:53 gibba045 bash[25517]: audit 2021-03-10T15:25:53.118495+0000 mon.a (mon.0) 1360 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:25:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:25:53 gibba045 bash[25517]: audit 2021-03-10T15:25:53.118693+0000 mon.c (mon.1) 1451 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T15:25:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:25:53 gibba045 bash[25517]: audit 2021-03-10T15:25:53.119529+0000 mon.c (mon.1) 1452 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:25:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:25:53 gibba045 bash[25517]: audit 2021-03-10T15:25:53.119979+0000 mon.a (mon.0) 1361 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:25:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:25:53 gibba045 bash[25517]: audit 2021-03-10T15:25:53.120205+0000 mon.c (mon.1) 1453 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:25:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:25:53 gibba045 bash[25517]: audit 2021-03-10T15:25:53.120917+0000 mon.a (mon.0) 1362 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T15:25:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:25:53 gibba045 bash[25517]: audit 2021-03-10T15:25:53.121056+0000 mon.c (mon.1) 1454 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:25:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:25:53 gibba045 bash[25517]: audit 2021-03-10T15:25:53.121741+0000 mon.a (mon.0) 1363 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:25:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:25:53 gibba045 bash[25517]: audit 2021-03-10T15:25:53.121997+0000 mon.a (mon.0) 1364 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:25:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:25:53 gibba045 bash[25517]: audit 2021-03-10T15:25:53.122236+0000 mon.a (mon.0) 1365 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:25:54.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:25:54 gibba015 bash[29377]: cluster 2021-03-10T15:25:53.156979+0000 mgr.gibba045.orlgmj (mgr.34412) 5139 : cluster [DBG] pgmap v2923: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:25:54 gibba015 bash[30343]: cluster 2021-03-10T15:25:53.156979+0000 mgr.gibba045.orlgmj (mgr.34412) 5139 : cluster [DBG] pgmap v2923: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:54.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:25:54 gibba045 bash[25517]: cluster 2021-03-10T15:25:53.156979+0000 mgr.gibba045.orlgmj (mgr.34412) 5139 : cluster [DBG] pgmap v2923: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:55.591 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:25:55.822 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:25:55.823 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (96m) 54s ago 102m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:25:55.823 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (101m) 10m ago 101m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:25:55.823 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (97m) 10m ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:25:55.824 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (97m) 10m ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:25:55.824 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (96m) 54s ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:25:55.824 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (96m) 54s ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:25:55.824 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (95m) 10m ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:25:55.824 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (95m) 54s ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:25:55.825 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (102m) 54s ago 102m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:25:55.825 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (102m) 10m ago 102m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:25:55.825 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (94m) 54s ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:25:55.825 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (94m) 54s ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:25:55.826 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (94m) 54s ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:25:55.826 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (93m) 54s ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:25:55.826 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (93m) 10m ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:25:55.826 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (92m) 10m ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:25:55.827 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (92m) 10m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:25:55.827 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (91m) 10m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:25:55.827 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (101m) 10m ago 102m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:25:55.827 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 10m ago 100m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:25:56.070 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:25:56.070 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:25:56.070 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:25:56.071 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:25:56.071 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:25:56.071 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:25:56.071 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:25:56.072 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:25:56.072 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:25:56.072 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:25:56.072 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:25:56.073 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:25:56.073 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:25:56.073 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:25:56.073 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:25:56.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:25:56 gibba015 bash[29377]: cluster 2021-03-10T15:25:55.158661+0000 mgr.gibba045.orlgmj (mgr.34412) 5140 : cluster [DBG] pgmap v2924: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:56.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:25:56 gibba015 bash[29377]: audit 2021-03-10T15:25:55.581777+0000 mgr.gibba045.orlgmj (mgr.34412) 5141 : audit [DBG] from='client.47508 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:25:56.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:25:56 gibba015 bash[29377]: audit 2021-03-10T15:25:55.809684+0000 mgr.gibba045.orlgmj (mgr.34412) 5142 : audit [DBG] from='client.57502 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:25:56.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:25:56 gibba015 bash[29377]: audit 2021-03-10T15:25:56.065480+0000 mon.c (mon.1) 1455 : audit [DBG] from='client.? 172.21.2.115:0/2758950843' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:25:56.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:25:56 gibba015 bash[30343]: cluster 2021-03-10T15:25:55.158661+0000 mgr.gibba045.orlgmj (mgr.34412) 5140 : cluster [DBG] pgmap v2924: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:56.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:25:56 gibba015 bash[30343]: audit 2021-03-10T15:25:55.581777+0000 mgr.gibba045.orlgmj (mgr.34412) 5141 : audit [DBG] from='client.47508 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:25:56.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:25:56 gibba015 bash[30343]: audit 2021-03-10T15:25:55.809684+0000 mgr.gibba045.orlgmj (mgr.34412) 5142 : audit [DBG] from='client.57502 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:25:56.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:25:56 gibba015 bash[30343]: audit 2021-03-10T15:25:56.065480+0000 mon.c (mon.1) 1455 : audit [DBG] from='client.? 172.21.2.115:0/2758950843' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:25:56.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:25:56 gibba045 bash[25517]: cluster 2021-03-10T15:25:55.158661+0000 mgr.gibba045.orlgmj (mgr.34412) 5140 : cluster [DBG] pgmap v2924: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:56.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:25:56 gibba045 bash[25517]: audit 2021-03-10T15:25:55.581777+0000 mgr.gibba045.orlgmj (mgr.34412) 5141 : audit [DBG] from='client.47508 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:25:56.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:25:56 gibba045 bash[25517]: audit 2021-03-10T15:25:55.809684+0000 mgr.gibba045.orlgmj (mgr.34412) 5142 : audit [DBG] from='client.57502 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:25:56.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:25:56 gibba045 bash[25517]: audit 2021-03-10T15:25:56.065480+0000 mon.c (mon.1) 1455 : audit [DBG] from='client.? 172.21.2.115:0/2758950843' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:25:58.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:25:58 gibba045 bash[25517]: cluster 2021-03-10T15:25:57.159426+0000 mgr.gibba045.orlgmj (mgr.34412) 5143 : cluster [DBG] pgmap v2925: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:58.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:25:58 gibba015 bash[29377]: cluster 2021-03-10T15:25:57.159426+0000 mgr.gibba045.orlgmj (mgr.34412) 5143 : cluster [DBG] pgmap v2925: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:58.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:25:58 gibba015 bash[30343]: cluster 2021-03-10T15:25:57.159426+0000 mgr.gibba045.orlgmj (mgr.34412) 5143 : cluster [DBG] pgmap v2925: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:00.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:26:00 gibba045 bash[25517]: cluster 2021-03-10T15:25:59.160516+0000 mgr.gibba045.orlgmj (mgr.34412) 5144 : cluster [DBG] pgmap v2926: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:00.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:26:00 gibba015 bash[29377]: cluster 2021-03-10T15:25:59.160516+0000 mgr.gibba045.orlgmj (mgr.34412) 5144 : cluster [DBG] pgmap v2926: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:00.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:26:00 gibba015 bash[30343]: cluster 2021-03-10T15:25:59.160516+0000 mgr.gibba045.orlgmj (mgr.34412) 5144 : cluster [DBG] pgmap v2926: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:01.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:26:01 gibba045 bash[25517]: audit 2021-03-10T15:26:01.193831+0000 mon.c (mon.1) 1456 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:26:01.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:26:01 gibba045 bash[25517]: audit 2021-03-10T15:26:01.200235+0000 mon.c (mon.1) 1457 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:26:01.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:26:01 gibba015 bash[29377]: audit 2021-03-10T15:26:01.193831+0000 mon.c (mon.1) 1456 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:26:01.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:26:01 gibba015 bash[29377]: audit 2021-03-10T15:26:01.200235+0000 mon.c (mon.1) 1457 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:26:01.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:26:01 gibba015 bash[30343]: audit 2021-03-10T15:26:01.193831+0000 mon.c (mon.1) 1456 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:26:01.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:26:01 gibba015 bash[30343]: audit 2021-03-10T15:26:01.200235+0000 mon.c (mon.1) 1457 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:26:02.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:26:02 gibba045 bash[25517]: cluster 2021-03-10T15:26:01.162002+0000 mgr.gibba045.orlgmj (mgr.34412) 5145 : cluster [DBG] pgmap v2927: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:02.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:26:02 gibba045 bash[25517]: cephadm 2021-03-10T15:26:01.202495+0000 mgr.gibba045.orlgmj (mgr.34412) 5146 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:26:02.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:26:02 gibba015 bash[29377]: cluster 2021-03-10T15:26:01.162002+0000 mgr.gibba045.orlgmj (mgr.34412) 5145 : cluster [DBG] pgmap v2927: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:02.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:26:02 gibba015 bash[29377]: cephadm 2021-03-10T15:26:01.202495+0000 mgr.gibba045.orlgmj (mgr.34412) 5146 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:26:02.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:26:02 gibba015 bash[30343]: cluster 2021-03-10T15:26:01.162002+0000 mgr.gibba045.orlgmj (mgr.34412) 5145 : cluster [DBG] pgmap v2927: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:02.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:26:02 gibba015 bash[30343]: cephadm 2021-03-10T15:26:01.202495+0000 mgr.gibba045.orlgmj (mgr.34412) 5146 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:26:04.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:26:04 gibba045 bash[25517]: cluster 2021-03-10T15:26:03.162791+0000 mgr.gibba045.orlgmj (mgr.34412) 5147 : cluster [DBG] pgmap v2928: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:04.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:26:04 gibba015 bash[29377]: cluster 2021-03-10T15:26:03.162791+0000 mgr.gibba045.orlgmj (mgr.34412) 5147 : cluster [DBG] pgmap v2928: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:04.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:26:04 gibba015 bash[30343]: cluster 2021-03-10T15:26:03.162791+0000 mgr.gibba045.orlgmj (mgr.34412) 5147 : cluster [DBG] pgmap v2928: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:06.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:26:05 gibba015 bash[29377]: audit 2021-03-10T15:26:04.884231+0000 mon.a (mon.0) 1366 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:26:06.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:26:05 gibba015 bash[29377]: cephadm 2021-03-10T15:26:04.891828+0000 mgr.gibba045.orlgmj (mgr.34412) 5148 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:26:06.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:26:05 gibba015 bash[29377]: audit 2021-03-10T15:26:05.092550+0000 mon.a (mon.0) 1367 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:26:06.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:26:05 gibba015 bash[29377]: audit 2021-03-10T15:26:05.095959+0000 mon.c (mon.1) 1458 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:26:06.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:26:05 gibba015 bash[29377]: audit 2021-03-10T15:26:05.097265+0000 mon.c (mon.1) 1459 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:26:06.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:26:05 gibba015 bash[29377]: audit 2021-03-10T15:26:05.098458+0000 mon.c (mon.1) 1460 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:26:06.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:26:05 gibba015 bash[29377]: audit 2021-03-10T15:26:05.099529+0000 mon.c (mon.1) 1461 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:26:06.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:26:05 gibba015 bash[29377]: audit 2021-03-10T15:26:05.102301+0000 mon.c (mon.1) 1462 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:26:06.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:26:05 gibba015 bash[29377]: audit 2021-03-10T15:26:05.103560+0000 mon.c (mon.1) 1463 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:26:06.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:26:05 gibba015 bash[30343]: audit 2021-03-10T15:26:04.884231+0000 mon.a (mon.0) 1366 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:26:06.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:26:05 gibba015 bash[30343]: cephadm 2021-03-10T15:26:04.891828+0000 mgr.gibba045.orlgmj (mgr.34412) 5148 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:26:06.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:26:05 gibba015 bash[30343]: audit 2021-03-10T15:26:05.092550+0000 mon.a (mon.0) 1367 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:26:06.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:26:05 gibba015 bash[30343]: audit 2021-03-10T15:26:05.095959+0000 mon.c (mon.1) 1458 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:26:06.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:26:05 gibba015 bash[30343]: audit 2021-03-10T15:26:05.097265+0000 mon.c (mon.1) 1459 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:26:06.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:26:05 gibba015 bash[30343]: audit 2021-03-10T15:26:05.098458+0000 mon.c (mon.1) 1460 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:26:06.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:26:05 gibba015 bash[30343]: audit 2021-03-10T15:26:05.099529+0000 mon.c (mon.1) 1461 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:26:06.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:26:05 gibba015 bash[30343]: audit 2021-03-10T15:26:05.102301+0000 mon.c (mon.1) 1462 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:26:06.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:26:05 gibba015 bash[30343]: audit 2021-03-10T15:26:05.103560+0000 mon.c (mon.1) 1463 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:26:06.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:26:05 gibba045 bash[25517]: audit 2021-03-10T15:26:04.884231+0000 mon.a (mon.0) 1366 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:26:06.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:26:05 gibba045 bash[25517]: cephadm 2021-03-10T15:26:04.891828+0000 mgr.gibba045.orlgmj (mgr.34412) 5148 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:26:06.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:26:05 gibba045 bash[25517]: audit 2021-03-10T15:26:05.092550+0000 mon.a (mon.0) 1367 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:26:06.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:26:05 gibba045 bash[25517]: audit 2021-03-10T15:26:05.095959+0000 mon.c (mon.1) 1458 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:26:06.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:26:05 gibba045 bash[25517]: audit 2021-03-10T15:26:05.097265+0000 mon.c (mon.1) 1459 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:26:06.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:26:05 gibba045 bash[25517]: audit 2021-03-10T15:26:05.098458+0000 mon.c (mon.1) 1460 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:26:06.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:26:05 gibba045 bash[25517]: audit 2021-03-10T15:26:05.099529+0000 mon.c (mon.1) 1461 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:26:06.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:26:05 gibba045 bash[25517]: audit 2021-03-10T15:26:05.102301+0000 mon.c (mon.1) 1462 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:26:06.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:26:05 gibba045 bash[25517]: audit 2021-03-10T15:26:05.103560+0000 mon.c (mon.1) 1463 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:26:07.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:26:06 gibba015 bash[29377]: cephadm 2021-03-10T15:26:05.099428+0000 mgr.gibba045.orlgmj (mgr.34412) 5149 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:26:07.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:26:06 gibba015 bash[29377]: cephadm 2021-03-10T15:26:05.101051+0000 mgr.gibba045.orlgmj (mgr.34412) 5150 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:26:07.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:26:06 gibba015 bash[29377]: cephadm 2021-03-10T15:26:05.102234+0000 mgr.gibba045.orlgmj (mgr.34412) 5151 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:26:07.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:26:06 gibba015 bash[29377]: cephadm 2021-03-10T15:26:05.102270+0000 mgr.gibba045.orlgmj (mgr.34412) 5152 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:26:07.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:26:06 gibba015 bash[29377]: cephadm 2021-03-10T15:26:05.103404+0000 mgr.gibba045.orlgmj (mgr.34412) 5153 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:26:07.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:26:06 gibba015 bash[29377]: cephadm 2021-03-10T15:26:05.103442+0000 mgr.gibba045.orlgmj (mgr.34412) 5154 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:26:07.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:26:06 gibba015 bash[29377]: cephadm 2021-03-10T15:26:05.104421+0000 mgr.gibba045.orlgmj (mgr.34412) 5155 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:26:07.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:26:06 gibba015 bash[29377]: cephadm 2021-03-10T15:26:05.105886+0000 mgr.gibba045.orlgmj (mgr.34412) 5156 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:26:07.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:26:06 gibba015 bash[29377]: cephadm 2021-03-10T15:26:05.105923+0000 mgr.gibba045.orlgmj (mgr.34412) 5157 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:26:07.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:26:06 gibba015 bash[29377]: cephadm 2021-03-10T15:26:05.107133+0000 mgr.gibba045.orlgmj (mgr.34412) 5158 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:26:07.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:26:06 gibba015 bash[29377]: cephadm 2021-03-10T15:26:05.107442+0000 mgr.gibba045.orlgmj (mgr.34412) 5159 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:26:07.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:26:06 gibba015 bash[29377]: cephadm 2021-03-10T15:26:05.108352+0000 mgr.gibba045.orlgmj (mgr.34412) 5160 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:26:07.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:26:06 gibba015 bash[29377]: cephadm 2021-03-10T15:26:05.108404+0000 mgr.gibba045.orlgmj (mgr.34412) 5161 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:26:07.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:26:06 gibba015 bash[29377]: cephadm 2021-03-10T15:26:05.108577+0000 mgr.gibba045.orlgmj (mgr.34412) 5162 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:26:07.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:26:06 gibba015 bash[29377]: cluster 2021-03-10T15:26:05.163549+0000 mgr.gibba045.orlgmj (mgr.34412) 5163 : cluster [DBG] pgmap v2929: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:07.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:26:06 gibba015 bash[30343]: cephadm 2021-03-10T15:26:05.099428+0000 mgr.gibba045.orlgmj (mgr.34412) 5149 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:26:07.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:26:06 gibba015 bash[30343]: cephadm 2021-03-10T15:26:05.101051+0000 mgr.gibba045.orlgmj (mgr.34412) 5150 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:26:07.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:26:06 gibba015 bash[30343]: cephadm 2021-03-10T15:26:05.102234+0000 mgr.gibba045.orlgmj (mgr.34412) 5151 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:26:07.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:26:06 gibba015 bash[30343]: cephadm 2021-03-10T15:26:05.102270+0000 mgr.gibba045.orlgmj (mgr.34412) 5152 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:26:07.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:26:06 gibba015 bash[30343]: cephadm 2021-03-10T15:26:05.103404+0000 mgr.gibba045.orlgmj (mgr.34412) 5153 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:26:07.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:26:06 gibba015 bash[30343]: cephadm 2021-03-10T15:26:05.103442+0000 mgr.gibba045.orlgmj (mgr.34412) 5154 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:26:07.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:26:06 gibba015 bash[30343]: cephadm 2021-03-10T15:26:05.104421+0000 mgr.gibba045.orlgmj (mgr.34412) 5155 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:26:07.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:26:06 gibba015 bash[30343]: cephadm 2021-03-10T15:26:05.105886+0000 mgr.gibba045.orlgmj (mgr.34412) 5156 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:26:07.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:26:06 gibba015 bash[30343]: cephadm 2021-03-10T15:26:05.105923+0000 mgr.gibba045.orlgmj (mgr.34412) 5157 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:26:07.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:26:06 gibba015 bash[30343]: cephadm 2021-03-10T15:26:05.107133+0000 mgr.gibba045.orlgmj (mgr.34412) 5158 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:26:07.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:26:06 gibba015 bash[30343]: cephadm 2021-03-10T15:26:05.107442+0000 mgr.gibba045.orlgmj (mgr.34412) 5159 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:26:07.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:26:06 gibba015 bash[30343]: cephadm 2021-03-10T15:26:05.108352+0000 mgr.gibba045.orlgmj (mgr.34412) 5160 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:26:07.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:26:06 gibba015 bash[30343]: cephadm 2021-03-10T15:26:05.108404+0000 mgr.gibba045.orlgmj (mgr.34412) 5161 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:26:07.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:26:06 gibba015 bash[30343]: cephadm 2021-03-10T15:26:05.108577+0000 mgr.gibba045.orlgmj (mgr.34412) 5162 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:26:07.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:26:06 gibba015 bash[30343]: cluster 2021-03-10T15:26:05.163549+0000 mgr.gibba045.orlgmj (mgr.34412) 5163 : cluster [DBG] pgmap v2929: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:07.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:26:06 gibba045 bash[25517]: cephadm 2021-03-10T15:26:05.099428+0000 mgr.gibba045.orlgmj (mgr.34412) 5149 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:26:07.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:26:06 gibba045 bash[25517]: cephadm 2021-03-10T15:26:05.101051+0000 mgr.gibba045.orlgmj (mgr.34412) 5150 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:26:07.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:26:06 gibba045 bash[25517]: cephadm 2021-03-10T15:26:05.102234+0000 mgr.gibba045.orlgmj (mgr.34412) 5151 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:26:07.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:26:06 gibba045 bash[25517]: cephadm 2021-03-10T15:26:05.102270+0000 mgr.gibba045.orlgmj (mgr.34412) 5152 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:26:07.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:26:06 gibba045 bash[25517]: cephadm 2021-03-10T15:26:05.103404+0000 mgr.gibba045.orlgmj (mgr.34412) 5153 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:26:07.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:26:06 gibba045 bash[25517]: cephadm 2021-03-10T15:26:05.103442+0000 mgr.gibba045.orlgmj (mgr.34412) 5154 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:26:07.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:26:06 gibba045 bash[25517]: cephadm 2021-03-10T15:26:05.104421+0000 mgr.gibba045.orlgmj (mgr.34412) 5155 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:26:07.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:26:06 gibba045 bash[25517]: cephadm 2021-03-10T15:26:05.105886+0000 mgr.gibba045.orlgmj (mgr.34412) 5156 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:26:07.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:26:06 gibba045 bash[25517]: cephadm 2021-03-10T15:26:05.105923+0000 mgr.gibba045.orlgmj (mgr.34412) 5157 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:26:07.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:26:06 gibba045 bash[25517]: cephadm 2021-03-10T15:26:05.107133+0000 mgr.gibba045.orlgmj (mgr.34412) 5158 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:26:07.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:26:06 gibba045 bash[25517]: cephadm 2021-03-10T15:26:05.107442+0000 mgr.gibba045.orlgmj (mgr.34412) 5159 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:26:07.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:26:06 gibba045 bash[25517]: cephadm 2021-03-10T15:26:05.108352+0000 mgr.gibba045.orlgmj (mgr.34412) 5160 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:26:07.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:26:06 gibba045 bash[25517]: cephadm 2021-03-10T15:26:05.108404+0000 mgr.gibba045.orlgmj (mgr.34412) 5161 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:26:07.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:26:06 gibba045 bash[25517]: cephadm 2021-03-10T15:26:05.108577+0000 mgr.gibba045.orlgmj (mgr.34412) 5162 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:26:07.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:26:06 gibba045 bash[25517]: cluster 2021-03-10T15:26:05.163549+0000 mgr.gibba045.orlgmj (mgr.34412) 5163 : cluster [DBG] pgmap v2929: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:09.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:26:08 gibba015 bash[29377]: cluster 2021-03-10T15:26:07.165165+0000 mgr.gibba045.orlgmj (mgr.34412) 5164 : cluster [DBG] pgmap v2930: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:09.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:26:08 gibba015 bash[30343]: cluster 2021-03-10T15:26:07.165165+0000 mgr.gibba045.orlgmj (mgr.34412) 5164 : cluster [DBG] pgmap v2930: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:09.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:26:08 gibba045 bash[25517]: cluster 2021-03-10T15:26:07.165165+0000 mgr.gibba045.orlgmj (mgr.34412) 5164 : cluster [DBG] pgmap v2930: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:11.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:26:10 gibba015 bash[29377]: cluster 2021-03-10T15:26:09.166342+0000 mgr.gibba045.orlgmj (mgr.34412) 5165 : cluster [DBG] pgmap v2931: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:11.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:26:10 gibba015 bash[30343]: cluster 2021-03-10T15:26:09.166342+0000 mgr.gibba045.orlgmj (mgr.34412) 5165 : cluster [DBG] pgmap v2931: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:11.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:26:10 gibba045 bash[25517]: cluster 2021-03-10T15:26:09.166342+0000 mgr.gibba045.orlgmj (mgr.34412) 5165 : cluster [DBG] pgmap v2931: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:13.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:26:12 gibba015 bash[29377]: cluster 2021-03-10T15:26:11.168120+0000 mgr.gibba045.orlgmj (mgr.34412) 5166 : cluster [DBG] pgmap v2932: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:13.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:26:12 gibba015 bash[30343]: cluster 2021-03-10T15:26:11.168120+0000 mgr.gibba045.orlgmj (mgr.34412) 5166 : cluster [DBG] pgmap v2932: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:13.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:26:12 gibba045 bash[25517]: cluster 2021-03-10T15:26:11.168120+0000 mgr.gibba045.orlgmj (mgr.34412) 5166 : cluster [DBG] pgmap v2932: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:15.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:26:14 gibba015 bash[29377]: cluster 2021-03-10T15:26:13.169702+0000 mgr.gibba045.orlgmj (mgr.34412) 5167 : cluster [DBG] pgmap v2933: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:15.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:26:14 gibba015 bash[30343]: cluster 2021-03-10T15:26:13.169702+0000 mgr.gibba045.orlgmj (mgr.34412) 5167 : cluster [DBG] pgmap v2933: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:15.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:26:14 gibba045 bash[25517]: cluster 2021-03-10T15:26:13.169702+0000 mgr.gibba045.orlgmj (mgr.34412) 5167 : cluster [DBG] pgmap v2933: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:17.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:26:16 gibba015 bash[29377]: cluster 2021-03-10T15:26:15.170366+0000 mgr.gibba045.orlgmj (mgr.34412) 5168 : cluster [DBG] pgmap v2934: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:17.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:26:16 gibba015 bash[30343]: cluster 2021-03-10T15:26:15.170366+0000 mgr.gibba045.orlgmj (mgr.34412) 5168 : cluster [DBG] pgmap v2934: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:17.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:26:16 gibba045 bash[25517]: cluster 2021-03-10T15:26:15.170366+0000 mgr.gibba045.orlgmj (mgr.34412) 5168 : cluster [DBG] pgmap v2934: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:19.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:26:18 gibba015 bash[29377]: cluster 2021-03-10T15:26:17.171979+0000 mgr.gibba045.orlgmj (mgr.34412) 5169 : cluster [DBG] pgmap v2935: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:19.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:26:18 gibba015 bash[30343]: cluster 2021-03-10T15:26:17.171979+0000 mgr.gibba045.orlgmj (mgr.34412) 5169 : cluster [DBG] pgmap v2935: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:19.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:26:18 gibba045 bash[25517]: cluster 2021-03-10T15:26:17.171979+0000 mgr.gibba045.orlgmj (mgr.34412) 5169 : cluster [DBG] pgmap v2935: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:21.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:26:20 gibba015 bash[29377]: cluster 2021-03-10T15:26:19.173187+0000 mgr.gibba045.orlgmj (mgr.34412) 5170 : cluster [DBG] pgmap v2936: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:21.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:26:20 gibba015 bash[30343]: cluster 2021-03-10T15:26:19.173187+0000 mgr.gibba045.orlgmj (mgr.34412) 5170 : cluster [DBG] pgmap v2936: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:21.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:26:20 gibba045 bash[25517]: cluster 2021-03-10T15:26:19.173187+0000 mgr.gibba045.orlgmj (mgr.34412) 5170 : cluster [DBG] pgmap v2936: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:22.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:26:21 gibba015 bash[29377]: cephadm 2021-03-10T15:26:20.109455+0000 mgr.gibba045.orlgmj (mgr.34412) 5171 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:26:22.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:26:21 gibba015 bash[30343]: cephadm 2021-03-10T15:26:20.109455+0000 mgr.gibba045.orlgmj (mgr.34412) 5171 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:26:22.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:26:21 gibba045 bash[25517]: cephadm 2021-03-10T15:26:20.109455+0000 mgr.gibba045.orlgmj (mgr.34412) 5171 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:26:23.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:26:22 gibba015 bash[29377]: cluster 2021-03-10T15:26:21.173903+0000 mgr.gibba045.orlgmj (mgr.34412) 5172 : cluster [DBG] pgmap v2937: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:23.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:26:22 gibba015 bash[30343]: cluster 2021-03-10T15:26:21.173903+0000 mgr.gibba045.orlgmj (mgr.34412) 5172 : cluster [DBG] pgmap v2937: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:23.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:26:22 gibba045 bash[25517]: cluster 2021-03-10T15:26:21.173903+0000 mgr.gibba045.orlgmj (mgr.34412) 5172 : cluster [DBG] pgmap v2937: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:24.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:26:23 gibba045 bash[25517]: cluster 2021-03-10T15:26:23.175286+0000 mgr.gibba045.orlgmj (mgr.34412) 5173 : cluster [DBG] pgmap v2938: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:24.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:26:23 gibba015 bash[29377]: cluster 2021-03-10T15:26:23.175286+0000 mgr.gibba045.orlgmj (mgr.34412) 5173 : cluster [DBG] pgmap v2938: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:24.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:26:23 gibba015 bash[30343]: cluster 2021-03-10T15:26:23.175286+0000 mgr.gibba045.orlgmj (mgr.34412) 5173 : cluster [DBG] pgmap v2938: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:26.313 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:26:26.541 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:26:26.541 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (97m) 85s ago 102m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:26:26.541 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (102m) 21s ago 102m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:26:26.542 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (97m) 21s ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:26:26.542 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (97m) 21s ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:26:26.542 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (96m) 85s ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:26:26.542 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (96m) 85s ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:26:26.543 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (96m) 21s ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:26:26.543 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (96m) 85s ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:26:26.543 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (102m) 85s ago 102m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:26:26.543 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (102m) 21s ago 102m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:26:26.544 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (95m) 85s ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:26:26.544 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (95m) 85s ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:26:26.544 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (94m) 85s ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:26:26.544 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (94m) 85s ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:26:26.545 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (93m) 21s ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:26:26.545 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (93m) 21s ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:26:26.545 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (92m) 21s ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:26:26.545 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (92m) 21s ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:26:26.546 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (102m) 21s ago 102m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:26:26.546 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 21s ago 100m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:26:26.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:26:26 gibba045 bash[25517]: cluster 2021-03-10T15:26:25.177061+0000 mgr.gibba045.orlgmj (mgr.34412) 5174 : cluster [DBG] pgmap v2939: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:26.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:26:26 gibba015 bash[29377]: cluster 2021-03-10T15:26:25.177061+0000 mgr.gibba045.orlgmj (mgr.34412) 5174 : cluster [DBG] pgmap v2939: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:26.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:26:26 gibba015 bash[30343]: cluster 2021-03-10T15:26:25.177061+0000 mgr.gibba045.orlgmj (mgr.34412) 5174 : cluster [DBG] pgmap v2939: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:26.787 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:26:26.788 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:26:26.788 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:26:26.788 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:26:26.788 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:26:26.789 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:26:26.789 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:26:26.789 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:26:26.789 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:26:26.790 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:26:26.790 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:26:26.790 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:26:26.790 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:26:26.791 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:26:26.791 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:26:27.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:26:27 gibba045 bash[25517]: audit 2021-03-10T15:26:26.303724+0000 mgr.gibba045.orlgmj (mgr.34412) 5175 : audit [DBG] from='client.57514 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:26:27.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:26:27 gibba045 bash[25517]: audit 2021-03-10T15:26:26.528104+0000 mgr.gibba045.orlgmj (mgr.34412) 5176 : audit [DBG] from='client.57520 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:26:27.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:26:27 gibba045 bash[25517]: audit 2021-03-10T15:26:26.783298+0000 mon.c (mon.1) 1464 : audit [DBG] from='client.? 172.21.2.115:0/1844049611' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:26:27.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:26:27 gibba015 bash[29377]: audit 2021-03-10T15:26:26.303724+0000 mgr.gibba045.orlgmj (mgr.34412) 5175 : audit [DBG] from='client.57514 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:26:27.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:26:27 gibba015 bash[29377]: audit 2021-03-10T15:26:26.528104+0000 mgr.gibba045.orlgmj (mgr.34412) 5176 : audit [DBG] from='client.57520 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:26:27.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:26:27 gibba015 bash[29377]: audit 2021-03-10T15:26:26.783298+0000 mon.c (mon.1) 1464 : audit [DBG] from='client.? 172.21.2.115:0/1844049611' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:26:27.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:26:27 gibba015 bash[30343]: audit 2021-03-10T15:26:26.303724+0000 mgr.gibba045.orlgmj (mgr.34412) 5175 : audit [DBG] from='client.57514 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:26:27.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:26:27 gibba015 bash[30343]: audit 2021-03-10T15:26:26.528104+0000 mgr.gibba045.orlgmj (mgr.34412) 5176 : audit [DBG] from='client.57520 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:26:27.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:26:27 gibba015 bash[30343]: audit 2021-03-10T15:26:26.783298+0000 mon.c (mon.1) 1464 : audit [DBG] from='client.? 172.21.2.115:0/1844049611' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:26:28.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:26:28 gibba015 bash[29377]: cluster 2021-03-10T15:26:27.178041+0000 mgr.gibba045.orlgmj (mgr.34412) 5177 : cluster [DBG] pgmap v2940: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:28.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:26:28 gibba015 bash[30343]: cluster 2021-03-10T15:26:27.178041+0000 mgr.gibba045.orlgmj (mgr.34412) 5177 : cluster [DBG] pgmap v2940: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:28.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:26:28 gibba045 bash[25517]: cluster 2021-03-10T15:26:27.178041+0000 mgr.gibba045.orlgmj (mgr.34412) 5177 : cluster [DBG] pgmap v2940: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:30.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:26:30 gibba015 bash[29377]: cluster 2021-03-10T15:26:29.179087+0000 mgr.gibba045.orlgmj (mgr.34412) 5178 : cluster [DBG] pgmap v2941: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:30.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:26:30 gibba015 bash[30343]: cluster 2021-03-10T15:26:29.179087+0000 mgr.gibba045.orlgmj (mgr.34412) 5178 : cluster [DBG] pgmap v2941: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:30.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:26:30 gibba045 bash[25517]: cluster 2021-03-10T15:26:29.179087+0000 mgr.gibba045.orlgmj (mgr.34412) 5178 : cluster [DBG] pgmap v2941: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:32.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:26:32 gibba015 bash[29377]: cluster 2021-03-10T15:26:31.180936+0000 mgr.gibba045.orlgmj (mgr.34412) 5179 : cluster [DBG] pgmap v2942: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:32.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:26:32 gibba015 bash[30343]: cluster 2021-03-10T15:26:31.180936+0000 mgr.gibba045.orlgmj (mgr.34412) 5179 : cluster [DBG] pgmap v2942: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:32.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:26:32 gibba045 bash[25517]: cluster 2021-03-10T15:26:31.180936+0000 mgr.gibba045.orlgmj (mgr.34412) 5179 : cluster [DBG] pgmap v2942: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:34.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:26:34 gibba015 bash[29377]: cluster 2021-03-10T15:26:33.181629+0000 mgr.gibba045.orlgmj (mgr.34412) 5180 : cluster [DBG] pgmap v2943: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:34.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:26:34 gibba015 bash[30343]: cluster 2021-03-10T15:26:33.181629+0000 mgr.gibba045.orlgmj (mgr.34412) 5180 : cluster [DBG] pgmap v2943: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:34.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:26:34 gibba045 bash[25517]: cluster 2021-03-10T15:26:33.181629+0000 mgr.gibba045.orlgmj (mgr.34412) 5180 : cluster [DBG] pgmap v2943: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:36.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:26:36 gibba015 bash[29377]: cephadm 2021-03-10T15:26:35.125579+0000 mgr.gibba045.orlgmj (mgr.34412) 5181 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:26:36.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:26:36 gibba015 bash[29377]: cluster 2021-03-10T15:26:35.183170+0000 mgr.gibba045.orlgmj (mgr.34412) 5182 : cluster [DBG] pgmap v2944: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:36.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:26:36 gibba015 bash[30343]: cephadm 2021-03-10T15:26:35.125579+0000 mgr.gibba045.orlgmj (mgr.34412) 5181 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:26:36.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:26:36 gibba015 bash[30343]: cluster 2021-03-10T15:26:35.183170+0000 mgr.gibba045.orlgmj (mgr.34412) 5182 : cluster [DBG] pgmap v2944: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:36.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:26:36 gibba045 bash[25517]: cephadm 2021-03-10T15:26:35.125579+0000 mgr.gibba045.orlgmj (mgr.34412) 5181 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:26:36.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:26:36 gibba045 bash[25517]: cluster 2021-03-10T15:26:35.183170+0000 mgr.gibba045.orlgmj (mgr.34412) 5182 : cluster [DBG] pgmap v2944: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:38.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:26:38 gibba015 bash[29377]: cluster 2021-03-10T15:26:37.184936+0000 mgr.gibba045.orlgmj (mgr.34412) 5183 : cluster [DBG] pgmap v2945: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:38.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:26:38 gibba015 bash[30343]: cluster 2021-03-10T15:26:37.184936+0000 mgr.gibba045.orlgmj (mgr.34412) 5183 : cluster [DBG] pgmap v2945: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:38.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:26:38 gibba045 bash[25517]: cluster 2021-03-10T15:26:37.184936+0000 mgr.gibba045.orlgmj (mgr.34412) 5183 : cluster [DBG] pgmap v2945: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:40.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:26:40 gibba015 bash[29377]: cluster 2021-03-10T15:26:39.186137+0000 mgr.gibba045.orlgmj (mgr.34412) 5184 : cluster [DBG] pgmap v2946: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:40.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:26:40 gibba015 bash[30343]: cluster 2021-03-10T15:26:39.186137+0000 mgr.gibba045.orlgmj (mgr.34412) 5184 : cluster [DBG] pgmap v2946: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:40.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:26:40 gibba045 bash[25517]: cluster 2021-03-10T15:26:39.186137+0000 mgr.gibba045.orlgmj (mgr.34412) 5184 : cluster [DBG] pgmap v2946: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:42.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:26:42 gibba015 bash[29377]: cluster 2021-03-10T15:26:41.187952+0000 mgr.gibba045.orlgmj (mgr.34412) 5185 : cluster [DBG] pgmap v2947: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:42.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:26:42 gibba015 bash[30343]: cluster 2021-03-10T15:26:41.187952+0000 mgr.gibba045.orlgmj (mgr.34412) 5185 : cluster [DBG] pgmap v2947: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:42.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:26:42 gibba045 bash[25517]: cluster 2021-03-10T15:26:41.187952+0000 mgr.gibba045.orlgmj (mgr.34412) 5185 : cluster [DBG] pgmap v2947: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:44.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:26:44 gibba015 bash[29377]: cluster 2021-03-10T15:26:43.189593+0000 mgr.gibba045.orlgmj (mgr.34412) 5186 : cluster [DBG] pgmap v2948: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:44.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:26:44 gibba015 bash[30343]: cluster 2021-03-10T15:26:43.189593+0000 mgr.gibba045.orlgmj (mgr.34412) 5186 : cluster [DBG] pgmap v2948: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:44.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:26:44 gibba045 bash[25517]: cluster 2021-03-10T15:26:43.189593+0000 mgr.gibba045.orlgmj (mgr.34412) 5186 : cluster [DBG] pgmap v2948: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:46.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:26:46 gibba015 bash[29377]: cluster 2021-03-10T15:26:45.190621+0000 mgr.gibba045.orlgmj (mgr.34412) 5187 : cluster [DBG] pgmap v2949: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:46.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:26:46 gibba015 bash[30343]: cluster 2021-03-10T15:26:45.190621+0000 mgr.gibba045.orlgmj (mgr.34412) 5187 : cluster [DBG] pgmap v2949: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:46.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:26:46 gibba045 bash[25517]: cluster 2021-03-10T15:26:45.190621+0000 mgr.gibba045.orlgmj (mgr.34412) 5187 : cluster [DBG] pgmap v2949: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:48.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:26:48 gibba015 bash[29377]: cluster 2021-03-10T15:26:47.192173+0000 mgr.gibba045.orlgmj (mgr.34412) 5188 : cluster [DBG] pgmap v2950: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:48.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:26:48 gibba015 bash[30343]: cluster 2021-03-10T15:26:47.192173+0000 mgr.gibba045.orlgmj (mgr.34412) 5188 : cluster [DBG] pgmap v2950: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:48.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:26:48 gibba045 bash[25517]: cluster 2021-03-10T15:26:47.192173+0000 mgr.gibba045.orlgmj (mgr.34412) 5188 : cluster [DBG] pgmap v2950: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:50.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:26:50 gibba015 bash[29377]: cluster 2021-03-10T15:26:49.193369+0000 mgr.gibba045.orlgmj (mgr.34412) 5189 : cluster [DBG] pgmap v2951: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:50.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:26:50 gibba015 bash[30343]: cluster 2021-03-10T15:26:49.193369+0000 mgr.gibba045.orlgmj (mgr.34412) 5189 : cluster [DBG] pgmap v2951: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:50.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:26:50 gibba045 bash[25517]: cluster 2021-03-10T15:26:49.193369+0000 mgr.gibba045.orlgmj (mgr.34412) 5189 : cluster [DBG] pgmap v2951: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:51.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:26:51 gibba015 bash[29377]: cephadm 2021-03-10T15:26:50.141293+0000 mgr.gibba045.orlgmj (mgr.34412) 5190 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:26:51.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:26:51 gibba015 bash[30343]: cephadm 2021-03-10T15:26:50.141293+0000 mgr.gibba045.orlgmj (mgr.34412) 5190 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:26:51.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:26:51 gibba045 bash[25517]: cephadm 2021-03-10T15:26:50.141293+0000 mgr.gibba045.orlgmj (mgr.34412) 5190 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:26:52.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:26:52 gibba015 bash[29377]: cluster 2021-03-10T15:26:51.194281+0000 mgr.gibba045.orlgmj (mgr.34412) 5191 : cluster [DBG] pgmap v2952: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:52.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:26:52 gibba015 bash[30343]: cluster 2021-03-10T15:26:51.194281+0000 mgr.gibba045.orlgmj (mgr.34412) 5191 : cluster [DBG] pgmap v2952: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:52.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:26:52 gibba045 bash[25517]: cluster 2021-03-10T15:26:51.194281+0000 mgr.gibba045.orlgmj (mgr.34412) 5191 : cluster [DBG] pgmap v2952: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:26:53 gibba015 bash[29377]: audit 2021-03-10T15:26:53.124850+0000 mon.c (mon.1) 1465 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:26:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:26:53 gibba015 bash[29377]: audit 2021-03-10T15:26:53.125559+0000 mon.c (mon.1) 1466 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:26:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:26:53 gibba015 bash[29377]: audit 2021-03-10T15:26:53.126047+0000 mon.a (mon.0) 1368 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:26:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:26:53 gibba015 bash[29377]: audit 2021-03-10T15:26:53.126217+0000 mon.c (mon.1) 1467 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T15:26:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:26:53 gibba015 bash[29377]: audit 2021-03-10T15:26:53.127036+0000 mon.c (mon.1) 1468 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:26:53.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:26:53 gibba015 bash[29377]: audit 2021-03-10T15:26:53.127208+0000 mon.a (mon.0) 1369 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:26:53.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:26:53 gibba015 bash[29377]: audit 2021-03-10T15:26:53.127744+0000 mon.c (mon.1) 1469 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T15:26:53.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:26:53 gibba015 bash[29377]: audit 2021-03-10T15:26:53.128275+0000 mon.a (mon.0) 1370 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T15:26:53.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:26:53 gibba015 bash[29377]: audit 2021-03-10T15:26:53.128575+0000 mon.c (mon.1) 1470 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:26:53.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:26:53 gibba015 bash[29377]: audit 2021-03-10T15:26:53.129344+0000 mon.a (mon.0) 1371 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:26:53.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:26:53 gibba015 bash[29377]: audit 2021-03-10T15:26:53.130323+0000 mon.a (mon.0) 1372 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T15:26:53.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:26:53 gibba015 bash[29377]: audit 2021-03-10T15:26:53.131110+0000 mon.a (mon.0) 1373 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:26:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:26:53 gibba015 bash[30343]: audit 2021-03-10T15:26:53.124850+0000 mon.c (mon.1) 1465 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:26:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:26:53 gibba015 bash[30343]: audit 2021-03-10T15:26:53.125559+0000 mon.c (mon.1) 1466 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:26:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:26:53 gibba015 bash[30343]: audit 2021-03-10T15:26:53.126047+0000 mon.a (mon.0) 1368 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:26:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:26:53 gibba015 bash[30343]: audit 2021-03-10T15:26:53.126217+0000 mon.c (mon.1) 1467 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T15:26:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:26:53 gibba015 bash[30343]: audit 2021-03-10T15:26:53.127036+0000 mon.c (mon.1) 1468 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:26:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:26:53 gibba015 bash[30343]: audit 2021-03-10T15:26:53.127208+0000 mon.a (mon.0) 1369 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:26:53.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:26:53 gibba015 bash[30343]: audit 2021-03-10T15:26:53.127744+0000 mon.c (mon.1) 1469 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T15:26:53.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:26:53 gibba015 bash[30343]: audit 2021-03-10T15:26:53.128275+0000 mon.a (mon.0) 1370 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T15:26:53.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:26:53 gibba015 bash[30343]: audit 2021-03-10T15:26:53.128575+0000 mon.c (mon.1) 1470 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:26:53.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:26:53 gibba015 bash[30343]: audit 2021-03-10T15:26:53.129344+0000 mon.a (mon.0) 1371 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:26:53.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:26:53 gibba015 bash[30343]: audit 2021-03-10T15:26:53.130323+0000 mon.a (mon.0) 1372 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T15:26:53.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:26:53 gibba015 bash[30343]: audit 2021-03-10T15:26:53.131110+0000 mon.a (mon.0) 1373 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:26:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:26:53 gibba045 bash[25517]: audit 2021-03-10T15:26:53.124850+0000 mon.c (mon.1) 1465 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:26:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:26:53 gibba045 bash[25517]: audit 2021-03-10T15:26:53.125559+0000 mon.c (mon.1) 1466 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:26:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:26:53 gibba045 bash[25517]: audit 2021-03-10T15:26:53.126047+0000 mon.a (mon.0) 1368 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:26:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:26:53 gibba045 bash[25517]: audit 2021-03-10T15:26:53.126217+0000 mon.c (mon.1) 1467 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T15:26:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:26:53 gibba045 bash[25517]: audit 2021-03-10T15:26:53.127036+0000 mon.c (mon.1) 1468 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:26:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:26:53 gibba045 bash[25517]: audit 2021-03-10T15:26:53.127208+0000 mon.a (mon.0) 1369 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:26:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:26:53 gibba045 bash[25517]: audit 2021-03-10T15:26:53.127744+0000 mon.c (mon.1) 1469 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T15:26:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:26:53 gibba045 bash[25517]: audit 2021-03-10T15:26:53.128275+0000 mon.a (mon.0) 1370 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T15:26:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:26:53 gibba045 bash[25517]: audit 2021-03-10T15:26:53.128575+0000 mon.c (mon.1) 1470 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:26:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:26:53 gibba045 bash[25517]: audit 2021-03-10T15:26:53.129344+0000 mon.a (mon.0) 1371 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:26:53.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:26:53 gibba045 bash[25517]: audit 2021-03-10T15:26:53.130323+0000 mon.a (mon.0) 1372 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T15:26:53.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:26:53 gibba045 bash[25517]: audit 2021-03-10T15:26:53.131110+0000 mon.a (mon.0) 1373 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:26:54.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:26:54 gibba015 bash[29377]: cluster 2021-03-10T15:26:53.195101+0000 mgr.gibba045.orlgmj (mgr.34412) 5192 : cluster [DBG] pgmap v2953: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:26:54 gibba015 bash[30343]: cluster 2021-03-10T15:26:53.195101+0000 mgr.gibba045.orlgmj (mgr.34412) 5192 : cluster [DBG] pgmap v2953: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:54.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:26:54 gibba045 bash[25517]: cluster 2021-03-10T15:26:53.195101+0000 mgr.gibba045.orlgmj (mgr.34412) 5192 : cluster [DBG] pgmap v2953: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:56.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:26:56 gibba015 bash[29377]: cluster 2021-03-10T15:26:55.196413+0000 mgr.gibba045.orlgmj (mgr.34412) 5193 : cluster [DBG] pgmap v2954: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:56.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:26:56 gibba015 bash[30343]: cluster 2021-03-10T15:26:55.196413+0000 mgr.gibba045.orlgmj (mgr.34412) 5193 : cluster [DBG] pgmap v2954: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:56.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:26:56 gibba045 bash[25517]: cluster 2021-03-10T15:26:55.196413+0000 mgr.gibba045.orlgmj (mgr.34412) 5193 : cluster [DBG] pgmap v2954: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:57.031 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:26:57.259 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:26:57.259 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (97m) 116s ago 103m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:26:57.260 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (102m) 52s ago 102m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:26:57.260 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (98m) 52s ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:26:57.260 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (98m) 52s ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:26:57.261 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (97m) 116s ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:26:57.261 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (97m) 116s ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:26:57.261 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (96m) 52s ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:26:57.261 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (96m) 116s ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:26:57.262 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (103m) 116s ago 103m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:26:57.262 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (103m) 52s ago 103m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:26:57.262 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (95m) 116s ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:26:57.262 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (95m) 116s ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:26:57.263 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (95m) 116s ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:26:57.263 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (94m) 116s ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:26:57.263 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (94m) 52s ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:26:57.264 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (93m) 52s ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:26:57.264 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (93m) 52s ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:26:57.264 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (92m) 52s ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:26:57.264 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (102m) 52s ago 103m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:26:57.265 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 52s ago 101m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:26:57.510 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:26:57.511 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:26:57.511 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:26:57.511 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:26:57.512 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:26:57.512 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:26:57.512 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:26:57.513 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:26:57.513 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:26:57.513 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:26:57.513 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:26:57.514 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:26:57.514 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:26:57.514 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:26:57.514 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:26:58.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:26:58 gibba015 bash[29377]: audit 2021-03-10T15:26:57.021242+0000 mgr.gibba045.orlgmj (mgr.34412) 5194 : audit [DBG] from='client.47544 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:26:58.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:26:58 gibba015 bash[29377]: cluster 2021-03-10T15:26:57.197635+0000 mgr.gibba045.orlgmj (mgr.34412) 5195 : cluster [DBG] pgmap v2955: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:58.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:26:58 gibba015 bash[29377]: audit 2021-03-10T15:26:57.246421+0000 mgr.gibba045.orlgmj (mgr.34412) 5196 : audit [DBG] from='client.47550 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:26:58.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:26:58 gibba015 bash[29377]: audit 2021-03-10T15:26:57.505904+0000 mon.a (mon.0) 1374 : audit [DBG] from='client.? 172.21.2.115:0/2225582937' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:26:58.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:26:58 gibba015 bash[30343]: audit 2021-03-10T15:26:57.021242+0000 mgr.gibba045.orlgmj (mgr.34412) 5194 : audit [DBG] from='client.47544 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:26:58.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:26:58 gibba015 bash[30343]: cluster 2021-03-10T15:26:57.197635+0000 mgr.gibba045.orlgmj (mgr.34412) 5195 : cluster [DBG] pgmap v2955: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:58.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:26:58 gibba015 bash[30343]: audit 2021-03-10T15:26:57.246421+0000 mgr.gibba045.orlgmj (mgr.34412) 5196 : audit [DBG] from='client.47550 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:26:58.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:26:58 gibba015 bash[30343]: audit 2021-03-10T15:26:57.505904+0000 mon.a (mon.0) 1374 : audit [DBG] from='client.? 172.21.2.115:0/2225582937' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:26:58.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:26:58 gibba045 bash[25517]: audit 2021-03-10T15:26:57.021242+0000 mgr.gibba045.orlgmj (mgr.34412) 5194 : audit [DBG] from='client.47544 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:26:58.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:26:58 gibba045 bash[25517]: cluster 2021-03-10T15:26:57.197635+0000 mgr.gibba045.orlgmj (mgr.34412) 5195 : cluster [DBG] pgmap v2955: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:58.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:26:58 gibba045 bash[25517]: audit 2021-03-10T15:26:57.246421+0000 mgr.gibba045.orlgmj (mgr.34412) 5196 : audit [DBG] from='client.47550 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:26:58.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:26:58 gibba045 bash[25517]: audit 2021-03-10T15:26:57.505904+0000 mon.a (mon.0) 1374 : audit [DBG] from='client.? 172.21.2.115:0/2225582937' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:27:00.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:27:00 gibba015 bash[29377]: cluster 2021-03-10T15:26:59.198699+0000 mgr.gibba045.orlgmj (mgr.34412) 5197 : cluster [DBG] pgmap v2956: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:00.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:27:00 gibba015 bash[30343]: cluster 2021-03-10T15:26:59.198699+0000 mgr.gibba045.orlgmj (mgr.34412) 5197 : cluster [DBG] pgmap v2956: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:00.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:27:00 gibba045 bash[25517]: cluster 2021-03-10T15:26:59.198699+0000 mgr.gibba045.orlgmj (mgr.34412) 5197 : cluster [DBG] pgmap v2956: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:02.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:27:02 gibba015 bash[29377]: cluster 2021-03-10T15:27:01.200278+0000 mgr.gibba045.orlgmj (mgr.34412) 5198 : cluster [DBG] pgmap v2957: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:02.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:27:02 gibba015 bash[30343]: cluster 2021-03-10T15:27:01.200278+0000 mgr.gibba045.orlgmj (mgr.34412) 5198 : cluster [DBG] pgmap v2957: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:02.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:27:02 gibba045 bash[25517]: cluster 2021-03-10T15:27:01.200278+0000 mgr.gibba045.orlgmj (mgr.34412) 5198 : cluster [DBG] pgmap v2957: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:04.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:27:04 gibba015 bash[29377]: cluster 2021-03-10T15:27:03.201952+0000 mgr.gibba045.orlgmj (mgr.34412) 5199 : cluster [DBG] pgmap v2958: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:04.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:27:04 gibba015 bash[30343]: cluster 2021-03-10T15:27:03.201952+0000 mgr.gibba045.orlgmj (mgr.34412) 5199 : cluster [DBG] pgmap v2958: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:04.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:27:04 gibba045 bash[25517]: cluster 2021-03-10T15:27:03.201952+0000 mgr.gibba045.orlgmj (mgr.34412) 5199 : cluster [DBG] pgmap v2958: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:05.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:27:05 gibba045 bash[25517]: audit 2021-03-10T15:27:05.150015+0000 mon.c (mon.1) 1471 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:27:05.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:27:05 gibba045 bash[25517]: audit 2021-03-10T15:27:05.363837+0000 mon.a (mon.0) 1375 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:27:05.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:27:05 gibba045 bash[25517]: audit 2021-03-10T15:27:05.367215+0000 mon.c (mon.1) 1472 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:27:05.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:27:05 gibba045 bash[25517]: audit 2021-03-10T15:27:05.368544+0000 mon.c (mon.1) 1473 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:27:05.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:27:05 gibba045 bash[25517]: audit 2021-03-10T15:27:05.369962+0000 mon.c (mon.1) 1474 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:27:05.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:27:05 gibba045 bash[25517]: audit 2021-03-10T15:27:05.371214+0000 mon.c (mon.1) 1475 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:27:05.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:27:05 gibba045 bash[25517]: audit 2021-03-10T15:27:05.377134+0000 mon.c (mon.1) 1476 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:27:05.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:27:05 gibba045 bash[25517]: audit 2021-03-10T15:27:05.382338+0000 mon.c (mon.1) 1477 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:27:05.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:27:05 gibba015 bash[29377]: audit 2021-03-10T15:27:05.150015+0000 mon.c (mon.1) 1471 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:27:05.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:27:05 gibba015 bash[29377]: audit 2021-03-10T15:27:05.363837+0000 mon.a (mon.0) 1375 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:27:05.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:27:05 gibba015 bash[29377]: audit 2021-03-10T15:27:05.367215+0000 mon.c (mon.1) 1472 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:27:05.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:27:05 gibba015 bash[29377]: audit 2021-03-10T15:27:05.368544+0000 mon.c (mon.1) 1473 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:27:05.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:27:05 gibba015 bash[29377]: audit 2021-03-10T15:27:05.369962+0000 mon.c (mon.1) 1474 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:27:05.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:27:05 gibba015 bash[29377]: audit 2021-03-10T15:27:05.371214+0000 mon.c (mon.1) 1475 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:27:05.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:27:05 gibba015 bash[29377]: audit 2021-03-10T15:27:05.377134+0000 mon.c (mon.1) 1476 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:27:05.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:27:05 gibba015 bash[29377]: audit 2021-03-10T15:27:05.382338+0000 mon.c (mon.1) 1477 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:27:05.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:27:05 gibba015 bash[30343]: audit 2021-03-10T15:27:05.150015+0000 mon.c (mon.1) 1471 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:27:05.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:27:05 gibba015 bash[30343]: audit 2021-03-10T15:27:05.363837+0000 mon.a (mon.0) 1375 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:27:05.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:27:05 gibba015 bash[30343]: audit 2021-03-10T15:27:05.367215+0000 mon.c (mon.1) 1472 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:27:05.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:27:05 gibba015 bash[30343]: audit 2021-03-10T15:27:05.368544+0000 mon.c (mon.1) 1473 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:27:05.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:27:05 gibba015 bash[30343]: audit 2021-03-10T15:27:05.369962+0000 mon.c (mon.1) 1474 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:27:05.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:27:05 gibba015 bash[30343]: audit 2021-03-10T15:27:05.371214+0000 mon.c (mon.1) 1475 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:27:05.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:27:05 gibba015 bash[30343]: audit 2021-03-10T15:27:05.377134+0000 mon.c (mon.1) 1476 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:27:05.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:27:05 gibba015 bash[30343]: audit 2021-03-10T15:27:05.382338+0000 mon.c (mon.1) 1477 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:27:06.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:27:06 gibba045 bash[25517]: cephadm 2021-03-10T15:27:05.159172+0000 mgr.gibba045.orlgmj (mgr.34412) 5200 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:27:06.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:27:06 gibba045 bash[25517]: cephadm 2021-03-10T15:27:05.161110+0000 mgr.gibba045.orlgmj (mgr.34412) 5201 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:27:06.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:27:06 gibba045 bash[25517]: cluster 2021-03-10T15:27:05.202507+0000 mgr.gibba045.orlgmj (mgr.34412) 5202 : cluster [DBG] pgmap v2959: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:06.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:27:06 gibba045 bash[25517]: cephadm 2021-03-10T15:27:05.370597+0000 mgr.gibba045.orlgmj (mgr.34412) 5203 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:27:06.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:27:06 gibba045 bash[25517]: cephadm 2021-03-10T15:27:05.372110+0000 mgr.gibba045.orlgmj (mgr.34412) 5204 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:27:06.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:27:06 gibba045 bash[25517]: cephadm 2021-03-10T15:27:05.373330+0000 mgr.gibba045.orlgmj (mgr.34412) 5205 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:27:06.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:27:06 gibba045 bash[25517]: cephadm 2021-03-10T15:27:05.373423+0000 mgr.gibba045.orlgmj (mgr.34412) 5206 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:27:06.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:27:06 gibba045 bash[25517]: cephadm 2021-03-10T15:27:05.374794+0000 mgr.gibba045.orlgmj (mgr.34412) 5207 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:27:06.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:27:06 gibba045 bash[25517]: cephadm 2021-03-10T15:27:05.374832+0000 mgr.gibba045.orlgmj (mgr.34412) 5208 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:27:06.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:27:06 gibba045 bash[25517]: cephadm 2021-03-10T15:27:05.376047+0000 mgr.gibba045.orlgmj (mgr.34412) 5209 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:27:06.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:27:06 gibba045 bash[25517]: cephadm 2021-03-10T15:27:05.378647+0000 mgr.gibba045.orlgmj (mgr.34412) 5210 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:27:06.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:27:06 gibba045 bash[25517]: cephadm 2021-03-10T15:27:05.379256+0000 mgr.gibba045.orlgmj (mgr.34412) 5211 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:27:06.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:27:06 gibba045 bash[25517]: cephadm 2021-03-10T15:27:05.383376+0000 mgr.gibba045.orlgmj (mgr.34412) 5212 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:27:06.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:27:06 gibba045 bash[25517]: cephadm 2021-03-10T15:27:05.385470+0000 mgr.gibba045.orlgmj (mgr.34412) 5213 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:27:06.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:27:06 gibba045 bash[25517]: cephadm 2021-03-10T15:27:05.388618+0000 mgr.gibba045.orlgmj (mgr.34412) 5214 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:27:06.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:27:06 gibba045 bash[25517]: cephadm 2021-03-10T15:27:05.389004+0000 mgr.gibba045.orlgmj (mgr.34412) 5215 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:27:06.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:27:06 gibba045 bash[25517]: cephadm 2021-03-10T15:27:05.389594+0000 mgr.gibba045.orlgmj (mgr.34412) 5216 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:27:06.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:27:06 gibba015 bash[29377]: cephadm 2021-03-10T15:27:05.159172+0000 mgr.gibba045.orlgmj (mgr.34412) 5200 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:27:06.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:27:06 gibba015 bash[29377]: cephadm 2021-03-10T15:27:05.161110+0000 mgr.gibba045.orlgmj (mgr.34412) 5201 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:27:06.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:27:06 gibba015 bash[29377]: cluster 2021-03-10T15:27:05.202507+0000 mgr.gibba045.orlgmj (mgr.34412) 5202 : cluster [DBG] pgmap v2959: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:06.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:27:06 gibba015 bash[29377]: cephadm 2021-03-10T15:27:05.370597+0000 mgr.gibba045.orlgmj (mgr.34412) 5203 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:27:06.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:27:06 gibba015 bash[29377]: cephadm 2021-03-10T15:27:05.372110+0000 mgr.gibba045.orlgmj (mgr.34412) 5204 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:27:06.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:27:06 gibba015 bash[29377]: cephadm 2021-03-10T15:27:05.373330+0000 mgr.gibba045.orlgmj (mgr.34412) 5205 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:27:06.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:27:06 gibba015 bash[29377]: cephadm 2021-03-10T15:27:05.373423+0000 mgr.gibba045.orlgmj (mgr.34412) 5206 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:27:06.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:27:06 gibba015 bash[29377]: cephadm 2021-03-10T15:27:05.374794+0000 mgr.gibba045.orlgmj (mgr.34412) 5207 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:27:06.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:27:06 gibba015 bash[29377]: cephadm 2021-03-10T15:27:05.374832+0000 mgr.gibba045.orlgmj (mgr.34412) 5208 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:27:06.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:27:06 gibba015 bash[29377]: cephadm 2021-03-10T15:27:05.376047+0000 mgr.gibba045.orlgmj (mgr.34412) 5209 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:27:06.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:27:06 gibba015 bash[29377]: cephadm 2021-03-10T15:27:05.378647+0000 mgr.gibba045.orlgmj (mgr.34412) 5210 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:27:06.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:27:06 gibba015 bash[29377]: cephadm 2021-03-10T15:27:05.379256+0000 mgr.gibba045.orlgmj (mgr.34412) 5211 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:27:06.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:27:06 gibba015 bash[29377]: cephadm 2021-03-10T15:27:05.383376+0000 mgr.gibba045.orlgmj (mgr.34412) 5212 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:27:06.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:27:06 gibba015 bash[29377]: cephadm 2021-03-10T15:27:05.385470+0000 mgr.gibba045.orlgmj (mgr.34412) 5213 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:27:06.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:27:06 gibba015 bash[29377]: cephadm 2021-03-10T15:27:05.388618+0000 mgr.gibba045.orlgmj (mgr.34412) 5214 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:27:06.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:27:06 gibba015 bash[29377]: cephadm 2021-03-10T15:27:05.389004+0000 mgr.gibba045.orlgmj (mgr.34412) 5215 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:27:06.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:27:06 gibba015 bash[29377]: cephadm 2021-03-10T15:27:05.389594+0000 mgr.gibba045.orlgmj (mgr.34412) 5216 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:27:06.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:27:06 gibba015 bash[30343]: cephadm 2021-03-10T15:27:05.159172+0000 mgr.gibba045.orlgmj (mgr.34412) 5200 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:27:06.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:27:06 gibba015 bash[30343]: cephadm 2021-03-10T15:27:05.161110+0000 mgr.gibba045.orlgmj (mgr.34412) 5201 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:27:06.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:27:06 gibba015 bash[30343]: cluster 2021-03-10T15:27:05.202507+0000 mgr.gibba045.orlgmj (mgr.34412) 5202 : cluster [DBG] pgmap v2959: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:06.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:27:06 gibba015 bash[30343]: cephadm 2021-03-10T15:27:05.370597+0000 mgr.gibba045.orlgmj (mgr.34412) 5203 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:27:06.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:27:06 gibba015 bash[30343]: cephadm 2021-03-10T15:27:05.372110+0000 mgr.gibba045.orlgmj (mgr.34412) 5204 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:27:06.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:27:06 gibba015 bash[30343]: cephadm 2021-03-10T15:27:05.373330+0000 mgr.gibba045.orlgmj (mgr.34412) 5205 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:27:06.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:27:06 gibba015 bash[30343]: cephadm 2021-03-10T15:27:05.373423+0000 mgr.gibba045.orlgmj (mgr.34412) 5206 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:27:06.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:27:06 gibba015 bash[30343]: cephadm 2021-03-10T15:27:05.374794+0000 mgr.gibba045.orlgmj (mgr.34412) 5207 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:27:06.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:27:06 gibba015 bash[30343]: cephadm 2021-03-10T15:27:05.374832+0000 mgr.gibba045.orlgmj (mgr.34412) 5208 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:27:06.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:27:06 gibba015 bash[30343]: cephadm 2021-03-10T15:27:05.376047+0000 mgr.gibba045.orlgmj (mgr.34412) 5209 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:27:06.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:27:06 gibba015 bash[30343]: cephadm 2021-03-10T15:27:05.378647+0000 mgr.gibba045.orlgmj (mgr.34412) 5210 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:27:06.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:27:06 gibba015 bash[30343]: cephadm 2021-03-10T15:27:05.379256+0000 mgr.gibba045.orlgmj (mgr.34412) 5211 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:27:06.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:27:06 gibba015 bash[30343]: cephadm 2021-03-10T15:27:05.383376+0000 mgr.gibba045.orlgmj (mgr.34412) 5212 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:27:06.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:27:06 gibba015 bash[30343]: cephadm 2021-03-10T15:27:05.385470+0000 mgr.gibba045.orlgmj (mgr.34412) 5213 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:27:06.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:27:06 gibba015 bash[30343]: cephadm 2021-03-10T15:27:05.388618+0000 mgr.gibba045.orlgmj (mgr.34412) 5214 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:27:06.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:27:06 gibba015 bash[30343]: cephadm 2021-03-10T15:27:05.389004+0000 mgr.gibba045.orlgmj (mgr.34412) 5215 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:27:06.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:27:06 gibba015 bash[30343]: cephadm 2021-03-10T15:27:05.389594+0000 mgr.gibba045.orlgmj (mgr.34412) 5216 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:27:08.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:27:08 gibba045 bash[25517]: cluster 2021-03-10T15:27:07.203875+0000 mgr.gibba045.orlgmj (mgr.34412) 5217 : cluster [DBG] pgmap v2960: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:08.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:27:08 gibba015 bash[29377]: cluster 2021-03-10T15:27:07.203875+0000 mgr.gibba045.orlgmj (mgr.34412) 5217 : cluster [DBG] pgmap v2960: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:08.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:27:08 gibba015 bash[30343]: cluster 2021-03-10T15:27:07.203875+0000 mgr.gibba045.orlgmj (mgr.34412) 5217 : cluster [DBG] pgmap v2960: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:10.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:27:10 gibba045 bash[25517]: cluster 2021-03-10T15:27:09.205141+0000 mgr.gibba045.orlgmj (mgr.34412) 5218 : cluster [DBG] pgmap v2961: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:10.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:27:10 gibba015 bash[29377]: cluster 2021-03-10T15:27:09.205141+0000 mgr.gibba045.orlgmj (mgr.34412) 5218 : cluster [DBG] pgmap v2961: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:10.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:27:10 gibba015 bash[30343]: cluster 2021-03-10T15:27:09.205141+0000 mgr.gibba045.orlgmj (mgr.34412) 5218 : cluster [DBG] pgmap v2961: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:12.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:27:12 gibba045 bash[25517]: cluster 2021-03-10T15:27:11.206812+0000 mgr.gibba045.orlgmj (mgr.34412) 5219 : cluster [DBG] pgmap v2962: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:12.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:27:12 gibba015 bash[29377]: cluster 2021-03-10T15:27:11.206812+0000 mgr.gibba045.orlgmj (mgr.34412) 5219 : cluster [DBG] pgmap v2962: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:12.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:27:12 gibba015 bash[30343]: cluster 2021-03-10T15:27:11.206812+0000 mgr.gibba045.orlgmj (mgr.34412) 5219 : cluster [DBG] pgmap v2962: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:14.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:27:14 gibba045 bash[25517]: cluster 2021-03-10T15:27:13.208292+0000 mgr.gibba045.orlgmj (mgr.34412) 5220 : cluster [DBG] pgmap v2963: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:14.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:27:14 gibba015 bash[29377]: cluster 2021-03-10T15:27:13.208292+0000 mgr.gibba045.orlgmj (mgr.34412) 5220 : cluster [DBG] pgmap v2963: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:14.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:27:14 gibba015 bash[30343]: cluster 2021-03-10T15:27:13.208292+0000 mgr.gibba045.orlgmj (mgr.34412) 5220 : cluster [DBG] pgmap v2963: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:16.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:27:16 gibba045 bash[25517]: cluster 2021-03-10T15:27:15.209959+0000 mgr.gibba045.orlgmj (mgr.34412) 5221 : cluster [DBG] pgmap v2964: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:16.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:27:16 gibba015 bash[29377]: cluster 2021-03-10T15:27:15.209959+0000 mgr.gibba045.orlgmj (mgr.34412) 5221 : cluster [DBG] pgmap v2964: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:16.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:27:16 gibba015 bash[30343]: cluster 2021-03-10T15:27:15.209959+0000 mgr.gibba045.orlgmj (mgr.34412) 5221 : cluster [DBG] pgmap v2964: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:18.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:27:18 gibba045 bash[25517]: cluster 2021-03-10T15:27:17.211695+0000 mgr.gibba045.orlgmj (mgr.34412) 5222 : cluster [DBG] pgmap v2965: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:18.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:27:18 gibba015 bash[29377]: cluster 2021-03-10T15:27:17.211695+0000 mgr.gibba045.orlgmj (mgr.34412) 5222 : cluster [DBG] pgmap v2965: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:18.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:27:18 gibba015 bash[30343]: cluster 2021-03-10T15:27:17.211695+0000 mgr.gibba045.orlgmj (mgr.34412) 5222 : cluster [DBG] pgmap v2965: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:20.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:27:20 gibba045 bash[25517]: cluster 2021-03-10T15:27:19.212990+0000 mgr.gibba045.orlgmj (mgr.34412) 5223 : cluster [DBG] pgmap v2966: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:20.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:27:20 gibba015 bash[29377]: cluster 2021-03-10T15:27:19.212990+0000 mgr.gibba045.orlgmj (mgr.34412) 5223 : cluster [DBG] pgmap v2966: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:20.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:27:20 gibba015 bash[30343]: cluster 2021-03-10T15:27:19.212990+0000 mgr.gibba045.orlgmj (mgr.34412) 5223 : cluster [DBG] pgmap v2966: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:21.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:27:21 gibba015 bash[29377]: cephadm 2021-03-10T15:27:20.405793+0000 mgr.gibba045.orlgmj (mgr.34412) 5224 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:27:21.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:27:21 gibba015 bash[30343]: cephadm 2021-03-10T15:27:20.405793+0000 mgr.gibba045.orlgmj (mgr.34412) 5224 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:27:22.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:27:21 gibba045 bash[25517]: cephadm 2021-03-10T15:27:20.405793+0000 mgr.gibba045.orlgmj (mgr.34412) 5224 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:27:22.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:27:22 gibba015 bash[29377]: cluster 2021-03-10T15:27:21.214577+0000 mgr.gibba045.orlgmj (mgr.34412) 5225 : cluster [DBG] pgmap v2967: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:22.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:27:22 gibba015 bash[30343]: cluster 2021-03-10T15:27:21.214577+0000 mgr.gibba045.orlgmj (mgr.34412) 5225 : cluster [DBG] pgmap v2967: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:23.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:27:22 gibba045 bash[25517]: cluster 2021-03-10T15:27:21.214577+0000 mgr.gibba045.orlgmj (mgr.34412) 5225 : cluster [DBG] pgmap v2967: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:24.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:27:24 gibba015 bash[29377]: cluster 2021-03-10T15:27:23.216234+0000 mgr.gibba045.orlgmj (mgr.34412) 5226 : cluster [DBG] pgmap v2968: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:24.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:27:24 gibba015 bash[30343]: cluster 2021-03-10T15:27:23.216234+0000 mgr.gibba045.orlgmj (mgr.34412) 5226 : cluster [DBG] pgmap v2968: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:25.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:27:24 gibba045 bash[25517]: cluster 2021-03-10T15:27:23.216234+0000 mgr.gibba045.orlgmj (mgr.34412) 5226 : cluster [DBG] pgmap v2968: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:26.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:27:26 gibba015 bash[29377]: cluster 2021-03-10T15:27:25.217935+0000 mgr.gibba045.orlgmj (mgr.34412) 5227 : cluster [DBG] pgmap v2969: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:26.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:27:26 gibba015 bash[30343]: cluster 2021-03-10T15:27:25.217935+0000 mgr.gibba045.orlgmj (mgr.34412) 5227 : cluster [DBG] pgmap v2969: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:27.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:27:26 gibba045 bash[25517]: cluster 2021-03-10T15:27:25.217935+0000 mgr.gibba045.orlgmj (mgr.34412) 5227 : cluster [DBG] pgmap v2969: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:27.752 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:27:27.980 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:27:27.981 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (98m) 2m ago 103m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:27:27.981 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (103m) 83s ago 103m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:27:27.981 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (98m) 83s ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:27:27.981 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (98m) 83s ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:27:27.982 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (97m) 2m ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:27:27.982 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (97m) 2m ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:27:27.983 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (97m) 83s ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:27:27.983 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (97m) 2m ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:27:27.983 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (103m) 2m ago 103m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:27:27.984 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (103m) 83s ago 103m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:27:27.984 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (96m) 2m ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:27:27.984 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (96m) 2m ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:27:27.985 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (95m) 2m ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:27:27.985 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (95m) 2m ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:27:27.985 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (94m) 83s ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:27:27.986 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (94m) 83s ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:27:27.986 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (93m) 83s ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:27:27.986 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (93m) 83s ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:27:27.987 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (103m) 83s ago 103m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:27:27.987 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 83s ago 101m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:27:28.229 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:27:28.229 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:27:28.229 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:27:28.230 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:27:28.230 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:27:28.230 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:27:28.231 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:27:28.231 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:27:28.231 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:27:28.231 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:27:28.232 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:27:28.232 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:27:28.232 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:27:28.232 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:27:28.233 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:27:28.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:27:28 gibba015 bash[29377]: cluster 2021-03-10T15:27:27.219511+0000 mgr.gibba045.orlgmj (mgr.34412) 5228 : cluster [DBG] pgmap v2970: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:28.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:27:28 gibba015 bash[29377]: audit 2021-03-10T15:27:27.743175+0000 mgr.gibba045.orlgmj (mgr.34412) 5229 : audit [DBG] from='client.57550 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:27:28.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:27:28 gibba015 bash[29377]: audit 2021-03-10T15:27:27.967672+0000 mgr.gibba045.orlgmj (mgr.34412) 5230 : audit [DBG] from='client.47568 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:27:28.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:27:28 gibba015 bash[29377]: audit 2021-03-10T15:27:28.224566+0000 mon.c (mon.1) 1478 : audit [DBG] from='client.? 172.21.2.115:0/3825369827' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:27:28.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:27:28 gibba015 bash[30343]: cluster 2021-03-10T15:27:27.219511+0000 mgr.gibba045.orlgmj (mgr.34412) 5228 : cluster [DBG] pgmap v2970: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:28.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:27:28 gibba015 bash[30343]: audit 2021-03-10T15:27:27.743175+0000 mgr.gibba045.orlgmj (mgr.34412) 5229 : audit [DBG] from='client.57550 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:27:28.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:27:28 gibba015 bash[30343]: audit 2021-03-10T15:27:27.967672+0000 mgr.gibba045.orlgmj (mgr.34412) 5230 : audit [DBG] from='client.47568 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:27:28.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:27:28 gibba015 bash[30343]: audit 2021-03-10T15:27:28.224566+0000 mon.c (mon.1) 1478 : audit [DBG] from='client.? 172.21.2.115:0/3825369827' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:27:29.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:27:28 gibba045 bash[25517]: cluster 2021-03-10T15:27:27.219511+0000 mgr.gibba045.orlgmj (mgr.34412) 5228 : cluster [DBG] pgmap v2970: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:29.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:27:28 gibba045 bash[25517]: audit 2021-03-10T15:27:27.743175+0000 mgr.gibba045.orlgmj (mgr.34412) 5229 : audit [DBG] from='client.57550 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:27:29.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:27:28 gibba045 bash[25517]: audit 2021-03-10T15:27:27.967672+0000 mgr.gibba045.orlgmj (mgr.34412) 5230 : audit [DBG] from='client.47568 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:27:29.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:27:28 gibba045 bash[25517]: audit 2021-03-10T15:27:28.224566+0000 mon.c (mon.1) 1478 : audit [DBG] from='client.? 172.21.2.115:0/3825369827' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:27:30.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:27:30 gibba015 bash[29377]: cluster 2021-03-10T15:27:29.220902+0000 mgr.gibba045.orlgmj (mgr.34412) 5231 : cluster [DBG] pgmap v2971: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:30.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:27:30 gibba015 bash[30343]: cluster 2021-03-10T15:27:29.220902+0000 mgr.gibba045.orlgmj (mgr.34412) 5231 : cluster [DBG] pgmap v2971: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:31.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:27:30 gibba045 bash[25517]: cluster 2021-03-10T15:27:29.220902+0000 mgr.gibba045.orlgmj (mgr.34412) 5231 : cluster [DBG] pgmap v2971: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:32.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:27:32 gibba015 bash[29377]: cluster 2021-03-10T15:27:31.222647+0000 mgr.gibba045.orlgmj (mgr.34412) 5232 : cluster [DBG] pgmap v2972: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:32.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:27:32 gibba015 bash[30343]: cluster 2021-03-10T15:27:31.222647+0000 mgr.gibba045.orlgmj (mgr.34412) 5232 : cluster [DBG] pgmap v2972: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:33.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:27:32 gibba045 bash[25517]: cluster 2021-03-10T15:27:31.222647+0000 mgr.gibba045.orlgmj (mgr.34412) 5232 : cluster [DBG] pgmap v2972: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:34.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:27:34 gibba015 bash[29377]: cluster 2021-03-10T15:27:33.224268+0000 mgr.gibba045.orlgmj (mgr.34412) 5233 : cluster [DBG] pgmap v2973: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:34.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:27:34 gibba015 bash[30343]: cluster 2021-03-10T15:27:33.224268+0000 mgr.gibba045.orlgmj (mgr.34412) 5233 : cluster [DBG] pgmap v2973: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:35.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:27:34 gibba045 bash[25517]: cluster 2021-03-10T15:27:33.224268+0000 mgr.gibba045.orlgmj (mgr.34412) 5233 : cluster [DBG] pgmap v2973: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:36.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:27:36 gibba015 bash[29377]: cluster 2021-03-10T15:27:35.225992+0000 mgr.gibba045.orlgmj (mgr.34412) 5234 : cluster [DBG] pgmap v2974: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:36.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:27:36 gibba015 bash[29377]: cephadm 2021-03-10T15:27:35.421857+0000 mgr.gibba045.orlgmj (mgr.34412) 5235 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:27:36.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:27:36 gibba015 bash[30343]: cluster 2021-03-10T15:27:35.225992+0000 mgr.gibba045.orlgmj (mgr.34412) 5234 : cluster [DBG] pgmap v2974: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:36.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:27:36 gibba015 bash[30343]: cephadm 2021-03-10T15:27:35.421857+0000 mgr.gibba045.orlgmj (mgr.34412) 5235 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:27:37.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:27:36 gibba045 bash[25517]: cluster 2021-03-10T15:27:35.225992+0000 mgr.gibba045.orlgmj (mgr.34412) 5234 : cluster [DBG] pgmap v2974: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:37.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:27:36 gibba045 bash[25517]: cephadm 2021-03-10T15:27:35.421857+0000 mgr.gibba045.orlgmj (mgr.34412) 5235 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:27:38.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:27:38 gibba015 bash[29377]: cluster 2021-03-10T15:27:37.227706+0000 mgr.gibba045.orlgmj (mgr.34412) 5236 : cluster [DBG] pgmap v2975: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:38.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:27:38 gibba015 bash[30343]: cluster 2021-03-10T15:27:37.227706+0000 mgr.gibba045.orlgmj (mgr.34412) 5236 : cluster [DBG] pgmap v2975: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:39.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:27:38 gibba045 bash[25517]: cluster 2021-03-10T15:27:37.227706+0000 mgr.gibba045.orlgmj (mgr.34412) 5236 : cluster [DBG] pgmap v2975: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:40.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:27:40 gibba015 bash[29377]: cluster 2021-03-10T15:27:39.228943+0000 mgr.gibba045.orlgmj (mgr.34412) 5237 : cluster [DBG] pgmap v2976: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:40.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:27:40 gibba015 bash[30343]: cluster 2021-03-10T15:27:39.228943+0000 mgr.gibba045.orlgmj (mgr.34412) 5237 : cluster [DBG] pgmap v2976: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:41.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:27:40 gibba045 bash[25517]: cluster 2021-03-10T15:27:39.228943+0000 mgr.gibba045.orlgmj (mgr.34412) 5237 : cluster [DBG] pgmap v2976: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:42.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:27:42 gibba015 bash[29377]: cluster 2021-03-10T15:27:41.230457+0000 mgr.gibba045.orlgmj (mgr.34412) 5238 : cluster [DBG] pgmap v2977: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:42.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:27:42 gibba015 bash[30343]: cluster 2021-03-10T15:27:41.230457+0000 mgr.gibba045.orlgmj (mgr.34412) 5238 : cluster [DBG] pgmap v2977: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:43.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:27:42 gibba045 bash[25517]: cluster 2021-03-10T15:27:41.230457+0000 mgr.gibba045.orlgmj (mgr.34412) 5238 : cluster [DBG] pgmap v2977: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:44.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:27:44 gibba015 bash[29377]: cluster 2021-03-10T15:27:43.232116+0000 mgr.gibba045.orlgmj (mgr.34412) 5239 : cluster [DBG] pgmap v2978: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:44.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:27:44 gibba015 bash[30343]: cluster 2021-03-10T15:27:43.232116+0000 mgr.gibba045.orlgmj (mgr.34412) 5239 : cluster [DBG] pgmap v2978: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:45.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:27:44 gibba045 bash[25517]: cluster 2021-03-10T15:27:43.232116+0000 mgr.gibba045.orlgmj (mgr.34412) 5239 : cluster [DBG] pgmap v2978: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:46.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:27:46 gibba015 bash[29377]: cluster 2021-03-10T15:27:45.233575+0000 mgr.gibba045.orlgmj (mgr.34412) 5240 : cluster [DBG] pgmap v2979: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:46.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:27:46 gibba015 bash[30343]: cluster 2021-03-10T15:27:45.233575+0000 mgr.gibba045.orlgmj (mgr.34412) 5240 : cluster [DBG] pgmap v2979: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:47.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:27:46 gibba045 bash[25517]: cluster 2021-03-10T15:27:45.233575+0000 mgr.gibba045.orlgmj (mgr.34412) 5240 : cluster [DBG] pgmap v2979: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:48.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:27:48 gibba015 bash[29377]: cluster 2021-03-10T15:27:47.235271+0000 mgr.gibba045.orlgmj (mgr.34412) 5241 : cluster [DBG] pgmap v2980: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:48.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:27:48 gibba015 bash[30343]: cluster 2021-03-10T15:27:47.235271+0000 mgr.gibba045.orlgmj (mgr.34412) 5241 : cluster [DBG] pgmap v2980: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:49.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:27:48 gibba045 bash[25517]: cluster 2021-03-10T15:27:47.235271+0000 mgr.gibba045.orlgmj (mgr.34412) 5241 : cluster [DBG] pgmap v2980: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:50.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:27:50 gibba045 bash[25517]: cluster 2021-03-10T15:27:49.236505+0000 mgr.gibba045.orlgmj (mgr.34412) 5242 : cluster [DBG] pgmap v2981: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:50.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:27:50 gibba015 bash[29377]: cluster 2021-03-10T15:27:49.236505+0000 mgr.gibba045.orlgmj (mgr.34412) 5242 : cluster [DBG] pgmap v2981: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:50.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:27:50 gibba015 bash[30343]: cluster 2021-03-10T15:27:49.236505+0000 mgr.gibba045.orlgmj (mgr.34412) 5242 : cluster [DBG] pgmap v2981: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:51.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:27:51 gibba015 bash[29377]: cephadm 2021-03-10T15:27:50.437900+0000 mgr.gibba045.orlgmj (mgr.34412) 5243 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:27:51.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:27:51 gibba015 bash[30343]: cephadm 2021-03-10T15:27:50.437900+0000 mgr.gibba045.orlgmj (mgr.34412) 5243 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:27:52.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:27:51 gibba045 bash[25517]: cephadm 2021-03-10T15:27:50.437900+0000 mgr.gibba045.orlgmj (mgr.34412) 5243 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:27:52.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:27:52 gibba015 bash[29377]: cluster 2021-03-10T15:27:51.237932+0000 mgr.gibba045.orlgmj (mgr.34412) 5244 : cluster [DBG] pgmap v2982: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:52.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:27:52 gibba015 bash[30343]: cluster 2021-03-10T15:27:51.237932+0000 mgr.gibba045.orlgmj (mgr.34412) 5244 : cluster [DBG] pgmap v2982: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:53.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:27:52 gibba045 bash[25517]: cluster 2021-03-10T15:27:51.237932+0000 mgr.gibba045.orlgmj (mgr.34412) 5244 : cluster [DBG] pgmap v2982: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:27:53 gibba015 bash[29377]: audit 2021-03-10T15:27:53.132512+0000 mon.c (mon.1) 1479 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:27:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:27:53 gibba015 bash[29377]: audit 2021-03-10T15:27:53.133179+0000 mon.c (mon.1) 1480 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:27:53.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:27:53 gibba015 bash[29377]: audit 2021-03-10T15:27:53.133634+0000 mon.a (mon.0) 1376 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:27:53.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:27:53 gibba015 bash[29377]: audit 2021-03-10T15:27:53.133814+0000 mon.c (mon.1) 1481 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T15:27:53.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:27:53 gibba015 bash[29377]: audit 2021-03-10T15:27:53.134658+0000 mon.c (mon.1) 1482 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T15:27:53.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:27:53 gibba015 bash[29377]: audit 2021-03-10T15:27:53.135231+0000 mon.a (mon.0) 1377 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:27:53.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:27:53 gibba015 bash[29377]: audit 2021-03-10T15:27:53.135352+0000 mon.c (mon.1) 1483 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:27:53.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:27:53 gibba015 bash[29377]: audit 2021-03-10T15:27:53.136139+0000 mon.a (mon.0) 1378 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T15:27:53.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:27:53 gibba015 bash[29377]: audit 2021-03-10T15:27:53.136406+0000 mon.c (mon.1) 1484 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:27:53.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:27:53 gibba015 bash[29377]: audit 2021-03-10T15:27:53.137207+0000 mon.a (mon.0) 1379 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T15:27:53.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:27:53 gibba015 bash[29377]: audit 2021-03-10T15:27:53.138206+0000 mon.a (mon.0) 1380 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:27:53.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:27:53 gibba015 bash[29377]: audit 2021-03-10T15:27:53.138634+0000 mon.a (mon.0) 1381 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:27:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:27:53 gibba015 bash[30343]: audit 2021-03-10T15:27:53.132512+0000 mon.c (mon.1) 1479 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:27:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:27:53 gibba015 bash[30343]: audit 2021-03-10T15:27:53.133179+0000 mon.c (mon.1) 1480 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:27:53.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:27:53 gibba015 bash[30343]: audit 2021-03-10T15:27:53.133634+0000 mon.a (mon.0) 1376 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:27:53.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:27:53 gibba015 bash[30343]: audit 2021-03-10T15:27:53.133814+0000 mon.c (mon.1) 1481 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T15:27:53.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:27:53 gibba015 bash[30343]: audit 2021-03-10T15:27:53.134658+0000 mon.c (mon.1) 1482 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T15:27:53.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:27:53 gibba015 bash[30343]: audit 2021-03-10T15:27:53.135231+0000 mon.a (mon.0) 1377 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:27:53.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:27:53 gibba015 bash[30343]: audit 2021-03-10T15:27:53.135352+0000 mon.c (mon.1) 1483 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:27:53.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:27:53 gibba015 bash[30343]: audit 2021-03-10T15:27:53.136139+0000 mon.a (mon.0) 1378 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T15:27:53.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:27:53 gibba015 bash[30343]: audit 2021-03-10T15:27:53.136406+0000 mon.c (mon.1) 1484 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:27:53.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:27:53 gibba015 bash[30343]: audit 2021-03-10T15:27:53.137207+0000 mon.a (mon.0) 1379 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T15:27:53.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:27:53 gibba015 bash[30343]: audit 2021-03-10T15:27:53.138206+0000 mon.a (mon.0) 1380 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:27:53.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:27:53 gibba015 bash[30343]: audit 2021-03-10T15:27:53.138634+0000 mon.a (mon.0) 1381 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:27:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:27:53 gibba045 bash[25517]: audit 2021-03-10T15:27:53.132512+0000 mon.c (mon.1) 1479 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:27:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:27:53 gibba045 bash[25517]: audit 2021-03-10T15:27:53.133179+0000 mon.c (mon.1) 1480 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:27:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:27:53 gibba045 bash[25517]: audit 2021-03-10T15:27:53.133634+0000 mon.a (mon.0) 1376 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:27:54.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:27:53 gibba045 bash[25517]: audit 2021-03-10T15:27:53.133814+0000 mon.c (mon.1) 1481 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T15:27:54.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:27:53 gibba045 bash[25517]: audit 2021-03-10T15:27:53.134658+0000 mon.c (mon.1) 1482 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T15:27:54.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:27:53 gibba045 bash[25517]: audit 2021-03-10T15:27:53.135231+0000 mon.a (mon.0) 1377 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:27:54.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:27:53 gibba045 bash[25517]: audit 2021-03-10T15:27:53.135352+0000 mon.c (mon.1) 1483 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:27:54.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:27:53 gibba045 bash[25517]: audit 2021-03-10T15:27:53.136139+0000 mon.a (mon.0) 1378 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T15:27:54.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:27:53 gibba045 bash[25517]: audit 2021-03-10T15:27:53.136406+0000 mon.c (mon.1) 1484 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:27:54.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:27:53 gibba045 bash[25517]: audit 2021-03-10T15:27:53.137207+0000 mon.a (mon.0) 1379 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T15:27:54.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:27:53 gibba045 bash[25517]: audit 2021-03-10T15:27:53.138206+0000 mon.a (mon.0) 1380 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:27:54.062 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:27:53 gibba045 bash[25517]: audit 2021-03-10T15:27:53.138634+0000 mon.a (mon.0) 1381 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:27:54.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:27:54 gibba015 bash[29377]: cluster 2021-03-10T15:27:53.239496+0000 mgr.gibba045.orlgmj (mgr.34412) 5245 : cluster [DBG] pgmap v2983: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:54.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:27:54 gibba015 bash[30343]: cluster 2021-03-10T15:27:53.239496+0000 mgr.gibba045.orlgmj (mgr.34412) 5245 : cluster [DBG] pgmap v2983: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:55.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:27:54 gibba045 bash[25517]: cluster 2021-03-10T15:27:53.239496+0000 mgr.gibba045.orlgmj (mgr.34412) 5245 : cluster [DBG] pgmap v2983: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:57.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:27:56 gibba045 bash[25517]: cluster 2021-03-10T15:27:55.241045+0000 mgr.gibba045.orlgmj (mgr.34412) 5246 : cluster [DBG] pgmap v2984: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:57.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:27:56 gibba015 bash[29377]: cluster 2021-03-10T15:27:55.241045+0000 mgr.gibba045.orlgmj (mgr.34412) 5246 : cluster [DBG] pgmap v2984: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:57.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:27:56 gibba015 bash[30343]: cluster 2021-03-10T15:27:55.241045+0000 mgr.gibba045.orlgmj (mgr.34412) 5246 : cluster [DBG] pgmap v2984: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:58.471 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:27:58.695 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:27:58.695 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (98m) 2m ago 104m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:27:58.695 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (103m) 113s ago 103m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:27:58.695 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (99m) 113s ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:27:58.696 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (99m) 113s ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:27:58.696 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (98m) 2m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:27:58.696 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (98m) 2m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:27:58.696 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (97m) 113s ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:27:58.697 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (97m) 2m ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:27:58.697 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (104m) 2m ago 104m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:27:58.697 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (104m) 113s ago 104m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:27:58.697 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (97m) 2m ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:27:58.698 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (96m) 2m ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:27:58.698 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (96m) 2m ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:27:58.698 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (95m) 2m ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:27:58.698 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (95m) 113s ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:27:58.699 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (94m) 113s ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:27:58.699 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (94m) 113s ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:27:58.699 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (93m) 113s ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:27:58.699 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (103m) 113s ago 104m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:27:58.700 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 113s ago 102m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:27:58.947 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:27:58.947 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:27:58.948 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:27:58.948 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:27:58.948 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:27:58.948 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:27:58.948 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:27:58.949 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:27:58.949 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:27:58.949 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:27:58.949 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:27:58.950 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:27:58.950 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:27:58.950 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:27:58.950 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:27:59.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:27:58 gibba045 bash[25517]: cluster 2021-03-10T15:27:57.242778+0000 mgr.gibba045.orlgmj (mgr.34412) 5247 : cluster [DBG] pgmap v2985: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:59.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:27:58 gibba015 bash[29377]: cluster 2021-03-10T15:27:57.242778+0000 mgr.gibba045.orlgmj (mgr.34412) 5247 : cluster [DBG] pgmap v2985: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:59.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:27:58 gibba015 bash[30343]: cluster 2021-03-10T15:27:57.242778+0000 mgr.gibba045.orlgmj (mgr.34412) 5247 : cluster [DBG] pgmap v2985: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:00.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:27:59 gibba045 bash[25517]: audit 2021-03-10T15:27:58.461983+0000 mgr.gibba045.orlgmj (mgr.34412) 5248 : audit [DBG] from='client.47580 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:28:00.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:27:59 gibba045 bash[25517]: audit 2021-03-10T15:27:58.683693+0000 mgr.gibba045.orlgmj (mgr.34412) 5249 : audit [DBG] from='client.47586 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:28:00.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:27:59 gibba045 bash[25517]: audit 2021-03-10T15:27:58.942490+0000 mon.c (mon.1) 1485 : audit [DBG] from='client.? 172.21.2.115:0/2076116877' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:28:00.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:27:59 gibba015 bash[29377]: audit 2021-03-10T15:27:58.461983+0000 mgr.gibba045.orlgmj (mgr.34412) 5248 : audit [DBG] from='client.47580 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:28:00.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:27:59 gibba015 bash[29377]: audit 2021-03-10T15:27:58.683693+0000 mgr.gibba045.orlgmj (mgr.34412) 5249 : audit [DBG] from='client.47586 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:28:00.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:27:59 gibba015 bash[29377]: audit 2021-03-10T15:27:58.942490+0000 mon.c (mon.1) 1485 : audit [DBG] from='client.? 172.21.2.115:0/2076116877' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:28:00.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:27:59 gibba015 bash[30343]: audit 2021-03-10T15:27:58.461983+0000 mgr.gibba045.orlgmj (mgr.34412) 5248 : audit [DBG] from='client.47580 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:28:00.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:27:59 gibba015 bash[30343]: audit 2021-03-10T15:27:58.683693+0000 mgr.gibba045.orlgmj (mgr.34412) 5249 : audit [DBG] from='client.47586 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:28:00.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:27:59 gibba015 bash[30343]: audit 2021-03-10T15:27:58.942490+0000 mon.c (mon.1) 1485 : audit [DBG] from='client.? 172.21.2.115:0/2076116877' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:28:01.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:28:00 gibba045 bash[25517]: cluster 2021-03-10T15:27:59.243933+0000 mgr.gibba045.orlgmj (mgr.34412) 5250 : cluster [DBG] pgmap v2986: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:01.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:28:00 gibba015 bash[29377]: cluster 2021-03-10T15:27:59.243933+0000 mgr.gibba045.orlgmj (mgr.34412) 5250 : cluster [DBG] pgmap v2986: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:01.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:28:00 gibba015 bash[30343]: cluster 2021-03-10T15:27:59.243933+0000 mgr.gibba045.orlgmj (mgr.34412) 5250 : cluster [DBG] pgmap v2986: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:03.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:28:02 gibba045 bash[25517]: cluster 2021-03-10T15:28:01.245678+0000 mgr.gibba045.orlgmj (mgr.34412) 5251 : cluster [DBG] pgmap v2987: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:03.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:28:02 gibba015 bash[29377]: cluster 2021-03-10T15:28:01.245678+0000 mgr.gibba045.orlgmj (mgr.34412) 5251 : cluster [DBG] pgmap v2987: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:03.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:28:02 gibba015 bash[30343]: cluster 2021-03-10T15:28:01.245678+0000 mgr.gibba045.orlgmj (mgr.34412) 5251 : cluster [DBG] pgmap v2987: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:05.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:28:04 gibba045 bash[25517]: cluster 2021-03-10T15:28:03.247245+0000 mgr.gibba045.orlgmj (mgr.34412) 5252 : cluster [DBG] pgmap v2988: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:05.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:28:04 gibba015 bash[29377]: cluster 2021-03-10T15:28:03.247245+0000 mgr.gibba045.orlgmj (mgr.34412) 5252 : cluster [DBG] pgmap v2988: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:05.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:28:04 gibba015 bash[30343]: cluster 2021-03-10T15:28:03.247245+0000 mgr.gibba045.orlgmj (mgr.34412) 5252 : cluster [DBG] pgmap v2988: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:06.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:28:05 gibba045 bash[25517]: audit 2021-03-10T15:28:05.450235+0000 mon.c (mon.1) 1486 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:28:06.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:28:05 gibba045 bash[25517]: audit 2021-03-10T15:28:05.671869+0000 mon.a (mon.0) 1382 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:28:06.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:28:05 gibba045 bash[25517]: audit 2021-03-10T15:28:05.675716+0000 mon.c (mon.1) 1487 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:28:06.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:28:05 gibba045 bash[25517]: audit 2021-03-10T15:28:05.677032+0000 mon.c (mon.1) 1488 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:28:06.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:28:05 gibba045 bash[25517]: audit 2021-03-10T15:28:05.678141+0000 mon.c (mon.1) 1489 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:28:06.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:28:05 gibba045 bash[25517]: audit 2021-03-10T15:28:05.679028+0000 mon.c (mon.1) 1490 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:28:06.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:28:05 gibba045 bash[25517]: audit 2021-03-10T15:28:05.682054+0000 mon.c (mon.1) 1491 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:28:06.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:28:05 gibba045 bash[25517]: audit 2021-03-10T15:28:05.683608+0000 mon.c (mon.1) 1492 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:28:06.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:28:05 gibba015 bash[29377]: audit 2021-03-10T15:28:05.450235+0000 mon.c (mon.1) 1486 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:28:06.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:28:05 gibba015 bash[29377]: audit 2021-03-10T15:28:05.671869+0000 mon.a (mon.0) 1382 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:28:06.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:28:05 gibba015 bash[29377]: audit 2021-03-10T15:28:05.675716+0000 mon.c (mon.1) 1487 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:28:06.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:28:05 gibba015 bash[29377]: audit 2021-03-10T15:28:05.677032+0000 mon.c (mon.1) 1488 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:28:06.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:28:05 gibba015 bash[29377]: audit 2021-03-10T15:28:05.678141+0000 mon.c (mon.1) 1489 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:28:06.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:28:05 gibba015 bash[29377]: audit 2021-03-10T15:28:05.679028+0000 mon.c (mon.1) 1490 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:28:06.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:28:05 gibba015 bash[29377]: audit 2021-03-10T15:28:05.682054+0000 mon.c (mon.1) 1491 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:28:06.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:28:05 gibba015 bash[29377]: audit 2021-03-10T15:28:05.683608+0000 mon.c (mon.1) 1492 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:28:06.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:28:05 gibba015 bash[30343]: audit 2021-03-10T15:28:05.450235+0000 mon.c (mon.1) 1486 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:28:06.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:28:05 gibba015 bash[30343]: audit 2021-03-10T15:28:05.671869+0000 mon.a (mon.0) 1382 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:28:06.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:28:05 gibba015 bash[30343]: audit 2021-03-10T15:28:05.675716+0000 mon.c (mon.1) 1487 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:28:06.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:28:05 gibba015 bash[30343]: audit 2021-03-10T15:28:05.677032+0000 mon.c (mon.1) 1488 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:28:06.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:28:05 gibba015 bash[30343]: audit 2021-03-10T15:28:05.678141+0000 mon.c (mon.1) 1489 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:28:06.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:28:05 gibba015 bash[30343]: audit 2021-03-10T15:28:05.679028+0000 mon.c (mon.1) 1490 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:28:06.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:28:05 gibba015 bash[30343]: audit 2021-03-10T15:28:05.682054+0000 mon.c (mon.1) 1491 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:28:06.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:28:05 gibba015 bash[30343]: audit 2021-03-10T15:28:05.683608+0000 mon.c (mon.1) 1492 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:28:07.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:28:06 gibba045 bash[25517]: cluster 2021-03-10T15:28:05.248813+0000 mgr.gibba045.orlgmj (mgr.34412) 5253 : cluster [DBG] pgmap v2989: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:07.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:28:06 gibba045 bash[25517]: cephadm 2021-03-10T15:28:05.459923+0000 mgr.gibba045.orlgmj (mgr.34412) 5254 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:28:07.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:28:06 gibba045 bash[25517]: cephadm 2021-03-10T15:28:05.461785+0000 mgr.gibba045.orlgmj (mgr.34412) 5255 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:28:07.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:28:06 gibba045 bash[25517]: cephadm 2021-03-10T15:28:05.678796+0000 mgr.gibba045.orlgmj (mgr.34412) 5256 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:28:07.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:28:06 gibba045 bash[25517]: cephadm 2021-03-10T15:28:05.680659+0000 mgr.gibba045.orlgmj (mgr.34412) 5257 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:28:07.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:28:06 gibba045 bash[25517]: cephadm 2021-03-10T15:28:05.681796+0000 mgr.gibba045.orlgmj (mgr.34412) 5258 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:28:07.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:28:06 gibba045 bash[25517]: cephadm 2021-03-10T15:28:05.681841+0000 mgr.gibba045.orlgmj (mgr.34412) 5259 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:28:07.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:28:06 gibba045 bash[25517]: cephadm 2021-03-10T15:28:05.682758+0000 mgr.gibba045.orlgmj (mgr.34412) 5260 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:28:07.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:28:06 gibba045 bash[25517]: cephadm 2021-03-10T15:28:05.682802+0000 mgr.gibba045.orlgmj (mgr.34412) 5261 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:28:07.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:28:06 gibba045 bash[25517]: cephadm 2021-03-10T15:28:05.683732+0000 mgr.gibba045.orlgmj (mgr.34412) 5262 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:28:07.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:28:06 gibba045 bash[25517]: cephadm 2021-03-10T15:28:05.685394+0000 mgr.gibba045.orlgmj (mgr.34412) 5263 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:28:07.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:28:06 gibba045 bash[25517]: cephadm 2021-03-10T15:28:05.685434+0000 mgr.gibba045.orlgmj (mgr.34412) 5264 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:28:07.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:28:06 gibba045 bash[25517]: cephadm 2021-03-10T15:28:05.686779+0000 mgr.gibba045.orlgmj (mgr.34412) 5265 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:28:07.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:28:06 gibba045 bash[25517]: cephadm 2021-03-10T15:28:05.687174+0000 mgr.gibba045.orlgmj (mgr.34412) 5266 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:28:07.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:28:06 gibba045 bash[25517]: cephadm 2021-03-10T15:28:05.688438+0000 mgr.gibba045.orlgmj (mgr.34412) 5267 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:28:07.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:28:06 gibba045 bash[25517]: cephadm 2021-03-10T15:28:05.688511+0000 mgr.gibba045.orlgmj (mgr.34412) 5268 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:28:07.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:28:06 gibba045 bash[25517]: cephadm 2021-03-10T15:28:05.688640+0000 mgr.gibba045.orlgmj (mgr.34412) 5269 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:28:07.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:28:06 gibba015 bash[29377]: cluster 2021-03-10T15:28:05.248813+0000 mgr.gibba045.orlgmj (mgr.34412) 5253 : cluster [DBG] pgmap v2989: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:07.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:28:06 gibba015 bash[29377]: cephadm 2021-03-10T15:28:05.459923+0000 mgr.gibba045.orlgmj (mgr.34412) 5254 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:28:07.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:28:06 gibba015 bash[29377]: cephadm 2021-03-10T15:28:05.461785+0000 mgr.gibba045.orlgmj (mgr.34412) 5255 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:28:07.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:28:06 gibba015 bash[29377]: cephadm 2021-03-10T15:28:05.678796+0000 mgr.gibba045.orlgmj (mgr.34412) 5256 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:28:07.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:28:06 gibba015 bash[29377]: cephadm 2021-03-10T15:28:05.680659+0000 mgr.gibba045.orlgmj (mgr.34412) 5257 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:28:07.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:28:06 gibba015 bash[29377]: cephadm 2021-03-10T15:28:05.681796+0000 mgr.gibba045.orlgmj (mgr.34412) 5258 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:28:07.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:28:06 gibba015 bash[29377]: cephadm 2021-03-10T15:28:05.681841+0000 mgr.gibba045.orlgmj (mgr.34412) 5259 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:28:07.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:28:06 gibba015 bash[29377]: cephadm 2021-03-10T15:28:05.682758+0000 mgr.gibba045.orlgmj (mgr.34412) 5260 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:28:07.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:28:06 gibba015 bash[29377]: cephadm 2021-03-10T15:28:05.682802+0000 mgr.gibba045.orlgmj (mgr.34412) 5261 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:28:07.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:28:06 gibba015 bash[29377]: cephadm 2021-03-10T15:28:05.683732+0000 mgr.gibba045.orlgmj (mgr.34412) 5262 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:28:07.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:28:06 gibba015 bash[29377]: cephadm 2021-03-10T15:28:05.685394+0000 mgr.gibba045.orlgmj (mgr.34412) 5263 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:28:07.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:28:06 gibba015 bash[29377]: cephadm 2021-03-10T15:28:05.685434+0000 mgr.gibba045.orlgmj (mgr.34412) 5264 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:28:07.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:28:06 gibba015 bash[29377]: cephadm 2021-03-10T15:28:05.686779+0000 mgr.gibba045.orlgmj (mgr.34412) 5265 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:28:07.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:28:06 gibba015 bash[29377]: cephadm 2021-03-10T15:28:05.687174+0000 mgr.gibba045.orlgmj (mgr.34412) 5266 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:28:07.230 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:28:06 gibba015 bash[29377]: cephadm 2021-03-10T15:28:05.688438+0000 mgr.gibba045.orlgmj (mgr.34412) 5267 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:28:07.230 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:28:06 gibba015 bash[29377]: cephadm 2021-03-10T15:28:05.688511+0000 mgr.gibba045.orlgmj (mgr.34412) 5268 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:28:07.230 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:28:06 gibba015 bash[29377]: cephadm 2021-03-10T15:28:05.688640+0000 mgr.gibba045.orlgmj (mgr.34412) 5269 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:28:07.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:28:06 gibba015 bash[30343]: cluster 2021-03-10T15:28:05.248813+0000 mgr.gibba045.orlgmj (mgr.34412) 5253 : cluster [DBG] pgmap v2989: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:07.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:28:06 gibba015 bash[30343]: cephadm 2021-03-10T15:28:05.459923+0000 mgr.gibba045.orlgmj (mgr.34412) 5254 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:28:07.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:28:06 gibba015 bash[30343]: cephadm 2021-03-10T15:28:05.461785+0000 mgr.gibba045.orlgmj (mgr.34412) 5255 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:28:07.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:28:06 gibba015 bash[30343]: cephadm 2021-03-10T15:28:05.678796+0000 mgr.gibba045.orlgmj (mgr.34412) 5256 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:28:07.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:28:06 gibba015 bash[30343]: cephadm 2021-03-10T15:28:05.680659+0000 mgr.gibba045.orlgmj (mgr.34412) 5257 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:28:07.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:28:06 gibba015 bash[30343]: cephadm 2021-03-10T15:28:05.681796+0000 mgr.gibba045.orlgmj (mgr.34412) 5258 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:28:07.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:28:06 gibba015 bash[30343]: cephadm 2021-03-10T15:28:05.681841+0000 mgr.gibba045.orlgmj (mgr.34412) 5259 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:28:07.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:28:06 gibba015 bash[30343]: cephadm 2021-03-10T15:28:05.682758+0000 mgr.gibba045.orlgmj (mgr.34412) 5260 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:28:07.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:28:06 gibba015 bash[30343]: cephadm 2021-03-10T15:28:05.682802+0000 mgr.gibba045.orlgmj (mgr.34412) 5261 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:28:07.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:28:06 gibba015 bash[30343]: cephadm 2021-03-10T15:28:05.683732+0000 mgr.gibba045.orlgmj (mgr.34412) 5262 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:28:07.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:28:06 gibba015 bash[30343]: cephadm 2021-03-10T15:28:05.685394+0000 mgr.gibba045.orlgmj (mgr.34412) 5263 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:28:07.234 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:28:06 gibba015 bash[30343]: cephadm 2021-03-10T15:28:05.685434+0000 mgr.gibba045.orlgmj (mgr.34412) 5264 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:28:07.234 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:28:06 gibba015 bash[30343]: cephadm 2021-03-10T15:28:05.686779+0000 mgr.gibba045.orlgmj (mgr.34412) 5265 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:28:07.234 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:28:06 gibba015 bash[30343]: cephadm 2021-03-10T15:28:05.687174+0000 mgr.gibba045.orlgmj (mgr.34412) 5266 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:28:07.234 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:28:06 gibba015 bash[30343]: cephadm 2021-03-10T15:28:05.688438+0000 mgr.gibba045.orlgmj (mgr.34412) 5267 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:28:07.235 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:28:06 gibba015 bash[30343]: cephadm 2021-03-10T15:28:05.688511+0000 mgr.gibba045.orlgmj (mgr.34412) 5268 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:28:07.235 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:28:06 gibba015 bash[30343]: cephadm 2021-03-10T15:28:05.688640+0000 mgr.gibba045.orlgmj (mgr.34412) 5269 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:28:09.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:28:08 gibba045 bash[25517]: cluster 2021-03-10T15:28:07.250296+0000 mgr.gibba045.orlgmj (mgr.34412) 5270 : cluster [DBG] pgmap v2990: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:09.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:28:08 gibba015 bash[29377]: cluster 2021-03-10T15:28:07.250296+0000 mgr.gibba045.orlgmj (mgr.34412) 5270 : cluster [DBG] pgmap v2990: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:09.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:28:08 gibba015 bash[30343]: cluster 2021-03-10T15:28:07.250296+0000 mgr.gibba045.orlgmj (mgr.34412) 5270 : cluster [DBG] pgmap v2990: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:11.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:28:10 gibba015 bash[29377]: cluster 2021-03-10T15:28:09.251438+0000 mgr.gibba045.orlgmj (mgr.34412) 5271 : cluster [DBG] pgmap v2991: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:11.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:28:10 gibba015 bash[30343]: cluster 2021-03-10T15:28:09.251438+0000 mgr.gibba045.orlgmj (mgr.34412) 5271 : cluster [DBG] pgmap v2991: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:11.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:28:10 gibba045 bash[25517]: cluster 2021-03-10T15:28:09.251438+0000 mgr.gibba045.orlgmj (mgr.34412) 5271 : cluster [DBG] pgmap v2991: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:13.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:28:12 gibba015 bash[29377]: cluster 2021-03-10T15:28:11.253198+0000 mgr.gibba045.orlgmj (mgr.34412) 5272 : cluster [DBG] pgmap v2992: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:13.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:28:12 gibba015 bash[30343]: cluster 2021-03-10T15:28:11.253198+0000 mgr.gibba045.orlgmj (mgr.34412) 5272 : cluster [DBG] pgmap v2992: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:13.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:28:12 gibba045 bash[25517]: cluster 2021-03-10T15:28:11.253198+0000 mgr.gibba045.orlgmj (mgr.34412) 5272 : cluster [DBG] pgmap v2992: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:15.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:28:14 gibba015 bash[29377]: cluster 2021-03-10T15:28:13.254844+0000 mgr.gibba045.orlgmj (mgr.34412) 5273 : cluster [DBG] pgmap v2993: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:15.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:28:14 gibba015 bash[30343]: cluster 2021-03-10T15:28:13.254844+0000 mgr.gibba045.orlgmj (mgr.34412) 5273 : cluster [DBG] pgmap v2993: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:15.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:28:14 gibba045 bash[25517]: cluster 2021-03-10T15:28:13.254844+0000 mgr.gibba045.orlgmj (mgr.34412) 5273 : cluster [DBG] pgmap v2993: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:17.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:28:16 gibba015 bash[29377]: cluster 2021-03-10T15:28:15.256499+0000 mgr.gibba045.orlgmj (mgr.34412) 5274 : cluster [DBG] pgmap v2994: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:17.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:28:16 gibba015 bash[30343]: cluster 2021-03-10T15:28:15.256499+0000 mgr.gibba045.orlgmj (mgr.34412) 5274 : cluster [DBG] pgmap v2994: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:17.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:28:16 gibba045 bash[25517]: cluster 2021-03-10T15:28:15.256499+0000 mgr.gibba045.orlgmj (mgr.34412) 5274 : cluster [DBG] pgmap v2994: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:19.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:28:18 gibba015 bash[29377]: cluster 2021-03-10T15:28:17.258202+0000 mgr.gibba045.orlgmj (mgr.34412) 5275 : cluster [DBG] pgmap v2995: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:19.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:28:18 gibba015 bash[30343]: cluster 2021-03-10T15:28:17.258202+0000 mgr.gibba045.orlgmj (mgr.34412) 5275 : cluster [DBG] pgmap v2995: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:19.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:28:18 gibba045 bash[25517]: cluster 2021-03-10T15:28:17.258202+0000 mgr.gibba045.orlgmj (mgr.34412) 5275 : cluster [DBG] pgmap v2995: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:21.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:28:20 gibba045 bash[25517]: cluster 2021-03-10T15:28:19.259410+0000 mgr.gibba045.orlgmj (mgr.34412) 5276 : cluster [DBG] pgmap v2996: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:21.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:28:20 gibba015 bash[29377]: cluster 2021-03-10T15:28:19.259410+0000 mgr.gibba045.orlgmj (mgr.34412) 5276 : cluster [DBG] pgmap v2996: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:21.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:28:20 gibba015 bash[30343]: cluster 2021-03-10T15:28:19.259410+0000 mgr.gibba045.orlgmj (mgr.34412) 5276 : cluster [DBG] pgmap v2996: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:22.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:28:21 gibba015 bash[29377]: cephadm 2021-03-10T15:28:20.704694+0000 mgr.gibba045.orlgmj (mgr.34412) 5277 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:28:22.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:28:21 gibba015 bash[30343]: cephadm 2021-03-10T15:28:20.704694+0000 mgr.gibba045.orlgmj (mgr.34412) 5277 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:28:22.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:28:21 gibba045 bash[25517]: cephadm 2021-03-10T15:28:20.704694+0000 mgr.gibba045.orlgmj (mgr.34412) 5277 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:28:23.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:28:22 gibba015 bash[29377]: cluster 2021-03-10T15:28:21.261142+0000 mgr.gibba045.orlgmj (mgr.34412) 5278 : cluster [DBG] pgmap v2997: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:23.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:28:22 gibba015 bash[30343]: cluster 2021-03-10T15:28:21.261142+0000 mgr.gibba045.orlgmj (mgr.34412) 5278 : cluster [DBG] pgmap v2997: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:23.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:28:22 gibba045 bash[25517]: cluster 2021-03-10T15:28:21.261142+0000 mgr.gibba045.orlgmj (mgr.34412) 5278 : cluster [DBG] pgmap v2997: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:25.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:28:24 gibba015 bash[29377]: cluster 2021-03-10T15:28:23.262520+0000 mgr.gibba045.orlgmj (mgr.34412) 5279 : cluster [DBG] pgmap v2998: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:25.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:28:24 gibba015 bash[30343]: cluster 2021-03-10T15:28:23.262520+0000 mgr.gibba045.orlgmj (mgr.34412) 5279 : cluster [DBG] pgmap v2998: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:25.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:28:24 gibba045 bash[25517]: cluster 2021-03-10T15:28:23.262520+0000 mgr.gibba045.orlgmj (mgr.34412) 5279 : cluster [DBG] pgmap v2998: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:27.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:28:26 gibba015 bash[29377]: cluster 2021-03-10T15:28:25.264123+0000 mgr.gibba045.orlgmj (mgr.34412) 5280 : cluster [DBG] pgmap v2999: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:27.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:28:26 gibba015 bash[30343]: cluster 2021-03-10T15:28:25.264123+0000 mgr.gibba045.orlgmj (mgr.34412) 5280 : cluster [DBG] pgmap v2999: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:27.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:28:26 gibba045 bash[25517]: cluster 2021-03-10T15:28:25.264123+0000 mgr.gibba045.orlgmj (mgr.34412) 5280 : cluster [DBG] pgmap v2999: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:29.189 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:28:29.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:28:28 gibba015 bash[29377]: cluster 2021-03-10T15:28:27.265848+0000 mgr.gibba045.orlgmj (mgr.34412) 5281 : cluster [DBG] pgmap v3000: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:29.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:28:28 gibba015 bash[30343]: cluster 2021-03-10T15:28:27.265848+0000 mgr.gibba045.orlgmj (mgr.34412) 5281 : cluster [DBG] pgmap v3000: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:29.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:28:28 gibba045 bash[25517]: cluster 2021-03-10T15:28:27.265848+0000 mgr.gibba045.orlgmj (mgr.34412) 5281 : cluster [DBG] pgmap v3000: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:29.416 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:28:29.417 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (99m) 3m ago 104m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:28:29.417 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (104m) 2m ago 104m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:28:29.417 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (99m) 2m ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:28:29.418 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (99m) 2m ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:28:29.418 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (98m) 3m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:28:29.418 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (98m) 3m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:28:29.418 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (98m) 2m ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:28:29.419 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (98m) 3m ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:28:29.419 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (104m) 3m ago 104m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:28:29.419 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (104m) 2m ago 104m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:28:29.419 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (97m) 3m ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:28:29.419 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (97m) 3m ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:28:29.420 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (96m) 3m ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:28:29.420 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (96m) 3m ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:28:29.420 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (95m) 2m ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:28:29.420 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (95m) 2m ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:28:29.421 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (94m) 2m ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:28:29.421 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (94m) 2m ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:28:29.421 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (104m) 2m ago 104m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:28:29.421 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 2m ago 102m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:28:29.663 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:28:29.663 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:28:29.663 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:28:29.664 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:28:29.664 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:28:29.664 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:28:29.664 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:28:29.665 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:28:29.665 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:28:29.665 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:28:29.665 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:28:29.665 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:28:29.666 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:28:29.666 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:28:29.666 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:28:30.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:28:30 gibba015 bash[29377]: audit 2021-03-10T15:28:29.179584+0000 mgr.gibba045.orlgmj (mgr.34412) 5282 : audit [DBG] from='client.47598 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:28:30.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:28:30 gibba015 bash[29377]: cluster 2021-03-10T15:28:29.267199+0000 mgr.gibba045.orlgmj (mgr.34412) 5283 : cluster [DBG] pgmap v3001: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:30.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:28:30 gibba015 bash[29377]: audit 2021-03-10T15:28:29.403443+0000 mgr.gibba045.orlgmj (mgr.34412) 5284 : audit [DBG] from='client.57592 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:28:30.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:28:30 gibba015 bash[29377]: audit 2021-03-10T15:28:29.658608+0000 mon.a (mon.0) 1383 : audit [DBG] from='client.? 172.21.2.115:0/1452861812' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:28:30.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:28:30 gibba015 bash[30343]: audit 2021-03-10T15:28:29.179584+0000 mgr.gibba045.orlgmj (mgr.34412) 5282 : audit [DBG] from='client.47598 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:28:30.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:28:30 gibba015 bash[30343]: cluster 2021-03-10T15:28:29.267199+0000 mgr.gibba045.orlgmj (mgr.34412) 5283 : cluster [DBG] pgmap v3001: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:30.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:28:30 gibba015 bash[30343]: audit 2021-03-10T15:28:29.403443+0000 mgr.gibba045.orlgmj (mgr.34412) 5284 : audit [DBG] from='client.57592 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:28:30.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:28:30 gibba015 bash[30343]: audit 2021-03-10T15:28:29.658608+0000 mon.a (mon.0) 1383 : audit [DBG] from='client.? 172.21.2.115:0/1452861812' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:28:30.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:28:30 gibba045 bash[25517]: audit 2021-03-10T15:28:29.179584+0000 mgr.gibba045.orlgmj (mgr.34412) 5282 : audit [DBG] from='client.47598 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:28:30.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:28:30 gibba045 bash[25517]: cluster 2021-03-10T15:28:29.267199+0000 mgr.gibba045.orlgmj (mgr.34412) 5283 : cluster [DBG] pgmap v3001: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:30.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:28:30 gibba045 bash[25517]: audit 2021-03-10T15:28:29.403443+0000 mgr.gibba045.orlgmj (mgr.34412) 5284 : audit [DBG] from='client.57592 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:28:30.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:28:30 gibba045 bash[25517]: audit 2021-03-10T15:28:29.658608+0000 mon.a (mon.0) 1383 : audit [DBG] from='client.? 172.21.2.115:0/1452861812' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:28:32.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:28:32 gibba015 bash[29377]: cluster 2021-03-10T15:28:31.269065+0000 mgr.gibba045.orlgmj (mgr.34412) 5285 : cluster [DBG] pgmap v3002: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:32.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:28:32 gibba015 bash[30343]: cluster 2021-03-10T15:28:31.269065+0000 mgr.gibba045.orlgmj (mgr.34412) 5285 : cluster [DBG] pgmap v3002: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:32.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:28:32 gibba045 bash[25517]: cluster 2021-03-10T15:28:31.269065+0000 mgr.gibba045.orlgmj (mgr.34412) 5285 : cluster [DBG] pgmap v3002: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:34.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:28:34 gibba015 bash[29377]: cluster 2021-03-10T15:28:33.270412+0000 mgr.gibba045.orlgmj (mgr.34412) 5286 : cluster [DBG] pgmap v3003: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:34.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:28:34 gibba015 bash[30343]: cluster 2021-03-10T15:28:33.270412+0000 mgr.gibba045.orlgmj (mgr.34412) 5286 : cluster [DBG] pgmap v3003: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:34.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:28:34 gibba045 bash[25517]: cluster 2021-03-10T15:28:33.270412+0000 mgr.gibba045.orlgmj (mgr.34412) 5286 : cluster [DBG] pgmap v3003: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:36.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:28:36 gibba015 bash[29377]: cluster 2021-03-10T15:28:35.272117+0000 mgr.gibba045.orlgmj (mgr.34412) 5287 : cluster [DBG] pgmap v3004: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:36.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:28:36 gibba015 bash[29377]: cephadm 2021-03-10T15:28:35.720866+0000 mgr.gibba045.orlgmj (mgr.34412) 5288 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:28:36.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:28:36 gibba015 bash[30343]: cluster 2021-03-10T15:28:35.272117+0000 mgr.gibba045.orlgmj (mgr.34412) 5287 : cluster [DBG] pgmap v3004: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:36.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:28:36 gibba015 bash[30343]: cephadm 2021-03-10T15:28:35.720866+0000 mgr.gibba045.orlgmj (mgr.34412) 5288 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:28:36.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:28:36 gibba045 bash[25517]: cluster 2021-03-10T15:28:35.272117+0000 mgr.gibba045.orlgmj (mgr.34412) 5287 : cluster [DBG] pgmap v3004: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:36.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:28:36 gibba045 bash[25517]: cephadm 2021-03-10T15:28:35.720866+0000 mgr.gibba045.orlgmj (mgr.34412) 5288 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:28:38.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:28:38 gibba015 bash[29377]: cluster 2021-03-10T15:28:37.273980+0000 mgr.gibba045.orlgmj (mgr.34412) 5289 : cluster [DBG] pgmap v3005: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:38.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:28:38 gibba015 bash[30343]: cluster 2021-03-10T15:28:37.273980+0000 mgr.gibba045.orlgmj (mgr.34412) 5289 : cluster [DBG] pgmap v3005: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:38.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:28:38 gibba045 bash[25517]: cluster 2021-03-10T15:28:37.273980+0000 mgr.gibba045.orlgmj (mgr.34412) 5289 : cluster [DBG] pgmap v3005: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:40.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:28:40 gibba015 bash[29377]: cluster 2021-03-10T15:28:39.275493+0000 mgr.gibba045.orlgmj (mgr.34412) 5290 : cluster [DBG] pgmap v3006: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:40.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:28:40 gibba015 bash[30343]: cluster 2021-03-10T15:28:39.275493+0000 mgr.gibba045.orlgmj (mgr.34412) 5290 : cluster [DBG] pgmap v3006: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:40.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:28:40 gibba045 bash[25517]: cluster 2021-03-10T15:28:39.275493+0000 mgr.gibba045.orlgmj (mgr.34412) 5290 : cluster [DBG] pgmap v3006: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:42.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:28:42 gibba015 bash[29377]: cluster 2021-03-10T15:28:41.277325+0000 mgr.gibba045.orlgmj (mgr.34412) 5291 : cluster [DBG] pgmap v3007: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:42.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:28:42 gibba015 bash[30343]: cluster 2021-03-10T15:28:41.277325+0000 mgr.gibba045.orlgmj (mgr.34412) 5291 : cluster [DBG] pgmap v3007: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:42.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:28:42 gibba045 bash[25517]: cluster 2021-03-10T15:28:41.277325+0000 mgr.gibba045.orlgmj (mgr.34412) 5291 : cluster [DBG] pgmap v3007: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:44.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:28:44 gibba015 bash[29377]: cluster 2021-03-10T15:28:43.279175+0000 mgr.gibba045.orlgmj (mgr.34412) 5292 : cluster [DBG] pgmap v3008: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:44.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:28:44 gibba015 bash[30343]: cluster 2021-03-10T15:28:43.279175+0000 mgr.gibba045.orlgmj (mgr.34412) 5292 : cluster [DBG] pgmap v3008: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:44.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:28:44 gibba045 bash[25517]: cluster 2021-03-10T15:28:43.279175+0000 mgr.gibba045.orlgmj (mgr.34412) 5292 : cluster [DBG] pgmap v3008: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:46.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:28:46 gibba015 bash[29377]: cluster 2021-03-10T15:28:45.280908+0000 mgr.gibba045.orlgmj (mgr.34412) 5293 : cluster [DBG] pgmap v3009: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:46.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:28:46 gibba015 bash[30343]: cluster 2021-03-10T15:28:45.280908+0000 mgr.gibba045.orlgmj (mgr.34412) 5293 : cluster [DBG] pgmap v3009: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:46.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:28:46 gibba045 bash[25517]: cluster 2021-03-10T15:28:45.280908+0000 mgr.gibba045.orlgmj (mgr.34412) 5293 : cluster [DBG] pgmap v3009: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:48.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:28:48 gibba015 bash[29377]: cluster 2021-03-10T15:28:47.282656+0000 mgr.gibba045.orlgmj (mgr.34412) 5294 : cluster [DBG] pgmap v3010: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:48.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:28:48 gibba015 bash[30343]: cluster 2021-03-10T15:28:47.282656+0000 mgr.gibba045.orlgmj (mgr.34412) 5294 : cluster [DBG] pgmap v3010: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:48.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:28:48 gibba045 bash[25517]: cluster 2021-03-10T15:28:47.282656+0000 mgr.gibba045.orlgmj (mgr.34412) 5294 : cluster [DBG] pgmap v3010: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:50.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:28:50 gibba015 bash[29377]: cluster 2021-03-10T15:28:49.283982+0000 mgr.gibba045.orlgmj (mgr.34412) 5295 : cluster [DBG] pgmap v3011: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:50.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:28:50 gibba015 bash[30343]: cluster 2021-03-10T15:28:49.283982+0000 mgr.gibba045.orlgmj (mgr.34412) 5295 : cluster [DBG] pgmap v3011: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:50.738 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:28:50 gibba045 bash[25517]: cluster 2021-03-10T15:28:49.283982+0000 mgr.gibba045.orlgmj (mgr.34412) 5295 : cluster [DBG] pgmap v3011: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:51.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:28:51 gibba015 bash[29377]: cephadm 2021-03-10T15:28:50.736919+0000 mgr.gibba045.orlgmj (mgr.34412) 5296 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:28:51.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:28:51 gibba015 bash[30343]: cephadm 2021-03-10T15:28:50.736919+0000 mgr.gibba045.orlgmj (mgr.34412) 5296 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:28:51.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:28:51 gibba045 bash[25517]: cephadm 2021-03-10T15:28:50.736919+0000 mgr.gibba045.orlgmj (mgr.34412) 5296 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:28:52.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:28:52 gibba015 bash[29377]: cluster 2021-03-10T15:28:51.285674+0000 mgr.gibba045.orlgmj (mgr.34412) 5297 : cluster [DBG] pgmap v3012: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:52.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:28:52 gibba015 bash[30343]: cluster 2021-03-10T15:28:51.285674+0000 mgr.gibba045.orlgmj (mgr.34412) 5297 : cluster [DBG] pgmap v3012: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:52.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:28:52 gibba045 bash[25517]: cluster 2021-03-10T15:28:51.285674+0000 mgr.gibba045.orlgmj (mgr.34412) 5297 : cluster [DBG] pgmap v3012: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:28:53 gibba015 bash[29377]: audit 2021-03-10T15:28:53.140778+0000 mon.c (mon.1) 1493 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:28:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:28:53 gibba015 bash[29377]: audit 2021-03-10T15:28:53.141510+0000 mon.c (mon.1) 1494 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:28:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:28:53 gibba015 bash[29377]: audit 2021-03-10T15:28:53.141955+0000 mon.a (mon.0) 1384 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:28:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:28:53 gibba015 bash[29377]: audit 2021-03-10T15:28:53.142125+0000 mon.c (mon.1) 1495 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T15:28:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:28:53 gibba015 bash[29377]: audit 2021-03-10T15:28:53.142934+0000 mon.c (mon.1) 1496 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:28:53.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:28:53 gibba015 bash[29377]: audit 2021-03-10T15:28:53.143750+0000 mon.a (mon.0) 1385 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:28:53.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:28:53 gibba015 bash[29377]: audit 2021-03-10T15:28:53.143986+0000 mon.c (mon.1) 1497 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:28:53.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:28:53 gibba015 bash[29377]: audit 2021-03-10T15:28:53.144846+0000 mon.c (mon.1) 1498 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:28:53.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:28:53 gibba015 bash[29377]: audit 2021-03-10T15:28:53.144941+0000 mon.a (mon.0) 1386 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T15:28:53.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:28:53 gibba015 bash[29377]: audit 2021-03-10T15:28:53.146146+0000 mon.a (mon.0) 1387 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:28:53.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:28:53 gibba015 bash[29377]: audit 2021-03-10T15:28:53.146948+0000 mon.a (mon.0) 1388 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:28:53.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:28:53 gibba015 bash[29377]: audit 2021-03-10T15:28:53.147730+0000 mon.a (mon.0) 1389 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:28:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:28:53 gibba015 bash[30343]: audit 2021-03-10T15:28:53.140778+0000 mon.c (mon.1) 1493 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:28:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:28:53 gibba015 bash[30343]: audit 2021-03-10T15:28:53.141510+0000 mon.c (mon.1) 1494 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:28:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:28:53 gibba015 bash[30343]: audit 2021-03-10T15:28:53.141955+0000 mon.a (mon.0) 1384 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:28:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:28:53 gibba015 bash[30343]: audit 2021-03-10T15:28:53.142125+0000 mon.c (mon.1) 1495 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T15:28:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:28:53 gibba015 bash[30343]: audit 2021-03-10T15:28:53.142934+0000 mon.c (mon.1) 1496 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:28:53.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:28:53 gibba015 bash[30343]: audit 2021-03-10T15:28:53.143750+0000 mon.a (mon.0) 1385 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:28:53.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:28:53 gibba015 bash[30343]: audit 2021-03-10T15:28:53.143986+0000 mon.c (mon.1) 1497 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:28:53.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:28:53 gibba015 bash[30343]: audit 2021-03-10T15:28:53.144846+0000 mon.c (mon.1) 1498 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:28:53.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:28:53 gibba015 bash[30343]: audit 2021-03-10T15:28:53.144941+0000 mon.a (mon.0) 1386 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T15:28:53.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:28:53 gibba015 bash[30343]: audit 2021-03-10T15:28:53.146146+0000 mon.a (mon.0) 1387 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:28:53.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:28:53 gibba015 bash[30343]: audit 2021-03-10T15:28:53.146948+0000 mon.a (mon.0) 1388 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:28:53.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:28:53 gibba015 bash[30343]: audit 2021-03-10T15:28:53.147730+0000 mon.a (mon.0) 1389 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:28:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:28:53 gibba045 bash[25517]: audit 2021-03-10T15:28:53.140778+0000 mon.c (mon.1) 1493 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:28:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:28:53 gibba045 bash[25517]: audit 2021-03-10T15:28:53.141510+0000 mon.c (mon.1) 1494 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:28:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:28:53 gibba045 bash[25517]: audit 2021-03-10T15:28:53.141955+0000 mon.a (mon.0) 1384 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:28:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:28:53 gibba045 bash[25517]: audit 2021-03-10T15:28:53.142125+0000 mon.c (mon.1) 1495 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T15:28:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:28:53 gibba045 bash[25517]: audit 2021-03-10T15:28:53.142934+0000 mon.c (mon.1) 1496 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:28:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:28:53 gibba045 bash[25517]: audit 2021-03-10T15:28:53.143750+0000 mon.a (mon.0) 1385 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:28:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:28:53 gibba045 bash[25517]: audit 2021-03-10T15:28:53.143986+0000 mon.c (mon.1) 1497 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:28:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:28:53 gibba045 bash[25517]: audit 2021-03-10T15:28:53.144846+0000 mon.c (mon.1) 1498 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:28:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:28:53 gibba045 bash[25517]: audit 2021-03-10T15:28:53.144941+0000 mon.a (mon.0) 1386 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T15:28:53.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:28:53 gibba045 bash[25517]: audit 2021-03-10T15:28:53.146146+0000 mon.a (mon.0) 1387 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:28:53.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:28:53 gibba045 bash[25517]: audit 2021-03-10T15:28:53.146948+0000 mon.a (mon.0) 1388 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:28:53.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:28:53 gibba045 bash[25517]: audit 2021-03-10T15:28:53.147730+0000 mon.a (mon.0) 1389 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:28:54.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:28:54 gibba015 bash[29377]: cluster 2021-03-10T15:28:53.287067+0000 mgr.gibba045.orlgmj (mgr.34412) 5298 : cluster [DBG] pgmap v3013: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:28:54 gibba015 bash[30343]: cluster 2021-03-10T15:28:53.287067+0000 mgr.gibba045.orlgmj (mgr.34412) 5298 : cluster [DBG] pgmap v3013: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:54.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:28:54 gibba045 bash[25517]: cluster 2021-03-10T15:28:53.287067+0000 mgr.gibba045.orlgmj (mgr.34412) 5298 : cluster [DBG] pgmap v3013: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:56.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:28:56 gibba015 bash[29377]: cluster 2021-03-10T15:28:55.288654+0000 mgr.gibba045.orlgmj (mgr.34412) 5299 : cluster [DBG] pgmap v3014: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:56.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:28:56 gibba015 bash[30343]: cluster 2021-03-10T15:28:55.288654+0000 mgr.gibba045.orlgmj (mgr.34412) 5299 : cluster [DBG] pgmap v3014: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:56.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:28:56 gibba045 bash[25517]: cluster 2021-03-10T15:28:55.288654+0000 mgr.gibba045.orlgmj (mgr.34412) 5299 : cluster [DBG] pgmap v3014: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:58.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:28:58 gibba045 bash[25517]: cluster 2021-03-10T15:28:57.290200+0000 mgr.gibba045.orlgmj (mgr.34412) 5300 : cluster [DBG] pgmap v3015: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:58.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:28:58 gibba015 bash[29377]: cluster 2021-03-10T15:28:57.290200+0000 mgr.gibba045.orlgmj (mgr.34412) 5300 : cluster [DBG] pgmap v3015: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:58.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:28:58 gibba015 bash[30343]: cluster 2021-03-10T15:28:57.290200+0000 mgr.gibba045.orlgmj (mgr.34412) 5300 : cluster [DBG] pgmap v3015: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:59.907 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:29:00.137 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:29:00.137 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (99m) 3m ago 105m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:29:00.138 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (104m) 2m ago 104m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:29:00.138 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (100m) 2m ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:29:00.138 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (100m) 2m ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:29:00.138 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (99m) 3m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:29:00.139 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (99m) 3m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:29:00.139 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (98m) 2m ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:29:00.139 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (98m) 3m ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:29:00.139 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (105m) 3m ago 105m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:29:00.140 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (105m) 2m ago 105m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:29:00.140 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (98m) 3m ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:29:00.140 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (97m) 3m ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:29:00.140 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (97m) 3m ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:29:00.140 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (96m) 3m ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:29:00.141 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (96m) 2m ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:29:00.141 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (95m) 2m ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:29:00.141 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (95m) 2m ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:29:00.141 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (95m) 2m ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:29:00.141 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (104m) 2m ago 105m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:29:00.142 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 2m ago 103m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:29:00.387 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:29:00.387 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:29:00.387 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:29:00.388 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:29:00.388 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:29:00.388 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:29:00.388 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:29:00.389 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:29:00.389 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:29:00.389 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:29:00.389 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:29:00.389 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:29:00.390 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:29:00.390 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:29:00.390 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:29:00.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:29:00 gibba045 bash[25517]: cluster 2021-03-10T15:28:59.291380+0000 mgr.gibba045.orlgmj (mgr.34412) 5301 : cluster [DBG] pgmap v3016: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:00.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:29:00 gibba045 bash[25517]: audit 2021-03-10T15:28:59.897458+0000 mgr.gibba045.orlgmj (mgr.34412) 5302 : audit [DBG] from='client.57604 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:29:00.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:29:00 gibba045 bash[25517]: audit 2021-03-10T15:29:00.382329+0000 mon.a (mon.0) 1390 : audit [DBG] from='client.? 172.21.2.115:0/3180004723' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:29:00.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:29:00 gibba015 bash[29377]: cluster 2021-03-10T15:28:59.291380+0000 mgr.gibba045.orlgmj (mgr.34412) 5301 : cluster [DBG] pgmap v3016: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:00.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:29:00 gibba015 bash[29377]: audit 2021-03-10T15:28:59.897458+0000 mgr.gibba045.orlgmj (mgr.34412) 5302 : audit [DBG] from='client.57604 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:29:00.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:29:00 gibba015 bash[29377]: audit 2021-03-10T15:29:00.382329+0000 mon.a (mon.0) 1390 : audit [DBG] from='client.? 172.21.2.115:0/3180004723' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:29:00.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:29:00 gibba015 bash[30343]: cluster 2021-03-10T15:28:59.291380+0000 mgr.gibba045.orlgmj (mgr.34412) 5301 : cluster [DBG] pgmap v3016: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:00.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:29:00 gibba015 bash[30343]: audit 2021-03-10T15:28:59.897458+0000 mgr.gibba045.orlgmj (mgr.34412) 5302 : audit [DBG] from='client.57604 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:29:00.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:29:00 gibba015 bash[30343]: audit 2021-03-10T15:29:00.382329+0000 mon.a (mon.0) 1390 : audit [DBG] from='client.? 172.21.2.115:0/3180004723' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:29:01.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:29:01 gibba045 bash[25517]: audit 2021-03-10T15:29:00.122975+0000 mgr.gibba045.orlgmj (mgr.34412) 5303 : audit [DBG] from='client.47622 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:29:01.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:29:01 gibba015 bash[29377]: audit 2021-03-10T15:29:00.122975+0000 mgr.gibba045.orlgmj (mgr.34412) 5303 : audit [DBG] from='client.47622 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:29:01.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:29:01 gibba015 bash[30343]: audit 2021-03-10T15:29:00.122975+0000 mgr.gibba045.orlgmj (mgr.34412) 5303 : audit [DBG] from='client.47622 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:29:02.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:29:02 gibba045 bash[25517]: cluster 2021-03-10T15:29:01.293065+0000 mgr.gibba045.orlgmj (mgr.34412) 5304 : cluster [DBG] pgmap v3017: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:02.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:29:02 gibba015 bash[29377]: cluster 2021-03-10T15:29:01.293065+0000 mgr.gibba045.orlgmj (mgr.34412) 5304 : cluster [DBG] pgmap v3017: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:02.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:29:02 gibba015 bash[30343]: cluster 2021-03-10T15:29:01.293065+0000 mgr.gibba045.orlgmj (mgr.34412) 5304 : cluster [DBG] pgmap v3017: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:04.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:29:04 gibba045 bash[25517]: cluster 2021-03-10T15:29:03.294672+0000 mgr.gibba045.orlgmj (mgr.34412) 5305 : cluster [DBG] pgmap v3018: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:04.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:29:04 gibba015 bash[29377]: cluster 2021-03-10T15:29:03.294672+0000 mgr.gibba045.orlgmj (mgr.34412) 5305 : cluster [DBG] pgmap v3018: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:04.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:29:04 gibba015 bash[30343]: cluster 2021-03-10T15:29:03.294672+0000 mgr.gibba045.orlgmj (mgr.34412) 5305 : cluster [DBG] pgmap v3018: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:06.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:29:06 gibba045 bash[25517]: cluster 2021-03-10T15:29:05.296192+0000 mgr.gibba045.orlgmj (mgr.34412) 5306 : cluster [DBG] pgmap v3019: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:06.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:29:06 gibba045 bash[25517]: audit 2021-03-10T15:29:05.737597+0000 mon.c (mon.1) 1499 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:29:06.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:29:06 gibba045 bash[25517]: cephadm 2021-03-10T15:29:05.746847+0000 mgr.gibba045.orlgmj (mgr.34412) 5307 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:29:06.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:29:06 gibba045 bash[25517]: cephadm 2021-03-10T15:29:05.748812+0000 mgr.gibba045.orlgmj (mgr.34412) 5308 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:29:06.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:29:06 gibba045 bash[25517]: audit 2021-03-10T15:29:05.951488+0000 mon.a (mon.0) 1391 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:29:06.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:29:06 gibba045 bash[25517]: audit 2021-03-10T15:29:05.955415+0000 mon.c (mon.1) 1500 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:29:06.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:29:06 gibba045 bash[25517]: audit 2021-03-10T15:29:05.957223+0000 mon.c (mon.1) 1501 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:29:06.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:29:06 gibba045 bash[25517]: cephadm 2021-03-10T15:29:05.958500+0000 mgr.gibba045.orlgmj (mgr.34412) 5309 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:29:06.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:29:06 gibba045 bash[25517]: audit 2021-03-10T15:29:05.958959+0000 mon.c (mon.1) 1502 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:29:06.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:29:06 gibba045 bash[25517]: audit 2021-03-10T15:29:05.960565+0000 mon.c (mon.1) 1503 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:29:06.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:29:06 gibba045 bash[25517]: cephadm 2021-03-10T15:29:05.960658+0000 mgr.gibba045.orlgmj (mgr.34412) 5310 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:29:06.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:29:06 gibba045 bash[25517]: cephadm 2021-03-10T15:29:05.962242+0000 mgr.gibba045.orlgmj (mgr.34412) 5311 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:29:06.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:29:06 gibba045 bash[25517]: cephadm 2021-03-10T15:29:05.962282+0000 mgr.gibba045.orlgmj (mgr.34412) 5312 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:29:06.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:29:06 gibba045 bash[25517]: audit 2021-03-10T15:29:05.963878+0000 mon.c (mon.1) 1504 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:29:06.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:29:06 gibba045 bash[25517]: cephadm 2021-03-10T15:29:05.964053+0000 mgr.gibba045.orlgmj (mgr.34412) 5313 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:29:06.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:29:06 gibba045 bash[25517]: cephadm 2021-03-10T15:29:05.964091+0000 mgr.gibba045.orlgmj (mgr.34412) 5314 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:29:06.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:29:06 gibba045 bash[25517]: audit 2021-03-10T15:29:05.965450+0000 mon.c (mon.1) 1505 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:29:06.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:29:06 gibba045 bash[25517]: cephadm 2021-03-10T15:29:05.965466+0000 mgr.gibba045.orlgmj (mgr.34412) 5315 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:29:06.812 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:29:06 gibba045 bash[25517]: cephadm 2021-03-10T15:29:05.967243+0000 mgr.gibba045.orlgmj (mgr.34412) 5316 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:29:06.812 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:29:06 gibba045 bash[25517]: cephadm 2021-03-10T15:29:05.967282+0000 mgr.gibba045.orlgmj (mgr.34412) 5317 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:29:06.812 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:29:06 gibba045 bash[25517]: cephadm 2021-03-10T15:29:05.968827+0000 mgr.gibba045.orlgmj (mgr.34412) 5318 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:29:06.812 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:29:06 gibba045 bash[25517]: cephadm 2021-03-10T15:29:05.969150+0000 mgr.gibba045.orlgmj (mgr.34412) 5319 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:29:06.813 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:29:06 gibba045 bash[25517]: cephadm 2021-03-10T15:29:05.970319+0000 mgr.gibba045.orlgmj (mgr.34412) 5320 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:29:06.813 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:29:06 gibba045 bash[25517]: cephadm 2021-03-10T15:29:05.970358+0000 mgr.gibba045.orlgmj (mgr.34412) 5321 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:29:06.813 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:29:06 gibba045 bash[25517]: cephadm 2021-03-10T15:29:05.970465+0000 mgr.gibba045.orlgmj (mgr.34412) 5322 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:29:06.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:29:06 gibba015 bash[29377]: cluster 2021-03-10T15:29:05.296192+0000 mgr.gibba045.orlgmj (mgr.34412) 5306 : cluster [DBG] pgmap v3019: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:06.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:29:06 gibba015 bash[29377]: audit 2021-03-10T15:29:05.737597+0000 mon.c (mon.1) 1499 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:29:06.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:29:06 gibba015 bash[29377]: cephadm 2021-03-10T15:29:05.746847+0000 mgr.gibba045.orlgmj (mgr.34412) 5307 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:29:06.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:29:06 gibba015 bash[29377]: cephadm 2021-03-10T15:29:05.748812+0000 mgr.gibba045.orlgmj (mgr.34412) 5308 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:29:06.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:29:06 gibba015 bash[29377]: audit 2021-03-10T15:29:05.951488+0000 mon.a (mon.0) 1391 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:29:06.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:29:06 gibba015 bash[29377]: audit 2021-03-10T15:29:05.955415+0000 mon.c (mon.1) 1500 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:29:06.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:29:06 gibba015 bash[29377]: audit 2021-03-10T15:29:05.957223+0000 mon.c (mon.1) 1501 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:29:06.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:29:06 gibba015 bash[29377]: cephadm 2021-03-10T15:29:05.958500+0000 mgr.gibba045.orlgmj (mgr.34412) 5309 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:29:06.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:29:06 gibba015 bash[29377]: audit 2021-03-10T15:29:05.958959+0000 mon.c (mon.1) 1502 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:29:06.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:29:06 gibba015 bash[29377]: audit 2021-03-10T15:29:05.960565+0000 mon.c (mon.1) 1503 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:29:06.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:29:06 gibba015 bash[29377]: cephadm 2021-03-10T15:29:05.960658+0000 mgr.gibba045.orlgmj (mgr.34412) 5310 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:29:06.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:29:06 gibba015 bash[29377]: cephadm 2021-03-10T15:29:05.962242+0000 mgr.gibba045.orlgmj (mgr.34412) 5311 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:29:06.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:29:06 gibba015 bash[29377]: cephadm 2021-03-10T15:29:05.962282+0000 mgr.gibba045.orlgmj (mgr.34412) 5312 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:29:06.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:29:06 gibba015 bash[29377]: audit 2021-03-10T15:29:05.963878+0000 mon.c (mon.1) 1504 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:29:06.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:29:06 gibba015 bash[29377]: cephadm 2021-03-10T15:29:05.964053+0000 mgr.gibba045.orlgmj (mgr.34412) 5313 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:29:06.980 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:29:06 gibba015 bash[29377]: cephadm 2021-03-10T15:29:05.964091+0000 mgr.gibba045.orlgmj (mgr.34412) 5314 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:29:06.980 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:29:06 gibba015 bash[29377]: audit 2021-03-10T15:29:05.965450+0000 mon.c (mon.1) 1505 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:29:06.980 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:29:06 gibba015 bash[29377]: cephadm 2021-03-10T15:29:05.965466+0000 mgr.gibba045.orlgmj (mgr.34412) 5315 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:29:06.980 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:29:06 gibba015 bash[29377]: cephadm 2021-03-10T15:29:05.967243+0000 mgr.gibba045.orlgmj (mgr.34412) 5316 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:29:06.981 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:29:06 gibba015 bash[29377]: cephadm 2021-03-10T15:29:05.967282+0000 mgr.gibba045.orlgmj (mgr.34412) 5317 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:29:06.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:29:06 gibba015 bash[30343]: cluster 2021-03-10T15:29:05.296192+0000 mgr.gibba045.orlgmj (mgr.34412) 5306 : cluster [DBG] pgmap v3019: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:06.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:29:06 gibba015 bash[30343]: audit 2021-03-10T15:29:05.737597+0000 mon.c (mon.1) 1499 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:29:06.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:29:06 gibba015 bash[30343]: cephadm 2021-03-10T15:29:05.746847+0000 mgr.gibba045.orlgmj (mgr.34412) 5307 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:29:06.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:29:06 gibba015 bash[30343]: cephadm 2021-03-10T15:29:05.748812+0000 mgr.gibba045.orlgmj (mgr.34412) 5308 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:29:06.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:29:06 gibba015 bash[30343]: audit 2021-03-10T15:29:05.951488+0000 mon.a (mon.0) 1391 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:29:06.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:29:06 gibba015 bash[30343]: audit 2021-03-10T15:29:05.955415+0000 mon.c (mon.1) 1500 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:29:06.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:29:06 gibba015 bash[30343]: audit 2021-03-10T15:29:05.957223+0000 mon.c (mon.1) 1501 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:29:06.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:29:06 gibba015 bash[30343]: cephadm 2021-03-10T15:29:05.958500+0000 mgr.gibba045.orlgmj (mgr.34412) 5309 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:29:06.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:29:06 gibba015 bash[30343]: audit 2021-03-10T15:29:05.958959+0000 mon.c (mon.1) 1502 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:29:06.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:29:06 gibba015 bash[30343]: audit 2021-03-10T15:29:05.960565+0000 mon.c (mon.1) 1503 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:29:06.984 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:29:06 gibba015 bash[30343]: cephadm 2021-03-10T15:29:05.960658+0000 mgr.gibba045.orlgmj (mgr.34412) 5310 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:29:06.984 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:29:06 gibba015 bash[30343]: cephadm 2021-03-10T15:29:05.962242+0000 mgr.gibba045.orlgmj (mgr.34412) 5311 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:29:06.984 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:29:06 gibba015 bash[30343]: cephadm 2021-03-10T15:29:05.962282+0000 mgr.gibba045.orlgmj (mgr.34412) 5312 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:29:06.984 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:29:06 gibba015 bash[30343]: audit 2021-03-10T15:29:05.963878+0000 mon.c (mon.1) 1504 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:29:06.985 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:29:06 gibba015 bash[30343]: cephadm 2021-03-10T15:29:05.964053+0000 mgr.gibba045.orlgmj (mgr.34412) 5313 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:29:06.985 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:29:06 gibba015 bash[30343]: cephadm 2021-03-10T15:29:05.964091+0000 mgr.gibba045.orlgmj (mgr.34412) 5314 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:29:06.985 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:29:06 gibba015 bash[30343]: audit 2021-03-10T15:29:05.965450+0000 mon.c (mon.1) 1505 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:29:06.985 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:29:06 gibba015 bash[30343]: cephadm 2021-03-10T15:29:05.965466+0000 mgr.gibba045.orlgmj (mgr.34412) 5315 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:29:06.986 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:29:06 gibba015 bash[30343]: cephadm 2021-03-10T15:29:05.967243+0000 mgr.gibba045.orlgmj (mgr.34412) 5316 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:29:06.986 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:29:06 gibba015 bash[30343]: cephadm 2021-03-10T15:29:05.967282+0000 mgr.gibba045.orlgmj (mgr.34412) 5317 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:29:06.986 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:29:06 gibba015 bash[29377]: cephadm 2021-03-10T15:29:05.968827+0000 mgr.gibba045.orlgmj (mgr.34412) 5318 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:29:06.987 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:29:06 gibba015 bash[29377]: cephadm 2021-03-10T15:29:05.969150+0000 mgr.gibba045.orlgmj (mgr.34412) 5319 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:29:06.987 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:29:06 gibba015 bash[29377]: cephadm 2021-03-10T15:29:05.970319+0000 mgr.gibba045.orlgmj (mgr.34412) 5320 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:29:06.987 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:29:06 gibba015 bash[29377]: cephadm 2021-03-10T15:29:05.970358+0000 mgr.gibba045.orlgmj (mgr.34412) 5321 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:29:06.988 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:29:06 gibba015 bash[29377]: cephadm 2021-03-10T15:29:05.970465+0000 mgr.gibba045.orlgmj (mgr.34412) 5322 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:29:06.988 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:29:06 gibba015 bash[30343]: cephadm 2021-03-10T15:29:05.968827+0000 mgr.gibba045.orlgmj (mgr.34412) 5318 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:29:06.988 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:29:06 gibba015 bash[30343]: cephadm 2021-03-10T15:29:05.969150+0000 mgr.gibba045.orlgmj (mgr.34412) 5319 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:29:06.989 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:29:06 gibba015 bash[30343]: cephadm 2021-03-10T15:29:05.970319+0000 mgr.gibba045.orlgmj (mgr.34412) 5320 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:29:06.989 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:29:06 gibba015 bash[30343]: cephadm 2021-03-10T15:29:05.970358+0000 mgr.gibba045.orlgmj (mgr.34412) 5321 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:29:06.989 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:29:06 gibba015 bash[30343]: cephadm 2021-03-10T15:29:05.970465+0000 mgr.gibba045.orlgmj (mgr.34412) 5322 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:29:08.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:29:08 gibba045 bash[25517]: cluster 2021-03-10T15:29:07.297950+0000 mgr.gibba045.orlgmj (mgr.34412) 5323 : cluster [DBG] pgmap v3020: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:08.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:29:08 gibba015 bash[29377]: cluster 2021-03-10T15:29:07.297950+0000 mgr.gibba045.orlgmj (mgr.34412) 5323 : cluster [DBG] pgmap v3020: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:08.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:29:08 gibba015 bash[30343]: cluster 2021-03-10T15:29:07.297950+0000 mgr.gibba045.orlgmj (mgr.34412) 5323 : cluster [DBG] pgmap v3020: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:10.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:29:10 gibba045 bash[25517]: cluster 2021-03-10T15:29:09.299149+0000 mgr.gibba045.orlgmj (mgr.34412) 5324 : cluster [DBG] pgmap v3021: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:10.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:29:10 gibba015 bash[29377]: cluster 2021-03-10T15:29:09.299149+0000 mgr.gibba045.orlgmj (mgr.34412) 5324 : cluster [DBG] pgmap v3021: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:10.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:29:10 gibba015 bash[30343]: cluster 2021-03-10T15:29:09.299149+0000 mgr.gibba045.orlgmj (mgr.34412) 5324 : cluster [DBG] pgmap v3021: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:12.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:29:12 gibba045 bash[25517]: cluster 2021-03-10T15:29:11.300918+0000 mgr.gibba045.orlgmj (mgr.34412) 5325 : cluster [DBG] pgmap v3022: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:12.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:29:12 gibba015 bash[29377]: cluster 2021-03-10T15:29:11.300918+0000 mgr.gibba045.orlgmj (mgr.34412) 5325 : cluster [DBG] pgmap v3022: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:12.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:29:12 gibba015 bash[30343]: cluster 2021-03-10T15:29:11.300918+0000 mgr.gibba045.orlgmj (mgr.34412) 5325 : cluster [DBG] pgmap v3022: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:14.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:29:14 gibba045 bash[25517]: cluster 2021-03-10T15:29:13.302459+0000 mgr.gibba045.orlgmj (mgr.34412) 5326 : cluster [DBG] pgmap v3023: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:14.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:29:14 gibba015 bash[29377]: cluster 2021-03-10T15:29:13.302459+0000 mgr.gibba045.orlgmj (mgr.34412) 5326 : cluster [DBG] pgmap v3023: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:14.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:29:14 gibba015 bash[30343]: cluster 2021-03-10T15:29:13.302459+0000 mgr.gibba045.orlgmj (mgr.34412) 5326 : cluster [DBG] pgmap v3023: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:16.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:29:16 gibba015 bash[29377]: cluster 2021-03-10T15:29:15.304054+0000 mgr.gibba045.orlgmj (mgr.34412) 5327 : cluster [DBG] pgmap v3024: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:16.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:29:16 gibba015 bash[30343]: cluster 2021-03-10T15:29:15.304054+0000 mgr.gibba045.orlgmj (mgr.34412) 5327 : cluster [DBG] pgmap v3024: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:17.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:29:16 gibba045 bash[25517]: cluster 2021-03-10T15:29:15.304054+0000 mgr.gibba045.orlgmj (mgr.34412) 5327 : cluster [DBG] pgmap v3024: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:18.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:29:18 gibba015 bash[29377]: cluster 2021-03-10T15:29:17.305684+0000 mgr.gibba045.orlgmj (mgr.34412) 5328 : cluster [DBG] pgmap v3025: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:18.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:29:18 gibba015 bash[30343]: cluster 2021-03-10T15:29:17.305684+0000 mgr.gibba045.orlgmj (mgr.34412) 5328 : cluster [DBG] pgmap v3025: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:19.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:29:18 gibba045 bash[25517]: cluster 2021-03-10T15:29:17.305684+0000 mgr.gibba045.orlgmj (mgr.34412) 5328 : cluster [DBG] pgmap v3025: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:20.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:29:20 gibba015 bash[29377]: cluster 2021-03-10T15:29:19.306853+0000 mgr.gibba045.orlgmj (mgr.34412) 5329 : cluster [DBG] pgmap v3026: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:20.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:29:20 gibba015 bash[30343]: cluster 2021-03-10T15:29:19.306853+0000 mgr.gibba045.orlgmj (mgr.34412) 5329 : cluster [DBG] pgmap v3026: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:20.987 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:29:20 gibba045 bash[25517]: cluster 2021-03-10T15:29:19.306853+0000 mgr.gibba045.orlgmj (mgr.34412) 5329 : cluster [DBG] pgmap v3026: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:21.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:29:21 gibba015 bash[29377]: cephadm 2021-03-10T15:29:20.986448+0000 mgr.gibba045.orlgmj (mgr.34412) 5330 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:29:21.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:29:21 gibba015 bash[30343]: cephadm 2021-03-10T15:29:20.986448+0000 mgr.gibba045.orlgmj (mgr.34412) 5330 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:29:22.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:29:21 gibba045 bash[25517]: cephadm 2021-03-10T15:29:20.986448+0000 mgr.gibba045.orlgmj (mgr.34412) 5330 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:29:22.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:29:22 gibba015 bash[29377]: cluster 2021-03-10T15:29:21.308345+0000 mgr.gibba045.orlgmj (mgr.34412) 5331 : cluster [DBG] pgmap v3027: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:22.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:29:22 gibba015 bash[30343]: cluster 2021-03-10T15:29:21.308345+0000 mgr.gibba045.orlgmj (mgr.34412) 5331 : cluster [DBG] pgmap v3027: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:23.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:29:22 gibba045 bash[25517]: cluster 2021-03-10T15:29:21.308345+0000 mgr.gibba045.orlgmj (mgr.34412) 5331 : cluster [DBG] pgmap v3027: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:24.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:29:24 gibba015 bash[29377]: cluster 2021-03-10T15:29:23.309760+0000 mgr.gibba045.orlgmj (mgr.34412) 5332 : cluster [DBG] pgmap v3028: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:24.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:29:24 gibba015 bash[30343]: cluster 2021-03-10T15:29:23.309760+0000 mgr.gibba045.orlgmj (mgr.34412) 5332 : cluster [DBG] pgmap v3028: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:25.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:29:24 gibba045 bash[25517]: cluster 2021-03-10T15:29:23.309760+0000 mgr.gibba045.orlgmj (mgr.34412) 5332 : cluster [DBG] pgmap v3028: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:26.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:29:26 gibba015 bash[29377]: cluster 2021-03-10T15:29:25.311374+0000 mgr.gibba045.orlgmj (mgr.34412) 5333 : cluster [DBG] pgmap v3029: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:26.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:29:26 gibba015 bash[30343]: cluster 2021-03-10T15:29:25.311374+0000 mgr.gibba045.orlgmj (mgr.34412) 5333 : cluster [DBG] pgmap v3029: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:27.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:29:26 gibba045 bash[25517]: cluster 2021-03-10T15:29:25.311374+0000 mgr.gibba045.orlgmj (mgr.34412) 5333 : cluster [DBG] pgmap v3029: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:28.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:29:28 gibba015 bash[29377]: cluster 2021-03-10T15:29:27.313119+0000 mgr.gibba045.orlgmj (mgr.34412) 5334 : cluster [DBG] pgmap v3030: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:28.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:29:28 gibba015 bash[30343]: cluster 2021-03-10T15:29:27.313119+0000 mgr.gibba045.orlgmj (mgr.34412) 5334 : cluster [DBG] pgmap v3030: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:29.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:29:28 gibba045 bash[25517]: cluster 2021-03-10T15:29:27.313119+0000 mgr.gibba045.orlgmj (mgr.34412) 5334 : cluster [DBG] pgmap v3030: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:30.632 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:29:30.860 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:29:30.860 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (100m) 4m ago 105m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:29:30.860 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (105m) 3m ago 105m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:29:30.861 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (100m) 3m ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:29:30.861 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (100m) 3m ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:29:30.861 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (99m) 4m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:29:30.861 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (99m) 4m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:29:30.862 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (99m) 3m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:29:30.862 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (99m) 4m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:29:30.862 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (105m) 4m ago 105m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:29:30.862 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (105m) 3m ago 105m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:29:30.862 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (98m) 4m ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:29:30.863 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (98m) 4m ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:29:30.863 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (97m) 4m ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:29:30.863 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (97m) 4m ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:29:30.863 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (96m) 3m ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:29:30.864 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (96m) 3m ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:29:30.864 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (95m) 3m ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:29:30.864 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (95m) 3m ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:29:30.864 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (105m) 3m ago 105m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:29:30.865 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 3m ago 103m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:29:30.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:29:30 gibba015 bash[29377]: cluster 2021-03-10T15:29:29.314304+0000 mgr.gibba045.orlgmj (mgr.34412) 5335 : cluster [DBG] pgmap v3031: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:30.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:29:30 gibba015 bash[30343]: cluster 2021-03-10T15:29:29.314304+0000 mgr.gibba045.orlgmj (mgr.34412) 5335 : cluster [DBG] pgmap v3031: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:31.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:29:30 gibba045 bash[25517]: cluster 2021-03-10T15:29:29.314304+0000 mgr.gibba045.orlgmj (mgr.34412) 5335 : cluster [DBG] pgmap v3031: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:31.107 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:29:31.108 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:29:31.108 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:29:31.108 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:29:31.108 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:29:31.109 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:29:31.109 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:29:31.109 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:29:31.109 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:29:31.109 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:29:31.110 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:29:31.110 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:29:31.110 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:29:31.110 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:29:31.111 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:29:31.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:29:31 gibba015 bash[29377]: audit 2021-03-10T15:29:30.621527+0000 mgr.gibba045.orlgmj (mgr.34412) 5336 : audit [DBG] from='client.47634 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:29:31.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:29:31 gibba015 bash[29377]: audit 2021-03-10T15:29:30.846711+0000 mgr.gibba045.orlgmj (mgr.34412) 5337 : audit [DBG] from='client.47640 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:29:31.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:29:31 gibba015 bash[29377]: audit 2021-03-10T15:29:31.102950+0000 mon.a (mon.0) 1392 : audit [DBG] from='client.? 172.21.2.115:0/3194265956' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:29:31.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:29:31 gibba015 bash[30343]: audit 2021-03-10T15:29:30.621527+0000 mgr.gibba045.orlgmj (mgr.34412) 5336 : audit [DBG] from='client.47634 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:29:31.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:29:31 gibba015 bash[30343]: audit 2021-03-10T15:29:30.846711+0000 mgr.gibba045.orlgmj (mgr.34412) 5337 : audit [DBG] from='client.47640 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:29:31.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:29:31 gibba015 bash[30343]: audit 2021-03-10T15:29:31.102950+0000 mon.a (mon.0) 1392 : audit [DBG] from='client.? 172.21.2.115:0/3194265956' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:29:32.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:29:31 gibba045 bash[25517]: audit 2021-03-10T15:29:30.621527+0000 mgr.gibba045.orlgmj (mgr.34412) 5336 : audit [DBG] from='client.47634 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:29:32.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:29:31 gibba045 bash[25517]: audit 2021-03-10T15:29:30.846711+0000 mgr.gibba045.orlgmj (mgr.34412) 5337 : audit [DBG] from='client.47640 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:29:32.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:29:31 gibba045 bash[25517]: audit 2021-03-10T15:29:31.102950+0000 mon.a (mon.0) 1392 : audit [DBG] from='client.? 172.21.2.115:0/3194265956' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:29:32.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:29:32 gibba015 bash[29377]: cluster 2021-03-10T15:29:31.316001+0000 mgr.gibba045.orlgmj (mgr.34412) 5338 : cluster [DBG] pgmap v3032: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:32.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:29:32 gibba015 bash[30343]: cluster 2021-03-10T15:29:31.316001+0000 mgr.gibba045.orlgmj (mgr.34412) 5338 : cluster [DBG] pgmap v3032: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:33.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:29:32 gibba045 bash[25517]: cluster 2021-03-10T15:29:31.316001+0000 mgr.gibba045.orlgmj (mgr.34412) 5338 : cluster [DBG] pgmap v3032: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:34.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:29:34 gibba015 bash[29377]: cluster 2021-03-10T15:29:33.317541+0000 mgr.gibba045.orlgmj (mgr.34412) 5339 : cluster [DBG] pgmap v3033: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:34.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:29:34 gibba015 bash[30343]: cluster 2021-03-10T15:29:33.317541+0000 mgr.gibba045.orlgmj (mgr.34412) 5339 : cluster [DBG] pgmap v3033: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:35.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:29:34 gibba045 bash[25517]: cluster 2021-03-10T15:29:33.317541+0000 mgr.gibba045.orlgmj (mgr.34412) 5339 : cluster [DBG] pgmap v3033: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:36.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:29:36 gibba015 bash[29377]: cluster 2021-03-10T15:29:35.318954+0000 mgr.gibba045.orlgmj (mgr.34412) 5340 : cluster [DBG] pgmap v3034: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:36.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:29:36 gibba015 bash[29377]: cephadm 2021-03-10T15:29:36.002482+0000 mgr.gibba045.orlgmj (mgr.34412) 5341 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:29:36.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:29:36 gibba015 bash[30343]: cluster 2021-03-10T15:29:35.318954+0000 mgr.gibba045.orlgmj (mgr.34412) 5340 : cluster [DBG] pgmap v3034: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:36.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:29:36 gibba015 bash[30343]: cephadm 2021-03-10T15:29:36.002482+0000 mgr.gibba045.orlgmj (mgr.34412) 5341 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:29:37.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:29:36 gibba045 bash[25517]: cluster 2021-03-10T15:29:35.318954+0000 mgr.gibba045.orlgmj (mgr.34412) 5340 : cluster [DBG] pgmap v3034: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:37.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:29:36 gibba045 bash[25517]: cephadm 2021-03-10T15:29:36.002482+0000 mgr.gibba045.orlgmj (mgr.34412) 5341 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:29:38.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:29:38 gibba015 bash[29377]: cluster 2021-03-10T15:29:37.324823+0000 mgr.gibba045.orlgmj (mgr.34412) 5342 : cluster [DBG] pgmap v3035: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:38.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:29:38 gibba015 bash[30343]: cluster 2021-03-10T15:29:37.324823+0000 mgr.gibba045.orlgmj (mgr.34412) 5342 : cluster [DBG] pgmap v3035: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:39.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:29:38 gibba045 bash[25517]: cluster 2021-03-10T15:29:37.324823+0000 mgr.gibba045.orlgmj (mgr.34412) 5342 : cluster [DBG] pgmap v3035: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:40.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:29:40 gibba015 bash[29377]: cluster 2021-03-10T15:29:39.325892+0000 mgr.gibba045.orlgmj (mgr.34412) 5343 : cluster [DBG] pgmap v3036: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:40.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:29:40 gibba015 bash[30343]: cluster 2021-03-10T15:29:39.325892+0000 mgr.gibba045.orlgmj (mgr.34412) 5343 : cluster [DBG] pgmap v3036: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:41.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:29:40 gibba045 bash[25517]: cluster 2021-03-10T15:29:39.325892+0000 mgr.gibba045.orlgmj (mgr.34412) 5343 : cluster [DBG] pgmap v3036: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:42.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:29:42 gibba015 bash[29377]: cluster 2021-03-10T15:29:41.327598+0000 mgr.gibba045.orlgmj (mgr.34412) 5344 : cluster [DBG] pgmap v3037: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:42.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:29:42 gibba015 bash[30343]: cluster 2021-03-10T15:29:41.327598+0000 mgr.gibba045.orlgmj (mgr.34412) 5344 : cluster [DBG] pgmap v3037: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:43.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:29:42 gibba045 bash[25517]: cluster 2021-03-10T15:29:41.327598+0000 mgr.gibba045.orlgmj (mgr.34412) 5344 : cluster [DBG] pgmap v3037: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:44.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:29:44 gibba015 bash[29377]: cluster 2021-03-10T15:29:43.329141+0000 mgr.gibba045.orlgmj (mgr.34412) 5345 : cluster [DBG] pgmap v3038: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:44.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:29:44 gibba015 bash[30343]: cluster 2021-03-10T15:29:43.329141+0000 mgr.gibba045.orlgmj (mgr.34412) 5345 : cluster [DBG] pgmap v3038: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:45.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:29:44 gibba045 bash[25517]: cluster 2021-03-10T15:29:43.329141+0000 mgr.gibba045.orlgmj (mgr.34412) 5345 : cluster [DBG] pgmap v3038: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:46.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:29:46 gibba015 bash[29377]: cluster 2021-03-10T15:29:45.330520+0000 mgr.gibba045.orlgmj (mgr.34412) 5346 : cluster [DBG] pgmap v3039: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:46.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:29:46 gibba015 bash[30343]: cluster 2021-03-10T15:29:45.330520+0000 mgr.gibba045.orlgmj (mgr.34412) 5346 : cluster [DBG] pgmap v3039: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:47.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:29:46 gibba045 bash[25517]: cluster 2021-03-10T15:29:45.330520+0000 mgr.gibba045.orlgmj (mgr.34412) 5346 : cluster [DBG] pgmap v3039: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:48.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:29:48 gibba015 bash[29377]: cluster 2021-03-10T15:29:47.331375+0000 mgr.gibba045.orlgmj (mgr.34412) 5347 : cluster [DBG] pgmap v3040: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:48.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:29:48 gibba015 bash[30343]: cluster 2021-03-10T15:29:47.331375+0000 mgr.gibba045.orlgmj (mgr.34412) 5347 : cluster [DBG] pgmap v3040: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:49.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:29:48 gibba045 bash[25517]: cluster 2021-03-10T15:29:47.331375+0000 mgr.gibba045.orlgmj (mgr.34412) 5347 : cluster [DBG] pgmap v3040: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:51.018 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:29:50 gibba045 bash[25517]: cluster 2021-03-10T15:29:49.332478+0000 mgr.gibba045.orlgmj (mgr.34412) 5348 : cluster [DBG] pgmap v3041: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:51.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:29:50 gibba015 bash[29377]: cluster 2021-03-10T15:29:49.332478+0000 mgr.gibba045.orlgmj (mgr.34412) 5348 : cluster [DBG] pgmap v3041: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:51.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:29:50 gibba015 bash[30343]: cluster 2021-03-10T15:29:49.332478+0000 mgr.gibba045.orlgmj (mgr.34412) 5348 : cluster [DBG] pgmap v3041: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:52.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:29:51 gibba045 bash[25517]: cephadm 2021-03-10T15:29:51.017303+0000 mgr.gibba045.orlgmj (mgr.34412) 5349 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:29:52.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:29:51 gibba015 bash[29377]: cephadm 2021-03-10T15:29:51.017303+0000 mgr.gibba045.orlgmj (mgr.34412) 5349 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:29:52.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:29:51 gibba015 bash[30343]: cephadm 2021-03-10T15:29:51.017303+0000 mgr.gibba045.orlgmj (mgr.34412) 5349 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:29:53.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:29:52 gibba045 bash[25517]: cluster 2021-03-10T15:29:51.333934+0000 mgr.gibba045.orlgmj (mgr.34412) 5350 : cluster [DBG] pgmap v3042: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:53.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:29:52 gibba015 bash[29377]: cluster 2021-03-10T15:29:51.333934+0000 mgr.gibba045.orlgmj (mgr.34412) 5350 : cluster [DBG] pgmap v3042: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:53.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:29:52 gibba015 bash[30343]: cluster 2021-03-10T15:29:51.333934+0000 mgr.gibba045.orlgmj (mgr.34412) 5350 : cluster [DBG] pgmap v3042: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:29:53 gibba045 bash[25517]: audit 2021-03-10T15:29:53.147768+0000 mon.c (mon.1) 1506 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:29:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:29:53 gibba045 bash[25517]: audit 2021-03-10T15:29:53.148375+0000 mon.c (mon.1) 1507 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:29:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:29:53 gibba045 bash[25517]: audit 2021-03-10T15:29:53.148898+0000 mon.a (mon.0) 1393 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:29:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:29:53 gibba045 bash[25517]: audit 2021-03-10T15:29:53.149702+0000 mon.c (mon.1) 1508 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T15:29:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:29:53 gibba045 bash[25517]: audit 2021-03-10T15:29:53.150203+0000 mon.a (mon.0) 1394 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:29:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:29:53 gibba045 bash[25517]: audit 2021-03-10T15:29:53.150597+0000 mon.c (mon.1) 1509 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:29:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:29:53 gibba045 bash[25517]: audit 2021-03-10T15:29:53.151196+0000 mon.a (mon.0) 1395 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T15:29:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:29:53 gibba045 bash[25517]: audit 2021-03-10T15:29:53.151451+0000 mon.c (mon.1) 1510 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:29:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:29:53 gibba045 bash[25517]: audit 2021-03-10T15:29:53.152250+0000 mon.c (mon.1) 1511 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T15:29:54.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:29:53 gibba045 bash[25517]: audit 2021-03-10T15:29:53.152356+0000 mon.a (mon.0) 1396 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:29:54.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:29:53 gibba045 bash[25517]: audit 2021-03-10T15:29:53.153726+0000 mon.a (mon.0) 1397 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:29:54.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:29:53 gibba045 bash[25517]: audit 2021-03-10T15:29:53.154530+0000 mon.a (mon.0) 1398 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T15:29:54.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:29:53 gibba015 bash[29377]: audit 2021-03-10T15:29:53.147768+0000 mon.c (mon.1) 1506 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:29:54.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:29:53 gibba015 bash[29377]: audit 2021-03-10T15:29:53.148375+0000 mon.c (mon.1) 1507 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:29:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:29:53 gibba015 bash[29377]: audit 2021-03-10T15:29:53.148898+0000 mon.a (mon.0) 1393 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:29:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:29:53 gibba015 bash[29377]: audit 2021-03-10T15:29:53.149702+0000 mon.c (mon.1) 1508 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T15:29:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:29:53 gibba015 bash[29377]: audit 2021-03-10T15:29:53.150203+0000 mon.a (mon.0) 1394 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:29:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:29:53 gibba015 bash[29377]: audit 2021-03-10T15:29:53.150597+0000 mon.c (mon.1) 1509 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:29:54.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:29:53 gibba015 bash[29377]: audit 2021-03-10T15:29:53.151196+0000 mon.a (mon.0) 1395 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T15:29:54.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:29:53 gibba015 bash[29377]: audit 2021-03-10T15:29:53.151451+0000 mon.c (mon.1) 1510 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:29:54.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:29:53 gibba015 bash[29377]: audit 2021-03-10T15:29:53.152250+0000 mon.c (mon.1) 1511 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T15:29:54.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:29:53 gibba015 bash[29377]: audit 2021-03-10T15:29:53.152356+0000 mon.a (mon.0) 1396 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:29:54.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:29:53 gibba015 bash[29377]: audit 2021-03-10T15:29:53.153726+0000 mon.a (mon.0) 1397 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:29:54.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:29:53 gibba015 bash[29377]: audit 2021-03-10T15:29:53.154530+0000 mon.a (mon.0) 1398 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T15:29:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:29:53 gibba015 bash[30343]: audit 2021-03-10T15:29:53.147768+0000 mon.c (mon.1) 1506 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:29:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:29:53 gibba015 bash[30343]: audit 2021-03-10T15:29:53.148375+0000 mon.c (mon.1) 1507 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:29:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:29:53 gibba015 bash[30343]: audit 2021-03-10T15:29:53.148898+0000 mon.a (mon.0) 1393 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:29:54.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:29:53 gibba015 bash[30343]: audit 2021-03-10T15:29:53.149702+0000 mon.c (mon.1) 1508 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T15:29:54.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:29:53 gibba015 bash[30343]: audit 2021-03-10T15:29:53.150203+0000 mon.a (mon.0) 1394 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:29:54.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:29:53 gibba015 bash[30343]: audit 2021-03-10T15:29:53.150597+0000 mon.c (mon.1) 1509 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:29:54.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:29:53 gibba015 bash[30343]: audit 2021-03-10T15:29:53.151196+0000 mon.a (mon.0) 1395 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T15:29:54.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:29:53 gibba015 bash[30343]: audit 2021-03-10T15:29:53.151451+0000 mon.c (mon.1) 1510 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:29:54.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:29:53 gibba015 bash[30343]: audit 2021-03-10T15:29:53.152250+0000 mon.c (mon.1) 1511 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T15:29:54.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:29:53 gibba015 bash[30343]: audit 2021-03-10T15:29:53.152356+0000 mon.a (mon.0) 1396 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:29:54.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:29:53 gibba015 bash[30343]: audit 2021-03-10T15:29:53.153726+0000 mon.a (mon.0) 1397 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:29:54.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:29:53 gibba015 bash[30343]: audit 2021-03-10T15:29:53.154530+0000 mon.a (mon.0) 1398 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T15:29:55.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:29:54 gibba045 bash[25517]: cluster 2021-03-10T15:29:53.335618+0000 mgr.gibba045.orlgmj (mgr.34412) 5351 : cluster [DBG] pgmap v3043: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:55.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:29:54 gibba015 bash[29377]: cluster 2021-03-10T15:29:53.335618+0000 mgr.gibba045.orlgmj (mgr.34412) 5351 : cluster [DBG] pgmap v3043: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:55.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:29:54 gibba015 bash[30343]: cluster 2021-03-10T15:29:53.335618+0000 mgr.gibba045.orlgmj (mgr.34412) 5351 : cluster [DBG] pgmap v3043: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:57.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:29:56 gibba045 bash[25517]: cluster 2021-03-10T15:29:55.337301+0000 mgr.gibba045.orlgmj (mgr.34412) 5352 : cluster [DBG] pgmap v3044: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:57.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:29:56 gibba015 bash[29377]: cluster 2021-03-10T15:29:55.337301+0000 mgr.gibba045.orlgmj (mgr.34412) 5352 : cluster [DBG] pgmap v3044: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:57.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:29:56 gibba015 bash[30343]: cluster 2021-03-10T15:29:55.337301+0000 mgr.gibba045.orlgmj (mgr.34412) 5352 : cluster [DBG] pgmap v3044: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:59.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:29:58 gibba045 bash[25517]: cluster 2021-03-10T15:29:57.338201+0000 mgr.gibba045.orlgmj (mgr.34412) 5353 : cluster [DBG] pgmap v3045: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:59.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:29:58 gibba015 bash[29377]: cluster 2021-03-10T15:29:57.338201+0000 mgr.gibba045.orlgmj (mgr.34412) 5353 : cluster [DBG] pgmap v3045: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:59.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:29:58 gibba015 bash[30343]: cluster 2021-03-10T15:29:57.338201+0000 mgr.gibba045.orlgmj (mgr.34412) 5353 : cluster [DBG] pgmap v3045: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:00.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:30:00 gibba015 bash[29377]: debug 2021-03-10T15:29:59.995+0000 7f21beb4f700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T15:30:01.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:30:00 gibba045 bash[25517]: cluster 2021-03-10T15:29:59.339407+0000 mgr.gibba045.orlgmj (mgr.34412) 5354 : cluster [DBG] pgmap v3046: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:01.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:30:00 gibba045 bash[25517]: cluster 2021-03-10T15:30:00.000155+0000 mon.a (mon.0) 1399 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T15:30:01.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:30:00 gibba015 bash[29377]: cluster 2021-03-10T15:29:59.339407+0000 mgr.gibba045.orlgmj (mgr.34412) 5354 : cluster [DBG] pgmap v3046: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:01.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:30:00 gibba015 bash[29377]: cluster 2021-03-10T15:30:00.000155+0000 mon.a (mon.0) 1399 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T15:30:01.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:30:00 gibba015 bash[30343]: cluster 2021-03-10T15:29:59.339407+0000 mgr.gibba045.orlgmj (mgr.34412) 5354 : cluster [DBG] pgmap v3046: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:01.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:30:00 gibba015 bash[30343]: cluster 2021-03-10T15:30:00.000155+0000 mon.a (mon.0) 1399 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T15:30:01.350 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:30:01.576 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:30:01.576 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (100m) 5m ago 106m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:30:01.576 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (105m) 3m ago 105m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:30:01.577 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (101m) 3m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:30:01.577 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (101m) 3m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:30:01.577 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (100m) 5m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:30:01.577 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (100m) 5m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:30:01.578 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (99m) 3m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:30:01.578 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (99m) 5m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:30:01.578 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (106m) 5m ago 106m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:30:01.578 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (106m) 3m ago 106m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:30:01.578 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (99m) 5m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:30:01.579 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (98m) 5m ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:30:01.579 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (98m) 5m ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:30:01.579 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (97m) 5m ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:30:01.579 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (97m) 3m ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:30:01.580 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (96m) 3m ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:30:01.580 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (96m) 3m ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:30:01.580 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (96m) 3m ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:30:01.580 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (105m) 3m ago 106m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:30:01.581 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 3m ago 104m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:30:01.828 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:30:01.828 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:30:01.828 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:30:01.829 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:30:01.829 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:30:01.829 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:30:01.829 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:30:01.830 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:30:01.830 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:30:01.830 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:30:01.830 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:30:01.830 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:30:01.831 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:30:01.831 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:30:01.831 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:30:03.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:30:02 gibba045 bash[25517]: audit 2021-03-10T15:30:01.340085+0000 mgr.gibba045.orlgmj (mgr.34412) 5355 : audit [DBG] from='client.57640 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:30:03.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:30:02 gibba045 bash[25517]: cluster 2021-03-10T15:30:01.341539+0000 mgr.gibba045.orlgmj (mgr.34412) 5356 : cluster [DBG] pgmap v3047: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:03.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:30:02 gibba045 bash[25517]: audit 2021-03-10T15:30:01.563215+0000 mgr.gibba045.orlgmj (mgr.34412) 5357 : audit [DBG] from='client.47658 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:30:03.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:30:02 gibba045 bash[25517]: audit 2021-03-10T15:30:01.823170+0000 mon.c (mon.1) 1512 : audit [DBG] from='client.? 172.21.2.115:0/4077081888' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:30:03.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:30:02 gibba015 bash[29377]: audit 2021-03-10T15:30:01.340085+0000 mgr.gibba045.orlgmj (mgr.34412) 5355 : audit [DBG] from='client.57640 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:30:03.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:30:02 gibba015 bash[29377]: cluster 2021-03-10T15:30:01.341539+0000 mgr.gibba045.orlgmj (mgr.34412) 5356 : cluster [DBG] pgmap v3047: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:03.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:30:02 gibba015 bash[29377]: audit 2021-03-10T15:30:01.563215+0000 mgr.gibba045.orlgmj (mgr.34412) 5357 : audit [DBG] from='client.47658 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:30:03.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:30:02 gibba015 bash[29377]: audit 2021-03-10T15:30:01.823170+0000 mon.c (mon.1) 1512 : audit [DBG] from='client.? 172.21.2.115:0/4077081888' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:30:03.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:30:02 gibba015 bash[30343]: audit 2021-03-10T15:30:01.340085+0000 mgr.gibba045.orlgmj (mgr.34412) 5355 : audit [DBG] from='client.57640 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:30:03.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:30:02 gibba015 bash[30343]: cluster 2021-03-10T15:30:01.341539+0000 mgr.gibba045.orlgmj (mgr.34412) 5356 : cluster [DBG] pgmap v3047: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:03.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:30:02 gibba015 bash[30343]: audit 2021-03-10T15:30:01.563215+0000 mgr.gibba045.orlgmj (mgr.34412) 5357 : audit [DBG] from='client.47658 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:30:03.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:30:02 gibba015 bash[30343]: audit 2021-03-10T15:30:01.823170+0000 mon.c (mon.1) 1512 : audit [DBG] from='client.? 172.21.2.115:0/4077081888' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:30:05.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:30:04 gibba045 bash[25517]: cluster 2021-03-10T15:30:03.343148+0000 mgr.gibba045.orlgmj (mgr.34412) 5358 : cluster [DBG] pgmap v3048: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:05.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:30:04 gibba015 bash[29377]: cluster 2021-03-10T15:30:03.343148+0000 mgr.gibba045.orlgmj (mgr.34412) 5358 : cluster [DBG] pgmap v3048: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:05.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:30:04 gibba015 bash[30343]: cluster 2021-03-10T15:30:03.343148+0000 mgr.gibba045.orlgmj (mgr.34412) 5358 : cluster [DBG] pgmap v3048: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:07.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:30:06 gibba015 bash[29377]: cluster 2021-03-10T15:30:05.345016+0000 mgr.gibba045.orlgmj (mgr.34412) 5359 : cluster [DBG] pgmap v3049: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:07.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:30:06 gibba015 bash[29377]: audit 2021-03-10T15:30:06.030113+0000 mon.c (mon.1) 1513 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:30:07.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:30:06 gibba015 bash[29377]: cephadm 2021-03-10T15:30:06.039003+0000 mgr.gibba045.orlgmj (mgr.34412) 5360 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:30:07.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:30:06 gibba015 bash[29377]: cephadm 2021-03-10T15:30:06.040954+0000 mgr.gibba045.orlgmj (mgr.34412) 5361 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:30:07.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:30:06 gibba015 bash[29377]: audit 2021-03-10T15:30:06.242356+0000 mon.a (mon.0) 1400 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:30:07.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:30:06 gibba015 bash[29377]: audit 2021-03-10T15:30:06.245785+0000 mon.c (mon.1) 1514 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:30:07.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:30:06 gibba015 bash[29377]: audit 2021-03-10T15:30:06.247062+0000 mon.c (mon.1) 1515 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:30:07.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:30:06 gibba015 bash[29377]: audit 2021-03-10T15:30:06.248298+0000 mon.c (mon.1) 1516 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:30:07.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:30:06 gibba015 bash[29377]: audit 2021-03-10T15:30:06.249354+0000 mon.c (mon.1) 1517 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:30:07.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:30:06 gibba015 bash[29377]: audit 2021-03-10T15:30:06.252054+0000 mon.c (mon.1) 1518 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:30:07.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:30:06 gibba015 bash[29377]: audit 2021-03-10T15:30:06.253258+0000 mon.c (mon.1) 1519 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:30:07.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:30:06 gibba015 bash[30343]: cluster 2021-03-10T15:30:05.345016+0000 mgr.gibba045.orlgmj (mgr.34412) 5359 : cluster [DBG] pgmap v3049: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:07.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:30:06 gibba015 bash[30343]: audit 2021-03-10T15:30:06.030113+0000 mon.c (mon.1) 1513 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:30:07.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:30:06 gibba015 bash[30343]: cephadm 2021-03-10T15:30:06.039003+0000 mgr.gibba045.orlgmj (mgr.34412) 5360 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:30:07.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:30:06 gibba015 bash[30343]: cephadm 2021-03-10T15:30:06.040954+0000 mgr.gibba045.orlgmj (mgr.34412) 5361 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:30:07.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:30:06 gibba015 bash[30343]: audit 2021-03-10T15:30:06.242356+0000 mon.a (mon.0) 1400 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:30:07.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:30:06 gibba015 bash[30343]: audit 2021-03-10T15:30:06.245785+0000 mon.c (mon.1) 1514 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:30:07.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:30:06 gibba015 bash[30343]: audit 2021-03-10T15:30:06.247062+0000 mon.c (mon.1) 1515 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:30:07.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:30:06 gibba015 bash[30343]: audit 2021-03-10T15:30:06.248298+0000 mon.c (mon.1) 1516 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:30:07.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:30:06 gibba015 bash[30343]: audit 2021-03-10T15:30:06.249354+0000 mon.c (mon.1) 1517 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:30:07.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:30:06 gibba015 bash[30343]: audit 2021-03-10T15:30:06.252054+0000 mon.c (mon.1) 1518 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:30:07.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:30:06 gibba015 bash[30343]: audit 2021-03-10T15:30:06.253258+0000 mon.c (mon.1) 1519 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:30:07.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:30:06 gibba045 bash[25517]: cluster 2021-03-10T15:30:05.345016+0000 mgr.gibba045.orlgmj (mgr.34412) 5359 : cluster [DBG] pgmap v3049: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:07.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:30:06 gibba045 bash[25517]: audit 2021-03-10T15:30:06.030113+0000 mon.c (mon.1) 1513 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:30:07.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:30:06 gibba045 bash[25517]: cephadm 2021-03-10T15:30:06.039003+0000 mgr.gibba045.orlgmj (mgr.34412) 5360 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:30:07.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:30:06 gibba045 bash[25517]: cephadm 2021-03-10T15:30:06.040954+0000 mgr.gibba045.orlgmj (mgr.34412) 5361 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:30:07.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:30:06 gibba045 bash[25517]: audit 2021-03-10T15:30:06.242356+0000 mon.a (mon.0) 1400 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:30:07.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:30:06 gibba045 bash[25517]: audit 2021-03-10T15:30:06.245785+0000 mon.c (mon.1) 1514 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:30:07.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:30:06 gibba045 bash[25517]: audit 2021-03-10T15:30:06.247062+0000 mon.c (mon.1) 1515 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:30:07.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:30:06 gibba045 bash[25517]: audit 2021-03-10T15:30:06.248298+0000 mon.c (mon.1) 1516 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:30:07.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:30:06 gibba045 bash[25517]: audit 2021-03-10T15:30:06.249354+0000 mon.c (mon.1) 1517 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:30:07.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:30:06 gibba045 bash[25517]: audit 2021-03-10T15:30:06.252054+0000 mon.c (mon.1) 1518 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:30:07.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:30:06 gibba045 bash[25517]: audit 2021-03-10T15:30:06.253258+0000 mon.c (mon.1) 1519 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:30:08.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:30:07 gibba015 bash[29377]: cephadm 2021-03-10T15:30:06.249072+0000 mgr.gibba045.orlgmj (mgr.34412) 5362 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:30:08.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:30:07 gibba015 bash[29377]: cephadm 2021-03-10T15:30:06.250506+0000 mgr.gibba045.orlgmj (mgr.34412) 5363 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:30:08.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:30:07 gibba015 bash[29377]: cephadm 2021-03-10T15:30:06.251703+0000 mgr.gibba045.orlgmj (mgr.34412) 5364 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:30:08.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:30:07 gibba015 bash[29377]: cephadm 2021-03-10T15:30:06.251742+0000 mgr.gibba045.orlgmj (mgr.34412) 5365 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:30:08.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:30:07 gibba015 bash[29377]: cephadm 2021-03-10T15:30:06.252865+0000 mgr.gibba045.orlgmj (mgr.34412) 5366 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:30:08.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:30:07 gibba015 bash[29377]: cephadm 2021-03-10T15:30:06.252902+0000 mgr.gibba045.orlgmj (mgr.34412) 5367 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:30:08.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:30:07 gibba015 bash[29377]: cephadm 2021-03-10T15:30:06.253916+0000 mgr.gibba045.orlgmj (mgr.34412) 5368 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:30:08.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:30:07 gibba015 bash[29377]: cephadm 2021-03-10T15:30:06.255550+0000 mgr.gibba045.orlgmj (mgr.34412) 5369 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:30:08.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:30:07 gibba015 bash[29377]: cephadm 2021-03-10T15:30:06.255588+0000 mgr.gibba045.orlgmj (mgr.34412) 5370 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:30:08.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:30:07 gibba015 bash[29377]: cephadm 2021-03-10T15:30:06.256595+0000 mgr.gibba045.orlgmj (mgr.34412) 5371 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:30:08.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:30:07 gibba015 bash[29377]: cephadm 2021-03-10T15:30:06.256917+0000 mgr.gibba045.orlgmj (mgr.34412) 5372 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:30:08.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:30:07 gibba015 bash[29377]: cephadm 2021-03-10T15:30:06.258147+0000 mgr.gibba045.orlgmj (mgr.34412) 5373 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:30:08.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:30:07 gibba015 bash[29377]: cephadm 2021-03-10T15:30:06.258186+0000 mgr.gibba045.orlgmj (mgr.34412) 5374 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:30:08.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:30:07 gibba015 bash[29377]: cephadm 2021-03-10T15:30:06.258292+0000 mgr.gibba045.orlgmj (mgr.34412) 5375 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:30:08.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:30:07 gibba015 bash[30343]: cephadm 2021-03-10T15:30:06.249072+0000 mgr.gibba045.orlgmj (mgr.34412) 5362 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:30:08.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:30:07 gibba015 bash[30343]: cephadm 2021-03-10T15:30:06.250506+0000 mgr.gibba045.orlgmj (mgr.34412) 5363 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:30:08.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:30:07 gibba015 bash[30343]: cephadm 2021-03-10T15:30:06.251703+0000 mgr.gibba045.orlgmj (mgr.34412) 5364 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:30:08.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:30:07 gibba015 bash[30343]: cephadm 2021-03-10T15:30:06.251742+0000 mgr.gibba045.orlgmj (mgr.34412) 5365 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:30:08.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:30:07 gibba015 bash[30343]: cephadm 2021-03-10T15:30:06.252865+0000 mgr.gibba045.orlgmj (mgr.34412) 5366 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:30:08.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:30:07 gibba015 bash[30343]: cephadm 2021-03-10T15:30:06.252902+0000 mgr.gibba045.orlgmj (mgr.34412) 5367 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:30:08.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:30:07 gibba015 bash[30343]: cephadm 2021-03-10T15:30:06.253916+0000 mgr.gibba045.orlgmj (mgr.34412) 5368 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:30:08.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:30:07 gibba015 bash[30343]: cephadm 2021-03-10T15:30:06.255550+0000 mgr.gibba045.orlgmj (mgr.34412) 5369 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:30:08.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:30:07 gibba015 bash[30343]: cephadm 2021-03-10T15:30:06.255588+0000 mgr.gibba045.orlgmj (mgr.34412) 5370 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:30:08.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:30:07 gibba015 bash[30343]: cephadm 2021-03-10T15:30:06.256595+0000 mgr.gibba045.orlgmj (mgr.34412) 5371 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:30:08.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:30:07 gibba015 bash[30343]: cephadm 2021-03-10T15:30:06.256917+0000 mgr.gibba045.orlgmj (mgr.34412) 5372 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:30:08.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:30:07 gibba015 bash[30343]: cephadm 2021-03-10T15:30:06.258147+0000 mgr.gibba045.orlgmj (mgr.34412) 5373 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:30:08.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:30:07 gibba015 bash[30343]: cephadm 2021-03-10T15:30:06.258186+0000 mgr.gibba045.orlgmj (mgr.34412) 5374 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:30:08.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:30:07 gibba015 bash[30343]: cephadm 2021-03-10T15:30:06.258292+0000 mgr.gibba045.orlgmj (mgr.34412) 5375 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:30:08.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:30:07 gibba045 bash[25517]: cephadm 2021-03-10T15:30:06.249072+0000 mgr.gibba045.orlgmj (mgr.34412) 5362 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:30:08.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:30:07 gibba045 bash[25517]: cephadm 2021-03-10T15:30:06.250506+0000 mgr.gibba045.orlgmj (mgr.34412) 5363 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:30:08.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:30:07 gibba045 bash[25517]: cephadm 2021-03-10T15:30:06.251703+0000 mgr.gibba045.orlgmj (mgr.34412) 5364 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:30:08.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:30:07 gibba045 bash[25517]: cephadm 2021-03-10T15:30:06.251742+0000 mgr.gibba045.orlgmj (mgr.34412) 5365 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:30:08.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:30:07 gibba045 bash[25517]: cephadm 2021-03-10T15:30:06.252865+0000 mgr.gibba045.orlgmj (mgr.34412) 5366 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:30:08.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:30:07 gibba045 bash[25517]: cephadm 2021-03-10T15:30:06.252902+0000 mgr.gibba045.orlgmj (mgr.34412) 5367 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:30:08.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:30:07 gibba045 bash[25517]: cephadm 2021-03-10T15:30:06.253916+0000 mgr.gibba045.orlgmj (mgr.34412) 5368 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:30:08.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:30:07 gibba045 bash[25517]: cephadm 2021-03-10T15:30:06.255550+0000 mgr.gibba045.orlgmj (mgr.34412) 5369 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:30:08.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:30:07 gibba045 bash[25517]: cephadm 2021-03-10T15:30:06.255588+0000 mgr.gibba045.orlgmj (mgr.34412) 5370 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:30:08.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:30:07 gibba045 bash[25517]: cephadm 2021-03-10T15:30:06.256595+0000 mgr.gibba045.orlgmj (mgr.34412) 5371 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:30:08.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:30:07 gibba045 bash[25517]: cephadm 2021-03-10T15:30:06.256917+0000 mgr.gibba045.orlgmj (mgr.34412) 5372 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:30:08.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:30:07 gibba045 bash[25517]: cephadm 2021-03-10T15:30:06.258147+0000 mgr.gibba045.orlgmj (mgr.34412) 5373 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:30:08.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:30:07 gibba045 bash[25517]: cephadm 2021-03-10T15:30:06.258186+0000 mgr.gibba045.orlgmj (mgr.34412) 5374 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:30:08.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:30:07 gibba045 bash[25517]: cephadm 2021-03-10T15:30:06.258292+0000 mgr.gibba045.orlgmj (mgr.34412) 5375 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:30:09.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:30:08 gibba015 bash[29377]: cluster 2021-03-10T15:30:07.345979+0000 mgr.gibba045.orlgmj (mgr.34412) 5376 : cluster [DBG] pgmap v3050: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:09.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:30:08 gibba015 bash[30343]: cluster 2021-03-10T15:30:07.345979+0000 mgr.gibba045.orlgmj (mgr.34412) 5376 : cluster [DBG] pgmap v3050: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:09.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:30:08 gibba045 bash[25517]: cluster 2021-03-10T15:30:07.345979+0000 mgr.gibba045.orlgmj (mgr.34412) 5376 : cluster [DBG] pgmap v3050: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:11.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:30:10 gibba015 bash[29377]: cluster 2021-03-10T15:30:09.347239+0000 mgr.gibba045.orlgmj (mgr.34412) 5377 : cluster [DBG] pgmap v3051: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:11.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:30:10 gibba015 bash[30343]: cluster 2021-03-10T15:30:09.347239+0000 mgr.gibba045.orlgmj (mgr.34412) 5377 : cluster [DBG] pgmap v3051: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:11.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:30:10 gibba045 bash[25517]: cluster 2021-03-10T15:30:09.347239+0000 mgr.gibba045.orlgmj (mgr.34412) 5377 : cluster [DBG] pgmap v3051: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:13.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:30:12 gibba015 bash[29377]: cluster 2021-03-10T15:30:11.349110+0000 mgr.gibba045.orlgmj (mgr.34412) 5378 : cluster [DBG] pgmap v3052: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:13.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:30:12 gibba015 bash[30343]: cluster 2021-03-10T15:30:11.349110+0000 mgr.gibba045.orlgmj (mgr.34412) 5378 : cluster [DBG] pgmap v3052: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:13.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:30:12 gibba045 bash[25517]: cluster 2021-03-10T15:30:11.349110+0000 mgr.gibba045.orlgmj (mgr.34412) 5378 : cluster [DBG] pgmap v3052: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:15.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:30:14 gibba015 bash[29377]: cluster 2021-03-10T15:30:13.350729+0000 mgr.gibba045.orlgmj (mgr.34412) 5379 : cluster [DBG] pgmap v3053: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:15.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:30:14 gibba015 bash[30343]: cluster 2021-03-10T15:30:13.350729+0000 mgr.gibba045.orlgmj (mgr.34412) 5379 : cluster [DBG] pgmap v3053: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:15.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:30:14 gibba045 bash[25517]: cluster 2021-03-10T15:30:13.350729+0000 mgr.gibba045.orlgmj (mgr.34412) 5379 : cluster [DBG] pgmap v3053: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:17.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:30:16 gibba015 bash[29377]: cluster 2021-03-10T15:30:15.352413+0000 mgr.gibba045.orlgmj (mgr.34412) 5380 : cluster [DBG] pgmap v3054: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:17.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:30:16 gibba015 bash[30343]: cluster 2021-03-10T15:30:15.352413+0000 mgr.gibba045.orlgmj (mgr.34412) 5380 : cluster [DBG] pgmap v3054: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:17.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:30:16 gibba045 bash[25517]: cluster 2021-03-10T15:30:15.352413+0000 mgr.gibba045.orlgmj (mgr.34412) 5380 : cluster [DBG] pgmap v3054: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:19.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:30:18 gibba015 bash[29377]: cluster 2021-03-10T15:30:17.353031+0000 mgr.gibba045.orlgmj (mgr.34412) 5381 : cluster [DBG] pgmap v3055: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:19.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:30:18 gibba015 bash[30343]: cluster 2021-03-10T15:30:17.353031+0000 mgr.gibba045.orlgmj (mgr.34412) 5381 : cluster [DBG] pgmap v3055: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:19.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:30:18 gibba045 bash[25517]: cluster 2021-03-10T15:30:17.353031+0000 mgr.gibba045.orlgmj (mgr.34412) 5381 : cluster [DBG] pgmap v3055: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:21.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:30:20 gibba015 bash[29377]: cluster 2021-03-10T15:30:19.354244+0000 mgr.gibba045.orlgmj (mgr.34412) 5382 : cluster [DBG] pgmap v3056: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:21.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:30:20 gibba015 bash[30343]: cluster 2021-03-10T15:30:19.354244+0000 mgr.gibba045.orlgmj (mgr.34412) 5382 : cluster [DBG] pgmap v3056: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:21.275 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:30:20 gibba045 bash[25517]: cluster 2021-03-10T15:30:19.354244+0000 mgr.gibba045.orlgmj (mgr.34412) 5382 : cluster [DBG] pgmap v3056: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:23.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:30:22 gibba015 bash[29377]: cephadm 2021-03-10T15:30:21.274264+0000 mgr.gibba045.orlgmj (mgr.34412) 5383 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:30:23.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:30:22 gibba015 bash[29377]: cluster 2021-03-10T15:30:21.355924+0000 mgr.gibba045.orlgmj (mgr.34412) 5384 : cluster [DBG] pgmap v3057: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:23.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:30:22 gibba015 bash[30343]: cephadm 2021-03-10T15:30:21.274264+0000 mgr.gibba045.orlgmj (mgr.34412) 5383 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:30:23.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:30:22 gibba015 bash[30343]: cluster 2021-03-10T15:30:21.355924+0000 mgr.gibba045.orlgmj (mgr.34412) 5384 : cluster [DBG] pgmap v3057: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:23.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:30:22 gibba045 bash[25517]: cephadm 2021-03-10T15:30:21.274264+0000 mgr.gibba045.orlgmj (mgr.34412) 5383 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:30:23.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:30:22 gibba045 bash[25517]: cluster 2021-03-10T15:30:21.355924+0000 mgr.gibba045.orlgmj (mgr.34412) 5384 : cluster [DBG] pgmap v3057: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:25.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:30:24 gibba015 bash[29377]: cluster 2021-03-10T15:30:23.357579+0000 mgr.gibba045.orlgmj (mgr.34412) 5385 : cluster [DBG] pgmap v3058: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:25.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:30:24 gibba015 bash[30343]: cluster 2021-03-10T15:30:23.357579+0000 mgr.gibba045.orlgmj (mgr.34412) 5385 : cluster [DBG] pgmap v3058: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:25.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:30:24 gibba045 bash[25517]: cluster 2021-03-10T15:30:23.357579+0000 mgr.gibba045.orlgmj (mgr.34412) 5385 : cluster [DBG] pgmap v3058: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:27.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:30:26 gibba015 bash[29377]: cluster 2021-03-10T15:30:25.359078+0000 mgr.gibba045.orlgmj (mgr.34412) 5386 : cluster [DBG] pgmap v3059: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:27.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:30:26 gibba015 bash[30343]: cluster 2021-03-10T15:30:25.359078+0000 mgr.gibba045.orlgmj (mgr.34412) 5386 : cluster [DBG] pgmap v3059: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:27.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:30:26 gibba045 bash[25517]: cluster 2021-03-10T15:30:25.359078+0000 mgr.gibba045.orlgmj (mgr.34412) 5386 : cluster [DBG] pgmap v3059: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:29.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:30:28 gibba015 bash[29377]: cluster 2021-03-10T15:30:27.359764+0000 mgr.gibba045.orlgmj (mgr.34412) 5387 : cluster [DBG] pgmap v3060: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:29.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:30:28 gibba015 bash[30343]: cluster 2021-03-10T15:30:27.359764+0000 mgr.gibba045.orlgmj (mgr.34412) 5387 : cluster [DBG] pgmap v3060: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:29.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:30:28 gibba045 bash[25517]: cluster 2021-03-10T15:30:27.359764+0000 mgr.gibba045.orlgmj (mgr.34412) 5387 : cluster [DBG] pgmap v3060: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:31.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:30:30 gibba015 bash[29377]: cluster 2021-03-10T15:30:29.360867+0000 mgr.gibba045.orlgmj (mgr.34412) 5388 : cluster [DBG] pgmap v3061: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:31.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:30:30 gibba015 bash[30343]: cluster 2021-03-10T15:30:29.360867+0000 mgr.gibba045.orlgmj (mgr.34412) 5388 : cluster [DBG] pgmap v3061: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:31.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:30:30 gibba045 bash[25517]: cluster 2021-03-10T15:30:29.360867+0000 mgr.gibba045.orlgmj (mgr.34412) 5388 : cluster [DBG] pgmap v3061: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:32.074 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:30:32.305 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:30:32.305 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (101m) 5m ago 106m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:30:32.305 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (106m) 4m ago 106m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:30:32.306 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (101m) 4m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:30:32.306 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (101m) 4m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:30:32.306 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (100m) 5m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:30:32.306 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (100m) 5m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:30:32.306 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (100m) 4m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:30:32.307 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (100m) 5m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:30:32.307 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (106m) 5m ago 106m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:30:32.307 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (106m) 4m ago 106m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:30:32.307 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (99m) 5m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:30:32.307 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (99m) 5m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:30:32.308 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (98m) 5m ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:30:32.308 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (98m) 5m ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:30:32.308 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (97m) 4m ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:30:32.308 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (97m) 4m ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:30:32.308 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (96m) 4m ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:30:32.309 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (96m) 4m ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:30:32.309 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (106m) 4m ago 106m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:30:32.309 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 4m ago 104m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:30:32.557 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:30:32.557 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:30:32.558 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:30:32.558 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:30:32.558 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:30:32.558 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:30:32.559 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:30:32.559 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:30:32.559 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:30:32.559 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:30:32.560 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:30:32.560 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:30:32.560 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:30:32.560 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:30:32.561 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:30:33.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:30:32 gibba015 bash[29377]: cluster 2021-03-10T15:30:31.362371+0000 mgr.gibba045.orlgmj (mgr.34412) 5389 : cluster [DBG] pgmap v3062: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:33.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:30:32 gibba015 bash[29377]: audit 2021-03-10T15:30:32.552515+0000 mon.a (mon.0) 1401 : audit [DBG] from='client.? 172.21.2.115:0/3217410602' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:30:33.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:30:32 gibba015 bash[30343]: cluster 2021-03-10T15:30:31.362371+0000 mgr.gibba045.orlgmj (mgr.34412) 5389 : cluster [DBG] pgmap v3062: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:33.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:30:32 gibba015 bash[30343]: audit 2021-03-10T15:30:32.552515+0000 mon.a (mon.0) 1401 : audit [DBG] from='client.? 172.21.2.115:0/3217410602' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:30:33.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:30:32 gibba045 bash[25517]: cluster 2021-03-10T15:30:31.362371+0000 mgr.gibba045.orlgmj (mgr.34412) 5389 : cluster [DBG] pgmap v3062: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:33.329 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:30:32 gibba045 bash[25517]: audit 2021-03-10T15:30:32.552515+0000 mon.a (mon.0) 1401 : audit [DBG] from='client.? 172.21.2.115:0/3217410602' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:30:34.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:30:33 gibba015 bash[29377]: audit 2021-03-10T15:30:32.064714+0000 mgr.gibba045.orlgmj (mgr.34412) 5390 : audit [DBG] from='client.47670 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:30:34.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:30:33 gibba015 bash[29377]: audit 2021-03-10T15:30:32.291737+0000 mgr.gibba045.orlgmj (mgr.34412) 5391 : audit [DBG] from='client.47676 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:30:34.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:30:33 gibba015 bash[30343]: audit 2021-03-10T15:30:32.064714+0000 mgr.gibba045.orlgmj (mgr.34412) 5390 : audit [DBG] from='client.47670 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:30:34.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:30:33 gibba015 bash[30343]: audit 2021-03-10T15:30:32.291737+0000 mgr.gibba045.orlgmj (mgr.34412) 5391 : audit [DBG] from='client.47676 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:30:34.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:30:33 gibba045 bash[25517]: audit 2021-03-10T15:30:32.064714+0000 mgr.gibba045.orlgmj (mgr.34412) 5390 : audit [DBG] from='client.47670 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:30:34.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:30:33 gibba045 bash[25517]: audit 2021-03-10T15:30:32.291737+0000 mgr.gibba045.orlgmj (mgr.34412) 5391 : audit [DBG] from='client.47676 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:30:35.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:30:34 gibba015 bash[29377]: cluster 2021-03-10T15:30:33.364080+0000 mgr.gibba045.orlgmj (mgr.34412) 5392 : cluster [DBG] pgmap v3063: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:35.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:30:34 gibba015 bash[30343]: cluster 2021-03-10T15:30:33.364080+0000 mgr.gibba045.orlgmj (mgr.34412) 5392 : cluster [DBG] pgmap v3063: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:35.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:30:34 gibba045 bash[25517]: cluster 2021-03-10T15:30:33.364080+0000 mgr.gibba045.orlgmj (mgr.34412) 5392 : cluster [DBG] pgmap v3063: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:37.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:30:36 gibba015 bash[29377]: cluster 2021-03-10T15:30:35.365783+0000 mgr.gibba045.orlgmj (mgr.34412) 5393 : cluster [DBG] pgmap v3064: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:37.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:30:36 gibba015 bash[30343]: cluster 2021-03-10T15:30:35.365783+0000 mgr.gibba045.orlgmj (mgr.34412) 5393 : cluster [DBG] pgmap v3064: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:37.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:30:36 gibba045 bash[25517]: cluster 2021-03-10T15:30:35.365783+0000 mgr.gibba045.orlgmj (mgr.34412) 5393 : cluster [DBG] pgmap v3064: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:38.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:30:37 gibba015 bash[29377]: cephadm 2021-03-10T15:30:36.289220+0000 mgr.gibba045.orlgmj (mgr.34412) 5394 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:30:38.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:30:37 gibba015 bash[30343]: cephadm 2021-03-10T15:30:36.289220+0000 mgr.gibba045.orlgmj (mgr.34412) 5394 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:30:38.312 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:30:37 gibba045 bash[25517]: cephadm 2021-03-10T15:30:36.289220+0000 mgr.gibba045.orlgmj (mgr.34412) 5394 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:30:39.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:30:38 gibba015 bash[29377]: cluster 2021-03-10T15:30:37.366658+0000 mgr.gibba045.orlgmj (mgr.34412) 5395 : cluster [DBG] pgmap v3065: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:39.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:30:38 gibba015 bash[30343]: cluster 2021-03-10T15:30:37.366658+0000 mgr.gibba045.orlgmj (mgr.34412) 5395 : cluster [DBG] pgmap v3065: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:39.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:30:38 gibba045 bash[25517]: cluster 2021-03-10T15:30:37.366658+0000 mgr.gibba045.orlgmj (mgr.34412) 5395 : cluster [DBG] pgmap v3065: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:41.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:30:40 gibba045 bash[25517]: cluster 2021-03-10T15:30:39.367695+0000 mgr.gibba045.orlgmj (mgr.34412) 5396 : cluster [DBG] pgmap v3066: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:41.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:30:40 gibba015 bash[29377]: cluster 2021-03-10T15:30:39.367695+0000 mgr.gibba045.orlgmj (mgr.34412) 5396 : cluster [DBG] pgmap v3066: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:41.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:30:40 gibba015 bash[30343]: cluster 2021-03-10T15:30:39.367695+0000 mgr.gibba045.orlgmj (mgr.34412) 5396 : cluster [DBG] pgmap v3066: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:43.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:30:42 gibba045 bash[25517]: cluster 2021-03-10T15:30:41.369518+0000 mgr.gibba045.orlgmj (mgr.34412) 5397 : cluster [DBG] pgmap v3067: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:43.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:30:42 gibba015 bash[29377]: cluster 2021-03-10T15:30:41.369518+0000 mgr.gibba045.orlgmj (mgr.34412) 5397 : cluster [DBG] pgmap v3067: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:43.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:30:42 gibba015 bash[30343]: cluster 2021-03-10T15:30:41.369518+0000 mgr.gibba045.orlgmj (mgr.34412) 5397 : cluster [DBG] pgmap v3067: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:45.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:30:44 gibba045 bash[25517]: cluster 2021-03-10T15:30:43.371154+0000 mgr.gibba045.orlgmj (mgr.34412) 5398 : cluster [DBG] pgmap v3068: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:45.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:30:44 gibba015 bash[29377]: cluster 2021-03-10T15:30:43.371154+0000 mgr.gibba045.orlgmj (mgr.34412) 5398 : cluster [DBG] pgmap v3068: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:45.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:30:44 gibba015 bash[30343]: cluster 2021-03-10T15:30:43.371154+0000 mgr.gibba045.orlgmj (mgr.34412) 5398 : cluster [DBG] pgmap v3068: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:47.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:30:47 gibba045 bash[25517]: cluster 2021-03-10T15:30:45.372825+0000 mgr.gibba045.orlgmj (mgr.34412) 5399 : cluster [DBG] pgmap v3069: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:47.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:30:47 gibba015 bash[29377]: cluster 2021-03-10T15:30:45.372825+0000 mgr.gibba045.orlgmj (mgr.34412) 5399 : cluster [DBG] pgmap v3069: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:47.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:30:47 gibba015 bash[30343]: cluster 2021-03-10T15:30:45.372825+0000 mgr.gibba045.orlgmj (mgr.34412) 5399 : cluster [DBG] pgmap v3069: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:49.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:30:49 gibba045 bash[25517]: cluster 2021-03-10T15:30:47.373810+0000 mgr.gibba045.orlgmj (mgr.34412) 5400 : cluster [DBG] pgmap v3070: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:49.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:30:49 gibba015 bash[29377]: cluster 2021-03-10T15:30:47.373810+0000 mgr.gibba045.orlgmj (mgr.34412) 5400 : cluster [DBG] pgmap v3070: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:49.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:30:49 gibba015 bash[30343]: cluster 2021-03-10T15:30:47.373810+0000 mgr.gibba045.orlgmj (mgr.34412) 5400 : cluster [DBG] pgmap v3070: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:51.292 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:30:51 gibba045 bash[25517]: cluster 2021-03-10T15:30:49.374846+0000 mgr.gibba045.orlgmj (mgr.34412) 5401 : cluster [DBG] pgmap v3071: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:51.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:30:51 gibba015 bash[29377]: cluster 2021-03-10T15:30:49.374846+0000 mgr.gibba045.orlgmj (mgr.34412) 5401 : cluster [DBG] pgmap v3071: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:51.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:30:51 gibba015 bash[30343]: cluster 2021-03-10T15:30:49.374846+0000 mgr.gibba045.orlgmj (mgr.34412) 5401 : cluster [DBG] pgmap v3071: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:53.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:30:53 gibba045 bash[25517]: cephadm 2021-03-10T15:30:51.290807+0000 mgr.gibba045.orlgmj (mgr.34412) 5402 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:30:53.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:30:53 gibba045 bash[25517]: cluster 2021-03-10T15:30:51.376408+0000 mgr.gibba045.orlgmj (mgr.34412) 5403 : cluster [DBG] pgmap v3072: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:53.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:30:53 gibba015 bash[29377]: cephadm 2021-03-10T15:30:51.290807+0000 mgr.gibba045.orlgmj (mgr.34412) 5402 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:30:53.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:30:53 gibba015 bash[29377]: cluster 2021-03-10T15:30:51.376408+0000 mgr.gibba045.orlgmj (mgr.34412) 5403 : cluster [DBG] pgmap v3072: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:53.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:30:53 gibba015 bash[30343]: cephadm 2021-03-10T15:30:51.290807+0000 mgr.gibba045.orlgmj (mgr.34412) 5402 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:30:53.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:30:53 gibba015 bash[30343]: cluster 2021-03-10T15:30:51.376408+0000 mgr.gibba045.orlgmj (mgr.34412) 5403 : cluster [DBG] pgmap v3072: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:54.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:30:54 gibba045 bash[25517]: audit 2021-03-10T15:30:53.155616+0000 mon.c (mon.1) 1520 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:30:54.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:30:54 gibba045 bash[25517]: audit 2021-03-10T15:30:53.156533+0000 mon.c (mon.1) 1521 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:30:54.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:30:54 gibba045 bash[25517]: audit 2021-03-10T15:30:53.156815+0000 mon.a (mon.0) 1402 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:30:54.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:30:54 gibba045 bash[25517]: audit 2021-03-10T15:30:53.157445+0000 mon.c (mon.1) 1522 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T15:30:54.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:30:54 gibba045 bash[25517]: audit 2021-03-10T15:30:53.158523+0000 mon.a (mon.0) 1403 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:30:54.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:30:54 gibba045 bash[25517]: audit 2021-03-10T15:30:53.158658+0000 mon.c (mon.1) 1523 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:30:54.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:30:54 gibba045 bash[25517]: audit 2021-03-10T15:30:53.159758+0000 mon.a (mon.0) 1404 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T15:30:54.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:30:54 gibba045 bash[25517]: audit 2021-03-10T15:30:53.159799+0000 mon.c (mon.1) 1524 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:30:54.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:30:54 gibba045 bash[25517]: audit 2021-03-10T15:30:53.160972+0000 mon.c (mon.1) 1525 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:30:54.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:30:54 gibba045 bash[25517]: audit 2021-03-10T15:30:53.161240+0000 mon.a (mon.0) 1405 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:30:54.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:30:54 gibba045 bash[25517]: audit 2021-03-10T15:30:53.161593+0000 mon.a (mon.0) 1406 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:30:54.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:30:54 gibba045 bash[25517]: audit 2021-03-10T15:30:53.161800+0000 mon.a (mon.0) 1407 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:30:54.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:30:54 gibba015 bash[29377]: audit 2021-03-10T15:30:53.155616+0000 mon.c (mon.1) 1520 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:30:54.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:30:54 gibba015 bash[29377]: audit 2021-03-10T15:30:53.156533+0000 mon.c (mon.1) 1521 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:30:54.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:30:54 gibba015 bash[29377]: audit 2021-03-10T15:30:53.156815+0000 mon.a (mon.0) 1402 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:30:54.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:30:54 gibba015 bash[29377]: audit 2021-03-10T15:30:53.157445+0000 mon.c (mon.1) 1522 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T15:30:54.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:30:54 gibba015 bash[29377]: audit 2021-03-10T15:30:53.158523+0000 mon.a (mon.0) 1403 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:30:54.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:30:54 gibba015 bash[29377]: audit 2021-03-10T15:30:53.158658+0000 mon.c (mon.1) 1523 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:30:54.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:30:54 gibba015 bash[29377]: audit 2021-03-10T15:30:53.159758+0000 mon.a (mon.0) 1404 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T15:30:54.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:30:54 gibba015 bash[29377]: audit 2021-03-10T15:30:53.159799+0000 mon.c (mon.1) 1524 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:30:54.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:30:54 gibba015 bash[29377]: audit 2021-03-10T15:30:53.160972+0000 mon.c (mon.1) 1525 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:30:54.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:30:54 gibba015 bash[29377]: audit 2021-03-10T15:30:53.161240+0000 mon.a (mon.0) 1405 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:30:54.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:30:54 gibba015 bash[29377]: audit 2021-03-10T15:30:53.161593+0000 mon.a (mon.0) 1406 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:30:54.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:30:54 gibba015 bash[29377]: audit 2021-03-10T15:30:53.161800+0000 mon.a (mon.0) 1407 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:30:54.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:30:54 gibba015 bash[30343]: audit 2021-03-10T15:30:53.155616+0000 mon.c (mon.1) 1520 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:30:54.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:30:54 gibba015 bash[30343]: audit 2021-03-10T15:30:53.156533+0000 mon.c (mon.1) 1521 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:30:54.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:30:54 gibba015 bash[30343]: audit 2021-03-10T15:30:53.156815+0000 mon.a (mon.0) 1402 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:30:54.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:30:54 gibba015 bash[30343]: audit 2021-03-10T15:30:53.157445+0000 mon.c (mon.1) 1522 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T15:30:54.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:30:54 gibba015 bash[30343]: audit 2021-03-10T15:30:53.158523+0000 mon.a (mon.0) 1403 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:30:54.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:30:54 gibba015 bash[30343]: audit 2021-03-10T15:30:53.158658+0000 mon.c (mon.1) 1523 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:30:54.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:30:54 gibba015 bash[30343]: audit 2021-03-10T15:30:53.159758+0000 mon.a (mon.0) 1404 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T15:30:54.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:30:54 gibba015 bash[30343]: audit 2021-03-10T15:30:53.159799+0000 mon.c (mon.1) 1524 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:30:54.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:30:54 gibba015 bash[30343]: audit 2021-03-10T15:30:53.160972+0000 mon.c (mon.1) 1525 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:30:54.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:30:54 gibba015 bash[30343]: audit 2021-03-10T15:30:53.161240+0000 mon.a (mon.0) 1405 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:30:54.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:30:54 gibba015 bash[30343]: audit 2021-03-10T15:30:53.161593+0000 mon.a (mon.0) 1406 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:30:54.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:30:54 gibba015 bash[30343]: audit 2021-03-10T15:30:53.161800+0000 mon.a (mon.0) 1407 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:30:55.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:30:55 gibba045 bash[25517]: cluster 2021-03-10T15:30:53.378043+0000 mgr.gibba045.orlgmj (mgr.34412) 5404 : cluster [DBG] pgmap v3073: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:55.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:30:55 gibba015 bash[29377]: cluster 2021-03-10T15:30:53.378043+0000 mgr.gibba045.orlgmj (mgr.34412) 5404 : cluster [DBG] pgmap v3073: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:55.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:30:55 gibba015 bash[30343]: cluster 2021-03-10T15:30:53.378043+0000 mgr.gibba045.orlgmj (mgr.34412) 5404 : cluster [DBG] pgmap v3073: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:57.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:30:57 gibba015 bash[29377]: cluster 2021-03-10T15:30:55.379579+0000 mgr.gibba045.orlgmj (mgr.34412) 5405 : cluster [DBG] pgmap v3074: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:57.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:30:57 gibba015 bash[30343]: cluster 2021-03-10T15:30:55.379579+0000 mgr.gibba045.orlgmj (mgr.34412) 5405 : cluster [DBG] pgmap v3074: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:57.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:30:57 gibba045 bash[25517]: cluster 2021-03-10T15:30:55.379579+0000 mgr.gibba045.orlgmj (mgr.34412) 5405 : cluster [DBG] pgmap v3074: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:59.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:30:59 gibba015 bash[29377]: cluster 2021-03-10T15:30:57.380552+0000 mgr.gibba045.orlgmj (mgr.34412) 5406 : cluster [DBG] pgmap v3075: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:59.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:30:59 gibba015 bash[30343]: cluster 2021-03-10T15:30:57.380552+0000 mgr.gibba045.orlgmj (mgr.34412) 5406 : cluster [DBG] pgmap v3075: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:59.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:30:59 gibba045 bash[25517]: cluster 2021-03-10T15:30:57.380552+0000 mgr.gibba045.orlgmj (mgr.34412) 5406 : cluster [DBG] pgmap v3075: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:01.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:31:01 gibba015 bash[29377]: cluster 2021-03-10T15:30:59.381587+0000 mgr.gibba045.orlgmj (mgr.34412) 5407 : cluster [DBG] pgmap v3076: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:01.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:31:01 gibba015 bash[30343]: cluster 2021-03-10T15:30:59.381587+0000 mgr.gibba045.orlgmj (mgr.34412) 5407 : cluster [DBG] pgmap v3076: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:01.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:31:01 gibba045 bash[25517]: cluster 2021-03-10T15:30:59.381587+0000 mgr.gibba045.orlgmj (mgr.34412) 5407 : cluster [DBG] pgmap v3076: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:02.800 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:31:03.059 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:31:03.059 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (101m) 6m ago 107m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:31:03.059 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (106m) 4m ago 106m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:31:03.060 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (102m) 4m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:31:03.060 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (102m) 4m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:31:03.060 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (101m) 6m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:31:03.060 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (101m) 6m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:31:03.061 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (100m) 4m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:31:03.061 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (101m) 6m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:31:03.061 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (107m) 6m ago 107m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:31:03.061 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (107m) 4m ago 107m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:31:03.061 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (100m) 6m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:31:03.062 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (99m) 6m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:31:03.062 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (99m) 6m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:31:03.062 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (98m) 6m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:31:03.062 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (98m) 4m ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:31:03.063 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (97m) 4m ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:31:03.063 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (97m) 4m ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:31:03.063 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (97m) 4m ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:31:03.063 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (106m) 4m ago 107m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:31:03.064 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 4m ago 105m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:31:03.317 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:31:03.317 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:31:03.317 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:31:03.318 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:31:03.318 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:31:03.318 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:31:03.318 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:31:03.319 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:31:03.319 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:31:03.319 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:31:03.319 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:31:03.320 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:31:03.320 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:31:03.320 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:31:03.320 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:31:03.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:31:03 gibba015 bash[29377]: cluster 2021-03-10T15:31:01.383337+0000 mgr.gibba045.orlgmj (mgr.34412) 5408 : cluster [DBG] pgmap v3077: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:03.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:31:03 gibba015 bash[30343]: cluster 2021-03-10T15:31:01.383337+0000 mgr.gibba045.orlgmj (mgr.34412) 5408 : cluster [DBG] pgmap v3077: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:03.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:31:03 gibba045 bash[25517]: cluster 2021-03-10T15:31:01.383337+0000 mgr.gibba045.orlgmj (mgr.34412) 5408 : cluster [DBG] pgmap v3077: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:04.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:31:04 gibba015 bash[29377]: audit 2021-03-10T15:31:02.790642+0000 mgr.gibba045.orlgmj (mgr.34412) 5409 : audit [DBG] from='client.47688 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:31:04.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:31:04 gibba015 bash[29377]: audit 2021-03-10T15:31:03.018642+0000 mgr.gibba045.orlgmj (mgr.34412) 5410 : audit [DBG] from='client.47694 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:31:04.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:31:04 gibba015 bash[29377]: audit 2021-03-10T15:31:03.312431+0000 mon.c (mon.1) 1526 : audit [DBG] from='client.? 172.21.2.115:0/2155182458' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:31:04.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:31:04 gibba015 bash[29377]: cluster 2021-03-10T15:31:03.384891+0000 mgr.gibba045.orlgmj (mgr.34412) 5411 : cluster [DBG] pgmap v3078: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:04.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:31:04 gibba015 bash[30343]: audit 2021-03-10T15:31:02.790642+0000 mgr.gibba045.orlgmj (mgr.34412) 5409 : audit [DBG] from='client.47688 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:31:04.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:31:04 gibba015 bash[30343]: audit 2021-03-10T15:31:03.018642+0000 mgr.gibba045.orlgmj (mgr.34412) 5410 : audit [DBG] from='client.47694 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:31:04.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:31:04 gibba015 bash[30343]: audit 2021-03-10T15:31:03.312431+0000 mon.c (mon.1) 1526 : audit [DBG] from='client.? 172.21.2.115:0/2155182458' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:31:04.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:31:04 gibba015 bash[30343]: cluster 2021-03-10T15:31:03.384891+0000 mgr.gibba045.orlgmj (mgr.34412) 5411 : cluster [DBG] pgmap v3078: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:04.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:31:04 gibba045 bash[25517]: audit 2021-03-10T15:31:02.790642+0000 mgr.gibba045.orlgmj (mgr.34412) 5409 : audit [DBG] from='client.47688 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:31:04.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:31:04 gibba045 bash[25517]: audit 2021-03-10T15:31:03.018642+0000 mgr.gibba045.orlgmj (mgr.34412) 5410 : audit [DBG] from='client.47694 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:31:04.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:31:04 gibba045 bash[25517]: audit 2021-03-10T15:31:03.312431+0000 mon.c (mon.1) 1526 : audit [DBG] from='client.? 172.21.2.115:0/2155182458' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:31:04.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:31:04 gibba045 bash[25517]: cluster 2021-03-10T15:31:03.384891+0000 mgr.gibba045.orlgmj (mgr.34412) 5411 : cluster [DBG] pgmap v3078: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:06.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:31:06 gibba015 bash[29377]: cluster 2021-03-10T15:31:05.386304+0000 mgr.gibba045.orlgmj (mgr.34412) 5412 : cluster [DBG] pgmap v3079: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:06.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:31:06 gibba015 bash[29377]: audit 2021-03-10T15:31:06.304084+0000 mon.c (mon.1) 1527 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:31:06.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:31:06 gibba015 bash[30343]: cluster 2021-03-10T15:31:05.386304+0000 mgr.gibba045.orlgmj (mgr.34412) 5412 : cluster [DBG] pgmap v3079: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:06.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:31:06 gibba015 bash[30343]: audit 2021-03-10T15:31:06.304084+0000 mon.c (mon.1) 1527 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:31:06.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:31:06 gibba045 bash[25517]: cluster 2021-03-10T15:31:05.386304+0000 mgr.gibba045.orlgmj (mgr.34412) 5412 : cluster [DBG] pgmap v3079: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:06.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:31:06 gibba045 bash[25517]: audit 2021-03-10T15:31:06.304084+0000 mon.c (mon.1) 1527 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:31:07.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:31:07 gibba045 bash[25517]: cephadm 2021-03-10T15:31:06.313203+0000 mgr.gibba045.orlgmj (mgr.34412) 5413 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:31:07.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:31:07 gibba045 bash[25517]: cephadm 2021-03-10T15:31:06.315130+0000 mgr.gibba045.orlgmj (mgr.34412) 5414 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:31:07.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:31:07 gibba045 bash[25517]: audit 2021-03-10T15:31:06.515503+0000 mon.a (mon.0) 1408 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:31:07.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:31:07 gibba045 bash[25517]: audit 2021-03-10T15:31:06.519349+0000 mon.c (mon.1) 1528 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:31:07.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:31:07 gibba045 bash[25517]: audit 2021-03-10T15:31:06.521129+0000 mon.c (mon.1) 1529 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:31:07.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:31:07 gibba045 bash[25517]: cephadm 2021-03-10T15:31:06.522375+0000 mgr.gibba045.orlgmj (mgr.34412) 5415 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:31:07.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:31:07 gibba045 bash[25517]: audit 2021-03-10T15:31:06.522689+0000 mon.c (mon.1) 1530 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:31:07.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:31:07 gibba045 bash[25517]: audit 2021-03-10T15:31:06.524247+0000 mon.c (mon.1) 1531 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:31:07.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:31:07 gibba045 bash[25517]: cephadm 2021-03-10T15:31:06.524591+0000 mgr.gibba045.orlgmj (mgr.34412) 5416 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:31:07.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:31:07 gibba045 bash[25517]: cephadm 2021-03-10T15:31:06.526009+0000 mgr.gibba045.orlgmj (mgr.34412) 5417 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:31:07.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:31:07 gibba045 bash[25517]: cephadm 2021-03-10T15:31:06.526047+0000 mgr.gibba045.orlgmj (mgr.34412) 5418 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:31:07.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:31:07 gibba045 bash[25517]: cephadm 2021-03-10T15:31:06.527571+0000 mgr.gibba045.orlgmj (mgr.34412) 5419 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:31:07.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:31:07 gibba045 bash[25517]: audit 2021-03-10T15:31:06.527589+0000 mon.c (mon.1) 1532 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:31:07.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:31:07 gibba045 bash[25517]: cephadm 2021-03-10T15:31:06.527609+0000 mgr.gibba045.orlgmj (mgr.34412) 5420 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:31:07.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:31:07 gibba045 bash[25517]: cephadm 2021-03-10T15:31:06.528898+0000 mgr.gibba045.orlgmj (mgr.34412) 5421 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:31:07.812 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:31:07 gibba045 bash[25517]: audit 2021-03-10T15:31:06.529344+0000 mon.c (mon.1) 1533 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:31:07.812 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:31:07 gibba045 bash[25517]: cephadm 2021-03-10T15:31:06.530845+0000 mgr.gibba045.orlgmj (mgr.34412) 5422 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:31:07.812 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:31:07 gibba045 bash[25517]: cephadm 2021-03-10T15:31:06.530881+0000 mgr.gibba045.orlgmj (mgr.34412) 5423 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:31:07.812 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:31:07 gibba045 bash[25517]: cephadm 2021-03-10T15:31:06.532626+0000 mgr.gibba045.orlgmj (mgr.34412) 5424 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:31:07.812 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:31:07 gibba045 bash[25517]: cephadm 2021-03-10T15:31:06.532937+0000 mgr.gibba045.orlgmj (mgr.34412) 5425 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:31:07.813 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:31:07 gibba045 bash[25517]: cephadm 2021-03-10T15:31:06.534207+0000 mgr.gibba045.orlgmj (mgr.34412) 5426 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:31:07.813 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:31:07 gibba045 bash[25517]: cephadm 2021-03-10T15:31:06.534246+0000 mgr.gibba045.orlgmj (mgr.34412) 5427 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:31:07.813 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:31:07 gibba045 bash[25517]: cephadm 2021-03-10T15:31:06.534351+0000 mgr.gibba045.orlgmj (mgr.34412) 5428 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:31:07.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:31:07 gibba015 bash[29377]: cephadm 2021-03-10T15:31:06.313203+0000 mgr.gibba045.orlgmj (mgr.34412) 5413 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:31:07.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:31:07 gibba015 bash[29377]: cephadm 2021-03-10T15:31:06.315130+0000 mgr.gibba045.orlgmj (mgr.34412) 5414 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:31:07.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:31:07 gibba015 bash[29377]: audit 2021-03-10T15:31:06.515503+0000 mon.a (mon.0) 1408 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:31:07.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:31:07 gibba015 bash[29377]: audit 2021-03-10T15:31:06.519349+0000 mon.c (mon.1) 1528 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:31:07.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:31:07 gibba015 bash[29377]: audit 2021-03-10T15:31:06.521129+0000 mon.c (mon.1) 1529 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:31:07.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:31:07 gibba015 bash[29377]: cephadm 2021-03-10T15:31:06.522375+0000 mgr.gibba045.orlgmj (mgr.34412) 5415 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:31:07.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:31:07 gibba015 bash[29377]: audit 2021-03-10T15:31:06.522689+0000 mon.c (mon.1) 1530 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:31:07.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:31:07 gibba015 bash[29377]: audit 2021-03-10T15:31:06.524247+0000 mon.c (mon.1) 1531 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:31:07.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:31:07 gibba015 bash[29377]: cephadm 2021-03-10T15:31:06.524591+0000 mgr.gibba045.orlgmj (mgr.34412) 5416 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:31:07.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:31:07 gibba015 bash[29377]: cephadm 2021-03-10T15:31:06.526009+0000 mgr.gibba045.orlgmj (mgr.34412) 5417 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:31:07.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:31:07 gibba015 bash[29377]: cephadm 2021-03-10T15:31:06.526047+0000 mgr.gibba045.orlgmj (mgr.34412) 5418 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:31:07.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:31:07 gibba015 bash[29377]: cephadm 2021-03-10T15:31:06.527571+0000 mgr.gibba045.orlgmj (mgr.34412) 5419 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:31:07.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:31:07 gibba015 bash[29377]: audit 2021-03-10T15:31:06.527589+0000 mon.c (mon.1) 1532 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:31:07.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:31:07 gibba015 bash[29377]: cephadm 2021-03-10T15:31:06.527609+0000 mgr.gibba045.orlgmj (mgr.34412) 5420 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:31:07.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:31:07 gibba015 bash[29377]: cephadm 2021-03-10T15:31:06.528898+0000 mgr.gibba045.orlgmj (mgr.34412) 5421 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:31:07.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:31:07 gibba015 bash[29377]: audit 2021-03-10T15:31:06.529344+0000 mon.c (mon.1) 1533 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:31:07.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:31:07 gibba015 bash[29377]: cephadm 2021-03-10T15:31:06.530845+0000 mgr.gibba045.orlgmj (mgr.34412) 5422 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:31:07.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:31:07 gibba015 bash[29377]: cephadm 2021-03-10T15:31:06.530881+0000 mgr.gibba045.orlgmj (mgr.34412) 5423 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:31:07.980 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:31:07 gibba015 bash[29377]: cephadm 2021-03-10T15:31:06.532626+0000 mgr.gibba045.orlgmj (mgr.34412) 5424 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:31:07.980 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:31:07 gibba015 bash[29377]: cephadm 2021-03-10T15:31:06.532937+0000 mgr.gibba045.orlgmj (mgr.34412) 5425 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:31:07.980 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:31:07 gibba015 bash[29377]: cephadm 2021-03-10T15:31:06.534207+0000 mgr.gibba045.orlgmj (mgr.34412) 5426 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:31:07.980 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:31:07 gibba015 bash[29377]: cephadm 2021-03-10T15:31:06.534246+0000 mgr.gibba045.orlgmj (mgr.34412) 5427 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:31:07.980 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:31:07 gibba015 bash[29377]: cephadm 2021-03-10T15:31:06.534351+0000 mgr.gibba045.orlgmj (mgr.34412) 5428 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:31:07.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:31:07 gibba015 bash[30343]: cephadm 2021-03-10T15:31:06.313203+0000 mgr.gibba045.orlgmj (mgr.34412) 5413 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:31:07.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:31:07 gibba015 bash[30343]: cephadm 2021-03-10T15:31:06.315130+0000 mgr.gibba045.orlgmj (mgr.34412) 5414 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:31:07.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:31:07 gibba015 bash[30343]: audit 2021-03-10T15:31:06.515503+0000 mon.a (mon.0) 1408 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:31:07.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:31:07 gibba015 bash[30343]: audit 2021-03-10T15:31:06.519349+0000 mon.c (mon.1) 1528 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:31:07.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:31:07 gibba015 bash[30343]: audit 2021-03-10T15:31:06.521129+0000 mon.c (mon.1) 1529 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:31:07.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:31:07 gibba015 bash[30343]: cephadm 2021-03-10T15:31:06.522375+0000 mgr.gibba045.orlgmj (mgr.34412) 5415 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:31:07.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:31:07 gibba015 bash[30343]: audit 2021-03-10T15:31:06.522689+0000 mon.c (mon.1) 1530 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:31:07.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:31:07 gibba015 bash[30343]: audit 2021-03-10T15:31:06.524247+0000 mon.c (mon.1) 1531 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:31:07.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:31:07 gibba015 bash[30343]: cephadm 2021-03-10T15:31:06.524591+0000 mgr.gibba045.orlgmj (mgr.34412) 5416 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:31:07.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:31:07 gibba015 bash[30343]: cephadm 2021-03-10T15:31:06.526009+0000 mgr.gibba045.orlgmj (mgr.34412) 5417 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:31:07.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:31:07 gibba015 bash[30343]: cephadm 2021-03-10T15:31:06.526047+0000 mgr.gibba045.orlgmj (mgr.34412) 5418 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:31:07.984 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:31:07 gibba015 bash[30343]: cephadm 2021-03-10T15:31:06.527571+0000 mgr.gibba045.orlgmj (mgr.34412) 5419 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:31:07.984 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:31:07 gibba015 bash[30343]: audit 2021-03-10T15:31:06.527589+0000 mon.c (mon.1) 1532 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:31:07.984 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:31:07 gibba015 bash[30343]: cephadm 2021-03-10T15:31:06.527609+0000 mgr.gibba045.orlgmj (mgr.34412) 5420 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:31:07.984 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:31:07 gibba015 bash[30343]: cephadm 2021-03-10T15:31:06.528898+0000 mgr.gibba045.orlgmj (mgr.34412) 5421 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:31:07.985 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:31:07 gibba015 bash[30343]: audit 2021-03-10T15:31:06.529344+0000 mon.c (mon.1) 1533 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:31:07.985 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:31:07 gibba015 bash[30343]: cephadm 2021-03-10T15:31:06.530845+0000 mgr.gibba045.orlgmj (mgr.34412) 5422 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:31:07.985 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:31:07 gibba015 bash[30343]: cephadm 2021-03-10T15:31:06.530881+0000 mgr.gibba045.orlgmj (mgr.34412) 5423 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:31:07.985 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:31:07 gibba015 bash[30343]: cephadm 2021-03-10T15:31:06.532626+0000 mgr.gibba045.orlgmj (mgr.34412) 5424 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:31:07.986 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:31:07 gibba015 bash[30343]: cephadm 2021-03-10T15:31:06.532937+0000 mgr.gibba045.orlgmj (mgr.34412) 5425 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:31:07.986 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:31:07 gibba015 bash[30343]: cephadm 2021-03-10T15:31:06.534207+0000 mgr.gibba045.orlgmj (mgr.34412) 5426 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:31:07.986 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:31:07 gibba015 bash[30343]: cephadm 2021-03-10T15:31:06.534246+0000 mgr.gibba045.orlgmj (mgr.34412) 5427 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:31:07.986 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:31:07 gibba015 bash[30343]: cephadm 2021-03-10T15:31:06.534351+0000 mgr.gibba045.orlgmj (mgr.34412) 5428 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:31:08.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:31:08 gibba045 bash[25517]: cluster 2021-03-10T15:31:07.387267+0000 mgr.gibba045.orlgmj (mgr.34412) 5429 : cluster [DBG] pgmap v3080: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:08.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:31:08 gibba015 bash[29377]: cluster 2021-03-10T15:31:07.387267+0000 mgr.gibba045.orlgmj (mgr.34412) 5429 : cluster [DBG] pgmap v3080: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:08.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:31:08 gibba015 bash[30343]: cluster 2021-03-10T15:31:07.387267+0000 mgr.gibba045.orlgmj (mgr.34412) 5429 : cluster [DBG] pgmap v3080: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:10.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:31:10 gibba045 bash[25517]: cluster 2021-03-10T15:31:09.388296+0000 mgr.gibba045.orlgmj (mgr.34412) 5430 : cluster [DBG] pgmap v3081: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:10.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:31:10 gibba015 bash[29377]: cluster 2021-03-10T15:31:09.388296+0000 mgr.gibba045.orlgmj (mgr.34412) 5430 : cluster [DBG] pgmap v3081: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:10.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:31:10 gibba015 bash[30343]: cluster 2021-03-10T15:31:09.388296+0000 mgr.gibba045.orlgmj (mgr.34412) 5430 : cluster [DBG] pgmap v3081: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:12.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:31:12 gibba015 bash[29377]: cluster 2021-03-10T15:31:11.390206+0000 mgr.gibba045.orlgmj (mgr.34412) 5431 : cluster [DBG] pgmap v3082: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:12.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:31:12 gibba015 bash[30343]: cluster 2021-03-10T15:31:11.390206+0000 mgr.gibba045.orlgmj (mgr.34412) 5431 : cluster [DBG] pgmap v3082: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:13.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:31:12 gibba045 bash[25517]: cluster 2021-03-10T15:31:11.390206+0000 mgr.gibba045.orlgmj (mgr.34412) 5431 : cluster [DBG] pgmap v3082: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:14.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:31:14 gibba015 bash[29377]: cluster 2021-03-10T15:31:13.391529+0000 mgr.gibba045.orlgmj (mgr.34412) 5432 : cluster [DBG] pgmap v3083: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:14.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:31:14 gibba015 bash[30343]: cluster 2021-03-10T15:31:13.391529+0000 mgr.gibba045.orlgmj (mgr.34412) 5432 : cluster [DBG] pgmap v3083: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:15.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:31:14 gibba045 bash[25517]: cluster 2021-03-10T15:31:13.391529+0000 mgr.gibba045.orlgmj (mgr.34412) 5432 : cluster [DBG] pgmap v3083: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:16.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:31:16 gibba015 bash[29377]: cluster 2021-03-10T15:31:15.393294+0000 mgr.gibba045.orlgmj (mgr.34412) 5433 : cluster [DBG] pgmap v3084: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:16.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:31:16 gibba015 bash[30343]: cluster 2021-03-10T15:31:15.393294+0000 mgr.gibba045.orlgmj (mgr.34412) 5433 : cluster [DBG] pgmap v3084: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:17.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:31:16 gibba045 bash[25517]: cluster 2021-03-10T15:31:15.393294+0000 mgr.gibba045.orlgmj (mgr.34412) 5433 : cluster [DBG] pgmap v3084: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:18.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:31:18 gibba015 bash[29377]: cluster 2021-03-10T15:31:17.394304+0000 mgr.gibba045.orlgmj (mgr.34412) 5434 : cluster [DBG] pgmap v3085: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:18.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:31:18 gibba015 bash[30343]: cluster 2021-03-10T15:31:17.394304+0000 mgr.gibba045.orlgmj (mgr.34412) 5434 : cluster [DBG] pgmap v3085: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:19.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:31:18 gibba045 bash[25517]: cluster 2021-03-10T15:31:17.394304+0000 mgr.gibba045.orlgmj (mgr.34412) 5434 : cluster [DBG] pgmap v3085: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:20.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:31:20 gibba015 bash[29377]: cluster 2021-03-10T15:31:19.395401+0000 mgr.gibba045.orlgmj (mgr.34412) 5435 : cluster [DBG] pgmap v3086: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:20.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:31:20 gibba015 bash[30343]: cluster 2021-03-10T15:31:19.395401+0000 mgr.gibba045.orlgmj (mgr.34412) 5435 : cluster [DBG] pgmap v3086: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:21.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:31:20 gibba045 bash[25517]: cluster 2021-03-10T15:31:19.395401+0000 mgr.gibba045.orlgmj (mgr.34412) 5435 : cluster [DBG] pgmap v3086: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:22.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:31:22 gibba015 bash[29377]: cluster 2021-03-10T15:31:21.397422+0000 mgr.gibba045.orlgmj (mgr.34412) 5436 : cluster [DBG] pgmap v3087: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:22.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:31:22 gibba015 bash[29377]: cephadm 2021-03-10T15:31:21.550128+0000 mgr.gibba045.orlgmj (mgr.34412) 5437 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:31:22.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:31:22 gibba015 bash[30343]: cluster 2021-03-10T15:31:21.397422+0000 mgr.gibba045.orlgmj (mgr.34412) 5436 : cluster [DBG] pgmap v3087: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:22.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:31:22 gibba015 bash[30343]: cephadm 2021-03-10T15:31:21.550128+0000 mgr.gibba045.orlgmj (mgr.34412) 5437 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:31:23.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:31:22 gibba045 bash[25517]: cluster 2021-03-10T15:31:21.397422+0000 mgr.gibba045.orlgmj (mgr.34412) 5436 : cluster [DBG] pgmap v3087: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:23.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:31:22 gibba045 bash[25517]: cephadm 2021-03-10T15:31:21.550128+0000 mgr.gibba045.orlgmj (mgr.34412) 5437 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:31:24.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:31:24 gibba015 bash[29377]: cluster 2021-03-10T15:31:23.398952+0000 mgr.gibba045.orlgmj (mgr.34412) 5438 : cluster [DBG] pgmap v3088: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:24.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:31:24 gibba015 bash[30343]: cluster 2021-03-10T15:31:23.398952+0000 mgr.gibba045.orlgmj (mgr.34412) 5438 : cluster [DBG] pgmap v3088: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:25.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:31:24 gibba045 bash[25517]: cluster 2021-03-10T15:31:23.398952+0000 mgr.gibba045.orlgmj (mgr.34412) 5438 : cluster [DBG] pgmap v3088: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:26.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:31:26 gibba015 bash[29377]: cluster 2021-03-10T15:31:25.400744+0000 mgr.gibba045.orlgmj (mgr.34412) 5439 : cluster [DBG] pgmap v3089: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:26.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:31:26 gibba015 bash[30343]: cluster 2021-03-10T15:31:25.400744+0000 mgr.gibba045.orlgmj (mgr.34412) 5439 : cluster [DBG] pgmap v3089: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:27.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:31:26 gibba045 bash[25517]: cluster 2021-03-10T15:31:25.400744+0000 mgr.gibba045.orlgmj (mgr.34412) 5439 : cluster [DBG] pgmap v3089: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:28.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:31:28 gibba015 bash[29377]: cluster 2021-03-10T15:31:27.401861+0000 mgr.gibba045.orlgmj (mgr.34412) 5440 : cluster [DBG] pgmap v3090: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:28.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:31:28 gibba015 bash[30343]: cluster 2021-03-10T15:31:27.401861+0000 mgr.gibba045.orlgmj (mgr.34412) 5440 : cluster [DBG] pgmap v3090: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:29.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:31:28 gibba045 bash[25517]: cluster 2021-03-10T15:31:27.401861+0000 mgr.gibba045.orlgmj (mgr.34412) 5440 : cluster [DBG] pgmap v3090: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:30.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:31:30 gibba015 bash[29377]: cluster 2021-03-10T15:31:29.402918+0000 mgr.gibba045.orlgmj (mgr.34412) 5441 : cluster [DBG] pgmap v3091: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:30.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:31:30 gibba015 bash[30343]: cluster 2021-03-10T15:31:29.402918+0000 mgr.gibba045.orlgmj (mgr.34412) 5441 : cluster [DBG] pgmap v3091: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:31.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:31:30 gibba045 bash[25517]: cluster 2021-03-10T15:31:29.402918+0000 mgr.gibba045.orlgmj (mgr.34412) 5441 : cluster [DBG] pgmap v3091: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:32.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:31:32 gibba015 bash[29377]: cluster 2021-03-10T15:31:31.404969+0000 mgr.gibba045.orlgmj (mgr.34412) 5442 : cluster [DBG] pgmap v3092: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:32.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:31:32 gibba015 bash[30343]: cluster 2021-03-10T15:31:31.404969+0000 mgr.gibba045.orlgmj (mgr.34412) 5442 : cluster [DBG] pgmap v3092: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:33.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:31:32 gibba045 bash[25517]: cluster 2021-03-10T15:31:31.404969+0000 mgr.gibba045.orlgmj (mgr.34412) 5442 : cluster [DBG] pgmap v3092: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:33.561 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:31:33.786 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:31:33.786 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (102m) 6m ago 107m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:31:33.787 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (107m) 5m ago 107m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:31:33.787 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (102m) 5m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:31:33.787 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (103m) 5m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:31:33.787 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (101m) 6m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:31:33.788 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (101m) 6m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:31:33.788 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (101m) 5m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:31:33.788 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (101m) 6m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:31:33.788 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (107m) 6m ago 107m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:31:33.789 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (107m) 5m ago 107m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:31:33.789 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (100m) 6m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:31:33.789 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (100m) 6m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:31:33.789 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (99m) 6m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:31:33.789 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (99m) 6m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:31:33.790 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (98m) 5m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:31:33.790 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (98m) 5m ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:31:33.790 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (98m) 5m ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:31:33.790 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (97m) 5m ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:31:33.791 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (107m) 5m ago 107m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:31:33.791 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 5m ago 105m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:31:34.035 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:31:34.035 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:31:34.035 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:31:34.036 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:31:34.036 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:31:34.036 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:31:34.036 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:31:34.037 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:31:34.037 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:31:34.037 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:31:34.037 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:31:34.037 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:31:34.038 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:31:34.038 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:31:34.038 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:31:34.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:31:34 gibba015 bash[29377]: cluster 2021-03-10T15:31:33.406141+0000 mgr.gibba045.orlgmj (mgr.34412) 5443 : cluster [DBG] pgmap v3093: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:34.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:31:34 gibba015 bash[29377]: audit 2021-03-10T15:31:33.550225+0000 mgr.gibba045.orlgmj (mgr.34412) 5444 : audit [DBG] from='client.47706 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:31:34.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:31:34 gibba015 bash[29377]: audit 2021-03-10T15:31:33.773166+0000 mgr.gibba045.orlgmj (mgr.34412) 5445 : audit [DBG] from='client.57700 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:31:34.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:31:34 gibba015 bash[29377]: audit 2021-03-10T15:31:34.030085+0000 mon.a (mon.0) 1409 : audit [DBG] from='client.? 172.21.2.115:0/433889570' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:31:34.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:31:34 gibba015 bash[30343]: cluster 2021-03-10T15:31:33.406141+0000 mgr.gibba045.orlgmj (mgr.34412) 5443 : cluster [DBG] pgmap v3093: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:34.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:31:34 gibba015 bash[30343]: audit 2021-03-10T15:31:33.550225+0000 mgr.gibba045.orlgmj (mgr.34412) 5444 : audit [DBG] from='client.47706 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:31:34.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:31:34 gibba015 bash[30343]: audit 2021-03-10T15:31:33.773166+0000 mgr.gibba045.orlgmj (mgr.34412) 5445 : audit [DBG] from='client.57700 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:31:34.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:31:34 gibba015 bash[30343]: audit 2021-03-10T15:31:34.030085+0000 mon.a (mon.0) 1409 : audit [DBG] from='client.? 172.21.2.115:0/433889570' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:31:35.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:31:34 gibba045 bash[25517]: cluster 2021-03-10T15:31:33.406141+0000 mgr.gibba045.orlgmj (mgr.34412) 5443 : cluster [DBG] pgmap v3093: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:35.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:31:34 gibba045 bash[25517]: audit 2021-03-10T15:31:33.550225+0000 mgr.gibba045.orlgmj (mgr.34412) 5444 : audit [DBG] from='client.47706 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:31:35.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:31:34 gibba045 bash[25517]: audit 2021-03-10T15:31:33.773166+0000 mgr.gibba045.orlgmj (mgr.34412) 5445 : audit [DBG] from='client.57700 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:31:35.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:31:34 gibba045 bash[25517]: audit 2021-03-10T15:31:34.030085+0000 mon.a (mon.0) 1409 : audit [DBG] from='client.? 172.21.2.115:0/433889570' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:31:36.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:31:36 gibba015 bash[29377]: cluster 2021-03-10T15:31:35.407779+0000 mgr.gibba045.orlgmj (mgr.34412) 5446 : cluster [DBG] pgmap v3094: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:36.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:31:36 gibba015 bash[30343]: cluster 2021-03-10T15:31:35.407779+0000 mgr.gibba045.orlgmj (mgr.34412) 5446 : cluster [DBG] pgmap v3094: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:37.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:31:36 gibba045 bash[25517]: cluster 2021-03-10T15:31:35.407779+0000 mgr.gibba045.orlgmj (mgr.34412) 5446 : cluster [DBG] pgmap v3094: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:37.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:31:37 gibba015 bash[29377]: cephadm 2021-03-10T15:31:36.566162+0000 mgr.gibba045.orlgmj (mgr.34412) 5447 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:31:37.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:31:37 gibba015 bash[30343]: cephadm 2021-03-10T15:31:36.566162+0000 mgr.gibba045.orlgmj (mgr.34412) 5447 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:31:38.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:31:37 gibba045 bash[25517]: cephadm 2021-03-10T15:31:36.566162+0000 mgr.gibba045.orlgmj (mgr.34412) 5447 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:31:38.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:31:38 gibba015 bash[29377]: cluster 2021-03-10T15:31:37.408521+0000 mgr.gibba045.orlgmj (mgr.34412) 5448 : cluster [DBG] pgmap v3095: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:38.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:31:38 gibba015 bash[30343]: cluster 2021-03-10T15:31:37.408521+0000 mgr.gibba045.orlgmj (mgr.34412) 5448 : cluster [DBG] pgmap v3095: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:39.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:31:38 gibba045 bash[25517]: cluster 2021-03-10T15:31:37.408521+0000 mgr.gibba045.orlgmj (mgr.34412) 5448 : cluster [DBG] pgmap v3095: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:40.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:31:40 gibba015 bash[29377]: cluster 2021-03-10T15:31:39.409568+0000 mgr.gibba045.orlgmj (mgr.34412) 5449 : cluster [DBG] pgmap v3096: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:40.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:31:40 gibba015 bash[30343]: cluster 2021-03-10T15:31:39.409568+0000 mgr.gibba045.orlgmj (mgr.34412) 5449 : cluster [DBG] pgmap v3096: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:41.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:31:40 gibba045 bash[25517]: cluster 2021-03-10T15:31:39.409568+0000 mgr.gibba045.orlgmj (mgr.34412) 5449 : cluster [DBG] pgmap v3096: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:42.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:31:42 gibba015 bash[29377]: cluster 2021-03-10T15:31:41.411547+0000 mgr.gibba045.orlgmj (mgr.34412) 5450 : cluster [DBG] pgmap v3097: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:42.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:31:42 gibba015 bash[30343]: cluster 2021-03-10T15:31:41.411547+0000 mgr.gibba045.orlgmj (mgr.34412) 5450 : cluster [DBG] pgmap v3097: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:43.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:31:42 gibba045 bash[25517]: cluster 2021-03-10T15:31:41.411547+0000 mgr.gibba045.orlgmj (mgr.34412) 5450 : cluster [DBG] pgmap v3097: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:44.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:31:44 gibba015 bash[29377]: cluster 2021-03-10T15:31:43.412625+0000 mgr.gibba045.orlgmj (mgr.34412) 5451 : cluster [DBG] pgmap v3098: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:44.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:31:44 gibba015 bash[30343]: cluster 2021-03-10T15:31:43.412625+0000 mgr.gibba045.orlgmj (mgr.34412) 5451 : cluster [DBG] pgmap v3098: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:45.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:31:44 gibba045 bash[25517]: cluster 2021-03-10T15:31:43.412625+0000 mgr.gibba045.orlgmj (mgr.34412) 5451 : cluster [DBG] pgmap v3098: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:46.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:31:46 gibba015 bash[29377]: cluster 2021-03-10T15:31:45.414272+0000 mgr.gibba045.orlgmj (mgr.34412) 5452 : cluster [DBG] pgmap v3099: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:46.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:31:46 gibba015 bash[30343]: cluster 2021-03-10T15:31:45.414272+0000 mgr.gibba045.orlgmj (mgr.34412) 5452 : cluster [DBG] pgmap v3099: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:47.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:31:46 gibba045 bash[25517]: cluster 2021-03-10T15:31:45.414272+0000 mgr.gibba045.orlgmj (mgr.34412) 5452 : cluster [DBG] pgmap v3099: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:48.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:31:48 gibba015 bash[29377]: cluster 2021-03-10T15:31:47.415283+0000 mgr.gibba045.orlgmj (mgr.34412) 5453 : cluster [DBG] pgmap v3100: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:48.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:31:48 gibba015 bash[30343]: cluster 2021-03-10T15:31:47.415283+0000 mgr.gibba045.orlgmj (mgr.34412) 5453 : cluster [DBG] pgmap v3100: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:49.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:31:48 gibba045 bash[25517]: cluster 2021-03-10T15:31:47.415283+0000 mgr.gibba045.orlgmj (mgr.34412) 5453 : cluster [DBG] pgmap v3100: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:51.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:31:50 gibba045 bash[25517]: cluster 2021-03-10T15:31:49.416352+0000 mgr.gibba045.orlgmj (mgr.34412) 5454 : cluster [DBG] pgmap v3101: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:51.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:31:50 gibba015 bash[29377]: cluster 2021-03-10T15:31:49.416352+0000 mgr.gibba045.orlgmj (mgr.34412) 5454 : cluster [DBG] pgmap v3101: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:51.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:31:50 gibba015 bash[30343]: cluster 2021-03-10T15:31:49.416352+0000 mgr.gibba045.orlgmj (mgr.34412) 5454 : cluster [DBG] pgmap v3101: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:53.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:31:52 gibba045 bash[25517]: cluster 2021-03-10T15:31:51.418149+0000 mgr.gibba045.orlgmj (mgr.34412) 5455 : cluster [DBG] pgmap v3102: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:53.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:31:52 gibba045 bash[25517]: cephadm 2021-03-10T15:31:51.582252+0000 mgr.gibba045.orlgmj (mgr.34412) 5456 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:31:53.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:31:52 gibba015 bash[29377]: cluster 2021-03-10T15:31:51.418149+0000 mgr.gibba045.orlgmj (mgr.34412) 5455 : cluster [DBG] pgmap v3102: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:53.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:31:52 gibba015 bash[29377]: cephadm 2021-03-10T15:31:51.582252+0000 mgr.gibba045.orlgmj (mgr.34412) 5456 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:31:53.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:31:52 gibba015 bash[30343]: cluster 2021-03-10T15:31:51.418149+0000 mgr.gibba045.orlgmj (mgr.34412) 5455 : cluster [DBG] pgmap v3102: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:53.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:31:52 gibba015 bash[30343]: cephadm 2021-03-10T15:31:51.582252+0000 mgr.gibba045.orlgmj (mgr.34412) 5456 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:31:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:31:53 gibba045 bash[25517]: audit 2021-03-10T15:31:53.161742+0000 mon.c (mon.1) 1534 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:31:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:31:53 gibba045 bash[25517]: audit 2021-03-10T15:31:53.162683+0000 mon.c (mon.1) 1535 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:31:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:31:53 gibba045 bash[25517]: audit 2021-03-10T15:31:53.162969+0000 mon.a (mon.0) 1410 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:31:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:31:53 gibba045 bash[25517]: audit 2021-03-10T15:31:53.163814+0000 mon.c (mon.1) 1536 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T15:31:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:31:53 gibba045 bash[25517]: audit 2021-03-10T15:31:53.164168+0000 mon.a (mon.0) 1411 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:31:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:31:53 gibba045 bash[25517]: audit 2021-03-10T15:31:53.165142+0000 mon.a (mon.0) 1412 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T15:31:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:31:53 gibba045 bash[25517]: audit 2021-03-10T15:31:53.165155+0000 mon.c (mon.1) 1537 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:31:54.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:31:53 gibba045 bash[25517]: audit 2021-03-10T15:31:53.165853+0000 mon.a (mon.0) 1413 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:31:54.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:31:53 gibba045 bash[25517]: audit 2021-03-10T15:31:53.165858+0000 mon.c (mon.1) 1538 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:31:54.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:31:53 gibba045 bash[25517]: audit 2021-03-10T15:31:53.166201+0000 mon.c (mon.1) 1539 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:31:54.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:31:53 gibba045 bash[25517]: audit 2021-03-10T15:31:53.166292+0000 mon.a (mon.0) 1414 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:31:54.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:31:53 gibba045 bash[25517]: audit 2021-03-10T15:31:53.166450+0000 mon.a (mon.0) 1415 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:31:54.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:31:53 gibba015 bash[29377]: audit 2021-03-10T15:31:53.161742+0000 mon.c (mon.1) 1534 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:31:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:31:53 gibba015 bash[29377]: audit 2021-03-10T15:31:53.162683+0000 mon.c (mon.1) 1535 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:31:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:31:53 gibba015 bash[29377]: audit 2021-03-10T15:31:53.162969+0000 mon.a (mon.0) 1410 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:31:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:31:53 gibba015 bash[29377]: audit 2021-03-10T15:31:53.163814+0000 mon.c (mon.1) 1536 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T15:31:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:31:53 gibba015 bash[29377]: audit 2021-03-10T15:31:53.164168+0000 mon.a (mon.0) 1411 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:31:54.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:31:53 gibba015 bash[29377]: audit 2021-03-10T15:31:53.165142+0000 mon.a (mon.0) 1412 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T15:31:54.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:31:53 gibba015 bash[29377]: audit 2021-03-10T15:31:53.165155+0000 mon.c (mon.1) 1537 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:31:54.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:31:53 gibba015 bash[29377]: audit 2021-03-10T15:31:53.165853+0000 mon.a (mon.0) 1413 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:31:54.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:31:53 gibba015 bash[29377]: audit 2021-03-10T15:31:53.165858+0000 mon.c (mon.1) 1538 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:31:54.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:31:53 gibba015 bash[29377]: audit 2021-03-10T15:31:53.166201+0000 mon.c (mon.1) 1539 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:31:54.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:31:53 gibba015 bash[29377]: audit 2021-03-10T15:31:53.166292+0000 mon.a (mon.0) 1414 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:31:54.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:31:53 gibba015 bash[29377]: audit 2021-03-10T15:31:53.166450+0000 mon.a (mon.0) 1415 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:31:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:31:53 gibba015 bash[30343]: audit 2021-03-10T15:31:53.161742+0000 mon.c (mon.1) 1534 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:31:54.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:31:53 gibba015 bash[30343]: audit 2021-03-10T15:31:53.162683+0000 mon.c (mon.1) 1535 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:31:54.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:31:53 gibba015 bash[30343]: audit 2021-03-10T15:31:53.162969+0000 mon.a (mon.0) 1410 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:31:54.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:31:53 gibba015 bash[30343]: audit 2021-03-10T15:31:53.163814+0000 mon.c (mon.1) 1536 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T15:31:54.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:31:53 gibba015 bash[30343]: audit 2021-03-10T15:31:53.164168+0000 mon.a (mon.0) 1411 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:31:54.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:31:53 gibba015 bash[30343]: audit 2021-03-10T15:31:53.165142+0000 mon.a (mon.0) 1412 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T15:31:54.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:31:53 gibba015 bash[30343]: audit 2021-03-10T15:31:53.165155+0000 mon.c (mon.1) 1537 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:31:54.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:31:53 gibba015 bash[30343]: audit 2021-03-10T15:31:53.165853+0000 mon.a (mon.0) 1413 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:31:54.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:31:53 gibba015 bash[30343]: audit 2021-03-10T15:31:53.165858+0000 mon.c (mon.1) 1538 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:31:54.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:31:53 gibba015 bash[30343]: audit 2021-03-10T15:31:53.166201+0000 mon.c (mon.1) 1539 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:31:54.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:31:53 gibba015 bash[30343]: audit 2021-03-10T15:31:53.166292+0000 mon.a (mon.0) 1414 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:31:54.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:31:53 gibba015 bash[30343]: audit 2021-03-10T15:31:53.166450+0000 mon.a (mon.0) 1415 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:31:55.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:31:54 gibba045 bash[25517]: cluster 2021-03-10T15:31:53.419182+0000 mgr.gibba045.orlgmj (mgr.34412) 5457 : cluster [DBG] pgmap v3103: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:55.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:31:54 gibba015 bash[29377]: cluster 2021-03-10T15:31:53.419182+0000 mgr.gibba045.orlgmj (mgr.34412) 5457 : cluster [DBG] pgmap v3103: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:55.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:31:54 gibba015 bash[30343]: cluster 2021-03-10T15:31:53.419182+0000 mgr.gibba045.orlgmj (mgr.34412) 5457 : cluster [DBG] pgmap v3103: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:57.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:31:56 gibba045 bash[25517]: cluster 2021-03-10T15:31:55.420863+0000 mgr.gibba045.orlgmj (mgr.34412) 5458 : cluster [DBG] pgmap v3104: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:57.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:31:56 gibba015 bash[29377]: cluster 2021-03-10T15:31:55.420863+0000 mgr.gibba045.orlgmj (mgr.34412) 5458 : cluster [DBG] pgmap v3104: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:57.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:31:56 gibba015 bash[30343]: cluster 2021-03-10T15:31:55.420863+0000 mgr.gibba045.orlgmj (mgr.34412) 5458 : cluster [DBG] pgmap v3104: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:59.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:31:58 gibba045 bash[25517]: cluster 2021-03-10T15:31:57.422066+0000 mgr.gibba045.orlgmj (mgr.34412) 5459 : cluster [DBG] pgmap v3105: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:59.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:31:58 gibba015 bash[29377]: cluster 2021-03-10T15:31:57.422066+0000 mgr.gibba045.orlgmj (mgr.34412) 5459 : cluster [DBG] pgmap v3105: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:59.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:31:58 gibba015 bash[30343]: cluster 2021-03-10T15:31:57.422066+0000 mgr.gibba045.orlgmj (mgr.34412) 5459 : cluster [DBG] pgmap v3105: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:01.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:32:00 gibba045 bash[25517]: cluster 2021-03-10T15:31:59.423154+0000 mgr.gibba045.orlgmj (mgr.34412) 5460 : cluster [DBG] pgmap v3106: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:01.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:32:00 gibba015 bash[29377]: cluster 2021-03-10T15:31:59.423154+0000 mgr.gibba045.orlgmj (mgr.34412) 5460 : cluster [DBG] pgmap v3106: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:01.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:32:00 gibba015 bash[30343]: cluster 2021-03-10T15:31:59.423154+0000 mgr.gibba045.orlgmj (mgr.34412) 5460 : cluster [DBG] pgmap v3106: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:03.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:32:02 gibba045 bash[25517]: cluster 2021-03-10T15:32:01.425182+0000 mgr.gibba045.orlgmj (mgr.34412) 5461 : cluster [DBG] pgmap v3107: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:03.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:32:02 gibba015 bash[29377]: cluster 2021-03-10T15:32:01.425182+0000 mgr.gibba045.orlgmj (mgr.34412) 5461 : cluster [DBG] pgmap v3107: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:03.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:32:02 gibba015 bash[30343]: cluster 2021-03-10T15:32:01.425182+0000 mgr.gibba045.orlgmj (mgr.34412) 5461 : cluster [DBG] pgmap v3107: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:04.280 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:32:04.509 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:32:04.509 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (102m) 7m ago 108m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:32:04.509 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (107m) 5m ago 107m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:32:04.510 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (103m) 5m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:32:04.510 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (103m) 5m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:32:04.510 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (102m) 7m ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:32:04.510 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (102m) 7m ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:32:04.511 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (101m) 5m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:32:04.511 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (102m) 7m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:32:04.511 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (108m) 7m ago 108m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:32:04.511 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (108m) 5m ago 108m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:32:04.511 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (101m) 7m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:32:04.512 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (100m) 7m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:32:04.512 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (100m) 7m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:32:04.512 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (99m) 7m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:32:04.512 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (99m) 5m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:32:04.513 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (98m) 5m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:32:04.513 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (98m) 5m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:32:04.513 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (98m) 5m ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:32:04.513 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (107m) 5m ago 108m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:32:04.513 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 5m ago 106m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:32:04.761 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:32:04.761 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:32:04.761 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:32:04.762 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:32:04.762 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:32:04.762 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:32:04.762 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:32:04.763 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:32:04.763 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:32:04.763 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:32:04.763 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:32:04.764 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:32:04.764 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:32:04.764 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:32:04.764 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:32:05.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:32:04 gibba045 bash[25517]: cluster 2021-03-10T15:32:03.426501+0000 mgr.gibba045.orlgmj (mgr.34412) 5462 : cluster [DBG] pgmap v3108: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:05.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:32:04 gibba045 bash[25517]: audit 2021-03-10T15:32:04.756182+0000 mon.a (mon.0) 1416 : audit [DBG] from='client.? 172.21.2.115:0/34609167' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:32:05.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:32:04 gibba015 bash[29377]: cluster 2021-03-10T15:32:03.426501+0000 mgr.gibba045.orlgmj (mgr.34412) 5462 : cluster [DBG] pgmap v3108: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:05.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:32:04 gibba015 bash[29377]: audit 2021-03-10T15:32:04.756182+0000 mon.a (mon.0) 1416 : audit [DBG] from='client.? 172.21.2.115:0/34609167' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:32:05.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:32:04 gibba015 bash[30343]: cluster 2021-03-10T15:32:03.426501+0000 mgr.gibba045.orlgmj (mgr.34412) 5462 : cluster [DBG] pgmap v3108: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:05.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:32:04 gibba015 bash[30343]: audit 2021-03-10T15:32:04.756182+0000 mon.a (mon.0) 1416 : audit [DBG] from='client.? 172.21.2.115:0/34609167' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:32:06.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:32:05 gibba015 bash[29377]: audit 2021-03-10T15:32:04.270593+0000 mgr.gibba045.orlgmj (mgr.34412) 5463 : audit [DBG] from='client.47724 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:32:06.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:32:05 gibba015 bash[29377]: audit 2021-03-10T15:32:04.495805+0000 mgr.gibba045.orlgmj (mgr.34412) 5464 : audit [DBG] from='client.47730 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:32:06.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:32:05 gibba015 bash[30343]: audit 2021-03-10T15:32:04.270593+0000 mgr.gibba045.orlgmj (mgr.34412) 5463 : audit [DBG] from='client.47724 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:32:06.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:32:05 gibba015 bash[30343]: audit 2021-03-10T15:32:04.495805+0000 mgr.gibba045.orlgmj (mgr.34412) 5464 : audit [DBG] from='client.47730 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:32:06.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:32:05 gibba045 bash[25517]: audit 2021-03-10T15:32:04.270593+0000 mgr.gibba045.orlgmj (mgr.34412) 5463 : audit [DBG] from='client.47724 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:32:06.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:32:05 gibba045 bash[25517]: audit 2021-03-10T15:32:04.495805+0000 mgr.gibba045.orlgmj (mgr.34412) 5464 : audit [DBG] from='client.47730 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:32:07.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:32:06 gibba015 bash[29377]: cluster 2021-03-10T15:32:05.428125+0000 mgr.gibba045.orlgmj (mgr.34412) 5465 : cluster [DBG] pgmap v3109: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:07.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:32:06 gibba015 bash[29377]: audit 2021-03-10T15:32:06.595387+0000 mon.c (mon.1) 1540 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:32:07.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:32:06 gibba015 bash[29377]: audit 2021-03-10T15:32:06.792501+0000 mon.a (mon.0) 1417 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:32:07.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:32:06 gibba015 bash[29377]: audit 2021-03-10T15:32:06.795450+0000 mon.a (mon.0) 1418 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:32:07.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:32:06 gibba015 bash[30343]: cluster 2021-03-10T15:32:05.428125+0000 mgr.gibba045.orlgmj (mgr.34412) 5465 : cluster [DBG] pgmap v3109: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:07.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:32:06 gibba015 bash[30343]: audit 2021-03-10T15:32:06.595387+0000 mon.c (mon.1) 1540 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:32:07.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:32:06 gibba015 bash[30343]: audit 2021-03-10T15:32:06.792501+0000 mon.a (mon.0) 1417 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:32:07.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:32:06 gibba015 bash[30343]: audit 2021-03-10T15:32:06.795450+0000 mon.a (mon.0) 1418 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:32:07.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:32:06 gibba045 bash[25517]: cluster 2021-03-10T15:32:05.428125+0000 mgr.gibba045.orlgmj (mgr.34412) 5465 : cluster [DBG] pgmap v3109: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:07.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:32:06 gibba045 bash[25517]: audit 2021-03-10T15:32:06.595387+0000 mon.c (mon.1) 1540 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:32:07.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:32:06 gibba045 bash[25517]: audit 2021-03-10T15:32:06.792501+0000 mon.a (mon.0) 1417 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:32:07.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:32:06 gibba045 bash[25517]: audit 2021-03-10T15:32:06.795450+0000 mon.a (mon.0) 1418 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:32:08.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:32:07 gibba045 bash[25517]: cephadm 2021-03-10T15:32:06.797359+0000 mgr.gibba045.orlgmj (mgr.34412) 5466 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:32:08.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:32:07 gibba045 bash[25517]: cephadm 2021-03-10T15:32:06.800750+0000 mgr.gibba045.orlgmj (mgr.34412) 5467 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:32:08.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:32:07 gibba045 bash[25517]: audit 2021-03-10T15:32:06.985640+0000 mon.a (mon.0) 1419 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:32:08.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:32:07 gibba045 bash[25517]: audit 2021-03-10T15:32:07.002010+0000 mon.c (mon.1) 1541 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:32:08.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:32:07 gibba045 bash[25517]: cephadm 2021-03-10T15:32:07.002985+0000 mgr.gibba045.orlgmj (mgr.34412) 5468 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:32:08.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:32:07 gibba045 bash[25517]: audit 2021-03-10T15:32:07.007035+0000 mon.c (mon.1) 1542 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:32:08.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:32:07 gibba045 bash[25517]: cephadm 2021-03-10T15:32:07.009439+0000 mgr.gibba045.orlgmj (mgr.34412) 5469 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:32:08.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:32:07 gibba045 bash[25517]: audit 2021-03-10T15:32:07.010634+0000 mon.c (mon.1) 1543 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:32:08.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:32:07 gibba045 bash[25517]: cephadm 2021-03-10T15:32:07.013132+0000 mgr.gibba045.orlgmj (mgr.34412) 5470 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:32:08.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:32:07 gibba045 bash[25517]: cephadm 2021-03-10T15:32:07.013507+0000 mgr.gibba045.orlgmj (mgr.34412) 5471 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:32:08.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:32:07 gibba045 bash[25517]: audit 2021-03-10T15:32:07.013852+0000 mon.c (mon.1) 1544 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:32:08.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:32:07 gibba045 bash[25517]: cephadm 2021-03-10T15:32:07.016745+0000 mgr.gibba045.orlgmj (mgr.34412) 5472 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:32:08.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:32:07 gibba045 bash[25517]: cephadm 2021-03-10T15:32:07.017124+0000 mgr.gibba045.orlgmj (mgr.34412) 5473 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:32:08.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:32:07 gibba045 bash[25517]: cephadm 2021-03-10T15:32:07.019743+0000 mgr.gibba045.orlgmj (mgr.34412) 5474 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:32:08.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:32:07 gibba045 bash[25517]: audit 2021-03-10T15:32:07.021113+0000 mon.c (mon.1) 1545 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:32:08.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:32:07 gibba045 bash[25517]: cephadm 2021-03-10T15:32:07.023135+0000 mgr.gibba045.orlgmj (mgr.34412) 5475 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:32:08.312 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:32:07 gibba045 bash[25517]: cephadm 2021-03-10T15:32:07.023552+0000 mgr.gibba045.orlgmj (mgr.34412) 5476 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:32:08.312 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:32:07 gibba045 bash[25517]: audit 2021-03-10T15:32:07.026029+0000 mon.c (mon.1) 1546 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:32:08.312 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:32:07 gibba045 bash[25517]: cephadm 2021-03-10T15:32:07.026942+0000 mgr.gibba045.orlgmj (mgr.34412) 5477 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:32:08.312 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:32:07 gibba045 bash[25517]: cephadm 2021-03-10T15:32:07.029123+0000 mgr.gibba045.orlgmj (mgr.34412) 5478 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:32:08.312 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:32:07 gibba045 bash[25517]: cephadm 2021-03-10T15:32:07.032021+0000 mgr.gibba045.orlgmj (mgr.34412) 5479 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:32:08.313 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:32:07 gibba045 bash[25517]: cephadm 2021-03-10T15:32:07.032407+0000 mgr.gibba045.orlgmj (mgr.34412) 5480 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:32:08.313 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:32:07 gibba045 bash[25517]: cephadm 2021-03-10T15:32:07.033031+0000 mgr.gibba045.orlgmj (mgr.34412) 5481 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:32:08.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:32:07 gibba015 bash[29377]: cephadm 2021-03-10T15:32:06.797359+0000 mgr.gibba045.orlgmj (mgr.34412) 5466 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:32:08.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:32:07 gibba015 bash[29377]: cephadm 2021-03-10T15:32:06.800750+0000 mgr.gibba045.orlgmj (mgr.34412) 5467 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:32:08.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:32:07 gibba015 bash[29377]: audit 2021-03-10T15:32:06.985640+0000 mon.a (mon.0) 1419 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:32:08.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:32:07 gibba015 bash[29377]: audit 2021-03-10T15:32:07.002010+0000 mon.c (mon.1) 1541 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:32:08.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:32:07 gibba015 bash[29377]: cephadm 2021-03-10T15:32:07.002985+0000 mgr.gibba045.orlgmj (mgr.34412) 5468 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:32:08.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:32:07 gibba015 bash[29377]: audit 2021-03-10T15:32:07.007035+0000 mon.c (mon.1) 1542 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:32:08.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:32:07 gibba015 bash[29377]: cephadm 2021-03-10T15:32:07.009439+0000 mgr.gibba045.orlgmj (mgr.34412) 5469 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:32:08.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:32:07 gibba015 bash[29377]: audit 2021-03-10T15:32:07.010634+0000 mon.c (mon.1) 1543 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:32:08.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:32:07 gibba015 bash[29377]: cephadm 2021-03-10T15:32:07.013132+0000 mgr.gibba045.orlgmj (mgr.34412) 5470 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:32:08.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:32:07 gibba015 bash[29377]: cephadm 2021-03-10T15:32:07.013507+0000 mgr.gibba045.orlgmj (mgr.34412) 5471 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:32:08.479 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:32:07 gibba015 bash[29377]: audit 2021-03-10T15:32:07.013852+0000 mon.c (mon.1) 1544 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:32:08.479 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:32:07 gibba015 bash[29377]: cephadm 2021-03-10T15:32:07.016745+0000 mgr.gibba045.orlgmj (mgr.34412) 5472 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:32:08.479 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:32:07 gibba015 bash[29377]: cephadm 2021-03-10T15:32:07.017124+0000 mgr.gibba045.orlgmj (mgr.34412) 5473 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:32:08.480 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:32:07 gibba015 bash[29377]: cephadm 2021-03-10T15:32:07.019743+0000 mgr.gibba045.orlgmj (mgr.34412) 5474 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:32:08.480 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:32:07 gibba015 bash[29377]: audit 2021-03-10T15:32:07.021113+0000 mon.c (mon.1) 1545 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:32:08.480 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:32:07 gibba015 bash[29377]: cephadm 2021-03-10T15:32:07.023135+0000 mgr.gibba045.orlgmj (mgr.34412) 5475 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:32:08.480 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:32:07 gibba015 bash[29377]: cephadm 2021-03-10T15:32:07.023552+0000 mgr.gibba045.orlgmj (mgr.34412) 5476 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:32:08.481 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:32:07 gibba015 bash[29377]: audit 2021-03-10T15:32:07.026029+0000 mon.c (mon.1) 1546 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:32:08.481 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:32:07 gibba015 bash[29377]: cephadm 2021-03-10T15:32:07.026942+0000 mgr.gibba045.orlgmj (mgr.34412) 5477 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:32:08.481 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:32:07 gibba015 bash[29377]: cephadm 2021-03-10T15:32:07.029123+0000 mgr.gibba045.orlgmj (mgr.34412) 5478 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:32:08.482 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:32:07 gibba015 bash[29377]: cephadm 2021-03-10T15:32:07.032021+0000 mgr.gibba045.orlgmj (mgr.34412) 5479 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:32:08.482 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:32:07 gibba015 bash[29377]: cephadm 2021-03-10T15:32:07.032407+0000 mgr.gibba045.orlgmj (mgr.34412) 5480 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:32:08.482 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:32:07 gibba015 bash[29377]: cephadm 2021-03-10T15:32:07.033031+0000 mgr.gibba045.orlgmj (mgr.34412) 5481 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:32:08.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:32:07 gibba015 bash[30343]: cephadm 2021-03-10T15:32:06.797359+0000 mgr.gibba045.orlgmj (mgr.34412) 5466 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:32:08.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:32:07 gibba015 bash[30343]: cephadm 2021-03-10T15:32:06.800750+0000 mgr.gibba045.orlgmj (mgr.34412) 5467 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:32:08.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:32:07 gibba015 bash[30343]: audit 2021-03-10T15:32:06.985640+0000 mon.a (mon.0) 1419 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:32:08.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:32:07 gibba015 bash[30343]: audit 2021-03-10T15:32:07.002010+0000 mon.c (mon.1) 1541 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:32:08.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:32:07 gibba015 bash[30343]: cephadm 2021-03-10T15:32:07.002985+0000 mgr.gibba045.orlgmj (mgr.34412) 5468 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:32:08.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:32:07 gibba015 bash[30343]: audit 2021-03-10T15:32:07.007035+0000 mon.c (mon.1) 1542 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:32:08.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:32:07 gibba015 bash[30343]: cephadm 2021-03-10T15:32:07.009439+0000 mgr.gibba045.orlgmj (mgr.34412) 5469 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:32:08.485 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:32:07 gibba015 bash[30343]: audit 2021-03-10T15:32:07.010634+0000 mon.c (mon.1) 1543 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:32:08.485 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:32:07 gibba015 bash[30343]: cephadm 2021-03-10T15:32:07.013132+0000 mgr.gibba045.orlgmj (mgr.34412) 5470 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:32:08.485 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:32:07 gibba015 bash[30343]: cephadm 2021-03-10T15:32:07.013507+0000 mgr.gibba045.orlgmj (mgr.34412) 5471 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:32:08.485 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:32:07 gibba015 bash[30343]: audit 2021-03-10T15:32:07.013852+0000 mon.c (mon.1) 1544 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:32:08.486 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:32:07 gibba015 bash[30343]: cephadm 2021-03-10T15:32:07.016745+0000 mgr.gibba045.orlgmj (mgr.34412) 5472 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:32:08.486 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:32:07 gibba015 bash[30343]: cephadm 2021-03-10T15:32:07.017124+0000 mgr.gibba045.orlgmj (mgr.34412) 5473 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:32:08.486 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:32:07 gibba015 bash[30343]: cephadm 2021-03-10T15:32:07.019743+0000 mgr.gibba045.orlgmj (mgr.34412) 5474 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:32:08.486 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:32:07 gibba015 bash[30343]: audit 2021-03-10T15:32:07.021113+0000 mon.c (mon.1) 1545 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:32:08.487 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:32:07 gibba015 bash[30343]: cephadm 2021-03-10T15:32:07.023135+0000 mgr.gibba045.orlgmj (mgr.34412) 5475 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:32:08.487 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:32:07 gibba015 bash[30343]: cephadm 2021-03-10T15:32:07.023552+0000 mgr.gibba045.orlgmj (mgr.34412) 5476 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:32:08.487 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:32:07 gibba015 bash[30343]: audit 2021-03-10T15:32:07.026029+0000 mon.c (mon.1) 1546 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:32:08.487 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:32:07 gibba015 bash[30343]: cephadm 2021-03-10T15:32:07.026942+0000 mgr.gibba045.orlgmj (mgr.34412) 5477 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:32:08.488 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:32:07 gibba015 bash[30343]: cephadm 2021-03-10T15:32:07.029123+0000 mgr.gibba045.orlgmj (mgr.34412) 5478 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:32:08.488 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:32:07 gibba015 bash[30343]: cephadm 2021-03-10T15:32:07.032021+0000 mgr.gibba045.orlgmj (mgr.34412) 5479 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:32:08.488 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:32:07 gibba015 bash[30343]: cephadm 2021-03-10T15:32:07.032407+0000 mgr.gibba045.orlgmj (mgr.34412) 5480 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:32:08.488 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:32:07 gibba015 bash[30343]: cephadm 2021-03-10T15:32:07.033031+0000 mgr.gibba045.orlgmj (mgr.34412) 5481 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:32:09.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:32:09 gibba045 bash[25517]: cluster 2021-03-10T15:32:07.429908+0000 mgr.gibba045.orlgmj (mgr.34412) 5482 : cluster [DBG] pgmap v3110: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:09.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:32:09 gibba015 bash[29377]: cluster 2021-03-10T15:32:07.429908+0000 mgr.gibba045.orlgmj (mgr.34412) 5482 : cluster [DBG] pgmap v3110: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:09.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:32:09 gibba015 bash[30343]: cluster 2021-03-10T15:32:07.429908+0000 mgr.gibba045.orlgmj (mgr.34412) 5482 : cluster [DBG] pgmap v3110: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:11.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:32:11 gibba045 bash[25517]: cluster 2021-03-10T15:32:09.431069+0000 mgr.gibba045.orlgmj (mgr.34412) 5483 : cluster [DBG] pgmap v3111: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:11.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:32:11 gibba015 bash[29377]: cluster 2021-03-10T15:32:09.431069+0000 mgr.gibba045.orlgmj (mgr.34412) 5483 : cluster [DBG] pgmap v3111: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:11.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:32:11 gibba015 bash[30343]: cluster 2021-03-10T15:32:09.431069+0000 mgr.gibba045.orlgmj (mgr.34412) 5483 : cluster [DBG] pgmap v3111: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:13.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:32:13 gibba045 bash[25517]: cluster 2021-03-10T15:32:11.432817+0000 mgr.gibba045.orlgmj (mgr.34412) 5484 : cluster [DBG] pgmap v3112: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:13.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:32:13 gibba015 bash[29377]: cluster 2021-03-10T15:32:11.432817+0000 mgr.gibba045.orlgmj (mgr.34412) 5484 : cluster [DBG] pgmap v3112: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:13.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:32:13 gibba015 bash[30343]: cluster 2021-03-10T15:32:11.432817+0000 mgr.gibba045.orlgmj (mgr.34412) 5484 : cluster [DBG] pgmap v3112: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:15.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:32:15 gibba045 bash[25517]: cluster 2021-03-10T15:32:13.433980+0000 mgr.gibba045.orlgmj (mgr.34412) 5485 : cluster [DBG] pgmap v3113: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:15.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:32:15 gibba015 bash[29377]: cluster 2021-03-10T15:32:13.433980+0000 mgr.gibba045.orlgmj (mgr.34412) 5485 : cluster [DBG] pgmap v3113: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:15.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:32:15 gibba015 bash[30343]: cluster 2021-03-10T15:32:13.433980+0000 mgr.gibba045.orlgmj (mgr.34412) 5485 : cluster [DBG] pgmap v3113: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:17.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:32:17 gibba045 bash[25517]: cluster 2021-03-10T15:32:15.435646+0000 mgr.gibba045.orlgmj (mgr.34412) 5486 : cluster [DBG] pgmap v3114: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:17.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:32:17 gibba015 bash[29377]: cluster 2021-03-10T15:32:15.435646+0000 mgr.gibba045.orlgmj (mgr.34412) 5486 : cluster [DBG] pgmap v3114: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:17.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:32:17 gibba015 bash[30343]: cluster 2021-03-10T15:32:15.435646+0000 mgr.gibba045.orlgmj (mgr.34412) 5486 : cluster [DBG] pgmap v3114: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:19.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:32:19 gibba045 bash[25517]: cluster 2021-03-10T15:32:17.437213+0000 mgr.gibba045.orlgmj (mgr.34412) 5487 : cluster [DBG] pgmap v3115: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:19.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:32:19 gibba015 bash[29377]: cluster 2021-03-10T15:32:17.437213+0000 mgr.gibba045.orlgmj (mgr.34412) 5487 : cluster [DBG] pgmap v3115: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:19.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:32:19 gibba015 bash[30343]: cluster 2021-03-10T15:32:17.437213+0000 mgr.gibba045.orlgmj (mgr.34412) 5487 : cluster [DBG] pgmap v3115: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:21.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:32:21 gibba015 bash[29377]: cluster 2021-03-10T15:32:19.438312+0000 mgr.gibba045.orlgmj (mgr.34412) 5488 : cluster [DBG] pgmap v3116: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:21.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:32:21 gibba015 bash[30343]: cluster 2021-03-10T15:32:19.438312+0000 mgr.gibba045.orlgmj (mgr.34412) 5488 : cluster [DBG] pgmap v3116: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:21.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:32:21 gibba045 bash[25517]: cluster 2021-03-10T15:32:19.438312+0000 mgr.gibba045.orlgmj (mgr.34412) 5488 : cluster [DBG] pgmap v3116: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:23.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:32:23 gibba015 bash[29377]: cluster 2021-03-10T15:32:21.440323+0000 mgr.gibba045.orlgmj (mgr.34412) 5489 : cluster [DBG] pgmap v3117: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:23.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:32:23 gibba015 bash[29377]: cephadm 2021-03-10T15:32:22.049111+0000 mgr.gibba045.orlgmj (mgr.34412) 5490 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:32:23.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:32:23 gibba015 bash[30343]: cluster 2021-03-10T15:32:21.440323+0000 mgr.gibba045.orlgmj (mgr.34412) 5489 : cluster [DBG] pgmap v3117: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:23.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:32:23 gibba015 bash[30343]: cephadm 2021-03-10T15:32:22.049111+0000 mgr.gibba045.orlgmj (mgr.34412) 5490 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:32:23.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:32:23 gibba045 bash[25517]: cluster 2021-03-10T15:32:21.440323+0000 mgr.gibba045.orlgmj (mgr.34412) 5489 : cluster [DBG] pgmap v3117: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:23.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:32:23 gibba045 bash[25517]: cephadm 2021-03-10T15:32:22.049111+0000 mgr.gibba045.orlgmj (mgr.34412) 5490 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:32:25.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:32:25 gibba015 bash[29377]: cluster 2021-03-10T15:32:23.441443+0000 mgr.gibba045.orlgmj (mgr.34412) 5491 : cluster [DBG] pgmap v3118: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:25.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:32:25 gibba015 bash[30343]: cluster 2021-03-10T15:32:23.441443+0000 mgr.gibba045.orlgmj (mgr.34412) 5491 : cluster [DBG] pgmap v3118: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:25.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:32:25 gibba045 bash[25517]: cluster 2021-03-10T15:32:23.441443+0000 mgr.gibba045.orlgmj (mgr.34412) 5491 : cluster [DBG] pgmap v3118: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:27.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:32:27 gibba015 bash[29377]: cluster 2021-03-10T15:32:25.442936+0000 mgr.gibba045.orlgmj (mgr.34412) 5492 : cluster [DBG] pgmap v3119: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:27.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:32:27 gibba015 bash[30343]: cluster 2021-03-10T15:32:25.442936+0000 mgr.gibba045.orlgmj (mgr.34412) 5492 : cluster [DBG] pgmap v3119: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:27.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:32:27 gibba045 bash[25517]: cluster 2021-03-10T15:32:25.442936+0000 mgr.gibba045.orlgmj (mgr.34412) 5492 : cluster [DBG] pgmap v3119: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:29.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:32:29 gibba015 bash[29377]: cluster 2021-03-10T15:32:27.444311+0000 mgr.gibba045.orlgmj (mgr.34412) 5493 : cluster [DBG] pgmap v3120: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:29.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:32:29 gibba015 bash[30343]: cluster 2021-03-10T15:32:27.444311+0000 mgr.gibba045.orlgmj (mgr.34412) 5493 : cluster [DBG] pgmap v3120: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:29.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:32:29 gibba045 bash[25517]: cluster 2021-03-10T15:32:27.444311+0000 mgr.gibba045.orlgmj (mgr.34412) 5493 : cluster [DBG] pgmap v3120: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:31.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:32:31 gibba015 bash[29377]: cluster 2021-03-10T15:32:29.445419+0000 mgr.gibba045.orlgmj (mgr.34412) 5494 : cluster [DBG] pgmap v3121: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:31.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:32:31 gibba015 bash[30343]: cluster 2021-03-10T15:32:29.445419+0000 mgr.gibba045.orlgmj (mgr.34412) 5494 : cluster [DBG] pgmap v3121: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:31.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:32:31 gibba045 bash[25517]: cluster 2021-03-10T15:32:29.445419+0000 mgr.gibba045.orlgmj (mgr.34412) 5494 : cluster [DBG] pgmap v3121: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:33.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:32:33 gibba015 bash[29377]: cluster 2021-03-10T15:32:31.447181+0000 mgr.gibba045.orlgmj (mgr.34412) 5495 : cluster [DBG] pgmap v3122: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:33.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:32:33 gibba015 bash[30343]: cluster 2021-03-10T15:32:31.447181+0000 mgr.gibba045.orlgmj (mgr.34412) 5495 : cluster [DBG] pgmap v3122: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:33.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:32:33 gibba045 bash[25517]: cluster 2021-03-10T15:32:31.447181+0000 mgr.gibba045.orlgmj (mgr.34412) 5495 : cluster [DBG] pgmap v3122: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:34.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:32:34 gibba015 bash[29377]: cluster 2021-03-10T15:32:33.448408+0000 mgr.gibba045.orlgmj (mgr.34412) 5496 : cluster [DBG] pgmap v3123: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:34.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:32:34 gibba015 bash[30343]: cluster 2021-03-10T15:32:33.448408+0000 mgr.gibba045.orlgmj (mgr.34412) 5496 : cluster [DBG] pgmap v3123: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:34.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:32:34 gibba045 bash[25517]: cluster 2021-03-10T15:32:33.448408+0000 mgr.gibba045.orlgmj (mgr.34412) 5496 : cluster [DBG] pgmap v3123: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:35.007 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:32:35.234 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:32:35.237 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (103m) 7m ago 108m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:32:35.238 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (108m) 6m ago 108m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:32:35.238 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (103m) 6m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:32:35.238 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (104m) 6m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:32:35.238 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (102m) 7m ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:32:35.239 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (102m) 7m ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:32:35.239 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (102m) 6m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:32:35.239 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (102m) 7m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:32:35.239 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (108m) 7m ago 108m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:32:35.240 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (108m) 6m ago 108m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:32:35.240 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (101m) 7m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:32:35.240 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (101m) 7m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:32:35.240 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (100m) 7m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:32:35.240 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (100m) 7m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:32:35.241 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (99m) 6m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:32:35.241 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (99m) 6m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:32:35.241 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (99m) 6m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:32:35.241 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (98m) 6m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:32:35.241 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (108m) 6m ago 108m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:32:35.242 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 6m ago 106m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:32:35.483 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:32:35.484 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:32:35.484 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:32:35.484 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:32:35.484 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:32:35.485 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:32:35.485 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:32:35.485 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:32:35.485 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:32:35.485 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:32:35.486 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:32:35.486 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:32:35.486 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:32:35.486 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:32:35.486 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:32:35.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:32:35 gibba015 bash[29377]: audit 2021-03-10T15:32:34.997362+0000 mgr.gibba045.orlgmj (mgr.34412) 5497 : audit [DBG] from='client.47742 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:32:35.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:32:35 gibba015 bash[30343]: audit 2021-03-10T15:32:34.997362+0000 mgr.gibba045.orlgmj (mgr.34412) 5497 : audit [DBG] from='client.47742 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:32:35.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:32:35 gibba045 bash[25517]: audit 2021-03-10T15:32:34.997362+0000 mgr.gibba045.orlgmj (mgr.34412) 5497 : audit [DBG] from='client.47742 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:32:36.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:32:36 gibba045 bash[25517]: audit 2021-03-10T15:32:35.220850+0000 mgr.gibba045.orlgmj (mgr.34412) 5498 : audit [DBG] from='client.47748 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:32:36.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:32:36 gibba045 bash[25517]: cluster 2021-03-10T15:32:35.449771+0000 mgr.gibba045.orlgmj (mgr.34412) 5499 : cluster [DBG] pgmap v3124: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:36.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:32:36 gibba045 bash[25517]: audit 2021-03-10T15:32:35.478744+0000 mon.c (mon.1) 1547 : audit [DBG] from='client.? 172.21.2.115:0/4265462283' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:32:36.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:32:36 gibba015 bash[29377]: audit 2021-03-10T15:32:35.220850+0000 mgr.gibba045.orlgmj (mgr.34412) 5498 : audit [DBG] from='client.47748 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:32:36.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:32:36 gibba015 bash[29377]: cluster 2021-03-10T15:32:35.449771+0000 mgr.gibba045.orlgmj (mgr.34412) 5499 : cluster [DBG] pgmap v3124: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:36.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:32:36 gibba015 bash[29377]: audit 2021-03-10T15:32:35.478744+0000 mon.c (mon.1) 1547 : audit [DBG] from='client.? 172.21.2.115:0/4265462283' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:32:36.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:32:36 gibba015 bash[30343]: audit 2021-03-10T15:32:35.220850+0000 mgr.gibba045.orlgmj (mgr.34412) 5498 : audit [DBG] from='client.47748 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:32:36.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:32:36 gibba015 bash[30343]: cluster 2021-03-10T15:32:35.449771+0000 mgr.gibba045.orlgmj (mgr.34412) 5499 : cluster [DBG] pgmap v3124: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:36.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:32:36 gibba015 bash[30343]: audit 2021-03-10T15:32:35.478744+0000 mon.c (mon.1) 1547 : audit [DBG] from='client.? 172.21.2.115:0/4265462283' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:32:37.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:32:37 gibba045 bash[25517]: cephadm 2021-03-10T15:32:37.065121+0000 mgr.gibba045.orlgmj (mgr.34412) 5500 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:32:37.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:32:37 gibba015 bash[29377]: cephadm 2021-03-10T15:32:37.065121+0000 mgr.gibba045.orlgmj (mgr.34412) 5500 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:32:37.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:32:37 gibba015 bash[30343]: cephadm 2021-03-10T15:32:37.065121+0000 mgr.gibba045.orlgmj (mgr.34412) 5500 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:32:38.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:32:38 gibba045 bash[25517]: cluster 2021-03-10T15:32:37.451374+0000 mgr.gibba045.orlgmj (mgr.34412) 5501 : cluster [DBG] pgmap v3125: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:38.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:32:38 gibba015 bash[29377]: cluster 2021-03-10T15:32:37.451374+0000 mgr.gibba045.orlgmj (mgr.34412) 5501 : cluster [DBG] pgmap v3125: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:38.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:32:38 gibba015 bash[30343]: cluster 2021-03-10T15:32:37.451374+0000 mgr.gibba045.orlgmj (mgr.34412) 5501 : cluster [DBG] pgmap v3125: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:40.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:32:40 gibba045 bash[25517]: cluster 2021-03-10T15:32:39.452647+0000 mgr.gibba045.orlgmj (mgr.34412) 5502 : cluster [DBG] pgmap v3126: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:40.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:32:40 gibba015 bash[29377]: cluster 2021-03-10T15:32:39.452647+0000 mgr.gibba045.orlgmj (mgr.34412) 5502 : cluster [DBG] pgmap v3126: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:40.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:32:40 gibba015 bash[30343]: cluster 2021-03-10T15:32:39.452647+0000 mgr.gibba045.orlgmj (mgr.34412) 5502 : cluster [DBG] pgmap v3126: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:42.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:32:42 gibba045 bash[25517]: cluster 2021-03-10T15:32:41.454914+0000 mgr.gibba045.orlgmj (mgr.34412) 5503 : cluster [DBG] pgmap v3127: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:42.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:32:42 gibba015 bash[29377]: cluster 2021-03-10T15:32:41.454914+0000 mgr.gibba045.orlgmj (mgr.34412) 5503 : cluster [DBG] pgmap v3127: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:42.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:32:42 gibba015 bash[30343]: cluster 2021-03-10T15:32:41.454914+0000 mgr.gibba045.orlgmj (mgr.34412) 5503 : cluster [DBG] pgmap v3127: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:44.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:32:44 gibba045 bash[25517]: cluster 2021-03-10T15:32:43.456302+0000 mgr.gibba045.orlgmj (mgr.34412) 5504 : cluster [DBG] pgmap v3128: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:44.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:32:44 gibba015 bash[29377]: cluster 2021-03-10T15:32:43.456302+0000 mgr.gibba045.orlgmj (mgr.34412) 5504 : cluster [DBG] pgmap v3128: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:44.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:32:44 gibba015 bash[30343]: cluster 2021-03-10T15:32:43.456302+0000 mgr.gibba045.orlgmj (mgr.34412) 5504 : cluster [DBG] pgmap v3128: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:46.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:32:46 gibba045 bash[25517]: cluster 2021-03-10T15:32:45.457921+0000 mgr.gibba045.orlgmj (mgr.34412) 5505 : cluster [DBG] pgmap v3129: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:46.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:32:46 gibba015 bash[30343]: cluster 2021-03-10T15:32:45.457921+0000 mgr.gibba045.orlgmj (mgr.34412) 5505 : cluster [DBG] pgmap v3129: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:46.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:32:46 gibba015 bash[29377]: cluster 2021-03-10T15:32:45.457921+0000 mgr.gibba045.orlgmj (mgr.34412) 5505 : cluster [DBG] pgmap v3129: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:48.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:32:48 gibba045 bash[25517]: cluster 2021-03-10T15:32:47.459619+0000 mgr.gibba045.orlgmj (mgr.34412) 5506 : cluster [DBG] pgmap v3130: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:48.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:32:48 gibba015 bash[29377]: cluster 2021-03-10T15:32:47.459619+0000 mgr.gibba045.orlgmj (mgr.34412) 5506 : cluster [DBG] pgmap v3130: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:48.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:32:48 gibba015 bash[30343]: cluster 2021-03-10T15:32:47.459619+0000 mgr.gibba045.orlgmj (mgr.34412) 5506 : cluster [DBG] pgmap v3130: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:50.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:32:50 gibba015 bash[29377]: cluster 2021-03-10T15:32:49.460842+0000 mgr.gibba045.orlgmj (mgr.34412) 5507 : cluster [DBG] pgmap v3131: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:50.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:32:50 gibba015 bash[30343]: cluster 2021-03-10T15:32:49.460842+0000 mgr.gibba045.orlgmj (mgr.34412) 5507 : cluster [DBG] pgmap v3131: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:51.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:32:50 gibba045 bash[25517]: cluster 2021-03-10T15:32:49.460842+0000 mgr.gibba045.orlgmj (mgr.34412) 5507 : cluster [DBG] pgmap v3131: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:52.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:32:52 gibba015 bash[29377]: cluster 2021-03-10T15:32:51.462602+0000 mgr.gibba045.orlgmj (mgr.34412) 5508 : cluster [DBG] pgmap v3132: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:52.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:32:52 gibba015 bash[29377]: cephadm 2021-03-10T15:32:52.081112+0000 mgr.gibba045.orlgmj (mgr.34412) 5509 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:32:52.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:32:52 gibba015 bash[30343]: cluster 2021-03-10T15:32:51.462602+0000 mgr.gibba045.orlgmj (mgr.34412) 5508 : cluster [DBG] pgmap v3132: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:52.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:32:52 gibba015 bash[30343]: cephadm 2021-03-10T15:32:52.081112+0000 mgr.gibba045.orlgmj (mgr.34412) 5509 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:32:53.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:32:52 gibba045 bash[25517]: cluster 2021-03-10T15:32:51.462602+0000 mgr.gibba045.orlgmj (mgr.34412) 5508 : cluster [DBG] pgmap v3132: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:53.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:32:52 gibba045 bash[25517]: cephadm 2021-03-10T15:32:52.081112+0000 mgr.gibba045.orlgmj (mgr.34412) 5509 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:32:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:32:53 gibba015 bash[29377]: audit 2021-03-10T15:32:53.168804+0000 mon.c (mon.1) 1548 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:32:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:32:53 gibba015 bash[29377]: audit 2021-03-10T15:32:53.169598+0000 mon.c (mon.1) 1549 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:32:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:32:53 gibba015 bash[29377]: audit 2021-03-10T15:32:53.169980+0000 mon.a (mon.0) 1420 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:32:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:32:53 gibba015 bash[29377]: audit 2021-03-10T15:32:53.170236+0000 mon.c (mon.1) 1550 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:32:53.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:32:53 gibba015 bash[29377]: audit 2021-03-10T15:32:53.171043+0000 mon.c (mon.1) 1551 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T15:32:53.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:32:53 gibba015 bash[29377]: audit 2021-03-10T15:32:53.171718+0000 mon.c (mon.1) 1552 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:32:53.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:32:53 gibba015 bash[29377]: audit 2021-03-10T15:32:53.171837+0000 mon.a (mon.0) 1421 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:32:53.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:32:53 gibba015 bash[29377]: audit 2021-03-10T15:32:53.172371+0000 mon.c (mon.1) 1553 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:32:53.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:32:53 gibba015 bash[29377]: audit 2021-03-10T15:32:53.173382+0000 mon.a (mon.0) 1422 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:32:53.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:32:53 gibba015 bash[29377]: audit 2021-03-10T15:32:53.173663+0000 mon.a (mon.0) 1423 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T15:32:53.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:32:53 gibba015 bash[29377]: audit 2021-03-10T15:32:53.173873+0000 mon.a (mon.0) 1424 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:32:53.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:32:53 gibba015 bash[29377]: audit 2021-03-10T15:32:53.174126+0000 mon.a (mon.0) 1425 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:32:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:32:53 gibba015 bash[30343]: audit 2021-03-10T15:32:53.168804+0000 mon.c (mon.1) 1548 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:32:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:32:53 gibba015 bash[30343]: audit 2021-03-10T15:32:53.169598+0000 mon.c (mon.1) 1549 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:32:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:32:53 gibba015 bash[30343]: audit 2021-03-10T15:32:53.169980+0000 mon.a (mon.0) 1420 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:32:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:32:53 gibba015 bash[30343]: audit 2021-03-10T15:32:53.170236+0000 mon.c (mon.1) 1550 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:32:53.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:32:53 gibba015 bash[30343]: audit 2021-03-10T15:32:53.171043+0000 mon.c (mon.1) 1551 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T15:32:53.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:32:53 gibba015 bash[30343]: audit 2021-03-10T15:32:53.171718+0000 mon.c (mon.1) 1552 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:32:53.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:32:53 gibba015 bash[30343]: audit 2021-03-10T15:32:53.171837+0000 mon.a (mon.0) 1421 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:32:53.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:32:53 gibba015 bash[30343]: audit 2021-03-10T15:32:53.172371+0000 mon.c (mon.1) 1553 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:32:53.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:32:53 gibba015 bash[30343]: audit 2021-03-10T15:32:53.173382+0000 mon.a (mon.0) 1422 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:32:53.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:32:53 gibba015 bash[30343]: audit 2021-03-10T15:32:53.173663+0000 mon.a (mon.0) 1423 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T15:32:53.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:32:53 gibba015 bash[30343]: audit 2021-03-10T15:32:53.173873+0000 mon.a (mon.0) 1424 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:32:53.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:32:53 gibba015 bash[30343]: audit 2021-03-10T15:32:53.174126+0000 mon.a (mon.0) 1425 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:32:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:32:53 gibba045 bash[25517]: audit 2021-03-10T15:32:53.168804+0000 mon.c (mon.1) 1548 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:32:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:32:53 gibba045 bash[25517]: audit 2021-03-10T15:32:53.169598+0000 mon.c (mon.1) 1549 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:32:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:32:53 gibba045 bash[25517]: audit 2021-03-10T15:32:53.169980+0000 mon.a (mon.0) 1420 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:32:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:32:53 gibba045 bash[25517]: audit 2021-03-10T15:32:53.170236+0000 mon.c (mon.1) 1550 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:32:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:32:53 gibba045 bash[25517]: audit 2021-03-10T15:32:53.171043+0000 mon.c (mon.1) 1551 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T15:32:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:32:53 gibba045 bash[25517]: audit 2021-03-10T15:32:53.171718+0000 mon.c (mon.1) 1552 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:32:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:32:53 gibba045 bash[25517]: audit 2021-03-10T15:32:53.171837+0000 mon.a (mon.0) 1421 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:32:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:32:53 gibba045 bash[25517]: audit 2021-03-10T15:32:53.172371+0000 mon.c (mon.1) 1553 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:32:54.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:32:53 gibba045 bash[25517]: audit 2021-03-10T15:32:53.173382+0000 mon.a (mon.0) 1422 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:32:54.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:32:53 gibba045 bash[25517]: audit 2021-03-10T15:32:53.173663+0000 mon.a (mon.0) 1423 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T15:32:54.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:32:53 gibba045 bash[25517]: audit 2021-03-10T15:32:53.173873+0000 mon.a (mon.0) 1424 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:32:54.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:32:53 gibba045 bash[25517]: audit 2021-03-10T15:32:53.174126+0000 mon.a (mon.0) 1425 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:32:54.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:32:54 gibba015 bash[29377]: cluster 2021-03-10T15:32:53.463818+0000 mgr.gibba045.orlgmj (mgr.34412) 5510 : cluster [DBG] pgmap v3133: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:54.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:32:54 gibba015 bash[30343]: cluster 2021-03-10T15:32:53.463818+0000 mgr.gibba045.orlgmj (mgr.34412) 5510 : cluster [DBG] pgmap v3133: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:55.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:32:54 gibba045 bash[25517]: cluster 2021-03-10T15:32:53.463818+0000 mgr.gibba045.orlgmj (mgr.34412) 5510 : cluster [DBG] pgmap v3133: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:56.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:32:56 gibba015 bash[29377]: cluster 2021-03-10T15:32:55.465471+0000 mgr.gibba045.orlgmj (mgr.34412) 5511 : cluster [DBG] pgmap v3134: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:56.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:32:56 gibba015 bash[30343]: cluster 2021-03-10T15:32:55.465471+0000 mgr.gibba045.orlgmj (mgr.34412) 5511 : cluster [DBG] pgmap v3134: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:57.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:32:56 gibba045 bash[25517]: cluster 2021-03-10T15:32:55.465471+0000 mgr.gibba045.orlgmj (mgr.34412) 5511 : cluster [DBG] pgmap v3134: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:58.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:32:58 gibba015 bash[29377]: cluster 2021-03-10T15:32:57.467282+0000 mgr.gibba045.orlgmj (mgr.34412) 5512 : cluster [DBG] pgmap v3135: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:58.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:32:58 gibba015 bash[30343]: cluster 2021-03-10T15:32:57.467282+0000 mgr.gibba045.orlgmj (mgr.34412) 5512 : cluster [DBG] pgmap v3135: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:59.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:32:58 gibba045 bash[25517]: cluster 2021-03-10T15:32:57.467282+0000 mgr.gibba045.orlgmj (mgr.34412) 5512 : cluster [DBG] pgmap v3135: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:00.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:33:00 gibba015 bash[29377]: cluster 2021-03-10T15:32:59.468533+0000 mgr.gibba045.orlgmj (mgr.34412) 5513 : cluster [DBG] pgmap v3136: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:00.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:33:00 gibba015 bash[30343]: cluster 2021-03-10T15:32:59.468533+0000 mgr.gibba045.orlgmj (mgr.34412) 5513 : cluster [DBG] pgmap v3136: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:01.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:33:00 gibba045 bash[25517]: cluster 2021-03-10T15:32:59.468533+0000 mgr.gibba045.orlgmj (mgr.34412) 5513 : cluster [DBG] pgmap v3136: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:02.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:33:02 gibba015 bash[29377]: cluster 2021-03-10T15:33:01.470678+0000 mgr.gibba045.orlgmj (mgr.34412) 5514 : cluster [DBG] pgmap v3137: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:02.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:33:02 gibba015 bash[30343]: cluster 2021-03-10T15:33:01.470678+0000 mgr.gibba045.orlgmj (mgr.34412) 5514 : cluster [DBG] pgmap v3137: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:03.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:33:02 gibba045 bash[25517]: cluster 2021-03-10T15:33:01.470678+0000 mgr.gibba045.orlgmj (mgr.34412) 5514 : cluster [DBG] pgmap v3137: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:04.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:33:04 gibba015 bash[29377]: cluster 2021-03-10T15:33:03.472031+0000 mgr.gibba045.orlgmj (mgr.34412) 5515 : cluster [DBG] pgmap v3138: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:04.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:33:04 gibba015 bash[30343]: cluster 2021-03-10T15:33:03.472031+0000 mgr.gibba045.orlgmj (mgr.34412) 5515 : cluster [DBG] pgmap v3138: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:05.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:33:04 gibba045 bash[25517]: cluster 2021-03-10T15:33:03.472031+0000 mgr.gibba045.orlgmj (mgr.34412) 5515 : cluster [DBG] pgmap v3138: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:05.729 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:33:05.959 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:33:05.959 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (103m) 8m ago 109m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:33:05.960 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (108m) 7m ago 108m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:33:05.960 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (104m) 7m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:33:05.960 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (104m) 7m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:33:05.961 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (103m) 8m ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:33:05.961 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (103m) 8m ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:33:05.962 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (102m) 7m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:33:05.962 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (103m) 8m ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:33:05.963 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (109m) 8m ago 109m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:33:05.963 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (109m) 7m ago 109m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:33:05.964 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (102m) 8m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:33:05.964 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (101m) 8m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:33:05.964 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (101m) 8m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:33:05.964 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (100m) 8m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:33:05.964 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (100m) 7m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:33:05.965 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (100m) 7m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:33:05.965 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (99m) 7m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:33:05.965 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (99m) 7m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:33:05.966 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (108m) 7m ago 109m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:33:05.966 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 7m ago 107m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:33:06.208 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:33:06.209 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:33:06.209 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:33:06.209 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:33:06.209 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:33:06.210 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:33:06.210 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:33:06.210 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:33:06.210 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:33:06.211 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:33:06.211 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:33:06.211 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:33:06.211 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:33:06.211 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:33:06.212 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:33:06.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:33:06 gibba015 bash[29377]: cluster 2021-03-10T15:33:05.473719+0000 mgr.gibba045.orlgmj (mgr.34412) 5516 : cluster [DBG] pgmap v3139: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:06.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:33:06 gibba015 bash[29377]: audit 2021-03-10T15:33:05.718875+0000 mgr.gibba045.orlgmj (mgr.34412) 5517 : audit [DBG] from='client.57748 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:33:06.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:33:06 gibba015 bash[29377]: audit 2021-03-10T15:33:05.946040+0000 mgr.gibba045.orlgmj (mgr.34412) 5518 : audit [DBG] from='client.57754 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:33:06.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:33:06 gibba015 bash[29377]: audit 2021-03-10T15:33:06.203673+0000 mon.a (mon.0) 1426 : audit [DBG] from='client.? 172.21.2.115:0/1445981221' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:33:06.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:33:06 gibba015 bash[30343]: cluster 2021-03-10T15:33:05.473719+0000 mgr.gibba045.orlgmj (mgr.34412) 5516 : cluster [DBG] pgmap v3139: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:06.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:33:06 gibba015 bash[30343]: audit 2021-03-10T15:33:05.718875+0000 mgr.gibba045.orlgmj (mgr.34412) 5517 : audit [DBG] from='client.57748 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:33:06.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:33:06 gibba015 bash[30343]: audit 2021-03-10T15:33:05.946040+0000 mgr.gibba045.orlgmj (mgr.34412) 5518 : audit [DBG] from='client.57754 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:33:06.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:33:06 gibba015 bash[30343]: audit 2021-03-10T15:33:06.203673+0000 mon.a (mon.0) 1426 : audit [DBG] from='client.? 172.21.2.115:0/1445981221' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:33:07.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:33:06 gibba045 bash[25517]: cluster 2021-03-10T15:33:05.473719+0000 mgr.gibba045.orlgmj (mgr.34412) 5516 : cluster [DBG] pgmap v3139: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:07.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:33:06 gibba045 bash[25517]: audit 2021-03-10T15:33:05.718875+0000 mgr.gibba045.orlgmj (mgr.34412) 5517 : audit [DBG] from='client.57748 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:33:07.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:33:06 gibba045 bash[25517]: audit 2021-03-10T15:33:05.946040+0000 mgr.gibba045.orlgmj (mgr.34412) 5518 : audit [DBG] from='client.57754 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:33:07.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:33:06 gibba045 bash[25517]: audit 2021-03-10T15:33:06.203673+0000 mon.a (mon.0) 1426 : audit [DBG] from='client.? 172.21.2.115:0/1445981221' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:33:07.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:33:07 gibba015 bash[29377]: audit 2021-03-10T15:33:07.090205+0000 mon.c (mon.1) 1554 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:33:07.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:33:07 gibba015 bash[29377]: cephadm 2021-03-10T15:33:07.098945+0000 mgr.gibba045.orlgmj (mgr.34412) 5519 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:33:07.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:33:07 gibba015 bash[29377]: cephadm 2021-03-10T15:33:07.100730+0000 mgr.gibba045.orlgmj (mgr.34412) 5520 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:33:07.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:33:07 gibba015 bash[29377]: audit 2021-03-10T15:33:07.304828+0000 mon.a (mon.0) 1427 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:33:07.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:33:07 gibba015 bash[29377]: audit 2021-03-10T15:33:07.308337+0000 mon.c (mon.1) 1555 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:33:07.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:33:07 gibba015 bash[29377]: audit 2021-03-10T15:33:07.309813+0000 mon.c (mon.1) 1556 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:33:07.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:33:07 gibba015 bash[29377]: audit 2021-03-10T15:33:07.311183+0000 mon.c (mon.1) 1557 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:33:07.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:33:07 gibba015 bash[29377]: audit 2021-03-10T15:33:07.312644+0000 mon.c (mon.1) 1558 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:33:07.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:33:07 gibba015 bash[29377]: audit 2021-03-10T15:33:07.315735+0000 mon.c (mon.1) 1559 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:33:07.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:33:07 gibba015 bash[29377]: audit 2021-03-10T15:33:07.317379+0000 mon.c (mon.1) 1560 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:33:07.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:33:07 gibba015 bash[30343]: audit 2021-03-10T15:33:07.090205+0000 mon.c (mon.1) 1554 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:33:07.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:33:07 gibba015 bash[30343]: cephadm 2021-03-10T15:33:07.098945+0000 mgr.gibba045.orlgmj (mgr.34412) 5519 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:33:07.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:33:07 gibba015 bash[30343]: cephadm 2021-03-10T15:33:07.100730+0000 mgr.gibba045.orlgmj (mgr.34412) 5520 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:33:07.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:33:07 gibba015 bash[30343]: audit 2021-03-10T15:33:07.304828+0000 mon.a (mon.0) 1427 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:33:07.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:33:07 gibba015 bash[30343]: audit 2021-03-10T15:33:07.308337+0000 mon.c (mon.1) 1555 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:33:07.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:33:07 gibba015 bash[30343]: audit 2021-03-10T15:33:07.309813+0000 mon.c (mon.1) 1556 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:33:07.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:33:07 gibba015 bash[30343]: audit 2021-03-10T15:33:07.311183+0000 mon.c (mon.1) 1557 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:33:07.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:33:07 gibba015 bash[30343]: audit 2021-03-10T15:33:07.312644+0000 mon.c (mon.1) 1558 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:33:07.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:33:07 gibba015 bash[30343]: audit 2021-03-10T15:33:07.315735+0000 mon.c (mon.1) 1559 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:33:07.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:33:07 gibba015 bash[30343]: audit 2021-03-10T15:33:07.317379+0000 mon.c (mon.1) 1560 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:33:08.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:33:07 gibba045 bash[25517]: audit 2021-03-10T15:33:07.090205+0000 mon.c (mon.1) 1554 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:33:08.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:33:07 gibba045 bash[25517]: cephadm 2021-03-10T15:33:07.098945+0000 mgr.gibba045.orlgmj (mgr.34412) 5519 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:33:08.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:33:07 gibba045 bash[25517]: cephadm 2021-03-10T15:33:07.100730+0000 mgr.gibba045.orlgmj (mgr.34412) 5520 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:33:08.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:33:07 gibba045 bash[25517]: audit 2021-03-10T15:33:07.304828+0000 mon.a (mon.0) 1427 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:33:08.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:33:07 gibba045 bash[25517]: audit 2021-03-10T15:33:07.308337+0000 mon.c (mon.1) 1555 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:33:08.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:33:07 gibba045 bash[25517]: audit 2021-03-10T15:33:07.309813+0000 mon.c (mon.1) 1556 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:33:08.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:33:07 gibba045 bash[25517]: audit 2021-03-10T15:33:07.311183+0000 mon.c (mon.1) 1557 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:33:08.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:33:07 gibba045 bash[25517]: audit 2021-03-10T15:33:07.312644+0000 mon.c (mon.1) 1558 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:33:08.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:33:07 gibba045 bash[25517]: audit 2021-03-10T15:33:07.315735+0000 mon.c (mon.1) 1559 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:33:08.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:33:07 gibba045 bash[25517]: audit 2021-03-10T15:33:07.317379+0000 mon.c (mon.1) 1560 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:33:08.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:33:08 gibba015 bash[29377]: cephadm 2021-03-10T15:33:07.311433+0000 mgr.gibba045.orlgmj (mgr.34412) 5521 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:33:08.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:33:08 gibba015 bash[29377]: cephadm 2021-03-10T15:33:07.313325+0000 mgr.gibba045.orlgmj (mgr.34412) 5522 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:33:08.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:33:08 gibba015 bash[29377]: cephadm 2021-03-10T15:33:07.314513+0000 mgr.gibba045.orlgmj (mgr.34412) 5523 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:33:08.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:33:08 gibba015 bash[29377]: cephadm 2021-03-10T15:33:07.314551+0000 mgr.gibba045.orlgmj (mgr.34412) 5524 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:33:08.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:33:08 gibba015 bash[29377]: cephadm 2021-03-10T15:33:07.316035+0000 mgr.gibba045.orlgmj (mgr.34412) 5525 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:33:08.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:33:08 gibba015 bash[29377]: cephadm 2021-03-10T15:33:07.316074+0000 mgr.gibba045.orlgmj (mgr.34412) 5526 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:33:08.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:33:08 gibba015 bash[29377]: cephadm 2021-03-10T15:33:07.317251+0000 mgr.gibba045.orlgmj (mgr.34412) 5527 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:33:08.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:33:08 gibba015 bash[29377]: cephadm 2021-03-10T15:33:07.318997+0000 mgr.gibba045.orlgmj (mgr.34412) 5528 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:33:08.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:33:08 gibba015 bash[29377]: cephadm 2021-03-10T15:33:07.319032+0000 mgr.gibba045.orlgmj (mgr.34412) 5529 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:33:08.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:33:08 gibba015 bash[29377]: cephadm 2021-03-10T15:33:07.320553+0000 mgr.gibba045.orlgmj (mgr.34412) 5530 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:33:08.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:33:08 gibba015 bash[29377]: cephadm 2021-03-10T15:33:07.320865+0000 mgr.gibba045.orlgmj (mgr.34412) 5531 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:33:08.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:33:08 gibba015 bash[29377]: cephadm 2021-03-10T15:33:07.322275+0000 mgr.gibba045.orlgmj (mgr.34412) 5532 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:33:08.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:33:08 gibba015 bash[29377]: cephadm 2021-03-10T15:33:07.322312+0000 mgr.gibba045.orlgmj (mgr.34412) 5533 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:33:08.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:33:08 gibba015 bash[29377]: cephadm 2021-03-10T15:33:07.322416+0000 mgr.gibba045.orlgmj (mgr.34412) 5534 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:33:08.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:33:08 gibba015 bash[29377]: cluster 2021-03-10T15:33:07.475439+0000 mgr.gibba045.orlgmj (mgr.34412) 5535 : cluster [DBG] pgmap v3140: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:08.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:33:08 gibba015 bash[30343]: cephadm 2021-03-10T15:33:07.311433+0000 mgr.gibba045.orlgmj (mgr.34412) 5521 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:33:08.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:33:08 gibba015 bash[30343]: cephadm 2021-03-10T15:33:07.313325+0000 mgr.gibba045.orlgmj (mgr.34412) 5522 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:33:08.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:33:08 gibba015 bash[30343]: cephadm 2021-03-10T15:33:07.314513+0000 mgr.gibba045.orlgmj (mgr.34412) 5523 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:33:08.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:33:08 gibba015 bash[30343]: cephadm 2021-03-10T15:33:07.314551+0000 mgr.gibba045.orlgmj (mgr.34412) 5524 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:33:08.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:33:08 gibba015 bash[30343]: cephadm 2021-03-10T15:33:07.316035+0000 mgr.gibba045.orlgmj (mgr.34412) 5525 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:33:08.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:33:08 gibba015 bash[30343]: cephadm 2021-03-10T15:33:07.316074+0000 mgr.gibba045.orlgmj (mgr.34412) 5526 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:33:08.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:33:08 gibba015 bash[30343]: cephadm 2021-03-10T15:33:07.317251+0000 mgr.gibba045.orlgmj (mgr.34412) 5527 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:33:08.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:33:08 gibba015 bash[30343]: cephadm 2021-03-10T15:33:07.318997+0000 mgr.gibba045.orlgmj (mgr.34412) 5528 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:33:08.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:33:08 gibba015 bash[30343]: cephadm 2021-03-10T15:33:07.319032+0000 mgr.gibba045.orlgmj (mgr.34412) 5529 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:33:08.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:33:08 gibba015 bash[30343]: cephadm 2021-03-10T15:33:07.320553+0000 mgr.gibba045.orlgmj (mgr.34412) 5530 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:33:08.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:33:08 gibba015 bash[30343]: cephadm 2021-03-10T15:33:07.320865+0000 mgr.gibba045.orlgmj (mgr.34412) 5531 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:33:08.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:33:08 gibba015 bash[30343]: cephadm 2021-03-10T15:33:07.322275+0000 mgr.gibba045.orlgmj (mgr.34412) 5532 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:33:08.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:33:08 gibba015 bash[30343]: cephadm 2021-03-10T15:33:07.322312+0000 mgr.gibba045.orlgmj (mgr.34412) 5533 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:33:08.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:33:08 gibba015 bash[30343]: cephadm 2021-03-10T15:33:07.322416+0000 mgr.gibba045.orlgmj (mgr.34412) 5534 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:33:08.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:33:08 gibba015 bash[30343]: cluster 2021-03-10T15:33:07.475439+0000 mgr.gibba045.orlgmj (mgr.34412) 5535 : cluster [DBG] pgmap v3140: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:09.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:33:08 gibba045 bash[25517]: cephadm 2021-03-10T15:33:07.311433+0000 mgr.gibba045.orlgmj (mgr.34412) 5521 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:33:09.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:33:08 gibba045 bash[25517]: cephadm 2021-03-10T15:33:07.313325+0000 mgr.gibba045.orlgmj (mgr.34412) 5522 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:33:09.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:33:08 gibba045 bash[25517]: cephadm 2021-03-10T15:33:07.314513+0000 mgr.gibba045.orlgmj (mgr.34412) 5523 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:33:09.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:33:08 gibba045 bash[25517]: cephadm 2021-03-10T15:33:07.314551+0000 mgr.gibba045.orlgmj (mgr.34412) 5524 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:33:09.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:33:08 gibba045 bash[25517]: cephadm 2021-03-10T15:33:07.316035+0000 mgr.gibba045.orlgmj (mgr.34412) 5525 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:33:09.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:33:08 gibba045 bash[25517]: cephadm 2021-03-10T15:33:07.316074+0000 mgr.gibba045.orlgmj (mgr.34412) 5526 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:33:09.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:33:08 gibba045 bash[25517]: cephadm 2021-03-10T15:33:07.317251+0000 mgr.gibba045.orlgmj (mgr.34412) 5527 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:33:09.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:33:08 gibba045 bash[25517]: cephadm 2021-03-10T15:33:07.318997+0000 mgr.gibba045.orlgmj (mgr.34412) 5528 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:33:09.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:33:08 gibba045 bash[25517]: cephadm 2021-03-10T15:33:07.319032+0000 mgr.gibba045.orlgmj (mgr.34412) 5529 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:33:09.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:33:08 gibba045 bash[25517]: cephadm 2021-03-10T15:33:07.320553+0000 mgr.gibba045.orlgmj (mgr.34412) 5530 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:33:09.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:33:08 gibba045 bash[25517]: cephadm 2021-03-10T15:33:07.320865+0000 mgr.gibba045.orlgmj (mgr.34412) 5531 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:33:09.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:33:08 gibba045 bash[25517]: cephadm 2021-03-10T15:33:07.322275+0000 mgr.gibba045.orlgmj (mgr.34412) 5532 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:33:09.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:33:08 gibba045 bash[25517]: cephadm 2021-03-10T15:33:07.322312+0000 mgr.gibba045.orlgmj (mgr.34412) 5533 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:33:09.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:33:08 gibba045 bash[25517]: cephadm 2021-03-10T15:33:07.322416+0000 mgr.gibba045.orlgmj (mgr.34412) 5534 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:33:09.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:33:08 gibba045 bash[25517]: cluster 2021-03-10T15:33:07.475439+0000 mgr.gibba045.orlgmj (mgr.34412) 5535 : cluster [DBG] pgmap v3140: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:10.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:33:10 gibba015 bash[29377]: cluster 2021-03-10T15:33:09.476807+0000 mgr.gibba045.orlgmj (mgr.34412) 5536 : cluster [DBG] pgmap v3141: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:10.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:33:10 gibba015 bash[30343]: cluster 2021-03-10T15:33:09.476807+0000 mgr.gibba045.orlgmj (mgr.34412) 5536 : cluster [DBG] pgmap v3141: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:11.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:33:10 gibba045 bash[25517]: cluster 2021-03-10T15:33:09.476807+0000 mgr.gibba045.orlgmj (mgr.34412) 5536 : cluster [DBG] pgmap v3141: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:12.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:33:12 gibba015 bash[29377]: cluster 2021-03-10T15:33:11.478861+0000 mgr.gibba045.orlgmj (mgr.34412) 5537 : cluster [DBG] pgmap v3142: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:12.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:33:12 gibba015 bash[30343]: cluster 2021-03-10T15:33:11.478861+0000 mgr.gibba045.orlgmj (mgr.34412) 5537 : cluster [DBG] pgmap v3142: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:13.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:33:12 gibba045 bash[25517]: cluster 2021-03-10T15:33:11.478861+0000 mgr.gibba045.orlgmj (mgr.34412) 5537 : cluster [DBG] pgmap v3142: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:14.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:33:14 gibba015 bash[29377]: cluster 2021-03-10T15:33:13.480109+0000 mgr.gibba045.orlgmj (mgr.34412) 5538 : cluster [DBG] pgmap v3143: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:14.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:33:14 gibba015 bash[30343]: cluster 2021-03-10T15:33:13.480109+0000 mgr.gibba045.orlgmj (mgr.34412) 5538 : cluster [DBG] pgmap v3143: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:15.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:33:14 gibba045 bash[25517]: cluster 2021-03-10T15:33:13.480109+0000 mgr.gibba045.orlgmj (mgr.34412) 5538 : cluster [DBG] pgmap v3143: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:16.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:33:16 gibba015 bash[29377]: cluster 2021-03-10T15:33:15.481020+0000 mgr.gibba045.orlgmj (mgr.34412) 5539 : cluster [DBG] pgmap v3144: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:16.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:33:16 gibba015 bash[30343]: cluster 2021-03-10T15:33:15.481020+0000 mgr.gibba045.orlgmj (mgr.34412) 5539 : cluster [DBG] pgmap v3144: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:17.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:33:16 gibba045 bash[25517]: cluster 2021-03-10T15:33:15.481020+0000 mgr.gibba045.orlgmj (mgr.34412) 5539 : cluster [DBG] pgmap v3144: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:18.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:33:18 gibba015 bash[29377]: cluster 2021-03-10T15:33:17.482706+0000 mgr.gibba045.orlgmj (mgr.34412) 5540 : cluster [DBG] pgmap v3145: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:18.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:33:18 gibba015 bash[30343]: cluster 2021-03-10T15:33:17.482706+0000 mgr.gibba045.orlgmj (mgr.34412) 5540 : cluster [DBG] pgmap v3145: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:19.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:33:18 gibba045 bash[25517]: cluster 2021-03-10T15:33:17.482706+0000 mgr.gibba045.orlgmj (mgr.34412) 5540 : cluster [DBG] pgmap v3145: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:20.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:33:20 gibba015 bash[29377]: cluster 2021-03-10T15:33:19.483929+0000 mgr.gibba045.orlgmj (mgr.34412) 5541 : cluster [DBG] pgmap v3146: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:20.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:33:20 gibba015 bash[30343]: cluster 2021-03-10T15:33:19.483929+0000 mgr.gibba045.orlgmj (mgr.34412) 5541 : cluster [DBG] pgmap v3146: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:21.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:33:20 gibba045 bash[25517]: cluster 2021-03-10T15:33:19.483929+0000 mgr.gibba045.orlgmj (mgr.34412) 5541 : cluster [DBG] pgmap v3146: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:22.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:33:22 gibba015 bash[29377]: cluster 2021-03-10T15:33:21.486024+0000 mgr.gibba045.orlgmj (mgr.34412) 5542 : cluster [DBG] pgmap v3147: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:22.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:33:22 gibba015 bash[30343]: cluster 2021-03-10T15:33:21.486024+0000 mgr.gibba045.orlgmj (mgr.34412) 5542 : cluster [DBG] pgmap v3147: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:23.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:33:22 gibba045 bash[25517]: cluster 2021-03-10T15:33:21.486024+0000 mgr.gibba045.orlgmj (mgr.34412) 5542 : cluster [DBG] pgmap v3147: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:23.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:33:23 gibba015 bash[29377]: cephadm 2021-03-10T15:33:22.326655+0000 mgr.gibba045.orlgmj (mgr.34412) 5543 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:33:23.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:33:23 gibba015 bash[30343]: cephadm 2021-03-10T15:33:22.326655+0000 mgr.gibba045.orlgmj (mgr.34412) 5543 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:33:24.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:33:23 gibba045 bash[25517]: cephadm 2021-03-10T15:33:22.326655+0000 mgr.gibba045.orlgmj (mgr.34412) 5543 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:33:24.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:33:24 gibba015 bash[29377]: cluster 2021-03-10T15:33:23.487396+0000 mgr.gibba045.orlgmj (mgr.34412) 5544 : cluster [DBG] pgmap v3148: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:24.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:33:24 gibba015 bash[30343]: cluster 2021-03-10T15:33:23.487396+0000 mgr.gibba045.orlgmj (mgr.34412) 5544 : cluster [DBG] pgmap v3148: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:25.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:33:24 gibba045 bash[25517]: cluster 2021-03-10T15:33:23.487396+0000 mgr.gibba045.orlgmj (mgr.34412) 5544 : cluster [DBG] pgmap v3148: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:27.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:33:26 gibba045 bash[25517]: cluster 2021-03-10T15:33:25.489027+0000 mgr.gibba045.orlgmj (mgr.34412) 5545 : cluster [DBG] pgmap v3149: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:27.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:33:26 gibba015 bash[29377]: cluster 2021-03-10T15:33:25.489027+0000 mgr.gibba045.orlgmj (mgr.34412) 5545 : cluster [DBG] pgmap v3149: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:27.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:33:26 gibba015 bash[30343]: cluster 2021-03-10T15:33:25.489027+0000 mgr.gibba045.orlgmj (mgr.34412) 5545 : cluster [DBG] pgmap v3149: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:29.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:33:28 gibba045 bash[25517]: cluster 2021-03-10T15:33:27.490829+0000 mgr.gibba045.orlgmj (mgr.34412) 5546 : cluster [DBG] pgmap v3150: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:29.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:33:28 gibba015 bash[29377]: cluster 2021-03-10T15:33:27.490829+0000 mgr.gibba045.orlgmj (mgr.34412) 5546 : cluster [DBG] pgmap v3150: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:29.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:33:28 gibba015 bash[30343]: cluster 2021-03-10T15:33:27.490829+0000 mgr.gibba045.orlgmj (mgr.34412) 5546 : cluster [DBG] pgmap v3150: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:31.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:33:30 gibba045 bash[25517]: cluster 2021-03-10T15:33:29.492061+0000 mgr.gibba045.orlgmj (mgr.34412) 5547 : cluster [DBG] pgmap v3151: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:31.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:33:30 gibba015 bash[29377]: cluster 2021-03-10T15:33:29.492061+0000 mgr.gibba045.orlgmj (mgr.34412) 5547 : cluster [DBG] pgmap v3151: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:31.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:33:30 gibba015 bash[30343]: cluster 2021-03-10T15:33:29.492061+0000 mgr.gibba045.orlgmj (mgr.34412) 5547 : cluster [DBG] pgmap v3151: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:33.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:33:32 gibba045 bash[25517]: cluster 2021-03-10T15:33:31.494060+0000 mgr.gibba045.orlgmj (mgr.34412) 5548 : cluster [DBG] pgmap v3152: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:33.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:33:32 gibba015 bash[29377]: cluster 2021-03-10T15:33:31.494060+0000 mgr.gibba045.orlgmj (mgr.34412) 5548 : cluster [DBG] pgmap v3152: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:33.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:33:32 gibba015 bash[30343]: cluster 2021-03-10T15:33:31.494060+0000 mgr.gibba045.orlgmj (mgr.34412) 5548 : cluster [DBG] pgmap v3152: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:35.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:33:34 gibba045 bash[25517]: cluster 2021-03-10T15:33:33.495399+0000 mgr.gibba045.orlgmj (mgr.34412) 5549 : cluster [DBG] pgmap v3153: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:35.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:33:34 gibba015 bash[29377]: cluster 2021-03-10T15:33:33.495399+0000 mgr.gibba045.orlgmj (mgr.34412) 5549 : cluster [DBG] pgmap v3153: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:35.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:33:34 gibba015 bash[30343]: cluster 2021-03-10T15:33:33.495399+0000 mgr.gibba045.orlgmj (mgr.34412) 5549 : cluster [DBG] pgmap v3153: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:36.449 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:33:36.677 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:33:36.678 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (104m) 8m ago 109m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:33:36.678 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (109m) 7m ago 109m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:33:36.678 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (104m) 7m ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:33:36.678 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (105m) 7m ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:33:36.679 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (104m) 8m ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:33:36.679 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (103m) 8m ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:33:36.679 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (103m) 7m ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:33:36.679 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (103m) 8m ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:33:36.680 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (109m) 8m ago 109m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:33:36.680 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (109m) 7m ago 109m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:33:36.680 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (102m) 8m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:33:36.680 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (102m) 8m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:33:36.680 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (101m) 8m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:33:36.681 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (101m) 8m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:33:36.681 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (100m) 7m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:33:36.681 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (100m) 7m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:33:36.681 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (100m) 7m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:33:36.682 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (99m) 7m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:33:36.682 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (109m) 7m ago 109m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:33:36.682 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 7m ago 107m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:33:36.931 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:33:36.931 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:33:36.931 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:33:36.932 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:33:36.932 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:33:36.932 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:33:36.932 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:33:36.933 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:33:36.933 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:33:36.933 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:33:36.933 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:33:36.934 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:33:36.934 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:33:36.934 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:33:36.934 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:33:37.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:33:36 gibba045 bash[25517]: cluster 2021-03-10T15:33:35.497166+0000 mgr.gibba045.orlgmj (mgr.34412) 5550 : cluster [DBG] pgmap v3154: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:37.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:33:36 gibba015 bash[29377]: cluster 2021-03-10T15:33:35.497166+0000 mgr.gibba045.orlgmj (mgr.34412) 5550 : cluster [DBG] pgmap v3154: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:37.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:33:36 gibba015 bash[30343]: cluster 2021-03-10T15:33:35.497166+0000 mgr.gibba045.orlgmj (mgr.34412) 5550 : cluster [DBG] pgmap v3154: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:38.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:33:37 gibba045 bash[25517]: audit 2021-03-10T15:33:36.439556+0000 mgr.gibba045.orlgmj (mgr.34412) 5551 : audit [DBG] from='client.47778 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:33:38.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:33:37 gibba045 bash[25517]: audit 2021-03-10T15:33:36.663544+0000 mgr.gibba045.orlgmj (mgr.34412) 5552 : audit [DBG] from='client.47784 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:33:38.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:33:37 gibba045 bash[25517]: audit 2021-03-10T15:33:36.925973+0000 mon.c (mon.1) 1561 : audit [DBG] from='client.? 172.21.2.115:0/1398559376' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:33:38.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:33:37 gibba015 bash[29377]: audit 2021-03-10T15:33:36.439556+0000 mgr.gibba045.orlgmj (mgr.34412) 5551 : audit [DBG] from='client.47778 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:33:38.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:33:37 gibba015 bash[29377]: audit 2021-03-10T15:33:36.663544+0000 mgr.gibba045.orlgmj (mgr.34412) 5552 : audit [DBG] from='client.47784 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:33:38.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:33:37 gibba015 bash[29377]: audit 2021-03-10T15:33:36.925973+0000 mon.c (mon.1) 1561 : audit [DBG] from='client.? 172.21.2.115:0/1398559376' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:33:38.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:33:37 gibba015 bash[30343]: audit 2021-03-10T15:33:36.439556+0000 mgr.gibba045.orlgmj (mgr.34412) 5551 : audit [DBG] from='client.47778 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:33:38.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:33:37 gibba015 bash[30343]: audit 2021-03-10T15:33:36.663544+0000 mgr.gibba045.orlgmj (mgr.34412) 5552 : audit [DBG] from='client.47784 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:33:38.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:33:37 gibba015 bash[30343]: audit 2021-03-10T15:33:36.925973+0000 mon.c (mon.1) 1561 : audit [DBG] from='client.? 172.21.2.115:0/1398559376' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:33:39.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:33:38 gibba045 bash[25517]: cephadm 2021-03-10T15:33:37.342555+0000 mgr.gibba045.orlgmj (mgr.34412) 5553 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:33:39.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:33:38 gibba045 bash[25517]: cluster 2021-03-10T15:33:37.498711+0000 mgr.gibba045.orlgmj (mgr.34412) 5554 : cluster [DBG] pgmap v3155: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:39.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:33:38 gibba015 bash[29377]: cephadm 2021-03-10T15:33:37.342555+0000 mgr.gibba045.orlgmj (mgr.34412) 5553 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:33:39.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:33:38 gibba015 bash[29377]: cluster 2021-03-10T15:33:37.498711+0000 mgr.gibba045.orlgmj (mgr.34412) 5554 : cluster [DBG] pgmap v3155: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:39.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:33:38 gibba015 bash[30343]: cephadm 2021-03-10T15:33:37.342555+0000 mgr.gibba045.orlgmj (mgr.34412) 5553 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:33:39.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:33:38 gibba015 bash[30343]: cluster 2021-03-10T15:33:37.498711+0000 mgr.gibba045.orlgmj (mgr.34412) 5554 : cluster [DBG] pgmap v3155: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:40.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:33:40 gibba045 bash[25517]: cluster 2021-03-10T15:33:39.499958+0000 mgr.gibba045.orlgmj (mgr.34412) 5555 : cluster [DBG] pgmap v3156: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:40.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:33:40 gibba015 bash[29377]: cluster 2021-03-10T15:33:39.499958+0000 mgr.gibba045.orlgmj (mgr.34412) 5555 : cluster [DBG] pgmap v3156: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:40.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:33:40 gibba015 bash[30343]: cluster 2021-03-10T15:33:39.499958+0000 mgr.gibba045.orlgmj (mgr.34412) 5555 : cluster [DBG] pgmap v3156: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:42.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:33:42 gibba045 bash[25517]: cluster 2021-03-10T15:33:41.501862+0000 mgr.gibba045.orlgmj (mgr.34412) 5556 : cluster [DBG] pgmap v3157: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:42.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:33:42 gibba015 bash[29377]: cluster 2021-03-10T15:33:41.501862+0000 mgr.gibba045.orlgmj (mgr.34412) 5556 : cluster [DBG] pgmap v3157: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:42.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:33:42 gibba015 bash[30343]: cluster 2021-03-10T15:33:41.501862+0000 mgr.gibba045.orlgmj (mgr.34412) 5556 : cluster [DBG] pgmap v3157: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:44.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:33:44 gibba045 bash[25517]: cluster 2021-03-10T15:33:43.503188+0000 mgr.gibba045.orlgmj (mgr.34412) 5557 : cluster [DBG] pgmap v3158: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:44.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:33:44 gibba015 bash[29377]: cluster 2021-03-10T15:33:43.503188+0000 mgr.gibba045.orlgmj (mgr.34412) 5557 : cluster [DBG] pgmap v3158: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:44.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:33:44 gibba015 bash[30343]: cluster 2021-03-10T15:33:43.503188+0000 mgr.gibba045.orlgmj (mgr.34412) 5557 : cluster [DBG] pgmap v3158: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:46.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:33:46 gibba045 bash[25517]: cluster 2021-03-10T15:33:45.504908+0000 mgr.gibba045.orlgmj (mgr.34412) 5558 : cluster [DBG] pgmap v3159: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:46.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:33:46 gibba015 bash[29377]: cluster 2021-03-10T15:33:45.504908+0000 mgr.gibba045.orlgmj (mgr.34412) 5558 : cluster [DBG] pgmap v3159: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:46.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:33:46 gibba015 bash[30343]: cluster 2021-03-10T15:33:45.504908+0000 mgr.gibba045.orlgmj (mgr.34412) 5558 : cluster [DBG] pgmap v3159: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:48.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:33:48 gibba045 bash[25517]: cluster 2021-03-10T15:33:47.506681+0000 mgr.gibba045.orlgmj (mgr.34412) 5559 : cluster [DBG] pgmap v3160: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:48.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:33:48 gibba015 bash[29377]: cluster 2021-03-10T15:33:47.506681+0000 mgr.gibba045.orlgmj (mgr.34412) 5559 : cluster [DBG] pgmap v3160: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:48.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:33:48 gibba015 bash[30343]: cluster 2021-03-10T15:33:47.506681+0000 mgr.gibba045.orlgmj (mgr.34412) 5559 : cluster [DBG] pgmap v3160: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:50.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:33:50 gibba045 bash[25517]: cluster 2021-03-10T15:33:49.507953+0000 mgr.gibba045.orlgmj (mgr.34412) 5560 : cluster [DBG] pgmap v3161: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:50.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:33:50 gibba015 bash[29377]: cluster 2021-03-10T15:33:49.507953+0000 mgr.gibba045.orlgmj (mgr.34412) 5560 : cluster [DBG] pgmap v3161: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:50.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:33:50 gibba015 bash[30343]: cluster 2021-03-10T15:33:49.507953+0000 mgr.gibba045.orlgmj (mgr.34412) 5560 : cluster [DBG] pgmap v3161: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:52.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:33:52 gibba045 bash[25517]: cluster 2021-03-10T15:33:51.509722+0000 mgr.gibba045.orlgmj (mgr.34412) 5561 : cluster [DBG] pgmap v3162: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:52.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:33:52 gibba015 bash[29377]: cluster 2021-03-10T15:33:51.509722+0000 mgr.gibba045.orlgmj (mgr.34412) 5561 : cluster [DBG] pgmap v3162: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:52.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:33:52 gibba015 bash[30343]: cluster 2021-03-10T15:33:51.509722+0000 mgr.gibba045.orlgmj (mgr.34412) 5561 : cluster [DBG] pgmap v3162: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:33:53 gibba045 bash[25517]: cephadm 2021-03-10T15:33:52.364031+0000 mgr.gibba045.orlgmj (mgr.34412) 5562 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:33:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:33:53 gibba045 bash[25517]: audit 2021-03-10T15:33:53.176923+0000 mon.c (mon.1) 1562 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:33:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:33:53 gibba045 bash[25517]: audit 2021-03-10T15:33:53.177757+0000 mon.c (mon.1) 1563 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:33:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:33:53 gibba045 bash[25517]: audit 2021-03-10T15:33:53.178175+0000 mon.a (mon.0) 1428 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:33:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:33:53 gibba045 bash[25517]: audit 2021-03-10T15:33:53.178386+0000 mon.c (mon.1) 1564 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T15:33:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:33:53 gibba045 bash[25517]: audit 2021-03-10T15:33:53.179224+0000 mon.c (mon.1) 1565 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:33:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:33:53 gibba045 bash[25517]: audit 2021-03-10T15:33:53.179284+0000 mon.a (mon.0) 1429 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:33:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:33:53 gibba045 bash[25517]: audit 2021-03-10T15:33:53.179894+0000 mon.c (mon.1) 1566 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:33:53.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:33:53 gibba045 bash[25517]: audit 2021-03-10T15:33:53.180232+0000 mon.a (mon.0) 1430 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T15:33:53.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:33:53 gibba045 bash[25517]: audit 2021-03-10T15:33:53.180688+0000 mon.c (mon.1) 1567 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:33:53.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:33:53 gibba045 bash[25517]: audit 2021-03-10T15:33:53.180963+0000 mon.a (mon.0) 1431 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:33:53.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:33:53 gibba045 bash[25517]: audit 2021-03-10T15:33:53.181195+0000 mon.a (mon.0) 1432 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:33:53.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:33:53 gibba045 bash[25517]: audit 2021-03-10T15:33:53.181399+0000 mon.a (mon.0) 1433 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:33:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:33:53 gibba015 bash[29377]: cephadm 2021-03-10T15:33:52.364031+0000 mgr.gibba045.orlgmj (mgr.34412) 5562 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:33:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:33:53 gibba015 bash[29377]: audit 2021-03-10T15:33:53.176923+0000 mon.c (mon.1) 1562 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:33:53.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:33:53 gibba015 bash[29377]: audit 2021-03-10T15:33:53.177757+0000 mon.c (mon.1) 1563 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:33:53.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:33:53 gibba015 bash[29377]: audit 2021-03-10T15:33:53.178175+0000 mon.a (mon.0) 1428 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:33:53.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:33:53 gibba015 bash[29377]: audit 2021-03-10T15:33:53.178386+0000 mon.c (mon.1) 1564 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T15:33:53.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:33:53 gibba015 bash[29377]: audit 2021-03-10T15:33:53.179224+0000 mon.c (mon.1) 1565 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:33:53.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:33:53 gibba015 bash[29377]: audit 2021-03-10T15:33:53.179284+0000 mon.a (mon.0) 1429 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:33:53.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:33:53 gibba015 bash[29377]: audit 2021-03-10T15:33:53.179894+0000 mon.c (mon.1) 1566 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:33:53.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:33:53 gibba015 bash[29377]: audit 2021-03-10T15:33:53.180232+0000 mon.a (mon.0) 1430 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T15:33:53.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:33:53 gibba015 bash[29377]: audit 2021-03-10T15:33:53.180688+0000 mon.c (mon.1) 1567 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:33:53.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:33:53 gibba015 bash[29377]: audit 2021-03-10T15:33:53.180963+0000 mon.a (mon.0) 1431 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:33:53.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:33:53 gibba015 bash[29377]: audit 2021-03-10T15:33:53.181195+0000 mon.a (mon.0) 1432 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:33:53.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:33:53 gibba015 bash[29377]: audit 2021-03-10T15:33:53.181399+0000 mon.a (mon.0) 1433 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:33:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:33:53 gibba015 bash[30343]: cephadm 2021-03-10T15:33:52.364031+0000 mgr.gibba045.orlgmj (mgr.34412) 5562 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:33:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:33:53 gibba015 bash[30343]: audit 2021-03-10T15:33:53.176923+0000 mon.c (mon.1) 1562 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:33:53.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:33:53 gibba015 bash[30343]: audit 2021-03-10T15:33:53.177757+0000 mon.c (mon.1) 1563 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:33:53.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:33:53 gibba015 bash[30343]: audit 2021-03-10T15:33:53.178175+0000 mon.a (mon.0) 1428 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:33:53.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:33:53 gibba015 bash[30343]: audit 2021-03-10T15:33:53.178386+0000 mon.c (mon.1) 1564 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T15:33:53.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:33:53 gibba015 bash[30343]: audit 2021-03-10T15:33:53.179224+0000 mon.c (mon.1) 1565 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:33:53.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:33:53 gibba015 bash[30343]: audit 2021-03-10T15:33:53.179284+0000 mon.a (mon.0) 1429 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:33:53.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:33:53 gibba015 bash[30343]: audit 2021-03-10T15:33:53.179894+0000 mon.c (mon.1) 1566 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:33:53.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:33:53 gibba015 bash[30343]: audit 2021-03-10T15:33:53.180232+0000 mon.a (mon.0) 1430 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T15:33:53.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:33:53 gibba015 bash[30343]: audit 2021-03-10T15:33:53.180688+0000 mon.c (mon.1) 1567 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:33:53.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:33:53 gibba015 bash[30343]: audit 2021-03-10T15:33:53.180963+0000 mon.a (mon.0) 1431 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:33:53.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:33:53 gibba015 bash[30343]: audit 2021-03-10T15:33:53.181195+0000 mon.a (mon.0) 1432 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:33:53.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:33:53 gibba015 bash[30343]: audit 2021-03-10T15:33:53.181399+0000 mon.a (mon.0) 1433 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:33:54.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:33:54 gibba045 bash[25517]: cluster 2021-03-10T15:33:53.511086+0000 mgr.gibba045.orlgmj (mgr.34412) 5563 : cluster [DBG] pgmap v3163: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:54.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:33:54 gibba015 bash[29377]: cluster 2021-03-10T15:33:53.511086+0000 mgr.gibba045.orlgmj (mgr.34412) 5563 : cluster [DBG] pgmap v3163: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:54.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:33:54 gibba015 bash[30343]: cluster 2021-03-10T15:33:53.511086+0000 mgr.gibba045.orlgmj (mgr.34412) 5563 : cluster [DBG] pgmap v3163: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:56.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:33:56 gibba045 bash[25517]: cluster 2021-03-10T15:33:55.512812+0000 mgr.gibba045.orlgmj (mgr.34412) 5564 : cluster [DBG] pgmap v3164: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:56.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:33:56 gibba015 bash[29377]: cluster 2021-03-10T15:33:55.512812+0000 mgr.gibba045.orlgmj (mgr.34412) 5564 : cluster [DBG] pgmap v3164: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:56.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:33:56 gibba015 bash[30343]: cluster 2021-03-10T15:33:55.512812+0000 mgr.gibba045.orlgmj (mgr.34412) 5564 : cluster [DBG] pgmap v3164: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:58.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:33:58 gibba015 bash[29377]: cluster 2021-03-10T15:33:57.514536+0000 mgr.gibba045.orlgmj (mgr.34412) 5565 : cluster [DBG] pgmap v3165: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:58.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:33:58 gibba015 bash[30343]: cluster 2021-03-10T15:33:57.514536+0000 mgr.gibba045.orlgmj (mgr.34412) 5565 : cluster [DBG] pgmap v3165: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:59.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:33:58 gibba045 bash[25517]: cluster 2021-03-10T15:33:57.514536+0000 mgr.gibba045.orlgmj (mgr.34412) 5565 : cluster [DBG] pgmap v3165: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:00.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:34:00 gibba045 bash[25517]: cluster 2021-03-10T15:33:59.515861+0000 mgr.gibba045.orlgmj (mgr.34412) 5566 : cluster [DBG] pgmap v3166: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:00.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:34:00 gibba015 bash[29377]: cluster 2021-03-10T15:33:59.515861+0000 mgr.gibba045.orlgmj (mgr.34412) 5566 : cluster [DBG] pgmap v3166: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:00.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:34:00 gibba015 bash[30343]: cluster 2021-03-10T15:33:59.515861+0000 mgr.gibba045.orlgmj (mgr.34412) 5566 : cluster [DBG] pgmap v3166: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:02.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:34:02 gibba045 bash[25517]: cluster 2021-03-10T15:34:01.517814+0000 mgr.gibba045.orlgmj (mgr.34412) 5567 : cluster [DBG] pgmap v3167: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:02.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:34:02 gibba015 bash[29377]: cluster 2021-03-10T15:34:01.517814+0000 mgr.gibba045.orlgmj (mgr.34412) 5567 : cluster [DBG] pgmap v3167: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:02.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:34:02 gibba015 bash[30343]: cluster 2021-03-10T15:34:01.517814+0000 mgr.gibba045.orlgmj (mgr.34412) 5567 : cluster [DBG] pgmap v3167: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:04.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:34:04 gibba045 bash[25517]: cluster 2021-03-10T15:34:03.519037+0000 mgr.gibba045.orlgmj (mgr.34412) 5568 : cluster [DBG] pgmap v3168: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:04.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:34:04 gibba015 bash[30343]: cluster 2021-03-10T15:34:03.519037+0000 mgr.gibba045.orlgmj (mgr.34412) 5568 : cluster [DBG] pgmap v3168: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:04.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:34:04 gibba015 bash[29377]: cluster 2021-03-10T15:34:03.519037+0000 mgr.gibba045.orlgmj (mgr.34412) 5568 : cluster [DBG] pgmap v3168: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:06.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:34:06 gibba045 bash[25517]: cluster 2021-03-10T15:34:05.520682+0000 mgr.gibba045.orlgmj (mgr.34412) 5569 : cluster [DBG] pgmap v3169: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:06.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:34:06 gibba015 bash[30343]: cluster 2021-03-10T15:34:05.520682+0000 mgr.gibba045.orlgmj (mgr.34412) 5569 : cluster [DBG] pgmap v3169: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:06.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:34:06 gibba015 bash[29377]: cluster 2021-03-10T15:34:05.520682+0000 mgr.gibba045.orlgmj (mgr.34412) 5569 : cluster [DBG] pgmap v3169: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:07.177 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:34:07.400 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:34:07.400 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (104m) 9m ago 110m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:34:07.400 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (109m) 8m ago 109m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:34:07.401 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (105m) 8m ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:34:07.401 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (105m) 8m ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:34:07.401 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (104m) 9m ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:34:07.401 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (104m) 9m ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:34:07.402 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (103m) 8m ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:34:07.402 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (104m) 9m ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:34:07.402 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (110m) 9m ago 110m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:34:07.402 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (110m) 8m ago 110m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:34:07.403 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (103m) 9m ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:34:07.403 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (102m) 9m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:34:07.403 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (102m) 9m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:34:07.403 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (101m) 9m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:34:07.404 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (101m) 8m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:34:07.404 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (101m) 8m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:34:07.404 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (100m) 8m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:34:07.404 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (100m) 8m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:34:07.405 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (109m) 8m ago 110m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:34:07.405 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 8m ago 108m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:34:07.658 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:34:07.659 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:34:07.659 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:34:07.659 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:34:07.659 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:34:07.660 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:34:07.660 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:34:07.660 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:34:07.660 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:34:07.661 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:34:07.661 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:34:07.661 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:34:07.661 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:34:07.661 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:34:07.662 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:34:07.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:34:07 gibba045 bash[25517]: audit 2021-03-10T15:34:07.376052+0000 mon.c (mon.1) 1568 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:34:07.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:34:07 gibba015 bash[29377]: audit 2021-03-10T15:34:07.376052+0000 mon.c (mon.1) 1568 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:34:07.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:34:07 gibba015 bash[30343]: audit 2021-03-10T15:34:07.376052+0000 mon.c (mon.1) 1568 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:34:08.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:34:08 gibba015 bash[29377]: audit 2021-03-10T15:34:07.167191+0000 mgr.gibba045.orlgmj (mgr.34412) 5570 : audit [DBG] from='client.57784 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:34:08.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:34:08 gibba015 bash[29377]: cephadm 2021-03-10T15:34:07.381616+0000 mgr.gibba045.orlgmj (mgr.34412) 5571 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:34:08.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:34:08 gibba015 bash[29377]: cephadm 2021-03-10T15:34:07.382087+0000 mgr.gibba045.orlgmj (mgr.34412) 5572 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:34:08.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:34:08 gibba015 bash[29377]: audit 2021-03-10T15:34:07.390425+0000 mgr.gibba045.orlgmj (mgr.34412) 5573 : audit [DBG] from='client.57790 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:34:08.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:34:08 gibba015 bash[29377]: cluster 2021-03-10T15:34:07.521215+0000 mgr.gibba045.orlgmj (mgr.34412) 5574 : cluster [DBG] pgmap v3170: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:08.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:34:08 gibba015 bash[29377]: audit 2021-03-10T15:34:07.590172+0000 mon.a (mon.0) 1434 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:34:08.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:34:08 gibba015 bash[29377]: audit 2021-03-10T15:34:07.593950+0000 mon.c (mon.1) 1569 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:34:08.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:34:08 gibba015 bash[29377]: audit 2021-03-10T15:34:07.595250+0000 mon.c (mon.1) 1570 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:34:08.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:34:08 gibba015 bash[29377]: audit 2021-03-10T15:34:07.596420+0000 mon.c (mon.1) 1571 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:34:08.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:34:08 gibba015 bash[29377]: cephadm 2021-03-10T15:34:07.596964+0000 mgr.gibba045.orlgmj (mgr.34412) 5575 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:34:08.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:34:08 gibba015 bash[29377]: audit 2021-03-10T15:34:07.597557+0000 mon.c (mon.1) 1572 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:34:08.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:34:08 gibba015 bash[29377]: cephadm 2021-03-10T15:34:07.598730+0000 mgr.gibba045.orlgmj (mgr.34412) 5576 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:34:08.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:34:08 gibba015 bash[29377]: cephadm 2021-03-10T15:34:07.599849+0000 mgr.gibba045.orlgmj (mgr.34412) 5577 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:34:08.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:34:08 gibba015 bash[29377]: cephadm 2021-03-10T15:34:07.599898+0000 mgr.gibba045.orlgmj (mgr.34412) 5578 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:34:08.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:34:08 gibba015 bash[29377]: audit 2021-03-10T15:34:07.600312+0000 mon.c (mon.1) 1573 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:34:08.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:34:08 gibba015 bash[29377]: cephadm 2021-03-10T15:34:07.601024+0000 mgr.gibba045.orlgmj (mgr.34412) 5579 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:34:08.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:34:08 gibba015 bash[29377]: cephadm 2021-03-10T15:34:07.601072+0000 mgr.gibba045.orlgmj (mgr.34412) 5580 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:34:08.980 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:34:08 gibba015 bash[29377]: audit 2021-03-10T15:34:07.601837+0000 mon.c (mon.1) 1574 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:34:08.980 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:34:08 gibba015 bash[29377]: cephadm 2021-03-10T15:34:07.602159+0000 mgr.gibba045.orlgmj (mgr.34412) 5581 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:34:08.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:34:08 gibba015 bash[30343]: audit 2021-03-10T15:34:07.167191+0000 mgr.gibba045.orlgmj (mgr.34412) 5570 : audit [DBG] from='client.57784 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:34:08.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:34:08 gibba015 bash[30343]: cephadm 2021-03-10T15:34:07.381616+0000 mgr.gibba045.orlgmj (mgr.34412) 5571 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:34:08.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:34:08 gibba015 bash[30343]: cephadm 2021-03-10T15:34:07.382087+0000 mgr.gibba045.orlgmj (mgr.34412) 5572 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:34:08.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:34:08 gibba015 bash[30343]: audit 2021-03-10T15:34:07.390425+0000 mgr.gibba045.orlgmj (mgr.34412) 5573 : audit [DBG] from='client.57790 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:34:08.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:34:08 gibba015 bash[30343]: cluster 2021-03-10T15:34:07.521215+0000 mgr.gibba045.orlgmj (mgr.34412) 5574 : cluster [DBG] pgmap v3170: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:08.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:34:08 gibba015 bash[30343]: audit 2021-03-10T15:34:07.590172+0000 mon.a (mon.0) 1434 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:34:08.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:34:08 gibba015 bash[30343]: audit 2021-03-10T15:34:07.593950+0000 mon.c (mon.1) 1569 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:34:08.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:34:08 gibba015 bash[30343]: audit 2021-03-10T15:34:07.595250+0000 mon.c (mon.1) 1570 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:34:08.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:34:08 gibba015 bash[30343]: audit 2021-03-10T15:34:07.596420+0000 mon.c (mon.1) 1571 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:34:08.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:34:08 gibba015 bash[30343]: cephadm 2021-03-10T15:34:07.596964+0000 mgr.gibba045.orlgmj (mgr.34412) 5575 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:34:08.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:34:08 gibba015 bash[30343]: audit 2021-03-10T15:34:07.597557+0000 mon.c (mon.1) 1572 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:34:08.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:34:08 gibba015 bash[30343]: cephadm 2021-03-10T15:34:07.598730+0000 mgr.gibba045.orlgmj (mgr.34412) 5576 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:34:08.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:34:08 gibba015 bash[30343]: cephadm 2021-03-10T15:34:07.599849+0000 mgr.gibba045.orlgmj (mgr.34412) 5577 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:34:08.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:34:08 gibba015 bash[30343]: cephadm 2021-03-10T15:34:07.599898+0000 mgr.gibba045.orlgmj (mgr.34412) 5578 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:34:08.984 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:34:08 gibba015 bash[30343]: audit 2021-03-10T15:34:07.600312+0000 mon.c (mon.1) 1573 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:34:08.984 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:34:08 gibba015 bash[30343]: cephadm 2021-03-10T15:34:07.601024+0000 mgr.gibba045.orlgmj (mgr.34412) 5579 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:34:08.984 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:34:08 gibba015 bash[30343]: cephadm 2021-03-10T15:34:07.601072+0000 mgr.gibba045.orlgmj (mgr.34412) 5580 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:34:08.984 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:34:08 gibba015 bash[30343]: audit 2021-03-10T15:34:07.601837+0000 mon.c (mon.1) 1574 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:34:08.985 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:34:08 gibba015 bash[30343]: cephadm 2021-03-10T15:34:07.602159+0000 mgr.gibba045.orlgmj (mgr.34412) 5581 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:34:08.985 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:34:08 gibba015 bash[29377]: cephadm 2021-03-10T15:34:07.603609+0000 mgr.gibba045.orlgmj (mgr.34412) 5582 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:34:08.985 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:34:08 gibba015 bash[29377]: cephadm 2021-03-10T15:34:07.603661+0000 mgr.gibba045.orlgmj (mgr.34412) 5583 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:34:08.986 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:34:08 gibba015 bash[29377]: cephadm 2021-03-10T15:34:07.604957+0000 mgr.gibba045.orlgmj (mgr.34412) 5584 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:34:08.986 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:34:08 gibba015 bash[29377]: cephadm 2021-03-10T15:34:07.605374+0000 mgr.gibba045.orlgmj (mgr.34412) 5585 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:34:08.986 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:34:08 gibba015 bash[29377]: cephadm 2021-03-10T15:34:07.606680+0000 mgr.gibba045.orlgmj (mgr.34412) 5586 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:34:08.986 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:34:08 gibba015 bash[29377]: cephadm 2021-03-10T15:34:07.606730+0000 mgr.gibba045.orlgmj (mgr.34412) 5587 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:34:08.987 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:34:08 gibba015 bash[29377]: cephadm 2021-03-10T15:34:07.606870+0000 mgr.gibba045.orlgmj (mgr.34412) 5588 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:34:08.987 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:34:08 gibba015 bash[29377]: audit 2021-03-10T15:34:07.653685+0000 mon.c (mon.1) 1575 : audit [DBG] from='client.? 172.21.2.115:0/3536708195' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:34:08.987 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:34:08 gibba015 bash[30343]: cephadm 2021-03-10T15:34:07.603609+0000 mgr.gibba045.orlgmj (mgr.34412) 5582 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:34:08.987 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:34:08 gibba015 bash[30343]: cephadm 2021-03-10T15:34:07.603661+0000 mgr.gibba045.orlgmj (mgr.34412) 5583 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:34:08.988 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:34:08 gibba015 bash[30343]: cephadm 2021-03-10T15:34:07.604957+0000 mgr.gibba045.orlgmj (mgr.34412) 5584 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:34:08.988 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:34:08 gibba015 bash[30343]: cephadm 2021-03-10T15:34:07.605374+0000 mgr.gibba045.orlgmj (mgr.34412) 5585 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:34:08.988 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:34:08 gibba015 bash[30343]: cephadm 2021-03-10T15:34:07.606680+0000 mgr.gibba045.orlgmj (mgr.34412) 5586 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:34:08.988 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:34:08 gibba015 bash[30343]: cephadm 2021-03-10T15:34:07.606730+0000 mgr.gibba045.orlgmj (mgr.34412) 5587 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:34:08.989 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:34:08 gibba015 bash[30343]: cephadm 2021-03-10T15:34:07.606870+0000 mgr.gibba045.orlgmj (mgr.34412) 5588 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:34:08.989 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:34:08 gibba015 bash[30343]: audit 2021-03-10T15:34:07.653685+0000 mon.c (mon.1) 1575 : audit [DBG] from='client.? 172.21.2.115:0/3536708195' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:34:09.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:34:08 gibba045 bash[25517]: audit 2021-03-10T15:34:07.167191+0000 mgr.gibba045.orlgmj (mgr.34412) 5570 : audit [DBG] from='client.57784 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:34:09.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:34:08 gibba045 bash[25517]: cephadm 2021-03-10T15:34:07.381616+0000 mgr.gibba045.orlgmj (mgr.34412) 5571 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:34:09.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:34:08 gibba045 bash[25517]: cephadm 2021-03-10T15:34:07.382087+0000 mgr.gibba045.orlgmj (mgr.34412) 5572 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:34:09.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:34:08 gibba045 bash[25517]: audit 2021-03-10T15:34:07.390425+0000 mgr.gibba045.orlgmj (mgr.34412) 5573 : audit [DBG] from='client.57790 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:34:09.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:34:08 gibba045 bash[25517]: cluster 2021-03-10T15:34:07.521215+0000 mgr.gibba045.orlgmj (mgr.34412) 5574 : cluster [DBG] pgmap v3170: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:09.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:34:08 gibba045 bash[25517]: audit 2021-03-10T15:34:07.590172+0000 mon.a (mon.0) 1434 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:34:09.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:34:08 gibba045 bash[25517]: audit 2021-03-10T15:34:07.593950+0000 mon.c (mon.1) 1569 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:34:09.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:34:08 gibba045 bash[25517]: audit 2021-03-10T15:34:07.595250+0000 mon.c (mon.1) 1570 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:34:09.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:34:08 gibba045 bash[25517]: audit 2021-03-10T15:34:07.596420+0000 mon.c (mon.1) 1571 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:34:09.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:34:08 gibba045 bash[25517]: cephadm 2021-03-10T15:34:07.596964+0000 mgr.gibba045.orlgmj (mgr.34412) 5575 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:34:09.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:34:08 gibba045 bash[25517]: audit 2021-03-10T15:34:07.597557+0000 mon.c (mon.1) 1572 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:34:09.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:34:08 gibba045 bash[25517]: cephadm 2021-03-10T15:34:07.598730+0000 mgr.gibba045.orlgmj (mgr.34412) 5576 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:34:09.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:34:08 gibba045 bash[25517]: cephadm 2021-03-10T15:34:07.599849+0000 mgr.gibba045.orlgmj (mgr.34412) 5577 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:34:09.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:34:08 gibba045 bash[25517]: cephadm 2021-03-10T15:34:07.599898+0000 mgr.gibba045.orlgmj (mgr.34412) 5578 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:34:09.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:34:08 gibba045 bash[25517]: audit 2021-03-10T15:34:07.600312+0000 mon.c (mon.1) 1573 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:34:09.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:34:08 gibba045 bash[25517]: cephadm 2021-03-10T15:34:07.601024+0000 mgr.gibba045.orlgmj (mgr.34412) 5579 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:34:09.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:34:08 gibba045 bash[25517]: cephadm 2021-03-10T15:34:07.601072+0000 mgr.gibba045.orlgmj (mgr.34412) 5580 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:34:09.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:34:08 gibba045 bash[25517]: audit 2021-03-10T15:34:07.601837+0000 mon.c (mon.1) 1574 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:34:09.062 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:34:08 gibba045 bash[25517]: cephadm 2021-03-10T15:34:07.602159+0000 mgr.gibba045.orlgmj (mgr.34412) 5581 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:34:09.062 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:34:08 gibba045 bash[25517]: cephadm 2021-03-10T15:34:07.603609+0000 mgr.gibba045.orlgmj (mgr.34412) 5582 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:34:09.062 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:34:08 gibba045 bash[25517]: cephadm 2021-03-10T15:34:07.603661+0000 mgr.gibba045.orlgmj (mgr.34412) 5583 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:34:09.062 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:34:08 gibba045 bash[25517]: cephadm 2021-03-10T15:34:07.604957+0000 mgr.gibba045.orlgmj (mgr.34412) 5584 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:34:09.063 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:34:08 gibba045 bash[25517]: cephadm 2021-03-10T15:34:07.605374+0000 mgr.gibba045.orlgmj (mgr.34412) 5585 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:34:09.063 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:34:08 gibba045 bash[25517]: cephadm 2021-03-10T15:34:07.606680+0000 mgr.gibba045.orlgmj (mgr.34412) 5586 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:34:09.063 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:34:08 gibba045 bash[25517]: cephadm 2021-03-10T15:34:07.606730+0000 mgr.gibba045.orlgmj (mgr.34412) 5587 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:34:09.063 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:34:08 gibba045 bash[25517]: cephadm 2021-03-10T15:34:07.606870+0000 mgr.gibba045.orlgmj (mgr.34412) 5588 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:34:09.063 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:34:08 gibba045 bash[25517]: audit 2021-03-10T15:34:07.653685+0000 mon.c (mon.1) 1575 : audit [DBG] from='client.? 172.21.2.115:0/3536708195' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:34:10.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:34:10 gibba045 bash[25517]: cluster 2021-03-10T15:34:09.522391+0000 mgr.gibba045.orlgmj (mgr.34412) 5589 : cluster [DBG] pgmap v3171: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:10.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:34:10 gibba015 bash[29377]: cluster 2021-03-10T15:34:09.522391+0000 mgr.gibba045.orlgmj (mgr.34412) 5589 : cluster [DBG] pgmap v3171: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:10.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:34:10 gibba015 bash[30343]: cluster 2021-03-10T15:34:09.522391+0000 mgr.gibba045.orlgmj (mgr.34412) 5589 : cluster [DBG] pgmap v3171: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:12.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:34:12 gibba045 bash[25517]: cluster 2021-03-10T15:34:11.524225+0000 mgr.gibba045.orlgmj (mgr.34412) 5590 : cluster [DBG] pgmap v3172: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:12.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:34:12 gibba015 bash[29377]: cluster 2021-03-10T15:34:11.524225+0000 mgr.gibba045.orlgmj (mgr.34412) 5590 : cluster [DBG] pgmap v3172: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:12.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:34:12 gibba015 bash[30343]: cluster 2021-03-10T15:34:11.524225+0000 mgr.gibba045.orlgmj (mgr.34412) 5590 : cluster [DBG] pgmap v3172: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:14.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:34:14 gibba045 bash[25517]: cluster 2021-03-10T15:34:13.525533+0000 mgr.gibba045.orlgmj (mgr.34412) 5591 : cluster [DBG] pgmap v3173: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:14.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:34:14 gibba015 bash[29377]: cluster 2021-03-10T15:34:13.525533+0000 mgr.gibba045.orlgmj (mgr.34412) 5591 : cluster [DBG] pgmap v3173: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:14.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:34:14 gibba015 bash[30343]: cluster 2021-03-10T15:34:13.525533+0000 mgr.gibba045.orlgmj (mgr.34412) 5591 : cluster [DBG] pgmap v3173: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:16.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:34:16 gibba015 bash[29377]: cluster 2021-03-10T15:34:15.527162+0000 mgr.gibba045.orlgmj (mgr.34412) 5592 : cluster [DBG] pgmap v3174: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:16.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:34:16 gibba015 bash[30343]: cluster 2021-03-10T15:34:15.527162+0000 mgr.gibba045.orlgmj (mgr.34412) 5592 : cluster [DBG] pgmap v3174: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:17.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:34:16 gibba045 bash[25517]: cluster 2021-03-10T15:34:15.527162+0000 mgr.gibba045.orlgmj (mgr.34412) 5592 : cluster [DBG] pgmap v3174: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:18.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:34:18 gibba015 bash[29377]: cluster 2021-03-10T15:34:17.528978+0000 mgr.gibba045.orlgmj (mgr.34412) 5593 : cluster [DBG] pgmap v3175: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:18.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:34:18 gibba015 bash[30343]: cluster 2021-03-10T15:34:17.528978+0000 mgr.gibba045.orlgmj (mgr.34412) 5593 : cluster [DBG] pgmap v3175: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:19.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:34:18 gibba045 bash[25517]: cluster 2021-03-10T15:34:17.528978+0000 mgr.gibba045.orlgmj (mgr.34412) 5593 : cluster [DBG] pgmap v3175: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:20.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:34:20 gibba045 bash[25517]: cluster 2021-03-10T15:34:19.530290+0000 mgr.gibba045.orlgmj (mgr.34412) 5594 : cluster [DBG] pgmap v3176: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:20.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:34:20 gibba015 bash[29377]: cluster 2021-03-10T15:34:19.530290+0000 mgr.gibba045.orlgmj (mgr.34412) 5594 : cluster [DBG] pgmap v3176: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:20.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:34:20 gibba015 bash[30343]: cluster 2021-03-10T15:34:19.530290+0000 mgr.gibba045.orlgmj (mgr.34412) 5594 : cluster [DBG] pgmap v3176: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:22.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:34:22 gibba015 bash[29377]: cluster 2021-03-10T15:34:21.532156+0000 mgr.gibba045.orlgmj (mgr.34412) 5595 : cluster [DBG] pgmap v3177: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:22.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:34:22 gibba015 bash[30343]: cluster 2021-03-10T15:34:21.532156+0000 mgr.gibba045.orlgmj (mgr.34412) 5595 : cluster [DBG] pgmap v3177: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:23.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:34:22 gibba045 bash[25517]: cluster 2021-03-10T15:34:21.532156+0000 mgr.gibba045.orlgmj (mgr.34412) 5595 : cluster [DBG] pgmap v3177: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:23.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:34:23 gibba015 bash[29377]: cephadm 2021-03-10T15:34:22.609557+0000 mgr.gibba045.orlgmj (mgr.34412) 5596 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:34:23.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:34:23 gibba015 bash[30343]: cephadm 2021-03-10T15:34:22.609557+0000 mgr.gibba045.orlgmj (mgr.34412) 5596 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:34:24.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:34:23 gibba045 bash[25517]: cephadm 2021-03-10T15:34:22.609557+0000 mgr.gibba045.orlgmj (mgr.34412) 5596 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:34:24.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:34:24 gibba015 bash[29377]: cluster 2021-03-10T15:34:23.533507+0000 mgr.gibba045.orlgmj (mgr.34412) 5597 : cluster [DBG] pgmap v3178: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:24.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:34:24 gibba015 bash[30343]: cluster 2021-03-10T15:34:23.533507+0000 mgr.gibba045.orlgmj (mgr.34412) 5597 : cluster [DBG] pgmap v3178: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:25.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:34:24 gibba045 bash[25517]: cluster 2021-03-10T15:34:23.533507+0000 mgr.gibba045.orlgmj (mgr.34412) 5597 : cluster [DBG] pgmap v3178: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:26.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:34:26 gibba015 bash[29377]: cluster 2021-03-10T15:34:25.534910+0000 mgr.gibba045.orlgmj (mgr.34412) 5598 : cluster [DBG] pgmap v3179: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:26.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:34:26 gibba015 bash[30343]: cluster 2021-03-10T15:34:25.534910+0000 mgr.gibba045.orlgmj (mgr.34412) 5598 : cluster [DBG] pgmap v3179: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:27.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:34:26 gibba045 bash[25517]: cluster 2021-03-10T15:34:25.534910+0000 mgr.gibba045.orlgmj (mgr.34412) 5598 : cluster [DBG] pgmap v3179: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:28.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:34:28 gibba015 bash[29377]: cluster 2021-03-10T15:34:27.536695+0000 mgr.gibba045.orlgmj (mgr.34412) 5599 : cluster [DBG] pgmap v3180: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:28.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:34:28 gibba015 bash[30343]: cluster 2021-03-10T15:34:27.536695+0000 mgr.gibba045.orlgmj (mgr.34412) 5599 : cluster [DBG] pgmap v3180: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:29.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:34:28 gibba045 bash[25517]: cluster 2021-03-10T15:34:27.536695+0000 mgr.gibba045.orlgmj (mgr.34412) 5599 : cluster [DBG] pgmap v3180: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:30.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:34:30 gibba045 bash[25517]: cluster 2021-03-10T15:34:29.537990+0000 mgr.gibba045.orlgmj (mgr.34412) 5600 : cluster [DBG] pgmap v3181: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:30.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:34:30 gibba015 bash[29377]: cluster 2021-03-10T15:34:29.537990+0000 mgr.gibba045.orlgmj (mgr.34412) 5600 : cluster [DBG] pgmap v3181: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:30.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:34:30 gibba015 bash[30343]: cluster 2021-03-10T15:34:29.537990+0000 mgr.gibba045.orlgmj (mgr.34412) 5600 : cluster [DBG] pgmap v3181: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:32.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:34:32 gibba015 bash[29377]: cluster 2021-03-10T15:34:31.539899+0000 mgr.gibba045.orlgmj (mgr.34412) 5601 : cluster [DBG] pgmap v3182: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:32.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:34:32 gibba015 bash[30343]: cluster 2021-03-10T15:34:31.539899+0000 mgr.gibba045.orlgmj (mgr.34412) 5601 : cluster [DBG] pgmap v3182: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:33.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:34:32 gibba045 bash[25517]: cluster 2021-03-10T15:34:31.539899+0000 mgr.gibba045.orlgmj (mgr.34412) 5601 : cluster [DBG] pgmap v3182: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:34.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:34:34 gibba015 bash[29377]: cluster 2021-03-10T15:34:33.541137+0000 mgr.gibba045.orlgmj (mgr.34412) 5602 : cluster [DBG] pgmap v3183: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:34.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:34:34 gibba015 bash[30343]: cluster 2021-03-10T15:34:33.541137+0000 mgr.gibba045.orlgmj (mgr.34412) 5602 : cluster [DBG] pgmap v3183: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:35.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:34:34 gibba045 bash[25517]: cluster 2021-03-10T15:34:33.541137+0000 mgr.gibba045.orlgmj (mgr.34412) 5602 : cluster [DBG] pgmap v3183: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:36.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:34:36 gibba015 bash[29377]: cluster 2021-03-10T15:34:35.542731+0000 mgr.gibba045.orlgmj (mgr.34412) 5603 : cluster [DBG] pgmap v3184: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:36.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:34:36 gibba015 bash[30343]: cluster 2021-03-10T15:34:35.542731+0000 mgr.gibba045.orlgmj (mgr.34412) 5603 : cluster [DBG] pgmap v3184: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:37.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:34:36 gibba045 bash[25517]: cluster 2021-03-10T15:34:35.542731+0000 mgr.gibba045.orlgmj (mgr.34412) 5603 : cluster [DBG] pgmap v3184: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:37.899 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:34:38.129 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:34:38.130 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (105m) 9m ago 110m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:34:38.130 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (110m) 8m ago 110m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:34:38.130 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (105m) 8m ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:34:38.130 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (106m) 8m ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:34:38.131 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (105m) 9m ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:34:38.131 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (104m) 9m ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:34:38.131 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (104m) 8m ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:34:38.131 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (104m) 9m ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:34:38.132 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (110m) 9m ago 110m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:34:38.132 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (110m) 8m ago 110m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:34:38.132 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (103m) 9m ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:34:38.132 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (103m) 9m ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:34:38.133 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (102m) 9m ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:34:38.133 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (102m) 9m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:34:38.133 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (101m) 8m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:34:38.133 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (101m) 8m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:34:38.133 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (101m) 8m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:34:38.134 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (100m) 8m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:34:38.134 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (110m) 8m ago 110m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:34:38.134 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 8m ago 108m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:34:38.378 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:34:38.379 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:34:38.379 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:34:38.379 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:34:38.380 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:34:38.380 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:34:38.380 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:34:38.380 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:34:38.380 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:34:38.381 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:34:38.381 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:34:38.381 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:34:38.381 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:34:38.382 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:34:38.382 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:34:38.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:34:38 gibba015 bash[29377]: cluster 2021-03-10T15:34:37.544332+0000 mgr.gibba045.orlgmj (mgr.34412) 5604 : cluster [DBG] pgmap v3185: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:38.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:34:38 gibba015 bash[29377]: cephadm 2021-03-10T15:34:37.613549+0000 mgr.gibba045.orlgmj (mgr.34412) 5605 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:34:38.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:34:38 gibba015 bash[29377]: audit 2021-03-10T15:34:37.889436+0000 mgr.gibba045.orlgmj (mgr.34412) 5606 : audit [DBG] from='client.47814 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:34:38.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:34:38 gibba015 bash[29377]: audit 2021-03-10T15:34:38.116054+0000 mgr.gibba045.orlgmj (mgr.34412) 5607 : audit [DBG] from='client.57808 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:34:38.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:34:38 gibba015 bash[29377]: audit 2021-03-10T15:34:38.373460+0000 mon.a (mon.0) 1435 : audit [DBG] from='client.? 172.21.2.115:0/1968325113' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:34:38.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:34:38 gibba015 bash[30343]: cluster 2021-03-10T15:34:37.544332+0000 mgr.gibba045.orlgmj (mgr.34412) 5604 : cluster [DBG] pgmap v3185: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:38.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:34:38 gibba015 bash[30343]: cephadm 2021-03-10T15:34:37.613549+0000 mgr.gibba045.orlgmj (mgr.34412) 5605 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:34:38.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:34:38 gibba015 bash[30343]: audit 2021-03-10T15:34:37.889436+0000 mgr.gibba045.orlgmj (mgr.34412) 5606 : audit [DBG] from='client.47814 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:34:38.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:34:38 gibba015 bash[30343]: audit 2021-03-10T15:34:38.116054+0000 mgr.gibba045.orlgmj (mgr.34412) 5607 : audit [DBG] from='client.57808 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:34:38.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:34:38 gibba015 bash[30343]: audit 2021-03-10T15:34:38.373460+0000 mon.a (mon.0) 1435 : audit [DBG] from='client.? 172.21.2.115:0/1968325113' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:34:39.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:34:38 gibba045 bash[25517]: cluster 2021-03-10T15:34:37.544332+0000 mgr.gibba045.orlgmj (mgr.34412) 5604 : cluster [DBG] pgmap v3185: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:39.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:34:38 gibba045 bash[25517]: cephadm 2021-03-10T15:34:37.613549+0000 mgr.gibba045.orlgmj (mgr.34412) 5605 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:34:39.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:34:38 gibba045 bash[25517]: audit 2021-03-10T15:34:37.889436+0000 mgr.gibba045.orlgmj (mgr.34412) 5606 : audit [DBG] from='client.47814 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:34:39.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:34:38 gibba045 bash[25517]: audit 2021-03-10T15:34:38.116054+0000 mgr.gibba045.orlgmj (mgr.34412) 5607 : audit [DBG] from='client.57808 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:34:39.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:34:38 gibba045 bash[25517]: audit 2021-03-10T15:34:38.373460+0000 mon.a (mon.0) 1435 : audit [DBG] from='client.? 172.21.2.115:0/1968325113' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:34:40.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:34:40 gibba045 bash[25517]: cluster 2021-03-10T15:34:39.544848+0000 mgr.gibba045.orlgmj (mgr.34412) 5608 : cluster [DBG] pgmap v3186: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:40.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:34:40 gibba015 bash[29377]: cluster 2021-03-10T15:34:39.544848+0000 mgr.gibba045.orlgmj (mgr.34412) 5608 : cluster [DBG] pgmap v3186: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:40.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:34:40 gibba015 bash[30343]: cluster 2021-03-10T15:34:39.544848+0000 mgr.gibba045.orlgmj (mgr.34412) 5608 : cluster [DBG] pgmap v3186: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:42.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:34:42 gibba015 bash[29377]: cluster 2021-03-10T15:34:41.546650+0000 mgr.gibba045.orlgmj (mgr.34412) 5609 : cluster [DBG] pgmap v3187: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:42.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:34:42 gibba015 bash[30343]: cluster 2021-03-10T15:34:41.546650+0000 mgr.gibba045.orlgmj (mgr.34412) 5609 : cluster [DBG] pgmap v3187: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:43.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:34:42 gibba045 bash[25517]: cluster 2021-03-10T15:34:41.546650+0000 mgr.gibba045.orlgmj (mgr.34412) 5609 : cluster [DBG] pgmap v3187: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:44.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:34:44 gibba015 bash[29377]: cluster 2021-03-10T15:34:43.547958+0000 mgr.gibba045.orlgmj (mgr.34412) 5610 : cluster [DBG] pgmap v3188: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:44.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:34:44 gibba015 bash[30343]: cluster 2021-03-10T15:34:43.547958+0000 mgr.gibba045.orlgmj (mgr.34412) 5610 : cluster [DBG] pgmap v3188: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:45.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:34:44 gibba045 bash[25517]: cluster 2021-03-10T15:34:43.547958+0000 mgr.gibba045.orlgmj (mgr.34412) 5610 : cluster [DBG] pgmap v3188: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:46.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:34:46 gibba015 bash[29377]: cluster 2021-03-10T15:34:45.549386+0000 mgr.gibba045.orlgmj (mgr.34412) 5611 : cluster [DBG] pgmap v3189: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:46.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:34:46 gibba015 bash[30343]: cluster 2021-03-10T15:34:45.549386+0000 mgr.gibba045.orlgmj (mgr.34412) 5611 : cluster [DBG] pgmap v3189: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:47.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:34:46 gibba045 bash[25517]: cluster 2021-03-10T15:34:45.549386+0000 mgr.gibba045.orlgmj (mgr.34412) 5611 : cluster [DBG] pgmap v3189: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:48.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:34:48 gibba015 bash[29377]: cluster 2021-03-10T15:34:47.551141+0000 mgr.gibba045.orlgmj (mgr.34412) 5612 : cluster [DBG] pgmap v3190: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:48.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:34:48 gibba015 bash[30343]: cluster 2021-03-10T15:34:47.551141+0000 mgr.gibba045.orlgmj (mgr.34412) 5612 : cluster [DBG] pgmap v3190: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:49.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:34:48 gibba045 bash[25517]: cluster 2021-03-10T15:34:47.551141+0000 mgr.gibba045.orlgmj (mgr.34412) 5612 : cluster [DBG] pgmap v3190: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:50.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:34:50 gibba045 bash[25517]: cluster 2021-03-10T15:34:49.551914+0000 mgr.gibba045.orlgmj (mgr.34412) 5613 : cluster [DBG] pgmap v3191: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:50.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:34:50 gibba015 bash[29377]: cluster 2021-03-10T15:34:49.551914+0000 mgr.gibba045.orlgmj (mgr.34412) 5613 : cluster [DBG] pgmap v3191: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:50.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:34:50 gibba015 bash[30343]: cluster 2021-03-10T15:34:49.551914+0000 mgr.gibba045.orlgmj (mgr.34412) 5613 : cluster [DBG] pgmap v3191: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:52.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:34:52 gibba015 bash[29377]: cluster 2021-03-10T15:34:51.553620+0000 mgr.gibba045.orlgmj (mgr.34412) 5614 : cluster [DBG] pgmap v3192: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:52.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:34:52 gibba015 bash[30343]: cluster 2021-03-10T15:34:51.553620+0000 mgr.gibba045.orlgmj (mgr.34412) 5614 : cluster [DBG] pgmap v3192: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:53.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:34:52 gibba045 bash[25517]: cluster 2021-03-10T15:34:51.553620+0000 mgr.gibba045.orlgmj (mgr.34412) 5614 : cluster [DBG] pgmap v3192: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:34:53 gibba015 bash[29377]: cephadm 2021-03-10T15:34:52.628788+0000 mgr.gibba045.orlgmj (mgr.34412) 5615 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:34:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:34:53 gibba015 bash[29377]: audit 2021-03-10T15:34:53.183187+0000 mon.c (mon.1) 1576 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:34:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:34:53 gibba015 bash[29377]: audit 2021-03-10T15:34:53.184099+0000 mon.c (mon.1) 1577 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:34:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:34:53 gibba015 bash[29377]: audit 2021-03-10T15:34:53.184308+0000 mon.a (mon.0) 1436 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:34:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:34:53 gibba015 bash[29377]: audit 2021-03-10T15:34:53.185014+0000 mon.c (mon.1) 1578 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T15:34:53.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:34:53 gibba015 bash[29377]: audit 2021-03-10T15:34:53.185263+0000 mon.a (mon.0) 1437 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:34:53.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:34:53 gibba015 bash[29377]: audit 2021-03-10T15:34:53.186134+0000 mon.c (mon.1) 1579 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:34:53.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:34:53 gibba015 bash[29377]: audit 2021-03-10T15:34:53.186196+0000 mon.a (mon.0) 1438 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T15:34:53.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:34:53 gibba015 bash[29377]: audit 2021-03-10T15:34:53.187252+0000 mon.a (mon.0) 1439 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:34:53.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:34:53 gibba015 bash[29377]: audit 2021-03-10T15:34:53.187506+0000 mon.c (mon.1) 1580 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:34:53.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:34:53 gibba015 bash[29377]: audit 2021-03-10T15:34:53.188096+0000 mon.a (mon.0) 1440 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:34:53.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:34:53 gibba015 bash[29377]: audit 2021-03-10T15:34:53.188097+0000 mon.c (mon.1) 1581 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:34:53.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:34:53 gibba015 bash[29377]: audit 2021-03-10T15:34:53.188470+0000 mon.a (mon.0) 1441 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:34:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:34:53 gibba015 bash[30343]: cephadm 2021-03-10T15:34:52.628788+0000 mgr.gibba045.orlgmj (mgr.34412) 5615 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:34:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:34:53 gibba015 bash[30343]: audit 2021-03-10T15:34:53.183187+0000 mon.c (mon.1) 1576 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:34:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:34:53 gibba015 bash[30343]: audit 2021-03-10T15:34:53.184099+0000 mon.c (mon.1) 1577 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:34:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:34:53 gibba015 bash[30343]: audit 2021-03-10T15:34:53.184308+0000 mon.a (mon.0) 1436 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:34:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:34:53 gibba015 bash[30343]: audit 2021-03-10T15:34:53.185014+0000 mon.c (mon.1) 1578 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T15:34:53.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:34:53 gibba015 bash[30343]: audit 2021-03-10T15:34:53.185263+0000 mon.a (mon.0) 1437 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:34:53.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:34:53 gibba015 bash[30343]: audit 2021-03-10T15:34:53.186134+0000 mon.c (mon.1) 1579 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:34:53.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:34:53 gibba015 bash[30343]: audit 2021-03-10T15:34:53.186196+0000 mon.a (mon.0) 1438 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T15:34:53.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:34:53 gibba015 bash[30343]: audit 2021-03-10T15:34:53.187252+0000 mon.a (mon.0) 1439 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:34:53.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:34:53 gibba015 bash[30343]: audit 2021-03-10T15:34:53.187506+0000 mon.c (mon.1) 1580 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:34:53.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:34:53 gibba015 bash[30343]: audit 2021-03-10T15:34:53.188096+0000 mon.a (mon.0) 1440 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:34:53.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:34:53 gibba015 bash[30343]: audit 2021-03-10T15:34:53.188097+0000 mon.c (mon.1) 1581 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:34:53.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:34:53 gibba015 bash[30343]: audit 2021-03-10T15:34:53.188470+0000 mon.a (mon.0) 1441 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:34:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:34:53 gibba045 bash[25517]: cephadm 2021-03-10T15:34:52.628788+0000 mgr.gibba045.orlgmj (mgr.34412) 5615 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:34:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:34:53 gibba045 bash[25517]: audit 2021-03-10T15:34:53.183187+0000 mon.c (mon.1) 1576 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:34:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:34:53 gibba045 bash[25517]: audit 2021-03-10T15:34:53.184099+0000 mon.c (mon.1) 1577 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:34:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:34:53 gibba045 bash[25517]: audit 2021-03-10T15:34:53.184308+0000 mon.a (mon.0) 1436 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:34:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:34:53 gibba045 bash[25517]: audit 2021-03-10T15:34:53.185014+0000 mon.c (mon.1) 1578 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T15:34:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:34:53 gibba045 bash[25517]: audit 2021-03-10T15:34:53.185263+0000 mon.a (mon.0) 1437 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:34:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:34:53 gibba045 bash[25517]: audit 2021-03-10T15:34:53.186134+0000 mon.c (mon.1) 1579 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:34:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:34:53 gibba045 bash[25517]: audit 2021-03-10T15:34:53.186196+0000 mon.a (mon.0) 1438 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T15:34:54.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:34:53 gibba045 bash[25517]: audit 2021-03-10T15:34:53.187252+0000 mon.a (mon.0) 1439 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:34:54.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:34:53 gibba045 bash[25517]: audit 2021-03-10T15:34:53.187506+0000 mon.c (mon.1) 1580 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:34:54.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:34:53 gibba045 bash[25517]: audit 2021-03-10T15:34:53.188096+0000 mon.a (mon.0) 1440 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:34:54.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:34:53 gibba045 bash[25517]: audit 2021-03-10T15:34:53.188097+0000 mon.c (mon.1) 1581 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:34:54.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:34:53 gibba045 bash[25517]: audit 2021-03-10T15:34:53.188470+0000 mon.a (mon.0) 1441 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:34:54.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:34:54 gibba015 bash[29377]: cluster 2021-03-10T15:34:53.554808+0000 mgr.gibba045.orlgmj (mgr.34412) 5616 : cluster [DBG] pgmap v3193: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:54.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:34:54 gibba015 bash[30343]: cluster 2021-03-10T15:34:53.554808+0000 mgr.gibba045.orlgmj (mgr.34412) 5616 : cluster [DBG] pgmap v3193: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:55.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:34:54 gibba045 bash[25517]: cluster 2021-03-10T15:34:53.554808+0000 mgr.gibba045.orlgmj (mgr.34412) 5616 : cluster [DBG] pgmap v3193: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:56.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:34:56 gibba015 bash[29377]: cluster 2021-03-10T15:34:55.556576+0000 mgr.gibba045.orlgmj (mgr.34412) 5617 : cluster [DBG] pgmap v3194: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:56.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:34:56 gibba015 bash[30343]: cluster 2021-03-10T15:34:55.556576+0000 mgr.gibba045.orlgmj (mgr.34412) 5617 : cluster [DBG] pgmap v3194: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:57.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:34:56 gibba045 bash[25517]: cluster 2021-03-10T15:34:55.556576+0000 mgr.gibba045.orlgmj (mgr.34412) 5617 : cluster [DBG] pgmap v3194: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:58.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:34:58 gibba015 bash[29377]: cluster 2021-03-10T15:34:57.558351+0000 mgr.gibba045.orlgmj (mgr.34412) 5618 : cluster [DBG] pgmap v3195: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:58.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:34:58 gibba015 bash[30343]: cluster 2021-03-10T15:34:57.558351+0000 mgr.gibba045.orlgmj (mgr.34412) 5618 : cluster [DBG] pgmap v3195: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:59.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:34:58 gibba045 bash[25517]: cluster 2021-03-10T15:34:57.558351+0000 mgr.gibba045.orlgmj (mgr.34412) 5618 : cluster [DBG] pgmap v3195: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:00.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:35:00 gibba045 bash[25517]: cluster 2021-03-10T15:34:59.558881+0000 mgr.gibba045.orlgmj (mgr.34412) 5619 : cluster [DBG] pgmap v3196: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:00.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:35:00 gibba015 bash[29377]: cluster 2021-03-10T15:34:59.558881+0000 mgr.gibba045.orlgmj (mgr.34412) 5619 : cluster [DBG] pgmap v3196: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:00.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:35:00 gibba015 bash[30343]: cluster 2021-03-10T15:34:59.558881+0000 mgr.gibba045.orlgmj (mgr.34412) 5619 : cluster [DBG] pgmap v3196: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:02.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:35:02 gibba015 bash[29377]: cluster 2021-03-10T15:35:01.560580+0000 mgr.gibba045.orlgmj (mgr.34412) 5620 : cluster [DBG] pgmap v3197: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:02.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:35:02 gibba015 bash[30343]: cluster 2021-03-10T15:35:01.560580+0000 mgr.gibba045.orlgmj (mgr.34412) 5620 : cluster [DBG] pgmap v3197: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:03.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:35:02 gibba045 bash[25517]: cluster 2021-03-10T15:35:01.560580+0000 mgr.gibba045.orlgmj (mgr.34412) 5620 : cluster [DBG] pgmap v3197: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:04.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:35:04 gibba015 bash[29377]: cluster 2021-03-10T15:35:03.561638+0000 mgr.gibba045.orlgmj (mgr.34412) 5621 : cluster [DBG] pgmap v3198: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:04.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:35:04 gibba015 bash[30343]: cluster 2021-03-10T15:35:03.561638+0000 mgr.gibba045.orlgmj (mgr.34412) 5621 : cluster [DBG] pgmap v3198: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:05.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:35:04 gibba045 bash[25517]: cluster 2021-03-10T15:35:03.561638+0000 mgr.gibba045.orlgmj (mgr.34412) 5621 : cluster [DBG] pgmap v3198: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:06.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:35:06 gibba015 bash[29377]: cluster 2021-03-10T15:35:05.563149+0000 mgr.gibba045.orlgmj (mgr.34412) 5622 : cluster [DBG] pgmap v3199: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:06.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:35:06 gibba015 bash[30343]: cluster 2021-03-10T15:35:05.563149+0000 mgr.gibba045.orlgmj (mgr.34412) 5622 : cluster [DBG] pgmap v3199: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:07.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:35:06 gibba045 bash[25517]: cluster 2021-03-10T15:35:05.563149+0000 mgr.gibba045.orlgmj (mgr.34412) 5622 : cluster [DBG] pgmap v3199: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:08.620 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:35:08.846 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:35:08.846 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (105m) 10m ago 111m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:35:08.847 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (111m) 9m ago 111m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:35:08.847 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (106m) 9m ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:35:08.847 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (106m) 9m ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:35:08.847 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (105m) 10m ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:35:08.848 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (105m) 10m ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:35:08.848 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (104m) 9m ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:35:08.848 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (105m) 10m ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:35:08.849 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (111m) 10m ago 111m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:35:08.849 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (111m) 9m ago 111m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:35:08.849 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (104m) 10m ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:35:08.849 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (103m) 10m ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:35:08.850 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (103m) 10m ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:35:08.850 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (102m) 10m ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:35:08.850 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (102m) 9m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:35:08.850 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (102m) 9m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:35:08.851 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (101m) 9m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:35:08.851 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (101m) 9m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:35:08.851 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (110m) 9m ago 111m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:35:08.851 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 9m ago 109m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:35:08.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:35:08 gibba015 bash[29377]: cluster 2021-03-10T15:35:07.564996+0000 mgr.gibba045.orlgmj (mgr.34412) 5623 : cluster [DBG] pgmap v3200: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:08.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:35:08 gibba015 bash[29377]: audit 2021-03-10T15:35:07.640163+0000 mon.c (mon.1) 1582 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:35:08.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:35:08 gibba015 bash[29377]: audit 2021-03-10T15:35:07.648565+0000 mon.c (mon.1) 1583 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:35:08.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:35:08 gibba015 bash[29377]: cephadm 2021-03-10T15:35:07.651849+0000 mgr.gibba045.orlgmj (mgr.34412) 5624 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:35:08.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:35:08 gibba015 bash[30343]: cluster 2021-03-10T15:35:07.564996+0000 mgr.gibba045.orlgmj (mgr.34412) 5623 : cluster [DBG] pgmap v3200: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:08.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:35:08 gibba015 bash[30343]: audit 2021-03-10T15:35:07.640163+0000 mon.c (mon.1) 1582 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:35:08.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:35:08 gibba015 bash[30343]: audit 2021-03-10T15:35:07.648565+0000 mon.c (mon.1) 1583 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:35:08.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:35:08 gibba015 bash[30343]: cephadm 2021-03-10T15:35:07.651849+0000 mgr.gibba045.orlgmj (mgr.34412) 5624 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:35:09.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:35:08 gibba045 bash[25517]: cluster 2021-03-10T15:35:07.564996+0000 mgr.gibba045.orlgmj (mgr.34412) 5623 : cluster [DBG] pgmap v3200: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:09.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:35:08 gibba045 bash[25517]: audit 2021-03-10T15:35:07.640163+0000 mon.c (mon.1) 1582 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:35:09.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:35:08 gibba045 bash[25517]: audit 2021-03-10T15:35:07.648565+0000 mon.c (mon.1) 1583 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:35:09.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:35:08 gibba045 bash[25517]: cephadm 2021-03-10T15:35:07.651849+0000 mgr.gibba045.orlgmj (mgr.34412) 5624 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:35:09.108 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:35:09.109 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:35:09.109 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:35:09.109 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:35:09.109 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:35:09.110 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:35:09.110 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:35:09.110 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:35:09.111 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:35:09.111 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:35:09.111 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:35:09.111 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:35:09.112 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:35:09.112 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:35:09.112 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:35:09.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:35:09 gibba015 bash[29377]: audit 2021-03-10T15:35:08.609527+0000 mgr.gibba045.orlgmj (mgr.34412) 5625 : audit [DBG] from='client.47832 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:35:09.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:35:09 gibba015 bash[29377]: audit 2021-03-10T15:35:08.834023+0000 mgr.gibba045.orlgmj (mgr.34412) 5626 : audit [DBG] from='client.47838 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:35:09.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:35:09 gibba015 bash[29377]: audit 2021-03-10T15:35:09.103700+0000 mon.a (mon.0) 1442 : audit [DBG] from='client.? 172.21.2.115:0/1316510595' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:35:09.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:35:09 gibba015 bash[30343]: audit 2021-03-10T15:35:08.609527+0000 mgr.gibba045.orlgmj (mgr.34412) 5625 : audit [DBG] from='client.47832 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:35:09.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:35:09 gibba015 bash[30343]: audit 2021-03-10T15:35:08.834023+0000 mgr.gibba045.orlgmj (mgr.34412) 5626 : audit [DBG] from='client.47838 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:35:09.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:35:09 gibba015 bash[30343]: audit 2021-03-10T15:35:09.103700+0000 mon.a (mon.0) 1442 : audit [DBG] from='client.? 172.21.2.115:0/1316510595' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:35:10.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:35:09 gibba045 bash[25517]: audit 2021-03-10T15:35:08.609527+0000 mgr.gibba045.orlgmj (mgr.34412) 5625 : audit [DBG] from='client.47832 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:35:10.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:35:09 gibba045 bash[25517]: audit 2021-03-10T15:35:08.834023+0000 mgr.gibba045.orlgmj (mgr.34412) 5626 : audit [DBG] from='client.47838 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:35:10.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:35:09 gibba045 bash[25517]: audit 2021-03-10T15:35:09.103700+0000 mon.a (mon.0) 1442 : audit [DBG] from='client.? 172.21.2.115:0/1316510595' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:35:10.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:35:10 gibba015 bash[29377]: cluster 2021-03-10T15:35:09.566323+0000 mgr.gibba045.orlgmj (mgr.34412) 5627 : cluster [DBG] pgmap v3201: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:10.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:35:10 gibba015 bash[30343]: cluster 2021-03-10T15:35:09.566323+0000 mgr.gibba045.orlgmj (mgr.34412) 5627 : cluster [DBG] pgmap v3201: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:11.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:35:10 gibba045 bash[25517]: cluster 2021-03-10T15:35:09.566323+0000 mgr.gibba045.orlgmj (mgr.34412) 5627 : cluster [DBG] pgmap v3201: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:12.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:35:12 gibba015 bash[29377]: audit 2021-03-10T15:35:11.104177+0000 mon.a (mon.0) 1443 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:35:12.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:35:12 gibba015 bash[29377]: cephadm 2021-03-10T15:35:11.109936+0000 mgr.gibba045.orlgmj (mgr.34412) 5628 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:35:12.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:35:12 gibba015 bash[29377]: audit 2021-03-10T15:35:11.349359+0000 mon.a (mon.0) 1444 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:35:12.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:35:12 gibba015 bash[29377]: audit 2021-03-10T15:35:11.365523+0000 mon.c (mon.1) 1584 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:35:12.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:35:12 gibba015 bash[29377]: audit 2021-03-10T15:35:11.369513+0000 mon.c (mon.1) 1585 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:35:12.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:35:12 gibba015 bash[29377]: audit 2021-03-10T15:35:11.374210+0000 mon.c (mon.1) 1586 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:35:12.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:35:12 gibba015 bash[29377]: audit 2021-03-10T15:35:11.377390+0000 mon.c (mon.1) 1587 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:35:12.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:35:12 gibba015 bash[29377]: audit 2021-03-10T15:35:11.384912+0000 mon.c (mon.1) 1588 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:35:12.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:35:12 gibba015 bash[29377]: audit 2021-03-10T15:35:11.390013+0000 mon.c (mon.1) 1589 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:35:12.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:35:12 gibba015 bash[30343]: audit 2021-03-10T15:35:11.104177+0000 mon.a (mon.0) 1443 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:35:12.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:35:12 gibba015 bash[30343]: cephadm 2021-03-10T15:35:11.109936+0000 mgr.gibba045.orlgmj (mgr.34412) 5628 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:35:12.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:35:12 gibba015 bash[30343]: audit 2021-03-10T15:35:11.349359+0000 mon.a (mon.0) 1444 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:35:12.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:35:12 gibba015 bash[30343]: audit 2021-03-10T15:35:11.365523+0000 mon.c (mon.1) 1584 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:35:12.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:35:12 gibba015 bash[30343]: audit 2021-03-10T15:35:11.369513+0000 mon.c (mon.1) 1585 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:35:12.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:35:12 gibba015 bash[30343]: audit 2021-03-10T15:35:11.374210+0000 mon.c (mon.1) 1586 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:35:12.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:35:12 gibba015 bash[30343]: audit 2021-03-10T15:35:11.377390+0000 mon.c (mon.1) 1587 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:35:12.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:35:12 gibba015 bash[30343]: audit 2021-03-10T15:35:11.384912+0000 mon.c (mon.1) 1588 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:35:12.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:35:12 gibba015 bash[30343]: audit 2021-03-10T15:35:11.390013+0000 mon.c (mon.1) 1589 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:35:12.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:35:12 gibba045 bash[25517]: audit 2021-03-10T15:35:11.104177+0000 mon.a (mon.0) 1443 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:35:12.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:35:12 gibba045 bash[25517]: cephadm 2021-03-10T15:35:11.109936+0000 mgr.gibba045.orlgmj (mgr.34412) 5628 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:35:12.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:35:12 gibba045 bash[25517]: audit 2021-03-10T15:35:11.349359+0000 mon.a (mon.0) 1444 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:35:12.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:35:12 gibba045 bash[25517]: audit 2021-03-10T15:35:11.365523+0000 mon.c (mon.1) 1584 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:35:12.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:35:12 gibba045 bash[25517]: audit 2021-03-10T15:35:11.369513+0000 mon.c (mon.1) 1585 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:35:12.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:35:12 gibba045 bash[25517]: audit 2021-03-10T15:35:11.374210+0000 mon.c (mon.1) 1586 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:35:12.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:35:12 gibba045 bash[25517]: audit 2021-03-10T15:35:11.377390+0000 mon.c (mon.1) 1587 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:35:12.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:35:12 gibba045 bash[25517]: audit 2021-03-10T15:35:11.384912+0000 mon.c (mon.1) 1588 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:35:12.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:35:12 gibba045 bash[25517]: audit 2021-03-10T15:35:11.390013+0000 mon.c (mon.1) 1589 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:35:13.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:35:13 gibba015 bash[29377]: cephadm 2021-03-10T15:35:11.366594+0000 mgr.gibba045.orlgmj (mgr.34412) 5629 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:35:13.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:35:13 gibba015 bash[29377]: cephadm 2021-03-10T15:35:11.372137+0000 mgr.gibba045.orlgmj (mgr.34412) 5630 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:35:13.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:35:13 gibba015 bash[29377]: cephadm 2021-03-10T15:35:11.376009+0000 mgr.gibba045.orlgmj (mgr.34412) 5631 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:35:13.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:35:13 gibba015 bash[29377]: cephadm 2021-03-10T15:35:11.376277+0000 mgr.gibba045.orlgmj (mgr.34412) 5632 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:35:13.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:35:13 gibba015 bash[29377]: cephadm 2021-03-10T15:35:11.380043+0000 mgr.gibba045.orlgmj (mgr.34412) 5633 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:35:13.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:35:13 gibba015 bash[29377]: cephadm 2021-03-10T15:35:11.380378+0000 mgr.gibba045.orlgmj (mgr.34412) 5634 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:35:13.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:35:13 gibba015 bash[29377]: cephadm 2021-03-10T15:35:11.383126+0000 mgr.gibba045.orlgmj (mgr.34412) 5635 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:35:13.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:35:13 gibba015 bash[29377]: cephadm 2021-03-10T15:35:11.386711+0000 mgr.gibba045.orlgmj (mgr.34412) 5636 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:35:13.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:35:13 gibba015 bash[29377]: cephadm 2021-03-10T15:35:11.387110+0000 mgr.gibba045.orlgmj (mgr.34412) 5637 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:35:13.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:35:13 gibba015 bash[29377]: cephadm 2021-03-10T15:35:11.390699+0000 mgr.gibba045.orlgmj (mgr.34412) 5638 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:35:13.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:35:13 gibba015 bash[29377]: cephadm 2021-03-10T15:35:11.392721+0000 mgr.gibba045.orlgmj (mgr.34412) 5639 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:35:13.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:35:13 gibba015 bash[29377]: cephadm 2021-03-10T15:35:11.396665+0000 mgr.gibba045.orlgmj (mgr.34412) 5640 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:35:13.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:35:13 gibba015 bash[29377]: cephadm 2021-03-10T15:35:11.397060+0000 mgr.gibba045.orlgmj (mgr.34412) 5641 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:35:13.479 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:35:13 gibba015 bash[29377]: cephadm 2021-03-10T15:35:11.397658+0000 mgr.gibba045.orlgmj (mgr.34412) 5642 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:35:13.479 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:35:13 gibba015 bash[29377]: cluster 2021-03-10T15:35:11.568087+0000 mgr.gibba045.orlgmj (mgr.34412) 5643 : cluster [DBG] pgmap v3202: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:13.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:35:13 gibba015 bash[30343]: cephadm 2021-03-10T15:35:11.366594+0000 mgr.gibba045.orlgmj (mgr.34412) 5629 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:35:13.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:35:13 gibba015 bash[30343]: cephadm 2021-03-10T15:35:11.372137+0000 mgr.gibba045.orlgmj (mgr.34412) 5630 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:35:13.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:35:13 gibba015 bash[30343]: cephadm 2021-03-10T15:35:11.376009+0000 mgr.gibba045.orlgmj (mgr.34412) 5631 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:35:13.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:35:13 gibba015 bash[30343]: cephadm 2021-03-10T15:35:11.376277+0000 mgr.gibba045.orlgmj (mgr.34412) 5632 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:35:13.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:35:13 gibba015 bash[30343]: cephadm 2021-03-10T15:35:11.380043+0000 mgr.gibba045.orlgmj (mgr.34412) 5633 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:35:13.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:35:13 gibba015 bash[30343]: cephadm 2021-03-10T15:35:11.380378+0000 mgr.gibba045.orlgmj (mgr.34412) 5634 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:35:13.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:35:13 gibba015 bash[30343]: cephadm 2021-03-10T15:35:11.383126+0000 mgr.gibba045.orlgmj (mgr.34412) 5635 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:35:13.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:35:13 gibba015 bash[30343]: cephadm 2021-03-10T15:35:11.386711+0000 mgr.gibba045.orlgmj (mgr.34412) 5636 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:35:13.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:35:13 gibba015 bash[30343]: cephadm 2021-03-10T15:35:11.387110+0000 mgr.gibba045.orlgmj (mgr.34412) 5637 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:35:13.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:35:13 gibba015 bash[30343]: cephadm 2021-03-10T15:35:11.390699+0000 mgr.gibba045.orlgmj (mgr.34412) 5638 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:35:13.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:35:13 gibba015 bash[30343]: cephadm 2021-03-10T15:35:11.392721+0000 mgr.gibba045.orlgmj (mgr.34412) 5639 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:35:13.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:35:13 gibba015 bash[30343]: cephadm 2021-03-10T15:35:11.396665+0000 mgr.gibba045.orlgmj (mgr.34412) 5640 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:35:13.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:35:13 gibba015 bash[30343]: cephadm 2021-03-10T15:35:11.397060+0000 mgr.gibba045.orlgmj (mgr.34412) 5641 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:35:13.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:35:13 gibba015 bash[30343]: cephadm 2021-03-10T15:35:11.397658+0000 mgr.gibba045.orlgmj (mgr.34412) 5642 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:35:13.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:35:13 gibba015 bash[30343]: cluster 2021-03-10T15:35:11.568087+0000 mgr.gibba045.orlgmj (mgr.34412) 5643 : cluster [DBG] pgmap v3202: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:13.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:35:13 gibba045 bash[25517]: cephadm 2021-03-10T15:35:11.366594+0000 mgr.gibba045.orlgmj (mgr.34412) 5629 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:35:13.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:35:13 gibba045 bash[25517]: cephadm 2021-03-10T15:35:11.372137+0000 mgr.gibba045.orlgmj (mgr.34412) 5630 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:35:13.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:35:13 gibba045 bash[25517]: cephadm 2021-03-10T15:35:11.376009+0000 mgr.gibba045.orlgmj (mgr.34412) 5631 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:35:13.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:35:13 gibba045 bash[25517]: cephadm 2021-03-10T15:35:11.376277+0000 mgr.gibba045.orlgmj (mgr.34412) 5632 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:35:13.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:35:13 gibba045 bash[25517]: cephadm 2021-03-10T15:35:11.380043+0000 mgr.gibba045.orlgmj (mgr.34412) 5633 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:35:13.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:35:13 gibba045 bash[25517]: cephadm 2021-03-10T15:35:11.380378+0000 mgr.gibba045.orlgmj (mgr.34412) 5634 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:35:13.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:35:13 gibba045 bash[25517]: cephadm 2021-03-10T15:35:11.383126+0000 mgr.gibba045.orlgmj (mgr.34412) 5635 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:35:13.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:35:13 gibba045 bash[25517]: cephadm 2021-03-10T15:35:11.386711+0000 mgr.gibba045.orlgmj (mgr.34412) 5636 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:35:13.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:35:13 gibba045 bash[25517]: cephadm 2021-03-10T15:35:11.387110+0000 mgr.gibba045.orlgmj (mgr.34412) 5637 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:35:13.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:35:13 gibba045 bash[25517]: cephadm 2021-03-10T15:35:11.390699+0000 mgr.gibba045.orlgmj (mgr.34412) 5638 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:35:13.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:35:13 gibba045 bash[25517]: cephadm 2021-03-10T15:35:11.392721+0000 mgr.gibba045.orlgmj (mgr.34412) 5639 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:35:13.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:35:13 gibba045 bash[25517]: cephadm 2021-03-10T15:35:11.396665+0000 mgr.gibba045.orlgmj (mgr.34412) 5640 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:35:13.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:35:13 gibba045 bash[25517]: cephadm 2021-03-10T15:35:11.397060+0000 mgr.gibba045.orlgmj (mgr.34412) 5641 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:35:13.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:35:13 gibba045 bash[25517]: cephadm 2021-03-10T15:35:11.397658+0000 mgr.gibba045.orlgmj (mgr.34412) 5642 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:35:13.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:35:13 gibba045 bash[25517]: cluster 2021-03-10T15:35:11.568087+0000 mgr.gibba045.orlgmj (mgr.34412) 5643 : cluster [DBG] pgmap v3202: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:15.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:35:15 gibba015 bash[29377]: cluster 2021-03-10T15:35:13.569209+0000 mgr.gibba045.orlgmj (mgr.34412) 5644 : cluster [DBG] pgmap v3203: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:15.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:35:15 gibba015 bash[30343]: cluster 2021-03-10T15:35:13.569209+0000 mgr.gibba045.orlgmj (mgr.34412) 5644 : cluster [DBG] pgmap v3203: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:15.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:35:15 gibba045 bash[25517]: cluster 2021-03-10T15:35:13.569209+0000 mgr.gibba045.orlgmj (mgr.34412) 5644 : cluster [DBG] pgmap v3203: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:17.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:35:17 gibba015 bash[29377]: cluster 2021-03-10T15:35:15.570622+0000 mgr.gibba045.orlgmj (mgr.34412) 5645 : cluster [DBG] pgmap v3204: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:17.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:35:17 gibba015 bash[30343]: cluster 2021-03-10T15:35:15.570622+0000 mgr.gibba045.orlgmj (mgr.34412) 5645 : cluster [DBG] pgmap v3204: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:17.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:35:17 gibba045 bash[25517]: cluster 2021-03-10T15:35:15.570622+0000 mgr.gibba045.orlgmj (mgr.34412) 5645 : cluster [DBG] pgmap v3204: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:19.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:35:19 gibba015 bash[29377]: cluster 2021-03-10T15:35:17.572259+0000 mgr.gibba045.orlgmj (mgr.34412) 5646 : cluster [DBG] pgmap v3205: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:19.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:35:19 gibba015 bash[30343]: cluster 2021-03-10T15:35:17.572259+0000 mgr.gibba045.orlgmj (mgr.34412) 5646 : cluster [DBG] pgmap v3205: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:19.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:35:19 gibba045 bash[25517]: cluster 2021-03-10T15:35:17.572259+0000 mgr.gibba045.orlgmj (mgr.34412) 5646 : cluster [DBG] pgmap v3205: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:20.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:35:20 gibba015 bash[29377]: cluster 2021-03-10T15:35:19.572707+0000 mgr.gibba045.orlgmj (mgr.34412) 5647 : cluster [DBG] pgmap v3206: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:20.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:35:20 gibba015 bash[30343]: cluster 2021-03-10T15:35:19.572707+0000 mgr.gibba045.orlgmj (mgr.34412) 5647 : cluster [DBG] pgmap v3206: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:21.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:35:20 gibba045 bash[25517]: cluster 2021-03-10T15:35:19.572707+0000 mgr.gibba045.orlgmj (mgr.34412) 5647 : cluster [DBG] pgmap v3206: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:22.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:35:22 gibba015 bash[29377]: cluster 2021-03-10T15:35:21.574448+0000 mgr.gibba045.orlgmj (mgr.34412) 5648 : cluster [DBG] pgmap v3207: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:22.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:35:22 gibba015 bash[30343]: cluster 2021-03-10T15:35:21.574448+0000 mgr.gibba045.orlgmj (mgr.34412) 5648 : cluster [DBG] pgmap v3207: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:23.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:35:22 gibba045 bash[25517]: cluster 2021-03-10T15:35:21.574448+0000 mgr.gibba045.orlgmj (mgr.34412) 5648 : cluster [DBG] pgmap v3207: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:24.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:35:24 gibba015 bash[29377]: cluster 2021-03-10T15:35:23.575517+0000 mgr.gibba045.orlgmj (mgr.34412) 5649 : cluster [DBG] pgmap v3208: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:24.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:35:24 gibba015 bash[30343]: cluster 2021-03-10T15:35:23.575517+0000 mgr.gibba045.orlgmj (mgr.34412) 5649 : cluster [DBG] pgmap v3208: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:25.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:35:24 gibba045 bash[25517]: cluster 2021-03-10T15:35:23.575517+0000 mgr.gibba045.orlgmj (mgr.34412) 5649 : cluster [DBG] pgmap v3208: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:26.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:35:26 gibba045 bash[25517]: cluster 2021-03-10T15:35:25.577206+0000 mgr.gibba045.orlgmj (mgr.34412) 5650 : cluster [DBG] pgmap v3209: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:26.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:35:26 gibba015 bash[29377]: cluster 2021-03-10T15:35:25.577206+0000 mgr.gibba045.orlgmj (mgr.34412) 5650 : cluster [DBG] pgmap v3209: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:26.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:35:26 gibba015 bash[30343]: cluster 2021-03-10T15:35:25.577206+0000 mgr.gibba045.orlgmj (mgr.34412) 5650 : cluster [DBG] pgmap v3209: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:27.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:35:27 gibba015 bash[29377]: cephadm 2021-03-10T15:35:26.413454+0000 mgr.gibba045.orlgmj (mgr.34412) 5651 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:35:27.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:35:27 gibba015 bash[30343]: cephadm 2021-03-10T15:35:26.413454+0000 mgr.gibba045.orlgmj (mgr.34412) 5651 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:35:28.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:35:27 gibba045 bash[25517]: cephadm 2021-03-10T15:35:26.413454+0000 mgr.gibba045.orlgmj (mgr.34412) 5651 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:35:28.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:35:28 gibba015 bash[29377]: cluster 2021-03-10T15:35:27.578698+0000 mgr.gibba045.orlgmj (mgr.34412) 5652 : cluster [DBG] pgmap v3210: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:28.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:35:28 gibba015 bash[30343]: cluster 2021-03-10T15:35:27.578698+0000 mgr.gibba045.orlgmj (mgr.34412) 5652 : cluster [DBG] pgmap v3210: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:29.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:35:28 gibba045 bash[25517]: cluster 2021-03-10T15:35:27.578698+0000 mgr.gibba045.orlgmj (mgr.34412) 5652 : cluster [DBG] pgmap v3210: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:30.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:35:30 gibba015 bash[29377]: cluster 2021-03-10T15:35:29.579466+0000 mgr.gibba045.orlgmj (mgr.34412) 5653 : cluster [DBG] pgmap v3211: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:30.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:35:30 gibba015 bash[30343]: cluster 2021-03-10T15:35:29.579466+0000 mgr.gibba045.orlgmj (mgr.34412) 5653 : cluster [DBG] pgmap v3211: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:31.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:35:30 gibba045 bash[25517]: cluster 2021-03-10T15:35:29.579466+0000 mgr.gibba045.orlgmj (mgr.34412) 5653 : cluster [DBG] pgmap v3211: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:32.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:35:32 gibba015 bash[29377]: cluster 2021-03-10T15:35:31.581130+0000 mgr.gibba045.orlgmj (mgr.34412) 5654 : cluster [DBG] pgmap v3212: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:32.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:35:32 gibba015 bash[30343]: cluster 2021-03-10T15:35:31.581130+0000 mgr.gibba045.orlgmj (mgr.34412) 5654 : cluster [DBG] pgmap v3212: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:33.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:35:32 gibba045 bash[25517]: cluster 2021-03-10T15:35:31.581130+0000 mgr.gibba045.orlgmj (mgr.34412) 5654 : cluster [DBG] pgmap v3212: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:34.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:35:34 gibba015 bash[29377]: cluster 2021-03-10T15:35:33.582436+0000 mgr.gibba045.orlgmj (mgr.34412) 5655 : cluster [DBG] pgmap v3213: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:34.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:35:34 gibba015 bash[30343]: cluster 2021-03-10T15:35:33.582436+0000 mgr.gibba045.orlgmj (mgr.34412) 5655 : cluster [DBG] pgmap v3213: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:35.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:35:34 gibba045 bash[25517]: cluster 2021-03-10T15:35:33.582436+0000 mgr.gibba045.orlgmj (mgr.34412) 5655 : cluster [DBG] pgmap v3213: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:36.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:35:36 gibba015 bash[29377]: cluster 2021-03-10T15:35:35.584057+0000 mgr.gibba045.orlgmj (mgr.34412) 5656 : cluster [DBG] pgmap v3214: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:36.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:35:36 gibba015 bash[30343]: cluster 2021-03-10T15:35:35.584057+0000 mgr.gibba045.orlgmj (mgr.34412) 5656 : cluster [DBG] pgmap v3214: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:37.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:35:36 gibba045 bash[25517]: cluster 2021-03-10T15:35:35.584057+0000 mgr.gibba045.orlgmj (mgr.34412) 5656 : cluster [DBG] pgmap v3214: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:38.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:35:38 gibba015 bash[29377]: cluster 2021-03-10T15:35:37.585547+0000 mgr.gibba045.orlgmj (mgr.34412) 5657 : cluster [DBG] pgmap v3215: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:38.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:35:38 gibba015 bash[30343]: cluster 2021-03-10T15:35:37.585547+0000 mgr.gibba045.orlgmj (mgr.34412) 5657 : cluster [DBG] pgmap v3215: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:39.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:35:38 gibba045 bash[25517]: cluster 2021-03-10T15:35:37.585547+0000 mgr.gibba045.orlgmj (mgr.34412) 5657 : cluster [DBG] pgmap v3215: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:39.350 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:35:39.575 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:35:39.575 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (106m) 28s ago 111m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:35:39.576 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (111m) 9m ago 111m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:35:39.576 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (106m) 9m ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:35:39.576 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (107m) 9m ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:35:39.576 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (106m) 28s ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:35:39.577 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (105m) 28s ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:35:39.577 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (105m) 9m ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:35:39.577 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (105m) 28s ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:35:39.577 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (111m) 28s ago 111m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:35:39.577 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (111m) 9m ago 111m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:35:39.578 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (104m) 28s ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:35:39.578 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (104m) 28s ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:35:39.578 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (103m) 28s ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:35:39.578 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (103m) 28s ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:35:39.579 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (102m) 9m ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:35:39.579 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (102m) 9m ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:35:39.579 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (102m) 9m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:35:39.579 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (101m) 9m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:35:39.580 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (111m) 9m ago 111m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:35:39.580 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 9m ago 109m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:35:39.834 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:35:39.834 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:35:39.834 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:35:39.835 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:35:39.835 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:35:39.835 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:35:39.835 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:35:39.836 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:35:39.836 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:35:39.836 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:35:39.836 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:35:39.837 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:35:39.837 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:35:39.837 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:35:39.837 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:35:40.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:35:40 gibba015 bash[29377]: audit 2021-03-10T15:35:39.340157+0000 mgr.gibba045.orlgmj (mgr.34412) 5658 : audit [DBG] from='client.57838 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:35:40.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:35:40 gibba015 bash[29377]: audit 2021-03-10T15:35:39.565730+0000 mgr.gibba045.orlgmj (mgr.34412) 5659 : audit [DBG] from='client.57844 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:35:40.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:35:40 gibba015 bash[29377]: cluster 2021-03-10T15:35:39.586316+0000 mgr.gibba045.orlgmj (mgr.34412) 5660 : cluster [DBG] pgmap v3216: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:40.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:35:40 gibba015 bash[29377]: audit 2021-03-10T15:35:39.828911+0000 mon.a (mon.0) 1445 : audit [DBG] from='client.? 172.21.2.115:0/3568308668' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:35:40.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:35:40 gibba015 bash[30343]: audit 2021-03-10T15:35:39.340157+0000 mgr.gibba045.orlgmj (mgr.34412) 5658 : audit [DBG] from='client.57838 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:35:40.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:35:40 gibba015 bash[30343]: audit 2021-03-10T15:35:39.565730+0000 mgr.gibba045.orlgmj (mgr.34412) 5659 : audit [DBG] from='client.57844 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:35:40.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:35:40 gibba015 bash[30343]: cluster 2021-03-10T15:35:39.586316+0000 mgr.gibba045.orlgmj (mgr.34412) 5660 : cluster [DBG] pgmap v3216: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:40.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:35:40 gibba015 bash[30343]: audit 2021-03-10T15:35:39.828911+0000 mon.a (mon.0) 1445 : audit [DBG] from='client.? 172.21.2.115:0/3568308668' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:35:41.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:35:40 gibba045 bash[25517]: audit 2021-03-10T15:35:39.340157+0000 mgr.gibba045.orlgmj (mgr.34412) 5658 : audit [DBG] from='client.57838 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:35:41.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:35:40 gibba045 bash[25517]: audit 2021-03-10T15:35:39.565730+0000 mgr.gibba045.orlgmj (mgr.34412) 5659 : audit [DBG] from='client.57844 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:35:41.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:35:40 gibba045 bash[25517]: cluster 2021-03-10T15:35:39.586316+0000 mgr.gibba045.orlgmj (mgr.34412) 5660 : cluster [DBG] pgmap v3216: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:41.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:35:40 gibba045 bash[25517]: audit 2021-03-10T15:35:39.828911+0000 mon.a (mon.0) 1445 : audit [DBG] from='client.? 172.21.2.115:0/3568308668' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:35:42.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:35:42 gibba015 bash[29377]: cephadm 2021-03-10T15:35:41.429237+0000 mgr.gibba045.orlgmj (mgr.34412) 5661 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:35:42.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:35:42 gibba015 bash[29377]: cluster 2021-03-10T15:35:41.588031+0000 mgr.gibba045.orlgmj (mgr.34412) 5662 : cluster [DBG] pgmap v3217: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:42.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:35:42 gibba015 bash[30343]: cephadm 2021-03-10T15:35:41.429237+0000 mgr.gibba045.orlgmj (mgr.34412) 5661 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:35:42.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:35:42 gibba015 bash[30343]: cluster 2021-03-10T15:35:41.588031+0000 mgr.gibba045.orlgmj (mgr.34412) 5662 : cluster [DBG] pgmap v3217: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:43.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:35:42 gibba045 bash[25517]: cephadm 2021-03-10T15:35:41.429237+0000 mgr.gibba045.orlgmj (mgr.34412) 5661 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:35:43.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:35:42 gibba045 bash[25517]: cluster 2021-03-10T15:35:41.588031+0000 mgr.gibba045.orlgmj (mgr.34412) 5662 : cluster [DBG] pgmap v3217: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:44.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:35:44 gibba015 bash[29377]: cluster 2021-03-10T15:35:43.589334+0000 mgr.gibba045.orlgmj (mgr.34412) 5663 : cluster [DBG] pgmap v3218: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:44.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:35:44 gibba015 bash[30343]: cluster 2021-03-10T15:35:43.589334+0000 mgr.gibba045.orlgmj (mgr.34412) 5663 : cluster [DBG] pgmap v3218: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:45.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:35:44 gibba045 bash[25517]: cluster 2021-03-10T15:35:43.589334+0000 mgr.gibba045.orlgmj (mgr.34412) 5663 : cluster [DBG] pgmap v3218: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:46.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:35:46 gibba015 bash[29377]: cluster 2021-03-10T15:35:45.591006+0000 mgr.gibba045.orlgmj (mgr.34412) 5664 : cluster [DBG] pgmap v3219: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:46.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:35:46 gibba015 bash[30343]: cluster 2021-03-10T15:35:45.591006+0000 mgr.gibba045.orlgmj (mgr.34412) 5664 : cluster [DBG] pgmap v3219: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:47.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:35:46 gibba045 bash[25517]: cluster 2021-03-10T15:35:45.591006+0000 mgr.gibba045.orlgmj (mgr.34412) 5664 : cluster [DBG] pgmap v3219: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:48.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:35:48 gibba015 bash[29377]: cluster 2021-03-10T15:35:47.592545+0000 mgr.gibba045.orlgmj (mgr.34412) 5665 : cluster [DBG] pgmap v3220: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:48.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:35:48 gibba015 bash[30343]: cluster 2021-03-10T15:35:47.592545+0000 mgr.gibba045.orlgmj (mgr.34412) 5665 : cluster [DBG] pgmap v3220: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:49.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:35:48 gibba045 bash[25517]: cluster 2021-03-10T15:35:47.592545+0000 mgr.gibba045.orlgmj (mgr.34412) 5665 : cluster [DBG] pgmap v3220: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:50.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:35:50 gibba015 bash[29377]: cluster 2021-03-10T15:35:49.593233+0000 mgr.gibba045.orlgmj (mgr.34412) 5666 : cluster [DBG] pgmap v3221: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:50.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:35:50 gibba015 bash[30343]: cluster 2021-03-10T15:35:49.593233+0000 mgr.gibba045.orlgmj (mgr.34412) 5666 : cluster [DBG] pgmap v3221: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:51.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:35:50 gibba045 bash[25517]: cluster 2021-03-10T15:35:49.593233+0000 mgr.gibba045.orlgmj (mgr.34412) 5666 : cluster [DBG] pgmap v3221: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:52.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:35:52 gibba015 bash[29377]: cluster 2021-03-10T15:35:51.595057+0000 mgr.gibba045.orlgmj (mgr.34412) 5667 : cluster [DBG] pgmap v3222: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:52.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:35:52 gibba015 bash[30343]: cluster 2021-03-10T15:35:51.595057+0000 mgr.gibba045.orlgmj (mgr.34412) 5667 : cluster [DBG] pgmap v3222: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:53.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:35:52 gibba045 bash[25517]: cluster 2021-03-10T15:35:51.595057+0000 mgr.gibba045.orlgmj (mgr.34412) 5667 : cluster [DBG] pgmap v3222: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:35:53 gibba015 bash[29377]: audit 2021-03-10T15:35:53.191793+0000 mon.c (mon.1) 1590 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:35:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:35:53 gibba015 bash[29377]: audit 2021-03-10T15:35:53.192606+0000 mon.c (mon.1) 1591 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:35:53.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:35:53 gibba015 bash[29377]: audit 2021-03-10T15:35:53.193013+0000 mon.a (mon.0) 1446 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:35:53.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:35:53 gibba015 bash[29377]: audit 2021-03-10T15:35:53.193532+0000 mon.c (mon.1) 1592 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T15:35:53.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:35:53 gibba015 bash[29377]: audit 2021-03-10T15:35:53.194646+0000 mon.c (mon.1) 1593 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:35:53.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:35:53 gibba015 bash[29377]: audit 2021-03-10T15:35:53.195101+0000 mon.a (mon.0) 1447 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:35:53.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:35:53 gibba015 bash[29377]: audit 2021-03-10T15:35:53.195481+0000 mon.c (mon.1) 1594 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:35:53.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:35:53 gibba015 bash[29377]: audit 2021-03-10T15:35:53.196508+0000 mon.a (mon.0) 1448 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T15:35:53.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:35:53 gibba015 bash[29377]: audit 2021-03-10T15:35:53.196615+0000 mon.c (mon.1) 1595 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:35:53.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:35:53 gibba015 bash[29377]: audit 2021-03-10T15:35:53.197014+0000 mon.a (mon.0) 1449 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:35:53.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:35:53 gibba015 bash[29377]: audit 2021-03-10T15:35:53.197330+0000 mon.a (mon.0) 1450 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:35:53.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:35:53 gibba015 bash[29377]: audit 2021-03-10T15:35:53.197648+0000 mon.a (mon.0) 1451 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:35:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:35:53 gibba015 bash[30343]: audit 2021-03-10T15:35:53.191793+0000 mon.c (mon.1) 1590 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:35:53.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:35:53 gibba015 bash[30343]: audit 2021-03-10T15:35:53.192606+0000 mon.c (mon.1) 1591 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:35:53.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:35:53 gibba015 bash[30343]: audit 2021-03-10T15:35:53.193013+0000 mon.a (mon.0) 1446 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:35:53.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:35:53 gibba015 bash[30343]: audit 2021-03-10T15:35:53.193532+0000 mon.c (mon.1) 1592 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T15:35:53.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:35:53 gibba015 bash[30343]: audit 2021-03-10T15:35:53.194646+0000 mon.c (mon.1) 1593 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:35:53.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:35:53 gibba015 bash[30343]: audit 2021-03-10T15:35:53.195101+0000 mon.a (mon.0) 1447 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:35:53.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:35:53 gibba015 bash[30343]: audit 2021-03-10T15:35:53.195481+0000 mon.c (mon.1) 1594 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:35:53.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:35:53 gibba015 bash[30343]: audit 2021-03-10T15:35:53.196508+0000 mon.a (mon.0) 1448 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T15:35:53.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:35:53 gibba015 bash[30343]: audit 2021-03-10T15:35:53.196615+0000 mon.c (mon.1) 1595 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:35:53.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:35:53 gibba015 bash[30343]: audit 2021-03-10T15:35:53.197014+0000 mon.a (mon.0) 1449 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:35:53.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:35:53 gibba015 bash[30343]: audit 2021-03-10T15:35:53.197330+0000 mon.a (mon.0) 1450 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:35:53.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:35:53 gibba015 bash[30343]: audit 2021-03-10T15:35:53.197648+0000 mon.a (mon.0) 1451 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:35:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:35:53 gibba045 bash[25517]: audit 2021-03-10T15:35:53.191793+0000 mon.c (mon.1) 1590 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:35:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:35:53 gibba045 bash[25517]: audit 2021-03-10T15:35:53.192606+0000 mon.c (mon.1) 1591 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:35:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:35:53 gibba045 bash[25517]: audit 2021-03-10T15:35:53.193013+0000 mon.a (mon.0) 1446 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:35:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:35:53 gibba045 bash[25517]: audit 2021-03-10T15:35:53.193532+0000 mon.c (mon.1) 1592 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T15:35:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:35:53 gibba045 bash[25517]: audit 2021-03-10T15:35:53.194646+0000 mon.c (mon.1) 1593 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:35:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:35:53 gibba045 bash[25517]: audit 2021-03-10T15:35:53.195101+0000 mon.a (mon.0) 1447 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:35:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:35:53 gibba045 bash[25517]: audit 2021-03-10T15:35:53.195481+0000 mon.c (mon.1) 1594 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:35:54.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:35:53 gibba045 bash[25517]: audit 2021-03-10T15:35:53.196508+0000 mon.a (mon.0) 1448 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T15:35:54.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:35:53 gibba045 bash[25517]: audit 2021-03-10T15:35:53.196615+0000 mon.c (mon.1) 1595 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:35:54.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:35:53 gibba045 bash[25517]: audit 2021-03-10T15:35:53.197014+0000 mon.a (mon.0) 1449 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:35:54.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:35:53 gibba045 bash[25517]: audit 2021-03-10T15:35:53.197330+0000 mon.a (mon.0) 1450 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:35:54.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:35:53 gibba045 bash[25517]: audit 2021-03-10T15:35:53.197648+0000 mon.a (mon.0) 1451 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:35:54.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:35:54 gibba015 bash[29377]: cluster 2021-03-10T15:35:53.596476+0000 mgr.gibba045.orlgmj (mgr.34412) 5668 : cluster [DBG] pgmap v3223: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:54.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:35:54 gibba015 bash[30343]: cluster 2021-03-10T15:35:53.596476+0000 mgr.gibba045.orlgmj (mgr.34412) 5668 : cluster [DBG] pgmap v3223: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:55.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:35:54 gibba045 bash[25517]: cluster 2021-03-10T15:35:53.596476+0000 mgr.gibba045.orlgmj (mgr.34412) 5668 : cluster [DBG] pgmap v3223: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:56.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:35:56 gibba045 bash[25517]: cluster 2021-03-10T15:35:55.598120+0000 mgr.gibba045.orlgmj (mgr.34412) 5669 : cluster [DBG] pgmap v3224: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:56.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:35:56 gibba015 bash[29377]: cluster 2021-03-10T15:35:55.598120+0000 mgr.gibba045.orlgmj (mgr.34412) 5669 : cluster [DBG] pgmap v3224: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:56.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:35:56 gibba015 bash[30343]: cluster 2021-03-10T15:35:55.598120+0000 mgr.gibba045.orlgmj (mgr.34412) 5669 : cluster [DBG] pgmap v3224: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:57.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:35:57 gibba015 bash[29377]: cephadm 2021-03-10T15:35:56.445015+0000 mgr.gibba045.orlgmj (mgr.34412) 5670 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:35:57.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:35:57 gibba015 bash[30343]: cephadm 2021-03-10T15:35:56.445015+0000 mgr.gibba045.orlgmj (mgr.34412) 5670 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:35:58.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:35:57 gibba045 bash[25517]: cephadm 2021-03-10T15:35:56.445015+0000 mgr.gibba045.orlgmj (mgr.34412) 5670 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:35:58.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:35:58 gibba015 bash[29377]: cluster 2021-03-10T15:35:57.599951+0000 mgr.gibba045.orlgmj (mgr.34412) 5671 : cluster [DBG] pgmap v3225: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:58.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:35:58 gibba015 bash[30343]: cluster 2021-03-10T15:35:57.599951+0000 mgr.gibba045.orlgmj (mgr.34412) 5671 : cluster [DBG] pgmap v3225: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:59.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:35:58 gibba045 bash[25517]: cluster 2021-03-10T15:35:57.599951+0000 mgr.gibba045.orlgmj (mgr.34412) 5671 : cluster [DBG] pgmap v3225: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:00.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:36:00 gibba015 bash[29377]: cluster 2021-03-10T15:35:59.601514+0000 mgr.gibba045.orlgmj (mgr.34412) 5672 : cluster [DBG] pgmap v3226: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:00.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:36:00 gibba015 bash[30343]: cluster 2021-03-10T15:35:59.601514+0000 mgr.gibba045.orlgmj (mgr.34412) 5672 : cluster [DBG] pgmap v3226: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:01.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:36:00 gibba045 bash[25517]: cluster 2021-03-10T15:35:59.601514+0000 mgr.gibba045.orlgmj (mgr.34412) 5672 : cluster [DBG] pgmap v3226: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:02.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:36:02 gibba015 bash[29377]: cluster 2021-03-10T15:36:01.603398+0000 mgr.gibba045.orlgmj (mgr.34412) 5673 : cluster [DBG] pgmap v3227: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:02.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:36:02 gibba015 bash[30343]: cluster 2021-03-10T15:36:01.603398+0000 mgr.gibba045.orlgmj (mgr.34412) 5673 : cluster [DBG] pgmap v3227: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:03.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:36:02 gibba045 bash[25517]: cluster 2021-03-10T15:36:01.603398+0000 mgr.gibba045.orlgmj (mgr.34412) 5673 : cluster [DBG] pgmap v3227: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:04.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:36:04 gibba015 bash[29377]: cluster 2021-03-10T15:36:03.604679+0000 mgr.gibba045.orlgmj (mgr.34412) 5674 : cluster [DBG] pgmap v3228: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:04.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:36:04 gibba015 bash[30343]: cluster 2021-03-10T15:36:03.604679+0000 mgr.gibba045.orlgmj (mgr.34412) 5674 : cluster [DBG] pgmap v3228: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:05.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:36:04 gibba045 bash[25517]: cluster 2021-03-10T15:36:03.604679+0000 mgr.gibba045.orlgmj (mgr.34412) 5674 : cluster [DBG] pgmap v3228: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:06.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:36:06 gibba015 bash[29377]: cluster 2021-03-10T15:36:05.606297+0000 mgr.gibba045.orlgmj (mgr.34412) 5675 : cluster [DBG] pgmap v3229: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:06.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:36:06 gibba015 bash[30343]: cluster 2021-03-10T15:36:05.606297+0000 mgr.gibba045.orlgmj (mgr.34412) 5675 : cluster [DBG] pgmap v3229: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:07.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:36:06 gibba045 bash[25517]: cluster 2021-03-10T15:36:05.606297+0000 mgr.gibba045.orlgmj (mgr.34412) 5675 : cluster [DBG] pgmap v3229: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:08.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:36:08 gibba015 bash[29377]: cluster 2021-03-10T15:36:07.607903+0000 mgr.gibba045.orlgmj (mgr.34412) 5676 : cluster [DBG] pgmap v3230: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:08.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:36:08 gibba015 bash[30343]: cluster 2021-03-10T15:36:07.607903+0000 mgr.gibba045.orlgmj (mgr.34412) 5676 : cluster [DBG] pgmap v3230: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:09.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:36:08 gibba045 bash[25517]: cluster 2021-03-10T15:36:07.607903+0000 mgr.gibba045.orlgmj (mgr.34412) 5676 : cluster [DBG] pgmap v3230: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:10.079 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:36:10.308 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:36:10.308 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (106m) 59s ago 112m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:36:10.309 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (112m) 10m ago 112m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:36:10.309 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (107m) 10m ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:36:10.309 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (107m) 10m ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:36:10.309 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (106m) 59s ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:36:10.310 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (106m) 59s ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:36:10.310 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (105m) 10m ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:36:10.310 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (106m) 59s ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:36:10.310 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (112m) 59s ago 112m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:36:10.311 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (112m) 10m ago 112m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:36:10.311 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (105m) 59s ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:36:10.311 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (104m) 59s ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:36:10.311 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (104m) 59s ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:36:10.311 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (103m) 59s ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:36:10.312 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (103m) 10m ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:36:10.312 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (103m) 10m ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:36:10.312 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (102m) 10m ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:36:10.312 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (102m) 10m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:36:10.313 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (111m) 10m ago 112m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:36:10.313 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 10m ago 110m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:36:10.556 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:36:10.556 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:36:10.556 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:36:10.557 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:36:10.557 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:36:10.557 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:36:10.557 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:36:10.558 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:36:10.558 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:36:10.558 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:36:10.558 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:36:10.559 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:36:10.559 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:36:10.559 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:36:10.559 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:36:10.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:36:10 gibba015 bash[29377]: cluster 2021-03-10T15:36:09.608668+0000 mgr.gibba045.orlgmj (mgr.34412) 5677 : cluster [DBG] pgmap v3231: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:10.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:36:10 gibba015 bash[29377]: audit 2021-03-10T15:36:10.068864+0000 mgr.gibba045.orlgmj (mgr.34412) 5678 : audit [DBG] from='client.47868 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:36:10.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:36:10 gibba015 bash[29377]: audit 2021-03-10T15:36:10.550721+0000 mon.a (mon.0) 1452 : audit [DBG] from='client.? 172.21.2.115:0/1349961672' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:36:10.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:36:10 gibba015 bash[30343]: cluster 2021-03-10T15:36:09.608668+0000 mgr.gibba045.orlgmj (mgr.34412) 5677 : cluster [DBG] pgmap v3231: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:10.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:36:10 gibba015 bash[30343]: audit 2021-03-10T15:36:10.068864+0000 mgr.gibba045.orlgmj (mgr.34412) 5678 : audit [DBG] from='client.47868 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:36:10.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:36:10 gibba015 bash[30343]: audit 2021-03-10T15:36:10.550721+0000 mon.a (mon.0) 1452 : audit [DBG] from='client.? 172.21.2.115:0/1349961672' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:36:11.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:36:10 gibba045 bash[25517]: cluster 2021-03-10T15:36:09.608668+0000 mgr.gibba045.orlgmj (mgr.34412) 5677 : cluster [DBG] pgmap v3231: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:11.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:36:10 gibba045 bash[25517]: audit 2021-03-10T15:36:10.068864+0000 mgr.gibba045.orlgmj (mgr.34412) 5678 : audit [DBG] from='client.47868 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:36:11.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:36:10 gibba045 bash[25517]: audit 2021-03-10T15:36:10.550721+0000 mon.a (mon.0) 1452 : audit [DBG] from='client.? 172.21.2.115:0/1349961672' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:36:11.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:36:11 gibba015 bash[29377]: audit 2021-03-10T15:36:10.294221+0000 mgr.gibba045.orlgmj (mgr.34412) 5679 : audit [DBG] from='client.47874 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:36:11.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:36:11 gibba015 bash[29377]: audit 2021-03-10T15:36:11.458232+0000 mon.c (mon.1) 1596 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:36:11.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:36:11 gibba015 bash[29377]: audit 2021-03-10T15:36:11.465483+0000 mon.c (mon.1) 1597 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:36:11.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:36:11 gibba015 bash[30343]: audit 2021-03-10T15:36:10.294221+0000 mgr.gibba045.orlgmj (mgr.34412) 5679 : audit [DBG] from='client.47874 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:36:11.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:36:11 gibba015 bash[30343]: audit 2021-03-10T15:36:11.458232+0000 mon.c (mon.1) 1596 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:36:11.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:36:11 gibba015 bash[30343]: audit 2021-03-10T15:36:11.465483+0000 mon.c (mon.1) 1597 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:36:12.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:36:11 gibba045 bash[25517]: audit 2021-03-10T15:36:10.294221+0000 mgr.gibba045.orlgmj (mgr.34412) 5679 : audit [DBG] from='client.47874 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:36:12.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:36:11 gibba045 bash[25517]: audit 2021-03-10T15:36:11.458232+0000 mon.c (mon.1) 1596 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:36:12.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:36:11 gibba045 bash[25517]: audit 2021-03-10T15:36:11.465483+0000 mon.c (mon.1) 1597 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:36:12.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:36:12 gibba015 bash[29377]: cephadm 2021-03-10T15:36:11.467197+0000 mgr.gibba045.orlgmj (mgr.34412) 5680 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:36:12.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:36:12 gibba015 bash[29377]: cluster 2021-03-10T15:36:11.609082+0000 mgr.gibba045.orlgmj (mgr.34412) 5681 : cluster [DBG] pgmap v3232: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:12.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:36:12 gibba015 bash[30343]: cephadm 2021-03-10T15:36:11.467197+0000 mgr.gibba045.orlgmj (mgr.34412) 5680 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:36:12.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:36:12 gibba015 bash[30343]: cluster 2021-03-10T15:36:11.609082+0000 mgr.gibba045.orlgmj (mgr.34412) 5681 : cluster [DBG] pgmap v3232: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:13.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:36:12 gibba045 bash[25517]: cephadm 2021-03-10T15:36:11.467197+0000 mgr.gibba045.orlgmj (mgr.34412) 5680 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:36:13.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:36:12 gibba045 bash[25517]: cluster 2021-03-10T15:36:11.609082+0000 mgr.gibba045.orlgmj (mgr.34412) 5681 : cluster [DBG] pgmap v3232: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:14.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:36:14 gibba015 bash[29377]: cluster 2021-03-10T15:36:13.610371+0000 mgr.gibba045.orlgmj (mgr.34412) 5682 : cluster [DBG] pgmap v3233: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:14.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:36:14 gibba015 bash[30343]: cluster 2021-03-10T15:36:13.610371+0000 mgr.gibba045.orlgmj (mgr.34412) 5682 : cluster [DBG] pgmap v3233: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:15.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:36:14 gibba045 bash[25517]: cluster 2021-03-10T15:36:13.610371+0000 mgr.gibba045.orlgmj (mgr.34412) 5682 : cluster [DBG] pgmap v3233: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:16.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:36:16 gibba015 bash[29377]: audit 2021-03-10T15:36:15.185722+0000 mon.a (mon.0) 1453 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:36:16.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:36:16 gibba015 bash[29377]: cephadm 2021-03-10T15:36:15.192815+0000 mgr.gibba045.orlgmj (mgr.34412) 5683 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:36:16.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:36:16 gibba015 bash[29377]: audit 2021-03-10T15:36:15.386532+0000 mon.a (mon.0) 1454 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:36:16.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:36:16 gibba015 bash[29377]: audit 2021-03-10T15:36:15.390494+0000 mon.c (mon.1) 1598 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:36:16.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:36:16 gibba015 bash[29377]: audit 2021-03-10T15:36:15.392036+0000 mon.c (mon.1) 1599 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:36:16.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:36:16 gibba015 bash[29377]: audit 2021-03-10T15:36:15.393415+0000 mon.c (mon.1) 1600 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:36:16.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:36:16 gibba015 bash[29377]: audit 2021-03-10T15:36:15.394885+0000 mon.c (mon.1) 1601 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:36:16.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:36:16 gibba015 bash[29377]: audit 2021-03-10T15:36:15.398157+0000 mon.c (mon.1) 1602 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:36:16.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:36:16 gibba015 bash[29377]: audit 2021-03-10T15:36:15.399590+0000 mon.c (mon.1) 1603 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:36:16.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:36:16 gibba015 bash[30343]: audit 2021-03-10T15:36:15.185722+0000 mon.a (mon.0) 1453 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:36:16.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:36:16 gibba015 bash[30343]: cephadm 2021-03-10T15:36:15.192815+0000 mgr.gibba045.orlgmj (mgr.34412) 5683 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:36:16.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:36:16 gibba015 bash[30343]: audit 2021-03-10T15:36:15.386532+0000 mon.a (mon.0) 1454 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:36:16.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:36:16 gibba015 bash[30343]: audit 2021-03-10T15:36:15.390494+0000 mon.c (mon.1) 1598 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:36:16.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:36:16 gibba015 bash[30343]: audit 2021-03-10T15:36:15.392036+0000 mon.c (mon.1) 1599 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:36:16.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:36:16 gibba015 bash[30343]: audit 2021-03-10T15:36:15.393415+0000 mon.c (mon.1) 1600 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:36:16.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:36:16 gibba015 bash[30343]: audit 2021-03-10T15:36:15.394885+0000 mon.c (mon.1) 1601 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:36:16.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:36:16 gibba015 bash[30343]: audit 2021-03-10T15:36:15.398157+0000 mon.c (mon.1) 1602 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:36:16.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:36:16 gibba015 bash[30343]: audit 2021-03-10T15:36:15.399590+0000 mon.c (mon.1) 1603 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:36:16.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:36:16 gibba045 bash[25517]: audit 2021-03-10T15:36:15.185722+0000 mon.a (mon.0) 1453 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:36:16.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:36:16 gibba045 bash[25517]: cephadm 2021-03-10T15:36:15.192815+0000 mgr.gibba045.orlgmj (mgr.34412) 5683 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:36:16.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:36:16 gibba045 bash[25517]: audit 2021-03-10T15:36:15.386532+0000 mon.a (mon.0) 1454 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:36:16.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:36:16 gibba045 bash[25517]: audit 2021-03-10T15:36:15.390494+0000 mon.c (mon.1) 1598 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:36:16.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:36:16 gibba045 bash[25517]: audit 2021-03-10T15:36:15.392036+0000 mon.c (mon.1) 1599 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:36:16.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:36:16 gibba045 bash[25517]: audit 2021-03-10T15:36:15.393415+0000 mon.c (mon.1) 1600 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:36:16.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:36:16 gibba045 bash[25517]: audit 2021-03-10T15:36:15.394885+0000 mon.c (mon.1) 1601 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:36:16.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:36:16 gibba045 bash[25517]: audit 2021-03-10T15:36:15.398157+0000 mon.c (mon.1) 1602 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:36:16.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:36:16 gibba045 bash[25517]: audit 2021-03-10T15:36:15.399590+0000 mon.c (mon.1) 1603 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:36:17.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:36:17 gibba015 bash[29377]: cephadm 2021-03-10T15:36:15.393117+0000 mgr.gibba045.orlgmj (mgr.34412) 5684 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:36:17.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:36:17 gibba015 bash[29377]: cephadm 2021-03-10T15:36:15.395207+0000 mgr.gibba045.orlgmj (mgr.34412) 5685 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:36:17.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:36:17 gibba015 bash[29377]: cephadm 2021-03-10T15:36:15.396592+0000 mgr.gibba045.orlgmj (mgr.34412) 5686 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:36:17.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:36:17 gibba015 bash[29377]: cephadm 2021-03-10T15:36:15.396629+0000 mgr.gibba045.orlgmj (mgr.34412) 5687 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:36:17.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:36:17 gibba015 bash[29377]: cephadm 2021-03-10T15:36:15.397946+0000 mgr.gibba045.orlgmj (mgr.34412) 5688 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:36:17.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:36:17 gibba015 bash[29377]: cephadm 2021-03-10T15:36:15.397984+0000 mgr.gibba045.orlgmj (mgr.34412) 5689 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:36:17.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:36:17 gibba015 bash[29377]: cephadm 2021-03-10T15:36:15.399570+0000 mgr.gibba045.orlgmj (mgr.34412) 5690 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:36:17.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:36:17 gibba015 bash[29377]: cephadm 2021-03-10T15:36:15.401297+0000 mgr.gibba045.orlgmj (mgr.34412) 5691 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:36:17.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:36:17 gibba015 bash[29377]: cephadm 2021-03-10T15:36:15.401332+0000 mgr.gibba045.orlgmj (mgr.34412) 5692 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:36:17.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:36:17 gibba015 bash[29377]: cephadm 2021-03-10T15:36:15.402576+0000 mgr.gibba045.orlgmj (mgr.34412) 5693 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:36:17.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:36:17 gibba015 bash[29377]: cephadm 2021-03-10T15:36:15.402884+0000 mgr.gibba045.orlgmj (mgr.34412) 5694 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:36:17.479 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:36:17 gibba015 bash[29377]: cephadm 2021-03-10T15:36:15.404003+0000 mgr.gibba045.orlgmj (mgr.34412) 5695 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:36:17.479 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:36:17 gibba015 bash[29377]: cephadm 2021-03-10T15:36:15.404048+0000 mgr.gibba045.orlgmj (mgr.34412) 5696 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:36:17.479 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:36:17 gibba015 bash[29377]: cephadm 2021-03-10T15:36:15.404175+0000 mgr.gibba045.orlgmj (mgr.34412) 5697 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:36:17.479 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:36:17 gibba015 bash[29377]: cluster 2021-03-10T15:36:15.612001+0000 mgr.gibba045.orlgmj (mgr.34412) 5698 : cluster [DBG] pgmap v3234: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:17.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:36:17 gibba015 bash[30343]: cephadm 2021-03-10T15:36:15.393117+0000 mgr.gibba045.orlgmj (mgr.34412) 5684 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:36:17.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:36:17 gibba015 bash[30343]: cephadm 2021-03-10T15:36:15.395207+0000 mgr.gibba045.orlgmj (mgr.34412) 5685 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:36:17.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:36:17 gibba015 bash[30343]: cephadm 2021-03-10T15:36:15.396592+0000 mgr.gibba045.orlgmj (mgr.34412) 5686 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:36:17.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:36:17 gibba015 bash[30343]: cephadm 2021-03-10T15:36:15.396629+0000 mgr.gibba045.orlgmj (mgr.34412) 5687 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:36:17.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:36:17 gibba015 bash[30343]: cephadm 2021-03-10T15:36:15.397946+0000 mgr.gibba045.orlgmj (mgr.34412) 5688 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:36:17.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:36:17 gibba015 bash[30343]: cephadm 2021-03-10T15:36:15.397984+0000 mgr.gibba045.orlgmj (mgr.34412) 5689 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:36:17.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:36:17 gibba015 bash[30343]: cephadm 2021-03-10T15:36:15.399570+0000 mgr.gibba045.orlgmj (mgr.34412) 5690 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:36:17.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:36:17 gibba015 bash[30343]: cephadm 2021-03-10T15:36:15.401297+0000 mgr.gibba045.orlgmj (mgr.34412) 5691 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:36:17.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:36:17 gibba015 bash[30343]: cephadm 2021-03-10T15:36:15.401332+0000 mgr.gibba045.orlgmj (mgr.34412) 5692 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:36:17.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:36:17 gibba015 bash[30343]: cephadm 2021-03-10T15:36:15.402576+0000 mgr.gibba045.orlgmj (mgr.34412) 5693 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:36:17.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:36:17 gibba015 bash[30343]: cephadm 2021-03-10T15:36:15.402884+0000 mgr.gibba045.orlgmj (mgr.34412) 5694 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:36:17.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:36:17 gibba015 bash[30343]: cephadm 2021-03-10T15:36:15.404003+0000 mgr.gibba045.orlgmj (mgr.34412) 5695 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:36:17.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:36:17 gibba015 bash[30343]: cephadm 2021-03-10T15:36:15.404048+0000 mgr.gibba045.orlgmj (mgr.34412) 5696 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:36:17.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:36:17 gibba015 bash[30343]: cephadm 2021-03-10T15:36:15.404175+0000 mgr.gibba045.orlgmj (mgr.34412) 5697 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:36:17.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:36:17 gibba015 bash[30343]: cluster 2021-03-10T15:36:15.612001+0000 mgr.gibba045.orlgmj (mgr.34412) 5698 : cluster [DBG] pgmap v3234: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:17.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:36:17 gibba045 bash[25517]: cephadm 2021-03-10T15:36:15.393117+0000 mgr.gibba045.orlgmj (mgr.34412) 5684 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:36:17.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:36:17 gibba045 bash[25517]: cephadm 2021-03-10T15:36:15.395207+0000 mgr.gibba045.orlgmj (mgr.34412) 5685 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:36:17.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:36:17 gibba045 bash[25517]: cephadm 2021-03-10T15:36:15.396592+0000 mgr.gibba045.orlgmj (mgr.34412) 5686 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:36:17.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:36:17 gibba045 bash[25517]: cephadm 2021-03-10T15:36:15.396629+0000 mgr.gibba045.orlgmj (mgr.34412) 5687 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:36:17.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:36:17 gibba045 bash[25517]: cephadm 2021-03-10T15:36:15.397946+0000 mgr.gibba045.orlgmj (mgr.34412) 5688 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:36:17.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:36:17 gibba045 bash[25517]: cephadm 2021-03-10T15:36:15.397984+0000 mgr.gibba045.orlgmj (mgr.34412) 5689 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:36:17.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:36:17 gibba045 bash[25517]: cephadm 2021-03-10T15:36:15.399570+0000 mgr.gibba045.orlgmj (mgr.34412) 5690 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:36:17.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:36:17 gibba045 bash[25517]: cephadm 2021-03-10T15:36:15.401297+0000 mgr.gibba045.orlgmj (mgr.34412) 5691 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:36:17.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:36:17 gibba045 bash[25517]: cephadm 2021-03-10T15:36:15.401332+0000 mgr.gibba045.orlgmj (mgr.34412) 5692 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:36:17.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:36:17 gibba045 bash[25517]: cephadm 2021-03-10T15:36:15.402576+0000 mgr.gibba045.orlgmj (mgr.34412) 5693 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:36:17.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:36:17 gibba045 bash[25517]: cephadm 2021-03-10T15:36:15.402884+0000 mgr.gibba045.orlgmj (mgr.34412) 5694 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:36:17.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:36:17 gibba045 bash[25517]: cephadm 2021-03-10T15:36:15.404003+0000 mgr.gibba045.orlgmj (mgr.34412) 5695 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:36:17.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:36:17 gibba045 bash[25517]: cephadm 2021-03-10T15:36:15.404048+0000 mgr.gibba045.orlgmj (mgr.34412) 5696 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:36:17.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:36:17 gibba045 bash[25517]: cephadm 2021-03-10T15:36:15.404175+0000 mgr.gibba045.orlgmj (mgr.34412) 5697 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:36:17.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:36:17 gibba045 bash[25517]: cluster 2021-03-10T15:36:15.612001+0000 mgr.gibba045.orlgmj (mgr.34412) 5698 : cluster [DBG] pgmap v3234: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:18.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:36:18 gibba045 bash[25517]: cluster 2021-03-10T15:36:17.613704+0000 mgr.gibba045.orlgmj (mgr.34412) 5699 : cluster [DBG] pgmap v3235: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:18.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:36:18 gibba015 bash[29377]: cluster 2021-03-10T15:36:17.613704+0000 mgr.gibba045.orlgmj (mgr.34412) 5699 : cluster [DBG] pgmap v3235: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:18.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:36:18 gibba015 bash[30343]: cluster 2021-03-10T15:36:17.613704+0000 mgr.gibba045.orlgmj (mgr.34412) 5699 : cluster [DBG] pgmap v3235: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:20.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:36:20 gibba015 bash[29377]: cluster 2021-03-10T15:36:19.614587+0000 mgr.gibba045.orlgmj (mgr.34412) 5700 : cluster [DBG] pgmap v3236: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:20.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:36:20 gibba015 bash[30343]: cluster 2021-03-10T15:36:19.614587+0000 mgr.gibba045.orlgmj (mgr.34412) 5700 : cluster [DBG] pgmap v3236: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:21.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:36:20 gibba045 bash[25517]: cluster 2021-03-10T15:36:19.614587+0000 mgr.gibba045.orlgmj (mgr.34412) 5700 : cluster [DBG] pgmap v3236: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:22.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:36:22 gibba015 bash[29377]: cluster 2021-03-10T15:36:21.616217+0000 mgr.gibba045.orlgmj (mgr.34412) 5701 : cluster [DBG] pgmap v3237: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:22.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:36:22 gibba015 bash[30343]: cluster 2021-03-10T15:36:21.616217+0000 mgr.gibba045.orlgmj (mgr.34412) 5701 : cluster [DBG] pgmap v3237: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:23.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:36:22 gibba045 bash[25517]: cluster 2021-03-10T15:36:21.616217+0000 mgr.gibba045.orlgmj (mgr.34412) 5701 : cluster [DBG] pgmap v3237: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:24.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:36:24 gibba015 bash[29377]: cluster 2021-03-10T15:36:23.617584+0000 mgr.gibba045.orlgmj (mgr.34412) 5702 : cluster [DBG] pgmap v3238: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:24.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:36:24 gibba015 bash[30343]: cluster 2021-03-10T15:36:23.617584+0000 mgr.gibba045.orlgmj (mgr.34412) 5702 : cluster [DBG] pgmap v3238: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:25.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:36:24 gibba045 bash[25517]: cluster 2021-03-10T15:36:23.617584+0000 mgr.gibba045.orlgmj (mgr.34412) 5702 : cluster [DBG] pgmap v3238: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:26.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:36:26 gibba015 bash[29377]: cluster 2021-03-10T15:36:25.619081+0000 mgr.gibba045.orlgmj (mgr.34412) 5703 : cluster [DBG] pgmap v3239: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:26.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:36:26 gibba015 bash[30343]: cluster 2021-03-10T15:36:25.619081+0000 mgr.gibba045.orlgmj (mgr.34412) 5703 : cluster [DBG] pgmap v3239: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:27.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:36:26 gibba045 bash[25517]: cluster 2021-03-10T15:36:25.619081+0000 mgr.gibba045.orlgmj (mgr.34412) 5703 : cluster [DBG] pgmap v3239: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:28.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:36:28 gibba015 bash[29377]: cluster 2021-03-10T15:36:27.620861+0000 mgr.gibba045.orlgmj (mgr.34412) 5704 : cluster [DBG] pgmap v3240: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:28.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:36:28 gibba015 bash[30343]: cluster 2021-03-10T15:36:27.620861+0000 mgr.gibba045.orlgmj (mgr.34412) 5704 : cluster [DBG] pgmap v3240: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:29.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:36:28 gibba045 bash[25517]: cluster 2021-03-10T15:36:27.620861+0000 mgr.gibba045.orlgmj (mgr.34412) 5704 : cluster [DBG] pgmap v3240: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:30.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:36:30 gibba045 bash[25517]: cluster 2021-03-10T15:36:29.621723+0000 mgr.gibba045.orlgmj (mgr.34412) 5705 : cluster [DBG] pgmap v3241: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:30.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:36:30 gibba015 bash[30343]: cluster 2021-03-10T15:36:29.621723+0000 mgr.gibba045.orlgmj (mgr.34412) 5705 : cluster [DBG] pgmap v3241: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:30.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:36:30 gibba015 bash[29377]: cluster 2021-03-10T15:36:29.621723+0000 mgr.gibba045.orlgmj (mgr.34412) 5705 : cluster [DBG] pgmap v3241: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:31.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:36:31 gibba015 bash[29377]: cephadm 2021-03-10T15:36:30.420219+0000 mgr.gibba045.orlgmj (mgr.34412) 5706 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:36:31.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:36:31 gibba015 bash[30343]: cephadm 2021-03-10T15:36:30.420219+0000 mgr.gibba045.orlgmj (mgr.34412) 5706 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:36:32.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:36:31 gibba045 bash[25517]: cephadm 2021-03-10T15:36:30.420219+0000 mgr.gibba045.orlgmj (mgr.34412) 5706 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:36:32.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:36:32 gibba015 bash[29377]: cluster 2021-03-10T15:36:31.622527+0000 mgr.gibba045.orlgmj (mgr.34412) 5707 : cluster [DBG] pgmap v3242: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:32.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:36:32 gibba015 bash[30343]: cluster 2021-03-10T15:36:31.622527+0000 mgr.gibba045.orlgmj (mgr.34412) 5707 : cluster [DBG] pgmap v3242: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:33.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:36:32 gibba045 bash[25517]: cluster 2021-03-10T15:36:31.622527+0000 mgr.gibba045.orlgmj (mgr.34412) 5707 : cluster [DBG] pgmap v3242: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:34.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:36:34 gibba015 bash[29377]: cluster 2021-03-10T15:36:33.623928+0000 mgr.gibba045.orlgmj (mgr.34412) 5708 : cluster [DBG] pgmap v3243: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:34.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:36:34 gibba015 bash[30343]: cluster 2021-03-10T15:36:33.623928+0000 mgr.gibba045.orlgmj (mgr.34412) 5708 : cluster [DBG] pgmap v3243: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:35.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:36:34 gibba045 bash[25517]: cluster 2021-03-10T15:36:33.623928+0000 mgr.gibba045.orlgmj (mgr.34412) 5708 : cluster [DBG] pgmap v3243: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:36.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:36:36 gibba015 bash[29377]: cluster 2021-03-10T15:36:35.625373+0000 mgr.gibba045.orlgmj (mgr.34412) 5709 : cluster [DBG] pgmap v3244: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:36.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:36:36 gibba015 bash[30343]: cluster 2021-03-10T15:36:35.625373+0000 mgr.gibba045.orlgmj (mgr.34412) 5709 : cluster [DBG] pgmap v3244: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:37.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:36:36 gibba045 bash[25517]: cluster 2021-03-10T15:36:35.625373+0000 mgr.gibba045.orlgmj (mgr.34412) 5709 : cluster [DBG] pgmap v3244: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:38.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:36:38 gibba015 bash[29377]: cluster 2021-03-10T15:36:37.626989+0000 mgr.gibba045.orlgmj (mgr.34412) 5710 : cluster [DBG] pgmap v3245: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:38.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:36:38 gibba015 bash[30343]: cluster 2021-03-10T15:36:37.626989+0000 mgr.gibba045.orlgmj (mgr.34412) 5710 : cluster [DBG] pgmap v3245: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:39.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:36:38 gibba045 bash[25517]: cluster 2021-03-10T15:36:37.626989+0000 mgr.gibba045.orlgmj (mgr.34412) 5710 : cluster [DBG] pgmap v3245: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:40.805 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:36:40.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:36:40 gibba015 bash[29377]: cluster 2021-03-10T15:36:39.627570+0000 mgr.gibba045.orlgmj (mgr.34412) 5711 : cluster [DBG] pgmap v3246: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:40.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:36:40 gibba015 bash[30343]: cluster 2021-03-10T15:36:39.627570+0000 mgr.gibba045.orlgmj (mgr.34412) 5711 : cluster [DBG] pgmap v3246: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:41.032 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:36:41.033 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (107m) 89s ago 112m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:36:41.033 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (112m) 25s ago 112m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:36:41.033 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (107m) 25s ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:36:41.033 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (108m) 25s ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:36:41.034 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (107m) 89s ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:36:41.034 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (106m) 89s ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:36:41.034 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (106m) 25s ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:36:41.034 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (106m) 89s ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:36:41.035 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (112m) 89s ago 112m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:36:41.035 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (112m) 25s ago 112m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:36:41.035 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (105m) 89s ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:36:41.035 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (105m) 89s ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:36:41.036 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (104m) 89s ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:36:41.036 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (104m) 89s ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:36:41.036 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (104m) 25s ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:36:41.036 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (103m) 25s ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:36:41.037 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (103m) 25s ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:36:41.037 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (102m) 25s ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:36:41.037 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (112m) 25s ago 112m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:36:41.037 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 25s ago 110m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:36:41.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:36:40 gibba045 bash[25517]: cluster 2021-03-10T15:36:39.627570+0000 mgr.gibba045.orlgmj (mgr.34412) 5711 : cluster [DBG] pgmap v3246: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:41.285 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:36:41.285 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:36:41.285 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:36:41.286 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:36:41.286 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:36:41.286 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:36:41.286 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:36:41.287 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:36:41.287 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:36:41.287 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:36:41.287 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:36:41.287 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:36:41.288 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:36:41.288 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:36:41.288 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:36:41.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:36:41 gibba015 bash[29377]: audit 2021-03-10T15:36:40.794883+0000 mgr.gibba045.orlgmj (mgr.34412) 5712 : audit [DBG] from='client.47886 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:36:41.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:36:41 gibba015 bash[29377]: audit 2021-03-10T15:36:41.018845+0000 mgr.gibba045.orlgmj (mgr.34412) 5713 : audit [DBG] from='client.47892 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:36:41.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:36:41 gibba015 bash[29377]: audit 2021-03-10T15:36:41.279945+0000 mon.c (mon.1) 1604 : audit [DBG] from='client.? 172.21.2.115:0/1256529584' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:36:41.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:36:41 gibba015 bash[30343]: audit 2021-03-10T15:36:40.794883+0000 mgr.gibba045.orlgmj (mgr.34412) 5712 : audit [DBG] from='client.47886 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:36:41.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:36:41 gibba015 bash[30343]: audit 2021-03-10T15:36:41.018845+0000 mgr.gibba045.orlgmj (mgr.34412) 5713 : audit [DBG] from='client.47892 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:36:41.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:36:41 gibba015 bash[30343]: audit 2021-03-10T15:36:41.279945+0000 mon.c (mon.1) 1604 : audit [DBG] from='client.? 172.21.2.115:0/1256529584' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:36:42.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:36:41 gibba045 bash[25517]: audit 2021-03-10T15:36:40.794883+0000 mgr.gibba045.orlgmj (mgr.34412) 5712 : audit [DBG] from='client.47886 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:36:42.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:36:41 gibba045 bash[25517]: audit 2021-03-10T15:36:41.018845+0000 mgr.gibba045.orlgmj (mgr.34412) 5713 : audit [DBG] from='client.47892 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:36:42.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:36:41 gibba045 bash[25517]: audit 2021-03-10T15:36:41.279945+0000 mon.c (mon.1) 1604 : audit [DBG] from='client.? 172.21.2.115:0/1256529584' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:36:42.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:36:42 gibba015 bash[29377]: cluster 2021-03-10T15:36:41.628269+0000 mgr.gibba045.orlgmj (mgr.34412) 5714 : cluster [DBG] pgmap v3247: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:42.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:36:42 gibba015 bash[30343]: cluster 2021-03-10T15:36:41.628269+0000 mgr.gibba045.orlgmj (mgr.34412) 5714 : cluster [DBG] pgmap v3247: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:43.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:36:42 gibba045 bash[25517]: cluster 2021-03-10T15:36:41.628269+0000 mgr.gibba045.orlgmj (mgr.34412) 5714 : cluster [DBG] pgmap v3247: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:44.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:36:44 gibba015 bash[29377]: cluster 2021-03-10T15:36:43.629568+0000 mgr.gibba045.orlgmj (mgr.34412) 5715 : cluster [DBG] pgmap v3248: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:44.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:36:44 gibba015 bash[30343]: cluster 2021-03-10T15:36:43.629568+0000 mgr.gibba045.orlgmj (mgr.34412) 5715 : cluster [DBG] pgmap v3248: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:45.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:36:44 gibba045 bash[25517]: cluster 2021-03-10T15:36:43.629568+0000 mgr.gibba045.orlgmj (mgr.34412) 5715 : cluster [DBG] pgmap v3248: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:46.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:36:46 gibba015 bash[29377]: cephadm 2021-03-10T15:36:45.436280+0000 mgr.gibba045.orlgmj (mgr.34412) 5716 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:36:46.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:36:46 gibba015 bash[29377]: cluster 2021-03-10T15:36:45.630988+0000 mgr.gibba045.orlgmj (mgr.34412) 5717 : cluster [DBG] pgmap v3249: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:46.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:36:46 gibba015 bash[30343]: cephadm 2021-03-10T15:36:45.436280+0000 mgr.gibba045.orlgmj (mgr.34412) 5716 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:36:46.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:36:46 gibba015 bash[30343]: cluster 2021-03-10T15:36:45.630988+0000 mgr.gibba045.orlgmj (mgr.34412) 5717 : cluster [DBG] pgmap v3249: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:47.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:36:46 gibba045 bash[25517]: cephadm 2021-03-10T15:36:45.436280+0000 mgr.gibba045.orlgmj (mgr.34412) 5716 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:36:47.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:36:46 gibba045 bash[25517]: cluster 2021-03-10T15:36:45.630988+0000 mgr.gibba045.orlgmj (mgr.34412) 5717 : cluster [DBG] pgmap v3249: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:48.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:36:48 gibba015 bash[29377]: cluster 2021-03-10T15:36:47.632678+0000 mgr.gibba045.orlgmj (mgr.34412) 5718 : cluster [DBG] pgmap v3250: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:48.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:36:48 gibba015 bash[30343]: cluster 2021-03-10T15:36:47.632678+0000 mgr.gibba045.orlgmj (mgr.34412) 5718 : cluster [DBG] pgmap v3250: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:49.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:36:48 gibba045 bash[25517]: cluster 2021-03-10T15:36:47.632678+0000 mgr.gibba045.orlgmj (mgr.34412) 5718 : cluster [DBG] pgmap v3250: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:50.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:36:50 gibba015 bash[29377]: cluster 2021-03-10T15:36:49.634012+0000 mgr.gibba045.orlgmj (mgr.34412) 5719 : cluster [DBG] pgmap v3251: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:50.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:36:50 gibba015 bash[30343]: cluster 2021-03-10T15:36:49.634012+0000 mgr.gibba045.orlgmj (mgr.34412) 5719 : cluster [DBG] pgmap v3251: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:51.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:36:50 gibba045 bash[25517]: cluster 2021-03-10T15:36:49.634012+0000 mgr.gibba045.orlgmj (mgr.34412) 5719 : cluster [DBG] pgmap v3251: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:52.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:36:52 gibba015 bash[29377]: cluster 2021-03-10T15:36:51.635893+0000 mgr.gibba045.orlgmj (mgr.34412) 5720 : cluster [DBG] pgmap v3252: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:52.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:36:52 gibba015 bash[30343]: cluster 2021-03-10T15:36:51.635893+0000 mgr.gibba045.orlgmj (mgr.34412) 5720 : cluster [DBG] pgmap v3252: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:53.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:36:52 gibba045 bash[25517]: cluster 2021-03-10T15:36:51.635893+0000 mgr.gibba045.orlgmj (mgr.34412) 5720 : cluster [DBG] pgmap v3252: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:36:53 gibba015 bash[29377]: audit 2021-03-10T15:36:53.197949+0000 mon.c (mon.1) 1605 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:36:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:36:53 gibba015 bash[29377]: audit 2021-03-10T15:36:53.198633+0000 mon.c (mon.1) 1606 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:36:53.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:36:53 gibba015 bash[29377]: audit 2021-03-10T15:36:53.199126+0000 mon.a (mon.0) 1455 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:36:53.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:36:53 gibba015 bash[29377]: audit 2021-03-10T15:36:53.199693+0000 mon.c (mon.1) 1607 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T15:36:53.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:36:53 gibba015 bash[29377]: audit 2021-03-10T15:36:53.200371+0000 mon.a (mon.0) 1456 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:36:53.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:36:53 gibba015 bash[29377]: audit 2021-03-10T15:36:53.200585+0000 mon.c (mon.1) 1608 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:36:53.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:36:53 gibba015 bash[29377]: audit 2021-03-10T15:36:53.201319+0000 mon.a (mon.0) 1457 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T15:36:53.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:36:53 gibba015 bash[29377]: audit 2021-03-10T15:36:53.201441+0000 mon.c (mon.1) 1609 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:36:53.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:36:53 gibba015 bash[29377]: audit 2021-03-10T15:36:53.202125+0000 mon.c (mon.1) 1610 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:36:53.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:36:53 gibba015 bash[29377]: audit 2021-03-10T15:36:53.202328+0000 mon.a (mon.0) 1458 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:36:53.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:36:53 gibba015 bash[29377]: audit 2021-03-10T15:36:53.203289+0000 mon.a (mon.0) 1459 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:36:53.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:36:53 gibba015 bash[29377]: audit 2021-03-10T15:36:53.204300+0000 mon.a (mon.0) 1460 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:36:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:36:53 gibba015 bash[30343]: audit 2021-03-10T15:36:53.197949+0000 mon.c (mon.1) 1605 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:36:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:36:53 gibba015 bash[30343]: audit 2021-03-10T15:36:53.198633+0000 mon.c (mon.1) 1606 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:36:53.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:36:53 gibba015 bash[30343]: audit 2021-03-10T15:36:53.199126+0000 mon.a (mon.0) 1455 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:36:53.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:36:53 gibba015 bash[30343]: audit 2021-03-10T15:36:53.199693+0000 mon.c (mon.1) 1607 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T15:36:53.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:36:53 gibba015 bash[30343]: audit 2021-03-10T15:36:53.200371+0000 mon.a (mon.0) 1456 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:36:53.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:36:53 gibba015 bash[30343]: audit 2021-03-10T15:36:53.200585+0000 mon.c (mon.1) 1608 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:36:53.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:36:53 gibba015 bash[30343]: audit 2021-03-10T15:36:53.201319+0000 mon.a (mon.0) 1457 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T15:36:53.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:36:53 gibba015 bash[30343]: audit 2021-03-10T15:36:53.201441+0000 mon.c (mon.1) 1609 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:36:53.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:36:53 gibba015 bash[30343]: audit 2021-03-10T15:36:53.202125+0000 mon.c (mon.1) 1610 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:36:53.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:36:53 gibba015 bash[30343]: audit 2021-03-10T15:36:53.202328+0000 mon.a (mon.0) 1458 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:36:53.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:36:53 gibba015 bash[30343]: audit 2021-03-10T15:36:53.203289+0000 mon.a (mon.0) 1459 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:36:53.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:36:53 gibba015 bash[30343]: audit 2021-03-10T15:36:53.204300+0000 mon.a (mon.0) 1460 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:36:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:36:53 gibba045 bash[25517]: audit 2021-03-10T15:36:53.197949+0000 mon.c (mon.1) 1605 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:36:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:36:53 gibba045 bash[25517]: audit 2021-03-10T15:36:53.198633+0000 mon.c (mon.1) 1606 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:36:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:36:53 gibba045 bash[25517]: audit 2021-03-10T15:36:53.199126+0000 mon.a (mon.0) 1455 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:36:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:36:53 gibba045 bash[25517]: audit 2021-03-10T15:36:53.199693+0000 mon.c (mon.1) 1607 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T15:36:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:36:53 gibba045 bash[25517]: audit 2021-03-10T15:36:53.200371+0000 mon.a (mon.0) 1456 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:36:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:36:53 gibba045 bash[25517]: audit 2021-03-10T15:36:53.200585+0000 mon.c (mon.1) 1608 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:36:54.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:36:53 gibba045 bash[25517]: audit 2021-03-10T15:36:53.201319+0000 mon.a (mon.0) 1457 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T15:36:54.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:36:53 gibba045 bash[25517]: audit 2021-03-10T15:36:53.201441+0000 mon.c (mon.1) 1609 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:36:54.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:36:53 gibba045 bash[25517]: audit 2021-03-10T15:36:53.202125+0000 mon.c (mon.1) 1610 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:36:54.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:36:53 gibba045 bash[25517]: audit 2021-03-10T15:36:53.202328+0000 mon.a (mon.0) 1458 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:36:54.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:36:53 gibba045 bash[25517]: audit 2021-03-10T15:36:53.203289+0000 mon.a (mon.0) 1459 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:36:54.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:36:53 gibba045 bash[25517]: audit 2021-03-10T15:36:53.204300+0000 mon.a (mon.0) 1460 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:36:54.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:36:54 gibba015 bash[29377]: cluster 2021-03-10T15:36:53.637392+0000 mgr.gibba045.orlgmj (mgr.34412) 5721 : cluster [DBG] pgmap v3253: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:54.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:36:54 gibba015 bash[30343]: cluster 2021-03-10T15:36:53.637392+0000 mgr.gibba045.orlgmj (mgr.34412) 5721 : cluster [DBG] pgmap v3253: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:55.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:36:54 gibba045 bash[25517]: cluster 2021-03-10T15:36:53.637392+0000 mgr.gibba045.orlgmj (mgr.34412) 5721 : cluster [DBG] pgmap v3253: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:57.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:36:56 gibba045 bash[25517]: cluster 2021-03-10T15:36:55.638992+0000 mgr.gibba045.orlgmj (mgr.34412) 5722 : cluster [DBG] pgmap v3254: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:57.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:36:56 gibba015 bash[29377]: cluster 2021-03-10T15:36:55.638992+0000 mgr.gibba045.orlgmj (mgr.34412) 5722 : cluster [DBG] pgmap v3254: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:57.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:36:56 gibba015 bash[30343]: cluster 2021-03-10T15:36:55.638992+0000 mgr.gibba045.orlgmj (mgr.34412) 5722 : cluster [DBG] pgmap v3254: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:59.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:36:58 gibba045 bash[25517]: cluster 2021-03-10T15:36:57.640414+0000 mgr.gibba045.orlgmj (mgr.34412) 5723 : cluster [DBG] pgmap v3255: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:59.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:36:58 gibba015 bash[29377]: cluster 2021-03-10T15:36:57.640414+0000 mgr.gibba045.orlgmj (mgr.34412) 5723 : cluster [DBG] pgmap v3255: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:59.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:36:58 gibba015 bash[30343]: cluster 2021-03-10T15:36:57.640414+0000 mgr.gibba045.orlgmj (mgr.34412) 5723 : cluster [DBG] pgmap v3255: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:00.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:37:00 gibba045 bash[25517]: cluster 2021-03-10T15:36:59.642057+0000 mgr.gibba045.orlgmj (mgr.34412) 5724 : cluster [DBG] pgmap v3256: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:00.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:37:00 gibba015 bash[29377]: cluster 2021-03-10T15:36:59.642057+0000 mgr.gibba045.orlgmj (mgr.34412) 5724 : cluster [DBG] pgmap v3256: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:00.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:37:00 gibba015 bash[30343]: cluster 2021-03-10T15:36:59.642057+0000 mgr.gibba045.orlgmj (mgr.34412) 5724 : cluster [DBG] pgmap v3256: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:01.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:37:01 gibba015 bash[29377]: cephadm 2021-03-10T15:37:00.447813+0000 mgr.gibba045.orlgmj (mgr.34412) 5725 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:37:01.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:37:01 gibba015 bash[30343]: cephadm 2021-03-10T15:37:00.447813+0000 mgr.gibba045.orlgmj (mgr.34412) 5725 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:37:02.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:37:01 gibba045 bash[25517]: cephadm 2021-03-10T15:37:00.447813+0000 mgr.gibba045.orlgmj (mgr.34412) 5725 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:37:02.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:37:02 gibba015 bash[29377]: cluster 2021-03-10T15:37:01.642994+0000 mgr.gibba045.orlgmj (mgr.34412) 5726 : cluster [DBG] pgmap v3257: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:02.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:37:02 gibba015 bash[30343]: cluster 2021-03-10T15:37:01.642994+0000 mgr.gibba045.orlgmj (mgr.34412) 5726 : cluster [DBG] pgmap v3257: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:03.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:37:02 gibba045 bash[25517]: cluster 2021-03-10T15:37:01.642994+0000 mgr.gibba045.orlgmj (mgr.34412) 5726 : cluster [DBG] pgmap v3257: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:04.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:37:04 gibba015 bash[29377]: cluster 2021-03-10T15:37:03.644349+0000 mgr.gibba045.orlgmj (mgr.34412) 5727 : cluster [DBG] pgmap v3258: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:04.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:37:04 gibba015 bash[30343]: cluster 2021-03-10T15:37:03.644349+0000 mgr.gibba045.orlgmj (mgr.34412) 5727 : cluster [DBG] pgmap v3258: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:05.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:37:04 gibba045 bash[25517]: cluster 2021-03-10T15:37:03.644349+0000 mgr.gibba045.orlgmj (mgr.34412) 5727 : cluster [DBG] pgmap v3258: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:06.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:37:06 gibba015 bash[29377]: cluster 2021-03-10T15:37:05.645765+0000 mgr.gibba045.orlgmj (mgr.34412) 5728 : cluster [DBG] pgmap v3259: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:06.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:37:06 gibba015 bash[30343]: cluster 2021-03-10T15:37:05.645765+0000 mgr.gibba045.orlgmj (mgr.34412) 5728 : cluster [DBG] pgmap v3259: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:07.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:37:06 gibba045 bash[25517]: cluster 2021-03-10T15:37:05.645765+0000 mgr.gibba045.orlgmj (mgr.34412) 5728 : cluster [DBG] pgmap v3259: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:09.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:37:08 gibba045 bash[25517]: cluster 2021-03-10T15:37:07.647196+0000 mgr.gibba045.orlgmj (mgr.34412) 5729 : cluster [DBG] pgmap v3260: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:09.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:37:08 gibba015 bash[29377]: cluster 2021-03-10T15:37:07.647196+0000 mgr.gibba045.orlgmj (mgr.34412) 5729 : cluster [DBG] pgmap v3260: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:09.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:37:08 gibba015 bash[30343]: cluster 2021-03-10T15:37:07.647196+0000 mgr.gibba045.orlgmj (mgr.34412) 5729 : cluster [DBG] pgmap v3260: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:10.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:37:10 gibba015 bash[29377]: cluster 2021-03-10T15:37:09.648009+0000 mgr.gibba045.orlgmj (mgr.34412) 5730 : cluster [DBG] pgmap v3261: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:10.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:37:10 gibba015 bash[30343]: cluster 2021-03-10T15:37:09.648009+0000 mgr.gibba045.orlgmj (mgr.34412) 5730 : cluster [DBG] pgmap v3261: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:11.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:37:10 gibba045 bash[25517]: cluster 2021-03-10T15:37:09.648009+0000 mgr.gibba045.orlgmj (mgr.34412) 5730 : cluster [DBG] pgmap v3261: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:11.528 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:37:11.752 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:37:11.752 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (107m) 2m ago 113m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:37:11.752 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (113m) 56s ago 113m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:37:11.753 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (108m) 56s ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:37:11.753 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (108m) 56s ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:37:11.753 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (107m) 2m ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:37:11.753 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (107m) 2m ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:37:11.754 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (106m) 56s ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:37:11.754 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (107m) 2m ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:37:11.754 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (113m) 2m ago 113m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:37:11.754 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (113m) 56s ago 113m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:37:11.755 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (106m) 2m ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:37:11.755 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (105m) 2m ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:37:11.755 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (105m) 2m ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:37:11.755 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (104m) 2m ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:37:11.756 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (104m) 56s ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:37:11.756 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (104m) 56s ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:37:11.756 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (103m) 56s ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:37:11.756 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (103m) 56s ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:37:11.757 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (112m) 56s ago 113m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:37:11.757 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 56s ago 111m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:37:12.003 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:37:12.004 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:37:12.004 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:37:12.004 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:37:12.004 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:37:12.005 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:37:12.005 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:37:12.005 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:37:12.005 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:37:12.005 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:37:12.006 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:37:12.006 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:37:12.006 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:37:12.006 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:37:12.007 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:37:12.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:37:12 gibba015 bash[29377]: audit 2021-03-10T15:37:11.518227+0000 mgr.gibba045.orlgmj (mgr.34412) 5731 : audit [DBG] from='client.57892 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:37:12.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:37:12 gibba015 bash[29377]: cluster 2021-03-10T15:37:11.649761+0000 mgr.gibba045.orlgmj (mgr.34412) 5732 : cluster [DBG] pgmap v3262: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:12.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:37:12 gibba015 bash[29377]: audit 2021-03-10T15:37:11.741180+0000 mgr.gibba045.orlgmj (mgr.34412) 5733 : audit [DBG] from='client.47910 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:37:12.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:37:12 gibba015 bash[29377]: audit 2021-03-10T15:37:11.998345+0000 mon.a (mon.0) 1461 : audit [DBG] from='client.? 172.21.2.115:0/2540796420' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:37:12.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:37:12 gibba015 bash[30343]: audit 2021-03-10T15:37:11.518227+0000 mgr.gibba045.orlgmj (mgr.34412) 5731 : audit [DBG] from='client.57892 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:37:12.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:37:12 gibba015 bash[30343]: cluster 2021-03-10T15:37:11.649761+0000 mgr.gibba045.orlgmj (mgr.34412) 5732 : cluster [DBG] pgmap v3262: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:12.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:37:12 gibba015 bash[30343]: audit 2021-03-10T15:37:11.741180+0000 mgr.gibba045.orlgmj (mgr.34412) 5733 : audit [DBG] from='client.47910 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:37:12.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:37:12 gibba015 bash[30343]: audit 2021-03-10T15:37:11.998345+0000 mon.a (mon.0) 1461 : audit [DBG] from='client.? 172.21.2.115:0/2540796420' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:37:13.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:37:12 gibba045 bash[25517]: audit 2021-03-10T15:37:11.518227+0000 mgr.gibba045.orlgmj (mgr.34412) 5731 : audit [DBG] from='client.57892 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:37:13.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:37:12 gibba045 bash[25517]: cluster 2021-03-10T15:37:11.649761+0000 mgr.gibba045.orlgmj (mgr.34412) 5732 : cluster [DBG] pgmap v3262: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:13.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:37:12 gibba045 bash[25517]: audit 2021-03-10T15:37:11.741180+0000 mgr.gibba045.orlgmj (mgr.34412) 5733 : audit [DBG] from='client.47910 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:37:13.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:37:12 gibba045 bash[25517]: audit 2021-03-10T15:37:11.998345+0000 mon.a (mon.0) 1461 : audit [DBG] from='client.? 172.21.2.115:0/2540796420' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:37:14.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:37:14 gibba015 bash[29377]: cluster 2021-03-10T15:37:13.651107+0000 mgr.gibba045.orlgmj (mgr.34412) 5734 : cluster [DBG] pgmap v3263: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:14.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:37:14 gibba015 bash[30343]: cluster 2021-03-10T15:37:13.651107+0000 mgr.gibba045.orlgmj (mgr.34412) 5734 : cluster [DBG] pgmap v3263: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:15.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:37:14 gibba045 bash[25517]: cluster 2021-03-10T15:37:13.651107+0000 mgr.gibba045.orlgmj (mgr.34412) 5734 : cluster [DBG] pgmap v3263: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:16.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:37:15 gibba045 bash[25517]: audit 2021-03-10T15:37:15.461274+0000 mon.c (mon.1) 1611 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:37:16.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:37:15 gibba045 bash[25517]: audit 2021-03-10T15:37:15.692196+0000 mon.a (mon.0) 1462 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:37:16.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:37:15 gibba045 bash[25517]: audit 2021-03-10T15:37:15.696181+0000 mon.c (mon.1) 1612 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:37:16.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:37:15 gibba045 bash[25517]: audit 2021-03-10T15:37:15.697803+0000 mon.c (mon.1) 1613 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:37:16.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:37:15 gibba045 bash[25517]: audit 2021-03-10T15:37:15.699183+0000 mon.c (mon.1) 1614 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:37:16.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:37:15 gibba045 bash[25517]: audit 2021-03-10T15:37:15.700378+0000 mon.c (mon.1) 1615 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:37:16.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:37:15 gibba045 bash[25517]: audit 2021-03-10T15:37:15.703610+0000 mon.c (mon.1) 1616 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:37:16.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:37:15 gibba045 bash[25517]: audit 2021-03-10T15:37:15.704922+0000 mon.c (mon.1) 1617 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:37:16.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:37:15 gibba015 bash[29377]: audit 2021-03-10T15:37:15.461274+0000 mon.c (mon.1) 1611 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:37:16.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:37:15 gibba015 bash[29377]: audit 2021-03-10T15:37:15.692196+0000 mon.a (mon.0) 1462 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:37:16.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:37:15 gibba015 bash[29377]: audit 2021-03-10T15:37:15.696181+0000 mon.c (mon.1) 1612 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:37:16.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:37:15 gibba015 bash[29377]: audit 2021-03-10T15:37:15.697803+0000 mon.c (mon.1) 1613 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:37:16.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:37:15 gibba015 bash[29377]: audit 2021-03-10T15:37:15.699183+0000 mon.c (mon.1) 1614 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:37:16.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:37:15 gibba015 bash[29377]: audit 2021-03-10T15:37:15.700378+0000 mon.c (mon.1) 1615 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:37:16.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:37:15 gibba015 bash[29377]: audit 2021-03-10T15:37:15.703610+0000 mon.c (mon.1) 1616 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:37:16.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:37:15 gibba015 bash[29377]: audit 2021-03-10T15:37:15.704922+0000 mon.c (mon.1) 1617 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:37:16.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:37:15 gibba015 bash[30343]: audit 2021-03-10T15:37:15.461274+0000 mon.c (mon.1) 1611 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:37:16.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:37:15 gibba015 bash[30343]: audit 2021-03-10T15:37:15.692196+0000 mon.a (mon.0) 1462 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:37:16.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:37:15 gibba015 bash[30343]: audit 2021-03-10T15:37:15.696181+0000 mon.c (mon.1) 1612 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:37:16.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:37:15 gibba015 bash[30343]: audit 2021-03-10T15:37:15.697803+0000 mon.c (mon.1) 1613 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:37:16.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:37:15 gibba015 bash[30343]: audit 2021-03-10T15:37:15.699183+0000 mon.c (mon.1) 1614 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:37:16.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:37:15 gibba015 bash[30343]: audit 2021-03-10T15:37:15.700378+0000 mon.c (mon.1) 1615 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:37:16.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:37:15 gibba015 bash[30343]: audit 2021-03-10T15:37:15.703610+0000 mon.c (mon.1) 1616 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:37:16.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:37:15 gibba015 bash[30343]: audit 2021-03-10T15:37:15.704922+0000 mon.c (mon.1) 1617 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:37:17.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:37:16 gibba045 bash[25517]: cephadm 2021-03-10T15:37:15.470410+0000 mgr.gibba045.orlgmj (mgr.34412) 5735 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:37:17.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:37:16 gibba045 bash[25517]: cephadm 2021-03-10T15:37:15.471984+0000 mgr.gibba045.orlgmj (mgr.34412) 5736 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:37:17.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:37:16 gibba045 bash[25517]: cluster 2021-03-10T15:37:15.651871+0000 mgr.gibba045.orlgmj (mgr.34412) 5737 : cluster [DBG] pgmap v3264: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:17.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:37:16 gibba045 bash[25517]: cephadm 2021-03-10T15:37:15.698777+0000 mgr.gibba045.orlgmj (mgr.34412) 5738 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:37:17.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:37:16 gibba045 bash[25517]: cephadm 2021-03-10T15:37:15.700776+0000 mgr.gibba045.orlgmj (mgr.34412) 5739 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:37:17.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:37:16 gibba045 bash[25517]: cephadm 2021-03-10T15:37:15.702207+0000 mgr.gibba045.orlgmj (mgr.34412) 5740 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:37:17.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:37:16 gibba045 bash[25517]: cephadm 2021-03-10T15:37:15.702287+0000 mgr.gibba045.orlgmj (mgr.34412) 5741 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:37:17.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:37:16 gibba045 bash[25517]: cephadm 2021-03-10T15:37:15.703527+0000 mgr.gibba045.orlgmj (mgr.34412) 5742 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:37:17.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:37:16 gibba045 bash[25517]: cephadm 2021-03-10T15:37:15.703640+0000 mgr.gibba045.orlgmj (mgr.34412) 5743 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:37:17.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:37:16 gibba045 bash[25517]: cephadm 2021-03-10T15:37:15.704879+0000 mgr.gibba045.orlgmj (mgr.34412) 5744 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:37:17.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:37:16 gibba045 bash[25517]: cephadm 2021-03-10T15:37:15.706695+0000 mgr.gibba045.orlgmj (mgr.34412) 5745 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:37:17.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:37:16 gibba045 bash[25517]: cephadm 2021-03-10T15:37:15.706807+0000 mgr.gibba045.orlgmj (mgr.34412) 5746 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:37:17.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:37:16 gibba045 bash[25517]: cephadm 2021-03-10T15:37:15.707869+0000 mgr.gibba045.orlgmj (mgr.34412) 5747 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:37:17.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:37:16 gibba045 bash[25517]: cephadm 2021-03-10T15:37:15.708191+0000 mgr.gibba045.orlgmj (mgr.34412) 5748 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:37:17.062 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:37:16 gibba045 bash[25517]: cephadm 2021-03-10T15:37:15.709193+0000 mgr.gibba045.orlgmj (mgr.34412) 5749 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:37:17.062 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:37:16 gibba045 bash[25517]: cephadm 2021-03-10T15:37:15.709263+0000 mgr.gibba045.orlgmj (mgr.34412) 5750 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:37:17.062 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:37:16 gibba045 bash[25517]: cephadm 2021-03-10T15:37:15.709373+0000 mgr.gibba045.orlgmj (mgr.34412) 5751 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:37:17.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:37:16 gibba015 bash[29377]: cephadm 2021-03-10T15:37:15.470410+0000 mgr.gibba045.orlgmj (mgr.34412) 5735 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:37:17.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:37:16 gibba015 bash[29377]: cephadm 2021-03-10T15:37:15.471984+0000 mgr.gibba045.orlgmj (mgr.34412) 5736 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:37:17.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:37:16 gibba015 bash[29377]: cluster 2021-03-10T15:37:15.651871+0000 mgr.gibba045.orlgmj (mgr.34412) 5737 : cluster [DBG] pgmap v3264: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:17.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:37:16 gibba015 bash[29377]: cephadm 2021-03-10T15:37:15.698777+0000 mgr.gibba045.orlgmj (mgr.34412) 5738 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:37:17.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:37:16 gibba015 bash[29377]: cephadm 2021-03-10T15:37:15.700776+0000 mgr.gibba045.orlgmj (mgr.34412) 5739 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:37:17.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:37:16 gibba015 bash[29377]: cephadm 2021-03-10T15:37:15.702207+0000 mgr.gibba045.orlgmj (mgr.34412) 5740 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:37:17.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:37:16 gibba015 bash[29377]: cephadm 2021-03-10T15:37:15.702287+0000 mgr.gibba045.orlgmj (mgr.34412) 5741 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:37:17.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:37:16 gibba015 bash[29377]: cephadm 2021-03-10T15:37:15.703527+0000 mgr.gibba045.orlgmj (mgr.34412) 5742 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:37:17.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:37:16 gibba015 bash[29377]: cephadm 2021-03-10T15:37:15.703640+0000 mgr.gibba045.orlgmj (mgr.34412) 5743 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:37:17.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:37:16 gibba015 bash[29377]: cephadm 2021-03-10T15:37:15.704879+0000 mgr.gibba045.orlgmj (mgr.34412) 5744 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:37:17.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:37:16 gibba015 bash[29377]: cephadm 2021-03-10T15:37:15.706695+0000 mgr.gibba045.orlgmj (mgr.34412) 5745 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:37:17.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:37:16 gibba015 bash[29377]: cephadm 2021-03-10T15:37:15.706807+0000 mgr.gibba045.orlgmj (mgr.34412) 5746 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:37:17.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:37:16 gibba015 bash[29377]: cephadm 2021-03-10T15:37:15.707869+0000 mgr.gibba045.orlgmj (mgr.34412) 5747 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:37:17.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:37:16 gibba015 bash[29377]: cephadm 2021-03-10T15:37:15.708191+0000 mgr.gibba045.orlgmj (mgr.34412) 5748 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:37:17.230 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:37:16 gibba015 bash[29377]: cephadm 2021-03-10T15:37:15.709193+0000 mgr.gibba045.orlgmj (mgr.34412) 5749 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:37:17.230 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:37:16 gibba015 bash[29377]: cephadm 2021-03-10T15:37:15.709263+0000 mgr.gibba045.orlgmj (mgr.34412) 5750 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:37:17.230 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:37:16 gibba015 bash[29377]: cephadm 2021-03-10T15:37:15.709373+0000 mgr.gibba045.orlgmj (mgr.34412) 5751 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:37:17.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:37:16 gibba015 bash[30343]: cephadm 2021-03-10T15:37:15.470410+0000 mgr.gibba045.orlgmj (mgr.34412) 5735 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:37:17.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:37:16 gibba015 bash[30343]: cephadm 2021-03-10T15:37:15.471984+0000 mgr.gibba045.orlgmj (mgr.34412) 5736 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:37:17.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:37:16 gibba015 bash[30343]: cluster 2021-03-10T15:37:15.651871+0000 mgr.gibba045.orlgmj (mgr.34412) 5737 : cluster [DBG] pgmap v3264: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:17.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:37:16 gibba015 bash[30343]: cephadm 2021-03-10T15:37:15.698777+0000 mgr.gibba045.orlgmj (mgr.34412) 5738 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:37:17.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:37:16 gibba015 bash[30343]: cephadm 2021-03-10T15:37:15.700776+0000 mgr.gibba045.orlgmj (mgr.34412) 5739 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:37:17.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:37:16 gibba015 bash[30343]: cephadm 2021-03-10T15:37:15.702207+0000 mgr.gibba045.orlgmj (mgr.34412) 5740 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:37:17.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:37:16 gibba015 bash[30343]: cephadm 2021-03-10T15:37:15.702287+0000 mgr.gibba045.orlgmj (mgr.34412) 5741 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:37:17.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:37:16 gibba015 bash[30343]: cephadm 2021-03-10T15:37:15.703527+0000 mgr.gibba045.orlgmj (mgr.34412) 5742 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:37:17.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:37:16 gibba015 bash[30343]: cephadm 2021-03-10T15:37:15.703640+0000 mgr.gibba045.orlgmj (mgr.34412) 5743 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:37:17.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:37:16 gibba015 bash[30343]: cephadm 2021-03-10T15:37:15.704879+0000 mgr.gibba045.orlgmj (mgr.34412) 5744 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:37:17.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:37:16 gibba015 bash[30343]: cephadm 2021-03-10T15:37:15.706695+0000 mgr.gibba045.orlgmj (mgr.34412) 5745 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:37:17.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:37:16 gibba015 bash[30343]: cephadm 2021-03-10T15:37:15.706807+0000 mgr.gibba045.orlgmj (mgr.34412) 5746 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:37:17.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:37:16 gibba015 bash[30343]: cephadm 2021-03-10T15:37:15.707869+0000 mgr.gibba045.orlgmj (mgr.34412) 5747 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:37:17.234 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:37:16 gibba015 bash[30343]: cephadm 2021-03-10T15:37:15.708191+0000 mgr.gibba045.orlgmj (mgr.34412) 5748 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:37:17.234 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:37:16 gibba015 bash[30343]: cephadm 2021-03-10T15:37:15.709193+0000 mgr.gibba045.orlgmj (mgr.34412) 5749 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:37:17.234 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:37:16 gibba015 bash[30343]: cephadm 2021-03-10T15:37:15.709263+0000 mgr.gibba045.orlgmj (mgr.34412) 5750 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:37:17.234 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:37:16 gibba015 bash[30343]: cephadm 2021-03-10T15:37:15.709373+0000 mgr.gibba045.orlgmj (mgr.34412) 5751 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:37:19.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:37:18 gibba045 bash[25517]: cluster 2021-03-10T15:37:17.653310+0000 mgr.gibba045.orlgmj (mgr.34412) 5752 : cluster [DBG] pgmap v3265: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:19.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:37:18 gibba015 bash[29377]: cluster 2021-03-10T15:37:17.653310+0000 mgr.gibba045.orlgmj (mgr.34412) 5752 : cluster [DBG] pgmap v3265: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:19.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:37:18 gibba015 bash[30343]: cluster 2021-03-10T15:37:17.653310+0000 mgr.gibba045.orlgmj (mgr.34412) 5752 : cluster [DBG] pgmap v3265: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:20.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:37:20 gibba015 bash[29377]: cluster 2021-03-10T15:37:19.654065+0000 mgr.gibba045.orlgmj (mgr.34412) 5753 : cluster [DBG] pgmap v3266: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:20.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:37:20 gibba015 bash[30343]: cluster 2021-03-10T15:37:19.654065+0000 mgr.gibba045.orlgmj (mgr.34412) 5753 : cluster [DBG] pgmap v3266: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:21.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:37:20 gibba045 bash[25517]: cluster 2021-03-10T15:37:19.654065+0000 mgr.gibba045.orlgmj (mgr.34412) 5753 : cluster [DBG] pgmap v3266: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:22.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:37:22 gibba015 bash[29377]: cluster 2021-03-10T15:37:21.655794+0000 mgr.gibba045.orlgmj (mgr.34412) 5754 : cluster [DBG] pgmap v3267: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:22.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:37:22 gibba015 bash[30343]: cluster 2021-03-10T15:37:21.655794+0000 mgr.gibba045.orlgmj (mgr.34412) 5754 : cluster [DBG] pgmap v3267: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:23.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:37:22 gibba045 bash[25517]: cluster 2021-03-10T15:37:21.655794+0000 mgr.gibba045.orlgmj (mgr.34412) 5754 : cluster [DBG] pgmap v3267: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:25.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:37:24 gibba045 bash[25517]: cluster 2021-03-10T15:37:23.657051+0000 mgr.gibba045.orlgmj (mgr.34412) 5755 : cluster [DBG] pgmap v3268: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:25.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:37:24 gibba015 bash[29377]: cluster 2021-03-10T15:37:23.657051+0000 mgr.gibba045.orlgmj (mgr.34412) 5755 : cluster [DBG] pgmap v3268: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:25.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:37:24 gibba015 bash[30343]: cluster 2021-03-10T15:37:23.657051+0000 mgr.gibba045.orlgmj (mgr.34412) 5755 : cluster [DBG] pgmap v3268: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:27.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:37:26 gibba045 bash[25517]: cluster 2021-03-10T15:37:25.658351+0000 mgr.gibba045.orlgmj (mgr.34412) 5756 : cluster [DBG] pgmap v3269: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:27.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:37:26 gibba015 bash[29377]: cluster 2021-03-10T15:37:25.658351+0000 mgr.gibba045.orlgmj (mgr.34412) 5756 : cluster [DBG] pgmap v3269: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:27.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:37:26 gibba015 bash[30343]: cluster 2021-03-10T15:37:25.658351+0000 mgr.gibba045.orlgmj (mgr.34412) 5756 : cluster [DBG] pgmap v3269: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:29.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:37:28 gibba045 bash[25517]: cluster 2021-03-10T15:37:27.659886+0000 mgr.gibba045.orlgmj (mgr.34412) 5757 : cluster [DBG] pgmap v3270: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:29.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:37:28 gibba015 bash[29377]: cluster 2021-03-10T15:37:27.659886+0000 mgr.gibba045.orlgmj (mgr.34412) 5757 : cluster [DBG] pgmap v3270: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:29.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:37:28 gibba015 bash[30343]: cluster 2021-03-10T15:37:27.659886+0000 mgr.gibba045.orlgmj (mgr.34412) 5757 : cluster [DBG] pgmap v3270: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:30.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:37:30 gibba015 bash[29377]: cluster 2021-03-10T15:37:29.660855+0000 mgr.gibba045.orlgmj (mgr.34412) 5758 : cluster [DBG] pgmap v3271: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:30.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:37:30 gibba015 bash[30343]: cluster 2021-03-10T15:37:29.660855+0000 mgr.gibba045.orlgmj (mgr.34412) 5758 : cluster [DBG] pgmap v3271: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:31.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:37:30 gibba045 bash[25517]: cluster 2021-03-10T15:37:29.660855+0000 mgr.gibba045.orlgmj (mgr.34412) 5758 : cluster [DBG] pgmap v3271: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:31.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:37:31 gibba015 bash[29377]: cephadm 2021-03-10T15:37:30.721264+0000 mgr.gibba045.orlgmj (mgr.34412) 5759 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:37:31.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:37:31 gibba015 bash[30343]: cephadm 2021-03-10T15:37:30.721264+0000 mgr.gibba045.orlgmj (mgr.34412) 5759 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:37:32.068 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:37:31 gibba045 bash[25517]: cephadm 2021-03-10T15:37:30.721264+0000 mgr.gibba045.orlgmj (mgr.34412) 5759 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:37:32.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:37:32 gibba015 bash[29377]: cluster 2021-03-10T15:37:31.661714+0000 mgr.gibba045.orlgmj (mgr.34412) 5760 : cluster [DBG] pgmap v3272: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:32.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:37:32 gibba015 bash[30343]: cluster 2021-03-10T15:37:31.661714+0000 mgr.gibba045.orlgmj (mgr.34412) 5760 : cluster [DBG] pgmap v3272: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:33.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:37:32 gibba045 bash[25517]: cluster 2021-03-10T15:37:31.661714+0000 mgr.gibba045.orlgmj (mgr.34412) 5760 : cluster [DBG] pgmap v3272: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:35.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:37:34 gibba045 bash[25517]: cluster 2021-03-10T15:37:33.663120+0000 mgr.gibba045.orlgmj (mgr.34412) 5761 : cluster [DBG] pgmap v3273: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:35.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:37:34 gibba015 bash[29377]: cluster 2021-03-10T15:37:33.663120+0000 mgr.gibba045.orlgmj (mgr.34412) 5761 : cluster [DBG] pgmap v3273: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:35.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:37:34 gibba015 bash[30343]: cluster 2021-03-10T15:37:33.663120+0000 mgr.gibba045.orlgmj (mgr.34412) 5761 : cluster [DBG] pgmap v3273: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:37.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:37:36 gibba045 bash[25517]: cluster 2021-03-10T15:37:35.664720+0000 mgr.gibba045.orlgmj (mgr.34412) 5762 : cluster [DBG] pgmap v3274: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:37.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:37:36 gibba015 bash[29377]: cluster 2021-03-10T15:37:35.664720+0000 mgr.gibba045.orlgmj (mgr.34412) 5762 : cluster [DBG] pgmap v3274: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:37.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:37:36 gibba015 bash[30343]: cluster 2021-03-10T15:37:35.664720+0000 mgr.gibba045.orlgmj (mgr.34412) 5762 : cluster [DBG] pgmap v3274: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:39.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:37:38 gibba045 bash[25517]: cluster 2021-03-10T15:37:37.666302+0000 mgr.gibba045.orlgmj (mgr.34412) 5763 : cluster [DBG] pgmap v3275: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:39.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:37:38 gibba015 bash[29377]: cluster 2021-03-10T15:37:37.666302+0000 mgr.gibba045.orlgmj (mgr.34412) 5763 : cluster [DBG] pgmap v3275: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:39.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:37:38 gibba015 bash[30343]: cluster 2021-03-10T15:37:37.666302+0000 mgr.gibba045.orlgmj (mgr.34412) 5763 : cluster [DBG] pgmap v3275: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:40.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:37:40 gibba015 bash[29377]: cluster 2021-03-10T15:37:39.667207+0000 mgr.gibba045.orlgmj (mgr.34412) 5764 : cluster [DBG] pgmap v3276: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:40.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:37:40 gibba015 bash[30343]: cluster 2021-03-10T15:37:39.667207+0000 mgr.gibba045.orlgmj (mgr.34412) 5764 : cluster [DBG] pgmap v3276: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:41.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:37:40 gibba045 bash[25517]: cluster 2021-03-10T15:37:39.667207+0000 mgr.gibba045.orlgmj (mgr.34412) 5764 : cluster [DBG] pgmap v3276: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:42.252 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:37:42.494 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:37:42.495 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (108m) 2m ago 113m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:37:42.495 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (113m) 87s ago 113m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:37:42.495 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (108m) 87s ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:37:42.495 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (109m) 87s ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:37:42.496 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (108m) 2m ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:37:42.496 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (107m) 2m ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:37:42.496 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (107m) 87s ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:37:42.496 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (107m) 2m ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:37:42.497 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (113m) 2m ago 113m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:37:42.497 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (113m) 87s ago 113m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:37:42.497 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (106m) 2m ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:37:42.497 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (106m) 2m ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:37:42.498 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (105m) 2m ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:37:42.498 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (105m) 2m ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:37:42.498 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (105m) 87s ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:37:42.498 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (104m) 87s ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:37:42.499 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (104m) 87s ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:37:42.499 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (103m) 87s ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:37:42.499 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (113m) 87s ago 113m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:37:42.499 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 87s ago 111m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:37:42.745 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:37:42.745 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:37:42.745 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:37:42.746 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:37:42.746 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:37:42.746 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:37:42.746 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:37:42.747 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:37:42.747 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:37:42.747 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:37:42.747 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:37:42.748 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:37:42.748 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:37:42.748 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:37:42.748 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:37:43.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:37:42 gibba045 bash[25517]: cluster 2021-03-10T15:37:41.668878+0000 mgr.gibba045.orlgmj (mgr.34412) 5765 : cluster [DBG] pgmap v3277: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:43.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:37:42 gibba015 bash[29377]: cluster 2021-03-10T15:37:41.668878+0000 mgr.gibba045.orlgmj (mgr.34412) 5765 : cluster [DBG] pgmap v3277: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:43.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:37:42 gibba015 bash[30343]: cluster 2021-03-10T15:37:41.668878+0000 mgr.gibba045.orlgmj (mgr.34412) 5765 : cluster [DBG] pgmap v3277: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:44.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:37:43 gibba045 bash[25517]: audit 2021-03-10T15:37:42.241362+0000 mgr.gibba045.orlgmj (mgr.34412) 5766 : audit [DBG] from='client.57910 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:37:44.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:37:43 gibba045 bash[25517]: audit 2021-03-10T15:37:42.466533+0000 mgr.gibba045.orlgmj (mgr.34412) 5767 : audit [DBG] from='client.57916 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:37:44.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:37:43 gibba045 bash[25517]: audit 2021-03-10T15:37:42.739929+0000 mon.a (mon.0) 1463 : audit [DBG] from='client.? 172.21.2.115:0/2338726187' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:37:44.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:37:43 gibba015 bash[29377]: audit 2021-03-10T15:37:42.241362+0000 mgr.gibba045.orlgmj (mgr.34412) 5766 : audit [DBG] from='client.57910 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:37:44.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:37:43 gibba015 bash[29377]: audit 2021-03-10T15:37:42.466533+0000 mgr.gibba045.orlgmj (mgr.34412) 5767 : audit [DBG] from='client.57916 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:37:44.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:37:43 gibba015 bash[29377]: audit 2021-03-10T15:37:42.739929+0000 mon.a (mon.0) 1463 : audit [DBG] from='client.? 172.21.2.115:0/2338726187' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:37:44.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:37:43 gibba015 bash[30343]: audit 2021-03-10T15:37:42.241362+0000 mgr.gibba045.orlgmj (mgr.34412) 5766 : audit [DBG] from='client.57910 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:37:44.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:37:43 gibba015 bash[30343]: audit 2021-03-10T15:37:42.466533+0000 mgr.gibba045.orlgmj (mgr.34412) 5767 : audit [DBG] from='client.57916 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:37:44.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:37:43 gibba015 bash[30343]: audit 2021-03-10T15:37:42.739929+0000 mon.a (mon.0) 1463 : audit [DBG] from='client.? 172.21.2.115:0/2338726187' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:37:45.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:37:44 gibba045 bash[25517]: cluster 2021-03-10T15:37:43.670340+0000 mgr.gibba045.orlgmj (mgr.34412) 5768 : cluster [DBG] pgmap v3278: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:45.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:37:44 gibba015 bash[29377]: cluster 2021-03-10T15:37:43.670340+0000 mgr.gibba045.orlgmj (mgr.34412) 5768 : cluster [DBG] pgmap v3278: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:45.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:37:44 gibba015 bash[30343]: cluster 2021-03-10T15:37:43.670340+0000 mgr.gibba045.orlgmj (mgr.34412) 5768 : cluster [DBG] pgmap v3278: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:47.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:37:46 gibba045 bash[25517]: cluster 2021-03-10T15:37:45.671930+0000 mgr.gibba045.orlgmj (mgr.34412) 5769 : cluster [DBG] pgmap v3279: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:47.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:37:46 gibba045 bash[25517]: cephadm 2021-03-10T15:37:45.733389+0000 mgr.gibba045.orlgmj (mgr.34412) 5770 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:37:47.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:37:46 gibba015 bash[29377]: cluster 2021-03-10T15:37:45.671930+0000 mgr.gibba045.orlgmj (mgr.34412) 5769 : cluster [DBG] pgmap v3279: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:47.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:37:46 gibba015 bash[29377]: cephadm 2021-03-10T15:37:45.733389+0000 mgr.gibba045.orlgmj (mgr.34412) 5770 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:37:47.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:37:46 gibba015 bash[30343]: cluster 2021-03-10T15:37:45.671930+0000 mgr.gibba045.orlgmj (mgr.34412) 5769 : cluster [DBG] pgmap v3279: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:47.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:37:46 gibba015 bash[30343]: cephadm 2021-03-10T15:37:45.733389+0000 mgr.gibba045.orlgmj (mgr.34412) 5770 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:37:49.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:37:48 gibba045 bash[25517]: cluster 2021-03-10T15:37:47.673465+0000 mgr.gibba045.orlgmj (mgr.34412) 5771 : cluster [DBG] pgmap v3280: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:49.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:37:48 gibba015 bash[29377]: cluster 2021-03-10T15:37:47.673465+0000 mgr.gibba045.orlgmj (mgr.34412) 5771 : cluster [DBG] pgmap v3280: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:49.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:37:48 gibba015 bash[30343]: cluster 2021-03-10T15:37:47.673465+0000 mgr.gibba045.orlgmj (mgr.34412) 5771 : cluster [DBG] pgmap v3280: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:50.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:37:50 gibba015 bash[29377]: cluster 2021-03-10T15:37:49.674943+0000 mgr.gibba045.orlgmj (mgr.34412) 5772 : cluster [DBG] pgmap v3281: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:50.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:37:50 gibba015 bash[30343]: cluster 2021-03-10T15:37:49.674943+0000 mgr.gibba045.orlgmj (mgr.34412) 5772 : cluster [DBG] pgmap v3281: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:51.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:37:50 gibba045 bash[25517]: cluster 2021-03-10T15:37:49.674943+0000 mgr.gibba045.orlgmj (mgr.34412) 5772 : cluster [DBG] pgmap v3281: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:53.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:37:52 gibba045 bash[25517]: cluster 2021-03-10T15:37:51.676869+0000 mgr.gibba045.orlgmj (mgr.34412) 5773 : cluster [DBG] pgmap v3282: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:53.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:37:52 gibba015 bash[29377]: cluster 2021-03-10T15:37:51.676869+0000 mgr.gibba045.orlgmj (mgr.34412) 5773 : cluster [DBG] pgmap v3282: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:53.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:37:52 gibba015 bash[30343]: cluster 2021-03-10T15:37:51.676869+0000 mgr.gibba045.orlgmj (mgr.34412) 5773 : cluster [DBG] pgmap v3282: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:37:53 gibba045 bash[25517]: audit 2021-03-10T15:37:53.205958+0000 mon.c (mon.1) 1618 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:37:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:37:53 gibba045 bash[25517]: audit 2021-03-10T15:37:53.206736+0000 mon.c (mon.1) 1619 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:37:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:37:53 gibba045 bash[25517]: audit 2021-03-10T15:37:53.207074+0000 mon.a (mon.0) 1464 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:37:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:37:53 gibba045 bash[25517]: audit 2021-03-10T15:37:53.207545+0000 mon.c (mon.1) 1620 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:37:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:37:53 gibba045 bash[25517]: audit 2021-03-10T15:37:53.208205+0000 mon.a (mon.0) 1465 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:37:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:37:53 gibba045 bash[25517]: audit 2021-03-10T15:37:53.208612+0000 mon.c (mon.1) 1621 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T15:37:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:37:53 gibba045 bash[25517]: audit 2021-03-10T15:37:53.208943+0000 mon.a (mon.0) 1466 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:37:54.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:37:53 gibba045 bash[25517]: audit 2021-03-10T15:37:53.209809+0000 mon.c (mon.1) 1622 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:37:54.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:37:53 gibba045 bash[25517]: audit 2021-03-10T15:37:53.210411+0000 mon.a (mon.0) 1467 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T15:37:54.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:37:53 gibba045 bash[25517]: audit 2021-03-10T15:37:53.210885+0000 mon.c (mon.1) 1623 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:37:54.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:37:53 gibba045 bash[25517]: audit 2021-03-10T15:37:53.211281+0000 mon.a (mon.0) 1468 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:37:54.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:37:53 gibba045 bash[25517]: audit 2021-03-10T15:37:53.211524+0000 mon.a (mon.0) 1469 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:37:54.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:37:53 gibba015 bash[30343]: audit 2021-03-10T15:37:53.205958+0000 mon.c (mon.1) 1618 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:37:54.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:37:53 gibba015 bash[30343]: audit 2021-03-10T15:37:53.206736+0000 mon.c (mon.1) 1619 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:37:54.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:37:53 gibba015 bash[30343]: audit 2021-03-10T15:37:53.207074+0000 mon.a (mon.0) 1464 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:37:54.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:37:53 gibba015 bash[30343]: audit 2021-03-10T15:37:53.207545+0000 mon.c (mon.1) 1620 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:37:54.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:37:53 gibba015 bash[30343]: audit 2021-03-10T15:37:53.208205+0000 mon.a (mon.0) 1465 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:37:54.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:37:53 gibba015 bash[30343]: audit 2021-03-10T15:37:53.208612+0000 mon.c (mon.1) 1621 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T15:37:54.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:37:53 gibba015 bash[30343]: audit 2021-03-10T15:37:53.208943+0000 mon.a (mon.0) 1466 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:37:54.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:37:53 gibba015 bash[30343]: audit 2021-03-10T15:37:53.209809+0000 mon.c (mon.1) 1622 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:37:54.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:37:53 gibba015 bash[30343]: audit 2021-03-10T15:37:53.210411+0000 mon.a (mon.0) 1467 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T15:37:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:37:53 gibba015 bash[30343]: audit 2021-03-10T15:37:53.210885+0000 mon.c (mon.1) 1623 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:37:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:37:53 gibba015 bash[30343]: audit 2021-03-10T15:37:53.211281+0000 mon.a (mon.0) 1468 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:37:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:37:53 gibba015 bash[30343]: audit 2021-03-10T15:37:53.211524+0000 mon.a (mon.0) 1469 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:37:54.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:37:53 gibba015 bash[29377]: audit 2021-03-10T15:37:53.205958+0000 mon.c (mon.1) 1618 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:37:54.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:37:53 gibba015 bash[29377]: audit 2021-03-10T15:37:53.206736+0000 mon.c (mon.1) 1619 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:37:54.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:37:53 gibba015 bash[29377]: audit 2021-03-10T15:37:53.207074+0000 mon.a (mon.0) 1464 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:37:54.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:37:53 gibba015 bash[29377]: audit 2021-03-10T15:37:53.207545+0000 mon.c (mon.1) 1620 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:37:54.230 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:37:53 gibba015 bash[29377]: audit 2021-03-10T15:37:53.208205+0000 mon.a (mon.0) 1465 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:37:54.230 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:37:53 gibba015 bash[29377]: audit 2021-03-10T15:37:53.208612+0000 mon.c (mon.1) 1621 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T15:37:54.230 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:37:53 gibba015 bash[29377]: audit 2021-03-10T15:37:53.208943+0000 mon.a (mon.0) 1466 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:37:54.230 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:37:53 gibba015 bash[29377]: audit 2021-03-10T15:37:53.209809+0000 mon.c (mon.1) 1622 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:37:54.230 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:37:53 gibba015 bash[29377]: audit 2021-03-10T15:37:53.210411+0000 mon.a (mon.0) 1467 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T15:37:54.231 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:37:53 gibba015 bash[29377]: audit 2021-03-10T15:37:53.210885+0000 mon.c (mon.1) 1623 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:37:54.231 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:37:53 gibba015 bash[29377]: audit 2021-03-10T15:37:53.211281+0000 mon.a (mon.0) 1468 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:37:54.231 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:37:53 gibba015 bash[29377]: audit 2021-03-10T15:37:53.211524+0000 mon.a (mon.0) 1469 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:37:55.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:37:54 gibba045 bash[25517]: cluster 2021-03-10T15:37:53.678259+0000 mgr.gibba045.orlgmj (mgr.34412) 5774 : cluster [DBG] pgmap v3283: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:55.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:37:54 gibba015 bash[29377]: cluster 2021-03-10T15:37:53.678259+0000 mgr.gibba045.orlgmj (mgr.34412) 5774 : cluster [DBG] pgmap v3283: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:55.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:37:54 gibba015 bash[30343]: cluster 2021-03-10T15:37:53.678259+0000 mgr.gibba045.orlgmj (mgr.34412) 5774 : cluster [DBG] pgmap v3283: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:57.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:37:56 gibba045 bash[25517]: cluster 2021-03-10T15:37:55.680095+0000 mgr.gibba045.orlgmj (mgr.34412) 5775 : cluster [DBG] pgmap v3284: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:57.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:37:56 gibba015 bash[29377]: cluster 2021-03-10T15:37:55.680095+0000 mgr.gibba045.orlgmj (mgr.34412) 5775 : cluster [DBG] pgmap v3284: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:57.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:37:56 gibba015 bash[30343]: cluster 2021-03-10T15:37:55.680095+0000 mgr.gibba045.orlgmj (mgr.34412) 5775 : cluster [DBG] pgmap v3284: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:59.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:37:58 gibba045 bash[25517]: cluster 2021-03-10T15:37:57.681527+0000 mgr.gibba045.orlgmj (mgr.34412) 5776 : cluster [DBG] pgmap v3285: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:59.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:37:58 gibba015 bash[29377]: cluster 2021-03-10T15:37:57.681527+0000 mgr.gibba045.orlgmj (mgr.34412) 5776 : cluster [DBG] pgmap v3285: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:59.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:37:58 gibba015 bash[30343]: cluster 2021-03-10T15:37:57.681527+0000 mgr.gibba045.orlgmj (mgr.34412) 5776 : cluster [DBG] pgmap v3285: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:00.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:38:00 gibba015 bash[29377]: cluster 2021-03-10T15:37:59.682674+0000 mgr.gibba045.orlgmj (mgr.34412) 5777 : cluster [DBG] pgmap v3286: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:00.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:38:00 gibba015 bash[30343]: cluster 2021-03-10T15:37:59.682674+0000 mgr.gibba045.orlgmj (mgr.34412) 5777 : cluster [DBG] pgmap v3286: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:01.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:38:00 gibba045 bash[25517]: cluster 2021-03-10T15:37:59.682674+0000 mgr.gibba045.orlgmj (mgr.34412) 5777 : cluster [DBG] pgmap v3286: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:01.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:38:01 gibba015 bash[29377]: cephadm 2021-03-10T15:38:00.749354+0000 mgr.gibba045.orlgmj (mgr.34412) 5778 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:38:01.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:38:01 gibba015 bash[30343]: cephadm 2021-03-10T15:38:00.749354+0000 mgr.gibba045.orlgmj (mgr.34412) 5778 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:38:02.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:38:01 gibba045 bash[25517]: cephadm 2021-03-10T15:38:00.749354+0000 mgr.gibba045.orlgmj (mgr.34412) 5778 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:38:02.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:38:02 gibba015 bash[29377]: cluster 2021-03-10T15:38:01.683421+0000 mgr.gibba045.orlgmj (mgr.34412) 5779 : cluster [DBG] pgmap v3287: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:02.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:38:02 gibba015 bash[30343]: cluster 2021-03-10T15:38:01.683421+0000 mgr.gibba045.orlgmj (mgr.34412) 5779 : cluster [DBG] pgmap v3287: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:03.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:38:02 gibba045 bash[25517]: cluster 2021-03-10T15:38:01.683421+0000 mgr.gibba045.orlgmj (mgr.34412) 5779 : cluster [DBG] pgmap v3287: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:05.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:38:04 gibba045 bash[25517]: cluster 2021-03-10T15:38:03.684765+0000 mgr.gibba045.orlgmj (mgr.34412) 5780 : cluster [DBG] pgmap v3288: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:05.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:38:04 gibba015 bash[29377]: cluster 2021-03-10T15:38:03.684765+0000 mgr.gibba045.orlgmj (mgr.34412) 5780 : cluster [DBG] pgmap v3288: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:05.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:38:04 gibba015 bash[30343]: cluster 2021-03-10T15:38:03.684765+0000 mgr.gibba045.orlgmj (mgr.34412) 5780 : cluster [DBG] pgmap v3288: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:07.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:38:06 gibba045 bash[25517]: cluster 2021-03-10T15:38:05.686449+0000 mgr.gibba045.orlgmj (mgr.34412) 5781 : cluster [DBG] pgmap v3289: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:07.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:38:06 gibba015 bash[29377]: cluster 2021-03-10T15:38:05.686449+0000 mgr.gibba045.orlgmj (mgr.34412) 5781 : cluster [DBG] pgmap v3289: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:07.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:38:06 gibba015 bash[30343]: cluster 2021-03-10T15:38:05.686449+0000 mgr.gibba045.orlgmj (mgr.34412) 5781 : cluster [DBG] pgmap v3289: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:09.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:38:08 gibba045 bash[25517]: cluster 2021-03-10T15:38:07.687938+0000 mgr.gibba045.orlgmj (mgr.34412) 5782 : cluster [DBG] pgmap v3290: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:09.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:38:08 gibba015 bash[29377]: cluster 2021-03-10T15:38:07.687938+0000 mgr.gibba045.orlgmj (mgr.34412) 5782 : cluster [DBG] pgmap v3290: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:09.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:38:08 gibba015 bash[30343]: cluster 2021-03-10T15:38:07.687938+0000 mgr.gibba045.orlgmj (mgr.34412) 5782 : cluster [DBG] pgmap v3290: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:10.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:38:10 gibba015 bash[29377]: cluster 2021-03-10T15:38:09.689109+0000 mgr.gibba045.orlgmj (mgr.34412) 5783 : cluster [DBG] pgmap v3291: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:10.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:38:10 gibba015 bash[30343]: cluster 2021-03-10T15:38:09.689109+0000 mgr.gibba045.orlgmj (mgr.34412) 5783 : cluster [DBG] pgmap v3291: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:11.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:38:10 gibba045 bash[25517]: cluster 2021-03-10T15:38:09.689109+0000 mgr.gibba045.orlgmj (mgr.34412) 5783 : cluster [DBG] pgmap v3291: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:12.987 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:38:13.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:38:12 gibba045 bash[25517]: cluster 2021-03-10T15:38:11.690518+0000 mgr.gibba045.orlgmj (mgr.34412) 5784 : cluster [DBG] pgmap v3292: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:13.213 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:38:13.214 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (108m) 3m ago 114m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:38:13.214 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (114m) 118s ago 114m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:38:13.214 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (109m) 118s ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:38:13.214 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (109m) 118s ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:38:13.215 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (108m) 3m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:38:13.215 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (108m) 3m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:38:13.215 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (108m) 118s ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:38:13.215 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (108m) 3m ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:38:13.215 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (114m) 3m ago 114m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:38:13.216 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (114m) 118s ago 114m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:38:13.216 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (107m) 3m ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:38:13.216 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (106m) 3m ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:38:13.216 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (106m) 3m ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:38:13.217 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (105m) 3m ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:38:13.217 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (105m) 118s ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:38:13.217 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (105m) 118s ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:38:13.217 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (104m) 118s ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:38:13.217 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (104m) 118s ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:38:13.218 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (113m) 118s ago 114m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:38:13.218 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 118s ago 112m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:38:13.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:38:12 gibba015 bash[29377]: cluster 2021-03-10T15:38:11.690518+0000 mgr.gibba045.orlgmj (mgr.34412) 5784 : cluster [DBG] pgmap v3292: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:13.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:38:12 gibba015 bash[30343]: cluster 2021-03-10T15:38:11.690518+0000 mgr.gibba045.orlgmj (mgr.34412) 5784 : cluster [DBG] pgmap v3292: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:13.463 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:38:13.463 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:38:13.463 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:38:13.464 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:38:13.464 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:38:13.464 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:38:13.464 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:38:13.465 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:38:13.465 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:38:13.465 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:38:13.465 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:38:13.465 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:38:13.466 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:38:13.466 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:38:13.466 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:38:14.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:38:13 gibba045 bash[25517]: audit 2021-03-10T15:38:12.976321+0000 mgr.gibba045.orlgmj (mgr.34412) 5785 : audit [DBG] from='client.57928 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:38:14.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:38:13 gibba045 bash[25517]: audit 2021-03-10T15:38:13.200902+0000 mgr.gibba045.orlgmj (mgr.34412) 5786 : audit [DBG] from='client.57934 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:38:14.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:38:13 gibba045 bash[25517]: audit 2021-03-10T15:38:13.458130+0000 mon.c (mon.1) 1624 : audit [DBG] from='client.? 172.21.2.115:0/1229815128' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:38:14.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:38:13 gibba015 bash[29377]: audit 2021-03-10T15:38:12.976321+0000 mgr.gibba045.orlgmj (mgr.34412) 5785 : audit [DBG] from='client.57928 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:38:14.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:38:13 gibba015 bash[29377]: audit 2021-03-10T15:38:13.200902+0000 mgr.gibba045.orlgmj (mgr.34412) 5786 : audit [DBG] from='client.57934 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:38:14.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:38:13 gibba015 bash[29377]: audit 2021-03-10T15:38:13.458130+0000 mon.c (mon.1) 1624 : audit [DBG] from='client.? 172.21.2.115:0/1229815128' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:38:14.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:38:13 gibba015 bash[30343]: audit 2021-03-10T15:38:12.976321+0000 mgr.gibba045.orlgmj (mgr.34412) 5785 : audit [DBG] from='client.57928 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:38:14.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:38:13 gibba015 bash[30343]: audit 2021-03-10T15:38:13.200902+0000 mgr.gibba045.orlgmj (mgr.34412) 5786 : audit [DBG] from='client.57934 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:38:14.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:38:13 gibba015 bash[30343]: audit 2021-03-10T15:38:13.458130+0000 mon.c (mon.1) 1624 : audit [DBG] from='client.? 172.21.2.115:0/1229815128' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:38:15.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:38:14 gibba045 bash[25517]: cluster 2021-03-10T15:38:13.691975+0000 mgr.gibba045.orlgmj (mgr.34412) 5787 : cluster [DBG] pgmap v3293: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:15.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:38:14 gibba015 bash[29377]: cluster 2021-03-10T15:38:13.691975+0000 mgr.gibba045.orlgmj (mgr.34412) 5787 : cluster [DBG] pgmap v3293: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:15.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:38:14 gibba015 bash[30343]: cluster 2021-03-10T15:38:13.691975+0000 mgr.gibba045.orlgmj (mgr.34412) 5787 : cluster [DBG] pgmap v3293: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:16.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:38:15 gibba045 bash[25517]: audit 2021-03-10T15:38:15.762475+0000 mon.c (mon.1) 1625 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:38:16.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:38:15 gibba015 bash[29377]: audit 2021-03-10T15:38:15.762475+0000 mon.c (mon.1) 1625 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:38:16.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:38:15 gibba015 bash[30343]: audit 2021-03-10T15:38:15.762475+0000 mon.c (mon.1) 1625 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:38:17.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:38:16 gibba045 bash[25517]: cluster 2021-03-10T15:38:15.693524+0000 mgr.gibba045.orlgmj (mgr.34412) 5788 : cluster [DBG] pgmap v3294: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:17.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:38:16 gibba045 bash[25517]: cephadm 2021-03-10T15:38:15.771180+0000 mgr.gibba045.orlgmj (mgr.34412) 5789 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:38:17.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:38:16 gibba045 bash[25517]: cephadm 2021-03-10T15:38:15.773360+0000 mgr.gibba045.orlgmj (mgr.34412) 5790 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:38:17.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:38:16 gibba045 bash[25517]: audit 2021-03-10T15:38:15.979443+0000 mon.a (mon.0) 1470 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:38:17.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:38:16 gibba045 bash[25517]: audit 2021-03-10T15:38:15.983143+0000 mon.c (mon.1) 1626 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:38:17.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:38:16 gibba045 bash[25517]: audit 2021-03-10T15:38:15.984590+0000 mon.c (mon.1) 1627 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:38:17.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:38:16 gibba045 bash[25517]: audit 2021-03-10T15:38:15.985882+0000 mon.c (mon.1) 1628 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:38:17.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:38:16 gibba045 bash[25517]: cephadm 2021-03-10T15:38:15.986088+0000 mgr.gibba045.orlgmj (mgr.34412) 5791 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:38:17.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:38:16 gibba045 bash[25517]: audit 2021-03-10T15:38:15.987439+0000 mon.c (mon.1) 1629 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:38:17.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:38:16 gibba045 bash[25517]: cephadm 2021-03-10T15:38:15.987713+0000 mgr.gibba045.orlgmj (mgr.34412) 5792 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:38:17.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:38:16 gibba045 bash[25517]: cephadm 2021-03-10T15:38:15.989004+0000 mgr.gibba045.orlgmj (mgr.34412) 5793 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:38:17.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:38:16 gibba045 bash[25517]: cephadm 2021-03-10T15:38:15.989043+0000 mgr.gibba045.orlgmj (mgr.34412) 5794 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:38:17.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:38:16 gibba045 bash[25517]: audit 2021-03-10T15:38:15.990179+0000 mon.c (mon.1) 1630 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:38:17.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:38:16 gibba045 bash[25517]: cephadm 2021-03-10T15:38:15.990643+0000 mgr.gibba045.orlgmj (mgr.34412) 5795 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:38:17.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:38:16 gibba045 bash[25517]: cephadm 2021-03-10T15:38:15.990679+0000 mgr.gibba045.orlgmj (mgr.34412) 5796 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:38:17.312 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:38:16 gibba045 bash[25517]: cephadm 2021-03-10T15:38:15.991822+0000 mgr.gibba045.orlgmj (mgr.34412) 5797 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:38:17.312 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:38:16 gibba045 bash[25517]: audit 2021-03-10T15:38:15.991858+0000 mon.c (mon.1) 1631 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:38:17.312 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:38:16 gibba045 bash[25517]: cephadm 2021-03-10T15:38:15.993221+0000 mgr.gibba045.orlgmj (mgr.34412) 5798 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:38:17.312 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:38:16 gibba045 bash[25517]: cephadm 2021-03-10T15:38:15.993257+0000 mgr.gibba045.orlgmj (mgr.34412) 5799 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:38:17.313 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:38:16 gibba045 bash[25517]: cephadm 2021-03-10T15:38:15.994774+0000 mgr.gibba045.orlgmj (mgr.34412) 5800 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:38:17.313 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:38:16 gibba045 bash[25517]: cephadm 2021-03-10T15:38:15.995088+0000 mgr.gibba045.orlgmj (mgr.34412) 5801 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:38:17.313 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:38:16 gibba045 bash[25517]: cephadm 2021-03-10T15:38:15.996188+0000 mgr.gibba045.orlgmj (mgr.34412) 5802 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:38:17.313 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:38:16 gibba045 bash[25517]: cephadm 2021-03-10T15:38:15.996225+0000 mgr.gibba045.orlgmj (mgr.34412) 5803 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:38:17.313 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:38:16 gibba045 bash[25517]: cephadm 2021-03-10T15:38:15.996327+0000 mgr.gibba045.orlgmj (mgr.34412) 5804 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:38:17.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:38:16 gibba015 bash[29377]: cluster 2021-03-10T15:38:15.693524+0000 mgr.gibba045.orlgmj (mgr.34412) 5788 : cluster [DBG] pgmap v3294: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:17.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:38:16 gibba015 bash[29377]: cephadm 2021-03-10T15:38:15.771180+0000 mgr.gibba045.orlgmj (mgr.34412) 5789 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:38:17.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:38:16 gibba015 bash[29377]: cephadm 2021-03-10T15:38:15.773360+0000 mgr.gibba045.orlgmj (mgr.34412) 5790 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:38:17.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:38:16 gibba015 bash[29377]: audit 2021-03-10T15:38:15.979443+0000 mon.a (mon.0) 1470 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:38:17.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:38:16 gibba015 bash[29377]: audit 2021-03-10T15:38:15.983143+0000 mon.c (mon.1) 1626 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:38:17.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:38:16 gibba015 bash[29377]: audit 2021-03-10T15:38:15.984590+0000 mon.c (mon.1) 1627 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:38:17.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:38:16 gibba015 bash[29377]: audit 2021-03-10T15:38:15.985882+0000 mon.c (mon.1) 1628 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:38:17.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:38:16 gibba015 bash[29377]: cephadm 2021-03-10T15:38:15.986088+0000 mgr.gibba045.orlgmj (mgr.34412) 5791 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:38:17.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:38:16 gibba015 bash[29377]: audit 2021-03-10T15:38:15.987439+0000 mon.c (mon.1) 1629 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:38:17.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:38:16 gibba015 bash[29377]: cephadm 2021-03-10T15:38:15.987713+0000 mgr.gibba045.orlgmj (mgr.34412) 5792 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:38:17.479 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:38:16 gibba015 bash[29377]: cephadm 2021-03-10T15:38:15.989004+0000 mgr.gibba045.orlgmj (mgr.34412) 5793 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:38:17.479 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:38:16 gibba015 bash[29377]: cephadm 2021-03-10T15:38:15.989043+0000 mgr.gibba045.orlgmj (mgr.34412) 5794 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:38:17.479 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:38:16 gibba015 bash[29377]: audit 2021-03-10T15:38:15.990179+0000 mon.c (mon.1) 1630 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:38:17.479 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:38:16 gibba015 bash[29377]: cephadm 2021-03-10T15:38:15.990643+0000 mgr.gibba045.orlgmj (mgr.34412) 5795 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:38:17.480 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:38:16 gibba015 bash[29377]: cephadm 2021-03-10T15:38:15.990679+0000 mgr.gibba045.orlgmj (mgr.34412) 5796 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:38:17.480 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:38:16 gibba015 bash[29377]: cephadm 2021-03-10T15:38:15.991822+0000 mgr.gibba045.orlgmj (mgr.34412) 5797 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:38:17.480 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:38:16 gibba015 bash[29377]: audit 2021-03-10T15:38:15.991858+0000 mon.c (mon.1) 1631 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:38:17.480 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:38:16 gibba015 bash[29377]: cephadm 2021-03-10T15:38:15.993221+0000 mgr.gibba045.orlgmj (mgr.34412) 5798 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:38:17.480 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:38:16 gibba015 bash[29377]: cephadm 2021-03-10T15:38:15.993257+0000 mgr.gibba045.orlgmj (mgr.34412) 5799 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:38:17.481 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:38:16 gibba015 bash[29377]: cephadm 2021-03-10T15:38:15.994774+0000 mgr.gibba045.orlgmj (mgr.34412) 5800 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:38:17.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:38:16 gibba015 bash[30343]: cluster 2021-03-10T15:38:15.693524+0000 mgr.gibba045.orlgmj (mgr.34412) 5788 : cluster [DBG] pgmap v3294: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:17.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:38:16 gibba015 bash[30343]: cephadm 2021-03-10T15:38:15.771180+0000 mgr.gibba045.orlgmj (mgr.34412) 5789 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:38:17.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:38:16 gibba015 bash[30343]: cephadm 2021-03-10T15:38:15.773360+0000 mgr.gibba045.orlgmj (mgr.34412) 5790 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:38:17.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:38:16 gibba015 bash[30343]: audit 2021-03-10T15:38:15.979443+0000 mon.a (mon.0) 1470 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:38:17.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:38:16 gibba015 bash[30343]: audit 2021-03-10T15:38:15.983143+0000 mon.c (mon.1) 1626 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:38:17.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:38:16 gibba015 bash[30343]: audit 2021-03-10T15:38:15.984590+0000 mon.c (mon.1) 1627 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:38:17.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:38:16 gibba015 bash[30343]: audit 2021-03-10T15:38:15.985882+0000 mon.c (mon.1) 1628 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:38:17.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:38:16 gibba015 bash[30343]: cephadm 2021-03-10T15:38:15.986088+0000 mgr.gibba045.orlgmj (mgr.34412) 5791 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:38:17.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:38:16 gibba015 bash[30343]: audit 2021-03-10T15:38:15.987439+0000 mon.c (mon.1) 1629 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:38:17.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:38:16 gibba015 bash[30343]: cephadm 2021-03-10T15:38:15.987713+0000 mgr.gibba045.orlgmj (mgr.34412) 5792 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:38:17.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:38:16 gibba015 bash[30343]: cephadm 2021-03-10T15:38:15.989004+0000 mgr.gibba045.orlgmj (mgr.34412) 5793 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:38:17.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:38:16 gibba015 bash[30343]: cephadm 2021-03-10T15:38:15.989043+0000 mgr.gibba045.orlgmj (mgr.34412) 5794 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:38:17.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:38:16 gibba015 bash[30343]: audit 2021-03-10T15:38:15.990179+0000 mon.c (mon.1) 1630 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:38:17.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:38:16 gibba015 bash[30343]: cephadm 2021-03-10T15:38:15.990643+0000 mgr.gibba045.orlgmj (mgr.34412) 5795 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:38:17.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:38:16 gibba015 bash[30343]: cephadm 2021-03-10T15:38:15.990679+0000 mgr.gibba045.orlgmj (mgr.34412) 5796 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:38:17.485 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:38:16 gibba015 bash[30343]: cephadm 2021-03-10T15:38:15.991822+0000 mgr.gibba045.orlgmj (mgr.34412) 5797 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:38:17.485 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:38:16 gibba015 bash[30343]: audit 2021-03-10T15:38:15.991858+0000 mon.c (mon.1) 1631 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:38:17.485 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:38:16 gibba015 bash[30343]: cephadm 2021-03-10T15:38:15.993221+0000 mgr.gibba045.orlgmj (mgr.34412) 5798 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:38:17.485 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:38:16 gibba015 bash[30343]: cephadm 2021-03-10T15:38:15.993257+0000 mgr.gibba045.orlgmj (mgr.34412) 5799 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:38:17.486 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:38:16 gibba015 bash[30343]: cephadm 2021-03-10T15:38:15.994774+0000 mgr.gibba045.orlgmj (mgr.34412) 5800 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:38:17.486 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:38:16 gibba015 bash[29377]: cephadm 2021-03-10T15:38:15.995088+0000 mgr.gibba045.orlgmj (mgr.34412) 5801 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:38:17.486 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:38:16 gibba015 bash[29377]: cephadm 2021-03-10T15:38:15.996188+0000 mgr.gibba045.orlgmj (mgr.34412) 5802 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:38:17.486 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:38:16 gibba015 bash[29377]: cephadm 2021-03-10T15:38:15.996225+0000 mgr.gibba045.orlgmj (mgr.34412) 5803 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:38:17.487 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:38:16 gibba015 bash[29377]: cephadm 2021-03-10T15:38:15.996327+0000 mgr.gibba045.orlgmj (mgr.34412) 5804 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:38:17.487 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:38:16 gibba015 bash[30343]: cephadm 2021-03-10T15:38:15.995088+0000 mgr.gibba045.orlgmj (mgr.34412) 5801 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:38:17.487 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:38:16 gibba015 bash[30343]: cephadm 2021-03-10T15:38:15.996188+0000 mgr.gibba045.orlgmj (mgr.34412) 5802 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:38:17.488 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:38:16 gibba015 bash[30343]: cephadm 2021-03-10T15:38:15.996225+0000 mgr.gibba045.orlgmj (mgr.34412) 5803 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:38:17.488 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:38:16 gibba015 bash[30343]: cephadm 2021-03-10T15:38:15.996327+0000 mgr.gibba045.orlgmj (mgr.34412) 5804 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:38:19.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:38:18 gibba045 bash[25517]: cluster 2021-03-10T15:38:17.695032+0000 mgr.gibba045.orlgmj (mgr.34412) 5805 : cluster [DBG] pgmap v3295: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:19.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:38:18 gibba015 bash[29377]: cluster 2021-03-10T15:38:17.695032+0000 mgr.gibba045.orlgmj (mgr.34412) 5805 : cluster [DBG] pgmap v3295: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:19.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:38:18 gibba015 bash[30343]: cluster 2021-03-10T15:38:17.695032+0000 mgr.gibba045.orlgmj (mgr.34412) 5805 : cluster [DBG] pgmap v3295: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:20.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:38:20 gibba015 bash[29377]: cluster 2021-03-10T15:38:19.696840+0000 mgr.gibba045.orlgmj (mgr.34412) 5806 : cluster [DBG] pgmap v3296: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:20.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:38:20 gibba015 bash[30343]: cluster 2021-03-10T15:38:19.696840+0000 mgr.gibba045.orlgmj (mgr.34412) 5806 : cluster [DBG] pgmap v3296: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:21.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:38:20 gibba045 bash[25517]: cluster 2021-03-10T15:38:19.696840+0000 mgr.gibba045.orlgmj (mgr.34412) 5806 : cluster [DBG] pgmap v3296: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:23.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:38:22 gibba045 bash[25517]: cluster 2021-03-10T15:38:21.698576+0000 mgr.gibba045.orlgmj (mgr.34412) 5807 : cluster [DBG] pgmap v3297: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:23.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:38:22 gibba015 bash[29377]: cluster 2021-03-10T15:38:21.698576+0000 mgr.gibba045.orlgmj (mgr.34412) 5807 : cluster [DBG] pgmap v3297: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:23.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:38:22 gibba015 bash[30343]: cluster 2021-03-10T15:38:21.698576+0000 mgr.gibba045.orlgmj (mgr.34412) 5807 : cluster [DBG] pgmap v3297: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:25.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:38:24 gibba045 bash[25517]: cluster 2021-03-10T15:38:23.700113+0000 mgr.gibba045.orlgmj (mgr.34412) 5808 : cluster [DBG] pgmap v3298: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:25.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:38:24 gibba015 bash[29377]: cluster 2021-03-10T15:38:23.700113+0000 mgr.gibba045.orlgmj (mgr.34412) 5808 : cluster [DBG] pgmap v3298: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:25.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:38:24 gibba015 bash[30343]: cluster 2021-03-10T15:38:23.700113+0000 mgr.gibba045.orlgmj (mgr.34412) 5808 : cluster [DBG] pgmap v3298: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:27.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:38:26 gibba045 bash[25517]: cluster 2021-03-10T15:38:25.701779+0000 mgr.gibba045.orlgmj (mgr.34412) 5809 : cluster [DBG] pgmap v3299: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:27.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:38:26 gibba015 bash[29377]: cluster 2021-03-10T15:38:25.701779+0000 mgr.gibba045.orlgmj (mgr.34412) 5809 : cluster [DBG] pgmap v3299: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:27.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:38:26 gibba015 bash[30343]: cluster 2021-03-10T15:38:25.701779+0000 mgr.gibba045.orlgmj (mgr.34412) 5809 : cluster [DBG] pgmap v3299: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:29.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:38:28 gibba045 bash[25517]: cluster 2021-03-10T15:38:27.703316+0000 mgr.gibba045.orlgmj (mgr.34412) 5810 : cluster [DBG] pgmap v3300: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:29.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:38:28 gibba015 bash[29377]: cluster 2021-03-10T15:38:27.703316+0000 mgr.gibba045.orlgmj (mgr.34412) 5810 : cluster [DBG] pgmap v3300: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:29.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:38:28 gibba015 bash[30343]: cluster 2021-03-10T15:38:27.703316+0000 mgr.gibba045.orlgmj (mgr.34412) 5810 : cluster [DBG] pgmap v3300: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:30.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:38:30 gibba015 bash[29377]: cluster 2021-03-10T15:38:29.704729+0000 mgr.gibba045.orlgmj (mgr.34412) 5811 : cluster [DBG] pgmap v3301: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:30.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:38:30 gibba015 bash[30343]: cluster 2021-03-10T15:38:29.704729+0000 mgr.gibba045.orlgmj (mgr.34412) 5811 : cluster [DBG] pgmap v3301: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:31.010 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:38:30 gibba045 bash[25517]: cluster 2021-03-10T15:38:29.704729+0000 mgr.gibba045.orlgmj (mgr.34412) 5811 : cluster [DBG] pgmap v3301: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:31.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:38:31 gibba015 bash[29377]: cephadm 2021-03-10T15:38:31.009013+0000 mgr.gibba045.orlgmj (mgr.34412) 5812 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:38:31.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:38:31 gibba015 bash[30343]: cephadm 2021-03-10T15:38:31.009013+0000 mgr.gibba045.orlgmj (mgr.34412) 5812 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:38:32.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:38:31 gibba045 bash[25517]: cephadm 2021-03-10T15:38:31.009013+0000 mgr.gibba045.orlgmj (mgr.34412) 5812 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:38:32.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:38:32 gibba015 bash[29377]: cluster 2021-03-10T15:38:31.705476+0000 mgr.gibba045.orlgmj (mgr.34412) 5813 : cluster [DBG] pgmap v3302: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:32.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:38:32 gibba015 bash[30343]: cluster 2021-03-10T15:38:31.705476+0000 mgr.gibba045.orlgmj (mgr.34412) 5813 : cluster [DBG] pgmap v3302: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:33.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:38:32 gibba045 bash[25517]: cluster 2021-03-10T15:38:31.705476+0000 mgr.gibba045.orlgmj (mgr.34412) 5813 : cluster [DBG] pgmap v3302: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:35.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:38:34 gibba045 bash[25517]: cluster 2021-03-10T15:38:33.706749+0000 mgr.gibba045.orlgmj (mgr.34412) 5814 : cluster [DBG] pgmap v3303: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:35.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:38:34 gibba015 bash[29377]: cluster 2021-03-10T15:38:33.706749+0000 mgr.gibba045.orlgmj (mgr.34412) 5814 : cluster [DBG] pgmap v3303: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:35.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:38:34 gibba015 bash[30343]: cluster 2021-03-10T15:38:33.706749+0000 mgr.gibba045.orlgmj (mgr.34412) 5814 : cluster [DBG] pgmap v3303: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:37.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:38:36 gibba045 bash[25517]: cluster 2021-03-10T15:38:35.708376+0000 mgr.gibba045.orlgmj (mgr.34412) 5815 : cluster [DBG] pgmap v3304: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:37.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:38:36 gibba015 bash[29377]: cluster 2021-03-10T15:38:35.708376+0000 mgr.gibba045.orlgmj (mgr.34412) 5815 : cluster [DBG] pgmap v3304: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:37.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:38:36 gibba015 bash[30343]: cluster 2021-03-10T15:38:35.708376+0000 mgr.gibba045.orlgmj (mgr.34412) 5815 : cluster [DBG] pgmap v3304: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:39.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:38:38 gibba045 bash[25517]: cluster 2021-03-10T15:38:37.709708+0000 mgr.gibba045.orlgmj (mgr.34412) 5816 : cluster [DBG] pgmap v3305: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:39.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:38:38 gibba015 bash[29377]: cluster 2021-03-10T15:38:37.709708+0000 mgr.gibba045.orlgmj (mgr.34412) 5816 : cluster [DBG] pgmap v3305: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:39.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:38:38 gibba015 bash[30343]: cluster 2021-03-10T15:38:37.709708+0000 mgr.gibba045.orlgmj (mgr.34412) 5816 : cluster [DBG] pgmap v3305: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:40.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:38:40 gibba015 bash[29377]: cluster 2021-03-10T15:38:39.711240+0000 mgr.gibba045.orlgmj (mgr.34412) 5817 : cluster [DBG] pgmap v3306: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:40.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:38:40 gibba015 bash[30343]: cluster 2021-03-10T15:38:39.711240+0000 mgr.gibba045.orlgmj (mgr.34412) 5817 : cluster [DBG] pgmap v3306: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:41.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:38:40 gibba045 bash[25517]: cluster 2021-03-10T15:38:39.711240+0000 mgr.gibba045.orlgmj (mgr.34412) 5817 : cluster [DBG] pgmap v3306: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:43.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:38:42 gibba045 bash[25517]: cluster 2021-03-10T15:38:41.712940+0000 mgr.gibba045.orlgmj (mgr.34412) 5818 : cluster [DBG] pgmap v3307: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:43.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:38:42 gibba015 bash[29377]: cluster 2021-03-10T15:38:41.712940+0000 mgr.gibba045.orlgmj (mgr.34412) 5818 : cluster [DBG] pgmap v3307: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:43.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:38:42 gibba015 bash[30343]: cluster 2021-03-10T15:38:41.712940+0000 mgr.gibba045.orlgmj (mgr.34412) 5818 : cluster [DBG] pgmap v3307: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:43.707 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:38:43.935 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:38:43.936 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (109m) 3m ago 114m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:38:43.936 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (114m) 2m ago 114m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:38:43.936 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (109m) 2m ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:38:43.936 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (110m) 2m ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:38:43.937 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (109m) 3m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:38:43.937 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (108m) 3m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:38:43.937 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (108m) 2m ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:38:43.937 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (108m) 3m ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:38:43.937 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (114m) 3m ago 114m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:38:43.938 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (114m) 2m ago 115m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:38:43.938 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (107m) 3m ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:38:43.938 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (107m) 3m ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:38:43.938 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (106m) 3m ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:38:43.939 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (106m) 3m ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:38:43.939 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (106m) 2m ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:38:43.939 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (105m) 2m ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:38:43.939 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (105m) 2m ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:38:43.940 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (104m) 2m ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:38:43.940 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (114m) 2m ago 115m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:38:43.940 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 2m ago 112m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:38:44.185 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:38:44.185 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:38:44.185 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:38:44.185 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:38:44.186 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:38:44.186 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:38:44.186 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:38:44.186 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:38:44.187 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:38:44.187 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:38:44.187 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:38:44.187 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:38:44.188 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:38:44.188 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:38:44.188 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:38:45.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:38:44 gibba045 bash[25517]: audit 2021-03-10T15:38:43.696780+0000 mgr.gibba045.orlgmj (mgr.34412) 5819 : audit [DBG] from='client.57946 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:38:45.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:38:44 gibba045 bash[25517]: cluster 2021-03-10T15:38:43.714247+0000 mgr.gibba045.orlgmj (mgr.34412) 5820 : cluster [DBG] pgmap v3308: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:45.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:38:44 gibba045 bash[25517]: audit 2021-03-10T15:38:43.923283+0000 mgr.gibba045.orlgmj (mgr.34412) 5821 : audit [DBG] from='client.47964 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:38:45.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:38:44 gibba045 bash[25517]: audit 2021-03-10T15:38:44.179909+0000 mon.a (mon.0) 1471 : audit [DBG] from='client.? 172.21.2.115:0/2052526287' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:38:45.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:38:44 gibba015 bash[29377]: audit 2021-03-10T15:38:43.696780+0000 mgr.gibba045.orlgmj (mgr.34412) 5819 : audit [DBG] from='client.57946 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:38:45.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:38:44 gibba015 bash[29377]: cluster 2021-03-10T15:38:43.714247+0000 mgr.gibba045.orlgmj (mgr.34412) 5820 : cluster [DBG] pgmap v3308: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:45.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:38:44 gibba015 bash[29377]: audit 2021-03-10T15:38:43.923283+0000 mgr.gibba045.orlgmj (mgr.34412) 5821 : audit [DBG] from='client.47964 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:38:45.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:38:44 gibba015 bash[29377]: audit 2021-03-10T15:38:44.179909+0000 mon.a (mon.0) 1471 : audit [DBG] from='client.? 172.21.2.115:0/2052526287' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:38:45.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:38:44 gibba015 bash[30343]: audit 2021-03-10T15:38:43.696780+0000 mgr.gibba045.orlgmj (mgr.34412) 5819 : audit [DBG] from='client.57946 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:38:45.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:38:44 gibba015 bash[30343]: cluster 2021-03-10T15:38:43.714247+0000 mgr.gibba045.orlgmj (mgr.34412) 5820 : cluster [DBG] pgmap v3308: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:45.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:38:44 gibba015 bash[30343]: audit 2021-03-10T15:38:43.923283+0000 mgr.gibba045.orlgmj (mgr.34412) 5821 : audit [DBG] from='client.47964 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:38:45.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:38:44 gibba015 bash[30343]: audit 2021-03-10T15:38:44.179909+0000 mon.a (mon.0) 1471 : audit [DBG] from='client.? 172.21.2.115:0/2052526287' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:38:47.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:38:46 gibba045 bash[25517]: cluster 2021-03-10T15:38:45.715895+0000 mgr.gibba045.orlgmj (mgr.34412) 5822 : cluster [DBG] pgmap v3309: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:47.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:38:46 gibba045 bash[25517]: cephadm 2021-03-10T15:38:46.015108+0000 mgr.gibba045.orlgmj (mgr.34412) 5823 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:38:47.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:38:46 gibba015 bash[29377]: cluster 2021-03-10T15:38:45.715895+0000 mgr.gibba045.orlgmj (mgr.34412) 5822 : cluster [DBG] pgmap v3309: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:47.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:38:46 gibba015 bash[29377]: cephadm 2021-03-10T15:38:46.015108+0000 mgr.gibba045.orlgmj (mgr.34412) 5823 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:38:47.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:38:46 gibba015 bash[30343]: cluster 2021-03-10T15:38:45.715895+0000 mgr.gibba045.orlgmj (mgr.34412) 5822 : cluster [DBG] pgmap v3309: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:47.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:38:46 gibba015 bash[30343]: cephadm 2021-03-10T15:38:46.015108+0000 mgr.gibba045.orlgmj (mgr.34412) 5823 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:38:49.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:38:48 gibba045 bash[25517]: cluster 2021-03-10T15:38:47.717559+0000 mgr.gibba045.orlgmj (mgr.34412) 5824 : cluster [DBG] pgmap v3310: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:49.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:38:48 gibba015 bash[29377]: cluster 2021-03-10T15:38:47.717559+0000 mgr.gibba045.orlgmj (mgr.34412) 5824 : cluster [DBG] pgmap v3310: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:49.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:38:48 gibba015 bash[30343]: cluster 2021-03-10T15:38:47.717559+0000 mgr.gibba045.orlgmj (mgr.34412) 5824 : cluster [DBG] pgmap v3310: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:50.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:38:50 gibba015 bash[29377]: cluster 2021-03-10T15:38:49.718945+0000 mgr.gibba045.orlgmj (mgr.34412) 5825 : cluster [DBG] pgmap v3311: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:50.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:38:50 gibba015 bash[30343]: cluster 2021-03-10T15:38:49.718945+0000 mgr.gibba045.orlgmj (mgr.34412) 5825 : cluster [DBG] pgmap v3311: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:51.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:38:50 gibba045 bash[25517]: cluster 2021-03-10T15:38:49.718945+0000 mgr.gibba045.orlgmj (mgr.34412) 5825 : cluster [DBG] pgmap v3311: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:53.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:38:52 gibba045 bash[25517]: cluster 2021-03-10T15:38:51.720707+0000 mgr.gibba045.orlgmj (mgr.34412) 5826 : cluster [DBG] pgmap v3312: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:53.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:38:52 gibba015 bash[29377]: cluster 2021-03-10T15:38:51.720707+0000 mgr.gibba045.orlgmj (mgr.34412) 5826 : cluster [DBG] pgmap v3312: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:53.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:38:52 gibba015 bash[30343]: cluster 2021-03-10T15:38:51.720707+0000 mgr.gibba045.orlgmj (mgr.34412) 5826 : cluster [DBG] pgmap v3312: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:38:53 gibba045 bash[25517]: audit 2021-03-10T15:38:53.213910+0000 mon.c (mon.1) 1632 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:38:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:38:53 gibba045 bash[25517]: audit 2021-03-10T15:38:53.214770+0000 mon.c (mon.1) 1633 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:38:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:38:53 gibba045 bash[25517]: audit 2021-03-10T15:38:53.215140+0000 mon.a (mon.0) 1472 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:38:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:38:53 gibba045 bash[25517]: audit 2021-03-10T15:38:53.215632+0000 mon.c (mon.1) 1634 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T15:38:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:38:53 gibba045 bash[25517]: audit 2021-03-10T15:38:53.216747+0000 mon.c (mon.1) 1635 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T15:38:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:38:53 gibba045 bash[25517]: audit 2021-03-10T15:38:53.216838+0000 mon.a (mon.0) 1473 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:38:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:38:53 gibba045 bash[25517]: audit 2021-03-10T15:38:53.217672+0000 mon.c (mon.1) 1636 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:38:54.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:38:53 gibba045 bash[25517]: audit 2021-03-10T15:38:53.218680+0000 mon.c (mon.1) 1637 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:38:54.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:38:53 gibba045 bash[25517]: audit 2021-03-10T15:38:53.218699+0000 mon.a (mon.0) 1474 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T15:38:54.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:38:53 gibba045 bash[25517]: audit 2021-03-10T15:38:53.219405+0000 mon.a (mon.0) 1475 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T15:38:54.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:38:53 gibba045 bash[25517]: audit 2021-03-10T15:38:53.219680+0000 mon.a (mon.0) 1476 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:38:54.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:38:53 gibba045 bash[25517]: audit 2021-03-10T15:38:53.219987+0000 mon.a (mon.0) 1477 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:38:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:38:53 gibba015 bash[29377]: audit 2021-03-10T15:38:53.213910+0000 mon.c (mon.1) 1632 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:38:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:38:53 gibba015 bash[29377]: audit 2021-03-10T15:38:53.214770+0000 mon.c (mon.1) 1633 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:38:54.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:38:53 gibba015 bash[29377]: audit 2021-03-10T15:38:53.215140+0000 mon.a (mon.0) 1472 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:38:54.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:38:53 gibba015 bash[29377]: audit 2021-03-10T15:38:53.215632+0000 mon.c (mon.1) 1634 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T15:38:54.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:38:53 gibba015 bash[29377]: audit 2021-03-10T15:38:53.216747+0000 mon.c (mon.1) 1635 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T15:38:54.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:38:53 gibba015 bash[29377]: audit 2021-03-10T15:38:53.216838+0000 mon.a (mon.0) 1473 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:38:54.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:38:53 gibba015 bash[29377]: audit 2021-03-10T15:38:53.217672+0000 mon.c (mon.1) 1636 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:38:54.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:38:53 gibba015 bash[29377]: audit 2021-03-10T15:38:53.218680+0000 mon.c (mon.1) 1637 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:38:54.230 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:38:53 gibba015 bash[29377]: audit 2021-03-10T15:38:53.218699+0000 mon.a (mon.0) 1474 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T15:38:54.230 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:38:53 gibba015 bash[29377]: audit 2021-03-10T15:38:53.219405+0000 mon.a (mon.0) 1475 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T15:38:54.231 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:38:53 gibba015 bash[29377]: audit 2021-03-10T15:38:53.219680+0000 mon.a (mon.0) 1476 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:38:54.231 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:38:53 gibba015 bash[29377]: audit 2021-03-10T15:38:53.219987+0000 mon.a (mon.0) 1477 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:38:54.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:38:53 gibba015 bash[30343]: audit 2021-03-10T15:38:53.213910+0000 mon.c (mon.1) 1632 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:38:54.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:38:53 gibba015 bash[30343]: audit 2021-03-10T15:38:53.214770+0000 mon.c (mon.1) 1633 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:38:54.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:38:53 gibba015 bash[30343]: audit 2021-03-10T15:38:53.215140+0000 mon.a (mon.0) 1472 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:38:54.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:38:53 gibba015 bash[30343]: audit 2021-03-10T15:38:53.215632+0000 mon.c (mon.1) 1634 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T15:38:54.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:38:53 gibba015 bash[30343]: audit 2021-03-10T15:38:53.216747+0000 mon.c (mon.1) 1635 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T15:38:54.234 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:38:53 gibba015 bash[30343]: audit 2021-03-10T15:38:53.216838+0000 mon.a (mon.0) 1473 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:38:54.234 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:38:53 gibba015 bash[30343]: audit 2021-03-10T15:38:53.217672+0000 mon.c (mon.1) 1636 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:38:54.235 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:38:53 gibba015 bash[30343]: audit 2021-03-10T15:38:53.218680+0000 mon.c (mon.1) 1637 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:38:54.235 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:38:53 gibba015 bash[30343]: audit 2021-03-10T15:38:53.218699+0000 mon.a (mon.0) 1474 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T15:38:54.236 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:38:53 gibba015 bash[30343]: audit 2021-03-10T15:38:53.219405+0000 mon.a (mon.0) 1475 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T15:38:54.236 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:38:53 gibba015 bash[30343]: audit 2021-03-10T15:38:53.219680+0000 mon.a (mon.0) 1476 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:38:54.237 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:38:53 gibba015 bash[30343]: audit 2021-03-10T15:38:53.219987+0000 mon.a (mon.0) 1477 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:38:55.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:38:54 gibba045 bash[25517]: cluster 2021-03-10T15:38:53.722243+0000 mgr.gibba045.orlgmj (mgr.34412) 5827 : cluster [DBG] pgmap v3313: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:55.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:38:54 gibba015 bash[29377]: cluster 2021-03-10T15:38:53.722243+0000 mgr.gibba045.orlgmj (mgr.34412) 5827 : cluster [DBG] pgmap v3313: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:55.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:38:54 gibba015 bash[30343]: cluster 2021-03-10T15:38:53.722243+0000 mgr.gibba045.orlgmj (mgr.34412) 5827 : cluster [DBG] pgmap v3313: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:57.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:38:56 gibba015 bash[29377]: cluster 2021-03-10T15:38:55.723895+0000 mgr.gibba045.orlgmj (mgr.34412) 5828 : cluster [DBG] pgmap v3314: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:57.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:38:56 gibba015 bash[30343]: cluster 2021-03-10T15:38:55.723895+0000 mgr.gibba045.orlgmj (mgr.34412) 5828 : cluster [DBG] pgmap v3314: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:57.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:38:56 gibba045 bash[25517]: cluster 2021-03-10T15:38:55.723895+0000 mgr.gibba045.orlgmj (mgr.34412) 5828 : cluster [DBG] pgmap v3314: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:59.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:38:58 gibba015 bash[29377]: cluster 2021-03-10T15:38:57.725570+0000 mgr.gibba045.orlgmj (mgr.34412) 5829 : cluster [DBG] pgmap v3315: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:59.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:38:58 gibba015 bash[30343]: cluster 2021-03-10T15:38:57.725570+0000 mgr.gibba045.orlgmj (mgr.34412) 5829 : cluster [DBG] pgmap v3315: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:59.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:38:58 gibba045 bash[25517]: cluster 2021-03-10T15:38:57.725570+0000 mgr.gibba045.orlgmj (mgr.34412) 5829 : cluster [DBG] pgmap v3315: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:00.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:39:00 gibba015 bash[29377]: cluster 2021-03-10T15:38:59.727266+0000 mgr.gibba045.orlgmj (mgr.34412) 5830 : cluster [DBG] pgmap v3316: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:00.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:39:00 gibba015 bash[30343]: cluster 2021-03-10T15:38:59.727266+0000 mgr.gibba045.orlgmj (mgr.34412) 5830 : cluster [DBG] pgmap v3316: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:01.018 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:39:00 gibba045 bash[25517]: cluster 2021-03-10T15:38:59.727266+0000 mgr.gibba045.orlgmj (mgr.34412) 5830 : cluster [DBG] pgmap v3316: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:01.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:39:01 gibba015 bash[29377]: cephadm 2021-03-10T15:39:01.016696+0000 mgr.gibba045.orlgmj (mgr.34412) 5831 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:39:01.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:39:01 gibba015 bash[30343]: cephadm 2021-03-10T15:39:01.016696+0000 mgr.gibba045.orlgmj (mgr.34412) 5831 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:39:02.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:39:01 gibba045 bash[25517]: cephadm 2021-03-10T15:39:01.016696+0000 mgr.gibba045.orlgmj (mgr.34412) 5831 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:39:02.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:39:02 gibba015 bash[29377]: cluster 2021-03-10T15:39:01.728871+0000 mgr.gibba045.orlgmj (mgr.34412) 5832 : cluster [DBG] pgmap v3317: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:02.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:39:02 gibba015 bash[30343]: cluster 2021-03-10T15:39:01.728871+0000 mgr.gibba045.orlgmj (mgr.34412) 5832 : cluster [DBG] pgmap v3317: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:03.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:39:02 gibba045 bash[25517]: cluster 2021-03-10T15:39:01.728871+0000 mgr.gibba045.orlgmj (mgr.34412) 5832 : cluster [DBG] pgmap v3317: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:05.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:39:04 gibba045 bash[25517]: cluster 2021-03-10T15:39:03.730166+0000 mgr.gibba045.orlgmj (mgr.34412) 5833 : cluster [DBG] pgmap v3318: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:05.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:39:04 gibba015 bash[29377]: cluster 2021-03-10T15:39:03.730166+0000 mgr.gibba045.orlgmj (mgr.34412) 5833 : cluster [DBG] pgmap v3318: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:05.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:39:04 gibba015 bash[30343]: cluster 2021-03-10T15:39:03.730166+0000 mgr.gibba045.orlgmj (mgr.34412) 5833 : cluster [DBG] pgmap v3318: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:07.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:39:06 gibba045 bash[25517]: cluster 2021-03-10T15:39:05.731810+0000 mgr.gibba045.orlgmj (mgr.34412) 5834 : cluster [DBG] pgmap v3319: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:07.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:39:06 gibba015 bash[29377]: cluster 2021-03-10T15:39:05.731810+0000 mgr.gibba045.orlgmj (mgr.34412) 5834 : cluster [DBG] pgmap v3319: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:07.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:39:06 gibba015 bash[30343]: cluster 2021-03-10T15:39:05.731810+0000 mgr.gibba045.orlgmj (mgr.34412) 5834 : cluster [DBG] pgmap v3319: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:09.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:39:08 gibba015 bash[29377]: cluster 2021-03-10T15:39:07.733233+0000 mgr.gibba045.orlgmj (mgr.34412) 5835 : cluster [DBG] pgmap v3320: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:09.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:39:08 gibba015 bash[30343]: cluster 2021-03-10T15:39:07.733233+0000 mgr.gibba045.orlgmj (mgr.34412) 5835 : cluster [DBG] pgmap v3320: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:09.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:39:08 gibba045 bash[25517]: cluster 2021-03-10T15:39:07.733233+0000 mgr.gibba045.orlgmj (mgr.34412) 5835 : cluster [DBG] pgmap v3320: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:10.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:39:10 gibba015 bash[29377]: cluster 2021-03-10T15:39:09.734846+0000 mgr.gibba045.orlgmj (mgr.34412) 5836 : cluster [DBG] pgmap v3321: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:10.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:39:10 gibba015 bash[30343]: cluster 2021-03-10T15:39:09.734846+0000 mgr.gibba045.orlgmj (mgr.34412) 5836 : cluster [DBG] pgmap v3321: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:11.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:39:10 gibba045 bash[25517]: cluster 2021-03-10T15:39:09.734846+0000 mgr.gibba045.orlgmj (mgr.34412) 5836 : cluster [DBG] pgmap v3321: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:13.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:39:12 gibba045 bash[25517]: cluster 2021-03-10T15:39:11.736652+0000 mgr.gibba045.orlgmj (mgr.34412) 5837 : cluster [DBG] pgmap v3322: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:13.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:39:12 gibba015 bash[29377]: cluster 2021-03-10T15:39:11.736652+0000 mgr.gibba045.orlgmj (mgr.34412) 5837 : cluster [DBG] pgmap v3322: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:13.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:39:12 gibba015 bash[30343]: cluster 2021-03-10T15:39:11.736652+0000 mgr.gibba045.orlgmj (mgr.34412) 5837 : cluster [DBG] pgmap v3322: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:14.428 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:39:14.654 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:39:14.654 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (109m) 4m ago 115m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:39:14.654 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (115m) 2m ago 115m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:39:14.655 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (110m) 2m ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:39:14.655 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (110m) 2m ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:39:14.655 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (109m) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:39:14.656 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (109m) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:39:14.656 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (109m) 2m ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:39:14.656 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (109m) 4m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:39:14.656 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (115m) 4m ago 115m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:39:14.657 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (115m) 2m ago 115m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:39:14.657 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (108m) 4m ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:39:14.657 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (107m) 4m ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:39:14.658 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (107m) 4m ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:39:14.658 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (106m) 4m ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:39:14.658 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (106m) 2m ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:39:14.658 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (106m) 2m ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:39:14.659 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (105m) 2m ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:39:14.659 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (105m) 2m ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:39:14.659 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (114m) 2m ago 115m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:39:14.659 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 2m ago 113m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:39:14.906 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:39:14.907 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:39:14.907 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:39:14.907 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:39:14.908 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:39:14.908 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:39:14.908 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:39:14.909 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:39:14.909 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:39:14.909 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:39:14.909 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:39:14.909 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:39:14.910 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:39:14.910 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:39:14.910 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:39:15.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:39:14 gibba015 bash[29377]: cluster 2021-03-10T15:39:13.737854+0000 mgr.gibba045.orlgmj (mgr.34412) 5838 : cluster [DBG] pgmap v3323: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:15.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:39:14 gibba015 bash[30343]: cluster 2021-03-10T15:39:13.737854+0000 mgr.gibba045.orlgmj (mgr.34412) 5838 : cluster [DBG] pgmap v3323: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:15.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:39:14 gibba045 bash[25517]: cluster 2021-03-10T15:39:13.737854+0000 mgr.gibba045.orlgmj (mgr.34412) 5838 : cluster [DBG] pgmap v3323: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:16.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:39:15 gibba015 bash[29377]: audit 2021-03-10T15:39:14.417716+0000 mgr.gibba045.orlgmj (mgr.34412) 5839 : audit [DBG] from='client.57964 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:39:16.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:39:15 gibba015 bash[29377]: audit 2021-03-10T15:39:14.643319+0000 mgr.gibba045.orlgmj (mgr.34412) 5840 : audit [DBG] from='client.57970 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:39:16.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:39:15 gibba015 bash[29377]: audit 2021-03-10T15:39:14.901540+0000 mon.a (mon.0) 1478 : audit [DBG] from='client.? 172.21.2.115:0/2390424806' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:39:16.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:39:15 gibba015 bash[30343]: audit 2021-03-10T15:39:14.417716+0000 mgr.gibba045.orlgmj (mgr.34412) 5839 : audit [DBG] from='client.57964 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:39:16.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:39:15 gibba015 bash[30343]: audit 2021-03-10T15:39:14.643319+0000 mgr.gibba045.orlgmj (mgr.34412) 5840 : audit [DBG] from='client.57970 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:39:16.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:39:15 gibba015 bash[30343]: audit 2021-03-10T15:39:14.901540+0000 mon.a (mon.0) 1478 : audit [DBG] from='client.? 172.21.2.115:0/2390424806' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:39:16.257 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:39:15 gibba045 bash[25517]: audit 2021-03-10T15:39:14.417716+0000 mgr.gibba045.orlgmj (mgr.34412) 5839 : audit [DBG] from='client.57964 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:39:16.257 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:39:15 gibba045 bash[25517]: audit 2021-03-10T15:39:14.643319+0000 mgr.gibba045.orlgmj (mgr.34412) 5840 : audit [DBG] from='client.57970 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:39:16.258 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:39:15 gibba045 bash[25517]: audit 2021-03-10T15:39:14.901540+0000 mon.a (mon.0) 1478 : audit [DBG] from='client.? 172.21.2.115:0/2390424806' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:39:17.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:39:16 gibba015 bash[29377]: cluster 2021-03-10T15:39:15.739647+0000 mgr.gibba045.orlgmj (mgr.34412) 5841 : cluster [DBG] pgmap v3324: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:17.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:39:16 gibba015 bash[29377]: audit 2021-03-10T15:39:16.017288+0000 mon.c (mon.1) 1638 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:39:17.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:39:16 gibba015 bash[29377]: cephadm 2021-03-10T15:39:16.026290+0000 mgr.gibba045.orlgmj (mgr.34412) 5842 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:39:17.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:39:16 gibba015 bash[29377]: cephadm 2021-03-10T15:39:16.028075+0000 mgr.gibba045.orlgmj (mgr.34412) 5843 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:39:17.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:39:16 gibba015 bash[29377]: audit 2021-03-10T15:39:16.237642+0000 mon.a (mon.0) 1479 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:39:17.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:39:16 gibba015 bash[29377]: audit 2021-03-10T15:39:16.241245+0000 mon.c (mon.1) 1639 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:39:17.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:39:16 gibba015 bash[29377]: audit 2021-03-10T15:39:16.243061+0000 mon.c (mon.1) 1640 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:39:17.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:39:16 gibba015 bash[29377]: cephadm 2021-03-10T15:39:16.244000+0000 mgr.gibba045.orlgmj (mgr.34412) 5844 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:39:17.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:39:16 gibba015 bash[29377]: audit 2021-03-10T15:39:16.244659+0000 mon.c (mon.1) 1641 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:39:17.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:39:16 gibba015 bash[29377]: cephadm 2021-03-10T15:39:16.246091+0000 mgr.gibba045.orlgmj (mgr.34412) 5845 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:39:17.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:39:16 gibba015 bash[29377]: audit 2021-03-10T15:39:16.246209+0000 mon.c (mon.1) 1642 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:39:17.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:39:16 gibba015 bash[29377]: cephadm 2021-03-10T15:39:16.247577+0000 mgr.gibba045.orlgmj (mgr.34412) 5846 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:39:17.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:39:16 gibba015 bash[29377]: cephadm 2021-03-10T15:39:16.247652+0000 mgr.gibba045.orlgmj (mgr.34412) 5847 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:39:17.230 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:39:16 gibba015 bash[29377]: cephadm 2021-03-10T15:39:16.249323+0000 mgr.gibba045.orlgmj (mgr.34412) 5848 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:39:17.230 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:39:16 gibba015 bash[29377]: cephadm 2021-03-10T15:39:16.249360+0000 mgr.gibba045.orlgmj (mgr.34412) 5849 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:39:17.230 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:39:16 gibba015 bash[29377]: audit 2021-03-10T15:39:16.249847+0000 mon.c (mon.1) 1643 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:39:17.230 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:39:16 gibba015 bash[29377]: cephadm 2021-03-10T15:39:16.251000+0000 mgr.gibba045.orlgmj (mgr.34412) 5850 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:39:17.231 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:39:16 gibba015 bash[29377]: audit 2021-03-10T15:39:16.251738+0000 mon.c (mon.1) 1644 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:39:17.231 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:39:16 gibba015 bash[29377]: cephadm 2021-03-10T15:39:16.252837+0000 mgr.gibba045.orlgmj (mgr.34412) 5851 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:39:17.231 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:39:16 gibba015 bash[29377]: cephadm 2021-03-10T15:39:16.252873+0000 mgr.gibba045.orlgmj (mgr.34412) 5852 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:39:17.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:39:16 gibba015 bash[30343]: cluster 2021-03-10T15:39:15.739647+0000 mgr.gibba045.orlgmj (mgr.34412) 5841 : cluster [DBG] pgmap v3324: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:17.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:39:16 gibba015 bash[30343]: audit 2021-03-10T15:39:16.017288+0000 mon.c (mon.1) 1638 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:39:17.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:39:16 gibba015 bash[30343]: cephadm 2021-03-10T15:39:16.026290+0000 mgr.gibba045.orlgmj (mgr.34412) 5842 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:39:17.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:39:16 gibba015 bash[30343]: cephadm 2021-03-10T15:39:16.028075+0000 mgr.gibba045.orlgmj (mgr.34412) 5843 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:39:17.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:39:16 gibba015 bash[30343]: audit 2021-03-10T15:39:16.237642+0000 mon.a (mon.0) 1479 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:39:17.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:39:16 gibba015 bash[30343]: audit 2021-03-10T15:39:16.241245+0000 mon.c (mon.1) 1639 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:39:17.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:39:16 gibba015 bash[30343]: audit 2021-03-10T15:39:16.243061+0000 mon.c (mon.1) 1640 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:39:17.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:39:16 gibba015 bash[30343]: cephadm 2021-03-10T15:39:16.244000+0000 mgr.gibba045.orlgmj (mgr.34412) 5844 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:39:17.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:39:16 gibba015 bash[30343]: audit 2021-03-10T15:39:16.244659+0000 mon.c (mon.1) 1641 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:39:17.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:39:16 gibba015 bash[30343]: cephadm 2021-03-10T15:39:16.246091+0000 mgr.gibba045.orlgmj (mgr.34412) 5845 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:39:17.234 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:39:16 gibba015 bash[30343]: audit 2021-03-10T15:39:16.246209+0000 mon.c (mon.1) 1642 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:39:17.234 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:39:16 gibba015 bash[30343]: cephadm 2021-03-10T15:39:16.247577+0000 mgr.gibba045.orlgmj (mgr.34412) 5846 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:39:17.234 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:39:16 gibba015 bash[30343]: cephadm 2021-03-10T15:39:16.247652+0000 mgr.gibba045.orlgmj (mgr.34412) 5847 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:39:17.234 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:39:16 gibba015 bash[30343]: cephadm 2021-03-10T15:39:16.249323+0000 mgr.gibba045.orlgmj (mgr.34412) 5848 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:39:17.235 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:39:16 gibba015 bash[30343]: cephadm 2021-03-10T15:39:16.249360+0000 mgr.gibba045.orlgmj (mgr.34412) 5849 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:39:17.235 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:39:16 gibba015 bash[30343]: audit 2021-03-10T15:39:16.249847+0000 mon.c (mon.1) 1643 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:39:17.235 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:39:16 gibba015 bash[30343]: cephadm 2021-03-10T15:39:16.251000+0000 mgr.gibba045.orlgmj (mgr.34412) 5850 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:39:17.235 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:39:16 gibba015 bash[30343]: audit 2021-03-10T15:39:16.251738+0000 mon.c (mon.1) 1644 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:39:17.236 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:39:16 gibba015 bash[30343]: cephadm 2021-03-10T15:39:16.252837+0000 mgr.gibba045.orlgmj (mgr.34412) 5851 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:39:17.236 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:39:16 gibba015 bash[30343]: cephadm 2021-03-10T15:39:16.252873+0000 mgr.gibba045.orlgmj (mgr.34412) 5852 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:39:17.236 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:39:16 gibba015 bash[29377]: cephadm 2021-03-10T15:39:16.254615+0000 mgr.gibba045.orlgmj (mgr.34412) 5853 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:39:17.237 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:39:16 gibba015 bash[29377]: cephadm 2021-03-10T15:39:16.254928+0000 mgr.gibba045.orlgmj (mgr.34412) 5854 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:39:17.237 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:39:16 gibba015 bash[29377]: cephadm 2021-03-10T15:39:16.256191+0000 mgr.gibba045.orlgmj (mgr.34412) 5855 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:39:17.237 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:39:16 gibba015 bash[29377]: cephadm 2021-03-10T15:39:16.256229+0000 mgr.gibba045.orlgmj (mgr.34412) 5856 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:39:17.237 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:39:16 gibba015 bash[29377]: cephadm 2021-03-10T15:39:16.256389+0000 mgr.gibba045.orlgmj (mgr.34412) 5857 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:39:17.238 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:39:16 gibba015 bash[30343]: cephadm 2021-03-10T15:39:16.254615+0000 mgr.gibba045.orlgmj (mgr.34412) 5853 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:39:17.238 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:39:16 gibba015 bash[30343]: cephadm 2021-03-10T15:39:16.254928+0000 mgr.gibba045.orlgmj (mgr.34412) 5854 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:39:17.238 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:39:16 gibba015 bash[30343]: cephadm 2021-03-10T15:39:16.256191+0000 mgr.gibba045.orlgmj (mgr.34412) 5855 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:39:17.239 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:39:16 gibba015 bash[30343]: cephadm 2021-03-10T15:39:16.256229+0000 mgr.gibba045.orlgmj (mgr.34412) 5856 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:39:17.239 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:39:16 gibba015 bash[30343]: cephadm 2021-03-10T15:39:16.256389+0000 mgr.gibba045.orlgmj (mgr.34412) 5857 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:39:17.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:39:16 gibba045 bash[25517]: cluster 2021-03-10T15:39:15.739647+0000 mgr.gibba045.orlgmj (mgr.34412) 5841 : cluster [DBG] pgmap v3324: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:17.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:39:16 gibba045 bash[25517]: audit 2021-03-10T15:39:16.017288+0000 mon.c (mon.1) 1638 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:39:17.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:39:16 gibba045 bash[25517]: cephadm 2021-03-10T15:39:16.026290+0000 mgr.gibba045.orlgmj (mgr.34412) 5842 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:39:17.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:39:16 gibba045 bash[25517]: cephadm 2021-03-10T15:39:16.028075+0000 mgr.gibba045.orlgmj (mgr.34412) 5843 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:39:17.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:39:16 gibba045 bash[25517]: audit 2021-03-10T15:39:16.237642+0000 mon.a (mon.0) 1479 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:39:17.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:39:16 gibba045 bash[25517]: audit 2021-03-10T15:39:16.241245+0000 mon.c (mon.1) 1639 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:39:17.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:39:16 gibba045 bash[25517]: audit 2021-03-10T15:39:16.243061+0000 mon.c (mon.1) 1640 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:39:17.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:39:16 gibba045 bash[25517]: cephadm 2021-03-10T15:39:16.244000+0000 mgr.gibba045.orlgmj (mgr.34412) 5844 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:39:17.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:39:16 gibba045 bash[25517]: audit 2021-03-10T15:39:16.244659+0000 mon.c (mon.1) 1641 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:39:17.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:39:16 gibba045 bash[25517]: cephadm 2021-03-10T15:39:16.246091+0000 mgr.gibba045.orlgmj (mgr.34412) 5845 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:39:17.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:39:16 gibba045 bash[25517]: audit 2021-03-10T15:39:16.246209+0000 mon.c (mon.1) 1642 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:39:17.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:39:16 gibba045 bash[25517]: cephadm 2021-03-10T15:39:16.247577+0000 mgr.gibba045.orlgmj (mgr.34412) 5846 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:39:17.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:39:16 gibba045 bash[25517]: cephadm 2021-03-10T15:39:16.247652+0000 mgr.gibba045.orlgmj (mgr.34412) 5847 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:39:17.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:39:16 gibba045 bash[25517]: cephadm 2021-03-10T15:39:16.249323+0000 mgr.gibba045.orlgmj (mgr.34412) 5848 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:39:17.312 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:39:16 gibba045 bash[25517]: cephadm 2021-03-10T15:39:16.249360+0000 mgr.gibba045.orlgmj (mgr.34412) 5849 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:39:17.312 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:39:16 gibba045 bash[25517]: audit 2021-03-10T15:39:16.249847+0000 mon.c (mon.1) 1643 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:39:17.312 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:39:16 gibba045 bash[25517]: cephadm 2021-03-10T15:39:16.251000+0000 mgr.gibba045.orlgmj (mgr.34412) 5850 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:39:17.312 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:39:16 gibba045 bash[25517]: audit 2021-03-10T15:39:16.251738+0000 mon.c (mon.1) 1644 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:39:17.313 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:39:16 gibba045 bash[25517]: cephadm 2021-03-10T15:39:16.252837+0000 mgr.gibba045.orlgmj (mgr.34412) 5851 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:39:17.313 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:39:16 gibba045 bash[25517]: cephadm 2021-03-10T15:39:16.252873+0000 mgr.gibba045.orlgmj (mgr.34412) 5852 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:39:17.313 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:39:16 gibba045 bash[25517]: cephadm 2021-03-10T15:39:16.254615+0000 mgr.gibba045.orlgmj (mgr.34412) 5853 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:39:17.313 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:39:16 gibba045 bash[25517]: cephadm 2021-03-10T15:39:16.254928+0000 mgr.gibba045.orlgmj (mgr.34412) 5854 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:39:17.313 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:39:16 gibba045 bash[25517]: cephadm 2021-03-10T15:39:16.256191+0000 mgr.gibba045.orlgmj (mgr.34412) 5855 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:39:17.314 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:39:16 gibba045 bash[25517]: cephadm 2021-03-10T15:39:16.256229+0000 mgr.gibba045.orlgmj (mgr.34412) 5856 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:39:17.314 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:39:16 gibba045 bash[25517]: cephadm 2021-03-10T15:39:16.256389+0000 mgr.gibba045.orlgmj (mgr.34412) 5857 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:39:19.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:39:18 gibba015 bash[29377]: cluster 2021-03-10T15:39:17.741323+0000 mgr.gibba045.orlgmj (mgr.34412) 5858 : cluster [DBG] pgmap v3325: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:19.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:39:18 gibba015 bash[30343]: cluster 2021-03-10T15:39:17.741323+0000 mgr.gibba045.orlgmj (mgr.34412) 5858 : cluster [DBG] pgmap v3325: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:19.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:39:18 gibba045 bash[25517]: cluster 2021-03-10T15:39:17.741323+0000 mgr.gibba045.orlgmj (mgr.34412) 5858 : cluster [DBG] pgmap v3325: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:20.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:39:20 gibba015 bash[29377]: cluster 2021-03-10T15:39:19.742959+0000 mgr.gibba045.orlgmj (mgr.34412) 5859 : cluster [DBG] pgmap v3326: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:20.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:39:20 gibba015 bash[30343]: cluster 2021-03-10T15:39:19.742959+0000 mgr.gibba045.orlgmj (mgr.34412) 5859 : cluster [DBG] pgmap v3326: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:21.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:39:20 gibba045 bash[25517]: cluster 2021-03-10T15:39:19.742959+0000 mgr.gibba045.orlgmj (mgr.34412) 5859 : cluster [DBG] pgmap v3326: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:23.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:39:22 gibba015 bash[29377]: cluster 2021-03-10T15:39:21.744703+0000 mgr.gibba045.orlgmj (mgr.34412) 5860 : cluster [DBG] pgmap v3327: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:23.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:39:22 gibba015 bash[30343]: cluster 2021-03-10T15:39:21.744703+0000 mgr.gibba045.orlgmj (mgr.34412) 5860 : cluster [DBG] pgmap v3327: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:23.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:39:22 gibba045 bash[25517]: cluster 2021-03-10T15:39:21.744703+0000 mgr.gibba045.orlgmj (mgr.34412) 5860 : cluster [DBG] pgmap v3327: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:25.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:39:24 gibba015 bash[29377]: cluster 2021-03-10T15:39:23.745952+0000 mgr.gibba045.orlgmj (mgr.34412) 5861 : cluster [DBG] pgmap v3328: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:25.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:39:24 gibba015 bash[30343]: cluster 2021-03-10T15:39:23.745952+0000 mgr.gibba045.orlgmj (mgr.34412) 5861 : cluster [DBG] pgmap v3328: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:25.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:39:24 gibba045 bash[25517]: cluster 2021-03-10T15:39:23.745952+0000 mgr.gibba045.orlgmj (mgr.34412) 5861 : cluster [DBG] pgmap v3328: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:27.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:39:26 gibba015 bash[29377]: cluster 2021-03-10T15:39:25.747401+0000 mgr.gibba045.orlgmj (mgr.34412) 5862 : cluster [DBG] pgmap v3329: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:27.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:39:26 gibba015 bash[30343]: cluster 2021-03-10T15:39:25.747401+0000 mgr.gibba045.orlgmj (mgr.34412) 5862 : cluster [DBG] pgmap v3329: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:27.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:39:26 gibba045 bash[25517]: cluster 2021-03-10T15:39:25.747401+0000 mgr.gibba045.orlgmj (mgr.34412) 5862 : cluster [DBG] pgmap v3329: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:29.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:39:28 gibba015 bash[29377]: cluster 2021-03-10T15:39:27.748970+0000 mgr.gibba045.orlgmj (mgr.34412) 5863 : cluster [DBG] pgmap v3330: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:29.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:39:28 gibba015 bash[30343]: cluster 2021-03-10T15:39:27.748970+0000 mgr.gibba045.orlgmj (mgr.34412) 5863 : cluster [DBG] pgmap v3330: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:29.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:39:28 gibba045 bash[25517]: cluster 2021-03-10T15:39:27.748970+0000 mgr.gibba045.orlgmj (mgr.34412) 5863 : cluster [DBG] pgmap v3330: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:30.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:39:30 gibba015 bash[29377]: cluster 2021-03-10T15:39:29.750670+0000 mgr.gibba045.orlgmj (mgr.34412) 5864 : cluster [DBG] pgmap v3331: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:30.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:39:30 gibba015 bash[30343]: cluster 2021-03-10T15:39:29.750670+0000 mgr.gibba045.orlgmj (mgr.34412) 5864 : cluster [DBG] pgmap v3331: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:31.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:39:30 gibba045 bash[25517]: cluster 2021-03-10T15:39:29.750670+0000 mgr.gibba045.orlgmj (mgr.34412) 5864 : cluster [DBG] pgmap v3331: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:33.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:39:32 gibba015 bash[29377]: cephadm 2021-03-10T15:39:31.272475+0000 mgr.gibba045.orlgmj (mgr.34412) 5865 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:39:33.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:39:32 gibba015 bash[29377]: cluster 2021-03-10T15:39:31.752467+0000 mgr.gibba045.orlgmj (mgr.34412) 5866 : cluster [DBG] pgmap v3332: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:33.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:39:32 gibba015 bash[30343]: cephadm 2021-03-10T15:39:31.272475+0000 mgr.gibba045.orlgmj (mgr.34412) 5865 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:39:33.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:39:32 gibba015 bash[30343]: cluster 2021-03-10T15:39:31.752467+0000 mgr.gibba045.orlgmj (mgr.34412) 5866 : cluster [DBG] pgmap v3332: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:33.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:39:32 gibba045 bash[25517]: cephadm 2021-03-10T15:39:31.272475+0000 mgr.gibba045.orlgmj (mgr.34412) 5865 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:39:33.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:39:32 gibba045 bash[25517]: cluster 2021-03-10T15:39:31.752467+0000 mgr.gibba045.orlgmj (mgr.34412) 5866 : cluster [DBG] pgmap v3332: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:35.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:39:34 gibba015 bash[29377]: cluster 2021-03-10T15:39:33.753944+0000 mgr.gibba045.orlgmj (mgr.34412) 5867 : cluster [DBG] pgmap v3333: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:35.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:39:34 gibba015 bash[30343]: cluster 2021-03-10T15:39:33.753944+0000 mgr.gibba045.orlgmj (mgr.34412) 5867 : cluster [DBG] pgmap v3333: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:35.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:39:34 gibba045 bash[25517]: cluster 2021-03-10T15:39:33.753944+0000 mgr.gibba045.orlgmj (mgr.34412) 5867 : cluster [DBG] pgmap v3333: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:37.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:39:36 gibba015 bash[29377]: cluster 2021-03-10T15:39:35.755647+0000 mgr.gibba045.orlgmj (mgr.34412) 5868 : cluster [DBG] pgmap v3334: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:37.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:39:36 gibba015 bash[30343]: cluster 2021-03-10T15:39:35.755647+0000 mgr.gibba045.orlgmj (mgr.34412) 5868 : cluster [DBG] pgmap v3334: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:37.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:39:36 gibba045 bash[25517]: cluster 2021-03-10T15:39:35.755647+0000 mgr.gibba045.orlgmj (mgr.34412) 5868 : cluster [DBG] pgmap v3334: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:39.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:39:38 gibba015 bash[29377]: cluster 2021-03-10T15:39:37.757337+0000 mgr.gibba045.orlgmj (mgr.34412) 5869 : cluster [DBG] pgmap v3335: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:39.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:39:38 gibba015 bash[30343]: cluster 2021-03-10T15:39:37.757337+0000 mgr.gibba045.orlgmj (mgr.34412) 5869 : cluster [DBG] pgmap v3335: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:39.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:39:38 gibba045 bash[25517]: cluster 2021-03-10T15:39:37.757337+0000 mgr.gibba045.orlgmj (mgr.34412) 5869 : cluster [DBG] pgmap v3335: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:40.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:39:40 gibba015 bash[29377]: cluster 2021-03-10T15:39:39.758982+0000 mgr.gibba045.orlgmj (mgr.34412) 5870 : cluster [DBG] pgmap v3336: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:40.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:39:40 gibba015 bash[30343]: cluster 2021-03-10T15:39:39.758982+0000 mgr.gibba045.orlgmj (mgr.34412) 5870 : cluster [DBG] pgmap v3336: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:41.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:39:40 gibba045 bash[25517]: cluster 2021-03-10T15:39:39.758982+0000 mgr.gibba045.orlgmj (mgr.34412) 5870 : cluster [DBG] pgmap v3336: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:43.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:39:42 gibba015 bash[29377]: cluster 2021-03-10T15:39:41.760800+0000 mgr.gibba045.orlgmj (mgr.34412) 5871 : cluster [DBG] pgmap v3337: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:43.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:39:42 gibba015 bash[30343]: cluster 2021-03-10T15:39:41.760800+0000 mgr.gibba045.orlgmj (mgr.34412) 5871 : cluster [DBG] pgmap v3337: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:43.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:39:42 gibba045 bash[25517]: cluster 2021-03-10T15:39:41.760800+0000 mgr.gibba045.orlgmj (mgr.34412) 5871 : cluster [DBG] pgmap v3337: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:45.146 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:39:45.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:39:44 gibba015 bash[29377]: cluster 2021-03-10T15:39:43.762010+0000 mgr.gibba045.orlgmj (mgr.34412) 5872 : cluster [DBG] pgmap v3338: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:45.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:39:44 gibba015 bash[30343]: cluster 2021-03-10T15:39:43.762010+0000 mgr.gibba045.orlgmj (mgr.34412) 5872 : cluster [DBG] pgmap v3338: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:45.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:39:44 gibba045 bash[25517]: cluster 2021-03-10T15:39:43.762010+0000 mgr.gibba045.orlgmj (mgr.34412) 5872 : cluster [DBG] pgmap v3338: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:45.369 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:39:45.369 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (110m) 4m ago 115m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:39:45.370 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (115m) 3m ago 115m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:39:45.370 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (110m) 3m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:39:45.370 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (111m) 3m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:39:45.370 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (110m) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:39:45.371 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (110m) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:39:45.371 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (109m) 3m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:39:45.371 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (109m) 4m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:39:45.371 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (115m) 4m ago 116m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:39:45.372 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (116m) 3m ago 116m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:39:45.372 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (108m) 4m ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:39:45.372 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (108m) 4m ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:39:45.372 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (107m) 4m ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:39:45.373 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (107m) 4m ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:39:45.373 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (107m) 3m ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:39:45.373 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (106m) 3m ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:39:45.373 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (106m) 3m ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:39:45.373 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (105m) 3m ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:39:45.374 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (115m) 3m ago 116m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:39:45.374 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 3m ago 113m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:39:45.620 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:39:45.620 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:39:45.620 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:39:45.621 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:39:45.621 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:39:45.621 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:39:45.621 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:39:45.621 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:39:45.622 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:39:45.622 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:39:45.622 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:39:45.622 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:39:45.623 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:39:45.623 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:39:45.623 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:39:46.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:39:45 gibba015 bash[29377]: audit 2021-03-10T15:39:45.136654+0000 mgr.gibba045.orlgmj (mgr.34412) 5873 : audit [DBG] from='client.47994 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:39:46.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:39:45 gibba015 bash[29377]: audit 2021-03-10T15:39:45.615000+0000 mon.a (mon.0) 1480 : audit [DBG] from='client.? 172.21.2.115:0/2423829809' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:39:46.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:39:45 gibba015 bash[30343]: audit 2021-03-10T15:39:45.136654+0000 mgr.gibba045.orlgmj (mgr.34412) 5873 : audit [DBG] from='client.47994 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:39:46.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:39:45 gibba015 bash[30343]: audit 2021-03-10T15:39:45.615000+0000 mon.a (mon.0) 1480 : audit [DBG] from='client.? 172.21.2.115:0/2423829809' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:39:46.290 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:39:45 gibba045 bash[25517]: audit 2021-03-10T15:39:45.136654+0000 mgr.gibba045.orlgmj (mgr.34412) 5873 : audit [DBG] from='client.47994 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:39:46.290 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:39:45 gibba045 bash[25517]: audit 2021-03-10T15:39:45.615000+0000 mon.a (mon.0) 1480 : audit [DBG] from='client.? 172.21.2.115:0/2423829809' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:39:47.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:39:46 gibba015 bash[29377]: audit 2021-03-10T15:39:45.359808+0000 mgr.gibba045.orlgmj (mgr.34412) 5874 : audit [DBG] from='client.48000 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:39:47.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:39:46 gibba015 bash[29377]: cluster 2021-03-10T15:39:45.763762+0000 mgr.gibba045.orlgmj (mgr.34412) 5875 : cluster [DBG] pgmap v3339: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:47.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:39:46 gibba015 bash[30343]: audit 2021-03-10T15:39:45.359808+0000 mgr.gibba045.orlgmj (mgr.34412) 5874 : audit [DBG] from='client.48000 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:39:47.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:39:46 gibba015 bash[30343]: cluster 2021-03-10T15:39:45.763762+0000 mgr.gibba045.orlgmj (mgr.34412) 5875 : cluster [DBG] pgmap v3339: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:47.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:39:46 gibba045 bash[25517]: audit 2021-03-10T15:39:45.359808+0000 mgr.gibba045.orlgmj (mgr.34412) 5874 : audit [DBG] from='client.48000 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:39:47.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:39:46 gibba045 bash[25517]: cluster 2021-03-10T15:39:45.763762+0000 mgr.gibba045.orlgmj (mgr.34412) 5875 : cluster [DBG] pgmap v3339: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:48.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:39:47 gibba015 bash[29377]: cephadm 2021-03-10T15:39:46.288141+0000 mgr.gibba045.orlgmj (mgr.34412) 5876 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:39:48.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:39:47 gibba015 bash[30343]: cephadm 2021-03-10T15:39:46.288141+0000 mgr.gibba045.orlgmj (mgr.34412) 5876 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:39:48.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:39:47 gibba045 bash[25517]: cephadm 2021-03-10T15:39:46.288141+0000 mgr.gibba045.orlgmj (mgr.34412) 5876 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:39:49.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:39:48 gibba015 bash[29377]: cluster 2021-03-10T15:39:47.765298+0000 mgr.gibba045.orlgmj (mgr.34412) 5877 : cluster [DBG] pgmap v3340: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:49.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:39:48 gibba015 bash[30343]: cluster 2021-03-10T15:39:47.765298+0000 mgr.gibba045.orlgmj (mgr.34412) 5877 : cluster [DBG] pgmap v3340: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:49.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:39:48 gibba045 bash[25517]: cluster 2021-03-10T15:39:47.765298+0000 mgr.gibba045.orlgmj (mgr.34412) 5877 : cluster [DBG] pgmap v3340: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:50.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:39:50 gibba015 bash[30343]: cluster 2021-03-10T15:39:49.766960+0000 mgr.gibba045.orlgmj (mgr.34412) 5878 : cluster [DBG] pgmap v3341: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:50.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:39:50 gibba015 bash[29377]: cluster 2021-03-10T15:39:49.766960+0000 mgr.gibba045.orlgmj (mgr.34412) 5878 : cluster [DBG] pgmap v3341: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:51.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:39:50 gibba045 bash[25517]: cluster 2021-03-10T15:39:49.766960+0000 mgr.gibba045.orlgmj (mgr.34412) 5878 : cluster [DBG] pgmap v3341: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:53.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:39:52 gibba015 bash[29377]: cluster 2021-03-10T15:39:51.768754+0000 mgr.gibba045.orlgmj (mgr.34412) 5879 : cluster [DBG] pgmap v3342: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:53.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:39:52 gibba015 bash[30343]: cluster 2021-03-10T15:39:51.768754+0000 mgr.gibba045.orlgmj (mgr.34412) 5879 : cluster [DBG] pgmap v3342: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:53.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:39:52 gibba045 bash[25517]: cluster 2021-03-10T15:39:51.768754+0000 mgr.gibba045.orlgmj (mgr.34412) 5879 : cluster [DBG] pgmap v3342: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:39:53 gibba015 bash[29377]: audit 2021-03-10T15:39:53.221010+0000 mon.c (mon.1) 1645 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:39:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:39:53 gibba015 bash[29377]: audit 2021-03-10T15:39:53.221880+0000 mon.c (mon.1) 1646 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:39:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:39:53 gibba015 bash[29377]: audit 2021-03-10T15:39:53.222158+0000 mon.a (mon.0) 1481 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:39:54.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:39:53 gibba015 bash[29377]: audit 2021-03-10T15:39:53.222819+0000 mon.c (mon.1) 1647 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T15:39:54.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:39:53 gibba015 bash[29377]: audit 2021-03-10T15:39:53.223345+0000 mon.a (mon.0) 1482 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:39:54.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:39:53 gibba015 bash[29377]: audit 2021-03-10T15:39:53.223846+0000 mon.c (mon.1) 1648 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T15:39:54.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:39:53 gibba015 bash[29377]: audit 2021-03-10T15:39:53.224130+0000 mon.a (mon.0) 1483 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T15:39:54.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:39:53 gibba015 bash[29377]: audit 2021-03-10T15:39:53.225193+0000 mon.c (mon.1) 1649 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:39:54.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:39:53 gibba015 bash[29377]: audit 2021-03-10T15:39:53.225364+0000 mon.a (mon.0) 1484 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T15:39:54.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:39:53 gibba015 bash[29377]: audit 2021-03-10T15:39:53.226064+0000 mon.c (mon.1) 1650 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:39:54.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:39:53 gibba015 bash[29377]: audit 2021-03-10T15:39:53.226182+0000 mon.a (mon.0) 1485 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:39:54.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:39:53 gibba015 bash[29377]: audit 2021-03-10T15:39:53.226445+0000 mon.a (mon.0) 1486 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:39:54.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:39:53 gibba015 bash[30343]: audit 2021-03-10T15:39:53.221010+0000 mon.c (mon.1) 1645 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:39:54.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:39:53 gibba015 bash[30343]: audit 2021-03-10T15:39:53.221880+0000 mon.c (mon.1) 1646 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:39:54.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:39:53 gibba015 bash[30343]: audit 2021-03-10T15:39:53.222158+0000 mon.a (mon.0) 1481 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:39:54.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:39:53 gibba015 bash[30343]: audit 2021-03-10T15:39:53.222819+0000 mon.c (mon.1) 1647 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T15:39:54.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:39:53 gibba015 bash[30343]: audit 2021-03-10T15:39:53.223345+0000 mon.a (mon.0) 1482 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:39:54.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:39:53 gibba015 bash[30343]: audit 2021-03-10T15:39:53.223846+0000 mon.c (mon.1) 1648 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T15:39:54.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:39:53 gibba015 bash[30343]: audit 2021-03-10T15:39:53.224130+0000 mon.a (mon.0) 1483 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T15:39:54.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:39:53 gibba015 bash[30343]: audit 2021-03-10T15:39:53.225193+0000 mon.c (mon.1) 1649 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:39:54.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:39:53 gibba015 bash[30343]: audit 2021-03-10T15:39:53.225364+0000 mon.a (mon.0) 1484 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T15:39:54.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:39:53 gibba015 bash[30343]: audit 2021-03-10T15:39:53.226064+0000 mon.c (mon.1) 1650 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:39:54.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:39:53 gibba015 bash[30343]: audit 2021-03-10T15:39:53.226182+0000 mon.a (mon.0) 1485 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:39:54.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:39:53 gibba015 bash[30343]: audit 2021-03-10T15:39:53.226445+0000 mon.a (mon.0) 1486 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:39:54.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:39:53 gibba045 bash[25517]: audit 2021-03-10T15:39:53.221010+0000 mon.c (mon.1) 1645 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:39:54.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:39:53 gibba045 bash[25517]: audit 2021-03-10T15:39:53.221880+0000 mon.c (mon.1) 1646 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:39:54.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:39:53 gibba045 bash[25517]: audit 2021-03-10T15:39:53.222158+0000 mon.a (mon.0) 1481 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:39:54.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:39:53 gibba045 bash[25517]: audit 2021-03-10T15:39:53.222819+0000 mon.c (mon.1) 1647 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T15:39:54.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:39:53 gibba045 bash[25517]: audit 2021-03-10T15:39:53.223345+0000 mon.a (mon.0) 1482 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:39:54.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:39:53 gibba045 bash[25517]: audit 2021-03-10T15:39:53.223846+0000 mon.c (mon.1) 1648 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T15:39:54.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:39:53 gibba045 bash[25517]: audit 2021-03-10T15:39:53.224130+0000 mon.a (mon.0) 1483 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T15:39:54.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:39:53 gibba045 bash[25517]: audit 2021-03-10T15:39:53.225193+0000 mon.c (mon.1) 1649 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:39:54.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:39:53 gibba045 bash[25517]: audit 2021-03-10T15:39:53.225364+0000 mon.a (mon.0) 1484 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T15:39:54.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:39:53 gibba045 bash[25517]: audit 2021-03-10T15:39:53.226064+0000 mon.c (mon.1) 1650 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:39:54.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:39:53 gibba045 bash[25517]: audit 2021-03-10T15:39:53.226182+0000 mon.a (mon.0) 1485 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:39:54.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:39:53 gibba045 bash[25517]: audit 2021-03-10T15:39:53.226445+0000 mon.a (mon.0) 1486 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:39:55.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:39:54 gibba015 bash[29377]: cluster 2021-03-10T15:39:53.769906+0000 mgr.gibba045.orlgmj (mgr.34412) 5880 : cluster [DBG] pgmap v3343: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:55.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:39:54 gibba015 bash[30343]: cluster 2021-03-10T15:39:53.769906+0000 mgr.gibba045.orlgmj (mgr.34412) 5880 : cluster [DBG] pgmap v3343: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:55.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:39:54 gibba045 bash[25517]: cluster 2021-03-10T15:39:53.769906+0000 mgr.gibba045.orlgmj (mgr.34412) 5880 : cluster [DBG] pgmap v3343: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:57.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:39:56 gibba015 bash[29377]: cluster 2021-03-10T15:39:55.771378+0000 mgr.gibba045.orlgmj (mgr.34412) 5881 : cluster [DBG] pgmap v3344: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:57.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:39:56 gibba015 bash[30343]: cluster 2021-03-10T15:39:55.771378+0000 mgr.gibba045.orlgmj (mgr.34412) 5881 : cluster [DBG] pgmap v3344: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:57.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:39:56 gibba045 bash[25517]: cluster 2021-03-10T15:39:55.771378+0000 mgr.gibba045.orlgmj (mgr.34412) 5881 : cluster [DBG] pgmap v3344: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:59.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:39:58 gibba015 bash[29377]: cluster 2021-03-10T15:39:57.773031+0000 mgr.gibba045.orlgmj (mgr.34412) 5882 : cluster [DBG] pgmap v3345: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:59.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:39:58 gibba015 bash[30343]: cluster 2021-03-10T15:39:57.773031+0000 mgr.gibba045.orlgmj (mgr.34412) 5882 : cluster [DBG] pgmap v3345: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:59.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:39:58 gibba045 bash[25517]: cluster 2021-03-10T15:39:57.773031+0000 mgr.gibba045.orlgmj (mgr.34412) 5882 : cluster [DBG] pgmap v3345: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:00.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:40:00 gibba015 bash[29377]: debug 2021-03-10T15:39:59.993+0000 7f21beb4f700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T15:40:00.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:40:00 gibba015 bash[29377]: cluster 2021-03-10T15:39:59.774530+0000 mgr.gibba045.orlgmj (mgr.34412) 5883 : cluster [DBG] pgmap v3346: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:00.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:40:00 gibba015 bash[29377]: cluster 2021-03-10T15:40:00.000254+0000 mon.a (mon.0) 1487 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T15:40:00.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:40:00 gibba015 bash[30343]: cluster 2021-03-10T15:39:59.774530+0000 mgr.gibba045.orlgmj (mgr.34412) 5883 : cluster [DBG] pgmap v3346: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:00.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:40:00 gibba015 bash[30343]: cluster 2021-03-10T15:40:00.000254+0000 mon.a (mon.0) 1487 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T15:40:01.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:40:00 gibba045 bash[25517]: cluster 2021-03-10T15:39:59.774530+0000 mgr.gibba045.orlgmj (mgr.34412) 5883 : cluster [DBG] pgmap v3346: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:01.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:40:00 gibba045 bash[25517]: cluster 2021-03-10T15:40:00.000254+0000 mon.a (mon.0) 1487 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T15:40:03.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:40:02 gibba015 bash[29377]: cephadm 2021-03-10T15:40:01.304218+0000 mgr.gibba045.orlgmj (mgr.34412) 5884 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:40:03.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:40:02 gibba015 bash[29377]: cluster 2021-03-10T15:40:01.776299+0000 mgr.gibba045.orlgmj (mgr.34412) 5885 : cluster [DBG] pgmap v3347: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:03.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:40:02 gibba015 bash[30343]: cephadm 2021-03-10T15:40:01.304218+0000 mgr.gibba045.orlgmj (mgr.34412) 5884 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:40:03.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:40:02 gibba015 bash[30343]: cluster 2021-03-10T15:40:01.776299+0000 mgr.gibba045.orlgmj (mgr.34412) 5885 : cluster [DBG] pgmap v3347: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:03.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:40:02 gibba045 bash[25517]: cephadm 2021-03-10T15:40:01.304218+0000 mgr.gibba045.orlgmj (mgr.34412) 5884 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:40:03.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:40:02 gibba045 bash[25517]: cluster 2021-03-10T15:40:01.776299+0000 mgr.gibba045.orlgmj (mgr.34412) 5885 : cluster [DBG] pgmap v3347: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:05.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:40:04 gibba015 bash[29377]: cluster 2021-03-10T15:40:03.777901+0000 mgr.gibba045.orlgmj (mgr.34412) 5886 : cluster [DBG] pgmap v3348: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:05.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:40:04 gibba015 bash[30343]: cluster 2021-03-10T15:40:03.777901+0000 mgr.gibba045.orlgmj (mgr.34412) 5886 : cluster [DBG] pgmap v3348: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:05.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:40:04 gibba045 bash[25517]: cluster 2021-03-10T15:40:03.777901+0000 mgr.gibba045.orlgmj (mgr.34412) 5886 : cluster [DBG] pgmap v3348: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:07.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:40:06 gibba015 bash[29377]: cluster 2021-03-10T15:40:05.779682+0000 mgr.gibba045.orlgmj (mgr.34412) 5887 : cluster [DBG] pgmap v3349: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:07.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:40:06 gibba015 bash[30343]: cluster 2021-03-10T15:40:05.779682+0000 mgr.gibba045.orlgmj (mgr.34412) 5887 : cluster [DBG] pgmap v3349: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:07.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:40:06 gibba045 bash[25517]: cluster 2021-03-10T15:40:05.779682+0000 mgr.gibba045.orlgmj (mgr.34412) 5887 : cluster [DBG] pgmap v3349: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:09.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:40:08 gibba015 bash[29377]: cluster 2021-03-10T15:40:07.781349+0000 mgr.gibba045.orlgmj (mgr.34412) 5888 : cluster [DBG] pgmap v3350: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:09.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:40:08 gibba015 bash[30343]: cluster 2021-03-10T15:40:07.781349+0000 mgr.gibba045.orlgmj (mgr.34412) 5888 : cluster [DBG] pgmap v3350: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:09.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:40:08 gibba045 bash[25517]: cluster 2021-03-10T15:40:07.781349+0000 mgr.gibba045.orlgmj (mgr.34412) 5888 : cluster [DBG] pgmap v3350: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:10.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:40:10 gibba015 bash[29377]: cluster 2021-03-10T15:40:09.783145+0000 mgr.gibba045.orlgmj (mgr.34412) 5889 : cluster [DBG] pgmap v3351: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:10.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:40:10 gibba015 bash[30343]: cluster 2021-03-10T15:40:09.783145+0000 mgr.gibba045.orlgmj (mgr.34412) 5889 : cluster [DBG] pgmap v3351: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:11.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:40:10 gibba045 bash[25517]: cluster 2021-03-10T15:40:09.783145+0000 mgr.gibba045.orlgmj (mgr.34412) 5889 : cluster [DBG] pgmap v3351: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:13.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:40:12 gibba015 bash[29377]: cluster 2021-03-10T15:40:11.784989+0000 mgr.gibba045.orlgmj (mgr.34412) 5890 : cluster [DBG] pgmap v3352: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:13.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:40:12 gibba015 bash[30343]: cluster 2021-03-10T15:40:11.784989+0000 mgr.gibba045.orlgmj (mgr.34412) 5890 : cluster [DBG] pgmap v3352: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:13.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:40:12 gibba045 bash[25517]: cluster 2021-03-10T15:40:11.784989+0000 mgr.gibba045.orlgmj (mgr.34412) 5890 : cluster [DBG] pgmap v3352: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:15.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:40:14 gibba015 bash[29377]: cluster 2021-03-10T15:40:13.786627+0000 mgr.gibba045.orlgmj (mgr.34412) 5891 : cluster [DBG] pgmap v3353: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:15.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:40:14 gibba015 bash[30343]: cluster 2021-03-10T15:40:13.786627+0000 mgr.gibba045.orlgmj (mgr.34412) 5891 : cluster [DBG] pgmap v3353: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:15.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:40:14 gibba045 bash[25517]: cluster 2021-03-10T15:40:13.786627+0000 mgr.gibba045.orlgmj (mgr.34412) 5891 : cluster [DBG] pgmap v3353: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:15.864 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:40:16.089 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:40:16.090 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (110m) 5m ago 116m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:40:16.090 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (116m) 4m ago 116m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:40:16.090 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (111m) 4m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:40:16.091 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (111m) 4m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:40:16.091 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (110m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:40:16.091 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (110m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:40:16.091 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (110m) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:40:16.092 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (110m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:40:16.092 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (116m) 5m ago 116m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:40:16.092 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (116m) 4m ago 116m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:40:16.092 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (109m) 5m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:40:16.092 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (108m) 5m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:40:16.093 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (108m) 5m ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:40:16.093 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (108m) 5m ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:40:16.093 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (107m) 4m ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:40:16.093 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (107m) 4m ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:40:16.094 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (106m) 4m ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:40:16.094 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (106m) 4m ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:40:16.094 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (115m) 4m ago 116m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:40:16.094 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 4m ago 114m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:40:16.343 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:40:16.343 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:40:16.343 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:40:16.344 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:40:16.344 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:40:16.344 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:40:16.344 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:40:16.345 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:40:16.345 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:40:16.345 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:40:16.345 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:40:16.346 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:40:16.346 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:40:16.346 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:40:16.346 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:40:17.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:40:16 gibba015 bash[29377]: cluster 2021-03-10T15:40:15.788632+0000 mgr.gibba045.orlgmj (mgr.34412) 5892 : cluster [DBG] pgmap v3354: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:17.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:40:16 gibba015 bash[29377]: audit 2021-03-10T15:40:15.853938+0000 mgr.gibba045.orlgmj (mgr.34412) 5893 : audit [DBG] from='client.58000 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:40:17.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:40:16 gibba015 bash[29377]: audit 2021-03-10T15:40:16.079128+0000 mgr.gibba045.orlgmj (mgr.34412) 5894 : audit [DBG] from='client.58006 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:40:17.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:40:16 gibba015 bash[29377]: audit 2021-03-10T15:40:16.316896+0000 mon.c (mon.1) 1651 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:40:17.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:40:16 gibba015 bash[29377]: audit 2021-03-10T15:40:16.338048+0000 mon.a (mon.0) 1488 : audit [DBG] from='client.? 172.21.2.115:0/772605634' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:40:17.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:40:16 gibba015 bash[29377]: audit 2021-03-10T15:40:16.539600+0000 mon.a (mon.0) 1489 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:40:17.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:40:16 gibba015 bash[29377]: audit 2021-03-10T15:40:16.543324+0000 mon.c (mon.1) 1652 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:40:17.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:40:16 gibba015 bash[29377]: audit 2021-03-10T15:40:16.546075+0000 mon.c (mon.1) 1653 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:40:17.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:40:16 gibba015 bash[29377]: audit 2021-03-10T15:40:16.548667+0000 mon.c (mon.1) 1654 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:40:17.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:40:16 gibba015 bash[29377]: audit 2021-03-10T15:40:16.550994+0000 mon.c (mon.1) 1655 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:40:17.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:40:16 gibba015 bash[29377]: audit 2021-03-10T15:40:16.557208+0000 mon.c (mon.1) 1656 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:40:17.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:40:16 gibba015 bash[29377]: audit 2021-03-10T15:40:16.559953+0000 mon.c (mon.1) 1657 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:40:17.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:40:16 gibba015 bash[30343]: cluster 2021-03-10T15:40:15.788632+0000 mgr.gibba045.orlgmj (mgr.34412) 5892 : cluster [DBG] pgmap v3354: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:17.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:40:16 gibba015 bash[30343]: audit 2021-03-10T15:40:15.853938+0000 mgr.gibba045.orlgmj (mgr.34412) 5893 : audit [DBG] from='client.58000 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:40:17.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:40:16 gibba015 bash[30343]: audit 2021-03-10T15:40:16.079128+0000 mgr.gibba045.orlgmj (mgr.34412) 5894 : audit [DBG] from='client.58006 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:40:17.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:40:16 gibba015 bash[30343]: audit 2021-03-10T15:40:16.316896+0000 mon.c (mon.1) 1651 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:40:17.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:40:16 gibba015 bash[30343]: audit 2021-03-10T15:40:16.338048+0000 mon.a (mon.0) 1488 : audit [DBG] from='client.? 172.21.2.115:0/772605634' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:40:17.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:40:16 gibba015 bash[30343]: audit 2021-03-10T15:40:16.539600+0000 mon.a (mon.0) 1489 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:40:17.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:40:16 gibba015 bash[30343]: audit 2021-03-10T15:40:16.543324+0000 mon.c (mon.1) 1652 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:40:17.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:40:16 gibba015 bash[30343]: audit 2021-03-10T15:40:16.546075+0000 mon.c (mon.1) 1653 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:40:17.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:40:16 gibba015 bash[30343]: audit 2021-03-10T15:40:16.548667+0000 mon.c (mon.1) 1654 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:40:17.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:40:16 gibba015 bash[30343]: audit 2021-03-10T15:40:16.550994+0000 mon.c (mon.1) 1655 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:40:17.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:40:16 gibba015 bash[30343]: audit 2021-03-10T15:40:16.557208+0000 mon.c (mon.1) 1656 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:40:17.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:40:16 gibba015 bash[30343]: audit 2021-03-10T15:40:16.559953+0000 mon.c (mon.1) 1657 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:40:17.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:40:16 gibba045 bash[25517]: cluster 2021-03-10T15:40:15.788632+0000 mgr.gibba045.orlgmj (mgr.34412) 5892 : cluster [DBG] pgmap v3354: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:17.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:40:16 gibba045 bash[25517]: audit 2021-03-10T15:40:15.853938+0000 mgr.gibba045.orlgmj (mgr.34412) 5893 : audit [DBG] from='client.58000 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:40:17.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:40:16 gibba045 bash[25517]: audit 2021-03-10T15:40:16.079128+0000 mgr.gibba045.orlgmj (mgr.34412) 5894 : audit [DBG] from='client.58006 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:40:17.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:40:16 gibba045 bash[25517]: audit 2021-03-10T15:40:16.316896+0000 mon.c (mon.1) 1651 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:40:17.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:40:16 gibba045 bash[25517]: audit 2021-03-10T15:40:16.338048+0000 mon.a (mon.0) 1488 : audit [DBG] from='client.? 172.21.2.115:0/772605634' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:40:17.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:40:16 gibba045 bash[25517]: audit 2021-03-10T15:40:16.539600+0000 mon.a (mon.0) 1489 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:40:17.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:40:16 gibba045 bash[25517]: audit 2021-03-10T15:40:16.543324+0000 mon.c (mon.1) 1652 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:40:17.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:40:16 gibba045 bash[25517]: audit 2021-03-10T15:40:16.546075+0000 mon.c (mon.1) 1653 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:40:17.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:40:16 gibba045 bash[25517]: audit 2021-03-10T15:40:16.548667+0000 mon.c (mon.1) 1654 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:40:17.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:40:16 gibba045 bash[25517]: audit 2021-03-10T15:40:16.550994+0000 mon.c (mon.1) 1655 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:40:17.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:40:16 gibba045 bash[25517]: audit 2021-03-10T15:40:16.557208+0000 mon.c (mon.1) 1656 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:40:17.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:40:16 gibba045 bash[25517]: audit 2021-03-10T15:40:16.559953+0000 mon.c (mon.1) 1657 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:40:18.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:40:17 gibba015 bash[29377]: cephadm 2021-03-10T15:40:16.324599+0000 mgr.gibba045.orlgmj (mgr.34412) 5895 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:40:18.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:40:17 gibba015 bash[29377]: cephadm 2021-03-10T15:40:16.326412+0000 mgr.gibba045.orlgmj (mgr.34412) 5896 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:40:18.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:40:17 gibba015 bash[29377]: cephadm 2021-03-10T15:40:16.545924+0000 mgr.gibba045.orlgmj (mgr.34412) 5897 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:40:18.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:40:17 gibba015 bash[29377]: cephadm 2021-03-10T15:40:16.548968+0000 mgr.gibba045.orlgmj (mgr.34412) 5898 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:40:18.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:40:17 gibba015 bash[29377]: cephadm 2021-03-10T15:40:16.551550+0000 mgr.gibba045.orlgmj (mgr.34412) 5899 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:40:18.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:40:17 gibba015 bash[29377]: cephadm 2021-03-10T15:40:16.551586+0000 mgr.gibba045.orlgmj (mgr.34412) 5900 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:40:18.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:40:17 gibba015 bash[29377]: cephadm 2021-03-10T15:40:16.553949+0000 mgr.gibba045.orlgmj (mgr.34412) 5901 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:40:18.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:40:17 gibba015 bash[29377]: cephadm 2021-03-10T15:40:16.553985+0000 mgr.gibba045.orlgmj (mgr.34412) 5902 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:40:18.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:40:17 gibba015 bash[29377]: cephadm 2021-03-10T15:40:16.556263+0000 mgr.gibba045.orlgmj (mgr.34412) 5903 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:40:18.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:40:17 gibba015 bash[29377]: cephadm 2021-03-10T15:40:16.559973+0000 mgr.gibba045.orlgmj (mgr.34412) 5904 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:40:18.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:40:17 gibba015 bash[29377]: cephadm 2021-03-10T15:40:16.560009+0000 mgr.gibba045.orlgmj (mgr.34412) 5905 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:40:18.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:40:17 gibba015 bash[29377]: cephadm 2021-03-10T15:40:16.562408+0000 mgr.gibba045.orlgmj (mgr.34412) 5906 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:40:18.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:40:17 gibba015 bash[29377]: cephadm 2021-03-10T15:40:16.562955+0000 mgr.gibba045.orlgmj (mgr.34412) 5907 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:40:18.230 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:40:17 gibba015 bash[29377]: cephadm 2021-03-10T15:40:16.564977+0000 mgr.gibba045.orlgmj (mgr.34412) 5908 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:40:18.230 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:40:17 gibba015 bash[29377]: cephadm 2021-03-10T15:40:16.565016+0000 mgr.gibba045.orlgmj (mgr.34412) 5909 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:40:18.230 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:40:17 gibba015 bash[29377]: cephadm 2021-03-10T15:40:16.565131+0000 mgr.gibba045.orlgmj (mgr.34412) 5910 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:40:18.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:40:17 gibba015 bash[30343]: cephadm 2021-03-10T15:40:16.324599+0000 mgr.gibba045.orlgmj (mgr.34412) 5895 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:40:18.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:40:17 gibba015 bash[30343]: cephadm 2021-03-10T15:40:16.326412+0000 mgr.gibba045.orlgmj (mgr.34412) 5896 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:40:18.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:40:17 gibba015 bash[30343]: cephadm 2021-03-10T15:40:16.545924+0000 mgr.gibba045.orlgmj (mgr.34412) 5897 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:40:18.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:40:17 gibba015 bash[30343]: cephadm 2021-03-10T15:40:16.548968+0000 mgr.gibba045.orlgmj (mgr.34412) 5898 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:40:18.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:40:17 gibba015 bash[30343]: cephadm 2021-03-10T15:40:16.551550+0000 mgr.gibba045.orlgmj (mgr.34412) 5899 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:40:18.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:40:17 gibba015 bash[30343]: cephadm 2021-03-10T15:40:16.551586+0000 mgr.gibba045.orlgmj (mgr.34412) 5900 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:40:18.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:40:17 gibba015 bash[30343]: cephadm 2021-03-10T15:40:16.553949+0000 mgr.gibba045.orlgmj (mgr.34412) 5901 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:40:18.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:40:17 gibba015 bash[30343]: cephadm 2021-03-10T15:40:16.553985+0000 mgr.gibba045.orlgmj (mgr.34412) 5902 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:40:18.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:40:17 gibba015 bash[30343]: cephadm 2021-03-10T15:40:16.556263+0000 mgr.gibba045.orlgmj (mgr.34412) 5903 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:40:18.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:40:17 gibba015 bash[30343]: cephadm 2021-03-10T15:40:16.559973+0000 mgr.gibba045.orlgmj (mgr.34412) 5904 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:40:18.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:40:17 gibba015 bash[30343]: cephadm 2021-03-10T15:40:16.560009+0000 mgr.gibba045.orlgmj (mgr.34412) 5905 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:40:18.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:40:17 gibba015 bash[30343]: cephadm 2021-03-10T15:40:16.562408+0000 mgr.gibba045.orlgmj (mgr.34412) 5906 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:40:18.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:40:17 gibba015 bash[30343]: cephadm 2021-03-10T15:40:16.562955+0000 mgr.gibba045.orlgmj (mgr.34412) 5907 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:40:18.234 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:40:17 gibba015 bash[30343]: cephadm 2021-03-10T15:40:16.564977+0000 mgr.gibba045.orlgmj (mgr.34412) 5908 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:40:18.234 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:40:17 gibba015 bash[30343]: cephadm 2021-03-10T15:40:16.565016+0000 mgr.gibba045.orlgmj (mgr.34412) 5909 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:40:18.234 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:40:17 gibba015 bash[30343]: cephadm 2021-03-10T15:40:16.565131+0000 mgr.gibba045.orlgmj (mgr.34412) 5910 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:40:18.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:40:17 gibba045 bash[25517]: cephadm 2021-03-10T15:40:16.324599+0000 mgr.gibba045.orlgmj (mgr.34412) 5895 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:40:18.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:40:17 gibba045 bash[25517]: cephadm 2021-03-10T15:40:16.326412+0000 mgr.gibba045.orlgmj (mgr.34412) 5896 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:40:18.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:40:17 gibba045 bash[25517]: cephadm 2021-03-10T15:40:16.545924+0000 mgr.gibba045.orlgmj (mgr.34412) 5897 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:40:18.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:40:17 gibba045 bash[25517]: cephadm 2021-03-10T15:40:16.548968+0000 mgr.gibba045.orlgmj (mgr.34412) 5898 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:40:18.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:40:17 gibba045 bash[25517]: cephadm 2021-03-10T15:40:16.551550+0000 mgr.gibba045.orlgmj (mgr.34412) 5899 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:40:18.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:40:17 gibba045 bash[25517]: cephadm 2021-03-10T15:40:16.551586+0000 mgr.gibba045.orlgmj (mgr.34412) 5900 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:40:18.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:40:17 gibba045 bash[25517]: cephadm 2021-03-10T15:40:16.553949+0000 mgr.gibba045.orlgmj (mgr.34412) 5901 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:40:18.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:40:17 gibba045 bash[25517]: cephadm 2021-03-10T15:40:16.553985+0000 mgr.gibba045.orlgmj (mgr.34412) 5902 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:40:18.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:40:17 gibba045 bash[25517]: cephadm 2021-03-10T15:40:16.556263+0000 mgr.gibba045.orlgmj (mgr.34412) 5903 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:40:18.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:40:17 gibba045 bash[25517]: cephadm 2021-03-10T15:40:16.559973+0000 mgr.gibba045.orlgmj (mgr.34412) 5904 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:40:18.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:40:17 gibba045 bash[25517]: cephadm 2021-03-10T15:40:16.560009+0000 mgr.gibba045.orlgmj (mgr.34412) 5905 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:40:18.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:40:17 gibba045 bash[25517]: cephadm 2021-03-10T15:40:16.562408+0000 mgr.gibba045.orlgmj (mgr.34412) 5906 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:40:18.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:40:17 gibba045 bash[25517]: cephadm 2021-03-10T15:40:16.562955+0000 mgr.gibba045.orlgmj (mgr.34412) 5907 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:40:18.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:40:17 gibba045 bash[25517]: cephadm 2021-03-10T15:40:16.564977+0000 mgr.gibba045.orlgmj (mgr.34412) 5908 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:40:18.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:40:17 gibba045 bash[25517]: cephadm 2021-03-10T15:40:16.565016+0000 mgr.gibba045.orlgmj (mgr.34412) 5909 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:40:18.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:40:17 gibba045 bash[25517]: cephadm 2021-03-10T15:40:16.565131+0000 mgr.gibba045.orlgmj (mgr.34412) 5910 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:40:19.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:40:18 gibba015 bash[29377]: cluster 2021-03-10T15:40:17.790260+0000 mgr.gibba045.orlgmj (mgr.34412) 5911 : cluster [DBG] pgmap v3355: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:19.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:40:18 gibba015 bash[30343]: cluster 2021-03-10T15:40:17.790260+0000 mgr.gibba045.orlgmj (mgr.34412) 5911 : cluster [DBG] pgmap v3355: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:19.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:40:18 gibba045 bash[25517]: cluster 2021-03-10T15:40:17.790260+0000 mgr.gibba045.orlgmj (mgr.34412) 5911 : cluster [DBG] pgmap v3355: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:20.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:40:20 gibba015 bash[29377]: cluster 2021-03-10T15:40:19.791938+0000 mgr.gibba045.orlgmj (mgr.34412) 5912 : cluster [DBG] pgmap v3356: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:20.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:40:20 gibba015 bash[30343]: cluster 2021-03-10T15:40:19.791938+0000 mgr.gibba045.orlgmj (mgr.34412) 5912 : cluster [DBG] pgmap v3356: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:21.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:40:20 gibba045 bash[25517]: cluster 2021-03-10T15:40:19.791938+0000 mgr.gibba045.orlgmj (mgr.34412) 5912 : cluster [DBG] pgmap v3356: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:23.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:40:22 gibba015 bash[29377]: cluster 2021-03-10T15:40:21.793771+0000 mgr.gibba045.orlgmj (mgr.34412) 5913 : cluster [DBG] pgmap v3357: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:23.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:40:22 gibba015 bash[30343]: cluster 2021-03-10T15:40:21.793771+0000 mgr.gibba045.orlgmj (mgr.34412) 5913 : cluster [DBG] pgmap v3357: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:23.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:40:22 gibba045 bash[25517]: cluster 2021-03-10T15:40:21.793771+0000 mgr.gibba045.orlgmj (mgr.34412) 5913 : cluster [DBG] pgmap v3357: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:25.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:40:24 gibba015 bash[29377]: cluster 2021-03-10T15:40:23.795284+0000 mgr.gibba045.orlgmj (mgr.34412) 5914 : cluster [DBG] pgmap v3358: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:25.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:40:24 gibba015 bash[30343]: cluster 2021-03-10T15:40:23.795284+0000 mgr.gibba045.orlgmj (mgr.34412) 5914 : cluster [DBG] pgmap v3358: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:25.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:40:24 gibba045 bash[25517]: cluster 2021-03-10T15:40:23.795284+0000 mgr.gibba045.orlgmj (mgr.34412) 5914 : cluster [DBG] pgmap v3358: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:27.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:40:26 gibba015 bash[29377]: cluster 2021-03-10T15:40:25.797099+0000 mgr.gibba045.orlgmj (mgr.34412) 5915 : cluster [DBG] pgmap v3359: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:27.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:40:26 gibba015 bash[30343]: cluster 2021-03-10T15:40:25.797099+0000 mgr.gibba045.orlgmj (mgr.34412) 5915 : cluster [DBG] pgmap v3359: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:27.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:40:26 gibba045 bash[25517]: cluster 2021-03-10T15:40:25.797099+0000 mgr.gibba045.orlgmj (mgr.34412) 5915 : cluster [DBG] pgmap v3359: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:29.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:40:28 gibba015 bash[29377]: cluster 2021-03-10T15:40:27.798753+0000 mgr.gibba045.orlgmj (mgr.34412) 5916 : cluster [DBG] pgmap v3360: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:29.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:40:28 gibba015 bash[30343]: cluster 2021-03-10T15:40:27.798753+0000 mgr.gibba045.orlgmj (mgr.34412) 5916 : cluster [DBG] pgmap v3360: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:29.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:40:28 gibba045 bash[25517]: cluster 2021-03-10T15:40:27.798753+0000 mgr.gibba045.orlgmj (mgr.34412) 5916 : cluster [DBG] pgmap v3360: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:30.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:40:30 gibba015 bash[30343]: cluster 2021-03-10T15:40:29.800325+0000 mgr.gibba045.orlgmj (mgr.34412) 5917 : cluster [DBG] pgmap v3361: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:30.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:40:30 gibba015 bash[29377]: cluster 2021-03-10T15:40:29.800325+0000 mgr.gibba045.orlgmj (mgr.34412) 5917 : cluster [DBG] pgmap v3361: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:31.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:40:30 gibba045 bash[25517]: cluster 2021-03-10T15:40:29.800325+0000 mgr.gibba045.orlgmj (mgr.34412) 5917 : cluster [DBG] pgmap v3361: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:33.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:40:32 gibba015 bash[29377]: cephadm 2021-03-10T15:40:31.581201+0000 mgr.gibba045.orlgmj (mgr.34412) 5918 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:40:33.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:40:32 gibba015 bash[29377]: cluster 2021-03-10T15:40:31.801885+0000 mgr.gibba045.orlgmj (mgr.34412) 5919 : cluster [DBG] pgmap v3362: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:33.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:40:32 gibba015 bash[30343]: cephadm 2021-03-10T15:40:31.581201+0000 mgr.gibba045.orlgmj (mgr.34412) 5918 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:40:33.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:40:32 gibba015 bash[30343]: cluster 2021-03-10T15:40:31.801885+0000 mgr.gibba045.orlgmj (mgr.34412) 5919 : cluster [DBG] pgmap v3362: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:33.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:40:32 gibba045 bash[25517]: cephadm 2021-03-10T15:40:31.581201+0000 mgr.gibba045.orlgmj (mgr.34412) 5918 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:40:33.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:40:32 gibba045 bash[25517]: cluster 2021-03-10T15:40:31.801885+0000 mgr.gibba045.orlgmj (mgr.34412) 5919 : cluster [DBG] pgmap v3362: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:35.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:40:34 gibba015 bash[29377]: cluster 2021-03-10T15:40:33.802401+0000 mgr.gibba045.orlgmj (mgr.34412) 5920 : cluster [DBG] pgmap v3363: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:35.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:40:34 gibba015 bash[30343]: cluster 2021-03-10T15:40:33.802401+0000 mgr.gibba045.orlgmj (mgr.34412) 5920 : cluster [DBG] pgmap v3363: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:35.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:40:34 gibba045 bash[25517]: cluster 2021-03-10T15:40:33.802401+0000 mgr.gibba045.orlgmj (mgr.34412) 5920 : cluster [DBG] pgmap v3363: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:37.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:40:36 gibba015 bash[29377]: cluster 2021-03-10T15:40:35.804001+0000 mgr.gibba045.orlgmj (mgr.34412) 5921 : cluster [DBG] pgmap v3364: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:37.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:40:36 gibba015 bash[30343]: cluster 2021-03-10T15:40:35.804001+0000 mgr.gibba045.orlgmj (mgr.34412) 5921 : cluster [DBG] pgmap v3364: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:37.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:40:36 gibba045 bash[25517]: cluster 2021-03-10T15:40:35.804001+0000 mgr.gibba045.orlgmj (mgr.34412) 5921 : cluster [DBG] pgmap v3364: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:39.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:40:38 gibba015 bash[29377]: cluster 2021-03-10T15:40:37.805549+0000 mgr.gibba045.orlgmj (mgr.34412) 5922 : cluster [DBG] pgmap v3365: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:39.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:40:38 gibba015 bash[30343]: cluster 2021-03-10T15:40:37.805549+0000 mgr.gibba045.orlgmj (mgr.34412) 5922 : cluster [DBG] pgmap v3365: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:39.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:40:38 gibba045 bash[25517]: cluster 2021-03-10T15:40:37.805549+0000 mgr.gibba045.orlgmj (mgr.34412) 5922 : cluster [DBG] pgmap v3365: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:40.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:40:40 gibba015 bash[29377]: cluster 2021-03-10T15:40:39.807085+0000 mgr.gibba045.orlgmj (mgr.34412) 5923 : cluster [DBG] pgmap v3366: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:40.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:40:40 gibba015 bash[30343]: cluster 2021-03-10T15:40:39.807085+0000 mgr.gibba045.orlgmj (mgr.34412) 5923 : cluster [DBG] pgmap v3366: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:41.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:40:40 gibba045 bash[25517]: cluster 2021-03-10T15:40:39.807085+0000 mgr.gibba045.orlgmj (mgr.34412) 5923 : cluster [DBG] pgmap v3366: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:43.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:40:42 gibba015 bash[29377]: cluster 2021-03-10T15:40:41.808654+0000 mgr.gibba045.orlgmj (mgr.34412) 5924 : cluster [DBG] pgmap v3367: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:43.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:40:42 gibba015 bash[30343]: cluster 2021-03-10T15:40:41.808654+0000 mgr.gibba045.orlgmj (mgr.34412) 5924 : cluster [DBG] pgmap v3367: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:43.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:40:42 gibba045 bash[25517]: cluster 2021-03-10T15:40:41.808654+0000 mgr.gibba045.orlgmj (mgr.34412) 5924 : cluster [DBG] pgmap v3367: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:45.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:40:44 gibba015 bash[29377]: cluster 2021-03-10T15:40:43.809263+0000 mgr.gibba045.orlgmj (mgr.34412) 5925 : cluster [DBG] pgmap v3368: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:45.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:40:44 gibba015 bash[30343]: cluster 2021-03-10T15:40:43.809263+0000 mgr.gibba045.orlgmj (mgr.34412) 5925 : cluster [DBG] pgmap v3368: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:45.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:40:44 gibba045 bash[25517]: cluster 2021-03-10T15:40:43.809263+0000 mgr.gibba045.orlgmj (mgr.34412) 5925 : cluster [DBG] pgmap v3368: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:46.586 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:40:46.816 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:40:46.816 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (111m) 5m ago 116m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:40:46.816 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (116m) 4m ago 116m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:40:46.817 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (111m) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:40:46.817 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (112m) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:40:46.817 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (111m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:40:46.817 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (111m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:40:46.818 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (110m) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:40:46.818 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (110m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:40:46.818 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (116m) 5m ago 117m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:40:46.818 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (117m) 4m ago 117m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:40:46.818 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (109m) 5m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:40:46.819 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (109m) 5m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:40:46.819 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (108m) 5m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:40:46.819 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (108m) 5m ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:40:46.819 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (108m) 4m ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:40:46.820 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (107m) 4m ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:40:46.820 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (107m) 4m ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:40:46.820 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (106m) 4m ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:40:46.820 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (116m) 4m ago 117m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:40:46.820 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 4m ago 115m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:40:47.067 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:40:47.067 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:40:47.067 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:40:47.068 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:40:47.068 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:40:47.068 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:40:47.068 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:40:47.068 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:40:47.069 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:40:47.069 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:40:47.069 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:40:47.069 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:40:47.070 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:40:47.070 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:40:47.070 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:40:47.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:40:46 gibba015 bash[29377]: cluster 2021-03-10T15:40:45.810792+0000 mgr.gibba045.orlgmj (mgr.34412) 5926 : cluster [DBG] pgmap v3369: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:47.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:40:46 gibba015 bash[30343]: cluster 2021-03-10T15:40:45.810792+0000 mgr.gibba045.orlgmj (mgr.34412) 5926 : cluster [DBG] pgmap v3369: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:47.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:40:46 gibba045 bash[25517]: cluster 2021-03-10T15:40:45.810792+0000 mgr.gibba045.orlgmj (mgr.34412) 5926 : cluster [DBG] pgmap v3369: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:48.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:40:47 gibba015 bash[29377]: audit 2021-03-10T15:40:46.575706+0000 mgr.gibba045.orlgmj (mgr.34412) 5927 : audit [DBG] from='client.48030 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:40:48.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:40:47 gibba015 bash[29377]: cephadm 2021-03-10T15:40:46.597170+0000 mgr.gibba045.orlgmj (mgr.34412) 5928 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:40:48.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:40:47 gibba015 bash[29377]: audit 2021-03-10T15:40:46.801853+0000 mgr.gibba045.orlgmj (mgr.34412) 5929 : audit [DBG] from='client.58024 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:40:48.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:40:47 gibba015 bash[29377]: audit 2021-03-10T15:40:47.061995+0000 mon.a (mon.0) 1490 : audit [DBG] from='client.? 172.21.2.115:0/4219136519' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:40:48.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:40:47 gibba015 bash[30343]: audit 2021-03-10T15:40:46.575706+0000 mgr.gibba045.orlgmj (mgr.34412) 5927 : audit [DBG] from='client.48030 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:40:48.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:40:47 gibba015 bash[30343]: cephadm 2021-03-10T15:40:46.597170+0000 mgr.gibba045.orlgmj (mgr.34412) 5928 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:40:48.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:40:47 gibba015 bash[30343]: audit 2021-03-10T15:40:46.801853+0000 mgr.gibba045.orlgmj (mgr.34412) 5929 : audit [DBG] from='client.58024 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:40:48.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:40:47 gibba015 bash[30343]: audit 2021-03-10T15:40:47.061995+0000 mon.a (mon.0) 1490 : audit [DBG] from='client.? 172.21.2.115:0/4219136519' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:40:48.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:40:47 gibba045 bash[25517]: audit 2021-03-10T15:40:46.575706+0000 mgr.gibba045.orlgmj (mgr.34412) 5927 : audit [DBG] from='client.48030 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:40:48.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:40:47 gibba045 bash[25517]: cephadm 2021-03-10T15:40:46.597170+0000 mgr.gibba045.orlgmj (mgr.34412) 5928 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:40:48.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:40:47 gibba045 bash[25517]: audit 2021-03-10T15:40:46.801853+0000 mgr.gibba045.orlgmj (mgr.34412) 5929 : audit [DBG] from='client.58024 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:40:48.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:40:47 gibba045 bash[25517]: audit 2021-03-10T15:40:47.061995+0000 mon.a (mon.0) 1490 : audit [DBG] from='client.? 172.21.2.115:0/4219136519' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:40:49.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:40:48 gibba015 bash[29377]: cluster 2021-03-10T15:40:47.812518+0000 mgr.gibba045.orlgmj (mgr.34412) 5930 : cluster [DBG] pgmap v3370: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:49.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:40:48 gibba015 bash[30343]: cluster 2021-03-10T15:40:47.812518+0000 mgr.gibba045.orlgmj (mgr.34412) 5930 : cluster [DBG] pgmap v3370: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:49.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:40:48 gibba045 bash[25517]: cluster 2021-03-10T15:40:47.812518+0000 mgr.gibba045.orlgmj (mgr.34412) 5930 : cluster [DBG] pgmap v3370: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:50.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:40:50 gibba015 bash[29377]: cluster 2021-03-10T15:40:49.814182+0000 mgr.gibba045.orlgmj (mgr.34412) 5931 : cluster [DBG] pgmap v3371: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:50.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:40:50 gibba015 bash[30343]: cluster 2021-03-10T15:40:49.814182+0000 mgr.gibba045.orlgmj (mgr.34412) 5931 : cluster [DBG] pgmap v3371: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:51.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:40:50 gibba045 bash[25517]: cluster 2021-03-10T15:40:49.814182+0000 mgr.gibba045.orlgmj (mgr.34412) 5931 : cluster [DBG] pgmap v3371: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:53.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:40:52 gibba015 bash[29377]: cluster 2021-03-10T15:40:51.815930+0000 mgr.gibba045.orlgmj (mgr.34412) 5932 : cluster [DBG] pgmap v3372: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:53.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:40:52 gibba015 bash[30343]: cluster 2021-03-10T15:40:51.815930+0000 mgr.gibba045.orlgmj (mgr.34412) 5932 : cluster [DBG] pgmap v3372: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:53.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:40:52 gibba045 bash[25517]: cluster 2021-03-10T15:40:51.815930+0000 mgr.gibba045.orlgmj (mgr.34412) 5932 : cluster [DBG] pgmap v3372: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:40:53 gibba015 bash[29377]: audit 2021-03-10T15:40:53.229546+0000 mon.c (mon.1) 1658 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:40:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:40:53 gibba015 bash[29377]: audit 2021-03-10T15:40:53.230527+0000 mon.c (mon.1) 1659 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:40:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:40:53 gibba015 bash[29377]: audit 2021-03-10T15:40:53.230790+0000 mon.a (mon.0) 1491 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:40:54.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:40:53 gibba015 bash[29377]: audit 2021-03-10T15:40:53.231468+0000 mon.c (mon.1) 1660 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T15:40:54.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:40:53 gibba015 bash[29377]: audit 2021-03-10T15:40:53.231998+0000 mon.a (mon.0) 1492 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:40:54.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:40:53 gibba015 bash[29377]: audit 2021-03-10T15:40:53.232654+0000 mon.c (mon.1) 1661 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:40:54.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:40:53 gibba015 bash[29377]: audit 2021-03-10T15:40:53.232985+0000 mon.a (mon.0) 1493 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T15:40:54.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:40:53 gibba015 bash[29377]: audit 2021-03-10T15:40:53.233900+0000 mon.c (mon.1) 1662 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:40:54.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:40:53 gibba015 bash[29377]: audit 2021-03-10T15:40:53.234054+0000 mon.a (mon.0) 1494 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:40:54.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:40:53 gibba015 bash[29377]: audit 2021-03-10T15:40:53.234760+0000 mon.c (mon.1) 1663 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:40:54.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:40:53 gibba015 bash[29377]: audit 2021-03-10T15:40:53.234763+0000 mon.a (mon.0) 1495 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:40:54.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:40:53 gibba015 bash[29377]: audit 2021-03-10T15:40:53.235008+0000 mon.a (mon.0) 1496 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:40:54.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:40:53 gibba015 bash[30343]: audit 2021-03-10T15:40:53.229546+0000 mon.c (mon.1) 1658 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:40:54.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:40:53 gibba015 bash[30343]: audit 2021-03-10T15:40:53.230527+0000 mon.c (mon.1) 1659 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:40:54.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:40:53 gibba015 bash[30343]: audit 2021-03-10T15:40:53.230790+0000 mon.a (mon.0) 1491 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:40:54.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:40:53 gibba015 bash[30343]: audit 2021-03-10T15:40:53.231468+0000 mon.c (mon.1) 1660 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T15:40:54.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:40:53 gibba015 bash[30343]: audit 2021-03-10T15:40:53.231998+0000 mon.a (mon.0) 1492 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:40:54.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:40:53 gibba015 bash[30343]: audit 2021-03-10T15:40:53.232654+0000 mon.c (mon.1) 1661 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:40:54.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:40:53 gibba015 bash[30343]: audit 2021-03-10T15:40:53.232985+0000 mon.a (mon.0) 1493 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T15:40:54.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:40:53 gibba015 bash[30343]: audit 2021-03-10T15:40:53.233900+0000 mon.c (mon.1) 1662 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:40:54.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:40:53 gibba015 bash[30343]: audit 2021-03-10T15:40:53.234054+0000 mon.a (mon.0) 1494 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:40:54.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:40:53 gibba015 bash[30343]: audit 2021-03-10T15:40:53.234760+0000 mon.c (mon.1) 1663 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:40:54.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:40:53 gibba015 bash[30343]: audit 2021-03-10T15:40:53.234763+0000 mon.a (mon.0) 1495 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:40:54.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:40:53 gibba015 bash[30343]: audit 2021-03-10T15:40:53.235008+0000 mon.a (mon.0) 1496 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:40:54.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:40:53 gibba045 bash[25517]: audit 2021-03-10T15:40:53.229546+0000 mon.c (mon.1) 1658 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:40:54.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:40:53 gibba045 bash[25517]: audit 2021-03-10T15:40:53.230527+0000 mon.c (mon.1) 1659 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:40:54.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:40:53 gibba045 bash[25517]: audit 2021-03-10T15:40:53.230790+0000 mon.a (mon.0) 1491 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:40:54.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:40:53 gibba045 bash[25517]: audit 2021-03-10T15:40:53.231468+0000 mon.c (mon.1) 1660 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T15:40:54.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:40:53 gibba045 bash[25517]: audit 2021-03-10T15:40:53.231998+0000 mon.a (mon.0) 1492 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:40:54.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:40:53 gibba045 bash[25517]: audit 2021-03-10T15:40:53.232654+0000 mon.c (mon.1) 1661 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:40:54.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:40:53 gibba045 bash[25517]: audit 2021-03-10T15:40:53.232985+0000 mon.a (mon.0) 1493 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T15:40:54.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:40:53 gibba045 bash[25517]: audit 2021-03-10T15:40:53.233900+0000 mon.c (mon.1) 1662 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:40:54.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:40:53 gibba045 bash[25517]: audit 2021-03-10T15:40:53.234054+0000 mon.a (mon.0) 1494 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:40:54.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:40:53 gibba045 bash[25517]: audit 2021-03-10T15:40:53.234760+0000 mon.c (mon.1) 1663 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:40:54.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:40:53 gibba045 bash[25517]: audit 2021-03-10T15:40:53.234763+0000 mon.a (mon.0) 1495 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:40:54.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:40:53 gibba045 bash[25517]: audit 2021-03-10T15:40:53.235008+0000 mon.a (mon.0) 1496 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:40:55.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:40:54 gibba015 bash[29377]: cluster 2021-03-10T15:40:53.817168+0000 mgr.gibba045.orlgmj (mgr.34412) 5933 : cluster [DBG] pgmap v3373: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:55.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:40:54 gibba015 bash[30343]: cluster 2021-03-10T15:40:53.817168+0000 mgr.gibba045.orlgmj (mgr.34412) 5933 : cluster [DBG] pgmap v3373: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:55.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:40:54 gibba045 bash[25517]: cluster 2021-03-10T15:40:53.817168+0000 mgr.gibba045.orlgmj (mgr.34412) 5933 : cluster [DBG] pgmap v3373: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:57.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:40:56 gibba015 bash[29377]: cluster 2021-03-10T15:40:55.818903+0000 mgr.gibba045.orlgmj (mgr.34412) 5934 : cluster [DBG] pgmap v3374: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:57.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:40:56 gibba015 bash[30343]: cluster 2021-03-10T15:40:55.818903+0000 mgr.gibba045.orlgmj (mgr.34412) 5934 : cluster [DBG] pgmap v3374: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:57.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:40:56 gibba045 bash[25517]: cluster 2021-03-10T15:40:55.818903+0000 mgr.gibba045.orlgmj (mgr.34412) 5934 : cluster [DBG] pgmap v3374: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:59.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:40:58 gibba015 bash[29377]: cluster 2021-03-10T15:40:57.820457+0000 mgr.gibba045.orlgmj (mgr.34412) 5935 : cluster [DBG] pgmap v3375: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:59.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:40:58 gibba015 bash[30343]: cluster 2021-03-10T15:40:57.820457+0000 mgr.gibba045.orlgmj (mgr.34412) 5935 : cluster [DBG] pgmap v3375: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:59.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:40:58 gibba045 bash[25517]: cluster 2021-03-10T15:40:57.820457+0000 mgr.gibba045.orlgmj (mgr.34412) 5935 : cluster [DBG] pgmap v3375: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:00.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:41:00 gibba015 bash[29377]: cluster 2021-03-10T15:40:59.821887+0000 mgr.gibba045.orlgmj (mgr.34412) 5936 : cluster [DBG] pgmap v3376: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:00.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:41:00 gibba015 bash[30343]: cluster 2021-03-10T15:40:59.821887+0000 mgr.gibba045.orlgmj (mgr.34412) 5936 : cluster [DBG] pgmap v3376: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:01.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:41:00 gibba045 bash[25517]: cluster 2021-03-10T15:40:59.821887+0000 mgr.gibba045.orlgmj (mgr.34412) 5936 : cluster [DBG] pgmap v3376: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:03.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:41:02 gibba015 bash[29377]: cephadm 2021-03-10T15:41:01.613278+0000 mgr.gibba045.orlgmj (mgr.34412) 5937 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:41:03.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:41:02 gibba015 bash[29377]: cluster 2021-03-10T15:41:01.823707+0000 mgr.gibba045.orlgmj (mgr.34412) 5938 : cluster [DBG] pgmap v3377: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:03.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:41:02 gibba015 bash[30343]: cephadm 2021-03-10T15:41:01.613278+0000 mgr.gibba045.orlgmj (mgr.34412) 5937 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:41:03.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:41:02 gibba015 bash[30343]: cluster 2021-03-10T15:41:01.823707+0000 mgr.gibba045.orlgmj (mgr.34412) 5938 : cluster [DBG] pgmap v3377: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:03.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:41:02 gibba045 bash[25517]: cephadm 2021-03-10T15:41:01.613278+0000 mgr.gibba045.orlgmj (mgr.34412) 5937 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:41:03.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:41:02 gibba045 bash[25517]: cluster 2021-03-10T15:41:01.823707+0000 mgr.gibba045.orlgmj (mgr.34412) 5938 : cluster [DBG] pgmap v3377: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:05.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:41:04 gibba015 bash[29377]: cluster 2021-03-10T15:41:03.824333+0000 mgr.gibba045.orlgmj (mgr.34412) 5939 : cluster [DBG] pgmap v3378: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:05.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:41:04 gibba015 bash[30343]: cluster 2021-03-10T15:41:03.824333+0000 mgr.gibba045.orlgmj (mgr.34412) 5939 : cluster [DBG] pgmap v3378: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:05.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:41:04 gibba045 bash[25517]: cluster 2021-03-10T15:41:03.824333+0000 mgr.gibba045.orlgmj (mgr.34412) 5939 : cluster [DBG] pgmap v3378: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:07.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:41:06 gibba015 bash[29377]: cluster 2021-03-10T15:41:05.825864+0000 mgr.gibba045.orlgmj (mgr.34412) 5940 : cluster [DBG] pgmap v3379: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:07.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:41:06 gibba015 bash[30343]: cluster 2021-03-10T15:41:05.825864+0000 mgr.gibba045.orlgmj (mgr.34412) 5940 : cluster [DBG] pgmap v3379: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:07.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:41:06 gibba045 bash[25517]: cluster 2021-03-10T15:41:05.825864+0000 mgr.gibba045.orlgmj (mgr.34412) 5940 : cluster [DBG] pgmap v3379: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:09.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:41:08 gibba015 bash[29377]: cluster 2021-03-10T15:41:07.827537+0000 mgr.gibba045.orlgmj (mgr.34412) 5941 : cluster [DBG] pgmap v3380: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:09.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:41:08 gibba015 bash[30343]: cluster 2021-03-10T15:41:07.827537+0000 mgr.gibba045.orlgmj (mgr.34412) 5941 : cluster [DBG] pgmap v3380: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:09.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:41:08 gibba045 bash[25517]: cluster 2021-03-10T15:41:07.827537+0000 mgr.gibba045.orlgmj (mgr.34412) 5941 : cluster [DBG] pgmap v3380: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:10.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:41:10 gibba015 bash[29377]: cluster 2021-03-10T15:41:09.829106+0000 mgr.gibba045.orlgmj (mgr.34412) 5942 : cluster [DBG] pgmap v3381: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:10.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:41:10 gibba015 bash[30343]: cluster 2021-03-10T15:41:09.829106+0000 mgr.gibba045.orlgmj (mgr.34412) 5942 : cluster [DBG] pgmap v3381: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:11.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:41:10 gibba045 bash[25517]: cluster 2021-03-10T15:41:09.829106+0000 mgr.gibba045.orlgmj (mgr.34412) 5942 : cluster [DBG] pgmap v3381: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:13.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:41:12 gibba015 bash[29377]: cluster 2021-03-10T15:41:11.830595+0000 mgr.gibba045.orlgmj (mgr.34412) 5943 : cluster [DBG] pgmap v3382: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:13.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:41:12 gibba015 bash[30343]: cluster 2021-03-10T15:41:11.830595+0000 mgr.gibba045.orlgmj (mgr.34412) 5943 : cluster [DBG] pgmap v3382: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:13.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:41:12 gibba045 bash[25517]: cluster 2021-03-10T15:41:11.830595+0000 mgr.gibba045.orlgmj (mgr.34412) 5943 : cluster [DBG] pgmap v3382: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:15.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:41:14 gibba015 bash[29377]: cluster 2021-03-10T15:41:13.831239+0000 mgr.gibba045.orlgmj (mgr.34412) 5944 : cluster [DBG] pgmap v3383: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:15.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:41:14 gibba015 bash[30343]: cluster 2021-03-10T15:41:13.831239+0000 mgr.gibba045.orlgmj (mgr.34412) 5944 : cluster [DBG] pgmap v3383: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:15.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:41:14 gibba045 bash[25517]: cluster 2021-03-10T15:41:13.831239+0000 mgr.gibba045.orlgmj (mgr.34412) 5944 : cluster [DBG] pgmap v3383: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:17.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:41:16 gibba015 bash[29377]: cluster 2021-03-10T15:41:15.832962+0000 mgr.gibba045.orlgmj (mgr.34412) 5945 : cluster [DBG] pgmap v3384: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:17.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:41:16 gibba015 bash[29377]: audit 2021-03-10T15:41:16.626590+0000 mon.c (mon.1) 1664 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:41:17.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:41:16 gibba015 bash[29377]: audit 2021-03-10T15:41:16.857032+0000 mon.a (mon.0) 1497 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:41:17.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:41:16 gibba015 bash[29377]: audit 2021-03-10T15:41:16.861388+0000 mon.c (mon.1) 1665 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:41:17.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:41:16 gibba015 bash[29377]: audit 2021-03-10T15:41:16.863121+0000 mon.c (mon.1) 1666 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:41:17.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:41:16 gibba015 bash[29377]: audit 2021-03-10T15:41:16.864514+0000 mon.c (mon.1) 1667 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:41:17.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:41:16 gibba015 bash[29377]: audit 2021-03-10T15:41:16.865709+0000 mon.c (mon.1) 1668 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:41:17.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:41:16 gibba015 bash[29377]: audit 2021-03-10T15:41:16.868740+0000 mon.c (mon.1) 1669 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:41:17.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:41:16 gibba015 bash[29377]: audit 2021-03-10T15:41:16.870455+0000 mon.c (mon.1) 1670 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:41:17.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:41:16 gibba015 bash[30343]: cluster 2021-03-10T15:41:15.832962+0000 mgr.gibba045.orlgmj (mgr.34412) 5945 : cluster [DBG] pgmap v3384: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:17.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:41:16 gibba015 bash[30343]: audit 2021-03-10T15:41:16.626590+0000 mon.c (mon.1) 1664 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:41:17.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:41:16 gibba015 bash[30343]: audit 2021-03-10T15:41:16.857032+0000 mon.a (mon.0) 1497 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:41:17.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:41:16 gibba015 bash[30343]: audit 2021-03-10T15:41:16.861388+0000 mon.c (mon.1) 1665 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:41:17.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:41:16 gibba015 bash[30343]: audit 2021-03-10T15:41:16.863121+0000 mon.c (mon.1) 1666 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:41:17.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:41:16 gibba015 bash[30343]: audit 2021-03-10T15:41:16.864514+0000 mon.c (mon.1) 1667 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:41:17.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:41:16 gibba015 bash[30343]: audit 2021-03-10T15:41:16.865709+0000 mon.c (mon.1) 1668 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:41:17.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:41:16 gibba015 bash[30343]: audit 2021-03-10T15:41:16.868740+0000 mon.c (mon.1) 1669 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:41:17.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:41:16 gibba015 bash[30343]: audit 2021-03-10T15:41:16.870455+0000 mon.c (mon.1) 1670 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:41:17.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:41:16 gibba045 bash[25517]: cluster 2021-03-10T15:41:15.832962+0000 mgr.gibba045.orlgmj (mgr.34412) 5945 : cluster [DBG] pgmap v3384: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:17.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:41:16 gibba045 bash[25517]: audit 2021-03-10T15:41:16.626590+0000 mon.c (mon.1) 1664 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:41:17.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:41:16 gibba045 bash[25517]: audit 2021-03-10T15:41:16.857032+0000 mon.a (mon.0) 1497 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:41:17.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:41:16 gibba045 bash[25517]: audit 2021-03-10T15:41:16.861388+0000 mon.c (mon.1) 1665 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:41:17.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:41:16 gibba045 bash[25517]: audit 2021-03-10T15:41:16.863121+0000 mon.c (mon.1) 1666 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:41:17.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:41:16 gibba045 bash[25517]: audit 2021-03-10T15:41:16.864514+0000 mon.c (mon.1) 1667 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:41:17.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:41:16 gibba045 bash[25517]: audit 2021-03-10T15:41:16.865709+0000 mon.c (mon.1) 1668 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:41:17.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:41:16 gibba045 bash[25517]: audit 2021-03-10T15:41:16.868740+0000 mon.c (mon.1) 1669 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:41:17.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:41:16 gibba045 bash[25517]: audit 2021-03-10T15:41:16.870455+0000 mon.c (mon.1) 1670 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:41:17.311 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:41:17.537 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:41:17.537 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (111m) 6m ago 117m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:41:17.538 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (117m) 5m ago 117m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:41:17.538 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (112m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:41:17.538 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (112m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:41:17.538 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (111m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:41:17.539 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (111m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:41:17.539 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (111m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:41:17.539 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (111m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:41:17.539 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (117m) 6m ago 117m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:41:17.539 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (117m) 5m ago 117m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:41:17.540 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (110m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:41:17.540 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (109m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:41:17.540 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (109m) 6m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:41:17.540 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (109m) 6m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:41:17.541 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (108m) 5m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:41:17.541 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (108m) 5m ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:41:17.541 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (107m) 5m ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:41:17.541 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (107m) 5m ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:41:17.541 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (116m) 5m ago 117m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:41:17.542 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 5m ago 115m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:41:17.786 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:41:17.786 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:41:17.787 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:41:17.787 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:41:17.787 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:41:17.787 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:41:17.788 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:41:17.788 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:41:17.788 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:41:17.788 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:41:17.789 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:41:17.789 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:41:17.789 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:41:17.789 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:41:17.789 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:41:18.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:41:17 gibba015 bash[29377]: cephadm 2021-03-10T15:41:16.635625+0000 mgr.gibba045.orlgmj (mgr.34412) 5946 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:41:18.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:41:17 gibba015 bash[29377]: cephadm 2021-03-10T15:41:16.637202+0000 mgr.gibba045.orlgmj (mgr.34412) 5947 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:41:18.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:41:17 gibba015 bash[29377]: cephadm 2021-03-10T15:41:16.864046+0000 mgr.gibba045.orlgmj (mgr.34412) 5948 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:41:18.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:41:17 gibba015 bash[29377]: cephadm 2021-03-10T15:41:16.866187+0000 mgr.gibba045.orlgmj (mgr.34412) 5949 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:41:18.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:41:17 gibba015 bash[29377]: cephadm 2021-03-10T15:41:16.867419+0000 mgr.gibba045.orlgmj (mgr.34412) 5950 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:41:18.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:41:17 gibba015 bash[29377]: cephadm 2021-03-10T15:41:16.867493+0000 mgr.gibba045.orlgmj (mgr.34412) 5951 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:41:18.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:41:17 gibba015 bash[29377]: cephadm 2021-03-10T15:41:16.868789+0000 mgr.gibba045.orlgmj (mgr.34412) 5952 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:41:18.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:41:17 gibba015 bash[29377]: cephadm 2021-03-10T15:41:16.868825+0000 mgr.gibba045.orlgmj (mgr.34412) 5953 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:41:18.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:41:17 gibba015 bash[29377]: cephadm 2021-03-10T15:41:16.870118+0000 mgr.gibba045.orlgmj (mgr.34412) 5954 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:41:18.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:41:17 gibba015 bash[29377]: cephadm 2021-03-10T15:41:16.871749+0000 mgr.gibba045.orlgmj (mgr.34412) 5955 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:41:18.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:41:17 gibba015 bash[29377]: cephadm 2021-03-10T15:41:16.871786+0000 mgr.gibba045.orlgmj (mgr.34412) 5956 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:41:18.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:41:17 gibba015 bash[29377]: cephadm 2021-03-10T15:41:16.873319+0000 mgr.gibba045.orlgmj (mgr.34412) 5957 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:41:18.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:41:17 gibba015 bash[29377]: cephadm 2021-03-10T15:41:16.873644+0000 mgr.gibba045.orlgmj (mgr.34412) 5958 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:41:18.230 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:41:17 gibba015 bash[29377]: cephadm 2021-03-10T15:41:16.875099+0000 mgr.gibba045.orlgmj (mgr.34412) 5959 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:41:18.230 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:41:17 gibba015 bash[29377]: cephadm 2021-03-10T15:41:16.875140+0000 mgr.gibba045.orlgmj (mgr.34412) 5960 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:41:18.230 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:41:17 gibba015 bash[29377]: cephadm 2021-03-10T15:41:16.875253+0000 mgr.gibba045.orlgmj (mgr.34412) 5961 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:41:18.230 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:41:17 gibba015 bash[29377]: audit 2021-03-10T15:41:17.301350+0000 mgr.gibba045.orlgmj (mgr.34412) 5962 : audit [DBG] from='client.58036 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:41:18.231 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:41:17 gibba015 bash[29377]: audit 2021-03-10T15:41:17.779944+0000 mon.a (mon.0) 1498 : audit [DBG] from='client.? 172.21.2.115:0/3111781026' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:41:18.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:41:17 gibba015 bash[30343]: cephadm 2021-03-10T15:41:16.635625+0000 mgr.gibba045.orlgmj (mgr.34412) 5946 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:41:18.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:41:17 gibba015 bash[30343]: cephadm 2021-03-10T15:41:16.637202+0000 mgr.gibba045.orlgmj (mgr.34412) 5947 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:41:18.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:41:17 gibba015 bash[30343]: cephadm 2021-03-10T15:41:16.864046+0000 mgr.gibba045.orlgmj (mgr.34412) 5948 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:41:18.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:41:17 gibba015 bash[30343]: cephadm 2021-03-10T15:41:16.866187+0000 mgr.gibba045.orlgmj (mgr.34412) 5949 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:41:18.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:41:17 gibba015 bash[30343]: cephadm 2021-03-10T15:41:16.867419+0000 mgr.gibba045.orlgmj (mgr.34412) 5950 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:41:18.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:41:17 gibba015 bash[30343]: cephadm 2021-03-10T15:41:16.867493+0000 mgr.gibba045.orlgmj (mgr.34412) 5951 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:41:18.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:41:17 gibba015 bash[30343]: cephadm 2021-03-10T15:41:16.868789+0000 mgr.gibba045.orlgmj (mgr.34412) 5952 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:41:18.234 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:41:17 gibba015 bash[30343]: cephadm 2021-03-10T15:41:16.868825+0000 mgr.gibba045.orlgmj (mgr.34412) 5953 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:41:18.234 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:41:17 gibba015 bash[30343]: cephadm 2021-03-10T15:41:16.870118+0000 mgr.gibba045.orlgmj (mgr.34412) 5954 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:41:18.234 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:41:17 gibba015 bash[30343]: cephadm 2021-03-10T15:41:16.871749+0000 mgr.gibba045.orlgmj (mgr.34412) 5955 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:41:18.235 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:41:17 gibba015 bash[30343]: cephadm 2021-03-10T15:41:16.871786+0000 mgr.gibba045.orlgmj (mgr.34412) 5956 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:41:18.235 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:41:17 gibba015 bash[30343]: cephadm 2021-03-10T15:41:16.873319+0000 mgr.gibba045.orlgmj (mgr.34412) 5957 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:41:18.235 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:41:17 gibba015 bash[30343]: cephadm 2021-03-10T15:41:16.873644+0000 mgr.gibba045.orlgmj (mgr.34412) 5958 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:41:18.235 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:41:17 gibba015 bash[30343]: cephadm 2021-03-10T15:41:16.875099+0000 mgr.gibba045.orlgmj (mgr.34412) 5959 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:41:18.236 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:41:17 gibba015 bash[30343]: cephadm 2021-03-10T15:41:16.875140+0000 mgr.gibba045.orlgmj (mgr.34412) 5960 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:41:18.236 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:41:17 gibba015 bash[30343]: cephadm 2021-03-10T15:41:16.875253+0000 mgr.gibba045.orlgmj (mgr.34412) 5961 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:41:18.236 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:41:17 gibba015 bash[30343]: audit 2021-03-10T15:41:17.301350+0000 mgr.gibba045.orlgmj (mgr.34412) 5962 : audit [DBG] from='client.58036 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:41:18.237 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:41:17 gibba015 bash[30343]: audit 2021-03-10T15:41:17.779944+0000 mon.a (mon.0) 1498 : audit [DBG] from='client.? 172.21.2.115:0/3111781026' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:41:18.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:41:17 gibba045 bash[25517]: cephadm 2021-03-10T15:41:16.635625+0000 mgr.gibba045.orlgmj (mgr.34412) 5946 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:41:18.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:41:17 gibba045 bash[25517]: cephadm 2021-03-10T15:41:16.637202+0000 mgr.gibba045.orlgmj (mgr.34412) 5947 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:41:18.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:41:17 gibba045 bash[25517]: cephadm 2021-03-10T15:41:16.864046+0000 mgr.gibba045.orlgmj (mgr.34412) 5948 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:41:18.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:41:17 gibba045 bash[25517]: cephadm 2021-03-10T15:41:16.866187+0000 mgr.gibba045.orlgmj (mgr.34412) 5949 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:41:18.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:41:17 gibba045 bash[25517]: cephadm 2021-03-10T15:41:16.867419+0000 mgr.gibba045.orlgmj (mgr.34412) 5950 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:41:18.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:41:17 gibba045 bash[25517]: cephadm 2021-03-10T15:41:16.867493+0000 mgr.gibba045.orlgmj (mgr.34412) 5951 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:41:18.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:41:17 gibba045 bash[25517]: cephadm 2021-03-10T15:41:16.868789+0000 mgr.gibba045.orlgmj (mgr.34412) 5952 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:41:18.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:41:17 gibba045 bash[25517]: cephadm 2021-03-10T15:41:16.868825+0000 mgr.gibba045.orlgmj (mgr.34412) 5953 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:41:18.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:41:17 gibba045 bash[25517]: cephadm 2021-03-10T15:41:16.870118+0000 mgr.gibba045.orlgmj (mgr.34412) 5954 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:41:18.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:41:17 gibba045 bash[25517]: cephadm 2021-03-10T15:41:16.871749+0000 mgr.gibba045.orlgmj (mgr.34412) 5955 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:41:18.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:41:17 gibba045 bash[25517]: cephadm 2021-03-10T15:41:16.871786+0000 mgr.gibba045.orlgmj (mgr.34412) 5956 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:41:18.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:41:17 gibba045 bash[25517]: cephadm 2021-03-10T15:41:16.873319+0000 mgr.gibba045.orlgmj (mgr.34412) 5957 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:41:18.312 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:41:17 gibba045 bash[25517]: cephadm 2021-03-10T15:41:16.873644+0000 mgr.gibba045.orlgmj (mgr.34412) 5958 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:41:18.312 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:41:17 gibba045 bash[25517]: cephadm 2021-03-10T15:41:16.875099+0000 mgr.gibba045.orlgmj (mgr.34412) 5959 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:41:18.312 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:41:17 gibba045 bash[25517]: cephadm 2021-03-10T15:41:16.875140+0000 mgr.gibba045.orlgmj (mgr.34412) 5960 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:41:18.312 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:41:17 gibba045 bash[25517]: cephadm 2021-03-10T15:41:16.875253+0000 mgr.gibba045.orlgmj (mgr.34412) 5961 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:41:18.313 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:41:17 gibba045 bash[25517]: audit 2021-03-10T15:41:17.301350+0000 mgr.gibba045.orlgmj (mgr.34412) 5962 : audit [DBG] from='client.58036 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:41:18.313 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:41:17 gibba045 bash[25517]: audit 2021-03-10T15:41:17.779944+0000 mon.a (mon.0) 1498 : audit [DBG] from='client.? 172.21.2.115:0/3111781026' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:41:19.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:41:18 gibba015 bash[29377]: audit 2021-03-10T15:41:17.525086+0000 mgr.gibba045.orlgmj (mgr.34412) 5963 : audit [DBG] from='client.58042 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:41:19.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:41:18 gibba015 bash[29377]: cluster 2021-03-10T15:41:17.834642+0000 mgr.gibba045.orlgmj (mgr.34412) 5964 : cluster [DBG] pgmap v3385: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:19.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:41:18 gibba015 bash[30343]: audit 2021-03-10T15:41:17.525086+0000 mgr.gibba045.orlgmj (mgr.34412) 5963 : audit [DBG] from='client.58042 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:41:19.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:41:18 gibba015 bash[30343]: cluster 2021-03-10T15:41:17.834642+0000 mgr.gibba045.orlgmj (mgr.34412) 5964 : cluster [DBG] pgmap v3385: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:19.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:41:18 gibba045 bash[25517]: audit 2021-03-10T15:41:17.525086+0000 mgr.gibba045.orlgmj (mgr.34412) 5963 : audit [DBG] from='client.58042 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:41:19.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:41:18 gibba045 bash[25517]: cluster 2021-03-10T15:41:17.834642+0000 mgr.gibba045.orlgmj (mgr.34412) 5964 : cluster [DBG] pgmap v3385: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:20.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:41:20 gibba015 bash[29377]: cluster 2021-03-10T15:41:19.836263+0000 mgr.gibba045.orlgmj (mgr.34412) 5965 : cluster [DBG] pgmap v3386: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:20.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:41:20 gibba015 bash[30343]: cluster 2021-03-10T15:41:19.836263+0000 mgr.gibba045.orlgmj (mgr.34412) 5965 : cluster [DBG] pgmap v3386: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:21.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:41:20 gibba045 bash[25517]: cluster 2021-03-10T15:41:19.836263+0000 mgr.gibba045.orlgmj (mgr.34412) 5965 : cluster [DBG] pgmap v3386: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:23.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:41:22 gibba015 bash[29377]: cluster 2021-03-10T15:41:21.837885+0000 mgr.gibba045.orlgmj (mgr.34412) 5966 : cluster [DBG] pgmap v3387: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:23.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:41:22 gibba015 bash[30343]: cluster 2021-03-10T15:41:21.837885+0000 mgr.gibba045.orlgmj (mgr.34412) 5966 : cluster [DBG] pgmap v3387: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:23.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:41:22 gibba045 bash[25517]: cluster 2021-03-10T15:41:21.837885+0000 mgr.gibba045.orlgmj (mgr.34412) 5966 : cluster [DBG] pgmap v3387: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:25.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:41:24 gibba015 bash[29377]: cluster 2021-03-10T15:41:23.838549+0000 mgr.gibba045.orlgmj (mgr.34412) 5967 : cluster [DBG] pgmap v3388: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:25.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:41:24 gibba015 bash[30343]: cluster 2021-03-10T15:41:23.838549+0000 mgr.gibba045.orlgmj (mgr.34412) 5967 : cluster [DBG] pgmap v3388: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:25.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:41:24 gibba045 bash[25517]: cluster 2021-03-10T15:41:23.838549+0000 mgr.gibba045.orlgmj (mgr.34412) 5967 : cluster [DBG] pgmap v3388: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:27.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:41:26 gibba015 bash[29377]: cluster 2021-03-10T15:41:25.840074+0000 mgr.gibba045.orlgmj (mgr.34412) 5968 : cluster [DBG] pgmap v3389: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:27.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:41:26 gibba015 bash[30343]: cluster 2021-03-10T15:41:25.840074+0000 mgr.gibba045.orlgmj (mgr.34412) 5968 : cluster [DBG] pgmap v3389: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:27.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:41:26 gibba045 bash[25517]: cluster 2021-03-10T15:41:25.840074+0000 mgr.gibba045.orlgmj (mgr.34412) 5968 : cluster [DBG] pgmap v3389: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:29.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:41:28 gibba015 bash[29377]: cluster 2021-03-10T15:41:27.841765+0000 mgr.gibba045.orlgmj (mgr.34412) 5969 : cluster [DBG] pgmap v3390: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:29.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:41:28 gibba015 bash[30343]: cluster 2021-03-10T15:41:27.841765+0000 mgr.gibba045.orlgmj (mgr.34412) 5969 : cluster [DBG] pgmap v3390: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:29.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:41:28 gibba045 bash[25517]: cluster 2021-03-10T15:41:27.841765+0000 mgr.gibba045.orlgmj (mgr.34412) 5969 : cluster [DBG] pgmap v3390: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:30.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:41:30 gibba015 bash[29377]: cluster 2021-03-10T15:41:29.843269+0000 mgr.gibba045.orlgmj (mgr.34412) 5970 : cluster [DBG] pgmap v3391: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:30.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:41:30 gibba015 bash[30343]: cluster 2021-03-10T15:41:29.843269+0000 mgr.gibba045.orlgmj (mgr.34412) 5970 : cluster [DBG] pgmap v3391: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:31.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:41:30 gibba045 bash[25517]: cluster 2021-03-10T15:41:29.843269+0000 mgr.gibba045.orlgmj (mgr.34412) 5970 : cluster [DBG] pgmap v3391: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:33.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:41:32 gibba015 bash[29377]: cluster 2021-03-10T15:41:31.844975+0000 mgr.gibba045.orlgmj (mgr.34412) 5971 : cluster [DBG] pgmap v3392: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:33.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:41:32 gibba015 bash[29377]: cephadm 2021-03-10T15:41:31.891289+0000 mgr.gibba045.orlgmj (mgr.34412) 5972 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:41:33.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:41:32 gibba015 bash[30343]: cluster 2021-03-10T15:41:31.844975+0000 mgr.gibba045.orlgmj (mgr.34412) 5971 : cluster [DBG] pgmap v3392: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:33.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:41:32 gibba015 bash[30343]: cephadm 2021-03-10T15:41:31.891289+0000 mgr.gibba045.orlgmj (mgr.34412) 5972 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:41:33.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:41:32 gibba045 bash[25517]: cluster 2021-03-10T15:41:31.844975+0000 mgr.gibba045.orlgmj (mgr.34412) 5971 : cluster [DBG] pgmap v3392: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:33.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:41:32 gibba045 bash[25517]: cephadm 2021-03-10T15:41:31.891289+0000 mgr.gibba045.orlgmj (mgr.34412) 5972 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:41:35.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:41:34 gibba015 bash[29377]: cluster 2021-03-10T15:41:33.846349+0000 mgr.gibba045.orlgmj (mgr.34412) 5973 : cluster [DBG] pgmap v3393: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:35.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:41:34 gibba015 bash[30343]: cluster 2021-03-10T15:41:33.846349+0000 mgr.gibba045.orlgmj (mgr.34412) 5973 : cluster [DBG] pgmap v3393: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:35.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:41:34 gibba045 bash[25517]: cluster 2021-03-10T15:41:33.846349+0000 mgr.gibba045.orlgmj (mgr.34412) 5973 : cluster [DBG] pgmap v3393: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:37.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:41:36 gibba015 bash[29377]: cluster 2021-03-10T15:41:35.848282+0000 mgr.gibba045.orlgmj (mgr.34412) 5974 : cluster [DBG] pgmap v3394: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:37.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:41:36 gibba015 bash[30343]: cluster 2021-03-10T15:41:35.848282+0000 mgr.gibba045.orlgmj (mgr.34412) 5974 : cluster [DBG] pgmap v3394: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:37.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:41:36 gibba045 bash[25517]: cluster 2021-03-10T15:41:35.848282+0000 mgr.gibba045.orlgmj (mgr.34412) 5974 : cluster [DBG] pgmap v3394: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:39.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:41:38 gibba015 bash[29377]: cluster 2021-03-10T15:41:37.849712+0000 mgr.gibba045.orlgmj (mgr.34412) 5975 : cluster [DBG] pgmap v3395: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:39.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:41:38 gibba015 bash[30343]: cluster 2021-03-10T15:41:37.849712+0000 mgr.gibba045.orlgmj (mgr.34412) 5975 : cluster [DBG] pgmap v3395: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:39.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:41:38 gibba045 bash[25517]: cluster 2021-03-10T15:41:37.849712+0000 mgr.gibba045.orlgmj (mgr.34412) 5975 : cluster [DBG] pgmap v3395: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:40.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:41:40 gibba015 bash[29377]: cluster 2021-03-10T15:41:39.851559+0000 mgr.gibba045.orlgmj (mgr.34412) 5976 : cluster [DBG] pgmap v3396: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:40.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:41:40 gibba015 bash[30343]: cluster 2021-03-10T15:41:39.851559+0000 mgr.gibba045.orlgmj (mgr.34412) 5976 : cluster [DBG] pgmap v3396: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:41.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:41:40 gibba045 bash[25517]: cluster 2021-03-10T15:41:39.851559+0000 mgr.gibba045.orlgmj (mgr.34412) 5976 : cluster [DBG] pgmap v3396: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:43.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:41:42 gibba015 bash[29377]: cluster 2021-03-10T15:41:41.853350+0000 mgr.gibba045.orlgmj (mgr.34412) 5977 : cluster [DBG] pgmap v3397: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:43.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:41:42 gibba015 bash[30343]: cluster 2021-03-10T15:41:41.853350+0000 mgr.gibba045.orlgmj (mgr.34412) 5977 : cluster [DBG] pgmap v3397: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:43.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:41:42 gibba045 bash[25517]: cluster 2021-03-10T15:41:41.853350+0000 mgr.gibba045.orlgmj (mgr.34412) 5977 : cluster [DBG] pgmap v3397: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:45.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:41:44 gibba015 bash[29377]: cluster 2021-03-10T15:41:43.854604+0000 mgr.gibba045.orlgmj (mgr.34412) 5978 : cluster [DBG] pgmap v3398: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:45.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:41:44 gibba015 bash[30343]: cluster 2021-03-10T15:41:43.854604+0000 mgr.gibba045.orlgmj (mgr.34412) 5978 : cluster [DBG] pgmap v3398: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:45.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:41:44 gibba045 bash[25517]: cluster 2021-03-10T15:41:43.854604+0000 mgr.gibba045.orlgmj (mgr.34412) 5978 : cluster [DBG] pgmap v3398: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:47.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:41:46 gibba015 bash[29377]: cluster 2021-03-10T15:41:45.856362+0000 mgr.gibba045.orlgmj (mgr.34412) 5979 : cluster [DBG] pgmap v3399: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:47.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:41:46 gibba015 bash[30343]: cluster 2021-03-10T15:41:45.856362+0000 mgr.gibba045.orlgmj (mgr.34412) 5979 : cluster [DBG] pgmap v3399: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:47.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:41:46 gibba045 bash[25517]: cluster 2021-03-10T15:41:45.856362+0000 mgr.gibba045.orlgmj (mgr.34412) 5979 : cluster [DBG] pgmap v3399: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:48.027 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:41:48.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:41:47 gibba015 bash[29377]: cephadm 2021-03-10T15:41:46.907381+0000 mgr.gibba045.orlgmj (mgr.34412) 5980 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:41:48.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:41:47 gibba015 bash[30343]: cephadm 2021-03-10T15:41:46.907381+0000 mgr.gibba045.orlgmj (mgr.34412) 5980 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:41:48.252 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:41:48.252 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (112m) 6m ago 117m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:41:48.252 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (117m) 5m ago 117m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:41:48.253 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (112m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:41:48.253 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (113m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:41:48.253 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (112m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:41:48.253 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (112m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:41:48.253 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (111m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:41:48.254 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (111m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:41:48.254 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (118m) 6m ago 118m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:41:48.254 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (118m) 5m ago 118m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:41:48.254 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (110m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:41:48.255 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (110m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:41:48.255 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (109m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:41:48.255 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (109m) 6m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:41:48.255 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (109m) 5m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:41:48.255 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (108m) 5m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:41:48.256 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (108m) 5m ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:41:48.256 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (107m) 5m ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:41:48.256 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (117m) 5m ago 118m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:41:48.256 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 5m ago 116m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:41:48.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:41:47 gibba045 bash[25517]: cephadm 2021-03-10T15:41:46.907381+0000 mgr.gibba045.orlgmj (mgr.34412) 5980 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:41:48.501 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:41:48.501 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:41:48.502 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:41:48.502 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:41:48.502 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:41:48.502 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:41:48.503 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:41:48.503 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:41:48.503 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:41:48.503 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:41:48.503 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:41:48.504 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:41:48.504 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:41:48.504 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:41:48.504 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:41:49.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:41:48 gibba015 bash[29377]: cluster 2021-03-10T15:41:47.857805+0000 mgr.gibba045.orlgmj (mgr.34412) 5981 : cluster [DBG] pgmap v3400: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:49.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:41:48 gibba015 bash[29377]: audit 2021-03-10T15:41:48.017500+0000 mgr.gibba045.orlgmj (mgr.34412) 5982 : audit [DBG] from='client.48066 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:41:49.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:41:48 gibba015 bash[29377]: audit 2021-03-10T15:41:48.240579+0000 mgr.gibba045.orlgmj (mgr.34412) 5983 : audit [DBG] from='client.48072 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:41:49.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:41:48 gibba015 bash[29377]: audit 2021-03-10T15:41:48.496283+0000 mon.c (mon.1) 1671 : audit [DBG] from='client.? 172.21.2.115:0/1749940049' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:41:49.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:41:48 gibba015 bash[30343]: cluster 2021-03-10T15:41:47.857805+0000 mgr.gibba045.orlgmj (mgr.34412) 5981 : cluster [DBG] pgmap v3400: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:49.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:41:48 gibba015 bash[30343]: audit 2021-03-10T15:41:48.017500+0000 mgr.gibba045.orlgmj (mgr.34412) 5982 : audit [DBG] from='client.48066 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:41:49.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:41:48 gibba015 bash[30343]: audit 2021-03-10T15:41:48.240579+0000 mgr.gibba045.orlgmj (mgr.34412) 5983 : audit [DBG] from='client.48072 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:41:49.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:41:48 gibba015 bash[30343]: audit 2021-03-10T15:41:48.496283+0000 mon.c (mon.1) 1671 : audit [DBG] from='client.? 172.21.2.115:0/1749940049' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:41:49.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:41:48 gibba045 bash[25517]: cluster 2021-03-10T15:41:47.857805+0000 mgr.gibba045.orlgmj (mgr.34412) 5981 : cluster [DBG] pgmap v3400: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:49.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:41:48 gibba045 bash[25517]: audit 2021-03-10T15:41:48.017500+0000 mgr.gibba045.orlgmj (mgr.34412) 5982 : audit [DBG] from='client.48066 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:41:49.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:41:48 gibba045 bash[25517]: audit 2021-03-10T15:41:48.240579+0000 mgr.gibba045.orlgmj (mgr.34412) 5983 : audit [DBG] from='client.48072 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:41:49.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:41:48 gibba045 bash[25517]: audit 2021-03-10T15:41:48.496283+0000 mon.c (mon.1) 1671 : audit [DBG] from='client.? 172.21.2.115:0/1749940049' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:41:50.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:41:50 gibba015 bash[29377]: cluster 2021-03-10T15:41:49.859175+0000 mgr.gibba045.orlgmj (mgr.34412) 5984 : cluster [DBG] pgmap v3401: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:50.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:41:50 gibba015 bash[30343]: cluster 2021-03-10T15:41:49.859175+0000 mgr.gibba045.orlgmj (mgr.34412) 5984 : cluster [DBG] pgmap v3401: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:51.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:41:50 gibba045 bash[25517]: cluster 2021-03-10T15:41:49.859175+0000 mgr.gibba045.orlgmj (mgr.34412) 5984 : cluster [DBG] pgmap v3401: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:53.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:41:52 gibba015 bash[29377]: cluster 2021-03-10T15:41:51.860835+0000 mgr.gibba045.orlgmj (mgr.34412) 5985 : cluster [DBG] pgmap v3402: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:53.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:41:52 gibba015 bash[30343]: cluster 2021-03-10T15:41:51.860835+0000 mgr.gibba045.orlgmj (mgr.34412) 5985 : cluster [DBG] pgmap v3402: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:53.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:41:52 gibba045 bash[25517]: cluster 2021-03-10T15:41:51.860835+0000 mgr.gibba045.orlgmj (mgr.34412) 5985 : cluster [DBG] pgmap v3402: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:54.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:41:53 gibba015 bash[29377]: audit 2021-03-10T15:41:53.236815+0000 mon.c (mon.1) 1672 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:41:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:41:53 gibba015 bash[29377]: audit 2021-03-10T15:41:53.237742+0000 mon.c (mon.1) 1673 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:41:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:41:53 gibba015 bash[29377]: audit 2021-03-10T15:41:53.238165+0000 mon.a (mon.0) 1499 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:41:54.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:41:53 gibba015 bash[29377]: audit 2021-03-10T15:41:53.238569+0000 mon.c (mon.1) 1674 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T15:41:54.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:41:53 gibba015 bash[29377]: audit 2021-03-10T15:41:53.239707+0000 mon.c (mon.1) 1675 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T15:41:54.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:41:53 gibba015 bash[29377]: audit 2021-03-10T15:41:53.240235+0000 mon.a (mon.0) 1500 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:41:54.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:41:53 gibba015 bash[29377]: audit 2021-03-10T15:41:53.240530+0000 mon.c (mon.1) 1676 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:41:54.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:41:53 gibba015 bash[29377]: audit 2021-03-10T15:41:53.241588+0000 mon.c (mon.1) 1677 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:41:54.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:41:53 gibba015 bash[29377]: audit 2021-03-10T15:41:53.241686+0000 mon.a (mon.0) 1501 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T15:41:54.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:41:53 gibba015 bash[29377]: audit 2021-03-10T15:41:53.242680+0000 mon.a (mon.0) 1502 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T15:41:54.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:41:53 gibba015 bash[29377]: audit 2021-03-10T15:41:53.242820+0000 mon.a (mon.0) 1503 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:41:54.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:41:53 gibba015 bash[29377]: audit 2021-03-10T15:41:53.243082+0000 mon.a (mon.0) 1504 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:41:54.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:41:53 gibba015 bash[30343]: audit 2021-03-10T15:41:53.236815+0000 mon.c (mon.1) 1672 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:41:54.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:41:53 gibba015 bash[30343]: audit 2021-03-10T15:41:53.237742+0000 mon.c (mon.1) 1673 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:41:54.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:41:53 gibba015 bash[30343]: audit 2021-03-10T15:41:53.238165+0000 mon.a (mon.0) 1499 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:41:54.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:41:53 gibba015 bash[30343]: audit 2021-03-10T15:41:53.238569+0000 mon.c (mon.1) 1674 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T15:41:54.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:41:53 gibba015 bash[30343]: audit 2021-03-10T15:41:53.239707+0000 mon.c (mon.1) 1675 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T15:41:54.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:41:53 gibba015 bash[30343]: audit 2021-03-10T15:41:53.240235+0000 mon.a (mon.0) 1500 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:41:54.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:41:53 gibba015 bash[30343]: audit 2021-03-10T15:41:53.240530+0000 mon.c (mon.1) 1676 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:41:54.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:41:53 gibba015 bash[30343]: audit 2021-03-10T15:41:53.241588+0000 mon.c (mon.1) 1677 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:41:54.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:41:53 gibba015 bash[30343]: audit 2021-03-10T15:41:53.241686+0000 mon.a (mon.0) 1501 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T15:41:54.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:41:53 gibba015 bash[30343]: audit 2021-03-10T15:41:53.242680+0000 mon.a (mon.0) 1502 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T15:41:54.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:41:53 gibba015 bash[30343]: audit 2021-03-10T15:41:53.242820+0000 mon.a (mon.0) 1503 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:41:54.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:41:53 gibba015 bash[30343]: audit 2021-03-10T15:41:53.243082+0000 mon.a (mon.0) 1504 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:41:54.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:41:53 gibba045 bash[25517]: audit 2021-03-10T15:41:53.236815+0000 mon.c (mon.1) 1672 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:41:54.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:41:53 gibba045 bash[25517]: audit 2021-03-10T15:41:53.237742+0000 mon.c (mon.1) 1673 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:41:54.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:41:53 gibba045 bash[25517]: audit 2021-03-10T15:41:53.238165+0000 mon.a (mon.0) 1499 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:41:54.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:41:53 gibba045 bash[25517]: audit 2021-03-10T15:41:53.238569+0000 mon.c (mon.1) 1674 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T15:41:54.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:41:53 gibba045 bash[25517]: audit 2021-03-10T15:41:53.239707+0000 mon.c (mon.1) 1675 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T15:41:54.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:41:53 gibba045 bash[25517]: audit 2021-03-10T15:41:53.240235+0000 mon.a (mon.0) 1500 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:41:54.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:41:53 gibba045 bash[25517]: audit 2021-03-10T15:41:53.240530+0000 mon.c (mon.1) 1676 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:41:54.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:41:53 gibba045 bash[25517]: audit 2021-03-10T15:41:53.241588+0000 mon.c (mon.1) 1677 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:41:54.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:41:53 gibba045 bash[25517]: audit 2021-03-10T15:41:53.241686+0000 mon.a (mon.0) 1501 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T15:41:54.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:41:53 gibba045 bash[25517]: audit 2021-03-10T15:41:53.242680+0000 mon.a (mon.0) 1502 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T15:41:54.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:41:53 gibba045 bash[25517]: audit 2021-03-10T15:41:53.242820+0000 mon.a (mon.0) 1503 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:41:54.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:41:53 gibba045 bash[25517]: audit 2021-03-10T15:41:53.243082+0000 mon.a (mon.0) 1504 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:41:55.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:41:54 gibba015 bash[29377]: cluster 2021-03-10T15:41:53.862060+0000 mgr.gibba045.orlgmj (mgr.34412) 5986 : cluster [DBG] pgmap v3403: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:55.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:41:54 gibba015 bash[30343]: cluster 2021-03-10T15:41:53.862060+0000 mgr.gibba045.orlgmj (mgr.34412) 5986 : cluster [DBG] pgmap v3403: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:55.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:41:54 gibba045 bash[25517]: cluster 2021-03-10T15:41:53.862060+0000 mgr.gibba045.orlgmj (mgr.34412) 5986 : cluster [DBG] pgmap v3403: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:57.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:41:56 gibba015 bash[29377]: cluster 2021-03-10T15:41:55.863830+0000 mgr.gibba045.orlgmj (mgr.34412) 5987 : cluster [DBG] pgmap v3404: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:57.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:41:56 gibba015 bash[30343]: cluster 2021-03-10T15:41:55.863830+0000 mgr.gibba045.orlgmj (mgr.34412) 5987 : cluster [DBG] pgmap v3404: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:57.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:41:56 gibba045 bash[25517]: cluster 2021-03-10T15:41:55.863830+0000 mgr.gibba045.orlgmj (mgr.34412) 5987 : cluster [DBG] pgmap v3404: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:59.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:41:58 gibba015 bash[29377]: cluster 2021-03-10T15:41:57.865484+0000 mgr.gibba045.orlgmj (mgr.34412) 5988 : cluster [DBG] pgmap v3405: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:59.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:41:58 gibba015 bash[30343]: cluster 2021-03-10T15:41:57.865484+0000 mgr.gibba045.orlgmj (mgr.34412) 5988 : cluster [DBG] pgmap v3405: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:59.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:41:58 gibba045 bash[25517]: cluster 2021-03-10T15:41:57.865484+0000 mgr.gibba045.orlgmj (mgr.34412) 5988 : cluster [DBG] pgmap v3405: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:00.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:42:00 gibba015 bash[29377]: cluster 2021-03-10T15:41:59.867127+0000 mgr.gibba045.orlgmj (mgr.34412) 5989 : cluster [DBG] pgmap v3406: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:00.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:42:00 gibba015 bash[30343]: cluster 2021-03-10T15:41:59.867127+0000 mgr.gibba045.orlgmj (mgr.34412) 5989 : cluster [DBG] pgmap v3406: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:01.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:42:00 gibba045 bash[25517]: cluster 2021-03-10T15:41:59.867127+0000 mgr.gibba045.orlgmj (mgr.34412) 5989 : cluster [DBG] pgmap v3406: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:03.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:42:02 gibba015 bash[29377]: cluster 2021-03-10T15:42:01.868948+0000 mgr.gibba045.orlgmj (mgr.34412) 5990 : cluster [DBG] pgmap v3407: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:03.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:42:02 gibba015 bash[29377]: cephadm 2021-03-10T15:42:01.923410+0000 mgr.gibba045.orlgmj (mgr.34412) 5991 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:42:03.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:42:02 gibba015 bash[30343]: cluster 2021-03-10T15:42:01.868948+0000 mgr.gibba045.orlgmj (mgr.34412) 5990 : cluster [DBG] pgmap v3407: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:03.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:42:02 gibba015 bash[30343]: cephadm 2021-03-10T15:42:01.923410+0000 mgr.gibba045.orlgmj (mgr.34412) 5991 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:42:03.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:42:02 gibba045 bash[25517]: cluster 2021-03-10T15:42:01.868948+0000 mgr.gibba045.orlgmj (mgr.34412) 5990 : cluster [DBG] pgmap v3407: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:03.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:42:02 gibba045 bash[25517]: cephadm 2021-03-10T15:42:01.923410+0000 mgr.gibba045.orlgmj (mgr.34412) 5991 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:42:05.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:42:04 gibba015 bash[29377]: cluster 2021-03-10T15:42:03.870164+0000 mgr.gibba045.orlgmj (mgr.34412) 5992 : cluster [DBG] pgmap v3408: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:05.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:42:04 gibba015 bash[30343]: cluster 2021-03-10T15:42:03.870164+0000 mgr.gibba045.orlgmj (mgr.34412) 5992 : cluster [DBG] pgmap v3408: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:05.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:42:04 gibba045 bash[25517]: cluster 2021-03-10T15:42:03.870164+0000 mgr.gibba045.orlgmj (mgr.34412) 5992 : cluster [DBG] pgmap v3408: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:07.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:42:06 gibba015 bash[29377]: cluster 2021-03-10T15:42:05.871867+0000 mgr.gibba045.orlgmj (mgr.34412) 5993 : cluster [DBG] pgmap v3409: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:07.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:42:06 gibba015 bash[30343]: cluster 2021-03-10T15:42:05.871867+0000 mgr.gibba045.orlgmj (mgr.34412) 5993 : cluster [DBG] pgmap v3409: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:07.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:42:06 gibba045 bash[25517]: cluster 2021-03-10T15:42:05.871867+0000 mgr.gibba045.orlgmj (mgr.34412) 5993 : cluster [DBG] pgmap v3409: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:09.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:42:08 gibba015 bash[29377]: cluster 2021-03-10T15:42:07.873547+0000 mgr.gibba045.orlgmj (mgr.34412) 5994 : cluster [DBG] pgmap v3410: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:09.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:42:08 gibba015 bash[30343]: cluster 2021-03-10T15:42:07.873547+0000 mgr.gibba045.orlgmj (mgr.34412) 5994 : cluster [DBG] pgmap v3410: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:09.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:42:08 gibba045 bash[25517]: cluster 2021-03-10T15:42:07.873547+0000 mgr.gibba045.orlgmj (mgr.34412) 5994 : cluster [DBG] pgmap v3410: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:10.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:42:10 gibba015 bash[29377]: cluster 2021-03-10T15:42:09.874882+0000 mgr.gibba045.orlgmj (mgr.34412) 5995 : cluster [DBG] pgmap v3411: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:10.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:42:10 gibba015 bash[30343]: cluster 2021-03-10T15:42:09.874882+0000 mgr.gibba045.orlgmj (mgr.34412) 5995 : cluster [DBG] pgmap v3411: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:11.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:42:10 gibba045 bash[25517]: cluster 2021-03-10T15:42:09.874882+0000 mgr.gibba045.orlgmj (mgr.34412) 5995 : cluster [DBG] pgmap v3411: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:13.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:42:12 gibba015 bash[29377]: cluster 2021-03-10T15:42:11.876552+0000 mgr.gibba045.orlgmj (mgr.34412) 5996 : cluster [DBG] pgmap v3412: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:13.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:42:12 gibba015 bash[30343]: cluster 2021-03-10T15:42:11.876552+0000 mgr.gibba045.orlgmj (mgr.34412) 5996 : cluster [DBG] pgmap v3412: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:13.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:42:12 gibba045 bash[25517]: cluster 2021-03-10T15:42:11.876552+0000 mgr.gibba045.orlgmj (mgr.34412) 5996 : cluster [DBG] pgmap v3412: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:15.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:42:14 gibba015 bash[29377]: cluster 2021-03-10T15:42:13.877719+0000 mgr.gibba045.orlgmj (mgr.34412) 5997 : cluster [DBG] pgmap v3413: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:15.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:42:14 gibba015 bash[30343]: cluster 2021-03-10T15:42:13.877719+0000 mgr.gibba045.orlgmj (mgr.34412) 5997 : cluster [DBG] pgmap v3413: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:15.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:42:14 gibba045 bash[25517]: cluster 2021-03-10T15:42:13.877719+0000 mgr.gibba045.orlgmj (mgr.34412) 5997 : cluster [DBG] pgmap v3413: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:17.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:42:16 gibba015 bash[29377]: cluster 2021-03-10T15:42:15.879318+0000 mgr.gibba045.orlgmj (mgr.34412) 5998 : cluster [DBG] pgmap v3414: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:17.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:42:16 gibba015 bash[29377]: audit 2021-03-10T15:42:16.936978+0000 mon.c (mon.1) 1678 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:42:17.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:42:16 gibba015 bash[30343]: cluster 2021-03-10T15:42:15.879318+0000 mgr.gibba045.orlgmj (mgr.34412) 5998 : cluster [DBG] pgmap v3414: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:17.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:42:16 gibba015 bash[30343]: audit 2021-03-10T15:42:16.936978+0000 mon.c (mon.1) 1678 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:42:17.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:42:16 gibba045 bash[25517]: cluster 2021-03-10T15:42:15.879318+0000 mgr.gibba045.orlgmj (mgr.34412) 5998 : cluster [DBG] pgmap v3414: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:17.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:42:16 gibba045 bash[25517]: audit 2021-03-10T15:42:16.936978+0000 mon.c (mon.1) 1678 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:42:18.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:42:18 gibba015 bash[29377]: audit 2021-03-10T15:42:17.138832+0000 mon.a (mon.0) 1505 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:42:18.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:42:18 gibba015 bash[29377]: audit 2021-03-10T15:42:17.141846+0000 mon.a (mon.0) 1506 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:42:18.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:42:18 gibba015 bash[29377]: cephadm 2021-03-10T15:42:17.143641+0000 mgr.gibba045.orlgmj (mgr.34412) 5999 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:42:18.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:42:18 gibba015 bash[29377]: cephadm 2021-03-10T15:42:17.146861+0000 mgr.gibba045.orlgmj (mgr.34412) 6000 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:42:18.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:42:18 gibba015 bash[29377]: audit 2021-03-10T15:42:17.347808+0000 mon.a (mon.0) 1507 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:42:18.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:42:18 gibba015 bash[29377]: audit 2021-03-10T15:42:17.351698+0000 mon.c (mon.1) 1679 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:42:18.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:42:18 gibba015 bash[29377]: audit 2021-03-10T15:42:17.353102+0000 mon.c (mon.1) 1680 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:42:18.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:42:18 gibba015 bash[29377]: audit 2021-03-10T15:42:17.354712+0000 mon.c (mon.1) 1681 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:42:18.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:42:18 gibba015 bash[29377]: audit 2021-03-10T15:42:17.356142+0000 mon.c (mon.1) 1682 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:42:18.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:42:18 gibba015 bash[29377]: audit 2021-03-10T15:42:17.359562+0000 mon.c (mon.1) 1683 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:42:18.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:42:18 gibba015 bash[29377]: audit 2021-03-10T15:42:17.361410+0000 mon.c (mon.1) 1684 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:42:18.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:42:18 gibba015 bash[30343]: audit 2021-03-10T15:42:17.138832+0000 mon.a (mon.0) 1505 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:42:18.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:42:18 gibba015 bash[30343]: audit 2021-03-10T15:42:17.141846+0000 mon.a (mon.0) 1506 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:42:18.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:42:18 gibba015 bash[30343]: cephadm 2021-03-10T15:42:17.143641+0000 mgr.gibba045.orlgmj (mgr.34412) 5999 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:42:18.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:42:18 gibba015 bash[30343]: cephadm 2021-03-10T15:42:17.146861+0000 mgr.gibba045.orlgmj (mgr.34412) 6000 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:42:18.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:42:18 gibba015 bash[30343]: audit 2021-03-10T15:42:17.347808+0000 mon.a (mon.0) 1507 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:42:18.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:42:18 gibba015 bash[30343]: audit 2021-03-10T15:42:17.351698+0000 mon.c (mon.1) 1679 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:42:18.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:42:18 gibba015 bash[30343]: audit 2021-03-10T15:42:17.353102+0000 mon.c (mon.1) 1680 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:42:18.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:42:18 gibba015 bash[30343]: audit 2021-03-10T15:42:17.354712+0000 mon.c (mon.1) 1681 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:42:18.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:42:18 gibba015 bash[30343]: audit 2021-03-10T15:42:17.356142+0000 mon.c (mon.1) 1682 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:42:18.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:42:18 gibba015 bash[30343]: audit 2021-03-10T15:42:17.359562+0000 mon.c (mon.1) 1683 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:42:18.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:42:18 gibba015 bash[30343]: audit 2021-03-10T15:42:17.361410+0000 mon.c (mon.1) 1684 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:42:18.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:42:18 gibba045 bash[25517]: audit 2021-03-10T15:42:17.138832+0000 mon.a (mon.0) 1505 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:42:18.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:42:18 gibba045 bash[25517]: audit 2021-03-10T15:42:17.141846+0000 mon.a (mon.0) 1506 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:42:18.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:42:18 gibba045 bash[25517]: cephadm 2021-03-10T15:42:17.143641+0000 mgr.gibba045.orlgmj (mgr.34412) 5999 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:42:18.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:42:18 gibba045 bash[25517]: cephadm 2021-03-10T15:42:17.146861+0000 mgr.gibba045.orlgmj (mgr.34412) 6000 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:42:18.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:42:18 gibba045 bash[25517]: audit 2021-03-10T15:42:17.347808+0000 mon.a (mon.0) 1507 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:42:18.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:42:18 gibba045 bash[25517]: audit 2021-03-10T15:42:17.351698+0000 mon.c (mon.1) 1679 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:42:18.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:42:18 gibba045 bash[25517]: audit 2021-03-10T15:42:17.353102+0000 mon.c (mon.1) 1680 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:42:18.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:42:18 gibba045 bash[25517]: audit 2021-03-10T15:42:17.354712+0000 mon.c (mon.1) 1681 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:42:18.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:42:18 gibba045 bash[25517]: audit 2021-03-10T15:42:17.356142+0000 mon.c (mon.1) 1682 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:42:18.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:42:18 gibba045 bash[25517]: audit 2021-03-10T15:42:17.359562+0000 mon.c (mon.1) 1683 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:42:18.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:42:18 gibba045 bash[25517]: audit 2021-03-10T15:42:17.361410+0000 mon.c (mon.1) 1684 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:42:18.744 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:42:18.970 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:42:18.971 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (113m) 7m ago 118m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:42:18.971 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (118m) 6m ago 118m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:42:18.971 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (113m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:42:18.971 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (113m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:42:18.972 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (112m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:42:18.972 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (112m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:42:18.972 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (112m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:42:18.972 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (112m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:42:18.973 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (118m) 7m ago 118m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:42:18.973 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (118m) 6m ago 118m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:42:18.973 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (111m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:42:18.974 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (110m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:42:18.974 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (110m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:42:18.974 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (110m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:42:18.974 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (109m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:42:18.975 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (109m) 6m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:42:18.975 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (108m) 6m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:42:18.975 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (108m) 6m ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:42:18.975 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (117m) 6m ago 118m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:42:18.976 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 6m ago 116m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:42:19.217 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:42:19.217 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:42:19.217 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:42:19.217 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:42:19.218 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:42:19.218 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:42:19.218 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:42:19.218 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:42:19.219 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:42:19.219 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:42:19.219 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:42:19.219 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:42:19.220 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:42:19.220 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:42:19.220 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:42:19.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:42:19 gibba015 bash[29377]: cephadm 2021-03-10T15:42:17.354446+0000 mgr.gibba045.orlgmj (mgr.34412) 6001 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:42:19.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:42:19 gibba015 bash[29377]: cephadm 2021-03-10T15:42:17.356162+0000 mgr.gibba045.orlgmj (mgr.34412) 6002 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:42:19.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:42:19 gibba015 bash[29377]: cephadm 2021-03-10T15:42:17.357612+0000 mgr.gibba045.orlgmj (mgr.34412) 6003 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:42:19.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:42:19 gibba015 bash[29377]: cephadm 2021-03-10T15:42:17.357668+0000 mgr.gibba045.orlgmj (mgr.34412) 6004 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:42:19.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:42:19 gibba015 bash[29377]: cephadm 2021-03-10T15:42:17.359099+0000 mgr.gibba045.orlgmj (mgr.34412) 6005 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:42:19.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:42:19 gibba015 bash[29377]: cephadm 2021-03-10T15:42:17.359157+0000 mgr.gibba045.orlgmj (mgr.34412) 6006 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:42:19.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:42:19 gibba015 bash[29377]: cephadm 2021-03-10T15:42:17.360620+0000 mgr.gibba045.orlgmj (mgr.34412) 6007 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:42:19.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:42:19 gibba015 bash[29377]: cephadm 2021-03-10T15:42:17.362358+0000 mgr.gibba045.orlgmj (mgr.34412) 6008 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:42:19.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:42:19 gibba015 bash[29377]: cephadm 2021-03-10T15:42:17.362436+0000 mgr.gibba045.orlgmj (mgr.34412) 6009 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:42:19.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:42:19 gibba015 bash[29377]: cephadm 2021-03-10T15:42:17.364068+0000 mgr.gibba045.orlgmj (mgr.34412) 6010 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:42:19.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:42:19 gibba015 bash[29377]: cephadm 2021-03-10T15:42:17.364381+0000 mgr.gibba045.orlgmj (mgr.34412) 6011 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:42:19.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:42:19 gibba015 bash[29377]: cephadm 2021-03-10T15:42:17.365707+0000 mgr.gibba045.orlgmj (mgr.34412) 6012 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:42:19.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:42:19 gibba015 bash[29377]: cephadm 2021-03-10T15:42:17.365747+0000 mgr.gibba045.orlgmj (mgr.34412) 6013 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:42:19.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:42:19 gibba015 bash[29377]: cephadm 2021-03-10T15:42:17.365855+0000 mgr.gibba045.orlgmj (mgr.34412) 6014 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:42:19.479 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:42:19 gibba015 bash[29377]: cluster 2021-03-10T15:42:17.880694+0000 mgr.gibba045.orlgmj (mgr.34412) 6015 : cluster [DBG] pgmap v3415: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:19.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:42:19 gibba015 bash[30343]: cephadm 2021-03-10T15:42:17.354446+0000 mgr.gibba045.orlgmj (mgr.34412) 6001 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:42:19.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:42:19 gibba015 bash[30343]: cephadm 2021-03-10T15:42:17.356162+0000 mgr.gibba045.orlgmj (mgr.34412) 6002 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:42:19.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:42:19 gibba015 bash[30343]: cephadm 2021-03-10T15:42:17.357612+0000 mgr.gibba045.orlgmj (mgr.34412) 6003 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:42:19.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:42:19 gibba015 bash[30343]: cephadm 2021-03-10T15:42:17.357668+0000 mgr.gibba045.orlgmj (mgr.34412) 6004 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:42:19.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:42:19 gibba015 bash[30343]: cephadm 2021-03-10T15:42:17.359099+0000 mgr.gibba045.orlgmj (mgr.34412) 6005 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:42:19.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:42:19 gibba015 bash[30343]: cephadm 2021-03-10T15:42:17.359157+0000 mgr.gibba045.orlgmj (mgr.34412) 6006 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:42:19.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:42:19 gibba015 bash[30343]: cephadm 2021-03-10T15:42:17.360620+0000 mgr.gibba045.orlgmj (mgr.34412) 6007 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:42:19.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:42:19 gibba015 bash[30343]: cephadm 2021-03-10T15:42:17.362358+0000 mgr.gibba045.orlgmj (mgr.34412) 6008 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:42:19.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:42:19 gibba015 bash[30343]: cephadm 2021-03-10T15:42:17.362436+0000 mgr.gibba045.orlgmj (mgr.34412) 6009 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:42:19.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:42:19 gibba015 bash[30343]: cephadm 2021-03-10T15:42:17.364068+0000 mgr.gibba045.orlgmj (mgr.34412) 6010 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:42:19.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:42:19 gibba015 bash[30343]: cephadm 2021-03-10T15:42:17.364381+0000 mgr.gibba045.orlgmj (mgr.34412) 6011 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:42:19.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:42:19 gibba015 bash[30343]: cephadm 2021-03-10T15:42:17.365707+0000 mgr.gibba045.orlgmj (mgr.34412) 6012 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:42:19.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:42:19 gibba015 bash[30343]: cephadm 2021-03-10T15:42:17.365747+0000 mgr.gibba045.orlgmj (mgr.34412) 6013 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:42:19.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:42:19 gibba015 bash[30343]: cephadm 2021-03-10T15:42:17.365855+0000 mgr.gibba045.orlgmj (mgr.34412) 6014 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:42:19.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:42:19 gibba015 bash[30343]: cluster 2021-03-10T15:42:17.880694+0000 mgr.gibba045.orlgmj (mgr.34412) 6015 : cluster [DBG] pgmap v3415: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:19.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:42:19 gibba045 bash[25517]: cephadm 2021-03-10T15:42:17.354446+0000 mgr.gibba045.orlgmj (mgr.34412) 6001 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:42:19.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:42:19 gibba045 bash[25517]: cephadm 2021-03-10T15:42:17.356162+0000 mgr.gibba045.orlgmj (mgr.34412) 6002 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:42:19.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:42:19 gibba045 bash[25517]: cephadm 2021-03-10T15:42:17.357612+0000 mgr.gibba045.orlgmj (mgr.34412) 6003 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:42:19.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:42:19 gibba045 bash[25517]: cephadm 2021-03-10T15:42:17.357668+0000 mgr.gibba045.orlgmj (mgr.34412) 6004 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:42:19.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:42:19 gibba045 bash[25517]: cephadm 2021-03-10T15:42:17.359099+0000 mgr.gibba045.orlgmj (mgr.34412) 6005 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:42:19.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:42:19 gibba045 bash[25517]: cephadm 2021-03-10T15:42:17.359157+0000 mgr.gibba045.orlgmj (mgr.34412) 6006 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:42:19.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:42:19 gibba045 bash[25517]: cephadm 2021-03-10T15:42:17.360620+0000 mgr.gibba045.orlgmj (mgr.34412) 6007 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:42:19.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:42:19 gibba045 bash[25517]: cephadm 2021-03-10T15:42:17.362358+0000 mgr.gibba045.orlgmj (mgr.34412) 6008 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:42:19.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:42:19 gibba045 bash[25517]: cephadm 2021-03-10T15:42:17.362436+0000 mgr.gibba045.orlgmj (mgr.34412) 6009 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:42:19.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:42:19 gibba045 bash[25517]: cephadm 2021-03-10T15:42:17.364068+0000 mgr.gibba045.orlgmj (mgr.34412) 6010 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:42:19.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:42:19 gibba045 bash[25517]: cephadm 2021-03-10T15:42:17.364381+0000 mgr.gibba045.orlgmj (mgr.34412) 6011 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:42:19.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:42:19 gibba045 bash[25517]: cephadm 2021-03-10T15:42:17.365707+0000 mgr.gibba045.orlgmj (mgr.34412) 6012 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:42:19.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:42:19 gibba045 bash[25517]: cephadm 2021-03-10T15:42:17.365747+0000 mgr.gibba045.orlgmj (mgr.34412) 6013 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:42:19.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:42:19 gibba045 bash[25517]: cephadm 2021-03-10T15:42:17.365855+0000 mgr.gibba045.orlgmj (mgr.34412) 6014 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:42:19.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:42:19 gibba045 bash[25517]: cluster 2021-03-10T15:42:17.880694+0000 mgr.gibba045.orlgmj (mgr.34412) 6015 : cluster [DBG] pgmap v3415: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:20.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:42:20 gibba015 bash[29377]: audit 2021-03-10T15:42:18.733805+0000 mgr.gibba045.orlgmj (mgr.34412) 6016 : audit [DBG] from='client.58072 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:42:20.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:42:20 gibba015 bash[29377]: audit 2021-03-10T15:42:18.956727+0000 mgr.gibba045.orlgmj (mgr.34412) 6017 : audit [DBG] from='client.58078 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:42:20.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:42:20 gibba015 bash[29377]: audit 2021-03-10T15:42:19.212148+0000 mon.c (mon.1) 1685 : audit [DBG] from='client.? 172.21.2.115:0/1365953562' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:42:20.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:42:20 gibba015 bash[30343]: audit 2021-03-10T15:42:18.733805+0000 mgr.gibba045.orlgmj (mgr.34412) 6016 : audit [DBG] from='client.58072 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:42:20.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:42:20 gibba015 bash[30343]: audit 2021-03-10T15:42:18.956727+0000 mgr.gibba045.orlgmj (mgr.34412) 6017 : audit [DBG] from='client.58078 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:42:20.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:42:20 gibba015 bash[30343]: audit 2021-03-10T15:42:19.212148+0000 mon.c (mon.1) 1685 : audit [DBG] from='client.? 172.21.2.115:0/1365953562' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:42:20.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:42:20 gibba045 bash[25517]: audit 2021-03-10T15:42:18.733805+0000 mgr.gibba045.orlgmj (mgr.34412) 6016 : audit [DBG] from='client.58072 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:42:20.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:42:20 gibba045 bash[25517]: audit 2021-03-10T15:42:18.956727+0000 mgr.gibba045.orlgmj (mgr.34412) 6017 : audit [DBG] from='client.58078 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:42:20.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:42:20 gibba045 bash[25517]: audit 2021-03-10T15:42:19.212148+0000 mon.c (mon.1) 1685 : audit [DBG] from='client.? 172.21.2.115:0/1365953562' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:42:21.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:42:21 gibba015 bash[29377]: cluster 2021-03-10T15:42:19.882086+0000 mgr.gibba045.orlgmj (mgr.34412) 6018 : cluster [DBG] pgmap v3416: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:21.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:42:21 gibba015 bash[30343]: cluster 2021-03-10T15:42:19.882086+0000 mgr.gibba045.orlgmj (mgr.34412) 6018 : cluster [DBG] pgmap v3416: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:21.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:42:21 gibba045 bash[25517]: cluster 2021-03-10T15:42:19.882086+0000 mgr.gibba045.orlgmj (mgr.34412) 6018 : cluster [DBG] pgmap v3416: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:23.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:42:23 gibba015 bash[29377]: cluster 2021-03-10T15:42:21.883693+0000 mgr.gibba045.orlgmj (mgr.34412) 6019 : cluster [DBG] pgmap v3417: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:23.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:42:23 gibba015 bash[30343]: cluster 2021-03-10T15:42:21.883693+0000 mgr.gibba045.orlgmj (mgr.34412) 6019 : cluster [DBG] pgmap v3417: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:23.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:42:23 gibba045 bash[25517]: cluster 2021-03-10T15:42:21.883693+0000 mgr.gibba045.orlgmj (mgr.34412) 6019 : cluster [DBG] pgmap v3417: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:25.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:42:25 gibba015 bash[29377]: cluster 2021-03-10T15:42:23.885070+0000 mgr.gibba045.orlgmj (mgr.34412) 6020 : cluster [DBG] pgmap v3418: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:25.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:42:25 gibba015 bash[30343]: cluster 2021-03-10T15:42:23.885070+0000 mgr.gibba045.orlgmj (mgr.34412) 6020 : cluster [DBG] pgmap v3418: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:25.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:42:25 gibba045 bash[25517]: cluster 2021-03-10T15:42:23.885070+0000 mgr.gibba045.orlgmj (mgr.34412) 6020 : cluster [DBG] pgmap v3418: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:27.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:42:27 gibba015 bash[29377]: cluster 2021-03-10T15:42:25.886726+0000 mgr.gibba045.orlgmj (mgr.34412) 6021 : cluster [DBG] pgmap v3419: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:27.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:42:27 gibba015 bash[30343]: cluster 2021-03-10T15:42:25.886726+0000 mgr.gibba045.orlgmj (mgr.34412) 6021 : cluster [DBG] pgmap v3419: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:27.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:42:27 gibba045 bash[25517]: cluster 2021-03-10T15:42:25.886726+0000 mgr.gibba045.orlgmj (mgr.34412) 6021 : cluster [DBG] pgmap v3419: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:29.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:42:29 gibba015 bash[29377]: cluster 2021-03-10T15:42:27.888331+0000 mgr.gibba045.orlgmj (mgr.34412) 6022 : cluster [DBG] pgmap v3420: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:29.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:42:29 gibba015 bash[30343]: cluster 2021-03-10T15:42:27.888331+0000 mgr.gibba045.orlgmj (mgr.34412) 6022 : cluster [DBG] pgmap v3420: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:29.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:42:29 gibba045 bash[25517]: cluster 2021-03-10T15:42:27.888331+0000 mgr.gibba045.orlgmj (mgr.34412) 6022 : cluster [DBG] pgmap v3420: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:31.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:42:30 gibba045 bash[25517]: cluster 2021-03-10T15:42:29.890056+0000 mgr.gibba045.orlgmj (mgr.34412) 6023 : cluster [DBG] pgmap v3421: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:31.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:42:30 gibba015 bash[29377]: cluster 2021-03-10T15:42:29.890056+0000 mgr.gibba045.orlgmj (mgr.34412) 6023 : cluster [DBG] pgmap v3421: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:31.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:42:30 gibba015 bash[30343]: cluster 2021-03-10T15:42:29.890056+0000 mgr.gibba045.orlgmj (mgr.34412) 6023 : cluster [DBG] pgmap v3421: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:33.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:42:32 gibba015 bash[29377]: cluster 2021-03-10T15:42:31.891790+0000 mgr.gibba045.orlgmj (mgr.34412) 6024 : cluster [DBG] pgmap v3422: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:33.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:42:32 gibba015 bash[30343]: cluster 2021-03-10T15:42:31.891790+0000 mgr.gibba045.orlgmj (mgr.34412) 6024 : cluster [DBG] pgmap v3422: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:33.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:42:32 gibba045 bash[25517]: cluster 2021-03-10T15:42:31.891790+0000 mgr.gibba045.orlgmj (mgr.34412) 6024 : cluster [DBG] pgmap v3422: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:34.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:42:33 gibba015 bash[29377]: cephadm 2021-03-10T15:42:32.381900+0000 mgr.gibba045.orlgmj (mgr.34412) 6025 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:42:34.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:42:33 gibba015 bash[30343]: cephadm 2021-03-10T15:42:32.381900+0000 mgr.gibba045.orlgmj (mgr.34412) 6025 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:42:34.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:42:33 gibba045 bash[25517]: cephadm 2021-03-10T15:42:32.381900+0000 mgr.gibba045.orlgmj (mgr.34412) 6025 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:42:35.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:42:34 gibba015 bash[29377]: cluster 2021-03-10T15:42:33.893051+0000 mgr.gibba045.orlgmj (mgr.34412) 6026 : cluster [DBG] pgmap v3423: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:35.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:42:34 gibba015 bash[30343]: cluster 2021-03-10T15:42:33.893051+0000 mgr.gibba045.orlgmj (mgr.34412) 6026 : cluster [DBG] pgmap v3423: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:35.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:42:34 gibba045 bash[25517]: cluster 2021-03-10T15:42:33.893051+0000 mgr.gibba045.orlgmj (mgr.34412) 6026 : cluster [DBG] pgmap v3423: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:37.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:42:36 gibba045 bash[25517]: cluster 2021-03-10T15:42:35.894627+0000 mgr.gibba045.orlgmj (mgr.34412) 6027 : cluster [DBG] pgmap v3424: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:37.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:42:36 gibba015 bash[29377]: cluster 2021-03-10T15:42:35.894627+0000 mgr.gibba045.orlgmj (mgr.34412) 6027 : cluster [DBG] pgmap v3424: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:37.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:42:36 gibba015 bash[30343]: cluster 2021-03-10T15:42:35.894627+0000 mgr.gibba045.orlgmj (mgr.34412) 6027 : cluster [DBG] pgmap v3424: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:39.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:42:38 gibba045 bash[25517]: cluster 2021-03-10T15:42:37.896199+0000 mgr.gibba045.orlgmj (mgr.34412) 6028 : cluster [DBG] pgmap v3425: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:39.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:42:38 gibba015 bash[29377]: cluster 2021-03-10T15:42:37.896199+0000 mgr.gibba045.orlgmj (mgr.34412) 6028 : cluster [DBG] pgmap v3425: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:39.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:42:38 gibba015 bash[30343]: cluster 2021-03-10T15:42:37.896199+0000 mgr.gibba045.orlgmj (mgr.34412) 6028 : cluster [DBG] pgmap v3425: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:41.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:42:40 gibba045 bash[25517]: cluster 2021-03-10T15:42:39.897707+0000 mgr.gibba045.orlgmj (mgr.34412) 6029 : cluster [DBG] pgmap v3426: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:41.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:42:40 gibba015 bash[30343]: cluster 2021-03-10T15:42:39.897707+0000 mgr.gibba045.orlgmj (mgr.34412) 6029 : cluster [DBG] pgmap v3426: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:41.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:42:40 gibba015 bash[29377]: cluster 2021-03-10T15:42:39.897707+0000 mgr.gibba045.orlgmj (mgr.34412) 6029 : cluster [DBG] pgmap v3426: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:43.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:42:42 gibba015 bash[29377]: cluster 2021-03-10T15:42:41.899375+0000 mgr.gibba045.orlgmj (mgr.34412) 6030 : cluster [DBG] pgmap v3427: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:43.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:42:42 gibba015 bash[30343]: cluster 2021-03-10T15:42:41.899375+0000 mgr.gibba045.orlgmj (mgr.34412) 6030 : cluster [DBG] pgmap v3427: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:43.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:42:42 gibba045 bash[25517]: cluster 2021-03-10T15:42:41.899375+0000 mgr.gibba045.orlgmj (mgr.34412) 6030 : cluster [DBG] pgmap v3427: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:45.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:42:44 gibba015 bash[29377]: cluster 2021-03-10T15:42:43.900623+0000 mgr.gibba045.orlgmj (mgr.34412) 6031 : cluster [DBG] pgmap v3428: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:45.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:42:44 gibba015 bash[30343]: cluster 2021-03-10T15:42:43.900623+0000 mgr.gibba045.orlgmj (mgr.34412) 6031 : cluster [DBG] pgmap v3428: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:45.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:42:44 gibba045 bash[25517]: cluster 2021-03-10T15:42:43.900623+0000 mgr.gibba045.orlgmj (mgr.34412) 6031 : cluster [DBG] pgmap v3428: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:47.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:42:46 gibba045 bash[25517]: cluster 2021-03-10T15:42:45.902084+0000 mgr.gibba045.orlgmj (mgr.34412) 6032 : cluster [DBG] pgmap v3429: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:47.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:42:46 gibba015 bash[29377]: cluster 2021-03-10T15:42:45.902084+0000 mgr.gibba045.orlgmj (mgr.34412) 6032 : cluster [DBG] pgmap v3429: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:47.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:42:46 gibba015 bash[30343]: cluster 2021-03-10T15:42:45.902084+0000 mgr.gibba045.orlgmj (mgr.34412) 6032 : cluster [DBG] pgmap v3429: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:49.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:42:48 gibba045 bash[25517]: cephadm 2021-03-10T15:42:47.397694+0000 mgr.gibba045.orlgmj (mgr.34412) 6033 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:42:49.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:42:48 gibba045 bash[25517]: cluster 2021-03-10T15:42:47.903594+0000 mgr.gibba045.orlgmj (mgr.34412) 6034 : cluster [DBG] pgmap v3430: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:49.466 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:42:49.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:42:48 gibba015 bash[29377]: cephadm 2021-03-10T15:42:47.397694+0000 mgr.gibba045.orlgmj (mgr.34412) 6033 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:42:49.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:42:48 gibba015 bash[29377]: cluster 2021-03-10T15:42:47.903594+0000 mgr.gibba045.orlgmj (mgr.34412) 6034 : cluster [DBG] pgmap v3430: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:49.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:42:48 gibba015 bash[30343]: cephadm 2021-03-10T15:42:47.397694+0000 mgr.gibba045.orlgmj (mgr.34412) 6033 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:42:49.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:42:48 gibba015 bash[30343]: cluster 2021-03-10T15:42:47.903594+0000 mgr.gibba045.orlgmj (mgr.34412) 6034 : cluster [DBG] pgmap v3430: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:49.710 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:42:49.710 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (113m) 7m ago 118m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:42:49.711 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (118m) 6m ago 118m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:42:49.711 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (113m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:42:49.711 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (114m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:42:49.711 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (113m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:42:49.712 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (113m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:42:49.712 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (112m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:42:49.712 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (112m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:42:49.712 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (119m) 7m ago 119m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:42:49.712 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (119m) 6m ago 119m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:42:49.713 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (111m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:42:49.713 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (111m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:42:49.713 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (110m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:42:49.713 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (110m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:42:49.714 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (110m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:42:49.714 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (109m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:42:49.714 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (109m) 6m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:42:49.714 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (108m) 6m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:42:49.715 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (118m) 6m ago 119m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:42:49.715 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 6m ago 117m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:42:49.961 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:42:49.961 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:42:49.962 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:42:49.962 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:42:49.962 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:42:49.962 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:42:49.962 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:42:49.963 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:42:49.963 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:42:49.963 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:42:49.963 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:42:49.964 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:42:49.964 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:42:49.964 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:42:49.964 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:42:51.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:42:50 gibba045 bash[25517]: audit 2021-03-10T15:42:49.447791+0000 mgr.gibba045.orlgmj (mgr.34412) 6035 : audit [DBG] from='client.58090 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:42:51.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:42:50 gibba045 bash[25517]: audit 2021-03-10T15:42:49.698134+0000 mgr.gibba045.orlgmj (mgr.34412) 6036 : audit [DBG] from='client.48108 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:42:51.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:42:50 gibba045 bash[25517]: cluster 2021-03-10T15:42:49.905079+0000 mgr.gibba045.orlgmj (mgr.34412) 6037 : cluster [DBG] pgmap v3431: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:51.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:42:50 gibba045 bash[25517]: audit 2021-03-10T15:42:49.956721+0000 mon.c (mon.1) 1686 : audit [DBG] from='client.? 172.21.2.115:0/1204847974' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:42:51.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:42:50 gibba015 bash[29377]: audit 2021-03-10T15:42:49.447791+0000 mgr.gibba045.orlgmj (mgr.34412) 6035 : audit [DBG] from='client.58090 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:42:51.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:42:50 gibba015 bash[29377]: audit 2021-03-10T15:42:49.698134+0000 mgr.gibba045.orlgmj (mgr.34412) 6036 : audit [DBG] from='client.48108 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:42:51.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:42:50 gibba015 bash[29377]: cluster 2021-03-10T15:42:49.905079+0000 mgr.gibba045.orlgmj (mgr.34412) 6037 : cluster [DBG] pgmap v3431: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:51.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:42:50 gibba015 bash[29377]: audit 2021-03-10T15:42:49.956721+0000 mon.c (mon.1) 1686 : audit [DBG] from='client.? 172.21.2.115:0/1204847974' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:42:51.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:42:50 gibba015 bash[30343]: audit 2021-03-10T15:42:49.447791+0000 mgr.gibba045.orlgmj (mgr.34412) 6035 : audit [DBG] from='client.58090 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:42:51.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:42:50 gibba015 bash[30343]: audit 2021-03-10T15:42:49.698134+0000 mgr.gibba045.orlgmj (mgr.34412) 6036 : audit [DBG] from='client.48108 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:42:51.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:42:50 gibba015 bash[30343]: cluster 2021-03-10T15:42:49.905079+0000 mgr.gibba045.orlgmj (mgr.34412) 6037 : cluster [DBG] pgmap v3431: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:51.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:42:50 gibba015 bash[30343]: audit 2021-03-10T15:42:49.956721+0000 mon.c (mon.1) 1686 : audit [DBG] from='client.? 172.21.2.115:0/1204847974' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:42:53.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:42:52 gibba015 bash[29377]: cluster 2021-03-10T15:42:51.906890+0000 mgr.gibba045.orlgmj (mgr.34412) 6038 : cluster [DBG] pgmap v3432: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:53.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:42:52 gibba015 bash[30343]: cluster 2021-03-10T15:42:51.906890+0000 mgr.gibba045.orlgmj (mgr.34412) 6038 : cluster [DBG] pgmap v3432: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:53.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:42:52 gibba045 bash[25517]: cluster 2021-03-10T15:42:51.906890+0000 mgr.gibba045.orlgmj (mgr.34412) 6038 : cluster [DBG] pgmap v3432: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:53.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:42:53 gibba015 bash[30343]: audit 2021-03-10T15:42:53.242423+0000 mon.c (mon.1) 1687 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:42:53.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:42:53 gibba015 bash[30343]: audit 2021-03-10T15:42:53.243066+0000 mon.c (mon.1) 1688 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:42:53.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:42:53 gibba015 bash[30343]: audit 2021-03-10T15:42:53.243522+0000 mon.a (mon.0) 1508 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:42:53.984 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:42:53 gibba015 bash[30343]: audit 2021-03-10T15:42:53.244913+0000 mon.a (mon.0) 1509 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:42:53.984 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:42:53 gibba015 bash[29377]: audit 2021-03-10T15:42:53.242423+0000 mon.c (mon.1) 1687 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:42:53.984 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:42:53 gibba015 bash[29377]: audit 2021-03-10T15:42:53.243066+0000 mon.c (mon.1) 1688 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:42:53.984 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:42:53 gibba015 bash[29377]: audit 2021-03-10T15:42:53.243522+0000 mon.a (mon.0) 1508 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:42:53.985 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:42:53 gibba015 bash[29377]: audit 2021-03-10T15:42:53.244913+0000 mon.a (mon.0) 1509 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:42:53.985 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:42:53 gibba015 bash[29377]: audit 2021-03-10T15:42:53.246477+0000 mon.c (mon.1) 1689 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T15:42:53.985 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:42:53 gibba015 bash[29377]: audit 2021-03-10T15:42:53.247377+0000 mon.c (mon.1) 1690 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:42:53.986 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:42:53 gibba015 bash[29377]: audit 2021-03-10T15:42:53.247691+0000 mon.a (mon.0) 1510 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T15:42:53.986 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:42:53 gibba015 bash[29377]: audit 2021-03-10T15:42:53.248075+0000 mon.c (mon.1) 1691 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:42:53.986 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:42:53 gibba015 bash[29377]: audit 2021-03-10T15:42:53.248908+0000 mon.c (mon.1) 1692 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:42:53.986 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:42:53 gibba015 bash[29377]: audit 2021-03-10T15:42:53.249011+0000 mon.a (mon.0) 1511 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:42:53.986 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:42:53 gibba015 bash[29377]: audit 2021-03-10T15:42:53.250264+0000 mon.a (mon.0) 1512 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:42:53.987 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:42:53 gibba015 bash[29377]: audit 2021-03-10T15:42:53.251073+0000 mon.a (mon.0) 1513 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:42:54.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:42:53 gibba045 bash[25517]: audit 2021-03-10T15:42:53.242423+0000 mon.c (mon.1) 1687 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:42:54.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:42:53 gibba045 bash[25517]: audit 2021-03-10T15:42:53.243066+0000 mon.c (mon.1) 1688 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:42:54.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:42:53 gibba045 bash[25517]: audit 2021-03-10T15:42:53.243522+0000 mon.a (mon.0) 1508 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:42:54.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:42:53 gibba045 bash[25517]: audit 2021-03-10T15:42:53.244913+0000 mon.a (mon.0) 1509 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:42:54.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:42:53 gibba045 bash[25517]: audit 2021-03-10T15:42:53.246477+0000 mon.c (mon.1) 1689 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T15:42:54.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:42:53 gibba045 bash[25517]: audit 2021-03-10T15:42:53.247377+0000 mon.c (mon.1) 1690 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:42:54.312 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:42:53 gibba045 bash[25517]: audit 2021-03-10T15:42:53.247691+0000 mon.a (mon.0) 1510 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T15:42:54.312 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:42:53 gibba045 bash[25517]: audit 2021-03-10T15:42:53.248075+0000 mon.c (mon.1) 1691 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:42:54.312 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:42:53 gibba045 bash[25517]: audit 2021-03-10T15:42:53.248908+0000 mon.c (mon.1) 1692 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:42:54.312 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:42:53 gibba045 bash[25517]: audit 2021-03-10T15:42:53.249011+0000 mon.a (mon.0) 1511 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:42:54.313 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:42:53 gibba045 bash[25517]: audit 2021-03-10T15:42:53.250264+0000 mon.a (mon.0) 1512 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:42:54.313 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:42:53 gibba045 bash[25517]: audit 2021-03-10T15:42:53.251073+0000 mon.a (mon.0) 1513 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:42:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:42:53 gibba015 bash[30343]: audit 2021-03-10T15:42:53.246477+0000 mon.c (mon.1) 1689 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T15:42:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:42:53 gibba015 bash[30343]: audit 2021-03-10T15:42:53.247377+0000 mon.c (mon.1) 1690 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:42:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:42:53 gibba015 bash[30343]: audit 2021-03-10T15:42:53.247691+0000 mon.a (mon.0) 1510 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T15:42:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:42:53 gibba015 bash[30343]: audit 2021-03-10T15:42:53.248075+0000 mon.c (mon.1) 1691 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:42:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:42:53 gibba015 bash[30343]: audit 2021-03-10T15:42:53.248908+0000 mon.c (mon.1) 1692 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:42:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:42:53 gibba015 bash[30343]: audit 2021-03-10T15:42:53.249011+0000 mon.a (mon.0) 1511 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:42:54.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:42:53 gibba015 bash[30343]: audit 2021-03-10T15:42:53.250264+0000 mon.a (mon.0) 1512 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:42:54.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:42:53 gibba015 bash[30343]: audit 2021-03-10T15:42:53.251073+0000 mon.a (mon.0) 1513 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:42:55.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:42:54 gibba045 bash[25517]: cluster 2021-03-10T15:42:53.908130+0000 mgr.gibba045.orlgmj (mgr.34412) 6039 : cluster [DBG] pgmap v3433: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:55.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:42:54 gibba015 bash[30343]: cluster 2021-03-10T15:42:53.908130+0000 mgr.gibba045.orlgmj (mgr.34412) 6039 : cluster [DBG] pgmap v3433: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:55.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:42:54 gibba015 bash[29377]: cluster 2021-03-10T15:42:53.908130+0000 mgr.gibba045.orlgmj (mgr.34412) 6039 : cluster [DBG] pgmap v3433: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:57.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:42:56 gibba045 bash[25517]: cluster 2021-03-10T15:42:55.909721+0000 mgr.gibba045.orlgmj (mgr.34412) 6040 : cluster [DBG] pgmap v3434: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:57.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:42:56 gibba015 bash[29377]: cluster 2021-03-10T15:42:55.909721+0000 mgr.gibba045.orlgmj (mgr.34412) 6040 : cluster [DBG] pgmap v3434: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:57.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:42:56 gibba015 bash[30343]: cluster 2021-03-10T15:42:55.909721+0000 mgr.gibba045.orlgmj (mgr.34412) 6040 : cluster [DBG] pgmap v3434: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:59.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:42:59 gibba045 bash[25517]: cluster 2021-03-10T15:42:57.911257+0000 mgr.gibba045.orlgmj (mgr.34412) 6041 : cluster [DBG] pgmap v3435: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:59.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:42:58 gibba015 bash[29377]: cluster 2021-03-10T15:42:57.911257+0000 mgr.gibba045.orlgmj (mgr.34412) 6041 : cluster [DBG] pgmap v3435: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:59.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:42:59 gibba015 bash[30343]: cluster 2021-03-10T15:42:57.911257+0000 mgr.gibba045.orlgmj (mgr.34412) 6041 : cluster [DBG] pgmap v3435: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:01.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:43:00 gibba045 bash[25517]: cluster 2021-03-10T15:42:59.912723+0000 mgr.gibba045.orlgmj (mgr.34412) 6042 : cluster [DBG] pgmap v3436: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:01.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:43:00 gibba015 bash[29377]: cluster 2021-03-10T15:42:59.912723+0000 mgr.gibba045.orlgmj (mgr.34412) 6042 : cluster [DBG] pgmap v3436: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:01.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:43:00 gibba015 bash[30343]: cluster 2021-03-10T15:42:59.912723+0000 mgr.gibba045.orlgmj (mgr.34412) 6042 : cluster [DBG] pgmap v3436: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:03.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:43:02 gibba045 bash[25517]: cluster 2021-03-10T15:43:01.914476+0000 mgr.gibba045.orlgmj (mgr.34412) 6043 : cluster [DBG] pgmap v3437: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:03.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:43:02 gibba015 bash[29377]: cluster 2021-03-10T15:43:01.914476+0000 mgr.gibba045.orlgmj (mgr.34412) 6043 : cluster [DBG] pgmap v3437: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:03.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:43:02 gibba015 bash[30343]: cluster 2021-03-10T15:43:01.914476+0000 mgr.gibba045.orlgmj (mgr.34412) 6043 : cluster [DBG] pgmap v3437: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:04.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:43:03 gibba045 bash[25517]: cephadm 2021-03-10T15:43:02.413717+0000 mgr.gibba045.orlgmj (mgr.34412) 6044 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:43:04.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:43:03 gibba015 bash[29377]: cephadm 2021-03-10T15:43:02.413717+0000 mgr.gibba045.orlgmj (mgr.34412) 6044 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:43:04.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:43:03 gibba015 bash[30343]: cephadm 2021-03-10T15:43:02.413717+0000 mgr.gibba045.orlgmj (mgr.34412) 6044 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:43:05.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:43:04 gibba045 bash[25517]: cluster 2021-03-10T15:43:03.915762+0000 mgr.gibba045.orlgmj (mgr.34412) 6045 : cluster [DBG] pgmap v3438: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:05.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:43:04 gibba015 bash[29377]: cluster 2021-03-10T15:43:03.915762+0000 mgr.gibba045.orlgmj (mgr.34412) 6045 : cluster [DBG] pgmap v3438: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:05.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:43:04 gibba015 bash[30343]: cluster 2021-03-10T15:43:03.915762+0000 mgr.gibba045.orlgmj (mgr.34412) 6045 : cluster [DBG] pgmap v3438: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:07.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:43:07 gibba045 bash[25517]: cluster 2021-03-10T15:43:05.917437+0000 mgr.gibba045.orlgmj (mgr.34412) 6046 : cluster [DBG] pgmap v3439: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:07.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:43:06 gibba015 bash[29377]: cluster 2021-03-10T15:43:05.917437+0000 mgr.gibba045.orlgmj (mgr.34412) 6046 : cluster [DBG] pgmap v3439: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:07.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:43:07 gibba015 bash[30343]: cluster 2021-03-10T15:43:05.917437+0000 mgr.gibba045.orlgmj (mgr.34412) 6046 : cluster [DBG] pgmap v3439: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:09.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:43:09 gibba045 bash[25517]: cluster 2021-03-10T15:43:07.918935+0000 mgr.gibba045.orlgmj (mgr.34412) 6047 : cluster [DBG] pgmap v3440: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:09.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:43:09 gibba015 bash[29377]: cluster 2021-03-10T15:43:07.918935+0000 mgr.gibba045.orlgmj (mgr.34412) 6047 : cluster [DBG] pgmap v3440: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:09.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:43:09 gibba015 bash[30343]: cluster 2021-03-10T15:43:07.918935+0000 mgr.gibba045.orlgmj (mgr.34412) 6047 : cluster [DBG] pgmap v3440: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:11.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:43:10 gibba045 bash[25517]: cluster 2021-03-10T15:43:09.920654+0000 mgr.gibba045.orlgmj (mgr.34412) 6048 : cluster [DBG] pgmap v3441: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:11.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:43:10 gibba015 bash[29377]: cluster 2021-03-10T15:43:09.920654+0000 mgr.gibba045.orlgmj (mgr.34412) 6048 : cluster [DBG] pgmap v3441: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:11.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:43:10 gibba015 bash[30343]: cluster 2021-03-10T15:43:09.920654+0000 mgr.gibba045.orlgmj (mgr.34412) 6048 : cluster [DBG] pgmap v3441: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:13.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:43:12 gibba045 bash[25517]: cluster 2021-03-10T15:43:11.922325+0000 mgr.gibba045.orlgmj (mgr.34412) 6049 : cluster [DBG] pgmap v3442: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:13.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:43:12 gibba015 bash[29377]: cluster 2021-03-10T15:43:11.922325+0000 mgr.gibba045.orlgmj (mgr.34412) 6049 : cluster [DBG] pgmap v3442: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:13.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:43:12 gibba015 bash[30343]: cluster 2021-03-10T15:43:11.922325+0000 mgr.gibba045.orlgmj (mgr.34412) 6049 : cluster [DBG] pgmap v3442: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:15.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:43:14 gibba045 bash[25517]: cluster 2021-03-10T15:43:13.923691+0000 mgr.gibba045.orlgmj (mgr.34412) 6050 : cluster [DBG] pgmap v3443: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:15.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:43:14 gibba015 bash[29377]: cluster 2021-03-10T15:43:13.923691+0000 mgr.gibba045.orlgmj (mgr.34412) 6050 : cluster [DBG] pgmap v3443: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:15.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:43:14 gibba015 bash[30343]: cluster 2021-03-10T15:43:13.923691+0000 mgr.gibba045.orlgmj (mgr.34412) 6050 : cluster [DBG] pgmap v3443: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:17.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:43:17 gibba045 bash[25517]: cluster 2021-03-10T15:43:15.925306+0000 mgr.gibba045.orlgmj (mgr.34412) 6051 : cluster [DBG] pgmap v3444: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:17.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:43:16 gibba015 bash[29377]: cluster 2021-03-10T15:43:15.925306+0000 mgr.gibba045.orlgmj (mgr.34412) 6051 : cluster [DBG] pgmap v3444: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:17.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:43:17 gibba015 bash[30343]: cluster 2021-03-10T15:43:15.925306+0000 mgr.gibba045.orlgmj (mgr.34412) 6051 : cluster [DBG] pgmap v3444: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:18.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:43:18 gibba045 bash[25517]: audit 2021-03-10T15:43:17.427646+0000 mon.c (mon.1) 1693 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:43:18.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:43:18 gibba045 bash[25517]: audit 2021-03-10T15:43:17.652786+0000 mon.a (mon.0) 1514 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:43:18.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:43:18 gibba045 bash[25517]: audit 2021-03-10T15:43:17.656103+0000 mon.c (mon.1) 1694 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:43:18.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:43:18 gibba045 bash[25517]: audit 2021-03-10T15:43:17.657704+0000 mon.c (mon.1) 1695 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:43:18.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:43:18 gibba045 bash[25517]: audit 2021-03-10T15:43:17.659449+0000 mon.c (mon.1) 1696 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:43:18.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:43:18 gibba045 bash[25517]: audit 2021-03-10T15:43:17.661165+0000 mon.c (mon.1) 1697 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:43:18.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:43:18 gibba045 bash[25517]: audit 2021-03-10T15:43:17.664856+0000 mon.c (mon.1) 1698 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:43:18.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:43:18 gibba045 bash[25517]: audit 2021-03-10T15:43:17.666304+0000 mon.c (mon.1) 1699 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:43:18.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:43:18 gibba015 bash[29377]: audit 2021-03-10T15:43:17.427646+0000 mon.c (mon.1) 1693 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:43:18.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:43:18 gibba015 bash[29377]: audit 2021-03-10T15:43:17.652786+0000 mon.a (mon.0) 1514 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:43:18.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:43:18 gibba015 bash[29377]: audit 2021-03-10T15:43:17.656103+0000 mon.c (mon.1) 1694 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:43:18.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:43:18 gibba015 bash[29377]: audit 2021-03-10T15:43:17.657704+0000 mon.c (mon.1) 1695 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:43:18.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:43:18 gibba015 bash[29377]: audit 2021-03-10T15:43:17.659449+0000 mon.c (mon.1) 1696 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:43:18.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:43:18 gibba015 bash[29377]: audit 2021-03-10T15:43:17.661165+0000 mon.c (mon.1) 1697 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:43:18.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:43:18 gibba015 bash[29377]: audit 2021-03-10T15:43:17.664856+0000 mon.c (mon.1) 1698 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:43:18.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:43:18 gibba015 bash[29377]: audit 2021-03-10T15:43:17.666304+0000 mon.c (mon.1) 1699 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:43:18.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:43:18 gibba015 bash[30343]: audit 2021-03-10T15:43:17.427646+0000 mon.c (mon.1) 1693 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:43:18.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:43:18 gibba015 bash[30343]: audit 2021-03-10T15:43:17.652786+0000 mon.a (mon.0) 1514 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:43:18.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:43:18 gibba015 bash[30343]: audit 2021-03-10T15:43:17.656103+0000 mon.c (mon.1) 1694 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:43:18.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:43:18 gibba015 bash[30343]: audit 2021-03-10T15:43:17.657704+0000 mon.c (mon.1) 1695 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:43:18.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:43:18 gibba015 bash[30343]: audit 2021-03-10T15:43:17.659449+0000 mon.c (mon.1) 1696 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:43:18.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:43:18 gibba015 bash[30343]: audit 2021-03-10T15:43:17.661165+0000 mon.c (mon.1) 1697 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:43:18.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:43:18 gibba015 bash[30343]: audit 2021-03-10T15:43:17.664856+0000 mon.c (mon.1) 1698 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:43:18.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:43:18 gibba015 bash[30343]: audit 2021-03-10T15:43:17.666304+0000 mon.c (mon.1) 1699 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:43:19.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:43:19 gibba045 bash[25517]: cephadm 2021-03-10T15:43:17.435986+0000 mgr.gibba045.orlgmj (mgr.34412) 6052 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:43:19.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:43:19 gibba045 bash[25517]: cephadm 2021-03-10T15:43:17.437486+0000 mgr.gibba045.orlgmj (mgr.34412) 6053 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:43:19.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:43:19 gibba045 bash[25517]: cephadm 2021-03-10T15:43:17.658850+0000 mgr.gibba045.orlgmj (mgr.34412) 6054 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:43:19.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:43:19 gibba045 bash[25517]: cephadm 2021-03-10T15:43:17.660572+0000 mgr.gibba045.orlgmj (mgr.34412) 6055 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:43:19.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:43:19 gibba045 bash[25517]: cephadm 2021-03-10T15:43:17.662292+0000 mgr.gibba045.orlgmj (mgr.34412) 6056 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:43:19.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:43:19 gibba045 bash[25517]: cephadm 2021-03-10T15:43:17.662330+0000 mgr.gibba045.orlgmj (mgr.34412) 6057 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:43:19.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:43:19 gibba045 bash[25517]: cephadm 2021-03-10T15:43:17.664027+0000 mgr.gibba045.orlgmj (mgr.34412) 6058 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:43:19.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:43:19 gibba045 bash[25517]: cephadm 2021-03-10T15:43:17.664062+0000 mgr.gibba045.orlgmj (mgr.34412) 6059 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:43:19.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:43:19 gibba045 bash[25517]: cephadm 2021-03-10T15:43:17.665721+0000 mgr.gibba045.orlgmj (mgr.34412) 6060 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:43:19.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:43:19 gibba045 bash[25517]: cephadm 2021-03-10T15:43:17.667665+0000 mgr.gibba045.orlgmj (mgr.34412) 6061 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:43:19.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:43:19 gibba045 bash[25517]: cephadm 2021-03-10T15:43:17.667702+0000 mgr.gibba045.orlgmj (mgr.34412) 6062 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:43:19.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:43:19 gibba045 bash[25517]: cephadm 2021-03-10T15:43:17.669084+0000 mgr.gibba045.orlgmj (mgr.34412) 6063 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:43:19.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:43:19 gibba045 bash[25517]: cephadm 2021-03-10T15:43:17.669400+0000 mgr.gibba045.orlgmj (mgr.34412) 6064 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:43:19.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:43:19 gibba045 bash[25517]: cephadm 2021-03-10T15:43:17.670706+0000 mgr.gibba045.orlgmj (mgr.34412) 6065 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:43:19.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:43:19 gibba045 bash[25517]: cephadm 2021-03-10T15:43:17.670745+0000 mgr.gibba045.orlgmj (mgr.34412) 6066 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:43:19.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:43:19 gibba045 bash[25517]: cephadm 2021-03-10T15:43:17.670857+0000 mgr.gibba045.orlgmj (mgr.34412) 6067 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:43:19.312 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:43:19 gibba045 bash[25517]: cluster 2021-03-10T15:43:17.926942+0000 mgr.gibba045.orlgmj (mgr.34412) 6068 : cluster [DBG] pgmap v3445: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:19.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:43:19 gibba015 bash[29377]: cephadm 2021-03-10T15:43:17.435986+0000 mgr.gibba045.orlgmj (mgr.34412) 6052 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:43:19.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:43:19 gibba015 bash[29377]: cephadm 2021-03-10T15:43:17.437486+0000 mgr.gibba045.orlgmj (mgr.34412) 6053 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:43:19.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:43:19 gibba015 bash[29377]: cephadm 2021-03-10T15:43:17.658850+0000 mgr.gibba045.orlgmj (mgr.34412) 6054 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:43:19.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:43:19 gibba015 bash[29377]: cephadm 2021-03-10T15:43:17.660572+0000 mgr.gibba045.orlgmj (mgr.34412) 6055 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:43:19.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:43:19 gibba015 bash[29377]: cephadm 2021-03-10T15:43:17.662292+0000 mgr.gibba045.orlgmj (mgr.34412) 6056 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:43:19.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:43:19 gibba015 bash[29377]: cephadm 2021-03-10T15:43:17.662330+0000 mgr.gibba045.orlgmj (mgr.34412) 6057 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:43:19.479 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:43:19 gibba015 bash[29377]: cephadm 2021-03-10T15:43:17.664027+0000 mgr.gibba045.orlgmj (mgr.34412) 6058 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:43:19.479 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:43:19 gibba015 bash[29377]: cephadm 2021-03-10T15:43:17.664062+0000 mgr.gibba045.orlgmj (mgr.34412) 6059 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:43:19.479 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:43:19 gibba015 bash[29377]: cephadm 2021-03-10T15:43:17.665721+0000 mgr.gibba045.orlgmj (mgr.34412) 6060 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:43:19.479 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:43:19 gibba015 bash[29377]: cephadm 2021-03-10T15:43:17.667665+0000 mgr.gibba045.orlgmj (mgr.34412) 6061 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:43:19.480 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:43:19 gibba015 bash[29377]: cephadm 2021-03-10T15:43:17.667702+0000 mgr.gibba045.orlgmj (mgr.34412) 6062 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:43:19.480 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:43:19 gibba015 bash[29377]: cephadm 2021-03-10T15:43:17.669084+0000 mgr.gibba045.orlgmj (mgr.34412) 6063 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:43:19.480 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:43:19 gibba015 bash[29377]: cephadm 2021-03-10T15:43:17.669400+0000 mgr.gibba045.orlgmj (mgr.34412) 6064 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:43:19.480 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:43:19 gibba015 bash[29377]: cephadm 2021-03-10T15:43:17.670706+0000 mgr.gibba045.orlgmj (mgr.34412) 6065 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:43:19.480 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:43:19 gibba015 bash[29377]: cephadm 2021-03-10T15:43:17.670745+0000 mgr.gibba045.orlgmj (mgr.34412) 6066 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:43:19.481 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:43:19 gibba015 bash[29377]: cephadm 2021-03-10T15:43:17.670857+0000 mgr.gibba045.orlgmj (mgr.34412) 6067 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:43:19.481 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:43:19 gibba015 bash[29377]: cluster 2021-03-10T15:43:17.926942+0000 mgr.gibba045.orlgmj (mgr.34412) 6068 : cluster [DBG] pgmap v3445: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:19.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:43:19 gibba015 bash[30343]: cephadm 2021-03-10T15:43:17.435986+0000 mgr.gibba045.orlgmj (mgr.34412) 6052 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:43:19.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:43:19 gibba015 bash[30343]: cephadm 2021-03-10T15:43:17.437486+0000 mgr.gibba045.orlgmj (mgr.34412) 6053 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:43:19.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:43:19 gibba015 bash[30343]: cephadm 2021-03-10T15:43:17.658850+0000 mgr.gibba045.orlgmj (mgr.34412) 6054 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:43:19.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:43:19 gibba015 bash[30343]: cephadm 2021-03-10T15:43:17.660572+0000 mgr.gibba045.orlgmj (mgr.34412) 6055 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:43:19.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:43:19 gibba015 bash[30343]: cephadm 2021-03-10T15:43:17.662292+0000 mgr.gibba045.orlgmj (mgr.34412) 6056 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:43:19.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:43:19 gibba015 bash[30343]: cephadm 2021-03-10T15:43:17.662330+0000 mgr.gibba045.orlgmj (mgr.34412) 6057 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:43:19.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:43:19 gibba015 bash[30343]: cephadm 2021-03-10T15:43:17.664027+0000 mgr.gibba045.orlgmj (mgr.34412) 6058 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:43:19.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:43:19 gibba015 bash[30343]: cephadm 2021-03-10T15:43:17.664062+0000 mgr.gibba045.orlgmj (mgr.34412) 6059 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:43:19.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:43:19 gibba015 bash[30343]: cephadm 2021-03-10T15:43:17.665721+0000 mgr.gibba045.orlgmj (mgr.34412) 6060 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:43:19.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:43:19 gibba015 bash[30343]: cephadm 2021-03-10T15:43:17.667665+0000 mgr.gibba045.orlgmj (mgr.34412) 6061 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:43:19.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:43:19 gibba015 bash[30343]: cephadm 2021-03-10T15:43:17.667702+0000 mgr.gibba045.orlgmj (mgr.34412) 6062 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:43:19.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:43:19 gibba015 bash[30343]: cephadm 2021-03-10T15:43:17.669084+0000 mgr.gibba045.orlgmj (mgr.34412) 6063 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:43:19.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:43:19 gibba015 bash[30343]: cephadm 2021-03-10T15:43:17.669400+0000 mgr.gibba045.orlgmj (mgr.34412) 6064 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:43:19.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:43:19 gibba015 bash[30343]: cephadm 2021-03-10T15:43:17.670706+0000 mgr.gibba045.orlgmj (mgr.34412) 6065 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:43:19.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:43:19 gibba015 bash[30343]: cephadm 2021-03-10T15:43:17.670745+0000 mgr.gibba045.orlgmj (mgr.34412) 6066 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:43:19.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:43:19 gibba015 bash[30343]: cephadm 2021-03-10T15:43:17.670857+0000 mgr.gibba045.orlgmj (mgr.34412) 6067 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:43:19.485 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:43:19 gibba015 bash[30343]: cluster 2021-03-10T15:43:17.926942+0000 mgr.gibba045.orlgmj (mgr.34412) 6068 : cluster [DBG] pgmap v3445: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:20.205 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:43:20.435 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:43:20.435 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (114m) 8m ago 119m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:43:20.435 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (119m) 7m ago 119m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:43:20.435 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (114m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:43:20.436 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (114m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:43:20.436 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (113m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:43:20.436 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (113m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:43:20.436 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (113m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:43:20.437 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (113m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:43:20.437 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (119m) 8m ago 119m 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:43:20.437 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (119m) 7m ago 119m 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:43:20.437 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (112m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:43:20.437 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (111m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:43:20.438 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (111m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:43:20.438 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (111m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:43:20.438 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (110m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:43:20.438 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (110m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:43:20.439 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (109m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:43:20.439 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (109m) 7m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:43:20.439 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (118m) 7m ago 119m 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:43:20.439 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 7m ago 117m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:43:20.682 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:43:20.682 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:43:20.683 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:43:20.683 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:43:20.683 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:43:20.683 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:43:20.684 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:43:20.684 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:43:20.684 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:43:20.684 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:43:20.684 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:43:20.685 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:43:20.685 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:43:20.685 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:43:20.685 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:43:21.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:43:20 gibba045 bash[25517]: cluster 2021-03-10T15:43:19.928633+0000 mgr.gibba045.orlgmj (mgr.34412) 6069 : cluster [DBG] pgmap v3446: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:21.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:43:20 gibba045 bash[25517]: audit 2021-03-10T15:43:20.195515+0000 mgr.gibba045.orlgmj (mgr.34412) 6070 : audit [DBG] from='client.58108 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:43:21.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:43:20 gibba045 bash[25517]: audit 2021-03-10T15:43:20.677809+0000 mon.a (mon.0) 1515 : audit [DBG] from='client.? 172.21.2.115:0/2959432425' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:43:21.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:43:20 gibba015 bash[29377]: cluster 2021-03-10T15:43:19.928633+0000 mgr.gibba045.orlgmj (mgr.34412) 6069 : cluster [DBG] pgmap v3446: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:21.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:43:20 gibba015 bash[29377]: audit 2021-03-10T15:43:20.195515+0000 mgr.gibba045.orlgmj (mgr.34412) 6070 : audit [DBG] from='client.58108 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:43:21.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:43:20 gibba015 bash[29377]: audit 2021-03-10T15:43:20.677809+0000 mon.a (mon.0) 1515 : audit [DBG] from='client.? 172.21.2.115:0/2959432425' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:43:21.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:43:20 gibba015 bash[30343]: cluster 2021-03-10T15:43:19.928633+0000 mgr.gibba045.orlgmj (mgr.34412) 6069 : cluster [DBG] pgmap v3446: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:21.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:43:20 gibba015 bash[30343]: audit 2021-03-10T15:43:20.195515+0000 mgr.gibba045.orlgmj (mgr.34412) 6070 : audit [DBG] from='client.58108 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:43:21.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:43:20 gibba015 bash[30343]: audit 2021-03-10T15:43:20.677809+0000 mon.a (mon.0) 1515 : audit [DBG] from='client.? 172.21.2.115:0/2959432425' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:43:22.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:43:21 gibba045 bash[25517]: audit 2021-03-10T15:43:20.420772+0000 mgr.gibba045.orlgmj (mgr.34412) 6071 : audit [DBG] from='client.58114 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:43:22.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:43:21 gibba015 bash[29377]: audit 2021-03-10T15:43:20.420772+0000 mgr.gibba045.orlgmj (mgr.34412) 6071 : audit [DBG] from='client.58114 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:43:22.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:43:21 gibba015 bash[30343]: audit 2021-03-10T15:43:20.420772+0000 mgr.gibba045.orlgmj (mgr.34412) 6071 : audit [DBG] from='client.58114 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:43:23.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:43:22 gibba045 bash[25517]: cluster 2021-03-10T15:43:21.930372+0000 mgr.gibba045.orlgmj (mgr.34412) 6072 : cluster [DBG] pgmap v3447: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:23.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:43:22 gibba015 bash[29377]: cluster 2021-03-10T15:43:21.930372+0000 mgr.gibba045.orlgmj (mgr.34412) 6072 : cluster [DBG] pgmap v3447: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:23.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:43:22 gibba015 bash[30343]: cluster 2021-03-10T15:43:21.930372+0000 mgr.gibba045.orlgmj (mgr.34412) 6072 : cluster [DBG] pgmap v3447: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:25.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:43:24 gibba045 bash[25517]: cluster 2021-03-10T15:43:23.931588+0000 mgr.gibba045.orlgmj (mgr.34412) 6073 : cluster [DBG] pgmap v3448: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:25.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:43:24 gibba015 bash[29377]: cluster 2021-03-10T15:43:23.931588+0000 mgr.gibba045.orlgmj (mgr.34412) 6073 : cluster [DBG] pgmap v3448: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:25.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:43:24 gibba015 bash[30343]: cluster 2021-03-10T15:43:23.931588+0000 mgr.gibba045.orlgmj (mgr.34412) 6073 : cluster [DBG] pgmap v3448: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:27.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:43:26 gibba045 bash[25517]: cluster 2021-03-10T15:43:25.933401+0000 mgr.gibba045.orlgmj (mgr.34412) 6074 : cluster [DBG] pgmap v3449: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:27.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:43:26 gibba015 bash[29377]: cluster 2021-03-10T15:43:25.933401+0000 mgr.gibba045.orlgmj (mgr.34412) 6074 : cluster [DBG] pgmap v3449: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:27.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:43:26 gibba015 bash[30343]: cluster 2021-03-10T15:43:25.933401+0000 mgr.gibba045.orlgmj (mgr.34412) 6074 : cluster [DBG] pgmap v3449: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:29.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:43:29 gibba045 bash[25517]: cluster 2021-03-10T15:43:27.934720+0000 mgr.gibba045.orlgmj (mgr.34412) 6075 : cluster [DBG] pgmap v3450: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:29.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:43:29 gibba015 bash[29377]: cluster 2021-03-10T15:43:27.934720+0000 mgr.gibba045.orlgmj (mgr.34412) 6075 : cluster [DBG] pgmap v3450: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:29.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:43:29 gibba015 bash[30343]: cluster 2021-03-10T15:43:27.934720+0000 mgr.gibba045.orlgmj (mgr.34412) 6075 : cluster [DBG] pgmap v3450: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:31.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:43:30 gibba045 bash[25517]: cluster 2021-03-10T15:43:29.936077+0000 mgr.gibba045.orlgmj (mgr.34412) 6076 : cluster [DBG] pgmap v3451: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:31.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:43:30 gibba015 bash[29377]: cluster 2021-03-10T15:43:29.936077+0000 mgr.gibba045.orlgmj (mgr.34412) 6076 : cluster [DBG] pgmap v3451: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:31.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:43:30 gibba015 bash[30343]: cluster 2021-03-10T15:43:29.936077+0000 mgr.gibba045.orlgmj (mgr.34412) 6076 : cluster [DBG] pgmap v3451: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:33.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:43:33 gibba045 bash[25517]: cluster 2021-03-10T15:43:31.937811+0000 mgr.gibba045.orlgmj (mgr.34412) 6077 : cluster [DBG] pgmap v3452: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:33.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:43:32 gibba015 bash[29377]: cluster 2021-03-10T15:43:31.937811+0000 mgr.gibba045.orlgmj (mgr.34412) 6077 : cluster [DBG] pgmap v3452: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:33.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:43:32 gibba015 bash[30343]: cluster 2021-03-10T15:43:31.937811+0000 mgr.gibba045.orlgmj (mgr.34412) 6077 : cluster [DBG] pgmap v3452: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:34.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:43:34 gibba045 bash[25517]: cephadm 2021-03-10T15:43:32.686859+0000 mgr.gibba045.orlgmj (mgr.34412) 6078 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:43:34.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:43:34 gibba015 bash[29377]: cephadm 2021-03-10T15:43:32.686859+0000 mgr.gibba045.orlgmj (mgr.34412) 6078 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:43:34.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:43:34 gibba015 bash[30343]: cephadm 2021-03-10T15:43:32.686859+0000 mgr.gibba045.orlgmj (mgr.34412) 6078 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:43:35.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:43:35 gibba045 bash[25517]: cluster 2021-03-10T15:43:33.938983+0000 mgr.gibba045.orlgmj (mgr.34412) 6079 : cluster [DBG] pgmap v3453: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:35.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:43:35 gibba015 bash[29377]: cluster 2021-03-10T15:43:33.938983+0000 mgr.gibba045.orlgmj (mgr.34412) 6079 : cluster [DBG] pgmap v3453: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:35.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:43:35 gibba015 bash[30343]: cluster 2021-03-10T15:43:33.938983+0000 mgr.gibba045.orlgmj (mgr.34412) 6079 : cluster [DBG] pgmap v3453: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:37.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:43:37 gibba045 bash[25517]: cluster 2021-03-10T15:43:35.940733+0000 mgr.gibba045.orlgmj (mgr.34412) 6080 : cluster [DBG] pgmap v3454: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:37.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:43:37 gibba015 bash[29377]: cluster 2021-03-10T15:43:35.940733+0000 mgr.gibba045.orlgmj (mgr.34412) 6080 : cluster [DBG] pgmap v3454: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:37.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:43:37 gibba015 bash[30343]: cluster 2021-03-10T15:43:35.940733+0000 mgr.gibba045.orlgmj (mgr.34412) 6080 : cluster [DBG] pgmap v3454: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:39.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:43:39 gibba045 bash[25517]: cluster 2021-03-10T15:43:37.942441+0000 mgr.gibba045.orlgmj (mgr.34412) 6081 : cluster [DBG] pgmap v3455: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:39.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:43:39 gibba015 bash[29377]: cluster 2021-03-10T15:43:37.942441+0000 mgr.gibba045.orlgmj (mgr.34412) 6081 : cluster [DBG] pgmap v3455: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:39.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:43:39 gibba015 bash[30343]: cluster 2021-03-10T15:43:37.942441+0000 mgr.gibba045.orlgmj (mgr.34412) 6081 : cluster [DBG] pgmap v3455: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:41.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:43:40 gibba045 bash[25517]: cluster 2021-03-10T15:43:39.944134+0000 mgr.gibba045.orlgmj (mgr.34412) 6082 : cluster [DBG] pgmap v3456: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:41.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:43:40 gibba015 bash[29377]: cluster 2021-03-10T15:43:39.944134+0000 mgr.gibba045.orlgmj (mgr.34412) 6082 : cluster [DBG] pgmap v3456: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:41.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:43:40 gibba015 bash[30343]: cluster 2021-03-10T15:43:39.944134+0000 mgr.gibba045.orlgmj (mgr.34412) 6082 : cluster [DBG] pgmap v3456: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:43.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:43:43 gibba045 bash[25517]: cluster 2021-03-10T15:43:41.945896+0000 mgr.gibba045.orlgmj (mgr.34412) 6083 : cluster [DBG] pgmap v3457: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:43.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:43:43 gibba015 bash[29377]: cluster 2021-03-10T15:43:41.945896+0000 mgr.gibba045.orlgmj (mgr.34412) 6083 : cluster [DBG] pgmap v3457: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:43.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:43:43 gibba015 bash[30343]: cluster 2021-03-10T15:43:41.945896+0000 mgr.gibba045.orlgmj (mgr.34412) 6083 : cluster [DBG] pgmap v3457: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:45.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:43:45 gibba045 bash[25517]: cluster 2021-03-10T15:43:43.947096+0000 mgr.gibba045.orlgmj (mgr.34412) 6084 : cluster [DBG] pgmap v3458: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:45.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:43:45 gibba015 bash[29377]: cluster 2021-03-10T15:43:43.947096+0000 mgr.gibba045.orlgmj (mgr.34412) 6084 : cluster [DBG] pgmap v3458: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:45.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:43:45 gibba015 bash[30343]: cluster 2021-03-10T15:43:43.947096+0000 mgr.gibba045.orlgmj (mgr.34412) 6084 : cluster [DBG] pgmap v3458: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:47.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:43:47 gibba045 bash[25517]: cluster 2021-03-10T15:43:45.948855+0000 mgr.gibba045.orlgmj (mgr.34412) 6085 : cluster [DBG] pgmap v3459: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:47.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:43:47 gibba015 bash[29377]: cluster 2021-03-10T15:43:45.948855+0000 mgr.gibba045.orlgmj (mgr.34412) 6085 : cluster [DBG] pgmap v3459: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:47.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:43:47 gibba015 bash[30343]: cluster 2021-03-10T15:43:45.948855+0000 mgr.gibba045.orlgmj (mgr.34412) 6085 : cluster [DBG] pgmap v3459: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:49.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:43:49 gibba045 bash[25517]: cephadm 2021-03-10T15:43:47.702897+0000 mgr.gibba045.orlgmj (mgr.34412) 6086 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:43:49.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:43:49 gibba045 bash[25517]: cluster 2021-03-10T15:43:47.950528+0000 mgr.gibba045.orlgmj (mgr.34412) 6087 : cluster [DBG] pgmap v3460: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:49.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:43:49 gibba015 bash[29377]: cephadm 2021-03-10T15:43:47.702897+0000 mgr.gibba045.orlgmj (mgr.34412) 6086 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:43:49.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:43:49 gibba015 bash[29377]: cluster 2021-03-10T15:43:47.950528+0000 mgr.gibba045.orlgmj (mgr.34412) 6087 : cluster [DBG] pgmap v3460: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:49.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:43:49 gibba015 bash[30343]: cephadm 2021-03-10T15:43:47.702897+0000 mgr.gibba045.orlgmj (mgr.34412) 6086 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:43:49.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:43:49 gibba015 bash[30343]: cluster 2021-03-10T15:43:47.950528+0000 mgr.gibba045.orlgmj (mgr.34412) 6087 : cluster [DBG] pgmap v3460: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:50.929 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:43:51.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:43:50 gibba045 bash[25517]: cluster 2021-03-10T15:43:49.952156+0000 mgr.gibba045.orlgmj (mgr.34412) 6088 : cluster [DBG] pgmap v3461: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:51.187 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:43:51.187 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (114m) 8m ago 119m 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:43:51.188 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (119m) 7m ago 119m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:43:51.188 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (115m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:43:51.188 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (115m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:43:51.188 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (114m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:43:51.188 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (114m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:43:51.189 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (113m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:43:51.189 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (113m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:43:51.189 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 8m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:43:51.189 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 7m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:43:51.190 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (112m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:43:51.190 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (112m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:43:51.190 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (112m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:43:51.190 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (111m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:43:51.191 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (111m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:43:51.191 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (110m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:43:51.191 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (110m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:43:51.191 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (109m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:43:51.191 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (119m) 7m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:43:51.192 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 7m ago 118m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:43:51.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:43:50 gibba015 bash[29377]: cluster 2021-03-10T15:43:49.952156+0000 mgr.gibba045.orlgmj (mgr.34412) 6088 : cluster [DBG] pgmap v3461: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:51.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:43:50 gibba015 bash[30343]: cluster 2021-03-10T15:43:49.952156+0000 mgr.gibba045.orlgmj (mgr.34412) 6088 : cluster [DBG] pgmap v3461: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:51.446 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:43:51.446 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:43:51.447 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:43:51.447 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:43:51.447 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:43:51.447 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:43:51.448 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:43:51.448 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:43:51.448 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:43:51.448 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:43:51.448 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:43:51.449 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:43:51.449 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:43:51.449 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:43:51.449 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:43:52.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:43:51 gibba045 bash[25517]: audit 2021-03-10T15:43:50.918890+0000 mgr.gibba045.orlgmj (mgr.34412) 6089 : audit [DBG] from='client.48138 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:43:52.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:43:51 gibba045 bash[25517]: audit 2021-03-10T15:43:51.145690+0000 mgr.gibba045.orlgmj (mgr.34412) 6090 : audit [DBG] from='client.58132 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:43:52.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:43:51 gibba045 bash[25517]: audit 2021-03-10T15:43:51.442014+0000 mon.c (mon.1) 1700 : audit [DBG] from='client.? 172.21.2.115:0/363993893' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:43:52.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:43:51 gibba015 bash[29377]: audit 2021-03-10T15:43:50.918890+0000 mgr.gibba045.orlgmj (mgr.34412) 6089 : audit [DBG] from='client.48138 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:43:52.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:43:51 gibba015 bash[29377]: audit 2021-03-10T15:43:51.145690+0000 mgr.gibba045.orlgmj (mgr.34412) 6090 : audit [DBG] from='client.58132 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:43:52.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:43:51 gibba015 bash[29377]: audit 2021-03-10T15:43:51.442014+0000 mon.c (mon.1) 1700 : audit [DBG] from='client.? 172.21.2.115:0/363993893' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:43:52.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:43:51 gibba015 bash[30343]: audit 2021-03-10T15:43:50.918890+0000 mgr.gibba045.orlgmj (mgr.34412) 6089 : audit [DBG] from='client.48138 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:43:52.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:43:51 gibba015 bash[30343]: audit 2021-03-10T15:43:51.145690+0000 mgr.gibba045.orlgmj (mgr.34412) 6090 : audit [DBG] from='client.58132 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:43:52.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:43:51 gibba015 bash[30343]: audit 2021-03-10T15:43:51.442014+0000 mon.c (mon.1) 1700 : audit [DBG] from='client.? 172.21.2.115:0/363993893' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:43:53.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:43:52 gibba045 bash[25517]: cluster 2021-03-10T15:43:51.954022+0000 mgr.gibba045.orlgmj (mgr.34412) 6091 : cluster [DBG] pgmap v3462: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:53.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:43:52 gibba015 bash[29377]: cluster 2021-03-10T15:43:51.954022+0000 mgr.gibba045.orlgmj (mgr.34412) 6091 : cluster [DBG] pgmap v3462: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:53.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:43:52 gibba015 bash[30343]: cluster 2021-03-10T15:43:51.954022+0000 mgr.gibba045.orlgmj (mgr.34412) 6091 : cluster [DBG] pgmap v3462: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:43:53 gibba045 bash[25517]: audit 2021-03-10T15:43:53.249938+0000 mon.c (mon.1) 1701 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:43:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:43:53 gibba045 bash[25517]: audit 2021-03-10T15:43:53.250551+0000 mon.c (mon.1) 1702 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:43:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:43:53 gibba045 bash[25517]: audit 2021-03-10T15:43:53.251032+0000 mon.a (mon.0) 1516 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:43:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:43:53 gibba045 bash[25517]: audit 2021-03-10T15:43:53.252140+0000 mon.c (mon.1) 1703 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:43:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:43:53 gibba045 bash[25517]: audit 2021-03-10T15:43:53.252152+0000 mon.a (mon.0) 1517 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:43:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:43:53 gibba045 bash[25517]: audit 2021-03-10T15:43:53.252869+0000 mon.c (mon.1) 1704 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:43:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:43:53 gibba045 bash[25517]: audit 2021-03-10T15:43:53.253287+0000 mon.a (mon.0) 1518 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:43:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:43:53 gibba045 bash[25517]: audit 2021-03-10T15:43:53.253821+0000 mon.c (mon.1) 1705 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:43:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:43:53 gibba045 bash[25517]: audit 2021-03-10T15:43:53.254605+0000 mon.a (mon.0) 1519 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:43:54.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:43:53 gibba045 bash[25517]: audit 2021-03-10T15:43:53.254746+0000 mon.c (mon.1) 1706 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:43:54.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:43:53 gibba045 bash[25517]: audit 2021-03-10T15:43:53.255592+0000 mon.a (mon.0) 1520 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:43:54.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:43:53 gibba045 bash[25517]: audit 2021-03-10T15:43:53.256614+0000 mon.a (mon.0) 1521 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:43:54.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:43:53 gibba015 bash[29377]: audit 2021-03-10T15:43:53.249938+0000 mon.c (mon.1) 1701 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:43:54.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:43:53 gibba015 bash[29377]: audit 2021-03-10T15:43:53.250551+0000 mon.c (mon.1) 1702 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:43:54.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:43:53 gibba015 bash[29377]: audit 2021-03-10T15:43:53.251032+0000 mon.a (mon.0) 1516 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:43:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:43:53 gibba015 bash[29377]: audit 2021-03-10T15:43:53.252140+0000 mon.c (mon.1) 1703 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:43:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:43:53 gibba015 bash[29377]: audit 2021-03-10T15:43:53.252152+0000 mon.a (mon.0) 1517 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:43:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:43:53 gibba015 bash[29377]: audit 2021-03-10T15:43:53.252869+0000 mon.c (mon.1) 1704 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:43:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:43:53 gibba015 bash[29377]: audit 2021-03-10T15:43:53.253287+0000 mon.a (mon.0) 1518 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:43:54.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:43:53 gibba015 bash[29377]: audit 2021-03-10T15:43:53.253821+0000 mon.c (mon.1) 1705 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:43:54.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:43:53 gibba015 bash[29377]: audit 2021-03-10T15:43:53.254605+0000 mon.a (mon.0) 1519 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:43:54.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:43:53 gibba015 bash[29377]: audit 2021-03-10T15:43:53.254746+0000 mon.c (mon.1) 1706 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:43:54.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:43:53 gibba015 bash[29377]: audit 2021-03-10T15:43:53.255592+0000 mon.a (mon.0) 1520 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:43:54.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:43:53 gibba015 bash[29377]: audit 2021-03-10T15:43:53.256614+0000 mon.a (mon.0) 1521 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:43:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:43:53 gibba015 bash[30343]: audit 2021-03-10T15:43:53.249938+0000 mon.c (mon.1) 1701 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:43:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:43:53 gibba015 bash[30343]: audit 2021-03-10T15:43:53.250551+0000 mon.c (mon.1) 1702 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:43:54.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:43:53 gibba015 bash[30343]: audit 2021-03-10T15:43:53.251032+0000 mon.a (mon.0) 1516 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:43:54.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:43:53 gibba015 bash[30343]: audit 2021-03-10T15:43:53.252140+0000 mon.c (mon.1) 1703 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:43:54.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:43:53 gibba015 bash[30343]: audit 2021-03-10T15:43:53.252152+0000 mon.a (mon.0) 1517 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:43:54.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:43:53 gibba015 bash[30343]: audit 2021-03-10T15:43:53.252869+0000 mon.c (mon.1) 1704 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:43:54.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:43:53 gibba015 bash[30343]: audit 2021-03-10T15:43:53.253287+0000 mon.a (mon.0) 1518 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:43:54.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:43:53 gibba015 bash[30343]: audit 2021-03-10T15:43:53.253821+0000 mon.c (mon.1) 1705 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:43:54.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:43:53 gibba015 bash[30343]: audit 2021-03-10T15:43:53.254605+0000 mon.a (mon.0) 1519 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:43:54.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:43:53 gibba015 bash[30343]: audit 2021-03-10T15:43:53.254746+0000 mon.c (mon.1) 1706 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:43:54.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:43:53 gibba015 bash[30343]: audit 2021-03-10T15:43:53.255592+0000 mon.a (mon.0) 1520 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:43:54.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:43:53 gibba015 bash[30343]: audit 2021-03-10T15:43:53.256614+0000 mon.a (mon.0) 1521 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:43:55.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:43:54 gibba045 bash[25517]: cluster 2021-03-10T15:43:53.955342+0000 mgr.gibba045.orlgmj (mgr.34412) 6092 : cluster [DBG] pgmap v3463: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:55.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:43:54 gibba015 bash[29377]: cluster 2021-03-10T15:43:53.955342+0000 mgr.gibba045.orlgmj (mgr.34412) 6092 : cluster [DBG] pgmap v3463: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:55.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:43:54 gibba015 bash[30343]: cluster 2021-03-10T15:43:53.955342+0000 mgr.gibba045.orlgmj (mgr.34412) 6092 : cluster [DBG] pgmap v3463: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:57.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:43:57 gibba045 bash[25517]: cluster 2021-03-10T15:43:55.957099+0000 mgr.gibba045.orlgmj (mgr.34412) 6093 : cluster [DBG] pgmap v3464: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:57.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:43:57 gibba015 bash[29377]: cluster 2021-03-10T15:43:55.957099+0000 mgr.gibba045.orlgmj (mgr.34412) 6093 : cluster [DBG] pgmap v3464: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:57.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:43:57 gibba015 bash[30343]: cluster 2021-03-10T15:43:55.957099+0000 mgr.gibba045.orlgmj (mgr.34412) 6093 : cluster [DBG] pgmap v3464: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:59.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:43:59 gibba045 bash[25517]: cluster 2021-03-10T15:43:57.958489+0000 mgr.gibba045.orlgmj (mgr.34412) 6094 : cluster [DBG] pgmap v3465: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:59.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:43:59 gibba015 bash[29377]: cluster 2021-03-10T15:43:57.958489+0000 mgr.gibba045.orlgmj (mgr.34412) 6094 : cluster [DBG] pgmap v3465: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:59.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:43:59 gibba015 bash[30343]: cluster 2021-03-10T15:43:57.958489+0000 mgr.gibba045.orlgmj (mgr.34412) 6094 : cluster [DBG] pgmap v3465: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:01.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:44:00 gibba045 bash[25517]: cluster 2021-03-10T15:43:59.960148+0000 mgr.gibba045.orlgmj (mgr.34412) 6095 : cluster [DBG] pgmap v3466: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:01.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:44:00 gibba015 bash[29377]: cluster 2021-03-10T15:43:59.960148+0000 mgr.gibba045.orlgmj (mgr.34412) 6095 : cluster [DBG] pgmap v3466: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:01.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:44:00 gibba015 bash[30343]: cluster 2021-03-10T15:43:59.960148+0000 mgr.gibba045.orlgmj (mgr.34412) 6095 : cluster [DBG] pgmap v3466: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:03.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:44:03 gibba045 bash[25517]: cluster 2021-03-10T15:44:01.961954+0000 mgr.gibba045.orlgmj (mgr.34412) 6096 : cluster [DBG] pgmap v3467: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:03.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:44:03 gibba015 bash[29377]: cluster 2021-03-10T15:44:01.961954+0000 mgr.gibba045.orlgmj (mgr.34412) 6096 : cluster [DBG] pgmap v3467: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:03.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:44:03 gibba015 bash[30343]: cluster 2021-03-10T15:44:01.961954+0000 mgr.gibba045.orlgmj (mgr.34412) 6096 : cluster [DBG] pgmap v3467: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:04.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:44:04 gibba045 bash[25517]: cephadm 2021-03-10T15:44:02.718834+0000 mgr.gibba045.orlgmj (mgr.34412) 6097 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:44:04.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:44:04 gibba015 bash[29377]: cephadm 2021-03-10T15:44:02.718834+0000 mgr.gibba045.orlgmj (mgr.34412) 6097 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:44:04.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:44:04 gibba015 bash[30343]: cephadm 2021-03-10T15:44:02.718834+0000 mgr.gibba045.orlgmj (mgr.34412) 6097 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:44:05.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:44:05 gibba045 bash[25517]: cluster 2021-03-10T15:44:03.963194+0000 mgr.gibba045.orlgmj (mgr.34412) 6098 : cluster [DBG] pgmap v3468: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:05.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:44:05 gibba015 bash[29377]: cluster 2021-03-10T15:44:03.963194+0000 mgr.gibba045.orlgmj (mgr.34412) 6098 : cluster [DBG] pgmap v3468: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:05.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:44:05 gibba015 bash[30343]: cluster 2021-03-10T15:44:03.963194+0000 mgr.gibba045.orlgmj (mgr.34412) 6098 : cluster [DBG] pgmap v3468: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:07.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:44:07 gibba045 bash[25517]: cluster 2021-03-10T15:44:05.964868+0000 mgr.gibba045.orlgmj (mgr.34412) 6099 : cluster [DBG] pgmap v3469: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:07.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:44:07 gibba015 bash[29377]: cluster 2021-03-10T15:44:05.964868+0000 mgr.gibba045.orlgmj (mgr.34412) 6099 : cluster [DBG] pgmap v3469: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:07.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:44:07 gibba015 bash[30343]: cluster 2021-03-10T15:44:05.964868+0000 mgr.gibba045.orlgmj (mgr.34412) 6099 : cluster [DBG] pgmap v3469: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:09.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:44:09 gibba015 bash[29377]: cluster 2021-03-10T15:44:07.966393+0000 mgr.gibba045.orlgmj (mgr.34412) 6100 : cluster [DBG] pgmap v3470: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:09.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:44:09 gibba015 bash[30343]: cluster 2021-03-10T15:44:07.966393+0000 mgr.gibba045.orlgmj (mgr.34412) 6100 : cluster [DBG] pgmap v3470: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:09.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:44:09 gibba045 bash[25517]: cluster 2021-03-10T15:44:07.966393+0000 mgr.gibba045.orlgmj (mgr.34412) 6100 : cluster [DBG] pgmap v3470: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:11.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:44:10 gibba045 bash[25517]: cluster 2021-03-10T15:44:09.968108+0000 mgr.gibba045.orlgmj (mgr.34412) 6101 : cluster [DBG] pgmap v3471: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:11.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:44:10 gibba015 bash[29377]: cluster 2021-03-10T15:44:09.968108+0000 mgr.gibba045.orlgmj (mgr.34412) 6101 : cluster [DBG] pgmap v3471: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:11.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:44:10 gibba015 bash[30343]: cluster 2021-03-10T15:44:09.968108+0000 mgr.gibba045.orlgmj (mgr.34412) 6101 : cluster [DBG] pgmap v3471: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:13.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:44:13 gibba045 bash[25517]: cluster 2021-03-10T15:44:11.969811+0000 mgr.gibba045.orlgmj (mgr.34412) 6102 : cluster [DBG] pgmap v3472: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:13.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:44:13 gibba015 bash[29377]: cluster 2021-03-10T15:44:11.969811+0000 mgr.gibba045.orlgmj (mgr.34412) 6102 : cluster [DBG] pgmap v3472: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:13.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:44:13 gibba015 bash[30343]: cluster 2021-03-10T15:44:11.969811+0000 mgr.gibba045.orlgmj (mgr.34412) 6102 : cluster [DBG] pgmap v3472: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:15.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:44:15 gibba045 bash[25517]: cluster 2021-03-10T15:44:13.971126+0000 mgr.gibba045.orlgmj (mgr.34412) 6103 : cluster [DBG] pgmap v3473: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:15.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:44:15 gibba015 bash[29377]: cluster 2021-03-10T15:44:13.971126+0000 mgr.gibba045.orlgmj (mgr.34412) 6103 : cluster [DBG] pgmap v3473: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:15.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:44:15 gibba015 bash[30343]: cluster 2021-03-10T15:44:13.971126+0000 mgr.gibba045.orlgmj (mgr.34412) 6103 : cluster [DBG] pgmap v3473: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:17.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:44:17 gibba045 bash[25517]: cluster 2021-03-10T15:44:15.972818+0000 mgr.gibba045.orlgmj (mgr.34412) 6104 : cluster [DBG] pgmap v3474: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:17.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:44:17 gibba015 bash[29377]: cluster 2021-03-10T15:44:15.972818+0000 mgr.gibba045.orlgmj (mgr.34412) 6104 : cluster [DBG] pgmap v3474: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:17.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:44:17 gibba015 bash[30343]: cluster 2021-03-10T15:44:15.972818+0000 mgr.gibba045.orlgmj (mgr.34412) 6104 : cluster [DBG] pgmap v3474: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:18.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:44:18 gibba015 bash[29377]: audit 2021-03-10T15:44:17.718944+0000 mon.c (mon.1) 1707 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:44:18.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:44:18 gibba015 bash[29377]: audit 2021-03-10T15:44:17.725545+0000 mon.c (mon.1) 1708 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T15:44:18.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:44:18 gibba015 bash[30343]: audit 2021-03-10T15:44:17.718944+0000 mon.c (mon.1) 1707 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:44:18.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:44:18 gibba015 bash[30343]: audit 2021-03-10T15:44:17.725545+0000 mon.c (mon.1) 1708 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T15:44:18.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:44:18 gibba045 bash[25517]: audit 2021-03-10T15:44:17.718944+0000 mon.c (mon.1) 1707 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:44:18.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:44:18 gibba045 bash[25517]: audit 2021-03-10T15:44:17.725545+0000 mon.c (mon.1) 1708 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T15:44:19.214 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:44:19 gibba015 bash[29377]: cephadm 2021-03-10T15:44:17.728555+0000 mgr.gibba045.orlgmj (mgr.34412) 6105 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:44:19.214 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:44:19 gibba015 bash[29377]: cluster 2021-03-10T15:44:17.973434+0000 mgr.gibba045.orlgmj (mgr.34412) 6106 : cluster [DBG] pgmap v3475: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:19.215 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:44:19 gibba015 bash[30343]: cephadm 2021-03-10T15:44:17.728555+0000 mgr.gibba045.orlgmj (mgr.34412) 6105 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:44:19.215 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:44:19 gibba015 bash[30343]: cluster 2021-03-10T15:44:17.973434+0000 mgr.gibba045.orlgmj (mgr.34412) 6106 : cluster [DBG] pgmap v3475: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:19.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:44:19 gibba045 bash[25517]: cephadm 2021-03-10T15:44:17.728555+0000 mgr.gibba045.orlgmj (mgr.34412) 6105 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:44:19.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:44:19 gibba045 bash[25517]: cluster 2021-03-10T15:44:17.973434+0000 mgr.gibba045.orlgmj (mgr.34412) 6106 : cluster [DBG] pgmap v3475: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:21.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:44:20 gibba045 bash[25517]: cluster 2021-03-10T15:44:19.975016+0000 mgr.gibba045.orlgmj (mgr.34412) 6107 : cluster [DBG] pgmap v3476: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:21.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:44:20 gibba015 bash[29377]: cluster 2021-03-10T15:44:19.975016+0000 mgr.gibba045.orlgmj (mgr.34412) 6107 : cluster [DBG] pgmap v3476: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:21.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:44:20 gibba015 bash[30343]: cluster 2021-03-10T15:44:19.975016+0000 mgr.gibba045.orlgmj (mgr.34412) 6107 : cluster [DBG] pgmap v3476: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:21.702 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:44:21.935 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:44:21.935 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (115m) 9m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:44:21.936 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 8m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:44:21.936 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (115m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:44:21.936 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (115m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:44:21.936 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (114m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:44:21.937 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (114m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:44:21.937 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (114m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:44:21.937 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (114m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:44:21.937 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 9m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:44:21.938 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 8m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:44:21.938 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (113m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:44:21.938 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (112m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:44:21.938 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (112m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:44:21.939 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (112m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:44:21.939 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (111m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:44:21.939 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (111m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:44:21.939 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (110m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:44:21.940 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (110m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:44:21.940 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (119m) 8m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:44:21.940 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 8m ago 118m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:44:22.185 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:44:22.185 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:44:22.186 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:44:22.186 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:44:22.186 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:44:22.186 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:44:22.187 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:44:22.187 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:44:22.187 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:44:22.187 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:44:22.188 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:44:22.188 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:44:22.188 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:44:22.188 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:44:22.189 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:44:23.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:44:23 gibba045 bash[25517]: audit 2021-03-10T15:44:21.692041+0000 mgr.gibba045.orlgmj (mgr.34412) 6108 : audit [DBG] from='client.58144 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:44:23.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:44:23 gibba045 bash[25517]: audit 2021-03-10T15:44:21.921824+0000 mgr.gibba045.orlgmj (mgr.34412) 6109 : audit [DBG] from='client.58150 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:44:23.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:44:23 gibba045 bash[25517]: cluster 2021-03-10T15:44:21.975946+0000 mgr.gibba045.orlgmj (mgr.34412) 6110 : cluster [DBG] pgmap v3477: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:23.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:44:23 gibba045 bash[25517]: audit 2021-03-10T15:44:22.181341+0000 mon.a (mon.0) 1522 : audit [DBG] from='client.? 172.21.2.115:0/3088923488' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:44:23.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:44:23 gibba045 bash[25517]: audit 2021-03-10T15:44:22.260780+0000 mon.c (mon.1) 1709 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:44:23.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:44:23 gibba045 bash[25517]: audit 2021-03-10T15:44:22.452074+0000 mon.a (mon.0) 1523 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:44:23.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:44:23 gibba045 bash[25517]: audit 2021-03-10T15:44:22.646547+0000 mon.a (mon.0) 1524 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:44:23.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:44:23 gibba045 bash[25517]: audit 2021-03-10T15:44:22.654530+0000 mon.c (mon.1) 1710 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:44:23.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:44:23 gibba045 bash[25517]: audit 2021-03-10T15:44:22.656339+0000 mon.c (mon.1) 1711 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:44:23.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:44:23 gibba045 bash[25517]: audit 2021-03-10T15:44:22.657706+0000 mon.c (mon.1) 1712 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:44:23.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:44:23 gibba045 bash[25517]: audit 2021-03-10T15:44:22.659263+0000 mon.c (mon.1) 1713 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:44:23.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:44:23 gibba045 bash[25517]: audit 2021-03-10T15:44:22.662884+0000 mon.c (mon.1) 1714 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:44:23.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:44:23 gibba045 bash[25517]: audit 2021-03-10T15:44:22.664826+0000 mon.c (mon.1) 1715 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:44:23.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:44:23 gibba015 bash[29377]: audit 2021-03-10T15:44:21.692041+0000 mgr.gibba045.orlgmj (mgr.34412) 6108 : audit [DBG] from='client.58144 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:44:23.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:44:23 gibba015 bash[29377]: audit 2021-03-10T15:44:21.921824+0000 mgr.gibba045.orlgmj (mgr.34412) 6109 : audit [DBG] from='client.58150 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:44:23.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:44:23 gibba015 bash[29377]: cluster 2021-03-10T15:44:21.975946+0000 mgr.gibba045.orlgmj (mgr.34412) 6110 : cluster [DBG] pgmap v3477: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:23.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:44:23 gibba015 bash[29377]: audit 2021-03-10T15:44:22.181341+0000 mon.a (mon.0) 1522 : audit [DBG] from='client.? 172.21.2.115:0/3088923488' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:44:23.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:44:23 gibba015 bash[29377]: audit 2021-03-10T15:44:22.260780+0000 mon.c (mon.1) 1709 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:44:23.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:44:23 gibba015 bash[29377]: audit 2021-03-10T15:44:22.452074+0000 mon.a (mon.0) 1523 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:44:23.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:44:23 gibba015 bash[29377]: audit 2021-03-10T15:44:22.646547+0000 mon.a (mon.0) 1524 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:44:23.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:44:23 gibba015 bash[29377]: audit 2021-03-10T15:44:22.654530+0000 mon.c (mon.1) 1710 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:44:23.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:44:23 gibba015 bash[29377]: audit 2021-03-10T15:44:22.656339+0000 mon.c (mon.1) 1711 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:44:23.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:44:23 gibba015 bash[29377]: audit 2021-03-10T15:44:22.657706+0000 mon.c (mon.1) 1712 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:44:23.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:44:23 gibba015 bash[29377]: audit 2021-03-10T15:44:22.659263+0000 mon.c (mon.1) 1713 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:44:23.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:44:23 gibba015 bash[29377]: audit 2021-03-10T15:44:22.662884+0000 mon.c (mon.1) 1714 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:44:23.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:44:23 gibba015 bash[29377]: audit 2021-03-10T15:44:22.664826+0000 mon.c (mon.1) 1715 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:44:23.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:44:23 gibba015 bash[30343]: audit 2021-03-10T15:44:21.692041+0000 mgr.gibba045.orlgmj (mgr.34412) 6108 : audit [DBG] from='client.58144 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:44:23.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:44:23 gibba015 bash[30343]: audit 2021-03-10T15:44:21.921824+0000 mgr.gibba045.orlgmj (mgr.34412) 6109 : audit [DBG] from='client.58150 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:44:23.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:44:23 gibba015 bash[30343]: cluster 2021-03-10T15:44:21.975946+0000 mgr.gibba045.orlgmj (mgr.34412) 6110 : cluster [DBG] pgmap v3477: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:23.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:44:23 gibba015 bash[30343]: audit 2021-03-10T15:44:22.181341+0000 mon.a (mon.0) 1522 : audit [DBG] from='client.? 172.21.2.115:0/3088923488' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:44:23.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:44:23 gibba015 bash[30343]: audit 2021-03-10T15:44:22.260780+0000 mon.c (mon.1) 1709 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:44:23.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:44:23 gibba015 bash[30343]: audit 2021-03-10T15:44:22.452074+0000 mon.a (mon.0) 1523 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:44:23.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:44:23 gibba015 bash[30343]: audit 2021-03-10T15:44:22.646547+0000 mon.a (mon.0) 1524 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:44:23.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:44:23 gibba015 bash[30343]: audit 2021-03-10T15:44:22.654530+0000 mon.c (mon.1) 1710 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:44:23.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:44:23 gibba015 bash[30343]: audit 2021-03-10T15:44:22.656339+0000 mon.c (mon.1) 1711 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:44:23.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:44:23 gibba015 bash[30343]: audit 2021-03-10T15:44:22.657706+0000 mon.c (mon.1) 1712 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:44:23.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:44:23 gibba015 bash[30343]: audit 2021-03-10T15:44:22.659263+0000 mon.c (mon.1) 1713 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:44:23.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:44:23 gibba015 bash[30343]: audit 2021-03-10T15:44:22.662884+0000 mon.c (mon.1) 1714 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:44:23.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:44:23 gibba015 bash[30343]: audit 2021-03-10T15:44:22.664826+0000 mon.c (mon.1) 1715 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:44:24.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:44:24 gibba045 bash[25517]: cephadm 2021-03-10T15:44:22.458838+0000 mgr.gibba045.orlgmj (mgr.34412) 6111 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:44:24.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:44:24 gibba045 bash[25517]: cephadm 2021-03-10T15:44:22.656891+0000 mgr.gibba045.orlgmj (mgr.34412) 6112 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:44:24.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:44:24 gibba045 bash[25517]: cephadm 2021-03-10T15:44:22.659035+0000 mgr.gibba045.orlgmj (mgr.34412) 6113 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:44:24.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:44:24 gibba045 bash[25517]: cephadm 2021-03-10T15:44:22.660430+0000 mgr.gibba045.orlgmj (mgr.34412) 6114 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:44:24.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:44:24 gibba045 bash[25517]: cephadm 2021-03-10T15:44:22.660472+0000 mgr.gibba045.orlgmj (mgr.34412) 6115 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:44:24.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:44:24 gibba045 bash[25517]: cephadm 2021-03-10T15:44:22.662080+0000 mgr.gibba045.orlgmj (mgr.34412) 6116 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:44:24.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:44:24 gibba045 bash[25517]: cephadm 2021-03-10T15:44:22.662122+0000 mgr.gibba045.orlgmj (mgr.34412) 6117 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:44:24.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:44:24 gibba045 bash[25517]: cephadm 2021-03-10T15:44:22.663615+0000 mgr.gibba045.orlgmj (mgr.34412) 6118 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:44:24.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:44:24 gibba045 bash[25517]: cephadm 2021-03-10T15:44:22.665647+0000 mgr.gibba045.orlgmj (mgr.34412) 6119 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:44:24.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:44:24 gibba045 bash[25517]: cephadm 2021-03-10T15:44:22.665687+0000 mgr.gibba045.orlgmj (mgr.34412) 6120 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:44:24.312 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:44:24 gibba045 bash[25517]: cephadm 2021-03-10T15:44:22.667261+0000 mgr.gibba045.orlgmj (mgr.34412) 6121 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:44:24.312 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:44:24 gibba045 bash[25517]: cephadm 2021-03-10T15:44:22.667646+0000 mgr.gibba045.orlgmj (mgr.34412) 6122 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:44:24.313 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:44:24 gibba045 bash[25517]: cephadm 2021-03-10T15:44:22.669083+0000 mgr.gibba045.orlgmj (mgr.34412) 6123 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:44:24.313 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:44:24 gibba045 bash[25517]: cephadm 2021-03-10T15:44:22.669131+0000 mgr.gibba045.orlgmj (mgr.34412) 6124 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:44:24.314 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:44:24 gibba045 bash[25517]: cephadm 2021-03-10T15:44:22.669265+0000 mgr.gibba045.orlgmj (mgr.34412) 6125 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:44:24.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:44:24 gibba015 bash[29377]: cephadm 2021-03-10T15:44:22.458838+0000 mgr.gibba045.orlgmj (mgr.34412) 6111 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:44:24.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:44:24 gibba015 bash[29377]: cephadm 2021-03-10T15:44:22.656891+0000 mgr.gibba045.orlgmj (mgr.34412) 6112 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:44:24.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:44:24 gibba015 bash[29377]: cephadm 2021-03-10T15:44:22.659035+0000 mgr.gibba045.orlgmj (mgr.34412) 6113 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:44:24.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:44:24 gibba015 bash[29377]: cephadm 2021-03-10T15:44:22.660430+0000 mgr.gibba045.orlgmj (mgr.34412) 6114 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:44:24.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:44:24 gibba015 bash[29377]: cephadm 2021-03-10T15:44:22.660472+0000 mgr.gibba045.orlgmj (mgr.34412) 6115 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:44:24.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:44:24 gibba015 bash[29377]: cephadm 2021-03-10T15:44:22.662080+0000 mgr.gibba045.orlgmj (mgr.34412) 6116 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:44:24.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:44:24 gibba015 bash[29377]: cephadm 2021-03-10T15:44:22.662122+0000 mgr.gibba045.orlgmj (mgr.34412) 6117 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:44:24.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:44:24 gibba015 bash[29377]: cephadm 2021-03-10T15:44:22.663615+0000 mgr.gibba045.orlgmj (mgr.34412) 6118 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:44:24.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:44:24 gibba015 bash[29377]: cephadm 2021-03-10T15:44:22.665647+0000 mgr.gibba045.orlgmj (mgr.34412) 6119 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:44:24.479 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:44:24 gibba015 bash[29377]: cephadm 2021-03-10T15:44:22.665687+0000 mgr.gibba045.orlgmj (mgr.34412) 6120 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:44:24.479 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:44:24 gibba015 bash[29377]: cephadm 2021-03-10T15:44:22.667261+0000 mgr.gibba045.orlgmj (mgr.34412) 6121 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:44:24.480 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:44:24 gibba015 bash[29377]: cephadm 2021-03-10T15:44:22.667646+0000 mgr.gibba045.orlgmj (mgr.34412) 6122 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:44:24.480 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:44:24 gibba015 bash[29377]: cephadm 2021-03-10T15:44:22.669083+0000 mgr.gibba045.orlgmj (mgr.34412) 6123 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:44:24.481 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:44:24 gibba015 bash[29377]: cephadm 2021-03-10T15:44:22.669131+0000 mgr.gibba045.orlgmj (mgr.34412) 6124 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:44:24.481 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:44:24 gibba015 bash[29377]: cephadm 2021-03-10T15:44:22.669265+0000 mgr.gibba045.orlgmj (mgr.34412) 6125 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:44:24.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:44:24 gibba015 bash[30343]: cephadm 2021-03-10T15:44:22.458838+0000 mgr.gibba045.orlgmj (mgr.34412) 6111 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:44:24.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:44:24 gibba015 bash[30343]: cephadm 2021-03-10T15:44:22.656891+0000 mgr.gibba045.orlgmj (mgr.34412) 6112 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:44:24.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:44:24 gibba015 bash[30343]: cephadm 2021-03-10T15:44:22.659035+0000 mgr.gibba045.orlgmj (mgr.34412) 6113 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:44:24.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:44:24 gibba015 bash[30343]: cephadm 2021-03-10T15:44:22.660430+0000 mgr.gibba045.orlgmj (mgr.34412) 6114 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:44:24.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:44:24 gibba015 bash[30343]: cephadm 2021-03-10T15:44:22.660472+0000 mgr.gibba045.orlgmj (mgr.34412) 6115 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:44:24.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:44:24 gibba015 bash[30343]: cephadm 2021-03-10T15:44:22.662080+0000 mgr.gibba045.orlgmj (mgr.34412) 6116 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:44:24.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:44:24 gibba015 bash[30343]: cephadm 2021-03-10T15:44:22.662122+0000 mgr.gibba045.orlgmj (mgr.34412) 6117 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:44:24.485 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:44:24 gibba015 bash[30343]: cephadm 2021-03-10T15:44:22.663615+0000 mgr.gibba045.orlgmj (mgr.34412) 6118 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:44:24.485 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:44:24 gibba015 bash[30343]: cephadm 2021-03-10T15:44:22.665647+0000 mgr.gibba045.orlgmj (mgr.34412) 6119 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:44:24.486 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:44:24 gibba015 bash[30343]: cephadm 2021-03-10T15:44:22.665687+0000 mgr.gibba045.orlgmj (mgr.34412) 6120 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:44:24.486 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:44:24 gibba015 bash[30343]: cephadm 2021-03-10T15:44:22.667261+0000 mgr.gibba045.orlgmj (mgr.34412) 6121 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:44:24.487 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:44:24 gibba015 bash[30343]: cephadm 2021-03-10T15:44:22.667646+0000 mgr.gibba045.orlgmj (mgr.34412) 6122 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:44:24.487 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:44:24 gibba015 bash[30343]: cephadm 2021-03-10T15:44:22.669083+0000 mgr.gibba045.orlgmj (mgr.34412) 6123 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:44:24.488 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:44:24 gibba015 bash[30343]: cephadm 2021-03-10T15:44:22.669131+0000 mgr.gibba045.orlgmj (mgr.34412) 6124 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:44:24.488 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:44:24 gibba015 bash[30343]: cephadm 2021-03-10T15:44:22.669265+0000 mgr.gibba045.orlgmj (mgr.34412) 6125 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:44:25.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:44:25 gibba045 bash[25517]: cluster 2021-03-10T15:44:23.977075+0000 mgr.gibba045.orlgmj (mgr.34412) 6126 : cluster [DBG] pgmap v3478: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:25.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:44:25 gibba015 bash[29377]: cluster 2021-03-10T15:44:23.977075+0000 mgr.gibba045.orlgmj (mgr.34412) 6126 : cluster [DBG] pgmap v3478: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:25.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:44:25 gibba015 bash[30343]: cluster 2021-03-10T15:44:23.977075+0000 mgr.gibba045.orlgmj (mgr.34412) 6126 : cluster [DBG] pgmap v3478: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:27.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:44:27 gibba015 bash[29377]: cluster 2021-03-10T15:44:25.978823+0000 mgr.gibba045.orlgmj (mgr.34412) 6127 : cluster [DBG] pgmap v3479: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:27.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:44:27 gibba015 bash[30343]: cluster 2021-03-10T15:44:25.978823+0000 mgr.gibba045.orlgmj (mgr.34412) 6127 : cluster [DBG] pgmap v3479: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:27.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:44:27 gibba045 bash[25517]: cluster 2021-03-10T15:44:25.978823+0000 mgr.gibba045.orlgmj (mgr.34412) 6127 : cluster [DBG] pgmap v3479: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:29.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:44:29 gibba015 bash[29377]: cluster 2021-03-10T15:44:27.980561+0000 mgr.gibba045.orlgmj (mgr.34412) 6128 : cluster [DBG] pgmap v3480: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:29.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:44:29 gibba015 bash[30343]: cluster 2021-03-10T15:44:27.980561+0000 mgr.gibba045.orlgmj (mgr.34412) 6128 : cluster [DBG] pgmap v3480: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:29.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:44:29 gibba045 bash[25517]: cluster 2021-03-10T15:44:27.980561+0000 mgr.gibba045.orlgmj (mgr.34412) 6128 : cluster [DBG] pgmap v3480: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:31.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:44:30 gibba045 bash[25517]: cluster 2021-03-10T15:44:29.981881+0000 mgr.gibba045.orlgmj (mgr.34412) 6129 : cluster [DBG] pgmap v3481: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:31.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:44:30 gibba015 bash[29377]: cluster 2021-03-10T15:44:29.981881+0000 mgr.gibba045.orlgmj (mgr.34412) 6129 : cluster [DBG] pgmap v3481: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:31.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:44:30 gibba015 bash[30343]: cluster 2021-03-10T15:44:29.981881+0000 mgr.gibba045.orlgmj (mgr.34412) 6129 : cluster [DBG] pgmap v3481: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:33.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:44:33 gibba045 bash[25517]: cluster 2021-03-10T15:44:31.983497+0000 mgr.gibba045.orlgmj (mgr.34412) 6130 : cluster [DBG] pgmap v3482: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:33.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:44:33 gibba015 bash[29377]: cluster 2021-03-10T15:44:31.983497+0000 mgr.gibba045.orlgmj (mgr.34412) 6130 : cluster [DBG] pgmap v3482: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:33.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:44:33 gibba015 bash[30343]: cluster 2021-03-10T15:44:31.983497+0000 mgr.gibba045.orlgmj (mgr.34412) 6130 : cluster [DBG] pgmap v3482: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:35.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:44:35 gibba015 bash[29377]: cluster 2021-03-10T15:44:33.984881+0000 mgr.gibba045.orlgmj (mgr.34412) 6131 : cluster [DBG] pgmap v3483: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:35.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:44:35 gibba015 bash[30343]: cluster 2021-03-10T15:44:33.984881+0000 mgr.gibba045.orlgmj (mgr.34412) 6131 : cluster [DBG] pgmap v3483: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:35.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:44:35 gibba045 bash[25517]: cluster 2021-03-10T15:44:33.984881+0000 mgr.gibba045.orlgmj (mgr.34412) 6131 : cluster [DBG] pgmap v3483: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:37.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:44:37 gibba015 bash[29377]: cluster 2021-03-10T15:44:35.986360+0000 mgr.gibba045.orlgmj (mgr.34412) 6132 : cluster [DBG] pgmap v3484: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:37.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:44:37 gibba015 bash[30343]: cluster 2021-03-10T15:44:35.986360+0000 mgr.gibba045.orlgmj (mgr.34412) 6132 : cluster [DBG] pgmap v3484: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:37.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:44:37 gibba045 bash[25517]: cluster 2021-03-10T15:44:35.986360+0000 mgr.gibba045.orlgmj (mgr.34412) 6132 : cluster [DBG] pgmap v3484: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:39.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:44:39 gibba015 bash[29377]: cephadm 2021-03-10T15:44:37.685295+0000 mgr.gibba045.orlgmj (mgr.34412) 6133 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:44:39.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:44:39 gibba015 bash[29377]: cluster 2021-03-10T15:44:37.987977+0000 mgr.gibba045.orlgmj (mgr.34412) 6134 : cluster [DBG] pgmap v3485: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:39.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:44:39 gibba015 bash[30343]: cephadm 2021-03-10T15:44:37.685295+0000 mgr.gibba045.orlgmj (mgr.34412) 6133 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:44:39.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:44:39 gibba015 bash[30343]: cluster 2021-03-10T15:44:37.987977+0000 mgr.gibba045.orlgmj (mgr.34412) 6134 : cluster [DBG] pgmap v3485: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:39.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:44:39 gibba045 bash[25517]: cephadm 2021-03-10T15:44:37.685295+0000 mgr.gibba045.orlgmj (mgr.34412) 6133 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:44:39.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:44:39 gibba045 bash[25517]: cluster 2021-03-10T15:44:37.987977+0000 mgr.gibba045.orlgmj (mgr.34412) 6134 : cluster [DBG] pgmap v3485: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:41.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:44:40 gibba045 bash[25517]: cluster 2021-03-10T15:44:39.989646+0000 mgr.gibba045.orlgmj (mgr.34412) 6135 : cluster [DBG] pgmap v3486: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:41.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:44:40 gibba015 bash[29377]: cluster 2021-03-10T15:44:39.989646+0000 mgr.gibba045.orlgmj (mgr.34412) 6135 : cluster [DBG] pgmap v3486: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:41.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:44:40 gibba015 bash[30343]: cluster 2021-03-10T15:44:39.989646+0000 mgr.gibba045.orlgmj (mgr.34412) 6135 : cluster [DBG] pgmap v3486: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:43.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:44:43 gibba015 bash[29377]: cluster 2021-03-10T15:44:41.991133+0000 mgr.gibba045.orlgmj (mgr.34412) 6136 : cluster [DBG] pgmap v3487: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:43.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:44:43 gibba015 bash[30343]: cluster 2021-03-10T15:44:41.991133+0000 mgr.gibba045.orlgmj (mgr.34412) 6136 : cluster [DBG] pgmap v3487: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:43.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:44:43 gibba045 bash[25517]: cluster 2021-03-10T15:44:41.991133+0000 mgr.gibba045.orlgmj (mgr.34412) 6136 : cluster [DBG] pgmap v3487: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:45.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:44:45 gibba015 bash[29377]: cluster 2021-03-10T15:44:43.992316+0000 mgr.gibba045.orlgmj (mgr.34412) 6137 : cluster [DBG] pgmap v3488: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:45.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:44:45 gibba015 bash[30343]: cluster 2021-03-10T15:44:43.992316+0000 mgr.gibba045.orlgmj (mgr.34412) 6137 : cluster [DBG] pgmap v3488: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:45.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:44:45 gibba045 bash[25517]: cluster 2021-03-10T15:44:43.992316+0000 mgr.gibba045.orlgmj (mgr.34412) 6137 : cluster [DBG] pgmap v3488: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:47.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:44:47 gibba015 bash[29377]: cluster 2021-03-10T15:44:45.993990+0000 mgr.gibba045.orlgmj (mgr.34412) 6138 : cluster [DBG] pgmap v3489: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:47.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:44:47 gibba015 bash[30343]: cluster 2021-03-10T15:44:45.993990+0000 mgr.gibba045.orlgmj (mgr.34412) 6138 : cluster [DBG] pgmap v3489: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:47.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:44:47 gibba045 bash[25517]: cluster 2021-03-10T15:44:45.993990+0000 mgr.gibba045.orlgmj (mgr.34412) 6138 : cluster [DBG] pgmap v3489: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:49.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:44:49 gibba015 bash[29377]: cluster 2021-03-10T15:44:47.995667+0000 mgr.gibba045.orlgmj (mgr.34412) 6139 : cluster [DBG] pgmap v3490: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:49.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:44:49 gibba015 bash[30343]: cluster 2021-03-10T15:44:47.995667+0000 mgr.gibba045.orlgmj (mgr.34412) 6139 : cluster [DBG] pgmap v3490: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:49.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:44:49 gibba045 bash[25517]: cluster 2021-03-10T15:44:47.995667+0000 mgr.gibba045.orlgmj (mgr.34412) 6139 : cluster [DBG] pgmap v3490: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:51.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:44:50 gibba045 bash[25517]: cluster 2021-03-10T15:44:49.997357+0000 mgr.gibba045.orlgmj (mgr.34412) 6140 : cluster [DBG] pgmap v3491: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:51.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:44:50 gibba015 bash[29377]: cluster 2021-03-10T15:44:49.997357+0000 mgr.gibba045.orlgmj (mgr.34412) 6140 : cluster [DBG] pgmap v3491: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:51.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:44:50 gibba015 bash[30343]: cluster 2021-03-10T15:44:49.997357+0000 mgr.gibba045.orlgmj (mgr.34412) 6140 : cluster [DBG] pgmap v3491: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:52.430 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:44:52.685 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:44:52.685 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (115m) 9m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:44:52.685 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 8m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:44:52.685 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (116m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:44:52.686 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (116m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:44:52.686 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (115m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:44:52.686 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (115m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:44:52.686 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (114m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:44:52.687 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (114m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:44:52.687 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 9m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:44:52.687 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 8m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:44:52.687 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (113m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:44:52.687 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (113m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:44:52.688 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (113m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:44:52.688 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (112m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:44:52.688 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (112m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:44:52.688 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (111m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:44:52.688 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (111m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:44:52.689 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (110m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:44:52.689 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 8m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:44:52.689 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 8m ago 119m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:44:52.938 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:44:52.939 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:44:52.939 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:44:52.939 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:44:52.940 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:44:52.940 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:44:52.940 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:44:52.940 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:44:52.940 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:44:52.941 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:44:52.941 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:44:52.941 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:44:52.941 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:44:52.942 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:44:52.942 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:44:53.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:44:53 gibba015 bash[29377]: cluster 2021-03-10T15:44:51.998977+0000 mgr.gibba045.orlgmj (mgr.34412) 6141 : cluster [DBG] pgmap v3492: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:53.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:44:53 gibba015 bash[29377]: audit 2021-03-10T15:44:52.934675+0000 mon.a (mon.0) 1525 : audit [DBG] from='client.? 172.21.2.115:0/1803160765' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:44:53.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:44:53 gibba015 bash[30343]: cluster 2021-03-10T15:44:51.998977+0000 mgr.gibba045.orlgmj (mgr.34412) 6141 : cluster [DBG] pgmap v3492: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:53.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:44:53 gibba015 bash[30343]: audit 2021-03-10T15:44:52.934675+0000 mon.a (mon.0) 1525 : audit [DBG] from='client.? 172.21.2.115:0/1803160765' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:44:53.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:44:53 gibba045 bash[25517]: cluster 2021-03-10T15:44:51.998977+0000 mgr.gibba045.orlgmj (mgr.34412) 6141 : cluster [DBG] pgmap v3492: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:53.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:44:53 gibba045 bash[25517]: audit 2021-03-10T15:44:52.934675+0000 mon.a (mon.0) 1525 : audit [DBG] from='client.? 172.21.2.115:0/1803160765' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:44:54.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:44:54 gibba015 bash[29377]: audit 2021-03-10T15:44:52.420144+0000 mgr.gibba045.orlgmj (mgr.34412) 6142 : audit [DBG] from='client.58162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:44:54.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:44:54 gibba015 bash[29377]: audit 2021-03-10T15:44:52.643693+0000 mgr.gibba045.orlgmj (mgr.34412) 6143 : audit [DBG] from='client.58168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:44:54.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:44:54 gibba015 bash[29377]: cephadm 2021-03-10T15:44:52.700955+0000 mgr.gibba045.orlgmj (mgr.34412) 6144 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:44:54.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:44:54 gibba015 bash[29377]: audit 2021-03-10T15:44:53.255394+0000 mon.c (mon.1) 1716 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:44:54.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:44:54 gibba015 bash[29377]: audit 2021-03-10T15:44:53.256010+0000 mon.c (mon.1) 1717 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:44:54.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:44:54 gibba015 bash[29377]: audit 2021-03-10T15:44:53.256523+0000 mon.a (mon.0) 1526 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:44:54.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:44:54 gibba015 bash[29377]: audit 2021-03-10T15:44:53.257709+0000 mon.a (mon.0) 1527 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:44:54.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:44:54 gibba015 bash[29377]: audit 2021-03-10T15:44:53.257912+0000 mon.c (mon.1) 1718 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T15:44:54.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:44:54 gibba015 bash[29377]: audit 2021-03-10T15:44:53.258959+0000 mon.c (mon.1) 1719 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:44:54.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:44:54 gibba015 bash[29377]: audit 2021-03-10T15:44:53.259025+0000 mon.a (mon.0) 1528 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T15:44:54.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:44:54 gibba015 bash[29377]: audit 2021-03-10T15:44:53.259685+0000 mon.c (mon.1) 1720 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:44:54.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:44:54 gibba015 bash[29377]: audit 2021-03-10T15:44:53.260386+0000 mon.a (mon.0) 1529 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:44:54.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:44:54 gibba015 bash[29377]: audit 2021-03-10T15:44:53.260790+0000 mon.c (mon.1) 1721 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:44:54.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:44:54 gibba015 bash[29377]: audit 2021-03-10T15:44:53.261474+0000 mon.a (mon.0) 1530 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:44:54.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:44:54 gibba015 bash[29377]: audit 2021-03-10T15:44:53.262508+0000 mon.a (mon.0) 1531 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:44:54.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:44:54 gibba015 bash[30343]: audit 2021-03-10T15:44:52.420144+0000 mgr.gibba045.orlgmj (mgr.34412) 6142 : audit [DBG] from='client.58162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:44:54.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:44:54 gibba015 bash[30343]: audit 2021-03-10T15:44:52.643693+0000 mgr.gibba045.orlgmj (mgr.34412) 6143 : audit [DBG] from='client.58168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:44:54.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:44:54 gibba015 bash[30343]: cephadm 2021-03-10T15:44:52.700955+0000 mgr.gibba045.orlgmj (mgr.34412) 6144 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:44:54.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:44:54 gibba015 bash[30343]: audit 2021-03-10T15:44:53.255394+0000 mon.c (mon.1) 1716 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:44:54.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:44:54 gibba015 bash[30343]: audit 2021-03-10T15:44:53.256010+0000 mon.c (mon.1) 1717 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:44:54.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:44:54 gibba015 bash[30343]: audit 2021-03-10T15:44:53.256523+0000 mon.a (mon.0) 1526 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:44:54.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:44:54 gibba015 bash[30343]: audit 2021-03-10T15:44:53.257709+0000 mon.a (mon.0) 1527 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:44:54.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:44:54 gibba015 bash[30343]: audit 2021-03-10T15:44:53.257912+0000 mon.c (mon.1) 1718 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T15:44:54.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:44:54 gibba015 bash[30343]: audit 2021-03-10T15:44:53.258959+0000 mon.c (mon.1) 1719 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:44:54.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:44:54 gibba015 bash[30343]: audit 2021-03-10T15:44:53.259025+0000 mon.a (mon.0) 1528 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T15:44:54.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:44:54 gibba015 bash[30343]: audit 2021-03-10T15:44:53.259685+0000 mon.c (mon.1) 1720 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:44:54.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:44:54 gibba015 bash[30343]: audit 2021-03-10T15:44:53.260386+0000 mon.a (mon.0) 1529 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:44:54.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:44:54 gibba015 bash[30343]: audit 2021-03-10T15:44:53.260790+0000 mon.c (mon.1) 1721 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:44:54.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:44:54 gibba015 bash[30343]: audit 2021-03-10T15:44:53.261474+0000 mon.a (mon.0) 1530 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:44:54.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:44:54 gibba015 bash[30343]: audit 2021-03-10T15:44:53.262508+0000 mon.a (mon.0) 1531 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:44:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:44:54 gibba045 bash[25517]: audit 2021-03-10T15:44:52.420144+0000 mgr.gibba045.orlgmj (mgr.34412) 6142 : audit [DBG] from='client.58162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:44:54.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:44:54 gibba045 bash[25517]: audit 2021-03-10T15:44:52.643693+0000 mgr.gibba045.orlgmj (mgr.34412) 6143 : audit [DBG] from='client.58168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:44:54.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:44:54 gibba045 bash[25517]: cephadm 2021-03-10T15:44:52.700955+0000 mgr.gibba045.orlgmj (mgr.34412) 6144 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:44:54.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:44:54 gibba045 bash[25517]: audit 2021-03-10T15:44:53.255394+0000 mon.c (mon.1) 1716 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:44:54.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:44:54 gibba045 bash[25517]: audit 2021-03-10T15:44:53.256010+0000 mon.c (mon.1) 1717 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:44:54.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:44:54 gibba045 bash[25517]: audit 2021-03-10T15:44:53.256523+0000 mon.a (mon.0) 1526 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:44:54.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:44:54 gibba045 bash[25517]: audit 2021-03-10T15:44:53.257709+0000 mon.a (mon.0) 1527 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:44:54.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:44:54 gibba045 bash[25517]: audit 2021-03-10T15:44:53.257912+0000 mon.c (mon.1) 1718 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T15:44:54.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:44:54 gibba045 bash[25517]: audit 2021-03-10T15:44:53.258959+0000 mon.c (mon.1) 1719 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:44:54.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:44:54 gibba045 bash[25517]: audit 2021-03-10T15:44:53.259025+0000 mon.a (mon.0) 1528 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T15:44:54.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:44:54 gibba045 bash[25517]: audit 2021-03-10T15:44:53.259685+0000 mon.c (mon.1) 1720 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:44:54.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:44:54 gibba045 bash[25517]: audit 2021-03-10T15:44:53.260386+0000 mon.a (mon.0) 1529 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:44:54.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:44:54 gibba045 bash[25517]: audit 2021-03-10T15:44:53.260790+0000 mon.c (mon.1) 1721 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:44:54.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:44:54 gibba045 bash[25517]: audit 2021-03-10T15:44:53.261474+0000 mon.a (mon.0) 1530 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:44:54.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:44:54 gibba045 bash[25517]: audit 2021-03-10T15:44:53.262508+0000 mon.a (mon.0) 1531 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:44:55.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:44:55 gibba015 bash[29377]: cluster 2021-03-10T15:44:54.000174+0000 mgr.gibba045.orlgmj (mgr.34412) 6145 : cluster [DBG] pgmap v3493: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:55.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:44:55 gibba015 bash[30343]: cluster 2021-03-10T15:44:54.000174+0000 mgr.gibba045.orlgmj (mgr.34412) 6145 : cluster [DBG] pgmap v3493: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:55.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:44:55 gibba045 bash[25517]: cluster 2021-03-10T15:44:54.000174+0000 mgr.gibba045.orlgmj (mgr.34412) 6145 : cluster [DBG] pgmap v3493: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:57.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:44:57 gibba015 bash[29377]: cluster 2021-03-10T15:44:56.001667+0000 mgr.gibba045.orlgmj (mgr.34412) 6146 : cluster [DBG] pgmap v3494: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:57.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:44:57 gibba015 bash[30343]: cluster 2021-03-10T15:44:56.001667+0000 mgr.gibba045.orlgmj (mgr.34412) 6146 : cluster [DBG] pgmap v3494: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:57.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:44:57 gibba045 bash[25517]: cluster 2021-03-10T15:44:56.001667+0000 mgr.gibba045.orlgmj (mgr.34412) 6146 : cluster [DBG] pgmap v3494: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:59.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:44:59 gibba015 bash[30343]: cluster 2021-03-10T15:44:58.002684+0000 mgr.gibba045.orlgmj (mgr.34412) 6147 : cluster [DBG] pgmap v3495: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:59.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:44:59 gibba015 bash[29377]: cluster 2021-03-10T15:44:58.002684+0000 mgr.gibba045.orlgmj (mgr.34412) 6147 : cluster [DBG] pgmap v3495: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:59.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:44:59 gibba045 bash[25517]: cluster 2021-03-10T15:44:58.002684+0000 mgr.gibba045.orlgmj (mgr.34412) 6147 : cluster [DBG] pgmap v3495: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:01.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:45:00 gibba045 bash[25517]: cluster 2021-03-10T15:45:00.004021+0000 mgr.gibba045.orlgmj (mgr.34412) 6148 : cluster [DBG] pgmap v3496: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:01.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:45:00 gibba015 bash[29377]: cluster 2021-03-10T15:45:00.004021+0000 mgr.gibba045.orlgmj (mgr.34412) 6148 : cluster [DBG] pgmap v3496: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:01.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:45:00 gibba015 bash[30343]: cluster 2021-03-10T15:45:00.004021+0000 mgr.gibba045.orlgmj (mgr.34412) 6148 : cluster [DBG] pgmap v3496: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:03.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:45:03 gibba015 bash[29377]: cluster 2021-03-10T15:45:02.005741+0000 mgr.gibba045.orlgmj (mgr.34412) 6149 : cluster [DBG] pgmap v3497: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:03.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:45:03 gibba015 bash[30343]: cluster 2021-03-10T15:45:02.005741+0000 mgr.gibba045.orlgmj (mgr.34412) 6149 : cluster [DBG] pgmap v3497: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:03.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:45:03 gibba045 bash[25517]: cluster 2021-03-10T15:45:02.005741+0000 mgr.gibba045.orlgmj (mgr.34412) 6149 : cluster [DBG] pgmap v3497: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:05.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:45:05 gibba015 bash[29377]: cluster 2021-03-10T15:45:04.006951+0000 mgr.gibba045.orlgmj (mgr.34412) 6150 : cluster [DBG] pgmap v3498: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:05.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:45:05 gibba015 bash[30343]: cluster 2021-03-10T15:45:04.006951+0000 mgr.gibba045.orlgmj (mgr.34412) 6150 : cluster [DBG] pgmap v3498: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:05.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:45:05 gibba045 bash[25517]: cluster 2021-03-10T15:45:04.006951+0000 mgr.gibba045.orlgmj (mgr.34412) 6150 : cluster [DBG] pgmap v3498: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:07.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:45:07 gibba015 bash[29377]: cluster 2021-03-10T15:45:06.008615+0000 mgr.gibba045.orlgmj (mgr.34412) 6151 : cluster [DBG] pgmap v3499: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:07.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:45:07 gibba015 bash[30343]: cluster 2021-03-10T15:45:06.008615+0000 mgr.gibba045.orlgmj (mgr.34412) 6151 : cluster [DBG] pgmap v3499: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:07.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:45:07 gibba045 bash[25517]: cluster 2021-03-10T15:45:06.008615+0000 mgr.gibba045.orlgmj (mgr.34412) 6151 : cluster [DBG] pgmap v3499: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:09.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:45:09 gibba015 bash[29377]: cephadm 2021-03-10T15:45:07.714796+0000 mgr.gibba045.orlgmj (mgr.34412) 6152 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:45:09.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:45:09 gibba015 bash[29377]: cluster 2021-03-10T15:45:08.010244+0000 mgr.gibba045.orlgmj (mgr.34412) 6153 : cluster [DBG] pgmap v3500: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:09.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:45:09 gibba015 bash[30343]: cephadm 2021-03-10T15:45:07.714796+0000 mgr.gibba045.orlgmj (mgr.34412) 6152 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:45:09.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:45:09 gibba015 bash[30343]: cluster 2021-03-10T15:45:08.010244+0000 mgr.gibba045.orlgmj (mgr.34412) 6153 : cluster [DBG] pgmap v3500: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:09.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:45:09 gibba045 bash[25517]: cephadm 2021-03-10T15:45:07.714796+0000 mgr.gibba045.orlgmj (mgr.34412) 6152 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:45:09.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:45:09 gibba045 bash[25517]: cluster 2021-03-10T15:45:08.010244+0000 mgr.gibba045.orlgmj (mgr.34412) 6153 : cluster [DBG] pgmap v3500: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:11.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:45:10 gibba045 bash[25517]: cluster 2021-03-10T15:45:10.011656+0000 mgr.gibba045.orlgmj (mgr.34412) 6154 : cluster [DBG] pgmap v3501: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:11.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:45:10 gibba015 bash[29377]: cluster 2021-03-10T15:45:10.011656+0000 mgr.gibba045.orlgmj (mgr.34412) 6154 : cluster [DBG] pgmap v3501: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:11.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:45:10 gibba015 bash[30343]: cluster 2021-03-10T15:45:10.011656+0000 mgr.gibba045.orlgmj (mgr.34412) 6154 : cluster [DBG] pgmap v3501: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:13.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:45:13 gibba015 bash[29377]: cluster 2021-03-10T15:45:12.013326+0000 mgr.gibba045.orlgmj (mgr.34412) 6155 : cluster [DBG] pgmap v3502: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:13.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:45:13 gibba015 bash[30343]: cluster 2021-03-10T15:45:12.013326+0000 mgr.gibba045.orlgmj (mgr.34412) 6155 : cluster [DBG] pgmap v3502: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:13.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:45:13 gibba045 bash[25517]: cluster 2021-03-10T15:45:12.013326+0000 mgr.gibba045.orlgmj (mgr.34412) 6155 : cluster [DBG] pgmap v3502: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:15.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:45:15 gibba015 bash[29377]: cluster 2021-03-10T15:45:14.014541+0000 mgr.gibba045.orlgmj (mgr.34412) 6156 : cluster [DBG] pgmap v3503: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:15.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:45:15 gibba015 bash[30343]: cluster 2021-03-10T15:45:14.014541+0000 mgr.gibba045.orlgmj (mgr.34412) 6156 : cluster [DBG] pgmap v3503: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:15.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:45:15 gibba045 bash[25517]: cluster 2021-03-10T15:45:14.014541+0000 mgr.gibba045.orlgmj (mgr.34412) 6156 : cluster [DBG] pgmap v3503: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:17.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:45:17 gibba015 bash[29377]: cluster 2021-03-10T15:45:16.016133+0000 mgr.gibba045.orlgmj (mgr.34412) 6157 : cluster [DBG] pgmap v3504: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:17.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:45:17 gibba015 bash[30343]: cluster 2021-03-10T15:45:16.016133+0000 mgr.gibba045.orlgmj (mgr.34412) 6157 : cluster [DBG] pgmap v3504: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:17.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:45:17 gibba045 bash[25517]: cluster 2021-03-10T15:45:16.016133+0000 mgr.gibba045.orlgmj (mgr.34412) 6157 : cluster [DBG] pgmap v3504: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:19.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:45:19 gibba015 bash[29377]: cluster 2021-03-10T15:45:18.017713+0000 mgr.gibba045.orlgmj (mgr.34412) 6158 : cluster [DBG] pgmap v3505: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:19.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:45:19 gibba015 bash[30343]: cluster 2021-03-10T15:45:18.017713+0000 mgr.gibba045.orlgmj (mgr.34412) 6158 : cluster [DBG] pgmap v3505: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:19.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:45:19 gibba045 bash[25517]: cluster 2021-03-10T15:45:18.017713+0000 mgr.gibba045.orlgmj (mgr.34412) 6158 : cluster [DBG] pgmap v3505: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:21.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:45:20 gibba045 bash[25517]: cluster 2021-03-10T15:45:20.019228+0000 mgr.gibba045.orlgmj (mgr.34412) 6159 : cluster [DBG] pgmap v3506: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:21.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:45:20 gibba015 bash[29377]: cluster 2021-03-10T15:45:20.019228+0000 mgr.gibba045.orlgmj (mgr.34412) 6159 : cluster [DBG] pgmap v3506: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:21.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:45:20 gibba015 bash[30343]: cluster 2021-03-10T15:45:20.019228+0000 mgr.gibba045.orlgmj (mgr.34412) 6159 : cluster [DBG] pgmap v3506: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:23.184 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:45:23.411 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:45:23.412 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (116m) 10m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:45:23.412 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 9m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:45:23.412 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (116m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:45:23.413 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (116m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:45:23.413 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (115m) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:45:23.413 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (115m) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:45:23.413 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (115m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:45:23.413 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (115m) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:45:23.414 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 10m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:45:23.414 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 9m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:45:23.414 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (114m) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:45:23.414 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (113m) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:45:23.415 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (113m) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:45:23.415 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (113m) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:45:23.415 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (112m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:45:23.415 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (112m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:45:23.416 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (111m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:45:23.416 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (111m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:45:23.416 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 9m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:45:23.416 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 9m ago 119m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:45:23.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:45:23 gibba015 bash[29377]: cluster 2021-03-10T15:45:22.021177+0000 mgr.gibba045.orlgmj (mgr.34412) 6160 : cluster [DBG] pgmap v3507: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:23.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:45:23 gibba015 bash[29377]: audit 2021-03-10T15:45:22.728534+0000 mon.c (mon.1) 1722 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:45:23.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:45:23 gibba015 bash[29377]: audit 2021-03-10T15:45:22.735229+0000 mon.c (mon.1) 1723 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:45:23.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:45:23 gibba015 bash[30343]: cluster 2021-03-10T15:45:22.021177+0000 mgr.gibba045.orlgmj (mgr.34412) 6160 : cluster [DBG] pgmap v3507: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:23.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:45:23 gibba015 bash[30343]: audit 2021-03-10T15:45:22.728534+0000 mon.c (mon.1) 1722 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:45:23.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:45:23 gibba015 bash[30343]: audit 2021-03-10T15:45:22.735229+0000 mon.c (mon.1) 1723 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:45:23.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:45:23 gibba045 bash[25517]: cluster 2021-03-10T15:45:22.021177+0000 mgr.gibba045.orlgmj (mgr.34412) 6160 : cluster [DBG] pgmap v3507: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:23.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:45:23 gibba045 bash[25517]: audit 2021-03-10T15:45:22.728534+0000 mon.c (mon.1) 1722 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:45:23.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:45:23 gibba045 bash[25517]: audit 2021-03-10T15:45:22.735229+0000 mon.c (mon.1) 1723 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:45:23.659 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:45:23.660 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:45:23.660 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:45:23.660 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:45:23.660 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:45:23.661 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:45:23.661 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:45:23.661 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:45:23.661 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:45:23.661 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:45:23.662 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:45:23.662 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:45:23.662 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:45:23.663 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:45:23.663 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:45:24.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:45:24 gibba015 bash[29377]: cephadm 2021-03-10T15:45:22.737985+0000 mgr.gibba045.orlgmj (mgr.34412) 6161 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:45:24.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:45:24 gibba015 bash[29377]: audit 2021-03-10T15:45:23.175437+0000 mgr.gibba045.orlgmj (mgr.34412) 6162 : audit [DBG] from='client.58180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:45:24.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:45:24 gibba015 bash[29377]: audit 2021-03-10T15:45:23.398424+0000 mgr.gibba045.orlgmj (mgr.34412) 6163 : audit [DBG] from='client.58186 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:45:24.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:45:24 gibba015 bash[29377]: audit 2021-03-10T15:45:23.655890+0000 mon.c (mon.1) 1724 : audit [DBG] from='client.? 172.21.2.115:0/471596268' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:45:24.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:45:24 gibba015 bash[30343]: cephadm 2021-03-10T15:45:22.737985+0000 mgr.gibba045.orlgmj (mgr.34412) 6161 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:45:24.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:45:24 gibba015 bash[30343]: audit 2021-03-10T15:45:23.175437+0000 mgr.gibba045.orlgmj (mgr.34412) 6162 : audit [DBG] from='client.58180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:45:24.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:45:24 gibba015 bash[30343]: audit 2021-03-10T15:45:23.398424+0000 mgr.gibba045.orlgmj (mgr.34412) 6163 : audit [DBG] from='client.58186 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:45:24.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:45:24 gibba015 bash[30343]: audit 2021-03-10T15:45:23.655890+0000 mon.c (mon.1) 1724 : audit [DBG] from='client.? 172.21.2.115:0/471596268' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:45:24.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:45:24 gibba045 bash[25517]: cephadm 2021-03-10T15:45:22.737985+0000 mgr.gibba045.orlgmj (mgr.34412) 6161 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:45:24.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:45:24 gibba045 bash[25517]: audit 2021-03-10T15:45:23.175437+0000 mgr.gibba045.orlgmj (mgr.34412) 6162 : audit [DBG] from='client.58180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:45:24.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:45:24 gibba045 bash[25517]: audit 2021-03-10T15:45:23.398424+0000 mgr.gibba045.orlgmj (mgr.34412) 6163 : audit [DBG] from='client.58186 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:45:24.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:45:24 gibba045 bash[25517]: audit 2021-03-10T15:45:23.655890+0000 mon.c (mon.1) 1724 : audit [DBG] from='client.? 172.21.2.115:0/471596268' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:45:25.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:45:25 gibba015 bash[29377]: cluster 2021-03-10T15:45:24.022408+0000 mgr.gibba045.orlgmj (mgr.34412) 6164 : cluster [DBG] pgmap v3508: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:25.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:45:25 gibba015 bash[30343]: cluster 2021-03-10T15:45:24.022408+0000 mgr.gibba045.orlgmj (mgr.34412) 6164 : cluster [DBG] pgmap v3508: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:25.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:45:25 gibba045 bash[25517]: cluster 2021-03-10T15:45:24.022408+0000 mgr.gibba045.orlgmj (mgr.34412) 6164 : cluster [DBG] pgmap v3508: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:27.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:45:27 gibba045 bash[25517]: cluster 2021-03-10T15:45:26.024157+0000 mgr.gibba045.orlgmj (mgr.34412) 6165 : cluster [DBG] pgmap v3509: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:27.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:45:27 gibba045 bash[25517]: audit 2021-03-10T15:45:26.231619+0000 mon.a (mon.0) 1532 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:45:27.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:45:27 gibba045 bash[25517]: cephadm 2021-03-10T15:45:26.235865+0000 mgr.gibba045.orlgmj (mgr.34412) 6166 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:45:27.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:45:27 gibba045 bash[25517]: audit 2021-03-10T15:45:26.443806+0000 mon.a (mon.0) 1533 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:45:27.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:45:27 gibba045 bash[25517]: audit 2021-03-10T15:45:26.452682+0000 mon.c (mon.1) 1725 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:45:27.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:45:27 gibba045 bash[25517]: audit 2021-03-10T15:45:26.454813+0000 mon.c (mon.1) 1726 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:45:27.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:45:27 gibba045 bash[25517]: audit 2021-03-10T15:45:26.456673+0000 mon.c (mon.1) 1727 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:45:27.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:45:27 gibba045 bash[25517]: audit 2021-03-10T15:45:26.457959+0000 mon.c (mon.1) 1728 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:45:27.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:45:27 gibba045 bash[25517]: audit 2021-03-10T15:45:26.463806+0000 mon.c (mon.1) 1729 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:45:27.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:45:27 gibba045 bash[25517]: audit 2021-03-10T15:45:26.468960+0000 mon.c (mon.1) 1730 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:45:27.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:45:27 gibba015 bash[29377]: cluster 2021-03-10T15:45:26.024157+0000 mgr.gibba045.orlgmj (mgr.34412) 6165 : cluster [DBG] pgmap v3509: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:27.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:45:27 gibba015 bash[29377]: audit 2021-03-10T15:45:26.231619+0000 mon.a (mon.0) 1532 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:45:27.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:45:27 gibba015 bash[29377]: cephadm 2021-03-10T15:45:26.235865+0000 mgr.gibba045.orlgmj (mgr.34412) 6166 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:45:27.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:45:27 gibba015 bash[29377]: audit 2021-03-10T15:45:26.443806+0000 mon.a (mon.0) 1533 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:45:27.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:45:27 gibba015 bash[29377]: audit 2021-03-10T15:45:26.452682+0000 mon.c (mon.1) 1725 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:45:27.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:45:27 gibba015 bash[29377]: audit 2021-03-10T15:45:26.454813+0000 mon.c (mon.1) 1726 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:45:27.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:45:27 gibba015 bash[29377]: audit 2021-03-10T15:45:26.456673+0000 mon.c (mon.1) 1727 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:45:27.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:45:27 gibba015 bash[29377]: audit 2021-03-10T15:45:26.457959+0000 mon.c (mon.1) 1728 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:45:27.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:45:27 gibba015 bash[29377]: audit 2021-03-10T15:45:26.463806+0000 mon.c (mon.1) 1729 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:45:27.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:45:27 gibba015 bash[29377]: audit 2021-03-10T15:45:26.468960+0000 mon.c (mon.1) 1730 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:45:27.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:45:27 gibba015 bash[30343]: cluster 2021-03-10T15:45:26.024157+0000 mgr.gibba045.orlgmj (mgr.34412) 6165 : cluster [DBG] pgmap v3509: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:27.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:45:27 gibba015 bash[30343]: audit 2021-03-10T15:45:26.231619+0000 mon.a (mon.0) 1532 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:45:27.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:45:27 gibba015 bash[30343]: cephadm 2021-03-10T15:45:26.235865+0000 mgr.gibba045.orlgmj (mgr.34412) 6166 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:45:27.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:45:27 gibba015 bash[30343]: audit 2021-03-10T15:45:26.443806+0000 mon.a (mon.0) 1533 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:45:27.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:45:27 gibba015 bash[30343]: audit 2021-03-10T15:45:26.452682+0000 mon.c (mon.1) 1725 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:45:27.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:45:27 gibba015 bash[30343]: audit 2021-03-10T15:45:26.454813+0000 mon.c (mon.1) 1726 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:45:27.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:45:27 gibba015 bash[30343]: audit 2021-03-10T15:45:26.456673+0000 mon.c (mon.1) 1727 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:45:27.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:45:27 gibba015 bash[30343]: audit 2021-03-10T15:45:26.457959+0000 mon.c (mon.1) 1728 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:45:27.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:45:27 gibba015 bash[30343]: audit 2021-03-10T15:45:26.463806+0000 mon.c (mon.1) 1729 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:45:27.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:45:27 gibba015 bash[30343]: audit 2021-03-10T15:45:26.468960+0000 mon.c (mon.1) 1730 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:45:28.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:45:28 gibba045 bash[25517]: cephadm 2021-03-10T15:45:26.455151+0000 mgr.gibba045.orlgmj (mgr.34412) 6167 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:45:28.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:45:28 gibba045 bash[25517]: cephadm 2021-03-10T15:45:26.457440+0000 mgr.gibba045.orlgmj (mgr.34412) 6168 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:45:28.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:45:28 gibba045 bash[25517]: cephadm 2021-03-10T15:45:26.459265+0000 mgr.gibba045.orlgmj (mgr.34412) 6169 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:45:28.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:45:28 gibba045 bash[25517]: cephadm 2021-03-10T15:45:26.459325+0000 mgr.gibba045.orlgmj (mgr.34412) 6170 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:45:28.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:45:28 gibba045 bash[25517]: cephadm 2021-03-10T15:45:26.460644+0000 mgr.gibba045.orlgmj (mgr.34412) 6171 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:45:28.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:45:28 gibba045 bash[25517]: cephadm 2021-03-10T15:45:26.460731+0000 mgr.gibba045.orlgmj (mgr.34412) 6172 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:45:28.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:45:28 gibba045 bash[25517]: cephadm 2021-03-10T15:45:26.461893+0000 mgr.gibba045.orlgmj (mgr.34412) 6173 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:45:28.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:45:28 gibba045 bash[25517]: cephadm 2021-03-10T15:45:26.464714+0000 mgr.gibba045.orlgmj (mgr.34412) 6174 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:45:28.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:45:28 gibba045 bash[25517]: cephadm 2021-03-10T15:45:26.465094+0000 mgr.gibba045.orlgmj (mgr.34412) 6175 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:45:28.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:45:28 gibba045 bash[25517]: cephadm 2021-03-10T15:45:26.469141+0000 mgr.gibba045.orlgmj (mgr.34412) 6176 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:45:28.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:45:28 gibba045 bash[25517]: cephadm 2021-03-10T15:45:26.471204+0000 mgr.gibba045.orlgmj (mgr.34412) 6177 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:45:28.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:45:28 gibba045 bash[25517]: cephadm 2021-03-10T15:45:26.475075+0000 mgr.gibba045.orlgmj (mgr.34412) 6178 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:45:28.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:45:28 gibba045 bash[25517]: cephadm 2021-03-10T15:45:26.475596+0000 mgr.gibba045.orlgmj (mgr.34412) 6179 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:45:28.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:45:28 gibba045 bash[25517]: cephadm 2021-03-10T15:45:26.476194+0000 mgr.gibba045.orlgmj (mgr.34412) 6180 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:45:28.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:45:28 gibba015 bash[29377]: cephadm 2021-03-10T15:45:26.455151+0000 mgr.gibba045.orlgmj (mgr.34412) 6167 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:45:28.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:45:28 gibba015 bash[29377]: cephadm 2021-03-10T15:45:26.457440+0000 mgr.gibba045.orlgmj (mgr.34412) 6168 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:45:28.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:45:28 gibba015 bash[29377]: cephadm 2021-03-10T15:45:26.459265+0000 mgr.gibba045.orlgmj (mgr.34412) 6169 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:45:28.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:45:28 gibba015 bash[29377]: cephadm 2021-03-10T15:45:26.459325+0000 mgr.gibba045.orlgmj (mgr.34412) 6170 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:45:28.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:45:28 gibba015 bash[29377]: cephadm 2021-03-10T15:45:26.460644+0000 mgr.gibba045.orlgmj (mgr.34412) 6171 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:45:28.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:45:28 gibba015 bash[29377]: cephadm 2021-03-10T15:45:26.460731+0000 mgr.gibba045.orlgmj (mgr.34412) 6172 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:45:28.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:45:28 gibba015 bash[29377]: cephadm 2021-03-10T15:45:26.461893+0000 mgr.gibba045.orlgmj (mgr.34412) 6173 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:45:28.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:45:28 gibba015 bash[29377]: cephadm 2021-03-10T15:45:26.464714+0000 mgr.gibba045.orlgmj (mgr.34412) 6174 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:45:28.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:45:28 gibba015 bash[29377]: cephadm 2021-03-10T15:45:26.465094+0000 mgr.gibba045.orlgmj (mgr.34412) 6175 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:45:28.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:45:28 gibba015 bash[29377]: cephadm 2021-03-10T15:45:26.469141+0000 mgr.gibba045.orlgmj (mgr.34412) 6176 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:45:28.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:45:28 gibba015 bash[29377]: cephadm 2021-03-10T15:45:26.471204+0000 mgr.gibba045.orlgmj (mgr.34412) 6177 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:45:28.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:45:28 gibba015 bash[29377]: cephadm 2021-03-10T15:45:26.475075+0000 mgr.gibba045.orlgmj (mgr.34412) 6178 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:45:28.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:45:28 gibba015 bash[29377]: cephadm 2021-03-10T15:45:26.475596+0000 mgr.gibba045.orlgmj (mgr.34412) 6179 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:45:28.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:45:28 gibba015 bash[29377]: cephadm 2021-03-10T15:45:26.476194+0000 mgr.gibba045.orlgmj (mgr.34412) 6180 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:45:28.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:45:28 gibba015 bash[30343]: cephadm 2021-03-10T15:45:26.455151+0000 mgr.gibba045.orlgmj (mgr.34412) 6167 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:45:28.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:45:28 gibba015 bash[30343]: cephadm 2021-03-10T15:45:26.457440+0000 mgr.gibba045.orlgmj (mgr.34412) 6168 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:45:28.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:45:28 gibba015 bash[30343]: cephadm 2021-03-10T15:45:26.459265+0000 mgr.gibba045.orlgmj (mgr.34412) 6169 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:45:28.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:45:28 gibba015 bash[30343]: cephadm 2021-03-10T15:45:26.459325+0000 mgr.gibba045.orlgmj (mgr.34412) 6170 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:45:28.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:45:28 gibba015 bash[30343]: cephadm 2021-03-10T15:45:26.460644+0000 mgr.gibba045.orlgmj (mgr.34412) 6171 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:45:28.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:45:28 gibba015 bash[30343]: cephadm 2021-03-10T15:45:26.460731+0000 mgr.gibba045.orlgmj (mgr.34412) 6172 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:45:28.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:45:28 gibba015 bash[30343]: cephadm 2021-03-10T15:45:26.461893+0000 mgr.gibba045.orlgmj (mgr.34412) 6173 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:45:28.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:45:28 gibba015 bash[30343]: cephadm 2021-03-10T15:45:26.464714+0000 mgr.gibba045.orlgmj (mgr.34412) 6174 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:45:28.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:45:28 gibba015 bash[30343]: cephadm 2021-03-10T15:45:26.465094+0000 mgr.gibba045.orlgmj (mgr.34412) 6175 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:45:28.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:45:28 gibba015 bash[30343]: cephadm 2021-03-10T15:45:26.469141+0000 mgr.gibba045.orlgmj (mgr.34412) 6176 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:45:28.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:45:28 gibba015 bash[30343]: cephadm 2021-03-10T15:45:26.471204+0000 mgr.gibba045.orlgmj (mgr.34412) 6177 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:45:28.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:45:28 gibba015 bash[30343]: cephadm 2021-03-10T15:45:26.475075+0000 mgr.gibba045.orlgmj (mgr.34412) 6178 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:45:28.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:45:28 gibba015 bash[30343]: cephadm 2021-03-10T15:45:26.475596+0000 mgr.gibba045.orlgmj (mgr.34412) 6179 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:45:28.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:45:28 gibba015 bash[30343]: cephadm 2021-03-10T15:45:26.476194+0000 mgr.gibba045.orlgmj (mgr.34412) 6180 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:45:29.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:45:29 gibba045 bash[25517]: cluster 2021-03-10T15:45:28.025705+0000 mgr.gibba045.orlgmj (mgr.34412) 6181 : cluster [DBG] pgmap v3510: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:29.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:45:29 gibba015 bash[29377]: cluster 2021-03-10T15:45:28.025705+0000 mgr.gibba045.orlgmj (mgr.34412) 6181 : cluster [DBG] pgmap v3510: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:29.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:45:29 gibba015 bash[30343]: cluster 2021-03-10T15:45:28.025705+0000 mgr.gibba045.orlgmj (mgr.34412) 6181 : cluster [DBG] pgmap v3510: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:31.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:45:30 gibba015 bash[29377]: cluster 2021-03-10T15:45:30.026466+0000 mgr.gibba045.orlgmj (mgr.34412) 6182 : cluster [DBG] pgmap v3511: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:31.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:45:30 gibba015 bash[30343]: cluster 2021-03-10T15:45:30.026466+0000 mgr.gibba045.orlgmj (mgr.34412) 6182 : cluster [DBG] pgmap v3511: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:31.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:45:30 gibba045 bash[25517]: cluster 2021-03-10T15:45:30.026466+0000 mgr.gibba045.orlgmj (mgr.34412) 6182 : cluster [DBG] pgmap v3511: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:33.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:45:33 gibba015 bash[29377]: cluster 2021-03-10T15:45:32.027833+0000 mgr.gibba045.orlgmj (mgr.34412) 6183 : cluster [DBG] pgmap v3512: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:33.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:45:33 gibba015 bash[30343]: cluster 2021-03-10T15:45:32.027833+0000 mgr.gibba045.orlgmj (mgr.34412) 6183 : cluster [DBG] pgmap v3512: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:33.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:45:33 gibba045 bash[25517]: cluster 2021-03-10T15:45:32.027833+0000 mgr.gibba045.orlgmj (mgr.34412) 6183 : cluster [DBG] pgmap v3512: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:35.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:45:35 gibba015 bash[29377]: cluster 2021-03-10T15:45:34.029087+0000 mgr.gibba045.orlgmj (mgr.34412) 6184 : cluster [DBG] pgmap v3513: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:35.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:45:35 gibba015 bash[30343]: cluster 2021-03-10T15:45:34.029087+0000 mgr.gibba045.orlgmj (mgr.34412) 6184 : cluster [DBG] pgmap v3513: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:35.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:45:35 gibba045 bash[25517]: cluster 2021-03-10T15:45:34.029087+0000 mgr.gibba045.orlgmj (mgr.34412) 6184 : cluster [DBG] pgmap v3513: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:37.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:45:37 gibba015 bash[29377]: cluster 2021-03-10T15:45:36.030759+0000 mgr.gibba045.orlgmj (mgr.34412) 6185 : cluster [DBG] pgmap v3514: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:37.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:45:37 gibba015 bash[30343]: cluster 2021-03-10T15:45:36.030759+0000 mgr.gibba045.orlgmj (mgr.34412) 6185 : cluster [DBG] pgmap v3514: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:37.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:45:37 gibba045 bash[25517]: cluster 2021-03-10T15:45:36.030759+0000 mgr.gibba045.orlgmj (mgr.34412) 6185 : cluster [DBG] pgmap v3514: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:39.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:45:39 gibba015 bash[29377]: cluster 2021-03-10T15:45:38.032298+0000 mgr.gibba045.orlgmj (mgr.34412) 6186 : cluster [DBG] pgmap v3515: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:39.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:45:39 gibba015 bash[30343]: cluster 2021-03-10T15:45:38.032298+0000 mgr.gibba045.orlgmj (mgr.34412) 6186 : cluster [DBG] pgmap v3515: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:39.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:45:39 gibba045 bash[25517]: cluster 2021-03-10T15:45:38.032298+0000 mgr.gibba045.orlgmj (mgr.34412) 6186 : cluster [DBG] pgmap v3515: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:41.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:45:40 gibba015 bash[29377]: cluster 2021-03-10T15:45:40.032986+0000 mgr.gibba045.orlgmj (mgr.34412) 6187 : cluster [DBG] pgmap v3516: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:41.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:45:40 gibba015 bash[30343]: cluster 2021-03-10T15:45:40.032986+0000 mgr.gibba045.orlgmj (mgr.34412) 6187 : cluster [DBG] pgmap v3516: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:41.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:45:40 gibba045 bash[25517]: cluster 2021-03-10T15:45:40.032986+0000 mgr.gibba045.orlgmj (mgr.34412) 6187 : cluster [DBG] pgmap v3516: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:43.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:45:43 gibba015 bash[29377]: cephadm 2021-03-10T15:45:41.486025+0000 mgr.gibba045.orlgmj (mgr.34412) 6188 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:45:43.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:45:43 gibba015 bash[29377]: cluster 2021-03-10T15:45:42.034363+0000 mgr.gibba045.orlgmj (mgr.34412) 6189 : cluster [DBG] pgmap v3517: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:43.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:45:43 gibba015 bash[30343]: cephadm 2021-03-10T15:45:41.486025+0000 mgr.gibba045.orlgmj (mgr.34412) 6188 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:45:43.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:45:43 gibba015 bash[30343]: cluster 2021-03-10T15:45:42.034363+0000 mgr.gibba045.orlgmj (mgr.34412) 6189 : cluster [DBG] pgmap v3517: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:43.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:45:43 gibba045 bash[25517]: cephadm 2021-03-10T15:45:41.486025+0000 mgr.gibba045.orlgmj (mgr.34412) 6188 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:45:43.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:45:43 gibba045 bash[25517]: cluster 2021-03-10T15:45:42.034363+0000 mgr.gibba045.orlgmj (mgr.34412) 6189 : cluster [DBG] pgmap v3517: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:45.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:45:45 gibba015 bash[29377]: cluster 2021-03-10T15:45:44.035580+0000 mgr.gibba045.orlgmj (mgr.34412) 6190 : cluster [DBG] pgmap v3518: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:45.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:45:45 gibba015 bash[30343]: cluster 2021-03-10T15:45:44.035580+0000 mgr.gibba045.orlgmj (mgr.34412) 6190 : cluster [DBG] pgmap v3518: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:45.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:45:45 gibba045 bash[25517]: cluster 2021-03-10T15:45:44.035580+0000 mgr.gibba045.orlgmj (mgr.34412) 6190 : cluster [DBG] pgmap v3518: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:47.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:45:47 gibba015 bash[29377]: cluster 2021-03-10T15:45:46.037077+0000 mgr.gibba045.orlgmj (mgr.34412) 6191 : cluster [DBG] pgmap v3519: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:47.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:45:47 gibba015 bash[30343]: cluster 2021-03-10T15:45:46.037077+0000 mgr.gibba045.orlgmj (mgr.34412) 6191 : cluster [DBG] pgmap v3519: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:47.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:45:47 gibba045 bash[25517]: cluster 2021-03-10T15:45:46.037077+0000 mgr.gibba045.orlgmj (mgr.34412) 6191 : cluster [DBG] pgmap v3519: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:49.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:45:49 gibba015 bash[29377]: cluster 2021-03-10T15:45:48.038451+0000 mgr.gibba045.orlgmj (mgr.34412) 6192 : cluster [DBG] pgmap v3520: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:49.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:45:49 gibba015 bash[30343]: cluster 2021-03-10T15:45:48.038451+0000 mgr.gibba045.orlgmj (mgr.34412) 6192 : cluster [DBG] pgmap v3520: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:49.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:45:49 gibba045 bash[25517]: cluster 2021-03-10T15:45:48.038451+0000 mgr.gibba045.orlgmj (mgr.34412) 6192 : cluster [DBG] pgmap v3520: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:51.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:45:50 gibba015 bash[29377]: cluster 2021-03-10T15:45:50.038953+0000 mgr.gibba045.orlgmj (mgr.34412) 6193 : cluster [DBG] pgmap v3521: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:51.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:45:50 gibba015 bash[30343]: cluster 2021-03-10T15:45:50.038953+0000 mgr.gibba045.orlgmj (mgr.34412) 6193 : cluster [DBG] pgmap v3521: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:51.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:45:50 gibba045 bash[25517]: cluster 2021-03-10T15:45:50.038953+0000 mgr.gibba045.orlgmj (mgr.34412) 6193 : cluster [DBG] pgmap v3521: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:53.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:45:53 gibba015 bash[29377]: cluster 2021-03-10T15:45:52.040644+0000 mgr.gibba045.orlgmj (mgr.34412) 6194 : cluster [DBG] pgmap v3522: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:53.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:45:53 gibba015 bash[30343]: cluster 2021-03-10T15:45:52.040644+0000 mgr.gibba045.orlgmj (mgr.34412) 6194 : cluster [DBG] pgmap v3522: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:53.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:45:53 gibba045 bash[25517]: cluster 2021-03-10T15:45:52.040644+0000 mgr.gibba045.orlgmj (mgr.34412) 6194 : cluster [DBG] pgmap v3522: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:53.903 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:45:54.131 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:45:54.131 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (116m) 27s ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:45:54.131 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 9m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:45:54.131 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (117m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:45:54.132 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (117m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:45:54.132 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (116m) 27s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:45:54.132 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (116m) 27s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:45:54.132 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (115m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:45:54.133 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (115m) 27s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:45:54.133 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 27s ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:45:54.133 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 9m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:45:54.133 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (114m) 27s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:45:54.134 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (114m) 27s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:45:54.134 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (114m) 27s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:45:54.134 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (113m) 27s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:45:54.134 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (113m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:45:54.135 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (112m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:45:54.135 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (112m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:45:54.135 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (111m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:45:54.135 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 9m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:45:54.136 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 9m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T15:45:54.377 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:45:54.378 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:45:54.378 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:45:54.378 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:45:54.378 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:45:54.379 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:45:54.379 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:45:54.379 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:45:54.379 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:45:54.380 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:45:54.380 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:45:54.380 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:45:54.380 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:45:54.380 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:45:54.381 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:45:54.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:45:54 gibba015 bash[29377]: audit 2021-03-10T15:45:53.262685+0000 mon.c (mon.1) 1731 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:45:54.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:45:54 gibba015 bash[29377]: audit 2021-03-10T15:45:53.263388+0000 mon.c (mon.1) 1732 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:45:54.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:45:54 gibba015 bash[29377]: audit 2021-03-10T15:45:53.263837+0000 mon.a (mon.0) 1534 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:45:54.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:45:54 gibba015 bash[29377]: audit 2021-03-10T15:45:53.264271+0000 mon.c (mon.1) 1733 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T15:45:54.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:45:54 gibba015 bash[29377]: audit 2021-03-10T15:45:53.265159+0000 mon.a (mon.0) 1535 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:45:54.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:45:54 gibba015 bash[29377]: audit 2021-03-10T15:45:53.265224+0000 mon.c (mon.1) 1734 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T15:45:54.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:45:54 gibba015 bash[29377]: audit 2021-03-10T15:45:53.266046+0000 mon.c (mon.1) 1735 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:45:54.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:45:54 gibba015 bash[29377]: audit 2021-03-10T15:45:53.266212+0000 mon.a (mon.0) 1536 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T15:45:54.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:45:54 gibba015 bash[29377]: audit 2021-03-10T15:45:53.266753+0000 mon.c (mon.1) 1736 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:45:54.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:45:54 gibba015 bash[29377]: audit 2021-03-10T15:45:53.267420+0000 mon.a (mon.0) 1537 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T15:45:54.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:45:54 gibba015 bash[29377]: audit 2021-03-10T15:45:53.268569+0000 mon.a (mon.0) 1538 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:45:54.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:45:54 gibba015 bash[29377]: audit 2021-03-10T15:45:53.269460+0000 mon.a (mon.0) 1539 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:45:54.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:45:54 gibba015 bash[30343]: audit 2021-03-10T15:45:53.262685+0000 mon.c (mon.1) 1731 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:45:54.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:45:54 gibba015 bash[30343]: audit 2021-03-10T15:45:53.263388+0000 mon.c (mon.1) 1732 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:45:54.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:45:54 gibba015 bash[30343]: audit 2021-03-10T15:45:53.263837+0000 mon.a (mon.0) 1534 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:45:54.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:45:54 gibba015 bash[30343]: audit 2021-03-10T15:45:53.264271+0000 mon.c (mon.1) 1733 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T15:45:54.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:45:54 gibba015 bash[30343]: audit 2021-03-10T15:45:53.265159+0000 mon.a (mon.0) 1535 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:45:54.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:45:54 gibba015 bash[30343]: audit 2021-03-10T15:45:53.265224+0000 mon.c (mon.1) 1734 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T15:45:54.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:45:54 gibba015 bash[30343]: audit 2021-03-10T15:45:53.266046+0000 mon.c (mon.1) 1735 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:45:54.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:45:54 gibba015 bash[30343]: audit 2021-03-10T15:45:53.266212+0000 mon.a (mon.0) 1536 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T15:45:54.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:45:54 gibba015 bash[30343]: audit 2021-03-10T15:45:53.266753+0000 mon.c (mon.1) 1736 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:45:54.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:45:54 gibba015 bash[30343]: audit 2021-03-10T15:45:53.267420+0000 mon.a (mon.0) 1537 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T15:45:54.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:45:54 gibba015 bash[30343]: audit 2021-03-10T15:45:53.268569+0000 mon.a (mon.0) 1538 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:45:54.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:45:54 gibba015 bash[30343]: audit 2021-03-10T15:45:53.269460+0000 mon.a (mon.0) 1539 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:45:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:45:54 gibba045 bash[25517]: audit 2021-03-10T15:45:53.262685+0000 mon.c (mon.1) 1731 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:45:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:45:54 gibba045 bash[25517]: audit 2021-03-10T15:45:53.263388+0000 mon.c (mon.1) 1732 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:45:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:45:54 gibba045 bash[25517]: audit 2021-03-10T15:45:53.263837+0000 mon.a (mon.0) 1534 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:45:54.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:45:54 gibba045 bash[25517]: audit 2021-03-10T15:45:53.264271+0000 mon.c (mon.1) 1733 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T15:45:54.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:45:54 gibba045 bash[25517]: audit 2021-03-10T15:45:53.265159+0000 mon.a (mon.0) 1535 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:45:54.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:45:54 gibba045 bash[25517]: audit 2021-03-10T15:45:53.265224+0000 mon.c (mon.1) 1734 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T15:45:54.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:45:54 gibba045 bash[25517]: audit 2021-03-10T15:45:53.266046+0000 mon.c (mon.1) 1735 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:45:54.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:45:54 gibba045 bash[25517]: audit 2021-03-10T15:45:53.266212+0000 mon.a (mon.0) 1536 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T15:45:54.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:45:54 gibba045 bash[25517]: audit 2021-03-10T15:45:53.266753+0000 mon.c (mon.1) 1736 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:45:54.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:45:54 gibba045 bash[25517]: audit 2021-03-10T15:45:53.267420+0000 mon.a (mon.0) 1537 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T15:45:54.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:45:54 gibba045 bash[25517]: audit 2021-03-10T15:45:53.268569+0000 mon.a (mon.0) 1538 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:45:54.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:45:54 gibba045 bash[25517]: audit 2021-03-10T15:45:53.269460+0000 mon.a (mon.0) 1539 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:45:55.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:45:55 gibba015 bash[29377]: audit 2021-03-10T15:45:53.893995+0000 mgr.gibba045.orlgmj (mgr.34412) 6195 : audit [DBG] from='client.48210 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:45:55.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:45:55 gibba015 bash[29377]: cluster 2021-03-10T15:45:54.041830+0000 mgr.gibba045.orlgmj (mgr.34412) 6196 : cluster [DBG] pgmap v3523: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:55.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:45:55 gibba015 bash[29377]: audit 2021-03-10T15:45:54.121061+0000 mgr.gibba045.orlgmj (mgr.34412) 6197 : audit [DBG] from='client.48216 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:45:55.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:45:55 gibba015 bash[29377]: audit 2021-03-10T15:45:54.374028+0000 mon.a (mon.0) 1540 : audit [DBG] from='client.? 172.21.2.115:0/1275577997' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:45:55.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:45:55 gibba015 bash[30343]: audit 2021-03-10T15:45:53.893995+0000 mgr.gibba045.orlgmj (mgr.34412) 6195 : audit [DBG] from='client.48210 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:45:55.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:45:55 gibba015 bash[30343]: cluster 2021-03-10T15:45:54.041830+0000 mgr.gibba045.orlgmj (mgr.34412) 6196 : cluster [DBG] pgmap v3523: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:55.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:45:55 gibba015 bash[30343]: audit 2021-03-10T15:45:54.121061+0000 mgr.gibba045.orlgmj (mgr.34412) 6197 : audit [DBG] from='client.48216 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:45:55.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:45:55 gibba015 bash[30343]: audit 2021-03-10T15:45:54.374028+0000 mon.a (mon.0) 1540 : audit [DBG] from='client.? 172.21.2.115:0/1275577997' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:45:55.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:45:55 gibba045 bash[25517]: audit 2021-03-10T15:45:53.893995+0000 mgr.gibba045.orlgmj (mgr.34412) 6195 : audit [DBG] from='client.48210 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:45:55.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:45:55 gibba045 bash[25517]: cluster 2021-03-10T15:45:54.041830+0000 mgr.gibba045.orlgmj (mgr.34412) 6196 : cluster [DBG] pgmap v3523: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:55.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:45:55 gibba045 bash[25517]: audit 2021-03-10T15:45:54.121061+0000 mgr.gibba045.orlgmj (mgr.34412) 6197 : audit [DBG] from='client.48216 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:45:55.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:45:55 gibba045 bash[25517]: audit 2021-03-10T15:45:54.374028+0000 mon.a (mon.0) 1540 : audit [DBG] from='client.? 172.21.2.115:0/1275577997' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:45:57.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:45:57 gibba015 bash[29377]: cluster 2021-03-10T15:45:56.043568+0000 mgr.gibba045.orlgmj (mgr.34412) 6198 : cluster [DBG] pgmap v3524: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:57.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:45:57 gibba015 bash[30343]: cluster 2021-03-10T15:45:56.043568+0000 mgr.gibba045.orlgmj (mgr.34412) 6198 : cluster [DBG] pgmap v3524: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:57.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:45:57 gibba045 bash[25517]: cluster 2021-03-10T15:45:56.043568+0000 mgr.gibba045.orlgmj (mgr.34412) 6198 : cluster [DBG] pgmap v3524: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:58.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:45:58 gibba015 bash[29377]: cephadm 2021-03-10T15:45:56.501866+0000 mgr.gibba045.orlgmj (mgr.34412) 6199 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:45:58.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:45:58 gibba015 bash[30343]: cephadm 2021-03-10T15:45:56.501866+0000 mgr.gibba045.orlgmj (mgr.34412) 6199 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:45:58.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:45:58 gibba045 bash[25517]: cephadm 2021-03-10T15:45:56.501866+0000 mgr.gibba045.orlgmj (mgr.34412) 6199 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:45:59.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:45:59 gibba015 bash[29377]: cluster 2021-03-10T15:45:58.045242+0000 mgr.gibba045.orlgmj (mgr.34412) 6200 : cluster [DBG] pgmap v3525: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:59.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:45:59 gibba015 bash[30343]: cluster 2021-03-10T15:45:58.045242+0000 mgr.gibba045.orlgmj (mgr.34412) 6200 : cluster [DBG] pgmap v3525: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:59.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:45:59 gibba045 bash[25517]: cluster 2021-03-10T15:45:58.045242+0000 mgr.gibba045.orlgmj (mgr.34412) 6200 : cluster [DBG] pgmap v3525: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:01.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:00 gibba015 bash[29377]: cluster 2021-03-10T15:46:00.046023+0000 mgr.gibba045.orlgmj (mgr.34412) 6201 : cluster [DBG] pgmap v3526: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:01.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:00 gibba015 bash[30343]: cluster 2021-03-10T15:46:00.046023+0000 mgr.gibba045.orlgmj (mgr.34412) 6201 : cluster [DBG] pgmap v3526: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:01.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:00 gibba045 bash[25517]: cluster 2021-03-10T15:46:00.046023+0000 mgr.gibba045.orlgmj (mgr.34412) 6201 : cluster [DBG] pgmap v3526: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:03.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:03 gibba015 bash[29377]: cluster 2021-03-10T15:46:02.047411+0000 mgr.gibba045.orlgmj (mgr.34412) 6202 : cluster [DBG] pgmap v3527: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:03.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:03 gibba015 bash[30343]: cluster 2021-03-10T15:46:02.047411+0000 mgr.gibba045.orlgmj (mgr.34412) 6202 : cluster [DBG] pgmap v3527: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:03.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:03 gibba045 bash[25517]: cluster 2021-03-10T15:46:02.047411+0000 mgr.gibba045.orlgmj (mgr.34412) 6202 : cluster [DBG] pgmap v3527: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:05.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:05 gibba015 bash[29377]: cluster 2021-03-10T15:46:04.048672+0000 mgr.gibba045.orlgmj (mgr.34412) 6203 : cluster [DBG] pgmap v3528: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:05.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:05 gibba015 bash[30343]: cluster 2021-03-10T15:46:04.048672+0000 mgr.gibba045.orlgmj (mgr.34412) 6203 : cluster [DBG] pgmap v3528: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:05.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:05 gibba045 bash[25517]: cluster 2021-03-10T15:46:04.048672+0000 mgr.gibba045.orlgmj (mgr.34412) 6203 : cluster [DBG] pgmap v3528: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:07.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:07 gibba015 bash[29377]: cluster 2021-03-10T15:46:06.050370+0000 mgr.gibba045.orlgmj (mgr.34412) 6204 : cluster [DBG] pgmap v3529: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:07.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:07 gibba015 bash[30343]: cluster 2021-03-10T15:46:06.050370+0000 mgr.gibba045.orlgmj (mgr.34412) 6204 : cluster [DBG] pgmap v3529: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:07.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:07 gibba045 bash[25517]: cluster 2021-03-10T15:46:06.050370+0000 mgr.gibba045.orlgmj (mgr.34412) 6204 : cluster [DBG] pgmap v3529: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:09.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:09 gibba015 bash[29377]: cluster 2021-03-10T15:46:08.051888+0000 mgr.gibba045.orlgmj (mgr.34412) 6205 : cluster [DBG] pgmap v3530: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:09.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:09 gibba015 bash[30343]: cluster 2021-03-10T15:46:08.051888+0000 mgr.gibba045.orlgmj (mgr.34412) 6205 : cluster [DBG] pgmap v3530: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:09.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:09 gibba045 bash[25517]: cluster 2021-03-10T15:46:08.051888+0000 mgr.gibba045.orlgmj (mgr.34412) 6205 : cluster [DBG] pgmap v3530: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:11.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:10 gibba015 bash[29377]: cluster 2021-03-10T15:46:10.052884+0000 mgr.gibba045.orlgmj (mgr.34412) 6206 : cluster [DBG] pgmap v3531: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:11.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:10 gibba015 bash[30343]: cluster 2021-03-10T15:46:10.052884+0000 mgr.gibba045.orlgmj (mgr.34412) 6206 : cluster [DBG] pgmap v3531: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:11.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:10 gibba045 bash[25517]: cluster 2021-03-10T15:46:10.052884+0000 mgr.gibba045.orlgmj (mgr.34412) 6206 : cluster [DBG] pgmap v3531: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:13.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:13 gibba015 bash[29377]: cephadm 2021-03-10T15:46:11.517886+0000 mgr.gibba045.orlgmj (mgr.34412) 6207 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:46:13.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:13 gibba015 bash[29377]: cluster 2021-03-10T15:46:12.054549+0000 mgr.gibba045.orlgmj (mgr.34412) 6208 : cluster [DBG] pgmap v3532: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:13.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:13 gibba015 bash[30343]: cephadm 2021-03-10T15:46:11.517886+0000 mgr.gibba045.orlgmj (mgr.34412) 6207 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:46:13.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:13 gibba015 bash[30343]: cluster 2021-03-10T15:46:12.054549+0000 mgr.gibba045.orlgmj (mgr.34412) 6208 : cluster [DBG] pgmap v3532: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:13.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:13 gibba045 bash[25517]: cephadm 2021-03-10T15:46:11.517886+0000 mgr.gibba045.orlgmj (mgr.34412) 6207 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:46:13.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:13 gibba045 bash[25517]: cluster 2021-03-10T15:46:12.054549+0000 mgr.gibba045.orlgmj (mgr.34412) 6208 : cluster [DBG] pgmap v3532: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:15.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:15 gibba015 bash[29377]: cluster 2021-03-10T15:46:14.055788+0000 mgr.gibba045.orlgmj (mgr.34412) 6209 : cluster [DBG] pgmap v3533: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:15.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:15 gibba015 bash[30343]: cluster 2021-03-10T15:46:14.055788+0000 mgr.gibba045.orlgmj (mgr.34412) 6209 : cluster [DBG] pgmap v3533: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:15.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:15 gibba045 bash[25517]: cluster 2021-03-10T15:46:14.055788+0000 mgr.gibba045.orlgmj (mgr.34412) 6209 : cluster [DBG] pgmap v3533: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:17.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:17 gibba015 bash[29377]: cluster 2021-03-10T15:46:16.057541+0000 mgr.gibba045.orlgmj (mgr.34412) 6210 : cluster [DBG] pgmap v3534: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:17.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:17 gibba015 bash[30343]: cluster 2021-03-10T15:46:16.057541+0000 mgr.gibba045.orlgmj (mgr.34412) 6210 : cluster [DBG] pgmap v3534: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:17.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:17 gibba045 bash[25517]: cluster 2021-03-10T15:46:16.057541+0000 mgr.gibba045.orlgmj (mgr.34412) 6210 : cluster [DBG] pgmap v3534: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:19.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:19 gibba015 bash[29377]: cluster 2021-03-10T15:46:18.059223+0000 mgr.gibba045.orlgmj (mgr.34412) 6211 : cluster [DBG] pgmap v3535: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:19.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:19 gibba015 bash[30343]: cluster 2021-03-10T15:46:18.059223+0000 mgr.gibba045.orlgmj (mgr.34412) 6211 : cluster [DBG] pgmap v3535: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:19.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:19 gibba045 bash[25517]: cluster 2021-03-10T15:46:18.059223+0000 mgr.gibba045.orlgmj (mgr.34412) 6211 : cluster [DBG] pgmap v3535: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:21.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:20 gibba015 bash[29377]: cluster 2021-03-10T15:46:20.060235+0000 mgr.gibba045.orlgmj (mgr.34412) 6212 : cluster [DBG] pgmap v3536: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:21.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:20 gibba015 bash[30343]: cluster 2021-03-10T15:46:20.060235+0000 mgr.gibba045.orlgmj (mgr.34412) 6212 : cluster [DBG] pgmap v3536: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:21.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:20 gibba045 bash[25517]: cluster 2021-03-10T15:46:20.060235+0000 mgr.gibba045.orlgmj (mgr.34412) 6212 : cluster [DBG] pgmap v3536: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:23.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:23 gibba015 bash[29377]: cluster 2021-03-10T15:46:22.061741+0000 mgr.gibba045.orlgmj (mgr.34412) 6213 : cluster [DBG] pgmap v3537: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:23.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:23 gibba015 bash[30343]: cluster 2021-03-10T15:46:22.061741+0000 mgr.gibba045.orlgmj (mgr.34412) 6213 : cluster [DBG] pgmap v3537: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:23.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:23 gibba045 bash[25517]: cluster 2021-03-10T15:46:22.061741+0000 mgr.gibba045.orlgmj (mgr.34412) 6213 : cluster [DBG] pgmap v3537: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:24.623 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:46:24.853 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:46:24.854 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (117m) 58s ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:46:24.854 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 10m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:46:24.854 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (117m) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:46:24.854 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (117m) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:46:24.855 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (116m) 58s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:46:24.855 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (116m) 58s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:46:24.855 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (116m) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:46:24.855 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (116m) 58s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:46:24.856 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 58s ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:46:24.856 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 10m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:46:24.856 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (115m) 58s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:46:24.856 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (115m) 58s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:46:24.856 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (114m) 58s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:46:24.857 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (114m) 58s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:46:24.857 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (113m) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:46:24.857 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (113m) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:46:24.857 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (112m) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:46:24.858 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (112m) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:46:24.858 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 10m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:46:24.858 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 10m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T15:46:25.104 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:46:25.105 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:46:25.105 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:46:25.105 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:46:25.106 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:46:25.106 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:46:25.106 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:46:25.106 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:46:25.106 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:46:25.107 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:46:25.107 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:46:25.107 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:46:25.107 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:46:25.108 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:46:25.108 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:46:25.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:25 gibba015 bash[29377]: cluster 2021-03-10T15:46:24.062913+0000 mgr.gibba045.orlgmj (mgr.34412) 6214 : cluster [DBG] pgmap v3538: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:25.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:25 gibba015 bash[29377]: audit 2021-03-10T15:46:25.101212+0000 mon.c (mon.1) 1737 : audit [DBG] from='client.? 172.21.2.115:0/1510788274' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:46:25.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:25 gibba015 bash[30343]: cluster 2021-03-10T15:46:24.062913+0000 mgr.gibba045.orlgmj (mgr.34412) 6214 : cluster [DBG] pgmap v3538: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:25.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:25 gibba015 bash[30343]: audit 2021-03-10T15:46:25.101212+0000 mon.c (mon.1) 1737 : audit [DBG] from='client.? 172.21.2.115:0/1510788274' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:46:25.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:25 gibba045 bash[25517]: cluster 2021-03-10T15:46:24.062913+0000 mgr.gibba045.orlgmj (mgr.34412) 6214 : cluster [DBG] pgmap v3538: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:25.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:25 gibba045 bash[25517]: audit 2021-03-10T15:46:25.101212+0000 mon.c (mon.1) 1737 : audit [DBG] from='client.? 172.21.2.115:0/1510788274' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:46:26.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:26 gibba015 bash[29377]: audit 2021-03-10T15:46:24.614684+0000 mgr.gibba045.orlgmj (mgr.34412) 6215 : audit [DBG] from='client.58216 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:46:26.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:26 gibba015 bash[29377]: audit 2021-03-10T15:46:24.844788+0000 mgr.gibba045.orlgmj (mgr.34412) 6216 : audit [DBG] from='client.48234 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:46:26.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:26 gibba015 bash[30343]: audit 2021-03-10T15:46:24.614684+0000 mgr.gibba045.orlgmj (mgr.34412) 6215 : audit [DBG] from='client.58216 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:46:26.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:26 gibba015 bash[30343]: audit 2021-03-10T15:46:24.844788+0000 mgr.gibba045.orlgmj (mgr.34412) 6216 : audit [DBG] from='client.48234 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:46:26.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:26 gibba045 bash[25517]: audit 2021-03-10T15:46:24.614684+0000 mgr.gibba045.orlgmj (mgr.34412) 6215 : audit [DBG] from='client.58216 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:46:26.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:26 gibba045 bash[25517]: audit 2021-03-10T15:46:24.844788+0000 mgr.gibba045.orlgmj (mgr.34412) 6216 : audit [DBG] from='client.48234 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:46:27.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:27 gibba015 bash[29377]: cluster 2021-03-10T15:46:26.064684+0000 mgr.gibba045.orlgmj (mgr.34412) 6217 : cluster [DBG] pgmap v3539: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:27.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:27 gibba015 bash[29377]: audit 2021-03-10T15:46:26.531471+0000 mon.c (mon.1) 1738 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:46:27.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:27 gibba015 bash[29377]: audit 2021-03-10T15:46:26.539042+0000 mon.c (mon.1) 1739 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:46:27.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:27 gibba015 bash[30343]: cluster 2021-03-10T15:46:26.064684+0000 mgr.gibba045.orlgmj (mgr.34412) 6217 : cluster [DBG] pgmap v3539: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:27.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:27 gibba015 bash[30343]: audit 2021-03-10T15:46:26.531471+0000 mon.c (mon.1) 1738 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:46:27.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:27 gibba015 bash[30343]: audit 2021-03-10T15:46:26.539042+0000 mon.c (mon.1) 1739 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:46:27.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:27 gibba045 bash[25517]: cluster 2021-03-10T15:46:26.064684+0000 mgr.gibba045.orlgmj (mgr.34412) 6217 : cluster [DBG] pgmap v3539: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:27.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:27 gibba045 bash[25517]: audit 2021-03-10T15:46:26.531471+0000 mon.c (mon.1) 1738 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:46:27.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:27 gibba045 bash[25517]: audit 2021-03-10T15:46:26.539042+0000 mon.c (mon.1) 1739 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:46:28.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:28 gibba015 bash[29377]: cephadm 2021-03-10T15:46:26.540425+0000 mgr.gibba045.orlgmj (mgr.34412) 6218 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:46:28.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:28 gibba015 bash[30343]: cephadm 2021-03-10T15:46:26.540425+0000 mgr.gibba045.orlgmj (mgr.34412) 6218 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:46:28.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:28 gibba045 bash[25517]: cephadm 2021-03-10T15:46:26.540425+0000 mgr.gibba045.orlgmj (mgr.34412) 6218 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:46:29.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:29 gibba015 bash[29377]: cluster 2021-03-10T15:46:28.066045+0000 mgr.gibba045.orlgmj (mgr.34412) 6219 : cluster [DBG] pgmap v3540: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:29.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:29 gibba015 bash[30343]: cluster 2021-03-10T15:46:28.066045+0000 mgr.gibba045.orlgmj (mgr.34412) 6219 : cluster [DBG] pgmap v3540: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:29.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:29 gibba045 bash[25517]: cluster 2021-03-10T15:46:28.066045+0000 mgr.gibba045.orlgmj (mgr.34412) 6219 : cluster [DBG] pgmap v3540: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:31.534 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:31 gibba045 bash[25517]: cluster 2021-03-10T15:46:30.066579+0000 mgr.gibba045.orlgmj (mgr.34412) 6220 : cluster [DBG] pgmap v3541: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:31.535 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:31 gibba045 bash[25517]: audit 2021-03-10T15:46:30.226615+0000 mon.a (mon.0) 1541 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:46:31.535 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:31 gibba045 bash[25517]: audit 2021-03-10T15:46:30.228101+0000 mon.c (mon.1) 1740 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T15:46:31.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:31 gibba015 bash[29377]: cluster 2021-03-10T15:46:30.066579+0000 mgr.gibba045.orlgmj (mgr.34412) 6220 : cluster [DBG] pgmap v3541: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:31.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:31 gibba015 bash[29377]: audit 2021-03-10T15:46:30.226615+0000 mon.a (mon.0) 1541 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:46:31.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:31 gibba015 bash[29377]: audit 2021-03-10T15:46:30.228101+0000 mon.c (mon.1) 1740 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T15:46:31.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:31 gibba015 bash[30343]: cluster 2021-03-10T15:46:30.066579+0000 mgr.gibba045.orlgmj (mgr.34412) 6220 : cluster [DBG] pgmap v3541: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:31.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:31 gibba015 bash[30343]: audit 2021-03-10T15:46:30.226615+0000 mon.a (mon.0) 1541 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:46:31.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:31 gibba015 bash[30343]: audit 2021-03-10T15:46:30.228101+0000 mon.c (mon.1) 1740 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T15:46:33.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:33 gibba045 bash[25517]: cluster 2021-03-10T15:46:32.068103+0000 mgr.gibba045.orlgmj (mgr.34412) 6221 : cluster [DBG] pgmap v3542: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:33.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:33 gibba015 bash[29377]: cluster 2021-03-10T15:46:32.068103+0000 mgr.gibba045.orlgmj (mgr.34412) 6221 : cluster [DBG] pgmap v3542: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:33.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:33 gibba015 bash[30343]: cluster 2021-03-10T15:46:32.068103+0000 mgr.gibba045.orlgmj (mgr.34412) 6221 : cluster [DBG] pgmap v3542: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:35.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:35 gibba045 bash[25517]: cluster 2021-03-10T15:46:34.069457+0000 mgr.gibba045.orlgmj (mgr.34412) 6222 : cluster [DBG] pgmap v3543: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:35.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:35 gibba045 bash[25517]: audit 2021-03-10T15:46:35.096407+0000 mon.c (mon.1) 1741 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:46:35.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:35 gibba015 bash[29377]: cluster 2021-03-10T15:46:34.069457+0000 mgr.gibba045.orlgmj (mgr.34412) 6222 : cluster [DBG] pgmap v3543: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:35.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:35 gibba015 bash[29377]: audit 2021-03-10T15:46:35.096407+0000 mon.c (mon.1) 1741 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:46:35.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:35 gibba015 bash[30343]: cluster 2021-03-10T15:46:34.069457+0000 mgr.gibba045.orlgmj (mgr.34412) 6222 : cluster [DBG] pgmap v3543: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:35.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:35 gibba015 bash[30343]: audit 2021-03-10T15:46:35.096407+0000 mon.c (mon.1) 1741 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:46:36.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:36 gibba045 bash[25517]: audit 2021-03-10T15:46:35.260220+0000 mon.a (mon.0) 1542 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:46:36.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:36 gibba045 bash[25517]: cephadm 2021-03-10T15:46:35.264274+0000 mgr.gibba045.orlgmj (mgr.34412) 6223 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:46:36.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:36 gibba045 bash[25517]: audit 2021-03-10T15:46:35.450926+0000 mon.a (mon.0) 1543 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:46:36.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:36 gibba045 bash[25517]: audit 2021-03-10T15:46:35.455001+0000 mon.c (mon.1) 1742 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:46:36.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:36 gibba045 bash[25517]: audit 2021-03-10T15:46:35.456876+0000 mon.c (mon.1) 1743 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:46:36.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:36 gibba045 bash[25517]: audit 2021-03-10T15:46:35.458374+0000 mon.c (mon.1) 1744 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:46:36.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:36 gibba045 bash[25517]: audit 2021-03-10T15:46:35.459691+0000 mon.c (mon.1) 1745 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:46:36.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:36 gibba045 bash[25517]: audit 2021-03-10T15:46:35.465493+0000 mon.c (mon.1) 1746 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:46:36.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:36 gibba045 bash[25517]: audit 2021-03-10T15:46:35.470680+0000 mon.c (mon.1) 1747 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:46:36.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:36 gibba015 bash[29377]: audit 2021-03-10T15:46:35.260220+0000 mon.a (mon.0) 1542 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:46:36.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:36 gibba015 bash[29377]: cephadm 2021-03-10T15:46:35.264274+0000 mgr.gibba045.orlgmj (mgr.34412) 6223 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:46:36.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:36 gibba015 bash[29377]: audit 2021-03-10T15:46:35.450926+0000 mon.a (mon.0) 1543 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:46:36.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:36 gibba015 bash[29377]: audit 2021-03-10T15:46:35.455001+0000 mon.c (mon.1) 1742 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:46:36.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:36 gibba015 bash[29377]: audit 2021-03-10T15:46:35.456876+0000 mon.c (mon.1) 1743 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:46:36.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:36 gibba015 bash[29377]: audit 2021-03-10T15:46:35.458374+0000 mon.c (mon.1) 1744 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:46:36.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:36 gibba015 bash[29377]: audit 2021-03-10T15:46:35.459691+0000 mon.c (mon.1) 1745 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:46:36.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:36 gibba015 bash[29377]: audit 2021-03-10T15:46:35.465493+0000 mon.c (mon.1) 1746 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:46:36.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:36 gibba015 bash[29377]: audit 2021-03-10T15:46:35.470680+0000 mon.c (mon.1) 1747 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:46:36.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:36 gibba015 bash[30343]: audit 2021-03-10T15:46:35.260220+0000 mon.a (mon.0) 1542 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:46:36.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:36 gibba015 bash[30343]: cephadm 2021-03-10T15:46:35.264274+0000 mgr.gibba045.orlgmj (mgr.34412) 6223 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:46:36.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:36 gibba015 bash[30343]: audit 2021-03-10T15:46:35.450926+0000 mon.a (mon.0) 1543 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:46:36.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:36 gibba015 bash[30343]: audit 2021-03-10T15:46:35.455001+0000 mon.c (mon.1) 1742 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:46:36.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:36 gibba015 bash[30343]: audit 2021-03-10T15:46:35.456876+0000 mon.c (mon.1) 1743 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:46:36.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:36 gibba015 bash[30343]: audit 2021-03-10T15:46:35.458374+0000 mon.c (mon.1) 1744 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:46:36.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:36 gibba015 bash[30343]: audit 2021-03-10T15:46:35.459691+0000 mon.c (mon.1) 1745 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:46:36.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:36 gibba015 bash[30343]: audit 2021-03-10T15:46:35.465493+0000 mon.c (mon.1) 1746 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:46:36.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:36 gibba015 bash[30343]: audit 2021-03-10T15:46:35.470680+0000 mon.c (mon.1) 1747 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:46:37.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:37 gibba045 bash[25517]: cephadm 2021-03-10T15:46:35.457029+0000 mgr.gibba045.orlgmj (mgr.34412) 6224 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:46:37.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:37 gibba045 bash[25517]: cephadm 2021-03-10T15:46:35.459503+0000 mgr.gibba045.orlgmj (mgr.34412) 6225 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:46:37.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:37 gibba045 bash[25517]: cephadm 2021-03-10T15:46:35.461056+0000 mgr.gibba045.orlgmj (mgr.34412) 6226 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:46:37.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:37 gibba045 bash[25517]: cephadm 2021-03-10T15:46:35.461099+0000 mgr.gibba045.orlgmj (mgr.34412) 6227 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:46:37.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:37 gibba045 bash[25517]: cephadm 2021-03-10T15:46:35.462344+0000 mgr.gibba045.orlgmj (mgr.34412) 6228 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:46:37.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:37 gibba045 bash[25517]: cephadm 2021-03-10T15:46:35.462381+0000 mgr.gibba045.orlgmj (mgr.34412) 6229 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:46:37.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:37 gibba045 bash[25517]: cephadm 2021-03-10T15:46:35.463588+0000 mgr.gibba045.orlgmj (mgr.34412) 6230 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:46:37.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:37 gibba045 bash[25517]: cephadm 2021-03-10T15:46:35.466452+0000 mgr.gibba045.orlgmj (mgr.34412) 6231 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:46:37.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:37 gibba045 bash[25517]: cephadm 2021-03-10T15:46:35.466844+0000 mgr.gibba045.orlgmj (mgr.34412) 6232 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:46:37.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:37 gibba045 bash[25517]: cephadm 2021-03-10T15:46:35.470722+0000 mgr.gibba045.orlgmj (mgr.34412) 6233 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:46:37.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:37 gibba045 bash[25517]: cephadm 2021-03-10T15:46:35.473003+0000 mgr.gibba045.orlgmj (mgr.34412) 6234 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:46:37.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:37 gibba045 bash[25517]: cephadm 2021-03-10T15:46:35.475909+0000 mgr.gibba045.orlgmj (mgr.34412) 6235 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:46:37.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:37 gibba045 bash[25517]: cephadm 2021-03-10T15:46:35.476510+0000 mgr.gibba045.orlgmj (mgr.34412) 6236 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:46:37.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:37 gibba045 bash[25517]: cephadm 2021-03-10T15:46:35.477105+0000 mgr.gibba045.orlgmj (mgr.34412) 6237 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:46:37.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:37 gibba045 bash[25517]: cluster 2021-03-10T15:46:36.071197+0000 mgr.gibba045.orlgmj (mgr.34412) 6238 : cluster [DBG] pgmap v3544: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:37.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:37 gibba015 bash[29377]: cephadm 2021-03-10T15:46:35.457029+0000 mgr.gibba045.orlgmj (mgr.34412) 6224 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:46:37.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:37 gibba015 bash[29377]: cephadm 2021-03-10T15:46:35.459503+0000 mgr.gibba045.orlgmj (mgr.34412) 6225 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:46:37.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:37 gibba015 bash[29377]: cephadm 2021-03-10T15:46:35.461056+0000 mgr.gibba045.orlgmj (mgr.34412) 6226 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:46:37.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:37 gibba015 bash[29377]: cephadm 2021-03-10T15:46:35.461099+0000 mgr.gibba045.orlgmj (mgr.34412) 6227 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:46:37.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:37 gibba015 bash[29377]: cephadm 2021-03-10T15:46:35.462344+0000 mgr.gibba045.orlgmj (mgr.34412) 6228 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:46:37.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:37 gibba015 bash[29377]: cephadm 2021-03-10T15:46:35.462381+0000 mgr.gibba045.orlgmj (mgr.34412) 6229 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:46:37.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:37 gibba015 bash[29377]: cephadm 2021-03-10T15:46:35.463588+0000 mgr.gibba045.orlgmj (mgr.34412) 6230 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:46:37.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:37 gibba015 bash[29377]: cephadm 2021-03-10T15:46:35.466452+0000 mgr.gibba045.orlgmj (mgr.34412) 6231 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:46:37.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:37 gibba015 bash[29377]: cephadm 2021-03-10T15:46:35.466844+0000 mgr.gibba045.orlgmj (mgr.34412) 6232 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:46:37.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:37 gibba015 bash[29377]: cephadm 2021-03-10T15:46:35.470722+0000 mgr.gibba045.orlgmj (mgr.34412) 6233 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:46:37.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:37 gibba015 bash[29377]: cephadm 2021-03-10T15:46:35.473003+0000 mgr.gibba045.orlgmj (mgr.34412) 6234 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:46:37.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:37 gibba015 bash[29377]: cephadm 2021-03-10T15:46:35.475909+0000 mgr.gibba045.orlgmj (mgr.34412) 6235 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:46:37.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:37 gibba015 bash[29377]: cephadm 2021-03-10T15:46:35.476510+0000 mgr.gibba045.orlgmj (mgr.34412) 6236 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:46:37.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:37 gibba015 bash[29377]: cephadm 2021-03-10T15:46:35.477105+0000 mgr.gibba045.orlgmj (mgr.34412) 6237 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:46:37.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:37 gibba015 bash[29377]: cluster 2021-03-10T15:46:36.071197+0000 mgr.gibba045.orlgmj (mgr.34412) 6238 : cluster [DBG] pgmap v3544: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:37.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:37 gibba015 bash[30343]: cephadm 2021-03-10T15:46:35.457029+0000 mgr.gibba045.orlgmj (mgr.34412) 6224 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:46:37.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:37 gibba015 bash[30343]: cephadm 2021-03-10T15:46:35.459503+0000 mgr.gibba045.orlgmj (mgr.34412) 6225 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:46:37.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:37 gibba015 bash[30343]: cephadm 2021-03-10T15:46:35.461056+0000 mgr.gibba045.orlgmj (mgr.34412) 6226 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:46:37.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:37 gibba015 bash[30343]: cephadm 2021-03-10T15:46:35.461099+0000 mgr.gibba045.orlgmj (mgr.34412) 6227 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:46:37.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:37 gibba015 bash[30343]: cephadm 2021-03-10T15:46:35.462344+0000 mgr.gibba045.orlgmj (mgr.34412) 6228 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:46:37.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:37 gibba015 bash[30343]: cephadm 2021-03-10T15:46:35.462381+0000 mgr.gibba045.orlgmj (mgr.34412) 6229 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:46:37.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:37 gibba015 bash[30343]: cephadm 2021-03-10T15:46:35.463588+0000 mgr.gibba045.orlgmj (mgr.34412) 6230 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:46:37.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:37 gibba015 bash[30343]: cephadm 2021-03-10T15:46:35.466452+0000 mgr.gibba045.orlgmj (mgr.34412) 6231 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:46:37.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:37 gibba015 bash[30343]: cephadm 2021-03-10T15:46:35.466844+0000 mgr.gibba045.orlgmj (mgr.34412) 6232 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:46:37.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:37 gibba015 bash[30343]: cephadm 2021-03-10T15:46:35.470722+0000 mgr.gibba045.orlgmj (mgr.34412) 6233 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:46:37.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:37 gibba015 bash[30343]: cephadm 2021-03-10T15:46:35.473003+0000 mgr.gibba045.orlgmj (mgr.34412) 6234 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:46:37.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:37 gibba015 bash[30343]: cephadm 2021-03-10T15:46:35.475909+0000 mgr.gibba045.orlgmj (mgr.34412) 6235 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:46:37.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:37 gibba015 bash[30343]: cephadm 2021-03-10T15:46:35.476510+0000 mgr.gibba045.orlgmj (mgr.34412) 6236 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:46:37.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:37 gibba015 bash[30343]: cephadm 2021-03-10T15:46:35.477105+0000 mgr.gibba045.orlgmj (mgr.34412) 6237 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:46:37.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:37 gibba015 bash[30343]: cluster 2021-03-10T15:46:36.071197+0000 mgr.gibba045.orlgmj (mgr.34412) 6238 : cluster [DBG] pgmap v3544: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:39.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:39 gibba045 bash[25517]: cluster 2021-03-10T15:46:38.072914+0000 mgr.gibba045.orlgmj (mgr.34412) 6239 : cluster [DBG] pgmap v3545: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:39.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:39 gibba015 bash[29377]: cluster 2021-03-10T15:46:38.072914+0000 mgr.gibba045.orlgmj (mgr.34412) 6239 : cluster [DBG] pgmap v3545: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:39.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:39 gibba015 bash[30343]: cluster 2021-03-10T15:46:38.072914+0000 mgr.gibba045.orlgmj (mgr.34412) 6239 : cluster [DBG] pgmap v3545: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:41.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:40 gibba015 bash[29377]: cluster 2021-03-10T15:46:40.074023+0000 mgr.gibba045.orlgmj (mgr.34412) 6240 : cluster [DBG] pgmap v3546: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:41.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:40 gibba015 bash[30343]: cluster 2021-03-10T15:46:40.074023+0000 mgr.gibba045.orlgmj (mgr.34412) 6240 : cluster [DBG] pgmap v3546: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:41.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:40 gibba045 bash[25517]: cluster 2021-03-10T15:46:40.074023+0000 mgr.gibba045.orlgmj (mgr.34412) 6240 : cluster [DBG] pgmap v3546: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:43.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:43 gibba015 bash[29377]: cluster 2021-03-10T15:46:42.075424+0000 mgr.gibba045.orlgmj (mgr.34412) 6241 : cluster [DBG] pgmap v3547: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:43.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:43 gibba015 bash[30343]: cluster 2021-03-10T15:46:42.075424+0000 mgr.gibba045.orlgmj (mgr.34412) 6241 : cluster [DBG] pgmap v3547: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:43.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:43 gibba045 bash[25517]: cluster 2021-03-10T15:46:42.075424+0000 mgr.gibba045.orlgmj (mgr.34412) 6241 : cluster [DBG] pgmap v3547: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:45.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:45 gibba015 bash[29377]: cluster 2021-03-10T15:46:44.076634+0000 mgr.gibba045.orlgmj (mgr.34412) 6242 : cluster [DBG] pgmap v3548: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:45.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:45 gibba015 bash[30343]: cluster 2021-03-10T15:46:44.076634+0000 mgr.gibba045.orlgmj (mgr.34412) 6242 : cluster [DBG] pgmap v3548: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:45.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:45 gibba045 bash[25517]: cluster 2021-03-10T15:46:44.076634+0000 mgr.gibba045.orlgmj (mgr.34412) 6242 : cluster [DBG] pgmap v3548: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:47.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:47 gibba015 bash[29377]: cluster 2021-03-10T15:46:46.078343+0000 mgr.gibba045.orlgmj (mgr.34412) 6243 : cluster [DBG] pgmap v3549: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:47.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:47 gibba015 bash[30343]: cluster 2021-03-10T15:46:46.078343+0000 mgr.gibba045.orlgmj (mgr.34412) 6243 : cluster [DBG] pgmap v3549: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:47.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:47 gibba045 bash[25517]: cluster 2021-03-10T15:46:46.078343+0000 mgr.gibba045.orlgmj (mgr.34412) 6243 : cluster [DBG] pgmap v3549: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:49.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:49 gibba015 bash[29377]: cluster 2021-03-10T15:46:48.079952+0000 mgr.gibba045.orlgmj (mgr.34412) 6244 : cluster [DBG] pgmap v3550: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:49.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:49 gibba015 bash[30343]: cluster 2021-03-10T15:46:48.079952+0000 mgr.gibba045.orlgmj (mgr.34412) 6244 : cluster [DBG] pgmap v3550: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:49.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:49 gibba045 bash[25517]: cluster 2021-03-10T15:46:48.079952+0000 mgr.gibba045.orlgmj (mgr.34412) 6244 : cluster [DBG] pgmap v3550: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:51.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:50 gibba015 bash[29377]: cluster 2021-03-10T15:46:50.080818+0000 mgr.gibba045.orlgmj (mgr.34412) 6245 : cluster [DBG] pgmap v3551: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:51.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:50 gibba015 bash[30343]: cluster 2021-03-10T15:46:50.080818+0000 mgr.gibba045.orlgmj (mgr.34412) 6245 : cluster [DBG] pgmap v3551: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:51.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:50 gibba045 bash[25517]: cluster 2021-03-10T15:46:50.080818+0000 mgr.gibba045.orlgmj (mgr.34412) 6245 : cluster [DBG] pgmap v3551: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:52.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:51 gibba015 bash[29377]: cephadm 2021-03-10T15:46:50.481634+0000 mgr.gibba045.orlgmj (mgr.34412) 6246 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:46:52.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:51 gibba015 bash[30343]: cephadm 2021-03-10T15:46:50.481634+0000 mgr.gibba045.orlgmj (mgr.34412) 6246 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:46:52.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:51 gibba045 bash[25517]: cephadm 2021-03-10T15:46:50.481634+0000 mgr.gibba045.orlgmj (mgr.34412) 6246 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:46:53.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:52 gibba015 bash[29377]: cluster 2021-03-10T15:46:52.082440+0000 mgr.gibba045.orlgmj (mgr.34412) 6247 : cluster [DBG] pgmap v3552: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:53.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:52 gibba015 bash[30343]: cluster 2021-03-10T15:46:52.082440+0000 mgr.gibba045.orlgmj (mgr.34412) 6247 : cluster [DBG] pgmap v3552: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:53.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:52 gibba045 bash[25517]: cluster 2021-03-10T15:46:52.082440+0000 mgr.gibba045.orlgmj (mgr.34412) 6247 : cluster [DBG] pgmap v3552: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:54.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:53 gibba015 bash[29377]: audit 2021-03-10T15:46:53.269969+0000 mon.c (mon.1) 1748 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:46:54.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:53 gibba015 bash[29377]: audit 2021-03-10T15:46:53.270716+0000 mon.c (mon.1) 1749 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:46:54.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:53 gibba015 bash[29377]: audit 2021-03-10T15:46:53.271047+0000 mon.a (mon.0) 1544 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:46:54.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:53 gibba015 bash[29377]: audit 2021-03-10T15:46:53.271755+0000 mon.c (mon.1) 1750 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T15:46:54.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:53 gibba015 bash[29377]: audit 2021-03-10T15:46:53.272261+0000 mon.a (mon.0) 1545 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:46:54.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:53 gibba015 bash[29377]: audit 2021-03-10T15:46:53.272905+0000 mon.c (mon.1) 1751 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:46:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:53 gibba015 bash[29377]: audit 2021-03-10T15:46:53.273034+0000 mon.a (mon.0) 1546 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T15:46:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:53 gibba015 bash[29377]: audit 2021-03-10T15:46:53.274109+0000 mon.a (mon.0) 1547 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:46:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:53 gibba015 bash[29377]: audit 2021-03-10T15:46:53.274377+0000 mon.c (mon.1) 1752 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T15:46:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:53 gibba015 bash[29377]: audit 2021-03-10T15:46:53.274793+0000 mon.c (mon.1) 1753 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:46:54.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:53 gibba015 bash[29377]: audit 2021-03-10T15:46:53.274822+0000 mon.a (mon.0) 1548 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T15:46:54.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:53 gibba015 bash[29377]: audit 2021-03-10T15:46:53.275075+0000 mon.a (mon.0) 1549 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:46:54.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:53 gibba015 bash[30343]: audit 2021-03-10T15:46:53.269969+0000 mon.c (mon.1) 1748 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:46:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:53 gibba015 bash[30343]: audit 2021-03-10T15:46:53.270716+0000 mon.c (mon.1) 1749 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:46:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:53 gibba015 bash[30343]: audit 2021-03-10T15:46:53.271047+0000 mon.a (mon.0) 1544 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:46:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:53 gibba015 bash[30343]: audit 2021-03-10T15:46:53.271755+0000 mon.c (mon.1) 1750 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T15:46:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:53 gibba015 bash[30343]: audit 2021-03-10T15:46:53.272261+0000 mon.a (mon.0) 1545 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:46:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:53 gibba015 bash[30343]: audit 2021-03-10T15:46:53.272905+0000 mon.c (mon.1) 1751 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:46:54.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:53 gibba015 bash[30343]: audit 2021-03-10T15:46:53.273034+0000 mon.a (mon.0) 1546 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T15:46:54.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:53 gibba015 bash[30343]: audit 2021-03-10T15:46:53.274109+0000 mon.a (mon.0) 1547 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:46:54.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:53 gibba015 bash[30343]: audit 2021-03-10T15:46:53.274377+0000 mon.c (mon.1) 1752 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T15:46:54.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:53 gibba015 bash[30343]: audit 2021-03-10T15:46:53.274793+0000 mon.c (mon.1) 1753 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:46:54.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:53 gibba015 bash[30343]: audit 2021-03-10T15:46:53.274822+0000 mon.a (mon.0) 1548 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T15:46:54.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:53 gibba015 bash[30343]: audit 2021-03-10T15:46:53.275075+0000 mon.a (mon.0) 1549 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:46:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:53 gibba045 bash[25517]: audit 2021-03-10T15:46:53.269969+0000 mon.c (mon.1) 1748 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:46:54.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:53 gibba045 bash[25517]: audit 2021-03-10T15:46:53.270716+0000 mon.c (mon.1) 1749 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:46:54.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:53 gibba045 bash[25517]: audit 2021-03-10T15:46:53.271047+0000 mon.a (mon.0) 1544 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:46:54.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:53 gibba045 bash[25517]: audit 2021-03-10T15:46:53.271755+0000 mon.c (mon.1) 1750 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T15:46:54.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:53 gibba045 bash[25517]: audit 2021-03-10T15:46:53.272261+0000 mon.a (mon.0) 1545 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:46:54.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:53 gibba045 bash[25517]: audit 2021-03-10T15:46:53.272905+0000 mon.c (mon.1) 1751 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:46:54.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:53 gibba045 bash[25517]: audit 2021-03-10T15:46:53.273034+0000 mon.a (mon.0) 1546 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T15:46:54.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:53 gibba045 bash[25517]: audit 2021-03-10T15:46:53.274109+0000 mon.a (mon.0) 1547 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:46:54.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:53 gibba045 bash[25517]: audit 2021-03-10T15:46:53.274377+0000 mon.c (mon.1) 1752 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T15:46:54.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:53 gibba045 bash[25517]: audit 2021-03-10T15:46:53.274793+0000 mon.c (mon.1) 1753 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:46:54.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:53 gibba045 bash[25517]: audit 2021-03-10T15:46:53.274822+0000 mon.a (mon.0) 1548 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T15:46:54.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:53 gibba045 bash[25517]: audit 2021-03-10T15:46:53.275075+0000 mon.a (mon.0) 1549 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:46:55.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:54 gibba015 bash[29377]: cluster 2021-03-10T15:46:54.083643+0000 mgr.gibba045.orlgmj (mgr.34412) 6248 : cluster [DBG] pgmap v3553: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:55.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:54 gibba015 bash[30343]: cluster 2021-03-10T15:46:54.083643+0000 mgr.gibba045.orlgmj (mgr.34412) 6248 : cluster [DBG] pgmap v3553: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:55.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:54 gibba045 bash[25517]: cluster 2021-03-10T15:46:54.083643+0000 mgr.gibba045.orlgmj (mgr.34412) 6248 : cluster [DBG] pgmap v3553: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:55.347 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:46:55.577 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:46:55.577 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (117m) 89s ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:46:55.578 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 25s ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:46:55.578 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (118m) 25s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:46:55.578 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (118m) 25s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:46:55.578 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (117m) 89s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:46:55.579 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (117m) 89s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:46:55.579 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (116m) 25s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:46:55.579 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (116m) 89s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:46:55.579 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 89s ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:46:55.580 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 25s ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:46:55.580 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (115m) 89s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:46:55.580 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (115m) 89s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:46:55.580 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (115m) 89s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:46:55.581 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (114m) 89s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:46:55.581 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (114m) 25s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:46:55.581 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (113m) 25s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:46:55.581 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (113m) 25s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:46:55.581 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (112m) 25s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:46:55.582 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 25s ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:46:55.582 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 25s ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T15:46:55.827 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:46:55.827 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:46:55.827 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:46:55.828 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:46:55.828 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:46:55.828 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:46:55.828 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:46:55.828 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:46:55.829 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:46:55.829 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:46:55.829 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:46:55.829 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:46:55.830 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:46:55.830 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:46:55.830 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:46:56.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:55 gibba015 bash[29377]: audit 2021-03-10T15:46:55.338231+0000 mgr.gibba045.orlgmj (mgr.34412) 6249 : audit [DBG] from='client.48246 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:46:56.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:55 gibba015 bash[29377]: audit 2021-03-10T15:46:55.823646+0000 mon.c (mon.1) 1754 : audit [DBG] from='client.? 172.21.2.115:0/1460194286' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:46:56.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:55 gibba015 bash[30343]: audit 2021-03-10T15:46:55.338231+0000 mgr.gibba045.orlgmj (mgr.34412) 6249 : audit [DBG] from='client.48246 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:46:56.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:55 gibba015 bash[30343]: audit 2021-03-10T15:46:55.823646+0000 mon.c (mon.1) 1754 : audit [DBG] from='client.? 172.21.2.115:0/1460194286' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:46:56.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:55 gibba045 bash[25517]: audit 2021-03-10T15:46:55.338231+0000 mgr.gibba045.orlgmj (mgr.34412) 6249 : audit [DBG] from='client.48246 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:46:56.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:55 gibba045 bash[25517]: audit 2021-03-10T15:46:55.823646+0000 mon.c (mon.1) 1754 : audit [DBG] from='client.? 172.21.2.115:0/1460194286' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:46:57.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:56 gibba015 bash[29377]: audit 2021-03-10T15:46:55.564683+0000 mgr.gibba045.orlgmj (mgr.34412) 6250 : audit [DBG] from='client.58240 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:46:57.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:56 gibba015 bash[29377]: cluster 2021-03-10T15:46:56.085410+0000 mgr.gibba045.orlgmj (mgr.34412) 6251 : cluster [DBG] pgmap v3554: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:57.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:56 gibba015 bash[30343]: audit 2021-03-10T15:46:55.564683+0000 mgr.gibba045.orlgmj (mgr.34412) 6250 : audit [DBG] from='client.58240 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:46:57.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:56 gibba015 bash[30343]: cluster 2021-03-10T15:46:56.085410+0000 mgr.gibba045.orlgmj (mgr.34412) 6251 : cluster [DBG] pgmap v3554: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:57.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:56 gibba045 bash[25517]: audit 2021-03-10T15:46:55.564683+0000 mgr.gibba045.orlgmj (mgr.34412) 6250 : audit [DBG] from='client.58240 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:46:57.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:56 gibba045 bash[25517]: cluster 2021-03-10T15:46:56.085410+0000 mgr.gibba045.orlgmj (mgr.34412) 6251 : cluster [DBG] pgmap v3554: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:59.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:46:59 gibba015 bash[29377]: cluster 2021-03-10T15:46:58.087096+0000 mgr.gibba045.orlgmj (mgr.34412) 6252 : cluster [DBG] pgmap v3555: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:59.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:46:59 gibba015 bash[30343]: cluster 2021-03-10T15:46:58.087096+0000 mgr.gibba045.orlgmj (mgr.34412) 6252 : cluster [DBG] pgmap v3555: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:59.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:46:59 gibba045 bash[25517]: cluster 2021-03-10T15:46:58.087096+0000 mgr.gibba045.orlgmj (mgr.34412) 6252 : cluster [DBG] pgmap v3555: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:01.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:47:00 gibba015 bash[29377]: cluster 2021-03-10T15:47:00.088772+0000 mgr.gibba045.orlgmj (mgr.34412) 6253 : cluster [DBG] pgmap v3556: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:01.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:47:00 gibba015 bash[30343]: cluster 2021-03-10T15:47:00.088772+0000 mgr.gibba045.orlgmj (mgr.34412) 6253 : cluster [DBG] pgmap v3556: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:01.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:47:00 gibba045 bash[25517]: cluster 2021-03-10T15:47:00.088772+0000 mgr.gibba045.orlgmj (mgr.34412) 6253 : cluster [DBG] pgmap v3556: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:03.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:47:03 gibba015 bash[29377]: cluster 2021-03-10T15:47:02.090539+0000 mgr.gibba045.orlgmj (mgr.34412) 6254 : cluster [DBG] pgmap v3557: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:03.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:47:03 gibba015 bash[30343]: cluster 2021-03-10T15:47:02.090539+0000 mgr.gibba045.orlgmj (mgr.34412) 6254 : cluster [DBG] pgmap v3557: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:03.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:47:03 gibba045 bash[25517]: cluster 2021-03-10T15:47:02.090539+0000 mgr.gibba045.orlgmj (mgr.34412) 6254 : cluster [DBG] pgmap v3557: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:05.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:47:05 gibba015 bash[29377]: cluster 2021-03-10T15:47:04.091712+0000 mgr.gibba045.orlgmj (mgr.34412) 6255 : cluster [DBG] pgmap v3558: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:05.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:47:05 gibba015 bash[30343]: cluster 2021-03-10T15:47:04.091712+0000 mgr.gibba045.orlgmj (mgr.34412) 6255 : cluster [DBG] pgmap v3558: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:05.498 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:47:05 gibba045 bash[25517]: cluster 2021-03-10T15:47:04.091712+0000 mgr.gibba045.orlgmj (mgr.34412) 6255 : cluster [DBG] pgmap v3558: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:07.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:47:07 gibba015 bash[29377]: cephadm 2021-03-10T15:47:05.497711+0000 mgr.gibba045.orlgmj (mgr.34412) 6256 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:47:07.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:47:07 gibba015 bash[29377]: cluster 2021-03-10T15:47:06.093468+0000 mgr.gibba045.orlgmj (mgr.34412) 6257 : cluster [DBG] pgmap v3559: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:07.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:47:07 gibba015 bash[30343]: cephadm 2021-03-10T15:47:05.497711+0000 mgr.gibba045.orlgmj (mgr.34412) 6256 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:47:07.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:47:07 gibba015 bash[30343]: cluster 2021-03-10T15:47:06.093468+0000 mgr.gibba045.orlgmj (mgr.34412) 6257 : cluster [DBG] pgmap v3559: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:07.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:47:07 gibba045 bash[25517]: cephadm 2021-03-10T15:47:05.497711+0000 mgr.gibba045.orlgmj (mgr.34412) 6256 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:47:07.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:47:07 gibba045 bash[25517]: cluster 2021-03-10T15:47:06.093468+0000 mgr.gibba045.orlgmj (mgr.34412) 6257 : cluster [DBG] pgmap v3559: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:09.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:47:09 gibba015 bash[29377]: cluster 2021-03-10T15:47:08.095164+0000 mgr.gibba045.orlgmj (mgr.34412) 6258 : cluster [DBG] pgmap v3560: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:09.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:47:09 gibba015 bash[30343]: cluster 2021-03-10T15:47:08.095164+0000 mgr.gibba045.orlgmj (mgr.34412) 6258 : cluster [DBG] pgmap v3560: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:09.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:47:09 gibba045 bash[25517]: cluster 2021-03-10T15:47:08.095164+0000 mgr.gibba045.orlgmj (mgr.34412) 6258 : cluster [DBG] pgmap v3560: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:11.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:47:10 gibba015 bash[29377]: cluster 2021-03-10T15:47:10.096842+0000 mgr.gibba045.orlgmj (mgr.34412) 6259 : cluster [DBG] pgmap v3561: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:11.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:47:10 gibba015 bash[30343]: cluster 2021-03-10T15:47:10.096842+0000 mgr.gibba045.orlgmj (mgr.34412) 6259 : cluster [DBG] pgmap v3561: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:11.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:47:10 gibba045 bash[25517]: cluster 2021-03-10T15:47:10.096842+0000 mgr.gibba045.orlgmj (mgr.34412) 6259 : cluster [DBG] pgmap v3561: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:13.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:47:13 gibba015 bash[29377]: cluster 2021-03-10T15:47:12.098574+0000 mgr.gibba045.orlgmj (mgr.34412) 6260 : cluster [DBG] pgmap v3562: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:13.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:47:13 gibba015 bash[30343]: cluster 2021-03-10T15:47:12.098574+0000 mgr.gibba045.orlgmj (mgr.34412) 6260 : cluster [DBG] pgmap v3562: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:13.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:47:13 gibba045 bash[25517]: cluster 2021-03-10T15:47:12.098574+0000 mgr.gibba045.orlgmj (mgr.34412) 6260 : cluster [DBG] pgmap v3562: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:15.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:47:15 gibba015 bash[29377]: cluster 2021-03-10T15:47:14.099780+0000 mgr.gibba045.orlgmj (mgr.34412) 6261 : cluster [DBG] pgmap v3563: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:15.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:47:15 gibba015 bash[30343]: cluster 2021-03-10T15:47:14.099780+0000 mgr.gibba045.orlgmj (mgr.34412) 6261 : cluster [DBG] pgmap v3563: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:15.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:47:15 gibba045 bash[25517]: cluster 2021-03-10T15:47:14.099780+0000 mgr.gibba045.orlgmj (mgr.34412) 6261 : cluster [DBG] pgmap v3563: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:17.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:47:17 gibba015 bash[29377]: cluster 2021-03-10T15:47:16.101585+0000 mgr.gibba045.orlgmj (mgr.34412) 6262 : cluster [DBG] pgmap v3564: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:17.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:47:17 gibba015 bash[30343]: cluster 2021-03-10T15:47:16.101585+0000 mgr.gibba045.orlgmj (mgr.34412) 6262 : cluster [DBG] pgmap v3564: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:17.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:47:17 gibba045 bash[25517]: cluster 2021-03-10T15:47:16.101585+0000 mgr.gibba045.orlgmj (mgr.34412) 6262 : cluster [DBG] pgmap v3564: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:19.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:47:19 gibba015 bash[29377]: cluster 2021-03-10T15:47:18.103188+0000 mgr.gibba045.orlgmj (mgr.34412) 6263 : cluster [DBG] pgmap v3565: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:19.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:47:19 gibba015 bash[30343]: cluster 2021-03-10T15:47:18.103188+0000 mgr.gibba045.orlgmj (mgr.34412) 6263 : cluster [DBG] pgmap v3565: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:19.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:47:19 gibba045 bash[25517]: cluster 2021-03-10T15:47:18.103188+0000 mgr.gibba045.orlgmj (mgr.34412) 6263 : cluster [DBG] pgmap v3565: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:21.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:47:20 gibba015 bash[29377]: cluster 2021-03-10T15:47:20.105049+0000 mgr.gibba045.orlgmj (mgr.34412) 6264 : cluster [DBG] pgmap v3566: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:21.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:47:20 gibba015 bash[30343]: cluster 2021-03-10T15:47:20.105049+0000 mgr.gibba045.orlgmj (mgr.34412) 6264 : cluster [DBG] pgmap v3566: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:21.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:47:20 gibba045 bash[25517]: cluster 2021-03-10T15:47:20.105049+0000 mgr.gibba045.orlgmj (mgr.34412) 6264 : cluster [DBG] pgmap v3566: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:22.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:47:21 gibba015 bash[29377]: cephadm 2021-03-10T15:47:20.513725+0000 mgr.gibba045.orlgmj (mgr.34412) 6265 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:47:22.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:47:21 gibba015 bash[30343]: cephadm 2021-03-10T15:47:20.513725+0000 mgr.gibba045.orlgmj (mgr.34412) 6265 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:47:22.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:47:21 gibba045 bash[25517]: cephadm 2021-03-10T15:47:20.513725+0000 mgr.gibba045.orlgmj (mgr.34412) 6265 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:47:23.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:47:22 gibba015 bash[29377]: cluster 2021-03-10T15:47:22.106746+0000 mgr.gibba045.orlgmj (mgr.34412) 6266 : cluster [DBG] pgmap v3567: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:23.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:47:22 gibba015 bash[30343]: cluster 2021-03-10T15:47:22.106746+0000 mgr.gibba045.orlgmj (mgr.34412) 6266 : cluster [DBG] pgmap v3567: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:23.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:47:22 gibba045 bash[25517]: cluster 2021-03-10T15:47:22.106746+0000 mgr.gibba045.orlgmj (mgr.34412) 6266 : cluster [DBG] pgmap v3567: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:25.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:47:25 gibba015 bash[29377]: cluster 2021-03-10T15:47:24.108198+0000 mgr.gibba045.orlgmj (mgr.34412) 6267 : cluster [DBG] pgmap v3568: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:25.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:47:25 gibba015 bash[30343]: cluster 2021-03-10T15:47:24.108198+0000 mgr.gibba045.orlgmj (mgr.34412) 6267 : cluster [DBG] pgmap v3568: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:25.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:47:25 gibba045 bash[25517]: cluster 2021-03-10T15:47:24.108198+0000 mgr.gibba045.orlgmj (mgr.34412) 6267 : cluster [DBG] pgmap v3568: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:26.069 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:47:26.304 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:47:26.304 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (118m) 2m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:47:26.304 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 56s ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:47:26.305 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (118m) 56s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:47:26.305 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (118m) 56s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:47:26.305 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (117m) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:47:26.305 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (117m) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:47:26.306 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (117m) 56s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:47:26.306 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (117m) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:47:26.306 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 2m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:47:26.306 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 56s ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:47:26.307 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (116m) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:47:26.307 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (116m) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:47:26.307 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (115m) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:47:26.307 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (115m) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:47:26.307 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (114m) 56s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:47:26.308 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (114m) 56s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:47:26.308 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (113m) 56s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:47:26.308 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (113m) 56s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:47:26.308 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 56s ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:47:26.309 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 56s ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T15:47:26.554 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:47:26.554 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:47:26.554 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:47:26.555 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:47:26.555 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:47:26.555 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:47:26.555 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:47:26.556 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:47:26.556 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:47:26.556 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:47:26.556 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:47:26.556 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:47:26.557 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:47:26.557 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:47:26.557 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:47:27.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:47:27 gibba015 bash[29377]: audit 2021-03-10T15:47:26.060265+0000 mgr.gibba045.orlgmj (mgr.34412) 6268 : audit [DBG] from='client.58252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:47:27.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:47:27 gibba015 bash[29377]: cluster 2021-03-10T15:47:26.109839+0000 mgr.gibba045.orlgmj (mgr.34412) 6269 : cluster [DBG] pgmap v3569: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:27.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:47:27 gibba015 bash[29377]: audit 2021-03-10T15:47:26.291388+0000 mgr.gibba045.orlgmj (mgr.34412) 6270 : audit [DBG] from='client.48270 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:47:27.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:47:27 gibba015 bash[29377]: audit 2021-03-10T15:47:26.550823+0000 mon.a (mon.0) 1550 : audit [DBG] from='client.? 172.21.2.115:0/788467161' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:47:27.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:47:27 gibba015 bash[30343]: audit 2021-03-10T15:47:26.060265+0000 mgr.gibba045.orlgmj (mgr.34412) 6268 : audit [DBG] from='client.58252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:47:27.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:47:27 gibba015 bash[30343]: cluster 2021-03-10T15:47:26.109839+0000 mgr.gibba045.orlgmj (mgr.34412) 6269 : cluster [DBG] pgmap v3569: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:27.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:47:27 gibba015 bash[30343]: audit 2021-03-10T15:47:26.291388+0000 mgr.gibba045.orlgmj (mgr.34412) 6270 : audit [DBG] from='client.48270 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:47:27.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:47:27 gibba015 bash[30343]: audit 2021-03-10T15:47:26.550823+0000 mon.a (mon.0) 1550 : audit [DBG] from='client.? 172.21.2.115:0/788467161' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:47:27.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:47:27 gibba045 bash[25517]: audit 2021-03-10T15:47:26.060265+0000 mgr.gibba045.orlgmj (mgr.34412) 6268 : audit [DBG] from='client.58252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:47:27.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:47:27 gibba045 bash[25517]: cluster 2021-03-10T15:47:26.109839+0000 mgr.gibba045.orlgmj (mgr.34412) 6269 : cluster [DBG] pgmap v3569: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:27.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:47:27 gibba045 bash[25517]: audit 2021-03-10T15:47:26.291388+0000 mgr.gibba045.orlgmj (mgr.34412) 6270 : audit [DBG] from='client.48270 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:47:27.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:47:27 gibba045 bash[25517]: audit 2021-03-10T15:47:26.550823+0000 mon.a (mon.0) 1550 : audit [DBG] from='client.? 172.21.2.115:0/788467161' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:47:29.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:47:29 gibba015 bash[29377]: cluster 2021-03-10T15:47:28.111444+0000 mgr.gibba045.orlgmj (mgr.34412) 6271 : cluster [DBG] pgmap v3570: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:29.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:47:29 gibba015 bash[30343]: cluster 2021-03-10T15:47:28.111444+0000 mgr.gibba045.orlgmj (mgr.34412) 6271 : cluster [DBG] pgmap v3570: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:29.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:47:29 gibba045 bash[25517]: cluster 2021-03-10T15:47:28.111444+0000 mgr.gibba045.orlgmj (mgr.34412) 6271 : cluster [DBG] pgmap v3570: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:31.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:47:30 gibba015 bash[29377]: cluster 2021-03-10T15:47:30.112868+0000 mgr.gibba045.orlgmj (mgr.34412) 6272 : cluster [DBG] pgmap v3571: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:31.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:47:30 gibba015 bash[30343]: cluster 2021-03-10T15:47:30.112868+0000 mgr.gibba045.orlgmj (mgr.34412) 6272 : cluster [DBG] pgmap v3571: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:31.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:47:30 gibba045 bash[25517]: cluster 2021-03-10T15:47:30.112868+0000 mgr.gibba045.orlgmj (mgr.34412) 6272 : cluster [DBG] pgmap v3571: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:33.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:47:33 gibba015 bash[29377]: cluster 2021-03-10T15:47:32.114346+0000 mgr.gibba045.orlgmj (mgr.34412) 6273 : cluster [DBG] pgmap v3572: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:33.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:47:33 gibba015 bash[30343]: cluster 2021-03-10T15:47:32.114346+0000 mgr.gibba045.orlgmj (mgr.34412) 6273 : cluster [DBG] pgmap v3572: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:33.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:47:33 gibba045 bash[25517]: cluster 2021-03-10T15:47:32.114346+0000 mgr.gibba045.orlgmj (mgr.34412) 6273 : cluster [DBG] pgmap v3572: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:35.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:47:35 gibba015 bash[29377]: cluster 2021-03-10T15:47:34.115457+0000 mgr.gibba045.orlgmj (mgr.34412) 6274 : cluster [DBG] pgmap v3573: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:35.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:47:35 gibba015 bash[30343]: cluster 2021-03-10T15:47:34.115457+0000 mgr.gibba045.orlgmj (mgr.34412) 6274 : cluster [DBG] pgmap v3573: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:35.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:47:35 gibba045 bash[25517]: cluster 2021-03-10T15:47:34.115457+0000 mgr.gibba045.orlgmj (mgr.34412) 6274 : cluster [DBG] pgmap v3573: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:36.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:47:36 gibba015 bash[30343]: audit 2021-03-10T15:47:35.527593+0000 mon.c (mon.1) 1755 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:47:36.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:47:36 gibba015 bash[30343]: audit 2021-03-10T15:47:35.772928+0000 mon.a (mon.0) 1551 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:47:36.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:47:36 gibba015 bash[30343]: audit 2021-03-10T15:47:35.776452+0000 mon.c (mon.1) 1756 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:47:36.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:47:36 gibba015 bash[30343]: audit 2021-03-10T15:47:35.778005+0000 mon.c (mon.1) 1757 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:47:36.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:47:36 gibba015 bash[30343]: audit 2021-03-10T15:47:35.779242+0000 mon.c (mon.1) 1758 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:47:36.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:47:36 gibba015 bash[30343]: audit 2021-03-10T15:47:35.780528+0000 mon.c (mon.1) 1759 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:47:36.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:47:36 gibba015 bash[30343]: audit 2021-03-10T15:47:35.783440+0000 mon.c (mon.1) 1760 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:47:36.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:47:36 gibba015 bash[30343]: audit 2021-03-10T15:47:35.784912+0000 mon.c (mon.1) 1761 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:47:36.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:47:36 gibba015 bash[29377]: audit 2021-03-10T15:47:35.527593+0000 mon.c (mon.1) 1755 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:47:36.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:47:36 gibba015 bash[29377]: audit 2021-03-10T15:47:35.772928+0000 mon.a (mon.0) 1551 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:47:36.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:47:36 gibba015 bash[29377]: audit 2021-03-10T15:47:35.776452+0000 mon.c (mon.1) 1756 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:47:36.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:47:36 gibba015 bash[29377]: audit 2021-03-10T15:47:35.778005+0000 mon.c (mon.1) 1757 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:47:36.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:47:36 gibba015 bash[29377]: audit 2021-03-10T15:47:35.779242+0000 mon.c (mon.1) 1758 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:47:36.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:47:36 gibba015 bash[29377]: audit 2021-03-10T15:47:35.780528+0000 mon.c (mon.1) 1759 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:47:36.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:47:36 gibba015 bash[29377]: audit 2021-03-10T15:47:35.783440+0000 mon.c (mon.1) 1760 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:47:36.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:47:36 gibba015 bash[29377]: audit 2021-03-10T15:47:35.784912+0000 mon.c (mon.1) 1761 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:47:36.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:47:36 gibba045 bash[25517]: audit 2021-03-10T15:47:35.527593+0000 mon.c (mon.1) 1755 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:47:36.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:47:36 gibba045 bash[25517]: audit 2021-03-10T15:47:35.772928+0000 mon.a (mon.0) 1551 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:47:36.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:47:36 gibba045 bash[25517]: audit 2021-03-10T15:47:35.776452+0000 mon.c (mon.1) 1756 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:47:36.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:47:36 gibba045 bash[25517]: audit 2021-03-10T15:47:35.778005+0000 mon.c (mon.1) 1757 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:47:36.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:47:36 gibba045 bash[25517]: audit 2021-03-10T15:47:35.779242+0000 mon.c (mon.1) 1758 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:47:36.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:47:36 gibba045 bash[25517]: audit 2021-03-10T15:47:35.780528+0000 mon.c (mon.1) 1759 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:47:36.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:47:36 gibba045 bash[25517]: audit 2021-03-10T15:47:35.783440+0000 mon.c (mon.1) 1760 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:47:36.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:47:36 gibba045 bash[25517]: audit 2021-03-10T15:47:35.784912+0000 mon.c (mon.1) 1761 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:47:37.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:47:37 gibba015 bash[29377]: cephadm 2021-03-10T15:47:35.536734+0000 mgr.gibba045.orlgmj (mgr.34412) 6275 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:47:37.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:47:37 gibba015 bash[29377]: cephadm 2021-03-10T15:47:35.538235+0000 mgr.gibba045.orlgmj (mgr.34412) 6276 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:47:37.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:47:37 gibba015 bash[29377]: cephadm 2021-03-10T15:47:35.778816+0000 mgr.gibba045.orlgmj (mgr.34412) 6277 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:47:37.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:47:37 gibba015 bash[29377]: cephadm 2021-03-10T15:47:35.780572+0000 mgr.gibba045.orlgmj (mgr.34412) 6278 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:47:37.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:47:37 gibba015 bash[29377]: cephadm 2021-03-10T15:47:35.781889+0000 mgr.gibba045.orlgmj (mgr.34412) 6279 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:47:37.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:47:37 gibba015 bash[29377]: cephadm 2021-03-10T15:47:35.781953+0000 mgr.gibba045.orlgmj (mgr.34412) 6280 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:47:37.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:47:37 gibba015 bash[29377]: cephadm 2021-03-10T15:47:35.783067+0000 mgr.gibba045.orlgmj (mgr.34412) 6281 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:47:37.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:47:37 gibba015 bash[29377]: cephadm 2021-03-10T15:47:35.783125+0000 mgr.gibba045.orlgmj (mgr.34412) 6282 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:47:37.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:47:37 gibba015 bash[29377]: cephadm 2021-03-10T15:47:35.784339+0000 mgr.gibba045.orlgmj (mgr.34412) 6283 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:47:37.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:47:37 gibba015 bash[29377]: cephadm 2021-03-10T15:47:35.785811+0000 mgr.gibba045.orlgmj (mgr.34412) 6284 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:47:37.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:47:37 gibba015 bash[29377]: cephadm 2021-03-10T15:47:35.785892+0000 mgr.gibba045.orlgmj (mgr.34412) 6285 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:47:37.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:47:37 gibba015 bash[29377]: cephadm 2021-03-10T15:47:35.787336+0000 mgr.gibba045.orlgmj (mgr.34412) 6286 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:47:37.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:47:37 gibba015 bash[29377]: cephadm 2021-03-10T15:47:35.787706+0000 mgr.gibba045.orlgmj (mgr.34412) 6287 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:47:37.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:47:37 gibba015 bash[29377]: cephadm 2021-03-10T15:47:35.788789+0000 mgr.gibba045.orlgmj (mgr.34412) 6288 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:47:37.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:47:37 gibba015 bash[29377]: cephadm 2021-03-10T15:47:35.788854+0000 mgr.gibba045.orlgmj (mgr.34412) 6289 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:47:37.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:47:37 gibba015 bash[29377]: cephadm 2021-03-10T15:47:35.789011+0000 mgr.gibba045.orlgmj (mgr.34412) 6290 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:47:37.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:47:37 gibba015 bash[29377]: cluster 2021-03-10T15:47:36.116912+0000 mgr.gibba045.orlgmj (mgr.34412) 6291 : cluster [DBG] pgmap v3574: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:37.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:47:37 gibba015 bash[30343]: cephadm 2021-03-10T15:47:35.536734+0000 mgr.gibba045.orlgmj (mgr.34412) 6275 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:47:37.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:47:37 gibba015 bash[30343]: cephadm 2021-03-10T15:47:35.538235+0000 mgr.gibba045.orlgmj (mgr.34412) 6276 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:47:37.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:47:37 gibba015 bash[30343]: cephadm 2021-03-10T15:47:35.778816+0000 mgr.gibba045.orlgmj (mgr.34412) 6277 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:47:37.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:47:37 gibba015 bash[30343]: cephadm 2021-03-10T15:47:35.780572+0000 mgr.gibba045.orlgmj (mgr.34412) 6278 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:47:37.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:47:37 gibba015 bash[30343]: cephadm 2021-03-10T15:47:35.781889+0000 mgr.gibba045.orlgmj (mgr.34412) 6279 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:47:37.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:47:37 gibba015 bash[30343]: cephadm 2021-03-10T15:47:35.781953+0000 mgr.gibba045.orlgmj (mgr.34412) 6280 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:47:37.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:47:37 gibba015 bash[30343]: cephadm 2021-03-10T15:47:35.783067+0000 mgr.gibba045.orlgmj (mgr.34412) 6281 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:47:37.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:47:37 gibba015 bash[30343]: cephadm 2021-03-10T15:47:35.783125+0000 mgr.gibba045.orlgmj (mgr.34412) 6282 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:47:37.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:47:37 gibba015 bash[30343]: cephadm 2021-03-10T15:47:35.784339+0000 mgr.gibba045.orlgmj (mgr.34412) 6283 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:47:37.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:47:37 gibba015 bash[30343]: cephadm 2021-03-10T15:47:35.785811+0000 mgr.gibba045.orlgmj (mgr.34412) 6284 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:47:37.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:47:37 gibba015 bash[30343]: cephadm 2021-03-10T15:47:35.785892+0000 mgr.gibba045.orlgmj (mgr.34412) 6285 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:47:37.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:47:37 gibba015 bash[30343]: cephadm 2021-03-10T15:47:35.787336+0000 mgr.gibba045.orlgmj (mgr.34412) 6286 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:47:37.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:47:37 gibba015 bash[30343]: cephadm 2021-03-10T15:47:35.787706+0000 mgr.gibba045.orlgmj (mgr.34412) 6287 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:47:37.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:47:37 gibba015 bash[30343]: cephadm 2021-03-10T15:47:35.788789+0000 mgr.gibba045.orlgmj (mgr.34412) 6288 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:47:37.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:47:37 gibba015 bash[30343]: cephadm 2021-03-10T15:47:35.788854+0000 mgr.gibba045.orlgmj (mgr.34412) 6289 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:47:37.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:47:37 gibba015 bash[30343]: cephadm 2021-03-10T15:47:35.789011+0000 mgr.gibba045.orlgmj (mgr.34412) 6290 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:47:37.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:47:37 gibba015 bash[30343]: cluster 2021-03-10T15:47:36.116912+0000 mgr.gibba045.orlgmj (mgr.34412) 6291 : cluster [DBG] pgmap v3574: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:37.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:47:37 gibba045 bash[25517]: cephadm 2021-03-10T15:47:35.536734+0000 mgr.gibba045.orlgmj (mgr.34412) 6275 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:47:37.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:47:37 gibba045 bash[25517]: cephadm 2021-03-10T15:47:35.538235+0000 mgr.gibba045.orlgmj (mgr.34412) 6276 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:47:37.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:47:37 gibba045 bash[25517]: cephadm 2021-03-10T15:47:35.778816+0000 mgr.gibba045.orlgmj (mgr.34412) 6277 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:47:37.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:47:37 gibba045 bash[25517]: cephadm 2021-03-10T15:47:35.780572+0000 mgr.gibba045.orlgmj (mgr.34412) 6278 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:47:37.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:47:37 gibba045 bash[25517]: cephadm 2021-03-10T15:47:35.781889+0000 mgr.gibba045.orlgmj (mgr.34412) 6279 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:47:37.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:47:37 gibba045 bash[25517]: cephadm 2021-03-10T15:47:35.781953+0000 mgr.gibba045.orlgmj (mgr.34412) 6280 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:47:37.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:47:37 gibba045 bash[25517]: cephadm 2021-03-10T15:47:35.783067+0000 mgr.gibba045.orlgmj (mgr.34412) 6281 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:47:37.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:47:37 gibba045 bash[25517]: cephadm 2021-03-10T15:47:35.783125+0000 mgr.gibba045.orlgmj (mgr.34412) 6282 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:47:37.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:47:37 gibba045 bash[25517]: cephadm 2021-03-10T15:47:35.784339+0000 mgr.gibba045.orlgmj (mgr.34412) 6283 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:47:37.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:47:37 gibba045 bash[25517]: cephadm 2021-03-10T15:47:35.785811+0000 mgr.gibba045.orlgmj (mgr.34412) 6284 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:47:37.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:47:37 gibba045 bash[25517]: cephadm 2021-03-10T15:47:35.785892+0000 mgr.gibba045.orlgmj (mgr.34412) 6285 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:47:37.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:47:37 gibba045 bash[25517]: cephadm 2021-03-10T15:47:35.787336+0000 mgr.gibba045.orlgmj (mgr.34412) 6286 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:47:37.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:47:37 gibba045 bash[25517]: cephadm 2021-03-10T15:47:35.787706+0000 mgr.gibba045.orlgmj (mgr.34412) 6287 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:47:37.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:47:37 gibba045 bash[25517]: cephadm 2021-03-10T15:47:35.788789+0000 mgr.gibba045.orlgmj (mgr.34412) 6288 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:47:37.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:47:37 gibba045 bash[25517]: cephadm 2021-03-10T15:47:35.788854+0000 mgr.gibba045.orlgmj (mgr.34412) 6289 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:47:37.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:47:37 gibba045 bash[25517]: cephadm 2021-03-10T15:47:35.789011+0000 mgr.gibba045.orlgmj (mgr.34412) 6290 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:47:37.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:47:37 gibba045 bash[25517]: cluster 2021-03-10T15:47:36.116912+0000 mgr.gibba045.orlgmj (mgr.34412) 6291 : cluster [DBG] pgmap v3574: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:39.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:47:39 gibba015 bash[29377]: cluster 2021-03-10T15:47:38.118350+0000 mgr.gibba045.orlgmj (mgr.34412) 6292 : cluster [DBG] pgmap v3575: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:39.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:47:39 gibba015 bash[30343]: cluster 2021-03-10T15:47:38.118350+0000 mgr.gibba045.orlgmj (mgr.34412) 6292 : cluster [DBG] pgmap v3575: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:39.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:47:39 gibba045 bash[25517]: cluster 2021-03-10T15:47:38.118350+0000 mgr.gibba045.orlgmj (mgr.34412) 6292 : cluster [DBG] pgmap v3575: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:41.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:47:40 gibba015 bash[29377]: cluster 2021-03-10T15:47:40.120161+0000 mgr.gibba045.orlgmj (mgr.34412) 6293 : cluster [DBG] pgmap v3576: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:41.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:47:40 gibba015 bash[30343]: cluster 2021-03-10T15:47:40.120161+0000 mgr.gibba045.orlgmj (mgr.34412) 6293 : cluster [DBG] pgmap v3576: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:41.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:47:40 gibba045 bash[25517]: cluster 2021-03-10T15:47:40.120161+0000 mgr.gibba045.orlgmj (mgr.34412) 6293 : cluster [DBG] pgmap v3576: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:43.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:47:43 gibba015 bash[29377]: cluster 2021-03-10T15:47:42.122139+0000 mgr.gibba045.orlgmj (mgr.34412) 6294 : cluster [DBG] pgmap v3577: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:43.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:47:43 gibba015 bash[30343]: cluster 2021-03-10T15:47:42.122139+0000 mgr.gibba045.orlgmj (mgr.34412) 6294 : cluster [DBG] pgmap v3577: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:43.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:47:43 gibba045 bash[25517]: cluster 2021-03-10T15:47:42.122139+0000 mgr.gibba045.orlgmj (mgr.34412) 6294 : cluster [DBG] pgmap v3577: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:45.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:47:45 gibba015 bash[29377]: cluster 2021-03-10T15:47:44.123389+0000 mgr.gibba045.orlgmj (mgr.34412) 6295 : cluster [DBG] pgmap v3578: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:45.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:47:45 gibba015 bash[30343]: cluster 2021-03-10T15:47:44.123389+0000 mgr.gibba045.orlgmj (mgr.34412) 6295 : cluster [DBG] pgmap v3578: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:45.590 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:47:45 gibba045 bash[25517]: cluster 2021-03-10T15:47:44.123389+0000 mgr.gibba045.orlgmj (mgr.34412) 6295 : cluster [DBG] pgmap v3578: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:47.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:47:47 gibba015 bash[29377]: cluster 2021-03-10T15:47:46.125221+0000 mgr.gibba045.orlgmj (mgr.34412) 6296 : cluster [DBG] pgmap v3579: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:47.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:47:47 gibba015 bash[30343]: cluster 2021-03-10T15:47:46.125221+0000 mgr.gibba045.orlgmj (mgr.34412) 6296 : cluster [DBG] pgmap v3579: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:47.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:47:47 gibba045 bash[25517]: cluster 2021-03-10T15:47:46.125221+0000 mgr.gibba045.orlgmj (mgr.34412) 6296 : cluster [DBG] pgmap v3579: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:49.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:47:49 gibba015 bash[29377]: cluster 2021-03-10T15:47:48.126893+0000 mgr.gibba045.orlgmj (mgr.34412) 6297 : cluster [DBG] pgmap v3580: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:49.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:47:49 gibba015 bash[30343]: cluster 2021-03-10T15:47:48.126893+0000 mgr.gibba045.orlgmj (mgr.34412) 6297 : cluster [DBG] pgmap v3580: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:49.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:47:49 gibba045 bash[25517]: cluster 2021-03-10T15:47:48.126893+0000 mgr.gibba045.orlgmj (mgr.34412) 6297 : cluster [DBG] pgmap v3580: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:51.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:47:50 gibba045 bash[25517]: cluster 2021-03-10T15:47:50.127946+0000 mgr.gibba045.orlgmj (mgr.34412) 6298 : cluster [DBG] pgmap v3581: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:51.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:47:50 gibba015 bash[29377]: cluster 2021-03-10T15:47:50.127946+0000 mgr.gibba045.orlgmj (mgr.34412) 6298 : cluster [DBG] pgmap v3581: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:51.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:47:50 gibba015 bash[30343]: cluster 2021-03-10T15:47:50.127946+0000 mgr.gibba045.orlgmj (mgr.34412) 6298 : cluster [DBG] pgmap v3581: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:52.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:47:51 gibba015 bash[29377]: cephadm 2021-03-10T15:47:50.805126+0000 mgr.gibba045.orlgmj (mgr.34412) 6299 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:47:52.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:47:51 gibba015 bash[30343]: cephadm 2021-03-10T15:47:50.805126+0000 mgr.gibba045.orlgmj (mgr.34412) 6299 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:47:52.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:47:51 gibba045 bash[25517]: cephadm 2021-03-10T15:47:50.805126+0000 mgr.gibba045.orlgmj (mgr.34412) 6299 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:47:53.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:47:52 gibba015 bash[29377]: cluster 2021-03-10T15:47:52.129601+0000 mgr.gibba045.orlgmj (mgr.34412) 6300 : cluster [DBG] pgmap v3582: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:53.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:47:52 gibba015 bash[30343]: cluster 2021-03-10T15:47:52.129601+0000 mgr.gibba045.orlgmj (mgr.34412) 6300 : cluster [DBG] pgmap v3582: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:53.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:47:52 gibba045 bash[25517]: cluster 2021-03-10T15:47:52.129601+0000 mgr.gibba045.orlgmj (mgr.34412) 6300 : cluster [DBG] pgmap v3582: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:54.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:47:53 gibba015 bash[29377]: audit 2021-03-10T15:47:53.278863+0000 mon.c (mon.1) 1762 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:47:54.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:47:53 gibba015 bash[29377]: audit 2021-03-10T15:47:53.279618+0000 mon.c (mon.1) 1763 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:47:54.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:47:53 gibba015 bash[29377]: audit 2021-03-10T15:47:53.279997+0000 mon.a (mon.0) 1552 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:47:54.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:47:53 gibba015 bash[29377]: audit 2021-03-10T15:47:53.280337+0000 mon.c (mon.1) 1764 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T15:47:54.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:47:53 gibba015 bash[29377]: audit 2021-03-10T15:47:53.281135+0000 mon.a (mon.0) 1553 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:47:54.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:47:53 gibba015 bash[29377]: audit 2021-03-10T15:47:53.281241+0000 mon.c (mon.1) 1765 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T15:47:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:47:53 gibba015 bash[29377]: audit 2021-03-10T15:47:53.281994+0000 mon.a (mon.0) 1554 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T15:47:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:47:53 gibba015 bash[29377]: audit 2021-03-10T15:47:53.282132+0000 mon.c (mon.1) 1766 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:47:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:47:53 gibba015 bash[29377]: audit 2021-03-10T15:47:53.282981+0000 mon.c (mon.1) 1767 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:47:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:47:53 gibba015 bash[29377]: audit 2021-03-10T15:47:53.282984+0000 mon.a (mon.0) 1555 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T15:47:54.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:47:53 gibba015 bash[29377]: audit 2021-03-10T15:47:53.283950+0000 mon.a (mon.0) 1556 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:47:54.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:47:53 gibba015 bash[29377]: audit 2021-03-10T15:47:53.284762+0000 mon.a (mon.0) 1557 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:47:54.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:47:53 gibba015 bash[30343]: audit 2021-03-10T15:47:53.278863+0000 mon.c (mon.1) 1762 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:47:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:47:53 gibba015 bash[30343]: audit 2021-03-10T15:47:53.279618+0000 mon.c (mon.1) 1763 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:47:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:47:53 gibba015 bash[30343]: audit 2021-03-10T15:47:53.279997+0000 mon.a (mon.0) 1552 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:47:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:47:53 gibba015 bash[30343]: audit 2021-03-10T15:47:53.280337+0000 mon.c (mon.1) 1764 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T15:47:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:47:53 gibba015 bash[30343]: audit 2021-03-10T15:47:53.281135+0000 mon.a (mon.0) 1553 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:47:54.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:47:53 gibba015 bash[30343]: audit 2021-03-10T15:47:53.281241+0000 mon.c (mon.1) 1765 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T15:47:54.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:47:53 gibba015 bash[30343]: audit 2021-03-10T15:47:53.281994+0000 mon.a (mon.0) 1554 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T15:47:54.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:47:53 gibba015 bash[30343]: audit 2021-03-10T15:47:53.282132+0000 mon.c (mon.1) 1766 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:47:54.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:47:53 gibba015 bash[30343]: audit 2021-03-10T15:47:53.282981+0000 mon.c (mon.1) 1767 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:47:54.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:47:53 gibba015 bash[30343]: audit 2021-03-10T15:47:53.282984+0000 mon.a (mon.0) 1555 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T15:47:54.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:47:53 gibba015 bash[30343]: audit 2021-03-10T15:47:53.283950+0000 mon.a (mon.0) 1556 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:47:54.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:47:53 gibba015 bash[30343]: audit 2021-03-10T15:47:53.284762+0000 mon.a (mon.0) 1557 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:47:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:47:53 gibba045 bash[25517]: audit 2021-03-10T15:47:53.278863+0000 mon.c (mon.1) 1762 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:47:54.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:47:53 gibba045 bash[25517]: audit 2021-03-10T15:47:53.279618+0000 mon.c (mon.1) 1763 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:47:54.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:47:53 gibba045 bash[25517]: audit 2021-03-10T15:47:53.279997+0000 mon.a (mon.0) 1552 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:47:54.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:47:53 gibba045 bash[25517]: audit 2021-03-10T15:47:53.280337+0000 mon.c (mon.1) 1764 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T15:47:54.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:47:53 gibba045 bash[25517]: audit 2021-03-10T15:47:53.281135+0000 mon.a (mon.0) 1553 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:47:54.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:47:53 gibba045 bash[25517]: audit 2021-03-10T15:47:53.281241+0000 mon.c (mon.1) 1765 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T15:47:54.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:47:53 gibba045 bash[25517]: audit 2021-03-10T15:47:53.281994+0000 mon.a (mon.0) 1554 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T15:47:54.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:47:53 gibba045 bash[25517]: audit 2021-03-10T15:47:53.282132+0000 mon.c (mon.1) 1766 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:47:54.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:47:53 gibba045 bash[25517]: audit 2021-03-10T15:47:53.282981+0000 mon.c (mon.1) 1767 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:47:54.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:47:53 gibba045 bash[25517]: audit 2021-03-10T15:47:53.282984+0000 mon.a (mon.0) 1555 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T15:47:54.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:47:53 gibba045 bash[25517]: audit 2021-03-10T15:47:53.283950+0000 mon.a (mon.0) 1556 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:47:54.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:47:53 gibba045 bash[25517]: audit 2021-03-10T15:47:53.284762+0000 mon.a (mon.0) 1557 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:47:55.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:47:54 gibba015 bash[29377]: cluster 2021-03-10T15:47:54.130802+0000 mgr.gibba045.orlgmj (mgr.34412) 6301 : cluster [DBG] pgmap v3583: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:55.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:47:54 gibba015 bash[30343]: cluster 2021-03-10T15:47:54.130802+0000 mgr.gibba045.orlgmj (mgr.34412) 6301 : cluster [DBG] pgmap v3583: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:55.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:47:54 gibba045 bash[25517]: cluster 2021-03-10T15:47:54.130802+0000 mgr.gibba045.orlgmj (mgr.34412) 6301 : cluster [DBG] pgmap v3583: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:56.796 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:47:57.023 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:47:57.023 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (118m) 2m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:47:57.023 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 86s ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:47:57.024 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (119m) 86s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:47:57.024 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (119m) 86s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:47:57.024 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (118m) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:47:57.024 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (118m) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:47:57.025 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (117m) 86s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:47:57.025 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (117m) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:47:57.025 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 2m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:47:57.025 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 86s ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:47:57.025 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (116m) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:47:57.026 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (116m) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:47:57.026 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (116m) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:47:57.026 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (115m) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:47:57.026 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (115m) 86s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:47:57.027 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (114m) 86s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:47:57.027 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (114m) 86s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:47:57.027 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (113m) 86s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:47:57.027 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 86s ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:47:57.027 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 86s ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T15:47:57.271 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:47:57.271 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:47:57.271 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:47:57.272 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:47:57.272 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:47:57.272 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:47:57.272 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:47:57.273 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:47:57.273 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:47:57.273 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:47:57.273 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:47:57.273 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:47:57.274 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:47:57.274 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:47:57.274 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:47:57.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:47:57 gibba015 bash[29377]: cluster 2021-03-10T15:47:56.132501+0000 mgr.gibba045.orlgmj (mgr.34412) 6302 : cluster [DBG] pgmap v3584: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:57.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:47:57 gibba015 bash[30343]: cluster 2021-03-10T15:47:56.132501+0000 mgr.gibba045.orlgmj (mgr.34412) 6302 : cluster [DBG] pgmap v3584: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:57.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:47:57 gibba045 bash[25517]: cluster 2021-03-10T15:47:56.132501+0000 mgr.gibba045.orlgmj (mgr.34412) 6302 : cluster [DBG] pgmap v3584: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:58.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:47:58 gibba015 bash[29377]: audit 2021-03-10T15:47:56.787503+0000 mgr.gibba045.orlgmj (mgr.34412) 6303 : audit [DBG] from='client.58270 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:47:58.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:47:58 gibba015 bash[29377]: audit 2021-03-10T15:47:57.010297+0000 mgr.gibba045.orlgmj (mgr.34412) 6304 : audit [DBG] from='client.48288 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:47:58.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:47:58 gibba015 bash[29377]: audit 2021-03-10T15:47:57.268171+0000 mon.a (mon.0) 1558 : audit [DBG] from='client.? 172.21.2.115:0/1699892620' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:47:58.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:47:58 gibba015 bash[30343]: audit 2021-03-10T15:47:56.787503+0000 mgr.gibba045.orlgmj (mgr.34412) 6303 : audit [DBG] from='client.58270 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:47:58.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:47:58 gibba015 bash[30343]: audit 2021-03-10T15:47:57.010297+0000 mgr.gibba045.orlgmj (mgr.34412) 6304 : audit [DBG] from='client.48288 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:47:58.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:47:58 gibba015 bash[30343]: audit 2021-03-10T15:47:57.268171+0000 mon.a (mon.0) 1558 : audit [DBG] from='client.? 172.21.2.115:0/1699892620' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:47:58.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:47:58 gibba045 bash[25517]: audit 2021-03-10T15:47:56.787503+0000 mgr.gibba045.orlgmj (mgr.34412) 6303 : audit [DBG] from='client.58270 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:47:58.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:47:58 gibba045 bash[25517]: audit 2021-03-10T15:47:57.010297+0000 mgr.gibba045.orlgmj (mgr.34412) 6304 : audit [DBG] from='client.48288 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:47:58.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:47:58 gibba045 bash[25517]: audit 2021-03-10T15:47:57.268171+0000 mon.a (mon.0) 1558 : audit [DBG] from='client.? 172.21.2.115:0/1699892620' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:47:59.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:47:59 gibba015 bash[29377]: cluster 2021-03-10T15:47:58.134108+0000 mgr.gibba045.orlgmj (mgr.34412) 6305 : cluster [DBG] pgmap v3585: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:59.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:47:59 gibba015 bash[30343]: cluster 2021-03-10T15:47:58.134108+0000 mgr.gibba045.orlgmj (mgr.34412) 6305 : cluster [DBG] pgmap v3585: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:59.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:47:59 gibba045 bash[25517]: cluster 2021-03-10T15:47:58.134108+0000 mgr.gibba045.orlgmj (mgr.34412) 6305 : cluster [DBG] pgmap v3585: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:01.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:48:00 gibba015 bash[29377]: cluster 2021-03-10T15:48:00.134876+0000 mgr.gibba045.orlgmj (mgr.34412) 6306 : cluster [DBG] pgmap v3586: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:01.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:48:00 gibba015 bash[30343]: cluster 2021-03-10T15:48:00.134876+0000 mgr.gibba045.orlgmj (mgr.34412) 6306 : cluster [DBG] pgmap v3586: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:01.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:48:00 gibba045 bash[25517]: cluster 2021-03-10T15:48:00.134876+0000 mgr.gibba045.orlgmj (mgr.34412) 6306 : cluster [DBG] pgmap v3586: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:03.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:48:03 gibba015 bash[29377]: cluster 2021-03-10T15:48:02.136195+0000 mgr.gibba045.orlgmj (mgr.34412) 6307 : cluster [DBG] pgmap v3587: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:03.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:48:03 gibba015 bash[30343]: cluster 2021-03-10T15:48:02.136195+0000 mgr.gibba045.orlgmj (mgr.34412) 6307 : cluster [DBG] pgmap v3587: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:03.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:48:03 gibba045 bash[25517]: cluster 2021-03-10T15:48:02.136195+0000 mgr.gibba045.orlgmj (mgr.34412) 6307 : cluster [DBG] pgmap v3587: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:05.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:48:05 gibba015 bash[29377]: cluster 2021-03-10T15:48:04.137391+0000 mgr.gibba045.orlgmj (mgr.34412) 6308 : cluster [DBG] pgmap v3588: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:05.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:48:05 gibba015 bash[30343]: cluster 2021-03-10T15:48:04.137391+0000 mgr.gibba045.orlgmj (mgr.34412) 6308 : cluster [DBG] pgmap v3588: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:05.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:48:05 gibba045 bash[25517]: cluster 2021-03-10T15:48:04.137391+0000 mgr.gibba045.orlgmj (mgr.34412) 6308 : cluster [DBG] pgmap v3588: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:07.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:48:07 gibba015 bash[29377]: cephadm 2021-03-10T15:48:05.821196+0000 mgr.gibba045.orlgmj (mgr.34412) 6309 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:48:07.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:48:07 gibba015 bash[29377]: cluster 2021-03-10T15:48:06.138062+0000 mgr.gibba045.orlgmj (mgr.34412) 6310 : cluster [DBG] pgmap v3589: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:07.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:48:07 gibba015 bash[30343]: cephadm 2021-03-10T15:48:05.821196+0000 mgr.gibba045.orlgmj (mgr.34412) 6309 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:48:07.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:48:07 gibba015 bash[30343]: cluster 2021-03-10T15:48:06.138062+0000 mgr.gibba045.orlgmj (mgr.34412) 6310 : cluster [DBG] pgmap v3589: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:07.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:48:07 gibba045 bash[25517]: cephadm 2021-03-10T15:48:05.821196+0000 mgr.gibba045.orlgmj (mgr.34412) 6309 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:48:07.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:48:07 gibba045 bash[25517]: cluster 2021-03-10T15:48:06.138062+0000 mgr.gibba045.orlgmj (mgr.34412) 6310 : cluster [DBG] pgmap v3589: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:09.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:48:09 gibba045 bash[25517]: cluster 2021-03-10T15:48:08.139458+0000 mgr.gibba045.orlgmj (mgr.34412) 6311 : cluster [DBG] pgmap v3590: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:09.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:48:09 gibba015 bash[29377]: cluster 2021-03-10T15:48:08.139458+0000 mgr.gibba045.orlgmj (mgr.34412) 6311 : cluster [DBG] pgmap v3590: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:09.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:48:09 gibba015 bash[30343]: cluster 2021-03-10T15:48:08.139458+0000 mgr.gibba045.orlgmj (mgr.34412) 6311 : cluster [DBG] pgmap v3590: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:11.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:48:10 gibba015 bash[29377]: cluster 2021-03-10T15:48:10.141017+0000 mgr.gibba045.orlgmj (mgr.34412) 6312 : cluster [DBG] pgmap v3591: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:11.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:48:10 gibba015 bash[30343]: cluster 2021-03-10T15:48:10.141017+0000 mgr.gibba045.orlgmj (mgr.34412) 6312 : cluster [DBG] pgmap v3591: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:11.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:48:10 gibba045 bash[25517]: cluster 2021-03-10T15:48:10.141017+0000 mgr.gibba045.orlgmj (mgr.34412) 6312 : cluster [DBG] pgmap v3591: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:13.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:48:13 gibba015 bash[29377]: cluster 2021-03-10T15:48:12.141676+0000 mgr.gibba045.orlgmj (mgr.34412) 6313 : cluster [DBG] pgmap v3592: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:13.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:48:13 gibba015 bash[30343]: cluster 2021-03-10T15:48:12.141676+0000 mgr.gibba045.orlgmj (mgr.34412) 6313 : cluster [DBG] pgmap v3592: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:13.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:48:13 gibba045 bash[25517]: cluster 2021-03-10T15:48:12.141676+0000 mgr.gibba045.orlgmj (mgr.34412) 6313 : cluster [DBG] pgmap v3592: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:15.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:48:15 gibba015 bash[29377]: cluster 2021-03-10T15:48:14.142770+0000 mgr.gibba045.orlgmj (mgr.34412) 6314 : cluster [DBG] pgmap v3593: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:15.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:48:15 gibba015 bash[30343]: cluster 2021-03-10T15:48:14.142770+0000 mgr.gibba045.orlgmj (mgr.34412) 6314 : cluster [DBG] pgmap v3593: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:15.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:48:15 gibba045 bash[25517]: cluster 2021-03-10T15:48:14.142770+0000 mgr.gibba045.orlgmj (mgr.34412) 6314 : cluster [DBG] pgmap v3593: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:17.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:48:17 gibba015 bash[29377]: cluster 2021-03-10T15:48:16.144404+0000 mgr.gibba045.orlgmj (mgr.34412) 6315 : cluster [DBG] pgmap v3594: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:17.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:48:17 gibba015 bash[30343]: cluster 2021-03-10T15:48:16.144404+0000 mgr.gibba045.orlgmj (mgr.34412) 6315 : cluster [DBG] pgmap v3594: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:17.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:48:17 gibba045 bash[25517]: cluster 2021-03-10T15:48:16.144404+0000 mgr.gibba045.orlgmj (mgr.34412) 6315 : cluster [DBG] pgmap v3594: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:19.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:48:19 gibba045 bash[25517]: cluster 2021-03-10T15:48:18.144941+0000 mgr.gibba045.orlgmj (mgr.34412) 6316 : cluster [DBG] pgmap v3595: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:19.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:48:19 gibba015 bash[29377]: cluster 2021-03-10T15:48:18.144941+0000 mgr.gibba045.orlgmj (mgr.34412) 6316 : cluster [DBG] pgmap v3595: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:19.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:48:19 gibba015 bash[30343]: cluster 2021-03-10T15:48:18.144941+0000 mgr.gibba045.orlgmj (mgr.34412) 6316 : cluster [DBG] pgmap v3595: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:21.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:48:20 gibba015 bash[29377]: cluster 2021-03-10T15:48:20.146467+0000 mgr.gibba045.orlgmj (mgr.34412) 6317 : cluster [DBG] pgmap v3596: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:21.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:48:20 gibba015 bash[30343]: cluster 2021-03-10T15:48:20.146467+0000 mgr.gibba045.orlgmj (mgr.34412) 6317 : cluster [DBG] pgmap v3596: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:21.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:48:20 gibba045 bash[25517]: cluster 2021-03-10T15:48:20.146467+0000 mgr.gibba045.orlgmj (mgr.34412) 6317 : cluster [DBG] pgmap v3596: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:22.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:48:21 gibba015 bash[29377]: cephadm 2021-03-10T15:48:20.837216+0000 mgr.gibba045.orlgmj (mgr.34412) 6318 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:48:22.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:48:21 gibba015 bash[30343]: cephadm 2021-03-10T15:48:20.837216+0000 mgr.gibba045.orlgmj (mgr.34412) 6318 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:48:22.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:48:21 gibba045 bash[25517]: cephadm 2021-03-10T15:48:20.837216+0000 mgr.gibba045.orlgmj (mgr.34412) 6318 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:48:23.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:48:22 gibba015 bash[29377]: cluster 2021-03-10T15:48:22.147982+0000 mgr.gibba045.orlgmj (mgr.34412) 6319 : cluster [DBG] pgmap v3597: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:23.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:48:22 gibba015 bash[30343]: cluster 2021-03-10T15:48:22.147982+0000 mgr.gibba045.orlgmj (mgr.34412) 6319 : cluster [DBG] pgmap v3597: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:23.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:48:22 gibba045 bash[25517]: cluster 2021-03-10T15:48:22.147982+0000 mgr.gibba045.orlgmj (mgr.34412) 6319 : cluster [DBG] pgmap v3597: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:25.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:48:25 gibba015 bash[29377]: cluster 2021-03-10T15:48:24.148450+0000 mgr.gibba045.orlgmj (mgr.34412) 6320 : cluster [DBG] pgmap v3598: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:25.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:48:25 gibba015 bash[30343]: cluster 2021-03-10T15:48:24.148450+0000 mgr.gibba045.orlgmj (mgr.34412) 6320 : cluster [DBG] pgmap v3598: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:25.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:48:25 gibba045 bash[25517]: cluster 2021-03-10T15:48:24.148450+0000 mgr.gibba045.orlgmj (mgr.34412) 6320 : cluster [DBG] pgmap v3598: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:27.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:48:27 gibba015 bash[29377]: cluster 2021-03-10T15:48:26.149758+0000 mgr.gibba045.orlgmj (mgr.34412) 6321 : cluster [DBG] pgmap v3599: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:27.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:48:27 gibba015 bash[30343]: cluster 2021-03-10T15:48:26.149758+0000 mgr.gibba045.orlgmj (mgr.34412) 6321 : cluster [DBG] pgmap v3599: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:27.509 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:48:27.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:48:27 gibba045 bash[25517]: cluster 2021-03-10T15:48:26.149758+0000 mgr.gibba045.orlgmj (mgr.34412) 6321 : cluster [DBG] pgmap v3599: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:27.765 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:48:27.766 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (119m) 3m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:48:27.766 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 117s ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:48:27.766 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (119m) 117s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:48:27.767 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (119m) 117s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:48:27.767 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (118m) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:48:27.767 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (118m) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:48:27.767 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (118m) 117s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:48:27.767 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (118m) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:48:27.768 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 3m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:48:27.768 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 117s ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:48:27.768 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (117m) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:48:27.768 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (117m) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:48:27.768 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (116m) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:48:27.769 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (116m) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:48:27.769 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (115m) 117s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:48:27.769 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (115m) 117s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:48:27.769 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (114m) 117s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:48:27.769 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (114m) 117s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:48:27.770 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 117s ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:48:27.770 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 117s ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T15:48:28.017 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:48:28.017 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:48:28.017 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:48:28.017 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:48:28.018 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:48:28.018 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:48:28.018 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:48:28.018 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:48:28.019 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:48:28.019 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:48:28.019 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:48:28.019 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:48:28.019 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:48:28.019 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:48:28.020 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:48:28.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:48:28 gibba045 bash[25517]: audit 2021-03-10T15:48:28.014185+0000 mon.c (mon.1) 1768 : audit [DBG] from='client.? 172.21.2.115:0/234957124' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:48:28.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:48:28 gibba015 bash[29377]: audit 2021-03-10T15:48:28.014185+0000 mon.c (mon.1) 1768 : audit [DBG] from='client.? 172.21.2.115:0/234957124' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:48:28.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:48:28 gibba015 bash[30343]: audit 2021-03-10T15:48:28.014185+0000 mon.c (mon.1) 1768 : audit [DBG] from='client.? 172.21.2.115:0/234957124' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:48:29.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:48:29 gibba045 bash[25517]: audit 2021-03-10T15:48:27.502195+0000 mgr.gibba045.orlgmj (mgr.34412) 6322 : audit [DBG] from='client.58288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:48:29.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:48:29 gibba045 bash[25517]: audit 2021-03-10T15:48:27.723842+0000 mgr.gibba045.orlgmj (mgr.34412) 6323 : audit [DBG] from='client.58294 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:48:29.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:48:29 gibba045 bash[25517]: cluster 2021-03-10T15:48:28.151271+0000 mgr.gibba045.orlgmj (mgr.34412) 6324 : cluster [DBG] pgmap v3600: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:29.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:48:29 gibba015 bash[29377]: audit 2021-03-10T15:48:27.502195+0000 mgr.gibba045.orlgmj (mgr.34412) 6322 : audit [DBG] from='client.58288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:48:29.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:48:29 gibba015 bash[29377]: audit 2021-03-10T15:48:27.723842+0000 mgr.gibba045.orlgmj (mgr.34412) 6323 : audit [DBG] from='client.58294 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:48:29.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:48:29 gibba015 bash[29377]: cluster 2021-03-10T15:48:28.151271+0000 mgr.gibba045.orlgmj (mgr.34412) 6324 : cluster [DBG] pgmap v3600: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:29.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:48:29 gibba015 bash[30343]: audit 2021-03-10T15:48:27.502195+0000 mgr.gibba045.orlgmj (mgr.34412) 6322 : audit [DBG] from='client.58288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:48:29.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:48:29 gibba015 bash[30343]: audit 2021-03-10T15:48:27.723842+0000 mgr.gibba045.orlgmj (mgr.34412) 6323 : audit [DBG] from='client.58294 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:48:29.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:48:29 gibba015 bash[30343]: cluster 2021-03-10T15:48:28.151271+0000 mgr.gibba045.orlgmj (mgr.34412) 6324 : cluster [DBG] pgmap v3600: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:31.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:48:30 gibba015 bash[29377]: cluster 2021-03-10T15:48:30.152042+0000 mgr.gibba045.orlgmj (mgr.34412) 6325 : cluster [DBG] pgmap v3601: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:31.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:48:30 gibba015 bash[30343]: cluster 2021-03-10T15:48:30.152042+0000 mgr.gibba045.orlgmj (mgr.34412) 6325 : cluster [DBG] pgmap v3601: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:31.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:48:30 gibba045 bash[25517]: cluster 2021-03-10T15:48:30.152042+0000 mgr.gibba045.orlgmj (mgr.34412) 6325 : cluster [DBG] pgmap v3601: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:33.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:48:33 gibba015 bash[29377]: cluster 2021-03-10T15:48:32.153608+0000 mgr.gibba045.orlgmj (mgr.34412) 6326 : cluster [DBG] pgmap v3602: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:33.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:48:33 gibba015 bash[30343]: cluster 2021-03-10T15:48:32.153608+0000 mgr.gibba045.orlgmj (mgr.34412) 6326 : cluster [DBG] pgmap v3602: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:33.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:48:33 gibba045 bash[25517]: cluster 2021-03-10T15:48:32.153608+0000 mgr.gibba045.orlgmj (mgr.34412) 6326 : cluster [DBG] pgmap v3602: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:35.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:48:35 gibba045 bash[25517]: cluster 2021-03-10T15:48:34.154892+0000 mgr.gibba045.orlgmj (mgr.34412) 6327 : cluster [DBG] pgmap v3603: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:35.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:48:35 gibba015 bash[29377]: cluster 2021-03-10T15:48:34.154892+0000 mgr.gibba045.orlgmj (mgr.34412) 6327 : cluster [DBG] pgmap v3603: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:35.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:48:35 gibba015 bash[30343]: cluster 2021-03-10T15:48:34.154892+0000 mgr.gibba045.orlgmj (mgr.34412) 6327 : cluster [DBG] pgmap v3603: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:36.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:48:36 gibba045 bash[25517]: audit 2021-03-10T15:48:35.836189+0000 mon.c (mon.1) 1769 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:48:36.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:48:36 gibba045 bash[25517]: audit 2021-03-10T15:48:36.065116+0000 mon.a (mon.0) 1559 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:48:36.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:48:36 gibba045 bash[25517]: audit 2021-03-10T15:48:36.068498+0000 mon.c (mon.1) 1770 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:48:36.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:48:36 gibba045 bash[25517]: audit 2021-03-10T15:48:36.069810+0000 mon.c (mon.1) 1771 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:48:36.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:48:36 gibba045 bash[25517]: audit 2021-03-10T15:48:36.071157+0000 mon.c (mon.1) 1772 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:48:36.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:48:36 gibba045 bash[25517]: audit 2021-03-10T15:48:36.072242+0000 mon.c (mon.1) 1773 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:48:36.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:48:36 gibba045 bash[25517]: audit 2021-03-10T15:48:36.075419+0000 mon.c (mon.1) 1774 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:48:36.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:48:36 gibba045 bash[25517]: audit 2021-03-10T15:48:36.076957+0000 mon.c (mon.1) 1775 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:48:36.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:48:36 gibba015 bash[29377]: audit 2021-03-10T15:48:35.836189+0000 mon.c (mon.1) 1769 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:48:36.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:48:36 gibba015 bash[29377]: audit 2021-03-10T15:48:36.065116+0000 mon.a (mon.0) 1559 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:48:36.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:48:36 gibba015 bash[29377]: audit 2021-03-10T15:48:36.068498+0000 mon.c (mon.1) 1770 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:48:36.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:48:36 gibba015 bash[29377]: audit 2021-03-10T15:48:36.069810+0000 mon.c (mon.1) 1771 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:48:36.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:48:36 gibba015 bash[29377]: audit 2021-03-10T15:48:36.071157+0000 mon.c (mon.1) 1772 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:48:36.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:48:36 gibba015 bash[29377]: audit 2021-03-10T15:48:36.072242+0000 mon.c (mon.1) 1773 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:48:36.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:48:36 gibba015 bash[29377]: audit 2021-03-10T15:48:36.075419+0000 mon.c (mon.1) 1774 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:48:36.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:48:36 gibba015 bash[29377]: audit 2021-03-10T15:48:36.076957+0000 mon.c (mon.1) 1775 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:48:36.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:48:36 gibba015 bash[30343]: audit 2021-03-10T15:48:35.836189+0000 mon.c (mon.1) 1769 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:48:36.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:48:36 gibba015 bash[30343]: audit 2021-03-10T15:48:36.065116+0000 mon.a (mon.0) 1559 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:48:36.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:48:36 gibba015 bash[30343]: audit 2021-03-10T15:48:36.068498+0000 mon.c (mon.1) 1770 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:48:36.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:48:36 gibba015 bash[30343]: audit 2021-03-10T15:48:36.069810+0000 mon.c (mon.1) 1771 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:48:36.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:48:36 gibba015 bash[30343]: audit 2021-03-10T15:48:36.071157+0000 mon.c (mon.1) 1772 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:48:36.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:48:36 gibba015 bash[30343]: audit 2021-03-10T15:48:36.072242+0000 mon.c (mon.1) 1773 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:48:36.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:48:36 gibba015 bash[30343]: audit 2021-03-10T15:48:36.075419+0000 mon.c (mon.1) 1774 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:48:36.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:48:36 gibba015 bash[30343]: audit 2021-03-10T15:48:36.076957+0000 mon.c (mon.1) 1775 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:48:37.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:48:37 gibba045 bash[25517]: cephadm 2021-03-10T15:48:35.844732+0000 mgr.gibba045.orlgmj (mgr.34412) 6328 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:48:37.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:48:37 gibba045 bash[25517]: cephadm 2021-03-10T15:48:35.846621+0000 mgr.gibba045.orlgmj (mgr.34412) 6329 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:48:37.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:48:37 gibba045 bash[25517]: cephadm 2021-03-10T15:48:36.070825+0000 mgr.gibba045.orlgmj (mgr.34412) 6330 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:48:37.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:48:37 gibba045 bash[25517]: cephadm 2021-03-10T15:48:36.072356+0000 mgr.gibba045.orlgmj (mgr.34412) 6331 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:48:37.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:48:37 gibba045 bash[25517]: cephadm 2021-03-10T15:48:36.073633+0000 mgr.gibba045.orlgmj (mgr.34412) 6332 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:48:37.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:48:37 gibba045 bash[25517]: cephadm 2021-03-10T15:48:36.073669+0000 mgr.gibba045.orlgmj (mgr.34412) 6333 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:48:37.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:48:37 gibba045 bash[25517]: cephadm 2021-03-10T15:48:36.074836+0000 mgr.gibba045.orlgmj (mgr.34412) 6334 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:48:37.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:48:37 gibba045 bash[25517]: cephadm 2021-03-10T15:48:36.074873+0000 mgr.gibba045.orlgmj (mgr.34412) 6335 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:48:37.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:48:37 gibba045 bash[25517]: cephadm 2021-03-10T15:48:36.076154+0000 mgr.gibba045.orlgmj (mgr.34412) 6336 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:48:37.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:48:37 gibba045 bash[25517]: cephadm 2021-03-10T15:48:36.077868+0000 mgr.gibba045.orlgmj (mgr.34412) 6337 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:48:37.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:48:37 gibba045 bash[25517]: cephadm 2021-03-10T15:48:36.077904+0000 mgr.gibba045.orlgmj (mgr.34412) 6338 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:48:37.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:48:37 gibba045 bash[25517]: cephadm 2021-03-10T15:48:36.079249+0000 mgr.gibba045.orlgmj (mgr.34412) 6339 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:48:37.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:48:37 gibba045 bash[25517]: cephadm 2021-03-10T15:48:36.079597+0000 mgr.gibba045.orlgmj (mgr.34412) 6340 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:48:37.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:48:37 gibba045 bash[25517]: cephadm 2021-03-10T15:48:36.080722+0000 mgr.gibba045.orlgmj (mgr.34412) 6341 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:48:37.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:48:37 gibba045 bash[25517]: cephadm 2021-03-10T15:48:36.080761+0000 mgr.gibba045.orlgmj (mgr.34412) 6342 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:48:37.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:48:37 gibba045 bash[25517]: cephadm 2021-03-10T15:48:36.080869+0000 mgr.gibba045.orlgmj (mgr.34412) 6343 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:48:37.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:48:37 gibba045 bash[25517]: cluster 2021-03-10T15:48:36.156143+0000 mgr.gibba045.orlgmj (mgr.34412) 6344 : cluster [DBG] pgmap v3604: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:37.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:48:37 gibba015 bash[29377]: cephadm 2021-03-10T15:48:35.844732+0000 mgr.gibba045.orlgmj (mgr.34412) 6328 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:48:37.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:48:37 gibba015 bash[29377]: cephadm 2021-03-10T15:48:35.846621+0000 mgr.gibba045.orlgmj (mgr.34412) 6329 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:48:37.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:48:37 gibba015 bash[29377]: cephadm 2021-03-10T15:48:36.070825+0000 mgr.gibba045.orlgmj (mgr.34412) 6330 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:48:37.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:48:37 gibba015 bash[29377]: cephadm 2021-03-10T15:48:36.072356+0000 mgr.gibba045.orlgmj (mgr.34412) 6331 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:48:37.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:48:37 gibba015 bash[29377]: cephadm 2021-03-10T15:48:36.073633+0000 mgr.gibba045.orlgmj (mgr.34412) 6332 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:48:37.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:48:37 gibba015 bash[29377]: cephadm 2021-03-10T15:48:36.073669+0000 mgr.gibba045.orlgmj (mgr.34412) 6333 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:48:37.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:48:37 gibba015 bash[29377]: cephadm 2021-03-10T15:48:36.074836+0000 mgr.gibba045.orlgmj (mgr.34412) 6334 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:48:37.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:48:37 gibba015 bash[29377]: cephadm 2021-03-10T15:48:36.074873+0000 mgr.gibba045.orlgmj (mgr.34412) 6335 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:48:37.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:48:37 gibba015 bash[29377]: cephadm 2021-03-10T15:48:36.076154+0000 mgr.gibba045.orlgmj (mgr.34412) 6336 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:48:37.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:48:37 gibba015 bash[29377]: cephadm 2021-03-10T15:48:36.077868+0000 mgr.gibba045.orlgmj (mgr.34412) 6337 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:48:37.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:48:37 gibba015 bash[29377]: cephadm 2021-03-10T15:48:36.077904+0000 mgr.gibba045.orlgmj (mgr.34412) 6338 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:48:37.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:48:37 gibba015 bash[29377]: cephadm 2021-03-10T15:48:36.079249+0000 mgr.gibba045.orlgmj (mgr.34412) 6339 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:48:37.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:48:37 gibba015 bash[29377]: cephadm 2021-03-10T15:48:36.079597+0000 mgr.gibba045.orlgmj (mgr.34412) 6340 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:48:37.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:48:37 gibba015 bash[29377]: cephadm 2021-03-10T15:48:36.080722+0000 mgr.gibba045.orlgmj (mgr.34412) 6341 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:48:37.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:48:37 gibba015 bash[29377]: cephadm 2021-03-10T15:48:36.080761+0000 mgr.gibba045.orlgmj (mgr.34412) 6342 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:48:37.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:48:37 gibba015 bash[29377]: cephadm 2021-03-10T15:48:36.080869+0000 mgr.gibba045.orlgmj (mgr.34412) 6343 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:48:37.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:48:37 gibba015 bash[29377]: cluster 2021-03-10T15:48:36.156143+0000 mgr.gibba045.orlgmj (mgr.34412) 6344 : cluster [DBG] pgmap v3604: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:37.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:48:37 gibba015 bash[30343]: cephadm 2021-03-10T15:48:35.844732+0000 mgr.gibba045.orlgmj (mgr.34412) 6328 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:48:37.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:48:37 gibba015 bash[30343]: cephadm 2021-03-10T15:48:35.846621+0000 mgr.gibba045.orlgmj (mgr.34412) 6329 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:48:37.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:48:37 gibba015 bash[30343]: cephadm 2021-03-10T15:48:36.070825+0000 mgr.gibba045.orlgmj (mgr.34412) 6330 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:48:37.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:48:37 gibba015 bash[30343]: cephadm 2021-03-10T15:48:36.072356+0000 mgr.gibba045.orlgmj (mgr.34412) 6331 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:48:37.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:48:37 gibba015 bash[30343]: cephadm 2021-03-10T15:48:36.073633+0000 mgr.gibba045.orlgmj (mgr.34412) 6332 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:48:37.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:48:37 gibba015 bash[30343]: cephadm 2021-03-10T15:48:36.073669+0000 mgr.gibba045.orlgmj (mgr.34412) 6333 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:48:37.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:48:37 gibba015 bash[30343]: cephadm 2021-03-10T15:48:36.074836+0000 mgr.gibba045.orlgmj (mgr.34412) 6334 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:48:37.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:48:37 gibba015 bash[30343]: cephadm 2021-03-10T15:48:36.074873+0000 mgr.gibba045.orlgmj (mgr.34412) 6335 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:48:37.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:48:37 gibba015 bash[30343]: cephadm 2021-03-10T15:48:36.076154+0000 mgr.gibba045.orlgmj (mgr.34412) 6336 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:48:37.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:48:37 gibba015 bash[30343]: cephadm 2021-03-10T15:48:36.077868+0000 mgr.gibba045.orlgmj (mgr.34412) 6337 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:48:37.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:48:37 gibba015 bash[30343]: cephadm 2021-03-10T15:48:36.077904+0000 mgr.gibba045.orlgmj (mgr.34412) 6338 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:48:37.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:48:37 gibba015 bash[30343]: cephadm 2021-03-10T15:48:36.079249+0000 mgr.gibba045.orlgmj (mgr.34412) 6339 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:48:37.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:48:37 gibba015 bash[30343]: cephadm 2021-03-10T15:48:36.079597+0000 mgr.gibba045.orlgmj (mgr.34412) 6340 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:48:37.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:48:37 gibba015 bash[30343]: cephadm 2021-03-10T15:48:36.080722+0000 mgr.gibba045.orlgmj (mgr.34412) 6341 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:48:37.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:48:37 gibba015 bash[30343]: cephadm 2021-03-10T15:48:36.080761+0000 mgr.gibba045.orlgmj (mgr.34412) 6342 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:48:37.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:48:37 gibba015 bash[30343]: cephadm 2021-03-10T15:48:36.080869+0000 mgr.gibba045.orlgmj (mgr.34412) 6343 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:48:37.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:48:37 gibba015 bash[30343]: cluster 2021-03-10T15:48:36.156143+0000 mgr.gibba045.orlgmj (mgr.34412) 6344 : cluster [DBG] pgmap v3604: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:39.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:48:39 gibba045 bash[25517]: cluster 2021-03-10T15:48:38.157763+0000 mgr.gibba045.orlgmj (mgr.34412) 6345 : cluster [DBG] pgmap v3605: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:39.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:48:39 gibba015 bash[29377]: cluster 2021-03-10T15:48:38.157763+0000 mgr.gibba045.orlgmj (mgr.34412) 6345 : cluster [DBG] pgmap v3605: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:39.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:48:39 gibba015 bash[30343]: cluster 2021-03-10T15:48:38.157763+0000 mgr.gibba045.orlgmj (mgr.34412) 6345 : cluster [DBG] pgmap v3605: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:41.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:48:40 gibba015 bash[29377]: cluster 2021-03-10T15:48:40.159508+0000 mgr.gibba045.orlgmj (mgr.34412) 6346 : cluster [DBG] pgmap v3606: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:41.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:48:40 gibba015 bash[30343]: cluster 2021-03-10T15:48:40.159508+0000 mgr.gibba045.orlgmj (mgr.34412) 6346 : cluster [DBG] pgmap v3606: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:41.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:48:40 gibba045 bash[25517]: cluster 2021-03-10T15:48:40.159508+0000 mgr.gibba045.orlgmj (mgr.34412) 6346 : cluster [DBG] pgmap v3606: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:43.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:48:43 gibba045 bash[25517]: cluster 2021-03-10T15:48:42.160408+0000 mgr.gibba045.orlgmj (mgr.34412) 6347 : cluster [DBG] pgmap v3607: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:43.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:48:43 gibba015 bash[29377]: cluster 2021-03-10T15:48:42.160408+0000 mgr.gibba045.orlgmj (mgr.34412) 6347 : cluster [DBG] pgmap v3607: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:43.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:48:43 gibba015 bash[30343]: cluster 2021-03-10T15:48:42.160408+0000 mgr.gibba045.orlgmj (mgr.34412) 6347 : cluster [DBG] pgmap v3607: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:45.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:48:45 gibba045 bash[25517]: cluster 2021-03-10T15:48:44.161529+0000 mgr.gibba045.orlgmj (mgr.34412) 6348 : cluster [DBG] pgmap v3608: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:45.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:48:45 gibba015 bash[29377]: cluster 2021-03-10T15:48:44.161529+0000 mgr.gibba045.orlgmj (mgr.34412) 6348 : cluster [DBG] pgmap v3608: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:45.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:48:45 gibba015 bash[30343]: cluster 2021-03-10T15:48:44.161529+0000 mgr.gibba045.orlgmj (mgr.34412) 6348 : cluster [DBG] pgmap v3608: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:47.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:48:47 gibba045 bash[25517]: cluster 2021-03-10T15:48:46.163313+0000 mgr.gibba045.orlgmj (mgr.34412) 6349 : cluster [DBG] pgmap v3609: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:47.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:48:47 gibba015 bash[29377]: cluster 2021-03-10T15:48:46.163313+0000 mgr.gibba045.orlgmj (mgr.34412) 6349 : cluster [DBG] pgmap v3609: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:47.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:48:47 gibba015 bash[30343]: cluster 2021-03-10T15:48:46.163313+0000 mgr.gibba045.orlgmj (mgr.34412) 6349 : cluster [DBG] pgmap v3609: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:49.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:48:49 gibba045 bash[25517]: cluster 2021-03-10T15:48:48.164225+0000 mgr.gibba045.orlgmj (mgr.34412) 6350 : cluster [DBG] pgmap v3610: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:49.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:48:49 gibba015 bash[29377]: cluster 2021-03-10T15:48:48.164225+0000 mgr.gibba045.orlgmj (mgr.34412) 6350 : cluster [DBG] pgmap v3610: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:49.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:48:49 gibba015 bash[30343]: cluster 2021-03-10T15:48:48.164225+0000 mgr.gibba045.orlgmj (mgr.34412) 6350 : cluster [DBG] pgmap v3610: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:51.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:48:50 gibba015 bash[29377]: cluster 2021-03-10T15:48:50.165266+0000 mgr.gibba045.orlgmj (mgr.34412) 6351 : cluster [DBG] pgmap v3611: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:51.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:48:50 gibba015 bash[30343]: cluster 2021-03-10T15:48:50.165266+0000 mgr.gibba045.orlgmj (mgr.34412) 6351 : cluster [DBG] pgmap v3611: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:51.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:48:50 gibba045 bash[25517]: cluster 2021-03-10T15:48:50.165266+0000 mgr.gibba045.orlgmj (mgr.34412) 6351 : cluster [DBG] pgmap v3611: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:52.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:48:51 gibba015 bash[29377]: cephadm 2021-03-10T15:48:51.096928+0000 mgr.gibba045.orlgmj (mgr.34412) 6352 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:48:52.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:48:51 gibba015 bash[30343]: cephadm 2021-03-10T15:48:51.096928+0000 mgr.gibba045.orlgmj (mgr.34412) 6352 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:48:52.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:48:51 gibba045 bash[25517]: cephadm 2021-03-10T15:48:51.096928+0000 mgr.gibba045.orlgmj (mgr.34412) 6352 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:48:53.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:48:52 gibba015 bash[29377]: cluster 2021-03-10T15:48:52.166979+0000 mgr.gibba045.orlgmj (mgr.34412) 6353 : cluster [DBG] pgmap v3612: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:53.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:48:52 gibba015 bash[30343]: cluster 2021-03-10T15:48:52.166979+0000 mgr.gibba045.orlgmj (mgr.34412) 6353 : cluster [DBG] pgmap v3612: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:53.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:48:52 gibba045 bash[25517]: cluster 2021-03-10T15:48:52.166979+0000 mgr.gibba045.orlgmj (mgr.34412) 6353 : cluster [DBG] pgmap v3612: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:54.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:48:53 gibba015 bash[29377]: audit 2021-03-10T15:48:53.292307+0000 mon.c (mon.1) 1776 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:48:54.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:48:53 gibba015 bash[29377]: audit 2021-03-10T15:48:53.292979+0000 mon.c (mon.1) 1777 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:48:54.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:48:53 gibba015 bash[29377]: audit 2021-03-10T15:48:53.293602+0000 mon.a (mon.0) 1560 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:48:54.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:48:53 gibba015 bash[29377]: audit 2021-03-10T15:48:53.294865+0000 mon.a (mon.0) 1561 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:48:54.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:48:53 gibba015 bash[29377]: audit 2021-03-10T15:48:53.307018+0000 mon.c (mon.1) 1778 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T15:48:54.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:48:53 gibba015 bash[29377]: audit 2021-03-10T15:48:53.307781+0000 mon.c (mon.1) 1779 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:48:54.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:48:53 gibba015 bash[29377]: audit 2021-03-10T15:48:53.308346+0000 mon.a (mon.0) 1562 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T15:48:54.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:48:53 gibba015 bash[29377]: audit 2021-03-10T15:48:53.308472+0000 mon.c (mon.1) 1780 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:48:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:48:53 gibba015 bash[29377]: audit 2021-03-10T15:48:53.309156+0000 mon.c (mon.1) 1781 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T15:48:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:48:53 gibba015 bash[29377]: audit 2021-03-10T15:48:53.310603+0000 mon.a (mon.0) 1563 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:48:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:48:53 gibba015 bash[29377]: audit 2021-03-10T15:48:53.311542+0000 mon.a (mon.0) 1564 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:48:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:48:53 gibba015 bash[29377]: audit 2021-03-10T15:48:53.312454+0000 mon.a (mon.0) 1565 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T15:48:54.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:48:53 gibba015 bash[30343]: audit 2021-03-10T15:48:53.292307+0000 mon.c (mon.1) 1776 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:48:54.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:48:53 gibba015 bash[30343]: audit 2021-03-10T15:48:53.292979+0000 mon.c (mon.1) 1777 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:48:54.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:48:53 gibba015 bash[30343]: audit 2021-03-10T15:48:53.293602+0000 mon.a (mon.0) 1560 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:48:54.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:48:53 gibba015 bash[30343]: audit 2021-03-10T15:48:53.294865+0000 mon.a (mon.0) 1561 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:48:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:48:53 gibba015 bash[30343]: audit 2021-03-10T15:48:53.307018+0000 mon.c (mon.1) 1778 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T15:48:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:48:53 gibba015 bash[30343]: audit 2021-03-10T15:48:53.307781+0000 mon.c (mon.1) 1779 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:48:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:48:53 gibba015 bash[30343]: audit 2021-03-10T15:48:53.308346+0000 mon.a (mon.0) 1562 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T15:48:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:48:53 gibba015 bash[30343]: audit 2021-03-10T15:48:53.308472+0000 mon.c (mon.1) 1780 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:48:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:48:53 gibba015 bash[30343]: audit 2021-03-10T15:48:53.309156+0000 mon.c (mon.1) 1781 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T15:48:54.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:48:53 gibba015 bash[30343]: audit 2021-03-10T15:48:53.310603+0000 mon.a (mon.0) 1563 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:48:54.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:48:53 gibba015 bash[30343]: audit 2021-03-10T15:48:53.311542+0000 mon.a (mon.0) 1564 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:48:54.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:48:53 gibba015 bash[30343]: audit 2021-03-10T15:48:53.312454+0000 mon.a (mon.0) 1565 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T15:48:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:48:53 gibba045 bash[25517]: audit 2021-03-10T15:48:53.292307+0000 mon.c (mon.1) 1776 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:48:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:48:53 gibba045 bash[25517]: audit 2021-03-10T15:48:53.292979+0000 mon.c (mon.1) 1777 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:48:54.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:48:53 gibba045 bash[25517]: audit 2021-03-10T15:48:53.293602+0000 mon.a (mon.0) 1560 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:48:54.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:48:53 gibba045 bash[25517]: audit 2021-03-10T15:48:53.294865+0000 mon.a (mon.0) 1561 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:48:54.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:48:53 gibba045 bash[25517]: audit 2021-03-10T15:48:53.307018+0000 mon.c (mon.1) 1778 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T15:48:54.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:48:53 gibba045 bash[25517]: audit 2021-03-10T15:48:53.307781+0000 mon.c (mon.1) 1779 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:48:54.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:48:53 gibba045 bash[25517]: audit 2021-03-10T15:48:53.308346+0000 mon.a (mon.0) 1562 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T15:48:54.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:48:53 gibba045 bash[25517]: audit 2021-03-10T15:48:53.308472+0000 mon.c (mon.1) 1780 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:48:54.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:48:53 gibba045 bash[25517]: audit 2021-03-10T15:48:53.309156+0000 mon.c (mon.1) 1781 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T15:48:54.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:48:53 gibba045 bash[25517]: audit 2021-03-10T15:48:53.310603+0000 mon.a (mon.0) 1563 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:48:54.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:48:53 gibba045 bash[25517]: audit 2021-03-10T15:48:53.311542+0000 mon.a (mon.0) 1564 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:48:54.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:48:53 gibba045 bash[25517]: audit 2021-03-10T15:48:53.312454+0000 mon.a (mon.0) 1565 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T15:48:55.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:48:54 gibba015 bash[29377]: cluster 2021-03-10T15:48:54.167559+0000 mgr.gibba045.orlgmj (mgr.34412) 6354 : cluster [DBG] pgmap v3613: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:55.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:48:54 gibba015 bash[30343]: cluster 2021-03-10T15:48:54.167559+0000 mgr.gibba045.orlgmj (mgr.34412) 6354 : cluster [DBG] pgmap v3613: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:55.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:48:54 gibba045 bash[25517]: cluster 2021-03-10T15:48:54.167559+0000 mgr.gibba045.orlgmj (mgr.34412) 6354 : cluster [DBG] pgmap v3613: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:57.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:48:57 gibba045 bash[25517]: cluster 2021-03-10T15:48:56.169293+0000 mgr.gibba045.orlgmj (mgr.34412) 6355 : cluster [DBG] pgmap v3614: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:57.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:48:57 gibba015 bash[29377]: cluster 2021-03-10T15:48:56.169293+0000 mgr.gibba045.orlgmj (mgr.34412) 6355 : cluster [DBG] pgmap v3614: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:57.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:48:57 gibba015 bash[30343]: cluster 2021-03-10T15:48:56.169293+0000 mgr.gibba045.orlgmj (mgr.34412) 6355 : cluster [DBG] pgmap v3614: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:58.256 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:48:58.483 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:48:58.484 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (119m) 3m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:48:58.484 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 2m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:48:58.484 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:48:58.484 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:48:58.485 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (119m) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:48:58.485 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (119m) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:48:58.485 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (118m) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:48:58.485 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (118m) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:48:58.485 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 3m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:48:58.486 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 2m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:48:58.486 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (118m) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:48:58.486 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (117m) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:48:58.486 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (117m) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:48:58.487 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (116m) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:48:58.487 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (116m) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:48:58.487 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (115m) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:48:58.487 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (115m) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:48:58.487 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (114m) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:48:58.488 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 2m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:48:58.488 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 2m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T15:48:58.731 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:48:58.731 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:48:58.732 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:48:58.732 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:48:58.732 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:48:58.732 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:48:58.733 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:48:58.733 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:48:58.733 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:48:58.733 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:48:58.733 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:48:58.734 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:48:58.734 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:48:58.734 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:48:58.734 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:48:59.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:48:59 gibba045 bash[25517]: cluster 2021-03-10T15:48:58.170923+0000 mgr.gibba045.orlgmj (mgr.34412) 6356 : cluster [DBG] pgmap v3615: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:59.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:48:59 gibba045 bash[25517]: audit 2021-03-10T15:48:58.248765+0000 mgr.gibba045.orlgmj (mgr.34412) 6357 : audit [DBG] from='client.48318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:48:59.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:48:59 gibba045 bash[25517]: audit 2021-03-10T15:48:58.471302+0000 mgr.gibba045.orlgmj (mgr.34412) 6358 : audit [DBG] from='client.48324 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:48:59.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:48:59 gibba045 bash[25517]: audit 2021-03-10T15:48:58.728760+0000 mon.a (mon.0) 1566 : audit [DBG] from='client.? 172.21.2.115:0/2560582178' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:48:59.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:48:59 gibba015 bash[29377]: cluster 2021-03-10T15:48:58.170923+0000 mgr.gibba045.orlgmj (mgr.34412) 6356 : cluster [DBG] pgmap v3615: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:59.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:48:59 gibba015 bash[29377]: audit 2021-03-10T15:48:58.248765+0000 mgr.gibba045.orlgmj (mgr.34412) 6357 : audit [DBG] from='client.48318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:48:59.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:48:59 gibba015 bash[29377]: audit 2021-03-10T15:48:58.471302+0000 mgr.gibba045.orlgmj (mgr.34412) 6358 : audit [DBG] from='client.48324 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:48:59.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:48:59 gibba015 bash[29377]: audit 2021-03-10T15:48:58.728760+0000 mon.a (mon.0) 1566 : audit [DBG] from='client.? 172.21.2.115:0/2560582178' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:48:59.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:48:59 gibba015 bash[30343]: cluster 2021-03-10T15:48:58.170923+0000 mgr.gibba045.orlgmj (mgr.34412) 6356 : cluster [DBG] pgmap v3615: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:59.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:48:59 gibba015 bash[30343]: audit 2021-03-10T15:48:58.248765+0000 mgr.gibba045.orlgmj (mgr.34412) 6357 : audit [DBG] from='client.48318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:48:59.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:48:59 gibba015 bash[30343]: audit 2021-03-10T15:48:58.471302+0000 mgr.gibba045.orlgmj (mgr.34412) 6358 : audit [DBG] from='client.48324 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:48:59.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:48:59 gibba015 bash[30343]: audit 2021-03-10T15:48:58.728760+0000 mon.a (mon.0) 1566 : audit [DBG] from='client.? 172.21.2.115:0/2560582178' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:49:01.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:49:00 gibba015 bash[29377]: cluster 2021-03-10T15:49:00.171804+0000 mgr.gibba045.orlgmj (mgr.34412) 6359 : cluster [DBG] pgmap v3616: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:01.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:49:00 gibba015 bash[30343]: cluster 2021-03-10T15:49:00.171804+0000 mgr.gibba045.orlgmj (mgr.34412) 6359 : cluster [DBG] pgmap v3616: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:01.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:49:00 gibba045 bash[25517]: cluster 2021-03-10T15:49:00.171804+0000 mgr.gibba045.orlgmj (mgr.34412) 6359 : cluster [DBG] pgmap v3616: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:03.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:49:03 gibba045 bash[25517]: cluster 2021-03-10T15:49:02.173498+0000 mgr.gibba045.orlgmj (mgr.34412) 6360 : cluster [DBG] pgmap v3617: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:03.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:49:03 gibba015 bash[29377]: cluster 2021-03-10T15:49:02.173498+0000 mgr.gibba045.orlgmj (mgr.34412) 6360 : cluster [DBG] pgmap v3617: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:03.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:49:03 gibba015 bash[30343]: cluster 2021-03-10T15:49:02.173498+0000 mgr.gibba045.orlgmj (mgr.34412) 6360 : cluster [DBG] pgmap v3617: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:05.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:49:05 gibba045 bash[25517]: cluster 2021-03-10T15:49:04.174720+0000 mgr.gibba045.orlgmj (mgr.34412) 6361 : cluster [DBG] pgmap v3618: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:05.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:49:05 gibba015 bash[29377]: cluster 2021-03-10T15:49:04.174720+0000 mgr.gibba045.orlgmj (mgr.34412) 6361 : cluster [DBG] pgmap v3618: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:05.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:49:05 gibba015 bash[30343]: cluster 2021-03-10T15:49:04.174720+0000 mgr.gibba045.orlgmj (mgr.34412) 6361 : cluster [DBG] pgmap v3618: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:07.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:49:07 gibba045 bash[25517]: cephadm 2021-03-10T15:49:06.112753+0000 mgr.gibba045.orlgmj (mgr.34412) 6362 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:49:07.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:49:07 gibba045 bash[25517]: cluster 2021-03-10T15:49:06.175653+0000 mgr.gibba045.orlgmj (mgr.34412) 6363 : cluster [DBG] pgmap v3619: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:07.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:49:07 gibba015 bash[29377]: cephadm 2021-03-10T15:49:06.112753+0000 mgr.gibba045.orlgmj (mgr.34412) 6362 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:49:07.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:49:07 gibba015 bash[29377]: cluster 2021-03-10T15:49:06.175653+0000 mgr.gibba045.orlgmj (mgr.34412) 6363 : cluster [DBG] pgmap v3619: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:07.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:49:07 gibba015 bash[30343]: cephadm 2021-03-10T15:49:06.112753+0000 mgr.gibba045.orlgmj (mgr.34412) 6362 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:49:07.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:49:07 gibba015 bash[30343]: cluster 2021-03-10T15:49:06.175653+0000 mgr.gibba045.orlgmj (mgr.34412) 6363 : cluster [DBG] pgmap v3619: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:09.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:49:09 gibba045 bash[25517]: cluster 2021-03-10T15:49:08.177227+0000 mgr.gibba045.orlgmj (mgr.34412) 6364 : cluster [DBG] pgmap v3620: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:09.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:49:09 gibba015 bash[29377]: cluster 2021-03-10T15:49:08.177227+0000 mgr.gibba045.orlgmj (mgr.34412) 6364 : cluster [DBG] pgmap v3620: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:09.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:49:09 gibba015 bash[30343]: cluster 2021-03-10T15:49:08.177227+0000 mgr.gibba045.orlgmj (mgr.34412) 6364 : cluster [DBG] pgmap v3620: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:11.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:49:10 gibba015 bash[29377]: cluster 2021-03-10T15:49:10.178909+0000 mgr.gibba045.orlgmj (mgr.34412) 6365 : cluster [DBG] pgmap v3621: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:11.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:49:10 gibba015 bash[30343]: cluster 2021-03-10T15:49:10.178909+0000 mgr.gibba045.orlgmj (mgr.34412) 6365 : cluster [DBG] pgmap v3621: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:11.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:49:10 gibba045 bash[25517]: cluster 2021-03-10T15:49:10.178909+0000 mgr.gibba045.orlgmj (mgr.34412) 6365 : cluster [DBG] pgmap v3621: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:13.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:49:13 gibba045 bash[25517]: cluster 2021-03-10T15:49:12.179649+0000 mgr.gibba045.orlgmj (mgr.34412) 6366 : cluster [DBG] pgmap v3622: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:13.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:49:13 gibba015 bash[29377]: cluster 2021-03-10T15:49:12.179649+0000 mgr.gibba045.orlgmj (mgr.34412) 6366 : cluster [DBG] pgmap v3622: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:13.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:49:13 gibba015 bash[30343]: cluster 2021-03-10T15:49:12.179649+0000 mgr.gibba045.orlgmj (mgr.34412) 6366 : cluster [DBG] pgmap v3622: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:15.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:49:15 gibba045 bash[25517]: cluster 2021-03-10T15:49:14.180797+0000 mgr.gibba045.orlgmj (mgr.34412) 6367 : cluster [DBG] pgmap v3623: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:15.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:49:15 gibba015 bash[29377]: cluster 2021-03-10T15:49:14.180797+0000 mgr.gibba045.orlgmj (mgr.34412) 6367 : cluster [DBG] pgmap v3623: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:15.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:49:15 gibba015 bash[30343]: cluster 2021-03-10T15:49:14.180797+0000 mgr.gibba045.orlgmj (mgr.34412) 6367 : cluster [DBG] pgmap v3623: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:17.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:49:17 gibba045 bash[25517]: cluster 2021-03-10T15:49:16.182540+0000 mgr.gibba045.orlgmj (mgr.34412) 6368 : cluster [DBG] pgmap v3624: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:17.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:49:17 gibba015 bash[29377]: cluster 2021-03-10T15:49:16.182540+0000 mgr.gibba045.orlgmj (mgr.34412) 6368 : cluster [DBG] pgmap v3624: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:17.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:49:17 gibba015 bash[30343]: cluster 2021-03-10T15:49:16.182540+0000 mgr.gibba045.orlgmj (mgr.34412) 6368 : cluster [DBG] pgmap v3624: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:19.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:49:19 gibba045 bash[25517]: cluster 2021-03-10T15:49:18.183524+0000 mgr.gibba045.orlgmj (mgr.34412) 6369 : cluster [DBG] pgmap v3625: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:19.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:49:19 gibba015 bash[29377]: cluster 2021-03-10T15:49:18.183524+0000 mgr.gibba045.orlgmj (mgr.34412) 6369 : cluster [DBG] pgmap v3625: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:19.778 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:49:19 gibba015 bash[30343]: cluster 2021-03-10T15:49:18.183524+0000 mgr.gibba045.orlgmj (mgr.34412) 6369 : cluster [DBG] pgmap v3625: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:21.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:49:20 gibba015 bash[29377]: cluster 2021-03-10T15:49:20.185053+0000 mgr.gibba045.orlgmj (mgr.34412) 6370 : cluster [DBG] pgmap v3626: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:21.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:49:20 gibba015 bash[30343]: cluster 2021-03-10T15:49:20.185053+0000 mgr.gibba045.orlgmj (mgr.34412) 6370 : cluster [DBG] pgmap v3626: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:21.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:49:20 gibba045 bash[25517]: cluster 2021-03-10T15:49:20.185053+0000 mgr.gibba045.orlgmj (mgr.34412) 6370 : cluster [DBG] pgmap v3626: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:22.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:49:21 gibba015 bash[29377]: cephadm 2021-03-10T15:49:21.128835+0000 mgr.gibba045.orlgmj (mgr.34412) 6371 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:49:22.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:49:21 gibba015 bash[30343]: cephadm 2021-03-10T15:49:21.128835+0000 mgr.gibba045.orlgmj (mgr.34412) 6371 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:49:22.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:49:21 gibba045 bash[25517]: cephadm 2021-03-10T15:49:21.128835+0000 mgr.gibba045.orlgmj (mgr.34412) 6371 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:49:23.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:49:22 gibba015 bash[29377]: cluster 2021-03-10T15:49:22.186560+0000 mgr.gibba045.orlgmj (mgr.34412) 6372 : cluster [DBG] pgmap v3627: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:23.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:49:22 gibba015 bash[30343]: cluster 2021-03-10T15:49:22.186560+0000 mgr.gibba045.orlgmj (mgr.34412) 6372 : cluster [DBG] pgmap v3627: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:23.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:49:22 gibba045 bash[25517]: cluster 2021-03-10T15:49:22.186560+0000 mgr.gibba045.orlgmj (mgr.34412) 6372 : cluster [DBG] pgmap v3627: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:25.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:49:25 gibba045 bash[25517]: cluster 2021-03-10T15:49:24.187509+0000 mgr.gibba045.orlgmj (mgr.34412) 6373 : cluster [DBG] pgmap v3628: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:25.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:49:25 gibba015 bash[29377]: cluster 2021-03-10T15:49:24.187509+0000 mgr.gibba045.orlgmj (mgr.34412) 6373 : cluster [DBG] pgmap v3628: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:25.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:49:25 gibba015 bash[30343]: cluster 2021-03-10T15:49:24.187509+0000 mgr.gibba045.orlgmj (mgr.34412) 6373 : cluster [DBG] pgmap v3628: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:27.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:49:27 gibba045 bash[25517]: cluster 2021-03-10T15:49:26.189350+0000 mgr.gibba045.orlgmj (mgr.34412) 6374 : cluster [DBG] pgmap v3629: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:27.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:49:27 gibba015 bash[29377]: cluster 2021-03-10T15:49:26.189350+0000 mgr.gibba045.orlgmj (mgr.34412) 6374 : cluster [DBG] pgmap v3629: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:27.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:49:27 gibba015 bash[30343]: cluster 2021-03-10T15:49:26.189350+0000 mgr.gibba045.orlgmj (mgr.34412) 6374 : cluster [DBG] pgmap v3629: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:28.973 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:49:29.200 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:49:29.200 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 4m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:49:29.200 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 2m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:49:29.201 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:49:29.201 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:49:29.201 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (119m) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:49:29.201 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (119m) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:49:29.201 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (119m) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:49:29.202 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (119m) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:49:29.202 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 4m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:49:29.202 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 2m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:49:29.202 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (118m) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:49:29.203 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (118m) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:49:29.203 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (117m) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:49:29.203 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (117m) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:49:29.203 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (116m) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:49:29.203 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (116m) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:49:29.204 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (115m) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:49:29.204 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (115m) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:49:29.204 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 2m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:49:29.204 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 2m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T15:49:29.447 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:49:29.448 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:49:29.448 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:49:29.448 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:49:29.448 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:49:29.449 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:49:29.449 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:49:29.449 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:49:29.449 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:49:29.450 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:49:29.450 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:49:29.450 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:49:29.450 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:49:29.451 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:49:29.451 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:49:29.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:49:29 gibba045 bash[25517]: cluster 2021-03-10T15:49:28.190899+0000 mgr.gibba045.orlgmj (mgr.34412) 6375 : cluster [DBG] pgmap v3630: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:29.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:49:29 gibba015 bash[29377]: cluster 2021-03-10T15:49:28.190899+0000 mgr.gibba045.orlgmj (mgr.34412) 6375 : cluster [DBG] pgmap v3630: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:29.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:49:29 gibba015 bash[30343]: cluster 2021-03-10T15:49:28.190899+0000 mgr.gibba045.orlgmj (mgr.34412) 6375 : cluster [DBG] pgmap v3630: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:30.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:49:30 gibba045 bash[25517]: audit 2021-03-10T15:49:28.963986+0000 mgr.gibba045.orlgmj (mgr.34412) 6376 : audit [DBG] from='client.58324 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:49:30.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:49:30 gibba045 bash[25517]: audit 2021-03-10T15:49:29.187217+0000 mgr.gibba045.orlgmj (mgr.34412) 6377 : audit [DBG] from='client.48342 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:49:30.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:49:30 gibba045 bash[25517]: audit 2021-03-10T15:49:29.445068+0000 mon.c (mon.1) 1782 : audit [DBG] from='client.? 172.21.2.115:0/1021900770' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:49:30.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:49:30 gibba015 bash[29377]: audit 2021-03-10T15:49:28.963986+0000 mgr.gibba045.orlgmj (mgr.34412) 6376 : audit [DBG] from='client.58324 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:49:30.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:49:30 gibba015 bash[29377]: audit 2021-03-10T15:49:29.187217+0000 mgr.gibba045.orlgmj (mgr.34412) 6377 : audit [DBG] from='client.48342 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:49:30.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:49:30 gibba015 bash[29377]: audit 2021-03-10T15:49:29.445068+0000 mon.c (mon.1) 1782 : audit [DBG] from='client.? 172.21.2.115:0/1021900770' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:49:30.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:49:30 gibba015 bash[30343]: audit 2021-03-10T15:49:28.963986+0000 mgr.gibba045.orlgmj (mgr.34412) 6376 : audit [DBG] from='client.58324 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:49:30.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:49:30 gibba015 bash[30343]: audit 2021-03-10T15:49:29.187217+0000 mgr.gibba045.orlgmj (mgr.34412) 6377 : audit [DBG] from='client.48342 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:49:30.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:49:30 gibba015 bash[30343]: audit 2021-03-10T15:49:29.445068+0000 mon.c (mon.1) 1782 : audit [DBG] from='client.? 172.21.2.115:0/1021900770' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:49:31.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:49:31 gibba045 bash[25517]: cluster 2021-03-10T15:49:30.192702+0000 mgr.gibba045.orlgmj (mgr.34412) 6378 : cluster [DBG] pgmap v3631: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:31.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:49:31 gibba015 bash[29377]: cluster 2021-03-10T15:49:30.192702+0000 mgr.gibba045.orlgmj (mgr.34412) 6378 : cluster [DBG] pgmap v3631: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:31.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:49:31 gibba015 bash[30343]: cluster 2021-03-10T15:49:30.192702+0000 mgr.gibba045.orlgmj (mgr.34412) 6378 : cluster [DBG] pgmap v3631: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:33.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:49:33 gibba045 bash[25517]: cluster 2021-03-10T15:49:32.194450+0000 mgr.gibba045.orlgmj (mgr.34412) 6379 : cluster [DBG] pgmap v3632: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:33.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:49:33 gibba015 bash[29377]: cluster 2021-03-10T15:49:32.194450+0000 mgr.gibba045.orlgmj (mgr.34412) 6379 : cluster [DBG] pgmap v3632: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:33.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:49:33 gibba015 bash[30343]: cluster 2021-03-10T15:49:32.194450+0000 mgr.gibba045.orlgmj (mgr.34412) 6379 : cluster [DBG] pgmap v3632: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:35.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:49:35 gibba045 bash[25517]: cluster 2021-03-10T15:49:34.195816+0000 mgr.gibba045.orlgmj (mgr.34412) 6380 : cluster [DBG] pgmap v3633: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:35.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:49:35 gibba015 bash[29377]: cluster 2021-03-10T15:49:34.195816+0000 mgr.gibba045.orlgmj (mgr.34412) 6380 : cluster [DBG] pgmap v3633: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:35.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:49:35 gibba015 bash[30343]: cluster 2021-03-10T15:49:34.195816+0000 mgr.gibba045.orlgmj (mgr.34412) 6380 : cluster [DBG] pgmap v3633: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:36.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:49:36 gibba045 bash[25517]: audit 2021-03-10T15:49:36.128129+0000 mon.c (mon.1) 1783 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:49:36.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:49:36 gibba015 bash[29377]: audit 2021-03-10T15:49:36.128129+0000 mon.c (mon.1) 1783 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:49:36.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:49:36 gibba015 bash[30343]: audit 2021-03-10T15:49:36.128129+0000 mon.c (mon.1) 1783 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:49:37.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:49:37 gibba015 bash[29377]: cephadm 2021-03-10T15:49:36.134375+0000 mgr.gibba045.orlgmj (mgr.34412) 6381 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:49:37.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:49:37 gibba015 bash[29377]: cephadm 2021-03-10T15:49:36.134880+0000 mgr.gibba045.orlgmj (mgr.34412) 6382 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:49:37.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:49:37 gibba015 bash[29377]: cluster 2021-03-10T15:49:36.196358+0000 mgr.gibba045.orlgmj (mgr.34412) 6383 : cluster [DBG] pgmap v3634: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:37.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:49:37 gibba015 bash[29377]: audit 2021-03-10T15:49:36.365104+0000 mon.a (mon.0) 1567 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:49:37.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:49:37 gibba015 bash[29377]: audit 2021-03-10T15:49:36.368919+0000 mon.c (mon.1) 1784 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:49:37.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:49:37 gibba015 bash[29377]: audit 2021-03-10T15:49:36.370393+0000 mon.c (mon.1) 1785 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:49:37.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:49:37 gibba015 bash[29377]: cephadm 2021-03-10T15:49:36.371140+0000 mgr.gibba045.orlgmj (mgr.34412) 6384 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:49:37.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:49:37 gibba015 bash[29377]: audit 2021-03-10T15:49:36.371999+0000 mon.c (mon.1) 1786 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:49:37.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:49:37 gibba015 bash[29377]: cephadm 2021-03-10T15:49:36.373000+0000 mgr.gibba045.orlgmj (mgr.34412) 6385 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:49:37.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:49:37 gibba015 bash[29377]: audit 2021-03-10T15:49:36.373267+0000 mon.c (mon.1) 1787 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:49:37.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:49:37 gibba015 bash[29377]: cephadm 2021-03-10T15:49:36.374446+0000 mgr.gibba045.orlgmj (mgr.34412) 6386 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:49:37.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:49:37 gibba015 bash[29377]: cephadm 2021-03-10T15:49:36.374492+0000 mgr.gibba045.orlgmj (mgr.34412) 6387 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:49:37.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:49:37 gibba015 bash[29377]: cephadm 2021-03-10T15:49:36.375843+0000 mgr.gibba045.orlgmj (mgr.34412) 6388 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:49:37.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:49:37 gibba015 bash[29377]: cephadm 2021-03-10T15:49:36.375889+0000 mgr.gibba045.orlgmj (mgr.34412) 6389 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:49:37.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:49:37 gibba015 bash[29377]: cephadm 2021-03-10T15:49:36.377188+0000 mgr.gibba045.orlgmj (mgr.34412) 6390 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:49:37.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:49:37 gibba015 bash[29377]: audit 2021-03-10T15:49:36.378744+0000 mon.c (mon.1) 1788 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:49:37.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:49:37 gibba015 bash[29377]: cephadm 2021-03-10T15:49:36.379628+0000 mgr.gibba045.orlgmj (mgr.34412) 6391 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:49:37.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:49:37 gibba015 bash[29377]: cephadm 2021-03-10T15:49:36.379888+0000 mgr.gibba045.orlgmj (mgr.34412) 6392 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:49:37.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:49:37 gibba015 bash[29377]: cephadm 2021-03-10T15:49:36.383897+0000 mgr.gibba045.orlgmj (mgr.34412) 6393 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:49:37.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:49:37 gibba015 bash[29377]: audit 2021-03-10T15:49:36.383929+0000 mon.c (mon.1) 1789 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:49:37.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:49:37 gibba015 bash[30343]: cephadm 2021-03-10T15:49:36.134375+0000 mgr.gibba045.orlgmj (mgr.34412) 6381 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:49:37.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:49:37 gibba015 bash[30343]: cephadm 2021-03-10T15:49:36.134880+0000 mgr.gibba045.orlgmj (mgr.34412) 6382 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:49:37.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:49:37 gibba015 bash[30343]: cluster 2021-03-10T15:49:36.196358+0000 mgr.gibba045.orlgmj (mgr.34412) 6383 : cluster [DBG] pgmap v3634: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:37.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:49:37 gibba015 bash[30343]: audit 2021-03-10T15:49:36.365104+0000 mon.a (mon.0) 1567 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:49:37.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:49:37 gibba015 bash[30343]: audit 2021-03-10T15:49:36.368919+0000 mon.c (mon.1) 1784 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:49:37.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:49:37 gibba015 bash[30343]: audit 2021-03-10T15:49:36.370393+0000 mon.c (mon.1) 1785 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:49:37.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:49:37 gibba015 bash[30343]: cephadm 2021-03-10T15:49:36.371140+0000 mgr.gibba045.orlgmj (mgr.34412) 6384 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:49:37.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:49:37 gibba015 bash[30343]: audit 2021-03-10T15:49:36.371999+0000 mon.c (mon.1) 1786 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:49:37.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:49:37 gibba015 bash[30343]: cephadm 2021-03-10T15:49:36.373000+0000 mgr.gibba045.orlgmj (mgr.34412) 6385 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:49:37.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:49:37 gibba015 bash[30343]: audit 2021-03-10T15:49:36.373267+0000 mon.c (mon.1) 1787 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:49:37.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:49:37 gibba015 bash[30343]: cephadm 2021-03-10T15:49:36.374446+0000 mgr.gibba045.orlgmj (mgr.34412) 6386 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:49:37.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:49:37 gibba015 bash[30343]: cephadm 2021-03-10T15:49:36.374492+0000 mgr.gibba045.orlgmj (mgr.34412) 6387 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:49:37.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:49:37 gibba015 bash[30343]: cephadm 2021-03-10T15:49:36.375843+0000 mgr.gibba045.orlgmj (mgr.34412) 6388 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:49:37.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:49:37 gibba015 bash[30343]: cephadm 2021-03-10T15:49:36.375889+0000 mgr.gibba045.orlgmj (mgr.34412) 6389 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:49:37.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:49:37 gibba015 bash[30343]: cephadm 2021-03-10T15:49:36.377188+0000 mgr.gibba045.orlgmj (mgr.34412) 6390 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:49:37.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:49:37 gibba015 bash[30343]: audit 2021-03-10T15:49:36.378744+0000 mon.c (mon.1) 1788 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:49:37.733 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:49:37 gibba015 bash[30343]: cephadm 2021-03-10T15:49:36.379628+0000 mgr.gibba045.orlgmj (mgr.34412) 6391 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:49:37.733 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:49:37 gibba015 bash[30343]: cephadm 2021-03-10T15:49:36.379888+0000 mgr.gibba045.orlgmj (mgr.34412) 6392 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:49:37.733 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:49:37 gibba015 bash[30343]: cephadm 2021-03-10T15:49:36.383897+0000 mgr.gibba045.orlgmj (mgr.34412) 6393 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:49:37.733 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:49:37 gibba015 bash[30343]: audit 2021-03-10T15:49:36.383929+0000 mon.c (mon.1) 1789 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:49:37.734 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:49:37 gibba015 bash[29377]: cephadm 2021-03-10T15:49:36.385812+0000 mgr.gibba045.orlgmj (mgr.34412) 6394 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:49:37.734 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:49:37 gibba015 bash[29377]: cephadm 2021-03-10T15:49:36.389209+0000 mgr.gibba045.orlgmj (mgr.34412) 6395 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:49:37.734 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:49:37 gibba015 bash[29377]: cephadm 2021-03-10T15:49:36.389675+0000 mgr.gibba045.orlgmj (mgr.34412) 6396 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:49:37.734 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:49:37 gibba015 bash[29377]: cephadm 2021-03-10T15:49:36.390356+0000 mgr.gibba045.orlgmj (mgr.34412) 6397 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:49:37.735 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:49:37 gibba015 bash[30343]: cephadm 2021-03-10T15:49:36.385812+0000 mgr.gibba045.orlgmj (mgr.34412) 6394 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:49:37.735 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:49:37 gibba015 bash[30343]: cephadm 2021-03-10T15:49:36.389209+0000 mgr.gibba045.orlgmj (mgr.34412) 6395 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:49:37.735 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:49:37 gibba015 bash[30343]: cephadm 2021-03-10T15:49:36.389675+0000 mgr.gibba045.orlgmj (mgr.34412) 6396 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:49:37.735 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:49:37 gibba015 bash[30343]: cephadm 2021-03-10T15:49:36.390356+0000 mgr.gibba045.orlgmj (mgr.34412) 6397 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:49:37.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:49:37 gibba045 bash[25517]: cephadm 2021-03-10T15:49:36.134375+0000 mgr.gibba045.orlgmj (mgr.34412) 6381 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:49:37.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:49:37 gibba045 bash[25517]: cephadm 2021-03-10T15:49:36.134880+0000 mgr.gibba045.orlgmj (mgr.34412) 6382 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:49:37.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:49:37 gibba045 bash[25517]: cluster 2021-03-10T15:49:36.196358+0000 mgr.gibba045.orlgmj (mgr.34412) 6383 : cluster [DBG] pgmap v3634: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:37.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:49:37 gibba045 bash[25517]: audit 2021-03-10T15:49:36.365104+0000 mon.a (mon.0) 1567 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:49:37.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:49:37 gibba045 bash[25517]: audit 2021-03-10T15:49:36.368919+0000 mon.c (mon.1) 1784 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:49:37.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:49:37 gibba045 bash[25517]: audit 2021-03-10T15:49:36.370393+0000 mon.c (mon.1) 1785 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:49:37.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:49:37 gibba045 bash[25517]: cephadm 2021-03-10T15:49:36.371140+0000 mgr.gibba045.orlgmj (mgr.34412) 6384 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:49:37.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:49:37 gibba045 bash[25517]: audit 2021-03-10T15:49:36.371999+0000 mon.c (mon.1) 1786 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:49:37.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:49:37 gibba045 bash[25517]: cephadm 2021-03-10T15:49:36.373000+0000 mgr.gibba045.orlgmj (mgr.34412) 6385 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:49:37.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:49:37 gibba045 bash[25517]: audit 2021-03-10T15:49:36.373267+0000 mon.c (mon.1) 1787 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:49:37.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:49:37 gibba045 bash[25517]: cephadm 2021-03-10T15:49:36.374446+0000 mgr.gibba045.orlgmj (mgr.34412) 6386 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:49:37.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:49:37 gibba045 bash[25517]: cephadm 2021-03-10T15:49:36.374492+0000 mgr.gibba045.orlgmj (mgr.34412) 6387 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:49:37.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:49:37 gibba045 bash[25517]: cephadm 2021-03-10T15:49:36.375843+0000 mgr.gibba045.orlgmj (mgr.34412) 6388 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:49:37.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:49:37 gibba045 bash[25517]: cephadm 2021-03-10T15:49:36.375889+0000 mgr.gibba045.orlgmj (mgr.34412) 6389 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:49:37.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:49:37 gibba045 bash[25517]: cephadm 2021-03-10T15:49:36.377188+0000 mgr.gibba045.orlgmj (mgr.34412) 6390 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:49:37.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:49:37 gibba045 bash[25517]: audit 2021-03-10T15:49:36.378744+0000 mon.c (mon.1) 1788 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:49:37.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:49:37 gibba045 bash[25517]: cephadm 2021-03-10T15:49:36.379628+0000 mgr.gibba045.orlgmj (mgr.34412) 6391 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:49:37.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:49:37 gibba045 bash[25517]: cephadm 2021-03-10T15:49:36.379888+0000 mgr.gibba045.orlgmj (mgr.34412) 6392 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:49:37.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:49:37 gibba045 bash[25517]: cephadm 2021-03-10T15:49:36.383897+0000 mgr.gibba045.orlgmj (mgr.34412) 6393 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:49:37.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:49:37 gibba045 bash[25517]: audit 2021-03-10T15:49:36.383929+0000 mon.c (mon.1) 1789 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:49:37.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:49:37 gibba045 bash[25517]: cephadm 2021-03-10T15:49:36.385812+0000 mgr.gibba045.orlgmj (mgr.34412) 6394 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:49:37.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:49:37 gibba045 bash[25517]: cephadm 2021-03-10T15:49:36.389209+0000 mgr.gibba045.orlgmj (mgr.34412) 6395 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:49:37.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:49:37 gibba045 bash[25517]: cephadm 2021-03-10T15:49:36.389675+0000 mgr.gibba045.orlgmj (mgr.34412) 6396 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:49:37.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:49:37 gibba045 bash[25517]: cephadm 2021-03-10T15:49:36.390356+0000 mgr.gibba045.orlgmj (mgr.34412) 6397 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:49:39.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:49:39 gibba015 bash[29377]: cluster 2021-03-10T15:49:38.197859+0000 mgr.gibba045.orlgmj (mgr.34412) 6398 : cluster [DBG] pgmap v3635: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:39.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:49:39 gibba015 bash[30343]: cluster 2021-03-10T15:49:38.197859+0000 mgr.gibba045.orlgmj (mgr.34412) 6398 : cluster [DBG] pgmap v3635: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:39.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:49:39 gibba045 bash[25517]: cluster 2021-03-10T15:49:38.197859+0000 mgr.gibba045.orlgmj (mgr.34412) 6398 : cluster [DBG] pgmap v3635: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:41.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:49:40 gibba015 bash[29377]: cluster 2021-03-10T15:49:40.199443+0000 mgr.gibba045.orlgmj (mgr.34412) 6399 : cluster [DBG] pgmap v3636: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:41.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:49:40 gibba015 bash[30343]: cluster 2021-03-10T15:49:40.199443+0000 mgr.gibba045.orlgmj (mgr.34412) 6399 : cluster [DBG] pgmap v3636: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:41.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:49:40 gibba045 bash[25517]: cluster 2021-03-10T15:49:40.199443+0000 mgr.gibba045.orlgmj (mgr.34412) 6399 : cluster [DBG] pgmap v3636: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:43.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:49:43 gibba045 bash[25517]: cluster 2021-03-10T15:49:42.200565+0000 mgr.gibba045.orlgmj (mgr.34412) 6400 : cluster [DBG] pgmap v3637: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:43.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:49:43 gibba015 bash[29377]: cluster 2021-03-10T15:49:42.200565+0000 mgr.gibba045.orlgmj (mgr.34412) 6400 : cluster [DBG] pgmap v3637: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:43.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:49:43 gibba015 bash[30343]: cluster 2021-03-10T15:49:42.200565+0000 mgr.gibba045.orlgmj (mgr.34412) 6400 : cluster [DBG] pgmap v3637: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:45.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:49:45 gibba045 bash[25517]: cluster 2021-03-10T15:49:44.201678+0000 mgr.gibba045.orlgmj (mgr.34412) 6401 : cluster [DBG] pgmap v3638: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:45.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:49:45 gibba015 bash[29377]: cluster 2021-03-10T15:49:44.201678+0000 mgr.gibba045.orlgmj (mgr.34412) 6401 : cluster [DBG] pgmap v3638: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:45.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:49:45 gibba015 bash[30343]: cluster 2021-03-10T15:49:44.201678+0000 mgr.gibba045.orlgmj (mgr.34412) 6401 : cluster [DBG] pgmap v3638: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:47.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:49:47 gibba045 bash[25517]: cluster 2021-03-10T15:49:46.203469+0000 mgr.gibba045.orlgmj (mgr.34412) 6402 : cluster [DBG] pgmap v3639: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:47.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:49:47 gibba015 bash[29377]: cluster 2021-03-10T15:49:46.203469+0000 mgr.gibba045.orlgmj (mgr.34412) 6402 : cluster [DBG] pgmap v3639: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:47.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:49:47 gibba015 bash[30343]: cluster 2021-03-10T15:49:46.203469+0000 mgr.gibba045.orlgmj (mgr.34412) 6402 : cluster [DBG] pgmap v3639: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:49.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:49:49 gibba045 bash[25517]: cluster 2021-03-10T15:49:48.204525+0000 mgr.gibba045.orlgmj (mgr.34412) 6403 : cluster [DBG] pgmap v3640: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:49.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:49:49 gibba015 bash[29377]: cluster 2021-03-10T15:49:48.204525+0000 mgr.gibba045.orlgmj (mgr.34412) 6403 : cluster [DBG] pgmap v3640: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:49.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:49:49 gibba015 bash[30343]: cluster 2021-03-10T15:49:48.204525+0000 mgr.gibba045.orlgmj (mgr.34412) 6403 : cluster [DBG] pgmap v3640: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:51.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:49:50 gibba015 bash[29377]: cluster 2021-03-10T15:49:50.206052+0000 mgr.gibba045.orlgmj (mgr.34412) 6404 : cluster [DBG] pgmap v3641: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:51.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:49:50 gibba015 bash[30343]: cluster 2021-03-10T15:49:50.206052+0000 mgr.gibba045.orlgmj (mgr.34412) 6404 : cluster [DBG] pgmap v3641: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:51.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:49:50 gibba045 bash[25517]: cluster 2021-03-10T15:49:50.206052+0000 mgr.gibba045.orlgmj (mgr.34412) 6404 : cluster [DBG] pgmap v3641: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:52.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:49:51 gibba015 bash[29377]: cephadm 2021-03-10T15:49:51.406349+0000 mgr.gibba045.orlgmj (mgr.34412) 6405 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:49:52.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:49:51 gibba015 bash[30343]: cephadm 2021-03-10T15:49:51.406349+0000 mgr.gibba045.orlgmj (mgr.34412) 6405 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:49:52.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:49:51 gibba045 bash[25517]: cephadm 2021-03-10T15:49:51.406349+0000 mgr.gibba045.orlgmj (mgr.34412) 6405 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:49:53.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:49:52 gibba015 bash[29377]: cluster 2021-03-10T15:49:52.207823+0000 mgr.gibba045.orlgmj (mgr.34412) 6406 : cluster [DBG] pgmap v3642: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:53.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:49:52 gibba015 bash[30343]: cluster 2021-03-10T15:49:52.207823+0000 mgr.gibba045.orlgmj (mgr.34412) 6406 : cluster [DBG] pgmap v3642: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:53.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:49:52 gibba045 bash[25517]: cluster 2021-03-10T15:49:52.207823+0000 mgr.gibba045.orlgmj (mgr.34412) 6406 : cluster [DBG] pgmap v3642: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:54.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:49:53 gibba015 bash[29377]: audit 2021-03-10T15:49:53.303227+0000 mon.c (mon.1) 1790 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:49:54.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:49:53 gibba015 bash[29377]: audit 2021-03-10T15:49:53.303866+0000 mon.c (mon.1) 1791 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:49:54.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:49:53 gibba015 bash[29377]: audit 2021-03-10T15:49:53.304489+0000 mon.a (mon.0) 1568 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:49:54.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:49:53 gibba015 bash[29377]: audit 2021-03-10T15:49:53.305809+0000 mon.a (mon.0) 1569 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:49:54.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:49:53 gibba015 bash[29377]: audit 2021-03-10T15:49:53.313842+0000 mon.c (mon.1) 1792 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T15:49:54.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:49:53 gibba015 bash[29377]: audit 2021-03-10T15:49:53.314586+0000 mon.c (mon.1) 1793 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:49:54.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:49:53 gibba015 bash[29377]: audit 2021-03-10T15:49:53.315053+0000 mon.a (mon.0) 1570 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T15:49:54.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:49:53 gibba015 bash[29377]: audit 2021-03-10T15:49:53.315339+0000 mon.c (mon.1) 1794 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:49:54.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:49:53 gibba015 bash[29377]: audit 2021-03-10T15:49:53.315994+0000 mon.c (mon.1) 1795 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T15:49:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:49:53 gibba015 bash[29377]: audit 2021-03-10T15:49:53.317149+0000 mon.a (mon.0) 1571 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:49:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:49:53 gibba015 bash[29377]: audit 2021-03-10T15:49:53.318314+0000 mon.a (mon.0) 1572 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:49:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:49:53 gibba015 bash[29377]: audit 2021-03-10T15:49:53.319238+0000 mon.a (mon.0) 1573 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T15:49:54.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:49:53 gibba015 bash[30343]: audit 2021-03-10T15:49:53.303227+0000 mon.c (mon.1) 1790 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:49:54.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:49:53 gibba015 bash[30343]: audit 2021-03-10T15:49:53.303866+0000 mon.c (mon.1) 1791 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:49:54.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:49:53 gibba015 bash[30343]: audit 2021-03-10T15:49:53.304489+0000 mon.a (mon.0) 1568 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:49:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:49:53 gibba015 bash[30343]: audit 2021-03-10T15:49:53.305809+0000 mon.a (mon.0) 1569 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:49:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:49:53 gibba015 bash[30343]: audit 2021-03-10T15:49:53.313842+0000 mon.c (mon.1) 1792 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T15:49:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:49:53 gibba015 bash[30343]: audit 2021-03-10T15:49:53.314586+0000 mon.c (mon.1) 1793 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:49:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:49:53 gibba015 bash[30343]: audit 2021-03-10T15:49:53.315053+0000 mon.a (mon.0) 1570 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T15:49:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:49:53 gibba015 bash[30343]: audit 2021-03-10T15:49:53.315339+0000 mon.c (mon.1) 1794 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:49:54.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:49:53 gibba015 bash[30343]: audit 2021-03-10T15:49:53.315994+0000 mon.c (mon.1) 1795 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T15:49:54.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:49:53 gibba015 bash[30343]: audit 2021-03-10T15:49:53.317149+0000 mon.a (mon.0) 1571 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:49:54.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:49:53 gibba015 bash[30343]: audit 2021-03-10T15:49:53.318314+0000 mon.a (mon.0) 1572 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:49:54.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:49:53 gibba015 bash[30343]: audit 2021-03-10T15:49:53.319238+0000 mon.a (mon.0) 1573 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T15:49:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:49:53 gibba045 bash[25517]: audit 2021-03-10T15:49:53.303227+0000 mon.c (mon.1) 1790 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:49:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:49:53 gibba045 bash[25517]: audit 2021-03-10T15:49:53.303866+0000 mon.c (mon.1) 1791 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:49:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:49:53 gibba045 bash[25517]: audit 2021-03-10T15:49:53.304489+0000 mon.a (mon.0) 1568 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:49:54.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:49:53 gibba045 bash[25517]: audit 2021-03-10T15:49:53.305809+0000 mon.a (mon.0) 1569 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:49:54.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:49:53 gibba045 bash[25517]: audit 2021-03-10T15:49:53.313842+0000 mon.c (mon.1) 1792 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T15:49:54.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:49:53 gibba045 bash[25517]: audit 2021-03-10T15:49:53.314586+0000 mon.c (mon.1) 1793 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:49:54.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:49:53 gibba045 bash[25517]: audit 2021-03-10T15:49:53.315053+0000 mon.a (mon.0) 1570 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T15:49:54.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:49:53 gibba045 bash[25517]: audit 2021-03-10T15:49:53.315339+0000 mon.c (mon.1) 1794 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:49:54.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:49:53 gibba045 bash[25517]: audit 2021-03-10T15:49:53.315994+0000 mon.c (mon.1) 1795 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T15:49:54.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:49:53 gibba045 bash[25517]: audit 2021-03-10T15:49:53.317149+0000 mon.a (mon.0) 1571 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:49:54.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:49:53 gibba045 bash[25517]: audit 2021-03-10T15:49:53.318314+0000 mon.a (mon.0) 1572 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:49:54.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:49:53 gibba045 bash[25517]: audit 2021-03-10T15:49:53.319238+0000 mon.a (mon.0) 1573 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T15:49:55.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:49:54 gibba015 bash[29377]: cluster 2021-03-10T15:49:54.209117+0000 mgr.gibba045.orlgmj (mgr.34412) 6407 : cluster [DBG] pgmap v3643: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:55.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:49:54 gibba015 bash[30343]: cluster 2021-03-10T15:49:54.209117+0000 mgr.gibba045.orlgmj (mgr.34412) 6407 : cluster [DBG] pgmap v3643: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:55.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:49:54 gibba045 bash[25517]: cluster 2021-03-10T15:49:54.209117+0000 mgr.gibba045.orlgmj (mgr.34412) 6407 : cluster [DBG] pgmap v3643: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:57.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:49:57 gibba045 bash[25517]: cluster 2021-03-10T15:49:56.210865+0000 mgr.gibba045.orlgmj (mgr.34412) 6408 : cluster [DBG] pgmap v3644: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:57.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:49:57 gibba015 bash[29377]: cluster 2021-03-10T15:49:56.210865+0000 mgr.gibba045.orlgmj (mgr.34412) 6408 : cluster [DBG] pgmap v3644: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:57.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:49:57 gibba015 bash[30343]: cluster 2021-03-10T15:49:56.210865+0000 mgr.gibba045.orlgmj (mgr.34412) 6408 : cluster [DBG] pgmap v3644: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:59.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:49:59 gibba045 bash[25517]: cluster 2021-03-10T15:49:58.212598+0000 mgr.gibba045.orlgmj (mgr.34412) 6409 : cluster [DBG] pgmap v3645: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:59.691 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:49:59.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:49:59 gibba015 bash[29377]: cluster 2021-03-10T15:49:58.212598+0000 mgr.gibba045.orlgmj (mgr.34412) 6409 : cluster [DBG] pgmap v3645: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:59.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:49:59 gibba015 bash[30343]: cluster 2021-03-10T15:49:58.212598+0000 mgr.gibba045.orlgmj (mgr.34412) 6409 : cluster [DBG] pgmap v3645: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:59.920 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:49:59.920 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 4m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:49:59.921 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 3m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:49:59.921 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:49:59.921 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:49:59.921 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:49:59.921 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:49:59.922 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (119m) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:49:59.922 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (119m) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:49:59.922 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 4m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:49:59.922 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 3m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:49:59.923 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (119m) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:49:59.923 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (118m) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:49:59.923 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (118m) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:49:59.923 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (117m) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:49:59.923 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (117m) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:49:59.924 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (116m) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:49:59.924 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (116m) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:49:59.924 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (116m) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:49:59.924 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 3m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:49:59.924 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 3m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T15:50:00.170 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:50:00.170 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:50:00.171 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:50:00.171 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:50:00.171 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:50:00.171 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:50:00.171 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:50:00.172 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:50:00.172 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:50:00.172 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:50:00.172 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:50:00.172 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:50:00.173 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:50:00.173 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:50:00.173 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:50:00.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:50:00 gibba015 bash[29377]: debug 2021-03-10T15:49:59.995+0000 7f21beb4f700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T15:50:01.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:50:00 gibba015 bash[29377]: audit 2021-03-10T15:49:59.683456+0000 mgr.gibba045.orlgmj (mgr.34412) 6410 : audit [DBG] from='client.58342 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:50:01.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:50:00 gibba015 bash[29377]: audit 2021-03-10T15:49:59.909488+0000 mgr.gibba045.orlgmj (mgr.34412) 6411 : audit [DBG] from='client.58348 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:50:01.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:50:00 gibba015 bash[29377]: cluster 2021-03-10T15:50:00.000106+0000 mon.a (mon.0) 1574 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T15:50:01.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:50:00 gibba015 bash[29377]: audit 2021-03-10T15:50:00.167592+0000 mon.a (mon.0) 1575 : audit [DBG] from='client.? 172.21.2.115:0/3286178849' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:50:01.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:50:00 gibba015 bash[29377]: cluster 2021-03-10T15:50:00.214118+0000 mgr.gibba045.orlgmj (mgr.34412) 6412 : cluster [DBG] pgmap v3646: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:01.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:50:00 gibba015 bash[30343]: audit 2021-03-10T15:49:59.683456+0000 mgr.gibba045.orlgmj (mgr.34412) 6410 : audit [DBG] from='client.58342 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:50:01.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:50:00 gibba015 bash[30343]: audit 2021-03-10T15:49:59.909488+0000 mgr.gibba045.orlgmj (mgr.34412) 6411 : audit [DBG] from='client.58348 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:50:01.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:50:00 gibba015 bash[30343]: cluster 2021-03-10T15:50:00.000106+0000 mon.a (mon.0) 1574 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T15:50:01.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:50:00 gibba015 bash[30343]: audit 2021-03-10T15:50:00.167592+0000 mon.a (mon.0) 1575 : audit [DBG] from='client.? 172.21.2.115:0/3286178849' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:50:01.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:50:00 gibba015 bash[30343]: cluster 2021-03-10T15:50:00.214118+0000 mgr.gibba045.orlgmj (mgr.34412) 6412 : cluster [DBG] pgmap v3646: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:01.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:50:00 gibba045 bash[25517]: audit 2021-03-10T15:49:59.683456+0000 mgr.gibba045.orlgmj (mgr.34412) 6410 : audit [DBG] from='client.58342 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:50:01.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:50:00 gibba045 bash[25517]: audit 2021-03-10T15:49:59.909488+0000 mgr.gibba045.orlgmj (mgr.34412) 6411 : audit [DBG] from='client.58348 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:50:01.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:50:00 gibba045 bash[25517]: cluster 2021-03-10T15:50:00.000106+0000 mon.a (mon.0) 1574 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T15:50:01.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:50:00 gibba045 bash[25517]: audit 2021-03-10T15:50:00.167592+0000 mon.a (mon.0) 1575 : audit [DBG] from='client.? 172.21.2.115:0/3286178849' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:50:01.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:50:00 gibba045 bash[25517]: cluster 2021-03-10T15:50:00.214118+0000 mgr.gibba045.orlgmj (mgr.34412) 6412 : cluster [DBG] pgmap v3646: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:03.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:50:03 gibba045 bash[25517]: cluster 2021-03-10T15:50:02.215844+0000 mgr.gibba045.orlgmj (mgr.34412) 6413 : cluster [DBG] pgmap v3647: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:03.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:50:03 gibba015 bash[29377]: cluster 2021-03-10T15:50:02.215844+0000 mgr.gibba045.orlgmj (mgr.34412) 6413 : cluster [DBG] pgmap v3647: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:03.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:50:03 gibba015 bash[30343]: cluster 2021-03-10T15:50:02.215844+0000 mgr.gibba045.orlgmj (mgr.34412) 6413 : cluster [DBG] pgmap v3647: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:05.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:50:05 gibba045 bash[25517]: cluster 2021-03-10T15:50:04.217217+0000 mgr.gibba045.orlgmj (mgr.34412) 6414 : cluster [DBG] pgmap v3648: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:05.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:50:05 gibba015 bash[29377]: cluster 2021-03-10T15:50:04.217217+0000 mgr.gibba045.orlgmj (mgr.34412) 6414 : cluster [DBG] pgmap v3648: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:05.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:50:05 gibba015 bash[30343]: cluster 2021-03-10T15:50:04.217217+0000 mgr.gibba045.orlgmj (mgr.34412) 6414 : cluster [DBG] pgmap v3648: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:07.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:50:07 gibba045 bash[25517]: cluster 2021-03-10T15:50:06.218405+0000 mgr.gibba045.orlgmj (mgr.34412) 6415 : cluster [DBG] pgmap v3649: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:07.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:50:07 gibba045 bash[25517]: cephadm 2021-03-10T15:50:06.409231+0000 mgr.gibba045.orlgmj (mgr.34412) 6416 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:50:07.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:50:07 gibba015 bash[29377]: cluster 2021-03-10T15:50:06.218405+0000 mgr.gibba045.orlgmj (mgr.34412) 6415 : cluster [DBG] pgmap v3649: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:07.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:50:07 gibba015 bash[29377]: cephadm 2021-03-10T15:50:06.409231+0000 mgr.gibba045.orlgmj (mgr.34412) 6416 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:50:07.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:50:07 gibba015 bash[30343]: cluster 2021-03-10T15:50:06.218405+0000 mgr.gibba045.orlgmj (mgr.34412) 6415 : cluster [DBG] pgmap v3649: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:07.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:50:07 gibba015 bash[30343]: cephadm 2021-03-10T15:50:06.409231+0000 mgr.gibba045.orlgmj (mgr.34412) 6416 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:50:09.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:50:09 gibba015 bash[29377]: cluster 2021-03-10T15:50:08.219690+0000 mgr.gibba045.orlgmj (mgr.34412) 6417 : cluster [DBG] pgmap v3650: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:09.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:50:09 gibba015 bash[30343]: cluster 2021-03-10T15:50:08.219690+0000 mgr.gibba045.orlgmj (mgr.34412) 6417 : cluster [DBG] pgmap v3650: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:09.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:50:09 gibba045 bash[25517]: cluster 2021-03-10T15:50:08.219690+0000 mgr.gibba045.orlgmj (mgr.34412) 6417 : cluster [DBG] pgmap v3650: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:11.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:50:10 gibba015 bash[29377]: cluster 2021-03-10T15:50:10.221283+0000 mgr.gibba045.orlgmj (mgr.34412) 6418 : cluster [DBG] pgmap v3651: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:11.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:50:10 gibba015 bash[30343]: cluster 2021-03-10T15:50:10.221283+0000 mgr.gibba045.orlgmj (mgr.34412) 6418 : cluster [DBG] pgmap v3651: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:11.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:50:10 gibba045 bash[25517]: cluster 2021-03-10T15:50:10.221283+0000 mgr.gibba045.orlgmj (mgr.34412) 6418 : cluster [DBG] pgmap v3651: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:13.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:50:13 gibba045 bash[25517]: cluster 2021-03-10T15:50:12.222580+0000 mgr.gibba045.orlgmj (mgr.34412) 6419 : cluster [DBG] pgmap v3652: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:13.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:50:13 gibba015 bash[29377]: cluster 2021-03-10T15:50:12.222580+0000 mgr.gibba045.orlgmj (mgr.34412) 6419 : cluster [DBG] pgmap v3652: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:13.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:50:13 gibba015 bash[30343]: cluster 2021-03-10T15:50:12.222580+0000 mgr.gibba045.orlgmj (mgr.34412) 6419 : cluster [DBG] pgmap v3652: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:15.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:50:15 gibba045 bash[25517]: cluster 2021-03-10T15:50:14.223710+0000 mgr.gibba045.orlgmj (mgr.34412) 6420 : cluster [DBG] pgmap v3653: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:15.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:50:15 gibba015 bash[29377]: cluster 2021-03-10T15:50:14.223710+0000 mgr.gibba045.orlgmj (mgr.34412) 6420 : cluster [DBG] pgmap v3653: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:15.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:50:15 gibba015 bash[30343]: cluster 2021-03-10T15:50:14.223710+0000 mgr.gibba045.orlgmj (mgr.34412) 6420 : cluster [DBG] pgmap v3653: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:17.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:50:17 gibba045 bash[25517]: cluster 2021-03-10T15:50:16.225380+0000 mgr.gibba045.orlgmj (mgr.34412) 6421 : cluster [DBG] pgmap v3654: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:17.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:50:17 gibba015 bash[29377]: cluster 2021-03-10T15:50:16.225380+0000 mgr.gibba045.orlgmj (mgr.34412) 6421 : cluster [DBG] pgmap v3654: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:17.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:50:17 gibba015 bash[30343]: cluster 2021-03-10T15:50:16.225380+0000 mgr.gibba045.orlgmj (mgr.34412) 6421 : cluster [DBG] pgmap v3654: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:19.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:50:19 gibba015 bash[29377]: cluster 2021-03-10T15:50:18.226894+0000 mgr.gibba045.orlgmj (mgr.34412) 6422 : cluster [DBG] pgmap v3655: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:19.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:50:19 gibba015 bash[30343]: cluster 2021-03-10T15:50:18.226894+0000 mgr.gibba045.orlgmj (mgr.34412) 6422 : cluster [DBG] pgmap v3655: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:19.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:50:19 gibba045 bash[25517]: cluster 2021-03-10T15:50:18.226894+0000 mgr.gibba045.orlgmj (mgr.34412) 6422 : cluster [DBG] pgmap v3655: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:21.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:50:20 gibba015 bash[29377]: cluster 2021-03-10T15:50:20.227691+0000 mgr.gibba045.orlgmj (mgr.34412) 6423 : cluster [DBG] pgmap v3656: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:21.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:50:20 gibba015 bash[30343]: cluster 2021-03-10T15:50:20.227691+0000 mgr.gibba045.orlgmj (mgr.34412) 6423 : cluster [DBG] pgmap v3656: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:21.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:50:20 gibba045 bash[25517]: cluster 2021-03-10T15:50:20.227691+0000 mgr.gibba045.orlgmj (mgr.34412) 6423 : cluster [DBG] pgmap v3656: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:22.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:50:21 gibba015 bash[29377]: cephadm 2021-03-10T15:50:21.413057+0000 mgr.gibba045.orlgmj (mgr.34412) 6424 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:50:22.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:50:21 gibba015 bash[30343]: cephadm 2021-03-10T15:50:21.413057+0000 mgr.gibba045.orlgmj (mgr.34412) 6424 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:50:22.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:50:21 gibba045 bash[25517]: cephadm 2021-03-10T15:50:21.413057+0000 mgr.gibba045.orlgmj (mgr.34412) 6424 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:50:23.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:50:22 gibba015 bash[29377]: cluster 2021-03-10T15:50:22.229406+0000 mgr.gibba045.orlgmj (mgr.34412) 6425 : cluster [DBG] pgmap v3657: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:23.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:50:22 gibba015 bash[30343]: cluster 2021-03-10T15:50:22.229406+0000 mgr.gibba045.orlgmj (mgr.34412) 6425 : cluster [DBG] pgmap v3657: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:23.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:50:22 gibba045 bash[25517]: cluster 2021-03-10T15:50:22.229406+0000 mgr.gibba045.orlgmj (mgr.34412) 6425 : cluster [DBG] pgmap v3657: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:25.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:50:25 gibba045 bash[25517]: cluster 2021-03-10T15:50:24.230612+0000 mgr.gibba045.orlgmj (mgr.34412) 6426 : cluster [DBG] pgmap v3658: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:25.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:50:25 gibba015 bash[29377]: cluster 2021-03-10T15:50:24.230612+0000 mgr.gibba045.orlgmj (mgr.34412) 6426 : cluster [DBG] pgmap v3658: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:25.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:50:25 gibba015 bash[30343]: cluster 2021-03-10T15:50:24.230612+0000 mgr.gibba045.orlgmj (mgr.34412) 6426 : cluster [DBG] pgmap v3658: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:27.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:50:27 gibba045 bash[25517]: cluster 2021-03-10T15:50:26.232330+0000 mgr.gibba045.orlgmj (mgr.34412) 6427 : cluster [DBG] pgmap v3659: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:27.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:50:27 gibba015 bash[29377]: cluster 2021-03-10T15:50:26.232330+0000 mgr.gibba045.orlgmj (mgr.34412) 6427 : cluster [DBG] pgmap v3659: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:27.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:50:27 gibba015 bash[30343]: cluster 2021-03-10T15:50:26.232330+0000 mgr.gibba045.orlgmj (mgr.34412) 6427 : cluster [DBG] pgmap v3659: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:29.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:50:29 gibba015 bash[29377]: cluster 2021-03-10T15:50:28.234013+0000 mgr.gibba045.orlgmj (mgr.34412) 6428 : cluster [DBG] pgmap v3660: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:29.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:50:29 gibba015 bash[30343]: cluster 2021-03-10T15:50:28.234013+0000 mgr.gibba045.orlgmj (mgr.34412) 6428 : cluster [DBG] pgmap v3660: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:29.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:50:29 gibba045 bash[25517]: cluster 2021-03-10T15:50:28.234013+0000 mgr.gibba045.orlgmj (mgr.34412) 6428 : cluster [DBG] pgmap v3660: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:30.412 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:50:30.637 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:50:30.637 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 5m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:50:30.637 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 4m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:50:30.637 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:50:30.638 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:50:30.638 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:50:30.638 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:50:30.638 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:50:30.638 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:50:30.639 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 5m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:50:30.639 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 4m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:50:30.639 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (119m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:50:30.639 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (119m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:50:30.639 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (118m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:50:30.640 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (118m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:50:30.640 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (117m) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:50:30.640 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (117m) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:50:30.640 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (116m) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:50:30.640 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (116m) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:50:30.641 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 4m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:50:30.641 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 4m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T15:50:30.885 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:50:30.885 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:50:30.885 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:50:30.886 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:50:30.886 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:50:30.886 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:50:30.886 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:50:30.887 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:50:30.887 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:50:30.887 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:50:30.887 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:50:30.887 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:50:30.888 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:50:30.888 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:50:30.888 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:50:31.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:50:30 gibba015 bash[29377]: cluster 2021-03-10T15:50:30.235761+0000 mgr.gibba045.orlgmj (mgr.34412) 6429 : cluster [DBG] pgmap v3661: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:31.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:50:30 gibba015 bash[29377]: audit 2021-03-10T15:50:30.402726+0000 mgr.gibba045.orlgmj (mgr.34412) 6430 : audit [DBG] from='client.48372 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:50:31.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:50:30 gibba015 bash[29377]: audit 2021-03-10T15:50:30.882549+0000 mon.c (mon.1) 1796 : audit [DBG] from='client.? 172.21.2.115:0/867403650' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:50:31.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:50:31 gibba015 bash[30343]: cluster 2021-03-10T15:50:30.235761+0000 mgr.gibba045.orlgmj (mgr.34412) 6429 : cluster [DBG] pgmap v3661: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:31.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:50:31 gibba015 bash[30343]: audit 2021-03-10T15:50:30.402726+0000 mgr.gibba045.orlgmj (mgr.34412) 6430 : audit [DBG] from='client.48372 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:50:31.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:50:31 gibba015 bash[30343]: audit 2021-03-10T15:50:30.882549+0000 mon.c (mon.1) 1796 : audit [DBG] from='client.? 172.21.2.115:0/867403650' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:50:31.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:50:30 gibba045 bash[25517]: cluster 2021-03-10T15:50:30.235761+0000 mgr.gibba045.orlgmj (mgr.34412) 6429 : cluster [DBG] pgmap v3661: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:31.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:50:30 gibba045 bash[25517]: audit 2021-03-10T15:50:30.402726+0000 mgr.gibba045.orlgmj (mgr.34412) 6430 : audit [DBG] from='client.48372 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:50:31.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:50:30 gibba045 bash[25517]: audit 2021-03-10T15:50:30.882549+0000 mon.c (mon.1) 1796 : audit [DBG] from='client.? 172.21.2.115:0/867403650' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:50:32.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:50:31 gibba015 bash[29377]: audit 2021-03-10T15:50:30.624768+0000 mgr.gibba045.orlgmj (mgr.34412) 6431 : audit [DBG] from='client.48378 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:50:32.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:50:31 gibba015 bash[30343]: audit 2021-03-10T15:50:30.624768+0000 mgr.gibba045.orlgmj (mgr.34412) 6431 : audit [DBG] from='client.48378 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:50:32.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:50:31 gibba045 bash[25517]: audit 2021-03-10T15:50:30.624768+0000 mgr.gibba045.orlgmj (mgr.34412) 6431 : audit [DBG] from='client.48378 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:50:33.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:50:32 gibba045 bash[25517]: cluster 2021-03-10T15:50:32.237441+0000 mgr.gibba045.orlgmj (mgr.34412) 6432 : cluster [DBG] pgmap v3662: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:33.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:50:32 gibba015 bash[29377]: cluster 2021-03-10T15:50:32.237441+0000 mgr.gibba045.orlgmj (mgr.34412) 6432 : cluster [DBG] pgmap v3662: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:33.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:50:32 gibba015 bash[30343]: cluster 2021-03-10T15:50:32.237441+0000 mgr.gibba045.orlgmj (mgr.34412) 6432 : cluster [DBG] pgmap v3662: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:35.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:50:35 gibba045 bash[25517]: cluster 2021-03-10T15:50:34.238802+0000 mgr.gibba045.orlgmj (mgr.34412) 6433 : cluster [DBG] pgmap v3663: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:35.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:50:35 gibba015 bash[29377]: cluster 2021-03-10T15:50:34.238802+0000 mgr.gibba045.orlgmj (mgr.34412) 6433 : cluster [DBG] pgmap v3663: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:35.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:50:35 gibba015 bash[30343]: cluster 2021-03-10T15:50:34.238802+0000 mgr.gibba045.orlgmj (mgr.34412) 6433 : cluster [DBG] pgmap v3663: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:37.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:50:37 gibba015 bash[29377]: cluster 2021-03-10T15:50:36.240323+0000 mgr.gibba045.orlgmj (mgr.34412) 6434 : cluster [DBG] pgmap v3664: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:37.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:50:37 gibba015 bash[29377]: audit 2021-03-10T15:50:36.426899+0000 mon.c (mon.1) 1797 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:50:37.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:50:37 gibba015 bash[29377]: cephadm 2021-03-10T15:50:36.435530+0000 mgr.gibba045.orlgmj (mgr.34412) 6435 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:50:37.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:50:37 gibba015 bash[29377]: cephadm 2021-03-10T15:50:36.437047+0000 mgr.gibba045.orlgmj (mgr.34412) 6436 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:50:37.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:50:37 gibba015 bash[29377]: audit 2021-03-10T15:50:36.678086+0000 mon.a (mon.0) 1576 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:50:37.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:50:37 gibba015 bash[29377]: audit 2021-03-10T15:50:36.682069+0000 mon.c (mon.1) 1798 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:50:37.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:50:37 gibba015 bash[29377]: audit 2021-03-10T15:50:36.684063+0000 mon.c (mon.1) 1799 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:50:37.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:50:37 gibba015 bash[29377]: audit 2021-03-10T15:50:36.686062+0000 mon.c (mon.1) 1800 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:50:37.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:50:37 gibba015 bash[29377]: audit 2021-03-10T15:50:36.687652+0000 mon.c (mon.1) 1801 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:50:37.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:50:37 gibba015 bash[29377]: audit 2021-03-10T15:50:36.691264+0000 mon.c (mon.1) 1802 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:50:37.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:50:37 gibba015 bash[29377]: audit 2021-03-10T15:50:36.693260+0000 mon.c (mon.1) 1803 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:50:37.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:50:37 gibba015 bash[30343]: cluster 2021-03-10T15:50:36.240323+0000 mgr.gibba045.orlgmj (mgr.34412) 6434 : cluster [DBG] pgmap v3664: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:37.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:50:37 gibba015 bash[30343]: audit 2021-03-10T15:50:36.426899+0000 mon.c (mon.1) 1797 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:50:37.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:50:37 gibba015 bash[30343]: cephadm 2021-03-10T15:50:36.435530+0000 mgr.gibba045.orlgmj (mgr.34412) 6435 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:50:37.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:50:37 gibba015 bash[30343]: cephadm 2021-03-10T15:50:36.437047+0000 mgr.gibba045.orlgmj (mgr.34412) 6436 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:50:37.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:50:37 gibba015 bash[30343]: audit 2021-03-10T15:50:36.678086+0000 mon.a (mon.0) 1576 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:50:37.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:50:37 gibba015 bash[30343]: audit 2021-03-10T15:50:36.682069+0000 mon.c (mon.1) 1798 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:50:37.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:50:37 gibba015 bash[30343]: audit 2021-03-10T15:50:36.684063+0000 mon.c (mon.1) 1799 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:50:37.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:50:37 gibba015 bash[30343]: audit 2021-03-10T15:50:36.686062+0000 mon.c (mon.1) 1800 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:50:37.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:50:37 gibba015 bash[30343]: audit 2021-03-10T15:50:36.687652+0000 mon.c (mon.1) 1801 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:50:37.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:50:37 gibba015 bash[30343]: audit 2021-03-10T15:50:36.691264+0000 mon.c (mon.1) 1802 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:50:37.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:50:37 gibba015 bash[30343]: audit 2021-03-10T15:50:36.693260+0000 mon.c (mon.1) 1803 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:50:37.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:50:37 gibba045 bash[25517]: cluster 2021-03-10T15:50:36.240323+0000 mgr.gibba045.orlgmj (mgr.34412) 6434 : cluster [DBG] pgmap v3664: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:37.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:50:37 gibba045 bash[25517]: audit 2021-03-10T15:50:36.426899+0000 mon.c (mon.1) 1797 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:50:37.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:50:37 gibba045 bash[25517]: cephadm 2021-03-10T15:50:36.435530+0000 mgr.gibba045.orlgmj (mgr.34412) 6435 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:50:37.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:50:37 gibba045 bash[25517]: cephadm 2021-03-10T15:50:36.437047+0000 mgr.gibba045.orlgmj (mgr.34412) 6436 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:50:37.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:50:37 gibba045 bash[25517]: audit 2021-03-10T15:50:36.678086+0000 mon.a (mon.0) 1576 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:50:37.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:50:37 gibba045 bash[25517]: audit 2021-03-10T15:50:36.682069+0000 mon.c (mon.1) 1798 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:50:37.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:50:37 gibba045 bash[25517]: audit 2021-03-10T15:50:36.684063+0000 mon.c (mon.1) 1799 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:50:37.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:50:37 gibba045 bash[25517]: audit 2021-03-10T15:50:36.686062+0000 mon.c (mon.1) 1800 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:50:37.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:50:37 gibba045 bash[25517]: audit 2021-03-10T15:50:36.687652+0000 mon.c (mon.1) 1801 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:50:37.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:50:37 gibba045 bash[25517]: audit 2021-03-10T15:50:36.691264+0000 mon.c (mon.1) 1802 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:50:37.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:50:37 gibba045 bash[25517]: audit 2021-03-10T15:50:36.693260+0000 mon.c (mon.1) 1803 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:50:38.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:50:38 gibba015 bash[29377]: cephadm 2021-03-10T15:50:36.683948+0000 mgr.gibba045.orlgmj (mgr.34412) 6437 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:50:38.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:50:38 gibba015 bash[29377]: cephadm 2021-03-10T15:50:36.686471+0000 mgr.gibba045.orlgmj (mgr.34412) 6438 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:50:38.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:50:38 gibba015 bash[29377]: cephadm 2021-03-10T15:50:36.688266+0000 mgr.gibba045.orlgmj (mgr.34412) 6439 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:50:38.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:50:38 gibba015 bash[29377]: cephadm 2021-03-10T15:50:36.688309+0000 mgr.gibba045.orlgmj (mgr.34412) 6440 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:50:38.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:50:38 gibba015 bash[29377]: cephadm 2021-03-10T15:50:36.690147+0000 mgr.gibba045.orlgmj (mgr.34412) 6441 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:50:38.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:50:38 gibba015 bash[29377]: cephadm 2021-03-10T15:50:36.690192+0000 mgr.gibba045.orlgmj (mgr.34412) 6442 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:50:38.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:50:38 gibba015 bash[29377]: cephadm 2021-03-10T15:50:36.691473+0000 mgr.gibba045.orlgmj (mgr.34412) 6443 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:50:38.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:50:38 gibba015 bash[29377]: cephadm 2021-03-10T15:50:36.693526+0000 mgr.gibba045.orlgmj (mgr.34412) 6444 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:50:38.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:50:38 gibba015 bash[29377]: cephadm 2021-03-10T15:50:36.693569+0000 mgr.gibba045.orlgmj (mgr.34412) 6445 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:50:38.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:50:38 gibba015 bash[29377]: cephadm 2021-03-10T15:50:36.695329+0000 mgr.gibba045.orlgmj (mgr.34412) 6446 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:50:38.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:50:38 gibba015 bash[29377]: cephadm 2021-03-10T15:50:36.695740+0000 mgr.gibba045.orlgmj (mgr.34412) 6447 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:50:38.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:50:38 gibba015 bash[29377]: cephadm 2021-03-10T15:50:36.697494+0000 mgr.gibba045.orlgmj (mgr.34412) 6448 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:50:38.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:50:38 gibba015 bash[29377]: cephadm 2021-03-10T15:50:36.697544+0000 mgr.gibba045.orlgmj (mgr.34412) 6449 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:50:38.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:50:38 gibba015 bash[29377]: cephadm 2021-03-10T15:50:36.697683+0000 mgr.gibba045.orlgmj (mgr.34412) 6450 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:50:38.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:50:38 gibba015 bash[30343]: cephadm 2021-03-10T15:50:36.683948+0000 mgr.gibba045.orlgmj (mgr.34412) 6437 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:50:38.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:50:38 gibba015 bash[30343]: cephadm 2021-03-10T15:50:36.686471+0000 mgr.gibba045.orlgmj (mgr.34412) 6438 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:50:38.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:50:38 gibba015 bash[30343]: cephadm 2021-03-10T15:50:36.688266+0000 mgr.gibba045.orlgmj (mgr.34412) 6439 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:50:38.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:50:38 gibba015 bash[30343]: cephadm 2021-03-10T15:50:36.688309+0000 mgr.gibba045.orlgmj (mgr.34412) 6440 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:50:38.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:50:38 gibba015 bash[30343]: cephadm 2021-03-10T15:50:36.690147+0000 mgr.gibba045.orlgmj (mgr.34412) 6441 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:50:38.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:50:38 gibba015 bash[30343]: cephadm 2021-03-10T15:50:36.690192+0000 mgr.gibba045.orlgmj (mgr.34412) 6442 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:50:38.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:50:38 gibba015 bash[30343]: cephadm 2021-03-10T15:50:36.691473+0000 mgr.gibba045.orlgmj (mgr.34412) 6443 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:50:38.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:50:38 gibba015 bash[30343]: cephadm 2021-03-10T15:50:36.693526+0000 mgr.gibba045.orlgmj (mgr.34412) 6444 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:50:38.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:50:38 gibba015 bash[30343]: cephadm 2021-03-10T15:50:36.693569+0000 mgr.gibba045.orlgmj (mgr.34412) 6445 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:50:38.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:50:38 gibba015 bash[30343]: cephadm 2021-03-10T15:50:36.695329+0000 mgr.gibba045.orlgmj (mgr.34412) 6446 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:50:38.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:50:38 gibba015 bash[30343]: cephadm 2021-03-10T15:50:36.695740+0000 mgr.gibba045.orlgmj (mgr.34412) 6447 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:50:38.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:50:38 gibba015 bash[30343]: cephadm 2021-03-10T15:50:36.697494+0000 mgr.gibba045.orlgmj (mgr.34412) 6448 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:50:38.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:50:38 gibba015 bash[30343]: cephadm 2021-03-10T15:50:36.697544+0000 mgr.gibba045.orlgmj (mgr.34412) 6449 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:50:38.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:50:38 gibba015 bash[30343]: cephadm 2021-03-10T15:50:36.697683+0000 mgr.gibba045.orlgmj (mgr.34412) 6450 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:50:38.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:50:38 gibba045 bash[25517]: cephadm 2021-03-10T15:50:36.683948+0000 mgr.gibba045.orlgmj (mgr.34412) 6437 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:50:38.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:50:38 gibba045 bash[25517]: cephadm 2021-03-10T15:50:36.686471+0000 mgr.gibba045.orlgmj (mgr.34412) 6438 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:50:38.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:50:38 gibba045 bash[25517]: cephadm 2021-03-10T15:50:36.688266+0000 mgr.gibba045.orlgmj (mgr.34412) 6439 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:50:38.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:50:38 gibba045 bash[25517]: cephadm 2021-03-10T15:50:36.688309+0000 mgr.gibba045.orlgmj (mgr.34412) 6440 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:50:38.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:50:38 gibba045 bash[25517]: cephadm 2021-03-10T15:50:36.690147+0000 mgr.gibba045.orlgmj (mgr.34412) 6441 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:50:38.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:50:38 gibba045 bash[25517]: cephadm 2021-03-10T15:50:36.690192+0000 mgr.gibba045.orlgmj (mgr.34412) 6442 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:50:38.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:50:38 gibba045 bash[25517]: cephadm 2021-03-10T15:50:36.691473+0000 mgr.gibba045.orlgmj (mgr.34412) 6443 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:50:38.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:50:38 gibba045 bash[25517]: cephadm 2021-03-10T15:50:36.693526+0000 mgr.gibba045.orlgmj (mgr.34412) 6444 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:50:38.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:50:38 gibba045 bash[25517]: cephadm 2021-03-10T15:50:36.693569+0000 mgr.gibba045.orlgmj (mgr.34412) 6445 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:50:38.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:50:38 gibba045 bash[25517]: cephadm 2021-03-10T15:50:36.695329+0000 mgr.gibba045.orlgmj (mgr.34412) 6446 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:50:38.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:50:38 gibba045 bash[25517]: cephadm 2021-03-10T15:50:36.695740+0000 mgr.gibba045.orlgmj (mgr.34412) 6447 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:50:38.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:50:38 gibba045 bash[25517]: cephadm 2021-03-10T15:50:36.697494+0000 mgr.gibba045.orlgmj (mgr.34412) 6448 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:50:38.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:50:38 gibba045 bash[25517]: cephadm 2021-03-10T15:50:36.697544+0000 mgr.gibba045.orlgmj (mgr.34412) 6449 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:50:38.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:50:38 gibba045 bash[25517]: cephadm 2021-03-10T15:50:36.697683+0000 mgr.gibba045.orlgmj (mgr.34412) 6450 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:50:39.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:50:39 gibba015 bash[29377]: cluster 2021-03-10T15:50:38.242045+0000 mgr.gibba045.orlgmj (mgr.34412) 6451 : cluster [DBG] pgmap v3665: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:39.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:50:39 gibba015 bash[30343]: cluster 2021-03-10T15:50:38.242045+0000 mgr.gibba045.orlgmj (mgr.34412) 6451 : cluster [DBG] pgmap v3665: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:39.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:50:39 gibba045 bash[25517]: cluster 2021-03-10T15:50:38.242045+0000 mgr.gibba045.orlgmj (mgr.34412) 6451 : cluster [DBG] pgmap v3665: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:41.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:50:40 gibba015 bash[29377]: cluster 2021-03-10T15:50:40.243439+0000 mgr.gibba045.orlgmj (mgr.34412) 6452 : cluster [DBG] pgmap v3666: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:41.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:50:40 gibba015 bash[30343]: cluster 2021-03-10T15:50:40.243439+0000 mgr.gibba045.orlgmj (mgr.34412) 6452 : cluster [DBG] pgmap v3666: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:41.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:50:40 gibba045 bash[25517]: cluster 2021-03-10T15:50:40.243439+0000 mgr.gibba045.orlgmj (mgr.34412) 6452 : cluster [DBG] pgmap v3666: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:43.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:50:43 gibba015 bash[29377]: cluster 2021-03-10T15:50:42.245290+0000 mgr.gibba045.orlgmj (mgr.34412) 6453 : cluster [DBG] pgmap v3667: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:43.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:50:43 gibba015 bash[30343]: cluster 2021-03-10T15:50:42.245290+0000 mgr.gibba045.orlgmj (mgr.34412) 6453 : cluster [DBG] pgmap v3667: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:43.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:50:43 gibba045 bash[25517]: cluster 2021-03-10T15:50:42.245290+0000 mgr.gibba045.orlgmj (mgr.34412) 6453 : cluster [DBG] pgmap v3667: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:45.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:50:45 gibba015 bash[29377]: cluster 2021-03-10T15:50:44.246680+0000 mgr.gibba045.orlgmj (mgr.34412) 6454 : cluster [DBG] pgmap v3668: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:45.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:50:45 gibba015 bash[30343]: cluster 2021-03-10T15:50:44.246680+0000 mgr.gibba045.orlgmj (mgr.34412) 6454 : cluster [DBG] pgmap v3668: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:45.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:50:45 gibba045 bash[25517]: cluster 2021-03-10T15:50:44.246680+0000 mgr.gibba045.orlgmj (mgr.34412) 6454 : cluster [DBG] pgmap v3668: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:47.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:50:47 gibba015 bash[29377]: cluster 2021-03-10T15:50:46.248558+0000 mgr.gibba045.orlgmj (mgr.34412) 6455 : cluster [DBG] pgmap v3669: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:47.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:50:47 gibba015 bash[30343]: cluster 2021-03-10T15:50:46.248558+0000 mgr.gibba045.orlgmj (mgr.34412) 6455 : cluster [DBG] pgmap v3669: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:47.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:50:47 gibba045 bash[25517]: cluster 2021-03-10T15:50:46.248558+0000 mgr.gibba045.orlgmj (mgr.34412) 6455 : cluster [DBG] pgmap v3669: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:49.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:50:49 gibba015 bash[29377]: cluster 2021-03-10T15:50:48.250016+0000 mgr.gibba045.orlgmj (mgr.34412) 6456 : cluster [DBG] pgmap v3670: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:49.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:50:49 gibba015 bash[30343]: cluster 2021-03-10T15:50:48.250016+0000 mgr.gibba045.orlgmj (mgr.34412) 6456 : cluster [DBG] pgmap v3670: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:49.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:50:49 gibba045 bash[25517]: cluster 2021-03-10T15:50:48.250016+0000 mgr.gibba045.orlgmj (mgr.34412) 6456 : cluster [DBG] pgmap v3670: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:51.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:50:50 gibba015 bash[29377]: cluster 2021-03-10T15:50:50.251669+0000 mgr.gibba045.orlgmj (mgr.34412) 6457 : cluster [DBG] pgmap v3671: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:51.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:50:50 gibba015 bash[30343]: cluster 2021-03-10T15:50:50.251669+0000 mgr.gibba045.orlgmj (mgr.34412) 6457 : cluster [DBG] pgmap v3671: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:51.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:50:50 gibba045 bash[25517]: cluster 2021-03-10T15:50:50.251669+0000 mgr.gibba045.orlgmj (mgr.34412) 6457 : cluster [DBG] pgmap v3671: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:53.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:50:53 gibba015 bash[29377]: cephadm 2021-03-10T15:50:51.713690+0000 mgr.gibba045.orlgmj (mgr.34412) 6458 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:50:53.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:50:53 gibba015 bash[29377]: cluster 2021-03-10T15:50:52.253352+0000 mgr.gibba045.orlgmj (mgr.34412) 6459 : cluster [DBG] pgmap v3672: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:53.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:50:53 gibba015 bash[30343]: cephadm 2021-03-10T15:50:51.713690+0000 mgr.gibba045.orlgmj (mgr.34412) 6458 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:50:53.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:50:53 gibba015 bash[30343]: cluster 2021-03-10T15:50:52.253352+0000 mgr.gibba045.orlgmj (mgr.34412) 6459 : cluster [DBG] pgmap v3672: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:53.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:50:53 gibba045 bash[25517]: cephadm 2021-03-10T15:50:51.713690+0000 mgr.gibba045.orlgmj (mgr.34412) 6458 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:50:53.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:50:53 gibba045 bash[25517]: cluster 2021-03-10T15:50:52.253352+0000 mgr.gibba045.orlgmj (mgr.34412) 6459 : cluster [DBG] pgmap v3672: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:54.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:50:54 gibba015 bash[29377]: audit 2021-03-10T15:50:53.310972+0000 mon.c (mon.1) 1804 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:50:54.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:50:54 gibba015 bash[29377]: audit 2021-03-10T15:50:53.311370+0000 mon.c (mon.1) 1805 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:50:54.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:50:54 gibba015 bash[29377]: audit 2021-03-10T15:50:53.318348+0000 mon.a (mon.0) 1577 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:50:54.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:50:54 gibba015 bash[29377]: audit 2021-03-10T15:50:53.318473+0000 mon.a (mon.0) 1578 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:50:54.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:50:54 gibba015 bash[29377]: audit 2021-03-10T15:50:53.320573+0000 mon.c (mon.1) 1806 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T15:50:54.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:50:54 gibba015 bash[29377]: audit 2021-03-10T15:50:53.320793+0000 mon.c (mon.1) 1807 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T15:50:54.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:50:54 gibba015 bash[29377]: audit 2021-03-10T15:50:53.320906+0000 mon.a (mon.0) 1579 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T15:50:54.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:50:54 gibba015 bash[29377]: audit 2021-03-10T15:50:53.320911+0000 mon.c (mon.1) 1808 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:50:54.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:50:54 gibba015 bash[29377]: audit 2021-03-10T15:50:53.321080+0000 mon.c (mon.1) 1809 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:50:54.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:50:54 gibba015 bash[29377]: audit 2021-03-10T15:50:53.321189+0000 mon.a (mon.0) 1580 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T15:50:54.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:50:54 gibba015 bash[29377]: audit 2021-03-10T15:50:53.321368+0000 mon.a (mon.0) 1581 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:50:54.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:50:54 gibba015 bash[29377]: audit 2021-03-10T15:50:53.321517+0000 mon.a (mon.0) 1582 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:50:54.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:50:54 gibba015 bash[30343]: audit 2021-03-10T15:50:53.310972+0000 mon.c (mon.1) 1804 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:50:54.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:50:54 gibba015 bash[30343]: audit 2021-03-10T15:50:53.311370+0000 mon.c (mon.1) 1805 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:50:54.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:50:54 gibba015 bash[30343]: audit 2021-03-10T15:50:53.318348+0000 mon.a (mon.0) 1577 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:50:54.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:50:54 gibba015 bash[30343]: audit 2021-03-10T15:50:53.318473+0000 mon.a (mon.0) 1578 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:50:54.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:50:54 gibba015 bash[30343]: audit 2021-03-10T15:50:53.320573+0000 mon.c (mon.1) 1806 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T15:50:54.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:50:54 gibba015 bash[30343]: audit 2021-03-10T15:50:53.320793+0000 mon.c (mon.1) 1807 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T15:50:54.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:50:54 gibba015 bash[30343]: audit 2021-03-10T15:50:53.320906+0000 mon.a (mon.0) 1579 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T15:50:54.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:50:54 gibba015 bash[30343]: audit 2021-03-10T15:50:53.320911+0000 mon.c (mon.1) 1808 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:50:54.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:50:54 gibba015 bash[30343]: audit 2021-03-10T15:50:53.321080+0000 mon.c (mon.1) 1809 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:50:54.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:50:54 gibba015 bash[30343]: audit 2021-03-10T15:50:53.321189+0000 mon.a (mon.0) 1580 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T15:50:54.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:50:54 gibba015 bash[30343]: audit 2021-03-10T15:50:53.321368+0000 mon.a (mon.0) 1581 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:50:54.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:50:54 gibba015 bash[30343]: audit 2021-03-10T15:50:53.321517+0000 mon.a (mon.0) 1582 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:50:54.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:50:54 gibba045 bash[25517]: audit 2021-03-10T15:50:53.310972+0000 mon.c (mon.1) 1804 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:50:54.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:50:54 gibba045 bash[25517]: audit 2021-03-10T15:50:53.311370+0000 mon.c (mon.1) 1805 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:50:54.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:50:54 gibba045 bash[25517]: audit 2021-03-10T15:50:53.318348+0000 mon.a (mon.0) 1577 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:50:54.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:50:54 gibba045 bash[25517]: audit 2021-03-10T15:50:53.318473+0000 mon.a (mon.0) 1578 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:50:54.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:50:54 gibba045 bash[25517]: audit 2021-03-10T15:50:53.320573+0000 mon.c (mon.1) 1806 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T15:50:54.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:50:54 gibba045 bash[25517]: audit 2021-03-10T15:50:53.320793+0000 mon.c (mon.1) 1807 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T15:50:54.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:50:54 gibba045 bash[25517]: audit 2021-03-10T15:50:53.320906+0000 mon.a (mon.0) 1579 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T15:50:54.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:50:54 gibba045 bash[25517]: audit 2021-03-10T15:50:53.320911+0000 mon.c (mon.1) 1808 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:50:54.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:50:54 gibba045 bash[25517]: audit 2021-03-10T15:50:53.321080+0000 mon.c (mon.1) 1809 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:50:54.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:50:54 gibba045 bash[25517]: audit 2021-03-10T15:50:53.321189+0000 mon.a (mon.0) 1580 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T15:50:54.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:50:54 gibba045 bash[25517]: audit 2021-03-10T15:50:53.321368+0000 mon.a (mon.0) 1581 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:50:54.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:50:54 gibba045 bash[25517]: audit 2021-03-10T15:50:53.321517+0000 mon.a (mon.0) 1582 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:50:55.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:50:55 gibba015 bash[29377]: cluster 2021-03-10T15:50:54.254938+0000 mgr.gibba045.orlgmj (mgr.34412) 6460 : cluster [DBG] pgmap v3673: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:55.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:50:55 gibba015 bash[30343]: cluster 2021-03-10T15:50:54.254938+0000 mgr.gibba045.orlgmj (mgr.34412) 6460 : cluster [DBG] pgmap v3673: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:55.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:50:55 gibba045 bash[25517]: cluster 2021-03-10T15:50:54.254938+0000 mgr.gibba045.orlgmj (mgr.34412) 6460 : cluster [DBG] pgmap v3673: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:57.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:50:57 gibba015 bash[29377]: cluster 2021-03-10T15:50:56.256562+0000 mgr.gibba045.orlgmj (mgr.34412) 6461 : cluster [DBG] pgmap v3674: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:57.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:50:57 gibba015 bash[30343]: cluster 2021-03-10T15:50:56.256562+0000 mgr.gibba045.orlgmj (mgr.34412) 6461 : cluster [DBG] pgmap v3674: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:57.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:50:57 gibba045 bash[25517]: cluster 2021-03-10T15:50:56.256562+0000 mgr.gibba045.orlgmj (mgr.34412) 6461 : cluster [DBG] pgmap v3674: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:59.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:50:59 gibba015 bash[29377]: cluster 2021-03-10T15:50:58.258286+0000 mgr.gibba045.orlgmj (mgr.34412) 6462 : cluster [DBG] pgmap v3675: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:59.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:50:59 gibba015 bash[30343]: cluster 2021-03-10T15:50:58.258286+0000 mgr.gibba045.orlgmj (mgr.34412) 6462 : cluster [DBG] pgmap v3675: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:59.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:50:59 gibba045 bash[25517]: cluster 2021-03-10T15:50:58.258286+0000 mgr.gibba045.orlgmj (mgr.34412) 6462 : cluster [DBG] pgmap v3675: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:01.128 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:51:01.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:51:00 gibba015 bash[29377]: cluster 2021-03-10T15:51:00.259895+0000 mgr.gibba045.orlgmj (mgr.34412) 6463 : cluster [DBG] pgmap v3676: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:01.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:51:00 gibba015 bash[30343]: cluster 2021-03-10T15:51:00.259895+0000 mgr.gibba045.orlgmj (mgr.34412) 6463 : cluster [DBG] pgmap v3676: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:01.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:51:00 gibba045 bash[25517]: cluster 2021-03-10T15:51:00.259895+0000 mgr.gibba045.orlgmj (mgr.34412) 6463 : cluster [DBG] pgmap v3676: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:01.355 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:51:01.355 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 5m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:51:01.355 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 4m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:51:01.356 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:51:01.356 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:51:01.356 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:51:01.356 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:51:01.357 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:51:01.357 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:51:01.357 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 5m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:51:01.357 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 4m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:51:01.358 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:51:01.358 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (119m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:51:01.358 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (119m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:51:01.358 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (118m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:51:01.359 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (118m) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:51:01.359 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (117m) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:51:01.359 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (117m) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:51:01.359 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (117m) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:51:01.360 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 4m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:51:01.360 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 4m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T15:51:01.602 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:51:01.602 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:51:01.603 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:51:01.603 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:51:01.603 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:51:01.603 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:51:01.604 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:51:01.604 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:51:01.604 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:51:01.604 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:51:01.605 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:51:01.605 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:51:01.605 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:51:01.605 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:51:01.605 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:51:02.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:51:01 gibba045 bash[25517]: audit 2021-03-10T15:51:01.119717+0000 mgr.gibba045.orlgmj (mgr.34412) 6464 : audit [DBG] from='client.48390 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:51:02.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:51:01 gibba045 bash[25517]: audit 2021-03-10T15:51:01.342985+0000 mgr.gibba045.orlgmj (mgr.34412) 6465 : audit [DBG] from='client.58384 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:51:02.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:51:01 gibba045 bash[25517]: audit 2021-03-10T15:51:01.599729+0000 mon.a (mon.0) 1583 : audit [DBG] from='client.? 172.21.2.115:0/1829010093' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:51:02.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:51:01 gibba015 bash[29377]: audit 2021-03-10T15:51:01.119717+0000 mgr.gibba045.orlgmj (mgr.34412) 6464 : audit [DBG] from='client.48390 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:51:02.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:51:01 gibba015 bash[29377]: audit 2021-03-10T15:51:01.342985+0000 mgr.gibba045.orlgmj (mgr.34412) 6465 : audit [DBG] from='client.58384 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:51:02.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:51:01 gibba015 bash[29377]: audit 2021-03-10T15:51:01.599729+0000 mon.a (mon.0) 1583 : audit [DBG] from='client.? 172.21.2.115:0/1829010093' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:51:02.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:51:01 gibba015 bash[30343]: audit 2021-03-10T15:51:01.119717+0000 mgr.gibba045.orlgmj (mgr.34412) 6464 : audit [DBG] from='client.48390 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:51:02.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:51:01 gibba015 bash[30343]: audit 2021-03-10T15:51:01.342985+0000 mgr.gibba045.orlgmj (mgr.34412) 6465 : audit [DBG] from='client.58384 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:51:02.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:51:01 gibba015 bash[30343]: audit 2021-03-10T15:51:01.599729+0000 mon.a (mon.0) 1583 : audit [DBG] from='client.? 172.21.2.115:0/1829010093' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:51:03.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:51:02 gibba045 bash[25517]: cluster 2021-03-10T15:51:02.261430+0000 mgr.gibba045.orlgmj (mgr.34412) 6466 : cluster [DBG] pgmap v3677: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:03.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:51:02 gibba015 bash[29377]: cluster 2021-03-10T15:51:02.261430+0000 mgr.gibba045.orlgmj (mgr.34412) 6466 : cluster [DBG] pgmap v3677: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:03.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:51:02 gibba015 bash[30343]: cluster 2021-03-10T15:51:02.261430+0000 mgr.gibba045.orlgmj (mgr.34412) 6466 : cluster [DBG] pgmap v3677: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:05.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:51:05 gibba015 bash[29377]: cluster 2021-03-10T15:51:04.262679+0000 mgr.gibba045.orlgmj (mgr.34412) 6467 : cluster [DBG] pgmap v3678: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:05.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:51:05 gibba015 bash[30343]: cluster 2021-03-10T15:51:04.262679+0000 mgr.gibba045.orlgmj (mgr.34412) 6467 : cluster [DBG] pgmap v3678: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:05.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:51:05 gibba045 bash[25517]: cluster 2021-03-10T15:51:04.262679+0000 mgr.gibba045.orlgmj (mgr.34412) 6467 : cluster [DBG] pgmap v3678: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:07.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:51:07 gibba015 bash[29377]: cluster 2021-03-10T15:51:06.264370+0000 mgr.gibba045.orlgmj (mgr.34412) 6468 : cluster [DBG] pgmap v3679: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:07.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:51:07 gibba015 bash[30343]: cluster 2021-03-10T15:51:06.264370+0000 mgr.gibba045.orlgmj (mgr.34412) 6468 : cluster [DBG] pgmap v3679: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:07.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:51:07 gibba045 bash[25517]: cluster 2021-03-10T15:51:06.264370+0000 mgr.gibba045.orlgmj (mgr.34412) 6468 : cluster [DBG] pgmap v3679: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:08.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:51:08 gibba015 bash[29377]: cephadm 2021-03-10T15:51:06.721295+0000 mgr.gibba045.orlgmj (mgr.34412) 6469 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:51:08.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:51:08 gibba015 bash[30343]: cephadm 2021-03-10T15:51:06.721295+0000 mgr.gibba045.orlgmj (mgr.34412) 6469 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:51:08.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:51:08 gibba045 bash[25517]: cephadm 2021-03-10T15:51:06.721295+0000 mgr.gibba045.orlgmj (mgr.34412) 6469 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:51:09.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:51:09 gibba015 bash[29377]: cluster 2021-03-10T15:51:08.266390+0000 mgr.gibba045.orlgmj (mgr.34412) 6470 : cluster [DBG] pgmap v3680: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:09.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:51:09 gibba015 bash[30343]: cluster 2021-03-10T15:51:08.266390+0000 mgr.gibba045.orlgmj (mgr.34412) 6470 : cluster [DBG] pgmap v3680: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:09.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:51:09 gibba045 bash[25517]: cluster 2021-03-10T15:51:08.266390+0000 mgr.gibba045.orlgmj (mgr.34412) 6470 : cluster [DBG] pgmap v3680: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:11.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:51:10 gibba045 bash[25517]: cluster 2021-03-10T15:51:10.268388+0000 mgr.gibba045.orlgmj (mgr.34412) 6471 : cluster [DBG] pgmap v3681: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:11.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:51:10 gibba015 bash[29377]: cluster 2021-03-10T15:51:10.268388+0000 mgr.gibba045.orlgmj (mgr.34412) 6471 : cluster [DBG] pgmap v3681: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:11.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:51:10 gibba015 bash[30343]: cluster 2021-03-10T15:51:10.268388+0000 mgr.gibba045.orlgmj (mgr.34412) 6471 : cluster [DBG] pgmap v3681: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:13.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:51:13 gibba015 bash[29377]: cluster 2021-03-10T15:51:12.269901+0000 mgr.gibba045.orlgmj (mgr.34412) 6472 : cluster [DBG] pgmap v3682: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:13.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:51:13 gibba015 bash[30343]: cluster 2021-03-10T15:51:12.269901+0000 mgr.gibba045.orlgmj (mgr.34412) 6472 : cluster [DBG] pgmap v3682: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:13.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:51:13 gibba045 bash[25517]: cluster 2021-03-10T15:51:12.269901+0000 mgr.gibba045.orlgmj (mgr.34412) 6472 : cluster [DBG] pgmap v3682: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:15.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:51:15 gibba015 bash[29377]: cluster 2021-03-10T15:51:14.271265+0000 mgr.gibba045.orlgmj (mgr.34412) 6473 : cluster [DBG] pgmap v3683: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:15.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:51:15 gibba015 bash[30343]: cluster 2021-03-10T15:51:14.271265+0000 mgr.gibba045.orlgmj (mgr.34412) 6473 : cluster [DBG] pgmap v3683: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:15.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:51:15 gibba045 bash[25517]: cluster 2021-03-10T15:51:14.271265+0000 mgr.gibba045.orlgmj (mgr.34412) 6473 : cluster [DBG] pgmap v3683: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:17.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:51:17 gibba015 bash[29377]: cluster 2021-03-10T15:51:16.271769+0000 mgr.gibba045.orlgmj (mgr.34412) 6474 : cluster [DBG] pgmap v3684: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:17.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:51:17 gibba015 bash[30343]: cluster 2021-03-10T15:51:16.271769+0000 mgr.gibba045.orlgmj (mgr.34412) 6474 : cluster [DBG] pgmap v3684: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:17.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:51:17 gibba045 bash[25517]: cluster 2021-03-10T15:51:16.271769+0000 mgr.gibba045.orlgmj (mgr.34412) 6474 : cluster [DBG] pgmap v3684: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:19.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:51:19 gibba015 bash[29377]: cluster 2021-03-10T15:51:18.273036+0000 mgr.gibba045.orlgmj (mgr.34412) 6475 : cluster [DBG] pgmap v3685: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:19.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:51:19 gibba015 bash[30343]: cluster 2021-03-10T15:51:18.273036+0000 mgr.gibba045.orlgmj (mgr.34412) 6475 : cluster [DBG] pgmap v3685: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:19.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:51:19 gibba045 bash[25517]: cluster 2021-03-10T15:51:18.273036+0000 mgr.gibba045.orlgmj (mgr.34412) 6475 : cluster [DBG] pgmap v3685: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:21.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:51:20 gibba045 bash[25517]: cluster 2021-03-10T15:51:20.274707+0000 mgr.gibba045.orlgmj (mgr.34412) 6476 : cluster [DBG] pgmap v3686: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:21.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:51:20 gibba015 bash[29377]: cluster 2021-03-10T15:51:20.274707+0000 mgr.gibba045.orlgmj (mgr.34412) 6476 : cluster [DBG] pgmap v3686: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:21.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:51:20 gibba015 bash[30343]: cluster 2021-03-10T15:51:20.274707+0000 mgr.gibba045.orlgmj (mgr.34412) 6476 : cluster [DBG] pgmap v3686: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:23.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:51:23 gibba015 bash[29377]: cephadm 2021-03-10T15:51:21.737347+0000 mgr.gibba045.orlgmj (mgr.34412) 6477 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:51:23.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:51:23 gibba015 bash[29377]: cluster 2021-03-10T15:51:22.276473+0000 mgr.gibba045.orlgmj (mgr.34412) 6478 : cluster [DBG] pgmap v3687: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:23.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:51:23 gibba015 bash[30343]: cephadm 2021-03-10T15:51:21.737347+0000 mgr.gibba045.orlgmj (mgr.34412) 6477 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:51:23.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:51:23 gibba015 bash[30343]: cluster 2021-03-10T15:51:22.276473+0000 mgr.gibba045.orlgmj (mgr.34412) 6478 : cluster [DBG] pgmap v3687: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:23.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:51:23 gibba045 bash[25517]: cephadm 2021-03-10T15:51:21.737347+0000 mgr.gibba045.orlgmj (mgr.34412) 6477 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:51:23.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:51:23 gibba045 bash[25517]: cluster 2021-03-10T15:51:22.276473+0000 mgr.gibba045.orlgmj (mgr.34412) 6478 : cluster [DBG] pgmap v3687: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:25.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:51:25 gibba015 bash[29377]: cluster 2021-03-10T15:51:24.276900+0000 mgr.gibba045.orlgmj (mgr.34412) 6479 : cluster [DBG] pgmap v3688: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:25.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:51:25 gibba015 bash[30343]: cluster 2021-03-10T15:51:24.276900+0000 mgr.gibba045.orlgmj (mgr.34412) 6479 : cluster [DBG] pgmap v3688: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:25.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:51:25 gibba045 bash[25517]: cluster 2021-03-10T15:51:24.276900+0000 mgr.gibba045.orlgmj (mgr.34412) 6479 : cluster [DBG] pgmap v3688: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:27.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:51:27 gibba015 bash[29377]: cluster 2021-03-10T15:51:26.278556+0000 mgr.gibba045.orlgmj (mgr.34412) 6480 : cluster [DBG] pgmap v3689: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:27.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:51:27 gibba015 bash[30343]: cluster 2021-03-10T15:51:26.278556+0000 mgr.gibba045.orlgmj (mgr.34412) 6480 : cluster [DBG] pgmap v3689: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:27.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:51:27 gibba045 bash[25517]: cluster 2021-03-10T15:51:26.278556+0000 mgr.gibba045.orlgmj (mgr.34412) 6480 : cluster [DBG] pgmap v3689: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:29.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:51:29 gibba015 bash[29377]: cluster 2021-03-10T15:51:28.280174+0000 mgr.gibba045.orlgmj (mgr.34412) 6481 : cluster [DBG] pgmap v3690: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:29.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:51:29 gibba015 bash[30343]: cluster 2021-03-10T15:51:28.280174+0000 mgr.gibba045.orlgmj (mgr.34412) 6481 : cluster [DBG] pgmap v3690: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:29.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:51:29 gibba045 bash[25517]: cluster 2021-03-10T15:51:28.280174+0000 mgr.gibba045.orlgmj (mgr.34412) 6481 : cluster [DBG] pgmap v3690: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:31.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:51:30 gibba045 bash[25517]: cluster 2021-03-10T15:51:30.281709+0000 mgr.gibba045.orlgmj (mgr.34412) 6482 : cluster [DBG] pgmap v3691: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:31.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:51:30 gibba015 bash[29377]: cluster 2021-03-10T15:51:30.281709+0000 mgr.gibba045.orlgmj (mgr.34412) 6482 : cluster [DBG] pgmap v3691: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:31.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:51:30 gibba015 bash[30343]: cluster 2021-03-10T15:51:30.281709+0000 mgr.gibba045.orlgmj (mgr.34412) 6482 : cluster [DBG] pgmap v3691: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:31.846 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:51:32.072 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:51:32.072 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 6m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:51:32.072 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 5m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:51:32.073 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:51:32.073 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:51:32.073 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:51:32.073 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:51:32.073 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:51:32.074 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:51:32.074 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 6m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:51:32.074 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 5m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:51:32.074 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:51:32.075 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:51:32.075 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (119m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:51:32.075 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (119m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:51:32.075 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (118m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:51:32.076 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (118m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:51:32.076 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (117m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:51:32.076 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (117m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:51:32.076 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 5m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:51:32.077 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 5m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T15:51:32.321 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:51:32.321 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:51:32.321 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:51:32.322 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:51:32.322 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:51:32.322 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:51:32.322 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:51:32.323 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:51:32.323 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:51:32.323 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:51:32.323 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:51:32.323 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:51:32.324 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:51:32.324 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:51:32.324 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:51:32.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:51:32 gibba015 bash[29377]: audit 2021-03-10T15:51:32.318587+0000 mon.a (mon.0) 1584 : audit [DBG] from='client.? 172.21.2.115:0/1599761885' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:51:32.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:51:32 gibba015 bash[30343]: audit 2021-03-10T15:51:32.318587+0000 mon.a (mon.0) 1584 : audit [DBG] from='client.? 172.21.2.115:0/1599761885' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:51:32.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:51:32 gibba045 bash[25517]: audit 2021-03-10T15:51:32.318587+0000 mon.a (mon.0) 1584 : audit [DBG] from='client.? 172.21.2.115:0/1599761885' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:51:33.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:51:33 gibba015 bash[29377]: audit 2021-03-10T15:51:31.838209+0000 mgr.gibba045.orlgmj (mgr.34412) 6483 : audit [DBG] from='client.58396 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:51:33.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:51:33 gibba015 bash[29377]: audit 2021-03-10T15:51:32.060090+0000 mgr.gibba045.orlgmj (mgr.34412) 6484 : audit [DBG] from='client.58402 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:51:33.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:51:33 gibba015 bash[29377]: cluster 2021-03-10T15:51:32.282254+0000 mgr.gibba045.orlgmj (mgr.34412) 6485 : cluster [DBG] pgmap v3692: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:33.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:51:33 gibba015 bash[30343]: audit 2021-03-10T15:51:31.838209+0000 mgr.gibba045.orlgmj (mgr.34412) 6483 : audit [DBG] from='client.58396 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:51:33.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:51:33 gibba015 bash[30343]: audit 2021-03-10T15:51:32.060090+0000 mgr.gibba045.orlgmj (mgr.34412) 6484 : audit [DBG] from='client.58402 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:51:33.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:51:33 gibba015 bash[30343]: cluster 2021-03-10T15:51:32.282254+0000 mgr.gibba045.orlgmj (mgr.34412) 6485 : cluster [DBG] pgmap v3692: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:33.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:51:33 gibba045 bash[25517]: audit 2021-03-10T15:51:31.838209+0000 mgr.gibba045.orlgmj (mgr.34412) 6483 : audit [DBG] from='client.58396 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:51:33.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:51:33 gibba045 bash[25517]: audit 2021-03-10T15:51:32.060090+0000 mgr.gibba045.orlgmj (mgr.34412) 6484 : audit [DBG] from='client.58402 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:51:33.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:51:33 gibba045 bash[25517]: cluster 2021-03-10T15:51:32.282254+0000 mgr.gibba045.orlgmj (mgr.34412) 6485 : cluster [DBG] pgmap v3692: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:35.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:51:35 gibba015 bash[29377]: cluster 2021-03-10T15:51:34.283717+0000 mgr.gibba045.orlgmj (mgr.34412) 6486 : cluster [DBG] pgmap v3693: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:35.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:51:35 gibba015 bash[30343]: cluster 2021-03-10T15:51:34.283717+0000 mgr.gibba045.orlgmj (mgr.34412) 6486 : cluster [DBG] pgmap v3693: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:35.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:51:35 gibba045 bash[25517]: cluster 2021-03-10T15:51:34.283717+0000 mgr.gibba045.orlgmj (mgr.34412) 6486 : cluster [DBG] pgmap v3693: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:37.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:51:37 gibba015 bash[29377]: cluster 2021-03-10T15:51:36.285539+0000 mgr.gibba045.orlgmj (mgr.34412) 6487 : cluster [DBG] pgmap v3694: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:37.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:51:37 gibba015 bash[29377]: audit 2021-03-10T15:51:36.751373+0000 mon.c (mon.1) 1810 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:51:37.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:51:37 gibba015 bash[29377]: audit 2021-03-10T15:51:36.972515+0000 mon.a (mon.0) 1585 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:51:37.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:51:37 gibba015 bash[29377]: audit 2021-03-10T15:51:36.976281+0000 mon.c (mon.1) 1811 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:51:37.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:51:37 gibba015 bash[29377]: audit 2021-03-10T15:51:36.977455+0000 mon.c (mon.1) 1812 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:51:37.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:51:37 gibba015 bash[29377]: audit 2021-03-10T15:51:36.979033+0000 mon.c (mon.1) 1813 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:51:37.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:51:37 gibba015 bash[29377]: audit 2021-03-10T15:51:36.980854+0000 mon.c (mon.1) 1814 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:51:37.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:51:37 gibba015 bash[29377]: audit 2021-03-10T15:51:36.983823+0000 mon.c (mon.1) 1815 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:51:37.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:51:37 gibba015 bash[29377]: audit 2021-03-10T15:51:36.985275+0000 mon.c (mon.1) 1816 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:51:37.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:51:37 gibba015 bash[30343]: cluster 2021-03-10T15:51:36.285539+0000 mgr.gibba045.orlgmj (mgr.34412) 6487 : cluster [DBG] pgmap v3694: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:37.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:51:37 gibba015 bash[30343]: audit 2021-03-10T15:51:36.751373+0000 mon.c (mon.1) 1810 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:51:37.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:51:37 gibba015 bash[30343]: audit 2021-03-10T15:51:36.972515+0000 mon.a (mon.0) 1585 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:51:37.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:51:37 gibba015 bash[30343]: audit 2021-03-10T15:51:36.976281+0000 mon.c (mon.1) 1811 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:51:37.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:51:37 gibba015 bash[30343]: audit 2021-03-10T15:51:36.977455+0000 mon.c (mon.1) 1812 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:51:37.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:51:37 gibba015 bash[30343]: audit 2021-03-10T15:51:36.979033+0000 mon.c (mon.1) 1813 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:51:37.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:51:37 gibba015 bash[30343]: audit 2021-03-10T15:51:36.980854+0000 mon.c (mon.1) 1814 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:51:37.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:51:37 gibba015 bash[30343]: audit 2021-03-10T15:51:36.983823+0000 mon.c (mon.1) 1815 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:51:37.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:51:37 gibba015 bash[30343]: audit 2021-03-10T15:51:36.985275+0000 mon.c (mon.1) 1816 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:51:37.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:51:37 gibba045 bash[25517]: cluster 2021-03-10T15:51:36.285539+0000 mgr.gibba045.orlgmj (mgr.34412) 6487 : cluster [DBG] pgmap v3694: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:37.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:51:37 gibba045 bash[25517]: audit 2021-03-10T15:51:36.751373+0000 mon.c (mon.1) 1810 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:51:37.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:51:37 gibba045 bash[25517]: audit 2021-03-10T15:51:36.972515+0000 mon.a (mon.0) 1585 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:51:37.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:51:37 gibba045 bash[25517]: audit 2021-03-10T15:51:36.976281+0000 mon.c (mon.1) 1811 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:51:37.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:51:37 gibba045 bash[25517]: audit 2021-03-10T15:51:36.977455+0000 mon.c (mon.1) 1812 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:51:37.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:51:37 gibba045 bash[25517]: audit 2021-03-10T15:51:36.979033+0000 mon.c (mon.1) 1813 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:51:37.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:51:37 gibba045 bash[25517]: audit 2021-03-10T15:51:36.980854+0000 mon.c (mon.1) 1814 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:51:37.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:51:37 gibba045 bash[25517]: audit 2021-03-10T15:51:36.983823+0000 mon.c (mon.1) 1815 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:51:37.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:51:37 gibba045 bash[25517]: audit 2021-03-10T15:51:36.985275+0000 mon.c (mon.1) 1816 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:51:38.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:51:38 gibba015 bash[29377]: cephadm 2021-03-10T15:51:36.760396+0000 mgr.gibba045.orlgmj (mgr.34412) 6488 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:51:38.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:51:38 gibba015 bash[29377]: cephadm 2021-03-10T15:51:36.762030+0000 mgr.gibba045.orlgmj (mgr.34412) 6489 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:51:38.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:51:38 gibba015 bash[29377]: cephadm 2021-03-10T15:51:36.978526+0000 mgr.gibba045.orlgmj (mgr.34412) 6490 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:51:38.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:51:38 gibba015 bash[29377]: cephadm 2021-03-10T15:51:36.980086+0000 mgr.gibba045.orlgmj (mgr.34412) 6491 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:51:38.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:51:38 gibba015 bash[29377]: cephadm 2021-03-10T15:51:36.981259+0000 mgr.gibba045.orlgmj (mgr.34412) 6492 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:51:38.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:51:38 gibba015 bash[29377]: cephadm 2021-03-10T15:51:36.981322+0000 mgr.gibba045.orlgmj (mgr.34412) 6493 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:51:38.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:51:38 gibba015 bash[29377]: cephadm 2021-03-10T15:51:36.983253+0000 mgr.gibba045.orlgmj (mgr.34412) 6494 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:51:38.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:51:38 gibba015 bash[29377]: cephadm 2021-03-10T15:51:36.983293+0000 mgr.gibba045.orlgmj (mgr.34412) 6495 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:51:38.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:51:38 gibba015 bash[29377]: cephadm 2021-03-10T15:51:36.984614+0000 mgr.gibba045.orlgmj (mgr.34412) 6496 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:51:38.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:51:38 gibba015 bash[29377]: cephadm 2021-03-10T15:51:36.986129+0000 mgr.gibba045.orlgmj (mgr.34412) 6497 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:51:38.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:51:38 gibba015 bash[29377]: cephadm 2021-03-10T15:51:36.986164+0000 mgr.gibba045.orlgmj (mgr.34412) 6498 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:51:38.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:51:38 gibba015 bash[29377]: cephadm 2021-03-10T15:51:36.987450+0000 mgr.gibba045.orlgmj (mgr.34412) 6499 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:51:38.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:51:38 gibba015 bash[29377]: cephadm 2021-03-10T15:51:36.987773+0000 mgr.gibba045.orlgmj (mgr.34412) 6500 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:51:38.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:51:38 gibba015 bash[29377]: cephadm 2021-03-10T15:51:36.988916+0000 mgr.gibba045.orlgmj (mgr.34412) 6501 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:51:38.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:51:38 gibba015 bash[29377]: cephadm 2021-03-10T15:51:36.988952+0000 mgr.gibba045.orlgmj (mgr.34412) 6502 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:51:38.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:51:38 gibba015 bash[29377]: cephadm 2021-03-10T15:51:36.989057+0000 mgr.gibba045.orlgmj (mgr.34412) 6503 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:51:38.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:51:38 gibba015 bash[30343]: cephadm 2021-03-10T15:51:36.760396+0000 mgr.gibba045.orlgmj (mgr.34412) 6488 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:51:38.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:51:38 gibba015 bash[30343]: cephadm 2021-03-10T15:51:36.762030+0000 mgr.gibba045.orlgmj (mgr.34412) 6489 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:51:38.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:51:38 gibba015 bash[30343]: cephadm 2021-03-10T15:51:36.978526+0000 mgr.gibba045.orlgmj (mgr.34412) 6490 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:51:38.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:51:38 gibba015 bash[30343]: cephadm 2021-03-10T15:51:36.980086+0000 mgr.gibba045.orlgmj (mgr.34412) 6491 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:51:38.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:51:38 gibba015 bash[30343]: cephadm 2021-03-10T15:51:36.981259+0000 mgr.gibba045.orlgmj (mgr.34412) 6492 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:51:38.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:51:38 gibba015 bash[30343]: cephadm 2021-03-10T15:51:36.981322+0000 mgr.gibba045.orlgmj (mgr.34412) 6493 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:51:38.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:51:38 gibba015 bash[30343]: cephadm 2021-03-10T15:51:36.983253+0000 mgr.gibba045.orlgmj (mgr.34412) 6494 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:51:38.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:51:38 gibba015 bash[30343]: cephadm 2021-03-10T15:51:36.983293+0000 mgr.gibba045.orlgmj (mgr.34412) 6495 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:51:38.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:51:38 gibba015 bash[30343]: cephadm 2021-03-10T15:51:36.984614+0000 mgr.gibba045.orlgmj (mgr.34412) 6496 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:51:38.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:51:38 gibba015 bash[30343]: cephadm 2021-03-10T15:51:36.986129+0000 mgr.gibba045.orlgmj (mgr.34412) 6497 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:51:38.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:51:38 gibba015 bash[30343]: cephadm 2021-03-10T15:51:36.986164+0000 mgr.gibba045.orlgmj (mgr.34412) 6498 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:51:38.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:51:38 gibba015 bash[30343]: cephadm 2021-03-10T15:51:36.987450+0000 mgr.gibba045.orlgmj (mgr.34412) 6499 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:51:38.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:51:38 gibba015 bash[30343]: cephadm 2021-03-10T15:51:36.987773+0000 mgr.gibba045.orlgmj (mgr.34412) 6500 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:51:38.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:51:38 gibba015 bash[30343]: cephadm 2021-03-10T15:51:36.988916+0000 mgr.gibba045.orlgmj (mgr.34412) 6501 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:51:38.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:51:38 gibba015 bash[30343]: cephadm 2021-03-10T15:51:36.988952+0000 mgr.gibba045.orlgmj (mgr.34412) 6502 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:51:38.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:51:38 gibba015 bash[30343]: cephadm 2021-03-10T15:51:36.989057+0000 mgr.gibba045.orlgmj (mgr.34412) 6503 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:51:38.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:51:38 gibba045 bash[25517]: cephadm 2021-03-10T15:51:36.760396+0000 mgr.gibba045.orlgmj (mgr.34412) 6488 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:51:38.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:51:38 gibba045 bash[25517]: cephadm 2021-03-10T15:51:36.762030+0000 mgr.gibba045.orlgmj (mgr.34412) 6489 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:51:38.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:51:38 gibba045 bash[25517]: cephadm 2021-03-10T15:51:36.978526+0000 mgr.gibba045.orlgmj (mgr.34412) 6490 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:51:38.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:51:38 gibba045 bash[25517]: cephadm 2021-03-10T15:51:36.980086+0000 mgr.gibba045.orlgmj (mgr.34412) 6491 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:51:38.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:51:38 gibba045 bash[25517]: cephadm 2021-03-10T15:51:36.981259+0000 mgr.gibba045.orlgmj (mgr.34412) 6492 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:51:38.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:51:38 gibba045 bash[25517]: cephadm 2021-03-10T15:51:36.981322+0000 mgr.gibba045.orlgmj (mgr.34412) 6493 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:51:38.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:51:38 gibba045 bash[25517]: cephadm 2021-03-10T15:51:36.983253+0000 mgr.gibba045.orlgmj (mgr.34412) 6494 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:51:38.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:51:38 gibba045 bash[25517]: cephadm 2021-03-10T15:51:36.983293+0000 mgr.gibba045.orlgmj (mgr.34412) 6495 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:51:38.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:51:38 gibba045 bash[25517]: cephadm 2021-03-10T15:51:36.984614+0000 mgr.gibba045.orlgmj (mgr.34412) 6496 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:51:38.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:51:38 gibba045 bash[25517]: cephadm 2021-03-10T15:51:36.986129+0000 mgr.gibba045.orlgmj (mgr.34412) 6497 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:51:38.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:51:38 gibba045 bash[25517]: cephadm 2021-03-10T15:51:36.986164+0000 mgr.gibba045.orlgmj (mgr.34412) 6498 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:51:38.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:51:38 gibba045 bash[25517]: cephadm 2021-03-10T15:51:36.987450+0000 mgr.gibba045.orlgmj (mgr.34412) 6499 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:51:38.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:51:38 gibba045 bash[25517]: cephadm 2021-03-10T15:51:36.987773+0000 mgr.gibba045.orlgmj (mgr.34412) 6500 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:51:38.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:51:38 gibba045 bash[25517]: cephadm 2021-03-10T15:51:36.988916+0000 mgr.gibba045.orlgmj (mgr.34412) 6501 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:51:38.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:51:38 gibba045 bash[25517]: cephadm 2021-03-10T15:51:36.988952+0000 mgr.gibba045.orlgmj (mgr.34412) 6502 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:51:38.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:51:38 gibba045 bash[25517]: cephadm 2021-03-10T15:51:36.989057+0000 mgr.gibba045.orlgmj (mgr.34412) 6503 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:51:39.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:51:39 gibba015 bash[29377]: cluster 2021-03-10T15:51:38.286941+0000 mgr.gibba045.orlgmj (mgr.34412) 6504 : cluster [DBG] pgmap v3695: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:39.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:51:39 gibba015 bash[30343]: cluster 2021-03-10T15:51:38.286941+0000 mgr.gibba045.orlgmj (mgr.34412) 6504 : cluster [DBG] pgmap v3695: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:39.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:51:39 gibba045 bash[25517]: cluster 2021-03-10T15:51:38.286941+0000 mgr.gibba045.orlgmj (mgr.34412) 6504 : cluster [DBG] pgmap v3695: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:41.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:51:40 gibba045 bash[25517]: cluster 2021-03-10T15:51:40.287699+0000 mgr.gibba045.orlgmj (mgr.34412) 6505 : cluster [DBG] pgmap v3696: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:41.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:51:40 gibba015 bash[29377]: cluster 2021-03-10T15:51:40.287699+0000 mgr.gibba045.orlgmj (mgr.34412) 6505 : cluster [DBG] pgmap v3696: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:41.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:51:40 gibba015 bash[30343]: cluster 2021-03-10T15:51:40.287699+0000 mgr.gibba045.orlgmj (mgr.34412) 6505 : cluster [DBG] pgmap v3696: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:43.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:51:43 gibba015 bash[29377]: cluster 2021-03-10T15:51:42.289247+0000 mgr.gibba045.orlgmj (mgr.34412) 6506 : cluster [DBG] pgmap v3697: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:43.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:51:43 gibba015 bash[30343]: cluster 2021-03-10T15:51:42.289247+0000 mgr.gibba045.orlgmj (mgr.34412) 6506 : cluster [DBG] pgmap v3697: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:43.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:51:43 gibba045 bash[25517]: cluster 2021-03-10T15:51:42.289247+0000 mgr.gibba045.orlgmj (mgr.34412) 6506 : cluster [DBG] pgmap v3697: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:45.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:51:45 gibba015 bash[29377]: cluster 2021-03-10T15:51:44.290568+0000 mgr.gibba045.orlgmj (mgr.34412) 6507 : cluster [DBG] pgmap v3698: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:45.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:51:45 gibba015 bash[30343]: cluster 2021-03-10T15:51:44.290568+0000 mgr.gibba045.orlgmj (mgr.34412) 6507 : cluster [DBG] pgmap v3698: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:45.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:51:45 gibba045 bash[25517]: cluster 2021-03-10T15:51:44.290568+0000 mgr.gibba045.orlgmj (mgr.34412) 6507 : cluster [DBG] pgmap v3698: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:47.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:51:47 gibba015 bash[29377]: cluster 2021-03-10T15:51:46.292077+0000 mgr.gibba045.orlgmj (mgr.34412) 6508 : cluster [DBG] pgmap v3699: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:47.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:51:47 gibba015 bash[30343]: cluster 2021-03-10T15:51:46.292077+0000 mgr.gibba045.orlgmj (mgr.34412) 6508 : cluster [DBG] pgmap v3699: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:47.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:51:47 gibba045 bash[25517]: cluster 2021-03-10T15:51:46.292077+0000 mgr.gibba045.orlgmj (mgr.34412) 6508 : cluster [DBG] pgmap v3699: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:49.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:51:49 gibba015 bash[29377]: cluster 2021-03-10T15:51:48.293456+0000 mgr.gibba045.orlgmj (mgr.34412) 6509 : cluster [DBG] pgmap v3700: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:49.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:51:49 gibba015 bash[30343]: cluster 2021-03-10T15:51:48.293456+0000 mgr.gibba045.orlgmj (mgr.34412) 6509 : cluster [DBG] pgmap v3700: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:49.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:51:49 gibba045 bash[25517]: cluster 2021-03-10T15:51:48.293456+0000 mgr.gibba045.orlgmj (mgr.34412) 6509 : cluster [DBG] pgmap v3700: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:51.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:51:50 gibba045 bash[25517]: cluster 2021-03-10T15:51:50.295082+0000 mgr.gibba045.orlgmj (mgr.34412) 6510 : cluster [DBG] pgmap v3701: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:51.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:51:50 gibba015 bash[29377]: cluster 2021-03-10T15:51:50.295082+0000 mgr.gibba045.orlgmj (mgr.34412) 6510 : cluster [DBG] pgmap v3701: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:51.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:51:50 gibba015 bash[30343]: cluster 2021-03-10T15:51:50.295082+0000 mgr.gibba045.orlgmj (mgr.34412) 6510 : cluster [DBG] pgmap v3701: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:53.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:51:53 gibba015 bash[29377]: cephadm 2021-03-10T15:51:51.999265+0000 mgr.gibba045.orlgmj (mgr.34412) 6511 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:51:53.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:51:53 gibba015 bash[29377]: cluster 2021-03-10T15:51:52.296817+0000 mgr.gibba045.orlgmj (mgr.34412) 6512 : cluster [DBG] pgmap v3702: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:53.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:51:53 gibba015 bash[29377]: audit 2021-03-10T15:51:53.320596+0000 mon.c (mon.1) 1817 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:51:53.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:51:53 gibba015 bash[29377]: audit 2021-03-10T15:51:53.321396+0000 mon.c (mon.1) 1818 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:51:53.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:51:53 gibba015 bash[29377]: audit 2021-03-10T15:51:53.321716+0000 mon.a (mon.0) 1586 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:51:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:51:53 gibba015 bash[29377]: audit 2021-03-10T15:51:53.322895+0000 mon.a (mon.0) 1587 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:51:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:51:53 gibba015 bash[29377]: audit 2021-03-10T15:51:53.324347+0000 mon.c (mon.1) 1819 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T15:51:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:51:53 gibba015 bash[29377]: audit 2021-03-10T15:51:53.325272+0000 mon.c (mon.1) 1820 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:51:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:51:53 gibba015 bash[29377]: audit 2021-03-10T15:51:53.325499+0000 mon.a (mon.0) 1588 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T15:51:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:51:53 gibba015 bash[29377]: audit 2021-03-10T15:51:53.326200+0000 mon.c (mon.1) 1821 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:51:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:51:53 gibba015 bash[29377]: audit 2021-03-10T15:51:53.326701+0000 mon.a (mon.0) 1589 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:51:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:51:53 gibba015 bash[29377]: audit 2021-03-10T15:51:53.327361+0000 mon.c (mon.1) 1822 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:51:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:51:53 gibba015 bash[29377]: audit 2021-03-10T15:51:53.327571+0000 mon.a (mon.0) 1590 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:51:53.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:51:53 gibba015 bash[29377]: audit 2021-03-10T15:51:53.328528+0000 mon.a (mon.0) 1591 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:51:53.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:51:53 gibba015 bash[30343]: cephadm 2021-03-10T15:51:51.999265+0000 mgr.gibba045.orlgmj (mgr.34412) 6511 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:51:53.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:51:53 gibba015 bash[30343]: cluster 2021-03-10T15:51:52.296817+0000 mgr.gibba045.orlgmj (mgr.34412) 6512 : cluster [DBG] pgmap v3702: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:51:53 gibba015 bash[30343]: audit 2021-03-10T15:51:53.320596+0000 mon.c (mon.1) 1817 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:51:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:51:53 gibba015 bash[30343]: audit 2021-03-10T15:51:53.321396+0000 mon.c (mon.1) 1818 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:51:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:51:53 gibba015 bash[30343]: audit 2021-03-10T15:51:53.321716+0000 mon.a (mon.0) 1586 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:51:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:51:53 gibba015 bash[30343]: audit 2021-03-10T15:51:53.322895+0000 mon.a (mon.0) 1587 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:51:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:51:53 gibba015 bash[30343]: audit 2021-03-10T15:51:53.324347+0000 mon.c (mon.1) 1819 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T15:51:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:51:53 gibba015 bash[30343]: audit 2021-03-10T15:51:53.325272+0000 mon.c (mon.1) 1820 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:51:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:51:53 gibba015 bash[30343]: audit 2021-03-10T15:51:53.325499+0000 mon.a (mon.0) 1588 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T15:51:53.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:51:53 gibba015 bash[30343]: audit 2021-03-10T15:51:53.326200+0000 mon.c (mon.1) 1821 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:51:53.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:51:53 gibba015 bash[30343]: audit 2021-03-10T15:51:53.326701+0000 mon.a (mon.0) 1589 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:51:53.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:51:53 gibba015 bash[30343]: audit 2021-03-10T15:51:53.327361+0000 mon.c (mon.1) 1822 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:51:53.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:51:53 gibba015 bash[30343]: audit 2021-03-10T15:51:53.327571+0000 mon.a (mon.0) 1590 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:51:53.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:51:53 gibba015 bash[30343]: audit 2021-03-10T15:51:53.328528+0000 mon.a (mon.0) 1591 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:51:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:51:53 gibba045 bash[25517]: cephadm 2021-03-10T15:51:51.999265+0000 mgr.gibba045.orlgmj (mgr.34412) 6511 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:51:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:51:53 gibba045 bash[25517]: cluster 2021-03-10T15:51:52.296817+0000 mgr.gibba045.orlgmj (mgr.34412) 6512 : cluster [DBG] pgmap v3702: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:51:53 gibba045 bash[25517]: audit 2021-03-10T15:51:53.320596+0000 mon.c (mon.1) 1817 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:51:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:51:53 gibba045 bash[25517]: audit 2021-03-10T15:51:53.321396+0000 mon.c (mon.1) 1818 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:51:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:51:53 gibba045 bash[25517]: audit 2021-03-10T15:51:53.321716+0000 mon.a (mon.0) 1586 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:51:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:51:53 gibba045 bash[25517]: audit 2021-03-10T15:51:53.322895+0000 mon.a (mon.0) 1587 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:51:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:51:53 gibba045 bash[25517]: audit 2021-03-10T15:51:53.324347+0000 mon.c (mon.1) 1819 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T15:51:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:51:53 gibba045 bash[25517]: audit 2021-03-10T15:51:53.325272+0000 mon.c (mon.1) 1820 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:51:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:51:53 gibba045 bash[25517]: audit 2021-03-10T15:51:53.325499+0000 mon.a (mon.0) 1588 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T15:51:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:51:53 gibba045 bash[25517]: audit 2021-03-10T15:51:53.326200+0000 mon.c (mon.1) 1821 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:51:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:51:53 gibba045 bash[25517]: audit 2021-03-10T15:51:53.326701+0000 mon.a (mon.0) 1589 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:51:53.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:51:53 gibba045 bash[25517]: audit 2021-03-10T15:51:53.327361+0000 mon.c (mon.1) 1822 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:51:53.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:51:53 gibba045 bash[25517]: audit 2021-03-10T15:51:53.327571+0000 mon.a (mon.0) 1590 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:51:53.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:51:53 gibba045 bash[25517]: audit 2021-03-10T15:51:53.328528+0000 mon.a (mon.0) 1591 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:51:55.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:51:55 gibba015 bash[29377]: cluster 2021-03-10T15:51:54.298230+0000 mgr.gibba045.orlgmj (mgr.34412) 6513 : cluster [DBG] pgmap v3703: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:55.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:51:55 gibba015 bash[30343]: cluster 2021-03-10T15:51:54.298230+0000 mgr.gibba045.orlgmj (mgr.34412) 6513 : cluster [DBG] pgmap v3703: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:55.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:51:55 gibba045 bash[25517]: cluster 2021-03-10T15:51:54.298230+0000 mgr.gibba045.orlgmj (mgr.34412) 6513 : cluster [DBG] pgmap v3703: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:57.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:51:57 gibba015 bash[29377]: cluster 2021-03-10T15:51:56.298848+0000 mgr.gibba045.orlgmj (mgr.34412) 6514 : cluster [DBG] pgmap v3704: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:57.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:51:57 gibba015 bash[30343]: cluster 2021-03-10T15:51:56.298848+0000 mgr.gibba045.orlgmj (mgr.34412) 6514 : cluster [DBG] pgmap v3704: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:57.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:51:57 gibba045 bash[25517]: cluster 2021-03-10T15:51:56.298848+0000 mgr.gibba045.orlgmj (mgr.34412) 6514 : cluster [DBG] pgmap v3704: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:59.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:51:59 gibba015 bash[29377]: cluster 2021-03-10T15:51:58.300396+0000 mgr.gibba045.orlgmj (mgr.34412) 6515 : cluster [DBG] pgmap v3705: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:59.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:51:59 gibba015 bash[30343]: cluster 2021-03-10T15:51:58.300396+0000 mgr.gibba045.orlgmj (mgr.34412) 6515 : cluster [DBG] pgmap v3705: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:59.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:51:59 gibba045 bash[25517]: cluster 2021-03-10T15:51:58.300396+0000 mgr.gibba045.orlgmj (mgr.34412) 6515 : cluster [DBG] pgmap v3705: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:01.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:52:01 gibba045 bash[25517]: cluster 2021-03-10T15:52:00.301918+0000 mgr.gibba045.orlgmj (mgr.34412) 6516 : cluster [DBG] pgmap v3706: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:01.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:52:00 gibba015 bash[29377]: cluster 2021-03-10T15:52:00.301918+0000 mgr.gibba045.orlgmj (mgr.34412) 6516 : cluster [DBG] pgmap v3706: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:01.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:52:00 gibba015 bash[30343]: cluster 2021-03-10T15:52:00.301918+0000 mgr.gibba045.orlgmj (mgr.34412) 6516 : cluster [DBG] pgmap v3706: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:02.562 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:52:02.815 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:52:02.816 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 6m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:52:02.816 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 5m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:52:02.817 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:52:02.817 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:52:02.817 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:52:02.817 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:52:02.817 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:52:02.818 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:52:02.818 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 6m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:52:02.818 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 5m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:52:02.818 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:52:02.819 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:52:02.819 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:52:02.819 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (119m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:52:02.819 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (119m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:52:02.820 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (118m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:52:02.820 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (118m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:52:02.820 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (118m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:52:02.820 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 5m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:52:02.820 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 5m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T15:52:03.071 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:52:03.071 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:52:03.072 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:52:03.072 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:52:03.072 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:52:03.072 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:52:03.072 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:52:03.073 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:52:03.073 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:52:03.073 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:52:03.073 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:52:03.074 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:52:03.074 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:52:03.074 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:52:03.074 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:52:03.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:52:03 gibba015 bash[29377]: cluster 2021-03-10T15:52:02.303572+0000 mgr.gibba045.orlgmj (mgr.34412) 6517 : cluster [DBG] pgmap v3707: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:03.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:52:03 gibba015 bash[29377]: audit 2021-03-10T15:52:02.554548+0000 mgr.gibba045.orlgmj (mgr.34412) 6518 : audit [DBG] from='client.48426 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:52:03.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:52:03 gibba015 bash[29377]: audit 2021-03-10T15:52:03.068077+0000 mon.a (mon.0) 1592 : audit [DBG] from='client.? 172.21.2.115:0/2928927631' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:52:03.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:52:03 gibba015 bash[30343]: cluster 2021-03-10T15:52:02.303572+0000 mgr.gibba045.orlgmj (mgr.34412) 6517 : cluster [DBG] pgmap v3707: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:03.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:52:03 gibba015 bash[30343]: audit 2021-03-10T15:52:02.554548+0000 mgr.gibba045.orlgmj (mgr.34412) 6518 : audit [DBG] from='client.48426 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:52:03.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:52:03 gibba015 bash[30343]: audit 2021-03-10T15:52:03.068077+0000 mon.a (mon.0) 1592 : audit [DBG] from='client.? 172.21.2.115:0/2928927631' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:52:03.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:52:03 gibba045 bash[25517]: cluster 2021-03-10T15:52:02.303572+0000 mgr.gibba045.orlgmj (mgr.34412) 6517 : cluster [DBG] pgmap v3707: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:03.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:52:03 gibba045 bash[25517]: audit 2021-03-10T15:52:02.554548+0000 mgr.gibba045.orlgmj (mgr.34412) 6518 : audit [DBG] from='client.48426 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:52:03.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:52:03 gibba045 bash[25517]: audit 2021-03-10T15:52:03.068077+0000 mon.a (mon.0) 1592 : audit [DBG] from='client.? 172.21.2.115:0/2928927631' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:52:04.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:52:04 gibba015 bash[29377]: audit 2021-03-10T15:52:02.775640+0000 mgr.gibba045.orlgmj (mgr.34412) 6519 : audit [DBG] from='client.58420 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:52:04.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:52:04 gibba015 bash[30343]: audit 2021-03-10T15:52:02.775640+0000 mgr.gibba045.orlgmj (mgr.34412) 6519 : audit [DBG] from='client.58420 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:52:04.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:52:04 gibba045 bash[25517]: audit 2021-03-10T15:52:02.775640+0000 mgr.gibba045.orlgmj (mgr.34412) 6519 : audit [DBG] from='client.58420 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:52:05.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:52:05 gibba015 bash[29377]: cluster 2021-03-10T15:52:04.304885+0000 mgr.gibba045.orlgmj (mgr.34412) 6520 : cluster [DBG] pgmap v3708: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:05.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:52:05 gibba015 bash[30343]: cluster 2021-03-10T15:52:04.304885+0000 mgr.gibba045.orlgmj (mgr.34412) 6520 : cluster [DBG] pgmap v3708: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:05.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:52:05 gibba045 bash[25517]: cluster 2021-03-10T15:52:04.304885+0000 mgr.gibba045.orlgmj (mgr.34412) 6520 : cluster [DBG] pgmap v3708: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:07.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:52:07 gibba015 bash[29377]: cluster 2021-03-10T15:52:06.306654+0000 mgr.gibba045.orlgmj (mgr.34412) 6521 : cluster [DBG] pgmap v3709: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:07.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:52:07 gibba015 bash[30343]: cluster 2021-03-10T15:52:06.306654+0000 mgr.gibba045.orlgmj (mgr.34412) 6521 : cluster [DBG] pgmap v3709: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:07.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:52:07 gibba045 bash[25517]: cluster 2021-03-10T15:52:06.306654+0000 mgr.gibba045.orlgmj (mgr.34412) 6521 : cluster [DBG] pgmap v3709: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:08.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:52:08 gibba015 bash[29377]: cephadm 2021-03-10T15:52:07.005529+0000 mgr.gibba045.orlgmj (mgr.34412) 6522 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:52:08.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:52:08 gibba015 bash[30343]: cephadm 2021-03-10T15:52:07.005529+0000 mgr.gibba045.orlgmj (mgr.34412) 6522 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:52:08.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:52:08 gibba045 bash[25517]: cephadm 2021-03-10T15:52:07.005529+0000 mgr.gibba045.orlgmj (mgr.34412) 6522 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:52:09.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:52:09 gibba015 bash[29377]: cluster 2021-03-10T15:52:08.308379+0000 mgr.gibba045.orlgmj (mgr.34412) 6523 : cluster [DBG] pgmap v3710: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:09.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:52:09 gibba015 bash[30343]: cluster 2021-03-10T15:52:08.308379+0000 mgr.gibba045.orlgmj (mgr.34412) 6523 : cluster [DBG] pgmap v3710: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:09.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:52:09 gibba045 bash[25517]: cluster 2021-03-10T15:52:08.308379+0000 mgr.gibba045.orlgmj (mgr.34412) 6523 : cluster [DBG] pgmap v3710: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:11.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:52:11 gibba045 bash[25517]: cluster 2021-03-10T15:52:10.310038+0000 mgr.gibba045.orlgmj (mgr.34412) 6524 : cluster [DBG] pgmap v3711: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:11.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:52:11 gibba015 bash[29377]: cluster 2021-03-10T15:52:10.310038+0000 mgr.gibba045.orlgmj (mgr.34412) 6524 : cluster [DBG] pgmap v3711: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:11.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:52:11 gibba015 bash[30343]: cluster 2021-03-10T15:52:10.310038+0000 mgr.gibba045.orlgmj (mgr.34412) 6524 : cluster [DBG] pgmap v3711: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:13.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:52:13 gibba015 bash[29377]: cluster 2021-03-10T15:52:12.311689+0000 mgr.gibba045.orlgmj (mgr.34412) 6525 : cluster [DBG] pgmap v3712: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:13.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:52:13 gibba015 bash[30343]: cluster 2021-03-10T15:52:12.311689+0000 mgr.gibba045.orlgmj (mgr.34412) 6525 : cluster [DBG] pgmap v3712: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:13.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:52:13 gibba045 bash[25517]: cluster 2021-03-10T15:52:12.311689+0000 mgr.gibba045.orlgmj (mgr.34412) 6525 : cluster [DBG] pgmap v3712: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:15.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:52:15 gibba015 bash[29377]: cluster 2021-03-10T15:52:14.313067+0000 mgr.gibba045.orlgmj (mgr.34412) 6526 : cluster [DBG] pgmap v3713: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:15.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:52:15 gibba015 bash[30343]: cluster 2021-03-10T15:52:14.313067+0000 mgr.gibba045.orlgmj (mgr.34412) 6526 : cluster [DBG] pgmap v3713: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:15.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:52:15 gibba045 bash[25517]: cluster 2021-03-10T15:52:14.313067+0000 mgr.gibba045.orlgmj (mgr.34412) 6526 : cluster [DBG] pgmap v3713: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:17.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:52:17 gibba015 bash[29377]: cluster 2021-03-10T15:52:16.314812+0000 mgr.gibba045.orlgmj (mgr.34412) 6527 : cluster [DBG] pgmap v3714: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:17.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:52:17 gibba015 bash[30343]: cluster 2021-03-10T15:52:16.314812+0000 mgr.gibba045.orlgmj (mgr.34412) 6527 : cluster [DBG] pgmap v3714: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:17.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:52:17 gibba045 bash[25517]: cluster 2021-03-10T15:52:16.314812+0000 mgr.gibba045.orlgmj (mgr.34412) 6527 : cluster [DBG] pgmap v3714: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:19.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:52:19 gibba015 bash[29377]: cluster 2021-03-10T15:52:18.316481+0000 mgr.gibba045.orlgmj (mgr.34412) 6528 : cluster [DBG] pgmap v3715: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:19.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:52:19 gibba015 bash[30343]: cluster 2021-03-10T15:52:18.316481+0000 mgr.gibba045.orlgmj (mgr.34412) 6528 : cluster [DBG] pgmap v3715: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:19.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:52:19 gibba045 bash[25517]: cluster 2021-03-10T15:52:18.316481+0000 mgr.gibba045.orlgmj (mgr.34412) 6528 : cluster [DBG] pgmap v3715: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:21.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:52:21 gibba045 bash[25517]: cluster 2021-03-10T15:52:20.317259+0000 mgr.gibba045.orlgmj (mgr.34412) 6529 : cluster [DBG] pgmap v3716: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:21.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:52:21 gibba015 bash[29377]: cluster 2021-03-10T15:52:20.317259+0000 mgr.gibba045.orlgmj (mgr.34412) 6529 : cluster [DBG] pgmap v3716: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:21.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:52:21 gibba015 bash[30343]: cluster 2021-03-10T15:52:20.317259+0000 mgr.gibba045.orlgmj (mgr.34412) 6529 : cluster [DBG] pgmap v3716: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:23.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:52:23 gibba015 bash[29377]: cephadm 2021-03-10T15:52:22.021192+0000 mgr.gibba045.orlgmj (mgr.34412) 6530 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:52:23.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:52:23 gibba015 bash[29377]: cluster 2021-03-10T15:52:22.318757+0000 mgr.gibba045.orlgmj (mgr.34412) 6531 : cluster [DBG] pgmap v3717: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:23.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:52:23 gibba015 bash[30343]: cephadm 2021-03-10T15:52:22.021192+0000 mgr.gibba045.orlgmj (mgr.34412) 6530 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:52:23.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:52:23 gibba015 bash[30343]: cluster 2021-03-10T15:52:22.318757+0000 mgr.gibba045.orlgmj (mgr.34412) 6531 : cluster [DBG] pgmap v3717: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:23.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:52:23 gibba045 bash[25517]: cephadm 2021-03-10T15:52:22.021192+0000 mgr.gibba045.orlgmj (mgr.34412) 6530 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:52:23.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:52:23 gibba045 bash[25517]: cluster 2021-03-10T15:52:22.318757+0000 mgr.gibba045.orlgmj (mgr.34412) 6531 : cluster [DBG] pgmap v3717: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:25.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:52:25 gibba015 bash[29377]: cluster 2021-03-10T15:52:24.319901+0000 mgr.gibba045.orlgmj (mgr.34412) 6532 : cluster [DBG] pgmap v3718: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:25.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:52:25 gibba015 bash[30343]: cluster 2021-03-10T15:52:24.319901+0000 mgr.gibba045.orlgmj (mgr.34412) 6532 : cluster [DBG] pgmap v3718: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:25.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:52:25 gibba045 bash[25517]: cluster 2021-03-10T15:52:24.319901+0000 mgr.gibba045.orlgmj (mgr.34412) 6532 : cluster [DBG] pgmap v3718: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:27.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:52:27 gibba015 bash[29377]: cluster 2021-03-10T15:52:26.321711+0000 mgr.gibba045.orlgmj (mgr.34412) 6533 : cluster [DBG] pgmap v3719: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:27.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:52:27 gibba015 bash[30343]: cluster 2021-03-10T15:52:26.321711+0000 mgr.gibba045.orlgmj (mgr.34412) 6533 : cluster [DBG] pgmap v3719: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:27.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:52:27 gibba045 bash[25517]: cluster 2021-03-10T15:52:26.321711+0000 mgr.gibba045.orlgmj (mgr.34412) 6533 : cluster [DBG] pgmap v3719: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:29.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:52:29 gibba015 bash[29377]: cluster 2021-03-10T15:52:28.322973+0000 mgr.gibba045.orlgmj (mgr.34412) 6534 : cluster [DBG] pgmap v3720: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:29.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:52:29 gibba015 bash[30343]: cluster 2021-03-10T15:52:28.322973+0000 mgr.gibba045.orlgmj (mgr.34412) 6534 : cluster [DBG] pgmap v3720: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:29.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:52:29 gibba045 bash[25517]: cluster 2021-03-10T15:52:28.322973+0000 mgr.gibba045.orlgmj (mgr.34412) 6534 : cluster [DBG] pgmap v3720: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:31.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:52:31 gibba045 bash[25517]: cluster 2021-03-10T15:52:30.324551+0000 mgr.gibba045.orlgmj (mgr.34412) 6535 : cluster [DBG] pgmap v3721: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:31.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:52:31 gibba015 bash[29377]: cluster 2021-03-10T15:52:30.324551+0000 mgr.gibba045.orlgmj (mgr.34412) 6535 : cluster [DBG] pgmap v3721: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:31.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:52:31 gibba015 bash[30343]: cluster 2021-03-10T15:52:30.324551+0000 mgr.gibba045.orlgmj (mgr.34412) 6535 : cluster [DBG] pgmap v3721: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:33.311 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:52:33.540 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:52:33.540 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 7m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:52:33.540 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 6m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:52:33.540 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:52:33.541 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:52:33.541 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:52:33.541 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:52:33.541 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:52:33.542 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:52:33.542 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 7m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:52:33.542 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 6m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:52:33.542 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:52:33.543 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:52:33.543 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:52:33.543 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:52:33.543 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (119m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:52:33.544 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (119m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:52:33.544 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (119m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:52:33.544 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (118m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:52:33.544 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 6m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:52:33.544 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 6m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T15:52:33.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:52:33 gibba015 bash[29377]: cluster 2021-03-10T15:52:32.326020+0000 mgr.gibba045.orlgmj (mgr.34412) 6536 : cluster [DBG] pgmap v3722: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:33.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:52:33 gibba015 bash[30343]: cluster 2021-03-10T15:52:32.326020+0000 mgr.gibba045.orlgmj (mgr.34412) 6536 : cluster [DBG] pgmap v3722: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:33.788 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:52:33.789 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:52:33.789 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:52:33.789 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:52:33.790 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:52:33.790 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:52:33.790 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:52:33.790 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:52:33.790 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:52:33.791 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:52:33.791 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:52:33.791 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:52:33.791 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:52:33.792 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:52:33.792 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:52:33.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:52:33 gibba045 bash[25517]: cluster 2021-03-10T15:52:32.326020+0000 mgr.gibba045.orlgmj (mgr.34412) 6536 : cluster [DBG] pgmap v3722: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:34.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:52:34 gibba015 bash[29377]: audit 2021-03-10T15:52:33.302717+0000 mgr.gibba045.orlgmj (mgr.34412) 6537 : audit [DBG] from='client.58432 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:52:34.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:52:34 gibba015 bash[29377]: audit 2021-03-10T15:52:33.528131+0000 mgr.gibba045.orlgmj (mgr.34412) 6538 : audit [DBG] from='client.48450 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:52:34.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:52:34 gibba015 bash[29377]: audit 2021-03-10T15:52:33.786649+0000 mon.c (mon.1) 1823 : audit [DBG] from='client.? 172.21.2.115:0/4283824256' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:52:34.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:52:34 gibba015 bash[30343]: audit 2021-03-10T15:52:33.302717+0000 mgr.gibba045.orlgmj (mgr.34412) 6537 : audit [DBG] from='client.58432 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:52:34.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:52:34 gibba015 bash[30343]: audit 2021-03-10T15:52:33.528131+0000 mgr.gibba045.orlgmj (mgr.34412) 6538 : audit [DBG] from='client.48450 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:52:34.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:52:34 gibba015 bash[30343]: audit 2021-03-10T15:52:33.786649+0000 mon.c (mon.1) 1823 : audit [DBG] from='client.? 172.21.2.115:0/4283824256' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:52:34.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:52:34 gibba045 bash[25517]: audit 2021-03-10T15:52:33.302717+0000 mgr.gibba045.orlgmj (mgr.34412) 6537 : audit [DBG] from='client.58432 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:52:34.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:52:34 gibba045 bash[25517]: audit 2021-03-10T15:52:33.528131+0000 mgr.gibba045.orlgmj (mgr.34412) 6538 : audit [DBG] from='client.48450 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:52:34.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:52:34 gibba045 bash[25517]: audit 2021-03-10T15:52:33.786649+0000 mon.c (mon.1) 1823 : audit [DBG] from='client.? 172.21.2.115:0/4283824256' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:52:35.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:52:35 gibba015 bash[29377]: cluster 2021-03-10T15:52:34.327366+0000 mgr.gibba045.orlgmj (mgr.34412) 6539 : cluster [DBG] pgmap v3723: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:35.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:52:35 gibba015 bash[30343]: cluster 2021-03-10T15:52:34.327366+0000 mgr.gibba045.orlgmj (mgr.34412) 6539 : cluster [DBG] pgmap v3723: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:35.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:52:35 gibba045 bash[25517]: cluster 2021-03-10T15:52:34.327366+0000 mgr.gibba045.orlgmj (mgr.34412) 6539 : cluster [DBG] pgmap v3723: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:37.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:52:37 gibba015 bash[29377]: cluster 2021-03-10T15:52:36.328310+0000 mgr.gibba045.orlgmj (mgr.34412) 6540 : cluster [DBG] pgmap v3724: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:37.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:52:37 gibba015 bash[29377]: audit 2021-03-10T15:52:37.035376+0000 mon.c (mon.1) 1824 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:52:37.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:52:37 gibba015 bash[29377]: audit 2021-03-10T15:52:37.241703+0000 mon.a (mon.0) 1593 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:52:37.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:52:37 gibba015 bash[29377]: audit 2021-03-10T15:52:37.251224+0000 mon.a (mon.0) 1594 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:52:37.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:52:37 gibba015 bash[30343]: cluster 2021-03-10T15:52:36.328310+0000 mgr.gibba045.orlgmj (mgr.34412) 6540 : cluster [DBG] pgmap v3724: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:37.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:52:37 gibba015 bash[30343]: audit 2021-03-10T15:52:37.035376+0000 mon.c (mon.1) 1824 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:52:37.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:52:37 gibba015 bash[30343]: audit 2021-03-10T15:52:37.241703+0000 mon.a (mon.0) 1593 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:52:37.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:52:37 gibba015 bash[30343]: audit 2021-03-10T15:52:37.251224+0000 mon.a (mon.0) 1594 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:52:37.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:52:37 gibba045 bash[25517]: cluster 2021-03-10T15:52:36.328310+0000 mgr.gibba045.orlgmj (mgr.34412) 6540 : cluster [DBG] pgmap v3724: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:37.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:52:37 gibba045 bash[25517]: audit 2021-03-10T15:52:37.035376+0000 mon.c (mon.1) 1824 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:52:37.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:52:37 gibba045 bash[25517]: audit 2021-03-10T15:52:37.241703+0000 mon.a (mon.0) 1593 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:52:37.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:52:37 gibba045 bash[25517]: audit 2021-03-10T15:52:37.251224+0000 mon.a (mon.0) 1594 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:52:38.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:52:38 gibba015 bash[29377]: cephadm 2021-03-10T15:52:37.245991+0000 mgr.gibba045.orlgmj (mgr.34412) 6541 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:52:38.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:52:38 gibba015 bash[29377]: cephadm 2021-03-10T15:52:37.255198+0000 mgr.gibba045.orlgmj (mgr.34412) 6542 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:52:38.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:52:38 gibba015 bash[29377]: audit 2021-03-10T15:52:37.456149+0000 mon.a (mon.0) 1595 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:52:38.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:52:38 gibba015 bash[29377]: audit 2021-03-10T15:52:37.460076+0000 mon.c (mon.1) 1825 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:52:38.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:52:38 gibba015 bash[29377]: audit 2021-03-10T15:52:37.461311+0000 mon.c (mon.1) 1826 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:52:38.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:52:38 gibba015 bash[29377]: cephadm 2021-03-10T15:52:37.462188+0000 mgr.gibba045.orlgmj (mgr.34412) 6543 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:52:38.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:52:38 gibba015 bash[29377]: audit 2021-03-10T15:52:37.462902+0000 mon.c (mon.1) 1827 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:52:38.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:52:38 gibba015 bash[29377]: cephadm 2021-03-10T15:52:37.463814+0000 mgr.gibba045.orlgmj (mgr.34412) 6544 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:52:38.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:52:38 gibba015 bash[29377]: audit 2021-03-10T15:52:37.464284+0000 mon.c (mon.1) 1828 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:52:38.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:52:38 gibba015 bash[29377]: cephadm 2021-03-10T15:52:37.465164+0000 mgr.gibba045.orlgmj (mgr.34412) 6545 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:52:38.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:52:38 gibba015 bash[29377]: cephadm 2021-03-10T15:52:37.465212+0000 mgr.gibba045.orlgmj (mgr.34412) 6546 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:52:38.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:52:38 gibba015 bash[29377]: cephadm 2021-03-10T15:52:37.466748+0000 mgr.gibba045.orlgmj (mgr.34412) 6547 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:52:38.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:52:38 gibba015 bash[29377]: cephadm 2021-03-10T15:52:37.466791+0000 mgr.gibba045.orlgmj (mgr.34412) 6548 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:52:38.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:52:38 gibba015 bash[29377]: audit 2021-03-10T15:52:37.468006+0000 mon.c (mon.1) 1829 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:52:38.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:52:38 gibba015 bash[29377]: cephadm 2021-03-10T15:52:37.468054+0000 mgr.gibba045.orlgmj (mgr.34412) 6549 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:52:38.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:52:38 gibba015 bash[29377]: audit 2021-03-10T15:52:37.469502+0000 mon.c (mon.1) 1830 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:52:38.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:52:38 gibba015 bash[29377]: cephadm 2021-03-10T15:52:37.470124+0000 mgr.gibba045.orlgmj (mgr.34412) 6550 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:52:38.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:52:38 gibba015 bash[29377]: cephadm 2021-03-10T15:52:37.470174+0000 mgr.gibba045.orlgmj (mgr.34412) 6551 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:52:38.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:52:38 gibba015 bash[29377]: cephadm 2021-03-10T15:52:37.471648+0000 mgr.gibba045.orlgmj (mgr.34412) 6552 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:52:38.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:52:38 gibba015 bash[29377]: cephadm 2021-03-10T15:52:37.472057+0000 mgr.gibba045.orlgmj (mgr.34412) 6553 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:52:38.729 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:52:38 gibba015 bash[29377]: cephadm 2021-03-10T15:52:37.473444+0000 mgr.gibba045.orlgmj (mgr.34412) 6554 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:52:38.729 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:52:38 gibba015 bash[29377]: cephadm 2021-03-10T15:52:37.473494+0000 mgr.gibba045.orlgmj (mgr.34412) 6555 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:52:38.729 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:52:38 gibba015 bash[29377]: cephadm 2021-03-10T15:52:37.473624+0000 mgr.gibba045.orlgmj (mgr.34412) 6556 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:52:38.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:52:38 gibba015 bash[30343]: cephadm 2021-03-10T15:52:37.245991+0000 mgr.gibba045.orlgmj (mgr.34412) 6541 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:52:38.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:52:38 gibba015 bash[30343]: cephadm 2021-03-10T15:52:37.255198+0000 mgr.gibba045.orlgmj (mgr.34412) 6542 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:52:38.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:52:38 gibba015 bash[30343]: audit 2021-03-10T15:52:37.456149+0000 mon.a (mon.0) 1595 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:52:38.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:52:38 gibba015 bash[30343]: audit 2021-03-10T15:52:37.460076+0000 mon.c (mon.1) 1825 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:52:38.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:52:38 gibba015 bash[30343]: audit 2021-03-10T15:52:37.461311+0000 mon.c (mon.1) 1826 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:52:38.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:52:38 gibba015 bash[30343]: cephadm 2021-03-10T15:52:37.462188+0000 mgr.gibba045.orlgmj (mgr.34412) 6543 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:52:38.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:52:38 gibba015 bash[30343]: audit 2021-03-10T15:52:37.462902+0000 mon.c (mon.1) 1827 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:52:38.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:52:38 gibba015 bash[30343]: cephadm 2021-03-10T15:52:37.463814+0000 mgr.gibba045.orlgmj (mgr.34412) 6544 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:52:38.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:52:38 gibba015 bash[30343]: audit 2021-03-10T15:52:37.464284+0000 mon.c (mon.1) 1828 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:52:38.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:52:38 gibba015 bash[30343]: cephadm 2021-03-10T15:52:37.465164+0000 mgr.gibba045.orlgmj (mgr.34412) 6545 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:52:38.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:52:38 gibba015 bash[30343]: cephadm 2021-03-10T15:52:37.465212+0000 mgr.gibba045.orlgmj (mgr.34412) 6546 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:52:38.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:52:38 gibba015 bash[30343]: cephadm 2021-03-10T15:52:37.466748+0000 mgr.gibba045.orlgmj (mgr.34412) 6547 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:52:38.733 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:52:38 gibba015 bash[30343]: cephadm 2021-03-10T15:52:37.466791+0000 mgr.gibba045.orlgmj (mgr.34412) 6548 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:52:38.733 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:52:38 gibba015 bash[30343]: audit 2021-03-10T15:52:37.468006+0000 mon.c (mon.1) 1829 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:52:38.733 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:52:38 gibba015 bash[30343]: cephadm 2021-03-10T15:52:37.468054+0000 mgr.gibba045.orlgmj (mgr.34412) 6549 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:52:38.733 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:52:38 gibba015 bash[30343]: audit 2021-03-10T15:52:37.469502+0000 mon.c (mon.1) 1830 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:52:38.734 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:52:38 gibba015 bash[30343]: cephadm 2021-03-10T15:52:37.470124+0000 mgr.gibba045.orlgmj (mgr.34412) 6550 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:52:38.734 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:52:38 gibba015 bash[30343]: cephadm 2021-03-10T15:52:37.470174+0000 mgr.gibba045.orlgmj (mgr.34412) 6551 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:52:38.734 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:52:38 gibba015 bash[30343]: cephadm 2021-03-10T15:52:37.471648+0000 mgr.gibba045.orlgmj (mgr.34412) 6552 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:52:38.734 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:52:38 gibba015 bash[30343]: cephadm 2021-03-10T15:52:37.472057+0000 mgr.gibba045.orlgmj (mgr.34412) 6553 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:52:38.735 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:52:38 gibba015 bash[30343]: cephadm 2021-03-10T15:52:37.473444+0000 mgr.gibba045.orlgmj (mgr.34412) 6554 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:52:38.735 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:52:38 gibba015 bash[30343]: cephadm 2021-03-10T15:52:37.473494+0000 mgr.gibba045.orlgmj (mgr.34412) 6555 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:52:38.735 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:52:38 gibba015 bash[30343]: cephadm 2021-03-10T15:52:37.473624+0000 mgr.gibba045.orlgmj (mgr.34412) 6556 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:52:38.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:52:38 gibba045 bash[25517]: cephadm 2021-03-10T15:52:37.245991+0000 mgr.gibba045.orlgmj (mgr.34412) 6541 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:52:38.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:52:38 gibba045 bash[25517]: cephadm 2021-03-10T15:52:37.255198+0000 mgr.gibba045.orlgmj (mgr.34412) 6542 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:52:38.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:52:38 gibba045 bash[25517]: audit 2021-03-10T15:52:37.456149+0000 mon.a (mon.0) 1595 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:52:38.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:52:38 gibba045 bash[25517]: audit 2021-03-10T15:52:37.460076+0000 mon.c (mon.1) 1825 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:52:38.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:52:38 gibba045 bash[25517]: audit 2021-03-10T15:52:37.461311+0000 mon.c (mon.1) 1826 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:52:38.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:52:38 gibba045 bash[25517]: cephadm 2021-03-10T15:52:37.462188+0000 mgr.gibba045.orlgmj (mgr.34412) 6543 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:52:38.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:52:38 gibba045 bash[25517]: audit 2021-03-10T15:52:37.462902+0000 mon.c (mon.1) 1827 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:52:38.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:52:38 gibba045 bash[25517]: cephadm 2021-03-10T15:52:37.463814+0000 mgr.gibba045.orlgmj (mgr.34412) 6544 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:52:38.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:52:38 gibba045 bash[25517]: audit 2021-03-10T15:52:37.464284+0000 mon.c (mon.1) 1828 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:52:38.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:52:38 gibba045 bash[25517]: cephadm 2021-03-10T15:52:37.465164+0000 mgr.gibba045.orlgmj (mgr.34412) 6545 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:52:38.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:52:38 gibba045 bash[25517]: cephadm 2021-03-10T15:52:37.465212+0000 mgr.gibba045.orlgmj (mgr.34412) 6546 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:52:38.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:52:38 gibba045 bash[25517]: cephadm 2021-03-10T15:52:37.466748+0000 mgr.gibba045.orlgmj (mgr.34412) 6547 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:52:38.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:52:38 gibba045 bash[25517]: cephadm 2021-03-10T15:52:37.466791+0000 mgr.gibba045.orlgmj (mgr.34412) 6548 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:52:38.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:52:38 gibba045 bash[25517]: audit 2021-03-10T15:52:37.468006+0000 mon.c (mon.1) 1829 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:52:38.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:52:38 gibba045 bash[25517]: cephadm 2021-03-10T15:52:37.468054+0000 mgr.gibba045.orlgmj (mgr.34412) 6549 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:52:38.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:52:38 gibba045 bash[25517]: audit 2021-03-10T15:52:37.469502+0000 mon.c (mon.1) 1830 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:52:38.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:52:38 gibba045 bash[25517]: cephadm 2021-03-10T15:52:37.470124+0000 mgr.gibba045.orlgmj (mgr.34412) 6550 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:52:38.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:52:38 gibba045 bash[25517]: cephadm 2021-03-10T15:52:37.470174+0000 mgr.gibba045.orlgmj (mgr.34412) 6551 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:52:38.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:52:38 gibba045 bash[25517]: cephadm 2021-03-10T15:52:37.471648+0000 mgr.gibba045.orlgmj (mgr.34412) 6552 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:52:38.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:52:38 gibba045 bash[25517]: cephadm 2021-03-10T15:52:37.472057+0000 mgr.gibba045.orlgmj (mgr.34412) 6553 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:52:38.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:52:38 gibba045 bash[25517]: cephadm 2021-03-10T15:52:37.473444+0000 mgr.gibba045.orlgmj (mgr.34412) 6554 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:52:38.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:52:38 gibba045 bash[25517]: cephadm 2021-03-10T15:52:37.473494+0000 mgr.gibba045.orlgmj (mgr.34412) 6555 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:52:38.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:52:38 gibba045 bash[25517]: cephadm 2021-03-10T15:52:37.473624+0000 mgr.gibba045.orlgmj (mgr.34412) 6556 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:52:39.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:52:39 gibba045 bash[25517]: cluster 2021-03-10T15:52:38.329443+0000 mgr.gibba045.orlgmj (mgr.34412) 6557 : cluster [DBG] pgmap v3725: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:39.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:52:39 gibba015 bash[29377]: cluster 2021-03-10T15:52:38.329443+0000 mgr.gibba045.orlgmj (mgr.34412) 6557 : cluster [DBG] pgmap v3725: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:39.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:52:39 gibba015 bash[30343]: cluster 2021-03-10T15:52:38.329443+0000 mgr.gibba045.orlgmj (mgr.34412) 6557 : cluster [DBG] pgmap v3725: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:41.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:52:41 gibba045 bash[25517]: cluster 2021-03-10T15:52:40.330988+0000 mgr.gibba045.orlgmj (mgr.34412) 6558 : cluster [DBG] pgmap v3726: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:41.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:52:41 gibba015 bash[29377]: cluster 2021-03-10T15:52:40.330988+0000 mgr.gibba045.orlgmj (mgr.34412) 6558 : cluster [DBG] pgmap v3726: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:41.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:52:41 gibba015 bash[30343]: cluster 2021-03-10T15:52:40.330988+0000 mgr.gibba045.orlgmj (mgr.34412) 6558 : cluster [DBG] pgmap v3726: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:43.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:52:43 gibba015 bash[29377]: cluster 2021-03-10T15:52:42.332687+0000 mgr.gibba045.orlgmj (mgr.34412) 6559 : cluster [DBG] pgmap v3727: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:43.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:52:43 gibba015 bash[30343]: cluster 2021-03-10T15:52:42.332687+0000 mgr.gibba045.orlgmj (mgr.34412) 6559 : cluster [DBG] pgmap v3727: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:43.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:52:43 gibba045 bash[25517]: cluster 2021-03-10T15:52:42.332687+0000 mgr.gibba045.orlgmj (mgr.34412) 6559 : cluster [DBG] pgmap v3727: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:45.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:52:45 gibba015 bash[29377]: cluster 2021-03-10T15:52:44.333418+0000 mgr.gibba045.orlgmj (mgr.34412) 6560 : cluster [DBG] pgmap v3728: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:45.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:52:45 gibba015 bash[30343]: cluster 2021-03-10T15:52:44.333418+0000 mgr.gibba045.orlgmj (mgr.34412) 6560 : cluster [DBG] pgmap v3728: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:45.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:52:45 gibba045 bash[25517]: cluster 2021-03-10T15:52:44.333418+0000 mgr.gibba045.orlgmj (mgr.34412) 6560 : cluster [DBG] pgmap v3728: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:47.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:52:47 gibba015 bash[29377]: cluster 2021-03-10T15:52:46.335112+0000 mgr.gibba045.orlgmj (mgr.34412) 6561 : cluster [DBG] pgmap v3729: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:47.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:52:47 gibba015 bash[30343]: cluster 2021-03-10T15:52:46.335112+0000 mgr.gibba045.orlgmj (mgr.34412) 6561 : cluster [DBG] pgmap v3729: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:47.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:52:47 gibba045 bash[25517]: cluster 2021-03-10T15:52:46.335112+0000 mgr.gibba045.orlgmj (mgr.34412) 6561 : cluster [DBG] pgmap v3729: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:49.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:52:49 gibba015 bash[29377]: cluster 2021-03-10T15:52:48.336347+0000 mgr.gibba045.orlgmj (mgr.34412) 6562 : cluster [DBG] pgmap v3730: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:49.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:52:49 gibba015 bash[30343]: cluster 2021-03-10T15:52:48.336347+0000 mgr.gibba045.orlgmj (mgr.34412) 6562 : cluster [DBG] pgmap v3730: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:49.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:52:49 gibba045 bash[25517]: cluster 2021-03-10T15:52:48.336347+0000 mgr.gibba045.orlgmj (mgr.34412) 6562 : cluster [DBG] pgmap v3730: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:51.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:52:51 gibba045 bash[25517]: cluster 2021-03-10T15:52:50.338040+0000 mgr.gibba045.orlgmj (mgr.34412) 6563 : cluster [DBG] pgmap v3731: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:51.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:52:51 gibba015 bash[29377]: cluster 2021-03-10T15:52:50.338040+0000 mgr.gibba045.orlgmj (mgr.34412) 6563 : cluster [DBG] pgmap v3731: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:51.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:52:51 gibba015 bash[30343]: cluster 2021-03-10T15:52:50.338040+0000 mgr.gibba045.orlgmj (mgr.34412) 6563 : cluster [DBG] pgmap v3731: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:53.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:52:53 gibba015 bash[29377]: cluster 2021-03-10T15:52:52.339797+0000 mgr.gibba045.orlgmj (mgr.34412) 6564 : cluster [DBG] pgmap v3732: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:53.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:52:53 gibba015 bash[29377]: cephadm 2021-03-10T15:52:52.489211+0000 mgr.gibba045.orlgmj (mgr.34412) 6565 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:52:53.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:52:53 gibba015 bash[29377]: audit 2021-03-10T15:52:53.326598+0000 mon.c (mon.1) 1831 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:52:53.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:52:53 gibba015 bash[29377]: audit 2021-03-10T15:52:53.327217+0000 mon.c (mon.1) 1832 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:52:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:52:53 gibba015 bash[29377]: audit 2021-03-10T15:52:53.327751+0000 mon.a (mon.0) 1596 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:52:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:52:53 gibba015 bash[29377]: audit 2021-03-10T15:52:53.328852+0000 mon.a (mon.0) 1597 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:52:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:52:53 gibba015 bash[29377]: audit 2021-03-10T15:52:53.331651+0000 mon.c (mon.1) 1833 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T15:52:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:52:53 gibba015 bash[29377]: audit 2021-03-10T15:52:53.332346+0000 mon.c (mon.1) 1834 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T15:52:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:52:53 gibba015 bash[29377]: audit 2021-03-10T15:52:53.332795+0000 mon.a (mon.0) 1598 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T15:52:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:52:53 gibba015 bash[29377]: audit 2021-03-10T15:52:53.332998+0000 mon.c (mon.1) 1835 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:52:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:52:53 gibba015 bash[29377]: audit 2021-03-10T15:52:53.333855+0000 mon.c (mon.1) 1836 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:52:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:52:53 gibba015 bash[29377]: audit 2021-03-10T15:52:53.334059+0000 mon.a (mon.0) 1599 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T15:52:53.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:52:53 gibba015 bash[29377]: audit 2021-03-10T15:52:53.335199+0000 mon.a (mon.0) 1600 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:52:53.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:52:53 gibba015 bash[29377]: audit 2021-03-10T15:52:53.336003+0000 mon.a (mon.0) 1601 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:52:53.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:52:53 gibba015 bash[30343]: cluster 2021-03-10T15:52:52.339797+0000 mgr.gibba045.orlgmj (mgr.34412) 6564 : cluster [DBG] pgmap v3732: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:53.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:52:53 gibba015 bash[30343]: cephadm 2021-03-10T15:52:52.489211+0000 mgr.gibba045.orlgmj (mgr.34412) 6565 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:52:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:52:53 gibba015 bash[30343]: audit 2021-03-10T15:52:53.326598+0000 mon.c (mon.1) 1831 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:52:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:52:53 gibba015 bash[30343]: audit 2021-03-10T15:52:53.327217+0000 mon.c (mon.1) 1832 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:52:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:52:53 gibba015 bash[30343]: audit 2021-03-10T15:52:53.327751+0000 mon.a (mon.0) 1596 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:52:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:52:53 gibba015 bash[30343]: audit 2021-03-10T15:52:53.328852+0000 mon.a (mon.0) 1597 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:52:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:52:53 gibba015 bash[30343]: audit 2021-03-10T15:52:53.331651+0000 mon.c (mon.1) 1833 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T15:52:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:52:53 gibba015 bash[30343]: audit 2021-03-10T15:52:53.332346+0000 mon.c (mon.1) 1834 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T15:52:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:52:53 gibba015 bash[30343]: audit 2021-03-10T15:52:53.332795+0000 mon.a (mon.0) 1598 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T15:52:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:52:53 gibba015 bash[30343]: audit 2021-03-10T15:52:53.332998+0000 mon.c (mon.1) 1835 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:52:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:52:53 gibba015 bash[30343]: audit 2021-03-10T15:52:53.333855+0000 mon.c (mon.1) 1836 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:52:53.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:52:53 gibba015 bash[30343]: audit 2021-03-10T15:52:53.334059+0000 mon.a (mon.0) 1599 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T15:52:53.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:52:53 gibba015 bash[30343]: audit 2021-03-10T15:52:53.335199+0000 mon.a (mon.0) 1600 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:52:53.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:52:53 gibba015 bash[30343]: audit 2021-03-10T15:52:53.336003+0000 mon.a (mon.0) 1601 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:52:53.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:52:53 gibba045 bash[25517]: cluster 2021-03-10T15:52:52.339797+0000 mgr.gibba045.orlgmj (mgr.34412) 6564 : cluster [DBG] pgmap v3732: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:53.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:52:53 gibba045 bash[25517]: cephadm 2021-03-10T15:52:52.489211+0000 mgr.gibba045.orlgmj (mgr.34412) 6565 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:52:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:52:53 gibba045 bash[25517]: audit 2021-03-10T15:52:53.326598+0000 mon.c (mon.1) 1831 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:52:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:52:53 gibba045 bash[25517]: audit 2021-03-10T15:52:53.327217+0000 mon.c (mon.1) 1832 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:52:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:52:53 gibba045 bash[25517]: audit 2021-03-10T15:52:53.327751+0000 mon.a (mon.0) 1596 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:52:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:52:53 gibba045 bash[25517]: audit 2021-03-10T15:52:53.328852+0000 mon.a (mon.0) 1597 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:52:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:52:53 gibba045 bash[25517]: audit 2021-03-10T15:52:53.331651+0000 mon.c (mon.1) 1833 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T15:52:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:52:53 gibba045 bash[25517]: audit 2021-03-10T15:52:53.332346+0000 mon.c (mon.1) 1834 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T15:52:53.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:52:53 gibba045 bash[25517]: audit 2021-03-10T15:52:53.332795+0000 mon.a (mon.0) 1598 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T15:52:53.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:52:53 gibba045 bash[25517]: audit 2021-03-10T15:52:53.332998+0000 mon.c (mon.1) 1835 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:52:53.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:52:53 gibba045 bash[25517]: audit 2021-03-10T15:52:53.333855+0000 mon.c (mon.1) 1836 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:52:53.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:52:53 gibba045 bash[25517]: audit 2021-03-10T15:52:53.334059+0000 mon.a (mon.0) 1599 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T15:52:53.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:52:53 gibba045 bash[25517]: audit 2021-03-10T15:52:53.335199+0000 mon.a (mon.0) 1600 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:52:53.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:52:53 gibba045 bash[25517]: audit 2021-03-10T15:52:53.336003+0000 mon.a (mon.0) 1601 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:52:55.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:52:55 gibba015 bash[29377]: cluster 2021-03-10T15:52:54.341221+0000 mgr.gibba045.orlgmj (mgr.34412) 6566 : cluster [DBG] pgmap v3733: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:55.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:52:55 gibba015 bash[30343]: cluster 2021-03-10T15:52:54.341221+0000 mgr.gibba045.orlgmj (mgr.34412) 6566 : cluster [DBG] pgmap v3733: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:55.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:52:55 gibba045 bash[25517]: cluster 2021-03-10T15:52:54.341221+0000 mgr.gibba045.orlgmj (mgr.34412) 6566 : cluster [DBG] pgmap v3733: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:57.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:52:57 gibba015 bash[29377]: cluster 2021-03-10T15:52:56.343151+0000 mgr.gibba045.orlgmj (mgr.34412) 6567 : cluster [DBG] pgmap v3734: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:57.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:52:57 gibba015 bash[30343]: cluster 2021-03-10T15:52:56.343151+0000 mgr.gibba045.orlgmj (mgr.34412) 6567 : cluster [DBG] pgmap v3734: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:57.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:52:57 gibba045 bash[25517]: cluster 2021-03-10T15:52:56.343151+0000 mgr.gibba045.orlgmj (mgr.34412) 6567 : cluster [DBG] pgmap v3734: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:59.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:52:59 gibba015 bash[29377]: cluster 2021-03-10T15:52:58.344594+0000 mgr.gibba045.orlgmj (mgr.34412) 6568 : cluster [DBG] pgmap v3735: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:59.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:52:59 gibba015 bash[30343]: cluster 2021-03-10T15:52:58.344594+0000 mgr.gibba045.orlgmj (mgr.34412) 6568 : cluster [DBG] pgmap v3735: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:59.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:52:59 gibba045 bash[25517]: cluster 2021-03-10T15:52:58.344594+0000 mgr.gibba045.orlgmj (mgr.34412) 6568 : cluster [DBG] pgmap v3735: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:01.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:53:01 gibba045 bash[25517]: cluster 2021-03-10T15:53:00.345783+0000 mgr.gibba045.orlgmj (mgr.34412) 6569 : cluster [DBG] pgmap v3736: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:01.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:53:01 gibba015 bash[29377]: cluster 2021-03-10T15:53:00.345783+0000 mgr.gibba045.orlgmj (mgr.34412) 6569 : cluster [DBG] pgmap v3736: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:01.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:53:01 gibba015 bash[30343]: cluster 2021-03-10T15:53:00.345783+0000 mgr.gibba045.orlgmj (mgr.34412) 6569 : cluster [DBG] pgmap v3736: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:03.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:53:03 gibba015 bash[29377]: cluster 2021-03-10T15:53:02.347536+0000 mgr.gibba045.orlgmj (mgr.34412) 6570 : cluster [DBG] pgmap v3737: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:03.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:53:03 gibba015 bash[30343]: cluster 2021-03-10T15:53:02.347536+0000 mgr.gibba045.orlgmj (mgr.34412) 6570 : cluster [DBG] pgmap v3737: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:03.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:53:03 gibba045 bash[25517]: cluster 2021-03-10T15:53:02.347536+0000 mgr.gibba045.orlgmj (mgr.34412) 6570 : cluster [DBG] pgmap v3737: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:04.033 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:53:04.260 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:53:04.261 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 7m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:53:04.261 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 6m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:53:04.261 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:53:04.261 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:53:04.262 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:53:04.262 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:53:04.262 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:53:04.262 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:53:04.263 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 7m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:53:04.263 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 6m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:53:04.263 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:53:04.263 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:53:04.263 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:53:04.264 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:53:04.264 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:53:04.264 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (119m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:53:04.264 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (119m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:53:04.264 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (119m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:53:04.265 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 6m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:53:04.265 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 6m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T15:53:04.510 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:53:04.510 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:53:04.511 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:53:04.511 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:53:04.511 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:53:04.511 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:53:04.512 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:53:04.512 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:53:04.512 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:53:04.512 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:53:04.512 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:53:04.513 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:53:04.513 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:53:04.513 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:53:04.513 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:53:05.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:53:05 gibba015 bash[29377]: audit 2021-03-10T15:53:04.024572+0000 mgr.gibba045.orlgmj (mgr.34412) 6571 : audit [DBG] from='client.48462 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:53:05.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:53:05 gibba015 bash[29377]: audit 2021-03-10T15:53:04.249773+0000 mgr.gibba045.orlgmj (mgr.34412) 6572 : audit [DBG] from='client.58456 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:53:05.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:53:05 gibba015 bash[29377]: cluster 2021-03-10T15:53:04.348842+0000 mgr.gibba045.orlgmj (mgr.34412) 6573 : cluster [DBG] pgmap v3738: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:05.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:53:05 gibba015 bash[29377]: audit 2021-03-10T15:53:04.508192+0000 mon.a (mon.0) 1602 : audit [DBG] from='client.? 172.21.2.115:0/3362605200' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:53:05.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:53:05 gibba015 bash[30343]: audit 2021-03-10T15:53:04.024572+0000 mgr.gibba045.orlgmj (mgr.34412) 6571 : audit [DBG] from='client.48462 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:53:05.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:53:05 gibba015 bash[30343]: audit 2021-03-10T15:53:04.249773+0000 mgr.gibba045.orlgmj (mgr.34412) 6572 : audit [DBG] from='client.58456 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:53:05.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:53:05 gibba015 bash[30343]: cluster 2021-03-10T15:53:04.348842+0000 mgr.gibba045.orlgmj (mgr.34412) 6573 : cluster [DBG] pgmap v3738: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:05.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:53:05 gibba015 bash[30343]: audit 2021-03-10T15:53:04.508192+0000 mon.a (mon.0) 1602 : audit [DBG] from='client.? 172.21.2.115:0/3362605200' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:53:05.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:53:05 gibba045 bash[25517]: audit 2021-03-10T15:53:04.024572+0000 mgr.gibba045.orlgmj (mgr.34412) 6571 : audit [DBG] from='client.48462 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:53:05.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:53:05 gibba045 bash[25517]: audit 2021-03-10T15:53:04.249773+0000 mgr.gibba045.orlgmj (mgr.34412) 6572 : audit [DBG] from='client.58456 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:53:05.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:53:05 gibba045 bash[25517]: cluster 2021-03-10T15:53:04.348842+0000 mgr.gibba045.orlgmj (mgr.34412) 6573 : cluster [DBG] pgmap v3738: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:05.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:53:05 gibba045 bash[25517]: audit 2021-03-10T15:53:04.508192+0000 mon.a (mon.0) 1602 : audit [DBG] from='client.? 172.21.2.115:0/3362605200' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:53:07.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:53:07 gibba015 bash[29377]: cluster 2021-03-10T15:53:06.350707+0000 mgr.gibba045.orlgmj (mgr.34412) 6574 : cluster [DBG] pgmap v3739: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:07.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:53:07 gibba015 bash[30343]: cluster 2021-03-10T15:53:06.350707+0000 mgr.gibba045.orlgmj (mgr.34412) 6574 : cluster [DBG] pgmap v3739: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:07.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:53:07 gibba045 bash[25517]: cluster 2021-03-10T15:53:06.350707+0000 mgr.gibba045.orlgmj (mgr.34412) 6574 : cluster [DBG] pgmap v3739: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:08.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:53:08 gibba015 bash[29377]: cephadm 2021-03-10T15:53:07.504879+0000 mgr.gibba045.orlgmj (mgr.34412) 6575 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:53:08.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:53:08 gibba015 bash[30343]: cephadm 2021-03-10T15:53:07.504879+0000 mgr.gibba045.orlgmj (mgr.34412) 6575 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:53:08.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:53:08 gibba045 bash[25517]: cephadm 2021-03-10T15:53:07.504879+0000 mgr.gibba045.orlgmj (mgr.34412) 6575 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:53:09.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:53:09 gibba015 bash[29377]: cluster 2021-03-10T15:53:08.351777+0000 mgr.gibba045.orlgmj (mgr.34412) 6576 : cluster [DBG] pgmap v3740: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:09.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:53:09 gibba015 bash[30343]: cluster 2021-03-10T15:53:08.351777+0000 mgr.gibba045.orlgmj (mgr.34412) 6576 : cluster [DBG] pgmap v3740: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:09.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:53:09 gibba045 bash[25517]: cluster 2021-03-10T15:53:08.351777+0000 mgr.gibba045.orlgmj (mgr.34412) 6576 : cluster [DBG] pgmap v3740: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:11.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:53:11 gibba045 bash[25517]: cluster 2021-03-10T15:53:10.353492+0000 mgr.gibba045.orlgmj (mgr.34412) 6577 : cluster [DBG] pgmap v3741: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:11.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:53:11 gibba015 bash[29377]: cluster 2021-03-10T15:53:10.353492+0000 mgr.gibba045.orlgmj (mgr.34412) 6577 : cluster [DBG] pgmap v3741: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:11.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:53:11 gibba015 bash[30343]: cluster 2021-03-10T15:53:10.353492+0000 mgr.gibba045.orlgmj (mgr.34412) 6577 : cluster [DBG] pgmap v3741: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:13.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:53:13 gibba015 bash[29377]: cluster 2021-03-10T15:53:12.354430+0000 mgr.gibba045.orlgmj (mgr.34412) 6578 : cluster [DBG] pgmap v3742: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:13.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:53:13 gibba015 bash[30343]: cluster 2021-03-10T15:53:12.354430+0000 mgr.gibba045.orlgmj (mgr.34412) 6578 : cluster [DBG] pgmap v3742: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:13.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:53:13 gibba045 bash[25517]: cluster 2021-03-10T15:53:12.354430+0000 mgr.gibba045.orlgmj (mgr.34412) 6578 : cluster [DBG] pgmap v3742: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:15.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:53:15 gibba015 bash[29377]: cluster 2021-03-10T15:53:14.355574+0000 mgr.gibba045.orlgmj (mgr.34412) 6579 : cluster [DBG] pgmap v3743: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:15.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:53:15 gibba015 bash[30343]: cluster 2021-03-10T15:53:14.355574+0000 mgr.gibba045.orlgmj (mgr.34412) 6579 : cluster [DBG] pgmap v3743: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:15.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:53:15 gibba045 bash[25517]: cluster 2021-03-10T15:53:14.355574+0000 mgr.gibba045.orlgmj (mgr.34412) 6579 : cluster [DBG] pgmap v3743: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:17.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:53:17 gibba015 bash[29377]: cluster 2021-03-10T15:53:16.357701+0000 mgr.gibba045.orlgmj (mgr.34412) 6580 : cluster [DBG] pgmap v3744: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:17.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:53:17 gibba015 bash[30343]: cluster 2021-03-10T15:53:16.357701+0000 mgr.gibba045.orlgmj (mgr.34412) 6580 : cluster [DBG] pgmap v3744: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:17.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:53:17 gibba045 bash[25517]: cluster 2021-03-10T15:53:16.357701+0000 mgr.gibba045.orlgmj (mgr.34412) 6580 : cluster [DBG] pgmap v3744: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:19.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:53:19 gibba015 bash[29377]: cluster 2021-03-10T15:53:18.358781+0000 mgr.gibba045.orlgmj (mgr.34412) 6581 : cluster [DBG] pgmap v3745: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:19.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:53:19 gibba015 bash[30343]: cluster 2021-03-10T15:53:18.358781+0000 mgr.gibba045.orlgmj (mgr.34412) 6581 : cluster [DBG] pgmap v3745: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:19.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:53:19 gibba045 bash[25517]: cluster 2021-03-10T15:53:18.358781+0000 mgr.gibba045.orlgmj (mgr.34412) 6581 : cluster [DBG] pgmap v3745: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:21.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:53:21 gibba045 bash[25517]: cluster 2021-03-10T15:53:20.360652+0000 mgr.gibba045.orlgmj (mgr.34412) 6582 : cluster [DBG] pgmap v3746: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:21.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:53:21 gibba015 bash[29377]: cluster 2021-03-10T15:53:20.360652+0000 mgr.gibba045.orlgmj (mgr.34412) 6582 : cluster [DBG] pgmap v3746: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:21.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:53:21 gibba015 bash[30343]: cluster 2021-03-10T15:53:20.360652+0000 mgr.gibba045.orlgmj (mgr.34412) 6582 : cluster [DBG] pgmap v3746: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:23.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:53:23 gibba015 bash[29377]: cluster 2021-03-10T15:53:22.362196+0000 mgr.gibba045.orlgmj (mgr.34412) 6583 : cluster [DBG] pgmap v3747: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:23.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:53:23 gibba015 bash[29377]: cephadm 2021-03-10T15:53:22.520827+0000 mgr.gibba045.orlgmj (mgr.34412) 6584 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:53:23.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:53:23 gibba015 bash[30343]: cluster 2021-03-10T15:53:22.362196+0000 mgr.gibba045.orlgmj (mgr.34412) 6583 : cluster [DBG] pgmap v3747: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:23.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:53:23 gibba015 bash[30343]: cephadm 2021-03-10T15:53:22.520827+0000 mgr.gibba045.orlgmj (mgr.34412) 6584 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:53:23.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:53:23 gibba045 bash[25517]: cluster 2021-03-10T15:53:22.362196+0000 mgr.gibba045.orlgmj (mgr.34412) 6583 : cluster [DBG] pgmap v3747: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:23.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:53:23 gibba045 bash[25517]: cephadm 2021-03-10T15:53:22.520827+0000 mgr.gibba045.orlgmj (mgr.34412) 6584 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:53:25.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:53:25 gibba015 bash[29377]: cluster 2021-03-10T15:53:24.363565+0000 mgr.gibba045.orlgmj (mgr.34412) 6585 : cluster [DBG] pgmap v3748: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:25.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:53:25 gibba015 bash[30343]: cluster 2021-03-10T15:53:24.363565+0000 mgr.gibba045.orlgmj (mgr.34412) 6585 : cluster [DBG] pgmap v3748: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:25.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:53:25 gibba045 bash[25517]: cluster 2021-03-10T15:53:24.363565+0000 mgr.gibba045.orlgmj (mgr.34412) 6585 : cluster [DBG] pgmap v3748: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:27.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:53:27 gibba015 bash[29377]: cluster 2021-03-10T15:53:26.365721+0000 mgr.gibba045.orlgmj (mgr.34412) 6586 : cluster [DBG] pgmap v3749: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:27.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:53:27 gibba015 bash[30343]: cluster 2021-03-10T15:53:26.365721+0000 mgr.gibba045.orlgmj (mgr.34412) 6586 : cluster [DBG] pgmap v3749: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:27.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:53:27 gibba045 bash[25517]: cluster 2021-03-10T15:53:26.365721+0000 mgr.gibba045.orlgmj (mgr.34412) 6586 : cluster [DBG] pgmap v3749: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:29.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:53:29 gibba015 bash[29377]: cluster 2021-03-10T15:53:28.366912+0000 mgr.gibba045.orlgmj (mgr.34412) 6587 : cluster [DBG] pgmap v3750: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:29.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:53:29 gibba015 bash[30343]: cluster 2021-03-10T15:53:28.366912+0000 mgr.gibba045.orlgmj (mgr.34412) 6587 : cluster [DBG] pgmap v3750: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:29.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:53:29 gibba045 bash[25517]: cluster 2021-03-10T15:53:28.366912+0000 mgr.gibba045.orlgmj (mgr.34412) 6587 : cluster [DBG] pgmap v3750: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:31.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:53:31 gibba045 bash[25517]: cluster 2021-03-10T15:53:30.368672+0000 mgr.gibba045.orlgmj (mgr.34412) 6588 : cluster [DBG] pgmap v3751: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:31.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:53:31 gibba015 bash[29377]: cluster 2021-03-10T15:53:30.368672+0000 mgr.gibba045.orlgmj (mgr.34412) 6588 : cluster [DBG] pgmap v3751: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:31.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:53:31 gibba015 bash[30343]: cluster 2021-03-10T15:53:30.368672+0000 mgr.gibba045.orlgmj (mgr.34412) 6588 : cluster [DBG] pgmap v3751: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:33.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:53:33 gibba015 bash[29377]: cluster 2021-03-10T15:53:32.370502+0000 mgr.gibba045.orlgmj (mgr.34412) 6589 : cluster [DBG] pgmap v3752: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:33.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:53:33 gibba015 bash[30343]: cluster 2021-03-10T15:53:32.370502+0000 mgr.gibba045.orlgmj (mgr.34412) 6589 : cluster [DBG] pgmap v3752: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:33.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:53:33 gibba045 bash[25517]: cluster 2021-03-10T15:53:32.370502+0000 mgr.gibba045.orlgmj (mgr.34412) 6589 : cluster [DBG] pgmap v3752: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:34.762 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:53:34.993 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:53:34.994 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 8m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:53:34.994 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 7m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:53:34.994 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:53:34.994 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:53:34.995 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:53:34.995 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:53:34.995 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:53:34.995 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:53:34.995 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 8m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:53:34.996 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 7m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:53:34.996 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:53:34.996 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:53:34.996 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:53:34.997 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:53:34.997 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:53:34.997 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:53:34.997 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:53:34.997 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (119m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:53:34.998 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 7m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:53:34.998 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 7m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T15:53:35.244 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:53:35.244 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:53:35.244 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:53:35.245 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:53:35.245 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:53:35.245 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:53:35.245 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:53:35.246 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:53:35.246 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:53:35.246 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:53:35.246 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:53:35.246 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:53:35.247 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:53:35.247 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:53:35.247 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:53:35.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:53:35 gibba015 bash[29377]: cluster 2021-03-10T15:53:34.371690+0000 mgr.gibba045.orlgmj (mgr.34412) 6590 : cluster [DBG] pgmap v3753: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:35.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:53:35 gibba015 bash[29377]: audit 2021-03-10T15:53:35.241984+0000 mon.a (mon.0) 1603 : audit [DBG] from='client.? 172.21.2.115:0/1524922134' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:53:35.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:53:35 gibba015 bash[30343]: cluster 2021-03-10T15:53:34.371690+0000 mgr.gibba045.orlgmj (mgr.34412) 6590 : cluster [DBG] pgmap v3753: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:35.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:53:35 gibba015 bash[30343]: audit 2021-03-10T15:53:35.241984+0000 mon.a (mon.0) 1603 : audit [DBG] from='client.? 172.21.2.115:0/1524922134' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:53:35.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:53:35 gibba045 bash[25517]: cluster 2021-03-10T15:53:34.371690+0000 mgr.gibba045.orlgmj (mgr.34412) 6590 : cluster [DBG] pgmap v3753: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:35.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:53:35 gibba045 bash[25517]: audit 2021-03-10T15:53:35.241984+0000 mon.a (mon.0) 1603 : audit [DBG] from='client.? 172.21.2.115:0/1524922134' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:53:36.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:53:36 gibba015 bash[29377]: audit 2021-03-10T15:53:34.754609+0000 mgr.gibba045.orlgmj (mgr.34412) 6591 : audit [DBG] from='client.58468 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:53:36.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:53:36 gibba015 bash[29377]: audit 2021-03-10T15:53:34.981798+0000 mgr.gibba045.orlgmj (mgr.34412) 6592 : audit [DBG] from='client.48486 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:53:36.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:53:36 gibba015 bash[30343]: audit 2021-03-10T15:53:34.754609+0000 mgr.gibba045.orlgmj (mgr.34412) 6591 : audit [DBG] from='client.58468 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:53:36.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:53:36 gibba015 bash[30343]: audit 2021-03-10T15:53:34.981798+0000 mgr.gibba045.orlgmj (mgr.34412) 6592 : audit [DBG] from='client.48486 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:53:36.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:53:36 gibba045 bash[25517]: audit 2021-03-10T15:53:34.754609+0000 mgr.gibba045.orlgmj (mgr.34412) 6591 : audit [DBG] from='client.58468 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:53:36.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:53:36 gibba045 bash[25517]: audit 2021-03-10T15:53:34.981798+0000 mgr.gibba045.orlgmj (mgr.34412) 6592 : audit [DBG] from='client.48486 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:53:37.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:53:37 gibba015 bash[29377]: cluster 2021-03-10T15:53:36.373720+0000 mgr.gibba045.orlgmj (mgr.34412) 6593 : cluster [DBG] pgmap v3754: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:37.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:53:37 gibba015 bash[30343]: cluster 2021-03-10T15:53:36.373720+0000 mgr.gibba045.orlgmj (mgr.34412) 6593 : cluster [DBG] pgmap v3754: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:37.749 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:53:37 gibba045 bash[25517]: cluster 2021-03-10T15:53:36.373720+0000 mgr.gibba045.orlgmj (mgr.34412) 6593 : cluster [DBG] pgmap v3754: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:38.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:53:38 gibba015 bash[29377]: audit 2021-03-10T15:53:37.538733+0000 mon.c (mon.1) 1837 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:53:38.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:53:38 gibba015 bash[29377]: cephadm 2021-03-10T15:53:37.543790+0000 mgr.gibba045.orlgmj (mgr.34412) 6594 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:53:38.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:53:38 gibba015 bash[29377]: cephadm 2021-03-10T15:53:37.544193+0000 mgr.gibba045.orlgmj (mgr.34412) 6595 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:53:38.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:53:38 gibba015 bash[29377]: audit 2021-03-10T15:53:37.734119+0000 mon.a (mon.0) 1604 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:53:38.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:53:38 gibba015 bash[29377]: audit 2021-03-10T15:53:37.737712+0000 mon.c (mon.1) 1838 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:53:38.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:53:38 gibba015 bash[29377]: audit 2021-03-10T15:53:37.739080+0000 mon.c (mon.1) 1839 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:53:38.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:53:38 gibba015 bash[29377]: audit 2021-03-10T15:53:37.740463+0000 mon.c (mon.1) 1840 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:53:38.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:53:38 gibba015 bash[29377]: audit 2021-03-10T15:53:37.741615+0000 mon.c (mon.1) 1841 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:53:38.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:53:38 gibba015 bash[29377]: audit 2021-03-10T15:53:37.745230+0000 mon.c (mon.1) 1842 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:53:38.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:53:38 gibba015 bash[29377]: audit 2021-03-10T15:53:37.746849+0000 mon.c (mon.1) 1843 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:53:38.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:53:38 gibba015 bash[30343]: audit 2021-03-10T15:53:37.538733+0000 mon.c (mon.1) 1837 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:53:38.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:53:38 gibba015 bash[30343]: cephadm 2021-03-10T15:53:37.543790+0000 mgr.gibba045.orlgmj (mgr.34412) 6594 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:53:38.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:53:38 gibba015 bash[30343]: cephadm 2021-03-10T15:53:37.544193+0000 mgr.gibba045.orlgmj (mgr.34412) 6595 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:53:38.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:53:38 gibba015 bash[30343]: audit 2021-03-10T15:53:37.734119+0000 mon.a (mon.0) 1604 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:53:38.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:53:38 gibba015 bash[30343]: audit 2021-03-10T15:53:37.737712+0000 mon.c (mon.1) 1838 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:53:38.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:53:38 gibba015 bash[30343]: audit 2021-03-10T15:53:37.739080+0000 mon.c (mon.1) 1839 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:53:38.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:53:38 gibba015 bash[30343]: audit 2021-03-10T15:53:37.740463+0000 mon.c (mon.1) 1840 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:53:38.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:53:38 gibba015 bash[30343]: audit 2021-03-10T15:53:37.741615+0000 mon.c (mon.1) 1841 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:53:38.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:53:38 gibba015 bash[30343]: audit 2021-03-10T15:53:37.745230+0000 mon.c (mon.1) 1842 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:53:38.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:53:38 gibba015 bash[30343]: audit 2021-03-10T15:53:37.746849+0000 mon.c (mon.1) 1843 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:53:38.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:53:38 gibba045 bash[25517]: audit 2021-03-10T15:53:37.538733+0000 mon.c (mon.1) 1837 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:53:38.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:53:38 gibba045 bash[25517]: cephadm 2021-03-10T15:53:37.543790+0000 mgr.gibba045.orlgmj (mgr.34412) 6594 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:53:38.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:53:38 gibba045 bash[25517]: cephadm 2021-03-10T15:53:37.544193+0000 mgr.gibba045.orlgmj (mgr.34412) 6595 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:53:38.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:53:38 gibba045 bash[25517]: audit 2021-03-10T15:53:37.734119+0000 mon.a (mon.0) 1604 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:53:38.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:53:38 gibba045 bash[25517]: audit 2021-03-10T15:53:37.737712+0000 mon.c (mon.1) 1838 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:53:38.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:53:38 gibba045 bash[25517]: audit 2021-03-10T15:53:37.739080+0000 mon.c (mon.1) 1839 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:53:38.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:53:38 gibba045 bash[25517]: audit 2021-03-10T15:53:37.740463+0000 mon.c (mon.1) 1840 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:53:38.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:53:38 gibba045 bash[25517]: audit 2021-03-10T15:53:37.741615+0000 mon.c (mon.1) 1841 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:53:38.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:53:38 gibba045 bash[25517]: audit 2021-03-10T15:53:37.745230+0000 mon.c (mon.1) 1842 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:53:38.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:53:38 gibba045 bash[25517]: audit 2021-03-10T15:53:37.746849+0000 mon.c (mon.1) 1843 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:53:39.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:53:39 gibba015 bash[29377]: cephadm 2021-03-10T15:53:37.739779+0000 mgr.gibba045.orlgmj (mgr.34412) 6596 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:53:39.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:53:39 gibba015 bash[29377]: cephadm 2021-03-10T15:53:37.741347+0000 mgr.gibba045.orlgmj (mgr.34412) 6597 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:53:39.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:53:39 gibba015 bash[29377]: cephadm 2021-03-10T15:53:37.742655+0000 mgr.gibba045.orlgmj (mgr.34412) 6598 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:53:39.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:53:39 gibba015 bash[29377]: cephadm 2021-03-10T15:53:37.742786+0000 mgr.gibba045.orlgmj (mgr.34412) 6599 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:53:39.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:53:39 gibba015 bash[29377]: cephadm 2021-03-10T15:53:37.743924+0000 mgr.gibba045.orlgmj (mgr.34412) 6600 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:53:39.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:53:39 gibba015 bash[29377]: cephadm 2021-03-10T15:53:37.743962+0000 mgr.gibba045.orlgmj (mgr.34412) 6601 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:53:39.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:53:39 gibba015 bash[29377]: cephadm 2021-03-10T15:53:37.745720+0000 mgr.gibba045.orlgmj (mgr.34412) 6602 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:53:39.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:53:39 gibba015 bash[29377]: cephadm 2021-03-10T15:53:37.747342+0000 mgr.gibba045.orlgmj (mgr.34412) 6603 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:53:39.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:53:39 gibba015 bash[29377]: cephadm 2021-03-10T15:53:37.747380+0000 mgr.gibba045.orlgmj (mgr.34412) 6604 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:53:39.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:53:39 gibba015 bash[29377]: cephadm 2021-03-10T15:53:37.748793+0000 mgr.gibba045.orlgmj (mgr.34412) 6605 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:53:39.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:53:39 gibba015 bash[29377]: cephadm 2021-03-10T15:53:37.749195+0000 mgr.gibba045.orlgmj (mgr.34412) 6606 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:53:39.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:53:39 gibba015 bash[29377]: cephadm 2021-03-10T15:53:37.750495+0000 mgr.gibba045.orlgmj (mgr.34412) 6607 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:53:39.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:53:39 gibba015 bash[29377]: cephadm 2021-03-10T15:53:37.750534+0000 mgr.gibba045.orlgmj (mgr.34412) 6608 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:53:39.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:53:39 gibba015 bash[29377]: cephadm 2021-03-10T15:53:37.750719+0000 mgr.gibba045.orlgmj (mgr.34412) 6609 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:53:39.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:53:39 gibba015 bash[29377]: cluster 2021-03-10T15:53:38.375035+0000 mgr.gibba045.orlgmj (mgr.34412) 6610 : cluster [DBG] pgmap v3755: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:39.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:53:39 gibba015 bash[30343]: cephadm 2021-03-10T15:53:37.739779+0000 mgr.gibba045.orlgmj (mgr.34412) 6596 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:53:39.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:53:39 gibba015 bash[30343]: cephadm 2021-03-10T15:53:37.741347+0000 mgr.gibba045.orlgmj (mgr.34412) 6597 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:53:39.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:53:39 gibba015 bash[30343]: cephadm 2021-03-10T15:53:37.742655+0000 mgr.gibba045.orlgmj (mgr.34412) 6598 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:53:39.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:53:39 gibba015 bash[30343]: cephadm 2021-03-10T15:53:37.742786+0000 mgr.gibba045.orlgmj (mgr.34412) 6599 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:53:39.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:53:39 gibba015 bash[30343]: cephadm 2021-03-10T15:53:37.743924+0000 mgr.gibba045.orlgmj (mgr.34412) 6600 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:53:39.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:53:39 gibba015 bash[30343]: cephadm 2021-03-10T15:53:37.743962+0000 mgr.gibba045.orlgmj (mgr.34412) 6601 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:53:39.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:53:39 gibba015 bash[30343]: cephadm 2021-03-10T15:53:37.745720+0000 mgr.gibba045.orlgmj (mgr.34412) 6602 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:53:39.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:53:39 gibba015 bash[30343]: cephadm 2021-03-10T15:53:37.747342+0000 mgr.gibba045.orlgmj (mgr.34412) 6603 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:53:39.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:53:39 gibba015 bash[30343]: cephadm 2021-03-10T15:53:37.747380+0000 mgr.gibba045.orlgmj (mgr.34412) 6604 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:53:39.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:53:39 gibba015 bash[30343]: cephadm 2021-03-10T15:53:37.748793+0000 mgr.gibba045.orlgmj (mgr.34412) 6605 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:53:39.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:53:39 gibba015 bash[30343]: cephadm 2021-03-10T15:53:37.749195+0000 mgr.gibba045.orlgmj (mgr.34412) 6606 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:53:39.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:53:39 gibba015 bash[30343]: cephadm 2021-03-10T15:53:37.750495+0000 mgr.gibba045.orlgmj (mgr.34412) 6607 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:53:39.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:53:39 gibba015 bash[30343]: cephadm 2021-03-10T15:53:37.750534+0000 mgr.gibba045.orlgmj (mgr.34412) 6608 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:53:39.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:53:39 gibba015 bash[30343]: cephadm 2021-03-10T15:53:37.750719+0000 mgr.gibba045.orlgmj (mgr.34412) 6609 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:53:39.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:53:39 gibba015 bash[30343]: cluster 2021-03-10T15:53:38.375035+0000 mgr.gibba045.orlgmj (mgr.34412) 6610 : cluster [DBG] pgmap v3755: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:39.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:53:39 gibba045 bash[25517]: cephadm 2021-03-10T15:53:37.739779+0000 mgr.gibba045.orlgmj (mgr.34412) 6596 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:53:39.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:53:39 gibba045 bash[25517]: cephadm 2021-03-10T15:53:37.741347+0000 mgr.gibba045.orlgmj (mgr.34412) 6597 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:53:39.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:53:39 gibba045 bash[25517]: cephadm 2021-03-10T15:53:37.742655+0000 mgr.gibba045.orlgmj (mgr.34412) 6598 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:53:39.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:53:39 gibba045 bash[25517]: cephadm 2021-03-10T15:53:37.742786+0000 mgr.gibba045.orlgmj (mgr.34412) 6599 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:53:39.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:53:39 gibba045 bash[25517]: cephadm 2021-03-10T15:53:37.743924+0000 mgr.gibba045.orlgmj (mgr.34412) 6600 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:53:39.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:53:39 gibba045 bash[25517]: cephadm 2021-03-10T15:53:37.743962+0000 mgr.gibba045.orlgmj (mgr.34412) 6601 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:53:39.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:53:39 gibba045 bash[25517]: cephadm 2021-03-10T15:53:37.745720+0000 mgr.gibba045.orlgmj (mgr.34412) 6602 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:53:39.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:53:39 gibba045 bash[25517]: cephadm 2021-03-10T15:53:37.747342+0000 mgr.gibba045.orlgmj (mgr.34412) 6603 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:53:39.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:53:39 gibba045 bash[25517]: cephadm 2021-03-10T15:53:37.747380+0000 mgr.gibba045.orlgmj (mgr.34412) 6604 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:53:39.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:53:39 gibba045 bash[25517]: cephadm 2021-03-10T15:53:37.748793+0000 mgr.gibba045.orlgmj (mgr.34412) 6605 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:53:39.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:53:39 gibba045 bash[25517]: cephadm 2021-03-10T15:53:37.749195+0000 mgr.gibba045.orlgmj (mgr.34412) 6606 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:53:39.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:53:39 gibba045 bash[25517]: cephadm 2021-03-10T15:53:37.750495+0000 mgr.gibba045.orlgmj (mgr.34412) 6607 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:53:39.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:53:39 gibba045 bash[25517]: cephadm 2021-03-10T15:53:37.750534+0000 mgr.gibba045.orlgmj (mgr.34412) 6608 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:53:39.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:53:39 gibba045 bash[25517]: cephadm 2021-03-10T15:53:37.750719+0000 mgr.gibba045.orlgmj (mgr.34412) 6609 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:53:39.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:53:39 gibba045 bash[25517]: cluster 2021-03-10T15:53:38.375035+0000 mgr.gibba045.orlgmj (mgr.34412) 6610 : cluster [DBG] pgmap v3755: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:41.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:53:41 gibba045 bash[25517]: cluster 2021-03-10T15:53:40.376736+0000 mgr.gibba045.orlgmj (mgr.34412) 6611 : cluster [DBG] pgmap v3756: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:41.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:53:41 gibba015 bash[29377]: cluster 2021-03-10T15:53:40.376736+0000 mgr.gibba045.orlgmj (mgr.34412) 6611 : cluster [DBG] pgmap v3756: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:41.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:53:41 gibba015 bash[30343]: cluster 2021-03-10T15:53:40.376736+0000 mgr.gibba045.orlgmj (mgr.34412) 6611 : cluster [DBG] pgmap v3756: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:43.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:53:43 gibba015 bash[29377]: cluster 2021-03-10T15:53:42.378429+0000 mgr.gibba045.orlgmj (mgr.34412) 6612 : cluster [DBG] pgmap v3757: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:43.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:53:43 gibba015 bash[30343]: cluster 2021-03-10T15:53:42.378429+0000 mgr.gibba045.orlgmj (mgr.34412) 6612 : cluster [DBG] pgmap v3757: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:43.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:53:43 gibba045 bash[25517]: cluster 2021-03-10T15:53:42.378429+0000 mgr.gibba045.orlgmj (mgr.34412) 6612 : cluster [DBG] pgmap v3757: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:45.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:53:45 gibba015 bash[29377]: cluster 2021-03-10T15:53:44.379895+0000 mgr.gibba045.orlgmj (mgr.34412) 6613 : cluster [DBG] pgmap v3758: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:45.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:53:45 gibba015 bash[30343]: cluster 2021-03-10T15:53:44.379895+0000 mgr.gibba045.orlgmj (mgr.34412) 6613 : cluster [DBG] pgmap v3758: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:45.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:53:45 gibba045 bash[25517]: cluster 2021-03-10T15:53:44.379895+0000 mgr.gibba045.orlgmj (mgr.34412) 6613 : cluster [DBG] pgmap v3758: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:47.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:53:47 gibba015 bash[29377]: cluster 2021-03-10T15:53:46.381834+0000 mgr.gibba045.orlgmj (mgr.34412) 6614 : cluster [DBG] pgmap v3759: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:47.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:53:47 gibba015 bash[30343]: cluster 2021-03-10T15:53:46.381834+0000 mgr.gibba045.orlgmj (mgr.34412) 6614 : cluster [DBG] pgmap v3759: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:47.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:53:47 gibba045 bash[25517]: cluster 2021-03-10T15:53:46.381834+0000 mgr.gibba045.orlgmj (mgr.34412) 6614 : cluster [DBG] pgmap v3759: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:49.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:53:49 gibba015 bash[29377]: cluster 2021-03-10T15:53:48.382922+0000 mgr.gibba045.orlgmj (mgr.34412) 6615 : cluster [DBG] pgmap v3760: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:49.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:53:49 gibba015 bash[30343]: cluster 2021-03-10T15:53:48.382922+0000 mgr.gibba045.orlgmj (mgr.34412) 6615 : cluster [DBG] pgmap v3760: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:49.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:53:49 gibba045 bash[25517]: cluster 2021-03-10T15:53:48.382922+0000 mgr.gibba045.orlgmj (mgr.34412) 6615 : cluster [DBG] pgmap v3760: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:51.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:53:51 gibba045 bash[25517]: cluster 2021-03-10T15:53:50.384312+0000 mgr.gibba045.orlgmj (mgr.34412) 6616 : cluster [DBG] pgmap v3761: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:51.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:53:51 gibba015 bash[29377]: cluster 2021-03-10T15:53:50.384312+0000 mgr.gibba045.orlgmj (mgr.34412) 6616 : cluster [DBG] pgmap v3761: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:51.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:53:51 gibba015 bash[30343]: cluster 2021-03-10T15:53:50.384312+0000 mgr.gibba045.orlgmj (mgr.34412) 6616 : cluster [DBG] pgmap v3761: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:53.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:53:53 gibba015 bash[29377]: cluster 2021-03-10T15:53:52.386137+0000 mgr.gibba045.orlgmj (mgr.34412) 6617 : cluster [DBG] pgmap v3762: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:53.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:53:53 gibba015 bash[29377]: audit 2021-03-10T15:53:53.332865+0000 mon.c (mon.1) 1844 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:53:53.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:53:53 gibba015 bash[29377]: audit 2021-03-10T15:53:53.333585+0000 mon.c (mon.1) 1845 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:53:53.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:53:53 gibba015 bash[29377]: audit 2021-03-10T15:53:53.334016+0000 mon.a (mon.0) 1605 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:53:53.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:53:53 gibba015 bash[29377]: audit 2021-03-10T15:53:53.335100+0000 mon.a (mon.0) 1606 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:53:53.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:53:53 gibba015 bash[29377]: audit 2021-03-10T15:53:53.338045+0000 mon.c (mon.1) 1846 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T15:53:53.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:53:53 gibba015 bash[29377]: audit 2021-03-10T15:53:53.338799+0000 mon.c (mon.1) 1847 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:53:53.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:53:53 gibba015 bash[29377]: audit 2021-03-10T15:53:53.339059+0000 mon.a (mon.0) 1607 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T15:53:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:53:53 gibba015 bash[29377]: audit 2021-03-10T15:53:53.339473+0000 mon.c (mon.1) 1848 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:53:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:53:53 gibba015 bash[29377]: audit 2021-03-10T15:53:53.340186+0000 mon.a (mon.0) 1608 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:53:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:53:53 gibba015 bash[29377]: audit 2021-03-10T15:53:53.340303+0000 mon.c (mon.1) 1849 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:53:53.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:53:53 gibba015 bash[29377]: audit 2021-03-10T15:53:53.341222+0000 mon.a (mon.0) 1609 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:53:53.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:53:53 gibba015 bash[29377]: audit 2021-03-10T15:53:53.342301+0000 mon.a (mon.0) 1610 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:53:53.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:53:53 gibba015 bash[30343]: cluster 2021-03-10T15:53:52.386137+0000 mgr.gibba045.orlgmj (mgr.34412) 6617 : cluster [DBG] pgmap v3762: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:53.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:53:53 gibba015 bash[30343]: audit 2021-03-10T15:53:53.332865+0000 mon.c (mon.1) 1844 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:53:53.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:53:53 gibba015 bash[30343]: audit 2021-03-10T15:53:53.333585+0000 mon.c (mon.1) 1845 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:53:53.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:53:53 gibba015 bash[30343]: audit 2021-03-10T15:53:53.334016+0000 mon.a (mon.0) 1605 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:53:53.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:53:53 gibba015 bash[30343]: audit 2021-03-10T15:53:53.335100+0000 mon.a (mon.0) 1606 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:53:53.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:53:53 gibba015 bash[30343]: audit 2021-03-10T15:53:53.338045+0000 mon.c (mon.1) 1846 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T15:53:53.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:53:53 gibba015 bash[30343]: audit 2021-03-10T15:53:53.338799+0000 mon.c (mon.1) 1847 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:53:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:53:53 gibba015 bash[30343]: audit 2021-03-10T15:53:53.339059+0000 mon.a (mon.0) 1607 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T15:53:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:53:53 gibba015 bash[30343]: audit 2021-03-10T15:53:53.339473+0000 mon.c (mon.1) 1848 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:53:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:53:53 gibba015 bash[30343]: audit 2021-03-10T15:53:53.340186+0000 mon.a (mon.0) 1608 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:53:53.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:53:53 gibba015 bash[30343]: audit 2021-03-10T15:53:53.340303+0000 mon.c (mon.1) 1849 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:53:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:53:53 gibba015 bash[30343]: audit 2021-03-10T15:53:53.341222+0000 mon.a (mon.0) 1609 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:53:53.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:53:53 gibba015 bash[30343]: audit 2021-03-10T15:53:53.342301+0000 mon.a (mon.0) 1610 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:53:53.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:53:53 gibba045 bash[25517]: cluster 2021-03-10T15:53:52.386137+0000 mgr.gibba045.orlgmj (mgr.34412) 6617 : cluster [DBG] pgmap v3762: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:53.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:53:53 gibba045 bash[25517]: audit 2021-03-10T15:53:53.332865+0000 mon.c (mon.1) 1844 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:53:53.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:53:53 gibba045 bash[25517]: audit 2021-03-10T15:53:53.333585+0000 mon.c (mon.1) 1845 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:53:53.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:53:53 gibba045 bash[25517]: audit 2021-03-10T15:53:53.334016+0000 mon.a (mon.0) 1605 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:53:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:53:53 gibba045 bash[25517]: audit 2021-03-10T15:53:53.335100+0000 mon.a (mon.0) 1606 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:53:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:53:53 gibba045 bash[25517]: audit 2021-03-10T15:53:53.338045+0000 mon.c (mon.1) 1846 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T15:53:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:53:53 gibba045 bash[25517]: audit 2021-03-10T15:53:53.338799+0000 mon.c (mon.1) 1847 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:53:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:53:53 gibba045 bash[25517]: audit 2021-03-10T15:53:53.339059+0000 mon.a (mon.0) 1607 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T15:53:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:53:53 gibba045 bash[25517]: audit 2021-03-10T15:53:53.339473+0000 mon.c (mon.1) 1848 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:53:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:53:53 gibba045 bash[25517]: audit 2021-03-10T15:53:53.340186+0000 mon.a (mon.0) 1608 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:53:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:53:53 gibba045 bash[25517]: audit 2021-03-10T15:53:53.340303+0000 mon.c (mon.1) 1849 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:53:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:53:53 gibba045 bash[25517]: audit 2021-03-10T15:53:53.341222+0000 mon.a (mon.0) 1609 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:53:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:53:53 gibba045 bash[25517]: audit 2021-03-10T15:53:53.342301+0000 mon.a (mon.0) 1610 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:53:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:53:54 gibba015 bash[29377]: cephadm 2021-03-10T15:53:52.756153+0000 mgr.gibba045.orlgmj (mgr.34412) 6618 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:53:54.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:53:54 gibba015 bash[30343]: cephadm 2021-03-10T15:53:52.756153+0000 mgr.gibba045.orlgmj (mgr.34412) 6618 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:53:54.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:53:54 gibba045 bash[25517]: cephadm 2021-03-10T15:53:52.756153+0000 mgr.gibba045.orlgmj (mgr.34412) 6618 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:53:55.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:53:55 gibba015 bash[29377]: cluster 2021-03-10T15:53:54.387641+0000 mgr.gibba045.orlgmj (mgr.34412) 6619 : cluster [DBG] pgmap v3763: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:55.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:53:55 gibba015 bash[30343]: cluster 2021-03-10T15:53:54.387641+0000 mgr.gibba045.orlgmj (mgr.34412) 6619 : cluster [DBG] pgmap v3763: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:55.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:53:55 gibba045 bash[25517]: cluster 2021-03-10T15:53:54.387641+0000 mgr.gibba045.orlgmj (mgr.34412) 6619 : cluster [DBG] pgmap v3763: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:57.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:53:57 gibba045 bash[25517]: cluster 2021-03-10T15:53:56.389778+0000 mgr.gibba045.orlgmj (mgr.34412) 6620 : cluster [DBG] pgmap v3764: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:57.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:53:57 gibba015 bash[29377]: cluster 2021-03-10T15:53:56.389778+0000 mgr.gibba045.orlgmj (mgr.34412) 6620 : cluster [DBG] pgmap v3764: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:57.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:53:57 gibba015 bash[30343]: cluster 2021-03-10T15:53:56.389778+0000 mgr.gibba045.orlgmj (mgr.34412) 6620 : cluster [DBG] pgmap v3764: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:59.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:53:59 gibba045 bash[25517]: cluster 2021-03-10T15:53:58.391000+0000 mgr.gibba045.orlgmj (mgr.34412) 6621 : cluster [DBG] pgmap v3765: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:59.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:53:59 gibba015 bash[29377]: cluster 2021-03-10T15:53:58.391000+0000 mgr.gibba045.orlgmj (mgr.34412) 6621 : cluster [DBG] pgmap v3765: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:59.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:53:59 gibba015 bash[30343]: cluster 2021-03-10T15:53:58.391000+0000 mgr.gibba045.orlgmj (mgr.34412) 6621 : cluster [DBG] pgmap v3765: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:01.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:54:01 gibba045 bash[25517]: cluster 2021-03-10T15:54:00.392463+0000 mgr.gibba045.orlgmj (mgr.34412) 6622 : cluster [DBG] pgmap v3766: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:01.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:54:01 gibba015 bash[29377]: cluster 2021-03-10T15:54:00.392463+0000 mgr.gibba045.orlgmj (mgr.34412) 6622 : cluster [DBG] pgmap v3766: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:01.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:54:01 gibba015 bash[30343]: cluster 2021-03-10T15:54:00.392463+0000 mgr.gibba045.orlgmj (mgr.34412) 6622 : cluster [DBG] pgmap v3766: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:03.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:54:03 gibba015 bash[29377]: cluster 2021-03-10T15:54:02.394232+0000 mgr.gibba045.orlgmj (mgr.34412) 6623 : cluster [DBG] pgmap v3767: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:03.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:54:03 gibba015 bash[30343]: cluster 2021-03-10T15:54:02.394232+0000 mgr.gibba045.orlgmj (mgr.34412) 6623 : cluster [DBG] pgmap v3767: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:03.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:54:03 gibba045 bash[25517]: cluster 2021-03-10T15:54:02.394232+0000 mgr.gibba045.orlgmj (mgr.34412) 6623 : cluster [DBG] pgmap v3767: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:05.484 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:54:05.712 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:54:05.712 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 8m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:54:05.712 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 7m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:54:05.713 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:54:05.713 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:54:05.713 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:54:05.713 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:54:05.713 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:54:05.714 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:54:05.714 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 8m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:54:05.714 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 7m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:54:05.714 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:54:05.715 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:54:05.715 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:54:05.715 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:54:05.715 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:54:05.715 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:54:05.716 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:54:05.716 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:54:05.716 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 7m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:54:05.716 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 7m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T15:54:05.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:54:05 gibba015 bash[29377]: cluster 2021-03-10T15:54:04.395455+0000 mgr.gibba045.orlgmj (mgr.34412) 6624 : cluster [DBG] pgmap v3768: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:05.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:54:05 gibba015 bash[30343]: cluster 2021-03-10T15:54:04.395455+0000 mgr.gibba045.orlgmj (mgr.34412) 6624 : cluster [DBG] pgmap v3768: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:05.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:54:05 gibba045 bash[25517]: cluster 2021-03-10T15:54:04.395455+0000 mgr.gibba045.orlgmj (mgr.34412) 6624 : cluster [DBG] pgmap v3768: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:05.961 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:54:05.961 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:54:05.961 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:54:05.962 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:54:05.962 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:54:05.962 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:54:05.962 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:54:05.963 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:54:05.963 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:54:05.963 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:54:05.963 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:54:05.963 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:54:05.964 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:54:05.964 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:54:05.964 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:54:06.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:54:06 gibba015 bash[29377]: audit 2021-03-10T15:54:05.476980+0000 mgr.gibba045.orlgmj (mgr.34412) 6625 : audit [DBG] from='client.58486 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:54:06.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:54:06 gibba015 bash[29377]: audit 2021-03-10T15:54:05.959469+0000 mon.a (mon.0) 1611 : audit [DBG] from='client.? 172.21.2.115:0/1144259876' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:54:06.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:54:06 gibba015 bash[30343]: audit 2021-03-10T15:54:05.476980+0000 mgr.gibba045.orlgmj (mgr.34412) 6625 : audit [DBG] from='client.58486 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:54:06.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:54:06 gibba015 bash[30343]: audit 2021-03-10T15:54:05.959469+0000 mon.a (mon.0) 1611 : audit [DBG] from='client.? 172.21.2.115:0/1144259876' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:54:06.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:54:06 gibba045 bash[25517]: audit 2021-03-10T15:54:05.476980+0000 mgr.gibba045.orlgmj (mgr.34412) 6625 : audit [DBG] from='client.58486 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:54:06.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:54:06 gibba045 bash[25517]: audit 2021-03-10T15:54:05.959469+0000 mon.a (mon.0) 1611 : audit [DBG] from='client.? 172.21.2.115:0/1144259876' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:54:07.771 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:54:07 gibba045 bash[25517]: audit 2021-03-10T15:54:05.700482+0000 mgr.gibba045.orlgmj (mgr.34412) 6626 : audit [DBG] from='client.58492 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:54:07.772 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:54:07 gibba045 bash[25517]: cluster 2021-03-10T15:54:06.397494+0000 mgr.gibba045.orlgmj (mgr.34412) 6627 : cluster [DBG] pgmap v3769: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:07.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:54:07 gibba015 bash[29377]: audit 2021-03-10T15:54:05.700482+0000 mgr.gibba045.orlgmj (mgr.34412) 6626 : audit [DBG] from='client.58492 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:54:07.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:54:07 gibba015 bash[29377]: cluster 2021-03-10T15:54:06.397494+0000 mgr.gibba045.orlgmj (mgr.34412) 6627 : cluster [DBG] pgmap v3769: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:07.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:54:07 gibba015 bash[30343]: audit 2021-03-10T15:54:05.700482+0000 mgr.gibba045.orlgmj (mgr.34412) 6626 : audit [DBG] from='client.58492 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:54:07.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:54:07 gibba015 bash[30343]: cluster 2021-03-10T15:54:06.397494+0000 mgr.gibba045.orlgmj (mgr.34412) 6627 : cluster [DBG] pgmap v3769: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:09.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:54:09 gibba045 bash[25517]: cephadm 2021-03-10T15:54:07.772102+0000 mgr.gibba045.orlgmj (mgr.34412) 6628 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:54:09.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:54:09 gibba045 bash[25517]: cluster 2021-03-10T15:54:08.398695+0000 mgr.gibba045.orlgmj (mgr.34412) 6629 : cluster [DBG] pgmap v3770: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:09.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:54:09 gibba015 bash[29377]: cephadm 2021-03-10T15:54:07.772102+0000 mgr.gibba045.orlgmj (mgr.34412) 6628 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:54:09.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:54:09 gibba015 bash[29377]: cluster 2021-03-10T15:54:08.398695+0000 mgr.gibba045.orlgmj (mgr.34412) 6629 : cluster [DBG] pgmap v3770: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:09.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:54:09 gibba015 bash[30343]: cephadm 2021-03-10T15:54:07.772102+0000 mgr.gibba045.orlgmj (mgr.34412) 6628 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:54:09.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:54:09 gibba015 bash[30343]: cluster 2021-03-10T15:54:08.398695+0000 mgr.gibba045.orlgmj (mgr.34412) 6629 : cluster [DBG] pgmap v3770: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:11.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:54:11 gibba045 bash[25517]: cluster 2021-03-10T15:54:10.400410+0000 mgr.gibba045.orlgmj (mgr.34412) 6630 : cluster [DBG] pgmap v3771: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:11.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:54:11 gibba015 bash[29377]: cluster 2021-03-10T15:54:10.400410+0000 mgr.gibba045.orlgmj (mgr.34412) 6630 : cluster [DBG] pgmap v3771: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:11.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:54:11 gibba015 bash[30343]: cluster 2021-03-10T15:54:10.400410+0000 mgr.gibba045.orlgmj (mgr.34412) 6630 : cluster [DBG] pgmap v3771: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:13.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:54:13 gibba015 bash[29377]: cluster 2021-03-10T15:54:12.402379+0000 mgr.gibba045.orlgmj (mgr.34412) 6631 : cluster [DBG] pgmap v3772: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:13.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:54:13 gibba015 bash[30343]: cluster 2021-03-10T15:54:12.402379+0000 mgr.gibba045.orlgmj (mgr.34412) 6631 : cluster [DBG] pgmap v3772: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:13.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:54:13 gibba045 bash[25517]: cluster 2021-03-10T15:54:12.402379+0000 mgr.gibba045.orlgmj (mgr.34412) 6631 : cluster [DBG] pgmap v3772: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:15.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:54:15 gibba045 bash[25517]: cluster 2021-03-10T15:54:14.403876+0000 mgr.gibba045.orlgmj (mgr.34412) 6632 : cluster [DBG] pgmap v3773: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:15.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:54:15 gibba015 bash[29377]: cluster 2021-03-10T15:54:14.403876+0000 mgr.gibba045.orlgmj (mgr.34412) 6632 : cluster [DBG] pgmap v3773: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:15.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:54:15 gibba015 bash[30343]: cluster 2021-03-10T15:54:14.403876+0000 mgr.gibba045.orlgmj (mgr.34412) 6632 : cluster [DBG] pgmap v3773: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:17.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:54:17 gibba045 bash[25517]: cluster 2021-03-10T15:54:16.405975+0000 mgr.gibba045.orlgmj (mgr.34412) 6633 : cluster [DBG] pgmap v3774: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:17.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:54:17 gibba015 bash[29377]: cluster 2021-03-10T15:54:16.405975+0000 mgr.gibba045.orlgmj (mgr.34412) 6633 : cluster [DBG] pgmap v3774: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:17.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:54:17 gibba015 bash[30343]: cluster 2021-03-10T15:54:16.405975+0000 mgr.gibba045.orlgmj (mgr.34412) 6633 : cluster [DBG] pgmap v3774: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:19.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:54:19 gibba045 bash[25517]: cluster 2021-03-10T15:54:18.407247+0000 mgr.gibba045.orlgmj (mgr.34412) 6634 : cluster [DBG] pgmap v3775: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:19.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:54:19 gibba015 bash[29377]: cluster 2021-03-10T15:54:18.407247+0000 mgr.gibba045.orlgmj (mgr.34412) 6634 : cluster [DBG] pgmap v3775: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:19.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:54:19 gibba015 bash[30343]: cluster 2021-03-10T15:54:18.407247+0000 mgr.gibba045.orlgmj (mgr.34412) 6634 : cluster [DBG] pgmap v3775: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:21.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:54:21 gibba015 bash[29377]: cluster 2021-03-10T15:54:20.409001+0000 mgr.gibba045.orlgmj (mgr.34412) 6635 : cluster [DBG] pgmap v3776: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:21.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:54:21 gibba015 bash[30343]: cluster 2021-03-10T15:54:20.409001+0000 mgr.gibba045.orlgmj (mgr.34412) 6635 : cluster [DBG] pgmap v3776: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:21.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:54:21 gibba045 bash[25517]: cluster 2021-03-10T15:54:20.409001+0000 mgr.gibba045.orlgmj (mgr.34412) 6635 : cluster [DBG] pgmap v3776: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:23.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:54:23 gibba045 bash[25517]: cluster 2021-03-10T15:54:22.410718+0000 mgr.gibba045.orlgmj (mgr.34412) 6636 : cluster [DBG] pgmap v3777: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:23.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:54:23 gibba015 bash[29377]: cluster 2021-03-10T15:54:22.410718+0000 mgr.gibba045.orlgmj (mgr.34412) 6636 : cluster [DBG] pgmap v3777: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:23.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:54:23 gibba015 bash[30343]: cluster 2021-03-10T15:54:22.410718+0000 mgr.gibba045.orlgmj (mgr.34412) 6636 : cluster [DBG] pgmap v3777: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:24.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:54:24 gibba045 bash[25517]: cephadm 2021-03-10T15:54:22.788020+0000 mgr.gibba045.orlgmj (mgr.34412) 6637 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:54:24.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:54:24 gibba015 bash[29377]: cephadm 2021-03-10T15:54:22.788020+0000 mgr.gibba045.orlgmj (mgr.34412) 6637 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:54:24.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:54:24 gibba015 bash[30343]: cephadm 2021-03-10T15:54:22.788020+0000 mgr.gibba045.orlgmj (mgr.34412) 6637 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:54:25.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:54:25 gibba045 bash[25517]: cluster 2021-03-10T15:54:24.412216+0000 mgr.gibba045.orlgmj (mgr.34412) 6638 : cluster [DBG] pgmap v3778: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:25.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:54:25 gibba015 bash[29377]: cluster 2021-03-10T15:54:24.412216+0000 mgr.gibba045.orlgmj (mgr.34412) 6638 : cluster [DBG] pgmap v3778: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:25.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:54:25 gibba015 bash[30343]: cluster 2021-03-10T15:54:24.412216+0000 mgr.gibba045.orlgmj (mgr.34412) 6638 : cluster [DBG] pgmap v3778: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:27.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:54:27 gibba045 bash[25517]: cluster 2021-03-10T15:54:26.414196+0000 mgr.gibba045.orlgmj (mgr.34412) 6639 : cluster [DBG] pgmap v3779: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:27.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:54:27 gibba015 bash[29377]: cluster 2021-03-10T15:54:26.414196+0000 mgr.gibba045.orlgmj (mgr.34412) 6639 : cluster [DBG] pgmap v3779: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:27.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:54:27 gibba015 bash[30343]: cluster 2021-03-10T15:54:26.414196+0000 mgr.gibba045.orlgmj (mgr.34412) 6639 : cluster [DBG] pgmap v3779: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:29.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:54:29 gibba045 bash[25517]: cluster 2021-03-10T15:54:28.415502+0000 mgr.gibba045.orlgmj (mgr.34412) 6640 : cluster [DBG] pgmap v3780: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:29.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:54:29 gibba015 bash[29377]: cluster 2021-03-10T15:54:28.415502+0000 mgr.gibba045.orlgmj (mgr.34412) 6640 : cluster [DBG] pgmap v3780: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:29.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:54:29 gibba015 bash[30343]: cluster 2021-03-10T15:54:28.415502+0000 mgr.gibba045.orlgmj (mgr.34412) 6640 : cluster [DBG] pgmap v3780: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:31.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:54:31 gibba045 bash[25517]: cluster 2021-03-10T15:54:30.417263+0000 mgr.gibba045.orlgmj (mgr.34412) 6641 : cluster [DBG] pgmap v3781: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:31.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:54:31 gibba015 bash[29377]: cluster 2021-03-10T15:54:30.417263+0000 mgr.gibba045.orlgmj (mgr.34412) 6641 : cluster [DBG] pgmap v3781: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:31.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:54:31 gibba015 bash[30343]: cluster 2021-03-10T15:54:30.417263+0000 mgr.gibba045.orlgmj (mgr.34412) 6641 : cluster [DBG] pgmap v3781: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:33.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:54:33 gibba045 bash[25517]: cluster 2021-03-10T15:54:32.419099+0000 mgr.gibba045.orlgmj (mgr.34412) 6642 : cluster [DBG] pgmap v3782: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:33.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:54:33 gibba015 bash[29377]: cluster 2021-03-10T15:54:32.419099+0000 mgr.gibba045.orlgmj (mgr.34412) 6642 : cluster [DBG] pgmap v3782: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:33.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:54:33 gibba015 bash[30343]: cluster 2021-03-10T15:54:32.419099+0000 mgr.gibba045.orlgmj (mgr.34412) 6642 : cluster [DBG] pgmap v3782: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:35.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:54:35 gibba045 bash[25517]: cluster 2021-03-10T15:54:34.420524+0000 mgr.gibba045.orlgmj (mgr.34412) 6643 : cluster [DBG] pgmap v3783: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:35.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:54:35 gibba015 bash[29377]: cluster 2021-03-10T15:54:34.420524+0000 mgr.gibba045.orlgmj (mgr.34412) 6643 : cluster [DBG] pgmap v3783: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:35.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:54:35 gibba015 bash[30343]: cluster 2021-03-10T15:54:34.420524+0000 mgr.gibba045.orlgmj (mgr.34412) 6643 : cluster [DBG] pgmap v3783: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:36.201 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:54:36.430 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:54:36.430 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 9m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:54:36.431 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 8m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:54:36.431 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:54:36.431 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:54:36.431 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:54:36.432 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:54:36.432 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:54:36.432 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:54:36.432 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 9m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:54:36.432 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 8m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:54:36.433 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:54:36.433 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:54:36.433 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:54:36.433 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:54:36.434 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:54:36.434 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:54:36.434 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:54:36.434 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:54:36.434 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 8m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:54:36.435 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 8m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T15:54:36.678 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:54:36.679 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:54:36.679 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:54:36.679 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:54:36.679 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:54:36.680 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:54:36.680 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:54:36.680 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:54:36.681 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:54:36.681 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:54:36.681 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:54:36.681 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:54:36.682 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:54:36.682 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:54:36.682 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:54:37.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:54:37 gibba045 bash[25517]: audit 2021-03-10T15:54:36.194018+0000 mgr.gibba045.orlgmj (mgr.34412) 6644 : audit [DBG] from='client.48516 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:54:37.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:54:37 gibba045 bash[25517]: audit 2021-03-10T15:54:36.418485+0000 mgr.gibba045.orlgmj (mgr.34412) 6645 : audit [DBG] from='client.48522 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:54:37.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:54:37 gibba045 bash[25517]: cluster 2021-03-10T15:54:36.422243+0000 mgr.gibba045.orlgmj (mgr.34412) 6646 : cluster [DBG] pgmap v3784: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:37.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:54:37 gibba045 bash[25517]: audit 2021-03-10T15:54:36.676638+0000 mon.c (mon.1) 1850 : audit [DBG] from='client.? 172.21.2.115:0/3614077566' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:54:37.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:54:37 gibba015 bash[29377]: audit 2021-03-10T15:54:36.194018+0000 mgr.gibba045.orlgmj (mgr.34412) 6644 : audit [DBG] from='client.48516 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:54:37.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:54:37 gibba015 bash[29377]: audit 2021-03-10T15:54:36.418485+0000 mgr.gibba045.orlgmj (mgr.34412) 6645 : audit [DBG] from='client.48522 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:54:37.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:54:37 gibba015 bash[29377]: cluster 2021-03-10T15:54:36.422243+0000 mgr.gibba045.orlgmj (mgr.34412) 6646 : cluster [DBG] pgmap v3784: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:37.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:54:37 gibba015 bash[29377]: audit 2021-03-10T15:54:36.676638+0000 mon.c (mon.1) 1850 : audit [DBG] from='client.? 172.21.2.115:0/3614077566' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:54:37.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:54:37 gibba015 bash[30343]: audit 2021-03-10T15:54:36.194018+0000 mgr.gibba045.orlgmj (mgr.34412) 6644 : audit [DBG] from='client.48516 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:54:37.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:54:37 gibba015 bash[30343]: audit 2021-03-10T15:54:36.418485+0000 mgr.gibba045.orlgmj (mgr.34412) 6645 : audit [DBG] from='client.48522 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:54:37.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:54:37 gibba015 bash[30343]: cluster 2021-03-10T15:54:36.422243+0000 mgr.gibba045.orlgmj (mgr.34412) 6646 : cluster [DBG] pgmap v3784: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:37.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:54:37 gibba015 bash[30343]: audit 2021-03-10T15:54:36.676638+0000 mon.c (mon.1) 1850 : audit [DBG] from='client.? 172.21.2.115:0/3614077566' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:54:38.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:54:38 gibba045 bash[25517]: audit 2021-03-10T15:54:37.802387+0000 mon.c (mon.1) 1851 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:54:38.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:54:38 gibba045 bash[25517]: audit 2021-03-10T15:54:38.018166+0000 mon.a (mon.0) 1612 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:54:38.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:54:38 gibba045 bash[25517]: audit 2021-03-10T15:54:38.021543+0000 mon.c (mon.1) 1852 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:54:38.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:54:38 gibba045 bash[25517]: audit 2021-03-10T15:54:38.023689+0000 mon.c (mon.1) 1853 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:54:38.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:54:38 gibba045 bash[25517]: audit 2021-03-10T15:54:38.025421+0000 mon.c (mon.1) 1854 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:54:38.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:54:38 gibba045 bash[25517]: audit 2021-03-10T15:54:38.026765+0000 mon.c (mon.1) 1855 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:54:38.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:54:38 gibba045 bash[25517]: audit 2021-03-10T15:54:38.029870+0000 mon.c (mon.1) 1856 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:54:38.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:54:38 gibba045 bash[25517]: audit 2021-03-10T15:54:38.031651+0000 mon.c (mon.1) 1857 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:54:38.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:54:38 gibba015 bash[29377]: audit 2021-03-10T15:54:37.802387+0000 mon.c (mon.1) 1851 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:54:38.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:54:38 gibba015 bash[29377]: audit 2021-03-10T15:54:38.018166+0000 mon.a (mon.0) 1612 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:54:38.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:54:38 gibba015 bash[29377]: audit 2021-03-10T15:54:38.021543+0000 mon.c (mon.1) 1852 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:54:38.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:54:38 gibba015 bash[29377]: audit 2021-03-10T15:54:38.023689+0000 mon.c (mon.1) 1853 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:54:38.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:54:38 gibba015 bash[29377]: audit 2021-03-10T15:54:38.025421+0000 mon.c (mon.1) 1854 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:54:38.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:54:38 gibba015 bash[29377]: audit 2021-03-10T15:54:38.026765+0000 mon.c (mon.1) 1855 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:54:38.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:54:38 gibba015 bash[29377]: audit 2021-03-10T15:54:38.029870+0000 mon.c (mon.1) 1856 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:54:38.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:54:38 gibba015 bash[29377]: audit 2021-03-10T15:54:38.031651+0000 mon.c (mon.1) 1857 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:54:38.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:54:38 gibba015 bash[30343]: audit 2021-03-10T15:54:37.802387+0000 mon.c (mon.1) 1851 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:54:38.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:54:38 gibba015 bash[30343]: audit 2021-03-10T15:54:38.018166+0000 mon.a (mon.0) 1612 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:54:38.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:54:38 gibba015 bash[30343]: audit 2021-03-10T15:54:38.021543+0000 mon.c (mon.1) 1852 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:54:38.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:54:38 gibba015 bash[30343]: audit 2021-03-10T15:54:38.023689+0000 mon.c (mon.1) 1853 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:54:38.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:54:38 gibba015 bash[30343]: audit 2021-03-10T15:54:38.025421+0000 mon.c (mon.1) 1854 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:54:38.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:54:38 gibba015 bash[30343]: audit 2021-03-10T15:54:38.026765+0000 mon.c (mon.1) 1855 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:54:38.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:54:38 gibba015 bash[30343]: audit 2021-03-10T15:54:38.029870+0000 mon.c (mon.1) 1856 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:54:38.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:54:38 gibba015 bash[30343]: audit 2021-03-10T15:54:38.031651+0000 mon.c (mon.1) 1857 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:54:39.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:54:39 gibba045 bash[25517]: cephadm 2021-03-10T15:54:37.810192+0000 mgr.gibba045.orlgmj (mgr.34412) 6647 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:54:39.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:54:39 gibba045 bash[25517]: cephadm 2021-03-10T15:54:37.812014+0000 mgr.gibba045.orlgmj (mgr.34412) 6648 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:54:39.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:54:39 gibba045 bash[25517]: cephadm 2021-03-10T15:54:38.023568+0000 mgr.gibba045.orlgmj (mgr.34412) 6649 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:54:39.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:54:39 gibba045 bash[25517]: cephadm 2021-03-10T15:54:38.025688+0000 mgr.gibba045.orlgmj (mgr.34412) 6650 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:54:39.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:54:39 gibba045 bash[25517]: cephadm 2021-03-10T15:54:38.027667+0000 mgr.gibba045.orlgmj (mgr.34412) 6651 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:54:39.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:54:39 gibba045 bash[25517]: cephadm 2021-03-10T15:54:38.027705+0000 mgr.gibba045.orlgmj (mgr.34412) 6652 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:54:39.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:54:39 gibba045 bash[25517]: cephadm 2021-03-10T15:54:38.028855+0000 mgr.gibba045.orlgmj (mgr.34412) 6653 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:54:39.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:54:39 gibba045 bash[25517]: cephadm 2021-03-10T15:54:38.028891+0000 mgr.gibba045.orlgmj (mgr.34412) 6654 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:54:39.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:54:39 gibba045 bash[25517]: cephadm 2021-03-10T15:54:38.030198+0000 mgr.gibba045.orlgmj (mgr.34412) 6655 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:54:39.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:54:39 gibba045 bash[25517]: cephadm 2021-03-10T15:54:38.031855+0000 mgr.gibba045.orlgmj (mgr.34412) 6656 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:54:39.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:54:39 gibba045 bash[25517]: cephadm 2021-03-10T15:54:38.031890+0000 mgr.gibba045.orlgmj (mgr.34412) 6657 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:54:39.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:54:39 gibba045 bash[25517]: cephadm 2021-03-10T15:54:38.033551+0000 mgr.gibba045.orlgmj (mgr.34412) 6658 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:54:39.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:54:39 gibba045 bash[25517]: cephadm 2021-03-10T15:54:38.033942+0000 mgr.gibba045.orlgmj (mgr.34412) 6659 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:54:39.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:54:39 gibba045 bash[25517]: cephadm 2021-03-10T15:54:38.035105+0000 mgr.gibba045.orlgmj (mgr.34412) 6660 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:54:39.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:54:39 gibba045 bash[25517]: cephadm 2021-03-10T15:54:38.035141+0000 mgr.gibba045.orlgmj (mgr.34412) 6661 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:54:39.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:54:39 gibba045 bash[25517]: cephadm 2021-03-10T15:54:38.035253+0000 mgr.gibba045.orlgmj (mgr.34412) 6662 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:54:39.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:54:39 gibba045 bash[25517]: cluster 2021-03-10T15:54:38.423618+0000 mgr.gibba045.orlgmj (mgr.34412) 6663 : cluster [DBG] pgmap v3785: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:39.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:54:39 gibba015 bash[30343]: cephadm 2021-03-10T15:54:37.810192+0000 mgr.gibba045.orlgmj (mgr.34412) 6647 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:54:39.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:54:39 gibba015 bash[30343]: cephadm 2021-03-10T15:54:37.812014+0000 mgr.gibba045.orlgmj (mgr.34412) 6648 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:54:39.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:54:39 gibba015 bash[30343]: cephadm 2021-03-10T15:54:38.023568+0000 mgr.gibba045.orlgmj (mgr.34412) 6649 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:54:39.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:54:39 gibba015 bash[30343]: cephadm 2021-03-10T15:54:38.025688+0000 mgr.gibba045.orlgmj (mgr.34412) 6650 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:54:39.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:54:39 gibba015 bash[30343]: cephadm 2021-03-10T15:54:38.027667+0000 mgr.gibba045.orlgmj (mgr.34412) 6651 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:54:39.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:54:39 gibba015 bash[30343]: cephadm 2021-03-10T15:54:38.027705+0000 mgr.gibba045.orlgmj (mgr.34412) 6652 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:54:39.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:54:39 gibba015 bash[30343]: cephadm 2021-03-10T15:54:38.028855+0000 mgr.gibba045.orlgmj (mgr.34412) 6653 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:54:39.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:54:39 gibba015 bash[30343]: cephadm 2021-03-10T15:54:38.028891+0000 mgr.gibba045.orlgmj (mgr.34412) 6654 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:54:39.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:54:39 gibba015 bash[30343]: cephadm 2021-03-10T15:54:38.030198+0000 mgr.gibba045.orlgmj (mgr.34412) 6655 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:54:39.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:54:39 gibba015 bash[30343]: cephadm 2021-03-10T15:54:38.031855+0000 mgr.gibba045.orlgmj (mgr.34412) 6656 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:54:39.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:54:39 gibba015 bash[30343]: cephadm 2021-03-10T15:54:38.031890+0000 mgr.gibba045.orlgmj (mgr.34412) 6657 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:54:39.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:54:39 gibba015 bash[30343]: cephadm 2021-03-10T15:54:38.033551+0000 mgr.gibba045.orlgmj (mgr.34412) 6658 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:54:39.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:54:39 gibba015 bash[30343]: cephadm 2021-03-10T15:54:38.033942+0000 mgr.gibba045.orlgmj (mgr.34412) 6659 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:54:39.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:54:39 gibba015 bash[30343]: cephadm 2021-03-10T15:54:38.035105+0000 mgr.gibba045.orlgmj (mgr.34412) 6660 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:54:39.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:54:39 gibba015 bash[30343]: cephadm 2021-03-10T15:54:38.035141+0000 mgr.gibba045.orlgmj (mgr.34412) 6661 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:54:39.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:54:39 gibba015 bash[30343]: cephadm 2021-03-10T15:54:38.035253+0000 mgr.gibba045.orlgmj (mgr.34412) 6662 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:54:39.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:54:39 gibba015 bash[30343]: cluster 2021-03-10T15:54:38.423618+0000 mgr.gibba045.orlgmj (mgr.34412) 6663 : cluster [DBG] pgmap v3785: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:39.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:54:39 gibba015 bash[29377]: cephadm 2021-03-10T15:54:37.810192+0000 mgr.gibba045.orlgmj (mgr.34412) 6647 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:54:39.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:54:39 gibba015 bash[29377]: cephadm 2021-03-10T15:54:37.812014+0000 mgr.gibba045.orlgmj (mgr.34412) 6648 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:54:39.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:54:39 gibba015 bash[29377]: cephadm 2021-03-10T15:54:38.023568+0000 mgr.gibba045.orlgmj (mgr.34412) 6649 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:54:39.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:54:39 gibba015 bash[29377]: cephadm 2021-03-10T15:54:38.025688+0000 mgr.gibba045.orlgmj (mgr.34412) 6650 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:54:39.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:54:39 gibba015 bash[29377]: cephadm 2021-03-10T15:54:38.027667+0000 mgr.gibba045.orlgmj (mgr.34412) 6651 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:54:39.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:54:39 gibba015 bash[29377]: cephadm 2021-03-10T15:54:38.027705+0000 mgr.gibba045.orlgmj (mgr.34412) 6652 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:54:39.980 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:54:39 gibba015 bash[29377]: cephadm 2021-03-10T15:54:38.028855+0000 mgr.gibba045.orlgmj (mgr.34412) 6653 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:54:39.980 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:54:39 gibba015 bash[29377]: cephadm 2021-03-10T15:54:38.028891+0000 mgr.gibba045.orlgmj (mgr.34412) 6654 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:54:39.980 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:54:39 gibba015 bash[29377]: cephadm 2021-03-10T15:54:38.030198+0000 mgr.gibba045.orlgmj (mgr.34412) 6655 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:54:39.980 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:54:39 gibba015 bash[29377]: cephadm 2021-03-10T15:54:38.031855+0000 mgr.gibba045.orlgmj (mgr.34412) 6656 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:54:39.981 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:54:39 gibba015 bash[29377]: cephadm 2021-03-10T15:54:38.031890+0000 mgr.gibba045.orlgmj (mgr.34412) 6657 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:54:39.981 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:54:39 gibba015 bash[29377]: cephadm 2021-03-10T15:54:38.033551+0000 mgr.gibba045.orlgmj (mgr.34412) 6658 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:54:39.981 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:54:39 gibba015 bash[29377]: cephadm 2021-03-10T15:54:38.033942+0000 mgr.gibba045.orlgmj (mgr.34412) 6659 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:54:39.981 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:54:39 gibba015 bash[29377]: cephadm 2021-03-10T15:54:38.035105+0000 mgr.gibba045.orlgmj (mgr.34412) 6660 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:54:39.982 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:54:39 gibba015 bash[29377]: cephadm 2021-03-10T15:54:38.035141+0000 mgr.gibba045.orlgmj (mgr.34412) 6661 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:54:39.982 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:54:39 gibba015 bash[29377]: cephadm 2021-03-10T15:54:38.035253+0000 mgr.gibba045.orlgmj (mgr.34412) 6662 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:54:39.982 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:54:39 gibba015 bash[29377]: cluster 2021-03-10T15:54:38.423618+0000 mgr.gibba045.orlgmj (mgr.34412) 6663 : cluster [DBG] pgmap v3785: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:41.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:54:41 gibba015 bash[29377]: cluster 2021-03-10T15:54:40.425198+0000 mgr.gibba045.orlgmj (mgr.34412) 6664 : cluster [DBG] pgmap v3786: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:41.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:54:41 gibba015 bash[30343]: cluster 2021-03-10T15:54:40.425198+0000 mgr.gibba045.orlgmj (mgr.34412) 6664 : cluster [DBG] pgmap v3786: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:41.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:54:41 gibba045 bash[25517]: cluster 2021-03-10T15:54:40.425198+0000 mgr.gibba045.orlgmj (mgr.34412) 6664 : cluster [DBG] pgmap v3786: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:43.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:54:43 gibba045 bash[25517]: cluster 2021-03-10T15:54:42.426974+0000 mgr.gibba045.orlgmj (mgr.34412) 6665 : cluster [DBG] pgmap v3787: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:43.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:54:43 gibba015 bash[29377]: cluster 2021-03-10T15:54:42.426974+0000 mgr.gibba045.orlgmj (mgr.34412) 6665 : cluster [DBG] pgmap v3787: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:43.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:54:43 gibba015 bash[30343]: cluster 2021-03-10T15:54:42.426974+0000 mgr.gibba045.orlgmj (mgr.34412) 6665 : cluster [DBG] pgmap v3787: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:45.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:54:45 gibba045 bash[25517]: cluster 2021-03-10T15:54:44.428377+0000 mgr.gibba045.orlgmj (mgr.34412) 6666 : cluster [DBG] pgmap v3788: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:45.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:54:45 gibba015 bash[29377]: cluster 2021-03-10T15:54:44.428377+0000 mgr.gibba045.orlgmj (mgr.34412) 6666 : cluster [DBG] pgmap v3788: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:45.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:54:45 gibba015 bash[30343]: cluster 2021-03-10T15:54:44.428377+0000 mgr.gibba045.orlgmj (mgr.34412) 6666 : cluster [DBG] pgmap v3788: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:47.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:54:47 gibba045 bash[25517]: cluster 2021-03-10T15:54:46.430388+0000 mgr.gibba045.orlgmj (mgr.34412) 6667 : cluster [DBG] pgmap v3789: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:47.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:54:47 gibba015 bash[29377]: cluster 2021-03-10T15:54:46.430388+0000 mgr.gibba045.orlgmj (mgr.34412) 6667 : cluster [DBG] pgmap v3789: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:47.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:54:47 gibba015 bash[30343]: cluster 2021-03-10T15:54:46.430388+0000 mgr.gibba045.orlgmj (mgr.34412) 6667 : cluster [DBG] pgmap v3789: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:49.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:54:49 gibba045 bash[25517]: cluster 2021-03-10T15:54:48.431610+0000 mgr.gibba045.orlgmj (mgr.34412) 6668 : cluster [DBG] pgmap v3790: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:49.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:54:49 gibba015 bash[29377]: cluster 2021-03-10T15:54:48.431610+0000 mgr.gibba045.orlgmj (mgr.34412) 6668 : cluster [DBG] pgmap v3790: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:49.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:54:49 gibba015 bash[30343]: cluster 2021-03-10T15:54:48.431610+0000 mgr.gibba045.orlgmj (mgr.34412) 6668 : cluster [DBG] pgmap v3790: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:51.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:54:51 gibba015 bash[29377]: cluster 2021-03-10T15:54:50.433478+0000 mgr.gibba045.orlgmj (mgr.34412) 6669 : cluster [DBG] pgmap v3791: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:51.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:54:51 gibba015 bash[30343]: cluster 2021-03-10T15:54:50.433478+0000 mgr.gibba045.orlgmj (mgr.34412) 6669 : cluster [DBG] pgmap v3791: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:51.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:54:51 gibba045 bash[25517]: cluster 2021-03-10T15:54:50.433478+0000 mgr.gibba045.orlgmj (mgr.34412) 6669 : cluster [DBG] pgmap v3791: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:53.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:54:53 gibba045 bash[25517]: cluster 2021-03-10T15:54:52.435051+0000 mgr.gibba045.orlgmj (mgr.34412) 6670 : cluster [DBG] pgmap v3792: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:53.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:54:53 gibba045 bash[25517]: audit 2021-03-10T15:54:53.339541+0000 mon.c (mon.1) 1858 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:54:53.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:54:53 gibba045 bash[25517]: audit 2021-03-10T15:54:53.340182+0000 mon.c (mon.1) 1859 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:54:53.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:54:53 gibba045 bash[25517]: audit 2021-03-10T15:54:53.340634+0000 mon.a (mon.0) 1613 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:54:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:54:53 gibba045 bash[25517]: audit 2021-03-10T15:54:53.341830+0000 mon.a (mon.0) 1614 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:54:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:54:53 gibba045 bash[25517]: audit 2021-03-10T15:54:53.344691+0000 mon.c (mon.1) 1860 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T15:54:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:54:53 gibba045 bash[25517]: audit 2021-03-10T15:54:53.345467+0000 mon.c (mon.1) 1861 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:54:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:54:53 gibba045 bash[25517]: audit 2021-03-10T15:54:53.345762+0000 mon.a (mon.0) 1615 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T15:54:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:54:53 gibba045 bash[25517]: audit 2021-03-10T15:54:53.346588+0000 mon.c (mon.1) 1862 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T15:54:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:54:53 gibba045 bash[25517]: audit 2021-03-10T15:54:53.346718+0000 mon.a (mon.0) 1616 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:54:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:54:53 gibba045 bash[25517]: audit 2021-03-10T15:54:53.347706+0000 mon.a (mon.0) 1617 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T15:54:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:54:53 gibba045 bash[25517]: audit 2021-03-10T15:54:53.348119+0000 mon.c (mon.1) 1863 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:54:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:54:53 gibba045 bash[25517]: audit 2021-03-10T15:54:53.349319+0000 mon.a (mon.0) 1618 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:54:53.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:54:53 gibba015 bash[29377]: cluster 2021-03-10T15:54:52.435051+0000 mgr.gibba045.orlgmj (mgr.34412) 6670 : cluster [DBG] pgmap v3792: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:53.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:54:53 gibba015 bash[29377]: audit 2021-03-10T15:54:53.339541+0000 mon.c (mon.1) 1858 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:54:53.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:54:53 gibba015 bash[29377]: audit 2021-03-10T15:54:53.340182+0000 mon.c (mon.1) 1859 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:54:53.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:54:53 gibba015 bash[29377]: audit 2021-03-10T15:54:53.340634+0000 mon.a (mon.0) 1613 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:54:53.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:54:53 gibba015 bash[29377]: audit 2021-03-10T15:54:53.341830+0000 mon.a (mon.0) 1614 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:54:53.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:54:53 gibba015 bash[29377]: audit 2021-03-10T15:54:53.344691+0000 mon.c (mon.1) 1860 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T15:54:53.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:54:53 gibba015 bash[29377]: audit 2021-03-10T15:54:53.345467+0000 mon.c (mon.1) 1861 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:54:53.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:54:53 gibba015 bash[29377]: audit 2021-03-10T15:54:53.345762+0000 mon.a (mon.0) 1615 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T15:54:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:54:53 gibba015 bash[29377]: audit 2021-03-10T15:54:53.346588+0000 mon.c (mon.1) 1862 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T15:54:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:54:53 gibba015 bash[29377]: audit 2021-03-10T15:54:53.346718+0000 mon.a (mon.0) 1616 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:54:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:54:53 gibba015 bash[29377]: audit 2021-03-10T15:54:53.347706+0000 mon.a (mon.0) 1617 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T15:54:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:54:53 gibba015 bash[29377]: audit 2021-03-10T15:54:53.348119+0000 mon.c (mon.1) 1863 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:54:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:54:53 gibba015 bash[29377]: audit 2021-03-10T15:54:53.349319+0000 mon.a (mon.0) 1618 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:54:53.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:54:53 gibba015 bash[30343]: cluster 2021-03-10T15:54:52.435051+0000 mgr.gibba045.orlgmj (mgr.34412) 6670 : cluster [DBG] pgmap v3792: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:53.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:54:53 gibba015 bash[30343]: audit 2021-03-10T15:54:53.339541+0000 mon.c (mon.1) 1858 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:54:53.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:54:53 gibba015 bash[30343]: audit 2021-03-10T15:54:53.340182+0000 mon.c (mon.1) 1859 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:54:53.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:54:53 gibba015 bash[30343]: audit 2021-03-10T15:54:53.340634+0000 mon.a (mon.0) 1613 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:54:53.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:54:53 gibba015 bash[30343]: audit 2021-03-10T15:54:53.341830+0000 mon.a (mon.0) 1614 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:54:53.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:54:53 gibba015 bash[30343]: audit 2021-03-10T15:54:53.344691+0000 mon.c (mon.1) 1860 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T15:54:53.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:54:53 gibba015 bash[30343]: audit 2021-03-10T15:54:53.345467+0000 mon.c (mon.1) 1861 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:54:53.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:54:53 gibba015 bash[30343]: audit 2021-03-10T15:54:53.345762+0000 mon.a (mon.0) 1615 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T15:54:53.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:54:53 gibba015 bash[30343]: audit 2021-03-10T15:54:53.346588+0000 mon.c (mon.1) 1862 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T15:54:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:54:53 gibba015 bash[30343]: audit 2021-03-10T15:54:53.346718+0000 mon.a (mon.0) 1616 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:54:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:54:53 gibba015 bash[30343]: audit 2021-03-10T15:54:53.347706+0000 mon.a (mon.0) 1617 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T15:54:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:54:53 gibba015 bash[30343]: audit 2021-03-10T15:54:53.348119+0000 mon.c (mon.1) 1863 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:54:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:54:53 gibba015 bash[30343]: audit 2021-03-10T15:54:53.349319+0000 mon.a (mon.0) 1618 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:54:54.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:54:54 gibba045 bash[25517]: cephadm 2021-03-10T15:54:53.045477+0000 mgr.gibba045.orlgmj (mgr.34412) 6671 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:54:54.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:54:54 gibba015 bash[29377]: cephadm 2021-03-10T15:54:53.045477+0000 mgr.gibba045.orlgmj (mgr.34412) 6671 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:54:54.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:54:54 gibba015 bash[30343]: cephadm 2021-03-10T15:54:53.045477+0000 mgr.gibba045.orlgmj (mgr.34412) 6671 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:54:55.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:54:55 gibba045 bash[25517]: cluster 2021-03-10T15:54:54.436470+0000 mgr.gibba045.orlgmj (mgr.34412) 6672 : cluster [DBG] pgmap v3793: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:55.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:54:55 gibba015 bash[29377]: cluster 2021-03-10T15:54:54.436470+0000 mgr.gibba045.orlgmj (mgr.34412) 6672 : cluster [DBG] pgmap v3793: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:55.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:54:55 gibba015 bash[30343]: cluster 2021-03-10T15:54:54.436470+0000 mgr.gibba045.orlgmj (mgr.34412) 6672 : cluster [DBG] pgmap v3793: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:57.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:54:57 gibba045 bash[25517]: cluster 2021-03-10T15:54:56.438366+0000 mgr.gibba045.orlgmj (mgr.34412) 6673 : cluster [DBG] pgmap v3794: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:57.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:54:57 gibba015 bash[29377]: cluster 2021-03-10T15:54:56.438366+0000 mgr.gibba045.orlgmj (mgr.34412) 6673 : cluster [DBG] pgmap v3794: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:57.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:54:57 gibba015 bash[30343]: cluster 2021-03-10T15:54:56.438366+0000 mgr.gibba045.orlgmj (mgr.34412) 6673 : cluster [DBG] pgmap v3794: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:59.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:54:59 gibba045 bash[25517]: cluster 2021-03-10T15:54:58.439601+0000 mgr.gibba045.orlgmj (mgr.34412) 6674 : cluster [DBG] pgmap v3795: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:59.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:54:59 gibba015 bash[29377]: cluster 2021-03-10T15:54:58.439601+0000 mgr.gibba045.orlgmj (mgr.34412) 6674 : cluster [DBG] pgmap v3795: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:59.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:54:59 gibba015 bash[30343]: cluster 2021-03-10T15:54:58.439601+0000 mgr.gibba045.orlgmj (mgr.34412) 6674 : cluster [DBG] pgmap v3795: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:01.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:55:01 gibba015 bash[29377]: cluster 2021-03-10T15:55:00.441505+0000 mgr.gibba045.orlgmj (mgr.34412) 6675 : cluster [DBG] pgmap v3796: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:01.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:55:01 gibba015 bash[30343]: cluster 2021-03-10T15:55:00.441505+0000 mgr.gibba045.orlgmj (mgr.34412) 6675 : cluster [DBG] pgmap v3796: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:01.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:55:01 gibba045 bash[25517]: cluster 2021-03-10T15:55:00.441505+0000 mgr.gibba045.orlgmj (mgr.34412) 6675 : cluster [DBG] pgmap v3796: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:03.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:55:03 gibba045 bash[25517]: cluster 2021-03-10T15:55:02.443537+0000 mgr.gibba045.orlgmj (mgr.34412) 6676 : cluster [DBG] pgmap v3797: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:03.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:55:03 gibba015 bash[29377]: cluster 2021-03-10T15:55:02.443537+0000 mgr.gibba045.orlgmj (mgr.34412) 6676 : cluster [DBG] pgmap v3797: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:03.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:55:03 gibba015 bash[30343]: cluster 2021-03-10T15:55:02.443537+0000 mgr.gibba045.orlgmj (mgr.34412) 6676 : cluster [DBG] pgmap v3797: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:05.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:55:05 gibba045 bash[25517]: cluster 2021-03-10T15:55:04.444963+0000 mgr.gibba045.orlgmj (mgr.34412) 6677 : cluster [DBG] pgmap v3798: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:05.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:55:05 gibba015 bash[29377]: cluster 2021-03-10T15:55:04.444963+0000 mgr.gibba045.orlgmj (mgr.34412) 6677 : cluster [DBG] pgmap v3798: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:05.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:55:05 gibba015 bash[30343]: cluster 2021-03-10T15:55:04.444963+0000 mgr.gibba045.orlgmj (mgr.34412) 6677 : cluster [DBG] pgmap v3798: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:06.920 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:55:07.145 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:55:07.146 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 9m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:55:07.146 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 8m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:55:07.146 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:55:07.146 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:55:07.147 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:55:07.147 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:55:07.147 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:55:07.147 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:55:07.148 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 9m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:55:07.148 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 8m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:55:07.148 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:55:07.148 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:55:07.149 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:55:07.149 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:55:07.149 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:55:07.149 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:55:07.149 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:55:07.150 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:55:07.150 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 8m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:55:07.150 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 8m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T15:55:07.395 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:55:07.395 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:55:07.396 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:55:07.396 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:55:07.396 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:55:07.396 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:55:07.397 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:55:07.397 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:55:07.397 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:55:07.397 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:55:07.398 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:55:07.398 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:55:07.398 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:55:07.398 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:55:07.399 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:55:07.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:55:07 gibba045 bash[25517]: cluster 2021-03-10T15:55:06.446850+0000 mgr.gibba045.orlgmj (mgr.34412) 6678 : cluster [DBG] pgmap v3799: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:07.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:55:07 gibba045 bash[25517]: audit 2021-03-10T15:55:07.393271+0000 mon.a (mon.0) 1619 : audit [DBG] from='client.? 172.21.2.115:0/4104884343' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:55:07.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:55:07 gibba015 bash[29377]: cluster 2021-03-10T15:55:06.446850+0000 mgr.gibba045.orlgmj (mgr.34412) 6678 : cluster [DBG] pgmap v3799: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:07.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:55:07 gibba015 bash[29377]: audit 2021-03-10T15:55:07.393271+0000 mon.a (mon.0) 1619 : audit [DBG] from='client.? 172.21.2.115:0/4104884343' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:55:07.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:55:07 gibba015 bash[30343]: cluster 2021-03-10T15:55:06.446850+0000 mgr.gibba045.orlgmj (mgr.34412) 6678 : cluster [DBG] pgmap v3799: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:07.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:55:07 gibba015 bash[30343]: audit 2021-03-10T15:55:07.393271+0000 mon.a (mon.0) 1619 : audit [DBG] from='client.? 172.21.2.115:0/4104884343' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:55:08.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:55:08 gibba045 bash[25517]: audit 2021-03-10T15:55:06.912423+0000 mgr.gibba045.orlgmj (mgr.34412) 6679 : audit [DBG] from='client.48534 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:55:08.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:55:08 gibba045 bash[25517]: audit 2021-03-10T15:55:07.134201+0000 mgr.gibba045.orlgmj (mgr.34412) 6680 : audit [DBG] from='client.48540 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:55:08.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:55:08 gibba015 bash[29377]: audit 2021-03-10T15:55:06.912423+0000 mgr.gibba045.orlgmj (mgr.34412) 6679 : audit [DBG] from='client.48534 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:55:08.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:55:08 gibba015 bash[29377]: audit 2021-03-10T15:55:07.134201+0000 mgr.gibba045.orlgmj (mgr.34412) 6680 : audit [DBG] from='client.48540 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:55:08.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:55:08 gibba015 bash[30343]: audit 2021-03-10T15:55:06.912423+0000 mgr.gibba045.orlgmj (mgr.34412) 6679 : audit [DBG] from='client.48534 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:55:08.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:55:08 gibba015 bash[30343]: audit 2021-03-10T15:55:07.134201+0000 mgr.gibba045.orlgmj (mgr.34412) 6680 : audit [DBG] from='client.48540 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:55:09.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:55:09 gibba045 bash[25517]: cephadm 2021-03-10T15:55:08.051101+0000 mgr.gibba045.orlgmj (mgr.34412) 6681 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:55:09.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:55:09 gibba045 bash[25517]: cluster 2021-03-10T15:55:08.448329+0000 mgr.gibba045.orlgmj (mgr.34412) 6682 : cluster [DBG] pgmap v3800: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:09.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:55:09 gibba015 bash[29377]: cephadm 2021-03-10T15:55:08.051101+0000 mgr.gibba045.orlgmj (mgr.34412) 6681 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:55:09.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:55:09 gibba015 bash[29377]: cluster 2021-03-10T15:55:08.448329+0000 mgr.gibba045.orlgmj (mgr.34412) 6682 : cluster [DBG] pgmap v3800: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:09.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:55:09 gibba015 bash[30343]: cephadm 2021-03-10T15:55:08.051101+0000 mgr.gibba045.orlgmj (mgr.34412) 6681 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:55:09.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:55:09 gibba015 bash[30343]: cluster 2021-03-10T15:55:08.448329+0000 mgr.gibba045.orlgmj (mgr.34412) 6682 : cluster [DBG] pgmap v3800: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:11.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:55:11 gibba015 bash[29377]: cluster 2021-03-10T15:55:10.450006+0000 mgr.gibba045.orlgmj (mgr.34412) 6683 : cluster [DBG] pgmap v3801: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:11.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:55:11 gibba015 bash[30343]: cluster 2021-03-10T15:55:10.450006+0000 mgr.gibba045.orlgmj (mgr.34412) 6683 : cluster [DBG] pgmap v3801: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:11.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:55:11 gibba045 bash[25517]: cluster 2021-03-10T15:55:10.450006+0000 mgr.gibba045.orlgmj (mgr.34412) 6683 : cluster [DBG] pgmap v3801: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:13.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:55:13 gibba045 bash[25517]: cluster 2021-03-10T15:55:12.451781+0000 mgr.gibba045.orlgmj (mgr.34412) 6684 : cluster [DBG] pgmap v3802: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:13.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:55:13 gibba015 bash[29377]: cluster 2021-03-10T15:55:12.451781+0000 mgr.gibba045.orlgmj (mgr.34412) 6684 : cluster [DBG] pgmap v3802: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:13.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:55:13 gibba015 bash[30343]: cluster 2021-03-10T15:55:12.451781+0000 mgr.gibba045.orlgmj (mgr.34412) 6684 : cluster [DBG] pgmap v3802: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:15.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:55:15 gibba045 bash[25517]: cluster 2021-03-10T15:55:14.453492+0000 mgr.gibba045.orlgmj (mgr.34412) 6685 : cluster [DBG] pgmap v3803: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:15.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:55:15 gibba015 bash[29377]: cluster 2021-03-10T15:55:14.453492+0000 mgr.gibba045.orlgmj (mgr.34412) 6685 : cluster [DBG] pgmap v3803: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:15.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:55:15 gibba015 bash[30343]: cluster 2021-03-10T15:55:14.453492+0000 mgr.gibba045.orlgmj (mgr.34412) 6685 : cluster [DBG] pgmap v3803: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:17.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:55:17 gibba045 bash[25517]: cluster 2021-03-10T15:55:16.455435+0000 mgr.gibba045.orlgmj (mgr.34412) 6686 : cluster [DBG] pgmap v3804: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:17.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:55:17 gibba015 bash[29377]: cluster 2021-03-10T15:55:16.455435+0000 mgr.gibba045.orlgmj (mgr.34412) 6686 : cluster [DBG] pgmap v3804: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:17.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:55:17 gibba015 bash[30343]: cluster 2021-03-10T15:55:16.455435+0000 mgr.gibba045.orlgmj (mgr.34412) 6686 : cluster [DBG] pgmap v3804: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:19.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:55:19 gibba045 bash[25517]: cluster 2021-03-10T15:55:18.456845+0000 mgr.gibba045.orlgmj (mgr.34412) 6687 : cluster [DBG] pgmap v3805: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:19.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:55:19 gibba015 bash[29377]: cluster 2021-03-10T15:55:18.456845+0000 mgr.gibba045.orlgmj (mgr.34412) 6687 : cluster [DBG] pgmap v3805: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:19.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:55:19 gibba015 bash[30343]: cluster 2021-03-10T15:55:18.456845+0000 mgr.gibba045.orlgmj (mgr.34412) 6687 : cluster [DBG] pgmap v3805: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:21.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:55:21 gibba015 bash[29377]: cluster 2021-03-10T15:55:20.458653+0000 mgr.gibba045.orlgmj (mgr.34412) 6688 : cluster [DBG] pgmap v3806: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:21.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:55:21 gibba015 bash[30343]: cluster 2021-03-10T15:55:20.458653+0000 mgr.gibba045.orlgmj (mgr.34412) 6688 : cluster [DBG] pgmap v3806: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:21.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:55:21 gibba045 bash[25517]: cluster 2021-03-10T15:55:20.458653+0000 mgr.gibba045.orlgmj (mgr.34412) 6688 : cluster [DBG] pgmap v3806: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:23.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:55:23 gibba045 bash[25517]: cluster 2021-03-10T15:55:22.460498+0000 mgr.gibba045.orlgmj (mgr.34412) 6689 : cluster [DBG] pgmap v3807: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:23.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:55:23 gibba015 bash[29377]: cluster 2021-03-10T15:55:22.460498+0000 mgr.gibba045.orlgmj (mgr.34412) 6689 : cluster [DBG] pgmap v3807: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:23.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:55:23 gibba015 bash[30343]: cluster 2021-03-10T15:55:22.460498+0000 mgr.gibba045.orlgmj (mgr.34412) 6689 : cluster [DBG] pgmap v3807: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:24.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:55:24 gibba045 bash[25517]: cephadm 2021-03-10T15:55:23.065751+0000 mgr.gibba045.orlgmj (mgr.34412) 6690 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:55:24.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:55:24 gibba015 bash[29377]: cephadm 2021-03-10T15:55:23.065751+0000 mgr.gibba045.orlgmj (mgr.34412) 6690 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:55:24.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:55:24 gibba015 bash[30343]: cephadm 2021-03-10T15:55:23.065751+0000 mgr.gibba045.orlgmj (mgr.34412) 6690 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:55:25.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:55:25 gibba045 bash[25517]: cluster 2021-03-10T15:55:24.462195+0000 mgr.gibba045.orlgmj (mgr.34412) 6691 : cluster [DBG] pgmap v3808: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:25.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:55:25 gibba015 bash[29377]: cluster 2021-03-10T15:55:24.462195+0000 mgr.gibba045.orlgmj (mgr.34412) 6691 : cluster [DBG] pgmap v3808: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:25.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:55:25 gibba015 bash[30343]: cluster 2021-03-10T15:55:24.462195+0000 mgr.gibba045.orlgmj (mgr.34412) 6691 : cluster [DBG] pgmap v3808: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:27.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:55:27 gibba045 bash[25517]: cluster 2021-03-10T15:55:26.463977+0000 mgr.gibba045.orlgmj (mgr.34412) 6692 : cluster [DBG] pgmap v3809: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:27.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:55:27 gibba015 bash[29377]: cluster 2021-03-10T15:55:26.463977+0000 mgr.gibba045.orlgmj (mgr.34412) 6692 : cluster [DBG] pgmap v3809: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:27.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:55:27 gibba015 bash[30343]: cluster 2021-03-10T15:55:26.463977+0000 mgr.gibba045.orlgmj (mgr.34412) 6692 : cluster [DBG] pgmap v3809: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:29.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:55:29 gibba015 bash[29377]: cluster 2021-03-10T15:55:28.465365+0000 mgr.gibba045.orlgmj (mgr.34412) 6693 : cluster [DBG] pgmap v3810: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:29.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:55:29 gibba015 bash[30343]: cluster 2021-03-10T15:55:28.465365+0000 mgr.gibba045.orlgmj (mgr.34412) 6693 : cluster [DBG] pgmap v3810: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:30.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:55:29 gibba045 bash[25517]: cluster 2021-03-10T15:55:28.465365+0000 mgr.gibba045.orlgmj (mgr.34412) 6693 : cluster [DBG] pgmap v3810: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:31.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:55:31 gibba015 bash[29377]: cluster 2021-03-10T15:55:30.467149+0000 mgr.gibba045.orlgmj (mgr.34412) 6694 : cluster [DBG] pgmap v3811: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:31.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:55:31 gibba015 bash[30343]: cluster 2021-03-10T15:55:30.467149+0000 mgr.gibba045.orlgmj (mgr.34412) 6694 : cluster [DBG] pgmap v3811: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:31.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:55:31 gibba045 bash[25517]: cluster 2021-03-10T15:55:30.467149+0000 mgr.gibba045.orlgmj (mgr.34412) 6694 : cluster [DBG] pgmap v3811: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:33.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:55:33 gibba045 bash[25517]: cluster 2021-03-10T15:55:32.468950+0000 mgr.gibba045.orlgmj (mgr.34412) 6695 : cluster [DBG] pgmap v3812: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:33.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:55:33 gibba015 bash[29377]: cluster 2021-03-10T15:55:32.468950+0000 mgr.gibba045.orlgmj (mgr.34412) 6695 : cluster [DBG] pgmap v3812: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:33.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:55:33 gibba015 bash[30343]: cluster 2021-03-10T15:55:32.468950+0000 mgr.gibba045.orlgmj (mgr.34412) 6695 : cluster [DBG] pgmap v3812: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:35.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:55:35 gibba045 bash[25517]: cluster 2021-03-10T15:55:34.470566+0000 mgr.gibba045.orlgmj (mgr.34412) 6696 : cluster [DBG] pgmap v3813: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:35.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:55:35 gibba015 bash[29377]: cluster 2021-03-10T15:55:34.470566+0000 mgr.gibba045.orlgmj (mgr.34412) 6696 : cluster [DBG] pgmap v3813: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:35.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:55:35 gibba015 bash[30343]: cluster 2021-03-10T15:55:34.470566+0000 mgr.gibba045.orlgmj (mgr.34412) 6696 : cluster [DBG] pgmap v3813: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:37.639 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:55:37.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:55:37 gibba045 bash[25517]: cluster 2021-03-10T15:55:36.472253+0000 mgr.gibba045.orlgmj (mgr.34412) 6697 : cluster [DBG] pgmap v3814: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:37.895 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:55:37.895 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 10m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:55:37.895 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 9m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:55:37.895 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:55:37.896 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:55:37.896 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:55:37.896 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:55:37.896 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:55:37.897 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:55:37.897 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 10m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:55:37.897 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 9m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:55:37.897 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:55:37.898 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:55:37.898 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:55:37.898 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:55:37.898 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:55:37.899 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:55:37.899 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:55:37.899 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:55:37.899 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 9m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:55:37.900 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 9m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T15:55:37.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:55:37 gibba015 bash[29377]: cluster 2021-03-10T15:55:36.472253+0000 mgr.gibba045.orlgmj (mgr.34412) 6697 : cluster [DBG] pgmap v3814: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:37.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:55:37 gibba015 bash[30343]: cluster 2021-03-10T15:55:36.472253+0000 mgr.gibba045.orlgmj (mgr.34412) 6697 : cluster [DBG] pgmap v3814: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:38.156 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:55:38.156 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:55:38.156 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:55:38.157 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:55:38.157 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:55:38.157 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:55:38.157 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:55:38.158 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:55:38.158 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:55:38.158 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:55:38.158 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:55:38.158 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:55:38.159 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:55:38.159 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:55:38.159 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:55:38.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:55:38 gibba015 bash[29377]: audit 2021-03-10T15:55:37.631994+0000 mgr.gibba045.orlgmj (mgr.34412) 6698 : audit [DBG] from='client.58540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:55:38.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:55:38 gibba015 bash[29377]: audit 2021-03-10T15:55:38.076386+0000 mon.c (mon.1) 1864 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:55:38.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:55:38 gibba015 bash[29377]: audit 2021-03-10T15:55:38.081152+0000 mon.c (mon.1) 1865 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:55:38.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:55:38 gibba015 bash[29377]: audit 2021-03-10T15:55:38.154501+0000 mon.a (mon.0) 1620 : audit [DBG] from='client.? 172.21.2.115:0/3259282519' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:55:38.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:55:38 gibba015 bash[30343]: audit 2021-03-10T15:55:37.631994+0000 mgr.gibba045.orlgmj (mgr.34412) 6698 : audit [DBG] from='client.58540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:55:38.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:55:38 gibba015 bash[30343]: audit 2021-03-10T15:55:38.076386+0000 mon.c (mon.1) 1864 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:55:38.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:55:38 gibba015 bash[30343]: audit 2021-03-10T15:55:38.081152+0000 mon.c (mon.1) 1865 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:55:38.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:55:38 gibba015 bash[30343]: audit 2021-03-10T15:55:38.154501+0000 mon.a (mon.0) 1620 : audit [DBG] from='client.? 172.21.2.115:0/3259282519' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:55:39.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:55:38 gibba045 bash[25517]: audit 2021-03-10T15:55:37.631994+0000 mgr.gibba045.orlgmj (mgr.34412) 6698 : audit [DBG] from='client.58540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:55:39.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:55:38 gibba045 bash[25517]: audit 2021-03-10T15:55:38.076386+0000 mon.c (mon.1) 1864 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:55:39.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:55:38 gibba045 bash[25517]: audit 2021-03-10T15:55:38.081152+0000 mon.c (mon.1) 1865 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:55:39.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:55:38 gibba045 bash[25517]: audit 2021-03-10T15:55:38.154501+0000 mon.a (mon.0) 1620 : audit [DBG] from='client.? 172.21.2.115:0/3259282519' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:55:39.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:55:39 gibba015 bash[29377]: audit 2021-03-10T15:55:37.855781+0000 mgr.gibba045.orlgmj (mgr.34412) 6699 : audit [DBG] from='client.48558 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:55:39.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:55:39 gibba015 bash[29377]: cephadm 2021-03-10T15:55:38.083964+0000 mgr.gibba045.orlgmj (mgr.34412) 6700 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:55:39.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:55:39 gibba015 bash[29377]: cluster 2021-03-10T15:55:38.473485+0000 mgr.gibba045.orlgmj (mgr.34412) 6701 : cluster [DBG] pgmap v3815: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:39.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:55:39 gibba015 bash[30343]: audit 2021-03-10T15:55:37.855781+0000 mgr.gibba045.orlgmj (mgr.34412) 6699 : audit [DBG] from='client.48558 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:55:39.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:55:39 gibba015 bash[30343]: cephadm 2021-03-10T15:55:38.083964+0000 mgr.gibba045.orlgmj (mgr.34412) 6700 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:55:39.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:55:39 gibba015 bash[30343]: cluster 2021-03-10T15:55:38.473485+0000 mgr.gibba045.orlgmj (mgr.34412) 6701 : cluster [DBG] pgmap v3815: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:40.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:55:39 gibba045 bash[25517]: audit 2021-03-10T15:55:37.855781+0000 mgr.gibba045.orlgmj (mgr.34412) 6699 : audit [DBG] from='client.48558 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:55:40.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:55:39 gibba045 bash[25517]: cephadm 2021-03-10T15:55:38.083964+0000 mgr.gibba045.orlgmj (mgr.34412) 6700 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:55:40.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:55:39 gibba045 bash[25517]: cluster 2021-03-10T15:55:38.473485+0000 mgr.gibba045.orlgmj (mgr.34412) 6701 : cluster [DBG] pgmap v3815: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:41.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:55:41 gibba015 bash[29377]: cluster 2021-03-10T15:55:40.474979+0000 mgr.gibba045.orlgmj (mgr.34412) 6702 : cluster [DBG] pgmap v3816: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:41.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:55:41 gibba015 bash[30343]: cluster 2021-03-10T15:55:40.474979+0000 mgr.gibba045.orlgmj (mgr.34412) 6702 : cluster [DBG] pgmap v3816: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:41.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:55:41 gibba045 bash[25517]: cluster 2021-03-10T15:55:40.474979+0000 mgr.gibba045.orlgmj (mgr.34412) 6702 : cluster [DBG] pgmap v3816: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:42.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:55:42 gibba015 bash[29377]: audit 2021-03-10T15:55:41.707255+0000 mon.a (mon.0) 1621 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:55:42.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:55:42 gibba015 bash[29377]: cephadm 2021-03-10T15:55:41.710807+0000 mgr.gibba045.orlgmj (mgr.34412) 6703 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:55:42.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:55:42 gibba015 bash[29377]: audit 2021-03-10T15:55:41.914564+0000 mon.a (mon.0) 1622 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:55:42.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:55:42 gibba015 bash[29377]: cephadm 2021-03-10T15:55:41.933288+0000 mgr.gibba045.orlgmj (mgr.34412) 6704 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:55:42.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:55:42 gibba015 bash[29377]: audit 2021-03-10T15:55:41.933598+0000 mon.c (mon.1) 1866 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:55:42.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:55:42 gibba015 bash[29377]: audit 2021-03-10T15:55:41.938652+0000 mon.c (mon.1) 1867 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:55:42.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:55:42 gibba015 bash[29377]: cephadm 2021-03-10T15:55:41.939692+0000 mgr.gibba045.orlgmj (mgr.34412) 6705 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:55:42.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:55:42 gibba015 bash[29377]: audit 2021-03-10T15:55:41.943776+0000 mon.c (mon.1) 1868 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:55:42.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:55:42 gibba015 bash[29377]: cephadm 2021-03-10T15:55:41.944446+0000 mgr.gibba045.orlgmj (mgr.34412) 6706 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:55:42.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:55:42 gibba015 bash[29377]: cephadm 2021-03-10T15:55:41.945058+0000 mgr.gibba045.orlgmj (mgr.34412) 6707 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:55:42.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:55:42 gibba015 bash[29377]: audit 2021-03-10T15:55:41.946942+0000 mon.c (mon.1) 1869 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:55:42.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:55:42 gibba015 bash[29377]: cephadm 2021-03-10T15:55:41.948538+0000 mgr.gibba045.orlgmj (mgr.34412) 6708 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:55:42.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:55:42 gibba015 bash[29377]: cephadm 2021-03-10T15:55:41.948748+0000 mgr.gibba045.orlgmj (mgr.34412) 6709 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:55:42.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:55:42 gibba015 bash[29377]: cephadm 2021-03-10T15:55:41.951663+0000 mgr.gibba045.orlgmj (mgr.34412) 6710 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:55:42.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:55:42 gibba015 bash[29377]: audit 2021-03-10T15:55:41.954744+0000 mon.c (mon.1) 1870 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:55:42.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:55:42 gibba015 bash[29377]: cephadm 2021-03-10T15:55:41.955289+0000 mgr.gibba045.orlgmj (mgr.34412) 6711 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:55:42.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:55:42 gibba015 bash[29377]: cephadm 2021-03-10T15:55:41.955663+0000 mgr.gibba045.orlgmj (mgr.34412) 6712 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:55:42.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:55:42 gibba015 bash[29377]: cephadm 2021-03-10T15:55:41.959456+0000 mgr.gibba045.orlgmj (mgr.34412) 6713 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:55:42.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:55:42 gibba015 bash[29377]: audit 2021-03-10T15:55:41.959823+0000 mon.c (mon.1) 1871 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:55:42.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:55:42 gibba015 bash[29377]: cephadm 2021-03-10T15:55:41.961633+0000 mgr.gibba045.orlgmj (mgr.34412) 6714 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:55:42.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:55:42 gibba015 bash[29377]: cephadm 2021-03-10T15:55:41.964555+0000 mgr.gibba045.orlgmj (mgr.34412) 6715 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:55:42.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:55:42 gibba015 bash[29377]: cephadm 2021-03-10T15:55:41.964775+0000 mgr.gibba045.orlgmj (mgr.34412) 6716 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:55:42.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:55:42 gibba015 bash[29377]: cephadm 2021-03-10T15:55:41.965375+0000 mgr.gibba045.orlgmj (mgr.34412) 6717 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:55:42.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:55:42 gibba015 bash[29377]: cluster 2021-03-10T15:55:42.476805+0000 mgr.gibba045.orlgmj (mgr.34412) 6718 : cluster [DBG] pgmap v3817: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:42.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:55:42 gibba015 bash[30343]: audit 2021-03-10T15:55:41.707255+0000 mon.a (mon.0) 1621 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:55:42.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:55:42 gibba015 bash[30343]: cephadm 2021-03-10T15:55:41.710807+0000 mgr.gibba045.orlgmj (mgr.34412) 6703 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:55:42.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:55:42 gibba015 bash[30343]: audit 2021-03-10T15:55:41.914564+0000 mon.a (mon.0) 1622 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:55:42.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:55:42 gibba015 bash[30343]: cephadm 2021-03-10T15:55:41.933288+0000 mgr.gibba045.orlgmj (mgr.34412) 6704 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:55:42.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:55:42 gibba015 bash[30343]: audit 2021-03-10T15:55:41.933598+0000 mon.c (mon.1) 1866 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:55:42.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:55:42 gibba015 bash[30343]: audit 2021-03-10T15:55:41.938652+0000 mon.c (mon.1) 1867 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:55:42.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:55:42 gibba015 bash[30343]: cephadm 2021-03-10T15:55:41.939692+0000 mgr.gibba045.orlgmj (mgr.34412) 6705 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:55:42.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:55:42 gibba015 bash[30343]: audit 2021-03-10T15:55:41.943776+0000 mon.c (mon.1) 1868 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:55:42.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:55:42 gibba015 bash[30343]: cephadm 2021-03-10T15:55:41.944446+0000 mgr.gibba045.orlgmj (mgr.34412) 6706 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:55:42.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:55:42 gibba015 bash[30343]: cephadm 2021-03-10T15:55:41.945058+0000 mgr.gibba045.orlgmj (mgr.34412) 6707 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:55:42.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:55:42 gibba015 bash[30343]: audit 2021-03-10T15:55:41.946942+0000 mon.c (mon.1) 1869 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:55:42.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:55:42 gibba015 bash[30343]: cephadm 2021-03-10T15:55:41.948538+0000 mgr.gibba045.orlgmj (mgr.34412) 6708 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:55:42.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:55:42 gibba015 bash[30343]: cephadm 2021-03-10T15:55:41.948748+0000 mgr.gibba045.orlgmj (mgr.34412) 6709 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:55:42.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:55:42 gibba015 bash[30343]: cephadm 2021-03-10T15:55:41.951663+0000 mgr.gibba045.orlgmj (mgr.34412) 6710 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:55:42.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:55:42 gibba015 bash[30343]: audit 2021-03-10T15:55:41.954744+0000 mon.c (mon.1) 1870 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:55:42.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:55:42 gibba015 bash[30343]: cephadm 2021-03-10T15:55:41.955289+0000 mgr.gibba045.orlgmj (mgr.34412) 6711 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:55:42.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:55:42 gibba015 bash[30343]: cephadm 2021-03-10T15:55:41.955663+0000 mgr.gibba045.orlgmj (mgr.34412) 6712 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:55:42.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:55:42 gibba015 bash[30343]: cephadm 2021-03-10T15:55:41.959456+0000 mgr.gibba045.orlgmj (mgr.34412) 6713 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:55:42.984 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:55:42 gibba015 bash[30343]: audit 2021-03-10T15:55:41.959823+0000 mon.c (mon.1) 1871 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:55:42.984 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:55:42 gibba015 bash[30343]: cephadm 2021-03-10T15:55:41.961633+0000 mgr.gibba045.orlgmj (mgr.34412) 6714 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:55:42.984 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:55:42 gibba015 bash[30343]: cephadm 2021-03-10T15:55:41.964555+0000 mgr.gibba045.orlgmj (mgr.34412) 6715 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:55:42.984 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:55:42 gibba015 bash[30343]: cephadm 2021-03-10T15:55:41.964775+0000 mgr.gibba045.orlgmj (mgr.34412) 6716 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:55:42.985 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:55:42 gibba015 bash[30343]: cephadm 2021-03-10T15:55:41.965375+0000 mgr.gibba045.orlgmj (mgr.34412) 6717 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:55:42.985 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:55:42 gibba015 bash[30343]: cluster 2021-03-10T15:55:42.476805+0000 mgr.gibba045.orlgmj (mgr.34412) 6718 : cluster [DBG] pgmap v3817: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:43.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:55:42 gibba045 bash[25517]: audit 2021-03-10T15:55:41.707255+0000 mon.a (mon.0) 1621 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:55:43.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:55:42 gibba045 bash[25517]: cephadm 2021-03-10T15:55:41.710807+0000 mgr.gibba045.orlgmj (mgr.34412) 6703 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:55:43.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:55:42 gibba045 bash[25517]: audit 2021-03-10T15:55:41.914564+0000 mon.a (mon.0) 1622 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:55:43.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:55:42 gibba045 bash[25517]: cephadm 2021-03-10T15:55:41.933288+0000 mgr.gibba045.orlgmj (mgr.34412) 6704 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:55:43.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:55:42 gibba045 bash[25517]: audit 2021-03-10T15:55:41.933598+0000 mon.c (mon.1) 1866 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:55:43.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:55:42 gibba045 bash[25517]: audit 2021-03-10T15:55:41.938652+0000 mon.c (mon.1) 1867 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:55:43.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:55:42 gibba045 bash[25517]: cephadm 2021-03-10T15:55:41.939692+0000 mgr.gibba045.orlgmj (mgr.34412) 6705 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:55:43.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:55:42 gibba045 bash[25517]: audit 2021-03-10T15:55:41.943776+0000 mon.c (mon.1) 1868 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:55:43.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:55:42 gibba045 bash[25517]: cephadm 2021-03-10T15:55:41.944446+0000 mgr.gibba045.orlgmj (mgr.34412) 6706 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:55:43.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:55:42 gibba045 bash[25517]: cephadm 2021-03-10T15:55:41.945058+0000 mgr.gibba045.orlgmj (mgr.34412) 6707 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:55:43.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:55:42 gibba045 bash[25517]: audit 2021-03-10T15:55:41.946942+0000 mon.c (mon.1) 1869 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:55:43.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:55:42 gibba045 bash[25517]: cephadm 2021-03-10T15:55:41.948538+0000 mgr.gibba045.orlgmj (mgr.34412) 6708 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:55:43.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:55:42 gibba045 bash[25517]: cephadm 2021-03-10T15:55:41.948748+0000 mgr.gibba045.orlgmj (mgr.34412) 6709 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:55:43.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:55:42 gibba045 bash[25517]: cephadm 2021-03-10T15:55:41.951663+0000 mgr.gibba045.orlgmj (mgr.34412) 6710 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:55:43.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:55:42 gibba045 bash[25517]: audit 2021-03-10T15:55:41.954744+0000 mon.c (mon.1) 1870 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:55:43.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:55:42 gibba045 bash[25517]: cephadm 2021-03-10T15:55:41.955289+0000 mgr.gibba045.orlgmj (mgr.34412) 6711 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:55:43.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:55:42 gibba045 bash[25517]: cephadm 2021-03-10T15:55:41.955663+0000 mgr.gibba045.orlgmj (mgr.34412) 6712 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:55:43.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:55:42 gibba045 bash[25517]: cephadm 2021-03-10T15:55:41.959456+0000 mgr.gibba045.orlgmj (mgr.34412) 6713 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:55:43.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:55:42 gibba045 bash[25517]: audit 2021-03-10T15:55:41.959823+0000 mon.c (mon.1) 1871 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:55:43.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:55:42 gibba045 bash[25517]: cephadm 2021-03-10T15:55:41.961633+0000 mgr.gibba045.orlgmj (mgr.34412) 6714 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:55:43.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:55:42 gibba045 bash[25517]: cephadm 2021-03-10T15:55:41.964555+0000 mgr.gibba045.orlgmj (mgr.34412) 6715 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:55:43.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:55:42 gibba045 bash[25517]: cephadm 2021-03-10T15:55:41.964775+0000 mgr.gibba045.orlgmj (mgr.34412) 6716 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:55:43.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:55:42 gibba045 bash[25517]: cephadm 2021-03-10T15:55:41.965375+0000 mgr.gibba045.orlgmj (mgr.34412) 6717 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:55:43.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:55:42 gibba045 bash[25517]: cluster 2021-03-10T15:55:42.476805+0000 mgr.gibba045.orlgmj (mgr.34412) 6718 : cluster [DBG] pgmap v3817: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:45.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:55:45 gibba045 bash[25517]: cluster 2021-03-10T15:55:44.478175+0000 mgr.gibba045.orlgmj (mgr.34412) 6719 : cluster [DBG] pgmap v3818: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:45.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:55:45 gibba015 bash[29377]: cluster 2021-03-10T15:55:44.478175+0000 mgr.gibba045.orlgmj (mgr.34412) 6719 : cluster [DBG] pgmap v3818: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:45.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:55:45 gibba015 bash[30343]: cluster 2021-03-10T15:55:44.478175+0000 mgr.gibba045.orlgmj (mgr.34412) 6719 : cluster [DBG] pgmap v3818: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:47.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:55:47 gibba045 bash[25517]: cluster 2021-03-10T15:55:46.479947+0000 mgr.gibba045.orlgmj (mgr.34412) 6720 : cluster [DBG] pgmap v3819: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:47.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:55:47 gibba015 bash[29377]: cluster 2021-03-10T15:55:46.479947+0000 mgr.gibba045.orlgmj (mgr.34412) 6720 : cluster [DBG] pgmap v3819: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:47.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:55:47 gibba015 bash[30343]: cluster 2021-03-10T15:55:46.479947+0000 mgr.gibba045.orlgmj (mgr.34412) 6720 : cluster [DBG] pgmap v3819: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:49.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:55:49 gibba015 bash[29377]: cluster 2021-03-10T15:55:48.481296+0000 mgr.gibba045.orlgmj (mgr.34412) 6721 : cluster [DBG] pgmap v3820: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:49.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:55:49 gibba015 bash[30343]: cluster 2021-03-10T15:55:48.481296+0000 mgr.gibba045.orlgmj (mgr.34412) 6721 : cluster [DBG] pgmap v3820: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:50.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:55:49 gibba045 bash[25517]: cluster 2021-03-10T15:55:48.481296+0000 mgr.gibba045.orlgmj (mgr.34412) 6721 : cluster [DBG] pgmap v3820: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:51.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:55:51 gibba015 bash[29377]: cluster 2021-03-10T15:55:50.482723+0000 mgr.gibba045.orlgmj (mgr.34412) 6722 : cluster [DBG] pgmap v3821: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:51.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:55:51 gibba015 bash[30343]: cluster 2021-03-10T15:55:50.482723+0000 mgr.gibba045.orlgmj (mgr.34412) 6722 : cluster [DBG] pgmap v3821: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:51.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:55:51 gibba045 bash[25517]: cluster 2021-03-10T15:55:50.482723+0000 mgr.gibba045.orlgmj (mgr.34412) 6722 : cluster [DBG] pgmap v3821: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:53.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:55:53 gibba045 bash[25517]: cluster 2021-03-10T15:55:52.484572+0000 mgr.gibba045.orlgmj (mgr.34412) 6723 : cluster [DBG] pgmap v3822: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:53.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:55:53 gibba045 bash[25517]: audit 2021-03-10T15:55:53.347533+0000 mon.c (mon.1) 1872 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:55:53.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:55:53 gibba045 bash[25517]: audit 2021-03-10T15:55:53.348210+0000 mon.c (mon.1) 1873 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:55:53.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:55:53 gibba045 bash[25517]: audit 2021-03-10T15:55:53.348628+0000 mon.a (mon.0) 1623 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:55:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:55:53 gibba045 bash[25517]: audit 2021-03-10T15:55:53.349745+0000 mon.a (mon.0) 1624 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:55:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:55:53 gibba045 bash[25517]: audit 2021-03-10T15:55:53.352415+0000 mon.c (mon.1) 1874 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T15:55:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:55:53 gibba045 bash[25517]: audit 2021-03-10T15:55:53.353181+0000 mon.c (mon.1) 1875 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T15:55:53.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:55:53 gibba045 bash[25517]: audit 2021-03-10T15:55:53.353531+0000 mon.a (mon.0) 1625 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T15:55:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:55:53 gibba045 bash[25517]: audit 2021-03-10T15:55:53.353869+0000 mon.c (mon.1) 1876 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:55:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:55:53 gibba045 bash[25517]: audit 2021-03-10T15:55:53.354755+0000 mon.c (mon.1) 1877 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:55:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:55:53 gibba045 bash[25517]: audit 2021-03-10T15:55:53.355130+0000 mon.a (mon.0) 1626 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T15:55:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:55:53 gibba045 bash[25517]: audit 2021-03-10T15:55:53.356380+0000 mon.a (mon.0) 1627 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:55:53.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:55:53 gibba045 bash[25517]: audit 2021-03-10T15:55:53.357232+0000 mon.a (mon.0) 1628 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:55:53.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:55:53 gibba015 bash[29377]: cluster 2021-03-10T15:55:52.484572+0000 mgr.gibba045.orlgmj (mgr.34412) 6723 : cluster [DBG] pgmap v3822: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:53.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:55:53 gibba015 bash[29377]: audit 2021-03-10T15:55:53.347533+0000 mon.c (mon.1) 1872 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:55:53.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:55:53 gibba015 bash[29377]: audit 2021-03-10T15:55:53.348210+0000 mon.c (mon.1) 1873 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:55:53.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:55:53 gibba015 bash[29377]: audit 2021-03-10T15:55:53.348628+0000 mon.a (mon.0) 1623 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:55:53.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:55:53 gibba015 bash[29377]: audit 2021-03-10T15:55:53.349745+0000 mon.a (mon.0) 1624 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:55:53.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:55:53 gibba015 bash[29377]: audit 2021-03-10T15:55:53.352415+0000 mon.c (mon.1) 1874 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T15:55:53.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:55:53 gibba015 bash[29377]: audit 2021-03-10T15:55:53.353181+0000 mon.c (mon.1) 1875 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T15:55:53.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:55:53 gibba015 bash[29377]: audit 2021-03-10T15:55:53.353531+0000 mon.a (mon.0) 1625 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T15:55:53.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:55:53 gibba015 bash[29377]: audit 2021-03-10T15:55:53.353869+0000 mon.c (mon.1) 1876 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:55:53.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:55:53 gibba015 bash[29377]: audit 2021-03-10T15:55:53.354755+0000 mon.c (mon.1) 1877 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:55:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:55:53 gibba015 bash[29377]: audit 2021-03-10T15:55:53.355130+0000 mon.a (mon.0) 1626 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T15:55:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:55:53 gibba015 bash[29377]: audit 2021-03-10T15:55:53.356380+0000 mon.a (mon.0) 1627 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:55:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:55:53 gibba015 bash[29377]: audit 2021-03-10T15:55:53.357232+0000 mon.a (mon.0) 1628 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:55:53.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:55:53 gibba015 bash[30343]: cluster 2021-03-10T15:55:52.484572+0000 mgr.gibba045.orlgmj (mgr.34412) 6723 : cluster [DBG] pgmap v3822: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:53.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:55:53 gibba015 bash[30343]: audit 2021-03-10T15:55:53.347533+0000 mon.c (mon.1) 1872 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:55:53.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:55:53 gibba015 bash[30343]: audit 2021-03-10T15:55:53.348210+0000 mon.c (mon.1) 1873 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:55:53.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:55:53 gibba015 bash[30343]: audit 2021-03-10T15:55:53.348628+0000 mon.a (mon.0) 1623 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:55:53.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:55:53 gibba015 bash[30343]: audit 2021-03-10T15:55:53.349745+0000 mon.a (mon.0) 1624 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:55:53.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:55:53 gibba015 bash[30343]: audit 2021-03-10T15:55:53.352415+0000 mon.c (mon.1) 1874 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T15:55:53.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:55:53 gibba015 bash[30343]: audit 2021-03-10T15:55:53.353181+0000 mon.c (mon.1) 1875 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T15:55:53.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:55:53 gibba015 bash[30343]: audit 2021-03-10T15:55:53.353531+0000 mon.a (mon.0) 1625 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T15:55:53.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:55:53 gibba015 bash[30343]: audit 2021-03-10T15:55:53.353869+0000 mon.c (mon.1) 1876 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:55:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:55:53 gibba015 bash[30343]: audit 2021-03-10T15:55:53.354755+0000 mon.c (mon.1) 1877 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:55:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:55:53 gibba015 bash[30343]: audit 2021-03-10T15:55:53.355130+0000 mon.a (mon.0) 1626 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T15:55:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:55:53 gibba015 bash[30343]: audit 2021-03-10T15:55:53.356380+0000 mon.a (mon.0) 1627 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:55:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:55:53 gibba015 bash[30343]: audit 2021-03-10T15:55:53.357232+0000 mon.a (mon.0) 1628 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:55:55.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:55:55 gibba015 bash[29377]: cluster 2021-03-10T15:55:54.485942+0000 mgr.gibba045.orlgmj (mgr.34412) 6724 : cluster [DBG] pgmap v3823: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:55.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:55:55 gibba015 bash[30343]: cluster 2021-03-10T15:55:54.485942+0000 mgr.gibba045.orlgmj (mgr.34412) 6724 : cluster [DBG] pgmap v3823: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:56.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:55:55 gibba045 bash[25517]: cluster 2021-03-10T15:55:54.485942+0000 mgr.gibba045.orlgmj (mgr.34412) 6724 : cluster [DBG] pgmap v3823: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:57.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:55:57 gibba015 bash[29377]: cluster 2021-03-10T15:55:56.487709+0000 mgr.gibba045.orlgmj (mgr.34412) 6725 : cluster [DBG] pgmap v3824: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:57.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:55:57 gibba015 bash[30343]: cluster 2021-03-10T15:55:56.487709+0000 mgr.gibba045.orlgmj (mgr.34412) 6725 : cluster [DBG] pgmap v3824: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:58.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:55:57 gibba045 bash[25517]: cluster 2021-03-10T15:55:56.487709+0000 mgr.gibba045.orlgmj (mgr.34412) 6725 : cluster [DBG] pgmap v3824: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:58.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:55:58 gibba015 bash[29377]: cephadm 2021-03-10T15:55:56.978911+0000 mgr.gibba045.orlgmj (mgr.34412) 6726 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:55:58.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:55:58 gibba015 bash[30343]: cephadm 2021-03-10T15:55:56.978911+0000 mgr.gibba045.orlgmj (mgr.34412) 6726 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:55:59.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:55:58 gibba045 bash[25517]: cephadm 2021-03-10T15:55:56.978911+0000 mgr.gibba045.orlgmj (mgr.34412) 6726 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:55:59.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:55:59 gibba015 bash[29377]: cluster 2021-03-10T15:55:58.488811+0000 mgr.gibba045.orlgmj (mgr.34412) 6727 : cluster [DBG] pgmap v3825: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:59.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:55:59 gibba015 bash[30343]: cluster 2021-03-10T15:55:58.488811+0000 mgr.gibba045.orlgmj (mgr.34412) 6727 : cluster [DBG] pgmap v3825: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:00.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:55:59 gibba045 bash[25517]: cluster 2021-03-10T15:55:58.488811+0000 mgr.gibba045.orlgmj (mgr.34412) 6727 : cluster [DBG] pgmap v3825: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:01.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:56:01 gibba015 bash[29377]: cluster 2021-03-10T15:56:00.490523+0000 mgr.gibba045.orlgmj (mgr.34412) 6728 : cluster [DBG] pgmap v3826: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:01.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:56:01 gibba015 bash[30343]: cluster 2021-03-10T15:56:00.490523+0000 mgr.gibba045.orlgmj (mgr.34412) 6728 : cluster [DBG] pgmap v3826: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:01.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:56:01 gibba045 bash[25517]: cluster 2021-03-10T15:56:00.490523+0000 mgr.gibba045.orlgmj (mgr.34412) 6728 : cluster [DBG] pgmap v3826: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:03.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:56:03 gibba015 bash[29377]: cluster 2021-03-10T15:56:02.492226+0000 mgr.gibba045.orlgmj (mgr.34412) 6729 : cluster [DBG] pgmap v3827: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:03.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:56:03 gibba015 bash[30343]: cluster 2021-03-10T15:56:02.492226+0000 mgr.gibba045.orlgmj (mgr.34412) 6729 : cluster [DBG] pgmap v3827: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:04.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:56:03 gibba045 bash[25517]: cluster 2021-03-10T15:56:02.492226+0000 mgr.gibba045.orlgmj (mgr.34412) 6729 : cluster [DBG] pgmap v3827: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:05.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:56:05 gibba015 bash[29377]: cluster 2021-03-10T15:56:04.493553+0000 mgr.gibba045.orlgmj (mgr.34412) 6730 : cluster [DBG] pgmap v3828: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:05.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:56:05 gibba015 bash[30343]: cluster 2021-03-10T15:56:04.493553+0000 mgr.gibba045.orlgmj (mgr.34412) 6730 : cluster [DBG] pgmap v3828: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:06.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:56:05 gibba045 bash[25517]: cluster 2021-03-10T15:56:04.493553+0000 mgr.gibba045.orlgmj (mgr.34412) 6730 : cluster [DBG] pgmap v3828: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:07.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:56:07 gibba015 bash[29377]: cluster 2021-03-10T15:56:06.495333+0000 mgr.gibba045.orlgmj (mgr.34412) 6731 : cluster [DBG] pgmap v3829: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:07.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:56:07 gibba015 bash[30343]: cluster 2021-03-10T15:56:06.495333+0000 mgr.gibba045.orlgmj (mgr.34412) 6731 : cluster [DBG] pgmap v3829: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:08.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:56:07 gibba045 bash[25517]: cluster 2021-03-10T15:56:06.495333+0000 mgr.gibba045.orlgmj (mgr.34412) 6731 : cluster [DBG] pgmap v3829: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:08.401 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:56:08.629 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:56:08.630 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 26s ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:56:08.630 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 9m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:56:08.630 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:56:08.630 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:56:08.631 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 26s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:56:08.631 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 26s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:56:08.631 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:56:08.631 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 26s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:56:08.632 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 26s ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:56:08.632 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 9m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:56:08.632 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 26s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:56:08.632 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 26s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:56:08.633 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 26s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:56:08.633 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 26s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:56:08.633 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:56:08.633 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:56:08.633 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:56:08.634 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:56:08.634 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 9m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:56:08.634 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 9m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T15:56:08.880 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:56:08.881 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:56:08.881 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:56:08.881 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:56:08.881 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:56:08.882 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:56:08.882 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:56:08.882 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:56:08.882 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:56:08.882 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:56:08.883 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:56:08.883 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:56:08.883 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:56:08.883 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:56:08.884 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:56:09.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:56:09 gibba015 bash[29377]: audit 2021-03-10T15:56:08.393000+0000 mgr.gibba045.orlgmj (mgr.34412) 6732 : audit [DBG] from='client.58558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:56:09.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:56:09 gibba015 bash[29377]: cluster 2021-03-10T15:56:08.496576+0000 mgr.gibba045.orlgmj (mgr.34412) 6733 : cluster [DBG] pgmap v3830: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:09.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:56:09 gibba015 bash[29377]: audit 2021-03-10T15:56:08.619465+0000 mgr.gibba045.orlgmj (mgr.34412) 6734 : audit [DBG] from='client.58564 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:56:09.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:56:09 gibba015 bash[29377]: audit 2021-03-10T15:56:08.878817+0000 mon.a (mon.0) 1629 : audit [DBG] from='client.? 172.21.2.115:0/3955084509' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:56:09.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:56:09 gibba015 bash[30343]: audit 2021-03-10T15:56:08.393000+0000 mgr.gibba045.orlgmj (mgr.34412) 6732 : audit [DBG] from='client.58558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:56:09.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:56:09 gibba015 bash[30343]: cluster 2021-03-10T15:56:08.496576+0000 mgr.gibba045.orlgmj (mgr.34412) 6733 : cluster [DBG] pgmap v3830: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:09.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:56:09 gibba015 bash[30343]: audit 2021-03-10T15:56:08.619465+0000 mgr.gibba045.orlgmj (mgr.34412) 6734 : audit [DBG] from='client.58564 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:56:09.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:56:09 gibba015 bash[30343]: audit 2021-03-10T15:56:08.878817+0000 mon.a (mon.0) 1629 : audit [DBG] from='client.? 172.21.2.115:0/3955084509' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:56:10.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:56:09 gibba045 bash[25517]: audit 2021-03-10T15:56:08.393000+0000 mgr.gibba045.orlgmj (mgr.34412) 6732 : audit [DBG] from='client.58558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:56:10.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:56:09 gibba045 bash[25517]: cluster 2021-03-10T15:56:08.496576+0000 mgr.gibba045.orlgmj (mgr.34412) 6733 : cluster [DBG] pgmap v3830: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:10.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:56:09 gibba045 bash[25517]: audit 2021-03-10T15:56:08.619465+0000 mgr.gibba045.orlgmj (mgr.34412) 6734 : audit [DBG] from='client.58564 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:56:10.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:56:09 gibba045 bash[25517]: audit 2021-03-10T15:56:08.878817+0000 mon.a (mon.0) 1629 : audit [DBG] from='client.? 172.21.2.115:0/3955084509' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:56:11.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:56:11 gibba015 bash[29377]: cluster 2021-03-10T15:56:10.498282+0000 mgr.gibba045.orlgmj (mgr.34412) 6735 : cluster [DBG] pgmap v3831: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:11.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:56:11 gibba015 bash[30343]: cluster 2021-03-10T15:56:10.498282+0000 mgr.gibba045.orlgmj (mgr.34412) 6735 : cluster [DBG] pgmap v3831: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:11.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:56:11 gibba045 bash[25517]: cluster 2021-03-10T15:56:10.498282+0000 mgr.gibba045.orlgmj (mgr.34412) 6735 : cluster [DBG] pgmap v3831: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:13.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:56:13 gibba015 bash[29377]: cephadm 2021-03-10T15:56:11.995009+0000 mgr.gibba045.orlgmj (mgr.34412) 6736 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:56:13.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:56:13 gibba015 bash[29377]: cluster 2021-03-10T15:56:12.499931+0000 mgr.gibba045.orlgmj (mgr.34412) 6737 : cluster [DBG] pgmap v3832: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:13.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:56:13 gibba015 bash[30343]: cephadm 2021-03-10T15:56:11.995009+0000 mgr.gibba045.orlgmj (mgr.34412) 6736 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:56:13.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:56:13 gibba015 bash[30343]: cluster 2021-03-10T15:56:12.499931+0000 mgr.gibba045.orlgmj (mgr.34412) 6737 : cluster [DBG] pgmap v3832: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:14.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:56:13 gibba045 bash[25517]: cephadm 2021-03-10T15:56:11.995009+0000 mgr.gibba045.orlgmj (mgr.34412) 6736 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:56:14.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:56:13 gibba045 bash[25517]: cluster 2021-03-10T15:56:12.499931+0000 mgr.gibba045.orlgmj (mgr.34412) 6737 : cluster [DBG] pgmap v3832: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:15.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:56:15 gibba015 bash[29377]: cluster 2021-03-10T15:56:14.501331+0000 mgr.gibba045.orlgmj (mgr.34412) 6738 : cluster [DBG] pgmap v3833: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:15.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:56:15 gibba015 bash[30343]: cluster 2021-03-10T15:56:14.501331+0000 mgr.gibba045.orlgmj (mgr.34412) 6738 : cluster [DBG] pgmap v3833: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:16.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:56:15 gibba045 bash[25517]: cluster 2021-03-10T15:56:14.501331+0000 mgr.gibba045.orlgmj (mgr.34412) 6738 : cluster [DBG] pgmap v3833: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:17.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:56:17 gibba015 bash[29377]: cluster 2021-03-10T15:56:16.503102+0000 mgr.gibba045.orlgmj (mgr.34412) 6739 : cluster [DBG] pgmap v3834: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:17.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:56:17 gibba015 bash[30343]: cluster 2021-03-10T15:56:16.503102+0000 mgr.gibba045.orlgmj (mgr.34412) 6739 : cluster [DBG] pgmap v3834: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:18.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:56:17 gibba045 bash[25517]: cluster 2021-03-10T15:56:16.503102+0000 mgr.gibba045.orlgmj (mgr.34412) 6739 : cluster [DBG] pgmap v3834: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:19.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:56:19 gibba015 bash[29377]: cluster 2021-03-10T15:56:18.504463+0000 mgr.gibba045.orlgmj (mgr.34412) 6740 : cluster [DBG] pgmap v3835: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:19.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:56:19 gibba015 bash[30343]: cluster 2021-03-10T15:56:18.504463+0000 mgr.gibba045.orlgmj (mgr.34412) 6740 : cluster [DBG] pgmap v3835: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:20.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:56:19 gibba045 bash[25517]: cluster 2021-03-10T15:56:18.504463+0000 mgr.gibba045.orlgmj (mgr.34412) 6740 : cluster [DBG] pgmap v3835: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:21.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:56:21 gibba015 bash[29377]: cluster 2021-03-10T15:56:20.505815+0000 mgr.gibba045.orlgmj (mgr.34412) 6741 : cluster [DBG] pgmap v3836: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:21.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:56:21 gibba015 bash[30343]: cluster 2021-03-10T15:56:20.505815+0000 mgr.gibba045.orlgmj (mgr.34412) 6741 : cluster [DBG] pgmap v3836: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:21.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:56:21 gibba045 bash[25517]: cluster 2021-03-10T15:56:20.505815+0000 mgr.gibba045.orlgmj (mgr.34412) 6741 : cluster [DBG] pgmap v3836: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:23.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:56:23 gibba015 bash[29377]: cluster 2021-03-10T15:56:22.507325+0000 mgr.gibba045.orlgmj (mgr.34412) 6742 : cluster [DBG] pgmap v3837: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:23.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:56:23 gibba015 bash[30343]: cluster 2021-03-10T15:56:22.507325+0000 mgr.gibba045.orlgmj (mgr.34412) 6742 : cluster [DBG] pgmap v3837: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:24.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:56:23 gibba045 bash[25517]: cluster 2021-03-10T15:56:22.507325+0000 mgr.gibba045.orlgmj (mgr.34412) 6742 : cluster [DBG] pgmap v3837: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:25.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:56:25 gibba015 bash[29377]: cluster 2021-03-10T15:56:24.508998+0000 mgr.gibba045.orlgmj (mgr.34412) 6743 : cluster [DBG] pgmap v3838: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:25.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:56:25 gibba015 bash[30343]: cluster 2021-03-10T15:56:24.508998+0000 mgr.gibba045.orlgmj (mgr.34412) 6743 : cluster [DBG] pgmap v3838: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:26.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:56:25 gibba045 bash[25517]: cluster 2021-03-10T15:56:24.508998+0000 mgr.gibba045.orlgmj (mgr.34412) 6743 : cluster [DBG] pgmap v3838: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:27.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:56:27 gibba015 bash[29377]: cluster 2021-03-10T15:56:26.510776+0000 mgr.gibba045.orlgmj (mgr.34412) 6744 : cluster [DBG] pgmap v3839: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:27.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:56:27 gibba015 bash[30343]: cluster 2021-03-10T15:56:26.510776+0000 mgr.gibba045.orlgmj (mgr.34412) 6744 : cluster [DBG] pgmap v3839: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:28.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:56:27 gibba045 bash[25517]: cluster 2021-03-10T15:56:26.510776+0000 mgr.gibba045.orlgmj (mgr.34412) 6744 : cluster [DBG] pgmap v3839: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:28.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:56:28 gibba015 bash[29377]: cephadm 2021-03-10T15:56:27.011048+0000 mgr.gibba045.orlgmj (mgr.34412) 6745 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:56:28.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:56:28 gibba015 bash[30343]: cephadm 2021-03-10T15:56:27.011048+0000 mgr.gibba045.orlgmj (mgr.34412) 6745 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:56:29.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:56:28 gibba045 bash[25517]: cephadm 2021-03-10T15:56:27.011048+0000 mgr.gibba045.orlgmj (mgr.34412) 6745 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:56:29.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:56:29 gibba015 bash[29377]: cluster 2021-03-10T15:56:28.511993+0000 mgr.gibba045.orlgmj (mgr.34412) 6746 : cluster [DBG] pgmap v3840: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:29.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:56:29 gibba015 bash[30343]: cluster 2021-03-10T15:56:28.511993+0000 mgr.gibba045.orlgmj (mgr.34412) 6746 : cluster [DBG] pgmap v3840: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:30.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:56:29 gibba045 bash[25517]: cluster 2021-03-10T15:56:28.511993+0000 mgr.gibba045.orlgmj (mgr.34412) 6746 : cluster [DBG] pgmap v3840: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:31.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:56:31 gibba015 bash[29377]: cluster 2021-03-10T15:56:30.513568+0000 mgr.gibba045.orlgmj (mgr.34412) 6747 : cluster [DBG] pgmap v3841: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:31.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:56:31 gibba015 bash[30343]: cluster 2021-03-10T15:56:30.513568+0000 mgr.gibba045.orlgmj (mgr.34412) 6747 : cluster [DBG] pgmap v3841: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:31.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:56:31 gibba045 bash[25517]: cluster 2021-03-10T15:56:30.513568+0000 mgr.gibba045.orlgmj (mgr.34412) 6747 : cluster [DBG] pgmap v3841: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:33.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:56:33 gibba015 bash[29377]: cluster 2021-03-10T15:56:32.515375+0000 mgr.gibba045.orlgmj (mgr.34412) 6748 : cluster [DBG] pgmap v3842: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:33.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:56:33 gibba015 bash[30343]: cluster 2021-03-10T15:56:32.515375+0000 mgr.gibba045.orlgmj (mgr.34412) 6748 : cluster [DBG] pgmap v3842: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:34.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:56:33 gibba045 bash[25517]: cluster 2021-03-10T15:56:32.515375+0000 mgr.gibba045.orlgmj (mgr.34412) 6748 : cluster [DBG] pgmap v3842: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:35.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:56:35 gibba015 bash[29377]: cluster 2021-03-10T15:56:34.517046+0000 mgr.gibba045.orlgmj (mgr.34412) 6749 : cluster [DBG] pgmap v3843: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:35.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:56:35 gibba015 bash[30343]: cluster 2021-03-10T15:56:34.517046+0000 mgr.gibba045.orlgmj (mgr.34412) 6749 : cluster [DBG] pgmap v3843: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:36.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:56:35 gibba045 bash[25517]: cluster 2021-03-10T15:56:34.517046+0000 mgr.gibba045.orlgmj (mgr.34412) 6749 : cluster [DBG] pgmap v3843: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:37.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:56:37 gibba015 bash[29377]: cluster 2021-03-10T15:56:36.518979+0000 mgr.gibba045.orlgmj (mgr.34412) 6750 : cluster [DBG] pgmap v3844: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:37.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:56:37 gibba015 bash[30343]: cluster 2021-03-10T15:56:36.518979+0000 mgr.gibba045.orlgmj (mgr.34412) 6750 : cluster [DBG] pgmap v3844: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:38.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:56:37 gibba045 bash[25517]: cluster 2021-03-10T15:56:36.518979+0000 mgr.gibba045.orlgmj (mgr.34412) 6750 : cluster [DBG] pgmap v3844: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:39.126 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:56:39.380 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:56:39.381 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 57s ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:56:39.381 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 10m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:56:39.381 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:56:39.381 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:56:39.381 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 57s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:56:39.382 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 57s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:56:39.382 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:56:39.382 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 57s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:56:39.382 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 57s ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:56:39.383 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 10m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:56:39.383 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 57s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:56:39.383 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 57s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:56:39.383 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 57s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:56:39.384 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 57s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:56:39.384 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:56:39.384 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:56:39.384 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:56:39.384 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:56:39.385 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 10m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:56:39.385 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 10m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T15:56:39.633 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:56:39.634 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:56:39.634 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:56:39.634 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:56:39.635 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:56:39.635 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:56:39.635 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:56:39.635 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:56:39.636 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:56:39.636 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:56:39.636 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:56:39.636 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:56:39.637 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:56:39.637 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:56:39.637 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:56:39.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:56:39 gibba015 bash[29377]: cluster 2021-03-10T15:56:38.520379+0000 mgr.gibba045.orlgmj (mgr.34412) 6751 : cluster [DBG] pgmap v3845: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:39.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:56:39 gibba015 bash[30343]: cluster 2021-03-10T15:56:38.520379+0000 mgr.gibba045.orlgmj (mgr.34412) 6751 : cluster [DBG] pgmap v3845: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:40.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:56:39 gibba045 bash[25517]: cluster 2021-03-10T15:56:38.520379+0000 mgr.gibba045.orlgmj (mgr.34412) 6751 : cluster [DBG] pgmap v3845: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:40.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:56:40 gibba015 bash[29377]: audit 2021-03-10T15:56:39.117826+0000 mgr.gibba045.orlgmj (mgr.34412) 6752 : audit [DBG] from='client.48588 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:56:40.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:56:40 gibba015 bash[29377]: audit 2021-03-10T15:56:39.340204+0000 mgr.gibba045.orlgmj (mgr.34412) 6753 : audit [DBG] from='client.48594 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:56:40.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:56:40 gibba015 bash[29377]: audit 2021-03-10T15:56:39.632411+0000 mon.c (mon.1) 1878 : audit [DBG] from='client.? 172.21.2.115:0/1655263681' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:56:40.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:56:40 gibba015 bash[30343]: audit 2021-03-10T15:56:39.117826+0000 mgr.gibba045.orlgmj (mgr.34412) 6752 : audit [DBG] from='client.48588 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:56:40.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:56:40 gibba015 bash[30343]: audit 2021-03-10T15:56:39.340204+0000 mgr.gibba045.orlgmj (mgr.34412) 6753 : audit [DBG] from='client.48594 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:56:40.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:56:40 gibba015 bash[30343]: audit 2021-03-10T15:56:39.632411+0000 mon.c (mon.1) 1878 : audit [DBG] from='client.? 172.21.2.115:0/1655263681' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:56:41.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:56:40 gibba045 bash[25517]: audit 2021-03-10T15:56:39.117826+0000 mgr.gibba045.orlgmj (mgr.34412) 6752 : audit [DBG] from='client.48588 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:56:41.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:56:40 gibba045 bash[25517]: audit 2021-03-10T15:56:39.340204+0000 mgr.gibba045.orlgmj (mgr.34412) 6753 : audit [DBG] from='client.48594 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:56:41.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:56:40 gibba045 bash[25517]: audit 2021-03-10T15:56:39.632411+0000 mon.c (mon.1) 1878 : audit [DBG] from='client.? 172.21.2.115:0/1655263681' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:56:41.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:56:41 gibba015 bash[29377]: cluster 2021-03-10T15:56:40.522077+0000 mgr.gibba045.orlgmj (mgr.34412) 6754 : cluster [DBG] pgmap v3846: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:41.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:56:41 gibba015 bash[30343]: cluster 2021-03-10T15:56:40.522077+0000 mgr.gibba045.orlgmj (mgr.34412) 6754 : cluster [DBG] pgmap v3846: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:42.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:56:41 gibba045 bash[25517]: cluster 2021-03-10T15:56:40.522077+0000 mgr.gibba045.orlgmj (mgr.34412) 6754 : cluster [DBG] pgmap v3846: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:42.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:56:42 gibba015 bash[29377]: audit 2021-03-10T15:56:42.023719+0000 mon.c (mon.1) 1879 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:56:42.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:56:42 gibba015 bash[29377]: audit 2021-03-10T15:56:42.031076+0000 mon.c (mon.1) 1880 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:56:42.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:56:42 gibba015 bash[30343]: audit 2021-03-10T15:56:42.023719+0000 mon.c (mon.1) 1879 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:56:42.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:56:42 gibba015 bash[30343]: audit 2021-03-10T15:56:42.031076+0000 mon.c (mon.1) 1880 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:56:43.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:56:42 gibba045 bash[25517]: audit 2021-03-10T15:56:42.023719+0000 mon.c (mon.1) 1879 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:56:43.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:56:42 gibba045 bash[25517]: audit 2021-03-10T15:56:42.031076+0000 mon.c (mon.1) 1880 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:56:43.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:56:43 gibba015 bash[29377]: cephadm 2021-03-10T15:56:42.031838+0000 mgr.gibba045.orlgmj (mgr.34412) 6755 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:56:43.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:56:43 gibba015 bash[29377]: cluster 2021-03-10T15:56:42.523891+0000 mgr.gibba045.orlgmj (mgr.34412) 6756 : cluster [DBG] pgmap v3847: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:43.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:56:43 gibba015 bash[30343]: cephadm 2021-03-10T15:56:42.031838+0000 mgr.gibba045.orlgmj (mgr.34412) 6755 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:56:43.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:56:43 gibba015 bash[30343]: cluster 2021-03-10T15:56:42.523891+0000 mgr.gibba045.orlgmj (mgr.34412) 6756 : cluster [DBG] pgmap v3847: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:44.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:56:43 gibba045 bash[25517]: cephadm 2021-03-10T15:56:42.031838+0000 mgr.gibba045.orlgmj (mgr.34412) 6755 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:56:44.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:56:43 gibba045 bash[25517]: cluster 2021-03-10T15:56:42.523891+0000 mgr.gibba045.orlgmj (mgr.34412) 6756 : cluster [DBG] pgmap v3847: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:45.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:56:45 gibba015 bash[29377]: cluster 2021-03-10T15:56:44.525314+0000 mgr.gibba045.orlgmj (mgr.34412) 6757 : cluster [DBG] pgmap v3848: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:45.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:56:45 gibba015 bash[30343]: cluster 2021-03-10T15:56:44.525314+0000 mgr.gibba045.orlgmj (mgr.34412) 6757 : cluster [DBG] pgmap v3848: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:46.010 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:56:45 gibba045 bash[25517]: cluster 2021-03-10T15:56:44.525314+0000 mgr.gibba045.orlgmj (mgr.34412) 6757 : cluster [DBG] pgmap v3848: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:47.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:56:46 gibba045 bash[25517]: audit 2021-03-10T15:56:45.787228+0000 mon.a (mon.0) 1630 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:56:47.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:56:46 gibba045 bash[25517]: cephadm 2021-03-10T15:56:45.791103+0000 mgr.gibba045.orlgmj (mgr.34412) 6758 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:56:47.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:56:46 gibba045 bash[25517]: audit 2021-03-10T15:56:45.996609+0000 mon.a (mon.0) 1631 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:56:47.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:56:46 gibba045 bash[25517]: audit 2021-03-10T15:56:46.000189+0000 mon.c (mon.1) 1881 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:56:47.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:56:46 gibba045 bash[25517]: audit 2021-03-10T15:56:46.001414+0000 mon.c (mon.1) 1882 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:56:47.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:56:46 gibba045 bash[25517]: cephadm 2021-03-10T15:56:46.002098+0000 mgr.gibba045.orlgmj (mgr.34412) 6759 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:56:47.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:56:46 gibba045 bash[25517]: audit 2021-03-10T15:56:46.002556+0000 mon.c (mon.1) 1883 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:56:47.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:56:46 gibba045 bash[25517]: cephadm 2021-03-10T15:56:46.003616+0000 mgr.gibba045.orlgmj (mgr.34412) 6760 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:56:47.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:56:46 gibba045 bash[25517]: audit 2021-03-10T15:56:46.003811+0000 mon.c (mon.1) 1884 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:56:47.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:56:46 gibba045 bash[25517]: cephadm 2021-03-10T15:56:46.004799+0000 mgr.gibba045.orlgmj (mgr.34412) 6761 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:56:47.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:56:46 gibba045 bash[25517]: cephadm 2021-03-10T15:56:46.004836+0000 mgr.gibba045.orlgmj (mgr.34412) 6762 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:56:47.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:56:46 gibba045 bash[25517]: cephadm 2021-03-10T15:56:46.005962+0000 mgr.gibba045.orlgmj (mgr.34412) 6763 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:56:47.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:56:46 gibba045 bash[25517]: cephadm 2021-03-10T15:56:46.006000+0000 mgr.gibba045.orlgmj (mgr.34412) 6764 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:56:47.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:56:46 gibba045 bash[25517]: cephadm 2021-03-10T15:56:46.007254+0000 mgr.gibba045.orlgmj (mgr.34412) 6765 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:56:47.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:56:46 gibba045 bash[25517]: audit 2021-03-10T15:56:46.007302+0000 mon.c (mon.1) 1885 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:56:47.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:56:46 gibba045 bash[25517]: audit 2021-03-10T15:56:46.008725+0000 mon.c (mon.1) 1886 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:56:47.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:56:46 gibba045 bash[25517]: cephadm 2021-03-10T15:56:46.009111+0000 mgr.gibba045.orlgmj (mgr.34412) 6766 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:56:47.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:56:46 gibba045 bash[25517]: cephadm 2021-03-10T15:56:46.009147+0000 mgr.gibba045.orlgmj (mgr.34412) 6767 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:56:47.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:56:46 gibba045 bash[25517]: cephadm 2021-03-10T15:56:46.010753+0000 mgr.gibba045.orlgmj (mgr.34412) 6768 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:56:47.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:56:46 gibba045 bash[25517]: cephadm 2021-03-10T15:56:46.011065+0000 mgr.gibba045.orlgmj (mgr.34412) 6769 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:56:47.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:56:46 gibba045 bash[25517]: cephadm 2021-03-10T15:56:46.012061+0000 mgr.gibba045.orlgmj (mgr.34412) 6770 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:56:47.062 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:56:46 gibba045 bash[25517]: cephadm 2021-03-10T15:56:46.012100+0000 mgr.gibba045.orlgmj (mgr.34412) 6771 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:56:47.062 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:56:46 gibba045 bash[25517]: cephadm 2021-03-10T15:56:46.012207+0000 mgr.gibba045.orlgmj (mgr.34412) 6772 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:56:47.062 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:56:46 gibba045 bash[25517]: cluster 2021-03-10T15:56:46.526999+0000 mgr.gibba045.orlgmj (mgr.34412) 6773 : cluster [DBG] pgmap v3849: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:47.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:56:46 gibba015 bash[29377]: audit 2021-03-10T15:56:45.787228+0000 mon.a (mon.0) 1630 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:56:47.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:56:46 gibba015 bash[29377]: cephadm 2021-03-10T15:56:45.791103+0000 mgr.gibba045.orlgmj (mgr.34412) 6758 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:56:47.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:56:46 gibba015 bash[29377]: audit 2021-03-10T15:56:45.996609+0000 mon.a (mon.0) 1631 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:56:47.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:56:46 gibba015 bash[29377]: audit 2021-03-10T15:56:46.000189+0000 mon.c (mon.1) 1881 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:56:47.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:56:46 gibba015 bash[29377]: audit 2021-03-10T15:56:46.001414+0000 mon.c (mon.1) 1882 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:56:47.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:56:46 gibba015 bash[29377]: cephadm 2021-03-10T15:56:46.002098+0000 mgr.gibba045.orlgmj (mgr.34412) 6759 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:56:47.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:56:46 gibba015 bash[29377]: audit 2021-03-10T15:56:46.002556+0000 mon.c (mon.1) 1883 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:56:47.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:56:46 gibba015 bash[29377]: cephadm 2021-03-10T15:56:46.003616+0000 mgr.gibba045.orlgmj (mgr.34412) 6760 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:56:47.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:56:46 gibba015 bash[29377]: audit 2021-03-10T15:56:46.003811+0000 mon.c (mon.1) 1884 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:56:47.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:56:46 gibba015 bash[29377]: cephadm 2021-03-10T15:56:46.004799+0000 mgr.gibba045.orlgmj (mgr.34412) 6761 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:56:47.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:56:46 gibba015 bash[29377]: cephadm 2021-03-10T15:56:46.004836+0000 mgr.gibba045.orlgmj (mgr.34412) 6762 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:56:47.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:56:46 gibba015 bash[29377]: cephadm 2021-03-10T15:56:46.005962+0000 mgr.gibba045.orlgmj (mgr.34412) 6763 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:56:47.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:56:46 gibba015 bash[29377]: cephadm 2021-03-10T15:56:46.006000+0000 mgr.gibba045.orlgmj (mgr.34412) 6764 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:56:47.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:56:46 gibba015 bash[29377]: cephadm 2021-03-10T15:56:46.007254+0000 mgr.gibba045.orlgmj (mgr.34412) 6765 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:56:47.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:56:46 gibba015 bash[29377]: audit 2021-03-10T15:56:46.007302+0000 mon.c (mon.1) 1885 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:56:47.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:56:46 gibba015 bash[29377]: audit 2021-03-10T15:56:46.008725+0000 mon.c (mon.1) 1886 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:56:47.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:56:46 gibba015 bash[29377]: cephadm 2021-03-10T15:56:46.009111+0000 mgr.gibba045.orlgmj (mgr.34412) 6766 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:56:47.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:56:46 gibba015 bash[29377]: cephadm 2021-03-10T15:56:46.009147+0000 mgr.gibba045.orlgmj (mgr.34412) 6767 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:56:47.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:56:46 gibba015 bash[29377]: cephadm 2021-03-10T15:56:46.010753+0000 mgr.gibba045.orlgmj (mgr.34412) 6768 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:56:47.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:56:46 gibba015 bash[29377]: cephadm 2021-03-10T15:56:46.011065+0000 mgr.gibba045.orlgmj (mgr.34412) 6769 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:56:47.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:56:46 gibba015 bash[29377]: cephadm 2021-03-10T15:56:46.012061+0000 mgr.gibba045.orlgmj (mgr.34412) 6770 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:56:47.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:56:46 gibba015 bash[30343]: audit 2021-03-10T15:56:45.787228+0000 mon.a (mon.0) 1630 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:56:47.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:56:46 gibba015 bash[30343]: cephadm 2021-03-10T15:56:45.791103+0000 mgr.gibba045.orlgmj (mgr.34412) 6758 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:56:47.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:56:46 gibba015 bash[30343]: audit 2021-03-10T15:56:45.996609+0000 mon.a (mon.0) 1631 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:56:47.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:56:46 gibba015 bash[30343]: audit 2021-03-10T15:56:46.000189+0000 mon.c (mon.1) 1881 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:56:47.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:56:46 gibba015 bash[30343]: audit 2021-03-10T15:56:46.001414+0000 mon.c (mon.1) 1882 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:56:47.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:56:46 gibba015 bash[30343]: cephadm 2021-03-10T15:56:46.002098+0000 mgr.gibba045.orlgmj (mgr.34412) 6759 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:56:47.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:56:46 gibba015 bash[30343]: audit 2021-03-10T15:56:46.002556+0000 mon.c (mon.1) 1883 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:56:47.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:56:46 gibba015 bash[30343]: cephadm 2021-03-10T15:56:46.003616+0000 mgr.gibba045.orlgmj (mgr.34412) 6760 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:56:47.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:56:46 gibba015 bash[30343]: audit 2021-03-10T15:56:46.003811+0000 mon.c (mon.1) 1884 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:56:47.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:56:46 gibba015 bash[30343]: cephadm 2021-03-10T15:56:46.004799+0000 mgr.gibba045.orlgmj (mgr.34412) 6761 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:56:47.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:56:46 gibba015 bash[30343]: cephadm 2021-03-10T15:56:46.004836+0000 mgr.gibba045.orlgmj (mgr.34412) 6762 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:56:47.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:56:46 gibba015 bash[30343]: cephadm 2021-03-10T15:56:46.005962+0000 mgr.gibba045.orlgmj (mgr.34412) 6763 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:56:47.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:56:46 gibba015 bash[30343]: cephadm 2021-03-10T15:56:46.006000+0000 mgr.gibba045.orlgmj (mgr.34412) 6764 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:56:47.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:56:46 gibba015 bash[30343]: cephadm 2021-03-10T15:56:46.007254+0000 mgr.gibba045.orlgmj (mgr.34412) 6765 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:56:47.234 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:56:46 gibba015 bash[30343]: audit 2021-03-10T15:56:46.007302+0000 mon.c (mon.1) 1885 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:56:47.234 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:56:46 gibba015 bash[30343]: audit 2021-03-10T15:56:46.008725+0000 mon.c (mon.1) 1886 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:56:47.234 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:56:46 gibba015 bash[30343]: cephadm 2021-03-10T15:56:46.009111+0000 mgr.gibba045.orlgmj (mgr.34412) 6766 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:56:47.235 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:56:46 gibba015 bash[30343]: cephadm 2021-03-10T15:56:46.009147+0000 mgr.gibba045.orlgmj (mgr.34412) 6767 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:56:47.235 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:56:46 gibba015 bash[30343]: cephadm 2021-03-10T15:56:46.010753+0000 mgr.gibba045.orlgmj (mgr.34412) 6768 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:56:47.235 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:56:46 gibba015 bash[30343]: cephadm 2021-03-10T15:56:46.011065+0000 mgr.gibba045.orlgmj (mgr.34412) 6769 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:56:47.235 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:56:46 gibba015 bash[30343]: cephadm 2021-03-10T15:56:46.012061+0000 mgr.gibba045.orlgmj (mgr.34412) 6770 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:56:47.236 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:56:46 gibba015 bash[29377]: cephadm 2021-03-10T15:56:46.012100+0000 mgr.gibba045.orlgmj (mgr.34412) 6771 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:56:47.236 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:56:46 gibba015 bash[29377]: cephadm 2021-03-10T15:56:46.012207+0000 mgr.gibba045.orlgmj (mgr.34412) 6772 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:56:47.237 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:56:46 gibba015 bash[29377]: cluster 2021-03-10T15:56:46.526999+0000 mgr.gibba045.orlgmj (mgr.34412) 6773 : cluster [DBG] pgmap v3849: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:47.237 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:56:46 gibba015 bash[30343]: cephadm 2021-03-10T15:56:46.012100+0000 mgr.gibba045.orlgmj (mgr.34412) 6771 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:56:47.238 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:56:46 gibba015 bash[30343]: cephadm 2021-03-10T15:56:46.012207+0000 mgr.gibba045.orlgmj (mgr.34412) 6772 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:56:47.238 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:56:46 gibba015 bash[30343]: cluster 2021-03-10T15:56:46.526999+0000 mgr.gibba045.orlgmj (mgr.34412) 6773 : cluster [DBG] pgmap v3849: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:49.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:56:49 gibba015 bash[29377]: cluster 2021-03-10T15:56:48.528326+0000 mgr.gibba045.orlgmj (mgr.34412) 6774 : cluster [DBG] pgmap v3850: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:49.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:56:49 gibba015 bash[30343]: cluster 2021-03-10T15:56:48.528326+0000 mgr.gibba045.orlgmj (mgr.34412) 6774 : cluster [DBG] pgmap v3850: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:50.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:56:49 gibba045 bash[25517]: cluster 2021-03-10T15:56:48.528326+0000 mgr.gibba045.orlgmj (mgr.34412) 6774 : cluster [DBG] pgmap v3850: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:51.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:56:51 gibba015 bash[29377]: cluster 2021-03-10T15:56:50.530079+0000 mgr.gibba045.orlgmj (mgr.34412) 6775 : cluster [DBG] pgmap v3851: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:51.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:56:51 gibba015 bash[30343]: cluster 2021-03-10T15:56:50.530079+0000 mgr.gibba045.orlgmj (mgr.34412) 6775 : cluster [DBG] pgmap v3851: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:51.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:56:51 gibba045 bash[25517]: cluster 2021-03-10T15:56:50.530079+0000 mgr.gibba045.orlgmj (mgr.34412) 6775 : cluster [DBG] pgmap v3851: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:53.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:56:53 gibba015 bash[29377]: cluster 2021-03-10T15:56:52.531815+0000 mgr.gibba045.orlgmj (mgr.34412) 6776 : cluster [DBG] pgmap v3852: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:53.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:56:53 gibba015 bash[29377]: audit 2021-03-10T15:56:53.355246+0000 mon.c (mon.1) 1887 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:56:53.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:56:53 gibba015 bash[29377]: audit 2021-03-10T15:56:53.356072+0000 mon.c (mon.1) 1888 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:56:53.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:56:53 gibba015 bash[29377]: audit 2021-03-10T15:56:53.356341+0000 mon.a (mon.0) 1632 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:56:53.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:56:53 gibba015 bash[29377]: audit 2021-03-10T15:56:53.357425+0000 mon.a (mon.0) 1633 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:56:53.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:56:53 gibba015 bash[29377]: audit 2021-03-10T15:56:53.357660+0000 mon.c (mon.1) 1889 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T15:56:53.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:56:53 gibba015 bash[29377]: audit 2021-03-10T15:56:53.358857+0000 mon.a (mon.0) 1634 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T15:56:53.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:56:53 gibba015 bash[29377]: audit 2021-03-10T15:56:53.358895+0000 mon.c (mon.1) 1890 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:56:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:56:53 gibba015 bash[29377]: audit 2021-03-10T15:56:53.359245+0000 mon.a (mon.0) 1635 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:56:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:56:53 gibba015 bash[29377]: audit 2021-03-10T15:56:53.359283+0000 mon.c (mon.1) 1891 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:56:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:56:53 gibba015 bash[29377]: audit 2021-03-10T15:56:53.359548+0000 mon.c (mon.1) 1892 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:56:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:56:53 gibba015 bash[29377]: audit 2021-03-10T15:56:53.359583+0000 mon.a (mon.0) 1636 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:56:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:56:53 gibba015 bash[29377]: audit 2021-03-10T15:56:53.359879+0000 mon.a (mon.0) 1637 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:56:53.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:56:53 gibba015 bash[30343]: cluster 2021-03-10T15:56:52.531815+0000 mgr.gibba045.orlgmj (mgr.34412) 6776 : cluster [DBG] pgmap v3852: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:53.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:56:53 gibba015 bash[30343]: audit 2021-03-10T15:56:53.355246+0000 mon.c (mon.1) 1887 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:56:53.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:56:53 gibba015 bash[30343]: audit 2021-03-10T15:56:53.356072+0000 mon.c (mon.1) 1888 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:56:53.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:56:53 gibba015 bash[30343]: audit 2021-03-10T15:56:53.356341+0000 mon.a (mon.0) 1632 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:56:53.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:56:53 gibba015 bash[30343]: audit 2021-03-10T15:56:53.357425+0000 mon.a (mon.0) 1633 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:56:53.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:56:53 gibba015 bash[30343]: audit 2021-03-10T15:56:53.357660+0000 mon.c (mon.1) 1889 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T15:56:53.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:56:53 gibba015 bash[30343]: audit 2021-03-10T15:56:53.358857+0000 mon.a (mon.0) 1634 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T15:56:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:56:53 gibba015 bash[30343]: audit 2021-03-10T15:56:53.358895+0000 mon.c (mon.1) 1890 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:56:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:56:53 gibba015 bash[30343]: audit 2021-03-10T15:56:53.359245+0000 mon.a (mon.0) 1635 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:56:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:56:53 gibba015 bash[30343]: audit 2021-03-10T15:56:53.359283+0000 mon.c (mon.1) 1891 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:56:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:56:53 gibba015 bash[30343]: audit 2021-03-10T15:56:53.359548+0000 mon.c (mon.1) 1892 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:56:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:56:53 gibba015 bash[30343]: audit 2021-03-10T15:56:53.359583+0000 mon.a (mon.0) 1636 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:56:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:56:53 gibba015 bash[30343]: audit 2021-03-10T15:56:53.359879+0000 mon.a (mon.0) 1637 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:56:54.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:56:53 gibba045 bash[25517]: cluster 2021-03-10T15:56:52.531815+0000 mgr.gibba045.orlgmj (mgr.34412) 6776 : cluster [DBG] pgmap v3852: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:54.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:56:53 gibba045 bash[25517]: audit 2021-03-10T15:56:53.355246+0000 mon.c (mon.1) 1887 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:56:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:56:53 gibba045 bash[25517]: audit 2021-03-10T15:56:53.356072+0000 mon.c (mon.1) 1888 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:56:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:56:53 gibba045 bash[25517]: audit 2021-03-10T15:56:53.356341+0000 mon.a (mon.0) 1632 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:56:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:56:53 gibba045 bash[25517]: audit 2021-03-10T15:56:53.357425+0000 mon.a (mon.0) 1633 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:56:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:56:53 gibba045 bash[25517]: audit 2021-03-10T15:56:53.357660+0000 mon.c (mon.1) 1889 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T15:56:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:56:53 gibba045 bash[25517]: audit 2021-03-10T15:56:53.358857+0000 mon.a (mon.0) 1634 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T15:56:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:56:53 gibba045 bash[25517]: audit 2021-03-10T15:56:53.358895+0000 mon.c (mon.1) 1890 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:56:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:56:53 gibba045 bash[25517]: audit 2021-03-10T15:56:53.359245+0000 mon.a (mon.0) 1635 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:56:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:56:53 gibba045 bash[25517]: audit 2021-03-10T15:56:53.359283+0000 mon.c (mon.1) 1891 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:56:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:56:53 gibba045 bash[25517]: audit 2021-03-10T15:56:53.359548+0000 mon.c (mon.1) 1892 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:56:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:56:53 gibba045 bash[25517]: audit 2021-03-10T15:56:53.359583+0000 mon.a (mon.0) 1636 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:56:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:56:53 gibba045 bash[25517]: audit 2021-03-10T15:56:53.359879+0000 mon.a (mon.0) 1637 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:56:55.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:56:55 gibba015 bash[29377]: cluster 2021-03-10T15:56:54.533175+0000 mgr.gibba045.orlgmj (mgr.34412) 6777 : cluster [DBG] pgmap v3853: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:55.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:56:55 gibba015 bash[30343]: cluster 2021-03-10T15:56:54.533175+0000 mgr.gibba045.orlgmj (mgr.34412) 6777 : cluster [DBG] pgmap v3853: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:56.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:56:55 gibba045 bash[25517]: cluster 2021-03-10T15:56:54.533175+0000 mgr.gibba045.orlgmj (mgr.34412) 6777 : cluster [DBG] pgmap v3853: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:57.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:56:57 gibba015 bash[29377]: cluster 2021-03-10T15:56:56.534832+0000 mgr.gibba045.orlgmj (mgr.34412) 6778 : cluster [DBG] pgmap v3854: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:57.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:56:57 gibba015 bash[30343]: cluster 2021-03-10T15:56:56.534832+0000 mgr.gibba045.orlgmj (mgr.34412) 6778 : cluster [DBG] pgmap v3854: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:58.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:56:57 gibba045 bash[25517]: cluster 2021-03-10T15:56:56.534832+0000 mgr.gibba045.orlgmj (mgr.34412) 6778 : cluster [DBG] pgmap v3854: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:59.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:56:59 gibba015 bash[29377]: cluster 2021-03-10T15:56:58.536071+0000 mgr.gibba045.orlgmj (mgr.34412) 6779 : cluster [DBG] pgmap v3855: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:59.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:56:59 gibba015 bash[30343]: cluster 2021-03-10T15:56:58.536071+0000 mgr.gibba045.orlgmj (mgr.34412) 6779 : cluster [DBG] pgmap v3855: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:00.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:56:59 gibba045 bash[25517]: cluster 2021-03-10T15:56:58.536071+0000 mgr.gibba045.orlgmj (mgr.34412) 6779 : cluster [DBG] pgmap v3855: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:01.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:57:01 gibba045 bash[25517]: cluster 2021-03-10T15:57:00.537808+0000 mgr.gibba045.orlgmj (mgr.34412) 6780 : cluster [DBG] pgmap v3856: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:01.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:57:01 gibba015 bash[29377]: cluster 2021-03-10T15:57:00.537808+0000 mgr.gibba045.orlgmj (mgr.34412) 6780 : cluster [DBG] pgmap v3856: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:01.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:57:01 gibba015 bash[30343]: cluster 2021-03-10T15:57:00.537808+0000 mgr.gibba045.orlgmj (mgr.34412) 6780 : cluster [DBG] pgmap v3856: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:02.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:57:02 gibba015 bash[29377]: cephadm 2021-03-10T15:57:01.028366+0000 mgr.gibba045.orlgmj (mgr.34412) 6781 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:57:02.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:57:02 gibba015 bash[30343]: cephadm 2021-03-10T15:57:01.028366+0000 mgr.gibba045.orlgmj (mgr.34412) 6781 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:57:02.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:57:02 gibba045 bash[25517]: cephadm 2021-03-10T15:57:01.028366+0000 mgr.gibba045.orlgmj (mgr.34412) 6781 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:57:03.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:57:03 gibba015 bash[29377]: cluster 2021-03-10T15:57:02.539575+0000 mgr.gibba045.orlgmj (mgr.34412) 6782 : cluster [DBG] pgmap v3857: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:03.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:57:03 gibba015 bash[30343]: cluster 2021-03-10T15:57:02.539575+0000 mgr.gibba045.orlgmj (mgr.34412) 6782 : cluster [DBG] pgmap v3857: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:03.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:57:03 gibba045 bash[25517]: cluster 2021-03-10T15:57:02.539575+0000 mgr.gibba045.orlgmj (mgr.34412) 6782 : cluster [DBG] pgmap v3857: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:05.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:57:05 gibba015 bash[29377]: cluster 2021-03-10T15:57:04.540956+0000 mgr.gibba045.orlgmj (mgr.34412) 6783 : cluster [DBG] pgmap v3858: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:05.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:57:05 gibba015 bash[30343]: cluster 2021-03-10T15:57:04.540956+0000 mgr.gibba045.orlgmj (mgr.34412) 6783 : cluster [DBG] pgmap v3858: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:06.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:57:05 gibba045 bash[25517]: cluster 2021-03-10T15:57:04.540956+0000 mgr.gibba045.orlgmj (mgr.34412) 6783 : cluster [DBG] pgmap v3858: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:07.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:57:07 gibba015 bash[29377]: cluster 2021-03-10T15:57:06.542754+0000 mgr.gibba045.orlgmj (mgr.34412) 6784 : cluster [DBG] pgmap v3859: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:07.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:57:07 gibba015 bash[30343]: cluster 2021-03-10T15:57:06.542754+0000 mgr.gibba045.orlgmj (mgr.34412) 6784 : cluster [DBG] pgmap v3859: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:08.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:57:07 gibba045 bash[25517]: cluster 2021-03-10T15:57:06.542754+0000 mgr.gibba045.orlgmj (mgr.34412) 6784 : cluster [DBG] pgmap v3859: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:09.879 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:57:09.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:57:09 gibba015 bash[30343]: cluster 2021-03-10T15:57:08.544131+0000 mgr.gibba045.orlgmj (mgr.34412) 6785 : cluster [DBG] pgmap v3860: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:09.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:57:09 gibba015 bash[29377]: cluster 2021-03-10T15:57:08.544131+0000 mgr.gibba045.orlgmj (mgr.34412) 6785 : cluster [DBG] pgmap v3860: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:10.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:57:09 gibba045 bash[25517]: cluster 2021-03-10T15:57:08.544131+0000 mgr.gibba045.orlgmj (mgr.34412) 6785 : cluster [DBG] pgmap v3860: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:10.107 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:57:10.107 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 88s ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:57:10.107 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 24s ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:57:10.108 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 24s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:57:10.108 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 24s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:57:10.108 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 88s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:57:10.108 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 88s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:57:10.108 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 24s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:57:10.109 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 88s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:57:10.109 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 88s ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:57:10.109 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 24s ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:57:10.109 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 88s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:57:10.110 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 88s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:57:10.110 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 88s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:57:10.110 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 88s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:57:10.110 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 24s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:57:10.111 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 24s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:57:10.111 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 24s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:57:10.111 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 24s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:57:10.111 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 24s ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:57:10.111 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 24s ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T15:57:10.355 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:57:10.356 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:57:10.356 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:57:10.356 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:57:10.356 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:57:10.357 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:57:10.357 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:57:10.357 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:57:10.357 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:57:10.358 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:57:10.358 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:57:10.358 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:57:10.358 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:57:10.358 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:57:10.359 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:57:11.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:57:11 gibba015 bash[29377]: audit 2021-03-10T15:57:09.871223+0000 mgr.gibba045.orlgmj (mgr.34412) 6786 : audit [DBG] from='client.48606 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:57:11.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:57:11 gibba015 bash[29377]: audit 2021-03-10T15:57:10.096111+0000 mgr.gibba045.orlgmj (mgr.34412) 6787 : audit [DBG] from='client.48612 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:57:11.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:57:11 gibba015 bash[29377]: audit 2021-03-10T15:57:10.354182+0000 mon.a (mon.0) 1638 : audit [DBG] from='client.? 172.21.2.115:0/2316551284' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:57:11.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:57:11 gibba015 bash[29377]: cluster 2021-03-10T15:57:10.545819+0000 mgr.gibba045.orlgmj (mgr.34412) 6788 : cluster [DBG] pgmap v3861: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:11.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:57:11 gibba015 bash[30343]: audit 2021-03-10T15:57:09.871223+0000 mgr.gibba045.orlgmj (mgr.34412) 6786 : audit [DBG] from='client.48606 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:57:11.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:57:11 gibba015 bash[30343]: audit 2021-03-10T15:57:10.096111+0000 mgr.gibba045.orlgmj (mgr.34412) 6787 : audit [DBG] from='client.48612 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:57:11.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:57:11 gibba015 bash[30343]: audit 2021-03-10T15:57:10.354182+0000 mon.a (mon.0) 1638 : audit [DBG] from='client.? 172.21.2.115:0/2316551284' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:57:11.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:57:11 gibba015 bash[30343]: cluster 2021-03-10T15:57:10.545819+0000 mgr.gibba045.orlgmj (mgr.34412) 6788 : cluster [DBG] pgmap v3861: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:11.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:57:11 gibba045 bash[25517]: audit 2021-03-10T15:57:09.871223+0000 mgr.gibba045.orlgmj (mgr.34412) 6786 : audit [DBG] from='client.48606 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:57:11.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:57:11 gibba045 bash[25517]: audit 2021-03-10T15:57:10.096111+0000 mgr.gibba045.orlgmj (mgr.34412) 6787 : audit [DBG] from='client.48612 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:57:11.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:57:11 gibba045 bash[25517]: audit 2021-03-10T15:57:10.354182+0000 mon.a (mon.0) 1638 : audit [DBG] from='client.? 172.21.2.115:0/2316551284' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:57:11.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:57:11 gibba045 bash[25517]: cluster 2021-03-10T15:57:10.545819+0000 mgr.gibba045.orlgmj (mgr.34412) 6788 : cluster [DBG] pgmap v3861: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:13.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:57:13 gibba015 bash[29377]: cluster 2021-03-10T15:57:12.547350+0000 mgr.gibba045.orlgmj (mgr.34412) 6789 : cluster [DBG] pgmap v3862: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:13.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:57:13 gibba015 bash[30343]: cluster 2021-03-10T15:57:12.547350+0000 mgr.gibba045.orlgmj (mgr.34412) 6789 : cluster [DBG] pgmap v3862: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:14.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:57:13 gibba045 bash[25517]: cluster 2021-03-10T15:57:12.547350+0000 mgr.gibba045.orlgmj (mgr.34412) 6789 : cluster [DBG] pgmap v3862: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:15.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:57:15 gibba015 bash[29377]: cluster 2021-03-10T15:57:14.548875+0000 mgr.gibba045.orlgmj (mgr.34412) 6790 : cluster [DBG] pgmap v3863: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:15.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:57:15 gibba015 bash[30343]: cluster 2021-03-10T15:57:14.548875+0000 mgr.gibba045.orlgmj (mgr.34412) 6790 : cluster [DBG] pgmap v3863: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:16.038 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:57:15 gibba045 bash[25517]: cluster 2021-03-10T15:57:14.548875+0000 mgr.gibba045.orlgmj (mgr.34412) 6790 : cluster [DBG] pgmap v3863: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:17.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:57:17 gibba015 bash[29377]: cephadm 2021-03-10T15:57:16.039026+0000 mgr.gibba045.orlgmj (mgr.34412) 6791 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:57:17.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:57:17 gibba015 bash[29377]: cluster 2021-03-10T15:57:16.550537+0000 mgr.gibba045.orlgmj (mgr.34412) 6792 : cluster [DBG] pgmap v3864: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:17.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:57:17 gibba015 bash[30343]: cephadm 2021-03-10T15:57:16.039026+0000 mgr.gibba045.orlgmj (mgr.34412) 6791 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:57:17.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:57:17 gibba015 bash[30343]: cluster 2021-03-10T15:57:16.550537+0000 mgr.gibba045.orlgmj (mgr.34412) 6792 : cluster [DBG] pgmap v3864: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:18.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:57:17 gibba045 bash[25517]: cephadm 2021-03-10T15:57:16.039026+0000 mgr.gibba045.orlgmj (mgr.34412) 6791 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:57:18.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:57:17 gibba045 bash[25517]: cluster 2021-03-10T15:57:16.550537+0000 mgr.gibba045.orlgmj (mgr.34412) 6792 : cluster [DBG] pgmap v3864: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:19.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:57:19 gibba015 bash[29377]: cluster 2021-03-10T15:57:18.551838+0000 mgr.gibba045.orlgmj (mgr.34412) 6793 : cluster [DBG] pgmap v3865: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:19.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:57:19 gibba015 bash[30343]: cluster 2021-03-10T15:57:18.551838+0000 mgr.gibba045.orlgmj (mgr.34412) 6793 : cluster [DBG] pgmap v3865: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:20.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:57:19 gibba045 bash[25517]: cluster 2021-03-10T15:57:18.551838+0000 mgr.gibba045.orlgmj (mgr.34412) 6793 : cluster [DBG] pgmap v3865: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:21.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:57:21 gibba015 bash[29377]: cluster 2021-03-10T15:57:20.553551+0000 mgr.gibba045.orlgmj (mgr.34412) 6794 : cluster [DBG] pgmap v3866: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:21.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:57:21 gibba015 bash[30343]: cluster 2021-03-10T15:57:20.553551+0000 mgr.gibba045.orlgmj (mgr.34412) 6794 : cluster [DBG] pgmap v3866: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:21.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:57:21 gibba045 bash[25517]: cluster 2021-03-10T15:57:20.553551+0000 mgr.gibba045.orlgmj (mgr.34412) 6794 : cluster [DBG] pgmap v3866: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:23.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:57:23 gibba015 bash[29377]: cluster 2021-03-10T15:57:22.555260+0000 mgr.gibba045.orlgmj (mgr.34412) 6795 : cluster [DBG] pgmap v3867: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:23.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:57:23 gibba015 bash[30343]: cluster 2021-03-10T15:57:22.555260+0000 mgr.gibba045.orlgmj (mgr.34412) 6795 : cluster [DBG] pgmap v3867: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:24.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:57:23 gibba045 bash[25517]: cluster 2021-03-10T15:57:22.555260+0000 mgr.gibba045.orlgmj (mgr.34412) 6795 : cluster [DBG] pgmap v3867: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:25.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:57:25 gibba015 bash[29377]: cluster 2021-03-10T15:57:24.556953+0000 mgr.gibba045.orlgmj (mgr.34412) 6796 : cluster [DBG] pgmap v3868: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:25.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:57:25 gibba015 bash[30343]: cluster 2021-03-10T15:57:24.556953+0000 mgr.gibba045.orlgmj (mgr.34412) 6796 : cluster [DBG] pgmap v3868: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:26.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:57:25 gibba045 bash[25517]: cluster 2021-03-10T15:57:24.556953+0000 mgr.gibba045.orlgmj (mgr.34412) 6796 : cluster [DBG] pgmap v3868: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:27.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:57:27 gibba015 bash[29377]: cluster 2021-03-10T15:57:26.558831+0000 mgr.gibba045.orlgmj (mgr.34412) 6797 : cluster [DBG] pgmap v3869: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:27.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:57:27 gibba015 bash[30343]: cluster 2021-03-10T15:57:26.558831+0000 mgr.gibba045.orlgmj (mgr.34412) 6797 : cluster [DBG] pgmap v3869: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:28.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:57:27 gibba045 bash[25517]: cluster 2021-03-10T15:57:26.558831+0000 mgr.gibba045.orlgmj (mgr.34412) 6797 : cluster [DBG] pgmap v3869: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:29.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:57:29 gibba015 bash[29377]: cluster 2021-03-10T15:57:28.560140+0000 mgr.gibba045.orlgmj (mgr.34412) 6798 : cluster [DBG] pgmap v3870: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:29.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:57:29 gibba015 bash[30343]: cluster 2021-03-10T15:57:28.560140+0000 mgr.gibba045.orlgmj (mgr.34412) 6798 : cluster [DBG] pgmap v3870: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:30.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:57:29 gibba045 bash[25517]: cluster 2021-03-10T15:57:28.560140+0000 mgr.gibba045.orlgmj (mgr.34412) 6798 : cluster [DBG] pgmap v3870: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:31.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:57:31 gibba045 bash[25517]: cluster 2021-03-10T15:57:30.561844+0000 mgr.gibba045.orlgmj (mgr.34412) 6799 : cluster [DBG] pgmap v3871: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:31.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:57:31 gibba015 bash[29377]: cluster 2021-03-10T15:57:30.561844+0000 mgr.gibba045.orlgmj (mgr.34412) 6799 : cluster [DBG] pgmap v3871: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:31.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:57:31 gibba015 bash[30343]: cluster 2021-03-10T15:57:30.561844+0000 mgr.gibba045.orlgmj (mgr.34412) 6799 : cluster [DBG] pgmap v3871: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:32.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:57:32 gibba015 bash[29377]: cephadm 2021-03-10T15:57:31.055035+0000 mgr.gibba045.orlgmj (mgr.34412) 6800 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:57:32.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:57:32 gibba015 bash[30343]: cephadm 2021-03-10T15:57:31.055035+0000 mgr.gibba045.orlgmj (mgr.34412) 6800 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:57:32.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:57:32 gibba045 bash[25517]: cephadm 2021-03-10T15:57:31.055035+0000 mgr.gibba045.orlgmj (mgr.34412) 6800 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:57:33.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:57:33 gibba015 bash[29377]: cluster 2021-03-10T15:57:32.563331+0000 mgr.gibba045.orlgmj (mgr.34412) 6801 : cluster [DBG] pgmap v3872: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:33.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:57:33 gibba015 bash[30343]: cluster 2021-03-10T15:57:32.563331+0000 mgr.gibba045.orlgmj (mgr.34412) 6801 : cluster [DBG] pgmap v3872: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:33.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:57:33 gibba045 bash[25517]: cluster 2021-03-10T15:57:32.563331+0000 mgr.gibba045.orlgmj (mgr.34412) 6801 : cluster [DBG] pgmap v3872: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:35.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:57:35 gibba015 bash[29377]: cluster 2021-03-10T15:57:34.564730+0000 mgr.gibba045.orlgmj (mgr.34412) 6802 : cluster [DBG] pgmap v3873: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:35.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:57:35 gibba015 bash[30343]: cluster 2021-03-10T15:57:34.564730+0000 mgr.gibba045.orlgmj (mgr.34412) 6802 : cluster [DBG] pgmap v3873: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:36.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:57:35 gibba045 bash[25517]: cluster 2021-03-10T15:57:34.564730+0000 mgr.gibba045.orlgmj (mgr.34412) 6802 : cluster [DBG] pgmap v3873: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:37.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:57:37 gibba015 bash[29377]: cluster 2021-03-10T15:57:36.566583+0000 mgr.gibba045.orlgmj (mgr.34412) 6803 : cluster [DBG] pgmap v3874: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:37.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:57:37 gibba015 bash[30343]: cluster 2021-03-10T15:57:36.566583+0000 mgr.gibba045.orlgmj (mgr.34412) 6803 : cluster [DBG] pgmap v3874: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:38.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:57:37 gibba045 bash[25517]: cluster 2021-03-10T15:57:36.566583+0000 mgr.gibba045.orlgmj (mgr.34412) 6803 : cluster [DBG] pgmap v3874: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:39.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:57:39 gibba015 bash[29377]: cluster 2021-03-10T15:57:38.567897+0000 mgr.gibba045.orlgmj (mgr.34412) 6804 : cluster [DBG] pgmap v3875: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:39.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:57:39 gibba015 bash[30343]: cluster 2021-03-10T15:57:38.567897+0000 mgr.gibba045.orlgmj (mgr.34412) 6804 : cluster [DBG] pgmap v3875: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:40.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:57:39 gibba045 bash[25517]: cluster 2021-03-10T15:57:38.567897+0000 mgr.gibba045.orlgmj (mgr.34412) 6804 : cluster [DBG] pgmap v3875: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:40.595 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:57:40.822 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:57:40.823 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 119s ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:57:40.823 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 55s ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:57:40.823 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 55s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:57:40.823 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 55s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:57:40.824 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 119s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:57:40.824 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 119s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:57:40.824 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 55s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:57:40.824 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 119s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:57:40.825 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 119s ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:57:40.825 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 55s ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:57:40.825 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 119s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:57:40.825 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 119s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:57:40.825 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 119s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:57:40.826 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 119s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:57:40.826 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 55s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:57:40.826 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 55s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:57:40.826 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 55s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:57:40.827 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 55s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:57:40.827 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 55s ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:57:40.827 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 55s ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T15:57:41.069 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:57:41.070 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:57:41.070 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:57:41.070 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:57:41.071 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:57:41.071 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:57:41.071 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:57:41.071 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:57:41.072 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:57:41.072 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:57:41.072 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:57:41.072 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:57:41.072 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:57:41.073 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:57:41.073 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:57:41.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:57:41 gibba015 bash[29377]: cluster 2021-03-10T15:57:40.569604+0000 mgr.gibba045.orlgmj (mgr.34412) 6805 : cluster [DBG] pgmap v3876: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:41.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:57:41 gibba015 bash[29377]: audit 2021-03-10T15:57:40.587517+0000 mgr.gibba045.orlgmj (mgr.34412) 6806 : audit [DBG] from='client.58612 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:57:41.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:57:41 gibba015 bash[29377]: audit 2021-03-10T15:57:41.068307+0000 mon.a (mon.0) 1639 : audit [DBG] from='client.? 172.21.2.115:0/994658059' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:57:41.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:57:41 gibba015 bash[30343]: cluster 2021-03-10T15:57:40.569604+0000 mgr.gibba045.orlgmj (mgr.34412) 6805 : cluster [DBG] pgmap v3876: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:41.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:57:41 gibba015 bash[30343]: audit 2021-03-10T15:57:40.587517+0000 mgr.gibba045.orlgmj (mgr.34412) 6806 : audit [DBG] from='client.58612 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:57:41.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:57:41 gibba015 bash[30343]: audit 2021-03-10T15:57:41.068307+0000 mon.a (mon.0) 1639 : audit [DBG] from='client.? 172.21.2.115:0/994658059' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:57:41.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:57:41 gibba045 bash[25517]: cluster 2021-03-10T15:57:40.569604+0000 mgr.gibba045.orlgmj (mgr.34412) 6805 : cluster [DBG] pgmap v3876: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:41.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:57:41 gibba045 bash[25517]: audit 2021-03-10T15:57:40.587517+0000 mgr.gibba045.orlgmj (mgr.34412) 6806 : audit [DBG] from='client.58612 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:57:41.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:57:41 gibba045 bash[25517]: audit 2021-03-10T15:57:41.068307+0000 mon.a (mon.0) 1639 : audit [DBG] from='client.? 172.21.2.115:0/994658059' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:57:42.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:57:42 gibba015 bash[29377]: audit 2021-03-10T15:57:40.811360+0000 mgr.gibba045.orlgmj (mgr.34412) 6807 : audit [DBG] from='client.58618 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:57:42.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:57:42 gibba015 bash[30343]: audit 2021-03-10T15:57:40.811360+0000 mgr.gibba045.orlgmj (mgr.34412) 6807 : audit [DBG] from='client.58618 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:57:42.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:57:42 gibba045 bash[25517]: audit 2021-03-10T15:57:40.811360+0000 mgr.gibba045.orlgmj (mgr.34412) 6807 : audit [DBG] from='client.58618 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:57:43.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:57:43 gibba015 bash[29377]: cluster 2021-03-10T15:57:42.574857+0000 mgr.gibba045.orlgmj (mgr.34412) 6808 : cluster [DBG] pgmap v3877: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:43.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:57:43 gibba015 bash[30343]: cluster 2021-03-10T15:57:42.574857+0000 mgr.gibba045.orlgmj (mgr.34412) 6808 : cluster [DBG] pgmap v3877: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:43.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:57:43 gibba045 bash[25517]: cluster 2021-03-10T15:57:42.574857+0000 mgr.gibba045.orlgmj (mgr.34412) 6808 : cluster [DBG] pgmap v3877: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:45.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:57:45 gibba015 bash[29377]: cluster 2021-03-10T15:57:44.576076+0000 mgr.gibba045.orlgmj (mgr.34412) 6809 : cluster [DBG] pgmap v3878: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:45.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:57:45 gibba015 bash[30343]: cluster 2021-03-10T15:57:44.576076+0000 mgr.gibba045.orlgmj (mgr.34412) 6809 : cluster [DBG] pgmap v3878: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:46.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:57:45 gibba045 bash[25517]: cluster 2021-03-10T15:57:44.576076+0000 mgr.gibba045.orlgmj (mgr.34412) 6809 : cluster [DBG] pgmap v3878: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:46.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:57:46 gibba015 bash[29377]: audit 2021-03-10T15:57:46.067565+0000 mon.c (mon.1) 1893 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:57:46.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:57:46 gibba015 bash[29377]: audit 2021-03-10T15:57:46.288080+0000 mon.a (mon.0) 1640 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:57:46.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:57:46 gibba015 bash[29377]: audit 2021-03-10T15:57:46.292073+0000 mon.c (mon.1) 1894 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:57:46.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:57:46 gibba015 bash[29377]: audit 2021-03-10T15:57:46.293843+0000 mon.c (mon.1) 1895 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:57:46.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:57:46 gibba015 bash[29377]: audit 2021-03-10T15:57:46.295613+0000 mon.c (mon.1) 1896 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:57:46.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:57:46 gibba015 bash[29377]: audit 2021-03-10T15:57:46.296934+0000 mon.c (mon.1) 1897 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:57:46.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:57:46 gibba015 bash[29377]: audit 2021-03-10T15:57:46.300101+0000 mon.c (mon.1) 1898 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:57:46.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:57:46 gibba015 bash[29377]: audit 2021-03-10T15:57:46.301565+0000 mon.c (mon.1) 1899 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:57:46.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:57:46 gibba015 bash[30343]: audit 2021-03-10T15:57:46.067565+0000 mon.c (mon.1) 1893 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:57:46.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:57:46 gibba015 bash[30343]: audit 2021-03-10T15:57:46.288080+0000 mon.a (mon.0) 1640 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:57:46.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:57:46 gibba015 bash[30343]: audit 2021-03-10T15:57:46.292073+0000 mon.c (mon.1) 1894 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:57:46.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:57:46 gibba015 bash[30343]: audit 2021-03-10T15:57:46.293843+0000 mon.c (mon.1) 1895 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:57:46.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:57:46 gibba015 bash[30343]: audit 2021-03-10T15:57:46.295613+0000 mon.c (mon.1) 1896 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:57:46.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:57:46 gibba015 bash[30343]: audit 2021-03-10T15:57:46.296934+0000 mon.c (mon.1) 1897 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:57:46.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:57:46 gibba015 bash[30343]: audit 2021-03-10T15:57:46.300101+0000 mon.c (mon.1) 1898 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:57:46.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:57:46 gibba015 bash[30343]: audit 2021-03-10T15:57:46.301565+0000 mon.c (mon.1) 1899 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:57:47.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:57:46 gibba045 bash[25517]: audit 2021-03-10T15:57:46.067565+0000 mon.c (mon.1) 1893 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:57:47.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:57:46 gibba045 bash[25517]: audit 2021-03-10T15:57:46.288080+0000 mon.a (mon.0) 1640 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:57:47.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:57:46 gibba045 bash[25517]: audit 2021-03-10T15:57:46.292073+0000 mon.c (mon.1) 1894 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:57:47.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:57:46 gibba045 bash[25517]: audit 2021-03-10T15:57:46.293843+0000 mon.c (mon.1) 1895 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:57:47.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:57:46 gibba045 bash[25517]: audit 2021-03-10T15:57:46.295613+0000 mon.c (mon.1) 1896 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:57:47.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:57:46 gibba045 bash[25517]: audit 2021-03-10T15:57:46.296934+0000 mon.c (mon.1) 1897 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:57:47.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:57:46 gibba045 bash[25517]: audit 2021-03-10T15:57:46.300101+0000 mon.c (mon.1) 1898 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:57:47.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:57:46 gibba045 bash[25517]: audit 2021-03-10T15:57:46.301565+0000 mon.c (mon.1) 1899 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:57:47.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:57:47 gibba015 bash[29377]: cephadm 2021-03-10T15:57:46.075177+0000 mgr.gibba045.orlgmj (mgr.34412) 6810 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:57:47.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:57:47 gibba015 bash[29377]: cephadm 2021-03-10T15:57:46.076941+0000 mgr.gibba045.orlgmj (mgr.34412) 6811 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:57:47.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:57:47 gibba015 bash[29377]: cephadm 2021-03-10T15:57:46.293760+0000 mgr.gibba045.orlgmj (mgr.34412) 6812 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:57:47.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:57:47 gibba015 bash[29377]: cephadm 2021-03-10T15:57:46.295903+0000 mgr.gibba045.orlgmj (mgr.34412) 6813 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:57:47.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:57:47 gibba015 bash[29377]: cephadm 2021-03-10T15:57:46.297637+0000 mgr.gibba045.orlgmj (mgr.34412) 6814 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:57:47.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:57:47 gibba015 bash[29377]: cephadm 2021-03-10T15:57:46.297674+0000 mgr.gibba045.orlgmj (mgr.34412) 6815 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:57:47.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:57:47 gibba015 bash[29377]: cephadm 2021-03-10T15:57:46.299029+0000 mgr.gibba045.orlgmj (mgr.34412) 6816 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:57:47.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:57:47 gibba015 bash[29377]: cephadm 2021-03-10T15:57:46.299066+0000 mgr.gibba045.orlgmj (mgr.34412) 6817 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:57:47.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:57:47 gibba015 bash[29377]: cephadm 2021-03-10T15:57:46.300323+0000 mgr.gibba045.orlgmj (mgr.34412) 6818 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:57:47.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:57:47 gibba015 bash[29377]: cephadm 2021-03-10T15:57:46.301964+0000 mgr.gibba045.orlgmj (mgr.34412) 6819 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:57:47.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:57:47 gibba015 bash[29377]: cephadm 2021-03-10T15:57:46.302001+0000 mgr.gibba045.orlgmj (mgr.34412) 6820 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:57:47.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:57:47 gibba015 bash[29377]: cephadm 2021-03-10T15:57:46.303415+0000 mgr.gibba045.orlgmj (mgr.34412) 6821 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:57:47.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:57:47 gibba015 bash[29377]: cephadm 2021-03-10T15:57:46.303735+0000 mgr.gibba045.orlgmj (mgr.34412) 6822 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:57:47.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:57:47 gibba015 bash[29377]: cephadm 2021-03-10T15:57:46.305077+0000 mgr.gibba045.orlgmj (mgr.34412) 6823 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:57:47.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:57:47 gibba015 bash[29377]: cephadm 2021-03-10T15:57:46.305115+0000 mgr.gibba045.orlgmj (mgr.34412) 6824 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:57:47.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:57:47 gibba015 bash[29377]: cephadm 2021-03-10T15:57:46.305223+0000 mgr.gibba045.orlgmj (mgr.34412) 6825 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:57:47.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:57:47 gibba015 bash[29377]: cluster 2021-03-10T15:57:46.577852+0000 mgr.gibba045.orlgmj (mgr.34412) 6826 : cluster [DBG] pgmap v3879: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:47.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:57:47 gibba015 bash[30343]: cephadm 2021-03-10T15:57:46.075177+0000 mgr.gibba045.orlgmj (mgr.34412) 6810 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:57:47.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:57:47 gibba015 bash[30343]: cephadm 2021-03-10T15:57:46.076941+0000 mgr.gibba045.orlgmj (mgr.34412) 6811 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:57:47.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:57:47 gibba015 bash[30343]: cephadm 2021-03-10T15:57:46.293760+0000 mgr.gibba045.orlgmj (mgr.34412) 6812 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:57:47.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:57:47 gibba015 bash[30343]: cephadm 2021-03-10T15:57:46.295903+0000 mgr.gibba045.orlgmj (mgr.34412) 6813 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:57:47.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:57:47 gibba015 bash[30343]: cephadm 2021-03-10T15:57:46.297637+0000 mgr.gibba045.orlgmj (mgr.34412) 6814 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:57:47.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:57:47 gibba015 bash[30343]: cephadm 2021-03-10T15:57:46.297674+0000 mgr.gibba045.orlgmj (mgr.34412) 6815 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:57:47.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:57:47 gibba015 bash[30343]: cephadm 2021-03-10T15:57:46.299029+0000 mgr.gibba045.orlgmj (mgr.34412) 6816 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:57:47.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:57:47 gibba015 bash[30343]: cephadm 2021-03-10T15:57:46.299066+0000 mgr.gibba045.orlgmj (mgr.34412) 6817 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:57:47.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:57:47 gibba015 bash[30343]: cephadm 2021-03-10T15:57:46.300323+0000 mgr.gibba045.orlgmj (mgr.34412) 6818 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:57:47.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:57:47 gibba015 bash[30343]: cephadm 2021-03-10T15:57:46.301964+0000 mgr.gibba045.orlgmj (mgr.34412) 6819 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:57:47.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:57:47 gibba015 bash[30343]: cephadm 2021-03-10T15:57:46.302001+0000 mgr.gibba045.orlgmj (mgr.34412) 6820 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:57:47.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:57:47 gibba015 bash[30343]: cephadm 2021-03-10T15:57:46.303415+0000 mgr.gibba045.orlgmj (mgr.34412) 6821 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:57:47.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:57:47 gibba015 bash[30343]: cephadm 2021-03-10T15:57:46.303735+0000 mgr.gibba045.orlgmj (mgr.34412) 6822 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:57:47.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:57:47 gibba015 bash[30343]: cephadm 2021-03-10T15:57:46.305077+0000 mgr.gibba045.orlgmj (mgr.34412) 6823 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:57:47.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:57:47 gibba015 bash[30343]: cephadm 2021-03-10T15:57:46.305115+0000 mgr.gibba045.orlgmj (mgr.34412) 6824 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:57:47.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:57:47 gibba015 bash[30343]: cephadm 2021-03-10T15:57:46.305223+0000 mgr.gibba045.orlgmj (mgr.34412) 6825 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:57:47.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:57:47 gibba015 bash[30343]: cluster 2021-03-10T15:57:46.577852+0000 mgr.gibba045.orlgmj (mgr.34412) 6826 : cluster [DBG] pgmap v3879: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:48.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:57:47 gibba045 bash[25517]: cephadm 2021-03-10T15:57:46.075177+0000 mgr.gibba045.orlgmj (mgr.34412) 6810 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:57:48.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:57:47 gibba045 bash[25517]: cephadm 2021-03-10T15:57:46.076941+0000 mgr.gibba045.orlgmj (mgr.34412) 6811 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:57:48.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:57:47 gibba045 bash[25517]: cephadm 2021-03-10T15:57:46.293760+0000 mgr.gibba045.orlgmj (mgr.34412) 6812 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:57:48.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:57:47 gibba045 bash[25517]: cephadm 2021-03-10T15:57:46.295903+0000 mgr.gibba045.orlgmj (mgr.34412) 6813 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:57:48.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:57:47 gibba045 bash[25517]: cephadm 2021-03-10T15:57:46.297637+0000 mgr.gibba045.orlgmj (mgr.34412) 6814 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:57:48.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:57:47 gibba045 bash[25517]: cephadm 2021-03-10T15:57:46.297674+0000 mgr.gibba045.orlgmj (mgr.34412) 6815 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:57:48.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:57:47 gibba045 bash[25517]: cephadm 2021-03-10T15:57:46.299029+0000 mgr.gibba045.orlgmj (mgr.34412) 6816 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:57:48.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:57:47 gibba045 bash[25517]: cephadm 2021-03-10T15:57:46.299066+0000 mgr.gibba045.orlgmj (mgr.34412) 6817 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:57:48.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:57:47 gibba045 bash[25517]: cephadm 2021-03-10T15:57:46.300323+0000 mgr.gibba045.orlgmj (mgr.34412) 6818 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:57:48.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:57:47 gibba045 bash[25517]: cephadm 2021-03-10T15:57:46.301964+0000 mgr.gibba045.orlgmj (mgr.34412) 6819 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:57:48.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:57:47 gibba045 bash[25517]: cephadm 2021-03-10T15:57:46.302001+0000 mgr.gibba045.orlgmj (mgr.34412) 6820 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:57:48.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:57:47 gibba045 bash[25517]: cephadm 2021-03-10T15:57:46.303415+0000 mgr.gibba045.orlgmj (mgr.34412) 6821 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:57:48.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:57:47 gibba045 bash[25517]: cephadm 2021-03-10T15:57:46.303735+0000 mgr.gibba045.orlgmj (mgr.34412) 6822 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:57:48.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:57:47 gibba045 bash[25517]: cephadm 2021-03-10T15:57:46.305077+0000 mgr.gibba045.orlgmj (mgr.34412) 6823 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:57:48.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:57:47 gibba045 bash[25517]: cephadm 2021-03-10T15:57:46.305115+0000 mgr.gibba045.orlgmj (mgr.34412) 6824 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:57:48.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:57:47 gibba045 bash[25517]: cephadm 2021-03-10T15:57:46.305223+0000 mgr.gibba045.orlgmj (mgr.34412) 6825 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:57:48.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:57:47 gibba045 bash[25517]: cluster 2021-03-10T15:57:46.577852+0000 mgr.gibba045.orlgmj (mgr.34412) 6826 : cluster [DBG] pgmap v3879: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:49.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:57:49 gibba015 bash[29377]: cluster 2021-03-10T15:57:48.579214+0000 mgr.gibba045.orlgmj (mgr.34412) 6827 : cluster [DBG] pgmap v3880: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:49.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:57:49 gibba015 bash[30343]: cluster 2021-03-10T15:57:48.579214+0000 mgr.gibba045.orlgmj (mgr.34412) 6827 : cluster [DBG] pgmap v3880: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:50.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:57:49 gibba045 bash[25517]: cluster 2021-03-10T15:57:48.579214+0000 mgr.gibba045.orlgmj (mgr.34412) 6827 : cluster [DBG] pgmap v3880: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:51.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:57:51 gibba015 bash[29377]: cluster 2021-03-10T15:57:50.580935+0000 mgr.gibba045.orlgmj (mgr.34412) 6828 : cluster [DBG] pgmap v3881: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:51.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:57:51 gibba015 bash[30343]: cluster 2021-03-10T15:57:50.580935+0000 mgr.gibba045.orlgmj (mgr.34412) 6828 : cluster [DBG] pgmap v3881: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:51.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:57:51 gibba045 bash[25517]: cluster 2021-03-10T15:57:50.580935+0000 mgr.gibba045.orlgmj (mgr.34412) 6828 : cluster [DBG] pgmap v3881: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:53.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:57:53 gibba015 bash[29377]: cluster 2021-03-10T15:57:52.581785+0000 mgr.gibba045.orlgmj (mgr.34412) 6829 : cluster [DBG] pgmap v3882: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:53.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:57:53 gibba015 bash[29377]: audit 2021-03-10T15:57:53.363184+0000 mon.c (mon.1) 1900 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:57:53.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:57:53 gibba015 bash[29377]: audit 2021-03-10T15:57:53.363832+0000 mon.c (mon.1) 1901 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:57:53.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:57:53 gibba015 bash[29377]: audit 2021-03-10T15:57:53.364268+0000 mon.a (mon.0) 1641 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:57:53.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:57:53 gibba015 bash[29377]: audit 2021-03-10T15:57:53.364813+0000 mon.c (mon.1) 1902 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T15:57:53.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:57:53 gibba015 bash[29377]: audit 2021-03-10T15:57:53.365314+0000 mon.a (mon.0) 1642 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:57:53.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:57:53 gibba015 bash[29377]: audit 2021-03-10T15:57:53.366015+0000 mon.a (mon.0) 1643 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T15:57:53.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:57:53 gibba015 bash[29377]: audit 2021-03-10T15:57:53.366415+0000 mon.c (mon.1) 1903 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:57:53.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:57:53 gibba015 bash[29377]: audit 2021-03-10T15:57:53.367531+0000 mon.c (mon.1) 1904 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:57:53.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:57:53 gibba015 bash[29377]: audit 2021-03-10T15:57:53.367586+0000 mon.a (mon.0) 1644 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:57:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:57:53 gibba015 bash[29377]: audit 2021-03-10T15:57:53.368753+0000 mon.a (mon.0) 1645 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:57:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:57:53 gibba015 bash[29377]: audit 2021-03-10T15:57:53.368758+0000 mon.c (mon.1) 1905 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T15:57:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:57:53 gibba015 bash[29377]: audit 2021-03-10T15:57:53.369076+0000 mon.a (mon.0) 1646 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T15:57:53.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:57:53 gibba015 bash[30343]: cluster 2021-03-10T15:57:52.581785+0000 mgr.gibba045.orlgmj (mgr.34412) 6829 : cluster [DBG] pgmap v3882: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:53.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:57:53 gibba015 bash[30343]: audit 2021-03-10T15:57:53.363184+0000 mon.c (mon.1) 1900 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:57:53.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:57:53 gibba015 bash[30343]: audit 2021-03-10T15:57:53.363832+0000 mon.c (mon.1) 1901 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:57:53.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:57:53 gibba015 bash[30343]: audit 2021-03-10T15:57:53.364268+0000 mon.a (mon.0) 1641 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:57:53.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:57:53 gibba015 bash[30343]: audit 2021-03-10T15:57:53.364813+0000 mon.c (mon.1) 1902 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T15:57:53.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:57:53 gibba015 bash[30343]: audit 2021-03-10T15:57:53.365314+0000 mon.a (mon.0) 1642 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:57:53.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:57:53 gibba015 bash[30343]: audit 2021-03-10T15:57:53.366015+0000 mon.a (mon.0) 1643 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T15:57:53.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:57:53 gibba015 bash[30343]: audit 2021-03-10T15:57:53.366415+0000 mon.c (mon.1) 1903 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:57:53.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:57:53 gibba015 bash[30343]: audit 2021-03-10T15:57:53.367531+0000 mon.c (mon.1) 1904 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:57:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:57:53 gibba015 bash[30343]: audit 2021-03-10T15:57:53.367586+0000 mon.a (mon.0) 1644 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:57:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:57:53 gibba015 bash[30343]: audit 2021-03-10T15:57:53.368753+0000 mon.a (mon.0) 1645 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:57:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:57:53 gibba015 bash[30343]: audit 2021-03-10T15:57:53.368758+0000 mon.c (mon.1) 1905 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T15:57:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:57:53 gibba015 bash[30343]: audit 2021-03-10T15:57:53.369076+0000 mon.a (mon.0) 1646 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T15:57:54.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:57:53 gibba045 bash[25517]: cluster 2021-03-10T15:57:52.581785+0000 mgr.gibba045.orlgmj (mgr.34412) 6829 : cluster [DBG] pgmap v3882: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:57:53 gibba045 bash[25517]: audit 2021-03-10T15:57:53.363184+0000 mon.c (mon.1) 1900 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:57:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:57:53 gibba045 bash[25517]: audit 2021-03-10T15:57:53.363832+0000 mon.c (mon.1) 1901 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:57:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:57:53 gibba045 bash[25517]: audit 2021-03-10T15:57:53.364268+0000 mon.a (mon.0) 1641 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:57:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:57:53 gibba045 bash[25517]: audit 2021-03-10T15:57:53.364813+0000 mon.c (mon.1) 1902 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T15:57:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:57:53 gibba045 bash[25517]: audit 2021-03-10T15:57:53.365314+0000 mon.a (mon.0) 1642 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:57:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:57:53 gibba045 bash[25517]: audit 2021-03-10T15:57:53.366015+0000 mon.a (mon.0) 1643 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T15:57:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:57:53 gibba045 bash[25517]: audit 2021-03-10T15:57:53.366415+0000 mon.c (mon.1) 1903 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:57:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:57:53 gibba045 bash[25517]: audit 2021-03-10T15:57:53.367531+0000 mon.c (mon.1) 1904 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:57:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:57:53 gibba045 bash[25517]: audit 2021-03-10T15:57:53.367586+0000 mon.a (mon.0) 1644 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:57:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:57:53 gibba045 bash[25517]: audit 2021-03-10T15:57:53.368753+0000 mon.a (mon.0) 1645 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:57:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:57:53 gibba045 bash[25517]: audit 2021-03-10T15:57:53.368758+0000 mon.c (mon.1) 1905 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T15:57:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:57:53 gibba045 bash[25517]: audit 2021-03-10T15:57:53.369076+0000 mon.a (mon.0) 1646 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T15:57:55.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:57:55 gibba015 bash[29377]: cluster 2021-03-10T15:57:54.583323+0000 mgr.gibba045.orlgmj (mgr.34412) 6830 : cluster [DBG] pgmap v3883: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:55.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:57:55 gibba015 bash[30343]: cluster 2021-03-10T15:57:54.583323+0000 mgr.gibba045.orlgmj (mgr.34412) 6830 : cluster [DBG] pgmap v3883: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:56.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:57:55 gibba045 bash[25517]: cluster 2021-03-10T15:57:54.583323+0000 mgr.gibba045.orlgmj (mgr.34412) 6830 : cluster [DBG] pgmap v3883: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:57.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:57:57 gibba015 bash[29377]: cluster 2021-03-10T15:57:56.585152+0000 mgr.gibba045.orlgmj (mgr.34412) 6831 : cluster [DBG] pgmap v3884: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:57.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:57:57 gibba015 bash[30343]: cluster 2021-03-10T15:57:56.585152+0000 mgr.gibba045.orlgmj (mgr.34412) 6831 : cluster [DBG] pgmap v3884: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:58.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:57:57 gibba045 bash[25517]: cluster 2021-03-10T15:57:56.585152+0000 mgr.gibba045.orlgmj (mgr.34412) 6831 : cluster [DBG] pgmap v3884: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:59.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:57:59 gibba015 bash[29377]: cluster 2021-03-10T15:57:58.586252+0000 mgr.gibba045.orlgmj (mgr.34412) 6832 : cluster [DBG] pgmap v3885: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:59.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:57:59 gibba015 bash[30343]: cluster 2021-03-10T15:57:58.586252+0000 mgr.gibba045.orlgmj (mgr.34412) 6832 : cluster [DBG] pgmap v3885: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:00.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:57:59 gibba045 bash[25517]: cluster 2021-03-10T15:57:58.586252+0000 mgr.gibba045.orlgmj (mgr.34412) 6832 : cluster [DBG] pgmap v3885: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:01.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:58:01 gibba015 bash[29377]: cluster 2021-03-10T15:58:00.587795+0000 mgr.gibba045.orlgmj (mgr.34412) 6833 : cluster [DBG] pgmap v3886: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:01.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:58:01 gibba015 bash[30343]: cluster 2021-03-10T15:58:00.587795+0000 mgr.gibba045.orlgmj (mgr.34412) 6833 : cluster [DBG] pgmap v3886: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:01.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:58:01 gibba045 bash[25517]: cluster 2021-03-10T15:58:00.587795+0000 mgr.gibba045.orlgmj (mgr.34412) 6833 : cluster [DBG] pgmap v3886: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:02.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:58:02 gibba015 bash[29377]: cephadm 2021-03-10T15:58:01.312770+0000 mgr.gibba045.orlgmj (mgr.34412) 6834 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:58:02.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:58:02 gibba015 bash[30343]: cephadm 2021-03-10T15:58:01.312770+0000 mgr.gibba045.orlgmj (mgr.34412) 6834 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:58:02.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:58:02 gibba045 bash[25517]: cephadm 2021-03-10T15:58:01.312770+0000 mgr.gibba045.orlgmj (mgr.34412) 6834 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:58:03.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:58:03 gibba015 bash[29377]: cluster 2021-03-10T15:58:02.588661+0000 mgr.gibba045.orlgmj (mgr.34412) 6835 : cluster [DBG] pgmap v3887: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:03.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:58:03 gibba015 bash[30343]: cluster 2021-03-10T15:58:02.588661+0000 mgr.gibba045.orlgmj (mgr.34412) 6835 : cluster [DBG] pgmap v3887: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:03.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:58:03 gibba045 bash[25517]: cluster 2021-03-10T15:58:02.588661+0000 mgr.gibba045.orlgmj (mgr.34412) 6835 : cluster [DBG] pgmap v3887: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:05.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:58:05 gibba015 bash[29377]: cluster 2021-03-10T15:58:04.590151+0000 mgr.gibba045.orlgmj (mgr.34412) 6836 : cluster [DBG] pgmap v3888: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:05.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:58:05 gibba015 bash[30343]: cluster 2021-03-10T15:58:04.590151+0000 mgr.gibba045.orlgmj (mgr.34412) 6836 : cluster [DBG] pgmap v3888: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:06.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:58:05 gibba045 bash[25517]: cluster 2021-03-10T15:58:04.590151+0000 mgr.gibba045.orlgmj (mgr.34412) 6836 : cluster [DBG] pgmap v3888: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:07.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:58:07 gibba015 bash[29377]: cluster 2021-03-10T15:58:06.591822+0000 mgr.gibba045.orlgmj (mgr.34412) 6837 : cluster [DBG] pgmap v3889: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:07.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:58:07 gibba015 bash[30343]: cluster 2021-03-10T15:58:06.591822+0000 mgr.gibba045.orlgmj (mgr.34412) 6837 : cluster [DBG] pgmap v3889: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:08.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:58:07 gibba045 bash[25517]: cluster 2021-03-10T15:58:06.591822+0000 mgr.gibba045.orlgmj (mgr.34412) 6837 : cluster [DBG] pgmap v3889: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:09.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:58:09 gibba015 bash[29377]: cluster 2021-03-10T15:58:08.593226+0000 mgr.gibba045.orlgmj (mgr.34412) 6838 : cluster [DBG] pgmap v3890: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:09.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:58:09 gibba015 bash[30343]: cluster 2021-03-10T15:58:08.593226+0000 mgr.gibba045.orlgmj (mgr.34412) 6838 : cluster [DBG] pgmap v3890: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:10.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:58:09 gibba045 bash[25517]: cluster 2021-03-10T15:58:08.593226+0000 mgr.gibba045.orlgmj (mgr.34412) 6838 : cluster [DBG] pgmap v3890: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:11.316 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:58:11.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:58:11 gibba015 bash[29377]: cluster 2021-03-10T15:58:10.594901+0000 mgr.gibba045.orlgmj (mgr.34412) 6839 : cluster [DBG] pgmap v3891: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:11.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:58:11 gibba015 bash[30343]: cluster 2021-03-10T15:58:10.594901+0000 mgr.gibba045.orlgmj (mgr.34412) 6839 : cluster [DBG] pgmap v3891: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:11.543 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:58:11.543 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 2m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:58:11.543 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 85s ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:58:11.544 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 85s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:58:11.544 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 85s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:58:11.544 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:58:11.544 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:58:11.545 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 85s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:58:11.545 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:58:11.545 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 2m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:58:11.545 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 85s ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:58:11.545 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:58:11.546 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:58:11.546 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:58:11.546 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:58:11.546 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 85s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:58:11.546 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 85s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:58:11.547 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 85s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:58:11.547 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 85s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:58:11.547 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 85s ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:58:11.548 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 85s ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T15:58:11.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:58:11 gibba045 bash[25517]: cluster 2021-03-10T15:58:10.594901+0000 mgr.gibba045.orlgmj (mgr.34412) 6839 : cluster [DBG] pgmap v3891: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:11.792 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:58:11.793 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:58:11.793 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:58:11.793 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:58:11.793 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:58:11.794 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:58:11.794 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:58:11.794 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:58:11.794 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:58:11.795 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:58:11.795 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:58:11.795 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:58:11.795 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:58:11.796 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:58:11.796 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:58:12.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:58:12 gibba015 bash[29377]: audit 2021-03-10T15:58:11.308402+0000 mgr.gibba045.orlgmj (mgr.34412) 6840 : audit [DBG] from='client.48642 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:58:12.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:58:12 gibba015 bash[29377]: audit 2021-03-10T15:58:11.531874+0000 mgr.gibba045.orlgmj (mgr.34412) 6841 : audit [DBG] from='client.48648 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:58:12.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:58:12 gibba015 bash[29377]: audit 2021-03-10T15:58:11.791353+0000 mon.a (mon.0) 1647 : audit [DBG] from='client.? 172.21.2.115:0/817616711' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:58:12.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:58:12 gibba015 bash[30343]: audit 2021-03-10T15:58:11.308402+0000 mgr.gibba045.orlgmj (mgr.34412) 6840 : audit [DBG] from='client.48642 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:58:12.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:58:12 gibba015 bash[30343]: audit 2021-03-10T15:58:11.531874+0000 mgr.gibba045.orlgmj (mgr.34412) 6841 : audit [DBG] from='client.48648 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:58:12.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:58:12 gibba015 bash[30343]: audit 2021-03-10T15:58:11.791353+0000 mon.a (mon.0) 1647 : audit [DBG] from='client.? 172.21.2.115:0/817616711' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:58:12.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:58:12 gibba045 bash[25517]: audit 2021-03-10T15:58:11.308402+0000 mgr.gibba045.orlgmj (mgr.34412) 6840 : audit [DBG] from='client.48642 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:58:12.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:58:12 gibba045 bash[25517]: audit 2021-03-10T15:58:11.531874+0000 mgr.gibba045.orlgmj (mgr.34412) 6841 : audit [DBG] from='client.48648 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:58:12.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:58:12 gibba045 bash[25517]: audit 2021-03-10T15:58:11.791353+0000 mon.a (mon.0) 1647 : audit [DBG] from='client.? 172.21.2.115:0/817616711' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:58:13.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:58:13 gibba015 bash[29377]: cluster 2021-03-10T15:58:12.596658+0000 mgr.gibba045.orlgmj (mgr.34412) 6842 : cluster [DBG] pgmap v3892: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:13.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:58:13 gibba015 bash[30343]: cluster 2021-03-10T15:58:12.596658+0000 mgr.gibba045.orlgmj (mgr.34412) 6842 : cluster [DBG] pgmap v3892: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:13.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:58:13 gibba045 bash[25517]: cluster 2021-03-10T15:58:12.596658+0000 mgr.gibba045.orlgmj (mgr.34412) 6842 : cluster [DBG] pgmap v3892: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:15.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:58:15 gibba015 bash[29377]: cluster 2021-03-10T15:58:14.598004+0000 mgr.gibba045.orlgmj (mgr.34412) 6843 : cluster [DBG] pgmap v3893: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:15.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:58:15 gibba015 bash[30343]: cluster 2021-03-10T15:58:14.598004+0000 mgr.gibba045.orlgmj (mgr.34412) 6843 : cluster [DBG] pgmap v3893: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:16.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:58:15 gibba045 bash[25517]: cluster 2021-03-10T15:58:14.598004+0000 mgr.gibba045.orlgmj (mgr.34412) 6843 : cluster [DBG] pgmap v3893: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:17.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:58:17 gibba015 bash[29377]: cephadm 2021-03-10T15:58:16.325148+0000 mgr.gibba045.orlgmj (mgr.34412) 6844 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:58:17.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:58:17 gibba015 bash[29377]: cluster 2021-03-10T15:58:16.599629+0000 mgr.gibba045.orlgmj (mgr.34412) 6845 : cluster [DBG] pgmap v3894: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:17.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:58:17 gibba015 bash[30343]: cephadm 2021-03-10T15:58:16.325148+0000 mgr.gibba045.orlgmj (mgr.34412) 6844 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:58:17.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:58:17 gibba015 bash[30343]: cluster 2021-03-10T15:58:16.599629+0000 mgr.gibba045.orlgmj (mgr.34412) 6845 : cluster [DBG] pgmap v3894: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:18.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:58:17 gibba045 bash[25517]: cephadm 2021-03-10T15:58:16.325148+0000 mgr.gibba045.orlgmj (mgr.34412) 6844 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:58:18.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:58:17 gibba045 bash[25517]: cluster 2021-03-10T15:58:16.599629+0000 mgr.gibba045.orlgmj (mgr.34412) 6845 : cluster [DBG] pgmap v3894: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:19.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:58:19 gibba015 bash[29377]: cluster 2021-03-10T15:58:18.601057+0000 mgr.gibba045.orlgmj (mgr.34412) 6846 : cluster [DBG] pgmap v3895: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:19.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:58:19 gibba015 bash[30343]: cluster 2021-03-10T15:58:18.601057+0000 mgr.gibba045.orlgmj (mgr.34412) 6846 : cluster [DBG] pgmap v3895: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:20.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:58:19 gibba045 bash[25517]: cluster 2021-03-10T15:58:18.601057+0000 mgr.gibba045.orlgmj (mgr.34412) 6846 : cluster [DBG] pgmap v3895: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:21.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:58:21 gibba015 bash[29377]: cluster 2021-03-10T15:58:20.602745+0000 mgr.gibba045.orlgmj (mgr.34412) 6847 : cluster [DBG] pgmap v3896: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:21.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:58:21 gibba015 bash[30343]: cluster 2021-03-10T15:58:20.602745+0000 mgr.gibba045.orlgmj (mgr.34412) 6847 : cluster [DBG] pgmap v3896: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:21.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:58:21 gibba045 bash[25517]: cluster 2021-03-10T15:58:20.602745+0000 mgr.gibba045.orlgmj (mgr.34412) 6847 : cluster [DBG] pgmap v3896: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:23.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:58:23 gibba015 bash[29377]: cluster 2021-03-10T15:58:22.603626+0000 mgr.gibba045.orlgmj (mgr.34412) 6848 : cluster [DBG] pgmap v3897: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:23.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:58:23 gibba015 bash[30343]: cluster 2021-03-10T15:58:22.603626+0000 mgr.gibba045.orlgmj (mgr.34412) 6848 : cluster [DBG] pgmap v3897: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:24.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:58:23 gibba045 bash[25517]: cluster 2021-03-10T15:58:22.603626+0000 mgr.gibba045.orlgmj (mgr.34412) 6848 : cluster [DBG] pgmap v3897: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:25.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:58:25 gibba015 bash[29377]: cluster 2021-03-10T15:58:24.604867+0000 mgr.gibba045.orlgmj (mgr.34412) 6849 : cluster [DBG] pgmap v3898: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:25.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:58:25 gibba015 bash[30343]: cluster 2021-03-10T15:58:24.604867+0000 mgr.gibba045.orlgmj (mgr.34412) 6849 : cluster [DBG] pgmap v3898: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:26.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:58:25 gibba045 bash[25517]: cluster 2021-03-10T15:58:24.604867+0000 mgr.gibba045.orlgmj (mgr.34412) 6849 : cluster [DBG] pgmap v3898: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:27.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:58:27 gibba015 bash[29377]: cluster 2021-03-10T15:58:26.606697+0000 mgr.gibba045.orlgmj (mgr.34412) 6850 : cluster [DBG] pgmap v3899: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:27.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:58:27 gibba015 bash[30343]: cluster 2021-03-10T15:58:26.606697+0000 mgr.gibba045.orlgmj (mgr.34412) 6850 : cluster [DBG] pgmap v3899: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:28.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:58:27 gibba045 bash[25517]: cluster 2021-03-10T15:58:26.606697+0000 mgr.gibba045.orlgmj (mgr.34412) 6850 : cluster [DBG] pgmap v3899: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:29.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:58:29 gibba015 bash[29377]: cluster 2021-03-10T15:58:28.608010+0000 mgr.gibba045.orlgmj (mgr.34412) 6851 : cluster [DBG] pgmap v3900: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:29.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:58:29 gibba015 bash[30343]: cluster 2021-03-10T15:58:28.608010+0000 mgr.gibba045.orlgmj (mgr.34412) 6851 : cluster [DBG] pgmap v3900: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:30.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:58:29 gibba045 bash[25517]: cluster 2021-03-10T15:58:28.608010+0000 mgr.gibba045.orlgmj (mgr.34412) 6851 : cluster [DBG] pgmap v3900: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:31.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:58:31 gibba015 bash[29377]: cluster 2021-03-10T15:58:30.609653+0000 mgr.gibba045.orlgmj (mgr.34412) 6852 : cluster [DBG] pgmap v3901: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:31.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:58:31 gibba015 bash[30343]: cluster 2021-03-10T15:58:30.609653+0000 mgr.gibba045.orlgmj (mgr.34412) 6852 : cluster [DBG] pgmap v3901: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:31.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:58:31 gibba045 bash[25517]: cluster 2021-03-10T15:58:30.609653+0000 mgr.gibba045.orlgmj (mgr.34412) 6852 : cluster [DBG] pgmap v3901: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:32.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:58:32 gibba015 bash[29377]: cephadm 2021-03-10T15:58:31.337725+0000 mgr.gibba045.orlgmj (mgr.34412) 6853 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:58:32.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:58:32 gibba015 bash[30343]: cephadm 2021-03-10T15:58:31.337725+0000 mgr.gibba045.orlgmj (mgr.34412) 6853 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:58:32.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:58:32 gibba045 bash[25517]: cephadm 2021-03-10T15:58:31.337725+0000 mgr.gibba045.orlgmj (mgr.34412) 6853 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:58:33.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:58:33 gibba015 bash[29377]: cluster 2021-03-10T15:58:32.610562+0000 mgr.gibba045.orlgmj (mgr.34412) 6854 : cluster [DBG] pgmap v3902: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:33.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:58:33 gibba015 bash[30343]: cluster 2021-03-10T15:58:32.610562+0000 mgr.gibba045.orlgmj (mgr.34412) 6854 : cluster [DBG] pgmap v3902: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:33.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:58:33 gibba045 bash[25517]: cluster 2021-03-10T15:58:32.610562+0000 mgr.gibba045.orlgmj (mgr.34412) 6854 : cluster [DBG] pgmap v3902: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:35.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:58:35 gibba015 bash[29377]: cluster 2021-03-10T15:58:34.611939+0000 mgr.gibba045.orlgmj (mgr.34412) 6855 : cluster [DBG] pgmap v3903: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:35.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:58:35 gibba015 bash[30343]: cluster 2021-03-10T15:58:34.611939+0000 mgr.gibba045.orlgmj (mgr.34412) 6855 : cluster [DBG] pgmap v3903: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:36.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:58:35 gibba045 bash[25517]: cluster 2021-03-10T15:58:34.611939+0000 mgr.gibba045.orlgmj (mgr.34412) 6855 : cluster [DBG] pgmap v3903: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:37.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:58:37 gibba015 bash[29377]: cluster 2021-03-10T15:58:36.613862+0000 mgr.gibba045.orlgmj (mgr.34412) 6856 : cluster [DBG] pgmap v3904: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:37.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:58:37 gibba015 bash[30343]: cluster 2021-03-10T15:58:36.613862+0000 mgr.gibba045.orlgmj (mgr.34412) 6856 : cluster [DBG] pgmap v3904: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:38.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:58:37 gibba045 bash[25517]: cluster 2021-03-10T15:58:36.613862+0000 mgr.gibba045.orlgmj (mgr.34412) 6856 : cluster [DBG] pgmap v3904: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:39.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:58:39 gibba015 bash[29377]: cluster 2021-03-10T15:58:38.614918+0000 mgr.gibba045.orlgmj (mgr.34412) 6857 : cluster [DBG] pgmap v3905: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:39.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:58:39 gibba015 bash[30343]: cluster 2021-03-10T15:58:38.614918+0000 mgr.gibba045.orlgmj (mgr.34412) 6857 : cluster [DBG] pgmap v3905: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:40.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:58:39 gibba045 bash[25517]: cluster 2021-03-10T15:58:38.614918+0000 mgr.gibba045.orlgmj (mgr.34412) 6857 : cluster [DBG] pgmap v3905: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:41.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:58:41 gibba015 bash[29377]: cluster 2021-03-10T15:58:40.616521+0000 mgr.gibba045.orlgmj (mgr.34412) 6858 : cluster [DBG] pgmap v3906: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:41.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:58:41 gibba015 bash[30343]: cluster 2021-03-10T15:58:40.616521+0000 mgr.gibba045.orlgmj (mgr.34412) 6858 : cluster [DBG] pgmap v3906: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:41.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:58:41 gibba045 bash[25517]: cluster 2021-03-10T15:58:40.616521+0000 mgr.gibba045.orlgmj (mgr.34412) 6858 : cluster [DBG] pgmap v3906: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:42.036 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:58:42.262 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:58:42.262 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 3m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:58:42.263 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 116s ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:58:42.263 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 116s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:58:42.263 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 116s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:58:42.263 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:58:42.264 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:58:42.264 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 116s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:58:42.264 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:58:42.264 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 3m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:58:42.265 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 116s ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:58:42.265 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:58:42.265 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:58:42.265 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:58:42.266 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:58:42.266 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 116s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:58:42.266 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 116s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:58:42.266 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 116s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:58:42.267 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 116s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:58:42.267 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 116s ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:58:42.267 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 116s ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T15:58:42.514 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:58:42.515 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:58:42.515 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:58:42.515 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:58:42.515 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:58:42.516 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:58:42.516 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:58:42.516 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:58:42.516 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:58:42.516 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:58:42.517 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:58:42.517 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:58:42.517 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:58:42.517 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:58:42.518 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:58:42.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:58:42 gibba015 bash[29377]: audit 2021-03-10T15:58:42.513103+0000 mon.a (mon.0) 1648 : audit [DBG] from='client.? 172.21.2.115:0/29050140' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:58:42.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:58:42 gibba015 bash[30343]: audit 2021-03-10T15:58:42.513103+0000 mon.a (mon.0) 1648 : audit [DBG] from='client.? 172.21.2.115:0/29050140' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:58:43.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:58:42 gibba045 bash[25517]: audit 2021-03-10T15:58:42.513103+0000 mon.a (mon.0) 1648 : audit [DBG] from='client.? 172.21.2.115:0/29050140' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:58:43.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:58:43 gibba015 bash[29377]: audit 2021-03-10T15:58:42.028288+0000 mgr.gibba045.orlgmj (mgr.34412) 6859 : audit [DBG] from='client.48660 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:58:43.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:58:43 gibba015 bash[29377]: audit 2021-03-10T15:58:42.251308+0000 mgr.gibba045.orlgmj (mgr.34412) 6860 : audit [DBG] from='client.48666 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:58:43.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:58:43 gibba015 bash[29377]: cluster 2021-03-10T15:58:42.617486+0000 mgr.gibba045.orlgmj (mgr.34412) 6861 : cluster [DBG] pgmap v3907: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:43.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:58:43 gibba015 bash[30343]: audit 2021-03-10T15:58:42.028288+0000 mgr.gibba045.orlgmj (mgr.34412) 6859 : audit [DBG] from='client.48660 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:58:43.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:58:43 gibba015 bash[30343]: audit 2021-03-10T15:58:42.251308+0000 mgr.gibba045.orlgmj (mgr.34412) 6860 : audit [DBG] from='client.48666 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:58:43.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:58:43 gibba015 bash[30343]: cluster 2021-03-10T15:58:42.617486+0000 mgr.gibba045.orlgmj (mgr.34412) 6861 : cluster [DBG] pgmap v3907: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:44.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:58:43 gibba045 bash[25517]: audit 2021-03-10T15:58:42.028288+0000 mgr.gibba045.orlgmj (mgr.34412) 6859 : audit [DBG] from='client.48660 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:58:44.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:58:43 gibba045 bash[25517]: audit 2021-03-10T15:58:42.251308+0000 mgr.gibba045.orlgmj (mgr.34412) 6860 : audit [DBG] from='client.48666 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:58:44.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:58:43 gibba045 bash[25517]: cluster 2021-03-10T15:58:42.617486+0000 mgr.gibba045.orlgmj (mgr.34412) 6861 : cluster [DBG] pgmap v3907: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:45.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:58:45 gibba015 bash[29377]: cluster 2021-03-10T15:58:44.618728+0000 mgr.gibba045.orlgmj (mgr.34412) 6862 : cluster [DBG] pgmap v3908: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:45.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:58:45 gibba015 bash[30343]: cluster 2021-03-10T15:58:44.618728+0000 mgr.gibba045.orlgmj (mgr.34412) 6862 : cluster [DBG] pgmap v3908: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:46.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:58:45 gibba045 bash[25517]: cluster 2021-03-10T15:58:44.618728+0000 mgr.gibba045.orlgmj (mgr.34412) 6862 : cluster [DBG] pgmap v3908: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:46.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:58:46 gibba015 bash[29377]: audit 2021-03-10T15:58:46.351883+0000 mon.c (mon.1) 1906 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:58:46.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:58:46 gibba015 bash[29377]: audit 2021-03-10T15:58:46.579768+0000 mon.a (mon.0) 1649 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:58:46.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:58:46 gibba015 bash[29377]: audit 2021-03-10T15:58:46.583714+0000 mon.c (mon.1) 1907 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:58:46.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:58:46 gibba015 bash[29377]: audit 2021-03-10T15:58:46.585411+0000 mon.c (mon.1) 1908 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:58:46.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:58:46 gibba015 bash[29377]: audit 2021-03-10T15:58:46.587234+0000 mon.c (mon.1) 1909 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:58:46.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:58:46 gibba015 bash[29377]: audit 2021-03-10T15:58:46.588518+0000 mon.c (mon.1) 1910 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:58:46.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:58:46 gibba015 bash[29377]: audit 2021-03-10T15:58:46.592249+0000 mon.c (mon.1) 1911 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:58:46.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:58:46 gibba015 bash[29377]: audit 2021-03-10T15:58:46.594015+0000 mon.c (mon.1) 1912 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:58:46.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:58:46 gibba015 bash[30343]: audit 2021-03-10T15:58:46.351883+0000 mon.c (mon.1) 1906 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:58:46.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:58:46 gibba015 bash[30343]: audit 2021-03-10T15:58:46.579768+0000 mon.a (mon.0) 1649 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:58:46.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:58:46 gibba015 bash[30343]: audit 2021-03-10T15:58:46.583714+0000 mon.c (mon.1) 1907 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:58:46.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:58:46 gibba015 bash[30343]: audit 2021-03-10T15:58:46.585411+0000 mon.c (mon.1) 1908 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:58:46.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:58:46 gibba015 bash[30343]: audit 2021-03-10T15:58:46.587234+0000 mon.c (mon.1) 1909 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:58:46.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:58:46 gibba015 bash[30343]: audit 2021-03-10T15:58:46.588518+0000 mon.c (mon.1) 1910 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:58:46.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:58:46 gibba015 bash[30343]: audit 2021-03-10T15:58:46.592249+0000 mon.c (mon.1) 1911 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:58:46.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:58:46 gibba015 bash[30343]: audit 2021-03-10T15:58:46.594015+0000 mon.c (mon.1) 1912 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:58:47.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:58:46 gibba045 bash[25517]: audit 2021-03-10T15:58:46.351883+0000 mon.c (mon.1) 1906 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:58:47.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:58:46 gibba045 bash[25517]: audit 2021-03-10T15:58:46.579768+0000 mon.a (mon.0) 1649 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:58:47.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:58:46 gibba045 bash[25517]: audit 2021-03-10T15:58:46.583714+0000 mon.c (mon.1) 1907 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:58:47.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:58:46 gibba045 bash[25517]: audit 2021-03-10T15:58:46.585411+0000 mon.c (mon.1) 1908 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:58:47.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:58:46 gibba045 bash[25517]: audit 2021-03-10T15:58:46.587234+0000 mon.c (mon.1) 1909 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:58:47.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:58:46 gibba045 bash[25517]: audit 2021-03-10T15:58:46.588518+0000 mon.c (mon.1) 1910 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:58:47.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:58:46 gibba045 bash[25517]: audit 2021-03-10T15:58:46.592249+0000 mon.c (mon.1) 1911 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:58:47.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:58:46 gibba045 bash[25517]: audit 2021-03-10T15:58:46.594015+0000 mon.c (mon.1) 1912 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:58:47.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:58:47 gibba015 bash[29377]: cephadm 2021-03-10T15:58:46.359609+0000 mgr.gibba045.orlgmj (mgr.34412) 6863 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:58:47.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:58:47 gibba015 bash[29377]: cephadm 2021-03-10T15:58:46.361260+0000 mgr.gibba045.orlgmj (mgr.34412) 6864 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:58:47.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:58:47 gibba015 bash[29377]: cephadm 2021-03-10T15:58:46.585515+0000 mgr.gibba045.orlgmj (mgr.34412) 6865 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:58:47.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:58:47 gibba015 bash[29377]: cephadm 2021-03-10T15:58:46.587528+0000 mgr.gibba045.orlgmj (mgr.34412) 6866 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:58:47.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:58:47 gibba015 bash[29377]: cephadm 2021-03-10T15:58:46.589195+0000 mgr.gibba045.orlgmj (mgr.34412) 6867 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:58:47.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:58:47 gibba015 bash[29377]: cephadm 2021-03-10T15:58:46.589241+0000 mgr.gibba045.orlgmj (mgr.34412) 6868 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:58:47.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:58:47 gibba015 bash[29377]: cephadm 2021-03-10T15:58:46.590553+0000 mgr.gibba045.orlgmj (mgr.34412) 6869 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:58:47.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:58:47 gibba015 bash[29377]: cephadm 2021-03-10T15:58:46.590597+0000 mgr.gibba045.orlgmj (mgr.34412) 6870 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:58:47.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:58:47 gibba015 bash[29377]: cephadm 2021-03-10T15:58:46.591999+0000 mgr.gibba045.orlgmj (mgr.34412) 6871 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:58:47.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:58:47 gibba015 bash[29377]: cephadm 2021-03-10T15:58:46.594096+0000 mgr.gibba045.orlgmj (mgr.34412) 6872 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:58:47.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:58:47 gibba015 bash[29377]: cephadm 2021-03-10T15:58:46.594146+0000 mgr.gibba045.orlgmj (mgr.34412) 6873 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:58:47.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:58:47 gibba015 bash[29377]: cephadm 2021-03-10T15:58:46.595725+0000 mgr.gibba045.orlgmj (mgr.34412) 6874 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:58:47.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:58:47 gibba015 bash[29377]: cephadm 2021-03-10T15:58:46.596130+0000 mgr.gibba045.orlgmj (mgr.34412) 6875 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:58:47.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:58:47 gibba015 bash[29377]: cephadm 2021-03-10T15:58:46.597684+0000 mgr.gibba045.orlgmj (mgr.34412) 6876 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:58:47.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:58:47 gibba015 bash[29377]: cephadm 2021-03-10T15:58:46.597732+0000 mgr.gibba045.orlgmj (mgr.34412) 6877 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:58:47.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:58:47 gibba015 bash[29377]: cephadm 2021-03-10T15:58:46.597856+0000 mgr.gibba045.orlgmj (mgr.34412) 6878 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:58:47.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:58:47 gibba015 bash[29377]: cluster 2021-03-10T15:58:46.619588+0000 mgr.gibba045.orlgmj (mgr.34412) 6879 : cluster [DBG] pgmap v3909: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:47.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:58:47 gibba015 bash[30343]: cephadm 2021-03-10T15:58:46.359609+0000 mgr.gibba045.orlgmj (mgr.34412) 6863 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:58:47.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:58:47 gibba015 bash[30343]: cephadm 2021-03-10T15:58:46.361260+0000 mgr.gibba045.orlgmj (mgr.34412) 6864 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:58:47.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:58:47 gibba015 bash[30343]: cephadm 2021-03-10T15:58:46.585515+0000 mgr.gibba045.orlgmj (mgr.34412) 6865 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:58:47.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:58:47 gibba015 bash[30343]: cephadm 2021-03-10T15:58:46.587528+0000 mgr.gibba045.orlgmj (mgr.34412) 6866 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:58:47.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:58:47 gibba015 bash[30343]: cephadm 2021-03-10T15:58:46.589195+0000 mgr.gibba045.orlgmj (mgr.34412) 6867 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:58:47.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:58:47 gibba015 bash[30343]: cephadm 2021-03-10T15:58:46.589241+0000 mgr.gibba045.orlgmj (mgr.34412) 6868 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:58:47.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:58:47 gibba015 bash[30343]: cephadm 2021-03-10T15:58:46.590553+0000 mgr.gibba045.orlgmj (mgr.34412) 6869 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:58:47.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:58:47 gibba015 bash[30343]: cephadm 2021-03-10T15:58:46.590597+0000 mgr.gibba045.orlgmj (mgr.34412) 6870 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:58:47.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:58:47 gibba015 bash[30343]: cephadm 2021-03-10T15:58:46.591999+0000 mgr.gibba045.orlgmj (mgr.34412) 6871 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:58:47.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:58:47 gibba015 bash[30343]: cephadm 2021-03-10T15:58:46.594096+0000 mgr.gibba045.orlgmj (mgr.34412) 6872 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:58:47.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:58:47 gibba015 bash[30343]: cephadm 2021-03-10T15:58:46.594146+0000 mgr.gibba045.orlgmj (mgr.34412) 6873 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:58:47.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:58:47 gibba015 bash[30343]: cephadm 2021-03-10T15:58:46.595725+0000 mgr.gibba045.orlgmj (mgr.34412) 6874 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:58:47.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:58:47 gibba015 bash[30343]: cephadm 2021-03-10T15:58:46.596130+0000 mgr.gibba045.orlgmj (mgr.34412) 6875 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:58:47.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:58:47 gibba015 bash[30343]: cephadm 2021-03-10T15:58:46.597684+0000 mgr.gibba045.orlgmj (mgr.34412) 6876 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:58:47.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:58:47 gibba015 bash[30343]: cephadm 2021-03-10T15:58:46.597732+0000 mgr.gibba045.orlgmj (mgr.34412) 6877 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:58:47.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:58:47 gibba015 bash[30343]: cephadm 2021-03-10T15:58:46.597856+0000 mgr.gibba045.orlgmj (mgr.34412) 6878 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:58:47.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:58:47 gibba015 bash[30343]: cluster 2021-03-10T15:58:46.619588+0000 mgr.gibba045.orlgmj (mgr.34412) 6879 : cluster [DBG] pgmap v3909: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:48.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:58:47 gibba045 bash[25517]: cephadm 2021-03-10T15:58:46.359609+0000 mgr.gibba045.orlgmj (mgr.34412) 6863 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:58:48.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:58:47 gibba045 bash[25517]: cephadm 2021-03-10T15:58:46.361260+0000 mgr.gibba045.orlgmj (mgr.34412) 6864 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:58:48.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:58:47 gibba045 bash[25517]: cephadm 2021-03-10T15:58:46.585515+0000 mgr.gibba045.orlgmj (mgr.34412) 6865 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:58:48.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:58:47 gibba045 bash[25517]: cephadm 2021-03-10T15:58:46.587528+0000 mgr.gibba045.orlgmj (mgr.34412) 6866 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:58:48.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:58:47 gibba045 bash[25517]: cephadm 2021-03-10T15:58:46.589195+0000 mgr.gibba045.orlgmj (mgr.34412) 6867 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:58:48.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:58:47 gibba045 bash[25517]: cephadm 2021-03-10T15:58:46.589241+0000 mgr.gibba045.orlgmj (mgr.34412) 6868 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:58:48.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:58:47 gibba045 bash[25517]: cephadm 2021-03-10T15:58:46.590553+0000 mgr.gibba045.orlgmj (mgr.34412) 6869 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:58:48.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:58:47 gibba045 bash[25517]: cephadm 2021-03-10T15:58:46.590597+0000 mgr.gibba045.orlgmj (mgr.34412) 6870 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:58:48.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:58:47 gibba045 bash[25517]: cephadm 2021-03-10T15:58:46.591999+0000 mgr.gibba045.orlgmj (mgr.34412) 6871 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:58:48.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:58:47 gibba045 bash[25517]: cephadm 2021-03-10T15:58:46.594096+0000 mgr.gibba045.orlgmj (mgr.34412) 6872 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:58:48.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:58:47 gibba045 bash[25517]: cephadm 2021-03-10T15:58:46.594146+0000 mgr.gibba045.orlgmj (mgr.34412) 6873 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:58:48.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:58:47 gibba045 bash[25517]: cephadm 2021-03-10T15:58:46.595725+0000 mgr.gibba045.orlgmj (mgr.34412) 6874 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:58:48.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:58:47 gibba045 bash[25517]: cephadm 2021-03-10T15:58:46.596130+0000 mgr.gibba045.orlgmj (mgr.34412) 6875 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:58:48.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:58:47 gibba045 bash[25517]: cephadm 2021-03-10T15:58:46.597684+0000 mgr.gibba045.orlgmj (mgr.34412) 6876 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:58:48.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:58:47 gibba045 bash[25517]: cephadm 2021-03-10T15:58:46.597732+0000 mgr.gibba045.orlgmj (mgr.34412) 6877 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:58:48.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:58:47 gibba045 bash[25517]: cephadm 2021-03-10T15:58:46.597856+0000 mgr.gibba045.orlgmj (mgr.34412) 6878 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:58:48.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:58:47 gibba045 bash[25517]: cluster 2021-03-10T15:58:46.619588+0000 mgr.gibba045.orlgmj (mgr.34412) 6879 : cluster [DBG] pgmap v3909: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:49.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:58:49 gibba015 bash[29377]: cluster 2021-03-10T15:58:48.620872+0000 mgr.gibba045.orlgmj (mgr.34412) 6880 : cluster [DBG] pgmap v3910: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:49.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:58:49 gibba015 bash[30343]: cluster 2021-03-10T15:58:48.620872+0000 mgr.gibba045.orlgmj (mgr.34412) 6880 : cluster [DBG] pgmap v3910: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:50.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:58:49 gibba045 bash[25517]: cluster 2021-03-10T15:58:48.620872+0000 mgr.gibba045.orlgmj (mgr.34412) 6880 : cluster [DBG] pgmap v3910: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:51.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:58:51 gibba015 bash[29377]: cluster 2021-03-10T15:58:50.622503+0000 mgr.gibba045.orlgmj (mgr.34412) 6881 : cluster [DBG] pgmap v3911: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:51.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:58:51 gibba015 bash[30343]: cluster 2021-03-10T15:58:50.622503+0000 mgr.gibba045.orlgmj (mgr.34412) 6881 : cluster [DBG] pgmap v3911: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:51.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:58:51 gibba045 bash[25517]: cluster 2021-03-10T15:58:50.622503+0000 mgr.gibba045.orlgmj (mgr.34412) 6881 : cluster [DBG] pgmap v3911: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:53.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:58:53 gibba015 bash[29377]: cluster 2021-03-10T15:58:52.623349+0000 mgr.gibba045.orlgmj (mgr.34412) 6882 : cluster [DBG] pgmap v3912: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:53.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:58:53 gibba015 bash[29377]: audit 2021-03-10T15:58:53.370257+0000 mon.c (mon.1) 1913 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:58:53.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:58:53 gibba015 bash[29377]: audit 2021-03-10T15:58:53.370947+0000 mon.c (mon.1) 1914 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:58:53.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:58:53 gibba015 bash[29377]: audit 2021-03-10T15:58:53.371461+0000 mon.a (mon.0) 1650 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:58:53.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:58:53 gibba015 bash[29377]: audit 2021-03-10T15:58:53.371474+0000 mon.c (mon.1) 1915 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T15:58:53.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:58:53 gibba015 bash[29377]: audit 2021-03-10T15:58:53.372130+0000 mon.c (mon.1) 1916 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:58:53.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:58:53 gibba015 bash[29377]: audit 2021-03-10T15:58:53.372749+0000 mon.c (mon.1) 1917 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:58:53.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:58:53 gibba015 bash[29377]: audit 2021-03-10T15:58:53.373155+0000 mon.a (mon.0) 1651 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:58:53.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:58:53 gibba015 bash[29377]: audit 2021-03-10T15:58:53.373602+0000 mon.c (mon.1) 1918 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:58:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:58:53 gibba015 bash[29377]: audit 2021-03-10T15:58:53.374089+0000 mon.a (mon.0) 1652 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T15:58:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:58:53 gibba015 bash[29377]: audit 2021-03-10T15:58:53.374353+0000 mon.a (mon.0) 1653 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:58:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:58:53 gibba015 bash[29377]: audit 2021-03-10T15:58:53.374579+0000 mon.a (mon.0) 1654 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:58:53.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:58:53 gibba015 bash[29377]: audit 2021-03-10T15:58:53.374891+0000 mon.a (mon.0) 1655 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:58:53.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:58:53 gibba015 bash[30343]: cluster 2021-03-10T15:58:52.623349+0000 mgr.gibba045.orlgmj (mgr.34412) 6882 : cluster [DBG] pgmap v3912: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:53.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:58:53 gibba015 bash[30343]: audit 2021-03-10T15:58:53.370257+0000 mon.c (mon.1) 1913 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:58:53.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:58:53 gibba015 bash[30343]: audit 2021-03-10T15:58:53.370947+0000 mon.c (mon.1) 1914 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:58:53.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:58:53 gibba015 bash[30343]: audit 2021-03-10T15:58:53.371461+0000 mon.a (mon.0) 1650 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:58:53.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:58:53 gibba015 bash[30343]: audit 2021-03-10T15:58:53.371474+0000 mon.c (mon.1) 1915 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T15:58:53.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:58:53 gibba015 bash[30343]: audit 2021-03-10T15:58:53.372130+0000 mon.c (mon.1) 1916 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:58:53.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:58:53 gibba015 bash[30343]: audit 2021-03-10T15:58:53.372749+0000 mon.c (mon.1) 1917 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:58:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:58:53 gibba015 bash[30343]: audit 2021-03-10T15:58:53.373155+0000 mon.a (mon.0) 1651 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:58:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:58:53 gibba015 bash[30343]: audit 2021-03-10T15:58:53.373602+0000 mon.c (mon.1) 1918 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:58:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:58:53 gibba015 bash[30343]: audit 2021-03-10T15:58:53.374089+0000 mon.a (mon.0) 1652 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T15:58:53.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:58:53 gibba015 bash[30343]: audit 2021-03-10T15:58:53.374353+0000 mon.a (mon.0) 1653 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:58:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:58:53 gibba015 bash[30343]: audit 2021-03-10T15:58:53.374579+0000 mon.a (mon.0) 1654 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:58:53.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:58:53 gibba015 bash[30343]: audit 2021-03-10T15:58:53.374891+0000 mon.a (mon.0) 1655 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:58:54.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:58:53 gibba045 bash[25517]: cluster 2021-03-10T15:58:52.623349+0000 mgr.gibba045.orlgmj (mgr.34412) 6882 : cluster [DBG] pgmap v3912: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:54.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:58:53 gibba045 bash[25517]: audit 2021-03-10T15:58:53.370257+0000 mon.c (mon.1) 1913 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:58:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:58:53 gibba045 bash[25517]: audit 2021-03-10T15:58:53.370947+0000 mon.c (mon.1) 1914 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:58:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:58:53 gibba045 bash[25517]: audit 2021-03-10T15:58:53.371461+0000 mon.a (mon.0) 1650 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:58:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:58:53 gibba045 bash[25517]: audit 2021-03-10T15:58:53.371474+0000 mon.c (mon.1) 1915 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T15:58:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:58:53 gibba045 bash[25517]: audit 2021-03-10T15:58:53.372130+0000 mon.c (mon.1) 1916 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:58:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:58:53 gibba045 bash[25517]: audit 2021-03-10T15:58:53.372749+0000 mon.c (mon.1) 1917 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:58:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:58:53 gibba045 bash[25517]: audit 2021-03-10T15:58:53.373155+0000 mon.a (mon.0) 1651 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:58:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:58:53 gibba045 bash[25517]: audit 2021-03-10T15:58:53.373602+0000 mon.c (mon.1) 1918 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:58:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:58:53 gibba045 bash[25517]: audit 2021-03-10T15:58:53.374089+0000 mon.a (mon.0) 1652 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T15:58:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:58:53 gibba045 bash[25517]: audit 2021-03-10T15:58:53.374353+0000 mon.a (mon.0) 1653 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:58:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:58:53 gibba045 bash[25517]: audit 2021-03-10T15:58:53.374579+0000 mon.a (mon.0) 1654 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:58:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:58:53 gibba045 bash[25517]: audit 2021-03-10T15:58:53.374891+0000 mon.a (mon.0) 1655 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:58:55.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:58:55 gibba015 bash[29377]: cluster 2021-03-10T15:58:54.624765+0000 mgr.gibba045.orlgmj (mgr.34412) 6883 : cluster [DBG] pgmap v3913: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:55.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:58:55 gibba015 bash[30343]: cluster 2021-03-10T15:58:54.624765+0000 mgr.gibba045.orlgmj (mgr.34412) 6883 : cluster [DBG] pgmap v3913: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:56.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:58:55 gibba045 bash[25517]: cluster 2021-03-10T15:58:54.624765+0000 mgr.gibba045.orlgmj (mgr.34412) 6883 : cluster [DBG] pgmap v3913: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:57.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:58:57 gibba015 bash[29377]: cluster 2021-03-10T15:58:56.626493+0000 mgr.gibba045.orlgmj (mgr.34412) 6884 : cluster [DBG] pgmap v3914: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:57.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:58:57 gibba015 bash[30343]: cluster 2021-03-10T15:58:56.626493+0000 mgr.gibba045.orlgmj (mgr.34412) 6884 : cluster [DBG] pgmap v3914: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:58.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:58:57 gibba045 bash[25517]: cluster 2021-03-10T15:58:56.626493+0000 mgr.gibba045.orlgmj (mgr.34412) 6884 : cluster [DBG] pgmap v3914: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:59.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:58:59 gibba015 bash[29377]: cluster 2021-03-10T15:58:58.627720+0000 mgr.gibba045.orlgmj (mgr.34412) 6885 : cluster [DBG] pgmap v3915: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:59.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:58:59 gibba015 bash[30343]: cluster 2021-03-10T15:58:58.627720+0000 mgr.gibba045.orlgmj (mgr.34412) 6885 : cluster [DBG] pgmap v3915: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:00.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:58:59 gibba045 bash[25517]: cluster 2021-03-10T15:58:58.627720+0000 mgr.gibba045.orlgmj (mgr.34412) 6885 : cluster [DBG] pgmap v3915: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:01.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:59:01 gibba015 bash[29377]: cluster 2021-03-10T15:59:00.629443+0000 mgr.gibba045.orlgmj (mgr.34412) 6886 : cluster [DBG] pgmap v3916: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:01.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:59:01 gibba015 bash[30343]: cluster 2021-03-10T15:59:00.629443+0000 mgr.gibba045.orlgmj (mgr.34412) 6886 : cluster [DBG] pgmap v3916: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:01.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:59:01 gibba045 bash[25517]: cluster 2021-03-10T15:59:00.629443+0000 mgr.gibba045.orlgmj (mgr.34412) 6886 : cluster [DBG] pgmap v3916: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:02.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:59:02 gibba015 bash[29377]: cephadm 2021-03-10T15:59:01.613267+0000 mgr.gibba045.orlgmj (mgr.34412) 6887 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:59:02.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:59:02 gibba015 bash[30343]: cephadm 2021-03-10T15:59:01.613267+0000 mgr.gibba045.orlgmj (mgr.34412) 6887 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:59:02.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:59:02 gibba045 bash[25517]: cephadm 2021-03-10T15:59:01.613267+0000 mgr.gibba045.orlgmj (mgr.34412) 6887 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:59:03.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:59:03 gibba015 bash[29377]: cluster 2021-03-10T15:59:02.630126+0000 mgr.gibba045.orlgmj (mgr.34412) 6888 : cluster [DBG] pgmap v3917: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:03.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:59:03 gibba015 bash[30343]: cluster 2021-03-10T15:59:02.630126+0000 mgr.gibba045.orlgmj (mgr.34412) 6888 : cluster [DBG] pgmap v3917: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:03.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:59:03 gibba045 bash[25517]: cluster 2021-03-10T15:59:02.630126+0000 mgr.gibba045.orlgmj (mgr.34412) 6888 : cluster [DBG] pgmap v3917: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:05.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:59:05 gibba015 bash[29377]: cluster 2021-03-10T15:59:04.631335+0000 mgr.gibba045.orlgmj (mgr.34412) 6889 : cluster [DBG] pgmap v3918: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:05.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:59:05 gibba015 bash[30343]: cluster 2021-03-10T15:59:04.631335+0000 mgr.gibba045.orlgmj (mgr.34412) 6889 : cluster [DBG] pgmap v3918: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:06.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:59:05 gibba045 bash[25517]: cluster 2021-03-10T15:59:04.631335+0000 mgr.gibba045.orlgmj (mgr.34412) 6889 : cluster [DBG] pgmap v3918: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:07.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:59:07 gibba015 bash[29377]: cluster 2021-03-10T15:59:06.633324+0000 mgr.gibba045.orlgmj (mgr.34412) 6890 : cluster [DBG] pgmap v3919: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:07.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:59:07 gibba015 bash[30343]: cluster 2021-03-10T15:59:06.633324+0000 mgr.gibba045.orlgmj (mgr.34412) 6890 : cluster [DBG] pgmap v3919: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:08.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:59:07 gibba045 bash[25517]: cluster 2021-03-10T15:59:06.633324+0000 mgr.gibba045.orlgmj (mgr.34412) 6890 : cluster [DBG] pgmap v3919: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:09.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:59:09 gibba015 bash[29377]: cluster 2021-03-10T15:59:08.634629+0000 mgr.gibba045.orlgmj (mgr.34412) 6891 : cluster [DBG] pgmap v3920: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:09.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:59:09 gibba015 bash[30343]: cluster 2021-03-10T15:59:08.634629+0000 mgr.gibba045.orlgmj (mgr.34412) 6891 : cluster [DBG] pgmap v3920: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:10.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:59:09 gibba045 bash[25517]: cluster 2021-03-10T15:59:08.634629+0000 mgr.gibba045.orlgmj (mgr.34412) 6891 : cluster [DBG] pgmap v3920: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:11.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:59:11 gibba015 bash[29377]: cluster 2021-03-10T15:59:10.636408+0000 mgr.gibba045.orlgmj (mgr.34412) 6892 : cluster [DBG] pgmap v3921: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:11.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:59:11 gibba015 bash[30343]: cluster 2021-03-10T15:59:10.636408+0000 mgr.gibba045.orlgmj (mgr.34412) 6892 : cluster [DBG] pgmap v3921: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:11.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:59:11 gibba045 bash[25517]: cluster 2021-03-10T15:59:10.636408+0000 mgr.gibba045.orlgmj (mgr.34412) 6892 : cluster [DBG] pgmap v3921: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:12.758 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:59:13.015 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:59:13.016 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 3m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:59:13.016 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 2m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:59:13.016 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:59:13.016 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:59:13.017 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:59:13.017 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:59:13.017 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:59:13.017 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:59:13.018 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 3m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:59:13.018 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 2m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:59:13.018 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:59:13.018 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:59:13.018 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:59:13.019 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:59:13.019 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:59:13.019 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:59:13.019 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:59:13.020 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:59:13.020 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 2m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:59:13.020 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 2m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T15:59:13.272 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:59:13.272 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:59:13.273 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:59:13.273 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:59:13.273 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:59:13.273 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:59:13.274 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:59:13.274 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:59:13.274 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:59:13.274 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:59:13.275 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:59:13.275 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:59:13.275 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:59:13.275 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:59:13.276 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:59:13.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:59:13 gibba015 bash[29377]: cluster 2021-03-10T15:59:12.637385+0000 mgr.gibba045.orlgmj (mgr.34412) 6893 : cluster [DBG] pgmap v3922: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:13.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:59:13 gibba015 bash[29377]: audit 2021-03-10T15:59:12.750086+0000 mgr.gibba045.orlgmj (mgr.34412) 6894 : audit [DBG] from='client.48678 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:59:13.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:59:13 gibba015 bash[29377]: audit 2021-03-10T15:59:13.270082+0000 mon.c (mon.1) 1919 : audit [DBG] from='client.? 172.21.2.115:0/3463643774' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:59:13.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:59:13 gibba015 bash[30343]: cluster 2021-03-10T15:59:12.637385+0000 mgr.gibba045.orlgmj (mgr.34412) 6893 : cluster [DBG] pgmap v3922: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:13.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:59:13 gibba015 bash[30343]: audit 2021-03-10T15:59:12.750086+0000 mgr.gibba045.orlgmj (mgr.34412) 6894 : audit [DBG] from='client.48678 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:59:13.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:59:13 gibba015 bash[30343]: audit 2021-03-10T15:59:13.270082+0000 mon.c (mon.1) 1919 : audit [DBG] from='client.? 172.21.2.115:0/3463643774' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:59:14.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:59:13 gibba045 bash[25517]: cluster 2021-03-10T15:59:12.637385+0000 mgr.gibba045.orlgmj (mgr.34412) 6893 : cluster [DBG] pgmap v3922: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:14.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:59:13 gibba045 bash[25517]: audit 2021-03-10T15:59:12.750086+0000 mgr.gibba045.orlgmj (mgr.34412) 6894 : audit [DBG] from='client.48678 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:59:14.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:59:13 gibba045 bash[25517]: audit 2021-03-10T15:59:13.270082+0000 mon.c (mon.1) 1919 : audit [DBG] from='client.? 172.21.2.115:0/3463643774' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:59:14.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:59:14 gibba015 bash[29377]: audit 2021-03-10T15:59:12.976279+0000 mgr.gibba045.orlgmj (mgr.34412) 6895 : audit [DBG] from='client.58672 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:59:14.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:59:14 gibba015 bash[30343]: audit 2021-03-10T15:59:12.976279+0000 mgr.gibba045.orlgmj (mgr.34412) 6895 : audit [DBG] from='client.58672 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:59:15.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:59:14 gibba045 bash[25517]: audit 2021-03-10T15:59:12.976279+0000 mgr.gibba045.orlgmj (mgr.34412) 6895 : audit [DBG] from='client.58672 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:59:15.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:59:15 gibba015 bash[29377]: cluster 2021-03-10T15:59:14.638655+0000 mgr.gibba045.orlgmj (mgr.34412) 6896 : cluster [DBG] pgmap v3923: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:15.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:59:15 gibba015 bash[30343]: cluster 2021-03-10T15:59:14.638655+0000 mgr.gibba045.orlgmj (mgr.34412) 6896 : cluster [DBG] pgmap v3923: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:16.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:59:15 gibba045 bash[25517]: cluster 2021-03-10T15:59:14.638655+0000 mgr.gibba045.orlgmj (mgr.34412) 6896 : cluster [DBG] pgmap v3923: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:17.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:59:17 gibba015 bash[29377]: cephadm 2021-03-10T15:59:16.619022+0000 mgr.gibba045.orlgmj (mgr.34412) 6897 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:59:17.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:59:17 gibba015 bash[29377]: cluster 2021-03-10T15:59:16.640384+0000 mgr.gibba045.orlgmj (mgr.34412) 6898 : cluster [DBG] pgmap v3924: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:17.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:59:17 gibba015 bash[30343]: cephadm 2021-03-10T15:59:16.619022+0000 mgr.gibba045.orlgmj (mgr.34412) 6897 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:59:17.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:59:17 gibba015 bash[30343]: cluster 2021-03-10T15:59:16.640384+0000 mgr.gibba045.orlgmj (mgr.34412) 6898 : cluster [DBG] pgmap v3924: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:18.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:59:17 gibba045 bash[25517]: cephadm 2021-03-10T15:59:16.619022+0000 mgr.gibba045.orlgmj (mgr.34412) 6897 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:59:18.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:59:17 gibba045 bash[25517]: cluster 2021-03-10T15:59:16.640384+0000 mgr.gibba045.orlgmj (mgr.34412) 6898 : cluster [DBG] pgmap v3924: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:20.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:59:19 gibba045 bash[25517]: cluster 2021-03-10T15:59:18.641402+0000 mgr.gibba045.orlgmj (mgr.34412) 6899 : cluster [DBG] pgmap v3925: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:20.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:59:19 gibba015 bash[29377]: cluster 2021-03-10T15:59:18.641402+0000 mgr.gibba045.orlgmj (mgr.34412) 6899 : cluster [DBG] pgmap v3925: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:20.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:59:19 gibba015 bash[30343]: cluster 2021-03-10T15:59:18.641402+0000 mgr.gibba045.orlgmj (mgr.34412) 6899 : cluster [DBG] pgmap v3925: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:21.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:59:21 gibba015 bash[29377]: cluster 2021-03-10T15:59:20.643092+0000 mgr.gibba045.orlgmj (mgr.34412) 6900 : cluster [DBG] pgmap v3926: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:21.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:59:21 gibba015 bash[30343]: cluster 2021-03-10T15:59:20.643092+0000 mgr.gibba045.orlgmj (mgr.34412) 6900 : cluster [DBG] pgmap v3926: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:21.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:59:21 gibba045 bash[25517]: cluster 2021-03-10T15:59:20.643092+0000 mgr.gibba045.orlgmj (mgr.34412) 6900 : cluster [DBG] pgmap v3926: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:23.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:59:23 gibba015 bash[29377]: cluster 2021-03-10T15:59:22.644035+0000 mgr.gibba045.orlgmj (mgr.34412) 6901 : cluster [DBG] pgmap v3927: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:23.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:59:23 gibba015 bash[30343]: cluster 2021-03-10T15:59:22.644035+0000 mgr.gibba045.orlgmj (mgr.34412) 6901 : cluster [DBG] pgmap v3927: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:24.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:59:23 gibba045 bash[25517]: cluster 2021-03-10T15:59:22.644035+0000 mgr.gibba045.orlgmj (mgr.34412) 6901 : cluster [DBG] pgmap v3927: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:25.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:59:25 gibba015 bash[29377]: cluster 2021-03-10T15:59:24.644984+0000 mgr.gibba045.orlgmj (mgr.34412) 6902 : cluster [DBG] pgmap v3928: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:25.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:59:25 gibba015 bash[30343]: cluster 2021-03-10T15:59:24.644984+0000 mgr.gibba045.orlgmj (mgr.34412) 6902 : cluster [DBG] pgmap v3928: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:26.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:59:25 gibba045 bash[25517]: cluster 2021-03-10T15:59:24.644984+0000 mgr.gibba045.orlgmj (mgr.34412) 6902 : cluster [DBG] pgmap v3928: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:28.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:59:27 gibba045 bash[25517]: cluster 2021-03-10T15:59:26.646749+0000 mgr.gibba045.orlgmj (mgr.34412) 6903 : cluster [DBG] pgmap v3929: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:28.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:59:27 gibba015 bash[29377]: cluster 2021-03-10T15:59:26.646749+0000 mgr.gibba045.orlgmj (mgr.34412) 6903 : cluster [DBG] pgmap v3929: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:28.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:59:27 gibba015 bash[30343]: cluster 2021-03-10T15:59:26.646749+0000 mgr.gibba045.orlgmj (mgr.34412) 6903 : cluster [DBG] pgmap v3929: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:30.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:59:29 gibba045 bash[25517]: cluster 2021-03-10T15:59:28.647952+0000 mgr.gibba045.orlgmj (mgr.34412) 6904 : cluster [DBG] pgmap v3930: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:30.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:59:29 gibba015 bash[29377]: cluster 2021-03-10T15:59:28.647952+0000 mgr.gibba045.orlgmj (mgr.34412) 6904 : cluster [DBG] pgmap v3930: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:30.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:59:29 gibba015 bash[30343]: cluster 2021-03-10T15:59:28.647952+0000 mgr.gibba045.orlgmj (mgr.34412) 6904 : cluster [DBG] pgmap v3930: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:31.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:59:31 gibba015 bash[29377]: cluster 2021-03-10T15:59:30.649677+0000 mgr.gibba045.orlgmj (mgr.34412) 6905 : cluster [DBG] pgmap v3931: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:31.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:59:31 gibba015 bash[30343]: cluster 2021-03-10T15:59:30.649677+0000 mgr.gibba045.orlgmj (mgr.34412) 6905 : cluster [DBG] pgmap v3931: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:31.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:59:31 gibba045 bash[25517]: cluster 2021-03-10T15:59:30.649677+0000 mgr.gibba045.orlgmj (mgr.34412) 6905 : cluster [DBG] pgmap v3931: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:32.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:59:32 gibba015 bash[29377]: cephadm 2021-03-10T15:59:31.635121+0000 mgr.gibba045.orlgmj (mgr.34412) 6906 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:59:32.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:59:32 gibba015 bash[30343]: cephadm 2021-03-10T15:59:31.635121+0000 mgr.gibba045.orlgmj (mgr.34412) 6906 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:59:32.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:59:32 gibba045 bash[25517]: cephadm 2021-03-10T15:59:31.635121+0000 mgr.gibba045.orlgmj (mgr.34412) 6906 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:59:33.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:59:33 gibba015 bash[29377]: cluster 2021-03-10T15:59:32.650599+0000 mgr.gibba045.orlgmj (mgr.34412) 6907 : cluster [DBG] pgmap v3932: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:33.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:59:33 gibba015 bash[30343]: cluster 2021-03-10T15:59:32.650599+0000 mgr.gibba045.orlgmj (mgr.34412) 6907 : cluster [DBG] pgmap v3932: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:33.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:59:33 gibba045 bash[25517]: cluster 2021-03-10T15:59:32.650599+0000 mgr.gibba045.orlgmj (mgr.34412) 6907 : cluster [DBG] pgmap v3932: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:35.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:59:35 gibba015 bash[29377]: cluster 2021-03-10T15:59:34.651997+0000 mgr.gibba045.orlgmj (mgr.34412) 6908 : cluster [DBG] pgmap v3933: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:35.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:59:35 gibba015 bash[30343]: cluster 2021-03-10T15:59:34.651997+0000 mgr.gibba045.orlgmj (mgr.34412) 6908 : cluster [DBG] pgmap v3933: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:36.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:59:35 gibba045 bash[25517]: cluster 2021-03-10T15:59:34.651997+0000 mgr.gibba045.orlgmj (mgr.34412) 6908 : cluster [DBG] pgmap v3933: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:38.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:59:37 gibba045 bash[25517]: cluster 2021-03-10T15:59:36.653880+0000 mgr.gibba045.orlgmj (mgr.34412) 6909 : cluster [DBG] pgmap v3934: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:38.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:59:37 gibba015 bash[29377]: cluster 2021-03-10T15:59:36.653880+0000 mgr.gibba045.orlgmj (mgr.34412) 6909 : cluster [DBG] pgmap v3934: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:38.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:59:37 gibba015 bash[30343]: cluster 2021-03-10T15:59:36.653880+0000 mgr.gibba045.orlgmj (mgr.34412) 6909 : cluster [DBG] pgmap v3934: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:40.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:59:39 gibba045 bash[25517]: cluster 2021-03-10T15:59:38.655070+0000 mgr.gibba045.orlgmj (mgr.34412) 6910 : cluster [DBG] pgmap v3935: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:40.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:59:39 gibba015 bash[29377]: cluster 2021-03-10T15:59:38.655070+0000 mgr.gibba045.orlgmj (mgr.34412) 6910 : cluster [DBG] pgmap v3935: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:40.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:59:39 gibba015 bash[30343]: cluster 2021-03-10T15:59:38.655070+0000 mgr.gibba045.orlgmj (mgr.34412) 6910 : cluster [DBG] pgmap v3935: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:41.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:59:41 gibba015 bash[29377]: cluster 2021-03-10T15:59:40.656610+0000 mgr.gibba045.orlgmj (mgr.34412) 6911 : cluster [DBG] pgmap v3936: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:41.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:59:41 gibba015 bash[30343]: cluster 2021-03-10T15:59:40.656610+0000 mgr.gibba045.orlgmj (mgr.34412) 6911 : cluster [DBG] pgmap v3936: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:41.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:59:41 gibba045 bash[25517]: cluster 2021-03-10T15:59:40.656610+0000 mgr.gibba045.orlgmj (mgr.34412) 6911 : cluster [DBG] pgmap v3936: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:43.517 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T15:59:43.740 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:59:43.740 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 4m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T15:59:43.740 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 2m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T15:59:43.740 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T15:59:43.741 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T15:59:43.741 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T15:59:43.741 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T15:59:43.741 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T15:59:43.742 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T15:59:43.742 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 4m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T15:59:43.742 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 2m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T15:59:43.742 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T15:59:43.743 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T15:59:43.743 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T15:59:43.743 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T15:59:43.743 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T15:59:43.744 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T15:59:43.744 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T15:59:43.744 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T15:59:43.744 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 2m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T15:59:43.745 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 2m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T15:59:43.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:59:43 gibba015 bash[29377]: cluster 2021-03-10T15:59:42.657485+0000 mgr.gibba045.orlgmj (mgr.34412) 6912 : cluster [DBG] pgmap v3937: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:43.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:59:43 gibba015 bash[30343]: cluster 2021-03-10T15:59:42.657485+0000 mgr.gibba045.orlgmj (mgr.34412) 6912 : cluster [DBG] pgmap v3937: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:43.989 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T15:59:43.989 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T15:59:43.989 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:59:43.989 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:59:43.990 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T15:59:43.990 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:59:43.990 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:59:43.990 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T15:59:43.991 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:59:43.991 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T15:59:43.991 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T15:59:43.991 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T15:59:43.991 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:59:43.992 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T15:59:43.992 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T15:59:44.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:59:43 gibba045 bash[25517]: cluster 2021-03-10T15:59:42.657485+0000 mgr.gibba045.orlgmj (mgr.34412) 6912 : cluster [DBG] pgmap v3937: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:45.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:59:44 gibba045 bash[25517]: audit 2021-03-10T15:59:43.509163+0000 mgr.gibba045.orlgmj (mgr.34412) 6913 : audit [DBG] from='client.48696 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:59:45.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:59:44 gibba045 bash[25517]: audit 2021-03-10T15:59:43.732247+0000 mgr.gibba045.orlgmj (mgr.34412) 6914 : audit [DBG] from='client.48702 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:59:45.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:59:44 gibba045 bash[25517]: audit 2021-03-10T15:59:43.987828+0000 mon.a (mon.0) 1656 : audit [DBG] from='client.? 172.21.2.115:0/2651423231' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:59:45.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:59:44 gibba015 bash[29377]: audit 2021-03-10T15:59:43.509163+0000 mgr.gibba045.orlgmj (mgr.34412) 6913 : audit [DBG] from='client.48696 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:59:45.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:59:44 gibba015 bash[29377]: audit 2021-03-10T15:59:43.732247+0000 mgr.gibba045.orlgmj (mgr.34412) 6914 : audit [DBG] from='client.48702 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:59:45.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:59:44 gibba015 bash[29377]: audit 2021-03-10T15:59:43.987828+0000 mon.a (mon.0) 1656 : audit [DBG] from='client.? 172.21.2.115:0/2651423231' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:59:45.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:59:44 gibba015 bash[30343]: audit 2021-03-10T15:59:43.509163+0000 mgr.gibba045.orlgmj (mgr.34412) 6913 : audit [DBG] from='client.48696 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:59:45.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:59:44 gibba015 bash[30343]: audit 2021-03-10T15:59:43.732247+0000 mgr.gibba045.orlgmj (mgr.34412) 6914 : audit [DBG] from='client.48702 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:59:45.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:59:44 gibba015 bash[30343]: audit 2021-03-10T15:59:43.987828+0000 mon.a (mon.0) 1656 : audit [DBG] from='client.? 172.21.2.115:0/2651423231' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:59:46.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:59:45 gibba045 bash[25517]: cluster 2021-03-10T15:59:44.658180+0000 mgr.gibba045.orlgmj (mgr.34412) 6915 : cluster [DBG] pgmap v3938: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:46.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:59:45 gibba015 bash[29377]: cluster 2021-03-10T15:59:44.658180+0000 mgr.gibba045.orlgmj (mgr.34412) 6915 : cluster [DBG] pgmap v3938: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:46.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:59:45 gibba015 bash[30343]: cluster 2021-03-10T15:59:44.658180+0000 mgr.gibba045.orlgmj (mgr.34412) 6915 : cluster [DBG] pgmap v3938: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:47.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:59:46 gibba045 bash[25517]: audit 2021-03-10T15:59:46.649558+0000 mon.c (mon.1) 1920 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:59:47.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:59:46 gibba015 bash[29377]: audit 2021-03-10T15:59:46.649558+0000 mon.c (mon.1) 1920 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:59:47.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:59:46 gibba015 bash[30343]: audit 2021-03-10T15:59:46.649558+0000 mon.c (mon.1) 1920 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:59:48.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:59:47 gibba045 bash[25517]: cephadm 2021-03-10T15:59:46.658045+0000 mgr.gibba045.orlgmj (mgr.34412) 6916 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:59:48.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:59:47 gibba045 bash[25517]: cluster 2021-03-10T15:59:46.659655+0000 mgr.gibba045.orlgmj (mgr.34412) 6917 : cluster [DBG] pgmap v3939: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:48.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:59:47 gibba045 bash[25517]: cephadm 2021-03-10T15:59:46.659989+0000 mgr.gibba045.orlgmj (mgr.34412) 6918 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:59:48.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:59:47 gibba045 bash[25517]: audit 2021-03-10T15:59:46.888431+0000 mon.a (mon.0) 1657 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:59:48.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:59:47 gibba045 bash[25517]: audit 2021-03-10T15:59:46.891954+0000 mon.c (mon.1) 1921 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:59:48.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:59:47 gibba045 bash[25517]: audit 2021-03-10T15:59:46.893224+0000 mon.c (mon.1) 1922 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:59:48.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:59:47 gibba045 bash[25517]: audit 2021-03-10T15:59:46.894687+0000 mon.c (mon.1) 1923 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:59:48.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:59:47 gibba045 bash[25517]: audit 2021-03-10T15:59:46.895794+0000 mon.c (mon.1) 1924 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:59:48.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:59:47 gibba045 bash[25517]: audit 2021-03-10T15:59:46.898546+0000 mon.c (mon.1) 1925 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:59:48.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:59:47 gibba045 bash[25517]: audit 2021-03-10T15:59:46.899915+0000 mon.c (mon.1) 1926 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:59:48.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:59:47 gibba015 bash[30343]: cephadm 2021-03-10T15:59:46.658045+0000 mgr.gibba045.orlgmj (mgr.34412) 6916 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:59:48.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:59:47 gibba015 bash[30343]: cluster 2021-03-10T15:59:46.659655+0000 mgr.gibba045.orlgmj (mgr.34412) 6917 : cluster [DBG] pgmap v3939: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:48.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:59:47 gibba015 bash[30343]: cephadm 2021-03-10T15:59:46.659989+0000 mgr.gibba045.orlgmj (mgr.34412) 6918 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:59:48.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:59:47 gibba015 bash[30343]: audit 2021-03-10T15:59:46.888431+0000 mon.a (mon.0) 1657 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:59:48.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:59:47 gibba015 bash[30343]: audit 2021-03-10T15:59:46.891954+0000 mon.c (mon.1) 1921 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:59:48.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:59:47 gibba015 bash[30343]: audit 2021-03-10T15:59:46.893224+0000 mon.c (mon.1) 1922 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:59:48.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:59:47 gibba015 bash[30343]: audit 2021-03-10T15:59:46.894687+0000 mon.c (mon.1) 1923 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:59:48.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:59:47 gibba015 bash[30343]: audit 2021-03-10T15:59:46.895794+0000 mon.c (mon.1) 1924 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:59:48.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:59:47 gibba015 bash[30343]: audit 2021-03-10T15:59:46.898546+0000 mon.c (mon.1) 1925 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:59:48.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:59:47 gibba015 bash[30343]: audit 2021-03-10T15:59:46.899915+0000 mon.c (mon.1) 1926 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:59:48.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:59:47 gibba015 bash[29377]: cephadm 2021-03-10T15:59:46.658045+0000 mgr.gibba045.orlgmj (mgr.34412) 6916 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T15:59:48.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:59:47 gibba015 bash[29377]: cluster 2021-03-10T15:59:46.659655+0000 mgr.gibba045.orlgmj (mgr.34412) 6917 : cluster [DBG] pgmap v3939: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:48.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:59:47 gibba015 bash[29377]: cephadm 2021-03-10T15:59:46.659989+0000 mgr.gibba045.orlgmj (mgr.34412) 6918 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T15:59:48.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:59:47 gibba015 bash[29377]: audit 2021-03-10T15:59:46.888431+0000 mon.a (mon.0) 1657 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T15:59:48.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:59:47 gibba015 bash[29377]: audit 2021-03-10T15:59:46.891954+0000 mon.c (mon.1) 1921 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:59:48.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:59:47 gibba015 bash[29377]: audit 2021-03-10T15:59:46.893224+0000 mon.c (mon.1) 1922 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:59:48.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:59:47 gibba015 bash[29377]: audit 2021-03-10T15:59:46.894687+0000 mon.c (mon.1) 1923 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:59:48.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:59:47 gibba015 bash[29377]: audit 2021-03-10T15:59:46.895794+0000 mon.c (mon.1) 1924 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:59:48.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:59:47 gibba015 bash[29377]: audit 2021-03-10T15:59:46.898546+0000 mon.c (mon.1) 1925 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:59:48.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:59:47 gibba015 bash[29377]: audit 2021-03-10T15:59:46.899915+0000 mon.c (mon.1) 1926 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:59:49.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:59:48 gibba045 bash[25517]: cephadm 2021-03-10T15:59:46.893815+0000 mgr.gibba045.orlgmj (mgr.34412) 6919 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:59:49.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:59:48 gibba045 bash[25517]: cephadm 2021-03-10T15:59:46.895300+0000 mgr.gibba045.orlgmj (mgr.34412) 6920 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:59:49.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:59:48 gibba045 bash[25517]: cephadm 2021-03-10T15:59:46.896566+0000 mgr.gibba045.orlgmj (mgr.34412) 6921 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:59:49.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:59:48 gibba045 bash[25517]: cephadm 2021-03-10T15:59:46.896604+0000 mgr.gibba045.orlgmj (mgr.34412) 6922 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:59:49.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:59:48 gibba045 bash[25517]: cephadm 2021-03-10T15:59:46.897913+0000 mgr.gibba045.orlgmj (mgr.34412) 6923 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:59:49.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:59:48 gibba045 bash[25517]: cephadm 2021-03-10T15:59:46.897951+0000 mgr.gibba045.orlgmj (mgr.34412) 6924 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:59:49.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:59:48 gibba045 bash[25517]: cephadm 2021-03-10T15:59:46.898976+0000 mgr.gibba045.orlgmj (mgr.34412) 6925 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:59:49.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:59:48 gibba045 bash[25517]: cephadm 2021-03-10T15:59:46.900416+0000 mgr.gibba045.orlgmj (mgr.34412) 6926 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:59:49.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:59:48 gibba045 bash[25517]: cephadm 2021-03-10T15:59:46.900529+0000 mgr.gibba045.orlgmj (mgr.34412) 6927 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:59:49.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:59:48 gibba045 bash[25517]: cephadm 2021-03-10T15:59:46.901718+0000 mgr.gibba045.orlgmj (mgr.34412) 6928 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:59:49.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:59:48 gibba045 bash[25517]: cephadm 2021-03-10T15:59:46.902029+0000 mgr.gibba045.orlgmj (mgr.34412) 6929 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:59:49.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:59:48 gibba045 bash[25517]: cephadm 2021-03-10T15:59:46.903075+0000 mgr.gibba045.orlgmj (mgr.34412) 6930 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:59:49.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:59:48 gibba045 bash[25517]: cephadm 2021-03-10T15:59:46.903112+0000 mgr.gibba045.orlgmj (mgr.34412) 6931 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:59:49.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:59:48 gibba045 bash[25517]: cephadm 2021-03-10T15:59:46.903215+0000 mgr.gibba045.orlgmj (mgr.34412) 6932 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:59:49.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:59:48 gibba015 bash[29377]: cephadm 2021-03-10T15:59:46.893815+0000 mgr.gibba045.orlgmj (mgr.34412) 6919 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:59:49.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:59:48 gibba015 bash[29377]: cephadm 2021-03-10T15:59:46.895300+0000 mgr.gibba045.orlgmj (mgr.34412) 6920 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:59:49.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:59:48 gibba015 bash[29377]: cephadm 2021-03-10T15:59:46.896566+0000 mgr.gibba045.orlgmj (mgr.34412) 6921 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:59:49.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:59:48 gibba015 bash[29377]: cephadm 2021-03-10T15:59:46.896604+0000 mgr.gibba045.orlgmj (mgr.34412) 6922 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:59:49.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:59:48 gibba015 bash[29377]: cephadm 2021-03-10T15:59:46.897913+0000 mgr.gibba045.orlgmj (mgr.34412) 6923 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:59:49.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:59:48 gibba015 bash[29377]: cephadm 2021-03-10T15:59:46.897951+0000 mgr.gibba045.orlgmj (mgr.34412) 6924 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:59:49.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:59:48 gibba015 bash[29377]: cephadm 2021-03-10T15:59:46.898976+0000 mgr.gibba045.orlgmj (mgr.34412) 6925 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:59:49.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:59:48 gibba015 bash[29377]: cephadm 2021-03-10T15:59:46.900416+0000 mgr.gibba045.orlgmj (mgr.34412) 6926 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:59:49.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:59:48 gibba015 bash[29377]: cephadm 2021-03-10T15:59:46.900529+0000 mgr.gibba045.orlgmj (mgr.34412) 6927 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:59:49.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:59:48 gibba015 bash[29377]: cephadm 2021-03-10T15:59:46.901718+0000 mgr.gibba045.orlgmj (mgr.34412) 6928 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:59:49.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:59:48 gibba015 bash[29377]: cephadm 2021-03-10T15:59:46.902029+0000 mgr.gibba045.orlgmj (mgr.34412) 6929 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:59:49.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:59:48 gibba015 bash[29377]: cephadm 2021-03-10T15:59:46.903075+0000 mgr.gibba045.orlgmj (mgr.34412) 6930 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:59:49.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:59:48 gibba015 bash[29377]: cephadm 2021-03-10T15:59:46.903112+0000 mgr.gibba045.orlgmj (mgr.34412) 6931 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:59:49.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:59:48 gibba015 bash[29377]: cephadm 2021-03-10T15:59:46.903215+0000 mgr.gibba045.orlgmj (mgr.34412) 6932 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:59:49.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:59:48 gibba015 bash[30343]: cephadm 2021-03-10T15:59:46.893815+0000 mgr.gibba045.orlgmj (mgr.34412) 6919 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:59:49.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:59:48 gibba015 bash[30343]: cephadm 2021-03-10T15:59:46.895300+0000 mgr.gibba045.orlgmj (mgr.34412) 6920 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:59:49.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:59:48 gibba015 bash[30343]: cephadm 2021-03-10T15:59:46.896566+0000 mgr.gibba045.orlgmj (mgr.34412) 6921 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:59:49.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:59:48 gibba015 bash[30343]: cephadm 2021-03-10T15:59:46.896604+0000 mgr.gibba045.orlgmj (mgr.34412) 6922 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:59:49.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:59:48 gibba015 bash[30343]: cephadm 2021-03-10T15:59:46.897913+0000 mgr.gibba045.orlgmj (mgr.34412) 6923 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:59:49.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:59:48 gibba015 bash[30343]: cephadm 2021-03-10T15:59:46.897951+0000 mgr.gibba045.orlgmj (mgr.34412) 6924 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:59:49.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:59:48 gibba015 bash[30343]: cephadm 2021-03-10T15:59:46.898976+0000 mgr.gibba045.orlgmj (mgr.34412) 6925 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:59:49.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:59:48 gibba015 bash[30343]: cephadm 2021-03-10T15:59:46.900416+0000 mgr.gibba045.orlgmj (mgr.34412) 6926 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:59:49.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:59:48 gibba015 bash[30343]: cephadm 2021-03-10T15:59:46.900529+0000 mgr.gibba045.orlgmj (mgr.34412) 6927 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:59:49.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:59:48 gibba015 bash[30343]: cephadm 2021-03-10T15:59:46.901718+0000 mgr.gibba045.orlgmj (mgr.34412) 6928 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:59:49.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:59:48 gibba015 bash[30343]: cephadm 2021-03-10T15:59:46.902029+0000 mgr.gibba045.orlgmj (mgr.34412) 6929 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:59:49.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:59:48 gibba015 bash[30343]: cephadm 2021-03-10T15:59:46.903075+0000 mgr.gibba045.orlgmj (mgr.34412) 6930 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:59:49.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:59:48 gibba015 bash[30343]: cephadm 2021-03-10T15:59:46.903112+0000 mgr.gibba045.orlgmj (mgr.34412) 6931 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:59:49.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:59:48 gibba015 bash[30343]: cephadm 2021-03-10T15:59:46.903215+0000 mgr.gibba045.orlgmj (mgr.34412) 6932 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T15:59:50.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:59:49 gibba045 bash[25517]: cluster 2021-03-10T15:59:48.660723+0000 mgr.gibba045.orlgmj (mgr.34412) 6933 : cluster [DBG] pgmap v3940: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:50.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:59:49 gibba015 bash[29377]: cluster 2021-03-10T15:59:48.660723+0000 mgr.gibba045.orlgmj (mgr.34412) 6933 : cluster [DBG] pgmap v3940: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:50.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:59:49 gibba015 bash[30343]: cluster 2021-03-10T15:59:48.660723+0000 mgr.gibba045.orlgmj (mgr.34412) 6933 : cluster [DBG] pgmap v3940: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:51.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:59:51 gibba015 bash[29377]: cluster 2021-03-10T15:59:50.662421+0000 mgr.gibba045.orlgmj (mgr.34412) 6934 : cluster [DBG] pgmap v3941: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:51.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:59:51 gibba015 bash[30343]: cluster 2021-03-10T15:59:50.662421+0000 mgr.gibba045.orlgmj (mgr.34412) 6934 : cluster [DBG] pgmap v3941: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:51.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:59:51 gibba045 bash[25517]: cluster 2021-03-10T15:59:50.662421+0000 mgr.gibba045.orlgmj (mgr.34412) 6934 : cluster [DBG] pgmap v3941: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:54.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:59:53 gibba045 bash[25517]: cluster 2021-03-10T15:59:52.663886+0000 mgr.gibba045.orlgmj (mgr.34412) 6935 : cluster [DBG] pgmap v3942: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:54.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:59:53 gibba045 bash[25517]: audit 2021-03-10T15:59:53.377949+0000 mon.c (mon.1) 1927 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:59:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:59:53 gibba045 bash[25517]: audit 2021-03-10T15:59:53.378592+0000 mon.c (mon.1) 1928 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:59:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:59:53 gibba045 bash[25517]: audit 2021-03-10T15:59:53.379080+0000 mon.a (mon.0) 1658 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:59:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:59:53 gibba045 bash[25517]: audit 2021-03-10T15:59:53.379230+0000 mon.c (mon.1) 1929 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T15:59:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:59:53 gibba045 bash[25517]: audit 2021-03-10T15:59:53.380077+0000 mon.c (mon.1) 1930 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:59:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:59:53 gibba045 bash[25517]: audit 2021-03-10T15:59:53.380123+0000 mon.a (mon.0) 1659 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:59:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:59:53 gibba045 bash[25517]: audit 2021-03-10T15:59:53.380705+0000 mon.c (mon.1) 1931 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:59:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:59:53 gibba045 bash[25517]: audit 2021-03-10T15:59:53.381270+0000 mon.a (mon.0) 1660 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T15:59:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:59:53 gibba045 bash[25517]: audit 2021-03-10T15:59:53.381514+0000 mon.c (mon.1) 1932 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:59:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:59:53 gibba045 bash[25517]: audit 2021-03-10T15:59:53.382321+0000 mon.a (mon.0) 1661 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:59:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:59:53 gibba045 bash[25517]: audit 2021-03-10T15:59:53.383371+0000 mon.a (mon.0) 1662 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:59:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:59:53 gibba045 bash[25517]: audit 2021-03-10T15:59:53.383849+0000 mon.a (mon.0) 1663 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:59:54.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:59:53 gibba015 bash[29377]: cluster 2021-03-10T15:59:52.663886+0000 mgr.gibba045.orlgmj (mgr.34412) 6935 : cluster [DBG] pgmap v3942: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:54.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:59:53 gibba015 bash[29377]: audit 2021-03-10T15:59:53.377949+0000 mon.c (mon.1) 1927 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:59:54.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:59:53 gibba015 bash[29377]: audit 2021-03-10T15:59:53.378592+0000 mon.c (mon.1) 1928 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:59:54.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:59:53 gibba015 bash[29377]: audit 2021-03-10T15:59:53.379080+0000 mon.a (mon.0) 1658 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:59:54.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:59:53 gibba015 bash[29377]: audit 2021-03-10T15:59:53.379230+0000 mon.c (mon.1) 1929 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T15:59:54.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:59:53 gibba015 bash[29377]: audit 2021-03-10T15:59:53.380077+0000 mon.c (mon.1) 1930 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:59:54.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:59:53 gibba015 bash[29377]: audit 2021-03-10T15:59:53.380123+0000 mon.a (mon.0) 1659 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:59:54.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:59:53 gibba015 bash[29377]: audit 2021-03-10T15:59:53.380705+0000 mon.c (mon.1) 1931 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:59:54.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:59:53 gibba015 bash[29377]: audit 2021-03-10T15:59:53.381270+0000 mon.a (mon.0) 1660 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T15:59:54.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:59:53 gibba015 bash[29377]: audit 2021-03-10T15:59:53.381514+0000 mon.c (mon.1) 1932 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:59:54.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:59:53 gibba015 bash[29377]: audit 2021-03-10T15:59:53.382321+0000 mon.a (mon.0) 1661 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:59:54.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:59:53 gibba015 bash[29377]: audit 2021-03-10T15:59:53.383371+0000 mon.a (mon.0) 1662 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:59:54.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:59:53 gibba015 bash[29377]: audit 2021-03-10T15:59:53.383849+0000 mon.a (mon.0) 1663 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:59:54.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:59:53 gibba015 bash[30343]: cluster 2021-03-10T15:59:52.663886+0000 mgr.gibba045.orlgmj (mgr.34412) 6935 : cluster [DBG] pgmap v3942: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:54.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:59:53 gibba015 bash[30343]: audit 2021-03-10T15:59:53.377949+0000 mon.c (mon.1) 1927 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:59:54.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:59:53 gibba015 bash[30343]: audit 2021-03-10T15:59:53.378592+0000 mon.c (mon.1) 1928 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:59:54.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:59:53 gibba015 bash[30343]: audit 2021-03-10T15:59:53.379080+0000 mon.a (mon.0) 1658 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:59:54.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:59:53 gibba015 bash[30343]: audit 2021-03-10T15:59:53.379230+0000 mon.c (mon.1) 1929 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T15:59:54.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:59:53 gibba015 bash[30343]: audit 2021-03-10T15:59:53.380077+0000 mon.c (mon.1) 1930 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:59:54.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:59:53 gibba015 bash[30343]: audit 2021-03-10T15:59:53.380123+0000 mon.a (mon.0) 1659 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T15:59:54.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:59:53 gibba015 bash[30343]: audit 2021-03-10T15:59:53.380705+0000 mon.c (mon.1) 1931 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:59:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:59:53 gibba015 bash[30343]: audit 2021-03-10T15:59:53.381270+0000 mon.a (mon.0) 1660 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T15:59:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:59:53 gibba015 bash[30343]: audit 2021-03-10T15:59:53.381514+0000 mon.c (mon.1) 1932 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:59:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:59:53 gibba015 bash[30343]: audit 2021-03-10T15:59:53.382321+0000 mon.a (mon.0) 1661 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:59:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:59:53 gibba015 bash[30343]: audit 2021-03-10T15:59:53.383371+0000 mon.a (mon.0) 1662 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:59:54.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:59:53 gibba015 bash[30343]: audit 2021-03-10T15:59:53.383849+0000 mon.a (mon.0) 1663 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:59:56.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:59:55 gibba045 bash[25517]: cluster 2021-03-10T15:59:54.664772+0000 mgr.gibba045.orlgmj (mgr.34412) 6936 : cluster [DBG] pgmap v3943: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:56.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:59:55 gibba015 bash[29377]: cluster 2021-03-10T15:59:54.664772+0000 mgr.gibba045.orlgmj (mgr.34412) 6936 : cluster [DBG] pgmap v3943: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:56.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:59:55 gibba015 bash[30343]: cluster 2021-03-10T15:59:54.664772+0000 mgr.gibba045.orlgmj (mgr.34412) 6936 : cluster [DBG] pgmap v3943: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:58.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:59:57 gibba045 bash[25517]: cluster 2021-03-10T15:59:56.666261+0000 mgr.gibba045.orlgmj (mgr.34412) 6937 : cluster [DBG] pgmap v3944: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:58.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:59:57 gibba015 bash[29377]: cluster 2021-03-10T15:59:56.666261+0000 mgr.gibba045.orlgmj (mgr.34412) 6937 : cluster [DBG] pgmap v3944: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:58.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:59:57 gibba015 bash[30343]: cluster 2021-03-10T15:59:56.666261+0000 mgr.gibba045.orlgmj (mgr.34412) 6937 : cluster [DBG] pgmap v3944: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:00.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 15:59:59 gibba045 bash[25517]: cluster 2021-03-10T15:59:58.667631+0000 mgr.gibba045.orlgmj (mgr.34412) 6938 : cluster [DBG] pgmap v3945: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:00.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 15:59:59 gibba015 bash[29377]: cluster 2021-03-10T15:59:58.667631+0000 mgr.gibba045.orlgmj (mgr.34412) 6938 : cluster [DBG] pgmap v3945: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:00.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:00:00 gibba015 bash[29377]: debug 2021-03-10T15:59:59.997+0000 7f21beb4f700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T16:00:00.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 15:59:59 gibba015 bash[30343]: cluster 2021-03-10T15:59:58.667631+0000 mgr.gibba045.orlgmj (mgr.34412) 6938 : cluster [DBG] pgmap v3945: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:01.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:00:00 gibba045 bash[25517]: cluster 2021-03-10T16:00:00.000244+0000 mon.a (mon.0) 1664 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T16:00:01.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:00:00 gibba015 bash[29377]: cluster 2021-03-10T16:00:00.000244+0000 mon.a (mon.0) 1664 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T16:00:01.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:00:00 gibba015 bash[30343]: cluster 2021-03-10T16:00:00.000244+0000 mon.a (mon.0) 1664 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T16:00:02.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:00:01 gibba045 bash[25517]: cluster 2021-03-10T16:00:00.669101+0000 mgr.gibba045.orlgmj (mgr.34412) 6939 : cluster [DBG] pgmap v3946: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:02.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:00:01 gibba015 bash[29377]: cluster 2021-03-10T16:00:00.669101+0000 mgr.gibba045.orlgmj (mgr.34412) 6939 : cluster [DBG] pgmap v3946: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:02.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:00:01 gibba015 bash[30343]: cluster 2021-03-10T16:00:00.669101+0000 mgr.gibba045.orlgmj (mgr.34412) 6939 : cluster [DBG] pgmap v3946: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:04.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:00:03 gibba045 bash[25517]: cephadm 2021-03-10T16:00:01.914277+0000 mgr.gibba045.orlgmj (mgr.34412) 6940 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:00:04.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:00:03 gibba045 bash[25517]: cluster 2021-03-10T16:00:02.670155+0000 mgr.gibba045.orlgmj (mgr.34412) 6941 : cluster [DBG] pgmap v3947: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:04.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:00:03 gibba015 bash[29377]: cephadm 2021-03-10T16:00:01.914277+0000 mgr.gibba045.orlgmj (mgr.34412) 6940 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:00:04.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:00:03 gibba015 bash[29377]: cluster 2021-03-10T16:00:02.670155+0000 mgr.gibba045.orlgmj (mgr.34412) 6941 : cluster [DBG] pgmap v3947: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:04.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:00:03 gibba015 bash[30343]: cephadm 2021-03-10T16:00:01.914277+0000 mgr.gibba045.orlgmj (mgr.34412) 6940 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:00:04.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:00:03 gibba015 bash[30343]: cluster 2021-03-10T16:00:02.670155+0000 mgr.gibba045.orlgmj (mgr.34412) 6941 : cluster [DBG] pgmap v3947: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:06.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:00:05 gibba045 bash[25517]: cluster 2021-03-10T16:00:04.671621+0000 mgr.gibba045.orlgmj (mgr.34412) 6942 : cluster [DBG] pgmap v3948: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:06.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:00:05 gibba015 bash[29377]: cluster 2021-03-10T16:00:04.671621+0000 mgr.gibba045.orlgmj (mgr.34412) 6942 : cluster [DBG] pgmap v3948: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:06.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:00:05 gibba015 bash[30343]: cluster 2021-03-10T16:00:04.671621+0000 mgr.gibba045.orlgmj (mgr.34412) 6942 : cluster [DBG] pgmap v3948: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:08.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:00:07 gibba045 bash[25517]: cluster 2021-03-10T16:00:06.673610+0000 mgr.gibba045.orlgmj (mgr.34412) 6943 : cluster [DBG] pgmap v3949: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:08.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:00:07 gibba015 bash[29377]: cluster 2021-03-10T16:00:06.673610+0000 mgr.gibba045.orlgmj (mgr.34412) 6943 : cluster [DBG] pgmap v3949: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:08.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:00:07 gibba015 bash[30343]: cluster 2021-03-10T16:00:06.673610+0000 mgr.gibba045.orlgmj (mgr.34412) 6943 : cluster [DBG] pgmap v3949: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:09.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:00:08 gibba015 bash[29377]: cluster 2021-03-10T16:00:08.674915+0000 mgr.gibba045.orlgmj (mgr.34412) 6944 : cluster [DBG] pgmap v3950: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:09.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:00:08 gibba015 bash[30343]: cluster 2021-03-10T16:00:08.674915+0000 mgr.gibba045.orlgmj (mgr.34412) 6944 : cluster [DBG] pgmap v3950: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:09.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:00:08 gibba045 bash[25517]: cluster 2021-03-10T16:00:08.674915+0000 mgr.gibba045.orlgmj (mgr.34412) 6944 : cluster [DBG] pgmap v3950: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:11.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:00:11 gibba015 bash[29377]: cluster 2021-03-10T16:00:10.676670+0000 mgr.gibba045.orlgmj (mgr.34412) 6945 : cluster [DBG] pgmap v3951: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:11.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:00:11 gibba015 bash[30343]: cluster 2021-03-10T16:00:10.676670+0000 mgr.gibba045.orlgmj (mgr.34412) 6945 : cluster [DBG] pgmap v3951: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:11.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:00:11 gibba045 bash[25517]: cluster 2021-03-10T16:00:10.676670+0000 mgr.gibba045.orlgmj (mgr.34412) 6945 : cluster [DBG] pgmap v3951: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:14.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:00:13 gibba045 bash[25517]: cluster 2021-03-10T16:00:12.677754+0000 mgr.gibba045.orlgmj (mgr.34412) 6946 : cluster [DBG] pgmap v3952: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:14.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:00:13 gibba015 bash[29377]: cluster 2021-03-10T16:00:12.677754+0000 mgr.gibba045.orlgmj (mgr.34412) 6946 : cluster [DBG] pgmap v3952: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:14.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:00:13 gibba015 bash[30343]: cluster 2021-03-10T16:00:12.677754+0000 mgr.gibba045.orlgmj (mgr.34412) 6946 : cluster [DBG] pgmap v3952: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:14.233 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:00:14.460 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:00:14.460 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 4m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:00:14.460 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 3m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:00:14.461 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:00:14.461 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:00:14.461 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:00:14.462 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:00:14.462 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:00:14.462 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:00:14.462 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 4m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:00:14.462 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 3m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:00:14.463 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:00:14.463 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:00:14.463 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:00:14.463 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:00:14.463 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:00:14.464 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:00:14.464 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:00:14.464 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:00:14.464 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 3m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:00:14.465 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 3m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:00:14.709 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:00:14.710 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:00:14.710 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:00:14.710 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:00:14.710 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:00:14.711 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:00:14.711 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:00:14.711 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:00:14.711 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:00:14.712 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:00:14.712 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:00:14.712 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:00:14.712 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:00:14.713 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:00:14.713 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:00:15.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:00:14 gibba045 bash[25517]: audit 2021-03-10T16:00:14.708486+0000 mon.a (mon.0) 1665 : audit [DBG] from='client.? 172.21.2.115:0/1905970629' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:00:15.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:00:14 gibba015 bash[29377]: audit 2021-03-10T16:00:14.708486+0000 mon.a (mon.0) 1665 : audit [DBG] from='client.? 172.21.2.115:0/1905970629' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:00:15.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:00:14 gibba015 bash[30343]: audit 2021-03-10T16:00:14.708486+0000 mon.a (mon.0) 1665 : audit [DBG] from='client.? 172.21.2.115:0/1905970629' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:00:16.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:00:15 gibba045 bash[25517]: audit 2021-03-10T16:00:14.225369+0000 mgr.gibba045.orlgmj (mgr.34412) 6947 : audit [DBG] from='client.58702 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:00:16.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:00:15 gibba045 bash[25517]: audit 2021-03-10T16:00:14.448563+0000 mgr.gibba045.orlgmj (mgr.34412) 6948 : audit [DBG] from='client.48720 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:00:16.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:00:15 gibba045 bash[25517]: cluster 2021-03-10T16:00:14.679329+0000 mgr.gibba045.orlgmj (mgr.34412) 6949 : cluster [DBG] pgmap v3953: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:16.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:00:15 gibba015 bash[29377]: audit 2021-03-10T16:00:14.225369+0000 mgr.gibba045.orlgmj (mgr.34412) 6947 : audit [DBG] from='client.58702 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:00:16.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:00:15 gibba015 bash[29377]: audit 2021-03-10T16:00:14.448563+0000 mgr.gibba045.orlgmj (mgr.34412) 6948 : audit [DBG] from='client.48720 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:00:16.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:00:15 gibba015 bash[29377]: cluster 2021-03-10T16:00:14.679329+0000 mgr.gibba045.orlgmj (mgr.34412) 6949 : cluster [DBG] pgmap v3953: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:16.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:00:15 gibba015 bash[30343]: audit 2021-03-10T16:00:14.225369+0000 mgr.gibba045.orlgmj (mgr.34412) 6947 : audit [DBG] from='client.58702 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:00:16.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:00:15 gibba015 bash[30343]: audit 2021-03-10T16:00:14.448563+0000 mgr.gibba045.orlgmj (mgr.34412) 6948 : audit [DBG] from='client.48720 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:00:16.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:00:15 gibba015 bash[30343]: cluster 2021-03-10T16:00:14.679329+0000 mgr.gibba045.orlgmj (mgr.34412) 6949 : cluster [DBG] pgmap v3953: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:18.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:00:17 gibba045 bash[25517]: cluster 2021-03-10T16:00:16.681180+0000 mgr.gibba045.orlgmj (mgr.34412) 6950 : cluster [DBG] pgmap v3954: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:18.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:00:17 gibba015 bash[29377]: cluster 2021-03-10T16:00:16.681180+0000 mgr.gibba045.orlgmj (mgr.34412) 6950 : cluster [DBG] pgmap v3954: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:18.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:00:17 gibba015 bash[30343]: cluster 2021-03-10T16:00:16.681180+0000 mgr.gibba045.orlgmj (mgr.34412) 6950 : cluster [DBG] pgmap v3954: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:19.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:00:18 gibba045 bash[25517]: cephadm 2021-03-10T16:00:16.930373+0000 mgr.gibba045.orlgmj (mgr.34412) 6951 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:00:19.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:00:18 gibba015 bash[29377]: cephadm 2021-03-10T16:00:16.930373+0000 mgr.gibba045.orlgmj (mgr.34412) 6951 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:00:19.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:00:18 gibba015 bash[30343]: cephadm 2021-03-10T16:00:16.930373+0000 mgr.gibba045.orlgmj (mgr.34412) 6951 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:00:20.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:00:19 gibba045 bash[25517]: cluster 2021-03-10T16:00:18.682546+0000 mgr.gibba045.orlgmj (mgr.34412) 6952 : cluster [DBG] pgmap v3955: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:20.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:00:19 gibba015 bash[30343]: cluster 2021-03-10T16:00:18.682546+0000 mgr.gibba045.orlgmj (mgr.34412) 6952 : cluster [DBG] pgmap v3955: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:20.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:00:19 gibba015 bash[29377]: cluster 2021-03-10T16:00:18.682546+0000 mgr.gibba045.orlgmj (mgr.34412) 6952 : cluster [DBG] pgmap v3955: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:21.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:00:21 gibba015 bash[29377]: cluster 2021-03-10T16:00:20.684154+0000 mgr.gibba045.orlgmj (mgr.34412) 6953 : cluster [DBG] pgmap v3956: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:21.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:00:21 gibba015 bash[30343]: cluster 2021-03-10T16:00:20.684154+0000 mgr.gibba045.orlgmj (mgr.34412) 6953 : cluster [DBG] pgmap v3956: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:21.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:00:21 gibba045 bash[25517]: cluster 2021-03-10T16:00:20.684154+0000 mgr.gibba045.orlgmj (mgr.34412) 6953 : cluster [DBG] pgmap v3956: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:24.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:00:23 gibba045 bash[25517]: cluster 2021-03-10T16:00:22.685458+0000 mgr.gibba045.orlgmj (mgr.34412) 6954 : cluster [DBG] pgmap v3957: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:24.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:00:23 gibba015 bash[29377]: cluster 2021-03-10T16:00:22.685458+0000 mgr.gibba045.orlgmj (mgr.34412) 6954 : cluster [DBG] pgmap v3957: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:24.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:00:23 gibba015 bash[30343]: cluster 2021-03-10T16:00:22.685458+0000 mgr.gibba045.orlgmj (mgr.34412) 6954 : cluster [DBG] pgmap v3957: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:26.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:00:25 gibba045 bash[25517]: cluster 2021-03-10T16:00:24.686302+0000 mgr.gibba045.orlgmj (mgr.34412) 6955 : cluster [DBG] pgmap v3958: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:26.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:00:25 gibba015 bash[29377]: cluster 2021-03-10T16:00:24.686302+0000 mgr.gibba045.orlgmj (mgr.34412) 6955 : cluster [DBG] pgmap v3958: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:26.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:00:25 gibba015 bash[30343]: cluster 2021-03-10T16:00:24.686302+0000 mgr.gibba045.orlgmj (mgr.34412) 6955 : cluster [DBG] pgmap v3958: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:28.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:00:27 gibba045 bash[25517]: cluster 2021-03-10T16:00:26.687964+0000 mgr.gibba045.orlgmj (mgr.34412) 6956 : cluster [DBG] pgmap v3959: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:28.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:00:27 gibba015 bash[29377]: cluster 2021-03-10T16:00:26.687964+0000 mgr.gibba045.orlgmj (mgr.34412) 6956 : cluster [DBG] pgmap v3959: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:28.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:00:27 gibba015 bash[30343]: cluster 2021-03-10T16:00:26.687964+0000 mgr.gibba045.orlgmj (mgr.34412) 6956 : cluster [DBG] pgmap v3959: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:30.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:00:29 gibba045 bash[25517]: cluster 2021-03-10T16:00:28.689271+0000 mgr.gibba045.orlgmj (mgr.34412) 6957 : cluster [DBG] pgmap v3960: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:30.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:00:29 gibba015 bash[29377]: cluster 2021-03-10T16:00:28.689271+0000 mgr.gibba045.orlgmj (mgr.34412) 6957 : cluster [DBG] pgmap v3960: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:30.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:00:29 gibba015 bash[30343]: cluster 2021-03-10T16:00:28.689271+0000 mgr.gibba045.orlgmj (mgr.34412) 6957 : cluster [DBG] pgmap v3960: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:31.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:00:31 gibba045 bash[25517]: cluster 2021-03-10T16:00:30.690746+0000 mgr.gibba045.orlgmj (mgr.34412) 6958 : cluster [DBG] pgmap v3961: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:31.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:00:31 gibba015 bash[29377]: cluster 2021-03-10T16:00:30.690746+0000 mgr.gibba045.orlgmj (mgr.34412) 6958 : cluster [DBG] pgmap v3961: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:31.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:00:31 gibba015 bash[30343]: cluster 2021-03-10T16:00:30.690746+0000 mgr.gibba045.orlgmj (mgr.34412) 6958 : cluster [DBG] pgmap v3961: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:34.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:00:33 gibba045 bash[25517]: cephadm 2021-03-10T16:00:31.941177+0000 mgr.gibba045.orlgmj (mgr.34412) 6959 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:00:34.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:00:33 gibba045 bash[25517]: cluster 2021-03-10T16:00:32.692209+0000 mgr.gibba045.orlgmj (mgr.34412) 6960 : cluster [DBG] pgmap v3962: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:34.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:00:33 gibba015 bash[29377]: cephadm 2021-03-10T16:00:31.941177+0000 mgr.gibba045.orlgmj (mgr.34412) 6959 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:00:34.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:00:33 gibba015 bash[29377]: cluster 2021-03-10T16:00:32.692209+0000 mgr.gibba045.orlgmj (mgr.34412) 6960 : cluster [DBG] pgmap v3962: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:34.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:00:33 gibba015 bash[30343]: cephadm 2021-03-10T16:00:31.941177+0000 mgr.gibba045.orlgmj (mgr.34412) 6959 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:00:34.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:00:33 gibba015 bash[30343]: cluster 2021-03-10T16:00:32.692209+0000 mgr.gibba045.orlgmj (mgr.34412) 6960 : cluster [DBG] pgmap v3962: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:36.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:00:35 gibba045 bash[25517]: cluster 2021-03-10T16:00:34.693674+0000 mgr.gibba045.orlgmj (mgr.34412) 6961 : cluster [DBG] pgmap v3963: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:36.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:00:35 gibba015 bash[29377]: cluster 2021-03-10T16:00:34.693674+0000 mgr.gibba045.orlgmj (mgr.34412) 6961 : cluster [DBG] pgmap v3963: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:36.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:00:35 gibba015 bash[30343]: cluster 2021-03-10T16:00:34.693674+0000 mgr.gibba045.orlgmj (mgr.34412) 6961 : cluster [DBG] pgmap v3963: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:38.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:00:37 gibba045 bash[25517]: cluster 2021-03-10T16:00:36.695357+0000 mgr.gibba045.orlgmj (mgr.34412) 6962 : cluster [DBG] pgmap v3964: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:38.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:00:37 gibba015 bash[29377]: cluster 2021-03-10T16:00:36.695357+0000 mgr.gibba045.orlgmj (mgr.34412) 6962 : cluster [DBG] pgmap v3964: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:38.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:00:37 gibba015 bash[30343]: cluster 2021-03-10T16:00:36.695357+0000 mgr.gibba045.orlgmj (mgr.34412) 6962 : cluster [DBG] pgmap v3964: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:40.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:00:39 gibba045 bash[25517]: cluster 2021-03-10T16:00:38.696700+0000 mgr.gibba045.orlgmj (mgr.34412) 6963 : cluster [DBG] pgmap v3965: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:40.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:00:39 gibba015 bash[29377]: cluster 2021-03-10T16:00:38.696700+0000 mgr.gibba045.orlgmj (mgr.34412) 6963 : cluster [DBG] pgmap v3965: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:40.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:00:39 gibba015 bash[30343]: cluster 2021-03-10T16:00:38.696700+0000 mgr.gibba045.orlgmj (mgr.34412) 6963 : cluster [DBG] pgmap v3965: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:41.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:00:41 gibba045 bash[25517]: cluster 2021-03-10T16:00:40.698248+0000 mgr.gibba045.orlgmj (mgr.34412) 6964 : cluster [DBG] pgmap v3966: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:41.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:00:41 gibba015 bash[29377]: cluster 2021-03-10T16:00:40.698248+0000 mgr.gibba045.orlgmj (mgr.34412) 6964 : cluster [DBG] pgmap v3966: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:41.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:00:41 gibba015 bash[30343]: cluster 2021-03-10T16:00:40.698248+0000 mgr.gibba045.orlgmj (mgr.34412) 6964 : cluster [DBG] pgmap v3966: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:44.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:00:43 gibba045 bash[25517]: cluster 2021-03-10T16:00:42.699777+0000 mgr.gibba045.orlgmj (mgr.34412) 6965 : cluster [DBG] pgmap v3967: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:44.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:00:43 gibba015 bash[29377]: cluster 2021-03-10T16:00:42.699777+0000 mgr.gibba045.orlgmj (mgr.34412) 6965 : cluster [DBG] pgmap v3967: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:44.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:00:43 gibba015 bash[30343]: cluster 2021-03-10T16:00:42.699777+0000 mgr.gibba045.orlgmj (mgr.34412) 6965 : cluster [DBG] pgmap v3967: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:44.952 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:00:45.177 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:00:45.177 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 5m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:00:45.178 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 3m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:00:45.178 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:00:45.178 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:00:45.178 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:00:45.178 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:00:45.179 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:00:45.179 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:00:45.179 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 5m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:00:45.179 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 3m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:00:45.180 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:00:45.180 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:00:45.180 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:00:45.180 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:00:45.181 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:00:45.181 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:00:45.181 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:00:45.181 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:00:45.181 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 3m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:00:45.182 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 3m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:00:45.424 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:00:45.424 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:00:45.425 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:00:45.425 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:00:45.425 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:00:45.425 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:00:45.426 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:00:45.426 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:00:45.426 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:00:45.426 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:00:45.426 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:00:45.427 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:00:45.427 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:00:45.427 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:00:45.427 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:00:46.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:00:45 gibba045 bash[25517]: cluster 2021-03-10T16:00:44.701328+0000 mgr.gibba045.orlgmj (mgr.34412) 6966 : cluster [DBG] pgmap v3968: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:46.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:00:45 gibba045 bash[25517]: audit 2021-03-10T16:00:45.422962+0000 mon.a (mon.0) 1666 : audit [DBG] from='client.? 172.21.2.115:0/2995582731' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:00:46.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:00:45 gibba015 bash[29377]: cluster 2021-03-10T16:00:44.701328+0000 mgr.gibba045.orlgmj (mgr.34412) 6966 : cluster [DBG] pgmap v3968: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:46.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:00:45 gibba015 bash[29377]: audit 2021-03-10T16:00:45.422962+0000 mon.a (mon.0) 1666 : audit [DBG] from='client.? 172.21.2.115:0/2995582731' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:00:46.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:00:45 gibba015 bash[30343]: cluster 2021-03-10T16:00:44.701328+0000 mgr.gibba045.orlgmj (mgr.34412) 6966 : cluster [DBG] pgmap v3968: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:46.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:00:45 gibba015 bash[30343]: audit 2021-03-10T16:00:45.422962+0000 mon.a (mon.0) 1666 : audit [DBG] from='client.? 172.21.2.115:0/2995582731' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:00:47.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:00:46 gibba045 bash[25517]: audit 2021-03-10T16:00:44.945258+0000 mgr.gibba045.orlgmj (mgr.34412) 6967 : audit [DBG] from='client.58720 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:00:47.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:00:46 gibba045 bash[25517]: audit 2021-03-10T16:00:45.168673+0000 mgr.gibba045.orlgmj (mgr.34412) 6968 : audit [DBG] from='client.58726 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:00:47.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:00:46 gibba015 bash[29377]: audit 2021-03-10T16:00:44.945258+0000 mgr.gibba045.orlgmj (mgr.34412) 6967 : audit [DBG] from='client.58720 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:00:47.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:00:46 gibba015 bash[29377]: audit 2021-03-10T16:00:45.168673+0000 mgr.gibba045.orlgmj (mgr.34412) 6968 : audit [DBG] from='client.58726 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:00:47.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:00:46 gibba015 bash[30343]: audit 2021-03-10T16:00:44.945258+0000 mgr.gibba045.orlgmj (mgr.34412) 6967 : audit [DBG] from='client.58720 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:00:47.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:00:46 gibba015 bash[30343]: audit 2021-03-10T16:00:45.168673+0000 mgr.gibba045.orlgmj (mgr.34412) 6968 : audit [DBG] from='client.58726 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:00:48.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:00:47 gibba045 bash[25517]: cluster 2021-03-10T16:00:46.703157+0000 mgr.gibba045.orlgmj (mgr.34412) 6969 : cluster [DBG] pgmap v3969: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:48.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:00:47 gibba045 bash[25517]: audit 2021-03-10T16:00:46.955715+0000 mon.c (mon.1) 1933 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:00:48.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:00:47 gibba045 bash[25517]: audit 2021-03-10T16:00:47.189643+0000 mon.a (mon.0) 1667 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:00:48.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:00:47 gibba045 bash[25517]: audit 2021-03-10T16:00:47.193318+0000 mon.c (mon.1) 1934 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:00:48.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:00:47 gibba045 bash[25517]: audit 2021-03-10T16:00:47.194890+0000 mon.c (mon.1) 1935 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:00:48.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:00:47 gibba045 bash[25517]: audit 2021-03-10T16:00:47.196496+0000 mon.c (mon.1) 1936 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:00:48.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:00:47 gibba045 bash[25517]: audit 2021-03-10T16:00:47.197933+0000 mon.c (mon.1) 1937 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:00:48.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:00:47 gibba045 bash[25517]: audit 2021-03-10T16:00:47.201381+0000 mon.c (mon.1) 1938 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:00:48.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:00:47 gibba045 bash[25517]: audit 2021-03-10T16:00:47.202988+0000 mon.c (mon.1) 1939 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:00:48.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:00:47 gibba015 bash[29377]: cluster 2021-03-10T16:00:46.703157+0000 mgr.gibba045.orlgmj (mgr.34412) 6969 : cluster [DBG] pgmap v3969: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:48.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:00:47 gibba015 bash[29377]: audit 2021-03-10T16:00:46.955715+0000 mon.c (mon.1) 1933 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:00:48.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:00:47 gibba015 bash[29377]: audit 2021-03-10T16:00:47.189643+0000 mon.a (mon.0) 1667 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:00:48.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:00:47 gibba015 bash[29377]: audit 2021-03-10T16:00:47.193318+0000 mon.c (mon.1) 1934 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:00:48.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:00:47 gibba015 bash[29377]: audit 2021-03-10T16:00:47.194890+0000 mon.c (mon.1) 1935 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:00:48.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:00:47 gibba015 bash[29377]: audit 2021-03-10T16:00:47.196496+0000 mon.c (mon.1) 1936 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:00:48.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:00:47 gibba015 bash[29377]: audit 2021-03-10T16:00:47.197933+0000 mon.c (mon.1) 1937 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:00:48.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:00:47 gibba015 bash[29377]: audit 2021-03-10T16:00:47.201381+0000 mon.c (mon.1) 1938 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:00:48.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:00:47 gibba015 bash[29377]: audit 2021-03-10T16:00:47.202988+0000 mon.c (mon.1) 1939 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:00:48.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:00:47 gibba015 bash[30343]: cluster 2021-03-10T16:00:46.703157+0000 mgr.gibba045.orlgmj (mgr.34412) 6969 : cluster [DBG] pgmap v3969: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:48.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:00:47 gibba015 bash[30343]: audit 2021-03-10T16:00:46.955715+0000 mon.c (mon.1) 1933 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:00:48.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:00:47 gibba015 bash[30343]: audit 2021-03-10T16:00:47.189643+0000 mon.a (mon.0) 1667 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:00:48.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:00:47 gibba015 bash[30343]: audit 2021-03-10T16:00:47.193318+0000 mon.c (mon.1) 1934 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:00:48.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:00:47 gibba015 bash[30343]: audit 2021-03-10T16:00:47.194890+0000 mon.c (mon.1) 1935 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:00:48.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:00:47 gibba015 bash[30343]: audit 2021-03-10T16:00:47.196496+0000 mon.c (mon.1) 1936 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:00:48.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:00:47 gibba015 bash[30343]: audit 2021-03-10T16:00:47.197933+0000 mon.c (mon.1) 1937 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:00:48.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:00:47 gibba015 bash[30343]: audit 2021-03-10T16:00:47.201381+0000 mon.c (mon.1) 1938 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:00:48.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:00:47 gibba015 bash[30343]: audit 2021-03-10T16:00:47.202988+0000 mon.c (mon.1) 1939 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:00:49.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:00:48 gibba045 bash[25517]: cephadm 2021-03-10T16:00:46.963633+0000 mgr.gibba045.orlgmj (mgr.34412) 6970 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:00:49.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:00:48 gibba045 bash[25517]: cephadm 2021-03-10T16:00:46.965468+0000 mgr.gibba045.orlgmj (mgr.34412) 6971 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:00:49.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:00:48 gibba045 bash[25517]: cephadm 2021-03-10T16:00:47.195050+0000 mgr.gibba045.orlgmj (mgr.34412) 6972 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:00:49.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:00:48 gibba045 bash[25517]: cephadm 2021-03-10T16:00:47.196867+0000 mgr.gibba045.orlgmj (mgr.34412) 6973 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:00:49.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:00:48 gibba045 bash[25517]: cephadm 2021-03-10T16:00:47.198433+0000 mgr.gibba045.orlgmj (mgr.34412) 6974 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:00:49.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:00:48 gibba045 bash[25517]: cephadm 2021-03-10T16:00:47.198470+0000 mgr.gibba045.orlgmj (mgr.34412) 6975 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:00:49.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:00:48 gibba045 bash[25517]: cephadm 2021-03-10T16:00:47.199794+0000 mgr.gibba045.orlgmj (mgr.34412) 6976 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:00:49.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:00:48 gibba045 bash[25517]: cephadm 2021-03-10T16:00:47.199831+0000 mgr.gibba045.orlgmj (mgr.34412) 6977 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:00:49.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:00:48 gibba045 bash[25517]: cephadm 2021-03-10T16:00:47.201416+0000 mgr.gibba045.orlgmj (mgr.34412) 6978 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:00:49.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:00:48 gibba045 bash[25517]: cephadm 2021-03-10T16:00:47.203239+0000 mgr.gibba045.orlgmj (mgr.34412) 6979 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:00:49.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:00:48 gibba045 bash[25517]: cephadm 2021-03-10T16:00:47.203276+0000 mgr.gibba045.orlgmj (mgr.34412) 6980 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:00:49.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:00:48 gibba045 bash[25517]: cephadm 2021-03-10T16:00:47.204753+0000 mgr.gibba045.orlgmj (mgr.34412) 6981 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:00:49.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:00:48 gibba045 bash[25517]: cephadm 2021-03-10T16:00:47.205067+0000 mgr.gibba045.orlgmj (mgr.34412) 6982 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:00:49.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:00:48 gibba045 bash[25517]: cephadm 2021-03-10T16:00:47.206319+0000 mgr.gibba045.orlgmj (mgr.34412) 6983 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:00:49.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:00:48 gibba045 bash[25517]: cephadm 2021-03-10T16:00:47.206357+0000 mgr.gibba045.orlgmj (mgr.34412) 6984 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:00:49.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:00:48 gibba045 bash[25517]: cephadm 2021-03-10T16:00:47.206461+0000 mgr.gibba045.orlgmj (mgr.34412) 6985 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:00:49.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:00:48 gibba015 bash[29377]: cephadm 2021-03-10T16:00:46.963633+0000 mgr.gibba045.orlgmj (mgr.34412) 6970 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:00:49.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:00:48 gibba015 bash[29377]: cephadm 2021-03-10T16:00:46.965468+0000 mgr.gibba045.orlgmj (mgr.34412) 6971 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:00:49.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:00:48 gibba015 bash[29377]: cephadm 2021-03-10T16:00:47.195050+0000 mgr.gibba045.orlgmj (mgr.34412) 6972 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:00:49.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:00:48 gibba015 bash[29377]: cephadm 2021-03-10T16:00:47.196867+0000 mgr.gibba045.orlgmj (mgr.34412) 6973 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:00:49.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:00:48 gibba015 bash[29377]: cephadm 2021-03-10T16:00:47.198433+0000 mgr.gibba045.orlgmj (mgr.34412) 6974 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:00:49.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:00:48 gibba015 bash[29377]: cephadm 2021-03-10T16:00:47.198470+0000 mgr.gibba045.orlgmj (mgr.34412) 6975 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:00:49.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:00:48 gibba015 bash[29377]: cephadm 2021-03-10T16:00:47.199794+0000 mgr.gibba045.orlgmj (mgr.34412) 6976 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:00:49.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:00:48 gibba015 bash[29377]: cephadm 2021-03-10T16:00:47.199831+0000 mgr.gibba045.orlgmj (mgr.34412) 6977 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:00:49.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:00:48 gibba015 bash[29377]: cephadm 2021-03-10T16:00:47.201416+0000 mgr.gibba045.orlgmj (mgr.34412) 6978 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:00:49.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:00:48 gibba015 bash[29377]: cephadm 2021-03-10T16:00:47.203239+0000 mgr.gibba045.orlgmj (mgr.34412) 6979 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:00:49.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:00:48 gibba015 bash[29377]: cephadm 2021-03-10T16:00:47.203276+0000 mgr.gibba045.orlgmj (mgr.34412) 6980 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:00:49.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:00:48 gibba015 bash[29377]: cephadm 2021-03-10T16:00:47.204753+0000 mgr.gibba045.orlgmj (mgr.34412) 6981 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:00:49.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:00:48 gibba015 bash[29377]: cephadm 2021-03-10T16:00:47.205067+0000 mgr.gibba045.orlgmj (mgr.34412) 6982 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:00:49.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:00:48 gibba015 bash[29377]: cephadm 2021-03-10T16:00:47.206319+0000 mgr.gibba045.orlgmj (mgr.34412) 6983 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:00:49.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:00:48 gibba015 bash[29377]: cephadm 2021-03-10T16:00:47.206357+0000 mgr.gibba045.orlgmj (mgr.34412) 6984 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:00:49.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:00:48 gibba015 bash[29377]: cephadm 2021-03-10T16:00:47.206461+0000 mgr.gibba045.orlgmj (mgr.34412) 6985 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:00:49.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:00:48 gibba015 bash[30343]: cephadm 2021-03-10T16:00:46.963633+0000 mgr.gibba045.orlgmj (mgr.34412) 6970 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:00:49.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:00:48 gibba015 bash[30343]: cephadm 2021-03-10T16:00:46.965468+0000 mgr.gibba045.orlgmj (mgr.34412) 6971 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:00:49.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:00:48 gibba015 bash[30343]: cephadm 2021-03-10T16:00:47.195050+0000 mgr.gibba045.orlgmj (mgr.34412) 6972 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:00:49.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:00:48 gibba015 bash[30343]: cephadm 2021-03-10T16:00:47.196867+0000 mgr.gibba045.orlgmj (mgr.34412) 6973 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:00:49.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:00:48 gibba015 bash[30343]: cephadm 2021-03-10T16:00:47.198433+0000 mgr.gibba045.orlgmj (mgr.34412) 6974 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:00:49.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:00:48 gibba015 bash[30343]: cephadm 2021-03-10T16:00:47.198470+0000 mgr.gibba045.orlgmj (mgr.34412) 6975 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:00:49.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:00:48 gibba015 bash[30343]: cephadm 2021-03-10T16:00:47.199794+0000 mgr.gibba045.orlgmj (mgr.34412) 6976 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:00:49.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:00:48 gibba015 bash[30343]: cephadm 2021-03-10T16:00:47.199831+0000 mgr.gibba045.orlgmj (mgr.34412) 6977 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:00:49.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:00:48 gibba015 bash[30343]: cephadm 2021-03-10T16:00:47.201416+0000 mgr.gibba045.orlgmj (mgr.34412) 6978 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:00:49.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:00:48 gibba015 bash[30343]: cephadm 2021-03-10T16:00:47.203239+0000 mgr.gibba045.orlgmj (mgr.34412) 6979 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:00:49.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:00:48 gibba015 bash[30343]: cephadm 2021-03-10T16:00:47.203276+0000 mgr.gibba045.orlgmj (mgr.34412) 6980 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:00:49.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:00:48 gibba015 bash[30343]: cephadm 2021-03-10T16:00:47.204753+0000 mgr.gibba045.orlgmj (mgr.34412) 6981 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:00:49.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:00:48 gibba015 bash[30343]: cephadm 2021-03-10T16:00:47.205067+0000 mgr.gibba045.orlgmj (mgr.34412) 6982 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:00:49.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:00:48 gibba015 bash[30343]: cephadm 2021-03-10T16:00:47.206319+0000 mgr.gibba045.orlgmj (mgr.34412) 6983 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:00:49.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:00:48 gibba015 bash[30343]: cephadm 2021-03-10T16:00:47.206357+0000 mgr.gibba045.orlgmj (mgr.34412) 6984 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:00:49.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:00:48 gibba015 bash[30343]: cephadm 2021-03-10T16:00:47.206461+0000 mgr.gibba045.orlgmj (mgr.34412) 6985 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:00:50.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:00:49 gibba015 bash[29377]: cluster 2021-03-10T16:00:48.704528+0000 mgr.gibba045.orlgmj (mgr.34412) 6986 : cluster [DBG] pgmap v3970: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:50.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:00:49 gibba015 bash[30343]: cluster 2021-03-10T16:00:48.704528+0000 mgr.gibba045.orlgmj (mgr.34412) 6986 : cluster [DBG] pgmap v3970: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:50.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:00:49 gibba045 bash[25517]: cluster 2021-03-10T16:00:48.704528+0000 mgr.gibba045.orlgmj (mgr.34412) 6986 : cluster [DBG] pgmap v3970: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:51.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:00:51 gibba045 bash[25517]: cluster 2021-03-10T16:00:50.705981+0000 mgr.gibba045.orlgmj (mgr.34412) 6987 : cluster [DBG] pgmap v3971: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:51.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:00:51 gibba015 bash[29377]: cluster 2021-03-10T16:00:50.705981+0000 mgr.gibba045.orlgmj (mgr.34412) 6987 : cluster [DBG] pgmap v3971: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:51.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:00:51 gibba015 bash[30343]: cluster 2021-03-10T16:00:50.705981+0000 mgr.gibba045.orlgmj (mgr.34412) 6987 : cluster [DBG] pgmap v3971: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:54.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:00:53 gibba045 bash[25517]: cluster 2021-03-10T16:00:52.707632+0000 mgr.gibba045.orlgmj (mgr.34412) 6988 : cluster [DBG] pgmap v3972: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:54.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:00:53 gibba045 bash[25517]: audit 2021-03-10T16:00:53.385403+0000 mon.c (mon.1) 1940 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:00:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:00:53 gibba045 bash[25517]: audit 2021-03-10T16:00:53.386064+0000 mon.c (mon.1) 1941 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:00:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:00:53 gibba045 bash[25517]: audit 2021-03-10T16:00:53.386608+0000 mon.a (mon.0) 1668 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:00:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:00:53 gibba045 bash[25517]: audit 2021-03-10T16:00:53.386630+0000 mon.c (mon.1) 1942 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T16:00:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:00:53 gibba045 bash[25517]: audit 2021-03-10T16:00:53.387339+0000 mon.c (mon.1) 1943 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:00:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:00:53 gibba045 bash[25517]: audit 2021-03-10T16:00:53.388020+0000 mon.a (mon.0) 1669 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:00:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:00:53 gibba045 bash[25517]: audit 2021-03-10T16:00:53.388113+0000 mon.c (mon.1) 1944 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:00:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:00:53 gibba045 bash[25517]: audit 2021-03-10T16:00:53.388975+0000 mon.c (mon.1) 1945 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-03-10T16:00:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:00:53 gibba045 bash[25517]: audit 2021-03-10T16:00:53.389171+0000 mon.a (mon.0) 1670 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T16:00:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:00:53 gibba045 bash[25517]: audit 2021-03-10T16:00:53.390492+0000 mon.a (mon.0) 1671 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:00:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:00:53 gibba045 bash[25517]: audit 2021-03-10T16:00:53.391257+0000 mon.a (mon.0) 1672 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:00:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:00:53 gibba045 bash[25517]: audit 2021-03-10T16:00:53.391448+0000 mon.a (mon.0) 1673 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-03-10T16:00:54.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:00:53 gibba015 bash[29377]: cluster 2021-03-10T16:00:52.707632+0000 mgr.gibba045.orlgmj (mgr.34412) 6988 : cluster [DBG] pgmap v3972: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:54.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:00:53 gibba015 bash[29377]: audit 2021-03-10T16:00:53.385403+0000 mon.c (mon.1) 1940 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:00:54.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:00:53 gibba015 bash[29377]: audit 2021-03-10T16:00:53.386064+0000 mon.c (mon.1) 1941 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:00:54.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:00:53 gibba015 bash[29377]: audit 2021-03-10T16:00:53.386608+0000 mon.a (mon.0) 1668 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:00:54.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:00:53 gibba015 bash[29377]: audit 2021-03-10T16:00:53.386630+0000 mon.c (mon.1) 1942 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T16:00:54.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:00:53 gibba015 bash[29377]: audit 2021-03-10T16:00:53.387339+0000 mon.c (mon.1) 1943 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:00:54.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:00:53 gibba015 bash[29377]: audit 2021-03-10T16:00:53.388020+0000 mon.a (mon.0) 1669 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:00:54.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:00:53 gibba015 bash[29377]: audit 2021-03-10T16:00:53.388113+0000 mon.c (mon.1) 1944 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:00:54.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:00:53 gibba015 bash[29377]: audit 2021-03-10T16:00:53.388975+0000 mon.c (mon.1) 1945 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-03-10T16:00:54.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:00:53 gibba015 bash[29377]: audit 2021-03-10T16:00:53.389171+0000 mon.a (mon.0) 1670 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T16:00:54.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:00:53 gibba015 bash[29377]: audit 2021-03-10T16:00:53.390492+0000 mon.a (mon.0) 1671 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:00:54.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:00:53 gibba015 bash[29377]: audit 2021-03-10T16:00:53.391257+0000 mon.a (mon.0) 1672 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:00:54.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:00:53 gibba015 bash[29377]: audit 2021-03-10T16:00:53.391448+0000 mon.a (mon.0) 1673 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-03-10T16:00:54.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:00:53 gibba015 bash[30343]: cluster 2021-03-10T16:00:52.707632+0000 mgr.gibba045.orlgmj (mgr.34412) 6988 : cluster [DBG] pgmap v3972: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:54.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:00:53 gibba015 bash[30343]: audit 2021-03-10T16:00:53.385403+0000 mon.c (mon.1) 1940 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:00:54.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:00:53 gibba015 bash[30343]: audit 2021-03-10T16:00:53.386064+0000 mon.c (mon.1) 1941 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:00:54.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:00:53 gibba015 bash[30343]: audit 2021-03-10T16:00:53.386608+0000 mon.a (mon.0) 1668 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:00:54.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:00:53 gibba015 bash[30343]: audit 2021-03-10T16:00:53.386630+0000 mon.c (mon.1) 1942 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T16:00:54.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:00:53 gibba015 bash[30343]: audit 2021-03-10T16:00:53.387339+0000 mon.c (mon.1) 1943 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:00:54.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:00:53 gibba015 bash[30343]: audit 2021-03-10T16:00:53.388020+0000 mon.a (mon.0) 1669 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:00:54.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:00:53 gibba015 bash[30343]: audit 2021-03-10T16:00:53.388113+0000 mon.c (mon.1) 1944 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:00:54.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:00:53 gibba015 bash[30343]: audit 2021-03-10T16:00:53.388975+0000 mon.c (mon.1) 1945 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-03-10T16:00:54.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:00:53 gibba015 bash[30343]: audit 2021-03-10T16:00:53.389171+0000 mon.a (mon.0) 1670 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T16:00:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:00:53 gibba015 bash[30343]: audit 2021-03-10T16:00:53.390492+0000 mon.a (mon.0) 1671 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:00:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:00:53 gibba015 bash[30343]: audit 2021-03-10T16:00:53.391257+0000 mon.a (mon.0) 1672 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:00:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:00:53 gibba015 bash[30343]: audit 2021-03-10T16:00:53.391448+0000 mon.a (mon.0) 1673 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-03-10T16:00:56.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:00:55 gibba045 bash[25517]: cluster 2021-03-10T16:00:54.708780+0000 mgr.gibba045.orlgmj (mgr.34412) 6989 : cluster [DBG] pgmap v3973: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:56.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:00:55 gibba015 bash[29377]: cluster 2021-03-10T16:00:54.708780+0000 mgr.gibba045.orlgmj (mgr.34412) 6989 : cluster [DBG] pgmap v3973: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:56.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:00:55 gibba015 bash[30343]: cluster 2021-03-10T16:00:54.708780+0000 mgr.gibba045.orlgmj (mgr.34412) 6989 : cluster [DBG] pgmap v3973: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:58.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:00:57 gibba045 bash[25517]: cluster 2021-03-10T16:00:56.709807+0000 mgr.gibba045.orlgmj (mgr.34412) 6990 : cluster [DBG] pgmap v3974: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:58.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:00:57 gibba015 bash[29377]: cluster 2021-03-10T16:00:56.709807+0000 mgr.gibba045.orlgmj (mgr.34412) 6990 : cluster [DBG] pgmap v3974: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:58.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:00:57 gibba015 bash[30343]: cluster 2021-03-10T16:00:56.709807+0000 mgr.gibba045.orlgmj (mgr.34412) 6990 : cluster [DBG] pgmap v3974: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:00.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:00:59 gibba045 bash[25517]: cluster 2021-03-10T16:00:58.711031+0000 mgr.gibba045.orlgmj (mgr.34412) 6991 : cluster [DBG] pgmap v3975: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:00.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:00:59 gibba015 bash[29377]: cluster 2021-03-10T16:00:58.711031+0000 mgr.gibba045.orlgmj (mgr.34412) 6991 : cluster [DBG] pgmap v3975: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:00.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:00:59 gibba015 bash[30343]: cluster 2021-03-10T16:00:58.711031+0000 mgr.gibba045.orlgmj (mgr.34412) 6991 : cluster [DBG] pgmap v3975: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:01.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:01:01 gibba045 bash[25517]: cluster 2021-03-10T16:01:00.712962+0000 mgr.gibba045.orlgmj (mgr.34412) 6992 : cluster [DBG] pgmap v3976: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:01.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:01:01 gibba015 bash[29377]: cluster 2021-03-10T16:01:00.712962+0000 mgr.gibba045.orlgmj (mgr.34412) 6992 : cluster [DBG] pgmap v3976: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:01.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:01:01 gibba015 bash[30343]: cluster 2021-03-10T16:01:00.712962+0000 mgr.gibba045.orlgmj (mgr.34412) 6992 : cluster [DBG] pgmap v3976: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:04.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:01:03 gibba045 bash[25517]: cephadm 2021-03-10T16:01:02.222498+0000 mgr.gibba045.orlgmj (mgr.34412) 6993 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:01:04.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:01:03 gibba045 bash[25517]: cluster 2021-03-10T16:01:02.714486+0000 mgr.gibba045.orlgmj (mgr.34412) 6994 : cluster [DBG] pgmap v3977: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:04.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:01:03 gibba015 bash[29377]: cephadm 2021-03-10T16:01:02.222498+0000 mgr.gibba045.orlgmj (mgr.34412) 6993 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:01:04.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:01:03 gibba015 bash[29377]: cluster 2021-03-10T16:01:02.714486+0000 mgr.gibba045.orlgmj (mgr.34412) 6994 : cluster [DBG] pgmap v3977: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:04.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:01:03 gibba015 bash[30343]: cephadm 2021-03-10T16:01:02.222498+0000 mgr.gibba045.orlgmj (mgr.34412) 6993 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:01:04.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:01:03 gibba015 bash[30343]: cluster 2021-03-10T16:01:02.714486+0000 mgr.gibba045.orlgmj (mgr.34412) 6994 : cluster [DBG] pgmap v3977: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:06.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:01:05 gibba045 bash[25517]: cluster 2021-03-10T16:01:04.715813+0000 mgr.gibba045.orlgmj (mgr.34412) 6995 : cluster [DBG] pgmap v3978: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:06.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:01:05 gibba015 bash[29377]: cluster 2021-03-10T16:01:04.715813+0000 mgr.gibba045.orlgmj (mgr.34412) 6995 : cluster [DBG] pgmap v3978: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:06.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:01:05 gibba015 bash[30343]: cluster 2021-03-10T16:01:04.715813+0000 mgr.gibba045.orlgmj (mgr.34412) 6995 : cluster [DBG] pgmap v3978: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:08.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:01:07 gibba045 bash[25517]: cluster 2021-03-10T16:01:06.717532+0000 mgr.gibba045.orlgmj (mgr.34412) 6996 : cluster [DBG] pgmap v3979: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:08.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:01:07 gibba015 bash[29377]: cluster 2021-03-10T16:01:06.717532+0000 mgr.gibba045.orlgmj (mgr.34412) 6996 : cluster [DBG] pgmap v3979: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:08.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:01:07 gibba015 bash[30343]: cluster 2021-03-10T16:01:06.717532+0000 mgr.gibba045.orlgmj (mgr.34412) 6996 : cluster [DBG] pgmap v3979: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:10.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:01:09 gibba015 bash[29377]: cluster 2021-03-10T16:01:08.718875+0000 mgr.gibba045.orlgmj (mgr.34412) 6997 : cluster [DBG] pgmap v3980: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:10.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:01:09 gibba015 bash[30343]: cluster 2021-03-10T16:01:08.718875+0000 mgr.gibba045.orlgmj (mgr.34412) 6997 : cluster [DBG] pgmap v3980: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:10.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:01:09 gibba045 bash[25517]: cluster 2021-03-10T16:01:08.718875+0000 mgr.gibba045.orlgmj (mgr.34412) 6997 : cluster [DBG] pgmap v3980: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:11.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:01:11 gibba045 bash[25517]: cluster 2021-03-10T16:01:10.720515+0000 mgr.gibba045.orlgmj (mgr.34412) 6998 : cluster [DBG] pgmap v3981: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:11.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:01:11 gibba015 bash[29377]: cluster 2021-03-10T16:01:10.720515+0000 mgr.gibba045.orlgmj (mgr.34412) 6998 : cluster [DBG] pgmap v3981: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:11.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:01:11 gibba015 bash[30343]: cluster 2021-03-10T16:01:10.720515+0000 mgr.gibba045.orlgmj (mgr.34412) 6998 : cluster [DBG] pgmap v3981: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:14.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:01:13 gibba045 bash[25517]: cluster 2021-03-10T16:01:12.721918+0000 mgr.gibba045.orlgmj (mgr.34412) 6999 : cluster [DBG] pgmap v3982: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:14.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:01:13 gibba015 bash[29377]: cluster 2021-03-10T16:01:12.721918+0000 mgr.gibba045.orlgmj (mgr.34412) 6999 : cluster [DBG] pgmap v3982: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:14.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:01:13 gibba015 bash[30343]: cluster 2021-03-10T16:01:12.721918+0000 mgr.gibba045.orlgmj (mgr.34412) 6999 : cluster [DBG] pgmap v3982: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:15.666 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:01:15.896 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:01:15.896 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 5m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:01:15.897 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 4m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:01:15.897 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:01:15.897 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:01:15.897 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:01:15.898 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:01:15.898 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:01:15.898 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:01:15.898 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 5m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:01:15.899 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 4m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:01:15.899 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:01:15.899 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:01:15.899 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:01:15.900 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:01:15.900 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:01:15.900 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:01:15.900 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:01:15.900 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:01:15.901 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 4m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:01:15.901 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 4m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:01:16.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:01:15 gibba045 bash[25517]: cluster 2021-03-10T16:01:14.723269+0000 mgr.gibba045.orlgmj (mgr.34412) 7000 : cluster [DBG] pgmap v3983: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:16.146 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:01:16.146 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:01:16.146 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:01:16.147 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:01:16.147 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:01:16.147 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:01:16.147 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:01:16.148 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:01:16.148 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:01:16.148 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:01:16.148 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:01:16.148 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:01:16.149 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:01:16.149 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:01:16.149 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:01:16.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:01:15 gibba015 bash[29377]: cluster 2021-03-10T16:01:14.723269+0000 mgr.gibba045.orlgmj (mgr.34412) 7000 : cluster [DBG] pgmap v3983: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:16.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:01:15 gibba015 bash[30343]: cluster 2021-03-10T16:01:14.723269+0000 mgr.gibba045.orlgmj (mgr.34412) 7000 : cluster [DBG] pgmap v3983: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:17.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:01:16 gibba045 bash[25517]: audit 2021-03-10T16:01:15.658579+0000 mgr.gibba045.orlgmj (mgr.34412) 7001 : audit [DBG] from='client.48750 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:01:17.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:01:16 gibba045 bash[25517]: audit 2021-03-10T16:01:16.145104+0000 mon.c (mon.1) 1946 : audit [DBG] from='client.? 172.21.2.115:0/3872995340' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:01:17.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:01:16 gibba015 bash[29377]: audit 2021-03-10T16:01:15.658579+0000 mgr.gibba045.orlgmj (mgr.34412) 7001 : audit [DBG] from='client.48750 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:01:17.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:01:16 gibba015 bash[29377]: audit 2021-03-10T16:01:16.145104+0000 mon.c (mon.1) 1946 : audit [DBG] from='client.? 172.21.2.115:0/3872995340' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:01:17.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:01:16 gibba015 bash[30343]: audit 2021-03-10T16:01:15.658579+0000 mgr.gibba045.orlgmj (mgr.34412) 7001 : audit [DBG] from='client.48750 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:01:17.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:01:16 gibba015 bash[30343]: audit 2021-03-10T16:01:16.145104+0000 mon.c (mon.1) 1946 : audit [DBG] from='client.? 172.21.2.115:0/3872995340' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:01:18.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:01:17 gibba015 bash[29377]: audit 2021-03-10T16:01:15.885473+0000 mgr.gibba045.orlgmj (mgr.34412) 7002 : audit [DBG] from='client.48756 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:01:18.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:01:17 gibba015 bash[29377]: cluster 2021-03-10T16:01:16.725250+0000 mgr.gibba045.orlgmj (mgr.34412) 7003 : cluster [DBG] pgmap v3984: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:18.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:01:17 gibba015 bash[30343]: audit 2021-03-10T16:01:15.885473+0000 mgr.gibba045.orlgmj (mgr.34412) 7002 : audit [DBG] from='client.48756 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:01:18.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:01:17 gibba015 bash[30343]: cluster 2021-03-10T16:01:16.725250+0000 mgr.gibba045.orlgmj (mgr.34412) 7003 : cluster [DBG] pgmap v3984: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:18.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:01:17 gibba045 bash[25517]: audit 2021-03-10T16:01:15.885473+0000 mgr.gibba045.orlgmj (mgr.34412) 7002 : audit [DBG] from='client.48756 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:01:18.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:01:17 gibba045 bash[25517]: cluster 2021-03-10T16:01:16.725250+0000 mgr.gibba045.orlgmj (mgr.34412) 7003 : cluster [DBG] pgmap v3984: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:19.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:01:18 gibba015 bash[29377]: cephadm 2021-03-10T16:01:17.238550+0000 mgr.gibba045.orlgmj (mgr.34412) 7004 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:01:19.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:01:18 gibba015 bash[30343]: cephadm 2021-03-10T16:01:17.238550+0000 mgr.gibba045.orlgmj (mgr.34412) 7004 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:01:19.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:01:18 gibba045 bash[25517]: cephadm 2021-03-10T16:01:17.238550+0000 mgr.gibba045.orlgmj (mgr.34412) 7004 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:01:20.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:01:19 gibba015 bash[29377]: cluster 2021-03-10T16:01:18.726508+0000 mgr.gibba045.orlgmj (mgr.34412) 7005 : cluster [DBG] pgmap v3985: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:20.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:01:19 gibba015 bash[30343]: cluster 2021-03-10T16:01:18.726508+0000 mgr.gibba045.orlgmj (mgr.34412) 7005 : cluster [DBG] pgmap v3985: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:20.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:01:19 gibba045 bash[25517]: cluster 2021-03-10T16:01:18.726508+0000 mgr.gibba045.orlgmj (mgr.34412) 7005 : cluster [DBG] pgmap v3985: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:21.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:01:21 gibba045 bash[25517]: cluster 2021-03-10T16:01:20.728117+0000 mgr.gibba045.orlgmj (mgr.34412) 7006 : cluster [DBG] pgmap v3986: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:21.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:01:21 gibba015 bash[29377]: cluster 2021-03-10T16:01:20.728117+0000 mgr.gibba045.orlgmj (mgr.34412) 7006 : cluster [DBG] pgmap v3986: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:21.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:01:21 gibba015 bash[30343]: cluster 2021-03-10T16:01:20.728117+0000 mgr.gibba045.orlgmj (mgr.34412) 7006 : cluster [DBG] pgmap v3986: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:24.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:01:23 gibba045 bash[25517]: cluster 2021-03-10T16:01:22.729689+0000 mgr.gibba045.orlgmj (mgr.34412) 7007 : cluster [DBG] pgmap v3987: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:24.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:01:23 gibba015 bash[29377]: cluster 2021-03-10T16:01:22.729689+0000 mgr.gibba045.orlgmj (mgr.34412) 7007 : cluster [DBG] pgmap v3987: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:24.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:01:23 gibba015 bash[30343]: cluster 2021-03-10T16:01:22.729689+0000 mgr.gibba045.orlgmj (mgr.34412) 7007 : cluster [DBG] pgmap v3987: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:26.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:01:25 gibba045 bash[25517]: cluster 2021-03-10T16:01:24.731222+0000 mgr.gibba045.orlgmj (mgr.34412) 7008 : cluster [DBG] pgmap v3988: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:26.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:01:25 gibba015 bash[29377]: cluster 2021-03-10T16:01:24.731222+0000 mgr.gibba045.orlgmj (mgr.34412) 7008 : cluster [DBG] pgmap v3988: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:26.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:01:25 gibba015 bash[30343]: cluster 2021-03-10T16:01:24.731222+0000 mgr.gibba045.orlgmj (mgr.34412) 7008 : cluster [DBG] pgmap v3988: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:28.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:01:27 gibba015 bash[29377]: cluster 2021-03-10T16:01:26.733007+0000 mgr.gibba045.orlgmj (mgr.34412) 7009 : cluster [DBG] pgmap v3989: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:28.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:01:27 gibba015 bash[30343]: cluster 2021-03-10T16:01:26.733007+0000 mgr.gibba045.orlgmj (mgr.34412) 7009 : cluster [DBG] pgmap v3989: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:28.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:01:27 gibba045 bash[25517]: cluster 2021-03-10T16:01:26.733007+0000 mgr.gibba045.orlgmj (mgr.34412) 7009 : cluster [DBG] pgmap v3989: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:30.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:01:29 gibba015 bash[29377]: cluster 2021-03-10T16:01:28.734542+0000 mgr.gibba045.orlgmj (mgr.34412) 7010 : cluster [DBG] pgmap v3990: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:30.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:01:29 gibba015 bash[30343]: cluster 2021-03-10T16:01:28.734542+0000 mgr.gibba045.orlgmj (mgr.34412) 7010 : cluster [DBG] pgmap v3990: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:30.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:01:29 gibba045 bash[25517]: cluster 2021-03-10T16:01:28.734542+0000 mgr.gibba045.orlgmj (mgr.34412) 7010 : cluster [DBG] pgmap v3990: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:31.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:01:31 gibba045 bash[25517]: cluster 2021-03-10T16:01:30.736104+0000 mgr.gibba045.orlgmj (mgr.34412) 7011 : cluster [DBG] pgmap v3991: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:31.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:01:31 gibba015 bash[29377]: cluster 2021-03-10T16:01:30.736104+0000 mgr.gibba045.orlgmj (mgr.34412) 7011 : cluster [DBG] pgmap v3991: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:31.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:01:31 gibba015 bash[30343]: cluster 2021-03-10T16:01:30.736104+0000 mgr.gibba045.orlgmj (mgr.34412) 7011 : cluster [DBG] pgmap v3991: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:34.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:01:33 gibba045 bash[25517]: cephadm 2021-03-10T16:01:32.254543+0000 mgr.gibba045.orlgmj (mgr.34412) 7012 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:01:34.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:01:33 gibba045 bash[25517]: cluster 2021-03-10T16:01:32.737571+0000 mgr.gibba045.orlgmj (mgr.34412) 7013 : cluster [DBG] pgmap v3992: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:34.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:01:33 gibba015 bash[29377]: cephadm 2021-03-10T16:01:32.254543+0000 mgr.gibba045.orlgmj (mgr.34412) 7012 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:01:34.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:01:33 gibba015 bash[29377]: cluster 2021-03-10T16:01:32.737571+0000 mgr.gibba045.orlgmj (mgr.34412) 7013 : cluster [DBG] pgmap v3992: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:34.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:01:33 gibba015 bash[30343]: cephadm 2021-03-10T16:01:32.254543+0000 mgr.gibba045.orlgmj (mgr.34412) 7012 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:01:34.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:01:33 gibba015 bash[30343]: cluster 2021-03-10T16:01:32.737571+0000 mgr.gibba045.orlgmj (mgr.34412) 7013 : cluster [DBG] pgmap v3992: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:36.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:01:35 gibba015 bash[29377]: cluster 2021-03-10T16:01:34.738891+0000 mgr.gibba045.orlgmj (mgr.34412) 7014 : cluster [DBG] pgmap v3993: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:36.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:01:35 gibba015 bash[30343]: cluster 2021-03-10T16:01:34.738891+0000 mgr.gibba045.orlgmj (mgr.34412) 7014 : cluster [DBG] pgmap v3993: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:36.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:01:35 gibba045 bash[25517]: cluster 2021-03-10T16:01:34.738891+0000 mgr.gibba045.orlgmj (mgr.34412) 7014 : cluster [DBG] pgmap v3993: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:38.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:01:37 gibba015 bash[29377]: cluster 2021-03-10T16:01:36.740694+0000 mgr.gibba045.orlgmj (mgr.34412) 7015 : cluster [DBG] pgmap v3994: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:38.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:01:37 gibba015 bash[30343]: cluster 2021-03-10T16:01:36.740694+0000 mgr.gibba045.orlgmj (mgr.34412) 7015 : cluster [DBG] pgmap v3994: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:38.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:01:37 gibba045 bash[25517]: cluster 2021-03-10T16:01:36.740694+0000 mgr.gibba045.orlgmj (mgr.34412) 7015 : cluster [DBG] pgmap v3994: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:39.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:01:38 gibba015 bash[29377]: cluster 2021-03-10T16:01:38.741907+0000 mgr.gibba045.orlgmj (mgr.34412) 7016 : cluster [DBG] pgmap v3995: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:39.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:01:38 gibba015 bash[30343]: cluster 2021-03-10T16:01:38.741907+0000 mgr.gibba045.orlgmj (mgr.34412) 7016 : cluster [DBG] pgmap v3995: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:39.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:01:38 gibba045 bash[25517]: cluster 2021-03-10T16:01:38.741907+0000 mgr.gibba045.orlgmj (mgr.34412) 7016 : cluster [DBG] pgmap v3995: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:41.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:01:41 gibba045 bash[25517]: cluster 2021-03-10T16:01:40.743482+0000 mgr.gibba045.orlgmj (mgr.34412) 7017 : cluster [DBG] pgmap v3996: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:41.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:01:41 gibba015 bash[29377]: cluster 2021-03-10T16:01:40.743482+0000 mgr.gibba045.orlgmj (mgr.34412) 7017 : cluster [DBG] pgmap v3996: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:41.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:01:41 gibba015 bash[30343]: cluster 2021-03-10T16:01:40.743482+0000 mgr.gibba045.orlgmj (mgr.34412) 7017 : cluster [DBG] pgmap v3996: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:44.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:01:43 gibba015 bash[29377]: cluster 2021-03-10T16:01:42.745200+0000 mgr.gibba045.orlgmj (mgr.34412) 7018 : cluster [DBG] pgmap v3997: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:44.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:01:43 gibba015 bash[30343]: cluster 2021-03-10T16:01:42.745200+0000 mgr.gibba045.orlgmj (mgr.34412) 7018 : cluster [DBG] pgmap v3997: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:44.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:01:43 gibba045 bash[25517]: cluster 2021-03-10T16:01:42.745200+0000 mgr.gibba045.orlgmj (mgr.34412) 7018 : cluster [DBG] pgmap v3997: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:46.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:01:45 gibba015 bash[29377]: cluster 2021-03-10T16:01:44.746754+0000 mgr.gibba045.orlgmj (mgr.34412) 7019 : cluster [DBG] pgmap v3998: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:46.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:01:45 gibba015 bash[30343]: cluster 2021-03-10T16:01:44.746754+0000 mgr.gibba045.orlgmj (mgr.34412) 7019 : cluster [DBG] pgmap v3998: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:46.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:01:45 gibba045 bash[25517]: cluster 2021-03-10T16:01:44.746754+0000 mgr.gibba045.orlgmj (mgr.34412) 7019 : cluster [DBG] pgmap v3998: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:46.387 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:01:46.614 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:01:46.615 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 6m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:01:46.615 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 5m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:01:46.615 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:01:46.615 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:01:46.616 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:01:46.616 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:01:46.616 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:01:46.616 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:01:46.617 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 6m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:01:46.617 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 5m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:01:46.617 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:01:46.617 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:01:46.618 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:01:46.618 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:01:46.618 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:01:46.618 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:01:46.619 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:01:46.619 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:01:46.619 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 5m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:01:46.619 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 5m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:01:46.873 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:01:46.873 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:01:46.873 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:01:46.874 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:01:46.874 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:01:46.874 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:01:46.874 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:01:46.875 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:01:46.875 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:01:46.875 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:01:46.875 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:01:46.875 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:01:46.876 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:01:46.876 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:01:46.876 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:01:48.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:01:47 gibba015 bash[29377]: audit 2021-03-10T16:01:46.379501+0000 mgr.gibba045.orlgmj (mgr.34412) 7020 : audit [DBG] from='client.48768 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:01:48.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:01:47 gibba015 bash[29377]: audit 2021-03-10T16:01:46.603170+0000 mgr.gibba045.orlgmj (mgr.34412) 7021 : audit [DBG] from='client.58762 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:01:48.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:01:47 gibba015 bash[29377]: cluster 2021-03-10T16:01:46.748732+0000 mgr.gibba045.orlgmj (mgr.34412) 7022 : cluster [DBG] pgmap v3999: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:48.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:01:47 gibba015 bash[29377]: audit 2021-03-10T16:01:46.872040+0000 mon.c (mon.1) 1947 : audit [DBG] from='client.? 172.21.2.115:0/2398911799' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:01:48.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:01:47 gibba015 bash[29377]: audit 2021-03-10T16:01:47.269151+0000 mon.c (mon.1) 1948 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:01:48.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:01:47 gibba015 bash[29377]: audit 2021-03-10T16:01:47.496873+0000 mon.a (mon.0) 1674 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:01:48.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:01:47 gibba015 bash[29377]: audit 2021-03-10T16:01:47.500615+0000 mon.c (mon.1) 1949 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:01:48.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:01:47 gibba015 bash[29377]: audit 2021-03-10T16:01:47.502123+0000 mon.c (mon.1) 1950 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:01:48.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:01:47 gibba015 bash[29377]: audit 2021-03-10T16:01:47.503778+0000 mon.c (mon.1) 1951 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:01:48.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:01:47 gibba015 bash[29377]: audit 2021-03-10T16:01:47.505338+0000 mon.c (mon.1) 1952 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:01:48.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:01:47 gibba015 bash[29377]: audit 2021-03-10T16:01:47.508872+0000 mon.c (mon.1) 1953 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:01:48.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:01:47 gibba015 bash[29377]: audit 2021-03-10T16:01:47.510429+0000 mon.c (mon.1) 1954 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:01:48.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:01:47 gibba015 bash[30343]: audit 2021-03-10T16:01:46.379501+0000 mgr.gibba045.orlgmj (mgr.34412) 7020 : audit [DBG] from='client.48768 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:01:48.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:01:47 gibba015 bash[30343]: audit 2021-03-10T16:01:46.603170+0000 mgr.gibba045.orlgmj (mgr.34412) 7021 : audit [DBG] from='client.58762 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:01:48.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:01:47 gibba015 bash[30343]: cluster 2021-03-10T16:01:46.748732+0000 mgr.gibba045.orlgmj (mgr.34412) 7022 : cluster [DBG] pgmap v3999: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:48.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:01:47 gibba015 bash[30343]: audit 2021-03-10T16:01:46.872040+0000 mon.c (mon.1) 1947 : audit [DBG] from='client.? 172.21.2.115:0/2398911799' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:01:48.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:01:47 gibba015 bash[30343]: audit 2021-03-10T16:01:47.269151+0000 mon.c (mon.1) 1948 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:01:48.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:01:47 gibba015 bash[30343]: audit 2021-03-10T16:01:47.496873+0000 mon.a (mon.0) 1674 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:01:48.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:01:47 gibba015 bash[30343]: audit 2021-03-10T16:01:47.500615+0000 mon.c (mon.1) 1949 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:01:48.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:01:47 gibba015 bash[30343]: audit 2021-03-10T16:01:47.502123+0000 mon.c (mon.1) 1950 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:01:48.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:01:47 gibba015 bash[30343]: audit 2021-03-10T16:01:47.503778+0000 mon.c (mon.1) 1951 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:01:48.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:01:47 gibba015 bash[30343]: audit 2021-03-10T16:01:47.505338+0000 mon.c (mon.1) 1952 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:01:48.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:01:47 gibba015 bash[30343]: audit 2021-03-10T16:01:47.508872+0000 mon.c (mon.1) 1953 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:01:48.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:01:47 gibba015 bash[30343]: audit 2021-03-10T16:01:47.510429+0000 mon.c (mon.1) 1954 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:01:48.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:01:47 gibba045 bash[25517]: audit 2021-03-10T16:01:46.379501+0000 mgr.gibba045.orlgmj (mgr.34412) 7020 : audit [DBG] from='client.48768 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:01:48.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:01:47 gibba045 bash[25517]: audit 2021-03-10T16:01:46.603170+0000 mgr.gibba045.orlgmj (mgr.34412) 7021 : audit [DBG] from='client.58762 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:01:48.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:01:47 gibba045 bash[25517]: cluster 2021-03-10T16:01:46.748732+0000 mgr.gibba045.orlgmj (mgr.34412) 7022 : cluster [DBG] pgmap v3999: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:48.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:01:47 gibba045 bash[25517]: audit 2021-03-10T16:01:46.872040+0000 mon.c (mon.1) 1947 : audit [DBG] from='client.? 172.21.2.115:0/2398911799' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:01:48.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:01:47 gibba045 bash[25517]: audit 2021-03-10T16:01:47.269151+0000 mon.c (mon.1) 1948 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:01:48.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:01:47 gibba045 bash[25517]: audit 2021-03-10T16:01:47.496873+0000 mon.a (mon.0) 1674 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:01:48.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:01:47 gibba045 bash[25517]: audit 2021-03-10T16:01:47.500615+0000 mon.c (mon.1) 1949 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:01:48.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:01:47 gibba045 bash[25517]: audit 2021-03-10T16:01:47.502123+0000 mon.c (mon.1) 1950 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:01:48.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:01:47 gibba045 bash[25517]: audit 2021-03-10T16:01:47.503778+0000 mon.c (mon.1) 1951 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:01:48.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:01:47 gibba045 bash[25517]: audit 2021-03-10T16:01:47.505338+0000 mon.c (mon.1) 1952 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:01:48.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:01:47 gibba045 bash[25517]: audit 2021-03-10T16:01:47.508872+0000 mon.c (mon.1) 1953 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:01:48.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:01:47 gibba045 bash[25517]: audit 2021-03-10T16:01:47.510429+0000 mon.c (mon.1) 1954 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:01:49.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:01:48 gibba015 bash[29377]: cephadm 2021-03-10T16:01:47.276504+0000 mgr.gibba045.orlgmj (mgr.34412) 7023 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:01:49.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:01:48 gibba015 bash[29377]: cephadm 2021-03-10T16:01:47.278510+0000 mgr.gibba045.orlgmj (mgr.34412) 7024 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:01:49.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:01:48 gibba015 bash[29377]: cephadm 2021-03-10T16:01:47.502217+0000 mgr.gibba045.orlgmj (mgr.34412) 7025 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:01:49.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:01:48 gibba015 bash[29377]: cephadm 2021-03-10T16:01:47.504095+0000 mgr.gibba045.orlgmj (mgr.34412) 7026 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:01:49.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:01:48 gibba015 bash[29377]: cephadm 2021-03-10T16:01:47.505640+0000 mgr.gibba045.orlgmj (mgr.34412) 7027 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:01:49.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:01:48 gibba015 bash[29377]: cephadm 2021-03-10T16:01:47.505675+0000 mgr.gibba045.orlgmj (mgr.34412) 7028 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:01:49.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:01:48 gibba015 bash[29377]: cephadm 2021-03-10T16:01:47.507293+0000 mgr.gibba045.orlgmj (mgr.34412) 7029 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:01:49.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:01:48 gibba015 bash[29377]: cephadm 2021-03-10T16:01:47.507328+0000 mgr.gibba045.orlgmj (mgr.34412) 7030 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:01:49.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:01:48 gibba015 bash[29377]: cephadm 2021-03-10T16:01:47.508704+0000 mgr.gibba045.orlgmj (mgr.34412) 7031 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:01:49.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:01:48 gibba015 bash[29377]: cephadm 2021-03-10T16:01:47.510718+0000 mgr.gibba045.orlgmj (mgr.34412) 7032 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:01:49.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:01:48 gibba015 bash[29377]: cephadm 2021-03-10T16:01:47.510754+0000 mgr.gibba045.orlgmj (mgr.34412) 7033 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:01:49.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:01:48 gibba015 bash[29377]: cephadm 2021-03-10T16:01:47.512230+0000 mgr.gibba045.orlgmj (mgr.34412) 7034 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:01:49.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:01:48 gibba015 bash[29377]: cephadm 2021-03-10T16:01:47.512613+0000 mgr.gibba045.orlgmj (mgr.34412) 7035 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:01:49.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:01:48 gibba015 bash[29377]: cephadm 2021-03-10T16:01:47.513844+0000 mgr.gibba045.orlgmj (mgr.34412) 7036 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:01:49.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:01:48 gibba015 bash[29377]: cephadm 2021-03-10T16:01:47.513879+0000 mgr.gibba045.orlgmj (mgr.34412) 7037 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:01:49.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:01:48 gibba015 bash[29377]: cephadm 2021-03-10T16:01:47.513982+0000 mgr.gibba045.orlgmj (mgr.34412) 7038 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:01:49.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:01:48 gibba015 bash[29377]: cluster 2021-03-10T16:01:48.750245+0000 mgr.gibba045.orlgmj (mgr.34412) 7039 : cluster [DBG] pgmap v4000: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:49.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:01:48 gibba015 bash[30343]: cephadm 2021-03-10T16:01:47.276504+0000 mgr.gibba045.orlgmj (mgr.34412) 7023 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:01:49.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:01:48 gibba015 bash[30343]: cephadm 2021-03-10T16:01:47.278510+0000 mgr.gibba045.orlgmj (mgr.34412) 7024 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:01:49.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:01:48 gibba015 bash[30343]: cephadm 2021-03-10T16:01:47.502217+0000 mgr.gibba045.orlgmj (mgr.34412) 7025 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:01:49.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:01:48 gibba015 bash[30343]: cephadm 2021-03-10T16:01:47.504095+0000 mgr.gibba045.orlgmj (mgr.34412) 7026 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:01:49.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:01:48 gibba015 bash[30343]: cephadm 2021-03-10T16:01:47.505640+0000 mgr.gibba045.orlgmj (mgr.34412) 7027 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:01:49.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:01:48 gibba015 bash[30343]: cephadm 2021-03-10T16:01:47.505675+0000 mgr.gibba045.orlgmj (mgr.34412) 7028 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:01:49.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:01:48 gibba015 bash[30343]: cephadm 2021-03-10T16:01:47.507293+0000 mgr.gibba045.orlgmj (mgr.34412) 7029 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:01:49.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:01:48 gibba015 bash[30343]: cephadm 2021-03-10T16:01:47.507328+0000 mgr.gibba045.orlgmj (mgr.34412) 7030 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:01:49.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:01:48 gibba015 bash[30343]: cephadm 2021-03-10T16:01:47.508704+0000 mgr.gibba045.orlgmj (mgr.34412) 7031 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:01:49.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:01:48 gibba015 bash[30343]: cephadm 2021-03-10T16:01:47.510718+0000 mgr.gibba045.orlgmj (mgr.34412) 7032 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:01:49.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:01:48 gibba015 bash[30343]: cephadm 2021-03-10T16:01:47.510754+0000 mgr.gibba045.orlgmj (mgr.34412) 7033 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:01:49.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:01:48 gibba015 bash[30343]: cephadm 2021-03-10T16:01:47.512230+0000 mgr.gibba045.orlgmj (mgr.34412) 7034 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:01:49.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:01:48 gibba015 bash[30343]: cephadm 2021-03-10T16:01:47.512613+0000 mgr.gibba045.orlgmj (mgr.34412) 7035 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:01:49.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:01:48 gibba015 bash[30343]: cephadm 2021-03-10T16:01:47.513844+0000 mgr.gibba045.orlgmj (mgr.34412) 7036 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:01:49.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:01:48 gibba015 bash[30343]: cephadm 2021-03-10T16:01:47.513879+0000 mgr.gibba045.orlgmj (mgr.34412) 7037 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:01:49.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:01:48 gibba015 bash[30343]: cephadm 2021-03-10T16:01:47.513982+0000 mgr.gibba045.orlgmj (mgr.34412) 7038 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:01:49.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:01:48 gibba015 bash[30343]: cluster 2021-03-10T16:01:48.750245+0000 mgr.gibba045.orlgmj (mgr.34412) 7039 : cluster [DBG] pgmap v4000: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:49.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:01:48 gibba045 bash[25517]: cephadm 2021-03-10T16:01:47.276504+0000 mgr.gibba045.orlgmj (mgr.34412) 7023 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:01:49.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:01:48 gibba045 bash[25517]: cephadm 2021-03-10T16:01:47.278510+0000 mgr.gibba045.orlgmj (mgr.34412) 7024 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:01:49.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:01:48 gibba045 bash[25517]: cephadm 2021-03-10T16:01:47.502217+0000 mgr.gibba045.orlgmj (mgr.34412) 7025 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:01:49.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:01:48 gibba045 bash[25517]: cephadm 2021-03-10T16:01:47.504095+0000 mgr.gibba045.orlgmj (mgr.34412) 7026 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:01:49.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:01:48 gibba045 bash[25517]: cephadm 2021-03-10T16:01:47.505640+0000 mgr.gibba045.orlgmj (mgr.34412) 7027 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:01:49.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:01:48 gibba045 bash[25517]: cephadm 2021-03-10T16:01:47.505675+0000 mgr.gibba045.orlgmj (mgr.34412) 7028 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:01:49.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:01:48 gibba045 bash[25517]: cephadm 2021-03-10T16:01:47.507293+0000 mgr.gibba045.orlgmj (mgr.34412) 7029 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:01:49.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:01:48 gibba045 bash[25517]: cephadm 2021-03-10T16:01:47.507328+0000 mgr.gibba045.orlgmj (mgr.34412) 7030 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:01:49.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:01:48 gibba045 bash[25517]: cephadm 2021-03-10T16:01:47.508704+0000 mgr.gibba045.orlgmj (mgr.34412) 7031 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:01:49.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:01:48 gibba045 bash[25517]: cephadm 2021-03-10T16:01:47.510718+0000 mgr.gibba045.orlgmj (mgr.34412) 7032 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:01:49.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:01:48 gibba045 bash[25517]: cephadm 2021-03-10T16:01:47.510754+0000 mgr.gibba045.orlgmj (mgr.34412) 7033 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:01:49.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:01:48 gibba045 bash[25517]: cephadm 2021-03-10T16:01:47.512230+0000 mgr.gibba045.orlgmj (mgr.34412) 7034 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:01:49.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:01:48 gibba045 bash[25517]: cephadm 2021-03-10T16:01:47.512613+0000 mgr.gibba045.orlgmj (mgr.34412) 7035 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:01:49.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:01:48 gibba045 bash[25517]: cephadm 2021-03-10T16:01:47.513844+0000 mgr.gibba045.orlgmj (mgr.34412) 7036 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:01:49.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:01:48 gibba045 bash[25517]: cephadm 2021-03-10T16:01:47.513879+0000 mgr.gibba045.orlgmj (mgr.34412) 7037 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:01:49.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:01:48 gibba045 bash[25517]: cephadm 2021-03-10T16:01:47.513982+0000 mgr.gibba045.orlgmj (mgr.34412) 7038 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:01:49.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:01:48 gibba045 bash[25517]: cluster 2021-03-10T16:01:48.750245+0000 mgr.gibba045.orlgmj (mgr.34412) 7039 : cluster [DBG] pgmap v4000: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:51.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:01:51 gibba045 bash[25517]: cluster 2021-03-10T16:01:50.751805+0000 mgr.gibba045.orlgmj (mgr.34412) 7040 : cluster [DBG] pgmap v4001: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:51.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:01:51 gibba015 bash[29377]: cluster 2021-03-10T16:01:50.751805+0000 mgr.gibba045.orlgmj (mgr.34412) 7040 : cluster [DBG] pgmap v4001: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:51.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:01:51 gibba015 bash[30343]: cluster 2021-03-10T16:01:50.751805+0000 mgr.gibba045.orlgmj (mgr.34412) 7040 : cluster [DBG] pgmap v4001: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:54.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:01:53 gibba015 bash[29377]: cluster 2021-03-10T16:01:52.753529+0000 mgr.gibba045.orlgmj (mgr.34412) 7041 : cluster [DBG] pgmap v4002: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:54.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:01:53 gibba015 bash[29377]: audit 2021-03-10T16:01:53.391754+0000 mon.c (mon.1) 1955 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:01:54.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:01:53 gibba015 bash[29377]: audit 2021-03-10T16:01:53.392364+0000 mon.c (mon.1) 1956 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:01:54.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:01:53 gibba015 bash[29377]: audit 2021-03-10T16:01:53.392886+0000 mon.a (mon.0) 1675 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:01:54.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:01:53 gibba015 bash[29377]: audit 2021-03-10T16:01:53.393926+0000 mon.c (mon.1) 1957 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T16:01:54.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:01:53 gibba015 bash[29377]: audit 2021-03-10T16:01:53.393980+0000 mon.a (mon.0) 1676 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:01:54.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:01:53 gibba015 bash[29377]: audit 2021-03-10T16:01:53.394685+0000 mon.c (mon.1) 1958 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:01:54.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:01:53 gibba015 bash[29377]: audit 2021-03-10T16:01:53.395028+0000 mon.a (mon.0) 1677 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T16:01:54.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:01:53 gibba015 bash[29377]: audit 2021-03-10T16:01:53.395512+0000 mon.c (mon.1) 1959 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T16:01:54.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:01:53 gibba015 bash[29377]: audit 2021-03-10T16:01:53.396266+0000 mon.a (mon.0) 1678 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:01:54.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:01:53 gibba015 bash[29377]: audit 2021-03-10T16:01:53.396286+0000 mon.c (mon.1) 1960 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:01:54.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:01:53 gibba015 bash[29377]: audit 2021-03-10T16:01:53.397484+0000 mon.a (mon.0) 1679 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T16:01:54.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:01:53 gibba015 bash[29377]: audit 2021-03-10T16:01:53.398353+0000 mon.a (mon.0) 1680 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:01:54.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:01:53 gibba015 bash[30343]: cluster 2021-03-10T16:01:52.753529+0000 mgr.gibba045.orlgmj (mgr.34412) 7041 : cluster [DBG] pgmap v4002: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:54.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:01:53 gibba015 bash[30343]: audit 2021-03-10T16:01:53.391754+0000 mon.c (mon.1) 1955 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:01:54.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:01:53 gibba015 bash[30343]: audit 2021-03-10T16:01:53.392364+0000 mon.c (mon.1) 1956 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:01:54.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:01:53 gibba015 bash[30343]: audit 2021-03-10T16:01:53.392886+0000 mon.a (mon.0) 1675 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:01:54.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:01:53 gibba015 bash[30343]: audit 2021-03-10T16:01:53.393926+0000 mon.c (mon.1) 1957 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T16:01:54.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:01:53 gibba015 bash[30343]: audit 2021-03-10T16:01:53.393980+0000 mon.a (mon.0) 1676 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:01:54.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:01:53 gibba015 bash[30343]: audit 2021-03-10T16:01:53.394685+0000 mon.c (mon.1) 1958 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:01:54.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:01:53 gibba015 bash[30343]: audit 2021-03-10T16:01:53.395028+0000 mon.a (mon.0) 1677 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T16:01:54.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:01:53 gibba015 bash[30343]: audit 2021-03-10T16:01:53.395512+0000 mon.c (mon.1) 1959 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T16:01:54.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:01:53 gibba015 bash[30343]: audit 2021-03-10T16:01:53.396266+0000 mon.a (mon.0) 1678 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:01:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:01:53 gibba015 bash[30343]: audit 2021-03-10T16:01:53.396286+0000 mon.c (mon.1) 1960 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:01:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:01:53 gibba015 bash[30343]: audit 2021-03-10T16:01:53.397484+0000 mon.a (mon.0) 1679 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T16:01:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:01:53 gibba015 bash[30343]: audit 2021-03-10T16:01:53.398353+0000 mon.a (mon.0) 1680 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:01:54.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:01:53 gibba045 bash[25517]: cluster 2021-03-10T16:01:52.753529+0000 mgr.gibba045.orlgmj (mgr.34412) 7041 : cluster [DBG] pgmap v4002: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:54.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:01:53 gibba045 bash[25517]: audit 2021-03-10T16:01:53.391754+0000 mon.c (mon.1) 1955 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:01:54.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:01:53 gibba045 bash[25517]: audit 2021-03-10T16:01:53.392364+0000 mon.c (mon.1) 1956 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:01:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:01:53 gibba045 bash[25517]: audit 2021-03-10T16:01:53.392886+0000 mon.a (mon.0) 1675 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:01:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:01:53 gibba045 bash[25517]: audit 2021-03-10T16:01:53.393926+0000 mon.c (mon.1) 1957 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T16:01:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:01:53 gibba045 bash[25517]: audit 2021-03-10T16:01:53.393980+0000 mon.a (mon.0) 1676 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:01:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:01:53 gibba045 bash[25517]: audit 2021-03-10T16:01:53.394685+0000 mon.c (mon.1) 1958 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:01:54.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:01:53 gibba045 bash[25517]: audit 2021-03-10T16:01:53.395028+0000 mon.a (mon.0) 1677 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T16:01:54.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:01:53 gibba045 bash[25517]: audit 2021-03-10T16:01:53.395512+0000 mon.c (mon.1) 1959 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T16:01:54.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:01:53 gibba045 bash[25517]: audit 2021-03-10T16:01:53.396266+0000 mon.a (mon.0) 1678 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:01:54.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:01:53 gibba045 bash[25517]: audit 2021-03-10T16:01:53.396286+0000 mon.c (mon.1) 1960 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:01:54.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:01:53 gibba045 bash[25517]: audit 2021-03-10T16:01:53.397484+0000 mon.a (mon.0) 1679 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T16:01:54.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:01:53 gibba045 bash[25517]: audit 2021-03-10T16:01:53.398353+0000 mon.a (mon.0) 1680 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:01:56.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:01:55 gibba015 bash[29377]: cluster 2021-03-10T16:01:54.754988+0000 mgr.gibba045.orlgmj (mgr.34412) 7042 : cluster [DBG] pgmap v4003: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:56.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:01:55 gibba015 bash[30343]: cluster 2021-03-10T16:01:54.754988+0000 mgr.gibba045.orlgmj (mgr.34412) 7042 : cluster [DBG] pgmap v4003: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:56.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:01:55 gibba045 bash[25517]: cluster 2021-03-10T16:01:54.754988+0000 mgr.gibba045.orlgmj (mgr.34412) 7042 : cluster [DBG] pgmap v4003: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:57.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:01:56 gibba015 bash[29377]: cluster 2021-03-10T16:01:56.756787+0000 mgr.gibba045.orlgmj (mgr.34412) 7043 : cluster [DBG] pgmap v4004: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:57.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:01:56 gibba015 bash[30343]: cluster 2021-03-10T16:01:56.756787+0000 mgr.gibba045.orlgmj (mgr.34412) 7043 : cluster [DBG] pgmap v4004: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:57.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:01:56 gibba045 bash[25517]: cluster 2021-03-10T16:01:56.756787+0000 mgr.gibba045.orlgmj (mgr.34412) 7043 : cluster [DBG] pgmap v4004: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:00.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:01:59 gibba015 bash[29377]: cluster 2021-03-10T16:01:58.758301+0000 mgr.gibba045.orlgmj (mgr.34412) 7044 : cluster [DBG] pgmap v4005: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:00.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:01:59 gibba015 bash[30343]: cluster 2021-03-10T16:01:58.758301+0000 mgr.gibba045.orlgmj (mgr.34412) 7044 : cluster [DBG] pgmap v4005: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:00.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:01:59 gibba045 bash[25517]: cluster 2021-03-10T16:01:58.758301+0000 mgr.gibba045.orlgmj (mgr.34412) 7044 : cluster [DBG] pgmap v4005: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:01.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:02:01 gibba045 bash[25517]: cluster 2021-03-10T16:02:00.760073+0000 mgr.gibba045.orlgmj (mgr.34412) 7045 : cluster [DBG] pgmap v4006: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:01.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:02:01 gibba015 bash[29377]: cluster 2021-03-10T16:02:00.760073+0000 mgr.gibba045.orlgmj (mgr.34412) 7045 : cluster [DBG] pgmap v4006: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:01.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:02:01 gibba015 bash[30343]: cluster 2021-03-10T16:02:00.760073+0000 mgr.gibba045.orlgmj (mgr.34412) 7045 : cluster [DBG] pgmap v4006: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:04.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:02:03 gibba015 bash[29377]: cephadm 2021-03-10T16:02:02.526029+0000 mgr.gibba045.orlgmj (mgr.34412) 7046 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:02:04.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:02:03 gibba015 bash[29377]: cluster 2021-03-10T16:02:02.761551+0000 mgr.gibba045.orlgmj (mgr.34412) 7047 : cluster [DBG] pgmap v4007: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:04.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:02:03 gibba015 bash[30343]: cephadm 2021-03-10T16:02:02.526029+0000 mgr.gibba045.orlgmj (mgr.34412) 7046 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:02:04.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:02:03 gibba015 bash[30343]: cluster 2021-03-10T16:02:02.761551+0000 mgr.gibba045.orlgmj (mgr.34412) 7047 : cluster [DBG] pgmap v4007: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:04.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:02:03 gibba045 bash[25517]: cephadm 2021-03-10T16:02:02.526029+0000 mgr.gibba045.orlgmj (mgr.34412) 7046 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:02:04.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:02:03 gibba045 bash[25517]: cluster 2021-03-10T16:02:02.761551+0000 mgr.gibba045.orlgmj (mgr.34412) 7047 : cluster [DBG] pgmap v4007: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:05.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:02:04 gibba015 bash[29377]: cluster 2021-03-10T16:02:04.763042+0000 mgr.gibba045.orlgmj (mgr.34412) 7048 : cluster [DBG] pgmap v4008: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:05.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:02:04 gibba015 bash[30343]: cluster 2021-03-10T16:02:04.763042+0000 mgr.gibba045.orlgmj (mgr.34412) 7048 : cluster [DBG] pgmap v4008: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:05.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:02:04 gibba045 bash[25517]: cluster 2021-03-10T16:02:04.763042+0000 mgr.gibba045.orlgmj (mgr.34412) 7048 : cluster [DBG] pgmap v4008: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:08.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:02:07 gibba015 bash[29377]: cluster 2021-03-10T16:02:06.764635+0000 mgr.gibba045.orlgmj (mgr.34412) 7049 : cluster [DBG] pgmap v4009: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:08.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:02:07 gibba015 bash[30343]: cluster 2021-03-10T16:02:06.764635+0000 mgr.gibba045.orlgmj (mgr.34412) 7049 : cluster [DBG] pgmap v4009: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:08.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:02:07 gibba045 bash[25517]: cluster 2021-03-10T16:02:06.764635+0000 mgr.gibba045.orlgmj (mgr.34412) 7049 : cluster [DBG] pgmap v4009: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:09.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:02:08 gibba015 bash[29377]: cluster 2021-03-10T16:02:08.765972+0000 mgr.gibba045.orlgmj (mgr.34412) 7050 : cluster [DBG] pgmap v4010: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:09.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:02:08 gibba015 bash[30343]: cluster 2021-03-10T16:02:08.765972+0000 mgr.gibba045.orlgmj (mgr.34412) 7050 : cluster [DBG] pgmap v4010: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:09.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:02:08 gibba045 bash[25517]: cluster 2021-03-10T16:02:08.765972+0000 mgr.gibba045.orlgmj (mgr.34412) 7050 : cluster [DBG] pgmap v4010: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:11.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:02:11 gibba045 bash[25517]: cluster 2021-03-10T16:02:10.767712+0000 mgr.gibba045.orlgmj (mgr.34412) 7051 : cluster [DBG] pgmap v4011: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:11.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:02:11 gibba015 bash[29377]: cluster 2021-03-10T16:02:10.767712+0000 mgr.gibba045.orlgmj (mgr.34412) 7051 : cluster [DBG] pgmap v4011: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:11.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:02:11 gibba015 bash[30343]: cluster 2021-03-10T16:02:10.767712+0000 mgr.gibba045.orlgmj (mgr.34412) 7051 : cluster [DBG] pgmap v4011: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:14.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:02:13 gibba015 bash[29377]: cluster 2021-03-10T16:02:12.769150+0000 mgr.gibba045.orlgmj (mgr.34412) 7052 : cluster [DBG] pgmap v4012: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:14.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:02:13 gibba015 bash[30343]: cluster 2021-03-10T16:02:12.769150+0000 mgr.gibba045.orlgmj (mgr.34412) 7052 : cluster [DBG] pgmap v4012: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:14.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:02:13 gibba045 bash[25517]: cluster 2021-03-10T16:02:12.769150+0000 mgr.gibba045.orlgmj (mgr.34412) 7052 : cluster [DBG] pgmap v4012: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:15.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:02:14 gibba015 bash[29377]: cluster 2021-03-10T16:02:14.770699+0000 mgr.gibba045.orlgmj (mgr.34412) 7053 : cluster [DBG] pgmap v4013: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:15.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:02:14 gibba015 bash[30343]: cluster 2021-03-10T16:02:14.770699+0000 mgr.gibba045.orlgmj (mgr.34412) 7053 : cluster [DBG] pgmap v4013: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:15.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:02:14 gibba045 bash[25517]: cluster 2021-03-10T16:02:14.770699+0000 mgr.gibba045.orlgmj (mgr.34412) 7053 : cluster [DBG] pgmap v4013: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:17.114 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:02:17.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:02:16 gibba015 bash[29377]: cluster 2021-03-10T16:02:16.772515+0000 mgr.gibba045.orlgmj (mgr.34412) 7054 : cluster [DBG] pgmap v4014: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:17.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:02:16 gibba015 bash[30343]: cluster 2021-03-10T16:02:16.772515+0000 mgr.gibba045.orlgmj (mgr.34412) 7054 : cluster [DBG] pgmap v4014: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:17.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:02:16 gibba045 bash[25517]: cluster 2021-03-10T16:02:16.772515+0000 mgr.gibba045.orlgmj (mgr.34412) 7054 : cluster [DBG] pgmap v4014: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:17.344 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:02:17.344 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 6m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:02:17.344 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 5m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:02:17.345 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:02:17.345 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:02:17.345 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:02:17.345 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:02:17.345 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:02:17.346 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:02:17.346 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 6m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:02:17.346 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 5m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:02:17.346 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:02:17.347 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:02:17.347 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:02:17.347 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:02:17.347 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:02:17.347 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:02:17.348 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:02:17.348 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:02:17.348 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 5m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:02:17.348 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 5m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:02:17.592 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:02:17.592 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:02:17.592 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:02:17.592 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:02:17.592 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:02:17.593 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:02:17.593 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:02:17.593 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:02:17.593 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:02:17.594 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:02:17.594 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:02:17.594 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:02:17.594 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:02:17.595 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:02:17.595 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:02:18.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:02:17 gibba015 bash[29377]: audit 2021-03-10T16:02:17.106593+0000 mgr.gibba045.orlgmj (mgr.34412) 7055 : audit [DBG] from='client.48786 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:02:18.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:02:17 gibba015 bash[29377]: audit 2021-03-10T16:02:17.333442+0000 mgr.gibba045.orlgmj (mgr.34412) 7056 : audit [DBG] from='client.48792 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:02:18.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:02:17 gibba015 bash[29377]: cephadm 2021-03-10T16:02:17.542079+0000 mgr.gibba045.orlgmj (mgr.34412) 7057 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:02:18.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:02:17 gibba015 bash[29377]: audit 2021-03-10T16:02:17.591084+0000 mon.a (mon.0) 1681 : audit [DBG] from='client.? 172.21.2.115:0/2171094227' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:02:18.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:02:17 gibba015 bash[30343]: audit 2021-03-10T16:02:17.106593+0000 mgr.gibba045.orlgmj (mgr.34412) 7055 : audit [DBG] from='client.48786 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:02:18.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:02:17 gibba015 bash[30343]: audit 2021-03-10T16:02:17.333442+0000 mgr.gibba045.orlgmj (mgr.34412) 7056 : audit [DBG] from='client.48792 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:02:18.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:02:17 gibba015 bash[30343]: cephadm 2021-03-10T16:02:17.542079+0000 mgr.gibba045.orlgmj (mgr.34412) 7057 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:02:18.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:02:17 gibba015 bash[30343]: audit 2021-03-10T16:02:17.591084+0000 mon.a (mon.0) 1681 : audit [DBG] from='client.? 172.21.2.115:0/2171094227' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:02:18.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:02:17 gibba045 bash[25517]: audit 2021-03-10T16:02:17.106593+0000 mgr.gibba045.orlgmj (mgr.34412) 7055 : audit [DBG] from='client.48786 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:02:18.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:02:17 gibba045 bash[25517]: audit 2021-03-10T16:02:17.333442+0000 mgr.gibba045.orlgmj (mgr.34412) 7056 : audit [DBG] from='client.48792 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:02:18.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:02:17 gibba045 bash[25517]: cephadm 2021-03-10T16:02:17.542079+0000 mgr.gibba045.orlgmj (mgr.34412) 7057 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:02:18.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:02:17 gibba045 bash[25517]: audit 2021-03-10T16:02:17.591084+0000 mon.a (mon.0) 1681 : audit [DBG] from='client.? 172.21.2.115:0/2171094227' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:02:19.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:02:18 gibba015 bash[29377]: cluster 2021-03-10T16:02:18.773711+0000 mgr.gibba045.orlgmj (mgr.34412) 7058 : cluster [DBG] pgmap v4015: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:19.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:02:18 gibba015 bash[30343]: cluster 2021-03-10T16:02:18.773711+0000 mgr.gibba045.orlgmj (mgr.34412) 7058 : cluster [DBG] pgmap v4015: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:19.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:02:18 gibba045 bash[25517]: cluster 2021-03-10T16:02:18.773711+0000 mgr.gibba045.orlgmj (mgr.34412) 7058 : cluster [DBG] pgmap v4015: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:21.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:02:21 gibba045 bash[25517]: cluster 2021-03-10T16:02:20.775533+0000 mgr.gibba045.orlgmj (mgr.34412) 7059 : cluster [DBG] pgmap v4016: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:21.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:02:21 gibba015 bash[29377]: cluster 2021-03-10T16:02:20.775533+0000 mgr.gibba045.orlgmj (mgr.34412) 7059 : cluster [DBG] pgmap v4016: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:21.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:02:21 gibba015 bash[30343]: cluster 2021-03-10T16:02:20.775533+0000 mgr.gibba045.orlgmj (mgr.34412) 7059 : cluster [DBG] pgmap v4016: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:23.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:02:22 gibba015 bash[29377]: cluster 2021-03-10T16:02:22.777144+0000 mgr.gibba045.orlgmj (mgr.34412) 7060 : cluster [DBG] pgmap v4017: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:23.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:02:22 gibba015 bash[30343]: cluster 2021-03-10T16:02:22.777144+0000 mgr.gibba045.orlgmj (mgr.34412) 7060 : cluster [DBG] pgmap v4017: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:23.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:02:22 gibba045 bash[25517]: cluster 2021-03-10T16:02:22.777144+0000 mgr.gibba045.orlgmj (mgr.34412) 7060 : cluster [DBG] pgmap v4017: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:25.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:02:24 gibba015 bash[29377]: cluster 2021-03-10T16:02:24.778914+0000 mgr.gibba045.orlgmj (mgr.34412) 7061 : cluster [DBG] pgmap v4018: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:25.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:02:24 gibba015 bash[30343]: cluster 2021-03-10T16:02:24.778914+0000 mgr.gibba045.orlgmj (mgr.34412) 7061 : cluster [DBG] pgmap v4018: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:25.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:02:24 gibba045 bash[25517]: cluster 2021-03-10T16:02:24.778914+0000 mgr.gibba045.orlgmj (mgr.34412) 7061 : cluster [DBG] pgmap v4018: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:27.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:02:26 gibba015 bash[29377]: cluster 2021-03-10T16:02:26.780747+0000 mgr.gibba045.orlgmj (mgr.34412) 7062 : cluster [DBG] pgmap v4019: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:27.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:02:26 gibba015 bash[30343]: cluster 2021-03-10T16:02:26.780747+0000 mgr.gibba045.orlgmj (mgr.34412) 7062 : cluster [DBG] pgmap v4019: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:27.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:02:26 gibba045 bash[25517]: cluster 2021-03-10T16:02:26.780747+0000 mgr.gibba045.orlgmj (mgr.34412) 7062 : cluster [DBG] pgmap v4019: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:29.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:02:28 gibba015 bash[29377]: cluster 2021-03-10T16:02:28.781927+0000 mgr.gibba045.orlgmj (mgr.34412) 7063 : cluster [DBG] pgmap v4020: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:29.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:02:28 gibba015 bash[30343]: cluster 2021-03-10T16:02:28.781927+0000 mgr.gibba045.orlgmj (mgr.34412) 7063 : cluster [DBG] pgmap v4020: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:29.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:02:28 gibba045 bash[25517]: cluster 2021-03-10T16:02:28.781927+0000 mgr.gibba045.orlgmj (mgr.34412) 7063 : cluster [DBG] pgmap v4020: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:31.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:02:31 gibba045 bash[25517]: cluster 2021-03-10T16:02:30.783695+0000 mgr.gibba045.orlgmj (mgr.34412) 7064 : cluster [DBG] pgmap v4021: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:31.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:02:31 gibba015 bash[29377]: cluster 2021-03-10T16:02:30.783695+0000 mgr.gibba045.orlgmj (mgr.34412) 7064 : cluster [DBG] pgmap v4021: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:31.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:02:31 gibba015 bash[30343]: cluster 2021-03-10T16:02:30.783695+0000 mgr.gibba045.orlgmj (mgr.34412) 7064 : cluster [DBG] pgmap v4021: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:33.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:02:32 gibba015 bash[29377]: cephadm 2021-03-10T16:02:32.558098+0000 mgr.gibba045.orlgmj (mgr.34412) 7065 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:02:33.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:02:32 gibba015 bash[29377]: cluster 2021-03-10T16:02:32.785249+0000 mgr.gibba045.orlgmj (mgr.34412) 7066 : cluster [DBG] pgmap v4022: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:33.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:02:32 gibba015 bash[30343]: cephadm 2021-03-10T16:02:32.558098+0000 mgr.gibba045.orlgmj (mgr.34412) 7065 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:02:33.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:02:32 gibba015 bash[30343]: cluster 2021-03-10T16:02:32.785249+0000 mgr.gibba045.orlgmj (mgr.34412) 7066 : cluster [DBG] pgmap v4022: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:33.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:02:32 gibba045 bash[25517]: cephadm 2021-03-10T16:02:32.558098+0000 mgr.gibba045.orlgmj (mgr.34412) 7065 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:02:33.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:02:32 gibba045 bash[25517]: cluster 2021-03-10T16:02:32.785249+0000 mgr.gibba045.orlgmj (mgr.34412) 7066 : cluster [DBG] pgmap v4022: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:35.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:02:34 gibba015 bash[29377]: cluster 2021-03-10T16:02:34.786987+0000 mgr.gibba045.orlgmj (mgr.34412) 7067 : cluster [DBG] pgmap v4023: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:35.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:02:34 gibba015 bash[30343]: cluster 2021-03-10T16:02:34.786987+0000 mgr.gibba045.orlgmj (mgr.34412) 7067 : cluster [DBG] pgmap v4023: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:35.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:02:34 gibba045 bash[25517]: cluster 2021-03-10T16:02:34.786987+0000 mgr.gibba045.orlgmj (mgr.34412) 7067 : cluster [DBG] pgmap v4023: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:37.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:02:36 gibba015 bash[29377]: cluster 2021-03-10T16:02:36.788816+0000 mgr.gibba045.orlgmj (mgr.34412) 7068 : cluster [DBG] pgmap v4024: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:37.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:02:36 gibba015 bash[30343]: cluster 2021-03-10T16:02:36.788816+0000 mgr.gibba045.orlgmj (mgr.34412) 7068 : cluster [DBG] pgmap v4024: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:37.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:02:36 gibba045 bash[25517]: cluster 2021-03-10T16:02:36.788816+0000 mgr.gibba045.orlgmj (mgr.34412) 7068 : cluster [DBG] pgmap v4024: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:39.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:02:38 gibba015 bash[29377]: cluster 2021-03-10T16:02:38.790079+0000 mgr.gibba045.orlgmj (mgr.34412) 7069 : cluster [DBG] pgmap v4025: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:39.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:02:38 gibba015 bash[30343]: cluster 2021-03-10T16:02:38.790079+0000 mgr.gibba045.orlgmj (mgr.34412) 7069 : cluster [DBG] pgmap v4025: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:39.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:02:38 gibba045 bash[25517]: cluster 2021-03-10T16:02:38.790079+0000 mgr.gibba045.orlgmj (mgr.34412) 7069 : cluster [DBG] pgmap v4025: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:41.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:02:41 gibba045 bash[25517]: cluster 2021-03-10T16:02:40.791841+0000 mgr.gibba045.orlgmj (mgr.34412) 7070 : cluster [DBG] pgmap v4026: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:41.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:02:41 gibba015 bash[29377]: cluster 2021-03-10T16:02:40.791841+0000 mgr.gibba045.orlgmj (mgr.34412) 7070 : cluster [DBG] pgmap v4026: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:41.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:02:41 gibba015 bash[30343]: cluster 2021-03-10T16:02:40.791841+0000 mgr.gibba045.orlgmj (mgr.34412) 7070 : cluster [DBG] pgmap v4026: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:43.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:02:42 gibba015 bash[29377]: cluster 2021-03-10T16:02:42.793520+0000 mgr.gibba045.orlgmj (mgr.34412) 7071 : cluster [DBG] pgmap v4027: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:43.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:02:42 gibba015 bash[30343]: cluster 2021-03-10T16:02:42.793520+0000 mgr.gibba045.orlgmj (mgr.34412) 7071 : cluster [DBG] pgmap v4027: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:43.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:02:42 gibba045 bash[25517]: cluster 2021-03-10T16:02:42.793520+0000 mgr.gibba045.orlgmj (mgr.34412) 7071 : cluster [DBG] pgmap v4027: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:45.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:02:44 gibba015 bash[29377]: cluster 2021-03-10T16:02:44.795242+0000 mgr.gibba045.orlgmj (mgr.34412) 7072 : cluster [DBG] pgmap v4028: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:45.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:02:44 gibba015 bash[30343]: cluster 2021-03-10T16:02:44.795242+0000 mgr.gibba045.orlgmj (mgr.34412) 7072 : cluster [DBG] pgmap v4028: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:45.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:02:44 gibba045 bash[25517]: cluster 2021-03-10T16:02:44.795242+0000 mgr.gibba045.orlgmj (mgr.34412) 7072 : cluster [DBG] pgmap v4028: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:47.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:02:46 gibba015 bash[29377]: cluster 2021-03-10T16:02:46.796696+0000 mgr.gibba045.orlgmj (mgr.34412) 7073 : cluster [DBG] pgmap v4029: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:47.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:02:46 gibba015 bash[30343]: cluster 2021-03-10T16:02:46.796696+0000 mgr.gibba045.orlgmj (mgr.34412) 7073 : cluster [DBG] pgmap v4029: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:47.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:02:46 gibba045 bash[25517]: cluster 2021-03-10T16:02:46.796696+0000 mgr.gibba045.orlgmj (mgr.34412) 7073 : cluster [DBG] pgmap v4029: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:47.845 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:02:48.080 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:02:48.080 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 7m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:02:48.080 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 6m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:02:48.080 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:02:48.081 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:02:48.081 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:02:48.081 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:02:48.081 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:02:48.082 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:02:48.082 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 7m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:02:48.082 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 6m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:02:48.083 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:02:48.083 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:02:48.083 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:02:48.083 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:02:48.084 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:02:48.084 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:02:48.084 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:02:48.084 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:02:48.085 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 6m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:02:48.085 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 6m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:02:48.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:02:47 gibba015 bash[29377]: audit 2021-03-10T16:02:47.572583+0000 mon.c (mon.1) 1961 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:02:48.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:02:47 gibba015 bash[29377]: audit 2021-03-10T16:02:47.782909+0000 mon.a (mon.0) 1682 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:02:48.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:02:47 gibba015 bash[29377]: audit 2021-03-10T16:02:47.786022+0000 mon.a (mon.0) 1683 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:02:48.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:02:47 gibba015 bash[29377]: cephadm 2021-03-10T16:02:47.786443+0000 mgr.gibba045.orlgmj (mgr.34412) 7074 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:02:48.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:02:47 gibba015 bash[29377]: cephadm 2021-03-10T16:02:47.790407+0000 mgr.gibba045.orlgmj (mgr.34412) 7075 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:02:48.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:02:47 gibba015 bash[29377]: audit 2021-03-10T16:02:47.835464+0000 mgr.gibba045.orlgmj (mgr.34412) 7076 : audit [DBG] from='client.58792 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:02:48.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:02:47 gibba015 bash[30343]: audit 2021-03-10T16:02:47.572583+0000 mon.c (mon.1) 1961 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:02:48.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:02:47 gibba015 bash[30343]: audit 2021-03-10T16:02:47.782909+0000 mon.a (mon.0) 1682 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:02:48.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:02:47 gibba015 bash[30343]: audit 2021-03-10T16:02:47.786022+0000 mon.a (mon.0) 1683 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:02:48.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:02:47 gibba015 bash[30343]: cephadm 2021-03-10T16:02:47.786443+0000 mgr.gibba045.orlgmj (mgr.34412) 7074 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:02:48.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:02:47 gibba015 bash[30343]: cephadm 2021-03-10T16:02:47.790407+0000 mgr.gibba045.orlgmj (mgr.34412) 7075 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:02:48.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:02:47 gibba015 bash[30343]: audit 2021-03-10T16:02:47.835464+0000 mgr.gibba045.orlgmj (mgr.34412) 7076 : audit [DBG] from='client.58792 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:02:48.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:02:47 gibba045 bash[25517]: audit 2021-03-10T16:02:47.572583+0000 mon.c (mon.1) 1961 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:02:48.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:02:47 gibba045 bash[25517]: audit 2021-03-10T16:02:47.782909+0000 mon.a (mon.0) 1682 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:02:48.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:02:47 gibba045 bash[25517]: audit 2021-03-10T16:02:47.786022+0000 mon.a (mon.0) 1683 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:02:48.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:02:47 gibba045 bash[25517]: cephadm 2021-03-10T16:02:47.786443+0000 mgr.gibba045.orlgmj (mgr.34412) 7074 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:02:48.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:02:47 gibba045 bash[25517]: cephadm 2021-03-10T16:02:47.790407+0000 mgr.gibba045.orlgmj (mgr.34412) 7075 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:02:48.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:02:47 gibba045 bash[25517]: audit 2021-03-10T16:02:47.835464+0000 mgr.gibba045.orlgmj (mgr.34412) 7076 : audit [DBG] from='client.58792 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:02:48.332 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:02:48.332 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:02:48.332 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:02:48.333 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:02:48.333 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:02:48.333 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:02:48.333 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:02:48.333 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:02:48.334 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:02:48.334 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:02:48.334 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:02:48.334 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:02:48.335 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:02:48.335 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:02:48.335 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:02:49.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:02:49 gibba045 bash[25517]: audit 2021-03-10T16:02:48.002869+0000 mon.a (mon.0) 1684 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:02:49.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:02:49 gibba045 bash[25517]: audit 2021-03-10T16:02:48.006125+0000 mon.c (mon.1) 1962 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:02:49.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:02:49 gibba045 bash[25517]: audit 2021-03-10T16:02:48.007463+0000 mon.c (mon.1) 1963 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:02:49.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:02:49 gibba045 bash[25517]: cephadm 2021-03-10T16:02:48.007926+0000 mgr.gibba045.orlgmj (mgr.34412) 7077 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:02:49.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:02:49 gibba045 bash[25517]: audit 2021-03-10T16:02:48.008667+0000 mon.c (mon.1) 1964 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:02:49.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:02:49 gibba045 bash[25517]: audit 2021-03-10T16:02:48.009505+0000 mon.c (mon.1) 1965 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:02:49.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:02:49 gibba045 bash[25517]: cephadm 2021-03-10T16:02:48.009603+0000 mgr.gibba045.orlgmj (mgr.34412) 7078 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:02:49.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:02:49 gibba045 bash[25517]: cephadm 2021-03-10T16:02:48.010815+0000 mgr.gibba045.orlgmj (mgr.34412) 7079 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:02:49.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:02:49 gibba045 bash[25517]: cephadm 2021-03-10T16:02:48.010853+0000 mgr.gibba045.orlgmj (mgr.34412) 7080 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:02:49.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:02:49 gibba045 bash[25517]: audit 2021-03-10T16:02:48.011685+0000 mon.c (mon.1) 1966 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:02:49.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:02:49 gibba045 bash[25517]: cephadm 2021-03-10T16:02:48.011749+0000 mgr.gibba045.orlgmj (mgr.34412) 7081 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:02:49.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:02:49 gibba045 bash[25517]: cephadm 2021-03-10T16:02:48.011785+0000 mgr.gibba045.orlgmj (mgr.34412) 7082 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:02:49.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:02:49 gibba045 bash[25517]: cephadm 2021-03-10T16:02:48.012618+0000 mgr.gibba045.orlgmj (mgr.34412) 7083 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:02:49.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:02:49 gibba045 bash[25517]: audit 2021-03-10T16:02:48.012927+0000 mon.c (mon.1) 1967 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:02:49.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:02:49 gibba045 bash[25517]: cephadm 2021-03-10T16:02:48.013754+0000 mgr.gibba045.orlgmj (mgr.34412) 7084 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:02:49.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:02:49 gibba045 bash[25517]: cephadm 2021-03-10T16:02:48.013791+0000 mgr.gibba045.orlgmj (mgr.34412) 7085 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:02:49.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:02:49 gibba045 bash[25517]: cephadm 2021-03-10T16:02:48.014806+0000 mgr.gibba045.orlgmj (mgr.34412) 7086 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:02:49.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:02:49 gibba045 bash[25517]: cephadm 2021-03-10T16:02:48.015123+0000 mgr.gibba045.orlgmj (mgr.34412) 7087 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:02:49.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:02:49 gibba045 bash[25517]: cephadm 2021-03-10T16:02:48.016082+0000 mgr.gibba045.orlgmj (mgr.34412) 7088 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:02:49.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:02:49 gibba045 bash[25517]: cephadm 2021-03-10T16:02:48.016221+0000 mgr.gibba045.orlgmj (mgr.34412) 7089 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:02:49.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:02:49 gibba045 bash[25517]: cephadm 2021-03-10T16:02:48.016328+0000 mgr.gibba045.orlgmj (mgr.34412) 7090 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:02:49.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:02:49 gibba045 bash[25517]: audit 2021-03-10T16:02:48.065422+0000 mgr.gibba045.orlgmj (mgr.34412) 7091 : audit [DBG] from='client.48810 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:02:49.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:02:49 gibba045 bash[25517]: audit 2021-03-10T16:02:48.331344+0000 mon.c (mon.1) 1968 : audit [DBG] from='client.? 172.21.2.115:0/2928498105' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:02:49.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:02:49 gibba045 bash[25517]: cluster 2021-03-10T16:02:48.798536+0000 mgr.gibba045.orlgmj (mgr.34412) 7092 : cluster [DBG] pgmap v4030: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:49.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:02:49 gibba015 bash[29377]: audit 2021-03-10T16:02:48.002869+0000 mon.a (mon.0) 1684 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:02:49.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:02:49 gibba015 bash[29377]: audit 2021-03-10T16:02:48.006125+0000 mon.c (mon.1) 1962 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:02:49.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:02:49 gibba015 bash[29377]: audit 2021-03-10T16:02:48.007463+0000 mon.c (mon.1) 1963 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:02:49.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:02:49 gibba015 bash[29377]: cephadm 2021-03-10T16:02:48.007926+0000 mgr.gibba045.orlgmj (mgr.34412) 7077 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:02:49.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:02:49 gibba015 bash[29377]: audit 2021-03-10T16:02:48.008667+0000 mon.c (mon.1) 1964 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:02:49.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:02:49 gibba015 bash[29377]: audit 2021-03-10T16:02:48.009505+0000 mon.c (mon.1) 1965 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:02:49.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:02:49 gibba015 bash[29377]: cephadm 2021-03-10T16:02:48.009603+0000 mgr.gibba045.orlgmj (mgr.34412) 7078 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:02:49.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:02:49 gibba015 bash[29377]: cephadm 2021-03-10T16:02:48.010815+0000 mgr.gibba045.orlgmj (mgr.34412) 7079 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:02:49.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:02:49 gibba015 bash[29377]: cephadm 2021-03-10T16:02:48.010853+0000 mgr.gibba045.orlgmj (mgr.34412) 7080 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:02:49.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:02:49 gibba015 bash[29377]: audit 2021-03-10T16:02:48.011685+0000 mon.c (mon.1) 1966 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:02:49.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:02:49 gibba015 bash[29377]: cephadm 2021-03-10T16:02:48.011749+0000 mgr.gibba045.orlgmj (mgr.34412) 7081 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:02:49.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:02:49 gibba015 bash[29377]: cephadm 2021-03-10T16:02:48.011785+0000 mgr.gibba045.orlgmj (mgr.34412) 7082 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:02:49.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:02:49 gibba015 bash[29377]: cephadm 2021-03-10T16:02:48.012618+0000 mgr.gibba045.orlgmj (mgr.34412) 7083 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:02:49.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:02:49 gibba015 bash[29377]: audit 2021-03-10T16:02:48.012927+0000 mon.c (mon.1) 1967 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:02:49.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:02:49 gibba015 bash[29377]: cephadm 2021-03-10T16:02:48.013754+0000 mgr.gibba045.orlgmj (mgr.34412) 7084 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:02:49.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:02:49 gibba015 bash[29377]: cephadm 2021-03-10T16:02:48.013791+0000 mgr.gibba045.orlgmj (mgr.34412) 7085 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:02:49.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:02:49 gibba015 bash[29377]: cephadm 2021-03-10T16:02:48.014806+0000 mgr.gibba045.orlgmj (mgr.34412) 7086 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:02:49.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:02:49 gibba015 bash[29377]: cephadm 2021-03-10T16:02:48.015123+0000 mgr.gibba045.orlgmj (mgr.34412) 7087 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:02:49.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:02:49 gibba015 bash[29377]: cephadm 2021-03-10T16:02:48.016082+0000 mgr.gibba045.orlgmj (mgr.34412) 7088 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:02:49.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:02:49 gibba015 bash[29377]: cephadm 2021-03-10T16:02:48.016221+0000 mgr.gibba045.orlgmj (mgr.34412) 7089 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:02:49.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:02:49 gibba015 bash[30343]: audit 2021-03-10T16:02:48.002869+0000 mon.a (mon.0) 1684 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:02:49.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:02:49 gibba015 bash[30343]: audit 2021-03-10T16:02:48.006125+0000 mon.c (mon.1) 1962 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:02:49.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:02:49 gibba015 bash[30343]: audit 2021-03-10T16:02:48.007463+0000 mon.c (mon.1) 1963 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:02:49.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:02:49 gibba015 bash[30343]: cephadm 2021-03-10T16:02:48.007926+0000 mgr.gibba045.orlgmj (mgr.34412) 7077 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:02:49.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:02:49 gibba015 bash[30343]: audit 2021-03-10T16:02:48.008667+0000 mon.c (mon.1) 1964 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:02:49.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:02:49 gibba015 bash[30343]: audit 2021-03-10T16:02:48.009505+0000 mon.c (mon.1) 1965 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:02:49.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:02:49 gibba015 bash[30343]: cephadm 2021-03-10T16:02:48.009603+0000 mgr.gibba045.orlgmj (mgr.34412) 7078 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:02:49.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:02:49 gibba015 bash[30343]: cephadm 2021-03-10T16:02:48.010815+0000 mgr.gibba045.orlgmj (mgr.34412) 7079 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:02:49.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:02:49 gibba015 bash[30343]: cephadm 2021-03-10T16:02:48.010853+0000 mgr.gibba045.orlgmj (mgr.34412) 7080 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:02:49.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:02:49 gibba015 bash[30343]: audit 2021-03-10T16:02:48.011685+0000 mon.c (mon.1) 1966 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:02:49.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:02:49 gibba015 bash[30343]: cephadm 2021-03-10T16:02:48.011749+0000 mgr.gibba045.orlgmj (mgr.34412) 7081 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:02:49.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:02:49 gibba015 bash[30343]: cephadm 2021-03-10T16:02:48.011785+0000 mgr.gibba045.orlgmj (mgr.34412) 7082 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:02:49.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:02:49 gibba015 bash[30343]: cephadm 2021-03-10T16:02:48.012618+0000 mgr.gibba045.orlgmj (mgr.34412) 7083 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:02:49.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:02:49 gibba015 bash[30343]: audit 2021-03-10T16:02:48.012927+0000 mon.c (mon.1) 1967 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:02:49.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:02:49 gibba015 bash[30343]: cephadm 2021-03-10T16:02:48.013754+0000 mgr.gibba045.orlgmj (mgr.34412) 7084 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:02:49.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:02:49 gibba015 bash[30343]: cephadm 2021-03-10T16:02:48.013791+0000 mgr.gibba045.orlgmj (mgr.34412) 7085 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:02:49.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:02:49 gibba015 bash[30343]: cephadm 2021-03-10T16:02:48.014806+0000 mgr.gibba045.orlgmj (mgr.34412) 7086 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:02:49.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:02:49 gibba015 bash[30343]: cephadm 2021-03-10T16:02:48.015123+0000 mgr.gibba045.orlgmj (mgr.34412) 7087 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:02:49.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:02:49 gibba015 bash[30343]: cephadm 2021-03-10T16:02:48.016082+0000 mgr.gibba045.orlgmj (mgr.34412) 7088 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:02:49.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:02:49 gibba015 bash[30343]: cephadm 2021-03-10T16:02:48.016221+0000 mgr.gibba045.orlgmj (mgr.34412) 7089 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:02:49.482 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:02:49 gibba015 bash[29377]: cephadm 2021-03-10T16:02:48.016328+0000 mgr.gibba045.orlgmj (mgr.34412) 7090 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:02:49.482 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:02:49 gibba015 bash[29377]: audit 2021-03-10T16:02:48.065422+0000 mgr.gibba045.orlgmj (mgr.34412) 7091 : audit [DBG] from='client.48810 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:02:49.482 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:02:49 gibba015 bash[29377]: audit 2021-03-10T16:02:48.331344+0000 mon.c (mon.1) 1968 : audit [DBG] from='client.? 172.21.2.115:0/2928498105' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:02:49.482 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:02:49 gibba015 bash[29377]: cluster 2021-03-10T16:02:48.798536+0000 mgr.gibba045.orlgmj (mgr.34412) 7092 : cluster [DBG] pgmap v4030: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:49.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:02:49 gibba015 bash[30343]: cephadm 2021-03-10T16:02:48.016328+0000 mgr.gibba045.orlgmj (mgr.34412) 7090 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:02:49.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:02:49 gibba015 bash[30343]: audit 2021-03-10T16:02:48.065422+0000 mgr.gibba045.orlgmj (mgr.34412) 7091 : audit [DBG] from='client.48810 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:02:49.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:02:49 gibba015 bash[30343]: audit 2021-03-10T16:02:48.331344+0000 mon.c (mon.1) 1968 : audit [DBG] from='client.? 172.21.2.115:0/2928498105' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:02:49.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:02:49 gibba015 bash[30343]: cluster 2021-03-10T16:02:48.798536+0000 mgr.gibba045.orlgmj (mgr.34412) 7092 : cluster [DBG] pgmap v4030: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:51.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:02:51 gibba015 bash[29377]: cluster 2021-03-10T16:02:50.800347+0000 mgr.gibba045.orlgmj (mgr.34412) 7093 : cluster [DBG] pgmap v4031: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:51.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:02:51 gibba015 bash[30343]: cluster 2021-03-10T16:02:50.800347+0000 mgr.gibba045.orlgmj (mgr.34412) 7093 : cluster [DBG] pgmap v4031: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:51.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:02:51 gibba045 bash[25517]: cluster 2021-03-10T16:02:50.800347+0000 mgr.gibba045.orlgmj (mgr.34412) 7093 : cluster [DBG] pgmap v4031: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:53.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:02:52 gibba015 bash[29377]: cluster 2021-03-10T16:02:52.801981+0000 mgr.gibba045.orlgmj (mgr.34412) 7094 : cluster [DBG] pgmap v4032: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:53.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:02:52 gibba015 bash[30343]: cluster 2021-03-10T16:02:52.801981+0000 mgr.gibba045.orlgmj (mgr.34412) 7094 : cluster [DBG] pgmap v4032: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:53.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:02:52 gibba045 bash[25517]: cluster 2021-03-10T16:02:52.801981+0000 mgr.gibba045.orlgmj (mgr.34412) 7094 : cluster [DBG] pgmap v4032: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:54.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:02:53 gibba015 bash[29377]: audit 2021-03-10T16:02:53.398251+0000 mon.c (mon.1) 1969 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:02:54.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:02:53 gibba015 bash[29377]: audit 2021-03-10T16:02:53.398938+0000 mon.c (mon.1) 1970 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:02:54.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:02:53 gibba015 bash[29377]: audit 2021-03-10T16:02:53.399406+0000 mon.a (mon.0) 1685 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:02:54.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:02:53 gibba015 bash[29377]: audit 2021-03-10T16:02:53.399678+0000 mon.c (mon.1) 1971 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T16:02:54.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:02:53 gibba015 bash[29377]: audit 2021-03-10T16:02:53.400599+0000 mon.c (mon.1) 1972 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:02:54.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:02:53 gibba015 bash[29377]: audit 2021-03-10T16:02:53.400602+0000 mon.a (mon.0) 1686 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:02:54.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:02:53 gibba015 bash[29377]: audit 2021-03-10T16:02:53.401475+0000 mon.c (mon.1) 1973 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:02:54.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:02:53 gibba015 bash[29377]: audit 2021-03-10T16:02:53.401543+0000 mon.a (mon.0) 1687 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T16:02:54.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:02:53 gibba015 bash[29377]: audit 2021-03-10T16:02:53.402176+0000 mon.c (mon.1) 1974 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:02:54.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:02:53 gibba015 bash[29377]: audit 2021-03-10T16:02:53.402710+0000 mon.a (mon.0) 1688 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:02:54.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:02:53 gibba015 bash[29377]: audit 2021-03-10T16:02:53.403972+0000 mon.a (mon.0) 1689 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:02:54.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:02:53 gibba015 bash[29377]: audit 2021-03-10T16:02:53.404797+0000 mon.a (mon.0) 1690 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:02:54.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:02:53 gibba015 bash[30343]: audit 2021-03-10T16:02:53.398251+0000 mon.c (mon.1) 1969 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:02:54.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:02:53 gibba015 bash[30343]: audit 2021-03-10T16:02:53.398938+0000 mon.c (mon.1) 1970 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:02:54.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:02:53 gibba015 bash[30343]: audit 2021-03-10T16:02:53.399406+0000 mon.a (mon.0) 1685 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:02:54.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:02:53 gibba015 bash[30343]: audit 2021-03-10T16:02:53.399678+0000 mon.c (mon.1) 1971 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T16:02:54.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:02:53 gibba015 bash[30343]: audit 2021-03-10T16:02:53.400599+0000 mon.c (mon.1) 1972 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:02:54.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:02:53 gibba015 bash[30343]: audit 2021-03-10T16:02:53.400602+0000 mon.a (mon.0) 1686 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:02:54.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:02:53 gibba015 bash[30343]: audit 2021-03-10T16:02:53.401475+0000 mon.c (mon.1) 1973 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:02:54.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:02:53 gibba015 bash[30343]: audit 2021-03-10T16:02:53.401543+0000 mon.a (mon.0) 1687 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T16:02:54.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:02:53 gibba015 bash[30343]: audit 2021-03-10T16:02:53.402176+0000 mon.c (mon.1) 1974 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:02:54.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:02:53 gibba015 bash[30343]: audit 2021-03-10T16:02:53.402710+0000 mon.a (mon.0) 1688 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:02:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:02:53 gibba015 bash[30343]: audit 2021-03-10T16:02:53.403972+0000 mon.a (mon.0) 1689 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:02:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:02:53 gibba015 bash[30343]: audit 2021-03-10T16:02:53.404797+0000 mon.a (mon.0) 1690 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:02:54.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:02:53 gibba045 bash[25517]: audit 2021-03-10T16:02:53.398251+0000 mon.c (mon.1) 1969 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:02:54.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:02:53 gibba045 bash[25517]: audit 2021-03-10T16:02:53.398938+0000 mon.c (mon.1) 1970 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:02:54.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:02:53 gibba045 bash[25517]: audit 2021-03-10T16:02:53.399406+0000 mon.a (mon.0) 1685 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:02:54.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:02:53 gibba045 bash[25517]: audit 2021-03-10T16:02:53.399678+0000 mon.c (mon.1) 1971 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T16:02:54.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:02:53 gibba045 bash[25517]: audit 2021-03-10T16:02:53.400599+0000 mon.c (mon.1) 1972 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:02:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:02:53 gibba045 bash[25517]: audit 2021-03-10T16:02:53.400602+0000 mon.a (mon.0) 1686 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:02:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:02:53 gibba045 bash[25517]: audit 2021-03-10T16:02:53.401475+0000 mon.c (mon.1) 1973 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:02:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:02:53 gibba045 bash[25517]: audit 2021-03-10T16:02:53.401543+0000 mon.a (mon.0) 1687 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T16:02:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:02:53 gibba045 bash[25517]: audit 2021-03-10T16:02:53.402176+0000 mon.c (mon.1) 1974 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:02:54.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:02:53 gibba045 bash[25517]: audit 2021-03-10T16:02:53.402710+0000 mon.a (mon.0) 1688 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:02:54.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:02:53 gibba045 bash[25517]: audit 2021-03-10T16:02:53.403972+0000 mon.a (mon.0) 1689 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:02:54.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:02:53 gibba045 bash[25517]: audit 2021-03-10T16:02:53.404797+0000 mon.a (mon.0) 1690 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:02:55.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:02:54 gibba015 bash[29377]: cluster 2021-03-10T16:02:54.803579+0000 mgr.gibba045.orlgmj (mgr.34412) 7095 : cluster [DBG] pgmap v4033: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:55.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:02:54 gibba015 bash[30343]: cluster 2021-03-10T16:02:54.803579+0000 mgr.gibba045.orlgmj (mgr.34412) 7095 : cluster [DBG] pgmap v4033: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:55.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:02:54 gibba045 bash[25517]: cluster 2021-03-10T16:02:54.803579+0000 mgr.gibba045.orlgmj (mgr.34412) 7095 : cluster [DBG] pgmap v4033: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:57.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:02:56 gibba015 bash[29377]: cluster 2021-03-10T16:02:56.805420+0000 mgr.gibba045.orlgmj (mgr.34412) 7096 : cluster [DBG] pgmap v4034: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:57.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:02:56 gibba015 bash[30343]: cluster 2021-03-10T16:02:56.805420+0000 mgr.gibba045.orlgmj (mgr.34412) 7096 : cluster [DBG] pgmap v4034: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:57.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:02:56 gibba045 bash[25517]: cluster 2021-03-10T16:02:56.805420+0000 mgr.gibba045.orlgmj (mgr.34412) 7096 : cluster [DBG] pgmap v4034: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:59.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:02:58 gibba015 bash[29377]: cluster 2021-03-10T16:02:58.805926+0000 mgr.gibba045.orlgmj (mgr.34412) 7097 : cluster [DBG] pgmap v4035: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:59.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:02:58 gibba015 bash[30343]: cluster 2021-03-10T16:02:58.805926+0000 mgr.gibba045.orlgmj (mgr.34412) 7097 : cluster [DBG] pgmap v4035: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:59.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:02:58 gibba045 bash[25517]: cluster 2021-03-10T16:02:58.805926+0000 mgr.gibba045.orlgmj (mgr.34412) 7097 : cluster [DBG] pgmap v4035: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:01.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:03:01 gibba015 bash[29377]: cluster 2021-03-10T16:03:00.807410+0000 mgr.gibba045.orlgmj (mgr.34412) 7098 : cluster [DBG] pgmap v4036: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:01.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:03:01 gibba015 bash[30343]: cluster 2021-03-10T16:03:00.807410+0000 mgr.gibba045.orlgmj (mgr.34412) 7098 : cluster [DBG] pgmap v4036: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:01.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:03:01 gibba045 bash[25517]: cluster 2021-03-10T16:03:00.807410+0000 mgr.gibba045.orlgmj (mgr.34412) 7098 : cluster [DBG] pgmap v4036: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:03.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:03:02 gibba015 bash[29377]: cluster 2021-03-10T16:03:02.809071+0000 mgr.gibba045.orlgmj (mgr.34412) 7099 : cluster [DBG] pgmap v4037: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:03.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:03:02 gibba015 bash[30343]: cluster 2021-03-10T16:03:02.809071+0000 mgr.gibba045.orlgmj (mgr.34412) 7099 : cluster [DBG] pgmap v4037: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:03.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:03:02 gibba045 bash[25517]: cluster 2021-03-10T16:03:02.809071+0000 mgr.gibba045.orlgmj (mgr.34412) 7099 : cluster [DBG] pgmap v4037: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:04.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:03:03 gibba015 bash[29377]: cephadm 2021-03-10T16:03:03.029745+0000 mgr.gibba045.orlgmj (mgr.34412) 7100 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:03:04.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:03:03 gibba015 bash[30343]: cephadm 2021-03-10T16:03:03.029745+0000 mgr.gibba045.orlgmj (mgr.34412) 7100 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:03:04.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:03:03 gibba045 bash[25517]: cephadm 2021-03-10T16:03:03.029745+0000 mgr.gibba045.orlgmj (mgr.34412) 7100 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:03:05.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:03:04 gibba015 bash[29377]: cluster 2021-03-10T16:03:04.810726+0000 mgr.gibba045.orlgmj (mgr.34412) 7101 : cluster [DBG] pgmap v4038: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:05.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:03:04 gibba015 bash[30343]: cluster 2021-03-10T16:03:04.810726+0000 mgr.gibba045.orlgmj (mgr.34412) 7101 : cluster [DBG] pgmap v4038: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:05.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:03:04 gibba045 bash[25517]: cluster 2021-03-10T16:03:04.810726+0000 mgr.gibba045.orlgmj (mgr.34412) 7101 : cluster [DBG] pgmap v4038: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:07.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:03:06 gibba015 bash[29377]: cluster 2021-03-10T16:03:06.812677+0000 mgr.gibba045.orlgmj (mgr.34412) 7102 : cluster [DBG] pgmap v4039: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:07.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:03:06 gibba015 bash[30343]: cluster 2021-03-10T16:03:06.812677+0000 mgr.gibba045.orlgmj (mgr.34412) 7102 : cluster [DBG] pgmap v4039: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:07.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:03:06 gibba045 bash[25517]: cluster 2021-03-10T16:03:06.812677+0000 mgr.gibba045.orlgmj (mgr.34412) 7102 : cluster [DBG] pgmap v4039: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:09.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:03:08 gibba015 bash[29377]: cluster 2021-03-10T16:03:08.813266+0000 mgr.gibba045.orlgmj (mgr.34412) 7103 : cluster [DBG] pgmap v4040: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:09.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:03:08 gibba015 bash[30343]: cluster 2021-03-10T16:03:08.813266+0000 mgr.gibba045.orlgmj (mgr.34412) 7103 : cluster [DBG] pgmap v4040: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:09.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:03:08 gibba045 bash[25517]: cluster 2021-03-10T16:03:08.813266+0000 mgr.gibba045.orlgmj (mgr.34412) 7103 : cluster [DBG] pgmap v4040: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:11.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:03:11 gibba015 bash[29377]: cluster 2021-03-10T16:03:10.814613+0000 mgr.gibba045.orlgmj (mgr.34412) 7104 : cluster [DBG] pgmap v4041: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:11.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:03:11 gibba015 bash[30343]: cluster 2021-03-10T16:03:10.814613+0000 mgr.gibba045.orlgmj (mgr.34412) 7104 : cluster [DBG] pgmap v4041: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:11.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:03:11 gibba045 bash[25517]: cluster 2021-03-10T16:03:10.814613+0000 mgr.gibba045.orlgmj (mgr.34412) 7104 : cluster [DBG] pgmap v4041: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:13.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:03:12 gibba015 bash[29377]: cluster 2021-03-10T16:03:12.816233+0000 mgr.gibba045.orlgmj (mgr.34412) 7105 : cluster [DBG] pgmap v4042: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:13.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:03:12 gibba015 bash[30343]: cluster 2021-03-10T16:03:12.816233+0000 mgr.gibba045.orlgmj (mgr.34412) 7105 : cluster [DBG] pgmap v4042: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:13.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:03:12 gibba045 bash[25517]: cluster 2021-03-10T16:03:12.816233+0000 mgr.gibba045.orlgmj (mgr.34412) 7105 : cluster [DBG] pgmap v4042: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:15.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:03:14 gibba015 bash[29377]: cluster 2021-03-10T16:03:14.817855+0000 mgr.gibba045.orlgmj (mgr.34412) 7106 : cluster [DBG] pgmap v4043: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:15.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:03:14 gibba015 bash[30343]: cluster 2021-03-10T16:03:14.817855+0000 mgr.gibba045.orlgmj (mgr.34412) 7106 : cluster [DBG] pgmap v4043: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:15.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:03:14 gibba045 bash[25517]: cluster 2021-03-10T16:03:14.817855+0000 mgr.gibba045.orlgmj (mgr.34412) 7106 : cluster [DBG] pgmap v4043: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:17.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:03:16 gibba015 bash[29377]: cluster 2021-03-10T16:03:16.819595+0000 mgr.gibba045.orlgmj (mgr.34412) 7107 : cluster [DBG] pgmap v4044: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:17.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:03:16 gibba015 bash[30343]: cluster 2021-03-10T16:03:16.819595+0000 mgr.gibba045.orlgmj (mgr.34412) 7107 : cluster [DBG] pgmap v4044: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:17.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:03:16 gibba045 bash[25517]: cluster 2021-03-10T16:03:16.819595+0000 mgr.gibba045.orlgmj (mgr.34412) 7107 : cluster [DBG] pgmap v4044: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:18.577 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:03:18.804 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:03:18.805 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 7m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:03:18.805 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 6m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:03:18.805 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:03:18.805 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:03:18.806 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:03:18.806 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:03:18.806 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:03:18.806 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:03:18.807 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 7m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:03:18.807 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 6m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:03:18.807 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:03:18.807 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:03:18.808 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:03:18.808 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:03:18.808 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:03:18.808 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:03:18.809 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:03:18.809 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:03:18.809 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 6m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:03:18.809 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 6m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:03:19.052 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:03:19.052 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:03:19.052 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:03:19.053 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:03:19.053 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:03:19.053 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:03:19.053 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:03:19.054 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:03:19.054 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:03:19.054 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:03:19.054 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:03:19.055 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:03:19.055 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:03:19.055 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:03:19.055 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:03:19.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:03:18 gibba015 bash[29377]: cephadm 2021-03-10T16:03:18.034483+0000 mgr.gibba045.orlgmj (mgr.34412) 7108 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:03:19.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:03:18 gibba015 bash[29377]: audit 2021-03-10T16:03:18.569636+0000 mgr.gibba045.orlgmj (mgr.34412) 7109 : audit [DBG] from='client.48822 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:03:19.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:03:18 gibba015 bash[29377]: audit 2021-03-10T16:03:18.793720+0000 mgr.gibba045.orlgmj (mgr.34412) 7110 : audit [DBG] from='client.58816 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:03:19.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:03:18 gibba015 bash[29377]: cluster 2021-03-10T16:03:18.820825+0000 mgr.gibba045.orlgmj (mgr.34412) 7111 : cluster [DBG] pgmap v4045: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:19.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:03:18 gibba015 bash[30343]: cephadm 2021-03-10T16:03:18.034483+0000 mgr.gibba045.orlgmj (mgr.34412) 7108 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:03:19.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:03:18 gibba015 bash[30343]: audit 2021-03-10T16:03:18.569636+0000 mgr.gibba045.orlgmj (mgr.34412) 7109 : audit [DBG] from='client.48822 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:03:19.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:03:18 gibba015 bash[30343]: audit 2021-03-10T16:03:18.793720+0000 mgr.gibba045.orlgmj (mgr.34412) 7110 : audit [DBG] from='client.58816 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:03:19.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:03:18 gibba015 bash[30343]: cluster 2021-03-10T16:03:18.820825+0000 mgr.gibba045.orlgmj (mgr.34412) 7111 : cluster [DBG] pgmap v4045: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:19.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:03:18 gibba045 bash[25517]: cephadm 2021-03-10T16:03:18.034483+0000 mgr.gibba045.orlgmj (mgr.34412) 7108 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:03:19.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:03:18 gibba045 bash[25517]: audit 2021-03-10T16:03:18.569636+0000 mgr.gibba045.orlgmj (mgr.34412) 7109 : audit [DBG] from='client.48822 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:03:19.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:03:18 gibba045 bash[25517]: audit 2021-03-10T16:03:18.793720+0000 mgr.gibba045.orlgmj (mgr.34412) 7110 : audit [DBG] from='client.58816 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:03:19.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:03:18 gibba045 bash[25517]: cluster 2021-03-10T16:03:18.820825+0000 mgr.gibba045.orlgmj (mgr.34412) 7111 : cluster [DBG] pgmap v4045: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:20.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:03:19 gibba015 bash[29377]: audit 2021-03-10T16:03:19.051165+0000 mon.c (mon.1) 1975 : audit [DBG] from='client.? 172.21.2.115:0/781190642' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:03:20.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:03:19 gibba015 bash[30343]: audit 2021-03-10T16:03:19.051165+0000 mon.c (mon.1) 1975 : audit [DBG] from='client.? 172.21.2.115:0/781190642' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:03:20.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:03:19 gibba045 bash[25517]: audit 2021-03-10T16:03:19.051165+0000 mon.c (mon.1) 1975 : audit [DBG] from='client.? 172.21.2.115:0/781190642' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:03:21.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:03:21 gibba015 bash[29377]: cluster 2021-03-10T16:03:20.822322+0000 mgr.gibba045.orlgmj (mgr.34412) 7112 : cluster [DBG] pgmap v4046: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:21.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:03:21 gibba015 bash[30343]: cluster 2021-03-10T16:03:20.822322+0000 mgr.gibba045.orlgmj (mgr.34412) 7112 : cluster [DBG] pgmap v4046: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:21.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:03:21 gibba045 bash[25517]: cluster 2021-03-10T16:03:20.822322+0000 mgr.gibba045.orlgmj (mgr.34412) 7112 : cluster [DBG] pgmap v4046: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:23.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:03:22 gibba015 bash[29377]: cluster 2021-03-10T16:03:22.823989+0000 mgr.gibba045.orlgmj (mgr.34412) 7113 : cluster [DBG] pgmap v4047: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:23.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:03:22 gibba015 bash[30343]: cluster 2021-03-10T16:03:22.823989+0000 mgr.gibba045.orlgmj (mgr.34412) 7113 : cluster [DBG] pgmap v4047: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:23.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:03:22 gibba045 bash[25517]: cluster 2021-03-10T16:03:22.823989+0000 mgr.gibba045.orlgmj (mgr.34412) 7113 : cluster [DBG] pgmap v4047: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:25.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:03:24 gibba015 bash[29377]: cluster 2021-03-10T16:03:24.825683+0000 mgr.gibba045.orlgmj (mgr.34412) 7114 : cluster [DBG] pgmap v4048: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:25.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:03:24 gibba015 bash[30343]: cluster 2021-03-10T16:03:24.825683+0000 mgr.gibba045.orlgmj (mgr.34412) 7114 : cluster [DBG] pgmap v4048: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:25.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:03:24 gibba045 bash[25517]: cluster 2021-03-10T16:03:24.825683+0000 mgr.gibba045.orlgmj (mgr.34412) 7114 : cluster [DBG] pgmap v4048: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:27.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:03:26 gibba015 bash[29377]: cluster 2021-03-10T16:03:26.827406+0000 mgr.gibba045.orlgmj (mgr.34412) 7115 : cluster [DBG] pgmap v4049: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:27.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:03:26 gibba015 bash[30343]: cluster 2021-03-10T16:03:26.827406+0000 mgr.gibba045.orlgmj (mgr.34412) 7115 : cluster [DBG] pgmap v4049: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:27.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:03:26 gibba045 bash[25517]: cluster 2021-03-10T16:03:26.827406+0000 mgr.gibba045.orlgmj (mgr.34412) 7115 : cluster [DBG] pgmap v4049: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:29.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:03:28 gibba015 bash[29377]: cluster 2021-03-10T16:03:28.828652+0000 mgr.gibba045.orlgmj (mgr.34412) 7116 : cluster [DBG] pgmap v4050: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:29.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:03:28 gibba015 bash[30343]: cluster 2021-03-10T16:03:28.828652+0000 mgr.gibba045.orlgmj (mgr.34412) 7116 : cluster [DBG] pgmap v4050: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:29.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:03:28 gibba045 bash[25517]: cluster 2021-03-10T16:03:28.828652+0000 mgr.gibba045.orlgmj (mgr.34412) 7116 : cluster [DBG] pgmap v4050: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:31.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:03:31 gibba015 bash[29377]: cluster 2021-03-10T16:03:30.830055+0000 mgr.gibba045.orlgmj (mgr.34412) 7117 : cluster [DBG] pgmap v4051: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:31.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:03:31 gibba015 bash[30343]: cluster 2021-03-10T16:03:30.830055+0000 mgr.gibba045.orlgmj (mgr.34412) 7117 : cluster [DBG] pgmap v4051: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:31.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:03:31 gibba045 bash[25517]: cluster 2021-03-10T16:03:30.830055+0000 mgr.gibba045.orlgmj (mgr.34412) 7117 : cluster [DBG] pgmap v4051: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:33.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:03:32 gibba015 bash[29377]: cluster 2021-03-10T16:03:32.831651+0000 mgr.gibba045.orlgmj (mgr.34412) 7118 : cluster [DBG] pgmap v4052: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:33.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:03:32 gibba015 bash[30343]: cluster 2021-03-10T16:03:32.831651+0000 mgr.gibba045.orlgmj (mgr.34412) 7118 : cluster [DBG] pgmap v4052: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:33.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:03:32 gibba045 bash[25517]: cluster 2021-03-10T16:03:32.831651+0000 mgr.gibba045.orlgmj (mgr.34412) 7118 : cluster [DBG] pgmap v4052: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:34.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:03:33 gibba015 bash[29377]: cephadm 2021-03-10T16:03:33.050503+0000 mgr.gibba045.orlgmj (mgr.34412) 7119 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:03:34.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:03:33 gibba015 bash[30343]: cephadm 2021-03-10T16:03:33.050503+0000 mgr.gibba045.orlgmj (mgr.34412) 7119 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:03:34.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:03:33 gibba045 bash[25517]: cephadm 2021-03-10T16:03:33.050503+0000 mgr.gibba045.orlgmj (mgr.34412) 7119 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:03:35.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:03:34 gibba015 bash[29377]: cluster 2021-03-10T16:03:34.833317+0000 mgr.gibba045.orlgmj (mgr.34412) 7120 : cluster [DBG] pgmap v4053: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:35.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:03:34 gibba015 bash[30343]: cluster 2021-03-10T16:03:34.833317+0000 mgr.gibba045.orlgmj (mgr.34412) 7120 : cluster [DBG] pgmap v4053: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:35.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:03:34 gibba045 bash[25517]: cluster 2021-03-10T16:03:34.833317+0000 mgr.gibba045.orlgmj (mgr.34412) 7120 : cluster [DBG] pgmap v4053: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:37.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:03:36 gibba015 bash[29377]: cluster 2021-03-10T16:03:36.835004+0000 mgr.gibba045.orlgmj (mgr.34412) 7121 : cluster [DBG] pgmap v4054: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:37.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:03:36 gibba015 bash[30343]: cluster 2021-03-10T16:03:36.835004+0000 mgr.gibba045.orlgmj (mgr.34412) 7121 : cluster [DBG] pgmap v4054: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:37.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:03:36 gibba045 bash[25517]: cluster 2021-03-10T16:03:36.835004+0000 mgr.gibba045.orlgmj (mgr.34412) 7121 : cluster [DBG] pgmap v4054: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:39.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:03:38 gibba015 bash[29377]: cluster 2021-03-10T16:03:38.836156+0000 mgr.gibba045.orlgmj (mgr.34412) 7122 : cluster [DBG] pgmap v4055: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:39.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:03:38 gibba015 bash[30343]: cluster 2021-03-10T16:03:38.836156+0000 mgr.gibba045.orlgmj (mgr.34412) 7122 : cluster [DBG] pgmap v4055: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:39.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:03:38 gibba045 bash[25517]: cluster 2021-03-10T16:03:38.836156+0000 mgr.gibba045.orlgmj (mgr.34412) 7122 : cluster [DBG] pgmap v4055: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:41.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:03:41 gibba015 bash[29377]: cluster 2021-03-10T16:03:40.837803+0000 mgr.gibba045.orlgmj (mgr.34412) 7123 : cluster [DBG] pgmap v4056: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:41.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:03:41 gibba015 bash[30343]: cluster 2021-03-10T16:03:40.837803+0000 mgr.gibba045.orlgmj (mgr.34412) 7123 : cluster [DBG] pgmap v4056: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:41.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:03:41 gibba045 bash[25517]: cluster 2021-03-10T16:03:40.837803+0000 mgr.gibba045.orlgmj (mgr.34412) 7123 : cluster [DBG] pgmap v4056: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:43.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:03:42 gibba015 bash[29377]: cluster 2021-03-10T16:03:42.839354+0000 mgr.gibba045.orlgmj (mgr.34412) 7124 : cluster [DBG] pgmap v4057: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:43.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:03:42 gibba015 bash[30343]: cluster 2021-03-10T16:03:42.839354+0000 mgr.gibba045.orlgmj (mgr.34412) 7124 : cluster [DBG] pgmap v4057: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:43.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:03:42 gibba045 bash[25517]: cluster 2021-03-10T16:03:42.839354+0000 mgr.gibba045.orlgmj (mgr.34412) 7124 : cluster [DBG] pgmap v4057: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:45.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:03:44 gibba015 bash[29377]: cluster 2021-03-10T16:03:44.840901+0000 mgr.gibba045.orlgmj (mgr.34412) 7125 : cluster [DBG] pgmap v4058: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:45.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:03:44 gibba015 bash[30343]: cluster 2021-03-10T16:03:44.840901+0000 mgr.gibba045.orlgmj (mgr.34412) 7125 : cluster [DBG] pgmap v4058: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:45.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:03:44 gibba045 bash[25517]: cluster 2021-03-10T16:03:44.840901+0000 mgr.gibba045.orlgmj (mgr.34412) 7125 : cluster [DBG] pgmap v4058: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:47.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:03:46 gibba015 bash[29377]: cluster 2021-03-10T16:03:46.842647+0000 mgr.gibba045.orlgmj (mgr.34412) 7126 : cluster [DBG] pgmap v4059: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:47.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:03:46 gibba015 bash[30343]: cluster 2021-03-10T16:03:46.842647+0000 mgr.gibba045.orlgmj (mgr.34412) 7126 : cluster [DBG] pgmap v4059: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:47.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:03:46 gibba045 bash[25517]: cluster 2021-03-10T16:03:46.842647+0000 mgr.gibba045.orlgmj (mgr.34412) 7126 : cluster [DBG] pgmap v4059: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:48.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:03:48 gibba015 bash[29377]: audit 2021-03-10T16:03:48.065180+0000 mon.c (mon.1) 1976 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:03:48.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:03:48 gibba015 bash[30343]: audit 2021-03-10T16:03:48.065180+0000 mon.c (mon.1) 1976 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:03:48.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:03:48 gibba045 bash[25517]: audit 2021-03-10T16:03:48.065180+0000 mon.c (mon.1) 1976 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:03:49.295 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:03:49.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:03:49 gibba045 bash[25517]: cephadm 2021-03-10T16:03:48.073807+0000 mgr.gibba045.orlgmj (mgr.34412) 7127 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:03:49.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:03:49 gibba045 bash[25517]: cephadm 2021-03-10T16:03:48.075281+0000 mgr.gibba045.orlgmj (mgr.34412) 7128 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:03:49.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:03:49 gibba045 bash[25517]: audit 2021-03-10T16:03:48.297265+0000 mon.a (mon.0) 1691 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:03:49.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:03:49 gibba045 bash[25517]: audit 2021-03-10T16:03:48.301046+0000 mon.c (mon.1) 1977 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:03:49.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:03:49 gibba045 bash[25517]: cephadm 2021-03-10T16:03:48.302641+0000 mgr.gibba045.orlgmj (mgr.34412) 7129 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:03:49.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:03:49 gibba045 bash[25517]: audit 2021-03-10T16:03:48.302694+0000 mon.c (mon.1) 1978 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:03:49.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:03:49 gibba045 bash[25517]: audit 2021-03-10T16:03:48.304304+0000 mon.c (mon.1) 1979 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:03:49.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:03:49 gibba045 bash[25517]: cephadm 2021-03-10T16:03:48.304687+0000 mgr.gibba045.orlgmj (mgr.34412) 7130 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:03:49.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:03:49 gibba045 bash[25517]: audit 2021-03-10T16:03:48.306205+0000 mon.c (mon.1) 1980 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:03:49.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:03:49 gibba045 bash[25517]: cephadm 2021-03-10T16:03:48.306221+0000 mgr.gibba045.orlgmj (mgr.34412) 7131 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:03:49.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:03:49 gibba045 bash[25517]: cephadm 2021-03-10T16:03:48.306260+0000 mgr.gibba045.orlgmj (mgr.34412) 7132 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:03:49.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:03:49 gibba045 bash[25517]: cephadm 2021-03-10T16:03:48.308046+0000 mgr.gibba045.orlgmj (mgr.34412) 7133 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:03:49.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:03:49 gibba045 bash[25517]: cephadm 2021-03-10T16:03:48.308084+0000 mgr.gibba045.orlgmj (mgr.34412) 7134 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:03:49.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:03:49 gibba045 bash[25517]: cephadm 2021-03-10T16:03:48.309985+0000 mgr.gibba045.orlgmj (mgr.34412) 7135 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:03:49.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:03:49 gibba045 bash[25517]: audit 2021-03-10T16:03:48.310055+0000 mon.c (mon.1) 1981 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:03:49.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:03:49 gibba045 bash[25517]: audit 2021-03-10T16:03:48.311616+0000 mon.c (mon.1) 1982 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:03:49.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:03:49 gibba045 bash[25517]: cephadm 2021-03-10T16:03:48.311897+0000 mgr.gibba045.orlgmj (mgr.34412) 7136 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:03:49.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:03:49 gibba045 bash[25517]: cephadm 2021-03-10T16:03:48.311935+0000 mgr.gibba045.orlgmj (mgr.34412) 7137 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:03:49.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:03:49 gibba045 bash[25517]: cephadm 2021-03-10T16:03:48.313338+0000 mgr.gibba045.orlgmj (mgr.34412) 7138 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:03:49.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:03:49 gibba045 bash[25517]: cephadm 2021-03-10T16:03:48.313654+0000 mgr.gibba045.orlgmj (mgr.34412) 7139 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:03:49.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:03:49 gibba045 bash[25517]: cephadm 2021-03-10T16:03:48.314833+0000 mgr.gibba045.orlgmj (mgr.34412) 7140 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:03:49.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:03:49 gibba045 bash[25517]: cephadm 2021-03-10T16:03:48.314872+0000 mgr.gibba045.orlgmj (mgr.34412) 7141 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:03:49.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:03:49 gibba045 bash[25517]: cephadm 2021-03-10T16:03:48.314978+0000 mgr.gibba045.orlgmj (mgr.34412) 7142 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:03:49.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:03:49 gibba045 bash[25517]: cluster 2021-03-10T16:03:48.843867+0000 mgr.gibba045.orlgmj (mgr.34412) 7143 : cluster [DBG] pgmap v4060: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:49.560 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:03:49.561 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 8m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:03:49.561 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 7m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:03:49.561 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:03:49.561 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:03:49.561 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:03:49.562 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:03:49.562 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:03:49.562 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:03:49.562 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 8m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:03:49.563 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 7m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:03:49.563 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:03:49.563 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:03:49.563 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:03:49.563 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:03:49.564 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:03:49.564 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:03:49.564 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:03:49.564 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:03:49.564 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 7m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:03:49.565 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 7m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:03:49.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:03:49 gibba015 bash[29377]: cephadm 2021-03-10T16:03:48.073807+0000 mgr.gibba045.orlgmj (mgr.34412) 7127 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:03:49.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:03:49 gibba015 bash[29377]: cephadm 2021-03-10T16:03:48.075281+0000 mgr.gibba045.orlgmj (mgr.34412) 7128 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:03:49.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:03:49 gibba015 bash[29377]: audit 2021-03-10T16:03:48.297265+0000 mon.a (mon.0) 1691 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:03:49.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:03:49 gibba015 bash[29377]: audit 2021-03-10T16:03:48.301046+0000 mon.c (mon.1) 1977 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:03:49.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:03:49 gibba015 bash[29377]: cephadm 2021-03-10T16:03:48.302641+0000 mgr.gibba045.orlgmj (mgr.34412) 7129 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:03:49.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:03:49 gibba015 bash[29377]: audit 2021-03-10T16:03:48.302694+0000 mon.c (mon.1) 1978 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:03:49.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:03:49 gibba015 bash[29377]: audit 2021-03-10T16:03:48.304304+0000 mon.c (mon.1) 1979 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:03:49.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:03:49 gibba015 bash[29377]: cephadm 2021-03-10T16:03:48.304687+0000 mgr.gibba045.orlgmj (mgr.34412) 7130 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:03:49.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:03:49 gibba015 bash[29377]: audit 2021-03-10T16:03:48.306205+0000 mon.c (mon.1) 1980 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:03:49.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:03:49 gibba015 bash[29377]: cephadm 2021-03-10T16:03:48.306221+0000 mgr.gibba045.orlgmj (mgr.34412) 7131 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:03:49.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:03:49 gibba015 bash[29377]: cephadm 2021-03-10T16:03:48.306260+0000 mgr.gibba045.orlgmj (mgr.34412) 7132 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:03:49.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:03:49 gibba015 bash[29377]: cephadm 2021-03-10T16:03:48.308046+0000 mgr.gibba045.orlgmj (mgr.34412) 7133 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:03:49.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:03:49 gibba015 bash[29377]: cephadm 2021-03-10T16:03:48.308084+0000 mgr.gibba045.orlgmj (mgr.34412) 7134 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:03:49.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:03:49 gibba015 bash[29377]: cephadm 2021-03-10T16:03:48.309985+0000 mgr.gibba045.orlgmj (mgr.34412) 7135 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:03:49.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:03:49 gibba015 bash[29377]: audit 2021-03-10T16:03:48.310055+0000 mon.c (mon.1) 1981 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:03:49.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:03:49 gibba015 bash[29377]: audit 2021-03-10T16:03:48.311616+0000 mon.c (mon.1) 1982 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:03:49.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:03:49 gibba015 bash[29377]: cephadm 2021-03-10T16:03:48.311897+0000 mgr.gibba045.orlgmj (mgr.34412) 7136 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:03:49.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:03:49 gibba015 bash[29377]: cephadm 2021-03-10T16:03:48.311935+0000 mgr.gibba045.orlgmj (mgr.34412) 7137 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:03:49.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:03:49 gibba015 bash[29377]: cephadm 2021-03-10T16:03:48.313338+0000 mgr.gibba045.orlgmj (mgr.34412) 7138 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:03:49.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:03:49 gibba015 bash[29377]: cephadm 2021-03-10T16:03:48.313654+0000 mgr.gibba045.orlgmj (mgr.34412) 7139 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:03:49.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:03:49 gibba015 bash[29377]: cephadm 2021-03-10T16:03:48.314833+0000 mgr.gibba045.orlgmj (mgr.34412) 7140 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:03:49.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:03:49 gibba015 bash[29377]: cephadm 2021-03-10T16:03:48.314872+0000 mgr.gibba045.orlgmj (mgr.34412) 7141 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:03:49.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:03:49 gibba015 bash[29377]: cephadm 2021-03-10T16:03:48.314978+0000 mgr.gibba045.orlgmj (mgr.34412) 7142 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:03:49.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:03:49 gibba015 bash[29377]: cluster 2021-03-10T16:03:48.843867+0000 mgr.gibba045.orlgmj (mgr.34412) 7143 : cluster [DBG] pgmap v4060: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:49.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:03:49 gibba015 bash[30343]: cephadm 2021-03-10T16:03:48.073807+0000 mgr.gibba045.orlgmj (mgr.34412) 7127 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:03:49.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:03:49 gibba015 bash[30343]: cephadm 2021-03-10T16:03:48.075281+0000 mgr.gibba045.orlgmj (mgr.34412) 7128 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:03:49.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:03:49 gibba015 bash[30343]: audit 2021-03-10T16:03:48.297265+0000 mon.a (mon.0) 1691 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:03:49.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:03:49 gibba015 bash[30343]: audit 2021-03-10T16:03:48.301046+0000 mon.c (mon.1) 1977 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:03:49.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:03:49 gibba015 bash[30343]: cephadm 2021-03-10T16:03:48.302641+0000 mgr.gibba045.orlgmj (mgr.34412) 7129 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:03:49.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:03:49 gibba015 bash[30343]: audit 2021-03-10T16:03:48.302694+0000 mon.c (mon.1) 1978 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:03:49.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:03:49 gibba015 bash[30343]: audit 2021-03-10T16:03:48.304304+0000 mon.c (mon.1) 1979 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:03:49.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:03:49 gibba015 bash[30343]: cephadm 2021-03-10T16:03:48.304687+0000 mgr.gibba045.orlgmj (mgr.34412) 7130 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:03:49.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:03:49 gibba015 bash[30343]: audit 2021-03-10T16:03:48.306205+0000 mon.c (mon.1) 1980 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:03:49.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:03:49 gibba015 bash[30343]: cephadm 2021-03-10T16:03:48.306221+0000 mgr.gibba045.orlgmj (mgr.34412) 7131 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:03:49.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:03:49 gibba015 bash[30343]: cephadm 2021-03-10T16:03:48.306260+0000 mgr.gibba045.orlgmj (mgr.34412) 7132 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:03:49.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:03:49 gibba015 bash[30343]: cephadm 2021-03-10T16:03:48.308046+0000 mgr.gibba045.orlgmj (mgr.34412) 7133 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:03:49.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:03:49 gibba015 bash[30343]: cephadm 2021-03-10T16:03:48.308084+0000 mgr.gibba045.orlgmj (mgr.34412) 7134 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:03:49.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:03:49 gibba015 bash[30343]: cephadm 2021-03-10T16:03:48.309985+0000 mgr.gibba045.orlgmj (mgr.34412) 7135 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:03:49.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:03:49 gibba015 bash[30343]: audit 2021-03-10T16:03:48.310055+0000 mon.c (mon.1) 1981 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:03:49.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:03:49 gibba015 bash[30343]: audit 2021-03-10T16:03:48.311616+0000 mon.c (mon.1) 1982 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:03:49.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:03:49 gibba015 bash[30343]: cephadm 2021-03-10T16:03:48.311897+0000 mgr.gibba045.orlgmj (mgr.34412) 7136 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:03:49.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:03:49 gibba015 bash[30343]: cephadm 2021-03-10T16:03:48.311935+0000 mgr.gibba045.orlgmj (mgr.34412) 7137 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:03:49.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:03:49 gibba015 bash[30343]: cephadm 2021-03-10T16:03:48.313338+0000 mgr.gibba045.orlgmj (mgr.34412) 7138 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:03:49.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:03:49 gibba015 bash[30343]: cephadm 2021-03-10T16:03:48.313654+0000 mgr.gibba045.orlgmj (mgr.34412) 7139 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:03:49.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:03:49 gibba015 bash[30343]: cephadm 2021-03-10T16:03:48.314833+0000 mgr.gibba045.orlgmj (mgr.34412) 7140 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:03:49.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:03:49 gibba015 bash[30343]: cephadm 2021-03-10T16:03:48.314872+0000 mgr.gibba045.orlgmj (mgr.34412) 7141 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:03:49.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:03:49 gibba015 bash[30343]: cephadm 2021-03-10T16:03:48.314978+0000 mgr.gibba045.orlgmj (mgr.34412) 7142 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:03:49.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:03:49 gibba015 bash[30343]: cluster 2021-03-10T16:03:48.843867+0000 mgr.gibba045.orlgmj (mgr.34412) 7143 : cluster [DBG] pgmap v4060: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:49.824 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:03:49.824 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:03:49.825 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:03:49.825 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:03:49.825 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:03:49.825 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:03:49.826 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:03:49.826 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:03:49.826 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:03:49.826 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:03:49.826 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:03:49.827 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:03:49.827 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:03:49.827 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:03:49.827 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:03:50.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:03:50 gibba015 bash[29377]: audit 2021-03-10T16:03:49.287556+0000 mgr.gibba045.orlgmj (mgr.34412) 7144 : audit [DBG] from='client.58828 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:03:50.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:03:50 gibba015 bash[29377]: audit 2021-03-10T16:03:49.517094+0000 mgr.gibba045.orlgmj (mgr.34412) 7145 : audit [DBG] from='client.58834 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:03:50.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:03:50 gibba015 bash[29377]: audit 2021-03-10T16:03:49.823731+0000 mon.c (mon.1) 1983 : audit [DBG] from='client.? 172.21.2.115:0/196771463' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:03:50.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:03:50 gibba015 bash[30343]: audit 2021-03-10T16:03:49.287556+0000 mgr.gibba045.orlgmj (mgr.34412) 7144 : audit [DBG] from='client.58828 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:03:50.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:03:50 gibba015 bash[30343]: audit 2021-03-10T16:03:49.517094+0000 mgr.gibba045.orlgmj (mgr.34412) 7145 : audit [DBG] from='client.58834 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:03:50.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:03:50 gibba015 bash[30343]: audit 2021-03-10T16:03:49.823731+0000 mon.c (mon.1) 1983 : audit [DBG] from='client.? 172.21.2.115:0/196771463' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:03:50.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:03:50 gibba045 bash[25517]: audit 2021-03-10T16:03:49.287556+0000 mgr.gibba045.orlgmj (mgr.34412) 7144 : audit [DBG] from='client.58828 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:03:50.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:03:50 gibba045 bash[25517]: audit 2021-03-10T16:03:49.517094+0000 mgr.gibba045.orlgmj (mgr.34412) 7145 : audit [DBG] from='client.58834 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:03:50.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:03:50 gibba045 bash[25517]: audit 2021-03-10T16:03:49.823731+0000 mon.c (mon.1) 1983 : audit [DBG] from='client.? 172.21.2.115:0/196771463' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:03:51.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:03:51 gibba015 bash[29377]: cluster 2021-03-10T16:03:50.845522+0000 mgr.gibba045.orlgmj (mgr.34412) 7146 : cluster [DBG] pgmap v4061: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:51.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:03:51 gibba015 bash[30343]: cluster 2021-03-10T16:03:50.845522+0000 mgr.gibba045.orlgmj (mgr.34412) 7146 : cluster [DBG] pgmap v4061: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:51.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:03:51 gibba045 bash[25517]: cluster 2021-03-10T16:03:50.845522+0000 mgr.gibba045.orlgmj (mgr.34412) 7146 : cluster [DBG] pgmap v4061: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:53.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:03:52 gibba015 bash[29377]: cluster 2021-03-10T16:03:52.847121+0000 mgr.gibba045.orlgmj (mgr.34412) 7147 : cluster [DBG] pgmap v4062: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:53.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:03:52 gibba015 bash[30343]: cluster 2021-03-10T16:03:52.847121+0000 mgr.gibba045.orlgmj (mgr.34412) 7147 : cluster [DBG] pgmap v4062: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:53.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:03:52 gibba045 bash[25517]: cluster 2021-03-10T16:03:52.847121+0000 mgr.gibba045.orlgmj (mgr.34412) 7147 : cluster [DBG] pgmap v4062: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:54.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:03:53 gibba015 bash[29377]: audit 2021-03-10T16:03:53.404310+0000 mon.c (mon.1) 1984 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:03:54.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:03:53 gibba015 bash[29377]: audit 2021-03-10T16:03:53.405367+0000 mon.c (mon.1) 1985 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:03:54.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:03:53 gibba015 bash[29377]: audit 2021-03-10T16:03:53.405596+0000 mon.a (mon.0) 1692 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:03:54.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:03:53 gibba015 bash[29377]: audit 2021-03-10T16:03:53.406923+0000 mon.a (mon.0) 1693 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:03:54.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:03:53 gibba015 bash[29377]: audit 2021-03-10T16:03:53.407187+0000 mon.c (mon.1) 1986 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T16:03:54.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:03:53 gibba015 bash[29377]: audit 2021-03-10T16:03:53.408480+0000 mon.a (mon.0) 1694 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T16:03:54.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:03:53 gibba015 bash[29377]: audit 2021-03-10T16:03:53.408505+0000 mon.c (mon.1) 1987 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:03:54.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:03:53 gibba015 bash[29377]: audit 2021-03-10T16:03:53.409795+0000 mon.c (mon.1) 1988 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:03:54.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:03:53 gibba015 bash[29377]: audit 2021-03-10T16:03:53.409840+0000 mon.a (mon.0) 1695 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:03:54.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:03:53 gibba015 bash[29377]: audit 2021-03-10T16:03:53.410887+0000 mon.a (mon.0) 1696 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:03:54.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:03:53 gibba015 bash[29377]: audit 2021-03-10T16:03:53.411111+0000 mon.c (mon.1) 1989 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T16:03:54.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:03:53 gibba015 bash[29377]: audit 2021-03-10T16:03:53.412383+0000 mon.a (mon.0) 1697 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T16:03:54.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:03:53 gibba015 bash[30343]: audit 2021-03-10T16:03:53.404310+0000 mon.c (mon.1) 1984 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:03:54.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:03:53 gibba015 bash[30343]: audit 2021-03-10T16:03:53.405367+0000 mon.c (mon.1) 1985 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:03:54.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:03:53 gibba015 bash[30343]: audit 2021-03-10T16:03:53.405596+0000 mon.a (mon.0) 1692 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:03:54.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:03:53 gibba015 bash[30343]: audit 2021-03-10T16:03:53.406923+0000 mon.a (mon.0) 1693 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:03:54.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:03:53 gibba015 bash[30343]: audit 2021-03-10T16:03:53.407187+0000 mon.c (mon.1) 1986 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T16:03:54.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:03:53 gibba015 bash[30343]: audit 2021-03-10T16:03:53.408480+0000 mon.a (mon.0) 1694 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T16:03:54.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:03:53 gibba015 bash[30343]: audit 2021-03-10T16:03:53.408505+0000 mon.c (mon.1) 1987 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:03:54.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:03:53 gibba015 bash[30343]: audit 2021-03-10T16:03:53.409795+0000 mon.c (mon.1) 1988 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:03:54.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:03:53 gibba015 bash[30343]: audit 2021-03-10T16:03:53.409840+0000 mon.a (mon.0) 1695 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:03:54.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:03:53 gibba015 bash[30343]: audit 2021-03-10T16:03:53.410887+0000 mon.a (mon.0) 1696 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:03:54.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:03:53 gibba015 bash[30343]: audit 2021-03-10T16:03:53.411111+0000 mon.c (mon.1) 1989 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T16:03:54.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:03:53 gibba015 bash[30343]: audit 2021-03-10T16:03:53.412383+0000 mon.a (mon.0) 1697 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T16:03:54.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:03:53 gibba045 bash[25517]: audit 2021-03-10T16:03:53.404310+0000 mon.c (mon.1) 1984 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:03:54.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:03:53 gibba045 bash[25517]: audit 2021-03-10T16:03:53.405367+0000 mon.c (mon.1) 1985 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:03:54.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:03:53 gibba045 bash[25517]: audit 2021-03-10T16:03:53.405596+0000 mon.a (mon.0) 1692 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:03:54.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:03:53 gibba045 bash[25517]: audit 2021-03-10T16:03:53.406923+0000 mon.a (mon.0) 1693 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:03:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:03:53 gibba045 bash[25517]: audit 2021-03-10T16:03:53.407187+0000 mon.c (mon.1) 1986 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T16:03:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:03:53 gibba045 bash[25517]: audit 2021-03-10T16:03:53.408480+0000 mon.a (mon.0) 1694 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T16:03:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:03:53 gibba045 bash[25517]: audit 2021-03-10T16:03:53.408505+0000 mon.c (mon.1) 1987 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:03:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:03:53 gibba045 bash[25517]: audit 2021-03-10T16:03:53.409795+0000 mon.c (mon.1) 1988 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:03:54.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:03:53 gibba045 bash[25517]: audit 2021-03-10T16:03:53.409840+0000 mon.a (mon.0) 1695 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:03:54.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:03:53 gibba045 bash[25517]: audit 2021-03-10T16:03:53.410887+0000 mon.a (mon.0) 1696 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:03:54.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:03:53 gibba045 bash[25517]: audit 2021-03-10T16:03:53.411111+0000 mon.c (mon.1) 1989 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T16:03:54.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:03:53 gibba045 bash[25517]: audit 2021-03-10T16:03:53.412383+0000 mon.a (mon.0) 1697 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T16:03:55.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:03:54 gibba015 bash[29377]: cluster 2021-03-10T16:03:54.848613+0000 mgr.gibba045.orlgmj (mgr.34412) 7148 : cluster [DBG] pgmap v4063: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:55.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:03:54 gibba015 bash[30343]: cluster 2021-03-10T16:03:54.848613+0000 mgr.gibba045.orlgmj (mgr.34412) 7148 : cluster [DBG] pgmap v4063: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:55.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:03:54 gibba045 bash[25517]: cluster 2021-03-10T16:03:54.848613+0000 mgr.gibba045.orlgmj (mgr.34412) 7148 : cluster [DBG] pgmap v4063: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:57.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:03:56 gibba015 bash[29377]: cluster 2021-03-10T16:03:56.850178+0000 mgr.gibba045.orlgmj (mgr.34412) 7149 : cluster [DBG] pgmap v4064: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:57.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:03:56 gibba015 bash[30343]: cluster 2021-03-10T16:03:56.850178+0000 mgr.gibba045.orlgmj (mgr.34412) 7149 : cluster [DBG] pgmap v4064: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:57.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:03:56 gibba045 bash[25517]: cluster 2021-03-10T16:03:56.850178+0000 mgr.gibba045.orlgmj (mgr.34412) 7149 : cluster [DBG] pgmap v4064: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:59.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:03:58 gibba015 bash[29377]: cluster 2021-03-10T16:03:58.851386+0000 mgr.gibba045.orlgmj (mgr.34412) 7150 : cluster [DBG] pgmap v4065: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:59.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:03:58 gibba015 bash[30343]: cluster 2021-03-10T16:03:58.851386+0000 mgr.gibba045.orlgmj (mgr.34412) 7150 : cluster [DBG] pgmap v4065: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:59.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:03:58 gibba045 bash[25517]: cluster 2021-03-10T16:03:58.851386+0000 mgr.gibba045.orlgmj (mgr.34412) 7150 : cluster [DBG] pgmap v4065: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:01.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:04:01 gibba015 bash[29377]: cluster 2021-03-10T16:04:00.853260+0000 mgr.gibba045.orlgmj (mgr.34412) 7151 : cluster [DBG] pgmap v4066: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:01.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:04:01 gibba015 bash[30343]: cluster 2021-03-10T16:04:00.853260+0000 mgr.gibba045.orlgmj (mgr.34412) 7151 : cluster [DBG] pgmap v4066: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:01.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:04:01 gibba045 bash[25517]: cluster 2021-03-10T16:04:00.853260+0000 mgr.gibba045.orlgmj (mgr.34412) 7151 : cluster [DBG] pgmap v4066: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:03.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:04:02 gibba015 bash[29377]: cluster 2021-03-10T16:04:02.854818+0000 mgr.gibba045.orlgmj (mgr.34412) 7152 : cluster [DBG] pgmap v4067: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:03.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:04:02 gibba015 bash[30343]: cluster 2021-03-10T16:04:02.854818+0000 mgr.gibba045.orlgmj (mgr.34412) 7152 : cluster [DBG] pgmap v4067: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:03.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:04:02 gibba045 bash[25517]: cluster 2021-03-10T16:04:02.854818+0000 mgr.gibba045.orlgmj (mgr.34412) 7152 : cluster [DBG] pgmap v4067: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:04.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:04:03 gibba015 bash[29377]: cephadm 2021-03-10T16:04:03.329385+0000 mgr.gibba045.orlgmj (mgr.34412) 7153 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:04:04.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:04:03 gibba015 bash[30343]: cephadm 2021-03-10T16:04:03.329385+0000 mgr.gibba045.orlgmj (mgr.34412) 7153 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:04:04.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:04:03 gibba045 bash[25517]: cephadm 2021-03-10T16:04:03.329385+0000 mgr.gibba045.orlgmj (mgr.34412) 7153 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:04:05.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:04:04 gibba015 bash[29377]: cluster 2021-03-10T16:04:04.856362+0000 mgr.gibba045.orlgmj (mgr.34412) 7154 : cluster [DBG] pgmap v4068: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:05.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:04:04 gibba015 bash[30343]: cluster 2021-03-10T16:04:04.856362+0000 mgr.gibba045.orlgmj (mgr.34412) 7154 : cluster [DBG] pgmap v4068: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:05.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:04:04 gibba045 bash[25517]: cluster 2021-03-10T16:04:04.856362+0000 mgr.gibba045.orlgmj (mgr.34412) 7154 : cluster [DBG] pgmap v4068: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:07.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:04:06 gibba015 bash[29377]: cluster 2021-03-10T16:04:06.857867+0000 mgr.gibba045.orlgmj (mgr.34412) 7155 : cluster [DBG] pgmap v4069: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:07.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:04:06 gibba015 bash[30343]: cluster 2021-03-10T16:04:06.857867+0000 mgr.gibba045.orlgmj (mgr.34412) 7155 : cluster [DBG] pgmap v4069: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:07.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:04:06 gibba045 bash[25517]: cluster 2021-03-10T16:04:06.857867+0000 mgr.gibba045.orlgmj (mgr.34412) 7155 : cluster [DBG] pgmap v4069: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:09.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:04:08 gibba015 bash[29377]: cluster 2021-03-10T16:04:08.859038+0000 mgr.gibba045.orlgmj (mgr.34412) 7156 : cluster [DBG] pgmap v4070: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:09.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:04:08 gibba015 bash[30343]: cluster 2021-03-10T16:04:08.859038+0000 mgr.gibba045.orlgmj (mgr.34412) 7156 : cluster [DBG] pgmap v4070: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:09.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:04:08 gibba045 bash[25517]: cluster 2021-03-10T16:04:08.859038+0000 mgr.gibba045.orlgmj (mgr.34412) 7156 : cluster [DBG] pgmap v4070: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:11.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:04:11 gibba015 bash[29377]: cluster 2021-03-10T16:04:10.860517+0000 mgr.gibba045.orlgmj (mgr.34412) 7157 : cluster [DBG] pgmap v4071: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:11.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:04:11 gibba015 bash[30343]: cluster 2021-03-10T16:04:10.860517+0000 mgr.gibba045.orlgmj (mgr.34412) 7157 : cluster [DBG] pgmap v4071: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:11.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:04:11 gibba045 bash[25517]: cluster 2021-03-10T16:04:10.860517+0000 mgr.gibba045.orlgmj (mgr.34412) 7157 : cluster [DBG] pgmap v4071: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:13.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:04:12 gibba015 bash[29377]: cluster 2021-03-10T16:04:12.861834+0000 mgr.gibba045.orlgmj (mgr.34412) 7158 : cluster [DBG] pgmap v4072: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:13.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:04:12 gibba015 bash[30343]: cluster 2021-03-10T16:04:12.861834+0000 mgr.gibba045.orlgmj (mgr.34412) 7158 : cluster [DBG] pgmap v4072: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:13.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:04:12 gibba045 bash[25517]: cluster 2021-03-10T16:04:12.861834+0000 mgr.gibba045.orlgmj (mgr.34412) 7158 : cluster [DBG] pgmap v4072: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:15.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:04:14 gibba015 bash[29377]: cluster 2021-03-10T16:04:14.863238+0000 mgr.gibba045.orlgmj (mgr.34412) 7159 : cluster [DBG] pgmap v4073: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:15.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:04:14 gibba015 bash[30343]: cluster 2021-03-10T16:04:14.863238+0000 mgr.gibba045.orlgmj (mgr.34412) 7159 : cluster [DBG] pgmap v4073: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:15.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:04:14 gibba045 bash[25517]: cluster 2021-03-10T16:04:14.863238+0000 mgr.gibba045.orlgmj (mgr.34412) 7159 : cluster [DBG] pgmap v4073: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:17.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:04:16 gibba015 bash[29377]: cluster 2021-03-10T16:04:16.864889+0000 mgr.gibba045.orlgmj (mgr.34412) 7160 : cluster [DBG] pgmap v4074: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:17.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:04:16 gibba015 bash[30343]: cluster 2021-03-10T16:04:16.864889+0000 mgr.gibba045.orlgmj (mgr.34412) 7160 : cluster [DBG] pgmap v4074: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:17.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:04:16 gibba045 bash[25517]: cluster 2021-03-10T16:04:16.864889+0000 mgr.gibba045.orlgmj (mgr.34412) 7160 : cluster [DBG] pgmap v4074: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:19.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:04:18 gibba015 bash[29377]: cephadm 2021-03-10T16:04:18.339544+0000 mgr.gibba045.orlgmj (mgr.34412) 7161 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:04:19.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:04:18 gibba015 bash[29377]: cluster 2021-03-10T16:04:18.866088+0000 mgr.gibba045.orlgmj (mgr.34412) 7162 : cluster [DBG] pgmap v4075: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:19.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:04:18 gibba015 bash[30343]: cephadm 2021-03-10T16:04:18.339544+0000 mgr.gibba045.orlgmj (mgr.34412) 7161 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:04:19.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:04:18 gibba015 bash[30343]: cluster 2021-03-10T16:04:18.866088+0000 mgr.gibba045.orlgmj (mgr.34412) 7162 : cluster [DBG] pgmap v4075: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:19.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:04:18 gibba045 bash[25517]: cephadm 2021-03-10T16:04:18.339544+0000 mgr.gibba045.orlgmj (mgr.34412) 7161 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:04:19.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:04:18 gibba045 bash[25517]: cluster 2021-03-10T16:04:18.866088+0000 mgr.gibba045.orlgmj (mgr.34412) 7162 : cluster [DBG] pgmap v4075: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:20.070 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:04:20.298 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:04:20.298 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 8m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:04:20.299 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 7m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:04:20.299 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:04:20.299 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:04:20.299 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:04:20.300 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:04:20.300 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:04:20.300 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:04:20.300 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 8m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:04:20.300 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 7m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:04:20.301 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:04:20.301 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:04:20.301 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:04:20.301 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:04:20.302 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:04:20.302 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:04:20.302 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:04:20.302 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:04:20.303 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 7m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:04:20.303 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 7m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:04:20.550 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:04:20.551 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:04:20.551 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:04:20.551 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:04:20.551 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:04:20.552 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:04:20.552 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:04:20.552 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:04:20.552 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:04:20.552 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:04:20.553 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:04:20.553 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:04:20.553 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:04:20.553 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:04:20.554 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:04:21.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:04:21 gibba015 bash[29377]: audit 2021-03-10T16:04:20.063035+0000 mgr.gibba045.orlgmj (mgr.34412) 7163 : audit [DBG] from='client.58846 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:04:21.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:04:21 gibba015 bash[29377]: audit 2021-03-10T16:04:20.286963+0000 mgr.gibba045.orlgmj (mgr.34412) 7164 : audit [DBG] from='client.48864 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:04:21.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:04:21 gibba015 bash[29377]: audit 2021-03-10T16:04:20.549757+0000 mon.c (mon.1) 1990 : audit [DBG] from='client.? 172.21.2.115:0/3477550441' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:04:21.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:04:21 gibba015 bash[29377]: cluster 2021-03-10T16:04:20.867702+0000 mgr.gibba045.orlgmj (mgr.34412) 7165 : cluster [DBG] pgmap v4076: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:21.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:04:21 gibba015 bash[30343]: audit 2021-03-10T16:04:20.063035+0000 mgr.gibba045.orlgmj (mgr.34412) 7163 : audit [DBG] from='client.58846 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:04:21.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:04:21 gibba015 bash[30343]: audit 2021-03-10T16:04:20.286963+0000 mgr.gibba045.orlgmj (mgr.34412) 7164 : audit [DBG] from='client.48864 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:04:21.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:04:21 gibba015 bash[30343]: audit 2021-03-10T16:04:20.549757+0000 mon.c (mon.1) 1990 : audit [DBG] from='client.? 172.21.2.115:0/3477550441' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:04:21.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:04:21 gibba015 bash[30343]: cluster 2021-03-10T16:04:20.867702+0000 mgr.gibba045.orlgmj (mgr.34412) 7165 : cluster [DBG] pgmap v4076: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:21.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:04:21 gibba045 bash[25517]: audit 2021-03-10T16:04:20.063035+0000 mgr.gibba045.orlgmj (mgr.34412) 7163 : audit [DBG] from='client.58846 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:04:21.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:04:21 gibba045 bash[25517]: audit 2021-03-10T16:04:20.286963+0000 mgr.gibba045.orlgmj (mgr.34412) 7164 : audit [DBG] from='client.48864 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:04:21.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:04:21 gibba045 bash[25517]: audit 2021-03-10T16:04:20.549757+0000 mon.c (mon.1) 1990 : audit [DBG] from='client.? 172.21.2.115:0/3477550441' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:04:21.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:04:21 gibba045 bash[25517]: cluster 2021-03-10T16:04:20.867702+0000 mgr.gibba045.orlgmj (mgr.34412) 7165 : cluster [DBG] pgmap v4076: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:23.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:04:22 gibba015 bash[29377]: cluster 2021-03-10T16:04:22.869190+0000 mgr.gibba045.orlgmj (mgr.34412) 7166 : cluster [DBG] pgmap v4077: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:23.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:04:22 gibba015 bash[30343]: cluster 2021-03-10T16:04:22.869190+0000 mgr.gibba045.orlgmj (mgr.34412) 7166 : cluster [DBG] pgmap v4077: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:23.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:04:22 gibba045 bash[25517]: cluster 2021-03-10T16:04:22.869190+0000 mgr.gibba045.orlgmj (mgr.34412) 7166 : cluster [DBG] pgmap v4077: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:25.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:04:24 gibba015 bash[29377]: cluster 2021-03-10T16:04:24.870602+0000 mgr.gibba045.orlgmj (mgr.34412) 7167 : cluster [DBG] pgmap v4078: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:25.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:04:24 gibba015 bash[30343]: cluster 2021-03-10T16:04:24.870602+0000 mgr.gibba045.orlgmj (mgr.34412) 7167 : cluster [DBG] pgmap v4078: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:25.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:04:24 gibba045 bash[25517]: cluster 2021-03-10T16:04:24.870602+0000 mgr.gibba045.orlgmj (mgr.34412) 7167 : cluster [DBG] pgmap v4078: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:27.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:04:26 gibba015 bash[29377]: cluster 2021-03-10T16:04:26.872082+0000 mgr.gibba045.orlgmj (mgr.34412) 7168 : cluster [DBG] pgmap v4079: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:27.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:04:26 gibba015 bash[30343]: cluster 2021-03-10T16:04:26.872082+0000 mgr.gibba045.orlgmj (mgr.34412) 7168 : cluster [DBG] pgmap v4079: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:27.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:04:26 gibba045 bash[25517]: cluster 2021-03-10T16:04:26.872082+0000 mgr.gibba045.orlgmj (mgr.34412) 7168 : cluster [DBG] pgmap v4079: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:29.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:04:28 gibba015 bash[29377]: cluster 2021-03-10T16:04:28.873258+0000 mgr.gibba045.orlgmj (mgr.34412) 7169 : cluster [DBG] pgmap v4080: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:29.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:04:28 gibba015 bash[30343]: cluster 2021-03-10T16:04:28.873258+0000 mgr.gibba045.orlgmj (mgr.34412) 7169 : cluster [DBG] pgmap v4080: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:29.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:04:28 gibba045 bash[25517]: cluster 2021-03-10T16:04:28.873258+0000 mgr.gibba045.orlgmj (mgr.34412) 7169 : cluster [DBG] pgmap v4080: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:31.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:04:31 gibba015 bash[29377]: cluster 2021-03-10T16:04:30.874868+0000 mgr.gibba045.orlgmj (mgr.34412) 7170 : cluster [DBG] pgmap v4081: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:31.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:04:31 gibba015 bash[30343]: cluster 2021-03-10T16:04:30.874868+0000 mgr.gibba045.orlgmj (mgr.34412) 7170 : cluster [DBG] pgmap v4081: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:31.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:04:31 gibba045 bash[25517]: cluster 2021-03-10T16:04:30.874868+0000 mgr.gibba045.orlgmj (mgr.34412) 7170 : cluster [DBG] pgmap v4081: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:33.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:04:32 gibba015 bash[29377]: cluster 2021-03-10T16:04:32.876407+0000 mgr.gibba045.orlgmj (mgr.34412) 7171 : cluster [DBG] pgmap v4082: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:33.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:04:32 gibba015 bash[30343]: cluster 2021-03-10T16:04:32.876407+0000 mgr.gibba045.orlgmj (mgr.34412) 7171 : cluster [DBG] pgmap v4082: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:33.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:04:32 gibba045 bash[25517]: cluster 2021-03-10T16:04:32.876407+0000 mgr.gibba045.orlgmj (mgr.34412) 7171 : cluster [DBG] pgmap v4082: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:34.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:04:33 gibba015 bash[29377]: cephadm 2021-03-10T16:04:33.353289+0000 mgr.gibba045.orlgmj (mgr.34412) 7172 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:04:34.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:04:33 gibba015 bash[30343]: cephadm 2021-03-10T16:04:33.353289+0000 mgr.gibba045.orlgmj (mgr.34412) 7172 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:04:34.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:04:33 gibba045 bash[25517]: cephadm 2021-03-10T16:04:33.353289+0000 mgr.gibba045.orlgmj (mgr.34412) 7172 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:04:35.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:04:34 gibba015 bash[29377]: cluster 2021-03-10T16:04:34.878238+0000 mgr.gibba045.orlgmj (mgr.34412) 7173 : cluster [DBG] pgmap v4083: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:35.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:04:34 gibba015 bash[30343]: cluster 2021-03-10T16:04:34.878238+0000 mgr.gibba045.orlgmj (mgr.34412) 7173 : cluster [DBG] pgmap v4083: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:35.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:04:34 gibba045 bash[25517]: cluster 2021-03-10T16:04:34.878238+0000 mgr.gibba045.orlgmj (mgr.34412) 7173 : cluster [DBG] pgmap v4083: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:37.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:04:36 gibba015 bash[29377]: cluster 2021-03-10T16:04:36.879879+0000 mgr.gibba045.orlgmj (mgr.34412) 7174 : cluster [DBG] pgmap v4084: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:37.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:04:36 gibba015 bash[30343]: cluster 2021-03-10T16:04:36.879879+0000 mgr.gibba045.orlgmj (mgr.34412) 7174 : cluster [DBG] pgmap v4084: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:37.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:04:36 gibba045 bash[25517]: cluster 2021-03-10T16:04:36.879879+0000 mgr.gibba045.orlgmj (mgr.34412) 7174 : cluster [DBG] pgmap v4084: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:39.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:04:38 gibba015 bash[29377]: cluster 2021-03-10T16:04:38.880883+0000 mgr.gibba045.orlgmj (mgr.34412) 7175 : cluster [DBG] pgmap v4085: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:39.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:04:38 gibba015 bash[30343]: cluster 2021-03-10T16:04:38.880883+0000 mgr.gibba045.orlgmj (mgr.34412) 7175 : cluster [DBG] pgmap v4085: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:39.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:04:38 gibba045 bash[25517]: cluster 2021-03-10T16:04:38.880883+0000 mgr.gibba045.orlgmj (mgr.34412) 7175 : cluster [DBG] pgmap v4085: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:41.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:04:41 gibba015 bash[29377]: cluster 2021-03-10T16:04:40.882423+0000 mgr.gibba045.orlgmj (mgr.34412) 7176 : cluster [DBG] pgmap v4086: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:41.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:04:41 gibba015 bash[30343]: cluster 2021-03-10T16:04:40.882423+0000 mgr.gibba045.orlgmj (mgr.34412) 7176 : cluster [DBG] pgmap v4086: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:41.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:04:41 gibba045 bash[25517]: cluster 2021-03-10T16:04:40.882423+0000 mgr.gibba045.orlgmj (mgr.34412) 7176 : cluster [DBG] pgmap v4086: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:43.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:04:42 gibba015 bash[29377]: cluster 2021-03-10T16:04:42.883971+0000 mgr.gibba045.orlgmj (mgr.34412) 7177 : cluster [DBG] pgmap v4087: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:43.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:04:42 gibba015 bash[30343]: cluster 2021-03-10T16:04:42.883971+0000 mgr.gibba045.orlgmj (mgr.34412) 7177 : cluster [DBG] pgmap v4087: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:43.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:04:42 gibba045 bash[25517]: cluster 2021-03-10T16:04:42.883971+0000 mgr.gibba045.orlgmj (mgr.34412) 7177 : cluster [DBG] pgmap v4087: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:46.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:04:46 gibba015 bash[29377]: cluster 2021-03-10T16:04:44.885557+0000 mgr.gibba045.orlgmj (mgr.34412) 7178 : cluster [DBG] pgmap v4088: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:46.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:04:46 gibba015 bash[30343]: cluster 2021-03-10T16:04:44.885557+0000 mgr.gibba045.orlgmj (mgr.34412) 7178 : cluster [DBG] pgmap v4088: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:46.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:04:46 gibba045 bash[25517]: cluster 2021-03-10T16:04:44.885557+0000 mgr.gibba045.orlgmj (mgr.34412) 7178 : cluster [DBG] pgmap v4088: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:48.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:04:48 gibba015 bash[29377]: cluster 2021-03-10T16:04:46.887051+0000 mgr.gibba045.orlgmj (mgr.34412) 7179 : cluster [DBG] pgmap v4089: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:48.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:04:48 gibba015 bash[30343]: cluster 2021-03-10T16:04:46.887051+0000 mgr.gibba045.orlgmj (mgr.34412) 7179 : cluster [DBG] pgmap v4089: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:48.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:04:48 gibba045 bash[25517]: cluster 2021-03-10T16:04:46.887051+0000 mgr.gibba045.orlgmj (mgr.34412) 7179 : cluster [DBG] pgmap v4089: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:49.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:04:49 gibba015 bash[29377]: audit 2021-03-10T16:04:48.366822+0000 mon.c (mon.1) 1991 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:04:49.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:04:49 gibba015 bash[29377]: cephadm 2021-03-10T16:04:48.371037+0000 mgr.gibba045.orlgmj (mgr.34412) 7180 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:04:49.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:04:49 gibba015 bash[29377]: cephadm 2021-03-10T16:04:48.371431+0000 mgr.gibba045.orlgmj (mgr.34412) 7181 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:04:49.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:04:49 gibba015 bash[29377]: audit 2021-03-10T16:04:48.569685+0000 mon.a (mon.0) 1698 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:04:49.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:04:49 gibba015 bash[29377]: audit 2021-03-10T16:04:48.573316+0000 mon.c (mon.1) 1992 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:04:49.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:04:49 gibba015 bash[29377]: audit 2021-03-10T16:04:48.574848+0000 mon.c (mon.1) 1993 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:04:49.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:04:49 gibba015 bash[29377]: cephadm 2021-03-10T16:04:48.575045+0000 mgr.gibba045.orlgmj (mgr.34412) 7182 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:04:49.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:04:49 gibba015 bash[29377]: audit 2021-03-10T16:04:48.576616+0000 mon.c (mon.1) 1994 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:04:49.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:04:49 gibba015 bash[29377]: cephadm 2021-03-10T16:04:48.576788+0000 mgr.gibba045.orlgmj (mgr.34412) 7183 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:04:49.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:04:49 gibba015 bash[29377]: audit 2021-03-10T16:04:48.577841+0000 mon.c (mon.1) 1995 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:04:49.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:04:49 gibba015 bash[29377]: cephadm 2021-03-10T16:04:48.578547+0000 mgr.gibba045.orlgmj (mgr.34412) 7184 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:04:49.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:04:49 gibba015 bash[29377]: cephadm 2021-03-10T16:04:48.578583+0000 mgr.gibba045.orlgmj (mgr.34412) 7185 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:04:49.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:04:49 gibba015 bash[29377]: cephadm 2021-03-10T16:04:48.579919+0000 mgr.gibba045.orlgmj (mgr.34412) 7186 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:04:49.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:04:49 gibba015 bash[29377]: cephadm 2021-03-10T16:04:48.579958+0000 mgr.gibba045.orlgmj (mgr.34412) 7187 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:04:49.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:04:49 gibba015 bash[29377]: cephadm 2021-03-10T16:04:48.581334+0000 mgr.gibba045.orlgmj (mgr.34412) 7188 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:04:49.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:04:49 gibba015 bash[29377]: audit 2021-03-10T16:04:48.581355+0000 mon.c (mon.1) 1996 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:04:49.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:04:49 gibba015 bash[29377]: audit 2021-03-10T16:04:48.582976+0000 mon.c (mon.1) 1997 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:04:49.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:04:49 gibba015 bash[29377]: cephadm 2021-03-10T16:04:48.583179+0000 mgr.gibba045.orlgmj (mgr.34412) 7189 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:04:49.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:04:49 gibba015 bash[29377]: cephadm 2021-03-10T16:04:48.583217+0000 mgr.gibba045.orlgmj (mgr.34412) 7190 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:04:49.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:04:49 gibba015 bash[29377]: cephadm 2021-03-10T16:04:48.584698+0000 mgr.gibba045.orlgmj (mgr.34412) 7191 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:04:49.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:04:49 gibba015 bash[30343]: audit 2021-03-10T16:04:48.366822+0000 mon.c (mon.1) 1991 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:04:49.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:04:49 gibba015 bash[30343]: cephadm 2021-03-10T16:04:48.371037+0000 mgr.gibba045.orlgmj (mgr.34412) 7180 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:04:49.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:04:49 gibba015 bash[30343]: cephadm 2021-03-10T16:04:48.371431+0000 mgr.gibba045.orlgmj (mgr.34412) 7181 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:04:49.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:04:49 gibba015 bash[30343]: audit 2021-03-10T16:04:48.569685+0000 mon.a (mon.0) 1698 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:04:49.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:04:49 gibba015 bash[30343]: audit 2021-03-10T16:04:48.573316+0000 mon.c (mon.1) 1992 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:04:49.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:04:49 gibba015 bash[30343]: audit 2021-03-10T16:04:48.574848+0000 mon.c (mon.1) 1993 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:04:49.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:04:49 gibba015 bash[30343]: cephadm 2021-03-10T16:04:48.575045+0000 mgr.gibba045.orlgmj (mgr.34412) 7182 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:04:49.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:04:49 gibba015 bash[30343]: audit 2021-03-10T16:04:48.576616+0000 mon.c (mon.1) 1994 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:04:49.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:04:49 gibba015 bash[30343]: cephadm 2021-03-10T16:04:48.576788+0000 mgr.gibba045.orlgmj (mgr.34412) 7183 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:04:49.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:04:49 gibba015 bash[30343]: audit 2021-03-10T16:04:48.577841+0000 mon.c (mon.1) 1995 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:04:49.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:04:49 gibba015 bash[30343]: cephadm 2021-03-10T16:04:48.578547+0000 mgr.gibba045.orlgmj (mgr.34412) 7184 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:04:49.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:04:49 gibba015 bash[30343]: cephadm 2021-03-10T16:04:48.578583+0000 mgr.gibba045.orlgmj (mgr.34412) 7185 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:04:49.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:04:49 gibba015 bash[30343]: cephadm 2021-03-10T16:04:48.579919+0000 mgr.gibba045.orlgmj (mgr.34412) 7186 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:04:49.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:04:49 gibba015 bash[30343]: cephadm 2021-03-10T16:04:48.579958+0000 mgr.gibba045.orlgmj (mgr.34412) 7187 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:04:49.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:04:49 gibba015 bash[30343]: cephadm 2021-03-10T16:04:48.581334+0000 mgr.gibba045.orlgmj (mgr.34412) 7188 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:04:49.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:04:49 gibba015 bash[30343]: audit 2021-03-10T16:04:48.581355+0000 mon.c (mon.1) 1996 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:04:49.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:04:49 gibba015 bash[30343]: audit 2021-03-10T16:04:48.582976+0000 mon.c (mon.1) 1997 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:04:49.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:04:49 gibba015 bash[30343]: cephadm 2021-03-10T16:04:48.583179+0000 mgr.gibba045.orlgmj (mgr.34412) 7189 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:04:49.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:04:49 gibba015 bash[30343]: cephadm 2021-03-10T16:04:48.583217+0000 mgr.gibba045.orlgmj (mgr.34412) 7190 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:04:49.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:04:49 gibba015 bash[30343]: cephadm 2021-03-10T16:04:48.584698+0000 mgr.gibba045.orlgmj (mgr.34412) 7191 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:04:49.731 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:04:49 gibba015 bash[29377]: cephadm 2021-03-10T16:04:48.585015+0000 mgr.gibba045.orlgmj (mgr.34412) 7192 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:04:49.732 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:04:49 gibba015 bash[29377]: cephadm 2021-03-10T16:04:48.586447+0000 mgr.gibba045.orlgmj (mgr.34412) 7193 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:04:49.732 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:04:49 gibba015 bash[29377]: cephadm 2021-03-10T16:04:48.586486+0000 mgr.gibba045.orlgmj (mgr.34412) 7194 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:04:49.732 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:04:49 gibba015 bash[29377]: cephadm 2021-03-10T16:04:48.586593+0000 mgr.gibba045.orlgmj (mgr.34412) 7195 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:04:49.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:04:49 gibba015 bash[30343]: cephadm 2021-03-10T16:04:48.585015+0000 mgr.gibba045.orlgmj (mgr.34412) 7192 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:04:49.733 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:04:49 gibba015 bash[30343]: cephadm 2021-03-10T16:04:48.586447+0000 mgr.gibba045.orlgmj (mgr.34412) 7193 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:04:49.733 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:04:49 gibba015 bash[30343]: cephadm 2021-03-10T16:04:48.586486+0000 mgr.gibba045.orlgmj (mgr.34412) 7194 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:04:49.733 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:04:49 gibba015 bash[30343]: cephadm 2021-03-10T16:04:48.586593+0000 mgr.gibba045.orlgmj (mgr.34412) 7195 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:04:49.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:04:49 gibba045 bash[25517]: audit 2021-03-10T16:04:48.366822+0000 mon.c (mon.1) 1991 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:04:49.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:04:49 gibba045 bash[25517]: cephadm 2021-03-10T16:04:48.371037+0000 mgr.gibba045.orlgmj (mgr.34412) 7180 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:04:49.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:04:49 gibba045 bash[25517]: cephadm 2021-03-10T16:04:48.371431+0000 mgr.gibba045.orlgmj (mgr.34412) 7181 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:04:49.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:04:49 gibba045 bash[25517]: audit 2021-03-10T16:04:48.569685+0000 mon.a (mon.0) 1698 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:04:49.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:04:49 gibba045 bash[25517]: audit 2021-03-10T16:04:48.573316+0000 mon.c (mon.1) 1992 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:04:49.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:04:49 gibba045 bash[25517]: audit 2021-03-10T16:04:48.574848+0000 mon.c (mon.1) 1993 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:04:49.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:04:49 gibba045 bash[25517]: cephadm 2021-03-10T16:04:48.575045+0000 mgr.gibba045.orlgmj (mgr.34412) 7182 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:04:49.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:04:49 gibba045 bash[25517]: audit 2021-03-10T16:04:48.576616+0000 mon.c (mon.1) 1994 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:04:49.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:04:49 gibba045 bash[25517]: cephadm 2021-03-10T16:04:48.576788+0000 mgr.gibba045.orlgmj (mgr.34412) 7183 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:04:49.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:04:49 gibba045 bash[25517]: audit 2021-03-10T16:04:48.577841+0000 mon.c (mon.1) 1995 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:04:49.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:04:49 gibba045 bash[25517]: cephadm 2021-03-10T16:04:48.578547+0000 mgr.gibba045.orlgmj (mgr.34412) 7184 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:04:49.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:04:49 gibba045 bash[25517]: cephadm 2021-03-10T16:04:48.578583+0000 mgr.gibba045.orlgmj (mgr.34412) 7185 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:04:49.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:04:49 gibba045 bash[25517]: cephadm 2021-03-10T16:04:48.579919+0000 mgr.gibba045.orlgmj (mgr.34412) 7186 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:04:49.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:04:49 gibba045 bash[25517]: cephadm 2021-03-10T16:04:48.579958+0000 mgr.gibba045.orlgmj (mgr.34412) 7187 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:04:49.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:04:49 gibba045 bash[25517]: cephadm 2021-03-10T16:04:48.581334+0000 mgr.gibba045.orlgmj (mgr.34412) 7188 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:04:49.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:04:49 gibba045 bash[25517]: audit 2021-03-10T16:04:48.581355+0000 mon.c (mon.1) 1996 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:04:49.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:04:49 gibba045 bash[25517]: audit 2021-03-10T16:04:48.582976+0000 mon.c (mon.1) 1997 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:04:49.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:04:49 gibba045 bash[25517]: cephadm 2021-03-10T16:04:48.583179+0000 mgr.gibba045.orlgmj (mgr.34412) 7189 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:04:49.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:04:49 gibba045 bash[25517]: cephadm 2021-03-10T16:04:48.583217+0000 mgr.gibba045.orlgmj (mgr.34412) 7190 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:04:49.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:04:49 gibba045 bash[25517]: cephadm 2021-03-10T16:04:48.584698+0000 mgr.gibba045.orlgmj (mgr.34412) 7191 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:04:49.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:04:49 gibba045 bash[25517]: cephadm 2021-03-10T16:04:48.585015+0000 mgr.gibba045.orlgmj (mgr.34412) 7192 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:04:49.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:04:49 gibba045 bash[25517]: cephadm 2021-03-10T16:04:48.586447+0000 mgr.gibba045.orlgmj (mgr.34412) 7193 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:04:49.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:04:49 gibba045 bash[25517]: cephadm 2021-03-10T16:04:48.586486+0000 mgr.gibba045.orlgmj (mgr.34412) 7194 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:04:49.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:04:49 gibba045 bash[25517]: cephadm 2021-03-10T16:04:48.586593+0000 mgr.gibba045.orlgmj (mgr.34412) 7195 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:04:50.796 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:04:50.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:04:50 gibba015 bash[29377]: cluster 2021-03-10T16:04:48.888266+0000 mgr.gibba045.orlgmj (mgr.34412) 7196 : cluster [DBG] pgmap v4090: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:50.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:04:50 gibba015 bash[30343]: cluster 2021-03-10T16:04:48.888266+0000 mgr.gibba045.orlgmj (mgr.34412) 7196 : cluster [DBG] pgmap v4090: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:51.024 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:04:51.024 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 9m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:04:51.025 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 8m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:04:51.025 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:04:51.025 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:04:51.025 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:04:51.025 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:04:51.026 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:04:51.026 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:04:51.026 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 9m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:04:51.026 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 8m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:04:51.026 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:04:51.027 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:04:51.027 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:04:51.027 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:04:51.027 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:04:51.028 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:04:51.028 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:04:51.028 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:04:51.028 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 8m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:04:51.028 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 8m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:04:51.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:04:50 gibba045 bash[25517]: cluster 2021-03-10T16:04:48.888266+0000 mgr.gibba045.orlgmj (mgr.34412) 7196 : cluster [DBG] pgmap v4090: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:51.277 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:04:51.277 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:04:51.277 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:04:51.278 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:04:51.278 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:04:51.278 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:04:51.278 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:04:51.278 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:04:51.279 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:04:51.279 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:04:51.279 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:04:51.279 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:04:51.279 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:04:51.280 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:04:51.280 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:04:51.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:04:51 gibba015 bash[29377]: audit 2021-03-10T16:04:50.788660+0000 mgr.gibba045.orlgmj (mgr.34412) 7197 : audit [DBG] from='client.58864 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:04:51.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:04:51 gibba015 bash[29377]: audit 2021-03-10T16:04:51.276329+0000 mon.a (mon.0) 1699 : audit [DBG] from='client.? 172.21.2.115:0/2441332600' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:04:51.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:04:51 gibba015 bash[30343]: audit 2021-03-10T16:04:50.788660+0000 mgr.gibba045.orlgmj (mgr.34412) 7197 : audit [DBG] from='client.58864 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:04:51.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:04:51 gibba015 bash[30343]: audit 2021-03-10T16:04:51.276329+0000 mon.a (mon.0) 1699 : audit [DBG] from='client.? 172.21.2.115:0/2441332600' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:04:52.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:04:51 gibba045 bash[25517]: audit 2021-03-10T16:04:50.788660+0000 mgr.gibba045.orlgmj (mgr.34412) 7197 : audit [DBG] from='client.58864 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:04:52.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:04:51 gibba045 bash[25517]: audit 2021-03-10T16:04:51.276329+0000 mon.a (mon.0) 1699 : audit [DBG] from='client.? 172.21.2.115:0/2441332600' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:04:52.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:04:52 gibba015 bash[29377]: cluster 2021-03-10T16:04:50.889723+0000 mgr.gibba045.orlgmj (mgr.34412) 7198 : cluster [DBG] pgmap v4091: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:52.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:04:52 gibba015 bash[29377]: audit 2021-03-10T16:04:51.013266+0000 mgr.gibba045.orlgmj (mgr.34412) 7199 : audit [DBG] from='client.58870 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:04:52.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:04:52 gibba015 bash[30343]: cluster 2021-03-10T16:04:50.889723+0000 mgr.gibba045.orlgmj (mgr.34412) 7198 : cluster [DBG] pgmap v4091: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:52.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:04:52 gibba015 bash[30343]: audit 2021-03-10T16:04:51.013266+0000 mgr.gibba045.orlgmj (mgr.34412) 7199 : audit [DBG] from='client.58870 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:04:53.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:04:52 gibba045 bash[25517]: cluster 2021-03-10T16:04:50.889723+0000 mgr.gibba045.orlgmj (mgr.34412) 7198 : cluster [DBG] pgmap v4091: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:53.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:04:52 gibba045 bash[25517]: audit 2021-03-10T16:04:51.013266+0000 mgr.gibba045.orlgmj (mgr.34412) 7199 : audit [DBG] from='client.58870 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:04:53.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:04:53 gibba015 bash[29377]: audit 2021-03-10T16:04:53.411818+0000 mon.c (mon.1) 1998 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:04:53.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:04:53 gibba015 bash[29377]: audit 2021-03-10T16:04:53.412426+0000 mon.c (mon.1) 1999 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:04:53.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:04:53 gibba015 bash[29377]: audit 2021-03-10T16:04:53.412910+0000 mon.a (mon.0) 1700 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:04:53.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:04:53 gibba015 bash[29377]: audit 2021-03-10T16:04:53.414134+0000 mon.a (mon.0) 1701 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:04:53.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:04:53 gibba015 bash[29377]: audit 2021-03-10T16:04:53.415676+0000 mon.c (mon.1) 2000 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T16:04:53.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:04:53 gibba015 bash[29377]: audit 2021-03-10T16:04:53.416424+0000 mon.c (mon.1) 2001 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T16:04:53.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:04:53 gibba015 bash[29377]: audit 2021-03-10T16:04:53.416776+0000 mon.a (mon.0) 1702 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T16:04:53.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:04:53 gibba015 bash[29377]: audit 2021-03-10T16:04:53.417157+0000 mon.c (mon.1) 2002 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:04:53.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:04:53 gibba015 bash[29377]: audit 2021-03-10T16:04:53.418031+0000 mon.a (mon.0) 1703 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T16:04:53.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:04:53 gibba015 bash[29377]: audit 2021-03-10T16:04:53.418219+0000 mon.c (mon.1) 2003 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:04:53.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:04:53 gibba015 bash[29377]: audit 2021-03-10T16:04:53.418996+0000 mon.a (mon.0) 1704 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:04:53.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:04:53 gibba015 bash[29377]: audit 2021-03-10T16:04:53.419944+0000 mon.a (mon.0) 1705 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:04:53.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:04:53 gibba015 bash[30343]: audit 2021-03-10T16:04:53.411818+0000 mon.c (mon.1) 1998 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:04:53.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:04:53 gibba015 bash[30343]: audit 2021-03-10T16:04:53.412426+0000 mon.c (mon.1) 1999 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:04:53.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:04:53 gibba015 bash[30343]: audit 2021-03-10T16:04:53.412910+0000 mon.a (mon.0) 1700 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:04:53.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:04:53 gibba015 bash[30343]: audit 2021-03-10T16:04:53.414134+0000 mon.a (mon.0) 1701 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:04:53.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:04:53 gibba015 bash[30343]: audit 2021-03-10T16:04:53.415676+0000 mon.c (mon.1) 2000 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T16:04:53.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:04:53 gibba015 bash[30343]: audit 2021-03-10T16:04:53.416424+0000 mon.c (mon.1) 2001 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T16:04:53.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:04:53 gibba015 bash[30343]: audit 2021-03-10T16:04:53.416776+0000 mon.a (mon.0) 1702 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T16:04:53.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:04:53 gibba015 bash[30343]: audit 2021-03-10T16:04:53.417157+0000 mon.c (mon.1) 2002 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:04:53.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:04:53 gibba015 bash[30343]: audit 2021-03-10T16:04:53.418031+0000 mon.a (mon.0) 1703 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T16:04:53.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:04:53 gibba015 bash[30343]: audit 2021-03-10T16:04:53.418219+0000 mon.c (mon.1) 2003 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:04:53.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:04:53 gibba015 bash[30343]: audit 2021-03-10T16:04:53.418996+0000 mon.a (mon.0) 1704 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:04:53.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:04:53 gibba015 bash[30343]: audit 2021-03-10T16:04:53.419944+0000 mon.a (mon.0) 1705 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:04:54.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:04:53 gibba045 bash[25517]: audit 2021-03-10T16:04:53.411818+0000 mon.c (mon.1) 1998 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:04:54.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:04:53 gibba045 bash[25517]: audit 2021-03-10T16:04:53.412426+0000 mon.c (mon.1) 1999 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:04:54.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:04:53 gibba045 bash[25517]: audit 2021-03-10T16:04:53.412910+0000 mon.a (mon.0) 1700 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:04:54.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:04:53 gibba045 bash[25517]: audit 2021-03-10T16:04:53.414134+0000 mon.a (mon.0) 1701 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:04:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:04:53 gibba045 bash[25517]: audit 2021-03-10T16:04:53.415676+0000 mon.c (mon.1) 2000 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T16:04:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:04:53 gibba045 bash[25517]: audit 2021-03-10T16:04:53.416424+0000 mon.c (mon.1) 2001 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T16:04:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:04:53 gibba045 bash[25517]: audit 2021-03-10T16:04:53.416776+0000 mon.a (mon.0) 1702 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T16:04:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:04:53 gibba045 bash[25517]: audit 2021-03-10T16:04:53.417157+0000 mon.c (mon.1) 2002 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:04:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:04:53 gibba045 bash[25517]: audit 2021-03-10T16:04:53.418031+0000 mon.a (mon.0) 1703 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T16:04:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:04:53 gibba045 bash[25517]: audit 2021-03-10T16:04:53.418219+0000 mon.c (mon.1) 2003 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:04:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:04:53 gibba045 bash[25517]: audit 2021-03-10T16:04:53.418996+0000 mon.a (mon.0) 1704 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:04:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:04:53 gibba045 bash[25517]: audit 2021-03-10T16:04:53.419944+0000 mon.a (mon.0) 1705 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:04:54.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:04:54 gibba015 bash[29377]: cluster 2021-03-10T16:04:52.891208+0000 mgr.gibba045.orlgmj (mgr.34412) 7200 : cluster [DBG] pgmap v4092: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:54.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:04:54 gibba015 bash[30343]: cluster 2021-03-10T16:04:52.891208+0000 mgr.gibba045.orlgmj (mgr.34412) 7200 : cluster [DBG] pgmap v4092: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:55.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:04:54 gibba045 bash[25517]: cluster 2021-03-10T16:04:52.891208+0000 mgr.gibba045.orlgmj (mgr.34412) 7200 : cluster [DBG] pgmap v4092: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:56.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:04:56 gibba015 bash[29377]: cluster 2021-03-10T16:04:54.892788+0000 mgr.gibba045.orlgmj (mgr.34412) 7201 : cluster [DBG] pgmap v4093: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:56.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:04:56 gibba015 bash[30343]: cluster 2021-03-10T16:04:54.892788+0000 mgr.gibba045.orlgmj (mgr.34412) 7201 : cluster [DBG] pgmap v4093: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:57.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:04:56 gibba045 bash[25517]: cluster 2021-03-10T16:04:54.892788+0000 mgr.gibba045.orlgmj (mgr.34412) 7201 : cluster [DBG] pgmap v4093: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:58.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:04:58 gibba015 bash[29377]: cluster 2021-03-10T16:04:56.894419+0000 mgr.gibba045.orlgmj (mgr.34412) 7202 : cluster [DBG] pgmap v4094: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:58.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:04:58 gibba015 bash[30343]: cluster 2021-03-10T16:04:56.894419+0000 mgr.gibba045.orlgmj (mgr.34412) 7202 : cluster [DBG] pgmap v4094: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:59.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:04:58 gibba045 bash[25517]: cluster 2021-03-10T16:04:56.894419+0000 mgr.gibba045.orlgmj (mgr.34412) 7202 : cluster [DBG] pgmap v4094: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:00.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:05:00 gibba015 bash[29377]: cluster 2021-03-10T16:04:58.895658+0000 mgr.gibba045.orlgmj (mgr.34412) 7203 : cluster [DBG] pgmap v4095: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:00.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:05:00 gibba015 bash[30343]: cluster 2021-03-10T16:04:58.895658+0000 mgr.gibba045.orlgmj (mgr.34412) 7203 : cluster [DBG] pgmap v4095: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:01.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:05:00 gibba045 bash[25517]: cluster 2021-03-10T16:04:58.895658+0000 mgr.gibba045.orlgmj (mgr.34412) 7203 : cluster [DBG] pgmap v4095: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:02.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:05:02 gibba015 bash[29377]: cluster 2021-03-10T16:05:00.897361+0000 mgr.gibba045.orlgmj (mgr.34412) 7204 : cluster [DBG] pgmap v4096: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:02.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:05:02 gibba015 bash[30343]: cluster 2021-03-10T16:05:00.897361+0000 mgr.gibba045.orlgmj (mgr.34412) 7204 : cluster [DBG] pgmap v4096: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:03.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:05:02 gibba045 bash[25517]: cluster 2021-03-10T16:05:00.897361+0000 mgr.gibba045.orlgmj (mgr.34412) 7204 : cluster [DBG] pgmap v4096: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:04.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:05:04 gibba015 bash[29377]: cluster 2021-03-10T16:05:02.898847+0000 mgr.gibba045.orlgmj (mgr.34412) 7205 : cluster [DBG] pgmap v4097: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:04.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:05:04 gibba015 bash[29377]: cephadm 2021-03-10T16:05:03.593526+0000 mgr.gibba045.orlgmj (mgr.34412) 7206 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:05:04.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:05:04 gibba015 bash[30343]: cluster 2021-03-10T16:05:02.898847+0000 mgr.gibba045.orlgmj (mgr.34412) 7205 : cluster [DBG] pgmap v4097: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:04.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:05:04 gibba015 bash[30343]: cephadm 2021-03-10T16:05:03.593526+0000 mgr.gibba045.orlgmj (mgr.34412) 7206 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:05:05.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:05:04 gibba045 bash[25517]: cluster 2021-03-10T16:05:02.898847+0000 mgr.gibba045.orlgmj (mgr.34412) 7205 : cluster [DBG] pgmap v4097: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:05.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:05:04 gibba045 bash[25517]: cephadm 2021-03-10T16:05:03.593526+0000 mgr.gibba045.orlgmj (mgr.34412) 7206 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:05:06.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:05:06 gibba015 bash[29377]: cluster 2021-03-10T16:05:04.900380+0000 mgr.gibba045.orlgmj (mgr.34412) 7207 : cluster [DBG] pgmap v4098: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:06.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:05:06 gibba015 bash[30343]: cluster 2021-03-10T16:05:04.900380+0000 mgr.gibba045.orlgmj (mgr.34412) 7207 : cluster [DBG] pgmap v4098: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:07.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:05:06 gibba045 bash[25517]: cluster 2021-03-10T16:05:04.900380+0000 mgr.gibba045.orlgmj (mgr.34412) 7207 : cluster [DBG] pgmap v4098: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:08.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:05:08 gibba015 bash[29377]: cluster 2021-03-10T16:05:06.902222+0000 mgr.gibba045.orlgmj (mgr.34412) 7208 : cluster [DBG] pgmap v4099: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:08.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:05:08 gibba015 bash[30343]: cluster 2021-03-10T16:05:06.902222+0000 mgr.gibba045.orlgmj (mgr.34412) 7208 : cluster [DBG] pgmap v4099: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:09.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:05:08 gibba045 bash[25517]: cluster 2021-03-10T16:05:06.902222+0000 mgr.gibba045.orlgmj (mgr.34412) 7208 : cluster [DBG] pgmap v4099: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:10.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:05:10 gibba015 bash[29377]: cluster 2021-03-10T16:05:08.903507+0000 mgr.gibba045.orlgmj (mgr.34412) 7209 : cluster [DBG] pgmap v4100: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:10.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:05:10 gibba015 bash[30343]: cluster 2021-03-10T16:05:08.903507+0000 mgr.gibba045.orlgmj (mgr.34412) 7209 : cluster [DBG] pgmap v4100: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:11.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:05:10 gibba045 bash[25517]: cluster 2021-03-10T16:05:08.903507+0000 mgr.gibba045.orlgmj (mgr.34412) 7209 : cluster [DBG] pgmap v4100: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:12.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:05:12 gibba015 bash[29377]: cluster 2021-03-10T16:05:10.905203+0000 mgr.gibba045.orlgmj (mgr.34412) 7210 : cluster [DBG] pgmap v4101: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:12.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:05:12 gibba015 bash[30343]: cluster 2021-03-10T16:05:10.905203+0000 mgr.gibba045.orlgmj (mgr.34412) 7210 : cluster [DBG] pgmap v4101: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:13.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:05:12 gibba045 bash[25517]: cluster 2021-03-10T16:05:10.905203+0000 mgr.gibba045.orlgmj (mgr.34412) 7210 : cluster [DBG] pgmap v4101: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:14.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:05:14 gibba015 bash[29377]: cluster 2021-03-10T16:05:12.906877+0000 mgr.gibba045.orlgmj (mgr.34412) 7211 : cluster [DBG] pgmap v4102: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:14.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:05:14 gibba015 bash[30343]: cluster 2021-03-10T16:05:12.906877+0000 mgr.gibba045.orlgmj (mgr.34412) 7211 : cluster [DBG] pgmap v4102: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:15.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:05:14 gibba045 bash[25517]: cluster 2021-03-10T16:05:12.906877+0000 mgr.gibba045.orlgmj (mgr.34412) 7211 : cluster [DBG] pgmap v4102: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:16.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:05:16 gibba015 bash[29377]: cluster 2021-03-10T16:05:14.908467+0000 mgr.gibba045.orlgmj (mgr.34412) 7212 : cluster [DBG] pgmap v4103: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:16.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:05:16 gibba015 bash[30343]: cluster 2021-03-10T16:05:14.908467+0000 mgr.gibba045.orlgmj (mgr.34412) 7212 : cluster [DBG] pgmap v4103: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:17.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:05:16 gibba045 bash[25517]: cluster 2021-03-10T16:05:14.908467+0000 mgr.gibba045.orlgmj (mgr.34412) 7212 : cluster [DBG] pgmap v4103: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:18.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:05:18 gibba015 bash[29377]: cluster 2021-03-10T16:05:16.910291+0000 mgr.gibba045.orlgmj (mgr.34412) 7213 : cluster [DBG] pgmap v4104: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:18.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:05:18 gibba015 bash[30343]: cluster 2021-03-10T16:05:16.910291+0000 mgr.gibba045.orlgmj (mgr.34412) 7213 : cluster [DBG] pgmap v4104: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:19.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:05:18 gibba045 bash[25517]: cluster 2021-03-10T16:05:16.910291+0000 mgr.gibba045.orlgmj (mgr.34412) 7213 : cluster [DBG] pgmap v4104: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:20.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:05:19 gibba045 bash[25517]: cephadm 2021-03-10T16:05:18.599807+0000 mgr.gibba045.orlgmj (mgr.34412) 7214 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:05:20.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:05:19 gibba015 bash[29377]: cephadm 2021-03-10T16:05:18.599807+0000 mgr.gibba045.orlgmj (mgr.34412) 7214 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:05:20.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:05:19 gibba015 bash[30343]: cephadm 2021-03-10T16:05:18.599807+0000 mgr.gibba045.orlgmj (mgr.34412) 7214 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:05:21.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:05:20 gibba045 bash[25517]: cluster 2021-03-10T16:05:18.911688+0000 mgr.gibba045.orlgmj (mgr.34412) 7215 : cluster [DBG] pgmap v4105: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:21.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:05:20 gibba015 bash[29377]: cluster 2021-03-10T16:05:18.911688+0000 mgr.gibba045.orlgmj (mgr.34412) 7215 : cluster [DBG] pgmap v4105: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:21.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:05:20 gibba015 bash[30343]: cluster 2021-03-10T16:05:18.911688+0000 mgr.gibba045.orlgmj (mgr.34412) 7215 : cluster [DBG] pgmap v4105: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:21.520 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:05:21.747 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:05:21.748 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 9m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:05:21.749 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 8m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:05:21.749 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:05:21.750 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:05:21.750 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:05:21.751 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:05:21.752 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:05:21.752 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:05:21.753 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 9m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:05:21.753 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 8m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:05:21.754 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:05:21.754 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:05:21.755 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:05:21.755 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:05:21.756 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:05:21.757 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:05:21.757 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:05:21.758 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:05:21.758 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 8m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:05:21.759 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 8m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:05:21.998 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:05:21.999 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:05:21.999 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:05:21.999 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:05:21.999 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:05:22.000 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:05:22.000 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:05:22.000 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:05:22.000 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:05:22.001 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:05:22.001 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:05:22.001 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:05:22.001 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:05:22.002 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:05:22.002 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:05:23.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:05:22 gibba045 bash[25517]: cluster 2021-03-10T16:05:20.913298+0000 mgr.gibba045.orlgmj (mgr.34412) 7216 : cluster [DBG] pgmap v4106: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:23.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:05:22 gibba045 bash[25517]: audit 2021-03-10T16:05:21.512329+0000 mgr.gibba045.orlgmj (mgr.34412) 7217 : audit [DBG] from='client.48894 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:05:23.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:05:22 gibba045 bash[25517]: audit 2021-03-10T16:05:21.736040+0000 mgr.gibba045.orlgmj (mgr.34412) 7218 : audit [DBG] from='client.58888 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:05:23.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:05:22 gibba045 bash[25517]: audit 2021-03-10T16:05:21.997728+0000 mon.a (mon.0) 1706 : audit [DBG] from='client.? 172.21.2.115:0/2663495499' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:05:23.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:05:22 gibba015 bash[29377]: cluster 2021-03-10T16:05:20.913298+0000 mgr.gibba045.orlgmj (mgr.34412) 7216 : cluster [DBG] pgmap v4106: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:23.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:05:22 gibba015 bash[29377]: audit 2021-03-10T16:05:21.512329+0000 mgr.gibba045.orlgmj (mgr.34412) 7217 : audit [DBG] from='client.48894 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:05:23.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:05:22 gibba015 bash[29377]: audit 2021-03-10T16:05:21.736040+0000 mgr.gibba045.orlgmj (mgr.34412) 7218 : audit [DBG] from='client.58888 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:05:23.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:05:22 gibba015 bash[29377]: audit 2021-03-10T16:05:21.997728+0000 mon.a (mon.0) 1706 : audit [DBG] from='client.? 172.21.2.115:0/2663495499' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:05:23.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:05:22 gibba015 bash[30343]: cluster 2021-03-10T16:05:20.913298+0000 mgr.gibba045.orlgmj (mgr.34412) 7216 : cluster [DBG] pgmap v4106: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:23.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:05:22 gibba015 bash[30343]: audit 2021-03-10T16:05:21.512329+0000 mgr.gibba045.orlgmj (mgr.34412) 7217 : audit [DBG] from='client.48894 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:05:23.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:05:22 gibba015 bash[30343]: audit 2021-03-10T16:05:21.736040+0000 mgr.gibba045.orlgmj (mgr.34412) 7218 : audit [DBG] from='client.58888 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:05:23.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:05:22 gibba015 bash[30343]: audit 2021-03-10T16:05:21.997728+0000 mon.a (mon.0) 1706 : audit [DBG] from='client.? 172.21.2.115:0/2663495499' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:05:25.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:05:24 gibba045 bash[25517]: cluster 2021-03-10T16:05:22.914827+0000 mgr.gibba045.orlgmj (mgr.34412) 7219 : cluster [DBG] pgmap v4107: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:25.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:05:24 gibba015 bash[29377]: cluster 2021-03-10T16:05:22.914827+0000 mgr.gibba045.orlgmj (mgr.34412) 7219 : cluster [DBG] pgmap v4107: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:25.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:05:24 gibba015 bash[30343]: cluster 2021-03-10T16:05:22.914827+0000 mgr.gibba045.orlgmj (mgr.34412) 7219 : cluster [DBG] pgmap v4107: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:27.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:05:26 gibba045 bash[25517]: cluster 2021-03-10T16:05:24.916605+0000 mgr.gibba045.orlgmj (mgr.34412) 7220 : cluster [DBG] pgmap v4108: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:27.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:05:26 gibba015 bash[29377]: cluster 2021-03-10T16:05:24.916605+0000 mgr.gibba045.orlgmj (mgr.34412) 7220 : cluster [DBG] pgmap v4108: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:27.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:05:26 gibba015 bash[30343]: cluster 2021-03-10T16:05:24.916605+0000 mgr.gibba045.orlgmj (mgr.34412) 7220 : cluster [DBG] pgmap v4108: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:29.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:05:28 gibba045 bash[25517]: cluster 2021-03-10T16:05:26.918428+0000 mgr.gibba045.orlgmj (mgr.34412) 7221 : cluster [DBG] pgmap v4109: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:29.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:05:28 gibba015 bash[29377]: cluster 2021-03-10T16:05:26.918428+0000 mgr.gibba045.orlgmj (mgr.34412) 7221 : cluster [DBG] pgmap v4109: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:29.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:05:28 gibba015 bash[30343]: cluster 2021-03-10T16:05:26.918428+0000 mgr.gibba045.orlgmj (mgr.34412) 7221 : cluster [DBG] pgmap v4109: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:31.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:05:30 gibba045 bash[25517]: cluster 2021-03-10T16:05:28.919697+0000 mgr.gibba045.orlgmj (mgr.34412) 7222 : cluster [DBG] pgmap v4110: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:31.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:05:30 gibba015 bash[29377]: cluster 2021-03-10T16:05:28.919697+0000 mgr.gibba045.orlgmj (mgr.34412) 7222 : cluster [DBG] pgmap v4110: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:31.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:05:30 gibba015 bash[30343]: cluster 2021-03-10T16:05:28.919697+0000 mgr.gibba045.orlgmj (mgr.34412) 7222 : cluster [DBG] pgmap v4110: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:33.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:05:32 gibba045 bash[25517]: cluster 2021-03-10T16:05:30.921349+0000 mgr.gibba045.orlgmj (mgr.34412) 7223 : cluster [DBG] pgmap v4111: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:33.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:05:32 gibba015 bash[29377]: cluster 2021-03-10T16:05:30.921349+0000 mgr.gibba045.orlgmj (mgr.34412) 7223 : cluster [DBG] pgmap v4111: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:33.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:05:32 gibba015 bash[30343]: cluster 2021-03-10T16:05:30.921349+0000 mgr.gibba045.orlgmj (mgr.34412) 7223 : cluster [DBG] pgmap v4111: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:35.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:05:34 gibba045 bash[25517]: cluster 2021-03-10T16:05:32.923007+0000 mgr.gibba045.orlgmj (mgr.34412) 7224 : cluster [DBG] pgmap v4112: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:35.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:05:34 gibba045 bash[25517]: cephadm 2021-03-10T16:05:33.615742+0000 mgr.gibba045.orlgmj (mgr.34412) 7225 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:05:35.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:05:34 gibba015 bash[29377]: cluster 2021-03-10T16:05:32.923007+0000 mgr.gibba045.orlgmj (mgr.34412) 7224 : cluster [DBG] pgmap v4112: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:35.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:05:34 gibba015 bash[29377]: cephadm 2021-03-10T16:05:33.615742+0000 mgr.gibba045.orlgmj (mgr.34412) 7225 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:05:35.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:05:34 gibba015 bash[30343]: cluster 2021-03-10T16:05:32.923007+0000 mgr.gibba045.orlgmj (mgr.34412) 7224 : cluster [DBG] pgmap v4112: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:35.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:05:34 gibba015 bash[30343]: cephadm 2021-03-10T16:05:33.615742+0000 mgr.gibba045.orlgmj (mgr.34412) 7225 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:05:37.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:05:36 gibba045 bash[25517]: cluster 2021-03-10T16:05:34.924688+0000 mgr.gibba045.orlgmj (mgr.34412) 7226 : cluster [DBG] pgmap v4113: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:37.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:05:36 gibba015 bash[29377]: cluster 2021-03-10T16:05:34.924688+0000 mgr.gibba045.orlgmj (mgr.34412) 7226 : cluster [DBG] pgmap v4113: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:37.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:05:36 gibba015 bash[30343]: cluster 2021-03-10T16:05:34.924688+0000 mgr.gibba045.orlgmj (mgr.34412) 7226 : cluster [DBG] pgmap v4113: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:39.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:05:38 gibba015 bash[29377]: cluster 2021-03-10T16:05:36.926286+0000 mgr.gibba045.orlgmj (mgr.34412) 7227 : cluster [DBG] pgmap v4114: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:39.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:05:38 gibba015 bash[30343]: cluster 2021-03-10T16:05:36.926286+0000 mgr.gibba045.orlgmj (mgr.34412) 7227 : cluster [DBG] pgmap v4114: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:39.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:05:38 gibba045 bash[25517]: cluster 2021-03-10T16:05:36.926286+0000 mgr.gibba045.orlgmj (mgr.34412) 7227 : cluster [DBG] pgmap v4114: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:41.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:05:40 gibba015 bash[29377]: cluster 2021-03-10T16:05:38.927472+0000 mgr.gibba045.orlgmj (mgr.34412) 7228 : cluster [DBG] pgmap v4115: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:41.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:05:40 gibba015 bash[30343]: cluster 2021-03-10T16:05:38.927472+0000 mgr.gibba045.orlgmj (mgr.34412) 7228 : cluster [DBG] pgmap v4115: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:41.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:05:40 gibba045 bash[25517]: cluster 2021-03-10T16:05:38.927472+0000 mgr.gibba045.orlgmj (mgr.34412) 7228 : cluster [DBG] pgmap v4115: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:43.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:05:42 gibba015 bash[29377]: cluster 2021-03-10T16:05:40.929274+0000 mgr.gibba045.orlgmj (mgr.34412) 7229 : cluster [DBG] pgmap v4116: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:43.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:05:42 gibba015 bash[30343]: cluster 2021-03-10T16:05:40.929274+0000 mgr.gibba045.orlgmj (mgr.34412) 7229 : cluster [DBG] pgmap v4116: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:43.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:05:42 gibba045 bash[25517]: cluster 2021-03-10T16:05:40.929274+0000 mgr.gibba045.orlgmj (mgr.34412) 7229 : cluster [DBG] pgmap v4116: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:45.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:05:44 gibba015 bash[29377]: cluster 2021-03-10T16:05:42.930670+0000 mgr.gibba045.orlgmj (mgr.34412) 7230 : cluster [DBG] pgmap v4117: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:45.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:05:44 gibba015 bash[30343]: cluster 2021-03-10T16:05:42.930670+0000 mgr.gibba045.orlgmj (mgr.34412) 7230 : cluster [DBG] pgmap v4117: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:45.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:05:44 gibba045 bash[25517]: cluster 2021-03-10T16:05:42.930670+0000 mgr.gibba045.orlgmj (mgr.34412) 7230 : cluster [DBG] pgmap v4117: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:47.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:05:46 gibba015 bash[29377]: cluster 2021-03-10T16:05:44.932089+0000 mgr.gibba045.orlgmj (mgr.34412) 7231 : cluster [DBG] pgmap v4118: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:47.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:05:46 gibba015 bash[30343]: cluster 2021-03-10T16:05:44.932089+0000 mgr.gibba045.orlgmj (mgr.34412) 7231 : cluster [DBG] pgmap v4118: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:47.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:05:46 gibba045 bash[25517]: cluster 2021-03-10T16:05:44.932089+0000 mgr.gibba045.orlgmj (mgr.34412) 7231 : cluster [DBG] pgmap v4118: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:49.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:05:48 gibba015 bash[29377]: cluster 2021-03-10T16:05:46.933624+0000 mgr.gibba045.orlgmj (mgr.34412) 7232 : cluster [DBG] pgmap v4119: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:49.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:05:48 gibba015 bash[29377]: audit 2021-03-10T16:05:48.630211+0000 mon.c (mon.1) 2004 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:05:49.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:05:48 gibba015 bash[29377]: audit 2021-03-10T16:05:48.637778+0000 mon.c (mon.1) 2005 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:05:49.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:05:48 gibba015 bash[30343]: cluster 2021-03-10T16:05:46.933624+0000 mgr.gibba045.orlgmj (mgr.34412) 7232 : cluster [DBG] pgmap v4119: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:49.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:05:48 gibba015 bash[30343]: audit 2021-03-10T16:05:48.630211+0000 mon.c (mon.1) 2004 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:05:49.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:05:48 gibba015 bash[30343]: audit 2021-03-10T16:05:48.637778+0000 mon.c (mon.1) 2005 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:05:49.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:05:48 gibba045 bash[25517]: cluster 2021-03-10T16:05:46.933624+0000 mgr.gibba045.orlgmj (mgr.34412) 7232 : cluster [DBG] pgmap v4119: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:49.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:05:48 gibba045 bash[25517]: audit 2021-03-10T16:05:48.630211+0000 mon.c (mon.1) 2004 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:05:49.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:05:48 gibba045 bash[25517]: audit 2021-03-10T16:05:48.637778+0000 mon.c (mon.1) 2005 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:05:50.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:05:49 gibba015 bash[29377]: cephadm 2021-03-10T16:05:48.639755+0000 mgr.gibba045.orlgmj (mgr.34412) 7233 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:05:50.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:05:49 gibba015 bash[30343]: cephadm 2021-03-10T16:05:48.639755+0000 mgr.gibba045.orlgmj (mgr.34412) 7233 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:05:50.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:05:49 gibba045 bash[25517]: cephadm 2021-03-10T16:05:48.639755+0000 mgr.gibba045.orlgmj (mgr.34412) 7233 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:05:51.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:05:50 gibba015 bash[29377]: cluster 2021-03-10T16:05:48.934773+0000 mgr.gibba045.orlgmj (mgr.34412) 7234 : cluster [DBG] pgmap v4120: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:51.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:05:50 gibba015 bash[30343]: cluster 2021-03-10T16:05:48.934773+0000 mgr.gibba045.orlgmj (mgr.34412) 7234 : cluster [DBG] pgmap v4120: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:51.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:05:50 gibba045 bash[25517]: cluster 2021-03-10T16:05:48.934773+0000 mgr.gibba045.orlgmj (mgr.34412) 7234 : cluster [DBG] pgmap v4120: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:52.258 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:05:52.492 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:05:52.492 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 0s ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:05:52.492 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 9m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:05:52.492 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:05:52.493 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:05:52.493 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 0s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:05:52.493 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 0s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:05:52.493 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:05:52.494 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 0s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:05:52.494 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 0s ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:05:52.494 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 9m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:05:52.494 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 0s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:05:52.495 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 0s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:05:52.495 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 0s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:05:52.495 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 0s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:05:52.495 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:05:52.496 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:05:52.496 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:05:52.496 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:05:52.496 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 9m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:05:52.497 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 9m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:05:52.743 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:05:52.743 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:05:52.744 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:05:52.744 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:05:52.744 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:05:52.744 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:05:52.745 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:05:52.745 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:05:52.745 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:05:52.745 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:05:52.746 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:05:52.746 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:05:52.746 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:05:52.746 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:05:52.747 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:05:53.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:05:52 gibba015 bash[29377]: cluster 2021-03-10T16:05:50.935961+0000 mgr.gibba045.orlgmj (mgr.34412) 7235 : cluster [DBG] pgmap v4121: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:53.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:05:52 gibba015 bash[29377]: audit 2021-03-10T16:05:52.115380+0000 mon.a (mon.0) 1707 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:05:53.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:05:52 gibba015 bash[29377]: audit 2021-03-10T16:05:52.314059+0000 mon.a (mon.0) 1708 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:05:53.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:05:52 gibba015 bash[29377]: audit 2021-03-10T16:05:52.324258+0000 mon.c (mon.1) 2006 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:05:53.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:05:52 gibba015 bash[29377]: audit 2021-03-10T16:05:52.328158+0000 mon.c (mon.1) 2007 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:05:53.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:05:52 gibba015 bash[29377]: audit 2021-03-10T16:05:52.331933+0000 mon.c (mon.1) 2008 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:05:53.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:05:52 gibba015 bash[29377]: audit 2021-03-10T16:05:52.335139+0000 mon.c (mon.1) 2009 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:05:53.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:05:52 gibba015 bash[29377]: audit 2021-03-10T16:05:52.341810+0000 mon.c (mon.1) 2010 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:05:53.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:05:52 gibba015 bash[29377]: audit 2021-03-10T16:05:52.346275+0000 mon.c (mon.1) 2011 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:05:53.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:05:52 gibba015 bash[29377]: audit 2021-03-10T16:05:52.742508+0000 mon.a (mon.0) 1709 : audit [DBG] from='client.? 172.21.2.115:0/155365507' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:05:53.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:05:52 gibba015 bash[30343]: cluster 2021-03-10T16:05:50.935961+0000 mgr.gibba045.orlgmj (mgr.34412) 7235 : cluster [DBG] pgmap v4121: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:53.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:05:52 gibba015 bash[30343]: audit 2021-03-10T16:05:52.115380+0000 mon.a (mon.0) 1707 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:05:53.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:05:52 gibba015 bash[30343]: audit 2021-03-10T16:05:52.314059+0000 mon.a (mon.0) 1708 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:05:53.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:05:52 gibba015 bash[30343]: audit 2021-03-10T16:05:52.324258+0000 mon.c (mon.1) 2006 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:05:53.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:05:52 gibba015 bash[30343]: audit 2021-03-10T16:05:52.328158+0000 mon.c (mon.1) 2007 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:05:53.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:05:52 gibba015 bash[30343]: audit 2021-03-10T16:05:52.331933+0000 mon.c (mon.1) 2008 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:05:53.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:05:52 gibba015 bash[30343]: audit 2021-03-10T16:05:52.335139+0000 mon.c (mon.1) 2009 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:05:53.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:05:52 gibba015 bash[30343]: audit 2021-03-10T16:05:52.341810+0000 mon.c (mon.1) 2010 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:05:53.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:05:52 gibba015 bash[30343]: audit 2021-03-10T16:05:52.346275+0000 mon.c (mon.1) 2011 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:05:53.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:05:52 gibba015 bash[30343]: audit 2021-03-10T16:05:52.742508+0000 mon.a (mon.0) 1709 : audit [DBG] from='client.? 172.21.2.115:0/155365507' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:05:53.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:05:52 gibba045 bash[25517]: cluster 2021-03-10T16:05:50.935961+0000 mgr.gibba045.orlgmj (mgr.34412) 7235 : cluster [DBG] pgmap v4121: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:53.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:05:52 gibba045 bash[25517]: audit 2021-03-10T16:05:52.115380+0000 mon.a (mon.0) 1707 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:05:53.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:05:52 gibba045 bash[25517]: audit 2021-03-10T16:05:52.314059+0000 mon.a (mon.0) 1708 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:05:53.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:05:52 gibba045 bash[25517]: audit 2021-03-10T16:05:52.324258+0000 mon.c (mon.1) 2006 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:05:53.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:05:52 gibba045 bash[25517]: audit 2021-03-10T16:05:52.328158+0000 mon.c (mon.1) 2007 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:05:53.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:05:52 gibba045 bash[25517]: audit 2021-03-10T16:05:52.331933+0000 mon.c (mon.1) 2008 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:05:53.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:05:52 gibba045 bash[25517]: audit 2021-03-10T16:05:52.335139+0000 mon.c (mon.1) 2009 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:05:53.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:05:52 gibba045 bash[25517]: audit 2021-03-10T16:05:52.341810+0000 mon.c (mon.1) 2010 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:05:53.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:05:52 gibba045 bash[25517]: audit 2021-03-10T16:05:52.346275+0000 mon.c (mon.1) 2011 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:05:53.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:05:52 gibba045 bash[25517]: audit 2021-03-10T16:05:52.742508+0000 mon.a (mon.0) 1709 : audit [DBG] from='client.? 172.21.2.115:0/155365507' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:05:54.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:05:53 gibba015 bash[29377]: cephadm 2021-03-10T16:05:52.118694+0000 mgr.gibba045.orlgmj (mgr.34412) 7236 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:05:54.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:05:53 gibba015 bash[29377]: audit 2021-03-10T16:05:52.251279+0000 mgr.gibba045.orlgmj (mgr.34412) 7237 : audit [DBG] from='client.58900 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:05:54.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:05:53 gibba015 bash[29377]: cephadm 2021-03-10T16:05:52.323341+0000 mgr.gibba045.orlgmj (mgr.34412) 7238 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:05:54.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:05:53 gibba015 bash[29377]: cephadm 2021-03-10T16:05:52.329288+0000 mgr.gibba045.orlgmj (mgr.34412) 7239 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:05:54.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:05:53 gibba015 bash[29377]: cephadm 2021-03-10T16:05:52.332876+0000 mgr.gibba045.orlgmj (mgr.34412) 7240 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:05:54.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:05:53 gibba015 bash[29377]: cephadm 2021-03-10T16:05:52.333188+0000 mgr.gibba045.orlgmj (mgr.34412) 7241 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:05:54.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:05:53 gibba015 bash[29377]: cephadm 2021-03-10T16:05:52.336511+0000 mgr.gibba045.orlgmj (mgr.34412) 7242 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:05:54.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:05:53 gibba015 bash[29377]: cephadm 2021-03-10T16:05:52.337050+0000 mgr.gibba045.orlgmj (mgr.34412) 7243 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:05:54.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:05:53 gibba015 bash[29377]: cephadm 2021-03-10T16:05:52.339494+0000 mgr.gibba045.orlgmj (mgr.34412) 7244 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:05:54.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:05:53 gibba015 bash[29377]: cephadm 2021-03-10T16:05:52.342326+0000 mgr.gibba045.orlgmj (mgr.34412) 7245 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:05:54.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:05:53 gibba015 bash[29377]: cephadm 2021-03-10T16:05:52.342814+0000 mgr.gibba045.orlgmj (mgr.34412) 7246 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:05:54.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:05:53 gibba015 bash[29377]: cephadm 2021-03-10T16:05:52.346127+0000 mgr.gibba045.orlgmj (mgr.34412) 7247 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:05:54.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:05:53 gibba015 bash[29377]: cephadm 2021-03-10T16:05:52.348050+0000 mgr.gibba045.orlgmj (mgr.34412) 7248 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:05:54.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:05:53 gibba015 bash[29377]: cephadm 2021-03-10T16:05:52.350612+0000 mgr.gibba045.orlgmj (mgr.34412) 7249 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:05:54.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:05:53 gibba015 bash[29377]: cephadm 2021-03-10T16:05:52.350993+0000 mgr.gibba045.orlgmj (mgr.34412) 7250 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:05:54.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:05:53 gibba015 bash[29377]: cephadm 2021-03-10T16:05:52.351779+0000 mgr.gibba045.orlgmj (mgr.34412) 7251 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:05:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:05:53 gibba015 bash[29377]: audit 2021-03-10T16:05:52.481313+0000 mgr.gibba045.orlgmj (mgr.34412) 7252 : audit [DBG] from='client.58906 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:05:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:05:53 gibba015 bash[29377]: audit 2021-03-10T16:05:53.418483+0000 mon.c (mon.1) 2012 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:05:54.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:05:53 gibba015 bash[29377]: audit 2021-03-10T16:05:53.419159+0000 mon.c (mon.1) 2013 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:05:54.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:05:53 gibba015 bash[30343]: cephadm 2021-03-10T16:05:52.118694+0000 mgr.gibba045.orlgmj (mgr.34412) 7236 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:05:54.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:05:53 gibba015 bash[30343]: audit 2021-03-10T16:05:52.251279+0000 mgr.gibba045.orlgmj (mgr.34412) 7237 : audit [DBG] from='client.58900 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:05:54.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:05:53 gibba015 bash[30343]: cephadm 2021-03-10T16:05:52.323341+0000 mgr.gibba045.orlgmj (mgr.34412) 7238 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:05:54.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:05:53 gibba015 bash[30343]: cephadm 2021-03-10T16:05:52.329288+0000 mgr.gibba045.orlgmj (mgr.34412) 7239 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:05:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:05:53 gibba015 bash[30343]: cephadm 2021-03-10T16:05:52.332876+0000 mgr.gibba045.orlgmj (mgr.34412) 7240 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:05:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:05:53 gibba015 bash[30343]: cephadm 2021-03-10T16:05:52.333188+0000 mgr.gibba045.orlgmj (mgr.34412) 7241 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:05:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:05:53 gibba015 bash[30343]: cephadm 2021-03-10T16:05:52.336511+0000 mgr.gibba045.orlgmj (mgr.34412) 7242 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:05:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:05:53 gibba015 bash[30343]: cephadm 2021-03-10T16:05:52.337050+0000 mgr.gibba045.orlgmj (mgr.34412) 7243 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:05:54.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:05:53 gibba015 bash[30343]: cephadm 2021-03-10T16:05:52.339494+0000 mgr.gibba045.orlgmj (mgr.34412) 7244 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:05:54.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:05:53 gibba015 bash[30343]: cephadm 2021-03-10T16:05:52.342326+0000 mgr.gibba045.orlgmj (mgr.34412) 7245 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:05:54.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:05:53 gibba015 bash[30343]: cephadm 2021-03-10T16:05:52.342814+0000 mgr.gibba045.orlgmj (mgr.34412) 7246 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:05:54.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:05:53 gibba015 bash[30343]: cephadm 2021-03-10T16:05:52.346127+0000 mgr.gibba045.orlgmj (mgr.34412) 7247 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:05:54.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:05:53 gibba015 bash[30343]: cephadm 2021-03-10T16:05:52.348050+0000 mgr.gibba045.orlgmj (mgr.34412) 7248 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:05:54.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:05:53 gibba015 bash[30343]: cephadm 2021-03-10T16:05:52.350612+0000 mgr.gibba045.orlgmj (mgr.34412) 7249 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:05:54.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:05:53 gibba015 bash[30343]: cephadm 2021-03-10T16:05:52.350993+0000 mgr.gibba045.orlgmj (mgr.34412) 7250 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:05:54.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:05:53 gibba015 bash[30343]: cephadm 2021-03-10T16:05:52.351779+0000 mgr.gibba045.orlgmj (mgr.34412) 7251 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:05:54.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:05:53 gibba015 bash[30343]: audit 2021-03-10T16:05:52.481313+0000 mgr.gibba045.orlgmj (mgr.34412) 7252 : audit [DBG] from='client.58906 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:05:54.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:05:53 gibba015 bash[30343]: audit 2021-03-10T16:05:53.418483+0000 mon.c (mon.1) 2012 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:05:54.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:05:53 gibba015 bash[30343]: audit 2021-03-10T16:05:53.419159+0000 mon.c (mon.1) 2013 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:05:54.231 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:05:53 gibba015 bash[29377]: audit 2021-03-10T16:05:53.419593+0000 mon.a (mon.0) 1710 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:05:54.232 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:05:53 gibba015 bash[29377]: audit 2021-03-10T16:05:53.420732+0000 mon.a (mon.0) 1711 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:05:54.232 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:05:53 gibba015 bash[29377]: audit 2021-03-10T16:05:53.421148+0000 mon.c (mon.1) 2014 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T16:05:54.232 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:05:53 gibba015 bash[29377]: audit 2021-03-10T16:05:53.422072+0000 mon.c (mon.1) 2015 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T16:05:54.232 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:05:53 gibba015 bash[29377]: audit 2021-03-10T16:05:53.422283+0000 mon.a (mon.0) 1712 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T16:05:54.233 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:05:53 gibba015 bash[29377]: audit 2021-03-10T16:05:53.422801+0000 mon.c (mon.1) 2016 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:05:54.233 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:05:53 gibba015 bash[29377]: audit 2021-03-10T16:05:53.423509+0000 mon.a (mon.0) 1713 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T16:05:54.233 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:05:53 gibba015 bash[29377]: audit 2021-03-10T16:05:53.423849+0000 mon.c (mon.1) 2017 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:05:54.233 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:05:53 gibba015 bash[29377]: audit 2021-03-10T16:05:53.424577+0000 mon.a (mon.0) 1714 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:05:54.233 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:05:53 gibba015 bash[29377]: audit 2021-03-10T16:05:53.425582+0000 mon.a (mon.0) 1715 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:05:54.234 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:05:53 gibba015 bash[30343]: audit 2021-03-10T16:05:53.419593+0000 mon.a (mon.0) 1710 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:05:54.234 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:05:53 gibba015 bash[30343]: audit 2021-03-10T16:05:53.420732+0000 mon.a (mon.0) 1711 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:05:54.234 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:05:53 gibba015 bash[30343]: audit 2021-03-10T16:05:53.421148+0000 mon.c (mon.1) 2014 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T16:05:54.235 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:05:53 gibba015 bash[30343]: audit 2021-03-10T16:05:53.422072+0000 mon.c (mon.1) 2015 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T16:05:54.235 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:05:53 gibba015 bash[30343]: audit 2021-03-10T16:05:53.422283+0000 mon.a (mon.0) 1712 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T16:05:54.235 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:05:53 gibba015 bash[30343]: audit 2021-03-10T16:05:53.422801+0000 mon.c (mon.1) 2016 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:05:54.235 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:05:53 gibba015 bash[30343]: audit 2021-03-10T16:05:53.423509+0000 mon.a (mon.0) 1713 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T16:05:54.235 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:05:53 gibba015 bash[30343]: audit 2021-03-10T16:05:53.423849+0000 mon.c (mon.1) 2017 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:05:54.236 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:05:53 gibba015 bash[30343]: audit 2021-03-10T16:05:53.424577+0000 mon.a (mon.0) 1714 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:05:54.236 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:05:53 gibba015 bash[30343]: audit 2021-03-10T16:05:53.425582+0000 mon.a (mon.0) 1715 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:05:54.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:05:53 gibba045 bash[25517]: cephadm 2021-03-10T16:05:52.118694+0000 mgr.gibba045.orlgmj (mgr.34412) 7236 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:05:54.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:05:53 gibba045 bash[25517]: audit 2021-03-10T16:05:52.251279+0000 mgr.gibba045.orlgmj (mgr.34412) 7237 : audit [DBG] from='client.58900 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:05:54.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:05:53 gibba045 bash[25517]: cephadm 2021-03-10T16:05:52.323341+0000 mgr.gibba045.orlgmj (mgr.34412) 7238 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:05:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:05:53 gibba045 bash[25517]: cephadm 2021-03-10T16:05:52.329288+0000 mgr.gibba045.orlgmj (mgr.34412) 7239 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:05:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:05:53 gibba045 bash[25517]: cephadm 2021-03-10T16:05:52.332876+0000 mgr.gibba045.orlgmj (mgr.34412) 7240 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:05:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:05:53 gibba045 bash[25517]: cephadm 2021-03-10T16:05:52.333188+0000 mgr.gibba045.orlgmj (mgr.34412) 7241 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:05:54.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:05:53 gibba045 bash[25517]: cephadm 2021-03-10T16:05:52.336511+0000 mgr.gibba045.orlgmj (mgr.34412) 7242 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:05:54.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:05:53 gibba045 bash[25517]: cephadm 2021-03-10T16:05:52.337050+0000 mgr.gibba045.orlgmj (mgr.34412) 7243 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:05:54.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:05:53 gibba045 bash[25517]: cephadm 2021-03-10T16:05:52.339494+0000 mgr.gibba045.orlgmj (mgr.34412) 7244 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:05:54.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:05:53 gibba045 bash[25517]: cephadm 2021-03-10T16:05:52.342326+0000 mgr.gibba045.orlgmj (mgr.34412) 7245 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:05:54.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:05:53 gibba045 bash[25517]: cephadm 2021-03-10T16:05:52.342814+0000 mgr.gibba045.orlgmj (mgr.34412) 7246 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:05:54.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:05:53 gibba045 bash[25517]: cephadm 2021-03-10T16:05:52.346127+0000 mgr.gibba045.orlgmj (mgr.34412) 7247 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:05:54.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:05:53 gibba045 bash[25517]: cephadm 2021-03-10T16:05:52.348050+0000 mgr.gibba045.orlgmj (mgr.34412) 7248 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:05:54.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:05:53 gibba045 bash[25517]: cephadm 2021-03-10T16:05:52.350612+0000 mgr.gibba045.orlgmj (mgr.34412) 7249 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:05:54.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:05:53 gibba045 bash[25517]: cephadm 2021-03-10T16:05:52.350993+0000 mgr.gibba045.orlgmj (mgr.34412) 7250 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:05:54.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:05:53 gibba045 bash[25517]: cephadm 2021-03-10T16:05:52.351779+0000 mgr.gibba045.orlgmj (mgr.34412) 7251 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:05:54.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:05:53 gibba045 bash[25517]: audit 2021-03-10T16:05:52.481313+0000 mgr.gibba045.orlgmj (mgr.34412) 7252 : audit [DBG] from='client.58906 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:05:54.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:05:53 gibba045 bash[25517]: audit 2021-03-10T16:05:53.418483+0000 mon.c (mon.1) 2012 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:05:54.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:05:53 gibba045 bash[25517]: audit 2021-03-10T16:05:53.419159+0000 mon.c (mon.1) 2013 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:05:54.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:05:53 gibba045 bash[25517]: audit 2021-03-10T16:05:53.419593+0000 mon.a (mon.0) 1710 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:05:54.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:05:53 gibba045 bash[25517]: audit 2021-03-10T16:05:53.420732+0000 mon.a (mon.0) 1711 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:05:54.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:05:53 gibba045 bash[25517]: audit 2021-03-10T16:05:53.421148+0000 mon.c (mon.1) 2014 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T16:05:54.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:05:53 gibba045 bash[25517]: audit 2021-03-10T16:05:53.422072+0000 mon.c (mon.1) 2015 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T16:05:54.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:05:53 gibba045 bash[25517]: audit 2021-03-10T16:05:53.422283+0000 mon.a (mon.0) 1712 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T16:05:54.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:05:53 gibba045 bash[25517]: audit 2021-03-10T16:05:53.422801+0000 mon.c (mon.1) 2016 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:05:54.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:05:53 gibba045 bash[25517]: audit 2021-03-10T16:05:53.423509+0000 mon.a (mon.0) 1713 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T16:05:54.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:05:53 gibba045 bash[25517]: audit 2021-03-10T16:05:53.423849+0000 mon.c (mon.1) 2017 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:05:54.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:05:53 gibba045 bash[25517]: audit 2021-03-10T16:05:53.424577+0000 mon.a (mon.0) 1714 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:05:54.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:05:53 gibba045 bash[25517]: audit 2021-03-10T16:05:53.425582+0000 mon.a (mon.0) 1715 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:05:55.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:05:54 gibba015 bash[29377]: cluster 2021-03-10T16:05:52.937462+0000 mgr.gibba045.orlgmj (mgr.34412) 7253 : cluster [DBG] pgmap v4122: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:55.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:05:54 gibba015 bash[30343]: cluster 2021-03-10T16:05:52.937462+0000 mgr.gibba045.orlgmj (mgr.34412) 7253 : cluster [DBG] pgmap v4122: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:55.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:05:54 gibba045 bash[25517]: cluster 2021-03-10T16:05:52.937462+0000 mgr.gibba045.orlgmj (mgr.34412) 7253 : cluster [DBG] pgmap v4122: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:57.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:05:56 gibba015 bash[29377]: cluster 2021-03-10T16:05:54.938309+0000 mgr.gibba045.orlgmj (mgr.34412) 7254 : cluster [DBG] pgmap v4123: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:57.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:05:56 gibba015 bash[30343]: cluster 2021-03-10T16:05:54.938309+0000 mgr.gibba045.orlgmj (mgr.34412) 7254 : cluster [DBG] pgmap v4123: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:57.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:05:56 gibba045 bash[25517]: cluster 2021-03-10T16:05:54.938309+0000 mgr.gibba045.orlgmj (mgr.34412) 7254 : cluster [DBG] pgmap v4123: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:59.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:05:58 gibba015 bash[29377]: cluster 2021-03-10T16:05:56.939101+0000 mgr.gibba045.orlgmj (mgr.34412) 7255 : cluster [DBG] pgmap v4124: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:59.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:05:58 gibba015 bash[30343]: cluster 2021-03-10T16:05:56.939101+0000 mgr.gibba045.orlgmj (mgr.34412) 7255 : cluster [DBG] pgmap v4124: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:59.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:05:58 gibba045 bash[25517]: cluster 2021-03-10T16:05:56.939101+0000 mgr.gibba045.orlgmj (mgr.34412) 7255 : cluster [DBG] pgmap v4124: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:01.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:06:00 gibba015 bash[29377]: cluster 2021-03-10T16:05:58.939455+0000 mgr.gibba045.orlgmj (mgr.34412) 7256 : cluster [DBG] pgmap v4125: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:01.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:06:00 gibba015 bash[30343]: cluster 2021-03-10T16:05:58.939455+0000 mgr.gibba045.orlgmj (mgr.34412) 7256 : cluster [DBG] pgmap v4125: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:01.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:06:00 gibba045 bash[25517]: cluster 2021-03-10T16:05:58.939455+0000 mgr.gibba045.orlgmj (mgr.34412) 7256 : cluster [DBG] pgmap v4125: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:02.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:06:01 gibba045 bash[25517]: cluster 2021-03-10T16:06:00.940110+0000 mgr.gibba045.orlgmj (mgr.34412) 7257 : cluster [DBG] pgmap v4126: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:02.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:06:01 gibba015 bash[29377]: cluster 2021-03-10T16:06:00.940110+0000 mgr.gibba045.orlgmj (mgr.34412) 7257 : cluster [DBG] pgmap v4126: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:02.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:06:01 gibba015 bash[30343]: cluster 2021-03-10T16:06:00.940110+0000 mgr.gibba045.orlgmj (mgr.34412) 7257 : cluster [DBG] pgmap v4126: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:04.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:06:03 gibba045 bash[25517]: cluster 2021-03-10T16:06:02.941622+0000 mgr.gibba045.orlgmj (mgr.34412) 7258 : cluster [DBG] pgmap v4127: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:04.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:06:03 gibba015 bash[29377]: cluster 2021-03-10T16:06:02.941622+0000 mgr.gibba045.orlgmj (mgr.34412) 7258 : cluster [DBG] pgmap v4127: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:04.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:06:03 gibba015 bash[30343]: cluster 2021-03-10T16:06:02.941622+0000 mgr.gibba045.orlgmj (mgr.34412) 7258 : cluster [DBG] pgmap v4127: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:06.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:06:06 gibba015 bash[29377]: cluster 2021-03-10T16:06:04.943042+0000 mgr.gibba045.orlgmj (mgr.34412) 7259 : cluster [DBG] pgmap v4128: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:06.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:06:06 gibba015 bash[30343]: cluster 2021-03-10T16:06:04.943042+0000 mgr.gibba045.orlgmj (mgr.34412) 7259 : cluster [DBG] pgmap v4128: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:06.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:06:06 gibba045 bash[25517]: cluster 2021-03-10T16:06:04.943042+0000 mgr.gibba045.orlgmj (mgr.34412) 7259 : cluster [DBG] pgmap v4128: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:08.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:06:08 gibba015 bash[29377]: cluster 2021-03-10T16:06:06.944844+0000 mgr.gibba045.orlgmj (mgr.34412) 7260 : cluster [DBG] pgmap v4129: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:08.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:06:08 gibba015 bash[29377]: cephadm 2021-03-10T16:06:07.367861+0000 mgr.gibba045.orlgmj (mgr.34412) 7261 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:06:08.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:06:08 gibba015 bash[30343]: cluster 2021-03-10T16:06:06.944844+0000 mgr.gibba045.orlgmj (mgr.34412) 7260 : cluster [DBG] pgmap v4129: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:08.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:06:08 gibba015 bash[30343]: cephadm 2021-03-10T16:06:07.367861+0000 mgr.gibba045.orlgmj (mgr.34412) 7261 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:06:08.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:06:08 gibba045 bash[25517]: cluster 2021-03-10T16:06:06.944844+0000 mgr.gibba045.orlgmj (mgr.34412) 7260 : cluster [DBG] pgmap v4129: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:08.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:06:08 gibba045 bash[25517]: cephadm 2021-03-10T16:06:07.367861+0000 mgr.gibba045.orlgmj (mgr.34412) 7261 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:06:10.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:06:10 gibba015 bash[29377]: cluster 2021-03-10T16:06:08.946214+0000 mgr.gibba045.orlgmj (mgr.34412) 7262 : cluster [DBG] pgmap v4130: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:10.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:06:10 gibba015 bash[30343]: cluster 2021-03-10T16:06:08.946214+0000 mgr.gibba045.orlgmj (mgr.34412) 7262 : cluster [DBG] pgmap v4130: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:10.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:06:10 gibba045 bash[25517]: cluster 2021-03-10T16:06:08.946214+0000 mgr.gibba045.orlgmj (mgr.34412) 7262 : cluster [DBG] pgmap v4130: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:12.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:06:12 gibba015 bash[29377]: cluster 2021-03-10T16:06:10.947897+0000 mgr.gibba045.orlgmj (mgr.34412) 7263 : cluster [DBG] pgmap v4131: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:12.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:06:12 gibba015 bash[30343]: cluster 2021-03-10T16:06:10.947897+0000 mgr.gibba045.orlgmj (mgr.34412) 7263 : cluster [DBG] pgmap v4131: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:12.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:06:12 gibba045 bash[25517]: cluster 2021-03-10T16:06:10.947897+0000 mgr.gibba045.orlgmj (mgr.34412) 7263 : cluster [DBG] pgmap v4131: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:14.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:06:14 gibba015 bash[29377]: cluster 2021-03-10T16:06:12.949390+0000 mgr.gibba045.orlgmj (mgr.34412) 7264 : cluster [DBG] pgmap v4132: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:14.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:06:14 gibba015 bash[30343]: cluster 2021-03-10T16:06:12.949390+0000 mgr.gibba045.orlgmj (mgr.34412) 7264 : cluster [DBG] pgmap v4132: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:14.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:06:14 gibba045 bash[25517]: cluster 2021-03-10T16:06:12.949390+0000 mgr.gibba045.orlgmj (mgr.34412) 7264 : cluster [DBG] pgmap v4132: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:16.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:06:16 gibba015 bash[29377]: cluster 2021-03-10T16:06:14.951096+0000 mgr.gibba045.orlgmj (mgr.34412) 7265 : cluster [DBG] pgmap v4133: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:16.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:06:16 gibba015 bash[30343]: cluster 2021-03-10T16:06:14.951096+0000 mgr.gibba045.orlgmj (mgr.34412) 7265 : cluster [DBG] pgmap v4133: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:16.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:06:16 gibba045 bash[25517]: cluster 2021-03-10T16:06:14.951096+0000 mgr.gibba045.orlgmj (mgr.34412) 7265 : cluster [DBG] pgmap v4133: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:18.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:06:18 gibba015 bash[29377]: cluster 2021-03-10T16:06:16.952918+0000 mgr.gibba045.orlgmj (mgr.34412) 7266 : cluster [DBG] pgmap v4134: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:18.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:06:18 gibba015 bash[30343]: cluster 2021-03-10T16:06:16.952918+0000 mgr.gibba045.orlgmj (mgr.34412) 7266 : cluster [DBG] pgmap v4134: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:18.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:06:18 gibba045 bash[25517]: cluster 2021-03-10T16:06:16.952918+0000 mgr.gibba045.orlgmj (mgr.34412) 7266 : cluster [DBG] pgmap v4134: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:20.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:06:20 gibba015 bash[29377]: cluster 2021-03-10T16:06:18.954135+0000 mgr.gibba045.orlgmj (mgr.34412) 7267 : cluster [DBG] pgmap v4135: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:20.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:06:20 gibba015 bash[30343]: cluster 2021-03-10T16:06:18.954135+0000 mgr.gibba045.orlgmj (mgr.34412) 7267 : cluster [DBG] pgmap v4135: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:20.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:06:20 gibba045 bash[25517]: cluster 2021-03-10T16:06:18.954135+0000 mgr.gibba045.orlgmj (mgr.34412) 7267 : cluster [DBG] pgmap v4135: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:22.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:06:22 gibba015 bash[29377]: cluster 2021-03-10T16:06:20.955646+0000 mgr.gibba045.orlgmj (mgr.34412) 7268 : cluster [DBG] pgmap v4136: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:22.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:06:22 gibba015 bash[30343]: cluster 2021-03-10T16:06:20.955646+0000 mgr.gibba045.orlgmj (mgr.34412) 7268 : cluster [DBG] pgmap v4136: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:22.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:06:22 gibba045 bash[25517]: cluster 2021-03-10T16:06:20.955646+0000 mgr.gibba045.orlgmj (mgr.34412) 7268 : cluster [DBG] pgmap v4136: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:22.987 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:06:23.222 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:06:23.223 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 31s ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:06:23.223 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 9m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:06:23.224 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:06:23.224 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:06:23.224 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 31s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:06:23.225 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 31s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:06:23.225 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:06:23.226 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 31s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:06:23.226 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 31s ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:06:23.227 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 9m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:06:23.227 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 31s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:06:23.228 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 31s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:06:23.228 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 31s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:06:23.228 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 31s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:06:23.229 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:06:23.229 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:06:23.230 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:06:23.230 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:06:23.231 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 9m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:06:23.231 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 9m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:06:23.476 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:06:23.477 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:06:23.477 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:06:23.477 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:06:23.478 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:06:23.478 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:06:23.478 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:06:23.478 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:06:23.478 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:06:23.479 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:06:23.479 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:06:23.479 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:06:23.479 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:06:23.480 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:06:23.480 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:06:23.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:06:23 gibba015 bash[29377]: cephadm 2021-03-10T16:06:22.383984+0000 mgr.gibba045.orlgmj (mgr.34412) 7269 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:06:23.822 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:06:23 gibba015 bash[30343]: cephadm 2021-03-10T16:06:22.383984+0000 mgr.gibba045.orlgmj (mgr.34412) 7269 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:06:23.823 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:06:23 gibba045 bash[25517]: cephadm 2021-03-10T16:06:22.383984+0000 mgr.gibba045.orlgmj (mgr.34412) 7269 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:06:24.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:06:24 gibba045 bash[25517]: cluster 2021-03-10T16:06:22.957077+0000 mgr.gibba045.orlgmj (mgr.34412) 7270 : cluster [DBG] pgmap v4137: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:24.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:06:24 gibba045 bash[25517]: audit 2021-03-10T16:06:22.980504+0000 mgr.gibba045.orlgmj (mgr.34412) 7271 : audit [DBG] from='client.58918 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:06:24.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:06:24 gibba045 bash[25517]: audit 2021-03-10T16:06:23.211644+0000 mgr.gibba045.orlgmj (mgr.34412) 7272 : audit [DBG] from='client.58924 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:06:24.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:06:24 gibba045 bash[25517]: audit 2021-03-10T16:06:23.476134+0000 mon.a (mon.0) 1716 : audit [DBG] from='client.? 172.21.2.115:0/3992776439' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:06:24.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:06:24 gibba015 bash[29377]: cluster 2021-03-10T16:06:22.957077+0000 mgr.gibba045.orlgmj (mgr.34412) 7270 : cluster [DBG] pgmap v4137: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:24.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:06:24 gibba015 bash[29377]: audit 2021-03-10T16:06:22.980504+0000 mgr.gibba045.orlgmj (mgr.34412) 7271 : audit [DBG] from='client.58918 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:06:24.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:06:24 gibba015 bash[29377]: audit 2021-03-10T16:06:23.211644+0000 mgr.gibba045.orlgmj (mgr.34412) 7272 : audit [DBG] from='client.58924 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:06:24.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:06:24 gibba015 bash[29377]: audit 2021-03-10T16:06:23.476134+0000 mon.a (mon.0) 1716 : audit [DBG] from='client.? 172.21.2.115:0/3992776439' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:06:24.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:06:24 gibba015 bash[30343]: cluster 2021-03-10T16:06:22.957077+0000 mgr.gibba045.orlgmj (mgr.34412) 7270 : cluster [DBG] pgmap v4137: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:24.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:06:24 gibba015 bash[30343]: audit 2021-03-10T16:06:22.980504+0000 mgr.gibba045.orlgmj (mgr.34412) 7271 : audit [DBG] from='client.58918 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:06:24.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:06:24 gibba015 bash[30343]: audit 2021-03-10T16:06:23.211644+0000 mgr.gibba045.orlgmj (mgr.34412) 7272 : audit [DBG] from='client.58924 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:06:24.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:06:24 gibba015 bash[30343]: audit 2021-03-10T16:06:23.476134+0000 mon.a (mon.0) 1716 : audit [DBG] from='client.? 172.21.2.115:0/3992776439' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:06:26.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:06:26 gibba045 bash[25517]: cluster 2021-03-10T16:06:24.958765+0000 mgr.gibba045.orlgmj (mgr.34412) 7273 : cluster [DBG] pgmap v4138: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:26.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:06:26 gibba015 bash[29377]: cluster 2021-03-10T16:06:24.958765+0000 mgr.gibba045.orlgmj (mgr.34412) 7273 : cluster [DBG] pgmap v4138: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:26.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:06:26 gibba015 bash[30343]: cluster 2021-03-10T16:06:24.958765+0000 mgr.gibba045.orlgmj (mgr.34412) 7273 : cluster [DBG] pgmap v4138: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:28.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:06:28 gibba045 bash[25517]: cluster 2021-03-10T16:06:26.960552+0000 mgr.gibba045.orlgmj (mgr.34412) 7274 : cluster [DBG] pgmap v4139: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:28.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:06:28 gibba015 bash[29377]: cluster 2021-03-10T16:06:26.960552+0000 mgr.gibba045.orlgmj (mgr.34412) 7274 : cluster [DBG] pgmap v4139: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:28.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:06:28 gibba015 bash[30343]: cluster 2021-03-10T16:06:26.960552+0000 mgr.gibba045.orlgmj (mgr.34412) 7274 : cluster [DBG] pgmap v4139: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:30.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:06:30 gibba045 bash[25517]: cluster 2021-03-10T16:06:28.961780+0000 mgr.gibba045.orlgmj (mgr.34412) 7275 : cluster [DBG] pgmap v4140: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:30.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:06:30 gibba015 bash[29377]: cluster 2021-03-10T16:06:28.961780+0000 mgr.gibba045.orlgmj (mgr.34412) 7275 : cluster [DBG] pgmap v4140: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:30.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:06:30 gibba015 bash[30343]: cluster 2021-03-10T16:06:28.961780+0000 mgr.gibba045.orlgmj (mgr.34412) 7275 : cluster [DBG] pgmap v4140: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:32.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:06:32 gibba045 bash[25517]: cluster 2021-03-10T16:06:30.963292+0000 mgr.gibba045.orlgmj (mgr.34412) 7276 : cluster [DBG] pgmap v4141: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:32.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:06:32 gibba015 bash[29377]: cluster 2021-03-10T16:06:30.963292+0000 mgr.gibba045.orlgmj (mgr.34412) 7276 : cluster [DBG] pgmap v4141: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:32.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:06:32 gibba015 bash[30343]: cluster 2021-03-10T16:06:30.963292+0000 mgr.gibba045.orlgmj (mgr.34412) 7276 : cluster [DBG] pgmap v4141: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:34.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:06:34 gibba045 bash[25517]: cluster 2021-03-10T16:06:32.964998+0000 mgr.gibba045.orlgmj (mgr.34412) 7277 : cluster [DBG] pgmap v4142: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:34.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:06:34 gibba015 bash[29377]: cluster 2021-03-10T16:06:32.964998+0000 mgr.gibba045.orlgmj (mgr.34412) 7277 : cluster [DBG] pgmap v4142: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:34.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:06:34 gibba015 bash[30343]: cluster 2021-03-10T16:06:32.964998+0000 mgr.gibba045.orlgmj (mgr.34412) 7277 : cluster [DBG] pgmap v4142: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:36.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:06:36 gibba045 bash[25517]: cluster 2021-03-10T16:06:34.966432+0000 mgr.gibba045.orlgmj (mgr.34412) 7278 : cluster [DBG] pgmap v4143: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:36.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:06:36 gibba015 bash[29377]: cluster 2021-03-10T16:06:34.966432+0000 mgr.gibba045.orlgmj (mgr.34412) 7278 : cluster [DBG] pgmap v4143: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:36.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:06:36 gibba015 bash[30343]: cluster 2021-03-10T16:06:34.966432+0000 mgr.gibba045.orlgmj (mgr.34412) 7278 : cluster [DBG] pgmap v4143: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:38.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:06:38 gibba045 bash[25517]: cluster 2021-03-10T16:06:36.968072+0000 mgr.gibba045.orlgmj (mgr.34412) 7279 : cluster [DBG] pgmap v4144: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:38.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:06:38 gibba045 bash[25517]: cephadm 2021-03-10T16:06:37.400024+0000 mgr.gibba045.orlgmj (mgr.34412) 7280 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:06:38.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:06:38 gibba015 bash[29377]: cluster 2021-03-10T16:06:36.968072+0000 mgr.gibba045.orlgmj (mgr.34412) 7279 : cluster [DBG] pgmap v4144: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:38.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:06:38 gibba015 bash[29377]: cephadm 2021-03-10T16:06:37.400024+0000 mgr.gibba045.orlgmj (mgr.34412) 7280 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:06:38.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:06:38 gibba015 bash[30343]: cluster 2021-03-10T16:06:36.968072+0000 mgr.gibba045.orlgmj (mgr.34412) 7279 : cluster [DBG] pgmap v4144: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:38.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:06:38 gibba015 bash[30343]: cephadm 2021-03-10T16:06:37.400024+0000 mgr.gibba045.orlgmj (mgr.34412) 7280 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:06:40.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:06:40 gibba045 bash[25517]: cluster 2021-03-10T16:06:38.969330+0000 mgr.gibba045.orlgmj (mgr.34412) 7281 : cluster [DBG] pgmap v4145: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:40.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:06:40 gibba015 bash[29377]: cluster 2021-03-10T16:06:38.969330+0000 mgr.gibba045.orlgmj (mgr.34412) 7281 : cluster [DBG] pgmap v4145: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:40.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:06:40 gibba015 bash[30343]: cluster 2021-03-10T16:06:38.969330+0000 mgr.gibba045.orlgmj (mgr.34412) 7281 : cluster [DBG] pgmap v4145: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:42.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:06:42 gibba015 bash[29377]: cluster 2021-03-10T16:06:40.970817+0000 mgr.gibba045.orlgmj (mgr.34412) 7282 : cluster [DBG] pgmap v4146: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:42.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:06:42 gibba015 bash[30343]: cluster 2021-03-10T16:06:40.970817+0000 mgr.gibba045.orlgmj (mgr.34412) 7282 : cluster [DBG] pgmap v4146: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:43.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:06:42 gibba045 bash[25517]: cluster 2021-03-10T16:06:40.970817+0000 mgr.gibba045.orlgmj (mgr.34412) 7282 : cluster [DBG] pgmap v4146: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:44.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:06:44 gibba015 bash[29377]: cluster 2021-03-10T16:06:42.972489+0000 mgr.gibba045.orlgmj (mgr.34412) 7283 : cluster [DBG] pgmap v4147: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:44.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:06:44 gibba015 bash[30343]: cluster 2021-03-10T16:06:42.972489+0000 mgr.gibba045.orlgmj (mgr.34412) 7283 : cluster [DBG] pgmap v4147: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:45.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:06:44 gibba045 bash[25517]: cluster 2021-03-10T16:06:42.972489+0000 mgr.gibba045.orlgmj (mgr.34412) 7283 : cluster [DBG] pgmap v4147: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:46.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:06:46 gibba015 bash[29377]: cluster 2021-03-10T16:06:44.973908+0000 mgr.gibba045.orlgmj (mgr.34412) 7284 : cluster [DBG] pgmap v4148: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:46.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:06:46 gibba015 bash[30343]: cluster 2021-03-10T16:06:44.973908+0000 mgr.gibba045.orlgmj (mgr.34412) 7284 : cluster [DBG] pgmap v4148: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:47.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:06:46 gibba045 bash[25517]: cluster 2021-03-10T16:06:44.973908+0000 mgr.gibba045.orlgmj (mgr.34412) 7284 : cluster [DBG] pgmap v4148: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:48.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:06:48 gibba015 bash[29377]: cluster 2021-03-10T16:06:46.975557+0000 mgr.gibba045.orlgmj (mgr.34412) 7285 : cluster [DBG] pgmap v4149: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:48.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:06:48 gibba015 bash[30343]: cluster 2021-03-10T16:06:46.975557+0000 mgr.gibba045.orlgmj (mgr.34412) 7285 : cluster [DBG] pgmap v4149: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:49.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:06:48 gibba045 bash[25517]: cluster 2021-03-10T16:06:46.975557+0000 mgr.gibba045.orlgmj (mgr.34412) 7285 : cluster [DBG] pgmap v4149: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:50.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:06:50 gibba015 bash[29377]: cluster 2021-03-10T16:06:48.976844+0000 mgr.gibba045.orlgmj (mgr.34412) 7286 : cluster [DBG] pgmap v4150: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:50.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:06:50 gibba015 bash[30343]: cluster 2021-03-10T16:06:48.976844+0000 mgr.gibba045.orlgmj (mgr.34412) 7286 : cluster [DBG] pgmap v4150: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:51.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:06:50 gibba045 bash[25517]: cluster 2021-03-10T16:06:48.976844+0000 mgr.gibba045.orlgmj (mgr.34412) 7286 : cluster [DBG] pgmap v4150: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:52.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:06:52 gibba015 bash[29377]: cluster 2021-03-10T16:06:50.978567+0000 mgr.gibba045.orlgmj (mgr.34412) 7287 : cluster [DBG] pgmap v4151: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:52.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:06:52 gibba015 bash[29377]: audit 2021-03-10T16:06:52.414254+0000 mon.c (mon.1) 2018 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:06:52.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:06:52 gibba015 bash[29377]: audit 2021-03-10T16:06:52.420579+0000 mon.c (mon.1) 2019 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:06:52.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:06:52 gibba015 bash[30343]: cluster 2021-03-10T16:06:50.978567+0000 mgr.gibba045.orlgmj (mgr.34412) 7287 : cluster [DBG] pgmap v4151: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:52.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:06:52 gibba015 bash[30343]: audit 2021-03-10T16:06:52.414254+0000 mon.c (mon.1) 2018 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:06:52.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:06:52 gibba015 bash[30343]: audit 2021-03-10T16:06:52.420579+0000 mon.c (mon.1) 2019 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:06:53.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:06:52 gibba045 bash[25517]: cluster 2021-03-10T16:06:50.978567+0000 mgr.gibba045.orlgmj (mgr.34412) 7287 : cluster [DBG] pgmap v4151: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:53.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:06:52 gibba045 bash[25517]: audit 2021-03-10T16:06:52.414254+0000 mon.c (mon.1) 2018 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:06:53.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:06:52 gibba045 bash[25517]: audit 2021-03-10T16:06:52.420579+0000 mon.c (mon.1) 2019 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:06:53.721 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:06:53.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:06:53 gibba015 bash[29377]: cephadm 2021-03-10T16:06:52.421427+0000 mgr.gibba045.orlgmj (mgr.34412) 7288 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:06:53.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:06:53 gibba015 bash[29377]: audit 2021-03-10T16:06:53.424322+0000 mon.c (mon.1) 2020 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:06:53.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:06:53 gibba015 bash[29377]: audit 2021-03-10T16:06:53.424944+0000 mon.c (mon.1) 2021 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:06:53.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:06:53 gibba015 bash[29377]: audit 2021-03-10T16:06:53.425449+0000 mon.a (mon.0) 1717 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:06:53.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:06:53 gibba015 bash[29377]: audit 2021-03-10T16:06:53.426551+0000 mon.a (mon.0) 1718 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:06:53.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:06:53 gibba015 bash[29377]: audit 2021-03-10T16:06:53.427243+0000 mon.c (mon.1) 2022 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:06:53.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:06:53 gibba015 bash[29377]: audit 2021-03-10T16:06:53.428122+0000 mon.c (mon.1) 2023 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:06:53.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:06:53 gibba015 bash[29377]: audit 2021-03-10T16:06:53.428340+0000 mon.a (mon.0) 1719 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:06:53.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:06:53 gibba015 bash[29377]: audit 2021-03-10T16:06:53.428752+0000 mon.c (mon.1) 2024 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:06:53.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:06:53 gibba015 bash[29377]: audit 2021-03-10T16:06:53.429666+0000 mon.a (mon.0) 1720 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:06:53.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:06:53 gibba015 bash[29377]: audit 2021-03-10T16:06:53.429710+0000 mon.c (mon.1) 2025 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:06:53.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:06:53 gibba015 bash[29377]: audit 2021-03-10T16:06:53.430679+0000 mon.a (mon.0) 1721 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:06:53.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:06:53 gibba015 bash[29377]: audit 2021-03-10T16:06:53.431717+0000 mon.a (mon.0) 1722 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:06:53.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:06:53 gibba015 bash[30343]: cephadm 2021-03-10T16:06:52.421427+0000 mgr.gibba045.orlgmj (mgr.34412) 7288 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:06:53.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:06:53 gibba015 bash[30343]: audit 2021-03-10T16:06:53.424322+0000 mon.c (mon.1) 2020 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:06:53.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:06:53 gibba015 bash[30343]: audit 2021-03-10T16:06:53.424944+0000 mon.c (mon.1) 2021 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:06:53.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:06:53 gibba015 bash[30343]: audit 2021-03-10T16:06:53.425449+0000 mon.a (mon.0) 1717 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:06:53.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:06:53 gibba015 bash[30343]: audit 2021-03-10T16:06:53.426551+0000 mon.a (mon.0) 1718 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:06:53.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:06:53 gibba015 bash[30343]: audit 2021-03-10T16:06:53.427243+0000 mon.c (mon.1) 2022 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:06:53.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:06:53 gibba015 bash[30343]: audit 2021-03-10T16:06:53.428122+0000 mon.c (mon.1) 2023 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:06:53.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:06:53 gibba015 bash[30343]: audit 2021-03-10T16:06:53.428340+0000 mon.a (mon.0) 1719 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:06:53.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:06:53 gibba015 bash[30343]: audit 2021-03-10T16:06:53.428752+0000 mon.c (mon.1) 2024 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:06:53.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:06:53 gibba015 bash[30343]: audit 2021-03-10T16:06:53.429666+0000 mon.a (mon.0) 1720 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:06:53.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:06:53 gibba015 bash[30343]: audit 2021-03-10T16:06:53.429710+0000 mon.c (mon.1) 2025 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:06:53.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:06:53 gibba015 bash[30343]: audit 2021-03-10T16:06:53.430679+0000 mon.a (mon.0) 1721 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:06:53.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:06:53 gibba015 bash[30343]: audit 2021-03-10T16:06:53.431717+0000 mon.a (mon.0) 1722 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:06:53.981 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:06:53.982 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 61s ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:06:53.982 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 10m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:06:53.982 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:06:53.982 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:06:53.983 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 61s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:06:53.983 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 61s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:06:53.983 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:06:53.983 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 61s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:06:53.984 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 61s ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:06:53.984 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 10m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:06:53.984 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 61s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:06:53.984 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 61s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:06:53.984 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 61s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:06:53.985 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 61s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:06:53.985 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:06:53.985 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:06:53.985 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:06:53.986 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:06:53.986 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 10m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:06:53.986 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 10m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:06:54.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:06:53 gibba045 bash[25517]: cephadm 2021-03-10T16:06:52.421427+0000 mgr.gibba045.orlgmj (mgr.34412) 7288 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:06:54.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:06:53 gibba045 bash[25517]: audit 2021-03-10T16:06:53.424322+0000 mon.c (mon.1) 2020 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:06:54.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:06:53 gibba045 bash[25517]: audit 2021-03-10T16:06:53.424944+0000 mon.c (mon.1) 2021 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:06:54.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:06:53 gibba045 bash[25517]: audit 2021-03-10T16:06:53.425449+0000 mon.a (mon.0) 1717 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:06:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:06:53 gibba045 bash[25517]: audit 2021-03-10T16:06:53.426551+0000 mon.a (mon.0) 1718 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:06:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:06:53 gibba045 bash[25517]: audit 2021-03-10T16:06:53.427243+0000 mon.c (mon.1) 2022 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:06:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:06:53 gibba045 bash[25517]: audit 2021-03-10T16:06:53.428122+0000 mon.c (mon.1) 2023 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:06:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:06:53 gibba045 bash[25517]: audit 2021-03-10T16:06:53.428340+0000 mon.a (mon.0) 1719 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:06:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:06:53 gibba045 bash[25517]: audit 2021-03-10T16:06:53.428752+0000 mon.c (mon.1) 2024 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:06:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:06:53 gibba045 bash[25517]: audit 2021-03-10T16:06:53.429666+0000 mon.a (mon.0) 1720 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:06:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:06:53 gibba045 bash[25517]: audit 2021-03-10T16:06:53.429710+0000 mon.c (mon.1) 2025 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:06:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:06:53 gibba045 bash[25517]: audit 2021-03-10T16:06:53.430679+0000 mon.a (mon.0) 1721 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:06:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:06:53 gibba045 bash[25517]: audit 2021-03-10T16:06:53.431717+0000 mon.a (mon.0) 1722 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:06:54.234 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:06:54.234 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:06:54.234 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:06:54.235 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:06:54.235 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:06:54.235 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:06:54.235 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:06:54.235 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:06:54.236 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:06:54.236 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:06:54.236 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:06:54.236 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:06:54.237 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:06:54.237 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:06:54.237 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:06:54.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:06:54 gibba015 bash[29377]: cluster 2021-03-10T16:06:52.980132+0000 mgr.gibba045.orlgmj (mgr.34412) 7289 : cluster [DBG] pgmap v4152: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:54.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:06:54 gibba015 bash[29377]: audit 2021-03-10T16:06:53.714311+0000 mgr.gibba045.orlgmj (mgr.34412) 7290 : audit [DBG] from='client.48948 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:06:54.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:06:54 gibba015 bash[29377]: audit 2021-03-10T16:06:54.233435+0000 mon.a (mon.0) 1723 : audit [DBG] from='client.? 172.21.2.115:0/1889764184' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:06:54.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:06:54 gibba015 bash[30343]: cluster 2021-03-10T16:06:52.980132+0000 mgr.gibba045.orlgmj (mgr.34412) 7289 : cluster [DBG] pgmap v4152: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:54.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:06:54 gibba015 bash[30343]: audit 2021-03-10T16:06:53.714311+0000 mgr.gibba045.orlgmj (mgr.34412) 7290 : audit [DBG] from='client.48948 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:06:54.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:06:54 gibba015 bash[30343]: audit 2021-03-10T16:06:54.233435+0000 mon.a (mon.0) 1723 : audit [DBG] from='client.? 172.21.2.115:0/1889764184' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:06:55.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:06:54 gibba045 bash[25517]: cluster 2021-03-10T16:06:52.980132+0000 mgr.gibba045.orlgmj (mgr.34412) 7289 : cluster [DBG] pgmap v4152: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:55.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:06:54 gibba045 bash[25517]: audit 2021-03-10T16:06:53.714311+0000 mgr.gibba045.orlgmj (mgr.34412) 7290 : audit [DBG] from='client.48948 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:06:55.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:06:54 gibba045 bash[25517]: audit 2021-03-10T16:06:54.233435+0000 mon.a (mon.0) 1723 : audit [DBG] from='client.? 172.21.2.115:0/1889764184' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:06:55.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:06:55 gibba015 bash[29377]: audit 2021-03-10T16:06:53.942967+0000 mgr.gibba045.orlgmj (mgr.34412) 7291 : audit [DBG] from='client.58942 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:06:55.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:06:55 gibba015 bash[30343]: audit 2021-03-10T16:06:53.942967+0000 mgr.gibba045.orlgmj (mgr.34412) 7291 : audit [DBG] from='client.58942 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:06:56.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:06:55 gibba045 bash[25517]: audit 2021-03-10T16:06:53.942967+0000 mgr.gibba045.orlgmj (mgr.34412) 7291 : audit [DBG] from='client.58942 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:06:56.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:06:56 gibba015 bash[29377]: cluster 2021-03-10T16:06:54.981719+0000 mgr.gibba045.orlgmj (mgr.34412) 7292 : cluster [DBG] pgmap v4153: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:56.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:06:56 gibba015 bash[29377]: audit 2021-03-10T16:06:56.080520+0000 mon.a (mon.0) 1724 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:06:56.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:06:56 gibba015 bash[29377]: audit 2021-03-10T16:06:56.277551+0000 mon.a (mon.0) 1725 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:06:56.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:06:56 gibba015 bash[29377]: audit 2021-03-10T16:06:56.281297+0000 mon.c (mon.1) 2026 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:06:56.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:06:56 gibba015 bash[29377]: audit 2021-03-10T16:06:56.283037+0000 mon.c (mon.1) 2027 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:06:56.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:06:56 gibba015 bash[29377]: audit 2021-03-10T16:06:56.284622+0000 mon.c (mon.1) 2028 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:06:56.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:06:56 gibba015 bash[29377]: audit 2021-03-10T16:06:56.285790+0000 mon.c (mon.1) 2029 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:06:56.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:06:56 gibba015 bash[29377]: audit 2021-03-10T16:06:56.288397+0000 mon.c (mon.1) 2030 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:06:56.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:06:56 gibba015 bash[29377]: audit 2021-03-10T16:06:56.289872+0000 mon.c (mon.1) 2031 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:06:56.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:06:56 gibba015 bash[30343]: cluster 2021-03-10T16:06:54.981719+0000 mgr.gibba045.orlgmj (mgr.34412) 7292 : cluster [DBG] pgmap v4153: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:56.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:06:56 gibba015 bash[30343]: audit 2021-03-10T16:06:56.080520+0000 mon.a (mon.0) 1724 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:06:56.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:06:56 gibba015 bash[30343]: audit 2021-03-10T16:06:56.277551+0000 mon.a (mon.0) 1725 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:06:56.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:06:56 gibba015 bash[30343]: audit 2021-03-10T16:06:56.281297+0000 mon.c (mon.1) 2026 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:06:56.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:06:56 gibba015 bash[30343]: audit 2021-03-10T16:06:56.283037+0000 mon.c (mon.1) 2027 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:06:56.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:06:56 gibba015 bash[30343]: audit 2021-03-10T16:06:56.284622+0000 mon.c (mon.1) 2028 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:06:56.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:06:56 gibba015 bash[30343]: audit 2021-03-10T16:06:56.285790+0000 mon.c (mon.1) 2029 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:06:56.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:06:56 gibba015 bash[30343]: audit 2021-03-10T16:06:56.288397+0000 mon.c (mon.1) 2030 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:06:56.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:06:56 gibba015 bash[30343]: audit 2021-03-10T16:06:56.289872+0000 mon.c (mon.1) 2031 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:06:57.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:06:56 gibba045 bash[25517]: cluster 2021-03-10T16:06:54.981719+0000 mgr.gibba045.orlgmj (mgr.34412) 7292 : cluster [DBG] pgmap v4153: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:57.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:06:56 gibba045 bash[25517]: audit 2021-03-10T16:06:56.080520+0000 mon.a (mon.0) 1724 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:06:57.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:06:56 gibba045 bash[25517]: audit 2021-03-10T16:06:56.277551+0000 mon.a (mon.0) 1725 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:06:57.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:06:56 gibba045 bash[25517]: audit 2021-03-10T16:06:56.281297+0000 mon.c (mon.1) 2026 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:06:57.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:06:56 gibba045 bash[25517]: audit 2021-03-10T16:06:56.283037+0000 mon.c (mon.1) 2027 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:06:57.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:06:56 gibba045 bash[25517]: audit 2021-03-10T16:06:56.284622+0000 mon.c (mon.1) 2028 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:06:57.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:06:56 gibba045 bash[25517]: audit 2021-03-10T16:06:56.285790+0000 mon.c (mon.1) 2029 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:06:57.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:06:56 gibba045 bash[25517]: audit 2021-03-10T16:06:56.288397+0000 mon.c (mon.1) 2030 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:06:57.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:06:56 gibba045 bash[25517]: audit 2021-03-10T16:06:56.289872+0000 mon.c (mon.1) 2031 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:06:57.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:06:57 gibba015 bash[29377]: cephadm 2021-03-10T16:06:56.083961+0000 mgr.gibba045.orlgmj (mgr.34412) 7293 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:06:57.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:06:57 gibba015 bash[29377]: cephadm 2021-03-10T16:06:56.283013+0000 mgr.gibba045.orlgmj (mgr.34412) 7294 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:06:57.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:06:57 gibba015 bash[29377]: cephadm 2021-03-10T16:06:56.284933+0000 mgr.gibba045.orlgmj (mgr.34412) 7295 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:06:57.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:06:57 gibba015 bash[29377]: cephadm 2021-03-10T16:06:56.286493+0000 mgr.gibba045.orlgmj (mgr.34412) 7296 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:06:57.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:06:57 gibba015 bash[29377]: cephadm 2021-03-10T16:06:56.286529+0000 mgr.gibba045.orlgmj (mgr.34412) 7297 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:06:57.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:06:57 gibba015 bash[29377]: cephadm 2021-03-10T16:06:56.287735+0000 mgr.gibba045.orlgmj (mgr.34412) 7298 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:06:57.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:06:57 gibba015 bash[29377]: cephadm 2021-03-10T16:06:56.287772+0000 mgr.gibba045.orlgmj (mgr.34412) 7299 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:06:57.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:06:57 gibba015 bash[29377]: cephadm 2021-03-10T16:06:56.289185+0000 mgr.gibba045.orlgmj (mgr.34412) 7300 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:06:57.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:06:57 gibba015 bash[29377]: cephadm 2021-03-10T16:06:56.290425+0000 mgr.gibba045.orlgmj (mgr.34412) 7301 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:06:57.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:06:57 gibba015 bash[29377]: cephadm 2021-03-10T16:06:56.290461+0000 mgr.gibba045.orlgmj (mgr.34412) 7302 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:06:57.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:06:57 gibba015 bash[29377]: cephadm 2021-03-10T16:06:56.291579+0000 mgr.gibba045.orlgmj (mgr.34412) 7303 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:06:57.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:06:57 gibba015 bash[29377]: cephadm 2021-03-10T16:06:56.291887+0000 mgr.gibba045.orlgmj (mgr.34412) 7304 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:06:57.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:06:57 gibba015 bash[29377]: cephadm 2021-03-10T16:06:56.293366+0000 mgr.gibba045.orlgmj (mgr.34412) 7305 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:06:57.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:06:57 gibba015 bash[29377]: cephadm 2021-03-10T16:06:56.293401+0000 mgr.gibba045.orlgmj (mgr.34412) 7306 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:06:57.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:06:57 gibba015 bash[29377]: cephadm 2021-03-10T16:06:56.293505+0000 mgr.gibba045.orlgmj (mgr.34412) 7307 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:06:57.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:06:57 gibba015 bash[30343]: cephadm 2021-03-10T16:06:56.083961+0000 mgr.gibba045.orlgmj (mgr.34412) 7293 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:06:57.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:06:57 gibba015 bash[30343]: cephadm 2021-03-10T16:06:56.283013+0000 mgr.gibba045.orlgmj (mgr.34412) 7294 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:06:57.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:06:57 gibba015 bash[30343]: cephadm 2021-03-10T16:06:56.284933+0000 mgr.gibba045.orlgmj (mgr.34412) 7295 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:06:57.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:06:57 gibba015 bash[30343]: cephadm 2021-03-10T16:06:56.286493+0000 mgr.gibba045.orlgmj (mgr.34412) 7296 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:06:57.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:06:57 gibba015 bash[30343]: cephadm 2021-03-10T16:06:56.286529+0000 mgr.gibba045.orlgmj (mgr.34412) 7297 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:06:57.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:06:57 gibba015 bash[30343]: cephadm 2021-03-10T16:06:56.287735+0000 mgr.gibba045.orlgmj (mgr.34412) 7298 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:06:57.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:06:57 gibba015 bash[30343]: cephadm 2021-03-10T16:06:56.287772+0000 mgr.gibba045.orlgmj (mgr.34412) 7299 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:06:57.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:06:57 gibba015 bash[30343]: cephadm 2021-03-10T16:06:56.289185+0000 mgr.gibba045.orlgmj (mgr.34412) 7300 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:06:57.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:06:57 gibba015 bash[30343]: cephadm 2021-03-10T16:06:56.290425+0000 mgr.gibba045.orlgmj (mgr.34412) 7301 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:06:57.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:06:57 gibba015 bash[30343]: cephadm 2021-03-10T16:06:56.290461+0000 mgr.gibba045.orlgmj (mgr.34412) 7302 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:06:57.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:06:57 gibba015 bash[30343]: cephadm 2021-03-10T16:06:56.291579+0000 mgr.gibba045.orlgmj (mgr.34412) 7303 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:06:57.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:06:57 gibba015 bash[30343]: cephadm 2021-03-10T16:06:56.291887+0000 mgr.gibba045.orlgmj (mgr.34412) 7304 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:06:57.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:06:57 gibba015 bash[30343]: cephadm 2021-03-10T16:06:56.293366+0000 mgr.gibba045.orlgmj (mgr.34412) 7305 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:06:57.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:06:57 gibba015 bash[30343]: cephadm 2021-03-10T16:06:56.293401+0000 mgr.gibba045.orlgmj (mgr.34412) 7306 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:06:57.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:06:57 gibba015 bash[30343]: cephadm 2021-03-10T16:06:56.293505+0000 mgr.gibba045.orlgmj (mgr.34412) 7307 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:06:58.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:06:57 gibba045 bash[25517]: cephadm 2021-03-10T16:06:56.083961+0000 mgr.gibba045.orlgmj (mgr.34412) 7293 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:06:58.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:06:57 gibba045 bash[25517]: cephadm 2021-03-10T16:06:56.283013+0000 mgr.gibba045.orlgmj (mgr.34412) 7294 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:06:58.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:06:57 gibba045 bash[25517]: cephadm 2021-03-10T16:06:56.284933+0000 mgr.gibba045.orlgmj (mgr.34412) 7295 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:06:58.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:06:57 gibba045 bash[25517]: cephadm 2021-03-10T16:06:56.286493+0000 mgr.gibba045.orlgmj (mgr.34412) 7296 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:06:58.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:06:57 gibba045 bash[25517]: cephadm 2021-03-10T16:06:56.286529+0000 mgr.gibba045.orlgmj (mgr.34412) 7297 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:06:58.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:06:57 gibba045 bash[25517]: cephadm 2021-03-10T16:06:56.287735+0000 mgr.gibba045.orlgmj (mgr.34412) 7298 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:06:58.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:06:57 gibba045 bash[25517]: cephadm 2021-03-10T16:06:56.287772+0000 mgr.gibba045.orlgmj (mgr.34412) 7299 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:06:58.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:06:57 gibba045 bash[25517]: cephadm 2021-03-10T16:06:56.289185+0000 mgr.gibba045.orlgmj (mgr.34412) 7300 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:06:58.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:06:57 gibba045 bash[25517]: cephadm 2021-03-10T16:06:56.290425+0000 mgr.gibba045.orlgmj (mgr.34412) 7301 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:06:58.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:06:57 gibba045 bash[25517]: cephadm 2021-03-10T16:06:56.290461+0000 mgr.gibba045.orlgmj (mgr.34412) 7302 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:06:58.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:06:57 gibba045 bash[25517]: cephadm 2021-03-10T16:06:56.291579+0000 mgr.gibba045.orlgmj (mgr.34412) 7303 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:06:58.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:06:57 gibba045 bash[25517]: cephadm 2021-03-10T16:06:56.291887+0000 mgr.gibba045.orlgmj (mgr.34412) 7304 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:06:58.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:06:57 gibba045 bash[25517]: cephadm 2021-03-10T16:06:56.293366+0000 mgr.gibba045.orlgmj (mgr.34412) 7305 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:06:58.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:06:57 gibba045 bash[25517]: cephadm 2021-03-10T16:06:56.293401+0000 mgr.gibba045.orlgmj (mgr.34412) 7306 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:06:58.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:06:57 gibba045 bash[25517]: cephadm 2021-03-10T16:06:56.293505+0000 mgr.gibba045.orlgmj (mgr.34412) 7307 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:06:58.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:06:58 gibba015 bash[29377]: cluster 2021-03-10T16:06:56.983379+0000 mgr.gibba045.orlgmj (mgr.34412) 7308 : cluster [DBG] pgmap v4154: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:58.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:06:58 gibba015 bash[30343]: cluster 2021-03-10T16:06:56.983379+0000 mgr.gibba045.orlgmj (mgr.34412) 7308 : cluster [DBG] pgmap v4154: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:59.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:06:58 gibba045 bash[25517]: cluster 2021-03-10T16:06:56.983379+0000 mgr.gibba045.orlgmj (mgr.34412) 7308 : cluster [DBG] pgmap v4154: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:00.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:07:00 gibba015 bash[29377]: cluster 2021-03-10T16:06:58.984592+0000 mgr.gibba045.orlgmj (mgr.34412) 7309 : cluster [DBG] pgmap v4155: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:00.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:07:00 gibba015 bash[30343]: cluster 2021-03-10T16:06:58.984592+0000 mgr.gibba045.orlgmj (mgr.34412) 7309 : cluster [DBG] pgmap v4155: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:01.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:07:00 gibba045 bash[25517]: cluster 2021-03-10T16:06:58.984592+0000 mgr.gibba045.orlgmj (mgr.34412) 7309 : cluster [DBG] pgmap v4155: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:02.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:07:02 gibba015 bash[29377]: cluster 2021-03-10T16:07:00.986548+0000 mgr.gibba045.orlgmj (mgr.34412) 7310 : cluster [DBG] pgmap v4156: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:02.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:07:02 gibba015 bash[30343]: cluster 2021-03-10T16:07:00.986548+0000 mgr.gibba045.orlgmj (mgr.34412) 7310 : cluster [DBG] pgmap v4156: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:03.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:07:02 gibba045 bash[25517]: cluster 2021-03-10T16:07:00.986548+0000 mgr.gibba045.orlgmj (mgr.34412) 7310 : cluster [DBG] pgmap v4156: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:04.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:07:04 gibba015 bash[29377]: cluster 2021-03-10T16:07:02.988185+0000 mgr.gibba045.orlgmj (mgr.34412) 7311 : cluster [DBG] pgmap v4157: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:04.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:07:04 gibba015 bash[30343]: cluster 2021-03-10T16:07:02.988185+0000 mgr.gibba045.orlgmj (mgr.34412) 7311 : cluster [DBG] pgmap v4157: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:05.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:07:04 gibba045 bash[25517]: cluster 2021-03-10T16:07:02.988185+0000 mgr.gibba045.orlgmj (mgr.34412) 7311 : cluster [DBG] pgmap v4157: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:06.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:07:06 gibba015 bash[29377]: cluster 2021-03-10T16:07:04.989723+0000 mgr.gibba045.orlgmj (mgr.34412) 7312 : cluster [DBG] pgmap v4158: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:06.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:07:06 gibba015 bash[30343]: cluster 2021-03-10T16:07:04.989723+0000 mgr.gibba045.orlgmj (mgr.34412) 7312 : cluster [DBG] pgmap v4158: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:07.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:07:06 gibba045 bash[25517]: cluster 2021-03-10T16:07:04.989723+0000 mgr.gibba045.orlgmj (mgr.34412) 7312 : cluster [DBG] pgmap v4158: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:08.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:07:08 gibba015 bash[29377]: cluster 2021-03-10T16:07:06.991363+0000 mgr.gibba045.orlgmj (mgr.34412) 7313 : cluster [DBG] pgmap v4159: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:08.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:07:08 gibba015 bash[30343]: cluster 2021-03-10T16:07:06.991363+0000 mgr.gibba045.orlgmj (mgr.34412) 7313 : cluster [DBG] pgmap v4159: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:09.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:07:08 gibba045 bash[25517]: cluster 2021-03-10T16:07:06.991363+0000 mgr.gibba045.orlgmj (mgr.34412) 7313 : cluster [DBG] pgmap v4159: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:10.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:07:10 gibba015 bash[29377]: cluster 2021-03-10T16:07:08.992779+0000 mgr.gibba045.orlgmj (mgr.34412) 7314 : cluster [DBG] pgmap v4160: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:10.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:07:10 gibba015 bash[30343]: cluster 2021-03-10T16:07:08.992779+0000 mgr.gibba045.orlgmj (mgr.34412) 7314 : cluster [DBG] pgmap v4160: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:11.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:07:10 gibba045 bash[25517]: cluster 2021-03-10T16:07:08.992779+0000 mgr.gibba045.orlgmj (mgr.34412) 7314 : cluster [DBG] pgmap v4160: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:12.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:07:12 gibba015 bash[29377]: cluster 2021-03-10T16:07:10.994501+0000 mgr.gibba045.orlgmj (mgr.34412) 7315 : cluster [DBG] pgmap v4161: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:12.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:07:12 gibba015 bash[29377]: cephadm 2021-03-10T16:07:11.309578+0000 mgr.gibba045.orlgmj (mgr.34412) 7316 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:07:12.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:07:12 gibba015 bash[30343]: cluster 2021-03-10T16:07:10.994501+0000 mgr.gibba045.orlgmj (mgr.34412) 7315 : cluster [DBG] pgmap v4161: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:12.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:07:12 gibba015 bash[30343]: cephadm 2021-03-10T16:07:11.309578+0000 mgr.gibba045.orlgmj (mgr.34412) 7316 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:07:13.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:07:12 gibba045 bash[25517]: cluster 2021-03-10T16:07:10.994501+0000 mgr.gibba045.orlgmj (mgr.34412) 7315 : cluster [DBG] pgmap v4161: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:13.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:07:12 gibba045 bash[25517]: cephadm 2021-03-10T16:07:11.309578+0000 mgr.gibba045.orlgmj (mgr.34412) 7316 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:07:14.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:07:14 gibba015 bash[29377]: cluster 2021-03-10T16:07:12.996153+0000 mgr.gibba045.orlgmj (mgr.34412) 7317 : cluster [DBG] pgmap v4162: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:14.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:07:14 gibba015 bash[30343]: cluster 2021-03-10T16:07:12.996153+0000 mgr.gibba045.orlgmj (mgr.34412) 7317 : cluster [DBG] pgmap v4162: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:15.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:07:14 gibba045 bash[25517]: cluster 2021-03-10T16:07:12.996153+0000 mgr.gibba045.orlgmj (mgr.34412) 7317 : cluster [DBG] pgmap v4162: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:16.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:07:16 gibba015 bash[29377]: cluster 2021-03-10T16:07:14.997711+0000 mgr.gibba045.orlgmj (mgr.34412) 7318 : cluster [DBG] pgmap v4163: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:16.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:07:16 gibba015 bash[30343]: cluster 2021-03-10T16:07:14.997711+0000 mgr.gibba045.orlgmj (mgr.34412) 7318 : cluster [DBG] pgmap v4163: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:17.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:07:16 gibba045 bash[25517]: cluster 2021-03-10T16:07:14.997711+0000 mgr.gibba045.orlgmj (mgr.34412) 7318 : cluster [DBG] pgmap v4163: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:19.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:07:18 gibba045 bash[25517]: cluster 2021-03-10T16:07:16.999449+0000 mgr.gibba045.orlgmj (mgr.34412) 7319 : cluster [DBG] pgmap v4164: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:19.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:07:18 gibba015 bash[29377]: cluster 2021-03-10T16:07:16.999449+0000 mgr.gibba045.orlgmj (mgr.34412) 7319 : cluster [DBG] pgmap v4164: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:19.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:07:18 gibba015 bash[30343]: cluster 2021-03-10T16:07:16.999449+0000 mgr.gibba045.orlgmj (mgr.34412) 7319 : cluster [DBG] pgmap v4164: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:21.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:07:20 gibba045 bash[25517]: cluster 2021-03-10T16:07:19.000700+0000 mgr.gibba045.orlgmj (mgr.34412) 7320 : cluster [DBG] pgmap v4165: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:21.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:07:20 gibba015 bash[29377]: cluster 2021-03-10T16:07:19.000700+0000 mgr.gibba045.orlgmj (mgr.34412) 7320 : cluster [DBG] pgmap v4165: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:21.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:07:20 gibba015 bash[30343]: cluster 2021-03-10T16:07:19.000700+0000 mgr.gibba045.orlgmj (mgr.34412) 7320 : cluster [DBG] pgmap v4165: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:23.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:07:22 gibba045 bash[25517]: cluster 2021-03-10T16:07:21.002301+0000 mgr.gibba045.orlgmj (mgr.34412) 7321 : cluster [DBG] pgmap v4166: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:23.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:07:22 gibba015 bash[29377]: cluster 2021-03-10T16:07:21.002301+0000 mgr.gibba045.orlgmj (mgr.34412) 7321 : cluster [DBG] pgmap v4166: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:23.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:07:22 gibba015 bash[30343]: cluster 2021-03-10T16:07:21.002301+0000 mgr.gibba045.orlgmj (mgr.34412) 7321 : cluster [DBG] pgmap v4166: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:24.479 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:07:24.730 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:07:24.731 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 92s ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:07:24.731 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 28s ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:07:24.731 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 28s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:07:24.732 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 28s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:07:24.732 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 92s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:07:24.732 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 92s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:07:24.732 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 28s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:07:24.732 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 92s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:07:24.733 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 92s ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:07:24.733 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 28s ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:07:24.733 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 92s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:07:24.733 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 92s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:07:24.734 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 92s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:07:24.734 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 92s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:07:24.734 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 28s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:07:24.734 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 28s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:07:24.735 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 28s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:07:24.735 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 28s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:07:24.735 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 28s ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:07:24.735 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 28s ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:07:24.984 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:07:24.985 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:07:24.985 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:07:24.985 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:07:24.985 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:07:24.986 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:07:24.986 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:07:24.986 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:07:24.986 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:07:24.987 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:07:24.987 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:07:24.987 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:07:24.988 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:07:24.988 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:07:24.988 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:07:25.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:07:24 gibba045 bash[25517]: cluster 2021-03-10T16:07:23.003931+0000 mgr.gibba045.orlgmj (mgr.34412) 7322 : cluster [DBG] pgmap v4167: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:25.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:07:24 gibba015 bash[29377]: cluster 2021-03-10T16:07:23.003931+0000 mgr.gibba045.orlgmj (mgr.34412) 7322 : cluster [DBG] pgmap v4167: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:25.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:07:24 gibba015 bash[30343]: cluster 2021-03-10T16:07:23.003931+0000 mgr.gibba045.orlgmj (mgr.34412) 7322 : cluster [DBG] pgmap v4167: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:26.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:07:25 gibba045 bash[25517]: audit 2021-03-10T16:07:24.472122+0000 mgr.gibba045.orlgmj (mgr.34412) 7323 : audit [DBG] from='client.48966 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:07:26.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:07:25 gibba045 bash[25517]: audit 2021-03-10T16:07:24.699053+0000 mgr.gibba045.orlgmj (mgr.34412) 7324 : audit [DBG] from='client.58960 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:07:26.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:07:25 gibba045 bash[25517]: audit 2021-03-10T16:07:24.984042+0000 mon.c (mon.1) 2032 : audit [DBG] from='client.? 172.21.2.115:0/1689813214' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:07:26.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:07:25 gibba015 bash[29377]: audit 2021-03-10T16:07:24.472122+0000 mgr.gibba045.orlgmj (mgr.34412) 7323 : audit [DBG] from='client.48966 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:07:26.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:07:25 gibba015 bash[29377]: audit 2021-03-10T16:07:24.699053+0000 mgr.gibba045.orlgmj (mgr.34412) 7324 : audit [DBG] from='client.58960 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:07:26.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:07:25 gibba015 bash[29377]: audit 2021-03-10T16:07:24.984042+0000 mon.c (mon.1) 2032 : audit [DBG] from='client.? 172.21.2.115:0/1689813214' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:07:26.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:07:25 gibba015 bash[30343]: audit 2021-03-10T16:07:24.472122+0000 mgr.gibba045.orlgmj (mgr.34412) 7323 : audit [DBG] from='client.48966 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:07:26.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:07:25 gibba015 bash[30343]: audit 2021-03-10T16:07:24.699053+0000 mgr.gibba045.orlgmj (mgr.34412) 7324 : audit [DBG] from='client.58960 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:07:26.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:07:25 gibba015 bash[30343]: audit 2021-03-10T16:07:24.984042+0000 mon.c (mon.1) 2032 : audit [DBG] from='client.? 172.21.2.115:0/1689813214' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:07:27.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:07:26 gibba045 bash[25517]: cluster 2021-03-10T16:07:25.005362+0000 mgr.gibba045.orlgmj (mgr.34412) 7325 : cluster [DBG] pgmap v4168: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:27.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:07:26 gibba015 bash[29377]: cluster 2021-03-10T16:07:25.005362+0000 mgr.gibba045.orlgmj (mgr.34412) 7325 : cluster [DBG] pgmap v4168: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:27.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:07:26 gibba015 bash[30343]: cluster 2021-03-10T16:07:25.005362+0000 mgr.gibba045.orlgmj (mgr.34412) 7325 : cluster [DBG] pgmap v4168: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:28.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:07:27 gibba045 bash[25517]: cephadm 2021-03-10T16:07:26.325678+0000 mgr.gibba045.orlgmj (mgr.34412) 7326 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:07:28.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:07:27 gibba015 bash[29377]: cephadm 2021-03-10T16:07:26.325678+0000 mgr.gibba045.orlgmj (mgr.34412) 7326 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:07:28.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:07:27 gibba015 bash[30343]: cephadm 2021-03-10T16:07:26.325678+0000 mgr.gibba045.orlgmj (mgr.34412) 7326 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:07:29.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:07:28 gibba045 bash[25517]: cluster 2021-03-10T16:07:27.006889+0000 mgr.gibba045.orlgmj (mgr.34412) 7327 : cluster [DBG] pgmap v4169: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:29.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:07:28 gibba015 bash[29377]: cluster 2021-03-10T16:07:27.006889+0000 mgr.gibba045.orlgmj (mgr.34412) 7327 : cluster [DBG] pgmap v4169: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:29.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:07:28 gibba015 bash[30343]: cluster 2021-03-10T16:07:27.006889+0000 mgr.gibba045.orlgmj (mgr.34412) 7327 : cluster [DBG] pgmap v4169: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:31.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:07:30 gibba045 bash[25517]: cluster 2021-03-10T16:07:29.008146+0000 mgr.gibba045.orlgmj (mgr.34412) 7328 : cluster [DBG] pgmap v4170: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:31.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:07:30 gibba015 bash[29377]: cluster 2021-03-10T16:07:29.008146+0000 mgr.gibba045.orlgmj (mgr.34412) 7328 : cluster [DBG] pgmap v4170: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:31.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:07:30 gibba015 bash[30343]: cluster 2021-03-10T16:07:29.008146+0000 mgr.gibba045.orlgmj (mgr.34412) 7328 : cluster [DBG] pgmap v4170: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:33.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:07:32 gibba015 bash[29377]: cluster 2021-03-10T16:07:31.009912+0000 mgr.gibba045.orlgmj (mgr.34412) 7329 : cluster [DBG] pgmap v4171: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:33.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:07:32 gibba015 bash[30343]: cluster 2021-03-10T16:07:31.009912+0000 mgr.gibba045.orlgmj (mgr.34412) 7329 : cluster [DBG] pgmap v4171: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:33.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:07:32 gibba045 bash[25517]: cluster 2021-03-10T16:07:31.009912+0000 mgr.gibba045.orlgmj (mgr.34412) 7329 : cluster [DBG] pgmap v4171: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:35.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:07:34 gibba015 bash[29377]: cluster 2021-03-10T16:07:33.011595+0000 mgr.gibba045.orlgmj (mgr.34412) 7330 : cluster [DBG] pgmap v4172: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:35.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:07:34 gibba015 bash[30343]: cluster 2021-03-10T16:07:33.011595+0000 mgr.gibba045.orlgmj (mgr.34412) 7330 : cluster [DBG] pgmap v4172: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:35.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:07:34 gibba045 bash[25517]: cluster 2021-03-10T16:07:33.011595+0000 mgr.gibba045.orlgmj (mgr.34412) 7330 : cluster [DBG] pgmap v4172: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:37.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:07:36 gibba015 bash[29377]: cluster 2021-03-10T16:07:35.013023+0000 mgr.gibba045.orlgmj (mgr.34412) 7331 : cluster [DBG] pgmap v4173: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:37.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:07:36 gibba015 bash[30343]: cluster 2021-03-10T16:07:35.013023+0000 mgr.gibba045.orlgmj (mgr.34412) 7331 : cluster [DBG] pgmap v4173: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:37.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:07:36 gibba045 bash[25517]: cluster 2021-03-10T16:07:35.013023+0000 mgr.gibba045.orlgmj (mgr.34412) 7331 : cluster [DBG] pgmap v4173: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:39.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:07:38 gibba015 bash[29377]: cluster 2021-03-10T16:07:37.014704+0000 mgr.gibba045.orlgmj (mgr.34412) 7332 : cluster [DBG] pgmap v4174: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:39.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:07:38 gibba015 bash[30343]: cluster 2021-03-10T16:07:37.014704+0000 mgr.gibba045.orlgmj (mgr.34412) 7332 : cluster [DBG] pgmap v4174: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:39.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:07:38 gibba045 bash[25517]: cluster 2021-03-10T16:07:37.014704+0000 mgr.gibba045.orlgmj (mgr.34412) 7332 : cluster [DBG] pgmap v4174: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:41.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:07:40 gibba015 bash[30343]: cluster 2021-03-10T16:07:39.015865+0000 mgr.gibba045.orlgmj (mgr.34412) 7333 : cluster [DBG] pgmap v4175: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:41.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:07:40 gibba015 bash[29377]: cluster 2021-03-10T16:07:39.015865+0000 mgr.gibba045.orlgmj (mgr.34412) 7333 : cluster [DBG] pgmap v4175: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:41.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:07:40 gibba045 bash[25517]: cluster 2021-03-10T16:07:39.015865+0000 mgr.gibba045.orlgmj (mgr.34412) 7333 : cluster [DBG] pgmap v4175: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:43.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:07:42 gibba015 bash[29377]: cluster 2021-03-10T16:07:41.017425+0000 mgr.gibba045.orlgmj (mgr.34412) 7334 : cluster [DBG] pgmap v4176: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:43.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:07:42 gibba015 bash[29377]: cephadm 2021-03-10T16:07:41.341773+0000 mgr.gibba045.orlgmj (mgr.34412) 7335 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:07:43.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:07:42 gibba015 bash[30343]: cluster 2021-03-10T16:07:41.017425+0000 mgr.gibba045.orlgmj (mgr.34412) 7334 : cluster [DBG] pgmap v4176: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:43.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:07:42 gibba015 bash[30343]: cephadm 2021-03-10T16:07:41.341773+0000 mgr.gibba045.orlgmj (mgr.34412) 7335 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:07:43.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:07:42 gibba045 bash[25517]: cluster 2021-03-10T16:07:41.017425+0000 mgr.gibba045.orlgmj (mgr.34412) 7334 : cluster [DBG] pgmap v4176: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:43.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:07:42 gibba045 bash[25517]: cephadm 2021-03-10T16:07:41.341773+0000 mgr.gibba045.orlgmj (mgr.34412) 7335 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:07:45.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:07:44 gibba015 bash[29377]: cluster 2021-03-10T16:07:43.018943+0000 mgr.gibba045.orlgmj (mgr.34412) 7336 : cluster [DBG] pgmap v4177: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:45.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:07:44 gibba015 bash[30343]: cluster 2021-03-10T16:07:43.018943+0000 mgr.gibba045.orlgmj (mgr.34412) 7336 : cluster [DBG] pgmap v4177: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:45.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:07:44 gibba045 bash[25517]: cluster 2021-03-10T16:07:43.018943+0000 mgr.gibba045.orlgmj (mgr.34412) 7336 : cluster [DBG] pgmap v4177: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:47.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:07:46 gibba015 bash[29377]: cluster 2021-03-10T16:07:45.020348+0000 mgr.gibba045.orlgmj (mgr.34412) 7337 : cluster [DBG] pgmap v4178: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:47.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:07:46 gibba015 bash[30343]: cluster 2021-03-10T16:07:45.020348+0000 mgr.gibba045.orlgmj (mgr.34412) 7337 : cluster [DBG] pgmap v4178: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:47.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:07:46 gibba045 bash[25517]: cluster 2021-03-10T16:07:45.020348+0000 mgr.gibba045.orlgmj (mgr.34412) 7337 : cluster [DBG] pgmap v4178: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:49.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:07:48 gibba015 bash[29377]: cluster 2021-03-10T16:07:47.021899+0000 mgr.gibba045.orlgmj (mgr.34412) 7338 : cluster [DBG] pgmap v4179: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:49.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:07:48 gibba015 bash[30343]: cluster 2021-03-10T16:07:47.021899+0000 mgr.gibba045.orlgmj (mgr.34412) 7338 : cluster [DBG] pgmap v4179: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:49.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:07:48 gibba045 bash[25517]: cluster 2021-03-10T16:07:47.021899+0000 mgr.gibba045.orlgmj (mgr.34412) 7338 : cluster [DBG] pgmap v4179: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:51.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:07:50 gibba015 bash[29377]: cluster 2021-03-10T16:07:49.023285+0000 mgr.gibba045.orlgmj (mgr.34412) 7339 : cluster [DBG] pgmap v4180: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:51.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:07:50 gibba015 bash[30343]: cluster 2021-03-10T16:07:49.023285+0000 mgr.gibba045.orlgmj (mgr.34412) 7339 : cluster [DBG] pgmap v4180: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:51.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:07:50 gibba045 bash[25517]: cluster 2021-03-10T16:07:49.023285+0000 mgr.gibba045.orlgmj (mgr.34412) 7339 : cluster [DBG] pgmap v4180: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:53.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:07:52 gibba015 bash[29377]: cluster 2021-03-10T16:07:51.025316+0000 mgr.gibba045.orlgmj (mgr.34412) 7340 : cluster [DBG] pgmap v4181: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:53.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:07:52 gibba015 bash[30343]: cluster 2021-03-10T16:07:51.025316+0000 mgr.gibba045.orlgmj (mgr.34412) 7340 : cluster [DBG] pgmap v4181: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:53.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:07:52 gibba045 bash[25517]: cluster 2021-03-10T16:07:51.025316+0000 mgr.gibba045.orlgmj (mgr.34412) 7340 : cluster [DBG] pgmap v4181: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:54.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:07:53 gibba015 bash[29377]: audit 2021-03-10T16:07:53.432472+0000 mon.c (mon.1) 2033 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:07:54.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:07:53 gibba015 bash[29377]: audit 2021-03-10T16:07:53.433217+0000 mon.c (mon.1) 2034 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:07:54.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:07:53 gibba015 bash[29377]: audit 2021-03-10T16:07:53.433750+0000 mon.a (mon.0) 1726 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:07:54.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:07:53 gibba015 bash[29377]: audit 2021-03-10T16:07:53.434246+0000 mon.c (mon.1) 2035 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T16:07:54.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:07:53 gibba015 bash[29377]: audit 2021-03-10T16:07:53.435634+0000 mon.c (mon.1) 2036 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:07:54.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:07:53 gibba015 bash[29377]: audit 2021-03-10T16:07:53.435657+0000 mon.a (mon.0) 1727 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:07:54.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:07:53 gibba015 bash[29377]: audit 2021-03-10T16:07:53.436866+0000 mon.c (mon.1) 2037 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:07:54.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:07:53 gibba015 bash[29377]: audit 2021-03-10T16:07:53.436926+0000 mon.a (mon.0) 1728 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T16:07:54.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:07:53 gibba015 bash[29377]: audit 2021-03-10T16:07:53.437168+0000 mon.c (mon.1) 2038 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:07:54.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:07:53 gibba015 bash[29377]: audit 2021-03-10T16:07:53.437391+0000 mon.a (mon.0) 1729 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:07:54.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:07:53 gibba015 bash[29377]: audit 2021-03-10T16:07:53.437747+0000 mon.a (mon.0) 1730 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:07:54.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:07:53 gibba015 bash[29377]: audit 2021-03-10T16:07:53.437947+0000 mon.a (mon.0) 1731 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:07:54.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:07:53 gibba015 bash[30343]: audit 2021-03-10T16:07:53.432472+0000 mon.c (mon.1) 2033 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:07:54.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:07:53 gibba015 bash[30343]: audit 2021-03-10T16:07:53.433217+0000 mon.c (mon.1) 2034 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:07:54.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:07:53 gibba015 bash[30343]: audit 2021-03-10T16:07:53.433750+0000 mon.a (mon.0) 1726 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:07:54.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:07:53 gibba015 bash[30343]: audit 2021-03-10T16:07:53.434246+0000 mon.c (mon.1) 2035 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T16:07:54.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:07:53 gibba015 bash[30343]: audit 2021-03-10T16:07:53.435634+0000 mon.c (mon.1) 2036 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:07:54.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:07:53 gibba015 bash[30343]: audit 2021-03-10T16:07:53.435657+0000 mon.a (mon.0) 1727 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:07:54.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:07:53 gibba015 bash[30343]: audit 2021-03-10T16:07:53.436866+0000 mon.c (mon.1) 2037 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:07:54.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:07:53 gibba015 bash[30343]: audit 2021-03-10T16:07:53.436926+0000 mon.a (mon.0) 1728 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T16:07:54.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:07:53 gibba015 bash[30343]: audit 2021-03-10T16:07:53.437168+0000 mon.c (mon.1) 2038 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:07:54.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:07:53 gibba015 bash[30343]: audit 2021-03-10T16:07:53.437391+0000 mon.a (mon.0) 1729 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:07:54.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:07:53 gibba015 bash[30343]: audit 2021-03-10T16:07:53.437747+0000 mon.a (mon.0) 1730 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:07:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:07:53 gibba015 bash[30343]: audit 2021-03-10T16:07:53.437947+0000 mon.a (mon.0) 1731 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:07:54.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:07:53 gibba045 bash[25517]: audit 2021-03-10T16:07:53.432472+0000 mon.c (mon.1) 2033 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:07:54.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:07:53 gibba045 bash[25517]: audit 2021-03-10T16:07:53.433217+0000 mon.c (mon.1) 2034 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:07:54.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:07:53 gibba045 bash[25517]: audit 2021-03-10T16:07:53.433750+0000 mon.a (mon.0) 1726 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:07:54.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:07:53 gibba045 bash[25517]: audit 2021-03-10T16:07:53.434246+0000 mon.c (mon.1) 2035 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T16:07:54.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:07:53 gibba045 bash[25517]: audit 2021-03-10T16:07:53.435634+0000 mon.c (mon.1) 2036 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:07:54.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:07:53 gibba045 bash[25517]: audit 2021-03-10T16:07:53.435657+0000 mon.a (mon.0) 1727 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:07:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:07:53 gibba045 bash[25517]: audit 2021-03-10T16:07:53.436866+0000 mon.c (mon.1) 2037 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:07:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:07:53 gibba045 bash[25517]: audit 2021-03-10T16:07:53.436926+0000 mon.a (mon.0) 1728 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T16:07:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:07:53 gibba045 bash[25517]: audit 2021-03-10T16:07:53.437168+0000 mon.c (mon.1) 2038 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:07:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:07:53 gibba045 bash[25517]: audit 2021-03-10T16:07:53.437391+0000 mon.a (mon.0) 1729 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:07:54.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:07:53 gibba045 bash[25517]: audit 2021-03-10T16:07:53.437747+0000 mon.a (mon.0) 1730 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:07:54.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:07:53 gibba045 bash[25517]: audit 2021-03-10T16:07:53.437947+0000 mon.a (mon.0) 1731 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:07:55.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:07:54 gibba015 bash[29377]: cluster 2021-03-10T16:07:53.027007+0000 mgr.gibba045.orlgmj (mgr.34412) 7341 : cluster [DBG] pgmap v4182: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:55.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:07:54 gibba015 bash[30343]: cluster 2021-03-10T16:07:53.027007+0000 mgr.gibba045.orlgmj (mgr.34412) 7341 : cluster [DBG] pgmap v4182: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:55.225 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:07:55.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:07:54 gibba045 bash[25517]: cluster 2021-03-10T16:07:53.027007+0000 mgr.gibba045.orlgmj (mgr.34412) 7341 : cluster [DBG] pgmap v4182: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:55.454 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:07:55.454 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 2m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:07:55.455 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 59s ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:07:55.455 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 59s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:07:55.455 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 59s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:07:55.455 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:07:55.455 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:07:55.456 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 59s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:07:55.456 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:07:55.456 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 2m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:07:55.456 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 59s ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:07:55.456 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:07:55.457 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:07:55.457 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:07:55.457 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:07:55.457 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 59s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:07:55.457 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 59s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:07:55.458 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 59s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:07:55.458 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 59s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:07:55.458 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 59s ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:07:55.458 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 59s ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:07:55.702 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:07:55.702 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:07:55.702 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:07:55.703 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:07:55.703 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:07:55.703 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:07:55.703 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:07:55.704 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:07:55.704 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:07:55.704 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:07:55.704 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:07:55.705 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:07:55.705 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:07:55.705 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:07:55.705 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:07:56.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:07:56 gibba015 bash[29377]: cluster 2021-03-10T16:07:55.028828+0000 mgr.gibba045.orlgmj (mgr.34412) 7342 : cluster [DBG] pgmap v4183: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:56.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:07:56 gibba015 bash[29377]: audit 2021-03-10T16:07:55.217895+0000 mgr.gibba045.orlgmj (mgr.34412) 7343 : audit [DBG] from='client.48984 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:07:56.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:07:56 gibba015 bash[29377]: audit 2021-03-10T16:07:55.444930+0000 mgr.gibba045.orlgmj (mgr.34412) 7344 : audit [DBG] from='client.58978 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:07:56.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:07:56 gibba015 bash[29377]: audit 2021-03-10T16:07:55.701553+0000 mon.c (mon.1) 2039 : audit [DBG] from='client.? 172.21.2.115:0/3151973636' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:07:56.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:07:56 gibba015 bash[29377]: audit 2021-03-10T16:07:56.355291+0000 mon.c (mon.1) 2040 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:07:56.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:07:56 gibba015 bash[30343]: cluster 2021-03-10T16:07:55.028828+0000 mgr.gibba045.orlgmj (mgr.34412) 7342 : cluster [DBG] pgmap v4183: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:56.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:07:56 gibba015 bash[30343]: audit 2021-03-10T16:07:55.217895+0000 mgr.gibba045.orlgmj (mgr.34412) 7343 : audit [DBG] from='client.48984 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:07:56.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:07:56 gibba015 bash[30343]: audit 2021-03-10T16:07:55.444930+0000 mgr.gibba045.orlgmj (mgr.34412) 7344 : audit [DBG] from='client.58978 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:07:56.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:07:56 gibba015 bash[30343]: audit 2021-03-10T16:07:55.701553+0000 mon.c (mon.1) 2039 : audit [DBG] from='client.? 172.21.2.115:0/3151973636' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:07:56.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:07:56 gibba015 bash[30343]: audit 2021-03-10T16:07:56.355291+0000 mon.c (mon.1) 2040 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:07:56.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:07:56 gibba045 bash[25517]: cluster 2021-03-10T16:07:55.028828+0000 mgr.gibba045.orlgmj (mgr.34412) 7342 : cluster [DBG] pgmap v4183: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:56.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:07:56 gibba045 bash[25517]: audit 2021-03-10T16:07:55.217895+0000 mgr.gibba045.orlgmj (mgr.34412) 7343 : audit [DBG] from='client.48984 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:07:56.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:07:56 gibba045 bash[25517]: audit 2021-03-10T16:07:55.444930+0000 mgr.gibba045.orlgmj (mgr.34412) 7344 : audit [DBG] from='client.58978 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:07:56.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:07:56 gibba045 bash[25517]: audit 2021-03-10T16:07:55.701553+0000 mon.c (mon.1) 2039 : audit [DBG] from='client.? 172.21.2.115:0/3151973636' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:07:56.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:07:56 gibba045 bash[25517]: audit 2021-03-10T16:07:56.355291+0000 mon.c (mon.1) 2040 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:07:57.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:07:57 gibba045 bash[25517]: cephadm 2021-03-10T16:07:56.359795+0000 mgr.gibba045.orlgmj (mgr.34412) 7345 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:07:57.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:07:57 gibba045 bash[25517]: cephadm 2021-03-10T16:07:56.360052+0000 mgr.gibba045.orlgmj (mgr.34412) 7346 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:07:57.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:07:57 gibba045 bash[25517]: audit 2021-03-10T16:07:56.546027+0000 mon.a (mon.0) 1732 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:07:57.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:07:57 gibba045 bash[25517]: audit 2021-03-10T16:07:56.549562+0000 mon.c (mon.1) 2041 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:07:57.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:07:57 gibba045 bash[25517]: cephadm 2021-03-10T16:07:56.551261+0000 mgr.gibba045.orlgmj (mgr.34412) 7347 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:07:57.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:07:57 gibba045 bash[25517]: audit 2021-03-10T16:07:56.551305+0000 mon.c (mon.1) 2042 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:07:57.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:07:57 gibba045 bash[25517]: audit 2021-03-10T16:07:56.552692+0000 mon.c (mon.1) 2043 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:07:57.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:07:57 gibba045 bash[25517]: cephadm 2021-03-10T16:07:56.553222+0000 mgr.gibba045.orlgmj (mgr.34412) 7348 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:07:57.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:07:57 gibba045 bash[25517]: audit 2021-03-10T16:07:56.553895+0000 mon.c (mon.1) 2044 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:07:57.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:07:57 gibba045 bash[25517]: cephadm 2021-03-10T16:07:56.554509+0000 mgr.gibba045.orlgmj (mgr.34412) 7349 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:07:57.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:07:57 gibba045 bash[25517]: cephadm 2021-03-10T16:07:56.554548+0000 mgr.gibba045.orlgmj (mgr.34412) 7350 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:07:57.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:07:57 gibba045 bash[25517]: cephadm 2021-03-10T16:07:56.555846+0000 mgr.gibba045.orlgmj (mgr.34412) 7351 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:07:57.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:07:57 gibba045 bash[25517]: cephadm 2021-03-10T16:07:56.555884+0000 mgr.gibba045.orlgmj (mgr.34412) 7352 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:07:57.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:07:57 gibba045 bash[25517]: audit 2021-03-10T16:07:56.557389+0000 mon.c (mon.1) 2045 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:07:57.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:07:57 gibba045 bash[25517]: cephadm 2021-03-10T16:07:56.557481+0000 mgr.gibba045.orlgmj (mgr.34412) 7353 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:07:57.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:07:57 gibba045 bash[25517]: audit 2021-03-10T16:07:56.558872+0000 mon.c (mon.1) 2046 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:07:57.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:07:57 gibba045 bash[25517]: cephadm 2021-03-10T16:07:56.559290+0000 mgr.gibba045.orlgmj (mgr.34412) 7354 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:07:57.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:07:57 gibba045 bash[25517]: cephadm 2021-03-10T16:07:56.559327+0000 mgr.gibba045.orlgmj (mgr.34412) 7355 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:07:57.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:07:57 gibba045 bash[25517]: cephadm 2021-03-10T16:07:56.560547+0000 mgr.gibba045.orlgmj (mgr.34412) 7356 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:07:57.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:07:57 gibba045 bash[25517]: cephadm 2021-03-10T16:07:56.560865+0000 mgr.gibba045.orlgmj (mgr.34412) 7357 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:07:57.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:07:57 gibba045 bash[25517]: cephadm 2021-03-10T16:07:56.562256+0000 mgr.gibba045.orlgmj (mgr.34412) 7358 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:07:57.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:07:57 gibba045 bash[25517]: cephadm 2021-03-10T16:07:56.562295+0000 mgr.gibba045.orlgmj (mgr.34412) 7359 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:07:57.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:07:57 gibba045 bash[25517]: cephadm 2021-03-10T16:07:56.562401+0000 mgr.gibba045.orlgmj (mgr.34412) 7360 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:07:57.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:07:57 gibba015 bash[29377]: cephadm 2021-03-10T16:07:56.359795+0000 mgr.gibba045.orlgmj (mgr.34412) 7345 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:07:57.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:07:57 gibba015 bash[29377]: cephadm 2021-03-10T16:07:56.360052+0000 mgr.gibba045.orlgmj (mgr.34412) 7346 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:07:57.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:07:57 gibba015 bash[29377]: audit 2021-03-10T16:07:56.546027+0000 mon.a (mon.0) 1732 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:07:57.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:07:57 gibba015 bash[29377]: audit 2021-03-10T16:07:56.549562+0000 mon.c (mon.1) 2041 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:07:57.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:07:57 gibba015 bash[29377]: cephadm 2021-03-10T16:07:56.551261+0000 mgr.gibba045.orlgmj (mgr.34412) 7347 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:07:57.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:07:57 gibba015 bash[29377]: audit 2021-03-10T16:07:56.551305+0000 mon.c (mon.1) 2042 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:07:57.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:07:57 gibba015 bash[29377]: audit 2021-03-10T16:07:56.552692+0000 mon.c (mon.1) 2043 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:07:57.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:07:57 gibba015 bash[29377]: cephadm 2021-03-10T16:07:56.553222+0000 mgr.gibba045.orlgmj (mgr.34412) 7348 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:07:57.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:07:57 gibba015 bash[29377]: audit 2021-03-10T16:07:56.553895+0000 mon.c (mon.1) 2044 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:07:57.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:07:57 gibba015 bash[29377]: cephadm 2021-03-10T16:07:56.554509+0000 mgr.gibba045.orlgmj (mgr.34412) 7349 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:07:57.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:07:57 gibba015 bash[29377]: cephadm 2021-03-10T16:07:56.554548+0000 mgr.gibba045.orlgmj (mgr.34412) 7350 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:07:57.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:07:57 gibba015 bash[29377]: cephadm 2021-03-10T16:07:56.555846+0000 mgr.gibba045.orlgmj (mgr.34412) 7351 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:07:57.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:07:57 gibba015 bash[29377]: cephadm 2021-03-10T16:07:56.555884+0000 mgr.gibba045.orlgmj (mgr.34412) 7352 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:07:57.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:07:57 gibba015 bash[29377]: audit 2021-03-10T16:07:56.557389+0000 mon.c (mon.1) 2045 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:07:57.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:07:57 gibba015 bash[29377]: cephadm 2021-03-10T16:07:56.557481+0000 mgr.gibba045.orlgmj (mgr.34412) 7353 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:07:57.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:07:57 gibba015 bash[29377]: audit 2021-03-10T16:07:56.558872+0000 mon.c (mon.1) 2046 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:07:57.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:07:57 gibba015 bash[29377]: cephadm 2021-03-10T16:07:56.559290+0000 mgr.gibba045.orlgmj (mgr.34412) 7354 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:07:57.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:07:57 gibba015 bash[29377]: cephadm 2021-03-10T16:07:56.559327+0000 mgr.gibba045.orlgmj (mgr.34412) 7355 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:07:57.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:07:57 gibba015 bash[29377]: cephadm 2021-03-10T16:07:56.560547+0000 mgr.gibba045.orlgmj (mgr.34412) 7356 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:07:57.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:07:57 gibba015 bash[29377]: cephadm 2021-03-10T16:07:56.560865+0000 mgr.gibba045.orlgmj (mgr.34412) 7357 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:07:57.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:07:57 gibba015 bash[29377]: cephadm 2021-03-10T16:07:56.562256+0000 mgr.gibba045.orlgmj (mgr.34412) 7358 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:07:57.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:07:57 gibba015 bash[29377]: cephadm 2021-03-10T16:07:56.562295+0000 mgr.gibba045.orlgmj (mgr.34412) 7359 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:07:57.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:07:57 gibba015 bash[29377]: cephadm 2021-03-10T16:07:56.562401+0000 mgr.gibba045.orlgmj (mgr.34412) 7360 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:07:57.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:07:57 gibba015 bash[30343]: cephadm 2021-03-10T16:07:56.359795+0000 mgr.gibba045.orlgmj (mgr.34412) 7345 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:07:57.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:07:57 gibba015 bash[30343]: cephadm 2021-03-10T16:07:56.360052+0000 mgr.gibba045.orlgmj (mgr.34412) 7346 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:07:57.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:07:57 gibba015 bash[30343]: audit 2021-03-10T16:07:56.546027+0000 mon.a (mon.0) 1732 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:07:57.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:07:57 gibba015 bash[30343]: audit 2021-03-10T16:07:56.549562+0000 mon.c (mon.1) 2041 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:07:57.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:07:57 gibba015 bash[30343]: cephadm 2021-03-10T16:07:56.551261+0000 mgr.gibba045.orlgmj (mgr.34412) 7347 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:07:57.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:07:57 gibba015 bash[30343]: audit 2021-03-10T16:07:56.551305+0000 mon.c (mon.1) 2042 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:07:57.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:07:57 gibba015 bash[30343]: audit 2021-03-10T16:07:56.552692+0000 mon.c (mon.1) 2043 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:07:57.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:07:57 gibba015 bash[30343]: cephadm 2021-03-10T16:07:56.553222+0000 mgr.gibba045.orlgmj (mgr.34412) 7348 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:07:57.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:07:57 gibba015 bash[30343]: audit 2021-03-10T16:07:56.553895+0000 mon.c (mon.1) 2044 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:07:57.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:07:57 gibba015 bash[30343]: cephadm 2021-03-10T16:07:56.554509+0000 mgr.gibba045.orlgmj (mgr.34412) 7349 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:07:57.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:07:57 gibba015 bash[30343]: cephadm 2021-03-10T16:07:56.554548+0000 mgr.gibba045.orlgmj (mgr.34412) 7350 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:07:57.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:07:57 gibba015 bash[30343]: cephadm 2021-03-10T16:07:56.555846+0000 mgr.gibba045.orlgmj (mgr.34412) 7351 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:07:57.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:07:57 gibba015 bash[30343]: cephadm 2021-03-10T16:07:56.555884+0000 mgr.gibba045.orlgmj (mgr.34412) 7352 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:07:57.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:07:57 gibba015 bash[30343]: audit 2021-03-10T16:07:56.557389+0000 mon.c (mon.1) 2045 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:07:57.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:07:57 gibba015 bash[30343]: cephadm 2021-03-10T16:07:56.557481+0000 mgr.gibba045.orlgmj (mgr.34412) 7353 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:07:57.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:07:57 gibba015 bash[30343]: audit 2021-03-10T16:07:56.558872+0000 mon.c (mon.1) 2046 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:07:57.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:07:57 gibba015 bash[30343]: cephadm 2021-03-10T16:07:56.559290+0000 mgr.gibba045.orlgmj (mgr.34412) 7354 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:07:57.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:07:57 gibba015 bash[30343]: cephadm 2021-03-10T16:07:56.559327+0000 mgr.gibba045.orlgmj (mgr.34412) 7355 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:07:57.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:07:57 gibba015 bash[30343]: cephadm 2021-03-10T16:07:56.560547+0000 mgr.gibba045.orlgmj (mgr.34412) 7356 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:07:57.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:07:57 gibba015 bash[30343]: cephadm 2021-03-10T16:07:56.560865+0000 mgr.gibba045.orlgmj (mgr.34412) 7357 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:07:57.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:07:57 gibba015 bash[30343]: cephadm 2021-03-10T16:07:56.562256+0000 mgr.gibba045.orlgmj (mgr.34412) 7358 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:07:57.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:07:57 gibba015 bash[30343]: cephadm 2021-03-10T16:07:56.562295+0000 mgr.gibba045.orlgmj (mgr.34412) 7359 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:07:57.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:07:57 gibba015 bash[30343]: cephadm 2021-03-10T16:07:56.562401+0000 mgr.gibba045.orlgmj (mgr.34412) 7360 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:07:58.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:07:58 gibba015 bash[29377]: cluster 2021-03-10T16:07:57.030368+0000 mgr.gibba045.orlgmj (mgr.34412) 7361 : cluster [DBG] pgmap v4184: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:58.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:07:58 gibba015 bash[30343]: cluster 2021-03-10T16:07:57.030368+0000 mgr.gibba045.orlgmj (mgr.34412) 7361 : cluster [DBG] pgmap v4184: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:59.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:07:58 gibba045 bash[25517]: cluster 2021-03-10T16:07:57.030368+0000 mgr.gibba045.orlgmj (mgr.34412) 7361 : cluster [DBG] pgmap v4184: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:00.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:08:00 gibba015 bash[29377]: cluster 2021-03-10T16:07:59.031685+0000 mgr.gibba045.orlgmj (mgr.34412) 7362 : cluster [DBG] pgmap v4185: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:00.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:08:00 gibba015 bash[30343]: cluster 2021-03-10T16:07:59.031685+0000 mgr.gibba045.orlgmj (mgr.34412) 7362 : cluster [DBG] pgmap v4185: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:01.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:08:00 gibba045 bash[25517]: cluster 2021-03-10T16:07:59.031685+0000 mgr.gibba045.orlgmj (mgr.34412) 7362 : cluster [DBG] pgmap v4185: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:02.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:08:02 gibba015 bash[29377]: cluster 2021-03-10T16:08:01.033275+0000 mgr.gibba045.orlgmj (mgr.34412) 7363 : cluster [DBG] pgmap v4186: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:02.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:08:02 gibba015 bash[30343]: cluster 2021-03-10T16:08:01.033275+0000 mgr.gibba045.orlgmj (mgr.34412) 7363 : cluster [DBG] pgmap v4186: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:03.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:08:02 gibba045 bash[25517]: cluster 2021-03-10T16:08:01.033275+0000 mgr.gibba045.orlgmj (mgr.34412) 7363 : cluster [DBG] pgmap v4186: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:04.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:08:04 gibba015 bash[29377]: cluster 2021-03-10T16:08:03.034644+0000 mgr.gibba045.orlgmj (mgr.34412) 7364 : cluster [DBG] pgmap v4187: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:04.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:08:04 gibba015 bash[30343]: cluster 2021-03-10T16:08:03.034644+0000 mgr.gibba045.orlgmj (mgr.34412) 7364 : cluster [DBG] pgmap v4187: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:05.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:08:04 gibba045 bash[25517]: cluster 2021-03-10T16:08:03.034644+0000 mgr.gibba045.orlgmj (mgr.34412) 7364 : cluster [DBG] pgmap v4187: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:06.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:08:06 gibba015 bash[29377]: cluster 2021-03-10T16:08:05.036021+0000 mgr.gibba045.orlgmj (mgr.34412) 7365 : cluster [DBG] pgmap v4188: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:06.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:08:06 gibba015 bash[30343]: cluster 2021-03-10T16:08:05.036021+0000 mgr.gibba045.orlgmj (mgr.34412) 7365 : cluster [DBG] pgmap v4188: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:07.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:08:06 gibba045 bash[25517]: cluster 2021-03-10T16:08:05.036021+0000 mgr.gibba045.orlgmj (mgr.34412) 7365 : cluster [DBG] pgmap v4188: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:08.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:08:08 gibba015 bash[29377]: cluster 2021-03-10T16:08:07.037564+0000 mgr.gibba045.orlgmj (mgr.34412) 7366 : cluster [DBG] pgmap v4189: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:08.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:08:08 gibba015 bash[30343]: cluster 2021-03-10T16:08:07.037564+0000 mgr.gibba045.orlgmj (mgr.34412) 7366 : cluster [DBG] pgmap v4189: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:09.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:08:08 gibba045 bash[25517]: cluster 2021-03-10T16:08:07.037564+0000 mgr.gibba045.orlgmj (mgr.34412) 7366 : cluster [DBG] pgmap v4189: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:10.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:08:10 gibba015 bash[29377]: cluster 2021-03-10T16:08:09.038829+0000 mgr.gibba045.orlgmj (mgr.34412) 7367 : cluster [DBG] pgmap v4190: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:10.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:08:10 gibba015 bash[30343]: cluster 2021-03-10T16:08:09.038829+0000 mgr.gibba045.orlgmj (mgr.34412) 7367 : cluster [DBG] pgmap v4190: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:11.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:08:10 gibba045 bash[25517]: cluster 2021-03-10T16:08:09.038829+0000 mgr.gibba045.orlgmj (mgr.34412) 7367 : cluster [DBG] pgmap v4190: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:12.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:08:12 gibba015 bash[29377]: cluster 2021-03-10T16:08:11.040622+0000 mgr.gibba045.orlgmj (mgr.34412) 7368 : cluster [DBG] pgmap v4191: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:12.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:08:12 gibba015 bash[29377]: cephadm 2021-03-10T16:08:11.578408+0000 mgr.gibba045.orlgmj (mgr.34412) 7369 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:08:12.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:08:12 gibba015 bash[30343]: cluster 2021-03-10T16:08:11.040622+0000 mgr.gibba045.orlgmj (mgr.34412) 7368 : cluster [DBG] pgmap v4191: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:12.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:08:12 gibba015 bash[30343]: cephadm 2021-03-10T16:08:11.578408+0000 mgr.gibba045.orlgmj (mgr.34412) 7369 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:08:13.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:08:12 gibba045 bash[25517]: cluster 2021-03-10T16:08:11.040622+0000 mgr.gibba045.orlgmj (mgr.34412) 7368 : cluster [DBG] pgmap v4191: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:13.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:08:12 gibba045 bash[25517]: cephadm 2021-03-10T16:08:11.578408+0000 mgr.gibba045.orlgmj (mgr.34412) 7369 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:08:14.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:08:14 gibba015 bash[29377]: cluster 2021-03-10T16:08:13.042043+0000 mgr.gibba045.orlgmj (mgr.34412) 7370 : cluster [DBG] pgmap v4192: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:14.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:08:14 gibba015 bash[30343]: cluster 2021-03-10T16:08:13.042043+0000 mgr.gibba045.orlgmj (mgr.34412) 7370 : cluster [DBG] pgmap v4192: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:15.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:08:14 gibba045 bash[25517]: cluster 2021-03-10T16:08:13.042043+0000 mgr.gibba045.orlgmj (mgr.34412) 7370 : cluster [DBG] pgmap v4192: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:16.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:08:16 gibba015 bash[29377]: cluster 2021-03-10T16:08:15.043605+0000 mgr.gibba045.orlgmj (mgr.34412) 7371 : cluster [DBG] pgmap v4193: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:16.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:08:16 gibba015 bash[30343]: cluster 2021-03-10T16:08:15.043605+0000 mgr.gibba045.orlgmj (mgr.34412) 7371 : cluster [DBG] pgmap v4193: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:17.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:08:16 gibba045 bash[25517]: cluster 2021-03-10T16:08:15.043605+0000 mgr.gibba045.orlgmj (mgr.34412) 7371 : cluster [DBG] pgmap v4193: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:18.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:08:18 gibba015 bash[29377]: cluster 2021-03-10T16:08:17.045389+0000 mgr.gibba045.orlgmj (mgr.34412) 7372 : cluster [DBG] pgmap v4194: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:18.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:08:18 gibba015 bash[30343]: cluster 2021-03-10T16:08:17.045389+0000 mgr.gibba045.orlgmj (mgr.34412) 7372 : cluster [DBG] pgmap v4194: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:19.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:08:18 gibba045 bash[25517]: cluster 2021-03-10T16:08:17.045389+0000 mgr.gibba045.orlgmj (mgr.34412) 7372 : cluster [DBG] pgmap v4194: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:20.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:08:20 gibba015 bash[29377]: cluster 2021-03-10T16:08:19.046620+0000 mgr.gibba045.orlgmj (mgr.34412) 7373 : cluster [DBG] pgmap v4195: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:20.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:08:20 gibba015 bash[30343]: cluster 2021-03-10T16:08:19.046620+0000 mgr.gibba045.orlgmj (mgr.34412) 7373 : cluster [DBG] pgmap v4195: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:21.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:08:20 gibba045 bash[25517]: cluster 2021-03-10T16:08:19.046620+0000 mgr.gibba045.orlgmj (mgr.34412) 7373 : cluster [DBG] pgmap v4195: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:22.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:08:22 gibba015 bash[29377]: cluster 2021-03-10T16:08:21.048258+0000 mgr.gibba045.orlgmj (mgr.34412) 7374 : cluster [DBG] pgmap v4196: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:22.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:08:22 gibba015 bash[30343]: cluster 2021-03-10T16:08:21.048258+0000 mgr.gibba045.orlgmj (mgr.34412) 7374 : cluster [DBG] pgmap v4196: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:23.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:08:22 gibba045 bash[25517]: cluster 2021-03-10T16:08:21.048258+0000 mgr.gibba045.orlgmj (mgr.34412) 7374 : cluster [DBG] pgmap v4196: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:24.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:08:24 gibba015 bash[29377]: cluster 2021-03-10T16:08:23.049925+0000 mgr.gibba045.orlgmj (mgr.34412) 7375 : cluster [DBG] pgmap v4197: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:24.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:08:24 gibba015 bash[30343]: cluster 2021-03-10T16:08:23.049925+0000 mgr.gibba045.orlgmj (mgr.34412) 7375 : cluster [DBG] pgmap v4197: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:25.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:08:24 gibba045 bash[25517]: cluster 2021-03-10T16:08:23.049925+0000 mgr.gibba045.orlgmj (mgr.34412) 7375 : cluster [DBG] pgmap v4197: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:25.943 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:08:26.177 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:08:26.177 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 2m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:08:26.177 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 90s ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:08:26.177 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 90s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:08:26.178 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 90s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:08:26.178 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:08:26.178 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:08:26.178 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 90s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:08:26.179 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:08:26.179 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 2m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:08:26.179 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 90s ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:08:26.179 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:08:26.179 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:08:26.180 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:08:26.180 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:08:26.180 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 90s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:08:26.180 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 90s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:08:26.181 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 90s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:08:26.181 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 90s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:08:26.181 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 90s ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:08:26.181 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 90s ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:08:26.424 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:08:26.424 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:08:26.425 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:08:26.425 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:08:26.425 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:08:26.425 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:08:26.426 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:08:26.426 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:08:26.426 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:08:26.426 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:08:26.427 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:08:26.427 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:08:26.427 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:08:26.427 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:08:26.428 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:08:26.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:08:26 gibba015 bash[29377]: cluster 2021-03-10T16:08:25.051551+0000 mgr.gibba045.orlgmj (mgr.34412) 7376 : cluster [DBG] pgmap v4198: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:26.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:08:26 gibba015 bash[29377]: audit 2021-03-10T16:08:25.936171+0000 mgr.gibba045.orlgmj (mgr.34412) 7377 : audit [DBG] from='client.58990 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:08:26.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:08:26 gibba015 bash[29377]: audit 2021-03-10T16:08:26.423713+0000 mon.a (mon.0) 1733 : audit [DBG] from='client.? 172.21.2.115:0/3732234938' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:08:26.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:08:26 gibba015 bash[30343]: cluster 2021-03-10T16:08:25.051551+0000 mgr.gibba045.orlgmj (mgr.34412) 7376 : cluster [DBG] pgmap v4198: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:26.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:08:26 gibba015 bash[30343]: audit 2021-03-10T16:08:25.936171+0000 mgr.gibba045.orlgmj (mgr.34412) 7377 : audit [DBG] from='client.58990 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:08:26.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:08:26 gibba015 bash[30343]: audit 2021-03-10T16:08:26.423713+0000 mon.a (mon.0) 1733 : audit [DBG] from='client.? 172.21.2.115:0/3732234938' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:08:27.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:08:26 gibba045 bash[25517]: cluster 2021-03-10T16:08:25.051551+0000 mgr.gibba045.orlgmj (mgr.34412) 7376 : cluster [DBG] pgmap v4198: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:27.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:08:26 gibba045 bash[25517]: audit 2021-03-10T16:08:25.936171+0000 mgr.gibba045.orlgmj (mgr.34412) 7377 : audit [DBG] from='client.58990 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:08:27.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:08:26 gibba045 bash[25517]: audit 2021-03-10T16:08:26.423713+0000 mon.a (mon.0) 1733 : audit [DBG] from='client.? 172.21.2.115:0/3732234938' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:08:27.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:08:27 gibba015 bash[29377]: audit 2021-03-10T16:08:26.166069+0000 mgr.gibba045.orlgmj (mgr.34412) 7378 : audit [DBG] from='client.49008 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:08:27.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:08:27 gibba015 bash[29377]: cephadm 2021-03-10T16:08:26.594441+0000 mgr.gibba045.orlgmj (mgr.34412) 7379 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:08:27.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:08:27 gibba015 bash[30343]: audit 2021-03-10T16:08:26.166069+0000 mgr.gibba045.orlgmj (mgr.34412) 7378 : audit [DBG] from='client.49008 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:08:27.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:08:27 gibba015 bash[30343]: cephadm 2021-03-10T16:08:26.594441+0000 mgr.gibba045.orlgmj (mgr.34412) 7379 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:08:28.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:08:27 gibba045 bash[25517]: audit 2021-03-10T16:08:26.166069+0000 mgr.gibba045.orlgmj (mgr.34412) 7378 : audit [DBG] from='client.49008 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:08:28.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:08:27 gibba045 bash[25517]: cephadm 2021-03-10T16:08:26.594441+0000 mgr.gibba045.orlgmj (mgr.34412) 7379 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:08:28.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:08:28 gibba015 bash[29377]: cluster 2021-03-10T16:08:27.053256+0000 mgr.gibba045.orlgmj (mgr.34412) 7380 : cluster [DBG] pgmap v4199: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:28.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:08:28 gibba015 bash[30343]: cluster 2021-03-10T16:08:27.053256+0000 mgr.gibba045.orlgmj (mgr.34412) 7380 : cluster [DBG] pgmap v4199: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:29.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:08:28 gibba045 bash[25517]: cluster 2021-03-10T16:08:27.053256+0000 mgr.gibba045.orlgmj (mgr.34412) 7380 : cluster [DBG] pgmap v4199: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:30.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:08:30 gibba015 bash[29377]: cluster 2021-03-10T16:08:29.054516+0000 mgr.gibba045.orlgmj (mgr.34412) 7381 : cluster [DBG] pgmap v4200: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:30.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:08:30 gibba015 bash[30343]: cluster 2021-03-10T16:08:29.054516+0000 mgr.gibba045.orlgmj (mgr.34412) 7381 : cluster [DBG] pgmap v4200: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:31.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:08:30 gibba045 bash[25517]: cluster 2021-03-10T16:08:29.054516+0000 mgr.gibba045.orlgmj (mgr.34412) 7381 : cluster [DBG] pgmap v4200: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:33.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:08:32 gibba045 bash[25517]: cluster 2021-03-10T16:08:31.056160+0000 mgr.gibba045.orlgmj (mgr.34412) 7382 : cluster [DBG] pgmap v4201: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:33.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:08:32 gibba015 bash[29377]: cluster 2021-03-10T16:08:31.056160+0000 mgr.gibba045.orlgmj (mgr.34412) 7382 : cluster [DBG] pgmap v4201: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:33.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:08:32 gibba015 bash[30343]: cluster 2021-03-10T16:08:31.056160+0000 mgr.gibba045.orlgmj (mgr.34412) 7382 : cluster [DBG] pgmap v4201: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:35.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:08:34 gibba045 bash[25517]: cluster 2021-03-10T16:08:33.057625+0000 mgr.gibba045.orlgmj (mgr.34412) 7383 : cluster [DBG] pgmap v4202: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:35.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:08:34 gibba015 bash[29377]: cluster 2021-03-10T16:08:33.057625+0000 mgr.gibba045.orlgmj (mgr.34412) 7383 : cluster [DBG] pgmap v4202: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:35.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:08:34 gibba015 bash[30343]: cluster 2021-03-10T16:08:33.057625+0000 mgr.gibba045.orlgmj (mgr.34412) 7383 : cluster [DBG] pgmap v4202: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:37.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:08:36 gibba045 bash[25517]: cluster 2021-03-10T16:08:35.059149+0000 mgr.gibba045.orlgmj (mgr.34412) 7384 : cluster [DBG] pgmap v4203: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:37.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:08:36 gibba015 bash[29377]: cluster 2021-03-10T16:08:35.059149+0000 mgr.gibba045.orlgmj (mgr.34412) 7384 : cluster [DBG] pgmap v4203: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:37.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:08:36 gibba015 bash[30343]: cluster 2021-03-10T16:08:35.059149+0000 mgr.gibba045.orlgmj (mgr.34412) 7384 : cluster [DBG] pgmap v4203: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:39.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:08:38 gibba045 bash[25517]: cluster 2021-03-10T16:08:37.060842+0000 mgr.gibba045.orlgmj (mgr.34412) 7385 : cluster [DBG] pgmap v4204: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:39.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:08:38 gibba015 bash[29377]: cluster 2021-03-10T16:08:37.060842+0000 mgr.gibba045.orlgmj (mgr.34412) 7385 : cluster [DBG] pgmap v4204: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:39.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:08:38 gibba015 bash[30343]: cluster 2021-03-10T16:08:37.060842+0000 mgr.gibba045.orlgmj (mgr.34412) 7385 : cluster [DBG] pgmap v4204: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:41.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:08:40 gibba045 bash[25517]: cluster 2021-03-10T16:08:39.062023+0000 mgr.gibba045.orlgmj (mgr.34412) 7386 : cluster [DBG] pgmap v4205: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:41.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:08:40 gibba015 bash[29377]: cluster 2021-03-10T16:08:39.062023+0000 mgr.gibba045.orlgmj (mgr.34412) 7386 : cluster [DBG] pgmap v4205: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:41.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:08:40 gibba015 bash[30343]: cluster 2021-03-10T16:08:39.062023+0000 mgr.gibba045.orlgmj (mgr.34412) 7386 : cluster [DBG] pgmap v4205: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:43.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:08:42 gibba045 bash[25517]: cluster 2021-03-10T16:08:41.063557+0000 mgr.gibba045.orlgmj (mgr.34412) 7387 : cluster [DBG] pgmap v4206: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:43.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:08:42 gibba045 bash[25517]: cephadm 2021-03-10T16:08:41.610190+0000 mgr.gibba045.orlgmj (mgr.34412) 7388 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:08:43.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:08:42 gibba015 bash[29377]: cluster 2021-03-10T16:08:41.063557+0000 mgr.gibba045.orlgmj (mgr.34412) 7387 : cluster [DBG] pgmap v4206: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:43.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:08:42 gibba015 bash[29377]: cephadm 2021-03-10T16:08:41.610190+0000 mgr.gibba045.orlgmj (mgr.34412) 7388 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:08:43.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:08:42 gibba015 bash[30343]: cluster 2021-03-10T16:08:41.063557+0000 mgr.gibba045.orlgmj (mgr.34412) 7387 : cluster [DBG] pgmap v4206: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:43.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:08:42 gibba015 bash[30343]: cephadm 2021-03-10T16:08:41.610190+0000 mgr.gibba045.orlgmj (mgr.34412) 7388 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:08:45.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:08:44 gibba045 bash[25517]: cluster 2021-03-10T16:08:43.065140+0000 mgr.gibba045.orlgmj (mgr.34412) 7389 : cluster [DBG] pgmap v4207: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:45.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:08:44 gibba015 bash[29377]: cluster 2021-03-10T16:08:43.065140+0000 mgr.gibba045.orlgmj (mgr.34412) 7389 : cluster [DBG] pgmap v4207: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:45.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:08:44 gibba015 bash[30343]: cluster 2021-03-10T16:08:43.065140+0000 mgr.gibba045.orlgmj (mgr.34412) 7389 : cluster [DBG] pgmap v4207: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:47.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:08:46 gibba045 bash[25517]: cluster 2021-03-10T16:08:45.066592+0000 mgr.gibba045.orlgmj (mgr.34412) 7390 : cluster [DBG] pgmap v4208: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:47.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:08:46 gibba015 bash[29377]: cluster 2021-03-10T16:08:45.066592+0000 mgr.gibba045.orlgmj (mgr.34412) 7390 : cluster [DBG] pgmap v4208: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:47.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:08:46 gibba015 bash[30343]: cluster 2021-03-10T16:08:45.066592+0000 mgr.gibba045.orlgmj (mgr.34412) 7390 : cluster [DBG] pgmap v4208: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:49.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:08:48 gibba045 bash[25517]: cluster 2021-03-10T16:08:47.068281+0000 mgr.gibba045.orlgmj (mgr.34412) 7391 : cluster [DBG] pgmap v4209: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:49.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:08:48 gibba015 bash[29377]: cluster 2021-03-10T16:08:47.068281+0000 mgr.gibba045.orlgmj (mgr.34412) 7391 : cluster [DBG] pgmap v4209: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:49.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:08:48 gibba015 bash[30343]: cluster 2021-03-10T16:08:47.068281+0000 mgr.gibba045.orlgmj (mgr.34412) 7391 : cluster [DBG] pgmap v4209: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:51.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:08:50 gibba015 bash[29377]: cluster 2021-03-10T16:08:49.069521+0000 mgr.gibba045.orlgmj (mgr.34412) 7392 : cluster [DBG] pgmap v4210: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:51.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:08:50 gibba015 bash[30343]: cluster 2021-03-10T16:08:49.069521+0000 mgr.gibba045.orlgmj (mgr.34412) 7392 : cluster [DBG] pgmap v4210: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:51.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:08:50 gibba045 bash[25517]: cluster 2021-03-10T16:08:49.069521+0000 mgr.gibba045.orlgmj (mgr.34412) 7392 : cluster [DBG] pgmap v4210: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:53.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:08:52 gibba015 bash[29377]: cluster 2021-03-10T16:08:51.071349+0000 mgr.gibba045.orlgmj (mgr.34412) 7393 : cluster [DBG] pgmap v4211: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:53.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:08:52 gibba015 bash[30343]: cluster 2021-03-10T16:08:51.071349+0000 mgr.gibba045.orlgmj (mgr.34412) 7393 : cluster [DBG] pgmap v4211: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:53.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:08:52 gibba045 bash[25517]: cluster 2021-03-10T16:08:51.071349+0000 mgr.gibba045.orlgmj (mgr.34412) 7393 : cluster [DBG] pgmap v4211: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:54.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:08:53 gibba015 bash[29377]: audit 2021-03-10T16:08:53.439673+0000 mon.c (mon.1) 2047 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:08:54.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:08:53 gibba015 bash[29377]: audit 2021-03-10T16:08:53.440359+0000 mon.c (mon.1) 2048 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:08:54.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:08:53 gibba015 bash[29377]: audit 2021-03-10T16:08:53.440888+0000 mon.a (mon.0) 1734 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:08:54.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:08:53 gibba015 bash[29377]: audit 2021-03-10T16:08:53.441026+0000 mon.c (mon.1) 2049 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T16:08:54.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:08:53 gibba015 bash[29377]: audit 2021-03-10T16:08:53.441804+0000 mon.c (mon.1) 2050 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:08:54.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:08:53 gibba015 bash[29377]: audit 2021-03-10T16:08:53.442681+0000 mon.c (mon.1) 2051 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:08:54.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:08:53 gibba015 bash[29377]: audit 2021-03-10T16:08:53.443033+0000 mon.a (mon.0) 1735 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:08:54.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:08:53 gibba015 bash[29377]: audit 2021-03-10T16:08:53.443420+0000 mon.c (mon.1) 2052 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T16:08:54.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:08:53 gibba015 bash[29377]: audit 2021-03-10T16:08:53.444675+0000 mon.a (mon.0) 1736 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T16:08:54.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:08:53 gibba015 bash[29377]: audit 2021-03-10T16:08:53.444876+0000 mon.a (mon.0) 1737 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:08:54.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:08:53 gibba015 bash[29377]: audit 2021-03-10T16:08:53.445044+0000 mon.a (mon.0) 1738 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:08:54.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:08:53 gibba015 bash[29377]: audit 2021-03-10T16:08:53.445247+0000 mon.a (mon.0) 1739 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T16:08:54.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:08:53 gibba015 bash[30343]: audit 2021-03-10T16:08:53.439673+0000 mon.c (mon.1) 2047 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:08:54.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:08:53 gibba015 bash[30343]: audit 2021-03-10T16:08:53.440359+0000 mon.c (mon.1) 2048 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:08:54.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:08:53 gibba015 bash[30343]: audit 2021-03-10T16:08:53.440888+0000 mon.a (mon.0) 1734 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:08:54.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:08:53 gibba015 bash[30343]: audit 2021-03-10T16:08:53.441026+0000 mon.c (mon.1) 2049 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T16:08:54.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:08:53 gibba015 bash[30343]: audit 2021-03-10T16:08:53.441804+0000 mon.c (mon.1) 2050 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:08:54.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:08:53 gibba015 bash[30343]: audit 2021-03-10T16:08:53.442681+0000 mon.c (mon.1) 2051 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:08:54.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:08:53 gibba015 bash[30343]: audit 2021-03-10T16:08:53.443033+0000 mon.a (mon.0) 1735 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:08:54.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:08:53 gibba015 bash[30343]: audit 2021-03-10T16:08:53.443420+0000 mon.c (mon.1) 2052 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T16:08:54.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:08:53 gibba015 bash[30343]: audit 2021-03-10T16:08:53.444675+0000 mon.a (mon.0) 1736 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T16:08:54.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:08:53 gibba015 bash[30343]: audit 2021-03-10T16:08:53.444876+0000 mon.a (mon.0) 1737 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:08:54.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:08:53 gibba015 bash[30343]: audit 2021-03-10T16:08:53.445044+0000 mon.a (mon.0) 1738 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:08:54.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:08:53 gibba015 bash[30343]: audit 2021-03-10T16:08:53.445247+0000 mon.a (mon.0) 1739 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T16:08:54.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:08:53 gibba045 bash[25517]: audit 2021-03-10T16:08:53.439673+0000 mon.c (mon.1) 2047 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:08:54.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:08:53 gibba045 bash[25517]: audit 2021-03-10T16:08:53.440359+0000 mon.c (mon.1) 2048 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:08:54.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:08:53 gibba045 bash[25517]: audit 2021-03-10T16:08:53.440888+0000 mon.a (mon.0) 1734 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:08:54.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:08:53 gibba045 bash[25517]: audit 2021-03-10T16:08:53.441026+0000 mon.c (mon.1) 2049 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T16:08:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:08:53 gibba045 bash[25517]: audit 2021-03-10T16:08:53.441804+0000 mon.c (mon.1) 2050 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:08:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:08:53 gibba045 bash[25517]: audit 2021-03-10T16:08:53.442681+0000 mon.c (mon.1) 2051 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:08:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:08:53 gibba045 bash[25517]: audit 2021-03-10T16:08:53.443033+0000 mon.a (mon.0) 1735 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:08:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:08:53 gibba045 bash[25517]: audit 2021-03-10T16:08:53.443420+0000 mon.c (mon.1) 2052 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T16:08:54.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:08:53 gibba045 bash[25517]: audit 2021-03-10T16:08:53.444675+0000 mon.a (mon.0) 1736 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T16:08:54.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:08:53 gibba045 bash[25517]: audit 2021-03-10T16:08:53.444876+0000 mon.a (mon.0) 1737 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:08:54.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:08:53 gibba045 bash[25517]: audit 2021-03-10T16:08:53.445044+0000 mon.a (mon.0) 1738 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:08:54.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:08:53 gibba045 bash[25517]: audit 2021-03-10T16:08:53.445247+0000 mon.a (mon.0) 1739 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T16:08:55.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:08:54 gibba015 bash[29377]: cluster 2021-03-10T16:08:53.072944+0000 mgr.gibba045.orlgmj (mgr.34412) 7394 : cluster [DBG] pgmap v4212: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:55.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:08:54 gibba015 bash[30343]: cluster 2021-03-10T16:08:53.072944+0000 mgr.gibba045.orlgmj (mgr.34412) 7394 : cluster [DBG] pgmap v4212: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:55.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:08:54 gibba045 bash[25517]: cluster 2021-03-10T16:08:53.072944+0000 mgr.gibba045.orlgmj (mgr.34412) 7394 : cluster [DBG] pgmap v4212: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:56.666 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:08:56.900 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:08:56.900 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 3m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:08:56.901 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 2m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:08:56.901 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:08:56.901 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:08:56.901 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:08:56.902 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:08:56.902 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:08:56.902 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:08:56.902 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 3m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:08:56.903 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 2m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:08:56.903 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:08:56.903 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:08:56.903 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:08:56.904 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:08:56.904 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:08:56.904 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:08:56.904 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:08:56.904 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:08:56.905 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 2m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:08:56.905 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 2m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:08:57.149 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:08:57.149 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:08:57.149 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:08:57.150 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:08:57.150 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:08:57.150 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:08:57.150 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:08:57.151 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:08:57.151 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:08:57.151 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:08:57.151 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:08:57.152 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:08:57.152 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:08:57.152 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:08:57.152 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:08:57.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:08:56 gibba015 bash[29377]: cluster 2021-03-10T16:08:55.074387+0000 mgr.gibba045.orlgmj (mgr.34412) 7395 : cluster [DBG] pgmap v4213: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:57.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:08:56 gibba015 bash[29377]: audit 2021-03-10T16:08:56.623960+0000 mon.c (mon.1) 2053 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:08:57.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:08:56 gibba015 bash[30343]: cluster 2021-03-10T16:08:55.074387+0000 mgr.gibba045.orlgmj (mgr.34412) 7395 : cluster [DBG] pgmap v4213: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:57.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:08:56 gibba015 bash[30343]: audit 2021-03-10T16:08:56.623960+0000 mon.c (mon.1) 2053 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:08:57.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:08:56 gibba045 bash[25517]: cluster 2021-03-10T16:08:55.074387+0000 mgr.gibba045.orlgmj (mgr.34412) 7395 : cluster [DBG] pgmap v4213: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:57.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:08:56 gibba045 bash[25517]: audit 2021-03-10T16:08:56.623960+0000 mon.c (mon.1) 2053 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:08:58.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:08:57 gibba015 bash[29377]: cephadm 2021-03-10T16:08:56.630356+0000 mgr.gibba045.orlgmj (mgr.34412) 7396 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:08:58.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:08:57 gibba015 bash[29377]: cephadm 2021-03-10T16:08:56.632265+0000 mgr.gibba045.orlgmj (mgr.34412) 7397 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:08:58.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:08:57 gibba015 bash[29377]: audit 2021-03-10T16:08:56.660388+0000 mgr.gibba045.orlgmj (mgr.34412) 7398 : audit [DBG] from='client.49020 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:08:58.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:08:57 gibba015 bash[29377]: audit 2021-03-10T16:08:56.853877+0000 mon.a (mon.0) 1740 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:08:58.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:08:57 gibba015 bash[29377]: audit 2021-03-10T16:08:56.857380+0000 mon.c (mon.1) 2054 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:08:58.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:08:57 gibba015 bash[29377]: audit 2021-03-10T16:08:56.858594+0000 mon.c (mon.1) 2055 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:08:58.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:08:57 gibba015 bash[29377]: cephadm 2021-03-10T16:08:56.859063+0000 mgr.gibba045.orlgmj (mgr.34412) 7399 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:08:58.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:08:57 gibba015 bash[29377]: audit 2021-03-10T16:08:56.859651+0000 mon.c (mon.1) 2056 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:08:58.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:08:57 gibba015 bash[29377]: audit 2021-03-10T16:08:56.860633+0000 mon.c (mon.1) 2057 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:08:58.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:08:57 gibba015 bash[29377]: cephadm 2021-03-10T16:08:56.860655+0000 mgr.gibba045.orlgmj (mgr.34412) 7400 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:08:58.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:08:57 gibba015 bash[29377]: cephadm 2021-03-10T16:08:56.861678+0000 mgr.gibba045.orlgmj (mgr.34412) 7401 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:08:58.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:08:57 gibba015 bash[29377]: cephadm 2021-03-10T16:08:56.861717+0000 mgr.gibba045.orlgmj (mgr.34412) 7402 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:08:58.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:08:57 gibba015 bash[29377]: cephadm 2021-03-10T16:08:56.862723+0000 mgr.gibba045.orlgmj (mgr.34412) 7403 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:08:58.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:08:57 gibba015 bash[29377]: cephadm 2021-03-10T16:08:56.862762+0000 mgr.gibba045.orlgmj (mgr.34412) 7404 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:08:58.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:08:57 gibba015 bash[29377]: audit 2021-03-10T16:08:56.862813+0000 mon.c (mon.1) 2058 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:08:58.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:08:57 gibba015 bash[29377]: cephadm 2021-03-10T16:08:56.863579+0000 mgr.gibba045.orlgmj (mgr.34412) 7405 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:08:58.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:08:57 gibba015 bash[29377]: audit 2021-03-10T16:08:56.863958+0000 mon.c (mon.1) 2059 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:08:58.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:08:57 gibba015 bash[29377]: cephadm 2021-03-10T16:08:56.864786+0000 mgr.gibba045.orlgmj (mgr.34412) 7406 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:08:58.230 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:08:57 gibba015 bash[29377]: cephadm 2021-03-10T16:08:56.864822+0000 mgr.gibba045.orlgmj (mgr.34412) 7407 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:08:58.230 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:08:57 gibba015 bash[29377]: cephadm 2021-03-10T16:08:56.865794+0000 mgr.gibba045.orlgmj (mgr.34412) 7408 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:08:58.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:08:57 gibba015 bash[30343]: cephadm 2021-03-10T16:08:56.630356+0000 mgr.gibba045.orlgmj (mgr.34412) 7396 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:08:58.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:08:57 gibba015 bash[30343]: cephadm 2021-03-10T16:08:56.632265+0000 mgr.gibba045.orlgmj (mgr.34412) 7397 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:08:58.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:08:57 gibba015 bash[30343]: audit 2021-03-10T16:08:56.660388+0000 mgr.gibba045.orlgmj (mgr.34412) 7398 : audit [DBG] from='client.49020 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:08:58.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:08:57 gibba015 bash[30343]: audit 2021-03-10T16:08:56.853877+0000 mon.a (mon.0) 1740 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:08:58.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:08:57 gibba015 bash[30343]: audit 2021-03-10T16:08:56.857380+0000 mon.c (mon.1) 2054 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:08:58.234 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:08:57 gibba015 bash[30343]: audit 2021-03-10T16:08:56.858594+0000 mon.c (mon.1) 2055 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:08:58.234 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:08:57 gibba015 bash[30343]: cephadm 2021-03-10T16:08:56.859063+0000 mgr.gibba045.orlgmj (mgr.34412) 7399 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:08:58.234 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:08:57 gibba015 bash[30343]: audit 2021-03-10T16:08:56.859651+0000 mon.c (mon.1) 2056 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:08:58.235 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:08:57 gibba015 bash[30343]: audit 2021-03-10T16:08:56.860633+0000 mon.c (mon.1) 2057 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:08:58.235 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:08:57 gibba015 bash[30343]: cephadm 2021-03-10T16:08:56.860655+0000 mgr.gibba045.orlgmj (mgr.34412) 7400 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:08:58.236 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:08:57 gibba015 bash[30343]: cephadm 2021-03-10T16:08:56.861678+0000 mgr.gibba045.orlgmj (mgr.34412) 7401 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:08:58.236 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:08:57 gibba015 bash[30343]: cephadm 2021-03-10T16:08:56.861717+0000 mgr.gibba045.orlgmj (mgr.34412) 7402 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:08:58.237 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:08:57 gibba015 bash[30343]: cephadm 2021-03-10T16:08:56.862723+0000 mgr.gibba045.orlgmj (mgr.34412) 7403 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:08:58.237 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:08:57 gibba015 bash[30343]: cephadm 2021-03-10T16:08:56.862762+0000 mgr.gibba045.orlgmj (mgr.34412) 7404 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:08:58.238 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:08:57 gibba015 bash[30343]: audit 2021-03-10T16:08:56.862813+0000 mon.c (mon.1) 2058 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:08:58.238 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:08:57 gibba015 bash[30343]: cephadm 2021-03-10T16:08:56.863579+0000 mgr.gibba045.orlgmj (mgr.34412) 7405 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:08:58.238 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:08:57 gibba015 bash[30343]: audit 2021-03-10T16:08:56.863958+0000 mon.c (mon.1) 2059 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:08:58.239 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:08:57 gibba015 bash[30343]: cephadm 2021-03-10T16:08:56.864786+0000 mgr.gibba045.orlgmj (mgr.34412) 7406 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:08:58.239 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:08:57 gibba015 bash[30343]: cephadm 2021-03-10T16:08:56.864822+0000 mgr.gibba045.orlgmj (mgr.34412) 7407 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:08:58.240 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:08:57 gibba015 bash[30343]: cephadm 2021-03-10T16:08:56.865794+0000 mgr.gibba045.orlgmj (mgr.34412) 7408 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:08:58.240 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:08:57 gibba015 bash[30343]: cephadm 2021-03-10T16:08:56.866113+0000 mgr.gibba045.orlgmj (mgr.34412) 7409 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:08:58.241 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:08:57 gibba015 bash[30343]: cephadm 2021-03-10T16:08:56.866960+0000 mgr.gibba045.orlgmj (mgr.34412) 7410 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:08:58.241 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:08:57 gibba015 bash[30343]: cephadm 2021-03-10T16:08:56.867000+0000 mgr.gibba045.orlgmj (mgr.34412) 7411 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:08:58.241 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:08:57 gibba015 bash[30343]: cephadm 2021-03-10T16:08:56.867106+0000 mgr.gibba045.orlgmj (mgr.34412) 7412 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:08:58.242 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:08:57 gibba015 bash[30343]: audit 2021-03-10T16:08:56.893182+0000 mgr.gibba045.orlgmj (mgr.34412) 7413 : audit [DBG] from='client.59014 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:08:58.242 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:08:57 gibba015 bash[30343]: audit 2021-03-10T16:08:57.148685+0000 mon.c (mon.1) 2060 : audit [DBG] from='client.? 172.21.2.115:0/813163035' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:08:58.243 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:08:57 gibba015 bash[29377]: cephadm 2021-03-10T16:08:56.866113+0000 mgr.gibba045.orlgmj (mgr.34412) 7409 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:08:58.243 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:08:57 gibba015 bash[29377]: cephadm 2021-03-10T16:08:56.866960+0000 mgr.gibba045.orlgmj (mgr.34412) 7410 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:08:58.244 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:08:57 gibba015 bash[29377]: cephadm 2021-03-10T16:08:56.867000+0000 mgr.gibba045.orlgmj (mgr.34412) 7411 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:08:58.244 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:08:57 gibba015 bash[29377]: cephadm 2021-03-10T16:08:56.867106+0000 mgr.gibba045.orlgmj (mgr.34412) 7412 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:08:58.245 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:08:57 gibba015 bash[29377]: audit 2021-03-10T16:08:56.893182+0000 mgr.gibba045.orlgmj (mgr.34412) 7413 : audit [DBG] from='client.59014 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:08:58.245 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:08:57 gibba015 bash[29377]: audit 2021-03-10T16:08:57.148685+0000 mon.c (mon.1) 2060 : audit [DBG] from='client.? 172.21.2.115:0/813163035' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:08:58.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:08:57 gibba045 bash[25517]: cephadm 2021-03-10T16:08:56.630356+0000 mgr.gibba045.orlgmj (mgr.34412) 7396 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:08:58.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:08:57 gibba045 bash[25517]: cephadm 2021-03-10T16:08:56.632265+0000 mgr.gibba045.orlgmj (mgr.34412) 7397 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:08:58.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:08:57 gibba045 bash[25517]: audit 2021-03-10T16:08:56.660388+0000 mgr.gibba045.orlgmj (mgr.34412) 7398 : audit [DBG] from='client.49020 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:08:58.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:08:57 gibba045 bash[25517]: audit 2021-03-10T16:08:56.853877+0000 mon.a (mon.0) 1740 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:08:58.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:08:57 gibba045 bash[25517]: audit 2021-03-10T16:08:56.857380+0000 mon.c (mon.1) 2054 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:08:58.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:08:57 gibba045 bash[25517]: audit 2021-03-10T16:08:56.858594+0000 mon.c (mon.1) 2055 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:08:58.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:08:57 gibba045 bash[25517]: cephadm 2021-03-10T16:08:56.859063+0000 mgr.gibba045.orlgmj (mgr.34412) 7399 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:08:58.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:08:57 gibba045 bash[25517]: audit 2021-03-10T16:08:56.859651+0000 mon.c (mon.1) 2056 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:08:58.312 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:08:57 gibba045 bash[25517]: audit 2021-03-10T16:08:56.860633+0000 mon.c (mon.1) 2057 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:08:58.312 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:08:57 gibba045 bash[25517]: cephadm 2021-03-10T16:08:56.860655+0000 mgr.gibba045.orlgmj (mgr.34412) 7400 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:08:58.313 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:08:57 gibba045 bash[25517]: cephadm 2021-03-10T16:08:56.861678+0000 mgr.gibba045.orlgmj (mgr.34412) 7401 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:08:58.313 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:08:57 gibba045 bash[25517]: cephadm 2021-03-10T16:08:56.861717+0000 mgr.gibba045.orlgmj (mgr.34412) 7402 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:08:58.313 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:08:57 gibba045 bash[25517]: cephadm 2021-03-10T16:08:56.862723+0000 mgr.gibba045.orlgmj (mgr.34412) 7403 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:08:58.314 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:08:57 gibba045 bash[25517]: cephadm 2021-03-10T16:08:56.862762+0000 mgr.gibba045.orlgmj (mgr.34412) 7404 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:08:58.314 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:08:57 gibba045 bash[25517]: audit 2021-03-10T16:08:56.862813+0000 mon.c (mon.1) 2058 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:08:58.315 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:08:57 gibba045 bash[25517]: cephadm 2021-03-10T16:08:56.863579+0000 mgr.gibba045.orlgmj (mgr.34412) 7405 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:08:58.315 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:08:57 gibba045 bash[25517]: audit 2021-03-10T16:08:56.863958+0000 mon.c (mon.1) 2059 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:08:58.316 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:08:57 gibba045 bash[25517]: cephadm 2021-03-10T16:08:56.864786+0000 mgr.gibba045.orlgmj (mgr.34412) 7406 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:08:58.316 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:08:57 gibba045 bash[25517]: cephadm 2021-03-10T16:08:56.864822+0000 mgr.gibba045.orlgmj (mgr.34412) 7407 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:08:58.316 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:08:57 gibba045 bash[25517]: cephadm 2021-03-10T16:08:56.865794+0000 mgr.gibba045.orlgmj (mgr.34412) 7408 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:08:58.317 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:08:57 gibba045 bash[25517]: cephadm 2021-03-10T16:08:56.866113+0000 mgr.gibba045.orlgmj (mgr.34412) 7409 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:08:58.317 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:08:57 gibba045 bash[25517]: cephadm 2021-03-10T16:08:56.866960+0000 mgr.gibba045.orlgmj (mgr.34412) 7410 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:08:58.318 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:08:57 gibba045 bash[25517]: cephadm 2021-03-10T16:08:56.867000+0000 mgr.gibba045.orlgmj (mgr.34412) 7411 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:08:58.318 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:08:57 gibba045 bash[25517]: cephadm 2021-03-10T16:08:56.867106+0000 mgr.gibba045.orlgmj (mgr.34412) 7412 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:08:58.319 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:08:57 gibba045 bash[25517]: audit 2021-03-10T16:08:56.893182+0000 mgr.gibba045.orlgmj (mgr.34412) 7413 : audit [DBG] from='client.59014 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:08:58.319 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:08:57 gibba045 bash[25517]: audit 2021-03-10T16:08:57.148685+0000 mon.c (mon.1) 2060 : audit [DBG] from='client.? 172.21.2.115:0/813163035' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:08:59.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:08:58 gibba015 bash[29377]: cluster 2021-03-10T16:08:57.076198+0000 mgr.gibba045.orlgmj (mgr.34412) 7414 : cluster [DBG] pgmap v4214: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:59.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:08:58 gibba015 bash[30343]: cluster 2021-03-10T16:08:57.076198+0000 mgr.gibba045.orlgmj (mgr.34412) 7414 : cluster [DBG] pgmap v4214: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:59.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:08:58 gibba045 bash[25517]: cluster 2021-03-10T16:08:57.076198+0000 mgr.gibba045.orlgmj (mgr.34412) 7414 : cluster [DBG] pgmap v4214: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:01.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:09:00 gibba015 bash[29377]: cluster 2021-03-10T16:08:59.077455+0000 mgr.gibba045.orlgmj (mgr.34412) 7415 : cluster [DBG] pgmap v4215: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:01.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:09:00 gibba015 bash[30343]: cluster 2021-03-10T16:08:59.077455+0000 mgr.gibba045.orlgmj (mgr.34412) 7415 : cluster [DBG] pgmap v4215: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:01.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:09:00 gibba045 bash[25517]: cluster 2021-03-10T16:08:59.077455+0000 mgr.gibba045.orlgmj (mgr.34412) 7415 : cluster [DBG] pgmap v4215: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:03.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:09:02 gibba015 bash[29377]: cluster 2021-03-10T16:09:01.079217+0000 mgr.gibba045.orlgmj (mgr.34412) 7416 : cluster [DBG] pgmap v4216: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:03.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:09:02 gibba015 bash[30343]: cluster 2021-03-10T16:09:01.079217+0000 mgr.gibba045.orlgmj (mgr.34412) 7416 : cluster [DBG] pgmap v4216: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:03.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:09:02 gibba045 bash[25517]: cluster 2021-03-10T16:09:01.079217+0000 mgr.gibba045.orlgmj (mgr.34412) 7416 : cluster [DBG] pgmap v4216: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:05.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:09:04 gibba015 bash[29377]: cluster 2021-03-10T16:09:03.080929+0000 mgr.gibba045.orlgmj (mgr.34412) 7417 : cluster [DBG] pgmap v4217: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:05.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:09:04 gibba015 bash[30343]: cluster 2021-03-10T16:09:03.080929+0000 mgr.gibba045.orlgmj (mgr.34412) 7417 : cluster [DBG] pgmap v4217: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:05.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:09:04 gibba045 bash[25517]: cluster 2021-03-10T16:09:03.080929+0000 mgr.gibba045.orlgmj (mgr.34412) 7417 : cluster [DBG] pgmap v4217: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:07.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:09:06 gibba015 bash[29377]: cluster 2021-03-10T16:09:05.082593+0000 mgr.gibba045.orlgmj (mgr.34412) 7418 : cluster [DBG] pgmap v4218: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:07.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:09:06 gibba015 bash[30343]: cluster 2021-03-10T16:09:05.082593+0000 mgr.gibba045.orlgmj (mgr.34412) 7418 : cluster [DBG] pgmap v4218: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:07.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:09:06 gibba045 bash[25517]: cluster 2021-03-10T16:09:05.082593+0000 mgr.gibba045.orlgmj (mgr.34412) 7418 : cluster [DBG] pgmap v4218: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:09.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:09:08 gibba015 bash[29377]: cluster 2021-03-10T16:09:07.084482+0000 mgr.gibba045.orlgmj (mgr.34412) 7419 : cluster [DBG] pgmap v4219: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:09.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:09:08 gibba015 bash[30343]: cluster 2021-03-10T16:09:07.084482+0000 mgr.gibba045.orlgmj (mgr.34412) 7419 : cluster [DBG] pgmap v4219: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:09.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:09:08 gibba045 bash[25517]: cluster 2021-03-10T16:09:07.084482+0000 mgr.gibba045.orlgmj (mgr.34412) 7419 : cluster [DBG] pgmap v4219: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:11.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:09:10 gibba015 bash[29377]: cluster 2021-03-10T16:09:09.085667+0000 mgr.gibba045.orlgmj (mgr.34412) 7420 : cluster [DBG] pgmap v4220: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:11.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:09:10 gibba015 bash[30343]: cluster 2021-03-10T16:09:09.085667+0000 mgr.gibba045.orlgmj (mgr.34412) 7420 : cluster [DBG] pgmap v4220: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:11.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:09:10 gibba045 bash[25517]: cluster 2021-03-10T16:09:09.085667+0000 mgr.gibba045.orlgmj (mgr.34412) 7420 : cluster [DBG] pgmap v4220: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:13.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:09:12 gibba015 bash[29377]: cluster 2021-03-10T16:09:11.087418+0000 mgr.gibba045.orlgmj (mgr.34412) 7421 : cluster [DBG] pgmap v4221: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:13.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:09:12 gibba015 bash[29377]: cephadm 2021-03-10T16:09:11.883188+0000 mgr.gibba045.orlgmj (mgr.34412) 7422 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:09:13.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:09:12 gibba015 bash[30343]: cluster 2021-03-10T16:09:11.087418+0000 mgr.gibba045.orlgmj (mgr.34412) 7421 : cluster [DBG] pgmap v4221: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:13.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:09:12 gibba015 bash[30343]: cephadm 2021-03-10T16:09:11.883188+0000 mgr.gibba045.orlgmj (mgr.34412) 7422 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:09:13.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:09:12 gibba045 bash[25517]: cluster 2021-03-10T16:09:11.087418+0000 mgr.gibba045.orlgmj (mgr.34412) 7421 : cluster [DBG] pgmap v4221: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:13.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:09:12 gibba045 bash[25517]: cephadm 2021-03-10T16:09:11.883188+0000 mgr.gibba045.orlgmj (mgr.34412) 7422 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:09:15.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:09:14 gibba015 bash[29377]: cluster 2021-03-10T16:09:13.089209+0000 mgr.gibba045.orlgmj (mgr.34412) 7423 : cluster [DBG] pgmap v4222: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:15.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:09:14 gibba015 bash[30343]: cluster 2021-03-10T16:09:13.089209+0000 mgr.gibba045.orlgmj (mgr.34412) 7423 : cluster [DBG] pgmap v4222: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:15.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:09:14 gibba045 bash[25517]: cluster 2021-03-10T16:09:13.089209+0000 mgr.gibba045.orlgmj (mgr.34412) 7423 : cluster [DBG] pgmap v4222: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:17.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:09:16 gibba015 bash[29377]: cluster 2021-03-10T16:09:15.090928+0000 mgr.gibba045.orlgmj (mgr.34412) 7424 : cluster [DBG] pgmap v4223: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:17.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:09:16 gibba015 bash[30343]: cluster 2021-03-10T16:09:15.090928+0000 mgr.gibba045.orlgmj (mgr.34412) 7424 : cluster [DBG] pgmap v4223: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:17.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:09:16 gibba045 bash[25517]: cluster 2021-03-10T16:09:15.090928+0000 mgr.gibba045.orlgmj (mgr.34412) 7424 : cluster [DBG] pgmap v4223: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:19.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:09:18 gibba015 bash[29377]: cluster 2021-03-10T16:09:17.092735+0000 mgr.gibba045.orlgmj (mgr.34412) 7425 : cluster [DBG] pgmap v4224: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:19.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:09:18 gibba015 bash[30343]: cluster 2021-03-10T16:09:17.092735+0000 mgr.gibba045.orlgmj (mgr.34412) 7425 : cluster [DBG] pgmap v4224: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:19.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:09:18 gibba045 bash[25517]: cluster 2021-03-10T16:09:17.092735+0000 mgr.gibba045.orlgmj (mgr.34412) 7425 : cluster [DBG] pgmap v4224: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:21.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:09:20 gibba015 bash[29377]: cluster 2021-03-10T16:09:19.094020+0000 mgr.gibba045.orlgmj (mgr.34412) 7426 : cluster [DBG] pgmap v4225: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:21.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:09:20 gibba015 bash[30343]: cluster 2021-03-10T16:09:19.094020+0000 mgr.gibba045.orlgmj (mgr.34412) 7426 : cluster [DBG] pgmap v4225: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:21.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:09:20 gibba045 bash[25517]: cluster 2021-03-10T16:09:19.094020+0000 mgr.gibba045.orlgmj (mgr.34412) 7426 : cluster [DBG] pgmap v4225: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:23.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:09:22 gibba045 bash[25517]: cluster 2021-03-10T16:09:21.095712+0000 mgr.gibba045.orlgmj (mgr.34412) 7427 : cluster [DBG] pgmap v4226: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:23.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:09:22 gibba015 bash[29377]: cluster 2021-03-10T16:09:21.095712+0000 mgr.gibba045.orlgmj (mgr.34412) 7427 : cluster [DBG] pgmap v4226: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:23.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:09:22 gibba015 bash[30343]: cluster 2021-03-10T16:09:21.095712+0000 mgr.gibba045.orlgmj (mgr.34412) 7427 : cluster [DBG] pgmap v4226: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:25.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:09:24 gibba045 bash[25517]: cluster 2021-03-10T16:09:23.097427+0000 mgr.gibba045.orlgmj (mgr.34412) 7428 : cluster [DBG] pgmap v4227: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:25.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:09:24 gibba015 bash[29377]: cluster 2021-03-10T16:09:23.097427+0000 mgr.gibba045.orlgmj (mgr.34412) 7428 : cluster [DBG] pgmap v4227: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:25.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:09:24 gibba015 bash[30343]: cluster 2021-03-10T16:09:23.097427+0000 mgr.gibba045.orlgmj (mgr.34412) 7428 : cluster [DBG] pgmap v4227: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:27.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:09:26 gibba045 bash[25517]: cluster 2021-03-10T16:09:25.099055+0000 mgr.gibba045.orlgmj (mgr.34412) 7429 : cluster [DBG] pgmap v4228: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:27.403 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:09:27.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:09:26 gibba015 bash[29377]: cluster 2021-03-10T16:09:25.099055+0000 mgr.gibba045.orlgmj (mgr.34412) 7429 : cluster [DBG] pgmap v4228: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:27.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:09:26 gibba015 bash[30343]: cluster 2021-03-10T16:09:25.099055+0000 mgr.gibba045.orlgmj (mgr.34412) 7429 : cluster [DBG] pgmap v4228: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:27.631 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:09:27.631 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 3m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:09:27.631 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 2m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:09:27.632 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:09:27.632 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:09:27.632 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:09:27.632 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:09:27.633 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:09:27.633 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:09:27.633 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 3m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:09:27.633 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 2m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:09:27.633 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:09:27.634 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:09:27.634 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:09:27.634 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:09:27.634 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:09:27.634 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:09:27.635 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:09:27.635 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:09:27.635 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 2m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:09:27.635 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 2m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:09:27.880 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:09:27.880 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:09:27.880 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:09:27.881 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:09:27.881 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:09:27.881 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:09:27.881 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:09:27.881 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:09:27.882 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:09:27.882 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:09:27.882 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:09:27.882 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:09:27.883 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:09:27.883 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:09:27.883 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:09:28.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:09:27 gibba045 bash[25517]: cephadm 2021-03-10T16:09:26.899225+0000 mgr.gibba045.orlgmj (mgr.34412) 7430 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:09:28.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:09:27 gibba045 bash[25517]: audit 2021-03-10T16:09:27.879494+0000 mon.a (mon.0) 1741 : audit [DBG] from='client.? 172.21.2.115:0/3133423313' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:09:28.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:09:27 gibba015 bash[29377]: cephadm 2021-03-10T16:09:26.899225+0000 mgr.gibba045.orlgmj (mgr.34412) 7430 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:09:28.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:09:27 gibba015 bash[29377]: audit 2021-03-10T16:09:27.879494+0000 mon.a (mon.0) 1741 : audit [DBG] from='client.? 172.21.2.115:0/3133423313' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:09:28.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:09:27 gibba015 bash[30343]: cephadm 2021-03-10T16:09:26.899225+0000 mgr.gibba045.orlgmj (mgr.34412) 7430 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:09:28.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:09:27 gibba015 bash[30343]: audit 2021-03-10T16:09:27.879494+0000 mon.a (mon.0) 1741 : audit [DBG] from='client.? 172.21.2.115:0/3133423313' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:09:29.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:09:29 gibba045 bash[25517]: cluster 2021-03-10T16:09:27.100787+0000 mgr.gibba045.orlgmj (mgr.34412) 7431 : cluster [DBG] pgmap v4229: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:29.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:09:29 gibba045 bash[25517]: audit 2021-03-10T16:09:27.395597+0000 mgr.gibba045.orlgmj (mgr.34412) 7432 : audit [DBG] from='client.49038 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:09:29.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:09:29 gibba045 bash[25517]: audit 2021-03-10T16:09:27.620218+0000 mgr.gibba045.orlgmj (mgr.34412) 7433 : audit [DBG] from='client.59032 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:09:29.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:09:29 gibba015 bash[29377]: cluster 2021-03-10T16:09:27.100787+0000 mgr.gibba045.orlgmj (mgr.34412) 7431 : cluster [DBG] pgmap v4229: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:29.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:09:29 gibba015 bash[29377]: audit 2021-03-10T16:09:27.395597+0000 mgr.gibba045.orlgmj (mgr.34412) 7432 : audit [DBG] from='client.49038 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:09:29.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:09:29 gibba015 bash[29377]: audit 2021-03-10T16:09:27.620218+0000 mgr.gibba045.orlgmj (mgr.34412) 7433 : audit [DBG] from='client.59032 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:09:29.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:09:29 gibba015 bash[30343]: cluster 2021-03-10T16:09:27.100787+0000 mgr.gibba045.orlgmj (mgr.34412) 7431 : cluster [DBG] pgmap v4229: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:29.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:09:29 gibba015 bash[30343]: audit 2021-03-10T16:09:27.395597+0000 mgr.gibba045.orlgmj (mgr.34412) 7432 : audit [DBG] from='client.49038 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:09:29.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:09:29 gibba015 bash[30343]: audit 2021-03-10T16:09:27.620218+0000 mgr.gibba045.orlgmj (mgr.34412) 7433 : audit [DBG] from='client.59032 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:09:30.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:09:30 gibba045 bash[25517]: cluster 2021-03-10T16:09:29.101868+0000 mgr.gibba045.orlgmj (mgr.34412) 7434 : cluster [DBG] pgmap v4230: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:30.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:09:30 gibba015 bash[29377]: cluster 2021-03-10T16:09:29.101868+0000 mgr.gibba045.orlgmj (mgr.34412) 7434 : cluster [DBG] pgmap v4230: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:30.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:09:30 gibba015 bash[30343]: cluster 2021-03-10T16:09:29.101868+0000 mgr.gibba045.orlgmj (mgr.34412) 7434 : cluster [DBG] pgmap v4230: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:32.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:09:32 gibba045 bash[25517]: cluster 2021-03-10T16:09:31.103739+0000 mgr.gibba045.orlgmj (mgr.34412) 7435 : cluster [DBG] pgmap v4231: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:32.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:09:32 gibba015 bash[29377]: cluster 2021-03-10T16:09:31.103739+0000 mgr.gibba045.orlgmj (mgr.34412) 7435 : cluster [DBG] pgmap v4231: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:32.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:09:32 gibba015 bash[30343]: cluster 2021-03-10T16:09:31.103739+0000 mgr.gibba045.orlgmj (mgr.34412) 7435 : cluster [DBG] pgmap v4231: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:34.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:09:34 gibba045 bash[25517]: cluster 2021-03-10T16:09:33.105370+0000 mgr.gibba045.orlgmj (mgr.34412) 7436 : cluster [DBG] pgmap v4232: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:34.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:09:34 gibba015 bash[29377]: cluster 2021-03-10T16:09:33.105370+0000 mgr.gibba045.orlgmj (mgr.34412) 7436 : cluster [DBG] pgmap v4232: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:34.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:09:34 gibba015 bash[30343]: cluster 2021-03-10T16:09:33.105370+0000 mgr.gibba045.orlgmj (mgr.34412) 7436 : cluster [DBG] pgmap v4232: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:36.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:09:36 gibba045 bash[25517]: cluster 2021-03-10T16:09:35.107033+0000 mgr.gibba045.orlgmj (mgr.34412) 7437 : cluster [DBG] pgmap v4233: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:36.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:09:36 gibba015 bash[29377]: cluster 2021-03-10T16:09:35.107033+0000 mgr.gibba045.orlgmj (mgr.34412) 7437 : cluster [DBG] pgmap v4233: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:36.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:09:36 gibba015 bash[30343]: cluster 2021-03-10T16:09:35.107033+0000 mgr.gibba045.orlgmj (mgr.34412) 7437 : cluster [DBG] pgmap v4233: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:38.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:09:38 gibba045 bash[25517]: cluster 2021-03-10T16:09:37.108916+0000 mgr.gibba045.orlgmj (mgr.34412) 7438 : cluster [DBG] pgmap v4234: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:38.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:09:38 gibba015 bash[29377]: cluster 2021-03-10T16:09:37.108916+0000 mgr.gibba045.orlgmj (mgr.34412) 7438 : cluster [DBG] pgmap v4234: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:38.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:09:38 gibba015 bash[30343]: cluster 2021-03-10T16:09:37.108916+0000 mgr.gibba045.orlgmj (mgr.34412) 7438 : cluster [DBG] pgmap v4234: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:40.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:09:40 gibba045 bash[25517]: cluster 2021-03-10T16:09:39.110217+0000 mgr.gibba045.orlgmj (mgr.34412) 7439 : cluster [DBG] pgmap v4235: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:40.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:09:40 gibba015 bash[29377]: cluster 2021-03-10T16:09:39.110217+0000 mgr.gibba045.orlgmj (mgr.34412) 7439 : cluster [DBG] pgmap v4235: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:40.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:09:40 gibba015 bash[30343]: cluster 2021-03-10T16:09:39.110217+0000 mgr.gibba045.orlgmj (mgr.34412) 7439 : cluster [DBG] pgmap v4235: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:42.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:09:42 gibba045 bash[25517]: cluster 2021-03-10T16:09:41.112050+0000 mgr.gibba045.orlgmj (mgr.34412) 7440 : cluster [DBG] pgmap v4236: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:42.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:09:42 gibba045 bash[25517]: cephadm 2021-03-10T16:09:41.915224+0000 mgr.gibba045.orlgmj (mgr.34412) 7441 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:09:42.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:09:42 gibba015 bash[29377]: cluster 2021-03-10T16:09:41.112050+0000 mgr.gibba045.orlgmj (mgr.34412) 7440 : cluster [DBG] pgmap v4236: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:42.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:09:42 gibba015 bash[29377]: cephadm 2021-03-10T16:09:41.915224+0000 mgr.gibba045.orlgmj (mgr.34412) 7441 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:09:42.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:09:42 gibba015 bash[30343]: cluster 2021-03-10T16:09:41.112050+0000 mgr.gibba045.orlgmj (mgr.34412) 7440 : cluster [DBG] pgmap v4236: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:42.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:09:42 gibba015 bash[30343]: cephadm 2021-03-10T16:09:41.915224+0000 mgr.gibba045.orlgmj (mgr.34412) 7441 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:09:44.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:09:44 gibba015 bash[29377]: cluster 2021-03-10T16:09:43.113618+0000 mgr.gibba045.orlgmj (mgr.34412) 7442 : cluster [DBG] pgmap v4237: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:44.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:09:44 gibba015 bash[30343]: cluster 2021-03-10T16:09:43.113618+0000 mgr.gibba045.orlgmj (mgr.34412) 7442 : cluster [DBG] pgmap v4237: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:45.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:09:44 gibba045 bash[25517]: cluster 2021-03-10T16:09:43.113618+0000 mgr.gibba045.orlgmj (mgr.34412) 7442 : cluster [DBG] pgmap v4237: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:46.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:09:46 gibba015 bash[29377]: cluster 2021-03-10T16:09:45.115168+0000 mgr.gibba045.orlgmj (mgr.34412) 7443 : cluster [DBG] pgmap v4238: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:46.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:09:46 gibba015 bash[30343]: cluster 2021-03-10T16:09:45.115168+0000 mgr.gibba045.orlgmj (mgr.34412) 7443 : cluster [DBG] pgmap v4238: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:47.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:09:46 gibba045 bash[25517]: cluster 2021-03-10T16:09:45.115168+0000 mgr.gibba045.orlgmj (mgr.34412) 7443 : cluster [DBG] pgmap v4238: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:48.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:09:48 gibba015 bash[29377]: cluster 2021-03-10T16:09:47.116918+0000 mgr.gibba045.orlgmj (mgr.34412) 7444 : cluster [DBG] pgmap v4239: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:48.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:09:48 gibba015 bash[30343]: cluster 2021-03-10T16:09:47.116918+0000 mgr.gibba045.orlgmj (mgr.34412) 7444 : cluster [DBG] pgmap v4239: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:49.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:09:48 gibba045 bash[25517]: cluster 2021-03-10T16:09:47.116918+0000 mgr.gibba045.orlgmj (mgr.34412) 7444 : cluster [DBG] pgmap v4239: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:50.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:09:50 gibba015 bash[29377]: cluster 2021-03-10T16:09:49.118074+0000 mgr.gibba045.orlgmj (mgr.34412) 7445 : cluster [DBG] pgmap v4240: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:50.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:09:50 gibba015 bash[30343]: cluster 2021-03-10T16:09:49.118074+0000 mgr.gibba045.orlgmj (mgr.34412) 7445 : cluster [DBG] pgmap v4240: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:51.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:09:50 gibba045 bash[25517]: cluster 2021-03-10T16:09:49.118074+0000 mgr.gibba045.orlgmj (mgr.34412) 7445 : cluster [DBG] pgmap v4240: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:52.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:09:52 gibba015 bash[29377]: cluster 2021-03-10T16:09:51.119730+0000 mgr.gibba045.orlgmj (mgr.34412) 7446 : cluster [DBG] pgmap v4241: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:52.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:09:52 gibba015 bash[30343]: cluster 2021-03-10T16:09:51.119730+0000 mgr.gibba045.orlgmj (mgr.34412) 7446 : cluster [DBG] pgmap v4241: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:53.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:09:52 gibba045 bash[25517]: cluster 2021-03-10T16:09:51.119730+0000 mgr.gibba045.orlgmj (mgr.34412) 7446 : cluster [DBG] pgmap v4241: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:53.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:09:53 gibba015 bash[29377]: audit 2021-03-10T16:09:53.446386+0000 mon.c (mon.1) 2061 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:09:53.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:09:53 gibba015 bash[29377]: audit 2021-03-10T16:09:53.447342+0000 mon.c (mon.1) 2062 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:09:53.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:09:53 gibba015 bash[29377]: audit 2021-03-10T16:09:53.447634+0000 mon.a (mon.0) 1742 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:09:53.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:09:53 gibba015 bash[29377]: audit 2021-03-10T16:09:53.448397+0000 mon.c (mon.1) 2063 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T16:09:53.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:09:53 gibba015 bash[29377]: audit 2021-03-10T16:09:53.448570+0000 mon.a (mon.0) 1743 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:09:53.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:09:53 gibba015 bash[29377]: audit 2021-03-10T16:09:53.449508+0000 mon.a (mon.0) 1744 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T16:09:53.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:09:53 gibba015 bash[29377]: audit 2021-03-10T16:09:53.449856+0000 mon.c (mon.1) 2064 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:09:53.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:09:53 gibba015 bash[29377]: audit 2021-03-10T16:09:53.451128+0000 mon.a (mon.0) 1745 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:09:53.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:09:53 gibba015 bash[29377]: audit 2021-03-10T16:09:53.451162+0000 mon.c (mon.1) 2065 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:09:53.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:09:53 gibba015 bash[29377]: audit 2021-03-10T16:09:53.451722+0000 mon.c (mon.1) 2066 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:09:53.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:09:53 gibba015 bash[29377]: audit 2021-03-10T16:09:53.451874+0000 mon.a (mon.0) 1746 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:09:53.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:09:53 gibba015 bash[29377]: audit 2021-03-10T16:09:53.452251+0000 mon.a (mon.0) 1747 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:09:53.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:09:53 gibba015 bash[30343]: audit 2021-03-10T16:09:53.446386+0000 mon.c (mon.1) 2061 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:09:53.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:09:53 gibba015 bash[30343]: audit 2021-03-10T16:09:53.447342+0000 mon.c (mon.1) 2062 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:09:53.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:09:53 gibba015 bash[30343]: audit 2021-03-10T16:09:53.447634+0000 mon.a (mon.0) 1742 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:09:53.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:09:53 gibba015 bash[30343]: audit 2021-03-10T16:09:53.448397+0000 mon.c (mon.1) 2063 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T16:09:53.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:09:53 gibba015 bash[30343]: audit 2021-03-10T16:09:53.448570+0000 mon.a (mon.0) 1743 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:09:53.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:09:53 gibba015 bash[30343]: audit 2021-03-10T16:09:53.449508+0000 mon.a (mon.0) 1744 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T16:09:53.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:09:53 gibba015 bash[30343]: audit 2021-03-10T16:09:53.449856+0000 mon.c (mon.1) 2064 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:09:53.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:09:53 gibba015 bash[30343]: audit 2021-03-10T16:09:53.451128+0000 mon.a (mon.0) 1745 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:09:53.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:09:53 gibba015 bash[30343]: audit 2021-03-10T16:09:53.451162+0000 mon.c (mon.1) 2065 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:09:53.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:09:53 gibba015 bash[30343]: audit 2021-03-10T16:09:53.451722+0000 mon.c (mon.1) 2066 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:09:53.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:09:53 gibba015 bash[30343]: audit 2021-03-10T16:09:53.451874+0000 mon.a (mon.0) 1746 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:09:53.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:09:53 gibba015 bash[30343]: audit 2021-03-10T16:09:53.452251+0000 mon.a (mon.0) 1747 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:09:54.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:09:53 gibba045 bash[25517]: audit 2021-03-10T16:09:53.446386+0000 mon.c (mon.1) 2061 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:09:54.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:09:53 gibba045 bash[25517]: audit 2021-03-10T16:09:53.447342+0000 mon.c (mon.1) 2062 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:09:54.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:09:53 gibba045 bash[25517]: audit 2021-03-10T16:09:53.447634+0000 mon.a (mon.0) 1742 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:09:54.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:09:53 gibba045 bash[25517]: audit 2021-03-10T16:09:53.448397+0000 mon.c (mon.1) 2063 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T16:09:54.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:09:53 gibba045 bash[25517]: audit 2021-03-10T16:09:53.448570+0000 mon.a (mon.0) 1743 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:09:54.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:09:53 gibba045 bash[25517]: audit 2021-03-10T16:09:53.449508+0000 mon.a (mon.0) 1744 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T16:09:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:09:53 gibba045 bash[25517]: audit 2021-03-10T16:09:53.449856+0000 mon.c (mon.1) 2064 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:09:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:09:53 gibba045 bash[25517]: audit 2021-03-10T16:09:53.451128+0000 mon.a (mon.0) 1745 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:09:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:09:53 gibba045 bash[25517]: audit 2021-03-10T16:09:53.451162+0000 mon.c (mon.1) 2065 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:09:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:09:53 gibba045 bash[25517]: audit 2021-03-10T16:09:53.451722+0000 mon.c (mon.1) 2066 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:09:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:09:53 gibba045 bash[25517]: audit 2021-03-10T16:09:53.451874+0000 mon.a (mon.0) 1746 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:09:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:09:53 gibba045 bash[25517]: audit 2021-03-10T16:09:53.452251+0000 mon.a (mon.0) 1747 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:09:54.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:09:54 gibba015 bash[29377]: cluster 2021-03-10T16:09:53.121298+0000 mgr.gibba045.orlgmj (mgr.34412) 7447 : cluster [DBG] pgmap v4242: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:54.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:09:54 gibba015 bash[30343]: cluster 2021-03-10T16:09:53.121298+0000 mgr.gibba045.orlgmj (mgr.34412) 7447 : cluster [DBG] pgmap v4242: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:55.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:09:54 gibba045 bash[25517]: cluster 2021-03-10T16:09:53.121298+0000 mgr.gibba045.orlgmj (mgr.34412) 7447 : cluster [DBG] pgmap v4242: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:56.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:09:56 gibba015 bash[29377]: cluster 2021-03-10T16:09:55.122845+0000 mgr.gibba045.orlgmj (mgr.34412) 7448 : cluster [DBG] pgmap v4243: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:56.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:09:56 gibba015 bash[30343]: cluster 2021-03-10T16:09:55.122845+0000 mgr.gibba045.orlgmj (mgr.34412) 7448 : cluster [DBG] pgmap v4243: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:57.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:09:56 gibba045 bash[25517]: cluster 2021-03-10T16:09:55.122845+0000 mgr.gibba045.orlgmj (mgr.34412) 7448 : cluster [DBG] pgmap v4243: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:57.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:09:57 gibba015 bash[29377]: audit 2021-03-10T16:09:56.929826+0000 mon.c (mon.1) 2067 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:09:57.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:09:57 gibba015 bash[29377]: cephadm 2021-03-10T16:09:56.938120+0000 mgr.gibba045.orlgmj (mgr.34412) 7449 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:09:57.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:09:57 gibba015 bash[29377]: cephadm 2021-03-10T16:09:56.940147+0000 mgr.gibba045.orlgmj (mgr.34412) 7450 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:09:57.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:09:57 gibba015 bash[29377]: audit 2021-03-10T16:09:57.149611+0000 mon.a (mon.0) 1748 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:09:57.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:09:57 gibba015 bash[29377]: audit 2021-03-10T16:09:57.153104+0000 mon.c (mon.1) 2068 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:09:57.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:09:57 gibba015 bash[29377]: audit 2021-03-10T16:09:57.154927+0000 mon.c (mon.1) 2069 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:09:57.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:09:57 gibba015 bash[29377]: audit 2021-03-10T16:09:57.156780+0000 mon.c (mon.1) 2070 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:09:57.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:09:57 gibba015 bash[29377]: audit 2021-03-10T16:09:57.158282+0000 mon.c (mon.1) 2071 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:09:57.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:09:57 gibba015 bash[29377]: audit 2021-03-10T16:09:57.162227+0000 mon.c (mon.1) 2072 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:09:57.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:09:57 gibba015 bash[29377]: audit 2021-03-10T16:09:57.163727+0000 mon.c (mon.1) 2073 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:09:57.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:09:57 gibba015 bash[30343]: audit 2021-03-10T16:09:56.929826+0000 mon.c (mon.1) 2067 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:09:57.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:09:57 gibba015 bash[30343]: cephadm 2021-03-10T16:09:56.938120+0000 mgr.gibba045.orlgmj (mgr.34412) 7449 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:09:57.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:09:57 gibba015 bash[30343]: cephadm 2021-03-10T16:09:56.940147+0000 mgr.gibba045.orlgmj (mgr.34412) 7450 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:09:57.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:09:57 gibba015 bash[30343]: audit 2021-03-10T16:09:57.149611+0000 mon.a (mon.0) 1748 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:09:57.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:09:57 gibba015 bash[30343]: audit 2021-03-10T16:09:57.153104+0000 mon.c (mon.1) 2068 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:09:57.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:09:57 gibba015 bash[30343]: audit 2021-03-10T16:09:57.154927+0000 mon.c (mon.1) 2069 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:09:57.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:09:57 gibba015 bash[30343]: audit 2021-03-10T16:09:57.156780+0000 mon.c (mon.1) 2070 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:09:57.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:09:57 gibba015 bash[30343]: audit 2021-03-10T16:09:57.158282+0000 mon.c (mon.1) 2071 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:09:57.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:09:57 gibba015 bash[30343]: audit 2021-03-10T16:09:57.162227+0000 mon.c (mon.1) 2072 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:09:57.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:09:57 gibba015 bash[30343]: audit 2021-03-10T16:09:57.163727+0000 mon.c (mon.1) 2073 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:09:58.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:09:57 gibba045 bash[25517]: audit 2021-03-10T16:09:56.929826+0000 mon.c (mon.1) 2067 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:09:58.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:09:57 gibba045 bash[25517]: cephadm 2021-03-10T16:09:56.938120+0000 mgr.gibba045.orlgmj (mgr.34412) 7449 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:09:58.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:09:57 gibba045 bash[25517]: cephadm 2021-03-10T16:09:56.940147+0000 mgr.gibba045.orlgmj (mgr.34412) 7450 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:09:58.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:09:57 gibba045 bash[25517]: audit 2021-03-10T16:09:57.149611+0000 mon.a (mon.0) 1748 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:09:58.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:09:57 gibba045 bash[25517]: audit 2021-03-10T16:09:57.153104+0000 mon.c (mon.1) 2068 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:09:58.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:09:57 gibba045 bash[25517]: audit 2021-03-10T16:09:57.154927+0000 mon.c (mon.1) 2069 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:09:58.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:09:57 gibba045 bash[25517]: audit 2021-03-10T16:09:57.156780+0000 mon.c (mon.1) 2070 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:09:58.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:09:57 gibba045 bash[25517]: audit 2021-03-10T16:09:57.158282+0000 mon.c (mon.1) 2071 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:09:58.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:09:57 gibba045 bash[25517]: audit 2021-03-10T16:09:57.162227+0000 mon.c (mon.1) 2072 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:09:58.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:09:57 gibba045 bash[25517]: audit 2021-03-10T16:09:57.163727+0000 mon.c (mon.1) 2073 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:09:58.124 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:09:58.349 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:09:58.350 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 4m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:09:58.350 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 3m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:09:58.350 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:09:58.350 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:09:58.351 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:09:58.351 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:09:58.351 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:09:58.351 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:09:58.352 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 4m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:09:58.352 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 3m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:09:58.352 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:09:58.352 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:09:58.352 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:09:58.353 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:09:58.353 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:09:58.353 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:09:58.353 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:09:58.354 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:09:58.354 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 3m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:09:58.354 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 3m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:09:58.601 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:09:58.601 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:09:58.601 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:09:58.601 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:09:58.602 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:09:58.602 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:09:58.602 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:09:58.602 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:09:58.603 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:09:58.603 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:09:58.603 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:09:58.603 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:09:58.603 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:09:58.604 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:09:58.604 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:09:58.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:09:58 gibba015 bash[29377]: cluster 2021-03-10T16:09:57.123365+0000 mgr.gibba045.orlgmj (mgr.34412) 7451 : cluster [DBG] pgmap v4244: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:58.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:09:58 gibba015 bash[29377]: cephadm 2021-03-10T16:09:57.154710+0000 mgr.gibba045.orlgmj (mgr.34412) 7452 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:09:58.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:09:58 gibba015 bash[29377]: cephadm 2021-03-10T16:09:57.156733+0000 mgr.gibba045.orlgmj (mgr.34412) 7453 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:09:58.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:09:58 gibba015 bash[29377]: cephadm 2021-03-10T16:09:57.158460+0000 mgr.gibba045.orlgmj (mgr.34412) 7454 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:09:58.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:09:58 gibba015 bash[29377]: cephadm 2021-03-10T16:09:57.158527+0000 mgr.gibba045.orlgmj (mgr.34412) 7455 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:09:58.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:09:58 gibba015 bash[29377]: cephadm 2021-03-10T16:09:57.160061+0000 mgr.gibba045.orlgmj (mgr.34412) 7456 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:09:58.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:09:58 gibba015 bash[29377]: cephadm 2021-03-10T16:09:57.160099+0000 mgr.gibba045.orlgmj (mgr.34412) 7457 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:09:58.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:09:58 gibba015 bash[29377]: cephadm 2021-03-10T16:09:57.161744+0000 mgr.gibba045.orlgmj (mgr.34412) 7458 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:09:58.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:09:58 gibba015 bash[29377]: cephadm 2021-03-10T16:09:57.163961+0000 mgr.gibba045.orlgmj (mgr.34412) 7459 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:09:58.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:09:58 gibba015 bash[29377]: cephadm 2021-03-10T16:09:57.163997+0000 mgr.gibba045.orlgmj (mgr.34412) 7460 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:09:58.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:09:58 gibba015 bash[29377]: cephadm 2021-03-10T16:09:57.165378+0000 mgr.gibba045.orlgmj (mgr.34412) 7461 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:09:58.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:09:58 gibba015 bash[29377]: cephadm 2021-03-10T16:09:57.165692+0000 mgr.gibba045.orlgmj (mgr.34412) 7462 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:09:58.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:09:58 gibba015 bash[29377]: cephadm 2021-03-10T16:09:57.167315+0000 mgr.gibba045.orlgmj (mgr.34412) 7463 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:09:58.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:09:58 gibba015 bash[29377]: cephadm 2021-03-10T16:09:57.167350+0000 mgr.gibba045.orlgmj (mgr.34412) 7464 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:09:58.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:09:58 gibba015 bash[29377]: cephadm 2021-03-10T16:09:57.167454+0000 mgr.gibba045.orlgmj (mgr.34412) 7465 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:09:58.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:09:58 gibba015 bash[29377]: audit 2021-03-10T16:09:58.600564+0000 mon.a (mon.0) 1749 : audit [DBG] from='client.? 172.21.2.115:0/3734298728' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:09:58.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:09:58 gibba015 bash[30343]: cluster 2021-03-10T16:09:57.123365+0000 mgr.gibba045.orlgmj (mgr.34412) 7451 : cluster [DBG] pgmap v4244: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:58.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:09:58 gibba015 bash[30343]: cephadm 2021-03-10T16:09:57.154710+0000 mgr.gibba045.orlgmj (mgr.34412) 7452 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:09:58.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:09:58 gibba015 bash[30343]: cephadm 2021-03-10T16:09:57.156733+0000 mgr.gibba045.orlgmj (mgr.34412) 7453 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:09:58.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:09:58 gibba015 bash[30343]: cephadm 2021-03-10T16:09:57.158460+0000 mgr.gibba045.orlgmj (mgr.34412) 7454 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:09:58.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:09:58 gibba015 bash[30343]: cephadm 2021-03-10T16:09:57.158527+0000 mgr.gibba045.orlgmj (mgr.34412) 7455 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:09:58.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:09:58 gibba015 bash[30343]: cephadm 2021-03-10T16:09:57.160061+0000 mgr.gibba045.orlgmj (mgr.34412) 7456 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:09:58.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:09:58 gibba015 bash[30343]: cephadm 2021-03-10T16:09:57.160099+0000 mgr.gibba045.orlgmj (mgr.34412) 7457 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:09:58.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:09:58 gibba015 bash[30343]: cephadm 2021-03-10T16:09:57.161744+0000 mgr.gibba045.orlgmj (mgr.34412) 7458 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:09:58.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:09:58 gibba015 bash[30343]: cephadm 2021-03-10T16:09:57.163961+0000 mgr.gibba045.orlgmj (mgr.34412) 7459 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:09:58.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:09:58 gibba015 bash[30343]: cephadm 2021-03-10T16:09:57.163997+0000 mgr.gibba045.orlgmj (mgr.34412) 7460 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:09:58.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:09:58 gibba015 bash[30343]: cephadm 2021-03-10T16:09:57.165378+0000 mgr.gibba045.orlgmj (mgr.34412) 7461 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:09:58.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:09:58 gibba015 bash[30343]: cephadm 2021-03-10T16:09:57.165692+0000 mgr.gibba045.orlgmj (mgr.34412) 7462 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:09:58.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:09:58 gibba015 bash[30343]: cephadm 2021-03-10T16:09:57.167315+0000 mgr.gibba045.orlgmj (mgr.34412) 7463 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:09:58.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:09:58 gibba015 bash[30343]: cephadm 2021-03-10T16:09:57.167350+0000 mgr.gibba045.orlgmj (mgr.34412) 7464 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:09:58.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:09:58 gibba015 bash[30343]: cephadm 2021-03-10T16:09:57.167454+0000 mgr.gibba045.orlgmj (mgr.34412) 7465 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:09:58.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:09:58 gibba015 bash[30343]: audit 2021-03-10T16:09:58.600564+0000 mon.a (mon.0) 1749 : audit [DBG] from='client.? 172.21.2.115:0/3734298728' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:09:59.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:09:58 gibba045 bash[25517]: cluster 2021-03-10T16:09:57.123365+0000 mgr.gibba045.orlgmj (mgr.34412) 7451 : cluster [DBG] pgmap v4244: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:59.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:09:58 gibba045 bash[25517]: cephadm 2021-03-10T16:09:57.154710+0000 mgr.gibba045.orlgmj (mgr.34412) 7452 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:09:59.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:09:58 gibba045 bash[25517]: cephadm 2021-03-10T16:09:57.156733+0000 mgr.gibba045.orlgmj (mgr.34412) 7453 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:09:59.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:09:58 gibba045 bash[25517]: cephadm 2021-03-10T16:09:57.158460+0000 mgr.gibba045.orlgmj (mgr.34412) 7454 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:09:59.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:09:58 gibba045 bash[25517]: cephadm 2021-03-10T16:09:57.158527+0000 mgr.gibba045.orlgmj (mgr.34412) 7455 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:09:59.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:09:58 gibba045 bash[25517]: cephadm 2021-03-10T16:09:57.160061+0000 mgr.gibba045.orlgmj (mgr.34412) 7456 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:09:59.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:09:58 gibba045 bash[25517]: cephadm 2021-03-10T16:09:57.160099+0000 mgr.gibba045.orlgmj (mgr.34412) 7457 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:09:59.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:09:58 gibba045 bash[25517]: cephadm 2021-03-10T16:09:57.161744+0000 mgr.gibba045.orlgmj (mgr.34412) 7458 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:09:59.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:09:58 gibba045 bash[25517]: cephadm 2021-03-10T16:09:57.163961+0000 mgr.gibba045.orlgmj (mgr.34412) 7459 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:09:59.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:09:58 gibba045 bash[25517]: cephadm 2021-03-10T16:09:57.163997+0000 mgr.gibba045.orlgmj (mgr.34412) 7460 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:09:59.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:09:58 gibba045 bash[25517]: cephadm 2021-03-10T16:09:57.165378+0000 mgr.gibba045.orlgmj (mgr.34412) 7461 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:09:59.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:09:58 gibba045 bash[25517]: cephadm 2021-03-10T16:09:57.165692+0000 mgr.gibba045.orlgmj (mgr.34412) 7462 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:09:59.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:09:58 gibba045 bash[25517]: cephadm 2021-03-10T16:09:57.167315+0000 mgr.gibba045.orlgmj (mgr.34412) 7463 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:09:59.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:09:58 gibba045 bash[25517]: cephadm 2021-03-10T16:09:57.167350+0000 mgr.gibba045.orlgmj (mgr.34412) 7464 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:09:59.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:09:58 gibba045 bash[25517]: cephadm 2021-03-10T16:09:57.167454+0000 mgr.gibba045.orlgmj (mgr.34412) 7465 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:09:59.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:09:58 gibba045 bash[25517]: audit 2021-03-10T16:09:58.600564+0000 mon.a (mon.0) 1749 : audit [DBG] from='client.? 172.21.2.115:0/3734298728' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:09:59.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:09:59 gibba015 bash[29377]: audit 2021-03-10T16:09:58.117596+0000 mgr.gibba045.orlgmj (mgr.34412) 7466 : audit [DBG] from='client.49056 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:09:59.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:09:59 gibba015 bash[29377]: audit 2021-03-10T16:09:58.339754+0000 mgr.gibba045.orlgmj (mgr.34412) 7467 : audit [DBG] from='client.59050 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:09:59.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:09:59 gibba015 bash[30343]: audit 2021-03-10T16:09:58.117596+0000 mgr.gibba045.orlgmj (mgr.34412) 7466 : audit [DBG] from='client.49056 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:09:59.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:09:59 gibba015 bash[30343]: audit 2021-03-10T16:09:58.339754+0000 mgr.gibba045.orlgmj (mgr.34412) 7467 : audit [DBG] from='client.59050 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:10:00.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:09:59 gibba045 bash[25517]: audit 2021-03-10T16:09:58.117596+0000 mgr.gibba045.orlgmj (mgr.34412) 7466 : audit [DBG] from='client.49056 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:10:00.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:09:59 gibba045 bash[25517]: audit 2021-03-10T16:09:58.339754+0000 mgr.gibba045.orlgmj (mgr.34412) 7467 : audit [DBG] from='client.59050 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:10:00.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:10:00 gibba015 bash[29377]: debug 2021-03-10T16:09:59.994+0000 7f21beb4f700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T16:10:00.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:10:00 gibba015 bash[29377]: cluster 2021-03-10T16:09:59.124588+0000 mgr.gibba045.orlgmj (mgr.34412) 7468 : cluster [DBG] pgmap v4245: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:00.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:10:00 gibba015 bash[29377]: cluster 2021-03-10T16:10:00.000196+0000 mon.a (mon.0) 1750 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T16:10:00.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:10:00 gibba015 bash[30343]: cluster 2021-03-10T16:09:59.124588+0000 mgr.gibba045.orlgmj (mgr.34412) 7468 : cluster [DBG] pgmap v4245: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:00.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:10:00 gibba015 bash[30343]: cluster 2021-03-10T16:10:00.000196+0000 mon.a (mon.0) 1750 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T16:10:01.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:10:00 gibba045 bash[25517]: cluster 2021-03-10T16:09:59.124588+0000 mgr.gibba045.orlgmj (mgr.34412) 7468 : cluster [DBG] pgmap v4245: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:01.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:10:00 gibba045 bash[25517]: cluster 2021-03-10T16:10:00.000196+0000 mon.a (mon.0) 1750 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T16:10:02.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:10:02 gibba015 bash[29377]: cluster 2021-03-10T16:10:01.126191+0000 mgr.gibba045.orlgmj (mgr.34412) 7469 : cluster [DBG] pgmap v4246: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:02.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:10:02 gibba015 bash[30343]: cluster 2021-03-10T16:10:01.126191+0000 mgr.gibba045.orlgmj (mgr.34412) 7469 : cluster [DBG] pgmap v4246: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:03.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:10:02 gibba045 bash[25517]: cluster 2021-03-10T16:10:01.126191+0000 mgr.gibba045.orlgmj (mgr.34412) 7469 : cluster [DBG] pgmap v4246: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:04.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:10:04 gibba015 bash[29377]: cluster 2021-03-10T16:10:03.127742+0000 mgr.gibba045.orlgmj (mgr.34412) 7470 : cluster [DBG] pgmap v4247: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:04.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:10:04 gibba015 bash[30343]: cluster 2021-03-10T16:10:03.127742+0000 mgr.gibba045.orlgmj (mgr.34412) 7470 : cluster [DBG] pgmap v4247: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:05.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:10:04 gibba045 bash[25517]: cluster 2021-03-10T16:10:03.127742+0000 mgr.gibba045.orlgmj (mgr.34412) 7470 : cluster [DBG] pgmap v4247: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:06.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:10:06 gibba015 bash[29377]: cluster 2021-03-10T16:10:05.129465+0000 mgr.gibba045.orlgmj (mgr.34412) 7471 : cluster [DBG] pgmap v4248: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:06.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:10:06 gibba015 bash[30343]: cluster 2021-03-10T16:10:05.129465+0000 mgr.gibba045.orlgmj (mgr.34412) 7471 : cluster [DBG] pgmap v4248: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:07.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:10:06 gibba045 bash[25517]: cluster 2021-03-10T16:10:05.129465+0000 mgr.gibba045.orlgmj (mgr.34412) 7471 : cluster [DBG] pgmap v4248: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:08.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:10:08 gibba015 bash[29377]: cluster 2021-03-10T16:10:07.131425+0000 mgr.gibba045.orlgmj (mgr.34412) 7472 : cluster [DBG] pgmap v4249: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:08.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:10:08 gibba015 bash[30343]: cluster 2021-03-10T16:10:07.131425+0000 mgr.gibba045.orlgmj (mgr.34412) 7472 : cluster [DBG] pgmap v4249: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:09.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:10:08 gibba045 bash[25517]: cluster 2021-03-10T16:10:07.131425+0000 mgr.gibba045.orlgmj (mgr.34412) 7472 : cluster [DBG] pgmap v4249: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:10.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:10:10 gibba015 bash[29377]: cluster 2021-03-10T16:10:09.132781+0000 mgr.gibba045.orlgmj (mgr.34412) 7473 : cluster [DBG] pgmap v4250: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:10.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:10:10 gibba015 bash[30343]: cluster 2021-03-10T16:10:09.132781+0000 mgr.gibba045.orlgmj (mgr.34412) 7473 : cluster [DBG] pgmap v4250: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:11.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:10:10 gibba045 bash[25517]: cluster 2021-03-10T16:10:09.132781+0000 mgr.gibba045.orlgmj (mgr.34412) 7473 : cluster [DBG] pgmap v4250: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:12.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:10:12 gibba015 bash[29377]: cluster 2021-03-10T16:10:11.134286+0000 mgr.gibba045.orlgmj (mgr.34412) 7474 : cluster [DBG] pgmap v4251: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:12.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:10:12 gibba015 bash[30343]: cluster 2021-03-10T16:10:11.134286+0000 mgr.gibba045.orlgmj (mgr.34412) 7474 : cluster [DBG] pgmap v4251: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:13.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:10:12 gibba045 bash[25517]: cluster 2021-03-10T16:10:11.134286+0000 mgr.gibba045.orlgmj (mgr.34412) 7474 : cluster [DBG] pgmap v4251: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:13.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:10:13 gibba015 bash[29377]: cephadm 2021-03-10T16:10:12.183062+0000 mgr.gibba045.orlgmj (mgr.34412) 7475 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:10:13.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:10:13 gibba015 bash[30343]: cephadm 2021-03-10T16:10:12.183062+0000 mgr.gibba045.orlgmj (mgr.34412) 7475 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:10:14.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:10:13 gibba045 bash[25517]: cephadm 2021-03-10T16:10:12.183062+0000 mgr.gibba045.orlgmj (mgr.34412) 7475 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:10:14.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:10:14 gibba015 bash[29377]: cluster 2021-03-10T16:10:13.135970+0000 mgr.gibba045.orlgmj (mgr.34412) 7476 : cluster [DBG] pgmap v4252: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:14.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:10:14 gibba015 bash[30343]: cluster 2021-03-10T16:10:13.135970+0000 mgr.gibba045.orlgmj (mgr.34412) 7476 : cluster [DBG] pgmap v4252: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:15.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:10:14 gibba045 bash[25517]: cluster 2021-03-10T16:10:13.135970+0000 mgr.gibba045.orlgmj (mgr.34412) 7476 : cluster [DBG] pgmap v4252: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:16.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:10:16 gibba015 bash[29377]: cluster 2021-03-10T16:10:15.136467+0000 mgr.gibba045.orlgmj (mgr.34412) 7477 : cluster [DBG] pgmap v4253: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:16.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:10:16 gibba015 bash[30343]: cluster 2021-03-10T16:10:15.136467+0000 mgr.gibba045.orlgmj (mgr.34412) 7477 : cluster [DBG] pgmap v4253: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:17.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:10:16 gibba045 bash[25517]: cluster 2021-03-10T16:10:15.136467+0000 mgr.gibba045.orlgmj (mgr.34412) 7477 : cluster [DBG] pgmap v4253: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:19.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:10:18 gibba045 bash[25517]: cluster 2021-03-10T16:10:17.138082+0000 mgr.gibba045.orlgmj (mgr.34412) 7478 : cluster [DBG] pgmap v4254: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:19.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:10:18 gibba015 bash[29377]: cluster 2021-03-10T16:10:17.138082+0000 mgr.gibba045.orlgmj (mgr.34412) 7478 : cluster [DBG] pgmap v4254: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:19.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:10:18 gibba015 bash[30343]: cluster 2021-03-10T16:10:17.138082+0000 mgr.gibba045.orlgmj (mgr.34412) 7478 : cluster [DBG] pgmap v4254: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:21.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:10:20 gibba045 bash[25517]: cluster 2021-03-10T16:10:19.139319+0000 mgr.gibba045.orlgmj (mgr.34412) 7479 : cluster [DBG] pgmap v4255: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:21.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:10:20 gibba015 bash[29377]: cluster 2021-03-10T16:10:19.139319+0000 mgr.gibba045.orlgmj (mgr.34412) 7479 : cluster [DBG] pgmap v4255: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:21.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:10:20 gibba015 bash[30343]: cluster 2021-03-10T16:10:19.139319+0000 mgr.gibba045.orlgmj (mgr.34412) 7479 : cluster [DBG] pgmap v4255: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:23.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:10:22 gibba045 bash[25517]: cluster 2021-03-10T16:10:21.140025+0000 mgr.gibba045.orlgmj (mgr.34412) 7480 : cluster [DBG] pgmap v4256: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:23.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:10:22 gibba015 bash[29377]: cluster 2021-03-10T16:10:21.140025+0000 mgr.gibba045.orlgmj (mgr.34412) 7480 : cluster [DBG] pgmap v4256: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:23.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:10:22 gibba015 bash[30343]: cluster 2021-03-10T16:10:21.140025+0000 mgr.gibba045.orlgmj (mgr.34412) 7480 : cluster [DBG] pgmap v4256: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:25.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:10:24 gibba045 bash[25517]: cluster 2021-03-10T16:10:23.140392+0000 mgr.gibba045.orlgmj (mgr.34412) 7481 : cluster [DBG] pgmap v4257: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:25.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:10:24 gibba015 bash[29377]: cluster 2021-03-10T16:10:23.140392+0000 mgr.gibba045.orlgmj (mgr.34412) 7481 : cluster [DBG] pgmap v4257: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:25.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:10:24 gibba015 bash[30343]: cluster 2021-03-10T16:10:23.140392+0000 mgr.gibba045.orlgmj (mgr.34412) 7481 : cluster [DBG] pgmap v4257: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:27.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:10:26 gibba045 bash[25517]: cluster 2021-03-10T16:10:25.141779+0000 mgr.gibba045.orlgmj (mgr.34412) 7482 : cluster [DBG] pgmap v4258: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:27.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:10:26 gibba015 bash[29377]: cluster 2021-03-10T16:10:25.141779+0000 mgr.gibba045.orlgmj (mgr.34412) 7482 : cluster [DBG] pgmap v4258: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:27.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:10:26 gibba015 bash[30343]: cluster 2021-03-10T16:10:25.141779+0000 mgr.gibba045.orlgmj (mgr.34412) 7482 : cluster [DBG] pgmap v4258: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:28.841 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:10:29.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:10:28 gibba045 bash[25517]: cluster 2021-03-10T16:10:27.143279+0000 mgr.gibba045.orlgmj (mgr.34412) 7483 : cluster [DBG] pgmap v4259: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:29.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:10:28 gibba045 bash[25517]: cephadm 2021-03-10T16:10:27.189400+0000 mgr.gibba045.orlgmj (mgr.34412) 7484 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:10:29.066 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:10:29.067 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 4m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:10:29.067 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 3m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:10:29.067 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:10:29.067 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:10:29.068 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:10:29.068 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:10:29.068 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:10:29.068 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:10:29.069 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 4m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:10:29.069 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 3m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:10:29.069 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:10:29.069 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:10:29.070 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:10:29.070 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:10:29.070 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:10:29.070 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:10:29.070 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:10:29.071 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:10:29.071 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 3m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:10:29.071 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 3m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:10:29.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:10:28 gibba015 bash[29377]: cluster 2021-03-10T16:10:27.143279+0000 mgr.gibba045.orlgmj (mgr.34412) 7483 : cluster [DBG] pgmap v4259: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:29.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:10:28 gibba015 bash[29377]: cephadm 2021-03-10T16:10:27.189400+0000 mgr.gibba045.orlgmj (mgr.34412) 7484 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:10:29.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:10:28 gibba015 bash[30343]: cluster 2021-03-10T16:10:27.143279+0000 mgr.gibba045.orlgmj (mgr.34412) 7483 : cluster [DBG] pgmap v4259: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:29.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:10:28 gibba015 bash[30343]: cephadm 2021-03-10T16:10:27.189400+0000 mgr.gibba045.orlgmj (mgr.34412) 7484 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:10:29.319 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:10:29.320 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:10:29.320 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:10:29.320 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:10:29.321 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:10:29.321 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:10:29.321 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:10:29.321 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:10:29.322 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:10:29.322 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:10:29.322 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:10:29.322 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:10:29.323 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:10:29.323 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:10:29.323 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:10:30.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:10:29 gibba045 bash[25517]: audit 2021-03-10T16:10:28.834804+0000 mgr.gibba045.orlgmj (mgr.34412) 7485 : audit [DBG] from='client.49074 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:10:30.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:10:29 gibba045 bash[25517]: audit 2021-03-10T16:10:29.319252+0000 mon.a (mon.0) 1751 : audit [DBG] from='client.? 172.21.2.115:0/41387911' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:10:30.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:10:29 gibba015 bash[29377]: audit 2021-03-10T16:10:28.834804+0000 mgr.gibba045.orlgmj (mgr.34412) 7485 : audit [DBG] from='client.49074 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:10:30.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:10:29 gibba015 bash[29377]: audit 2021-03-10T16:10:29.319252+0000 mon.a (mon.0) 1751 : audit [DBG] from='client.? 172.21.2.115:0/41387911' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:10:30.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:10:29 gibba015 bash[30343]: audit 2021-03-10T16:10:28.834804+0000 mgr.gibba045.orlgmj (mgr.34412) 7485 : audit [DBG] from='client.49074 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:10:30.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:10:29 gibba015 bash[30343]: audit 2021-03-10T16:10:29.319252+0000 mon.a (mon.0) 1751 : audit [DBG] from='client.? 172.21.2.115:0/41387911' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:10:31.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:10:30 gibba045 bash[25517]: audit 2021-03-10T16:10:29.056791+0000 mgr.gibba045.orlgmj (mgr.34412) 7486 : audit [DBG] from='client.49080 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:10:31.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:10:30 gibba045 bash[25517]: cluster 2021-03-10T16:10:29.144549+0000 mgr.gibba045.orlgmj (mgr.34412) 7487 : cluster [DBG] pgmap v4260: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:31.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:10:30 gibba015 bash[29377]: audit 2021-03-10T16:10:29.056791+0000 mgr.gibba045.orlgmj (mgr.34412) 7486 : audit [DBG] from='client.49080 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:10:31.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:10:30 gibba015 bash[29377]: cluster 2021-03-10T16:10:29.144549+0000 mgr.gibba045.orlgmj (mgr.34412) 7487 : cluster [DBG] pgmap v4260: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:31.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:10:30 gibba015 bash[30343]: audit 2021-03-10T16:10:29.056791+0000 mgr.gibba045.orlgmj (mgr.34412) 7486 : audit [DBG] from='client.49080 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:10:31.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:10:30 gibba015 bash[30343]: cluster 2021-03-10T16:10:29.144549+0000 mgr.gibba045.orlgmj (mgr.34412) 7487 : cluster [DBG] pgmap v4260: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:33.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:10:32 gibba045 bash[25517]: cluster 2021-03-10T16:10:31.145133+0000 mgr.gibba045.orlgmj (mgr.34412) 7488 : cluster [DBG] pgmap v4261: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:33.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:10:32 gibba015 bash[29377]: cluster 2021-03-10T16:10:31.145133+0000 mgr.gibba045.orlgmj (mgr.34412) 7488 : cluster [DBG] pgmap v4261: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:33.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:10:32 gibba015 bash[30343]: cluster 2021-03-10T16:10:31.145133+0000 mgr.gibba045.orlgmj (mgr.34412) 7488 : cluster [DBG] pgmap v4261: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:35.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:10:34 gibba045 bash[25517]: cluster 2021-03-10T16:10:33.145740+0000 mgr.gibba045.orlgmj (mgr.34412) 7489 : cluster [DBG] pgmap v4262: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:35.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:10:34 gibba015 bash[29377]: cluster 2021-03-10T16:10:33.145740+0000 mgr.gibba045.orlgmj (mgr.34412) 7489 : cluster [DBG] pgmap v4262: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:35.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:10:34 gibba015 bash[30343]: cluster 2021-03-10T16:10:33.145740+0000 mgr.gibba045.orlgmj (mgr.34412) 7489 : cluster [DBG] pgmap v4262: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:37.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:10:36 gibba015 bash[29377]: cluster 2021-03-10T16:10:35.147306+0000 mgr.gibba045.orlgmj (mgr.34412) 7490 : cluster [DBG] pgmap v4263: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:37.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:10:36 gibba015 bash[30343]: cluster 2021-03-10T16:10:35.147306+0000 mgr.gibba045.orlgmj (mgr.34412) 7490 : cluster [DBG] pgmap v4263: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:37.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:10:36 gibba045 bash[25517]: cluster 2021-03-10T16:10:35.147306+0000 mgr.gibba045.orlgmj (mgr.34412) 7490 : cluster [DBG] pgmap v4263: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:39.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:10:38 gibba015 bash[29377]: cluster 2021-03-10T16:10:37.149056+0000 mgr.gibba045.orlgmj (mgr.34412) 7491 : cluster [DBG] pgmap v4264: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:39.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:10:38 gibba015 bash[30343]: cluster 2021-03-10T16:10:37.149056+0000 mgr.gibba045.orlgmj (mgr.34412) 7491 : cluster [DBG] pgmap v4264: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:39.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:10:38 gibba045 bash[25517]: cluster 2021-03-10T16:10:37.149056+0000 mgr.gibba045.orlgmj (mgr.34412) 7491 : cluster [DBG] pgmap v4264: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:41.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:10:40 gibba015 bash[29377]: cluster 2021-03-10T16:10:39.149546+0000 mgr.gibba045.orlgmj (mgr.34412) 7492 : cluster [DBG] pgmap v4265: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:41.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:10:40 gibba015 bash[30343]: cluster 2021-03-10T16:10:39.149546+0000 mgr.gibba045.orlgmj (mgr.34412) 7492 : cluster [DBG] pgmap v4265: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:41.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:10:40 gibba045 bash[25517]: cluster 2021-03-10T16:10:39.149546+0000 mgr.gibba045.orlgmj (mgr.34412) 7492 : cluster [DBG] pgmap v4265: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:43.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:10:42 gibba015 bash[29377]: cluster 2021-03-10T16:10:41.151017+0000 mgr.gibba045.orlgmj (mgr.34412) 7493 : cluster [DBG] pgmap v4266: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:43.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:10:42 gibba015 bash[30343]: cluster 2021-03-10T16:10:41.151017+0000 mgr.gibba045.orlgmj (mgr.34412) 7493 : cluster [DBG] pgmap v4266: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:43.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:10:42 gibba045 bash[25517]: cluster 2021-03-10T16:10:41.151017+0000 mgr.gibba045.orlgmj (mgr.34412) 7493 : cluster [DBG] pgmap v4266: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:44.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:10:43 gibba015 bash[29377]: cephadm 2021-03-10T16:10:42.196967+0000 mgr.gibba045.orlgmj (mgr.34412) 7494 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:10:44.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:10:43 gibba015 bash[30343]: cephadm 2021-03-10T16:10:42.196967+0000 mgr.gibba045.orlgmj (mgr.34412) 7494 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:10:44.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:10:43 gibba045 bash[25517]: cephadm 2021-03-10T16:10:42.196967+0000 mgr.gibba045.orlgmj (mgr.34412) 7494 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:10:45.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:10:44 gibba015 bash[29377]: cluster 2021-03-10T16:10:43.152568+0000 mgr.gibba045.orlgmj (mgr.34412) 7495 : cluster [DBG] pgmap v4267: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:45.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:10:44 gibba015 bash[30343]: cluster 2021-03-10T16:10:43.152568+0000 mgr.gibba045.orlgmj (mgr.34412) 7495 : cluster [DBG] pgmap v4267: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:45.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:10:44 gibba045 bash[25517]: cluster 2021-03-10T16:10:43.152568+0000 mgr.gibba045.orlgmj (mgr.34412) 7495 : cluster [DBG] pgmap v4267: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:47.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:10:46 gibba015 bash[29377]: cluster 2021-03-10T16:10:45.153258+0000 mgr.gibba045.orlgmj (mgr.34412) 7496 : cluster [DBG] pgmap v4268: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:47.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:10:46 gibba015 bash[30343]: cluster 2021-03-10T16:10:45.153258+0000 mgr.gibba045.orlgmj (mgr.34412) 7496 : cluster [DBG] pgmap v4268: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:47.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:10:46 gibba045 bash[25517]: cluster 2021-03-10T16:10:45.153258+0000 mgr.gibba045.orlgmj (mgr.34412) 7496 : cluster [DBG] pgmap v4268: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:49.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:10:48 gibba015 bash[29377]: cluster 2021-03-10T16:10:47.153781+0000 mgr.gibba045.orlgmj (mgr.34412) 7497 : cluster [DBG] pgmap v4269: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:49.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:10:48 gibba015 bash[30343]: cluster 2021-03-10T16:10:47.153781+0000 mgr.gibba045.orlgmj (mgr.34412) 7497 : cluster [DBG] pgmap v4269: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:49.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:10:48 gibba045 bash[25517]: cluster 2021-03-10T16:10:47.153781+0000 mgr.gibba045.orlgmj (mgr.34412) 7497 : cluster [DBG] pgmap v4269: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:51.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:10:50 gibba015 bash[29377]: cluster 2021-03-10T16:10:49.155022+0000 mgr.gibba045.orlgmj (mgr.34412) 7498 : cluster [DBG] pgmap v4270: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:51.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:10:50 gibba015 bash[30343]: cluster 2021-03-10T16:10:49.155022+0000 mgr.gibba045.orlgmj (mgr.34412) 7498 : cluster [DBG] pgmap v4270: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:51.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:10:50 gibba045 bash[25517]: cluster 2021-03-10T16:10:49.155022+0000 mgr.gibba045.orlgmj (mgr.34412) 7498 : cluster [DBG] pgmap v4270: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:53.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:10:52 gibba015 bash[29377]: cluster 2021-03-10T16:10:51.155786+0000 mgr.gibba045.orlgmj (mgr.34412) 7499 : cluster [DBG] pgmap v4271: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:53.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:10:52 gibba015 bash[30343]: cluster 2021-03-10T16:10:51.155786+0000 mgr.gibba045.orlgmj (mgr.34412) 7499 : cluster [DBG] pgmap v4271: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:53.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:10:52 gibba045 bash[25517]: cluster 2021-03-10T16:10:51.155786+0000 mgr.gibba045.orlgmj (mgr.34412) 7499 : cluster [DBG] pgmap v4271: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:54.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:10:53 gibba015 bash[29377]: audit 2021-03-10T16:10:53.451971+0000 mon.c (mon.1) 2074 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:10:54.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:10:53 gibba015 bash[29377]: audit 2021-03-10T16:10:53.452594+0000 mon.c (mon.1) 2075 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:10:54.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:10:53 gibba015 bash[29377]: audit 2021-03-10T16:10:53.453118+0000 mon.a (mon.0) 1752 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:10:54.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:10:53 gibba015 bash[29377]: audit 2021-03-10T16:10:53.454193+0000 mon.c (mon.1) 2076 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T16:10:54.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:10:53 gibba015 bash[29377]: audit 2021-03-10T16:10:53.454458+0000 mon.a (mon.0) 1753 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:10:54.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:10:53 gibba015 bash[29377]: audit 2021-03-10T16:10:53.454897+0000 mon.c (mon.1) 2077 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:10:54.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:10:53 gibba015 bash[29377]: audit 2021-03-10T16:10:53.455197+0000 mon.a (mon.0) 1754 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T16:10:54.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:10:53 gibba015 bash[29377]: audit 2021-03-10T16:10:53.455980+0000 mon.c (mon.1) 2078 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:10:54.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:10:53 gibba015 bash[29377]: audit 2021-03-10T16:10:53.456517+0000 mon.a (mon.0) 1755 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:10:54.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:10:53 gibba015 bash[29377]: audit 2021-03-10T16:10:53.456821+0000 mon.c (mon.1) 2079 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:10:54.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:10:53 gibba015 bash[29377]: audit 2021-03-10T16:10:53.457724+0000 mon.a (mon.0) 1756 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:10:54.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:10:53 gibba015 bash[29377]: audit 2021-03-10T16:10:53.458566+0000 mon.a (mon.0) 1757 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:10:54.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:10:53 gibba015 bash[30343]: audit 2021-03-10T16:10:53.451971+0000 mon.c (mon.1) 2074 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:10:54.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:10:53 gibba015 bash[30343]: audit 2021-03-10T16:10:53.452594+0000 mon.c (mon.1) 2075 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:10:54.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:10:53 gibba015 bash[30343]: audit 2021-03-10T16:10:53.453118+0000 mon.a (mon.0) 1752 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:10:54.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:10:53 gibba015 bash[30343]: audit 2021-03-10T16:10:53.454193+0000 mon.c (mon.1) 2076 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T16:10:54.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:10:53 gibba015 bash[30343]: audit 2021-03-10T16:10:53.454458+0000 mon.a (mon.0) 1753 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:10:54.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:10:53 gibba015 bash[30343]: audit 2021-03-10T16:10:53.454897+0000 mon.c (mon.1) 2077 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:10:54.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:10:53 gibba015 bash[30343]: audit 2021-03-10T16:10:53.455197+0000 mon.a (mon.0) 1754 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T16:10:54.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:10:53 gibba015 bash[30343]: audit 2021-03-10T16:10:53.455980+0000 mon.c (mon.1) 2078 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:10:54.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:10:53 gibba015 bash[30343]: audit 2021-03-10T16:10:53.456517+0000 mon.a (mon.0) 1755 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:10:54.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:10:53 gibba015 bash[30343]: audit 2021-03-10T16:10:53.456821+0000 mon.c (mon.1) 2079 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:10:54.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:10:53 gibba015 bash[30343]: audit 2021-03-10T16:10:53.457724+0000 mon.a (mon.0) 1756 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:10:54.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:10:53 gibba015 bash[30343]: audit 2021-03-10T16:10:53.458566+0000 mon.a (mon.0) 1757 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:10:54.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:10:53 gibba045 bash[25517]: audit 2021-03-10T16:10:53.451971+0000 mon.c (mon.1) 2074 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:10:54.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:10:53 gibba045 bash[25517]: audit 2021-03-10T16:10:53.452594+0000 mon.c (mon.1) 2075 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:10:54.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:10:53 gibba045 bash[25517]: audit 2021-03-10T16:10:53.453118+0000 mon.a (mon.0) 1752 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:10:54.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:10:53 gibba045 bash[25517]: audit 2021-03-10T16:10:53.454193+0000 mon.c (mon.1) 2076 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T16:10:54.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:10:53 gibba045 bash[25517]: audit 2021-03-10T16:10:53.454458+0000 mon.a (mon.0) 1753 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:10:54.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:10:53 gibba045 bash[25517]: audit 2021-03-10T16:10:53.454897+0000 mon.c (mon.1) 2077 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:10:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:10:53 gibba045 bash[25517]: audit 2021-03-10T16:10:53.455197+0000 mon.a (mon.0) 1754 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T16:10:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:10:53 gibba045 bash[25517]: audit 2021-03-10T16:10:53.455980+0000 mon.c (mon.1) 2078 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:10:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:10:53 gibba045 bash[25517]: audit 2021-03-10T16:10:53.456517+0000 mon.a (mon.0) 1755 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:10:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:10:53 gibba045 bash[25517]: audit 2021-03-10T16:10:53.456821+0000 mon.c (mon.1) 2079 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:10:54.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:10:53 gibba045 bash[25517]: audit 2021-03-10T16:10:53.457724+0000 mon.a (mon.0) 1756 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:10:54.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:10:53 gibba045 bash[25517]: audit 2021-03-10T16:10:53.458566+0000 mon.a (mon.0) 1757 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:10:55.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:10:54 gibba015 bash[29377]: cluster 2021-03-10T16:10:53.157354+0000 mgr.gibba045.orlgmj (mgr.34412) 7500 : cluster [DBG] pgmap v4272: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:55.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:10:54 gibba015 bash[30343]: cluster 2021-03-10T16:10:53.157354+0000 mgr.gibba045.orlgmj (mgr.34412) 7500 : cluster [DBG] pgmap v4272: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:55.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:10:54 gibba045 bash[25517]: cluster 2021-03-10T16:10:53.157354+0000 mgr.gibba045.orlgmj (mgr.34412) 7500 : cluster [DBG] pgmap v4272: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:57.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:10:56 gibba015 bash[29377]: cluster 2021-03-10T16:10:55.157902+0000 mgr.gibba045.orlgmj (mgr.34412) 7501 : cluster [DBG] pgmap v4273: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:57.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:10:56 gibba015 bash[30343]: cluster 2021-03-10T16:10:55.157902+0000 mgr.gibba045.orlgmj (mgr.34412) 7501 : cluster [DBG] pgmap v4273: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:57.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:10:56 gibba045 bash[25517]: cluster 2021-03-10T16:10:55.157902+0000 mgr.gibba045.orlgmj (mgr.34412) 7501 : cluster [DBG] pgmap v4273: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:58.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:10:57 gibba015 bash[29377]: audit 2021-03-10T16:10:57.211240+0000 mon.c (mon.1) 2080 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:10:58.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:10:57 gibba015 bash[29377]: audit 2021-03-10T16:10:57.441401+0000 mon.a (mon.0) 1758 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:10:58.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:10:57 gibba015 bash[29377]: audit 2021-03-10T16:10:57.444910+0000 mon.c (mon.1) 2081 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:10:58.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:10:57 gibba015 bash[29377]: audit 2021-03-10T16:10:57.446382+0000 mon.c (mon.1) 2082 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:10:58.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:10:57 gibba015 bash[29377]: audit 2021-03-10T16:10:57.448086+0000 mon.c (mon.1) 2083 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:10:58.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:10:57 gibba015 bash[29377]: audit 2021-03-10T16:10:57.449365+0000 mon.c (mon.1) 2084 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:10:58.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:10:57 gibba015 bash[29377]: audit 2021-03-10T16:10:57.452366+0000 mon.c (mon.1) 2085 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:10:58.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:10:57 gibba015 bash[29377]: audit 2021-03-10T16:10:57.453765+0000 mon.c (mon.1) 2086 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:10:58.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:10:57 gibba015 bash[30343]: audit 2021-03-10T16:10:57.211240+0000 mon.c (mon.1) 2080 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:10:58.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:10:57 gibba015 bash[30343]: audit 2021-03-10T16:10:57.441401+0000 mon.a (mon.0) 1758 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:10:58.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:10:57 gibba015 bash[30343]: audit 2021-03-10T16:10:57.444910+0000 mon.c (mon.1) 2081 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:10:58.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:10:57 gibba015 bash[30343]: audit 2021-03-10T16:10:57.446382+0000 mon.c (mon.1) 2082 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:10:58.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:10:57 gibba015 bash[30343]: audit 2021-03-10T16:10:57.448086+0000 mon.c (mon.1) 2083 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:10:58.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:10:57 gibba015 bash[30343]: audit 2021-03-10T16:10:57.449365+0000 mon.c (mon.1) 2084 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:10:58.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:10:57 gibba015 bash[30343]: audit 2021-03-10T16:10:57.452366+0000 mon.c (mon.1) 2085 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:10:58.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:10:57 gibba015 bash[30343]: audit 2021-03-10T16:10:57.453765+0000 mon.c (mon.1) 2086 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:10:58.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:10:57 gibba045 bash[25517]: audit 2021-03-10T16:10:57.211240+0000 mon.c (mon.1) 2080 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:10:58.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:10:57 gibba045 bash[25517]: audit 2021-03-10T16:10:57.441401+0000 mon.a (mon.0) 1758 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:10:58.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:10:57 gibba045 bash[25517]: audit 2021-03-10T16:10:57.444910+0000 mon.c (mon.1) 2081 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:10:58.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:10:57 gibba045 bash[25517]: audit 2021-03-10T16:10:57.446382+0000 mon.c (mon.1) 2082 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:10:58.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:10:57 gibba045 bash[25517]: audit 2021-03-10T16:10:57.448086+0000 mon.c (mon.1) 2083 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:10:58.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:10:57 gibba045 bash[25517]: audit 2021-03-10T16:10:57.449365+0000 mon.c (mon.1) 2084 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:10:58.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:10:57 gibba045 bash[25517]: audit 2021-03-10T16:10:57.452366+0000 mon.c (mon.1) 2085 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:10:58.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:10:57 gibba045 bash[25517]: audit 2021-03-10T16:10:57.453765+0000 mon.c (mon.1) 2086 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:10:59.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:10:58 gibba015 bash[29377]: cluster 2021-03-10T16:10:57.158476+0000 mgr.gibba045.orlgmj (mgr.34412) 7502 : cluster [DBG] pgmap v4274: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:59.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:10:58 gibba015 bash[29377]: cephadm 2021-03-10T16:10:57.217768+0000 mgr.gibba045.orlgmj (mgr.34412) 7503 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:10:59.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:10:58 gibba015 bash[29377]: cephadm 2021-03-10T16:10:57.219470+0000 mgr.gibba045.orlgmj (mgr.34412) 7504 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:10:59.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:10:58 gibba015 bash[29377]: cephadm 2021-03-10T16:10:57.446546+0000 mgr.gibba045.orlgmj (mgr.34412) 7505 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:10:59.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:10:58 gibba015 bash[29377]: cephadm 2021-03-10T16:10:57.448233+0000 mgr.gibba045.orlgmj (mgr.34412) 7506 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:10:59.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:10:58 gibba015 bash[29377]: cephadm 2021-03-10T16:10:57.449842+0000 mgr.gibba045.orlgmj (mgr.34412) 7507 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:10:59.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:10:58 gibba015 bash[29377]: cephadm 2021-03-10T16:10:57.449920+0000 mgr.gibba045.orlgmj (mgr.34412) 7508 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:10:59.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:10:58 gibba015 bash[29377]: cephadm 2021-03-10T16:10:57.451342+0000 mgr.gibba045.orlgmj (mgr.34412) 7509 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:10:59.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:10:58 gibba015 bash[29377]: cephadm 2021-03-10T16:10:57.451381+0000 mgr.gibba045.orlgmj (mgr.34412) 7510 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:10:59.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:10:58 gibba015 bash[29377]: cephadm 2021-03-10T16:10:57.452397+0000 mgr.gibba045.orlgmj (mgr.34412) 7511 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:10:59.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:10:58 gibba015 bash[29377]: cephadm 2021-03-10T16:10:57.454165+0000 mgr.gibba045.orlgmj (mgr.34412) 7512 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:10:59.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:10:58 gibba015 bash[29377]: cephadm 2021-03-10T16:10:57.454202+0000 mgr.gibba045.orlgmj (mgr.34412) 7513 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:10:59.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:10:58 gibba015 bash[29377]: cephadm 2021-03-10T16:10:57.455481+0000 mgr.gibba045.orlgmj (mgr.34412) 7514 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:10:59.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:10:58 gibba015 bash[29377]: cephadm 2021-03-10T16:10:57.455795+0000 mgr.gibba045.orlgmj (mgr.34412) 7515 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:10:59.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:10:58 gibba015 bash[29377]: cephadm 2021-03-10T16:10:57.456846+0000 mgr.gibba045.orlgmj (mgr.34412) 7516 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:10:59.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:10:58 gibba015 bash[29377]: cephadm 2021-03-10T16:10:57.456883+0000 mgr.gibba045.orlgmj (mgr.34412) 7517 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:10:59.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:10:58 gibba015 bash[29377]: cephadm 2021-03-10T16:10:57.456988+0000 mgr.gibba045.orlgmj (mgr.34412) 7518 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:10:59.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:10:58 gibba015 bash[30343]: cluster 2021-03-10T16:10:57.158476+0000 mgr.gibba045.orlgmj (mgr.34412) 7502 : cluster [DBG] pgmap v4274: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:59.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:10:58 gibba015 bash[30343]: cephadm 2021-03-10T16:10:57.217768+0000 mgr.gibba045.orlgmj (mgr.34412) 7503 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:10:59.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:10:58 gibba015 bash[30343]: cephadm 2021-03-10T16:10:57.219470+0000 mgr.gibba045.orlgmj (mgr.34412) 7504 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:10:59.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:10:58 gibba015 bash[30343]: cephadm 2021-03-10T16:10:57.446546+0000 mgr.gibba045.orlgmj (mgr.34412) 7505 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:10:59.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:10:58 gibba015 bash[30343]: cephadm 2021-03-10T16:10:57.448233+0000 mgr.gibba045.orlgmj (mgr.34412) 7506 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:10:59.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:10:58 gibba015 bash[30343]: cephadm 2021-03-10T16:10:57.449842+0000 mgr.gibba045.orlgmj (mgr.34412) 7507 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:10:59.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:10:58 gibba015 bash[30343]: cephadm 2021-03-10T16:10:57.449920+0000 mgr.gibba045.orlgmj (mgr.34412) 7508 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:10:59.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:10:58 gibba015 bash[30343]: cephadm 2021-03-10T16:10:57.451342+0000 mgr.gibba045.orlgmj (mgr.34412) 7509 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:10:59.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:10:58 gibba015 bash[30343]: cephadm 2021-03-10T16:10:57.451381+0000 mgr.gibba045.orlgmj (mgr.34412) 7510 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:10:59.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:10:58 gibba015 bash[30343]: cephadm 2021-03-10T16:10:57.452397+0000 mgr.gibba045.orlgmj (mgr.34412) 7511 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:10:59.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:10:58 gibba015 bash[30343]: cephadm 2021-03-10T16:10:57.454165+0000 mgr.gibba045.orlgmj (mgr.34412) 7512 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:10:59.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:10:58 gibba015 bash[30343]: cephadm 2021-03-10T16:10:57.454202+0000 mgr.gibba045.orlgmj (mgr.34412) 7513 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:10:59.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:10:58 gibba015 bash[30343]: cephadm 2021-03-10T16:10:57.455481+0000 mgr.gibba045.orlgmj (mgr.34412) 7514 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:10:59.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:10:58 gibba015 bash[30343]: cephadm 2021-03-10T16:10:57.455795+0000 mgr.gibba045.orlgmj (mgr.34412) 7515 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:10:59.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:10:58 gibba015 bash[30343]: cephadm 2021-03-10T16:10:57.456846+0000 mgr.gibba045.orlgmj (mgr.34412) 7516 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:10:59.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:10:58 gibba015 bash[30343]: cephadm 2021-03-10T16:10:57.456883+0000 mgr.gibba045.orlgmj (mgr.34412) 7517 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:10:59.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:10:58 gibba015 bash[30343]: cephadm 2021-03-10T16:10:57.456988+0000 mgr.gibba045.orlgmj (mgr.34412) 7518 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:10:59.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:10:58 gibba045 bash[25517]: cluster 2021-03-10T16:10:57.158476+0000 mgr.gibba045.orlgmj (mgr.34412) 7502 : cluster [DBG] pgmap v4274: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:59.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:10:58 gibba045 bash[25517]: cephadm 2021-03-10T16:10:57.217768+0000 mgr.gibba045.orlgmj (mgr.34412) 7503 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:10:59.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:10:58 gibba045 bash[25517]: cephadm 2021-03-10T16:10:57.219470+0000 mgr.gibba045.orlgmj (mgr.34412) 7504 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:10:59.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:10:58 gibba045 bash[25517]: cephadm 2021-03-10T16:10:57.446546+0000 mgr.gibba045.orlgmj (mgr.34412) 7505 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:10:59.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:10:58 gibba045 bash[25517]: cephadm 2021-03-10T16:10:57.448233+0000 mgr.gibba045.orlgmj (mgr.34412) 7506 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:10:59.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:10:58 gibba045 bash[25517]: cephadm 2021-03-10T16:10:57.449842+0000 mgr.gibba045.orlgmj (mgr.34412) 7507 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:10:59.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:10:58 gibba045 bash[25517]: cephadm 2021-03-10T16:10:57.449920+0000 mgr.gibba045.orlgmj (mgr.34412) 7508 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:10:59.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:10:58 gibba045 bash[25517]: cephadm 2021-03-10T16:10:57.451342+0000 mgr.gibba045.orlgmj (mgr.34412) 7509 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:10:59.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:10:58 gibba045 bash[25517]: cephadm 2021-03-10T16:10:57.451381+0000 mgr.gibba045.orlgmj (mgr.34412) 7510 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:10:59.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:10:58 gibba045 bash[25517]: cephadm 2021-03-10T16:10:57.452397+0000 mgr.gibba045.orlgmj (mgr.34412) 7511 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:10:59.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:10:58 gibba045 bash[25517]: cephadm 2021-03-10T16:10:57.454165+0000 mgr.gibba045.orlgmj (mgr.34412) 7512 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:10:59.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:10:58 gibba045 bash[25517]: cephadm 2021-03-10T16:10:57.454202+0000 mgr.gibba045.orlgmj (mgr.34412) 7513 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:10:59.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:10:58 gibba045 bash[25517]: cephadm 2021-03-10T16:10:57.455481+0000 mgr.gibba045.orlgmj (mgr.34412) 7514 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:10:59.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:10:58 gibba045 bash[25517]: cephadm 2021-03-10T16:10:57.455795+0000 mgr.gibba045.orlgmj (mgr.34412) 7515 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:10:59.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:10:58 gibba045 bash[25517]: cephadm 2021-03-10T16:10:57.456846+0000 mgr.gibba045.orlgmj (mgr.34412) 7516 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:10:59.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:10:58 gibba045 bash[25517]: cephadm 2021-03-10T16:10:57.456883+0000 mgr.gibba045.orlgmj (mgr.34412) 7517 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:10:59.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:10:58 gibba045 bash[25517]: cephadm 2021-03-10T16:10:57.456988+0000 mgr.gibba045.orlgmj (mgr.34412) 7518 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:10:59.563 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:10:59.795 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:10:59.795 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 5m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:10:59.795 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 4m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:10:59.796 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:10:59.796 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:10:59.796 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:10:59.796 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:10:59.797 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:10:59.797 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:10:59.797 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 5m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:10:59.797 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 4m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:10:59.797 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:10:59.798 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:10:59.798 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:10:59.798 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:10:59.798 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:10:59.799 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:10:59.799 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:10:59.799 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:10:59.799 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 4m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:10:59.800 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 4m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:11:00.043 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:11:00.043 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:11:00.044 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:11:00.044 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:11:00.044 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:11:00.044 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:11:00.045 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:11:00.045 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:11:00.045 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:11:00.045 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:11:00.045 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:11:00.046 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:11:00.046 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:11:00.046 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:11:00.046 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:11:01.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:11:00 gibba015 bash[29377]: cluster 2021-03-10T16:10:59.159592+0000 mgr.gibba045.orlgmj (mgr.34412) 7519 : cluster [DBG] pgmap v4275: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:01.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:11:00 gibba015 bash[29377]: audit 2021-03-10T16:10:59.556187+0000 mgr.gibba045.orlgmj (mgr.34412) 7520 : audit [DBG] from='client.49092 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:11:01.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:11:00 gibba015 bash[29377]: audit 2021-03-10T16:10:59.784700+0000 mgr.gibba045.orlgmj (mgr.34412) 7521 : audit [DBG] from='client.49098 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:11:01.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:11:00 gibba015 bash[29377]: audit 2021-03-10T16:11:00.042766+0000 mon.c (mon.1) 2087 : audit [DBG] from='client.? 172.21.2.115:0/57488580' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:11:01.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:11:00 gibba015 bash[30343]: cluster 2021-03-10T16:10:59.159592+0000 mgr.gibba045.orlgmj (mgr.34412) 7519 : cluster [DBG] pgmap v4275: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:01.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:11:00 gibba015 bash[30343]: audit 2021-03-10T16:10:59.556187+0000 mgr.gibba045.orlgmj (mgr.34412) 7520 : audit [DBG] from='client.49092 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:11:01.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:11:00 gibba015 bash[30343]: audit 2021-03-10T16:10:59.784700+0000 mgr.gibba045.orlgmj (mgr.34412) 7521 : audit [DBG] from='client.49098 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:11:01.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:11:00 gibba015 bash[30343]: audit 2021-03-10T16:11:00.042766+0000 mon.c (mon.1) 2087 : audit [DBG] from='client.? 172.21.2.115:0/57488580' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:11:01.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:11:00 gibba045 bash[25517]: cluster 2021-03-10T16:10:59.159592+0000 mgr.gibba045.orlgmj (mgr.34412) 7519 : cluster [DBG] pgmap v4275: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:01.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:11:00 gibba045 bash[25517]: audit 2021-03-10T16:10:59.556187+0000 mgr.gibba045.orlgmj (mgr.34412) 7520 : audit [DBG] from='client.49092 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:11:01.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:11:00 gibba045 bash[25517]: audit 2021-03-10T16:10:59.784700+0000 mgr.gibba045.orlgmj (mgr.34412) 7521 : audit [DBG] from='client.49098 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:11:01.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:11:00 gibba045 bash[25517]: audit 2021-03-10T16:11:00.042766+0000 mon.c (mon.1) 2087 : audit [DBG] from='client.? 172.21.2.115:0/57488580' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:11:03.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:11:02 gibba015 bash[29377]: cluster 2021-03-10T16:11:01.161078+0000 mgr.gibba045.orlgmj (mgr.34412) 7522 : cluster [DBG] pgmap v4276: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:03.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:11:02 gibba015 bash[30343]: cluster 2021-03-10T16:11:01.161078+0000 mgr.gibba045.orlgmj (mgr.34412) 7522 : cluster [DBG] pgmap v4276: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:03.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:11:02 gibba045 bash[25517]: cluster 2021-03-10T16:11:01.161078+0000 mgr.gibba045.orlgmj (mgr.34412) 7522 : cluster [DBG] pgmap v4276: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:05.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:11:04 gibba015 bash[29377]: cluster 2021-03-10T16:11:03.161751+0000 mgr.gibba045.orlgmj (mgr.34412) 7523 : cluster [DBG] pgmap v4277: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:05.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:11:04 gibba015 bash[30343]: cluster 2021-03-10T16:11:03.161751+0000 mgr.gibba045.orlgmj (mgr.34412) 7523 : cluster [DBG] pgmap v4277: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:05.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:11:04 gibba045 bash[25517]: cluster 2021-03-10T16:11:03.161751+0000 mgr.gibba045.orlgmj (mgr.34412) 7523 : cluster [DBG] pgmap v4277: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:07.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:11:06 gibba015 bash[29377]: cluster 2021-03-10T16:11:05.163238+0000 mgr.gibba045.orlgmj (mgr.34412) 7524 : cluster [DBG] pgmap v4278: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:07.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:11:06 gibba015 bash[30343]: cluster 2021-03-10T16:11:05.163238+0000 mgr.gibba045.orlgmj (mgr.34412) 7524 : cluster [DBG] pgmap v4278: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:07.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:11:06 gibba045 bash[25517]: cluster 2021-03-10T16:11:05.163238+0000 mgr.gibba045.orlgmj (mgr.34412) 7524 : cluster [DBG] pgmap v4278: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:09.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:11:08 gibba045 bash[25517]: cluster 2021-03-10T16:11:07.165008+0000 mgr.gibba045.orlgmj (mgr.34412) 7525 : cluster [DBG] pgmap v4279: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:09.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:11:08 gibba015 bash[29377]: cluster 2021-03-10T16:11:07.165008+0000 mgr.gibba045.orlgmj (mgr.34412) 7525 : cluster [DBG] pgmap v4279: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:09.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:11:08 gibba015 bash[30343]: cluster 2021-03-10T16:11:07.165008+0000 mgr.gibba045.orlgmj (mgr.34412) 7525 : cluster [DBG] pgmap v4279: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:11.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:11:10 gibba045 bash[25517]: cluster 2021-03-10T16:11:09.165611+0000 mgr.gibba045.orlgmj (mgr.34412) 7526 : cluster [DBG] pgmap v4280: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:11.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:11:10 gibba015 bash[29377]: cluster 2021-03-10T16:11:09.165611+0000 mgr.gibba045.orlgmj (mgr.34412) 7526 : cluster [DBG] pgmap v4280: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:11.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:11:10 gibba015 bash[30343]: cluster 2021-03-10T16:11:09.165611+0000 mgr.gibba045.orlgmj (mgr.34412) 7526 : cluster [DBG] pgmap v4280: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:13.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:11:12 gibba045 bash[25517]: cluster 2021-03-10T16:11:11.166297+0000 mgr.gibba045.orlgmj (mgr.34412) 7527 : cluster [DBG] pgmap v4281: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:13.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:11:12 gibba015 bash[29377]: cluster 2021-03-10T16:11:11.166297+0000 mgr.gibba045.orlgmj (mgr.34412) 7527 : cluster [DBG] pgmap v4281: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:13.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:11:12 gibba015 bash[30343]: cluster 2021-03-10T16:11:11.166297+0000 mgr.gibba045.orlgmj (mgr.34412) 7527 : cluster [DBG] pgmap v4281: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:14.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:11:14 gibba045 bash[25517]: cephadm 2021-03-10T16:11:12.463091+0000 mgr.gibba045.orlgmj (mgr.34412) 7528 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:11:14.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:11:13 gibba015 bash[29377]: cephadm 2021-03-10T16:11:12.463091+0000 mgr.gibba045.orlgmj (mgr.34412) 7528 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:11:14.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:11:14 gibba015 bash[30343]: cephadm 2021-03-10T16:11:12.463091+0000 mgr.gibba045.orlgmj (mgr.34412) 7528 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:11:15.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:11:15 gibba045 bash[25517]: cluster 2021-03-10T16:11:13.167695+0000 mgr.gibba045.orlgmj (mgr.34412) 7529 : cluster [DBG] pgmap v4282: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:15.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:11:15 gibba015 bash[29377]: cluster 2021-03-10T16:11:13.167695+0000 mgr.gibba045.orlgmj (mgr.34412) 7529 : cluster [DBG] pgmap v4282: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:15.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:11:15 gibba015 bash[30343]: cluster 2021-03-10T16:11:13.167695+0000 mgr.gibba045.orlgmj (mgr.34412) 7529 : cluster [DBG] pgmap v4282: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:17.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:11:17 gibba045 bash[25517]: cluster 2021-03-10T16:11:15.168519+0000 mgr.gibba045.orlgmj (mgr.34412) 7530 : cluster [DBG] pgmap v4283: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:17.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:11:17 gibba015 bash[29377]: cluster 2021-03-10T16:11:15.168519+0000 mgr.gibba045.orlgmj (mgr.34412) 7530 : cluster [DBG] pgmap v4283: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:17.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:11:17 gibba015 bash[30343]: cluster 2021-03-10T16:11:15.168519+0000 mgr.gibba045.orlgmj (mgr.34412) 7530 : cluster [DBG] pgmap v4283: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:19.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:11:19 gibba045 bash[25517]: cluster 2021-03-10T16:11:17.170159+0000 mgr.gibba045.orlgmj (mgr.34412) 7531 : cluster [DBG] pgmap v4284: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:19.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:11:19 gibba015 bash[29377]: cluster 2021-03-10T16:11:17.170159+0000 mgr.gibba045.orlgmj (mgr.34412) 7531 : cluster [DBG] pgmap v4284: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:19.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:11:19 gibba015 bash[30343]: cluster 2021-03-10T16:11:17.170159+0000 mgr.gibba045.orlgmj (mgr.34412) 7531 : cluster [DBG] pgmap v4284: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:21.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:11:21 gibba045 bash[25517]: cluster 2021-03-10T16:11:19.170705+0000 mgr.gibba045.orlgmj (mgr.34412) 7532 : cluster [DBG] pgmap v4285: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:21.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:11:21 gibba015 bash[29377]: cluster 2021-03-10T16:11:19.170705+0000 mgr.gibba045.orlgmj (mgr.34412) 7532 : cluster [DBG] pgmap v4285: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:21.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:11:21 gibba015 bash[30343]: cluster 2021-03-10T16:11:19.170705+0000 mgr.gibba045.orlgmj (mgr.34412) 7532 : cluster [DBG] pgmap v4285: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:23.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:11:23 gibba045 bash[25517]: cluster 2021-03-10T16:11:21.171575+0000 mgr.gibba045.orlgmj (mgr.34412) 7533 : cluster [DBG] pgmap v4286: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:23.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:11:23 gibba015 bash[29377]: cluster 2021-03-10T16:11:21.171575+0000 mgr.gibba045.orlgmj (mgr.34412) 7533 : cluster [DBG] pgmap v4286: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:23.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:11:23 gibba015 bash[30343]: cluster 2021-03-10T16:11:21.171575+0000 mgr.gibba045.orlgmj (mgr.34412) 7533 : cluster [DBG] pgmap v4286: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:25.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:11:25 gibba045 bash[25517]: cluster 2021-03-10T16:11:23.173019+0000 mgr.gibba045.orlgmj (mgr.34412) 7534 : cluster [DBG] pgmap v4287: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:25.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:11:25 gibba015 bash[29377]: cluster 2021-03-10T16:11:23.173019+0000 mgr.gibba045.orlgmj (mgr.34412) 7534 : cluster [DBG] pgmap v4287: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:25.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:11:25 gibba015 bash[30343]: cluster 2021-03-10T16:11:23.173019+0000 mgr.gibba045.orlgmj (mgr.34412) 7534 : cluster [DBG] pgmap v4287: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:26.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:11:26 gibba015 bash[29377]: cluster 2021-03-10T16:11:25.174410+0000 mgr.gibba045.orlgmj (mgr.34412) 7535 : cluster [DBG] pgmap v4288: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:26.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:11:26 gibba015 bash[30343]: cluster 2021-03-10T16:11:25.174410+0000 mgr.gibba045.orlgmj (mgr.34412) 7535 : cluster [DBG] pgmap v4288: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:27.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:11:26 gibba045 bash[25517]: cluster 2021-03-10T16:11:25.174410+0000 mgr.gibba045.orlgmj (mgr.34412) 7535 : cluster [DBG] pgmap v4288: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:28.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:11:28 gibba015 bash[29377]: cluster 2021-03-10T16:11:27.175348+0000 mgr.gibba045.orlgmj (mgr.34412) 7536 : cluster [DBG] pgmap v4289: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:28.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:11:28 gibba015 bash[29377]: cephadm 2021-03-10T16:11:27.479171+0000 mgr.gibba045.orlgmj (mgr.34412) 7537 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:11:28.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:11:28 gibba015 bash[30343]: cluster 2021-03-10T16:11:27.175348+0000 mgr.gibba045.orlgmj (mgr.34412) 7536 : cluster [DBG] pgmap v4289: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:28.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:11:28 gibba015 bash[30343]: cephadm 2021-03-10T16:11:27.479171+0000 mgr.gibba045.orlgmj (mgr.34412) 7537 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:11:29.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:11:28 gibba045 bash[25517]: cluster 2021-03-10T16:11:27.175348+0000 mgr.gibba045.orlgmj (mgr.34412) 7536 : cluster [DBG] pgmap v4289: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:29.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:11:28 gibba045 bash[25517]: cephadm 2021-03-10T16:11:27.479171+0000 mgr.gibba045.orlgmj (mgr.34412) 7537 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:11:30.292 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:11:30.519 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:11:30.520 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 5m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:11:30.520 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 4m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:11:30.520 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:11:30.520 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:11:30.521 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:11:30.521 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:11:30.521 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:11:30.521 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:11:30.521 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 5m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:11:30.522 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 4m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:11:30.522 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:11:30.522 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:11:30.522 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:11:30.523 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:11:30.523 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:11:30.523 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:11:30.523 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:11:30.523 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:11:30.524 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 4m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:11:30.524 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 4m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:11:30.773 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:11:30.773 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:11:30.773 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:11:30.773 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:11:30.773 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:11:30.774 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:11:30.774 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:11:30.774 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:11:30.774 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:11:30.775 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:11:30.775 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:11:30.775 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:11:30.775 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:11:30.775 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:11:30.775 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:11:30.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:11:30 gibba015 bash[29377]: cluster 2021-03-10T16:11:29.176499+0000 mgr.gibba045.orlgmj (mgr.34412) 7538 : cluster [DBG] pgmap v4290: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:30.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:11:30 gibba015 bash[30343]: cluster 2021-03-10T16:11:29.176499+0000 mgr.gibba045.orlgmj (mgr.34412) 7538 : cluster [DBG] pgmap v4290: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:31.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:11:30 gibba045 bash[25517]: cluster 2021-03-10T16:11:29.176499+0000 mgr.gibba045.orlgmj (mgr.34412) 7538 : cluster [DBG] pgmap v4290: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:31.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:11:31 gibba015 bash[29377]: audit 2021-03-10T16:11:30.284962+0000 mgr.gibba045.orlgmj (mgr.34412) 7539 : audit [DBG] from='client.49110 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:11:31.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:11:31 gibba015 bash[29377]: audit 2021-03-10T16:11:30.509164+0000 mgr.gibba045.orlgmj (mgr.34412) 7540 : audit [DBG] from='client.49116 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:11:31.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:11:31 gibba015 bash[29377]: audit 2021-03-10T16:11:30.772775+0000 mon.c (mon.1) 2088 : audit [DBG] from='client.? 172.21.2.115:0/1787862787' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:11:31.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:11:31 gibba015 bash[30343]: audit 2021-03-10T16:11:30.284962+0000 mgr.gibba045.orlgmj (mgr.34412) 7539 : audit [DBG] from='client.49110 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:11:31.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:11:31 gibba015 bash[30343]: audit 2021-03-10T16:11:30.509164+0000 mgr.gibba045.orlgmj (mgr.34412) 7540 : audit [DBG] from='client.49116 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:11:31.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:11:31 gibba015 bash[30343]: audit 2021-03-10T16:11:30.772775+0000 mon.c (mon.1) 2088 : audit [DBG] from='client.? 172.21.2.115:0/1787862787' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:11:32.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:11:31 gibba045 bash[25517]: audit 2021-03-10T16:11:30.284962+0000 mgr.gibba045.orlgmj (mgr.34412) 7539 : audit [DBG] from='client.49110 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:11:32.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:11:31 gibba045 bash[25517]: audit 2021-03-10T16:11:30.509164+0000 mgr.gibba045.orlgmj (mgr.34412) 7540 : audit [DBG] from='client.49116 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:11:32.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:11:31 gibba045 bash[25517]: audit 2021-03-10T16:11:30.772775+0000 mon.c (mon.1) 2088 : audit [DBG] from='client.? 172.21.2.115:0/1787862787' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:11:32.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:11:32 gibba015 bash[29377]: cluster 2021-03-10T16:11:31.177931+0000 mgr.gibba045.orlgmj (mgr.34412) 7541 : cluster [DBG] pgmap v4291: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:32.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:11:32 gibba015 bash[30343]: cluster 2021-03-10T16:11:31.177931+0000 mgr.gibba045.orlgmj (mgr.34412) 7541 : cluster [DBG] pgmap v4291: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:33.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:11:32 gibba045 bash[25517]: cluster 2021-03-10T16:11:31.177931+0000 mgr.gibba045.orlgmj (mgr.34412) 7541 : cluster [DBG] pgmap v4291: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:34.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:11:34 gibba015 bash[29377]: cluster 2021-03-10T16:11:33.178876+0000 mgr.gibba045.orlgmj (mgr.34412) 7542 : cluster [DBG] pgmap v4292: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:34.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:11:34 gibba015 bash[30343]: cluster 2021-03-10T16:11:33.178876+0000 mgr.gibba045.orlgmj (mgr.34412) 7542 : cluster [DBG] pgmap v4292: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:35.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:11:34 gibba045 bash[25517]: cluster 2021-03-10T16:11:33.178876+0000 mgr.gibba045.orlgmj (mgr.34412) 7542 : cluster [DBG] pgmap v4292: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:36.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:11:36 gibba015 bash[29377]: cluster 2021-03-10T16:11:35.179584+0000 mgr.gibba045.orlgmj (mgr.34412) 7543 : cluster [DBG] pgmap v4293: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:36.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:11:36 gibba015 bash[30343]: cluster 2021-03-10T16:11:35.179584+0000 mgr.gibba045.orlgmj (mgr.34412) 7543 : cluster [DBG] pgmap v4293: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:37.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:11:36 gibba045 bash[25517]: cluster 2021-03-10T16:11:35.179584+0000 mgr.gibba045.orlgmj (mgr.34412) 7543 : cluster [DBG] pgmap v4293: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:38.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:11:38 gibba015 bash[29377]: cluster 2021-03-10T16:11:37.181130+0000 mgr.gibba045.orlgmj (mgr.34412) 7544 : cluster [DBG] pgmap v4294: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:38.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:11:38 gibba015 bash[30343]: cluster 2021-03-10T16:11:37.181130+0000 mgr.gibba045.orlgmj (mgr.34412) 7544 : cluster [DBG] pgmap v4294: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:39.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:11:38 gibba045 bash[25517]: cluster 2021-03-10T16:11:37.181130+0000 mgr.gibba045.orlgmj (mgr.34412) 7544 : cluster [DBG] pgmap v4294: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:40.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:11:40 gibba015 bash[29377]: cluster 2021-03-10T16:11:39.181912+0000 mgr.gibba045.orlgmj (mgr.34412) 7545 : cluster [DBG] pgmap v4295: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:40.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:11:40 gibba015 bash[30343]: cluster 2021-03-10T16:11:39.181912+0000 mgr.gibba045.orlgmj (mgr.34412) 7545 : cluster [DBG] pgmap v4295: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:41.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:11:40 gibba045 bash[25517]: cluster 2021-03-10T16:11:39.181912+0000 mgr.gibba045.orlgmj (mgr.34412) 7545 : cluster [DBG] pgmap v4295: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:42.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:11:42 gibba045 bash[25517]: cluster 2021-03-10T16:11:41.183428+0000 mgr.gibba045.orlgmj (mgr.34412) 7546 : cluster [DBG] pgmap v4296: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:42.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:11:42 gibba015 bash[29377]: cluster 2021-03-10T16:11:41.183428+0000 mgr.gibba045.orlgmj (mgr.34412) 7546 : cluster [DBG] pgmap v4296: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:42.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:11:42 gibba015 bash[30343]: cluster 2021-03-10T16:11:41.183428+0000 mgr.gibba045.orlgmj (mgr.34412) 7546 : cluster [DBG] pgmap v4296: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:43.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:11:43 gibba015 bash[29377]: cephadm 2021-03-10T16:11:42.495354+0000 mgr.gibba045.orlgmj (mgr.34412) 7547 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:11:43.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:11:43 gibba015 bash[30343]: cephadm 2021-03-10T16:11:42.495354+0000 mgr.gibba045.orlgmj (mgr.34412) 7547 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:11:44.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:11:43 gibba045 bash[25517]: cephadm 2021-03-10T16:11:42.495354+0000 mgr.gibba045.orlgmj (mgr.34412) 7547 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:11:44.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:11:44 gibba015 bash[29377]: cluster 2021-03-10T16:11:43.184241+0000 mgr.gibba045.orlgmj (mgr.34412) 7548 : cluster [DBG] pgmap v4297: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:44.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:11:44 gibba015 bash[30343]: cluster 2021-03-10T16:11:43.184241+0000 mgr.gibba045.orlgmj (mgr.34412) 7548 : cluster [DBG] pgmap v4297: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:45.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:11:44 gibba045 bash[25517]: cluster 2021-03-10T16:11:43.184241+0000 mgr.gibba045.orlgmj (mgr.34412) 7548 : cluster [DBG] pgmap v4297: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:46.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:11:46 gibba015 bash[29377]: cluster 2021-03-10T16:11:45.185043+0000 mgr.gibba045.orlgmj (mgr.34412) 7549 : cluster [DBG] pgmap v4298: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:46.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:11:46 gibba015 bash[30343]: cluster 2021-03-10T16:11:45.185043+0000 mgr.gibba045.orlgmj (mgr.34412) 7549 : cluster [DBG] pgmap v4298: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:47.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:11:46 gibba045 bash[25517]: cluster 2021-03-10T16:11:45.185043+0000 mgr.gibba045.orlgmj (mgr.34412) 7549 : cluster [DBG] pgmap v4298: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:48.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:11:48 gibba015 bash[29377]: cluster 2021-03-10T16:11:47.186440+0000 mgr.gibba045.orlgmj (mgr.34412) 7550 : cluster [DBG] pgmap v4299: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:48.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:11:48 gibba015 bash[30343]: cluster 2021-03-10T16:11:47.186440+0000 mgr.gibba045.orlgmj (mgr.34412) 7550 : cluster [DBG] pgmap v4299: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:49.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:11:48 gibba045 bash[25517]: cluster 2021-03-10T16:11:47.186440+0000 mgr.gibba045.orlgmj (mgr.34412) 7550 : cluster [DBG] pgmap v4299: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:50.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:11:50 gibba015 bash[29377]: cluster 2021-03-10T16:11:49.187663+0000 mgr.gibba045.orlgmj (mgr.34412) 7551 : cluster [DBG] pgmap v4300: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:50.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:11:50 gibba015 bash[30343]: cluster 2021-03-10T16:11:49.187663+0000 mgr.gibba045.orlgmj (mgr.34412) 7551 : cluster [DBG] pgmap v4300: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:51.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:11:50 gibba045 bash[25517]: cluster 2021-03-10T16:11:49.187663+0000 mgr.gibba045.orlgmj (mgr.34412) 7551 : cluster [DBG] pgmap v4300: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:52.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:11:52 gibba015 bash[29377]: cluster 2021-03-10T16:11:51.188619+0000 mgr.gibba045.orlgmj (mgr.34412) 7552 : cluster [DBG] pgmap v4301: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:52.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:11:52 gibba015 bash[30343]: cluster 2021-03-10T16:11:51.188619+0000 mgr.gibba045.orlgmj (mgr.34412) 7552 : cluster [DBG] pgmap v4301: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:53.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:11:52 gibba045 bash[25517]: cluster 2021-03-10T16:11:51.188619+0000 mgr.gibba045.orlgmj (mgr.34412) 7552 : cluster [DBG] pgmap v4301: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:53.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:11:53 gibba015 bash[29377]: audit 2021-03-10T16:11:53.459053+0000 mon.c (mon.1) 2089 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:11:53.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:11:53 gibba015 bash[29377]: audit 2021-03-10T16:11:53.459693+0000 mon.c (mon.1) 2090 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:11:53.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:11:53 gibba015 bash[29377]: audit 2021-03-10T16:11:53.460153+0000 mon.a (mon.0) 1759 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:11:53.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:11:53 gibba015 bash[29377]: audit 2021-03-10T16:11:53.460282+0000 mon.c (mon.1) 2091 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T16:11:53.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:11:53 gibba015 bash[29377]: audit 2021-03-10T16:11:53.461151+0000 mon.c (mon.1) 2092 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:11:53.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:11:53 gibba015 bash[29377]: audit 2021-03-10T16:11:53.461604+0000 mon.a (mon.0) 1760 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:11:53.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:11:53 gibba015 bash[29377]: audit 2021-03-10T16:11:53.461839+0000 mon.c (mon.1) 2093 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:11:53.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:11:53 gibba015 bash[29377]: audit 2021-03-10T16:11:53.462540+0000 mon.a (mon.0) 1761 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T16:11:53.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:11:53 gibba015 bash[29377]: audit 2021-03-10T16:11:53.462881+0000 mon.c (mon.1) 2094 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:11:53.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:11:53 gibba015 bash[29377]: audit 2021-03-10T16:11:53.463592+0000 mon.a (mon.0) 1762 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:11:53.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:11:53 gibba015 bash[29377]: audit 2021-03-10T16:11:53.464574+0000 mon.a (mon.0) 1763 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:11:53.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:11:53 gibba015 bash[29377]: audit 2021-03-10T16:11:53.465318+0000 mon.a (mon.0) 1764 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:11:53.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:11:53 gibba015 bash[30343]: audit 2021-03-10T16:11:53.459053+0000 mon.c (mon.1) 2089 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:11:53.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:11:53 gibba015 bash[30343]: audit 2021-03-10T16:11:53.459693+0000 mon.c (mon.1) 2090 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:11:53.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:11:53 gibba015 bash[30343]: audit 2021-03-10T16:11:53.460153+0000 mon.a (mon.0) 1759 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:11:53.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:11:53 gibba015 bash[30343]: audit 2021-03-10T16:11:53.460282+0000 mon.c (mon.1) 2091 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T16:11:53.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:11:53 gibba015 bash[30343]: audit 2021-03-10T16:11:53.461151+0000 mon.c (mon.1) 2092 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:11:53.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:11:53 gibba015 bash[30343]: audit 2021-03-10T16:11:53.461604+0000 mon.a (mon.0) 1760 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:11:53.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:11:53 gibba015 bash[30343]: audit 2021-03-10T16:11:53.461839+0000 mon.c (mon.1) 2093 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:11:53.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:11:53 gibba015 bash[30343]: audit 2021-03-10T16:11:53.462540+0000 mon.a (mon.0) 1761 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T16:11:53.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:11:53 gibba015 bash[30343]: audit 2021-03-10T16:11:53.462881+0000 mon.c (mon.1) 2094 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:11:53.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:11:53 gibba015 bash[30343]: audit 2021-03-10T16:11:53.463592+0000 mon.a (mon.0) 1762 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:11:53.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:11:53 gibba015 bash[30343]: audit 2021-03-10T16:11:53.464574+0000 mon.a (mon.0) 1763 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:11:53.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:11:53 gibba015 bash[30343]: audit 2021-03-10T16:11:53.465318+0000 mon.a (mon.0) 1764 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:11:54.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:11:53 gibba045 bash[25517]: audit 2021-03-10T16:11:53.459053+0000 mon.c (mon.1) 2089 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:11:54.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:11:53 gibba045 bash[25517]: audit 2021-03-10T16:11:53.459693+0000 mon.c (mon.1) 2090 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:11:54.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:11:53 gibba045 bash[25517]: audit 2021-03-10T16:11:53.460153+0000 mon.a (mon.0) 1759 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:11:54.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:11:53 gibba045 bash[25517]: audit 2021-03-10T16:11:53.460282+0000 mon.c (mon.1) 2091 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T16:11:54.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:11:53 gibba045 bash[25517]: audit 2021-03-10T16:11:53.461151+0000 mon.c (mon.1) 2092 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:11:54.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:11:53 gibba045 bash[25517]: audit 2021-03-10T16:11:53.461604+0000 mon.a (mon.0) 1760 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:11:54.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:11:53 gibba045 bash[25517]: audit 2021-03-10T16:11:53.461839+0000 mon.c (mon.1) 2093 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:11:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:11:53 gibba045 bash[25517]: audit 2021-03-10T16:11:53.462540+0000 mon.a (mon.0) 1761 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T16:11:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:11:53 gibba045 bash[25517]: audit 2021-03-10T16:11:53.462881+0000 mon.c (mon.1) 2094 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:11:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:11:53 gibba045 bash[25517]: audit 2021-03-10T16:11:53.463592+0000 mon.a (mon.0) 1762 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:11:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:11:53 gibba045 bash[25517]: audit 2021-03-10T16:11:53.464574+0000 mon.a (mon.0) 1763 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:11:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:11:53 gibba045 bash[25517]: audit 2021-03-10T16:11:53.465318+0000 mon.a (mon.0) 1764 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:11:54.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:11:54 gibba015 bash[29377]: cluster 2021-03-10T16:11:53.189856+0000 mgr.gibba045.orlgmj (mgr.34412) 7553 : cluster [DBG] pgmap v4302: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:54.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:11:54 gibba015 bash[30343]: cluster 2021-03-10T16:11:53.189856+0000 mgr.gibba045.orlgmj (mgr.34412) 7553 : cluster [DBG] pgmap v4302: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:55.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:11:54 gibba045 bash[25517]: cluster 2021-03-10T16:11:53.189856+0000 mgr.gibba045.orlgmj (mgr.34412) 7553 : cluster [DBG] pgmap v4302: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:56.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:11:56 gibba015 bash[29377]: cluster 2021-03-10T16:11:55.191495+0000 mgr.gibba045.orlgmj (mgr.34412) 7554 : cluster [DBG] pgmap v4303: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:56.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:11:56 gibba015 bash[30343]: cluster 2021-03-10T16:11:55.191495+0000 mgr.gibba045.orlgmj (mgr.34412) 7554 : cluster [DBG] pgmap v4303: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:57.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:11:56 gibba045 bash[25517]: cluster 2021-03-10T16:11:55.191495+0000 mgr.gibba045.orlgmj (mgr.34412) 7554 : cluster [DBG] pgmap v4303: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:57.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:11:57 gibba015 bash[29377]: audit 2021-03-10T16:11:57.496121+0000 mon.c (mon.1) 2095 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:11:57.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:11:57 gibba015 bash[30343]: audit 2021-03-10T16:11:57.496121+0000 mon.c (mon.1) 2095 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:11:58.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:11:57 gibba045 bash[25517]: audit 2021-03-10T16:11:57.496121+0000 mon.c (mon.1) 2095 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:11:59.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:11:58 gibba045 bash[25517]: cluster 2021-03-10T16:11:57.192526+0000 mgr.gibba045.orlgmj (mgr.34412) 7555 : cluster [DBG] pgmap v4304: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:59.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:11:58 gibba045 bash[25517]: cephadm 2021-03-10T16:11:57.504628+0000 mgr.gibba045.orlgmj (mgr.34412) 7556 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:11:59.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:11:58 gibba045 bash[25517]: cephadm 2021-03-10T16:11:57.506149+0000 mgr.gibba045.orlgmj (mgr.34412) 7557 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:11:59.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:11:58 gibba045 bash[25517]: audit 2021-03-10T16:11:57.731909+0000 mon.a (mon.0) 1765 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:11:59.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:11:58 gibba045 bash[25517]: audit 2021-03-10T16:11:57.739465+0000 mon.c (mon.1) 2096 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:11:59.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:11:58 gibba045 bash[25517]: audit 2021-03-10T16:11:57.740934+0000 mon.c (mon.1) 2097 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:11:59.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:11:58 gibba045 bash[25517]: cephadm 2021-03-10T16:11:57.740944+0000 mgr.gibba045.orlgmj (mgr.34412) 7558 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:11:59.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:11:58 gibba045 bash[25517]: audit 2021-03-10T16:11:57.742271+0000 mon.c (mon.1) 2098 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:11:59.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:11:58 gibba045 bash[25517]: cephadm 2021-03-10T16:11:57.742936+0000 mgr.gibba045.orlgmj (mgr.34412) 7559 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:11:59.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:11:58 gibba045 bash[25517]: cephadm 2021-03-10T16:11:57.744103+0000 mgr.gibba045.orlgmj (mgr.34412) 7560 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:11:59.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:11:58 gibba045 bash[25517]: cephadm 2021-03-10T16:11:57.744141+0000 mgr.gibba045.orlgmj (mgr.34412) 7561 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:11:59.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:11:58 gibba045 bash[25517]: audit 2021-03-10T16:11:57.744205+0000 mon.c (mon.1) 2099 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:11:59.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:11:58 gibba045 bash[25517]: cephadm 2021-03-10T16:11:57.746053+0000 mgr.gibba045.orlgmj (mgr.34412) 7562 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:11:59.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:11:58 gibba045 bash[25517]: cephadm 2021-03-10T16:11:57.746094+0000 mgr.gibba045.orlgmj (mgr.34412) 7563 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:11:59.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:11:58 gibba045 bash[25517]: cephadm 2021-03-10T16:11:57.747623+0000 mgr.gibba045.orlgmj (mgr.34412) 7564 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:11:59.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:11:58 gibba045 bash[25517]: audit 2021-03-10T16:11:57.748118+0000 mon.c (mon.1) 2100 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:11:59.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:11:58 gibba045 bash[25517]: cephadm 2021-03-10T16:11:57.749722+0000 mgr.gibba045.orlgmj (mgr.34412) 7565 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:11:59.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:11:58 gibba045 bash[25517]: cephadm 2021-03-10T16:11:57.749758+0000 mgr.gibba045.orlgmj (mgr.34412) 7566 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:11:59.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:11:58 gibba045 bash[25517]: audit 2021-03-10T16:11:57.749980+0000 mon.c (mon.1) 2101 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:11:59.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:11:58 gibba045 bash[25517]: cephadm 2021-03-10T16:11:57.751524+0000 mgr.gibba045.orlgmj (mgr.34412) 7567 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:11:59.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:11:58 gibba045 bash[25517]: cephadm 2021-03-10T16:11:57.751917+0000 mgr.gibba045.orlgmj (mgr.34412) 7568 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:11:59.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:11:58 gibba045 bash[25517]: cephadm 2021-03-10T16:11:57.753775+0000 mgr.gibba045.orlgmj (mgr.34412) 7569 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:11:59.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:11:58 gibba045 bash[25517]: cephadm 2021-03-10T16:11:57.753818+0000 mgr.gibba045.orlgmj (mgr.34412) 7570 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:11:59.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:11:58 gibba045 bash[25517]: cephadm 2021-03-10T16:11:57.753948+0000 mgr.gibba045.orlgmj (mgr.34412) 7571 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:11:59.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:11:58 gibba015 bash[29377]: cluster 2021-03-10T16:11:57.192526+0000 mgr.gibba045.orlgmj (mgr.34412) 7555 : cluster [DBG] pgmap v4304: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:59.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:11:58 gibba015 bash[29377]: cephadm 2021-03-10T16:11:57.504628+0000 mgr.gibba045.orlgmj (mgr.34412) 7556 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:11:59.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:11:58 gibba015 bash[29377]: cephadm 2021-03-10T16:11:57.506149+0000 mgr.gibba045.orlgmj (mgr.34412) 7557 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:11:59.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:11:58 gibba015 bash[29377]: audit 2021-03-10T16:11:57.731909+0000 mon.a (mon.0) 1765 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:11:59.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:11:58 gibba015 bash[29377]: audit 2021-03-10T16:11:57.739465+0000 mon.c (mon.1) 2096 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:11:59.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:11:58 gibba015 bash[29377]: audit 2021-03-10T16:11:57.740934+0000 mon.c (mon.1) 2097 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:11:59.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:11:58 gibba015 bash[29377]: cephadm 2021-03-10T16:11:57.740944+0000 mgr.gibba045.orlgmj (mgr.34412) 7558 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:11:59.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:11:58 gibba015 bash[29377]: audit 2021-03-10T16:11:57.742271+0000 mon.c (mon.1) 2098 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:11:59.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:11:58 gibba015 bash[29377]: cephadm 2021-03-10T16:11:57.742936+0000 mgr.gibba045.orlgmj (mgr.34412) 7559 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:11:59.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:11:58 gibba015 bash[29377]: cephadm 2021-03-10T16:11:57.744103+0000 mgr.gibba045.orlgmj (mgr.34412) 7560 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:11:59.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:11:58 gibba015 bash[29377]: cephadm 2021-03-10T16:11:57.744141+0000 mgr.gibba045.orlgmj (mgr.34412) 7561 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:11:59.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:11:58 gibba015 bash[29377]: audit 2021-03-10T16:11:57.744205+0000 mon.c (mon.1) 2099 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:11:59.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:11:58 gibba015 bash[29377]: cephadm 2021-03-10T16:11:57.746053+0000 mgr.gibba045.orlgmj (mgr.34412) 7562 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:11:59.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:11:58 gibba015 bash[29377]: cephadm 2021-03-10T16:11:57.746094+0000 mgr.gibba045.orlgmj (mgr.34412) 7563 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:11:59.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:11:58 gibba015 bash[29377]: cephadm 2021-03-10T16:11:57.747623+0000 mgr.gibba045.orlgmj (mgr.34412) 7564 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:11:59.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:11:58 gibba015 bash[29377]: audit 2021-03-10T16:11:57.748118+0000 mon.c (mon.1) 2100 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:11:59.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:11:58 gibba015 bash[29377]: cephadm 2021-03-10T16:11:57.749722+0000 mgr.gibba045.orlgmj (mgr.34412) 7565 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:11:59.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:11:58 gibba015 bash[29377]: cephadm 2021-03-10T16:11:57.749758+0000 mgr.gibba045.orlgmj (mgr.34412) 7566 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:11:59.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:11:58 gibba015 bash[29377]: audit 2021-03-10T16:11:57.749980+0000 mon.c (mon.1) 2101 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:11:59.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:11:58 gibba015 bash[29377]: cephadm 2021-03-10T16:11:57.751524+0000 mgr.gibba045.orlgmj (mgr.34412) 7567 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:11:59.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:11:58 gibba015 bash[30343]: cluster 2021-03-10T16:11:57.192526+0000 mgr.gibba045.orlgmj (mgr.34412) 7555 : cluster [DBG] pgmap v4304: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:59.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:11:58 gibba015 bash[30343]: cephadm 2021-03-10T16:11:57.504628+0000 mgr.gibba045.orlgmj (mgr.34412) 7556 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:11:59.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:11:58 gibba015 bash[30343]: cephadm 2021-03-10T16:11:57.506149+0000 mgr.gibba045.orlgmj (mgr.34412) 7557 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:11:59.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:11:58 gibba015 bash[30343]: audit 2021-03-10T16:11:57.731909+0000 mon.a (mon.0) 1765 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:11:59.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:11:58 gibba015 bash[30343]: audit 2021-03-10T16:11:57.739465+0000 mon.c (mon.1) 2096 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:11:59.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:11:58 gibba015 bash[30343]: audit 2021-03-10T16:11:57.740934+0000 mon.c (mon.1) 2097 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:11:59.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:11:58 gibba015 bash[30343]: cephadm 2021-03-10T16:11:57.740944+0000 mgr.gibba045.orlgmj (mgr.34412) 7558 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:11:59.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:11:58 gibba015 bash[30343]: audit 2021-03-10T16:11:57.742271+0000 mon.c (mon.1) 2098 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:11:59.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:11:58 gibba015 bash[30343]: cephadm 2021-03-10T16:11:57.742936+0000 mgr.gibba045.orlgmj (mgr.34412) 7559 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:11:59.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:11:58 gibba015 bash[30343]: cephadm 2021-03-10T16:11:57.744103+0000 mgr.gibba045.orlgmj (mgr.34412) 7560 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:11:59.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:11:58 gibba015 bash[30343]: cephadm 2021-03-10T16:11:57.744141+0000 mgr.gibba045.orlgmj (mgr.34412) 7561 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:11:59.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:11:58 gibba015 bash[30343]: audit 2021-03-10T16:11:57.744205+0000 mon.c (mon.1) 2099 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:11:59.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:11:58 gibba015 bash[30343]: cephadm 2021-03-10T16:11:57.746053+0000 mgr.gibba045.orlgmj (mgr.34412) 7562 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:11:59.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:11:58 gibba015 bash[30343]: cephadm 2021-03-10T16:11:57.746094+0000 mgr.gibba045.orlgmj (mgr.34412) 7563 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:11:59.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:11:58 gibba015 bash[30343]: cephadm 2021-03-10T16:11:57.747623+0000 mgr.gibba045.orlgmj (mgr.34412) 7564 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:11:59.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:11:58 gibba015 bash[30343]: audit 2021-03-10T16:11:57.748118+0000 mon.c (mon.1) 2100 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:11:59.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:11:58 gibba015 bash[30343]: cephadm 2021-03-10T16:11:57.749722+0000 mgr.gibba045.orlgmj (mgr.34412) 7565 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:11:59.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:11:58 gibba015 bash[30343]: cephadm 2021-03-10T16:11:57.749758+0000 mgr.gibba045.orlgmj (mgr.34412) 7566 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:11:59.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:11:58 gibba015 bash[30343]: audit 2021-03-10T16:11:57.749980+0000 mon.c (mon.1) 2101 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:11:59.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:11:58 gibba015 bash[30343]: cephadm 2021-03-10T16:11:57.751524+0000 mgr.gibba045.orlgmj (mgr.34412) 7567 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:11:59.231 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:11:58 gibba015 bash[29377]: cephadm 2021-03-10T16:11:57.751917+0000 mgr.gibba045.orlgmj (mgr.34412) 7568 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:11:59.231 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:11:58 gibba015 bash[29377]: cephadm 2021-03-10T16:11:57.753775+0000 mgr.gibba045.orlgmj (mgr.34412) 7569 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:11:59.231 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:11:58 gibba015 bash[29377]: cephadm 2021-03-10T16:11:57.753818+0000 mgr.gibba045.orlgmj (mgr.34412) 7570 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:11:59.231 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:11:58 gibba015 bash[29377]: cephadm 2021-03-10T16:11:57.753948+0000 mgr.gibba045.orlgmj (mgr.34412) 7571 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:11:59.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:11:58 gibba015 bash[30343]: cephadm 2021-03-10T16:11:57.751917+0000 mgr.gibba045.orlgmj (mgr.34412) 7568 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:11:59.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:11:58 gibba015 bash[30343]: cephadm 2021-03-10T16:11:57.753775+0000 mgr.gibba045.orlgmj (mgr.34412) 7569 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:11:59.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:11:58 gibba015 bash[30343]: cephadm 2021-03-10T16:11:57.753818+0000 mgr.gibba045.orlgmj (mgr.34412) 7570 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:11:59.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:11:58 gibba015 bash[30343]: cephadm 2021-03-10T16:11:57.753948+0000 mgr.gibba045.orlgmj (mgr.34412) 7571 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:12:01.011 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:12:01.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:12:00 gibba045 bash[25517]: cluster 2021-03-10T16:11:59.193177+0000 mgr.gibba045.orlgmj (mgr.34412) 7572 : cluster [DBG] pgmap v4305: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:01.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:12:00 gibba015 bash[29377]: cluster 2021-03-10T16:11:59.193177+0000 mgr.gibba045.orlgmj (mgr.34412) 7572 : cluster [DBG] pgmap v4305: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:01.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:12:00 gibba015 bash[30343]: cluster 2021-03-10T16:11:59.193177+0000 mgr.gibba045.orlgmj (mgr.34412) 7572 : cluster [DBG] pgmap v4305: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:01.238 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:12:01.239 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 6m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:12:01.239 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 5m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:12:01.239 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:12:01.239 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:12:01.239 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:12:01.240 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:12:01.240 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:12:01.240 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:12:01.240 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 6m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:12:01.240 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 5m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:12:01.241 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:12:01.241 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:12:01.241 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:12:01.241 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:12:01.242 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:12:01.242 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:12:01.242 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:12:01.242 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:12:01.243 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 5m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:12:01.243 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 5m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:12:01.487 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:12:01.488 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:12:01.488 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:12:01.488 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:12:01.489 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:12:01.489 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:12:01.489 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:12:01.489 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:12:01.489 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:12:01.490 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:12:01.490 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:12:01.490 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:12:01.490 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:12:01.491 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:12:01.491 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:12:02.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:12:01 gibba045 bash[25517]: audit 2021-03-10T16:12:01.004598+0000 mgr.gibba045.orlgmj (mgr.34412) 7573 : audit [DBG] from='client.59116 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:12:02.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:12:01 gibba045 bash[25517]: audit 2021-03-10T16:12:01.487582+0000 mon.c (mon.1) 2102 : audit [DBG] from='client.? 172.21.2.115:0/494971215' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:12:02.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:12:01 gibba015 bash[29377]: audit 2021-03-10T16:12:01.004598+0000 mgr.gibba045.orlgmj (mgr.34412) 7573 : audit [DBG] from='client.59116 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:12:02.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:12:01 gibba015 bash[29377]: audit 2021-03-10T16:12:01.487582+0000 mon.c (mon.1) 2102 : audit [DBG] from='client.? 172.21.2.115:0/494971215' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:12:02.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:12:01 gibba015 bash[30343]: audit 2021-03-10T16:12:01.004598+0000 mgr.gibba045.orlgmj (mgr.34412) 7573 : audit [DBG] from='client.59116 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:12:02.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:12:01 gibba015 bash[30343]: audit 2021-03-10T16:12:01.487582+0000 mon.c (mon.1) 2102 : audit [DBG] from='client.? 172.21.2.115:0/494971215' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:12:03.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:12:02 gibba045 bash[25517]: cluster 2021-03-10T16:12:01.194560+0000 mgr.gibba045.orlgmj (mgr.34412) 7574 : cluster [DBG] pgmap v4306: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:03.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:12:02 gibba045 bash[25517]: audit 2021-03-10T16:12:01.228409+0000 mgr.gibba045.orlgmj (mgr.34412) 7575 : audit [DBG] from='client.49134 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:12:03.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:12:02 gibba015 bash[29377]: cluster 2021-03-10T16:12:01.194560+0000 mgr.gibba045.orlgmj (mgr.34412) 7574 : cluster [DBG] pgmap v4306: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:03.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:12:02 gibba015 bash[29377]: audit 2021-03-10T16:12:01.228409+0000 mgr.gibba045.orlgmj (mgr.34412) 7575 : audit [DBG] from='client.49134 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:12:03.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:12:02 gibba015 bash[30343]: cluster 2021-03-10T16:12:01.194560+0000 mgr.gibba045.orlgmj (mgr.34412) 7574 : cluster [DBG] pgmap v4306: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:03.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:12:02 gibba015 bash[30343]: audit 2021-03-10T16:12:01.228409+0000 mgr.gibba045.orlgmj (mgr.34412) 7575 : audit [DBG] from='client.49134 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:12:05.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:12:04 gibba045 bash[25517]: cluster 2021-03-10T16:12:03.196068+0000 mgr.gibba045.orlgmj (mgr.34412) 7576 : cluster [DBG] pgmap v4307: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:05.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:12:04 gibba015 bash[29377]: cluster 2021-03-10T16:12:03.196068+0000 mgr.gibba045.orlgmj (mgr.34412) 7576 : cluster [DBG] pgmap v4307: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:05.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:12:04 gibba015 bash[30343]: cluster 2021-03-10T16:12:03.196068+0000 mgr.gibba045.orlgmj (mgr.34412) 7576 : cluster [DBG] pgmap v4307: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:07.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:12:06 gibba045 bash[25517]: cluster 2021-03-10T16:12:05.197592+0000 mgr.gibba045.orlgmj (mgr.34412) 7577 : cluster [DBG] pgmap v4308: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:07.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:12:06 gibba015 bash[29377]: cluster 2021-03-10T16:12:05.197592+0000 mgr.gibba045.orlgmj (mgr.34412) 7577 : cluster [DBG] pgmap v4308: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:07.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:12:06 gibba015 bash[30343]: cluster 2021-03-10T16:12:05.197592+0000 mgr.gibba045.orlgmj (mgr.34412) 7577 : cluster [DBG] pgmap v4308: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:09.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:12:08 gibba045 bash[25517]: cluster 2021-03-10T16:12:07.198399+0000 mgr.gibba045.orlgmj (mgr.34412) 7578 : cluster [DBG] pgmap v4309: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:09.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:12:08 gibba015 bash[29377]: cluster 2021-03-10T16:12:07.198399+0000 mgr.gibba045.orlgmj (mgr.34412) 7578 : cluster [DBG] pgmap v4309: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:09.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:12:08 gibba015 bash[30343]: cluster 2021-03-10T16:12:07.198399+0000 mgr.gibba045.orlgmj (mgr.34412) 7578 : cluster [DBG] pgmap v4309: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:11.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:12:10 gibba045 bash[25517]: cluster 2021-03-10T16:12:09.199241+0000 mgr.gibba045.orlgmj (mgr.34412) 7579 : cluster [DBG] pgmap v4310: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:11.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:12:10 gibba015 bash[29377]: cluster 2021-03-10T16:12:09.199241+0000 mgr.gibba045.orlgmj (mgr.34412) 7579 : cluster [DBG] pgmap v4310: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:11.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:12:10 gibba015 bash[30343]: cluster 2021-03-10T16:12:09.199241+0000 mgr.gibba045.orlgmj (mgr.34412) 7579 : cluster [DBG] pgmap v4310: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:13.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:12:12 gibba045 bash[25517]: cluster 2021-03-10T16:12:11.200941+0000 mgr.gibba045.orlgmj (mgr.34412) 7580 : cluster [DBG] pgmap v4311: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:13.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:12:12 gibba015 bash[29377]: cluster 2021-03-10T16:12:11.200941+0000 mgr.gibba045.orlgmj (mgr.34412) 7580 : cluster [DBG] pgmap v4311: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:13.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:12:12 gibba015 bash[30343]: cluster 2021-03-10T16:12:11.200941+0000 mgr.gibba045.orlgmj (mgr.34412) 7580 : cluster [DBG] pgmap v4311: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:14.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:12:13 gibba015 bash[29377]: cephadm 2021-03-10T16:12:12.769651+0000 mgr.gibba045.orlgmj (mgr.34412) 7581 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:12:14.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:12:13 gibba015 bash[30343]: cephadm 2021-03-10T16:12:12.769651+0000 mgr.gibba045.orlgmj (mgr.34412) 7581 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:12:14.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:12:13 gibba045 bash[25517]: cephadm 2021-03-10T16:12:12.769651+0000 mgr.gibba045.orlgmj (mgr.34412) 7581 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:12:15.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:12:14 gibba015 bash[29377]: cluster 2021-03-10T16:12:13.202438+0000 mgr.gibba045.orlgmj (mgr.34412) 7582 : cluster [DBG] pgmap v4312: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:15.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:12:14 gibba015 bash[30343]: cluster 2021-03-10T16:12:13.202438+0000 mgr.gibba045.orlgmj (mgr.34412) 7582 : cluster [DBG] pgmap v4312: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:15.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:12:14 gibba045 bash[25517]: cluster 2021-03-10T16:12:13.202438+0000 mgr.gibba045.orlgmj (mgr.34412) 7582 : cluster [DBG] pgmap v4312: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:17.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:12:16 gibba015 bash[29377]: cluster 2021-03-10T16:12:15.203440+0000 mgr.gibba045.orlgmj (mgr.34412) 7583 : cluster [DBG] pgmap v4313: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:17.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:12:16 gibba015 bash[30343]: cluster 2021-03-10T16:12:15.203440+0000 mgr.gibba045.orlgmj (mgr.34412) 7583 : cluster [DBG] pgmap v4313: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:17.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:12:16 gibba045 bash[25517]: cluster 2021-03-10T16:12:15.203440+0000 mgr.gibba045.orlgmj (mgr.34412) 7583 : cluster [DBG] pgmap v4313: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:19.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:12:18 gibba015 bash[29377]: cluster 2021-03-10T16:12:17.205080+0000 mgr.gibba045.orlgmj (mgr.34412) 7584 : cluster [DBG] pgmap v4314: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:19.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:12:18 gibba015 bash[30343]: cluster 2021-03-10T16:12:17.205080+0000 mgr.gibba045.orlgmj (mgr.34412) 7584 : cluster [DBG] pgmap v4314: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:19.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:12:18 gibba045 bash[25517]: cluster 2021-03-10T16:12:17.205080+0000 mgr.gibba045.orlgmj (mgr.34412) 7584 : cluster [DBG] pgmap v4314: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:21.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:12:20 gibba015 bash[29377]: cluster 2021-03-10T16:12:19.206315+0000 mgr.gibba045.orlgmj (mgr.34412) 7585 : cluster [DBG] pgmap v4315: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:21.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:12:20 gibba015 bash[30343]: cluster 2021-03-10T16:12:19.206315+0000 mgr.gibba045.orlgmj (mgr.34412) 7585 : cluster [DBG] pgmap v4315: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:21.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:12:20 gibba045 bash[25517]: cluster 2021-03-10T16:12:19.206315+0000 mgr.gibba045.orlgmj (mgr.34412) 7585 : cluster [DBG] pgmap v4315: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:23.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:12:22 gibba015 bash[29377]: cluster 2021-03-10T16:12:21.207432+0000 mgr.gibba045.orlgmj (mgr.34412) 7586 : cluster [DBG] pgmap v4316: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:23.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:12:22 gibba015 bash[30343]: cluster 2021-03-10T16:12:21.207432+0000 mgr.gibba045.orlgmj (mgr.34412) 7586 : cluster [DBG] pgmap v4316: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:23.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:12:22 gibba045 bash[25517]: cluster 2021-03-10T16:12:21.207432+0000 mgr.gibba045.orlgmj (mgr.34412) 7586 : cluster [DBG] pgmap v4316: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:25.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:12:24 gibba015 bash[29377]: cluster 2021-03-10T16:12:23.208422+0000 mgr.gibba045.orlgmj (mgr.34412) 7587 : cluster [DBG] pgmap v4317: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:25.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:12:24 gibba015 bash[30343]: cluster 2021-03-10T16:12:23.208422+0000 mgr.gibba045.orlgmj (mgr.34412) 7587 : cluster [DBG] pgmap v4317: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:25.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:12:24 gibba045 bash[25517]: cluster 2021-03-10T16:12:23.208422+0000 mgr.gibba045.orlgmj (mgr.34412) 7587 : cluster [DBG] pgmap v4317: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:27.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:12:26 gibba015 bash[29377]: cluster 2021-03-10T16:12:25.209996+0000 mgr.gibba045.orlgmj (mgr.34412) 7588 : cluster [DBG] pgmap v4318: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:27.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:12:26 gibba015 bash[30343]: cluster 2021-03-10T16:12:25.209996+0000 mgr.gibba045.orlgmj (mgr.34412) 7588 : cluster [DBG] pgmap v4318: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:27.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:12:26 gibba045 bash[25517]: cluster 2021-03-10T16:12:25.209996+0000 mgr.gibba045.orlgmj (mgr.34412) 7588 : cluster [DBG] pgmap v4318: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:29.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:12:28 gibba015 bash[29377]: cluster 2021-03-10T16:12:27.211724+0000 mgr.gibba045.orlgmj (mgr.34412) 7589 : cluster [DBG] pgmap v4319: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:29.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:12:28 gibba015 bash[29377]: cephadm 2021-03-10T16:12:27.785327+0000 mgr.gibba045.orlgmj (mgr.34412) 7590 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:12:29.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:12:28 gibba015 bash[30343]: cluster 2021-03-10T16:12:27.211724+0000 mgr.gibba045.orlgmj (mgr.34412) 7589 : cluster [DBG] pgmap v4319: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:29.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:12:28 gibba015 bash[30343]: cephadm 2021-03-10T16:12:27.785327+0000 mgr.gibba045.orlgmj (mgr.34412) 7590 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:12:29.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:12:28 gibba045 bash[25517]: cluster 2021-03-10T16:12:27.211724+0000 mgr.gibba045.orlgmj (mgr.34412) 7589 : cluster [DBG] pgmap v4319: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:29.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:12:28 gibba045 bash[25517]: cephadm 2021-03-10T16:12:27.785327+0000 mgr.gibba045.orlgmj (mgr.34412) 7590 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:12:31.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:12:30 gibba015 bash[29377]: cluster 2021-03-10T16:12:29.213127+0000 mgr.gibba045.orlgmj (mgr.34412) 7591 : cluster [DBG] pgmap v4320: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:31.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:12:30 gibba015 bash[30343]: cluster 2021-03-10T16:12:29.213127+0000 mgr.gibba045.orlgmj (mgr.34412) 7591 : cluster [DBG] pgmap v4320: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:31.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:12:30 gibba045 bash[25517]: cluster 2021-03-10T16:12:29.213127+0000 mgr.gibba045.orlgmj (mgr.34412) 7591 : cluster [DBG] pgmap v4320: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:31.728 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:12:31.952 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:12:31.952 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 6m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:12:31.953 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 5m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:12:31.953 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:12:31.953 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:12:31.953 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:12:31.954 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:12:31.954 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:12:31.954 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:12:31.954 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 6m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:12:31.955 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 5m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:12:31.955 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:12:31.955 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:12:31.955 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:12:31.956 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:12:31.956 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:12:31.956 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:12:31.956 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:12:31.956 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:12:31.957 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 5m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:12:31.957 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 5m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:12:32.201 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:12:32.202 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:12:32.202 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:12:32.202 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:12:32.202 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:12:32.203 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:12:32.203 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:12:32.203 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:12:32.203 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:12:32.204 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:12:32.204 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:12:32.204 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:12:32.204 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:12:32.204 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:12:32.205 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:12:33.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:12:32 gibba015 bash[29377]: cluster 2021-03-10T16:12:31.214692+0000 mgr.gibba045.orlgmj (mgr.34412) 7592 : cluster [DBG] pgmap v4321: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:33.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:12:32 gibba015 bash[29377]: audit 2021-03-10T16:12:31.721567+0000 mgr.gibba045.orlgmj (mgr.34412) 7593 : audit [DBG] from='client.49146 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:12:33.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:12:32 gibba015 bash[29377]: audit 2021-03-10T16:12:31.944542+0000 mgr.gibba045.orlgmj (mgr.34412) 7594 : audit [DBG] from='client.49152 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:12:33.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:12:32 gibba015 bash[29377]: audit 2021-03-10T16:12:32.201227+0000 mon.a (mon.0) 1766 : audit [DBG] from='client.? 172.21.2.115:0/265338982' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:12:33.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:12:32 gibba015 bash[30343]: cluster 2021-03-10T16:12:31.214692+0000 mgr.gibba045.orlgmj (mgr.34412) 7592 : cluster [DBG] pgmap v4321: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:33.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:12:32 gibba015 bash[30343]: audit 2021-03-10T16:12:31.721567+0000 mgr.gibba045.orlgmj (mgr.34412) 7593 : audit [DBG] from='client.49146 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:12:33.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:12:32 gibba015 bash[30343]: audit 2021-03-10T16:12:31.944542+0000 mgr.gibba045.orlgmj (mgr.34412) 7594 : audit [DBG] from='client.49152 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:12:33.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:12:32 gibba015 bash[30343]: audit 2021-03-10T16:12:32.201227+0000 mon.a (mon.0) 1766 : audit [DBG] from='client.? 172.21.2.115:0/265338982' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:12:33.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:12:32 gibba045 bash[25517]: cluster 2021-03-10T16:12:31.214692+0000 mgr.gibba045.orlgmj (mgr.34412) 7592 : cluster [DBG] pgmap v4321: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:33.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:12:32 gibba045 bash[25517]: audit 2021-03-10T16:12:31.721567+0000 mgr.gibba045.orlgmj (mgr.34412) 7593 : audit [DBG] from='client.49146 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:12:33.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:12:32 gibba045 bash[25517]: audit 2021-03-10T16:12:31.944542+0000 mgr.gibba045.orlgmj (mgr.34412) 7594 : audit [DBG] from='client.49152 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:12:33.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:12:32 gibba045 bash[25517]: audit 2021-03-10T16:12:32.201227+0000 mon.a (mon.0) 1766 : audit [DBG] from='client.? 172.21.2.115:0/265338982' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:12:35.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:12:34 gibba015 bash[29377]: cluster 2021-03-10T16:12:33.215846+0000 mgr.gibba045.orlgmj (mgr.34412) 7595 : cluster [DBG] pgmap v4322: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:35.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:12:34 gibba015 bash[30343]: cluster 2021-03-10T16:12:33.215846+0000 mgr.gibba045.orlgmj (mgr.34412) 7595 : cluster [DBG] pgmap v4322: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:35.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:12:34 gibba045 bash[25517]: cluster 2021-03-10T16:12:33.215846+0000 mgr.gibba045.orlgmj (mgr.34412) 7595 : cluster [DBG] pgmap v4322: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:37.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:12:36 gibba015 bash[29377]: cluster 2021-03-10T16:12:35.217508+0000 mgr.gibba045.orlgmj (mgr.34412) 7596 : cluster [DBG] pgmap v4323: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:37.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:12:36 gibba015 bash[30343]: cluster 2021-03-10T16:12:35.217508+0000 mgr.gibba045.orlgmj (mgr.34412) 7596 : cluster [DBG] pgmap v4323: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:37.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:12:36 gibba045 bash[25517]: cluster 2021-03-10T16:12:35.217508+0000 mgr.gibba045.orlgmj (mgr.34412) 7596 : cluster [DBG] pgmap v4323: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:39.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:12:38 gibba015 bash[29377]: cluster 2021-03-10T16:12:37.219126+0000 mgr.gibba045.orlgmj (mgr.34412) 7597 : cluster [DBG] pgmap v4324: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:39.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:12:38 gibba015 bash[30343]: cluster 2021-03-10T16:12:37.219126+0000 mgr.gibba045.orlgmj (mgr.34412) 7597 : cluster [DBG] pgmap v4324: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:39.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:12:38 gibba045 bash[25517]: cluster 2021-03-10T16:12:37.219126+0000 mgr.gibba045.orlgmj (mgr.34412) 7597 : cluster [DBG] pgmap v4324: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:41.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:12:40 gibba015 bash[29377]: cluster 2021-03-10T16:12:39.220284+0000 mgr.gibba045.orlgmj (mgr.34412) 7598 : cluster [DBG] pgmap v4325: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:41.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:12:40 gibba015 bash[30343]: cluster 2021-03-10T16:12:39.220284+0000 mgr.gibba045.orlgmj (mgr.34412) 7598 : cluster [DBG] pgmap v4325: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:41.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:12:40 gibba045 bash[25517]: cluster 2021-03-10T16:12:39.220284+0000 mgr.gibba045.orlgmj (mgr.34412) 7598 : cluster [DBG] pgmap v4325: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:43.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:12:42 gibba045 bash[25517]: cluster 2021-03-10T16:12:41.221888+0000 mgr.gibba045.orlgmj (mgr.34412) 7599 : cluster [DBG] pgmap v4326: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:43.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:12:42 gibba015 bash[29377]: cluster 2021-03-10T16:12:41.221888+0000 mgr.gibba045.orlgmj (mgr.34412) 7599 : cluster [DBG] pgmap v4326: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:43.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:12:42 gibba015 bash[30343]: cluster 2021-03-10T16:12:41.221888+0000 mgr.gibba045.orlgmj (mgr.34412) 7599 : cluster [DBG] pgmap v4326: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:44.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:12:43 gibba015 bash[29377]: cephadm 2021-03-10T16:12:42.801190+0000 mgr.gibba045.orlgmj (mgr.34412) 7600 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:12:44.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:12:43 gibba015 bash[30343]: cephadm 2021-03-10T16:12:42.801190+0000 mgr.gibba045.orlgmj (mgr.34412) 7600 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:12:44.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:12:43 gibba045 bash[25517]: cephadm 2021-03-10T16:12:42.801190+0000 mgr.gibba045.orlgmj (mgr.34412) 7600 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:12:45.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:12:44 gibba015 bash[29377]: cluster 2021-03-10T16:12:43.223519+0000 mgr.gibba045.orlgmj (mgr.34412) 7601 : cluster [DBG] pgmap v4327: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:45.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:12:44 gibba015 bash[30343]: cluster 2021-03-10T16:12:43.223519+0000 mgr.gibba045.orlgmj (mgr.34412) 7601 : cluster [DBG] pgmap v4327: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:45.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:12:44 gibba045 bash[25517]: cluster 2021-03-10T16:12:43.223519+0000 mgr.gibba045.orlgmj (mgr.34412) 7601 : cluster [DBG] pgmap v4327: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:47.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:12:46 gibba045 bash[25517]: cluster 2021-03-10T16:12:45.225164+0000 mgr.gibba045.orlgmj (mgr.34412) 7602 : cluster [DBG] pgmap v4328: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:47.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:12:46 gibba015 bash[29377]: cluster 2021-03-10T16:12:45.225164+0000 mgr.gibba045.orlgmj (mgr.34412) 7602 : cluster [DBG] pgmap v4328: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:47.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:12:46 gibba015 bash[30343]: cluster 2021-03-10T16:12:45.225164+0000 mgr.gibba045.orlgmj (mgr.34412) 7602 : cluster [DBG] pgmap v4328: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:49.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:12:48 gibba045 bash[25517]: cluster 2021-03-10T16:12:47.226330+0000 mgr.gibba045.orlgmj (mgr.34412) 7603 : cluster [DBG] pgmap v4329: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:49.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:12:48 gibba015 bash[29377]: cluster 2021-03-10T16:12:47.226330+0000 mgr.gibba045.orlgmj (mgr.34412) 7603 : cluster [DBG] pgmap v4329: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:49.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:12:48 gibba015 bash[30343]: cluster 2021-03-10T16:12:47.226330+0000 mgr.gibba045.orlgmj (mgr.34412) 7603 : cluster [DBG] pgmap v4329: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:51.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:12:50 gibba045 bash[25517]: cluster 2021-03-10T16:12:49.227495+0000 mgr.gibba045.orlgmj (mgr.34412) 7604 : cluster [DBG] pgmap v4330: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:51.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:12:50 gibba015 bash[29377]: cluster 2021-03-10T16:12:49.227495+0000 mgr.gibba045.orlgmj (mgr.34412) 7604 : cluster [DBG] pgmap v4330: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:51.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:12:50 gibba015 bash[30343]: cluster 2021-03-10T16:12:49.227495+0000 mgr.gibba045.orlgmj (mgr.34412) 7604 : cluster [DBG] pgmap v4330: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:53.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:12:53 gibba045 bash[25517]: cluster 2021-03-10T16:12:51.229227+0000 mgr.gibba045.orlgmj (mgr.34412) 7605 : cluster [DBG] pgmap v4331: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:53.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:12:52 gibba015 bash[29377]: cluster 2021-03-10T16:12:51.229227+0000 mgr.gibba045.orlgmj (mgr.34412) 7605 : cluster [DBG] pgmap v4331: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:53.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:12:52 gibba015 bash[30343]: cluster 2021-03-10T16:12:51.229227+0000 mgr.gibba045.orlgmj (mgr.34412) 7605 : cluster [DBG] pgmap v4331: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:54.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:12:54 gibba045 bash[25517]: audit 2021-03-10T16:12:53.465183+0000 mon.c (mon.1) 2103 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:12:54.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:12:54 gibba045 bash[25517]: audit 2021-03-10T16:12:53.465819+0000 mon.c (mon.1) 2104 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:12:54.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:12:54 gibba045 bash[25517]: audit 2021-03-10T16:12:53.466294+0000 mon.a (mon.0) 1767 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:12:54.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:12:54 gibba045 bash[25517]: audit 2021-03-10T16:12:53.467356+0000 mon.c (mon.1) 2105 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T16:12:54.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:12:54 gibba045 bash[25517]: audit 2021-03-10T16:12:53.467521+0000 mon.a (mon.0) 1768 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:12:54.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:12:54 gibba045 bash[25517]: audit 2021-03-10T16:12:53.468099+0000 mon.c (mon.1) 2106 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:12:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:12:54 gibba045 bash[25517]: audit 2021-03-10T16:12:53.468533+0000 mon.a (mon.0) 1769 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T16:12:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:12:54 gibba045 bash[25517]: audit 2021-03-10T16:12:53.468988+0000 mon.c (mon.1) 2107 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T16:12:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:12:54 gibba045 bash[25517]: audit 2021-03-10T16:12:53.469806+0000 mon.a (mon.0) 1770 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:12:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:12:54 gibba045 bash[25517]: audit 2021-03-10T16:12:53.469863+0000 mon.c (mon.1) 2108 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:12:54.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:12:54 gibba045 bash[25517]: audit 2021-03-10T16:12:53.470925+0000 mon.a (mon.0) 1771 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T16:12:54.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:12:54 gibba045 bash[25517]: audit 2021-03-10T16:12:53.471828+0000 mon.a (mon.0) 1772 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:12:54.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:12:54 gibba015 bash[29377]: audit 2021-03-10T16:12:53.465183+0000 mon.c (mon.1) 2103 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:12:54.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:12:54 gibba015 bash[29377]: audit 2021-03-10T16:12:53.465819+0000 mon.c (mon.1) 2104 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:12:54.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:12:54 gibba015 bash[29377]: audit 2021-03-10T16:12:53.466294+0000 mon.a (mon.0) 1767 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:12:54.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:12:54 gibba015 bash[29377]: audit 2021-03-10T16:12:53.467356+0000 mon.c (mon.1) 2105 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T16:12:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:12:54 gibba015 bash[29377]: audit 2021-03-10T16:12:53.467521+0000 mon.a (mon.0) 1768 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:12:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:12:54 gibba015 bash[29377]: audit 2021-03-10T16:12:53.468099+0000 mon.c (mon.1) 2106 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:12:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:12:54 gibba015 bash[29377]: audit 2021-03-10T16:12:53.468533+0000 mon.a (mon.0) 1769 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T16:12:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:12:54 gibba015 bash[29377]: audit 2021-03-10T16:12:53.468988+0000 mon.c (mon.1) 2107 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T16:12:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:12:54 gibba015 bash[29377]: audit 2021-03-10T16:12:53.469806+0000 mon.a (mon.0) 1770 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:12:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:12:54 gibba015 bash[29377]: audit 2021-03-10T16:12:53.469863+0000 mon.c (mon.1) 2108 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:12:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:12:54 gibba015 bash[29377]: audit 2021-03-10T16:12:53.470925+0000 mon.a (mon.0) 1771 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T16:12:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:12:54 gibba015 bash[29377]: audit 2021-03-10T16:12:53.471828+0000 mon.a (mon.0) 1772 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:12:54.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:12:54 gibba015 bash[30343]: audit 2021-03-10T16:12:53.465183+0000 mon.c (mon.1) 2103 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:12:54.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:12:54 gibba015 bash[30343]: audit 2021-03-10T16:12:53.465819+0000 mon.c (mon.1) 2104 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:12:54.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:12:54 gibba015 bash[30343]: audit 2021-03-10T16:12:53.466294+0000 mon.a (mon.0) 1767 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:12:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:12:54 gibba015 bash[30343]: audit 2021-03-10T16:12:53.467356+0000 mon.c (mon.1) 2105 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T16:12:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:12:54 gibba015 bash[30343]: audit 2021-03-10T16:12:53.467521+0000 mon.a (mon.0) 1768 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:12:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:12:54 gibba015 bash[30343]: audit 2021-03-10T16:12:53.468099+0000 mon.c (mon.1) 2106 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:12:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:12:54 gibba015 bash[30343]: audit 2021-03-10T16:12:53.468533+0000 mon.a (mon.0) 1769 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T16:12:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:12:54 gibba015 bash[30343]: audit 2021-03-10T16:12:53.468988+0000 mon.c (mon.1) 2107 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T16:12:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:12:54 gibba015 bash[30343]: audit 2021-03-10T16:12:53.469806+0000 mon.a (mon.0) 1770 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:12:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:12:54 gibba015 bash[30343]: audit 2021-03-10T16:12:53.469863+0000 mon.c (mon.1) 2108 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:12:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:12:54 gibba015 bash[30343]: audit 2021-03-10T16:12:53.470925+0000 mon.a (mon.0) 1771 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T16:12:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:12:54 gibba015 bash[30343]: audit 2021-03-10T16:12:53.471828+0000 mon.a (mon.0) 1772 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:12:55.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:12:55 gibba045 bash[25517]: cluster 2021-03-10T16:12:53.230823+0000 mgr.gibba045.orlgmj (mgr.34412) 7606 : cluster [DBG] pgmap v4332: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:55.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:12:55 gibba015 bash[29377]: cluster 2021-03-10T16:12:53.230823+0000 mgr.gibba045.orlgmj (mgr.34412) 7606 : cluster [DBG] pgmap v4332: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:55.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:12:55 gibba015 bash[30343]: cluster 2021-03-10T16:12:53.230823+0000 mgr.gibba045.orlgmj (mgr.34412) 7606 : cluster [DBG] pgmap v4332: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:57.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:12:57 gibba045 bash[25517]: cluster 2021-03-10T16:12:55.232316+0000 mgr.gibba045.orlgmj (mgr.34412) 7607 : cluster [DBG] pgmap v4333: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:57.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:12:57 gibba015 bash[29377]: cluster 2021-03-10T16:12:55.232316+0000 mgr.gibba045.orlgmj (mgr.34412) 7607 : cluster [DBG] pgmap v4333: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:57.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:12:57 gibba015 bash[30343]: cluster 2021-03-10T16:12:55.232316+0000 mgr.gibba045.orlgmj (mgr.34412) 7607 : cluster [DBG] pgmap v4333: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:58.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:12:58 gibba045 bash[25517]: audit 2021-03-10T16:12:57.815854+0000 mon.c (mon.1) 2109 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:12:58.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:12:58 gibba015 bash[29377]: audit 2021-03-10T16:12:57.815854+0000 mon.c (mon.1) 2109 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:12:58.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:12:58 gibba015 bash[30343]: audit 2021-03-10T16:12:57.815854+0000 mon.c (mon.1) 2109 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:12:59.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:12:59 gibba045 bash[25517]: cluster 2021-03-10T16:12:57.234137+0000 mgr.gibba045.orlgmj (mgr.34412) 7608 : cluster [DBG] pgmap v4334: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:59.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:12:59 gibba045 bash[25517]: audit 2021-03-10T16:12:58.024939+0000 mon.a (mon.0) 1773 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:12:59.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:12:59 gibba045 bash[25517]: cephadm 2021-03-10T16:12:58.028505+0000 mgr.gibba045.orlgmj (mgr.34412) 7609 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:12:59.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:12:59 gibba045 bash[25517]: audit 2021-03-10T16:12:58.029993+0000 mon.a (mon.0) 1774 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:12:59.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:12:59 gibba045 bash[25517]: cephadm 2021-03-10T16:12:58.033231+0000 mgr.gibba045.orlgmj (mgr.34412) 7610 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:12:59.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:12:59 gibba045 bash[25517]: audit 2021-03-10T16:12:58.235512+0000 mon.a (mon.0) 1775 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:12:59.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:12:59 gibba045 bash[25517]: audit 2021-03-10T16:12:58.239230+0000 mon.c (mon.1) 2110 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:12:59.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:12:59 gibba045 bash[25517]: audit 2021-03-10T16:12:58.240845+0000 mon.c (mon.1) 2111 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:12:59.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:12:59 gibba045 bash[25517]: audit 2021-03-10T16:12:58.242432+0000 mon.c (mon.1) 2112 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:12:59.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:12:59 gibba045 bash[25517]: audit 2021-03-10T16:12:58.243605+0000 mon.c (mon.1) 2113 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:12:59.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:12:59 gibba045 bash[25517]: audit 2021-03-10T16:12:58.246568+0000 mon.c (mon.1) 2114 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:12:59.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:12:59 gibba045 bash[25517]: audit 2021-03-10T16:12:58.248124+0000 mon.c (mon.1) 2115 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:12:59.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:12:59 gibba015 bash[29377]: cluster 2021-03-10T16:12:57.234137+0000 mgr.gibba045.orlgmj (mgr.34412) 7608 : cluster [DBG] pgmap v4334: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:59.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:12:59 gibba015 bash[29377]: audit 2021-03-10T16:12:58.024939+0000 mon.a (mon.0) 1773 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:12:59.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:12:59 gibba015 bash[29377]: cephadm 2021-03-10T16:12:58.028505+0000 mgr.gibba045.orlgmj (mgr.34412) 7609 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:12:59.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:12:59 gibba015 bash[29377]: audit 2021-03-10T16:12:58.029993+0000 mon.a (mon.0) 1774 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:12:59.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:12:59 gibba015 bash[29377]: cephadm 2021-03-10T16:12:58.033231+0000 mgr.gibba045.orlgmj (mgr.34412) 7610 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:12:59.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:12:59 gibba015 bash[29377]: audit 2021-03-10T16:12:58.235512+0000 mon.a (mon.0) 1775 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:12:59.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:12:59 gibba015 bash[29377]: audit 2021-03-10T16:12:58.239230+0000 mon.c (mon.1) 2110 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:12:59.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:12:59 gibba015 bash[29377]: audit 2021-03-10T16:12:58.240845+0000 mon.c (mon.1) 2111 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:12:59.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:12:59 gibba015 bash[29377]: audit 2021-03-10T16:12:58.242432+0000 mon.c (mon.1) 2112 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:12:59.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:12:59 gibba015 bash[29377]: audit 2021-03-10T16:12:58.243605+0000 mon.c (mon.1) 2113 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:12:59.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:12:59 gibba015 bash[29377]: audit 2021-03-10T16:12:58.246568+0000 mon.c (mon.1) 2114 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:12:59.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:12:59 gibba015 bash[29377]: audit 2021-03-10T16:12:58.248124+0000 mon.c (mon.1) 2115 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:12:59.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:12:59 gibba015 bash[30343]: cluster 2021-03-10T16:12:57.234137+0000 mgr.gibba045.orlgmj (mgr.34412) 7608 : cluster [DBG] pgmap v4334: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:59.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:12:59 gibba015 bash[30343]: audit 2021-03-10T16:12:58.024939+0000 mon.a (mon.0) 1773 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:12:59.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:12:59 gibba015 bash[30343]: cephadm 2021-03-10T16:12:58.028505+0000 mgr.gibba045.orlgmj (mgr.34412) 7609 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:12:59.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:12:59 gibba015 bash[30343]: audit 2021-03-10T16:12:58.029993+0000 mon.a (mon.0) 1774 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:12:59.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:12:59 gibba015 bash[30343]: cephadm 2021-03-10T16:12:58.033231+0000 mgr.gibba045.orlgmj (mgr.34412) 7610 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:12:59.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:12:59 gibba015 bash[30343]: audit 2021-03-10T16:12:58.235512+0000 mon.a (mon.0) 1775 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:12:59.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:12:59 gibba015 bash[30343]: audit 2021-03-10T16:12:58.239230+0000 mon.c (mon.1) 2110 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:12:59.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:12:59 gibba015 bash[30343]: audit 2021-03-10T16:12:58.240845+0000 mon.c (mon.1) 2111 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:12:59.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:12:59 gibba015 bash[30343]: audit 2021-03-10T16:12:58.242432+0000 mon.c (mon.1) 2112 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:12:59.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:12:59 gibba015 bash[30343]: audit 2021-03-10T16:12:58.243605+0000 mon.c (mon.1) 2113 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:12:59.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:12:59 gibba015 bash[30343]: audit 2021-03-10T16:12:58.246568+0000 mon.c (mon.1) 2114 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:12:59.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:12:59 gibba015 bash[30343]: audit 2021-03-10T16:12:58.248124+0000 mon.c (mon.1) 2115 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:13:00.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:00 gibba045 bash[25517]: cephadm 2021-03-10T16:12:58.240749+0000 mgr.gibba045.orlgmj (mgr.34412) 7611 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:13:00.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:00 gibba045 bash[25517]: cephadm 2021-03-10T16:12:58.242627+0000 mgr.gibba045.orlgmj (mgr.34412) 7612 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:13:00.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:00 gibba045 bash[25517]: cephadm 2021-03-10T16:12:58.244205+0000 mgr.gibba045.orlgmj (mgr.34412) 7613 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:13:00.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:00 gibba045 bash[25517]: cephadm 2021-03-10T16:12:58.244262+0000 mgr.gibba045.orlgmj (mgr.34412) 7614 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:13:00.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:00 gibba045 bash[25517]: cephadm 2021-03-10T16:12:58.245471+0000 mgr.gibba045.orlgmj (mgr.34412) 7615 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:13:00.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:00 gibba045 bash[25517]: cephadm 2021-03-10T16:12:58.245552+0000 mgr.gibba045.orlgmj (mgr.34412) 7616 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:13:00.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:00 gibba045 bash[25517]: cephadm 2021-03-10T16:12:58.246774+0000 mgr.gibba045.orlgmj (mgr.34412) 7617 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:13:00.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:00 gibba045 bash[25517]: cephadm 2021-03-10T16:12:58.248252+0000 mgr.gibba045.orlgmj (mgr.34412) 7618 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:13:00.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:00 gibba045 bash[25517]: cephadm 2021-03-10T16:12:58.248321+0000 mgr.gibba045.orlgmj (mgr.34412) 7619 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:13:00.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:00 gibba045 bash[25517]: cephadm 2021-03-10T16:12:58.249750+0000 mgr.gibba045.orlgmj (mgr.34412) 7620 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:13:00.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:00 gibba045 bash[25517]: cephadm 2021-03-10T16:12:58.250098+0000 mgr.gibba045.orlgmj (mgr.34412) 7621 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:13:00.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:00 gibba045 bash[25517]: cephadm 2021-03-10T16:12:58.251153+0000 mgr.gibba045.orlgmj (mgr.34412) 7622 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:13:00.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:00 gibba045 bash[25517]: cephadm 2021-03-10T16:12:58.251209+0000 mgr.gibba045.orlgmj (mgr.34412) 7623 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:13:00.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:00 gibba045 bash[25517]: cephadm 2021-03-10T16:12:58.251338+0000 mgr.gibba045.orlgmj (mgr.34412) 7624 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:13:00.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:00 gibba015 bash[29377]: cephadm 2021-03-10T16:12:58.240749+0000 mgr.gibba045.orlgmj (mgr.34412) 7611 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:13:00.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:00 gibba015 bash[29377]: cephadm 2021-03-10T16:12:58.242627+0000 mgr.gibba045.orlgmj (mgr.34412) 7612 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:13:00.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:00 gibba015 bash[29377]: cephadm 2021-03-10T16:12:58.244205+0000 mgr.gibba045.orlgmj (mgr.34412) 7613 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:13:00.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:00 gibba015 bash[29377]: cephadm 2021-03-10T16:12:58.244262+0000 mgr.gibba045.orlgmj (mgr.34412) 7614 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:13:00.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:00 gibba015 bash[29377]: cephadm 2021-03-10T16:12:58.245471+0000 mgr.gibba045.orlgmj (mgr.34412) 7615 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:13:00.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:00 gibba015 bash[29377]: cephadm 2021-03-10T16:12:58.245552+0000 mgr.gibba045.orlgmj (mgr.34412) 7616 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:13:00.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:00 gibba015 bash[29377]: cephadm 2021-03-10T16:12:58.246774+0000 mgr.gibba045.orlgmj (mgr.34412) 7617 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:13:00.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:00 gibba015 bash[29377]: cephadm 2021-03-10T16:12:58.248252+0000 mgr.gibba045.orlgmj (mgr.34412) 7618 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:13:00.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:00 gibba015 bash[29377]: cephadm 2021-03-10T16:12:58.248321+0000 mgr.gibba045.orlgmj (mgr.34412) 7619 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:13:00.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:00 gibba015 bash[29377]: cephadm 2021-03-10T16:12:58.249750+0000 mgr.gibba045.orlgmj (mgr.34412) 7620 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:13:00.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:00 gibba015 bash[29377]: cephadm 2021-03-10T16:12:58.250098+0000 mgr.gibba045.orlgmj (mgr.34412) 7621 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:13:00.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:00 gibba015 bash[29377]: cephadm 2021-03-10T16:12:58.251153+0000 mgr.gibba045.orlgmj (mgr.34412) 7622 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:13:00.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:00 gibba015 bash[29377]: cephadm 2021-03-10T16:12:58.251209+0000 mgr.gibba045.orlgmj (mgr.34412) 7623 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:13:00.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:00 gibba015 bash[29377]: cephadm 2021-03-10T16:12:58.251338+0000 mgr.gibba045.orlgmj (mgr.34412) 7624 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:13:00.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:00 gibba015 bash[30343]: cephadm 2021-03-10T16:12:58.240749+0000 mgr.gibba045.orlgmj (mgr.34412) 7611 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:13:00.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:00 gibba015 bash[30343]: cephadm 2021-03-10T16:12:58.242627+0000 mgr.gibba045.orlgmj (mgr.34412) 7612 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:13:00.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:00 gibba015 bash[30343]: cephadm 2021-03-10T16:12:58.244205+0000 mgr.gibba045.orlgmj (mgr.34412) 7613 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:13:00.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:00 gibba015 bash[30343]: cephadm 2021-03-10T16:12:58.244262+0000 mgr.gibba045.orlgmj (mgr.34412) 7614 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:13:00.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:00 gibba015 bash[30343]: cephadm 2021-03-10T16:12:58.245471+0000 mgr.gibba045.orlgmj (mgr.34412) 7615 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:13:00.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:00 gibba015 bash[30343]: cephadm 2021-03-10T16:12:58.245552+0000 mgr.gibba045.orlgmj (mgr.34412) 7616 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:13:00.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:00 gibba015 bash[30343]: cephadm 2021-03-10T16:12:58.246774+0000 mgr.gibba045.orlgmj (mgr.34412) 7617 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:13:00.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:00 gibba015 bash[30343]: cephadm 2021-03-10T16:12:58.248252+0000 mgr.gibba045.orlgmj (mgr.34412) 7618 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:13:00.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:00 gibba015 bash[30343]: cephadm 2021-03-10T16:12:58.248321+0000 mgr.gibba045.orlgmj (mgr.34412) 7619 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:13:00.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:00 gibba015 bash[30343]: cephadm 2021-03-10T16:12:58.249750+0000 mgr.gibba045.orlgmj (mgr.34412) 7620 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:13:00.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:00 gibba015 bash[30343]: cephadm 2021-03-10T16:12:58.250098+0000 mgr.gibba045.orlgmj (mgr.34412) 7621 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:13:00.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:00 gibba015 bash[30343]: cephadm 2021-03-10T16:12:58.251153+0000 mgr.gibba045.orlgmj (mgr.34412) 7622 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:13:00.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:00 gibba015 bash[30343]: cephadm 2021-03-10T16:12:58.251209+0000 mgr.gibba045.orlgmj (mgr.34412) 7623 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:13:00.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:00 gibba015 bash[30343]: cephadm 2021-03-10T16:12:58.251338+0000 mgr.gibba045.orlgmj (mgr.34412) 7624 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:13:01.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:01 gibba045 bash[25517]: cluster 2021-03-10T16:12:59.235399+0000 mgr.gibba045.orlgmj (mgr.34412) 7625 : cluster [DBG] pgmap v4335: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:01.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:01 gibba015 bash[29377]: cluster 2021-03-10T16:12:59.235399+0000 mgr.gibba045.orlgmj (mgr.34412) 7625 : cluster [DBG] pgmap v4335: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:01.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:01 gibba015 bash[30343]: cluster 2021-03-10T16:12:59.235399+0000 mgr.gibba045.orlgmj (mgr.34412) 7625 : cluster [DBG] pgmap v4335: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:02.444 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:13:02.674 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:13:02.674 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 7m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:13:02.674 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 6m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:13:02.675 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:13:02.675 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:13:02.675 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:13:02.675 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:13:02.676 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:13:02.676 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:13:02.676 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 7m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:13:02.676 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 6m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:13:02.677 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:13:02.677 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:13:02.677 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:13:02.677 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:13:02.677 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:13:02.678 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:13:02.678 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:13:02.678 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:13:02.678 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 6m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:13:02.679 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 6m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:13:02.921 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:13:02.922 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:13:02.922 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:13:02.922 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:13:02.922 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:13:02.923 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:13:02.923 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:13:02.923 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:13:02.923 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:13:02.924 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:13:02.924 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:13:02.924 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:13:02.924 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:13:02.924 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:13:02.925 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:13:03.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:03 gibba015 bash[29377]: cluster 2021-03-10T16:13:01.237101+0000 mgr.gibba045.orlgmj (mgr.34412) 7626 : cluster [DBG] pgmap v4336: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:03.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:03 gibba015 bash[29377]: audit 2021-03-10T16:13:02.921330+0000 mon.a (mon.0) 1776 : audit [DBG] from='client.? 172.21.2.115:0/2790924210' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:13:03.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:03 gibba015 bash[30343]: cluster 2021-03-10T16:13:01.237101+0000 mgr.gibba045.orlgmj (mgr.34412) 7626 : cluster [DBG] pgmap v4336: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:03.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:03 gibba015 bash[30343]: audit 2021-03-10T16:13:02.921330+0000 mon.a (mon.0) 1776 : audit [DBG] from='client.? 172.21.2.115:0/2790924210' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:13:03.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:03 gibba045 bash[25517]: cluster 2021-03-10T16:13:01.237101+0000 mgr.gibba045.orlgmj (mgr.34412) 7626 : cluster [DBG] pgmap v4336: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:03.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:03 gibba045 bash[25517]: audit 2021-03-10T16:13:02.921330+0000 mon.a (mon.0) 1776 : audit [DBG] from='client.? 172.21.2.115:0/2790924210' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:13:04.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:04 gibba015 bash[29377]: audit 2021-03-10T16:13:02.437180+0000 mgr.gibba045.orlgmj (mgr.34412) 7627 : audit [DBG] from='client.59152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:13:04.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:04 gibba015 bash[29377]: audit 2021-03-10T16:13:02.663749+0000 mgr.gibba045.orlgmj (mgr.34412) 7628 : audit [DBG] from='client.49170 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:13:04.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:04 gibba015 bash[30343]: audit 2021-03-10T16:13:02.437180+0000 mgr.gibba045.orlgmj (mgr.34412) 7627 : audit [DBG] from='client.59152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:13:04.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:04 gibba015 bash[30343]: audit 2021-03-10T16:13:02.663749+0000 mgr.gibba045.orlgmj (mgr.34412) 7628 : audit [DBG] from='client.49170 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:13:04.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:04 gibba045 bash[25517]: audit 2021-03-10T16:13:02.437180+0000 mgr.gibba045.orlgmj (mgr.34412) 7627 : audit [DBG] from='client.59152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:13:04.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:04 gibba045 bash[25517]: audit 2021-03-10T16:13:02.663749+0000 mgr.gibba045.orlgmj (mgr.34412) 7628 : audit [DBG] from='client.49170 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:13:05.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:05 gibba015 bash[29377]: cluster 2021-03-10T16:13:03.238647+0000 mgr.gibba045.orlgmj (mgr.34412) 7629 : cluster [DBG] pgmap v4337: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:05.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:05 gibba015 bash[30343]: cluster 2021-03-10T16:13:03.238647+0000 mgr.gibba045.orlgmj (mgr.34412) 7629 : cluster [DBG] pgmap v4337: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:05.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:05 gibba045 bash[25517]: cluster 2021-03-10T16:13:03.238647+0000 mgr.gibba045.orlgmj (mgr.34412) 7629 : cluster [DBG] pgmap v4337: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:07.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:07 gibba015 bash[29377]: cluster 2021-03-10T16:13:05.240197+0000 mgr.gibba045.orlgmj (mgr.34412) 7630 : cluster [DBG] pgmap v4338: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:07.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:07 gibba015 bash[30343]: cluster 2021-03-10T16:13:05.240197+0000 mgr.gibba045.orlgmj (mgr.34412) 7630 : cluster [DBG] pgmap v4338: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:07.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:07 gibba045 bash[25517]: cluster 2021-03-10T16:13:05.240197+0000 mgr.gibba045.orlgmj (mgr.34412) 7630 : cluster [DBG] pgmap v4338: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:09.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:09 gibba015 bash[29377]: cluster 2021-03-10T16:13:07.241911+0000 mgr.gibba045.orlgmj (mgr.34412) 7631 : cluster [DBG] pgmap v4339: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:09.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:09 gibba015 bash[30343]: cluster 2021-03-10T16:13:07.241911+0000 mgr.gibba045.orlgmj (mgr.34412) 7631 : cluster [DBG] pgmap v4339: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:09.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:09 gibba045 bash[25517]: cluster 2021-03-10T16:13:07.241911+0000 mgr.gibba045.orlgmj (mgr.34412) 7631 : cluster [DBG] pgmap v4339: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:10.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:10 gibba015 bash[29377]: cluster 2021-03-10T16:13:09.243084+0000 mgr.gibba045.orlgmj (mgr.34412) 7632 : cluster [DBG] pgmap v4340: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:10.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:10 gibba015 bash[30343]: cluster 2021-03-10T16:13:09.243084+0000 mgr.gibba045.orlgmj (mgr.34412) 7632 : cluster [DBG] pgmap v4340: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:10.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:10 gibba045 bash[25517]: cluster 2021-03-10T16:13:09.243084+0000 mgr.gibba045.orlgmj (mgr.34412) 7632 : cluster [DBG] pgmap v4340: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:12.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:12 gibba015 bash[29377]: cluster 2021-03-10T16:13:11.244864+0000 mgr.gibba045.orlgmj (mgr.34412) 7633 : cluster [DBG] pgmap v4341: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:12.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:12 gibba015 bash[30343]: cluster 2021-03-10T16:13:11.244864+0000 mgr.gibba045.orlgmj (mgr.34412) 7633 : cluster [DBG] pgmap v4341: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:13.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:12 gibba045 bash[25517]: cluster 2021-03-10T16:13:11.244864+0000 mgr.gibba045.orlgmj (mgr.34412) 7633 : cluster [DBG] pgmap v4341: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:14.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:14 gibba015 bash[29377]: cluster 2021-03-10T16:13:13.246227+0000 mgr.gibba045.orlgmj (mgr.34412) 7634 : cluster [DBG] pgmap v4342: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:14.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:14 gibba015 bash[29377]: cephadm 2021-03-10T16:13:13.267223+0000 mgr.gibba045.orlgmj (mgr.34412) 7635 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:13:14.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:14 gibba015 bash[30343]: cluster 2021-03-10T16:13:13.246227+0000 mgr.gibba045.orlgmj (mgr.34412) 7634 : cluster [DBG] pgmap v4342: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:14.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:14 gibba015 bash[30343]: cephadm 2021-03-10T16:13:13.267223+0000 mgr.gibba045.orlgmj (mgr.34412) 7635 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:13:15.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:14 gibba045 bash[25517]: cluster 2021-03-10T16:13:13.246227+0000 mgr.gibba045.orlgmj (mgr.34412) 7634 : cluster [DBG] pgmap v4342: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:15.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:14 gibba045 bash[25517]: cephadm 2021-03-10T16:13:13.267223+0000 mgr.gibba045.orlgmj (mgr.34412) 7635 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:13:16.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:16 gibba015 bash[29377]: cluster 2021-03-10T16:13:15.247758+0000 mgr.gibba045.orlgmj (mgr.34412) 7636 : cluster [DBG] pgmap v4343: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:16.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:16 gibba015 bash[30343]: cluster 2021-03-10T16:13:15.247758+0000 mgr.gibba045.orlgmj (mgr.34412) 7636 : cluster [DBG] pgmap v4343: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:17.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:16 gibba045 bash[25517]: cluster 2021-03-10T16:13:15.247758+0000 mgr.gibba045.orlgmj (mgr.34412) 7636 : cluster [DBG] pgmap v4343: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:18.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:18 gibba015 bash[29377]: cluster 2021-03-10T16:13:17.249571+0000 mgr.gibba045.orlgmj (mgr.34412) 7637 : cluster [DBG] pgmap v4344: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:18.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:18 gibba015 bash[30343]: cluster 2021-03-10T16:13:17.249571+0000 mgr.gibba045.orlgmj (mgr.34412) 7637 : cluster [DBG] pgmap v4344: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:19.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:18 gibba045 bash[25517]: cluster 2021-03-10T16:13:17.249571+0000 mgr.gibba045.orlgmj (mgr.34412) 7637 : cluster [DBG] pgmap v4344: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:20.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:20 gibba015 bash[29377]: cluster 2021-03-10T16:13:19.250767+0000 mgr.gibba045.orlgmj (mgr.34412) 7638 : cluster [DBG] pgmap v4345: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:20.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:20 gibba015 bash[30343]: cluster 2021-03-10T16:13:19.250767+0000 mgr.gibba045.orlgmj (mgr.34412) 7638 : cluster [DBG] pgmap v4345: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:21.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:20 gibba045 bash[25517]: cluster 2021-03-10T16:13:19.250767+0000 mgr.gibba045.orlgmj (mgr.34412) 7638 : cluster [DBG] pgmap v4345: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:22.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:22 gibba015 bash[29377]: cluster 2021-03-10T16:13:21.252596+0000 mgr.gibba045.orlgmj (mgr.34412) 7639 : cluster [DBG] pgmap v4346: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:22.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:22 gibba015 bash[30343]: cluster 2021-03-10T16:13:21.252596+0000 mgr.gibba045.orlgmj (mgr.34412) 7639 : cluster [DBG] pgmap v4346: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:23.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:22 gibba045 bash[25517]: cluster 2021-03-10T16:13:21.252596+0000 mgr.gibba045.orlgmj (mgr.34412) 7639 : cluster [DBG] pgmap v4346: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:24.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:24 gibba015 bash[29377]: cluster 2021-03-10T16:13:23.254195+0000 mgr.gibba045.orlgmj (mgr.34412) 7640 : cluster [DBG] pgmap v4347: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:24.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:24 gibba015 bash[30343]: cluster 2021-03-10T16:13:23.254195+0000 mgr.gibba045.orlgmj (mgr.34412) 7640 : cluster [DBG] pgmap v4347: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:25.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:24 gibba045 bash[25517]: cluster 2021-03-10T16:13:23.254195+0000 mgr.gibba045.orlgmj (mgr.34412) 7640 : cluster [DBG] pgmap v4347: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:26.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:26 gibba015 bash[29377]: cluster 2021-03-10T16:13:25.255883+0000 mgr.gibba045.orlgmj (mgr.34412) 7641 : cluster [DBG] pgmap v4348: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:26.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:26 gibba015 bash[30343]: cluster 2021-03-10T16:13:25.255883+0000 mgr.gibba045.orlgmj (mgr.34412) 7641 : cluster [DBG] pgmap v4348: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:27.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:26 gibba045 bash[25517]: cluster 2021-03-10T16:13:25.255883+0000 mgr.gibba045.orlgmj (mgr.34412) 7641 : cluster [DBG] pgmap v4348: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:28.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:28 gibba015 bash[29377]: cluster 2021-03-10T16:13:27.257651+0000 mgr.gibba045.orlgmj (mgr.34412) 7642 : cluster [DBG] pgmap v4349: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:28.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:28 gibba015 bash[30343]: cluster 2021-03-10T16:13:27.257651+0000 mgr.gibba045.orlgmj (mgr.34412) 7642 : cluster [DBG] pgmap v4349: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:29.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:28 gibba045 bash[25517]: cluster 2021-03-10T16:13:27.257651+0000 mgr.gibba045.orlgmj (mgr.34412) 7642 : cluster [DBG] pgmap v4349: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:29.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:29 gibba015 bash[29377]: cephadm 2021-03-10T16:13:28.283321+0000 mgr.gibba045.orlgmj (mgr.34412) 7643 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:13:29.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:29 gibba015 bash[30343]: cephadm 2021-03-10T16:13:28.283321+0000 mgr.gibba045.orlgmj (mgr.34412) 7643 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:13:30.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:29 gibba045 bash[25517]: cephadm 2021-03-10T16:13:28.283321+0000 mgr.gibba045.orlgmj (mgr.34412) 7643 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:13:30.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:30 gibba015 bash[29377]: cluster 2021-03-10T16:13:29.258900+0000 mgr.gibba045.orlgmj (mgr.34412) 7644 : cluster [DBG] pgmap v4350: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:30.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:30 gibba015 bash[30343]: cluster 2021-03-10T16:13:29.258900+0000 mgr.gibba045.orlgmj (mgr.34412) 7644 : cluster [DBG] pgmap v4350: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:31.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:30 gibba045 bash[25517]: cluster 2021-03-10T16:13:29.258900+0000 mgr.gibba045.orlgmj (mgr.34412) 7644 : cluster [DBG] pgmap v4350: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:32.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:32 gibba015 bash[29377]: cluster 2021-03-10T16:13:31.260708+0000 mgr.gibba045.orlgmj (mgr.34412) 7645 : cluster [DBG] pgmap v4351: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:32.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:32 gibba015 bash[30343]: cluster 2021-03-10T16:13:31.260708+0000 mgr.gibba045.orlgmj (mgr.34412) 7645 : cluster [DBG] pgmap v4351: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:33.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:32 gibba045 bash[25517]: cluster 2021-03-10T16:13:31.260708+0000 mgr.gibba045.orlgmj (mgr.34412) 7645 : cluster [DBG] pgmap v4351: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:33.166 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:13:33.397 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:13:33.397 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 7m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:13:33.397 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 6m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:13:33.398 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:13:33.398 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:13:33.398 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:13:33.398 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:13:33.399 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:13:33.399 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:13:33.399 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 7m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:13:33.399 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 6m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:13:33.399 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:13:33.400 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:13:33.400 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:13:33.400 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:13:33.400 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:13:33.401 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:13:33.401 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:13:33.401 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:13:33.401 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 6m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:13:33.402 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 6m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:13:33.645 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:13:33.646 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:13:33.646 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:13:33.646 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:13:33.646 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:13:33.647 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:13:33.647 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:13:33.647 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:13:33.647 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:13:33.647 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:13:33.648 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:13:33.648 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:13:33.648 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:13:33.648 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:13:33.648 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:13:33.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:33 gibba015 bash[29377]: audit 2021-03-10T16:13:33.645372+0000 mon.c (mon.1) 2116 : audit [DBG] from='client.? 172.21.2.115:0/3067712675' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:13:33.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:33 gibba015 bash[30343]: audit 2021-03-10T16:13:33.645372+0000 mon.c (mon.1) 2116 : audit [DBG] from='client.? 172.21.2.115:0/3067712675' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:13:34.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:33 gibba045 bash[25517]: audit 2021-03-10T16:13:33.645372+0000 mon.c (mon.1) 2116 : audit [DBG] from='client.? 172.21.2.115:0/3067712675' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:13:34.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:34 gibba015 bash[29377]: audit 2021-03-10T16:13:33.160743+0000 mgr.gibba045.orlgmj (mgr.34412) 7646 : audit [DBG] from='client.59170 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:13:34.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:34 gibba015 bash[29377]: cluster 2021-03-10T16:13:33.262496+0000 mgr.gibba045.orlgmj (mgr.34412) 7647 : cluster [DBG] pgmap v4352: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:34.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:34 gibba015 bash[29377]: audit 2021-03-10T16:13:33.386592+0000 mgr.gibba045.orlgmj (mgr.34412) 7648 : audit [DBG] from='client.59176 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:13:34.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:34 gibba015 bash[30343]: audit 2021-03-10T16:13:33.160743+0000 mgr.gibba045.orlgmj (mgr.34412) 7646 : audit [DBG] from='client.59170 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:13:34.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:34 gibba015 bash[30343]: cluster 2021-03-10T16:13:33.262496+0000 mgr.gibba045.orlgmj (mgr.34412) 7647 : cluster [DBG] pgmap v4352: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:34.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:34 gibba015 bash[30343]: audit 2021-03-10T16:13:33.386592+0000 mgr.gibba045.orlgmj (mgr.34412) 7648 : audit [DBG] from='client.59176 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:13:35.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:34 gibba045 bash[25517]: audit 2021-03-10T16:13:33.160743+0000 mgr.gibba045.orlgmj (mgr.34412) 7646 : audit [DBG] from='client.59170 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:13:35.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:34 gibba045 bash[25517]: cluster 2021-03-10T16:13:33.262496+0000 mgr.gibba045.orlgmj (mgr.34412) 7647 : cluster [DBG] pgmap v4352: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:35.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:34 gibba045 bash[25517]: audit 2021-03-10T16:13:33.386592+0000 mgr.gibba045.orlgmj (mgr.34412) 7648 : audit [DBG] from='client.59176 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:13:37.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:36 gibba045 bash[25517]: cluster 2021-03-10T16:13:35.264295+0000 mgr.gibba045.orlgmj (mgr.34412) 7649 : cluster [DBG] pgmap v4353: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:37.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:36 gibba015 bash[29377]: cluster 2021-03-10T16:13:35.264295+0000 mgr.gibba045.orlgmj (mgr.34412) 7649 : cluster [DBG] pgmap v4353: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:37.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:36 gibba015 bash[30343]: cluster 2021-03-10T16:13:35.264295+0000 mgr.gibba045.orlgmj (mgr.34412) 7649 : cluster [DBG] pgmap v4353: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:39.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:38 gibba045 bash[25517]: cluster 2021-03-10T16:13:37.265989+0000 mgr.gibba045.orlgmj (mgr.34412) 7650 : cluster [DBG] pgmap v4354: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:39.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:38 gibba015 bash[29377]: cluster 2021-03-10T16:13:37.265989+0000 mgr.gibba045.orlgmj (mgr.34412) 7650 : cluster [DBG] pgmap v4354: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:39.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:38 gibba015 bash[30343]: cluster 2021-03-10T16:13:37.265989+0000 mgr.gibba045.orlgmj (mgr.34412) 7650 : cluster [DBG] pgmap v4354: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:41.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:40 gibba045 bash[25517]: cluster 2021-03-10T16:13:39.267394+0000 mgr.gibba045.orlgmj (mgr.34412) 7651 : cluster [DBG] pgmap v4355: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:41.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:40 gibba015 bash[29377]: cluster 2021-03-10T16:13:39.267394+0000 mgr.gibba045.orlgmj (mgr.34412) 7651 : cluster [DBG] pgmap v4355: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:41.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:40 gibba015 bash[30343]: cluster 2021-03-10T16:13:39.267394+0000 mgr.gibba045.orlgmj (mgr.34412) 7651 : cluster [DBG] pgmap v4355: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:43.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:42 gibba045 bash[25517]: cluster 2021-03-10T16:13:41.269169+0000 mgr.gibba045.orlgmj (mgr.34412) 7652 : cluster [DBG] pgmap v4356: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:43.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:42 gibba015 bash[29377]: cluster 2021-03-10T16:13:41.269169+0000 mgr.gibba045.orlgmj (mgr.34412) 7652 : cluster [DBG] pgmap v4356: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:43.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:42 gibba015 bash[30343]: cluster 2021-03-10T16:13:41.269169+0000 mgr.gibba045.orlgmj (mgr.34412) 7652 : cluster [DBG] pgmap v4356: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:45.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:44 gibba045 bash[25517]: cluster 2021-03-10T16:13:43.270751+0000 mgr.gibba045.orlgmj (mgr.34412) 7653 : cluster [DBG] pgmap v4357: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:45.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:44 gibba045 bash[25517]: cephadm 2021-03-10T16:13:43.297382+0000 mgr.gibba045.orlgmj (mgr.34412) 7654 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:13:45.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:44 gibba015 bash[29377]: cluster 2021-03-10T16:13:43.270751+0000 mgr.gibba045.orlgmj (mgr.34412) 7653 : cluster [DBG] pgmap v4357: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:45.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:44 gibba015 bash[29377]: cephadm 2021-03-10T16:13:43.297382+0000 mgr.gibba045.orlgmj (mgr.34412) 7654 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:13:45.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:44 gibba015 bash[30343]: cluster 2021-03-10T16:13:43.270751+0000 mgr.gibba045.orlgmj (mgr.34412) 7653 : cluster [DBG] pgmap v4357: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:45.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:44 gibba015 bash[30343]: cephadm 2021-03-10T16:13:43.297382+0000 mgr.gibba045.orlgmj (mgr.34412) 7654 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:13:47.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:46 gibba045 bash[25517]: cluster 2021-03-10T16:13:45.272418+0000 mgr.gibba045.orlgmj (mgr.34412) 7655 : cluster [DBG] pgmap v4358: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:47.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:46 gibba015 bash[29377]: cluster 2021-03-10T16:13:45.272418+0000 mgr.gibba045.orlgmj (mgr.34412) 7655 : cluster [DBG] pgmap v4358: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:47.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:46 gibba015 bash[30343]: cluster 2021-03-10T16:13:45.272418+0000 mgr.gibba045.orlgmj (mgr.34412) 7655 : cluster [DBG] pgmap v4358: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:49.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:48 gibba045 bash[25517]: cluster 2021-03-10T16:13:47.274263+0000 mgr.gibba045.orlgmj (mgr.34412) 7656 : cluster [DBG] pgmap v4359: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:49.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:48 gibba015 bash[29377]: cluster 2021-03-10T16:13:47.274263+0000 mgr.gibba045.orlgmj (mgr.34412) 7656 : cluster [DBG] pgmap v4359: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:49.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:48 gibba015 bash[30343]: cluster 2021-03-10T16:13:47.274263+0000 mgr.gibba045.orlgmj (mgr.34412) 7656 : cluster [DBG] pgmap v4359: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:51.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:50 gibba045 bash[25517]: cluster 2021-03-10T16:13:49.275483+0000 mgr.gibba045.orlgmj (mgr.34412) 7657 : cluster [DBG] pgmap v4360: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:51.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:50 gibba015 bash[29377]: cluster 2021-03-10T16:13:49.275483+0000 mgr.gibba045.orlgmj (mgr.34412) 7657 : cluster [DBG] pgmap v4360: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:51.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:50 gibba015 bash[30343]: cluster 2021-03-10T16:13:49.275483+0000 mgr.gibba045.orlgmj (mgr.34412) 7657 : cluster [DBG] pgmap v4360: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:53.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:52 gibba045 bash[25517]: cluster 2021-03-10T16:13:51.277178+0000 mgr.gibba045.orlgmj (mgr.34412) 7658 : cluster [DBG] pgmap v4361: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:53.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:52 gibba015 bash[29377]: cluster 2021-03-10T16:13:51.277178+0000 mgr.gibba045.orlgmj (mgr.34412) 7658 : cluster [DBG] pgmap v4361: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:53.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:52 gibba015 bash[30343]: cluster 2021-03-10T16:13:51.277178+0000 mgr.gibba045.orlgmj (mgr.34412) 7658 : cluster [DBG] pgmap v4361: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:54.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:53 gibba015 bash[29377]: audit 2021-03-10T16:13:53.471369+0000 mon.c (mon.1) 2117 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:13:54.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:53 gibba015 bash[29377]: audit 2021-03-10T16:13:53.472491+0000 mon.a (mon.0) 1777 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:13:54.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:53 gibba015 bash[29377]: audit 2021-03-10T16:13:53.473759+0000 mon.c (mon.1) 2118 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:13:54.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:53 gibba015 bash[29377]: audit 2021-03-10T16:13:53.474726+0000 mon.a (mon.0) 1778 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:13:54.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:53 gibba015 bash[29377]: audit 2021-03-10T16:13:53.475867+0000 mon.c (mon.1) 2119 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T16:13:54.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:53 gibba015 bash[29377]: audit 2021-03-10T16:13:53.476600+0000 mon.c (mon.1) 2120 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:13:54.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:53 gibba015 bash[29377]: audit 2021-03-10T16:13:53.477155+0000 mon.a (mon.0) 1779 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T16:13:54.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:53 gibba015 bash[29377]: audit 2021-03-10T16:13:53.477311+0000 mon.c (mon.1) 2121 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:13:54.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:53 gibba015 bash[29377]: audit 2021-03-10T16:13:53.477997+0000 mon.c (mon.1) 2122 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:13:54.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:53 gibba015 bash[29377]: audit 2021-03-10T16:13:53.479451+0000 mon.a (mon.0) 1780 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:13:54.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:53 gibba015 bash[29377]: audit 2021-03-10T16:13:53.480275+0000 mon.a (mon.0) 1781 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:13:54.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:53 gibba015 bash[29377]: audit 2021-03-10T16:13:53.481245+0000 mon.a (mon.0) 1782 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:13:54.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:53 gibba015 bash[30343]: audit 2021-03-10T16:13:53.471369+0000 mon.c (mon.1) 2117 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:13:54.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:53 gibba015 bash[30343]: audit 2021-03-10T16:13:53.472491+0000 mon.a (mon.0) 1777 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:13:54.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:53 gibba015 bash[30343]: audit 2021-03-10T16:13:53.473759+0000 mon.c (mon.1) 2118 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:13:54.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:53 gibba015 bash[30343]: audit 2021-03-10T16:13:53.474726+0000 mon.a (mon.0) 1778 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:13:54.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:53 gibba015 bash[30343]: audit 2021-03-10T16:13:53.475867+0000 mon.c (mon.1) 2119 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T16:13:54.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:53 gibba015 bash[30343]: audit 2021-03-10T16:13:53.476600+0000 mon.c (mon.1) 2120 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:13:54.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:53 gibba015 bash[30343]: audit 2021-03-10T16:13:53.477155+0000 mon.a (mon.0) 1779 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T16:13:54.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:53 gibba015 bash[30343]: audit 2021-03-10T16:13:53.477311+0000 mon.c (mon.1) 2121 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:13:54.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:53 gibba015 bash[30343]: audit 2021-03-10T16:13:53.477997+0000 mon.c (mon.1) 2122 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:13:54.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:53 gibba015 bash[30343]: audit 2021-03-10T16:13:53.479451+0000 mon.a (mon.0) 1780 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:13:54.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:53 gibba015 bash[30343]: audit 2021-03-10T16:13:53.480275+0000 mon.a (mon.0) 1781 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:13:54.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:53 gibba015 bash[30343]: audit 2021-03-10T16:13:53.481245+0000 mon.a (mon.0) 1782 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:13:54.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:53 gibba045 bash[25517]: audit 2021-03-10T16:13:53.471369+0000 mon.c (mon.1) 2117 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:13:54.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:53 gibba045 bash[25517]: audit 2021-03-10T16:13:53.472491+0000 mon.a (mon.0) 1777 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:13:54.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:53 gibba045 bash[25517]: audit 2021-03-10T16:13:53.473759+0000 mon.c (mon.1) 2118 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:13:54.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:53 gibba045 bash[25517]: audit 2021-03-10T16:13:53.474726+0000 mon.a (mon.0) 1778 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:13:54.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:53 gibba045 bash[25517]: audit 2021-03-10T16:13:53.475867+0000 mon.c (mon.1) 2119 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T16:13:54.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:53 gibba045 bash[25517]: audit 2021-03-10T16:13:53.476600+0000 mon.c (mon.1) 2120 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:13:54.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:53 gibba045 bash[25517]: audit 2021-03-10T16:13:53.477155+0000 mon.a (mon.0) 1779 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T16:13:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:53 gibba045 bash[25517]: audit 2021-03-10T16:13:53.477311+0000 mon.c (mon.1) 2121 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:13:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:53 gibba045 bash[25517]: audit 2021-03-10T16:13:53.477997+0000 mon.c (mon.1) 2122 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:13:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:53 gibba045 bash[25517]: audit 2021-03-10T16:13:53.479451+0000 mon.a (mon.0) 1780 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:13:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:53 gibba045 bash[25517]: audit 2021-03-10T16:13:53.480275+0000 mon.a (mon.0) 1781 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:13:54.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:53 gibba045 bash[25517]: audit 2021-03-10T16:13:53.481245+0000 mon.a (mon.0) 1782 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:13:55.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:54 gibba015 bash[29377]: cluster 2021-03-10T16:13:53.278895+0000 mgr.gibba045.orlgmj (mgr.34412) 7659 : cluster [DBG] pgmap v4362: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:55.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:54 gibba015 bash[30343]: cluster 2021-03-10T16:13:53.278895+0000 mgr.gibba045.orlgmj (mgr.34412) 7659 : cluster [DBG] pgmap v4362: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:55.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:54 gibba045 bash[25517]: cluster 2021-03-10T16:13:53.278895+0000 mgr.gibba045.orlgmj (mgr.34412) 7659 : cluster [DBG] pgmap v4362: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:57.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:56 gibba015 bash[29377]: cluster 2021-03-10T16:13:55.280533+0000 mgr.gibba045.orlgmj (mgr.34412) 7660 : cluster [DBG] pgmap v4363: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:57.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:56 gibba015 bash[30343]: cluster 2021-03-10T16:13:55.280533+0000 mgr.gibba045.orlgmj (mgr.34412) 7660 : cluster [DBG] pgmap v4363: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:57.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:56 gibba045 bash[25517]: cluster 2021-03-10T16:13:55.280533+0000 mgr.gibba045.orlgmj (mgr.34412) 7660 : cluster [DBG] pgmap v4363: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:59.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:58 gibba015 bash[29377]: cluster 2021-03-10T16:13:57.282286+0000 mgr.gibba045.orlgmj (mgr.34412) 7661 : cluster [DBG] pgmap v4364: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:59.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:58 gibba015 bash[29377]: audit 2021-03-10T16:13:58.311466+0000 mon.c (mon.1) 2123 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:13:59.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:58 gibba015 bash[29377]: audit 2021-03-10T16:13:58.547788+0000 mon.a (mon.0) 1783 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:13:59.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:58 gibba015 bash[29377]: audit 2021-03-10T16:13:58.551765+0000 mon.c (mon.1) 2124 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:13:59.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:58 gibba015 bash[29377]: audit 2021-03-10T16:13:58.553514+0000 mon.c (mon.1) 2125 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:13:59.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:58 gibba015 bash[29377]: audit 2021-03-10T16:13:58.555126+0000 mon.c (mon.1) 2126 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:13:59.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:58 gibba015 bash[29377]: audit 2021-03-10T16:13:58.556460+0000 mon.c (mon.1) 2127 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:13:59.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:58 gibba015 bash[29377]: audit 2021-03-10T16:13:58.560391+0000 mon.c (mon.1) 2128 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:13:59.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:58 gibba015 bash[29377]: audit 2021-03-10T16:13:58.562416+0000 mon.c (mon.1) 2129 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:13:59.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:58 gibba015 bash[30343]: cluster 2021-03-10T16:13:57.282286+0000 mgr.gibba045.orlgmj (mgr.34412) 7661 : cluster [DBG] pgmap v4364: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:59.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:58 gibba015 bash[30343]: audit 2021-03-10T16:13:58.311466+0000 mon.c (mon.1) 2123 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:13:59.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:58 gibba015 bash[30343]: audit 2021-03-10T16:13:58.547788+0000 mon.a (mon.0) 1783 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:13:59.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:58 gibba015 bash[30343]: audit 2021-03-10T16:13:58.551765+0000 mon.c (mon.1) 2124 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:13:59.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:58 gibba015 bash[30343]: audit 2021-03-10T16:13:58.553514+0000 mon.c (mon.1) 2125 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:13:59.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:58 gibba015 bash[30343]: audit 2021-03-10T16:13:58.555126+0000 mon.c (mon.1) 2126 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:13:59.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:58 gibba015 bash[30343]: audit 2021-03-10T16:13:58.556460+0000 mon.c (mon.1) 2127 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:13:59.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:58 gibba015 bash[30343]: audit 2021-03-10T16:13:58.560391+0000 mon.c (mon.1) 2128 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:13:59.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:58 gibba015 bash[30343]: audit 2021-03-10T16:13:58.562416+0000 mon.c (mon.1) 2129 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:13:59.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:58 gibba045 bash[25517]: cluster 2021-03-10T16:13:57.282286+0000 mgr.gibba045.orlgmj (mgr.34412) 7661 : cluster [DBG] pgmap v4364: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:59.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:58 gibba045 bash[25517]: audit 2021-03-10T16:13:58.311466+0000 mon.c (mon.1) 2123 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:13:59.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:58 gibba045 bash[25517]: audit 2021-03-10T16:13:58.547788+0000 mon.a (mon.0) 1783 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:13:59.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:58 gibba045 bash[25517]: audit 2021-03-10T16:13:58.551765+0000 mon.c (mon.1) 2124 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:13:59.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:58 gibba045 bash[25517]: audit 2021-03-10T16:13:58.553514+0000 mon.c (mon.1) 2125 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:13:59.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:58 gibba045 bash[25517]: audit 2021-03-10T16:13:58.555126+0000 mon.c (mon.1) 2126 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:13:59.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:58 gibba045 bash[25517]: audit 2021-03-10T16:13:58.556460+0000 mon.c (mon.1) 2127 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:13:59.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:58 gibba045 bash[25517]: audit 2021-03-10T16:13:58.560391+0000 mon.c (mon.1) 2128 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:13:59.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:58 gibba045 bash[25517]: audit 2021-03-10T16:13:58.562416+0000 mon.c (mon.1) 2129 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:14:00.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:59 gibba015 bash[29377]: cephadm 2021-03-10T16:13:58.318518+0000 mgr.gibba045.orlgmj (mgr.34412) 7662 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:14:00.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:59 gibba015 bash[29377]: cephadm 2021-03-10T16:13:58.321016+0000 mgr.gibba045.orlgmj (mgr.34412) 7663 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:14:00.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:59 gibba015 bash[29377]: cephadm 2021-03-10T16:13:58.553271+0000 mgr.gibba045.orlgmj (mgr.34412) 7664 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:14:00.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:59 gibba015 bash[29377]: cephadm 2021-03-10T16:13:58.555488+0000 mgr.gibba045.orlgmj (mgr.34412) 7665 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:14:00.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:59 gibba015 bash[29377]: cephadm 2021-03-10T16:13:58.556981+0000 mgr.gibba045.orlgmj (mgr.34412) 7666 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:14:00.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:59 gibba015 bash[29377]: cephadm 2021-03-10T16:13:58.557018+0000 mgr.gibba045.orlgmj (mgr.34412) 7667 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:14:00.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:59 gibba015 bash[29377]: cephadm 2021-03-10T16:13:58.558370+0000 mgr.gibba045.orlgmj (mgr.34412) 7668 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:14:00.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:59 gibba015 bash[29377]: cephadm 2021-03-10T16:13:58.558407+0000 mgr.gibba045.orlgmj (mgr.34412) 7669 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:14:00.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:59 gibba015 bash[29377]: cephadm 2021-03-10T16:13:58.560140+0000 mgr.gibba045.orlgmj (mgr.34412) 7670 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:14:00.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:59 gibba015 bash[29377]: cephadm 2021-03-10T16:13:58.562149+0000 mgr.gibba045.orlgmj (mgr.34412) 7671 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:14:00.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:59 gibba015 bash[29377]: cephadm 2021-03-10T16:13:58.562184+0000 mgr.gibba045.orlgmj (mgr.34412) 7672 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:14:00.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:59 gibba015 bash[29377]: cephadm 2021-03-10T16:13:58.564018+0000 mgr.gibba045.orlgmj (mgr.34412) 7673 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:14:00.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:59 gibba015 bash[29377]: cephadm 2021-03-10T16:13:58.564346+0000 mgr.gibba045.orlgmj (mgr.34412) 7674 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:14:00.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:59 gibba015 bash[29377]: cephadm 2021-03-10T16:13:58.566008+0000 mgr.gibba045.orlgmj (mgr.34412) 7675 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:14:00.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:59 gibba015 bash[29377]: cephadm 2021-03-10T16:13:58.566046+0000 mgr.gibba045.orlgmj (mgr.34412) 7676 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:14:00.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:13:59 gibba015 bash[29377]: cephadm 2021-03-10T16:13:58.566155+0000 mgr.gibba045.orlgmj (mgr.34412) 7677 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:14:00.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:59 gibba015 bash[30343]: cephadm 2021-03-10T16:13:58.318518+0000 mgr.gibba045.orlgmj (mgr.34412) 7662 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:14:00.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:59 gibba015 bash[30343]: cephadm 2021-03-10T16:13:58.321016+0000 mgr.gibba045.orlgmj (mgr.34412) 7663 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:14:00.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:59 gibba015 bash[30343]: cephadm 2021-03-10T16:13:58.553271+0000 mgr.gibba045.orlgmj (mgr.34412) 7664 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:14:00.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:59 gibba015 bash[30343]: cephadm 2021-03-10T16:13:58.555488+0000 mgr.gibba045.orlgmj (mgr.34412) 7665 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:14:00.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:59 gibba015 bash[30343]: cephadm 2021-03-10T16:13:58.556981+0000 mgr.gibba045.orlgmj (mgr.34412) 7666 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:14:00.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:59 gibba015 bash[30343]: cephadm 2021-03-10T16:13:58.557018+0000 mgr.gibba045.orlgmj (mgr.34412) 7667 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:14:00.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:59 gibba015 bash[30343]: cephadm 2021-03-10T16:13:58.558370+0000 mgr.gibba045.orlgmj (mgr.34412) 7668 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:14:00.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:59 gibba015 bash[30343]: cephadm 2021-03-10T16:13:58.558407+0000 mgr.gibba045.orlgmj (mgr.34412) 7669 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:14:00.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:59 gibba015 bash[30343]: cephadm 2021-03-10T16:13:58.560140+0000 mgr.gibba045.orlgmj (mgr.34412) 7670 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:14:00.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:59 gibba015 bash[30343]: cephadm 2021-03-10T16:13:58.562149+0000 mgr.gibba045.orlgmj (mgr.34412) 7671 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:14:00.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:59 gibba015 bash[30343]: cephadm 2021-03-10T16:13:58.562184+0000 mgr.gibba045.orlgmj (mgr.34412) 7672 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:14:00.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:59 gibba015 bash[30343]: cephadm 2021-03-10T16:13:58.564018+0000 mgr.gibba045.orlgmj (mgr.34412) 7673 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:14:00.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:59 gibba015 bash[30343]: cephadm 2021-03-10T16:13:58.564346+0000 mgr.gibba045.orlgmj (mgr.34412) 7674 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:14:00.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:59 gibba015 bash[30343]: cephadm 2021-03-10T16:13:58.566008+0000 mgr.gibba045.orlgmj (mgr.34412) 7675 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:14:00.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:59 gibba015 bash[30343]: cephadm 2021-03-10T16:13:58.566046+0000 mgr.gibba045.orlgmj (mgr.34412) 7676 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:14:00.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:13:59 gibba015 bash[30343]: cephadm 2021-03-10T16:13:58.566155+0000 mgr.gibba045.orlgmj (mgr.34412) 7677 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:14:00.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:59 gibba045 bash[25517]: cephadm 2021-03-10T16:13:58.318518+0000 mgr.gibba045.orlgmj (mgr.34412) 7662 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:14:00.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:59 gibba045 bash[25517]: cephadm 2021-03-10T16:13:58.321016+0000 mgr.gibba045.orlgmj (mgr.34412) 7663 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:14:00.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:59 gibba045 bash[25517]: cephadm 2021-03-10T16:13:58.553271+0000 mgr.gibba045.orlgmj (mgr.34412) 7664 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:14:00.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:59 gibba045 bash[25517]: cephadm 2021-03-10T16:13:58.555488+0000 mgr.gibba045.orlgmj (mgr.34412) 7665 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:14:00.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:59 gibba045 bash[25517]: cephadm 2021-03-10T16:13:58.556981+0000 mgr.gibba045.orlgmj (mgr.34412) 7666 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:14:00.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:59 gibba045 bash[25517]: cephadm 2021-03-10T16:13:58.557018+0000 mgr.gibba045.orlgmj (mgr.34412) 7667 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:14:00.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:59 gibba045 bash[25517]: cephadm 2021-03-10T16:13:58.558370+0000 mgr.gibba045.orlgmj (mgr.34412) 7668 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:14:00.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:59 gibba045 bash[25517]: cephadm 2021-03-10T16:13:58.558407+0000 mgr.gibba045.orlgmj (mgr.34412) 7669 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:14:00.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:59 gibba045 bash[25517]: cephadm 2021-03-10T16:13:58.560140+0000 mgr.gibba045.orlgmj (mgr.34412) 7670 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:14:00.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:59 gibba045 bash[25517]: cephadm 2021-03-10T16:13:58.562149+0000 mgr.gibba045.orlgmj (mgr.34412) 7671 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:14:00.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:59 gibba045 bash[25517]: cephadm 2021-03-10T16:13:58.562184+0000 mgr.gibba045.orlgmj (mgr.34412) 7672 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:14:00.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:59 gibba045 bash[25517]: cephadm 2021-03-10T16:13:58.564018+0000 mgr.gibba045.orlgmj (mgr.34412) 7673 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:14:00.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:59 gibba045 bash[25517]: cephadm 2021-03-10T16:13:58.564346+0000 mgr.gibba045.orlgmj (mgr.34412) 7674 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:14:00.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:59 gibba045 bash[25517]: cephadm 2021-03-10T16:13:58.566008+0000 mgr.gibba045.orlgmj (mgr.34412) 7675 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:14:00.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:59 gibba045 bash[25517]: cephadm 2021-03-10T16:13:58.566046+0000 mgr.gibba045.orlgmj (mgr.34412) 7676 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:14:00.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:13:59 gibba045 bash[25517]: cephadm 2021-03-10T16:13:58.566155+0000 mgr.gibba045.orlgmj (mgr.34412) 7677 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:14:01.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:14:00 gibba015 bash[29377]: cluster 2021-03-10T16:13:59.283510+0000 mgr.gibba045.orlgmj (mgr.34412) 7678 : cluster [DBG] pgmap v4365: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:01.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:14:00 gibba015 bash[30343]: cluster 2021-03-10T16:13:59.283510+0000 mgr.gibba045.orlgmj (mgr.34412) 7678 : cluster [DBG] pgmap v4365: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:01.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:14:00 gibba045 bash[25517]: cluster 2021-03-10T16:13:59.283510+0000 mgr.gibba045.orlgmj (mgr.34412) 7678 : cluster [DBG] pgmap v4365: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:03.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:14:02 gibba015 bash[29377]: cluster 2021-03-10T16:14:01.285261+0000 mgr.gibba045.orlgmj (mgr.34412) 7679 : cluster [DBG] pgmap v4366: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:03.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:14:02 gibba015 bash[30343]: cluster 2021-03-10T16:14:01.285261+0000 mgr.gibba045.orlgmj (mgr.34412) 7679 : cluster [DBG] pgmap v4366: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:03.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:14:02 gibba045 bash[25517]: cluster 2021-03-10T16:14:01.285261+0000 mgr.gibba045.orlgmj (mgr.34412) 7679 : cluster [DBG] pgmap v4366: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:03.884 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:14:04.111 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:14:04.112 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 8m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:14:04.112 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 7m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:14:04.112 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:14:04.113 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:14:04.113 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:14:04.113 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:14:04.113 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:14:04.114 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:14:04.114 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 8m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:14:04.114 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 7m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:14:04.114 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:14:04.115 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:14:04.115 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:14:04.115 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:14:04.115 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:14:04.116 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:14:04.116 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:14:04.116 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:14:04.116 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 7m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:14:04.117 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 7m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:14:04.358 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:14:04.358 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:14:04.359 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:14:04.359 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:14:04.359 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:14:04.359 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:14:04.359 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:14:04.360 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:14:04.360 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:14:04.360 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:14:04.360 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:14:04.361 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:14:04.361 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:14:04.361 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:14:04.361 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:14:05.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:14:04 gibba015 bash[29377]: cluster 2021-03-10T16:14:03.286636+0000 mgr.gibba045.orlgmj (mgr.34412) 7680 : cluster [DBG] pgmap v4367: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:05.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:14:04 gibba015 bash[29377]: audit 2021-03-10T16:14:03.878735+0000 mgr.gibba045.orlgmj (mgr.34412) 7681 : audit [DBG] from='client.49200 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:14:05.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:14:04 gibba015 bash[29377]: audit 2021-03-10T16:14:04.101977+0000 mgr.gibba045.orlgmj (mgr.34412) 7682 : audit [DBG] from='client.59194 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:14:05.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:14:04 gibba015 bash[29377]: audit 2021-03-10T16:14:04.358119+0000 mon.a (mon.0) 1784 : audit [DBG] from='client.? 172.21.2.115:0/376322203' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:14:05.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:14:04 gibba015 bash[30343]: cluster 2021-03-10T16:14:03.286636+0000 mgr.gibba045.orlgmj (mgr.34412) 7680 : cluster [DBG] pgmap v4367: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:05.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:14:04 gibba015 bash[30343]: audit 2021-03-10T16:14:03.878735+0000 mgr.gibba045.orlgmj (mgr.34412) 7681 : audit [DBG] from='client.49200 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:14:05.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:14:04 gibba015 bash[30343]: audit 2021-03-10T16:14:04.101977+0000 mgr.gibba045.orlgmj (mgr.34412) 7682 : audit [DBG] from='client.59194 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:14:05.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:14:04 gibba015 bash[30343]: audit 2021-03-10T16:14:04.358119+0000 mon.a (mon.0) 1784 : audit [DBG] from='client.? 172.21.2.115:0/376322203' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:14:05.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:14:04 gibba045 bash[25517]: cluster 2021-03-10T16:14:03.286636+0000 mgr.gibba045.orlgmj (mgr.34412) 7680 : cluster [DBG] pgmap v4367: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:05.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:14:04 gibba045 bash[25517]: audit 2021-03-10T16:14:03.878735+0000 mgr.gibba045.orlgmj (mgr.34412) 7681 : audit [DBG] from='client.49200 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:14:05.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:14:04 gibba045 bash[25517]: audit 2021-03-10T16:14:04.101977+0000 mgr.gibba045.orlgmj (mgr.34412) 7682 : audit [DBG] from='client.59194 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:14:05.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:14:04 gibba045 bash[25517]: audit 2021-03-10T16:14:04.358119+0000 mon.a (mon.0) 1784 : audit [DBG] from='client.? 172.21.2.115:0/376322203' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:14:07.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:14:06 gibba015 bash[29377]: cluster 2021-03-10T16:14:05.288026+0000 mgr.gibba045.orlgmj (mgr.34412) 7683 : cluster [DBG] pgmap v4368: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:07.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:14:06 gibba015 bash[30343]: cluster 2021-03-10T16:14:05.288026+0000 mgr.gibba045.orlgmj (mgr.34412) 7683 : cluster [DBG] pgmap v4368: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:07.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:14:06 gibba045 bash[25517]: cluster 2021-03-10T16:14:05.288026+0000 mgr.gibba045.orlgmj (mgr.34412) 7683 : cluster [DBG] pgmap v4368: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:09.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:14:08 gibba015 bash[29377]: cluster 2021-03-10T16:14:07.289748+0000 mgr.gibba045.orlgmj (mgr.34412) 7684 : cluster [DBG] pgmap v4369: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:09.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:14:08 gibba015 bash[30343]: cluster 2021-03-10T16:14:07.289748+0000 mgr.gibba045.orlgmj (mgr.34412) 7684 : cluster [DBG] pgmap v4369: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:09.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:14:08 gibba045 bash[25517]: cluster 2021-03-10T16:14:07.289748+0000 mgr.gibba045.orlgmj (mgr.34412) 7684 : cluster [DBG] pgmap v4369: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:11.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:14:10 gibba015 bash[29377]: cluster 2021-03-10T16:14:09.290947+0000 mgr.gibba045.orlgmj (mgr.34412) 7685 : cluster [DBG] pgmap v4370: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:11.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:14:10 gibba015 bash[30343]: cluster 2021-03-10T16:14:09.290947+0000 mgr.gibba045.orlgmj (mgr.34412) 7685 : cluster [DBG] pgmap v4370: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:11.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:14:10 gibba045 bash[25517]: cluster 2021-03-10T16:14:09.290947+0000 mgr.gibba045.orlgmj (mgr.34412) 7685 : cluster [DBG] pgmap v4370: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:13.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:14:12 gibba015 bash[29377]: cluster 2021-03-10T16:14:11.292739+0000 mgr.gibba045.orlgmj (mgr.34412) 7686 : cluster [DBG] pgmap v4371: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:13.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:14:12 gibba015 bash[30343]: cluster 2021-03-10T16:14:11.292739+0000 mgr.gibba045.orlgmj (mgr.34412) 7686 : cluster [DBG] pgmap v4371: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:13.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:14:12 gibba045 bash[25517]: cluster 2021-03-10T16:14:11.292739+0000 mgr.gibba045.orlgmj (mgr.34412) 7686 : cluster [DBG] pgmap v4371: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:15.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:14:14 gibba015 bash[29377]: cluster 2021-03-10T16:14:13.294375+0000 mgr.gibba045.orlgmj (mgr.34412) 7687 : cluster [DBG] pgmap v4372: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:15.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:14:14 gibba015 bash[29377]: cephadm 2021-03-10T16:14:13.582025+0000 mgr.gibba045.orlgmj (mgr.34412) 7688 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:14:15.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:14:14 gibba015 bash[30343]: cluster 2021-03-10T16:14:13.294375+0000 mgr.gibba045.orlgmj (mgr.34412) 7687 : cluster [DBG] pgmap v4372: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:15.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:14:14 gibba015 bash[30343]: cephadm 2021-03-10T16:14:13.582025+0000 mgr.gibba045.orlgmj (mgr.34412) 7688 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:14:15.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:14:14 gibba045 bash[25517]: cluster 2021-03-10T16:14:13.294375+0000 mgr.gibba045.orlgmj (mgr.34412) 7687 : cluster [DBG] pgmap v4372: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:15.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:14:14 gibba045 bash[25517]: cephadm 2021-03-10T16:14:13.582025+0000 mgr.gibba045.orlgmj (mgr.34412) 7688 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:14:17.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:14:16 gibba015 bash[29377]: cluster 2021-03-10T16:14:15.295886+0000 mgr.gibba045.orlgmj (mgr.34412) 7689 : cluster [DBG] pgmap v4373: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:17.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:14:16 gibba015 bash[30343]: cluster 2021-03-10T16:14:15.295886+0000 mgr.gibba045.orlgmj (mgr.34412) 7689 : cluster [DBG] pgmap v4373: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:17.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:14:16 gibba045 bash[25517]: cluster 2021-03-10T16:14:15.295886+0000 mgr.gibba045.orlgmj (mgr.34412) 7689 : cluster [DBG] pgmap v4373: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:19.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:14:18 gibba015 bash[29377]: cluster 2021-03-10T16:14:17.297626+0000 mgr.gibba045.orlgmj (mgr.34412) 7690 : cluster [DBG] pgmap v4374: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:19.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:14:18 gibba015 bash[30343]: cluster 2021-03-10T16:14:17.297626+0000 mgr.gibba045.orlgmj (mgr.34412) 7690 : cluster [DBG] pgmap v4374: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:19.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:14:18 gibba045 bash[25517]: cluster 2021-03-10T16:14:17.297626+0000 mgr.gibba045.orlgmj (mgr.34412) 7690 : cluster [DBG] pgmap v4374: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:21.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:14:20 gibba015 bash[29377]: cluster 2021-03-10T16:14:19.298833+0000 mgr.gibba045.orlgmj (mgr.34412) 7691 : cluster [DBG] pgmap v4375: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:21.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:14:20 gibba015 bash[30343]: cluster 2021-03-10T16:14:19.298833+0000 mgr.gibba045.orlgmj (mgr.34412) 7691 : cluster [DBG] pgmap v4375: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:21.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:14:20 gibba045 bash[25517]: cluster 2021-03-10T16:14:19.298833+0000 mgr.gibba045.orlgmj (mgr.34412) 7691 : cluster [DBG] pgmap v4375: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:23.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:14:22 gibba015 bash[29377]: cluster 2021-03-10T16:14:21.300316+0000 mgr.gibba045.orlgmj (mgr.34412) 7692 : cluster [DBG] pgmap v4376: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:23.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:14:22 gibba015 bash[30343]: cluster 2021-03-10T16:14:21.300316+0000 mgr.gibba045.orlgmj (mgr.34412) 7692 : cluster [DBG] pgmap v4376: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:23.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:14:22 gibba045 bash[25517]: cluster 2021-03-10T16:14:21.300316+0000 mgr.gibba045.orlgmj (mgr.34412) 7692 : cluster [DBG] pgmap v4376: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:25.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:14:24 gibba015 bash[29377]: cluster 2021-03-10T16:14:23.301797+0000 mgr.gibba045.orlgmj (mgr.34412) 7693 : cluster [DBG] pgmap v4377: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:25.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:14:24 gibba015 bash[30343]: cluster 2021-03-10T16:14:23.301797+0000 mgr.gibba045.orlgmj (mgr.34412) 7693 : cluster [DBG] pgmap v4377: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:25.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:14:24 gibba045 bash[25517]: cluster 2021-03-10T16:14:23.301797+0000 mgr.gibba045.orlgmj (mgr.34412) 7693 : cluster [DBG] pgmap v4377: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:27.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:14:26 gibba015 bash[29377]: cluster 2021-03-10T16:14:25.303354+0000 mgr.gibba045.orlgmj (mgr.34412) 7694 : cluster [DBG] pgmap v4378: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:27.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:14:26 gibba015 bash[30343]: cluster 2021-03-10T16:14:25.303354+0000 mgr.gibba045.orlgmj (mgr.34412) 7694 : cluster [DBG] pgmap v4378: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:27.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:14:26 gibba045 bash[25517]: cluster 2021-03-10T16:14:25.303354+0000 mgr.gibba045.orlgmj (mgr.34412) 7694 : cluster [DBG] pgmap v4378: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:29.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:14:28 gibba045 bash[25517]: cluster 2021-03-10T16:14:27.304923+0000 mgr.gibba045.orlgmj (mgr.34412) 7695 : cluster [DBG] pgmap v4379: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:29.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:14:28 gibba015 bash[29377]: cluster 2021-03-10T16:14:27.304923+0000 mgr.gibba045.orlgmj (mgr.34412) 7695 : cluster [DBG] pgmap v4379: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:29.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:14:28 gibba015 bash[30343]: cluster 2021-03-10T16:14:27.304923+0000 mgr.gibba045.orlgmj (mgr.34412) 7695 : cluster [DBG] pgmap v4379: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:30.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:14:29 gibba045 bash[25517]: cephadm 2021-03-10T16:14:28.597369+0000 mgr.gibba045.orlgmj (mgr.34412) 7696 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:14:30.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:14:29 gibba015 bash[29377]: cephadm 2021-03-10T16:14:28.597369+0000 mgr.gibba045.orlgmj (mgr.34412) 7696 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:14:30.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:14:29 gibba015 bash[30343]: cephadm 2021-03-10T16:14:28.597369+0000 mgr.gibba045.orlgmj (mgr.34412) 7696 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:14:31.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:14:30 gibba045 bash[25517]: cluster 2021-03-10T16:14:29.306145+0000 mgr.gibba045.orlgmj (mgr.34412) 7697 : cluster [DBG] pgmap v4380: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:31.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:14:30 gibba015 bash[29377]: cluster 2021-03-10T16:14:29.306145+0000 mgr.gibba045.orlgmj (mgr.34412) 7697 : cluster [DBG] pgmap v4380: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:31.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:14:30 gibba015 bash[30343]: cluster 2021-03-10T16:14:29.306145+0000 mgr.gibba045.orlgmj (mgr.34412) 7697 : cluster [DBG] pgmap v4380: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:33.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:14:33 gibba045 bash[25517]: cluster 2021-03-10T16:14:31.307649+0000 mgr.gibba045.orlgmj (mgr.34412) 7698 : cluster [DBG] pgmap v4381: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:33.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:14:32 gibba015 bash[29377]: cluster 2021-03-10T16:14:31.307649+0000 mgr.gibba045.orlgmj (mgr.34412) 7698 : cluster [DBG] pgmap v4381: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:33.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:14:32 gibba015 bash[30343]: cluster 2021-03-10T16:14:31.307649+0000 mgr.gibba045.orlgmj (mgr.34412) 7698 : cluster [DBG] pgmap v4381: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:34.603 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:14:34.836 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:14:34.837 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 8m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:14:34.837 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 7m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:14:34.837 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:14:34.837 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:14:34.838 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:14:34.838 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:14:34.838 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:14:34.838 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:14:34.838 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 8m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:14:34.839 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 7m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:14:34.839 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:14:34.839 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:14:34.839 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:14:34.840 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:14:34.840 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:14:34.843 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:14:34.843 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:14:34.843 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:14:34.843 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 7m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:14:34.844 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 7m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:14:35.088 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:14:35.089 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:14:35.089 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:14:35.089 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:14:35.089 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:14:35.090 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:14:35.090 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:14:35.090 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:14:35.090 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:14:35.091 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:14:35.091 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:14:35.091 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:14:35.091 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:14:35.092 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:14:35.092 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:14:35.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:14:35 gibba045 bash[25517]: cluster 2021-03-10T16:14:33.309130+0000 mgr.gibba045.orlgmj (mgr.34412) 7699 : cluster [DBG] pgmap v4382: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:35.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:14:35 gibba015 bash[29377]: cluster 2021-03-10T16:14:33.309130+0000 mgr.gibba045.orlgmj (mgr.34412) 7699 : cluster [DBG] pgmap v4382: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:35.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:14:35 gibba015 bash[30343]: cluster 2021-03-10T16:14:33.309130+0000 mgr.gibba045.orlgmj (mgr.34412) 7699 : cluster [DBG] pgmap v4382: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:36.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:14:36 gibba045 bash[25517]: audit 2021-03-10T16:14:34.595968+0000 mgr.gibba045.orlgmj (mgr.34412) 7700 : audit [DBG] from='client.59206 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:14:36.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:14:36 gibba045 bash[25517]: audit 2021-03-10T16:14:34.826583+0000 mgr.gibba045.orlgmj (mgr.34412) 7701 : audit [DBG] from='client.59212 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:14:36.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:14:36 gibba045 bash[25517]: audit 2021-03-10T16:14:35.088303+0000 mon.a (mon.0) 1785 : audit [DBG] from='client.? 172.21.2.115:0/3426369887' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:14:36.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:14:36 gibba015 bash[29377]: audit 2021-03-10T16:14:34.595968+0000 mgr.gibba045.orlgmj (mgr.34412) 7700 : audit [DBG] from='client.59206 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:14:36.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:14:36 gibba015 bash[29377]: audit 2021-03-10T16:14:34.826583+0000 mgr.gibba045.orlgmj (mgr.34412) 7701 : audit [DBG] from='client.59212 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:14:36.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:14:36 gibba015 bash[29377]: audit 2021-03-10T16:14:35.088303+0000 mon.a (mon.0) 1785 : audit [DBG] from='client.? 172.21.2.115:0/3426369887' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:14:36.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:14:36 gibba015 bash[30343]: audit 2021-03-10T16:14:34.595968+0000 mgr.gibba045.orlgmj (mgr.34412) 7700 : audit [DBG] from='client.59206 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:14:36.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:14:36 gibba015 bash[30343]: audit 2021-03-10T16:14:34.826583+0000 mgr.gibba045.orlgmj (mgr.34412) 7701 : audit [DBG] from='client.59212 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:14:36.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:14:36 gibba015 bash[30343]: audit 2021-03-10T16:14:35.088303+0000 mon.a (mon.0) 1785 : audit [DBG] from='client.? 172.21.2.115:0/3426369887' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:14:37.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:14:37 gibba045 bash[25517]: cluster 2021-03-10T16:14:35.310523+0000 mgr.gibba045.orlgmj (mgr.34412) 7702 : cluster [DBG] pgmap v4383: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:37.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:14:37 gibba015 bash[29377]: cluster 2021-03-10T16:14:35.310523+0000 mgr.gibba045.orlgmj (mgr.34412) 7702 : cluster [DBG] pgmap v4383: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:37.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:14:37 gibba015 bash[30343]: cluster 2021-03-10T16:14:35.310523+0000 mgr.gibba045.orlgmj (mgr.34412) 7702 : cluster [DBG] pgmap v4383: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:39.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:14:39 gibba045 bash[25517]: cluster 2021-03-10T16:14:37.312133+0000 mgr.gibba045.orlgmj (mgr.34412) 7703 : cluster [DBG] pgmap v4384: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:39.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:14:39 gibba015 bash[29377]: cluster 2021-03-10T16:14:37.312133+0000 mgr.gibba045.orlgmj (mgr.34412) 7703 : cluster [DBG] pgmap v4384: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:39.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:14:39 gibba015 bash[30343]: cluster 2021-03-10T16:14:37.312133+0000 mgr.gibba045.orlgmj (mgr.34412) 7703 : cluster [DBG] pgmap v4384: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:41.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:14:41 gibba045 bash[25517]: cluster 2021-03-10T16:14:39.313343+0000 mgr.gibba045.orlgmj (mgr.34412) 7704 : cluster [DBG] pgmap v4385: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:41.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:14:41 gibba015 bash[29377]: cluster 2021-03-10T16:14:39.313343+0000 mgr.gibba045.orlgmj (mgr.34412) 7704 : cluster [DBG] pgmap v4385: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:41.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:14:41 gibba015 bash[30343]: cluster 2021-03-10T16:14:39.313343+0000 mgr.gibba045.orlgmj (mgr.34412) 7704 : cluster [DBG] pgmap v4385: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:43.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:14:43 gibba015 bash[29377]: cluster 2021-03-10T16:14:41.314815+0000 mgr.gibba045.orlgmj (mgr.34412) 7705 : cluster [DBG] pgmap v4386: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:43.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:14:43 gibba015 bash[30343]: cluster 2021-03-10T16:14:41.314815+0000 mgr.gibba045.orlgmj (mgr.34412) 7705 : cluster [DBG] pgmap v4386: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:43.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:14:43 gibba045 bash[25517]: cluster 2021-03-10T16:14:41.314815+0000 mgr.gibba045.orlgmj (mgr.34412) 7705 : cluster [DBG] pgmap v4386: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:45.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:14:45 gibba015 bash[29377]: cluster 2021-03-10T16:14:43.316263+0000 mgr.gibba045.orlgmj (mgr.34412) 7706 : cluster [DBG] pgmap v4387: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:45.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:14:45 gibba015 bash[29377]: cephadm 2021-03-10T16:14:43.613327+0000 mgr.gibba045.orlgmj (mgr.34412) 7707 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:14:45.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:14:45 gibba015 bash[30343]: cluster 2021-03-10T16:14:43.316263+0000 mgr.gibba045.orlgmj (mgr.34412) 7706 : cluster [DBG] pgmap v4387: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:45.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:14:45 gibba015 bash[30343]: cephadm 2021-03-10T16:14:43.613327+0000 mgr.gibba045.orlgmj (mgr.34412) 7707 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:14:45.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:14:45 gibba045 bash[25517]: cluster 2021-03-10T16:14:43.316263+0000 mgr.gibba045.orlgmj (mgr.34412) 7706 : cluster [DBG] pgmap v4387: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:45.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:14:45 gibba045 bash[25517]: cephadm 2021-03-10T16:14:43.613327+0000 mgr.gibba045.orlgmj (mgr.34412) 7707 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:14:47.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:14:47 gibba015 bash[29377]: cluster 2021-03-10T16:14:45.317891+0000 mgr.gibba045.orlgmj (mgr.34412) 7708 : cluster [DBG] pgmap v4388: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:47.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:14:47 gibba015 bash[30343]: cluster 2021-03-10T16:14:45.317891+0000 mgr.gibba045.orlgmj (mgr.34412) 7708 : cluster [DBG] pgmap v4388: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:47.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:14:47 gibba045 bash[25517]: cluster 2021-03-10T16:14:45.317891+0000 mgr.gibba045.orlgmj (mgr.34412) 7708 : cluster [DBG] pgmap v4388: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:49.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:14:49 gibba015 bash[29377]: cluster 2021-03-10T16:14:47.319373+0000 mgr.gibba045.orlgmj (mgr.34412) 7709 : cluster [DBG] pgmap v4389: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:49.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:14:49 gibba015 bash[30343]: cluster 2021-03-10T16:14:47.319373+0000 mgr.gibba045.orlgmj (mgr.34412) 7709 : cluster [DBG] pgmap v4389: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:49.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:14:49 gibba045 bash[25517]: cluster 2021-03-10T16:14:47.319373+0000 mgr.gibba045.orlgmj (mgr.34412) 7709 : cluster [DBG] pgmap v4389: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:51.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:14:51 gibba015 bash[29377]: cluster 2021-03-10T16:14:49.320561+0000 mgr.gibba045.orlgmj (mgr.34412) 7710 : cluster [DBG] pgmap v4390: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:51.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:14:51 gibba015 bash[30343]: cluster 2021-03-10T16:14:49.320561+0000 mgr.gibba045.orlgmj (mgr.34412) 7710 : cluster [DBG] pgmap v4390: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:51.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:14:51 gibba045 bash[25517]: cluster 2021-03-10T16:14:49.320561+0000 mgr.gibba045.orlgmj (mgr.34412) 7710 : cluster [DBG] pgmap v4390: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:53.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:14:53 gibba015 bash[29377]: cluster 2021-03-10T16:14:51.321981+0000 mgr.gibba045.orlgmj (mgr.34412) 7711 : cluster [DBG] pgmap v4391: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:53.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:14:53 gibba015 bash[30343]: cluster 2021-03-10T16:14:51.321981+0000 mgr.gibba045.orlgmj (mgr.34412) 7711 : cluster [DBG] pgmap v4391: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:53.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:14:53 gibba045 bash[25517]: cluster 2021-03-10T16:14:51.321981+0000 mgr.gibba045.orlgmj (mgr.34412) 7711 : cluster [DBG] pgmap v4391: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:54.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:14:54 gibba015 bash[29377]: audit 2021-03-10T16:14:53.478770+0000 mon.c (mon.1) 2130 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:14:54.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:14:54 gibba015 bash[29377]: audit 2021-03-10T16:14:53.479474+0000 mon.c (mon.1) 2131 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:14:54.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:14:54 gibba015 bash[29377]: audit 2021-03-10T16:14:53.479930+0000 mon.a (mon.0) 1786 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:14:54.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:14:54 gibba015 bash[29377]: audit 2021-03-10T16:14:53.481151+0000 mon.a (mon.0) 1787 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:14:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:14:54 gibba015 bash[29377]: audit 2021-03-10T16:14:53.481781+0000 mon.c (mon.1) 2132 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T16:14:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:14:54 gibba015 bash[29377]: audit 2021-03-10T16:14:53.482652+0000 mon.c (mon.1) 2133 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:14:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:14:54 gibba015 bash[29377]: audit 2021-03-10T16:14:53.482967+0000 mon.a (mon.0) 1788 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T16:14:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:14:54 gibba015 bash[29377]: audit 2021-03-10T16:14:53.483343+0000 mon.c (mon.1) 2134 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:14:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:14:54 gibba015 bash[29377]: audit 2021-03-10T16:14:53.484188+0000 mon.a (mon.0) 1789 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:14:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:14:54 gibba015 bash[29377]: audit 2021-03-10T16:14:53.484246+0000 mon.c (mon.1) 2135 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:14:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:14:54 gibba015 bash[29377]: audit 2021-03-10T16:14:53.485214+0000 mon.a (mon.0) 1790 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:14:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:14:54 gibba015 bash[29377]: audit 2021-03-10T16:14:53.486246+0000 mon.a (mon.0) 1791 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:14:54.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:14:54 gibba015 bash[30343]: audit 2021-03-10T16:14:53.478770+0000 mon.c (mon.1) 2130 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:14:54.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:14:54 gibba015 bash[30343]: audit 2021-03-10T16:14:53.479474+0000 mon.c (mon.1) 2131 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:14:54.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:14:54 gibba015 bash[30343]: audit 2021-03-10T16:14:53.479930+0000 mon.a (mon.0) 1786 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:14:54.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:14:54 gibba015 bash[30343]: audit 2021-03-10T16:14:53.481151+0000 mon.a (mon.0) 1787 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:14:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:14:54 gibba015 bash[30343]: audit 2021-03-10T16:14:53.481781+0000 mon.c (mon.1) 2132 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T16:14:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:14:54 gibba015 bash[30343]: audit 2021-03-10T16:14:53.482652+0000 mon.c (mon.1) 2133 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:14:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:14:54 gibba015 bash[30343]: audit 2021-03-10T16:14:53.482967+0000 mon.a (mon.0) 1788 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T16:14:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:14:54 gibba015 bash[30343]: audit 2021-03-10T16:14:53.483343+0000 mon.c (mon.1) 2134 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:14:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:14:54 gibba015 bash[30343]: audit 2021-03-10T16:14:53.484188+0000 mon.a (mon.0) 1789 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:14:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:14:54 gibba015 bash[30343]: audit 2021-03-10T16:14:53.484246+0000 mon.c (mon.1) 2135 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:14:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:14:54 gibba015 bash[30343]: audit 2021-03-10T16:14:53.485214+0000 mon.a (mon.0) 1790 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:14:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:14:54 gibba015 bash[30343]: audit 2021-03-10T16:14:53.486246+0000 mon.a (mon.0) 1791 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:14:54.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:14:54 gibba045 bash[25517]: audit 2021-03-10T16:14:53.478770+0000 mon.c (mon.1) 2130 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:14:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:14:54 gibba045 bash[25517]: audit 2021-03-10T16:14:53.479474+0000 mon.c (mon.1) 2131 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:14:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:14:54 gibba045 bash[25517]: audit 2021-03-10T16:14:53.479930+0000 mon.a (mon.0) 1786 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:14:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:14:54 gibba045 bash[25517]: audit 2021-03-10T16:14:53.481151+0000 mon.a (mon.0) 1787 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:14:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:14:54 gibba045 bash[25517]: audit 2021-03-10T16:14:53.481781+0000 mon.c (mon.1) 2132 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T16:14:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:14:54 gibba045 bash[25517]: audit 2021-03-10T16:14:53.482652+0000 mon.c (mon.1) 2133 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:14:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:14:54 gibba045 bash[25517]: audit 2021-03-10T16:14:53.482967+0000 mon.a (mon.0) 1788 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T16:14:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:14:54 gibba045 bash[25517]: audit 2021-03-10T16:14:53.483343+0000 mon.c (mon.1) 2134 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:14:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:14:54 gibba045 bash[25517]: audit 2021-03-10T16:14:53.484188+0000 mon.a (mon.0) 1789 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:14:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:14:54 gibba045 bash[25517]: audit 2021-03-10T16:14:53.484246+0000 mon.c (mon.1) 2135 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:14:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:14:54 gibba045 bash[25517]: audit 2021-03-10T16:14:53.485214+0000 mon.a (mon.0) 1790 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:14:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:14:54 gibba045 bash[25517]: audit 2021-03-10T16:14:53.486246+0000 mon.a (mon.0) 1791 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:14:55.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:14:55 gibba015 bash[29377]: cluster 2021-03-10T16:14:53.323577+0000 mgr.gibba045.orlgmj (mgr.34412) 7712 : cluster [DBG] pgmap v4392: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:55.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:14:55 gibba015 bash[30343]: cluster 2021-03-10T16:14:53.323577+0000 mgr.gibba045.orlgmj (mgr.34412) 7712 : cluster [DBG] pgmap v4392: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:55.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:14:55 gibba045 bash[25517]: cluster 2021-03-10T16:14:53.323577+0000 mgr.gibba045.orlgmj (mgr.34412) 7712 : cluster [DBG] pgmap v4392: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:57.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:14:57 gibba015 bash[29377]: cluster 2021-03-10T16:14:55.325275+0000 mgr.gibba045.orlgmj (mgr.34412) 7713 : cluster [DBG] pgmap v4393: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:57.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:14:57 gibba015 bash[30343]: cluster 2021-03-10T16:14:55.325275+0000 mgr.gibba045.orlgmj (mgr.34412) 7713 : cluster [DBG] pgmap v4393: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:57.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:14:57 gibba045 bash[25517]: cluster 2021-03-10T16:14:55.325275+0000 mgr.gibba045.orlgmj (mgr.34412) 7713 : cluster [DBG] pgmap v4393: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:59.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:14:59 gibba015 bash[29377]: cluster 2021-03-10T16:14:57.326785+0000 mgr.gibba045.orlgmj (mgr.34412) 7714 : cluster [DBG] pgmap v4394: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:59.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:14:59 gibba015 bash[29377]: audit 2021-03-10T16:14:58.627951+0000 mon.c (mon.1) 2136 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:14:59.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:14:59 gibba015 bash[29377]: audit 2021-03-10T16:14:58.634567+0000 mon.c (mon.1) 2137 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T16:14:59.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:14:59 gibba015 bash[30343]: cluster 2021-03-10T16:14:57.326785+0000 mgr.gibba045.orlgmj (mgr.34412) 7714 : cluster [DBG] pgmap v4394: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:59.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:14:59 gibba015 bash[30343]: audit 2021-03-10T16:14:58.627951+0000 mon.c (mon.1) 2136 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:14:59.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:14:59 gibba015 bash[30343]: audit 2021-03-10T16:14:58.634567+0000 mon.c (mon.1) 2137 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T16:14:59.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:14:59 gibba045 bash[25517]: cluster 2021-03-10T16:14:57.326785+0000 mgr.gibba045.orlgmj (mgr.34412) 7714 : cluster [DBG] pgmap v4394: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:59.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:14:59 gibba045 bash[25517]: audit 2021-03-10T16:14:58.627951+0000 mon.c (mon.1) 2136 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:14:59.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:14:59 gibba045 bash[25517]: audit 2021-03-10T16:14:58.634567+0000 mon.c (mon.1) 2137 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T16:15:00.204 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:15:00 gibba015 bash[29377]: cephadm 2021-03-10T16:14:58.636605+0000 mgr.gibba045.orlgmj (mgr.34412) 7715 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:15:00.204 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:15:00 gibba015 bash[30343]: cephadm 2021-03-10T16:14:58.636605+0000 mgr.gibba045.orlgmj (mgr.34412) 7715 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:15:00.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:15:00 gibba045 bash[25517]: cephadm 2021-03-10T16:14:58.636605+0000 mgr.gibba045.orlgmj (mgr.34412) 7715 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:15:01.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:15:01 gibba015 bash[29377]: cluster 2021-03-10T16:14:59.328253+0000 mgr.gibba045.orlgmj (mgr.34412) 7716 : cluster [DBG] pgmap v4395: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:01.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:15:01 gibba015 bash[30343]: cluster 2021-03-10T16:14:59.328253+0000 mgr.gibba045.orlgmj (mgr.34412) 7716 : cluster [DBG] pgmap v4395: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:01.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:15:01 gibba045 bash[25517]: cluster 2021-03-10T16:14:59.328253+0000 mgr.gibba045.orlgmj (mgr.34412) 7716 : cluster [DBG] pgmap v4395: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:02.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:15:02 gibba015 bash[29377]: cluster 2021-03-10T16:15:01.329683+0000 mgr.gibba045.orlgmj (mgr.34412) 7717 : cluster [DBG] pgmap v4396: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:02.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:15:02 gibba015 bash[30343]: cluster 2021-03-10T16:15:01.329683+0000 mgr.gibba045.orlgmj (mgr.34412) 7717 : cluster [DBG] pgmap v4396: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:02.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:15:02 gibba045 bash[25517]: cluster 2021-03-10T16:15:01.329683+0000 mgr.gibba045.orlgmj (mgr.34412) 7717 : cluster [DBG] pgmap v4396: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:04.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:15:04 gibba015 bash[29377]: cluster 2021-03-10T16:15:03.331331+0000 mgr.gibba045.orlgmj (mgr.34412) 7718 : cluster [DBG] pgmap v4397: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:04.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:15:04 gibba015 bash[29377]: audit 2021-03-10T16:15:03.395350+0000 mon.c (mon.1) 2138 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:15:04.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:15:04 gibba015 bash[29377]: audit 2021-03-10T16:15:03.585999+0000 mon.a (mon.0) 1792 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:15:04.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:15:04 gibba015 bash[29377]: cephadm 2021-03-10T16:15:03.590188+0000 mgr.gibba045.orlgmj (mgr.34412) 7719 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:15:04.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:15:04 gibba015 bash[29377]: audit 2021-03-10T16:15:03.781544+0000 mon.a (mon.0) 1793 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:15:04.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:15:04 gibba015 bash[29377]: audit 2021-03-10T16:15:03.791345+0000 mon.c (mon.1) 2139 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:15:04.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:15:04 gibba015 bash[29377]: cephadm 2021-03-10T16:15:03.792600+0000 mgr.gibba045.orlgmj (mgr.34412) 7720 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:15:04.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:15:04 gibba015 bash[29377]: audit 2021-03-10T16:15:03.792618+0000 mon.c (mon.1) 2140 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:15:04.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:15:04 gibba015 bash[29377]: audit 2021-03-10T16:15:03.793963+0000 mon.c (mon.1) 2141 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:15:04.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:15:04 gibba015 bash[29377]: cephadm 2021-03-10T16:15:03.794511+0000 mgr.gibba045.orlgmj (mgr.34412) 7721 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:15:04.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:15:04 gibba015 bash[29377]: audit 2021-03-10T16:15:03.795312+0000 mon.c (mon.1) 2142 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:15:04.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:15:04 gibba015 bash[29377]: cephadm 2021-03-10T16:15:03.795694+0000 mgr.gibba045.orlgmj (mgr.34412) 7722 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:15:04.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:15:04 gibba015 bash[29377]: cephadm 2021-03-10T16:15:03.795733+0000 mgr.gibba045.orlgmj (mgr.34412) 7723 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:15:04.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:15:04 gibba015 bash[29377]: cephadm 2021-03-10T16:15:03.797174+0000 mgr.gibba045.orlgmj (mgr.34412) 7724 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:15:04.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:15:04 gibba015 bash[29377]: cephadm 2021-03-10T16:15:03.797231+0000 mgr.gibba045.orlgmj (mgr.34412) 7725 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:15:04.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:15:04 gibba015 bash[29377]: audit 2021-03-10T16:15:03.798435+0000 mon.c (mon.1) 2143 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:15:04.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:15:04 gibba015 bash[29377]: cephadm 2021-03-10T16:15:03.798483+0000 mgr.gibba045.orlgmj (mgr.34412) 7726 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:15:04.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:15:04 gibba015 bash[29377]: cephadm 2021-03-10T16:15:03.800148+0000 mgr.gibba045.orlgmj (mgr.34412) 7727 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:15:04.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:15:04 gibba015 bash[29377]: cephadm 2021-03-10T16:15:03.800194+0000 mgr.gibba045.orlgmj (mgr.34412) 7728 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:15:04.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:15:04 gibba015 bash[29377]: audit 2021-03-10T16:15:03.800199+0000 mon.c (mon.1) 2144 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:15:04.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:15:04 gibba015 bash[30343]: cluster 2021-03-10T16:15:03.331331+0000 mgr.gibba045.orlgmj (mgr.34412) 7718 : cluster [DBG] pgmap v4397: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:04.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:15:04 gibba015 bash[30343]: audit 2021-03-10T16:15:03.395350+0000 mon.c (mon.1) 2138 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:15:04.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:15:04 gibba015 bash[30343]: audit 2021-03-10T16:15:03.585999+0000 mon.a (mon.0) 1792 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:15:04.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:15:04 gibba015 bash[30343]: cephadm 2021-03-10T16:15:03.590188+0000 mgr.gibba045.orlgmj (mgr.34412) 7719 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:15:04.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:15:04 gibba015 bash[30343]: audit 2021-03-10T16:15:03.781544+0000 mon.a (mon.0) 1793 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:15:04.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:15:04 gibba015 bash[30343]: audit 2021-03-10T16:15:03.791345+0000 mon.c (mon.1) 2139 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:15:04.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:15:04 gibba015 bash[30343]: cephadm 2021-03-10T16:15:03.792600+0000 mgr.gibba045.orlgmj (mgr.34412) 7720 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:15:04.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:15:04 gibba015 bash[30343]: audit 2021-03-10T16:15:03.792618+0000 mon.c (mon.1) 2140 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:15:04.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:15:04 gibba015 bash[30343]: audit 2021-03-10T16:15:03.793963+0000 mon.c (mon.1) 2141 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:15:04.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:15:04 gibba015 bash[30343]: cephadm 2021-03-10T16:15:03.794511+0000 mgr.gibba045.orlgmj (mgr.34412) 7721 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:15:04.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:15:04 gibba015 bash[30343]: audit 2021-03-10T16:15:03.795312+0000 mon.c (mon.1) 2142 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:15:04.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:15:04 gibba015 bash[30343]: cephadm 2021-03-10T16:15:03.795694+0000 mgr.gibba045.orlgmj (mgr.34412) 7722 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:15:04.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:15:04 gibba015 bash[30343]: cephadm 2021-03-10T16:15:03.795733+0000 mgr.gibba045.orlgmj (mgr.34412) 7723 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:15:04.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:15:04 gibba015 bash[30343]: cephadm 2021-03-10T16:15:03.797174+0000 mgr.gibba045.orlgmj (mgr.34412) 7724 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:15:04.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:15:04 gibba015 bash[30343]: cephadm 2021-03-10T16:15:03.797231+0000 mgr.gibba045.orlgmj (mgr.34412) 7725 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:15:04.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:15:04 gibba015 bash[30343]: audit 2021-03-10T16:15:03.798435+0000 mon.c (mon.1) 2143 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:15:04.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:15:04 gibba015 bash[30343]: cephadm 2021-03-10T16:15:03.798483+0000 mgr.gibba045.orlgmj (mgr.34412) 7726 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:15:04.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:15:04 gibba015 bash[30343]: cephadm 2021-03-10T16:15:03.800148+0000 mgr.gibba045.orlgmj (mgr.34412) 7727 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:15:04.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:15:04 gibba015 bash[30343]: cephadm 2021-03-10T16:15:03.800194+0000 mgr.gibba045.orlgmj (mgr.34412) 7728 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:15:04.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:15:04 gibba015 bash[30343]: audit 2021-03-10T16:15:03.800199+0000 mon.c (mon.1) 2144 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:15:04.733 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:15:04 gibba015 bash[29377]: cephadm 2021-03-10T16:15:03.801575+0000 mgr.gibba045.orlgmj (mgr.34412) 7729 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:15:04.733 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:15:04 gibba015 bash[29377]: cephadm 2021-03-10T16:15:03.801993+0000 mgr.gibba045.orlgmj (mgr.34412) 7730 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:15:04.733 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:15:04 gibba015 bash[29377]: cephadm 2021-03-10T16:15:03.803411+0000 mgr.gibba045.orlgmj (mgr.34412) 7731 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:15:04.734 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:15:04 gibba015 bash[29377]: cephadm 2021-03-10T16:15:03.803460+0000 mgr.gibba045.orlgmj (mgr.34412) 7732 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:15:04.734 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:15:04 gibba015 bash[29377]: cephadm 2021-03-10T16:15:03.803602+0000 mgr.gibba045.orlgmj (mgr.34412) 7733 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:15:04.734 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:15:04 gibba015 bash[30343]: cephadm 2021-03-10T16:15:03.801575+0000 mgr.gibba045.orlgmj (mgr.34412) 7729 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:15:04.734 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:15:04 gibba015 bash[30343]: cephadm 2021-03-10T16:15:03.801993+0000 mgr.gibba045.orlgmj (mgr.34412) 7730 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:15:04.735 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:15:04 gibba015 bash[30343]: cephadm 2021-03-10T16:15:03.803411+0000 mgr.gibba045.orlgmj (mgr.34412) 7731 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:15:04.735 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:15:04 gibba015 bash[30343]: cephadm 2021-03-10T16:15:03.803460+0000 mgr.gibba045.orlgmj (mgr.34412) 7732 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:15:04.735 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:15:04 gibba015 bash[30343]: cephadm 2021-03-10T16:15:03.803602+0000 mgr.gibba045.orlgmj (mgr.34412) 7733 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:15:04.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:15:04 gibba045 bash[25517]: cluster 2021-03-10T16:15:03.331331+0000 mgr.gibba045.orlgmj (mgr.34412) 7718 : cluster [DBG] pgmap v4397: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:04.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:15:04 gibba045 bash[25517]: audit 2021-03-10T16:15:03.395350+0000 mon.c (mon.1) 2138 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:15:04.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:15:04 gibba045 bash[25517]: audit 2021-03-10T16:15:03.585999+0000 mon.a (mon.0) 1792 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:15:04.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:15:04 gibba045 bash[25517]: cephadm 2021-03-10T16:15:03.590188+0000 mgr.gibba045.orlgmj (mgr.34412) 7719 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:15:04.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:15:04 gibba045 bash[25517]: audit 2021-03-10T16:15:03.781544+0000 mon.a (mon.0) 1793 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:15:04.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:15:04 gibba045 bash[25517]: audit 2021-03-10T16:15:03.791345+0000 mon.c (mon.1) 2139 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:15:04.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:15:04 gibba045 bash[25517]: cephadm 2021-03-10T16:15:03.792600+0000 mgr.gibba045.orlgmj (mgr.34412) 7720 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:15:04.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:15:04 gibba045 bash[25517]: audit 2021-03-10T16:15:03.792618+0000 mon.c (mon.1) 2140 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:15:04.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:15:04 gibba045 bash[25517]: audit 2021-03-10T16:15:03.793963+0000 mon.c (mon.1) 2141 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:15:04.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:15:04 gibba045 bash[25517]: cephadm 2021-03-10T16:15:03.794511+0000 mgr.gibba045.orlgmj (mgr.34412) 7721 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:15:04.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:15:04 gibba045 bash[25517]: audit 2021-03-10T16:15:03.795312+0000 mon.c (mon.1) 2142 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:15:04.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:15:04 gibba045 bash[25517]: cephadm 2021-03-10T16:15:03.795694+0000 mgr.gibba045.orlgmj (mgr.34412) 7722 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:15:04.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:15:04 gibba045 bash[25517]: cephadm 2021-03-10T16:15:03.795733+0000 mgr.gibba045.orlgmj (mgr.34412) 7723 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:15:04.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:15:04 gibba045 bash[25517]: cephadm 2021-03-10T16:15:03.797174+0000 mgr.gibba045.orlgmj (mgr.34412) 7724 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:15:04.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:15:04 gibba045 bash[25517]: cephadm 2021-03-10T16:15:03.797231+0000 mgr.gibba045.orlgmj (mgr.34412) 7725 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:15:04.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:15:04 gibba045 bash[25517]: audit 2021-03-10T16:15:03.798435+0000 mon.c (mon.1) 2143 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:15:04.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:15:04 gibba045 bash[25517]: cephadm 2021-03-10T16:15:03.798483+0000 mgr.gibba045.orlgmj (mgr.34412) 7726 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:15:04.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:15:04 gibba045 bash[25517]: cephadm 2021-03-10T16:15:03.800148+0000 mgr.gibba045.orlgmj (mgr.34412) 7727 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:15:04.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:15:04 gibba045 bash[25517]: cephadm 2021-03-10T16:15:03.800194+0000 mgr.gibba045.orlgmj (mgr.34412) 7728 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:15:04.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:15:04 gibba045 bash[25517]: audit 2021-03-10T16:15:03.800199+0000 mon.c (mon.1) 2144 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:15:04.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:15:04 gibba045 bash[25517]: cephadm 2021-03-10T16:15:03.801575+0000 mgr.gibba045.orlgmj (mgr.34412) 7729 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:15:04.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:15:04 gibba045 bash[25517]: cephadm 2021-03-10T16:15:03.801993+0000 mgr.gibba045.orlgmj (mgr.34412) 7730 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:15:04.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:15:04 gibba045 bash[25517]: cephadm 2021-03-10T16:15:03.803411+0000 mgr.gibba045.orlgmj (mgr.34412) 7731 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:15:04.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:15:04 gibba045 bash[25517]: cephadm 2021-03-10T16:15:03.803460+0000 mgr.gibba045.orlgmj (mgr.34412) 7732 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:15:04.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:15:04 gibba045 bash[25517]: cephadm 2021-03-10T16:15:03.803602+0000 mgr.gibba045.orlgmj (mgr.34412) 7733 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:15:05.335 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:15:05.567 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:15:05.567 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 9m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:15:05.568 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 8m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:15:05.568 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:15:05.569 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:15:05.569 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:15:05.570 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:15:05.570 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:15:05.570 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:15:05.571 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 9m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:15:05.571 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 8m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:15:05.572 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:15:05.572 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:15:05.573 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:15:05.573 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:15:05.573 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:15:05.574 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:15:05.574 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:15:05.575 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:15:05.575 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 8m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:15:05.576 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 8m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:15:05.818 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:15:05.819 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:15:05.819 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:15:05.820 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:15:05.820 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:15:05.821 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:15:05.821 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:15:05.822 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:15:05.822 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:15:05.823 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:15:05.823 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:15:05.824 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:15:05.824 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:15:05.825 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:15:05.825 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:15:06.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:15:06 gibba015 bash[29377]: audit 2021-03-10T16:15:05.327944+0000 mgr.gibba045.orlgmj (mgr.34412) 7734 : audit [DBG] from='client.49236 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:15:06.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:15:06 gibba015 bash[29377]: cluster 2021-03-10T16:15:05.332738+0000 mgr.gibba045.orlgmj (mgr.34412) 7735 : cluster [DBG] pgmap v4398: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:06.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:15:06 gibba015 bash[29377]: audit 2021-03-10T16:15:05.556935+0000 mgr.gibba045.orlgmj (mgr.34412) 7736 : audit [DBG] from='client.59230 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:15:06.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:15:06 gibba015 bash[29377]: audit 2021-03-10T16:15:05.818181+0000 mon.c (mon.1) 2145 : audit [DBG] from='client.? 172.21.2.115:0/1792268082' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:15:06.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:15:06 gibba015 bash[30343]: audit 2021-03-10T16:15:05.327944+0000 mgr.gibba045.orlgmj (mgr.34412) 7734 : audit [DBG] from='client.49236 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:15:06.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:15:06 gibba015 bash[30343]: cluster 2021-03-10T16:15:05.332738+0000 mgr.gibba045.orlgmj (mgr.34412) 7735 : cluster [DBG] pgmap v4398: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:06.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:15:06 gibba015 bash[30343]: audit 2021-03-10T16:15:05.556935+0000 mgr.gibba045.orlgmj (mgr.34412) 7736 : audit [DBG] from='client.59230 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:15:06.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:15:06 gibba015 bash[30343]: audit 2021-03-10T16:15:05.818181+0000 mon.c (mon.1) 2145 : audit [DBG] from='client.? 172.21.2.115:0/1792268082' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:15:07.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:15:06 gibba045 bash[25517]: audit 2021-03-10T16:15:05.327944+0000 mgr.gibba045.orlgmj (mgr.34412) 7734 : audit [DBG] from='client.49236 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:15:07.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:15:06 gibba045 bash[25517]: cluster 2021-03-10T16:15:05.332738+0000 mgr.gibba045.orlgmj (mgr.34412) 7735 : cluster [DBG] pgmap v4398: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:07.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:15:06 gibba045 bash[25517]: audit 2021-03-10T16:15:05.556935+0000 mgr.gibba045.orlgmj (mgr.34412) 7736 : audit [DBG] from='client.59230 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:15:07.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:15:06 gibba045 bash[25517]: audit 2021-03-10T16:15:05.818181+0000 mon.c (mon.1) 2145 : audit [DBG] from='client.? 172.21.2.115:0/1792268082' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:15:08.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:15:08 gibba015 bash[29377]: cluster 2021-03-10T16:15:07.334291+0000 mgr.gibba045.orlgmj (mgr.34412) 7737 : cluster [DBG] pgmap v4399: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:08.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:15:08 gibba015 bash[30343]: cluster 2021-03-10T16:15:07.334291+0000 mgr.gibba045.orlgmj (mgr.34412) 7737 : cluster [DBG] pgmap v4399: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:09.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:15:08 gibba045 bash[25517]: cluster 2021-03-10T16:15:07.334291+0000 mgr.gibba045.orlgmj (mgr.34412) 7737 : cluster [DBG] pgmap v4399: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:10.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:15:10 gibba015 bash[29377]: cluster 2021-03-10T16:15:09.335806+0000 mgr.gibba045.orlgmj (mgr.34412) 7738 : cluster [DBG] pgmap v4400: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:10.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:15:10 gibba015 bash[30343]: cluster 2021-03-10T16:15:09.335806+0000 mgr.gibba045.orlgmj (mgr.34412) 7738 : cluster [DBG] pgmap v4400: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:11.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:15:10 gibba045 bash[25517]: cluster 2021-03-10T16:15:09.335806+0000 mgr.gibba045.orlgmj (mgr.34412) 7738 : cluster [DBG] pgmap v4400: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:12.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:15:12 gibba015 bash[29377]: cluster 2021-03-10T16:15:11.337555+0000 mgr.gibba045.orlgmj (mgr.34412) 7739 : cluster [DBG] pgmap v4401: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:12.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:15:12 gibba015 bash[30343]: cluster 2021-03-10T16:15:11.337555+0000 mgr.gibba045.orlgmj (mgr.34412) 7739 : cluster [DBG] pgmap v4401: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:13.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:15:12 gibba045 bash[25517]: cluster 2021-03-10T16:15:11.337555+0000 mgr.gibba045.orlgmj (mgr.34412) 7739 : cluster [DBG] pgmap v4401: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:14.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:15:14 gibba015 bash[29377]: cluster 2021-03-10T16:15:13.339053+0000 mgr.gibba045.orlgmj (mgr.34412) 7740 : cluster [DBG] pgmap v4402: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:14.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:15:14 gibba015 bash[30343]: cluster 2021-03-10T16:15:13.339053+0000 mgr.gibba045.orlgmj (mgr.34412) 7740 : cluster [DBG] pgmap v4402: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:15.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:15:14 gibba045 bash[25517]: cluster 2021-03-10T16:15:13.339053+0000 mgr.gibba045.orlgmj (mgr.34412) 7740 : cluster [DBG] pgmap v4402: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:16.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:15:16 gibba015 bash[29377]: cluster 2021-03-10T16:15:15.340626+0000 mgr.gibba045.orlgmj (mgr.34412) 7741 : cluster [DBG] pgmap v4403: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:16.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:15:16 gibba015 bash[30343]: cluster 2021-03-10T16:15:15.340626+0000 mgr.gibba045.orlgmj (mgr.34412) 7741 : cluster [DBG] pgmap v4403: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:17.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:15:16 gibba045 bash[25517]: cluster 2021-03-10T16:15:15.340626+0000 mgr.gibba045.orlgmj (mgr.34412) 7741 : cluster [DBG] pgmap v4403: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:18.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:15:18 gibba015 bash[29377]: cluster 2021-03-10T16:15:17.342409+0000 mgr.gibba045.orlgmj (mgr.34412) 7742 : cluster [DBG] pgmap v4404: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:18.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:15:18 gibba015 bash[30343]: cluster 2021-03-10T16:15:17.342409+0000 mgr.gibba045.orlgmj (mgr.34412) 7742 : cluster [DBG] pgmap v4404: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:19.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:15:18 gibba045 bash[25517]: cluster 2021-03-10T16:15:17.342409+0000 mgr.gibba045.orlgmj (mgr.34412) 7742 : cluster [DBG] pgmap v4404: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:20.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:15:19 gibba045 bash[25517]: cephadm 2021-03-10T16:15:18.817333+0000 mgr.gibba045.orlgmj (mgr.34412) 7743 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:15:20.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:15:19 gibba015 bash[29377]: cephadm 2021-03-10T16:15:18.817333+0000 mgr.gibba045.orlgmj (mgr.34412) 7743 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:15:20.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:15:19 gibba015 bash[30343]: cephadm 2021-03-10T16:15:18.817333+0000 mgr.gibba045.orlgmj (mgr.34412) 7743 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:15:21.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:15:20 gibba045 bash[25517]: cluster 2021-03-10T16:15:19.343878+0000 mgr.gibba045.orlgmj (mgr.34412) 7744 : cluster [DBG] pgmap v4405: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:21.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:15:20 gibba015 bash[29377]: cluster 2021-03-10T16:15:19.343878+0000 mgr.gibba045.orlgmj (mgr.34412) 7744 : cluster [DBG] pgmap v4405: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:21.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:15:20 gibba015 bash[30343]: cluster 2021-03-10T16:15:19.343878+0000 mgr.gibba045.orlgmj (mgr.34412) 7744 : cluster [DBG] pgmap v4405: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:23.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:15:22 gibba045 bash[25517]: cluster 2021-03-10T16:15:21.345640+0000 mgr.gibba045.orlgmj (mgr.34412) 7745 : cluster [DBG] pgmap v4406: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:23.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:15:22 gibba015 bash[29377]: cluster 2021-03-10T16:15:21.345640+0000 mgr.gibba045.orlgmj (mgr.34412) 7745 : cluster [DBG] pgmap v4406: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:23.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:15:22 gibba015 bash[30343]: cluster 2021-03-10T16:15:21.345640+0000 mgr.gibba045.orlgmj (mgr.34412) 7745 : cluster [DBG] pgmap v4406: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:25.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:15:24 gibba045 bash[25517]: cluster 2021-03-10T16:15:23.347397+0000 mgr.gibba045.orlgmj (mgr.34412) 7746 : cluster [DBG] pgmap v4407: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:25.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:15:24 gibba015 bash[29377]: cluster 2021-03-10T16:15:23.347397+0000 mgr.gibba045.orlgmj (mgr.34412) 7746 : cluster [DBG] pgmap v4407: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:25.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:15:24 gibba015 bash[30343]: cluster 2021-03-10T16:15:23.347397+0000 mgr.gibba045.orlgmj (mgr.34412) 7746 : cluster [DBG] pgmap v4407: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:27.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:15:26 gibba045 bash[25517]: cluster 2021-03-10T16:15:25.349196+0000 mgr.gibba045.orlgmj (mgr.34412) 7747 : cluster [DBG] pgmap v4408: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:27.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:15:26 gibba015 bash[29377]: cluster 2021-03-10T16:15:25.349196+0000 mgr.gibba045.orlgmj (mgr.34412) 7747 : cluster [DBG] pgmap v4408: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:27.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:15:26 gibba015 bash[30343]: cluster 2021-03-10T16:15:25.349196+0000 mgr.gibba045.orlgmj (mgr.34412) 7747 : cluster [DBG] pgmap v4408: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:29.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:15:28 gibba045 bash[25517]: cluster 2021-03-10T16:15:27.351149+0000 mgr.gibba045.orlgmj (mgr.34412) 7748 : cluster [DBG] pgmap v4409: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:29.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:15:28 gibba015 bash[29377]: cluster 2021-03-10T16:15:27.351149+0000 mgr.gibba045.orlgmj (mgr.34412) 7748 : cluster [DBG] pgmap v4409: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:29.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:15:28 gibba015 bash[30343]: cluster 2021-03-10T16:15:27.351149+0000 mgr.gibba045.orlgmj (mgr.34412) 7748 : cluster [DBG] pgmap v4409: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:31.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:15:30 gibba045 bash[25517]: cluster 2021-03-10T16:15:29.352690+0000 mgr.gibba045.orlgmj (mgr.34412) 7749 : cluster [DBG] pgmap v4410: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:31.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:15:30 gibba015 bash[29377]: cluster 2021-03-10T16:15:29.352690+0000 mgr.gibba045.orlgmj (mgr.34412) 7749 : cluster [DBG] pgmap v4410: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:31.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:15:30 gibba015 bash[30343]: cluster 2021-03-10T16:15:29.352690+0000 mgr.gibba045.orlgmj (mgr.34412) 7749 : cluster [DBG] pgmap v4410: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:33.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:15:32 gibba045 bash[25517]: cluster 2021-03-10T16:15:31.354611+0000 mgr.gibba045.orlgmj (mgr.34412) 7750 : cluster [DBG] pgmap v4411: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:33.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:15:32 gibba015 bash[29377]: cluster 2021-03-10T16:15:31.354611+0000 mgr.gibba045.orlgmj (mgr.34412) 7750 : cluster [DBG] pgmap v4411: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:33.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:15:32 gibba015 bash[30343]: cluster 2021-03-10T16:15:31.354611+0000 mgr.gibba045.orlgmj (mgr.34412) 7750 : cluster [DBG] pgmap v4411: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:35.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:15:34 gibba045 bash[25517]: cluster 2021-03-10T16:15:33.356126+0000 mgr.gibba045.orlgmj (mgr.34412) 7751 : cluster [DBG] pgmap v4412: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:35.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:15:34 gibba045 bash[25517]: cephadm 2021-03-10T16:15:33.829261+0000 mgr.gibba045.orlgmj (mgr.34412) 7752 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:15:35.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:15:34 gibba015 bash[29377]: cluster 2021-03-10T16:15:33.356126+0000 mgr.gibba045.orlgmj (mgr.34412) 7751 : cluster [DBG] pgmap v4412: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:35.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:15:34 gibba015 bash[29377]: cephadm 2021-03-10T16:15:33.829261+0000 mgr.gibba045.orlgmj (mgr.34412) 7752 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:15:35.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:15:34 gibba015 bash[30343]: cluster 2021-03-10T16:15:33.356126+0000 mgr.gibba045.orlgmj (mgr.34412) 7751 : cluster [DBG] pgmap v4412: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:35.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:15:34 gibba015 bash[30343]: cephadm 2021-03-10T16:15:33.829261+0000 mgr.gibba045.orlgmj (mgr.34412) 7752 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:15:36.077 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:15:36.306 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:15:36.306 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 9m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:15:36.307 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 8m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:15:36.307 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:15:36.308 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:15:36.308 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:15:36.309 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:15:36.309 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:15:36.310 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:15:36.310 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 9m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:15:36.310 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 8m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:15:36.311 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:15:36.311 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:15:36.312 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:15:36.312 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:15:36.313 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:15:36.313 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:15:36.313 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:15:36.313 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:15:36.314 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 8m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:15:36.314 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 8m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:15:36.556 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:15:36.557 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:15:36.557 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:15:36.557 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:15:36.558 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:15:36.558 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:15:36.558 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:15:36.558 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:15:36.559 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:15:36.559 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:15:36.559 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:15:36.559 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:15:36.560 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:15:36.560 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:15:36.560 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:15:37.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:15:36 gibba045 bash[25517]: cluster 2021-03-10T16:15:35.357555+0000 mgr.gibba045.orlgmj (mgr.34412) 7753 : cluster [DBG] pgmap v4413: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:37.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:15:36 gibba045 bash[25517]: audit 2021-03-10T16:15:36.070958+0000 mgr.gibba045.orlgmj (mgr.34412) 7754 : audit [DBG] from='client.49254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:15:37.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:15:36 gibba045 bash[25517]: audit 2021-03-10T16:15:36.556597+0000 mon.a (mon.0) 1794 : audit [DBG] from='client.? 172.21.2.115:0/1707718895' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:15:37.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:15:36 gibba015 bash[29377]: cluster 2021-03-10T16:15:35.357555+0000 mgr.gibba045.orlgmj (mgr.34412) 7753 : cluster [DBG] pgmap v4413: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:37.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:15:36 gibba015 bash[29377]: audit 2021-03-10T16:15:36.070958+0000 mgr.gibba045.orlgmj (mgr.34412) 7754 : audit [DBG] from='client.49254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:15:37.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:15:36 gibba015 bash[29377]: audit 2021-03-10T16:15:36.556597+0000 mon.a (mon.0) 1794 : audit [DBG] from='client.? 172.21.2.115:0/1707718895' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:15:37.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:15:36 gibba015 bash[30343]: cluster 2021-03-10T16:15:35.357555+0000 mgr.gibba045.orlgmj (mgr.34412) 7753 : cluster [DBG] pgmap v4413: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:37.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:15:36 gibba015 bash[30343]: audit 2021-03-10T16:15:36.070958+0000 mgr.gibba045.orlgmj (mgr.34412) 7754 : audit [DBG] from='client.49254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:15:37.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:15:36 gibba015 bash[30343]: audit 2021-03-10T16:15:36.556597+0000 mon.a (mon.0) 1794 : audit [DBG] from='client.? 172.21.2.115:0/1707718895' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:15:38.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:15:37 gibba015 bash[29377]: audit 2021-03-10T16:15:36.296538+0000 mgr.gibba045.orlgmj (mgr.34412) 7755 : audit [DBG] from='client.59248 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:15:38.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:15:37 gibba015 bash[30343]: audit 2021-03-10T16:15:36.296538+0000 mgr.gibba045.orlgmj (mgr.34412) 7755 : audit [DBG] from='client.59248 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:15:38.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:15:37 gibba045 bash[25517]: audit 2021-03-10T16:15:36.296538+0000 mgr.gibba045.orlgmj (mgr.34412) 7755 : audit [DBG] from='client.59248 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:15:39.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:15:38 gibba015 bash[29377]: cluster 2021-03-10T16:15:37.359410+0000 mgr.gibba045.orlgmj (mgr.34412) 7756 : cluster [DBG] pgmap v4414: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:39.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:15:38 gibba015 bash[30343]: cluster 2021-03-10T16:15:37.359410+0000 mgr.gibba045.orlgmj (mgr.34412) 7756 : cluster [DBG] pgmap v4414: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:39.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:15:38 gibba045 bash[25517]: cluster 2021-03-10T16:15:37.359410+0000 mgr.gibba045.orlgmj (mgr.34412) 7756 : cluster [DBG] pgmap v4414: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:41.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:15:40 gibba015 bash[29377]: cluster 2021-03-10T16:15:39.360963+0000 mgr.gibba045.orlgmj (mgr.34412) 7757 : cluster [DBG] pgmap v4415: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:41.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:15:40 gibba015 bash[30343]: cluster 2021-03-10T16:15:39.360963+0000 mgr.gibba045.orlgmj (mgr.34412) 7757 : cluster [DBG] pgmap v4415: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:41.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:15:40 gibba045 bash[25517]: cluster 2021-03-10T16:15:39.360963+0000 mgr.gibba045.orlgmj (mgr.34412) 7757 : cluster [DBG] pgmap v4415: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:43.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:15:42 gibba015 bash[29377]: cluster 2021-03-10T16:15:41.362704+0000 mgr.gibba045.orlgmj (mgr.34412) 7758 : cluster [DBG] pgmap v4416: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:43.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:15:42 gibba015 bash[30343]: cluster 2021-03-10T16:15:41.362704+0000 mgr.gibba045.orlgmj (mgr.34412) 7758 : cluster [DBG] pgmap v4416: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:43.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:15:42 gibba045 bash[25517]: cluster 2021-03-10T16:15:41.362704+0000 mgr.gibba045.orlgmj (mgr.34412) 7758 : cluster [DBG] pgmap v4416: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:45.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:15:44 gibba015 bash[29377]: cluster 2021-03-10T16:15:43.364197+0000 mgr.gibba045.orlgmj (mgr.34412) 7759 : cluster [DBG] pgmap v4417: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:45.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:15:44 gibba015 bash[30343]: cluster 2021-03-10T16:15:43.364197+0000 mgr.gibba045.orlgmj (mgr.34412) 7759 : cluster [DBG] pgmap v4417: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:45.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:15:44 gibba045 bash[25517]: cluster 2021-03-10T16:15:43.364197+0000 mgr.gibba045.orlgmj (mgr.34412) 7759 : cluster [DBG] pgmap v4417: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:47.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:15:46 gibba015 bash[29377]: cluster 2021-03-10T16:15:45.365914+0000 mgr.gibba045.orlgmj (mgr.34412) 7760 : cluster [DBG] pgmap v4418: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:47.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:15:46 gibba015 bash[30343]: cluster 2021-03-10T16:15:45.365914+0000 mgr.gibba045.orlgmj (mgr.34412) 7760 : cluster [DBG] pgmap v4418: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:47.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:15:46 gibba045 bash[25517]: cluster 2021-03-10T16:15:45.365914+0000 mgr.gibba045.orlgmj (mgr.34412) 7760 : cluster [DBG] pgmap v4418: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:49.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:15:48 gibba015 bash[29377]: cluster 2021-03-10T16:15:47.367737+0000 mgr.gibba045.orlgmj (mgr.34412) 7761 : cluster [DBG] pgmap v4419: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:49.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:15:48 gibba015 bash[30343]: cluster 2021-03-10T16:15:47.367737+0000 mgr.gibba045.orlgmj (mgr.34412) 7761 : cluster [DBG] pgmap v4419: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:49.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:15:48 gibba045 bash[25517]: cluster 2021-03-10T16:15:47.367737+0000 mgr.gibba045.orlgmj (mgr.34412) 7761 : cluster [DBG] pgmap v4419: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:50.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:15:49 gibba015 bash[29377]: cephadm 2021-03-10T16:15:48.841211+0000 mgr.gibba045.orlgmj (mgr.34412) 7762 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:15:50.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:15:49 gibba015 bash[30343]: cephadm 2021-03-10T16:15:48.841211+0000 mgr.gibba045.orlgmj (mgr.34412) 7762 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:15:50.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:15:49 gibba045 bash[25517]: cephadm 2021-03-10T16:15:48.841211+0000 mgr.gibba045.orlgmj (mgr.34412) 7762 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:15:51.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:15:50 gibba015 bash[29377]: cluster 2021-03-10T16:15:49.369059+0000 mgr.gibba045.orlgmj (mgr.34412) 7763 : cluster [DBG] pgmap v4420: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:51.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:15:50 gibba015 bash[30343]: cluster 2021-03-10T16:15:49.369059+0000 mgr.gibba045.orlgmj (mgr.34412) 7763 : cluster [DBG] pgmap v4420: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:51.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:15:50 gibba045 bash[25517]: cluster 2021-03-10T16:15:49.369059+0000 mgr.gibba045.orlgmj (mgr.34412) 7763 : cluster [DBG] pgmap v4420: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:53.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:15:52 gibba015 bash[29377]: cluster 2021-03-10T16:15:51.370681+0000 mgr.gibba045.orlgmj (mgr.34412) 7764 : cluster [DBG] pgmap v4421: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:53.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:15:52 gibba015 bash[30343]: cluster 2021-03-10T16:15:51.370681+0000 mgr.gibba045.orlgmj (mgr.34412) 7764 : cluster [DBG] pgmap v4421: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:53.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:15:52 gibba045 bash[25517]: cluster 2021-03-10T16:15:51.370681+0000 mgr.gibba045.orlgmj (mgr.34412) 7764 : cluster [DBG] pgmap v4421: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:54.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:15:53 gibba015 bash[29377]: audit 2021-03-10T16:15:53.485542+0000 mon.c (mon.1) 2146 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:15:54.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:15:53 gibba015 bash[29377]: audit 2021-03-10T16:15:53.486253+0000 mon.c (mon.1) 2147 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:15:54.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:15:53 gibba015 bash[29377]: audit 2021-03-10T16:15:53.486634+0000 mon.a (mon.0) 1795 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:15:54.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:15:53 gibba015 bash[29377]: audit 2021-03-10T16:15:53.487731+0000 mon.a (mon.0) 1796 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:15:54.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:15:53 gibba015 bash[29377]: audit 2021-03-10T16:15:53.487864+0000 mon.c (mon.1) 2148 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T16:15:54.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:15:53 gibba015 bash[29377]: audit 2021-03-10T16:15:53.488787+0000 mon.c (mon.1) 2149 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:15:54.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:15:53 gibba015 bash[29377]: audit 2021-03-10T16:15:53.488996+0000 mon.a (mon.0) 1797 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T16:15:54.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:15:53 gibba015 bash[29377]: audit 2021-03-10T16:15:53.489587+0000 mon.c (mon.1) 2150 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:15:54.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:15:53 gibba015 bash[29377]: audit 2021-03-10T16:15:53.490306+0000 mon.a (mon.0) 1798 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:15:54.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:15:53 gibba015 bash[29377]: audit 2021-03-10T16:15:53.490407+0000 mon.c (mon.1) 2151 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:15:54.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:15:53 gibba015 bash[29377]: audit 2021-03-10T16:15:53.491290+0000 mon.a (mon.0) 1799 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:15:54.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:15:53 gibba015 bash[29377]: audit 2021-03-10T16:15:53.492269+0000 mon.a (mon.0) 1800 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:15:54.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:15:53 gibba015 bash[30343]: audit 2021-03-10T16:15:53.485542+0000 mon.c (mon.1) 2146 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:15:54.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:15:53 gibba015 bash[30343]: audit 2021-03-10T16:15:53.486253+0000 mon.c (mon.1) 2147 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:15:54.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:15:53 gibba015 bash[30343]: audit 2021-03-10T16:15:53.486634+0000 mon.a (mon.0) 1795 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:15:54.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:15:53 gibba015 bash[30343]: audit 2021-03-10T16:15:53.487731+0000 mon.a (mon.0) 1796 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:15:54.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:15:53 gibba015 bash[30343]: audit 2021-03-10T16:15:53.487864+0000 mon.c (mon.1) 2148 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T16:15:54.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:15:53 gibba015 bash[30343]: audit 2021-03-10T16:15:53.488787+0000 mon.c (mon.1) 2149 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:15:54.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:15:53 gibba015 bash[30343]: audit 2021-03-10T16:15:53.488996+0000 mon.a (mon.0) 1797 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T16:15:54.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:15:53 gibba015 bash[30343]: audit 2021-03-10T16:15:53.489587+0000 mon.c (mon.1) 2150 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:15:54.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:15:53 gibba015 bash[30343]: audit 2021-03-10T16:15:53.490306+0000 mon.a (mon.0) 1798 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:15:54.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:15:53 gibba015 bash[30343]: audit 2021-03-10T16:15:53.490407+0000 mon.c (mon.1) 2151 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:15:54.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:15:53 gibba015 bash[30343]: audit 2021-03-10T16:15:53.491290+0000 mon.a (mon.0) 1799 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:15:54.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:15:53 gibba015 bash[30343]: audit 2021-03-10T16:15:53.492269+0000 mon.a (mon.0) 1800 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:15:54.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:15:53 gibba045 bash[25517]: audit 2021-03-10T16:15:53.485542+0000 mon.c (mon.1) 2146 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:15:54.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:15:53 gibba045 bash[25517]: audit 2021-03-10T16:15:53.486253+0000 mon.c (mon.1) 2147 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:15:54.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:15:53 gibba045 bash[25517]: audit 2021-03-10T16:15:53.486634+0000 mon.a (mon.0) 1795 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:15:54.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:15:53 gibba045 bash[25517]: audit 2021-03-10T16:15:53.487731+0000 mon.a (mon.0) 1796 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:15:54.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:15:53 gibba045 bash[25517]: audit 2021-03-10T16:15:53.487864+0000 mon.c (mon.1) 2148 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T16:15:54.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:15:53 gibba045 bash[25517]: audit 2021-03-10T16:15:53.488787+0000 mon.c (mon.1) 2149 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:15:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:15:53 gibba045 bash[25517]: audit 2021-03-10T16:15:53.488996+0000 mon.a (mon.0) 1797 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T16:15:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:15:53 gibba045 bash[25517]: audit 2021-03-10T16:15:53.489587+0000 mon.c (mon.1) 2150 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:15:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:15:53 gibba045 bash[25517]: audit 2021-03-10T16:15:53.490306+0000 mon.a (mon.0) 1798 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:15:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:15:53 gibba045 bash[25517]: audit 2021-03-10T16:15:53.490407+0000 mon.c (mon.1) 2151 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:15:54.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:15:53 gibba045 bash[25517]: audit 2021-03-10T16:15:53.491290+0000 mon.a (mon.0) 1799 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:15:54.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:15:53 gibba045 bash[25517]: audit 2021-03-10T16:15:53.492269+0000 mon.a (mon.0) 1800 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:15:55.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:15:54 gibba015 bash[29377]: cluster 2021-03-10T16:15:53.372330+0000 mgr.gibba045.orlgmj (mgr.34412) 7765 : cluster [DBG] pgmap v4422: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:55.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:15:54 gibba015 bash[30343]: cluster 2021-03-10T16:15:53.372330+0000 mgr.gibba045.orlgmj (mgr.34412) 7765 : cluster [DBG] pgmap v4422: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:55.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:15:54 gibba045 bash[25517]: cluster 2021-03-10T16:15:53.372330+0000 mgr.gibba045.orlgmj (mgr.34412) 7765 : cluster [DBG] pgmap v4422: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:57.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:15:56 gibba015 bash[29377]: cluster 2021-03-10T16:15:55.373919+0000 mgr.gibba045.orlgmj (mgr.34412) 7766 : cluster [DBG] pgmap v4423: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:57.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:15:56 gibba015 bash[30343]: cluster 2021-03-10T16:15:55.373919+0000 mgr.gibba045.orlgmj (mgr.34412) 7766 : cluster [DBG] pgmap v4423: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:57.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:15:56 gibba045 bash[25517]: cluster 2021-03-10T16:15:55.373919+0000 mgr.gibba045.orlgmj (mgr.34412) 7766 : cluster [DBG] pgmap v4423: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:59.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:15:58 gibba015 bash[29377]: cluster 2021-03-10T16:15:57.375686+0000 mgr.gibba045.orlgmj (mgr.34412) 7767 : cluster [DBG] pgmap v4424: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:59.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:15:58 gibba015 bash[30343]: cluster 2021-03-10T16:15:57.375686+0000 mgr.gibba045.orlgmj (mgr.34412) 7767 : cluster [DBG] pgmap v4424: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:59.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:15:58 gibba045 bash[25517]: cluster 2021-03-10T16:15:57.375686+0000 mgr.gibba045.orlgmj (mgr.34412) 7767 : cluster [DBG] pgmap v4424: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:01.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:16:00 gibba015 bash[29377]: cluster 2021-03-10T16:15:59.377248+0000 mgr.gibba045.orlgmj (mgr.34412) 7768 : cluster [DBG] pgmap v4425: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:01.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:16:00 gibba015 bash[30343]: cluster 2021-03-10T16:15:59.377248+0000 mgr.gibba045.orlgmj (mgr.34412) 7768 : cluster [DBG] pgmap v4425: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:01.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:16:00 gibba045 bash[25517]: cluster 2021-03-10T16:15:59.377248+0000 mgr.gibba045.orlgmj (mgr.34412) 7768 : cluster [DBG] pgmap v4425: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:03.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:16:02 gibba015 bash[29377]: cluster 2021-03-10T16:16:01.378949+0000 mgr.gibba045.orlgmj (mgr.34412) 7769 : cluster [DBG] pgmap v4426: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:03.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:16:02 gibba015 bash[30343]: cluster 2021-03-10T16:16:01.378949+0000 mgr.gibba045.orlgmj (mgr.34412) 7769 : cluster [DBG] pgmap v4426: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:03.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:16:02 gibba045 bash[25517]: cluster 2021-03-10T16:16:01.378949+0000 mgr.gibba045.orlgmj (mgr.34412) 7769 : cluster [DBG] pgmap v4426: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:04.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:16:03 gibba015 bash[29377]: audit 2021-03-10T16:16:03.851748+0000 mon.c (mon.1) 2152 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:16:04.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:16:03 gibba015 bash[29377]: audit 2021-03-10T16:16:03.857474+0000 mon.c (mon.1) 2153 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:16:04.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:16:03 gibba015 bash[30343]: audit 2021-03-10T16:16:03.851748+0000 mon.c (mon.1) 2152 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:16:04.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:16:03 gibba015 bash[30343]: audit 2021-03-10T16:16:03.857474+0000 mon.c (mon.1) 2153 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:16:04.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:16:03 gibba045 bash[25517]: audit 2021-03-10T16:16:03.851748+0000 mon.c (mon.1) 2152 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:16:04.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:16:03 gibba045 bash[25517]: audit 2021-03-10T16:16:03.857474+0000 mon.c (mon.1) 2153 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:16:05.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:16:04 gibba015 bash[29377]: cluster 2021-03-10T16:16:03.380478+0000 mgr.gibba045.orlgmj (mgr.34412) 7770 : cluster [DBG] pgmap v4427: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:05.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:16:04 gibba015 bash[29377]: cephadm 2021-03-10T16:16:03.859658+0000 mgr.gibba045.orlgmj (mgr.34412) 7771 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:16:05.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:16:04 gibba015 bash[30343]: cluster 2021-03-10T16:16:03.380478+0000 mgr.gibba045.orlgmj (mgr.34412) 7770 : cluster [DBG] pgmap v4427: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:05.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:16:04 gibba015 bash[30343]: cephadm 2021-03-10T16:16:03.859658+0000 mgr.gibba045.orlgmj (mgr.34412) 7771 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:16:05.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:16:04 gibba045 bash[25517]: cluster 2021-03-10T16:16:03.380478+0000 mgr.gibba045.orlgmj (mgr.34412) 7770 : cluster [DBG] pgmap v4427: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:05.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:16:04 gibba045 bash[25517]: cephadm 2021-03-10T16:16:03.859658+0000 mgr.gibba045.orlgmj (mgr.34412) 7771 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:16:06.820 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:16:07.058 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:16:07.059 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 10m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:16:07.059 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 9m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:16:07.059 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:16:07.059 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:16:07.060 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:16:07.060 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:16:07.060 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:16:07.061 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:16:07.061 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 10m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:16:07.061 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 9m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:16:07.061 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:16:07.061 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:16:07.062 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:16:07.062 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:16:07.062 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:16:07.062 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:16:07.063 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:16:07.063 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:16:07.063 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 9m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:16:07.063 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 9m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:16:07.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:16:06 gibba015 bash[29377]: cluster 2021-03-10T16:16:05.382133+0000 mgr.gibba045.orlgmj (mgr.34412) 7772 : cluster [DBG] pgmap v4428: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:07.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:16:06 gibba015 bash[30343]: cluster 2021-03-10T16:16:05.382133+0000 mgr.gibba045.orlgmj (mgr.34412) 7772 : cluster [DBG] pgmap v4428: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:07.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:16:06 gibba045 bash[25517]: cluster 2021-03-10T16:16:05.382133+0000 mgr.gibba045.orlgmj (mgr.34412) 7772 : cluster [DBG] pgmap v4428: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:07.344 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:16:07.344 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:16:07.345 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:16:07.345 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:16:07.345 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:16:07.345 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:16:07.346 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:16:07.346 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:16:07.346 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:16:07.346 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:16:07.346 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:16:07.347 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:16:07.347 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:16:07.347 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:16:07.347 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:16:08.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:16:07 gibba015 bash[29377]: audit 2021-03-10T16:16:06.813695+0000 mgr.gibba045.orlgmj (mgr.34412) 7773 : audit [DBG] from='client.59260 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:16:08.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:16:07 gibba015 bash[29377]: audit 2021-03-10T16:16:07.049559+0000 mgr.gibba045.orlgmj (mgr.34412) 7774 : audit [DBG] from='client.59266 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:16:08.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:16:07 gibba015 bash[29377]: audit 2021-03-10T16:16:07.339739+0000 mon.a (mon.0) 1801 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:16:08.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:16:07 gibba015 bash[29377]: audit 2021-03-10T16:16:07.344859+0000 mon.c (mon.1) 2154 : audit [DBG] from='client.? 172.21.2.115:0/894360274' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:16:08.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:16:07 gibba015 bash[29377]: audit 2021-03-10T16:16:07.581366+0000 mon.a (mon.0) 1802 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:16:08.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:16:07 gibba015 bash[29377]: audit 2021-03-10T16:16:07.589059+0000 mon.c (mon.1) 2155 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:16:08.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:16:07 gibba015 bash[29377]: audit 2021-03-10T16:16:07.590581+0000 mon.c (mon.1) 2156 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:16:08.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:16:07 gibba015 bash[29377]: audit 2021-03-10T16:16:07.591796+0000 mon.c (mon.1) 2157 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:16:08.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:16:07 gibba015 bash[29377]: audit 2021-03-10T16:16:07.592927+0000 mon.c (mon.1) 2158 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:16:08.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:16:07 gibba015 bash[29377]: audit 2021-03-10T16:16:07.596118+0000 mon.c (mon.1) 2159 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:16:08.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:16:07 gibba015 bash[29377]: audit 2021-03-10T16:16:07.597933+0000 mon.c (mon.1) 2160 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:16:08.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:16:07 gibba015 bash[30343]: audit 2021-03-10T16:16:06.813695+0000 mgr.gibba045.orlgmj (mgr.34412) 7773 : audit [DBG] from='client.59260 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:16:08.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:16:07 gibba015 bash[30343]: audit 2021-03-10T16:16:07.049559+0000 mgr.gibba045.orlgmj (mgr.34412) 7774 : audit [DBG] from='client.59266 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:16:08.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:16:07 gibba015 bash[30343]: audit 2021-03-10T16:16:07.339739+0000 mon.a (mon.0) 1801 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:16:08.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:16:07 gibba015 bash[30343]: audit 2021-03-10T16:16:07.344859+0000 mon.c (mon.1) 2154 : audit [DBG] from='client.? 172.21.2.115:0/894360274' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:16:08.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:16:07 gibba015 bash[30343]: audit 2021-03-10T16:16:07.581366+0000 mon.a (mon.0) 1802 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:16:08.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:16:07 gibba015 bash[30343]: audit 2021-03-10T16:16:07.589059+0000 mon.c (mon.1) 2155 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:16:08.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:16:07 gibba015 bash[30343]: audit 2021-03-10T16:16:07.590581+0000 mon.c (mon.1) 2156 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:16:08.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:16:07 gibba015 bash[30343]: audit 2021-03-10T16:16:07.591796+0000 mon.c (mon.1) 2157 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:16:08.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:16:07 gibba015 bash[30343]: audit 2021-03-10T16:16:07.592927+0000 mon.c (mon.1) 2158 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:16:08.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:16:07 gibba015 bash[30343]: audit 2021-03-10T16:16:07.596118+0000 mon.c (mon.1) 2159 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:16:08.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:16:07 gibba015 bash[30343]: audit 2021-03-10T16:16:07.597933+0000 mon.c (mon.1) 2160 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:16:08.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:16:07 gibba045 bash[25517]: audit 2021-03-10T16:16:06.813695+0000 mgr.gibba045.orlgmj (mgr.34412) 7773 : audit [DBG] from='client.59260 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:16:08.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:16:07 gibba045 bash[25517]: audit 2021-03-10T16:16:07.049559+0000 mgr.gibba045.orlgmj (mgr.34412) 7774 : audit [DBG] from='client.59266 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:16:08.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:16:07 gibba045 bash[25517]: audit 2021-03-10T16:16:07.339739+0000 mon.a (mon.0) 1801 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:16:08.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:16:07 gibba045 bash[25517]: audit 2021-03-10T16:16:07.344859+0000 mon.c (mon.1) 2154 : audit [DBG] from='client.? 172.21.2.115:0/894360274' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:16:08.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:16:07 gibba045 bash[25517]: audit 2021-03-10T16:16:07.581366+0000 mon.a (mon.0) 1802 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:16:08.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:16:07 gibba045 bash[25517]: audit 2021-03-10T16:16:07.589059+0000 mon.c (mon.1) 2155 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:16:08.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:16:07 gibba045 bash[25517]: audit 2021-03-10T16:16:07.590581+0000 mon.c (mon.1) 2156 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:16:08.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:16:07 gibba045 bash[25517]: audit 2021-03-10T16:16:07.591796+0000 mon.c (mon.1) 2157 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:16:08.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:16:07 gibba045 bash[25517]: audit 2021-03-10T16:16:07.592927+0000 mon.c (mon.1) 2158 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:16:08.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:16:07 gibba045 bash[25517]: audit 2021-03-10T16:16:07.596118+0000 mon.c (mon.1) 2159 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:16:08.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:16:07 gibba045 bash[25517]: audit 2021-03-10T16:16:07.597933+0000 mon.c (mon.1) 2160 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:16:09.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:16:08 gibba015 bash[29377]: cephadm 2021-03-10T16:16:07.344075+0000 mgr.gibba045.orlgmj (mgr.34412) 7775 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:16:09.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:16:08 gibba015 bash[29377]: cluster 2021-03-10T16:16:07.383558+0000 mgr.gibba045.orlgmj (mgr.34412) 7776 : cluster [DBG] pgmap v4429: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:09.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:16:08 gibba015 bash[29377]: cephadm 2021-03-10T16:16:07.590755+0000 mgr.gibba045.orlgmj (mgr.34412) 7777 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:16:09.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:16:08 gibba015 bash[29377]: cephadm 2021-03-10T16:16:07.592508+0000 mgr.gibba045.orlgmj (mgr.34412) 7778 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:16:09.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:16:08 gibba015 bash[29377]: cephadm 2021-03-10T16:16:07.593849+0000 mgr.gibba045.orlgmj (mgr.34412) 7779 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:16:09.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:16:08 gibba015 bash[29377]: cephadm 2021-03-10T16:16:07.593888+0000 mgr.gibba045.orlgmj (mgr.34412) 7780 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:16:09.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:16:08 gibba015 bash[29377]: cephadm 2021-03-10T16:16:07.595042+0000 mgr.gibba045.orlgmj (mgr.34412) 7781 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:16:09.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:16:08 gibba015 bash[29377]: cephadm 2021-03-10T16:16:07.595098+0000 mgr.gibba045.orlgmj (mgr.34412) 7782 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:16:09.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:16:08 gibba015 bash[29377]: cephadm 2021-03-10T16:16:07.596011+0000 mgr.gibba045.orlgmj (mgr.34412) 7783 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:16:09.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:16:08 gibba015 bash[29377]: cephadm 2021-03-10T16:16:07.597956+0000 mgr.gibba045.orlgmj (mgr.34412) 7784 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:16:09.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:16:08 gibba015 bash[29377]: cephadm 2021-03-10T16:16:07.597995+0000 mgr.gibba045.orlgmj (mgr.34412) 7785 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:16:09.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:16:08 gibba015 bash[29377]: cephadm 2021-03-10T16:16:07.599579+0000 mgr.gibba045.orlgmj (mgr.34412) 7786 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:16:09.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:16:08 gibba015 bash[29377]: cephadm 2021-03-10T16:16:07.599935+0000 mgr.gibba045.orlgmj (mgr.34412) 7787 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:16:09.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:16:08 gibba015 bash[29377]: cephadm 2021-03-10T16:16:07.601567+0000 mgr.gibba045.orlgmj (mgr.34412) 7788 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:16:09.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:16:08 gibba015 bash[29377]: cephadm 2021-03-10T16:16:07.601611+0000 mgr.gibba045.orlgmj (mgr.34412) 7789 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:16:09.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:16:08 gibba015 bash[29377]: cephadm 2021-03-10T16:16:07.601737+0000 mgr.gibba045.orlgmj (mgr.34412) 7790 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:16:09.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:16:08 gibba015 bash[30343]: cephadm 2021-03-10T16:16:07.344075+0000 mgr.gibba045.orlgmj (mgr.34412) 7775 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:16:09.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:16:08 gibba015 bash[30343]: cluster 2021-03-10T16:16:07.383558+0000 mgr.gibba045.orlgmj (mgr.34412) 7776 : cluster [DBG] pgmap v4429: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:09.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:16:08 gibba015 bash[30343]: cephadm 2021-03-10T16:16:07.590755+0000 mgr.gibba045.orlgmj (mgr.34412) 7777 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:16:09.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:16:08 gibba015 bash[30343]: cephadm 2021-03-10T16:16:07.592508+0000 mgr.gibba045.orlgmj (mgr.34412) 7778 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:16:09.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:16:08 gibba015 bash[30343]: cephadm 2021-03-10T16:16:07.593849+0000 mgr.gibba045.orlgmj (mgr.34412) 7779 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:16:09.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:16:08 gibba015 bash[30343]: cephadm 2021-03-10T16:16:07.593888+0000 mgr.gibba045.orlgmj (mgr.34412) 7780 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:16:09.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:16:08 gibba015 bash[30343]: cephadm 2021-03-10T16:16:07.595042+0000 mgr.gibba045.orlgmj (mgr.34412) 7781 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:16:09.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:16:08 gibba015 bash[30343]: cephadm 2021-03-10T16:16:07.595098+0000 mgr.gibba045.orlgmj (mgr.34412) 7782 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:16:09.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:16:08 gibba015 bash[30343]: cephadm 2021-03-10T16:16:07.596011+0000 mgr.gibba045.orlgmj (mgr.34412) 7783 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:16:09.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:16:08 gibba015 bash[30343]: cephadm 2021-03-10T16:16:07.597956+0000 mgr.gibba045.orlgmj (mgr.34412) 7784 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:16:09.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:16:08 gibba015 bash[30343]: cephadm 2021-03-10T16:16:07.597995+0000 mgr.gibba045.orlgmj (mgr.34412) 7785 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:16:09.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:16:08 gibba015 bash[30343]: cephadm 2021-03-10T16:16:07.599579+0000 mgr.gibba045.orlgmj (mgr.34412) 7786 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:16:09.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:16:08 gibba015 bash[30343]: cephadm 2021-03-10T16:16:07.599935+0000 mgr.gibba045.orlgmj (mgr.34412) 7787 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:16:09.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:16:08 gibba015 bash[30343]: cephadm 2021-03-10T16:16:07.601567+0000 mgr.gibba045.orlgmj (mgr.34412) 7788 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:16:09.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:16:08 gibba015 bash[30343]: cephadm 2021-03-10T16:16:07.601611+0000 mgr.gibba045.orlgmj (mgr.34412) 7789 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:16:09.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:16:08 gibba015 bash[30343]: cephadm 2021-03-10T16:16:07.601737+0000 mgr.gibba045.orlgmj (mgr.34412) 7790 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:16:09.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:16:08 gibba045 bash[25517]: cephadm 2021-03-10T16:16:07.344075+0000 mgr.gibba045.orlgmj (mgr.34412) 7775 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:16:09.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:16:08 gibba045 bash[25517]: cluster 2021-03-10T16:16:07.383558+0000 mgr.gibba045.orlgmj (mgr.34412) 7776 : cluster [DBG] pgmap v4429: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:09.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:16:08 gibba045 bash[25517]: cephadm 2021-03-10T16:16:07.590755+0000 mgr.gibba045.orlgmj (mgr.34412) 7777 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:16:09.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:16:08 gibba045 bash[25517]: cephadm 2021-03-10T16:16:07.592508+0000 mgr.gibba045.orlgmj (mgr.34412) 7778 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:16:09.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:16:08 gibba045 bash[25517]: cephadm 2021-03-10T16:16:07.593849+0000 mgr.gibba045.orlgmj (mgr.34412) 7779 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:16:09.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:16:08 gibba045 bash[25517]: cephadm 2021-03-10T16:16:07.593888+0000 mgr.gibba045.orlgmj (mgr.34412) 7780 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:16:09.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:16:08 gibba045 bash[25517]: cephadm 2021-03-10T16:16:07.595042+0000 mgr.gibba045.orlgmj (mgr.34412) 7781 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:16:09.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:16:08 gibba045 bash[25517]: cephadm 2021-03-10T16:16:07.595098+0000 mgr.gibba045.orlgmj (mgr.34412) 7782 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:16:09.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:16:08 gibba045 bash[25517]: cephadm 2021-03-10T16:16:07.596011+0000 mgr.gibba045.orlgmj (mgr.34412) 7783 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:16:09.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:16:08 gibba045 bash[25517]: cephadm 2021-03-10T16:16:07.597956+0000 mgr.gibba045.orlgmj (mgr.34412) 7784 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:16:09.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:16:08 gibba045 bash[25517]: cephadm 2021-03-10T16:16:07.597995+0000 mgr.gibba045.orlgmj (mgr.34412) 7785 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:16:09.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:16:08 gibba045 bash[25517]: cephadm 2021-03-10T16:16:07.599579+0000 mgr.gibba045.orlgmj (mgr.34412) 7786 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:16:09.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:16:08 gibba045 bash[25517]: cephadm 2021-03-10T16:16:07.599935+0000 mgr.gibba045.orlgmj (mgr.34412) 7787 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:16:09.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:16:08 gibba045 bash[25517]: cephadm 2021-03-10T16:16:07.601567+0000 mgr.gibba045.orlgmj (mgr.34412) 7788 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:16:09.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:16:08 gibba045 bash[25517]: cephadm 2021-03-10T16:16:07.601611+0000 mgr.gibba045.orlgmj (mgr.34412) 7789 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:16:09.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:16:08 gibba045 bash[25517]: cephadm 2021-03-10T16:16:07.601737+0000 mgr.gibba045.orlgmj (mgr.34412) 7790 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:16:11.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:16:10 gibba045 bash[25517]: cluster 2021-03-10T16:16:09.384759+0000 mgr.gibba045.orlgmj (mgr.34412) 7791 : cluster [DBG] pgmap v4430: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:11.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:16:10 gibba015 bash[29377]: cluster 2021-03-10T16:16:09.384759+0000 mgr.gibba045.orlgmj (mgr.34412) 7791 : cluster [DBG] pgmap v4430: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:11.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:16:10 gibba015 bash[30343]: cluster 2021-03-10T16:16:09.384759+0000 mgr.gibba045.orlgmj (mgr.34412) 7791 : cluster [DBG] pgmap v4430: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:13.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:16:12 gibba045 bash[25517]: cluster 2021-03-10T16:16:11.386532+0000 mgr.gibba045.orlgmj (mgr.34412) 7792 : cluster [DBG] pgmap v4431: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:13.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:16:12 gibba015 bash[29377]: cluster 2021-03-10T16:16:11.386532+0000 mgr.gibba045.orlgmj (mgr.34412) 7792 : cluster [DBG] pgmap v4431: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:13.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:16:12 gibba015 bash[30343]: cluster 2021-03-10T16:16:11.386532+0000 mgr.gibba045.orlgmj (mgr.34412) 7792 : cluster [DBG] pgmap v4431: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:15.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:16:14 gibba045 bash[25517]: cluster 2021-03-10T16:16:13.388153+0000 mgr.gibba045.orlgmj (mgr.34412) 7793 : cluster [DBG] pgmap v4432: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:15.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:16:14 gibba015 bash[29377]: cluster 2021-03-10T16:16:13.388153+0000 mgr.gibba045.orlgmj (mgr.34412) 7793 : cluster [DBG] pgmap v4432: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:15.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:16:14 gibba015 bash[30343]: cluster 2021-03-10T16:16:13.388153+0000 mgr.gibba045.orlgmj (mgr.34412) 7793 : cluster [DBG] pgmap v4432: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:17.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:16:17 gibba045 bash[25517]: cluster 2021-03-10T16:16:15.389758+0000 mgr.gibba045.orlgmj (mgr.34412) 7794 : cluster [DBG] pgmap v4433: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:17.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:16:16 gibba015 bash[29377]: cluster 2021-03-10T16:16:15.389758+0000 mgr.gibba045.orlgmj (mgr.34412) 7794 : cluster [DBG] pgmap v4433: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:17.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:16:16 gibba015 bash[30343]: cluster 2021-03-10T16:16:15.389758+0000 mgr.gibba045.orlgmj (mgr.34412) 7794 : cluster [DBG] pgmap v4433: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:19.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:16:19 gibba045 bash[25517]: cluster 2021-03-10T16:16:17.391558+0000 mgr.gibba045.orlgmj (mgr.34412) 7795 : cluster [DBG] pgmap v4434: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:19.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:16:19 gibba015 bash[29377]: cluster 2021-03-10T16:16:17.391558+0000 mgr.gibba045.orlgmj (mgr.34412) 7795 : cluster [DBG] pgmap v4434: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:19.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:16:19 gibba015 bash[30343]: cluster 2021-03-10T16:16:17.391558+0000 mgr.gibba045.orlgmj (mgr.34412) 7795 : cluster [DBG] pgmap v4434: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:21.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:16:21 gibba045 bash[25517]: cluster 2021-03-10T16:16:19.393092+0000 mgr.gibba045.orlgmj (mgr.34412) 7796 : cluster [DBG] pgmap v4435: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:21.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:16:21 gibba015 bash[29377]: cluster 2021-03-10T16:16:19.393092+0000 mgr.gibba045.orlgmj (mgr.34412) 7796 : cluster [DBG] pgmap v4435: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:21.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:16:21 gibba015 bash[30343]: cluster 2021-03-10T16:16:19.393092+0000 mgr.gibba045.orlgmj (mgr.34412) 7796 : cluster [DBG] pgmap v4435: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:23.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:16:23 gibba045 bash[25517]: cluster 2021-03-10T16:16:21.394553+0000 mgr.gibba045.orlgmj (mgr.34412) 7797 : cluster [DBG] pgmap v4436: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:23.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:16:23 gibba015 bash[29377]: cluster 2021-03-10T16:16:21.394553+0000 mgr.gibba045.orlgmj (mgr.34412) 7797 : cluster [DBG] pgmap v4436: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:23.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:16:23 gibba015 bash[30343]: cluster 2021-03-10T16:16:21.394553+0000 mgr.gibba045.orlgmj (mgr.34412) 7797 : cluster [DBG] pgmap v4436: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:24.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:16:24 gibba045 bash[25517]: cephadm 2021-03-10T16:16:22.617817+0000 mgr.gibba045.orlgmj (mgr.34412) 7798 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:16:24.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:16:24 gibba015 bash[29377]: cephadm 2021-03-10T16:16:22.617817+0000 mgr.gibba045.orlgmj (mgr.34412) 7798 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:16:24.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:16:24 gibba015 bash[30343]: cephadm 2021-03-10T16:16:22.617817+0000 mgr.gibba045.orlgmj (mgr.34412) 7798 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:16:25.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:16:25 gibba045 bash[25517]: cluster 2021-03-10T16:16:23.396062+0000 mgr.gibba045.orlgmj (mgr.34412) 7799 : cluster [DBG] pgmap v4437: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:25.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:16:25 gibba015 bash[29377]: cluster 2021-03-10T16:16:23.396062+0000 mgr.gibba045.orlgmj (mgr.34412) 7799 : cluster [DBG] pgmap v4437: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:25.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:16:25 gibba015 bash[30343]: cluster 2021-03-10T16:16:23.396062+0000 mgr.gibba045.orlgmj (mgr.34412) 7799 : cluster [DBG] pgmap v4437: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:27.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:16:27 gibba045 bash[25517]: cluster 2021-03-10T16:16:25.397666+0000 mgr.gibba045.orlgmj (mgr.34412) 7800 : cluster [DBG] pgmap v4438: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:27.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:16:27 gibba015 bash[29377]: cluster 2021-03-10T16:16:25.397666+0000 mgr.gibba045.orlgmj (mgr.34412) 7800 : cluster [DBG] pgmap v4438: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:27.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:16:27 gibba015 bash[30343]: cluster 2021-03-10T16:16:25.397666+0000 mgr.gibba045.orlgmj (mgr.34412) 7800 : cluster [DBG] pgmap v4438: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:29.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:16:29 gibba015 bash[29377]: cluster 2021-03-10T16:16:27.399454+0000 mgr.gibba045.orlgmj (mgr.34412) 7801 : cluster [DBG] pgmap v4439: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:29.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:16:29 gibba015 bash[30343]: cluster 2021-03-10T16:16:27.399454+0000 mgr.gibba045.orlgmj (mgr.34412) 7801 : cluster [DBG] pgmap v4439: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:29.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:16:29 gibba045 bash[25517]: cluster 2021-03-10T16:16:27.399454+0000 mgr.gibba045.orlgmj (mgr.34412) 7801 : cluster [DBG] pgmap v4439: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:31.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:16:31 gibba015 bash[29377]: cluster 2021-03-10T16:16:29.400679+0000 mgr.gibba045.orlgmj (mgr.34412) 7802 : cluster [DBG] pgmap v4440: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:31.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:16:31 gibba015 bash[30343]: cluster 2021-03-10T16:16:29.400679+0000 mgr.gibba045.orlgmj (mgr.34412) 7802 : cluster [DBG] pgmap v4440: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:31.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:16:31 gibba045 bash[25517]: cluster 2021-03-10T16:16:29.400679+0000 mgr.gibba045.orlgmj (mgr.34412) 7802 : cluster [DBG] pgmap v4440: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:33.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:16:33 gibba015 bash[29377]: cluster 2021-03-10T16:16:31.402228+0000 mgr.gibba045.orlgmj (mgr.34412) 7803 : cluster [DBG] pgmap v4441: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:33.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:16:33 gibba015 bash[30343]: cluster 2021-03-10T16:16:31.402228+0000 mgr.gibba045.orlgmj (mgr.34412) 7803 : cluster [DBG] pgmap v4441: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:33.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:16:33 gibba045 bash[25517]: cluster 2021-03-10T16:16:31.402228+0000 mgr.gibba045.orlgmj (mgr.34412) 7803 : cluster [DBG] pgmap v4441: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:35.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:16:35 gibba015 bash[29377]: cluster 2021-03-10T16:16:33.403856+0000 mgr.gibba045.orlgmj (mgr.34412) 7804 : cluster [DBG] pgmap v4442: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:35.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:16:35 gibba015 bash[30343]: cluster 2021-03-10T16:16:33.403856+0000 mgr.gibba045.orlgmj (mgr.34412) 7804 : cluster [DBG] pgmap v4442: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:35.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:16:35 gibba045 bash[25517]: cluster 2021-03-10T16:16:33.403856+0000 mgr.gibba045.orlgmj (mgr.34412) 7804 : cluster [DBG] pgmap v4442: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:37.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:16:37 gibba015 bash[29377]: cluster 2021-03-10T16:16:35.405545+0000 mgr.gibba045.orlgmj (mgr.34412) 7805 : cluster [DBG] pgmap v4443: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:37.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:16:37 gibba015 bash[30343]: cluster 2021-03-10T16:16:35.405545+0000 mgr.gibba045.orlgmj (mgr.34412) 7805 : cluster [DBG] pgmap v4443: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:37.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:16:37 gibba045 bash[25517]: cluster 2021-03-10T16:16:35.405545+0000 mgr.gibba045.orlgmj (mgr.34412) 7805 : cluster [DBG] pgmap v4443: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:37.589 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:16:37.837 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:16:37.838 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 30s ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:16:37.838 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 9m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:16:37.838 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:16:37.839 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:16:37.839 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 30s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:16:37.839 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 30s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:16:37.839 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:16:37.840 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 30s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:16:37.840 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 30s ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:16:37.840 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 9m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:16:37.840 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 30s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:16:37.840 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 30s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:16:37.841 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 30s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:16:37.841 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 30s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:16:37.841 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:16:37.841 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:16:37.842 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:16:37.842 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:16:37.842 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 9m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:16:37.842 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 9m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:16:38.087 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:16:38.087 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:16:38.088 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:16:38.088 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:16:38.088 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:16:38.088 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:16:38.089 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:16:38.089 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:16:38.089 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:16:38.089 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:16:38.090 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:16:38.090 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:16:38.090 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:16:38.090 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:16:38.090 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:16:38.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:16:38 gibba015 bash[29377]: audit 2021-03-10T16:16:38.087478+0000 mon.a (mon.0) 1803 : audit [DBG] from='client.? 172.21.2.115:0/1118473441' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:16:38.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:16:38 gibba015 bash[30343]: audit 2021-03-10T16:16:38.087478+0000 mon.a (mon.0) 1803 : audit [DBG] from='client.? 172.21.2.115:0/1118473441' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:16:38.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:16:38 gibba045 bash[25517]: audit 2021-03-10T16:16:38.087478+0000 mon.a (mon.0) 1803 : audit [DBG] from='client.? 172.21.2.115:0/1118473441' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:16:39.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:16:39 gibba015 bash[29377]: cluster 2021-03-10T16:16:37.407391+0000 mgr.gibba045.orlgmj (mgr.34412) 7806 : cluster [DBG] pgmap v4444: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:39.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:16:39 gibba015 bash[29377]: audit 2021-03-10T16:16:37.582520+0000 mgr.gibba045.orlgmj (mgr.34412) 7807 : audit [DBG] from='client.49290 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:16:39.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:16:39 gibba015 bash[29377]: cephadm 2021-03-10T16:16:37.633797+0000 mgr.gibba045.orlgmj (mgr.34412) 7808 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:16:39.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:16:39 gibba015 bash[29377]: audit 2021-03-10T16:16:37.806459+0000 mgr.gibba045.orlgmj (mgr.34412) 7809 : audit [DBG] from='client.59284 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:16:39.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:16:39 gibba015 bash[30343]: cluster 2021-03-10T16:16:37.407391+0000 mgr.gibba045.orlgmj (mgr.34412) 7806 : cluster [DBG] pgmap v4444: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:39.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:16:39 gibba015 bash[30343]: audit 2021-03-10T16:16:37.582520+0000 mgr.gibba045.orlgmj (mgr.34412) 7807 : audit [DBG] from='client.49290 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:16:39.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:16:39 gibba015 bash[30343]: cephadm 2021-03-10T16:16:37.633797+0000 mgr.gibba045.orlgmj (mgr.34412) 7808 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:16:39.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:16:39 gibba015 bash[30343]: audit 2021-03-10T16:16:37.806459+0000 mgr.gibba045.orlgmj (mgr.34412) 7809 : audit [DBG] from='client.59284 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:16:39.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:16:39 gibba045 bash[25517]: cluster 2021-03-10T16:16:37.407391+0000 mgr.gibba045.orlgmj (mgr.34412) 7806 : cluster [DBG] pgmap v4444: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:39.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:16:39 gibba045 bash[25517]: audit 2021-03-10T16:16:37.582520+0000 mgr.gibba045.orlgmj (mgr.34412) 7807 : audit [DBG] from='client.49290 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:16:39.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:16:39 gibba045 bash[25517]: cephadm 2021-03-10T16:16:37.633797+0000 mgr.gibba045.orlgmj (mgr.34412) 7808 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:16:39.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:16:39 gibba045 bash[25517]: audit 2021-03-10T16:16:37.806459+0000 mgr.gibba045.orlgmj (mgr.34412) 7809 : audit [DBG] from='client.59284 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:16:41.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:16:41 gibba015 bash[29377]: cluster 2021-03-10T16:16:39.408928+0000 mgr.gibba045.orlgmj (mgr.34412) 7810 : cluster [DBG] pgmap v4445: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:41.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:16:41 gibba015 bash[30343]: cluster 2021-03-10T16:16:39.408928+0000 mgr.gibba045.orlgmj (mgr.34412) 7810 : cluster [DBG] pgmap v4445: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:41.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:16:41 gibba045 bash[25517]: cluster 2021-03-10T16:16:39.408928+0000 mgr.gibba045.orlgmj (mgr.34412) 7810 : cluster [DBG] pgmap v4445: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:43.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:16:43 gibba015 bash[29377]: cluster 2021-03-10T16:16:41.410443+0000 mgr.gibba045.orlgmj (mgr.34412) 7811 : cluster [DBG] pgmap v4446: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:43.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:16:43 gibba015 bash[30343]: cluster 2021-03-10T16:16:41.410443+0000 mgr.gibba045.orlgmj (mgr.34412) 7811 : cluster [DBG] pgmap v4446: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:43.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:16:43 gibba045 bash[25517]: cluster 2021-03-10T16:16:41.410443+0000 mgr.gibba045.orlgmj (mgr.34412) 7811 : cluster [DBG] pgmap v4446: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:45.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:16:45 gibba015 bash[29377]: cluster 2021-03-10T16:16:43.412075+0000 mgr.gibba045.orlgmj (mgr.34412) 7812 : cluster [DBG] pgmap v4447: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:45.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:16:45 gibba015 bash[30343]: cluster 2021-03-10T16:16:43.412075+0000 mgr.gibba045.orlgmj (mgr.34412) 7812 : cluster [DBG] pgmap v4447: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:45.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:16:45 gibba045 bash[25517]: cluster 2021-03-10T16:16:43.412075+0000 mgr.gibba045.orlgmj (mgr.34412) 7812 : cluster [DBG] pgmap v4447: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:47.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:16:47 gibba015 bash[29377]: cluster 2021-03-10T16:16:45.413605+0000 mgr.gibba045.orlgmj (mgr.34412) 7813 : cluster [DBG] pgmap v4448: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:47.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:16:47 gibba015 bash[30343]: cluster 2021-03-10T16:16:45.413605+0000 mgr.gibba045.orlgmj (mgr.34412) 7813 : cluster [DBG] pgmap v4448: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:47.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:16:47 gibba045 bash[25517]: cluster 2021-03-10T16:16:45.413605+0000 mgr.gibba045.orlgmj (mgr.34412) 7813 : cluster [DBG] pgmap v4448: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:49.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:16:49 gibba015 bash[29377]: cluster 2021-03-10T16:16:47.415230+0000 mgr.gibba045.orlgmj (mgr.34412) 7814 : cluster [DBG] pgmap v4449: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:49.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:16:49 gibba015 bash[30343]: cluster 2021-03-10T16:16:47.415230+0000 mgr.gibba045.orlgmj (mgr.34412) 7814 : cluster [DBG] pgmap v4449: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:49.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:16:49 gibba045 bash[25517]: cluster 2021-03-10T16:16:47.415230+0000 mgr.gibba045.orlgmj (mgr.34412) 7814 : cluster [DBG] pgmap v4449: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:51.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:16:51 gibba015 bash[29377]: cluster 2021-03-10T16:16:49.416837+0000 mgr.gibba045.orlgmj (mgr.34412) 7815 : cluster [DBG] pgmap v4450: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:51.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:16:51 gibba015 bash[30343]: cluster 2021-03-10T16:16:49.416837+0000 mgr.gibba045.orlgmj (mgr.34412) 7815 : cluster [DBG] pgmap v4450: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:51.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:16:51 gibba045 bash[25517]: cluster 2021-03-10T16:16:49.416837+0000 mgr.gibba045.orlgmj (mgr.34412) 7815 : cluster [DBG] pgmap v4450: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:53.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:16:53 gibba015 bash[29377]: cluster 2021-03-10T16:16:51.418712+0000 mgr.gibba045.orlgmj (mgr.34412) 7816 : cluster [DBG] pgmap v4451: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:53.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:16:53 gibba015 bash[30343]: cluster 2021-03-10T16:16:51.418712+0000 mgr.gibba045.orlgmj (mgr.34412) 7816 : cluster [DBG] pgmap v4451: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:53.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:16:53 gibba045 bash[25517]: cluster 2021-03-10T16:16:51.418712+0000 mgr.gibba045.orlgmj (mgr.34412) 7816 : cluster [DBG] pgmap v4451: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:54.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:16:54 gibba015 bash[29377]: cephadm 2021-03-10T16:16:52.649896+0000 mgr.gibba045.orlgmj (mgr.34412) 7817 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:16:54.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:16:54 gibba015 bash[29377]: audit 2021-03-10T16:16:53.493616+0000 mon.c (mon.1) 2161 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:16:54.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:16:54 gibba015 bash[29377]: audit 2021-03-10T16:16:53.494227+0000 mon.c (mon.1) 2162 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:16:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:16:54 gibba015 bash[29377]: audit 2021-03-10T16:16:53.494763+0000 mon.a (mon.0) 1804 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:16:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:16:54 gibba015 bash[29377]: audit 2021-03-10T16:16:53.494805+0000 mon.c (mon.1) 2163 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T16:16:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:16:54 gibba015 bash[29377]: audit 2021-03-10T16:16:53.495495+0000 mon.c (mon.1) 2164 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:16:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:16:54 gibba015 bash[29377]: audit 2021-03-10T16:16:53.496144+0000 mon.a (mon.0) 1805 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:16:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:16:54 gibba015 bash[29377]: audit 2021-03-10T16:16:53.496305+0000 mon.c (mon.1) 2165 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:16:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:16:54 gibba015 bash[29377]: audit 2021-03-10T16:16:53.497184+0000 mon.c (mon.1) 2166 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:16:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:16:54 gibba015 bash[29377]: audit 2021-03-10T16:16:53.497193+0000 mon.a (mon.0) 1806 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T16:16:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:16:54 gibba015 bash[29377]: audit 2021-03-10T16:16:53.498307+0000 mon.a (mon.0) 1807 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:16:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:16:54 gibba015 bash[29377]: audit 2021-03-10T16:16:53.499092+0000 mon.a (mon.0) 1808 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:16:54.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:16:54 gibba015 bash[29377]: audit 2021-03-10T16:16:53.499649+0000 mon.a (mon.0) 1809 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:16:54.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:16:54 gibba015 bash[30343]: cephadm 2021-03-10T16:16:52.649896+0000 mgr.gibba045.orlgmj (mgr.34412) 7817 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:16:54.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:16:54 gibba015 bash[30343]: audit 2021-03-10T16:16:53.493616+0000 mon.c (mon.1) 2161 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:16:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:16:54 gibba015 bash[30343]: audit 2021-03-10T16:16:53.494227+0000 mon.c (mon.1) 2162 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:16:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:16:54 gibba015 bash[30343]: audit 2021-03-10T16:16:53.494763+0000 mon.a (mon.0) 1804 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:16:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:16:54 gibba015 bash[30343]: audit 2021-03-10T16:16:53.494805+0000 mon.c (mon.1) 2163 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T16:16:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:16:54 gibba015 bash[30343]: audit 2021-03-10T16:16:53.495495+0000 mon.c (mon.1) 2164 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:16:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:16:54 gibba015 bash[30343]: audit 2021-03-10T16:16:53.496144+0000 mon.a (mon.0) 1805 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:16:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:16:54 gibba015 bash[30343]: audit 2021-03-10T16:16:53.496305+0000 mon.c (mon.1) 2165 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:16:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:16:54 gibba015 bash[30343]: audit 2021-03-10T16:16:53.497184+0000 mon.c (mon.1) 2166 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:16:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:16:54 gibba015 bash[30343]: audit 2021-03-10T16:16:53.497193+0000 mon.a (mon.0) 1806 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T16:16:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:16:54 gibba015 bash[30343]: audit 2021-03-10T16:16:53.498307+0000 mon.a (mon.0) 1807 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:16:54.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:16:54 gibba015 bash[30343]: audit 2021-03-10T16:16:53.499092+0000 mon.a (mon.0) 1808 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:16:54.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:16:54 gibba015 bash[30343]: audit 2021-03-10T16:16:53.499649+0000 mon.a (mon.0) 1809 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:16:54.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:16:54 gibba045 bash[25517]: cephadm 2021-03-10T16:16:52.649896+0000 mgr.gibba045.orlgmj (mgr.34412) 7817 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:16:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:16:54 gibba045 bash[25517]: audit 2021-03-10T16:16:53.493616+0000 mon.c (mon.1) 2161 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:16:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:16:54 gibba045 bash[25517]: audit 2021-03-10T16:16:53.494227+0000 mon.c (mon.1) 2162 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:16:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:16:54 gibba045 bash[25517]: audit 2021-03-10T16:16:53.494763+0000 mon.a (mon.0) 1804 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:16:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:16:54 gibba045 bash[25517]: audit 2021-03-10T16:16:53.494805+0000 mon.c (mon.1) 2163 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T16:16:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:16:54 gibba045 bash[25517]: audit 2021-03-10T16:16:53.495495+0000 mon.c (mon.1) 2164 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:16:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:16:54 gibba045 bash[25517]: audit 2021-03-10T16:16:53.496144+0000 mon.a (mon.0) 1805 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:16:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:16:54 gibba045 bash[25517]: audit 2021-03-10T16:16:53.496305+0000 mon.c (mon.1) 2165 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:16:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:16:54 gibba045 bash[25517]: audit 2021-03-10T16:16:53.497184+0000 mon.c (mon.1) 2166 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:16:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:16:54 gibba045 bash[25517]: audit 2021-03-10T16:16:53.497193+0000 mon.a (mon.0) 1806 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T16:16:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:16:54 gibba045 bash[25517]: audit 2021-03-10T16:16:53.498307+0000 mon.a (mon.0) 1807 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:16:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:16:54 gibba045 bash[25517]: audit 2021-03-10T16:16:53.499092+0000 mon.a (mon.0) 1808 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:16:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:16:54 gibba045 bash[25517]: audit 2021-03-10T16:16:53.499649+0000 mon.a (mon.0) 1809 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:16:55.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:16:55 gibba015 bash[29377]: cluster 2021-03-10T16:16:53.420257+0000 mgr.gibba045.orlgmj (mgr.34412) 7818 : cluster [DBG] pgmap v4452: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:55.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:16:55 gibba015 bash[30343]: cluster 2021-03-10T16:16:53.420257+0000 mgr.gibba045.orlgmj (mgr.34412) 7818 : cluster [DBG] pgmap v4452: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:55.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:16:55 gibba045 bash[25517]: cluster 2021-03-10T16:16:53.420257+0000 mgr.gibba045.orlgmj (mgr.34412) 7818 : cluster [DBG] pgmap v4452: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:57.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:16:57 gibba015 bash[29377]: cluster 2021-03-10T16:16:55.421887+0000 mgr.gibba045.orlgmj (mgr.34412) 7819 : cluster [DBG] pgmap v4453: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:57.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:16:57 gibba015 bash[30343]: cluster 2021-03-10T16:16:55.421887+0000 mgr.gibba045.orlgmj (mgr.34412) 7819 : cluster [DBG] pgmap v4453: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:57.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:16:57 gibba045 bash[25517]: cluster 2021-03-10T16:16:55.421887+0000 mgr.gibba045.orlgmj (mgr.34412) 7819 : cluster [DBG] pgmap v4453: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:58.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:16:58 gibba015 bash[29377]: cluster 2021-03-10T16:16:57.423597+0000 mgr.gibba045.orlgmj (mgr.34412) 7820 : cluster [DBG] pgmap v4454: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:58.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:16:58 gibba015 bash[30343]: cluster 2021-03-10T16:16:57.423597+0000 mgr.gibba045.orlgmj (mgr.34412) 7820 : cluster [DBG] pgmap v4454: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:58.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:16:58 gibba045 bash[25517]: cluster 2021-03-10T16:16:57.423597+0000 mgr.gibba045.orlgmj (mgr.34412) 7820 : cluster [DBG] pgmap v4454: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:00.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:00 gibba045 bash[25517]: cluster 2021-03-10T16:16:59.425173+0000 mgr.gibba045.orlgmj (mgr.34412) 7821 : cluster [DBG] pgmap v4455: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:00.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:00 gibba015 bash[29377]: cluster 2021-03-10T16:16:59.425173+0000 mgr.gibba045.orlgmj (mgr.34412) 7821 : cluster [DBG] pgmap v4455: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:00.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:00 gibba015 bash[30343]: cluster 2021-03-10T16:16:59.425173+0000 mgr.gibba045.orlgmj (mgr.34412) 7821 : cluster [DBG] pgmap v4455: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:03.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:02 gibba045 bash[25517]: cluster 2021-03-10T16:17:01.426786+0000 mgr.gibba045.orlgmj (mgr.34412) 7822 : cluster [DBG] pgmap v4456: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:03.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:02 gibba015 bash[29377]: cluster 2021-03-10T16:17:01.426786+0000 mgr.gibba045.orlgmj (mgr.34412) 7822 : cluster [DBG] pgmap v4456: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:03.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:02 gibba015 bash[30343]: cluster 2021-03-10T16:17:01.426786+0000 mgr.gibba045.orlgmj (mgr.34412) 7822 : cluster [DBG] pgmap v4456: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:05.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:04 gibba045 bash[25517]: cluster 2021-03-10T16:17:03.428339+0000 mgr.gibba045.orlgmj (mgr.34412) 7823 : cluster [DBG] pgmap v4457: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:05.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:04 gibba015 bash[29377]: cluster 2021-03-10T16:17:03.428339+0000 mgr.gibba045.orlgmj (mgr.34412) 7823 : cluster [DBG] pgmap v4457: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:05.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:04 gibba015 bash[30343]: cluster 2021-03-10T16:17:03.428339+0000 mgr.gibba045.orlgmj (mgr.34412) 7823 : cluster [DBG] pgmap v4457: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:07.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:06 gibba045 bash[25517]: cluster 2021-03-10T16:17:05.430076+0000 mgr.gibba045.orlgmj (mgr.34412) 7824 : cluster [DBG] pgmap v4458: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:07.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:06 gibba015 bash[29377]: cluster 2021-03-10T16:17:05.430076+0000 mgr.gibba045.orlgmj (mgr.34412) 7824 : cluster [DBG] pgmap v4458: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:07.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:06 gibba015 bash[30343]: cluster 2021-03-10T16:17:05.430076+0000 mgr.gibba045.orlgmj (mgr.34412) 7824 : cluster [DBG] pgmap v4458: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:08.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:07 gibba045 bash[25517]: audit 2021-03-10T16:17:07.651961+0000 mon.c (mon.1) 2167 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:17:08.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:07 gibba045 bash[25517]: audit 2021-03-10T16:17:07.659517+0000 mon.c (mon.1) 2168 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:17:08.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:07 gibba015 bash[29377]: audit 2021-03-10T16:17:07.651961+0000 mon.c (mon.1) 2167 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:17:08.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:07 gibba015 bash[29377]: audit 2021-03-10T16:17:07.659517+0000 mon.c (mon.1) 2168 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:17:08.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:07 gibba015 bash[30343]: audit 2021-03-10T16:17:07.651961+0000 mon.c (mon.1) 2167 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:17:08.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:07 gibba015 bash[30343]: audit 2021-03-10T16:17:07.659517+0000 mon.c (mon.1) 2168 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:17:08.376 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:17:08.608 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:17:08.609 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 61s ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:17:08.609 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 10m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:17:08.609 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:17:08.609 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:17:08.610 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 61s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:17:08.610 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 61s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:17:08.610 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:17:08.611 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 61s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:17:08.611 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 61s ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:17:08.611 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 10m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:17:08.611 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 61s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:17:08.611 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 61s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:17:08.612 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 61s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:17:08.612 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 61s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:17:08.612 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:17:08.612 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:17:08.613 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:17:08.613 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:17:08.613 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 10m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:17:08.613 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 10m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:17:08.860 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:17:08.860 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:17:08.860 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:17:08.861 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:17:08.861 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:17:08.861 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:17:08.861 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:17:08.862 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:17:08.862 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:17:08.862 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:17:08.862 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:17:08.863 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:17:08.863 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:17:08.863 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:17:08.863 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:17:09.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:08 gibba045 bash[25517]: cluster 2021-03-10T16:17:07.431774+0000 mgr.gibba045.orlgmj (mgr.34412) 7825 : cluster [DBG] pgmap v4459: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:09.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:08 gibba045 bash[25517]: cephadm 2021-03-10T16:17:07.660104+0000 mgr.gibba045.orlgmj (mgr.34412) 7826 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:17:09.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:08 gibba015 bash[29377]: cluster 2021-03-10T16:17:07.431774+0000 mgr.gibba045.orlgmj (mgr.34412) 7825 : cluster [DBG] pgmap v4459: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:09.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:08 gibba015 bash[29377]: cephadm 2021-03-10T16:17:07.660104+0000 mgr.gibba045.orlgmj (mgr.34412) 7826 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:17:09.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:08 gibba015 bash[30343]: cluster 2021-03-10T16:17:07.431774+0000 mgr.gibba045.orlgmj (mgr.34412) 7825 : cluster [DBG] pgmap v4459: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:09.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:08 gibba015 bash[30343]: cephadm 2021-03-10T16:17:07.660104+0000 mgr.gibba045.orlgmj (mgr.34412) 7826 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:17:10.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:09 gibba045 bash[25517]: audit 2021-03-10T16:17:08.369213+0000 mgr.gibba045.orlgmj (mgr.34412) 7827 : audit [DBG] from='client.49308 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:17:10.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:09 gibba045 bash[25517]: audit 2021-03-10T16:17:08.598587+0000 mgr.gibba045.orlgmj (mgr.34412) 7828 : audit [DBG] from='client.59302 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:17:10.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:09 gibba045 bash[25517]: audit 2021-03-10T16:17:08.860080+0000 mon.c (mon.1) 2169 : audit [DBG] from='client.? 172.21.2.115:0/1596152808' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:17:10.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:09 gibba015 bash[29377]: audit 2021-03-10T16:17:08.369213+0000 mgr.gibba045.orlgmj (mgr.34412) 7827 : audit [DBG] from='client.49308 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:17:10.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:09 gibba015 bash[29377]: audit 2021-03-10T16:17:08.598587+0000 mgr.gibba045.orlgmj (mgr.34412) 7828 : audit [DBG] from='client.59302 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:17:10.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:09 gibba015 bash[29377]: audit 2021-03-10T16:17:08.860080+0000 mon.c (mon.1) 2169 : audit [DBG] from='client.? 172.21.2.115:0/1596152808' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:17:10.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:09 gibba015 bash[30343]: audit 2021-03-10T16:17:08.369213+0000 mgr.gibba045.orlgmj (mgr.34412) 7827 : audit [DBG] from='client.49308 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:17:10.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:09 gibba015 bash[30343]: audit 2021-03-10T16:17:08.598587+0000 mgr.gibba045.orlgmj (mgr.34412) 7828 : audit [DBG] from='client.59302 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:17:10.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:09 gibba015 bash[30343]: audit 2021-03-10T16:17:08.860080+0000 mon.c (mon.1) 2169 : audit [DBG] from='client.? 172.21.2.115:0/1596152808' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:17:11.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:10 gibba045 bash[25517]: cluster 2021-03-10T16:17:09.433250+0000 mgr.gibba045.orlgmj (mgr.34412) 7829 : cluster [DBG] pgmap v4460: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:11.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:10 gibba015 bash[29377]: cluster 2021-03-10T16:17:09.433250+0000 mgr.gibba045.orlgmj (mgr.34412) 7829 : cluster [DBG] pgmap v4460: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:11.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:10 gibba015 bash[30343]: cluster 2021-03-10T16:17:09.433250+0000 mgr.gibba045.orlgmj (mgr.34412) 7829 : cluster [DBG] pgmap v4460: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:12.665 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:12 gibba045 bash[25517]: audit 2021-03-10T16:17:11.397552+0000 mon.a (mon.0) 1810 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:17:12.665 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:12 gibba045 bash[25517]: audit 2021-03-10T16:17:11.401522+0000 mon.c (mon.1) 2170 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T16:17:12.665 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:12 gibba045 bash[25517]: cluster 2021-03-10T16:17:11.433901+0000 mgr.gibba045.orlgmj (mgr.34412) 7830 : cluster [DBG] pgmap v4461: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:12.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:12 gibba015 bash[29377]: audit 2021-03-10T16:17:11.397552+0000 mon.a (mon.0) 1810 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:17:12.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:12 gibba015 bash[29377]: audit 2021-03-10T16:17:11.401522+0000 mon.c (mon.1) 2170 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T16:17:12.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:12 gibba015 bash[29377]: cluster 2021-03-10T16:17:11.433901+0000 mgr.gibba045.orlgmj (mgr.34412) 7830 : cluster [DBG] pgmap v4461: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:12.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:12 gibba015 bash[30343]: audit 2021-03-10T16:17:11.397552+0000 mon.a (mon.0) 1810 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:17:12.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:12 gibba015 bash[30343]: audit 2021-03-10T16:17:11.401522+0000 mon.c (mon.1) 2170 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T16:17:12.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:12 gibba015 bash[30343]: cluster 2021-03-10T16:17:11.433901+0000 mgr.gibba045.orlgmj (mgr.34412) 7830 : cluster [DBG] pgmap v4461: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:14.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:14 gibba045 bash[25517]: cluster 2021-03-10T16:17:13.434400+0000 mgr.gibba045.orlgmj (mgr.34412) 7831 : cluster [DBG] pgmap v4462: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:14.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:14 gibba015 bash[29377]: cluster 2021-03-10T16:17:13.434400+0000 mgr.gibba045.orlgmj (mgr.34412) 7831 : cluster [DBG] pgmap v4462: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:14.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:14 gibba015 bash[30343]: cluster 2021-03-10T16:17:13.434400+0000 mgr.gibba045.orlgmj (mgr.34412) 7831 : cluster [DBG] pgmap v4462: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:17.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:16 gibba045 bash[25517]: cluster 2021-03-10T16:17:15.434974+0000 mgr.gibba045.orlgmj (mgr.34412) 7832 : cluster [DBG] pgmap v4463: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:17.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:16 gibba045 bash[25517]: audit 2021-03-10T16:17:16.079985+0000 mon.c (mon.1) 2171 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:17:17.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:16 gibba045 bash[25517]: audit 2021-03-10T16:17:16.251070+0000 mon.a (mon.0) 1811 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:17:17.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:16 gibba045 bash[25517]: audit 2021-03-10T16:17:16.444127+0000 mon.a (mon.0) 1812 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:17:17.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:16 gibba045 bash[25517]: audit 2021-03-10T16:17:16.447783+0000 mon.c (mon.1) 2172 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:17:17.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:16 gibba045 bash[25517]: audit 2021-03-10T16:17:16.449369+0000 mon.c (mon.1) 2173 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:17:17.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:16 gibba045 bash[25517]: audit 2021-03-10T16:17:16.450516+0000 mon.c (mon.1) 2174 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:17:17.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:16 gibba045 bash[25517]: audit 2021-03-10T16:17:16.451618+0000 mon.c (mon.1) 2175 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:17:17.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:16 gibba045 bash[25517]: audit 2021-03-10T16:17:16.454092+0000 mon.c (mon.1) 2176 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:17:17.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:16 gibba045 bash[25517]: audit 2021-03-10T16:17:16.455830+0000 mon.c (mon.1) 2177 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:17:17.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:16 gibba015 bash[29377]: cluster 2021-03-10T16:17:15.434974+0000 mgr.gibba045.orlgmj (mgr.34412) 7832 : cluster [DBG] pgmap v4463: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:17.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:16 gibba015 bash[29377]: audit 2021-03-10T16:17:16.079985+0000 mon.c (mon.1) 2171 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:17:17.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:16 gibba015 bash[29377]: audit 2021-03-10T16:17:16.251070+0000 mon.a (mon.0) 1811 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:17:17.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:16 gibba015 bash[29377]: audit 2021-03-10T16:17:16.444127+0000 mon.a (mon.0) 1812 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:17:17.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:16 gibba015 bash[29377]: audit 2021-03-10T16:17:16.447783+0000 mon.c (mon.1) 2172 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:17:17.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:16 gibba015 bash[29377]: audit 2021-03-10T16:17:16.449369+0000 mon.c (mon.1) 2173 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:17:17.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:16 gibba015 bash[29377]: audit 2021-03-10T16:17:16.450516+0000 mon.c (mon.1) 2174 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:17:17.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:16 gibba015 bash[29377]: audit 2021-03-10T16:17:16.451618+0000 mon.c (mon.1) 2175 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:17:17.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:16 gibba015 bash[29377]: audit 2021-03-10T16:17:16.454092+0000 mon.c (mon.1) 2176 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:17:17.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:16 gibba015 bash[29377]: audit 2021-03-10T16:17:16.455830+0000 mon.c (mon.1) 2177 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:17:17.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:16 gibba015 bash[30343]: cluster 2021-03-10T16:17:15.434974+0000 mgr.gibba045.orlgmj (mgr.34412) 7832 : cluster [DBG] pgmap v4463: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:17.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:16 gibba015 bash[30343]: audit 2021-03-10T16:17:16.079985+0000 mon.c (mon.1) 2171 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:17:17.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:16 gibba015 bash[30343]: audit 2021-03-10T16:17:16.251070+0000 mon.a (mon.0) 1811 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:17:17.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:16 gibba015 bash[30343]: audit 2021-03-10T16:17:16.444127+0000 mon.a (mon.0) 1812 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:17:17.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:16 gibba015 bash[30343]: audit 2021-03-10T16:17:16.447783+0000 mon.c (mon.1) 2172 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:17:17.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:16 gibba015 bash[30343]: audit 2021-03-10T16:17:16.449369+0000 mon.c (mon.1) 2173 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:17:17.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:16 gibba015 bash[30343]: audit 2021-03-10T16:17:16.450516+0000 mon.c (mon.1) 2174 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:17:17.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:16 gibba015 bash[30343]: audit 2021-03-10T16:17:16.451618+0000 mon.c (mon.1) 2175 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:17:17.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:16 gibba015 bash[30343]: audit 2021-03-10T16:17:16.454092+0000 mon.c (mon.1) 2176 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:17:17.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:16 gibba015 bash[30343]: audit 2021-03-10T16:17:16.455830+0000 mon.c (mon.1) 2177 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:17:18.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:17 gibba045 bash[25517]: cephadm 2021-03-10T16:17:16.254768+0000 mgr.gibba045.orlgmj (mgr.34412) 7833 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:17:18.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:17 gibba045 bash[25517]: cephadm 2021-03-10T16:17:16.449534+0000 mgr.gibba045.orlgmj (mgr.34412) 7834 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:17:18.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:17 gibba045 bash[25517]: cephadm 2021-03-10T16:17:16.451251+0000 mgr.gibba045.orlgmj (mgr.34412) 7835 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:17:18.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:17 gibba045 bash[25517]: cephadm 2021-03-10T16:17:16.452620+0000 mgr.gibba045.orlgmj (mgr.34412) 7836 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:17:18.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:17 gibba045 bash[25517]: cephadm 2021-03-10T16:17:16.452656+0000 mgr.gibba045.orlgmj (mgr.34412) 7837 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:17:18.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:17 gibba045 bash[25517]: cephadm 2021-03-10T16:17:16.453769+0000 mgr.gibba045.orlgmj (mgr.34412) 7838 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:17:18.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:17 gibba045 bash[25517]: cephadm 2021-03-10T16:17:16.453835+0000 mgr.gibba045.orlgmj (mgr.34412) 7839 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:17:18.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:17 gibba045 bash[25517]: cephadm 2021-03-10T16:17:16.454885+0000 mgr.gibba045.orlgmj (mgr.34412) 7840 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:17:18.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:17 gibba045 bash[25517]: cephadm 2021-03-10T16:17:16.456099+0000 mgr.gibba045.orlgmj (mgr.34412) 7841 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:17:18.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:17 gibba045 bash[25517]: cephadm 2021-03-10T16:17:16.456137+0000 mgr.gibba045.orlgmj (mgr.34412) 7842 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:17:18.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:17 gibba045 bash[25517]: cephadm 2021-03-10T16:17:16.457516+0000 mgr.gibba045.orlgmj (mgr.34412) 7843 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:17:18.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:17 gibba045 bash[25517]: cephadm 2021-03-10T16:17:16.457841+0000 mgr.gibba045.orlgmj (mgr.34412) 7844 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:17:18.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:17 gibba045 bash[25517]: cephadm 2021-03-10T16:17:16.459225+0000 mgr.gibba045.orlgmj (mgr.34412) 7845 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:17:18.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:17 gibba045 bash[25517]: cephadm 2021-03-10T16:17:16.459265+0000 mgr.gibba045.orlgmj (mgr.34412) 7846 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:17:18.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:17 gibba045 bash[25517]: cephadm 2021-03-10T16:17:16.459376+0000 mgr.gibba045.orlgmj (mgr.34412) 7847 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:17:18.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:17 gibba015 bash[29377]: cephadm 2021-03-10T16:17:16.254768+0000 mgr.gibba045.orlgmj (mgr.34412) 7833 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:17:18.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:17 gibba015 bash[29377]: cephadm 2021-03-10T16:17:16.449534+0000 mgr.gibba045.orlgmj (mgr.34412) 7834 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:17:18.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:17 gibba015 bash[29377]: cephadm 2021-03-10T16:17:16.451251+0000 mgr.gibba045.orlgmj (mgr.34412) 7835 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:17:18.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:17 gibba015 bash[29377]: cephadm 2021-03-10T16:17:16.452620+0000 mgr.gibba045.orlgmj (mgr.34412) 7836 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:17:18.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:17 gibba015 bash[29377]: cephadm 2021-03-10T16:17:16.452656+0000 mgr.gibba045.orlgmj (mgr.34412) 7837 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:17:18.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:17 gibba015 bash[29377]: cephadm 2021-03-10T16:17:16.453769+0000 mgr.gibba045.orlgmj (mgr.34412) 7838 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:17:18.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:17 gibba015 bash[29377]: cephadm 2021-03-10T16:17:16.453835+0000 mgr.gibba045.orlgmj (mgr.34412) 7839 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:17:18.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:17 gibba015 bash[29377]: cephadm 2021-03-10T16:17:16.454885+0000 mgr.gibba045.orlgmj (mgr.34412) 7840 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:17:18.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:17 gibba015 bash[29377]: cephadm 2021-03-10T16:17:16.456099+0000 mgr.gibba045.orlgmj (mgr.34412) 7841 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:17:18.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:17 gibba015 bash[29377]: cephadm 2021-03-10T16:17:16.456137+0000 mgr.gibba045.orlgmj (mgr.34412) 7842 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:17:18.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:17 gibba015 bash[29377]: cephadm 2021-03-10T16:17:16.457516+0000 mgr.gibba045.orlgmj (mgr.34412) 7843 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:17:18.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:17 gibba015 bash[29377]: cephadm 2021-03-10T16:17:16.457841+0000 mgr.gibba045.orlgmj (mgr.34412) 7844 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:17:18.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:17 gibba015 bash[29377]: cephadm 2021-03-10T16:17:16.459225+0000 mgr.gibba045.orlgmj (mgr.34412) 7845 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:17:18.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:17 gibba015 bash[29377]: cephadm 2021-03-10T16:17:16.459265+0000 mgr.gibba045.orlgmj (mgr.34412) 7846 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:17:18.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:17 gibba015 bash[29377]: cephadm 2021-03-10T16:17:16.459376+0000 mgr.gibba045.orlgmj (mgr.34412) 7847 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:17:18.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:17 gibba015 bash[30343]: cephadm 2021-03-10T16:17:16.254768+0000 mgr.gibba045.orlgmj (mgr.34412) 7833 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:17:18.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:17 gibba015 bash[30343]: cephadm 2021-03-10T16:17:16.449534+0000 mgr.gibba045.orlgmj (mgr.34412) 7834 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:17:18.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:17 gibba015 bash[30343]: cephadm 2021-03-10T16:17:16.451251+0000 mgr.gibba045.orlgmj (mgr.34412) 7835 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:17:18.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:17 gibba015 bash[30343]: cephadm 2021-03-10T16:17:16.452620+0000 mgr.gibba045.orlgmj (mgr.34412) 7836 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:17:18.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:17 gibba015 bash[30343]: cephadm 2021-03-10T16:17:16.452656+0000 mgr.gibba045.orlgmj (mgr.34412) 7837 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:17:18.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:17 gibba015 bash[30343]: cephadm 2021-03-10T16:17:16.453769+0000 mgr.gibba045.orlgmj (mgr.34412) 7838 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:17:18.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:17 gibba015 bash[30343]: cephadm 2021-03-10T16:17:16.453835+0000 mgr.gibba045.orlgmj (mgr.34412) 7839 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:17:18.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:17 gibba015 bash[30343]: cephadm 2021-03-10T16:17:16.454885+0000 mgr.gibba045.orlgmj (mgr.34412) 7840 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:17:18.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:17 gibba015 bash[30343]: cephadm 2021-03-10T16:17:16.456099+0000 mgr.gibba045.orlgmj (mgr.34412) 7841 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:17:18.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:17 gibba015 bash[30343]: cephadm 2021-03-10T16:17:16.456137+0000 mgr.gibba045.orlgmj (mgr.34412) 7842 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:17:18.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:17 gibba015 bash[30343]: cephadm 2021-03-10T16:17:16.457516+0000 mgr.gibba045.orlgmj (mgr.34412) 7843 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:17:18.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:17 gibba015 bash[30343]: cephadm 2021-03-10T16:17:16.457841+0000 mgr.gibba045.orlgmj (mgr.34412) 7844 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:17:18.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:17 gibba015 bash[30343]: cephadm 2021-03-10T16:17:16.459225+0000 mgr.gibba045.orlgmj (mgr.34412) 7845 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:17:18.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:17 gibba015 bash[30343]: cephadm 2021-03-10T16:17:16.459265+0000 mgr.gibba045.orlgmj (mgr.34412) 7846 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:17:18.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:17 gibba015 bash[30343]: cephadm 2021-03-10T16:17:16.459376+0000 mgr.gibba045.orlgmj (mgr.34412) 7847 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:17:19.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:18 gibba045 bash[25517]: cluster 2021-03-10T16:17:17.436701+0000 mgr.gibba045.orlgmj (mgr.34412) 7848 : cluster [DBG] pgmap v4464: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:19.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:18 gibba015 bash[29377]: cluster 2021-03-10T16:17:17.436701+0000 mgr.gibba045.orlgmj (mgr.34412) 7848 : cluster [DBG] pgmap v4464: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:19.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:18 gibba015 bash[30343]: cluster 2021-03-10T16:17:17.436701+0000 mgr.gibba045.orlgmj (mgr.34412) 7848 : cluster [DBG] pgmap v4464: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:21.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:20 gibba045 bash[25517]: cluster 2021-03-10T16:17:19.438187+0000 mgr.gibba045.orlgmj (mgr.34412) 7849 : cluster [DBG] pgmap v4465: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:21.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:20 gibba015 bash[29377]: cluster 2021-03-10T16:17:19.438187+0000 mgr.gibba045.orlgmj (mgr.34412) 7849 : cluster [DBG] pgmap v4465: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:21.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:20 gibba015 bash[30343]: cluster 2021-03-10T16:17:19.438187+0000 mgr.gibba045.orlgmj (mgr.34412) 7849 : cluster [DBG] pgmap v4465: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:23.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:22 gibba045 bash[25517]: cluster 2021-03-10T16:17:21.439908+0000 mgr.gibba045.orlgmj (mgr.34412) 7850 : cluster [DBG] pgmap v4466: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:23.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:22 gibba015 bash[29377]: cluster 2021-03-10T16:17:21.439908+0000 mgr.gibba045.orlgmj (mgr.34412) 7850 : cluster [DBG] pgmap v4466: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:23.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:22 gibba015 bash[30343]: cluster 2021-03-10T16:17:21.439908+0000 mgr.gibba045.orlgmj (mgr.34412) 7850 : cluster [DBG] pgmap v4466: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:25.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:24 gibba045 bash[25517]: cluster 2021-03-10T16:17:23.441435+0000 mgr.gibba045.orlgmj (mgr.34412) 7851 : cluster [DBG] pgmap v4467: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:25.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:24 gibba015 bash[29377]: cluster 2021-03-10T16:17:23.441435+0000 mgr.gibba045.orlgmj (mgr.34412) 7851 : cluster [DBG] pgmap v4467: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:25.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:24 gibba015 bash[30343]: cluster 2021-03-10T16:17:23.441435+0000 mgr.gibba045.orlgmj (mgr.34412) 7851 : cluster [DBG] pgmap v4467: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:27.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:26 gibba045 bash[25517]: cluster 2021-03-10T16:17:25.443044+0000 mgr.gibba045.orlgmj (mgr.34412) 7852 : cluster [DBG] pgmap v4468: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:27.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:26 gibba015 bash[29377]: cluster 2021-03-10T16:17:25.443044+0000 mgr.gibba045.orlgmj (mgr.34412) 7852 : cluster [DBG] pgmap v4468: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:27.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:26 gibba015 bash[30343]: cluster 2021-03-10T16:17:25.443044+0000 mgr.gibba045.orlgmj (mgr.34412) 7852 : cluster [DBG] pgmap v4468: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:29.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:28 gibba045 bash[25517]: cluster 2021-03-10T16:17:27.444553+0000 mgr.gibba045.orlgmj (mgr.34412) 7853 : cluster [DBG] pgmap v4469: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:29.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:28 gibba015 bash[29377]: cluster 2021-03-10T16:17:27.444553+0000 mgr.gibba045.orlgmj (mgr.34412) 7853 : cluster [DBG] pgmap v4469: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:29.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:28 gibba015 bash[30343]: cluster 2021-03-10T16:17:27.444553+0000 mgr.gibba045.orlgmj (mgr.34412) 7853 : cluster [DBG] pgmap v4469: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:31.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:30 gibba015 bash[29377]: cluster 2021-03-10T16:17:29.445748+0000 mgr.gibba045.orlgmj (mgr.34412) 7854 : cluster [DBG] pgmap v4470: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:31.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:30 gibba015 bash[30343]: cluster 2021-03-10T16:17:29.445748+0000 mgr.gibba045.orlgmj (mgr.34412) 7854 : cluster [DBG] pgmap v4470: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:31.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:30 gibba045 bash[25517]: cluster 2021-03-10T16:17:29.445748+0000 mgr.gibba045.orlgmj (mgr.34412) 7854 : cluster [DBG] pgmap v4470: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:33.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:32 gibba015 bash[29377]: cluster 2021-03-10T16:17:31.447323+0000 mgr.gibba045.orlgmj (mgr.34412) 7855 : cluster [DBG] pgmap v4471: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:33.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:32 gibba015 bash[29377]: cephadm 2021-03-10T16:17:31.469281+0000 mgr.gibba045.orlgmj (mgr.34412) 7856 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:17:33.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:32 gibba015 bash[30343]: cluster 2021-03-10T16:17:31.447323+0000 mgr.gibba045.orlgmj (mgr.34412) 7855 : cluster [DBG] pgmap v4471: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:33.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:32 gibba015 bash[30343]: cephadm 2021-03-10T16:17:31.469281+0000 mgr.gibba045.orlgmj (mgr.34412) 7856 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:17:33.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:32 gibba045 bash[25517]: cluster 2021-03-10T16:17:31.447323+0000 mgr.gibba045.orlgmj (mgr.34412) 7855 : cluster [DBG] pgmap v4471: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:33.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:32 gibba045 bash[25517]: cephadm 2021-03-10T16:17:31.469281+0000 mgr.gibba045.orlgmj (mgr.34412) 7856 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:17:35.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:34 gibba015 bash[29377]: cluster 2021-03-10T16:17:33.448786+0000 mgr.gibba045.orlgmj (mgr.34412) 7857 : cluster [DBG] pgmap v4472: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:35.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:34 gibba015 bash[30343]: cluster 2021-03-10T16:17:33.448786+0000 mgr.gibba045.orlgmj (mgr.34412) 7857 : cluster [DBG] pgmap v4472: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:35.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:34 gibba045 bash[25517]: cluster 2021-03-10T16:17:33.448786+0000 mgr.gibba045.orlgmj (mgr.34412) 7857 : cluster [DBG] pgmap v4472: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:37.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:36 gibba015 bash[29377]: cluster 2021-03-10T16:17:35.450215+0000 mgr.gibba045.orlgmj (mgr.34412) 7858 : cluster [DBG] pgmap v4473: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:37.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:36 gibba015 bash[30343]: cluster 2021-03-10T16:17:35.450215+0000 mgr.gibba045.orlgmj (mgr.34412) 7858 : cluster [DBG] pgmap v4473: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:37.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:36 gibba045 bash[25517]: cluster 2021-03-10T16:17:35.450215+0000 mgr.gibba045.orlgmj (mgr.34412) 7858 : cluster [DBG] pgmap v4473: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:39.097 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:17:39.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:38 gibba015 bash[29377]: cluster 2021-03-10T16:17:37.451926+0000 mgr.gibba045.orlgmj (mgr.34412) 7859 : cluster [DBG] pgmap v4474: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:39.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:38 gibba015 bash[30343]: cluster 2021-03-10T16:17:37.451926+0000 mgr.gibba045.orlgmj (mgr.34412) 7859 : cluster [DBG] pgmap v4474: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:39.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:38 gibba045 bash[25517]: cluster 2021-03-10T16:17:37.451926+0000 mgr.gibba045.orlgmj (mgr.34412) 7859 : cluster [DBG] pgmap v4474: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:39.327 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:17:39.328 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 91s ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:17:39.328 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 27s ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:17:39.328 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 27s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:17:39.328 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 27s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:17:39.329 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 91s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:17:39.329 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 91s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:17:39.329 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 27s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:17:39.329 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 91s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:17:39.329 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 91s ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:17:39.330 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 27s ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:17:39.330 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 91s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:17:39.330 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 91s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:17:39.330 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 91s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:17:39.331 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 91s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:17:39.331 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 27s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:17:39.331 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 27s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:17:39.331 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 27s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:17:39.331 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 27s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:17:39.332 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 27s ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:17:39.332 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 27s ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:17:39.576 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:17:39.576 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:17:39.576 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:17:39.577 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:17:39.577 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:17:39.577 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:17:39.577 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:17:39.578 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:17:39.578 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:17:39.578 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:17:39.578 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:17:39.579 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:17:39.579 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:17:39.579 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:17:39.579 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:17:40.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:39 gibba015 bash[29377]: audit 2021-03-10T16:17:39.090735+0000 mgr.gibba045.orlgmj (mgr.34412) 7860 : audit [DBG] from='client.59314 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:17:40.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:39 gibba015 bash[29377]: audit 2021-03-10T16:17:39.576211+0000 mon.c (mon.1) 2178 : audit [DBG] from='client.? 172.21.2.115:0/3576703525' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:17:40.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:39 gibba015 bash[30343]: audit 2021-03-10T16:17:39.090735+0000 mgr.gibba045.orlgmj (mgr.34412) 7860 : audit [DBG] from='client.59314 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:17:40.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:39 gibba015 bash[30343]: audit 2021-03-10T16:17:39.576211+0000 mon.c (mon.1) 2178 : audit [DBG] from='client.? 172.21.2.115:0/3576703525' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:17:40.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:39 gibba045 bash[25517]: audit 2021-03-10T16:17:39.090735+0000 mgr.gibba045.orlgmj (mgr.34412) 7860 : audit [DBG] from='client.59314 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:17:40.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:39 gibba045 bash[25517]: audit 2021-03-10T16:17:39.576211+0000 mon.c (mon.1) 2178 : audit [DBG] from='client.? 172.21.2.115:0/3576703525' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:17:41.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:40 gibba015 bash[29377]: audit 2021-03-10T16:17:39.317314+0000 mgr.gibba045.orlgmj (mgr.34412) 7861 : audit [DBG] from='client.59320 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:17:41.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:40 gibba015 bash[29377]: cluster 2021-03-10T16:17:39.453335+0000 mgr.gibba045.orlgmj (mgr.34412) 7862 : cluster [DBG] pgmap v4475: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:41.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:40 gibba015 bash[30343]: audit 2021-03-10T16:17:39.317314+0000 mgr.gibba045.orlgmj (mgr.34412) 7861 : audit [DBG] from='client.59320 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:17:41.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:40 gibba015 bash[30343]: cluster 2021-03-10T16:17:39.453335+0000 mgr.gibba045.orlgmj (mgr.34412) 7862 : cluster [DBG] pgmap v4475: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:41.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:40 gibba045 bash[25517]: audit 2021-03-10T16:17:39.317314+0000 mgr.gibba045.orlgmj (mgr.34412) 7861 : audit [DBG] from='client.59320 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:17:41.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:40 gibba045 bash[25517]: cluster 2021-03-10T16:17:39.453335+0000 mgr.gibba045.orlgmj (mgr.34412) 7862 : cluster [DBG] pgmap v4475: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:43.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:42 gibba015 bash[29377]: cluster 2021-03-10T16:17:41.455138+0000 mgr.gibba045.orlgmj (mgr.34412) 7863 : cluster [DBG] pgmap v4476: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:43.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:42 gibba015 bash[30343]: cluster 2021-03-10T16:17:41.455138+0000 mgr.gibba045.orlgmj (mgr.34412) 7863 : cluster [DBG] pgmap v4476: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:43.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:42 gibba045 bash[25517]: cluster 2021-03-10T16:17:41.455138+0000 mgr.gibba045.orlgmj (mgr.34412) 7863 : cluster [DBG] pgmap v4476: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:45.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:44 gibba015 bash[29377]: cluster 2021-03-10T16:17:43.456537+0000 mgr.gibba045.orlgmj (mgr.34412) 7864 : cluster [DBG] pgmap v4477: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:45.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:44 gibba015 bash[30343]: cluster 2021-03-10T16:17:43.456537+0000 mgr.gibba045.orlgmj (mgr.34412) 7864 : cluster [DBG] pgmap v4477: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:45.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:44 gibba045 bash[25517]: cluster 2021-03-10T16:17:43.456537+0000 mgr.gibba045.orlgmj (mgr.34412) 7864 : cluster [DBG] pgmap v4477: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:47.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:46 gibba015 bash[29377]: cluster 2021-03-10T16:17:45.458158+0000 mgr.gibba045.orlgmj (mgr.34412) 7865 : cluster [DBG] pgmap v4478: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:47.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:46 gibba015 bash[30343]: cluster 2021-03-10T16:17:45.458158+0000 mgr.gibba045.orlgmj (mgr.34412) 7865 : cluster [DBG] pgmap v4478: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:47.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:46 gibba045 bash[25517]: cluster 2021-03-10T16:17:45.458158+0000 mgr.gibba045.orlgmj (mgr.34412) 7865 : cluster [DBG] pgmap v4478: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:48.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:47 gibba015 bash[29377]: cephadm 2021-03-10T16:17:46.485361+0000 mgr.gibba045.orlgmj (mgr.34412) 7866 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:17:48.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:47 gibba015 bash[30343]: cephadm 2021-03-10T16:17:46.485361+0000 mgr.gibba045.orlgmj (mgr.34412) 7866 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:17:48.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:47 gibba045 bash[25517]: cephadm 2021-03-10T16:17:46.485361+0000 mgr.gibba045.orlgmj (mgr.34412) 7866 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:17:49.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:48 gibba015 bash[29377]: cluster 2021-03-10T16:17:47.459973+0000 mgr.gibba045.orlgmj (mgr.34412) 7867 : cluster [DBG] pgmap v4479: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:49.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:48 gibba015 bash[30343]: cluster 2021-03-10T16:17:47.459973+0000 mgr.gibba045.orlgmj (mgr.34412) 7867 : cluster [DBG] pgmap v4479: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:49.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:48 gibba045 bash[25517]: cluster 2021-03-10T16:17:47.459973+0000 mgr.gibba045.orlgmj (mgr.34412) 7867 : cluster [DBG] pgmap v4479: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:51.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:50 gibba015 bash[29377]: cluster 2021-03-10T16:17:49.461510+0000 mgr.gibba045.orlgmj (mgr.34412) 7868 : cluster [DBG] pgmap v4480: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:51.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:50 gibba015 bash[30343]: cluster 2021-03-10T16:17:49.461510+0000 mgr.gibba045.orlgmj (mgr.34412) 7868 : cluster [DBG] pgmap v4480: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:51.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:50 gibba045 bash[25517]: cluster 2021-03-10T16:17:49.461510+0000 mgr.gibba045.orlgmj (mgr.34412) 7868 : cluster [DBG] pgmap v4480: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:53.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:52 gibba015 bash[29377]: cluster 2021-03-10T16:17:51.463591+0000 mgr.gibba045.orlgmj (mgr.34412) 7869 : cluster [DBG] pgmap v4481: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:53.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:52 gibba015 bash[30343]: cluster 2021-03-10T16:17:51.463591+0000 mgr.gibba045.orlgmj (mgr.34412) 7869 : cluster [DBG] pgmap v4481: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:53.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:52 gibba045 bash[25517]: cluster 2021-03-10T16:17:51.463591+0000 mgr.gibba045.orlgmj (mgr.34412) 7869 : cluster [DBG] pgmap v4481: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:54.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:53 gibba015 bash[29377]: audit 2021-03-10T16:17:53.501771+0000 mon.c (mon.1) 2179 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:17:54.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:53 gibba015 bash[29377]: audit 2021-03-10T16:17:53.502482+0000 mon.c (mon.1) 2180 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:17:54.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:53 gibba015 bash[29377]: audit 2021-03-10T16:17:53.502914+0000 mon.a (mon.0) 1813 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:17:54.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:53 gibba015 bash[29377]: audit 2021-03-10T16:17:53.503334+0000 mon.c (mon.1) 2181 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T16:17:54.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:53 gibba015 bash[29377]: audit 2021-03-10T16:17:53.504051+0000 mon.a (mon.0) 1814 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:17:54.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:53 gibba015 bash[29377]: audit 2021-03-10T16:17:53.504171+0000 mon.c (mon.1) 2182 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:17:54.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:53 gibba015 bash[29377]: audit 2021-03-10T16:17:53.505009+0000 mon.c (mon.1) 2183 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:17:54.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:53 gibba015 bash[29377]: audit 2021-03-10T16:17:53.505482+0000 mon.a (mon.0) 1815 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T16:17:54.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:53 gibba015 bash[29377]: audit 2021-03-10T16:17:53.505760+0000 mon.c (mon.1) 2184 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T16:17:54.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:53 gibba015 bash[29377]: audit 2021-03-10T16:17:53.506561+0000 mon.a (mon.0) 1816 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:17:54.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:53 gibba015 bash[29377]: audit 2021-03-10T16:17:53.507655+0000 mon.a (mon.0) 1817 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:17:54.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:53 gibba015 bash[29377]: audit 2021-03-10T16:17:53.507961+0000 mon.a (mon.0) 1818 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T16:17:54.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:53 gibba015 bash[30343]: audit 2021-03-10T16:17:53.501771+0000 mon.c (mon.1) 2179 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:17:54.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:53 gibba015 bash[30343]: audit 2021-03-10T16:17:53.502482+0000 mon.c (mon.1) 2180 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:17:54.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:53 gibba015 bash[30343]: audit 2021-03-10T16:17:53.502914+0000 mon.a (mon.0) 1813 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:17:54.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:53 gibba015 bash[30343]: audit 2021-03-10T16:17:53.503334+0000 mon.c (mon.1) 2181 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T16:17:54.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:53 gibba015 bash[30343]: audit 2021-03-10T16:17:53.504051+0000 mon.a (mon.0) 1814 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:17:54.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:53 gibba015 bash[30343]: audit 2021-03-10T16:17:53.504171+0000 mon.c (mon.1) 2182 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:17:54.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:53 gibba015 bash[30343]: audit 2021-03-10T16:17:53.505009+0000 mon.c (mon.1) 2183 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:17:54.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:53 gibba015 bash[30343]: audit 2021-03-10T16:17:53.505482+0000 mon.a (mon.0) 1815 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T16:17:54.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:53 gibba015 bash[30343]: audit 2021-03-10T16:17:53.505760+0000 mon.c (mon.1) 2184 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T16:17:54.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:53 gibba015 bash[30343]: audit 2021-03-10T16:17:53.506561+0000 mon.a (mon.0) 1816 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:17:54.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:53 gibba015 bash[30343]: audit 2021-03-10T16:17:53.507655+0000 mon.a (mon.0) 1817 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:17:54.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:53 gibba015 bash[30343]: audit 2021-03-10T16:17:53.507961+0000 mon.a (mon.0) 1818 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T16:17:54.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:53 gibba045 bash[25517]: audit 2021-03-10T16:17:53.501771+0000 mon.c (mon.1) 2179 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:17:54.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:53 gibba045 bash[25517]: audit 2021-03-10T16:17:53.502482+0000 mon.c (mon.1) 2180 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:17:54.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:53 gibba045 bash[25517]: audit 2021-03-10T16:17:53.502914+0000 mon.a (mon.0) 1813 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:17:54.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:53 gibba045 bash[25517]: audit 2021-03-10T16:17:53.503334+0000 mon.c (mon.1) 2181 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T16:17:54.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:53 gibba045 bash[25517]: audit 2021-03-10T16:17:53.504051+0000 mon.a (mon.0) 1814 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:17:54.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:53 gibba045 bash[25517]: audit 2021-03-10T16:17:53.504171+0000 mon.c (mon.1) 2182 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:17:54.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:53 gibba045 bash[25517]: audit 2021-03-10T16:17:53.505009+0000 mon.c (mon.1) 2183 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:17:54.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:53 gibba045 bash[25517]: audit 2021-03-10T16:17:53.505482+0000 mon.a (mon.0) 1815 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T16:17:54.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:53 gibba045 bash[25517]: audit 2021-03-10T16:17:53.505760+0000 mon.c (mon.1) 2184 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T16:17:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:53 gibba045 bash[25517]: audit 2021-03-10T16:17:53.506561+0000 mon.a (mon.0) 1816 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:17:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:53 gibba045 bash[25517]: audit 2021-03-10T16:17:53.507655+0000 mon.a (mon.0) 1817 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:17:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:53 gibba045 bash[25517]: audit 2021-03-10T16:17:53.507961+0000 mon.a (mon.0) 1818 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T16:17:55.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:54 gibba015 bash[29377]: cluster 2021-03-10T16:17:53.465175+0000 mgr.gibba045.orlgmj (mgr.34412) 7870 : cluster [DBG] pgmap v4482: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:55.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:54 gibba015 bash[30343]: cluster 2021-03-10T16:17:53.465175+0000 mgr.gibba045.orlgmj (mgr.34412) 7870 : cluster [DBG] pgmap v4482: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:55.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:54 gibba045 bash[25517]: cluster 2021-03-10T16:17:53.465175+0000 mgr.gibba045.orlgmj (mgr.34412) 7870 : cluster [DBG] pgmap v4482: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:57.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:56 gibba015 bash[29377]: cluster 2021-03-10T16:17:55.466828+0000 mgr.gibba045.orlgmj (mgr.34412) 7871 : cluster [DBG] pgmap v4483: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:57.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:56 gibba015 bash[30343]: cluster 2021-03-10T16:17:55.466828+0000 mgr.gibba045.orlgmj (mgr.34412) 7871 : cluster [DBG] pgmap v4483: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:57.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:56 gibba045 bash[25517]: cluster 2021-03-10T16:17:55.466828+0000 mgr.gibba045.orlgmj (mgr.34412) 7871 : cluster [DBG] pgmap v4483: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:59.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:17:58 gibba015 bash[29377]: cluster 2021-03-10T16:17:57.468679+0000 mgr.gibba045.orlgmj (mgr.34412) 7872 : cluster [DBG] pgmap v4484: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:59.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:17:58 gibba015 bash[30343]: cluster 2021-03-10T16:17:57.468679+0000 mgr.gibba045.orlgmj (mgr.34412) 7872 : cluster [DBG] pgmap v4484: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:59.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:17:58 gibba045 bash[25517]: cluster 2021-03-10T16:17:57.468679+0000 mgr.gibba045.orlgmj (mgr.34412) 7872 : cluster [DBG] pgmap v4484: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:01.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:18:00 gibba015 bash[29377]: cluster 2021-03-10T16:17:59.469892+0000 mgr.gibba045.orlgmj (mgr.34412) 7873 : cluster [DBG] pgmap v4485: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:01.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:18:00 gibba015 bash[30343]: cluster 2021-03-10T16:17:59.469892+0000 mgr.gibba045.orlgmj (mgr.34412) 7873 : cluster [DBG] pgmap v4485: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:01.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:18:00 gibba045 bash[25517]: cluster 2021-03-10T16:17:59.469892+0000 mgr.gibba045.orlgmj (mgr.34412) 7873 : cluster [DBG] pgmap v4485: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:03.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:18:02 gibba015 bash[29377]: cluster 2021-03-10T16:18:01.471793+0000 mgr.gibba045.orlgmj (mgr.34412) 7874 : cluster [DBG] pgmap v4486: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:03.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:18:02 gibba015 bash[29377]: cephadm 2021-03-10T16:18:01.501185+0000 mgr.gibba045.orlgmj (mgr.34412) 7875 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:18:03.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:18:02 gibba015 bash[30343]: cluster 2021-03-10T16:18:01.471793+0000 mgr.gibba045.orlgmj (mgr.34412) 7874 : cluster [DBG] pgmap v4486: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:03.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:18:02 gibba015 bash[30343]: cephadm 2021-03-10T16:18:01.501185+0000 mgr.gibba045.orlgmj (mgr.34412) 7875 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:18:03.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:18:02 gibba045 bash[25517]: cluster 2021-03-10T16:18:01.471793+0000 mgr.gibba045.orlgmj (mgr.34412) 7874 : cluster [DBG] pgmap v4486: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:03.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:18:02 gibba045 bash[25517]: cephadm 2021-03-10T16:18:01.501185+0000 mgr.gibba045.orlgmj (mgr.34412) 7875 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:18:05.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:18:04 gibba045 bash[25517]: cluster 2021-03-10T16:18:03.473357+0000 mgr.gibba045.orlgmj (mgr.34412) 7876 : cluster [DBG] pgmap v4487: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:05.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:18:04 gibba015 bash[29377]: cluster 2021-03-10T16:18:03.473357+0000 mgr.gibba045.orlgmj (mgr.34412) 7876 : cluster [DBG] pgmap v4487: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:05.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:18:04 gibba015 bash[30343]: cluster 2021-03-10T16:18:03.473357+0000 mgr.gibba045.orlgmj (mgr.34412) 7876 : cluster [DBG] pgmap v4487: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:07.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:18:06 gibba045 bash[25517]: cluster 2021-03-10T16:18:05.475145+0000 mgr.gibba045.orlgmj (mgr.34412) 7877 : cluster [DBG] pgmap v4488: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:07.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:18:06 gibba015 bash[29377]: cluster 2021-03-10T16:18:05.475145+0000 mgr.gibba045.orlgmj (mgr.34412) 7877 : cluster [DBG] pgmap v4488: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:07.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:18:06 gibba015 bash[30343]: cluster 2021-03-10T16:18:05.475145+0000 mgr.gibba045.orlgmj (mgr.34412) 7877 : cluster [DBG] pgmap v4488: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:09.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:18:08 gibba045 bash[25517]: cluster 2021-03-10T16:18:07.477033+0000 mgr.gibba045.orlgmj (mgr.34412) 7878 : cluster [DBG] pgmap v4489: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:09.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:18:08 gibba015 bash[29377]: cluster 2021-03-10T16:18:07.477033+0000 mgr.gibba045.orlgmj (mgr.34412) 7878 : cluster [DBG] pgmap v4489: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:09.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:18:08 gibba015 bash[30343]: cluster 2021-03-10T16:18:07.477033+0000 mgr.gibba045.orlgmj (mgr.34412) 7878 : cluster [DBG] pgmap v4489: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:09.829 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:18:10.057 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:18:10.057 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 2m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:18:10.057 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 58s ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:18:10.058 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 58s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:18:10.058 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 58s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:18:10.058 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:18:10.058 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:18:10.059 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 58s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:18:10.059 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:18:10.059 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 2m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:18:10.059 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 58s ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:18:10.060 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:18:10.060 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:18:10.060 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:18:10.060 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:18:10.060 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 58s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:18:10.061 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 58s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:18:10.061 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 58s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:18:10.061 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 58s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:18:10.061 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 58s ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:18:10.062 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 58s ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:18:10.306 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:18:10.307 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:18:10.307 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:18:10.307 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:18:10.307 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:18:10.308 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:18:10.308 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:18:10.308 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:18:10.308 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:18:10.309 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:18:10.309 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:18:10.309 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:18:10.309 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:18:10.309 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:18:10.310 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:18:11.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:18:11 gibba045 bash[25517]: cluster 2021-03-10T16:18:09.478349+0000 mgr.gibba045.orlgmj (mgr.34412) 7879 : cluster [DBG] pgmap v4490: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:11.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:18:11 gibba045 bash[25517]: audit 2021-03-10T16:18:09.823289+0000 mgr.gibba045.orlgmj (mgr.34412) 7880 : audit [DBG] from='client.49344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:18:11.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:18:11 gibba045 bash[25517]: audit 2021-03-10T16:18:10.049407+0000 mgr.gibba045.orlgmj (mgr.34412) 7881 : audit [DBG] from='client.59338 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:18:11.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:18:11 gibba045 bash[25517]: audit 2021-03-10T16:18:10.306668+0000 mon.c (mon.1) 2185 : audit [DBG] from='client.? 172.21.2.115:0/280010090' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:18:11.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:18:11 gibba015 bash[29377]: cluster 2021-03-10T16:18:09.478349+0000 mgr.gibba045.orlgmj (mgr.34412) 7879 : cluster [DBG] pgmap v4490: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:11.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:18:11 gibba015 bash[29377]: audit 2021-03-10T16:18:09.823289+0000 mgr.gibba045.orlgmj (mgr.34412) 7880 : audit [DBG] from='client.49344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:18:11.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:18:11 gibba015 bash[29377]: audit 2021-03-10T16:18:10.049407+0000 mgr.gibba045.orlgmj (mgr.34412) 7881 : audit [DBG] from='client.59338 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:18:11.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:18:11 gibba015 bash[29377]: audit 2021-03-10T16:18:10.306668+0000 mon.c (mon.1) 2185 : audit [DBG] from='client.? 172.21.2.115:0/280010090' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:18:11.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:18:11 gibba015 bash[30343]: cluster 2021-03-10T16:18:09.478349+0000 mgr.gibba045.orlgmj (mgr.34412) 7879 : cluster [DBG] pgmap v4490: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:11.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:18:11 gibba015 bash[30343]: audit 2021-03-10T16:18:09.823289+0000 mgr.gibba045.orlgmj (mgr.34412) 7880 : audit [DBG] from='client.49344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:18:11.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:18:11 gibba015 bash[30343]: audit 2021-03-10T16:18:10.049407+0000 mgr.gibba045.orlgmj (mgr.34412) 7881 : audit [DBG] from='client.59338 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:18:11.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:18:11 gibba015 bash[30343]: audit 2021-03-10T16:18:10.306668+0000 mon.c (mon.1) 2185 : audit [DBG] from='client.? 172.21.2.115:0/280010090' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:18:13.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:18:13 gibba045 bash[25517]: cluster 2021-03-10T16:18:11.480089+0000 mgr.gibba045.orlgmj (mgr.34412) 7882 : cluster [DBG] pgmap v4491: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:13.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:18:13 gibba015 bash[29377]: cluster 2021-03-10T16:18:11.480089+0000 mgr.gibba045.orlgmj (mgr.34412) 7882 : cluster [DBG] pgmap v4491: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:13.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:18:13 gibba015 bash[30343]: cluster 2021-03-10T16:18:11.480089+0000 mgr.gibba045.orlgmj (mgr.34412) 7882 : cluster [DBG] pgmap v4491: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:15.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:18:15 gibba045 bash[25517]: cluster 2021-03-10T16:18:13.481557+0000 mgr.gibba045.orlgmj (mgr.34412) 7883 : cluster [DBG] pgmap v4492: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:15.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:18:15 gibba015 bash[29377]: cluster 2021-03-10T16:18:13.481557+0000 mgr.gibba045.orlgmj (mgr.34412) 7883 : cluster [DBG] pgmap v4492: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:15.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:18:15 gibba015 bash[30343]: cluster 2021-03-10T16:18:13.481557+0000 mgr.gibba045.orlgmj (mgr.34412) 7883 : cluster [DBG] pgmap v4492: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:17.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:18:17 gibba045 bash[25517]: cluster 2021-03-10T16:18:15.483064+0000 mgr.gibba045.orlgmj (mgr.34412) 7884 : cluster [DBG] pgmap v4493: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:17.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:18:17 gibba045 bash[25517]: audit 2021-03-10T16:18:16.515510+0000 mon.c (mon.1) 2186 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:18:17.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:18:17 gibba045 bash[25517]: audit 2021-03-10T16:18:16.744331+0000 mon.a (mon.0) 1819 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:18:17.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:18:17 gibba045 bash[25517]: audit 2021-03-10T16:18:16.748436+0000 mon.c (mon.1) 2187 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:18:17.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:18:17 gibba045 bash[25517]: audit 2021-03-10T16:18:16.751069+0000 mon.c (mon.1) 2188 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:18:17.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:18:17 gibba045 bash[25517]: audit 2021-03-10T16:18:16.753403+0000 mon.c (mon.1) 2189 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:18:17.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:18:17 gibba045 bash[25517]: audit 2021-03-10T16:18:16.755743+0000 mon.c (mon.1) 2190 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:18:17.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:18:17 gibba045 bash[25517]: audit 2021-03-10T16:18:16.761785+0000 mon.c (mon.1) 2191 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:18:17.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:18:17 gibba045 bash[25517]: audit 2021-03-10T16:18:16.764446+0000 mon.c (mon.1) 2192 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:18:17.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:18:17 gibba015 bash[29377]: cluster 2021-03-10T16:18:15.483064+0000 mgr.gibba045.orlgmj (mgr.34412) 7884 : cluster [DBG] pgmap v4493: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:17.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:18:17 gibba015 bash[29377]: audit 2021-03-10T16:18:16.515510+0000 mon.c (mon.1) 2186 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:18:17.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:18:17 gibba015 bash[29377]: audit 2021-03-10T16:18:16.744331+0000 mon.a (mon.0) 1819 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:18:17.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:18:17 gibba015 bash[29377]: audit 2021-03-10T16:18:16.748436+0000 mon.c (mon.1) 2187 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:18:17.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:18:17 gibba015 bash[29377]: audit 2021-03-10T16:18:16.751069+0000 mon.c (mon.1) 2188 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:18:17.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:18:17 gibba015 bash[29377]: audit 2021-03-10T16:18:16.753403+0000 mon.c (mon.1) 2189 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:18:17.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:18:17 gibba015 bash[29377]: audit 2021-03-10T16:18:16.755743+0000 mon.c (mon.1) 2190 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:18:17.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:18:17 gibba015 bash[29377]: audit 2021-03-10T16:18:16.761785+0000 mon.c (mon.1) 2191 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:18:17.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:18:17 gibba015 bash[29377]: audit 2021-03-10T16:18:16.764446+0000 mon.c (mon.1) 2192 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:18:17.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:18:17 gibba015 bash[30343]: cluster 2021-03-10T16:18:15.483064+0000 mgr.gibba045.orlgmj (mgr.34412) 7884 : cluster [DBG] pgmap v4493: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:17.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:18:17 gibba015 bash[30343]: audit 2021-03-10T16:18:16.515510+0000 mon.c (mon.1) 2186 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:18:17.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:18:17 gibba015 bash[30343]: audit 2021-03-10T16:18:16.744331+0000 mon.a (mon.0) 1819 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:18:17.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:18:17 gibba015 bash[30343]: audit 2021-03-10T16:18:16.748436+0000 mon.c (mon.1) 2187 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:18:17.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:18:17 gibba015 bash[30343]: audit 2021-03-10T16:18:16.751069+0000 mon.c (mon.1) 2188 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:18:17.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:18:17 gibba015 bash[30343]: audit 2021-03-10T16:18:16.753403+0000 mon.c (mon.1) 2189 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:18:17.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:18:17 gibba015 bash[30343]: audit 2021-03-10T16:18:16.755743+0000 mon.c (mon.1) 2190 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:18:17.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:18:17 gibba015 bash[30343]: audit 2021-03-10T16:18:16.761785+0000 mon.c (mon.1) 2191 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:18:17.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:18:17 gibba015 bash[30343]: audit 2021-03-10T16:18:16.764446+0000 mon.c (mon.1) 2192 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:18:18.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:18:18 gibba045 bash[25517]: cephadm 2021-03-10T16:18:16.522989+0000 mgr.gibba045.orlgmj (mgr.34412) 7885 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:18:18.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:18:18 gibba045 bash[25517]: cephadm 2021-03-10T16:18:16.524864+0000 mgr.gibba045.orlgmj (mgr.34412) 7886 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:18:18.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:18:18 gibba045 bash[25517]: cephadm 2021-03-10T16:18:16.749966+0000 mgr.gibba045.orlgmj (mgr.34412) 7887 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:18:18.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:18:18 gibba045 bash[25517]: cephadm 2021-03-10T16:18:16.752938+0000 mgr.gibba045.orlgmj (mgr.34412) 7888 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:18:18.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:18:18 gibba045 bash[25517]: cephadm 2021-03-10T16:18:16.755214+0000 mgr.gibba045.orlgmj (mgr.34412) 7889 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:18:18.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:18:18 gibba045 bash[25517]: cephadm 2021-03-10T16:18:16.755254+0000 mgr.gibba045.orlgmj (mgr.34412) 7890 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:18:18.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:18:18 gibba045 bash[25517]: cephadm 2021-03-10T16:18:16.757592+0000 mgr.gibba045.orlgmj (mgr.34412) 7891 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:18:18.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:18:18 gibba045 bash[25517]: cephadm 2021-03-10T16:18:16.757633+0000 mgr.gibba045.orlgmj (mgr.34412) 7892 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:18:18.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:18:18 gibba045 bash[25517]: cephadm 2021-03-10T16:18:16.759981+0000 mgr.gibba045.orlgmj (mgr.34412) 7893 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:18:18.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:18:18 gibba045 bash[25517]: cephadm 2021-03-10T16:18:16.763481+0000 mgr.gibba045.orlgmj (mgr.34412) 7894 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:18:18.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:18:18 gibba045 bash[25517]: cephadm 2021-03-10T16:18:16.763526+0000 mgr.gibba045.orlgmj (mgr.34412) 7895 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:18:18.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:18:18 gibba045 bash[25517]: cephadm 2021-03-10T16:18:16.765984+0000 mgr.gibba045.orlgmj (mgr.34412) 7896 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:18:18.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:18:18 gibba045 bash[25517]: cephadm 2021-03-10T16:18:16.766363+0000 mgr.gibba045.orlgmj (mgr.34412) 7897 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:18:18.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:18:18 gibba045 bash[25517]: cephadm 2021-03-10T16:18:16.768945+0000 mgr.gibba045.orlgmj (mgr.34412) 7898 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:18:18.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:18:18 gibba045 bash[25517]: cephadm 2021-03-10T16:18:16.768995+0000 mgr.gibba045.orlgmj (mgr.34412) 7899 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:18:18.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:18:18 gibba045 bash[25517]: cephadm 2021-03-10T16:18:16.769133+0000 mgr.gibba045.orlgmj (mgr.34412) 7900 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:18:18.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:18:18 gibba015 bash[29377]: cephadm 2021-03-10T16:18:16.522989+0000 mgr.gibba045.orlgmj (mgr.34412) 7885 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:18:18.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:18:18 gibba015 bash[29377]: cephadm 2021-03-10T16:18:16.524864+0000 mgr.gibba045.orlgmj (mgr.34412) 7886 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:18:18.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:18:18 gibba015 bash[29377]: cephadm 2021-03-10T16:18:16.749966+0000 mgr.gibba045.orlgmj (mgr.34412) 7887 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:18:18.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:18:18 gibba015 bash[29377]: cephadm 2021-03-10T16:18:16.752938+0000 mgr.gibba045.orlgmj (mgr.34412) 7888 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:18:18.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:18:18 gibba015 bash[29377]: cephadm 2021-03-10T16:18:16.755214+0000 mgr.gibba045.orlgmj (mgr.34412) 7889 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:18:18.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:18:18 gibba015 bash[29377]: cephadm 2021-03-10T16:18:16.755254+0000 mgr.gibba045.orlgmj (mgr.34412) 7890 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:18:18.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:18:18 gibba015 bash[29377]: cephadm 2021-03-10T16:18:16.757592+0000 mgr.gibba045.orlgmj (mgr.34412) 7891 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:18:18.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:18:18 gibba015 bash[29377]: cephadm 2021-03-10T16:18:16.757633+0000 mgr.gibba045.orlgmj (mgr.34412) 7892 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:18:18.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:18:18 gibba015 bash[29377]: cephadm 2021-03-10T16:18:16.759981+0000 mgr.gibba045.orlgmj (mgr.34412) 7893 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:18:18.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:18:18 gibba015 bash[29377]: cephadm 2021-03-10T16:18:16.763481+0000 mgr.gibba045.orlgmj (mgr.34412) 7894 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:18:18.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:18:18 gibba015 bash[29377]: cephadm 2021-03-10T16:18:16.763526+0000 mgr.gibba045.orlgmj (mgr.34412) 7895 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:18:18.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:18:18 gibba015 bash[29377]: cephadm 2021-03-10T16:18:16.765984+0000 mgr.gibba045.orlgmj (mgr.34412) 7896 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:18:18.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:18:18 gibba015 bash[29377]: cephadm 2021-03-10T16:18:16.766363+0000 mgr.gibba045.orlgmj (mgr.34412) 7897 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:18:18.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:18:18 gibba015 bash[29377]: cephadm 2021-03-10T16:18:16.768945+0000 mgr.gibba045.orlgmj (mgr.34412) 7898 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:18:18.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:18:18 gibba015 bash[29377]: cephadm 2021-03-10T16:18:16.768995+0000 mgr.gibba045.orlgmj (mgr.34412) 7899 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:18:18.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:18:18 gibba015 bash[29377]: cephadm 2021-03-10T16:18:16.769133+0000 mgr.gibba045.orlgmj (mgr.34412) 7900 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:18:18.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:18:18 gibba015 bash[30343]: cephadm 2021-03-10T16:18:16.522989+0000 mgr.gibba045.orlgmj (mgr.34412) 7885 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:18:18.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:18:18 gibba015 bash[30343]: cephadm 2021-03-10T16:18:16.524864+0000 mgr.gibba045.orlgmj (mgr.34412) 7886 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:18:18.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:18:18 gibba015 bash[30343]: cephadm 2021-03-10T16:18:16.749966+0000 mgr.gibba045.orlgmj (mgr.34412) 7887 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:18:18.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:18:18 gibba015 bash[30343]: cephadm 2021-03-10T16:18:16.752938+0000 mgr.gibba045.orlgmj (mgr.34412) 7888 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:18:18.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:18:18 gibba015 bash[30343]: cephadm 2021-03-10T16:18:16.755214+0000 mgr.gibba045.orlgmj (mgr.34412) 7889 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:18:18.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:18:18 gibba015 bash[30343]: cephadm 2021-03-10T16:18:16.755254+0000 mgr.gibba045.orlgmj (mgr.34412) 7890 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:18:18.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:18:18 gibba015 bash[30343]: cephadm 2021-03-10T16:18:16.757592+0000 mgr.gibba045.orlgmj (mgr.34412) 7891 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:18:18.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:18:18 gibba015 bash[30343]: cephadm 2021-03-10T16:18:16.757633+0000 mgr.gibba045.orlgmj (mgr.34412) 7892 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:18:18.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:18:18 gibba015 bash[30343]: cephadm 2021-03-10T16:18:16.759981+0000 mgr.gibba045.orlgmj (mgr.34412) 7893 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:18:18.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:18:18 gibba015 bash[30343]: cephadm 2021-03-10T16:18:16.763481+0000 mgr.gibba045.orlgmj (mgr.34412) 7894 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:18:18.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:18:18 gibba015 bash[30343]: cephadm 2021-03-10T16:18:16.763526+0000 mgr.gibba045.orlgmj (mgr.34412) 7895 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:18:18.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:18:18 gibba015 bash[30343]: cephadm 2021-03-10T16:18:16.765984+0000 mgr.gibba045.orlgmj (mgr.34412) 7896 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:18:18.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:18:18 gibba015 bash[30343]: cephadm 2021-03-10T16:18:16.766363+0000 mgr.gibba045.orlgmj (mgr.34412) 7897 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:18:18.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:18:18 gibba015 bash[30343]: cephadm 2021-03-10T16:18:16.768945+0000 mgr.gibba045.orlgmj (mgr.34412) 7898 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:18:18.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:18:18 gibba015 bash[30343]: cephadm 2021-03-10T16:18:16.768995+0000 mgr.gibba045.orlgmj (mgr.34412) 7899 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:18:18.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:18:18 gibba015 bash[30343]: cephadm 2021-03-10T16:18:16.769133+0000 mgr.gibba045.orlgmj (mgr.34412) 7900 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:18:19.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:18:19 gibba045 bash[25517]: cluster 2021-03-10T16:18:17.484862+0000 mgr.gibba045.orlgmj (mgr.34412) 7901 : cluster [DBG] pgmap v4494: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:19.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:18:19 gibba015 bash[29377]: cluster 2021-03-10T16:18:17.484862+0000 mgr.gibba045.orlgmj (mgr.34412) 7901 : cluster [DBG] pgmap v4494: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:19.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:18:19 gibba015 bash[30343]: cluster 2021-03-10T16:18:17.484862+0000 mgr.gibba045.orlgmj (mgr.34412) 7901 : cluster [DBG] pgmap v4494: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:21.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:18:21 gibba015 bash[29377]: cluster 2021-03-10T16:18:19.486399+0000 mgr.gibba045.orlgmj (mgr.34412) 7902 : cluster [DBG] pgmap v4495: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:21.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:18:21 gibba015 bash[30343]: cluster 2021-03-10T16:18:19.486399+0000 mgr.gibba045.orlgmj (mgr.34412) 7902 : cluster [DBG] pgmap v4495: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:21.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:18:21 gibba045 bash[25517]: cluster 2021-03-10T16:18:19.486399+0000 mgr.gibba045.orlgmj (mgr.34412) 7902 : cluster [DBG] pgmap v4495: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:23.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:18:23 gibba015 bash[29377]: cluster 2021-03-10T16:18:21.488269+0000 mgr.gibba045.orlgmj (mgr.34412) 7903 : cluster [DBG] pgmap v4496: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:23.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:18:23 gibba015 bash[30343]: cluster 2021-03-10T16:18:21.488269+0000 mgr.gibba045.orlgmj (mgr.34412) 7903 : cluster [DBG] pgmap v4496: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:23.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:18:23 gibba045 bash[25517]: cluster 2021-03-10T16:18:21.488269+0000 mgr.gibba045.orlgmj (mgr.34412) 7903 : cluster [DBG] pgmap v4496: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:25.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:18:25 gibba015 bash[29377]: cluster 2021-03-10T16:18:23.489725+0000 mgr.gibba045.orlgmj (mgr.34412) 7904 : cluster [DBG] pgmap v4497: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:25.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:18:25 gibba015 bash[30343]: cluster 2021-03-10T16:18:23.489725+0000 mgr.gibba045.orlgmj (mgr.34412) 7904 : cluster [DBG] pgmap v4497: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:25.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:18:25 gibba045 bash[25517]: cluster 2021-03-10T16:18:23.489725+0000 mgr.gibba045.orlgmj (mgr.34412) 7904 : cluster [DBG] pgmap v4497: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:27.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:18:27 gibba015 bash[29377]: cluster 2021-03-10T16:18:25.491217+0000 mgr.gibba045.orlgmj (mgr.34412) 7905 : cluster [DBG] pgmap v4498: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:27.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:18:27 gibba015 bash[30343]: cluster 2021-03-10T16:18:25.491217+0000 mgr.gibba045.orlgmj (mgr.34412) 7905 : cluster [DBG] pgmap v4498: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:27.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:18:27 gibba045 bash[25517]: cluster 2021-03-10T16:18:25.491217+0000 mgr.gibba045.orlgmj (mgr.34412) 7905 : cluster [DBG] pgmap v4498: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:29.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:18:29 gibba015 bash[29377]: cluster 2021-03-10T16:18:27.492769+0000 mgr.gibba045.orlgmj (mgr.34412) 7906 : cluster [DBG] pgmap v4499: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:29.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:18:29 gibba015 bash[30343]: cluster 2021-03-10T16:18:27.492769+0000 mgr.gibba045.orlgmj (mgr.34412) 7906 : cluster [DBG] pgmap v4499: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:29.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:18:29 gibba045 bash[25517]: cluster 2021-03-10T16:18:27.492769+0000 mgr.gibba045.orlgmj (mgr.34412) 7906 : cluster [DBG] pgmap v4499: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:31.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:18:31 gibba015 bash[29377]: cluster 2021-03-10T16:18:29.494079+0000 mgr.gibba045.orlgmj (mgr.34412) 7907 : cluster [DBG] pgmap v4500: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:31.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:18:31 gibba015 bash[30343]: cluster 2021-03-10T16:18:29.494079+0000 mgr.gibba045.orlgmj (mgr.34412) 7907 : cluster [DBG] pgmap v4500: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:31.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:18:31 gibba045 bash[25517]: cluster 2021-03-10T16:18:29.494079+0000 mgr.gibba045.orlgmj (mgr.34412) 7907 : cluster [DBG] pgmap v4500: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:33.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:18:33 gibba015 bash[29377]: cluster 2021-03-10T16:18:31.495913+0000 mgr.gibba045.orlgmj (mgr.34412) 7908 : cluster [DBG] pgmap v4501: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:33.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:18:33 gibba015 bash[29377]: cephadm 2021-03-10T16:18:31.773898+0000 mgr.gibba045.orlgmj (mgr.34412) 7909 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:18:33.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:18:33 gibba015 bash[30343]: cluster 2021-03-10T16:18:31.495913+0000 mgr.gibba045.orlgmj (mgr.34412) 7908 : cluster [DBG] pgmap v4501: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:33.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:18:33 gibba015 bash[30343]: cephadm 2021-03-10T16:18:31.773898+0000 mgr.gibba045.orlgmj (mgr.34412) 7909 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:18:33.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:18:33 gibba045 bash[25517]: cluster 2021-03-10T16:18:31.495913+0000 mgr.gibba045.orlgmj (mgr.34412) 7908 : cluster [DBG] pgmap v4501: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:33.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:18:33 gibba045 bash[25517]: cephadm 2021-03-10T16:18:31.773898+0000 mgr.gibba045.orlgmj (mgr.34412) 7909 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:18:35.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:18:35 gibba015 bash[29377]: cluster 2021-03-10T16:18:33.497359+0000 mgr.gibba045.orlgmj (mgr.34412) 7910 : cluster [DBG] pgmap v4502: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:35.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:18:35 gibba015 bash[30343]: cluster 2021-03-10T16:18:33.497359+0000 mgr.gibba045.orlgmj (mgr.34412) 7910 : cluster [DBG] pgmap v4502: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:35.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:18:35 gibba045 bash[25517]: cluster 2021-03-10T16:18:33.497359+0000 mgr.gibba045.orlgmj (mgr.34412) 7910 : cluster [DBG] pgmap v4502: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:37.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:18:37 gibba015 bash[29377]: cluster 2021-03-10T16:18:35.499003+0000 mgr.gibba045.orlgmj (mgr.34412) 7911 : cluster [DBG] pgmap v4503: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:37.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:18:37 gibba015 bash[30343]: cluster 2021-03-10T16:18:35.499003+0000 mgr.gibba045.orlgmj (mgr.34412) 7911 : cluster [DBG] pgmap v4503: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:37.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:18:37 gibba045 bash[25517]: cluster 2021-03-10T16:18:35.499003+0000 mgr.gibba045.orlgmj (mgr.34412) 7911 : cluster [DBG] pgmap v4503: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:39.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:18:39 gibba015 bash[29377]: cluster 2021-03-10T16:18:37.500694+0000 mgr.gibba045.orlgmj (mgr.34412) 7912 : cluster [DBG] pgmap v4504: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:39.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:18:39 gibba015 bash[30343]: cluster 2021-03-10T16:18:37.500694+0000 mgr.gibba045.orlgmj (mgr.34412) 7912 : cluster [DBG] pgmap v4504: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:39.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:18:39 gibba045 bash[25517]: cluster 2021-03-10T16:18:37.500694+0000 mgr.gibba045.orlgmj (mgr.34412) 7912 : cluster [DBG] pgmap v4504: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:40.551 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:18:40.777 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:18:40.778 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 2m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:18:40.778 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 89s ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:18:40.778 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 89s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:18:40.778 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 89s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:18:40.779 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:18:40.779 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:18:40.779 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 89s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:18:40.779 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:18:40.780 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 2m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:18:40.780 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 89s ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:18:40.780 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:18:40.780 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:18:40.781 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:18:40.781 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:18:40.781 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 89s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:18:40.781 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 89s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:18:40.781 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 89s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:18:40.782 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 89s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:18:40.782 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 89s ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:18:40.782 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 89s ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:18:41.024 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:18:41.024 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:18:41.024 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:18:41.025 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:18:41.025 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:18:41.025 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:18:41.025 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:18:41.026 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:18:41.026 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:18:41.026 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:18:41.026 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:18:41.027 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:18:41.027 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:18:41.027 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:18:41.027 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:18:41.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:18:41 gibba015 bash[29377]: cluster 2021-03-10T16:18:39.502067+0000 mgr.gibba045.orlgmj (mgr.34412) 7913 : cluster [DBG] pgmap v4505: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:41.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:18:41 gibba015 bash[29377]: audit 2021-03-10T16:18:41.024411+0000 mon.c (mon.1) 2193 : audit [DBG] from='client.? 172.21.2.115:0/1651811161' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:18:41.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:18:41 gibba015 bash[30343]: cluster 2021-03-10T16:18:39.502067+0000 mgr.gibba045.orlgmj (mgr.34412) 7913 : cluster [DBG] pgmap v4505: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:41.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:18:41 gibba015 bash[30343]: audit 2021-03-10T16:18:41.024411+0000 mon.c (mon.1) 2193 : audit [DBG] from='client.? 172.21.2.115:0/1651811161' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:18:41.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:18:41 gibba045 bash[25517]: cluster 2021-03-10T16:18:39.502067+0000 mgr.gibba045.orlgmj (mgr.34412) 7913 : cluster [DBG] pgmap v4505: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:41.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:18:41 gibba045 bash[25517]: audit 2021-03-10T16:18:41.024411+0000 mon.c (mon.1) 2193 : audit [DBG] from='client.? 172.21.2.115:0/1651811161' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:18:42.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:18:42 gibba015 bash[29377]: audit 2021-03-10T16:18:40.544742+0000 mgr.gibba045.orlgmj (mgr.34412) 7914 : audit [DBG] from='client.59350 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:18:42.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:18:42 gibba015 bash[29377]: audit 2021-03-10T16:18:40.768053+0000 mgr.gibba045.orlgmj (mgr.34412) 7915 : audit [DBG] from='client.49368 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:18:42.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:18:42 gibba015 bash[30343]: audit 2021-03-10T16:18:40.544742+0000 mgr.gibba045.orlgmj (mgr.34412) 7914 : audit [DBG] from='client.59350 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:18:42.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:18:42 gibba015 bash[30343]: audit 2021-03-10T16:18:40.768053+0000 mgr.gibba045.orlgmj (mgr.34412) 7915 : audit [DBG] from='client.49368 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:18:42.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:18:42 gibba045 bash[25517]: audit 2021-03-10T16:18:40.544742+0000 mgr.gibba045.orlgmj (mgr.34412) 7914 : audit [DBG] from='client.59350 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:18:42.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:18:42 gibba045 bash[25517]: audit 2021-03-10T16:18:40.768053+0000 mgr.gibba045.orlgmj (mgr.34412) 7915 : audit [DBG] from='client.49368 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:18:43.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:18:43 gibba015 bash[29377]: cluster 2021-03-10T16:18:41.503739+0000 mgr.gibba045.orlgmj (mgr.34412) 7916 : cluster [DBG] pgmap v4506: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:43.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:18:43 gibba015 bash[30343]: cluster 2021-03-10T16:18:41.503739+0000 mgr.gibba045.orlgmj (mgr.34412) 7916 : cluster [DBG] pgmap v4506: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:43.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:18:43 gibba045 bash[25517]: cluster 2021-03-10T16:18:41.503739+0000 mgr.gibba045.orlgmj (mgr.34412) 7916 : cluster [DBG] pgmap v4506: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:45.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:18:45 gibba015 bash[29377]: cluster 2021-03-10T16:18:43.505320+0000 mgr.gibba045.orlgmj (mgr.34412) 7917 : cluster [DBG] pgmap v4507: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:45.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:18:45 gibba015 bash[30343]: cluster 2021-03-10T16:18:43.505320+0000 mgr.gibba045.orlgmj (mgr.34412) 7917 : cluster [DBG] pgmap v4507: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:45.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:18:45 gibba045 bash[25517]: cluster 2021-03-10T16:18:43.505320+0000 mgr.gibba045.orlgmj (mgr.34412) 7917 : cluster [DBG] pgmap v4507: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:47.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:18:47 gibba015 bash[29377]: cluster 2021-03-10T16:18:45.506777+0000 mgr.gibba045.orlgmj (mgr.34412) 7918 : cluster [DBG] pgmap v4508: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:47.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:18:47 gibba015 bash[30343]: cluster 2021-03-10T16:18:45.506777+0000 mgr.gibba045.orlgmj (mgr.34412) 7918 : cluster [DBG] pgmap v4508: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:47.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:18:47 gibba045 bash[25517]: cluster 2021-03-10T16:18:45.506777+0000 mgr.gibba045.orlgmj (mgr.34412) 7918 : cluster [DBG] pgmap v4508: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:48.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:18:48 gibba015 bash[29377]: cephadm 2021-03-10T16:18:46.789956+0000 mgr.gibba045.orlgmj (mgr.34412) 7919 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:18:48.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:18:48 gibba015 bash[30343]: cephadm 2021-03-10T16:18:46.789956+0000 mgr.gibba045.orlgmj (mgr.34412) 7919 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:18:48.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:18:48 gibba045 bash[25517]: cephadm 2021-03-10T16:18:46.789956+0000 mgr.gibba045.orlgmj (mgr.34412) 7919 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:18:49.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:18:49 gibba015 bash[29377]: cluster 2021-03-10T16:18:47.508571+0000 mgr.gibba045.orlgmj (mgr.34412) 7920 : cluster [DBG] pgmap v4509: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:49.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:18:49 gibba015 bash[30343]: cluster 2021-03-10T16:18:47.508571+0000 mgr.gibba045.orlgmj (mgr.34412) 7920 : cluster [DBG] pgmap v4509: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:49.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:18:49 gibba045 bash[25517]: cluster 2021-03-10T16:18:47.508571+0000 mgr.gibba045.orlgmj (mgr.34412) 7920 : cluster [DBG] pgmap v4509: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:51.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:18:51 gibba015 bash[29377]: cluster 2021-03-10T16:18:49.509851+0000 mgr.gibba045.orlgmj (mgr.34412) 7921 : cluster [DBG] pgmap v4510: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:51.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:18:51 gibba015 bash[30343]: cluster 2021-03-10T16:18:49.509851+0000 mgr.gibba045.orlgmj (mgr.34412) 7921 : cluster [DBG] pgmap v4510: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:51.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:18:51 gibba045 bash[25517]: cluster 2021-03-10T16:18:49.509851+0000 mgr.gibba045.orlgmj (mgr.34412) 7921 : cluster [DBG] pgmap v4510: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:53.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:18:53 gibba015 bash[29377]: cluster 2021-03-10T16:18:51.511796+0000 mgr.gibba045.orlgmj (mgr.34412) 7922 : cluster [DBG] pgmap v4511: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:53.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:18:53 gibba015 bash[30343]: cluster 2021-03-10T16:18:51.511796+0000 mgr.gibba045.orlgmj (mgr.34412) 7922 : cluster [DBG] pgmap v4511: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:53.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:18:53 gibba045 bash[25517]: cluster 2021-03-10T16:18:51.511796+0000 mgr.gibba045.orlgmj (mgr.34412) 7922 : cluster [DBG] pgmap v4511: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:54.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:18:54 gibba015 bash[29377]: audit 2021-03-10T16:18:53.508225+0000 mon.c (mon.1) 2194 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:18:54.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:18:54 gibba015 bash[29377]: audit 2021-03-10T16:18:53.508949+0000 mon.c (mon.1) 2195 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:18:54.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:18:54 gibba015 bash[29377]: audit 2021-03-10T16:18:53.509363+0000 mon.a (mon.0) 1820 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:18:54.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:18:54 gibba015 bash[29377]: audit 2021-03-10T16:18:53.510003+0000 mon.c (mon.1) 2196 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T16:18:54.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:18:54 gibba015 bash[29377]: audit 2021-03-10T16:18:53.510542+0000 mon.a (mon.0) 1821 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:18:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:18:54 gibba015 bash[29377]: audit 2021-03-10T16:18:53.511194+0000 mon.c (mon.1) 2197 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:18:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:18:54 gibba015 bash[29377]: audit 2021-03-10T16:18:53.511278+0000 mon.a (mon.0) 1822 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T16:18:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:18:54 gibba015 bash[29377]: audit 2021-03-10T16:18:53.512303+0000 mon.a (mon.0) 1823 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:18:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:18:54 gibba015 bash[29377]: audit 2021-03-10T16:18:53.512540+0000 mon.c (mon.1) 2198 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-03-10T16:18:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:18:54 gibba015 bash[29377]: audit 2021-03-10T16:18:53.513586+0000 mon.a (mon.0) 1824 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-03-10T16:18:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:18:54 gibba015 bash[29377]: audit 2021-03-10T16:18:53.513594+0000 mon.c (mon.1) 2199 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:18:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:18:54 gibba015 bash[29377]: audit 2021-03-10T16:18:53.513909+0000 mon.a (mon.0) 1825 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:18:54.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:18:54 gibba015 bash[30343]: audit 2021-03-10T16:18:53.508225+0000 mon.c (mon.1) 2194 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:18:54.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:18:54 gibba015 bash[30343]: audit 2021-03-10T16:18:53.508949+0000 mon.c (mon.1) 2195 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:18:54.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:18:54 gibba015 bash[30343]: audit 2021-03-10T16:18:53.509363+0000 mon.a (mon.0) 1820 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:18:54.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:18:54 gibba015 bash[30343]: audit 2021-03-10T16:18:53.510003+0000 mon.c (mon.1) 2196 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T16:18:54.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:18:54 gibba015 bash[30343]: audit 2021-03-10T16:18:53.510542+0000 mon.a (mon.0) 1821 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:18:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:18:54 gibba015 bash[30343]: audit 2021-03-10T16:18:53.511194+0000 mon.c (mon.1) 2197 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:18:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:18:54 gibba015 bash[30343]: audit 2021-03-10T16:18:53.511278+0000 mon.a (mon.0) 1822 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T16:18:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:18:54 gibba015 bash[30343]: audit 2021-03-10T16:18:53.512303+0000 mon.a (mon.0) 1823 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:18:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:18:54 gibba015 bash[30343]: audit 2021-03-10T16:18:53.512540+0000 mon.c (mon.1) 2198 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-03-10T16:18:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:18:54 gibba015 bash[30343]: audit 2021-03-10T16:18:53.513586+0000 mon.a (mon.0) 1824 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-03-10T16:18:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:18:54 gibba015 bash[30343]: audit 2021-03-10T16:18:53.513594+0000 mon.c (mon.1) 2199 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:18:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:18:54 gibba015 bash[30343]: audit 2021-03-10T16:18:53.513909+0000 mon.a (mon.0) 1825 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:18:54.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:18:54 gibba045 bash[25517]: audit 2021-03-10T16:18:53.508225+0000 mon.c (mon.1) 2194 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:18:54.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:18:54 gibba045 bash[25517]: audit 2021-03-10T16:18:53.508949+0000 mon.c (mon.1) 2195 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:18:54.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:18:54 gibba045 bash[25517]: audit 2021-03-10T16:18:53.509363+0000 mon.a (mon.0) 1820 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:18:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:18:54 gibba045 bash[25517]: audit 2021-03-10T16:18:53.510003+0000 mon.c (mon.1) 2196 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T16:18:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:18:54 gibba045 bash[25517]: audit 2021-03-10T16:18:53.510542+0000 mon.a (mon.0) 1821 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:18:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:18:54 gibba045 bash[25517]: audit 2021-03-10T16:18:53.511194+0000 mon.c (mon.1) 2197 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:18:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:18:54 gibba045 bash[25517]: audit 2021-03-10T16:18:53.511278+0000 mon.a (mon.0) 1822 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T16:18:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:18:54 gibba045 bash[25517]: audit 2021-03-10T16:18:53.512303+0000 mon.a (mon.0) 1823 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:18:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:18:54 gibba045 bash[25517]: audit 2021-03-10T16:18:53.512540+0000 mon.c (mon.1) 2198 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-03-10T16:18:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:18:54 gibba045 bash[25517]: audit 2021-03-10T16:18:53.513586+0000 mon.a (mon.0) 1824 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-03-10T16:18:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:18:54 gibba045 bash[25517]: audit 2021-03-10T16:18:53.513594+0000 mon.c (mon.1) 2199 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:18:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:18:54 gibba045 bash[25517]: audit 2021-03-10T16:18:53.513909+0000 mon.a (mon.0) 1825 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:18:55.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:18:55 gibba015 bash[29377]: cluster 2021-03-10T16:18:53.512238+0000 mgr.gibba045.orlgmj (mgr.34412) 7923 : cluster [DBG] pgmap v4512: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:55.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:18:55 gibba015 bash[30343]: cluster 2021-03-10T16:18:53.512238+0000 mgr.gibba045.orlgmj (mgr.34412) 7923 : cluster [DBG] pgmap v4512: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:55.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:18:55 gibba045 bash[25517]: cluster 2021-03-10T16:18:53.512238+0000 mgr.gibba045.orlgmj (mgr.34412) 7923 : cluster [DBG] pgmap v4512: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:57.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:18:57 gibba045 bash[25517]: cluster 2021-03-10T16:18:55.513785+0000 mgr.gibba045.orlgmj (mgr.34412) 7924 : cluster [DBG] pgmap v4513: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:57.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:18:57 gibba015 bash[29377]: cluster 2021-03-10T16:18:55.513785+0000 mgr.gibba045.orlgmj (mgr.34412) 7924 : cluster [DBG] pgmap v4513: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:57.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:18:57 gibba015 bash[30343]: cluster 2021-03-10T16:18:55.513785+0000 mgr.gibba045.orlgmj (mgr.34412) 7924 : cluster [DBG] pgmap v4513: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:58.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:18:58 gibba045 bash[25517]: cluster 2021-03-10T16:18:57.515578+0000 mgr.gibba045.orlgmj (mgr.34412) 7925 : cluster [DBG] pgmap v4514: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:58.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:18:58 gibba015 bash[29377]: cluster 2021-03-10T16:18:57.515578+0000 mgr.gibba045.orlgmj (mgr.34412) 7925 : cluster [DBG] pgmap v4514: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:58.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:18:58 gibba015 bash[30343]: cluster 2021-03-10T16:18:57.515578+0000 mgr.gibba045.orlgmj (mgr.34412) 7925 : cluster [DBG] pgmap v4514: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:00.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:19:00 gibba015 bash[29377]: cluster 2021-03-10T16:18:59.517066+0000 mgr.gibba045.orlgmj (mgr.34412) 7926 : cluster [DBG] pgmap v4515: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:00.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:19:00 gibba015 bash[30343]: cluster 2021-03-10T16:18:59.517066+0000 mgr.gibba045.orlgmj (mgr.34412) 7926 : cluster [DBG] pgmap v4515: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:01.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:19:00 gibba045 bash[25517]: cluster 2021-03-10T16:18:59.517066+0000 mgr.gibba045.orlgmj (mgr.34412) 7926 : cluster [DBG] pgmap v4515: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:03.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:19:02 gibba015 bash[29377]: cluster 2021-03-10T16:19:01.518896+0000 mgr.gibba045.orlgmj (mgr.34412) 7927 : cluster [DBG] pgmap v4516: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:03.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:19:02 gibba015 bash[29377]: cephadm 2021-03-10T16:19:01.805757+0000 mgr.gibba045.orlgmj (mgr.34412) 7928 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:19:03.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:19:02 gibba015 bash[30343]: cluster 2021-03-10T16:19:01.518896+0000 mgr.gibba045.orlgmj (mgr.34412) 7927 : cluster [DBG] pgmap v4516: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:03.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:19:02 gibba015 bash[30343]: cephadm 2021-03-10T16:19:01.805757+0000 mgr.gibba045.orlgmj (mgr.34412) 7928 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:19:03.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:19:02 gibba045 bash[25517]: cluster 2021-03-10T16:19:01.518896+0000 mgr.gibba045.orlgmj (mgr.34412) 7927 : cluster [DBG] pgmap v4516: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:03.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:19:02 gibba045 bash[25517]: cephadm 2021-03-10T16:19:01.805757+0000 mgr.gibba045.orlgmj (mgr.34412) 7928 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:19:05.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:19:04 gibba015 bash[29377]: cluster 2021-03-10T16:19:03.520390+0000 mgr.gibba045.orlgmj (mgr.34412) 7929 : cluster [DBG] pgmap v4517: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:05.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:19:04 gibba015 bash[30343]: cluster 2021-03-10T16:19:03.520390+0000 mgr.gibba045.orlgmj (mgr.34412) 7929 : cluster [DBG] pgmap v4517: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:05.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:19:04 gibba045 bash[25517]: cluster 2021-03-10T16:19:03.520390+0000 mgr.gibba045.orlgmj (mgr.34412) 7929 : cluster [DBG] pgmap v4517: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:07.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:19:06 gibba015 bash[29377]: cluster 2021-03-10T16:19:05.521852+0000 mgr.gibba045.orlgmj (mgr.34412) 7930 : cluster [DBG] pgmap v4518: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:07.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:19:06 gibba015 bash[30343]: cluster 2021-03-10T16:19:05.521852+0000 mgr.gibba045.orlgmj (mgr.34412) 7930 : cluster [DBG] pgmap v4518: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:07.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:19:06 gibba045 bash[25517]: cluster 2021-03-10T16:19:05.521852+0000 mgr.gibba045.orlgmj (mgr.34412) 7930 : cluster [DBG] pgmap v4518: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:09.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:19:08 gibba015 bash[29377]: cluster 2021-03-10T16:19:07.523598+0000 mgr.gibba045.orlgmj (mgr.34412) 7931 : cluster [DBG] pgmap v4519: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:09.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:19:08 gibba015 bash[30343]: cluster 2021-03-10T16:19:07.523598+0000 mgr.gibba045.orlgmj (mgr.34412) 7931 : cluster [DBG] pgmap v4519: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:09.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:19:08 gibba045 bash[25517]: cluster 2021-03-10T16:19:07.523598+0000 mgr.gibba045.orlgmj (mgr.34412) 7931 : cluster [DBG] pgmap v4519: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:11.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:19:10 gibba015 bash[29377]: cluster 2021-03-10T16:19:09.525206+0000 mgr.gibba045.orlgmj (mgr.34412) 7932 : cluster [DBG] pgmap v4520: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:11.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:19:10 gibba015 bash[30343]: cluster 2021-03-10T16:19:09.525206+0000 mgr.gibba045.orlgmj (mgr.34412) 7932 : cluster [DBG] pgmap v4520: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:11.271 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:19:11.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:19:10 gibba045 bash[25517]: cluster 2021-03-10T16:19:09.525206+0000 mgr.gibba045.orlgmj (mgr.34412) 7932 : cluster [DBG] pgmap v4520: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:11.528 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:19:11.529 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 3m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:19:11.529 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 2m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:19:11.529 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:19:11.529 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:19:11.530 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:19:11.530 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:19:11.530 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:19:11.530 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:19:11.531 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 3m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:19:11.531 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 2m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:19:11.531 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:19:11.531 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:19:11.532 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:19:11.532 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:19:11.532 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:19:11.532 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:19:11.533 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:19:11.533 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:19:11.533 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 2m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:19:11.533 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 2m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:19:11.785 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:19:11.786 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:19:11.786 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:19:11.786 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:19:11.786 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:19:11.787 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:19:11.787 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:19:11.787 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:19:11.787 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:19:11.788 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:19:11.788 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:19:11.788 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:19:11.788 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:19:11.789 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:19:11.789 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:19:12.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:19:11 gibba015 bash[29377]: audit 2021-03-10T16:19:11.785762+0000 mon.a (mon.0) 1826 : audit [DBG] from='client.? 172.21.2.115:0/3601547639' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:19:12.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:19:11 gibba015 bash[30343]: audit 2021-03-10T16:19:11.785762+0000 mon.a (mon.0) 1826 : audit [DBG] from='client.? 172.21.2.115:0/3601547639' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:19:12.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:19:11 gibba045 bash[25517]: audit 2021-03-10T16:19:11.785762+0000 mon.a (mon.0) 1826 : audit [DBG] from='client.? 172.21.2.115:0/3601547639' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:19:13.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:19:12 gibba015 bash[29377]: audit 2021-03-10T16:19:11.264734+0000 mgr.gibba045.orlgmj (mgr.34412) 7933 : audit [DBG] from='client.59368 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:19:13.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:19:12 gibba015 bash[29377]: audit 2021-03-10T16:19:11.491627+0000 mgr.gibba045.orlgmj (mgr.34412) 7934 : audit [DBG] from='client.49386 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:19:13.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:19:12 gibba015 bash[29377]: cluster 2021-03-10T16:19:11.526708+0000 mgr.gibba045.orlgmj (mgr.34412) 7935 : cluster [DBG] pgmap v4521: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:13.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:19:12 gibba015 bash[30343]: audit 2021-03-10T16:19:11.264734+0000 mgr.gibba045.orlgmj (mgr.34412) 7933 : audit [DBG] from='client.59368 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:19:13.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:19:12 gibba015 bash[30343]: audit 2021-03-10T16:19:11.491627+0000 mgr.gibba045.orlgmj (mgr.34412) 7934 : audit [DBG] from='client.49386 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:19:13.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:19:12 gibba015 bash[30343]: cluster 2021-03-10T16:19:11.526708+0000 mgr.gibba045.orlgmj (mgr.34412) 7935 : cluster [DBG] pgmap v4521: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:13.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:19:12 gibba045 bash[25517]: audit 2021-03-10T16:19:11.264734+0000 mgr.gibba045.orlgmj (mgr.34412) 7933 : audit [DBG] from='client.59368 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:19:13.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:19:12 gibba045 bash[25517]: audit 2021-03-10T16:19:11.491627+0000 mgr.gibba045.orlgmj (mgr.34412) 7934 : audit [DBG] from='client.49386 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:19:13.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:19:12 gibba045 bash[25517]: cluster 2021-03-10T16:19:11.526708+0000 mgr.gibba045.orlgmj (mgr.34412) 7935 : cluster [DBG] pgmap v4521: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:15.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:19:14 gibba015 bash[29377]: cluster 2021-03-10T16:19:13.528174+0000 mgr.gibba045.orlgmj (mgr.34412) 7936 : cluster [DBG] pgmap v4522: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:15.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:19:14 gibba015 bash[30343]: cluster 2021-03-10T16:19:13.528174+0000 mgr.gibba045.orlgmj (mgr.34412) 7936 : cluster [DBG] pgmap v4522: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:15.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:19:14 gibba045 bash[25517]: cluster 2021-03-10T16:19:13.528174+0000 mgr.gibba045.orlgmj (mgr.34412) 7936 : cluster [DBG] pgmap v4522: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:17.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:19:16 gibba015 bash[29377]: cluster 2021-03-10T16:19:15.529781+0000 mgr.gibba045.orlgmj (mgr.34412) 7937 : cluster [DBG] pgmap v4523: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:17.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:19:16 gibba015 bash[29377]: audit 2021-03-10T16:19:16.820070+0000 mon.c (mon.1) 2200 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:19:17.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:19:16 gibba015 bash[30343]: cluster 2021-03-10T16:19:15.529781+0000 mgr.gibba045.orlgmj (mgr.34412) 7937 : cluster [DBG] pgmap v4523: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:17.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:19:16 gibba015 bash[30343]: audit 2021-03-10T16:19:16.820070+0000 mon.c (mon.1) 2200 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:19:17.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:19:16 gibba045 bash[25517]: cluster 2021-03-10T16:19:15.529781+0000 mgr.gibba045.orlgmj (mgr.34412) 7937 : cluster [DBG] pgmap v4523: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:17.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:19:16 gibba045 bash[25517]: audit 2021-03-10T16:19:16.820070+0000 mon.c (mon.1) 2200 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:19:18.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:19:18 gibba015 bash[29377]: cephadm 2021-03-10T16:19:16.827980+0000 mgr.gibba045.orlgmj (mgr.34412) 7938 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:19:18.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:19:18 gibba015 bash[29377]: cephadm 2021-03-10T16:19:16.829880+0000 mgr.gibba045.orlgmj (mgr.34412) 7939 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:19:18.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:19:18 gibba015 bash[29377]: audit 2021-03-10T16:19:17.056526+0000 mon.a (mon.0) 1827 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:19:18.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:19:18 gibba015 bash[29377]: audit 2021-03-10T16:19:17.060616+0000 mon.c (mon.1) 2201 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:19:18.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:19:18 gibba015 bash[29377]: audit 2021-03-10T16:19:17.062005+0000 mon.c (mon.1) 2202 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:19:18.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:19:18 gibba015 bash[29377]: cephadm 2021-03-10T16:19:17.062422+0000 mgr.gibba045.orlgmj (mgr.34412) 7940 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:19:18.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:19:18 gibba015 bash[29377]: audit 2021-03-10T16:19:17.063519+0000 mon.c (mon.1) 2203 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:19:18.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:19:18 gibba015 bash[29377]: cephadm 2021-03-10T16:19:17.064055+0000 mgr.gibba045.orlgmj (mgr.34412) 7941 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:19:18.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:19:18 gibba015 bash[29377]: audit 2021-03-10T16:19:17.064660+0000 mon.c (mon.1) 2204 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:19:18.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:19:18 gibba015 bash[29377]: cephadm 2021-03-10T16:19:17.065505+0000 mgr.gibba045.orlgmj (mgr.34412) 7942 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:19:18.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:19:18 gibba015 bash[29377]: cephadm 2021-03-10T16:19:17.065559+0000 mgr.gibba045.orlgmj (mgr.34412) 7943 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:19:18.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:19:18 gibba015 bash[29377]: cephadm 2021-03-10T16:19:17.066867+0000 mgr.gibba045.orlgmj (mgr.34412) 7944 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:19:18.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:19:18 gibba015 bash[29377]: cephadm 2021-03-10T16:19:17.066921+0000 mgr.gibba045.orlgmj (mgr.34412) 7945 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:19:18.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:19:18 gibba015 bash[29377]: audit 2021-03-10T16:19:17.067827+0000 mon.c (mon.1) 2205 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:19:18.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:19:18 gibba015 bash[29377]: cephadm 2021-03-10T16:19:17.068032+0000 mgr.gibba045.orlgmj (mgr.34412) 7946 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:19:18.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:19:18 gibba015 bash[29377]: audit 2021-03-10T16:19:17.069414+0000 mon.c (mon.1) 2206 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:19:18.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:19:18 gibba015 bash[29377]: cephadm 2021-03-10T16:19:17.069771+0000 mgr.gibba045.orlgmj (mgr.34412) 7947 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:19:18.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:19:18 gibba015 bash[29377]: cephadm 2021-03-10T16:19:17.069829+0000 mgr.gibba045.orlgmj (mgr.34412) 7948 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:19:18.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:19:18 gibba015 bash[29377]: cephadm 2021-03-10T16:19:17.071189+0000 mgr.gibba045.orlgmj (mgr.34412) 7949 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:19:18.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:19:18 gibba015 bash[29377]: cephadm 2021-03-10T16:19:17.071642+0000 mgr.gibba045.orlgmj (mgr.34412) 7950 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:19:18.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:19:18 gibba015 bash[29377]: cephadm 2021-03-10T16:19:17.072749+0000 mgr.gibba045.orlgmj (mgr.34412) 7951 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:19:18.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:19:18 gibba015 bash[29377]: cephadm 2021-03-10T16:19:17.072825+0000 mgr.gibba045.orlgmj (mgr.34412) 7952 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:19:18.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:19:18 gibba015 bash[29377]: cephadm 2021-03-10T16:19:17.072982+0000 mgr.gibba045.orlgmj (mgr.34412) 7953 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:19:18.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:19:18 gibba015 bash[30343]: cephadm 2021-03-10T16:19:16.827980+0000 mgr.gibba045.orlgmj (mgr.34412) 7938 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:19:18.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:19:18 gibba015 bash[30343]: cephadm 2021-03-10T16:19:16.829880+0000 mgr.gibba045.orlgmj (mgr.34412) 7939 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:19:18.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:19:18 gibba015 bash[30343]: audit 2021-03-10T16:19:17.056526+0000 mon.a (mon.0) 1827 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:19:18.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:19:18 gibba015 bash[30343]: audit 2021-03-10T16:19:17.060616+0000 mon.c (mon.1) 2201 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:19:18.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:19:18 gibba015 bash[30343]: audit 2021-03-10T16:19:17.062005+0000 mon.c (mon.1) 2202 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:19:18.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:19:18 gibba015 bash[30343]: cephadm 2021-03-10T16:19:17.062422+0000 mgr.gibba045.orlgmj (mgr.34412) 7940 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:19:18.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:19:18 gibba015 bash[30343]: audit 2021-03-10T16:19:17.063519+0000 mon.c (mon.1) 2203 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:19:18.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:19:18 gibba015 bash[30343]: cephadm 2021-03-10T16:19:17.064055+0000 mgr.gibba045.orlgmj (mgr.34412) 7941 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:19:18.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:19:18 gibba015 bash[30343]: audit 2021-03-10T16:19:17.064660+0000 mon.c (mon.1) 2204 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:19:18.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:19:18 gibba015 bash[30343]: cephadm 2021-03-10T16:19:17.065505+0000 mgr.gibba045.orlgmj (mgr.34412) 7942 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:19:18.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:19:18 gibba015 bash[30343]: cephadm 2021-03-10T16:19:17.065559+0000 mgr.gibba045.orlgmj (mgr.34412) 7943 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:19:18.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:19:18 gibba015 bash[30343]: cephadm 2021-03-10T16:19:17.066867+0000 mgr.gibba045.orlgmj (mgr.34412) 7944 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:19:18.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:19:18 gibba015 bash[30343]: cephadm 2021-03-10T16:19:17.066921+0000 mgr.gibba045.orlgmj (mgr.34412) 7945 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:19:18.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:19:18 gibba015 bash[30343]: audit 2021-03-10T16:19:17.067827+0000 mon.c (mon.1) 2205 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:19:18.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:19:18 gibba015 bash[30343]: cephadm 2021-03-10T16:19:17.068032+0000 mgr.gibba045.orlgmj (mgr.34412) 7946 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:19:18.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:19:18 gibba015 bash[30343]: audit 2021-03-10T16:19:17.069414+0000 mon.c (mon.1) 2206 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:19:18.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:19:18 gibba015 bash[30343]: cephadm 2021-03-10T16:19:17.069771+0000 mgr.gibba045.orlgmj (mgr.34412) 7947 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:19:18.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:19:18 gibba015 bash[30343]: cephadm 2021-03-10T16:19:17.069829+0000 mgr.gibba045.orlgmj (mgr.34412) 7948 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:19:18.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:19:18 gibba015 bash[30343]: cephadm 2021-03-10T16:19:17.071189+0000 mgr.gibba045.orlgmj (mgr.34412) 7949 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:19:18.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:19:18 gibba015 bash[30343]: cephadm 2021-03-10T16:19:17.071642+0000 mgr.gibba045.orlgmj (mgr.34412) 7950 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:19:18.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:19:18 gibba015 bash[30343]: cephadm 2021-03-10T16:19:17.072749+0000 mgr.gibba045.orlgmj (mgr.34412) 7951 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:19:18.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:19:18 gibba015 bash[30343]: cephadm 2021-03-10T16:19:17.072825+0000 mgr.gibba045.orlgmj (mgr.34412) 7952 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:19:18.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:19:18 gibba015 bash[30343]: cephadm 2021-03-10T16:19:17.072982+0000 mgr.gibba045.orlgmj (mgr.34412) 7953 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:19:18.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:19:18 gibba045 bash[25517]: cephadm 2021-03-10T16:19:16.827980+0000 mgr.gibba045.orlgmj (mgr.34412) 7938 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:19:18.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:19:18 gibba045 bash[25517]: cephadm 2021-03-10T16:19:16.829880+0000 mgr.gibba045.orlgmj (mgr.34412) 7939 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:19:18.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:19:18 gibba045 bash[25517]: audit 2021-03-10T16:19:17.056526+0000 mon.a (mon.0) 1827 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:19:18.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:19:18 gibba045 bash[25517]: audit 2021-03-10T16:19:17.060616+0000 mon.c (mon.1) 2201 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:19:18.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:19:18 gibba045 bash[25517]: audit 2021-03-10T16:19:17.062005+0000 mon.c (mon.1) 2202 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:19:18.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:19:18 gibba045 bash[25517]: cephadm 2021-03-10T16:19:17.062422+0000 mgr.gibba045.orlgmj (mgr.34412) 7940 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:19:18.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:19:18 gibba045 bash[25517]: audit 2021-03-10T16:19:17.063519+0000 mon.c (mon.1) 2203 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:19:18.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:19:18 gibba045 bash[25517]: cephadm 2021-03-10T16:19:17.064055+0000 mgr.gibba045.orlgmj (mgr.34412) 7941 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:19:18.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:19:18 gibba045 bash[25517]: audit 2021-03-10T16:19:17.064660+0000 mon.c (mon.1) 2204 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:19:18.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:19:18 gibba045 bash[25517]: cephadm 2021-03-10T16:19:17.065505+0000 mgr.gibba045.orlgmj (mgr.34412) 7942 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:19:18.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:19:18 gibba045 bash[25517]: cephadm 2021-03-10T16:19:17.065559+0000 mgr.gibba045.orlgmj (mgr.34412) 7943 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:19:18.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:19:18 gibba045 bash[25517]: cephadm 2021-03-10T16:19:17.066867+0000 mgr.gibba045.orlgmj (mgr.34412) 7944 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:19:18.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:19:18 gibba045 bash[25517]: cephadm 2021-03-10T16:19:17.066921+0000 mgr.gibba045.orlgmj (mgr.34412) 7945 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:19:18.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:19:18 gibba045 bash[25517]: audit 2021-03-10T16:19:17.067827+0000 mon.c (mon.1) 2205 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:19:18.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:19:18 gibba045 bash[25517]: cephadm 2021-03-10T16:19:17.068032+0000 mgr.gibba045.orlgmj (mgr.34412) 7946 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:19:18.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:19:18 gibba045 bash[25517]: audit 2021-03-10T16:19:17.069414+0000 mon.c (mon.1) 2206 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:19:18.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:19:18 gibba045 bash[25517]: cephadm 2021-03-10T16:19:17.069771+0000 mgr.gibba045.orlgmj (mgr.34412) 7947 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:19:18.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:19:18 gibba045 bash[25517]: cephadm 2021-03-10T16:19:17.069829+0000 mgr.gibba045.orlgmj (mgr.34412) 7948 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:19:18.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:19:18 gibba045 bash[25517]: cephadm 2021-03-10T16:19:17.071189+0000 mgr.gibba045.orlgmj (mgr.34412) 7949 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:19:18.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:19:18 gibba045 bash[25517]: cephadm 2021-03-10T16:19:17.071642+0000 mgr.gibba045.orlgmj (mgr.34412) 7950 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:19:18.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:19:18 gibba045 bash[25517]: cephadm 2021-03-10T16:19:17.072749+0000 mgr.gibba045.orlgmj (mgr.34412) 7951 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:19:18.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:19:18 gibba045 bash[25517]: cephadm 2021-03-10T16:19:17.072825+0000 mgr.gibba045.orlgmj (mgr.34412) 7952 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:19:18.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:19:18 gibba045 bash[25517]: cephadm 2021-03-10T16:19:17.072982+0000 mgr.gibba045.orlgmj (mgr.34412) 7953 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:19:19.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:19:19 gibba015 bash[29377]: cluster 2021-03-10T16:19:17.531270+0000 mgr.gibba045.orlgmj (mgr.34412) 7954 : cluster [DBG] pgmap v4524: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:19.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:19:19 gibba015 bash[30343]: cluster 2021-03-10T16:19:17.531270+0000 mgr.gibba045.orlgmj (mgr.34412) 7954 : cluster [DBG] pgmap v4524: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:19.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:19:19 gibba045 bash[25517]: cluster 2021-03-10T16:19:17.531270+0000 mgr.gibba045.orlgmj (mgr.34412) 7954 : cluster [DBG] pgmap v4524: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:21.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:19:21 gibba015 bash[29377]: cluster 2021-03-10T16:19:19.532682+0000 mgr.gibba045.orlgmj (mgr.34412) 7955 : cluster [DBG] pgmap v4525: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:21.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:19:21 gibba015 bash[30343]: cluster 2021-03-10T16:19:19.532682+0000 mgr.gibba045.orlgmj (mgr.34412) 7955 : cluster [DBG] pgmap v4525: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:21.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:19:21 gibba045 bash[25517]: cluster 2021-03-10T16:19:19.532682+0000 mgr.gibba045.orlgmj (mgr.34412) 7955 : cluster [DBG] pgmap v4525: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:23.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:19:23 gibba015 bash[29377]: cluster 2021-03-10T16:19:21.534303+0000 mgr.gibba045.orlgmj (mgr.34412) 7956 : cluster [DBG] pgmap v4526: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:23.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:19:23 gibba015 bash[30343]: cluster 2021-03-10T16:19:21.534303+0000 mgr.gibba045.orlgmj (mgr.34412) 7956 : cluster [DBG] pgmap v4526: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:23.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:19:23 gibba045 bash[25517]: cluster 2021-03-10T16:19:21.534303+0000 mgr.gibba045.orlgmj (mgr.34412) 7956 : cluster [DBG] pgmap v4526: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:25.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:19:25 gibba015 bash[29377]: cluster 2021-03-10T16:19:23.535638+0000 mgr.gibba045.orlgmj (mgr.34412) 7957 : cluster [DBG] pgmap v4527: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:25.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:19:25 gibba015 bash[30343]: cluster 2021-03-10T16:19:23.535638+0000 mgr.gibba045.orlgmj (mgr.34412) 7957 : cluster [DBG] pgmap v4527: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:25.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:19:25 gibba045 bash[25517]: cluster 2021-03-10T16:19:23.535638+0000 mgr.gibba045.orlgmj (mgr.34412) 7957 : cluster [DBG] pgmap v4527: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:27.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:19:27 gibba015 bash[29377]: cluster 2021-03-10T16:19:25.537361+0000 mgr.gibba045.orlgmj (mgr.34412) 7958 : cluster [DBG] pgmap v4528: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:27.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:19:27 gibba015 bash[30343]: cluster 2021-03-10T16:19:25.537361+0000 mgr.gibba045.orlgmj (mgr.34412) 7958 : cluster [DBG] pgmap v4528: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:27.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:19:27 gibba045 bash[25517]: cluster 2021-03-10T16:19:25.537361+0000 mgr.gibba045.orlgmj (mgr.34412) 7958 : cluster [DBG] pgmap v4528: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:29.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:19:29 gibba015 bash[29377]: cluster 2021-03-10T16:19:27.539060+0000 mgr.gibba045.orlgmj (mgr.34412) 7959 : cluster [DBG] pgmap v4529: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:29.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:19:29 gibba015 bash[30343]: cluster 2021-03-10T16:19:27.539060+0000 mgr.gibba045.orlgmj (mgr.34412) 7959 : cluster [DBG] pgmap v4529: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:29.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:19:29 gibba045 bash[25517]: cluster 2021-03-10T16:19:27.539060+0000 mgr.gibba045.orlgmj (mgr.34412) 7959 : cluster [DBG] pgmap v4529: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:31.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:19:31 gibba015 bash[29377]: cluster 2021-03-10T16:19:29.540612+0000 mgr.gibba045.orlgmj (mgr.34412) 7960 : cluster [DBG] pgmap v4530: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:31.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:19:31 gibba015 bash[30343]: cluster 2021-03-10T16:19:29.540612+0000 mgr.gibba045.orlgmj (mgr.34412) 7960 : cluster [DBG] pgmap v4530: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:31.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:19:31 gibba045 bash[25517]: cluster 2021-03-10T16:19:29.540612+0000 mgr.gibba045.orlgmj (mgr.34412) 7960 : cluster [DBG] pgmap v4530: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:33.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:19:33 gibba015 bash[29377]: cluster 2021-03-10T16:19:31.542336+0000 mgr.gibba045.orlgmj (mgr.34412) 7961 : cluster [DBG] pgmap v4531: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:33.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:19:33 gibba015 bash[29377]: cephadm 2021-03-10T16:19:32.089096+0000 mgr.gibba045.orlgmj (mgr.34412) 7962 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:19:33.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:19:33 gibba015 bash[30343]: cluster 2021-03-10T16:19:31.542336+0000 mgr.gibba045.orlgmj (mgr.34412) 7961 : cluster [DBG] pgmap v4531: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:33.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:19:33 gibba015 bash[30343]: cephadm 2021-03-10T16:19:32.089096+0000 mgr.gibba045.orlgmj (mgr.34412) 7962 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:19:33.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:19:33 gibba045 bash[25517]: cluster 2021-03-10T16:19:31.542336+0000 mgr.gibba045.orlgmj (mgr.34412) 7961 : cluster [DBG] pgmap v4531: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:33.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:19:33 gibba045 bash[25517]: cephadm 2021-03-10T16:19:32.089096+0000 mgr.gibba045.orlgmj (mgr.34412) 7962 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:19:35.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:19:35 gibba015 bash[29377]: cluster 2021-03-10T16:19:33.543704+0000 mgr.gibba045.orlgmj (mgr.34412) 7963 : cluster [DBG] pgmap v4532: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:35.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:19:35 gibba015 bash[30343]: cluster 2021-03-10T16:19:33.543704+0000 mgr.gibba045.orlgmj (mgr.34412) 7963 : cluster [DBG] pgmap v4532: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:35.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:19:35 gibba045 bash[25517]: cluster 2021-03-10T16:19:33.543704+0000 mgr.gibba045.orlgmj (mgr.34412) 7963 : cluster [DBG] pgmap v4532: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:37.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:19:37 gibba015 bash[29377]: cluster 2021-03-10T16:19:35.545245+0000 mgr.gibba045.orlgmj (mgr.34412) 7964 : cluster [DBG] pgmap v4533: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:37.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:19:37 gibba015 bash[30343]: cluster 2021-03-10T16:19:35.545245+0000 mgr.gibba045.orlgmj (mgr.34412) 7964 : cluster [DBG] pgmap v4533: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:37.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:19:37 gibba045 bash[25517]: cluster 2021-03-10T16:19:35.545245+0000 mgr.gibba045.orlgmj (mgr.34412) 7964 : cluster [DBG] pgmap v4533: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:39.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:19:39 gibba015 bash[29377]: cluster 2021-03-10T16:19:37.546742+0000 mgr.gibba045.orlgmj (mgr.34412) 7965 : cluster [DBG] pgmap v4534: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:39.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:19:39 gibba015 bash[30343]: cluster 2021-03-10T16:19:37.546742+0000 mgr.gibba045.orlgmj (mgr.34412) 7965 : cluster [DBG] pgmap v4534: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:39.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:19:39 gibba045 bash[25517]: cluster 2021-03-10T16:19:37.546742+0000 mgr.gibba045.orlgmj (mgr.34412) 7965 : cluster [DBG] pgmap v4534: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:41.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:19:41 gibba015 bash[29377]: cluster 2021-03-10T16:19:39.548328+0000 mgr.gibba045.orlgmj (mgr.34412) 7966 : cluster [DBG] pgmap v4535: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:41.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:19:41 gibba015 bash[30343]: cluster 2021-03-10T16:19:39.548328+0000 mgr.gibba045.orlgmj (mgr.34412) 7966 : cluster [DBG] pgmap v4535: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:41.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:19:41 gibba045 bash[25517]: cluster 2021-03-10T16:19:39.548328+0000 mgr.gibba045.orlgmj (mgr.34412) 7966 : cluster [DBG] pgmap v4535: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:42.030 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:19:42.253 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:19:42.253 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 3m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:19:42.253 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 2m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:19:42.254 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:19:42.254 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:19:42.254 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:19:42.254 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:19:42.254 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:19:42.255 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:19:42.255 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 3m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:19:42.255 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 2m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:19:42.255 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:19:42.256 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:19:42.256 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:19:42.256 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:19:42.256 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:19:42.257 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:19:42.257 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:19:42.257 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:19:42.257 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 2m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:19:42.257 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 2m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:19:42.502 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:19:42.503 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:19:42.503 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:19:42.503 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:19:42.503 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:19:42.504 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:19:42.504 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:19:42.504 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:19:42.504 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:19:42.504 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:19:42.505 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:19:42.505 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:19:42.505 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:19:42.505 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:19:42.506 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:19:43.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:19:43 gibba015 bash[29377]: cluster 2021-03-10T16:19:41.550099+0000 mgr.gibba045.orlgmj (mgr.34412) 7967 : cluster [DBG] pgmap v4536: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:43.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:19:43 gibba015 bash[29377]: audit 2021-03-10T16:19:42.024121+0000 mgr.gibba045.orlgmj (mgr.34412) 7968 : audit [DBG] from='client.59386 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:19:43.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:19:43 gibba015 bash[29377]: audit 2021-03-10T16:19:42.502934+0000 mon.a (mon.0) 1828 : audit [DBG] from='client.? 172.21.2.115:0/1042197551' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:19:43.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:19:43 gibba015 bash[30343]: cluster 2021-03-10T16:19:41.550099+0000 mgr.gibba045.orlgmj (mgr.34412) 7967 : cluster [DBG] pgmap v4536: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:43.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:19:43 gibba015 bash[30343]: audit 2021-03-10T16:19:42.024121+0000 mgr.gibba045.orlgmj (mgr.34412) 7968 : audit [DBG] from='client.59386 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:19:43.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:19:43 gibba015 bash[30343]: audit 2021-03-10T16:19:42.502934+0000 mon.a (mon.0) 1828 : audit [DBG] from='client.? 172.21.2.115:0/1042197551' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:19:43.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:19:43 gibba045 bash[25517]: cluster 2021-03-10T16:19:41.550099+0000 mgr.gibba045.orlgmj (mgr.34412) 7967 : cluster [DBG] pgmap v4536: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:43.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:19:43 gibba045 bash[25517]: audit 2021-03-10T16:19:42.024121+0000 mgr.gibba045.orlgmj (mgr.34412) 7968 : audit [DBG] from='client.59386 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:19:43.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:19:43 gibba045 bash[25517]: audit 2021-03-10T16:19:42.502934+0000 mon.a (mon.0) 1828 : audit [DBG] from='client.? 172.21.2.115:0/1042197551' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:19:44.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:19:44 gibba015 bash[29377]: audit 2021-03-10T16:19:42.245098+0000 mgr.gibba045.orlgmj (mgr.34412) 7969 : audit [DBG] from='client.59392 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:19:44.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:19:44 gibba015 bash[30343]: audit 2021-03-10T16:19:42.245098+0000 mgr.gibba045.orlgmj (mgr.34412) 7969 : audit [DBG] from='client.59392 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:19:44.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:19:44 gibba045 bash[25517]: audit 2021-03-10T16:19:42.245098+0000 mgr.gibba045.orlgmj (mgr.34412) 7969 : audit [DBG] from='client.59392 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:19:45.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:19:45 gibba015 bash[29377]: cluster 2021-03-10T16:19:43.551463+0000 mgr.gibba045.orlgmj (mgr.34412) 7970 : cluster [DBG] pgmap v4537: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:45.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:19:45 gibba015 bash[30343]: cluster 2021-03-10T16:19:43.551463+0000 mgr.gibba045.orlgmj (mgr.34412) 7970 : cluster [DBG] pgmap v4537: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:45.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:19:45 gibba045 bash[25517]: cluster 2021-03-10T16:19:43.551463+0000 mgr.gibba045.orlgmj (mgr.34412) 7970 : cluster [DBG] pgmap v4537: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:47.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:19:47 gibba015 bash[29377]: cluster 2021-03-10T16:19:45.553203+0000 mgr.gibba045.orlgmj (mgr.34412) 7971 : cluster [DBG] pgmap v4538: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:47.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:19:47 gibba015 bash[30343]: cluster 2021-03-10T16:19:45.553203+0000 mgr.gibba045.orlgmj (mgr.34412) 7971 : cluster [DBG] pgmap v4538: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:47.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:19:47 gibba045 bash[25517]: cluster 2021-03-10T16:19:45.553203+0000 mgr.gibba045.orlgmj (mgr.34412) 7971 : cluster [DBG] pgmap v4538: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:48.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:19:48 gibba015 bash[29377]: cephadm 2021-03-10T16:19:47.104976+0000 mgr.gibba045.orlgmj (mgr.34412) 7972 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:19:48.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:19:48 gibba015 bash[30343]: cephadm 2021-03-10T16:19:47.104976+0000 mgr.gibba045.orlgmj (mgr.34412) 7972 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:19:48.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:19:48 gibba045 bash[25517]: cephadm 2021-03-10T16:19:47.104976+0000 mgr.gibba045.orlgmj (mgr.34412) 7972 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:19:49.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:19:49 gibba015 bash[29377]: cluster 2021-03-10T16:19:47.554883+0000 mgr.gibba045.orlgmj (mgr.34412) 7973 : cluster [DBG] pgmap v4539: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:49.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:19:49 gibba015 bash[30343]: cluster 2021-03-10T16:19:47.554883+0000 mgr.gibba045.orlgmj (mgr.34412) 7973 : cluster [DBG] pgmap v4539: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:49.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:19:49 gibba045 bash[25517]: cluster 2021-03-10T16:19:47.554883+0000 mgr.gibba045.orlgmj (mgr.34412) 7973 : cluster [DBG] pgmap v4539: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:51.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:19:51 gibba015 bash[29377]: cluster 2021-03-10T16:19:49.556373+0000 mgr.gibba045.orlgmj (mgr.34412) 7974 : cluster [DBG] pgmap v4540: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:51.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:19:51 gibba015 bash[30343]: cluster 2021-03-10T16:19:49.556373+0000 mgr.gibba045.orlgmj (mgr.34412) 7974 : cluster [DBG] pgmap v4540: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:51.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:19:51 gibba045 bash[25517]: cluster 2021-03-10T16:19:49.556373+0000 mgr.gibba045.orlgmj (mgr.34412) 7974 : cluster [DBG] pgmap v4540: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:53.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:19:53 gibba045 bash[25517]: cluster 2021-03-10T16:19:51.557849+0000 mgr.gibba045.orlgmj (mgr.34412) 7975 : cluster [DBG] pgmap v4541: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:53.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:19:53 gibba015 bash[29377]: cluster 2021-03-10T16:19:51.557849+0000 mgr.gibba045.orlgmj (mgr.34412) 7975 : cluster [DBG] pgmap v4541: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:53.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:19:53 gibba015 bash[30343]: cluster 2021-03-10T16:19:51.557849+0000 mgr.gibba045.orlgmj (mgr.34412) 7975 : cluster [DBG] pgmap v4541: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:54.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:19:54 gibba045 bash[25517]: audit 2021-03-10T16:19:53.516315+0000 mon.c (mon.1) 2207 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:19:54.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:19:54 gibba045 bash[25517]: audit 2021-03-10T16:19:53.517061+0000 mon.c (mon.1) 2208 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:19:54.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:19:54 gibba045 bash[25517]: audit 2021-03-10T16:19:53.517600+0000 mon.a (mon.0) 1829 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:19:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:19:54 gibba045 bash[25517]: audit 2021-03-10T16:19:53.518118+0000 mon.c (mon.1) 2209 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T16:19:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:19:54 gibba045 bash[25517]: audit 2021-03-10T16:19:53.519483+0000 mon.c (mon.1) 2210 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:19:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:19:54 gibba045 bash[25517]: audit 2021-03-10T16:19:53.519516+0000 mon.a (mon.0) 1830 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:19:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:19:54 gibba045 bash[25517]: audit 2021-03-10T16:19:53.520864+0000 mon.c (mon.1) 2211 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:19:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:19:54 gibba045 bash[25517]: audit 2021-03-10T16:19:53.521442+0000 mon.a (mon.0) 1831 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T16:19:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:19:54 gibba045 bash[25517]: audit 2021-03-10T16:19:53.522022+0000 mon.c (mon.1) 2212 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:19:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:19:54 gibba045 bash[25517]: audit 2021-03-10T16:19:53.523261+0000 mon.a (mon.0) 1832 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:19:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:19:54 gibba045 bash[25517]: audit 2021-03-10T16:19:53.524665+0000 mon.a (mon.0) 1833 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:19:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:19:54 gibba045 bash[25517]: audit 2021-03-10T16:19:53.525863+0000 mon.a (mon.0) 1834 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:19:54.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:19:54 gibba015 bash[29377]: audit 2021-03-10T16:19:53.516315+0000 mon.c (mon.1) 2207 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:19:54.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:19:54 gibba015 bash[29377]: audit 2021-03-10T16:19:53.517061+0000 mon.c (mon.1) 2208 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:19:54.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:19:54 gibba015 bash[29377]: audit 2021-03-10T16:19:53.517600+0000 mon.a (mon.0) 1829 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:19:54.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:19:54 gibba015 bash[29377]: audit 2021-03-10T16:19:53.518118+0000 mon.c (mon.1) 2209 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T16:19:54.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:19:54 gibba015 bash[29377]: audit 2021-03-10T16:19:53.519483+0000 mon.c (mon.1) 2210 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:19:54.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:19:54 gibba015 bash[29377]: audit 2021-03-10T16:19:53.519516+0000 mon.a (mon.0) 1830 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:19:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:19:54 gibba015 bash[29377]: audit 2021-03-10T16:19:53.520864+0000 mon.c (mon.1) 2211 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:19:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:19:54 gibba015 bash[29377]: audit 2021-03-10T16:19:53.521442+0000 mon.a (mon.0) 1831 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T16:19:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:19:54 gibba015 bash[29377]: audit 2021-03-10T16:19:53.522022+0000 mon.c (mon.1) 2212 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:19:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:19:54 gibba015 bash[29377]: audit 2021-03-10T16:19:53.523261+0000 mon.a (mon.0) 1832 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:19:54.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:19:54 gibba015 bash[29377]: audit 2021-03-10T16:19:53.524665+0000 mon.a (mon.0) 1833 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:19:54.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:19:54 gibba015 bash[29377]: audit 2021-03-10T16:19:53.525863+0000 mon.a (mon.0) 1834 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:19:54.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:19:54 gibba015 bash[30343]: audit 2021-03-10T16:19:53.516315+0000 mon.c (mon.1) 2207 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:19:54.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:19:54 gibba015 bash[30343]: audit 2021-03-10T16:19:53.517061+0000 mon.c (mon.1) 2208 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:19:54.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:19:54 gibba015 bash[30343]: audit 2021-03-10T16:19:53.517600+0000 mon.a (mon.0) 1829 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:19:54.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:19:54 gibba015 bash[30343]: audit 2021-03-10T16:19:53.518118+0000 mon.c (mon.1) 2209 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T16:19:54.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:19:54 gibba015 bash[30343]: audit 2021-03-10T16:19:53.519483+0000 mon.c (mon.1) 2210 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:19:54.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:19:54 gibba015 bash[30343]: audit 2021-03-10T16:19:53.519516+0000 mon.a (mon.0) 1830 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:19:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:19:54 gibba015 bash[30343]: audit 2021-03-10T16:19:53.520864+0000 mon.c (mon.1) 2211 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:19:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:19:54 gibba015 bash[30343]: audit 2021-03-10T16:19:53.521442+0000 mon.a (mon.0) 1831 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T16:19:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:19:54 gibba015 bash[30343]: audit 2021-03-10T16:19:53.522022+0000 mon.c (mon.1) 2212 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:19:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:19:54 gibba015 bash[30343]: audit 2021-03-10T16:19:53.523261+0000 mon.a (mon.0) 1832 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:19:54.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:19:54 gibba015 bash[30343]: audit 2021-03-10T16:19:53.524665+0000 mon.a (mon.0) 1833 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:19:54.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:19:54 gibba015 bash[30343]: audit 2021-03-10T16:19:53.525863+0000 mon.a (mon.0) 1834 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:19:55.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:19:55 gibba045 bash[25517]: cluster 2021-03-10T16:19:53.558519+0000 mgr.gibba045.orlgmj (mgr.34412) 7976 : cluster [DBG] pgmap v4542: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:55.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:19:55 gibba015 bash[29377]: cluster 2021-03-10T16:19:53.558519+0000 mgr.gibba045.orlgmj (mgr.34412) 7976 : cluster [DBG] pgmap v4542: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:55.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:19:55 gibba015 bash[30343]: cluster 2021-03-10T16:19:53.558519+0000 mgr.gibba045.orlgmj (mgr.34412) 7976 : cluster [DBG] pgmap v4542: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:57.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:19:56 gibba015 bash[29377]: cluster 2021-03-10T16:19:55.559925+0000 mgr.gibba045.orlgmj (mgr.34412) 7977 : cluster [DBG] pgmap v4543: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:57.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:19:56 gibba015 bash[30343]: cluster 2021-03-10T16:19:55.559925+0000 mgr.gibba045.orlgmj (mgr.34412) 7977 : cluster [DBG] pgmap v4543: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:57.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:19:56 gibba045 bash[25517]: cluster 2021-03-10T16:19:55.559925+0000 mgr.gibba045.orlgmj (mgr.34412) 7977 : cluster [DBG] pgmap v4543: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:59.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:19:58 gibba015 bash[29377]: cluster 2021-03-10T16:19:57.561656+0000 mgr.gibba045.orlgmj (mgr.34412) 7978 : cluster [DBG] pgmap v4544: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:59.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:19:58 gibba015 bash[30343]: cluster 2021-03-10T16:19:57.561656+0000 mgr.gibba045.orlgmj (mgr.34412) 7978 : cluster [DBG] pgmap v4544: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:59.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:19:58 gibba045 bash[25517]: cluster 2021-03-10T16:19:57.561656+0000 mgr.gibba045.orlgmj (mgr.34412) 7978 : cluster [DBG] pgmap v4544: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:00.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:20:00 gibba015 bash[29377]: debug 2021-03-10T16:19:59.996+0000 7f21beb4f700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T16:20:01.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:20:00 gibba015 bash[29377]: cluster 2021-03-10T16:19:59.563326+0000 mgr.gibba045.orlgmj (mgr.34412) 7979 : cluster [DBG] pgmap v4545: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:01.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:20:00 gibba015 bash[29377]: cluster 2021-03-10T16:20:00.000478+0000 mon.a (mon.0) 1835 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T16:20:01.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:20:00 gibba015 bash[30343]: cluster 2021-03-10T16:19:59.563326+0000 mgr.gibba045.orlgmj (mgr.34412) 7979 : cluster [DBG] pgmap v4545: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:01.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:20:00 gibba015 bash[30343]: cluster 2021-03-10T16:20:00.000478+0000 mon.a (mon.0) 1835 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T16:20:01.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:20:00 gibba045 bash[25517]: cluster 2021-03-10T16:19:59.563326+0000 mgr.gibba045.orlgmj (mgr.34412) 7979 : cluster [DBG] pgmap v4545: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:01.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:20:00 gibba045 bash[25517]: cluster 2021-03-10T16:20:00.000478+0000 mon.a (mon.0) 1835 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T16:20:03.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:20:02 gibba015 bash[29377]: cluster 2021-03-10T16:20:01.565130+0000 mgr.gibba045.orlgmj (mgr.34412) 7980 : cluster [DBG] pgmap v4546: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:03.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:20:02 gibba015 bash[29377]: cephadm 2021-03-10T16:20:02.110700+0000 mgr.gibba045.orlgmj (mgr.34412) 7981 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:20:03.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:20:02 gibba015 bash[30343]: cluster 2021-03-10T16:20:01.565130+0000 mgr.gibba045.orlgmj (mgr.34412) 7980 : cluster [DBG] pgmap v4546: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:03.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:20:02 gibba015 bash[30343]: cephadm 2021-03-10T16:20:02.110700+0000 mgr.gibba045.orlgmj (mgr.34412) 7981 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:20:03.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:20:02 gibba045 bash[25517]: cluster 2021-03-10T16:20:01.565130+0000 mgr.gibba045.orlgmj (mgr.34412) 7980 : cluster [DBG] pgmap v4546: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:03.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:20:02 gibba045 bash[25517]: cephadm 2021-03-10T16:20:02.110700+0000 mgr.gibba045.orlgmj (mgr.34412) 7981 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:20:05.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:20:04 gibba015 bash[29377]: cluster 2021-03-10T16:20:03.566582+0000 mgr.gibba045.orlgmj (mgr.34412) 7982 : cluster [DBG] pgmap v4547: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:05.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:20:04 gibba015 bash[30343]: cluster 2021-03-10T16:20:03.566582+0000 mgr.gibba045.orlgmj (mgr.34412) 7982 : cluster [DBG] pgmap v4547: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:05.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:20:04 gibba045 bash[25517]: cluster 2021-03-10T16:20:03.566582+0000 mgr.gibba045.orlgmj (mgr.34412) 7982 : cluster [DBG] pgmap v4547: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:07.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:20:06 gibba015 bash[29377]: cluster 2021-03-10T16:20:05.568177+0000 mgr.gibba045.orlgmj (mgr.34412) 7983 : cluster [DBG] pgmap v4548: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:07.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:20:06 gibba015 bash[30343]: cluster 2021-03-10T16:20:05.568177+0000 mgr.gibba045.orlgmj (mgr.34412) 7983 : cluster [DBG] pgmap v4548: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:07.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:20:06 gibba045 bash[25517]: cluster 2021-03-10T16:20:05.568177+0000 mgr.gibba045.orlgmj (mgr.34412) 7983 : cluster [DBG] pgmap v4548: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:09.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:20:08 gibba015 bash[29377]: cluster 2021-03-10T16:20:07.569936+0000 mgr.gibba045.orlgmj (mgr.34412) 7984 : cluster [DBG] pgmap v4549: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:09.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:20:08 gibba015 bash[30343]: cluster 2021-03-10T16:20:07.569936+0000 mgr.gibba045.orlgmj (mgr.34412) 7984 : cluster [DBG] pgmap v4549: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:09.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:20:08 gibba045 bash[25517]: cluster 2021-03-10T16:20:07.569936+0000 mgr.gibba045.orlgmj (mgr.34412) 7984 : cluster [DBG] pgmap v4549: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:11.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:20:10 gibba015 bash[29377]: cluster 2021-03-10T16:20:09.571310+0000 mgr.gibba045.orlgmj (mgr.34412) 7985 : cluster [DBG] pgmap v4550: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:11.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:20:10 gibba015 bash[30343]: cluster 2021-03-10T16:20:09.571310+0000 mgr.gibba045.orlgmj (mgr.34412) 7985 : cluster [DBG] pgmap v4550: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:11.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:20:10 gibba045 bash[25517]: cluster 2021-03-10T16:20:09.571310+0000 mgr.gibba045.orlgmj (mgr.34412) 7985 : cluster [DBG] pgmap v4550: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:12.749 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:20:12.988 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:20:12.988 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 4m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:20:12.988 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 3m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:20:12.989 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:20:12.989 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:20:12.989 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:20:12.989 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:20:12.990 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:20:12.990 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:20:12.990 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 4m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:20:12.990 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 3m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:20:12.991 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:20:12.991 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:20:12.991 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:20:12.991 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:20:12.992 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:20:12.992 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:20:12.992 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:20:12.992 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:20:12.993 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 3m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:20:12.993 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 3m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:20:13.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:20:12 gibba015 bash[29377]: cluster 2021-03-10T16:20:11.572838+0000 mgr.gibba045.orlgmj (mgr.34412) 7986 : cluster [DBG] pgmap v4551: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:13.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:20:12 gibba015 bash[30343]: cluster 2021-03-10T16:20:11.572838+0000 mgr.gibba045.orlgmj (mgr.34412) 7986 : cluster [DBG] pgmap v4551: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:13.234 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:20:13.235 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:20:13.235 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:20:13.235 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:20:13.235 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:20:13.236 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:20:13.236 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:20:13.236 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:20:13.236 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:20:13.237 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:20:13.237 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:20:13.237 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:20:13.237 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:20:13.237 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:20:13.238 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:20:13.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:20:12 gibba045 bash[25517]: cluster 2021-03-10T16:20:11.572838+0000 mgr.gibba045.orlgmj (mgr.34412) 7986 : cluster [DBG] pgmap v4551: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:14.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:20:13 gibba015 bash[29377]: audit 2021-03-10T16:20:12.743314+0000 mgr.gibba045.orlgmj (mgr.34412) 7987 : audit [DBG] from='client.59404 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:20:14.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:20:13 gibba015 bash[29377]: audit 2021-03-10T16:20:12.966220+0000 mgr.gibba045.orlgmj (mgr.34412) 7988 : audit [DBG] from='client.59410 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:20:14.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:20:13 gibba015 bash[29377]: audit 2021-03-10T16:20:13.235061+0000 mon.c (mon.1) 2213 : audit [DBG] from='client.? 172.21.2.115:0/3085645733' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:20:14.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:20:13 gibba015 bash[30343]: audit 2021-03-10T16:20:12.743314+0000 mgr.gibba045.orlgmj (mgr.34412) 7987 : audit [DBG] from='client.59404 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:20:14.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:20:13 gibba015 bash[30343]: audit 2021-03-10T16:20:12.966220+0000 mgr.gibba045.orlgmj (mgr.34412) 7988 : audit [DBG] from='client.59410 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:20:14.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:20:13 gibba015 bash[30343]: audit 2021-03-10T16:20:13.235061+0000 mon.c (mon.1) 2213 : audit [DBG] from='client.? 172.21.2.115:0/3085645733' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:20:14.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:20:13 gibba045 bash[25517]: audit 2021-03-10T16:20:12.743314+0000 mgr.gibba045.orlgmj (mgr.34412) 7987 : audit [DBG] from='client.59404 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:20:14.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:20:13 gibba045 bash[25517]: audit 2021-03-10T16:20:12.966220+0000 mgr.gibba045.orlgmj (mgr.34412) 7988 : audit [DBG] from='client.59410 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:20:14.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:20:13 gibba045 bash[25517]: audit 2021-03-10T16:20:13.235061+0000 mon.c (mon.1) 2213 : audit [DBG] from='client.? 172.21.2.115:0/3085645733' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:20:15.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:20:14 gibba015 bash[29377]: cluster 2021-03-10T16:20:13.574229+0000 mgr.gibba045.orlgmj (mgr.34412) 7989 : cluster [DBG] pgmap v4552: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:15.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:20:14 gibba015 bash[30343]: cluster 2021-03-10T16:20:13.574229+0000 mgr.gibba045.orlgmj (mgr.34412) 7989 : cluster [DBG] pgmap v4552: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:15.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:20:14 gibba045 bash[25517]: cluster 2021-03-10T16:20:13.574229+0000 mgr.gibba045.orlgmj (mgr.34412) 7989 : cluster [DBG] pgmap v4552: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:17.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:20:16 gibba015 bash[29377]: cluster 2021-03-10T16:20:15.575997+0000 mgr.gibba045.orlgmj (mgr.34412) 7990 : cluster [DBG] pgmap v4553: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:17.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:20:16 gibba015 bash[30343]: cluster 2021-03-10T16:20:15.575997+0000 mgr.gibba045.orlgmj (mgr.34412) 7990 : cluster [DBG] pgmap v4553: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:17.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:20:16 gibba045 bash[25517]: cluster 2021-03-10T16:20:15.575997+0000 mgr.gibba045.orlgmj (mgr.34412) 7990 : cluster [DBG] pgmap v4553: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:18.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:20:17 gibba015 bash[29377]: audit 2021-03-10T16:20:17.125259+0000 mon.c (mon.1) 2214 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:20:18.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:20:17 gibba015 bash[29377]: cephadm 2021-03-10T16:20:17.133049+0000 mgr.gibba045.orlgmj (mgr.34412) 7991 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:20:18.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:20:17 gibba015 bash[29377]: cephadm 2021-03-10T16:20:17.134834+0000 mgr.gibba045.orlgmj (mgr.34412) 7992 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:20:18.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:20:17 gibba015 bash[29377]: audit 2021-03-10T16:20:17.357378+0000 mon.a (mon.0) 1836 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:20:18.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:20:17 gibba015 bash[29377]: audit 2021-03-10T16:20:17.361206+0000 mon.c (mon.1) 2215 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:20:18.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:20:17 gibba015 bash[29377]: audit 2021-03-10T16:20:17.362893+0000 mon.c (mon.1) 2216 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:20:18.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:20:17 gibba015 bash[29377]: audit 2021-03-10T16:20:17.364639+0000 mon.c (mon.1) 2217 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:20:18.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:20:17 gibba015 bash[29377]: audit 2021-03-10T16:20:17.365915+0000 mon.c (mon.1) 2218 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:20:18.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:20:17 gibba015 bash[29377]: audit 2021-03-10T16:20:17.370040+0000 mon.c (mon.1) 2219 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:20:18.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:20:17 gibba015 bash[29377]: audit 2021-03-10T16:20:17.372506+0000 mon.c (mon.1) 2220 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:20:18.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:20:17 gibba015 bash[30343]: audit 2021-03-10T16:20:17.125259+0000 mon.c (mon.1) 2214 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:20:18.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:20:17 gibba015 bash[30343]: cephadm 2021-03-10T16:20:17.133049+0000 mgr.gibba045.orlgmj (mgr.34412) 7991 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:20:18.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:20:17 gibba015 bash[30343]: cephadm 2021-03-10T16:20:17.134834+0000 mgr.gibba045.orlgmj (mgr.34412) 7992 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:20:18.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:20:17 gibba015 bash[30343]: audit 2021-03-10T16:20:17.357378+0000 mon.a (mon.0) 1836 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:20:18.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:20:17 gibba015 bash[30343]: audit 2021-03-10T16:20:17.361206+0000 mon.c (mon.1) 2215 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:20:18.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:20:17 gibba015 bash[30343]: audit 2021-03-10T16:20:17.362893+0000 mon.c (mon.1) 2216 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:20:18.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:20:17 gibba015 bash[30343]: audit 2021-03-10T16:20:17.364639+0000 mon.c (mon.1) 2217 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:20:18.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:20:17 gibba015 bash[30343]: audit 2021-03-10T16:20:17.365915+0000 mon.c (mon.1) 2218 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:20:18.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:20:17 gibba015 bash[30343]: audit 2021-03-10T16:20:17.370040+0000 mon.c (mon.1) 2219 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:20:18.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:20:17 gibba015 bash[30343]: audit 2021-03-10T16:20:17.372506+0000 mon.c (mon.1) 2220 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:20:18.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:20:17 gibba045 bash[25517]: audit 2021-03-10T16:20:17.125259+0000 mon.c (mon.1) 2214 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:20:18.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:20:17 gibba045 bash[25517]: cephadm 2021-03-10T16:20:17.133049+0000 mgr.gibba045.orlgmj (mgr.34412) 7991 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:20:18.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:20:17 gibba045 bash[25517]: cephadm 2021-03-10T16:20:17.134834+0000 mgr.gibba045.orlgmj (mgr.34412) 7992 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:20:18.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:20:17 gibba045 bash[25517]: audit 2021-03-10T16:20:17.357378+0000 mon.a (mon.0) 1836 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:20:18.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:20:17 gibba045 bash[25517]: audit 2021-03-10T16:20:17.361206+0000 mon.c (mon.1) 2215 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:20:18.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:20:17 gibba045 bash[25517]: audit 2021-03-10T16:20:17.362893+0000 mon.c (mon.1) 2216 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:20:18.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:20:17 gibba045 bash[25517]: audit 2021-03-10T16:20:17.364639+0000 mon.c (mon.1) 2217 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:20:18.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:20:17 gibba045 bash[25517]: audit 2021-03-10T16:20:17.365915+0000 mon.c (mon.1) 2218 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:20:18.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:20:17 gibba045 bash[25517]: audit 2021-03-10T16:20:17.370040+0000 mon.c (mon.1) 2219 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:20:18.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:20:17 gibba045 bash[25517]: audit 2021-03-10T16:20:17.372506+0000 mon.c (mon.1) 2220 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:20:19.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:20:18 gibba015 bash[29377]: cephadm 2021-03-10T16:20:17.362804+0000 mgr.gibba045.orlgmj (mgr.34412) 7993 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:20:19.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:20:18 gibba015 bash[29377]: cephadm 2021-03-10T16:20:17.365025+0000 mgr.gibba045.orlgmj (mgr.34412) 7994 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:20:19.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:20:18 gibba015 bash[29377]: cephadm 2021-03-10T16:20:17.366574+0000 mgr.gibba045.orlgmj (mgr.34412) 7995 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:20:19.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:20:18 gibba015 bash[29377]: cephadm 2021-03-10T16:20:17.366672+0000 mgr.gibba045.orlgmj (mgr.34412) 7996 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:20:19.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:20:18 gibba015 bash[29377]: cephadm 2021-03-10T16:20:17.367934+0000 mgr.gibba045.orlgmj (mgr.34412) 7997 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:20:19.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:20:18 gibba015 bash[29377]: cephadm 2021-03-10T16:20:17.367996+0000 mgr.gibba045.orlgmj (mgr.34412) 7998 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:20:19.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:20:18 gibba015 bash[29377]: cephadm 2021-03-10T16:20:17.369556+0000 mgr.gibba045.orlgmj (mgr.34412) 7999 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:20:19.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:20:18 gibba015 bash[29377]: cephadm 2021-03-10T16:20:17.371819+0000 mgr.gibba045.orlgmj (mgr.34412) 8000 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:20:19.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:20:18 gibba015 bash[29377]: cephadm 2021-03-10T16:20:17.371917+0000 mgr.gibba045.orlgmj (mgr.34412) 8001 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:20:19.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:20:18 gibba015 bash[29377]: cephadm 2021-03-10T16:20:17.373977+0000 mgr.gibba045.orlgmj (mgr.34412) 8002 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:20:19.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:20:18 gibba015 bash[29377]: cephadm 2021-03-10T16:20:17.374555+0000 mgr.gibba045.orlgmj (mgr.34412) 8003 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:20:19.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:20:18 gibba015 bash[29377]: cephadm 2021-03-10T16:20:17.376052+0000 mgr.gibba045.orlgmj (mgr.34412) 8004 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:20:19.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:20:18 gibba015 bash[29377]: cephadm 2021-03-10T16:20:17.376125+0000 mgr.gibba045.orlgmj (mgr.34412) 8005 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:20:19.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:20:18 gibba015 bash[29377]: cephadm 2021-03-10T16:20:17.376285+0000 mgr.gibba045.orlgmj (mgr.34412) 8006 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:20:19.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:20:18 gibba015 bash[29377]: cluster 2021-03-10T16:20:17.577890+0000 mgr.gibba045.orlgmj (mgr.34412) 8007 : cluster [DBG] pgmap v4554: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:19.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:20:18 gibba015 bash[30343]: cephadm 2021-03-10T16:20:17.362804+0000 mgr.gibba045.orlgmj (mgr.34412) 7993 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:20:19.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:20:18 gibba015 bash[30343]: cephadm 2021-03-10T16:20:17.365025+0000 mgr.gibba045.orlgmj (mgr.34412) 7994 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:20:19.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:20:18 gibba015 bash[30343]: cephadm 2021-03-10T16:20:17.366574+0000 mgr.gibba045.orlgmj (mgr.34412) 7995 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:20:19.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:20:18 gibba015 bash[30343]: cephadm 2021-03-10T16:20:17.366672+0000 mgr.gibba045.orlgmj (mgr.34412) 7996 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:20:19.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:20:18 gibba015 bash[30343]: cephadm 2021-03-10T16:20:17.367934+0000 mgr.gibba045.orlgmj (mgr.34412) 7997 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:20:19.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:20:18 gibba015 bash[30343]: cephadm 2021-03-10T16:20:17.367996+0000 mgr.gibba045.orlgmj (mgr.34412) 7998 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:20:19.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:20:18 gibba015 bash[30343]: cephadm 2021-03-10T16:20:17.369556+0000 mgr.gibba045.orlgmj (mgr.34412) 7999 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:20:19.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:20:18 gibba015 bash[30343]: cephadm 2021-03-10T16:20:17.371819+0000 mgr.gibba045.orlgmj (mgr.34412) 8000 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:20:19.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:20:18 gibba015 bash[30343]: cephadm 2021-03-10T16:20:17.371917+0000 mgr.gibba045.orlgmj (mgr.34412) 8001 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:20:19.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:20:18 gibba015 bash[30343]: cephadm 2021-03-10T16:20:17.373977+0000 mgr.gibba045.orlgmj (mgr.34412) 8002 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:20:19.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:20:18 gibba015 bash[30343]: cephadm 2021-03-10T16:20:17.374555+0000 mgr.gibba045.orlgmj (mgr.34412) 8003 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:20:19.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:20:18 gibba015 bash[30343]: cephadm 2021-03-10T16:20:17.376052+0000 mgr.gibba045.orlgmj (mgr.34412) 8004 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:20:19.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:20:18 gibba015 bash[30343]: cephadm 2021-03-10T16:20:17.376125+0000 mgr.gibba045.orlgmj (mgr.34412) 8005 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:20:19.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:20:18 gibba015 bash[30343]: cephadm 2021-03-10T16:20:17.376285+0000 mgr.gibba045.orlgmj (mgr.34412) 8006 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:20:19.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:20:18 gibba015 bash[30343]: cluster 2021-03-10T16:20:17.577890+0000 mgr.gibba045.orlgmj (mgr.34412) 8007 : cluster [DBG] pgmap v4554: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:19.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:20:18 gibba045 bash[25517]: cephadm 2021-03-10T16:20:17.362804+0000 mgr.gibba045.orlgmj (mgr.34412) 7993 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:20:19.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:20:18 gibba045 bash[25517]: cephadm 2021-03-10T16:20:17.365025+0000 mgr.gibba045.orlgmj (mgr.34412) 7994 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:20:19.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:20:18 gibba045 bash[25517]: cephadm 2021-03-10T16:20:17.366574+0000 mgr.gibba045.orlgmj (mgr.34412) 7995 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:20:19.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:20:18 gibba045 bash[25517]: cephadm 2021-03-10T16:20:17.366672+0000 mgr.gibba045.orlgmj (mgr.34412) 7996 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:20:19.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:20:18 gibba045 bash[25517]: cephadm 2021-03-10T16:20:17.367934+0000 mgr.gibba045.orlgmj (mgr.34412) 7997 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:20:19.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:20:18 gibba045 bash[25517]: cephadm 2021-03-10T16:20:17.367996+0000 mgr.gibba045.orlgmj (mgr.34412) 7998 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:20:19.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:20:18 gibba045 bash[25517]: cephadm 2021-03-10T16:20:17.369556+0000 mgr.gibba045.orlgmj (mgr.34412) 7999 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:20:19.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:20:18 gibba045 bash[25517]: cephadm 2021-03-10T16:20:17.371819+0000 mgr.gibba045.orlgmj (mgr.34412) 8000 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:20:19.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:20:18 gibba045 bash[25517]: cephadm 2021-03-10T16:20:17.371917+0000 mgr.gibba045.orlgmj (mgr.34412) 8001 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:20:19.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:20:18 gibba045 bash[25517]: cephadm 2021-03-10T16:20:17.373977+0000 mgr.gibba045.orlgmj (mgr.34412) 8002 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:20:19.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:20:18 gibba045 bash[25517]: cephadm 2021-03-10T16:20:17.374555+0000 mgr.gibba045.orlgmj (mgr.34412) 8003 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:20:19.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:20:18 gibba045 bash[25517]: cephadm 2021-03-10T16:20:17.376052+0000 mgr.gibba045.orlgmj (mgr.34412) 8004 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:20:19.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:20:18 gibba045 bash[25517]: cephadm 2021-03-10T16:20:17.376125+0000 mgr.gibba045.orlgmj (mgr.34412) 8005 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:20:19.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:20:18 gibba045 bash[25517]: cephadm 2021-03-10T16:20:17.376285+0000 mgr.gibba045.orlgmj (mgr.34412) 8006 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:20:19.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:20:18 gibba045 bash[25517]: cluster 2021-03-10T16:20:17.577890+0000 mgr.gibba045.orlgmj (mgr.34412) 8007 : cluster [DBG] pgmap v4554: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:21.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:20:20 gibba015 bash[29377]: cluster 2021-03-10T16:20:19.579553+0000 mgr.gibba045.orlgmj (mgr.34412) 8008 : cluster [DBG] pgmap v4555: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:21.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:20:20 gibba015 bash[30343]: cluster 2021-03-10T16:20:19.579553+0000 mgr.gibba045.orlgmj (mgr.34412) 8008 : cluster [DBG] pgmap v4555: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:21.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:20:20 gibba045 bash[25517]: cluster 2021-03-10T16:20:19.579553+0000 mgr.gibba045.orlgmj (mgr.34412) 8008 : cluster [DBG] pgmap v4555: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:23.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:20:22 gibba015 bash[29377]: cluster 2021-03-10T16:20:21.581358+0000 mgr.gibba045.orlgmj (mgr.34412) 8009 : cluster [DBG] pgmap v4556: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:23.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:20:22 gibba015 bash[30343]: cluster 2021-03-10T16:20:21.581358+0000 mgr.gibba045.orlgmj (mgr.34412) 8009 : cluster [DBG] pgmap v4556: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:23.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:20:22 gibba045 bash[25517]: cluster 2021-03-10T16:20:21.581358+0000 mgr.gibba045.orlgmj (mgr.34412) 8009 : cluster [DBG] pgmap v4556: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:25.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:20:24 gibba015 bash[29377]: cluster 2021-03-10T16:20:23.582692+0000 mgr.gibba045.orlgmj (mgr.34412) 8010 : cluster [DBG] pgmap v4557: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:25.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:20:24 gibba015 bash[30343]: cluster 2021-03-10T16:20:23.582692+0000 mgr.gibba045.orlgmj (mgr.34412) 8010 : cluster [DBG] pgmap v4557: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:25.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:20:24 gibba045 bash[25517]: cluster 2021-03-10T16:20:23.582692+0000 mgr.gibba045.orlgmj (mgr.34412) 8010 : cluster [DBG] pgmap v4557: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:27.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:20:26 gibba015 bash[29377]: cluster 2021-03-10T16:20:25.584235+0000 mgr.gibba045.orlgmj (mgr.34412) 8011 : cluster [DBG] pgmap v4558: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:27.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:20:26 gibba015 bash[30343]: cluster 2021-03-10T16:20:25.584235+0000 mgr.gibba045.orlgmj (mgr.34412) 8011 : cluster [DBG] pgmap v4558: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:27.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:20:26 gibba045 bash[25517]: cluster 2021-03-10T16:20:25.584235+0000 mgr.gibba045.orlgmj (mgr.34412) 8011 : cluster [DBG] pgmap v4558: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:29.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:20:28 gibba015 bash[29377]: cluster 2021-03-10T16:20:27.585986+0000 mgr.gibba045.orlgmj (mgr.34412) 8012 : cluster [DBG] pgmap v4559: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:29.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:20:28 gibba015 bash[30343]: cluster 2021-03-10T16:20:27.585986+0000 mgr.gibba045.orlgmj (mgr.34412) 8012 : cluster [DBG] pgmap v4559: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:29.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:20:28 gibba045 bash[25517]: cluster 2021-03-10T16:20:27.585986+0000 mgr.gibba045.orlgmj (mgr.34412) 8012 : cluster [DBG] pgmap v4559: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:31.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:20:30 gibba045 bash[25517]: cluster 2021-03-10T16:20:29.587608+0000 mgr.gibba045.orlgmj (mgr.34412) 8013 : cluster [DBG] pgmap v4560: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:31.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:20:30 gibba015 bash[29377]: cluster 2021-03-10T16:20:29.587608+0000 mgr.gibba045.orlgmj (mgr.34412) 8013 : cluster [DBG] pgmap v4560: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:31.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:20:30 gibba015 bash[30343]: cluster 2021-03-10T16:20:29.587608+0000 mgr.gibba045.orlgmj (mgr.34412) 8013 : cluster [DBG] pgmap v4560: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:33.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:20:32 gibba045 bash[25517]: cluster 2021-03-10T16:20:31.589283+0000 mgr.gibba045.orlgmj (mgr.34412) 8014 : cluster [DBG] pgmap v4561: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:33.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:20:32 gibba015 bash[29377]: cluster 2021-03-10T16:20:31.589283+0000 mgr.gibba045.orlgmj (mgr.34412) 8014 : cluster [DBG] pgmap v4561: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:33.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:20:32 gibba015 bash[30343]: cluster 2021-03-10T16:20:31.589283+0000 mgr.gibba045.orlgmj (mgr.34412) 8014 : cluster [DBG] pgmap v4561: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:34.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:20:34 gibba045 bash[25517]: cephadm 2021-03-10T16:20:32.392256+0000 mgr.gibba045.orlgmj (mgr.34412) 8015 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:20:34.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:20:33 gibba015 bash[29377]: cephadm 2021-03-10T16:20:32.392256+0000 mgr.gibba045.orlgmj (mgr.34412) 8015 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:20:34.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:20:33 gibba015 bash[30343]: cephadm 2021-03-10T16:20:32.392256+0000 mgr.gibba045.orlgmj (mgr.34412) 8015 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:20:35.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:20:35 gibba045 bash[25517]: cluster 2021-03-10T16:20:33.590744+0000 mgr.gibba045.orlgmj (mgr.34412) 8016 : cluster [DBG] pgmap v4562: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:35.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:20:35 gibba015 bash[29377]: cluster 2021-03-10T16:20:33.590744+0000 mgr.gibba045.orlgmj (mgr.34412) 8016 : cluster [DBG] pgmap v4562: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:35.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:20:35 gibba015 bash[30343]: cluster 2021-03-10T16:20:33.590744+0000 mgr.gibba045.orlgmj (mgr.34412) 8016 : cluster [DBG] pgmap v4562: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:37.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:20:37 gibba045 bash[25517]: cluster 2021-03-10T16:20:35.592419+0000 mgr.gibba045.orlgmj (mgr.34412) 8017 : cluster [DBG] pgmap v4563: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:37.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:20:37 gibba015 bash[29377]: cluster 2021-03-10T16:20:35.592419+0000 mgr.gibba045.orlgmj (mgr.34412) 8017 : cluster [DBG] pgmap v4563: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:37.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:20:37 gibba015 bash[30343]: cluster 2021-03-10T16:20:35.592419+0000 mgr.gibba045.orlgmj (mgr.34412) 8017 : cluster [DBG] pgmap v4563: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:39.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:20:39 gibba045 bash[25517]: cluster 2021-03-10T16:20:37.594352+0000 mgr.gibba045.orlgmj (mgr.34412) 8018 : cluster [DBG] pgmap v4564: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:39.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:20:39 gibba015 bash[29377]: cluster 2021-03-10T16:20:37.594352+0000 mgr.gibba045.orlgmj (mgr.34412) 8018 : cluster [DBG] pgmap v4564: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:39.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:20:39 gibba015 bash[30343]: cluster 2021-03-10T16:20:37.594352+0000 mgr.gibba045.orlgmj (mgr.34412) 8018 : cluster [DBG] pgmap v4564: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:41.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:20:41 gibba045 bash[25517]: cluster 2021-03-10T16:20:39.596183+0000 mgr.gibba045.orlgmj (mgr.34412) 8019 : cluster [DBG] pgmap v4565: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:41.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:20:41 gibba015 bash[29377]: cluster 2021-03-10T16:20:39.596183+0000 mgr.gibba045.orlgmj (mgr.34412) 8019 : cluster [DBG] pgmap v4565: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:41.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:20:41 gibba015 bash[30343]: cluster 2021-03-10T16:20:39.596183+0000 mgr.gibba045.orlgmj (mgr.34412) 8019 : cluster [DBG] pgmap v4565: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:43.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:20:43 gibba045 bash[25517]: cluster 2021-03-10T16:20:41.598241+0000 mgr.gibba045.orlgmj (mgr.34412) 8020 : cluster [DBG] pgmap v4566: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:43.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:20:43 gibba015 bash[29377]: cluster 2021-03-10T16:20:41.598241+0000 mgr.gibba045.orlgmj (mgr.34412) 8020 : cluster [DBG] pgmap v4566: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:43.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:20:43 gibba015 bash[30343]: cluster 2021-03-10T16:20:41.598241+0000 mgr.gibba045.orlgmj (mgr.34412) 8020 : cluster [DBG] pgmap v4566: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:43.477 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:20:43.706 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:20:43.706 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 4m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:20:43.706 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 3m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:20:43.707 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:20:43.707 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:20:43.707 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:20:43.707 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:20:43.707 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:20:43.708 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:20:43.708 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 4m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:20:43.708 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 3m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:20:43.708 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:20:43.709 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:20:43.709 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:20:43.709 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:20:43.709 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:20:43.709 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:20:43.710 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:20:43.710 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:20:43.710 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 3m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:20:43.710 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 3m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:20:43.952 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:20:43.952 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:20:43.953 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:20:43.953 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:20:43.953 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:20:43.953 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:20:43.954 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:20:43.954 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:20:43.954 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:20:43.954 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:20:43.955 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:20:43.955 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:20:43.955 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:20:43.955 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:20:43.956 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:20:44.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:20:44 gibba045 bash[25517]: audit 2021-03-10T16:20:43.952742+0000 mon.c (mon.1) 2221 : audit [DBG] from='client.? 172.21.2.115:0/1271221679' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:20:44.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:20:44 gibba015 bash[29377]: audit 2021-03-10T16:20:43.952742+0000 mon.c (mon.1) 2221 : audit [DBG] from='client.? 172.21.2.115:0/1271221679' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:20:44.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:20:44 gibba015 bash[30343]: audit 2021-03-10T16:20:43.952742+0000 mon.c (mon.1) 2221 : audit [DBG] from='client.? 172.21.2.115:0/1271221679' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:20:45.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:20:45 gibba015 bash[29377]: audit 2021-03-10T16:20:43.471672+0000 mgr.gibba045.orlgmj (mgr.34412) 8021 : audit [DBG] from='client.59422 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:20:45.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:20:45 gibba015 bash[29377]: cluster 2021-03-10T16:20:43.599660+0000 mgr.gibba045.orlgmj (mgr.34412) 8022 : cluster [DBG] pgmap v4567: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:45.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:20:45 gibba015 bash[29377]: audit 2021-03-10T16:20:43.696422+0000 mgr.gibba045.orlgmj (mgr.34412) 8023 : audit [DBG] from='client.59428 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:20:45.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:20:45 gibba015 bash[30343]: audit 2021-03-10T16:20:43.471672+0000 mgr.gibba045.orlgmj (mgr.34412) 8021 : audit [DBG] from='client.59422 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:20:45.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:20:45 gibba015 bash[30343]: cluster 2021-03-10T16:20:43.599660+0000 mgr.gibba045.orlgmj (mgr.34412) 8022 : cluster [DBG] pgmap v4567: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:45.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:20:45 gibba015 bash[30343]: audit 2021-03-10T16:20:43.696422+0000 mgr.gibba045.orlgmj (mgr.34412) 8023 : audit [DBG] from='client.59428 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:20:45.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:20:45 gibba045 bash[25517]: audit 2021-03-10T16:20:43.471672+0000 mgr.gibba045.orlgmj (mgr.34412) 8021 : audit [DBG] from='client.59422 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:20:45.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:20:45 gibba045 bash[25517]: cluster 2021-03-10T16:20:43.599660+0000 mgr.gibba045.orlgmj (mgr.34412) 8022 : cluster [DBG] pgmap v4567: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:45.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:20:45 gibba045 bash[25517]: audit 2021-03-10T16:20:43.696422+0000 mgr.gibba045.orlgmj (mgr.34412) 8023 : audit [DBG] from='client.59428 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:20:47.391 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:20:47 gibba045 bash[25517]: cluster 2021-03-10T16:20:45.601460+0000 mgr.gibba045.orlgmj (mgr.34412) 8024 : cluster [DBG] pgmap v4568: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:47.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:20:47 gibba015 bash[29377]: cluster 2021-03-10T16:20:45.601460+0000 mgr.gibba045.orlgmj (mgr.34412) 8024 : cluster [DBG] pgmap v4568: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:47.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:20:47 gibba015 bash[30343]: cluster 2021-03-10T16:20:45.601460+0000 mgr.gibba045.orlgmj (mgr.34412) 8024 : cluster [DBG] pgmap v4568: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:49.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:20:49 gibba015 bash[29377]: cephadm 2021-03-10T16:20:47.393429+0000 mgr.gibba045.orlgmj (mgr.34412) 8025 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:20:49.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:20:49 gibba015 bash[29377]: cluster 2021-03-10T16:20:47.603132+0000 mgr.gibba045.orlgmj (mgr.34412) 8026 : cluster [DBG] pgmap v4569: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:49.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:20:49 gibba015 bash[30343]: cephadm 2021-03-10T16:20:47.393429+0000 mgr.gibba045.orlgmj (mgr.34412) 8025 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:20:49.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:20:49 gibba015 bash[30343]: cluster 2021-03-10T16:20:47.603132+0000 mgr.gibba045.orlgmj (mgr.34412) 8026 : cluster [DBG] pgmap v4569: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:49.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:20:49 gibba045 bash[25517]: cephadm 2021-03-10T16:20:47.393429+0000 mgr.gibba045.orlgmj (mgr.34412) 8025 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:20:49.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:20:49 gibba045 bash[25517]: cluster 2021-03-10T16:20:47.603132+0000 mgr.gibba045.orlgmj (mgr.34412) 8026 : cluster [DBG] pgmap v4569: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:51.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:20:51 gibba015 bash[29377]: cluster 2021-03-10T16:20:49.604728+0000 mgr.gibba045.orlgmj (mgr.34412) 8027 : cluster [DBG] pgmap v4570: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:51.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:20:51 gibba015 bash[30343]: cluster 2021-03-10T16:20:49.604728+0000 mgr.gibba045.orlgmj (mgr.34412) 8027 : cluster [DBG] pgmap v4570: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:51.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:20:51 gibba045 bash[25517]: cluster 2021-03-10T16:20:49.604728+0000 mgr.gibba045.orlgmj (mgr.34412) 8027 : cluster [DBG] pgmap v4570: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:53.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:20:53 gibba015 bash[29377]: cluster 2021-03-10T16:20:51.606472+0000 mgr.gibba045.orlgmj (mgr.34412) 8028 : cluster [DBG] pgmap v4571: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:53.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:20:53 gibba015 bash[30343]: cluster 2021-03-10T16:20:51.606472+0000 mgr.gibba045.orlgmj (mgr.34412) 8028 : cluster [DBG] pgmap v4571: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:53.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:20:53 gibba045 bash[25517]: cluster 2021-03-10T16:20:51.606472+0000 mgr.gibba045.orlgmj (mgr.34412) 8028 : cluster [DBG] pgmap v4571: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:54.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:20:54 gibba015 bash[29377]: audit 2021-03-10T16:20:53.523813+0000 mon.c (mon.1) 2222 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:20:54.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:20:54 gibba015 bash[29377]: audit 2021-03-10T16:20:53.524454+0000 mon.c (mon.1) 2223 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:20:54.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:20:54 gibba015 bash[29377]: audit 2021-03-10T16:20:53.525090+0000 mon.a (mon.0) 1837 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:20:54.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:20:54 gibba015 bash[29377]: audit 2021-03-10T16:20:53.526268+0000 mon.a (mon.0) 1838 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:20:54.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:20:54 gibba015 bash[29377]: audit 2021-03-10T16:20:53.526843+0000 mon.c (mon.1) 2224 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T16:20:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:20:54 gibba015 bash[29377]: audit 2021-03-10T16:20:53.527763+0000 mon.c (mon.1) 2225 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:20:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:20:54 gibba015 bash[29377]: audit 2021-03-10T16:20:53.528066+0000 mon.a (mon.0) 1839 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T16:20:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:20:54 gibba015 bash[29377]: audit 2021-03-10T16:20:53.528717+0000 mon.c (mon.1) 2226 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:20:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:20:54 gibba015 bash[29377]: audit 2021-03-10T16:20:53.529422+0000 mon.a (mon.0) 1840 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:20:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:20:54 gibba015 bash[29377]: audit 2021-03-10T16:20:53.529502+0000 mon.c (mon.1) 2227 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:20:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:20:54 gibba015 bash[29377]: audit 2021-03-10T16:20:53.529818+0000 mon.a (mon.0) 1841 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:20:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:20:54 gibba015 bash[29377]: audit 2021-03-10T16:20:53.530110+0000 mon.a (mon.0) 1842 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:20:54.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:20:54 gibba015 bash[30343]: audit 2021-03-10T16:20:53.523813+0000 mon.c (mon.1) 2222 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:20:54.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:20:54 gibba015 bash[30343]: audit 2021-03-10T16:20:53.524454+0000 mon.c (mon.1) 2223 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:20:54.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:20:54 gibba015 bash[30343]: audit 2021-03-10T16:20:53.525090+0000 mon.a (mon.0) 1837 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:20:54.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:20:54 gibba015 bash[30343]: audit 2021-03-10T16:20:53.526268+0000 mon.a (mon.0) 1838 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:20:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:20:54 gibba015 bash[30343]: audit 2021-03-10T16:20:53.526843+0000 mon.c (mon.1) 2224 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T16:20:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:20:54 gibba015 bash[30343]: audit 2021-03-10T16:20:53.527763+0000 mon.c (mon.1) 2225 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:20:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:20:54 gibba015 bash[30343]: audit 2021-03-10T16:20:53.528066+0000 mon.a (mon.0) 1839 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T16:20:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:20:54 gibba015 bash[30343]: audit 2021-03-10T16:20:53.528717+0000 mon.c (mon.1) 2226 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:20:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:20:54 gibba015 bash[30343]: audit 2021-03-10T16:20:53.529422+0000 mon.a (mon.0) 1840 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:20:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:20:54 gibba015 bash[30343]: audit 2021-03-10T16:20:53.529502+0000 mon.c (mon.1) 2227 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:20:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:20:54 gibba015 bash[30343]: audit 2021-03-10T16:20:53.529818+0000 mon.a (mon.0) 1841 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:20:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:20:54 gibba015 bash[30343]: audit 2021-03-10T16:20:53.530110+0000 mon.a (mon.0) 1842 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:20:54.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:20:54 gibba045 bash[25517]: audit 2021-03-10T16:20:53.523813+0000 mon.c (mon.1) 2222 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:20:54.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:20:54 gibba045 bash[25517]: audit 2021-03-10T16:20:53.524454+0000 mon.c (mon.1) 2223 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:20:54.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:20:54 gibba045 bash[25517]: audit 2021-03-10T16:20:53.525090+0000 mon.a (mon.0) 1837 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:20:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:20:54 gibba045 bash[25517]: audit 2021-03-10T16:20:53.526268+0000 mon.a (mon.0) 1838 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:20:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:20:54 gibba045 bash[25517]: audit 2021-03-10T16:20:53.526843+0000 mon.c (mon.1) 2224 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T16:20:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:20:54 gibba045 bash[25517]: audit 2021-03-10T16:20:53.527763+0000 mon.c (mon.1) 2225 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:20:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:20:54 gibba045 bash[25517]: audit 2021-03-10T16:20:53.528066+0000 mon.a (mon.0) 1839 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T16:20:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:20:54 gibba045 bash[25517]: audit 2021-03-10T16:20:53.528717+0000 mon.c (mon.1) 2226 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:20:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:20:54 gibba045 bash[25517]: audit 2021-03-10T16:20:53.529422+0000 mon.a (mon.0) 1840 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:20:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:20:54 gibba045 bash[25517]: audit 2021-03-10T16:20:53.529502+0000 mon.c (mon.1) 2227 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:20:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:20:54 gibba045 bash[25517]: audit 2021-03-10T16:20:53.529818+0000 mon.a (mon.0) 1841 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:20:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:20:54 gibba045 bash[25517]: audit 2021-03-10T16:20:53.530110+0000 mon.a (mon.0) 1842 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:20:55.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:20:55 gibba015 bash[29377]: cluster 2021-03-10T16:20:53.607759+0000 mgr.gibba045.orlgmj (mgr.34412) 8029 : cluster [DBG] pgmap v4572: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:55.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:20:55 gibba015 bash[30343]: cluster 2021-03-10T16:20:53.607759+0000 mgr.gibba045.orlgmj (mgr.34412) 8029 : cluster [DBG] pgmap v4572: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:55.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:20:55 gibba045 bash[25517]: cluster 2021-03-10T16:20:53.607759+0000 mgr.gibba045.orlgmj (mgr.34412) 8029 : cluster [DBG] pgmap v4572: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:57.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:20:57 gibba015 bash[29377]: cluster 2021-03-10T16:20:55.609443+0000 mgr.gibba045.orlgmj (mgr.34412) 8030 : cluster [DBG] pgmap v4573: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:57.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:20:57 gibba015 bash[30343]: cluster 2021-03-10T16:20:55.609443+0000 mgr.gibba045.orlgmj (mgr.34412) 8030 : cluster [DBG] pgmap v4573: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:57.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:20:57 gibba045 bash[25517]: cluster 2021-03-10T16:20:55.609443+0000 mgr.gibba045.orlgmj (mgr.34412) 8030 : cluster [DBG] pgmap v4573: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:59.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:20:59 gibba015 bash[29377]: cluster 2021-03-10T16:20:57.611067+0000 mgr.gibba045.orlgmj (mgr.34412) 8031 : cluster [DBG] pgmap v4574: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:59.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:20:59 gibba015 bash[30343]: cluster 2021-03-10T16:20:57.611067+0000 mgr.gibba045.orlgmj (mgr.34412) 8031 : cluster [DBG] pgmap v4574: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:59.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:20:59 gibba045 bash[25517]: cluster 2021-03-10T16:20:57.611067+0000 mgr.gibba045.orlgmj (mgr.34412) 8031 : cluster [DBG] pgmap v4574: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:01.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:21:01 gibba015 bash[29377]: cluster 2021-03-10T16:20:59.612604+0000 mgr.gibba045.orlgmj (mgr.34412) 8032 : cluster [DBG] pgmap v4575: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:01.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:21:01 gibba015 bash[30343]: cluster 2021-03-10T16:20:59.612604+0000 mgr.gibba045.orlgmj (mgr.34412) 8032 : cluster [DBG] pgmap v4575: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:01.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:21:01 gibba045 bash[25517]: cluster 2021-03-10T16:20:59.612604+0000 mgr.gibba045.orlgmj (mgr.34412) 8032 : cluster [DBG] pgmap v4575: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:03.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:21:03 gibba015 bash[29377]: cluster 2021-03-10T16:21:01.614439+0000 mgr.gibba045.orlgmj (mgr.34412) 8033 : cluster [DBG] pgmap v4576: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:03.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:21:03 gibba015 bash[30343]: cluster 2021-03-10T16:21:01.614439+0000 mgr.gibba045.orlgmj (mgr.34412) 8033 : cluster [DBG] pgmap v4576: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:03.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:21:03 gibba045 bash[25517]: cluster 2021-03-10T16:21:01.614439+0000 mgr.gibba045.orlgmj (mgr.34412) 8033 : cluster [DBG] pgmap v4576: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:04.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:21:04 gibba015 bash[29377]: cephadm 2021-03-10T16:21:02.409587+0000 mgr.gibba045.orlgmj (mgr.34412) 8034 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:21:04.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:21:04 gibba015 bash[30343]: cephadm 2021-03-10T16:21:02.409587+0000 mgr.gibba045.orlgmj (mgr.34412) 8034 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:21:04.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:21:04 gibba045 bash[25517]: cephadm 2021-03-10T16:21:02.409587+0000 mgr.gibba045.orlgmj (mgr.34412) 8034 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:21:05.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:21:05 gibba015 bash[29377]: cluster 2021-03-10T16:21:03.615791+0000 mgr.gibba045.orlgmj (mgr.34412) 8035 : cluster [DBG] pgmap v4577: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:05.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:21:05 gibba015 bash[30343]: cluster 2021-03-10T16:21:03.615791+0000 mgr.gibba045.orlgmj (mgr.34412) 8035 : cluster [DBG] pgmap v4577: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:05.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:21:05 gibba045 bash[25517]: cluster 2021-03-10T16:21:03.615791+0000 mgr.gibba045.orlgmj (mgr.34412) 8035 : cluster [DBG] pgmap v4577: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:07.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:21:07 gibba015 bash[29377]: cluster 2021-03-10T16:21:05.617413+0000 mgr.gibba045.orlgmj (mgr.34412) 8036 : cluster [DBG] pgmap v4578: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:07.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:21:07 gibba015 bash[30343]: cluster 2021-03-10T16:21:05.617413+0000 mgr.gibba045.orlgmj (mgr.34412) 8036 : cluster [DBG] pgmap v4578: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:07.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:21:07 gibba045 bash[25517]: cluster 2021-03-10T16:21:05.617413+0000 mgr.gibba045.orlgmj (mgr.34412) 8036 : cluster [DBG] pgmap v4578: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:09.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:21:09 gibba015 bash[29377]: cluster 2021-03-10T16:21:07.619020+0000 mgr.gibba045.orlgmj (mgr.34412) 8037 : cluster [DBG] pgmap v4579: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:09.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:21:09 gibba015 bash[30343]: cluster 2021-03-10T16:21:07.619020+0000 mgr.gibba045.orlgmj (mgr.34412) 8037 : cluster [DBG] pgmap v4579: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:09.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:21:09 gibba045 bash[25517]: cluster 2021-03-10T16:21:07.619020+0000 mgr.gibba045.orlgmj (mgr.34412) 8037 : cluster [DBG] pgmap v4579: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:11.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:21:11 gibba015 bash[29377]: cluster 2021-03-10T16:21:09.620703+0000 mgr.gibba045.orlgmj (mgr.34412) 8038 : cluster [DBG] pgmap v4580: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:11.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:21:11 gibba015 bash[30343]: cluster 2021-03-10T16:21:09.620703+0000 mgr.gibba045.orlgmj (mgr.34412) 8038 : cluster [DBG] pgmap v4580: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:11.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:21:11 gibba045 bash[25517]: cluster 2021-03-10T16:21:09.620703+0000 mgr.gibba045.orlgmj (mgr.34412) 8038 : cluster [DBG] pgmap v4580: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:13.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:21:13 gibba015 bash[29377]: cluster 2021-03-10T16:21:11.622585+0000 mgr.gibba045.orlgmj (mgr.34412) 8039 : cluster [DBG] pgmap v4581: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:13.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:21:13 gibba015 bash[30343]: cluster 2021-03-10T16:21:11.622585+0000 mgr.gibba045.orlgmj (mgr.34412) 8039 : cluster [DBG] pgmap v4581: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:13.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:21:13 gibba045 bash[25517]: cluster 2021-03-10T16:21:11.622585+0000 mgr.gibba045.orlgmj (mgr.34412) 8039 : cluster [DBG] pgmap v4581: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:14.197 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:21:14.425 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:21:14.425 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 5m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:21:14.425 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 4m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:21:14.426 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:21:14.426 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:21:14.426 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:21:14.426 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:21:14.427 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:21:14.427 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:21:14.427 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 5m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:21:14.427 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 4m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:21:14.428 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:21:14.428 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:21:14.428 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:21:14.428 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:21:14.428 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:21:14.429 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:21:14.429 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:21:14.429 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:21:14.429 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 4m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:21:14.430 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 4m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:21:14.675 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:21:14.676 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:21:14.676 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:21:14.676 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:21:14.676 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:21:14.677 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:21:14.677 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:21:14.677 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:21:14.677 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:21:14.678 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:21:14.678 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:21:14.678 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:21:14.678 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:21:14.679 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:21:14.679 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:21:15.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:21:15 gibba015 bash[29377]: cluster 2021-03-10T16:21:13.623844+0000 mgr.gibba045.orlgmj (mgr.34412) 8040 : cluster [DBG] pgmap v4582: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:15.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:21:15 gibba015 bash[29377]: audit 2021-03-10T16:21:14.190862+0000 mgr.gibba045.orlgmj (mgr.34412) 8041 : audit [DBG] from='client.49452 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:21:15.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:21:15 gibba015 bash[29377]: audit 2021-03-10T16:21:14.676120+0000 mon.c (mon.1) 2228 : audit [DBG] from='client.? 172.21.2.115:0/3374840175' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:21:15.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:21:15 gibba015 bash[30343]: cluster 2021-03-10T16:21:13.623844+0000 mgr.gibba045.orlgmj (mgr.34412) 8040 : cluster [DBG] pgmap v4582: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:15.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:21:15 gibba015 bash[30343]: audit 2021-03-10T16:21:14.190862+0000 mgr.gibba045.orlgmj (mgr.34412) 8041 : audit [DBG] from='client.49452 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:21:15.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:21:15 gibba015 bash[30343]: audit 2021-03-10T16:21:14.676120+0000 mon.c (mon.1) 2228 : audit [DBG] from='client.? 172.21.2.115:0/3374840175' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:21:15.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:21:15 gibba045 bash[25517]: cluster 2021-03-10T16:21:13.623844+0000 mgr.gibba045.orlgmj (mgr.34412) 8040 : cluster [DBG] pgmap v4582: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:15.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:21:15 gibba045 bash[25517]: audit 2021-03-10T16:21:14.190862+0000 mgr.gibba045.orlgmj (mgr.34412) 8041 : audit [DBG] from='client.49452 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:21:15.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:21:15 gibba045 bash[25517]: audit 2021-03-10T16:21:14.676120+0000 mon.c (mon.1) 2228 : audit [DBG] from='client.? 172.21.2.115:0/3374840175' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:21:16.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:21:16 gibba015 bash[29377]: audit 2021-03-10T16:21:14.417259+0000 mgr.gibba045.orlgmj (mgr.34412) 8042 : audit [DBG] from='client.49458 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:21:16.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:21:16 gibba015 bash[30343]: audit 2021-03-10T16:21:14.417259+0000 mgr.gibba045.orlgmj (mgr.34412) 8042 : audit [DBG] from='client.49458 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:21:16.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:21:16 gibba045 bash[25517]: audit 2021-03-10T16:21:14.417259+0000 mgr.gibba045.orlgmj (mgr.34412) 8042 : audit [DBG] from='client.49458 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:21:17.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:21:17 gibba015 bash[29377]: cluster 2021-03-10T16:21:15.625427+0000 mgr.gibba045.orlgmj (mgr.34412) 8043 : cluster [DBG] pgmap v4583: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:17.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:21:17 gibba015 bash[30343]: cluster 2021-03-10T16:21:15.625427+0000 mgr.gibba045.orlgmj (mgr.34412) 8043 : cluster [DBG] pgmap v4583: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:17.552 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:21:17 gibba045 bash[25517]: cluster 2021-03-10T16:21:15.625427+0000 mgr.gibba045.orlgmj (mgr.34412) 8043 : cluster [DBG] pgmap v4583: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:18.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:21:18 gibba045 bash[25517]: audit 2021-03-10T16:21:17.423941+0000 mon.c (mon.1) 2229 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:21:18.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:21:18 gibba045 bash[25517]: audit 2021-03-10T16:21:17.656514+0000 mon.a (mon.0) 1843 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:21:18.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:21:18 gibba045 bash[25517]: audit 2021-03-10T16:21:17.660636+0000 mon.c (mon.1) 2230 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:21:18.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:21:18 gibba045 bash[25517]: audit 2021-03-10T16:21:17.661566+0000 mon.c (mon.1) 2231 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:21:18.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:21:18 gibba045 bash[25517]: audit 2021-03-10T16:21:17.662792+0000 mon.c (mon.1) 2232 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:21:18.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:21:18 gibba045 bash[25517]: audit 2021-03-10T16:21:17.664037+0000 mon.c (mon.1) 2233 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:21:18.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:21:18 gibba045 bash[25517]: audit 2021-03-10T16:21:17.666742+0000 mon.c (mon.1) 2234 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:21:18.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:21:18 gibba045 bash[25517]: audit 2021-03-10T16:21:17.668160+0000 mon.c (mon.1) 2235 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:21:18.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:21:18 gibba015 bash[29377]: audit 2021-03-10T16:21:17.423941+0000 mon.c (mon.1) 2229 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:21:18.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:21:18 gibba015 bash[29377]: audit 2021-03-10T16:21:17.656514+0000 mon.a (mon.0) 1843 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:21:18.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:21:18 gibba015 bash[29377]: audit 2021-03-10T16:21:17.660636+0000 mon.c (mon.1) 2230 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:21:18.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:21:18 gibba015 bash[29377]: audit 2021-03-10T16:21:17.661566+0000 mon.c (mon.1) 2231 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:21:18.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:21:18 gibba015 bash[29377]: audit 2021-03-10T16:21:17.662792+0000 mon.c (mon.1) 2232 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:21:18.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:21:18 gibba015 bash[29377]: audit 2021-03-10T16:21:17.664037+0000 mon.c (mon.1) 2233 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:21:18.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:21:18 gibba015 bash[29377]: audit 2021-03-10T16:21:17.666742+0000 mon.c (mon.1) 2234 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:21:18.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:21:18 gibba015 bash[29377]: audit 2021-03-10T16:21:17.668160+0000 mon.c (mon.1) 2235 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:21:18.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:21:18 gibba015 bash[30343]: audit 2021-03-10T16:21:17.423941+0000 mon.c (mon.1) 2229 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:21:18.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:21:18 gibba015 bash[30343]: audit 2021-03-10T16:21:17.656514+0000 mon.a (mon.0) 1843 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:21:18.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:21:18 gibba015 bash[30343]: audit 2021-03-10T16:21:17.660636+0000 mon.c (mon.1) 2230 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:21:18.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:21:18 gibba015 bash[30343]: audit 2021-03-10T16:21:17.661566+0000 mon.c (mon.1) 2231 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:21:18.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:21:18 gibba015 bash[30343]: audit 2021-03-10T16:21:17.662792+0000 mon.c (mon.1) 2232 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:21:18.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:21:18 gibba015 bash[30343]: audit 2021-03-10T16:21:17.664037+0000 mon.c (mon.1) 2233 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:21:18.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:21:18 gibba015 bash[30343]: audit 2021-03-10T16:21:17.666742+0000 mon.c (mon.1) 2234 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:21:18.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:21:18 gibba015 bash[30343]: audit 2021-03-10T16:21:17.668160+0000 mon.c (mon.1) 2235 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:21:19.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:21:19 gibba045 bash[25517]: cephadm 2021-03-10T16:21:17.431605+0000 mgr.gibba045.orlgmj (mgr.34412) 8044 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:21:19.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:21:19 gibba045 bash[25517]: cephadm 2021-03-10T16:21:17.433409+0000 mgr.gibba045.orlgmj (mgr.34412) 8045 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:21:19.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:21:19 gibba045 bash[25517]: cluster 2021-03-10T16:21:17.625995+0000 mgr.gibba045.orlgmj (mgr.34412) 8046 : cluster [DBG] pgmap v4584: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:19.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:21:19 gibba045 bash[25517]: cephadm 2021-03-10T16:21:17.662510+0000 mgr.gibba045.orlgmj (mgr.34412) 8047 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:21:19.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:21:19 gibba045 bash[25517]: cephadm 2021-03-10T16:21:17.663808+0000 mgr.gibba045.orlgmj (mgr.34412) 8048 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:21:19.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:21:19 gibba045 bash[25517]: cephadm 2021-03-10T16:21:17.664787+0000 mgr.gibba045.orlgmj (mgr.34412) 8049 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:21:19.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:21:19 gibba045 bash[25517]: cephadm 2021-03-10T16:21:17.664826+0000 mgr.gibba045.orlgmj (mgr.34412) 8050 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:21:19.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:21:19 gibba045 bash[25517]: cephadm 2021-03-10T16:21:17.666079+0000 mgr.gibba045.orlgmj (mgr.34412) 8051 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:21:19.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:21:19 gibba045 bash[25517]: cephadm 2021-03-10T16:21:17.666116+0000 mgr.gibba045.orlgmj (mgr.34412) 8052 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:21:19.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:21:19 gibba045 bash[25517]: cephadm 2021-03-10T16:21:17.667444+0000 mgr.gibba045.orlgmj (mgr.34412) 8053 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:21:19.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:21:19 gibba045 bash[25517]: cephadm 2021-03-10T16:21:17.668847+0000 mgr.gibba045.orlgmj (mgr.34412) 8054 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:21:19.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:21:19 gibba045 bash[25517]: cephadm 2021-03-10T16:21:17.668890+0000 mgr.gibba045.orlgmj (mgr.34412) 8055 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:21:19.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:21:19 gibba045 bash[25517]: cephadm 2021-03-10T16:21:17.669997+0000 mgr.gibba045.orlgmj (mgr.34412) 8056 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:21:19.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:21:19 gibba045 bash[25517]: cephadm 2021-03-10T16:21:17.670362+0000 mgr.gibba045.orlgmj (mgr.34412) 8057 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:21:19.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:21:19 gibba045 bash[25517]: cephadm 2021-03-10T16:21:17.671365+0000 mgr.gibba045.orlgmj (mgr.34412) 8058 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:21:19.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:21:19 gibba045 bash[25517]: cephadm 2021-03-10T16:21:17.671410+0000 mgr.gibba045.orlgmj (mgr.34412) 8059 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:21:19.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:21:19 gibba045 bash[25517]: cephadm 2021-03-10T16:21:17.671531+0000 mgr.gibba045.orlgmj (mgr.34412) 8060 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:21:19.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:21:19 gibba015 bash[29377]: cephadm 2021-03-10T16:21:17.431605+0000 mgr.gibba045.orlgmj (mgr.34412) 8044 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:21:19.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:21:19 gibba015 bash[29377]: cephadm 2021-03-10T16:21:17.433409+0000 mgr.gibba045.orlgmj (mgr.34412) 8045 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:21:19.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:21:19 gibba015 bash[29377]: cluster 2021-03-10T16:21:17.625995+0000 mgr.gibba045.orlgmj (mgr.34412) 8046 : cluster [DBG] pgmap v4584: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:19.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:21:19 gibba015 bash[29377]: cephadm 2021-03-10T16:21:17.662510+0000 mgr.gibba045.orlgmj (mgr.34412) 8047 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:21:19.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:21:19 gibba015 bash[29377]: cephadm 2021-03-10T16:21:17.663808+0000 mgr.gibba045.orlgmj (mgr.34412) 8048 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:21:19.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:21:19 gibba015 bash[29377]: cephadm 2021-03-10T16:21:17.664787+0000 mgr.gibba045.orlgmj (mgr.34412) 8049 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:21:19.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:21:19 gibba015 bash[29377]: cephadm 2021-03-10T16:21:17.664826+0000 mgr.gibba045.orlgmj (mgr.34412) 8050 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:21:19.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:21:19 gibba015 bash[29377]: cephadm 2021-03-10T16:21:17.666079+0000 mgr.gibba045.orlgmj (mgr.34412) 8051 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:21:19.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:21:19 gibba015 bash[29377]: cephadm 2021-03-10T16:21:17.666116+0000 mgr.gibba045.orlgmj (mgr.34412) 8052 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:21:19.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:21:19 gibba015 bash[29377]: cephadm 2021-03-10T16:21:17.667444+0000 mgr.gibba045.orlgmj (mgr.34412) 8053 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:21:19.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:21:19 gibba015 bash[29377]: cephadm 2021-03-10T16:21:17.668847+0000 mgr.gibba045.orlgmj (mgr.34412) 8054 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:21:19.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:21:19 gibba015 bash[29377]: cephadm 2021-03-10T16:21:17.668890+0000 mgr.gibba045.orlgmj (mgr.34412) 8055 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:21:19.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:21:19 gibba015 bash[29377]: cephadm 2021-03-10T16:21:17.669997+0000 mgr.gibba045.orlgmj (mgr.34412) 8056 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:21:19.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:21:19 gibba015 bash[29377]: cephadm 2021-03-10T16:21:17.670362+0000 mgr.gibba045.orlgmj (mgr.34412) 8057 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:21:19.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:21:19 gibba015 bash[29377]: cephadm 2021-03-10T16:21:17.671365+0000 mgr.gibba045.orlgmj (mgr.34412) 8058 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:21:19.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:21:19 gibba015 bash[29377]: cephadm 2021-03-10T16:21:17.671410+0000 mgr.gibba045.orlgmj (mgr.34412) 8059 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:21:19.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:21:19 gibba015 bash[29377]: cephadm 2021-03-10T16:21:17.671531+0000 mgr.gibba045.orlgmj (mgr.34412) 8060 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:21:19.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:21:19 gibba015 bash[30343]: cephadm 2021-03-10T16:21:17.431605+0000 mgr.gibba045.orlgmj (mgr.34412) 8044 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:21:19.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:21:19 gibba015 bash[30343]: cephadm 2021-03-10T16:21:17.433409+0000 mgr.gibba045.orlgmj (mgr.34412) 8045 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:21:19.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:21:19 gibba015 bash[30343]: cluster 2021-03-10T16:21:17.625995+0000 mgr.gibba045.orlgmj (mgr.34412) 8046 : cluster [DBG] pgmap v4584: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:19.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:21:19 gibba015 bash[30343]: cephadm 2021-03-10T16:21:17.662510+0000 mgr.gibba045.orlgmj (mgr.34412) 8047 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:21:19.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:21:19 gibba015 bash[30343]: cephadm 2021-03-10T16:21:17.663808+0000 mgr.gibba045.orlgmj (mgr.34412) 8048 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:21:19.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:21:19 gibba015 bash[30343]: cephadm 2021-03-10T16:21:17.664787+0000 mgr.gibba045.orlgmj (mgr.34412) 8049 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:21:19.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:21:19 gibba015 bash[30343]: cephadm 2021-03-10T16:21:17.664826+0000 mgr.gibba045.orlgmj (mgr.34412) 8050 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:21:19.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:21:19 gibba015 bash[30343]: cephadm 2021-03-10T16:21:17.666079+0000 mgr.gibba045.orlgmj (mgr.34412) 8051 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:21:19.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:21:19 gibba015 bash[30343]: cephadm 2021-03-10T16:21:17.666116+0000 mgr.gibba045.orlgmj (mgr.34412) 8052 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:21:19.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:21:19 gibba015 bash[30343]: cephadm 2021-03-10T16:21:17.667444+0000 mgr.gibba045.orlgmj (mgr.34412) 8053 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:21:19.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:21:19 gibba015 bash[30343]: cephadm 2021-03-10T16:21:17.668847+0000 mgr.gibba045.orlgmj (mgr.34412) 8054 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:21:19.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:21:19 gibba015 bash[30343]: cephadm 2021-03-10T16:21:17.668890+0000 mgr.gibba045.orlgmj (mgr.34412) 8055 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:21:19.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:21:19 gibba015 bash[30343]: cephadm 2021-03-10T16:21:17.669997+0000 mgr.gibba045.orlgmj (mgr.34412) 8056 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:21:19.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:21:19 gibba015 bash[30343]: cephadm 2021-03-10T16:21:17.670362+0000 mgr.gibba045.orlgmj (mgr.34412) 8057 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:21:19.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:21:19 gibba015 bash[30343]: cephadm 2021-03-10T16:21:17.671365+0000 mgr.gibba045.orlgmj (mgr.34412) 8058 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:21:19.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:21:19 gibba015 bash[30343]: cephadm 2021-03-10T16:21:17.671410+0000 mgr.gibba045.orlgmj (mgr.34412) 8059 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:21:19.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:21:19 gibba015 bash[30343]: cephadm 2021-03-10T16:21:17.671531+0000 mgr.gibba045.orlgmj (mgr.34412) 8060 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:21:21.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:21:21 gibba045 bash[25517]: cluster 2021-03-10T16:21:19.627300+0000 mgr.gibba045.orlgmj (mgr.34412) 8061 : cluster [DBG] pgmap v4585: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:21.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:21:21 gibba015 bash[29377]: cluster 2021-03-10T16:21:19.627300+0000 mgr.gibba045.orlgmj (mgr.34412) 8061 : cluster [DBG] pgmap v4585: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:21.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:21:21 gibba015 bash[30343]: cluster 2021-03-10T16:21:19.627300+0000 mgr.gibba045.orlgmj (mgr.34412) 8061 : cluster [DBG] pgmap v4585: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:23.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:21:23 gibba045 bash[25517]: cluster 2021-03-10T16:21:21.629094+0000 mgr.gibba045.orlgmj (mgr.34412) 8062 : cluster [DBG] pgmap v4586: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:23.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:21:23 gibba015 bash[29377]: cluster 2021-03-10T16:21:21.629094+0000 mgr.gibba045.orlgmj (mgr.34412) 8062 : cluster [DBG] pgmap v4586: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:23.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:21:23 gibba015 bash[30343]: cluster 2021-03-10T16:21:21.629094+0000 mgr.gibba045.orlgmj (mgr.34412) 8062 : cluster [DBG] pgmap v4586: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:25.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:21:25 gibba045 bash[25517]: cluster 2021-03-10T16:21:23.630427+0000 mgr.gibba045.orlgmj (mgr.34412) 8063 : cluster [DBG] pgmap v4587: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:25.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:21:25 gibba015 bash[29377]: cluster 2021-03-10T16:21:23.630427+0000 mgr.gibba045.orlgmj (mgr.34412) 8063 : cluster [DBG] pgmap v4587: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:25.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:21:25 gibba015 bash[30343]: cluster 2021-03-10T16:21:23.630427+0000 mgr.gibba045.orlgmj (mgr.34412) 8063 : cluster [DBG] pgmap v4587: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:27.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:21:27 gibba045 bash[25517]: cluster 2021-03-10T16:21:25.631721+0000 mgr.gibba045.orlgmj (mgr.34412) 8064 : cluster [DBG] pgmap v4588: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:27.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:21:27 gibba015 bash[29377]: cluster 2021-03-10T16:21:25.631721+0000 mgr.gibba045.orlgmj (mgr.34412) 8064 : cluster [DBG] pgmap v4588: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:27.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:21:27 gibba015 bash[30343]: cluster 2021-03-10T16:21:25.631721+0000 mgr.gibba045.orlgmj (mgr.34412) 8064 : cluster [DBG] pgmap v4588: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:29.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:21:29 gibba045 bash[25517]: cluster 2021-03-10T16:21:27.633531+0000 mgr.gibba045.orlgmj (mgr.34412) 8065 : cluster [DBG] pgmap v4589: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:29.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:21:29 gibba015 bash[29377]: cluster 2021-03-10T16:21:27.633531+0000 mgr.gibba045.orlgmj (mgr.34412) 8065 : cluster [DBG] pgmap v4589: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:29.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:21:29 gibba015 bash[30343]: cluster 2021-03-10T16:21:27.633531+0000 mgr.gibba045.orlgmj (mgr.34412) 8065 : cluster [DBG] pgmap v4589: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:31.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:21:31 gibba045 bash[25517]: cluster 2021-03-10T16:21:29.635172+0000 mgr.gibba045.orlgmj (mgr.34412) 8066 : cluster [DBG] pgmap v4590: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:31.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:21:31 gibba015 bash[29377]: cluster 2021-03-10T16:21:29.635172+0000 mgr.gibba045.orlgmj (mgr.34412) 8066 : cluster [DBG] pgmap v4590: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:31.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:21:31 gibba015 bash[30343]: cluster 2021-03-10T16:21:29.635172+0000 mgr.gibba045.orlgmj (mgr.34412) 8066 : cluster [DBG] pgmap v4590: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:32.685 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:21:32 gibba045 bash[25517]: cluster 2021-03-10T16:21:31.637092+0000 mgr.gibba045.orlgmj (mgr.34412) 8067 : cluster [DBG] pgmap v4591: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:32.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:21:32 gibba015 bash[29377]: cluster 2021-03-10T16:21:31.637092+0000 mgr.gibba045.orlgmj (mgr.34412) 8067 : cluster [DBG] pgmap v4591: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:32.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:21:32 gibba015 bash[30343]: cluster 2021-03-10T16:21:31.637092+0000 mgr.gibba045.orlgmj (mgr.34412) 8067 : cluster [DBG] pgmap v4591: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:33.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:21:33 gibba015 bash[29377]: cephadm 2021-03-10T16:21:32.687591+0000 mgr.gibba045.orlgmj (mgr.34412) 8068 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:21:33.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:21:33 gibba015 bash[30343]: cephadm 2021-03-10T16:21:32.687591+0000 mgr.gibba045.orlgmj (mgr.34412) 8068 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:21:33.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:21:33 gibba045 bash[25517]: cephadm 2021-03-10T16:21:32.687591+0000 mgr.gibba045.orlgmj (mgr.34412) 8068 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:21:34.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:21:34 gibba015 bash[29377]: cluster 2021-03-10T16:21:33.638611+0000 mgr.gibba045.orlgmj (mgr.34412) 8069 : cluster [DBG] pgmap v4592: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:34.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:21:34 gibba015 bash[30343]: cluster 2021-03-10T16:21:33.638611+0000 mgr.gibba045.orlgmj (mgr.34412) 8069 : cluster [DBG] pgmap v4592: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:34.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:21:34 gibba045 bash[25517]: cluster 2021-03-10T16:21:33.638611+0000 mgr.gibba045.orlgmj (mgr.34412) 8069 : cluster [DBG] pgmap v4592: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:37.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:21:36 gibba015 bash[29377]: cluster 2021-03-10T16:21:35.639896+0000 mgr.gibba045.orlgmj (mgr.34412) 8070 : cluster [DBG] pgmap v4593: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:37.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:21:36 gibba015 bash[30343]: cluster 2021-03-10T16:21:35.639896+0000 mgr.gibba045.orlgmj (mgr.34412) 8070 : cluster [DBG] pgmap v4593: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:37.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:21:36 gibba045 bash[25517]: cluster 2021-03-10T16:21:35.639896+0000 mgr.gibba045.orlgmj (mgr.34412) 8070 : cluster [DBG] pgmap v4593: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:39.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:21:38 gibba015 bash[29377]: cluster 2021-03-10T16:21:37.641593+0000 mgr.gibba045.orlgmj (mgr.34412) 8071 : cluster [DBG] pgmap v4594: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:39.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:21:38 gibba015 bash[30343]: cluster 2021-03-10T16:21:37.641593+0000 mgr.gibba045.orlgmj (mgr.34412) 8071 : cluster [DBG] pgmap v4594: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:39.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:21:38 gibba045 bash[25517]: cluster 2021-03-10T16:21:37.641593+0000 mgr.gibba045.orlgmj (mgr.34412) 8071 : cluster [DBG] pgmap v4594: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:41.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:21:40 gibba015 bash[29377]: cluster 2021-03-10T16:21:39.643189+0000 mgr.gibba045.orlgmj (mgr.34412) 8072 : cluster [DBG] pgmap v4595: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:41.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:21:40 gibba015 bash[30343]: cluster 2021-03-10T16:21:39.643189+0000 mgr.gibba045.orlgmj (mgr.34412) 8072 : cluster [DBG] pgmap v4595: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:41.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:21:40 gibba045 bash[25517]: cluster 2021-03-10T16:21:39.643189+0000 mgr.gibba045.orlgmj (mgr.34412) 8072 : cluster [DBG] pgmap v4595: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:43.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:21:42 gibba015 bash[29377]: cluster 2021-03-10T16:21:41.645100+0000 mgr.gibba045.orlgmj (mgr.34412) 8073 : cluster [DBG] pgmap v4596: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:43.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:21:42 gibba015 bash[30343]: cluster 2021-03-10T16:21:41.645100+0000 mgr.gibba045.orlgmj (mgr.34412) 8073 : cluster [DBG] pgmap v4596: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:43.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:21:42 gibba045 bash[25517]: cluster 2021-03-10T16:21:41.645100+0000 mgr.gibba045.orlgmj (mgr.34412) 8073 : cluster [DBG] pgmap v4596: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:44.923 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:21:45.150 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:21:45.150 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 5m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:21:45.151 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 4m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:21:45.151 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:21:45.151 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:21:45.151 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:21:45.151 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:21:45.152 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:21:45.152 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:21:45.152 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 5m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:21:45.152 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 4m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:21:45.153 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:21:45.153 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:21:45.153 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:21:45.153 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:21:45.154 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:21:45.154 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:21:45.154 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:21:45.154 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:21:45.154 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 4m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:21:45.155 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 4m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:21:45.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:21:44 gibba015 bash[29377]: cluster 2021-03-10T16:21:43.646297+0000 mgr.gibba045.orlgmj (mgr.34412) 8074 : cluster [DBG] pgmap v4597: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:45.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:21:44 gibba015 bash[30343]: cluster 2021-03-10T16:21:43.646297+0000 mgr.gibba045.orlgmj (mgr.34412) 8074 : cluster [DBG] pgmap v4597: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:45.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:21:44 gibba045 bash[25517]: cluster 2021-03-10T16:21:43.646297+0000 mgr.gibba045.orlgmj (mgr.34412) 8074 : cluster [DBG] pgmap v4597: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:45.399 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:21:45.400 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:21:45.400 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:21:45.400 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:21:45.400 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:21:45.401 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:21:45.401 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:21:45.401 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:21:45.401 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:21:45.402 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:21:45.402 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:21:45.402 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:21:45.402 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:21:45.402 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:21:45.403 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:21:46.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:21:45 gibba015 bash[29377]: audit 2021-03-10T16:21:44.918313+0000 mgr.gibba045.orlgmj (mgr.34412) 8075 : audit [DBG] from='client.59458 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:21:46.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:21:45 gibba015 bash[29377]: audit 2021-03-10T16:21:45.144626+0000 mgr.gibba045.orlgmj (mgr.34412) 8076 : audit [DBG] from='client.49476 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:21:46.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:21:45 gibba015 bash[29377]: audit 2021-03-10T16:21:45.400004+0000 mon.c (mon.1) 2236 : audit [DBG] from='client.? 172.21.2.115:0/1823739232' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:21:46.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:21:45 gibba015 bash[30343]: audit 2021-03-10T16:21:44.918313+0000 mgr.gibba045.orlgmj (mgr.34412) 8075 : audit [DBG] from='client.59458 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:21:46.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:21:45 gibba015 bash[30343]: audit 2021-03-10T16:21:45.144626+0000 mgr.gibba045.orlgmj (mgr.34412) 8076 : audit [DBG] from='client.49476 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:21:46.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:21:45 gibba015 bash[30343]: audit 2021-03-10T16:21:45.400004+0000 mon.c (mon.1) 2236 : audit [DBG] from='client.? 172.21.2.115:0/1823739232' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:21:46.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:21:45 gibba045 bash[25517]: audit 2021-03-10T16:21:44.918313+0000 mgr.gibba045.orlgmj (mgr.34412) 8075 : audit [DBG] from='client.59458 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:21:46.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:21:45 gibba045 bash[25517]: audit 2021-03-10T16:21:45.144626+0000 mgr.gibba045.orlgmj (mgr.34412) 8076 : audit [DBG] from='client.49476 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:21:46.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:21:45 gibba045 bash[25517]: audit 2021-03-10T16:21:45.400004+0000 mon.c (mon.1) 2236 : audit [DBG] from='client.? 172.21.2.115:0/1823739232' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:21:47.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:21:46 gibba015 bash[29377]: cluster 2021-03-10T16:21:45.647849+0000 mgr.gibba045.orlgmj (mgr.34412) 8077 : cluster [DBG] pgmap v4598: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:47.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:21:46 gibba015 bash[30343]: cluster 2021-03-10T16:21:45.647849+0000 mgr.gibba045.orlgmj (mgr.34412) 8077 : cluster [DBG] pgmap v4598: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:47.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:21:46 gibba045 bash[25517]: cluster 2021-03-10T16:21:45.647849+0000 mgr.gibba045.orlgmj (mgr.34412) 8077 : cluster [DBG] pgmap v4598: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:49.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:21:48 gibba015 bash[29377]: cluster 2021-03-10T16:21:47.649626+0000 mgr.gibba045.orlgmj (mgr.34412) 8078 : cluster [DBG] pgmap v4599: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:49.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:21:48 gibba015 bash[29377]: cephadm 2021-03-10T16:21:47.703520+0000 mgr.gibba045.orlgmj (mgr.34412) 8079 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:21:49.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:21:48 gibba015 bash[30343]: cluster 2021-03-10T16:21:47.649626+0000 mgr.gibba045.orlgmj (mgr.34412) 8078 : cluster [DBG] pgmap v4599: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:49.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:21:48 gibba015 bash[30343]: cephadm 2021-03-10T16:21:47.703520+0000 mgr.gibba045.orlgmj (mgr.34412) 8079 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:21:49.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:21:48 gibba045 bash[25517]: cluster 2021-03-10T16:21:47.649626+0000 mgr.gibba045.orlgmj (mgr.34412) 8078 : cluster [DBG] pgmap v4599: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:49.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:21:48 gibba045 bash[25517]: cephadm 2021-03-10T16:21:47.703520+0000 mgr.gibba045.orlgmj (mgr.34412) 8079 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:21:51.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:21:50 gibba015 bash[29377]: cluster 2021-03-10T16:21:49.650363+0000 mgr.gibba045.orlgmj (mgr.34412) 8080 : cluster [DBG] pgmap v4600: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:51.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:21:50 gibba015 bash[30343]: cluster 2021-03-10T16:21:49.650363+0000 mgr.gibba045.orlgmj (mgr.34412) 8080 : cluster [DBG] pgmap v4600: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:51.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:21:50 gibba045 bash[25517]: cluster 2021-03-10T16:21:49.650363+0000 mgr.gibba045.orlgmj (mgr.34412) 8080 : cluster [DBG] pgmap v4600: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:53.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:21:52 gibba015 bash[29377]: cluster 2021-03-10T16:21:51.652216+0000 mgr.gibba045.orlgmj (mgr.34412) 8081 : cluster [DBG] pgmap v4601: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:53.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:21:52 gibba015 bash[30343]: cluster 2021-03-10T16:21:51.652216+0000 mgr.gibba045.orlgmj (mgr.34412) 8081 : cluster [DBG] pgmap v4601: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:53.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:21:52 gibba045 bash[25517]: cluster 2021-03-10T16:21:51.652216+0000 mgr.gibba045.orlgmj (mgr.34412) 8081 : cluster [DBG] pgmap v4601: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:54.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:21:53 gibba015 bash[29377]: audit 2021-03-10T16:21:53.531776+0000 mon.c (mon.1) 2237 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:21:54.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:21:53 gibba015 bash[29377]: audit 2021-03-10T16:21:53.532662+0000 mon.c (mon.1) 2238 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:21:54.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:21:53 gibba015 bash[29377]: audit 2021-03-10T16:21:53.532868+0000 mon.a (mon.0) 1844 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:21:54.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:21:53 gibba015 bash[29377]: audit 2021-03-10T16:21:53.533562+0000 mon.c (mon.1) 2239 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T16:21:54.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:21:53 gibba015 bash[29377]: audit 2021-03-10T16:21:53.534723+0000 mon.c (mon.1) 2240 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:21:54.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:21:53 gibba015 bash[29377]: audit 2021-03-10T16:21:53.534790+0000 mon.a (mon.0) 1845 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:21:54.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:21:53 gibba015 bash[29377]: audit 2021-03-10T16:21:53.535545+0000 mon.c (mon.1) 2241 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:21:54.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:21:53 gibba015 bash[29377]: audit 2021-03-10T16:21:53.536563+0000 mon.a (mon.0) 1846 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T16:21:54.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:21:53 gibba015 bash[29377]: audit 2021-03-10T16:21:53.536564+0000 mon.c (mon.1) 2242 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:21:54.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:21:53 gibba015 bash[29377]: audit 2021-03-10T16:21:53.536849+0000 mon.a (mon.0) 1847 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:21:54.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:21:53 gibba015 bash[29377]: audit 2021-03-10T16:21:53.537024+0000 mon.a (mon.0) 1848 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:21:54.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:21:53 gibba015 bash[29377]: audit 2021-03-10T16:21:53.537236+0000 mon.a (mon.0) 1849 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:21:54.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:21:53 gibba015 bash[30343]: audit 2021-03-10T16:21:53.531776+0000 mon.c (mon.1) 2237 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:21:54.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:21:53 gibba015 bash[30343]: audit 2021-03-10T16:21:53.532662+0000 mon.c (mon.1) 2238 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:21:54.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:21:53 gibba015 bash[30343]: audit 2021-03-10T16:21:53.532868+0000 mon.a (mon.0) 1844 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:21:54.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:21:53 gibba015 bash[30343]: audit 2021-03-10T16:21:53.533562+0000 mon.c (mon.1) 2239 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T16:21:54.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:21:53 gibba015 bash[30343]: audit 2021-03-10T16:21:53.534723+0000 mon.c (mon.1) 2240 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:21:54.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:21:53 gibba015 bash[30343]: audit 2021-03-10T16:21:53.534790+0000 mon.a (mon.0) 1845 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:21:54.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:21:53 gibba015 bash[30343]: audit 2021-03-10T16:21:53.535545+0000 mon.c (mon.1) 2241 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:21:54.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:21:53 gibba015 bash[30343]: audit 2021-03-10T16:21:53.536563+0000 mon.a (mon.0) 1846 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T16:21:54.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:21:53 gibba015 bash[30343]: audit 2021-03-10T16:21:53.536564+0000 mon.c (mon.1) 2242 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:21:54.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:21:53 gibba015 bash[30343]: audit 2021-03-10T16:21:53.536849+0000 mon.a (mon.0) 1847 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:21:54.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:21:53 gibba015 bash[30343]: audit 2021-03-10T16:21:53.537024+0000 mon.a (mon.0) 1848 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:21:54.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:21:53 gibba015 bash[30343]: audit 2021-03-10T16:21:53.537236+0000 mon.a (mon.0) 1849 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:21:54.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:21:53 gibba045 bash[25517]: audit 2021-03-10T16:21:53.531776+0000 mon.c (mon.1) 2237 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:21:54.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:21:53 gibba045 bash[25517]: audit 2021-03-10T16:21:53.532662+0000 mon.c (mon.1) 2238 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:21:54.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:21:53 gibba045 bash[25517]: audit 2021-03-10T16:21:53.532868+0000 mon.a (mon.0) 1844 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:21:54.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:21:53 gibba045 bash[25517]: audit 2021-03-10T16:21:53.533562+0000 mon.c (mon.1) 2239 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T16:21:54.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:21:53 gibba045 bash[25517]: audit 2021-03-10T16:21:53.534723+0000 mon.c (mon.1) 2240 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:21:54.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:21:53 gibba045 bash[25517]: audit 2021-03-10T16:21:53.534790+0000 mon.a (mon.0) 1845 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:21:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:21:53 gibba045 bash[25517]: audit 2021-03-10T16:21:53.535545+0000 mon.c (mon.1) 2241 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:21:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:21:53 gibba045 bash[25517]: audit 2021-03-10T16:21:53.536563+0000 mon.a (mon.0) 1846 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T16:21:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:21:53 gibba045 bash[25517]: audit 2021-03-10T16:21:53.536564+0000 mon.c (mon.1) 2242 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:21:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:21:53 gibba045 bash[25517]: audit 2021-03-10T16:21:53.536849+0000 mon.a (mon.0) 1847 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:21:54.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:21:53 gibba045 bash[25517]: audit 2021-03-10T16:21:53.537024+0000 mon.a (mon.0) 1848 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:21:54.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:21:53 gibba045 bash[25517]: audit 2021-03-10T16:21:53.537236+0000 mon.a (mon.0) 1849 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:21:55.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:21:54 gibba015 bash[29377]: cluster 2021-03-10T16:21:53.653566+0000 mgr.gibba045.orlgmj (mgr.34412) 8082 : cluster [DBG] pgmap v4602: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:55.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:21:54 gibba015 bash[30343]: cluster 2021-03-10T16:21:53.653566+0000 mgr.gibba045.orlgmj (mgr.34412) 8082 : cluster [DBG] pgmap v4602: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:55.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:21:54 gibba045 bash[25517]: cluster 2021-03-10T16:21:53.653566+0000 mgr.gibba045.orlgmj (mgr.34412) 8082 : cluster [DBG] pgmap v4602: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:57.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:21:56 gibba015 bash[29377]: cluster 2021-03-10T16:21:55.655142+0000 mgr.gibba045.orlgmj (mgr.34412) 8083 : cluster [DBG] pgmap v4603: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:57.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:21:56 gibba015 bash[30343]: cluster 2021-03-10T16:21:55.655142+0000 mgr.gibba045.orlgmj (mgr.34412) 8083 : cluster [DBG] pgmap v4603: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:57.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:21:56 gibba045 bash[25517]: cluster 2021-03-10T16:21:55.655142+0000 mgr.gibba045.orlgmj (mgr.34412) 8083 : cluster [DBG] pgmap v4603: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:59.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:21:58 gibba045 bash[25517]: cluster 2021-03-10T16:21:57.656891+0000 mgr.gibba045.orlgmj (mgr.34412) 8084 : cluster [DBG] pgmap v4604: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:59.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:21:58 gibba015 bash[29377]: cluster 2021-03-10T16:21:57.656891+0000 mgr.gibba045.orlgmj (mgr.34412) 8084 : cluster [DBG] pgmap v4604: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:59.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:21:58 gibba015 bash[30343]: cluster 2021-03-10T16:21:57.656891+0000 mgr.gibba045.orlgmj (mgr.34412) 8084 : cluster [DBG] pgmap v4604: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:01.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:22:00 gibba045 bash[25517]: cluster 2021-03-10T16:21:59.658234+0000 mgr.gibba045.orlgmj (mgr.34412) 8085 : cluster [DBG] pgmap v4605: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:01.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:22:00 gibba015 bash[29377]: cluster 2021-03-10T16:21:59.658234+0000 mgr.gibba045.orlgmj (mgr.34412) 8085 : cluster [DBG] pgmap v4605: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:01.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:22:00 gibba015 bash[30343]: cluster 2021-03-10T16:21:59.658234+0000 mgr.gibba045.orlgmj (mgr.34412) 8085 : cluster [DBG] pgmap v4605: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:03.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:22:02 gibba045 bash[25517]: cluster 2021-03-10T16:22:01.660095+0000 mgr.gibba045.orlgmj (mgr.34412) 8086 : cluster [DBG] pgmap v4606: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:03.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:22:02 gibba015 bash[29377]: cluster 2021-03-10T16:22:01.660095+0000 mgr.gibba045.orlgmj (mgr.34412) 8086 : cluster [DBG] pgmap v4606: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:03.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:22:02 gibba015 bash[30343]: cluster 2021-03-10T16:22:01.660095+0000 mgr.gibba045.orlgmj (mgr.34412) 8086 : cluster [DBG] pgmap v4606: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:04.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:22:04 gibba045 bash[25517]: cephadm 2021-03-10T16:22:02.719577+0000 mgr.gibba045.orlgmj (mgr.34412) 8087 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:22:04.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:22:04 gibba015 bash[29377]: cephadm 2021-03-10T16:22:02.719577+0000 mgr.gibba045.orlgmj (mgr.34412) 8087 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:22:04.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:22:04 gibba015 bash[30343]: cephadm 2021-03-10T16:22:02.719577+0000 mgr.gibba045.orlgmj (mgr.34412) 8087 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:22:05.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:22:05 gibba045 bash[25517]: cluster 2021-03-10T16:22:03.661612+0000 mgr.gibba045.orlgmj (mgr.34412) 8088 : cluster [DBG] pgmap v4607: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:05.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:22:05 gibba015 bash[29377]: cluster 2021-03-10T16:22:03.661612+0000 mgr.gibba045.orlgmj (mgr.34412) 8088 : cluster [DBG] pgmap v4607: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:05.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:22:05 gibba015 bash[30343]: cluster 2021-03-10T16:22:03.661612+0000 mgr.gibba045.orlgmj (mgr.34412) 8088 : cluster [DBG] pgmap v4607: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:07.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:22:07 gibba045 bash[25517]: cluster 2021-03-10T16:22:05.663248+0000 mgr.gibba045.orlgmj (mgr.34412) 8089 : cluster [DBG] pgmap v4608: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:07.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:22:07 gibba015 bash[29377]: cluster 2021-03-10T16:22:05.663248+0000 mgr.gibba045.orlgmj (mgr.34412) 8089 : cluster [DBG] pgmap v4608: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:07.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:22:07 gibba015 bash[30343]: cluster 2021-03-10T16:22:05.663248+0000 mgr.gibba045.orlgmj (mgr.34412) 8089 : cluster [DBG] pgmap v4608: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:09.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:22:09 gibba045 bash[25517]: cluster 2021-03-10T16:22:07.664772+0000 mgr.gibba045.orlgmj (mgr.34412) 8090 : cluster [DBG] pgmap v4609: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:09.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:22:09 gibba015 bash[29377]: cluster 2021-03-10T16:22:07.664772+0000 mgr.gibba045.orlgmj (mgr.34412) 8090 : cluster [DBG] pgmap v4609: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:09.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:22:09 gibba015 bash[30343]: cluster 2021-03-10T16:22:07.664772+0000 mgr.gibba045.orlgmj (mgr.34412) 8090 : cluster [DBG] pgmap v4609: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:11.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:22:11 gibba045 bash[25517]: cluster 2021-03-10T16:22:09.665620+0000 mgr.gibba045.orlgmj (mgr.34412) 8091 : cluster [DBG] pgmap v4610: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:11.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:22:11 gibba015 bash[29377]: cluster 2021-03-10T16:22:09.665620+0000 mgr.gibba045.orlgmj (mgr.34412) 8091 : cluster [DBG] pgmap v4610: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:11.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:22:11 gibba015 bash[30343]: cluster 2021-03-10T16:22:09.665620+0000 mgr.gibba045.orlgmj (mgr.34412) 8091 : cluster [DBG] pgmap v4610: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:13.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:22:13 gibba045 bash[25517]: cluster 2021-03-10T16:22:11.667205+0000 mgr.gibba045.orlgmj (mgr.34412) 8092 : cluster [DBG] pgmap v4611: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:13.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:22:13 gibba015 bash[29377]: cluster 2021-03-10T16:22:11.667205+0000 mgr.gibba045.orlgmj (mgr.34412) 8092 : cluster [DBG] pgmap v4611: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:13.572 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:22:13 gibba015 bash[30343]: cluster 2021-03-10T16:22:11.667205+0000 mgr.gibba045.orlgmj (mgr.34412) 8092 : cluster [DBG] pgmap v4611: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:15.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:22:15 gibba015 bash[29377]: cluster 2021-03-10T16:22:13.668716+0000 mgr.gibba045.orlgmj (mgr.34412) 8093 : cluster [DBG] pgmap v4612: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:15.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:22:15 gibba015 bash[30343]: cluster 2021-03-10T16:22:13.668716+0000 mgr.gibba045.orlgmj (mgr.34412) 8093 : cluster [DBG] pgmap v4612: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:15.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:22:15 gibba045 bash[25517]: cluster 2021-03-10T16:22:13.668716+0000 mgr.gibba045.orlgmj (mgr.34412) 8093 : cluster [DBG] pgmap v4612: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:15.640 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:22:15.868 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:22:15.868 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 6m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:22:15.868 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 5m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:22:15.868 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:22:15.869 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:22:15.869 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:22:15.869 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:22:15.869 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:22:15.870 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:22:15.870 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 6m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:22:15.870 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 5m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:22:15.870 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:22:15.871 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:22:15.871 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:22:15.871 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:22:15.871 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:22:15.871 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:22:15.872 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:22:15.872 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:22:15.872 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 5m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:22:15.872 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 5m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:22:16.118 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:22:16.118 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:22:16.119 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:22:16.119 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:22:16.119 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:22:16.119 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:22:16.120 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:22:16.120 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:22:16.120 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:22:16.120 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:22:16.121 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:22:16.121 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:22:16.121 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:22:16.121 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:22:16.121 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:22:17.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:22:17 gibba015 bash[29377]: audit 2021-03-10T16:22:15.634955+0000 mgr.gibba045.orlgmj (mgr.34412) 8094 : audit [DBG] from='client.49488 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:22:17.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:22:17 gibba015 bash[29377]: cluster 2021-03-10T16:22:15.670035+0000 mgr.gibba045.orlgmj (mgr.34412) 8095 : cluster [DBG] pgmap v4613: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:17.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:22:17 gibba015 bash[29377]: audit 2021-03-10T16:22:15.857975+0000 mgr.gibba045.orlgmj (mgr.34412) 8096 : audit [DBG] from='client.59482 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:22:17.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:22:17 gibba015 bash[29377]: audit 2021-03-10T16:22:16.118732+0000 mon.a (mon.0) 1850 : audit [DBG] from='client.? 172.21.2.115:0/1979721811' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:22:17.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:22:17 gibba015 bash[30343]: audit 2021-03-10T16:22:15.634955+0000 mgr.gibba045.orlgmj (mgr.34412) 8094 : audit [DBG] from='client.49488 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:22:17.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:22:17 gibba015 bash[30343]: cluster 2021-03-10T16:22:15.670035+0000 mgr.gibba045.orlgmj (mgr.34412) 8095 : cluster [DBG] pgmap v4613: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:17.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:22:17 gibba015 bash[30343]: audit 2021-03-10T16:22:15.857975+0000 mgr.gibba045.orlgmj (mgr.34412) 8096 : audit [DBG] from='client.59482 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:22:17.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:22:17 gibba015 bash[30343]: audit 2021-03-10T16:22:16.118732+0000 mon.a (mon.0) 1850 : audit [DBG] from='client.? 172.21.2.115:0/1979721811' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:22:17.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:22:17 gibba045 bash[25517]: audit 2021-03-10T16:22:15.634955+0000 mgr.gibba045.orlgmj (mgr.34412) 8094 : audit [DBG] from='client.49488 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:22:17.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:22:17 gibba045 bash[25517]: cluster 2021-03-10T16:22:15.670035+0000 mgr.gibba045.orlgmj (mgr.34412) 8095 : cluster [DBG] pgmap v4613: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:17.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:22:17 gibba045 bash[25517]: audit 2021-03-10T16:22:15.857975+0000 mgr.gibba045.orlgmj (mgr.34412) 8096 : audit [DBG] from='client.59482 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:22:17.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:22:17 gibba045 bash[25517]: audit 2021-03-10T16:22:16.118732+0000 mon.a (mon.0) 1850 : audit [DBG] from='client.? 172.21.2.115:0/1979721811' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:22:18.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:22:18 gibba045 bash[25517]: audit 2021-03-10T16:22:17.723686+0000 mon.c (mon.1) 2243 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:22:18.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:22:18 gibba045 bash[25517]: audit 2021-03-10T16:22:17.960130+0000 mon.a (mon.0) 1851 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:22:18.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:22:18 gibba045 bash[25517]: audit 2021-03-10T16:22:17.963852+0000 mon.c (mon.1) 2244 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:22:18.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:22:18 gibba045 bash[25517]: audit 2021-03-10T16:22:17.965023+0000 mon.c (mon.1) 2245 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:22:18.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:22:18 gibba045 bash[25517]: audit 2021-03-10T16:22:17.966587+0000 mon.c (mon.1) 2246 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:22:18.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:22:18 gibba045 bash[25517]: audit 2021-03-10T16:22:17.968031+0000 mon.c (mon.1) 2247 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:22:18.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:22:18 gibba045 bash[25517]: audit 2021-03-10T16:22:17.971478+0000 mon.c (mon.1) 2248 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:22:18.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:22:18 gibba045 bash[25517]: audit 2021-03-10T16:22:17.973344+0000 mon.c (mon.1) 2249 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:22:18.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:22:18 gibba015 bash[29377]: audit 2021-03-10T16:22:17.723686+0000 mon.c (mon.1) 2243 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:22:18.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:22:18 gibba015 bash[29377]: audit 2021-03-10T16:22:17.960130+0000 mon.a (mon.0) 1851 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:22:18.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:22:18 gibba015 bash[29377]: audit 2021-03-10T16:22:17.963852+0000 mon.c (mon.1) 2244 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:22:18.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:22:18 gibba015 bash[29377]: audit 2021-03-10T16:22:17.965023+0000 mon.c (mon.1) 2245 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:22:18.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:22:18 gibba015 bash[29377]: audit 2021-03-10T16:22:17.966587+0000 mon.c (mon.1) 2246 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:22:18.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:22:18 gibba015 bash[29377]: audit 2021-03-10T16:22:17.968031+0000 mon.c (mon.1) 2247 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:22:18.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:22:18 gibba015 bash[29377]: audit 2021-03-10T16:22:17.971478+0000 mon.c (mon.1) 2248 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:22:18.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:22:18 gibba015 bash[29377]: audit 2021-03-10T16:22:17.973344+0000 mon.c (mon.1) 2249 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:22:18.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:22:18 gibba015 bash[30343]: audit 2021-03-10T16:22:17.723686+0000 mon.c (mon.1) 2243 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:22:18.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:22:18 gibba015 bash[30343]: audit 2021-03-10T16:22:17.960130+0000 mon.a (mon.0) 1851 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:22:18.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:22:18 gibba015 bash[30343]: audit 2021-03-10T16:22:17.963852+0000 mon.c (mon.1) 2244 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:22:18.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:22:18 gibba015 bash[30343]: audit 2021-03-10T16:22:17.965023+0000 mon.c (mon.1) 2245 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:22:18.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:22:18 gibba015 bash[30343]: audit 2021-03-10T16:22:17.966587+0000 mon.c (mon.1) 2246 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:22:18.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:22:18 gibba015 bash[30343]: audit 2021-03-10T16:22:17.968031+0000 mon.c (mon.1) 2247 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:22:18.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:22:18 gibba015 bash[30343]: audit 2021-03-10T16:22:17.971478+0000 mon.c (mon.1) 2248 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:22:18.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:22:18 gibba015 bash[30343]: audit 2021-03-10T16:22:17.973344+0000 mon.c (mon.1) 2249 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:22:19.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:22:19 gibba015 bash[29377]: cluster 2021-03-10T16:22:17.671555+0000 mgr.gibba045.orlgmj (mgr.34412) 8097 : cluster [DBG] pgmap v4614: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:19.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:22:19 gibba015 bash[29377]: cephadm 2021-03-10T16:22:17.731426+0000 mgr.gibba045.orlgmj (mgr.34412) 8098 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:22:19.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:22:19 gibba015 bash[29377]: cephadm 2021-03-10T16:22:17.733343+0000 mgr.gibba045.orlgmj (mgr.34412) 8099 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:22:19.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:22:19 gibba015 bash[29377]: cephadm 2021-03-10T16:22:17.965612+0000 mgr.gibba045.orlgmj (mgr.34412) 8100 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:22:19.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:22:19 gibba015 bash[29377]: cephadm 2021-03-10T16:22:17.967243+0000 mgr.gibba045.orlgmj (mgr.34412) 8101 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:22:19.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:22:19 gibba015 bash[29377]: cephadm 2021-03-10T16:22:17.968569+0000 mgr.gibba045.orlgmj (mgr.34412) 8102 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:22:19.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:22:19 gibba015 bash[29377]: cephadm 2021-03-10T16:22:17.968611+0000 mgr.gibba045.orlgmj (mgr.34412) 8103 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:22:19.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:22:19 gibba015 bash[29377]: cephadm 2021-03-10T16:22:17.970102+0000 mgr.gibba045.orlgmj (mgr.34412) 8104 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:22:19.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:22:19 gibba015 bash[29377]: cephadm 2021-03-10T16:22:17.970145+0000 mgr.gibba045.orlgmj (mgr.34412) 8105 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:22:19.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:22:19 gibba015 bash[29377]: cephadm 2021-03-10T16:22:17.971570+0000 mgr.gibba045.orlgmj (mgr.34412) 8106 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:22:19.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:22:19 gibba015 bash[29377]: cephadm 2021-03-10T16:22:17.973372+0000 mgr.gibba045.orlgmj (mgr.34412) 8107 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:22:19.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:22:19 gibba015 bash[29377]: cephadm 2021-03-10T16:22:17.973415+0000 mgr.gibba045.orlgmj (mgr.34412) 8108 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:22:19.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:22:19 gibba015 bash[29377]: cephadm 2021-03-10T16:22:17.974999+0000 mgr.gibba045.orlgmj (mgr.34412) 8109 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:22:19.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:22:19 gibba015 bash[29377]: cephadm 2021-03-10T16:22:17.975379+0000 mgr.gibba045.orlgmj (mgr.34412) 8110 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:22:19.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:22:19 gibba015 bash[29377]: cephadm 2021-03-10T16:22:17.976934+0000 mgr.gibba045.orlgmj (mgr.34412) 8111 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:22:19.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:22:19 gibba015 bash[29377]: cephadm 2021-03-10T16:22:17.976985+0000 mgr.gibba045.orlgmj (mgr.34412) 8112 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:22:19.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:22:19 gibba015 bash[29377]: cephadm 2021-03-10T16:22:17.977122+0000 mgr.gibba045.orlgmj (mgr.34412) 8113 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:22:19.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:22:19 gibba015 bash[30343]: cluster 2021-03-10T16:22:17.671555+0000 mgr.gibba045.orlgmj (mgr.34412) 8097 : cluster [DBG] pgmap v4614: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:19.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:22:19 gibba015 bash[30343]: cephadm 2021-03-10T16:22:17.731426+0000 mgr.gibba045.orlgmj (mgr.34412) 8098 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:22:19.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:22:19 gibba015 bash[30343]: cephadm 2021-03-10T16:22:17.733343+0000 mgr.gibba045.orlgmj (mgr.34412) 8099 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:22:19.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:22:19 gibba015 bash[30343]: cephadm 2021-03-10T16:22:17.965612+0000 mgr.gibba045.orlgmj (mgr.34412) 8100 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:22:19.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:22:19 gibba015 bash[30343]: cephadm 2021-03-10T16:22:17.967243+0000 mgr.gibba045.orlgmj (mgr.34412) 8101 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:22:19.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:22:19 gibba015 bash[30343]: cephadm 2021-03-10T16:22:17.968569+0000 mgr.gibba045.orlgmj (mgr.34412) 8102 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:22:19.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:22:19 gibba015 bash[30343]: cephadm 2021-03-10T16:22:17.968611+0000 mgr.gibba045.orlgmj (mgr.34412) 8103 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:22:19.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:22:19 gibba015 bash[30343]: cephadm 2021-03-10T16:22:17.970102+0000 mgr.gibba045.orlgmj (mgr.34412) 8104 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:22:19.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:22:19 gibba015 bash[30343]: cephadm 2021-03-10T16:22:17.970145+0000 mgr.gibba045.orlgmj (mgr.34412) 8105 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:22:19.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:22:19 gibba015 bash[30343]: cephadm 2021-03-10T16:22:17.971570+0000 mgr.gibba045.orlgmj (mgr.34412) 8106 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:22:19.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:22:19 gibba015 bash[30343]: cephadm 2021-03-10T16:22:17.973372+0000 mgr.gibba045.orlgmj (mgr.34412) 8107 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:22:19.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:22:19 gibba015 bash[30343]: cephadm 2021-03-10T16:22:17.973415+0000 mgr.gibba045.orlgmj (mgr.34412) 8108 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:22:19.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:22:19 gibba015 bash[30343]: cephadm 2021-03-10T16:22:17.974999+0000 mgr.gibba045.orlgmj (mgr.34412) 8109 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:22:19.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:22:19 gibba015 bash[30343]: cephadm 2021-03-10T16:22:17.975379+0000 mgr.gibba045.orlgmj (mgr.34412) 8110 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:22:19.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:22:19 gibba015 bash[30343]: cephadm 2021-03-10T16:22:17.976934+0000 mgr.gibba045.orlgmj (mgr.34412) 8111 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:22:19.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:22:19 gibba015 bash[30343]: cephadm 2021-03-10T16:22:17.976985+0000 mgr.gibba045.orlgmj (mgr.34412) 8112 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:22:19.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:22:19 gibba015 bash[30343]: cephadm 2021-03-10T16:22:17.977122+0000 mgr.gibba045.orlgmj (mgr.34412) 8113 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:22:19.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:22:19 gibba045 bash[25517]: cluster 2021-03-10T16:22:17.671555+0000 mgr.gibba045.orlgmj (mgr.34412) 8097 : cluster [DBG] pgmap v4614: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:19.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:22:19 gibba045 bash[25517]: cephadm 2021-03-10T16:22:17.731426+0000 mgr.gibba045.orlgmj (mgr.34412) 8098 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:22:19.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:22:19 gibba045 bash[25517]: cephadm 2021-03-10T16:22:17.733343+0000 mgr.gibba045.orlgmj (mgr.34412) 8099 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:22:19.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:22:19 gibba045 bash[25517]: cephadm 2021-03-10T16:22:17.965612+0000 mgr.gibba045.orlgmj (mgr.34412) 8100 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:22:19.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:22:19 gibba045 bash[25517]: cephadm 2021-03-10T16:22:17.967243+0000 mgr.gibba045.orlgmj (mgr.34412) 8101 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:22:19.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:22:19 gibba045 bash[25517]: cephadm 2021-03-10T16:22:17.968569+0000 mgr.gibba045.orlgmj (mgr.34412) 8102 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:22:19.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:22:19 gibba045 bash[25517]: cephadm 2021-03-10T16:22:17.968611+0000 mgr.gibba045.orlgmj (mgr.34412) 8103 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:22:19.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:22:19 gibba045 bash[25517]: cephadm 2021-03-10T16:22:17.970102+0000 mgr.gibba045.orlgmj (mgr.34412) 8104 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:22:19.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:22:19 gibba045 bash[25517]: cephadm 2021-03-10T16:22:17.970145+0000 mgr.gibba045.orlgmj (mgr.34412) 8105 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:22:19.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:22:19 gibba045 bash[25517]: cephadm 2021-03-10T16:22:17.971570+0000 mgr.gibba045.orlgmj (mgr.34412) 8106 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:22:19.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:22:19 gibba045 bash[25517]: cephadm 2021-03-10T16:22:17.973372+0000 mgr.gibba045.orlgmj (mgr.34412) 8107 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:22:19.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:22:19 gibba045 bash[25517]: cephadm 2021-03-10T16:22:17.973415+0000 mgr.gibba045.orlgmj (mgr.34412) 8108 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:22:19.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:22:19 gibba045 bash[25517]: cephadm 2021-03-10T16:22:17.974999+0000 mgr.gibba045.orlgmj (mgr.34412) 8109 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:22:19.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:22:19 gibba045 bash[25517]: cephadm 2021-03-10T16:22:17.975379+0000 mgr.gibba045.orlgmj (mgr.34412) 8110 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:22:19.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:22:19 gibba045 bash[25517]: cephadm 2021-03-10T16:22:17.976934+0000 mgr.gibba045.orlgmj (mgr.34412) 8111 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:22:19.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:22:19 gibba045 bash[25517]: cephadm 2021-03-10T16:22:17.976985+0000 mgr.gibba045.orlgmj (mgr.34412) 8112 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:22:19.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:22:19 gibba045 bash[25517]: cephadm 2021-03-10T16:22:17.977122+0000 mgr.gibba045.orlgmj (mgr.34412) 8113 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:22:21.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:22:21 gibba015 bash[29377]: cluster 2021-03-10T16:22:19.672388+0000 mgr.gibba045.orlgmj (mgr.34412) 8114 : cluster [DBG] pgmap v4615: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:21.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:22:21 gibba015 bash[30343]: cluster 2021-03-10T16:22:19.672388+0000 mgr.gibba045.orlgmj (mgr.34412) 8114 : cluster [DBG] pgmap v4615: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:21.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:22:21 gibba045 bash[25517]: cluster 2021-03-10T16:22:19.672388+0000 mgr.gibba045.orlgmj (mgr.34412) 8114 : cluster [DBG] pgmap v4615: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:23.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:22:23 gibba015 bash[29377]: cluster 2021-03-10T16:22:21.674150+0000 mgr.gibba045.orlgmj (mgr.34412) 8115 : cluster [DBG] pgmap v4616: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:23.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:22:23 gibba015 bash[30343]: cluster 2021-03-10T16:22:21.674150+0000 mgr.gibba045.orlgmj (mgr.34412) 8115 : cluster [DBG] pgmap v4616: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:23.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:22:23 gibba045 bash[25517]: cluster 2021-03-10T16:22:21.674150+0000 mgr.gibba045.orlgmj (mgr.34412) 8115 : cluster [DBG] pgmap v4616: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:25.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:22:25 gibba015 bash[29377]: cluster 2021-03-10T16:22:23.675672+0000 mgr.gibba045.orlgmj (mgr.34412) 8116 : cluster [DBG] pgmap v4617: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:25.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:22:25 gibba015 bash[30343]: cluster 2021-03-10T16:22:23.675672+0000 mgr.gibba045.orlgmj (mgr.34412) 8116 : cluster [DBG] pgmap v4617: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:25.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:22:25 gibba045 bash[25517]: cluster 2021-03-10T16:22:23.675672+0000 mgr.gibba045.orlgmj (mgr.34412) 8116 : cluster [DBG] pgmap v4617: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:27.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:22:27 gibba015 bash[29377]: cluster 2021-03-10T16:22:25.677375+0000 mgr.gibba045.orlgmj (mgr.34412) 8117 : cluster [DBG] pgmap v4618: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:27.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:22:27 gibba015 bash[30343]: cluster 2021-03-10T16:22:25.677375+0000 mgr.gibba045.orlgmj (mgr.34412) 8117 : cluster [DBG] pgmap v4618: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:27.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:22:27 gibba045 bash[25517]: cluster 2021-03-10T16:22:25.677375+0000 mgr.gibba045.orlgmj (mgr.34412) 8117 : cluster [DBG] pgmap v4618: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:29.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:22:29 gibba015 bash[29377]: cluster 2021-03-10T16:22:27.678714+0000 mgr.gibba045.orlgmj (mgr.34412) 8118 : cluster [DBG] pgmap v4619: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:29.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:22:29 gibba015 bash[30343]: cluster 2021-03-10T16:22:27.678714+0000 mgr.gibba045.orlgmj (mgr.34412) 8118 : cluster [DBG] pgmap v4619: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:29.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:22:29 gibba045 bash[25517]: cluster 2021-03-10T16:22:27.678714+0000 mgr.gibba045.orlgmj (mgr.34412) 8118 : cluster [DBG] pgmap v4619: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:31.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:22:31 gibba015 bash[29377]: cluster 2021-03-10T16:22:29.679548+0000 mgr.gibba045.orlgmj (mgr.34412) 8119 : cluster [DBG] pgmap v4620: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:31.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:22:31 gibba015 bash[30343]: cluster 2021-03-10T16:22:29.679548+0000 mgr.gibba045.orlgmj (mgr.34412) 8119 : cluster [DBG] pgmap v4620: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:31.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:22:31 gibba045 bash[25517]: cluster 2021-03-10T16:22:29.679548+0000 mgr.gibba045.orlgmj (mgr.34412) 8119 : cluster [DBG] pgmap v4620: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:33.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:22:33 gibba045 bash[25517]: cluster 2021-03-10T16:22:31.681410+0000 mgr.gibba045.orlgmj (mgr.34412) 8120 : cluster [DBG] pgmap v4621: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:33.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:22:33 gibba015 bash[29377]: cluster 2021-03-10T16:22:31.681410+0000 mgr.gibba045.orlgmj (mgr.34412) 8120 : cluster [DBG] pgmap v4621: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:33.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:22:33 gibba015 bash[30343]: cluster 2021-03-10T16:22:31.681410+0000 mgr.gibba045.orlgmj (mgr.34412) 8120 : cluster [DBG] pgmap v4621: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:34.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:22:34 gibba015 bash[29377]: cephadm 2021-03-10T16:22:32.993130+0000 mgr.gibba045.orlgmj (mgr.34412) 8121 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:22:34.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:22:34 gibba015 bash[30343]: cephadm 2021-03-10T16:22:32.993130+0000 mgr.gibba045.orlgmj (mgr.34412) 8121 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:22:34.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:22:34 gibba045 bash[25517]: cephadm 2021-03-10T16:22:32.993130+0000 mgr.gibba045.orlgmj (mgr.34412) 8121 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:22:35.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:22:35 gibba015 bash[29377]: cluster 2021-03-10T16:22:33.682867+0000 mgr.gibba045.orlgmj (mgr.34412) 8122 : cluster [DBG] pgmap v4622: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:35.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:22:35 gibba015 bash[30343]: cluster 2021-03-10T16:22:33.682867+0000 mgr.gibba045.orlgmj (mgr.34412) 8122 : cluster [DBG] pgmap v4622: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:35.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:22:35 gibba045 bash[25517]: cluster 2021-03-10T16:22:33.682867+0000 mgr.gibba045.orlgmj (mgr.34412) 8122 : cluster [DBG] pgmap v4622: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:37.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:22:37 gibba015 bash[29377]: cluster 2021-03-10T16:22:35.684404+0000 mgr.gibba045.orlgmj (mgr.34412) 8123 : cluster [DBG] pgmap v4623: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:37.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:22:37 gibba015 bash[30343]: cluster 2021-03-10T16:22:35.684404+0000 mgr.gibba045.orlgmj (mgr.34412) 8123 : cluster [DBG] pgmap v4623: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:37.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:22:37 gibba045 bash[25517]: cluster 2021-03-10T16:22:35.684404+0000 mgr.gibba045.orlgmj (mgr.34412) 8123 : cluster [DBG] pgmap v4623: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:39.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:22:39 gibba015 bash[29377]: cluster 2021-03-10T16:22:37.685947+0000 mgr.gibba045.orlgmj (mgr.34412) 8124 : cluster [DBG] pgmap v4624: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:39.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:22:39 gibba015 bash[30343]: cluster 2021-03-10T16:22:37.685947+0000 mgr.gibba045.orlgmj (mgr.34412) 8124 : cluster [DBG] pgmap v4624: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:39.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:22:39 gibba045 bash[25517]: cluster 2021-03-10T16:22:37.685947+0000 mgr.gibba045.orlgmj (mgr.34412) 8124 : cluster [DBG] pgmap v4624: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:41.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:22:41 gibba015 bash[29377]: cluster 2021-03-10T16:22:39.686756+0000 mgr.gibba045.orlgmj (mgr.34412) 8125 : cluster [DBG] pgmap v4625: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:41.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:22:41 gibba015 bash[30343]: cluster 2021-03-10T16:22:39.686756+0000 mgr.gibba045.orlgmj (mgr.34412) 8125 : cluster [DBG] pgmap v4625: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:41.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:22:41 gibba045 bash[25517]: cluster 2021-03-10T16:22:39.686756+0000 mgr.gibba045.orlgmj (mgr.34412) 8125 : cluster [DBG] pgmap v4625: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:43.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:22:43 gibba015 bash[29377]: cluster 2021-03-10T16:22:41.688523+0000 mgr.gibba045.orlgmj (mgr.34412) 8126 : cluster [DBG] pgmap v4626: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:43.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:22:43 gibba015 bash[30343]: cluster 2021-03-10T16:22:41.688523+0000 mgr.gibba045.orlgmj (mgr.34412) 8126 : cluster [DBG] pgmap v4626: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:43.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:22:43 gibba045 bash[25517]: cluster 2021-03-10T16:22:41.688523+0000 mgr.gibba045.orlgmj (mgr.34412) 8126 : cluster [DBG] pgmap v4626: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:45.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:22:45 gibba015 bash[29377]: cluster 2021-03-10T16:22:43.689930+0000 mgr.gibba045.orlgmj (mgr.34412) 8127 : cluster [DBG] pgmap v4627: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:45.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:22:45 gibba015 bash[30343]: cluster 2021-03-10T16:22:43.689930+0000 mgr.gibba045.orlgmj (mgr.34412) 8127 : cluster [DBG] pgmap v4627: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:45.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:22:45 gibba045 bash[25517]: cluster 2021-03-10T16:22:43.689930+0000 mgr.gibba045.orlgmj (mgr.34412) 8127 : cluster [DBG] pgmap v4627: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:46.361 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:22:46.587 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:22:46.587 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 6m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:22:46.588 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 5m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:22:46.588 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:22:46.588 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:22:46.588 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:22:46.589 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:22:46.589 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:22:46.589 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:22:46.589 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 6m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:22:46.590 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 5m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:22:46.590 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:22:46.590 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:22:46.590 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:22:46.591 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:22:46.591 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:22:46.591 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:22:46.591 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:22:46.591 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:22:46.592 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 5m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:22:46.592 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 5m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:22:46.833 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:22:46.834 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:22:46.834 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:22:46.834 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:22:46.834 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:22:46.835 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:22:46.835 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:22:46.835 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:22:46.835 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:22:46.835 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:22:46.836 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:22:46.836 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:22:46.836 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:22:46.836 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:22:46.837 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:22:47.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:22:47 gibba015 bash[29377]: cluster 2021-03-10T16:22:45.691532+0000 mgr.gibba045.orlgmj (mgr.34412) 8128 : cluster [DBG] pgmap v4628: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:47.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:22:47 gibba015 bash[29377]: audit 2021-03-10T16:22:46.834007+0000 mon.c (mon.1) 2250 : audit [DBG] from='client.? 172.21.2.115:0/2020796764' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:22:47.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:22:47 gibba015 bash[30343]: cluster 2021-03-10T16:22:45.691532+0000 mgr.gibba045.orlgmj (mgr.34412) 8128 : cluster [DBG] pgmap v4628: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:47.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:22:47 gibba015 bash[30343]: audit 2021-03-10T16:22:46.834007+0000 mon.c (mon.1) 2250 : audit [DBG] from='client.? 172.21.2.115:0/2020796764' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:22:47.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:22:47 gibba045 bash[25517]: cluster 2021-03-10T16:22:45.691532+0000 mgr.gibba045.orlgmj (mgr.34412) 8128 : cluster [DBG] pgmap v4628: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:47.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:22:47 gibba045 bash[25517]: audit 2021-03-10T16:22:46.834007+0000 mon.c (mon.1) 2250 : audit [DBG] from='client.? 172.21.2.115:0/2020796764' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:22:48.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:22:48 gibba045 bash[25517]: audit 2021-03-10T16:22:46.355154+0000 mgr.gibba045.orlgmj (mgr.34412) 8129 : audit [DBG] from='client.59494 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:22:48.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:22:48 gibba045 bash[25517]: audit 2021-03-10T16:22:46.578413+0000 mgr.gibba045.orlgmj (mgr.34412) 8130 : audit [DBG] from='client.49512 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:22:48.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:22:48 gibba015 bash[29377]: audit 2021-03-10T16:22:46.355154+0000 mgr.gibba045.orlgmj (mgr.34412) 8129 : audit [DBG] from='client.59494 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:22:48.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:22:48 gibba015 bash[29377]: audit 2021-03-10T16:22:46.578413+0000 mgr.gibba045.orlgmj (mgr.34412) 8130 : audit [DBG] from='client.49512 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:22:48.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:22:48 gibba015 bash[30343]: audit 2021-03-10T16:22:46.355154+0000 mgr.gibba045.orlgmj (mgr.34412) 8129 : audit [DBG] from='client.59494 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:22:48.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:22:48 gibba015 bash[30343]: audit 2021-03-10T16:22:46.578413+0000 mgr.gibba045.orlgmj (mgr.34412) 8130 : audit [DBG] from='client.49512 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:22:49.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:22:49 gibba045 bash[25517]: cluster 2021-03-10T16:22:47.693101+0000 mgr.gibba045.orlgmj (mgr.34412) 8131 : cluster [DBG] pgmap v4629: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:49.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:22:49 gibba045 bash[25517]: cephadm 2021-03-10T16:22:48.005397+0000 mgr.gibba045.orlgmj (mgr.34412) 8132 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:22:49.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:22:49 gibba015 bash[29377]: cluster 2021-03-10T16:22:47.693101+0000 mgr.gibba045.orlgmj (mgr.34412) 8131 : cluster [DBG] pgmap v4629: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:49.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:22:49 gibba015 bash[29377]: cephadm 2021-03-10T16:22:48.005397+0000 mgr.gibba045.orlgmj (mgr.34412) 8132 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:22:49.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:22:49 gibba015 bash[30343]: cluster 2021-03-10T16:22:47.693101+0000 mgr.gibba045.orlgmj (mgr.34412) 8131 : cluster [DBG] pgmap v4629: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:49.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:22:49 gibba015 bash[30343]: cephadm 2021-03-10T16:22:48.005397+0000 mgr.gibba045.orlgmj (mgr.34412) 8132 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:22:51.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:22:51 gibba045 bash[25517]: cluster 2021-03-10T16:22:49.694080+0000 mgr.gibba045.orlgmj (mgr.34412) 8133 : cluster [DBG] pgmap v4630: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:51.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:22:51 gibba015 bash[29377]: cluster 2021-03-10T16:22:49.694080+0000 mgr.gibba045.orlgmj (mgr.34412) 8133 : cluster [DBG] pgmap v4630: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:51.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:22:51 gibba015 bash[30343]: cluster 2021-03-10T16:22:49.694080+0000 mgr.gibba045.orlgmj (mgr.34412) 8133 : cluster [DBG] pgmap v4630: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:53.552 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:22:53 gibba045 bash[25517]: cluster 2021-03-10T16:22:51.695703+0000 mgr.gibba045.orlgmj (mgr.34412) 8134 : cluster [DBG] pgmap v4631: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:53.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:22:53 gibba015 bash[29377]: cluster 2021-03-10T16:22:51.695703+0000 mgr.gibba045.orlgmj (mgr.34412) 8134 : cluster [DBG] pgmap v4631: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:53.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:22:53 gibba015 bash[30343]: cluster 2021-03-10T16:22:51.695703+0000 mgr.gibba045.orlgmj (mgr.34412) 8134 : cluster [DBG] pgmap v4631: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:54.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:22:54 gibba045 bash[25517]: audit 2021-03-10T16:22:53.539081+0000 mon.c (mon.1) 2251 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:22:54.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:22:54 gibba045 bash[25517]: audit 2021-03-10T16:22:53.539897+0000 mon.c (mon.1) 2252 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:22:54.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:22:54 gibba045 bash[25517]: audit 2021-03-10T16:22:53.540222+0000 mon.a (mon.0) 1852 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:22:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:22:54 gibba045 bash[25517]: audit 2021-03-10T16:22:53.540821+0000 mon.c (mon.1) 2253 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T16:22:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:22:54 gibba045 bash[25517]: audit 2021-03-10T16:22:53.541634+0000 mon.a (mon.0) 1853 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:22:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:22:54 gibba045 bash[25517]: audit 2021-03-10T16:22:53.541947+0000 mon.c (mon.1) 2254 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:22:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:22:54 gibba045 bash[25517]: audit 2021-03-10T16:22:53.542769+0000 mon.a (mon.0) 1854 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T16:22:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:22:54 gibba045 bash[25517]: audit 2021-03-10T16:22:53.543130+0000 mon.c (mon.1) 2255 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:22:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:22:54 gibba045 bash[25517]: audit 2021-03-10T16:22:53.543871+0000 mon.a (mon.0) 1855 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:22:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:22:54 gibba045 bash[25517]: audit 2021-03-10T16:22:53.544143+0000 mon.c (mon.1) 2256 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:22:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:22:54 gibba045 bash[25517]: audit 2021-03-10T16:22:53.544285+0000 mon.a (mon.0) 1856 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:22:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:22:54 gibba045 bash[25517]: audit 2021-03-10T16:22:53.544485+0000 mon.a (mon.0) 1857 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:22:54.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:22:54 gibba015 bash[29377]: audit 2021-03-10T16:22:53.539081+0000 mon.c (mon.1) 2251 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:22:54.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:22:54 gibba015 bash[29377]: audit 2021-03-10T16:22:53.539897+0000 mon.c (mon.1) 2252 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:22:54.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:22:54 gibba015 bash[29377]: audit 2021-03-10T16:22:53.540222+0000 mon.a (mon.0) 1852 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:22:54.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:22:54 gibba015 bash[29377]: audit 2021-03-10T16:22:53.540821+0000 mon.c (mon.1) 2253 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T16:22:54.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:22:54 gibba015 bash[29377]: audit 2021-03-10T16:22:53.541634+0000 mon.a (mon.0) 1853 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:22:54.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:22:54 gibba015 bash[29377]: audit 2021-03-10T16:22:53.541947+0000 mon.c (mon.1) 2254 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:22:54.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:22:54 gibba015 bash[29377]: audit 2021-03-10T16:22:53.542769+0000 mon.a (mon.0) 1854 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T16:22:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:22:54 gibba015 bash[29377]: audit 2021-03-10T16:22:53.543130+0000 mon.c (mon.1) 2255 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:22:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:22:54 gibba015 bash[29377]: audit 2021-03-10T16:22:53.543871+0000 mon.a (mon.0) 1855 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:22:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:22:54 gibba015 bash[29377]: audit 2021-03-10T16:22:53.544143+0000 mon.c (mon.1) 2256 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:22:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:22:54 gibba015 bash[29377]: audit 2021-03-10T16:22:53.544285+0000 mon.a (mon.0) 1856 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:22:54.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:22:54 gibba015 bash[29377]: audit 2021-03-10T16:22:53.544485+0000 mon.a (mon.0) 1857 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:22:54.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:22:54 gibba015 bash[30343]: audit 2021-03-10T16:22:53.539081+0000 mon.c (mon.1) 2251 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:22:54.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:22:54 gibba015 bash[30343]: audit 2021-03-10T16:22:53.539897+0000 mon.c (mon.1) 2252 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:22:54.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:22:54 gibba015 bash[30343]: audit 2021-03-10T16:22:53.540222+0000 mon.a (mon.0) 1852 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:22:54.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:22:54 gibba015 bash[30343]: audit 2021-03-10T16:22:53.540821+0000 mon.c (mon.1) 2253 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T16:22:54.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:22:54 gibba015 bash[30343]: audit 2021-03-10T16:22:53.541634+0000 mon.a (mon.0) 1853 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:22:54.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:22:54 gibba015 bash[30343]: audit 2021-03-10T16:22:53.541947+0000 mon.c (mon.1) 2254 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:22:54.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:22:54 gibba015 bash[30343]: audit 2021-03-10T16:22:53.542769+0000 mon.a (mon.0) 1854 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T16:22:54.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:22:54 gibba015 bash[30343]: audit 2021-03-10T16:22:53.543130+0000 mon.c (mon.1) 2255 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:22:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:22:54 gibba015 bash[30343]: audit 2021-03-10T16:22:53.543871+0000 mon.a (mon.0) 1855 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:22:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:22:54 gibba015 bash[30343]: audit 2021-03-10T16:22:53.544143+0000 mon.c (mon.1) 2256 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:22:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:22:54 gibba015 bash[30343]: audit 2021-03-10T16:22:53.544285+0000 mon.a (mon.0) 1856 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:22:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:22:54 gibba015 bash[30343]: audit 2021-03-10T16:22:53.544485+0000 mon.a (mon.0) 1857 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:22:55.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:22:55 gibba045 bash[25517]: cluster 2021-03-10T16:22:53.697294+0000 mgr.gibba045.orlgmj (mgr.34412) 8135 : cluster [DBG] pgmap v4632: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:55.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:22:55 gibba015 bash[29377]: cluster 2021-03-10T16:22:53.697294+0000 mgr.gibba045.orlgmj (mgr.34412) 8135 : cluster [DBG] pgmap v4632: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:55.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:22:55 gibba015 bash[30343]: cluster 2021-03-10T16:22:53.697294+0000 mgr.gibba045.orlgmj (mgr.34412) 8135 : cluster [DBG] pgmap v4632: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:57.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:22:57 gibba045 bash[25517]: cluster 2021-03-10T16:22:55.699018+0000 mgr.gibba045.orlgmj (mgr.34412) 8136 : cluster [DBG] pgmap v4633: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:57.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:22:57 gibba015 bash[29377]: cluster 2021-03-10T16:22:55.699018+0000 mgr.gibba045.orlgmj (mgr.34412) 8136 : cluster [DBG] pgmap v4633: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:57.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:22:57 gibba015 bash[30343]: cluster 2021-03-10T16:22:55.699018+0000 mgr.gibba045.orlgmj (mgr.34412) 8136 : cluster [DBG] pgmap v4633: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:59.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:22:59 gibba045 bash[25517]: cluster 2021-03-10T16:22:57.700679+0000 mgr.gibba045.orlgmj (mgr.34412) 8137 : cluster [DBG] pgmap v4634: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:59.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:22:59 gibba015 bash[29377]: cluster 2021-03-10T16:22:57.700679+0000 mgr.gibba045.orlgmj (mgr.34412) 8137 : cluster [DBG] pgmap v4634: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:59.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:22:59 gibba015 bash[30343]: cluster 2021-03-10T16:22:57.700679+0000 mgr.gibba045.orlgmj (mgr.34412) 8137 : cluster [DBG] pgmap v4634: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:01.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:23:01 gibba045 bash[25517]: cluster 2021-03-10T16:22:59.702414+0000 mgr.gibba045.orlgmj (mgr.34412) 8138 : cluster [DBG] pgmap v4635: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:01.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:23:01 gibba015 bash[29377]: cluster 2021-03-10T16:22:59.702414+0000 mgr.gibba045.orlgmj (mgr.34412) 8138 : cluster [DBG] pgmap v4635: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:01.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:23:01 gibba015 bash[30343]: cluster 2021-03-10T16:22:59.702414+0000 mgr.gibba045.orlgmj (mgr.34412) 8138 : cluster [DBG] pgmap v4635: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:03.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:23:03 gibba045 bash[25517]: cluster 2021-03-10T16:23:01.704053+0000 mgr.gibba045.orlgmj (mgr.34412) 8139 : cluster [DBG] pgmap v4636: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:03.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:23:03 gibba015 bash[29377]: cluster 2021-03-10T16:23:01.704053+0000 mgr.gibba045.orlgmj (mgr.34412) 8139 : cluster [DBG] pgmap v4636: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:03.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:23:03 gibba015 bash[30343]: cluster 2021-03-10T16:23:01.704053+0000 mgr.gibba045.orlgmj (mgr.34412) 8139 : cluster [DBG] pgmap v4636: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:04.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:23:04 gibba045 bash[25517]: cephadm 2021-03-10T16:23:03.021473+0000 mgr.gibba045.orlgmj (mgr.34412) 8140 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:23:04.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:23:04 gibba015 bash[29377]: cephadm 2021-03-10T16:23:03.021473+0000 mgr.gibba045.orlgmj (mgr.34412) 8140 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:23:04.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:23:04 gibba015 bash[30343]: cephadm 2021-03-10T16:23:03.021473+0000 mgr.gibba045.orlgmj (mgr.34412) 8140 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:23:05.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:23:05 gibba015 bash[29377]: cluster 2021-03-10T16:23:03.705516+0000 mgr.gibba045.orlgmj (mgr.34412) 8141 : cluster [DBG] pgmap v4637: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:05.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:23:05 gibba015 bash[30343]: cluster 2021-03-10T16:23:03.705516+0000 mgr.gibba045.orlgmj (mgr.34412) 8141 : cluster [DBG] pgmap v4637: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:05.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:23:05 gibba045 bash[25517]: cluster 2021-03-10T16:23:03.705516+0000 mgr.gibba045.orlgmj (mgr.34412) 8141 : cluster [DBG] pgmap v4637: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:07.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:23:07 gibba015 bash[29377]: cluster 2021-03-10T16:23:05.707110+0000 mgr.gibba045.orlgmj (mgr.34412) 8142 : cluster [DBG] pgmap v4638: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:07.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:23:07 gibba015 bash[30343]: cluster 2021-03-10T16:23:05.707110+0000 mgr.gibba045.orlgmj (mgr.34412) 8142 : cluster [DBG] pgmap v4638: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:07.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:23:07 gibba045 bash[25517]: cluster 2021-03-10T16:23:05.707110+0000 mgr.gibba045.orlgmj (mgr.34412) 8142 : cluster [DBG] pgmap v4638: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:09.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:23:09 gibba015 bash[29377]: cluster 2021-03-10T16:23:07.708627+0000 mgr.gibba045.orlgmj (mgr.34412) 8143 : cluster [DBG] pgmap v4639: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:09.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:23:09 gibba015 bash[30343]: cluster 2021-03-10T16:23:07.708627+0000 mgr.gibba045.orlgmj (mgr.34412) 8143 : cluster [DBG] pgmap v4639: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:09.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:23:09 gibba045 bash[25517]: cluster 2021-03-10T16:23:07.708627+0000 mgr.gibba045.orlgmj (mgr.34412) 8143 : cluster [DBG] pgmap v4639: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:10.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:23:10 gibba015 bash[29377]: cluster 2021-03-10T16:23:09.709674+0000 mgr.gibba045.orlgmj (mgr.34412) 8144 : cluster [DBG] pgmap v4640: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:10.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:23:10 gibba015 bash[30343]: cluster 2021-03-10T16:23:09.709674+0000 mgr.gibba045.orlgmj (mgr.34412) 8144 : cluster [DBG] pgmap v4640: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:10.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:23:10 gibba045 bash[25517]: cluster 2021-03-10T16:23:09.709674+0000 mgr.gibba045.orlgmj (mgr.34412) 8144 : cluster [DBG] pgmap v4640: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:13.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:23:12 gibba015 bash[29377]: cluster 2021-03-10T16:23:11.711095+0000 mgr.gibba045.orlgmj (mgr.34412) 8145 : cluster [DBG] pgmap v4641: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:13.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:23:12 gibba015 bash[30343]: cluster 2021-03-10T16:23:11.711095+0000 mgr.gibba045.orlgmj (mgr.34412) 8145 : cluster [DBG] pgmap v4641: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:13.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:23:12 gibba045 bash[25517]: cluster 2021-03-10T16:23:11.711095+0000 mgr.gibba045.orlgmj (mgr.34412) 8145 : cluster [DBG] pgmap v4641: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:15.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:23:14 gibba015 bash[29377]: cluster 2021-03-10T16:23:13.712312+0000 mgr.gibba045.orlgmj (mgr.34412) 8146 : cluster [DBG] pgmap v4642: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:15.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:23:14 gibba015 bash[30343]: cluster 2021-03-10T16:23:13.712312+0000 mgr.gibba045.orlgmj (mgr.34412) 8146 : cluster [DBG] pgmap v4642: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:15.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:23:14 gibba045 bash[25517]: cluster 2021-03-10T16:23:13.712312+0000 mgr.gibba045.orlgmj (mgr.34412) 8146 : cluster [DBG] pgmap v4642: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:17.080 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:23:17.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:23:16 gibba015 bash[29377]: cluster 2021-03-10T16:23:15.713838+0000 mgr.gibba045.orlgmj (mgr.34412) 8147 : cluster [DBG] pgmap v4643: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:17.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:23:16 gibba015 bash[30343]: cluster 2021-03-10T16:23:15.713838+0000 mgr.gibba045.orlgmj (mgr.34412) 8147 : cluster [DBG] pgmap v4643: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:17.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:23:16 gibba045 bash[25517]: cluster 2021-03-10T16:23:15.713838+0000 mgr.gibba045.orlgmj (mgr.34412) 8147 : cluster [DBG] pgmap v4643: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:17.307 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:23:17.308 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 7m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:23:17.308 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 6m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:23:17.308 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:23:17.308 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:23:17.309 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:23:17.309 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:23:17.309 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:23:17.309 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:23:17.310 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 7m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:23:17.310 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 6m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:23:17.310 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:23:17.310 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:23:17.311 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:23:17.311 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:23:17.311 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:23:17.311 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:23:17.311 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:23:17.312 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:23:17.312 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 6m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:23:17.312 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 6m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:23:17.558 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:23:17.558 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:23:17.559 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:23:17.559 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:23:17.559 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:23:17.559 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:23:17.560 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:23:17.560 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:23:17.560 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:23:17.560 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:23:17.560 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:23:17.561 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:23:17.561 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:23:17.561 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:23:17.561 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:23:18.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:23:17 gibba015 bash[29377]: audit 2021-03-10T16:23:17.074204+0000 mgr.gibba045.orlgmj (mgr.34412) 8148 : audit [DBG] from='client.49524 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:23:18.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:23:17 gibba015 bash[29377]: audit 2021-03-10T16:23:17.298277+0000 mgr.gibba045.orlgmj (mgr.34412) 8149 : audit [DBG] from='client.59518 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:23:18.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:23:17 gibba015 bash[29377]: audit 2021-03-10T16:23:17.558710+0000 mon.a (mon.0) 1858 : audit [DBG] from='client.? 172.21.2.115:0/1932208002' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:23:18.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:23:17 gibba015 bash[30343]: audit 2021-03-10T16:23:17.074204+0000 mgr.gibba045.orlgmj (mgr.34412) 8148 : audit [DBG] from='client.49524 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:23:18.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:23:17 gibba015 bash[30343]: audit 2021-03-10T16:23:17.298277+0000 mgr.gibba045.orlgmj (mgr.34412) 8149 : audit [DBG] from='client.59518 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:23:18.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:23:17 gibba015 bash[30343]: audit 2021-03-10T16:23:17.558710+0000 mon.a (mon.0) 1858 : audit [DBG] from='client.? 172.21.2.115:0/1932208002' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:23:18.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:23:17 gibba045 bash[25517]: audit 2021-03-10T16:23:17.074204+0000 mgr.gibba045.orlgmj (mgr.34412) 8148 : audit [DBG] from='client.49524 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:23:18.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:23:17 gibba045 bash[25517]: audit 2021-03-10T16:23:17.298277+0000 mgr.gibba045.orlgmj (mgr.34412) 8149 : audit [DBG] from='client.59518 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:23:18.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:23:17 gibba045 bash[25517]: audit 2021-03-10T16:23:17.558710+0000 mon.a (mon.0) 1858 : audit [DBG] from='client.? 172.21.2.115:0/1932208002' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:23:19.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:23:18 gibba015 bash[29377]: cluster 2021-03-10T16:23:17.715261+0000 mgr.gibba045.orlgmj (mgr.34412) 8150 : cluster [DBG] pgmap v4644: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:19.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:23:18 gibba015 bash[29377]: audit 2021-03-10T16:23:18.035353+0000 mon.c (mon.1) 2257 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:23:19.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:23:18 gibba015 bash[29377]: audit 2021-03-10T16:23:18.230214+0000 mon.a (mon.0) 1859 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:23:19.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:23:18 gibba015 bash[29377]: cephadm 2021-03-10T16:23:18.233964+0000 mgr.gibba045.orlgmj (mgr.34412) 8151 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:23:19.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:23:18 gibba015 bash[29377]: audit 2021-03-10T16:23:18.283792+0000 mon.a (mon.0) 1860 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:23:19.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:23:18 gibba015 bash[29377]: cephadm 2021-03-10T16:23:18.287328+0000 mgr.gibba045.orlgmj (mgr.34412) 8152 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:23:19.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:23:18 gibba015 bash[29377]: audit 2021-03-10T16:23:18.490235+0000 mon.a (mon.0) 1861 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:23:19.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:23:18 gibba015 bash[29377]: audit 2021-03-10T16:23:18.497343+0000 mon.c (mon.1) 2258 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:23:19.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:23:18 gibba015 bash[29377]: audit 2021-03-10T16:23:18.500075+0000 mon.c (mon.1) 2259 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:23:19.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:23:18 gibba015 bash[29377]: audit 2021-03-10T16:23:18.502532+0000 mon.c (mon.1) 2260 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:23:19.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:23:18 gibba015 bash[29377]: audit 2021-03-10T16:23:18.504899+0000 mon.c (mon.1) 2261 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:23:19.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:23:18 gibba015 bash[29377]: audit 2021-03-10T16:23:18.513935+0000 mon.c (mon.1) 2262 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:23:19.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:23:18 gibba015 bash[29377]: audit 2021-03-10T16:23:18.520932+0000 mon.c (mon.1) 2263 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:23:19.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:23:18 gibba015 bash[30343]: cluster 2021-03-10T16:23:17.715261+0000 mgr.gibba045.orlgmj (mgr.34412) 8150 : cluster [DBG] pgmap v4644: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:19.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:23:18 gibba015 bash[30343]: audit 2021-03-10T16:23:18.035353+0000 mon.c (mon.1) 2257 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:23:19.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:23:18 gibba015 bash[30343]: audit 2021-03-10T16:23:18.230214+0000 mon.a (mon.0) 1859 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:23:19.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:23:18 gibba015 bash[30343]: cephadm 2021-03-10T16:23:18.233964+0000 mgr.gibba045.orlgmj (mgr.34412) 8151 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:23:19.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:23:18 gibba015 bash[30343]: audit 2021-03-10T16:23:18.283792+0000 mon.a (mon.0) 1860 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:23:19.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:23:18 gibba015 bash[30343]: cephadm 2021-03-10T16:23:18.287328+0000 mgr.gibba045.orlgmj (mgr.34412) 8152 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:23:19.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:23:18 gibba015 bash[30343]: audit 2021-03-10T16:23:18.490235+0000 mon.a (mon.0) 1861 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:23:19.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:23:18 gibba015 bash[30343]: audit 2021-03-10T16:23:18.497343+0000 mon.c (mon.1) 2258 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:23:19.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:23:18 gibba015 bash[30343]: audit 2021-03-10T16:23:18.500075+0000 mon.c (mon.1) 2259 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:23:19.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:23:18 gibba015 bash[30343]: audit 2021-03-10T16:23:18.502532+0000 mon.c (mon.1) 2260 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:23:19.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:23:18 gibba015 bash[30343]: audit 2021-03-10T16:23:18.504899+0000 mon.c (mon.1) 2261 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:23:19.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:23:18 gibba015 bash[30343]: audit 2021-03-10T16:23:18.513935+0000 mon.c (mon.1) 2262 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:23:19.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:23:18 gibba015 bash[30343]: audit 2021-03-10T16:23:18.520932+0000 mon.c (mon.1) 2263 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:23:19.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:23:18 gibba045 bash[25517]: cluster 2021-03-10T16:23:17.715261+0000 mgr.gibba045.orlgmj (mgr.34412) 8150 : cluster [DBG] pgmap v4644: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:19.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:23:18 gibba045 bash[25517]: audit 2021-03-10T16:23:18.035353+0000 mon.c (mon.1) 2257 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:23:19.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:23:18 gibba045 bash[25517]: audit 2021-03-10T16:23:18.230214+0000 mon.a (mon.0) 1859 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:23:19.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:23:18 gibba045 bash[25517]: cephadm 2021-03-10T16:23:18.233964+0000 mgr.gibba045.orlgmj (mgr.34412) 8151 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:23:19.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:23:18 gibba045 bash[25517]: audit 2021-03-10T16:23:18.283792+0000 mon.a (mon.0) 1860 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:23:19.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:23:18 gibba045 bash[25517]: cephadm 2021-03-10T16:23:18.287328+0000 mgr.gibba045.orlgmj (mgr.34412) 8152 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:23:19.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:23:18 gibba045 bash[25517]: audit 2021-03-10T16:23:18.490235+0000 mon.a (mon.0) 1861 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:23:19.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:23:18 gibba045 bash[25517]: audit 2021-03-10T16:23:18.497343+0000 mon.c (mon.1) 2258 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:23:19.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:23:18 gibba045 bash[25517]: audit 2021-03-10T16:23:18.500075+0000 mon.c (mon.1) 2259 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:23:19.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:23:18 gibba045 bash[25517]: audit 2021-03-10T16:23:18.502532+0000 mon.c (mon.1) 2260 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:23:19.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:23:18 gibba045 bash[25517]: audit 2021-03-10T16:23:18.504899+0000 mon.c (mon.1) 2261 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:23:19.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:23:18 gibba045 bash[25517]: audit 2021-03-10T16:23:18.513935+0000 mon.c (mon.1) 2262 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:23:19.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:23:18 gibba045 bash[25517]: audit 2021-03-10T16:23:18.520932+0000 mon.c (mon.1) 2263 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:23:20.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:23:19 gibba045 bash[25517]: cephadm 2021-03-10T16:23:18.498655+0000 mgr.gibba045.orlgmj (mgr.34412) 8153 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:23:20.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:23:19 gibba045 bash[25517]: cephadm 2021-03-10T16:23:18.501907+0000 mgr.gibba045.orlgmj (mgr.34412) 8154 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:23:20.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:23:19 gibba045 bash[25517]: cephadm 2021-03-10T16:23:18.504318+0000 mgr.gibba045.orlgmj (mgr.34412) 8155 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:23:20.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:23:19 gibba045 bash[25517]: cephadm 2021-03-10T16:23:18.504360+0000 mgr.gibba045.orlgmj (mgr.34412) 8156 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:23:20.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:23:19 gibba045 bash[25517]: cephadm 2021-03-10T16:23:18.506778+0000 mgr.gibba045.orlgmj (mgr.34412) 8157 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:23:20.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:23:19 gibba045 bash[25517]: cephadm 2021-03-10T16:23:18.506823+0000 mgr.gibba045.orlgmj (mgr.34412) 8158 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:23:20.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:23:19 gibba045 bash[25517]: cephadm 2021-03-10T16:23:18.509294+0000 mgr.gibba045.orlgmj (mgr.34412) 8159 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:23:20.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:23:19 gibba045 bash[25517]: cephadm 2021-03-10T16:23:18.514434+0000 mgr.gibba045.orlgmj (mgr.34412) 8160 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:23:20.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:23:19 gibba045 bash[25517]: cephadm 2021-03-10T16:23:18.514674+0000 mgr.gibba045.orlgmj (mgr.34412) 8161 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:23:20.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:23:19 gibba045 bash[25517]: cephadm 2021-03-10T16:23:18.520072+0000 mgr.gibba045.orlgmj (mgr.34412) 8162 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:23:20.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:23:19 gibba045 bash[25517]: cephadm 2021-03-10T16:23:18.522164+0000 mgr.gibba045.orlgmj (mgr.34412) 8163 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:23:20.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:23:19 gibba045 bash[25517]: cephadm 2021-03-10T16:23:18.526625+0000 mgr.gibba045.orlgmj (mgr.34412) 8164 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:23:20.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:23:19 gibba045 bash[25517]: cephadm 2021-03-10T16:23:18.527209+0000 mgr.gibba045.orlgmj (mgr.34412) 8165 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:23:20.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:23:19 gibba045 bash[25517]: cephadm 2021-03-10T16:23:18.527877+0000 mgr.gibba045.orlgmj (mgr.34412) 8166 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:23:20.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:23:19 gibba015 bash[29377]: cephadm 2021-03-10T16:23:18.498655+0000 mgr.gibba045.orlgmj (mgr.34412) 8153 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:23:20.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:23:19 gibba015 bash[29377]: cephadm 2021-03-10T16:23:18.501907+0000 mgr.gibba045.orlgmj (mgr.34412) 8154 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:23:20.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:23:19 gibba015 bash[29377]: cephadm 2021-03-10T16:23:18.504318+0000 mgr.gibba045.orlgmj (mgr.34412) 8155 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:23:20.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:23:19 gibba015 bash[29377]: cephadm 2021-03-10T16:23:18.504360+0000 mgr.gibba045.orlgmj (mgr.34412) 8156 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:23:20.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:23:19 gibba015 bash[29377]: cephadm 2021-03-10T16:23:18.506778+0000 mgr.gibba045.orlgmj (mgr.34412) 8157 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:23:20.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:23:19 gibba015 bash[29377]: cephadm 2021-03-10T16:23:18.506823+0000 mgr.gibba045.orlgmj (mgr.34412) 8158 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:23:20.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:23:19 gibba015 bash[29377]: cephadm 2021-03-10T16:23:18.509294+0000 mgr.gibba045.orlgmj (mgr.34412) 8159 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:23:20.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:23:19 gibba015 bash[29377]: cephadm 2021-03-10T16:23:18.514434+0000 mgr.gibba045.orlgmj (mgr.34412) 8160 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:23:20.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:23:19 gibba015 bash[29377]: cephadm 2021-03-10T16:23:18.514674+0000 mgr.gibba045.orlgmj (mgr.34412) 8161 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:23:20.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:23:19 gibba015 bash[29377]: cephadm 2021-03-10T16:23:18.520072+0000 mgr.gibba045.orlgmj (mgr.34412) 8162 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:23:20.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:23:19 gibba015 bash[29377]: cephadm 2021-03-10T16:23:18.522164+0000 mgr.gibba045.orlgmj (mgr.34412) 8163 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:23:20.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:23:19 gibba015 bash[29377]: cephadm 2021-03-10T16:23:18.526625+0000 mgr.gibba045.orlgmj (mgr.34412) 8164 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:23:20.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:23:19 gibba015 bash[29377]: cephadm 2021-03-10T16:23:18.527209+0000 mgr.gibba045.orlgmj (mgr.34412) 8165 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:23:20.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:23:19 gibba015 bash[29377]: cephadm 2021-03-10T16:23:18.527877+0000 mgr.gibba045.orlgmj (mgr.34412) 8166 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:23:20.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:23:19 gibba015 bash[30343]: cephadm 2021-03-10T16:23:18.498655+0000 mgr.gibba045.orlgmj (mgr.34412) 8153 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:23:20.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:23:19 gibba015 bash[30343]: cephadm 2021-03-10T16:23:18.501907+0000 mgr.gibba045.orlgmj (mgr.34412) 8154 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:23:20.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:23:19 gibba015 bash[30343]: cephadm 2021-03-10T16:23:18.504318+0000 mgr.gibba045.orlgmj (mgr.34412) 8155 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:23:20.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:23:19 gibba015 bash[30343]: cephadm 2021-03-10T16:23:18.504360+0000 mgr.gibba045.orlgmj (mgr.34412) 8156 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:23:20.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:23:19 gibba015 bash[30343]: cephadm 2021-03-10T16:23:18.506778+0000 mgr.gibba045.orlgmj (mgr.34412) 8157 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:23:20.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:23:19 gibba015 bash[30343]: cephadm 2021-03-10T16:23:18.506823+0000 mgr.gibba045.orlgmj (mgr.34412) 8158 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:23:20.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:23:19 gibba015 bash[30343]: cephadm 2021-03-10T16:23:18.509294+0000 mgr.gibba045.orlgmj (mgr.34412) 8159 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:23:20.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:23:19 gibba015 bash[30343]: cephadm 2021-03-10T16:23:18.514434+0000 mgr.gibba045.orlgmj (mgr.34412) 8160 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:23:20.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:23:19 gibba015 bash[30343]: cephadm 2021-03-10T16:23:18.514674+0000 mgr.gibba045.orlgmj (mgr.34412) 8161 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:23:20.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:23:19 gibba015 bash[30343]: cephadm 2021-03-10T16:23:18.520072+0000 mgr.gibba045.orlgmj (mgr.34412) 8162 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:23:20.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:23:19 gibba015 bash[30343]: cephadm 2021-03-10T16:23:18.522164+0000 mgr.gibba045.orlgmj (mgr.34412) 8163 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:23:20.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:23:19 gibba015 bash[30343]: cephadm 2021-03-10T16:23:18.526625+0000 mgr.gibba045.orlgmj (mgr.34412) 8164 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:23:20.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:23:19 gibba015 bash[30343]: cephadm 2021-03-10T16:23:18.527209+0000 mgr.gibba045.orlgmj (mgr.34412) 8165 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:23:20.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:23:19 gibba015 bash[30343]: cephadm 2021-03-10T16:23:18.527877+0000 mgr.gibba045.orlgmj (mgr.34412) 8166 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:23:21.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:23:20 gibba045 bash[25517]: cluster 2021-03-10T16:23:19.716695+0000 mgr.gibba045.orlgmj (mgr.34412) 8167 : cluster [DBG] pgmap v4645: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:21.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:23:20 gibba015 bash[29377]: cluster 2021-03-10T16:23:19.716695+0000 mgr.gibba045.orlgmj (mgr.34412) 8167 : cluster [DBG] pgmap v4645: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:21.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:23:20 gibba015 bash[30343]: cluster 2021-03-10T16:23:19.716695+0000 mgr.gibba045.orlgmj (mgr.34412) 8167 : cluster [DBG] pgmap v4645: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:23.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:23:22 gibba045 bash[25517]: cluster 2021-03-10T16:23:21.718444+0000 mgr.gibba045.orlgmj (mgr.34412) 8168 : cluster [DBG] pgmap v4646: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:23.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:23:22 gibba015 bash[29377]: cluster 2021-03-10T16:23:21.718444+0000 mgr.gibba045.orlgmj (mgr.34412) 8168 : cluster [DBG] pgmap v4646: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:23.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:23:22 gibba015 bash[30343]: cluster 2021-03-10T16:23:21.718444+0000 mgr.gibba045.orlgmj (mgr.34412) 8168 : cluster [DBG] pgmap v4646: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:25.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:23:24 gibba045 bash[25517]: cluster 2021-03-10T16:23:23.719705+0000 mgr.gibba045.orlgmj (mgr.34412) 8169 : cluster [DBG] pgmap v4647: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:25.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:23:24 gibba015 bash[29377]: cluster 2021-03-10T16:23:23.719705+0000 mgr.gibba045.orlgmj (mgr.34412) 8169 : cluster [DBG] pgmap v4647: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:25.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:23:24 gibba015 bash[30343]: cluster 2021-03-10T16:23:23.719705+0000 mgr.gibba045.orlgmj (mgr.34412) 8169 : cluster [DBG] pgmap v4647: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:27.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:23:27 gibba045 bash[25517]: cluster 2021-03-10T16:23:25.721420+0000 mgr.gibba045.orlgmj (mgr.34412) 8170 : cluster [DBG] pgmap v4648: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:27.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:23:27 gibba015 bash[29377]: cluster 2021-03-10T16:23:25.721420+0000 mgr.gibba045.orlgmj (mgr.34412) 8170 : cluster [DBG] pgmap v4648: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:27.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:23:27 gibba015 bash[30343]: cluster 2021-03-10T16:23:25.721420+0000 mgr.gibba045.orlgmj (mgr.34412) 8170 : cluster [DBG] pgmap v4648: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:29.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:23:29 gibba045 bash[25517]: cluster 2021-03-10T16:23:27.722937+0000 mgr.gibba045.orlgmj (mgr.34412) 8171 : cluster [DBG] pgmap v4649: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:29.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:23:29 gibba015 bash[29377]: cluster 2021-03-10T16:23:27.722937+0000 mgr.gibba045.orlgmj (mgr.34412) 8171 : cluster [DBG] pgmap v4649: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:29.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:23:29 gibba015 bash[30343]: cluster 2021-03-10T16:23:27.722937+0000 mgr.gibba045.orlgmj (mgr.34412) 8171 : cluster [DBG] pgmap v4649: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:31.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:23:31 gibba045 bash[25517]: cluster 2021-03-10T16:23:29.724741+0000 mgr.gibba045.orlgmj (mgr.34412) 8172 : cluster [DBG] pgmap v4650: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:31.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:23:31 gibba015 bash[29377]: cluster 2021-03-10T16:23:29.724741+0000 mgr.gibba045.orlgmj (mgr.34412) 8172 : cluster [DBG] pgmap v4650: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:31.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:23:31 gibba015 bash[30343]: cluster 2021-03-10T16:23:29.724741+0000 mgr.gibba045.orlgmj (mgr.34412) 8172 : cluster [DBG] pgmap v4650: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:33.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:23:33 gibba045 bash[25517]: cluster 2021-03-10T16:23:31.726488+0000 mgr.gibba045.orlgmj (mgr.34412) 8173 : cluster [DBG] pgmap v4651: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:33.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:23:33 gibba015 bash[29377]: cluster 2021-03-10T16:23:31.726488+0000 mgr.gibba045.orlgmj (mgr.34412) 8173 : cluster [DBG] pgmap v4651: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:33.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:23:33 gibba015 bash[30343]: cluster 2021-03-10T16:23:31.726488+0000 mgr.gibba045.orlgmj (mgr.34412) 8173 : cluster [DBG] pgmap v4651: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:35.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:23:35 gibba045 bash[25517]: cephadm 2021-03-10T16:23:33.543948+0000 mgr.gibba045.orlgmj (mgr.34412) 8174 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:23:35.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:23:35 gibba045 bash[25517]: cluster 2021-03-10T16:23:33.727913+0000 mgr.gibba045.orlgmj (mgr.34412) 8175 : cluster [DBG] pgmap v4652: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:35.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:23:35 gibba015 bash[29377]: cephadm 2021-03-10T16:23:33.543948+0000 mgr.gibba045.orlgmj (mgr.34412) 8174 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:23:35.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:23:35 gibba015 bash[29377]: cluster 2021-03-10T16:23:33.727913+0000 mgr.gibba045.orlgmj (mgr.34412) 8175 : cluster [DBG] pgmap v4652: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:35.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:23:35 gibba015 bash[30343]: cephadm 2021-03-10T16:23:33.543948+0000 mgr.gibba045.orlgmj (mgr.34412) 8174 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:23:35.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:23:35 gibba015 bash[30343]: cluster 2021-03-10T16:23:33.727913+0000 mgr.gibba045.orlgmj (mgr.34412) 8175 : cluster [DBG] pgmap v4652: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:37.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:23:37 gibba045 bash[25517]: cluster 2021-03-10T16:23:35.729534+0000 mgr.gibba045.orlgmj (mgr.34412) 8176 : cluster [DBG] pgmap v4653: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:37.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:23:37 gibba015 bash[29377]: cluster 2021-03-10T16:23:35.729534+0000 mgr.gibba045.orlgmj (mgr.34412) 8176 : cluster [DBG] pgmap v4653: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:37.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:23:37 gibba015 bash[30343]: cluster 2021-03-10T16:23:35.729534+0000 mgr.gibba045.orlgmj (mgr.34412) 8176 : cluster [DBG] pgmap v4653: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:39.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:23:39 gibba045 bash[25517]: cluster 2021-03-10T16:23:37.731039+0000 mgr.gibba045.orlgmj (mgr.34412) 8177 : cluster [DBG] pgmap v4654: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:39.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:23:39 gibba015 bash[29377]: cluster 2021-03-10T16:23:37.731039+0000 mgr.gibba045.orlgmj (mgr.34412) 8177 : cluster [DBG] pgmap v4654: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:39.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:23:39 gibba015 bash[30343]: cluster 2021-03-10T16:23:37.731039+0000 mgr.gibba045.orlgmj (mgr.34412) 8177 : cluster [DBG] pgmap v4654: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:41.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:23:41 gibba015 bash[29377]: cluster 2021-03-10T16:23:39.732904+0000 mgr.gibba045.orlgmj (mgr.34412) 8178 : cluster [DBG] pgmap v4655: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:41.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:23:41 gibba015 bash[30343]: cluster 2021-03-10T16:23:39.732904+0000 mgr.gibba045.orlgmj (mgr.34412) 8178 : cluster [DBG] pgmap v4655: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:41.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:23:41 gibba045 bash[25517]: cluster 2021-03-10T16:23:39.732904+0000 mgr.gibba045.orlgmj (mgr.34412) 8178 : cluster [DBG] pgmap v4655: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:43.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:23:43 gibba015 bash[29377]: cluster 2021-03-10T16:23:41.734558+0000 mgr.gibba045.orlgmj (mgr.34412) 8179 : cluster [DBG] pgmap v4656: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:43.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:23:43 gibba015 bash[30343]: cluster 2021-03-10T16:23:41.734558+0000 mgr.gibba045.orlgmj (mgr.34412) 8179 : cluster [DBG] pgmap v4656: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:43.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:23:43 gibba045 bash[25517]: cluster 2021-03-10T16:23:41.734558+0000 mgr.gibba045.orlgmj (mgr.34412) 8179 : cluster [DBG] pgmap v4656: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:45.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:23:45 gibba015 bash[29377]: cluster 2021-03-10T16:23:43.736025+0000 mgr.gibba045.orlgmj (mgr.34412) 8180 : cluster [DBG] pgmap v4657: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:45.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:23:45 gibba015 bash[30343]: cluster 2021-03-10T16:23:43.736025+0000 mgr.gibba045.orlgmj (mgr.34412) 8180 : cluster [DBG] pgmap v4657: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:45.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:23:45 gibba045 bash[25517]: cluster 2021-03-10T16:23:43.736025+0000 mgr.gibba045.orlgmj (mgr.34412) 8180 : cluster [DBG] pgmap v4657: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:47.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:23:47 gibba015 bash[29377]: cluster 2021-03-10T16:23:45.737595+0000 mgr.gibba045.orlgmj (mgr.34412) 8181 : cluster [DBG] pgmap v4658: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:47.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:23:47 gibba015 bash[30343]: cluster 2021-03-10T16:23:45.737595+0000 mgr.gibba045.orlgmj (mgr.34412) 8181 : cluster [DBG] pgmap v4658: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:47.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:23:47 gibba045 bash[25517]: cluster 2021-03-10T16:23:45.737595+0000 mgr.gibba045.orlgmj (mgr.34412) 8181 : cluster [DBG] pgmap v4658: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:47.804 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:23:48.061 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:23:48.062 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 7m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:23:48.062 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 6m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:23:48.063 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:23:48.063 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:23:48.063 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:23:48.063 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:23:48.063 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:23:48.064 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:23:48.064 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 7m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:23:48.064 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 6m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:23:48.064 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:23:48.065 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:23:48.065 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:23:48.065 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:23:48.065 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:23:48.065 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:23:48.066 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:23:48.066 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:23:48.066 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 6m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:23:48.066 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 6m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:23:48.316 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:23:48.316 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:23:48.316 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:23:48.317 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:23:48.317 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:23:48.317 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:23:48.317 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:23:48.317 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:23:48.318 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:23:48.318 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:23:48.318 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:23:48.318 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:23:48.319 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:23:48.319 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:23:48.319 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:23:49.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:23:49 gibba015 bash[29377]: cluster 2021-03-10T16:23:47.739210+0000 mgr.gibba045.orlgmj (mgr.34412) 8182 : cluster [DBG] pgmap v4659: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:49.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:23:49 gibba015 bash[29377]: audit 2021-03-10T16:23:47.797663+0000 mgr.gibba045.orlgmj (mgr.34412) 8183 : audit [DBG] from='client.59530 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:23:49.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:23:49 gibba015 bash[29377]: audit 2021-03-10T16:23:48.024313+0000 mgr.gibba045.orlgmj (mgr.34412) 8184 : audit [DBG] from='client.59536 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:23:49.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:23:49 gibba015 bash[29377]: audit 2021-03-10T16:23:48.316207+0000 mon.a (mon.0) 1862 : audit [DBG] from='client.? 172.21.2.115:0/979828765' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:23:49.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:23:49 gibba015 bash[30343]: cluster 2021-03-10T16:23:47.739210+0000 mgr.gibba045.orlgmj (mgr.34412) 8182 : cluster [DBG] pgmap v4659: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:49.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:23:49 gibba015 bash[30343]: audit 2021-03-10T16:23:47.797663+0000 mgr.gibba045.orlgmj (mgr.34412) 8183 : audit [DBG] from='client.59530 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:23:49.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:23:49 gibba015 bash[30343]: audit 2021-03-10T16:23:48.024313+0000 mgr.gibba045.orlgmj (mgr.34412) 8184 : audit [DBG] from='client.59536 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:23:49.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:23:49 gibba015 bash[30343]: audit 2021-03-10T16:23:48.316207+0000 mon.a (mon.0) 1862 : audit [DBG] from='client.? 172.21.2.115:0/979828765' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:23:49.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:23:49 gibba045 bash[25517]: cluster 2021-03-10T16:23:47.739210+0000 mgr.gibba045.orlgmj (mgr.34412) 8182 : cluster [DBG] pgmap v4659: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:49.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:23:49 gibba045 bash[25517]: audit 2021-03-10T16:23:47.797663+0000 mgr.gibba045.orlgmj (mgr.34412) 8183 : audit [DBG] from='client.59530 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:23:49.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:23:49 gibba045 bash[25517]: audit 2021-03-10T16:23:48.024313+0000 mgr.gibba045.orlgmj (mgr.34412) 8184 : audit [DBG] from='client.59536 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:23:49.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:23:49 gibba045 bash[25517]: audit 2021-03-10T16:23:48.316207+0000 mon.a (mon.0) 1862 : audit [DBG] from='client.? 172.21.2.115:0/979828765' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:23:50.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:23:50 gibba015 bash[29377]: cephadm 2021-03-10T16:23:48.559948+0000 mgr.gibba045.orlgmj (mgr.34412) 8185 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:23:50.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:23:50 gibba015 bash[30343]: cephadm 2021-03-10T16:23:48.559948+0000 mgr.gibba045.orlgmj (mgr.34412) 8185 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:23:50.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:23:50 gibba045 bash[25517]: cephadm 2021-03-10T16:23:48.559948+0000 mgr.gibba045.orlgmj (mgr.34412) 8185 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:23:51.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:23:51 gibba015 bash[29377]: cluster 2021-03-10T16:23:49.740800+0000 mgr.gibba045.orlgmj (mgr.34412) 8186 : cluster [DBG] pgmap v4660: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:51.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:23:51 gibba015 bash[30343]: cluster 2021-03-10T16:23:49.740800+0000 mgr.gibba045.orlgmj (mgr.34412) 8186 : cluster [DBG] pgmap v4660: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:51.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:23:51 gibba045 bash[25517]: cluster 2021-03-10T16:23:49.740800+0000 mgr.gibba045.orlgmj (mgr.34412) 8186 : cluster [DBG] pgmap v4660: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:53.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:23:53 gibba015 bash[29377]: cluster 2021-03-10T16:23:51.742595+0000 mgr.gibba045.orlgmj (mgr.34412) 8187 : cluster [DBG] pgmap v4661: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:53.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:23:53 gibba015 bash[30343]: cluster 2021-03-10T16:23:51.742595+0000 mgr.gibba045.orlgmj (mgr.34412) 8187 : cluster [DBG] pgmap v4661: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:53.552 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:23:53 gibba045 bash[25517]: cluster 2021-03-10T16:23:51.742595+0000 mgr.gibba045.orlgmj (mgr.34412) 8187 : cluster [DBG] pgmap v4661: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:54.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:23:54 gibba015 bash[29377]: audit 2021-03-10T16:23:53.547568+0000 mon.c (mon.1) 2264 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:23:54.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:23:54 gibba015 bash[29377]: audit 2021-03-10T16:23:53.548209+0000 mon.c (mon.1) 2265 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:23:54.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:23:54 gibba015 bash[29377]: audit 2021-03-10T16:23:53.548806+0000 mon.c (mon.1) 2266 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T16:23:54.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:23:54 gibba015 bash[29377]: audit 2021-03-10T16:23:53.548825+0000 mon.a (mon.0) 1863 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:23:54.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:23:54 gibba015 bash[29377]: audit 2021-03-10T16:23:53.549585+0000 mon.c (mon.1) 2267 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 5]}]: dispatch 2021-03-10T16:23:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:23:54 gibba015 bash[29377]: audit 2021-03-10T16:23:53.550408+0000 mon.c (mon.1) 2268 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:23:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:23:54 gibba015 bash[29377]: audit 2021-03-10T16:23:53.550707+0000 mon.a (mon.0) 1864 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:23:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:23:54 gibba015 bash[29377]: audit 2021-03-10T16:23:53.551081+0000 mon.c (mon.1) 2269 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:23:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:23:54 gibba015 bash[29377]: audit 2021-03-10T16:23:53.552559+0000 mon.a (mon.0) 1865 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T16:23:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:23:54 gibba015 bash[29377]: audit 2021-03-10T16:23:53.553542+0000 mon.a (mon.0) 1866 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 5]}]: dispatch 2021-03-10T16:23:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:23:54 gibba015 bash[29377]: audit 2021-03-10T16:23:53.554351+0000 mon.a (mon.0) 1867 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:23:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:23:54 gibba015 bash[29377]: audit 2021-03-10T16:23:53.554540+0000 mon.a (mon.0) 1868 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:23:54.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:23:54 gibba015 bash[30343]: audit 2021-03-10T16:23:53.547568+0000 mon.c (mon.1) 2264 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:23:54.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:23:54 gibba015 bash[30343]: audit 2021-03-10T16:23:53.548209+0000 mon.c (mon.1) 2265 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:23:54.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:23:54 gibba015 bash[30343]: audit 2021-03-10T16:23:53.548806+0000 mon.c (mon.1) 2266 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T16:23:54.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:23:54 gibba015 bash[30343]: audit 2021-03-10T16:23:53.548825+0000 mon.a (mon.0) 1863 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:23:54.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:23:54 gibba015 bash[30343]: audit 2021-03-10T16:23:53.549585+0000 mon.c (mon.1) 2267 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 5]}]: dispatch 2021-03-10T16:23:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:23:54 gibba015 bash[30343]: audit 2021-03-10T16:23:53.550408+0000 mon.c (mon.1) 2268 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:23:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:23:54 gibba015 bash[30343]: audit 2021-03-10T16:23:53.550707+0000 mon.a (mon.0) 1864 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:23:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:23:54 gibba015 bash[30343]: audit 2021-03-10T16:23:53.551081+0000 mon.c (mon.1) 2269 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:23:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:23:54 gibba015 bash[30343]: audit 2021-03-10T16:23:53.552559+0000 mon.a (mon.0) 1865 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T16:23:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:23:54 gibba015 bash[30343]: audit 2021-03-10T16:23:53.553542+0000 mon.a (mon.0) 1866 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 5]}]: dispatch 2021-03-10T16:23:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:23:54 gibba015 bash[30343]: audit 2021-03-10T16:23:53.554351+0000 mon.a (mon.0) 1867 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:23:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:23:54 gibba015 bash[30343]: audit 2021-03-10T16:23:53.554540+0000 mon.a (mon.0) 1868 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:23:54.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:23:54 gibba045 bash[25517]: audit 2021-03-10T16:23:53.547568+0000 mon.c (mon.1) 2264 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:23:54.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:23:54 gibba045 bash[25517]: audit 2021-03-10T16:23:53.548209+0000 mon.c (mon.1) 2265 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:23:54.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:23:54 gibba045 bash[25517]: audit 2021-03-10T16:23:53.548806+0000 mon.c (mon.1) 2266 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T16:23:54.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:23:54 gibba045 bash[25517]: audit 2021-03-10T16:23:53.548825+0000 mon.a (mon.0) 1863 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:23:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:23:54 gibba045 bash[25517]: audit 2021-03-10T16:23:53.549585+0000 mon.c (mon.1) 2267 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 5]}]: dispatch 2021-03-10T16:23:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:23:54 gibba045 bash[25517]: audit 2021-03-10T16:23:53.550408+0000 mon.c (mon.1) 2268 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:23:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:23:54 gibba045 bash[25517]: audit 2021-03-10T16:23:53.550707+0000 mon.a (mon.0) 1864 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:23:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:23:54 gibba045 bash[25517]: audit 2021-03-10T16:23:53.551081+0000 mon.c (mon.1) 2269 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:23:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:23:54 gibba045 bash[25517]: audit 2021-03-10T16:23:53.552559+0000 mon.a (mon.0) 1865 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T16:23:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:23:54 gibba045 bash[25517]: audit 2021-03-10T16:23:53.553542+0000 mon.a (mon.0) 1866 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 5]}]: dispatch 2021-03-10T16:23:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:23:54 gibba045 bash[25517]: audit 2021-03-10T16:23:53.554351+0000 mon.a (mon.0) 1867 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:23:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:23:54 gibba045 bash[25517]: audit 2021-03-10T16:23:53.554540+0000 mon.a (mon.0) 1868 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:23:55.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:23:55 gibba015 bash[29377]: cluster 2021-03-10T16:23:53.744089+0000 mgr.gibba045.orlgmj (mgr.34412) 8188 : cluster [DBG] pgmap v4662: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:55.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:23:55 gibba015 bash[30343]: cluster 2021-03-10T16:23:53.744089+0000 mgr.gibba045.orlgmj (mgr.34412) 8188 : cluster [DBG] pgmap v4662: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:55.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:23:55 gibba045 bash[25517]: cluster 2021-03-10T16:23:53.744089+0000 mgr.gibba045.orlgmj (mgr.34412) 8188 : cluster [DBG] pgmap v4662: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:57.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:23:57 gibba015 bash[29377]: cluster 2021-03-10T16:23:55.745735+0000 mgr.gibba045.orlgmj (mgr.34412) 8189 : cluster [DBG] pgmap v4663: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:57.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:23:57 gibba015 bash[30343]: cluster 2021-03-10T16:23:55.745735+0000 mgr.gibba045.orlgmj (mgr.34412) 8189 : cluster [DBG] pgmap v4663: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:57.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:23:57 gibba045 bash[25517]: cluster 2021-03-10T16:23:55.745735+0000 mgr.gibba045.orlgmj (mgr.34412) 8189 : cluster [DBG] pgmap v4663: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:59.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:23:59 gibba015 bash[29377]: cluster 2021-03-10T16:23:57.747337+0000 mgr.gibba045.orlgmj (mgr.34412) 8190 : cluster [DBG] pgmap v4664: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:59.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:23:59 gibba015 bash[30343]: cluster 2021-03-10T16:23:57.747337+0000 mgr.gibba045.orlgmj (mgr.34412) 8190 : cluster [DBG] pgmap v4664: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:59.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:23:59 gibba045 bash[25517]: cluster 2021-03-10T16:23:57.747337+0000 mgr.gibba045.orlgmj (mgr.34412) 8190 : cluster [DBG] pgmap v4664: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:01.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:24:01 gibba015 bash[29377]: cluster 2021-03-10T16:23:59.749058+0000 mgr.gibba045.orlgmj (mgr.34412) 8191 : cluster [DBG] pgmap v4665: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:01.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:24:01 gibba015 bash[30343]: cluster 2021-03-10T16:23:59.749058+0000 mgr.gibba045.orlgmj (mgr.34412) 8191 : cluster [DBG] pgmap v4665: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:01.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:24:01 gibba045 bash[25517]: cluster 2021-03-10T16:23:59.749058+0000 mgr.gibba045.orlgmj (mgr.34412) 8191 : cluster [DBG] pgmap v4665: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:03.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:24:03 gibba015 bash[29377]: cluster 2021-03-10T16:24:01.750812+0000 mgr.gibba045.orlgmj (mgr.34412) 8192 : cluster [DBG] pgmap v4666: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:03.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:24:03 gibba015 bash[30343]: cluster 2021-03-10T16:24:01.750812+0000 mgr.gibba045.orlgmj (mgr.34412) 8192 : cluster [DBG] pgmap v4666: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:03.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:24:03 gibba045 bash[25517]: cluster 2021-03-10T16:24:01.750812+0000 mgr.gibba045.orlgmj (mgr.34412) 8192 : cluster [DBG] pgmap v4666: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:05.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:24:05 gibba015 bash[29377]: cephadm 2021-03-10T16:24:03.565409+0000 mgr.gibba045.orlgmj (mgr.34412) 8193 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:24:05.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:24:05 gibba015 bash[29377]: cluster 2021-03-10T16:24:03.752049+0000 mgr.gibba045.orlgmj (mgr.34412) 8194 : cluster [DBG] pgmap v4667: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:05.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:24:05 gibba015 bash[30343]: cephadm 2021-03-10T16:24:03.565409+0000 mgr.gibba045.orlgmj (mgr.34412) 8193 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:24:05.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:24:05 gibba015 bash[30343]: cluster 2021-03-10T16:24:03.752049+0000 mgr.gibba045.orlgmj (mgr.34412) 8194 : cluster [DBG] pgmap v4667: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:05.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:24:05 gibba045 bash[25517]: cephadm 2021-03-10T16:24:03.565409+0000 mgr.gibba045.orlgmj (mgr.34412) 8193 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:24:05.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:24:05 gibba045 bash[25517]: cluster 2021-03-10T16:24:03.752049+0000 mgr.gibba045.orlgmj (mgr.34412) 8194 : cluster [DBG] pgmap v4667: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:07.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:24:07 gibba015 bash[29377]: cluster 2021-03-10T16:24:05.753611+0000 mgr.gibba045.orlgmj (mgr.34412) 8195 : cluster [DBG] pgmap v4668: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:07.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:24:07 gibba015 bash[30343]: cluster 2021-03-10T16:24:05.753611+0000 mgr.gibba045.orlgmj (mgr.34412) 8195 : cluster [DBG] pgmap v4668: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:07.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:24:07 gibba045 bash[25517]: cluster 2021-03-10T16:24:05.753611+0000 mgr.gibba045.orlgmj (mgr.34412) 8195 : cluster [DBG] pgmap v4668: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:09.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:24:09 gibba015 bash[29377]: cluster 2021-03-10T16:24:07.755250+0000 mgr.gibba045.orlgmj (mgr.34412) 8196 : cluster [DBG] pgmap v4669: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:09.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:24:09 gibba015 bash[30343]: cluster 2021-03-10T16:24:07.755250+0000 mgr.gibba045.orlgmj (mgr.34412) 8196 : cluster [DBG] pgmap v4669: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:09.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:24:09 gibba045 bash[25517]: cluster 2021-03-10T16:24:07.755250+0000 mgr.gibba045.orlgmj (mgr.34412) 8196 : cluster [DBG] pgmap v4669: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:11.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:24:11 gibba015 bash[29377]: cluster 2021-03-10T16:24:09.756996+0000 mgr.gibba045.orlgmj (mgr.34412) 8197 : cluster [DBG] pgmap v4670: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:11.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:24:11 gibba015 bash[30343]: cluster 2021-03-10T16:24:09.756996+0000 mgr.gibba045.orlgmj (mgr.34412) 8197 : cluster [DBG] pgmap v4670: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:11.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:24:11 gibba045 bash[25517]: cluster 2021-03-10T16:24:09.756996+0000 mgr.gibba045.orlgmj (mgr.34412) 8197 : cluster [DBG] pgmap v4670: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:13.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:24:13 gibba015 bash[29377]: cluster 2021-03-10T16:24:11.758768+0000 mgr.gibba045.orlgmj (mgr.34412) 8198 : cluster [DBG] pgmap v4671: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:13.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:24:13 gibba015 bash[30343]: cluster 2021-03-10T16:24:11.758768+0000 mgr.gibba045.orlgmj (mgr.34412) 8198 : cluster [DBG] pgmap v4671: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:13.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:24:13 gibba045 bash[25517]: cluster 2021-03-10T16:24:11.758768+0000 mgr.gibba045.orlgmj (mgr.34412) 8198 : cluster [DBG] pgmap v4671: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:15.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:24:15 gibba015 bash[29377]: cluster 2021-03-10T16:24:13.760314+0000 mgr.gibba045.orlgmj (mgr.34412) 8199 : cluster [DBG] pgmap v4672: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:15.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:24:15 gibba015 bash[30343]: cluster 2021-03-10T16:24:13.760314+0000 mgr.gibba045.orlgmj (mgr.34412) 8199 : cluster [DBG] pgmap v4672: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:15.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:24:15 gibba045 bash[25517]: cluster 2021-03-10T16:24:13.760314+0000 mgr.gibba045.orlgmj (mgr.34412) 8199 : cluster [DBG] pgmap v4672: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:17.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:24:17 gibba045 bash[25517]: cluster 2021-03-10T16:24:15.762152+0000 mgr.gibba045.orlgmj (mgr.34412) 8200 : cluster [DBG] pgmap v4673: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:17.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:24:17 gibba015 bash[29377]: cluster 2021-03-10T16:24:15.762152+0000 mgr.gibba045.orlgmj (mgr.34412) 8200 : cluster [DBG] pgmap v4673: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:17.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:24:17 gibba015 bash[30343]: cluster 2021-03-10T16:24:15.762152+0000 mgr.gibba045.orlgmj (mgr.34412) 8200 : cluster [DBG] pgmap v4673: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:18.558 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:24:18.781 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:24:18.782 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 8m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:24:18.782 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 7m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:24:18.782 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:24:18.783 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:24:18.783 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:24:18.783 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:24:18.783 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:24:18.783 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:24:18.784 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 8m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:24:18.784 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 7m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:24:18.784 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:24:18.784 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:24:18.785 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:24:18.785 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:24:18.785 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:24:18.785 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:24:18.785 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:24:18.786 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:24:18.786 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 7m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:24:18.786 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 7m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:24:19.033 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:24:19.033 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:24:19.033 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:24:19.033 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:24:19.034 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:24:19.034 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:24:19.034 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:24:19.034 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:24:19.034 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:24:19.035 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:24:19.035 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:24:19.035 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:24:19.035 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:24:19.035 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:24:19.036 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:24:19.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:24:19 gibba045 bash[25517]: cluster 2021-03-10T16:24:17.763820+0000 mgr.gibba045.orlgmj (mgr.34412) 8201 : cluster [DBG] pgmap v4674: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:19.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:24:19 gibba045 bash[25517]: audit 2021-03-10T16:24:18.579095+0000 mon.c (mon.1) 2270 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:24:19.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:24:19 gibba045 bash[25517]: audit 2021-03-10T16:24:18.800902+0000 mon.a (mon.0) 1869 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:24:19.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:24:19 gibba045 bash[25517]: audit 2021-03-10T16:24:18.804299+0000 mon.c (mon.1) 2271 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:24:19.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:24:19 gibba045 bash[25517]: audit 2021-03-10T16:24:18.805448+0000 mon.c (mon.1) 2272 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:24:19.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:24:19 gibba045 bash[25517]: audit 2021-03-10T16:24:18.806568+0000 mon.c (mon.1) 2273 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:24:19.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:24:19 gibba045 bash[25517]: audit 2021-03-10T16:24:18.807574+0000 mon.c (mon.1) 2274 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:24:19.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:24:19 gibba045 bash[25517]: audit 2021-03-10T16:24:18.809504+0000 mon.c (mon.1) 2275 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:24:19.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:24:19 gibba045 bash[25517]: audit 2021-03-10T16:24:18.810604+0000 mon.c (mon.1) 2276 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:24:19.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:24:19 gibba045 bash[25517]: audit 2021-03-10T16:24:19.033515+0000 mon.a (mon.0) 1870 : audit [DBG] from='client.? 172.21.2.115:0/3695884749' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:24:19.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:24:19 gibba015 bash[29377]: cluster 2021-03-10T16:24:17.763820+0000 mgr.gibba045.orlgmj (mgr.34412) 8201 : cluster [DBG] pgmap v4674: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:19.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:24:19 gibba015 bash[29377]: audit 2021-03-10T16:24:18.579095+0000 mon.c (mon.1) 2270 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:24:19.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:24:19 gibba015 bash[29377]: audit 2021-03-10T16:24:18.800902+0000 mon.a (mon.0) 1869 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:24:19.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:24:19 gibba015 bash[29377]: audit 2021-03-10T16:24:18.804299+0000 mon.c (mon.1) 2271 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:24:19.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:24:19 gibba015 bash[29377]: audit 2021-03-10T16:24:18.805448+0000 mon.c (mon.1) 2272 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:24:19.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:24:19 gibba015 bash[29377]: audit 2021-03-10T16:24:18.806568+0000 mon.c (mon.1) 2273 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:24:19.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:24:19 gibba015 bash[29377]: audit 2021-03-10T16:24:18.807574+0000 mon.c (mon.1) 2274 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:24:19.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:24:19 gibba015 bash[29377]: audit 2021-03-10T16:24:18.809504+0000 mon.c (mon.1) 2275 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:24:19.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:24:19 gibba015 bash[29377]: audit 2021-03-10T16:24:18.810604+0000 mon.c (mon.1) 2276 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:24:19.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:24:19 gibba015 bash[29377]: audit 2021-03-10T16:24:19.033515+0000 mon.a (mon.0) 1870 : audit [DBG] from='client.? 172.21.2.115:0/3695884749' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:24:19.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:24:19 gibba015 bash[30343]: cluster 2021-03-10T16:24:17.763820+0000 mgr.gibba045.orlgmj (mgr.34412) 8201 : cluster [DBG] pgmap v4674: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:19.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:24:19 gibba015 bash[30343]: audit 2021-03-10T16:24:18.579095+0000 mon.c (mon.1) 2270 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:24:19.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:24:19 gibba015 bash[30343]: audit 2021-03-10T16:24:18.800902+0000 mon.a (mon.0) 1869 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:24:19.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:24:19 gibba015 bash[30343]: audit 2021-03-10T16:24:18.804299+0000 mon.c (mon.1) 2271 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:24:19.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:24:19 gibba015 bash[30343]: audit 2021-03-10T16:24:18.805448+0000 mon.c (mon.1) 2272 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:24:19.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:24:19 gibba015 bash[30343]: audit 2021-03-10T16:24:18.806568+0000 mon.c (mon.1) 2273 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:24:19.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:24:19 gibba015 bash[30343]: audit 2021-03-10T16:24:18.807574+0000 mon.c (mon.1) 2274 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:24:19.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:24:19 gibba015 bash[30343]: audit 2021-03-10T16:24:18.809504+0000 mon.c (mon.1) 2275 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:24:19.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:24:19 gibba015 bash[30343]: audit 2021-03-10T16:24:18.810604+0000 mon.c (mon.1) 2276 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:24:19.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:24:19 gibba015 bash[30343]: audit 2021-03-10T16:24:19.033515+0000 mon.a (mon.0) 1870 : audit [DBG] from='client.? 172.21.2.115:0/3695884749' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:24:20.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:24:20 gibba045 bash[25517]: audit 2021-03-10T16:24:18.552248+0000 mgr.gibba045.orlgmj (mgr.34412) 8202 : audit [DBG] from='client.49560 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:24:20.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:24:20 gibba045 bash[25517]: cephadm 2021-03-10T16:24:18.585523+0000 mgr.gibba045.orlgmj (mgr.34412) 8203 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:24:20.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:24:20 gibba045 bash[25517]: cephadm 2021-03-10T16:24:18.587453+0000 mgr.gibba045.orlgmj (mgr.34412) 8204 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:24:20.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:24:20 gibba045 bash[25517]: audit 2021-03-10T16:24:18.777067+0000 mgr.gibba045.orlgmj (mgr.34412) 8205 : audit [DBG] from='client.49566 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:24:20.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:24:20 gibba045 bash[25517]: cephadm 2021-03-10T16:24:18.806110+0000 mgr.gibba045.orlgmj (mgr.34412) 8206 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:24:20.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:24:20 gibba045 bash[25517]: cephadm 2021-03-10T16:24:18.807655+0000 mgr.gibba045.orlgmj (mgr.34412) 8207 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:24:20.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:24:20 gibba045 bash[25517]: cephadm 2021-03-10T16:24:18.808660+0000 mgr.gibba045.orlgmj (mgr.34412) 8208 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:24:20.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:24:20 gibba045 bash[25517]: cephadm 2021-03-10T16:24:18.808750+0000 mgr.gibba045.orlgmj (mgr.34412) 8209 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:24:20.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:24:20 gibba045 bash[25517]: cephadm 2021-03-10T16:24:18.809786+0000 mgr.gibba045.orlgmj (mgr.34412) 8210 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:24:20.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:24:20 gibba045 bash[25517]: cephadm 2021-03-10T16:24:18.809826+0000 mgr.gibba045.orlgmj (mgr.34412) 8211 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:24:20.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:24:20 gibba045 bash[25517]: cephadm 2021-03-10T16:24:18.810670+0000 mgr.gibba045.orlgmj (mgr.34412) 8212 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:24:20.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:24:20 gibba045 bash[25517]: cephadm 2021-03-10T16:24:18.811637+0000 mgr.gibba045.orlgmj (mgr.34412) 8213 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:24:20.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:24:20 gibba045 bash[25517]: cephadm 2021-03-10T16:24:18.811676+0000 mgr.gibba045.orlgmj (mgr.34412) 8214 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:24:20.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:24:20 gibba045 bash[25517]: cephadm 2021-03-10T16:24:18.812582+0000 mgr.gibba045.orlgmj (mgr.34412) 8215 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:24:20.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:24:20 gibba045 bash[25517]: cephadm 2021-03-10T16:24:18.812899+0000 mgr.gibba045.orlgmj (mgr.34412) 8216 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:24:20.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:24:20 gibba045 bash[25517]: cephadm 2021-03-10T16:24:18.813681+0000 mgr.gibba045.orlgmj (mgr.34412) 8217 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:24:20.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:24:20 gibba045 bash[25517]: cephadm 2021-03-10T16:24:18.813720+0000 mgr.gibba045.orlgmj (mgr.34412) 8218 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:24:20.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:24:20 gibba045 bash[25517]: cephadm 2021-03-10T16:24:18.813842+0000 mgr.gibba045.orlgmj (mgr.34412) 8219 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:24:20.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:24:20 gibba015 bash[29377]: audit 2021-03-10T16:24:18.552248+0000 mgr.gibba045.orlgmj (mgr.34412) 8202 : audit [DBG] from='client.49560 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:24:20.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:24:20 gibba015 bash[29377]: cephadm 2021-03-10T16:24:18.585523+0000 mgr.gibba045.orlgmj (mgr.34412) 8203 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:24:20.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:24:20 gibba015 bash[29377]: cephadm 2021-03-10T16:24:18.587453+0000 mgr.gibba045.orlgmj (mgr.34412) 8204 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:24:20.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:24:20 gibba015 bash[29377]: audit 2021-03-10T16:24:18.777067+0000 mgr.gibba045.orlgmj (mgr.34412) 8205 : audit [DBG] from='client.49566 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:24:20.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:24:20 gibba015 bash[29377]: cephadm 2021-03-10T16:24:18.806110+0000 mgr.gibba045.orlgmj (mgr.34412) 8206 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:24:20.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:24:20 gibba015 bash[29377]: cephadm 2021-03-10T16:24:18.807655+0000 mgr.gibba045.orlgmj (mgr.34412) 8207 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:24:20.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:24:20 gibba015 bash[29377]: cephadm 2021-03-10T16:24:18.808660+0000 mgr.gibba045.orlgmj (mgr.34412) 8208 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:24:20.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:24:20 gibba015 bash[29377]: cephadm 2021-03-10T16:24:18.808750+0000 mgr.gibba045.orlgmj (mgr.34412) 8209 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:24:20.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:24:20 gibba015 bash[29377]: cephadm 2021-03-10T16:24:18.809786+0000 mgr.gibba045.orlgmj (mgr.34412) 8210 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:24:20.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:24:20 gibba015 bash[29377]: cephadm 2021-03-10T16:24:18.809826+0000 mgr.gibba045.orlgmj (mgr.34412) 8211 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:24:20.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:24:20 gibba015 bash[29377]: cephadm 2021-03-10T16:24:18.810670+0000 mgr.gibba045.orlgmj (mgr.34412) 8212 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:24:20.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:24:20 gibba015 bash[29377]: cephadm 2021-03-10T16:24:18.811637+0000 mgr.gibba045.orlgmj (mgr.34412) 8213 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:24:20.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:24:20 gibba015 bash[29377]: cephadm 2021-03-10T16:24:18.811676+0000 mgr.gibba045.orlgmj (mgr.34412) 8214 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:24:20.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:24:20 gibba015 bash[29377]: cephadm 2021-03-10T16:24:18.812582+0000 mgr.gibba045.orlgmj (mgr.34412) 8215 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:24:20.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:24:20 gibba015 bash[29377]: cephadm 2021-03-10T16:24:18.812899+0000 mgr.gibba045.orlgmj (mgr.34412) 8216 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:24:20.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:24:20 gibba015 bash[29377]: cephadm 2021-03-10T16:24:18.813681+0000 mgr.gibba045.orlgmj (mgr.34412) 8217 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:24:20.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:24:20 gibba015 bash[29377]: cephadm 2021-03-10T16:24:18.813720+0000 mgr.gibba045.orlgmj (mgr.34412) 8218 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:24:20.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:24:20 gibba015 bash[29377]: cephadm 2021-03-10T16:24:18.813842+0000 mgr.gibba045.orlgmj (mgr.34412) 8219 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:24:20.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:24:20 gibba015 bash[30343]: audit 2021-03-10T16:24:18.552248+0000 mgr.gibba045.orlgmj (mgr.34412) 8202 : audit [DBG] from='client.49560 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:24:20.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:24:20 gibba015 bash[30343]: cephadm 2021-03-10T16:24:18.585523+0000 mgr.gibba045.orlgmj (mgr.34412) 8203 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:24:20.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:24:20 gibba015 bash[30343]: cephadm 2021-03-10T16:24:18.587453+0000 mgr.gibba045.orlgmj (mgr.34412) 8204 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:24:20.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:24:20 gibba015 bash[30343]: audit 2021-03-10T16:24:18.777067+0000 mgr.gibba045.orlgmj (mgr.34412) 8205 : audit [DBG] from='client.49566 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:24:20.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:24:20 gibba015 bash[30343]: cephadm 2021-03-10T16:24:18.806110+0000 mgr.gibba045.orlgmj (mgr.34412) 8206 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:24:20.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:24:20 gibba015 bash[30343]: cephadm 2021-03-10T16:24:18.807655+0000 mgr.gibba045.orlgmj (mgr.34412) 8207 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:24:20.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:24:20 gibba015 bash[30343]: cephadm 2021-03-10T16:24:18.808660+0000 mgr.gibba045.orlgmj (mgr.34412) 8208 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:24:20.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:24:20 gibba015 bash[30343]: cephadm 2021-03-10T16:24:18.808750+0000 mgr.gibba045.orlgmj (mgr.34412) 8209 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:24:20.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:24:20 gibba015 bash[30343]: cephadm 2021-03-10T16:24:18.809786+0000 mgr.gibba045.orlgmj (mgr.34412) 8210 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:24:20.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:24:20 gibba015 bash[30343]: cephadm 2021-03-10T16:24:18.809826+0000 mgr.gibba045.orlgmj (mgr.34412) 8211 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:24:20.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:24:20 gibba015 bash[30343]: cephadm 2021-03-10T16:24:18.810670+0000 mgr.gibba045.orlgmj (mgr.34412) 8212 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:24:20.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:24:20 gibba015 bash[30343]: cephadm 2021-03-10T16:24:18.811637+0000 mgr.gibba045.orlgmj (mgr.34412) 8213 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:24:20.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:24:20 gibba015 bash[30343]: cephadm 2021-03-10T16:24:18.811676+0000 mgr.gibba045.orlgmj (mgr.34412) 8214 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:24:20.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:24:20 gibba015 bash[30343]: cephadm 2021-03-10T16:24:18.812582+0000 mgr.gibba045.orlgmj (mgr.34412) 8215 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:24:20.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:24:20 gibba015 bash[30343]: cephadm 2021-03-10T16:24:18.812899+0000 mgr.gibba045.orlgmj (mgr.34412) 8216 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:24:20.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:24:20 gibba015 bash[30343]: cephadm 2021-03-10T16:24:18.813681+0000 mgr.gibba045.orlgmj (mgr.34412) 8217 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:24:20.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:24:20 gibba015 bash[30343]: cephadm 2021-03-10T16:24:18.813720+0000 mgr.gibba045.orlgmj (mgr.34412) 8218 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:24:20.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:24:20 gibba015 bash[30343]: cephadm 2021-03-10T16:24:18.813842+0000 mgr.gibba045.orlgmj (mgr.34412) 8219 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:24:21.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:24:21 gibba045 bash[25517]: cluster 2021-03-10T16:24:19.765513+0000 mgr.gibba045.orlgmj (mgr.34412) 8220 : cluster [DBG] pgmap v4675: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:21.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:24:21 gibba015 bash[29377]: cluster 2021-03-10T16:24:19.765513+0000 mgr.gibba045.orlgmj (mgr.34412) 8220 : cluster [DBG] pgmap v4675: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:21.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:24:21 gibba015 bash[30343]: cluster 2021-03-10T16:24:19.765513+0000 mgr.gibba045.orlgmj (mgr.34412) 8220 : cluster [DBG] pgmap v4675: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:23.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:24:23 gibba045 bash[25517]: cluster 2021-03-10T16:24:21.767204+0000 mgr.gibba045.orlgmj (mgr.34412) 8221 : cluster [DBG] pgmap v4676: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:23.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:24:23 gibba015 bash[29377]: cluster 2021-03-10T16:24:21.767204+0000 mgr.gibba045.orlgmj (mgr.34412) 8221 : cluster [DBG] pgmap v4676: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:23.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:24:23 gibba015 bash[30343]: cluster 2021-03-10T16:24:21.767204+0000 mgr.gibba045.orlgmj (mgr.34412) 8221 : cluster [DBG] pgmap v4676: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:25.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:24:25 gibba045 bash[25517]: cluster 2021-03-10T16:24:23.768717+0000 mgr.gibba045.orlgmj (mgr.34412) 8222 : cluster [DBG] pgmap v4677: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:25.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:24:25 gibba015 bash[29377]: cluster 2021-03-10T16:24:23.768717+0000 mgr.gibba045.orlgmj (mgr.34412) 8222 : cluster [DBG] pgmap v4677: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:25.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:24:25 gibba015 bash[30343]: cluster 2021-03-10T16:24:23.768717+0000 mgr.gibba045.orlgmj (mgr.34412) 8222 : cluster [DBG] pgmap v4677: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:27.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:24:27 gibba045 bash[25517]: cluster 2021-03-10T16:24:25.770300+0000 mgr.gibba045.orlgmj (mgr.34412) 8223 : cluster [DBG] pgmap v4678: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:27.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:24:27 gibba015 bash[29377]: cluster 2021-03-10T16:24:25.770300+0000 mgr.gibba045.orlgmj (mgr.34412) 8223 : cluster [DBG] pgmap v4678: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:27.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:24:27 gibba015 bash[30343]: cluster 2021-03-10T16:24:25.770300+0000 mgr.gibba045.orlgmj (mgr.34412) 8223 : cluster [DBG] pgmap v4678: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:29.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:24:29 gibba045 bash[25517]: cluster 2021-03-10T16:24:27.771901+0000 mgr.gibba045.orlgmj (mgr.34412) 8224 : cluster [DBG] pgmap v4679: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:29.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:24:29 gibba015 bash[29377]: cluster 2021-03-10T16:24:27.771901+0000 mgr.gibba045.orlgmj (mgr.34412) 8224 : cluster [DBG] pgmap v4679: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:29.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:24:29 gibba015 bash[30343]: cluster 2021-03-10T16:24:27.771901+0000 mgr.gibba045.orlgmj (mgr.34412) 8224 : cluster [DBG] pgmap v4679: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:31.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:24:31 gibba045 bash[25517]: cluster 2021-03-10T16:24:29.773505+0000 mgr.gibba045.orlgmj (mgr.34412) 8225 : cluster [DBG] pgmap v4680: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:31.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:24:31 gibba015 bash[29377]: cluster 2021-03-10T16:24:29.773505+0000 mgr.gibba045.orlgmj (mgr.34412) 8225 : cluster [DBG] pgmap v4680: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:31.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:24:31 gibba015 bash[30343]: cluster 2021-03-10T16:24:29.773505+0000 mgr.gibba045.orlgmj (mgr.34412) 8225 : cluster [DBG] pgmap v4680: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:33.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:24:33 gibba045 bash[25517]: cluster 2021-03-10T16:24:31.775215+0000 mgr.gibba045.orlgmj (mgr.34412) 8226 : cluster [DBG] pgmap v4681: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:33.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:24:33 gibba015 bash[29377]: cluster 2021-03-10T16:24:31.775215+0000 mgr.gibba045.orlgmj (mgr.34412) 8226 : cluster [DBG] pgmap v4681: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:33.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:24:33 gibba015 bash[30343]: cluster 2021-03-10T16:24:31.775215+0000 mgr.gibba045.orlgmj (mgr.34412) 8226 : cluster [DBG] pgmap v4681: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:35.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:24:35 gibba015 bash[29377]: cluster 2021-03-10T16:24:33.776784+0000 mgr.gibba045.orlgmj (mgr.34412) 8227 : cluster [DBG] pgmap v4682: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:35.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:24:35 gibba015 bash[29377]: cephadm 2021-03-10T16:24:33.828687+0000 mgr.gibba045.orlgmj (mgr.34412) 8228 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:24:35.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:24:35 gibba015 bash[30343]: cluster 2021-03-10T16:24:33.776784+0000 mgr.gibba045.orlgmj (mgr.34412) 8227 : cluster [DBG] pgmap v4682: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:35.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:24:35 gibba015 bash[30343]: cephadm 2021-03-10T16:24:33.828687+0000 mgr.gibba045.orlgmj (mgr.34412) 8228 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:24:35.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:24:35 gibba045 bash[25517]: cluster 2021-03-10T16:24:33.776784+0000 mgr.gibba045.orlgmj (mgr.34412) 8227 : cluster [DBG] pgmap v4682: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:35.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:24:35 gibba045 bash[25517]: cephadm 2021-03-10T16:24:33.828687+0000 mgr.gibba045.orlgmj (mgr.34412) 8228 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:24:37.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:24:37 gibba015 bash[29377]: cluster 2021-03-10T16:24:35.778560+0000 mgr.gibba045.orlgmj (mgr.34412) 8229 : cluster [DBG] pgmap v4683: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:37.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:24:37 gibba015 bash[30343]: cluster 2021-03-10T16:24:35.778560+0000 mgr.gibba045.orlgmj (mgr.34412) 8229 : cluster [DBG] pgmap v4683: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:37.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:24:37 gibba045 bash[25517]: cluster 2021-03-10T16:24:35.778560+0000 mgr.gibba045.orlgmj (mgr.34412) 8229 : cluster [DBG] pgmap v4683: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:39.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:24:39 gibba015 bash[29377]: cluster 2021-03-10T16:24:37.779971+0000 mgr.gibba045.orlgmj (mgr.34412) 8230 : cluster [DBG] pgmap v4684: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:39.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:24:39 gibba015 bash[30343]: cluster 2021-03-10T16:24:37.779971+0000 mgr.gibba045.orlgmj (mgr.34412) 8230 : cluster [DBG] pgmap v4684: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:39.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:24:39 gibba045 bash[25517]: cluster 2021-03-10T16:24:37.779971+0000 mgr.gibba045.orlgmj (mgr.34412) 8230 : cluster [DBG] pgmap v4684: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:41.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:24:41 gibba015 bash[29377]: cluster 2021-03-10T16:24:39.781613+0000 mgr.gibba045.orlgmj (mgr.34412) 8231 : cluster [DBG] pgmap v4685: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:41.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:24:41 gibba015 bash[30343]: cluster 2021-03-10T16:24:39.781613+0000 mgr.gibba045.orlgmj (mgr.34412) 8231 : cluster [DBG] pgmap v4685: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:41.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:24:41 gibba045 bash[25517]: cluster 2021-03-10T16:24:39.781613+0000 mgr.gibba045.orlgmj (mgr.34412) 8231 : cluster [DBG] pgmap v4685: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:43.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:24:43 gibba015 bash[29377]: cluster 2021-03-10T16:24:41.783340+0000 mgr.gibba045.orlgmj (mgr.34412) 8232 : cluster [DBG] pgmap v4686: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:43.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:24:43 gibba015 bash[30343]: cluster 2021-03-10T16:24:41.783340+0000 mgr.gibba045.orlgmj (mgr.34412) 8232 : cluster [DBG] pgmap v4686: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:43.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:24:43 gibba045 bash[25517]: cluster 2021-03-10T16:24:41.783340+0000 mgr.gibba045.orlgmj (mgr.34412) 8232 : cluster [DBG] pgmap v4686: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:45.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:24:45 gibba015 bash[29377]: cluster 2021-03-10T16:24:43.784745+0000 mgr.gibba045.orlgmj (mgr.34412) 8233 : cluster [DBG] pgmap v4687: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:45.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:24:45 gibba015 bash[30343]: cluster 2021-03-10T16:24:43.784745+0000 mgr.gibba045.orlgmj (mgr.34412) 8233 : cluster [DBG] pgmap v4687: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:45.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:24:45 gibba045 bash[25517]: cluster 2021-03-10T16:24:43.784745+0000 mgr.gibba045.orlgmj (mgr.34412) 8233 : cluster [DBG] pgmap v4687: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:47.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:24:47 gibba015 bash[29377]: cluster 2021-03-10T16:24:45.786481+0000 mgr.gibba045.orlgmj (mgr.34412) 8234 : cluster [DBG] pgmap v4688: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:47.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:24:47 gibba015 bash[30343]: cluster 2021-03-10T16:24:45.786481+0000 mgr.gibba045.orlgmj (mgr.34412) 8234 : cluster [DBG] pgmap v4688: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:47.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:24:47 gibba045 bash[25517]: cluster 2021-03-10T16:24:45.786481+0000 mgr.gibba045.orlgmj (mgr.34412) 8234 : cluster [DBG] pgmap v4688: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:49.275 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:24:49.504 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:24:49.504 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 8m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:24:49.504 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 7m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:24:49.505 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:24:49.505 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:24:49.505 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:24:49.505 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:24:49.505 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:24:49.506 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:24:49.506 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 8m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:24:49.506 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 7m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:24:49.506 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:24:49.507 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:24:49.507 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:24:49.507 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:24:49.507 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:24:49.508 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:24:49.508 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:24:49.508 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:24:49.508 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 7m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:24:49.509 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 7m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:24:49.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:24:49 gibba015 bash[29377]: cluster 2021-03-10T16:24:47.788161+0000 mgr.gibba045.orlgmj (mgr.34412) 8235 : cluster [DBG] pgmap v4689: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:49.719 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:24:49 gibba015 bash[30343]: cluster 2021-03-10T16:24:47.788161+0000 mgr.gibba045.orlgmj (mgr.34412) 8235 : cluster [DBG] pgmap v4689: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:49.761 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:24:49.761 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:24:49.762 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:24:49.762 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:24:49.762 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:24:49.762 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:24:49.763 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:24:49.763 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:24:49.763 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:24:49.763 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:24:49.763 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:24:49.764 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:24:49.764 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:24:49.764 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:24:49.764 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:24:49.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:24:49 gibba045 bash[25517]: cluster 2021-03-10T16:24:47.788161+0000 mgr.gibba045.orlgmj (mgr.34412) 8235 : cluster [DBG] pgmap v4689: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:50.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:24:50 gibba015 bash[29377]: cephadm 2021-03-10T16:24:48.841198+0000 mgr.gibba045.orlgmj (mgr.34412) 8236 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:24:50.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:24:50 gibba015 bash[29377]: audit 2021-03-10T16:24:49.268635+0000 mgr.gibba045.orlgmj (mgr.34412) 8237 : audit [DBG] from='client.59566 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:24:50.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:24:50 gibba015 bash[29377]: audit 2021-03-10T16:24:49.761928+0000 mon.c (mon.1) 2277 : audit [DBG] from='client.? 172.21.2.115:0/682008509' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:24:50.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:24:50 gibba015 bash[30343]: cephadm 2021-03-10T16:24:48.841198+0000 mgr.gibba045.orlgmj (mgr.34412) 8236 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:24:50.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:24:50 gibba015 bash[30343]: audit 2021-03-10T16:24:49.268635+0000 mgr.gibba045.orlgmj (mgr.34412) 8237 : audit [DBG] from='client.59566 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:24:50.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:24:50 gibba015 bash[30343]: audit 2021-03-10T16:24:49.761928+0000 mon.c (mon.1) 2277 : audit [DBG] from='client.? 172.21.2.115:0/682008509' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:24:50.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:24:50 gibba045 bash[25517]: cephadm 2021-03-10T16:24:48.841198+0000 mgr.gibba045.orlgmj (mgr.34412) 8236 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:24:50.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:24:50 gibba045 bash[25517]: audit 2021-03-10T16:24:49.268635+0000 mgr.gibba045.orlgmj (mgr.34412) 8237 : audit [DBG] from='client.59566 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:24:50.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:24:50 gibba045 bash[25517]: audit 2021-03-10T16:24:49.761928+0000 mon.c (mon.1) 2277 : audit [DBG] from='client.? 172.21.2.115:0/682008509' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:24:51.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:24:51 gibba015 bash[29377]: audit 2021-03-10T16:24:49.494381+0000 mgr.gibba045.orlgmj (mgr.34412) 8238 : audit [DBG] from='client.59572 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:24:51.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:24:51 gibba015 bash[29377]: cluster 2021-03-10T16:24:49.789693+0000 mgr.gibba045.orlgmj (mgr.34412) 8239 : cluster [DBG] pgmap v4690: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:51.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:24:51 gibba015 bash[30343]: audit 2021-03-10T16:24:49.494381+0000 mgr.gibba045.orlgmj (mgr.34412) 8238 : audit [DBG] from='client.59572 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:24:51.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:24:51 gibba015 bash[30343]: cluster 2021-03-10T16:24:49.789693+0000 mgr.gibba045.orlgmj (mgr.34412) 8239 : cluster [DBG] pgmap v4690: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:51.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:24:51 gibba045 bash[25517]: audit 2021-03-10T16:24:49.494381+0000 mgr.gibba045.orlgmj (mgr.34412) 8238 : audit [DBG] from='client.59572 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:24:51.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:24:51 gibba045 bash[25517]: cluster 2021-03-10T16:24:49.789693+0000 mgr.gibba045.orlgmj (mgr.34412) 8239 : cluster [DBG] pgmap v4690: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:52.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:24:52 gibba015 bash[29377]: cluster 2021-03-10T16:24:51.791371+0000 mgr.gibba045.orlgmj (mgr.34412) 8240 : cluster [DBG] pgmap v4691: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:52.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:24:52 gibba015 bash[30343]: cluster 2021-03-10T16:24:51.791371+0000 mgr.gibba045.orlgmj (mgr.34412) 8240 : cluster [DBG] pgmap v4691: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:52.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:24:52 gibba045 bash[25517]: cluster 2021-03-10T16:24:51.791371+0000 mgr.gibba045.orlgmj (mgr.34412) 8240 : cluster [DBG] pgmap v4691: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:53.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:24:53 gibba015 bash[29377]: audit 2021-03-10T16:24:53.553968+0000 mon.c (mon.1) 2278 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:24:53.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:24:53 gibba015 bash[29377]: audit 2021-03-10T16:24:53.554839+0000 mon.c (mon.1) 2279 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:24:53.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:24:53 gibba015 bash[29377]: audit 2021-03-10T16:24:53.555076+0000 mon.a (mon.0) 1871 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:24:53.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:24:53 gibba015 bash[29377]: audit 2021-03-10T16:24:53.556220+0000 mon.a (mon.0) 1872 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:24:53.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:24:53 gibba015 bash[29377]: audit 2021-03-10T16:24:53.556901+0000 mon.c (mon.1) 2280 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:24:53.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:24:53 gibba015 bash[29377]: audit 2021-03-10T16:24:53.558001+0000 mon.c (mon.1) 2281 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:24:53.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:24:53 gibba015 bash[29377]: audit 2021-03-10T16:24:53.558075+0000 mon.a (mon.0) 1873 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:24:53.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:24:53 gibba015 bash[29377]: audit 2021-03-10T16:24:53.558813+0000 mon.c (mon.1) 2282 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:24:53.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:24:53 gibba015 bash[29377]: audit 2021-03-10T16:24:53.559124+0000 mon.a (mon.0) 1874 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:24:53.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:24:53 gibba015 bash[29377]: audit 2021-03-10T16:24:53.559628+0000 mon.c (mon.1) 2283 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:24:53.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:24:53 gibba015 bash[29377]: audit 2021-03-10T16:24:53.560095+0000 mon.a (mon.0) 1875 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:24:53.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:24:53 gibba015 bash[29377]: audit 2021-03-10T16:24:53.561252+0000 mon.a (mon.0) 1876 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:24:53.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:24:53 gibba015 bash[30343]: audit 2021-03-10T16:24:53.553968+0000 mon.c (mon.1) 2278 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:24:53.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:24:53 gibba015 bash[30343]: audit 2021-03-10T16:24:53.554839+0000 mon.c (mon.1) 2279 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:24:53.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:24:53 gibba015 bash[30343]: audit 2021-03-10T16:24:53.555076+0000 mon.a (mon.0) 1871 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:24:53.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:24:53 gibba015 bash[30343]: audit 2021-03-10T16:24:53.556220+0000 mon.a (mon.0) 1872 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:24:53.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:24:53 gibba015 bash[30343]: audit 2021-03-10T16:24:53.556901+0000 mon.c (mon.1) 2280 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:24:53.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:24:53 gibba015 bash[30343]: audit 2021-03-10T16:24:53.558001+0000 mon.c (mon.1) 2281 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:24:53.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:24:53 gibba015 bash[30343]: audit 2021-03-10T16:24:53.558075+0000 mon.a (mon.0) 1873 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:24:53.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:24:53 gibba015 bash[30343]: audit 2021-03-10T16:24:53.558813+0000 mon.c (mon.1) 2282 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:24:53.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:24:53 gibba015 bash[30343]: audit 2021-03-10T16:24:53.559124+0000 mon.a (mon.0) 1874 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:24:53.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:24:53 gibba015 bash[30343]: audit 2021-03-10T16:24:53.559628+0000 mon.c (mon.1) 2283 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:24:53.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:24:53 gibba015 bash[30343]: audit 2021-03-10T16:24:53.560095+0000 mon.a (mon.0) 1875 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:24:53.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:24:53 gibba015 bash[30343]: audit 2021-03-10T16:24:53.561252+0000 mon.a (mon.0) 1876 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:24:54.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:24:53 gibba045 bash[25517]: audit 2021-03-10T16:24:53.553968+0000 mon.c (mon.1) 2278 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:24:54.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:24:53 gibba045 bash[25517]: audit 2021-03-10T16:24:53.554839+0000 mon.c (mon.1) 2279 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:24:54.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:24:53 gibba045 bash[25517]: audit 2021-03-10T16:24:53.555076+0000 mon.a (mon.0) 1871 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:24:54.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:24:53 gibba045 bash[25517]: audit 2021-03-10T16:24:53.556220+0000 mon.a (mon.0) 1872 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:24:54.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:24:53 gibba045 bash[25517]: audit 2021-03-10T16:24:53.556901+0000 mon.c (mon.1) 2280 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:24:54.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:24:53 gibba045 bash[25517]: audit 2021-03-10T16:24:53.558001+0000 mon.c (mon.1) 2281 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:24:54.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:24:53 gibba045 bash[25517]: audit 2021-03-10T16:24:53.558075+0000 mon.a (mon.0) 1873 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:24:54.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:24:53 gibba045 bash[25517]: audit 2021-03-10T16:24:53.558813+0000 mon.c (mon.1) 2282 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:24:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:24:53 gibba045 bash[25517]: audit 2021-03-10T16:24:53.559124+0000 mon.a (mon.0) 1874 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:24:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:24:53 gibba045 bash[25517]: audit 2021-03-10T16:24:53.559628+0000 mon.c (mon.1) 2283 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:24:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:24:53 gibba045 bash[25517]: audit 2021-03-10T16:24:53.560095+0000 mon.a (mon.0) 1875 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:24:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:24:53 gibba045 bash[25517]: audit 2021-03-10T16:24:53.561252+0000 mon.a (mon.0) 1876 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:24:54.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:24:54 gibba015 bash[29377]: cluster 2021-03-10T16:24:53.792888+0000 mgr.gibba045.orlgmj (mgr.34412) 8241 : cluster [DBG] pgmap v4692: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:54.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:24:54 gibba015 bash[30343]: cluster 2021-03-10T16:24:53.792888+0000 mgr.gibba045.orlgmj (mgr.34412) 8241 : cluster [DBG] pgmap v4692: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:55.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:24:54 gibba045 bash[25517]: cluster 2021-03-10T16:24:53.792888+0000 mgr.gibba045.orlgmj (mgr.34412) 8241 : cluster [DBG] pgmap v4692: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:57.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:24:56 gibba045 bash[25517]: cluster 2021-03-10T16:24:55.794416+0000 mgr.gibba045.orlgmj (mgr.34412) 8242 : cluster [DBG] pgmap v4693: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:57.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:24:56 gibba015 bash[29377]: cluster 2021-03-10T16:24:55.794416+0000 mgr.gibba045.orlgmj (mgr.34412) 8242 : cluster [DBG] pgmap v4693: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:57.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:24:56 gibba015 bash[30343]: cluster 2021-03-10T16:24:55.794416+0000 mgr.gibba045.orlgmj (mgr.34412) 8242 : cluster [DBG] pgmap v4693: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:59.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:24:58 gibba045 bash[25517]: cluster 2021-03-10T16:24:57.795984+0000 mgr.gibba045.orlgmj (mgr.34412) 8243 : cluster [DBG] pgmap v4694: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:59.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:24:58 gibba015 bash[29377]: cluster 2021-03-10T16:24:57.795984+0000 mgr.gibba045.orlgmj (mgr.34412) 8243 : cluster [DBG] pgmap v4694: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:59.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:24:58 gibba015 bash[30343]: cluster 2021-03-10T16:24:57.795984+0000 mgr.gibba045.orlgmj (mgr.34412) 8243 : cluster [DBG] pgmap v4694: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:01.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:25:01 gibba045 bash[25517]: cluster 2021-03-10T16:24:59.797612+0000 mgr.gibba045.orlgmj (mgr.34412) 8244 : cluster [DBG] pgmap v4695: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:01.337 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:25:00 gibba015 bash[29377]: cluster 2021-03-10T16:24:59.797612+0000 mgr.gibba045.orlgmj (mgr.34412) 8244 : cluster [DBG] pgmap v4695: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:01.338 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:25:00 gibba015 bash[30343]: cluster 2021-03-10T16:24:59.797612+0000 mgr.gibba045.orlgmj (mgr.34412) 8244 : cluster [DBG] pgmap v4695: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:03.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:25:03 gibba045 bash[25517]: cluster 2021-03-10T16:25:01.799406+0000 mgr.gibba045.orlgmj (mgr.34412) 8245 : cluster [DBG] pgmap v4696: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:03.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:25:03 gibba015 bash[29377]: cluster 2021-03-10T16:25:01.799406+0000 mgr.gibba045.orlgmj (mgr.34412) 8245 : cluster [DBG] pgmap v4696: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:03.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:25:03 gibba015 bash[30343]: cluster 2021-03-10T16:25:01.799406+0000 mgr.gibba045.orlgmj (mgr.34412) 8245 : cluster [DBG] pgmap v4696: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:05.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:25:05 gibba045 bash[25517]: cluster 2021-03-10T16:25:03.799907+0000 mgr.gibba045.orlgmj (mgr.34412) 8246 : cluster [DBG] pgmap v4697: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:05.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:25:05 gibba045 bash[25517]: cephadm 2021-03-10T16:25:03.853098+0000 mgr.gibba045.orlgmj (mgr.34412) 8247 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:25:05.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:25:05 gibba015 bash[29377]: cluster 2021-03-10T16:25:03.799907+0000 mgr.gibba045.orlgmj (mgr.34412) 8246 : cluster [DBG] pgmap v4697: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:05.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:25:05 gibba015 bash[29377]: cephadm 2021-03-10T16:25:03.853098+0000 mgr.gibba045.orlgmj (mgr.34412) 8247 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:25:05.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:25:05 gibba015 bash[30343]: cluster 2021-03-10T16:25:03.799907+0000 mgr.gibba045.orlgmj (mgr.34412) 8246 : cluster [DBG] pgmap v4697: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:05.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:25:05 gibba015 bash[30343]: cephadm 2021-03-10T16:25:03.853098+0000 mgr.gibba045.orlgmj (mgr.34412) 8247 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:25:07.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:25:07 gibba045 bash[25517]: cluster 2021-03-10T16:25:05.801667+0000 mgr.gibba045.orlgmj (mgr.34412) 8248 : cluster [DBG] pgmap v4698: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:07.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:25:07 gibba015 bash[29377]: cluster 2021-03-10T16:25:05.801667+0000 mgr.gibba045.orlgmj (mgr.34412) 8248 : cluster [DBG] pgmap v4698: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:07.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:25:07 gibba015 bash[30343]: cluster 2021-03-10T16:25:05.801667+0000 mgr.gibba045.orlgmj (mgr.34412) 8248 : cluster [DBG] pgmap v4698: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:09.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:25:09 gibba045 bash[25517]: cluster 2021-03-10T16:25:07.803159+0000 mgr.gibba045.orlgmj (mgr.34412) 8249 : cluster [DBG] pgmap v4699: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:09.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:25:09 gibba015 bash[29377]: cluster 2021-03-10T16:25:07.803159+0000 mgr.gibba045.orlgmj (mgr.34412) 8249 : cluster [DBG] pgmap v4699: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:09.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:25:09 gibba015 bash[30343]: cluster 2021-03-10T16:25:07.803159+0000 mgr.gibba045.orlgmj (mgr.34412) 8249 : cluster [DBG] pgmap v4699: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:11.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:25:11 gibba045 bash[25517]: cluster 2021-03-10T16:25:09.804842+0000 mgr.gibba045.orlgmj (mgr.34412) 8250 : cluster [DBG] pgmap v4700: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:11.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:25:11 gibba015 bash[29377]: cluster 2021-03-10T16:25:09.804842+0000 mgr.gibba045.orlgmj (mgr.34412) 8250 : cluster [DBG] pgmap v4700: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:11.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:25:11 gibba015 bash[30343]: cluster 2021-03-10T16:25:09.804842+0000 mgr.gibba045.orlgmj (mgr.34412) 8250 : cluster [DBG] pgmap v4700: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:13.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:25:13 gibba045 bash[25517]: cluster 2021-03-10T16:25:11.806578+0000 mgr.gibba045.orlgmj (mgr.34412) 8251 : cluster [DBG] pgmap v4701: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:13.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:25:13 gibba015 bash[29377]: cluster 2021-03-10T16:25:11.806578+0000 mgr.gibba045.orlgmj (mgr.34412) 8251 : cluster [DBG] pgmap v4701: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:13.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:25:13 gibba015 bash[30343]: cluster 2021-03-10T16:25:11.806578+0000 mgr.gibba045.orlgmj (mgr.34412) 8251 : cluster [DBG] pgmap v4701: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:15.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:25:15 gibba015 bash[29377]: cluster 2021-03-10T16:25:13.807079+0000 mgr.gibba045.orlgmj (mgr.34412) 8252 : cluster [DBG] pgmap v4702: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:15.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:25:15 gibba015 bash[30343]: cluster 2021-03-10T16:25:13.807079+0000 mgr.gibba045.orlgmj (mgr.34412) 8252 : cluster [DBG] pgmap v4702: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:15.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:25:15 gibba045 bash[25517]: cluster 2021-03-10T16:25:13.807079+0000 mgr.gibba045.orlgmj (mgr.34412) 8252 : cluster [DBG] pgmap v4702: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:17.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:25:17 gibba015 bash[29377]: cluster 2021-03-10T16:25:15.808796+0000 mgr.gibba045.orlgmj (mgr.34412) 8253 : cluster [DBG] pgmap v4703: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:17.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:25:17 gibba015 bash[30343]: cluster 2021-03-10T16:25:15.808796+0000 mgr.gibba045.orlgmj (mgr.34412) 8253 : cluster [DBG] pgmap v4703: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:17.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:25:17 gibba045 bash[25517]: cluster 2021-03-10T16:25:15.808796+0000 mgr.gibba045.orlgmj (mgr.34412) 8253 : cluster [DBG] pgmap v4703: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:19.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:25:19 gibba015 bash[29377]: cluster 2021-03-10T16:25:17.810401+0000 mgr.gibba045.orlgmj (mgr.34412) 8254 : cluster [DBG] pgmap v4704: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:19.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:25:19 gibba015 bash[29377]: audit 2021-03-10T16:25:18.863665+0000 mon.c (mon.1) 2284 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:25:19.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:25:19 gibba015 bash[30343]: cluster 2021-03-10T16:25:17.810401+0000 mgr.gibba045.orlgmj (mgr.34412) 8254 : cluster [DBG] pgmap v4704: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:19.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:25:19 gibba015 bash[30343]: audit 2021-03-10T16:25:18.863665+0000 mon.c (mon.1) 2284 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:25:19.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:25:19 gibba045 bash[25517]: cluster 2021-03-10T16:25:17.810401+0000 mgr.gibba045.orlgmj (mgr.34412) 8254 : cluster [DBG] pgmap v4704: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:19.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:25:19 gibba045 bash[25517]: audit 2021-03-10T16:25:18.863665+0000 mon.c (mon.1) 2284 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:25:20.008 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:25:20.266 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:25:20.266 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 9m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:25:20.266 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 8m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:25:20.267 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:25:20.267 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:25:20.267 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:25:20.267 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:25:20.268 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:25:20.268 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:25:20.268 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 9m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:25:20.268 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 8m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:25:20.269 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:25:20.269 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:25:20.269 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:25:20.269 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:25:20.269 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:25:20.270 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:25:20.270 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:25:20.270 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:25:20.270 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 8m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:25:20.271 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 8m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:25:20.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:25:20 gibba015 bash[29377]: cephadm 2021-03-10T16:25:18.871506+0000 mgr.gibba045.orlgmj (mgr.34412) 8255 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:25:20.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:25:20 gibba015 bash[29377]: cephadm 2021-03-10T16:25:18.873361+0000 mgr.gibba045.orlgmj (mgr.34412) 8256 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:25:20.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:25:20 gibba015 bash[29377]: audit 2021-03-10T16:25:19.081404+0000 mon.a (mon.0) 1877 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:25:20.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:25:20 gibba015 bash[29377]: audit 2021-03-10T16:25:19.085024+0000 mon.c (mon.1) 2285 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:25:20.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:25:20 gibba015 bash[29377]: audit 2021-03-10T16:25:19.086611+0000 mon.c (mon.1) 2286 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:25:20.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:25:20 gibba015 bash[29377]: cephadm 2021-03-10T16:25:19.086811+0000 mgr.gibba045.orlgmj (mgr.34412) 8257 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:25:20.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:25:20 gibba015 bash[29377]: audit 2021-03-10T16:25:19.087893+0000 mon.c (mon.1) 2287 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:25:20.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:25:20 gibba015 bash[29377]: cephadm 2021-03-10T16:25:19.088572+0000 mgr.gibba045.orlgmj (mgr.34412) 8258 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:25:20.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:25:20 gibba015 bash[29377]: audit 2021-03-10T16:25:19.089226+0000 mon.c (mon.1) 2288 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:25:20.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:25:20 gibba015 bash[29377]: cephadm 2021-03-10T16:25:19.089910+0000 mgr.gibba045.orlgmj (mgr.34412) 8259 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:25:20.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:25:20 gibba015 bash[29377]: cephadm 2021-03-10T16:25:19.089949+0000 mgr.gibba045.orlgmj (mgr.34412) 8260 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:25:20.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:25:20 gibba015 bash[29377]: cephadm 2021-03-10T16:25:19.091175+0000 mgr.gibba045.orlgmj (mgr.34412) 8261 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:25:20.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:25:20 gibba015 bash[29377]: cephadm 2021-03-10T16:25:19.091214+0000 mgr.gibba045.orlgmj (mgr.34412) 8262 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:25:20.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:25:20 gibba015 bash[29377]: cephadm 2021-03-10T16:25:19.092533+0000 mgr.gibba045.orlgmj (mgr.34412) 8263 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:25:20.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:25:20 gibba015 bash[29377]: audit 2021-03-10T16:25:19.092655+0000 mon.c (mon.1) 2289 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:25:20.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:25:20 gibba015 bash[29377]: audit 2021-03-10T16:25:19.094486+0000 mon.c (mon.1) 2290 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:25:20.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:25:20 gibba015 bash[29377]: cephadm 2021-03-10T16:25:19.094527+0000 mgr.gibba045.orlgmj (mgr.34412) 8264 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:25:20.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:25:20 gibba015 bash[29377]: cephadm 2021-03-10T16:25:19.094566+0000 mgr.gibba045.orlgmj (mgr.34412) 8265 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:25:20.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:25:20 gibba015 bash[29377]: cephadm 2021-03-10T16:25:19.096188+0000 mgr.gibba045.orlgmj (mgr.34412) 8266 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:25:20.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:25:20 gibba015 bash[29377]: cephadm 2021-03-10T16:25:19.096552+0000 mgr.gibba045.orlgmj (mgr.34412) 8267 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:25:20.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:25:20 gibba015 bash[29377]: cephadm 2021-03-10T16:25:19.097952+0000 mgr.gibba045.orlgmj (mgr.34412) 8268 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:25:20.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:25:20 gibba015 bash[29377]: cephadm 2021-03-10T16:25:19.097992+0000 mgr.gibba045.orlgmj (mgr.34412) 8269 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:25:20.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:25:20 gibba015 bash[29377]: cephadm 2021-03-10T16:25:19.098101+0000 mgr.gibba045.orlgmj (mgr.34412) 8270 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:25:20.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:25:20 gibba015 bash[30343]: cephadm 2021-03-10T16:25:18.871506+0000 mgr.gibba045.orlgmj (mgr.34412) 8255 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:25:20.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:25:20 gibba015 bash[30343]: cephadm 2021-03-10T16:25:18.873361+0000 mgr.gibba045.orlgmj (mgr.34412) 8256 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:25:20.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:25:20 gibba015 bash[30343]: audit 2021-03-10T16:25:19.081404+0000 mon.a (mon.0) 1877 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:25:20.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:25:20 gibba015 bash[30343]: audit 2021-03-10T16:25:19.085024+0000 mon.c (mon.1) 2285 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:25:20.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:25:20 gibba015 bash[30343]: audit 2021-03-10T16:25:19.086611+0000 mon.c (mon.1) 2286 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:25:20.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:25:20 gibba015 bash[30343]: cephadm 2021-03-10T16:25:19.086811+0000 mgr.gibba045.orlgmj (mgr.34412) 8257 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:25:20.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:25:20 gibba015 bash[30343]: audit 2021-03-10T16:25:19.087893+0000 mon.c (mon.1) 2287 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:25:20.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:25:20 gibba015 bash[30343]: cephadm 2021-03-10T16:25:19.088572+0000 mgr.gibba045.orlgmj (mgr.34412) 8258 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:25:20.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:25:20 gibba015 bash[30343]: audit 2021-03-10T16:25:19.089226+0000 mon.c (mon.1) 2288 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:25:20.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:25:20 gibba015 bash[30343]: cephadm 2021-03-10T16:25:19.089910+0000 mgr.gibba045.orlgmj (mgr.34412) 8259 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:25:20.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:25:20 gibba015 bash[30343]: cephadm 2021-03-10T16:25:19.089949+0000 mgr.gibba045.orlgmj (mgr.34412) 8260 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:25:20.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:25:20 gibba015 bash[30343]: cephadm 2021-03-10T16:25:19.091175+0000 mgr.gibba045.orlgmj (mgr.34412) 8261 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:25:20.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:25:20 gibba015 bash[30343]: cephadm 2021-03-10T16:25:19.091214+0000 mgr.gibba045.orlgmj (mgr.34412) 8262 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:25:20.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:25:20 gibba015 bash[30343]: cephadm 2021-03-10T16:25:19.092533+0000 mgr.gibba045.orlgmj (mgr.34412) 8263 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:25:20.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:25:20 gibba015 bash[30343]: audit 2021-03-10T16:25:19.092655+0000 mon.c (mon.1) 2289 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:25:20.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:25:20 gibba015 bash[30343]: audit 2021-03-10T16:25:19.094486+0000 mon.c (mon.1) 2290 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:25:20.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:25:20 gibba015 bash[30343]: cephadm 2021-03-10T16:25:19.094527+0000 mgr.gibba045.orlgmj (mgr.34412) 8264 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:25:20.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:25:20 gibba015 bash[30343]: cephadm 2021-03-10T16:25:19.094566+0000 mgr.gibba045.orlgmj (mgr.34412) 8265 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:25:20.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:25:20 gibba015 bash[30343]: cephadm 2021-03-10T16:25:19.096188+0000 mgr.gibba045.orlgmj (mgr.34412) 8266 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:25:20.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:25:20 gibba015 bash[30343]: cephadm 2021-03-10T16:25:19.096552+0000 mgr.gibba045.orlgmj (mgr.34412) 8267 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:25:20.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:25:20 gibba015 bash[30343]: cephadm 2021-03-10T16:25:19.097952+0000 mgr.gibba045.orlgmj (mgr.34412) 8268 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:25:20.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:25:20 gibba015 bash[30343]: cephadm 2021-03-10T16:25:19.097992+0000 mgr.gibba045.orlgmj (mgr.34412) 8269 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:25:20.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:25:20 gibba015 bash[30343]: cephadm 2021-03-10T16:25:19.098101+0000 mgr.gibba045.orlgmj (mgr.34412) 8270 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:25:20.519 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:25:20.519 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:25:20.519 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:25:20.519 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:25:20.519 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:25:20.520 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:25:20.520 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:25:20.520 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:25:20.521 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:25:20.521 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:25:20.521 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:25:20.521 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:25:20.521 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:25:20.522 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:25:20.522 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:25:20.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:25:20 gibba045 bash[25517]: cephadm 2021-03-10T16:25:18.871506+0000 mgr.gibba045.orlgmj (mgr.34412) 8255 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:25:20.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:25:20 gibba045 bash[25517]: cephadm 2021-03-10T16:25:18.873361+0000 mgr.gibba045.orlgmj (mgr.34412) 8256 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:25:20.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:25:20 gibba045 bash[25517]: audit 2021-03-10T16:25:19.081404+0000 mon.a (mon.0) 1877 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:25:20.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:25:20 gibba045 bash[25517]: audit 2021-03-10T16:25:19.085024+0000 mon.c (mon.1) 2285 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:25:20.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:25:20 gibba045 bash[25517]: audit 2021-03-10T16:25:19.086611+0000 mon.c (mon.1) 2286 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:25:20.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:25:20 gibba045 bash[25517]: cephadm 2021-03-10T16:25:19.086811+0000 mgr.gibba045.orlgmj (mgr.34412) 8257 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:25:20.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:25:20 gibba045 bash[25517]: audit 2021-03-10T16:25:19.087893+0000 mon.c (mon.1) 2287 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:25:20.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:25:20 gibba045 bash[25517]: cephadm 2021-03-10T16:25:19.088572+0000 mgr.gibba045.orlgmj (mgr.34412) 8258 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:25:20.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:25:20 gibba045 bash[25517]: audit 2021-03-10T16:25:19.089226+0000 mon.c (mon.1) 2288 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:25:20.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:25:20 gibba045 bash[25517]: cephadm 2021-03-10T16:25:19.089910+0000 mgr.gibba045.orlgmj (mgr.34412) 8259 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:25:20.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:25:20 gibba045 bash[25517]: cephadm 2021-03-10T16:25:19.089949+0000 mgr.gibba045.orlgmj (mgr.34412) 8260 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:25:20.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:25:20 gibba045 bash[25517]: cephadm 2021-03-10T16:25:19.091175+0000 mgr.gibba045.orlgmj (mgr.34412) 8261 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:25:20.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:25:20 gibba045 bash[25517]: cephadm 2021-03-10T16:25:19.091214+0000 mgr.gibba045.orlgmj (mgr.34412) 8262 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:25:20.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:25:20 gibba045 bash[25517]: cephadm 2021-03-10T16:25:19.092533+0000 mgr.gibba045.orlgmj (mgr.34412) 8263 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:25:20.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:25:20 gibba045 bash[25517]: audit 2021-03-10T16:25:19.092655+0000 mon.c (mon.1) 2289 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:25:20.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:25:20 gibba045 bash[25517]: audit 2021-03-10T16:25:19.094486+0000 mon.c (mon.1) 2290 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:25:20.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:25:20 gibba045 bash[25517]: cephadm 2021-03-10T16:25:19.094527+0000 mgr.gibba045.orlgmj (mgr.34412) 8264 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:25:20.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:25:20 gibba045 bash[25517]: cephadm 2021-03-10T16:25:19.094566+0000 mgr.gibba045.orlgmj (mgr.34412) 8265 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:25:20.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:25:20 gibba045 bash[25517]: cephadm 2021-03-10T16:25:19.096188+0000 mgr.gibba045.orlgmj (mgr.34412) 8266 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:25:20.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:25:20 gibba045 bash[25517]: cephadm 2021-03-10T16:25:19.096552+0000 mgr.gibba045.orlgmj (mgr.34412) 8267 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:25:20.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:25:20 gibba045 bash[25517]: cephadm 2021-03-10T16:25:19.097952+0000 mgr.gibba045.orlgmj (mgr.34412) 8268 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:25:20.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:25:20 gibba045 bash[25517]: cephadm 2021-03-10T16:25:19.097992+0000 mgr.gibba045.orlgmj (mgr.34412) 8269 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:25:20.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:25:20 gibba045 bash[25517]: cephadm 2021-03-10T16:25:19.098101+0000 mgr.gibba045.orlgmj (mgr.34412) 8270 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:25:21.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:25:21 gibba015 bash[29377]: cluster 2021-03-10T16:25:19.812050+0000 mgr.gibba045.orlgmj (mgr.34412) 8271 : cluster [DBG] pgmap v4705: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:21.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:25:21 gibba015 bash[29377]: audit 2021-03-10T16:25:20.001840+0000 mgr.gibba045.orlgmj (mgr.34412) 8272 : audit [DBG] from='client.59584 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:25:21.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:25:21 gibba015 bash[29377]: audit 2021-03-10T16:25:20.228682+0000 mgr.gibba045.orlgmj (mgr.34412) 8273 : audit [DBG] from='client.59590 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:25:21.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:25:21 gibba015 bash[29377]: audit 2021-03-10T16:25:20.519570+0000 mon.c (mon.1) 2291 : audit [DBG] from='client.? 172.21.2.115:0/1496333572' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:25:21.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:25:21 gibba015 bash[30343]: cluster 2021-03-10T16:25:19.812050+0000 mgr.gibba045.orlgmj (mgr.34412) 8271 : cluster [DBG] pgmap v4705: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:21.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:25:21 gibba015 bash[30343]: audit 2021-03-10T16:25:20.001840+0000 mgr.gibba045.orlgmj (mgr.34412) 8272 : audit [DBG] from='client.59584 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:25:21.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:25:21 gibba015 bash[30343]: audit 2021-03-10T16:25:20.228682+0000 mgr.gibba045.orlgmj (mgr.34412) 8273 : audit [DBG] from='client.59590 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:25:21.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:25:21 gibba015 bash[30343]: audit 2021-03-10T16:25:20.519570+0000 mon.c (mon.1) 2291 : audit [DBG] from='client.? 172.21.2.115:0/1496333572' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:25:21.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:25:21 gibba045 bash[25517]: cluster 2021-03-10T16:25:19.812050+0000 mgr.gibba045.orlgmj (mgr.34412) 8271 : cluster [DBG] pgmap v4705: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:21.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:25:21 gibba045 bash[25517]: audit 2021-03-10T16:25:20.001840+0000 mgr.gibba045.orlgmj (mgr.34412) 8272 : audit [DBG] from='client.59584 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:25:21.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:25:21 gibba045 bash[25517]: audit 2021-03-10T16:25:20.228682+0000 mgr.gibba045.orlgmj (mgr.34412) 8273 : audit [DBG] from='client.59590 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:25:21.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:25:21 gibba045 bash[25517]: audit 2021-03-10T16:25:20.519570+0000 mon.c (mon.1) 2291 : audit [DBG] from='client.? 172.21.2.115:0/1496333572' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:25:23.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:25:23 gibba015 bash[29377]: cluster 2021-03-10T16:25:21.813723+0000 mgr.gibba045.orlgmj (mgr.34412) 8274 : cluster [DBG] pgmap v4706: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:23.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:25:23 gibba015 bash[30343]: cluster 2021-03-10T16:25:21.813723+0000 mgr.gibba045.orlgmj (mgr.34412) 8274 : cluster [DBG] pgmap v4706: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:23.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:25:23 gibba045 bash[25517]: cluster 2021-03-10T16:25:21.813723+0000 mgr.gibba045.orlgmj (mgr.34412) 8274 : cluster [DBG] pgmap v4706: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:25.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:25:25 gibba015 bash[29377]: cluster 2021-03-10T16:25:23.814310+0000 mgr.gibba045.orlgmj (mgr.34412) 8275 : cluster [DBG] pgmap v4707: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:25.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:25:25 gibba015 bash[30343]: cluster 2021-03-10T16:25:23.814310+0000 mgr.gibba045.orlgmj (mgr.34412) 8275 : cluster [DBG] pgmap v4707: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:25.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:25:25 gibba045 bash[25517]: cluster 2021-03-10T16:25:23.814310+0000 mgr.gibba045.orlgmj (mgr.34412) 8275 : cluster [DBG] pgmap v4707: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:27.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:25:27 gibba015 bash[29377]: cluster 2021-03-10T16:25:25.815977+0000 mgr.gibba045.orlgmj (mgr.34412) 8276 : cluster [DBG] pgmap v4708: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:27.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:25:27 gibba015 bash[30343]: cluster 2021-03-10T16:25:25.815977+0000 mgr.gibba045.orlgmj (mgr.34412) 8276 : cluster [DBG] pgmap v4708: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:27.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:25:27 gibba045 bash[25517]: cluster 2021-03-10T16:25:25.815977+0000 mgr.gibba045.orlgmj (mgr.34412) 8276 : cluster [DBG] pgmap v4708: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:29.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:25:29 gibba015 bash[29377]: cluster 2021-03-10T16:25:27.817621+0000 mgr.gibba045.orlgmj (mgr.34412) 8277 : cluster [DBG] pgmap v4709: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:29.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:25:29 gibba015 bash[30343]: cluster 2021-03-10T16:25:27.817621+0000 mgr.gibba045.orlgmj (mgr.34412) 8277 : cluster [DBG] pgmap v4709: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:29.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:25:29 gibba045 bash[25517]: cluster 2021-03-10T16:25:27.817621+0000 mgr.gibba045.orlgmj (mgr.34412) 8277 : cluster [DBG] pgmap v4709: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:31.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:25:31 gibba015 bash[29377]: cluster 2021-03-10T16:25:29.819137+0000 mgr.gibba045.orlgmj (mgr.34412) 8278 : cluster [DBG] pgmap v4710: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:31.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:25:31 gibba015 bash[30343]: cluster 2021-03-10T16:25:29.819137+0000 mgr.gibba045.orlgmj (mgr.34412) 8278 : cluster [DBG] pgmap v4710: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:31.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:25:31 gibba045 bash[25517]: cluster 2021-03-10T16:25:29.819137+0000 mgr.gibba045.orlgmj (mgr.34412) 8278 : cluster [DBG] pgmap v4710: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:33.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:25:33 gibba015 bash[29377]: cluster 2021-03-10T16:25:31.820785+0000 mgr.gibba045.orlgmj (mgr.34412) 8279 : cluster [DBG] pgmap v4711: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:33.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:25:33 gibba015 bash[30343]: cluster 2021-03-10T16:25:31.820785+0000 mgr.gibba045.orlgmj (mgr.34412) 8279 : cluster [DBG] pgmap v4711: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:33.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:25:33 gibba045 bash[25517]: cluster 2021-03-10T16:25:31.820785+0000 mgr.gibba045.orlgmj (mgr.34412) 8279 : cluster [DBG] pgmap v4711: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:35.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:25:35 gibba015 bash[29377]: cluster 2021-03-10T16:25:33.821957+0000 mgr.gibba045.orlgmj (mgr.34412) 8280 : cluster [DBG] pgmap v4712: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:35.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:25:35 gibba015 bash[29377]: cephadm 2021-03-10T16:25:34.113859+0000 mgr.gibba045.orlgmj (mgr.34412) 8281 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:25:35.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:25:35 gibba015 bash[30343]: cluster 2021-03-10T16:25:33.821957+0000 mgr.gibba045.orlgmj (mgr.34412) 8280 : cluster [DBG] pgmap v4712: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:35.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:25:35 gibba015 bash[30343]: cephadm 2021-03-10T16:25:34.113859+0000 mgr.gibba045.orlgmj (mgr.34412) 8281 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:25:35.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:25:35 gibba045 bash[25517]: cluster 2021-03-10T16:25:33.821957+0000 mgr.gibba045.orlgmj (mgr.34412) 8280 : cluster [DBG] pgmap v4712: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:35.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:25:35 gibba045 bash[25517]: cephadm 2021-03-10T16:25:34.113859+0000 mgr.gibba045.orlgmj (mgr.34412) 8281 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:25:37.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:25:37 gibba015 bash[29377]: cluster 2021-03-10T16:25:35.823536+0000 mgr.gibba045.orlgmj (mgr.34412) 8282 : cluster [DBG] pgmap v4713: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:37.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:25:37 gibba015 bash[30343]: cluster 2021-03-10T16:25:35.823536+0000 mgr.gibba045.orlgmj (mgr.34412) 8282 : cluster [DBG] pgmap v4713: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:37.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:25:37 gibba045 bash[25517]: cluster 2021-03-10T16:25:35.823536+0000 mgr.gibba045.orlgmj (mgr.34412) 8282 : cluster [DBG] pgmap v4713: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:39.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:25:39 gibba015 bash[29377]: cluster 2021-03-10T16:25:37.825155+0000 mgr.gibba045.orlgmj (mgr.34412) 8283 : cluster [DBG] pgmap v4714: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:39.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:25:39 gibba015 bash[30343]: cluster 2021-03-10T16:25:37.825155+0000 mgr.gibba045.orlgmj (mgr.34412) 8283 : cluster [DBG] pgmap v4714: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:39.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:25:39 gibba045 bash[25517]: cluster 2021-03-10T16:25:37.825155+0000 mgr.gibba045.orlgmj (mgr.34412) 8283 : cluster [DBG] pgmap v4714: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:41.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:25:41 gibba015 bash[29377]: cluster 2021-03-10T16:25:39.826766+0000 mgr.gibba045.orlgmj (mgr.34412) 8284 : cluster [DBG] pgmap v4715: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:41.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:25:41 gibba015 bash[30343]: cluster 2021-03-10T16:25:39.826766+0000 mgr.gibba045.orlgmj (mgr.34412) 8284 : cluster [DBG] pgmap v4715: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:41.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:25:41 gibba045 bash[25517]: cluster 2021-03-10T16:25:39.826766+0000 mgr.gibba045.orlgmj (mgr.34412) 8284 : cluster [DBG] pgmap v4715: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:43.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:25:43 gibba015 bash[29377]: cluster 2021-03-10T16:25:41.828492+0000 mgr.gibba045.orlgmj (mgr.34412) 8285 : cluster [DBG] pgmap v4716: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:43.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:25:43 gibba015 bash[30343]: cluster 2021-03-10T16:25:41.828492+0000 mgr.gibba045.orlgmj (mgr.34412) 8285 : cluster [DBG] pgmap v4716: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:43.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:25:43 gibba045 bash[25517]: cluster 2021-03-10T16:25:41.828492+0000 mgr.gibba045.orlgmj (mgr.34412) 8285 : cluster [DBG] pgmap v4716: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:45.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:25:45 gibba015 bash[29377]: cluster 2021-03-10T16:25:43.829658+0000 mgr.gibba045.orlgmj (mgr.34412) 8286 : cluster [DBG] pgmap v4717: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:45.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:25:45 gibba015 bash[30343]: cluster 2021-03-10T16:25:43.829658+0000 mgr.gibba045.orlgmj (mgr.34412) 8286 : cluster [DBG] pgmap v4717: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:45.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:25:45 gibba045 bash[25517]: cluster 2021-03-10T16:25:43.829658+0000 mgr.gibba045.orlgmj (mgr.34412) 8286 : cluster [DBG] pgmap v4717: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:47.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:25:47 gibba015 bash[29377]: cluster 2021-03-10T16:25:45.831417+0000 mgr.gibba045.orlgmj (mgr.34412) 8287 : cluster [DBG] pgmap v4718: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:47.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:25:47 gibba015 bash[30343]: cluster 2021-03-10T16:25:45.831417+0000 mgr.gibba045.orlgmj (mgr.34412) 8287 : cluster [DBG] pgmap v4718: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:47.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:25:47 gibba045 bash[25517]: cluster 2021-03-10T16:25:45.831417+0000 mgr.gibba045.orlgmj (mgr.34412) 8287 : cluster [DBG] pgmap v4718: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:49.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:25:49 gibba015 bash[29377]: cluster 2021-03-10T16:25:47.838922+0000 mgr.gibba045.orlgmj (mgr.34412) 8288 : cluster [DBG] pgmap v4719: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:49.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:25:49 gibba015 bash[30343]: cluster 2021-03-10T16:25:47.838922+0000 mgr.gibba045.orlgmj (mgr.34412) 8288 : cluster [DBG] pgmap v4719: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:49.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:25:49 gibba045 bash[25517]: cluster 2021-03-10T16:25:47.838922+0000 mgr.gibba045.orlgmj (mgr.34412) 8288 : cluster [DBG] pgmap v4719: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:50.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:25:50 gibba045 bash[25517]: cephadm 2021-03-10T16:25:49.129209+0000 mgr.gibba045.orlgmj (mgr.34412) 8289 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:25:50.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:25:50 gibba015 bash[29377]: cephadm 2021-03-10T16:25:49.129209+0000 mgr.gibba045.orlgmj (mgr.34412) 8289 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:25:50.719 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:25:50 gibba015 bash[30343]: cephadm 2021-03-10T16:25:49.129209+0000 mgr.gibba045.orlgmj (mgr.34412) 8289 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:25:50.761 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:25:50.990 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:25:50.990 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 9m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:25:50.990 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 8m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:25:50.990 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:25:50.991 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:25:50.991 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:25:50.991 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:25:50.991 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:25:50.992 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:25:50.992 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 9m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:25:50.992 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 8m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:25:50.992 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:25:50.993 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:25:50.993 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:25:50.993 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:25:50.993 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:25:50.993 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:25:50.994 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:25:50.994 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:25:50.994 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 8m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:25:50.995 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 8m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:25:51.241 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:25:51.241 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:25:51.241 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:25:51.242 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:25:51.242 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:25:51.242 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:25:51.242 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:25:51.243 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:25:51.243 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:25:51.243 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:25:51.243 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:25:51.243 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:25:51.244 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:25:51.244 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:25:51.244 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:25:51.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:25:51 gibba045 bash[25517]: cluster 2021-03-10T16:25:49.840526+0000 mgr.gibba045.orlgmj (mgr.34412) 8290 : cluster [DBG] pgmap v4720: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:51.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:25:51 gibba015 bash[29377]: cluster 2021-03-10T16:25:49.840526+0000 mgr.gibba045.orlgmj (mgr.34412) 8290 : cluster [DBG] pgmap v4720: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:51.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:25:51 gibba015 bash[30343]: cluster 2021-03-10T16:25:49.840526+0000 mgr.gibba045.orlgmj (mgr.34412) 8290 : cluster [DBG] pgmap v4720: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:52.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:25:52 gibba045 bash[25517]: audit 2021-03-10T16:25:50.755657+0000 mgr.gibba045.orlgmj (mgr.34412) 8291 : audit [DBG] from='client.59602 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:25:52.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:25:52 gibba045 bash[25517]: audit 2021-03-10T16:25:50.980401+0000 mgr.gibba045.orlgmj (mgr.34412) 8292 : audit [DBG] from='client.59608 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:25:52.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:25:52 gibba045 bash[25517]: audit 2021-03-10T16:25:51.241624+0000 mon.c (mon.1) 2292 : audit [DBG] from='client.? 172.21.2.115:0/3269996769' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:25:52.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:25:52 gibba015 bash[29377]: audit 2021-03-10T16:25:50.755657+0000 mgr.gibba045.orlgmj (mgr.34412) 8291 : audit [DBG] from='client.59602 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:25:52.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:25:52 gibba015 bash[29377]: audit 2021-03-10T16:25:50.980401+0000 mgr.gibba045.orlgmj (mgr.34412) 8292 : audit [DBG] from='client.59608 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:25:52.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:25:52 gibba015 bash[29377]: audit 2021-03-10T16:25:51.241624+0000 mon.c (mon.1) 2292 : audit [DBG] from='client.? 172.21.2.115:0/3269996769' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:25:52.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:25:52 gibba015 bash[30343]: audit 2021-03-10T16:25:50.755657+0000 mgr.gibba045.orlgmj (mgr.34412) 8291 : audit [DBG] from='client.59602 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:25:52.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:25:52 gibba015 bash[30343]: audit 2021-03-10T16:25:50.980401+0000 mgr.gibba045.orlgmj (mgr.34412) 8292 : audit [DBG] from='client.59608 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:25:52.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:25:52 gibba015 bash[30343]: audit 2021-03-10T16:25:51.241624+0000 mon.c (mon.1) 2292 : audit [DBG] from='client.? 172.21.2.115:0/3269996769' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:25:53.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:25:53 gibba045 bash[25517]: cluster 2021-03-10T16:25:51.841996+0000 mgr.gibba045.orlgmj (mgr.34412) 8293 : cluster [DBG] pgmap v4721: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:53.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:25:53 gibba015 bash[29377]: cluster 2021-03-10T16:25:51.841996+0000 mgr.gibba045.orlgmj (mgr.34412) 8293 : cluster [DBG] pgmap v4721: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:53.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:25:53 gibba015 bash[30343]: cluster 2021-03-10T16:25:51.841996+0000 mgr.gibba045.orlgmj (mgr.34412) 8293 : cluster [DBG] pgmap v4721: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:54.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:25:54 gibba045 bash[25517]: audit 2021-03-10T16:25:53.569393+0000 mon.c (mon.1) 2293 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:25:54.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:25:54 gibba045 bash[25517]: audit 2021-03-10T16:25:53.570490+0000 mon.a (mon.0) 1878 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:25:54.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:25:54 gibba045 bash[25517]: audit 2021-03-10T16:25:53.571492+0000 mon.c (mon.1) 2294 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:25:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:25:54 gibba045 bash[25517]: audit 2021-03-10T16:25:53.572435+0000 mon.a (mon.0) 1879 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:25:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:25:54 gibba045 bash[25517]: audit 2021-03-10T16:25:53.582874+0000 mon.c (mon.1) 2295 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T16:25:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:25:54 gibba045 bash[25517]: audit 2021-03-10T16:25:53.583777+0000 mon.c (mon.1) 2296 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:25:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:25:54 gibba045 bash[25517]: audit 2021-03-10T16:25:53.583984+0000 mon.a (mon.0) 1880 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T16:25:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:25:54 gibba045 bash[25517]: audit 2021-03-10T16:25:53.584704+0000 mon.c (mon.1) 2297 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:25:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:25:54 gibba045 bash[25517]: audit 2021-03-10T16:25:53.585344+0000 mon.a (mon.0) 1881 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:25:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:25:54 gibba045 bash[25517]: audit 2021-03-10T16:25:53.585808+0000 mon.c (mon.1) 2298 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:25:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:25:54 gibba045 bash[25517]: audit 2021-03-10T16:25:53.586372+0000 mon.a (mon.0) 1882 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:25:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:25:54 gibba045 bash[25517]: audit 2021-03-10T16:25:53.587375+0000 mon.a (mon.0) 1883 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:25:54.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:25:54 gibba015 bash[29377]: audit 2021-03-10T16:25:53.569393+0000 mon.c (mon.1) 2293 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:25:54.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:25:54 gibba015 bash[29377]: audit 2021-03-10T16:25:53.570490+0000 mon.a (mon.0) 1878 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:25:54.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:25:54 gibba015 bash[29377]: audit 2021-03-10T16:25:53.571492+0000 mon.c (mon.1) 2294 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:25:54.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:25:54 gibba015 bash[29377]: audit 2021-03-10T16:25:53.572435+0000 mon.a (mon.0) 1879 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:25:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:25:54 gibba015 bash[29377]: audit 2021-03-10T16:25:53.582874+0000 mon.c (mon.1) 2295 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T16:25:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:25:54 gibba015 bash[29377]: audit 2021-03-10T16:25:53.583777+0000 mon.c (mon.1) 2296 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:25:54.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:25:54 gibba015 bash[29377]: audit 2021-03-10T16:25:53.583984+0000 mon.a (mon.0) 1880 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T16:25:54.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:25:54 gibba015 bash[29377]: audit 2021-03-10T16:25:53.584704+0000 mon.c (mon.1) 2297 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:25:54.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:25:54 gibba015 bash[29377]: audit 2021-03-10T16:25:53.585344+0000 mon.a (mon.0) 1881 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:25:54.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:25:54 gibba015 bash[29377]: audit 2021-03-10T16:25:53.585808+0000 mon.c (mon.1) 2298 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:25:54.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:25:54 gibba015 bash[29377]: audit 2021-03-10T16:25:53.586372+0000 mon.a (mon.0) 1882 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:25:54.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:25:54 gibba015 bash[29377]: audit 2021-03-10T16:25:53.587375+0000 mon.a (mon.0) 1883 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:25:54.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:25:54 gibba015 bash[30343]: audit 2021-03-10T16:25:53.569393+0000 mon.c (mon.1) 2293 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:25:54.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:25:54 gibba015 bash[30343]: audit 2021-03-10T16:25:53.570490+0000 mon.a (mon.0) 1878 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:25:54.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:25:54 gibba015 bash[30343]: audit 2021-03-10T16:25:53.571492+0000 mon.c (mon.1) 2294 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:25:54.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:25:54 gibba015 bash[30343]: audit 2021-03-10T16:25:53.572435+0000 mon.a (mon.0) 1879 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:25:54.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:25:54 gibba015 bash[30343]: audit 2021-03-10T16:25:53.582874+0000 mon.c (mon.1) 2295 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T16:25:54.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:25:54 gibba015 bash[30343]: audit 2021-03-10T16:25:53.583777+0000 mon.c (mon.1) 2296 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:25:54.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:25:54 gibba015 bash[30343]: audit 2021-03-10T16:25:53.583984+0000 mon.a (mon.0) 1880 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T16:25:54.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:25:54 gibba015 bash[30343]: audit 2021-03-10T16:25:53.584704+0000 mon.c (mon.1) 2297 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:25:54.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:25:54 gibba015 bash[30343]: audit 2021-03-10T16:25:53.585344+0000 mon.a (mon.0) 1881 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:25:54.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:25:54 gibba015 bash[30343]: audit 2021-03-10T16:25:53.585808+0000 mon.c (mon.1) 2298 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:25:54.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:25:54 gibba015 bash[30343]: audit 2021-03-10T16:25:53.586372+0000 mon.a (mon.0) 1882 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:25:54.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:25:54 gibba015 bash[30343]: audit 2021-03-10T16:25:53.587375+0000 mon.a (mon.0) 1883 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:25:55.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:25:55 gibba045 bash[25517]: cluster 2021-03-10T16:25:53.843186+0000 mgr.gibba045.orlgmj (mgr.34412) 8294 : cluster [DBG] pgmap v4722: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:55.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:25:55 gibba015 bash[29377]: cluster 2021-03-10T16:25:53.843186+0000 mgr.gibba045.orlgmj (mgr.34412) 8294 : cluster [DBG] pgmap v4722: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:55.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:25:55 gibba015 bash[30343]: cluster 2021-03-10T16:25:53.843186+0000 mgr.gibba045.orlgmj (mgr.34412) 8294 : cluster [DBG] pgmap v4722: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:57.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:25:57 gibba045 bash[25517]: cluster 2021-03-10T16:25:55.845044+0000 mgr.gibba045.orlgmj (mgr.34412) 8295 : cluster [DBG] pgmap v4723: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:57.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:25:57 gibba015 bash[29377]: cluster 2021-03-10T16:25:55.845044+0000 mgr.gibba045.orlgmj (mgr.34412) 8295 : cluster [DBG] pgmap v4723: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:57.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:25:57 gibba015 bash[30343]: cluster 2021-03-10T16:25:55.845044+0000 mgr.gibba045.orlgmj (mgr.34412) 8295 : cluster [DBG] pgmap v4723: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:59.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:25:59 gibba045 bash[25517]: cluster 2021-03-10T16:25:57.845877+0000 mgr.gibba045.orlgmj (mgr.34412) 8296 : cluster [DBG] pgmap v4724: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:59.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:25:59 gibba015 bash[29377]: cluster 2021-03-10T16:25:57.845877+0000 mgr.gibba045.orlgmj (mgr.34412) 8296 : cluster [DBG] pgmap v4724: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:59.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:25:59 gibba015 bash[30343]: cluster 2021-03-10T16:25:57.845877+0000 mgr.gibba045.orlgmj (mgr.34412) 8296 : cluster [DBG] pgmap v4724: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:01.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:26:01 gibba045 bash[25517]: cluster 2021-03-10T16:25:59.847420+0000 mgr.gibba045.orlgmj (mgr.34412) 8297 : cluster [DBG] pgmap v4725: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:01.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:26:01 gibba015 bash[29377]: cluster 2021-03-10T16:25:59.847420+0000 mgr.gibba045.orlgmj (mgr.34412) 8297 : cluster [DBG] pgmap v4725: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:01.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:26:01 gibba015 bash[30343]: cluster 2021-03-10T16:25:59.847420+0000 mgr.gibba045.orlgmj (mgr.34412) 8297 : cluster [DBG] pgmap v4725: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:03.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:26:03 gibba045 bash[25517]: cluster 2021-03-10T16:26:01.849183+0000 mgr.gibba045.orlgmj (mgr.34412) 8298 : cluster [DBG] pgmap v4726: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:03.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:26:03 gibba015 bash[29377]: cluster 2021-03-10T16:26:01.849183+0000 mgr.gibba045.orlgmj (mgr.34412) 8298 : cluster [DBG] pgmap v4726: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:03.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:26:03 gibba015 bash[30343]: cluster 2021-03-10T16:26:01.849183+0000 mgr.gibba045.orlgmj (mgr.34412) 8298 : cluster [DBG] pgmap v4726: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:05.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:26:05 gibba015 bash[29377]: cluster 2021-03-10T16:26:03.850041+0000 mgr.gibba045.orlgmj (mgr.34412) 8299 : cluster [DBG] pgmap v4727: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:05.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:26:05 gibba015 bash[29377]: cephadm 2021-03-10T16:26:04.139595+0000 mgr.gibba045.orlgmj (mgr.34412) 8300 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:26:05.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:26:05 gibba015 bash[30343]: cluster 2021-03-10T16:26:03.850041+0000 mgr.gibba045.orlgmj (mgr.34412) 8299 : cluster [DBG] pgmap v4727: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:05.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:26:05 gibba015 bash[30343]: cephadm 2021-03-10T16:26:04.139595+0000 mgr.gibba045.orlgmj (mgr.34412) 8300 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:26:05.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:26:05 gibba045 bash[25517]: cluster 2021-03-10T16:26:03.850041+0000 mgr.gibba045.orlgmj (mgr.34412) 8299 : cluster [DBG] pgmap v4727: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:05.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:26:05 gibba045 bash[25517]: cephadm 2021-03-10T16:26:04.139595+0000 mgr.gibba045.orlgmj (mgr.34412) 8300 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:26:07.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:26:07 gibba015 bash[29377]: cluster 2021-03-10T16:26:05.851622+0000 mgr.gibba045.orlgmj (mgr.34412) 8301 : cluster [DBG] pgmap v4728: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:07.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:26:07 gibba015 bash[30343]: cluster 2021-03-10T16:26:05.851622+0000 mgr.gibba045.orlgmj (mgr.34412) 8301 : cluster [DBG] pgmap v4728: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:07.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:26:07 gibba045 bash[25517]: cluster 2021-03-10T16:26:05.851622+0000 mgr.gibba045.orlgmj (mgr.34412) 8301 : cluster [DBG] pgmap v4728: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:09.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:26:09 gibba015 bash[29377]: cluster 2021-03-10T16:26:07.852440+0000 mgr.gibba045.orlgmj (mgr.34412) 8302 : cluster [DBG] pgmap v4729: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:09.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:26:09 gibba015 bash[30343]: cluster 2021-03-10T16:26:07.852440+0000 mgr.gibba045.orlgmj (mgr.34412) 8302 : cluster [DBG] pgmap v4729: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:09.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:26:09 gibba045 bash[25517]: cluster 2021-03-10T16:26:07.852440+0000 mgr.gibba045.orlgmj (mgr.34412) 8302 : cluster [DBG] pgmap v4729: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:11.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:26:11 gibba015 bash[29377]: cluster 2021-03-10T16:26:09.853772+0000 mgr.gibba045.orlgmj (mgr.34412) 8303 : cluster [DBG] pgmap v4730: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:11.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:26:11 gibba015 bash[30343]: cluster 2021-03-10T16:26:09.853772+0000 mgr.gibba045.orlgmj (mgr.34412) 8303 : cluster [DBG] pgmap v4730: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:11.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:26:11 gibba045 bash[25517]: cluster 2021-03-10T16:26:09.853772+0000 mgr.gibba045.orlgmj (mgr.34412) 8303 : cluster [DBG] pgmap v4730: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:13.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:26:13 gibba015 bash[29377]: cluster 2021-03-10T16:26:11.855260+0000 mgr.gibba045.orlgmj (mgr.34412) 8304 : cluster [DBG] pgmap v4731: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:13.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:26:13 gibba015 bash[30343]: cluster 2021-03-10T16:26:11.855260+0000 mgr.gibba045.orlgmj (mgr.34412) 8304 : cluster [DBG] pgmap v4731: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:13.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:26:13 gibba045 bash[25517]: cluster 2021-03-10T16:26:11.855260+0000 mgr.gibba045.orlgmj (mgr.34412) 8304 : cluster [DBG] pgmap v4731: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:15.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:26:15 gibba015 bash[29377]: cluster 2021-03-10T16:26:13.855848+0000 mgr.gibba045.orlgmj (mgr.34412) 8305 : cluster [DBG] pgmap v4732: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:15.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:26:15 gibba015 bash[30343]: cluster 2021-03-10T16:26:13.855848+0000 mgr.gibba045.orlgmj (mgr.34412) 8305 : cluster [DBG] pgmap v4732: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:15.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:26:15 gibba045 bash[25517]: cluster 2021-03-10T16:26:13.855848+0000 mgr.gibba045.orlgmj (mgr.34412) 8305 : cluster [DBG] pgmap v4732: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:17.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:26:17 gibba015 bash[29377]: cluster 2021-03-10T16:26:15.857503+0000 mgr.gibba045.orlgmj (mgr.34412) 8306 : cluster [DBG] pgmap v4733: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:17.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:26:17 gibba015 bash[30343]: cluster 2021-03-10T16:26:15.857503+0000 mgr.gibba045.orlgmj (mgr.34412) 8306 : cluster [DBG] pgmap v4733: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:17.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:26:17 gibba045 bash[25517]: cluster 2021-03-10T16:26:15.857503+0000 mgr.gibba045.orlgmj (mgr.34412) 8306 : cluster [DBG] pgmap v4733: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:19.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:26:19 gibba015 bash[29377]: cluster 2021-03-10T16:26:17.858326+0000 mgr.gibba045.orlgmj (mgr.34412) 8307 : cluster [DBG] pgmap v4734: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:19.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:26:19 gibba015 bash[29377]: audit 2021-03-10T16:26:19.153823+0000 mon.c (mon.1) 2299 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:26:19.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:26:19 gibba015 bash[29377]: audit 2021-03-10T16:26:19.159902+0000 mon.c (mon.1) 2300 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:26:19.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:26:19 gibba015 bash[30343]: cluster 2021-03-10T16:26:17.858326+0000 mgr.gibba045.orlgmj (mgr.34412) 8307 : cluster [DBG] pgmap v4734: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:19.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:26:19 gibba015 bash[30343]: audit 2021-03-10T16:26:19.153823+0000 mon.c (mon.1) 2299 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:26:19.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:26:19 gibba015 bash[30343]: audit 2021-03-10T16:26:19.159902+0000 mon.c (mon.1) 2300 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:26:19.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:26:19 gibba045 bash[25517]: cluster 2021-03-10T16:26:17.858326+0000 mgr.gibba045.orlgmj (mgr.34412) 8307 : cluster [DBG] pgmap v4734: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:19.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:26:19 gibba045 bash[25517]: audit 2021-03-10T16:26:19.153823+0000 mon.c (mon.1) 2299 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:26:19.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:26:19 gibba045 bash[25517]: audit 2021-03-10T16:26:19.159902+0000 mon.c (mon.1) 2300 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:26:20.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:26:20 gibba015 bash[29377]: cephadm 2021-03-10T16:26:19.162002+0000 mgr.gibba045.orlgmj (mgr.34412) 8308 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:26:20.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:26:20 gibba015 bash[30343]: cephadm 2021-03-10T16:26:19.162002+0000 mgr.gibba045.orlgmj (mgr.34412) 8308 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:26:20.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:26:20 gibba045 bash[25517]: cephadm 2021-03-10T16:26:19.162002+0000 mgr.gibba045.orlgmj (mgr.34412) 8308 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:26:21.486 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:26:21.714 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:26:21.715 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 10m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:26:21.715 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 9m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:26:21.716 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:26:21.716 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:26:21.716 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:26:21.716 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:26:21.717 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:26:21.717 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:26:21.717 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 10m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:26:21.718 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 9m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:26:21.718 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:26:21.718 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:26:21.718 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:26:21.719 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:26:21.719 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:26:21.719 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:26:21.719 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:26:21.720 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:26:21.720 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 9m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:26:21.720 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 9m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:26:21.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:26:21 gibba015 bash[29377]: cluster 2021-03-10T16:26:19.859852+0000 mgr.gibba045.orlgmj (mgr.34412) 8309 : cluster [DBG] pgmap v4735: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:21.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:26:21 gibba015 bash[30343]: cluster 2021-03-10T16:26:19.859852+0000 mgr.gibba045.orlgmj (mgr.34412) 8309 : cluster [DBG] pgmap v4735: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:21.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:26:21 gibba045 bash[25517]: cluster 2021-03-10T16:26:19.859852+0000 mgr.gibba045.orlgmj (mgr.34412) 8309 : cluster [DBG] pgmap v4735: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:21.971 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:26:21.971 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:26:21.972 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:26:21.972 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:26:21.972 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:26:21.972 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:26:21.973 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:26:21.973 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:26:21.973 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:26:21.973 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:26:21.974 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:26:21.974 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:26:21.974 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:26:21.974 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:26:21.974 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:26:22.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:26:22 gibba015 bash[29377]: audit 2021-03-10T16:26:21.971793+0000 mon.c (mon.1) 2301 : audit [DBG] from='client.? 172.21.2.115:0/3816919014' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:26:22.719 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:26:22 gibba015 bash[30343]: audit 2021-03-10T16:26:21.971793+0000 mon.c (mon.1) 2301 : audit [DBG] from='client.? 172.21.2.115:0/3816919014' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:26:22.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:26:22 gibba045 bash[25517]: audit 2021-03-10T16:26:21.971793+0000 mon.c (mon.1) 2301 : audit [DBG] from='client.? 172.21.2.115:0/3816919014' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:26:23.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:26:23 gibba015 bash[29377]: audit 2021-03-10T16:26:21.480501+0000 mgr.gibba045.orlgmj (mgr.34412) 8310 : audit [DBG] from='client.49632 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:26:23.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:26:23 gibba015 bash[29377]: audit 2021-03-10T16:26:21.704512+0000 mgr.gibba045.orlgmj (mgr.34412) 8311 : audit [DBG] from='client.49638 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:26:23.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:26:23 gibba015 bash[29377]: cluster 2021-03-10T16:26:21.861665+0000 mgr.gibba045.orlgmj (mgr.34412) 8312 : cluster [DBG] pgmap v4736: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:23.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:26:23 gibba015 bash[29377]: audit 2021-03-10T16:26:22.665077+0000 mon.a (mon.0) 1884 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:26:23.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:26:23 gibba015 bash[29377]: audit 2021-03-10T16:26:22.881481+0000 mon.a (mon.0) 1885 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:26:23.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:26:23 gibba015 bash[29377]: audit 2021-03-10T16:26:22.887350+0000 mon.c (mon.1) 2302 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:26:23.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:26:23 gibba015 bash[29377]: audit 2021-03-10T16:26:22.889829+0000 mon.c (mon.1) 2303 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:26:23.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:26:23 gibba015 bash[29377]: audit 2021-03-10T16:26:22.892281+0000 mon.c (mon.1) 2304 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:26:23.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:26:23 gibba015 bash[29377]: audit 2021-03-10T16:26:22.893848+0000 mon.c (mon.1) 2305 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:26:23.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:26:23 gibba015 bash[29377]: audit 2021-03-10T16:26:22.897942+0000 mon.c (mon.1) 2306 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:26:23.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:26:23 gibba015 bash[29377]: audit 2021-03-10T16:26:22.900826+0000 mon.c (mon.1) 2307 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:26:23.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:26:23 gibba015 bash[30343]: audit 2021-03-10T16:26:21.480501+0000 mgr.gibba045.orlgmj (mgr.34412) 8310 : audit [DBG] from='client.49632 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:26:23.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:26:23 gibba015 bash[30343]: audit 2021-03-10T16:26:21.704512+0000 mgr.gibba045.orlgmj (mgr.34412) 8311 : audit [DBG] from='client.49638 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:26:23.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:26:23 gibba015 bash[30343]: cluster 2021-03-10T16:26:21.861665+0000 mgr.gibba045.orlgmj (mgr.34412) 8312 : cluster [DBG] pgmap v4736: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:23.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:26:23 gibba015 bash[30343]: audit 2021-03-10T16:26:22.665077+0000 mon.a (mon.0) 1884 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:26:23.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:26:23 gibba015 bash[30343]: audit 2021-03-10T16:26:22.881481+0000 mon.a (mon.0) 1885 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:26:23.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:26:23 gibba015 bash[30343]: audit 2021-03-10T16:26:22.887350+0000 mon.c (mon.1) 2302 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:26:23.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:26:23 gibba015 bash[30343]: audit 2021-03-10T16:26:22.889829+0000 mon.c (mon.1) 2303 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:26:23.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:26:23 gibba015 bash[30343]: audit 2021-03-10T16:26:22.892281+0000 mon.c (mon.1) 2304 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:26:23.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:26:23 gibba015 bash[30343]: audit 2021-03-10T16:26:22.893848+0000 mon.c (mon.1) 2305 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:26:23.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:26:23 gibba015 bash[30343]: audit 2021-03-10T16:26:22.897942+0000 mon.c (mon.1) 2306 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:26:23.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:26:23 gibba015 bash[30343]: audit 2021-03-10T16:26:22.900826+0000 mon.c (mon.1) 2307 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:26:23.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:26:23 gibba045 bash[25517]: audit 2021-03-10T16:26:21.480501+0000 mgr.gibba045.orlgmj (mgr.34412) 8310 : audit [DBG] from='client.49632 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:26:23.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:26:23 gibba045 bash[25517]: audit 2021-03-10T16:26:21.704512+0000 mgr.gibba045.orlgmj (mgr.34412) 8311 : audit [DBG] from='client.49638 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:26:23.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:26:23 gibba045 bash[25517]: cluster 2021-03-10T16:26:21.861665+0000 mgr.gibba045.orlgmj (mgr.34412) 8312 : cluster [DBG] pgmap v4736: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:23.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:26:23 gibba045 bash[25517]: audit 2021-03-10T16:26:22.665077+0000 mon.a (mon.0) 1884 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:26:23.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:26:23 gibba045 bash[25517]: audit 2021-03-10T16:26:22.881481+0000 mon.a (mon.0) 1885 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:26:23.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:26:23 gibba045 bash[25517]: audit 2021-03-10T16:26:22.887350+0000 mon.c (mon.1) 2302 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:26:23.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:26:23 gibba045 bash[25517]: audit 2021-03-10T16:26:22.889829+0000 mon.c (mon.1) 2303 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:26:23.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:26:23 gibba045 bash[25517]: audit 2021-03-10T16:26:22.892281+0000 mon.c (mon.1) 2304 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:26:23.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:26:23 gibba045 bash[25517]: audit 2021-03-10T16:26:22.893848+0000 mon.c (mon.1) 2305 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:26:23.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:26:23 gibba045 bash[25517]: audit 2021-03-10T16:26:22.897942+0000 mon.c (mon.1) 2306 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:26:23.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:26:23 gibba045 bash[25517]: audit 2021-03-10T16:26:22.900826+0000 mon.c (mon.1) 2307 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:26:24.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:26:24 gibba015 bash[29377]: cephadm 2021-03-10T16:26:22.668824+0000 mgr.gibba045.orlgmj (mgr.34412) 8313 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:26:24.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:26:24 gibba015 bash[29377]: cephadm 2021-03-10T16:26:22.888759+0000 mgr.gibba045.orlgmj (mgr.34412) 8314 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:26:24.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:26:24 gibba015 bash[29377]: cephadm 2021-03-10T16:26:22.891651+0000 mgr.gibba045.orlgmj (mgr.34412) 8315 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:26:24.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:26:24 gibba015 bash[29377]: cephadm 2021-03-10T16:26:22.893756+0000 mgr.gibba045.orlgmj (mgr.34412) 8316 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:26:24.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:26:24 gibba015 bash[29377]: cephadm 2021-03-10T16:26:22.893976+0000 mgr.gibba045.orlgmj (mgr.34412) 8317 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:26:24.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:26:24 gibba015 bash[29377]: cephadm 2021-03-10T16:26:22.895896+0000 mgr.gibba045.orlgmj (mgr.34412) 8318 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:26:24.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:26:24 gibba015 bash[29377]: cephadm 2021-03-10T16:26:22.896004+0000 mgr.gibba045.orlgmj (mgr.34412) 8319 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:26:24.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:26:24 gibba015 bash[29377]: cephadm 2021-03-10T16:26:22.897493+0000 mgr.gibba045.orlgmj (mgr.34412) 8320 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:26:24.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:26:24 gibba015 bash[29377]: cephadm 2021-03-10T16:26:22.899477+0000 mgr.gibba045.orlgmj (mgr.34412) 8321 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:26:24.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:26:24 gibba015 bash[29377]: cephadm 2021-03-10T16:26:22.899594+0000 mgr.gibba045.orlgmj (mgr.34412) 8322 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:26:24.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:26:24 gibba015 bash[29377]: cephadm 2021-03-10T16:26:22.901637+0000 mgr.gibba045.orlgmj (mgr.34412) 8323 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:26:24.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:26:24 gibba015 bash[29377]: cephadm 2021-03-10T16:26:22.902771+0000 mgr.gibba045.orlgmj (mgr.34412) 8324 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:26:24.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:26:24 gibba015 bash[29377]: cephadm 2021-03-10T16:26:22.904535+0000 mgr.gibba045.orlgmj (mgr.34412) 8325 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:26:24.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:26:24 gibba015 bash[29377]: cephadm 2021-03-10T16:26:22.904670+0000 mgr.gibba045.orlgmj (mgr.34412) 8326 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:26:24.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:26:24 gibba015 bash[29377]: cephadm 2021-03-10T16:26:22.905074+0000 mgr.gibba045.orlgmj (mgr.34412) 8327 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:26:24.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:26:24 gibba015 bash[30343]: cephadm 2021-03-10T16:26:22.668824+0000 mgr.gibba045.orlgmj (mgr.34412) 8313 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:26:24.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:26:24 gibba015 bash[30343]: cephadm 2021-03-10T16:26:22.888759+0000 mgr.gibba045.orlgmj (mgr.34412) 8314 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:26:24.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:26:24 gibba015 bash[30343]: cephadm 2021-03-10T16:26:22.891651+0000 mgr.gibba045.orlgmj (mgr.34412) 8315 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:26:24.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:26:24 gibba015 bash[30343]: cephadm 2021-03-10T16:26:22.893756+0000 mgr.gibba045.orlgmj (mgr.34412) 8316 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:26:24.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:26:24 gibba015 bash[30343]: cephadm 2021-03-10T16:26:22.893976+0000 mgr.gibba045.orlgmj (mgr.34412) 8317 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:26:24.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:26:24 gibba015 bash[30343]: cephadm 2021-03-10T16:26:22.895896+0000 mgr.gibba045.orlgmj (mgr.34412) 8318 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:26:24.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:26:24 gibba015 bash[30343]: cephadm 2021-03-10T16:26:22.896004+0000 mgr.gibba045.orlgmj (mgr.34412) 8319 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:26:24.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:26:24 gibba015 bash[30343]: cephadm 2021-03-10T16:26:22.897493+0000 mgr.gibba045.orlgmj (mgr.34412) 8320 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:26:24.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:26:24 gibba015 bash[30343]: cephadm 2021-03-10T16:26:22.899477+0000 mgr.gibba045.orlgmj (mgr.34412) 8321 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:26:24.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:26:24 gibba015 bash[30343]: cephadm 2021-03-10T16:26:22.899594+0000 mgr.gibba045.orlgmj (mgr.34412) 8322 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:26:24.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:26:24 gibba015 bash[30343]: cephadm 2021-03-10T16:26:22.901637+0000 mgr.gibba045.orlgmj (mgr.34412) 8323 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:26:24.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:26:24 gibba015 bash[30343]: cephadm 2021-03-10T16:26:22.902771+0000 mgr.gibba045.orlgmj (mgr.34412) 8324 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:26:24.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:26:24 gibba015 bash[30343]: cephadm 2021-03-10T16:26:22.904535+0000 mgr.gibba045.orlgmj (mgr.34412) 8325 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:26:24.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:26:24 gibba015 bash[30343]: cephadm 2021-03-10T16:26:22.904670+0000 mgr.gibba045.orlgmj (mgr.34412) 8326 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:26:24.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:26:24 gibba015 bash[30343]: cephadm 2021-03-10T16:26:22.905074+0000 mgr.gibba045.orlgmj (mgr.34412) 8327 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:26:24.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:26:24 gibba045 bash[25517]: cephadm 2021-03-10T16:26:22.668824+0000 mgr.gibba045.orlgmj (mgr.34412) 8313 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:26:24.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:26:24 gibba045 bash[25517]: cephadm 2021-03-10T16:26:22.888759+0000 mgr.gibba045.orlgmj (mgr.34412) 8314 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:26:24.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:26:24 gibba045 bash[25517]: cephadm 2021-03-10T16:26:22.891651+0000 mgr.gibba045.orlgmj (mgr.34412) 8315 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:26:24.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:26:24 gibba045 bash[25517]: cephadm 2021-03-10T16:26:22.893756+0000 mgr.gibba045.orlgmj (mgr.34412) 8316 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:26:24.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:26:24 gibba045 bash[25517]: cephadm 2021-03-10T16:26:22.893976+0000 mgr.gibba045.orlgmj (mgr.34412) 8317 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:26:24.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:26:24 gibba045 bash[25517]: cephadm 2021-03-10T16:26:22.895896+0000 mgr.gibba045.orlgmj (mgr.34412) 8318 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:26:24.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:26:24 gibba045 bash[25517]: cephadm 2021-03-10T16:26:22.896004+0000 mgr.gibba045.orlgmj (mgr.34412) 8319 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:26:24.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:26:24 gibba045 bash[25517]: cephadm 2021-03-10T16:26:22.897493+0000 mgr.gibba045.orlgmj (mgr.34412) 8320 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:26:24.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:26:24 gibba045 bash[25517]: cephadm 2021-03-10T16:26:22.899477+0000 mgr.gibba045.orlgmj (mgr.34412) 8321 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:26:24.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:26:24 gibba045 bash[25517]: cephadm 2021-03-10T16:26:22.899594+0000 mgr.gibba045.orlgmj (mgr.34412) 8322 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:26:24.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:26:24 gibba045 bash[25517]: cephadm 2021-03-10T16:26:22.901637+0000 mgr.gibba045.orlgmj (mgr.34412) 8323 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:26:24.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:26:24 gibba045 bash[25517]: cephadm 2021-03-10T16:26:22.902771+0000 mgr.gibba045.orlgmj (mgr.34412) 8324 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:26:24.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:26:24 gibba045 bash[25517]: cephadm 2021-03-10T16:26:22.904535+0000 mgr.gibba045.orlgmj (mgr.34412) 8325 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:26:24.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:26:24 gibba045 bash[25517]: cephadm 2021-03-10T16:26:22.904670+0000 mgr.gibba045.orlgmj (mgr.34412) 8326 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:26:24.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:26:24 gibba045 bash[25517]: cephadm 2021-03-10T16:26:22.905074+0000 mgr.gibba045.orlgmj (mgr.34412) 8327 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:26:25.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:26:25 gibba015 bash[29377]: cluster 2021-03-10T16:26:23.862533+0000 mgr.gibba045.orlgmj (mgr.34412) 8328 : cluster [DBG] pgmap v4737: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:25.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:26:25 gibba015 bash[30343]: cluster 2021-03-10T16:26:23.862533+0000 mgr.gibba045.orlgmj (mgr.34412) 8328 : cluster [DBG] pgmap v4737: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:25.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:26:25 gibba045 bash[25517]: cluster 2021-03-10T16:26:23.862533+0000 mgr.gibba045.orlgmj (mgr.34412) 8328 : cluster [DBG] pgmap v4737: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:27.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:26:27 gibba045 bash[25517]: cluster 2021-03-10T16:26:25.864350+0000 mgr.gibba045.orlgmj (mgr.34412) 8329 : cluster [DBG] pgmap v4738: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:27.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:26:27 gibba015 bash[29377]: cluster 2021-03-10T16:26:25.864350+0000 mgr.gibba045.orlgmj (mgr.34412) 8329 : cluster [DBG] pgmap v4738: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:27.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:26:27 gibba015 bash[30343]: cluster 2021-03-10T16:26:25.864350+0000 mgr.gibba045.orlgmj (mgr.34412) 8329 : cluster [DBG] pgmap v4738: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:29.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:26:29 gibba045 bash[25517]: cluster 2021-03-10T16:26:27.865025+0000 mgr.gibba045.orlgmj (mgr.34412) 8330 : cluster [DBG] pgmap v4739: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:29.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:26:29 gibba015 bash[29377]: cluster 2021-03-10T16:26:27.865025+0000 mgr.gibba045.orlgmj (mgr.34412) 8330 : cluster [DBG] pgmap v4739: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:29.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:26:29 gibba015 bash[30343]: cluster 2021-03-10T16:26:27.865025+0000 mgr.gibba045.orlgmj (mgr.34412) 8330 : cluster [DBG] pgmap v4739: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:31.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:26:31 gibba045 bash[25517]: cluster 2021-03-10T16:26:29.866527+0000 mgr.gibba045.orlgmj (mgr.34412) 8331 : cluster [DBG] pgmap v4740: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:31.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:26:31 gibba015 bash[29377]: cluster 2021-03-10T16:26:29.866527+0000 mgr.gibba045.orlgmj (mgr.34412) 8331 : cluster [DBG] pgmap v4740: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:31.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:26:31 gibba015 bash[30343]: cluster 2021-03-10T16:26:29.866527+0000 mgr.gibba045.orlgmj (mgr.34412) 8331 : cluster [DBG] pgmap v4740: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:33.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:26:33 gibba015 bash[29377]: cluster 2021-03-10T16:26:31.868300+0000 mgr.gibba045.orlgmj (mgr.34412) 8332 : cluster [DBG] pgmap v4741: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:33.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:26:33 gibba015 bash[30343]: cluster 2021-03-10T16:26:31.868300+0000 mgr.gibba045.orlgmj (mgr.34412) 8332 : cluster [DBG] pgmap v4741: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:33.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:26:33 gibba045 bash[25517]: cluster 2021-03-10T16:26:31.868300+0000 mgr.gibba045.orlgmj (mgr.34412) 8332 : cluster [DBG] pgmap v4741: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:35.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:26:35 gibba015 bash[29377]: cluster 2021-03-10T16:26:33.869518+0000 mgr.gibba045.orlgmj (mgr.34412) 8333 : cluster [DBG] pgmap v4742: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:35.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:26:35 gibba015 bash[30343]: cluster 2021-03-10T16:26:33.869518+0000 mgr.gibba045.orlgmj (mgr.34412) 8333 : cluster [DBG] pgmap v4742: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:35.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:26:35 gibba045 bash[25517]: cluster 2021-03-10T16:26:33.869518+0000 mgr.gibba045.orlgmj (mgr.34412) 8333 : cluster [DBG] pgmap v4742: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:37.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:26:37 gibba015 bash[29377]: cluster 2021-03-10T16:26:35.871139+0000 mgr.gibba045.orlgmj (mgr.34412) 8334 : cluster [DBG] pgmap v4743: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:37.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:26:37 gibba015 bash[30343]: cluster 2021-03-10T16:26:35.871139+0000 mgr.gibba045.orlgmj (mgr.34412) 8334 : cluster [DBG] pgmap v4743: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:37.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:26:37 gibba045 bash[25517]: cluster 2021-03-10T16:26:35.871139+0000 mgr.gibba045.orlgmj (mgr.34412) 8334 : cluster [DBG] pgmap v4743: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:39.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:26:39 gibba015 bash[29377]: cluster 2021-03-10T16:26:37.872047+0000 mgr.gibba045.orlgmj (mgr.34412) 8335 : cluster [DBG] pgmap v4744: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:39.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:26:39 gibba015 bash[29377]: cephadm 2021-03-10T16:26:37.920843+0000 mgr.gibba045.orlgmj (mgr.34412) 8336 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:26:39.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:26:39 gibba015 bash[30343]: cluster 2021-03-10T16:26:37.872047+0000 mgr.gibba045.orlgmj (mgr.34412) 8335 : cluster [DBG] pgmap v4744: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:39.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:26:39 gibba015 bash[30343]: cephadm 2021-03-10T16:26:37.920843+0000 mgr.gibba045.orlgmj (mgr.34412) 8336 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:26:39.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:26:39 gibba045 bash[25517]: cluster 2021-03-10T16:26:37.872047+0000 mgr.gibba045.orlgmj (mgr.34412) 8335 : cluster [DBG] pgmap v4744: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:39.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:26:39 gibba045 bash[25517]: cephadm 2021-03-10T16:26:37.920843+0000 mgr.gibba045.orlgmj (mgr.34412) 8336 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:26:41.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:26:41 gibba015 bash[29377]: cluster 2021-03-10T16:26:39.873570+0000 mgr.gibba045.orlgmj (mgr.34412) 8337 : cluster [DBG] pgmap v4745: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:41.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:26:41 gibba015 bash[30343]: cluster 2021-03-10T16:26:39.873570+0000 mgr.gibba045.orlgmj (mgr.34412) 8337 : cluster [DBG] pgmap v4745: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:41.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:26:41 gibba045 bash[25517]: cluster 2021-03-10T16:26:39.873570+0000 mgr.gibba045.orlgmj (mgr.34412) 8337 : cluster [DBG] pgmap v4745: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:43.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:26:43 gibba015 bash[29377]: cluster 2021-03-10T16:26:41.875466+0000 mgr.gibba045.orlgmj (mgr.34412) 8338 : cluster [DBG] pgmap v4746: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:43.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:26:43 gibba015 bash[30343]: cluster 2021-03-10T16:26:41.875466+0000 mgr.gibba045.orlgmj (mgr.34412) 8338 : cluster [DBG] pgmap v4746: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:43.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:26:43 gibba045 bash[25517]: cluster 2021-03-10T16:26:41.875466+0000 mgr.gibba045.orlgmj (mgr.34412) 8338 : cluster [DBG] pgmap v4746: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:45.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:26:45 gibba015 bash[29377]: cluster 2021-03-10T16:26:43.876713+0000 mgr.gibba045.orlgmj (mgr.34412) 8339 : cluster [DBG] pgmap v4747: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:45.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:26:45 gibba015 bash[30343]: cluster 2021-03-10T16:26:43.876713+0000 mgr.gibba045.orlgmj (mgr.34412) 8339 : cluster [DBG] pgmap v4747: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:45.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:26:45 gibba045 bash[25517]: cluster 2021-03-10T16:26:43.876713+0000 mgr.gibba045.orlgmj (mgr.34412) 8339 : cluster [DBG] pgmap v4747: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:47.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:26:47 gibba015 bash[29377]: cluster 2021-03-10T16:26:45.878456+0000 mgr.gibba045.orlgmj (mgr.34412) 8340 : cluster [DBG] pgmap v4748: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:47.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:26:47 gibba015 bash[30343]: cluster 2021-03-10T16:26:45.878456+0000 mgr.gibba045.orlgmj (mgr.34412) 8340 : cluster [DBG] pgmap v4748: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:47.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:26:47 gibba045 bash[25517]: cluster 2021-03-10T16:26:45.878456+0000 mgr.gibba045.orlgmj (mgr.34412) 8340 : cluster [DBG] pgmap v4748: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:49.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:26:49 gibba015 bash[29377]: cluster 2021-03-10T16:26:47.879244+0000 mgr.gibba045.orlgmj (mgr.34412) 8341 : cluster [DBG] pgmap v4749: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:49.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:26:49 gibba015 bash[30343]: cluster 2021-03-10T16:26:47.879244+0000 mgr.gibba045.orlgmj (mgr.34412) 8341 : cluster [DBG] pgmap v4749: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:49.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:26:49 gibba045 bash[25517]: cluster 2021-03-10T16:26:47.879244+0000 mgr.gibba045.orlgmj (mgr.34412) 8341 : cluster [DBG] pgmap v4749: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:51.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:26:51 gibba015 bash[29377]: cluster 2021-03-10T16:26:49.880883+0000 mgr.gibba045.orlgmj (mgr.34412) 8342 : cluster [DBG] pgmap v4750: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:51.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:26:51 gibba015 bash[30343]: cluster 2021-03-10T16:26:49.880883+0000 mgr.gibba045.orlgmj (mgr.34412) 8342 : cluster [DBG] pgmap v4750: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:51.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:26:51 gibba045 bash[25517]: cluster 2021-03-10T16:26:49.880883+0000 mgr.gibba045.orlgmj (mgr.34412) 8342 : cluster [DBG] pgmap v4750: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:52.238 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:26:52.467 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:26:52.467 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 29s ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:26:52.468 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 9m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:26:52.468 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:26:52.468 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:26:52.469 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 29s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:26:52.469 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 29s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:26:52.469 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:26:52.469 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 29s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:26:52.470 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 29s ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:26:52.470 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 9m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:26:52.470 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 29s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:26:52.471 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 29s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:26:52.471 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 29s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:26:52.471 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 29s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:26:52.471 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:26:52.472 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:26:52.475 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:26:52.475 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:26:52.475 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 9m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:26:52.475 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 9m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:26:52.721 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:26:52.722 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:26:52.722 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:26:52.722 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:26:52.723 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:26:52.723 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:26:52.723 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:26:52.723 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:26:52.724 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:26:52.724 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:26:52.724 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:26:52.724 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:26:52.725 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:26:52.725 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:26:52.725 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:26:53.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:26:53 gibba045 bash[25517]: cluster 2021-03-10T16:26:51.882682+0000 mgr.gibba045.orlgmj (mgr.34412) 8343 : cluster [DBG] pgmap v4751: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:53.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:26:53 gibba045 bash[25517]: audit 2021-03-10T16:26:52.231887+0000 mgr.gibba045.orlgmj (mgr.34412) 8344 : audit [DBG] from='client.49650 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:26:53.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:26:53 gibba045 bash[25517]: audit 2021-03-10T16:26:52.722153+0000 mon.a (mon.0) 1886 : audit [DBG] from='client.? 172.21.2.115:0/4164879151' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:26:53.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:26:53 gibba015 bash[29377]: cluster 2021-03-10T16:26:51.882682+0000 mgr.gibba045.orlgmj (mgr.34412) 8343 : cluster [DBG] pgmap v4751: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:53.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:26:53 gibba015 bash[29377]: audit 2021-03-10T16:26:52.231887+0000 mgr.gibba045.orlgmj (mgr.34412) 8344 : audit [DBG] from='client.49650 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:26:53.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:26:53 gibba015 bash[29377]: audit 2021-03-10T16:26:52.722153+0000 mon.a (mon.0) 1886 : audit [DBG] from='client.? 172.21.2.115:0/4164879151' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:26:53.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:26:53 gibba015 bash[30343]: cluster 2021-03-10T16:26:51.882682+0000 mgr.gibba045.orlgmj (mgr.34412) 8343 : cluster [DBG] pgmap v4751: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:53.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:26:53 gibba015 bash[30343]: audit 2021-03-10T16:26:52.231887+0000 mgr.gibba045.orlgmj (mgr.34412) 8344 : audit [DBG] from='client.49650 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:26:53.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:26:53 gibba015 bash[30343]: audit 2021-03-10T16:26:52.722153+0000 mon.a (mon.0) 1886 : audit [DBG] from='client.? 172.21.2.115:0/4164879151' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:26:54.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:26:54 gibba015 bash[29377]: audit 2021-03-10T16:26:52.462511+0000 mgr.gibba045.orlgmj (mgr.34412) 8345 : audit [DBG] from='client.49656 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:26:54.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:26:54 gibba015 bash[29377]: cephadm 2021-03-10T16:26:52.929406+0000 mgr.gibba045.orlgmj (mgr.34412) 8346 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:26:54.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:26:54 gibba015 bash[29377]: audit 2021-03-10T16:26:53.577554+0000 mon.c (mon.1) 2308 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:26:54.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:26:54 gibba015 bash[29377]: audit 2021-03-10T16:26:53.578672+0000 mon.a (mon.0) 1887 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:26:54.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:26:54 gibba015 bash[29377]: audit 2021-03-10T16:26:53.581304+0000 mon.c (mon.1) 2309 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:26:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:26:54 gibba015 bash[29377]: audit 2021-03-10T16:26:53.582471+0000 mon.a (mon.0) 1888 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:26:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:26:54 gibba015 bash[29377]: audit 2021-03-10T16:26:53.590664+0000 mon.c (mon.1) 2310 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T16:26:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:26:54 gibba015 bash[29377]: audit 2021-03-10T16:26:53.591415+0000 mon.c (mon.1) 2311 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:26:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:26:54 gibba015 bash[29377]: audit 2021-03-10T16:26:53.591790+0000 mon.a (mon.0) 1889 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T16:26:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:26:54 gibba015 bash[29377]: audit 2021-03-10T16:26:53.592087+0000 mon.c (mon.1) 2312 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T16:26:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:26:54 gibba015 bash[29377]: audit 2021-03-10T16:26:53.592928+0000 mon.c (mon.1) 2313 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:26:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:26:54 gibba015 bash[29377]: audit 2021-03-10T16:26:53.593442+0000 mon.a (mon.0) 1890 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:26:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:26:54 gibba015 bash[29377]: audit 2021-03-10T16:26:53.594489+0000 mon.a (mon.0) 1891 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T16:26:54.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:26:54 gibba015 bash[29377]: audit 2021-03-10T16:26:53.595370+0000 mon.a (mon.0) 1892 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:26:54.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:26:54 gibba015 bash[30343]: audit 2021-03-10T16:26:52.462511+0000 mgr.gibba045.orlgmj (mgr.34412) 8345 : audit [DBG] from='client.49656 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:26:54.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:26:54 gibba015 bash[30343]: cephadm 2021-03-10T16:26:52.929406+0000 mgr.gibba045.orlgmj (mgr.34412) 8346 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:26:54.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:26:54 gibba015 bash[30343]: audit 2021-03-10T16:26:53.577554+0000 mon.c (mon.1) 2308 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:26:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:26:54 gibba015 bash[30343]: audit 2021-03-10T16:26:53.578672+0000 mon.a (mon.0) 1887 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:26:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:26:54 gibba015 bash[30343]: audit 2021-03-10T16:26:53.581304+0000 mon.c (mon.1) 2309 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:26:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:26:54 gibba015 bash[30343]: audit 2021-03-10T16:26:53.582471+0000 mon.a (mon.0) 1888 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:26:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:26:54 gibba015 bash[30343]: audit 2021-03-10T16:26:53.590664+0000 mon.c (mon.1) 2310 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T16:26:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:26:54 gibba015 bash[30343]: audit 2021-03-10T16:26:53.591415+0000 mon.c (mon.1) 2311 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:26:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:26:54 gibba015 bash[30343]: audit 2021-03-10T16:26:53.591790+0000 mon.a (mon.0) 1889 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T16:26:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:26:54 gibba015 bash[30343]: audit 2021-03-10T16:26:53.592087+0000 mon.c (mon.1) 2312 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T16:26:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:26:54 gibba015 bash[30343]: audit 2021-03-10T16:26:53.592928+0000 mon.c (mon.1) 2313 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:26:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:26:54 gibba015 bash[30343]: audit 2021-03-10T16:26:53.593442+0000 mon.a (mon.0) 1890 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:26:54.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:26:54 gibba015 bash[30343]: audit 2021-03-10T16:26:53.594489+0000 mon.a (mon.0) 1891 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T16:26:54.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:26:54 gibba015 bash[30343]: audit 2021-03-10T16:26:53.595370+0000 mon.a (mon.0) 1892 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:26:54.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:26:54 gibba045 bash[25517]: audit 2021-03-10T16:26:52.462511+0000 mgr.gibba045.orlgmj (mgr.34412) 8345 : audit [DBG] from='client.49656 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:26:54.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:26:54 gibba045 bash[25517]: cephadm 2021-03-10T16:26:52.929406+0000 mgr.gibba045.orlgmj (mgr.34412) 8346 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:26:54.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:26:54 gibba045 bash[25517]: audit 2021-03-10T16:26:53.577554+0000 mon.c (mon.1) 2308 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:26:54.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:26:54 gibba045 bash[25517]: audit 2021-03-10T16:26:53.578672+0000 mon.a (mon.0) 1887 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:26:54.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:26:54 gibba045 bash[25517]: audit 2021-03-10T16:26:53.581304+0000 mon.c (mon.1) 2309 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:26:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:26:54 gibba045 bash[25517]: audit 2021-03-10T16:26:53.582471+0000 mon.a (mon.0) 1888 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:26:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:26:54 gibba045 bash[25517]: audit 2021-03-10T16:26:53.590664+0000 mon.c (mon.1) 2310 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T16:26:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:26:54 gibba045 bash[25517]: audit 2021-03-10T16:26:53.591415+0000 mon.c (mon.1) 2311 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:26:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:26:54 gibba045 bash[25517]: audit 2021-03-10T16:26:53.591790+0000 mon.a (mon.0) 1889 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T16:26:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:26:54 gibba045 bash[25517]: audit 2021-03-10T16:26:53.592087+0000 mon.c (mon.1) 2312 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T16:26:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:26:54 gibba045 bash[25517]: audit 2021-03-10T16:26:53.592928+0000 mon.c (mon.1) 2313 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:26:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:26:54 gibba045 bash[25517]: audit 2021-03-10T16:26:53.593442+0000 mon.a (mon.0) 1890 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:26:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:26:54 gibba045 bash[25517]: audit 2021-03-10T16:26:53.594489+0000 mon.a (mon.0) 1891 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T16:26:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:26:54 gibba045 bash[25517]: audit 2021-03-10T16:26:53.595370+0000 mon.a (mon.0) 1892 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:26:55.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:26:55 gibba015 bash[29377]: cluster 2021-03-10T16:26:53.884059+0000 mgr.gibba045.orlgmj (mgr.34412) 8347 : cluster [DBG] pgmap v4752: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:55.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:26:55 gibba015 bash[30343]: cluster 2021-03-10T16:26:53.884059+0000 mgr.gibba045.orlgmj (mgr.34412) 8347 : cluster [DBG] pgmap v4752: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:55.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:26:55 gibba045 bash[25517]: cluster 2021-03-10T16:26:53.884059+0000 mgr.gibba045.orlgmj (mgr.34412) 8347 : cluster [DBG] pgmap v4752: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:57.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:26:57 gibba015 bash[29377]: cluster 2021-03-10T16:26:55.885832+0000 mgr.gibba045.orlgmj (mgr.34412) 8348 : cluster [DBG] pgmap v4753: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:57.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:26:57 gibba015 bash[30343]: cluster 2021-03-10T16:26:55.885832+0000 mgr.gibba045.orlgmj (mgr.34412) 8348 : cluster [DBG] pgmap v4753: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:57.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:26:57 gibba045 bash[25517]: cluster 2021-03-10T16:26:55.885832+0000 mgr.gibba045.orlgmj (mgr.34412) 8348 : cluster [DBG] pgmap v4753: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:59.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:26:59 gibba015 bash[29377]: cluster 2021-03-10T16:26:57.886794+0000 mgr.gibba045.orlgmj (mgr.34412) 8349 : cluster [DBG] pgmap v4754: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:59.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:26:59 gibba015 bash[30343]: cluster 2021-03-10T16:26:57.886794+0000 mgr.gibba045.orlgmj (mgr.34412) 8349 : cluster [DBG] pgmap v4754: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:59.552 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:26:59 gibba045 bash[25517]: cluster 2021-03-10T16:26:57.886794+0000 mgr.gibba045.orlgmj (mgr.34412) 8349 : cluster [DBG] pgmap v4754: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:01.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:27:01 gibba015 bash[29377]: cluster 2021-03-10T16:26:59.888504+0000 mgr.gibba045.orlgmj (mgr.34412) 8350 : cluster [DBG] pgmap v4755: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:01.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:27:01 gibba015 bash[30343]: cluster 2021-03-10T16:26:59.888504+0000 mgr.gibba045.orlgmj (mgr.34412) 8350 : cluster [DBG] pgmap v4755: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:01.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:27:01 gibba045 bash[25517]: cluster 2021-03-10T16:26:59.888504+0000 mgr.gibba045.orlgmj (mgr.34412) 8350 : cluster [DBG] pgmap v4755: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:03.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:27:03 gibba015 bash[29377]: cluster 2021-03-10T16:27:01.890391+0000 mgr.gibba045.orlgmj (mgr.34412) 8351 : cluster [DBG] pgmap v4756: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:03.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:27:03 gibba015 bash[30343]: cluster 2021-03-10T16:27:01.890391+0000 mgr.gibba045.orlgmj (mgr.34412) 8351 : cluster [DBG] pgmap v4756: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:03.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:27:03 gibba045 bash[25517]: cluster 2021-03-10T16:27:01.890391+0000 mgr.gibba045.orlgmj (mgr.34412) 8351 : cluster [DBG] pgmap v4756: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:05.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:27:05 gibba015 bash[29377]: cluster 2021-03-10T16:27:03.891811+0000 mgr.gibba045.orlgmj (mgr.34412) 8352 : cluster [DBG] pgmap v4757: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:05.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:27:05 gibba015 bash[30343]: cluster 2021-03-10T16:27:03.891811+0000 mgr.gibba045.orlgmj (mgr.34412) 8352 : cluster [DBG] pgmap v4757: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:05.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:27:05 gibba045 bash[25517]: cluster 2021-03-10T16:27:03.891811+0000 mgr.gibba045.orlgmj (mgr.34412) 8352 : cluster [DBG] pgmap v4757: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:07.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:27:07 gibba015 bash[29377]: cluster 2021-03-10T16:27:05.893419+0000 mgr.gibba045.orlgmj (mgr.34412) 8353 : cluster [DBG] pgmap v4758: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:07.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:27:07 gibba015 bash[30343]: cluster 2021-03-10T16:27:05.893419+0000 mgr.gibba045.orlgmj (mgr.34412) 8353 : cluster [DBG] pgmap v4758: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:07.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:27:07 gibba045 bash[25517]: cluster 2021-03-10T16:27:05.893419+0000 mgr.gibba045.orlgmj (mgr.34412) 8353 : cluster [DBG] pgmap v4758: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:09.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:27:09 gibba015 bash[29377]: cluster 2021-03-10T16:27:07.894389+0000 mgr.gibba045.orlgmj (mgr.34412) 8354 : cluster [DBG] pgmap v4759: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:09.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:27:09 gibba015 bash[29377]: cephadm 2021-03-10T16:27:07.945358+0000 mgr.gibba045.orlgmj (mgr.34412) 8355 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:27:09.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:27:09 gibba015 bash[30343]: cluster 2021-03-10T16:27:07.894389+0000 mgr.gibba045.orlgmj (mgr.34412) 8354 : cluster [DBG] pgmap v4759: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:09.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:27:09 gibba015 bash[30343]: cephadm 2021-03-10T16:27:07.945358+0000 mgr.gibba045.orlgmj (mgr.34412) 8355 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:27:09.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:27:09 gibba045 bash[25517]: cluster 2021-03-10T16:27:07.894389+0000 mgr.gibba045.orlgmj (mgr.34412) 8354 : cluster [DBG] pgmap v4759: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:09.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:27:09 gibba045 bash[25517]: cephadm 2021-03-10T16:27:07.945358+0000 mgr.gibba045.orlgmj (mgr.34412) 8355 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:27:11.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:27:11 gibba015 bash[29377]: cluster 2021-03-10T16:27:09.896026+0000 mgr.gibba045.orlgmj (mgr.34412) 8356 : cluster [DBG] pgmap v4760: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:11.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:27:11 gibba015 bash[30343]: cluster 2021-03-10T16:27:09.896026+0000 mgr.gibba045.orlgmj (mgr.34412) 8356 : cluster [DBG] pgmap v4760: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:11.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:27:11 gibba045 bash[25517]: cluster 2021-03-10T16:27:09.896026+0000 mgr.gibba045.orlgmj (mgr.34412) 8356 : cluster [DBG] pgmap v4760: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:13.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:27:13 gibba045 bash[25517]: cluster 2021-03-10T16:27:11.897567+0000 mgr.gibba045.orlgmj (mgr.34412) 8357 : cluster [DBG] pgmap v4761: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:13.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:27:13 gibba015 bash[29377]: cluster 2021-03-10T16:27:11.897567+0000 mgr.gibba045.orlgmj (mgr.34412) 8357 : cluster [DBG] pgmap v4761: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:13.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:27:13 gibba015 bash[30343]: cluster 2021-03-10T16:27:11.897567+0000 mgr.gibba045.orlgmj (mgr.34412) 8357 : cluster [DBG] pgmap v4761: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:15.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:27:15 gibba045 bash[25517]: cluster 2021-03-10T16:27:13.898726+0000 mgr.gibba045.orlgmj (mgr.34412) 8358 : cluster [DBG] pgmap v4762: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:15.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:27:15 gibba015 bash[29377]: cluster 2021-03-10T16:27:13.898726+0000 mgr.gibba045.orlgmj (mgr.34412) 8358 : cluster [DBG] pgmap v4762: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:15.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:27:15 gibba015 bash[30343]: cluster 2021-03-10T16:27:13.898726+0000 mgr.gibba045.orlgmj (mgr.34412) 8358 : cluster [DBG] pgmap v4762: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:17.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:27:17 gibba045 bash[25517]: cluster 2021-03-10T16:27:15.900519+0000 mgr.gibba045.orlgmj (mgr.34412) 8359 : cluster [DBG] pgmap v4763: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:17.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:27:17 gibba015 bash[29377]: cluster 2021-03-10T16:27:15.900519+0000 mgr.gibba045.orlgmj (mgr.34412) 8359 : cluster [DBG] pgmap v4763: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:17.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:27:17 gibba015 bash[30343]: cluster 2021-03-10T16:27:15.900519+0000 mgr.gibba045.orlgmj (mgr.34412) 8359 : cluster [DBG] pgmap v4763: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:19.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:27:19 gibba045 bash[25517]: cluster 2021-03-10T16:27:17.901185+0000 mgr.gibba045.orlgmj (mgr.34412) 8360 : cluster [DBG] pgmap v4764: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:19.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:27:19 gibba015 bash[29377]: cluster 2021-03-10T16:27:17.901185+0000 mgr.gibba045.orlgmj (mgr.34412) 8360 : cluster [DBG] pgmap v4764: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:19.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:27:19 gibba015 bash[30343]: cluster 2021-03-10T16:27:17.901185+0000 mgr.gibba045.orlgmj (mgr.34412) 8360 : cluster [DBG] pgmap v4764: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:21.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:27:21 gibba045 bash[25517]: cluster 2021-03-10T16:27:19.902752+0000 mgr.gibba045.orlgmj (mgr.34412) 8361 : cluster [DBG] pgmap v4765: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:21.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:27:21 gibba015 bash[29377]: cluster 2021-03-10T16:27:19.902752+0000 mgr.gibba045.orlgmj (mgr.34412) 8361 : cluster [DBG] pgmap v4765: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:21.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:27:21 gibba015 bash[30343]: cluster 2021-03-10T16:27:19.902752+0000 mgr.gibba045.orlgmj (mgr.34412) 8361 : cluster [DBG] pgmap v4765: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:22.962 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:27:23.223 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:27:23.223 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 60s ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:27:23.223 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 10m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:27:23.224 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:27:23.224 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:27:23.224 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 60s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:27:23.224 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 60s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:27:23.225 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:27:23.225 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 60s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:27:23.225 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 60s ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:27:23.225 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 10m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:27:23.225 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 60s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:27:23.226 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 60s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:27:23.226 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 60s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:27:23.226 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 60s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:27:23.226 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:27:23.227 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:27:23.227 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:27:23.227 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:27:23.227 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 10m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:27:23.228 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 10m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:27:23.484 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:27:23.485 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:27:23.485 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:27:23.485 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:27:23.486 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:27:23.486 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:27:23.486 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:27:23.486 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:27:23.487 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:27:23.487 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:27:23.487 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:27:23.487 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:27:23.488 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:27:23.488 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:27:23.488 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:27:23.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:27:23 gibba045 bash[25517]: cluster 2021-03-10T16:27:21.904405+0000 mgr.gibba045.orlgmj (mgr.34412) 8362 : cluster [DBG] pgmap v4766: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:23.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:27:23 gibba045 bash[25517]: audit 2021-03-10T16:27:22.958905+0000 mon.c (mon.1) 2314 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:27:23.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:27:23 gibba045 bash[25517]: audit 2021-03-10T16:27:22.965279+0000 mon.c (mon.1) 2315 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:27:23.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:27:23 gibba015 bash[29377]: cluster 2021-03-10T16:27:21.904405+0000 mgr.gibba045.orlgmj (mgr.34412) 8362 : cluster [DBG] pgmap v4766: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:23.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:27:23 gibba015 bash[29377]: audit 2021-03-10T16:27:22.958905+0000 mon.c (mon.1) 2314 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:27:23.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:27:23 gibba015 bash[29377]: audit 2021-03-10T16:27:22.965279+0000 mon.c (mon.1) 2315 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:27:23.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:27:23 gibba015 bash[30343]: cluster 2021-03-10T16:27:21.904405+0000 mgr.gibba045.orlgmj (mgr.34412) 8362 : cluster [DBG] pgmap v4766: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:23.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:27:23 gibba015 bash[30343]: audit 2021-03-10T16:27:22.958905+0000 mon.c (mon.1) 2314 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:27:23.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:27:23 gibba015 bash[30343]: audit 2021-03-10T16:27:22.965279+0000 mon.c (mon.1) 2315 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:27:24.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:27:24 gibba045 bash[25517]: audit 2021-03-10T16:27:22.956155+0000 mgr.gibba045.orlgmj (mgr.34412) 8363 : audit [DBG] from='client.49668 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:27:24.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:27:24 gibba045 bash[25517]: cephadm 2021-03-10T16:27:22.965407+0000 mgr.gibba045.orlgmj (mgr.34412) 8364 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:27:24.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:27:24 gibba045 bash[25517]: audit 2021-03-10T16:27:23.184059+0000 mgr.gibba045.orlgmj (mgr.34412) 8365 : audit [DBG] from='client.59662 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:27:24.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:27:24 gibba045 bash[25517]: audit 2021-03-10T16:27:23.485399+0000 mon.a (mon.0) 1893 : audit [DBG] from='client.? 172.21.2.115:0/1560101493' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:27:24.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:27:24 gibba015 bash[29377]: audit 2021-03-10T16:27:22.956155+0000 mgr.gibba045.orlgmj (mgr.34412) 8363 : audit [DBG] from='client.49668 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:27:24.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:27:24 gibba015 bash[29377]: cephadm 2021-03-10T16:27:22.965407+0000 mgr.gibba045.orlgmj (mgr.34412) 8364 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:27:24.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:27:24 gibba015 bash[29377]: audit 2021-03-10T16:27:23.184059+0000 mgr.gibba045.orlgmj (mgr.34412) 8365 : audit [DBG] from='client.59662 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:27:24.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:27:24 gibba015 bash[29377]: audit 2021-03-10T16:27:23.485399+0000 mon.a (mon.0) 1893 : audit [DBG] from='client.? 172.21.2.115:0/1560101493' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:27:24.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:27:24 gibba015 bash[30343]: audit 2021-03-10T16:27:22.956155+0000 mgr.gibba045.orlgmj (mgr.34412) 8363 : audit [DBG] from='client.49668 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:27:24.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:27:24 gibba015 bash[30343]: cephadm 2021-03-10T16:27:22.965407+0000 mgr.gibba045.orlgmj (mgr.34412) 8364 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:27:24.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:27:24 gibba015 bash[30343]: audit 2021-03-10T16:27:23.184059+0000 mgr.gibba045.orlgmj (mgr.34412) 8365 : audit [DBG] from='client.59662 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:27:24.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:27:24 gibba015 bash[30343]: audit 2021-03-10T16:27:23.485399+0000 mon.a (mon.0) 1893 : audit [DBG] from='client.? 172.21.2.115:0/1560101493' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:27:25.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:27:25 gibba045 bash[25517]: cluster 2021-03-10T16:27:23.905696+0000 mgr.gibba045.orlgmj (mgr.34412) 8366 : cluster [DBG] pgmap v4767: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:25.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:27:25 gibba015 bash[29377]: cluster 2021-03-10T16:27:23.905696+0000 mgr.gibba045.orlgmj (mgr.34412) 8366 : cluster [DBG] pgmap v4767: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:25.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:27:25 gibba015 bash[30343]: cluster 2021-03-10T16:27:23.905696+0000 mgr.gibba045.orlgmj (mgr.34412) 8366 : cluster [DBG] pgmap v4767: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:27.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:27:27 gibba045 bash[25517]: cluster 2021-03-10T16:27:25.906261+0000 mgr.gibba045.orlgmj (mgr.34412) 8367 : cluster [DBG] pgmap v4768: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:27.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:27:27 gibba045 bash[25517]: audit 2021-03-10T16:27:26.729779+0000 mon.a (mon.0) 1894 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:27:27.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:27:27 gibba045 bash[25517]: audit 2021-03-10T16:27:26.930531+0000 mon.a (mon.0) 1895 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:27:27.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:27:27 gibba045 bash[25517]: audit 2021-03-10T16:27:26.934663+0000 mon.c (mon.1) 2316 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:27:27.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:27:27 gibba045 bash[25517]: audit 2021-03-10T16:27:26.937039+0000 mon.c (mon.1) 2317 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:27:27.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:27:27 gibba045 bash[25517]: audit 2021-03-10T16:27:26.938902+0000 mon.c (mon.1) 2318 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:27:27.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:27:27 gibba045 bash[25517]: audit 2021-03-10T16:27:26.940233+0000 mon.c (mon.1) 2319 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:27:27.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:27:27 gibba045 bash[25517]: audit 2021-03-10T16:27:26.943427+0000 mon.c (mon.1) 2320 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:27:27.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:27:27 gibba045 bash[25517]: audit 2021-03-10T16:27:26.945110+0000 mon.c (mon.1) 2321 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:27:27.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:27:27 gibba015 bash[29377]: cluster 2021-03-10T16:27:25.906261+0000 mgr.gibba045.orlgmj (mgr.34412) 8367 : cluster [DBG] pgmap v4768: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:27.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:27:27 gibba015 bash[29377]: audit 2021-03-10T16:27:26.729779+0000 mon.a (mon.0) 1894 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:27:27.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:27:27 gibba015 bash[29377]: audit 2021-03-10T16:27:26.930531+0000 mon.a (mon.0) 1895 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:27:27.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:27:27 gibba015 bash[29377]: audit 2021-03-10T16:27:26.934663+0000 mon.c (mon.1) 2316 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:27:27.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:27:27 gibba015 bash[29377]: audit 2021-03-10T16:27:26.937039+0000 mon.c (mon.1) 2317 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:27:27.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:27:27 gibba015 bash[29377]: audit 2021-03-10T16:27:26.938902+0000 mon.c (mon.1) 2318 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:27:27.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:27:27 gibba015 bash[29377]: audit 2021-03-10T16:27:26.940233+0000 mon.c (mon.1) 2319 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:27:27.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:27:27 gibba015 bash[29377]: audit 2021-03-10T16:27:26.943427+0000 mon.c (mon.1) 2320 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:27:27.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:27:27 gibba015 bash[29377]: audit 2021-03-10T16:27:26.945110+0000 mon.c (mon.1) 2321 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:27:27.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:27:27 gibba015 bash[30343]: cluster 2021-03-10T16:27:25.906261+0000 mgr.gibba045.orlgmj (mgr.34412) 8367 : cluster [DBG] pgmap v4768: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:27.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:27:27 gibba015 bash[30343]: audit 2021-03-10T16:27:26.729779+0000 mon.a (mon.0) 1894 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:27:27.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:27:27 gibba015 bash[30343]: audit 2021-03-10T16:27:26.930531+0000 mon.a (mon.0) 1895 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:27:27.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:27:27 gibba015 bash[30343]: audit 2021-03-10T16:27:26.934663+0000 mon.c (mon.1) 2316 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:27:27.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:27:27 gibba015 bash[30343]: audit 2021-03-10T16:27:26.937039+0000 mon.c (mon.1) 2317 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:27:27.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:27:27 gibba015 bash[30343]: audit 2021-03-10T16:27:26.938902+0000 mon.c (mon.1) 2318 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:27:27.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:27:27 gibba015 bash[30343]: audit 2021-03-10T16:27:26.940233+0000 mon.c (mon.1) 2319 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:27:27.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:27:27 gibba015 bash[30343]: audit 2021-03-10T16:27:26.943427+0000 mon.c (mon.1) 2320 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:27:27.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:27:27 gibba015 bash[30343]: audit 2021-03-10T16:27:26.945110+0000 mon.c (mon.1) 2321 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:27:28.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:27:28 gibba015 bash[29377]: cephadm 2021-03-10T16:27:26.733438+0000 mgr.gibba045.orlgmj (mgr.34412) 8368 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:27:28.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:27:28 gibba015 bash[29377]: cephadm 2021-03-10T16:27:26.936215+0000 mgr.gibba045.orlgmj (mgr.34412) 8369 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:27:28.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:27:28 gibba015 bash[29377]: cephadm 2021-03-10T16:27:26.939050+0000 mgr.gibba045.orlgmj (mgr.34412) 8370 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:27:28.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:27:28 gibba015 bash[29377]: cephadm 2021-03-10T16:27:26.940689+0000 mgr.gibba045.orlgmj (mgr.34412) 8371 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:27:28.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:27:28 gibba015 bash[29377]: cephadm 2021-03-10T16:27:26.940735+0000 mgr.gibba045.orlgmj (mgr.34412) 8372 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:27:28.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:27:28 gibba015 bash[29377]: cephadm 2021-03-10T16:27:26.942213+0000 mgr.gibba045.orlgmj (mgr.34412) 8373 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:27:28.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:27:28 gibba015 bash[29377]: cephadm 2021-03-10T16:27:26.942281+0000 mgr.gibba045.orlgmj (mgr.34412) 8374 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:27:28.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:27:28 gibba015 bash[29377]: cephadm 2021-03-10T16:27:26.943576+0000 mgr.gibba045.orlgmj (mgr.34412) 8375 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:27:28.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:27:28 gibba015 bash[29377]: cephadm 2021-03-10T16:27:26.945281+0000 mgr.gibba045.orlgmj (mgr.34412) 8376 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:27:28.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:27:28 gibba015 bash[29377]: cephadm 2021-03-10T16:27:26.945324+0000 mgr.gibba045.orlgmj (mgr.34412) 8377 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:27:28.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:27:28 gibba015 bash[29377]: cephadm 2021-03-10T16:27:26.946744+0000 mgr.gibba045.orlgmj (mgr.34412) 8378 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:27:28.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:27:28 gibba015 bash[29377]: cephadm 2021-03-10T16:27:26.947180+0000 mgr.gibba045.orlgmj (mgr.34412) 8379 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:27:28.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:27:28 gibba015 bash[29377]: cephadm 2021-03-10T16:27:26.948633+0000 mgr.gibba045.orlgmj (mgr.34412) 8380 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:27:28.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:27:28 gibba015 bash[29377]: cephadm 2021-03-10T16:27:26.948681+0000 mgr.gibba045.orlgmj (mgr.34412) 8381 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:27:28.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:27:28 gibba015 bash[29377]: cephadm 2021-03-10T16:27:26.948803+0000 mgr.gibba045.orlgmj (mgr.34412) 8382 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:27:28.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:27:28 gibba015 bash[30343]: cephadm 2021-03-10T16:27:26.733438+0000 mgr.gibba045.orlgmj (mgr.34412) 8368 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:27:28.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:27:28 gibba015 bash[30343]: cephadm 2021-03-10T16:27:26.936215+0000 mgr.gibba045.orlgmj (mgr.34412) 8369 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:27:28.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:27:28 gibba015 bash[30343]: cephadm 2021-03-10T16:27:26.939050+0000 mgr.gibba045.orlgmj (mgr.34412) 8370 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:27:28.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:27:28 gibba015 bash[30343]: cephadm 2021-03-10T16:27:26.940689+0000 mgr.gibba045.orlgmj (mgr.34412) 8371 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:27:28.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:27:28 gibba015 bash[30343]: cephadm 2021-03-10T16:27:26.940735+0000 mgr.gibba045.orlgmj (mgr.34412) 8372 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:27:28.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:27:28 gibba015 bash[30343]: cephadm 2021-03-10T16:27:26.942213+0000 mgr.gibba045.orlgmj (mgr.34412) 8373 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:27:28.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:27:28 gibba015 bash[30343]: cephadm 2021-03-10T16:27:26.942281+0000 mgr.gibba045.orlgmj (mgr.34412) 8374 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:27:28.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:27:28 gibba015 bash[30343]: cephadm 2021-03-10T16:27:26.943576+0000 mgr.gibba045.orlgmj (mgr.34412) 8375 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:27:28.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:27:28 gibba015 bash[30343]: cephadm 2021-03-10T16:27:26.945281+0000 mgr.gibba045.orlgmj (mgr.34412) 8376 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:27:28.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:27:28 gibba015 bash[30343]: cephadm 2021-03-10T16:27:26.945324+0000 mgr.gibba045.orlgmj (mgr.34412) 8377 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:27:28.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:27:28 gibba015 bash[30343]: cephadm 2021-03-10T16:27:26.946744+0000 mgr.gibba045.orlgmj (mgr.34412) 8378 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:27:28.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:27:28 gibba015 bash[30343]: cephadm 2021-03-10T16:27:26.947180+0000 mgr.gibba045.orlgmj (mgr.34412) 8379 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:27:28.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:27:28 gibba015 bash[30343]: cephadm 2021-03-10T16:27:26.948633+0000 mgr.gibba045.orlgmj (mgr.34412) 8380 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:27:28.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:27:28 gibba015 bash[30343]: cephadm 2021-03-10T16:27:26.948681+0000 mgr.gibba045.orlgmj (mgr.34412) 8381 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:27:28.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:27:28 gibba015 bash[30343]: cephadm 2021-03-10T16:27:26.948803+0000 mgr.gibba045.orlgmj (mgr.34412) 8382 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:27:28.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:27:28 gibba045 bash[25517]: cephadm 2021-03-10T16:27:26.733438+0000 mgr.gibba045.orlgmj (mgr.34412) 8368 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:27:28.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:27:28 gibba045 bash[25517]: cephadm 2021-03-10T16:27:26.936215+0000 mgr.gibba045.orlgmj (mgr.34412) 8369 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:27:28.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:27:28 gibba045 bash[25517]: cephadm 2021-03-10T16:27:26.939050+0000 mgr.gibba045.orlgmj (mgr.34412) 8370 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:27:28.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:27:28 gibba045 bash[25517]: cephadm 2021-03-10T16:27:26.940689+0000 mgr.gibba045.orlgmj (mgr.34412) 8371 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:27:28.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:27:28 gibba045 bash[25517]: cephadm 2021-03-10T16:27:26.940735+0000 mgr.gibba045.orlgmj (mgr.34412) 8372 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:27:28.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:27:28 gibba045 bash[25517]: cephadm 2021-03-10T16:27:26.942213+0000 mgr.gibba045.orlgmj (mgr.34412) 8373 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:27:28.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:27:28 gibba045 bash[25517]: cephadm 2021-03-10T16:27:26.942281+0000 mgr.gibba045.orlgmj (mgr.34412) 8374 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:27:28.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:27:28 gibba045 bash[25517]: cephadm 2021-03-10T16:27:26.943576+0000 mgr.gibba045.orlgmj (mgr.34412) 8375 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:27:28.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:27:28 gibba045 bash[25517]: cephadm 2021-03-10T16:27:26.945281+0000 mgr.gibba045.orlgmj (mgr.34412) 8376 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:27:28.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:27:28 gibba045 bash[25517]: cephadm 2021-03-10T16:27:26.945324+0000 mgr.gibba045.orlgmj (mgr.34412) 8377 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:27:28.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:27:28 gibba045 bash[25517]: cephadm 2021-03-10T16:27:26.946744+0000 mgr.gibba045.orlgmj (mgr.34412) 8378 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:27:28.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:27:28 gibba045 bash[25517]: cephadm 2021-03-10T16:27:26.947180+0000 mgr.gibba045.orlgmj (mgr.34412) 8379 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:27:28.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:27:28 gibba045 bash[25517]: cephadm 2021-03-10T16:27:26.948633+0000 mgr.gibba045.orlgmj (mgr.34412) 8380 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:27:28.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:27:28 gibba045 bash[25517]: cephadm 2021-03-10T16:27:26.948681+0000 mgr.gibba045.orlgmj (mgr.34412) 8381 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:27:28.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:27:28 gibba045 bash[25517]: cephadm 2021-03-10T16:27:26.948803+0000 mgr.gibba045.orlgmj (mgr.34412) 8382 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:27:29.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:27:29 gibba015 bash[29377]: cluster 2021-03-10T16:27:27.906930+0000 mgr.gibba045.orlgmj (mgr.34412) 8383 : cluster [DBG] pgmap v4769: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:29.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:27:29 gibba015 bash[30343]: cluster 2021-03-10T16:27:27.906930+0000 mgr.gibba045.orlgmj (mgr.34412) 8383 : cluster [DBG] pgmap v4769: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:29.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:27:29 gibba045 bash[25517]: cluster 2021-03-10T16:27:27.906930+0000 mgr.gibba045.orlgmj (mgr.34412) 8383 : cluster [DBG] pgmap v4769: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:31.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:27:31 gibba015 bash[29377]: cluster 2021-03-10T16:27:29.908578+0000 mgr.gibba045.orlgmj (mgr.34412) 8384 : cluster [DBG] pgmap v4770: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:31.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:27:31 gibba015 bash[30343]: cluster 2021-03-10T16:27:29.908578+0000 mgr.gibba045.orlgmj (mgr.34412) 8384 : cluster [DBG] pgmap v4770: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:31.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:27:31 gibba045 bash[25517]: cluster 2021-03-10T16:27:29.908578+0000 mgr.gibba045.orlgmj (mgr.34412) 8384 : cluster [DBG] pgmap v4770: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:33.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:27:33 gibba015 bash[29377]: cluster 2021-03-10T16:27:31.910089+0000 mgr.gibba045.orlgmj (mgr.34412) 8385 : cluster [DBG] pgmap v4771: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:33.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:27:33 gibba015 bash[30343]: cluster 2021-03-10T16:27:31.910089+0000 mgr.gibba045.orlgmj (mgr.34412) 8385 : cluster [DBG] pgmap v4771: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:33.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:27:33 gibba045 bash[25517]: cluster 2021-03-10T16:27:31.910089+0000 mgr.gibba045.orlgmj (mgr.34412) 8385 : cluster [DBG] pgmap v4771: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:35.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:27:35 gibba015 bash[29377]: cluster 2021-03-10T16:27:33.911441+0000 mgr.gibba045.orlgmj (mgr.34412) 8386 : cluster [DBG] pgmap v4772: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:35.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:27:35 gibba015 bash[30343]: cluster 2021-03-10T16:27:33.911441+0000 mgr.gibba045.orlgmj (mgr.34412) 8386 : cluster [DBG] pgmap v4772: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:35.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:27:35 gibba045 bash[25517]: cluster 2021-03-10T16:27:33.911441+0000 mgr.gibba045.orlgmj (mgr.34412) 8386 : cluster [DBG] pgmap v4772: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:37.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:27:37 gibba015 bash[29377]: cluster 2021-03-10T16:27:35.913003+0000 mgr.gibba045.orlgmj (mgr.34412) 8387 : cluster [DBG] pgmap v4773: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:37.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:27:37 gibba015 bash[30343]: cluster 2021-03-10T16:27:35.913003+0000 mgr.gibba045.orlgmj (mgr.34412) 8387 : cluster [DBG] pgmap v4773: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:37.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:27:37 gibba045 bash[25517]: cluster 2021-03-10T16:27:35.913003+0000 mgr.gibba045.orlgmj (mgr.34412) 8387 : cluster [DBG] pgmap v4773: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:39.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:27:39 gibba015 bash[29377]: cluster 2021-03-10T16:27:37.914076+0000 mgr.gibba045.orlgmj (mgr.34412) 8388 : cluster [DBG] pgmap v4774: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:39.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:27:39 gibba015 bash[30343]: cluster 2021-03-10T16:27:37.914076+0000 mgr.gibba045.orlgmj (mgr.34412) 8388 : cluster [DBG] pgmap v4774: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:39.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:27:39 gibba045 bash[25517]: cluster 2021-03-10T16:27:37.914076+0000 mgr.gibba045.orlgmj (mgr.34412) 8388 : cluster [DBG] pgmap v4774: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:41.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:27:41 gibba015 bash[29377]: cluster 2021-03-10T16:27:39.915509+0000 mgr.gibba045.orlgmj (mgr.34412) 8389 : cluster [DBG] pgmap v4775: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:41.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:27:41 gibba015 bash[30343]: cluster 2021-03-10T16:27:39.915509+0000 mgr.gibba045.orlgmj (mgr.34412) 8389 : cluster [DBG] pgmap v4775: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:41.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:27:41 gibba045 bash[25517]: cluster 2021-03-10T16:27:39.915509+0000 mgr.gibba045.orlgmj (mgr.34412) 8389 : cluster [DBG] pgmap v4775: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:43.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:27:43 gibba015 bash[29377]: cluster 2021-03-10T16:27:41.917389+0000 mgr.gibba045.orlgmj (mgr.34412) 8390 : cluster [DBG] pgmap v4776: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:43.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:27:43 gibba015 bash[29377]: cephadm 2021-03-10T16:27:41.964918+0000 mgr.gibba045.orlgmj (mgr.34412) 8391 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:27:43.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:27:43 gibba015 bash[30343]: cluster 2021-03-10T16:27:41.917389+0000 mgr.gibba045.orlgmj (mgr.34412) 8390 : cluster [DBG] pgmap v4776: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:43.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:27:43 gibba015 bash[30343]: cephadm 2021-03-10T16:27:41.964918+0000 mgr.gibba045.orlgmj (mgr.34412) 8391 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:27:43.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:27:43 gibba045 bash[25517]: cluster 2021-03-10T16:27:41.917389+0000 mgr.gibba045.orlgmj (mgr.34412) 8390 : cluster [DBG] pgmap v4776: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:43.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:27:43 gibba045 bash[25517]: cephadm 2021-03-10T16:27:41.964918+0000 mgr.gibba045.orlgmj (mgr.34412) 8391 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:27:45.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:27:45 gibba015 bash[29377]: cluster 2021-03-10T16:27:43.918578+0000 mgr.gibba045.orlgmj (mgr.34412) 8392 : cluster [DBG] pgmap v4777: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:45.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:27:45 gibba015 bash[30343]: cluster 2021-03-10T16:27:43.918578+0000 mgr.gibba045.orlgmj (mgr.34412) 8392 : cluster [DBG] pgmap v4777: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:45.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:27:45 gibba045 bash[25517]: cluster 2021-03-10T16:27:43.918578+0000 mgr.gibba045.orlgmj (mgr.34412) 8392 : cluster [DBG] pgmap v4777: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:47.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:27:47 gibba015 bash[29377]: cluster 2021-03-10T16:27:45.920123+0000 mgr.gibba045.orlgmj (mgr.34412) 8393 : cluster [DBG] pgmap v4778: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:47.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:27:47 gibba015 bash[30343]: cluster 2021-03-10T16:27:45.920123+0000 mgr.gibba045.orlgmj (mgr.34412) 8393 : cluster [DBG] pgmap v4778: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:47.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:27:47 gibba045 bash[25517]: cluster 2021-03-10T16:27:45.920123+0000 mgr.gibba045.orlgmj (mgr.34412) 8393 : cluster [DBG] pgmap v4778: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:49.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:27:49 gibba015 bash[29377]: cluster 2021-03-10T16:27:47.921197+0000 mgr.gibba045.orlgmj (mgr.34412) 8394 : cluster [DBG] pgmap v4779: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:49.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:27:49 gibba015 bash[30343]: cluster 2021-03-10T16:27:47.921197+0000 mgr.gibba045.orlgmj (mgr.34412) 8394 : cluster [DBG] pgmap v4779: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:49.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:27:49 gibba045 bash[25517]: cluster 2021-03-10T16:27:47.921197+0000 mgr.gibba045.orlgmj (mgr.34412) 8394 : cluster [DBG] pgmap v4779: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:51.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:27:51 gibba015 bash[29377]: cluster 2021-03-10T16:27:49.922518+0000 mgr.gibba045.orlgmj (mgr.34412) 8395 : cluster [DBG] pgmap v4780: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:51.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:27:51 gibba015 bash[30343]: cluster 2021-03-10T16:27:49.922518+0000 mgr.gibba045.orlgmj (mgr.34412) 8395 : cluster [DBG] pgmap v4780: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:51.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:27:51 gibba045 bash[25517]: cluster 2021-03-10T16:27:49.922518+0000 mgr.gibba045.orlgmj (mgr.34412) 8395 : cluster [DBG] pgmap v4780: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:53.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:27:53 gibba015 bash[29377]: cluster 2021-03-10T16:27:51.924289+0000 mgr.gibba045.orlgmj (mgr.34412) 8396 : cluster [DBG] pgmap v4781: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:53.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:27:53 gibba015 bash[30343]: cluster 2021-03-10T16:27:51.924289+0000 mgr.gibba045.orlgmj (mgr.34412) 8396 : cluster [DBG] pgmap v4781: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:53.727 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:27:53.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:27:53 gibba045 bash[25517]: cluster 2021-03-10T16:27:51.924289+0000 mgr.gibba045.orlgmj (mgr.34412) 8396 : cluster [DBG] pgmap v4781: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:53.980 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:27:53.981 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 91s ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:27:53.981 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 27s ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:27:53.981 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 27s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:27:53.982 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 27s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:27:53.982 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 91s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:27:53.982 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 91s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:27:53.983 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 27s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:27:53.983 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 91s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:27:53.983 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 91s ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:27:53.983 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 27s ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:27:53.984 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 91s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:27:53.984 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 91s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:27:53.984 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 91s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:27:53.984 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 91s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:27:53.985 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 27s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:27:53.985 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 27s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:27:53.985 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 27s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:27:53.985 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 27s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:27:53.985 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 27s ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:27:53.986 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 27s ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:27:54.242 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:27:54.242 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:27:54.243 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:27:54.243 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:27:54.243 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:27:54.243 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:27:54.244 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:27:54.244 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:27:54.244 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:27:54.244 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:27:54.245 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:27:54.245 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:27:54.245 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:27:54.245 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:27:54.245 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:27:54.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:27:54 gibba015 bash[29377]: audit 2021-03-10T16:27:53.582675+0000 mon.c (mon.1) 2322 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:27:54.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:27:54 gibba015 bash[29377]: audit 2021-03-10T16:27:53.583027+0000 mon.a (mon.0) 1896 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:27:54.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:27:54 gibba015 bash[29377]: audit 2021-03-10T16:27:53.585407+0000 mon.c (mon.1) 2323 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:27:54.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:27:54 gibba015 bash[29377]: audit 2021-03-10T16:27:53.585742+0000 mon.a (mon.0) 1897 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:27:54.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:27:54 gibba015 bash[29377]: audit 2021-03-10T16:27:53.596020+0000 mon.c (mon.1) 2324 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T16:27:54.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:27:54 gibba015 bash[29377]: audit 2021-03-10T16:27:53.596137+0000 mon.c (mon.1) 2325 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:27:54.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:27:54 gibba015 bash[29377]: audit 2021-03-10T16:27:53.596285+0000 mon.c (mon.1) 2326 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:27:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:27:54 gibba015 bash[29377]: audit 2021-03-10T16:27:53.596518+0000 mon.a (mon.0) 1898 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T16:27:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:27:54 gibba015 bash[29377]: audit 2021-03-10T16:27:53.596519+0000 mon.c (mon.1) 2327 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:27:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:27:54 gibba015 bash[29377]: audit 2021-03-10T16:27:53.596964+0000 mon.a (mon.0) 1899 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:27:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:27:54 gibba015 bash[29377]: audit 2021-03-10T16:27:53.597217+0000 mon.a (mon.0) 1900 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:27:54.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:27:54 gibba015 bash[29377]: audit 2021-03-10T16:27:53.597472+0000 mon.a (mon.0) 1901 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:27:54.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:27:54 gibba015 bash[29377]: audit 2021-03-10T16:27:54.243107+0000 mon.a (mon.0) 1902 : audit [DBG] from='client.? 172.21.2.115:0/1596360772' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:27:54.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:27:54 gibba015 bash[30343]: audit 2021-03-10T16:27:53.582675+0000 mon.c (mon.1) 2322 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:27:54.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:27:54 gibba015 bash[30343]: audit 2021-03-10T16:27:53.583027+0000 mon.a (mon.0) 1896 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:27:54.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:27:54 gibba015 bash[30343]: audit 2021-03-10T16:27:53.585407+0000 mon.c (mon.1) 2323 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:27:54.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:27:54 gibba015 bash[30343]: audit 2021-03-10T16:27:53.585742+0000 mon.a (mon.0) 1897 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:27:54.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:27:54 gibba015 bash[30343]: audit 2021-03-10T16:27:53.596020+0000 mon.c (mon.1) 2324 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T16:27:54.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:27:54 gibba015 bash[30343]: audit 2021-03-10T16:27:53.596137+0000 mon.c (mon.1) 2325 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:27:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:27:54 gibba015 bash[30343]: audit 2021-03-10T16:27:53.596285+0000 mon.c (mon.1) 2326 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:27:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:27:54 gibba015 bash[30343]: audit 2021-03-10T16:27:53.596518+0000 mon.a (mon.0) 1898 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T16:27:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:27:54 gibba015 bash[30343]: audit 2021-03-10T16:27:53.596519+0000 mon.c (mon.1) 2327 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:27:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:27:54 gibba015 bash[30343]: audit 2021-03-10T16:27:53.596964+0000 mon.a (mon.0) 1899 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:27:54.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:27:54 gibba015 bash[30343]: audit 2021-03-10T16:27:53.597217+0000 mon.a (mon.0) 1900 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:27:54.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:27:54 gibba015 bash[30343]: audit 2021-03-10T16:27:53.597472+0000 mon.a (mon.0) 1901 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:27:54.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:27:54 gibba015 bash[30343]: audit 2021-03-10T16:27:54.243107+0000 mon.a (mon.0) 1902 : audit [DBG] from='client.? 172.21.2.115:0/1596360772' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:27:54.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:27:54 gibba045 bash[25517]: audit 2021-03-10T16:27:53.582675+0000 mon.c (mon.1) 2322 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:27:54.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:27:54 gibba045 bash[25517]: audit 2021-03-10T16:27:53.583027+0000 mon.a (mon.0) 1896 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:27:54.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:27:54 gibba045 bash[25517]: audit 2021-03-10T16:27:53.585407+0000 mon.c (mon.1) 2323 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:27:54.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:27:54 gibba045 bash[25517]: audit 2021-03-10T16:27:53.585742+0000 mon.a (mon.0) 1897 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:27:54.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:27:54 gibba045 bash[25517]: audit 2021-03-10T16:27:53.596020+0000 mon.c (mon.1) 2324 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T16:27:54.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:27:54 gibba045 bash[25517]: audit 2021-03-10T16:27:53.596137+0000 mon.c (mon.1) 2325 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:27:54.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:27:54 gibba045 bash[25517]: audit 2021-03-10T16:27:53.596285+0000 mon.c (mon.1) 2326 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:27:54.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:27:54 gibba045 bash[25517]: audit 2021-03-10T16:27:53.596518+0000 mon.a (mon.0) 1898 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T16:27:54.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:27:54 gibba045 bash[25517]: audit 2021-03-10T16:27:53.596519+0000 mon.c (mon.1) 2327 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:27:54.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:27:54 gibba045 bash[25517]: audit 2021-03-10T16:27:53.596964+0000 mon.a (mon.0) 1899 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:27:54.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:27:54 gibba045 bash[25517]: audit 2021-03-10T16:27:53.597217+0000 mon.a (mon.0) 1900 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:27:54.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:27:54 gibba045 bash[25517]: audit 2021-03-10T16:27:53.597472+0000 mon.a (mon.0) 1901 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:27:54.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:27:54 gibba045 bash[25517]: audit 2021-03-10T16:27:54.243107+0000 mon.a (mon.0) 1902 : audit [DBG] from='client.? 172.21.2.115:0/1596360772' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:27:55.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:27:55 gibba015 bash[29377]: audit 2021-03-10T16:27:53.721528+0000 mgr.gibba045.orlgmj (mgr.34412) 8397 : audit [DBG] from='client.49686 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:27:55.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:27:55 gibba015 bash[29377]: cluster 2021-03-10T16:27:53.925514+0000 mgr.gibba045.orlgmj (mgr.34412) 8398 : cluster [DBG] pgmap v4782: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:55.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:27:55 gibba015 bash[29377]: audit 2021-03-10T16:27:53.943911+0000 mgr.gibba045.orlgmj (mgr.34412) 8399 : audit [DBG] from='client.49692 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:27:55.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:27:55 gibba015 bash[30343]: audit 2021-03-10T16:27:53.721528+0000 mgr.gibba045.orlgmj (mgr.34412) 8397 : audit [DBG] from='client.49686 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:27:55.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:27:55 gibba015 bash[30343]: cluster 2021-03-10T16:27:53.925514+0000 mgr.gibba045.orlgmj (mgr.34412) 8398 : cluster [DBG] pgmap v4782: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:55.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:27:55 gibba015 bash[30343]: audit 2021-03-10T16:27:53.943911+0000 mgr.gibba045.orlgmj (mgr.34412) 8399 : audit [DBG] from='client.49692 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:27:55.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:27:55 gibba045 bash[25517]: audit 2021-03-10T16:27:53.721528+0000 mgr.gibba045.orlgmj (mgr.34412) 8397 : audit [DBG] from='client.49686 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:27:55.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:27:55 gibba045 bash[25517]: cluster 2021-03-10T16:27:53.925514+0000 mgr.gibba045.orlgmj (mgr.34412) 8398 : cluster [DBG] pgmap v4782: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:55.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:27:55 gibba045 bash[25517]: audit 2021-03-10T16:27:53.943911+0000 mgr.gibba045.orlgmj (mgr.34412) 8399 : audit [DBG] from='client.49692 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:27:57.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:27:57 gibba015 bash[29377]: cluster 2021-03-10T16:27:55.927134+0000 mgr.gibba045.orlgmj (mgr.34412) 8400 : cluster [DBG] pgmap v4783: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:57.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:27:57 gibba015 bash[30343]: cluster 2021-03-10T16:27:55.927134+0000 mgr.gibba045.orlgmj (mgr.34412) 8400 : cluster [DBG] pgmap v4783: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:57.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:27:57 gibba045 bash[25517]: cluster 2021-03-10T16:27:55.927134+0000 mgr.gibba045.orlgmj (mgr.34412) 8400 : cluster [DBG] pgmap v4783: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:58.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:27:58 gibba015 bash[29377]: cephadm 2021-03-10T16:27:56.980882+0000 mgr.gibba045.orlgmj (mgr.34412) 8401 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:27:58.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:27:58 gibba015 bash[29377]: cluster 2021-03-10T16:27:57.928044+0000 mgr.gibba045.orlgmj (mgr.34412) 8402 : cluster [DBG] pgmap v4784: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:58.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:27:58 gibba015 bash[30343]: cephadm 2021-03-10T16:27:56.980882+0000 mgr.gibba045.orlgmj (mgr.34412) 8401 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:27:58.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:27:58 gibba015 bash[30343]: cluster 2021-03-10T16:27:57.928044+0000 mgr.gibba045.orlgmj (mgr.34412) 8402 : cluster [DBG] pgmap v4784: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:58.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:27:58 gibba045 bash[25517]: cephadm 2021-03-10T16:27:56.980882+0000 mgr.gibba045.orlgmj (mgr.34412) 8401 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:27:58.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:27:58 gibba045 bash[25517]: cluster 2021-03-10T16:27:57.928044+0000 mgr.gibba045.orlgmj (mgr.34412) 8402 : cluster [DBG] pgmap v4784: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:01.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:28:00 gibba045 bash[25517]: cluster 2021-03-10T16:27:59.929385+0000 mgr.gibba045.orlgmj (mgr.34412) 8403 : cluster [DBG] pgmap v4785: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:01.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:28:00 gibba015 bash[29377]: cluster 2021-03-10T16:27:59.929385+0000 mgr.gibba045.orlgmj (mgr.34412) 8403 : cluster [DBG] pgmap v4785: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:01.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:28:00 gibba015 bash[30343]: cluster 2021-03-10T16:27:59.929385+0000 mgr.gibba045.orlgmj (mgr.34412) 8403 : cluster [DBG] pgmap v4785: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:03.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:28:03 gibba015 bash[29377]: cluster 2021-03-10T16:28:01.931137+0000 mgr.gibba045.orlgmj (mgr.34412) 8404 : cluster [DBG] pgmap v4786: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:03.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:28:03 gibba015 bash[30343]: cluster 2021-03-10T16:28:01.931137+0000 mgr.gibba045.orlgmj (mgr.34412) 8404 : cluster [DBG] pgmap v4786: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:03.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:28:03 gibba045 bash[25517]: cluster 2021-03-10T16:28:01.931137+0000 mgr.gibba045.orlgmj (mgr.34412) 8404 : cluster [DBG] pgmap v4786: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:05.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:28:05 gibba015 bash[29377]: cluster 2021-03-10T16:28:03.932325+0000 mgr.gibba045.orlgmj (mgr.34412) 8405 : cluster [DBG] pgmap v4787: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:05.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:28:05 gibba015 bash[30343]: cluster 2021-03-10T16:28:03.932325+0000 mgr.gibba045.orlgmj (mgr.34412) 8405 : cluster [DBG] pgmap v4787: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:05.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:28:05 gibba045 bash[25517]: cluster 2021-03-10T16:28:03.932325+0000 mgr.gibba045.orlgmj (mgr.34412) 8405 : cluster [DBG] pgmap v4787: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:07.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:28:07 gibba015 bash[29377]: cluster 2021-03-10T16:28:05.933877+0000 mgr.gibba045.orlgmj (mgr.34412) 8406 : cluster [DBG] pgmap v4788: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:07.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:28:07 gibba015 bash[30343]: cluster 2021-03-10T16:28:05.933877+0000 mgr.gibba045.orlgmj (mgr.34412) 8406 : cluster [DBG] pgmap v4788: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:07.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:28:07 gibba045 bash[25517]: cluster 2021-03-10T16:28:05.933877+0000 mgr.gibba045.orlgmj (mgr.34412) 8406 : cluster [DBG] pgmap v4788: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:09.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:28:09 gibba015 bash[29377]: cluster 2021-03-10T16:28:07.934673+0000 mgr.gibba045.orlgmj (mgr.34412) 8407 : cluster [DBG] pgmap v4789: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:09.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:28:09 gibba015 bash[30343]: cluster 2021-03-10T16:28:07.934673+0000 mgr.gibba045.orlgmj (mgr.34412) 8407 : cluster [DBG] pgmap v4789: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:09.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:28:09 gibba045 bash[25517]: cluster 2021-03-10T16:28:07.934673+0000 mgr.gibba045.orlgmj (mgr.34412) 8407 : cluster [DBG] pgmap v4789: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:11.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:28:11 gibba015 bash[29377]: cluster 2021-03-10T16:28:09.936243+0000 mgr.gibba045.orlgmj (mgr.34412) 8408 : cluster [DBG] pgmap v4790: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:11.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:28:11 gibba015 bash[30343]: cluster 2021-03-10T16:28:09.936243+0000 mgr.gibba045.orlgmj (mgr.34412) 8408 : cluster [DBG] pgmap v4790: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:11.552 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:28:11 gibba045 bash[25517]: cluster 2021-03-10T16:28:09.936243+0000 mgr.gibba045.orlgmj (mgr.34412) 8408 : cluster [DBG] pgmap v4790: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:13.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:28:13 gibba015 bash[29377]: cluster 2021-03-10T16:28:11.938060+0000 mgr.gibba045.orlgmj (mgr.34412) 8409 : cluster [DBG] pgmap v4791: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:13.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:28:13 gibba015 bash[29377]: cephadm 2021-03-10T16:28:11.996961+0000 mgr.gibba045.orlgmj (mgr.34412) 8410 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:28:13.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:28:13 gibba015 bash[30343]: cluster 2021-03-10T16:28:11.938060+0000 mgr.gibba045.orlgmj (mgr.34412) 8409 : cluster [DBG] pgmap v4791: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:13.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:28:13 gibba015 bash[30343]: cephadm 2021-03-10T16:28:11.996961+0000 mgr.gibba045.orlgmj (mgr.34412) 8410 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:28:13.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:28:13 gibba045 bash[25517]: cluster 2021-03-10T16:28:11.938060+0000 mgr.gibba045.orlgmj (mgr.34412) 8409 : cluster [DBG] pgmap v4791: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:13.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:28:13 gibba045 bash[25517]: cephadm 2021-03-10T16:28:11.996961+0000 mgr.gibba045.orlgmj (mgr.34412) 8410 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:28:15.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:28:15 gibba015 bash[29377]: cluster 2021-03-10T16:28:13.939301+0000 mgr.gibba045.orlgmj (mgr.34412) 8411 : cluster [DBG] pgmap v4792: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:15.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:28:15 gibba015 bash[30343]: cluster 2021-03-10T16:28:13.939301+0000 mgr.gibba045.orlgmj (mgr.34412) 8411 : cluster [DBG] pgmap v4792: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:15.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:28:15 gibba045 bash[25517]: cluster 2021-03-10T16:28:13.939301+0000 mgr.gibba045.orlgmj (mgr.34412) 8411 : cluster [DBG] pgmap v4792: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:17.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:28:17 gibba015 bash[29377]: cluster 2021-03-10T16:28:15.940990+0000 mgr.gibba045.orlgmj (mgr.34412) 8412 : cluster [DBG] pgmap v4793: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:17.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:28:17 gibba015 bash[30343]: cluster 2021-03-10T16:28:15.940990+0000 mgr.gibba045.orlgmj (mgr.34412) 8412 : cluster [DBG] pgmap v4793: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:17.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:28:17 gibba045 bash[25517]: cluster 2021-03-10T16:28:15.940990+0000 mgr.gibba045.orlgmj (mgr.34412) 8412 : cluster [DBG] pgmap v4793: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:19.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:28:19 gibba015 bash[29377]: cluster 2021-03-10T16:28:17.942135+0000 mgr.gibba045.orlgmj (mgr.34412) 8413 : cluster [DBG] pgmap v4794: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:19.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:28:19 gibba015 bash[30343]: cluster 2021-03-10T16:28:17.942135+0000 mgr.gibba045.orlgmj (mgr.34412) 8413 : cluster [DBG] pgmap v4794: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:19.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:28:19 gibba045 bash[25517]: cluster 2021-03-10T16:28:17.942135+0000 mgr.gibba045.orlgmj (mgr.34412) 8413 : cluster [DBG] pgmap v4794: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:21.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:28:21 gibba015 bash[29377]: cluster 2021-03-10T16:28:19.943756+0000 mgr.gibba045.orlgmj (mgr.34412) 8414 : cluster [DBG] pgmap v4795: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:21.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:28:21 gibba015 bash[30343]: cluster 2021-03-10T16:28:19.943756+0000 mgr.gibba045.orlgmj (mgr.34412) 8414 : cluster [DBG] pgmap v4795: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:21.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:28:21 gibba045 bash[25517]: cluster 2021-03-10T16:28:19.943756+0000 mgr.gibba045.orlgmj (mgr.34412) 8414 : cluster [DBG] pgmap v4795: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:23.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:28:23 gibba015 bash[29377]: cluster 2021-03-10T16:28:21.945443+0000 mgr.gibba045.orlgmj (mgr.34412) 8415 : cluster [DBG] pgmap v4796: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:23.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:28:23 gibba015 bash[30343]: cluster 2021-03-10T16:28:21.945443+0000 mgr.gibba045.orlgmj (mgr.34412) 8415 : cluster [DBG] pgmap v4796: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:23.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:28:23 gibba045 bash[25517]: cluster 2021-03-10T16:28:21.945443+0000 mgr.gibba045.orlgmj (mgr.34412) 8415 : cluster [DBG] pgmap v4796: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:24.484 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:28:24.714 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:28:24.714 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 2m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:28:24.715 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 57s ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:28:24.715 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 57s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:28:24.715 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 57s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:28:24.716 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:28:24.716 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:28:24.716 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 57s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:28:24.717 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:28:24.717 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 2m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:28:24.717 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 57s ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:28:24.717 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:28:24.718 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:28:24.718 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:28:24.718 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:28:24.719 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 57s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:28:24.719 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 57s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:28:24.719 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 57s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:28:24.719 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 57s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:28:24.720 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 57s ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:28:24.720 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 57s ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:28:24.966 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:28:24.967 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:28:24.967 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:28:24.967 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:28:24.967 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:28:24.968 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:28:24.968 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:28:24.968 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:28:24.968 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:28:24.968 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:28:24.969 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:28:24.969 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:28:24.969 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:28:24.969 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:28:24.970 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:28:25.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:28:25 gibba015 bash[29377]: cluster 2021-03-10T16:28:23.946710+0000 mgr.gibba045.orlgmj (mgr.34412) 8416 : cluster [DBG] pgmap v4797: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:25.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:28:25 gibba015 bash[29377]: audit 2021-03-10T16:28:24.967016+0000 mon.a (mon.0) 1903 : audit [DBG] from='client.? 172.21.2.115:0/4268572019' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:28:25.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:28:25 gibba015 bash[30343]: cluster 2021-03-10T16:28:23.946710+0000 mgr.gibba045.orlgmj (mgr.34412) 8416 : cluster [DBG] pgmap v4797: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:25.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:28:25 gibba015 bash[30343]: audit 2021-03-10T16:28:24.967016+0000 mon.a (mon.0) 1903 : audit [DBG] from='client.? 172.21.2.115:0/4268572019' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:28:25.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:28:25 gibba045 bash[25517]: cluster 2021-03-10T16:28:23.946710+0000 mgr.gibba045.orlgmj (mgr.34412) 8416 : cluster [DBG] pgmap v4797: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:25.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:28:25 gibba045 bash[25517]: audit 2021-03-10T16:28:24.967016+0000 mon.a (mon.0) 1903 : audit [DBG] from='client.? 172.21.2.115:0/4268572019' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:28:26.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:28:26 gibba015 bash[29377]: audit 2021-03-10T16:28:24.478963+0000 mgr.gibba045.orlgmj (mgr.34412) 8417 : audit [DBG] from='client.59692 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:28:26.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:28:26 gibba015 bash[29377]: audit 2021-03-10T16:28:24.706456+0000 mgr.gibba045.orlgmj (mgr.34412) 8418 : audit [DBG] from='client.49710 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:28:26.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:28:26 gibba015 bash[30343]: audit 2021-03-10T16:28:24.478963+0000 mgr.gibba045.orlgmj (mgr.34412) 8417 : audit [DBG] from='client.59692 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:28:26.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:28:26 gibba015 bash[30343]: audit 2021-03-10T16:28:24.706456+0000 mgr.gibba045.orlgmj (mgr.34412) 8418 : audit [DBG] from='client.49710 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:28:26.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:28:26 gibba045 bash[25517]: audit 2021-03-10T16:28:24.478963+0000 mgr.gibba045.orlgmj (mgr.34412) 8417 : audit [DBG] from='client.59692 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:28:26.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:28:26 gibba045 bash[25517]: audit 2021-03-10T16:28:24.706456+0000 mgr.gibba045.orlgmj (mgr.34412) 8418 : audit [DBG] from='client.49710 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:28:27.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:28:27 gibba015 bash[29377]: cluster 2021-03-10T16:28:25.948215+0000 mgr.gibba045.orlgmj (mgr.34412) 8419 : cluster [DBG] pgmap v4798: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:27.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:28:27 gibba015 bash[29377]: audit 2021-03-10T16:28:27.011609+0000 mon.c (mon.1) 2328 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:28:27.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:28:27 gibba015 bash[30343]: cluster 2021-03-10T16:28:25.948215+0000 mgr.gibba045.orlgmj (mgr.34412) 8419 : cluster [DBG] pgmap v4798: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:27.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:28:27 gibba015 bash[30343]: audit 2021-03-10T16:28:27.011609+0000 mon.c (mon.1) 2328 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:28:27.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:28:27 gibba045 bash[25517]: cluster 2021-03-10T16:28:25.948215+0000 mgr.gibba045.orlgmj (mgr.34412) 8419 : cluster [DBG] pgmap v4798: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:27.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:28:27 gibba045 bash[25517]: audit 2021-03-10T16:28:27.011609+0000 mon.c (mon.1) 2328 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:28:28.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:28:28 gibba045 bash[25517]: cephadm 2021-03-10T16:28:27.019621+0000 mgr.gibba045.orlgmj (mgr.34412) 8420 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:28:28.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:28:28 gibba045 bash[25517]: cephadm 2021-03-10T16:28:27.021661+0000 mgr.gibba045.orlgmj (mgr.34412) 8421 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:28:28.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:28:28 gibba045 bash[25517]: audit 2021-03-10T16:28:27.248979+0000 mon.a (mon.0) 1904 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:28:28.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:28:28 gibba045 bash[25517]: audit 2021-03-10T16:28:27.252947+0000 mon.c (mon.1) 2329 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:28:28.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:28:28 gibba045 bash[25517]: audit 2021-03-10T16:28:27.254278+0000 mon.c (mon.1) 2330 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:28:28.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:28:28 gibba045 bash[25517]: cephadm 2021-03-10T16:28:27.254627+0000 mgr.gibba045.orlgmj (mgr.34412) 8422 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:28:28.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:28:28 gibba045 bash[25517]: audit 2021-03-10T16:28:27.255490+0000 mon.c (mon.1) 2331 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:28:28.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:28:28 gibba045 bash[25517]: cephadm 2021-03-10T16:28:27.256322+0000 mgr.gibba045.orlgmj (mgr.34412) 8423 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:28:28.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:28:28 gibba045 bash[25517]: audit 2021-03-10T16:28:27.256526+0000 mon.c (mon.1) 2332 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:28:28.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:28:28 gibba045 bash[25517]: cephadm 2021-03-10T16:28:27.257509+0000 mgr.gibba045.orlgmj (mgr.34412) 8424 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:28:28.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:28:28 gibba045 bash[25517]: cephadm 2021-03-10T16:28:27.257547+0000 mgr.gibba045.orlgmj (mgr.34412) 8425 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:28:28.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:28:28 gibba045 bash[25517]: cephadm 2021-03-10T16:28:27.258712+0000 mgr.gibba045.orlgmj (mgr.34412) 8426 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:28:28.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:28:28 gibba045 bash[25517]: cephadm 2021-03-10T16:28:27.258751+0000 mgr.gibba045.orlgmj (mgr.34412) 8427 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:28:28.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:28:28 gibba045 bash[25517]: audit 2021-03-10T16:28:27.259190+0000 mon.c (mon.1) 2333 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:28:28.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:28:28 gibba045 bash[25517]: cephadm 2021-03-10T16:28:27.259719+0000 mgr.gibba045.orlgmj (mgr.34412) 8428 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:28:28.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:28:28 gibba045 bash[25517]: audit 2021-03-10T16:28:27.260552+0000 mon.c (mon.1) 2334 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:28:28.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:28:28 gibba045 bash[25517]: cephadm 2021-03-10T16:28:27.261190+0000 mgr.gibba045.orlgmj (mgr.34412) 8429 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:28:28.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:28:28 gibba045 bash[25517]: cephadm 2021-03-10T16:28:27.261228+0000 mgr.gibba045.orlgmj (mgr.34412) 8430 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:28:28.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:28:28 gibba045 bash[25517]: cephadm 2021-03-10T16:28:27.262360+0000 mgr.gibba045.orlgmj (mgr.34412) 8431 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:28:28.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:28:28 gibba045 bash[25517]: cephadm 2021-03-10T16:28:27.262675+0000 mgr.gibba045.orlgmj (mgr.34412) 8432 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:28:28.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:28:28 gibba045 bash[25517]: cephadm 2021-03-10T16:28:27.263718+0000 mgr.gibba045.orlgmj (mgr.34412) 8433 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:28:28.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:28:28 gibba045 bash[25517]: cephadm 2021-03-10T16:28:27.263756+0000 mgr.gibba045.orlgmj (mgr.34412) 8434 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:28:28.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:28:28 gibba045 bash[25517]: cephadm 2021-03-10T16:28:27.263862+0000 mgr.gibba045.orlgmj (mgr.34412) 8435 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:28:28.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:28:28 gibba015 bash[29377]: cephadm 2021-03-10T16:28:27.019621+0000 mgr.gibba045.orlgmj (mgr.34412) 8420 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:28:28.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:28:28 gibba015 bash[29377]: cephadm 2021-03-10T16:28:27.021661+0000 mgr.gibba045.orlgmj (mgr.34412) 8421 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:28:28.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:28:28 gibba015 bash[29377]: audit 2021-03-10T16:28:27.248979+0000 mon.a (mon.0) 1904 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:28:28.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:28:28 gibba015 bash[29377]: audit 2021-03-10T16:28:27.252947+0000 mon.c (mon.1) 2329 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:28:28.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:28:28 gibba015 bash[29377]: audit 2021-03-10T16:28:27.254278+0000 mon.c (mon.1) 2330 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:28:28.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:28:28 gibba015 bash[29377]: cephadm 2021-03-10T16:28:27.254627+0000 mgr.gibba045.orlgmj (mgr.34412) 8422 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:28:28.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:28:28 gibba015 bash[29377]: audit 2021-03-10T16:28:27.255490+0000 mon.c (mon.1) 2331 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:28:28.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:28:28 gibba015 bash[29377]: cephadm 2021-03-10T16:28:27.256322+0000 mgr.gibba045.orlgmj (mgr.34412) 8423 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:28:28.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:28:28 gibba015 bash[29377]: audit 2021-03-10T16:28:27.256526+0000 mon.c (mon.1) 2332 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:28:28.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:28:28 gibba015 bash[29377]: cephadm 2021-03-10T16:28:27.257509+0000 mgr.gibba045.orlgmj (mgr.34412) 8424 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:28:28.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:28:28 gibba015 bash[29377]: cephadm 2021-03-10T16:28:27.257547+0000 mgr.gibba045.orlgmj (mgr.34412) 8425 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:28:28.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:28:28 gibba015 bash[29377]: cephadm 2021-03-10T16:28:27.258712+0000 mgr.gibba045.orlgmj (mgr.34412) 8426 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:28:28.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:28:28 gibba015 bash[29377]: cephadm 2021-03-10T16:28:27.258751+0000 mgr.gibba045.orlgmj (mgr.34412) 8427 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:28:28.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:28:28 gibba015 bash[29377]: audit 2021-03-10T16:28:27.259190+0000 mon.c (mon.1) 2333 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:28:28.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:28:28 gibba015 bash[29377]: cephadm 2021-03-10T16:28:27.259719+0000 mgr.gibba045.orlgmj (mgr.34412) 8428 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:28:28.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:28:28 gibba015 bash[29377]: audit 2021-03-10T16:28:27.260552+0000 mon.c (mon.1) 2334 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:28:28.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:28:28 gibba015 bash[29377]: cephadm 2021-03-10T16:28:27.261190+0000 mgr.gibba045.orlgmj (mgr.34412) 8429 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:28:28.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:28:28 gibba015 bash[29377]: cephadm 2021-03-10T16:28:27.261228+0000 mgr.gibba045.orlgmj (mgr.34412) 8430 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:28:28.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:28:28 gibba015 bash[29377]: cephadm 2021-03-10T16:28:27.262360+0000 mgr.gibba045.orlgmj (mgr.34412) 8431 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:28:28.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:28:28 gibba015 bash[29377]: cephadm 2021-03-10T16:28:27.262675+0000 mgr.gibba045.orlgmj (mgr.34412) 8432 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:28:28.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:28:28 gibba015 bash[29377]: cephadm 2021-03-10T16:28:27.263718+0000 mgr.gibba045.orlgmj (mgr.34412) 8433 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:28:28.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:28:28 gibba015 bash[29377]: cephadm 2021-03-10T16:28:27.263756+0000 mgr.gibba045.orlgmj (mgr.34412) 8434 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:28:28.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:28:28 gibba015 bash[29377]: cephadm 2021-03-10T16:28:27.263862+0000 mgr.gibba045.orlgmj (mgr.34412) 8435 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:28:28.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:28:28 gibba015 bash[30343]: cephadm 2021-03-10T16:28:27.019621+0000 mgr.gibba045.orlgmj (mgr.34412) 8420 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:28:28.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:28:28 gibba015 bash[30343]: cephadm 2021-03-10T16:28:27.021661+0000 mgr.gibba045.orlgmj (mgr.34412) 8421 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:28:28.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:28:28 gibba015 bash[30343]: audit 2021-03-10T16:28:27.248979+0000 mon.a (mon.0) 1904 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:28:28.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:28:28 gibba015 bash[30343]: audit 2021-03-10T16:28:27.252947+0000 mon.c (mon.1) 2329 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:28:28.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:28:28 gibba015 bash[30343]: audit 2021-03-10T16:28:27.254278+0000 mon.c (mon.1) 2330 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:28:28.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:28:28 gibba015 bash[30343]: cephadm 2021-03-10T16:28:27.254627+0000 mgr.gibba045.orlgmj (mgr.34412) 8422 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:28:28.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:28:28 gibba015 bash[30343]: audit 2021-03-10T16:28:27.255490+0000 mon.c (mon.1) 2331 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:28:28.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:28:28 gibba015 bash[30343]: cephadm 2021-03-10T16:28:27.256322+0000 mgr.gibba045.orlgmj (mgr.34412) 8423 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:28:28.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:28:28 gibba015 bash[30343]: audit 2021-03-10T16:28:27.256526+0000 mon.c (mon.1) 2332 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:28:28.733 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:28:28 gibba015 bash[30343]: cephadm 2021-03-10T16:28:27.257509+0000 mgr.gibba045.orlgmj (mgr.34412) 8424 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:28:28.733 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:28:28 gibba015 bash[30343]: cephadm 2021-03-10T16:28:27.257547+0000 mgr.gibba045.orlgmj (mgr.34412) 8425 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:28:28.733 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:28:28 gibba015 bash[30343]: cephadm 2021-03-10T16:28:27.258712+0000 mgr.gibba045.orlgmj (mgr.34412) 8426 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:28:28.733 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:28:28 gibba015 bash[30343]: cephadm 2021-03-10T16:28:27.258751+0000 mgr.gibba045.orlgmj (mgr.34412) 8427 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:28:28.734 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:28:28 gibba015 bash[30343]: audit 2021-03-10T16:28:27.259190+0000 mon.c (mon.1) 2333 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:28:28.734 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:28:28 gibba015 bash[30343]: cephadm 2021-03-10T16:28:27.259719+0000 mgr.gibba045.orlgmj (mgr.34412) 8428 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:28:28.734 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:28:28 gibba015 bash[30343]: audit 2021-03-10T16:28:27.260552+0000 mon.c (mon.1) 2334 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:28:28.734 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:28:28 gibba015 bash[30343]: cephadm 2021-03-10T16:28:27.261190+0000 mgr.gibba045.orlgmj (mgr.34412) 8429 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:28:28.735 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:28:28 gibba015 bash[30343]: cephadm 2021-03-10T16:28:27.261228+0000 mgr.gibba045.orlgmj (mgr.34412) 8430 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:28:28.735 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:28:28 gibba015 bash[30343]: cephadm 2021-03-10T16:28:27.262360+0000 mgr.gibba045.orlgmj (mgr.34412) 8431 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:28:28.735 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:28:28 gibba015 bash[30343]: cephadm 2021-03-10T16:28:27.262675+0000 mgr.gibba045.orlgmj (mgr.34412) 8432 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:28:28.735 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:28:28 gibba015 bash[30343]: cephadm 2021-03-10T16:28:27.263718+0000 mgr.gibba045.orlgmj (mgr.34412) 8433 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:28:28.735 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:28:28 gibba015 bash[30343]: cephadm 2021-03-10T16:28:27.263756+0000 mgr.gibba045.orlgmj (mgr.34412) 8434 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:28:28.736 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:28:28 gibba015 bash[30343]: cephadm 2021-03-10T16:28:27.263862+0000 mgr.gibba045.orlgmj (mgr.34412) 8435 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:28:29.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:28:29 gibba045 bash[25517]: cluster 2021-03-10T16:28:27.949433+0000 mgr.gibba045.orlgmj (mgr.34412) 8436 : cluster [DBG] pgmap v4799: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:29.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:28:29 gibba015 bash[29377]: cluster 2021-03-10T16:28:27.949433+0000 mgr.gibba045.orlgmj (mgr.34412) 8436 : cluster [DBG] pgmap v4799: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:29.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:28:29 gibba015 bash[30343]: cluster 2021-03-10T16:28:27.949433+0000 mgr.gibba045.orlgmj (mgr.34412) 8436 : cluster [DBG] pgmap v4799: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:31.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:28:31 gibba045 bash[25517]: cluster 2021-03-10T16:28:29.951027+0000 mgr.gibba045.orlgmj (mgr.34412) 8437 : cluster [DBG] pgmap v4800: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:31.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:28:31 gibba015 bash[29377]: cluster 2021-03-10T16:28:29.951027+0000 mgr.gibba045.orlgmj (mgr.34412) 8437 : cluster [DBG] pgmap v4800: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:31.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:28:31 gibba015 bash[30343]: cluster 2021-03-10T16:28:29.951027+0000 mgr.gibba045.orlgmj (mgr.34412) 8437 : cluster [DBG] pgmap v4800: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:33.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:28:33 gibba045 bash[25517]: cluster 2021-03-10T16:28:31.952817+0000 mgr.gibba045.orlgmj (mgr.34412) 8438 : cluster [DBG] pgmap v4801: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:33.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:28:33 gibba015 bash[29377]: cluster 2021-03-10T16:28:31.952817+0000 mgr.gibba045.orlgmj (mgr.34412) 8438 : cluster [DBG] pgmap v4801: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:33.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:28:33 gibba015 bash[30343]: cluster 2021-03-10T16:28:31.952817+0000 mgr.gibba045.orlgmj (mgr.34412) 8438 : cluster [DBG] pgmap v4801: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:35.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:28:35 gibba045 bash[25517]: cluster 2021-03-10T16:28:33.954044+0000 mgr.gibba045.orlgmj (mgr.34412) 8439 : cluster [DBG] pgmap v4802: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:35.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:28:35 gibba015 bash[29377]: cluster 2021-03-10T16:28:33.954044+0000 mgr.gibba045.orlgmj (mgr.34412) 8439 : cluster [DBG] pgmap v4802: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:35.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:28:35 gibba015 bash[30343]: cluster 2021-03-10T16:28:33.954044+0000 mgr.gibba045.orlgmj (mgr.34412) 8439 : cluster [DBG] pgmap v4802: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:37.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:28:37 gibba045 bash[25517]: cluster 2021-03-10T16:28:35.955557+0000 mgr.gibba045.orlgmj (mgr.34412) 8440 : cluster [DBG] pgmap v4803: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:37.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:28:37 gibba015 bash[29377]: cluster 2021-03-10T16:28:35.955557+0000 mgr.gibba045.orlgmj (mgr.34412) 8440 : cluster [DBG] pgmap v4803: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:37.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:28:37 gibba015 bash[30343]: cluster 2021-03-10T16:28:35.955557+0000 mgr.gibba045.orlgmj (mgr.34412) 8440 : cluster [DBG] pgmap v4803: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:39.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:28:39 gibba015 bash[29377]: cluster 2021-03-10T16:28:37.956781+0000 mgr.gibba045.orlgmj (mgr.34412) 8441 : cluster [DBG] pgmap v4804: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:39.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:28:39 gibba015 bash[30343]: cluster 2021-03-10T16:28:37.956781+0000 mgr.gibba045.orlgmj (mgr.34412) 8441 : cluster [DBG] pgmap v4804: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:39.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:28:39 gibba045 bash[25517]: cluster 2021-03-10T16:28:37.956781+0000 mgr.gibba045.orlgmj (mgr.34412) 8441 : cluster [DBG] pgmap v4804: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:41.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:28:41 gibba015 bash[29377]: cluster 2021-03-10T16:28:39.958219+0000 mgr.gibba045.orlgmj (mgr.34412) 8442 : cluster [DBG] pgmap v4805: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:41.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:28:41 gibba015 bash[30343]: cluster 2021-03-10T16:28:39.958219+0000 mgr.gibba045.orlgmj (mgr.34412) 8442 : cluster [DBG] pgmap v4805: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:41.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:28:41 gibba045 bash[25517]: cluster 2021-03-10T16:28:39.958219+0000 mgr.gibba045.orlgmj (mgr.34412) 8442 : cluster [DBG] pgmap v4805: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:43.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:28:43 gibba015 bash[29377]: cluster 2021-03-10T16:28:41.959931+0000 mgr.gibba045.orlgmj (mgr.34412) 8443 : cluster [DBG] pgmap v4806: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:43.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:28:43 gibba015 bash[29377]: cephadm 2021-03-10T16:28:42.270196+0000 mgr.gibba045.orlgmj (mgr.34412) 8444 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:28:43.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:28:43 gibba015 bash[30343]: cluster 2021-03-10T16:28:41.959931+0000 mgr.gibba045.orlgmj (mgr.34412) 8443 : cluster [DBG] pgmap v4806: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:43.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:28:43 gibba015 bash[30343]: cephadm 2021-03-10T16:28:42.270196+0000 mgr.gibba045.orlgmj (mgr.34412) 8444 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:28:43.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:28:43 gibba045 bash[25517]: cluster 2021-03-10T16:28:41.959931+0000 mgr.gibba045.orlgmj (mgr.34412) 8443 : cluster [DBG] pgmap v4806: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:43.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:28:43 gibba045 bash[25517]: cephadm 2021-03-10T16:28:42.270196+0000 mgr.gibba045.orlgmj (mgr.34412) 8444 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:28:45.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:28:45 gibba015 bash[29377]: cluster 2021-03-10T16:28:43.961299+0000 mgr.gibba045.orlgmj (mgr.34412) 8445 : cluster [DBG] pgmap v4807: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:45.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:28:45 gibba015 bash[30343]: cluster 2021-03-10T16:28:43.961299+0000 mgr.gibba045.orlgmj (mgr.34412) 8445 : cluster [DBG] pgmap v4807: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:45.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:28:45 gibba045 bash[25517]: cluster 2021-03-10T16:28:43.961299+0000 mgr.gibba045.orlgmj (mgr.34412) 8445 : cluster [DBG] pgmap v4807: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:47.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:28:47 gibba015 bash[29377]: cluster 2021-03-10T16:28:45.962827+0000 mgr.gibba045.orlgmj (mgr.34412) 8446 : cluster [DBG] pgmap v4808: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:47.735 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:28:47 gibba015 bash[30343]: cluster 2021-03-10T16:28:45.962827+0000 mgr.gibba045.orlgmj (mgr.34412) 8446 : cluster [DBG] pgmap v4808: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:47.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:28:47 gibba045 bash[25517]: cluster 2021-03-10T16:28:45.962827+0000 mgr.gibba045.orlgmj (mgr.34412) 8446 : cluster [DBG] pgmap v4808: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:49.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:28:49 gibba015 bash[29377]: cluster 2021-03-10T16:28:47.964591+0000 mgr.gibba045.orlgmj (mgr.34412) 8447 : cluster [DBG] pgmap v4809: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:49.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:28:49 gibba015 bash[30343]: cluster 2021-03-10T16:28:47.964591+0000 mgr.gibba045.orlgmj (mgr.34412) 8447 : cluster [DBG] pgmap v4809: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:49.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:28:49 gibba045 bash[25517]: cluster 2021-03-10T16:28:47.964591+0000 mgr.gibba045.orlgmj (mgr.34412) 8447 : cluster [DBG] pgmap v4809: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:51.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:28:51 gibba015 bash[29377]: cluster 2021-03-10T16:28:49.966234+0000 mgr.gibba045.orlgmj (mgr.34412) 8448 : cluster [DBG] pgmap v4810: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:51.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:28:51 gibba015 bash[30343]: cluster 2021-03-10T16:28:49.966234+0000 mgr.gibba045.orlgmj (mgr.34412) 8448 : cluster [DBG] pgmap v4810: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:51.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:28:51 gibba045 bash[25517]: cluster 2021-03-10T16:28:49.966234+0000 mgr.gibba045.orlgmj (mgr.34412) 8448 : cluster [DBG] pgmap v4810: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:53.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:28:53 gibba015 bash[29377]: cluster 2021-03-10T16:28:51.968025+0000 mgr.gibba045.orlgmj (mgr.34412) 8449 : cluster [DBG] pgmap v4811: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:53.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:28:53 gibba015 bash[30343]: cluster 2021-03-10T16:28:51.968025+0000 mgr.gibba045.orlgmj (mgr.34412) 8449 : cluster [DBG] pgmap v4811: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:53.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:28:53 gibba045 bash[25517]: cluster 2021-03-10T16:28:51.968025+0000 mgr.gibba045.orlgmj (mgr.34412) 8449 : cluster [DBG] pgmap v4811: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:54.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:28:54 gibba015 bash[29377]: audit 2021-03-10T16:28:53.589584+0000 mon.c (mon.1) 2335 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:28:54.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:28:54 gibba015 bash[29377]: audit 2021-03-10T16:28:53.590385+0000 mon.c (mon.1) 2336 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:28:54.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:28:54 gibba015 bash[29377]: audit 2021-03-10T16:28:53.590745+0000 mon.a (mon.0) 1905 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:28:54.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:28:54 gibba015 bash[29377]: audit 2021-03-10T16:28:53.591824+0000 mon.a (mon.0) 1906 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:28:54.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:28:54 gibba015 bash[29377]: audit 2021-03-10T16:28:53.599974+0000 mon.c (mon.1) 2337 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T16:28:54.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:28:54 gibba015 bash[29377]: audit 2021-03-10T16:28:53.600829+0000 mon.c (mon.1) 2338 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:28:54.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:28:54 gibba015 bash[29377]: audit 2021-03-10T16:28:53.601143+0000 mon.a (mon.0) 1907 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T16:28:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:28:54 gibba015 bash[29377]: audit 2021-03-10T16:28:53.601805+0000 mon.c (mon.1) 2339 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:28:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:28:54 gibba015 bash[29377]: audit 2021-03-10T16:28:53.602387+0000 mon.a (mon.0) 1908 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:28:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:28:54 gibba015 bash[29377]: audit 2021-03-10T16:28:53.602941+0000 mon.c (mon.1) 2340 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:28:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:28:54 gibba015 bash[29377]: audit 2021-03-10T16:28:53.603179+0000 mon.a (mon.0) 1909 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:28:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:28:54 gibba015 bash[29377]: audit 2021-03-10T16:28:53.604396+0000 mon.a (mon.0) 1910 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:28:54.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:28:54 gibba015 bash[30343]: audit 2021-03-10T16:28:53.589584+0000 mon.c (mon.1) 2335 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:28:54.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:28:54 gibba015 bash[30343]: audit 2021-03-10T16:28:53.590385+0000 mon.c (mon.1) 2336 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:28:54.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:28:54 gibba015 bash[30343]: audit 2021-03-10T16:28:53.590745+0000 mon.a (mon.0) 1905 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:28:54.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:28:54 gibba015 bash[30343]: audit 2021-03-10T16:28:53.591824+0000 mon.a (mon.0) 1906 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:28:54.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:28:54 gibba015 bash[30343]: audit 2021-03-10T16:28:53.599974+0000 mon.c (mon.1) 2337 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T16:28:54.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:28:54 gibba015 bash[30343]: audit 2021-03-10T16:28:53.600829+0000 mon.c (mon.1) 2338 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:28:54.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:28:54 gibba015 bash[30343]: audit 2021-03-10T16:28:53.601143+0000 mon.a (mon.0) 1907 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T16:28:54.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:28:54 gibba015 bash[30343]: audit 2021-03-10T16:28:53.601805+0000 mon.c (mon.1) 2339 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:28:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:28:54 gibba015 bash[30343]: audit 2021-03-10T16:28:53.602387+0000 mon.a (mon.0) 1908 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:28:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:28:54 gibba015 bash[30343]: audit 2021-03-10T16:28:53.602941+0000 mon.c (mon.1) 2340 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:28:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:28:54 gibba015 bash[30343]: audit 2021-03-10T16:28:53.603179+0000 mon.a (mon.0) 1909 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:28:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:28:54 gibba015 bash[30343]: audit 2021-03-10T16:28:53.604396+0000 mon.a (mon.0) 1910 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:28:54.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:28:54 gibba045 bash[25517]: audit 2021-03-10T16:28:53.589584+0000 mon.c (mon.1) 2335 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:28:54.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:28:54 gibba045 bash[25517]: audit 2021-03-10T16:28:53.590385+0000 mon.c (mon.1) 2336 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:28:54.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:28:54 gibba045 bash[25517]: audit 2021-03-10T16:28:53.590745+0000 mon.a (mon.0) 1905 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:28:54.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:28:54 gibba045 bash[25517]: audit 2021-03-10T16:28:53.591824+0000 mon.a (mon.0) 1906 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:28:54.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:28:54 gibba045 bash[25517]: audit 2021-03-10T16:28:53.599974+0000 mon.c (mon.1) 2337 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T16:28:54.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:28:54 gibba045 bash[25517]: audit 2021-03-10T16:28:53.600829+0000 mon.c (mon.1) 2338 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:28:54.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:28:54 gibba045 bash[25517]: audit 2021-03-10T16:28:53.601143+0000 mon.a (mon.0) 1907 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T16:28:54.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:28:54 gibba045 bash[25517]: audit 2021-03-10T16:28:53.601805+0000 mon.c (mon.1) 2339 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:28:54.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:28:54 gibba045 bash[25517]: audit 2021-03-10T16:28:53.602387+0000 mon.a (mon.0) 1908 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:28:54.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:28:54 gibba045 bash[25517]: audit 2021-03-10T16:28:53.602941+0000 mon.c (mon.1) 2340 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:28:54.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:28:54 gibba045 bash[25517]: audit 2021-03-10T16:28:53.603179+0000 mon.a (mon.0) 1909 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:28:54.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:28:54 gibba045 bash[25517]: audit 2021-03-10T16:28:53.604396+0000 mon.a (mon.0) 1910 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:28:55.210 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:28:55.466 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:28:55.466 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 2m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:28:55.467 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 88s ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:28:55.467 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 88s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:28:55.467 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 88s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:28:55.467 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:28:55.468 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:28:55.468 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 88s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:28:55.468 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:28:55.468 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 2m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:28:55.469 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 88s ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:28:55.469 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:28:55.469 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:28:55.469 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:28:55.469 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:28:55.470 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 88s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:28:55.470 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 88s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:28:55.470 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 88s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:28:55.470 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 88s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:28:55.471 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 88s ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:28:55.471 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 88s ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:28:55.716 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:28:55.717 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:28:55.717 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:28:55.717 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:28:55.718 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:28:55.718 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:28:55.718 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:28:55.719 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:28:55.719 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:28:55.719 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:28:55.719 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:28:55.719 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:28:55.720 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:28:55.720 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:28:55.720 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:28:55.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:28:55 gibba015 bash[29377]: cluster 2021-03-10T16:28:53.969301+0000 mgr.gibba045.orlgmj (mgr.34412) 8450 : cluster [DBG] pgmap v4812: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:55.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:28:55 gibba015 bash[30343]: cluster 2021-03-10T16:28:53.969301+0000 mgr.gibba045.orlgmj (mgr.34412) 8450 : cluster [DBG] pgmap v4812: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:55.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:28:55 gibba045 bash[25517]: cluster 2021-03-10T16:28:53.969301+0000 mgr.gibba045.orlgmj (mgr.34412) 8450 : cluster [DBG] pgmap v4812: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:56.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:28:56 gibba015 bash[29377]: audit 2021-03-10T16:28:55.204307+0000 mgr.gibba045.orlgmj (mgr.34412) 8451 : audit [DBG] from='client.59710 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:28:56.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:28:56 gibba015 bash[29377]: audit 2021-03-10T16:28:55.429776+0000 mgr.gibba045.orlgmj (mgr.34412) 8452 : audit [DBG] from='client.59716 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:28:56.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:28:56 gibba015 bash[29377]: audit 2021-03-10T16:28:55.717105+0000 mon.c (mon.1) 2341 : audit [DBG] from='client.? 172.21.2.115:0/4167699133' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:28:56.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:28:56 gibba015 bash[30343]: audit 2021-03-10T16:28:55.204307+0000 mgr.gibba045.orlgmj (mgr.34412) 8451 : audit [DBG] from='client.59710 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:28:56.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:28:56 gibba015 bash[30343]: audit 2021-03-10T16:28:55.429776+0000 mgr.gibba045.orlgmj (mgr.34412) 8452 : audit [DBG] from='client.59716 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:28:56.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:28:56 gibba015 bash[30343]: audit 2021-03-10T16:28:55.717105+0000 mon.c (mon.1) 2341 : audit [DBG] from='client.? 172.21.2.115:0/4167699133' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:28:56.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:28:56 gibba045 bash[25517]: audit 2021-03-10T16:28:55.204307+0000 mgr.gibba045.orlgmj (mgr.34412) 8451 : audit [DBG] from='client.59710 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:28:56.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:28:56 gibba045 bash[25517]: audit 2021-03-10T16:28:55.429776+0000 mgr.gibba045.orlgmj (mgr.34412) 8452 : audit [DBG] from='client.59716 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:28:56.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:28:56 gibba045 bash[25517]: audit 2021-03-10T16:28:55.717105+0000 mon.c (mon.1) 2341 : audit [DBG] from='client.? 172.21.2.115:0/4167699133' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:28:57.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:28:57 gibba045 bash[25517]: cluster 2021-03-10T16:28:55.971011+0000 mgr.gibba045.orlgmj (mgr.34412) 8453 : cluster [DBG] pgmap v4813: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:57.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:28:57 gibba015 bash[29377]: cluster 2021-03-10T16:28:55.971011+0000 mgr.gibba045.orlgmj (mgr.34412) 8453 : cluster [DBG] pgmap v4813: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:57.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:28:57 gibba015 bash[30343]: cluster 2021-03-10T16:28:55.971011+0000 mgr.gibba045.orlgmj (mgr.34412) 8453 : cluster [DBG] pgmap v4813: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:58.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:28:58 gibba015 bash[29377]: cephadm 2021-03-10T16:28:57.277951+0000 mgr.gibba045.orlgmj (mgr.34412) 8454 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:28:58.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:28:58 gibba015 bash[30343]: cephadm 2021-03-10T16:28:57.277951+0000 mgr.gibba045.orlgmj (mgr.34412) 8454 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:28:58.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:28:58 gibba045 bash[25517]: cephadm 2021-03-10T16:28:57.277951+0000 mgr.gibba045.orlgmj (mgr.34412) 8454 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:28:59.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:28:59 gibba015 bash[29377]: cluster 2021-03-10T16:28:57.972659+0000 mgr.gibba045.orlgmj (mgr.34412) 8455 : cluster [DBG] pgmap v4814: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:59.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:28:59 gibba015 bash[30343]: cluster 2021-03-10T16:28:57.972659+0000 mgr.gibba045.orlgmj (mgr.34412) 8455 : cluster [DBG] pgmap v4814: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:59.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:28:59 gibba045 bash[25517]: cluster 2021-03-10T16:28:57.972659+0000 mgr.gibba045.orlgmj (mgr.34412) 8455 : cluster [DBG] pgmap v4814: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:01.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:29:01 gibba015 bash[29377]: cluster 2021-03-10T16:28:59.974341+0000 mgr.gibba045.orlgmj (mgr.34412) 8456 : cluster [DBG] pgmap v4815: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:01.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:29:01 gibba015 bash[30343]: cluster 2021-03-10T16:28:59.974341+0000 mgr.gibba045.orlgmj (mgr.34412) 8456 : cluster [DBG] pgmap v4815: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:01.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:29:01 gibba045 bash[25517]: cluster 2021-03-10T16:28:59.974341+0000 mgr.gibba045.orlgmj (mgr.34412) 8456 : cluster [DBG] pgmap v4815: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:03.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:29:03 gibba015 bash[29377]: cluster 2021-03-10T16:29:01.976116+0000 mgr.gibba045.orlgmj (mgr.34412) 8457 : cluster [DBG] pgmap v4816: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:03.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:29:03 gibba015 bash[30343]: cluster 2021-03-10T16:29:01.976116+0000 mgr.gibba045.orlgmj (mgr.34412) 8457 : cluster [DBG] pgmap v4816: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:03.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:29:03 gibba045 bash[25517]: cluster 2021-03-10T16:29:01.976116+0000 mgr.gibba045.orlgmj (mgr.34412) 8457 : cluster [DBG] pgmap v4816: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:05.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:29:05 gibba015 bash[29377]: cluster 2021-03-10T16:29:03.977436+0000 mgr.gibba045.orlgmj (mgr.34412) 8458 : cluster [DBG] pgmap v4817: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:05.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:29:05 gibba015 bash[30343]: cluster 2021-03-10T16:29:03.977436+0000 mgr.gibba045.orlgmj (mgr.34412) 8458 : cluster [DBG] pgmap v4817: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:05.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:29:05 gibba045 bash[25517]: cluster 2021-03-10T16:29:03.977436+0000 mgr.gibba045.orlgmj (mgr.34412) 8458 : cluster [DBG] pgmap v4817: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:07.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:29:07 gibba015 bash[29377]: cluster 2021-03-10T16:29:05.979078+0000 mgr.gibba045.orlgmj (mgr.34412) 8459 : cluster [DBG] pgmap v4818: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:07.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:29:07 gibba015 bash[30343]: cluster 2021-03-10T16:29:05.979078+0000 mgr.gibba045.orlgmj (mgr.34412) 8459 : cluster [DBG] pgmap v4818: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:07.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:29:07 gibba045 bash[25517]: cluster 2021-03-10T16:29:05.979078+0000 mgr.gibba045.orlgmj (mgr.34412) 8459 : cluster [DBG] pgmap v4818: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:09.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:29:09 gibba015 bash[29377]: cluster 2021-03-10T16:29:07.980769+0000 mgr.gibba045.orlgmj (mgr.34412) 8460 : cluster [DBG] pgmap v4819: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:09.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:29:09 gibba015 bash[30343]: cluster 2021-03-10T16:29:07.980769+0000 mgr.gibba045.orlgmj (mgr.34412) 8460 : cluster [DBG] pgmap v4819: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:09.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:29:09 gibba045 bash[25517]: cluster 2021-03-10T16:29:07.980769+0000 mgr.gibba045.orlgmj (mgr.34412) 8460 : cluster [DBG] pgmap v4819: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:11.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:29:11 gibba045 bash[25517]: cluster 2021-03-10T16:29:09.982416+0000 mgr.gibba045.orlgmj (mgr.34412) 8461 : cluster [DBG] pgmap v4820: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:11.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:29:11 gibba015 bash[29377]: cluster 2021-03-10T16:29:09.982416+0000 mgr.gibba045.orlgmj (mgr.34412) 8461 : cluster [DBG] pgmap v4820: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:11.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:29:11 gibba015 bash[30343]: cluster 2021-03-10T16:29:09.982416+0000 mgr.gibba045.orlgmj (mgr.34412) 8461 : cluster [DBG] pgmap v4820: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:12.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:29:12 gibba045 bash[25517]: cluster 2021-03-10T16:29:11.984225+0000 mgr.gibba045.orlgmj (mgr.34412) 8462 : cluster [DBG] pgmap v4821: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:12.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:29:12 gibba045 bash[25517]: cephadm 2021-03-10T16:29:12.294046+0000 mgr.gibba045.orlgmj (mgr.34412) 8463 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:29:12.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:29:12 gibba015 bash[29377]: cluster 2021-03-10T16:29:11.984225+0000 mgr.gibba045.orlgmj (mgr.34412) 8462 : cluster [DBG] pgmap v4821: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:12.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:29:12 gibba015 bash[29377]: cephadm 2021-03-10T16:29:12.294046+0000 mgr.gibba045.orlgmj (mgr.34412) 8463 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:29:12.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:29:12 gibba015 bash[30343]: cluster 2021-03-10T16:29:11.984225+0000 mgr.gibba045.orlgmj (mgr.34412) 8462 : cluster [DBG] pgmap v4821: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:12.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:29:12 gibba015 bash[30343]: cephadm 2021-03-10T16:29:12.294046+0000 mgr.gibba045.orlgmj (mgr.34412) 8463 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:29:15.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:29:15 gibba045 bash[25517]: cluster 2021-03-10T16:29:13.985503+0000 mgr.gibba045.orlgmj (mgr.34412) 8464 : cluster [DBG] pgmap v4822: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:15.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:29:15 gibba015 bash[29377]: cluster 2021-03-10T16:29:13.985503+0000 mgr.gibba045.orlgmj (mgr.34412) 8464 : cluster [DBG] pgmap v4822: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:15.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:29:15 gibba015 bash[30343]: cluster 2021-03-10T16:29:13.985503+0000 mgr.gibba045.orlgmj (mgr.34412) 8464 : cluster [DBG] pgmap v4822: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:17.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:29:17 gibba015 bash[29377]: cluster 2021-03-10T16:29:15.987213+0000 mgr.gibba045.orlgmj (mgr.34412) 8465 : cluster [DBG] pgmap v4823: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:17.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:29:17 gibba015 bash[30343]: cluster 2021-03-10T16:29:15.987213+0000 mgr.gibba045.orlgmj (mgr.34412) 8465 : cluster [DBG] pgmap v4823: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:17.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:29:17 gibba045 bash[25517]: cluster 2021-03-10T16:29:15.987213+0000 mgr.gibba045.orlgmj (mgr.34412) 8465 : cluster [DBG] pgmap v4823: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:19.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:29:19 gibba015 bash[29377]: cluster 2021-03-10T16:29:17.988903+0000 mgr.gibba045.orlgmj (mgr.34412) 8466 : cluster [DBG] pgmap v4824: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:19.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:29:19 gibba015 bash[30343]: cluster 2021-03-10T16:29:17.988903+0000 mgr.gibba045.orlgmj (mgr.34412) 8466 : cluster [DBG] pgmap v4824: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:19.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:29:19 gibba045 bash[25517]: cluster 2021-03-10T16:29:17.988903+0000 mgr.gibba045.orlgmj (mgr.34412) 8466 : cluster [DBG] pgmap v4824: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:21.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:29:21 gibba015 bash[29377]: cluster 2021-03-10T16:29:19.990569+0000 mgr.gibba045.orlgmj (mgr.34412) 8467 : cluster [DBG] pgmap v4825: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:21.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:29:21 gibba015 bash[30343]: cluster 2021-03-10T16:29:19.990569+0000 mgr.gibba045.orlgmj (mgr.34412) 8467 : cluster [DBG] pgmap v4825: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:21.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:29:21 gibba045 bash[25517]: cluster 2021-03-10T16:29:19.990569+0000 mgr.gibba045.orlgmj (mgr.34412) 8467 : cluster [DBG] pgmap v4825: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:23.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:29:23 gibba015 bash[29377]: cluster 2021-03-10T16:29:21.992234+0000 mgr.gibba045.orlgmj (mgr.34412) 8468 : cluster [DBG] pgmap v4826: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:23.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:29:23 gibba015 bash[30343]: cluster 2021-03-10T16:29:21.992234+0000 mgr.gibba045.orlgmj (mgr.34412) 8468 : cluster [DBG] pgmap v4826: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:23.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:29:23 gibba045 bash[25517]: cluster 2021-03-10T16:29:21.992234+0000 mgr.gibba045.orlgmj (mgr.34412) 8468 : cluster [DBG] pgmap v4826: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:25.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:29:25 gibba015 bash[29377]: cluster 2021-03-10T16:29:23.993419+0000 mgr.gibba045.orlgmj (mgr.34412) 8469 : cluster [DBG] pgmap v4827: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:25.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:29:25 gibba015 bash[30343]: cluster 2021-03-10T16:29:23.993419+0000 mgr.gibba045.orlgmj (mgr.34412) 8469 : cluster [DBG] pgmap v4827: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:25.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:29:25 gibba045 bash[25517]: cluster 2021-03-10T16:29:23.993419+0000 mgr.gibba045.orlgmj (mgr.34412) 8469 : cluster [DBG] pgmap v4827: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:25.958 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:29:26.186 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:29:26.186 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 3m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:29:26.187 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 119s ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:29:26.187 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 119s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:29:26.187 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 119s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:29:26.187 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:29:26.188 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:29:26.188 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 119s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:29:26.188 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:29:26.188 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 3m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:29:26.188 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 119s ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:29:26.189 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:29:26.189 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:29:26.189 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:29:26.189 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:29:26.190 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 119s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:29:26.190 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 119s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:29:26.190 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 119s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:29:26.190 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 119s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:29:26.191 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 119s ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:29:26.191 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 119s ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:29:26.434 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:29:26.434 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:29:26.434 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:29:26.435 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:29:26.435 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:29:26.435 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:29:26.435 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:29:26.436 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:29:26.436 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:29:26.436 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:29:26.436 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:29:26.436 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:29:26.437 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:29:26.437 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:29:26.437 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:29:27.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:29:27 gibba015 bash[29377]: audit 2021-03-10T16:29:25.952355+0000 mgr.gibba045.orlgmj (mgr.34412) 8470 : audit [DBG] from='client.49740 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:29:27.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:29:27 gibba015 bash[29377]: cluster 2021-03-10T16:29:25.995029+0000 mgr.gibba045.orlgmj (mgr.34412) 8471 : cluster [DBG] pgmap v4828: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:27.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:29:27 gibba015 bash[29377]: audit 2021-03-10T16:29:26.177297+0000 mgr.gibba045.orlgmj (mgr.34412) 8472 : audit [DBG] from='client.59734 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:29:27.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:29:27 gibba015 bash[29377]: audit 2021-03-10T16:29:26.434600+0000 mon.c (mon.1) 2342 : audit [DBG] from='client.? 172.21.2.115:0/3311901327' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:29:27.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:29:27 gibba015 bash[30343]: audit 2021-03-10T16:29:25.952355+0000 mgr.gibba045.orlgmj (mgr.34412) 8470 : audit [DBG] from='client.49740 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:29:27.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:29:27 gibba015 bash[30343]: cluster 2021-03-10T16:29:25.995029+0000 mgr.gibba045.orlgmj (mgr.34412) 8471 : cluster [DBG] pgmap v4828: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:27.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:29:27 gibba015 bash[30343]: audit 2021-03-10T16:29:26.177297+0000 mgr.gibba045.orlgmj (mgr.34412) 8472 : audit [DBG] from='client.59734 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:29:27.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:29:27 gibba015 bash[30343]: audit 2021-03-10T16:29:26.434600+0000 mon.c (mon.1) 2342 : audit [DBG] from='client.? 172.21.2.115:0/3311901327' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:29:27.544 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:29:27 gibba045 bash[25517]: audit 2021-03-10T16:29:25.952355+0000 mgr.gibba045.orlgmj (mgr.34412) 8470 : audit [DBG] from='client.49740 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:29:27.544 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:29:27 gibba045 bash[25517]: cluster 2021-03-10T16:29:25.995029+0000 mgr.gibba045.orlgmj (mgr.34412) 8471 : cluster [DBG] pgmap v4828: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:27.545 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:29:27 gibba045 bash[25517]: audit 2021-03-10T16:29:26.177297+0000 mgr.gibba045.orlgmj (mgr.34412) 8472 : audit [DBG] from='client.59734 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:29:27.545 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:29:27 gibba045 bash[25517]: audit 2021-03-10T16:29:26.434600+0000 mon.c (mon.1) 2342 : audit [DBG] from='client.? 172.21.2.115:0/3311901327' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:29:28.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:29:28 gibba015 bash[29377]: audit 2021-03-10T16:29:27.308320+0000 mon.c (mon.1) 2343 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:29:28.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:29:28 gibba015 bash[29377]: cephadm 2021-03-10T16:29:27.316134+0000 mgr.gibba045.orlgmj (mgr.34412) 8473 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:29:28.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:29:28 gibba015 bash[29377]: cephadm 2021-03-10T16:29:27.318047+0000 mgr.gibba045.orlgmj (mgr.34412) 8474 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:29:28.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:29:28 gibba015 bash[29377]: audit 2021-03-10T16:29:27.528846+0000 mon.a (mon.0) 1911 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:29:28.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:29:28 gibba015 bash[29377]: audit 2021-03-10T16:29:27.532541+0000 mon.c (mon.1) 2344 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:29:28.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:29:28 gibba015 bash[29377]: audit 2021-03-10T16:29:27.534331+0000 mon.c (mon.1) 2345 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:29:28.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:29:28 gibba015 bash[29377]: audit 2021-03-10T16:29:27.536020+0000 mon.c (mon.1) 2346 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:29:28.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:29:28 gibba015 bash[29377]: audit 2021-03-10T16:29:27.537452+0000 mon.c (mon.1) 2347 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:29:28.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:29:28 gibba015 bash[29377]: audit 2021-03-10T16:29:27.541901+0000 mon.c (mon.1) 2348 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:29:28.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:29:28 gibba015 bash[29377]: audit 2021-03-10T16:29:27.543992+0000 mon.c (mon.1) 2349 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:29:28.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:29:28 gibba015 bash[30343]: audit 2021-03-10T16:29:27.308320+0000 mon.c (mon.1) 2343 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:29:28.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:29:28 gibba015 bash[30343]: cephadm 2021-03-10T16:29:27.316134+0000 mgr.gibba045.orlgmj (mgr.34412) 8473 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:29:28.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:29:28 gibba015 bash[30343]: cephadm 2021-03-10T16:29:27.318047+0000 mgr.gibba045.orlgmj (mgr.34412) 8474 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:29:28.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:29:28 gibba015 bash[30343]: audit 2021-03-10T16:29:27.528846+0000 mon.a (mon.0) 1911 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:29:28.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:29:28 gibba015 bash[30343]: audit 2021-03-10T16:29:27.532541+0000 mon.c (mon.1) 2344 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:29:28.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:29:28 gibba015 bash[30343]: audit 2021-03-10T16:29:27.534331+0000 mon.c (mon.1) 2345 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:29:28.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:29:28 gibba015 bash[30343]: audit 2021-03-10T16:29:27.536020+0000 mon.c (mon.1) 2346 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:29:28.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:29:28 gibba015 bash[30343]: audit 2021-03-10T16:29:27.537452+0000 mon.c (mon.1) 2347 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:29:28.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:29:28 gibba015 bash[30343]: audit 2021-03-10T16:29:27.541901+0000 mon.c (mon.1) 2348 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:29:28.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:29:28 gibba015 bash[30343]: audit 2021-03-10T16:29:27.543992+0000 mon.c (mon.1) 2349 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:29:28.552 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:29:28 gibba045 bash[25517]: audit 2021-03-10T16:29:27.308320+0000 mon.c (mon.1) 2343 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:29:28.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:29:28 gibba045 bash[25517]: cephadm 2021-03-10T16:29:27.316134+0000 mgr.gibba045.orlgmj (mgr.34412) 8473 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:29:28.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:29:28 gibba045 bash[25517]: cephadm 2021-03-10T16:29:27.318047+0000 mgr.gibba045.orlgmj (mgr.34412) 8474 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:29:28.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:29:28 gibba045 bash[25517]: audit 2021-03-10T16:29:27.528846+0000 mon.a (mon.0) 1911 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:29:28.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:29:28 gibba045 bash[25517]: audit 2021-03-10T16:29:27.532541+0000 mon.c (mon.1) 2344 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:29:28.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:29:28 gibba045 bash[25517]: audit 2021-03-10T16:29:27.534331+0000 mon.c (mon.1) 2345 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:29:28.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:29:28 gibba045 bash[25517]: audit 2021-03-10T16:29:27.536020+0000 mon.c (mon.1) 2346 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:29:28.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:29:28 gibba045 bash[25517]: audit 2021-03-10T16:29:27.537452+0000 mon.c (mon.1) 2347 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:29:28.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:29:28 gibba045 bash[25517]: audit 2021-03-10T16:29:27.541901+0000 mon.c (mon.1) 2348 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:29:28.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:29:28 gibba045 bash[25517]: audit 2021-03-10T16:29:27.543992+0000 mon.c (mon.1) 2349 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:29:29.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:29:29 gibba015 bash[30343]: cephadm 2021-03-10T16:29:27.534195+0000 mgr.gibba045.orlgmj (mgr.34412) 8475 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:29:29.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:29:29 gibba015 bash[30343]: cephadm 2021-03-10T16:29:27.536204+0000 mgr.gibba045.orlgmj (mgr.34412) 8476 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:29:29.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:29:29 gibba015 bash[30343]: cephadm 2021-03-10T16:29:27.537951+0000 mgr.gibba045.orlgmj (mgr.34412) 8477 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:29:29.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:29:29 gibba015 bash[30343]: cephadm 2021-03-10T16:29:27.537990+0000 mgr.gibba045.orlgmj (mgr.34412) 8478 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:29:29.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:29:29 gibba015 bash[30343]: cephadm 2021-03-10T16:29:27.539617+0000 mgr.gibba045.orlgmj (mgr.34412) 8479 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:29:29.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:29:29 gibba015 bash[30343]: cephadm 2021-03-10T16:29:27.539653+0000 mgr.gibba045.orlgmj (mgr.34412) 8480 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:29:29.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:29:29 gibba015 bash[30343]: cephadm 2021-03-10T16:29:27.541492+0000 mgr.gibba045.orlgmj (mgr.34412) 8481 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:29:29.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:29:29 gibba015 bash[30343]: cephadm 2021-03-10T16:29:27.543631+0000 mgr.gibba045.orlgmj (mgr.34412) 8482 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:29:29.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:29:29 gibba015 bash[30343]: cephadm 2021-03-10T16:29:27.543670+0000 mgr.gibba045.orlgmj (mgr.34412) 8483 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:29:29.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:29:29 gibba015 bash[30343]: cephadm 2021-03-10T16:29:27.545575+0000 mgr.gibba045.orlgmj (mgr.34412) 8484 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:29:29.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:29:29 gibba015 bash[30343]: cephadm 2021-03-10T16:29:27.545981+0000 mgr.gibba045.orlgmj (mgr.34412) 8485 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:29:29.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:29:29 gibba015 bash[30343]: cephadm 2021-03-10T16:29:27.547443+0000 mgr.gibba045.orlgmj (mgr.34412) 8486 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:29:29.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:29:29 gibba015 bash[30343]: cephadm 2021-03-10T16:29:27.547480+0000 mgr.gibba045.orlgmj (mgr.34412) 8487 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:29:29.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:29:29 gibba015 bash[30343]: cephadm 2021-03-10T16:29:27.547592+0000 mgr.gibba045.orlgmj (mgr.34412) 8488 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:29:29.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:29:29 gibba015 bash[30343]: cluster 2021-03-10T16:29:27.996623+0000 mgr.gibba045.orlgmj (mgr.34412) 8489 : cluster [DBG] pgmap v4829: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:29.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:29:29 gibba015 bash[29377]: cephadm 2021-03-10T16:29:27.534195+0000 mgr.gibba045.orlgmj (mgr.34412) 8475 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:29:29.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:29:29 gibba015 bash[29377]: cephadm 2021-03-10T16:29:27.536204+0000 mgr.gibba045.orlgmj (mgr.34412) 8476 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:29:29.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:29:29 gibba015 bash[29377]: cephadm 2021-03-10T16:29:27.537951+0000 mgr.gibba045.orlgmj (mgr.34412) 8477 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:29:29.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:29:29 gibba015 bash[29377]: cephadm 2021-03-10T16:29:27.537990+0000 mgr.gibba045.orlgmj (mgr.34412) 8478 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:29:29.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:29:29 gibba015 bash[29377]: cephadm 2021-03-10T16:29:27.539617+0000 mgr.gibba045.orlgmj (mgr.34412) 8479 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:29:29.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:29:29 gibba015 bash[29377]: cephadm 2021-03-10T16:29:27.539653+0000 mgr.gibba045.orlgmj (mgr.34412) 8480 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:29:29.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:29:29 gibba015 bash[29377]: cephadm 2021-03-10T16:29:27.541492+0000 mgr.gibba045.orlgmj (mgr.34412) 8481 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:29:29.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:29:29 gibba015 bash[29377]: cephadm 2021-03-10T16:29:27.543631+0000 mgr.gibba045.orlgmj (mgr.34412) 8482 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:29:29.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:29:29 gibba015 bash[29377]: cephadm 2021-03-10T16:29:27.543670+0000 mgr.gibba045.orlgmj (mgr.34412) 8483 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:29:29.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:29:29 gibba015 bash[29377]: cephadm 2021-03-10T16:29:27.545575+0000 mgr.gibba045.orlgmj (mgr.34412) 8484 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:29:29.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:29:29 gibba015 bash[29377]: cephadm 2021-03-10T16:29:27.545981+0000 mgr.gibba045.orlgmj (mgr.34412) 8485 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:29:29.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:29:29 gibba015 bash[29377]: cephadm 2021-03-10T16:29:27.547443+0000 mgr.gibba045.orlgmj (mgr.34412) 8486 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:29:29.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:29:29 gibba015 bash[29377]: cephadm 2021-03-10T16:29:27.547480+0000 mgr.gibba045.orlgmj (mgr.34412) 8487 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:29:29.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:29:29 gibba015 bash[29377]: cephadm 2021-03-10T16:29:27.547592+0000 mgr.gibba045.orlgmj (mgr.34412) 8488 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:29:29.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:29:29 gibba015 bash[29377]: cluster 2021-03-10T16:29:27.996623+0000 mgr.gibba045.orlgmj (mgr.34412) 8489 : cluster [DBG] pgmap v4829: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:29.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:29:29 gibba045 bash[25517]: cephadm 2021-03-10T16:29:27.534195+0000 mgr.gibba045.orlgmj (mgr.34412) 8475 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:29:29.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:29:29 gibba045 bash[25517]: cephadm 2021-03-10T16:29:27.536204+0000 mgr.gibba045.orlgmj (mgr.34412) 8476 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:29:29.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:29:29 gibba045 bash[25517]: cephadm 2021-03-10T16:29:27.537951+0000 mgr.gibba045.orlgmj (mgr.34412) 8477 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:29:29.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:29:29 gibba045 bash[25517]: cephadm 2021-03-10T16:29:27.537990+0000 mgr.gibba045.orlgmj (mgr.34412) 8478 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:29:29.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:29:29 gibba045 bash[25517]: cephadm 2021-03-10T16:29:27.539617+0000 mgr.gibba045.orlgmj (mgr.34412) 8479 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:29:29.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:29:29 gibba045 bash[25517]: cephadm 2021-03-10T16:29:27.539653+0000 mgr.gibba045.orlgmj (mgr.34412) 8480 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:29:29.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:29:29 gibba045 bash[25517]: cephadm 2021-03-10T16:29:27.541492+0000 mgr.gibba045.orlgmj (mgr.34412) 8481 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:29:29.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:29:29 gibba045 bash[25517]: cephadm 2021-03-10T16:29:27.543631+0000 mgr.gibba045.orlgmj (mgr.34412) 8482 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:29:29.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:29:29 gibba045 bash[25517]: cephadm 2021-03-10T16:29:27.543670+0000 mgr.gibba045.orlgmj (mgr.34412) 8483 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:29:29.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:29:29 gibba045 bash[25517]: cephadm 2021-03-10T16:29:27.545575+0000 mgr.gibba045.orlgmj (mgr.34412) 8484 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:29:29.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:29:29 gibba045 bash[25517]: cephadm 2021-03-10T16:29:27.545981+0000 mgr.gibba045.orlgmj (mgr.34412) 8485 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:29:29.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:29:29 gibba045 bash[25517]: cephadm 2021-03-10T16:29:27.547443+0000 mgr.gibba045.orlgmj (mgr.34412) 8486 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:29:29.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:29:29 gibba045 bash[25517]: cephadm 2021-03-10T16:29:27.547480+0000 mgr.gibba045.orlgmj (mgr.34412) 8487 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:29:29.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:29:29 gibba045 bash[25517]: cephadm 2021-03-10T16:29:27.547592+0000 mgr.gibba045.orlgmj (mgr.34412) 8488 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:29:29.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:29:29 gibba045 bash[25517]: cluster 2021-03-10T16:29:27.996623+0000 mgr.gibba045.orlgmj (mgr.34412) 8489 : cluster [DBG] pgmap v4829: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:31.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:29:31 gibba015 bash[29377]: cluster 2021-03-10T16:29:29.997994+0000 mgr.gibba045.orlgmj (mgr.34412) 8490 : cluster [DBG] pgmap v4830: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:31.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:29:31 gibba015 bash[30343]: cluster 2021-03-10T16:29:29.997994+0000 mgr.gibba045.orlgmj (mgr.34412) 8490 : cluster [DBG] pgmap v4830: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:31.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:29:31 gibba045 bash[25517]: cluster 2021-03-10T16:29:29.997994+0000 mgr.gibba045.orlgmj (mgr.34412) 8490 : cluster [DBG] pgmap v4830: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:33.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:29:33 gibba015 bash[29377]: cluster 2021-03-10T16:29:31.999813+0000 mgr.gibba045.orlgmj (mgr.34412) 8491 : cluster [DBG] pgmap v4831: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:33.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:29:33 gibba015 bash[30343]: cluster 2021-03-10T16:29:31.999813+0000 mgr.gibba045.orlgmj (mgr.34412) 8491 : cluster [DBG] pgmap v4831: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:33.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:29:33 gibba045 bash[25517]: cluster 2021-03-10T16:29:31.999813+0000 mgr.gibba045.orlgmj (mgr.34412) 8491 : cluster [DBG] pgmap v4831: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:35.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:29:35 gibba015 bash[29377]: cluster 2021-03-10T16:29:34.001034+0000 mgr.gibba045.orlgmj (mgr.34412) 8492 : cluster [DBG] pgmap v4832: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:35.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:29:35 gibba015 bash[30343]: cluster 2021-03-10T16:29:34.001034+0000 mgr.gibba045.orlgmj (mgr.34412) 8492 : cluster [DBG] pgmap v4832: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:35.552 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:29:35 gibba045 bash[25517]: cluster 2021-03-10T16:29:34.001034+0000 mgr.gibba045.orlgmj (mgr.34412) 8492 : cluster [DBG] pgmap v4832: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:37.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:29:37 gibba015 bash[29377]: cluster 2021-03-10T16:29:36.002770+0000 mgr.gibba045.orlgmj (mgr.34412) 8493 : cluster [DBG] pgmap v4833: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:37.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:29:37 gibba015 bash[30343]: cluster 2021-03-10T16:29:36.002770+0000 mgr.gibba045.orlgmj (mgr.34412) 8493 : cluster [DBG] pgmap v4833: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:37.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:29:37 gibba045 bash[25517]: cluster 2021-03-10T16:29:36.002770+0000 mgr.gibba045.orlgmj (mgr.34412) 8493 : cluster [DBG] pgmap v4833: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:39.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:29:39 gibba015 bash[29377]: cluster 2021-03-10T16:29:38.004423+0000 mgr.gibba045.orlgmj (mgr.34412) 8494 : cluster [DBG] pgmap v4834: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:39.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:29:39 gibba015 bash[30343]: cluster 2021-03-10T16:29:38.004423+0000 mgr.gibba045.orlgmj (mgr.34412) 8494 : cluster [DBG] pgmap v4834: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:39.552 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:29:39 gibba045 bash[25517]: cluster 2021-03-10T16:29:38.004423+0000 mgr.gibba045.orlgmj (mgr.34412) 8494 : cluster [DBG] pgmap v4834: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:41.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:29:41 gibba015 bash[29377]: cluster 2021-03-10T16:29:40.005824+0000 mgr.gibba045.orlgmj (mgr.34412) 8495 : cluster [DBG] pgmap v4835: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:41.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:29:41 gibba015 bash[30343]: cluster 2021-03-10T16:29:40.005824+0000 mgr.gibba045.orlgmj (mgr.34412) 8495 : cluster [DBG] pgmap v4835: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:41.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:29:41 gibba045 bash[25517]: cluster 2021-03-10T16:29:40.005824+0000 mgr.gibba045.orlgmj (mgr.34412) 8495 : cluster [DBG] pgmap v4835: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:43.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:29:43 gibba045 bash[25517]: cluster 2021-03-10T16:29:42.007364+0000 mgr.gibba045.orlgmj (mgr.34412) 8496 : cluster [DBG] pgmap v4836: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:43.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:29:43 gibba015 bash[29377]: cluster 2021-03-10T16:29:42.007364+0000 mgr.gibba045.orlgmj (mgr.34412) 8496 : cluster [DBG] pgmap v4836: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:43.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:29:43 gibba015 bash[30343]: cluster 2021-03-10T16:29:42.007364+0000 mgr.gibba045.orlgmj (mgr.34412) 8496 : cluster [DBG] pgmap v4836: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:44.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:29:44 gibba045 bash[25517]: cephadm 2021-03-10T16:29:42.548631+0000 mgr.gibba045.orlgmj (mgr.34412) 8497 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:29:44.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:29:44 gibba015 bash[29377]: cephadm 2021-03-10T16:29:42.548631+0000 mgr.gibba045.orlgmj (mgr.34412) 8497 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:29:44.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:29:44 gibba015 bash[30343]: cephadm 2021-03-10T16:29:42.548631+0000 mgr.gibba045.orlgmj (mgr.34412) 8497 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:29:45.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:29:45 gibba045 bash[25517]: cluster 2021-03-10T16:29:44.008645+0000 mgr.gibba045.orlgmj (mgr.34412) 8498 : cluster [DBG] pgmap v4837: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:45.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:29:45 gibba015 bash[29377]: cluster 2021-03-10T16:29:44.008645+0000 mgr.gibba045.orlgmj (mgr.34412) 8498 : cluster [DBG] pgmap v4837: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:45.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:29:45 gibba015 bash[30343]: cluster 2021-03-10T16:29:44.008645+0000 mgr.gibba045.orlgmj (mgr.34412) 8498 : cluster [DBG] pgmap v4837: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:47.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:29:47 gibba045 bash[25517]: cluster 2021-03-10T16:29:46.010225+0000 mgr.gibba045.orlgmj (mgr.34412) 8499 : cluster [DBG] pgmap v4838: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:47.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:29:47 gibba015 bash[29377]: cluster 2021-03-10T16:29:46.010225+0000 mgr.gibba045.orlgmj (mgr.34412) 8499 : cluster [DBG] pgmap v4838: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:47.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:29:47 gibba015 bash[30343]: cluster 2021-03-10T16:29:46.010225+0000 mgr.gibba045.orlgmj (mgr.34412) 8499 : cluster [DBG] pgmap v4838: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:49.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:29:49 gibba045 bash[25517]: cluster 2021-03-10T16:29:48.011729+0000 mgr.gibba045.orlgmj (mgr.34412) 8500 : cluster [DBG] pgmap v4839: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:49.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:29:49 gibba015 bash[29377]: cluster 2021-03-10T16:29:48.011729+0000 mgr.gibba045.orlgmj (mgr.34412) 8500 : cluster [DBG] pgmap v4839: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:49.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:29:49 gibba015 bash[30343]: cluster 2021-03-10T16:29:48.011729+0000 mgr.gibba045.orlgmj (mgr.34412) 8500 : cluster [DBG] pgmap v4839: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:51.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:29:51 gibba045 bash[25517]: cluster 2021-03-10T16:29:50.012259+0000 mgr.gibba045.orlgmj (mgr.34412) 8501 : cluster [DBG] pgmap v4840: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:51.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:29:51 gibba015 bash[29377]: cluster 2021-03-10T16:29:50.012259+0000 mgr.gibba045.orlgmj (mgr.34412) 8501 : cluster [DBG] pgmap v4840: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:51.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:29:51 gibba015 bash[30343]: cluster 2021-03-10T16:29:50.012259+0000 mgr.gibba045.orlgmj (mgr.34412) 8501 : cluster [DBG] pgmap v4840: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:53.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:29:53 gibba045 bash[25517]: cluster 2021-03-10T16:29:52.013956+0000 mgr.gibba045.orlgmj (mgr.34412) 8502 : cluster [DBG] pgmap v4841: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:53.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:29:53 gibba015 bash[29377]: cluster 2021-03-10T16:29:52.013956+0000 mgr.gibba045.orlgmj (mgr.34412) 8502 : cluster [DBG] pgmap v4841: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:53.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:29:53 gibba015 bash[30343]: cluster 2021-03-10T16:29:52.013956+0000 mgr.gibba045.orlgmj (mgr.34412) 8502 : cluster [DBG] pgmap v4841: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:54.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:29:54 gibba045 bash[25517]: audit 2021-03-10T16:29:53.595500+0000 mon.c (mon.1) 2350 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:29:54.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:29:54 gibba045 bash[25517]: audit 2021-03-10T16:29:53.596122+0000 mon.c (mon.1) 2351 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:29:54.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:29:54 gibba045 bash[25517]: audit 2021-03-10T16:29:53.596617+0000 mon.a (mon.0) 1912 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:29:54.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:29:54 gibba045 bash[25517]: audit 2021-03-10T16:29:53.597756+0000 mon.a (mon.0) 1913 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:29:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:29:54 gibba045 bash[25517]: audit 2021-03-10T16:29:53.607044+0000 mon.c (mon.1) 2352 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T16:29:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:29:54 gibba045 bash[25517]: audit 2021-03-10T16:29:53.607739+0000 mon.c (mon.1) 2353 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:29:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:29:54 gibba045 bash[25517]: audit 2021-03-10T16:29:53.608171+0000 mon.a (mon.0) 1914 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T16:29:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:29:54 gibba045 bash[25517]: audit 2021-03-10T16:29:53.608423+0000 mon.c (mon.1) 2354 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:29:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:29:54 gibba045 bash[25517]: audit 2021-03-10T16:29:53.609097+0000 mon.c (mon.1) 2355 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:29:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:29:54 gibba045 bash[25517]: audit 2021-03-10T16:29:53.609674+0000 mon.a (mon.0) 1915 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:29:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:29:54 gibba045 bash[25517]: audit 2021-03-10T16:29:53.610972+0000 mon.a (mon.0) 1916 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:29:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:29:54 gibba045 bash[25517]: audit 2021-03-10T16:29:53.611763+0000 mon.a (mon.0) 1917 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:29:54.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:29:54 gibba015 bash[29377]: audit 2021-03-10T16:29:53.595500+0000 mon.c (mon.1) 2350 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:29:54.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:29:54 gibba015 bash[29377]: audit 2021-03-10T16:29:53.596122+0000 mon.c (mon.1) 2351 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:29:54.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:29:54 gibba015 bash[29377]: audit 2021-03-10T16:29:53.596617+0000 mon.a (mon.0) 1912 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:29:54.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:29:54 gibba015 bash[29377]: audit 2021-03-10T16:29:53.597756+0000 mon.a (mon.0) 1913 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:29:54.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:29:54 gibba015 bash[29377]: audit 2021-03-10T16:29:53.607044+0000 mon.c (mon.1) 2352 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T16:29:54.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:29:54 gibba015 bash[29377]: audit 2021-03-10T16:29:53.607739+0000 mon.c (mon.1) 2353 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:29:54.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:29:54 gibba015 bash[29377]: audit 2021-03-10T16:29:53.608171+0000 mon.a (mon.0) 1914 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T16:29:54.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:29:54 gibba015 bash[29377]: audit 2021-03-10T16:29:53.608423+0000 mon.c (mon.1) 2354 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:29:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:29:54 gibba015 bash[29377]: audit 2021-03-10T16:29:53.609097+0000 mon.c (mon.1) 2355 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:29:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:29:54 gibba015 bash[29377]: audit 2021-03-10T16:29:53.609674+0000 mon.a (mon.0) 1915 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:29:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:29:54 gibba015 bash[29377]: audit 2021-03-10T16:29:53.610972+0000 mon.a (mon.0) 1916 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:29:54.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:29:54 gibba015 bash[29377]: audit 2021-03-10T16:29:53.611763+0000 mon.a (mon.0) 1917 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:29:54.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:29:54 gibba015 bash[30343]: audit 2021-03-10T16:29:53.595500+0000 mon.c (mon.1) 2350 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:29:54.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:29:54 gibba015 bash[30343]: audit 2021-03-10T16:29:53.596122+0000 mon.c (mon.1) 2351 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:29:54.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:29:54 gibba015 bash[30343]: audit 2021-03-10T16:29:53.596617+0000 mon.a (mon.0) 1912 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:29:54.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:29:54 gibba015 bash[30343]: audit 2021-03-10T16:29:53.597756+0000 mon.a (mon.0) 1913 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:29:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:29:54 gibba015 bash[30343]: audit 2021-03-10T16:29:53.607044+0000 mon.c (mon.1) 2352 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T16:29:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:29:54 gibba015 bash[30343]: audit 2021-03-10T16:29:53.607739+0000 mon.c (mon.1) 2353 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:29:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:29:54 gibba015 bash[30343]: audit 2021-03-10T16:29:53.608171+0000 mon.a (mon.0) 1914 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T16:29:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:29:54 gibba015 bash[30343]: audit 2021-03-10T16:29:53.608423+0000 mon.c (mon.1) 2354 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:29:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:29:54 gibba015 bash[30343]: audit 2021-03-10T16:29:53.609097+0000 mon.c (mon.1) 2355 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:29:54.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:29:54 gibba015 bash[30343]: audit 2021-03-10T16:29:53.609674+0000 mon.a (mon.0) 1915 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:29:54.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:29:54 gibba015 bash[30343]: audit 2021-03-10T16:29:53.610972+0000 mon.a (mon.0) 1916 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:29:54.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:29:54 gibba015 bash[30343]: audit 2021-03-10T16:29:53.611763+0000 mon.a (mon.0) 1917 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:29:55.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:29:55 gibba045 bash[25517]: cluster 2021-03-10T16:29:54.015334+0000 mgr.gibba045.orlgmj (mgr.34412) 8503 : cluster [DBG] pgmap v4842: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:55.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:29:55 gibba015 bash[29377]: cluster 2021-03-10T16:29:54.015334+0000 mgr.gibba045.orlgmj (mgr.34412) 8503 : cluster [DBG] pgmap v4842: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:55.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:29:55 gibba015 bash[30343]: cluster 2021-03-10T16:29:54.015334+0000 mgr.gibba045.orlgmj (mgr.34412) 8503 : cluster [DBG] pgmap v4842: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:56.682 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:29:56.909 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:29:56.909 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 3m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:29:56.909 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 2m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:29:56.910 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:29:56.910 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:29:56.910 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:29:56.910 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:29:56.911 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:29:56.911 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:29:56.911 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 3m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:29:56.911 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 2m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:29:56.912 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:29:56.912 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:29:56.912 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:29:56.912 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:29:56.912 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:29:56.913 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:29:56.913 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:29:56.913 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:29:56.913 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 2m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:29:56.914 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 2m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:29:57.154 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:29:57.154 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:29:57.155 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:29:57.155 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:29:57.155 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:29:57.156 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:29:57.156 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:29:57.156 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:29:57.157 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:29:57.157 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:29:57.157 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:29:57.157 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:29:57.157 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:29:57.158 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:29:57.158 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:29:57.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:29:57 gibba045 bash[25517]: cluster 2021-03-10T16:29:56.017032+0000 mgr.gibba045.orlgmj (mgr.34412) 8504 : cluster [DBG] pgmap v4843: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:57.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:29:57 gibba045 bash[25517]: audit 2021-03-10T16:29:57.154973+0000 mon.a (mon.0) 1918 : audit [DBG] from='client.? 172.21.2.115:0/1390510206' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:29:57.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:29:57 gibba015 bash[29377]: cluster 2021-03-10T16:29:56.017032+0000 mgr.gibba045.orlgmj (mgr.34412) 8504 : cluster [DBG] pgmap v4843: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:57.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:29:57 gibba015 bash[29377]: audit 2021-03-10T16:29:57.154973+0000 mon.a (mon.0) 1918 : audit [DBG] from='client.? 172.21.2.115:0/1390510206' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:29:57.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:29:57 gibba015 bash[30343]: cluster 2021-03-10T16:29:56.017032+0000 mgr.gibba045.orlgmj (mgr.34412) 8504 : cluster [DBG] pgmap v4843: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:57.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:29:57 gibba015 bash[30343]: audit 2021-03-10T16:29:57.154973+0000 mon.a (mon.0) 1918 : audit [DBG] from='client.? 172.21.2.115:0/1390510206' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:29:58.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:29:58 gibba015 bash[29377]: audit 2021-03-10T16:29:56.676500+0000 mgr.gibba045.orlgmj (mgr.34412) 8505 : audit [DBG] from='client.59746 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:29:58.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:29:58 gibba015 bash[29377]: audit 2021-03-10T16:29:56.899377+0000 mgr.gibba045.orlgmj (mgr.34412) 8506 : audit [DBG] from='client.49764 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:29:58.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:29:58 gibba015 bash[30343]: audit 2021-03-10T16:29:56.676500+0000 mgr.gibba045.orlgmj (mgr.34412) 8505 : audit [DBG] from='client.59746 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:29:58.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:29:58 gibba015 bash[30343]: audit 2021-03-10T16:29:56.899377+0000 mgr.gibba045.orlgmj (mgr.34412) 8506 : audit [DBG] from='client.49764 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:29:58.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:29:58 gibba045 bash[25517]: audit 2021-03-10T16:29:56.676500+0000 mgr.gibba045.orlgmj (mgr.34412) 8505 : audit [DBG] from='client.59746 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:29:58.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:29:58 gibba045 bash[25517]: audit 2021-03-10T16:29:56.899377+0000 mgr.gibba045.orlgmj (mgr.34412) 8506 : audit [DBG] from='client.49764 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:29:59.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:29:59 gibba015 bash[29377]: cephadm 2021-03-10T16:29:57.564540+0000 mgr.gibba045.orlgmj (mgr.34412) 8507 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:29:59.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:29:59 gibba015 bash[29377]: cluster 2021-03-10T16:29:58.018671+0000 mgr.gibba045.orlgmj (mgr.34412) 8508 : cluster [DBG] pgmap v4844: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:59.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:29:59 gibba015 bash[30343]: cephadm 2021-03-10T16:29:57.564540+0000 mgr.gibba045.orlgmj (mgr.34412) 8507 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:29:59.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:29:59 gibba015 bash[30343]: cluster 2021-03-10T16:29:58.018671+0000 mgr.gibba045.orlgmj (mgr.34412) 8508 : cluster [DBG] pgmap v4844: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:59.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:29:59 gibba045 bash[25517]: cephadm 2021-03-10T16:29:57.564540+0000 mgr.gibba045.orlgmj (mgr.34412) 8507 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:29:59.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:29:59 gibba045 bash[25517]: cluster 2021-03-10T16:29:58.018671+0000 mgr.gibba045.orlgmj (mgr.34412) 8508 : cluster [DBG] pgmap v4844: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:00.336 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:30:00 gibba015 bash[29377]: debug 2021-03-10T16:29:59.994+0000 7f21beb4f700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T16:30:00.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:30:00 gibba015 bash[29377]: cluster 2021-03-10T16:30:00.000176+0000 mon.a (mon.0) 1919 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T16:30:00.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:30:00 gibba015 bash[30343]: cluster 2021-03-10T16:30:00.000176+0000 mon.a (mon.0) 1919 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T16:30:00.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:30:00 gibba045 bash[25517]: cluster 2021-03-10T16:30:00.000176+0000 mon.a (mon.0) 1919 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T16:30:01.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:30:01 gibba015 bash[29377]: cluster 2021-03-10T16:30:00.019457+0000 mgr.gibba045.orlgmj (mgr.34412) 8509 : cluster [DBG] pgmap v4845: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:01.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:30:01 gibba015 bash[30343]: cluster 2021-03-10T16:30:00.019457+0000 mgr.gibba045.orlgmj (mgr.34412) 8509 : cluster [DBG] pgmap v4845: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:01.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:30:01 gibba045 bash[25517]: cluster 2021-03-10T16:30:00.019457+0000 mgr.gibba045.orlgmj (mgr.34412) 8509 : cluster [DBG] pgmap v4845: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:03.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:30:03 gibba015 bash[29377]: cluster 2021-03-10T16:30:02.021131+0000 mgr.gibba045.orlgmj (mgr.34412) 8510 : cluster [DBG] pgmap v4846: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:03.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:30:03 gibba015 bash[30343]: cluster 2021-03-10T16:30:02.021131+0000 mgr.gibba045.orlgmj (mgr.34412) 8510 : cluster [DBG] pgmap v4846: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:03.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:30:03 gibba045 bash[25517]: cluster 2021-03-10T16:30:02.021131+0000 mgr.gibba045.orlgmj (mgr.34412) 8510 : cluster [DBG] pgmap v4846: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:05.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:30:05 gibba015 bash[29377]: cluster 2021-03-10T16:30:04.022302+0000 mgr.gibba045.orlgmj (mgr.34412) 8511 : cluster [DBG] pgmap v4847: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:05.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:30:05 gibba015 bash[30343]: cluster 2021-03-10T16:30:04.022302+0000 mgr.gibba045.orlgmj (mgr.34412) 8511 : cluster [DBG] pgmap v4847: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:05.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:30:05 gibba045 bash[25517]: cluster 2021-03-10T16:30:04.022302+0000 mgr.gibba045.orlgmj (mgr.34412) 8511 : cluster [DBG] pgmap v4847: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:07.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:30:07 gibba015 bash[29377]: cluster 2021-03-10T16:30:06.024141+0000 mgr.gibba045.orlgmj (mgr.34412) 8512 : cluster [DBG] pgmap v4848: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:07.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:30:07 gibba015 bash[30343]: cluster 2021-03-10T16:30:06.024141+0000 mgr.gibba045.orlgmj (mgr.34412) 8512 : cluster [DBG] pgmap v4848: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:07.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:30:07 gibba045 bash[25517]: cluster 2021-03-10T16:30:06.024141+0000 mgr.gibba045.orlgmj (mgr.34412) 8512 : cluster [DBG] pgmap v4848: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:09.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:30:09 gibba015 bash[29377]: cluster 2021-03-10T16:30:08.025812+0000 mgr.gibba045.orlgmj (mgr.34412) 8513 : cluster [DBG] pgmap v4849: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:09.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:30:09 gibba015 bash[30343]: cluster 2021-03-10T16:30:08.025812+0000 mgr.gibba045.orlgmj (mgr.34412) 8513 : cluster [DBG] pgmap v4849: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:09.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:30:09 gibba045 bash[25517]: cluster 2021-03-10T16:30:08.025812+0000 mgr.gibba045.orlgmj (mgr.34412) 8513 : cluster [DBG] pgmap v4849: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:11.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:30:11 gibba015 bash[29377]: cluster 2021-03-10T16:30:10.026708+0000 mgr.gibba045.orlgmj (mgr.34412) 8514 : cluster [DBG] pgmap v4850: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:11.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:30:11 gibba015 bash[30343]: cluster 2021-03-10T16:30:10.026708+0000 mgr.gibba045.orlgmj (mgr.34412) 8514 : cluster [DBG] pgmap v4850: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:11.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:30:11 gibba045 bash[25517]: cluster 2021-03-10T16:30:10.026708+0000 mgr.gibba045.orlgmj (mgr.34412) 8514 : cluster [DBG] pgmap v4850: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:13.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:30:13 gibba015 bash[29377]: cluster 2021-03-10T16:30:12.028237+0000 mgr.gibba045.orlgmj (mgr.34412) 8515 : cluster [DBG] pgmap v4851: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:13.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:30:13 gibba015 bash[30343]: cluster 2021-03-10T16:30:12.028237+0000 mgr.gibba045.orlgmj (mgr.34412) 8515 : cluster [DBG] pgmap v4851: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:13.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:30:13 gibba045 bash[25517]: cluster 2021-03-10T16:30:12.028237+0000 mgr.gibba045.orlgmj (mgr.34412) 8515 : cluster [DBG] pgmap v4851: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:14.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:30:14 gibba015 bash[29377]: cephadm 2021-03-10T16:30:12.569355+0000 mgr.gibba045.orlgmj (mgr.34412) 8516 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:30:14.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:30:14 gibba015 bash[30343]: cephadm 2021-03-10T16:30:12.569355+0000 mgr.gibba045.orlgmj (mgr.34412) 8516 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:30:14.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:30:14 gibba045 bash[25517]: cephadm 2021-03-10T16:30:12.569355+0000 mgr.gibba045.orlgmj (mgr.34412) 8516 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:30:15.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:30:15 gibba015 bash[29377]: cluster 2021-03-10T16:30:14.029467+0000 mgr.gibba045.orlgmj (mgr.34412) 8517 : cluster [DBG] pgmap v4852: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:15.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:30:15 gibba015 bash[30343]: cluster 2021-03-10T16:30:14.029467+0000 mgr.gibba045.orlgmj (mgr.34412) 8517 : cluster [DBG] pgmap v4852: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:15.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:30:15 gibba045 bash[25517]: cluster 2021-03-10T16:30:14.029467+0000 mgr.gibba045.orlgmj (mgr.34412) 8517 : cluster [DBG] pgmap v4852: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:17.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:30:17 gibba015 bash[29377]: cluster 2021-03-10T16:30:16.031326+0000 mgr.gibba045.orlgmj (mgr.34412) 8518 : cluster [DBG] pgmap v4853: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:17.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:30:17 gibba015 bash[30343]: cluster 2021-03-10T16:30:16.031326+0000 mgr.gibba045.orlgmj (mgr.34412) 8518 : cluster [DBG] pgmap v4853: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:17.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:30:17 gibba045 bash[25517]: cluster 2021-03-10T16:30:16.031326+0000 mgr.gibba045.orlgmj (mgr.34412) 8518 : cluster [DBG] pgmap v4853: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:19.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:30:19 gibba015 bash[29377]: cluster 2021-03-10T16:30:18.033191+0000 mgr.gibba045.orlgmj (mgr.34412) 8519 : cluster [DBG] pgmap v4854: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:19.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:30:19 gibba015 bash[30343]: cluster 2021-03-10T16:30:18.033191+0000 mgr.gibba045.orlgmj (mgr.34412) 8519 : cluster [DBG] pgmap v4854: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:19.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:30:19 gibba045 bash[25517]: cluster 2021-03-10T16:30:18.033191+0000 mgr.gibba045.orlgmj (mgr.34412) 8519 : cluster [DBG] pgmap v4854: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:21.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:30:21 gibba015 bash[29377]: cluster 2021-03-10T16:30:20.034000+0000 mgr.gibba045.orlgmj (mgr.34412) 8520 : cluster [DBG] pgmap v4855: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:21.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:30:21 gibba015 bash[30343]: cluster 2021-03-10T16:30:20.034000+0000 mgr.gibba045.orlgmj (mgr.34412) 8520 : cluster [DBG] pgmap v4855: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:21.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:30:21 gibba045 bash[25517]: cluster 2021-03-10T16:30:20.034000+0000 mgr.gibba045.orlgmj (mgr.34412) 8520 : cluster [DBG] pgmap v4855: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:23.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:30:23 gibba015 bash[29377]: cluster 2021-03-10T16:30:22.035699+0000 mgr.gibba045.orlgmj (mgr.34412) 8521 : cluster [DBG] pgmap v4856: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:23.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:30:23 gibba015 bash[30343]: cluster 2021-03-10T16:30:22.035699+0000 mgr.gibba045.orlgmj (mgr.34412) 8521 : cluster [DBG] pgmap v4856: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:23.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:30:23 gibba045 bash[25517]: cluster 2021-03-10T16:30:22.035699+0000 mgr.gibba045.orlgmj (mgr.34412) 8521 : cluster [DBG] pgmap v4856: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:25.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:30:25 gibba015 bash[29377]: cluster 2021-03-10T16:30:24.036944+0000 mgr.gibba045.orlgmj (mgr.34412) 8522 : cluster [DBG] pgmap v4857: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:25.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:30:25 gibba015 bash[30343]: cluster 2021-03-10T16:30:24.036944+0000 mgr.gibba045.orlgmj (mgr.34412) 8522 : cluster [DBG] pgmap v4857: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:25.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:30:25 gibba045 bash[25517]: cluster 2021-03-10T16:30:24.036944+0000 mgr.gibba045.orlgmj (mgr.34412) 8522 : cluster [DBG] pgmap v4857: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:27.395 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:30:27.617 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:30:27.618 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 4m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:30:27.618 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 3m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:30:27.618 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:30:27.618 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:30:27.618 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:30:27.619 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:30:27.619 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:30:27.619 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:30:27.619 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 4m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:30:27.620 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 3m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:30:27.620 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:30:27.620 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:30:27.620 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:30:27.620 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:30:27.621 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:30:27.621 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:30:27.621 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:30:27.621 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:30:27.621 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 3m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:30:27.622 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 3m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:30:27.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:30:27 gibba015 bash[29377]: cluster 2021-03-10T16:30:26.038767+0000 mgr.gibba045.orlgmj (mgr.34412) 8523 : cluster [DBG] pgmap v4858: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:27.719 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:30:27 gibba015 bash[30343]: cluster 2021-03-10T16:30:26.038767+0000 mgr.gibba045.orlgmj (mgr.34412) 8523 : cluster [DBG] pgmap v4858: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:27.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:30:27 gibba045 bash[25517]: cluster 2021-03-10T16:30:26.038767+0000 mgr.gibba045.orlgmj (mgr.34412) 8523 : cluster [DBG] pgmap v4858: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:27.872 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:30:27.873 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:30:27.873 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:30:27.873 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:30:27.873 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:30:27.874 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:30:27.874 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:30:27.874 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:30:27.875 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:30:27.875 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:30:27.875 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:30:27.875 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:30:27.875 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:30:27.876 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:30:27.876 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:30:28.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:30:28 gibba045 bash[25517]: audit 2021-03-10T16:30:27.389801+0000 mgr.gibba045.orlgmj (mgr.34412) 8524 : audit [DBG] from='client.59764 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:30:28.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:30:28 gibba045 bash[25517]: audit 2021-03-10T16:30:27.579088+0000 mon.c (mon.1) 2356 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:30:28.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:30:28 gibba045 bash[25517]: audit 2021-03-10T16:30:27.812382+0000 mon.a (mon.0) 1920 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:30:28.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:30:28 gibba045 bash[25517]: audit 2021-03-10T16:30:27.815807+0000 mon.c (mon.1) 2357 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:30:28.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:30:28 gibba045 bash[25517]: audit 2021-03-10T16:30:27.816950+0000 mon.c (mon.1) 2358 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:30:28.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:30:28 gibba045 bash[25517]: audit 2021-03-10T16:30:27.817943+0000 mon.c (mon.1) 2359 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:30:28.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:30:28 gibba045 bash[25517]: audit 2021-03-10T16:30:27.819032+0000 mon.c (mon.1) 2360 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:30:28.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:30:28 gibba045 bash[25517]: audit 2021-03-10T16:30:27.821245+0000 mon.c (mon.1) 2361 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:30:28.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:30:28 gibba045 bash[25517]: audit 2021-03-10T16:30:27.822614+0000 mon.c (mon.1) 2362 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:30:28.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:30:28 gibba045 bash[25517]: audit 2021-03-10T16:30:27.873245+0000 mon.a (mon.0) 1921 : audit [DBG] from='client.? 172.21.2.115:0/281693417' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:30:28.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:30:28 gibba015 bash[29377]: audit 2021-03-10T16:30:27.389801+0000 mgr.gibba045.orlgmj (mgr.34412) 8524 : audit [DBG] from='client.59764 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:30:28.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:30:28 gibba015 bash[29377]: audit 2021-03-10T16:30:27.579088+0000 mon.c (mon.1) 2356 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:30:28.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:30:28 gibba015 bash[29377]: audit 2021-03-10T16:30:27.812382+0000 mon.a (mon.0) 1920 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:30:28.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:30:28 gibba015 bash[29377]: audit 2021-03-10T16:30:27.815807+0000 mon.c (mon.1) 2357 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:30:28.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:30:28 gibba015 bash[29377]: audit 2021-03-10T16:30:27.816950+0000 mon.c (mon.1) 2358 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:30:28.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:30:28 gibba015 bash[29377]: audit 2021-03-10T16:30:27.817943+0000 mon.c (mon.1) 2359 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:30:28.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:30:28 gibba015 bash[29377]: audit 2021-03-10T16:30:27.819032+0000 mon.c (mon.1) 2360 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:30:28.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:30:28 gibba015 bash[29377]: audit 2021-03-10T16:30:27.821245+0000 mon.c (mon.1) 2361 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:30:28.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:30:28 gibba015 bash[29377]: audit 2021-03-10T16:30:27.822614+0000 mon.c (mon.1) 2362 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:30:28.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:30:28 gibba015 bash[29377]: audit 2021-03-10T16:30:27.873245+0000 mon.a (mon.0) 1921 : audit [DBG] from='client.? 172.21.2.115:0/281693417' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:30:28.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:30:28 gibba015 bash[30343]: audit 2021-03-10T16:30:27.389801+0000 mgr.gibba045.orlgmj (mgr.34412) 8524 : audit [DBG] from='client.59764 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:30:28.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:30:28 gibba015 bash[30343]: audit 2021-03-10T16:30:27.579088+0000 mon.c (mon.1) 2356 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:30:28.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:30:28 gibba015 bash[30343]: audit 2021-03-10T16:30:27.812382+0000 mon.a (mon.0) 1920 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:30:28.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:30:28 gibba015 bash[30343]: audit 2021-03-10T16:30:27.815807+0000 mon.c (mon.1) 2357 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:30:28.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:30:28 gibba015 bash[30343]: audit 2021-03-10T16:30:27.816950+0000 mon.c (mon.1) 2358 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:30:28.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:30:28 gibba015 bash[30343]: audit 2021-03-10T16:30:27.817943+0000 mon.c (mon.1) 2359 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:30:28.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:30:28 gibba015 bash[30343]: audit 2021-03-10T16:30:27.819032+0000 mon.c (mon.1) 2360 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:30:28.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:30:28 gibba015 bash[30343]: audit 2021-03-10T16:30:27.821245+0000 mon.c (mon.1) 2361 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:30:28.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:30:28 gibba015 bash[30343]: audit 2021-03-10T16:30:27.822614+0000 mon.c (mon.1) 2362 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:30:28.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:30:28 gibba015 bash[30343]: audit 2021-03-10T16:30:27.873245+0000 mon.a (mon.0) 1921 : audit [DBG] from='client.? 172.21.2.115:0/281693417' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:30:29.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:30:29 gibba045 bash[25517]: cephadm 2021-03-10T16:30:27.585223+0000 mgr.gibba045.orlgmj (mgr.34412) 8525 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:30:29.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:30:29 gibba045 bash[25517]: cephadm 2021-03-10T16:30:27.587262+0000 mgr.gibba045.orlgmj (mgr.34412) 8526 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:30:29.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:30:29 gibba045 bash[25517]: audit 2021-03-10T16:30:27.612636+0000 mgr.gibba045.orlgmj (mgr.34412) 8527 : audit [DBG] from='client.59770 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:30:29.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:30:29 gibba045 bash[25517]: cephadm 2021-03-10T16:30:27.817667+0000 mgr.gibba045.orlgmj (mgr.34412) 8528 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:30:29.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:30:29 gibba045 bash[25517]: cephadm 2021-03-10T16:30:27.819167+0000 mgr.gibba045.orlgmj (mgr.34412) 8529 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:30:29.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:30:29 gibba045 bash[25517]: cephadm 2021-03-10T16:30:27.820165+0000 mgr.gibba045.orlgmj (mgr.34412) 8530 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:30:29.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:30:29 gibba045 bash[25517]: cephadm 2021-03-10T16:30:27.820203+0000 mgr.gibba045.orlgmj (mgr.34412) 8531 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:30:29.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:30:29 gibba045 bash[25517]: cephadm 2021-03-10T16:30:27.821317+0000 mgr.gibba045.orlgmj (mgr.34412) 8532 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:30:29.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:30:29 gibba045 bash[25517]: cephadm 2021-03-10T16:30:27.821355+0000 mgr.gibba045.orlgmj (mgr.34412) 8533 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:30:29.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:30:29 gibba045 bash[25517]: cephadm 2021-03-10T16:30:27.822168+0000 mgr.gibba045.orlgmj (mgr.34412) 8534 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:30:29.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:30:29 gibba045 bash[25517]: cephadm 2021-03-10T16:30:27.823364+0000 mgr.gibba045.orlgmj (mgr.34412) 8535 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:30:29.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:30:29 gibba045 bash[25517]: cephadm 2021-03-10T16:30:27.823400+0000 mgr.gibba045.orlgmj (mgr.34412) 8536 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:30:29.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:30:29 gibba045 bash[25517]: cephadm 2021-03-10T16:30:27.824436+0000 mgr.gibba045.orlgmj (mgr.34412) 8537 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:30:29.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:30:29 gibba045 bash[25517]: cephadm 2021-03-10T16:30:27.824874+0000 mgr.gibba045.orlgmj (mgr.34412) 8538 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:30:29.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:30:29 gibba045 bash[25517]: cephadm 2021-03-10T16:30:27.826042+0000 mgr.gibba045.orlgmj (mgr.34412) 8539 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:30:29.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:30:29 gibba045 bash[25517]: cephadm 2021-03-10T16:30:27.826080+0000 mgr.gibba045.orlgmj (mgr.34412) 8540 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:30:29.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:30:29 gibba045 bash[25517]: cephadm 2021-03-10T16:30:27.826183+0000 mgr.gibba045.orlgmj (mgr.34412) 8541 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:30:29.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:30:29 gibba045 bash[25517]: cluster 2021-03-10T16:30:28.040522+0000 mgr.gibba045.orlgmj (mgr.34412) 8542 : cluster [DBG] pgmap v4859: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:29.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:30:29 gibba015 bash[29377]: cephadm 2021-03-10T16:30:27.585223+0000 mgr.gibba045.orlgmj (mgr.34412) 8525 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:30:29.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:30:29 gibba015 bash[29377]: cephadm 2021-03-10T16:30:27.587262+0000 mgr.gibba045.orlgmj (mgr.34412) 8526 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:30:29.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:30:29 gibba015 bash[29377]: audit 2021-03-10T16:30:27.612636+0000 mgr.gibba045.orlgmj (mgr.34412) 8527 : audit [DBG] from='client.59770 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:30:29.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:30:29 gibba015 bash[29377]: cephadm 2021-03-10T16:30:27.817667+0000 mgr.gibba045.orlgmj (mgr.34412) 8528 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:30:29.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:30:29 gibba015 bash[29377]: cephadm 2021-03-10T16:30:27.819167+0000 mgr.gibba045.orlgmj (mgr.34412) 8529 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:30:29.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:30:29 gibba015 bash[29377]: cephadm 2021-03-10T16:30:27.820165+0000 mgr.gibba045.orlgmj (mgr.34412) 8530 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:30:29.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:30:29 gibba015 bash[29377]: cephadm 2021-03-10T16:30:27.820203+0000 mgr.gibba045.orlgmj (mgr.34412) 8531 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:30:29.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:30:29 gibba015 bash[29377]: cephadm 2021-03-10T16:30:27.821317+0000 mgr.gibba045.orlgmj (mgr.34412) 8532 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:30:29.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:30:29 gibba015 bash[29377]: cephadm 2021-03-10T16:30:27.821355+0000 mgr.gibba045.orlgmj (mgr.34412) 8533 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:30:29.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:30:29 gibba015 bash[29377]: cephadm 2021-03-10T16:30:27.822168+0000 mgr.gibba045.orlgmj (mgr.34412) 8534 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:30:29.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:30:29 gibba015 bash[29377]: cephadm 2021-03-10T16:30:27.823364+0000 mgr.gibba045.orlgmj (mgr.34412) 8535 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:30:29.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:30:29 gibba015 bash[29377]: cephadm 2021-03-10T16:30:27.823400+0000 mgr.gibba045.orlgmj (mgr.34412) 8536 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:30:29.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:30:29 gibba015 bash[29377]: cephadm 2021-03-10T16:30:27.824436+0000 mgr.gibba045.orlgmj (mgr.34412) 8537 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:30:29.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:30:29 gibba015 bash[29377]: cephadm 2021-03-10T16:30:27.824874+0000 mgr.gibba045.orlgmj (mgr.34412) 8538 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:30:29.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:30:29 gibba015 bash[29377]: cephadm 2021-03-10T16:30:27.826042+0000 mgr.gibba045.orlgmj (mgr.34412) 8539 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:30:29.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:30:29 gibba015 bash[29377]: cephadm 2021-03-10T16:30:27.826080+0000 mgr.gibba045.orlgmj (mgr.34412) 8540 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:30:29.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:30:29 gibba015 bash[29377]: cephadm 2021-03-10T16:30:27.826183+0000 mgr.gibba045.orlgmj (mgr.34412) 8541 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:30:29.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:30:29 gibba015 bash[29377]: cluster 2021-03-10T16:30:28.040522+0000 mgr.gibba045.orlgmj (mgr.34412) 8542 : cluster [DBG] pgmap v4859: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:29.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:30:29 gibba015 bash[30343]: cephadm 2021-03-10T16:30:27.585223+0000 mgr.gibba045.orlgmj (mgr.34412) 8525 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:30:29.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:30:29 gibba015 bash[30343]: cephadm 2021-03-10T16:30:27.587262+0000 mgr.gibba045.orlgmj (mgr.34412) 8526 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:30:29.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:30:29 gibba015 bash[30343]: audit 2021-03-10T16:30:27.612636+0000 mgr.gibba045.orlgmj (mgr.34412) 8527 : audit [DBG] from='client.59770 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:30:29.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:30:29 gibba015 bash[30343]: cephadm 2021-03-10T16:30:27.817667+0000 mgr.gibba045.orlgmj (mgr.34412) 8528 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:30:29.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:30:29 gibba015 bash[30343]: cephadm 2021-03-10T16:30:27.819167+0000 mgr.gibba045.orlgmj (mgr.34412) 8529 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:30:29.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:30:29 gibba015 bash[30343]: cephadm 2021-03-10T16:30:27.820165+0000 mgr.gibba045.orlgmj (mgr.34412) 8530 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:30:29.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:30:29 gibba015 bash[30343]: cephadm 2021-03-10T16:30:27.820203+0000 mgr.gibba045.orlgmj (mgr.34412) 8531 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:30:29.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:30:29 gibba015 bash[30343]: cephadm 2021-03-10T16:30:27.821317+0000 mgr.gibba045.orlgmj (mgr.34412) 8532 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:30:29.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:30:29 gibba015 bash[30343]: cephadm 2021-03-10T16:30:27.821355+0000 mgr.gibba045.orlgmj (mgr.34412) 8533 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:30:29.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:30:29 gibba015 bash[30343]: cephadm 2021-03-10T16:30:27.822168+0000 mgr.gibba045.orlgmj (mgr.34412) 8534 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:30:29.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:30:29 gibba015 bash[30343]: cephadm 2021-03-10T16:30:27.823364+0000 mgr.gibba045.orlgmj (mgr.34412) 8535 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:30:29.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:30:29 gibba015 bash[30343]: cephadm 2021-03-10T16:30:27.823400+0000 mgr.gibba045.orlgmj (mgr.34412) 8536 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:30:29.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:30:29 gibba015 bash[30343]: cephadm 2021-03-10T16:30:27.824436+0000 mgr.gibba045.orlgmj (mgr.34412) 8537 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:30:29.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:30:29 gibba015 bash[30343]: cephadm 2021-03-10T16:30:27.824874+0000 mgr.gibba045.orlgmj (mgr.34412) 8538 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:30:29.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:30:29 gibba015 bash[30343]: cephadm 2021-03-10T16:30:27.826042+0000 mgr.gibba045.orlgmj (mgr.34412) 8539 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:30:29.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:30:29 gibba015 bash[30343]: cephadm 2021-03-10T16:30:27.826080+0000 mgr.gibba045.orlgmj (mgr.34412) 8540 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:30:29.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:30:29 gibba015 bash[30343]: cephadm 2021-03-10T16:30:27.826183+0000 mgr.gibba045.orlgmj (mgr.34412) 8541 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:30:29.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:30:29 gibba015 bash[30343]: cluster 2021-03-10T16:30:28.040522+0000 mgr.gibba045.orlgmj (mgr.34412) 8542 : cluster [DBG] pgmap v4859: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:31.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:30:31 gibba045 bash[25517]: cluster 2021-03-10T16:30:30.041418+0000 mgr.gibba045.orlgmj (mgr.34412) 8543 : cluster [DBG] pgmap v4860: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:31.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:30:31 gibba015 bash[29377]: cluster 2021-03-10T16:30:30.041418+0000 mgr.gibba045.orlgmj (mgr.34412) 8543 : cluster [DBG] pgmap v4860: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:31.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:30:31 gibba015 bash[30343]: cluster 2021-03-10T16:30:30.041418+0000 mgr.gibba045.orlgmj (mgr.34412) 8543 : cluster [DBG] pgmap v4860: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:33.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:30:33 gibba045 bash[25517]: cluster 2021-03-10T16:30:32.043141+0000 mgr.gibba045.orlgmj (mgr.34412) 8544 : cluster [DBG] pgmap v4861: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:33.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:30:33 gibba015 bash[29377]: cluster 2021-03-10T16:30:32.043141+0000 mgr.gibba045.orlgmj (mgr.34412) 8544 : cluster [DBG] pgmap v4861: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:33.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:30:33 gibba015 bash[30343]: cluster 2021-03-10T16:30:32.043141+0000 mgr.gibba045.orlgmj (mgr.34412) 8544 : cluster [DBG] pgmap v4861: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:35.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:30:35 gibba045 bash[25517]: cluster 2021-03-10T16:30:34.044293+0000 mgr.gibba045.orlgmj (mgr.34412) 8545 : cluster [DBG] pgmap v4862: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:35.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:30:35 gibba015 bash[29377]: cluster 2021-03-10T16:30:34.044293+0000 mgr.gibba045.orlgmj (mgr.34412) 8545 : cluster [DBG] pgmap v4862: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:35.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:30:35 gibba015 bash[30343]: cluster 2021-03-10T16:30:34.044293+0000 mgr.gibba045.orlgmj (mgr.34412) 8545 : cluster [DBG] pgmap v4862: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:37.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:30:37 gibba015 bash[29377]: cluster 2021-03-10T16:30:36.045965+0000 mgr.gibba045.orlgmj (mgr.34412) 8546 : cluster [DBG] pgmap v4863: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:37.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:30:37 gibba015 bash[30343]: cluster 2021-03-10T16:30:36.045965+0000 mgr.gibba045.orlgmj (mgr.34412) 8546 : cluster [DBG] pgmap v4863: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:37.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:30:37 gibba045 bash[25517]: cluster 2021-03-10T16:30:36.045965+0000 mgr.gibba045.orlgmj (mgr.34412) 8546 : cluster [DBG] pgmap v4863: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:39.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:30:39 gibba015 bash[29377]: cluster 2021-03-10T16:30:38.047598+0000 mgr.gibba045.orlgmj (mgr.34412) 8547 : cluster [DBG] pgmap v4864: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:39.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:30:39 gibba015 bash[30343]: cluster 2021-03-10T16:30:38.047598+0000 mgr.gibba045.orlgmj (mgr.34412) 8547 : cluster [DBG] pgmap v4864: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:39.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:30:39 gibba045 bash[25517]: cluster 2021-03-10T16:30:38.047598+0000 mgr.gibba045.orlgmj (mgr.34412) 8547 : cluster [DBG] pgmap v4864: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:41.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:30:41 gibba015 bash[29377]: cluster 2021-03-10T16:30:40.048444+0000 mgr.gibba045.orlgmj (mgr.34412) 8548 : cluster [DBG] pgmap v4865: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:41.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:30:41 gibba015 bash[30343]: cluster 2021-03-10T16:30:40.048444+0000 mgr.gibba045.orlgmj (mgr.34412) 8548 : cluster [DBG] pgmap v4865: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:41.552 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:30:41 gibba045 bash[25517]: cluster 2021-03-10T16:30:40.048444+0000 mgr.gibba045.orlgmj (mgr.34412) 8548 : cluster [DBG] pgmap v4865: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:43.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:30:43 gibba015 bash[29377]: cluster 2021-03-10T16:30:42.050083+0000 mgr.gibba045.orlgmj (mgr.34412) 8549 : cluster [DBG] pgmap v4866: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:43.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:30:43 gibba015 bash[30343]: cluster 2021-03-10T16:30:42.050083+0000 mgr.gibba045.orlgmj (mgr.34412) 8549 : cluster [DBG] pgmap v4866: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:43.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:30:43 gibba045 bash[25517]: cluster 2021-03-10T16:30:42.050083+0000 mgr.gibba045.orlgmj (mgr.34412) 8549 : cluster [DBG] pgmap v4866: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:44.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:30:44 gibba015 bash[29377]: cephadm 2021-03-10T16:30:42.842233+0000 mgr.gibba045.orlgmj (mgr.34412) 8550 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:30:44.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:30:44 gibba015 bash[30343]: cephadm 2021-03-10T16:30:42.842233+0000 mgr.gibba045.orlgmj (mgr.34412) 8550 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:30:44.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:30:44 gibba045 bash[25517]: cephadm 2021-03-10T16:30:42.842233+0000 mgr.gibba045.orlgmj (mgr.34412) 8550 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:30:45.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:30:45 gibba015 bash[29377]: cluster 2021-03-10T16:30:44.051334+0000 mgr.gibba045.orlgmj (mgr.34412) 8551 : cluster [DBG] pgmap v4867: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:45.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:30:45 gibba015 bash[30343]: cluster 2021-03-10T16:30:44.051334+0000 mgr.gibba045.orlgmj (mgr.34412) 8551 : cluster [DBG] pgmap v4867: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:45.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:30:45 gibba045 bash[25517]: cluster 2021-03-10T16:30:44.051334+0000 mgr.gibba045.orlgmj (mgr.34412) 8551 : cluster [DBG] pgmap v4867: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:47.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:30:47 gibba015 bash[29377]: cluster 2021-03-10T16:30:46.053111+0000 mgr.gibba045.orlgmj (mgr.34412) 8552 : cluster [DBG] pgmap v4868: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:47.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:30:47 gibba015 bash[30343]: cluster 2021-03-10T16:30:46.053111+0000 mgr.gibba045.orlgmj (mgr.34412) 8552 : cluster [DBG] pgmap v4868: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:47.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:30:47 gibba045 bash[25517]: cluster 2021-03-10T16:30:46.053111+0000 mgr.gibba045.orlgmj (mgr.34412) 8552 : cluster [DBG] pgmap v4868: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:49.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:30:49 gibba015 bash[29377]: cluster 2021-03-10T16:30:48.054642+0000 mgr.gibba045.orlgmj (mgr.34412) 8553 : cluster [DBG] pgmap v4869: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:49.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:30:49 gibba015 bash[30343]: cluster 2021-03-10T16:30:48.054642+0000 mgr.gibba045.orlgmj (mgr.34412) 8553 : cluster [DBG] pgmap v4869: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:49.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:30:49 gibba045 bash[25517]: cluster 2021-03-10T16:30:48.054642+0000 mgr.gibba045.orlgmj (mgr.34412) 8553 : cluster [DBG] pgmap v4869: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:51.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:30:51 gibba045 bash[25517]: cluster 2021-03-10T16:30:50.055136+0000 mgr.gibba045.orlgmj (mgr.34412) 8554 : cluster [DBG] pgmap v4870: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:51.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:30:51 gibba015 bash[29377]: cluster 2021-03-10T16:30:50.055136+0000 mgr.gibba045.orlgmj (mgr.34412) 8554 : cluster [DBG] pgmap v4870: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:51.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:30:51 gibba015 bash[30343]: cluster 2021-03-10T16:30:50.055136+0000 mgr.gibba045.orlgmj (mgr.34412) 8554 : cluster [DBG] pgmap v4870: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:53.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:30:53 gibba045 bash[25517]: cluster 2021-03-10T16:30:52.056711+0000 mgr.gibba045.orlgmj (mgr.34412) 8555 : cluster [DBG] pgmap v4871: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:53.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:30:53 gibba015 bash[29377]: cluster 2021-03-10T16:30:52.056711+0000 mgr.gibba045.orlgmj (mgr.34412) 8555 : cluster [DBG] pgmap v4871: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:53.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:30:53 gibba015 bash[30343]: cluster 2021-03-10T16:30:52.056711+0000 mgr.gibba045.orlgmj (mgr.34412) 8555 : cluster [DBG] pgmap v4871: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:54.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:30:54 gibba045 bash[25517]: audit 2021-03-10T16:30:53.602400+0000 mon.c (mon.1) 2363 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:30:54.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:30:54 gibba045 bash[25517]: audit 2021-03-10T16:30:53.603025+0000 mon.c (mon.1) 2364 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:30:54.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:30:54 gibba045 bash[25517]: audit 2021-03-10T16:30:53.603627+0000 mon.a (mon.0) 1922 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:30:54.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:30:54 gibba045 bash[25517]: audit 2021-03-10T16:30:53.604873+0000 mon.a (mon.0) 1923 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:30:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:30:54 gibba045 bash[25517]: audit 2021-03-10T16:30:53.613563+0000 mon.c (mon.1) 2365 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T16:30:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:30:54 gibba045 bash[25517]: audit 2021-03-10T16:30:53.614289+0000 mon.c (mon.1) 2366 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:30:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:30:54 gibba045 bash[25517]: audit 2021-03-10T16:30:53.614689+0000 mon.a (mon.0) 1924 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T16:30:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:30:54 gibba045 bash[25517]: audit 2021-03-10T16:30:53.614966+0000 mon.c (mon.1) 2367 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:30:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:30:54 gibba045 bash[25517]: audit 2021-03-10T16:30:53.615640+0000 mon.c (mon.1) 2368 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:30:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:30:54 gibba045 bash[25517]: audit 2021-03-10T16:30:53.616506+0000 mon.a (mon.0) 1925 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:30:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:30:54 gibba045 bash[25517]: audit 2021-03-10T16:30:53.617603+0000 mon.a (mon.0) 1926 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:30:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:30:54 gibba045 bash[25517]: audit 2021-03-10T16:30:53.618413+0000 mon.a (mon.0) 1927 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:30:54.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:30:54 gibba015 bash[29377]: audit 2021-03-10T16:30:53.602400+0000 mon.c (mon.1) 2363 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:30:54.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:30:54 gibba015 bash[29377]: audit 2021-03-10T16:30:53.603025+0000 mon.c (mon.1) 2364 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:30:54.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:30:54 gibba015 bash[29377]: audit 2021-03-10T16:30:53.603627+0000 mon.a (mon.0) 1922 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:30:54.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:30:54 gibba015 bash[29377]: audit 2021-03-10T16:30:53.604873+0000 mon.a (mon.0) 1923 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:30:54.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:30:54 gibba015 bash[29377]: audit 2021-03-10T16:30:53.613563+0000 mon.c (mon.1) 2365 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T16:30:54.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:30:54 gibba015 bash[29377]: audit 2021-03-10T16:30:53.614289+0000 mon.c (mon.1) 2366 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:30:54.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:30:54 gibba015 bash[29377]: audit 2021-03-10T16:30:53.614689+0000 mon.a (mon.0) 1924 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T16:30:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:30:54 gibba015 bash[29377]: audit 2021-03-10T16:30:53.614966+0000 mon.c (mon.1) 2367 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:30:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:30:54 gibba015 bash[29377]: audit 2021-03-10T16:30:53.615640+0000 mon.c (mon.1) 2368 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:30:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:30:54 gibba015 bash[29377]: audit 2021-03-10T16:30:53.616506+0000 mon.a (mon.0) 1925 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:30:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:30:54 gibba015 bash[29377]: audit 2021-03-10T16:30:53.617603+0000 mon.a (mon.0) 1926 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:30:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:30:54 gibba015 bash[29377]: audit 2021-03-10T16:30:53.618413+0000 mon.a (mon.0) 1927 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:30:54.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:30:54 gibba015 bash[30343]: audit 2021-03-10T16:30:53.602400+0000 mon.c (mon.1) 2363 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:30:54.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:30:54 gibba015 bash[30343]: audit 2021-03-10T16:30:53.603025+0000 mon.c (mon.1) 2364 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:30:54.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:30:54 gibba015 bash[30343]: audit 2021-03-10T16:30:53.603627+0000 mon.a (mon.0) 1922 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:30:54.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:30:54 gibba015 bash[30343]: audit 2021-03-10T16:30:53.604873+0000 mon.a (mon.0) 1923 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:30:54.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:30:54 gibba015 bash[30343]: audit 2021-03-10T16:30:53.613563+0000 mon.c (mon.1) 2365 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T16:30:54.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:30:54 gibba015 bash[30343]: audit 2021-03-10T16:30:53.614289+0000 mon.c (mon.1) 2366 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:30:54.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:30:54 gibba015 bash[30343]: audit 2021-03-10T16:30:53.614689+0000 mon.a (mon.0) 1924 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T16:30:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:30:54 gibba015 bash[30343]: audit 2021-03-10T16:30:53.614966+0000 mon.c (mon.1) 2367 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:30:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:30:54 gibba015 bash[30343]: audit 2021-03-10T16:30:53.615640+0000 mon.c (mon.1) 2368 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:30:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:30:54 gibba015 bash[30343]: audit 2021-03-10T16:30:53.616506+0000 mon.a (mon.0) 1925 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:30:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:30:54 gibba015 bash[30343]: audit 2021-03-10T16:30:53.617603+0000 mon.a (mon.0) 1926 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:30:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:30:54 gibba015 bash[30343]: audit 2021-03-10T16:30:53.618413+0000 mon.a (mon.0) 1927 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:30:55.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:30:55 gibba045 bash[25517]: cluster 2021-03-10T16:30:54.057978+0000 mgr.gibba045.orlgmj (mgr.34412) 8556 : cluster [DBG] pgmap v4872: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:55.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:30:55 gibba015 bash[29377]: cluster 2021-03-10T16:30:54.057978+0000 mgr.gibba045.orlgmj (mgr.34412) 8556 : cluster [DBG] pgmap v4872: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:55.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:30:55 gibba015 bash[30343]: cluster 2021-03-10T16:30:54.057978+0000 mgr.gibba045.orlgmj (mgr.34412) 8556 : cluster [DBG] pgmap v4872: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:57.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:30:57 gibba045 bash[25517]: cluster 2021-03-10T16:30:56.059763+0000 mgr.gibba045.orlgmj (mgr.34412) 8557 : cluster [DBG] pgmap v4873: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:57.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:30:57 gibba015 bash[29377]: cluster 2021-03-10T16:30:56.059763+0000 mgr.gibba045.orlgmj (mgr.34412) 8557 : cluster [DBG] pgmap v4873: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:57.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:30:57 gibba015 bash[30343]: cluster 2021-03-10T16:30:56.059763+0000 mgr.gibba045.orlgmj (mgr.34412) 8557 : cluster [DBG] pgmap v4873: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:58.113 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:30:58.339 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:30:58.339 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 4m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:30:58.340 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 3m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:30:58.340 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:30:58.341 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:30:58.341 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:30:58.342 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:30:58.342 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:30:58.343 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:30:58.343 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 4m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:30:58.343 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 3m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:30:58.344 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:30:58.344 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:30:58.345 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:30:58.345 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:30:58.345 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:30:58.346 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:30:58.346 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:30:58.347 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:30:58.347 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 3m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:30:58.347 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 3m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:30:58.586 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:30:58.587 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:30:58.587 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:30:58.587 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:30:58.587 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:30:58.588 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:30:58.588 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:30:58.588 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:30:58.589 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:30:58.589 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:30:58.589 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:30:58.589 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:30:58.590 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:30:58.590 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:30:58.590 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:30:59.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:30:59 gibba045 bash[25517]: cephadm 2021-03-10T16:30:57.858297+0000 mgr.gibba045.orlgmj (mgr.34412) 8558 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:30:59.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:30:59 gibba045 bash[25517]: cluster 2021-03-10T16:30:58.061314+0000 mgr.gibba045.orlgmj (mgr.34412) 8559 : cluster [DBG] pgmap v4874: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:59.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:30:59 gibba045 bash[25517]: audit 2021-03-10T16:30:58.108165+0000 mgr.gibba045.orlgmj (mgr.34412) 8560 : audit [DBG] from='client.59782 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:30:59.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:30:59 gibba045 bash[25517]: audit 2021-03-10T16:30:58.330376+0000 mgr.gibba045.orlgmj (mgr.34412) 8561 : audit [DBG] from='client.49800 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:30:59.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:30:59 gibba045 bash[25517]: audit 2021-03-10T16:30:58.587279+0000 mon.a (mon.0) 1928 : audit [DBG] from='client.? 172.21.2.115:0/3317911167' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:30:59.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:30:59 gibba015 bash[29377]: cephadm 2021-03-10T16:30:57.858297+0000 mgr.gibba045.orlgmj (mgr.34412) 8558 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:30:59.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:30:59 gibba015 bash[29377]: cluster 2021-03-10T16:30:58.061314+0000 mgr.gibba045.orlgmj (mgr.34412) 8559 : cluster [DBG] pgmap v4874: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:59.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:30:59 gibba015 bash[29377]: audit 2021-03-10T16:30:58.108165+0000 mgr.gibba045.orlgmj (mgr.34412) 8560 : audit [DBG] from='client.59782 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:30:59.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:30:59 gibba015 bash[29377]: audit 2021-03-10T16:30:58.330376+0000 mgr.gibba045.orlgmj (mgr.34412) 8561 : audit [DBG] from='client.49800 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:30:59.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:30:59 gibba015 bash[29377]: audit 2021-03-10T16:30:58.587279+0000 mon.a (mon.0) 1928 : audit [DBG] from='client.? 172.21.2.115:0/3317911167' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:30:59.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:30:59 gibba015 bash[30343]: cephadm 2021-03-10T16:30:57.858297+0000 mgr.gibba045.orlgmj (mgr.34412) 8558 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:30:59.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:30:59 gibba015 bash[30343]: cluster 2021-03-10T16:30:58.061314+0000 mgr.gibba045.orlgmj (mgr.34412) 8559 : cluster [DBG] pgmap v4874: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:59.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:30:59 gibba015 bash[30343]: audit 2021-03-10T16:30:58.108165+0000 mgr.gibba045.orlgmj (mgr.34412) 8560 : audit [DBG] from='client.59782 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:30:59.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:30:59 gibba015 bash[30343]: audit 2021-03-10T16:30:58.330376+0000 mgr.gibba045.orlgmj (mgr.34412) 8561 : audit [DBG] from='client.49800 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:30:59.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:30:59 gibba015 bash[30343]: audit 2021-03-10T16:30:58.587279+0000 mon.a (mon.0) 1928 : audit [DBG] from='client.? 172.21.2.115:0/3317911167' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:31:01.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:31:01 gibba045 bash[25517]: cluster 2021-03-10T16:31:00.062437+0000 mgr.gibba045.orlgmj (mgr.34412) 8562 : cluster [DBG] pgmap v4875: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:01.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:31:01 gibba015 bash[29377]: cluster 2021-03-10T16:31:00.062437+0000 mgr.gibba045.orlgmj (mgr.34412) 8562 : cluster [DBG] pgmap v4875: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:01.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:31:01 gibba015 bash[30343]: cluster 2021-03-10T16:31:00.062437+0000 mgr.gibba045.orlgmj (mgr.34412) 8562 : cluster [DBG] pgmap v4875: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:03.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:31:03 gibba045 bash[25517]: cluster 2021-03-10T16:31:02.064055+0000 mgr.gibba045.orlgmj (mgr.34412) 8563 : cluster [DBG] pgmap v4876: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:03.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:31:03 gibba015 bash[29377]: cluster 2021-03-10T16:31:02.064055+0000 mgr.gibba045.orlgmj (mgr.34412) 8563 : cluster [DBG] pgmap v4876: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:03.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:31:03 gibba015 bash[30343]: cluster 2021-03-10T16:31:02.064055+0000 mgr.gibba045.orlgmj (mgr.34412) 8563 : cluster [DBG] pgmap v4876: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:05.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:31:05 gibba045 bash[25517]: cluster 2021-03-10T16:31:04.065488+0000 mgr.gibba045.orlgmj (mgr.34412) 8564 : cluster [DBG] pgmap v4877: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:05.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:31:05 gibba015 bash[29377]: cluster 2021-03-10T16:31:04.065488+0000 mgr.gibba045.orlgmj (mgr.34412) 8564 : cluster [DBG] pgmap v4877: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:05.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:31:05 gibba015 bash[30343]: cluster 2021-03-10T16:31:04.065488+0000 mgr.gibba045.orlgmj (mgr.34412) 8564 : cluster [DBG] pgmap v4877: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:07.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:31:07 gibba045 bash[25517]: cluster 2021-03-10T16:31:06.066273+0000 mgr.gibba045.orlgmj (mgr.34412) 8565 : cluster [DBG] pgmap v4878: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:07.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:31:07 gibba015 bash[29377]: cluster 2021-03-10T16:31:06.066273+0000 mgr.gibba045.orlgmj (mgr.34412) 8565 : cluster [DBG] pgmap v4878: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:07.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:31:07 gibba015 bash[30343]: cluster 2021-03-10T16:31:06.066273+0000 mgr.gibba045.orlgmj (mgr.34412) 8565 : cluster [DBG] pgmap v4878: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:09.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:31:09 gibba045 bash[25517]: cluster 2021-03-10T16:31:08.067754+0000 mgr.gibba045.orlgmj (mgr.34412) 8566 : cluster [DBG] pgmap v4879: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:09.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:31:09 gibba015 bash[29377]: cluster 2021-03-10T16:31:08.067754+0000 mgr.gibba045.orlgmj (mgr.34412) 8566 : cluster [DBG] pgmap v4879: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:09.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:31:09 gibba015 bash[30343]: cluster 2021-03-10T16:31:08.067754+0000 mgr.gibba045.orlgmj (mgr.34412) 8566 : cluster [DBG] pgmap v4879: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:11.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:31:11 gibba015 bash[29377]: cluster 2021-03-10T16:31:10.068828+0000 mgr.gibba045.orlgmj (mgr.34412) 8567 : cluster [DBG] pgmap v4880: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:11.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:31:11 gibba015 bash[30343]: cluster 2021-03-10T16:31:10.068828+0000 mgr.gibba045.orlgmj (mgr.34412) 8567 : cluster [DBG] pgmap v4880: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:11.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:31:11 gibba045 bash[25517]: cluster 2021-03-10T16:31:10.068828+0000 mgr.gibba045.orlgmj (mgr.34412) 8567 : cluster [DBG] pgmap v4880: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:13.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:31:13 gibba015 bash[29377]: cluster 2021-03-10T16:31:12.070304+0000 mgr.gibba045.orlgmj (mgr.34412) 8568 : cluster [DBG] pgmap v4881: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:13.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:31:13 gibba015 bash[30343]: cluster 2021-03-10T16:31:12.070304+0000 mgr.gibba045.orlgmj (mgr.34412) 8568 : cluster [DBG] pgmap v4881: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:13.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:31:13 gibba045 bash[25517]: cluster 2021-03-10T16:31:12.070304+0000 mgr.gibba045.orlgmj (mgr.34412) 8568 : cluster [DBG] pgmap v4881: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:14.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:31:14 gibba015 bash[29377]: cephadm 2021-03-10T16:31:12.869294+0000 mgr.gibba045.orlgmj (mgr.34412) 8569 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:31:14.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:31:14 gibba015 bash[30343]: cephadm 2021-03-10T16:31:12.869294+0000 mgr.gibba045.orlgmj (mgr.34412) 8569 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:31:14.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:31:14 gibba045 bash[25517]: cephadm 2021-03-10T16:31:12.869294+0000 mgr.gibba045.orlgmj (mgr.34412) 8569 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:31:15.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:31:15 gibba015 bash[29377]: cluster 2021-03-10T16:31:14.071493+0000 mgr.gibba045.orlgmj (mgr.34412) 8570 : cluster [DBG] pgmap v4882: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:15.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:31:15 gibba015 bash[30343]: cluster 2021-03-10T16:31:14.071493+0000 mgr.gibba045.orlgmj (mgr.34412) 8570 : cluster [DBG] pgmap v4882: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:15.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:31:15 gibba045 bash[25517]: cluster 2021-03-10T16:31:14.071493+0000 mgr.gibba045.orlgmj (mgr.34412) 8570 : cluster [DBG] pgmap v4882: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:17.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:31:17 gibba015 bash[29377]: cluster 2021-03-10T16:31:16.072990+0000 mgr.gibba045.orlgmj (mgr.34412) 8571 : cluster [DBG] pgmap v4883: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:17.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:31:17 gibba015 bash[30343]: cluster 2021-03-10T16:31:16.072990+0000 mgr.gibba045.orlgmj (mgr.34412) 8571 : cluster [DBG] pgmap v4883: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:17.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:31:17 gibba045 bash[25517]: cluster 2021-03-10T16:31:16.072990+0000 mgr.gibba045.orlgmj (mgr.34412) 8571 : cluster [DBG] pgmap v4883: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:19.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:31:19 gibba015 bash[29377]: cluster 2021-03-10T16:31:18.074341+0000 mgr.gibba045.orlgmj (mgr.34412) 8572 : cluster [DBG] pgmap v4884: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:19.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:31:19 gibba015 bash[30343]: cluster 2021-03-10T16:31:18.074341+0000 mgr.gibba045.orlgmj (mgr.34412) 8572 : cluster [DBG] pgmap v4884: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:19.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:31:19 gibba045 bash[25517]: cluster 2021-03-10T16:31:18.074341+0000 mgr.gibba045.orlgmj (mgr.34412) 8572 : cluster [DBG] pgmap v4884: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:21.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:31:21 gibba015 bash[29377]: cluster 2021-03-10T16:31:20.075312+0000 mgr.gibba045.orlgmj (mgr.34412) 8573 : cluster [DBG] pgmap v4885: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:21.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:31:21 gibba015 bash[30343]: cluster 2021-03-10T16:31:20.075312+0000 mgr.gibba045.orlgmj (mgr.34412) 8573 : cluster [DBG] pgmap v4885: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:21.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:31:21 gibba045 bash[25517]: cluster 2021-03-10T16:31:20.075312+0000 mgr.gibba045.orlgmj (mgr.34412) 8573 : cluster [DBG] pgmap v4885: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:23.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:31:23 gibba015 bash[29377]: cluster 2021-03-10T16:31:22.077016+0000 mgr.gibba045.orlgmj (mgr.34412) 8574 : cluster [DBG] pgmap v4886: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:23.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:31:23 gibba015 bash[30343]: cluster 2021-03-10T16:31:22.077016+0000 mgr.gibba045.orlgmj (mgr.34412) 8574 : cluster [DBG] pgmap v4886: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:23.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:31:23 gibba045 bash[25517]: cluster 2021-03-10T16:31:22.077016+0000 mgr.gibba045.orlgmj (mgr.34412) 8574 : cluster [DBG] pgmap v4886: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:25.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:31:25 gibba015 bash[29377]: cluster 2021-03-10T16:31:24.078241+0000 mgr.gibba045.orlgmj (mgr.34412) 8575 : cluster [DBG] pgmap v4887: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:25.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:31:25 gibba015 bash[30343]: cluster 2021-03-10T16:31:24.078241+0000 mgr.gibba045.orlgmj (mgr.34412) 8575 : cluster [DBG] pgmap v4887: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:25.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:31:25 gibba045 bash[25517]: cluster 2021-03-10T16:31:24.078241+0000 mgr.gibba045.orlgmj (mgr.34412) 8575 : cluster [DBG] pgmap v4887: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:27.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:31:27 gibba015 bash[29377]: cluster 2021-03-10T16:31:26.079976+0000 mgr.gibba045.orlgmj (mgr.34412) 8576 : cluster [DBG] pgmap v4888: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:27.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:31:27 gibba015 bash[30343]: cluster 2021-03-10T16:31:26.079976+0000 mgr.gibba045.orlgmj (mgr.34412) 8576 : cluster [DBG] pgmap v4888: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:27.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:31:27 gibba045 bash[25517]: cluster 2021-03-10T16:31:26.079976+0000 mgr.gibba045.orlgmj (mgr.34412) 8576 : cluster [DBG] pgmap v4888: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:28.719 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:31:28 gibba015 bash[30343]: audit 2021-03-10T16:31:27.889878+0000 mon.c (mon.1) 2369 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:31:28.719 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:31:28 gibba015 bash[30343]: audit 2021-03-10T16:31:28.097255+0000 mon.a (mon.0) 1929 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:31:28.719 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:31:28 gibba015 bash[30343]: audit 2021-03-10T16:31:28.101114+0000 mon.c (mon.1) 2370 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:31:28.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:31:28 gibba015 bash[30343]: audit 2021-03-10T16:31:28.102819+0000 mon.c (mon.1) 2371 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:31:28.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:31:28 gibba015 bash[30343]: audit 2021-03-10T16:31:28.104396+0000 mon.c (mon.1) 2372 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:31:28.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:31:28 gibba015 bash[30343]: audit 2021-03-10T16:31:28.106001+0000 mon.c (mon.1) 2373 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:31:28.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:31:28 gibba015 bash[30343]: audit 2021-03-10T16:31:28.108989+0000 mon.c (mon.1) 2374 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:31:28.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:31:28 gibba015 bash[30343]: audit 2021-03-10T16:31:28.110384+0000 mon.c (mon.1) 2375 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:31:28.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:31:28 gibba015 bash[29377]: audit 2021-03-10T16:31:27.889878+0000 mon.c (mon.1) 2369 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:31:28.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:31:28 gibba015 bash[29377]: audit 2021-03-10T16:31:28.097255+0000 mon.a (mon.0) 1929 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:31:28.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:31:28 gibba015 bash[29377]: audit 2021-03-10T16:31:28.101114+0000 mon.c (mon.1) 2370 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:31:28.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:31:28 gibba015 bash[29377]: audit 2021-03-10T16:31:28.102819+0000 mon.c (mon.1) 2371 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:31:28.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:31:28 gibba015 bash[29377]: audit 2021-03-10T16:31:28.104396+0000 mon.c (mon.1) 2372 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:31:28.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:31:28 gibba015 bash[29377]: audit 2021-03-10T16:31:28.106001+0000 mon.c (mon.1) 2373 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:31:28.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:31:28 gibba015 bash[29377]: audit 2021-03-10T16:31:28.108989+0000 mon.c (mon.1) 2374 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:31:28.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:31:28 gibba015 bash[29377]: audit 2021-03-10T16:31:28.110384+0000 mon.c (mon.1) 2375 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:31:28.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:31:28 gibba045 bash[25517]: audit 2021-03-10T16:31:27.889878+0000 mon.c (mon.1) 2369 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:31:28.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:31:28 gibba045 bash[25517]: audit 2021-03-10T16:31:28.097255+0000 mon.a (mon.0) 1929 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:31:28.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:31:28 gibba045 bash[25517]: audit 2021-03-10T16:31:28.101114+0000 mon.c (mon.1) 2370 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:31:28.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:31:28 gibba045 bash[25517]: audit 2021-03-10T16:31:28.102819+0000 mon.c (mon.1) 2371 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:31:28.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:31:28 gibba045 bash[25517]: audit 2021-03-10T16:31:28.104396+0000 mon.c (mon.1) 2372 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:31:28.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:31:28 gibba045 bash[25517]: audit 2021-03-10T16:31:28.106001+0000 mon.c (mon.1) 2373 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:31:28.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:31:28 gibba045 bash[25517]: audit 2021-03-10T16:31:28.108989+0000 mon.c (mon.1) 2374 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:31:28.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:31:28 gibba045 bash[25517]: audit 2021-03-10T16:31:28.110384+0000 mon.c (mon.1) 2375 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:31:28.828 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:31:29.054 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:31:29.055 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 5m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:31:29.055 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 4m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:31:29.055 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:31:29.055 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:31:29.056 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:31:29.056 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:31:29.056 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:31:29.056 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:31:29.057 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 5m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:31:29.057 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 4m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:31:29.058 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:31:29.058 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:31:29.058 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:31:29.059 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:31:29.059 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:31:29.060 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:31:29.060 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:31:29.060 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:31:29.061 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 4m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:31:29.061 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 4m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:31:29.304 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:31:29.305 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:31:29.305 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:31:29.305 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:31:29.305 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:31:29.306 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:31:29.306 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:31:29.306 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:31:29.306 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:31:29.307 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:31:29.307 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:31:29.307 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:31:29.307 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:31:29.307 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:31:29.308 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:31:29.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:31:29 gibba015 bash[29377]: cephadm 2021-03-10T16:31:27.894924+0000 mgr.gibba045.orlgmj (mgr.34412) 8577 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:31:29.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:31:29 gibba015 bash[29377]: cephadm 2021-03-10T16:31:27.895246+0000 mgr.gibba045.orlgmj (mgr.34412) 8578 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:31:29.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:31:29 gibba015 bash[29377]: cluster 2021-03-10T16:31:28.080564+0000 mgr.gibba045.orlgmj (mgr.34412) 8579 : cluster [DBG] pgmap v4889: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:29.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:31:29 gibba015 bash[29377]: cephadm 2021-03-10T16:31:28.102751+0000 mgr.gibba045.orlgmj (mgr.34412) 8580 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:31:29.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:31:29 gibba015 bash[29377]: cephadm 2021-03-10T16:31:28.104788+0000 mgr.gibba045.orlgmj (mgr.34412) 8581 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:31:29.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:31:29 gibba015 bash[29377]: cephadm 2021-03-10T16:31:28.106387+0000 mgr.gibba045.orlgmj (mgr.34412) 8582 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:31:29.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:31:29 gibba015 bash[29377]: cephadm 2021-03-10T16:31:28.106460+0000 mgr.gibba045.orlgmj (mgr.34412) 8583 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:31:29.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:31:29 gibba015 bash[29377]: cephadm 2021-03-10T16:31:28.107918+0000 mgr.gibba045.orlgmj (mgr.34412) 8584 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:31:29.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:31:29 gibba015 bash[29377]: cephadm 2021-03-10T16:31:28.107987+0000 mgr.gibba045.orlgmj (mgr.34412) 8585 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:31:29.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:31:29 gibba015 bash[29377]: cephadm 2021-03-10T16:31:28.109317+0000 mgr.gibba045.orlgmj (mgr.34412) 8586 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:31:29.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:31:29 gibba015 bash[29377]: cephadm 2021-03-10T16:31:28.110915+0000 mgr.gibba045.orlgmj (mgr.34412) 8587 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:31:29.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:31:29 gibba015 bash[29377]: cephadm 2021-03-10T16:31:28.110953+0000 mgr.gibba045.orlgmj (mgr.34412) 8588 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:31:29.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:31:29 gibba015 bash[29377]: cephadm 2021-03-10T16:31:28.112239+0000 mgr.gibba045.orlgmj (mgr.34412) 8589 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:31:29.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:31:29 gibba015 bash[29377]: cephadm 2021-03-10T16:31:28.112617+0000 mgr.gibba045.orlgmj (mgr.34412) 8590 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:31:29.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:31:29 gibba015 bash[29377]: cephadm 2021-03-10T16:31:28.113493+0000 mgr.gibba045.orlgmj (mgr.34412) 8591 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:31:29.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:31:29 gibba015 bash[29377]: cephadm 2021-03-10T16:31:28.113532+0000 mgr.gibba045.orlgmj (mgr.34412) 8592 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:31:29.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:31:29 gibba015 bash[29377]: cephadm 2021-03-10T16:31:28.113638+0000 mgr.gibba045.orlgmj (mgr.34412) 8593 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:31:29.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:31:29 gibba015 bash[29377]: audit 2021-03-10T16:31:29.305347+0000 mon.a (mon.0) 1930 : audit [DBG] from='client.? 172.21.2.115:0/2639417' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:31:29.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:31:29 gibba015 bash[30343]: cephadm 2021-03-10T16:31:27.894924+0000 mgr.gibba045.orlgmj (mgr.34412) 8577 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:31:29.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:31:29 gibba015 bash[30343]: cephadm 2021-03-10T16:31:27.895246+0000 mgr.gibba045.orlgmj (mgr.34412) 8578 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:31:29.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:31:29 gibba015 bash[30343]: cluster 2021-03-10T16:31:28.080564+0000 mgr.gibba045.orlgmj (mgr.34412) 8579 : cluster [DBG] pgmap v4889: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:29.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:31:29 gibba015 bash[30343]: cephadm 2021-03-10T16:31:28.102751+0000 mgr.gibba045.orlgmj (mgr.34412) 8580 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:31:29.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:31:29 gibba015 bash[30343]: cephadm 2021-03-10T16:31:28.104788+0000 mgr.gibba045.orlgmj (mgr.34412) 8581 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:31:29.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:31:29 gibba015 bash[30343]: cephadm 2021-03-10T16:31:28.106387+0000 mgr.gibba045.orlgmj (mgr.34412) 8582 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:31:29.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:31:29 gibba015 bash[30343]: cephadm 2021-03-10T16:31:28.106460+0000 mgr.gibba045.orlgmj (mgr.34412) 8583 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:31:29.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:31:29 gibba015 bash[30343]: cephadm 2021-03-10T16:31:28.107918+0000 mgr.gibba045.orlgmj (mgr.34412) 8584 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:31:29.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:31:29 gibba015 bash[30343]: cephadm 2021-03-10T16:31:28.107987+0000 mgr.gibba045.orlgmj (mgr.34412) 8585 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:31:29.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:31:29 gibba015 bash[30343]: cephadm 2021-03-10T16:31:28.109317+0000 mgr.gibba045.orlgmj (mgr.34412) 8586 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:31:29.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:31:29 gibba015 bash[30343]: cephadm 2021-03-10T16:31:28.110915+0000 mgr.gibba045.orlgmj (mgr.34412) 8587 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:31:29.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:31:29 gibba015 bash[30343]: cephadm 2021-03-10T16:31:28.110953+0000 mgr.gibba045.orlgmj (mgr.34412) 8588 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:31:29.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:31:29 gibba015 bash[30343]: cephadm 2021-03-10T16:31:28.112239+0000 mgr.gibba045.orlgmj (mgr.34412) 8589 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:31:29.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:31:29 gibba015 bash[30343]: cephadm 2021-03-10T16:31:28.112617+0000 mgr.gibba045.orlgmj (mgr.34412) 8590 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:31:29.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:31:29 gibba015 bash[30343]: cephadm 2021-03-10T16:31:28.113493+0000 mgr.gibba045.orlgmj (mgr.34412) 8591 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:31:29.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:31:29 gibba015 bash[30343]: cephadm 2021-03-10T16:31:28.113532+0000 mgr.gibba045.orlgmj (mgr.34412) 8592 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:31:29.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:31:29 gibba015 bash[30343]: cephadm 2021-03-10T16:31:28.113638+0000 mgr.gibba045.orlgmj (mgr.34412) 8593 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:31:29.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:31:29 gibba015 bash[30343]: audit 2021-03-10T16:31:29.305347+0000 mon.a (mon.0) 1930 : audit [DBG] from='client.? 172.21.2.115:0/2639417' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:31:29.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:31:29 gibba045 bash[25517]: cephadm 2021-03-10T16:31:27.894924+0000 mgr.gibba045.orlgmj (mgr.34412) 8577 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:31:29.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:31:29 gibba045 bash[25517]: cephadm 2021-03-10T16:31:27.895246+0000 mgr.gibba045.orlgmj (mgr.34412) 8578 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:31:29.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:31:29 gibba045 bash[25517]: cluster 2021-03-10T16:31:28.080564+0000 mgr.gibba045.orlgmj (mgr.34412) 8579 : cluster [DBG] pgmap v4889: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:29.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:31:29 gibba045 bash[25517]: cephadm 2021-03-10T16:31:28.102751+0000 mgr.gibba045.orlgmj (mgr.34412) 8580 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:31:29.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:31:29 gibba045 bash[25517]: cephadm 2021-03-10T16:31:28.104788+0000 mgr.gibba045.orlgmj (mgr.34412) 8581 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:31:29.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:31:29 gibba045 bash[25517]: cephadm 2021-03-10T16:31:28.106387+0000 mgr.gibba045.orlgmj (mgr.34412) 8582 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:31:29.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:31:29 gibba045 bash[25517]: cephadm 2021-03-10T16:31:28.106460+0000 mgr.gibba045.orlgmj (mgr.34412) 8583 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:31:29.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:31:29 gibba045 bash[25517]: cephadm 2021-03-10T16:31:28.107918+0000 mgr.gibba045.orlgmj (mgr.34412) 8584 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:31:29.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:31:29 gibba045 bash[25517]: cephadm 2021-03-10T16:31:28.107987+0000 mgr.gibba045.orlgmj (mgr.34412) 8585 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:31:29.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:31:29 gibba045 bash[25517]: cephadm 2021-03-10T16:31:28.109317+0000 mgr.gibba045.orlgmj (mgr.34412) 8586 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:31:29.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:31:29 gibba045 bash[25517]: cephadm 2021-03-10T16:31:28.110915+0000 mgr.gibba045.orlgmj (mgr.34412) 8587 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:31:29.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:31:29 gibba045 bash[25517]: cephadm 2021-03-10T16:31:28.110953+0000 mgr.gibba045.orlgmj (mgr.34412) 8588 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:31:29.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:31:29 gibba045 bash[25517]: cephadm 2021-03-10T16:31:28.112239+0000 mgr.gibba045.orlgmj (mgr.34412) 8589 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:31:29.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:31:29 gibba045 bash[25517]: cephadm 2021-03-10T16:31:28.112617+0000 mgr.gibba045.orlgmj (mgr.34412) 8590 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:31:29.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:31:29 gibba045 bash[25517]: cephadm 2021-03-10T16:31:28.113493+0000 mgr.gibba045.orlgmj (mgr.34412) 8591 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:31:29.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:31:29 gibba045 bash[25517]: cephadm 2021-03-10T16:31:28.113532+0000 mgr.gibba045.orlgmj (mgr.34412) 8592 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:31:29.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:31:29 gibba045 bash[25517]: cephadm 2021-03-10T16:31:28.113638+0000 mgr.gibba045.orlgmj (mgr.34412) 8593 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:31:29.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:31:29 gibba045 bash[25517]: audit 2021-03-10T16:31:29.305347+0000 mon.a (mon.0) 1930 : audit [DBG] from='client.? 172.21.2.115:0/2639417' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:31:30.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:31:30 gibba015 bash[29377]: audit 2021-03-10T16:31:28.822960+0000 mgr.gibba045.orlgmj (mgr.34412) 8594 : audit [DBG] from='client.59800 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:31:30.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:31:30 gibba015 bash[29377]: audit 2021-03-10T16:31:29.045001+0000 mgr.gibba045.orlgmj (mgr.34412) 8595 : audit [DBG] from='client.59806 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:31:30.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:31:30 gibba015 bash[30343]: audit 2021-03-10T16:31:28.822960+0000 mgr.gibba045.orlgmj (mgr.34412) 8594 : audit [DBG] from='client.59800 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:31:30.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:31:30 gibba015 bash[30343]: audit 2021-03-10T16:31:29.045001+0000 mgr.gibba045.orlgmj (mgr.34412) 8595 : audit [DBG] from='client.59806 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:31:30.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:31:30 gibba045 bash[25517]: audit 2021-03-10T16:31:28.822960+0000 mgr.gibba045.orlgmj (mgr.34412) 8594 : audit [DBG] from='client.59800 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:31:30.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:31:30 gibba045 bash[25517]: audit 2021-03-10T16:31:29.045001+0000 mgr.gibba045.orlgmj (mgr.34412) 8595 : audit [DBG] from='client.59806 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:31:31.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:31:31 gibba015 bash[29377]: cluster 2021-03-10T16:31:30.081475+0000 mgr.gibba045.orlgmj (mgr.34412) 8596 : cluster [DBG] pgmap v4890: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:31.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:31:31 gibba015 bash[30343]: cluster 2021-03-10T16:31:30.081475+0000 mgr.gibba045.orlgmj (mgr.34412) 8596 : cluster [DBG] pgmap v4890: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:31.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:31:31 gibba045 bash[25517]: cluster 2021-03-10T16:31:30.081475+0000 mgr.gibba045.orlgmj (mgr.34412) 8596 : cluster [DBG] pgmap v4890: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:33.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:31:33 gibba015 bash[29377]: cluster 2021-03-10T16:31:32.083145+0000 mgr.gibba045.orlgmj (mgr.34412) 8597 : cluster [DBG] pgmap v4891: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:33.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:31:33 gibba015 bash[30343]: cluster 2021-03-10T16:31:32.083145+0000 mgr.gibba045.orlgmj (mgr.34412) 8597 : cluster [DBG] pgmap v4891: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:33.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:31:33 gibba045 bash[25517]: cluster 2021-03-10T16:31:32.083145+0000 mgr.gibba045.orlgmj (mgr.34412) 8597 : cluster [DBG] pgmap v4891: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:35.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:31:35 gibba015 bash[29377]: cluster 2021-03-10T16:31:34.084514+0000 mgr.gibba045.orlgmj (mgr.34412) 8598 : cluster [DBG] pgmap v4892: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:35.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:31:35 gibba015 bash[30343]: cluster 2021-03-10T16:31:34.084514+0000 mgr.gibba045.orlgmj (mgr.34412) 8598 : cluster [DBG] pgmap v4892: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:35.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:31:35 gibba045 bash[25517]: cluster 2021-03-10T16:31:34.084514+0000 mgr.gibba045.orlgmj (mgr.34412) 8598 : cluster [DBG] pgmap v4892: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:37.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:31:37 gibba015 bash[29377]: cluster 2021-03-10T16:31:36.085986+0000 mgr.gibba045.orlgmj (mgr.34412) 8599 : cluster [DBG] pgmap v4893: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:37.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:31:37 gibba015 bash[30343]: cluster 2021-03-10T16:31:36.085986+0000 mgr.gibba045.orlgmj (mgr.34412) 8599 : cluster [DBG] pgmap v4893: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:37.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:31:37 gibba045 bash[25517]: cluster 2021-03-10T16:31:36.085986+0000 mgr.gibba045.orlgmj (mgr.34412) 8599 : cluster [DBG] pgmap v4893: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:39.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:31:39 gibba015 bash[29377]: cluster 2021-03-10T16:31:38.087526+0000 mgr.gibba045.orlgmj (mgr.34412) 8600 : cluster [DBG] pgmap v4894: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:39.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:31:39 gibba015 bash[30343]: cluster 2021-03-10T16:31:38.087526+0000 mgr.gibba045.orlgmj (mgr.34412) 8600 : cluster [DBG] pgmap v4894: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:39.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:31:39 gibba045 bash[25517]: cluster 2021-03-10T16:31:38.087526+0000 mgr.gibba045.orlgmj (mgr.34412) 8600 : cluster [DBG] pgmap v4894: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:41.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:31:41 gibba015 bash[29377]: cluster 2021-03-10T16:31:40.088801+0000 mgr.gibba045.orlgmj (mgr.34412) 8601 : cluster [DBG] pgmap v4895: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:41.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:31:41 gibba015 bash[30343]: cluster 2021-03-10T16:31:40.088801+0000 mgr.gibba045.orlgmj (mgr.34412) 8601 : cluster [DBG] pgmap v4895: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:41.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:31:41 gibba045 bash[25517]: cluster 2021-03-10T16:31:40.088801+0000 mgr.gibba045.orlgmj (mgr.34412) 8601 : cluster [DBG] pgmap v4895: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:43.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:31:43 gibba045 bash[25517]: cluster 2021-03-10T16:31:42.090548+0000 mgr.gibba045.orlgmj (mgr.34412) 8602 : cluster [DBG] pgmap v4896: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:43.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:31:43 gibba015 bash[29377]: cluster 2021-03-10T16:31:42.090548+0000 mgr.gibba045.orlgmj (mgr.34412) 8602 : cluster [DBG] pgmap v4896: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:43.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:31:43 gibba015 bash[30343]: cluster 2021-03-10T16:31:42.090548+0000 mgr.gibba045.orlgmj (mgr.34412) 8602 : cluster [DBG] pgmap v4896: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:44.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:31:44 gibba045 bash[25517]: cephadm 2021-03-10T16:31:43.129670+0000 mgr.gibba045.orlgmj (mgr.34412) 8603 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:31:44.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:31:44 gibba015 bash[29377]: cephadm 2021-03-10T16:31:43.129670+0000 mgr.gibba045.orlgmj (mgr.34412) 8603 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:31:44.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:31:44 gibba015 bash[30343]: cephadm 2021-03-10T16:31:43.129670+0000 mgr.gibba045.orlgmj (mgr.34412) 8603 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:31:45.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:31:45 gibba045 bash[25517]: cluster 2021-03-10T16:31:44.091764+0000 mgr.gibba045.orlgmj (mgr.34412) 8604 : cluster [DBG] pgmap v4897: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:45.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:31:45 gibba015 bash[29377]: cluster 2021-03-10T16:31:44.091764+0000 mgr.gibba045.orlgmj (mgr.34412) 8604 : cluster [DBG] pgmap v4897: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:45.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:31:45 gibba015 bash[30343]: cluster 2021-03-10T16:31:44.091764+0000 mgr.gibba045.orlgmj (mgr.34412) 8604 : cluster [DBG] pgmap v4897: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:47.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:31:47 gibba045 bash[25517]: cluster 2021-03-10T16:31:46.093468+0000 mgr.gibba045.orlgmj (mgr.34412) 8605 : cluster [DBG] pgmap v4898: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:47.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:31:47 gibba015 bash[29377]: cluster 2021-03-10T16:31:46.093468+0000 mgr.gibba045.orlgmj (mgr.34412) 8605 : cluster [DBG] pgmap v4898: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:47.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:31:47 gibba015 bash[30343]: cluster 2021-03-10T16:31:46.093468+0000 mgr.gibba045.orlgmj (mgr.34412) 8605 : cluster [DBG] pgmap v4898: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:49.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:31:49 gibba045 bash[25517]: cluster 2021-03-10T16:31:48.095067+0000 mgr.gibba045.orlgmj (mgr.34412) 8606 : cluster [DBG] pgmap v4899: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:49.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:31:49 gibba015 bash[29377]: cluster 2021-03-10T16:31:48.095067+0000 mgr.gibba045.orlgmj (mgr.34412) 8606 : cluster [DBG] pgmap v4899: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:49.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:31:49 gibba015 bash[30343]: cluster 2021-03-10T16:31:48.095067+0000 mgr.gibba045.orlgmj (mgr.34412) 8606 : cluster [DBG] pgmap v4899: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:51.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:31:51 gibba045 bash[25517]: cluster 2021-03-10T16:31:50.095942+0000 mgr.gibba045.orlgmj (mgr.34412) 8607 : cluster [DBG] pgmap v4900: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:51.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:31:51 gibba015 bash[29377]: cluster 2021-03-10T16:31:50.095942+0000 mgr.gibba045.orlgmj (mgr.34412) 8607 : cluster [DBG] pgmap v4900: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:51.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:31:51 gibba015 bash[30343]: cluster 2021-03-10T16:31:50.095942+0000 mgr.gibba045.orlgmj (mgr.34412) 8607 : cluster [DBG] pgmap v4900: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:53.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:31:53 gibba045 bash[25517]: cluster 2021-03-10T16:31:52.097584+0000 mgr.gibba045.orlgmj (mgr.34412) 8608 : cluster [DBG] pgmap v4901: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:53.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:31:53 gibba015 bash[29377]: cluster 2021-03-10T16:31:52.097584+0000 mgr.gibba045.orlgmj (mgr.34412) 8608 : cluster [DBG] pgmap v4901: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:53.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:31:53 gibba015 bash[30343]: cluster 2021-03-10T16:31:52.097584+0000 mgr.gibba045.orlgmj (mgr.34412) 8608 : cluster [DBG] pgmap v4901: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:54.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:31:54 gibba045 bash[25517]: audit 2021-03-10T16:31:53.611678+0000 mon.c (mon.1) 2376 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:31:54.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:31:54 gibba045 bash[25517]: audit 2021-03-10T16:31:53.612374+0000 mon.c (mon.1) 2377 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:31:54.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:31:54 gibba045 bash[25517]: audit 2021-03-10T16:31:53.612778+0000 mon.a (mon.0) 1931 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:31:54.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:31:54 gibba045 bash[25517]: audit 2021-03-10T16:31:53.614230+0000 mon.a (mon.0) 1932 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:31:54.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:31:54 gibba045 bash[25517]: audit 2021-03-10T16:31:53.626636+0000 mon.c (mon.1) 2378 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T16:31:54.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:31:54 gibba045 bash[25517]: audit 2021-03-10T16:31:53.627383+0000 mon.c (mon.1) 2379 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:31:54.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:31:54 gibba045 bash[25517]: audit 2021-03-10T16:31:53.627845+0000 mon.a (mon.0) 1933 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T16:31:54.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:31:54 gibba045 bash[25517]: audit 2021-03-10T16:31:53.628075+0000 mon.c (mon.1) 2380 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:31:54.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:31:54 gibba045 bash[25517]: audit 2021-03-10T16:31:53.628896+0000 mon.c (mon.1) 2381 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:31:54.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:31:54 gibba045 bash[25517]: audit 2021-03-10T16:31:53.629353+0000 mon.a (mon.0) 1934 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:31:54.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:31:54 gibba045 bash[25517]: audit 2021-03-10T16:31:53.630610+0000 mon.a (mon.0) 1935 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:31:54.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:31:54 gibba045 bash[25517]: audit 2021-03-10T16:31:53.631437+0000 mon.a (mon.0) 1936 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:31:54.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:31:54 gibba015 bash[29377]: audit 2021-03-10T16:31:53.611678+0000 mon.c (mon.1) 2376 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:31:54.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:31:54 gibba015 bash[29377]: audit 2021-03-10T16:31:53.612374+0000 mon.c (mon.1) 2377 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:31:54.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:31:54 gibba015 bash[29377]: audit 2021-03-10T16:31:53.612778+0000 mon.a (mon.0) 1931 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:31:54.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:31:54 gibba015 bash[29377]: audit 2021-03-10T16:31:53.614230+0000 mon.a (mon.0) 1932 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:31:54.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:31:54 gibba015 bash[29377]: audit 2021-03-10T16:31:53.626636+0000 mon.c (mon.1) 2378 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T16:31:54.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:31:54 gibba015 bash[29377]: audit 2021-03-10T16:31:53.627383+0000 mon.c (mon.1) 2379 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:31:54.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:31:54 gibba015 bash[29377]: audit 2021-03-10T16:31:53.627845+0000 mon.a (mon.0) 1933 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T16:31:54.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:31:54 gibba015 bash[29377]: audit 2021-03-10T16:31:53.628075+0000 mon.c (mon.1) 2380 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:31:54.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:31:54 gibba015 bash[29377]: audit 2021-03-10T16:31:53.628896+0000 mon.c (mon.1) 2381 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:31:54.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:31:54 gibba015 bash[29377]: audit 2021-03-10T16:31:53.629353+0000 mon.a (mon.0) 1934 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:31:54.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:31:54 gibba015 bash[29377]: audit 2021-03-10T16:31:53.630610+0000 mon.a (mon.0) 1935 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:31:54.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:31:54 gibba015 bash[29377]: audit 2021-03-10T16:31:53.631437+0000 mon.a (mon.0) 1936 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:31:54.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:31:54 gibba015 bash[30343]: audit 2021-03-10T16:31:53.611678+0000 mon.c (mon.1) 2376 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:31:54.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:31:54 gibba015 bash[30343]: audit 2021-03-10T16:31:53.612374+0000 mon.c (mon.1) 2377 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:31:54.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:31:54 gibba015 bash[30343]: audit 2021-03-10T16:31:53.612778+0000 mon.a (mon.0) 1931 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:31:54.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:31:54 gibba015 bash[30343]: audit 2021-03-10T16:31:53.614230+0000 mon.a (mon.0) 1932 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:31:54.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:31:54 gibba015 bash[30343]: audit 2021-03-10T16:31:53.626636+0000 mon.c (mon.1) 2378 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T16:31:54.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:31:54 gibba015 bash[30343]: audit 2021-03-10T16:31:53.627383+0000 mon.c (mon.1) 2379 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:31:54.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:31:54 gibba015 bash[30343]: audit 2021-03-10T16:31:53.627845+0000 mon.a (mon.0) 1933 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T16:31:54.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:31:54 gibba015 bash[30343]: audit 2021-03-10T16:31:53.628075+0000 mon.c (mon.1) 2380 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:31:54.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:31:54 gibba015 bash[30343]: audit 2021-03-10T16:31:53.628896+0000 mon.c (mon.1) 2381 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:31:54.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:31:54 gibba015 bash[30343]: audit 2021-03-10T16:31:53.629353+0000 mon.a (mon.0) 1934 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:31:54.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:31:54 gibba015 bash[30343]: audit 2021-03-10T16:31:53.630610+0000 mon.a (mon.0) 1935 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:31:54.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:31:54 gibba015 bash[30343]: audit 2021-03-10T16:31:53.631437+0000 mon.a (mon.0) 1936 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:31:55.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:31:55 gibba045 bash[25517]: cluster 2021-03-10T16:31:54.098807+0000 mgr.gibba045.orlgmj (mgr.34412) 8609 : cluster [DBG] pgmap v4902: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:55.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:31:55 gibba015 bash[29377]: cluster 2021-03-10T16:31:54.098807+0000 mgr.gibba045.orlgmj (mgr.34412) 8609 : cluster [DBG] pgmap v4902: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:55.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:31:55 gibba015 bash[30343]: cluster 2021-03-10T16:31:54.098807+0000 mgr.gibba045.orlgmj (mgr.34412) 8609 : cluster [DBG] pgmap v4902: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:57.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:31:57 gibba015 bash[29377]: cluster 2021-03-10T16:31:56.100582+0000 mgr.gibba045.orlgmj (mgr.34412) 8610 : cluster [DBG] pgmap v4903: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:57.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:31:57 gibba015 bash[30343]: cluster 2021-03-10T16:31:56.100582+0000 mgr.gibba045.orlgmj (mgr.34412) 8610 : cluster [DBG] pgmap v4903: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:57.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:31:57 gibba045 bash[25517]: cluster 2021-03-10T16:31:56.100582+0000 mgr.gibba045.orlgmj (mgr.34412) 8610 : cluster [DBG] pgmap v4903: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:59.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:31:59 gibba015 bash[29377]: cluster 2021-03-10T16:31:58.102226+0000 mgr.gibba045.orlgmj (mgr.34412) 8611 : cluster [DBG] pgmap v4904: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:59.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:31:59 gibba015 bash[29377]: cephadm 2021-03-10T16:31:58.145773+0000 mgr.gibba045.orlgmj (mgr.34412) 8612 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:31:59.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:31:59 gibba015 bash[30343]: cluster 2021-03-10T16:31:58.102226+0000 mgr.gibba045.orlgmj (mgr.34412) 8611 : cluster [DBG] pgmap v4904: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:59.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:31:59 gibba015 bash[30343]: cephadm 2021-03-10T16:31:58.145773+0000 mgr.gibba045.orlgmj (mgr.34412) 8612 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:31:59.550 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:31:59.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:31:59 gibba045 bash[25517]: cluster 2021-03-10T16:31:58.102226+0000 mgr.gibba045.orlgmj (mgr.34412) 8611 : cluster [DBG] pgmap v4904: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:59.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:31:59 gibba045 bash[25517]: cephadm 2021-03-10T16:31:58.145773+0000 mgr.gibba045.orlgmj (mgr.34412) 8612 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:31:59.781 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:31:59.781 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 5m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:31:59.781 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 4m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:31:59.782 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:31:59.782 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:31:59.782 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:31:59.782 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:31:59.787 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:31:59.787 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:31:59.787 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 5m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:31:59.788 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 4m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:31:59.788 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:31:59.788 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:31:59.788 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:31:59.789 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:31:59.789 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:31:59.789 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:31:59.789 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:31:59.790 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:31:59.790 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 4m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:31:59.790 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 4m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:32:00.031 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:32:00.031 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:32:00.031 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:32:00.032 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:32:00.032 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:32:00.032 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:32:00.032 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:32:00.033 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:32:00.033 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:32:00.033 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:32:00.033 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:32:00.033 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:32:00.034 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:32:00.034 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:32:00.034 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:32:00.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:32:00 gibba045 bash[25517]: audit 2021-03-10T16:32:00.031723+0000 mon.a (mon.0) 1937 : audit [DBG] from='client.? 172.21.2.115:0/71259868' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:32:00.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:32:00 gibba015 bash[29377]: audit 2021-03-10T16:32:00.031723+0000 mon.a (mon.0) 1937 : audit [DBG] from='client.? 172.21.2.115:0/71259868' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:32:00.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:32:00 gibba015 bash[30343]: audit 2021-03-10T16:32:00.031723+0000 mon.a (mon.0) 1937 : audit [DBG] from='client.? 172.21.2.115:0/71259868' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:32:01.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:32:01 gibba045 bash[25517]: audit 2021-03-10T16:31:59.544799+0000 mgr.gibba045.orlgmj (mgr.34412) 8613 : audit [DBG] from='client.59818 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:32:01.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:32:01 gibba045 bash[25517]: audit 2021-03-10T16:31:59.772646+0000 mgr.gibba045.orlgmj (mgr.34412) 8614 : audit [DBG] from='client.59824 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:32:01.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:32:01 gibba045 bash[25517]: cluster 2021-03-10T16:32:00.103922+0000 mgr.gibba045.orlgmj (mgr.34412) 8615 : cluster [DBG] pgmap v4905: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:01.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:32:01 gibba015 bash[29377]: audit 2021-03-10T16:31:59.544799+0000 mgr.gibba045.orlgmj (mgr.34412) 8613 : audit [DBG] from='client.59818 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:32:01.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:32:01 gibba015 bash[29377]: audit 2021-03-10T16:31:59.772646+0000 mgr.gibba045.orlgmj (mgr.34412) 8614 : audit [DBG] from='client.59824 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:32:01.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:32:01 gibba015 bash[29377]: cluster 2021-03-10T16:32:00.103922+0000 mgr.gibba045.orlgmj (mgr.34412) 8615 : cluster [DBG] pgmap v4905: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:01.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:32:01 gibba015 bash[30343]: audit 2021-03-10T16:31:59.544799+0000 mgr.gibba045.orlgmj (mgr.34412) 8613 : audit [DBG] from='client.59818 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:32:01.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:32:01 gibba015 bash[30343]: audit 2021-03-10T16:31:59.772646+0000 mgr.gibba045.orlgmj (mgr.34412) 8614 : audit [DBG] from='client.59824 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:32:01.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:32:01 gibba015 bash[30343]: cluster 2021-03-10T16:32:00.103922+0000 mgr.gibba045.orlgmj (mgr.34412) 8615 : cluster [DBG] pgmap v4905: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:03.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:32:03 gibba045 bash[25517]: cluster 2021-03-10T16:32:02.105660+0000 mgr.gibba045.orlgmj (mgr.34412) 8616 : cluster [DBG] pgmap v4906: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:03.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:32:03 gibba015 bash[29377]: cluster 2021-03-10T16:32:02.105660+0000 mgr.gibba045.orlgmj (mgr.34412) 8616 : cluster [DBG] pgmap v4906: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:03.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:32:03 gibba015 bash[30343]: cluster 2021-03-10T16:32:02.105660+0000 mgr.gibba045.orlgmj (mgr.34412) 8616 : cluster [DBG] pgmap v4906: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:05.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:32:05 gibba045 bash[25517]: cluster 2021-03-10T16:32:04.106846+0000 mgr.gibba045.orlgmj (mgr.34412) 8617 : cluster [DBG] pgmap v4907: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:05.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:32:05 gibba015 bash[29377]: cluster 2021-03-10T16:32:04.106846+0000 mgr.gibba045.orlgmj (mgr.34412) 8617 : cluster [DBG] pgmap v4907: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:05.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:32:05 gibba015 bash[30343]: cluster 2021-03-10T16:32:04.106846+0000 mgr.gibba045.orlgmj (mgr.34412) 8617 : cluster [DBG] pgmap v4907: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:07.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:32:07 gibba045 bash[25517]: cluster 2021-03-10T16:32:06.108666+0000 mgr.gibba045.orlgmj (mgr.34412) 8618 : cluster [DBG] pgmap v4908: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:07.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:32:07 gibba015 bash[29377]: cluster 2021-03-10T16:32:06.108666+0000 mgr.gibba045.orlgmj (mgr.34412) 8618 : cluster [DBG] pgmap v4908: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:07.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:32:07 gibba015 bash[30343]: cluster 2021-03-10T16:32:06.108666+0000 mgr.gibba045.orlgmj (mgr.34412) 8618 : cluster [DBG] pgmap v4908: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:09.552 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:32:09 gibba045 bash[25517]: cluster 2021-03-10T16:32:08.109971+0000 mgr.gibba045.orlgmj (mgr.34412) 8619 : cluster [DBG] pgmap v4909: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:09.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:32:09 gibba015 bash[29377]: cluster 2021-03-10T16:32:08.109971+0000 mgr.gibba045.orlgmj (mgr.34412) 8619 : cluster [DBG] pgmap v4909: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:09.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:32:09 gibba015 bash[30343]: cluster 2021-03-10T16:32:08.109971+0000 mgr.gibba045.orlgmj (mgr.34412) 8619 : cluster [DBG] pgmap v4909: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:11.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:32:11 gibba045 bash[25517]: cluster 2021-03-10T16:32:10.111680+0000 mgr.gibba045.orlgmj (mgr.34412) 8620 : cluster [DBG] pgmap v4910: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:11.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:32:11 gibba015 bash[29377]: cluster 2021-03-10T16:32:10.111680+0000 mgr.gibba045.orlgmj (mgr.34412) 8620 : cluster [DBG] pgmap v4910: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:11.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:32:11 gibba015 bash[30343]: cluster 2021-03-10T16:32:10.111680+0000 mgr.gibba045.orlgmj (mgr.34412) 8620 : cluster [DBG] pgmap v4910: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:13.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:32:13 gibba045 bash[25517]: cluster 2021-03-10T16:32:12.113411+0000 mgr.gibba045.orlgmj (mgr.34412) 8621 : cluster [DBG] pgmap v4911: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:13.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:32:13 gibba015 bash[29377]: cluster 2021-03-10T16:32:12.113411+0000 mgr.gibba045.orlgmj (mgr.34412) 8621 : cluster [DBG] pgmap v4911: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:13.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:32:13 gibba015 bash[30343]: cluster 2021-03-10T16:32:12.113411+0000 mgr.gibba045.orlgmj (mgr.34412) 8621 : cluster [DBG] pgmap v4911: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:14.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:32:14 gibba045 bash[25517]: cephadm 2021-03-10T16:32:13.161401+0000 mgr.gibba045.orlgmj (mgr.34412) 8622 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:32:14.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:32:14 gibba015 bash[29377]: cephadm 2021-03-10T16:32:13.161401+0000 mgr.gibba045.orlgmj (mgr.34412) 8622 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:32:14.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:32:14 gibba015 bash[30343]: cephadm 2021-03-10T16:32:13.161401+0000 mgr.gibba045.orlgmj (mgr.34412) 8622 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:32:15.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:32:15 gibba045 bash[25517]: cluster 2021-03-10T16:32:14.114603+0000 mgr.gibba045.orlgmj (mgr.34412) 8623 : cluster [DBG] pgmap v4912: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:15.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:32:15 gibba015 bash[29377]: cluster 2021-03-10T16:32:14.114603+0000 mgr.gibba045.orlgmj (mgr.34412) 8623 : cluster [DBG] pgmap v4912: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:15.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:32:15 gibba015 bash[30343]: cluster 2021-03-10T16:32:14.114603+0000 mgr.gibba045.orlgmj (mgr.34412) 8623 : cluster [DBG] pgmap v4912: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:17.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:32:17 gibba015 bash[29377]: cluster 2021-03-10T16:32:16.116403+0000 mgr.gibba045.orlgmj (mgr.34412) 8624 : cluster [DBG] pgmap v4913: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:17.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:32:17 gibba015 bash[30343]: cluster 2021-03-10T16:32:16.116403+0000 mgr.gibba045.orlgmj (mgr.34412) 8624 : cluster [DBG] pgmap v4913: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:17.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:32:17 gibba045 bash[25517]: cluster 2021-03-10T16:32:16.116403+0000 mgr.gibba045.orlgmj (mgr.34412) 8624 : cluster [DBG] pgmap v4913: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:19.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:32:19 gibba015 bash[29377]: cluster 2021-03-10T16:32:18.117808+0000 mgr.gibba045.orlgmj (mgr.34412) 8625 : cluster [DBG] pgmap v4914: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:19.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:32:19 gibba015 bash[30343]: cluster 2021-03-10T16:32:18.117808+0000 mgr.gibba045.orlgmj (mgr.34412) 8625 : cluster [DBG] pgmap v4914: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:19.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:32:19 gibba045 bash[25517]: cluster 2021-03-10T16:32:18.117808+0000 mgr.gibba045.orlgmj (mgr.34412) 8625 : cluster [DBG] pgmap v4914: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:21.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:32:21 gibba015 bash[29377]: cluster 2021-03-10T16:32:20.119425+0000 mgr.gibba045.orlgmj (mgr.34412) 8626 : cluster [DBG] pgmap v4915: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:21.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:32:21 gibba015 bash[30343]: cluster 2021-03-10T16:32:20.119425+0000 mgr.gibba045.orlgmj (mgr.34412) 8626 : cluster [DBG] pgmap v4915: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:21.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:32:21 gibba045 bash[25517]: cluster 2021-03-10T16:32:20.119425+0000 mgr.gibba045.orlgmj (mgr.34412) 8626 : cluster [DBG] pgmap v4915: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:23.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:32:23 gibba015 bash[29377]: cluster 2021-03-10T16:32:22.121206+0000 mgr.gibba045.orlgmj (mgr.34412) 8627 : cluster [DBG] pgmap v4916: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:23.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:32:23 gibba015 bash[30343]: cluster 2021-03-10T16:32:22.121206+0000 mgr.gibba045.orlgmj (mgr.34412) 8627 : cluster [DBG] pgmap v4916: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:23.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:32:23 gibba045 bash[25517]: cluster 2021-03-10T16:32:22.121206+0000 mgr.gibba045.orlgmj (mgr.34412) 8627 : cluster [DBG] pgmap v4916: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:25.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:32:25 gibba015 bash[29377]: cluster 2021-03-10T16:32:24.122429+0000 mgr.gibba045.orlgmj (mgr.34412) 8628 : cluster [DBG] pgmap v4917: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:25.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:32:25 gibba015 bash[30343]: cluster 2021-03-10T16:32:24.122429+0000 mgr.gibba045.orlgmj (mgr.34412) 8628 : cluster [DBG] pgmap v4917: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:25.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:32:25 gibba045 bash[25517]: cluster 2021-03-10T16:32:24.122429+0000 mgr.gibba045.orlgmj (mgr.34412) 8628 : cluster [DBG] pgmap v4917: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:27.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:32:27 gibba015 bash[29377]: cluster 2021-03-10T16:32:26.123893+0000 mgr.gibba045.orlgmj (mgr.34412) 8629 : cluster [DBG] pgmap v4918: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:27.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:32:27 gibba015 bash[30343]: cluster 2021-03-10T16:32:26.123893+0000 mgr.gibba045.orlgmj (mgr.34412) 8629 : cluster [DBG] pgmap v4918: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:27.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:32:27 gibba045 bash[25517]: cluster 2021-03-10T16:32:26.123893+0000 mgr.gibba045.orlgmj (mgr.34412) 8629 : cluster [DBG] pgmap v4918: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:28.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:32:28 gibba015 bash[29377]: audit 2021-03-10T16:32:28.175932+0000 mon.c (mon.1) 2382 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:32:28.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:32:28 gibba015 bash[30343]: audit 2021-03-10T16:32:28.175932+0000 mon.c (mon.1) 2382 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:32:28.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:32:28 gibba045 bash[25517]: audit 2021-03-10T16:32:28.175932+0000 mon.c (mon.1) 2382 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:32:29.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:32:29 gibba015 bash[29377]: cluster 2021-03-10T16:32:28.125540+0000 mgr.gibba045.orlgmj (mgr.34412) 8630 : cluster [DBG] pgmap v4919: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:29.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:32:29 gibba015 bash[29377]: cephadm 2021-03-10T16:32:28.184658+0000 mgr.gibba045.orlgmj (mgr.34412) 8631 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:32:29.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:32:29 gibba015 bash[29377]: cephadm 2021-03-10T16:32:28.186544+0000 mgr.gibba045.orlgmj (mgr.34412) 8632 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:32:29.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:32:29 gibba015 bash[29377]: audit 2021-03-10T16:32:28.396815+0000 mon.a (mon.0) 1938 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:32:29.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:32:29 gibba015 bash[29377]: audit 2021-03-10T16:32:28.400437+0000 mon.c (mon.1) 2383 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:32:29.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:32:29 gibba015 bash[29377]: cephadm 2021-03-10T16:32:28.402286+0000 mgr.gibba045.orlgmj (mgr.34412) 8633 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:32:29.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:32:29 gibba015 bash[29377]: audit 2021-03-10T16:32:28.404015+0000 mon.c (mon.1) 2384 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:32:29.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:32:29 gibba015 bash[29377]: cephadm 2021-03-10T16:32:28.405362+0000 mgr.gibba045.orlgmj (mgr.34412) 8634 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:32:29.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:32:29 gibba015 bash[29377]: audit 2021-03-10T16:32:28.407405+0000 mon.c (mon.1) 2385 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:32:29.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:32:29 gibba015 bash[29377]: cephadm 2021-03-10T16:32:28.408603+0000 mgr.gibba045.orlgmj (mgr.34412) 8635 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:32:29.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:32:29 gibba015 bash[29377]: cephadm 2021-03-10T16:32:28.408988+0000 mgr.gibba045.orlgmj (mgr.34412) 8636 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:32:29.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:32:29 gibba015 bash[29377]: audit 2021-03-10T16:32:28.410446+0000 mon.c (mon.1) 2386 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:32:29.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:32:29 gibba015 bash[29377]: cephadm 2021-03-10T16:32:28.411864+0000 mgr.gibba045.orlgmj (mgr.34412) 8637 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:32:29.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:32:29 gibba015 bash[29377]: cephadm 2021-03-10T16:32:28.412130+0000 mgr.gibba045.orlgmj (mgr.34412) 8638 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:32:29.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:32:29 gibba015 bash[29377]: cephadm 2021-03-10T16:32:28.415151+0000 mgr.gibba045.orlgmj (mgr.34412) 8639 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:32:29.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:32:29 gibba015 bash[29377]: audit 2021-03-10T16:32:28.417651+0000 mon.c (mon.1) 2387 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:32:29.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:32:29 gibba015 bash[29377]: cephadm 2021-03-10T16:32:28.418163+0000 mgr.gibba045.orlgmj (mgr.34412) 8640 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:32:29.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:32:29 gibba015 bash[29377]: cephadm 2021-03-10T16:32:28.418559+0000 mgr.gibba045.orlgmj (mgr.34412) 8641 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:32:29.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:32:29 gibba015 bash[29377]: cephadm 2021-03-10T16:32:28.422412+0000 mgr.gibba045.orlgmj (mgr.34412) 8642 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:32:29.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:32:29 gibba015 bash[29377]: audit 2021-03-10T16:32:28.422760+0000 mon.c (mon.1) 2388 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:32:29.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:32:29 gibba015 bash[29377]: cephadm 2021-03-10T16:32:28.424598+0000 mgr.gibba045.orlgmj (mgr.34412) 8643 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:32:29.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:32:29 gibba015 bash[29377]: cephadm 2021-03-10T16:32:28.427383+0000 mgr.gibba045.orlgmj (mgr.34412) 8644 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:32:29.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:32:29 gibba015 bash[29377]: cephadm 2021-03-10T16:32:28.427775+0000 mgr.gibba045.orlgmj (mgr.34412) 8645 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:32:29.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:32:29 gibba015 bash[29377]: cephadm 2021-03-10T16:32:28.428354+0000 mgr.gibba045.orlgmj (mgr.34412) 8646 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:32:29.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:32:29 gibba015 bash[30343]: cluster 2021-03-10T16:32:28.125540+0000 mgr.gibba045.orlgmj (mgr.34412) 8630 : cluster [DBG] pgmap v4919: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:29.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:32:29 gibba015 bash[30343]: cephadm 2021-03-10T16:32:28.184658+0000 mgr.gibba045.orlgmj (mgr.34412) 8631 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:32:29.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:32:29 gibba015 bash[30343]: cephadm 2021-03-10T16:32:28.186544+0000 mgr.gibba045.orlgmj (mgr.34412) 8632 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:32:29.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:32:29 gibba015 bash[30343]: audit 2021-03-10T16:32:28.396815+0000 mon.a (mon.0) 1938 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:32:29.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:32:29 gibba015 bash[30343]: audit 2021-03-10T16:32:28.400437+0000 mon.c (mon.1) 2383 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:32:29.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:32:29 gibba015 bash[30343]: cephadm 2021-03-10T16:32:28.402286+0000 mgr.gibba045.orlgmj (mgr.34412) 8633 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:32:29.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:32:29 gibba015 bash[30343]: audit 2021-03-10T16:32:28.404015+0000 mon.c (mon.1) 2384 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:32:29.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:32:29 gibba015 bash[30343]: cephadm 2021-03-10T16:32:28.405362+0000 mgr.gibba045.orlgmj (mgr.34412) 8634 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:32:29.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:32:29 gibba015 bash[30343]: audit 2021-03-10T16:32:28.407405+0000 mon.c (mon.1) 2385 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:32:29.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:32:29 gibba015 bash[30343]: cephadm 2021-03-10T16:32:28.408603+0000 mgr.gibba045.orlgmj (mgr.34412) 8635 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:32:29.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:32:29 gibba015 bash[30343]: cephadm 2021-03-10T16:32:28.408988+0000 mgr.gibba045.orlgmj (mgr.34412) 8636 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:32:29.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:32:29 gibba015 bash[30343]: audit 2021-03-10T16:32:28.410446+0000 mon.c (mon.1) 2386 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:32:29.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:32:29 gibba015 bash[30343]: cephadm 2021-03-10T16:32:28.411864+0000 mgr.gibba045.orlgmj (mgr.34412) 8637 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:32:29.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:32:29 gibba015 bash[30343]: cephadm 2021-03-10T16:32:28.412130+0000 mgr.gibba045.orlgmj (mgr.34412) 8638 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:32:29.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:32:29 gibba015 bash[30343]: cephadm 2021-03-10T16:32:28.415151+0000 mgr.gibba045.orlgmj (mgr.34412) 8639 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:32:29.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:32:29 gibba015 bash[30343]: audit 2021-03-10T16:32:28.417651+0000 mon.c (mon.1) 2387 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:32:29.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:32:29 gibba015 bash[30343]: cephadm 2021-03-10T16:32:28.418163+0000 mgr.gibba045.orlgmj (mgr.34412) 8640 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:32:29.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:32:29 gibba015 bash[30343]: cephadm 2021-03-10T16:32:28.418559+0000 mgr.gibba045.orlgmj (mgr.34412) 8641 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:32:29.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:32:29 gibba015 bash[30343]: cephadm 2021-03-10T16:32:28.422412+0000 mgr.gibba045.orlgmj (mgr.34412) 8642 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:32:29.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:32:29 gibba015 bash[30343]: audit 2021-03-10T16:32:28.422760+0000 mon.c (mon.1) 2388 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:32:29.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:32:29 gibba015 bash[30343]: cephadm 2021-03-10T16:32:28.424598+0000 mgr.gibba045.orlgmj (mgr.34412) 8643 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:32:29.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:32:29 gibba015 bash[30343]: cephadm 2021-03-10T16:32:28.427383+0000 mgr.gibba045.orlgmj (mgr.34412) 8644 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:32:29.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:32:29 gibba015 bash[30343]: cephadm 2021-03-10T16:32:28.427775+0000 mgr.gibba045.orlgmj (mgr.34412) 8645 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:32:29.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:32:29 gibba015 bash[30343]: cephadm 2021-03-10T16:32:28.428354+0000 mgr.gibba045.orlgmj (mgr.34412) 8646 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:32:29.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:32:29 gibba045 bash[25517]: cluster 2021-03-10T16:32:28.125540+0000 mgr.gibba045.orlgmj (mgr.34412) 8630 : cluster [DBG] pgmap v4919: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:29.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:32:29 gibba045 bash[25517]: cephadm 2021-03-10T16:32:28.184658+0000 mgr.gibba045.orlgmj (mgr.34412) 8631 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:32:29.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:32:29 gibba045 bash[25517]: cephadm 2021-03-10T16:32:28.186544+0000 mgr.gibba045.orlgmj (mgr.34412) 8632 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:32:29.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:32:29 gibba045 bash[25517]: audit 2021-03-10T16:32:28.396815+0000 mon.a (mon.0) 1938 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:32:29.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:32:29 gibba045 bash[25517]: audit 2021-03-10T16:32:28.400437+0000 mon.c (mon.1) 2383 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:32:29.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:32:29 gibba045 bash[25517]: cephadm 2021-03-10T16:32:28.402286+0000 mgr.gibba045.orlgmj (mgr.34412) 8633 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:32:29.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:32:29 gibba045 bash[25517]: audit 2021-03-10T16:32:28.404015+0000 mon.c (mon.1) 2384 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:32:29.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:32:29 gibba045 bash[25517]: cephadm 2021-03-10T16:32:28.405362+0000 mgr.gibba045.orlgmj (mgr.34412) 8634 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:32:29.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:32:29 gibba045 bash[25517]: audit 2021-03-10T16:32:28.407405+0000 mon.c (mon.1) 2385 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:32:29.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:32:29 gibba045 bash[25517]: cephadm 2021-03-10T16:32:28.408603+0000 mgr.gibba045.orlgmj (mgr.34412) 8635 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:32:29.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:32:29 gibba045 bash[25517]: cephadm 2021-03-10T16:32:28.408988+0000 mgr.gibba045.orlgmj (mgr.34412) 8636 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:32:29.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:32:29 gibba045 bash[25517]: audit 2021-03-10T16:32:28.410446+0000 mon.c (mon.1) 2386 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:32:29.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:32:29 gibba045 bash[25517]: cephadm 2021-03-10T16:32:28.411864+0000 mgr.gibba045.orlgmj (mgr.34412) 8637 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:32:29.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:32:29 gibba045 bash[25517]: cephadm 2021-03-10T16:32:28.412130+0000 mgr.gibba045.orlgmj (mgr.34412) 8638 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:32:29.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:32:29 gibba045 bash[25517]: cephadm 2021-03-10T16:32:28.415151+0000 mgr.gibba045.orlgmj (mgr.34412) 8639 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:32:29.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:32:29 gibba045 bash[25517]: audit 2021-03-10T16:32:28.417651+0000 mon.c (mon.1) 2387 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:32:29.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:32:29 gibba045 bash[25517]: cephadm 2021-03-10T16:32:28.418163+0000 mgr.gibba045.orlgmj (mgr.34412) 8640 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:32:29.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:32:29 gibba045 bash[25517]: cephadm 2021-03-10T16:32:28.418559+0000 mgr.gibba045.orlgmj (mgr.34412) 8641 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:32:29.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:32:29 gibba045 bash[25517]: cephadm 2021-03-10T16:32:28.422412+0000 mgr.gibba045.orlgmj (mgr.34412) 8642 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:32:29.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:32:29 gibba045 bash[25517]: audit 2021-03-10T16:32:28.422760+0000 mon.c (mon.1) 2388 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:32:29.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:32:29 gibba045 bash[25517]: cephadm 2021-03-10T16:32:28.424598+0000 mgr.gibba045.orlgmj (mgr.34412) 8643 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:32:29.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:32:29 gibba045 bash[25517]: cephadm 2021-03-10T16:32:28.427383+0000 mgr.gibba045.orlgmj (mgr.34412) 8644 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:32:29.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:32:29 gibba045 bash[25517]: cephadm 2021-03-10T16:32:28.427775+0000 mgr.gibba045.orlgmj (mgr.34412) 8645 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:32:29.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:32:29 gibba045 bash[25517]: cephadm 2021-03-10T16:32:28.428354+0000 mgr.gibba045.orlgmj (mgr.34412) 8646 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:32:30.275 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:32:30.503 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:32:30.504 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 6m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:32:30.504 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 5m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:32:30.504 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:32:30.504 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:32:30.504 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:32:30.505 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:32:30.505 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:32:30.505 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:32:30.505 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 6m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:32:30.506 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 5m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:32:30.506 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:32:30.506 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:32:30.506 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:32:30.506 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:32:30.507 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:32:30.507 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:32:30.507 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:32:30.507 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:32:30.508 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 5m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:32:30.508 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 5m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:32:30.751 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:32:30.751 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:32:30.751 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:32:30.752 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:32:30.752 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:32:30.752 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:32:30.752 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:32:30.752 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:32:30.753 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:32:30.753 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:32:30.753 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:32:30.753 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:32:30.754 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:32:30.754 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:32:30.754 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:32:31.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:32:31 gibba015 bash[29377]: cluster 2021-03-10T16:32:30.127053+0000 mgr.gibba045.orlgmj (mgr.34412) 8647 : cluster [DBG] pgmap v4920: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:31.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:32:31 gibba015 bash[29377]: audit 2021-03-10T16:32:30.269070+0000 mgr.gibba045.orlgmj (mgr.34412) 8648 : audit [DBG] from='client.49848 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:32:31.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:32:31 gibba015 bash[29377]: audit 2021-03-10T16:32:30.494540+0000 mgr.gibba045.orlgmj (mgr.34412) 8649 : audit [DBG] from='client.49854 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:32:31.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:32:31 gibba015 bash[29377]: audit 2021-03-10T16:32:30.751632+0000 mon.c (mon.1) 2389 : audit [DBG] from='client.? 172.21.2.115:0/3697387999' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:32:31.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:32:31 gibba015 bash[30343]: cluster 2021-03-10T16:32:30.127053+0000 mgr.gibba045.orlgmj (mgr.34412) 8647 : cluster [DBG] pgmap v4920: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:31.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:32:31 gibba015 bash[30343]: audit 2021-03-10T16:32:30.269070+0000 mgr.gibba045.orlgmj (mgr.34412) 8648 : audit [DBG] from='client.49848 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:32:31.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:32:31 gibba015 bash[30343]: audit 2021-03-10T16:32:30.494540+0000 mgr.gibba045.orlgmj (mgr.34412) 8649 : audit [DBG] from='client.49854 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:32:31.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:32:31 gibba015 bash[30343]: audit 2021-03-10T16:32:30.751632+0000 mon.c (mon.1) 2389 : audit [DBG] from='client.? 172.21.2.115:0/3697387999' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:32:31.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:32:31 gibba045 bash[25517]: cluster 2021-03-10T16:32:30.127053+0000 mgr.gibba045.orlgmj (mgr.34412) 8647 : cluster [DBG] pgmap v4920: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:31.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:32:31 gibba045 bash[25517]: audit 2021-03-10T16:32:30.269070+0000 mgr.gibba045.orlgmj (mgr.34412) 8648 : audit [DBG] from='client.49848 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:32:31.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:32:31 gibba045 bash[25517]: audit 2021-03-10T16:32:30.494540+0000 mgr.gibba045.orlgmj (mgr.34412) 8649 : audit [DBG] from='client.49854 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:32:31.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:32:31 gibba045 bash[25517]: audit 2021-03-10T16:32:30.751632+0000 mon.c (mon.1) 2389 : audit [DBG] from='client.? 172.21.2.115:0/3697387999' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:32:33.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:32:33 gibba015 bash[29377]: cluster 2021-03-10T16:32:32.128850+0000 mgr.gibba045.orlgmj (mgr.34412) 8650 : cluster [DBG] pgmap v4921: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:33.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:32:33 gibba015 bash[30343]: cluster 2021-03-10T16:32:32.128850+0000 mgr.gibba045.orlgmj (mgr.34412) 8650 : cluster [DBG] pgmap v4921: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:33.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:32:33 gibba045 bash[25517]: cluster 2021-03-10T16:32:32.128850+0000 mgr.gibba045.orlgmj (mgr.34412) 8650 : cluster [DBG] pgmap v4921: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:35.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:32:35 gibba015 bash[29377]: cluster 2021-03-10T16:32:34.130127+0000 mgr.gibba045.orlgmj (mgr.34412) 8651 : cluster [DBG] pgmap v4922: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:35.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:32:35 gibba015 bash[30343]: cluster 2021-03-10T16:32:34.130127+0000 mgr.gibba045.orlgmj (mgr.34412) 8651 : cluster [DBG] pgmap v4922: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:35.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:32:35 gibba045 bash[25517]: cluster 2021-03-10T16:32:34.130127+0000 mgr.gibba045.orlgmj (mgr.34412) 8651 : cluster [DBG] pgmap v4922: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:37.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:32:37 gibba015 bash[29377]: cluster 2021-03-10T16:32:36.131605+0000 mgr.gibba045.orlgmj (mgr.34412) 8652 : cluster [DBG] pgmap v4923: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:37.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:32:37 gibba015 bash[30343]: cluster 2021-03-10T16:32:36.131605+0000 mgr.gibba045.orlgmj (mgr.34412) 8652 : cluster [DBG] pgmap v4923: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:37.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:32:37 gibba045 bash[25517]: cluster 2021-03-10T16:32:36.131605+0000 mgr.gibba045.orlgmj (mgr.34412) 8652 : cluster [DBG] pgmap v4923: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:39.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:32:39 gibba015 bash[29377]: cluster 2021-03-10T16:32:38.133237+0000 mgr.gibba045.orlgmj (mgr.34412) 8653 : cluster [DBG] pgmap v4924: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:39.719 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:32:39 gibba015 bash[30343]: cluster 2021-03-10T16:32:38.133237+0000 mgr.gibba045.orlgmj (mgr.34412) 8653 : cluster [DBG] pgmap v4924: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:39.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:32:39 gibba045 bash[25517]: cluster 2021-03-10T16:32:38.133237+0000 mgr.gibba045.orlgmj (mgr.34412) 8653 : cluster [DBG] pgmap v4924: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:41.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:32:41 gibba015 bash[29377]: cluster 2021-03-10T16:32:40.134846+0000 mgr.gibba045.orlgmj (mgr.34412) 8654 : cluster [DBG] pgmap v4925: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:41.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:32:41 gibba015 bash[30343]: cluster 2021-03-10T16:32:40.134846+0000 mgr.gibba045.orlgmj (mgr.34412) 8654 : cluster [DBG] pgmap v4925: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:41.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:32:41 gibba045 bash[25517]: cluster 2021-03-10T16:32:40.134846+0000 mgr.gibba045.orlgmj (mgr.34412) 8654 : cluster [DBG] pgmap v4925: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:43.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:32:43 gibba015 bash[29377]: cluster 2021-03-10T16:32:42.135441+0000 mgr.gibba045.orlgmj (mgr.34412) 8655 : cluster [DBG] pgmap v4926: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:43.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:32:43 gibba015 bash[30343]: cluster 2021-03-10T16:32:42.135441+0000 mgr.gibba045.orlgmj (mgr.34412) 8655 : cluster [DBG] pgmap v4926: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:43.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:32:43 gibba045 bash[25517]: cluster 2021-03-10T16:32:42.135441+0000 mgr.gibba045.orlgmj (mgr.34412) 8655 : cluster [DBG] pgmap v4926: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:44.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:32:44 gibba045 bash[25517]: cephadm 2021-03-10T16:32:43.444386+0000 mgr.gibba045.orlgmj (mgr.34412) 8656 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:32:44.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:32:44 gibba015 bash[29377]: cephadm 2021-03-10T16:32:43.444386+0000 mgr.gibba045.orlgmj (mgr.34412) 8656 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:32:44.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:32:44 gibba015 bash[30343]: cephadm 2021-03-10T16:32:43.444386+0000 mgr.gibba045.orlgmj (mgr.34412) 8656 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:32:45.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:32:45 gibba045 bash[25517]: cluster 2021-03-10T16:32:44.136564+0000 mgr.gibba045.orlgmj (mgr.34412) 8657 : cluster [DBG] pgmap v4927: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:45.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:32:45 gibba015 bash[29377]: cluster 2021-03-10T16:32:44.136564+0000 mgr.gibba045.orlgmj (mgr.34412) 8657 : cluster [DBG] pgmap v4927: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:45.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:32:45 gibba015 bash[30343]: cluster 2021-03-10T16:32:44.136564+0000 mgr.gibba045.orlgmj (mgr.34412) 8657 : cluster [DBG] pgmap v4927: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:47.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:32:47 gibba045 bash[25517]: cluster 2021-03-10T16:32:46.138035+0000 mgr.gibba045.orlgmj (mgr.34412) 8658 : cluster [DBG] pgmap v4928: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:47.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:32:47 gibba015 bash[29377]: cluster 2021-03-10T16:32:46.138035+0000 mgr.gibba045.orlgmj (mgr.34412) 8658 : cluster [DBG] pgmap v4928: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:47.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:32:47 gibba015 bash[30343]: cluster 2021-03-10T16:32:46.138035+0000 mgr.gibba045.orlgmj (mgr.34412) 8658 : cluster [DBG] pgmap v4928: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:49.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:32:49 gibba045 bash[25517]: cluster 2021-03-10T16:32:48.138875+0000 mgr.gibba045.orlgmj (mgr.34412) 8659 : cluster [DBG] pgmap v4929: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:49.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:32:49 gibba015 bash[29377]: cluster 2021-03-10T16:32:48.138875+0000 mgr.gibba045.orlgmj (mgr.34412) 8659 : cluster [DBG] pgmap v4929: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:49.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:32:49 gibba015 bash[30343]: cluster 2021-03-10T16:32:48.138875+0000 mgr.gibba045.orlgmj (mgr.34412) 8659 : cluster [DBG] pgmap v4929: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:51.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:32:51 gibba045 bash[25517]: cluster 2021-03-10T16:32:50.139677+0000 mgr.gibba045.orlgmj (mgr.34412) 8660 : cluster [DBG] pgmap v4930: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:51.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:32:51 gibba015 bash[29377]: cluster 2021-03-10T16:32:50.139677+0000 mgr.gibba045.orlgmj (mgr.34412) 8660 : cluster [DBG] pgmap v4930: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:51.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:32:51 gibba015 bash[30343]: cluster 2021-03-10T16:32:50.139677+0000 mgr.gibba045.orlgmj (mgr.34412) 8660 : cluster [DBG] pgmap v4930: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:53.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:32:53 gibba045 bash[25517]: cluster 2021-03-10T16:32:52.141243+0000 mgr.gibba045.orlgmj (mgr.34412) 8661 : cluster [DBG] pgmap v4931: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:53.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:32:53 gibba015 bash[29377]: cluster 2021-03-10T16:32:52.141243+0000 mgr.gibba045.orlgmj (mgr.34412) 8661 : cluster [DBG] pgmap v4931: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:53.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:32:53 gibba015 bash[30343]: cluster 2021-03-10T16:32:52.141243+0000 mgr.gibba045.orlgmj (mgr.34412) 8661 : cluster [DBG] pgmap v4931: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:54.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:32:54 gibba045 bash[25517]: audit 2021-03-10T16:32:53.627712+0000 mon.c (mon.1) 2390 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:32:54.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:32:54 gibba045 bash[25517]: audit 2021-03-10T16:32:53.628327+0000 mon.c (mon.1) 2391 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:32:54.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:32:54 gibba045 bash[25517]: audit 2021-03-10T16:32:53.628976+0000 mon.a (mon.0) 1939 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:32:54.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:32:54 gibba045 bash[25517]: audit 2021-03-10T16:32:53.632298+0000 mon.a (mon.0) 1940 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:32:54.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:32:54 gibba045 bash[25517]: audit 2021-03-10T16:32:53.643121+0000 mon.c (mon.1) 2392 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T16:32:54.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:32:54 gibba045 bash[25517]: audit 2021-03-10T16:32:53.643867+0000 mon.c (mon.1) 2393 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:32:54.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:32:54 gibba045 bash[25517]: audit 2021-03-10T16:32:53.644371+0000 mon.a (mon.0) 1941 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T16:32:54.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:32:54 gibba045 bash[25517]: audit 2021-03-10T16:32:53.644548+0000 mon.c (mon.1) 2394 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:32:54.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:32:54 gibba045 bash[25517]: audit 2021-03-10T16:32:53.645408+0000 mon.c (mon.1) 2395 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:32:54.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:32:54 gibba045 bash[25517]: audit 2021-03-10T16:32:53.645627+0000 mon.a (mon.0) 1942 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:32:54.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:32:54 gibba045 bash[25517]: audit 2021-03-10T16:32:53.646829+0000 mon.a (mon.0) 1943 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:32:54.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:32:54 gibba045 bash[25517]: audit 2021-03-10T16:32:53.647622+0000 mon.a (mon.0) 1944 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:32:54.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:32:54 gibba015 bash[29377]: audit 2021-03-10T16:32:53.627712+0000 mon.c (mon.1) 2390 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:32:54.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:32:54 gibba015 bash[29377]: audit 2021-03-10T16:32:53.628327+0000 mon.c (mon.1) 2391 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:32:54.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:32:54 gibba015 bash[29377]: audit 2021-03-10T16:32:53.628976+0000 mon.a (mon.0) 1939 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:32:54.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:32:54 gibba015 bash[29377]: audit 2021-03-10T16:32:53.632298+0000 mon.a (mon.0) 1940 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:32:54.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:32:54 gibba015 bash[29377]: audit 2021-03-10T16:32:53.643121+0000 mon.c (mon.1) 2392 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T16:32:54.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:32:54 gibba015 bash[29377]: audit 2021-03-10T16:32:53.643867+0000 mon.c (mon.1) 2393 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:32:54.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:32:54 gibba015 bash[29377]: audit 2021-03-10T16:32:53.644371+0000 mon.a (mon.0) 1941 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T16:32:54.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:32:54 gibba015 bash[29377]: audit 2021-03-10T16:32:53.644548+0000 mon.c (mon.1) 2394 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:32:54.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:32:54 gibba015 bash[29377]: audit 2021-03-10T16:32:53.645408+0000 mon.c (mon.1) 2395 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:32:54.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:32:54 gibba015 bash[29377]: audit 2021-03-10T16:32:53.645627+0000 mon.a (mon.0) 1942 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:32:54.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:32:54 gibba015 bash[29377]: audit 2021-03-10T16:32:53.646829+0000 mon.a (mon.0) 1943 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:32:54.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:32:54 gibba015 bash[29377]: audit 2021-03-10T16:32:53.647622+0000 mon.a (mon.0) 1944 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:32:54.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:32:54 gibba015 bash[30343]: audit 2021-03-10T16:32:53.627712+0000 mon.c (mon.1) 2390 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:32:54.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:32:54 gibba015 bash[30343]: audit 2021-03-10T16:32:53.628327+0000 mon.c (mon.1) 2391 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:32:54.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:32:54 gibba015 bash[30343]: audit 2021-03-10T16:32:53.628976+0000 mon.a (mon.0) 1939 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:32:54.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:32:54 gibba015 bash[30343]: audit 2021-03-10T16:32:53.632298+0000 mon.a (mon.0) 1940 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:32:54.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:32:54 gibba015 bash[30343]: audit 2021-03-10T16:32:53.643121+0000 mon.c (mon.1) 2392 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T16:32:54.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:32:54 gibba015 bash[30343]: audit 2021-03-10T16:32:53.643867+0000 mon.c (mon.1) 2393 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:32:54.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:32:54 gibba015 bash[30343]: audit 2021-03-10T16:32:53.644371+0000 mon.a (mon.0) 1941 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T16:32:54.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:32:54 gibba015 bash[30343]: audit 2021-03-10T16:32:53.644548+0000 mon.c (mon.1) 2394 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:32:54.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:32:54 gibba015 bash[30343]: audit 2021-03-10T16:32:53.645408+0000 mon.c (mon.1) 2395 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:32:54.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:32:54 gibba015 bash[30343]: audit 2021-03-10T16:32:53.645627+0000 mon.a (mon.0) 1942 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:32:54.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:32:54 gibba015 bash[30343]: audit 2021-03-10T16:32:53.646829+0000 mon.a (mon.0) 1943 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:32:54.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:32:54 gibba015 bash[30343]: audit 2021-03-10T16:32:53.647622+0000 mon.a (mon.0) 1944 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:32:55.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:32:55 gibba045 bash[25517]: cluster 2021-03-10T16:32:54.141749+0000 mgr.gibba045.orlgmj (mgr.34412) 8662 : cluster [DBG] pgmap v4932: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:55.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:32:55 gibba015 bash[29377]: cluster 2021-03-10T16:32:54.141749+0000 mgr.gibba045.orlgmj (mgr.34412) 8662 : cluster [DBG] pgmap v4932: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:55.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:32:55 gibba015 bash[30343]: cluster 2021-03-10T16:32:54.141749+0000 mgr.gibba045.orlgmj (mgr.34412) 8662 : cluster [DBG] pgmap v4932: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:57.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:32:57 gibba045 bash[25517]: cluster 2021-03-10T16:32:56.143364+0000 mgr.gibba045.orlgmj (mgr.34412) 8663 : cluster [DBG] pgmap v4933: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:57.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:32:57 gibba015 bash[29377]: cluster 2021-03-10T16:32:56.143364+0000 mgr.gibba045.orlgmj (mgr.34412) 8663 : cluster [DBG] pgmap v4933: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:57.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:32:57 gibba015 bash[30343]: cluster 2021-03-10T16:32:56.143364+0000 mgr.gibba045.orlgmj (mgr.34412) 8663 : cluster [DBG] pgmap v4933: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:59.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:32:59 gibba045 bash[25517]: cluster 2021-03-10T16:32:58.144787+0000 mgr.gibba045.orlgmj (mgr.34412) 8664 : cluster [DBG] pgmap v4934: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:59.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:32:59 gibba045 bash[25517]: cephadm 2021-03-10T16:32:58.460471+0000 mgr.gibba045.orlgmj (mgr.34412) 8665 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:32:59.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:32:59 gibba015 bash[29377]: cluster 2021-03-10T16:32:58.144787+0000 mgr.gibba045.orlgmj (mgr.34412) 8664 : cluster [DBG] pgmap v4934: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:59.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:32:59 gibba015 bash[29377]: cephadm 2021-03-10T16:32:58.460471+0000 mgr.gibba045.orlgmj (mgr.34412) 8665 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:32:59.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:32:59 gibba015 bash[30343]: cluster 2021-03-10T16:32:58.144787+0000 mgr.gibba045.orlgmj (mgr.34412) 8664 : cluster [DBG] pgmap v4934: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:59.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:32:59 gibba015 bash[30343]: cephadm 2021-03-10T16:32:58.460471+0000 mgr.gibba045.orlgmj (mgr.34412) 8665 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:33:00.994 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:33:01.221 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:33:01.221 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 6m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:33:01.221 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 5m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:33:01.222 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:33:01.222 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:33:01.222 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:33:01.222 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:33:01.223 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:33:01.223 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:33:01.223 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 6m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:33:01.223 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 5m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:33:01.223 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:33:01.224 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:33:01.224 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:33:01.224 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:33:01.224 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:33:01.224 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:33:01.225 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:33:01.225 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:33:01.225 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 5m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:33:01.225 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 5m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:33:01.474 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:33:01.474 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:33:01.474 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:33:01.475 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:33:01.475 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:33:01.475 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:33:01.475 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:33:01.475 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:33:01.476 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:33:01.476 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:33:01.476 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:33:01.476 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:33:01.477 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:33:01.477 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:33:01.477 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:33:01.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:33:01 gibba015 bash[29377]: cluster 2021-03-10T16:33:00.145505+0000 mgr.gibba045.orlgmj (mgr.34412) 8666 : cluster [DBG] pgmap v4935: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:01.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:33:01 gibba015 bash[29377]: audit 2021-03-10T16:33:01.474695+0000 mon.c (mon.1) 2396 : audit [DBG] from='client.? 172.21.2.115:0/4275680051' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:33:01.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:33:01 gibba015 bash[30343]: cluster 2021-03-10T16:33:00.145505+0000 mgr.gibba045.orlgmj (mgr.34412) 8666 : cluster [DBG] pgmap v4935: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:01.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:33:01 gibba015 bash[30343]: audit 2021-03-10T16:33:01.474695+0000 mon.c (mon.1) 2396 : audit [DBG] from='client.? 172.21.2.115:0/4275680051' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:33:02.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:33:01 gibba045 bash[25517]: cluster 2021-03-10T16:33:00.145505+0000 mgr.gibba045.orlgmj (mgr.34412) 8666 : cluster [DBG] pgmap v4935: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:02.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:33:01 gibba045 bash[25517]: audit 2021-03-10T16:33:01.474695+0000 mon.c (mon.1) 2396 : audit [DBG] from='client.? 172.21.2.115:0/4275680051' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:33:02.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:33:02 gibba015 bash[29377]: audit 2021-03-10T16:33:00.988084+0000 mgr.gibba045.orlgmj (mgr.34412) 8667 : audit [DBG] from='client.59854 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:33:02.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:33:02 gibba015 bash[29377]: audit 2021-03-10T16:33:01.212179+0000 mgr.gibba045.orlgmj (mgr.34412) 8668 : audit [DBG] from='client.49872 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:33:02.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:33:02 gibba015 bash[30343]: audit 2021-03-10T16:33:00.988084+0000 mgr.gibba045.orlgmj (mgr.34412) 8667 : audit [DBG] from='client.59854 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:33:02.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:33:02 gibba015 bash[30343]: audit 2021-03-10T16:33:01.212179+0000 mgr.gibba045.orlgmj (mgr.34412) 8668 : audit [DBG] from='client.49872 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:33:03.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:33:02 gibba045 bash[25517]: audit 2021-03-10T16:33:00.988084+0000 mgr.gibba045.orlgmj (mgr.34412) 8667 : audit [DBG] from='client.59854 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:33:03.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:33:02 gibba045 bash[25517]: audit 2021-03-10T16:33:01.212179+0000 mgr.gibba045.orlgmj (mgr.34412) 8668 : audit [DBG] from='client.49872 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:33:03.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:33:03 gibba015 bash[29377]: cluster 2021-03-10T16:33:02.146974+0000 mgr.gibba045.orlgmj (mgr.34412) 8669 : cluster [DBG] pgmap v4936: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:03.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:33:03 gibba015 bash[30343]: cluster 2021-03-10T16:33:02.146974+0000 mgr.gibba045.orlgmj (mgr.34412) 8669 : cluster [DBG] pgmap v4936: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:04.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:33:03 gibba045 bash[25517]: cluster 2021-03-10T16:33:02.146974+0000 mgr.gibba045.orlgmj (mgr.34412) 8669 : cluster [DBG] pgmap v4936: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:04.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:33:04 gibba015 bash[29377]: cluster 2021-03-10T16:33:04.148188+0000 mgr.gibba045.orlgmj (mgr.34412) 8670 : cluster [DBG] pgmap v4937: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:04.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:33:04 gibba015 bash[30343]: cluster 2021-03-10T16:33:04.148188+0000 mgr.gibba045.orlgmj (mgr.34412) 8670 : cluster [DBG] pgmap v4937: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:05.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:33:04 gibba045 bash[25517]: cluster 2021-03-10T16:33:04.148188+0000 mgr.gibba045.orlgmj (mgr.34412) 8670 : cluster [DBG] pgmap v4937: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:07.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:33:07 gibba045 bash[25517]: cluster 2021-03-10T16:33:06.148857+0000 mgr.gibba045.orlgmj (mgr.34412) 8671 : cluster [DBG] pgmap v4938: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:07.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:33:07 gibba015 bash[29377]: cluster 2021-03-10T16:33:06.148857+0000 mgr.gibba045.orlgmj (mgr.34412) 8671 : cluster [DBG] pgmap v4938: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:07.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:33:07 gibba015 bash[30343]: cluster 2021-03-10T16:33:06.148857+0000 mgr.gibba045.orlgmj (mgr.34412) 8671 : cluster [DBG] pgmap v4938: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:09.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:33:09 gibba045 bash[25517]: cluster 2021-03-10T16:33:08.150119+0000 mgr.gibba045.orlgmj (mgr.34412) 8672 : cluster [DBG] pgmap v4939: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:09.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:33:09 gibba015 bash[29377]: cluster 2021-03-10T16:33:08.150119+0000 mgr.gibba045.orlgmj (mgr.34412) 8672 : cluster [DBG] pgmap v4939: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:09.719 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:33:09 gibba015 bash[30343]: cluster 2021-03-10T16:33:08.150119+0000 mgr.gibba045.orlgmj (mgr.34412) 8672 : cluster [DBG] pgmap v4939: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:11.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:33:11 gibba045 bash[25517]: cluster 2021-03-10T16:33:10.151718+0000 mgr.gibba045.orlgmj (mgr.34412) 8673 : cluster [DBG] pgmap v4940: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:11.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:33:11 gibba015 bash[29377]: cluster 2021-03-10T16:33:10.151718+0000 mgr.gibba045.orlgmj (mgr.34412) 8673 : cluster [DBG] pgmap v4940: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:11.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:33:11 gibba015 bash[30343]: cluster 2021-03-10T16:33:10.151718+0000 mgr.gibba045.orlgmj (mgr.34412) 8673 : cluster [DBG] pgmap v4940: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:13.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:33:13 gibba045 bash[25517]: cluster 2021-03-10T16:33:12.152519+0000 mgr.gibba045.orlgmj (mgr.34412) 8674 : cluster [DBG] pgmap v4941: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:13.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:33:13 gibba015 bash[29377]: cluster 2021-03-10T16:33:12.152519+0000 mgr.gibba045.orlgmj (mgr.34412) 8674 : cluster [DBG] pgmap v4941: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:13.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:33:13 gibba015 bash[30343]: cluster 2021-03-10T16:33:12.152519+0000 mgr.gibba045.orlgmj (mgr.34412) 8674 : cluster [DBG] pgmap v4941: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:14.552 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:33:14 gibba045 bash[25517]: cephadm 2021-03-10T16:33:13.466142+0000 mgr.gibba045.orlgmj (mgr.34412) 8675 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:33:14.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:33:14 gibba015 bash[29377]: cephadm 2021-03-10T16:33:13.466142+0000 mgr.gibba045.orlgmj (mgr.34412) 8675 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:33:14.719 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:33:14 gibba015 bash[30343]: cephadm 2021-03-10T16:33:13.466142+0000 mgr.gibba045.orlgmj (mgr.34412) 8675 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:33:15.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:33:15 gibba045 bash[25517]: cluster 2021-03-10T16:33:14.153560+0000 mgr.gibba045.orlgmj (mgr.34412) 8676 : cluster [DBG] pgmap v4942: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:15.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:33:15 gibba015 bash[29377]: cluster 2021-03-10T16:33:14.153560+0000 mgr.gibba045.orlgmj (mgr.34412) 8676 : cluster [DBG] pgmap v4942: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:15.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:33:15 gibba015 bash[30343]: cluster 2021-03-10T16:33:14.153560+0000 mgr.gibba045.orlgmj (mgr.34412) 8676 : cluster [DBG] pgmap v4942: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:17.552 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:33:17 gibba045 bash[25517]: cluster 2021-03-10T16:33:16.155286+0000 mgr.gibba045.orlgmj (mgr.34412) 8677 : cluster [DBG] pgmap v4943: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:17.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:33:17 gibba015 bash[29377]: cluster 2021-03-10T16:33:16.155286+0000 mgr.gibba045.orlgmj (mgr.34412) 8677 : cluster [DBG] pgmap v4943: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:17.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:33:17 gibba015 bash[30343]: cluster 2021-03-10T16:33:16.155286+0000 mgr.gibba045.orlgmj (mgr.34412) 8677 : cluster [DBG] pgmap v4943: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:19.552 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:33:19 gibba045 bash[25517]: cluster 2021-03-10T16:33:18.156018+0000 mgr.gibba045.orlgmj (mgr.34412) 8678 : cluster [DBG] pgmap v4944: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:19.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:33:19 gibba015 bash[29377]: cluster 2021-03-10T16:33:18.156018+0000 mgr.gibba045.orlgmj (mgr.34412) 8678 : cluster [DBG] pgmap v4944: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:19.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:33:19 gibba015 bash[30343]: cluster 2021-03-10T16:33:18.156018+0000 mgr.gibba045.orlgmj (mgr.34412) 8678 : cluster [DBG] pgmap v4944: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:21.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:33:21 gibba045 bash[25517]: cluster 2021-03-10T16:33:20.157472+0000 mgr.gibba045.orlgmj (mgr.34412) 8679 : cluster [DBG] pgmap v4945: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:21.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:33:21 gibba015 bash[29377]: cluster 2021-03-10T16:33:20.157472+0000 mgr.gibba045.orlgmj (mgr.34412) 8679 : cluster [DBG] pgmap v4945: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:21.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:33:21 gibba015 bash[30343]: cluster 2021-03-10T16:33:20.157472+0000 mgr.gibba045.orlgmj (mgr.34412) 8679 : cluster [DBG] pgmap v4945: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:23.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:33:23 gibba015 bash[29377]: cluster 2021-03-10T16:33:22.158977+0000 mgr.gibba045.orlgmj (mgr.34412) 8680 : cluster [DBG] pgmap v4946: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:23.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:33:23 gibba015 bash[30343]: cluster 2021-03-10T16:33:22.158977+0000 mgr.gibba045.orlgmj (mgr.34412) 8680 : cluster [DBG] pgmap v4946: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:23.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:33:23 gibba045 bash[25517]: cluster 2021-03-10T16:33:22.158977+0000 mgr.gibba045.orlgmj (mgr.34412) 8680 : cluster [DBG] pgmap v4946: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:25.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:33:25 gibba015 bash[29377]: cluster 2021-03-10T16:33:24.159535+0000 mgr.gibba045.orlgmj (mgr.34412) 8681 : cluster [DBG] pgmap v4947: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:25.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:33:25 gibba015 bash[30343]: cluster 2021-03-10T16:33:24.159535+0000 mgr.gibba045.orlgmj (mgr.34412) 8681 : cluster [DBG] pgmap v4947: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:25.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:33:25 gibba045 bash[25517]: cluster 2021-03-10T16:33:24.159535+0000 mgr.gibba045.orlgmj (mgr.34412) 8681 : cluster [DBG] pgmap v4947: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:27.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:33:27 gibba015 bash[29377]: cluster 2021-03-10T16:33:26.161093+0000 mgr.gibba045.orlgmj (mgr.34412) 8682 : cluster [DBG] pgmap v4948: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:27.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:33:27 gibba015 bash[30343]: cluster 2021-03-10T16:33:26.161093+0000 mgr.gibba045.orlgmj (mgr.34412) 8682 : cluster [DBG] pgmap v4948: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:27.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:33:27 gibba045 bash[25517]: cluster 2021-03-10T16:33:26.161093+0000 mgr.gibba045.orlgmj (mgr.34412) 8682 : cluster [DBG] pgmap v4948: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:29.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:33:29 gibba015 bash[29377]: cluster 2021-03-10T16:33:28.162453+0000 mgr.gibba045.orlgmj (mgr.34412) 8683 : cluster [DBG] pgmap v4949: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:29.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:33:29 gibba015 bash[29377]: audit 2021-03-10T16:33:28.480339+0000 mon.c (mon.1) 2397 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:33:29.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:33:29 gibba015 bash[29377]: audit 2021-03-10T16:33:28.688700+0000 mon.a (mon.0) 1945 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:33:29.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:33:29 gibba015 bash[29377]: audit 2021-03-10T16:33:28.692611+0000 mon.a (mon.0) 1946 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:33:29.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:33:29 gibba015 bash[29377]: audit 2021-03-10T16:33:28.879077+0000 mon.a (mon.0) 1947 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:33:29.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:33:29 gibba015 bash[29377]: audit 2021-03-10T16:33:28.882424+0000 mon.c (mon.1) 2398 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:33:29.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:33:29 gibba015 bash[29377]: audit 2021-03-10T16:33:28.883903+0000 mon.c (mon.1) 2399 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:33:29.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:33:29 gibba015 bash[29377]: audit 2021-03-10T16:33:28.885262+0000 mon.c (mon.1) 2400 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:33:29.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:33:29 gibba015 bash[29377]: audit 2021-03-10T16:33:28.886752+0000 mon.c (mon.1) 2401 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:33:29.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:33:29 gibba015 bash[29377]: audit 2021-03-10T16:33:28.890139+0000 mon.c (mon.1) 2402 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:33:29.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:33:29 gibba015 bash[29377]: audit 2021-03-10T16:33:28.891932+0000 mon.c (mon.1) 2403 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:33:29.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:33:29 gibba015 bash[30343]: cluster 2021-03-10T16:33:28.162453+0000 mgr.gibba045.orlgmj (mgr.34412) 8683 : cluster [DBG] pgmap v4949: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:29.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:33:29 gibba015 bash[30343]: audit 2021-03-10T16:33:28.480339+0000 mon.c (mon.1) 2397 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:33:29.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:33:29 gibba015 bash[30343]: audit 2021-03-10T16:33:28.688700+0000 mon.a (mon.0) 1945 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:33:29.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:33:29 gibba015 bash[30343]: audit 2021-03-10T16:33:28.692611+0000 mon.a (mon.0) 1946 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:33:29.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:33:29 gibba015 bash[30343]: audit 2021-03-10T16:33:28.879077+0000 mon.a (mon.0) 1947 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:33:29.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:33:29 gibba015 bash[30343]: audit 2021-03-10T16:33:28.882424+0000 mon.c (mon.1) 2398 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:33:29.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:33:29 gibba015 bash[30343]: audit 2021-03-10T16:33:28.883903+0000 mon.c (mon.1) 2399 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:33:29.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:33:29 gibba015 bash[30343]: audit 2021-03-10T16:33:28.885262+0000 mon.c (mon.1) 2400 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:33:29.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:33:29 gibba015 bash[30343]: audit 2021-03-10T16:33:28.886752+0000 mon.c (mon.1) 2401 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:33:29.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:33:29 gibba015 bash[30343]: audit 2021-03-10T16:33:28.890139+0000 mon.c (mon.1) 2402 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:33:29.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:33:29 gibba015 bash[30343]: audit 2021-03-10T16:33:28.891932+0000 mon.c (mon.1) 2403 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:33:29.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:33:29 gibba045 bash[25517]: cluster 2021-03-10T16:33:28.162453+0000 mgr.gibba045.orlgmj (mgr.34412) 8683 : cluster [DBG] pgmap v4949: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:29.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:33:29 gibba045 bash[25517]: audit 2021-03-10T16:33:28.480339+0000 mon.c (mon.1) 2397 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:33:29.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:33:29 gibba045 bash[25517]: audit 2021-03-10T16:33:28.688700+0000 mon.a (mon.0) 1945 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:33:29.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:33:29 gibba045 bash[25517]: audit 2021-03-10T16:33:28.692611+0000 mon.a (mon.0) 1946 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:33:29.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:33:29 gibba045 bash[25517]: audit 2021-03-10T16:33:28.879077+0000 mon.a (mon.0) 1947 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:33:29.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:33:29 gibba045 bash[25517]: audit 2021-03-10T16:33:28.882424+0000 mon.c (mon.1) 2398 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:33:29.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:33:29 gibba045 bash[25517]: audit 2021-03-10T16:33:28.883903+0000 mon.c (mon.1) 2399 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:33:29.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:33:29 gibba045 bash[25517]: audit 2021-03-10T16:33:28.885262+0000 mon.c (mon.1) 2400 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:33:29.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:33:29 gibba045 bash[25517]: audit 2021-03-10T16:33:28.886752+0000 mon.c (mon.1) 2401 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:33:29.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:33:29 gibba045 bash[25517]: audit 2021-03-10T16:33:28.890139+0000 mon.c (mon.1) 2402 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:33:29.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:33:29 gibba045 bash[25517]: audit 2021-03-10T16:33:28.891932+0000 mon.c (mon.1) 2403 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:33:30.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:33:30 gibba015 bash[29377]: cephadm 2021-03-10T16:33:28.692603+0000 mgr.gibba045.orlgmj (mgr.34412) 8684 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:33:30.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:33:30 gibba015 bash[29377]: cephadm 2021-03-10T16:33:28.696030+0000 mgr.gibba045.orlgmj (mgr.34412) 8685 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:33:30.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:33:30 gibba015 bash[29377]: cephadm 2021-03-10T16:33:28.884210+0000 mgr.gibba045.orlgmj (mgr.34412) 8686 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:33:30.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:33:30 gibba015 bash[29377]: cephadm 2021-03-10T16:33:28.885930+0000 mgr.gibba045.orlgmj (mgr.34412) 8687 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:33:30.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:33:30 gibba015 bash[29377]: cephadm 2021-03-10T16:33:28.887180+0000 mgr.gibba045.orlgmj (mgr.34412) 8688 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:33:30.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:33:30 gibba015 bash[29377]: cephadm 2021-03-10T16:33:28.887217+0000 mgr.gibba045.orlgmj (mgr.34412) 8689 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:33:30.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:33:30 gibba015 bash[29377]: cephadm 2021-03-10T16:33:28.888792+0000 mgr.gibba045.orlgmj (mgr.34412) 8690 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:33:30.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:33:30 gibba015 bash[29377]: cephadm 2021-03-10T16:33:28.888833+0000 mgr.gibba045.orlgmj (mgr.34412) 8691 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:33:30.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:33:30 gibba015 bash[29377]: cephadm 2021-03-10T16:33:28.890361+0000 mgr.gibba045.orlgmj (mgr.34412) 8692 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:33:30.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:33:30 gibba015 bash[29377]: cephadm 2021-03-10T16:33:28.892053+0000 mgr.gibba045.orlgmj (mgr.34412) 8693 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:33:30.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:33:30 gibba015 bash[29377]: cephadm 2021-03-10T16:33:28.892091+0000 mgr.gibba045.orlgmj (mgr.34412) 8694 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:33:30.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:33:30 gibba015 bash[29377]: cephadm 2021-03-10T16:33:28.893706+0000 mgr.gibba045.orlgmj (mgr.34412) 8695 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:33:30.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:33:30 gibba015 bash[29377]: cephadm 2021-03-10T16:33:28.894023+0000 mgr.gibba045.orlgmj (mgr.34412) 8696 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:33:30.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:33:30 gibba015 bash[29377]: cephadm 2021-03-10T16:33:28.895509+0000 mgr.gibba045.orlgmj (mgr.34412) 8697 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:33:30.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:33:30 gibba015 bash[29377]: cephadm 2021-03-10T16:33:28.895547+0000 mgr.gibba045.orlgmj (mgr.34412) 8698 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:33:30.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:33:30 gibba015 bash[29377]: cephadm 2021-03-10T16:33:28.895654+0000 mgr.gibba045.orlgmj (mgr.34412) 8699 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:33:30.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:33:30 gibba015 bash[30343]: cephadm 2021-03-10T16:33:28.692603+0000 mgr.gibba045.orlgmj (mgr.34412) 8684 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:33:30.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:33:30 gibba015 bash[30343]: cephadm 2021-03-10T16:33:28.696030+0000 mgr.gibba045.orlgmj (mgr.34412) 8685 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:33:30.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:33:30 gibba015 bash[30343]: cephadm 2021-03-10T16:33:28.884210+0000 mgr.gibba045.orlgmj (mgr.34412) 8686 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:33:30.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:33:30 gibba015 bash[30343]: cephadm 2021-03-10T16:33:28.885930+0000 mgr.gibba045.orlgmj (mgr.34412) 8687 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:33:30.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:33:30 gibba015 bash[30343]: cephadm 2021-03-10T16:33:28.887180+0000 mgr.gibba045.orlgmj (mgr.34412) 8688 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:33:30.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:33:30 gibba015 bash[30343]: cephadm 2021-03-10T16:33:28.887217+0000 mgr.gibba045.orlgmj (mgr.34412) 8689 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:33:30.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:33:30 gibba015 bash[30343]: cephadm 2021-03-10T16:33:28.888792+0000 mgr.gibba045.orlgmj (mgr.34412) 8690 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:33:30.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:33:30 gibba015 bash[30343]: cephadm 2021-03-10T16:33:28.888833+0000 mgr.gibba045.orlgmj (mgr.34412) 8691 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:33:30.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:33:30 gibba015 bash[30343]: cephadm 2021-03-10T16:33:28.890361+0000 mgr.gibba045.orlgmj (mgr.34412) 8692 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:33:30.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:33:30 gibba015 bash[30343]: cephadm 2021-03-10T16:33:28.892053+0000 mgr.gibba045.orlgmj (mgr.34412) 8693 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:33:30.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:33:30 gibba015 bash[30343]: cephadm 2021-03-10T16:33:28.892091+0000 mgr.gibba045.orlgmj (mgr.34412) 8694 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:33:30.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:33:30 gibba015 bash[30343]: cephadm 2021-03-10T16:33:28.893706+0000 mgr.gibba045.orlgmj (mgr.34412) 8695 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:33:30.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:33:30 gibba015 bash[30343]: cephadm 2021-03-10T16:33:28.894023+0000 mgr.gibba045.orlgmj (mgr.34412) 8696 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:33:30.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:33:30 gibba015 bash[30343]: cephadm 2021-03-10T16:33:28.895509+0000 mgr.gibba045.orlgmj (mgr.34412) 8697 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:33:30.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:33:30 gibba015 bash[30343]: cephadm 2021-03-10T16:33:28.895547+0000 mgr.gibba045.orlgmj (mgr.34412) 8698 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:33:30.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:33:30 gibba015 bash[30343]: cephadm 2021-03-10T16:33:28.895654+0000 mgr.gibba045.orlgmj (mgr.34412) 8699 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:33:30.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:33:30 gibba045 bash[25517]: cephadm 2021-03-10T16:33:28.692603+0000 mgr.gibba045.orlgmj (mgr.34412) 8684 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:33:30.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:33:30 gibba045 bash[25517]: cephadm 2021-03-10T16:33:28.696030+0000 mgr.gibba045.orlgmj (mgr.34412) 8685 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:33:30.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:33:30 gibba045 bash[25517]: cephadm 2021-03-10T16:33:28.884210+0000 mgr.gibba045.orlgmj (mgr.34412) 8686 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:33:30.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:33:30 gibba045 bash[25517]: cephadm 2021-03-10T16:33:28.885930+0000 mgr.gibba045.orlgmj (mgr.34412) 8687 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:33:30.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:33:30 gibba045 bash[25517]: cephadm 2021-03-10T16:33:28.887180+0000 mgr.gibba045.orlgmj (mgr.34412) 8688 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:33:30.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:33:30 gibba045 bash[25517]: cephadm 2021-03-10T16:33:28.887217+0000 mgr.gibba045.orlgmj (mgr.34412) 8689 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:33:30.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:33:30 gibba045 bash[25517]: cephadm 2021-03-10T16:33:28.888792+0000 mgr.gibba045.orlgmj (mgr.34412) 8690 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:33:30.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:33:30 gibba045 bash[25517]: cephadm 2021-03-10T16:33:28.888833+0000 mgr.gibba045.orlgmj (mgr.34412) 8691 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:33:30.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:33:30 gibba045 bash[25517]: cephadm 2021-03-10T16:33:28.890361+0000 mgr.gibba045.orlgmj (mgr.34412) 8692 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:33:30.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:33:30 gibba045 bash[25517]: cephadm 2021-03-10T16:33:28.892053+0000 mgr.gibba045.orlgmj (mgr.34412) 8693 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:33:30.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:33:30 gibba045 bash[25517]: cephadm 2021-03-10T16:33:28.892091+0000 mgr.gibba045.orlgmj (mgr.34412) 8694 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:33:30.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:33:30 gibba045 bash[25517]: cephadm 2021-03-10T16:33:28.893706+0000 mgr.gibba045.orlgmj (mgr.34412) 8695 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:33:30.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:33:30 gibba045 bash[25517]: cephadm 2021-03-10T16:33:28.894023+0000 mgr.gibba045.orlgmj (mgr.34412) 8696 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:33:30.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:33:30 gibba045 bash[25517]: cephadm 2021-03-10T16:33:28.895509+0000 mgr.gibba045.orlgmj (mgr.34412) 8697 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:33:30.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:33:30 gibba045 bash[25517]: cephadm 2021-03-10T16:33:28.895547+0000 mgr.gibba045.orlgmj (mgr.34412) 8698 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:33:30.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:33:30 gibba045 bash[25517]: cephadm 2021-03-10T16:33:28.895654+0000 mgr.gibba045.orlgmj (mgr.34412) 8699 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:33:31.716 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:33:31.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:33:31 gibba015 bash[29377]: cluster 2021-03-10T16:33:30.163249+0000 mgr.gibba045.orlgmj (mgr.34412) 8700 : cluster [DBG] pgmap v4950: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:31.719 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:33:31 gibba015 bash[30343]: cluster 2021-03-10T16:33:30.163249+0000 mgr.gibba045.orlgmj (mgr.34412) 8700 : cluster [DBG] pgmap v4950: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:31.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:33:31 gibba045 bash[25517]: cluster 2021-03-10T16:33:30.163249+0000 mgr.gibba045.orlgmj (mgr.34412) 8700 : cluster [DBG] pgmap v4950: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:31.942 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:33:31.943 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 7m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:33:31.943 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 6m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:33:31.943 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:33:31.943 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:33:31.943 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:33:31.944 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:33:31.944 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:33:31.944 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:33:31.944 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 7m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:33:31.945 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 6m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:33:31.945 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:33:31.945 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:33:31.945 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:33:31.945 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:33:31.945 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:33:31.946 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:33:31.946 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:33:31.946 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:33:31.946 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 6m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:33:31.946 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 6m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:33:32.190 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:33:32.190 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:33:32.191 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:33:32.191 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:33:32.191 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:33:32.191 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:33:32.192 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:33:32.192 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:33:32.192 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:33:32.192 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:33:32.192 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:33:32.193 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:33:32.193 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:33:32.193 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:33:32.193 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:33:32.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:33:32 gibba015 bash[29377]: audit 2021-03-10T16:33:32.191300+0000 mon.a (mon.0) 1948 : audit [DBG] from='client.? 172.21.2.115:0/672819825' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:33:32.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:33:32 gibba015 bash[30343]: audit 2021-03-10T16:33:32.191300+0000 mon.a (mon.0) 1948 : audit [DBG] from='client.? 172.21.2.115:0/672819825' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:33:32.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:33:32 gibba045 bash[25517]: audit 2021-03-10T16:33:32.191300+0000 mon.a (mon.0) 1948 : audit [DBG] from='client.? 172.21.2.115:0/672819825' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:33:33.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:33:33 gibba015 bash[29377]: audit 2021-03-10T16:33:31.710676+0000 mgr.gibba045.orlgmj (mgr.34412) 8701 : audit [DBG] from='client.49884 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:33:33.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:33:33 gibba015 bash[29377]: audit 2021-03-10T16:33:31.933662+0000 mgr.gibba045.orlgmj (mgr.34412) 8702 : audit [DBG] from='client.49890 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:33:33.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:33:33 gibba015 bash[29377]: cluster 2021-03-10T16:33:32.164767+0000 mgr.gibba045.orlgmj (mgr.34412) 8703 : cluster [DBG] pgmap v4951: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:33.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:33:33 gibba015 bash[30343]: audit 2021-03-10T16:33:31.710676+0000 mgr.gibba045.orlgmj (mgr.34412) 8701 : audit [DBG] from='client.49884 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:33:33.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:33:33 gibba015 bash[30343]: audit 2021-03-10T16:33:31.933662+0000 mgr.gibba045.orlgmj (mgr.34412) 8702 : audit [DBG] from='client.49890 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:33:33.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:33:33 gibba015 bash[30343]: cluster 2021-03-10T16:33:32.164767+0000 mgr.gibba045.orlgmj (mgr.34412) 8703 : cluster [DBG] pgmap v4951: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:33.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:33:33 gibba045 bash[25517]: audit 2021-03-10T16:33:31.710676+0000 mgr.gibba045.orlgmj (mgr.34412) 8701 : audit [DBG] from='client.49884 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:33:33.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:33:33 gibba045 bash[25517]: audit 2021-03-10T16:33:31.933662+0000 mgr.gibba045.orlgmj (mgr.34412) 8702 : audit [DBG] from='client.49890 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:33:33.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:33:33 gibba045 bash[25517]: cluster 2021-03-10T16:33:32.164767+0000 mgr.gibba045.orlgmj (mgr.34412) 8703 : cluster [DBG] pgmap v4951: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:35.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:33:35 gibba015 bash[29377]: cluster 2021-03-10T16:33:34.166035+0000 mgr.gibba045.orlgmj (mgr.34412) 8704 : cluster [DBG] pgmap v4952: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:35.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:33:35 gibba015 bash[30343]: cluster 2021-03-10T16:33:34.166035+0000 mgr.gibba045.orlgmj (mgr.34412) 8704 : cluster [DBG] pgmap v4952: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:35.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:33:35 gibba045 bash[25517]: cluster 2021-03-10T16:33:34.166035+0000 mgr.gibba045.orlgmj (mgr.34412) 8704 : cluster [DBG] pgmap v4952: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:37.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:33:37 gibba015 bash[29377]: cluster 2021-03-10T16:33:36.166873+0000 mgr.gibba045.orlgmj (mgr.34412) 8705 : cluster [DBG] pgmap v4953: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:37.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:33:37 gibba015 bash[30343]: cluster 2021-03-10T16:33:36.166873+0000 mgr.gibba045.orlgmj (mgr.34412) 8705 : cluster [DBG] pgmap v4953: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:37.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:33:37 gibba045 bash[25517]: cluster 2021-03-10T16:33:36.166873+0000 mgr.gibba045.orlgmj (mgr.34412) 8705 : cluster [DBG] pgmap v4953: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:39.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:33:39 gibba015 bash[29377]: cluster 2021-03-10T16:33:38.168275+0000 mgr.gibba045.orlgmj (mgr.34412) 8706 : cluster [DBG] pgmap v4954: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:39.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:33:39 gibba015 bash[30343]: cluster 2021-03-10T16:33:38.168275+0000 mgr.gibba045.orlgmj (mgr.34412) 8706 : cluster [DBG] pgmap v4954: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:39.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:33:39 gibba045 bash[25517]: cluster 2021-03-10T16:33:38.168275+0000 mgr.gibba045.orlgmj (mgr.34412) 8706 : cluster [DBG] pgmap v4954: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:41.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:33:41 gibba015 bash[29377]: cluster 2021-03-10T16:33:40.170007+0000 mgr.gibba045.orlgmj (mgr.34412) 8707 : cluster [DBG] pgmap v4955: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:41.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:33:41 gibba015 bash[30343]: cluster 2021-03-10T16:33:40.170007+0000 mgr.gibba045.orlgmj (mgr.34412) 8707 : cluster [DBG] pgmap v4955: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:41.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:33:41 gibba045 bash[25517]: cluster 2021-03-10T16:33:40.170007+0000 mgr.gibba045.orlgmj (mgr.34412) 8707 : cluster [DBG] pgmap v4955: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:43.719 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:33:43 gibba015 bash[30343]: cluster 2021-03-10T16:33:42.170883+0000 mgr.gibba045.orlgmj (mgr.34412) 8708 : cluster [DBG] pgmap v4956: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:43.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:33:43 gibba015 bash[29377]: cluster 2021-03-10T16:33:42.170883+0000 mgr.gibba045.orlgmj (mgr.34412) 8708 : cluster [DBG] pgmap v4956: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:43.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:33:43 gibba045 bash[25517]: cluster 2021-03-10T16:33:42.170883+0000 mgr.gibba045.orlgmj (mgr.34412) 8708 : cluster [DBG] pgmap v4956: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:45.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:33:45 gibba015 bash[29377]: cephadm 2021-03-10T16:33:43.910117+0000 mgr.gibba045.orlgmj (mgr.34412) 8709 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:33:45.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:33:45 gibba015 bash[29377]: cluster 2021-03-10T16:33:44.171986+0000 mgr.gibba045.orlgmj (mgr.34412) 8710 : cluster [DBG] pgmap v4957: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:45.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:33:45 gibba015 bash[30343]: cephadm 2021-03-10T16:33:43.910117+0000 mgr.gibba045.orlgmj (mgr.34412) 8709 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:33:45.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:33:45 gibba015 bash[30343]: cluster 2021-03-10T16:33:44.171986+0000 mgr.gibba045.orlgmj (mgr.34412) 8710 : cluster [DBG] pgmap v4957: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:45.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:33:45 gibba045 bash[25517]: cephadm 2021-03-10T16:33:43.910117+0000 mgr.gibba045.orlgmj (mgr.34412) 8709 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:33:45.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:33:45 gibba045 bash[25517]: cluster 2021-03-10T16:33:44.171986+0000 mgr.gibba045.orlgmj (mgr.34412) 8710 : cluster [DBG] pgmap v4957: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:47.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:33:47 gibba015 bash[29377]: cluster 2021-03-10T16:33:46.173680+0000 mgr.gibba045.orlgmj (mgr.34412) 8711 : cluster [DBG] pgmap v4958: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:47.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:33:47 gibba015 bash[30343]: cluster 2021-03-10T16:33:46.173680+0000 mgr.gibba045.orlgmj (mgr.34412) 8711 : cluster [DBG] pgmap v4958: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:47.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:33:47 gibba045 bash[25517]: cluster 2021-03-10T16:33:46.173680+0000 mgr.gibba045.orlgmj (mgr.34412) 8711 : cluster [DBG] pgmap v4958: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:49.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:33:49 gibba015 bash[29377]: cluster 2021-03-10T16:33:48.174474+0000 mgr.gibba045.orlgmj (mgr.34412) 8712 : cluster [DBG] pgmap v4959: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:49.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:33:49 gibba015 bash[30343]: cluster 2021-03-10T16:33:48.174474+0000 mgr.gibba045.orlgmj (mgr.34412) 8712 : cluster [DBG] pgmap v4959: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:49.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:33:49 gibba045 bash[25517]: cluster 2021-03-10T16:33:48.174474+0000 mgr.gibba045.orlgmj (mgr.34412) 8712 : cluster [DBG] pgmap v4959: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:51.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:33:51 gibba015 bash[29377]: cluster 2021-03-10T16:33:50.175841+0000 mgr.gibba045.orlgmj (mgr.34412) 8713 : cluster [DBG] pgmap v4960: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:51.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:33:51 gibba015 bash[30343]: cluster 2021-03-10T16:33:50.175841+0000 mgr.gibba045.orlgmj (mgr.34412) 8713 : cluster [DBG] pgmap v4960: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:51.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:33:51 gibba045 bash[25517]: cluster 2021-03-10T16:33:50.175841+0000 mgr.gibba045.orlgmj (mgr.34412) 8713 : cluster [DBG] pgmap v4960: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:53.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:33:53 gibba015 bash[29377]: cluster 2021-03-10T16:33:52.177607+0000 mgr.gibba045.orlgmj (mgr.34412) 8714 : cluster [DBG] pgmap v4961: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:53.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:33:53 gibba015 bash[30343]: cluster 2021-03-10T16:33:52.177607+0000 mgr.gibba045.orlgmj (mgr.34412) 8714 : cluster [DBG] pgmap v4961: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:53.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:33:53 gibba045 bash[25517]: cluster 2021-03-10T16:33:52.177607+0000 mgr.gibba045.orlgmj (mgr.34412) 8714 : cluster [DBG] pgmap v4961: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:54.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:33:54 gibba045 bash[25517]: audit 2021-03-10T16:33:53.636205+0000 mon.c (mon.1) 2404 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:33:54.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:33:54 gibba045 bash[25517]: audit 2021-03-10T16:33:53.637374+0000 mon.a (mon.0) 1949 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:33:54.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:33:54 gibba045 bash[25517]: audit 2021-03-10T16:33:53.637448+0000 mon.c (mon.1) 2405 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:33:54.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:33:54 gibba045 bash[25517]: audit 2021-03-10T16:33:53.638637+0000 mon.a (mon.0) 1950 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:33:54.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:33:54 gibba045 bash[25517]: audit 2021-03-10T16:33:53.652923+0000 mon.c (mon.1) 2406 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T16:33:54.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:33:54 gibba045 bash[25517]: audit 2021-03-10T16:33:53.653687+0000 mon.c (mon.1) 2407 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:33:54.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:33:54 gibba045 bash[25517]: audit 2021-03-10T16:33:53.654350+0000 mon.a (mon.0) 1951 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T16:33:54.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:33:54 gibba045 bash[25517]: audit 2021-03-10T16:33:53.654391+0000 mon.c (mon.1) 2408 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:33:54.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:33:54 gibba045 bash[25517]: audit 2021-03-10T16:33:53.655063+0000 mon.c (mon.1) 2409 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 5]}]: dispatch 2021-03-10T16:33:54.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:33:54 gibba045 bash[25517]: audit 2021-03-10T16:33:53.656473+0000 mon.a (mon.0) 1952 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:33:54.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:33:54 gibba045 bash[25517]: audit 2021-03-10T16:33:53.657432+0000 mon.a (mon.0) 1953 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:33:54.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:33:54 gibba045 bash[25517]: audit 2021-03-10T16:33:53.658376+0000 mon.a (mon.0) 1954 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 5]}]: dispatch 2021-03-10T16:33:54.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:33:54 gibba015 bash[29377]: audit 2021-03-10T16:33:53.636205+0000 mon.c (mon.1) 2404 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:33:54.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:33:54 gibba015 bash[29377]: audit 2021-03-10T16:33:53.637374+0000 mon.a (mon.0) 1949 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:33:54.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:33:54 gibba015 bash[29377]: audit 2021-03-10T16:33:53.637448+0000 mon.c (mon.1) 2405 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:33:54.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:33:54 gibba015 bash[29377]: audit 2021-03-10T16:33:53.638637+0000 mon.a (mon.0) 1950 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:33:54.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:33:54 gibba015 bash[29377]: audit 2021-03-10T16:33:53.652923+0000 mon.c (mon.1) 2406 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T16:33:54.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:33:54 gibba015 bash[29377]: audit 2021-03-10T16:33:53.653687+0000 mon.c (mon.1) 2407 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:33:54.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:33:54 gibba015 bash[29377]: audit 2021-03-10T16:33:53.654350+0000 mon.a (mon.0) 1951 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T16:33:54.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:33:54 gibba015 bash[29377]: audit 2021-03-10T16:33:53.654391+0000 mon.c (mon.1) 2408 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:33:54.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:33:54 gibba015 bash[29377]: audit 2021-03-10T16:33:53.655063+0000 mon.c (mon.1) 2409 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 5]}]: dispatch 2021-03-10T16:33:54.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:33:54 gibba015 bash[29377]: audit 2021-03-10T16:33:53.656473+0000 mon.a (mon.0) 1952 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:33:54.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:33:54 gibba015 bash[29377]: audit 2021-03-10T16:33:53.657432+0000 mon.a (mon.0) 1953 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:33:54.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:33:54 gibba015 bash[29377]: audit 2021-03-10T16:33:53.658376+0000 mon.a (mon.0) 1954 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 5]}]: dispatch 2021-03-10T16:33:54.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:33:54 gibba015 bash[30343]: audit 2021-03-10T16:33:53.636205+0000 mon.c (mon.1) 2404 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:33:54.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:33:54 gibba015 bash[30343]: audit 2021-03-10T16:33:53.637374+0000 mon.a (mon.0) 1949 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:33:54.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:33:54 gibba015 bash[30343]: audit 2021-03-10T16:33:53.637448+0000 mon.c (mon.1) 2405 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:33:54.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:33:54 gibba015 bash[30343]: audit 2021-03-10T16:33:53.638637+0000 mon.a (mon.0) 1950 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:33:54.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:33:54 gibba015 bash[30343]: audit 2021-03-10T16:33:53.652923+0000 mon.c (mon.1) 2406 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T16:33:54.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:33:54 gibba015 bash[30343]: audit 2021-03-10T16:33:53.653687+0000 mon.c (mon.1) 2407 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:33:54.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:33:54 gibba015 bash[30343]: audit 2021-03-10T16:33:53.654350+0000 mon.a (mon.0) 1951 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T16:33:54.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:33:54 gibba015 bash[30343]: audit 2021-03-10T16:33:53.654391+0000 mon.c (mon.1) 2408 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:33:54.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:33:54 gibba015 bash[30343]: audit 2021-03-10T16:33:53.655063+0000 mon.c (mon.1) 2409 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 5]}]: dispatch 2021-03-10T16:33:54.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:33:54 gibba015 bash[30343]: audit 2021-03-10T16:33:53.656473+0000 mon.a (mon.0) 1952 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:33:54.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:33:54 gibba015 bash[30343]: audit 2021-03-10T16:33:53.657432+0000 mon.a (mon.0) 1953 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:33:54.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:33:54 gibba015 bash[30343]: audit 2021-03-10T16:33:53.658376+0000 mon.a (mon.0) 1954 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 5]}]: dispatch 2021-03-10T16:33:55.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:33:55 gibba045 bash[25517]: cluster 2021-03-10T16:33:54.178207+0000 mgr.gibba045.orlgmj (mgr.34412) 8715 : cluster [DBG] pgmap v4962: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:55.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:33:55 gibba015 bash[29377]: cluster 2021-03-10T16:33:54.178207+0000 mgr.gibba045.orlgmj (mgr.34412) 8715 : cluster [DBG] pgmap v4962: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:55.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:33:55 gibba015 bash[30343]: cluster 2021-03-10T16:33:54.178207+0000 mgr.gibba045.orlgmj (mgr.34412) 8715 : cluster [DBG] pgmap v4962: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:57.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:33:57 gibba045 bash[25517]: cluster 2021-03-10T16:33:56.179884+0000 mgr.gibba045.orlgmj (mgr.34412) 8716 : cluster [DBG] pgmap v4963: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:57.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:33:57 gibba015 bash[29377]: cluster 2021-03-10T16:33:56.179884+0000 mgr.gibba045.orlgmj (mgr.34412) 8716 : cluster [DBG] pgmap v4963: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:57.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:33:57 gibba015 bash[30343]: cluster 2021-03-10T16:33:56.179884+0000 mgr.gibba045.orlgmj (mgr.34412) 8716 : cluster [DBG] pgmap v4963: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:59.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:33:59 gibba045 bash[25517]: cluster 2021-03-10T16:33:58.181528+0000 mgr.gibba045.orlgmj (mgr.34412) 8717 : cluster [DBG] pgmap v4964: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:59.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:33:59 gibba015 bash[29377]: cluster 2021-03-10T16:33:58.181528+0000 mgr.gibba045.orlgmj (mgr.34412) 8717 : cluster [DBG] pgmap v4964: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:59.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:33:59 gibba015 bash[30343]: cluster 2021-03-10T16:33:58.181528+0000 mgr.gibba045.orlgmj (mgr.34412) 8717 : cluster [DBG] pgmap v4964: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:00.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:34:00 gibba045 bash[25517]: cephadm 2021-03-10T16:33:58.919997+0000 mgr.gibba045.orlgmj (mgr.34412) 8718 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:34:00.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:34:00 gibba015 bash[29377]: cephadm 2021-03-10T16:33:58.919997+0000 mgr.gibba045.orlgmj (mgr.34412) 8718 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:34:00.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:34:00 gibba015 bash[30343]: cephadm 2021-03-10T16:33:58.919997+0000 mgr.gibba045.orlgmj (mgr.34412) 8718 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:34:01.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:34:01 gibba045 bash[25517]: cluster 2021-03-10T16:34:00.182568+0000 mgr.gibba045.orlgmj (mgr.34412) 8719 : cluster [DBG] pgmap v4965: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:01.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:34:01 gibba015 bash[29377]: cluster 2021-03-10T16:34:00.182568+0000 mgr.gibba045.orlgmj (mgr.34412) 8719 : cluster [DBG] pgmap v4965: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:01.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:34:01 gibba015 bash[30343]: cluster 2021-03-10T16:34:00.182568+0000 mgr.gibba045.orlgmj (mgr.34412) 8719 : cluster [DBG] pgmap v4965: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:02.431 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:34:02.663 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:34:02.663 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 7m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:34:02.664 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 6m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:34:02.664 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:34:02.664 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:34:02.664 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:34:02.665 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:34:02.665 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:34:02.665 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:34:02.665 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 7m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:34:02.665 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 6m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:34:02.666 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:34:02.666 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:34:02.666 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:34:02.666 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:34:02.666 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:34:02.667 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:34:02.667 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:34:02.667 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:34:02.667 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 6m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:34:02.667 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 6m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:34:02.908 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:34:02.908 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:34:02.908 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:34:02.908 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:34:02.909 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:34:02.909 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:34:02.909 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:34:02.909 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:34:02.909 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:34:02.910 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:34:02.910 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:34:02.910 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:34:02.910 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:34:02.911 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:34:02.911 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:34:03.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:34:03 gibba045 bash[25517]: cluster 2021-03-10T16:34:02.184214+0000 mgr.gibba045.orlgmj (mgr.34412) 8720 : cluster [DBG] pgmap v4966: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:03.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:34:03 gibba045 bash[25517]: audit 2021-03-10T16:34:02.424921+0000 mgr.gibba045.orlgmj (mgr.34412) 8721 : audit [DBG] from='client.49902 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:34:03.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:34:03 gibba045 bash[25517]: audit 2021-03-10T16:34:02.908632+0000 mon.c (mon.1) 2410 : audit [DBG] from='client.? 172.21.2.115:0/1161629978' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:34:03.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:34:03 gibba015 bash[29377]: cluster 2021-03-10T16:34:02.184214+0000 mgr.gibba045.orlgmj (mgr.34412) 8720 : cluster [DBG] pgmap v4966: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:03.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:34:03 gibba015 bash[29377]: audit 2021-03-10T16:34:02.424921+0000 mgr.gibba045.orlgmj (mgr.34412) 8721 : audit [DBG] from='client.49902 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:34:03.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:34:03 gibba015 bash[29377]: audit 2021-03-10T16:34:02.908632+0000 mon.c (mon.1) 2410 : audit [DBG] from='client.? 172.21.2.115:0/1161629978' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:34:03.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:34:03 gibba015 bash[30343]: cluster 2021-03-10T16:34:02.184214+0000 mgr.gibba045.orlgmj (mgr.34412) 8720 : cluster [DBG] pgmap v4966: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:03.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:34:03 gibba015 bash[30343]: audit 2021-03-10T16:34:02.424921+0000 mgr.gibba045.orlgmj (mgr.34412) 8721 : audit [DBG] from='client.49902 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:34:03.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:34:03 gibba015 bash[30343]: audit 2021-03-10T16:34:02.908632+0000 mon.c (mon.1) 2410 : audit [DBG] from='client.? 172.21.2.115:0/1161629978' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:34:04.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:34:04 gibba045 bash[25517]: audit 2021-03-10T16:34:02.654083+0000 mgr.gibba045.orlgmj (mgr.34412) 8722 : audit [DBG] from='client.59896 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:34:04.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:34:04 gibba015 bash[29377]: audit 2021-03-10T16:34:02.654083+0000 mgr.gibba045.orlgmj (mgr.34412) 8722 : audit [DBG] from='client.59896 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:34:04.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:34:04 gibba015 bash[30343]: audit 2021-03-10T16:34:02.654083+0000 mgr.gibba045.orlgmj (mgr.34412) 8722 : audit [DBG] from='client.59896 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:34:05.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:34:05 gibba045 bash[25517]: cluster 2021-03-10T16:34:04.185460+0000 mgr.gibba045.orlgmj (mgr.34412) 8723 : cluster [DBG] pgmap v4967: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:05.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:34:05 gibba015 bash[29377]: cluster 2021-03-10T16:34:04.185460+0000 mgr.gibba045.orlgmj (mgr.34412) 8723 : cluster [DBG] pgmap v4967: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:05.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:34:05 gibba015 bash[30343]: cluster 2021-03-10T16:34:04.185460+0000 mgr.gibba045.orlgmj (mgr.34412) 8723 : cluster [DBG] pgmap v4967: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:07.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:34:07 gibba045 bash[25517]: cluster 2021-03-10T16:34:06.186446+0000 mgr.gibba045.orlgmj (mgr.34412) 8724 : cluster [DBG] pgmap v4968: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:07.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:34:07 gibba015 bash[29377]: cluster 2021-03-10T16:34:06.186446+0000 mgr.gibba045.orlgmj (mgr.34412) 8724 : cluster [DBG] pgmap v4968: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:07.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:34:07 gibba015 bash[30343]: cluster 2021-03-10T16:34:06.186446+0000 mgr.gibba045.orlgmj (mgr.34412) 8724 : cluster [DBG] pgmap v4968: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:09.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:34:09 gibba015 bash[29377]: cluster 2021-03-10T16:34:08.187905+0000 mgr.gibba045.orlgmj (mgr.34412) 8725 : cluster [DBG] pgmap v4969: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:09.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:34:09 gibba015 bash[30343]: cluster 2021-03-10T16:34:08.187905+0000 mgr.gibba045.orlgmj (mgr.34412) 8725 : cluster [DBG] pgmap v4969: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:10.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:34:09 gibba045 bash[25517]: cluster 2021-03-10T16:34:08.187905+0000 mgr.gibba045.orlgmj (mgr.34412) 8725 : cluster [DBG] pgmap v4969: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:11.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:34:11 gibba015 bash[29377]: cluster 2021-03-10T16:34:10.189587+0000 mgr.gibba045.orlgmj (mgr.34412) 8726 : cluster [DBG] pgmap v4970: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:11.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:34:11 gibba015 bash[30343]: cluster 2021-03-10T16:34:10.189587+0000 mgr.gibba045.orlgmj (mgr.34412) 8726 : cluster [DBG] pgmap v4970: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:12.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:34:11 gibba045 bash[25517]: cluster 2021-03-10T16:34:10.189587+0000 mgr.gibba045.orlgmj (mgr.34412) 8726 : cluster [DBG] pgmap v4970: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:13.930 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:34:13 gibba045 bash[25517]: cluster 2021-03-10T16:34:12.190643+0000 mgr.gibba045.orlgmj (mgr.34412) 8727 : cluster [DBG] pgmap v4971: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:13.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:34:13 gibba015 bash[29377]: cluster 2021-03-10T16:34:12.190643+0000 mgr.gibba045.orlgmj (mgr.34412) 8727 : cluster [DBG] pgmap v4971: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:13.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:34:13 gibba015 bash[30343]: cluster 2021-03-10T16:34:12.190643+0000 mgr.gibba045.orlgmj (mgr.34412) 8727 : cluster [DBG] pgmap v4971: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:15.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:34:15 gibba015 bash[29377]: cephadm 2021-03-10T16:34:13.933245+0000 mgr.gibba045.orlgmj (mgr.34412) 8728 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:34:15.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:34:15 gibba015 bash[29377]: cluster 2021-03-10T16:34:14.192008+0000 mgr.gibba045.orlgmj (mgr.34412) 8729 : cluster [DBG] pgmap v4972: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:15.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:34:15 gibba015 bash[30343]: cephadm 2021-03-10T16:34:13.933245+0000 mgr.gibba045.orlgmj (mgr.34412) 8728 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:34:15.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:34:15 gibba015 bash[30343]: cluster 2021-03-10T16:34:14.192008+0000 mgr.gibba045.orlgmj (mgr.34412) 8729 : cluster [DBG] pgmap v4972: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:16.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:34:15 gibba045 bash[25517]: cephadm 2021-03-10T16:34:13.933245+0000 mgr.gibba045.orlgmj (mgr.34412) 8728 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:34:16.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:34:15 gibba045 bash[25517]: cluster 2021-03-10T16:34:14.192008+0000 mgr.gibba045.orlgmj (mgr.34412) 8729 : cluster [DBG] pgmap v4972: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:17.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:34:17 gibba015 bash[29377]: cluster 2021-03-10T16:34:16.193650+0000 mgr.gibba045.orlgmj (mgr.34412) 8730 : cluster [DBG] pgmap v4973: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:17.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:34:17 gibba015 bash[30343]: cluster 2021-03-10T16:34:16.193650+0000 mgr.gibba045.orlgmj (mgr.34412) 8730 : cluster [DBG] pgmap v4973: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:18.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:34:17 gibba045 bash[25517]: cluster 2021-03-10T16:34:16.193650+0000 mgr.gibba045.orlgmj (mgr.34412) 8730 : cluster [DBG] pgmap v4973: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:19.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:34:19 gibba015 bash[29377]: cluster 2021-03-10T16:34:18.194494+0000 mgr.gibba045.orlgmj (mgr.34412) 8731 : cluster [DBG] pgmap v4974: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:19.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:34:19 gibba015 bash[30343]: cluster 2021-03-10T16:34:18.194494+0000 mgr.gibba045.orlgmj (mgr.34412) 8731 : cluster [DBG] pgmap v4974: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:20.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:34:19 gibba045 bash[25517]: cluster 2021-03-10T16:34:18.194494+0000 mgr.gibba045.orlgmj (mgr.34412) 8731 : cluster [DBG] pgmap v4974: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:20.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:34:20 gibba015 bash[29377]: cluster 2021-03-10T16:34:20.195902+0000 mgr.gibba045.orlgmj (mgr.34412) 8732 : cluster [DBG] pgmap v4975: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:20.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:34:20 gibba015 bash[30343]: cluster 2021-03-10T16:34:20.195902+0000 mgr.gibba045.orlgmj (mgr.34412) 8732 : cluster [DBG] pgmap v4975: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:21.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:34:20 gibba045 bash[25517]: cluster 2021-03-10T16:34:20.195902+0000 mgr.gibba045.orlgmj (mgr.34412) 8732 : cluster [DBG] pgmap v4975: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:23.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:34:23 gibba045 bash[25517]: cluster 2021-03-10T16:34:22.197537+0000 mgr.gibba045.orlgmj (mgr.34412) 8733 : cluster [DBG] pgmap v4976: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:23.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:34:23 gibba015 bash[29377]: cluster 2021-03-10T16:34:22.197537+0000 mgr.gibba045.orlgmj (mgr.34412) 8733 : cluster [DBG] pgmap v4976: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:23.719 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:34:23 gibba015 bash[30343]: cluster 2021-03-10T16:34:22.197537+0000 mgr.gibba045.orlgmj (mgr.34412) 8733 : cluster [DBG] pgmap v4976: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:25.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:34:25 gibba045 bash[25517]: cluster 2021-03-10T16:34:24.198613+0000 mgr.gibba045.orlgmj (mgr.34412) 8734 : cluster [DBG] pgmap v4977: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:25.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:34:25 gibba015 bash[29377]: cluster 2021-03-10T16:34:24.198613+0000 mgr.gibba045.orlgmj (mgr.34412) 8734 : cluster [DBG] pgmap v4977: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:25.719 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:34:25 gibba015 bash[30343]: cluster 2021-03-10T16:34:24.198613+0000 mgr.gibba045.orlgmj (mgr.34412) 8734 : cluster [DBG] pgmap v4977: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:27.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:34:27 gibba045 bash[25517]: cluster 2021-03-10T16:34:26.200213+0000 mgr.gibba045.orlgmj (mgr.34412) 8735 : cluster [DBG] pgmap v4978: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:27.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:34:27 gibba015 bash[29377]: cluster 2021-03-10T16:34:26.200213+0000 mgr.gibba045.orlgmj (mgr.34412) 8735 : cluster [DBG] pgmap v4978: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:27.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:34:27 gibba015 bash[30343]: cluster 2021-03-10T16:34:26.200213+0000 mgr.gibba045.orlgmj (mgr.34412) 8735 : cluster [DBG] pgmap v4978: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:29.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:34:29 gibba045 bash[25517]: cluster 2021-03-10T16:34:28.201865+0000 mgr.gibba045.orlgmj (mgr.34412) 8736 : cluster [DBG] pgmap v4979: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:29.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:34:29 gibba045 bash[25517]: audit 2021-03-10T16:34:28.940041+0000 mon.c (mon.1) 2411 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:34:29.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:34:29 gibba045 bash[25517]: audit 2021-03-10T16:34:29.141467+0000 mon.a (mon.0) 1955 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:34:29.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:34:29 gibba045 bash[25517]: audit 2021-03-10T16:34:29.144978+0000 mon.c (mon.1) 2412 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:34:29.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:34:29 gibba045 bash[25517]: audit 2021-03-10T16:34:29.146721+0000 mon.c (mon.1) 2413 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:34:29.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:34:29 gibba045 bash[25517]: audit 2021-03-10T16:34:29.148074+0000 mon.c (mon.1) 2414 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:34:29.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:34:29 gibba045 bash[25517]: audit 2021-03-10T16:34:29.149606+0000 mon.c (mon.1) 2415 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:34:29.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:34:29 gibba045 bash[25517]: audit 2021-03-10T16:34:29.152713+0000 mon.c (mon.1) 2416 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:34:29.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:34:29 gibba045 bash[25517]: audit 2021-03-10T16:34:29.154598+0000 mon.c (mon.1) 2417 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:34:29.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:34:29 gibba015 bash[29377]: cluster 2021-03-10T16:34:28.201865+0000 mgr.gibba045.orlgmj (mgr.34412) 8736 : cluster [DBG] pgmap v4979: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:29.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:34:29 gibba015 bash[29377]: audit 2021-03-10T16:34:28.940041+0000 mon.c (mon.1) 2411 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:34:29.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:34:29 gibba015 bash[29377]: audit 2021-03-10T16:34:29.141467+0000 mon.a (mon.0) 1955 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:34:29.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:34:29 gibba015 bash[29377]: audit 2021-03-10T16:34:29.144978+0000 mon.c (mon.1) 2412 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:34:29.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:34:29 gibba015 bash[29377]: audit 2021-03-10T16:34:29.146721+0000 mon.c (mon.1) 2413 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:34:29.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:34:29 gibba015 bash[29377]: audit 2021-03-10T16:34:29.148074+0000 mon.c (mon.1) 2414 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:34:29.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:34:29 gibba015 bash[29377]: audit 2021-03-10T16:34:29.149606+0000 mon.c (mon.1) 2415 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:34:29.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:34:29 gibba015 bash[29377]: audit 2021-03-10T16:34:29.152713+0000 mon.c (mon.1) 2416 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:34:29.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:34:29 gibba015 bash[29377]: audit 2021-03-10T16:34:29.154598+0000 mon.c (mon.1) 2417 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:34:29.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:34:29 gibba015 bash[30343]: cluster 2021-03-10T16:34:28.201865+0000 mgr.gibba045.orlgmj (mgr.34412) 8736 : cluster [DBG] pgmap v4979: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:29.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:34:29 gibba015 bash[30343]: audit 2021-03-10T16:34:28.940041+0000 mon.c (mon.1) 2411 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:34:29.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:34:29 gibba015 bash[30343]: audit 2021-03-10T16:34:29.141467+0000 mon.a (mon.0) 1955 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:34:29.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:34:29 gibba015 bash[30343]: audit 2021-03-10T16:34:29.144978+0000 mon.c (mon.1) 2412 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:34:29.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:34:29 gibba015 bash[30343]: audit 2021-03-10T16:34:29.146721+0000 mon.c (mon.1) 2413 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:34:29.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:34:29 gibba015 bash[30343]: audit 2021-03-10T16:34:29.148074+0000 mon.c (mon.1) 2414 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:34:29.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:34:29 gibba015 bash[30343]: audit 2021-03-10T16:34:29.149606+0000 mon.c (mon.1) 2415 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:34:29.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:34:29 gibba015 bash[30343]: audit 2021-03-10T16:34:29.152713+0000 mon.c (mon.1) 2416 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:34:29.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:34:29 gibba015 bash[30343]: audit 2021-03-10T16:34:29.154598+0000 mon.c (mon.1) 2417 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:34:30.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:34:30 gibba015 bash[29377]: cephadm 2021-03-10T16:34:28.947613+0000 mgr.gibba045.orlgmj (mgr.34412) 8737 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:34:30.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:34:30 gibba015 bash[29377]: cephadm 2021-03-10T16:34:28.949178+0000 mgr.gibba045.orlgmj (mgr.34412) 8738 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:34:30.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:34:30 gibba015 bash[29377]: cephadm 2021-03-10T16:34:29.146701+0000 mgr.gibba045.orlgmj (mgr.34412) 8739 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:34:30.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:34:30 gibba015 bash[29377]: cephadm 2021-03-10T16:34:29.148771+0000 mgr.gibba045.orlgmj (mgr.34412) 8740 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:34:30.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:34:30 gibba015 bash[29377]: cephadm 2021-03-10T16:34:29.150275+0000 mgr.gibba045.orlgmj (mgr.34412) 8741 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:34:30.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:34:30 gibba015 bash[29377]: cephadm 2021-03-10T16:34:29.150310+0000 mgr.gibba045.orlgmj (mgr.34412) 8742 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:34:30.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:34:30 gibba015 bash[29377]: cephadm 2021-03-10T16:34:29.151640+0000 mgr.gibba045.orlgmj (mgr.34412) 8743 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:34:30.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:34:30 gibba015 bash[29377]: cephadm 2021-03-10T16:34:29.151675+0000 mgr.gibba045.orlgmj (mgr.34412) 8744 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:34:30.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:34:30 gibba015 bash[29377]: cephadm 2021-03-10T16:34:29.153015+0000 mgr.gibba045.orlgmj (mgr.34412) 8745 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:34:30.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:34:30 gibba015 bash[29377]: cephadm 2021-03-10T16:34:29.154575+0000 mgr.gibba045.orlgmj (mgr.34412) 8746 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:34:30.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:34:30 gibba015 bash[29377]: cephadm 2021-03-10T16:34:29.154684+0000 mgr.gibba045.orlgmj (mgr.34412) 8747 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:34:30.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:34:30 gibba015 bash[29377]: cephadm 2021-03-10T16:34:29.156277+0000 mgr.gibba045.orlgmj (mgr.34412) 8748 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:34:30.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:34:30 gibba015 bash[29377]: cephadm 2021-03-10T16:34:29.156887+0000 mgr.gibba045.orlgmj (mgr.34412) 8749 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:34:30.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:34:30 gibba015 bash[29377]: cephadm 2021-03-10T16:34:29.158031+0000 mgr.gibba045.orlgmj (mgr.34412) 8750 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:34:30.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:34:30 gibba015 bash[29377]: cephadm 2021-03-10T16:34:29.158128+0000 mgr.gibba045.orlgmj (mgr.34412) 8751 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:34:30.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:34:30 gibba015 bash[29377]: cephadm 2021-03-10T16:34:29.158232+0000 mgr.gibba045.orlgmj (mgr.34412) 8752 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:34:30.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:34:30 gibba015 bash[30343]: cephadm 2021-03-10T16:34:28.947613+0000 mgr.gibba045.orlgmj (mgr.34412) 8737 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:34:30.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:34:30 gibba015 bash[30343]: cephadm 2021-03-10T16:34:28.949178+0000 mgr.gibba045.orlgmj (mgr.34412) 8738 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:34:30.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:34:30 gibba015 bash[30343]: cephadm 2021-03-10T16:34:29.146701+0000 mgr.gibba045.orlgmj (mgr.34412) 8739 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:34:30.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:34:30 gibba015 bash[30343]: cephadm 2021-03-10T16:34:29.148771+0000 mgr.gibba045.orlgmj (mgr.34412) 8740 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:34:30.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:34:30 gibba015 bash[30343]: cephadm 2021-03-10T16:34:29.150275+0000 mgr.gibba045.orlgmj (mgr.34412) 8741 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:34:30.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:34:30 gibba015 bash[30343]: cephadm 2021-03-10T16:34:29.150310+0000 mgr.gibba045.orlgmj (mgr.34412) 8742 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:34:30.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:34:30 gibba015 bash[30343]: cephadm 2021-03-10T16:34:29.151640+0000 mgr.gibba045.orlgmj (mgr.34412) 8743 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:34:30.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:34:30 gibba015 bash[30343]: cephadm 2021-03-10T16:34:29.151675+0000 mgr.gibba045.orlgmj (mgr.34412) 8744 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:34:30.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:34:30 gibba015 bash[30343]: cephadm 2021-03-10T16:34:29.153015+0000 mgr.gibba045.orlgmj (mgr.34412) 8745 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:34:30.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:34:30 gibba015 bash[30343]: cephadm 2021-03-10T16:34:29.154575+0000 mgr.gibba045.orlgmj (mgr.34412) 8746 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:34:30.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:34:30 gibba015 bash[30343]: cephadm 2021-03-10T16:34:29.154684+0000 mgr.gibba045.orlgmj (mgr.34412) 8747 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:34:30.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:34:30 gibba015 bash[30343]: cephadm 2021-03-10T16:34:29.156277+0000 mgr.gibba045.orlgmj (mgr.34412) 8748 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:34:30.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:34:30 gibba015 bash[30343]: cephadm 2021-03-10T16:34:29.156887+0000 mgr.gibba045.orlgmj (mgr.34412) 8749 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:34:30.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:34:30 gibba015 bash[30343]: cephadm 2021-03-10T16:34:29.158031+0000 mgr.gibba045.orlgmj (mgr.34412) 8750 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:34:30.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:34:30 gibba015 bash[30343]: cephadm 2021-03-10T16:34:29.158128+0000 mgr.gibba045.orlgmj (mgr.34412) 8751 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:34:30.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:34:30 gibba015 bash[30343]: cephadm 2021-03-10T16:34:29.158232+0000 mgr.gibba045.orlgmj (mgr.34412) 8752 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:34:30.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:34:30 gibba045 bash[25517]: cephadm 2021-03-10T16:34:28.947613+0000 mgr.gibba045.orlgmj (mgr.34412) 8737 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:34:30.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:34:30 gibba045 bash[25517]: cephadm 2021-03-10T16:34:28.949178+0000 mgr.gibba045.orlgmj (mgr.34412) 8738 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:34:30.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:34:30 gibba045 bash[25517]: cephadm 2021-03-10T16:34:29.146701+0000 mgr.gibba045.orlgmj (mgr.34412) 8739 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:34:30.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:34:30 gibba045 bash[25517]: cephadm 2021-03-10T16:34:29.148771+0000 mgr.gibba045.orlgmj (mgr.34412) 8740 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:34:30.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:34:30 gibba045 bash[25517]: cephadm 2021-03-10T16:34:29.150275+0000 mgr.gibba045.orlgmj (mgr.34412) 8741 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:34:30.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:34:30 gibba045 bash[25517]: cephadm 2021-03-10T16:34:29.150310+0000 mgr.gibba045.orlgmj (mgr.34412) 8742 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:34:30.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:34:30 gibba045 bash[25517]: cephadm 2021-03-10T16:34:29.151640+0000 mgr.gibba045.orlgmj (mgr.34412) 8743 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:34:30.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:34:30 gibba045 bash[25517]: cephadm 2021-03-10T16:34:29.151675+0000 mgr.gibba045.orlgmj (mgr.34412) 8744 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:34:30.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:34:30 gibba045 bash[25517]: cephadm 2021-03-10T16:34:29.153015+0000 mgr.gibba045.orlgmj (mgr.34412) 8745 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:34:30.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:34:30 gibba045 bash[25517]: cephadm 2021-03-10T16:34:29.154575+0000 mgr.gibba045.orlgmj (mgr.34412) 8746 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:34:30.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:34:30 gibba045 bash[25517]: cephadm 2021-03-10T16:34:29.154684+0000 mgr.gibba045.orlgmj (mgr.34412) 8747 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:34:30.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:34:30 gibba045 bash[25517]: cephadm 2021-03-10T16:34:29.156277+0000 mgr.gibba045.orlgmj (mgr.34412) 8748 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:34:30.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:34:30 gibba045 bash[25517]: cephadm 2021-03-10T16:34:29.156887+0000 mgr.gibba045.orlgmj (mgr.34412) 8749 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:34:30.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:34:30 gibba045 bash[25517]: cephadm 2021-03-10T16:34:29.158031+0000 mgr.gibba045.orlgmj (mgr.34412) 8750 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:34:30.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:34:30 gibba045 bash[25517]: cephadm 2021-03-10T16:34:29.158128+0000 mgr.gibba045.orlgmj (mgr.34412) 8751 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:34:30.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:34:30 gibba045 bash[25517]: cephadm 2021-03-10T16:34:29.158232+0000 mgr.gibba045.orlgmj (mgr.34412) 8752 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:34:31.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:34:31 gibba015 bash[29377]: cluster 2021-03-10T16:34:30.203017+0000 mgr.gibba045.orlgmj (mgr.34412) 8753 : cluster [DBG] pgmap v4980: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:31.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:34:31 gibba015 bash[30343]: cluster 2021-03-10T16:34:30.203017+0000 mgr.gibba045.orlgmj (mgr.34412) 8753 : cluster [DBG] pgmap v4980: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:31.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:34:31 gibba045 bash[25517]: cluster 2021-03-10T16:34:30.203017+0000 mgr.gibba045.orlgmj (mgr.34412) 8753 : cluster [DBG] pgmap v4980: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:33.146 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:34:33.371 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:34:33.371 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 8m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:34:33.371 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 7m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:34:33.371 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:34:33.372 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:34:33.372 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:34:33.372 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:34:33.372 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:34:33.372 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:34:33.373 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 8m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:34:33.373 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 7m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:34:33.373 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:34:33.373 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:34:33.374 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:34:33.374 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:34:33.374 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:34:33.374 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:34:33.375 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:34:33.375 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:34:33.375 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 7m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:34:33.375 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 7m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:34:33.621 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:34:33.621 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:34:33.622 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:34:33.622 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:34:33.622 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:34:33.622 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:34:33.623 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:34:33.623 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:34:33.623 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:34:33.623 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:34:33.623 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:34:33.624 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:34:33.624 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:34:33.624 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:34:33.624 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:34:33.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:34:33 gibba015 bash[29377]: cluster 2021-03-10T16:34:32.204633+0000 mgr.gibba045.orlgmj (mgr.34412) 8754 : cluster [DBG] pgmap v4981: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:33.719 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:34:33 gibba015 bash[30343]: cluster 2021-03-10T16:34:32.204633+0000 mgr.gibba045.orlgmj (mgr.34412) 8754 : cluster [DBG] pgmap v4981: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:33.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:34:33 gibba045 bash[25517]: cluster 2021-03-10T16:34:32.204633+0000 mgr.gibba045.orlgmj (mgr.34412) 8754 : cluster [DBG] pgmap v4981: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:34.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:34:34 gibba015 bash[29377]: audit 2021-03-10T16:34:33.142623+0000 mgr.gibba045.orlgmj (mgr.34412) 8755 : audit [DBG] from='client.49920 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:34:34.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:34:34 gibba015 bash[29377]: audit 2021-03-10T16:34:33.365262+0000 mgr.gibba045.orlgmj (mgr.34412) 8756 : audit [DBG] from='client.49926 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:34:34.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:34:34 gibba015 bash[29377]: audit 2021-03-10T16:34:33.622267+0000 mon.c (mon.1) 2418 : audit [DBG] from='client.? 172.21.2.115:0/3688954913' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:34:34.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:34:34 gibba015 bash[30343]: audit 2021-03-10T16:34:33.142623+0000 mgr.gibba045.orlgmj (mgr.34412) 8755 : audit [DBG] from='client.49920 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:34:34.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:34:34 gibba015 bash[30343]: audit 2021-03-10T16:34:33.365262+0000 mgr.gibba045.orlgmj (mgr.34412) 8756 : audit [DBG] from='client.49926 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:34:34.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:34:34 gibba015 bash[30343]: audit 2021-03-10T16:34:33.622267+0000 mon.c (mon.1) 2418 : audit [DBG] from='client.? 172.21.2.115:0/3688954913' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:34:34.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:34:34 gibba045 bash[25517]: audit 2021-03-10T16:34:33.142623+0000 mgr.gibba045.orlgmj (mgr.34412) 8755 : audit [DBG] from='client.49920 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:34:34.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:34:34 gibba045 bash[25517]: audit 2021-03-10T16:34:33.365262+0000 mgr.gibba045.orlgmj (mgr.34412) 8756 : audit [DBG] from='client.49926 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:34:34.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:34:34 gibba045 bash[25517]: audit 2021-03-10T16:34:33.622267+0000 mon.c (mon.1) 2418 : audit [DBG] from='client.? 172.21.2.115:0/3688954913' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:34:35.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:34:35 gibba015 bash[29377]: cluster 2021-03-10T16:34:34.205779+0000 mgr.gibba045.orlgmj (mgr.34412) 8757 : cluster [DBG] pgmap v4982: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:35.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:34:35 gibba015 bash[30343]: cluster 2021-03-10T16:34:34.205779+0000 mgr.gibba045.orlgmj (mgr.34412) 8757 : cluster [DBG] pgmap v4982: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:35.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:34:35 gibba045 bash[25517]: cluster 2021-03-10T16:34:34.205779+0000 mgr.gibba045.orlgmj (mgr.34412) 8757 : cluster [DBG] pgmap v4982: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:37.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:34:37 gibba015 bash[29377]: cluster 2021-03-10T16:34:36.207308+0000 mgr.gibba045.orlgmj (mgr.34412) 8758 : cluster [DBG] pgmap v4983: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:37.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:34:37 gibba015 bash[30343]: cluster 2021-03-10T16:34:36.207308+0000 mgr.gibba045.orlgmj (mgr.34412) 8758 : cluster [DBG] pgmap v4983: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:37.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:34:37 gibba045 bash[25517]: cluster 2021-03-10T16:34:36.207308+0000 mgr.gibba045.orlgmj (mgr.34412) 8758 : cluster [DBG] pgmap v4983: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:39.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:34:39 gibba015 bash[29377]: cluster 2021-03-10T16:34:38.208816+0000 mgr.gibba045.orlgmj (mgr.34412) 8759 : cluster [DBG] pgmap v4984: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:39.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:34:39 gibba015 bash[30343]: cluster 2021-03-10T16:34:38.208816+0000 mgr.gibba045.orlgmj (mgr.34412) 8759 : cluster [DBG] pgmap v4984: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:39.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:34:39 gibba045 bash[25517]: cluster 2021-03-10T16:34:38.208816+0000 mgr.gibba045.orlgmj (mgr.34412) 8759 : cluster [DBG] pgmap v4984: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:41.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:34:41 gibba015 bash[29377]: cluster 2021-03-10T16:34:40.210195+0000 mgr.gibba045.orlgmj (mgr.34412) 8760 : cluster [DBG] pgmap v4985: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:41.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:34:41 gibba015 bash[30343]: cluster 2021-03-10T16:34:40.210195+0000 mgr.gibba045.orlgmj (mgr.34412) 8760 : cluster [DBG] pgmap v4985: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:41.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:34:41 gibba045 bash[25517]: cluster 2021-03-10T16:34:40.210195+0000 mgr.gibba045.orlgmj (mgr.34412) 8760 : cluster [DBG] pgmap v4985: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:43.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:34:43 gibba015 bash[29377]: cluster 2021-03-10T16:34:42.211260+0000 mgr.gibba045.orlgmj (mgr.34412) 8761 : cluster [DBG] pgmap v4986: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:43.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:34:43 gibba015 bash[30343]: cluster 2021-03-10T16:34:42.211260+0000 mgr.gibba045.orlgmj (mgr.34412) 8761 : cluster [DBG] pgmap v4986: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:43.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:34:43 gibba045 bash[25517]: cluster 2021-03-10T16:34:42.211260+0000 mgr.gibba045.orlgmj (mgr.34412) 8761 : cluster [DBG] pgmap v4986: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:45.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:34:45 gibba015 bash[29377]: cephadm 2021-03-10T16:34:44.174035+0000 mgr.gibba045.orlgmj (mgr.34412) 8762 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:34:45.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:34:45 gibba015 bash[29377]: cluster 2021-03-10T16:34:44.212409+0000 mgr.gibba045.orlgmj (mgr.34412) 8763 : cluster [DBG] pgmap v4987: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:45.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:34:45 gibba015 bash[30343]: cephadm 2021-03-10T16:34:44.174035+0000 mgr.gibba045.orlgmj (mgr.34412) 8762 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:34:45.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:34:45 gibba015 bash[30343]: cluster 2021-03-10T16:34:44.212409+0000 mgr.gibba045.orlgmj (mgr.34412) 8763 : cluster [DBG] pgmap v4987: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:45.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:34:45 gibba045 bash[25517]: cephadm 2021-03-10T16:34:44.174035+0000 mgr.gibba045.orlgmj (mgr.34412) 8762 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:34:45.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:34:45 gibba045 bash[25517]: cluster 2021-03-10T16:34:44.212409+0000 mgr.gibba045.orlgmj (mgr.34412) 8763 : cluster [DBG] pgmap v4987: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:47.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:34:47 gibba015 bash[29377]: cluster 2021-03-10T16:34:46.214002+0000 mgr.gibba045.orlgmj (mgr.34412) 8764 : cluster [DBG] pgmap v4988: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:47.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:34:47 gibba015 bash[30343]: cluster 2021-03-10T16:34:46.214002+0000 mgr.gibba045.orlgmj (mgr.34412) 8764 : cluster [DBG] pgmap v4988: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:47.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:34:47 gibba045 bash[25517]: cluster 2021-03-10T16:34:46.214002+0000 mgr.gibba045.orlgmj (mgr.34412) 8764 : cluster [DBG] pgmap v4988: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:49.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:34:49 gibba015 bash[29377]: cluster 2021-03-10T16:34:48.215623+0000 mgr.gibba045.orlgmj (mgr.34412) 8765 : cluster [DBG] pgmap v4989: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:49.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:34:49 gibba015 bash[30343]: cluster 2021-03-10T16:34:48.215623+0000 mgr.gibba045.orlgmj (mgr.34412) 8765 : cluster [DBG] pgmap v4989: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:49.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:34:49 gibba045 bash[25517]: cluster 2021-03-10T16:34:48.215623+0000 mgr.gibba045.orlgmj (mgr.34412) 8765 : cluster [DBG] pgmap v4989: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:51.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:34:51 gibba015 bash[29377]: cluster 2021-03-10T16:34:50.217189+0000 mgr.gibba045.orlgmj (mgr.34412) 8766 : cluster [DBG] pgmap v4990: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:51.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:34:51 gibba015 bash[30343]: cluster 2021-03-10T16:34:50.217189+0000 mgr.gibba045.orlgmj (mgr.34412) 8766 : cluster [DBG] pgmap v4990: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:51.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:34:51 gibba045 bash[25517]: cluster 2021-03-10T16:34:50.217189+0000 mgr.gibba045.orlgmj (mgr.34412) 8766 : cluster [DBG] pgmap v4990: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:53.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:34:53 gibba015 bash[29377]: cluster 2021-03-10T16:34:52.218886+0000 mgr.gibba045.orlgmj (mgr.34412) 8767 : cluster [DBG] pgmap v4991: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:53.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:34:53 gibba015 bash[30343]: cluster 2021-03-10T16:34:52.218886+0000 mgr.gibba045.orlgmj (mgr.34412) 8767 : cluster [DBG] pgmap v4991: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:53.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:34:53 gibba045 bash[25517]: cluster 2021-03-10T16:34:52.218886+0000 mgr.gibba045.orlgmj (mgr.34412) 8767 : cluster [DBG] pgmap v4991: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:54.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:34:54 gibba015 bash[29377]: audit 2021-03-10T16:34:53.643896+0000 mon.c (mon.1) 2419 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:34:54.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:34:54 gibba015 bash[29377]: audit 2021-03-10T16:34:53.644993+0000 mon.a (mon.0) 1956 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:34:54.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:34:54 gibba015 bash[29377]: audit 2021-03-10T16:34:53.645393+0000 mon.c (mon.1) 2420 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:34:54.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:34:54 gibba015 bash[29377]: audit 2021-03-10T16:34:53.646480+0000 mon.a (mon.0) 1957 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:34:54.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:34:54 gibba015 bash[29377]: audit 2021-03-10T16:34:53.659996+0000 mon.c (mon.1) 2421 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T16:34:54.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:34:54 gibba015 bash[29377]: audit 2021-03-10T16:34:53.660915+0000 mon.c (mon.1) 2422 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:34:54.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:34:54 gibba015 bash[29377]: audit 2021-03-10T16:34:53.661128+0000 mon.a (mon.0) 1958 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T16:34:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:34:54 gibba015 bash[29377]: audit 2021-03-10T16:34:53.661874+0000 mon.c (mon.1) 2423 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:34:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:34:54 gibba015 bash[29377]: audit 2021-03-10T16:34:53.662374+0000 mon.a (mon.0) 1959 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:34:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:34:54 gibba015 bash[29377]: audit 2021-03-10T16:34:53.663061+0000 mon.c (mon.1) 2424 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:34:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:34:54 gibba015 bash[29377]: audit 2021-03-10T16:34:53.663665+0000 mon.a (mon.0) 1960 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:34:54.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:34:54 gibba015 bash[29377]: audit 2021-03-10T16:34:53.664681+0000 mon.a (mon.0) 1961 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:34:54.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:34:54 gibba015 bash[30343]: audit 2021-03-10T16:34:53.643896+0000 mon.c (mon.1) 2419 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:34:54.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:34:54 gibba015 bash[30343]: audit 2021-03-10T16:34:53.644993+0000 mon.a (mon.0) 1956 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:34:54.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:34:54 gibba015 bash[30343]: audit 2021-03-10T16:34:53.645393+0000 mon.c (mon.1) 2420 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:34:54.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:34:54 gibba015 bash[30343]: audit 2021-03-10T16:34:53.646480+0000 mon.a (mon.0) 1957 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:34:54.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:34:54 gibba015 bash[30343]: audit 2021-03-10T16:34:53.659996+0000 mon.c (mon.1) 2421 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T16:34:54.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:34:54 gibba015 bash[30343]: audit 2021-03-10T16:34:53.660915+0000 mon.c (mon.1) 2422 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:34:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:34:54 gibba015 bash[30343]: audit 2021-03-10T16:34:53.661128+0000 mon.a (mon.0) 1958 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T16:34:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:34:54 gibba015 bash[30343]: audit 2021-03-10T16:34:53.661874+0000 mon.c (mon.1) 2423 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:34:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:34:54 gibba015 bash[30343]: audit 2021-03-10T16:34:53.662374+0000 mon.a (mon.0) 1959 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:34:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:34:54 gibba015 bash[30343]: audit 2021-03-10T16:34:53.663061+0000 mon.c (mon.1) 2424 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:34:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:34:54 gibba015 bash[30343]: audit 2021-03-10T16:34:53.663665+0000 mon.a (mon.0) 1960 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:34:54.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:34:54 gibba015 bash[30343]: audit 2021-03-10T16:34:53.664681+0000 mon.a (mon.0) 1961 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:34:54.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:34:54 gibba045 bash[25517]: audit 2021-03-10T16:34:53.643896+0000 mon.c (mon.1) 2419 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:34:54.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:34:54 gibba045 bash[25517]: audit 2021-03-10T16:34:53.644993+0000 mon.a (mon.0) 1956 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:34:54.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:34:54 gibba045 bash[25517]: audit 2021-03-10T16:34:53.645393+0000 mon.c (mon.1) 2420 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:34:54.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:34:54 gibba045 bash[25517]: audit 2021-03-10T16:34:53.646480+0000 mon.a (mon.0) 1957 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:34:54.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:34:54 gibba045 bash[25517]: audit 2021-03-10T16:34:53.659996+0000 mon.c (mon.1) 2421 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T16:34:54.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:34:54 gibba045 bash[25517]: audit 2021-03-10T16:34:53.660915+0000 mon.c (mon.1) 2422 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:34:54.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:34:54 gibba045 bash[25517]: audit 2021-03-10T16:34:53.661128+0000 mon.a (mon.0) 1958 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T16:34:54.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:34:54 gibba045 bash[25517]: audit 2021-03-10T16:34:53.661874+0000 mon.c (mon.1) 2423 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:34:54.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:34:54 gibba045 bash[25517]: audit 2021-03-10T16:34:53.662374+0000 mon.a (mon.0) 1959 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:34:54.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:34:54 gibba045 bash[25517]: audit 2021-03-10T16:34:53.663061+0000 mon.c (mon.1) 2424 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:34:54.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:34:54 gibba045 bash[25517]: audit 2021-03-10T16:34:53.663665+0000 mon.a (mon.0) 1960 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:34:54.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:34:54 gibba045 bash[25517]: audit 2021-03-10T16:34:53.664681+0000 mon.a (mon.0) 1961 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:34:55.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:34:55 gibba015 bash[29377]: cluster 2021-03-10T16:34:54.220128+0000 mgr.gibba045.orlgmj (mgr.34412) 8768 : cluster [DBG] pgmap v4992: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:55.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:34:55 gibba015 bash[30343]: cluster 2021-03-10T16:34:54.220128+0000 mgr.gibba045.orlgmj (mgr.34412) 8768 : cluster [DBG] pgmap v4992: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:55.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:34:55 gibba045 bash[25517]: cluster 2021-03-10T16:34:54.220128+0000 mgr.gibba045.orlgmj (mgr.34412) 8768 : cluster [DBG] pgmap v4992: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:57.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:34:57 gibba015 bash[29377]: cluster 2021-03-10T16:34:56.221793+0000 mgr.gibba045.orlgmj (mgr.34412) 8769 : cluster [DBG] pgmap v4993: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:57.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:34:57 gibba015 bash[30343]: cluster 2021-03-10T16:34:56.221793+0000 mgr.gibba045.orlgmj (mgr.34412) 8769 : cluster [DBG] pgmap v4993: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:57.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:34:57 gibba045 bash[25517]: cluster 2021-03-10T16:34:56.221793+0000 mgr.gibba045.orlgmj (mgr.34412) 8769 : cluster [DBG] pgmap v4993: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:59.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:34:59 gibba015 bash[29377]: cluster 2021-03-10T16:34:58.223301+0000 mgr.gibba045.orlgmj (mgr.34412) 8770 : cluster [DBG] pgmap v4994: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:59.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:34:59 gibba015 bash[30343]: cluster 2021-03-10T16:34:58.223301+0000 mgr.gibba045.orlgmj (mgr.34412) 8770 : cluster [DBG] pgmap v4994: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:59.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:34:59 gibba045 bash[25517]: cluster 2021-03-10T16:34:58.223301+0000 mgr.gibba045.orlgmj (mgr.34412) 8770 : cluster [DBG] pgmap v4994: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:00.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:35:00 gibba015 bash[29377]: cephadm 2021-03-10T16:34:59.189837+0000 mgr.gibba045.orlgmj (mgr.34412) 8771 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:35:00.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:35:00 gibba015 bash[30343]: cephadm 2021-03-10T16:34:59.189837+0000 mgr.gibba045.orlgmj (mgr.34412) 8771 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:35:00.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:35:00 gibba045 bash[25517]: cephadm 2021-03-10T16:34:59.189837+0000 mgr.gibba045.orlgmj (mgr.34412) 8771 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:35:01.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:35:01 gibba015 bash[29377]: cluster 2021-03-10T16:35:00.224727+0000 mgr.gibba045.orlgmj (mgr.34412) 8772 : cluster [DBG] pgmap v4995: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:01.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:35:01 gibba015 bash[30343]: cluster 2021-03-10T16:35:00.224727+0000 mgr.gibba045.orlgmj (mgr.34412) 8772 : cluster [DBG] pgmap v4995: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:01.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:35:01 gibba045 bash[25517]: cluster 2021-03-10T16:35:00.224727+0000 mgr.gibba045.orlgmj (mgr.34412) 8772 : cluster [DBG] pgmap v4995: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:03.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:35:03 gibba045 bash[25517]: cluster 2021-03-10T16:35:02.226374+0000 mgr.gibba045.orlgmj (mgr.34412) 8773 : cluster [DBG] pgmap v4996: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:03.864 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:35:03.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:35:03 gibba015 bash[29377]: cluster 2021-03-10T16:35:02.226374+0000 mgr.gibba045.orlgmj (mgr.34412) 8773 : cluster [DBG] pgmap v4996: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:03.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:35:03 gibba015 bash[30343]: cluster 2021-03-10T16:35:02.226374+0000 mgr.gibba045.orlgmj (mgr.34412) 8773 : cluster [DBG] pgmap v4996: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:04.089 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:35:04.090 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 8m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:35:04.090 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 7m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:35:04.090 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:35:04.090 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:35:04.091 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:35:04.091 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:35:04.091 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:35:04.091 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:35:04.091 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 8m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:35:04.092 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 7m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:35:04.092 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:35:04.092 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:35:04.092 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:35:04.092 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:35:04.093 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:35:04.093 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:35:04.093 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:35:04.093 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:35:04.094 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 7m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:35:04.094 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 7m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:35:04.338 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:35:04.339 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:35:04.339 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:35:04.339 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:35:04.339 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:35:04.340 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:35:04.340 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:35:04.340 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:35:04.340 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:35:04.340 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:35:04.341 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:35:04.341 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:35:04.341 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:35:04.341 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:35:04.341 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:35:04.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:35:04 gibba045 bash[25517]: audit 2021-03-10T16:35:04.339739+0000 mon.a (mon.0) 1962 : audit [DBG] from='client.? 172.21.2.115:0/2959836349' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:35:04.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:35:04 gibba015 bash[29377]: audit 2021-03-10T16:35:04.339739+0000 mon.a (mon.0) 1962 : audit [DBG] from='client.? 172.21.2.115:0/2959836349' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:35:04.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:35:04 gibba015 bash[30343]: audit 2021-03-10T16:35:04.339739+0000 mon.a (mon.0) 1962 : audit [DBG] from='client.? 172.21.2.115:0/2959836349' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:35:05.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:35:05 gibba045 bash[25517]: audit 2021-03-10T16:35:03.859703+0000 mgr.gibba045.orlgmj (mgr.34412) 8774 : audit [DBG] from='client.59926 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:35:05.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:35:05 gibba045 bash[25517]: audit 2021-03-10T16:35:04.080009+0000 mgr.gibba045.orlgmj (mgr.34412) 8775 : audit [DBG] from='client.49944 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:35:05.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:35:05 gibba045 bash[25517]: cluster 2021-03-10T16:35:04.227599+0000 mgr.gibba045.orlgmj (mgr.34412) 8776 : cluster [DBG] pgmap v4997: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:05.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:35:05 gibba015 bash[29377]: audit 2021-03-10T16:35:03.859703+0000 mgr.gibba045.orlgmj (mgr.34412) 8774 : audit [DBG] from='client.59926 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:35:05.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:35:05 gibba015 bash[29377]: audit 2021-03-10T16:35:04.080009+0000 mgr.gibba045.orlgmj (mgr.34412) 8775 : audit [DBG] from='client.49944 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:35:05.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:35:05 gibba015 bash[29377]: cluster 2021-03-10T16:35:04.227599+0000 mgr.gibba045.orlgmj (mgr.34412) 8776 : cluster [DBG] pgmap v4997: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:05.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:35:05 gibba015 bash[30343]: audit 2021-03-10T16:35:03.859703+0000 mgr.gibba045.orlgmj (mgr.34412) 8774 : audit [DBG] from='client.59926 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:35:05.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:35:05 gibba015 bash[30343]: audit 2021-03-10T16:35:04.080009+0000 mgr.gibba045.orlgmj (mgr.34412) 8775 : audit [DBG] from='client.49944 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:35:05.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:35:05 gibba015 bash[30343]: cluster 2021-03-10T16:35:04.227599+0000 mgr.gibba045.orlgmj (mgr.34412) 8776 : cluster [DBG] pgmap v4997: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:07.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:35:07 gibba045 bash[25517]: cluster 2021-03-10T16:35:06.229363+0000 mgr.gibba045.orlgmj (mgr.34412) 8777 : cluster [DBG] pgmap v4998: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:07.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:35:07 gibba015 bash[29377]: cluster 2021-03-10T16:35:06.229363+0000 mgr.gibba045.orlgmj (mgr.34412) 8777 : cluster [DBG] pgmap v4998: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:07.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:35:07 gibba015 bash[30343]: cluster 2021-03-10T16:35:06.229363+0000 mgr.gibba045.orlgmj (mgr.34412) 8777 : cluster [DBG] pgmap v4998: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:09.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:35:09 gibba045 bash[25517]: cluster 2021-03-10T16:35:08.231047+0000 mgr.gibba045.orlgmj (mgr.34412) 8778 : cluster [DBG] pgmap v4999: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:09.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:35:09 gibba015 bash[29377]: cluster 2021-03-10T16:35:08.231047+0000 mgr.gibba045.orlgmj (mgr.34412) 8778 : cluster [DBG] pgmap v4999: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:09.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:35:09 gibba015 bash[30343]: cluster 2021-03-10T16:35:08.231047+0000 mgr.gibba045.orlgmj (mgr.34412) 8778 : cluster [DBG] pgmap v4999: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:11.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:35:11 gibba045 bash[25517]: cluster 2021-03-10T16:35:10.232782+0000 mgr.gibba045.orlgmj (mgr.34412) 8779 : cluster [DBG] pgmap v5000: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:11.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:35:11 gibba015 bash[29377]: cluster 2021-03-10T16:35:10.232782+0000 mgr.gibba045.orlgmj (mgr.34412) 8779 : cluster [DBG] pgmap v5000: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:11.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:35:11 gibba015 bash[30343]: cluster 2021-03-10T16:35:10.232782+0000 mgr.gibba045.orlgmj (mgr.34412) 8779 : cluster [DBG] pgmap v5000: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:13.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:35:13 gibba045 bash[25517]: cluster 2021-03-10T16:35:12.234358+0000 mgr.gibba045.orlgmj (mgr.34412) 8780 : cluster [DBG] pgmap v5001: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:13.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:35:13 gibba015 bash[29377]: cluster 2021-03-10T16:35:12.234358+0000 mgr.gibba045.orlgmj (mgr.34412) 8780 : cluster [DBG] pgmap v5001: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:13.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:35:13 gibba015 bash[30343]: cluster 2021-03-10T16:35:12.234358+0000 mgr.gibba045.orlgmj (mgr.34412) 8780 : cluster [DBG] pgmap v5001: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:15.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:35:15 gibba045 bash[25517]: cephadm 2021-03-10T16:35:14.196992+0000 mgr.gibba045.orlgmj (mgr.34412) 8781 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:35:15.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:35:15 gibba045 bash[25517]: cluster 2021-03-10T16:35:14.235581+0000 mgr.gibba045.orlgmj (mgr.34412) 8782 : cluster [DBG] pgmap v5002: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:15.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:35:15 gibba015 bash[29377]: cephadm 2021-03-10T16:35:14.196992+0000 mgr.gibba045.orlgmj (mgr.34412) 8781 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:35:15.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:35:15 gibba015 bash[29377]: cluster 2021-03-10T16:35:14.235581+0000 mgr.gibba045.orlgmj (mgr.34412) 8782 : cluster [DBG] pgmap v5002: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:15.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:35:15 gibba015 bash[30343]: cephadm 2021-03-10T16:35:14.196992+0000 mgr.gibba045.orlgmj (mgr.34412) 8781 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:35:15.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:35:15 gibba015 bash[30343]: cluster 2021-03-10T16:35:14.235581+0000 mgr.gibba045.orlgmj (mgr.34412) 8782 : cluster [DBG] pgmap v5002: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:17.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:35:17 gibba045 bash[25517]: cluster 2021-03-10T16:35:16.237435+0000 mgr.gibba045.orlgmj (mgr.34412) 8783 : cluster [DBG] pgmap v5003: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:17.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:35:17 gibba015 bash[29377]: cluster 2021-03-10T16:35:16.237435+0000 mgr.gibba045.orlgmj (mgr.34412) 8783 : cluster [DBG] pgmap v5003: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:17.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:35:17 gibba015 bash[30343]: cluster 2021-03-10T16:35:16.237435+0000 mgr.gibba045.orlgmj (mgr.34412) 8783 : cluster [DBG] pgmap v5003: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:19.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:35:19 gibba015 bash[29377]: cluster 2021-03-10T16:35:18.239052+0000 mgr.gibba045.orlgmj (mgr.34412) 8784 : cluster [DBG] pgmap v5004: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:19.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:35:19 gibba015 bash[30343]: cluster 2021-03-10T16:35:18.239052+0000 mgr.gibba045.orlgmj (mgr.34412) 8784 : cluster [DBG] pgmap v5004: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:20.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:35:19 gibba045 bash[25517]: cluster 2021-03-10T16:35:18.239052+0000 mgr.gibba045.orlgmj (mgr.34412) 8784 : cluster [DBG] pgmap v5004: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:21.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:35:21 gibba015 bash[29377]: cluster 2021-03-10T16:35:20.240734+0000 mgr.gibba045.orlgmj (mgr.34412) 8785 : cluster [DBG] pgmap v5005: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:22.174 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:35:21 gibba015 bash[30343]: cluster 2021-03-10T16:35:20.240734+0000 mgr.gibba045.orlgmj (mgr.34412) 8785 : cluster [DBG] pgmap v5005: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:22.175 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:35:21 gibba045 bash[25517]: cluster 2021-03-10T16:35:20.240734+0000 mgr.gibba045.orlgmj (mgr.34412) 8785 : cluster [DBG] pgmap v5005: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:23.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:35:23 gibba015 bash[29377]: cluster 2021-03-10T16:35:22.242439+0000 mgr.gibba045.orlgmj (mgr.34412) 8786 : cluster [DBG] pgmap v5006: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:23.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:35:23 gibba015 bash[30343]: cluster 2021-03-10T16:35:22.242439+0000 mgr.gibba045.orlgmj (mgr.34412) 8786 : cluster [DBG] pgmap v5006: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:24.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:35:23 gibba045 bash[25517]: cluster 2021-03-10T16:35:22.242439+0000 mgr.gibba045.orlgmj (mgr.34412) 8786 : cluster [DBG] pgmap v5006: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:25.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:35:25 gibba015 bash[29377]: cluster 2021-03-10T16:35:24.243605+0000 mgr.gibba045.orlgmj (mgr.34412) 8787 : cluster [DBG] pgmap v5007: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:25.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:35:25 gibba015 bash[30343]: cluster 2021-03-10T16:35:24.243605+0000 mgr.gibba045.orlgmj (mgr.34412) 8787 : cluster [DBG] pgmap v5007: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:26.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:35:25 gibba045 bash[25517]: cluster 2021-03-10T16:35:24.243605+0000 mgr.gibba045.orlgmj (mgr.34412) 8787 : cluster [DBG] pgmap v5007: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:27.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:35:27 gibba015 bash[29377]: cluster 2021-03-10T16:35:26.245440+0000 mgr.gibba045.orlgmj (mgr.34412) 8788 : cluster [DBG] pgmap v5008: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:27.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:35:27 gibba015 bash[30343]: cluster 2021-03-10T16:35:26.245440+0000 mgr.gibba045.orlgmj (mgr.34412) 8788 : cluster [DBG] pgmap v5008: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:28.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:35:27 gibba045 bash[25517]: cluster 2021-03-10T16:35:26.245440+0000 mgr.gibba045.orlgmj (mgr.34412) 8788 : cluster [DBG] pgmap v5008: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:29.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:35:29 gibba045 bash[25517]: cluster 2021-03-10T16:35:28.247136+0000 mgr.gibba045.orlgmj (mgr.34412) 8789 : cluster [DBG] pgmap v5009: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:29.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:35:29 gibba045 bash[25517]: audit 2021-03-10T16:35:29.211459+0000 mon.c (mon.1) 2425 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:35:29.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:35:29 gibba045 bash[25517]: audit 2021-03-10T16:35:29.423279+0000 mon.a (mon.0) 1963 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:35:29.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:35:29 gibba045 bash[25517]: audit 2021-03-10T16:35:29.427091+0000 mon.c (mon.1) 2426 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:35:29.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:35:29 gibba045 bash[25517]: audit 2021-03-10T16:35:29.428757+0000 mon.c (mon.1) 2427 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:35:29.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:35:29 gibba045 bash[25517]: audit 2021-03-10T16:35:29.430123+0000 mon.c (mon.1) 2428 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:35:29.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:35:29 gibba045 bash[25517]: audit 2021-03-10T16:35:29.431142+0000 mon.c (mon.1) 2429 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:35:29.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:35:29 gibba045 bash[25517]: audit 2021-03-10T16:35:29.433731+0000 mon.c (mon.1) 2430 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:35:29.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:35:29 gibba045 bash[25517]: audit 2021-03-10T16:35:29.435244+0000 mon.c (mon.1) 2431 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:35:29.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:35:29 gibba015 bash[29377]: cluster 2021-03-10T16:35:28.247136+0000 mgr.gibba045.orlgmj (mgr.34412) 8789 : cluster [DBG] pgmap v5009: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:29.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:35:29 gibba015 bash[29377]: audit 2021-03-10T16:35:29.211459+0000 mon.c (mon.1) 2425 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:35:29.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:35:29 gibba015 bash[29377]: audit 2021-03-10T16:35:29.423279+0000 mon.a (mon.0) 1963 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:35:29.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:35:29 gibba015 bash[29377]: audit 2021-03-10T16:35:29.427091+0000 mon.c (mon.1) 2426 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:35:29.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:35:29 gibba015 bash[29377]: audit 2021-03-10T16:35:29.428757+0000 mon.c (mon.1) 2427 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:35:29.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:35:29 gibba015 bash[29377]: audit 2021-03-10T16:35:29.430123+0000 mon.c (mon.1) 2428 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:35:29.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:35:29 gibba015 bash[29377]: audit 2021-03-10T16:35:29.431142+0000 mon.c (mon.1) 2429 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:35:29.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:35:29 gibba015 bash[29377]: audit 2021-03-10T16:35:29.433731+0000 mon.c (mon.1) 2430 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:35:29.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:35:29 gibba015 bash[29377]: audit 2021-03-10T16:35:29.435244+0000 mon.c (mon.1) 2431 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:35:29.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:35:29 gibba015 bash[30343]: cluster 2021-03-10T16:35:28.247136+0000 mgr.gibba045.orlgmj (mgr.34412) 8789 : cluster [DBG] pgmap v5009: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:29.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:35:29 gibba015 bash[30343]: audit 2021-03-10T16:35:29.211459+0000 mon.c (mon.1) 2425 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:35:29.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:35:29 gibba015 bash[30343]: audit 2021-03-10T16:35:29.423279+0000 mon.a (mon.0) 1963 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:35:29.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:35:29 gibba015 bash[30343]: audit 2021-03-10T16:35:29.427091+0000 mon.c (mon.1) 2426 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:35:29.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:35:29 gibba015 bash[30343]: audit 2021-03-10T16:35:29.428757+0000 mon.c (mon.1) 2427 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:35:29.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:35:29 gibba015 bash[30343]: audit 2021-03-10T16:35:29.430123+0000 mon.c (mon.1) 2428 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:35:29.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:35:29 gibba015 bash[30343]: audit 2021-03-10T16:35:29.431142+0000 mon.c (mon.1) 2429 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:35:29.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:35:29 gibba015 bash[30343]: audit 2021-03-10T16:35:29.433731+0000 mon.c (mon.1) 2430 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:35:29.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:35:29 gibba015 bash[30343]: audit 2021-03-10T16:35:29.435244+0000 mon.c (mon.1) 2431 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:35:30.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:35:30 gibba015 bash[29377]: cephadm 2021-03-10T16:35:29.219615+0000 mgr.gibba045.orlgmj (mgr.34412) 8790 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:35:30.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:35:30 gibba015 bash[29377]: cephadm 2021-03-10T16:35:29.221578+0000 mgr.gibba045.orlgmj (mgr.34412) 8791 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:35:30.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:35:30 gibba015 bash[29377]: cephadm 2021-03-10T16:35:29.428801+0000 mgr.gibba045.orlgmj (mgr.34412) 8792 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:35:30.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:35:30 gibba015 bash[29377]: cephadm 2021-03-10T16:35:29.430846+0000 mgr.gibba045.orlgmj (mgr.34412) 8793 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:35:30.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:35:30 gibba015 bash[29377]: cephadm 2021-03-10T16:35:29.432121+0000 mgr.gibba045.orlgmj (mgr.34412) 8794 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:35:30.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:35:30 gibba015 bash[29377]: cephadm 2021-03-10T16:35:29.432159+0000 mgr.gibba045.orlgmj (mgr.34412) 8795 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:35:30.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:35:30 gibba015 bash[29377]: cephadm 2021-03-10T16:35:29.433387+0000 mgr.gibba045.orlgmj (mgr.34412) 8796 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:35:30.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:35:30 gibba015 bash[29377]: cephadm 2021-03-10T16:35:29.433423+0000 mgr.gibba045.orlgmj (mgr.34412) 8797 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:35:30.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:35:30 gibba015 bash[29377]: cephadm 2021-03-10T16:35:29.434344+0000 mgr.gibba045.orlgmj (mgr.34412) 8798 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:35:30.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:35:30 gibba015 bash[29377]: cephadm 2021-03-10T16:35:29.435932+0000 mgr.gibba045.orlgmj (mgr.34412) 8799 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:35:30.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:35:30 gibba015 bash[29377]: cephadm 2021-03-10T16:35:29.435968+0000 mgr.gibba045.orlgmj (mgr.34412) 8800 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:35:30.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:35:30 gibba015 bash[29377]: cephadm 2021-03-10T16:35:29.437276+0000 mgr.gibba045.orlgmj (mgr.34412) 8801 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:35:30.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:35:30 gibba015 bash[29377]: cephadm 2021-03-10T16:35:29.437586+0000 mgr.gibba045.orlgmj (mgr.34412) 8802 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:35:30.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:35:30 gibba015 bash[29377]: cephadm 2021-03-10T16:35:29.438590+0000 mgr.gibba045.orlgmj (mgr.34412) 8803 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:35:30.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:35:30 gibba015 bash[29377]: cephadm 2021-03-10T16:35:29.438628+0000 mgr.gibba045.orlgmj (mgr.34412) 8804 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:35:30.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:35:30 gibba015 bash[29377]: cephadm 2021-03-10T16:35:29.438732+0000 mgr.gibba045.orlgmj (mgr.34412) 8805 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:35:30.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:35:30 gibba015 bash[30343]: cephadm 2021-03-10T16:35:29.219615+0000 mgr.gibba045.orlgmj (mgr.34412) 8790 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:35:30.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:35:30 gibba015 bash[30343]: cephadm 2021-03-10T16:35:29.221578+0000 mgr.gibba045.orlgmj (mgr.34412) 8791 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:35:30.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:35:30 gibba015 bash[30343]: cephadm 2021-03-10T16:35:29.428801+0000 mgr.gibba045.orlgmj (mgr.34412) 8792 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:35:30.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:35:30 gibba015 bash[30343]: cephadm 2021-03-10T16:35:29.430846+0000 mgr.gibba045.orlgmj (mgr.34412) 8793 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:35:30.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:35:30 gibba015 bash[30343]: cephadm 2021-03-10T16:35:29.432121+0000 mgr.gibba045.orlgmj (mgr.34412) 8794 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:35:30.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:35:30 gibba015 bash[30343]: cephadm 2021-03-10T16:35:29.432159+0000 mgr.gibba045.orlgmj (mgr.34412) 8795 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:35:30.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:35:30 gibba015 bash[30343]: cephadm 2021-03-10T16:35:29.433387+0000 mgr.gibba045.orlgmj (mgr.34412) 8796 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:35:30.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:35:30 gibba015 bash[30343]: cephadm 2021-03-10T16:35:29.433423+0000 mgr.gibba045.orlgmj (mgr.34412) 8797 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:35:30.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:35:30 gibba015 bash[30343]: cephadm 2021-03-10T16:35:29.434344+0000 mgr.gibba045.orlgmj (mgr.34412) 8798 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:35:30.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:35:30 gibba015 bash[30343]: cephadm 2021-03-10T16:35:29.435932+0000 mgr.gibba045.orlgmj (mgr.34412) 8799 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:35:30.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:35:30 gibba015 bash[30343]: cephadm 2021-03-10T16:35:29.435968+0000 mgr.gibba045.orlgmj (mgr.34412) 8800 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:35:30.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:35:30 gibba015 bash[30343]: cephadm 2021-03-10T16:35:29.437276+0000 mgr.gibba045.orlgmj (mgr.34412) 8801 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:35:30.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:35:30 gibba015 bash[30343]: cephadm 2021-03-10T16:35:29.437586+0000 mgr.gibba045.orlgmj (mgr.34412) 8802 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:35:30.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:35:30 gibba015 bash[30343]: cephadm 2021-03-10T16:35:29.438590+0000 mgr.gibba045.orlgmj (mgr.34412) 8803 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:35:30.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:35:30 gibba015 bash[30343]: cephadm 2021-03-10T16:35:29.438628+0000 mgr.gibba045.orlgmj (mgr.34412) 8804 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:35:30.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:35:30 gibba015 bash[30343]: cephadm 2021-03-10T16:35:29.438732+0000 mgr.gibba045.orlgmj (mgr.34412) 8805 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:35:31.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:35:30 gibba045 bash[25517]: cephadm 2021-03-10T16:35:29.219615+0000 mgr.gibba045.orlgmj (mgr.34412) 8790 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:35:31.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:35:30 gibba045 bash[25517]: cephadm 2021-03-10T16:35:29.221578+0000 mgr.gibba045.orlgmj (mgr.34412) 8791 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:35:31.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:35:30 gibba045 bash[25517]: cephadm 2021-03-10T16:35:29.428801+0000 mgr.gibba045.orlgmj (mgr.34412) 8792 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:35:31.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:35:30 gibba045 bash[25517]: cephadm 2021-03-10T16:35:29.430846+0000 mgr.gibba045.orlgmj (mgr.34412) 8793 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:35:31.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:35:30 gibba045 bash[25517]: cephadm 2021-03-10T16:35:29.432121+0000 mgr.gibba045.orlgmj (mgr.34412) 8794 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:35:31.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:35:30 gibba045 bash[25517]: cephadm 2021-03-10T16:35:29.432159+0000 mgr.gibba045.orlgmj (mgr.34412) 8795 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:35:31.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:35:30 gibba045 bash[25517]: cephadm 2021-03-10T16:35:29.433387+0000 mgr.gibba045.orlgmj (mgr.34412) 8796 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:35:31.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:35:30 gibba045 bash[25517]: cephadm 2021-03-10T16:35:29.433423+0000 mgr.gibba045.orlgmj (mgr.34412) 8797 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:35:31.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:35:30 gibba045 bash[25517]: cephadm 2021-03-10T16:35:29.434344+0000 mgr.gibba045.orlgmj (mgr.34412) 8798 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:35:31.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:35:30 gibba045 bash[25517]: cephadm 2021-03-10T16:35:29.435932+0000 mgr.gibba045.orlgmj (mgr.34412) 8799 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:35:31.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:35:30 gibba045 bash[25517]: cephadm 2021-03-10T16:35:29.435968+0000 mgr.gibba045.orlgmj (mgr.34412) 8800 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:35:31.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:35:30 gibba045 bash[25517]: cephadm 2021-03-10T16:35:29.437276+0000 mgr.gibba045.orlgmj (mgr.34412) 8801 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:35:31.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:35:30 gibba045 bash[25517]: cephadm 2021-03-10T16:35:29.437586+0000 mgr.gibba045.orlgmj (mgr.34412) 8802 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:35:31.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:35:30 gibba045 bash[25517]: cephadm 2021-03-10T16:35:29.438590+0000 mgr.gibba045.orlgmj (mgr.34412) 8803 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:35:31.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:35:30 gibba045 bash[25517]: cephadm 2021-03-10T16:35:29.438628+0000 mgr.gibba045.orlgmj (mgr.34412) 8804 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:35:31.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:35:30 gibba045 bash[25517]: cephadm 2021-03-10T16:35:29.438732+0000 mgr.gibba045.orlgmj (mgr.34412) 8805 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:35:31.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:35:31 gibba015 bash[29377]: cluster 2021-03-10T16:35:30.248871+0000 mgr.gibba045.orlgmj (mgr.34412) 8806 : cluster [DBG] pgmap v5010: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:31.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:35:31 gibba015 bash[30343]: cluster 2021-03-10T16:35:30.248871+0000 mgr.gibba045.orlgmj (mgr.34412) 8806 : cluster [DBG] pgmap v5010: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:32.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:35:31 gibba045 bash[25517]: cluster 2021-03-10T16:35:30.248871+0000 mgr.gibba045.orlgmj (mgr.34412) 8806 : cluster [DBG] pgmap v5010: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:33.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:35:33 gibba015 bash[29377]: cluster 2021-03-10T16:35:32.250629+0000 mgr.gibba045.orlgmj (mgr.34412) 8807 : cluster [DBG] pgmap v5011: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:33.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:35:33 gibba015 bash[30343]: cluster 2021-03-10T16:35:32.250629+0000 mgr.gibba045.orlgmj (mgr.34412) 8807 : cluster [DBG] pgmap v5011: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:34.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:35:33 gibba045 bash[25517]: cluster 2021-03-10T16:35:32.250629+0000 mgr.gibba045.orlgmj (mgr.34412) 8807 : cluster [DBG] pgmap v5011: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:34.582 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:35:34.851 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:35:34.852 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 9m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:35:34.852 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 8m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:35:34.852 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:35:34.853 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:35:34.853 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:35:34.853 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:35:34.853 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:35:34.853 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:35:34.854 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 9m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:35:34.854 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 8m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:35:34.854 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:35:34.854 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:35:34.855 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:35:34.855 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:35:34.855 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:35:34.855 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:35:34.855 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:35:34.856 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:35:34.856 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 8m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:35:34.856 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 8m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:35:34.968 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:35:34 gibba015 bash[29377]: cluster 2021-03-10T16:35:34.251862+0000 mgr.gibba045.orlgmj (mgr.34412) 8808 : cluster [DBG] pgmap v5012: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:34.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:35:34 gibba015 bash[29377]: audit 2021-03-10T16:35:34.576541+0000 mgr.gibba045.orlgmj (mgr.34412) 8809 : audit [DBG] from='client.49956 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:35:34.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:35:34 gibba015 bash[30343]: cluster 2021-03-10T16:35:34.251862+0000 mgr.gibba045.orlgmj (mgr.34412) 8808 : cluster [DBG] pgmap v5012: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:34.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:35:34 gibba015 bash[30343]: audit 2021-03-10T16:35:34.576541+0000 mgr.gibba045.orlgmj (mgr.34412) 8809 : audit [DBG] from='client.49956 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:35:35.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:35:34 gibba045 bash[25517]: cluster 2021-03-10T16:35:34.251862+0000 mgr.gibba045.orlgmj (mgr.34412) 8808 : cluster [DBG] pgmap v5012: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:35.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:35:34 gibba045 bash[25517]: audit 2021-03-10T16:35:34.576541+0000 mgr.gibba045.orlgmj (mgr.34412) 8809 : audit [DBG] from='client.49956 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:35:35.108 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:35:35.109 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:35:35.109 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:35:35.109 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:35:35.110 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:35:35.110 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:35:35.110 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:35:35.110 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:35:35.110 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:35:35.111 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:35:35.111 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:35:35.111 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:35:35.111 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:35:35.112 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:35:35.112 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:35:35.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:35:35 gibba015 bash[29377]: audit 2021-03-10T16:35:34.813589+0000 mgr.gibba045.orlgmj (mgr.34412) 8810 : audit [DBG] from='client.59950 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:35:35.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:35:35 gibba015 bash[29377]: audit 2021-03-10T16:35:35.109764+0000 mon.c (mon.1) 2432 : audit [DBG] from='client.? 172.21.2.115:0/448125168' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:35:35.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:35:35 gibba015 bash[30343]: audit 2021-03-10T16:35:34.813589+0000 mgr.gibba045.orlgmj (mgr.34412) 8810 : audit [DBG] from='client.59950 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:35:35.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:35:35 gibba015 bash[30343]: audit 2021-03-10T16:35:35.109764+0000 mon.c (mon.1) 2432 : audit [DBG] from='client.? 172.21.2.115:0/448125168' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:35:36.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:35:35 gibba045 bash[25517]: audit 2021-03-10T16:35:34.813589+0000 mgr.gibba045.orlgmj (mgr.34412) 8810 : audit [DBG] from='client.59950 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:35:36.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:35:35 gibba045 bash[25517]: audit 2021-03-10T16:35:35.109764+0000 mon.c (mon.1) 2432 : audit [DBG] from='client.? 172.21.2.115:0/448125168' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:35:37.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:35:37 gibba015 bash[29377]: cluster 2021-03-10T16:35:36.253503+0000 mgr.gibba045.orlgmj (mgr.34412) 8811 : cluster [DBG] pgmap v5013: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:37.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:35:37 gibba015 bash[30343]: cluster 2021-03-10T16:35:36.253503+0000 mgr.gibba045.orlgmj (mgr.34412) 8811 : cluster [DBG] pgmap v5013: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:37.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:35:37 gibba045 bash[25517]: cluster 2021-03-10T16:35:36.253503+0000 mgr.gibba045.orlgmj (mgr.34412) 8811 : cluster [DBG] pgmap v5013: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:39.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:35:39 gibba015 bash[29377]: cluster 2021-03-10T16:35:38.254974+0000 mgr.gibba045.orlgmj (mgr.34412) 8812 : cluster [DBG] pgmap v5014: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:39.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:35:39 gibba015 bash[30343]: cluster 2021-03-10T16:35:38.254974+0000 mgr.gibba045.orlgmj (mgr.34412) 8812 : cluster [DBG] pgmap v5014: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:39.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:35:39 gibba045 bash[25517]: cluster 2021-03-10T16:35:38.254974+0000 mgr.gibba045.orlgmj (mgr.34412) 8812 : cluster [DBG] pgmap v5014: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:41.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:35:41 gibba015 bash[29377]: cluster 2021-03-10T16:35:40.256345+0000 mgr.gibba045.orlgmj (mgr.34412) 8813 : cluster [DBG] pgmap v5015: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:41.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:35:41 gibba015 bash[30343]: cluster 2021-03-10T16:35:40.256345+0000 mgr.gibba045.orlgmj (mgr.34412) 8813 : cluster [DBG] pgmap v5015: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:41.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:35:41 gibba045 bash[25517]: cluster 2021-03-10T16:35:40.256345+0000 mgr.gibba045.orlgmj (mgr.34412) 8813 : cluster [DBG] pgmap v5015: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:43.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:35:43 gibba015 bash[29377]: cluster 2021-03-10T16:35:42.258091+0000 mgr.gibba045.orlgmj (mgr.34412) 8814 : cluster [DBG] pgmap v5016: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:43.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:35:43 gibba015 bash[30343]: cluster 2021-03-10T16:35:42.258091+0000 mgr.gibba045.orlgmj (mgr.34412) 8814 : cluster [DBG] pgmap v5016: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:43.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:35:43 gibba045 bash[25517]: cluster 2021-03-10T16:35:42.258091+0000 mgr.gibba045.orlgmj (mgr.34412) 8814 : cluster [DBG] pgmap v5016: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:45.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:35:45 gibba015 bash[29377]: cluster 2021-03-10T16:35:44.259391+0000 mgr.gibba045.orlgmj (mgr.34412) 8815 : cluster [DBG] pgmap v5017: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:45.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:35:45 gibba015 bash[29377]: cephadm 2021-03-10T16:35:44.448690+0000 mgr.gibba045.orlgmj (mgr.34412) 8816 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:35:45.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:35:45 gibba015 bash[30343]: cluster 2021-03-10T16:35:44.259391+0000 mgr.gibba045.orlgmj (mgr.34412) 8815 : cluster [DBG] pgmap v5017: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:45.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:35:45 gibba015 bash[30343]: cephadm 2021-03-10T16:35:44.448690+0000 mgr.gibba045.orlgmj (mgr.34412) 8816 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:35:45.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:35:45 gibba045 bash[25517]: cluster 2021-03-10T16:35:44.259391+0000 mgr.gibba045.orlgmj (mgr.34412) 8815 : cluster [DBG] pgmap v5017: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:45.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:35:45 gibba045 bash[25517]: cephadm 2021-03-10T16:35:44.448690+0000 mgr.gibba045.orlgmj (mgr.34412) 8816 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:35:47.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:35:47 gibba015 bash[29377]: cluster 2021-03-10T16:35:46.261117+0000 mgr.gibba045.orlgmj (mgr.34412) 8817 : cluster [DBG] pgmap v5018: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:47.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:35:47 gibba015 bash[30343]: cluster 2021-03-10T16:35:46.261117+0000 mgr.gibba045.orlgmj (mgr.34412) 8817 : cluster [DBG] pgmap v5018: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:47.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:35:47 gibba045 bash[25517]: cluster 2021-03-10T16:35:46.261117+0000 mgr.gibba045.orlgmj (mgr.34412) 8817 : cluster [DBG] pgmap v5018: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:49.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:35:49 gibba015 bash[29377]: cluster 2021-03-10T16:35:48.262752+0000 mgr.gibba045.orlgmj (mgr.34412) 8818 : cluster [DBG] pgmap v5019: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:49.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:35:49 gibba015 bash[30343]: cluster 2021-03-10T16:35:48.262752+0000 mgr.gibba045.orlgmj (mgr.34412) 8818 : cluster [DBG] pgmap v5019: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:49.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:35:49 gibba045 bash[25517]: cluster 2021-03-10T16:35:48.262752+0000 mgr.gibba045.orlgmj (mgr.34412) 8818 : cluster [DBG] pgmap v5019: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:51.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:35:51 gibba015 bash[29377]: cluster 2021-03-10T16:35:50.264463+0000 mgr.gibba045.orlgmj (mgr.34412) 8819 : cluster [DBG] pgmap v5020: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:51.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:35:51 gibba015 bash[30343]: cluster 2021-03-10T16:35:50.264463+0000 mgr.gibba045.orlgmj (mgr.34412) 8819 : cluster [DBG] pgmap v5020: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:51.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:35:51 gibba045 bash[25517]: cluster 2021-03-10T16:35:50.264463+0000 mgr.gibba045.orlgmj (mgr.34412) 8819 : cluster [DBG] pgmap v5020: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:53.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:35:53 gibba015 bash[29377]: cluster 2021-03-10T16:35:52.265942+0000 mgr.gibba045.orlgmj (mgr.34412) 8820 : cluster [DBG] pgmap v5021: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:53.719 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:35:53 gibba015 bash[30343]: cluster 2021-03-10T16:35:52.265942+0000 mgr.gibba045.orlgmj (mgr.34412) 8820 : cluster [DBG] pgmap v5021: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:53.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:35:53 gibba045 bash[25517]: cluster 2021-03-10T16:35:52.265942+0000 mgr.gibba045.orlgmj (mgr.34412) 8820 : cluster [DBG] pgmap v5021: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:54.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:35:54 gibba015 bash[29377]: audit 2021-03-10T16:35:53.648805+0000 mon.c (mon.1) 2433 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:35:54.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:35:54 gibba015 bash[29377]: audit 2021-03-10T16:35:53.649468+0000 mon.c (mon.1) 2434 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:35:54.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:35:54 gibba015 bash[29377]: audit 2021-03-10T16:35:53.649935+0000 mon.a (mon.0) 1964 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:35:54.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:35:54 gibba015 bash[29377]: audit 2021-03-10T16:35:53.651196+0000 mon.a (mon.0) 1965 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:35:54.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:35:54 gibba015 bash[29377]: audit 2021-03-10T16:35:53.667516+0000 mon.c (mon.1) 2435 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T16:35:54.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:35:54 gibba015 bash[29377]: audit 2021-03-10T16:35:53.668300+0000 mon.c (mon.1) 2436 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:35:54.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:35:54 gibba015 bash[29377]: audit 2021-03-10T16:35:53.668749+0000 mon.a (mon.0) 1966 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T16:35:54.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:35:54 gibba015 bash[29377]: audit 2021-03-10T16:35:53.668987+0000 mon.c (mon.1) 2437 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:35:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:35:54 gibba015 bash[29377]: audit 2021-03-10T16:35:53.669905+0000 mon.c (mon.1) 2438 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T16:35:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:35:54 gibba015 bash[29377]: audit 2021-03-10T16:35:53.670316+0000 mon.a (mon.0) 1967 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:35:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:35:54 gibba015 bash[29377]: audit 2021-03-10T16:35:53.671484+0000 mon.a (mon.0) 1968 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:35:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:35:54 gibba015 bash[29377]: audit 2021-03-10T16:35:53.672360+0000 mon.a (mon.0) 1969 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T16:35:54.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:35:54 gibba015 bash[30343]: audit 2021-03-10T16:35:53.648805+0000 mon.c (mon.1) 2433 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:35:54.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:35:54 gibba015 bash[30343]: audit 2021-03-10T16:35:53.649468+0000 mon.c (mon.1) 2434 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:35:54.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:35:54 gibba015 bash[30343]: audit 2021-03-10T16:35:53.649935+0000 mon.a (mon.0) 1964 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:35:54.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:35:54 gibba015 bash[30343]: audit 2021-03-10T16:35:53.651196+0000 mon.a (mon.0) 1965 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:35:54.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:35:54 gibba015 bash[30343]: audit 2021-03-10T16:35:53.667516+0000 mon.c (mon.1) 2435 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T16:35:54.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:35:54 gibba015 bash[30343]: audit 2021-03-10T16:35:53.668300+0000 mon.c (mon.1) 2436 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:35:54.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:35:54 gibba015 bash[30343]: audit 2021-03-10T16:35:53.668749+0000 mon.a (mon.0) 1966 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T16:35:54.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:35:54 gibba015 bash[30343]: audit 2021-03-10T16:35:53.668987+0000 mon.c (mon.1) 2437 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:35:54.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:35:54 gibba015 bash[30343]: audit 2021-03-10T16:35:53.669905+0000 mon.c (mon.1) 2438 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T16:35:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:35:54 gibba015 bash[30343]: audit 2021-03-10T16:35:53.670316+0000 mon.a (mon.0) 1967 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:35:54.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:35:54 gibba015 bash[30343]: audit 2021-03-10T16:35:53.671484+0000 mon.a (mon.0) 1968 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:35:54.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:35:54 gibba015 bash[30343]: audit 2021-03-10T16:35:53.672360+0000 mon.a (mon.0) 1969 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T16:35:54.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:35:54 gibba045 bash[25517]: audit 2021-03-10T16:35:53.648805+0000 mon.c (mon.1) 2433 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:35:54.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:35:54 gibba045 bash[25517]: audit 2021-03-10T16:35:53.649468+0000 mon.c (mon.1) 2434 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:35:54.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:35:54 gibba045 bash[25517]: audit 2021-03-10T16:35:53.649935+0000 mon.a (mon.0) 1964 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:35:54.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:35:54 gibba045 bash[25517]: audit 2021-03-10T16:35:53.651196+0000 mon.a (mon.0) 1965 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:35:54.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:35:54 gibba045 bash[25517]: audit 2021-03-10T16:35:53.667516+0000 mon.c (mon.1) 2435 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T16:35:54.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:35:54 gibba045 bash[25517]: audit 2021-03-10T16:35:53.668300+0000 mon.c (mon.1) 2436 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:35:54.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:35:54 gibba045 bash[25517]: audit 2021-03-10T16:35:53.668749+0000 mon.a (mon.0) 1966 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T16:35:54.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:35:54 gibba045 bash[25517]: audit 2021-03-10T16:35:53.668987+0000 mon.c (mon.1) 2437 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:35:54.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:35:54 gibba045 bash[25517]: audit 2021-03-10T16:35:53.669905+0000 mon.c (mon.1) 2438 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T16:35:54.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:35:54 gibba045 bash[25517]: audit 2021-03-10T16:35:53.670316+0000 mon.a (mon.0) 1967 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:35:54.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:35:54 gibba045 bash[25517]: audit 2021-03-10T16:35:53.671484+0000 mon.a (mon.0) 1968 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:35:54.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:35:54 gibba045 bash[25517]: audit 2021-03-10T16:35:53.672360+0000 mon.a (mon.0) 1969 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T16:35:55.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:35:55 gibba015 bash[29377]: cluster 2021-03-10T16:35:54.267206+0000 mgr.gibba045.orlgmj (mgr.34412) 8821 : cluster [DBG] pgmap v5022: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:55.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:35:55 gibba015 bash[30343]: cluster 2021-03-10T16:35:54.267206+0000 mgr.gibba045.orlgmj (mgr.34412) 8821 : cluster [DBG] pgmap v5022: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:55.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:35:55 gibba045 bash[25517]: cluster 2021-03-10T16:35:54.267206+0000 mgr.gibba045.orlgmj (mgr.34412) 8821 : cluster [DBG] pgmap v5022: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:57.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:35:57 gibba015 bash[29377]: cluster 2021-03-10T16:35:56.268863+0000 mgr.gibba045.orlgmj (mgr.34412) 8822 : cluster [DBG] pgmap v5023: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:57.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:35:57 gibba015 bash[30343]: cluster 2021-03-10T16:35:56.268863+0000 mgr.gibba045.orlgmj (mgr.34412) 8822 : cluster [DBG] pgmap v5023: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:57.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:35:57 gibba045 bash[25517]: cluster 2021-03-10T16:35:56.268863+0000 mgr.gibba045.orlgmj (mgr.34412) 8822 : cluster [DBG] pgmap v5023: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:59.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:35:59 gibba015 bash[29377]: cluster 2021-03-10T16:35:58.270328+0000 mgr.gibba045.orlgmj (mgr.34412) 8823 : cluster [DBG] pgmap v5024: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:59.719 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:35:59 gibba015 bash[30343]: cluster 2021-03-10T16:35:58.270328+0000 mgr.gibba045.orlgmj (mgr.34412) 8823 : cluster [DBG] pgmap v5024: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:59.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:35:59 gibba045 bash[25517]: cluster 2021-03-10T16:35:58.270328+0000 mgr.gibba045.orlgmj (mgr.34412) 8823 : cluster [DBG] pgmap v5024: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:00.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:36:00 gibba015 bash[29377]: cephadm 2021-03-10T16:35:59.464754+0000 mgr.gibba045.orlgmj (mgr.34412) 8824 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:36:00.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:36:00 gibba015 bash[30343]: cephadm 2021-03-10T16:35:59.464754+0000 mgr.gibba045.orlgmj (mgr.34412) 8824 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:36:00.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:36:00 gibba045 bash[25517]: cephadm 2021-03-10T16:35:59.464754+0000 mgr.gibba045.orlgmj (mgr.34412) 8824 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:36:01.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:36:01 gibba015 bash[29377]: cluster 2021-03-10T16:36:00.272020+0000 mgr.gibba045.orlgmj (mgr.34412) 8825 : cluster [DBG] pgmap v5025: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:01.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:36:01 gibba015 bash[30343]: cluster 2021-03-10T16:36:00.272020+0000 mgr.gibba045.orlgmj (mgr.34412) 8825 : cluster [DBG] pgmap v5025: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:01.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:36:01 gibba045 bash[25517]: cluster 2021-03-10T16:36:00.272020+0000 mgr.gibba045.orlgmj (mgr.34412) 8825 : cluster [DBG] pgmap v5025: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:03.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:36:03 gibba015 bash[29377]: cluster 2021-03-10T16:36:02.273800+0000 mgr.gibba045.orlgmj (mgr.34412) 8826 : cluster [DBG] pgmap v5026: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:03.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:36:03 gibba015 bash[30343]: cluster 2021-03-10T16:36:02.273800+0000 mgr.gibba045.orlgmj (mgr.34412) 8826 : cluster [DBG] pgmap v5026: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:03.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:36:03 gibba045 bash[25517]: cluster 2021-03-10T16:36:02.273800+0000 mgr.gibba045.orlgmj (mgr.34412) 8826 : cluster [DBG] pgmap v5026: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:05.352 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:36:05.582 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:36:05.582 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 9m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:36:05.582 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 8m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:36:05.583 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:36:05.583 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:36:05.583 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:36:05.583 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:36:05.584 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:36:05.584 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:36:05.584 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 9m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:36:05.584 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 8m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:36:05.585 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:36:05.585 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:36:05.585 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:36:05.585 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:36:05.586 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:36:05.586 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:36:05.586 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:36:05.586 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:36:05.587 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 8m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:36:05.587 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 8m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:36:05.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:36:05 gibba015 bash[29377]: cluster 2021-03-10T16:36:04.275129+0000 mgr.gibba045.orlgmj (mgr.34412) 8827 : cluster [DBG] pgmap v5027: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:05.719 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:36:05 gibba015 bash[30343]: cluster 2021-03-10T16:36:04.275129+0000 mgr.gibba045.orlgmj (mgr.34412) 8827 : cluster [DBG] pgmap v5027: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:05.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:36:05 gibba045 bash[25517]: cluster 2021-03-10T16:36:04.275129+0000 mgr.gibba045.orlgmj (mgr.34412) 8827 : cluster [DBG] pgmap v5027: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:05.830 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:36:05.831 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:36:05.831 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:36:05.831 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:36:05.832 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:36:05.832 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:36:05.832 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:36:05.832 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:36:05.832 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:36:05.833 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:36:05.833 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:36:05.833 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:36:05.833 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:36:05.834 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:36:05.834 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:36:06.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:36:06 gibba015 bash[29377]: audit 2021-03-10T16:36:05.346717+0000 mgr.gibba045.orlgmj (mgr.34412) 8828 : audit [DBG] from='client.59962 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:36:06.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:36:06 gibba015 bash[29377]: audit 2021-03-10T16:36:05.572925+0000 mgr.gibba045.orlgmj (mgr.34412) 8829 : audit [DBG] from='client.59968 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:36:06.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:36:06 gibba015 bash[29377]: audit 2021-03-10T16:36:05.831548+0000 mon.a (mon.0) 1970 : audit [DBG] from='client.? 172.21.2.115:0/1844949198' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:36:06.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:36:06 gibba015 bash[30343]: audit 2021-03-10T16:36:05.346717+0000 mgr.gibba045.orlgmj (mgr.34412) 8828 : audit [DBG] from='client.59962 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:36:06.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:36:06 gibba015 bash[30343]: audit 2021-03-10T16:36:05.572925+0000 mgr.gibba045.orlgmj (mgr.34412) 8829 : audit [DBG] from='client.59968 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:36:06.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:36:06 gibba015 bash[30343]: audit 2021-03-10T16:36:05.831548+0000 mon.a (mon.0) 1970 : audit [DBG] from='client.? 172.21.2.115:0/1844949198' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:36:06.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:36:06 gibba045 bash[25517]: audit 2021-03-10T16:36:05.346717+0000 mgr.gibba045.orlgmj (mgr.34412) 8828 : audit [DBG] from='client.59962 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:36:06.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:36:06 gibba045 bash[25517]: audit 2021-03-10T16:36:05.572925+0000 mgr.gibba045.orlgmj (mgr.34412) 8829 : audit [DBG] from='client.59968 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:36:06.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:36:06 gibba045 bash[25517]: audit 2021-03-10T16:36:05.831548+0000 mon.a (mon.0) 1970 : audit [DBG] from='client.? 172.21.2.115:0/1844949198' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:36:07.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:36:07 gibba015 bash[29377]: cluster 2021-03-10T16:36:06.276936+0000 mgr.gibba045.orlgmj (mgr.34412) 8830 : cluster [DBG] pgmap v5028: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:07.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:36:07 gibba015 bash[30343]: cluster 2021-03-10T16:36:06.276936+0000 mgr.gibba045.orlgmj (mgr.34412) 8830 : cluster [DBG] pgmap v5028: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:07.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:36:07 gibba045 bash[25517]: cluster 2021-03-10T16:36:06.276936+0000 mgr.gibba045.orlgmj (mgr.34412) 8830 : cluster [DBG] pgmap v5028: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:09.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:36:09 gibba015 bash[29377]: cluster 2021-03-10T16:36:08.278610+0000 mgr.gibba045.orlgmj (mgr.34412) 8831 : cluster [DBG] pgmap v5029: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:09.719 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:36:09 gibba015 bash[30343]: cluster 2021-03-10T16:36:08.278610+0000 mgr.gibba045.orlgmj (mgr.34412) 8831 : cluster [DBG] pgmap v5029: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:09.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:36:09 gibba045 bash[25517]: cluster 2021-03-10T16:36:08.278610+0000 mgr.gibba045.orlgmj (mgr.34412) 8831 : cluster [DBG] pgmap v5029: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:11.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:36:11 gibba045 bash[25517]: cluster 2021-03-10T16:36:10.280226+0000 mgr.gibba045.orlgmj (mgr.34412) 8832 : cluster [DBG] pgmap v5030: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:11.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:36:11 gibba015 bash[29377]: cluster 2021-03-10T16:36:10.280226+0000 mgr.gibba045.orlgmj (mgr.34412) 8832 : cluster [DBG] pgmap v5030: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:11.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:36:11 gibba015 bash[30343]: cluster 2021-03-10T16:36:10.280226+0000 mgr.gibba045.orlgmj (mgr.34412) 8832 : cluster [DBG] pgmap v5030: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:13.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:36:13 gibba045 bash[25517]: cluster 2021-03-10T16:36:12.281817+0000 mgr.gibba045.orlgmj (mgr.34412) 8833 : cluster [DBG] pgmap v5031: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:13.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:36:13 gibba015 bash[29377]: cluster 2021-03-10T16:36:12.281817+0000 mgr.gibba045.orlgmj (mgr.34412) 8833 : cluster [DBG] pgmap v5031: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:13.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:36:13 gibba015 bash[30343]: cluster 2021-03-10T16:36:12.281817+0000 mgr.gibba045.orlgmj (mgr.34412) 8833 : cluster [DBG] pgmap v5031: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:15.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:36:15 gibba045 bash[25517]: cluster 2021-03-10T16:36:14.283183+0000 mgr.gibba045.orlgmj (mgr.34412) 8834 : cluster [DBG] pgmap v5032: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:15.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:36:15 gibba045 bash[25517]: cephadm 2021-03-10T16:36:14.480615+0000 mgr.gibba045.orlgmj (mgr.34412) 8835 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:36:15.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:36:15 gibba015 bash[29377]: cluster 2021-03-10T16:36:14.283183+0000 mgr.gibba045.orlgmj (mgr.34412) 8834 : cluster [DBG] pgmap v5032: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:15.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:36:15 gibba015 bash[29377]: cephadm 2021-03-10T16:36:14.480615+0000 mgr.gibba045.orlgmj (mgr.34412) 8835 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:36:15.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:36:15 gibba015 bash[30343]: cluster 2021-03-10T16:36:14.283183+0000 mgr.gibba045.orlgmj (mgr.34412) 8834 : cluster [DBG] pgmap v5032: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:15.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:36:15 gibba015 bash[30343]: cephadm 2021-03-10T16:36:14.480615+0000 mgr.gibba045.orlgmj (mgr.34412) 8835 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:36:17.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:36:17 gibba045 bash[25517]: cluster 2021-03-10T16:36:16.284993+0000 mgr.gibba045.orlgmj (mgr.34412) 8836 : cluster [DBG] pgmap v5033: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:17.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:36:17 gibba015 bash[29377]: cluster 2021-03-10T16:36:16.284993+0000 mgr.gibba045.orlgmj (mgr.34412) 8836 : cluster [DBG] pgmap v5033: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:17.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:36:17 gibba015 bash[30343]: cluster 2021-03-10T16:36:16.284993+0000 mgr.gibba045.orlgmj (mgr.34412) 8836 : cluster [DBG] pgmap v5033: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:19.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:36:19 gibba045 bash[25517]: cluster 2021-03-10T16:36:18.286473+0000 mgr.gibba045.orlgmj (mgr.34412) 8837 : cluster [DBG] pgmap v5034: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:19.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:36:19 gibba015 bash[29377]: cluster 2021-03-10T16:36:18.286473+0000 mgr.gibba045.orlgmj (mgr.34412) 8837 : cluster [DBG] pgmap v5034: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:19.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:36:19 gibba015 bash[30343]: cluster 2021-03-10T16:36:18.286473+0000 mgr.gibba045.orlgmj (mgr.34412) 8837 : cluster [DBG] pgmap v5034: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:21.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:36:21 gibba045 bash[25517]: cluster 2021-03-10T16:36:20.288129+0000 mgr.gibba045.orlgmj (mgr.34412) 8838 : cluster [DBG] pgmap v5035: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:21.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:36:21 gibba015 bash[29377]: cluster 2021-03-10T16:36:20.288129+0000 mgr.gibba045.orlgmj (mgr.34412) 8838 : cluster [DBG] pgmap v5035: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:21.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:36:21 gibba015 bash[30343]: cluster 2021-03-10T16:36:20.288129+0000 mgr.gibba045.orlgmj (mgr.34412) 8838 : cluster [DBG] pgmap v5035: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:23.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:36:23 gibba045 bash[25517]: cluster 2021-03-10T16:36:22.289742+0000 mgr.gibba045.orlgmj (mgr.34412) 8839 : cluster [DBG] pgmap v5036: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:23.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:36:23 gibba015 bash[29377]: cluster 2021-03-10T16:36:22.289742+0000 mgr.gibba045.orlgmj (mgr.34412) 8839 : cluster [DBG] pgmap v5036: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:23.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:36:23 gibba015 bash[30343]: cluster 2021-03-10T16:36:22.289742+0000 mgr.gibba045.orlgmj (mgr.34412) 8839 : cluster [DBG] pgmap v5036: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:25.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:36:25 gibba045 bash[25517]: cluster 2021-03-10T16:36:24.291206+0000 mgr.gibba045.orlgmj (mgr.34412) 8840 : cluster [DBG] pgmap v5037: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:25.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:36:25 gibba015 bash[29377]: cluster 2021-03-10T16:36:24.291206+0000 mgr.gibba045.orlgmj (mgr.34412) 8840 : cluster [DBG] pgmap v5037: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:25.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:36:25 gibba015 bash[30343]: cluster 2021-03-10T16:36:24.291206+0000 mgr.gibba045.orlgmj (mgr.34412) 8840 : cluster [DBG] pgmap v5037: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:27.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:36:27 gibba045 bash[25517]: cluster 2021-03-10T16:36:26.292863+0000 mgr.gibba045.orlgmj (mgr.34412) 8841 : cluster [DBG] pgmap v5038: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:27.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:36:27 gibba015 bash[29377]: cluster 2021-03-10T16:36:26.292863+0000 mgr.gibba045.orlgmj (mgr.34412) 8841 : cluster [DBG] pgmap v5038: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:27.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:36:27 gibba015 bash[30343]: cluster 2021-03-10T16:36:26.292863+0000 mgr.gibba045.orlgmj (mgr.34412) 8841 : cluster [DBG] pgmap v5038: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:29.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:36:29 gibba045 bash[25517]: cluster 2021-03-10T16:36:28.294534+0000 mgr.gibba045.orlgmj (mgr.34412) 8842 : cluster [DBG] pgmap v5039: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:29.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:36:29 gibba045 bash[25517]: audit 2021-03-10T16:36:29.495049+0000 mon.c (mon.1) 2439 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:36:29.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:36:29 gibba045 bash[25517]: audit 2021-03-10T16:36:29.501591+0000 mon.c (mon.1) 2440 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:36:29.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:36:29 gibba015 bash[29377]: cluster 2021-03-10T16:36:28.294534+0000 mgr.gibba045.orlgmj (mgr.34412) 8842 : cluster [DBG] pgmap v5039: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:29.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:36:29 gibba015 bash[29377]: audit 2021-03-10T16:36:29.495049+0000 mon.c (mon.1) 2439 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:36:29.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:36:29 gibba015 bash[29377]: audit 2021-03-10T16:36:29.501591+0000 mon.c (mon.1) 2440 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:36:29.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:36:29 gibba015 bash[30343]: cluster 2021-03-10T16:36:28.294534+0000 mgr.gibba045.orlgmj (mgr.34412) 8842 : cluster [DBG] pgmap v5039: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:29.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:36:29 gibba015 bash[30343]: audit 2021-03-10T16:36:29.495049+0000 mon.c (mon.1) 2439 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:36:29.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:36:29 gibba015 bash[30343]: audit 2021-03-10T16:36:29.501591+0000 mon.c (mon.1) 2440 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:36:30.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:36:30 gibba015 bash[29377]: cephadm 2021-03-10T16:36:29.503615+0000 mgr.gibba045.orlgmj (mgr.34412) 8843 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:36:30.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:36:30 gibba015 bash[30343]: cephadm 2021-03-10T16:36:29.503615+0000 mgr.gibba045.orlgmj (mgr.34412) 8843 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:36:31.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:36:30 gibba045 bash[25517]: cephadm 2021-03-10T16:36:29.503615+0000 mgr.gibba045.orlgmj (mgr.34412) 8843 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:36:31.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:36:31 gibba015 bash[29377]: cluster 2021-03-10T16:36:30.296169+0000 mgr.gibba045.orlgmj (mgr.34412) 8844 : cluster [DBG] pgmap v5040: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:31.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:36:31 gibba015 bash[30343]: cluster 2021-03-10T16:36:30.296169+0000 mgr.gibba045.orlgmj (mgr.34412) 8844 : cluster [DBG] pgmap v5040: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:32.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:36:31 gibba045 bash[25517]: cluster 2021-03-10T16:36:30.296169+0000 mgr.gibba045.orlgmj (mgr.34412) 8844 : cluster [DBG] pgmap v5040: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:33.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:36:33 gibba015 bash[29377]: cluster 2021-03-10T16:36:32.297771+0000 mgr.gibba045.orlgmj (mgr.34412) 8845 : cluster [DBG] pgmap v5041: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:33.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:36:33 gibba015 bash[29377]: audit 2021-03-10T16:36:33.016697+0000 mon.a (mon.0) 1971 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:36:33.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:36:33 gibba015 bash[29377]: audit 2021-03-10T16:36:33.219601+0000 mon.a (mon.0) 1972 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:36:33.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:36:33 gibba015 bash[29377]: audit 2021-03-10T16:36:33.227552+0000 mon.c (mon.1) 2441 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:36:33.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:36:33 gibba015 bash[29377]: audit 2021-03-10T16:36:33.229195+0000 mon.c (mon.1) 2442 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:36:33.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:36:33 gibba015 bash[29377]: audit 2021-03-10T16:36:33.230724+0000 mon.c (mon.1) 2443 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:36:33.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:36:33 gibba015 bash[29377]: audit 2021-03-10T16:36:33.232042+0000 mon.c (mon.1) 2444 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:36:33.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:36:33 gibba015 bash[29377]: audit 2021-03-10T16:36:33.234971+0000 mon.c (mon.1) 2445 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:36:33.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:36:33 gibba015 bash[29377]: audit 2021-03-10T16:36:33.236454+0000 mon.c (mon.1) 2446 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:36:33.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:36:33 gibba015 bash[30343]: cluster 2021-03-10T16:36:32.297771+0000 mgr.gibba045.orlgmj (mgr.34412) 8845 : cluster [DBG] pgmap v5041: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:33.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:36:33 gibba015 bash[30343]: audit 2021-03-10T16:36:33.016697+0000 mon.a (mon.0) 1971 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:36:33.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:36:33 gibba015 bash[30343]: audit 2021-03-10T16:36:33.219601+0000 mon.a (mon.0) 1972 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:36:33.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:36:33 gibba015 bash[30343]: audit 2021-03-10T16:36:33.227552+0000 mon.c (mon.1) 2441 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:36:33.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:36:33 gibba015 bash[30343]: audit 2021-03-10T16:36:33.229195+0000 mon.c (mon.1) 2442 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:36:33.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:36:33 gibba015 bash[30343]: audit 2021-03-10T16:36:33.230724+0000 mon.c (mon.1) 2443 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:36:33.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:36:33 gibba015 bash[30343]: audit 2021-03-10T16:36:33.232042+0000 mon.c (mon.1) 2444 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:36:33.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:36:33 gibba015 bash[30343]: audit 2021-03-10T16:36:33.234971+0000 mon.c (mon.1) 2445 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:36:33.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:36:33 gibba015 bash[30343]: audit 2021-03-10T16:36:33.236454+0000 mon.c (mon.1) 2446 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:36:34.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:36:33 gibba045 bash[25517]: cluster 2021-03-10T16:36:32.297771+0000 mgr.gibba045.orlgmj (mgr.34412) 8845 : cluster [DBG] pgmap v5041: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:34.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:36:33 gibba045 bash[25517]: audit 2021-03-10T16:36:33.016697+0000 mon.a (mon.0) 1971 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:36:34.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:36:33 gibba045 bash[25517]: audit 2021-03-10T16:36:33.219601+0000 mon.a (mon.0) 1972 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:36:34.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:36:33 gibba045 bash[25517]: audit 2021-03-10T16:36:33.227552+0000 mon.c (mon.1) 2441 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:36:34.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:36:33 gibba045 bash[25517]: audit 2021-03-10T16:36:33.229195+0000 mon.c (mon.1) 2442 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:36:34.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:36:33 gibba045 bash[25517]: audit 2021-03-10T16:36:33.230724+0000 mon.c (mon.1) 2443 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:36:34.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:36:33 gibba045 bash[25517]: audit 2021-03-10T16:36:33.232042+0000 mon.c (mon.1) 2444 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:36:34.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:36:33 gibba045 bash[25517]: audit 2021-03-10T16:36:33.234971+0000 mon.c (mon.1) 2445 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:36:34.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:36:33 gibba045 bash[25517]: audit 2021-03-10T16:36:33.236454+0000 mon.c (mon.1) 2446 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:36:34.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:36:34 gibba015 bash[29377]: cephadm 2021-03-10T16:36:33.020861+0000 mgr.gibba045.orlgmj (mgr.34412) 8846 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:36:34.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:36:34 gibba015 bash[29377]: cephadm 2021-03-10T16:36:33.229054+0000 mgr.gibba045.orlgmj (mgr.34412) 8847 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:36:34.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:36:34 gibba015 bash[29377]: cephadm 2021-03-10T16:36:33.231173+0000 mgr.gibba045.orlgmj (mgr.34412) 8848 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:36:34.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:36:34 gibba015 bash[29377]: cephadm 2021-03-10T16:36:33.232611+0000 mgr.gibba045.orlgmj (mgr.34412) 8849 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:36:34.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:36:34 gibba015 bash[29377]: cephadm 2021-03-10T16:36:33.232651+0000 mgr.gibba045.orlgmj (mgr.34412) 8850 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:36:34.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:36:34 gibba015 bash[29377]: cephadm 2021-03-10T16:36:33.234129+0000 mgr.gibba045.orlgmj (mgr.34412) 8851 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:36:34.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:36:34 gibba015 bash[29377]: cephadm 2021-03-10T16:36:33.234170+0000 mgr.gibba045.orlgmj (mgr.34412) 8852 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:36:34.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:36:34 gibba015 bash[29377]: cephadm 2021-03-10T16:36:33.235357+0000 mgr.gibba045.orlgmj (mgr.34412) 8853 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:36:34.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:36:34 gibba015 bash[29377]: cephadm 2021-03-10T16:36:33.236817+0000 mgr.gibba045.orlgmj (mgr.34412) 8854 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:36:34.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:36:34 gibba015 bash[29377]: cephadm 2021-03-10T16:36:33.236941+0000 mgr.gibba045.orlgmj (mgr.34412) 8855 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:36:34.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:36:34 gibba015 bash[29377]: cephadm 2021-03-10T16:36:33.238267+0000 mgr.gibba045.orlgmj (mgr.34412) 8856 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:36:34.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:36:34 gibba015 bash[29377]: cephadm 2021-03-10T16:36:33.238623+0000 mgr.gibba045.orlgmj (mgr.34412) 8857 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:36:34.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:36:34 gibba015 bash[29377]: cephadm 2021-03-10T16:36:33.239727+0000 mgr.gibba045.orlgmj (mgr.34412) 8858 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:36:34.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:36:34 gibba015 bash[29377]: cephadm 2021-03-10T16:36:33.239771+0000 mgr.gibba045.orlgmj (mgr.34412) 8859 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:36:34.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:36:34 gibba015 bash[29377]: cephadm 2021-03-10T16:36:33.239888+0000 mgr.gibba045.orlgmj (mgr.34412) 8860 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:36:34.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:36:34 gibba015 bash[30343]: cephadm 2021-03-10T16:36:33.020861+0000 mgr.gibba045.orlgmj (mgr.34412) 8846 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:36:34.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:36:34 gibba015 bash[30343]: cephadm 2021-03-10T16:36:33.229054+0000 mgr.gibba045.orlgmj (mgr.34412) 8847 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:36:34.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:36:34 gibba015 bash[30343]: cephadm 2021-03-10T16:36:33.231173+0000 mgr.gibba045.orlgmj (mgr.34412) 8848 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:36:34.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:36:34 gibba015 bash[30343]: cephadm 2021-03-10T16:36:33.232611+0000 mgr.gibba045.orlgmj (mgr.34412) 8849 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:36:34.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:36:34 gibba015 bash[30343]: cephadm 2021-03-10T16:36:33.232651+0000 mgr.gibba045.orlgmj (mgr.34412) 8850 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:36:34.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:36:34 gibba015 bash[30343]: cephadm 2021-03-10T16:36:33.234129+0000 mgr.gibba045.orlgmj (mgr.34412) 8851 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:36:34.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:36:34 gibba015 bash[30343]: cephadm 2021-03-10T16:36:33.234170+0000 mgr.gibba045.orlgmj (mgr.34412) 8852 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:36:34.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:36:34 gibba015 bash[30343]: cephadm 2021-03-10T16:36:33.235357+0000 mgr.gibba045.orlgmj (mgr.34412) 8853 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:36:34.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:36:34 gibba015 bash[30343]: cephadm 2021-03-10T16:36:33.236817+0000 mgr.gibba045.orlgmj (mgr.34412) 8854 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:36:34.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:36:34 gibba015 bash[30343]: cephadm 2021-03-10T16:36:33.236941+0000 mgr.gibba045.orlgmj (mgr.34412) 8855 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:36:34.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:36:34 gibba015 bash[30343]: cephadm 2021-03-10T16:36:33.238267+0000 mgr.gibba045.orlgmj (mgr.34412) 8856 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:36:34.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:36:34 gibba015 bash[30343]: cephadm 2021-03-10T16:36:33.238623+0000 mgr.gibba045.orlgmj (mgr.34412) 8857 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:36:34.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:36:34 gibba015 bash[30343]: cephadm 2021-03-10T16:36:33.239727+0000 mgr.gibba045.orlgmj (mgr.34412) 8858 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:36:34.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:36:34 gibba015 bash[30343]: cephadm 2021-03-10T16:36:33.239771+0000 mgr.gibba045.orlgmj (mgr.34412) 8859 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:36:34.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:36:34 gibba015 bash[30343]: cephadm 2021-03-10T16:36:33.239888+0000 mgr.gibba045.orlgmj (mgr.34412) 8860 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:36:35.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:36:34 gibba045 bash[25517]: cephadm 2021-03-10T16:36:33.020861+0000 mgr.gibba045.orlgmj (mgr.34412) 8846 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:36:35.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:36:34 gibba045 bash[25517]: cephadm 2021-03-10T16:36:33.229054+0000 mgr.gibba045.orlgmj (mgr.34412) 8847 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:36:35.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:36:34 gibba045 bash[25517]: cephadm 2021-03-10T16:36:33.231173+0000 mgr.gibba045.orlgmj (mgr.34412) 8848 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:36:35.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:36:34 gibba045 bash[25517]: cephadm 2021-03-10T16:36:33.232611+0000 mgr.gibba045.orlgmj (mgr.34412) 8849 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:36:35.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:36:34 gibba045 bash[25517]: cephadm 2021-03-10T16:36:33.232651+0000 mgr.gibba045.orlgmj (mgr.34412) 8850 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:36:35.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:36:34 gibba045 bash[25517]: cephadm 2021-03-10T16:36:33.234129+0000 mgr.gibba045.orlgmj (mgr.34412) 8851 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:36:35.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:36:34 gibba045 bash[25517]: cephadm 2021-03-10T16:36:33.234170+0000 mgr.gibba045.orlgmj (mgr.34412) 8852 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:36:35.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:36:34 gibba045 bash[25517]: cephadm 2021-03-10T16:36:33.235357+0000 mgr.gibba045.orlgmj (mgr.34412) 8853 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:36:35.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:36:34 gibba045 bash[25517]: cephadm 2021-03-10T16:36:33.236817+0000 mgr.gibba045.orlgmj (mgr.34412) 8854 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:36:35.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:36:34 gibba045 bash[25517]: cephadm 2021-03-10T16:36:33.236941+0000 mgr.gibba045.orlgmj (mgr.34412) 8855 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:36:35.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:36:34 gibba045 bash[25517]: cephadm 2021-03-10T16:36:33.238267+0000 mgr.gibba045.orlgmj (mgr.34412) 8856 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:36:35.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:36:34 gibba045 bash[25517]: cephadm 2021-03-10T16:36:33.238623+0000 mgr.gibba045.orlgmj (mgr.34412) 8857 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:36:35.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:36:34 gibba045 bash[25517]: cephadm 2021-03-10T16:36:33.239727+0000 mgr.gibba045.orlgmj (mgr.34412) 8858 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:36:35.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:36:34 gibba045 bash[25517]: cephadm 2021-03-10T16:36:33.239771+0000 mgr.gibba045.orlgmj (mgr.34412) 8859 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:36:35.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:36:34 gibba045 bash[25517]: cephadm 2021-03-10T16:36:33.239888+0000 mgr.gibba045.orlgmj (mgr.34412) 8860 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:36:35.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:36:35 gibba015 bash[29377]: cluster 2021-03-10T16:36:34.299019+0000 mgr.gibba045.orlgmj (mgr.34412) 8861 : cluster [DBG] pgmap v5042: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:35.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:36:35 gibba015 bash[30343]: cluster 2021-03-10T16:36:34.299019+0000 mgr.gibba045.orlgmj (mgr.34412) 8861 : cluster [DBG] pgmap v5042: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:36.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:36:35 gibba045 bash[25517]: cluster 2021-03-10T16:36:34.299019+0000 mgr.gibba045.orlgmj (mgr.34412) 8861 : cluster [DBG] pgmap v5042: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:36.076 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:36:36.304 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:36:36.305 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 3s ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:36:36.305 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 9m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:36:36.305 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:36:36.305 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:36:36.306 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 3s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:36:36.306 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 3s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:36:36.306 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:36:36.306 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 3s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:36:36.307 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 3s ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:36:36.307 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 9m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:36:36.307 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 3s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:36:36.307 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 3s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:36:36.307 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 3s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:36:36.308 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 3s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:36:36.308 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:36:36.308 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:36:36.308 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:36:36.309 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:36:36.309 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 9m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:36:36.309 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 9m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:36:36.579 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:36:36.579 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:36:36.580 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:36:36.580 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:36:36.580 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:36:36.580 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:36:36.581 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:36:36.581 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:36:36.581 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:36:36.581 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:36:36.582 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:36:36.582 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:36:36.582 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:36:36.582 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:36:36.582 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:36:37.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:36:37 gibba015 bash[29377]: audit 2021-03-10T16:36:36.070680+0000 mgr.gibba045.orlgmj (mgr.34412) 8862 : audit [DBG] from='client.59980 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:36:37.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:36:37 gibba015 bash[29377]: audit 2021-03-10T16:36:36.295444+0000 mgr.gibba045.orlgmj (mgr.34412) 8863 : audit [DBG] from='client.49998 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:36:37.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:36:37 gibba015 bash[29377]: cluster 2021-03-10T16:36:36.300474+0000 mgr.gibba045.orlgmj (mgr.34412) 8864 : cluster [DBG] pgmap v5043: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:37.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:36:37 gibba015 bash[29377]: audit 2021-03-10T16:36:36.580085+0000 mon.a (mon.0) 1973 : audit [DBG] from='client.? 172.21.2.115:0/448781314' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:36:37.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:36:37 gibba015 bash[30343]: audit 2021-03-10T16:36:36.070680+0000 mgr.gibba045.orlgmj (mgr.34412) 8862 : audit [DBG] from='client.59980 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:36:37.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:36:37 gibba015 bash[30343]: audit 2021-03-10T16:36:36.295444+0000 mgr.gibba045.orlgmj (mgr.34412) 8863 : audit [DBG] from='client.49998 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:36:37.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:36:37 gibba015 bash[30343]: cluster 2021-03-10T16:36:36.300474+0000 mgr.gibba045.orlgmj (mgr.34412) 8864 : cluster [DBG] pgmap v5043: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:37.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:36:37 gibba015 bash[30343]: audit 2021-03-10T16:36:36.580085+0000 mon.a (mon.0) 1973 : audit [DBG] from='client.? 172.21.2.115:0/448781314' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:36:37.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:36:37 gibba045 bash[25517]: audit 2021-03-10T16:36:36.070680+0000 mgr.gibba045.orlgmj (mgr.34412) 8862 : audit [DBG] from='client.59980 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:36:37.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:36:37 gibba045 bash[25517]: audit 2021-03-10T16:36:36.295444+0000 mgr.gibba045.orlgmj (mgr.34412) 8863 : audit [DBG] from='client.49998 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:36:37.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:36:37 gibba045 bash[25517]: cluster 2021-03-10T16:36:36.300474+0000 mgr.gibba045.orlgmj (mgr.34412) 8864 : cluster [DBG] pgmap v5043: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:37.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:36:37 gibba045 bash[25517]: audit 2021-03-10T16:36:36.580085+0000 mon.a (mon.0) 1973 : audit [DBG] from='client.? 172.21.2.115:0/448781314' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:36:39.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:36:39 gibba015 bash[29377]: cluster 2021-03-10T16:36:38.302079+0000 mgr.gibba045.orlgmj (mgr.34412) 8865 : cluster [DBG] pgmap v5044: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:39.719 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:36:39 gibba015 bash[30343]: cluster 2021-03-10T16:36:38.302079+0000 mgr.gibba045.orlgmj (mgr.34412) 8865 : cluster [DBG] pgmap v5044: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:39.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:36:39 gibba045 bash[25517]: cluster 2021-03-10T16:36:38.302079+0000 mgr.gibba045.orlgmj (mgr.34412) 8865 : cluster [DBG] pgmap v5044: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:41.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:36:41 gibba015 bash[29377]: cluster 2021-03-10T16:36:40.303565+0000 mgr.gibba045.orlgmj (mgr.34412) 8866 : cluster [DBG] pgmap v5045: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:41.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:36:41 gibba015 bash[30343]: cluster 2021-03-10T16:36:40.303565+0000 mgr.gibba045.orlgmj (mgr.34412) 8866 : cluster [DBG] pgmap v5045: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:41.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:36:41 gibba045 bash[25517]: cluster 2021-03-10T16:36:40.303565+0000 mgr.gibba045.orlgmj (mgr.34412) 8866 : cluster [DBG] pgmap v5045: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:43.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:36:43 gibba015 bash[29377]: cluster 2021-03-10T16:36:42.305091+0000 mgr.gibba045.orlgmj (mgr.34412) 8867 : cluster [DBG] pgmap v5046: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:43.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:36:43 gibba015 bash[30343]: cluster 2021-03-10T16:36:42.305091+0000 mgr.gibba045.orlgmj (mgr.34412) 8867 : cluster [DBG] pgmap v5046: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:43.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:36:43 gibba045 bash[25517]: cluster 2021-03-10T16:36:42.305091+0000 mgr.gibba045.orlgmj (mgr.34412) 8867 : cluster [DBG] pgmap v5046: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:45.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:36:45 gibba015 bash[29377]: cluster 2021-03-10T16:36:44.306412+0000 mgr.gibba045.orlgmj (mgr.34412) 8868 : cluster [DBG] pgmap v5047: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:45.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:36:45 gibba015 bash[30343]: cluster 2021-03-10T16:36:44.306412+0000 mgr.gibba045.orlgmj (mgr.34412) 8868 : cluster [DBG] pgmap v5047: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:45.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:36:45 gibba045 bash[25517]: cluster 2021-03-10T16:36:44.306412+0000 mgr.gibba045.orlgmj (mgr.34412) 8868 : cluster [DBG] pgmap v5047: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:47.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:36:47 gibba015 bash[29377]: cluster 2021-03-10T16:36:46.308018+0000 mgr.gibba045.orlgmj (mgr.34412) 8869 : cluster [DBG] pgmap v5048: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:47.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:36:47 gibba015 bash[30343]: cluster 2021-03-10T16:36:46.308018+0000 mgr.gibba045.orlgmj (mgr.34412) 8869 : cluster [DBG] pgmap v5048: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:47.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:36:47 gibba045 bash[25517]: cluster 2021-03-10T16:36:46.308018+0000 mgr.gibba045.orlgmj (mgr.34412) 8869 : cluster [DBG] pgmap v5048: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:49.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:36:49 gibba015 bash[29377]: cephadm 2021-03-10T16:36:48.255870+0000 mgr.gibba045.orlgmj (mgr.34412) 8870 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:36:49.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:36:49 gibba015 bash[29377]: cluster 2021-03-10T16:36:48.309645+0000 mgr.gibba045.orlgmj (mgr.34412) 8871 : cluster [DBG] pgmap v5049: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:49.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:36:49 gibba015 bash[30343]: cephadm 2021-03-10T16:36:48.255870+0000 mgr.gibba045.orlgmj (mgr.34412) 8870 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:36:49.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:36:49 gibba015 bash[30343]: cluster 2021-03-10T16:36:48.309645+0000 mgr.gibba045.orlgmj (mgr.34412) 8871 : cluster [DBG] pgmap v5049: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:49.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:36:49 gibba045 bash[25517]: cephadm 2021-03-10T16:36:48.255870+0000 mgr.gibba045.orlgmj (mgr.34412) 8870 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:36:49.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:36:49 gibba045 bash[25517]: cluster 2021-03-10T16:36:48.309645+0000 mgr.gibba045.orlgmj (mgr.34412) 8871 : cluster [DBG] pgmap v5049: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:51.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:36:51 gibba015 bash[29377]: cluster 2021-03-10T16:36:50.311134+0000 mgr.gibba045.orlgmj (mgr.34412) 8872 : cluster [DBG] pgmap v5050: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:51.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:36:51 gibba015 bash[30343]: cluster 2021-03-10T16:36:50.311134+0000 mgr.gibba045.orlgmj (mgr.34412) 8872 : cluster [DBG] pgmap v5050: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:51.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:36:51 gibba045 bash[25517]: cluster 2021-03-10T16:36:50.311134+0000 mgr.gibba045.orlgmj (mgr.34412) 8872 : cluster [DBG] pgmap v5050: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:53.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:36:53 gibba015 bash[29377]: cluster 2021-03-10T16:36:52.312903+0000 mgr.gibba045.orlgmj (mgr.34412) 8873 : cluster [DBG] pgmap v5051: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:53.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:36:53 gibba015 bash[30343]: cluster 2021-03-10T16:36:52.312903+0000 mgr.gibba045.orlgmj (mgr.34412) 8873 : cluster [DBG] pgmap v5051: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:53.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:36:53 gibba045 bash[25517]: cluster 2021-03-10T16:36:52.312903+0000 mgr.gibba045.orlgmj (mgr.34412) 8873 : cluster [DBG] pgmap v5051: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:54.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:36:54 gibba015 bash[29377]: audit 2021-03-10T16:36:53.654525+0000 mon.c (mon.1) 2447 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:36:54.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:36:54 gibba015 bash[29377]: audit 2021-03-10T16:36:53.655173+0000 mon.c (mon.1) 2448 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:36:54.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:36:54 gibba015 bash[29377]: audit 2021-03-10T16:36:53.655683+0000 mon.a (mon.0) 1974 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:36:54.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:36:54 gibba015 bash[29377]: audit 2021-03-10T16:36:53.656855+0000 mon.a (mon.0) 1975 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:36:54.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:36:54 gibba015 bash[29377]: audit 2021-03-10T16:36:53.673860+0000 mon.c (mon.1) 2449 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T16:36:54.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:36:54 gibba015 bash[29377]: audit 2021-03-10T16:36:53.674608+0000 mon.c (mon.1) 2450 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:36:54.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:36:54 gibba015 bash[29377]: audit 2021-03-10T16:36:53.675086+0000 mon.a (mon.0) 1976 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T16:36:54.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:36:54 gibba015 bash[29377]: audit 2021-03-10T16:36:53.675288+0000 mon.c (mon.1) 2451 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:36:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:36:54 gibba015 bash[29377]: audit 2021-03-10T16:36:53.675945+0000 mon.c (mon.1) 2452 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T16:36:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:36:54 gibba015 bash[29377]: audit 2021-03-10T16:36:53.676576+0000 mon.a (mon.0) 1977 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:36:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:36:54 gibba015 bash[29377]: audit 2021-03-10T16:36:53.677730+0000 mon.a (mon.0) 1978 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:36:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:36:54 gibba015 bash[29377]: audit 2021-03-10T16:36:53.678537+0000 mon.a (mon.0) 1979 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T16:36:54.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:36:54 gibba015 bash[30343]: audit 2021-03-10T16:36:53.654525+0000 mon.c (mon.1) 2447 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:36:54.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:36:54 gibba015 bash[30343]: audit 2021-03-10T16:36:53.655173+0000 mon.c (mon.1) 2448 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:36:54.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:36:54 gibba015 bash[30343]: audit 2021-03-10T16:36:53.655683+0000 mon.a (mon.0) 1974 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:36:54.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:36:54 gibba015 bash[30343]: audit 2021-03-10T16:36:53.656855+0000 mon.a (mon.0) 1975 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:36:54.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:36:54 gibba015 bash[30343]: audit 2021-03-10T16:36:53.673860+0000 mon.c (mon.1) 2449 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T16:36:54.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:36:54 gibba015 bash[30343]: audit 2021-03-10T16:36:53.674608+0000 mon.c (mon.1) 2450 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:36:54.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:36:54 gibba015 bash[30343]: audit 2021-03-10T16:36:53.675086+0000 mon.a (mon.0) 1976 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T16:36:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:36:54 gibba015 bash[30343]: audit 2021-03-10T16:36:53.675288+0000 mon.c (mon.1) 2451 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:36:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:36:54 gibba015 bash[30343]: audit 2021-03-10T16:36:53.675945+0000 mon.c (mon.1) 2452 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T16:36:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:36:54 gibba015 bash[30343]: audit 2021-03-10T16:36:53.676576+0000 mon.a (mon.0) 1977 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:36:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:36:54 gibba015 bash[30343]: audit 2021-03-10T16:36:53.677730+0000 mon.a (mon.0) 1978 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:36:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:36:54 gibba015 bash[30343]: audit 2021-03-10T16:36:53.678537+0000 mon.a (mon.0) 1979 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T16:36:54.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:36:54 gibba045 bash[25517]: audit 2021-03-10T16:36:53.654525+0000 mon.c (mon.1) 2447 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:36:54.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:36:54 gibba045 bash[25517]: audit 2021-03-10T16:36:53.655173+0000 mon.c (mon.1) 2448 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:36:54.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:36:54 gibba045 bash[25517]: audit 2021-03-10T16:36:53.655683+0000 mon.a (mon.0) 1974 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:36:54.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:36:54 gibba045 bash[25517]: audit 2021-03-10T16:36:53.656855+0000 mon.a (mon.0) 1975 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:36:54.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:36:54 gibba045 bash[25517]: audit 2021-03-10T16:36:53.673860+0000 mon.c (mon.1) 2449 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T16:36:54.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:36:54 gibba045 bash[25517]: audit 2021-03-10T16:36:53.674608+0000 mon.c (mon.1) 2450 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:36:54.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:36:54 gibba045 bash[25517]: audit 2021-03-10T16:36:53.675086+0000 mon.a (mon.0) 1976 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T16:36:54.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:36:54 gibba045 bash[25517]: audit 2021-03-10T16:36:53.675288+0000 mon.c (mon.1) 2451 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:36:54.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:36:54 gibba045 bash[25517]: audit 2021-03-10T16:36:53.675945+0000 mon.c (mon.1) 2452 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T16:36:54.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:36:54 gibba045 bash[25517]: audit 2021-03-10T16:36:53.676576+0000 mon.a (mon.0) 1977 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:36:54.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:36:54 gibba045 bash[25517]: audit 2021-03-10T16:36:53.677730+0000 mon.a (mon.0) 1978 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:36:54.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:36:54 gibba045 bash[25517]: audit 2021-03-10T16:36:53.678537+0000 mon.a (mon.0) 1979 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T16:36:55.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:36:55 gibba015 bash[29377]: cluster 2021-03-10T16:36:54.314128+0000 mgr.gibba045.orlgmj (mgr.34412) 8874 : cluster [DBG] pgmap v5052: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:55.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:36:55 gibba015 bash[30343]: cluster 2021-03-10T16:36:54.314128+0000 mgr.gibba045.orlgmj (mgr.34412) 8874 : cluster [DBG] pgmap v5052: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:55.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:36:55 gibba045 bash[25517]: cluster 2021-03-10T16:36:54.314128+0000 mgr.gibba045.orlgmj (mgr.34412) 8874 : cluster [DBG] pgmap v5052: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:57.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:36:57 gibba015 bash[29377]: cluster 2021-03-10T16:36:56.315916+0000 mgr.gibba045.orlgmj (mgr.34412) 8875 : cluster [DBG] pgmap v5053: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:57.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:36:57 gibba015 bash[30343]: cluster 2021-03-10T16:36:56.315916+0000 mgr.gibba045.orlgmj (mgr.34412) 8875 : cluster [DBG] pgmap v5053: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:57.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:36:57 gibba045 bash[25517]: cluster 2021-03-10T16:36:56.315916+0000 mgr.gibba045.orlgmj (mgr.34412) 8875 : cluster [DBG] pgmap v5053: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:59.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:36:59 gibba015 bash[29377]: cluster 2021-03-10T16:36:58.317617+0000 mgr.gibba045.orlgmj (mgr.34412) 8876 : cluster [DBG] pgmap v5054: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:59.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:36:59 gibba015 bash[30343]: cluster 2021-03-10T16:36:58.317617+0000 mgr.gibba045.orlgmj (mgr.34412) 8876 : cluster [DBG] pgmap v5054: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:59.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:36:59 gibba045 bash[25517]: cluster 2021-03-10T16:36:58.317617+0000 mgr.gibba045.orlgmj (mgr.34412) 8876 : cluster [DBG] pgmap v5054: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:01.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:37:01 gibba015 bash[29377]: cluster 2021-03-10T16:37:00.319134+0000 mgr.gibba045.orlgmj (mgr.34412) 8877 : cluster [DBG] pgmap v5055: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:01.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:37:01 gibba015 bash[30343]: cluster 2021-03-10T16:37:00.319134+0000 mgr.gibba045.orlgmj (mgr.34412) 8877 : cluster [DBG] pgmap v5055: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:01.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:37:01 gibba045 bash[25517]: cluster 2021-03-10T16:37:00.319134+0000 mgr.gibba045.orlgmj (mgr.34412) 8877 : cluster [DBG] pgmap v5055: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:03.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:37:03 gibba045 bash[25517]: cluster 2021-03-10T16:37:02.320771+0000 mgr.gibba045.orlgmj (mgr.34412) 8878 : cluster [DBG] pgmap v5056: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:03.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:37:03 gibba015 bash[29377]: cluster 2021-03-10T16:37:02.320771+0000 mgr.gibba045.orlgmj (mgr.34412) 8878 : cluster [DBG] pgmap v5056: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:03.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:37:03 gibba015 bash[30343]: cluster 2021-03-10T16:37:02.320771+0000 mgr.gibba045.orlgmj (mgr.34412) 8878 : cluster [DBG] pgmap v5056: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:04.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:37:04 gibba045 bash[25517]: cephadm 2021-03-10T16:37:03.269681+0000 mgr.gibba045.orlgmj (mgr.34412) 8879 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:37:04.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:37:04 gibba015 bash[29377]: cephadm 2021-03-10T16:37:03.269681+0000 mgr.gibba045.orlgmj (mgr.34412) 8879 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:37:04.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:37:04 gibba015 bash[30343]: cephadm 2021-03-10T16:37:03.269681+0000 mgr.gibba045.orlgmj (mgr.34412) 8879 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:37:05.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:37:05 gibba045 bash[25517]: cluster 2021-03-10T16:37:04.321939+0000 mgr.gibba045.orlgmj (mgr.34412) 8880 : cluster [DBG] pgmap v5057: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:05.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:37:05 gibba015 bash[29377]: cluster 2021-03-10T16:37:04.321939+0000 mgr.gibba045.orlgmj (mgr.34412) 8880 : cluster [DBG] pgmap v5057: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:05.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:37:05 gibba015 bash[30343]: cluster 2021-03-10T16:37:04.321939+0000 mgr.gibba045.orlgmj (mgr.34412) 8880 : cluster [DBG] pgmap v5057: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:06.825 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:37:07.050 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:37:07.051 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 34s ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:37:07.051 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 9m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:37:07.051 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:37:07.051 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:37:07.052 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 34s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:37:07.052 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 34s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:37:07.052 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:37:07.052 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 34s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:37:07.053 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 34s ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:37:07.053 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 9m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:37:07.053 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 34s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:37:07.053 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 34s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:37:07.054 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 34s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:37:07.054 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 34s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:37:07.054 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:37:07.054 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:37:07.054 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:37:07.055 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:37:07.055 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 9m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:37:07.056 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 9m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:37:07.301 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:37:07.301 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:37:07.301 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:37:07.302 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:37:07.302 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:37:07.302 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:37:07.302 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:37:07.302 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:37:07.303 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:37:07.303 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:37:07.303 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:37:07.303 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:37:07.304 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:37:07.304 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:37:07.304 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:37:07.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:37:07 gibba045 bash[25517]: cluster 2021-03-10T16:37:06.323695+0000 mgr.gibba045.orlgmj (mgr.34412) 8881 : cluster [DBG] pgmap v5058: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:07.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:37:07 gibba045 bash[25517]: audit 2021-03-10T16:37:07.301728+0000 mon.c (mon.1) 2453 : audit [DBG] from='client.? 172.21.2.115:0/4198506371' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:37:07.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:37:07 gibba015 bash[29377]: cluster 2021-03-10T16:37:06.323695+0000 mgr.gibba045.orlgmj (mgr.34412) 8881 : cluster [DBG] pgmap v5058: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:07.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:37:07 gibba015 bash[29377]: audit 2021-03-10T16:37:07.301728+0000 mon.c (mon.1) 2453 : audit [DBG] from='client.? 172.21.2.115:0/4198506371' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:37:07.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:37:07 gibba015 bash[30343]: cluster 2021-03-10T16:37:06.323695+0000 mgr.gibba045.orlgmj (mgr.34412) 8881 : cluster [DBG] pgmap v5058: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:07.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:37:07 gibba015 bash[30343]: audit 2021-03-10T16:37:07.301728+0000 mon.c (mon.1) 2453 : audit [DBG] from='client.? 172.21.2.115:0/4198506371' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:37:08.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:37:08 gibba045 bash[25517]: audit 2021-03-10T16:37:06.819658+0000 mgr.gibba045.orlgmj (mgr.34412) 8882 : audit [DBG] from='client.59998 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:37:08.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:37:08 gibba045 bash[25517]: audit 2021-03-10T16:37:07.041169+0000 mgr.gibba045.orlgmj (mgr.34412) 8883 : audit [DBG] from='client.50016 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:37:08.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:37:08 gibba015 bash[29377]: audit 2021-03-10T16:37:06.819658+0000 mgr.gibba045.orlgmj (mgr.34412) 8882 : audit [DBG] from='client.59998 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:37:08.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:37:08 gibba015 bash[29377]: audit 2021-03-10T16:37:07.041169+0000 mgr.gibba045.orlgmj (mgr.34412) 8883 : audit [DBG] from='client.50016 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:37:08.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:37:08 gibba015 bash[30343]: audit 2021-03-10T16:37:06.819658+0000 mgr.gibba045.orlgmj (mgr.34412) 8882 : audit [DBG] from='client.59998 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:37:08.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:37:08 gibba015 bash[30343]: audit 2021-03-10T16:37:07.041169+0000 mgr.gibba045.orlgmj (mgr.34412) 8883 : audit [DBG] from='client.50016 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:37:09.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:37:09 gibba045 bash[25517]: cluster 2021-03-10T16:37:08.325353+0000 mgr.gibba045.orlgmj (mgr.34412) 8884 : cluster [DBG] pgmap v5059: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:09.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:37:09 gibba015 bash[29377]: cluster 2021-03-10T16:37:08.325353+0000 mgr.gibba045.orlgmj (mgr.34412) 8884 : cluster [DBG] pgmap v5059: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:09.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:37:09 gibba015 bash[30343]: cluster 2021-03-10T16:37:08.325353+0000 mgr.gibba045.orlgmj (mgr.34412) 8884 : cluster [DBG] pgmap v5059: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:11.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:37:11 gibba045 bash[25517]: cluster 2021-03-10T16:37:10.326983+0000 mgr.gibba045.orlgmj (mgr.34412) 8885 : cluster [DBG] pgmap v5060: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:11.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:37:11 gibba015 bash[29377]: cluster 2021-03-10T16:37:10.326983+0000 mgr.gibba045.orlgmj (mgr.34412) 8885 : cluster [DBG] pgmap v5060: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:11.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:37:11 gibba015 bash[30343]: cluster 2021-03-10T16:37:10.326983+0000 mgr.gibba045.orlgmj (mgr.34412) 8885 : cluster [DBG] pgmap v5060: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:13.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:37:13 gibba045 bash[25517]: cluster 2021-03-10T16:37:12.328662+0000 mgr.gibba045.orlgmj (mgr.34412) 8886 : cluster [DBG] pgmap v5061: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:13.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:37:13 gibba015 bash[29377]: cluster 2021-03-10T16:37:12.328662+0000 mgr.gibba045.orlgmj (mgr.34412) 8886 : cluster [DBG] pgmap v5061: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:13.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:37:13 gibba015 bash[30343]: cluster 2021-03-10T16:37:12.328662+0000 mgr.gibba045.orlgmj (mgr.34412) 8886 : cluster [DBG] pgmap v5061: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:15.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:37:15 gibba045 bash[25517]: cluster 2021-03-10T16:37:14.330134+0000 mgr.gibba045.orlgmj (mgr.34412) 8887 : cluster [DBG] pgmap v5062: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:15.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:37:15 gibba015 bash[29377]: cluster 2021-03-10T16:37:14.330134+0000 mgr.gibba045.orlgmj (mgr.34412) 8887 : cluster [DBG] pgmap v5062: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:15.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:37:15 gibba015 bash[30343]: cluster 2021-03-10T16:37:14.330134+0000 mgr.gibba045.orlgmj (mgr.34412) 8887 : cluster [DBG] pgmap v5062: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:17.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:37:17 gibba045 bash[25517]: cluster 2021-03-10T16:37:16.331974+0000 mgr.gibba045.orlgmj (mgr.34412) 8888 : cluster [DBG] pgmap v5063: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:17.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:37:17 gibba015 bash[29377]: cluster 2021-03-10T16:37:16.331974+0000 mgr.gibba045.orlgmj (mgr.34412) 8888 : cluster [DBG] pgmap v5063: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:17.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:37:17 gibba015 bash[30343]: cluster 2021-03-10T16:37:16.331974+0000 mgr.gibba045.orlgmj (mgr.34412) 8888 : cluster [DBG] pgmap v5063: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:19.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:37:19 gibba045 bash[25517]: cephadm 2021-03-10T16:37:18.285493+0000 mgr.gibba045.orlgmj (mgr.34412) 8889 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:37:20.072 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:37:19 gibba045 bash[25517]: cluster 2021-03-10T16:37:18.333594+0000 mgr.gibba045.orlgmj (mgr.34412) 8890 : cluster [DBG] pgmap v5064: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:20.073 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:37:19 gibba015 bash[29377]: cephadm 2021-03-10T16:37:18.285493+0000 mgr.gibba045.orlgmj (mgr.34412) 8889 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:37:20.073 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:37:19 gibba015 bash[29377]: cluster 2021-03-10T16:37:18.333594+0000 mgr.gibba045.orlgmj (mgr.34412) 8890 : cluster [DBG] pgmap v5064: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:20.074 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:37:19 gibba015 bash[30343]: cephadm 2021-03-10T16:37:18.285493+0000 mgr.gibba045.orlgmj (mgr.34412) 8889 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:37:20.074 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:37:19 gibba015 bash[30343]: cluster 2021-03-10T16:37:18.333594+0000 mgr.gibba045.orlgmj (mgr.34412) 8890 : cluster [DBG] pgmap v5064: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:21.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:37:21 gibba015 bash[29377]: cluster 2021-03-10T16:37:20.334996+0000 mgr.gibba045.orlgmj (mgr.34412) 8891 : cluster [DBG] pgmap v5065: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:21.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:37:21 gibba015 bash[30343]: cluster 2021-03-10T16:37:20.334996+0000 mgr.gibba045.orlgmj (mgr.34412) 8891 : cluster [DBG] pgmap v5065: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:22.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:37:21 gibba045 bash[25517]: cluster 2021-03-10T16:37:20.334996+0000 mgr.gibba045.orlgmj (mgr.34412) 8891 : cluster [DBG] pgmap v5065: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:23.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:37:23 gibba015 bash[29377]: cluster 2021-03-10T16:37:22.336808+0000 mgr.gibba045.orlgmj (mgr.34412) 8892 : cluster [DBG] pgmap v5066: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:23.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:37:23 gibba015 bash[30343]: cluster 2021-03-10T16:37:22.336808+0000 mgr.gibba045.orlgmj (mgr.34412) 8892 : cluster [DBG] pgmap v5066: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:24.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:37:23 gibba045 bash[25517]: cluster 2021-03-10T16:37:22.336808+0000 mgr.gibba045.orlgmj (mgr.34412) 8892 : cluster [DBG] pgmap v5066: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:25.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:37:25 gibba015 bash[29377]: cluster 2021-03-10T16:37:24.338038+0000 mgr.gibba045.orlgmj (mgr.34412) 8893 : cluster [DBG] pgmap v5067: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:25.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:37:25 gibba015 bash[30343]: cluster 2021-03-10T16:37:24.338038+0000 mgr.gibba045.orlgmj (mgr.34412) 8893 : cluster [DBG] pgmap v5067: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:26.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:37:25 gibba045 bash[25517]: cluster 2021-03-10T16:37:24.338038+0000 mgr.gibba045.orlgmj (mgr.34412) 8893 : cluster [DBG] pgmap v5067: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:27.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:37:27 gibba015 bash[29377]: cluster 2021-03-10T16:37:26.339899+0000 mgr.gibba045.orlgmj (mgr.34412) 8894 : cluster [DBG] pgmap v5068: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:27.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:37:27 gibba015 bash[30343]: cluster 2021-03-10T16:37:26.339899+0000 mgr.gibba045.orlgmj (mgr.34412) 8894 : cluster [DBG] pgmap v5068: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:28.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:37:27 gibba045 bash[25517]: cluster 2021-03-10T16:37:26.339899+0000 mgr.gibba045.orlgmj (mgr.34412) 8894 : cluster [DBG] pgmap v5068: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:29.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:37:29 gibba015 bash[29377]: cluster 2021-03-10T16:37:28.341392+0000 mgr.gibba045.orlgmj (mgr.34412) 8895 : cluster [DBG] pgmap v5069: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:29.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:37:29 gibba015 bash[30343]: cluster 2021-03-10T16:37:28.341392+0000 mgr.gibba045.orlgmj (mgr.34412) 8895 : cluster [DBG] pgmap v5069: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:30.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:37:29 gibba045 bash[25517]: cluster 2021-03-10T16:37:28.341392+0000 mgr.gibba045.orlgmj (mgr.34412) 8895 : cluster [DBG] pgmap v5069: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:31.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:37:31 gibba015 bash[29377]: cluster 2021-03-10T16:37:30.342935+0000 mgr.gibba045.orlgmj (mgr.34412) 8896 : cluster [DBG] pgmap v5070: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:31.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:37:31 gibba015 bash[30343]: cluster 2021-03-10T16:37:30.342935+0000 mgr.gibba045.orlgmj (mgr.34412) 8896 : cluster [DBG] pgmap v5070: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:32.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:37:31 gibba045 bash[25517]: cluster 2021-03-10T16:37:30.342935+0000 mgr.gibba045.orlgmj (mgr.34412) 8896 : cluster [DBG] pgmap v5070: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:33.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:37:33 gibba015 bash[29377]: cluster 2021-03-10T16:37:32.344576+0000 mgr.gibba045.orlgmj (mgr.34412) 8897 : cluster [DBG] pgmap v5071: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:33.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:37:33 gibba015 bash[29377]: audit 2021-03-10T16:37:33.299879+0000 mon.c (mon.1) 2454 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:37:33.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:37:33 gibba015 bash[29377]: audit 2021-03-10T16:37:33.306966+0000 mon.c (mon.1) 2455 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:37:33.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:37:33 gibba015 bash[30343]: cluster 2021-03-10T16:37:32.344576+0000 mgr.gibba045.orlgmj (mgr.34412) 8897 : cluster [DBG] pgmap v5071: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:33.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:37:33 gibba015 bash[30343]: audit 2021-03-10T16:37:33.299879+0000 mon.c (mon.1) 2454 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:37:33.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:37:33 gibba015 bash[30343]: audit 2021-03-10T16:37:33.306966+0000 mon.c (mon.1) 2455 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:37:34.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:37:33 gibba045 bash[25517]: cluster 2021-03-10T16:37:32.344576+0000 mgr.gibba045.orlgmj (mgr.34412) 8897 : cluster [DBG] pgmap v5071: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:34.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:37:33 gibba045 bash[25517]: audit 2021-03-10T16:37:33.299879+0000 mon.c (mon.1) 2454 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:37:34.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:37:33 gibba045 bash[25517]: audit 2021-03-10T16:37:33.306966+0000 mon.c (mon.1) 2455 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:37:34.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:37:34 gibba015 bash[29377]: cephadm 2021-03-10T16:37:33.307852+0000 mgr.gibba045.orlgmj (mgr.34412) 8898 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:37:34.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:37:34 gibba015 bash[30343]: cephadm 2021-03-10T16:37:33.307852+0000 mgr.gibba045.orlgmj (mgr.34412) 8898 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:37:35.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:37:34 gibba045 bash[25517]: cephadm 2021-03-10T16:37:33.307852+0000 mgr.gibba045.orlgmj (mgr.34412) 8898 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:37:35.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:37:35 gibba015 bash[29377]: cluster 2021-03-10T16:37:34.345811+0000 mgr.gibba045.orlgmj (mgr.34412) 8899 : cluster [DBG] pgmap v5072: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:35.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:37:35 gibba015 bash[30343]: cluster 2021-03-10T16:37:34.345811+0000 mgr.gibba045.orlgmj (mgr.34412) 8899 : cluster [DBG] pgmap v5072: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:36.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:37:35 gibba045 bash[25517]: cluster 2021-03-10T16:37:34.345811+0000 mgr.gibba045.orlgmj (mgr.34412) 8899 : cluster [DBG] pgmap v5072: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:37.543 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:37:37.774 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:37:37.775 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 64s ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:37:37.775 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 0s ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:37:37.775 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 0s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:37:37.776 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 0s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:37:37.776 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 64s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:37:37.776 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 64s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:37:37.776 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 0s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:37:37.777 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 64s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:37:37.777 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 64s ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:37:37.777 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 0s ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:37:37.777 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 64s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:37:37.777 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 64s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:37:37.778 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 64s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:37:37.778 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 64s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:37:37.778 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 0s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:37:37.778 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 0s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:37:37.779 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 0s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:37:37.779 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 0s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:37:37.779 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 0s ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:37:37.779 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 0s ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:37:37.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:37:37 gibba015 bash[29377]: cluster 2021-03-10T16:37:36.346397+0000 mgr.gibba045.orlgmj (mgr.34412) 8900 : cluster [DBG] pgmap v5073: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:37.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:37:37 gibba015 bash[29377]: audit 2021-03-10T16:37:37.084379+0000 mon.a (mon.0) 1980 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:37:37.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:37:37 gibba015 bash[29377]: audit 2021-03-10T16:37:37.292483+0000 mon.a (mon.0) 1981 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:37:37.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:37:37 gibba015 bash[29377]: audit 2021-03-10T16:37:37.296502+0000 mon.c (mon.1) 2456 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:37:37.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:37:37 gibba015 bash[29377]: audit 2021-03-10T16:37:37.298187+0000 mon.c (mon.1) 2457 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:37:37.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:37:37 gibba015 bash[29377]: audit 2021-03-10T16:37:37.299762+0000 mon.c (mon.1) 2458 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:37:37.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:37:37 gibba015 bash[29377]: audit 2021-03-10T16:37:37.301230+0000 mon.c (mon.1) 2459 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:37:37.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:37:37 gibba015 bash[29377]: audit 2021-03-10T16:37:37.305279+0000 mon.c (mon.1) 2460 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:37:37.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:37:37 gibba015 bash[29377]: audit 2021-03-10T16:37:37.307261+0000 mon.c (mon.1) 2461 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:37:37.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:37:37 gibba015 bash[30343]: cluster 2021-03-10T16:37:36.346397+0000 mgr.gibba045.orlgmj (mgr.34412) 8900 : cluster [DBG] pgmap v5073: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:37.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:37:37 gibba015 bash[30343]: audit 2021-03-10T16:37:37.084379+0000 mon.a (mon.0) 1980 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:37:37.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:37:37 gibba015 bash[30343]: audit 2021-03-10T16:37:37.292483+0000 mon.a (mon.0) 1981 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:37:37.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:37:37 gibba015 bash[30343]: audit 2021-03-10T16:37:37.296502+0000 mon.c (mon.1) 2456 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:37:37.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:37:37 gibba015 bash[30343]: audit 2021-03-10T16:37:37.298187+0000 mon.c (mon.1) 2457 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:37:37.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:37:37 gibba015 bash[30343]: audit 2021-03-10T16:37:37.299762+0000 mon.c (mon.1) 2458 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:37:37.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:37:37 gibba015 bash[30343]: audit 2021-03-10T16:37:37.301230+0000 mon.c (mon.1) 2459 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:37:37.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:37:37 gibba015 bash[30343]: audit 2021-03-10T16:37:37.305279+0000 mon.c (mon.1) 2460 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:37:37.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:37:37 gibba015 bash[30343]: audit 2021-03-10T16:37:37.307261+0000 mon.c (mon.1) 2461 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:37:38.027 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:37:38.027 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:37:38.027 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:37:38.027 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:37:38.028 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:37:38.028 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:37:38.028 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:37:38.028 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:37:38.029 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:37:38.029 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:37:38.029 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:37:38.029 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:37:38.030 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:37:38.030 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:37:38.030 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:37:38.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:37:37 gibba045 bash[25517]: cluster 2021-03-10T16:37:36.346397+0000 mgr.gibba045.orlgmj (mgr.34412) 8900 : cluster [DBG] pgmap v5073: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:38.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:37:37 gibba045 bash[25517]: audit 2021-03-10T16:37:37.084379+0000 mon.a (mon.0) 1980 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:37:38.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:37:37 gibba045 bash[25517]: audit 2021-03-10T16:37:37.292483+0000 mon.a (mon.0) 1981 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:37:38.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:37:37 gibba045 bash[25517]: audit 2021-03-10T16:37:37.296502+0000 mon.c (mon.1) 2456 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:37:38.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:37:37 gibba045 bash[25517]: audit 2021-03-10T16:37:37.298187+0000 mon.c (mon.1) 2457 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:37:38.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:37:37 gibba045 bash[25517]: audit 2021-03-10T16:37:37.299762+0000 mon.c (mon.1) 2458 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:37:38.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:37:37 gibba045 bash[25517]: audit 2021-03-10T16:37:37.301230+0000 mon.c (mon.1) 2459 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:37:38.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:37:37 gibba045 bash[25517]: audit 2021-03-10T16:37:37.305279+0000 mon.c (mon.1) 2460 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:37:38.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:37:37 gibba045 bash[25517]: audit 2021-03-10T16:37:37.307261+0000 mon.c (mon.1) 2461 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:37:38.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:37:38 gibba015 bash[29377]: cephadm 2021-03-10T16:37:37.088989+0000 mgr.gibba045.orlgmj (mgr.34412) 8901 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:37:38.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:37:38 gibba015 bash[29377]: cephadm 2021-03-10T16:37:37.298054+0000 mgr.gibba045.orlgmj (mgr.34412) 8902 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:37:38.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:37:38 gibba015 bash[29377]: cephadm 2021-03-10T16:37:37.300285+0000 mgr.gibba045.orlgmj (mgr.34412) 8903 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:37:38.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:37:38 gibba015 bash[29377]: cephadm 2021-03-10T16:37:37.301641+0000 mgr.gibba045.orlgmj (mgr.34412) 8904 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:37:38.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:37:38 gibba015 bash[29377]: cephadm 2021-03-10T16:37:37.301676+0000 mgr.gibba045.orlgmj (mgr.34412) 8905 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:37:38.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:37:38 gibba015 bash[29377]: cephadm 2021-03-10T16:37:37.303298+0000 mgr.gibba045.orlgmj (mgr.34412) 8906 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:37:38.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:37:38 gibba015 bash[29377]: cephadm 2021-03-10T16:37:37.303335+0000 mgr.gibba045.orlgmj (mgr.34412) 8907 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:37:38.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:37:38 gibba015 bash[29377]: cephadm 2021-03-10T16:37:37.305160+0000 mgr.gibba045.orlgmj (mgr.34412) 8908 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:37:38.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:37:38 gibba015 bash[29377]: cephadm 2021-03-10T16:37:37.307261+0000 mgr.gibba045.orlgmj (mgr.34412) 8909 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:37:38.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:37:38 gibba015 bash[29377]: cephadm 2021-03-10T16:37:37.307297+0000 mgr.gibba045.orlgmj (mgr.34412) 8910 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:37:38.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:37:38 gibba015 bash[29377]: cephadm 2021-03-10T16:37:37.309104+0000 mgr.gibba045.orlgmj (mgr.34412) 8911 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:37:38.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:37:38 gibba015 bash[29377]: cephadm 2021-03-10T16:37:37.309413+0000 mgr.gibba045.orlgmj (mgr.34412) 8912 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:37:38.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:37:38 gibba015 bash[29377]: cephadm 2021-03-10T16:37:37.311059+0000 mgr.gibba045.orlgmj (mgr.34412) 8913 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:37:38.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:37:38 gibba015 bash[29377]: cephadm 2021-03-10T16:37:37.311097+0000 mgr.gibba045.orlgmj (mgr.34412) 8914 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:37:38.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:37:38 gibba015 bash[29377]: cephadm 2021-03-10T16:37:37.311200+0000 mgr.gibba045.orlgmj (mgr.34412) 8915 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:37:38.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:37:38 gibba015 bash[29377]: audit 2021-03-10T16:37:37.537073+0000 mgr.gibba045.orlgmj (mgr.34412) 8916 : audit [DBG] from='client.50028 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:37:38.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:37:38 gibba015 bash[29377]: audit 2021-03-10T16:37:38.027718+0000 mon.c (mon.1) 2462 : audit [DBG] from='client.? 172.21.2.115:0/1221921370' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:37:38.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:37:38 gibba015 bash[30343]: cephadm 2021-03-10T16:37:37.088989+0000 mgr.gibba045.orlgmj (mgr.34412) 8901 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:37:38.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:37:38 gibba015 bash[30343]: cephadm 2021-03-10T16:37:37.298054+0000 mgr.gibba045.orlgmj (mgr.34412) 8902 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:37:38.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:37:38 gibba015 bash[30343]: cephadm 2021-03-10T16:37:37.300285+0000 mgr.gibba045.orlgmj (mgr.34412) 8903 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:37:38.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:37:38 gibba015 bash[30343]: cephadm 2021-03-10T16:37:37.301641+0000 mgr.gibba045.orlgmj (mgr.34412) 8904 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:37:38.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:37:38 gibba015 bash[30343]: cephadm 2021-03-10T16:37:37.301676+0000 mgr.gibba045.orlgmj (mgr.34412) 8905 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:37:38.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:37:38 gibba015 bash[30343]: cephadm 2021-03-10T16:37:37.303298+0000 mgr.gibba045.orlgmj (mgr.34412) 8906 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:37:38.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:37:38 gibba015 bash[30343]: cephadm 2021-03-10T16:37:37.303335+0000 mgr.gibba045.orlgmj (mgr.34412) 8907 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:37:38.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:37:38 gibba015 bash[30343]: cephadm 2021-03-10T16:37:37.305160+0000 mgr.gibba045.orlgmj (mgr.34412) 8908 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:37:38.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:37:38 gibba015 bash[30343]: cephadm 2021-03-10T16:37:37.307261+0000 mgr.gibba045.orlgmj (mgr.34412) 8909 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:37:38.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:37:38 gibba015 bash[30343]: cephadm 2021-03-10T16:37:37.307297+0000 mgr.gibba045.orlgmj (mgr.34412) 8910 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:37:38.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:37:38 gibba015 bash[30343]: cephadm 2021-03-10T16:37:37.309104+0000 mgr.gibba045.orlgmj (mgr.34412) 8911 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:37:38.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:37:38 gibba015 bash[30343]: cephadm 2021-03-10T16:37:37.309413+0000 mgr.gibba045.orlgmj (mgr.34412) 8912 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:37:38.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:37:38 gibba015 bash[30343]: cephadm 2021-03-10T16:37:37.311059+0000 mgr.gibba045.orlgmj (mgr.34412) 8913 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:37:38.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:37:38 gibba015 bash[30343]: cephadm 2021-03-10T16:37:37.311097+0000 mgr.gibba045.orlgmj (mgr.34412) 8914 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:37:38.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:37:38 gibba015 bash[30343]: cephadm 2021-03-10T16:37:37.311200+0000 mgr.gibba045.orlgmj (mgr.34412) 8915 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:37:38.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:37:38 gibba015 bash[30343]: audit 2021-03-10T16:37:37.537073+0000 mgr.gibba045.orlgmj (mgr.34412) 8916 : audit [DBG] from='client.50028 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:37:38.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:37:38 gibba015 bash[30343]: audit 2021-03-10T16:37:38.027718+0000 mon.c (mon.1) 2462 : audit [DBG] from='client.? 172.21.2.115:0/1221921370' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:37:39.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:37:38 gibba045 bash[25517]: cephadm 2021-03-10T16:37:37.088989+0000 mgr.gibba045.orlgmj (mgr.34412) 8901 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:37:39.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:37:38 gibba045 bash[25517]: cephadm 2021-03-10T16:37:37.298054+0000 mgr.gibba045.orlgmj (mgr.34412) 8902 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:37:39.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:37:38 gibba045 bash[25517]: cephadm 2021-03-10T16:37:37.300285+0000 mgr.gibba045.orlgmj (mgr.34412) 8903 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:37:39.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:37:38 gibba045 bash[25517]: cephadm 2021-03-10T16:37:37.301641+0000 mgr.gibba045.orlgmj (mgr.34412) 8904 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:37:39.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:37:38 gibba045 bash[25517]: cephadm 2021-03-10T16:37:37.301676+0000 mgr.gibba045.orlgmj (mgr.34412) 8905 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:37:39.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:37:38 gibba045 bash[25517]: cephadm 2021-03-10T16:37:37.303298+0000 mgr.gibba045.orlgmj (mgr.34412) 8906 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:37:39.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:37:38 gibba045 bash[25517]: cephadm 2021-03-10T16:37:37.303335+0000 mgr.gibba045.orlgmj (mgr.34412) 8907 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:37:39.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:37:38 gibba045 bash[25517]: cephadm 2021-03-10T16:37:37.305160+0000 mgr.gibba045.orlgmj (mgr.34412) 8908 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:37:39.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:37:38 gibba045 bash[25517]: cephadm 2021-03-10T16:37:37.307261+0000 mgr.gibba045.orlgmj (mgr.34412) 8909 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:37:39.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:37:38 gibba045 bash[25517]: cephadm 2021-03-10T16:37:37.307297+0000 mgr.gibba045.orlgmj (mgr.34412) 8910 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:37:39.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:37:38 gibba045 bash[25517]: cephadm 2021-03-10T16:37:37.309104+0000 mgr.gibba045.orlgmj (mgr.34412) 8911 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:37:39.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:37:38 gibba045 bash[25517]: cephadm 2021-03-10T16:37:37.309413+0000 mgr.gibba045.orlgmj (mgr.34412) 8912 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:37:39.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:37:38 gibba045 bash[25517]: cephadm 2021-03-10T16:37:37.311059+0000 mgr.gibba045.orlgmj (mgr.34412) 8913 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:37:39.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:37:38 gibba045 bash[25517]: cephadm 2021-03-10T16:37:37.311097+0000 mgr.gibba045.orlgmj (mgr.34412) 8914 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:37:39.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:37:38 gibba045 bash[25517]: cephadm 2021-03-10T16:37:37.311200+0000 mgr.gibba045.orlgmj (mgr.34412) 8915 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:37:39.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:37:38 gibba045 bash[25517]: audit 2021-03-10T16:37:37.537073+0000 mgr.gibba045.orlgmj (mgr.34412) 8916 : audit [DBG] from='client.50028 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:37:39.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:37:38 gibba045 bash[25517]: audit 2021-03-10T16:37:38.027718+0000 mon.c (mon.1) 2462 : audit [DBG] from='client.? 172.21.2.115:0/1221921370' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:37:39.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:37:39 gibba015 bash[29377]: audit 2021-03-10T16:37:37.765031+0000 mgr.gibba045.orlgmj (mgr.34412) 8917 : audit [DBG] from='client.60022 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:37:39.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:37:39 gibba015 bash[29377]: cluster 2021-03-10T16:37:38.347632+0000 mgr.gibba045.orlgmj (mgr.34412) 8918 : cluster [DBG] pgmap v5074: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:39.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:37:39 gibba015 bash[30343]: audit 2021-03-10T16:37:37.765031+0000 mgr.gibba045.orlgmj (mgr.34412) 8917 : audit [DBG] from='client.60022 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:37:39.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:37:39 gibba015 bash[30343]: cluster 2021-03-10T16:37:38.347632+0000 mgr.gibba045.orlgmj (mgr.34412) 8918 : cluster [DBG] pgmap v5074: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:40.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:37:39 gibba045 bash[25517]: audit 2021-03-10T16:37:37.765031+0000 mgr.gibba045.orlgmj (mgr.34412) 8917 : audit [DBG] from='client.60022 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:37:40.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:37:39 gibba045 bash[25517]: cluster 2021-03-10T16:37:38.347632+0000 mgr.gibba045.orlgmj (mgr.34412) 8918 : cluster [DBG] pgmap v5074: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:41.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:37:41 gibba015 bash[29377]: cluster 2021-03-10T16:37:40.349369+0000 mgr.gibba045.orlgmj (mgr.34412) 8919 : cluster [DBG] pgmap v5075: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:41.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:37:41 gibba015 bash[30343]: cluster 2021-03-10T16:37:40.349369+0000 mgr.gibba045.orlgmj (mgr.34412) 8919 : cluster [DBG] pgmap v5075: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:42.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:37:41 gibba045 bash[25517]: cluster 2021-03-10T16:37:40.349369+0000 mgr.gibba045.orlgmj (mgr.34412) 8919 : cluster [DBG] pgmap v5075: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:43.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:37:43 gibba015 bash[29377]: cluster 2021-03-10T16:37:42.351111+0000 mgr.gibba045.orlgmj (mgr.34412) 8920 : cluster [DBG] pgmap v5076: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:43.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:37:43 gibba015 bash[30343]: cluster 2021-03-10T16:37:42.351111+0000 mgr.gibba045.orlgmj (mgr.34412) 8920 : cluster [DBG] pgmap v5076: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:44.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:37:43 gibba045 bash[25517]: cluster 2021-03-10T16:37:42.351111+0000 mgr.gibba045.orlgmj (mgr.34412) 8920 : cluster [DBG] pgmap v5076: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:45.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:37:45 gibba015 bash[29377]: cluster 2021-03-10T16:37:44.352329+0000 mgr.gibba045.orlgmj (mgr.34412) 8921 : cluster [DBG] pgmap v5077: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:45.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:37:45 gibba015 bash[30343]: cluster 2021-03-10T16:37:44.352329+0000 mgr.gibba045.orlgmj (mgr.34412) 8921 : cluster [DBG] pgmap v5077: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:46.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:37:45 gibba045 bash[25517]: cluster 2021-03-10T16:37:44.352329+0000 mgr.gibba045.orlgmj (mgr.34412) 8921 : cluster [DBG] pgmap v5077: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:47.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:37:47 gibba015 bash[29377]: cluster 2021-03-10T16:37:46.354105+0000 mgr.gibba045.orlgmj (mgr.34412) 8922 : cluster [DBG] pgmap v5078: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:47.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:37:47 gibba015 bash[30343]: cluster 2021-03-10T16:37:46.354105+0000 mgr.gibba045.orlgmj (mgr.34412) 8922 : cluster [DBG] pgmap v5078: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:48.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:37:47 gibba045 bash[25517]: cluster 2021-03-10T16:37:46.354105+0000 mgr.gibba045.orlgmj (mgr.34412) 8922 : cluster [DBG] pgmap v5078: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:49.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:37:49 gibba015 bash[29377]: cluster 2021-03-10T16:37:48.355448+0000 mgr.gibba045.orlgmj (mgr.34412) 8923 : cluster [DBG] pgmap v5079: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:49.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:37:49 gibba015 bash[30343]: cluster 2021-03-10T16:37:48.355448+0000 mgr.gibba045.orlgmj (mgr.34412) 8923 : cluster [DBG] pgmap v5079: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:50.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:37:49 gibba045 bash[25517]: cluster 2021-03-10T16:37:48.355448+0000 mgr.gibba045.orlgmj (mgr.34412) 8923 : cluster [DBG] pgmap v5079: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:50.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:37:50 gibba015 bash[29377]: cluster 2021-03-10T16:37:50.357142+0000 mgr.gibba045.orlgmj (mgr.34412) 8924 : cluster [DBG] pgmap v5080: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:50.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:37:50 gibba015 bash[30343]: cluster 2021-03-10T16:37:50.357142+0000 mgr.gibba045.orlgmj (mgr.34412) 8924 : cluster [DBG] pgmap v5080: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:51.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:37:50 gibba045 bash[25517]: cluster 2021-03-10T16:37:50.357142+0000 mgr.gibba045.orlgmj (mgr.34412) 8924 : cluster [DBG] pgmap v5080: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:53.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:37:53 gibba015 bash[29377]: cephadm 2021-03-10T16:37:52.327120+0000 mgr.gibba045.orlgmj (mgr.34412) 8925 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:37:53.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:37:53 gibba015 bash[29377]: cluster 2021-03-10T16:37:52.358893+0000 mgr.gibba045.orlgmj (mgr.34412) 8926 : cluster [DBG] pgmap v5081: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:53.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:37:53 gibba015 bash[30343]: cephadm 2021-03-10T16:37:52.327120+0000 mgr.gibba045.orlgmj (mgr.34412) 8925 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:37:53.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:37:53 gibba015 bash[30343]: cluster 2021-03-10T16:37:52.358893+0000 mgr.gibba045.orlgmj (mgr.34412) 8926 : cluster [DBG] pgmap v5081: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:53.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:37:53 gibba045 bash[25517]: cephadm 2021-03-10T16:37:52.327120+0000 mgr.gibba045.orlgmj (mgr.34412) 8925 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:37:53.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:37:53 gibba045 bash[25517]: cluster 2021-03-10T16:37:52.358893+0000 mgr.gibba045.orlgmj (mgr.34412) 8926 : cluster [DBG] pgmap v5081: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:54.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:37:54 gibba015 bash[29377]: audit 2021-03-10T16:37:53.670847+0000 mon.c (mon.1) 2463 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:37:54.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:37:54 gibba015 bash[29377]: audit 2021-03-10T16:37:53.671637+0000 mon.c (mon.1) 2464 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:37:54.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:37:54 gibba015 bash[29377]: audit 2021-03-10T16:37:53.672071+0000 mon.a (mon.0) 1982 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:37:54.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:37:54 gibba015 bash[29377]: audit 2021-03-10T16:37:53.673454+0000 mon.a (mon.0) 1983 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:37:54.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:37:54 gibba015 bash[29377]: audit 2021-03-10T16:37:53.685295+0000 mon.c (mon.1) 2465 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T16:37:54.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:37:54 gibba015 bash[29377]: audit 2021-03-10T16:37:53.686204+0000 mon.c (mon.1) 2466 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T16:37:54.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:37:54 gibba015 bash[29377]: audit 2021-03-10T16:37:53.686487+0000 mon.a (mon.0) 1984 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T16:37:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:37:54 gibba015 bash[29377]: audit 2021-03-10T16:37:53.687066+0000 mon.c (mon.1) 2467 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:37:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:37:54 gibba015 bash[29377]: audit 2021-03-10T16:37:53.688228+0000 mon.c (mon.1) 2468 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:37:54.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:37:54 gibba015 bash[29377]: audit 2021-03-10T16:37:53.688737+0000 mon.a (mon.0) 1985 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T16:37:54.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:37:54 gibba015 bash[29377]: audit 2021-03-10T16:37:53.689985+0000 mon.a (mon.0) 1986 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:37:54.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:37:54 gibba015 bash[29377]: audit 2021-03-10T16:37:53.690618+0000 mon.a (mon.0) 1987 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:37:54.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:37:54 gibba015 bash[30343]: audit 2021-03-10T16:37:53.670847+0000 mon.c (mon.1) 2463 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:37:54.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:37:54 gibba015 bash[30343]: audit 2021-03-10T16:37:53.671637+0000 mon.c (mon.1) 2464 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:37:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:37:54 gibba015 bash[30343]: audit 2021-03-10T16:37:53.672071+0000 mon.a (mon.0) 1982 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:37:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:37:54 gibba015 bash[30343]: audit 2021-03-10T16:37:53.673454+0000 mon.a (mon.0) 1983 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:37:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:37:54 gibba015 bash[30343]: audit 2021-03-10T16:37:53.685295+0000 mon.c (mon.1) 2465 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T16:37:54.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:37:54 gibba015 bash[30343]: audit 2021-03-10T16:37:53.686204+0000 mon.c (mon.1) 2466 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T16:37:54.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:37:54 gibba015 bash[30343]: audit 2021-03-10T16:37:53.686487+0000 mon.a (mon.0) 1984 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T16:37:54.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:37:54 gibba015 bash[30343]: audit 2021-03-10T16:37:53.687066+0000 mon.c (mon.1) 2467 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:37:54.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:37:54 gibba015 bash[30343]: audit 2021-03-10T16:37:53.688228+0000 mon.c (mon.1) 2468 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:37:54.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:37:54 gibba015 bash[30343]: audit 2021-03-10T16:37:53.688737+0000 mon.a (mon.0) 1985 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T16:37:54.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:37:54 gibba015 bash[30343]: audit 2021-03-10T16:37:53.689985+0000 mon.a (mon.0) 1986 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:37:54.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:37:54 gibba015 bash[30343]: audit 2021-03-10T16:37:53.690618+0000 mon.a (mon.0) 1987 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:37:54.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:37:54 gibba045 bash[25517]: audit 2021-03-10T16:37:53.670847+0000 mon.c (mon.1) 2463 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:37:54.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:37:54 gibba045 bash[25517]: audit 2021-03-10T16:37:53.671637+0000 mon.c (mon.1) 2464 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:37:54.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:37:54 gibba045 bash[25517]: audit 2021-03-10T16:37:53.672071+0000 mon.a (mon.0) 1982 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:37:54.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:37:54 gibba045 bash[25517]: audit 2021-03-10T16:37:53.673454+0000 mon.a (mon.0) 1983 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:37:54.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:37:54 gibba045 bash[25517]: audit 2021-03-10T16:37:53.685295+0000 mon.c (mon.1) 2465 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T16:37:54.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:37:54 gibba045 bash[25517]: audit 2021-03-10T16:37:53.686204+0000 mon.c (mon.1) 2466 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T16:37:54.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:37:54 gibba045 bash[25517]: audit 2021-03-10T16:37:53.686487+0000 mon.a (mon.0) 1984 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T16:37:54.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:37:54 gibba045 bash[25517]: audit 2021-03-10T16:37:53.687066+0000 mon.c (mon.1) 2467 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:37:54.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:37:54 gibba045 bash[25517]: audit 2021-03-10T16:37:53.688228+0000 mon.c (mon.1) 2468 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:37:54.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:37:54 gibba045 bash[25517]: audit 2021-03-10T16:37:53.688737+0000 mon.a (mon.0) 1985 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T16:37:54.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:37:54 gibba045 bash[25517]: audit 2021-03-10T16:37:53.689985+0000 mon.a (mon.0) 1986 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:37:54.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:37:54 gibba045 bash[25517]: audit 2021-03-10T16:37:53.690618+0000 mon.a (mon.0) 1987 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:37:55.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:37:55 gibba015 bash[29377]: cluster 2021-03-10T16:37:54.360103+0000 mgr.gibba045.orlgmj (mgr.34412) 8927 : cluster [DBG] pgmap v5082: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:55.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:37:55 gibba015 bash[30343]: cluster 2021-03-10T16:37:54.360103+0000 mgr.gibba045.orlgmj (mgr.34412) 8927 : cluster [DBG] pgmap v5082: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:55.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:37:55 gibba045 bash[25517]: cluster 2021-03-10T16:37:54.360103+0000 mgr.gibba045.orlgmj (mgr.34412) 8927 : cluster [DBG] pgmap v5082: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:57.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:37:57 gibba015 bash[29377]: cluster 2021-03-10T16:37:56.361926+0000 mgr.gibba045.orlgmj (mgr.34412) 8928 : cluster [DBG] pgmap v5083: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:57.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:37:57 gibba015 bash[30343]: cluster 2021-03-10T16:37:56.361926+0000 mgr.gibba045.orlgmj (mgr.34412) 8928 : cluster [DBG] pgmap v5083: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:57.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:37:57 gibba045 bash[25517]: cluster 2021-03-10T16:37:56.361926+0000 mgr.gibba045.orlgmj (mgr.34412) 8928 : cluster [DBG] pgmap v5083: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:59.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:37:59 gibba015 bash[29377]: cluster 2021-03-10T16:37:58.363443+0000 mgr.gibba045.orlgmj (mgr.34412) 8929 : cluster [DBG] pgmap v5084: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:59.719 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:37:59 gibba015 bash[30343]: cluster 2021-03-10T16:37:58.363443+0000 mgr.gibba045.orlgmj (mgr.34412) 8929 : cluster [DBG] pgmap v5084: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:59.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:37:59 gibba045 bash[25517]: cluster 2021-03-10T16:37:58.363443+0000 mgr.gibba045.orlgmj (mgr.34412) 8929 : cluster [DBG] pgmap v5084: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:01.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:38:01 gibba015 bash[29377]: cluster 2021-03-10T16:38:00.365139+0000 mgr.gibba045.orlgmj (mgr.34412) 8930 : cluster [DBG] pgmap v5085: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:01.719 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:38:01 gibba015 bash[30343]: cluster 2021-03-10T16:38:00.365139+0000 mgr.gibba045.orlgmj (mgr.34412) 8930 : cluster [DBG] pgmap v5085: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:01.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:38:01 gibba045 bash[25517]: cluster 2021-03-10T16:38:00.365139+0000 mgr.gibba045.orlgmj (mgr.34412) 8930 : cluster [DBG] pgmap v5085: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:03.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:38:03 gibba015 bash[29377]: cluster 2021-03-10T16:38:02.366867+0000 mgr.gibba045.orlgmj (mgr.34412) 8931 : cluster [DBG] pgmap v5086: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:03.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:38:03 gibba015 bash[30343]: cluster 2021-03-10T16:38:02.366867+0000 mgr.gibba045.orlgmj (mgr.34412) 8931 : cluster [DBG] pgmap v5086: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:03.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:38:03 gibba045 bash[25517]: cluster 2021-03-10T16:38:02.366867+0000 mgr.gibba045.orlgmj (mgr.34412) 8931 : cluster [DBG] pgmap v5086: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:05.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:38:05 gibba015 bash[29377]: cluster 2021-03-10T16:38:04.368044+0000 mgr.gibba045.orlgmj (mgr.34412) 8932 : cluster [DBG] pgmap v5087: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:05.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:38:05 gibba015 bash[30343]: cluster 2021-03-10T16:38:04.368044+0000 mgr.gibba045.orlgmj (mgr.34412) 8932 : cluster [DBG] pgmap v5087: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:05.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:38:05 gibba045 bash[25517]: cluster 2021-03-10T16:38:04.368044+0000 mgr.gibba045.orlgmj (mgr.34412) 8932 : cluster [DBG] pgmap v5087: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:07.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:38:07 gibba015 bash[29377]: cluster 2021-03-10T16:38:06.369899+0000 mgr.gibba045.orlgmj (mgr.34412) 8933 : cluster [DBG] pgmap v5088: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:07.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:38:07 gibba015 bash[30343]: cluster 2021-03-10T16:38:06.369899+0000 mgr.gibba045.orlgmj (mgr.34412) 8933 : cluster [DBG] pgmap v5088: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:07.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:38:07 gibba045 bash[25517]: cluster 2021-03-10T16:38:06.369899+0000 mgr.gibba045.orlgmj (mgr.34412) 8933 : cluster [DBG] pgmap v5088: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:08.270 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:38:08.526 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:38:08.526 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 95s ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:38:08.526 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 31s ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:38:08.527 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 31s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:38:08.527 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 31s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:38:08.527 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 95s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:38:08.527 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 95s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:38:08.528 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 31s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:38:08.528 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 95s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:38:08.528 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 95s ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:38:08.528 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 31s ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:38:08.528 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 95s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:38:08.529 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 95s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:38:08.529 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 95s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:38:08.529 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 95s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:38:08.529 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 31s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:38:08.529 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 31s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:38:08.530 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 31s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:38:08.530 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 31s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:38:08.530 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 31s ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:38:08.530 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 31s ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:38:08.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:38:08 gibba015 bash[29377]: cephadm 2021-03-10T16:38:07.343062+0000 mgr.gibba045.orlgmj (mgr.34412) 8934 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:38:08.719 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:38:08 gibba015 bash[30343]: cephadm 2021-03-10T16:38:07.343062+0000 mgr.gibba045.orlgmj (mgr.34412) 8934 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:38:08.778 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:38:08.779 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:38:08.779 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:38:08.779 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:38:08.780 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:38:08.780 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:38:08.780 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:38:08.781 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:38:08.781 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:38:08.781 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:38:08.782 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:38:08.782 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:38:08.783 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:38:08.783 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:38:08.783 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:38:08.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:38:08 gibba045 bash[25517]: cephadm 2021-03-10T16:38:07.343062+0000 mgr.gibba045.orlgmj (mgr.34412) 8934 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:38:09.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:38:09 gibba015 bash[29377]: audit 2021-03-10T16:38:08.264641+0000 mgr.gibba045.orlgmj (mgr.34412) 8935 : audit [DBG] from='client.50046 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:38:09.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:38:09 gibba015 bash[29377]: cluster 2021-03-10T16:38:08.371114+0000 mgr.gibba045.orlgmj (mgr.34412) 8936 : cluster [DBG] pgmap v5089: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:09.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:38:09 gibba015 bash[29377]: audit 2021-03-10T16:38:08.491221+0000 mgr.gibba045.orlgmj (mgr.34412) 8937 : audit [DBG] from='client.50052 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:38:09.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:38:09 gibba015 bash[29377]: audit 2021-03-10T16:38:08.778924+0000 mon.a (mon.0) 1988 : audit [DBG] from='client.? 172.21.2.115:0/2615063293' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:38:09.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:38:09 gibba015 bash[30343]: audit 2021-03-10T16:38:08.264641+0000 mgr.gibba045.orlgmj (mgr.34412) 8935 : audit [DBG] from='client.50046 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:38:09.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:38:09 gibba015 bash[30343]: cluster 2021-03-10T16:38:08.371114+0000 mgr.gibba045.orlgmj (mgr.34412) 8936 : cluster [DBG] pgmap v5089: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:09.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:38:09 gibba015 bash[30343]: audit 2021-03-10T16:38:08.491221+0000 mgr.gibba045.orlgmj (mgr.34412) 8937 : audit [DBG] from='client.50052 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:38:09.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:38:09 gibba015 bash[30343]: audit 2021-03-10T16:38:08.778924+0000 mon.a (mon.0) 1988 : audit [DBG] from='client.? 172.21.2.115:0/2615063293' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:38:09.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:38:09 gibba045 bash[25517]: audit 2021-03-10T16:38:08.264641+0000 mgr.gibba045.orlgmj (mgr.34412) 8935 : audit [DBG] from='client.50046 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:38:09.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:38:09 gibba045 bash[25517]: cluster 2021-03-10T16:38:08.371114+0000 mgr.gibba045.orlgmj (mgr.34412) 8936 : cluster [DBG] pgmap v5089: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:09.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:38:09 gibba045 bash[25517]: audit 2021-03-10T16:38:08.491221+0000 mgr.gibba045.orlgmj (mgr.34412) 8937 : audit [DBG] from='client.50052 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:38:09.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:38:09 gibba045 bash[25517]: audit 2021-03-10T16:38:08.778924+0000 mon.a (mon.0) 1988 : audit [DBG] from='client.? 172.21.2.115:0/2615063293' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:38:11.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:38:11 gibba015 bash[29377]: cluster 2021-03-10T16:38:10.372873+0000 mgr.gibba045.orlgmj (mgr.34412) 8938 : cluster [DBG] pgmap v5090: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:11.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:38:11 gibba015 bash[30343]: cluster 2021-03-10T16:38:10.372873+0000 mgr.gibba045.orlgmj (mgr.34412) 8938 : cluster [DBG] pgmap v5090: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:11.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:38:11 gibba045 bash[25517]: cluster 2021-03-10T16:38:10.372873+0000 mgr.gibba045.orlgmj (mgr.34412) 8938 : cluster [DBG] pgmap v5090: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:13.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:38:13 gibba045 bash[25517]: cluster 2021-03-10T16:38:12.373608+0000 mgr.gibba045.orlgmj (mgr.34412) 8939 : cluster [DBG] pgmap v5091: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:13.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:38:13 gibba015 bash[29377]: cluster 2021-03-10T16:38:12.373608+0000 mgr.gibba045.orlgmj (mgr.34412) 8939 : cluster [DBG] pgmap v5091: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:13.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:38:13 gibba015 bash[30343]: cluster 2021-03-10T16:38:12.373608+0000 mgr.gibba045.orlgmj (mgr.34412) 8939 : cluster [DBG] pgmap v5091: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:15.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:38:15 gibba045 bash[25517]: cluster 2021-03-10T16:38:14.374688+0000 mgr.gibba045.orlgmj (mgr.34412) 8940 : cluster [DBG] pgmap v5092: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:15.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:38:15 gibba015 bash[29377]: cluster 2021-03-10T16:38:14.374688+0000 mgr.gibba045.orlgmj (mgr.34412) 8940 : cluster [DBG] pgmap v5092: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:15.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:38:15 gibba015 bash[30343]: cluster 2021-03-10T16:38:14.374688+0000 mgr.gibba045.orlgmj (mgr.34412) 8940 : cluster [DBG] pgmap v5092: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:17.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:38:17 gibba045 bash[25517]: cluster 2021-03-10T16:38:16.376570+0000 mgr.gibba045.orlgmj (mgr.34412) 8941 : cluster [DBG] pgmap v5093: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:17.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:38:17 gibba015 bash[29377]: cluster 2021-03-10T16:38:16.376570+0000 mgr.gibba045.orlgmj (mgr.34412) 8941 : cluster [DBG] pgmap v5093: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:17.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:38:17 gibba015 bash[30343]: cluster 2021-03-10T16:38:16.376570+0000 mgr.gibba045.orlgmj (mgr.34412) 8941 : cluster [DBG] pgmap v5093: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:19.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:38:19 gibba045 bash[25517]: cluster 2021-03-10T16:38:18.377674+0000 mgr.gibba045.orlgmj (mgr.34412) 8942 : cluster [DBG] pgmap v5094: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:19.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:38:19 gibba015 bash[29377]: cluster 2021-03-10T16:38:18.377674+0000 mgr.gibba045.orlgmj (mgr.34412) 8942 : cluster [DBG] pgmap v5094: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:19.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:38:19 gibba015 bash[30343]: cluster 2021-03-10T16:38:18.377674+0000 mgr.gibba045.orlgmj (mgr.34412) 8942 : cluster [DBG] pgmap v5094: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:21.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:38:21 gibba045 bash[25517]: cluster 2021-03-10T16:38:20.379128+0000 mgr.gibba045.orlgmj (mgr.34412) 8943 : cluster [DBG] pgmap v5095: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:21.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:38:21 gibba015 bash[29377]: cluster 2021-03-10T16:38:20.379128+0000 mgr.gibba045.orlgmj (mgr.34412) 8943 : cluster [DBG] pgmap v5095: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:21.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:38:21 gibba015 bash[30343]: cluster 2021-03-10T16:38:20.379128+0000 mgr.gibba045.orlgmj (mgr.34412) 8943 : cluster [DBG] pgmap v5095: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:23.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:38:23 gibba045 bash[25517]: cephadm 2021-03-10T16:38:22.359191+0000 mgr.gibba045.orlgmj (mgr.34412) 8944 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:38:23.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:38:23 gibba045 bash[25517]: cluster 2021-03-10T16:38:22.380862+0000 mgr.gibba045.orlgmj (mgr.34412) 8945 : cluster [DBG] pgmap v5096: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:23.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:38:23 gibba015 bash[29377]: cephadm 2021-03-10T16:38:22.359191+0000 mgr.gibba045.orlgmj (mgr.34412) 8944 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:38:23.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:38:23 gibba015 bash[29377]: cluster 2021-03-10T16:38:22.380862+0000 mgr.gibba045.orlgmj (mgr.34412) 8945 : cluster [DBG] pgmap v5096: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:23.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:38:23 gibba015 bash[30343]: cephadm 2021-03-10T16:38:22.359191+0000 mgr.gibba045.orlgmj (mgr.34412) 8944 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:38:23.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:38:23 gibba015 bash[30343]: cluster 2021-03-10T16:38:22.380862+0000 mgr.gibba045.orlgmj (mgr.34412) 8945 : cluster [DBG] pgmap v5096: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:25.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:38:25 gibba045 bash[25517]: cluster 2021-03-10T16:38:24.382106+0000 mgr.gibba045.orlgmj (mgr.34412) 8946 : cluster [DBG] pgmap v5097: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:25.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:38:25 gibba015 bash[29377]: cluster 2021-03-10T16:38:24.382106+0000 mgr.gibba045.orlgmj (mgr.34412) 8946 : cluster [DBG] pgmap v5097: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:25.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:38:25 gibba015 bash[30343]: cluster 2021-03-10T16:38:24.382106+0000 mgr.gibba045.orlgmj (mgr.34412) 8946 : cluster [DBG] pgmap v5097: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:27.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:38:27 gibba045 bash[25517]: cluster 2021-03-10T16:38:26.384153+0000 mgr.gibba045.orlgmj (mgr.34412) 8947 : cluster [DBG] pgmap v5098: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:27.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:38:27 gibba015 bash[29377]: cluster 2021-03-10T16:38:26.384153+0000 mgr.gibba045.orlgmj (mgr.34412) 8947 : cluster [DBG] pgmap v5098: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:27.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:38:27 gibba015 bash[30343]: cluster 2021-03-10T16:38:26.384153+0000 mgr.gibba045.orlgmj (mgr.34412) 8947 : cluster [DBG] pgmap v5098: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:29.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:38:29 gibba045 bash[25517]: cluster 2021-03-10T16:38:28.385474+0000 mgr.gibba045.orlgmj (mgr.34412) 8948 : cluster [DBG] pgmap v5099: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:29.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:38:29 gibba015 bash[29377]: cluster 2021-03-10T16:38:28.385474+0000 mgr.gibba045.orlgmj (mgr.34412) 8948 : cluster [DBG] pgmap v5099: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:29.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:38:29 gibba015 bash[30343]: cluster 2021-03-10T16:38:28.385474+0000 mgr.gibba045.orlgmj (mgr.34412) 8948 : cluster [DBG] pgmap v5099: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:31.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:38:31 gibba015 bash[29377]: cluster 2021-03-10T16:38:30.386992+0000 mgr.gibba045.orlgmj (mgr.34412) 8949 : cluster [DBG] pgmap v5100: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:31.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:38:31 gibba015 bash[30343]: cluster 2021-03-10T16:38:30.386992+0000 mgr.gibba045.orlgmj (mgr.34412) 8949 : cluster [DBG] pgmap v5100: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:32.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:38:31 gibba045 bash[25517]: cluster 2021-03-10T16:38:30.386992+0000 mgr.gibba045.orlgmj (mgr.34412) 8949 : cluster [DBG] pgmap v5100: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:33.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:38:33 gibba015 bash[29377]: cluster 2021-03-10T16:38:32.388761+0000 mgr.gibba045.orlgmj (mgr.34412) 8950 : cluster [DBG] pgmap v5101: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:33.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:38:33 gibba015 bash[30343]: cluster 2021-03-10T16:38:32.388761+0000 mgr.gibba045.orlgmj (mgr.34412) 8950 : cluster [DBG] pgmap v5101: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:34.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:38:33 gibba045 bash[25517]: cluster 2021-03-10T16:38:32.388761+0000 mgr.gibba045.orlgmj (mgr.34412) 8950 : cluster [DBG] pgmap v5101: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:35.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:38:35 gibba015 bash[29377]: cluster 2021-03-10T16:38:34.389966+0000 mgr.gibba045.orlgmj (mgr.34412) 8951 : cluster [DBG] pgmap v5102: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:35.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:38:35 gibba015 bash[30343]: cluster 2021-03-10T16:38:34.389966+0000 mgr.gibba045.orlgmj (mgr.34412) 8951 : cluster [DBG] pgmap v5102: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:36.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:38:35 gibba045 bash[25517]: cluster 2021-03-10T16:38:34.389966+0000 mgr.gibba045.orlgmj (mgr.34412) 8951 : cluster [DBG] pgmap v5102: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:37.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:38:37 gibba015 bash[29377]: cluster 2021-03-10T16:38:36.391735+0000 mgr.gibba045.orlgmj (mgr.34412) 8952 : cluster [DBG] pgmap v5103: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:37.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:38:37 gibba015 bash[29377]: audit 2021-03-10T16:38:37.373632+0000 mon.c (mon.1) 2469 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:38:37.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:38:37 gibba015 bash[30343]: cluster 2021-03-10T16:38:36.391735+0000 mgr.gibba045.orlgmj (mgr.34412) 8952 : cluster [DBG] pgmap v5103: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:37.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:38:37 gibba015 bash[30343]: audit 2021-03-10T16:38:37.373632+0000 mon.c (mon.1) 2469 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:38:38.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:38:37 gibba045 bash[25517]: cluster 2021-03-10T16:38:36.391735+0000 mgr.gibba045.orlgmj (mgr.34412) 8952 : cluster [DBG] pgmap v5103: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:38.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:38:37 gibba045 bash[25517]: audit 2021-03-10T16:38:37.373632+0000 mon.c (mon.1) 2469 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:38:38.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:38:38 gibba015 bash[29377]: cephadm 2021-03-10T16:38:37.382020+0000 mgr.gibba045.orlgmj (mgr.34412) 8953 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:38:38.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:38:38 gibba015 bash[29377]: cephadm 2021-03-10T16:38:37.383803+0000 mgr.gibba045.orlgmj (mgr.34412) 8954 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:38:38.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:38:38 gibba015 bash[29377]: audit 2021-03-10T16:38:37.607075+0000 mon.a (mon.0) 1989 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:38:38.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:38:38 gibba015 bash[29377]: audit 2021-03-10T16:38:37.610952+0000 mon.c (mon.1) 2470 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:38:38.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:38:38 gibba015 bash[29377]: audit 2021-03-10T16:38:37.612735+0000 mon.c (mon.1) 2471 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:38:38.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:38:38 gibba015 bash[29377]: cephadm 2021-03-10T16:38:37.612842+0000 mgr.gibba045.orlgmj (mgr.34412) 8955 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:38:38.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:38:38 gibba015 bash[29377]: audit 2021-03-10T16:38:37.613912+0000 mon.c (mon.1) 2472 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:38:38.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:38:38 gibba015 bash[29377]: cephadm 2021-03-10T16:38:37.614838+0000 mgr.gibba045.orlgmj (mgr.34412) 8956 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:38:38.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:38:38 gibba015 bash[29377]: audit 2021-03-10T16:38:37.614937+0000 mon.c (mon.1) 2473 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:38:38.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:38:38 gibba015 bash[29377]: cephadm 2021-03-10T16:38:37.616159+0000 mgr.gibba045.orlgmj (mgr.34412) 8957 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:38:38.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:38:38 gibba015 bash[29377]: cephadm 2021-03-10T16:38:37.616197+0000 mgr.gibba045.orlgmj (mgr.34412) 8958 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:38:38.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:38:38 gibba015 bash[29377]: cephadm 2021-03-10T16:38:37.617282+0000 mgr.gibba045.orlgmj (mgr.34412) 8959 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:38:38.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:38:38 gibba015 bash[29377]: cephadm 2021-03-10T16:38:37.617318+0000 mgr.gibba045.orlgmj (mgr.34412) 8960 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:38:38.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:38:38 gibba015 bash[29377]: audit 2021-03-10T16:38:37.617771+0000 mon.c (mon.1) 2474 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:38:38.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:38:38 gibba015 bash[29377]: cephadm 2021-03-10T16:38:37.618262+0000 mgr.gibba045.orlgmj (mgr.34412) 8961 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:38:38.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:38:38 gibba015 bash[29377]: audit 2021-03-10T16:38:37.619252+0000 mon.c (mon.1) 2475 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:38:38.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:38:38 gibba015 bash[29377]: cephadm 2021-03-10T16:38:37.619774+0000 mgr.gibba045.orlgmj (mgr.34412) 8962 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:38:38.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:38:38 gibba015 bash[29377]: cephadm 2021-03-10T16:38:37.619811+0000 mgr.gibba045.orlgmj (mgr.34412) 8963 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:38:38.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:38:38 gibba015 bash[29377]: cephadm 2021-03-10T16:38:37.621318+0000 mgr.gibba045.orlgmj (mgr.34412) 8964 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:38:38.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:38:38 gibba015 bash[29377]: cephadm 2021-03-10T16:38:37.621634+0000 mgr.gibba045.orlgmj (mgr.34412) 8965 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:38:38.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:38:38 gibba015 bash[29377]: cephadm 2021-03-10T16:38:37.622696+0000 mgr.gibba045.orlgmj (mgr.34412) 8966 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:38:38.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:38:38 gibba015 bash[29377]: cephadm 2021-03-10T16:38:37.622734+0000 mgr.gibba045.orlgmj (mgr.34412) 8967 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:38:38.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:38:38 gibba015 bash[29377]: cephadm 2021-03-10T16:38:37.622839+0000 mgr.gibba045.orlgmj (mgr.34412) 8968 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:38:38.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:38:38 gibba015 bash[30343]: cephadm 2021-03-10T16:38:37.382020+0000 mgr.gibba045.orlgmj (mgr.34412) 8953 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:38:38.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:38:38 gibba015 bash[30343]: cephadm 2021-03-10T16:38:37.383803+0000 mgr.gibba045.orlgmj (mgr.34412) 8954 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:38:38.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:38:38 gibba015 bash[30343]: audit 2021-03-10T16:38:37.607075+0000 mon.a (mon.0) 1989 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:38:38.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:38:38 gibba015 bash[30343]: audit 2021-03-10T16:38:37.610952+0000 mon.c (mon.1) 2470 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:38:38.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:38:38 gibba015 bash[30343]: audit 2021-03-10T16:38:37.612735+0000 mon.c (mon.1) 2471 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:38:38.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:38:38 gibba015 bash[30343]: cephadm 2021-03-10T16:38:37.612842+0000 mgr.gibba045.orlgmj (mgr.34412) 8955 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:38:38.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:38:38 gibba015 bash[30343]: audit 2021-03-10T16:38:37.613912+0000 mon.c (mon.1) 2472 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:38:38.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:38:38 gibba015 bash[30343]: cephadm 2021-03-10T16:38:37.614838+0000 mgr.gibba045.orlgmj (mgr.34412) 8956 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:38:38.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:38:38 gibba015 bash[30343]: audit 2021-03-10T16:38:37.614937+0000 mon.c (mon.1) 2473 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:38:38.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:38:38 gibba015 bash[30343]: cephadm 2021-03-10T16:38:37.616159+0000 mgr.gibba045.orlgmj (mgr.34412) 8957 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:38:38.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:38:38 gibba015 bash[30343]: cephadm 2021-03-10T16:38:37.616197+0000 mgr.gibba045.orlgmj (mgr.34412) 8958 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:38:38.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:38:38 gibba015 bash[30343]: cephadm 2021-03-10T16:38:37.617282+0000 mgr.gibba045.orlgmj (mgr.34412) 8959 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:38:38.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:38:38 gibba015 bash[30343]: cephadm 2021-03-10T16:38:37.617318+0000 mgr.gibba045.orlgmj (mgr.34412) 8960 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:38:38.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:38:38 gibba015 bash[30343]: audit 2021-03-10T16:38:37.617771+0000 mon.c (mon.1) 2474 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:38:38.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:38:38 gibba015 bash[30343]: cephadm 2021-03-10T16:38:37.618262+0000 mgr.gibba045.orlgmj (mgr.34412) 8961 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:38:38.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:38:38 gibba015 bash[30343]: audit 2021-03-10T16:38:37.619252+0000 mon.c (mon.1) 2475 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:38:38.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:38:38 gibba015 bash[30343]: cephadm 2021-03-10T16:38:37.619774+0000 mgr.gibba045.orlgmj (mgr.34412) 8962 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:38:38.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:38:38 gibba015 bash[30343]: cephadm 2021-03-10T16:38:37.619811+0000 mgr.gibba045.orlgmj (mgr.34412) 8963 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:38:38.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:38:38 gibba015 bash[30343]: cephadm 2021-03-10T16:38:37.621318+0000 mgr.gibba045.orlgmj (mgr.34412) 8964 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:38:38.984 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:38:38 gibba015 bash[30343]: cephadm 2021-03-10T16:38:37.621634+0000 mgr.gibba045.orlgmj (mgr.34412) 8965 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:38:38.984 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:38:38 gibba015 bash[30343]: cephadm 2021-03-10T16:38:37.622696+0000 mgr.gibba045.orlgmj (mgr.34412) 8966 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:38:38.984 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:38:38 gibba015 bash[30343]: cephadm 2021-03-10T16:38:37.622734+0000 mgr.gibba045.orlgmj (mgr.34412) 8967 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:38:38.984 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:38:38 gibba015 bash[30343]: cephadm 2021-03-10T16:38:37.622839+0000 mgr.gibba045.orlgmj (mgr.34412) 8968 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:38:39.022 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:38:39.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:38:38 gibba045 bash[25517]: cephadm 2021-03-10T16:38:37.382020+0000 mgr.gibba045.orlgmj (mgr.34412) 8953 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:38:39.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:38:38 gibba045 bash[25517]: cephadm 2021-03-10T16:38:37.383803+0000 mgr.gibba045.orlgmj (mgr.34412) 8954 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:38:39.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:38:38 gibba045 bash[25517]: audit 2021-03-10T16:38:37.607075+0000 mon.a (mon.0) 1989 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:38:39.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:38:38 gibba045 bash[25517]: audit 2021-03-10T16:38:37.610952+0000 mon.c (mon.1) 2470 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:38:39.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:38:38 gibba045 bash[25517]: audit 2021-03-10T16:38:37.612735+0000 mon.c (mon.1) 2471 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:38:39.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:38:38 gibba045 bash[25517]: cephadm 2021-03-10T16:38:37.612842+0000 mgr.gibba045.orlgmj (mgr.34412) 8955 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:38:39.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:38:38 gibba045 bash[25517]: audit 2021-03-10T16:38:37.613912+0000 mon.c (mon.1) 2472 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:38:39.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:38:38 gibba045 bash[25517]: cephadm 2021-03-10T16:38:37.614838+0000 mgr.gibba045.orlgmj (mgr.34412) 8956 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:38:39.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:38:38 gibba045 bash[25517]: audit 2021-03-10T16:38:37.614937+0000 mon.c (mon.1) 2473 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:38:39.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:38:38 gibba045 bash[25517]: cephadm 2021-03-10T16:38:37.616159+0000 mgr.gibba045.orlgmj (mgr.34412) 8957 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:38:39.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:38:38 gibba045 bash[25517]: cephadm 2021-03-10T16:38:37.616197+0000 mgr.gibba045.orlgmj (mgr.34412) 8958 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:38:39.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:38:38 gibba045 bash[25517]: cephadm 2021-03-10T16:38:37.617282+0000 mgr.gibba045.orlgmj (mgr.34412) 8959 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:38:39.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:38:38 gibba045 bash[25517]: cephadm 2021-03-10T16:38:37.617318+0000 mgr.gibba045.orlgmj (mgr.34412) 8960 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:38:39.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:38:38 gibba045 bash[25517]: audit 2021-03-10T16:38:37.617771+0000 mon.c (mon.1) 2474 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:38:39.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:38:38 gibba045 bash[25517]: cephadm 2021-03-10T16:38:37.618262+0000 mgr.gibba045.orlgmj (mgr.34412) 8961 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:38:39.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:38:38 gibba045 bash[25517]: audit 2021-03-10T16:38:37.619252+0000 mon.c (mon.1) 2475 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:38:39.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:38:38 gibba045 bash[25517]: cephadm 2021-03-10T16:38:37.619774+0000 mgr.gibba045.orlgmj (mgr.34412) 8962 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:38:39.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:38:38 gibba045 bash[25517]: cephadm 2021-03-10T16:38:37.619811+0000 mgr.gibba045.orlgmj (mgr.34412) 8963 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:38:39.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:38:38 gibba045 bash[25517]: cephadm 2021-03-10T16:38:37.621318+0000 mgr.gibba045.orlgmj (mgr.34412) 8964 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:38:39.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:38:38 gibba045 bash[25517]: cephadm 2021-03-10T16:38:37.621634+0000 mgr.gibba045.orlgmj (mgr.34412) 8965 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:38:39.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:38:38 gibba045 bash[25517]: cephadm 2021-03-10T16:38:37.622696+0000 mgr.gibba045.orlgmj (mgr.34412) 8966 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:38:39.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:38:38 gibba045 bash[25517]: cephadm 2021-03-10T16:38:37.622734+0000 mgr.gibba045.orlgmj (mgr.34412) 8967 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:38:39.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:38:38 gibba045 bash[25517]: cephadm 2021-03-10T16:38:37.622839+0000 mgr.gibba045.orlgmj (mgr.34412) 8968 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:38:39.248 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:38:39.249 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 2m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:38:39.249 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 62s ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:38:39.250 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 62s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:38:39.250 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 62s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:38:39.250 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:38:39.251 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:38:39.251 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 62s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:38:39.251 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:38:39.252 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 2m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:38:39.252 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 62s ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:38:39.252 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:38:39.252 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:38:39.252 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:38:39.253 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:38:39.253 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 62s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:38:39.253 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 62s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:38:39.253 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 62s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:38:39.254 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 62s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:38:39.254 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 62s ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:38:39.254 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 62s ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:38:39.501 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:38:39.501 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:38:39.502 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:38:39.502 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:38:39.502 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:38:39.503 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:38:39.503 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:38:39.503 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:38:39.504 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:38:39.504 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:38:39.504 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:38:39.505 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:38:39.505 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:38:39.505 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:38:39.506 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:38:39.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:38:39 gibba015 bash[29377]: cluster 2021-03-10T16:38:38.393007+0000 mgr.gibba045.orlgmj (mgr.34412) 8969 : cluster [DBG] pgmap v5104: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:39.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:38:39 gibba015 bash[29377]: audit 2021-03-10T16:38:39.501986+0000 mon.a (mon.0) 1990 : audit [DBG] from='client.? 172.21.2.115:0/3317037877' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:38:39.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:38:39 gibba015 bash[30343]: cluster 2021-03-10T16:38:38.393007+0000 mgr.gibba045.orlgmj (mgr.34412) 8969 : cluster [DBG] pgmap v5104: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:39.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:38:39 gibba015 bash[30343]: audit 2021-03-10T16:38:39.501986+0000 mon.a (mon.0) 1990 : audit [DBG] from='client.? 172.21.2.115:0/3317037877' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:38:40.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:38:39 gibba045 bash[25517]: cluster 2021-03-10T16:38:38.393007+0000 mgr.gibba045.orlgmj (mgr.34412) 8969 : cluster [DBG] pgmap v5104: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:40.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:38:39 gibba045 bash[25517]: audit 2021-03-10T16:38:39.501986+0000 mon.a (mon.0) 1990 : audit [DBG] from='client.? 172.21.2.115:0/3317037877' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:38:40.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:38:40 gibba015 bash[29377]: audit 2021-03-10T16:38:39.017112+0000 mgr.gibba045.orlgmj (mgr.34412) 8970 : audit [DBG] from='client.50064 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:38:40.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:38:40 gibba015 bash[29377]: audit 2021-03-10T16:38:39.239238+0000 mgr.gibba045.orlgmj (mgr.34412) 8971 : audit [DBG] from='client.50070 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:38:40.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:38:40 gibba015 bash[30343]: audit 2021-03-10T16:38:39.017112+0000 mgr.gibba045.orlgmj (mgr.34412) 8970 : audit [DBG] from='client.50064 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:38:40.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:38:40 gibba015 bash[30343]: audit 2021-03-10T16:38:39.239238+0000 mgr.gibba045.orlgmj (mgr.34412) 8971 : audit [DBG] from='client.50070 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:38:41.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:38:40 gibba045 bash[25517]: audit 2021-03-10T16:38:39.017112+0000 mgr.gibba045.orlgmj (mgr.34412) 8970 : audit [DBG] from='client.50064 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:38:41.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:38:40 gibba045 bash[25517]: audit 2021-03-10T16:38:39.239238+0000 mgr.gibba045.orlgmj (mgr.34412) 8971 : audit [DBG] from='client.50070 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:38:41.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:38:41 gibba015 bash[29377]: cluster 2021-03-10T16:38:40.394399+0000 mgr.gibba045.orlgmj (mgr.34412) 8972 : cluster [DBG] pgmap v5105: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:41.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:38:41 gibba015 bash[30343]: cluster 2021-03-10T16:38:40.394399+0000 mgr.gibba045.orlgmj (mgr.34412) 8972 : cluster [DBG] pgmap v5105: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:42.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:38:41 gibba045 bash[25517]: cluster 2021-03-10T16:38:40.394399+0000 mgr.gibba045.orlgmj (mgr.34412) 8972 : cluster [DBG] pgmap v5105: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:43.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:38:43 gibba015 bash[29377]: cluster 2021-03-10T16:38:42.396159+0000 mgr.gibba045.orlgmj (mgr.34412) 8973 : cluster [DBG] pgmap v5106: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:43.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:38:43 gibba015 bash[30343]: cluster 2021-03-10T16:38:42.396159+0000 mgr.gibba045.orlgmj (mgr.34412) 8973 : cluster [DBG] pgmap v5106: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:44.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:38:43 gibba045 bash[25517]: cluster 2021-03-10T16:38:42.396159+0000 mgr.gibba045.orlgmj (mgr.34412) 8973 : cluster [DBG] pgmap v5106: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:45.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:38:45 gibba015 bash[29377]: cluster 2021-03-10T16:38:44.397412+0000 mgr.gibba045.orlgmj (mgr.34412) 8974 : cluster [DBG] pgmap v5107: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:45.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:38:45 gibba015 bash[30343]: cluster 2021-03-10T16:38:44.397412+0000 mgr.gibba045.orlgmj (mgr.34412) 8974 : cluster [DBG] pgmap v5107: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:46.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:38:45 gibba045 bash[25517]: cluster 2021-03-10T16:38:44.397412+0000 mgr.gibba045.orlgmj (mgr.34412) 8974 : cluster [DBG] pgmap v5107: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:47.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:38:47 gibba015 bash[29377]: cluster 2021-03-10T16:38:46.399188+0000 mgr.gibba045.orlgmj (mgr.34412) 8975 : cluster [DBG] pgmap v5108: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:47.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:38:47 gibba015 bash[30343]: cluster 2021-03-10T16:38:46.399188+0000 mgr.gibba045.orlgmj (mgr.34412) 8975 : cluster [DBG] pgmap v5108: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:48.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:38:47 gibba045 bash[25517]: cluster 2021-03-10T16:38:46.399188+0000 mgr.gibba045.orlgmj (mgr.34412) 8975 : cluster [DBG] pgmap v5108: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:49.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:38:49 gibba015 bash[29377]: cluster 2021-03-10T16:38:48.400548+0000 mgr.gibba045.orlgmj (mgr.34412) 8976 : cluster [DBG] pgmap v5109: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:49.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:38:49 gibba015 bash[30343]: cluster 2021-03-10T16:38:48.400548+0000 mgr.gibba045.orlgmj (mgr.34412) 8976 : cluster [DBG] pgmap v5109: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:50.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:38:49 gibba045 bash[25517]: cluster 2021-03-10T16:38:48.400548+0000 mgr.gibba045.orlgmj (mgr.34412) 8976 : cluster [DBG] pgmap v5109: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:51.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:38:51 gibba015 bash[29377]: cluster 2021-03-10T16:38:50.402260+0000 mgr.gibba045.orlgmj (mgr.34412) 8977 : cluster [DBG] pgmap v5110: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:51.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:38:51 gibba015 bash[30343]: cluster 2021-03-10T16:38:50.402260+0000 mgr.gibba045.orlgmj (mgr.34412) 8977 : cluster [DBG] pgmap v5110: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:52.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:38:51 gibba045 bash[25517]: cluster 2021-03-10T16:38:50.402260+0000 mgr.gibba045.orlgmj (mgr.34412) 8977 : cluster [DBG] pgmap v5110: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:53.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:38:53 gibba015 bash[29377]: cluster 2021-03-10T16:38:52.404015+0000 mgr.gibba045.orlgmj (mgr.34412) 8978 : cluster [DBG] pgmap v5111: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:53.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:38:53 gibba015 bash[29377]: cephadm 2021-03-10T16:38:52.637389+0000 mgr.gibba045.orlgmj (mgr.34412) 8979 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:38:53.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:38:53 gibba015 bash[29377]: audit 2021-03-10T16:38:53.676495+0000 mon.c (mon.1) 2476 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:38:53.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:38:53 gibba015 bash[29377]: audit 2021-03-10T16:38:53.677624+0000 mon.a (mon.0) 1991 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:38:53.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:38:53 gibba015 bash[29377]: audit 2021-03-10T16:38:53.679815+0000 mon.c (mon.1) 2477 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:38:53.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:38:53 gibba015 bash[29377]: audit 2021-03-10T16:38:53.680908+0000 mon.a (mon.0) 1992 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:38:53.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:38:53 gibba015 bash[30343]: cluster 2021-03-10T16:38:52.404015+0000 mgr.gibba045.orlgmj (mgr.34412) 8978 : cluster [DBG] pgmap v5111: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:53.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:38:53 gibba015 bash[30343]: cephadm 2021-03-10T16:38:52.637389+0000 mgr.gibba045.orlgmj (mgr.34412) 8979 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:38:53.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:38:53 gibba015 bash[30343]: audit 2021-03-10T16:38:53.676495+0000 mon.c (mon.1) 2476 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:38:53.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:38:53 gibba015 bash[30343]: audit 2021-03-10T16:38:53.677624+0000 mon.a (mon.0) 1991 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:38:53.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:38:53 gibba015 bash[30343]: audit 2021-03-10T16:38:53.679815+0000 mon.c (mon.1) 2477 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:38:53.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:38:53 gibba015 bash[30343]: audit 2021-03-10T16:38:53.680908+0000 mon.a (mon.0) 1992 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:38:54.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:38:53 gibba045 bash[25517]: cluster 2021-03-10T16:38:52.404015+0000 mgr.gibba045.orlgmj (mgr.34412) 8978 : cluster [DBG] pgmap v5111: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:54.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:38:53 gibba045 bash[25517]: cephadm 2021-03-10T16:38:52.637389+0000 mgr.gibba045.orlgmj (mgr.34412) 8979 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:38:54.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:38:53 gibba045 bash[25517]: audit 2021-03-10T16:38:53.676495+0000 mon.c (mon.1) 2476 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:38:54.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:38:53 gibba045 bash[25517]: audit 2021-03-10T16:38:53.677624+0000 mon.a (mon.0) 1991 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:38:54.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:38:53 gibba045 bash[25517]: audit 2021-03-10T16:38:53.679815+0000 mon.c (mon.1) 2477 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:38:54.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:38:53 gibba045 bash[25517]: audit 2021-03-10T16:38:53.680908+0000 mon.a (mon.0) 1992 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:38:54.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:38:54 gibba015 bash[29377]: audit 2021-03-10T16:38:53.695443+0000 mon.c (mon.1) 2478 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T16:38:54.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:38:54 gibba015 bash[29377]: audit 2021-03-10T16:38:53.695569+0000 mon.c (mon.1) 2479 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:38:54.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:38:54 gibba015 bash[29377]: audit 2021-03-10T16:38:53.695711+0000 mon.a (mon.0) 1993 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T16:38:54.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:38:54 gibba015 bash[29377]: audit 2021-03-10T16:38:53.695775+0000 mon.c (mon.1) 2480 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:38:54.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:38:54 gibba015 bash[29377]: audit 2021-03-10T16:38:53.696001+0000 mon.a (mon.0) 1994 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:38:54.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:38:54 gibba015 bash[29377]: audit 2021-03-10T16:38:53.696098+0000 mon.c (mon.1) 2481 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:38:54.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:38:54 gibba015 bash[29377]: audit 2021-03-10T16:38:53.696212+0000 mon.a (mon.0) 1995 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:38:54.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:38:54 gibba015 bash[29377]: audit 2021-03-10T16:38:53.696437+0000 mon.a (mon.0) 1996 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:38:54.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:38:54 gibba015 bash[30343]: audit 2021-03-10T16:38:53.695443+0000 mon.c (mon.1) 2478 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T16:38:54.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:38:54 gibba015 bash[30343]: audit 2021-03-10T16:38:53.695569+0000 mon.c (mon.1) 2479 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:38:54.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:38:54 gibba015 bash[30343]: audit 2021-03-10T16:38:53.695711+0000 mon.a (mon.0) 1993 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T16:38:54.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:38:54 gibba015 bash[30343]: audit 2021-03-10T16:38:53.695775+0000 mon.c (mon.1) 2480 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:38:54.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:38:54 gibba015 bash[30343]: audit 2021-03-10T16:38:53.696001+0000 mon.a (mon.0) 1994 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:38:54.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:38:54 gibba015 bash[30343]: audit 2021-03-10T16:38:53.696098+0000 mon.c (mon.1) 2481 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:38:54.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:38:54 gibba015 bash[30343]: audit 2021-03-10T16:38:53.696212+0000 mon.a (mon.0) 1995 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:38:54.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:38:54 gibba015 bash[30343]: audit 2021-03-10T16:38:53.696437+0000 mon.a (mon.0) 1996 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:38:55.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:38:54 gibba045 bash[25517]: audit 2021-03-10T16:38:53.695443+0000 mon.c (mon.1) 2478 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T16:38:55.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:38:54 gibba045 bash[25517]: audit 2021-03-10T16:38:53.695569+0000 mon.c (mon.1) 2479 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:38:55.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:38:54 gibba045 bash[25517]: audit 2021-03-10T16:38:53.695711+0000 mon.a (mon.0) 1993 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T16:38:55.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:38:54 gibba045 bash[25517]: audit 2021-03-10T16:38:53.695775+0000 mon.c (mon.1) 2480 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:38:55.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:38:54 gibba045 bash[25517]: audit 2021-03-10T16:38:53.696001+0000 mon.a (mon.0) 1994 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:38:55.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:38:54 gibba045 bash[25517]: audit 2021-03-10T16:38:53.696098+0000 mon.c (mon.1) 2481 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:38:55.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:38:54 gibba045 bash[25517]: audit 2021-03-10T16:38:53.696212+0000 mon.a (mon.0) 1995 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:38:55.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:38:54 gibba045 bash[25517]: audit 2021-03-10T16:38:53.696437+0000 mon.a (mon.0) 1996 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:38:55.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:38:55 gibba015 bash[29377]: cluster 2021-03-10T16:38:54.405559+0000 mgr.gibba045.orlgmj (mgr.34412) 8980 : cluster [DBG] pgmap v5112: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:55.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:38:55 gibba015 bash[30343]: cluster 2021-03-10T16:38:54.405559+0000 mgr.gibba045.orlgmj (mgr.34412) 8980 : cluster [DBG] pgmap v5112: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:56.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:38:55 gibba045 bash[25517]: cluster 2021-03-10T16:38:54.405559+0000 mgr.gibba045.orlgmj (mgr.34412) 8980 : cluster [DBG] pgmap v5112: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:57.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:38:57 gibba015 bash[29377]: cluster 2021-03-10T16:38:56.407348+0000 mgr.gibba045.orlgmj (mgr.34412) 8981 : cluster [DBG] pgmap v5113: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:57.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:38:57 gibba015 bash[30343]: cluster 2021-03-10T16:38:56.407348+0000 mgr.gibba045.orlgmj (mgr.34412) 8981 : cluster [DBG] pgmap v5113: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:58.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:38:57 gibba045 bash[25517]: cluster 2021-03-10T16:38:56.407348+0000 mgr.gibba045.orlgmj (mgr.34412) 8981 : cluster [DBG] pgmap v5113: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:59.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:38:58 gibba045 bash[25517]: cluster 2021-03-10T16:38:58.408380+0000 mgr.gibba045.orlgmj (mgr.34412) 8982 : cluster [DBG] pgmap v5114: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:59.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:38:58 gibba015 bash[29377]: cluster 2021-03-10T16:38:58.408380+0000 mgr.gibba045.orlgmj (mgr.34412) 8982 : cluster [DBG] pgmap v5114: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:59.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:38:58 gibba015 bash[30343]: cluster 2021-03-10T16:38:58.408380+0000 mgr.gibba045.orlgmj (mgr.34412) 8982 : cluster [DBG] pgmap v5114: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:01.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:39:01 gibba015 bash[29377]: cluster 2021-03-10T16:39:00.409873+0000 mgr.gibba045.orlgmj (mgr.34412) 8983 : cluster [DBG] pgmap v5115: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:01.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:39:01 gibba015 bash[30343]: cluster 2021-03-10T16:39:00.409873+0000 mgr.gibba045.orlgmj (mgr.34412) 8983 : cluster [DBG] pgmap v5115: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:01.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:39:01 gibba045 bash[25517]: cluster 2021-03-10T16:39:00.409873+0000 mgr.gibba045.orlgmj (mgr.34412) 8983 : cluster [DBG] pgmap v5115: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:03.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:39:03 gibba045 bash[25517]: cluster 2021-03-10T16:39:02.411591+0000 mgr.gibba045.orlgmj (mgr.34412) 8984 : cluster [DBG] pgmap v5116: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:03.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:39:03 gibba015 bash[29377]: cluster 2021-03-10T16:39:02.411591+0000 mgr.gibba045.orlgmj (mgr.34412) 8984 : cluster [DBG] pgmap v5116: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:03.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:39:03 gibba015 bash[30343]: cluster 2021-03-10T16:39:02.411591+0000 mgr.gibba045.orlgmj (mgr.34412) 8984 : cluster [DBG] pgmap v5116: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:05.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:39:05 gibba045 bash[25517]: cluster 2021-03-10T16:39:04.413037+0000 mgr.gibba045.orlgmj (mgr.34412) 8985 : cluster [DBG] pgmap v5117: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:05.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:39:05 gibba015 bash[29377]: cluster 2021-03-10T16:39:04.413037+0000 mgr.gibba045.orlgmj (mgr.34412) 8985 : cluster [DBG] pgmap v5117: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:05.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:39:05 gibba015 bash[30343]: cluster 2021-03-10T16:39:04.413037+0000 mgr.gibba045.orlgmj (mgr.34412) 8985 : cluster [DBG] pgmap v5117: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:07.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:39:07 gibba045 bash[25517]: cluster 2021-03-10T16:39:06.414746+0000 mgr.gibba045.orlgmj (mgr.34412) 8986 : cluster [DBG] pgmap v5118: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:07.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:39:07 gibba015 bash[29377]: cluster 2021-03-10T16:39:06.414746+0000 mgr.gibba045.orlgmj (mgr.34412) 8986 : cluster [DBG] pgmap v5118: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:07.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:39:07 gibba015 bash[30343]: cluster 2021-03-10T16:39:06.414746+0000 mgr.gibba045.orlgmj (mgr.34412) 8986 : cluster [DBG] pgmap v5118: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:08.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:39:08 gibba045 bash[25517]: cephadm 2021-03-10T16:39:07.653488+0000 mgr.gibba045.orlgmj (mgr.34412) 8987 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:39:08.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:39:08 gibba015 bash[29377]: cephadm 2021-03-10T16:39:07.653488+0000 mgr.gibba045.orlgmj (mgr.34412) 8987 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:39:08.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:39:08 gibba015 bash[30343]: cephadm 2021-03-10T16:39:07.653488+0000 mgr.gibba045.orlgmj (mgr.34412) 8987 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:39:09.748 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:39:09.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:39:09 gibba045 bash[25517]: cluster 2021-03-10T16:39:08.416032+0000 mgr.gibba045.orlgmj (mgr.34412) 8988 : cluster [DBG] pgmap v5119: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:09.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:39:09 gibba015 bash[29377]: cluster 2021-03-10T16:39:08.416032+0000 mgr.gibba045.orlgmj (mgr.34412) 8988 : cluster [DBG] pgmap v5119: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:09.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:39:09 gibba015 bash[30343]: cluster 2021-03-10T16:39:08.416032+0000 mgr.gibba045.orlgmj (mgr.34412) 8988 : cluster [DBG] pgmap v5119: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:09.976 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:39:09.976 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 2m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:39:09.976 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 92s ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:39:09.976 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 92s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:39:09.977 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 92s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:39:09.977 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:39:09.977 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:39:09.977 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 92s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:39:09.978 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:39:09.978 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 2m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:39:09.978 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 92s ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:39:09.978 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:39:09.979 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:39:09.979 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:39:09.979 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:39:09.979 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 92s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:39:09.980 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 92s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:39:09.980 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 92s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:39:09.980 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 92s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:39:09.980 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 92s ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:39:09.980 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 92s ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:39:10.228 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:39:10.229 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:39:10.229 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:39:10.229 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:39:10.229 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:39:10.230 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:39:10.230 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:39:10.230 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:39:10.230 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:39:10.230 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:39:10.231 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:39:10.231 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:39:10.231 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:39:10.231 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:39:10.232 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:39:10.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:39:10 gibba045 bash[25517]: audit 2021-03-10T16:39:10.229386+0000 mon.a (mon.0) 1997 : audit [DBG] from='client.? 172.21.2.115:0/2841585960' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:39:10.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:39:10 gibba015 bash[29377]: audit 2021-03-10T16:39:10.229386+0000 mon.a (mon.0) 1997 : audit [DBG] from='client.? 172.21.2.115:0/2841585960' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:39:10.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:39:10 gibba015 bash[30343]: audit 2021-03-10T16:39:10.229386+0000 mon.a (mon.0) 1997 : audit [DBG] from='client.? 172.21.2.115:0/2841585960' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:39:11.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:39:11 gibba045 bash[25517]: audit 2021-03-10T16:39:09.742689+0000 mgr.gibba045.orlgmj (mgr.34412) 8989 : audit [DBG] from='client.60070 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:39:11.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:39:11 gibba045 bash[25517]: audit 2021-03-10T16:39:09.966782+0000 mgr.gibba045.orlgmj (mgr.34412) 8990 : audit [DBG] from='client.50088 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:39:11.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:39:11 gibba045 bash[25517]: cluster 2021-03-10T16:39:10.417588+0000 mgr.gibba045.orlgmj (mgr.34412) 8991 : cluster [DBG] pgmap v5120: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:11.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:39:11 gibba015 bash[29377]: audit 2021-03-10T16:39:09.742689+0000 mgr.gibba045.orlgmj (mgr.34412) 8989 : audit [DBG] from='client.60070 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:39:11.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:39:11 gibba015 bash[29377]: audit 2021-03-10T16:39:09.966782+0000 mgr.gibba045.orlgmj (mgr.34412) 8990 : audit [DBG] from='client.50088 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:39:11.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:39:11 gibba015 bash[29377]: cluster 2021-03-10T16:39:10.417588+0000 mgr.gibba045.orlgmj (mgr.34412) 8991 : cluster [DBG] pgmap v5120: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:11.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:39:11 gibba015 bash[30343]: audit 2021-03-10T16:39:09.742689+0000 mgr.gibba045.orlgmj (mgr.34412) 8989 : audit [DBG] from='client.60070 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:39:11.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:39:11 gibba015 bash[30343]: audit 2021-03-10T16:39:09.966782+0000 mgr.gibba045.orlgmj (mgr.34412) 8990 : audit [DBG] from='client.50088 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:39:11.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:39:11 gibba015 bash[30343]: cluster 2021-03-10T16:39:10.417588+0000 mgr.gibba045.orlgmj (mgr.34412) 8991 : cluster [DBG] pgmap v5120: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:13.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:39:13 gibba045 bash[25517]: cluster 2021-03-10T16:39:12.419311+0000 mgr.gibba045.orlgmj (mgr.34412) 8992 : cluster [DBG] pgmap v5121: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:13.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:39:13 gibba015 bash[29377]: cluster 2021-03-10T16:39:12.419311+0000 mgr.gibba045.orlgmj (mgr.34412) 8992 : cluster [DBG] pgmap v5121: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:13.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:39:13 gibba015 bash[30343]: cluster 2021-03-10T16:39:12.419311+0000 mgr.gibba045.orlgmj (mgr.34412) 8992 : cluster [DBG] pgmap v5121: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:15.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:39:15 gibba045 bash[25517]: cluster 2021-03-10T16:39:14.420559+0000 mgr.gibba045.orlgmj (mgr.34412) 8993 : cluster [DBG] pgmap v5122: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:15.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:39:15 gibba015 bash[29377]: cluster 2021-03-10T16:39:14.420559+0000 mgr.gibba045.orlgmj (mgr.34412) 8993 : cluster [DBG] pgmap v5122: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:15.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:39:15 gibba015 bash[30343]: cluster 2021-03-10T16:39:14.420559+0000 mgr.gibba045.orlgmj (mgr.34412) 8993 : cluster [DBG] pgmap v5122: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:17.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:39:17 gibba015 bash[29377]: cluster 2021-03-10T16:39:16.422325+0000 mgr.gibba045.orlgmj (mgr.34412) 8994 : cluster [DBG] pgmap v5123: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:17.719 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:39:17 gibba015 bash[30343]: cluster 2021-03-10T16:39:16.422325+0000 mgr.gibba045.orlgmj (mgr.34412) 8994 : cluster [DBG] pgmap v5123: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:17.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:39:17 gibba045 bash[25517]: cluster 2021-03-10T16:39:16.422325+0000 mgr.gibba045.orlgmj (mgr.34412) 8994 : cluster [DBG] pgmap v5123: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:19.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:39:19 gibba015 bash[29377]: cluster 2021-03-10T16:39:18.423331+0000 mgr.gibba045.orlgmj (mgr.34412) 8995 : cluster [DBG] pgmap v5124: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:19.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:39:19 gibba015 bash[30343]: cluster 2021-03-10T16:39:18.423331+0000 mgr.gibba045.orlgmj (mgr.34412) 8995 : cluster [DBG] pgmap v5124: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:19.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:39:19 gibba045 bash[25517]: cluster 2021-03-10T16:39:18.423331+0000 mgr.gibba045.orlgmj (mgr.34412) 8995 : cluster [DBG] pgmap v5124: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:21.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:39:21 gibba015 bash[29377]: cluster 2021-03-10T16:39:20.425033+0000 mgr.gibba045.orlgmj (mgr.34412) 8996 : cluster [DBG] pgmap v5125: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:21.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:39:21 gibba015 bash[30343]: cluster 2021-03-10T16:39:20.425033+0000 mgr.gibba045.orlgmj (mgr.34412) 8996 : cluster [DBG] pgmap v5125: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:21.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:39:21 gibba045 bash[25517]: cluster 2021-03-10T16:39:20.425033+0000 mgr.gibba045.orlgmj (mgr.34412) 8996 : cluster [DBG] pgmap v5125: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:23.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:39:23 gibba015 bash[29377]: cluster 2021-03-10T16:39:22.426710+0000 mgr.gibba045.orlgmj (mgr.34412) 8997 : cluster [DBG] pgmap v5126: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:23.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:39:23 gibba015 bash[29377]: cephadm 2021-03-10T16:39:22.669533+0000 mgr.gibba045.orlgmj (mgr.34412) 8998 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:39:23.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:39:23 gibba015 bash[30343]: cluster 2021-03-10T16:39:22.426710+0000 mgr.gibba045.orlgmj (mgr.34412) 8997 : cluster [DBG] pgmap v5126: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:23.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:39:23 gibba015 bash[30343]: cephadm 2021-03-10T16:39:22.669533+0000 mgr.gibba045.orlgmj (mgr.34412) 8998 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:39:23.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:39:23 gibba045 bash[25517]: cluster 2021-03-10T16:39:22.426710+0000 mgr.gibba045.orlgmj (mgr.34412) 8997 : cluster [DBG] pgmap v5126: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:23.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:39:23 gibba045 bash[25517]: cephadm 2021-03-10T16:39:22.669533+0000 mgr.gibba045.orlgmj (mgr.34412) 8998 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:39:25.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:39:25 gibba015 bash[29377]: cluster 2021-03-10T16:39:24.428224+0000 mgr.gibba045.orlgmj (mgr.34412) 8999 : cluster [DBG] pgmap v5127: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:25.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:39:25 gibba015 bash[30343]: cluster 2021-03-10T16:39:24.428224+0000 mgr.gibba045.orlgmj (mgr.34412) 8999 : cluster [DBG] pgmap v5127: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:25.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:39:25 gibba045 bash[25517]: cluster 2021-03-10T16:39:24.428224+0000 mgr.gibba045.orlgmj (mgr.34412) 8999 : cluster [DBG] pgmap v5127: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:27.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:39:27 gibba015 bash[29377]: cluster 2021-03-10T16:39:26.429963+0000 mgr.gibba045.orlgmj (mgr.34412) 9000 : cluster [DBG] pgmap v5128: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:27.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:39:27 gibba015 bash[30343]: cluster 2021-03-10T16:39:26.429963+0000 mgr.gibba045.orlgmj (mgr.34412) 9000 : cluster [DBG] pgmap v5128: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:27.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:39:27 gibba045 bash[25517]: cluster 2021-03-10T16:39:26.429963+0000 mgr.gibba045.orlgmj (mgr.34412) 9000 : cluster [DBG] pgmap v5128: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:29.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:39:29 gibba015 bash[29377]: cluster 2021-03-10T16:39:28.431149+0000 mgr.gibba045.orlgmj (mgr.34412) 9001 : cluster [DBG] pgmap v5129: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:29.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:39:29 gibba015 bash[30343]: cluster 2021-03-10T16:39:28.431149+0000 mgr.gibba045.orlgmj (mgr.34412) 9001 : cluster [DBG] pgmap v5129: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:29.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:39:29 gibba045 bash[25517]: cluster 2021-03-10T16:39:28.431149+0000 mgr.gibba045.orlgmj (mgr.34412) 9001 : cluster [DBG] pgmap v5129: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:31.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:39:31 gibba015 bash[29377]: cluster 2021-03-10T16:39:30.432800+0000 mgr.gibba045.orlgmj (mgr.34412) 9002 : cluster [DBG] pgmap v5130: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:31.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:39:31 gibba015 bash[30343]: cluster 2021-03-10T16:39:30.432800+0000 mgr.gibba045.orlgmj (mgr.34412) 9002 : cluster [DBG] pgmap v5130: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:31.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:39:31 gibba045 bash[25517]: cluster 2021-03-10T16:39:30.432800+0000 mgr.gibba045.orlgmj (mgr.34412) 9002 : cluster [DBG] pgmap v5130: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:33.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:39:33 gibba015 bash[29377]: cluster 2021-03-10T16:39:32.434297+0000 mgr.gibba045.orlgmj (mgr.34412) 9003 : cluster [DBG] pgmap v5131: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:33.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:39:33 gibba015 bash[30343]: cluster 2021-03-10T16:39:32.434297+0000 mgr.gibba045.orlgmj (mgr.34412) 9003 : cluster [DBG] pgmap v5131: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:33.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:39:33 gibba045 bash[25517]: cluster 2021-03-10T16:39:32.434297+0000 mgr.gibba045.orlgmj (mgr.34412) 9003 : cluster [DBG] pgmap v5131: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:35.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:39:35 gibba045 bash[25517]: cluster 2021-03-10T16:39:34.435531+0000 mgr.gibba045.orlgmj (mgr.34412) 9004 : cluster [DBG] pgmap v5132: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:35.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:39:35 gibba015 bash[29377]: cluster 2021-03-10T16:39:34.435531+0000 mgr.gibba045.orlgmj (mgr.34412) 9004 : cluster [DBG] pgmap v5132: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:35.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:39:35 gibba015 bash[30343]: cluster 2021-03-10T16:39:34.435531+0000 mgr.gibba045.orlgmj (mgr.34412) 9004 : cluster [DBG] pgmap v5132: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:37.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:39:37 gibba015 bash[29377]: cluster 2021-03-10T16:39:36.437272+0000 mgr.gibba045.orlgmj (mgr.34412) 9005 : cluster [DBG] pgmap v5133: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:37.719 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:39:37 gibba015 bash[30343]: cluster 2021-03-10T16:39:36.437272+0000 mgr.gibba045.orlgmj (mgr.34412) 9005 : cluster [DBG] pgmap v5133: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:37.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:39:37 gibba045 bash[25517]: cluster 2021-03-10T16:39:36.437272+0000 mgr.gibba045.orlgmj (mgr.34412) 9005 : cluster [DBG] pgmap v5133: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:38.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:39:38 gibba015 bash[29377]: audit 2021-03-10T16:39:37.683802+0000 mon.c (mon.1) 2482 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:39:38.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:39:38 gibba015 bash[29377]: cephadm 2021-03-10T16:39:37.692129+0000 mgr.gibba045.orlgmj (mgr.34412) 9006 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:39:38.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:39:38 gibba015 bash[29377]: cephadm 2021-03-10T16:39:37.694150+0000 mgr.gibba045.orlgmj (mgr.34412) 9007 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:39:38.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:39:38 gibba015 bash[29377]: audit 2021-03-10T16:39:37.916631+0000 mon.a (mon.0) 1998 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:39:38.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:39:38 gibba015 bash[29377]: audit 2021-03-10T16:39:37.920327+0000 mon.c (mon.1) 2483 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:39:38.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:39:38 gibba015 bash[29377]: audit 2021-03-10T16:39:37.921884+0000 mon.c (mon.1) 2484 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:39:38.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:39:38 gibba015 bash[29377]: audit 2021-03-10T16:39:37.923346+0000 mon.c (mon.1) 2485 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:39:38.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:39:38 gibba015 bash[29377]: audit 2021-03-10T16:39:37.924468+0000 mon.c (mon.1) 2486 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:39:38.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:39:38 gibba015 bash[29377]: audit 2021-03-10T16:39:37.927441+0000 mon.c (mon.1) 2487 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:39:38.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:39:38 gibba015 bash[29377]: audit 2021-03-10T16:39:37.929006+0000 mon.c (mon.1) 2488 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:39:38.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:39:38 gibba015 bash[30343]: audit 2021-03-10T16:39:37.683802+0000 mon.c (mon.1) 2482 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:39:38.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:39:38 gibba015 bash[30343]: cephadm 2021-03-10T16:39:37.692129+0000 mgr.gibba045.orlgmj (mgr.34412) 9006 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:39:38.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:39:38 gibba015 bash[30343]: cephadm 2021-03-10T16:39:37.694150+0000 mgr.gibba045.orlgmj (mgr.34412) 9007 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:39:38.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:39:38 gibba015 bash[30343]: audit 2021-03-10T16:39:37.916631+0000 mon.a (mon.0) 1998 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:39:38.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:39:38 gibba015 bash[30343]: audit 2021-03-10T16:39:37.920327+0000 mon.c (mon.1) 2483 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:39:38.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:39:38 gibba015 bash[30343]: audit 2021-03-10T16:39:37.921884+0000 mon.c (mon.1) 2484 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:39:38.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:39:38 gibba015 bash[30343]: audit 2021-03-10T16:39:37.923346+0000 mon.c (mon.1) 2485 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:39:38.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:39:38 gibba015 bash[30343]: audit 2021-03-10T16:39:37.924468+0000 mon.c (mon.1) 2486 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:39:38.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:39:38 gibba015 bash[30343]: audit 2021-03-10T16:39:37.927441+0000 mon.c (mon.1) 2487 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:39:38.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:39:38 gibba015 bash[30343]: audit 2021-03-10T16:39:37.929006+0000 mon.c (mon.1) 2488 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:39:38.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:39:38 gibba045 bash[25517]: audit 2021-03-10T16:39:37.683802+0000 mon.c (mon.1) 2482 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:39:38.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:39:38 gibba045 bash[25517]: cephadm 2021-03-10T16:39:37.692129+0000 mgr.gibba045.orlgmj (mgr.34412) 9006 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:39:38.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:39:38 gibba045 bash[25517]: cephadm 2021-03-10T16:39:37.694150+0000 mgr.gibba045.orlgmj (mgr.34412) 9007 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:39:38.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:39:38 gibba045 bash[25517]: audit 2021-03-10T16:39:37.916631+0000 mon.a (mon.0) 1998 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:39:38.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:39:38 gibba045 bash[25517]: audit 2021-03-10T16:39:37.920327+0000 mon.c (mon.1) 2483 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:39:38.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:39:38 gibba045 bash[25517]: audit 2021-03-10T16:39:37.921884+0000 mon.c (mon.1) 2484 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:39:38.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:39:38 gibba045 bash[25517]: audit 2021-03-10T16:39:37.923346+0000 mon.c (mon.1) 2485 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:39:38.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:39:38 gibba045 bash[25517]: audit 2021-03-10T16:39:37.924468+0000 mon.c (mon.1) 2486 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:39:38.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:39:38 gibba045 bash[25517]: audit 2021-03-10T16:39:37.927441+0000 mon.c (mon.1) 2487 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:39:38.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:39:38 gibba045 bash[25517]: audit 2021-03-10T16:39:37.929006+0000 mon.c (mon.1) 2488 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:39:39.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:39:39 gibba015 bash[29377]: cephadm 2021-03-10T16:39:37.922253+0000 mgr.gibba045.orlgmj (mgr.34412) 9008 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:39:39.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:39:39 gibba015 bash[29377]: cephadm 2021-03-10T16:39:37.923988+0000 mgr.gibba045.orlgmj (mgr.34412) 9009 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:39:39.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:39:39 gibba015 bash[29377]: cephadm 2021-03-10T16:39:37.925439+0000 mgr.gibba045.orlgmj (mgr.34412) 9010 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:39:39.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:39:39 gibba015 bash[29377]: cephadm 2021-03-10T16:39:37.925474+0000 mgr.gibba045.orlgmj (mgr.34412) 9011 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:39:39.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:39:39 gibba015 bash[29377]: cephadm 2021-03-10T16:39:37.926744+0000 mgr.gibba045.orlgmj (mgr.34412) 9012 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:39:39.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:39:39 gibba015 bash[29377]: cephadm 2021-03-10T16:39:37.926780+0000 mgr.gibba045.orlgmj (mgr.34412) 9013 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:39:39.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:39:39 gibba015 bash[29377]: cephadm 2021-03-10T16:39:37.927901+0000 mgr.gibba045.orlgmj (mgr.34412) 9014 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:39:39.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:39:39 gibba015 bash[29377]: cephadm 2021-03-10T16:39:37.929467+0000 mgr.gibba045.orlgmj (mgr.34412) 9015 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:39:39.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:39:39 gibba015 bash[29377]: cephadm 2021-03-10T16:39:37.929503+0000 mgr.gibba045.orlgmj (mgr.34412) 9016 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:39:39.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:39:39 gibba015 bash[29377]: cephadm 2021-03-10T16:39:37.930985+0000 mgr.gibba045.orlgmj (mgr.34412) 9017 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:39:39.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:39:39 gibba015 bash[29377]: cephadm 2021-03-10T16:39:37.931297+0000 mgr.gibba045.orlgmj (mgr.34412) 9018 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:39:39.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:39:39 gibba015 bash[29377]: cephadm 2021-03-10T16:39:37.933542+0000 mgr.gibba045.orlgmj (mgr.34412) 9019 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:39:39.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:39:39 gibba015 bash[29377]: cephadm 2021-03-10T16:39:37.934027+0000 mgr.gibba045.orlgmj (mgr.34412) 9020 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:39:39.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:39:39 gibba015 bash[29377]: cephadm 2021-03-10T16:39:37.934680+0000 mgr.gibba045.orlgmj (mgr.34412) 9021 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:39:39.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:39:39 gibba015 bash[29377]: cluster 2021-03-10T16:39:38.438638+0000 mgr.gibba045.orlgmj (mgr.34412) 9022 : cluster [DBG] pgmap v5134: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:39.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:39:39 gibba015 bash[30343]: cephadm 2021-03-10T16:39:37.922253+0000 mgr.gibba045.orlgmj (mgr.34412) 9008 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:39:39.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:39:39 gibba015 bash[30343]: cephadm 2021-03-10T16:39:37.923988+0000 mgr.gibba045.orlgmj (mgr.34412) 9009 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:39:39.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:39:39 gibba015 bash[30343]: cephadm 2021-03-10T16:39:37.925439+0000 mgr.gibba045.orlgmj (mgr.34412) 9010 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:39:39.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:39:39 gibba015 bash[30343]: cephadm 2021-03-10T16:39:37.925474+0000 mgr.gibba045.orlgmj (mgr.34412) 9011 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:39:39.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:39:39 gibba015 bash[30343]: cephadm 2021-03-10T16:39:37.926744+0000 mgr.gibba045.orlgmj (mgr.34412) 9012 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:39:39.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:39:39 gibba015 bash[30343]: cephadm 2021-03-10T16:39:37.926780+0000 mgr.gibba045.orlgmj (mgr.34412) 9013 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:39:39.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:39:39 gibba015 bash[30343]: cephadm 2021-03-10T16:39:37.927901+0000 mgr.gibba045.orlgmj (mgr.34412) 9014 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:39:39.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:39:39 gibba015 bash[30343]: cephadm 2021-03-10T16:39:37.929467+0000 mgr.gibba045.orlgmj (mgr.34412) 9015 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:39:39.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:39:39 gibba015 bash[30343]: cephadm 2021-03-10T16:39:37.929503+0000 mgr.gibba045.orlgmj (mgr.34412) 9016 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:39:39.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:39:39 gibba015 bash[30343]: cephadm 2021-03-10T16:39:37.930985+0000 mgr.gibba045.orlgmj (mgr.34412) 9017 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:39:39.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:39:39 gibba015 bash[30343]: cephadm 2021-03-10T16:39:37.931297+0000 mgr.gibba045.orlgmj (mgr.34412) 9018 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:39:39.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:39:39 gibba015 bash[30343]: cephadm 2021-03-10T16:39:37.933542+0000 mgr.gibba045.orlgmj (mgr.34412) 9019 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:39:39.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:39:39 gibba015 bash[30343]: cephadm 2021-03-10T16:39:37.934027+0000 mgr.gibba045.orlgmj (mgr.34412) 9020 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:39:39.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:39:39 gibba015 bash[30343]: cephadm 2021-03-10T16:39:37.934680+0000 mgr.gibba045.orlgmj (mgr.34412) 9021 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:39:39.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:39:39 gibba015 bash[30343]: cluster 2021-03-10T16:39:38.438638+0000 mgr.gibba045.orlgmj (mgr.34412) 9022 : cluster [DBG] pgmap v5134: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:39.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:39:39 gibba045 bash[25517]: cephadm 2021-03-10T16:39:37.922253+0000 mgr.gibba045.orlgmj (mgr.34412) 9008 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:39:39.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:39:39 gibba045 bash[25517]: cephadm 2021-03-10T16:39:37.923988+0000 mgr.gibba045.orlgmj (mgr.34412) 9009 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:39:39.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:39:39 gibba045 bash[25517]: cephadm 2021-03-10T16:39:37.925439+0000 mgr.gibba045.orlgmj (mgr.34412) 9010 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:39:39.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:39:39 gibba045 bash[25517]: cephadm 2021-03-10T16:39:37.925474+0000 mgr.gibba045.orlgmj (mgr.34412) 9011 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:39:39.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:39:39 gibba045 bash[25517]: cephadm 2021-03-10T16:39:37.926744+0000 mgr.gibba045.orlgmj (mgr.34412) 9012 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:39:39.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:39:39 gibba045 bash[25517]: cephadm 2021-03-10T16:39:37.926780+0000 mgr.gibba045.orlgmj (mgr.34412) 9013 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:39:39.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:39:39 gibba045 bash[25517]: cephadm 2021-03-10T16:39:37.927901+0000 mgr.gibba045.orlgmj (mgr.34412) 9014 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:39:39.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:39:39 gibba045 bash[25517]: cephadm 2021-03-10T16:39:37.929467+0000 mgr.gibba045.orlgmj (mgr.34412) 9015 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:39:39.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:39:39 gibba045 bash[25517]: cephadm 2021-03-10T16:39:37.929503+0000 mgr.gibba045.orlgmj (mgr.34412) 9016 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:39:39.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:39:39 gibba045 bash[25517]: cephadm 2021-03-10T16:39:37.930985+0000 mgr.gibba045.orlgmj (mgr.34412) 9017 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:39:39.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:39:39 gibba045 bash[25517]: cephadm 2021-03-10T16:39:37.931297+0000 mgr.gibba045.orlgmj (mgr.34412) 9018 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:39:39.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:39:39 gibba045 bash[25517]: cephadm 2021-03-10T16:39:37.933542+0000 mgr.gibba045.orlgmj (mgr.34412) 9019 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:39:39.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:39:39 gibba045 bash[25517]: cephadm 2021-03-10T16:39:37.934027+0000 mgr.gibba045.orlgmj (mgr.34412) 9020 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:39:39.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:39:39 gibba045 bash[25517]: cephadm 2021-03-10T16:39:37.934680+0000 mgr.gibba045.orlgmj (mgr.34412) 9021 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:39:39.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:39:39 gibba045 bash[25517]: cluster 2021-03-10T16:39:38.438638+0000 mgr.gibba045.orlgmj (mgr.34412) 9022 : cluster [DBG] pgmap v5134: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:40.472 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:39:40.705 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:39:40.706 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 3m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:39:40.706 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 2m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:39:40.706 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:39:40.707 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:39:40.707 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:39:40.707 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:39:40.707 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:39:40.707 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:39:40.708 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 3m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:39:40.708 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 2m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:39:40.708 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:39:40.708 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:39:40.709 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:39:40.709 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:39:40.709 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:39:40.709 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:39:40.709 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:39:40.710 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:39:40.710 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 2m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:39:40.710 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 2m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:39:40.958 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:39:40.959 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:39:40.959 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:39:40.959 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:39:40.959 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:39:40.960 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:39:40.960 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:39:40.960 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:39:40.960 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:39:40.961 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:39:40.961 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:39:40.961 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:39:40.961 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:39:40.961 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:39:40.962 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:39:41.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:39:41 gibba015 bash[29377]: cluster 2021-03-10T16:39:40.440235+0000 mgr.gibba045.orlgmj (mgr.34412) 9023 : cluster [DBG] pgmap v5135: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:41.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:39:41 gibba015 bash[29377]: audit 2021-03-10T16:39:40.466328+0000 mgr.gibba045.orlgmj (mgr.34412) 9024 : audit [DBG] from='client.50100 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:39:41.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:39:41 gibba015 bash[29377]: audit 2021-03-10T16:39:40.696665+0000 mgr.gibba045.orlgmj (mgr.34412) 9025 : audit [DBG] from='client.60094 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:39:41.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:39:41 gibba015 bash[29377]: audit 2021-03-10T16:39:40.959546+0000 mon.c (mon.1) 2489 : audit [DBG] from='client.? 172.21.2.115:0/2407322183' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:39:41.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:39:41 gibba015 bash[30343]: cluster 2021-03-10T16:39:40.440235+0000 mgr.gibba045.orlgmj (mgr.34412) 9023 : cluster [DBG] pgmap v5135: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:41.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:39:41 gibba015 bash[30343]: audit 2021-03-10T16:39:40.466328+0000 mgr.gibba045.orlgmj (mgr.34412) 9024 : audit [DBG] from='client.50100 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:39:41.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:39:41 gibba015 bash[30343]: audit 2021-03-10T16:39:40.696665+0000 mgr.gibba045.orlgmj (mgr.34412) 9025 : audit [DBG] from='client.60094 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:39:41.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:39:41 gibba015 bash[30343]: audit 2021-03-10T16:39:40.959546+0000 mon.c (mon.1) 2489 : audit [DBG] from='client.? 172.21.2.115:0/2407322183' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:39:41.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:39:41 gibba045 bash[25517]: cluster 2021-03-10T16:39:40.440235+0000 mgr.gibba045.orlgmj (mgr.34412) 9023 : cluster [DBG] pgmap v5135: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:41.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:39:41 gibba045 bash[25517]: audit 2021-03-10T16:39:40.466328+0000 mgr.gibba045.orlgmj (mgr.34412) 9024 : audit [DBG] from='client.50100 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:39:41.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:39:41 gibba045 bash[25517]: audit 2021-03-10T16:39:40.696665+0000 mgr.gibba045.orlgmj (mgr.34412) 9025 : audit [DBG] from='client.60094 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:39:41.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:39:41 gibba045 bash[25517]: audit 2021-03-10T16:39:40.959546+0000 mon.c (mon.1) 2489 : audit [DBG] from='client.? 172.21.2.115:0/2407322183' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:39:43.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:39:43 gibba015 bash[29377]: cluster 2021-03-10T16:39:42.441864+0000 mgr.gibba045.orlgmj (mgr.34412) 9026 : cluster [DBG] pgmap v5136: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:43.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:39:43 gibba015 bash[30343]: cluster 2021-03-10T16:39:42.441864+0000 mgr.gibba045.orlgmj (mgr.34412) 9026 : cluster [DBG] pgmap v5136: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:43.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:39:43 gibba045 bash[25517]: cluster 2021-03-10T16:39:42.441864+0000 mgr.gibba045.orlgmj (mgr.34412) 9026 : cluster [DBG] pgmap v5136: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:45.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:39:45 gibba045 bash[25517]: cluster 2021-03-10T16:39:44.443303+0000 mgr.gibba045.orlgmj (mgr.34412) 9027 : cluster [DBG] pgmap v5137: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:45.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:39:45 gibba015 bash[29377]: cluster 2021-03-10T16:39:44.443303+0000 mgr.gibba045.orlgmj (mgr.34412) 9027 : cluster [DBG] pgmap v5137: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:45.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:39:45 gibba015 bash[30343]: cluster 2021-03-10T16:39:44.443303+0000 mgr.gibba045.orlgmj (mgr.34412) 9027 : cluster [DBG] pgmap v5137: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:47.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:39:47 gibba015 bash[29377]: cluster 2021-03-10T16:39:46.445051+0000 mgr.gibba045.orlgmj (mgr.34412) 9028 : cluster [DBG] pgmap v5138: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:47.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:39:47 gibba015 bash[30343]: cluster 2021-03-10T16:39:46.445051+0000 mgr.gibba045.orlgmj (mgr.34412) 9028 : cluster [DBG] pgmap v5138: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:47.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:39:47 gibba045 bash[25517]: cluster 2021-03-10T16:39:46.445051+0000 mgr.gibba045.orlgmj (mgr.34412) 9028 : cluster [DBG] pgmap v5138: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:49.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:39:49 gibba015 bash[29377]: cluster 2021-03-10T16:39:48.446122+0000 mgr.gibba045.orlgmj (mgr.34412) 9029 : cluster [DBG] pgmap v5139: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:49.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:39:49 gibba015 bash[30343]: cluster 2021-03-10T16:39:48.446122+0000 mgr.gibba045.orlgmj (mgr.34412) 9029 : cluster [DBG] pgmap v5139: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:49.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:39:49 gibba045 bash[25517]: cluster 2021-03-10T16:39:48.446122+0000 mgr.gibba045.orlgmj (mgr.34412) 9029 : cluster [DBG] pgmap v5139: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:51.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:39:51 gibba015 bash[29377]: cluster 2021-03-10T16:39:50.447650+0000 mgr.gibba045.orlgmj (mgr.34412) 9030 : cluster [DBG] pgmap v5140: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:51.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:39:51 gibba015 bash[30343]: cluster 2021-03-10T16:39:50.447650+0000 mgr.gibba045.orlgmj (mgr.34412) 9030 : cluster [DBG] pgmap v5140: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:51.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:39:51 gibba045 bash[25517]: cluster 2021-03-10T16:39:50.447650+0000 mgr.gibba045.orlgmj (mgr.34412) 9030 : cluster [DBG] pgmap v5140: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:53.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:39:53 gibba045 bash[25517]: cluster 2021-03-10T16:39:52.449415+0000 mgr.gibba045.orlgmj (mgr.34412) 9031 : cluster [DBG] pgmap v5141: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:53.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:39:53 gibba015 bash[29377]: cluster 2021-03-10T16:39:52.449415+0000 mgr.gibba045.orlgmj (mgr.34412) 9031 : cluster [DBG] pgmap v5141: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:53.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:39:53 gibba015 bash[30343]: cluster 2021-03-10T16:39:52.449415+0000 mgr.gibba045.orlgmj (mgr.34412) 9031 : cluster [DBG] pgmap v5141: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:54.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:39:54 gibba045 bash[25517]: cephadm 2021-03-10T16:39:52.950605+0000 mgr.gibba045.orlgmj (mgr.34412) 9032 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:39:54.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:39:54 gibba045 bash[25517]: audit 2021-03-10T16:39:53.683164+0000 mon.c (mon.1) 2490 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:39:54.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:39:54 gibba045 bash[25517]: audit 2021-03-10T16:39:53.683803+0000 mon.c (mon.1) 2491 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:39:54.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:39:54 gibba045 bash[25517]: audit 2021-03-10T16:39:53.684276+0000 mon.a (mon.0) 1999 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:39:54.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:39:54 gibba045 bash[25517]: audit 2021-03-10T16:39:53.685452+0000 mon.a (mon.0) 2000 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:39:54.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:39:54 gibba045 bash[25517]: audit 2021-03-10T16:39:53.699354+0000 mon.c (mon.1) 2492 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T16:39:54.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:39:54 gibba045 bash[25517]: audit 2021-03-10T16:39:53.700136+0000 mon.c (mon.1) 2493 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:39:54.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:39:54 gibba045 bash[25517]: audit 2021-03-10T16:39:53.700494+0000 mon.a (mon.0) 2001 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T16:39:54.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:39:54 gibba045 bash[25517]: audit 2021-03-10T16:39:53.700831+0000 mon.c (mon.1) 2494 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:39:54.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:39:54 gibba045 bash[25517]: audit 2021-03-10T16:39:53.701668+0000 mon.a (mon.0) 2002 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:39:54.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:39:54 gibba045 bash[25517]: audit 2021-03-10T16:39:53.701783+0000 mon.c (mon.1) 2495 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:39:54.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:39:54 gibba045 bash[25517]: audit 2021-03-10T16:39:53.702657+0000 mon.a (mon.0) 2003 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:39:54.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:39:54 gibba045 bash[25517]: audit 2021-03-10T16:39:53.703736+0000 mon.a (mon.0) 2004 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:39:54.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:39:54 gibba015 bash[29377]: cephadm 2021-03-10T16:39:52.950605+0000 mgr.gibba045.orlgmj (mgr.34412) 9032 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:39:54.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:39:54 gibba015 bash[29377]: audit 2021-03-10T16:39:53.683164+0000 mon.c (mon.1) 2490 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:39:54.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:39:54 gibba015 bash[29377]: audit 2021-03-10T16:39:53.683803+0000 mon.c (mon.1) 2491 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:39:54.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:39:54 gibba015 bash[29377]: audit 2021-03-10T16:39:53.684276+0000 mon.a (mon.0) 1999 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:39:54.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:39:54 gibba015 bash[29377]: audit 2021-03-10T16:39:53.685452+0000 mon.a (mon.0) 2000 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:39:54.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:39:54 gibba015 bash[29377]: audit 2021-03-10T16:39:53.699354+0000 mon.c (mon.1) 2492 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T16:39:54.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:39:54 gibba015 bash[29377]: audit 2021-03-10T16:39:53.700136+0000 mon.c (mon.1) 2493 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:39:54.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:39:54 gibba015 bash[29377]: audit 2021-03-10T16:39:53.700494+0000 mon.a (mon.0) 2001 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T16:39:54.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:39:54 gibba015 bash[29377]: audit 2021-03-10T16:39:53.700831+0000 mon.c (mon.1) 2494 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:39:54.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:39:54 gibba015 bash[29377]: audit 2021-03-10T16:39:53.701668+0000 mon.a (mon.0) 2002 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:39:54.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:39:54 gibba015 bash[29377]: audit 2021-03-10T16:39:53.701783+0000 mon.c (mon.1) 2495 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:39:54.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:39:54 gibba015 bash[29377]: audit 2021-03-10T16:39:53.702657+0000 mon.a (mon.0) 2003 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:39:54.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:39:54 gibba015 bash[29377]: audit 2021-03-10T16:39:53.703736+0000 mon.a (mon.0) 2004 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:39:54.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:39:54 gibba015 bash[30343]: cephadm 2021-03-10T16:39:52.950605+0000 mgr.gibba045.orlgmj (mgr.34412) 9032 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:39:54.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:39:54 gibba015 bash[30343]: audit 2021-03-10T16:39:53.683164+0000 mon.c (mon.1) 2490 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:39:54.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:39:54 gibba015 bash[30343]: audit 2021-03-10T16:39:53.683803+0000 mon.c (mon.1) 2491 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:39:54.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:39:54 gibba015 bash[30343]: audit 2021-03-10T16:39:53.684276+0000 mon.a (mon.0) 1999 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:39:54.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:39:54 gibba015 bash[30343]: audit 2021-03-10T16:39:53.685452+0000 mon.a (mon.0) 2000 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:39:54.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:39:54 gibba015 bash[30343]: audit 2021-03-10T16:39:53.699354+0000 mon.c (mon.1) 2492 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T16:39:54.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:39:54 gibba015 bash[30343]: audit 2021-03-10T16:39:53.700136+0000 mon.c (mon.1) 2493 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:39:54.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:39:54 gibba015 bash[30343]: audit 2021-03-10T16:39:53.700494+0000 mon.a (mon.0) 2001 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T16:39:54.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:39:54 gibba015 bash[30343]: audit 2021-03-10T16:39:53.700831+0000 mon.c (mon.1) 2494 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:39:54.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:39:54 gibba015 bash[30343]: audit 2021-03-10T16:39:53.701668+0000 mon.a (mon.0) 2002 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:39:54.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:39:54 gibba015 bash[30343]: audit 2021-03-10T16:39:53.701783+0000 mon.c (mon.1) 2495 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:39:54.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:39:54 gibba015 bash[30343]: audit 2021-03-10T16:39:53.702657+0000 mon.a (mon.0) 2003 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:39:54.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:39:54 gibba015 bash[30343]: audit 2021-03-10T16:39:53.703736+0000 mon.a (mon.0) 2004 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:39:55.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:39:55 gibba045 bash[25517]: cluster 2021-03-10T16:39:54.450620+0000 mgr.gibba045.orlgmj (mgr.34412) 9033 : cluster [DBG] pgmap v5142: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:55.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:39:55 gibba015 bash[29377]: cluster 2021-03-10T16:39:54.450620+0000 mgr.gibba045.orlgmj (mgr.34412) 9033 : cluster [DBG] pgmap v5142: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:55.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:39:55 gibba015 bash[30343]: cluster 2021-03-10T16:39:54.450620+0000 mgr.gibba045.orlgmj (mgr.34412) 9033 : cluster [DBG] pgmap v5142: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:57.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:39:57 gibba015 bash[29377]: cluster 2021-03-10T16:39:56.451580+0000 mgr.gibba045.orlgmj (mgr.34412) 9034 : cluster [DBG] pgmap v5143: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:57.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:39:57 gibba015 bash[30343]: cluster 2021-03-10T16:39:56.451580+0000 mgr.gibba045.orlgmj (mgr.34412) 9034 : cluster [DBG] pgmap v5143: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:57.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:39:57 gibba045 bash[25517]: cluster 2021-03-10T16:39:56.451580+0000 mgr.gibba045.orlgmj (mgr.34412) 9034 : cluster [DBG] pgmap v5143: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:59.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:39:59 gibba015 bash[29377]: cluster 2021-03-10T16:39:58.452595+0000 mgr.gibba045.orlgmj (mgr.34412) 9035 : cluster [DBG] pgmap v5144: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:59.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:39:59 gibba015 bash[30343]: cluster 2021-03-10T16:39:58.452595+0000 mgr.gibba045.orlgmj (mgr.34412) 9035 : cluster [DBG] pgmap v5144: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:59.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:39:59 gibba045 bash[25517]: cluster 2021-03-10T16:39:58.452595+0000 mgr.gibba045.orlgmj (mgr.34412) 9035 : cluster [DBG] pgmap v5144: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:00.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:40:00 gibba015 bash[29377]: debug 2021-03-10T16:39:59.995+0000 7f21beb4f700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T16:40:00.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:40:00 gibba045 bash[25517]: cluster 2021-03-10T16:40:00.000225+0000 mon.a (mon.0) 2005 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T16:40:00.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:40:00 gibba015 bash[29377]: cluster 2021-03-10T16:40:00.000225+0000 mon.a (mon.0) 2005 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T16:40:00.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:40:00 gibba015 bash[30343]: cluster 2021-03-10T16:40:00.000225+0000 mon.a (mon.0) 2005 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T16:40:01.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:40:01 gibba045 bash[25517]: cluster 2021-03-10T16:40:00.453930+0000 mgr.gibba045.orlgmj (mgr.34412) 9036 : cluster [DBG] pgmap v5145: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:01.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:40:01 gibba015 bash[29377]: cluster 2021-03-10T16:40:00.453930+0000 mgr.gibba045.orlgmj (mgr.34412) 9036 : cluster [DBG] pgmap v5145: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:01.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:40:01 gibba015 bash[30343]: cluster 2021-03-10T16:40:00.453930+0000 mgr.gibba045.orlgmj (mgr.34412) 9036 : cluster [DBG] pgmap v5145: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:03.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:40:03 gibba045 bash[25517]: cluster 2021-03-10T16:40:02.455635+0000 mgr.gibba045.orlgmj (mgr.34412) 9037 : cluster [DBG] pgmap v5146: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:03.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:40:03 gibba015 bash[29377]: cluster 2021-03-10T16:40:02.455635+0000 mgr.gibba045.orlgmj (mgr.34412) 9037 : cluster [DBG] pgmap v5146: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:03.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:40:03 gibba015 bash[30343]: cluster 2021-03-10T16:40:02.455635+0000 mgr.gibba045.orlgmj (mgr.34412) 9037 : cluster [DBG] pgmap v5146: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:05.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:40:05 gibba045 bash[25517]: cluster 2021-03-10T16:40:04.457073+0000 mgr.gibba045.orlgmj (mgr.34412) 9038 : cluster [DBG] pgmap v5147: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:05.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:40:05 gibba015 bash[29377]: cluster 2021-03-10T16:40:04.457073+0000 mgr.gibba045.orlgmj (mgr.34412) 9038 : cluster [DBG] pgmap v5147: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:05.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:40:05 gibba015 bash[30343]: cluster 2021-03-10T16:40:04.457073+0000 mgr.gibba045.orlgmj (mgr.34412) 9038 : cluster [DBG] pgmap v5147: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:07.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:40:07 gibba015 bash[29377]: cluster 2021-03-10T16:40:06.457837+0000 mgr.gibba045.orlgmj (mgr.34412) 9039 : cluster [DBG] pgmap v5148: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:07.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:40:07 gibba015 bash[30343]: cluster 2021-03-10T16:40:06.457837+0000 mgr.gibba045.orlgmj (mgr.34412) 9039 : cluster [DBG] pgmap v5148: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:07.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:40:07 gibba045 bash[25517]: cluster 2021-03-10T16:40:06.457837+0000 mgr.gibba045.orlgmj (mgr.34412) 9039 : cluster [DBG] pgmap v5148: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:09.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:40:09 gibba045 bash[25517]: cephadm 2021-03-10T16:40:07.968870+0000 mgr.gibba045.orlgmj (mgr.34412) 9040 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:40:09.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:40:09 gibba045 bash[25517]: cluster 2021-03-10T16:40:08.458765+0000 mgr.gibba045.orlgmj (mgr.34412) 9041 : cluster [DBG] pgmap v5149: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:09.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:40:09 gibba015 bash[29377]: cephadm 2021-03-10T16:40:07.968870+0000 mgr.gibba045.orlgmj (mgr.34412) 9040 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:40:09.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:40:09 gibba015 bash[29377]: cluster 2021-03-10T16:40:08.458765+0000 mgr.gibba045.orlgmj (mgr.34412) 9041 : cluster [DBG] pgmap v5149: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:09.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:40:09 gibba015 bash[30343]: cephadm 2021-03-10T16:40:07.968870+0000 mgr.gibba045.orlgmj (mgr.34412) 9040 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:40:09.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:40:09 gibba015 bash[30343]: cluster 2021-03-10T16:40:08.458765+0000 mgr.gibba045.orlgmj (mgr.34412) 9041 : cluster [DBG] pgmap v5149: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:11.206 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:40:11.433 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:40:11.433 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 3m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:40:11.434 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 2m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:40:11.434 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:40:11.434 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:40:11.435 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:40:11.435 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:40:11.435 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:40:11.435 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:40:11.435 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 3m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:40:11.436 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 2m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:40:11.436 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:40:11.436 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:40:11.436 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:40:11.437 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:40:11.437 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:40:11.437 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:40:11.437 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:40:11.438 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:40:11.438 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 2m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:40:11.438 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 2m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:40:11.684 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:40:11.685 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:40:11.685 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:40:11.686 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:40:11.686 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:40:11.686 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:40:11.687 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:40:11.687 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:40:11.687 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:40:11.687 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:40:11.687 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:40:11.688 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:40:11.688 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:40:11.688 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:40:11.688 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:40:11.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:40:11 gibba045 bash[25517]: cluster 2021-03-10T16:40:10.460497+0000 mgr.gibba045.orlgmj (mgr.34412) 9042 : cluster [DBG] pgmap v5150: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:11.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:40:11 gibba015 bash[29377]: cluster 2021-03-10T16:40:10.460497+0000 mgr.gibba045.orlgmj (mgr.34412) 9042 : cluster [DBG] pgmap v5150: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:11.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:40:11 gibba015 bash[30343]: cluster 2021-03-10T16:40:10.460497+0000 mgr.gibba045.orlgmj (mgr.34412) 9042 : cluster [DBG] pgmap v5150: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:12.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:40:12 gibba045 bash[25517]: audit 2021-03-10T16:40:11.200663+0000 mgr.gibba045.orlgmj (mgr.34412) 9043 : audit [DBG] from='client.60106 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:40:12.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:40:12 gibba045 bash[25517]: audit 2021-03-10T16:40:11.424567+0000 mgr.gibba045.orlgmj (mgr.34412) 9044 : audit [DBG] from='client.60112 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:40:12.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:40:12 gibba045 bash[25517]: audit 2021-03-10T16:40:11.685324+0000 mon.a (mon.0) 2006 : audit [DBG] from='client.? 172.21.2.115:0/3574057272' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:40:12.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:40:12 gibba015 bash[29377]: audit 2021-03-10T16:40:11.200663+0000 mgr.gibba045.orlgmj (mgr.34412) 9043 : audit [DBG] from='client.60106 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:40:12.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:40:12 gibba015 bash[29377]: audit 2021-03-10T16:40:11.424567+0000 mgr.gibba045.orlgmj (mgr.34412) 9044 : audit [DBG] from='client.60112 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:40:12.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:40:12 gibba015 bash[29377]: audit 2021-03-10T16:40:11.685324+0000 mon.a (mon.0) 2006 : audit [DBG] from='client.? 172.21.2.115:0/3574057272' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:40:12.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:40:12 gibba015 bash[30343]: audit 2021-03-10T16:40:11.200663+0000 mgr.gibba045.orlgmj (mgr.34412) 9043 : audit [DBG] from='client.60106 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:40:12.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:40:12 gibba015 bash[30343]: audit 2021-03-10T16:40:11.424567+0000 mgr.gibba045.orlgmj (mgr.34412) 9044 : audit [DBG] from='client.60112 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:40:12.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:40:12 gibba015 bash[30343]: audit 2021-03-10T16:40:11.685324+0000 mon.a (mon.0) 2006 : audit [DBG] from='client.? 172.21.2.115:0/3574057272' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:40:13.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:40:13 gibba045 bash[25517]: cluster 2021-03-10T16:40:12.462300+0000 mgr.gibba045.orlgmj (mgr.34412) 9045 : cluster [DBG] pgmap v5151: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:13.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:40:13 gibba015 bash[29377]: cluster 2021-03-10T16:40:12.462300+0000 mgr.gibba045.orlgmj (mgr.34412) 9045 : cluster [DBG] pgmap v5151: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:13.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:40:13 gibba015 bash[30343]: cluster 2021-03-10T16:40:12.462300+0000 mgr.gibba045.orlgmj (mgr.34412) 9045 : cluster [DBG] pgmap v5151: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:15.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:40:15 gibba045 bash[25517]: cluster 2021-03-10T16:40:14.463541+0000 mgr.gibba045.orlgmj (mgr.34412) 9046 : cluster [DBG] pgmap v5152: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:15.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:40:15 gibba015 bash[29377]: cluster 2021-03-10T16:40:14.463541+0000 mgr.gibba045.orlgmj (mgr.34412) 9046 : cluster [DBG] pgmap v5152: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:15.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:40:15 gibba015 bash[30343]: cluster 2021-03-10T16:40:14.463541+0000 mgr.gibba045.orlgmj (mgr.34412) 9046 : cluster [DBG] pgmap v5152: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:17.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:40:17 gibba015 bash[29377]: cluster 2021-03-10T16:40:16.465496+0000 mgr.gibba045.orlgmj (mgr.34412) 9047 : cluster [DBG] pgmap v5153: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:17.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:40:17 gibba015 bash[30343]: cluster 2021-03-10T16:40:16.465496+0000 mgr.gibba045.orlgmj (mgr.34412) 9047 : cluster [DBG] pgmap v5153: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:17.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:40:17 gibba045 bash[25517]: cluster 2021-03-10T16:40:16.465496+0000 mgr.gibba045.orlgmj (mgr.34412) 9047 : cluster [DBG] pgmap v5153: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:19.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:40:19 gibba045 bash[25517]: cluster 2021-03-10T16:40:18.466863+0000 mgr.gibba045.orlgmj (mgr.34412) 9048 : cluster [DBG] pgmap v5154: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:19.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:40:19 gibba015 bash[29377]: cluster 2021-03-10T16:40:18.466863+0000 mgr.gibba045.orlgmj (mgr.34412) 9048 : cluster [DBG] pgmap v5154: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:19.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:40:19 gibba015 bash[30343]: cluster 2021-03-10T16:40:18.466863+0000 mgr.gibba045.orlgmj (mgr.34412) 9048 : cluster [DBG] pgmap v5154: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:21.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:40:21 gibba045 bash[25517]: cluster 2021-03-10T16:40:20.468524+0000 mgr.gibba045.orlgmj (mgr.34412) 9049 : cluster [DBG] pgmap v5155: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:21.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:40:21 gibba015 bash[29377]: cluster 2021-03-10T16:40:20.468524+0000 mgr.gibba045.orlgmj (mgr.34412) 9049 : cluster [DBG] pgmap v5155: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:21.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:40:21 gibba015 bash[30343]: cluster 2021-03-10T16:40:20.468524+0000 mgr.gibba045.orlgmj (mgr.34412) 9049 : cluster [DBG] pgmap v5155: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:23.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:40:23 gibba045 bash[25517]: cluster 2021-03-10T16:40:22.470210+0000 mgr.gibba045.orlgmj (mgr.34412) 9050 : cluster [DBG] pgmap v5156: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:23.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:40:23 gibba015 bash[29377]: cluster 2021-03-10T16:40:22.470210+0000 mgr.gibba045.orlgmj (mgr.34412) 9050 : cluster [DBG] pgmap v5156: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:23.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:40:23 gibba015 bash[30343]: cluster 2021-03-10T16:40:22.470210+0000 mgr.gibba045.orlgmj (mgr.34412) 9050 : cluster [DBG] pgmap v5156: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:24.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:40:24 gibba015 bash[29377]: cephadm 2021-03-10T16:40:22.984532+0000 mgr.gibba045.orlgmj (mgr.34412) 9051 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:40:24.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:40:24 gibba015 bash[30343]: cephadm 2021-03-10T16:40:22.984532+0000 mgr.gibba045.orlgmj (mgr.34412) 9051 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:40:25.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:40:24 gibba045 bash[25517]: cephadm 2021-03-10T16:40:22.984532+0000 mgr.gibba045.orlgmj (mgr.34412) 9051 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:40:25.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:40:25 gibba015 bash[29377]: cluster 2021-03-10T16:40:24.471419+0000 mgr.gibba045.orlgmj (mgr.34412) 9052 : cluster [DBG] pgmap v5157: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:25.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:40:25 gibba015 bash[30343]: cluster 2021-03-10T16:40:24.471419+0000 mgr.gibba045.orlgmj (mgr.34412) 9052 : cluster [DBG] pgmap v5157: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:26.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:40:25 gibba045 bash[25517]: cluster 2021-03-10T16:40:24.471419+0000 mgr.gibba045.orlgmj (mgr.34412) 9052 : cluster [DBG] pgmap v5157: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:27.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:40:27 gibba015 bash[29377]: cluster 2021-03-10T16:40:26.472230+0000 mgr.gibba045.orlgmj (mgr.34412) 9053 : cluster [DBG] pgmap v5158: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:27.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:40:27 gibba015 bash[30343]: cluster 2021-03-10T16:40:26.472230+0000 mgr.gibba045.orlgmj (mgr.34412) 9053 : cluster [DBG] pgmap v5158: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:27.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:40:27 gibba045 bash[25517]: cluster 2021-03-10T16:40:26.472230+0000 mgr.gibba045.orlgmj (mgr.34412) 9053 : cluster [DBG] pgmap v5158: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:29.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:40:29 gibba045 bash[25517]: cluster 2021-03-10T16:40:28.473357+0000 mgr.gibba045.orlgmj (mgr.34412) 9054 : cluster [DBG] pgmap v5159: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:29.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:40:29 gibba015 bash[29377]: cluster 2021-03-10T16:40:28.473357+0000 mgr.gibba045.orlgmj (mgr.34412) 9054 : cluster [DBG] pgmap v5159: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:29.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:40:29 gibba015 bash[30343]: cluster 2021-03-10T16:40:28.473357+0000 mgr.gibba045.orlgmj (mgr.34412) 9054 : cluster [DBG] pgmap v5159: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:31.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:40:31 gibba045 bash[25517]: cluster 2021-03-10T16:40:30.474695+0000 mgr.gibba045.orlgmj (mgr.34412) 9055 : cluster [DBG] pgmap v5160: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:31.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:40:31 gibba015 bash[29377]: cluster 2021-03-10T16:40:30.474695+0000 mgr.gibba045.orlgmj (mgr.34412) 9055 : cluster [DBG] pgmap v5160: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:31.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:40:31 gibba015 bash[30343]: cluster 2021-03-10T16:40:30.474695+0000 mgr.gibba045.orlgmj (mgr.34412) 9055 : cluster [DBG] pgmap v5160: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:33.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:40:33 gibba045 bash[25517]: cluster 2021-03-10T16:40:32.476274+0000 mgr.gibba045.orlgmj (mgr.34412) 9056 : cluster [DBG] pgmap v5161: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:33.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:40:33 gibba015 bash[29377]: cluster 2021-03-10T16:40:32.476274+0000 mgr.gibba045.orlgmj (mgr.34412) 9056 : cluster [DBG] pgmap v5161: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:33.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:40:33 gibba015 bash[30343]: cluster 2021-03-10T16:40:32.476274+0000 mgr.gibba045.orlgmj (mgr.34412) 9056 : cluster [DBG] pgmap v5161: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:35.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:40:35 gibba015 bash[29377]: cluster 2021-03-10T16:40:34.477428+0000 mgr.gibba045.orlgmj (mgr.34412) 9057 : cluster [DBG] pgmap v5162: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:35.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:40:35 gibba015 bash[30343]: cluster 2021-03-10T16:40:34.477428+0000 mgr.gibba045.orlgmj (mgr.34412) 9057 : cluster [DBG] pgmap v5162: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:36.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:40:35 gibba045 bash[25517]: cluster 2021-03-10T16:40:34.477428+0000 mgr.gibba045.orlgmj (mgr.34412) 9057 : cluster [DBG] pgmap v5162: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:37.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:40:37 gibba045 bash[25517]: cluster 2021-03-10T16:40:36.479130+0000 mgr.gibba045.orlgmj (mgr.34412) 9058 : cluster [DBG] pgmap v5163: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:37.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:40:37 gibba015 bash[29377]: cluster 2021-03-10T16:40:36.479130+0000 mgr.gibba045.orlgmj (mgr.34412) 9058 : cluster [DBG] pgmap v5163: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:37.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:40:37 gibba015 bash[30343]: cluster 2021-03-10T16:40:36.479130+0000 mgr.gibba045.orlgmj (mgr.34412) 9058 : cluster [DBG] pgmap v5163: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:38.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:40:38 gibba045 bash[25517]: audit 2021-03-10T16:40:37.990772+0000 mon.c (mon.1) 2496 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:40:38.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:40:38 gibba045 bash[25517]: audit 2021-03-10T16:40:38.201001+0000 mon.a (mon.0) 2007 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:40:38.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:40:38 gibba045 bash[25517]: audit 2021-03-10T16:40:38.204595+0000 mon.c (mon.1) 2497 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:40:38.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:40:38 gibba045 bash[25517]: audit 2021-03-10T16:40:38.205963+0000 mon.c (mon.1) 2498 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:40:38.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:40:38 gibba045 bash[25517]: audit 2021-03-10T16:40:38.207295+0000 mon.c (mon.1) 2499 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:40:38.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:40:38 gibba045 bash[25517]: audit 2021-03-10T16:40:38.208253+0000 mon.c (mon.1) 2500 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:40:38.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:40:38 gibba045 bash[25517]: audit 2021-03-10T16:40:38.210986+0000 mon.c (mon.1) 2501 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:40:38.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:40:38 gibba045 bash[25517]: audit 2021-03-10T16:40:38.212272+0000 mon.c (mon.1) 2502 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:40:38.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:40:38 gibba015 bash[29377]: audit 2021-03-10T16:40:37.990772+0000 mon.c (mon.1) 2496 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:40:38.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:40:38 gibba015 bash[29377]: audit 2021-03-10T16:40:38.201001+0000 mon.a (mon.0) 2007 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:40:38.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:40:38 gibba015 bash[29377]: audit 2021-03-10T16:40:38.204595+0000 mon.c (mon.1) 2497 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:40:38.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:40:38 gibba015 bash[29377]: audit 2021-03-10T16:40:38.205963+0000 mon.c (mon.1) 2498 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:40:38.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:40:38 gibba015 bash[29377]: audit 2021-03-10T16:40:38.207295+0000 mon.c (mon.1) 2499 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:40:38.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:40:38 gibba015 bash[29377]: audit 2021-03-10T16:40:38.208253+0000 mon.c (mon.1) 2500 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:40:38.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:40:38 gibba015 bash[29377]: audit 2021-03-10T16:40:38.210986+0000 mon.c (mon.1) 2501 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:40:38.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:40:38 gibba015 bash[29377]: audit 2021-03-10T16:40:38.212272+0000 mon.c (mon.1) 2502 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:40:38.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:40:38 gibba015 bash[30343]: audit 2021-03-10T16:40:37.990772+0000 mon.c (mon.1) 2496 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:40:38.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:40:38 gibba015 bash[30343]: audit 2021-03-10T16:40:38.201001+0000 mon.a (mon.0) 2007 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:40:38.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:40:38 gibba015 bash[30343]: audit 2021-03-10T16:40:38.204595+0000 mon.c (mon.1) 2497 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:40:38.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:40:38 gibba015 bash[30343]: audit 2021-03-10T16:40:38.205963+0000 mon.c (mon.1) 2498 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:40:38.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:40:38 gibba015 bash[30343]: audit 2021-03-10T16:40:38.207295+0000 mon.c (mon.1) 2499 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:40:38.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:40:38 gibba015 bash[30343]: audit 2021-03-10T16:40:38.208253+0000 mon.c (mon.1) 2500 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:40:38.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:40:38 gibba015 bash[30343]: audit 2021-03-10T16:40:38.210986+0000 mon.c (mon.1) 2501 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:40:38.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:40:38 gibba015 bash[30343]: audit 2021-03-10T16:40:38.212272+0000 mon.c (mon.1) 2502 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:40:39.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:40:39 gibba045 bash[25517]: cephadm 2021-03-10T16:40:37.996334+0000 mgr.gibba045.orlgmj (mgr.34412) 9059 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:40:39.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:40:39 gibba045 bash[25517]: cephadm 2021-03-10T16:40:37.996862+0000 mgr.gibba045.orlgmj (mgr.34412) 9060 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:40:39.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:40:39 gibba045 bash[25517]: cephadm 2021-03-10T16:40:38.206486+0000 mgr.gibba045.orlgmj (mgr.34412) 9061 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:40:39.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:40:39 gibba045 bash[25517]: cephadm 2021-03-10T16:40:38.208079+0000 mgr.gibba045.orlgmj (mgr.34412) 9062 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:40:39.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:40:39 gibba045 bash[25517]: cephadm 2021-03-10T16:40:38.209549+0000 mgr.gibba045.orlgmj (mgr.34412) 9063 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:40:39.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:40:39 gibba045 bash[25517]: cephadm 2021-03-10T16:40:38.209585+0000 mgr.gibba045.orlgmj (mgr.34412) 9064 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:40:39.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:40:39 gibba045 bash[25517]: cephadm 2021-03-10T16:40:38.210613+0000 mgr.gibba045.orlgmj (mgr.34412) 9065 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:40:39.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:40:39 gibba045 bash[25517]: cephadm 2021-03-10T16:40:38.210648+0000 mgr.gibba045.orlgmj (mgr.34412) 9066 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:40:39.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:40:39 gibba045 bash[25517]: cephadm 2021-03-10T16:40:38.211522+0000 mgr.gibba045.orlgmj (mgr.34412) 9067 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:40:39.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:40:39 gibba045 bash[25517]: cephadm 2021-03-10T16:40:38.213059+0000 mgr.gibba045.orlgmj (mgr.34412) 9068 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:40:39.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:40:39 gibba045 bash[25517]: cephadm 2021-03-10T16:40:38.213094+0000 mgr.gibba045.orlgmj (mgr.34412) 9069 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:40:39.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:40:39 gibba045 bash[25517]: cephadm 2021-03-10T16:40:38.214337+0000 mgr.gibba045.orlgmj (mgr.34412) 9070 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:40:39.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:40:39 gibba045 bash[25517]: cephadm 2021-03-10T16:40:38.214667+0000 mgr.gibba045.orlgmj (mgr.34412) 9071 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:40:39.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:40:39 gibba045 bash[25517]: cephadm 2021-03-10T16:40:38.215523+0000 mgr.gibba045.orlgmj (mgr.34412) 9072 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:40:39.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:40:39 gibba045 bash[25517]: cephadm 2021-03-10T16:40:38.215558+0000 mgr.gibba045.orlgmj (mgr.34412) 9073 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:40:39.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:40:39 gibba045 bash[25517]: cephadm 2021-03-10T16:40:38.215670+0000 mgr.gibba045.orlgmj (mgr.34412) 9074 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:40:39.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:40:39 gibba045 bash[25517]: cluster 2021-03-10T16:40:38.480153+0000 mgr.gibba045.orlgmj (mgr.34412) 9075 : cluster [DBG] pgmap v5164: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:39.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:40:39 gibba015 bash[29377]: cephadm 2021-03-10T16:40:37.996334+0000 mgr.gibba045.orlgmj (mgr.34412) 9059 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:40:39.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:40:39 gibba015 bash[29377]: cephadm 2021-03-10T16:40:37.996862+0000 mgr.gibba045.orlgmj (mgr.34412) 9060 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:40:39.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:40:39 gibba015 bash[29377]: cephadm 2021-03-10T16:40:38.206486+0000 mgr.gibba045.orlgmj (mgr.34412) 9061 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:40:39.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:40:39 gibba015 bash[29377]: cephadm 2021-03-10T16:40:38.208079+0000 mgr.gibba045.orlgmj (mgr.34412) 9062 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:40:39.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:40:39 gibba015 bash[29377]: cephadm 2021-03-10T16:40:38.209549+0000 mgr.gibba045.orlgmj (mgr.34412) 9063 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:40:39.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:40:39 gibba015 bash[29377]: cephadm 2021-03-10T16:40:38.209585+0000 mgr.gibba045.orlgmj (mgr.34412) 9064 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:40:39.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:40:39 gibba015 bash[29377]: cephadm 2021-03-10T16:40:38.210613+0000 mgr.gibba045.orlgmj (mgr.34412) 9065 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:40:39.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:40:39 gibba015 bash[29377]: cephadm 2021-03-10T16:40:38.210648+0000 mgr.gibba045.orlgmj (mgr.34412) 9066 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:40:39.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:40:39 gibba015 bash[29377]: cephadm 2021-03-10T16:40:38.211522+0000 mgr.gibba045.orlgmj (mgr.34412) 9067 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:40:39.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:40:39 gibba015 bash[29377]: cephadm 2021-03-10T16:40:38.213059+0000 mgr.gibba045.orlgmj (mgr.34412) 9068 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:40:39.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:40:39 gibba015 bash[29377]: cephadm 2021-03-10T16:40:38.213094+0000 mgr.gibba045.orlgmj (mgr.34412) 9069 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:40:39.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:40:39 gibba015 bash[29377]: cephadm 2021-03-10T16:40:38.214337+0000 mgr.gibba045.orlgmj (mgr.34412) 9070 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:40:39.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:40:39 gibba015 bash[29377]: cephadm 2021-03-10T16:40:38.214667+0000 mgr.gibba045.orlgmj (mgr.34412) 9071 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:40:39.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:40:39 gibba015 bash[29377]: cephadm 2021-03-10T16:40:38.215523+0000 mgr.gibba045.orlgmj (mgr.34412) 9072 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:40:39.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:40:39 gibba015 bash[29377]: cephadm 2021-03-10T16:40:38.215558+0000 mgr.gibba045.orlgmj (mgr.34412) 9073 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:40:39.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:40:39 gibba015 bash[29377]: cephadm 2021-03-10T16:40:38.215670+0000 mgr.gibba045.orlgmj (mgr.34412) 9074 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:40:39.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:40:39 gibba015 bash[29377]: cluster 2021-03-10T16:40:38.480153+0000 mgr.gibba045.orlgmj (mgr.34412) 9075 : cluster [DBG] pgmap v5164: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:39.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:40:39 gibba015 bash[30343]: cephadm 2021-03-10T16:40:37.996334+0000 mgr.gibba045.orlgmj (mgr.34412) 9059 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:40:39.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:40:39 gibba015 bash[30343]: cephadm 2021-03-10T16:40:37.996862+0000 mgr.gibba045.orlgmj (mgr.34412) 9060 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:40:39.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:40:39 gibba015 bash[30343]: cephadm 2021-03-10T16:40:38.206486+0000 mgr.gibba045.orlgmj (mgr.34412) 9061 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:40:39.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:40:39 gibba015 bash[30343]: cephadm 2021-03-10T16:40:38.208079+0000 mgr.gibba045.orlgmj (mgr.34412) 9062 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:40:39.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:40:39 gibba015 bash[30343]: cephadm 2021-03-10T16:40:38.209549+0000 mgr.gibba045.orlgmj (mgr.34412) 9063 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:40:39.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:40:39 gibba015 bash[30343]: cephadm 2021-03-10T16:40:38.209585+0000 mgr.gibba045.orlgmj (mgr.34412) 9064 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:40:39.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:40:39 gibba015 bash[30343]: cephadm 2021-03-10T16:40:38.210613+0000 mgr.gibba045.orlgmj (mgr.34412) 9065 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:40:39.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:40:39 gibba015 bash[30343]: cephadm 2021-03-10T16:40:38.210648+0000 mgr.gibba045.orlgmj (mgr.34412) 9066 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:40:39.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:40:39 gibba015 bash[30343]: cephadm 2021-03-10T16:40:38.211522+0000 mgr.gibba045.orlgmj (mgr.34412) 9067 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:40:39.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:40:39 gibba015 bash[30343]: cephadm 2021-03-10T16:40:38.213059+0000 mgr.gibba045.orlgmj (mgr.34412) 9068 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:40:39.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:40:39 gibba015 bash[30343]: cephadm 2021-03-10T16:40:38.213094+0000 mgr.gibba045.orlgmj (mgr.34412) 9069 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:40:39.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:40:39 gibba015 bash[30343]: cephadm 2021-03-10T16:40:38.214337+0000 mgr.gibba045.orlgmj (mgr.34412) 9070 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:40:39.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:40:39 gibba015 bash[30343]: cephadm 2021-03-10T16:40:38.214667+0000 mgr.gibba045.orlgmj (mgr.34412) 9071 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:40:39.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:40:39 gibba015 bash[30343]: cephadm 2021-03-10T16:40:38.215523+0000 mgr.gibba045.orlgmj (mgr.34412) 9072 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:40:39.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:40:39 gibba015 bash[30343]: cephadm 2021-03-10T16:40:38.215558+0000 mgr.gibba045.orlgmj (mgr.34412) 9073 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:40:39.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:40:39 gibba015 bash[30343]: cephadm 2021-03-10T16:40:38.215670+0000 mgr.gibba045.orlgmj (mgr.34412) 9074 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:40:39.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:40:39 gibba015 bash[30343]: cluster 2021-03-10T16:40:38.480153+0000 mgr.gibba045.orlgmj (mgr.34412) 9075 : cluster [DBG] pgmap v5164: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:41.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:40:41 gibba045 bash[25517]: cluster 2021-03-10T16:40:40.481521+0000 mgr.gibba045.orlgmj (mgr.34412) 9076 : cluster [DBG] pgmap v5165: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:41.929 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:40:41.968 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:40:41 gibba015 bash[29377]: cluster 2021-03-10T16:40:40.481521+0000 mgr.gibba045.orlgmj (mgr.34412) 9076 : cluster [DBG] pgmap v5165: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:41.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:40:41 gibba015 bash[30343]: cluster 2021-03-10T16:40:40.481521+0000 mgr.gibba045.orlgmj (mgr.34412) 9076 : cluster [DBG] pgmap v5165: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:42.152 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:40:42.152 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 4m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:40:42.152 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 3m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:40:42.153 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:40:42.153 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:40:42.153 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:40:42.153 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:40:42.153 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:40:42.154 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:40:42.154 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 4m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:40:42.154 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 3m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:40:42.154 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:40:42.155 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:40:42.155 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:40:42.155 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:40:42.155 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:40:42.155 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:40:42.156 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:40:42.156 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:40:42.156 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 3m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:40:42.156 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 3m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:40:42.400 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:40:42.400 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:40:42.401 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:40:42.401 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:40:42.401 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:40:42.402 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:40:42.402 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:40:42.403 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:40:42.403 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:40:42.403 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:40:42.404 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:40:42.404 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:40:42.405 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:40:42.405 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:40:42.405 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:40:42.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:40:42 gibba045 bash[25517]: audit 2021-03-10T16:40:42.400632+0000 mon.a (mon.0) 2008 : audit [DBG] from='client.? 172.21.2.115:0/1218744317' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:40:42.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:40:42 gibba015 bash[29377]: audit 2021-03-10T16:40:42.400632+0000 mon.a (mon.0) 2008 : audit [DBG] from='client.? 172.21.2.115:0/1218744317' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:40:42.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:40:42 gibba015 bash[30343]: audit 2021-03-10T16:40:42.400632+0000 mon.a (mon.0) 2008 : audit [DBG] from='client.? 172.21.2.115:0/1218744317' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:40:43.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:40:43 gibba045 bash[25517]: audit 2021-03-10T16:40:41.923592+0000 mgr.gibba045.orlgmj (mgr.34412) 9077 : audit [DBG] from='client.50136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:40:43.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:40:43 gibba045 bash[25517]: audit 2021-03-10T16:40:42.146529+0000 mgr.gibba045.orlgmj (mgr.34412) 9078 : audit [DBG] from='client.50142 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:40:43.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:40:43 gibba045 bash[25517]: cluster 2021-03-10T16:40:42.483224+0000 mgr.gibba045.orlgmj (mgr.34412) 9079 : cluster [DBG] pgmap v5166: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:43.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:40:43 gibba015 bash[29377]: audit 2021-03-10T16:40:41.923592+0000 mgr.gibba045.orlgmj (mgr.34412) 9077 : audit [DBG] from='client.50136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:40:43.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:40:43 gibba015 bash[29377]: audit 2021-03-10T16:40:42.146529+0000 mgr.gibba045.orlgmj (mgr.34412) 9078 : audit [DBG] from='client.50142 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:40:43.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:40:43 gibba015 bash[29377]: cluster 2021-03-10T16:40:42.483224+0000 mgr.gibba045.orlgmj (mgr.34412) 9079 : cluster [DBG] pgmap v5166: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:43.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:40:43 gibba015 bash[30343]: audit 2021-03-10T16:40:41.923592+0000 mgr.gibba045.orlgmj (mgr.34412) 9077 : audit [DBG] from='client.50136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:40:43.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:40:43 gibba015 bash[30343]: audit 2021-03-10T16:40:42.146529+0000 mgr.gibba045.orlgmj (mgr.34412) 9078 : audit [DBG] from='client.50142 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:40:43.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:40:43 gibba015 bash[30343]: cluster 2021-03-10T16:40:42.483224+0000 mgr.gibba045.orlgmj (mgr.34412) 9079 : cluster [DBG] pgmap v5166: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:45.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:40:45 gibba045 bash[25517]: cluster 2021-03-10T16:40:44.484761+0000 mgr.gibba045.orlgmj (mgr.34412) 9080 : cluster [DBG] pgmap v5167: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:45.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:40:45 gibba015 bash[29377]: cluster 2021-03-10T16:40:44.484761+0000 mgr.gibba045.orlgmj (mgr.34412) 9080 : cluster [DBG] pgmap v5167: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:45.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:40:45 gibba015 bash[30343]: cluster 2021-03-10T16:40:44.484761+0000 mgr.gibba045.orlgmj (mgr.34412) 9080 : cluster [DBG] pgmap v5167: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:47.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:40:47 gibba045 bash[25517]: cluster 2021-03-10T16:40:46.486701+0000 mgr.gibba045.orlgmj (mgr.34412) 9081 : cluster [DBG] pgmap v5168: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:47.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:40:47 gibba015 bash[29377]: cluster 2021-03-10T16:40:46.486701+0000 mgr.gibba045.orlgmj (mgr.34412) 9081 : cluster [DBG] pgmap v5168: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:47.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:40:47 gibba015 bash[30343]: cluster 2021-03-10T16:40:46.486701+0000 mgr.gibba045.orlgmj (mgr.34412) 9081 : cluster [DBG] pgmap v5168: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:49.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:40:49 gibba045 bash[25517]: cluster 2021-03-10T16:40:48.487844+0000 mgr.gibba045.orlgmj (mgr.34412) 9082 : cluster [DBG] pgmap v5169: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:49.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:40:49 gibba015 bash[29377]: cluster 2021-03-10T16:40:48.487844+0000 mgr.gibba045.orlgmj (mgr.34412) 9082 : cluster [DBG] pgmap v5169: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:49.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:40:49 gibba015 bash[30343]: cluster 2021-03-10T16:40:48.487844+0000 mgr.gibba045.orlgmj (mgr.34412) 9082 : cluster [DBG] pgmap v5169: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:51.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:40:51 gibba015 bash[29377]: cluster 2021-03-10T16:40:50.489464+0000 mgr.gibba045.orlgmj (mgr.34412) 9083 : cluster [DBG] pgmap v5170: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:51.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:40:51 gibba015 bash[30343]: cluster 2021-03-10T16:40:50.489464+0000 mgr.gibba045.orlgmj (mgr.34412) 9083 : cluster [DBG] pgmap v5170: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:52.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:40:51 gibba045 bash[25517]: cluster 2021-03-10T16:40:50.489464+0000 mgr.gibba045.orlgmj (mgr.34412) 9083 : cluster [DBG] pgmap v5170: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:53.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:40:53 gibba015 bash[29377]: cluster 2021-03-10T16:40:52.491214+0000 mgr.gibba045.orlgmj (mgr.34412) 9084 : cluster [DBG] pgmap v5171: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:53.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:40:53 gibba015 bash[30343]: cluster 2021-03-10T16:40:52.491214+0000 mgr.gibba045.orlgmj (mgr.34412) 9084 : cluster [DBG] pgmap v5171: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:54.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:40:53 gibba045 bash[25517]: cluster 2021-03-10T16:40:52.491214+0000 mgr.gibba045.orlgmj (mgr.34412) 9084 : cluster [DBG] pgmap v5171: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:54.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:40:54 gibba015 bash[29377]: cephadm 2021-03-10T16:40:53.231663+0000 mgr.gibba045.orlgmj (mgr.34412) 9085 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:40:54.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:40:54 gibba015 bash[29377]: audit 2021-03-10T16:40:53.690329+0000 mon.c (mon.1) 2503 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:40:54.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:40:54 gibba015 bash[29377]: audit 2021-03-10T16:40:53.690947+0000 mon.c (mon.1) 2504 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:40:54.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:40:54 gibba015 bash[29377]: audit 2021-03-10T16:40:53.691415+0000 mon.a (mon.0) 2009 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:40:54.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:40:54 gibba015 bash[29377]: audit 2021-03-10T16:40:53.692578+0000 mon.a (mon.0) 2010 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:40:54.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:40:54 gibba015 bash[29377]: audit 2021-03-10T16:40:53.705782+0000 mon.c (mon.1) 2505 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T16:40:54.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:40:54 gibba015 bash[29377]: audit 2021-03-10T16:40:53.706498+0000 mon.c (mon.1) 2506 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:40:54.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:40:54 gibba015 bash[29377]: audit 2021-03-10T16:40:53.707014+0000 mon.a (mon.0) 2011 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T16:40:54.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:40:54 gibba015 bash[29377]: audit 2021-03-10T16:40:53.707154+0000 mon.c (mon.1) 2507 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:40:54.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:40:54 gibba015 bash[29377]: audit 2021-03-10T16:40:53.707842+0000 mon.c (mon.1) 2508 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:40:54.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:40:54 gibba015 bash[29377]: audit 2021-03-10T16:40:53.708271+0000 mon.a (mon.0) 2012 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:40:54.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:40:54 gibba015 bash[29377]: audit 2021-03-10T16:40:53.709815+0000 mon.a (mon.0) 2013 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:40:54.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:40:54 gibba015 bash[29377]: audit 2021-03-10T16:40:53.710737+0000 mon.a (mon.0) 2014 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:40:54.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:40:54 gibba015 bash[30343]: cephadm 2021-03-10T16:40:53.231663+0000 mgr.gibba045.orlgmj (mgr.34412) 9085 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:40:54.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:40:54 gibba015 bash[30343]: audit 2021-03-10T16:40:53.690329+0000 mon.c (mon.1) 2503 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:40:54.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:40:54 gibba015 bash[30343]: audit 2021-03-10T16:40:53.690947+0000 mon.c (mon.1) 2504 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:40:54.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:40:54 gibba015 bash[30343]: audit 2021-03-10T16:40:53.691415+0000 mon.a (mon.0) 2009 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:40:55.004 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:40:54 gibba015 bash[30343]: audit 2021-03-10T16:40:53.692578+0000 mon.a (mon.0) 2010 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:40:55.004 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:40:54 gibba015 bash[30343]: audit 2021-03-10T16:40:53.705782+0000 mon.c (mon.1) 2505 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T16:40:55.005 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:40:54 gibba015 bash[30343]: audit 2021-03-10T16:40:53.706498+0000 mon.c (mon.1) 2506 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:40:55.005 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:40:54 gibba015 bash[30343]: audit 2021-03-10T16:40:53.707014+0000 mon.a (mon.0) 2011 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T16:40:55.007 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:40:54 gibba015 bash[30343]: audit 2021-03-10T16:40:53.707154+0000 mon.c (mon.1) 2507 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:40:55.021 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:40:54 gibba015 bash[30343]: audit 2021-03-10T16:40:53.707842+0000 mon.c (mon.1) 2508 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:40:55.021 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:40:54 gibba015 bash[30343]: audit 2021-03-10T16:40:53.708271+0000 mon.a (mon.0) 2012 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:40:55.021 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:40:54 gibba015 bash[30343]: audit 2021-03-10T16:40:53.709815+0000 mon.a (mon.0) 2013 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:40:55.021 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:40:54 gibba015 bash[30343]: audit 2021-03-10T16:40:53.710737+0000 mon.a (mon.0) 2014 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:40:55.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:40:54 gibba045 bash[25517]: cephadm 2021-03-10T16:40:53.231663+0000 mgr.gibba045.orlgmj (mgr.34412) 9085 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:40:55.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:40:54 gibba045 bash[25517]: audit 2021-03-10T16:40:53.690329+0000 mon.c (mon.1) 2503 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:40:55.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:40:54 gibba045 bash[25517]: audit 2021-03-10T16:40:53.690947+0000 mon.c (mon.1) 2504 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:40:55.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:40:54 gibba045 bash[25517]: audit 2021-03-10T16:40:53.691415+0000 mon.a (mon.0) 2009 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:40:55.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:40:54 gibba045 bash[25517]: audit 2021-03-10T16:40:53.692578+0000 mon.a (mon.0) 2010 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:40:55.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:40:54 gibba045 bash[25517]: audit 2021-03-10T16:40:53.705782+0000 mon.c (mon.1) 2505 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T16:40:55.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:40:54 gibba045 bash[25517]: audit 2021-03-10T16:40:53.706498+0000 mon.c (mon.1) 2506 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:40:55.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:40:54 gibba045 bash[25517]: audit 2021-03-10T16:40:53.707014+0000 mon.a (mon.0) 2011 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T16:40:55.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:40:54 gibba045 bash[25517]: audit 2021-03-10T16:40:53.707154+0000 mon.c (mon.1) 2507 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:40:55.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:40:54 gibba045 bash[25517]: audit 2021-03-10T16:40:53.707842+0000 mon.c (mon.1) 2508 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:40:55.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:40:54 gibba045 bash[25517]: audit 2021-03-10T16:40:53.708271+0000 mon.a (mon.0) 2012 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:40:55.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:40:54 gibba045 bash[25517]: audit 2021-03-10T16:40:53.709815+0000 mon.a (mon.0) 2013 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:40:55.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:40:54 gibba045 bash[25517]: audit 2021-03-10T16:40:53.710737+0000 mon.a (mon.0) 2014 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:40:55.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:40:55 gibba015 bash[29377]: cluster 2021-03-10T16:40:54.492718+0000 mgr.gibba045.orlgmj (mgr.34412) 9086 : cluster [DBG] pgmap v5172: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:55.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:40:55 gibba015 bash[30343]: cluster 2021-03-10T16:40:54.492718+0000 mgr.gibba045.orlgmj (mgr.34412) 9086 : cluster [DBG] pgmap v5172: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:56.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:40:55 gibba045 bash[25517]: cluster 2021-03-10T16:40:54.492718+0000 mgr.gibba045.orlgmj (mgr.34412) 9086 : cluster [DBG] pgmap v5172: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:57.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:40:57 gibba045 bash[25517]: cluster 2021-03-10T16:40:56.493427+0000 mgr.gibba045.orlgmj (mgr.34412) 9087 : cluster [DBG] pgmap v5173: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:57.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:40:57 gibba015 bash[29377]: cluster 2021-03-10T16:40:56.493427+0000 mgr.gibba045.orlgmj (mgr.34412) 9087 : cluster [DBG] pgmap v5173: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:57.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:40:57 gibba015 bash[30343]: cluster 2021-03-10T16:40:56.493427+0000 mgr.gibba045.orlgmj (mgr.34412) 9087 : cluster [DBG] pgmap v5173: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:59.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:40:59 gibba015 bash[29377]: cluster 2021-03-10T16:40:58.494629+0000 mgr.gibba045.orlgmj (mgr.34412) 9088 : cluster [DBG] pgmap v5174: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:59.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:40:59 gibba015 bash[30343]: cluster 2021-03-10T16:40:58.494629+0000 mgr.gibba045.orlgmj (mgr.34412) 9088 : cluster [DBG] pgmap v5174: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:00.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:40:59 gibba045 bash[25517]: cluster 2021-03-10T16:40:58.494629+0000 mgr.gibba045.orlgmj (mgr.34412) 9088 : cluster [DBG] pgmap v5174: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:01.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:41:01 gibba015 bash[29377]: cluster 2021-03-10T16:41:00.496136+0000 mgr.gibba045.orlgmj (mgr.34412) 9089 : cluster [DBG] pgmap v5175: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:01.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:41:01 gibba015 bash[30343]: cluster 2021-03-10T16:41:00.496136+0000 mgr.gibba045.orlgmj (mgr.34412) 9089 : cluster [DBG] pgmap v5175: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:02.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:41:01 gibba045 bash[25517]: cluster 2021-03-10T16:41:00.496136+0000 mgr.gibba045.orlgmj (mgr.34412) 9089 : cluster [DBG] pgmap v5175: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:03.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:41:03 gibba015 bash[29377]: cluster 2021-03-10T16:41:02.497926+0000 mgr.gibba045.orlgmj (mgr.34412) 9090 : cluster [DBG] pgmap v5176: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:03.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:41:03 gibba015 bash[30343]: cluster 2021-03-10T16:41:02.497926+0000 mgr.gibba045.orlgmj (mgr.34412) 9090 : cluster [DBG] pgmap v5176: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:04.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:41:03 gibba045 bash[25517]: cluster 2021-03-10T16:41:02.497926+0000 mgr.gibba045.orlgmj (mgr.34412) 9090 : cluster [DBG] pgmap v5176: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:05.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:41:05 gibba015 bash[29377]: cluster 2021-03-10T16:41:04.499272+0000 mgr.gibba045.orlgmj (mgr.34412) 9091 : cluster [DBG] pgmap v5177: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:05.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:41:05 gibba015 bash[30343]: cluster 2021-03-10T16:41:04.499272+0000 mgr.gibba045.orlgmj (mgr.34412) 9091 : cluster [DBG] pgmap v5177: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:06.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:41:05 gibba045 bash[25517]: cluster 2021-03-10T16:41:04.499272+0000 mgr.gibba045.orlgmj (mgr.34412) 9091 : cluster [DBG] pgmap v5177: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:07.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:41:07 gibba045 bash[25517]: cluster 2021-03-10T16:41:06.500156+0000 mgr.gibba045.orlgmj (mgr.34412) 9092 : cluster [DBG] pgmap v5178: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:07.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:41:07 gibba015 bash[29377]: cluster 2021-03-10T16:41:06.500156+0000 mgr.gibba045.orlgmj (mgr.34412) 9092 : cluster [DBG] pgmap v5178: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:07.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:41:07 gibba015 bash[30343]: cluster 2021-03-10T16:41:06.500156+0000 mgr.gibba045.orlgmj (mgr.34412) 9092 : cluster [DBG] pgmap v5178: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:09.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:41:09 gibba015 bash[29377]: cephadm 2021-03-10T16:41:08.233421+0000 mgr.gibba045.orlgmj (mgr.34412) 9093 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:41:09.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:41:09 gibba015 bash[29377]: cluster 2021-03-10T16:41:08.501170+0000 mgr.gibba045.orlgmj (mgr.34412) 9094 : cluster [DBG] pgmap v5179: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:09.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:41:09 gibba015 bash[30343]: cephadm 2021-03-10T16:41:08.233421+0000 mgr.gibba045.orlgmj (mgr.34412) 9093 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:41:09.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:41:09 gibba015 bash[30343]: cluster 2021-03-10T16:41:08.501170+0000 mgr.gibba045.orlgmj (mgr.34412) 9094 : cluster [DBG] pgmap v5179: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:10.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:41:09 gibba045 bash[25517]: cephadm 2021-03-10T16:41:08.233421+0000 mgr.gibba045.orlgmj (mgr.34412) 9093 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:41:10.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:41:09 gibba045 bash[25517]: cluster 2021-03-10T16:41:08.501170+0000 mgr.gibba045.orlgmj (mgr.34412) 9094 : cluster [DBG] pgmap v5179: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:11.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:41:11 gibba015 bash[29377]: cluster 2021-03-10T16:41:10.502768+0000 mgr.gibba045.orlgmj (mgr.34412) 9095 : cluster [DBG] pgmap v5180: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:11.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:41:11 gibba015 bash[30343]: cluster 2021-03-10T16:41:10.502768+0000 mgr.gibba045.orlgmj (mgr.34412) 9095 : cluster [DBG] pgmap v5180: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:12.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:41:11 gibba045 bash[25517]: cluster 2021-03-10T16:41:10.502768+0000 mgr.gibba045.orlgmj (mgr.34412) 9095 : cluster [DBG] pgmap v5180: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:12.641 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:41:12.869 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:41:12.870 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 4m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:41:12.870 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 3m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:41:12.870 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:41:12.871 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:41:12.871 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:41:12.871 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:41:12.871 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:41:12.872 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:41:12.872 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 4m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:41:12.872 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 3m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:41:12.872 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:41:12.872 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:41:12.873 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:41:12.873 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:41:12.873 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:41:12.874 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:41:12.874 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:41:12.874 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:41:12.875 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 3m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:41:12.879 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 3m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:41:13.121 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:41:13.121 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:41:13.122 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:41:13.122 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:41:13.123 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:41:13.123 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:41:13.123 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:41:13.124 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:41:13.124 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:41:13.125 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:41:13.125 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:41:13.125 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:41:13.126 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:41:13.128 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:41:13.128 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:41:13.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:41:13 gibba015 bash[29377]: cluster 2021-03-10T16:41:12.504389+0000 mgr.gibba045.orlgmj (mgr.34412) 9096 : cluster [DBG] pgmap v5181: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:13.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:41:13 gibba015 bash[29377]: audit 2021-03-10T16:41:12.636098+0000 mgr.gibba045.orlgmj (mgr.34412) 9097 : audit [DBG] from='client.50154 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:41:13.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:41:13 gibba015 bash[29377]: audit 2021-03-10T16:41:13.120079+0000 mon.a (mon.0) 2015 : audit [DBG] from='client.? 172.21.2.115:0/1271066377' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:41:13.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:41:13 gibba015 bash[30343]: cluster 2021-03-10T16:41:12.504389+0000 mgr.gibba045.orlgmj (mgr.34412) 9096 : cluster [DBG] pgmap v5181: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:13.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:41:13 gibba015 bash[30343]: audit 2021-03-10T16:41:12.636098+0000 mgr.gibba045.orlgmj (mgr.34412) 9097 : audit [DBG] from='client.50154 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:41:13.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:41:13 gibba015 bash[30343]: audit 2021-03-10T16:41:13.120079+0000 mon.a (mon.0) 2015 : audit [DBG] from='client.? 172.21.2.115:0/1271066377' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:41:14.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:41:13 gibba045 bash[25517]: cluster 2021-03-10T16:41:12.504389+0000 mgr.gibba045.orlgmj (mgr.34412) 9096 : cluster [DBG] pgmap v5181: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:14.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:41:13 gibba045 bash[25517]: audit 2021-03-10T16:41:12.636098+0000 mgr.gibba045.orlgmj (mgr.34412) 9097 : audit [DBG] from='client.50154 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:41:14.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:41:13 gibba045 bash[25517]: audit 2021-03-10T16:41:13.120079+0000 mon.a (mon.0) 2015 : audit [DBG] from='client.? 172.21.2.115:0/1271066377' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:41:14.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:41:14 gibba015 bash[29377]: audit 2021-03-10T16:41:12.860980+0000 mgr.gibba045.orlgmj (mgr.34412) 9098 : audit [DBG] from='client.60148 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:41:14.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:41:14 gibba015 bash[30343]: audit 2021-03-10T16:41:12.860980+0000 mgr.gibba045.orlgmj (mgr.34412) 9098 : audit [DBG] from='client.60148 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:41:15.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:41:14 gibba045 bash[25517]: audit 2021-03-10T16:41:12.860980+0000 mgr.gibba045.orlgmj (mgr.34412) 9098 : audit [DBG] from='client.60148 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:41:15.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:41:15 gibba015 bash[29377]: cluster 2021-03-10T16:41:14.505611+0000 mgr.gibba045.orlgmj (mgr.34412) 9099 : cluster [DBG] pgmap v5182: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:15.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:41:15 gibba015 bash[30343]: cluster 2021-03-10T16:41:14.505611+0000 mgr.gibba045.orlgmj (mgr.34412) 9099 : cluster [DBG] pgmap v5182: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:16.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:41:15 gibba045 bash[25517]: cluster 2021-03-10T16:41:14.505611+0000 mgr.gibba045.orlgmj (mgr.34412) 9099 : cluster [DBG] pgmap v5182: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:17.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:41:17 gibba045 bash[25517]: cluster 2021-03-10T16:41:16.506536+0000 mgr.gibba045.orlgmj (mgr.34412) 9100 : cluster [DBG] pgmap v5183: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:17.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:41:17 gibba015 bash[29377]: cluster 2021-03-10T16:41:16.506536+0000 mgr.gibba045.orlgmj (mgr.34412) 9100 : cluster [DBG] pgmap v5183: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:17.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:41:17 gibba015 bash[30343]: cluster 2021-03-10T16:41:16.506536+0000 mgr.gibba045.orlgmj (mgr.34412) 9100 : cluster [DBG] pgmap v5183: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:19.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:41:19 gibba015 bash[29377]: cluster 2021-03-10T16:41:18.507724+0000 mgr.gibba045.orlgmj (mgr.34412) 9101 : cluster [DBG] pgmap v5184: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:19.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:41:19 gibba015 bash[30343]: cluster 2021-03-10T16:41:18.507724+0000 mgr.gibba045.orlgmj (mgr.34412) 9101 : cluster [DBG] pgmap v5184: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:20.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:41:19 gibba045 bash[25517]: cluster 2021-03-10T16:41:18.507724+0000 mgr.gibba045.orlgmj (mgr.34412) 9101 : cluster [DBG] pgmap v5184: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:21.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:41:21 gibba015 bash[29377]: cluster 2021-03-10T16:41:20.509279+0000 mgr.gibba045.orlgmj (mgr.34412) 9102 : cluster [DBG] pgmap v5185: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:21.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:41:21 gibba015 bash[30343]: cluster 2021-03-10T16:41:20.509279+0000 mgr.gibba045.orlgmj (mgr.34412) 9102 : cluster [DBG] pgmap v5185: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:22.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:41:21 gibba045 bash[25517]: cluster 2021-03-10T16:41:20.509279+0000 mgr.gibba045.orlgmj (mgr.34412) 9102 : cluster [DBG] pgmap v5185: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:23.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:41:23 gibba015 bash[29377]: cluster 2021-03-10T16:41:22.511019+0000 mgr.gibba045.orlgmj (mgr.34412) 9103 : cluster [DBG] pgmap v5186: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:23.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:41:23 gibba015 bash[30343]: cluster 2021-03-10T16:41:22.511019+0000 mgr.gibba045.orlgmj (mgr.34412) 9103 : cluster [DBG] pgmap v5186: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:24.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:41:23 gibba045 bash[25517]: cluster 2021-03-10T16:41:22.511019+0000 mgr.gibba045.orlgmj (mgr.34412) 9103 : cluster [DBG] pgmap v5186: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:24.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:41:24 gibba015 bash[29377]: cephadm 2021-03-10T16:41:23.249537+0000 mgr.gibba045.orlgmj (mgr.34412) 9104 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:41:24.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:41:24 gibba015 bash[30343]: cephadm 2021-03-10T16:41:23.249537+0000 mgr.gibba045.orlgmj (mgr.34412) 9104 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:41:25.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:41:24 gibba045 bash[25517]: cephadm 2021-03-10T16:41:23.249537+0000 mgr.gibba045.orlgmj (mgr.34412) 9104 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:41:25.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:41:25 gibba015 bash[29377]: cluster 2021-03-10T16:41:24.512229+0000 mgr.gibba045.orlgmj (mgr.34412) 9105 : cluster [DBG] pgmap v5187: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:25.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:41:25 gibba015 bash[30343]: cluster 2021-03-10T16:41:24.512229+0000 mgr.gibba045.orlgmj (mgr.34412) 9105 : cluster [DBG] pgmap v5187: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:26.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:41:25 gibba045 bash[25517]: cluster 2021-03-10T16:41:24.512229+0000 mgr.gibba045.orlgmj (mgr.34412) 9105 : cluster [DBG] pgmap v5187: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:27.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:41:27 gibba045 bash[25517]: cluster 2021-03-10T16:41:26.513191+0000 mgr.gibba045.orlgmj (mgr.34412) 9106 : cluster [DBG] pgmap v5188: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:27.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:41:27 gibba015 bash[29377]: cluster 2021-03-10T16:41:26.513191+0000 mgr.gibba045.orlgmj (mgr.34412) 9106 : cluster [DBG] pgmap v5188: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:27.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:41:27 gibba015 bash[30343]: cluster 2021-03-10T16:41:26.513191+0000 mgr.gibba045.orlgmj (mgr.34412) 9106 : cluster [DBG] pgmap v5188: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:29.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:41:29 gibba015 bash[29377]: cluster 2021-03-10T16:41:28.514353+0000 mgr.gibba045.orlgmj (mgr.34412) 9107 : cluster [DBG] pgmap v5189: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:29.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:41:29 gibba015 bash[30343]: cluster 2021-03-10T16:41:28.514353+0000 mgr.gibba045.orlgmj (mgr.34412) 9107 : cluster [DBG] pgmap v5189: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:30.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:41:29 gibba045 bash[25517]: cluster 2021-03-10T16:41:28.514353+0000 mgr.gibba045.orlgmj (mgr.34412) 9107 : cluster [DBG] pgmap v5189: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:31.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:41:31 gibba015 bash[29377]: cluster 2021-03-10T16:41:30.515944+0000 mgr.gibba045.orlgmj (mgr.34412) 9108 : cluster [DBG] pgmap v5190: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:31.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:41:31 gibba015 bash[30343]: cluster 2021-03-10T16:41:30.515944+0000 mgr.gibba045.orlgmj (mgr.34412) 9108 : cluster [DBG] pgmap v5190: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:32.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:41:31 gibba045 bash[25517]: cluster 2021-03-10T16:41:30.515944+0000 mgr.gibba045.orlgmj (mgr.34412) 9108 : cluster [DBG] pgmap v5190: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:33.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:41:33 gibba015 bash[29377]: cluster 2021-03-10T16:41:32.517685+0000 mgr.gibba045.orlgmj (mgr.34412) 9109 : cluster [DBG] pgmap v5191: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:33.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:41:33 gibba015 bash[30343]: cluster 2021-03-10T16:41:32.517685+0000 mgr.gibba045.orlgmj (mgr.34412) 9109 : cluster [DBG] pgmap v5191: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:34.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:41:33 gibba045 bash[25517]: cluster 2021-03-10T16:41:32.517685+0000 mgr.gibba045.orlgmj (mgr.34412) 9109 : cluster [DBG] pgmap v5191: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:35.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:41:35 gibba015 bash[29377]: cluster 2021-03-10T16:41:34.519152+0000 mgr.gibba045.orlgmj (mgr.34412) 9110 : cluster [DBG] pgmap v5192: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:35.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:41:35 gibba015 bash[30343]: cluster 2021-03-10T16:41:34.519152+0000 mgr.gibba045.orlgmj (mgr.34412) 9110 : cluster [DBG] pgmap v5192: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:36.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:41:35 gibba045 bash[25517]: cluster 2021-03-10T16:41:34.519152+0000 mgr.gibba045.orlgmj (mgr.34412) 9110 : cluster [DBG] pgmap v5192: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:37.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:41:37 gibba045 bash[25517]: cluster 2021-03-10T16:41:36.521128+0000 mgr.gibba045.orlgmj (mgr.34412) 9111 : cluster [DBG] pgmap v5193: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:37.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:41:37 gibba015 bash[29377]: cluster 2021-03-10T16:41:36.521128+0000 mgr.gibba045.orlgmj (mgr.34412) 9111 : cluster [DBG] pgmap v5193: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:37.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:41:37 gibba015 bash[30343]: cluster 2021-03-10T16:41:36.521128+0000 mgr.gibba045.orlgmj (mgr.34412) 9111 : cluster [DBG] pgmap v5193: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:38.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:41:38 gibba045 bash[25517]: audit 2021-03-10T16:41:38.264002+0000 mon.c (mon.1) 2509 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:41:38.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:41:38 gibba045 bash[25517]: audit 2021-03-10T16:41:38.493003+0000 mon.a (mon.0) 2016 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:41:38.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:41:38 gibba045 bash[25517]: audit 2021-03-10T16:41:38.496906+0000 mon.c (mon.1) 2510 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:41:38.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:41:38 gibba045 bash[25517]: audit 2021-03-10T16:41:38.500052+0000 mon.c (mon.1) 2511 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:41:38.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:41:38 gibba015 bash[29377]: audit 2021-03-10T16:41:38.264002+0000 mon.c (mon.1) 2509 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:41:38.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:41:38 gibba015 bash[29377]: audit 2021-03-10T16:41:38.493003+0000 mon.a (mon.0) 2016 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:41:38.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:41:38 gibba015 bash[29377]: audit 2021-03-10T16:41:38.496906+0000 mon.c (mon.1) 2510 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:41:38.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:41:38 gibba015 bash[29377]: audit 2021-03-10T16:41:38.500052+0000 mon.c (mon.1) 2511 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:41:38.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:41:38 gibba015 bash[30343]: audit 2021-03-10T16:41:38.264002+0000 mon.c (mon.1) 2509 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:41:38.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:41:38 gibba015 bash[30343]: audit 2021-03-10T16:41:38.493003+0000 mon.a (mon.0) 2016 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:41:38.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:41:38 gibba015 bash[30343]: audit 2021-03-10T16:41:38.496906+0000 mon.c (mon.1) 2510 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:41:38.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:41:38 gibba015 bash[30343]: audit 2021-03-10T16:41:38.500052+0000 mon.c (mon.1) 2511 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:41:39.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:41:39 gibba045 bash[25517]: cephadm 2021-03-10T16:41:38.272397+0000 mgr.gibba045.orlgmj (mgr.34412) 9112 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:41:39.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:41:39 gibba045 bash[25517]: cephadm 2021-03-10T16:41:38.273898+0000 mgr.gibba045.orlgmj (mgr.34412) 9113 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:41:39.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:41:39 gibba045 bash[25517]: cephadm 2021-03-10T16:41:38.498400+0000 mgr.gibba045.orlgmj (mgr.34412) 9114 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:41:39.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:41:39 gibba045 bash[25517]: cephadm 2021-03-10T16:41:38.501894+0000 mgr.gibba045.orlgmj (mgr.34412) 9115 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:41:39.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:41:39 gibba045 bash[25517]: audit 2021-03-10T16:41:38.502678+0000 mon.c (mon.1) 2512 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:41:39.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:41:39 gibba045 bash[25517]: cephadm 2021-03-10T16:41:38.504414+0000 mgr.gibba045.orlgmj (mgr.34412) 9116 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:41:39.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:41:39 gibba045 bash[25517]: cephadm 2021-03-10T16:41:38.504511+0000 mgr.gibba045.orlgmj (mgr.34412) 9117 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:41:39.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:41:39 gibba045 bash[25517]: audit 2021-03-10T16:41:38.505038+0000 mon.c (mon.1) 2513 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:41:39.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:41:39 gibba045 bash[25517]: cephadm 2021-03-10T16:41:38.506956+0000 mgr.gibba045.orlgmj (mgr.34412) 9118 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:41:39.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:41:39 gibba045 bash[25517]: cephadm 2021-03-10T16:41:38.506992+0000 mgr.gibba045.orlgmj (mgr.34412) 9119 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:41:39.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:41:39 gibba045 bash[25517]: audit 2021-03-10T16:41:38.517051+0000 mon.c (mon.1) 2514 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:41:39.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:41:39 gibba045 bash[25517]: cephadm 2021-03-10T16:41:38.517707+0000 mgr.gibba045.orlgmj (mgr.34412) 9120 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:41:39.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:41:39 gibba045 bash[25517]: audit 2021-03-10T16:41:38.518609+0000 mon.c (mon.1) 2515 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:41:39.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:41:39 gibba045 bash[25517]: cephadm 2021-03-10T16:41:38.519141+0000 mgr.gibba045.orlgmj (mgr.34412) 9121 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:41:39.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:41:39 gibba045 bash[25517]: cephadm 2021-03-10T16:41:38.519179+0000 mgr.gibba045.orlgmj (mgr.34412) 9122 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:41:39.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:41:39 gibba045 bash[25517]: cephadm 2021-03-10T16:41:38.520474+0000 mgr.gibba045.orlgmj (mgr.34412) 9123 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:41:39.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:41:39 gibba045 bash[25517]: cephadm 2021-03-10T16:41:38.520899+0000 mgr.gibba045.orlgmj (mgr.34412) 9124 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:41:39.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:41:39 gibba045 bash[25517]: cluster 2021-03-10T16:41:38.521538+0000 mgr.gibba045.orlgmj (mgr.34412) 9125 : cluster [DBG] pgmap v5194: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:39.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:41:39 gibba045 bash[25517]: cephadm 2021-03-10T16:41:38.521950+0000 mgr.gibba045.orlgmj (mgr.34412) 9126 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:41:39.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:41:39 gibba045 bash[25517]: cephadm 2021-03-10T16:41:38.521991+0000 mgr.gibba045.orlgmj (mgr.34412) 9127 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:41:39.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:41:39 gibba045 bash[25517]: cephadm 2021-03-10T16:41:38.522107+0000 mgr.gibba045.orlgmj (mgr.34412) 9128 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:41:39.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:41:39 gibba015 bash[29377]: cephadm 2021-03-10T16:41:38.272397+0000 mgr.gibba045.orlgmj (mgr.34412) 9112 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:41:39.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:41:39 gibba015 bash[29377]: cephadm 2021-03-10T16:41:38.273898+0000 mgr.gibba045.orlgmj (mgr.34412) 9113 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:41:39.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:41:39 gibba015 bash[29377]: cephadm 2021-03-10T16:41:38.498400+0000 mgr.gibba045.orlgmj (mgr.34412) 9114 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:41:39.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:41:39 gibba015 bash[29377]: cephadm 2021-03-10T16:41:38.501894+0000 mgr.gibba045.orlgmj (mgr.34412) 9115 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:41:39.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:41:39 gibba015 bash[29377]: audit 2021-03-10T16:41:38.502678+0000 mon.c (mon.1) 2512 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:41:39.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:41:39 gibba015 bash[29377]: cephadm 2021-03-10T16:41:38.504414+0000 mgr.gibba045.orlgmj (mgr.34412) 9116 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:41:39.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:41:39 gibba015 bash[29377]: cephadm 2021-03-10T16:41:38.504511+0000 mgr.gibba045.orlgmj (mgr.34412) 9117 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:41:39.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:41:39 gibba015 bash[29377]: audit 2021-03-10T16:41:38.505038+0000 mon.c (mon.1) 2513 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:41:39.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:41:39 gibba015 bash[29377]: cephadm 2021-03-10T16:41:38.506956+0000 mgr.gibba045.orlgmj (mgr.34412) 9118 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:41:39.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:41:39 gibba015 bash[29377]: cephadm 2021-03-10T16:41:38.506992+0000 mgr.gibba045.orlgmj (mgr.34412) 9119 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:41:39.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:41:39 gibba015 bash[29377]: audit 2021-03-10T16:41:38.517051+0000 mon.c (mon.1) 2514 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:41:39.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:41:39 gibba015 bash[29377]: cephadm 2021-03-10T16:41:38.517707+0000 mgr.gibba045.orlgmj (mgr.34412) 9120 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:41:39.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:41:39 gibba015 bash[29377]: audit 2021-03-10T16:41:38.518609+0000 mon.c (mon.1) 2515 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:41:39.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:41:39 gibba015 bash[29377]: cephadm 2021-03-10T16:41:38.519141+0000 mgr.gibba045.orlgmj (mgr.34412) 9121 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:41:39.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:41:39 gibba015 bash[29377]: cephadm 2021-03-10T16:41:38.519179+0000 mgr.gibba045.orlgmj (mgr.34412) 9122 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:41:39.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:41:39 gibba015 bash[29377]: cephadm 2021-03-10T16:41:38.520474+0000 mgr.gibba045.orlgmj (mgr.34412) 9123 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:41:39.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:41:39 gibba015 bash[29377]: cephadm 2021-03-10T16:41:38.520899+0000 mgr.gibba045.orlgmj (mgr.34412) 9124 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:41:39.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:41:39 gibba015 bash[29377]: cluster 2021-03-10T16:41:38.521538+0000 mgr.gibba045.orlgmj (mgr.34412) 9125 : cluster [DBG] pgmap v5194: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:39.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:41:39 gibba015 bash[29377]: cephadm 2021-03-10T16:41:38.521950+0000 mgr.gibba045.orlgmj (mgr.34412) 9126 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:41:39.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:41:39 gibba015 bash[29377]: cephadm 2021-03-10T16:41:38.521991+0000 mgr.gibba045.orlgmj (mgr.34412) 9127 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:41:39.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:41:39 gibba015 bash[29377]: cephadm 2021-03-10T16:41:38.522107+0000 mgr.gibba045.orlgmj (mgr.34412) 9128 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:41:39.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:41:39 gibba015 bash[30343]: cephadm 2021-03-10T16:41:38.272397+0000 mgr.gibba045.orlgmj (mgr.34412) 9112 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:41:39.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:41:39 gibba015 bash[30343]: cephadm 2021-03-10T16:41:38.273898+0000 mgr.gibba045.orlgmj (mgr.34412) 9113 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:41:39.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:41:39 gibba015 bash[30343]: cephadm 2021-03-10T16:41:38.498400+0000 mgr.gibba045.orlgmj (mgr.34412) 9114 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:41:39.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:41:39 gibba015 bash[30343]: cephadm 2021-03-10T16:41:38.501894+0000 mgr.gibba045.orlgmj (mgr.34412) 9115 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:41:39.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:41:39 gibba015 bash[30343]: audit 2021-03-10T16:41:38.502678+0000 mon.c (mon.1) 2512 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:41:39.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:41:39 gibba015 bash[30343]: cephadm 2021-03-10T16:41:38.504414+0000 mgr.gibba045.orlgmj (mgr.34412) 9116 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:41:39.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:41:39 gibba015 bash[30343]: cephadm 2021-03-10T16:41:38.504511+0000 mgr.gibba045.orlgmj (mgr.34412) 9117 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:41:39.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:41:39 gibba015 bash[30343]: audit 2021-03-10T16:41:38.505038+0000 mon.c (mon.1) 2513 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:41:39.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:41:39 gibba015 bash[30343]: cephadm 2021-03-10T16:41:38.506956+0000 mgr.gibba045.orlgmj (mgr.34412) 9118 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:41:39.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:41:39 gibba015 bash[30343]: cephadm 2021-03-10T16:41:38.506992+0000 mgr.gibba045.orlgmj (mgr.34412) 9119 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:41:39.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:41:39 gibba015 bash[30343]: audit 2021-03-10T16:41:38.517051+0000 mon.c (mon.1) 2514 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:41:39.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:41:39 gibba015 bash[30343]: cephadm 2021-03-10T16:41:38.517707+0000 mgr.gibba045.orlgmj (mgr.34412) 9120 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:41:39.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:41:39 gibba015 bash[30343]: audit 2021-03-10T16:41:38.518609+0000 mon.c (mon.1) 2515 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:41:39.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:41:39 gibba015 bash[30343]: cephadm 2021-03-10T16:41:38.519141+0000 mgr.gibba045.orlgmj (mgr.34412) 9121 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:41:39.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:41:39 gibba015 bash[30343]: cephadm 2021-03-10T16:41:38.519179+0000 mgr.gibba045.orlgmj (mgr.34412) 9122 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:41:39.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:41:39 gibba015 bash[30343]: cephadm 2021-03-10T16:41:38.520474+0000 mgr.gibba045.orlgmj (mgr.34412) 9123 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:41:39.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:41:39 gibba015 bash[30343]: cephadm 2021-03-10T16:41:38.520899+0000 mgr.gibba045.orlgmj (mgr.34412) 9124 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:41:39.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:41:39 gibba015 bash[30343]: cluster 2021-03-10T16:41:38.521538+0000 mgr.gibba045.orlgmj (mgr.34412) 9125 : cluster [DBG] pgmap v5194: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:39.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:41:39 gibba015 bash[30343]: cephadm 2021-03-10T16:41:38.521950+0000 mgr.gibba045.orlgmj (mgr.34412) 9126 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:41:39.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:41:39 gibba015 bash[30343]: cephadm 2021-03-10T16:41:38.521991+0000 mgr.gibba045.orlgmj (mgr.34412) 9127 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:41:39.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:41:39 gibba015 bash[30343]: cephadm 2021-03-10T16:41:38.522107+0000 mgr.gibba045.orlgmj (mgr.34412) 9128 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:41:41.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:41:41 gibba015 bash[29377]: cluster 2021-03-10T16:41:40.523090+0000 mgr.gibba045.orlgmj (mgr.34412) 9129 : cluster [DBG] pgmap v5195: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:41.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:41:41 gibba015 bash[30343]: cluster 2021-03-10T16:41:40.523090+0000 mgr.gibba045.orlgmj (mgr.34412) 9129 : cluster [DBG] pgmap v5195: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:42.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:41:41 gibba045 bash[25517]: cluster 2021-03-10T16:41:40.523090+0000 mgr.gibba045.orlgmj (mgr.34412) 9129 : cluster [DBG] pgmap v5195: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:43.360 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:41:43.590 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:41:43.590 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 5m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:41:43.591 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 4m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:41:43.591 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:41:43.592 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:41:43.592 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:41:43.593 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:41:43.593 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:41:43.594 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:41:43.594 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 5m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:41:43.595 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 4m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:41:43.595 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:41:43.596 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:41:43.596 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:41:43.597 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:41:43.597 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:41:43.597 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:41:43.598 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:41:43.599 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:41:43.600 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 4m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:41:43.600 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 4m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:41:43.840 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:41:43.841 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:41:43.841 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:41:43.841 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:41:43.842 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:41:43.842 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:41:43.842 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:41:43.842 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:41:43.843 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:41:43.843 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:41:43.843 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:41:43.844 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:41:43.844 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:41:43.844 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:41:43.845 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:41:43.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:41:43 gibba015 bash[29377]: cluster 2021-03-10T16:41:42.524873+0000 mgr.gibba045.orlgmj (mgr.34412) 9130 : cluster [DBG] pgmap v5196: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:43.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:41:43 gibba015 bash[30343]: cluster 2021-03-10T16:41:42.524873+0000 mgr.gibba045.orlgmj (mgr.34412) 9130 : cluster [DBG] pgmap v5196: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:44.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:41:43 gibba045 bash[25517]: cluster 2021-03-10T16:41:42.524873+0000 mgr.gibba045.orlgmj (mgr.34412) 9130 : cluster [DBG] pgmap v5196: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:44.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:41:44 gibba015 bash[29377]: audit 2021-03-10T16:41:43.355120+0000 mgr.gibba045.orlgmj (mgr.34412) 9131 : audit [DBG] from='client.50172 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:41:44.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:41:44 gibba015 bash[29377]: audit 2021-03-10T16:41:43.580767+0000 mgr.gibba045.orlgmj (mgr.34412) 9132 : audit [DBG] from='client.60166 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:41:44.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:41:44 gibba015 bash[29377]: audit 2021-03-10T16:41:43.841422+0000 mon.a (mon.0) 2017 : audit [DBG] from='client.? 172.21.2.115:0/1247339900' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:41:44.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:41:44 gibba015 bash[30343]: audit 2021-03-10T16:41:43.355120+0000 mgr.gibba045.orlgmj (mgr.34412) 9131 : audit [DBG] from='client.50172 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:41:44.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:41:44 gibba015 bash[30343]: audit 2021-03-10T16:41:43.580767+0000 mgr.gibba045.orlgmj (mgr.34412) 9132 : audit [DBG] from='client.60166 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:41:44.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:41:44 gibba015 bash[30343]: audit 2021-03-10T16:41:43.841422+0000 mon.a (mon.0) 2017 : audit [DBG] from='client.? 172.21.2.115:0/1247339900' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:41:45.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:41:44 gibba045 bash[25517]: audit 2021-03-10T16:41:43.355120+0000 mgr.gibba045.orlgmj (mgr.34412) 9131 : audit [DBG] from='client.50172 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:41:45.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:41:44 gibba045 bash[25517]: audit 2021-03-10T16:41:43.580767+0000 mgr.gibba045.orlgmj (mgr.34412) 9132 : audit [DBG] from='client.60166 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:41:45.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:41:44 gibba045 bash[25517]: audit 2021-03-10T16:41:43.841422+0000 mon.a (mon.0) 2017 : audit [DBG] from='client.? 172.21.2.115:0/1247339900' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:41:45.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:41:45 gibba015 bash[29377]: cluster 2021-03-10T16:41:44.526181+0000 mgr.gibba045.orlgmj (mgr.34412) 9133 : cluster [DBG] pgmap v5197: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:45.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:41:45 gibba015 bash[30343]: cluster 2021-03-10T16:41:44.526181+0000 mgr.gibba045.orlgmj (mgr.34412) 9133 : cluster [DBG] pgmap v5197: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:46.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:41:45 gibba045 bash[25517]: cluster 2021-03-10T16:41:44.526181+0000 mgr.gibba045.orlgmj (mgr.34412) 9133 : cluster [DBG] pgmap v5197: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:47.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:41:47 gibba045 bash[25517]: cluster 2021-03-10T16:41:46.527053+0000 mgr.gibba045.orlgmj (mgr.34412) 9134 : cluster [DBG] pgmap v5198: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:47.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:41:47 gibba015 bash[29377]: cluster 2021-03-10T16:41:46.527053+0000 mgr.gibba045.orlgmj (mgr.34412) 9134 : cluster [DBG] pgmap v5198: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:47.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:41:47 gibba015 bash[30343]: cluster 2021-03-10T16:41:46.527053+0000 mgr.gibba045.orlgmj (mgr.34412) 9134 : cluster [DBG] pgmap v5198: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:49.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:41:49 gibba015 bash[29377]: cluster 2021-03-10T16:41:48.527979+0000 mgr.gibba045.orlgmj (mgr.34412) 9135 : cluster [DBG] pgmap v5199: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:49.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:41:49 gibba015 bash[30343]: cluster 2021-03-10T16:41:48.527979+0000 mgr.gibba045.orlgmj (mgr.34412) 9135 : cluster [DBG] pgmap v5199: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:50.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:41:49 gibba045 bash[25517]: cluster 2021-03-10T16:41:48.527979+0000 mgr.gibba045.orlgmj (mgr.34412) 9135 : cluster [DBG] pgmap v5199: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:51.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:41:51 gibba015 bash[29377]: cluster 2021-03-10T16:41:50.529664+0000 mgr.gibba045.orlgmj (mgr.34412) 9136 : cluster [DBG] pgmap v5200: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:51.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:41:51 gibba015 bash[30343]: cluster 2021-03-10T16:41:50.529664+0000 mgr.gibba045.orlgmj (mgr.34412) 9136 : cluster [DBG] pgmap v5200: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:52.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:41:51 gibba045 bash[25517]: cluster 2021-03-10T16:41:50.529664+0000 mgr.gibba045.orlgmj (mgr.34412) 9136 : cluster [DBG] pgmap v5200: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:53.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:41:53 gibba045 bash[25517]: cluster 2021-03-10T16:41:52.531275+0000 mgr.gibba045.orlgmj (mgr.34412) 9137 : cluster [DBG] pgmap v5201: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:53.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:41:53 gibba015 bash[29377]: cluster 2021-03-10T16:41:52.531275+0000 mgr.gibba045.orlgmj (mgr.34412) 9137 : cluster [DBG] pgmap v5201: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:53.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:41:53 gibba015 bash[30343]: cluster 2021-03-10T16:41:52.531275+0000 mgr.gibba045.orlgmj (mgr.34412) 9137 : cluster [DBG] pgmap v5201: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:54.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:41:54 gibba015 bash[29377]: cephadm 2021-03-10T16:41:53.538141+0000 mgr.gibba045.orlgmj (mgr.34412) 9138 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:41:54.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:41:54 gibba015 bash[29377]: audit 2021-03-10T16:41:53.696340+0000 mon.c (mon.1) 2516 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:41:54.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:41:54 gibba015 bash[29377]: audit 2021-03-10T16:41:53.696690+0000 mon.c (mon.1) 2517 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:41:54.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:41:54 gibba015 bash[29377]: audit 2021-03-10T16:41:53.697192+0000 mon.a (mon.0) 2018 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:41:54.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:41:54 gibba015 bash[29377]: audit 2021-03-10T16:41:53.697667+0000 mon.a (mon.0) 2019 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:41:54.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:41:54 gibba015 bash[29377]: audit 2021-03-10T16:41:53.712051+0000 mon.c (mon.1) 2518 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T16:41:54.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:41:54 gibba015 bash[29377]: audit 2021-03-10T16:41:53.712770+0000 mon.c (mon.1) 2519 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:41:54.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:41:54 gibba015 bash[29377]: audit 2021-03-10T16:41:53.713207+0000 mon.a (mon.0) 2020 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T16:41:54.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:41:54 gibba015 bash[29377]: audit 2021-03-10T16:41:53.713483+0000 mon.c (mon.1) 2520 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:41:54.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:41:54 gibba015 bash[29377]: audit 2021-03-10T16:41:53.714147+0000 mon.c (mon.1) 2521 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:41:54.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:41:54 gibba015 bash[29377]: audit 2021-03-10T16:41:53.715131+0000 mon.a (mon.0) 2021 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:41:54.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:41:54 gibba015 bash[29377]: audit 2021-03-10T16:41:53.716325+0000 mon.a (mon.0) 2022 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:41:54.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:41:54 gibba015 bash[29377]: audit 2021-03-10T16:41:53.717297+0000 mon.a (mon.0) 2023 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:41:54.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:41:54 gibba015 bash[30343]: cephadm 2021-03-10T16:41:53.538141+0000 mgr.gibba045.orlgmj (mgr.34412) 9138 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:41:54.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:41:54 gibba015 bash[30343]: audit 2021-03-10T16:41:53.696340+0000 mon.c (mon.1) 2516 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:41:54.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:41:54 gibba015 bash[30343]: audit 2021-03-10T16:41:53.696690+0000 mon.c (mon.1) 2517 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:41:54.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:41:54 gibba015 bash[30343]: audit 2021-03-10T16:41:53.697192+0000 mon.a (mon.0) 2018 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:41:54.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:41:54 gibba015 bash[30343]: audit 2021-03-10T16:41:53.697667+0000 mon.a (mon.0) 2019 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:41:54.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:41:54 gibba015 bash[30343]: audit 2021-03-10T16:41:53.712051+0000 mon.c (mon.1) 2518 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T16:41:54.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:41:54 gibba015 bash[30343]: audit 2021-03-10T16:41:53.712770+0000 mon.c (mon.1) 2519 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:41:54.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:41:54 gibba015 bash[30343]: audit 2021-03-10T16:41:53.713207+0000 mon.a (mon.0) 2020 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T16:41:54.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:41:54 gibba015 bash[30343]: audit 2021-03-10T16:41:53.713483+0000 mon.c (mon.1) 2520 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:41:54.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:41:54 gibba015 bash[30343]: audit 2021-03-10T16:41:53.714147+0000 mon.c (mon.1) 2521 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:41:54.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:41:54 gibba015 bash[30343]: audit 2021-03-10T16:41:53.715131+0000 mon.a (mon.0) 2021 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:41:54.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:41:54 gibba015 bash[30343]: audit 2021-03-10T16:41:53.716325+0000 mon.a (mon.0) 2022 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:41:54.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:41:54 gibba015 bash[30343]: audit 2021-03-10T16:41:53.717297+0000 mon.a (mon.0) 2023 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:41:55.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:41:54 gibba045 bash[25517]: cephadm 2021-03-10T16:41:53.538141+0000 mgr.gibba045.orlgmj (mgr.34412) 9138 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:41:55.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:41:54 gibba045 bash[25517]: audit 2021-03-10T16:41:53.696340+0000 mon.c (mon.1) 2516 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:41:55.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:41:54 gibba045 bash[25517]: audit 2021-03-10T16:41:53.696690+0000 mon.c (mon.1) 2517 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:41:55.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:41:54 gibba045 bash[25517]: audit 2021-03-10T16:41:53.697192+0000 mon.a (mon.0) 2018 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:41:55.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:41:54 gibba045 bash[25517]: audit 2021-03-10T16:41:53.697667+0000 mon.a (mon.0) 2019 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:41:55.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:41:54 gibba045 bash[25517]: audit 2021-03-10T16:41:53.712051+0000 mon.c (mon.1) 2518 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T16:41:55.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:41:54 gibba045 bash[25517]: audit 2021-03-10T16:41:53.712770+0000 mon.c (mon.1) 2519 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:41:55.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:41:54 gibba045 bash[25517]: audit 2021-03-10T16:41:53.713207+0000 mon.a (mon.0) 2020 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T16:41:55.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:41:54 gibba045 bash[25517]: audit 2021-03-10T16:41:53.713483+0000 mon.c (mon.1) 2520 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:41:55.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:41:54 gibba045 bash[25517]: audit 2021-03-10T16:41:53.714147+0000 mon.c (mon.1) 2521 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:41:55.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:41:54 gibba045 bash[25517]: audit 2021-03-10T16:41:53.715131+0000 mon.a (mon.0) 2021 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:41:55.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:41:54 gibba045 bash[25517]: audit 2021-03-10T16:41:53.716325+0000 mon.a (mon.0) 2022 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:41:55.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:41:54 gibba045 bash[25517]: audit 2021-03-10T16:41:53.717297+0000 mon.a (mon.0) 2023 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:41:55.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:41:55 gibba015 bash[29377]: cluster 2021-03-10T16:41:54.532960+0000 mgr.gibba045.orlgmj (mgr.34412) 9139 : cluster [DBG] pgmap v5202: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:55.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:41:55 gibba015 bash[30343]: cluster 2021-03-10T16:41:54.532960+0000 mgr.gibba045.orlgmj (mgr.34412) 9139 : cluster [DBG] pgmap v5202: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:56.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:41:55 gibba045 bash[25517]: cluster 2021-03-10T16:41:54.532960+0000 mgr.gibba045.orlgmj (mgr.34412) 9139 : cluster [DBG] pgmap v5202: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:57.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:41:57 gibba045 bash[25517]: cluster 2021-03-10T16:41:56.534037+0000 mgr.gibba045.orlgmj (mgr.34412) 9140 : cluster [DBG] pgmap v5203: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:57.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:41:57 gibba015 bash[29377]: cluster 2021-03-10T16:41:56.534037+0000 mgr.gibba045.orlgmj (mgr.34412) 9140 : cluster [DBG] pgmap v5203: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:57.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:41:57 gibba015 bash[30343]: cluster 2021-03-10T16:41:56.534037+0000 mgr.gibba045.orlgmj (mgr.34412) 9140 : cluster [DBG] pgmap v5203: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:59.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:41:59 gibba015 bash[29377]: cluster 2021-03-10T16:41:58.535123+0000 mgr.gibba045.orlgmj (mgr.34412) 9141 : cluster [DBG] pgmap v5204: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:59.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:41:59 gibba015 bash[30343]: cluster 2021-03-10T16:41:58.535123+0000 mgr.gibba045.orlgmj (mgr.34412) 9141 : cluster [DBG] pgmap v5204: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:00.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:41:59 gibba045 bash[25517]: cluster 2021-03-10T16:41:58.535123+0000 mgr.gibba045.orlgmj (mgr.34412) 9141 : cluster [DBG] pgmap v5204: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:01.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:42:01 gibba015 bash[29377]: cluster 2021-03-10T16:42:00.536686+0000 mgr.gibba045.orlgmj (mgr.34412) 9142 : cluster [DBG] pgmap v5205: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:01.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:42:01 gibba015 bash[30343]: cluster 2021-03-10T16:42:00.536686+0000 mgr.gibba045.orlgmj (mgr.34412) 9142 : cluster [DBG] pgmap v5205: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:02.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:42:01 gibba045 bash[25517]: cluster 2021-03-10T16:42:00.536686+0000 mgr.gibba045.orlgmj (mgr.34412) 9142 : cluster [DBG] pgmap v5205: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:03.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:42:03 gibba015 bash[29377]: cluster 2021-03-10T16:42:02.538236+0000 mgr.gibba045.orlgmj (mgr.34412) 9143 : cluster [DBG] pgmap v5206: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:03.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:42:03 gibba015 bash[30343]: cluster 2021-03-10T16:42:02.538236+0000 mgr.gibba045.orlgmj (mgr.34412) 9143 : cluster [DBG] pgmap v5206: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:04.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:42:03 gibba045 bash[25517]: cluster 2021-03-10T16:42:02.538236+0000 mgr.gibba045.orlgmj (mgr.34412) 9143 : cluster [DBG] pgmap v5206: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:05.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:42:05 gibba015 bash[29377]: cluster 2021-03-10T16:42:04.539759+0000 mgr.gibba045.orlgmj (mgr.34412) 9144 : cluster [DBG] pgmap v5207: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:05.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:42:05 gibba015 bash[30343]: cluster 2021-03-10T16:42:04.539759+0000 mgr.gibba045.orlgmj (mgr.34412) 9144 : cluster [DBG] pgmap v5207: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:06.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:42:05 gibba045 bash[25517]: cluster 2021-03-10T16:42:04.539759+0000 mgr.gibba045.orlgmj (mgr.34412) 9144 : cluster [DBG] pgmap v5207: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:07.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:42:07 gibba045 bash[25517]: cluster 2021-03-10T16:42:06.540809+0000 mgr.gibba045.orlgmj (mgr.34412) 9145 : cluster [DBG] pgmap v5208: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:07.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:42:07 gibba015 bash[29377]: cluster 2021-03-10T16:42:06.540809+0000 mgr.gibba045.orlgmj (mgr.34412) 9145 : cluster [DBG] pgmap v5208: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:07.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:42:07 gibba015 bash[30343]: cluster 2021-03-10T16:42:06.540809+0000 mgr.gibba045.orlgmj (mgr.34412) 9145 : cluster [DBG] pgmap v5208: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:09.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:42:09 gibba015 bash[29377]: cluster 2021-03-10T16:42:08.542071+0000 mgr.gibba045.orlgmj (mgr.34412) 9146 : cluster [DBG] pgmap v5209: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:09.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:42:09 gibba015 bash[29377]: cephadm 2021-03-10T16:42:08.554209+0000 mgr.gibba045.orlgmj (mgr.34412) 9147 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:42:09.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:42:09 gibba015 bash[30343]: cluster 2021-03-10T16:42:08.542071+0000 mgr.gibba045.orlgmj (mgr.34412) 9146 : cluster [DBG] pgmap v5209: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:09.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:42:09 gibba015 bash[30343]: cephadm 2021-03-10T16:42:08.554209+0000 mgr.gibba045.orlgmj (mgr.34412) 9147 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:42:10.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:42:09 gibba045 bash[25517]: cluster 2021-03-10T16:42:08.542071+0000 mgr.gibba045.orlgmj (mgr.34412) 9146 : cluster [DBG] pgmap v5209: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:10.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:42:09 gibba045 bash[25517]: cephadm 2021-03-10T16:42:08.554209+0000 mgr.gibba045.orlgmj (mgr.34412) 9147 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:42:11.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:42:11 gibba015 bash[29377]: cluster 2021-03-10T16:42:10.543760+0000 mgr.gibba045.orlgmj (mgr.34412) 9148 : cluster [DBG] pgmap v5210: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:11.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:42:11 gibba015 bash[30343]: cluster 2021-03-10T16:42:10.543760+0000 mgr.gibba045.orlgmj (mgr.34412) 9148 : cluster [DBG] pgmap v5210: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:12.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:42:11 gibba045 bash[25517]: cluster 2021-03-10T16:42:10.543760+0000 mgr.gibba045.orlgmj (mgr.34412) 9148 : cluster [DBG] pgmap v5210: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:13.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:42:13 gibba015 bash[29377]: cluster 2021-03-10T16:42:12.544275+0000 mgr.gibba045.orlgmj (mgr.34412) 9149 : cluster [DBG] pgmap v5211: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:13.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:42:13 gibba015 bash[30343]: cluster 2021-03-10T16:42:12.544275+0000 mgr.gibba045.orlgmj (mgr.34412) 9149 : cluster [DBG] pgmap v5211: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:14.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:42:13 gibba045 bash[25517]: cluster 2021-03-10T16:42:12.544275+0000 mgr.gibba045.orlgmj (mgr.34412) 9149 : cluster [DBG] pgmap v5211: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:14.084 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:42:14.309 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:42:14.310 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 5m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:42:14.310 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 4m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:42:14.310 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:42:14.311 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:42:14.311 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:42:14.311 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:42:14.311 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:42:14.312 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:42:14.312 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 5m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:42:14.312 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 4m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:42:14.312 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:42:14.312 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:42:14.313 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:42:14.313 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:42:14.313 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:42:14.313 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:42:14.314 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:42:14.314 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:42:14.316 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 4m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:42:14.316 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 4m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:42:14.557 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:42:14.557 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:42:14.557 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:42:14.558 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:42:14.558 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:42:14.558 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:42:14.558 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:42:14.559 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:42:14.559 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:42:14.559 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:42:14.559 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:42:14.560 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:42:14.560 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:42:14.560 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:42:14.560 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:42:14.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:42:14 gibba015 bash[29377]: audit 2021-03-10T16:42:14.558139+0000 mon.c (mon.1) 2522 : audit [DBG] from='client.? 172.21.2.115:0/1925800373' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:42:14.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:42:14 gibba015 bash[30343]: audit 2021-03-10T16:42:14.558139+0000 mon.c (mon.1) 2522 : audit [DBG] from='client.? 172.21.2.115:0/1925800373' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:42:15.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:42:14 gibba045 bash[25517]: audit 2021-03-10T16:42:14.558139+0000 mon.c (mon.1) 2522 : audit [DBG] from='client.? 172.21.2.115:0/1925800373' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:42:15.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:42:15 gibba015 bash[29377]: audit 2021-03-10T16:42:14.078783+0000 mgr.gibba045.orlgmj (mgr.34412) 9150 : audit [DBG] from='client.60178 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:42:15.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:42:15 gibba015 bash[29377]: audit 2021-03-10T16:42:14.300377+0000 mgr.gibba045.orlgmj (mgr.34412) 9151 : audit [DBG] from='client.50196 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:42:15.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:42:15 gibba015 bash[29377]: cluster 2021-03-10T16:42:14.545588+0000 mgr.gibba045.orlgmj (mgr.34412) 9152 : cluster [DBG] pgmap v5212: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:15.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:42:15 gibba015 bash[30343]: audit 2021-03-10T16:42:14.078783+0000 mgr.gibba045.orlgmj (mgr.34412) 9150 : audit [DBG] from='client.60178 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:42:15.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:42:15 gibba015 bash[30343]: audit 2021-03-10T16:42:14.300377+0000 mgr.gibba045.orlgmj (mgr.34412) 9151 : audit [DBG] from='client.50196 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:42:15.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:42:15 gibba015 bash[30343]: cluster 2021-03-10T16:42:14.545588+0000 mgr.gibba045.orlgmj (mgr.34412) 9152 : cluster [DBG] pgmap v5212: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:16.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:42:15 gibba045 bash[25517]: audit 2021-03-10T16:42:14.078783+0000 mgr.gibba045.orlgmj (mgr.34412) 9150 : audit [DBG] from='client.60178 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:42:16.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:42:15 gibba045 bash[25517]: audit 2021-03-10T16:42:14.300377+0000 mgr.gibba045.orlgmj (mgr.34412) 9151 : audit [DBG] from='client.50196 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:42:16.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:42:15 gibba045 bash[25517]: cluster 2021-03-10T16:42:14.545588+0000 mgr.gibba045.orlgmj (mgr.34412) 9152 : cluster [DBG] pgmap v5212: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:17.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:42:17 gibba045 bash[25517]: cluster 2021-03-10T16:42:16.546448+0000 mgr.gibba045.orlgmj (mgr.34412) 9153 : cluster [DBG] pgmap v5213: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:17.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:42:17 gibba015 bash[29377]: cluster 2021-03-10T16:42:16.546448+0000 mgr.gibba045.orlgmj (mgr.34412) 9153 : cluster [DBG] pgmap v5213: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:17.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:42:17 gibba015 bash[30343]: cluster 2021-03-10T16:42:16.546448+0000 mgr.gibba045.orlgmj (mgr.34412) 9153 : cluster [DBG] pgmap v5213: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:19.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:42:19 gibba015 bash[29377]: cluster 2021-03-10T16:42:18.547534+0000 mgr.gibba045.orlgmj (mgr.34412) 9154 : cluster [DBG] pgmap v5214: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:19.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:42:19 gibba015 bash[30343]: cluster 2021-03-10T16:42:18.547534+0000 mgr.gibba045.orlgmj (mgr.34412) 9154 : cluster [DBG] pgmap v5214: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:20.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:42:19 gibba045 bash[25517]: cluster 2021-03-10T16:42:18.547534+0000 mgr.gibba045.orlgmj (mgr.34412) 9154 : cluster [DBG] pgmap v5214: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:21.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:42:21 gibba015 bash[29377]: cluster 2021-03-10T16:42:20.548067+0000 mgr.gibba045.orlgmj (mgr.34412) 9155 : cluster [DBG] pgmap v5215: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:21.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:42:21 gibba015 bash[30343]: cluster 2021-03-10T16:42:20.548067+0000 mgr.gibba045.orlgmj (mgr.34412) 9155 : cluster [DBG] pgmap v5215: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:22.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:42:21 gibba045 bash[25517]: cluster 2021-03-10T16:42:20.548067+0000 mgr.gibba045.orlgmj (mgr.34412) 9155 : cluster [DBG] pgmap v5215: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:23.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:42:23 gibba015 bash[29377]: cluster 2021-03-10T16:42:22.549683+0000 mgr.gibba045.orlgmj (mgr.34412) 9156 : cluster [DBG] pgmap v5216: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:23.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:42:23 gibba015 bash[30343]: cluster 2021-03-10T16:42:22.549683+0000 mgr.gibba045.orlgmj (mgr.34412) 9156 : cluster [DBG] pgmap v5216: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:24.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:42:23 gibba045 bash[25517]: cluster 2021-03-10T16:42:22.549683+0000 mgr.gibba045.orlgmj (mgr.34412) 9156 : cluster [DBG] pgmap v5216: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:24.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:42:24 gibba015 bash[29377]: cephadm 2021-03-10T16:42:23.570282+0000 mgr.gibba045.orlgmj (mgr.34412) 9157 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:42:24.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:42:24 gibba015 bash[30343]: cephadm 2021-03-10T16:42:23.570282+0000 mgr.gibba045.orlgmj (mgr.34412) 9157 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:42:25.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:42:24 gibba045 bash[25517]: cephadm 2021-03-10T16:42:23.570282+0000 mgr.gibba045.orlgmj (mgr.34412) 9157 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:42:25.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:42:25 gibba015 bash[29377]: cluster 2021-03-10T16:42:24.550939+0000 mgr.gibba045.orlgmj (mgr.34412) 9158 : cluster [DBG] pgmap v5217: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:25.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:42:25 gibba015 bash[30343]: cluster 2021-03-10T16:42:24.550939+0000 mgr.gibba045.orlgmj (mgr.34412) 9158 : cluster [DBG] pgmap v5217: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:26.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:42:25 gibba045 bash[25517]: cluster 2021-03-10T16:42:24.550939+0000 mgr.gibba045.orlgmj (mgr.34412) 9158 : cluster [DBG] pgmap v5217: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:27.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:42:27 gibba045 bash[25517]: cluster 2021-03-10T16:42:26.551968+0000 mgr.gibba045.orlgmj (mgr.34412) 9159 : cluster [DBG] pgmap v5218: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:27.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:42:27 gibba015 bash[29377]: cluster 2021-03-10T16:42:26.551968+0000 mgr.gibba045.orlgmj (mgr.34412) 9159 : cluster [DBG] pgmap v5218: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:27.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:42:27 gibba015 bash[30343]: cluster 2021-03-10T16:42:26.551968+0000 mgr.gibba045.orlgmj (mgr.34412) 9159 : cluster [DBG] pgmap v5218: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:29.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:42:29 gibba015 bash[29377]: cluster 2021-03-10T16:42:28.552947+0000 mgr.gibba045.orlgmj (mgr.34412) 9160 : cluster [DBG] pgmap v5219: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:29.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:42:29 gibba015 bash[30343]: cluster 2021-03-10T16:42:28.552947+0000 mgr.gibba045.orlgmj (mgr.34412) 9160 : cluster [DBG] pgmap v5219: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:30.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:42:29 gibba045 bash[25517]: cluster 2021-03-10T16:42:28.552947+0000 mgr.gibba045.orlgmj (mgr.34412) 9160 : cluster [DBG] pgmap v5219: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:31.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:42:31 gibba015 bash[29377]: cluster 2021-03-10T16:42:30.554634+0000 mgr.gibba045.orlgmj (mgr.34412) 9161 : cluster [DBG] pgmap v5220: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:31.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:42:31 gibba015 bash[30343]: cluster 2021-03-10T16:42:30.554634+0000 mgr.gibba045.orlgmj (mgr.34412) 9161 : cluster [DBG] pgmap v5220: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:32.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:42:31 gibba045 bash[25517]: cluster 2021-03-10T16:42:30.554634+0000 mgr.gibba045.orlgmj (mgr.34412) 9161 : cluster [DBG] pgmap v5220: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:33.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:42:33 gibba015 bash[29377]: cluster 2021-03-10T16:42:32.556234+0000 mgr.gibba045.orlgmj (mgr.34412) 9162 : cluster [DBG] pgmap v5221: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:33.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:42:33 gibba015 bash[30343]: cluster 2021-03-10T16:42:32.556234+0000 mgr.gibba045.orlgmj (mgr.34412) 9162 : cluster [DBG] pgmap v5221: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:34.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:42:33 gibba045 bash[25517]: cluster 2021-03-10T16:42:32.556234+0000 mgr.gibba045.orlgmj (mgr.34412) 9162 : cluster [DBG] pgmap v5221: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:35.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:42:35 gibba015 bash[29377]: cluster 2021-03-10T16:42:34.557500+0000 mgr.gibba045.orlgmj (mgr.34412) 9163 : cluster [DBG] pgmap v5222: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:35.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:42:35 gibba015 bash[30343]: cluster 2021-03-10T16:42:34.557500+0000 mgr.gibba045.orlgmj (mgr.34412) 9163 : cluster [DBG] pgmap v5222: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:36.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:42:35 gibba045 bash[25517]: cluster 2021-03-10T16:42:34.557500+0000 mgr.gibba045.orlgmj (mgr.34412) 9163 : cluster [DBG] pgmap v5222: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:37.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:42:37 gibba045 bash[25517]: cluster 2021-03-10T16:42:36.558459+0000 mgr.gibba045.orlgmj (mgr.34412) 9164 : cluster [DBG] pgmap v5223: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:37.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:42:37 gibba015 bash[29377]: cluster 2021-03-10T16:42:36.558459+0000 mgr.gibba045.orlgmj (mgr.34412) 9164 : cluster [DBG] pgmap v5223: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:37.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:42:37 gibba015 bash[30343]: cluster 2021-03-10T16:42:36.558459+0000 mgr.gibba045.orlgmj (mgr.34412) 9164 : cluster [DBG] pgmap v5223: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:38.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:42:38 gibba015 bash[29377]: audit 2021-03-10T16:42:38.571924+0000 mon.c (mon.1) 2523 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:42:38.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:42:38 gibba015 bash[30343]: audit 2021-03-10T16:42:38.571924+0000 mon.c (mon.1) 2523 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:42:39.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:42:38 gibba045 bash[25517]: audit 2021-03-10T16:42:38.571924+0000 mon.c (mon.1) 2523 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:42:40.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:42:39 gibba045 bash[25517]: cluster 2021-03-10T16:42:38.559671+0000 mgr.gibba045.orlgmj (mgr.34412) 9165 : cluster [DBG] pgmap v5224: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:40.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:42:39 gibba045 bash[25517]: cephadm 2021-03-10T16:42:38.579996+0000 mgr.gibba045.orlgmj (mgr.34412) 9166 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:42:40.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:42:39 gibba045 bash[25517]: cephadm 2021-03-10T16:42:38.581504+0000 mgr.gibba045.orlgmj (mgr.34412) 9167 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:42:40.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:42:39 gibba045 bash[25517]: audit 2021-03-10T16:42:38.794015+0000 mon.a (mon.0) 2024 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:42:40.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:42:39 gibba045 bash[25517]: audit 2021-03-10T16:42:38.798008+0000 mon.c (mon.1) 2524 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:42:40.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:42:39 gibba045 bash[25517]: cephadm 2021-03-10T16:42:38.799389+0000 mgr.gibba045.orlgmj (mgr.34412) 9168 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:42:40.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:42:39 gibba045 bash[25517]: audit 2021-03-10T16:42:38.799573+0000 mon.c (mon.1) 2525 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:42:40.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:42:39 gibba045 bash[25517]: audit 2021-03-10T16:42:38.801283+0000 mon.c (mon.1) 2526 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:42:40.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:42:39 gibba045 bash[25517]: cephadm 2021-03-10T16:42:38.801539+0000 mgr.gibba045.orlgmj (mgr.34412) 9169 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:42:40.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:42:39 gibba045 bash[25517]: audit 2021-03-10T16:42:38.802539+0000 mon.c (mon.1) 2527 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:42:40.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:42:39 gibba045 bash[25517]: cephadm 2021-03-10T16:42:38.803182+0000 mgr.gibba045.orlgmj (mgr.34412) 9170 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:42:40.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:42:39 gibba045 bash[25517]: cephadm 2021-03-10T16:42:38.803221+0000 mgr.gibba045.orlgmj (mgr.34412) 9171 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:42:40.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:42:39 gibba045 bash[25517]: cephadm 2021-03-10T16:42:38.804562+0000 mgr.gibba045.orlgmj (mgr.34412) 9172 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:42:40.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:42:39 gibba045 bash[25517]: cephadm 2021-03-10T16:42:38.804601+0000 mgr.gibba045.orlgmj (mgr.34412) 9173 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:42:40.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:42:39 gibba045 bash[25517]: cephadm 2021-03-10T16:42:38.805709+0000 mgr.gibba045.orlgmj (mgr.34412) 9174 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:42:40.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:42:39 gibba045 bash[25517]: audit 2021-03-10T16:42:38.805893+0000 mon.c (mon.1) 2528 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:42:40.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:42:39 gibba045 bash[25517]: cephadm 2021-03-10T16:42:38.807574+0000 mgr.gibba045.orlgmj (mgr.34412) 9175 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:42:40.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:42:39 gibba045 bash[25517]: cephadm 2021-03-10T16:42:38.807613+0000 mgr.gibba045.orlgmj (mgr.34412) 9176 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:42:40.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:42:39 gibba045 bash[25517]: audit 2021-03-10T16:42:38.807841+0000 mon.c (mon.1) 2529 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:42:40.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:42:39 gibba015 bash[29377]: cluster 2021-03-10T16:42:38.559671+0000 mgr.gibba045.orlgmj (mgr.34412) 9165 : cluster [DBG] pgmap v5224: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:40.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:42:39 gibba015 bash[29377]: cephadm 2021-03-10T16:42:38.579996+0000 mgr.gibba045.orlgmj (mgr.34412) 9166 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:42:40.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:42:39 gibba015 bash[29377]: cephadm 2021-03-10T16:42:38.581504+0000 mgr.gibba045.orlgmj (mgr.34412) 9167 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:42:40.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:42:39 gibba015 bash[29377]: audit 2021-03-10T16:42:38.794015+0000 mon.a (mon.0) 2024 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:42:40.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:42:39 gibba015 bash[29377]: audit 2021-03-10T16:42:38.798008+0000 mon.c (mon.1) 2524 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:42:40.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:42:39 gibba015 bash[29377]: cephadm 2021-03-10T16:42:38.799389+0000 mgr.gibba045.orlgmj (mgr.34412) 9168 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:42:40.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:42:39 gibba015 bash[29377]: audit 2021-03-10T16:42:38.799573+0000 mon.c (mon.1) 2525 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:42:40.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:42:39 gibba015 bash[29377]: audit 2021-03-10T16:42:38.801283+0000 mon.c (mon.1) 2526 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:42:40.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:42:39 gibba015 bash[29377]: cephadm 2021-03-10T16:42:38.801539+0000 mgr.gibba045.orlgmj (mgr.34412) 9169 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:42:40.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:42:39 gibba015 bash[29377]: audit 2021-03-10T16:42:38.802539+0000 mon.c (mon.1) 2527 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:42:40.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:42:39 gibba015 bash[29377]: cephadm 2021-03-10T16:42:38.803182+0000 mgr.gibba045.orlgmj (mgr.34412) 9170 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:42:40.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:42:39 gibba015 bash[29377]: cephadm 2021-03-10T16:42:38.803221+0000 mgr.gibba045.orlgmj (mgr.34412) 9171 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:42:40.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:42:39 gibba015 bash[29377]: cephadm 2021-03-10T16:42:38.804562+0000 mgr.gibba045.orlgmj (mgr.34412) 9172 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:42:40.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:42:39 gibba015 bash[29377]: cephadm 2021-03-10T16:42:38.804601+0000 mgr.gibba045.orlgmj (mgr.34412) 9173 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:42:40.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:42:39 gibba015 bash[29377]: cephadm 2021-03-10T16:42:38.805709+0000 mgr.gibba045.orlgmj (mgr.34412) 9174 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:42:40.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:42:39 gibba015 bash[29377]: audit 2021-03-10T16:42:38.805893+0000 mon.c (mon.1) 2528 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:42:40.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:42:39 gibba015 bash[29377]: cephadm 2021-03-10T16:42:38.807574+0000 mgr.gibba045.orlgmj (mgr.34412) 9175 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:42:40.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:42:39 gibba015 bash[29377]: cephadm 2021-03-10T16:42:38.807613+0000 mgr.gibba045.orlgmj (mgr.34412) 9176 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:42:40.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:42:39 gibba015 bash[29377]: audit 2021-03-10T16:42:38.807841+0000 mon.c (mon.1) 2529 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:42:40.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:42:39 gibba015 bash[30343]: cluster 2021-03-10T16:42:38.559671+0000 mgr.gibba045.orlgmj (mgr.34412) 9165 : cluster [DBG] pgmap v5224: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:40.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:42:39 gibba015 bash[30343]: cephadm 2021-03-10T16:42:38.579996+0000 mgr.gibba045.orlgmj (mgr.34412) 9166 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:42:40.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:42:39 gibba015 bash[30343]: cephadm 2021-03-10T16:42:38.581504+0000 mgr.gibba045.orlgmj (mgr.34412) 9167 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:42:40.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:42:39 gibba015 bash[30343]: audit 2021-03-10T16:42:38.794015+0000 mon.a (mon.0) 2024 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:42:40.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:42:39 gibba015 bash[30343]: audit 2021-03-10T16:42:38.798008+0000 mon.c (mon.1) 2524 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:42:40.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:42:39 gibba015 bash[30343]: cephadm 2021-03-10T16:42:38.799389+0000 mgr.gibba045.orlgmj (mgr.34412) 9168 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:42:40.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:42:39 gibba015 bash[30343]: audit 2021-03-10T16:42:38.799573+0000 mon.c (mon.1) 2525 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:42:40.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:42:39 gibba015 bash[30343]: audit 2021-03-10T16:42:38.801283+0000 mon.c (mon.1) 2526 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:42:40.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:42:39 gibba015 bash[30343]: cephadm 2021-03-10T16:42:38.801539+0000 mgr.gibba045.orlgmj (mgr.34412) 9169 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:42:40.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:42:39 gibba015 bash[30343]: audit 2021-03-10T16:42:38.802539+0000 mon.c (mon.1) 2527 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:42:40.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:42:39 gibba015 bash[30343]: cephadm 2021-03-10T16:42:38.803182+0000 mgr.gibba045.orlgmj (mgr.34412) 9170 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:42:40.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:42:39 gibba015 bash[30343]: cephadm 2021-03-10T16:42:38.803221+0000 mgr.gibba045.orlgmj (mgr.34412) 9171 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:42:40.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:42:39 gibba015 bash[30343]: cephadm 2021-03-10T16:42:38.804562+0000 mgr.gibba045.orlgmj (mgr.34412) 9172 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:42:40.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:42:39 gibba015 bash[30343]: cephadm 2021-03-10T16:42:38.804601+0000 mgr.gibba045.orlgmj (mgr.34412) 9173 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:42:40.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:42:39 gibba015 bash[30343]: cephadm 2021-03-10T16:42:38.805709+0000 mgr.gibba045.orlgmj (mgr.34412) 9174 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:42:40.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:42:39 gibba015 bash[30343]: audit 2021-03-10T16:42:38.805893+0000 mon.c (mon.1) 2528 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:42:40.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:42:39 gibba015 bash[30343]: cephadm 2021-03-10T16:42:38.807574+0000 mgr.gibba045.orlgmj (mgr.34412) 9175 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:42:40.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:42:39 gibba015 bash[30343]: cephadm 2021-03-10T16:42:38.807613+0000 mgr.gibba045.orlgmj (mgr.34412) 9176 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:42:40.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:42:39 gibba015 bash[30343]: audit 2021-03-10T16:42:38.807841+0000 mon.c (mon.1) 2529 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:42:41.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:42:40 gibba015 bash[29377]: cephadm 2021-03-10T16:42:38.809587+0000 mgr.gibba045.orlgmj (mgr.34412) 9177 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:42:41.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:42:40 gibba015 bash[29377]: cephadm 2021-03-10T16:42:38.809923+0000 mgr.gibba045.orlgmj (mgr.34412) 9178 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:42:41.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:42:40 gibba015 bash[29377]: cephadm 2021-03-10T16:42:38.811275+0000 mgr.gibba045.orlgmj (mgr.34412) 9179 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:42:41.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:42:40 gibba015 bash[29377]: cephadm 2021-03-10T16:42:38.811316+0000 mgr.gibba045.orlgmj (mgr.34412) 9180 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:42:41.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:42:40 gibba015 bash[29377]: cephadm 2021-03-10T16:42:38.811430+0000 mgr.gibba045.orlgmj (mgr.34412) 9181 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:42:41.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:42:40 gibba015 bash[30343]: cephadm 2021-03-10T16:42:38.809587+0000 mgr.gibba045.orlgmj (mgr.34412) 9177 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:42:41.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:42:40 gibba015 bash[30343]: cephadm 2021-03-10T16:42:38.809923+0000 mgr.gibba045.orlgmj (mgr.34412) 9178 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:42:41.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:42:40 gibba015 bash[30343]: cephadm 2021-03-10T16:42:38.811275+0000 mgr.gibba045.orlgmj (mgr.34412) 9179 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:42:41.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:42:40 gibba015 bash[30343]: cephadm 2021-03-10T16:42:38.811316+0000 mgr.gibba045.orlgmj (mgr.34412) 9180 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:42:41.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:42:40 gibba015 bash[30343]: cephadm 2021-03-10T16:42:38.811430+0000 mgr.gibba045.orlgmj (mgr.34412) 9181 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:42:41.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:42:40 gibba045 bash[25517]: cephadm 2021-03-10T16:42:38.809587+0000 mgr.gibba045.orlgmj (mgr.34412) 9177 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:42:41.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:42:40 gibba045 bash[25517]: cephadm 2021-03-10T16:42:38.809923+0000 mgr.gibba045.orlgmj (mgr.34412) 9178 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:42:41.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:42:40 gibba045 bash[25517]: cephadm 2021-03-10T16:42:38.811275+0000 mgr.gibba045.orlgmj (mgr.34412) 9179 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:42:41.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:42:40 gibba045 bash[25517]: cephadm 2021-03-10T16:42:38.811316+0000 mgr.gibba045.orlgmj (mgr.34412) 9180 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:42:41.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:42:40 gibba045 bash[25517]: cephadm 2021-03-10T16:42:38.811430+0000 mgr.gibba045.orlgmj (mgr.34412) 9181 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:42:42.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:42:41 gibba015 bash[29377]: cluster 2021-03-10T16:42:40.561364+0000 mgr.gibba045.orlgmj (mgr.34412) 9182 : cluster [DBG] pgmap v5225: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:42.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:42:41 gibba015 bash[30343]: cluster 2021-03-10T16:42:40.561364+0000 mgr.gibba045.orlgmj (mgr.34412) 9182 : cluster [DBG] pgmap v5225: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:42.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:42:41 gibba045 bash[25517]: cluster 2021-03-10T16:42:40.561364+0000 mgr.gibba045.orlgmj (mgr.34412) 9182 : cluster [DBG] pgmap v5225: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:43.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:42:42 gibba015 bash[29377]: cluster 2021-03-10T16:42:42.563101+0000 mgr.gibba045.orlgmj (mgr.34412) 9183 : cluster [DBG] pgmap v5226: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:43.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:42:42 gibba015 bash[30343]: cluster 2021-03-10T16:42:42.563101+0000 mgr.gibba045.orlgmj (mgr.34412) 9183 : cluster [DBG] pgmap v5226: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:43.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:42:42 gibba045 bash[25517]: cluster 2021-03-10T16:42:42.563101+0000 mgr.gibba045.orlgmj (mgr.34412) 9183 : cluster [DBG] pgmap v5226: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:44.803 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:42:45.030 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:42:45.030 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 6m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:42:45.031 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 5m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:42:45.031 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:42:45.032 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:42:45.032 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:42:45.033 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:42:45.033 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:42:45.033 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:42:45.034 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 6m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:42:45.035 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 5m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:42:45.035 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:42:45.036 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:42:45.037 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:42:45.037 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:42:45.039 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:42:45.039 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:42:45.040 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:42:45.040 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:42:45.041 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 5m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:42:45.041 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 5m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:42:45.283 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:42:45.283 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:42:45.284 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:42:45.284 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:42:45.284 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:42:45.285 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:42:45.285 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:42:45.286 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:42:45.286 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:42:45.287 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:42:45.287 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:42:45.287 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:42:45.289 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:42:45.290 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:42:45.290 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:42:45.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:42:45 gibba015 bash[29377]: cluster 2021-03-10T16:42:44.563650+0000 mgr.gibba045.orlgmj (mgr.34412) 9184 : cluster [DBG] pgmap v5227: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:45.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:42:45 gibba015 bash[29377]: audit 2021-03-10T16:42:44.797991+0000 mgr.gibba045.orlgmj (mgr.34412) 9185 : audit [DBG] from='client.50208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:42:45.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:42:45 gibba015 bash[29377]: audit 2021-03-10T16:42:45.282663+0000 mon.a (mon.0) 2025 : audit [DBG] from='client.? 172.21.2.115:0/2009232917' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:42:45.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:42:45 gibba015 bash[30343]: cluster 2021-03-10T16:42:44.563650+0000 mgr.gibba045.orlgmj (mgr.34412) 9184 : cluster [DBG] pgmap v5227: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:45.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:42:45 gibba015 bash[30343]: audit 2021-03-10T16:42:44.797991+0000 mgr.gibba045.orlgmj (mgr.34412) 9185 : audit [DBG] from='client.50208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:42:45.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:42:45 gibba015 bash[30343]: audit 2021-03-10T16:42:45.282663+0000 mon.a (mon.0) 2025 : audit [DBG] from='client.? 172.21.2.115:0/2009232917' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:42:46.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:42:45 gibba045 bash[25517]: cluster 2021-03-10T16:42:44.563650+0000 mgr.gibba045.orlgmj (mgr.34412) 9184 : cluster [DBG] pgmap v5227: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:46.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:42:45 gibba045 bash[25517]: audit 2021-03-10T16:42:44.797991+0000 mgr.gibba045.orlgmj (mgr.34412) 9185 : audit [DBG] from='client.50208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:42:46.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:42:45 gibba045 bash[25517]: audit 2021-03-10T16:42:45.282663+0000 mon.a (mon.0) 2025 : audit [DBG] from='client.? 172.21.2.115:0/2009232917' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:42:46.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:42:46 gibba015 bash[29377]: audit 2021-03-10T16:42:45.021361+0000 mgr.gibba045.orlgmj (mgr.34412) 9186 : audit [DBG] from='client.60202 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:42:46.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:42:46 gibba015 bash[30343]: audit 2021-03-10T16:42:45.021361+0000 mgr.gibba045.orlgmj (mgr.34412) 9186 : audit [DBG] from='client.60202 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:42:47.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:42:46 gibba045 bash[25517]: audit 2021-03-10T16:42:45.021361+0000 mgr.gibba045.orlgmj (mgr.34412) 9186 : audit [DBG] from='client.60202 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:42:47.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:42:47 gibba015 bash[29377]: cluster 2021-03-10T16:42:46.564588+0000 mgr.gibba045.orlgmj (mgr.34412) 9187 : cluster [DBG] pgmap v5228: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:47.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:42:47 gibba015 bash[30343]: cluster 2021-03-10T16:42:46.564588+0000 mgr.gibba045.orlgmj (mgr.34412) 9187 : cluster [DBG] pgmap v5228: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:48.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:42:47 gibba045 bash[25517]: cluster 2021-03-10T16:42:46.564588+0000 mgr.gibba045.orlgmj (mgr.34412) 9187 : cluster [DBG] pgmap v5228: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:49.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:42:49 gibba015 bash[29377]: cluster 2021-03-10T16:42:48.565762+0000 mgr.gibba045.orlgmj (mgr.34412) 9188 : cluster [DBG] pgmap v5229: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:49.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:42:49 gibba015 bash[30343]: cluster 2021-03-10T16:42:48.565762+0000 mgr.gibba045.orlgmj (mgr.34412) 9188 : cluster [DBG] pgmap v5229: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:50.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:42:49 gibba045 bash[25517]: cluster 2021-03-10T16:42:48.565762+0000 mgr.gibba045.orlgmj (mgr.34412) 9188 : cluster [DBG] pgmap v5229: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:51.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:42:51 gibba015 bash[29377]: cluster 2021-03-10T16:42:50.567448+0000 mgr.gibba045.orlgmj (mgr.34412) 9189 : cluster [DBG] pgmap v5230: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:51.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:42:51 gibba015 bash[30343]: cluster 2021-03-10T16:42:50.567448+0000 mgr.gibba045.orlgmj (mgr.34412) 9189 : cluster [DBG] pgmap v5230: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:52.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:42:51 gibba045 bash[25517]: cluster 2021-03-10T16:42:50.567448+0000 mgr.gibba045.orlgmj (mgr.34412) 9189 : cluster [DBG] pgmap v5230: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:53.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:42:53 gibba015 bash[29377]: cluster 2021-03-10T16:42:52.568042+0000 mgr.gibba045.orlgmj (mgr.34412) 9190 : cluster [DBG] pgmap v5231: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:53.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:42:53 gibba015 bash[30343]: cluster 2021-03-10T16:42:52.568042+0000 mgr.gibba045.orlgmj (mgr.34412) 9190 : cluster [DBG] pgmap v5231: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:54.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:42:53 gibba045 bash[25517]: cluster 2021-03-10T16:42:52.568042+0000 mgr.gibba045.orlgmj (mgr.34412) 9190 : cluster [DBG] pgmap v5231: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:54.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:42:54 gibba015 bash[29377]: audit 2021-03-10T16:42:53.701154+0000 mon.c (mon.1) 2530 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:42:54.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:42:54 gibba015 bash[29377]: audit 2021-03-10T16:42:53.701373+0000 mon.c (mon.1) 2531 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:42:54.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:42:54 gibba015 bash[29377]: audit 2021-03-10T16:42:53.701700+0000 mon.a (mon.0) 2026 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:42:54.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:42:54 gibba015 bash[29377]: audit 2021-03-10T16:42:53.702003+0000 mon.a (mon.0) 2027 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:42:54.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:42:54 gibba015 bash[29377]: audit 2021-03-10T16:42:53.720342+0000 mon.c (mon.1) 2532 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T16:42:54.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:42:54 gibba015 bash[29377]: audit 2021-03-10T16:42:53.721161+0000 mon.c (mon.1) 2533 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:42:54.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:42:54 gibba015 bash[29377]: audit 2021-03-10T16:42:53.721595+0000 mon.a (mon.0) 2028 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T16:42:54.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:42:54 gibba015 bash[29377]: audit 2021-03-10T16:42:53.721870+0000 mon.c (mon.1) 2534 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-03-10T16:42:54.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:42:54 gibba015 bash[29377]: audit 2021-03-10T16:42:53.722832+0000 mon.a (mon.0) 2029 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:42:54.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:42:54 gibba015 bash[29377]: audit 2021-03-10T16:42:53.722940+0000 mon.c (mon.1) 2535 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:42:54.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:42:54 gibba015 bash[29377]: audit 2021-03-10T16:42:53.723780+0000 mon.a (mon.0) 2030 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-03-10T16:42:54.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:42:54 gibba015 bash[29377]: audit 2021-03-10T16:42:53.724714+0000 mon.a (mon.0) 2031 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:42:54.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:42:54 gibba015 bash[30343]: audit 2021-03-10T16:42:53.701154+0000 mon.c (mon.1) 2530 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:42:54.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:42:54 gibba015 bash[30343]: audit 2021-03-10T16:42:53.701373+0000 mon.c (mon.1) 2531 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:42:54.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:42:54 gibba015 bash[30343]: audit 2021-03-10T16:42:53.701700+0000 mon.a (mon.0) 2026 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:42:54.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:42:54 gibba015 bash[30343]: audit 2021-03-10T16:42:53.702003+0000 mon.a (mon.0) 2027 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:42:54.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:42:54 gibba015 bash[30343]: audit 2021-03-10T16:42:53.720342+0000 mon.c (mon.1) 2532 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T16:42:54.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:42:54 gibba015 bash[30343]: audit 2021-03-10T16:42:53.721161+0000 mon.c (mon.1) 2533 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:42:54.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:42:54 gibba015 bash[30343]: audit 2021-03-10T16:42:53.721595+0000 mon.a (mon.0) 2028 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T16:42:54.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:42:54 gibba015 bash[30343]: audit 2021-03-10T16:42:53.721870+0000 mon.c (mon.1) 2534 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-03-10T16:42:54.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:42:54 gibba015 bash[30343]: audit 2021-03-10T16:42:53.722832+0000 mon.a (mon.0) 2029 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:42:54.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:42:54 gibba015 bash[30343]: audit 2021-03-10T16:42:53.722940+0000 mon.c (mon.1) 2535 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:42:54.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:42:54 gibba015 bash[30343]: audit 2021-03-10T16:42:53.723780+0000 mon.a (mon.0) 2030 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-03-10T16:42:54.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:42:54 gibba015 bash[30343]: audit 2021-03-10T16:42:53.724714+0000 mon.a (mon.0) 2031 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:42:55.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:42:54 gibba045 bash[25517]: audit 2021-03-10T16:42:53.701154+0000 mon.c (mon.1) 2530 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:42:55.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:42:54 gibba045 bash[25517]: audit 2021-03-10T16:42:53.701373+0000 mon.c (mon.1) 2531 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:42:55.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:42:54 gibba045 bash[25517]: audit 2021-03-10T16:42:53.701700+0000 mon.a (mon.0) 2026 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:42:55.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:42:54 gibba045 bash[25517]: audit 2021-03-10T16:42:53.702003+0000 mon.a (mon.0) 2027 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:42:55.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:42:54 gibba045 bash[25517]: audit 2021-03-10T16:42:53.720342+0000 mon.c (mon.1) 2532 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T16:42:55.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:42:54 gibba045 bash[25517]: audit 2021-03-10T16:42:53.721161+0000 mon.c (mon.1) 2533 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:42:55.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:42:54 gibba045 bash[25517]: audit 2021-03-10T16:42:53.721595+0000 mon.a (mon.0) 2028 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T16:42:55.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:42:54 gibba045 bash[25517]: audit 2021-03-10T16:42:53.721870+0000 mon.c (mon.1) 2534 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-03-10T16:42:55.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:42:54 gibba045 bash[25517]: audit 2021-03-10T16:42:53.722832+0000 mon.a (mon.0) 2029 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:42:55.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:42:54 gibba045 bash[25517]: audit 2021-03-10T16:42:53.722940+0000 mon.c (mon.1) 2535 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:42:55.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:42:54 gibba045 bash[25517]: audit 2021-03-10T16:42:53.723780+0000 mon.a (mon.0) 2030 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-03-10T16:42:55.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:42:54 gibba045 bash[25517]: audit 2021-03-10T16:42:53.724714+0000 mon.a (mon.0) 2031 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:42:55.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:42:55 gibba015 bash[29377]: cephadm 2021-03-10T16:42:53.824627+0000 mgr.gibba045.orlgmj (mgr.34412) 9191 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:42:55.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:42:55 gibba015 bash[29377]: cluster 2021-03-10T16:42:54.569384+0000 mgr.gibba045.orlgmj (mgr.34412) 9192 : cluster [DBG] pgmap v5232: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:55.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:42:55 gibba015 bash[30343]: cephadm 2021-03-10T16:42:53.824627+0000 mgr.gibba045.orlgmj (mgr.34412) 9191 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:42:55.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:42:55 gibba015 bash[30343]: cluster 2021-03-10T16:42:54.569384+0000 mgr.gibba045.orlgmj (mgr.34412) 9192 : cluster [DBG] pgmap v5232: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:56.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:42:55 gibba045 bash[25517]: cephadm 2021-03-10T16:42:53.824627+0000 mgr.gibba045.orlgmj (mgr.34412) 9191 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:42:56.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:42:55 gibba045 bash[25517]: cluster 2021-03-10T16:42:54.569384+0000 mgr.gibba045.orlgmj (mgr.34412) 9192 : cluster [DBG] pgmap v5232: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:57.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:42:57 gibba045 bash[25517]: cluster 2021-03-10T16:42:56.571430+0000 mgr.gibba045.orlgmj (mgr.34412) 9193 : cluster [DBG] pgmap v5233: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:58.029 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:42:57 gibba015 bash[29377]: cluster 2021-03-10T16:42:56.571430+0000 mgr.gibba045.orlgmj (mgr.34412) 9193 : cluster [DBG] pgmap v5233: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:58.030 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:42:57 gibba015 bash[30343]: cluster 2021-03-10T16:42:56.571430+0000 mgr.gibba045.orlgmj (mgr.34412) 9193 : cluster [DBG] pgmap v5233: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:59.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:42:59 gibba015 bash[29377]: cluster 2021-03-10T16:42:58.572821+0000 mgr.gibba045.orlgmj (mgr.34412) 9194 : cluster [DBG] pgmap v5234: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:59.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:42:59 gibba015 bash[30343]: cluster 2021-03-10T16:42:58.572821+0000 mgr.gibba045.orlgmj (mgr.34412) 9194 : cluster [DBG] pgmap v5234: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:00.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:42:59 gibba045 bash[25517]: cluster 2021-03-10T16:42:58.572821+0000 mgr.gibba045.orlgmj (mgr.34412) 9194 : cluster [DBG] pgmap v5234: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:01.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:43:01 gibba015 bash[29377]: cluster 2021-03-10T16:43:00.573702+0000 mgr.gibba045.orlgmj (mgr.34412) 9195 : cluster [DBG] pgmap v5235: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:01.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:43:01 gibba015 bash[30343]: cluster 2021-03-10T16:43:00.573702+0000 mgr.gibba045.orlgmj (mgr.34412) 9195 : cluster [DBG] pgmap v5235: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:02.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:43:01 gibba045 bash[25517]: cluster 2021-03-10T16:43:00.573702+0000 mgr.gibba045.orlgmj (mgr.34412) 9195 : cluster [DBG] pgmap v5235: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:03.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:43:03 gibba015 bash[29377]: cluster 2021-03-10T16:43:02.575294+0000 mgr.gibba045.orlgmj (mgr.34412) 9196 : cluster [DBG] pgmap v5236: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:03.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:43:03 gibba015 bash[30343]: cluster 2021-03-10T16:43:02.575294+0000 mgr.gibba045.orlgmj (mgr.34412) 9196 : cluster [DBG] pgmap v5236: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:04.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:43:03 gibba045 bash[25517]: cluster 2021-03-10T16:43:02.575294+0000 mgr.gibba045.orlgmj (mgr.34412) 9196 : cluster [DBG] pgmap v5236: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:05.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:43:05 gibba015 bash[29377]: cluster 2021-03-10T16:43:04.576729+0000 mgr.gibba045.orlgmj (mgr.34412) 9197 : cluster [DBG] pgmap v5237: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:05.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:43:05 gibba015 bash[30343]: cluster 2021-03-10T16:43:04.576729+0000 mgr.gibba045.orlgmj (mgr.34412) 9197 : cluster [DBG] pgmap v5237: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:06.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:43:05 gibba045 bash[25517]: cluster 2021-03-10T16:43:04.576729+0000 mgr.gibba045.orlgmj (mgr.34412) 9197 : cluster [DBG] pgmap v5237: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:07.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:43:07 gibba045 bash[25517]: cluster 2021-03-10T16:43:06.577471+0000 mgr.gibba045.orlgmj (mgr.34412) 9198 : cluster [DBG] pgmap v5238: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:07.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:43:07 gibba015 bash[29377]: cluster 2021-03-10T16:43:06.577471+0000 mgr.gibba045.orlgmj (mgr.34412) 9198 : cluster [DBG] pgmap v5238: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:07.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:43:07 gibba015 bash[30343]: cluster 2021-03-10T16:43:06.577471+0000 mgr.gibba045.orlgmj (mgr.34412) 9198 : cluster [DBG] pgmap v5238: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:09.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:43:09 gibba015 bash[29377]: cluster 2021-03-10T16:43:08.578124+0000 mgr.gibba045.orlgmj (mgr.34412) 9199 : cluster [DBG] pgmap v5239: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:09.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:43:09 gibba015 bash[30343]: cluster 2021-03-10T16:43:08.578124+0000 mgr.gibba045.orlgmj (mgr.34412) 9199 : cluster [DBG] pgmap v5239: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:10.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:43:09 gibba045 bash[25517]: cluster 2021-03-10T16:43:08.578124+0000 mgr.gibba045.orlgmj (mgr.34412) 9199 : cluster [DBG] pgmap v5239: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:10.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:43:10 gibba015 bash[29377]: cephadm 2021-03-10T16:43:08.836793+0000 mgr.gibba045.orlgmj (mgr.34412) 9200 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:43:10.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:43:10 gibba015 bash[30343]: cephadm 2021-03-10T16:43:08.836793+0000 mgr.gibba045.orlgmj (mgr.34412) 9200 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:43:11.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:43:10 gibba045 bash[25517]: cephadm 2021-03-10T16:43:08.836793+0000 mgr.gibba045.orlgmj (mgr.34412) 9200 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:43:11.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:43:11 gibba015 bash[29377]: cluster 2021-03-10T16:43:10.579581+0000 mgr.gibba045.orlgmj (mgr.34412) 9201 : cluster [DBG] pgmap v5240: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:11.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:43:11 gibba015 bash[30343]: cluster 2021-03-10T16:43:10.579581+0000 mgr.gibba045.orlgmj (mgr.34412) 9201 : cluster [DBG] pgmap v5240: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:12.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:43:11 gibba045 bash[25517]: cluster 2021-03-10T16:43:10.579581+0000 mgr.gibba045.orlgmj (mgr.34412) 9201 : cluster [DBG] pgmap v5240: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:13.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:43:13 gibba015 bash[29377]: cluster 2021-03-10T16:43:12.581404+0000 mgr.gibba045.orlgmj (mgr.34412) 9202 : cluster [DBG] pgmap v5241: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:13.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:43:13 gibba015 bash[30343]: cluster 2021-03-10T16:43:12.581404+0000 mgr.gibba045.orlgmj (mgr.34412) 9202 : cluster [DBG] pgmap v5241: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:14.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:43:13 gibba045 bash[25517]: cluster 2021-03-10T16:43:12.581404+0000 mgr.gibba045.orlgmj (mgr.34412) 9202 : cluster [DBG] pgmap v5241: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:15.523 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:43:15.749 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:43:15.749 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 6m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:43:15.750 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 5m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:43:15.750 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:43:15.750 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:43:15.750 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:43:15.751 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:43:15.751 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:43:15.751 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:43:15.751 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 6m ago 2h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:43:15.752 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (2h) 5m ago 2h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:43:15.752 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:43:15.752 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:43:15.752 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:43:15.752 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:43:15.753 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:43:15.753 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:43:15.753 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:43:15.753 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:43:15.754 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 5m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:43:15.754 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 5m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:43:15.968 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:43:15 gibba015 bash[29377]: cluster 2021-03-10T16:43:14.582645+0000 mgr.gibba045.orlgmj (mgr.34412) 9203 : cluster [DBG] pgmap v5242: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:15.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:43:15 gibba015 bash[30343]: cluster 2021-03-10T16:43:14.582645+0000 mgr.gibba045.orlgmj (mgr.34412) 9203 : cluster [DBG] pgmap v5242: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:15.999 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:43:16.000 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:43:16.000 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:43:16.000 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:43:16.000 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:43:16.001 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:43:16.001 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:43:16.001 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:43:16.001 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:43:16.002 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:43:16.002 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:43:16.003 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:43:16.003 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:43:16.004 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:43:16.004 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:43:16.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:43:15 gibba045 bash[25517]: cluster 2021-03-10T16:43:14.582645+0000 mgr.gibba045.orlgmj (mgr.34412) 9203 : cluster [DBG] pgmap v5242: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:16.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:43:16 gibba015 bash[29377]: audit 2021-03-10T16:43:15.517751+0000 mgr.gibba045.orlgmj (mgr.34412) 9204 : audit [DBG] from='client.50226 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:43:16.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:43:16 gibba015 bash[29377]: audit 2021-03-10T16:43:15.741651+0000 mgr.gibba045.orlgmj (mgr.34412) 9205 : audit [DBG] from='client.50232 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:43:16.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:43:16 gibba015 bash[29377]: audit 2021-03-10T16:43:16.000817+0000 mon.a (mon.0) 2032 : audit [DBG] from='client.? 172.21.2.115:0/3400988544' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:43:16.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:43:16 gibba015 bash[30343]: audit 2021-03-10T16:43:15.517751+0000 mgr.gibba045.orlgmj (mgr.34412) 9204 : audit [DBG] from='client.50226 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:43:16.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:43:16 gibba015 bash[30343]: audit 2021-03-10T16:43:15.741651+0000 mgr.gibba045.orlgmj (mgr.34412) 9205 : audit [DBG] from='client.50232 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:43:16.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:43:16 gibba015 bash[30343]: audit 2021-03-10T16:43:16.000817+0000 mon.a (mon.0) 2032 : audit [DBG] from='client.? 172.21.2.115:0/3400988544' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:43:17.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:43:16 gibba045 bash[25517]: audit 2021-03-10T16:43:15.517751+0000 mgr.gibba045.orlgmj (mgr.34412) 9204 : audit [DBG] from='client.50226 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:43:17.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:43:16 gibba045 bash[25517]: audit 2021-03-10T16:43:15.741651+0000 mgr.gibba045.orlgmj (mgr.34412) 9205 : audit [DBG] from='client.50232 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:43:17.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:43:16 gibba045 bash[25517]: audit 2021-03-10T16:43:16.000817+0000 mon.a (mon.0) 2032 : audit [DBG] from='client.? 172.21.2.115:0/3400988544' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:43:17.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:43:17 gibba015 bash[29377]: cluster 2021-03-10T16:43:16.583657+0000 mgr.gibba045.orlgmj (mgr.34412) 9206 : cluster [DBG] pgmap v5243: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:17.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:43:17 gibba015 bash[30343]: cluster 2021-03-10T16:43:16.583657+0000 mgr.gibba045.orlgmj (mgr.34412) 9206 : cluster [DBG] pgmap v5243: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:18.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:43:17 gibba045 bash[25517]: cluster 2021-03-10T16:43:16.583657+0000 mgr.gibba045.orlgmj (mgr.34412) 9206 : cluster [DBG] pgmap v5243: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:19.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:43:19 gibba015 bash[29377]: cluster 2021-03-10T16:43:18.584946+0000 mgr.gibba045.orlgmj (mgr.34412) 9207 : cluster [DBG] pgmap v5244: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:19.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:43:19 gibba015 bash[30343]: cluster 2021-03-10T16:43:18.584946+0000 mgr.gibba045.orlgmj (mgr.34412) 9207 : cluster [DBG] pgmap v5244: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:20.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:43:19 gibba045 bash[25517]: cluster 2021-03-10T16:43:18.584946+0000 mgr.gibba045.orlgmj (mgr.34412) 9207 : cluster [DBG] pgmap v5244: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:21.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:43:21 gibba015 bash[29377]: cluster 2021-03-10T16:43:20.586537+0000 mgr.gibba045.orlgmj (mgr.34412) 9208 : cluster [DBG] pgmap v5245: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:21.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:43:21 gibba015 bash[30343]: cluster 2021-03-10T16:43:20.586537+0000 mgr.gibba045.orlgmj (mgr.34412) 9208 : cluster [DBG] pgmap v5245: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:22.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:43:21 gibba045 bash[25517]: cluster 2021-03-10T16:43:20.586537+0000 mgr.gibba045.orlgmj (mgr.34412) 9208 : cluster [DBG] pgmap v5245: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:23.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:43:23 gibba015 bash[29377]: cluster 2021-03-10T16:43:22.588344+0000 mgr.gibba045.orlgmj (mgr.34412) 9209 : cluster [DBG] pgmap v5246: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:23.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:43:23 gibba015 bash[30343]: cluster 2021-03-10T16:43:22.588344+0000 mgr.gibba045.orlgmj (mgr.34412) 9209 : cluster [DBG] pgmap v5246: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:24.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:43:23 gibba045 bash[25517]: cluster 2021-03-10T16:43:22.588344+0000 mgr.gibba045.orlgmj (mgr.34412) 9209 : cluster [DBG] pgmap v5246: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:26.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:43:25 gibba045 bash[25517]: cephadm 2021-03-10T16:43:23.849402+0000 mgr.gibba045.orlgmj (mgr.34412) 9210 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:43:26.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:43:25 gibba045 bash[25517]: cluster 2021-03-10T16:43:24.589015+0000 mgr.gibba045.orlgmj (mgr.34412) 9211 : cluster [DBG] pgmap v5247: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:26.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:43:25 gibba015 bash[29377]: cephadm 2021-03-10T16:43:23.849402+0000 mgr.gibba045.orlgmj (mgr.34412) 9210 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:43:26.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:43:25 gibba015 bash[29377]: cluster 2021-03-10T16:43:24.589015+0000 mgr.gibba045.orlgmj (mgr.34412) 9211 : cluster [DBG] pgmap v5247: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:26.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:43:25 gibba015 bash[30343]: cephadm 2021-03-10T16:43:23.849402+0000 mgr.gibba045.orlgmj (mgr.34412) 9210 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:43:26.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:43:25 gibba015 bash[30343]: cluster 2021-03-10T16:43:24.589015+0000 mgr.gibba045.orlgmj (mgr.34412) 9211 : cluster [DBG] pgmap v5247: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:27.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:43:27 gibba015 bash[29377]: cluster 2021-03-10T16:43:26.590927+0000 mgr.gibba045.orlgmj (mgr.34412) 9212 : cluster [DBG] pgmap v5248: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:27.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:43:27 gibba015 bash[30343]: cluster 2021-03-10T16:43:26.590927+0000 mgr.gibba045.orlgmj (mgr.34412) 9212 : cluster [DBG] pgmap v5248: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:28.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:43:27 gibba045 bash[25517]: cluster 2021-03-10T16:43:26.590927+0000 mgr.gibba045.orlgmj (mgr.34412) 9212 : cluster [DBG] pgmap v5248: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:29.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:43:29 gibba015 bash[29377]: cluster 2021-03-10T16:43:28.592011+0000 mgr.gibba045.orlgmj (mgr.34412) 9213 : cluster [DBG] pgmap v5249: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:29.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:43:29 gibba015 bash[30343]: cluster 2021-03-10T16:43:28.592011+0000 mgr.gibba045.orlgmj (mgr.34412) 9213 : cluster [DBG] pgmap v5249: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:30.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:43:29 gibba045 bash[25517]: cluster 2021-03-10T16:43:28.592011+0000 mgr.gibba045.orlgmj (mgr.34412) 9213 : cluster [DBG] pgmap v5249: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:31.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:43:31 gibba015 bash[29377]: cluster 2021-03-10T16:43:30.593465+0000 mgr.gibba045.orlgmj (mgr.34412) 9214 : cluster [DBG] pgmap v5250: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:31.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:43:31 gibba015 bash[30343]: cluster 2021-03-10T16:43:30.593465+0000 mgr.gibba045.orlgmj (mgr.34412) 9214 : cluster [DBG] pgmap v5250: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:32.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:43:31 gibba045 bash[25517]: cluster 2021-03-10T16:43:30.593465+0000 mgr.gibba045.orlgmj (mgr.34412) 9214 : cluster [DBG] pgmap v5250: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:33.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:43:33 gibba015 bash[29377]: cluster 2021-03-10T16:43:32.594336+0000 mgr.gibba045.orlgmj (mgr.34412) 9215 : cluster [DBG] pgmap v5251: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:33.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:43:33 gibba015 bash[30343]: cluster 2021-03-10T16:43:32.594336+0000 mgr.gibba045.orlgmj (mgr.34412) 9215 : cluster [DBG] pgmap v5251: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:34.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:43:33 gibba045 bash[25517]: cluster 2021-03-10T16:43:32.594336+0000 mgr.gibba045.orlgmj (mgr.34412) 9215 : cluster [DBG] pgmap v5251: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:35.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:43:35 gibba015 bash[29377]: cluster 2021-03-10T16:43:34.595708+0000 mgr.gibba045.orlgmj (mgr.34412) 9216 : cluster [DBG] pgmap v5252: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:35.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:43:35 gibba015 bash[30343]: cluster 2021-03-10T16:43:34.595708+0000 mgr.gibba045.orlgmj (mgr.34412) 9216 : cluster [DBG] pgmap v5252: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:36.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:43:35 gibba045 bash[25517]: cluster 2021-03-10T16:43:34.595708+0000 mgr.gibba045.orlgmj (mgr.34412) 9216 : cluster [DBG] pgmap v5252: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:37.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:43:37 gibba015 bash[29377]: cluster 2021-03-10T16:43:36.596490+0000 mgr.gibba045.orlgmj (mgr.34412) 9217 : cluster [DBG] pgmap v5253: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:37.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:43:37 gibba015 bash[30343]: cluster 2021-03-10T16:43:36.596490+0000 mgr.gibba045.orlgmj (mgr.34412) 9217 : cluster [DBG] pgmap v5253: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:38.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:43:37 gibba045 bash[25517]: cluster 2021-03-10T16:43:36.596490+0000 mgr.gibba045.orlgmj (mgr.34412) 9217 : cluster [DBG] pgmap v5253: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:39.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:43:39 gibba015 bash[29377]: cluster 2021-03-10T16:43:38.597772+0000 mgr.gibba045.orlgmj (mgr.34412) 9218 : cluster [DBG] pgmap v5254: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:39.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:43:39 gibba015 bash[29377]: audit 2021-03-10T16:43:38.863896+0000 mon.c (mon.1) 2536 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:43:39.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:43:39 gibba015 bash[29377]: audit 2021-03-10T16:43:39.072919+0000 mon.a (mon.0) 2033 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:43:39.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:43:39 gibba015 bash[29377]: audit 2021-03-10T16:43:39.076761+0000 mon.a (mon.0) 2034 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:43:39.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:43:39 gibba015 bash[29377]: audit 2021-03-10T16:43:39.260867+0000 mon.a (mon.0) 2035 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:43:39.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:43:39 gibba015 bash[29377]: audit 2021-03-10T16:43:39.264469+0000 mon.c (mon.1) 2537 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:43:39.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:43:39 gibba015 bash[29377]: audit 2021-03-10T16:43:39.266065+0000 mon.c (mon.1) 2538 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:43:39.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:43:39 gibba015 bash[29377]: audit 2021-03-10T16:43:39.267765+0000 mon.c (mon.1) 2539 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:43:39.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:43:39 gibba015 bash[29377]: audit 2021-03-10T16:43:39.269372+0000 mon.c (mon.1) 2540 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:43:39.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:43:39 gibba015 bash[29377]: audit 2021-03-10T16:43:39.273168+0000 mon.c (mon.1) 2541 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:43:39.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:43:39 gibba015 bash[29377]: audit 2021-03-10T16:43:39.274910+0000 mon.c (mon.1) 2542 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:43:39.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:43:39 gibba015 bash[30343]: cluster 2021-03-10T16:43:38.597772+0000 mgr.gibba045.orlgmj (mgr.34412) 9218 : cluster [DBG] pgmap v5254: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:39.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:43:39 gibba015 bash[30343]: audit 2021-03-10T16:43:38.863896+0000 mon.c (mon.1) 2536 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:43:39.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:43:39 gibba015 bash[30343]: audit 2021-03-10T16:43:39.072919+0000 mon.a (mon.0) 2033 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:43:39.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:43:39 gibba015 bash[30343]: audit 2021-03-10T16:43:39.076761+0000 mon.a (mon.0) 2034 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:43:39.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:43:39 gibba015 bash[30343]: audit 2021-03-10T16:43:39.260867+0000 mon.a (mon.0) 2035 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:43:39.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:43:39 gibba015 bash[30343]: audit 2021-03-10T16:43:39.264469+0000 mon.c (mon.1) 2537 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:43:39.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:43:39 gibba015 bash[30343]: audit 2021-03-10T16:43:39.266065+0000 mon.c (mon.1) 2538 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:43:39.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:43:39 gibba015 bash[30343]: audit 2021-03-10T16:43:39.267765+0000 mon.c (mon.1) 2539 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:43:39.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:43:39 gibba015 bash[30343]: audit 2021-03-10T16:43:39.269372+0000 mon.c (mon.1) 2540 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:43:39.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:43:39 gibba015 bash[30343]: audit 2021-03-10T16:43:39.273168+0000 mon.c (mon.1) 2541 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:43:39.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:43:39 gibba015 bash[30343]: audit 2021-03-10T16:43:39.274910+0000 mon.c (mon.1) 2542 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:43:40.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:43:39 gibba045 bash[25517]: cluster 2021-03-10T16:43:38.597772+0000 mgr.gibba045.orlgmj (mgr.34412) 9218 : cluster [DBG] pgmap v5254: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:40.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:43:39 gibba045 bash[25517]: audit 2021-03-10T16:43:38.863896+0000 mon.c (mon.1) 2536 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:43:40.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:43:39 gibba045 bash[25517]: audit 2021-03-10T16:43:39.072919+0000 mon.a (mon.0) 2033 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:43:40.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:43:39 gibba045 bash[25517]: audit 2021-03-10T16:43:39.076761+0000 mon.a (mon.0) 2034 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:43:40.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:43:39 gibba045 bash[25517]: audit 2021-03-10T16:43:39.260867+0000 mon.a (mon.0) 2035 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:43:40.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:43:39 gibba045 bash[25517]: audit 2021-03-10T16:43:39.264469+0000 mon.c (mon.1) 2537 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:43:40.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:43:39 gibba045 bash[25517]: audit 2021-03-10T16:43:39.266065+0000 mon.c (mon.1) 2538 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:43:40.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:43:39 gibba045 bash[25517]: audit 2021-03-10T16:43:39.267765+0000 mon.c (mon.1) 2539 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:43:40.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:43:39 gibba045 bash[25517]: audit 2021-03-10T16:43:39.269372+0000 mon.c (mon.1) 2540 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:43:40.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:43:39 gibba045 bash[25517]: audit 2021-03-10T16:43:39.273168+0000 mon.c (mon.1) 2541 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:43:40.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:43:39 gibba045 bash[25517]: audit 2021-03-10T16:43:39.274910+0000 mon.c (mon.1) 2542 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:43:40.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:43:40 gibba015 bash[29377]: cephadm 2021-03-10T16:43:39.076628+0000 mgr.gibba045.orlgmj (mgr.34412) 9219 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:43:40.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:43:40 gibba015 bash[29377]: cephadm 2021-03-10T16:43:39.080165+0000 mgr.gibba045.orlgmj (mgr.34412) 9220 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:43:40.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:43:40 gibba015 bash[29377]: cephadm 2021-03-10T16:43:39.266220+0000 mgr.gibba045.orlgmj (mgr.34412) 9221 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:43:40.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:43:40 gibba015 bash[29377]: cephadm 2021-03-10T16:43:39.267888+0000 mgr.gibba045.orlgmj (mgr.34412) 9222 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:43:40.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:43:40 gibba015 bash[29377]: cephadm 2021-03-10T16:43:39.269684+0000 mgr.gibba045.orlgmj (mgr.34412) 9223 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:43:40.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:43:40 gibba015 bash[29377]: cephadm 2021-03-10T16:43:39.269719+0000 mgr.gibba045.orlgmj (mgr.34412) 9224 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:43:40.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:43:40 gibba015 bash[29377]: cephadm 2021-03-10T16:43:39.271247+0000 mgr.gibba045.orlgmj (mgr.34412) 9225 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:43:40.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:43:40 gibba015 bash[29377]: cephadm 2021-03-10T16:43:39.271280+0000 mgr.gibba045.orlgmj (mgr.34412) 9226 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:43:40.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:43:40 gibba015 bash[29377]: cephadm 2021-03-10T16:43:39.272769+0000 mgr.gibba045.orlgmj (mgr.34412) 9227 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:43:40.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:43:40 gibba015 bash[29377]: cephadm 2021-03-10T16:43:39.274909+0000 mgr.gibba045.orlgmj (mgr.34412) 9228 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:43:40.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:43:40 gibba015 bash[29377]: cephadm 2021-03-10T16:43:39.274946+0000 mgr.gibba045.orlgmj (mgr.34412) 9229 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:43:40.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:43:40 gibba015 bash[29377]: cephadm 2021-03-10T16:43:39.276551+0000 mgr.gibba045.orlgmj (mgr.34412) 9230 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:43:40.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:43:40 gibba015 bash[29377]: cephadm 2021-03-10T16:43:39.276873+0000 mgr.gibba045.orlgmj (mgr.34412) 9231 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:43:40.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:43:40 gibba015 bash[29377]: cephadm 2021-03-10T16:43:39.278679+0000 mgr.gibba045.orlgmj (mgr.34412) 9232 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:43:40.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:43:40 gibba015 bash[29377]: cephadm 2021-03-10T16:43:39.278716+0000 mgr.gibba045.orlgmj (mgr.34412) 9233 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:43:40.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:43:40 gibba015 bash[29377]: cephadm 2021-03-10T16:43:39.278869+0000 mgr.gibba045.orlgmj (mgr.34412) 9234 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:43:40.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:43:40 gibba015 bash[30343]: cephadm 2021-03-10T16:43:39.076628+0000 mgr.gibba045.orlgmj (mgr.34412) 9219 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:43:40.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:43:40 gibba015 bash[30343]: cephadm 2021-03-10T16:43:39.080165+0000 mgr.gibba045.orlgmj (mgr.34412) 9220 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:43:40.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:43:40 gibba015 bash[30343]: cephadm 2021-03-10T16:43:39.266220+0000 mgr.gibba045.orlgmj (mgr.34412) 9221 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:43:40.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:43:40 gibba015 bash[30343]: cephadm 2021-03-10T16:43:39.267888+0000 mgr.gibba045.orlgmj (mgr.34412) 9222 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:43:40.984 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:43:40 gibba015 bash[30343]: cephadm 2021-03-10T16:43:39.269684+0000 mgr.gibba045.orlgmj (mgr.34412) 9223 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:43:40.986 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:43:40 gibba015 bash[30343]: cephadm 2021-03-10T16:43:39.269719+0000 mgr.gibba045.orlgmj (mgr.34412) 9224 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:43:40.986 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:43:40 gibba015 bash[30343]: cephadm 2021-03-10T16:43:39.271247+0000 mgr.gibba045.orlgmj (mgr.34412) 9225 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:43:40.986 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:43:40 gibba015 bash[30343]: cephadm 2021-03-10T16:43:39.271280+0000 mgr.gibba045.orlgmj (mgr.34412) 9226 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:43:40.987 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:43:40 gibba015 bash[30343]: cephadm 2021-03-10T16:43:39.272769+0000 mgr.gibba045.orlgmj (mgr.34412) 9227 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:43:40.987 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:43:40 gibba015 bash[30343]: cephadm 2021-03-10T16:43:39.274909+0000 mgr.gibba045.orlgmj (mgr.34412) 9228 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:43:40.987 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:43:40 gibba015 bash[30343]: cephadm 2021-03-10T16:43:39.274946+0000 mgr.gibba045.orlgmj (mgr.34412) 9229 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:43:40.987 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:43:40 gibba015 bash[30343]: cephadm 2021-03-10T16:43:39.276551+0000 mgr.gibba045.orlgmj (mgr.34412) 9230 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:43:40.987 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:43:40 gibba015 bash[30343]: cephadm 2021-03-10T16:43:39.276873+0000 mgr.gibba045.orlgmj (mgr.34412) 9231 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:43:40.988 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:43:40 gibba015 bash[30343]: cephadm 2021-03-10T16:43:39.278679+0000 mgr.gibba045.orlgmj (mgr.34412) 9232 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:43:40.988 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:43:40 gibba015 bash[30343]: cephadm 2021-03-10T16:43:39.278716+0000 mgr.gibba045.orlgmj (mgr.34412) 9233 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:43:40.993 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:43:40 gibba015 bash[30343]: cephadm 2021-03-10T16:43:39.278869+0000 mgr.gibba045.orlgmj (mgr.34412) 9234 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:43:41.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:43:40 gibba045 bash[25517]: cephadm 2021-03-10T16:43:39.076628+0000 mgr.gibba045.orlgmj (mgr.34412) 9219 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:43:41.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:43:40 gibba045 bash[25517]: cephadm 2021-03-10T16:43:39.080165+0000 mgr.gibba045.orlgmj (mgr.34412) 9220 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:43:41.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:43:40 gibba045 bash[25517]: cephadm 2021-03-10T16:43:39.266220+0000 mgr.gibba045.orlgmj (mgr.34412) 9221 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:43:41.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:43:40 gibba045 bash[25517]: cephadm 2021-03-10T16:43:39.267888+0000 mgr.gibba045.orlgmj (mgr.34412) 9222 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:43:41.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:43:40 gibba045 bash[25517]: cephadm 2021-03-10T16:43:39.269684+0000 mgr.gibba045.orlgmj (mgr.34412) 9223 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:43:41.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:43:40 gibba045 bash[25517]: cephadm 2021-03-10T16:43:39.269719+0000 mgr.gibba045.orlgmj (mgr.34412) 9224 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:43:41.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:43:40 gibba045 bash[25517]: cephadm 2021-03-10T16:43:39.271247+0000 mgr.gibba045.orlgmj (mgr.34412) 9225 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:43:41.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:43:40 gibba045 bash[25517]: cephadm 2021-03-10T16:43:39.271280+0000 mgr.gibba045.orlgmj (mgr.34412) 9226 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:43:41.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:43:40 gibba045 bash[25517]: cephadm 2021-03-10T16:43:39.272769+0000 mgr.gibba045.orlgmj (mgr.34412) 9227 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:43:41.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:43:40 gibba045 bash[25517]: cephadm 2021-03-10T16:43:39.274909+0000 mgr.gibba045.orlgmj (mgr.34412) 9228 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:43:41.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:43:40 gibba045 bash[25517]: cephadm 2021-03-10T16:43:39.274946+0000 mgr.gibba045.orlgmj (mgr.34412) 9229 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:43:41.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:43:40 gibba045 bash[25517]: cephadm 2021-03-10T16:43:39.276551+0000 mgr.gibba045.orlgmj (mgr.34412) 9230 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:43:41.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:43:40 gibba045 bash[25517]: cephadm 2021-03-10T16:43:39.276873+0000 mgr.gibba045.orlgmj (mgr.34412) 9231 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:43:41.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:43:40 gibba045 bash[25517]: cephadm 2021-03-10T16:43:39.278679+0000 mgr.gibba045.orlgmj (mgr.34412) 9232 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:43:41.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:43:40 gibba045 bash[25517]: cephadm 2021-03-10T16:43:39.278716+0000 mgr.gibba045.orlgmj (mgr.34412) 9233 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:43:41.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:43:40 gibba045 bash[25517]: cephadm 2021-03-10T16:43:39.278869+0000 mgr.gibba045.orlgmj (mgr.34412) 9234 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:43:41.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:43:41 gibba015 bash[29377]: cluster 2021-03-10T16:43:40.598936+0000 mgr.gibba045.orlgmj (mgr.34412) 9235 : cluster [DBG] pgmap v5255: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:41.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:43:41 gibba015 bash[30343]: cluster 2021-03-10T16:43:40.598936+0000 mgr.gibba045.orlgmj (mgr.34412) 9235 : cluster [DBG] pgmap v5255: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:42.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:43:41 gibba045 bash[25517]: cluster 2021-03-10T16:43:40.598936+0000 mgr.gibba045.orlgmj (mgr.34412) 9235 : cluster [DBG] pgmap v5255: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:43.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:43:43 gibba015 bash[29377]: cluster 2021-03-10T16:43:42.600764+0000 mgr.gibba045.orlgmj (mgr.34412) 9236 : cluster [DBG] pgmap v5256: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:43.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:43:43 gibba015 bash[30343]: cluster 2021-03-10T16:43:42.600764+0000 mgr.gibba045.orlgmj (mgr.34412) 9236 : cluster [DBG] pgmap v5256: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:44.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:43:43 gibba045 bash[25517]: cluster 2021-03-10T16:43:42.600764+0000 mgr.gibba045.orlgmj (mgr.34412) 9236 : cluster [DBG] pgmap v5256: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:45.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:43:45 gibba015 bash[29377]: cluster 2021-03-10T16:43:44.601978+0000 mgr.gibba045.orlgmj (mgr.34412) 9237 : cluster [DBG] pgmap v5257: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:45.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:43:45 gibba015 bash[30343]: cluster 2021-03-10T16:43:44.601978+0000 mgr.gibba045.orlgmj (mgr.34412) 9237 : cluster [DBG] pgmap v5257: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:46.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:43:45 gibba045 bash[25517]: cluster 2021-03-10T16:43:44.601978+0000 mgr.gibba045.orlgmj (mgr.34412) 9237 : cluster [DBG] pgmap v5257: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:46.242 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:43:46.473 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:43:46.473 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 7m ago 2h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:43:46.473 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (2h) 6m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:43:46.474 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:43:46.474 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:43:46.474 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:43:46.474 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:43:46.475 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:43:46.475 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:43:46.475 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (2h) 7m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:43:46.475 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 6m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:43:46.475 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:43:46.476 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:43:46.476 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:43:46.476 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:43:46.476 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:43:46.477 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:43:46.477 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:43:46.477 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:43:46.477 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 6m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:43:46.477 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 6m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:43:46.723 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:43:46.723 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:43:46.724 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:43:46.724 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:43:46.724 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:43:46.724 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:43:46.725 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:43:46.725 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:43:46.725 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:43:46.725 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:43:46.725 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:43:46.726 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:43:46.726 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:43:46.726 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:43:46.726 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:43:47.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:43:47 gibba015 bash[29377]: audit 2021-03-10T16:43:46.236696+0000 mgr.gibba045.orlgmj (mgr.34412) 9238 : audit [DBG] from='client.50244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:43:47.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:43:47 gibba015 bash[29377]: audit 2021-03-10T16:43:46.464059+0000 mgr.gibba045.orlgmj (mgr.34412) 9239 : audit [DBG] from='client.60238 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:43:47.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:43:47 gibba015 bash[29377]: cluster 2021-03-10T16:43:46.604026+0000 mgr.gibba045.orlgmj (mgr.34412) 9240 : cluster [DBG] pgmap v5258: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:47.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:43:47 gibba015 bash[29377]: audit 2021-03-10T16:43:46.724407+0000 mon.c (mon.1) 2543 : audit [DBG] from='client.? 172.21.2.115:0/249886864' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:43:47.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:43:47 gibba015 bash[30343]: audit 2021-03-10T16:43:46.236696+0000 mgr.gibba045.orlgmj (mgr.34412) 9238 : audit [DBG] from='client.50244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:43:47.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:43:47 gibba015 bash[30343]: audit 2021-03-10T16:43:46.464059+0000 mgr.gibba045.orlgmj (mgr.34412) 9239 : audit [DBG] from='client.60238 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:43:47.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:43:47 gibba015 bash[30343]: cluster 2021-03-10T16:43:46.604026+0000 mgr.gibba045.orlgmj (mgr.34412) 9240 : cluster [DBG] pgmap v5258: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:47.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:43:47 gibba015 bash[30343]: audit 2021-03-10T16:43:46.724407+0000 mon.c (mon.1) 2543 : audit [DBG] from='client.? 172.21.2.115:0/249886864' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:43:48.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:43:47 gibba045 bash[25517]: audit 2021-03-10T16:43:46.236696+0000 mgr.gibba045.orlgmj (mgr.34412) 9238 : audit [DBG] from='client.50244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:43:48.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:43:47 gibba045 bash[25517]: audit 2021-03-10T16:43:46.464059+0000 mgr.gibba045.orlgmj (mgr.34412) 9239 : audit [DBG] from='client.60238 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:43:48.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:43:47 gibba045 bash[25517]: cluster 2021-03-10T16:43:46.604026+0000 mgr.gibba045.orlgmj (mgr.34412) 9240 : cluster [DBG] pgmap v5258: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:48.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:43:47 gibba045 bash[25517]: audit 2021-03-10T16:43:46.724407+0000 mon.c (mon.1) 2543 : audit [DBG] from='client.? 172.21.2.115:0/249886864' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:43:49.968 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:43:49 gibba015 bash[29377]: cluster 2021-03-10T16:43:48.604937+0000 mgr.gibba045.orlgmj (mgr.34412) 9241 : cluster [DBG] pgmap v5259: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:49.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:43:49 gibba015 bash[30343]: cluster 2021-03-10T16:43:48.604937+0000 mgr.gibba045.orlgmj (mgr.34412) 9241 : cluster [DBG] pgmap v5259: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:50.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:43:49 gibba045 bash[25517]: cluster 2021-03-10T16:43:48.604937+0000 mgr.gibba045.orlgmj (mgr.34412) 9241 : cluster [DBG] pgmap v5259: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:51.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:43:51 gibba015 bash[29377]: cluster 2021-03-10T16:43:50.606554+0000 mgr.gibba045.orlgmj (mgr.34412) 9242 : cluster [DBG] pgmap v5260: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:51.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:43:51 gibba015 bash[30343]: cluster 2021-03-10T16:43:50.606554+0000 mgr.gibba045.orlgmj (mgr.34412) 9242 : cluster [DBG] pgmap v5260: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:52.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:43:51 gibba045 bash[25517]: cluster 2021-03-10T16:43:50.606554+0000 mgr.gibba045.orlgmj (mgr.34412) 9242 : cluster [DBG] pgmap v5260: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:53.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:43:53 gibba015 bash[29377]: cluster 2021-03-10T16:43:52.608038+0000 mgr.gibba045.orlgmj (mgr.34412) 9243 : cluster [DBG] pgmap v5261: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:53.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:43:53 gibba015 bash[30343]: cluster 2021-03-10T16:43:52.608038+0000 mgr.gibba045.orlgmj (mgr.34412) 9243 : cluster [DBG] pgmap v5261: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:54.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:43:53 gibba045 bash[25517]: cluster 2021-03-10T16:43:52.608038+0000 mgr.gibba045.orlgmj (mgr.34412) 9243 : cluster [DBG] pgmap v5261: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:54.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:43:54 gibba015 bash[29377]: audit 2021-03-10T16:43:53.704710+0000 mon.c (mon.1) 2544 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:43:54.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:43:54 gibba015 bash[29377]: audit 2021-03-10T16:43:53.705456+0000 mon.c (mon.1) 2545 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:43:54.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:43:54 gibba015 bash[29377]: audit 2021-03-10T16:43:53.705863+0000 mon.a (mon.0) 2036 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:43:54.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:43:54 gibba015 bash[29377]: audit 2021-03-10T16:43:53.706917+0000 mon.a (mon.0) 2037 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:43:54.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:43:54 gibba015 bash[29377]: audit 2021-03-10T16:43:53.727107+0000 mon.c (mon.1) 2546 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T16:43:54.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:43:54 gibba015 bash[29377]: audit 2021-03-10T16:43:53.727801+0000 mon.c (mon.1) 2547 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:43:54.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:43:54 gibba015 bash[29377]: audit 2021-03-10T16:43:53.728146+0000 mon.a (mon.0) 2038 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T16:43:54.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:43:54 gibba015 bash[29377]: audit 2021-03-10T16:43:53.728478+0000 mon.c (mon.1) 2548 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:43:54.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:43:54 gibba015 bash[29377]: audit 2021-03-10T16:43:53.729326+0000 mon.c (mon.1) 2549 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:43:54.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:43:54 gibba015 bash[29377]: audit 2021-03-10T16:43:53.729377+0000 mon.a (mon.0) 2039 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:43:54.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:43:54 gibba015 bash[29377]: audit 2021-03-10T16:43:53.730557+0000 mon.a (mon.0) 2040 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:43:54.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:43:54 gibba015 bash[29377]: audit 2021-03-10T16:43:53.731323+0000 mon.a (mon.0) 2041 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:43:54.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:43:54 gibba015 bash[30343]: audit 2021-03-10T16:43:53.704710+0000 mon.c (mon.1) 2544 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:43:54.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:43:54 gibba015 bash[30343]: audit 2021-03-10T16:43:53.705456+0000 mon.c (mon.1) 2545 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:43:54.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:43:54 gibba015 bash[30343]: audit 2021-03-10T16:43:53.705863+0000 mon.a (mon.0) 2036 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:43:54.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:43:54 gibba015 bash[30343]: audit 2021-03-10T16:43:53.706917+0000 mon.a (mon.0) 2037 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:43:54.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:43:54 gibba015 bash[30343]: audit 2021-03-10T16:43:53.727107+0000 mon.c (mon.1) 2546 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T16:43:54.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:43:54 gibba015 bash[30343]: audit 2021-03-10T16:43:53.727801+0000 mon.c (mon.1) 2547 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:43:54.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:43:54 gibba015 bash[30343]: audit 2021-03-10T16:43:53.728146+0000 mon.a (mon.0) 2038 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T16:43:54.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:43:54 gibba015 bash[30343]: audit 2021-03-10T16:43:53.728478+0000 mon.c (mon.1) 2548 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:43:54.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:43:54 gibba015 bash[30343]: audit 2021-03-10T16:43:53.729326+0000 mon.c (mon.1) 2549 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:43:54.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:43:54 gibba015 bash[30343]: audit 2021-03-10T16:43:53.729377+0000 mon.a (mon.0) 2039 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:43:54.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:43:54 gibba015 bash[30343]: audit 2021-03-10T16:43:53.730557+0000 mon.a (mon.0) 2040 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:43:54.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:43:54 gibba015 bash[30343]: audit 2021-03-10T16:43:53.731323+0000 mon.a (mon.0) 2041 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:43:55.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:43:54 gibba045 bash[25517]: audit 2021-03-10T16:43:53.704710+0000 mon.c (mon.1) 2544 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:43:55.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:43:54 gibba045 bash[25517]: audit 2021-03-10T16:43:53.705456+0000 mon.c (mon.1) 2545 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:43:55.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:43:54 gibba045 bash[25517]: audit 2021-03-10T16:43:53.705863+0000 mon.a (mon.0) 2036 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:43:55.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:43:54 gibba045 bash[25517]: audit 2021-03-10T16:43:53.706917+0000 mon.a (mon.0) 2037 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:43:55.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:43:54 gibba045 bash[25517]: audit 2021-03-10T16:43:53.727107+0000 mon.c (mon.1) 2546 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T16:43:55.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:43:54 gibba045 bash[25517]: audit 2021-03-10T16:43:53.727801+0000 mon.c (mon.1) 2547 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:43:55.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:43:54 gibba045 bash[25517]: audit 2021-03-10T16:43:53.728146+0000 mon.a (mon.0) 2038 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T16:43:55.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:43:54 gibba045 bash[25517]: audit 2021-03-10T16:43:53.728478+0000 mon.c (mon.1) 2548 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:43:55.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:43:54 gibba045 bash[25517]: audit 2021-03-10T16:43:53.729326+0000 mon.c (mon.1) 2549 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:43:55.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:43:54 gibba045 bash[25517]: audit 2021-03-10T16:43:53.729377+0000 mon.a (mon.0) 2039 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:43:55.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:43:54 gibba045 bash[25517]: audit 2021-03-10T16:43:53.730557+0000 mon.a (mon.0) 2040 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:43:55.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:43:54 gibba045 bash[25517]: audit 2021-03-10T16:43:53.731323+0000 mon.a (mon.0) 2041 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:43:55.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:43:55 gibba015 bash[29377]: cephadm 2021-03-10T16:43:54.284599+0000 mgr.gibba045.orlgmj (mgr.34412) 9244 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:43:55.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:43:55 gibba015 bash[29377]: cluster 2021-03-10T16:43:54.609419+0000 mgr.gibba045.orlgmj (mgr.34412) 9245 : cluster [DBG] pgmap v5262: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:55.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:43:55 gibba015 bash[30343]: cephadm 2021-03-10T16:43:54.284599+0000 mgr.gibba045.orlgmj (mgr.34412) 9244 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:43:55.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:43:55 gibba015 bash[30343]: cluster 2021-03-10T16:43:54.609419+0000 mgr.gibba045.orlgmj (mgr.34412) 9245 : cluster [DBG] pgmap v5262: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:56.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:43:55 gibba045 bash[25517]: cephadm 2021-03-10T16:43:54.284599+0000 mgr.gibba045.orlgmj (mgr.34412) 9244 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:43:56.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:43:55 gibba045 bash[25517]: cluster 2021-03-10T16:43:54.609419+0000 mgr.gibba045.orlgmj (mgr.34412) 9245 : cluster [DBG] pgmap v5262: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:57.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:43:57 gibba015 bash[29377]: cluster 2021-03-10T16:43:56.610591+0000 mgr.gibba045.orlgmj (mgr.34412) 9246 : cluster [DBG] pgmap v5263: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:57.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:43:57 gibba015 bash[30343]: cluster 2021-03-10T16:43:56.610591+0000 mgr.gibba045.orlgmj (mgr.34412) 9246 : cluster [DBG] pgmap v5263: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:58.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:43:57 gibba045 bash[25517]: cluster 2021-03-10T16:43:56.610591+0000 mgr.gibba045.orlgmj (mgr.34412) 9246 : cluster [DBG] pgmap v5263: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:59.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:43:59 gibba015 bash[29377]: cluster 2021-03-10T16:43:58.611893+0000 mgr.gibba045.orlgmj (mgr.34412) 9247 : cluster [DBG] pgmap v5264: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:59.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:43:59 gibba015 bash[30343]: cluster 2021-03-10T16:43:58.611893+0000 mgr.gibba045.orlgmj (mgr.34412) 9247 : cluster [DBG] pgmap v5264: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:00.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:43:59 gibba045 bash[25517]: cluster 2021-03-10T16:43:58.611893+0000 mgr.gibba045.orlgmj (mgr.34412) 9247 : cluster [DBG] pgmap v5264: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:01.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:44:01 gibba015 bash[29377]: cluster 2021-03-10T16:44:00.613447+0000 mgr.gibba045.orlgmj (mgr.34412) 9248 : cluster [DBG] pgmap v5265: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:01.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:44:01 gibba015 bash[30343]: cluster 2021-03-10T16:44:00.613447+0000 mgr.gibba045.orlgmj (mgr.34412) 9248 : cluster [DBG] pgmap v5265: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:02.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:44:01 gibba045 bash[25517]: cluster 2021-03-10T16:44:00.613447+0000 mgr.gibba045.orlgmj (mgr.34412) 9248 : cluster [DBG] pgmap v5265: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:03.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:44:03 gibba015 bash[29377]: cluster 2021-03-10T16:44:02.615137+0000 mgr.gibba045.orlgmj (mgr.34412) 9249 : cluster [DBG] pgmap v5266: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:03.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:44:03 gibba015 bash[30343]: cluster 2021-03-10T16:44:02.615137+0000 mgr.gibba045.orlgmj (mgr.34412) 9249 : cluster [DBG] pgmap v5266: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:04.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:44:03 gibba045 bash[25517]: cluster 2021-03-10T16:44:02.615137+0000 mgr.gibba045.orlgmj (mgr.34412) 9249 : cluster [DBG] pgmap v5266: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:05.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:44:05 gibba015 bash[29377]: cluster 2021-03-10T16:44:04.616509+0000 mgr.gibba045.orlgmj (mgr.34412) 9250 : cluster [DBG] pgmap v5267: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:05.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:44:05 gibba015 bash[30343]: cluster 2021-03-10T16:44:04.616509+0000 mgr.gibba045.orlgmj (mgr.34412) 9250 : cluster [DBG] pgmap v5267: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:06.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:44:05 gibba045 bash[25517]: cluster 2021-03-10T16:44:04.616509+0000 mgr.gibba045.orlgmj (mgr.34412) 9250 : cluster [DBG] pgmap v5267: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:07.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:44:07 gibba015 bash[29377]: cluster 2021-03-10T16:44:06.618081+0000 mgr.gibba045.orlgmj (mgr.34412) 9251 : cluster [DBG] pgmap v5268: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:07.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:44:07 gibba015 bash[30343]: cluster 2021-03-10T16:44:06.618081+0000 mgr.gibba045.orlgmj (mgr.34412) 9251 : cluster [DBG] pgmap v5268: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:08.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:44:07 gibba045 bash[25517]: cluster 2021-03-10T16:44:06.618081+0000 mgr.gibba045.orlgmj (mgr.34412) 9251 : cluster [DBG] pgmap v5268: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:09.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:44:09 gibba015 bash[29377]: cluster 2021-03-10T16:44:08.619463+0000 mgr.gibba045.orlgmj (mgr.34412) 9252 : cluster [DBG] pgmap v5269: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:09.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:44:09 gibba015 bash[30343]: cluster 2021-03-10T16:44:08.619463+0000 mgr.gibba045.orlgmj (mgr.34412) 9252 : cluster [DBG] pgmap v5269: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:10.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:44:09 gibba045 bash[25517]: cluster 2021-03-10T16:44:08.619463+0000 mgr.gibba045.orlgmj (mgr.34412) 9252 : cluster [DBG] pgmap v5269: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:10.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:44:10 gibba015 bash[29377]: cephadm 2021-03-10T16:44:09.300538+0000 mgr.gibba045.orlgmj (mgr.34412) 9253 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:44:10.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:44:10 gibba015 bash[30343]: cephadm 2021-03-10T16:44:09.300538+0000 mgr.gibba045.orlgmj (mgr.34412) 9253 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:44:11.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:44:10 gibba045 bash[25517]: cephadm 2021-03-10T16:44:09.300538+0000 mgr.gibba045.orlgmj (mgr.34412) 9253 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:44:11.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:44:11 gibba015 bash[29377]: cluster 2021-03-10T16:44:10.621205+0000 mgr.gibba045.orlgmj (mgr.34412) 9254 : cluster [DBG] pgmap v5270: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:11.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:44:11 gibba015 bash[30343]: cluster 2021-03-10T16:44:10.621205+0000 mgr.gibba045.orlgmj (mgr.34412) 9254 : cluster [DBG] pgmap v5270: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:12.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:44:11 gibba045 bash[25517]: cluster 2021-03-10T16:44:10.621205+0000 mgr.gibba045.orlgmj (mgr.34412) 9254 : cluster [DBG] pgmap v5270: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:13.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:44:13 gibba015 bash[29377]: cluster 2021-03-10T16:44:12.622608+0000 mgr.gibba045.orlgmj (mgr.34412) 9255 : cluster [DBG] pgmap v5271: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:13.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:44:13 gibba015 bash[30343]: cluster 2021-03-10T16:44:12.622608+0000 mgr.gibba045.orlgmj (mgr.34412) 9255 : cluster [DBG] pgmap v5271: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:14.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:44:13 gibba045 bash[25517]: cluster 2021-03-10T16:44:12.622608+0000 mgr.gibba045.orlgmj (mgr.34412) 9255 : cluster [DBG] pgmap v5271: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:15.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:44:15 gibba015 bash[29377]: cluster 2021-03-10T16:44:14.624256+0000 mgr.gibba045.orlgmj (mgr.34412) 9256 : cluster [DBG] pgmap v5272: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:15.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:44:15 gibba015 bash[30343]: cluster 2021-03-10T16:44:14.624256+0000 mgr.gibba045.orlgmj (mgr.34412) 9256 : cluster [DBG] pgmap v5272: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:16.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:44:15 gibba045 bash[25517]: cluster 2021-03-10T16:44:14.624256+0000 mgr.gibba045.orlgmj (mgr.34412) 9256 : cluster [DBG] pgmap v5272: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:16.970 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:44:17.196 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:44:17.196 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 7m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:44:17.196 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 6m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:44:17.197 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:44:17.197 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:44:17.197 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:44:17.197 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:44:17.198 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:44:17.198 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:44:17.198 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 7m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:44:17.198 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 6m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:44:17.199 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:44:17.199 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:44:17.199 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:44:17.199 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:44:17.200 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:44:17.200 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:44:17.200 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:44:17.200 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:44:17.203 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (2h) 6m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:44:17.204 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 6m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:44:17.447 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:44:17.447 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:44:17.448 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:44:17.448 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:44:17.448 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:44:17.448 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:44:17.449 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:44:17.449 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:44:17.449 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:44:17.449 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:44:17.449 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:44:17.450 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:44:17.452 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:44:17.452 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:44:17.453 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:44:17.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:44:17 gibba015 bash[29377]: cluster 2021-03-10T16:44:16.625289+0000 mgr.gibba045.orlgmj (mgr.34412) 9257 : cluster [DBG] pgmap v5273: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:17.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:44:17 gibba015 bash[29377]: audit 2021-03-10T16:44:17.448665+0000 mon.a (mon.0) 2042 : audit [DBG] from='client.? 172.21.2.115:0/2420770150' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:44:17.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:44:17 gibba015 bash[30343]: cluster 2021-03-10T16:44:16.625289+0000 mgr.gibba045.orlgmj (mgr.34412) 9257 : cluster [DBG] pgmap v5273: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:17.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:44:17 gibba015 bash[30343]: audit 2021-03-10T16:44:17.448665+0000 mon.a (mon.0) 2042 : audit [DBG] from='client.? 172.21.2.115:0/2420770150' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:44:18.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:44:17 gibba045 bash[25517]: cluster 2021-03-10T16:44:16.625289+0000 mgr.gibba045.orlgmj (mgr.34412) 9257 : cluster [DBG] pgmap v5273: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:18.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:44:17 gibba045 bash[25517]: audit 2021-03-10T16:44:17.448665+0000 mon.a (mon.0) 2042 : audit [DBG] from='client.? 172.21.2.115:0/2420770150' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:44:18.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:44:18 gibba015 bash[29377]: audit 2021-03-10T16:44:16.964712+0000 mgr.gibba045.orlgmj (mgr.34412) 9258 : audit [DBG] from='client.50262 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:44:18.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:44:18 gibba015 bash[29377]: audit 2021-03-10T16:44:17.187618+0000 mgr.gibba045.orlgmj (mgr.34412) 9259 : audit [DBG] from='client.50268 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:44:18.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:44:18 gibba015 bash[30343]: audit 2021-03-10T16:44:16.964712+0000 mgr.gibba045.orlgmj (mgr.34412) 9258 : audit [DBG] from='client.50262 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:44:18.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:44:18 gibba015 bash[30343]: audit 2021-03-10T16:44:17.187618+0000 mgr.gibba045.orlgmj (mgr.34412) 9259 : audit [DBG] from='client.50268 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:44:19.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:44:18 gibba045 bash[25517]: audit 2021-03-10T16:44:16.964712+0000 mgr.gibba045.orlgmj (mgr.34412) 9258 : audit [DBG] from='client.50262 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:44:19.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:44:18 gibba045 bash[25517]: audit 2021-03-10T16:44:17.187618+0000 mgr.gibba045.orlgmj (mgr.34412) 9259 : audit [DBG] from='client.50268 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:44:19.968 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:44:19 gibba015 bash[29377]: cluster 2021-03-10T16:44:18.625753+0000 mgr.gibba045.orlgmj (mgr.34412) 9260 : cluster [DBG] pgmap v5274: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:19.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:44:19 gibba015 bash[30343]: cluster 2021-03-10T16:44:18.625753+0000 mgr.gibba045.orlgmj (mgr.34412) 9260 : cluster [DBG] pgmap v5274: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:20.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:44:19 gibba045 bash[25517]: cluster 2021-03-10T16:44:18.625753+0000 mgr.gibba045.orlgmj (mgr.34412) 9260 : cluster [DBG] pgmap v5274: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:21.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:44:21 gibba015 bash[29377]: cluster 2021-03-10T16:44:20.626818+0000 mgr.gibba045.orlgmj (mgr.34412) 9261 : cluster [DBG] pgmap v5275: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:21.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:44:21 gibba015 bash[30343]: cluster 2021-03-10T16:44:20.626818+0000 mgr.gibba045.orlgmj (mgr.34412) 9261 : cluster [DBG] pgmap v5275: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:22.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:44:21 gibba045 bash[25517]: cluster 2021-03-10T16:44:20.626818+0000 mgr.gibba045.orlgmj (mgr.34412) 9261 : cluster [DBG] pgmap v5275: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:23.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:44:23 gibba015 bash[29377]: cluster 2021-03-10T16:44:22.628228+0000 mgr.gibba045.orlgmj (mgr.34412) 9262 : cluster [DBG] pgmap v5276: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:23.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:44:23 gibba015 bash[30343]: cluster 2021-03-10T16:44:22.628228+0000 mgr.gibba045.orlgmj (mgr.34412) 9262 : cluster [DBG] pgmap v5276: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:24.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:44:23 gibba045 bash[25517]: cluster 2021-03-10T16:44:22.628228+0000 mgr.gibba045.orlgmj (mgr.34412) 9262 : cluster [DBG] pgmap v5276: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:25.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:44:25 gibba015 bash[29377]: cephadm 2021-03-10T16:44:24.313270+0000 mgr.gibba045.orlgmj (mgr.34412) 9263 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:44:25.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:44:25 gibba015 bash[29377]: cluster 2021-03-10T16:44:24.629745+0000 mgr.gibba045.orlgmj (mgr.34412) 9264 : cluster [DBG] pgmap v5277: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:25.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:44:25 gibba015 bash[30343]: cephadm 2021-03-10T16:44:24.313270+0000 mgr.gibba045.orlgmj (mgr.34412) 9263 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:44:25.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:44:25 gibba015 bash[30343]: cluster 2021-03-10T16:44:24.629745+0000 mgr.gibba045.orlgmj (mgr.34412) 9264 : cluster [DBG] pgmap v5277: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:26.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:44:25 gibba045 bash[25517]: cephadm 2021-03-10T16:44:24.313270+0000 mgr.gibba045.orlgmj (mgr.34412) 9263 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:44:26.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:44:25 gibba045 bash[25517]: cluster 2021-03-10T16:44:24.629745+0000 mgr.gibba045.orlgmj (mgr.34412) 9264 : cluster [DBG] pgmap v5277: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:27.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:44:27 gibba015 bash[29377]: cluster 2021-03-10T16:44:26.630616+0000 mgr.gibba045.orlgmj (mgr.34412) 9265 : cluster [DBG] pgmap v5278: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:27.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:44:27 gibba015 bash[30343]: cluster 2021-03-10T16:44:26.630616+0000 mgr.gibba045.orlgmj (mgr.34412) 9265 : cluster [DBG] pgmap v5278: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:28.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:44:27 gibba045 bash[25517]: cluster 2021-03-10T16:44:26.630616+0000 mgr.gibba045.orlgmj (mgr.34412) 9265 : cluster [DBG] pgmap v5278: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:29.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:44:29 gibba015 bash[29377]: cluster 2021-03-10T16:44:28.631709+0000 mgr.gibba045.orlgmj (mgr.34412) 9266 : cluster [DBG] pgmap v5279: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:29.987 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:44:29 gibba015 bash[30343]: cluster 2021-03-10T16:44:28.631709+0000 mgr.gibba045.orlgmj (mgr.34412) 9266 : cluster [DBG] pgmap v5279: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:30.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:44:29 gibba045 bash[25517]: cluster 2021-03-10T16:44:28.631709+0000 mgr.gibba045.orlgmj (mgr.34412) 9266 : cluster [DBG] pgmap v5279: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:31.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:44:31 gibba015 bash[29377]: cluster 2021-03-10T16:44:30.633435+0000 mgr.gibba045.orlgmj (mgr.34412) 9267 : cluster [DBG] pgmap v5280: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:31.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:44:31 gibba015 bash[30343]: cluster 2021-03-10T16:44:30.633435+0000 mgr.gibba045.orlgmj (mgr.34412) 9267 : cluster [DBG] pgmap v5280: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:32.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:44:31 gibba045 bash[25517]: cluster 2021-03-10T16:44:30.633435+0000 mgr.gibba045.orlgmj (mgr.34412) 9267 : cluster [DBG] pgmap v5280: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:33.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:44:33 gibba015 bash[29377]: cluster 2021-03-10T16:44:32.635147+0000 mgr.gibba045.orlgmj (mgr.34412) 9268 : cluster [DBG] pgmap v5281: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:33.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:44:33 gibba015 bash[30343]: cluster 2021-03-10T16:44:32.635147+0000 mgr.gibba045.orlgmj (mgr.34412) 9268 : cluster [DBG] pgmap v5281: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:34.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:44:33 gibba045 bash[25517]: cluster 2021-03-10T16:44:32.635147+0000 mgr.gibba045.orlgmj (mgr.34412) 9268 : cluster [DBG] pgmap v5281: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:35.053 INFO:journalctl@ceph.prometheus.a.gibba045.stdout:Mar 10 16:44:34 gibba045 bash[19791]: level=info ts=2021-03-10T16:44:34.657Z caller=compact.go:507 component=tsdb msg="write block" mint=1615383873788 maxt=1615384800000 ulid=01F0EGD5YJ6C5N3RMQESPJ1BWN duration=15.389749ms 2021-03-10T16:44:35.053 INFO:journalctl@ceph.prometheus.a.gibba045.stdout:Mar 10 16:44:34 gibba045 bash[19791]: level=info ts=2021-03-10T16:44:34.659Z caller=head.go:847 component=tsdb msg="Head GC completed" duration=1.150497ms 2021-03-10T16:44:35.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:44:35 gibba015 bash[29377]: cluster 2021-03-10T16:44:34.636802+0000 mgr.gibba045.orlgmj (mgr.34412) 9269 : cluster [DBG] pgmap v5282: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:35.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:44:35 gibba015 bash[30343]: cluster 2021-03-10T16:44:34.636802+0000 mgr.gibba045.orlgmj (mgr.34412) 9269 : cluster [DBG] pgmap v5282: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:36.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:44:35 gibba045 bash[25517]: cluster 2021-03-10T16:44:34.636802+0000 mgr.gibba045.orlgmj (mgr.34412) 9269 : cluster [DBG] pgmap v5282: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:37.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:44:37 gibba015 bash[29377]: cluster 2021-03-10T16:44:36.638483+0000 mgr.gibba045.orlgmj (mgr.34412) 9270 : cluster [DBG] pgmap v5283: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:37.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:44:37 gibba015 bash[30343]: cluster 2021-03-10T16:44:36.638483+0000 mgr.gibba045.orlgmj (mgr.34412) 9270 : cluster [DBG] pgmap v5283: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:38.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:44:37 gibba045 bash[25517]: cluster 2021-03-10T16:44:36.638483+0000 mgr.gibba045.orlgmj (mgr.34412) 9270 : cluster [DBG] pgmap v5283: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:39.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:44:39 gibba015 bash[29377]: cluster 2021-03-10T16:44:38.639685+0000 mgr.gibba045.orlgmj (mgr.34412) 9271 : cluster [DBG] pgmap v5284: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:39.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:44:39 gibba015 bash[29377]: audit 2021-03-10T16:44:39.326647+0000 mon.c (mon.1) 2550 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:44:39.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:44:39 gibba015 bash[29377]: audit 2021-03-10T16:44:39.540864+0000 mon.a (mon.0) 2043 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:44:39.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:44:39 gibba015 bash[29377]: audit 2021-03-10T16:44:39.544472+0000 mon.c (mon.1) 2551 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:44:39.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:44:39 gibba015 bash[29377]: audit 2021-03-10T16:44:39.545826+0000 mon.c (mon.1) 2552 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:44:39.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:44:39 gibba015 bash[29377]: audit 2021-03-10T16:44:39.547357+0000 mon.c (mon.1) 2553 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:44:39.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:44:39 gibba015 bash[29377]: audit 2021-03-10T16:44:39.548530+0000 mon.c (mon.1) 2554 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:44:39.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:44:39 gibba015 bash[29377]: audit 2021-03-10T16:44:39.551632+0000 mon.c (mon.1) 2555 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:44:39.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:44:39 gibba015 bash[29377]: audit 2021-03-10T16:44:39.553120+0000 mon.c (mon.1) 2556 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:44:39.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:44:39 gibba015 bash[30343]: cluster 2021-03-10T16:44:38.639685+0000 mgr.gibba045.orlgmj (mgr.34412) 9271 : cluster [DBG] pgmap v5284: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:39.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:44:39 gibba015 bash[30343]: audit 2021-03-10T16:44:39.326647+0000 mon.c (mon.1) 2550 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:44:39.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:44:39 gibba015 bash[30343]: audit 2021-03-10T16:44:39.540864+0000 mon.a (mon.0) 2043 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:44:39.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:44:39 gibba015 bash[30343]: audit 2021-03-10T16:44:39.544472+0000 mon.c (mon.1) 2551 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:44:39.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:44:39 gibba015 bash[30343]: audit 2021-03-10T16:44:39.545826+0000 mon.c (mon.1) 2552 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:44:39.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:44:39 gibba015 bash[30343]: audit 2021-03-10T16:44:39.547357+0000 mon.c (mon.1) 2553 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:44:39.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:44:39 gibba015 bash[30343]: audit 2021-03-10T16:44:39.548530+0000 mon.c (mon.1) 2554 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:44:39.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:44:39 gibba015 bash[30343]: audit 2021-03-10T16:44:39.551632+0000 mon.c (mon.1) 2555 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:44:39.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:44:39 gibba015 bash[30343]: audit 2021-03-10T16:44:39.553120+0000 mon.c (mon.1) 2556 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:44:40.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:44:39 gibba045 bash[25517]: cluster 2021-03-10T16:44:38.639685+0000 mgr.gibba045.orlgmj (mgr.34412) 9271 : cluster [DBG] pgmap v5284: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:40.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:44:39 gibba045 bash[25517]: audit 2021-03-10T16:44:39.326647+0000 mon.c (mon.1) 2550 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:44:40.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:44:39 gibba045 bash[25517]: audit 2021-03-10T16:44:39.540864+0000 mon.a (mon.0) 2043 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:44:40.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:44:39 gibba045 bash[25517]: audit 2021-03-10T16:44:39.544472+0000 mon.c (mon.1) 2551 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:44:40.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:44:39 gibba045 bash[25517]: audit 2021-03-10T16:44:39.545826+0000 mon.c (mon.1) 2552 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:44:40.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:44:39 gibba045 bash[25517]: audit 2021-03-10T16:44:39.547357+0000 mon.c (mon.1) 2553 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:44:40.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:44:39 gibba045 bash[25517]: audit 2021-03-10T16:44:39.548530+0000 mon.c (mon.1) 2554 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:44:40.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:44:39 gibba045 bash[25517]: audit 2021-03-10T16:44:39.551632+0000 mon.c (mon.1) 2555 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:44:40.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:44:39 gibba045 bash[25517]: audit 2021-03-10T16:44:39.553120+0000 mon.c (mon.1) 2556 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:44:40.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:44:40 gibba015 bash[29377]: cephadm 2021-03-10T16:44:39.331328+0000 mgr.gibba045.orlgmj (mgr.34412) 9272 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:44:40.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:44:40 gibba015 bash[29377]: cephadm 2021-03-10T16:44:39.331826+0000 mgr.gibba045.orlgmj (mgr.34412) 9273 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:44:40.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:44:40 gibba015 bash[29377]: cephadm 2021-03-10T16:44:39.546097+0000 mgr.gibba045.orlgmj (mgr.34412) 9274 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:44:40.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:44:40 gibba015 bash[29377]: cephadm 2021-03-10T16:44:39.547752+0000 mgr.gibba045.orlgmj (mgr.34412) 9275 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:44:40.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:44:40 gibba015 bash[29377]: cephadm 2021-03-10T16:44:39.549294+0000 mgr.gibba045.orlgmj (mgr.34412) 9276 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:44:40.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:44:40 gibba015 bash[29377]: cephadm 2021-03-10T16:44:39.549331+0000 mgr.gibba045.orlgmj (mgr.34412) 9277 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:44:40.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:44:40 gibba015 bash[29377]: cephadm 2021-03-10T16:44:39.550692+0000 mgr.gibba045.orlgmj (mgr.34412) 9278 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:44:40.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:44:40 gibba015 bash[29377]: cephadm 2021-03-10T16:44:39.550729+0000 mgr.gibba045.orlgmj (mgr.34412) 9279 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:44:40.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:44:40 gibba015 bash[29377]: cephadm 2021-03-10T16:44:39.551588+0000 mgr.gibba045.orlgmj (mgr.34412) 9280 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:44:40.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:44:40 gibba015 bash[29377]: cephadm 2021-03-10T16:44:39.553474+0000 mgr.gibba045.orlgmj (mgr.34412) 9281 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:44:40.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:44:40 gibba015 bash[29377]: cephadm 2021-03-10T16:44:39.553511+0000 mgr.gibba045.orlgmj (mgr.34412) 9282 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:44:40.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:44:40 gibba015 bash[29377]: cephadm 2021-03-10T16:44:39.554773+0000 mgr.gibba045.orlgmj (mgr.34412) 9283 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:44:40.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:44:40 gibba015 bash[29377]: cephadm 2021-03-10T16:44:39.555099+0000 mgr.gibba045.orlgmj (mgr.34412) 9284 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:44:40.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:44:40 gibba015 bash[29377]: cephadm 2021-03-10T16:44:39.556792+0000 mgr.gibba045.orlgmj (mgr.34412) 9285 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:44:40.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:44:40 gibba015 bash[29377]: cephadm 2021-03-10T16:44:39.556832+0000 mgr.gibba045.orlgmj (mgr.34412) 9286 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:44:40.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:44:40 gibba015 bash[29377]: cephadm 2021-03-10T16:44:39.556941+0000 mgr.gibba045.orlgmj (mgr.34412) 9287 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:44:40.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:44:40 gibba015 bash[30343]: cephadm 2021-03-10T16:44:39.331328+0000 mgr.gibba045.orlgmj (mgr.34412) 9272 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:44:40.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:44:40 gibba015 bash[30343]: cephadm 2021-03-10T16:44:39.331826+0000 mgr.gibba045.orlgmj (mgr.34412) 9273 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:44:40.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:44:40 gibba015 bash[30343]: cephadm 2021-03-10T16:44:39.546097+0000 mgr.gibba045.orlgmj (mgr.34412) 9274 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:44:40.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:44:40 gibba015 bash[30343]: cephadm 2021-03-10T16:44:39.547752+0000 mgr.gibba045.orlgmj (mgr.34412) 9275 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:44:40.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:44:40 gibba015 bash[30343]: cephadm 2021-03-10T16:44:39.549294+0000 mgr.gibba045.orlgmj (mgr.34412) 9276 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:44:40.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:44:40 gibba015 bash[30343]: cephadm 2021-03-10T16:44:39.549331+0000 mgr.gibba045.orlgmj (mgr.34412) 9277 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:44:40.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:44:40 gibba015 bash[30343]: cephadm 2021-03-10T16:44:39.550692+0000 mgr.gibba045.orlgmj (mgr.34412) 9278 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:44:40.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:44:40 gibba015 bash[30343]: cephadm 2021-03-10T16:44:39.550729+0000 mgr.gibba045.orlgmj (mgr.34412) 9279 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:44:40.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:44:40 gibba015 bash[30343]: cephadm 2021-03-10T16:44:39.551588+0000 mgr.gibba045.orlgmj (mgr.34412) 9280 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:44:40.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:44:40 gibba015 bash[30343]: cephadm 2021-03-10T16:44:39.553474+0000 mgr.gibba045.orlgmj (mgr.34412) 9281 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:44:40.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:44:40 gibba015 bash[30343]: cephadm 2021-03-10T16:44:39.553511+0000 mgr.gibba045.orlgmj (mgr.34412) 9282 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:44:40.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:44:40 gibba015 bash[30343]: cephadm 2021-03-10T16:44:39.554773+0000 mgr.gibba045.orlgmj (mgr.34412) 9283 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:44:40.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:44:40 gibba015 bash[30343]: cephadm 2021-03-10T16:44:39.555099+0000 mgr.gibba045.orlgmj (mgr.34412) 9284 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:44:40.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:44:40 gibba015 bash[30343]: cephadm 2021-03-10T16:44:39.556792+0000 mgr.gibba045.orlgmj (mgr.34412) 9285 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:44:40.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:44:40 gibba015 bash[30343]: cephadm 2021-03-10T16:44:39.556832+0000 mgr.gibba045.orlgmj (mgr.34412) 9286 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:44:40.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:44:40 gibba015 bash[30343]: cephadm 2021-03-10T16:44:39.556941+0000 mgr.gibba045.orlgmj (mgr.34412) 9287 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:44:41.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:44:40 gibba045 bash[25517]: cephadm 2021-03-10T16:44:39.331328+0000 mgr.gibba045.orlgmj (mgr.34412) 9272 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:44:41.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:44:40 gibba045 bash[25517]: cephadm 2021-03-10T16:44:39.331826+0000 mgr.gibba045.orlgmj (mgr.34412) 9273 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:44:41.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:44:40 gibba045 bash[25517]: cephadm 2021-03-10T16:44:39.546097+0000 mgr.gibba045.orlgmj (mgr.34412) 9274 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:44:41.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:44:40 gibba045 bash[25517]: cephadm 2021-03-10T16:44:39.547752+0000 mgr.gibba045.orlgmj (mgr.34412) 9275 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:44:41.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:44:40 gibba045 bash[25517]: cephadm 2021-03-10T16:44:39.549294+0000 mgr.gibba045.orlgmj (mgr.34412) 9276 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:44:41.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:44:40 gibba045 bash[25517]: cephadm 2021-03-10T16:44:39.549331+0000 mgr.gibba045.orlgmj (mgr.34412) 9277 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:44:41.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:44:40 gibba045 bash[25517]: cephadm 2021-03-10T16:44:39.550692+0000 mgr.gibba045.orlgmj (mgr.34412) 9278 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:44:41.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:44:40 gibba045 bash[25517]: cephadm 2021-03-10T16:44:39.550729+0000 mgr.gibba045.orlgmj (mgr.34412) 9279 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:44:41.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:44:40 gibba045 bash[25517]: cephadm 2021-03-10T16:44:39.551588+0000 mgr.gibba045.orlgmj (mgr.34412) 9280 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:44:41.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:44:40 gibba045 bash[25517]: cephadm 2021-03-10T16:44:39.553474+0000 mgr.gibba045.orlgmj (mgr.34412) 9281 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:44:41.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:44:40 gibba045 bash[25517]: cephadm 2021-03-10T16:44:39.553511+0000 mgr.gibba045.orlgmj (mgr.34412) 9282 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:44:41.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:44:40 gibba045 bash[25517]: cephadm 2021-03-10T16:44:39.554773+0000 mgr.gibba045.orlgmj (mgr.34412) 9283 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:44:41.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:44:40 gibba045 bash[25517]: cephadm 2021-03-10T16:44:39.555099+0000 mgr.gibba045.orlgmj (mgr.34412) 9284 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:44:41.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:44:40 gibba045 bash[25517]: cephadm 2021-03-10T16:44:39.556792+0000 mgr.gibba045.orlgmj (mgr.34412) 9285 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:44:41.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:44:40 gibba045 bash[25517]: cephadm 2021-03-10T16:44:39.556832+0000 mgr.gibba045.orlgmj (mgr.34412) 9286 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:44:41.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:44:40 gibba045 bash[25517]: cephadm 2021-03-10T16:44:39.556941+0000 mgr.gibba045.orlgmj (mgr.34412) 9287 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:44:41.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:44:41 gibba015 bash[29377]: cluster 2021-03-10T16:44:40.641529+0000 mgr.gibba045.orlgmj (mgr.34412) 9288 : cluster [DBG] pgmap v5285: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:41.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:44:41 gibba015 bash[30343]: cluster 2021-03-10T16:44:40.641529+0000 mgr.gibba045.orlgmj (mgr.34412) 9288 : cluster [DBG] pgmap v5285: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:42.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:44:41 gibba045 bash[25517]: cluster 2021-03-10T16:44:40.641529+0000 mgr.gibba045.orlgmj (mgr.34412) 9288 : cluster [DBG] pgmap v5285: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:44.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:44:43 gibba045 bash[25517]: cluster 2021-03-10T16:44:42.643192+0000 mgr.gibba045.orlgmj (mgr.34412) 9289 : cluster [DBG] pgmap v5286: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:44.218 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:44:43 gibba015 bash[29377]: cluster 2021-03-10T16:44:42.643192+0000 mgr.gibba045.orlgmj (mgr.34412) 9289 : cluster [DBG] pgmap v5286: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:44.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:44:43 gibba015 bash[30343]: cluster 2021-03-10T16:44:42.643192+0000 mgr.gibba045.orlgmj (mgr.34412) 9289 : cluster [DBG] pgmap v5286: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:46.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:44:45 gibba045 bash[25517]: cluster 2021-03-10T16:44:44.644762+0000 mgr.gibba045.orlgmj (mgr.34412) 9290 : cluster [DBG] pgmap v5287: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:46.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:44:45 gibba015 bash[29377]: cluster 2021-03-10T16:44:44.644762+0000 mgr.gibba045.orlgmj (mgr.34412) 9290 : cluster [DBG] pgmap v5287: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:46.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:44:45 gibba015 bash[30343]: cluster 2021-03-10T16:44:44.644762+0000 mgr.gibba045.orlgmj (mgr.34412) 9290 : cluster [DBG] pgmap v5287: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:47.692 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:44:47.921 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:44:47.921 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 8m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:44:47.922 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 7m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:44:47.922 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:44:47.922 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:44:47.922 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:44:47.923 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:44:47.923 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:44:47.923 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:44:47.923 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 8m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:44:47.923 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 7m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:44:47.924 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:44:47.924 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:44:47.924 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:44:47.924 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:44:47.924 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:44:47.925 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:44:47.925 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:44:47.925 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:44:47.925 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 7m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:44:47.926 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 7m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:44:47.968 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:44:47 gibba015 bash[29377]: cluster 2021-03-10T16:44:46.645787+0000 mgr.gibba045.orlgmj (mgr.34412) 9291 : cluster [DBG] pgmap v5288: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:47.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:44:47 gibba015 bash[30343]: cluster 2021-03-10T16:44:46.645787+0000 mgr.gibba045.orlgmj (mgr.34412) 9291 : cluster [DBG] pgmap v5288: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:48.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:44:47 gibba045 bash[25517]: cluster 2021-03-10T16:44:46.645787+0000 mgr.gibba045.orlgmj (mgr.34412) 9291 : cluster [DBG] pgmap v5288: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:48.172 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:44:48.173 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:44:48.173 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:44:48.173 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:44:48.173 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:44:48.174 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:44:48.174 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:44:48.174 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:44:48.174 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:44:48.175 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:44:48.175 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:44:48.175 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:44:48.175 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:44:48.175 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:44:48.176 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:44:48.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:44:48 gibba015 bash[29377]: audit 2021-03-10T16:44:47.687135+0000 mgr.gibba045.orlgmj (mgr.34412) 9292 : audit [DBG] from='client.60268 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:44:48.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:44:48 gibba015 bash[29377]: audit 2021-03-10T16:44:48.174038+0000 mon.a (mon.0) 2044 : audit [DBG] from='client.? 172.21.2.115:0/3820606895' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:44:48.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:44:48 gibba015 bash[30343]: audit 2021-03-10T16:44:47.687135+0000 mgr.gibba045.orlgmj (mgr.34412) 9292 : audit [DBG] from='client.60268 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:44:48.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:44:48 gibba015 bash[30343]: audit 2021-03-10T16:44:48.174038+0000 mon.a (mon.0) 2044 : audit [DBG] from='client.? 172.21.2.115:0/3820606895' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:44:49.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:44:48 gibba045 bash[25517]: audit 2021-03-10T16:44:47.687135+0000 mgr.gibba045.orlgmj (mgr.34412) 9292 : audit [DBG] from='client.60268 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:44:49.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:44:48 gibba045 bash[25517]: audit 2021-03-10T16:44:48.174038+0000 mon.a (mon.0) 2044 : audit [DBG] from='client.? 172.21.2.115:0/3820606895' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:44:49.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:44:49 gibba015 bash[29377]: audit 2021-03-10T16:44:47.912807+0000 mgr.gibba045.orlgmj (mgr.34412) 9293 : audit [DBG] from='client.50286 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:44:49.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:44:49 gibba015 bash[29377]: cluster 2021-03-10T16:44:48.646186+0000 mgr.gibba045.orlgmj (mgr.34412) 9294 : cluster [DBG] pgmap v5289: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:49.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:44:49 gibba015 bash[30343]: audit 2021-03-10T16:44:47.912807+0000 mgr.gibba045.orlgmj (mgr.34412) 9293 : audit [DBG] from='client.50286 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:44:49.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:44:49 gibba015 bash[30343]: cluster 2021-03-10T16:44:48.646186+0000 mgr.gibba045.orlgmj (mgr.34412) 9294 : cluster [DBG] pgmap v5289: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:50.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:44:49 gibba045 bash[25517]: audit 2021-03-10T16:44:47.912807+0000 mgr.gibba045.orlgmj (mgr.34412) 9293 : audit [DBG] from='client.50286 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:44:50.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:44:49 gibba045 bash[25517]: cluster 2021-03-10T16:44:48.646186+0000 mgr.gibba045.orlgmj (mgr.34412) 9294 : cluster [DBG] pgmap v5289: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:51.968 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:44:51 gibba015 bash[29377]: cluster 2021-03-10T16:44:50.647833+0000 mgr.gibba045.orlgmj (mgr.34412) 9295 : cluster [DBG] pgmap v5290: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:51.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:44:51 gibba015 bash[30343]: cluster 2021-03-10T16:44:50.647833+0000 mgr.gibba045.orlgmj (mgr.34412) 9295 : cluster [DBG] pgmap v5290: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:52.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:44:51 gibba045 bash[25517]: cluster 2021-03-10T16:44:50.647833+0000 mgr.gibba045.orlgmj (mgr.34412) 9295 : cluster [DBG] pgmap v5290: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:53.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:44:53 gibba015 bash[29377]: cluster 2021-03-10T16:44:52.649249+0000 mgr.gibba045.orlgmj (mgr.34412) 9296 : cluster [DBG] pgmap v5291: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:53.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:44:53 gibba015 bash[30343]: cluster 2021-03-10T16:44:52.649249+0000 mgr.gibba045.orlgmj (mgr.34412) 9296 : cluster [DBG] pgmap v5291: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:54.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:44:53 gibba045 bash[25517]: cluster 2021-03-10T16:44:52.649249+0000 mgr.gibba045.orlgmj (mgr.34412) 9296 : cluster [DBG] pgmap v5291: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:55.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:44:54 gibba045 bash[25517]: audit 2021-03-10T16:44:53.710776+0000 mon.c (mon.1) 2557 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:44:55.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:44:54 gibba045 bash[25517]: audit 2021-03-10T16:44:53.711796+0000 mon.c (mon.1) 2558 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:44:55.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:44:54 gibba045 bash[25517]: audit 2021-03-10T16:44:53.712139+0000 mon.a (mon.0) 2045 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:44:55.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:44:54 gibba045 bash[25517]: audit 2021-03-10T16:44:53.714970+0000 mon.a (mon.0) 2046 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:44:55.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:44:54 gibba045 bash[25517]: audit 2021-03-10T16:44:53.736916+0000 mon.c (mon.1) 2559 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T16:44:55.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:44:54 gibba045 bash[25517]: audit 2021-03-10T16:44:53.737100+0000 mon.c (mon.1) 2560 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:44:55.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:44:54 gibba045 bash[25517]: audit 2021-03-10T16:44:53.737255+0000 mon.c (mon.1) 2561 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:44:55.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:44:54 gibba045 bash[25517]: audit 2021-03-10T16:44:53.737415+0000 mon.c (mon.1) 2562 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:44:55.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:44:54 gibba045 bash[25517]: audit 2021-03-10T16:44:53.737423+0000 mon.a (mon.0) 2047 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T16:44:55.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:44:54 gibba045 bash[25517]: audit 2021-03-10T16:44:53.737879+0000 mon.a (mon.0) 2048 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:44:55.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:44:54 gibba045 bash[25517]: audit 2021-03-10T16:44:53.738149+0000 mon.a (mon.0) 2049 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:44:55.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:44:54 gibba045 bash[25517]: audit 2021-03-10T16:44:53.738407+0000 mon.a (mon.0) 2050 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:44:55.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:44:54 gibba015 bash[29377]: audit 2021-03-10T16:44:53.710776+0000 mon.c (mon.1) 2557 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:44:55.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:44:54 gibba015 bash[29377]: audit 2021-03-10T16:44:53.711796+0000 mon.c (mon.1) 2558 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:44:55.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:44:54 gibba015 bash[29377]: audit 2021-03-10T16:44:53.712139+0000 mon.a (mon.0) 2045 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:44:55.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:44:54 gibba015 bash[29377]: audit 2021-03-10T16:44:53.714970+0000 mon.a (mon.0) 2046 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:44:55.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:44:54 gibba015 bash[29377]: audit 2021-03-10T16:44:53.736916+0000 mon.c (mon.1) 2559 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T16:44:55.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:44:54 gibba015 bash[29377]: audit 2021-03-10T16:44:53.737100+0000 mon.c (mon.1) 2560 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:44:55.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:44:54 gibba015 bash[29377]: audit 2021-03-10T16:44:53.737255+0000 mon.c (mon.1) 2561 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:44:55.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:44:54 gibba015 bash[29377]: audit 2021-03-10T16:44:53.737415+0000 mon.c (mon.1) 2562 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:44:55.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:44:54 gibba015 bash[29377]: audit 2021-03-10T16:44:53.737423+0000 mon.a (mon.0) 2047 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T16:44:55.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:44:54 gibba015 bash[29377]: audit 2021-03-10T16:44:53.737879+0000 mon.a (mon.0) 2048 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:44:55.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:44:54 gibba015 bash[29377]: audit 2021-03-10T16:44:53.738149+0000 mon.a (mon.0) 2049 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:44:55.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:44:54 gibba015 bash[29377]: audit 2021-03-10T16:44:53.738407+0000 mon.a (mon.0) 2050 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:44:55.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:44:54 gibba015 bash[30343]: audit 2021-03-10T16:44:53.710776+0000 mon.c (mon.1) 2557 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:44:55.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:44:54 gibba015 bash[30343]: audit 2021-03-10T16:44:53.711796+0000 mon.c (mon.1) 2558 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:44:55.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:44:54 gibba015 bash[30343]: audit 2021-03-10T16:44:53.712139+0000 mon.a (mon.0) 2045 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:44:55.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:44:54 gibba015 bash[30343]: audit 2021-03-10T16:44:53.714970+0000 mon.a (mon.0) 2046 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:44:55.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:44:54 gibba015 bash[30343]: audit 2021-03-10T16:44:53.736916+0000 mon.c (mon.1) 2559 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T16:44:55.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:44:54 gibba015 bash[30343]: audit 2021-03-10T16:44:53.737100+0000 mon.c (mon.1) 2560 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:44:55.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:44:54 gibba015 bash[30343]: audit 2021-03-10T16:44:53.737255+0000 mon.c (mon.1) 2561 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:44:55.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:44:54 gibba015 bash[30343]: audit 2021-03-10T16:44:53.737415+0000 mon.c (mon.1) 2562 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:44:55.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:44:54 gibba015 bash[30343]: audit 2021-03-10T16:44:53.737423+0000 mon.a (mon.0) 2047 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T16:44:55.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:44:54 gibba015 bash[30343]: audit 2021-03-10T16:44:53.737879+0000 mon.a (mon.0) 2048 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:44:55.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:44:54 gibba015 bash[30343]: audit 2021-03-10T16:44:53.738149+0000 mon.a (mon.0) 2049 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:44:55.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:44:54 gibba015 bash[30343]: audit 2021-03-10T16:44:53.738407+0000 mon.a (mon.0) 2050 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:44:56.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:44:55 gibba045 bash[25517]: cephadm 2021-03-10T16:44:54.572904+0000 mgr.gibba045.orlgmj (mgr.34412) 9297 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:44:56.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:44:55 gibba045 bash[25517]: cluster 2021-03-10T16:44:54.650005+0000 mgr.gibba045.orlgmj (mgr.34412) 9298 : cluster [DBG] pgmap v5292: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:56.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:44:55 gibba015 bash[29377]: cephadm 2021-03-10T16:44:54.572904+0000 mgr.gibba045.orlgmj (mgr.34412) 9297 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:44:56.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:44:55 gibba015 bash[29377]: cluster 2021-03-10T16:44:54.650005+0000 mgr.gibba045.orlgmj (mgr.34412) 9298 : cluster [DBG] pgmap v5292: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:56.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:44:55 gibba015 bash[30343]: cephadm 2021-03-10T16:44:54.572904+0000 mgr.gibba045.orlgmj (mgr.34412) 9297 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:44:56.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:44:55 gibba015 bash[30343]: cluster 2021-03-10T16:44:54.650005+0000 mgr.gibba045.orlgmj (mgr.34412) 9298 : cluster [DBG] pgmap v5292: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:57.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:44:57 gibba015 bash[29377]: cluster 2021-03-10T16:44:56.651642+0000 mgr.gibba045.orlgmj (mgr.34412) 9299 : cluster [DBG] pgmap v5293: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:57.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:44:57 gibba015 bash[30343]: cluster 2021-03-10T16:44:56.651642+0000 mgr.gibba045.orlgmj (mgr.34412) 9299 : cluster [DBG] pgmap v5293: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:58.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:44:57 gibba045 bash[25517]: cluster 2021-03-10T16:44:56.651642+0000 mgr.gibba045.orlgmj (mgr.34412) 9299 : cluster [DBG] pgmap v5293: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:59.968 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:44:59 gibba015 bash[29377]: cluster 2021-03-10T16:44:58.652898+0000 mgr.gibba045.orlgmj (mgr.34412) 9300 : cluster [DBG] pgmap v5294: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:59.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:44:59 gibba015 bash[30343]: cluster 2021-03-10T16:44:58.652898+0000 mgr.gibba045.orlgmj (mgr.34412) 9300 : cluster [DBG] pgmap v5294: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:00.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:44:59 gibba045 bash[25517]: cluster 2021-03-10T16:44:58.652898+0000 mgr.gibba045.orlgmj (mgr.34412) 9300 : cluster [DBG] pgmap v5294: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:02.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:45:01 gibba045 bash[25517]: cluster 2021-03-10T16:45:00.654565+0000 mgr.gibba045.orlgmj (mgr.34412) 9301 : cluster [DBG] pgmap v5295: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:02.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:45:01 gibba015 bash[29377]: cluster 2021-03-10T16:45:00.654565+0000 mgr.gibba045.orlgmj (mgr.34412) 9301 : cluster [DBG] pgmap v5295: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:02.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:45:01 gibba015 bash[30343]: cluster 2021-03-10T16:45:00.654565+0000 mgr.gibba045.orlgmj (mgr.34412) 9301 : cluster [DBG] pgmap v5295: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:04.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:45:03 gibba045 bash[25517]: cluster 2021-03-10T16:45:02.656242+0000 mgr.gibba045.orlgmj (mgr.34412) 9302 : cluster [DBG] pgmap v5296: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:04.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:45:03 gibba015 bash[29377]: cluster 2021-03-10T16:45:02.656242+0000 mgr.gibba045.orlgmj (mgr.34412) 9302 : cluster [DBG] pgmap v5296: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:04.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:45:03 gibba015 bash[30343]: cluster 2021-03-10T16:45:02.656242+0000 mgr.gibba045.orlgmj (mgr.34412) 9302 : cluster [DBG] pgmap v5296: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:06.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:45:05 gibba045 bash[25517]: cluster 2021-03-10T16:45:04.656824+0000 mgr.gibba045.orlgmj (mgr.34412) 9303 : cluster [DBG] pgmap v5297: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:06.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:45:05 gibba015 bash[29377]: cluster 2021-03-10T16:45:04.656824+0000 mgr.gibba045.orlgmj (mgr.34412) 9303 : cluster [DBG] pgmap v5297: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:06.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:45:05 gibba015 bash[30343]: cluster 2021-03-10T16:45:04.656824+0000 mgr.gibba045.orlgmj (mgr.34412) 9303 : cluster [DBG] pgmap v5297: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:07.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:45:07 gibba015 bash[29377]: cluster 2021-03-10T16:45:06.657733+0000 mgr.gibba045.orlgmj (mgr.34412) 9304 : cluster [DBG] pgmap v5298: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:07.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:45:07 gibba015 bash[30343]: cluster 2021-03-10T16:45:06.657733+0000 mgr.gibba045.orlgmj (mgr.34412) 9304 : cluster [DBG] pgmap v5298: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:08.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:45:07 gibba045 bash[25517]: cluster 2021-03-10T16:45:06.657733+0000 mgr.gibba045.orlgmj (mgr.34412) 9304 : cluster [DBG] pgmap v5298: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:09.968 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:45:09 gibba015 bash[29377]: cluster 2021-03-10T16:45:08.658690+0000 mgr.gibba045.orlgmj (mgr.34412) 9305 : cluster [DBG] pgmap v5299: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:09.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:45:09 gibba015 bash[30343]: cluster 2021-03-10T16:45:08.658690+0000 mgr.gibba045.orlgmj (mgr.34412) 9305 : cluster [DBG] pgmap v5299: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:10.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:45:09 gibba045 bash[25517]: cluster 2021-03-10T16:45:08.658690+0000 mgr.gibba045.orlgmj (mgr.34412) 9305 : cluster [DBG] pgmap v5299: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:11.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:45:10 gibba045 bash[25517]: cephadm 2021-03-10T16:45:09.588879+0000 mgr.gibba045.orlgmj (mgr.34412) 9306 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:45:11.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:45:10 gibba015 bash[29377]: cephadm 2021-03-10T16:45:09.588879+0000 mgr.gibba045.orlgmj (mgr.34412) 9306 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:45:11.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:45:10 gibba015 bash[30343]: cephadm 2021-03-10T16:45:09.588879+0000 mgr.gibba045.orlgmj (mgr.34412) 9306 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:45:12.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:45:11 gibba045 bash[25517]: cluster 2021-03-10T16:45:10.660510+0000 mgr.gibba045.orlgmj (mgr.34412) 9307 : cluster [DBG] pgmap v5300: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:12.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:45:11 gibba015 bash[29377]: cluster 2021-03-10T16:45:10.660510+0000 mgr.gibba045.orlgmj (mgr.34412) 9307 : cluster [DBG] pgmap v5300: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:12.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:45:11 gibba015 bash[30343]: cluster 2021-03-10T16:45:10.660510+0000 mgr.gibba045.orlgmj (mgr.34412) 9307 : cluster [DBG] pgmap v5300: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:14.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:45:13 gibba045 bash[25517]: cluster 2021-03-10T16:45:12.661962+0000 mgr.gibba045.orlgmj (mgr.34412) 9308 : cluster [DBG] pgmap v5301: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:14.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:45:13 gibba015 bash[29377]: cluster 2021-03-10T16:45:12.661962+0000 mgr.gibba045.orlgmj (mgr.34412) 9308 : cluster [DBG] pgmap v5301: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:14.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:45:13 gibba015 bash[30343]: cluster 2021-03-10T16:45:12.661962+0000 mgr.gibba045.orlgmj (mgr.34412) 9308 : cluster [DBG] pgmap v5301: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:16.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:45:15 gibba045 bash[25517]: cluster 2021-03-10T16:45:14.662773+0000 mgr.gibba045.orlgmj (mgr.34412) 9309 : cluster [DBG] pgmap v5302: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:16.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:45:15 gibba015 bash[29377]: cluster 2021-03-10T16:45:14.662773+0000 mgr.gibba045.orlgmj (mgr.34412) 9309 : cluster [DBG] pgmap v5302: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:16.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:45:15 gibba015 bash[30343]: cluster 2021-03-10T16:45:14.662773+0000 mgr.gibba045.orlgmj (mgr.34412) 9309 : cluster [DBG] pgmap v5302: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:17.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:45:17 gibba015 bash[29377]: cluster 2021-03-10T16:45:16.664408+0000 mgr.gibba045.orlgmj (mgr.34412) 9310 : cluster [DBG] pgmap v5303: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:17.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:45:17 gibba015 bash[30343]: cluster 2021-03-10T16:45:16.664408+0000 mgr.gibba045.orlgmj (mgr.34412) 9310 : cluster [DBG] pgmap v5303: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:18.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:45:17 gibba045 bash[25517]: cluster 2021-03-10T16:45:16.664408+0000 mgr.gibba045.orlgmj (mgr.34412) 9310 : cluster [DBG] pgmap v5303: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:18.414 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:45:18.642 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:45:18.642 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 8m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:45:18.642 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 7m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:45:18.643 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:45:18.643 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:45:18.643 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:45:18.643 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:45:18.644 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:45:18.644 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:45:18.644 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 8m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:45:18.644 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 7m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:45:18.644 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:45:18.645 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:45:18.645 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:45:18.645 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:45:18.645 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:45:18.646 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:45:18.646 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:45:18.646 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:45:18.646 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 7m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:45:18.647 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 7m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:45:18.892 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:45:18.892 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:45:18.892 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:45:18.893 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:45:18.893 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:45:18.893 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:45:18.893 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:45:18.894 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:45:18.894 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:45:18.894 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:45:18.894 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:45:18.895 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:45:18.895 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:45:18.895 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:45:18.895 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:45:20.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:45:19 gibba045 bash[25517]: audit 2021-03-10T16:45:18.409332+0000 mgr.gibba045.orlgmj (mgr.34412) 9311 : audit [DBG] from='client.50298 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:45:20.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:45:19 gibba045 bash[25517]: audit 2021-03-10T16:45:18.633509+0000 mgr.gibba045.orlgmj (mgr.34412) 9312 : audit [DBG] from='client.60292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:45:20.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:45:19 gibba045 bash[25517]: cluster 2021-03-10T16:45:18.664940+0000 mgr.gibba045.orlgmj (mgr.34412) 9313 : cluster [DBG] pgmap v5304: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:20.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:45:19 gibba045 bash[25517]: audit 2021-03-10T16:45:18.893366+0000 mon.a (mon.0) 2051 : audit [DBG] from='client.? 172.21.2.115:0/2645374004' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:45:20.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:45:19 gibba015 bash[29377]: audit 2021-03-10T16:45:18.409332+0000 mgr.gibba045.orlgmj (mgr.34412) 9311 : audit [DBG] from='client.50298 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:45:20.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:45:19 gibba015 bash[29377]: audit 2021-03-10T16:45:18.633509+0000 mgr.gibba045.orlgmj (mgr.34412) 9312 : audit [DBG] from='client.60292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:45:20.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:45:19 gibba015 bash[29377]: cluster 2021-03-10T16:45:18.664940+0000 mgr.gibba045.orlgmj (mgr.34412) 9313 : cluster [DBG] pgmap v5304: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:20.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:45:19 gibba015 bash[29377]: audit 2021-03-10T16:45:18.893366+0000 mon.a (mon.0) 2051 : audit [DBG] from='client.? 172.21.2.115:0/2645374004' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:45:20.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:45:19 gibba015 bash[30343]: audit 2021-03-10T16:45:18.409332+0000 mgr.gibba045.orlgmj (mgr.34412) 9311 : audit [DBG] from='client.50298 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:45:20.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:45:19 gibba015 bash[30343]: audit 2021-03-10T16:45:18.633509+0000 mgr.gibba045.orlgmj (mgr.34412) 9312 : audit [DBG] from='client.60292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:45:20.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:45:19 gibba015 bash[30343]: cluster 2021-03-10T16:45:18.664940+0000 mgr.gibba045.orlgmj (mgr.34412) 9313 : cluster [DBG] pgmap v5304: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:20.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:45:19 gibba015 bash[30343]: audit 2021-03-10T16:45:18.893366+0000 mon.a (mon.0) 2051 : audit [DBG] from='client.? 172.21.2.115:0/2645374004' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:45:22.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:45:21 gibba045 bash[25517]: cluster 2021-03-10T16:45:20.666560+0000 mgr.gibba045.orlgmj (mgr.34412) 9314 : cluster [DBG] pgmap v5305: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:22.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:45:21 gibba015 bash[29377]: cluster 2021-03-10T16:45:20.666560+0000 mgr.gibba045.orlgmj (mgr.34412) 9314 : cluster [DBG] pgmap v5305: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:22.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:45:21 gibba015 bash[30343]: cluster 2021-03-10T16:45:20.666560+0000 mgr.gibba045.orlgmj (mgr.34412) 9314 : cluster [DBG] pgmap v5305: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:24.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:45:23 gibba045 bash[25517]: cluster 2021-03-10T16:45:22.668091+0000 mgr.gibba045.orlgmj (mgr.34412) 9315 : cluster [DBG] pgmap v5306: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:24.218 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:45:23 gibba015 bash[29377]: cluster 2021-03-10T16:45:22.668091+0000 mgr.gibba045.orlgmj (mgr.34412) 9315 : cluster [DBG] pgmap v5306: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:24.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:45:23 gibba015 bash[30343]: cluster 2021-03-10T16:45:22.668091+0000 mgr.gibba045.orlgmj (mgr.34412) 9315 : cluster [DBG] pgmap v5306: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:26.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:45:25 gibba045 bash[25517]: cephadm 2021-03-10T16:45:24.603902+0000 mgr.gibba045.orlgmj (mgr.34412) 9316 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:45:26.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:45:25 gibba045 bash[25517]: cluster 2021-03-10T16:45:24.669742+0000 mgr.gibba045.orlgmj (mgr.34412) 9317 : cluster [DBG] pgmap v5307: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:26.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:45:25 gibba015 bash[29377]: cephadm 2021-03-10T16:45:24.603902+0000 mgr.gibba045.orlgmj (mgr.34412) 9316 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:45:26.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:45:25 gibba015 bash[29377]: cluster 2021-03-10T16:45:24.669742+0000 mgr.gibba045.orlgmj (mgr.34412) 9317 : cluster [DBG] pgmap v5307: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:26.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:45:25 gibba015 bash[30343]: cephadm 2021-03-10T16:45:24.603902+0000 mgr.gibba045.orlgmj (mgr.34412) 9316 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:45:26.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:45:25 gibba015 bash[30343]: cluster 2021-03-10T16:45:24.669742+0000 mgr.gibba045.orlgmj (mgr.34412) 9317 : cluster [DBG] pgmap v5307: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:27.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:45:27 gibba015 bash[29377]: cluster 2021-03-10T16:45:26.671499+0000 mgr.gibba045.orlgmj (mgr.34412) 9318 : cluster [DBG] pgmap v5308: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:27.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:45:27 gibba015 bash[30343]: cluster 2021-03-10T16:45:26.671499+0000 mgr.gibba045.orlgmj (mgr.34412) 9318 : cluster [DBG] pgmap v5308: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:28.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:45:27 gibba045 bash[25517]: cluster 2021-03-10T16:45:26.671499+0000 mgr.gibba045.orlgmj (mgr.34412) 9318 : cluster [DBG] pgmap v5308: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:30.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:45:29 gibba045 bash[25517]: cluster 2021-03-10T16:45:28.672829+0000 mgr.gibba045.orlgmj (mgr.34412) 9319 : cluster [DBG] pgmap v5309: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:30.218 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:45:29 gibba015 bash[29377]: cluster 2021-03-10T16:45:28.672829+0000 mgr.gibba045.orlgmj (mgr.34412) 9319 : cluster [DBG] pgmap v5309: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:30.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:45:29 gibba015 bash[30343]: cluster 2021-03-10T16:45:28.672829+0000 mgr.gibba045.orlgmj (mgr.34412) 9319 : cluster [DBG] pgmap v5309: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:32.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:45:31 gibba045 bash[25517]: cluster 2021-03-10T16:45:30.674400+0000 mgr.gibba045.orlgmj (mgr.34412) 9320 : cluster [DBG] pgmap v5310: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:32.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:45:31 gibba015 bash[29377]: cluster 2021-03-10T16:45:30.674400+0000 mgr.gibba045.orlgmj (mgr.34412) 9320 : cluster [DBG] pgmap v5310: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:32.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:45:31 gibba015 bash[30343]: cluster 2021-03-10T16:45:30.674400+0000 mgr.gibba045.orlgmj (mgr.34412) 9320 : cluster [DBG] pgmap v5310: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:34.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:45:33 gibba045 bash[25517]: cluster 2021-03-10T16:45:32.676059+0000 mgr.gibba045.orlgmj (mgr.34412) 9321 : cluster [DBG] pgmap v5311: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:34.218 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:45:33 gibba015 bash[29377]: cluster 2021-03-10T16:45:32.676059+0000 mgr.gibba045.orlgmj (mgr.34412) 9321 : cluster [DBG] pgmap v5311: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:34.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:45:33 gibba015 bash[30343]: cluster 2021-03-10T16:45:32.676059+0000 mgr.gibba045.orlgmj (mgr.34412) 9321 : cluster [DBG] pgmap v5311: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:36.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:45:35 gibba045 bash[25517]: cluster 2021-03-10T16:45:34.677045+0000 mgr.gibba045.orlgmj (mgr.34412) 9322 : cluster [DBG] pgmap v5312: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:36.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:45:35 gibba015 bash[29377]: cluster 2021-03-10T16:45:34.677045+0000 mgr.gibba045.orlgmj (mgr.34412) 9322 : cluster [DBG] pgmap v5312: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:36.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:45:35 gibba015 bash[30343]: cluster 2021-03-10T16:45:34.677045+0000 mgr.gibba045.orlgmj (mgr.34412) 9322 : cluster [DBG] pgmap v5312: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:37.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:45:37 gibba015 bash[29377]: cluster 2021-03-10T16:45:36.677845+0000 mgr.gibba045.orlgmj (mgr.34412) 9323 : cluster [DBG] pgmap v5313: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:37.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:45:37 gibba015 bash[30343]: cluster 2021-03-10T16:45:36.677845+0000 mgr.gibba045.orlgmj (mgr.34412) 9323 : cluster [DBG] pgmap v5313: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:38.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:45:37 gibba045 bash[25517]: cluster 2021-03-10T16:45:36.677845+0000 mgr.gibba045.orlgmj (mgr.34412) 9323 : cluster [DBG] pgmap v5313: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:40.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:45:39 gibba045 bash[25517]: cluster 2021-03-10T16:45:38.679041+0000 mgr.gibba045.orlgmj (mgr.34412) 9324 : cluster [DBG] pgmap v5314: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:40.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:45:39 gibba045 bash[25517]: audit 2021-03-10T16:45:39.615005+0000 mon.c (mon.1) 2563 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:45:40.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:45:39 gibba045 bash[25517]: audit 2021-03-10T16:45:39.620254+0000 mon.c (mon.1) 2564 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T16:45:40.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:45:39 gibba015 bash[29377]: cluster 2021-03-10T16:45:38.679041+0000 mgr.gibba045.orlgmj (mgr.34412) 9324 : cluster [DBG] pgmap v5314: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:40.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:45:39 gibba015 bash[29377]: audit 2021-03-10T16:45:39.615005+0000 mon.c (mon.1) 2563 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:45:40.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:45:39 gibba015 bash[29377]: audit 2021-03-10T16:45:39.620254+0000 mon.c (mon.1) 2564 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T16:45:40.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:45:39 gibba015 bash[30343]: cluster 2021-03-10T16:45:38.679041+0000 mgr.gibba045.orlgmj (mgr.34412) 9324 : cluster [DBG] pgmap v5314: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:40.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:45:39 gibba015 bash[30343]: audit 2021-03-10T16:45:39.615005+0000 mon.c (mon.1) 2563 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:45:40.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:45:39 gibba015 bash[30343]: audit 2021-03-10T16:45:39.620254+0000 mon.c (mon.1) 2564 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T16:45:41.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:45:40 gibba045 bash[25517]: cephadm 2021-03-10T16:45:39.622672+0000 mgr.gibba045.orlgmj (mgr.34412) 9325 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:45:41.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:45:40 gibba015 bash[29377]: cephadm 2021-03-10T16:45:39.622672+0000 mgr.gibba045.orlgmj (mgr.34412) 9325 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:45:41.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:45:40 gibba015 bash[30343]: cephadm 2021-03-10T16:45:39.622672+0000 mgr.gibba045.orlgmj (mgr.34412) 9325 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:45:42.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:45:41 gibba045 bash[25517]: cluster 2021-03-10T16:45:40.680737+0000 mgr.gibba045.orlgmj (mgr.34412) 9326 : cluster [DBG] pgmap v5315: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:42.218 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:45:41 gibba015 bash[29377]: cluster 2021-03-10T16:45:40.680737+0000 mgr.gibba045.orlgmj (mgr.34412) 9326 : cluster [DBG] pgmap v5315: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:42.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:45:41 gibba015 bash[30343]: cluster 2021-03-10T16:45:40.680737+0000 mgr.gibba045.orlgmj (mgr.34412) 9326 : cluster [DBG] pgmap v5315: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:43.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:45:43 gibba015 bash[29377]: cluster 2021-03-10T16:45:42.682241+0000 mgr.gibba045.orlgmj (mgr.34412) 9327 : cluster [DBG] pgmap v5316: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:43.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:45:43 gibba015 bash[30343]: cluster 2021-03-10T16:45:42.682241+0000 mgr.gibba045.orlgmj (mgr.34412) 9327 : cluster [DBG] pgmap v5316: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:44.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:45:43 gibba045 bash[25517]: cluster 2021-03-10T16:45:42.682241+0000 mgr.gibba045.orlgmj (mgr.34412) 9327 : cluster [DBG] pgmap v5316: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:45.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:45:44 gibba045 bash[25517]: audit 2021-03-10T16:45:44.191918+0000 mon.c (mon.1) 2565 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:45:45.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:45:44 gibba045 bash[25517]: audit 2021-03-10T16:45:44.368877+0000 mon.a (mon.0) 2052 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:45:45.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:45:44 gibba045 bash[25517]: audit 2021-03-10T16:45:44.564913+0000 mon.a (mon.0) 2053 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:45:45.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:45:44 gibba045 bash[25517]: audit 2021-03-10T16:45:44.582086+0000 mon.c (mon.1) 2566 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:45:45.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:45:44 gibba045 bash[25517]: audit 2021-03-10T16:45:44.586707+0000 mon.c (mon.1) 2567 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:45:45.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:45:44 gibba045 bash[25517]: audit 2021-03-10T16:45:44.591379+0000 mon.c (mon.1) 2568 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:45:45.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:45:44 gibba045 bash[25517]: audit 2021-03-10T16:45:44.594869+0000 mon.c (mon.1) 2569 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:45:45.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:45:44 gibba045 bash[25517]: audit 2021-03-10T16:45:44.602627+0000 mon.c (mon.1) 2570 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:45:45.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:45:44 gibba045 bash[25517]: audit 2021-03-10T16:45:44.607498+0000 mon.c (mon.1) 2571 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:45:45.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:45:44 gibba015 bash[29377]: audit 2021-03-10T16:45:44.191918+0000 mon.c (mon.1) 2565 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:45:45.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:45:44 gibba015 bash[29377]: audit 2021-03-10T16:45:44.368877+0000 mon.a (mon.0) 2052 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:45:45.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:45:44 gibba015 bash[29377]: audit 2021-03-10T16:45:44.564913+0000 mon.a (mon.0) 2053 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:45:45.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:45:44 gibba015 bash[29377]: audit 2021-03-10T16:45:44.582086+0000 mon.c (mon.1) 2566 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:45:45.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:45:44 gibba015 bash[29377]: audit 2021-03-10T16:45:44.586707+0000 mon.c (mon.1) 2567 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:45:45.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:45:44 gibba015 bash[29377]: audit 2021-03-10T16:45:44.591379+0000 mon.c (mon.1) 2568 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:45:45.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:45:44 gibba015 bash[29377]: audit 2021-03-10T16:45:44.594869+0000 mon.c (mon.1) 2569 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:45:45.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:45:44 gibba015 bash[29377]: audit 2021-03-10T16:45:44.602627+0000 mon.c (mon.1) 2570 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:45:45.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:45:44 gibba015 bash[29377]: audit 2021-03-10T16:45:44.607498+0000 mon.c (mon.1) 2571 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:45:45.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:45:44 gibba015 bash[30343]: audit 2021-03-10T16:45:44.191918+0000 mon.c (mon.1) 2565 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:45:45.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:45:44 gibba015 bash[30343]: audit 2021-03-10T16:45:44.368877+0000 mon.a (mon.0) 2052 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:45:45.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:45:44 gibba015 bash[30343]: audit 2021-03-10T16:45:44.564913+0000 mon.a (mon.0) 2053 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:45:45.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:45:44 gibba015 bash[30343]: audit 2021-03-10T16:45:44.582086+0000 mon.c (mon.1) 2566 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:45:45.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:45:44 gibba015 bash[30343]: audit 2021-03-10T16:45:44.586707+0000 mon.c (mon.1) 2567 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:45:45.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:45:44 gibba015 bash[30343]: audit 2021-03-10T16:45:44.591379+0000 mon.c (mon.1) 2568 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:45:45.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:45:44 gibba015 bash[30343]: audit 2021-03-10T16:45:44.594869+0000 mon.c (mon.1) 2569 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:45:45.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:45:44 gibba015 bash[30343]: audit 2021-03-10T16:45:44.602627+0000 mon.c (mon.1) 2570 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:45:45.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:45:44 gibba015 bash[30343]: audit 2021-03-10T16:45:44.607498+0000 mon.c (mon.1) 2571 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:45:46.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:45:45 gibba045 bash[25517]: cephadm 2021-03-10T16:45:44.373382+0000 mgr.gibba045.orlgmj (mgr.34412) 9328 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:45:46.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:45:45 gibba045 bash[25517]: cephadm 2021-03-10T16:45:44.581576+0000 mgr.gibba045.orlgmj (mgr.34412) 9329 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:45:46.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:45:45 gibba045 bash[25517]: cephadm 2021-03-10T16:45:44.587760+0000 mgr.gibba045.orlgmj (mgr.34412) 9330 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:45:46.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:45:45 gibba045 bash[25517]: cephadm 2021-03-10T16:45:44.591885+0000 mgr.gibba045.orlgmj (mgr.34412) 9331 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:45:46.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:45:45 gibba045 bash[25517]: cephadm 2021-03-10T16:45:44.592618+0000 mgr.gibba045.orlgmj (mgr.34412) 9332 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:45:46.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:45:45 gibba045 bash[25517]: cephadm 2021-03-10T16:45:44.595850+0000 mgr.gibba045.orlgmj (mgr.34412) 9333 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:45:46.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:45:45 gibba045 bash[25517]: cephadm 2021-03-10T16:45:44.596141+0000 mgr.gibba045.orlgmj (mgr.34412) 9334 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:45:46.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:45:45 gibba045 bash[25517]: cephadm 2021-03-10T16:45:44.599221+0000 mgr.gibba045.orlgmj (mgr.34412) 9335 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:45:46.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:45:45 gibba045 bash[25517]: cephadm 2021-03-10T16:45:44.602942+0000 mgr.gibba045.orlgmj (mgr.34412) 9336 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:45:46.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:45:45 gibba045 bash[25517]: cephadm 2021-03-10T16:45:44.603504+0000 mgr.gibba045.orlgmj (mgr.34412) 9337 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:45:46.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:45:45 gibba045 bash[25517]: cephadm 2021-03-10T16:45:44.607027+0000 mgr.gibba045.orlgmj (mgr.34412) 9338 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:45:46.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:45:45 gibba045 bash[25517]: cephadm 2021-03-10T16:45:44.609400+0000 mgr.gibba045.orlgmj (mgr.34412) 9339 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:45:46.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:45:45 gibba045 bash[25517]: cephadm 2021-03-10T16:45:44.611895+0000 mgr.gibba045.orlgmj (mgr.34412) 9340 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:45:46.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:45:45 gibba045 bash[25517]: cephadm 2021-03-10T16:45:44.612387+0000 mgr.gibba045.orlgmj (mgr.34412) 9341 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:45:46.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:45:45 gibba045 bash[25517]: cephadm 2021-03-10T16:45:44.613119+0000 mgr.gibba045.orlgmj (mgr.34412) 9342 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:45:46.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:45:45 gibba045 bash[25517]: cluster 2021-03-10T16:45:44.683728+0000 mgr.gibba045.orlgmj (mgr.34412) 9343 : cluster [DBG] pgmap v5317: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:46.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:45:45 gibba015 bash[30343]: cephadm 2021-03-10T16:45:44.373382+0000 mgr.gibba045.orlgmj (mgr.34412) 9328 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:45:46.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:45:45 gibba015 bash[30343]: cephadm 2021-03-10T16:45:44.581576+0000 mgr.gibba045.orlgmj (mgr.34412) 9329 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:45:46.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:45:45 gibba015 bash[30343]: cephadm 2021-03-10T16:45:44.587760+0000 mgr.gibba045.orlgmj (mgr.34412) 9330 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:45:46.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:45:45 gibba015 bash[30343]: cephadm 2021-03-10T16:45:44.591885+0000 mgr.gibba045.orlgmj (mgr.34412) 9331 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:45:46.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:45:45 gibba015 bash[30343]: cephadm 2021-03-10T16:45:44.592618+0000 mgr.gibba045.orlgmj (mgr.34412) 9332 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:45:46.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:45:45 gibba015 bash[30343]: cephadm 2021-03-10T16:45:44.595850+0000 mgr.gibba045.orlgmj (mgr.34412) 9333 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:45:46.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:45:45 gibba015 bash[30343]: cephadm 2021-03-10T16:45:44.596141+0000 mgr.gibba045.orlgmj (mgr.34412) 9334 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:45:46.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:45:45 gibba015 bash[30343]: cephadm 2021-03-10T16:45:44.599221+0000 mgr.gibba045.orlgmj (mgr.34412) 9335 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:45:46.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:45:45 gibba015 bash[30343]: cephadm 2021-03-10T16:45:44.602942+0000 mgr.gibba045.orlgmj (mgr.34412) 9336 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:45:46.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:45:45 gibba015 bash[30343]: cephadm 2021-03-10T16:45:44.603504+0000 mgr.gibba045.orlgmj (mgr.34412) 9337 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:45:46.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:45:45 gibba015 bash[30343]: cephadm 2021-03-10T16:45:44.607027+0000 mgr.gibba045.orlgmj (mgr.34412) 9338 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:45:46.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:45:45 gibba015 bash[30343]: cephadm 2021-03-10T16:45:44.609400+0000 mgr.gibba045.orlgmj (mgr.34412) 9339 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:45:46.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:45:45 gibba015 bash[30343]: cephadm 2021-03-10T16:45:44.611895+0000 mgr.gibba045.orlgmj (mgr.34412) 9340 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:45:46.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:45:45 gibba015 bash[30343]: cephadm 2021-03-10T16:45:44.612387+0000 mgr.gibba045.orlgmj (mgr.34412) 9341 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:45:46.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:45:45 gibba015 bash[30343]: cephadm 2021-03-10T16:45:44.613119+0000 mgr.gibba045.orlgmj (mgr.34412) 9342 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:45:46.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:45:45 gibba015 bash[30343]: cluster 2021-03-10T16:45:44.683728+0000 mgr.gibba045.orlgmj (mgr.34412) 9343 : cluster [DBG] pgmap v5317: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:46.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:45:45 gibba015 bash[29377]: cephadm 2021-03-10T16:45:44.373382+0000 mgr.gibba045.orlgmj (mgr.34412) 9328 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:45:46.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:45:45 gibba015 bash[29377]: cephadm 2021-03-10T16:45:44.581576+0000 mgr.gibba045.orlgmj (mgr.34412) 9329 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:45:46.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:45:45 gibba015 bash[29377]: cephadm 2021-03-10T16:45:44.587760+0000 mgr.gibba045.orlgmj (mgr.34412) 9330 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:45:46.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:45:45 gibba015 bash[29377]: cephadm 2021-03-10T16:45:44.591885+0000 mgr.gibba045.orlgmj (mgr.34412) 9331 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:45:46.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:45:45 gibba015 bash[29377]: cephadm 2021-03-10T16:45:44.592618+0000 mgr.gibba045.orlgmj (mgr.34412) 9332 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:45:46.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:45:45 gibba015 bash[29377]: cephadm 2021-03-10T16:45:44.595850+0000 mgr.gibba045.orlgmj (mgr.34412) 9333 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:45:46.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:45:45 gibba015 bash[29377]: cephadm 2021-03-10T16:45:44.596141+0000 mgr.gibba045.orlgmj (mgr.34412) 9334 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:45:46.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:45:45 gibba015 bash[29377]: cephadm 2021-03-10T16:45:44.599221+0000 mgr.gibba045.orlgmj (mgr.34412) 9335 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:45:46.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:45:45 gibba015 bash[29377]: cephadm 2021-03-10T16:45:44.602942+0000 mgr.gibba045.orlgmj (mgr.34412) 9336 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:45:46.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:45:45 gibba015 bash[29377]: cephadm 2021-03-10T16:45:44.603504+0000 mgr.gibba045.orlgmj (mgr.34412) 9337 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:45:46.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:45:45 gibba015 bash[29377]: cephadm 2021-03-10T16:45:44.607027+0000 mgr.gibba045.orlgmj (mgr.34412) 9338 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:45:46.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:45:45 gibba015 bash[29377]: cephadm 2021-03-10T16:45:44.609400+0000 mgr.gibba045.orlgmj (mgr.34412) 9339 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:45:46.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:45:45 gibba015 bash[29377]: cephadm 2021-03-10T16:45:44.611895+0000 mgr.gibba045.orlgmj (mgr.34412) 9340 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:45:46.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:45:45 gibba015 bash[29377]: cephadm 2021-03-10T16:45:44.612387+0000 mgr.gibba045.orlgmj (mgr.34412) 9341 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:45:46.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:45:45 gibba015 bash[29377]: cephadm 2021-03-10T16:45:44.613119+0000 mgr.gibba045.orlgmj (mgr.34412) 9342 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:45:46.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:45:45 gibba015 bash[29377]: cluster 2021-03-10T16:45:44.683728+0000 mgr.gibba045.orlgmj (mgr.34412) 9343 : cluster [DBG] pgmap v5317: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:47.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:45:47 gibba015 bash[29377]: cluster 2021-03-10T16:45:46.684683+0000 mgr.gibba045.orlgmj (mgr.34412) 9344 : cluster [DBG] pgmap v5318: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:47.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:45:47 gibba015 bash[30343]: cluster 2021-03-10T16:45:46.684683+0000 mgr.gibba045.orlgmj (mgr.34412) 9344 : cluster [DBG] pgmap v5318: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:48.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:45:47 gibba045 bash[25517]: cluster 2021-03-10T16:45:46.684683+0000 mgr.gibba045.orlgmj (mgr.34412) 9344 : cluster [DBG] pgmap v5318: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:49.132 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:45:49.360 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:45:49.361 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 9m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:45:49.361 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 8m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:45:49.362 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:45:49.362 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:45:49.362 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:45:49.362 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:45:49.363 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:45:49.363 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:45:49.363 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 9m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:45:49.363 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 8m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:45:49.363 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:45:49.364 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:45:49.364 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:45:49.364 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:45:49.364 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:45:49.365 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:45:49.365 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:45:49.365 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:45:49.365 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 8m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:45:49.365 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 8m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:45:49.609 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:45:49.609 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:45:49.609 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:45:49.609 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:45:49.610 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:45:49.610 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:45:49.610 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:45:49.610 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:45:49.611 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:45:49.611 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:45:49.611 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:45:49.611 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:45:49.612 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:45:49.612 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:45:49.612 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:45:50.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:45:49 gibba045 bash[25517]: cluster 2021-03-10T16:45:48.685587+0000 mgr.gibba045.orlgmj (mgr.34412) 9345 : cluster [DBG] pgmap v5319: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:50.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:45:49 gibba045 bash[25517]: audit 2021-03-10T16:45:49.610120+0000 mon.c (mon.1) 2572 : audit [DBG] from='client.? 172.21.2.115:0/2922212268' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:45:50.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:45:49 gibba015 bash[29377]: cluster 2021-03-10T16:45:48.685587+0000 mgr.gibba045.orlgmj (mgr.34412) 9345 : cluster [DBG] pgmap v5319: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:50.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:45:49 gibba015 bash[29377]: audit 2021-03-10T16:45:49.610120+0000 mon.c (mon.1) 2572 : audit [DBG] from='client.? 172.21.2.115:0/2922212268' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:45:50.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:45:49 gibba015 bash[30343]: cluster 2021-03-10T16:45:48.685587+0000 mgr.gibba045.orlgmj (mgr.34412) 9345 : cluster [DBG] pgmap v5319: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:50.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:45:49 gibba015 bash[30343]: audit 2021-03-10T16:45:49.610120+0000 mon.c (mon.1) 2572 : audit [DBG] from='client.? 172.21.2.115:0/2922212268' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:45:51.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:45:50 gibba045 bash[25517]: audit 2021-03-10T16:45:49.126975+0000 mgr.gibba045.orlgmj (mgr.34412) 9346 : audit [DBG] from='client.60304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:45:51.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:45:50 gibba045 bash[25517]: audit 2021-03-10T16:45:49.351789+0000 mgr.gibba045.orlgmj (mgr.34412) 9347 : audit [DBG] from='client.50322 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:45:51.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:45:50 gibba015 bash[29377]: audit 2021-03-10T16:45:49.126975+0000 mgr.gibba045.orlgmj (mgr.34412) 9346 : audit [DBG] from='client.60304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:45:51.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:45:50 gibba015 bash[29377]: audit 2021-03-10T16:45:49.351789+0000 mgr.gibba045.orlgmj (mgr.34412) 9347 : audit [DBG] from='client.50322 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:45:51.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:45:50 gibba015 bash[30343]: audit 2021-03-10T16:45:49.126975+0000 mgr.gibba045.orlgmj (mgr.34412) 9346 : audit [DBG] from='client.60304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:45:51.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:45:50 gibba015 bash[30343]: audit 2021-03-10T16:45:49.351789+0000 mgr.gibba045.orlgmj (mgr.34412) 9347 : audit [DBG] from='client.50322 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:45:52.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:45:51 gibba045 bash[25517]: cluster 2021-03-10T16:45:50.687285+0000 mgr.gibba045.orlgmj (mgr.34412) 9348 : cluster [DBG] pgmap v5320: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:52.218 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:45:51 gibba015 bash[29377]: cluster 2021-03-10T16:45:50.687285+0000 mgr.gibba045.orlgmj (mgr.34412) 9348 : cluster [DBG] pgmap v5320: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:52.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:45:51 gibba015 bash[30343]: cluster 2021-03-10T16:45:50.687285+0000 mgr.gibba045.orlgmj (mgr.34412) 9348 : cluster [DBG] pgmap v5320: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:54.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:45:53 gibba045 bash[25517]: cluster 2021-03-10T16:45:52.688849+0000 mgr.gibba045.orlgmj (mgr.34412) 9349 : cluster [DBG] pgmap v5321: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:54.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:45:53 gibba045 bash[25517]: audit 2021-03-10T16:45:53.716728+0000 mon.c (mon.1) 2573 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:45:54.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:45:53 gibba045 bash[25517]: audit 2021-03-10T16:45:53.717843+0000 mon.a (mon.0) 2054 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:45:54.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:45:53 gibba045 bash[25517]: audit 2021-03-10T16:45:53.717845+0000 mon.c (mon.1) 2574 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:45:54.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:45:53 gibba045 bash[25517]: audit 2021-03-10T16:45:53.718758+0000 mon.a (mon.0) 2055 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:45:54.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:45:53 gibba045 bash[25517]: audit 2021-03-10T16:45:53.741737+0000 mon.c (mon.1) 2575 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T16:45:54.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:45:53 gibba045 bash[25517]: audit 2021-03-10T16:45:53.742464+0000 mon.c (mon.1) 2576 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:45:54.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:45:53 gibba045 bash[25517]: audit 2021-03-10T16:45:53.742972+0000 mon.a (mon.0) 2056 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T16:45:54.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:45:53 gibba045 bash[25517]: audit 2021-03-10T16:45:53.743175+0000 mon.c (mon.1) 2577 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:45:54.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:45:53 gibba045 bash[25517]: audit 2021-03-10T16:45:53.744079+0000 mon.c (mon.1) 2578 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:45:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:45:53 gibba045 bash[25517]: audit 2021-03-10T16:45:53.744191+0000 mon.a (mon.0) 2057 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:45:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:45:53 gibba045 bash[25517]: audit 2021-03-10T16:45:53.745481+0000 mon.a (mon.0) 2058 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:45:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:45:53 gibba045 bash[25517]: audit 2021-03-10T16:45:53.746296+0000 mon.a (mon.0) 2059 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:45:54.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:45:53 gibba015 bash[29377]: cluster 2021-03-10T16:45:52.688849+0000 mgr.gibba045.orlgmj (mgr.34412) 9349 : cluster [DBG] pgmap v5321: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:54.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:45:53 gibba015 bash[29377]: audit 2021-03-10T16:45:53.716728+0000 mon.c (mon.1) 2573 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:45:54.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:45:53 gibba015 bash[29377]: audit 2021-03-10T16:45:53.717843+0000 mon.a (mon.0) 2054 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:45:54.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:45:53 gibba015 bash[29377]: audit 2021-03-10T16:45:53.717845+0000 mon.c (mon.1) 2574 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:45:54.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:45:53 gibba015 bash[29377]: audit 2021-03-10T16:45:53.718758+0000 mon.a (mon.0) 2055 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:45:54.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:45:53 gibba015 bash[29377]: audit 2021-03-10T16:45:53.741737+0000 mon.c (mon.1) 2575 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T16:45:54.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:45:53 gibba015 bash[29377]: audit 2021-03-10T16:45:53.742464+0000 mon.c (mon.1) 2576 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:45:54.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:45:53 gibba015 bash[29377]: audit 2021-03-10T16:45:53.742972+0000 mon.a (mon.0) 2056 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T16:45:54.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:45:53 gibba015 bash[29377]: audit 2021-03-10T16:45:53.743175+0000 mon.c (mon.1) 2577 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:45:54.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:45:53 gibba015 bash[29377]: audit 2021-03-10T16:45:53.744079+0000 mon.c (mon.1) 2578 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:45:54.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:45:53 gibba015 bash[29377]: audit 2021-03-10T16:45:53.744191+0000 mon.a (mon.0) 2057 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:45:54.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:45:53 gibba015 bash[29377]: audit 2021-03-10T16:45:53.745481+0000 mon.a (mon.0) 2058 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:45:54.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:45:53 gibba015 bash[29377]: audit 2021-03-10T16:45:53.746296+0000 mon.a (mon.0) 2059 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:45:54.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:45:53 gibba015 bash[30343]: cluster 2021-03-10T16:45:52.688849+0000 mgr.gibba045.orlgmj (mgr.34412) 9349 : cluster [DBG] pgmap v5321: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:54.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:45:53 gibba015 bash[30343]: audit 2021-03-10T16:45:53.716728+0000 mon.c (mon.1) 2573 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:45:54.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:45:53 gibba015 bash[30343]: audit 2021-03-10T16:45:53.717843+0000 mon.a (mon.0) 2054 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:45:54.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:45:53 gibba015 bash[30343]: audit 2021-03-10T16:45:53.717845+0000 mon.c (mon.1) 2574 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:45:54.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:45:53 gibba015 bash[30343]: audit 2021-03-10T16:45:53.718758+0000 mon.a (mon.0) 2055 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:45:54.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:45:53 gibba015 bash[30343]: audit 2021-03-10T16:45:53.741737+0000 mon.c (mon.1) 2575 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T16:45:54.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:45:53 gibba015 bash[30343]: audit 2021-03-10T16:45:53.742464+0000 mon.c (mon.1) 2576 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:45:54.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:45:53 gibba015 bash[30343]: audit 2021-03-10T16:45:53.742972+0000 mon.a (mon.0) 2056 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T16:45:54.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:45:53 gibba015 bash[30343]: audit 2021-03-10T16:45:53.743175+0000 mon.c (mon.1) 2577 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:45:54.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:45:53 gibba015 bash[30343]: audit 2021-03-10T16:45:53.744079+0000 mon.c (mon.1) 2578 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:45:54.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:45:53 gibba015 bash[30343]: audit 2021-03-10T16:45:53.744191+0000 mon.a (mon.0) 2057 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:45:54.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:45:53 gibba015 bash[30343]: audit 2021-03-10T16:45:53.745481+0000 mon.a (mon.0) 2058 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:45:54.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:45:53 gibba015 bash[30343]: audit 2021-03-10T16:45:53.746296+0000 mon.a (mon.0) 2059 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:45:56.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:45:55 gibba045 bash[25517]: cluster 2021-03-10T16:45:54.689789+0000 mgr.gibba045.orlgmj (mgr.34412) 9350 : cluster [DBG] pgmap v5322: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:56.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:45:55 gibba015 bash[29377]: cluster 2021-03-10T16:45:54.689789+0000 mgr.gibba045.orlgmj (mgr.34412) 9350 : cluster [DBG] pgmap v5322: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:56.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:45:55 gibba015 bash[30343]: cluster 2021-03-10T16:45:54.689789+0000 mgr.gibba045.orlgmj (mgr.34412) 9350 : cluster [DBG] pgmap v5322: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:57.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:45:57 gibba015 bash[29377]: cluster 2021-03-10T16:45:56.691548+0000 mgr.gibba045.orlgmj (mgr.34412) 9351 : cluster [DBG] pgmap v5323: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:57.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:45:57 gibba015 bash[30343]: cluster 2021-03-10T16:45:56.691548+0000 mgr.gibba045.orlgmj (mgr.34412) 9351 : cluster [DBG] pgmap v5323: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:58.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:45:57 gibba045 bash[25517]: cluster 2021-03-10T16:45:56.691548+0000 mgr.gibba045.orlgmj (mgr.34412) 9351 : cluster [DBG] pgmap v5323: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:00.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:45:59 gibba045 bash[25517]: cluster 2021-03-10T16:45:58.692903+0000 mgr.gibba045.orlgmj (mgr.34412) 9352 : cluster [DBG] pgmap v5324: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:00.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:45:59 gibba015 bash[29377]: cluster 2021-03-10T16:45:58.692903+0000 mgr.gibba045.orlgmj (mgr.34412) 9352 : cluster [DBG] pgmap v5324: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:00.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:45:59 gibba015 bash[30343]: cluster 2021-03-10T16:45:58.692903+0000 mgr.gibba045.orlgmj (mgr.34412) 9352 : cluster [DBG] pgmap v5324: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:01.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:46:00 gibba045 bash[25517]: cephadm 2021-03-10T16:45:59.629135+0000 mgr.gibba045.orlgmj (mgr.34412) 9353 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:46:01.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:46:00 gibba015 bash[29377]: cephadm 2021-03-10T16:45:59.629135+0000 mgr.gibba045.orlgmj (mgr.34412) 9353 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:46:01.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:46:00 gibba015 bash[30343]: cephadm 2021-03-10T16:45:59.629135+0000 mgr.gibba045.orlgmj (mgr.34412) 9353 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:46:02.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:46:01 gibba045 bash[25517]: cluster 2021-03-10T16:46:00.694703+0000 mgr.gibba045.orlgmj (mgr.34412) 9354 : cluster [DBG] pgmap v5325: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:02.218 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:46:01 gibba015 bash[29377]: cluster 2021-03-10T16:46:00.694703+0000 mgr.gibba045.orlgmj (mgr.34412) 9354 : cluster [DBG] pgmap v5325: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:02.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:46:01 gibba015 bash[30343]: cluster 2021-03-10T16:46:00.694703+0000 mgr.gibba045.orlgmj (mgr.34412) 9354 : cluster [DBG] pgmap v5325: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:04.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:46:03 gibba045 bash[25517]: cluster 2021-03-10T16:46:02.696371+0000 mgr.gibba045.orlgmj (mgr.34412) 9355 : cluster [DBG] pgmap v5326: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:04.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:46:03 gibba015 bash[29377]: cluster 2021-03-10T16:46:02.696371+0000 mgr.gibba045.orlgmj (mgr.34412) 9355 : cluster [DBG] pgmap v5326: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:04.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:46:03 gibba015 bash[30343]: cluster 2021-03-10T16:46:02.696371+0000 mgr.gibba045.orlgmj (mgr.34412) 9355 : cluster [DBG] pgmap v5326: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:06.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:46:05 gibba045 bash[25517]: cluster 2021-03-10T16:46:04.697749+0000 mgr.gibba045.orlgmj (mgr.34412) 9356 : cluster [DBG] pgmap v5327: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:06.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:46:05 gibba015 bash[29377]: cluster 2021-03-10T16:46:04.697749+0000 mgr.gibba045.orlgmj (mgr.34412) 9356 : cluster [DBG] pgmap v5327: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:06.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:46:05 gibba015 bash[30343]: cluster 2021-03-10T16:46:04.697749+0000 mgr.gibba045.orlgmj (mgr.34412) 9356 : cluster [DBG] pgmap v5327: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:07.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:46:07 gibba015 bash[29377]: cluster 2021-03-10T16:46:06.698839+0000 mgr.gibba045.orlgmj (mgr.34412) 9357 : cluster [DBG] pgmap v5328: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:07.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:46:07 gibba015 bash[30343]: cluster 2021-03-10T16:46:06.698839+0000 mgr.gibba045.orlgmj (mgr.34412) 9357 : cluster [DBG] pgmap v5328: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:08.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:46:07 gibba045 bash[25517]: cluster 2021-03-10T16:46:06.698839+0000 mgr.gibba045.orlgmj (mgr.34412) 9357 : cluster [DBG] pgmap v5328: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:10.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:46:09 gibba045 bash[25517]: cluster 2021-03-10T16:46:08.699956+0000 mgr.gibba045.orlgmj (mgr.34412) 9358 : cluster [DBG] pgmap v5329: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:10.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:46:09 gibba015 bash[29377]: cluster 2021-03-10T16:46:08.699956+0000 mgr.gibba045.orlgmj (mgr.34412) 9358 : cluster [DBG] pgmap v5329: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:10.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:46:09 gibba015 bash[30343]: cluster 2021-03-10T16:46:08.699956+0000 mgr.gibba045.orlgmj (mgr.34412) 9358 : cluster [DBG] pgmap v5329: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:12.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:46:11 gibba045 bash[25517]: cluster 2021-03-10T16:46:10.701501+0000 mgr.gibba045.orlgmj (mgr.34412) 9359 : cluster [DBG] pgmap v5330: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:12.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:46:11 gibba015 bash[29377]: cluster 2021-03-10T16:46:10.701501+0000 mgr.gibba045.orlgmj (mgr.34412) 9359 : cluster [DBG] pgmap v5330: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:12.350 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:46:11 gibba015 bash[30343]: cluster 2021-03-10T16:46:10.701501+0000 mgr.gibba045.orlgmj (mgr.34412) 9359 : cluster [DBG] pgmap v5330: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:14.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:46:13 gibba045 bash[25517]: cluster 2021-03-10T16:46:12.702516+0000 mgr.gibba045.orlgmj (mgr.34412) 9360 : cluster [DBG] pgmap v5331: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:14.218 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:46:13 gibba015 bash[29377]: cluster 2021-03-10T16:46:12.702516+0000 mgr.gibba045.orlgmj (mgr.34412) 9360 : cluster [DBG] pgmap v5331: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:14.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:46:13 gibba015 bash[30343]: cluster 2021-03-10T16:46:12.702516+0000 mgr.gibba045.orlgmj (mgr.34412) 9360 : cluster [DBG] pgmap v5331: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:16.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:46:15 gibba045 bash[25517]: cephadm 2021-03-10T16:46:14.631709+0000 mgr.gibba045.orlgmj (mgr.34412) 9361 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:46:16.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:46:15 gibba045 bash[25517]: cluster 2021-03-10T16:46:14.704124+0000 mgr.gibba045.orlgmj (mgr.34412) 9362 : cluster [DBG] pgmap v5332: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:16.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:46:15 gibba015 bash[29377]: cephadm 2021-03-10T16:46:14.631709+0000 mgr.gibba045.orlgmj (mgr.34412) 9361 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:46:16.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:46:15 gibba015 bash[29377]: cluster 2021-03-10T16:46:14.704124+0000 mgr.gibba045.orlgmj (mgr.34412) 9362 : cluster [DBG] pgmap v5332: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:16.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:46:15 gibba015 bash[30343]: cephadm 2021-03-10T16:46:14.631709+0000 mgr.gibba045.orlgmj (mgr.34412) 9361 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:46:16.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:46:15 gibba015 bash[30343]: cluster 2021-03-10T16:46:14.704124+0000 mgr.gibba045.orlgmj (mgr.34412) 9362 : cluster [DBG] pgmap v5332: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:17.968 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:46:17 gibba015 bash[29377]: cluster 2021-03-10T16:46:16.705450+0000 mgr.gibba045.orlgmj (mgr.34412) 9363 : cluster [DBG] pgmap v5333: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:17.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:46:17 gibba015 bash[30343]: cluster 2021-03-10T16:46:16.705450+0000 mgr.gibba045.orlgmj (mgr.34412) 9363 : cluster [DBG] pgmap v5333: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:18.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:46:17 gibba045 bash[25517]: cluster 2021-03-10T16:46:16.705450+0000 mgr.gibba045.orlgmj (mgr.34412) 9363 : cluster [DBG] pgmap v5333: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:19.854 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:46:20.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:46:19 gibba045 bash[25517]: cluster 2021-03-10T16:46:18.706668+0000 mgr.gibba045.orlgmj (mgr.34412) 9364 : cluster [DBG] pgmap v5334: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:20.081 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:46:20.081 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 9m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:46:20.081 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 8m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:46:20.081 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:46:20.082 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:46:20.082 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:46:20.082 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:46:20.082 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:46:20.083 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:46:20.083 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 9m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:46:20.083 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 8m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:46:20.083 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:46:20.083 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:46:20.084 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:46:20.084 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:46:20.084 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:46:20.084 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:46:20.085 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:46:20.085 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:46:20.085 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 8m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:46:20.085 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 8m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:46:20.218 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:46:19 gibba015 bash[29377]: cluster 2021-03-10T16:46:18.706668+0000 mgr.gibba045.orlgmj (mgr.34412) 9364 : cluster [DBG] pgmap v5334: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:20.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:46:19 gibba015 bash[30343]: cluster 2021-03-10T16:46:18.706668+0000 mgr.gibba045.orlgmj (mgr.34412) 9364 : cluster [DBG] pgmap v5334: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:20.332 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:46:20.332 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:46:20.332 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:46:20.332 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:46:20.333 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:46:20.333 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:46:20.333 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:46:20.334 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:46:20.334 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:46:20.334 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:46:20.334 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:46:20.335 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:46:20.335 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:46:20.335 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:46:20.335 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:46:21.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:46:20 gibba045 bash[25517]: audit 2021-03-10T16:46:19.849364+0000 mgr.gibba045.orlgmj (mgr.34412) 9365 : audit [DBG] from='client.50334 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:46:21.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:46:20 gibba045 bash[25517]: audit 2021-03-10T16:46:20.333360+0000 mon.a (mon.0) 2060 : audit [DBG] from='client.? 172.21.2.115:0/3404292043' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:46:21.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:46:20 gibba015 bash[29377]: audit 2021-03-10T16:46:19.849364+0000 mgr.gibba045.orlgmj (mgr.34412) 9365 : audit [DBG] from='client.50334 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:46:21.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:46:20 gibba015 bash[29377]: audit 2021-03-10T16:46:20.333360+0000 mon.a (mon.0) 2060 : audit [DBG] from='client.? 172.21.2.115:0/3404292043' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:46:21.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:46:20 gibba015 bash[30343]: audit 2021-03-10T16:46:19.849364+0000 mgr.gibba045.orlgmj (mgr.34412) 9365 : audit [DBG] from='client.50334 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:46:21.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:46:20 gibba015 bash[30343]: audit 2021-03-10T16:46:20.333360+0000 mon.a (mon.0) 2060 : audit [DBG] from='client.? 172.21.2.115:0/3404292043' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:46:22.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:46:21 gibba045 bash[25517]: audit 2021-03-10T16:46:20.073891+0000 mgr.gibba045.orlgmj (mgr.34412) 9366 : audit [DBG] from='client.50340 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:46:22.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:46:21 gibba045 bash[25517]: cluster 2021-03-10T16:46:20.708361+0000 mgr.gibba045.orlgmj (mgr.34412) 9367 : cluster [DBG] pgmap v5335: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:22.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:46:21 gibba015 bash[29377]: audit 2021-03-10T16:46:20.073891+0000 mgr.gibba045.orlgmj (mgr.34412) 9366 : audit [DBG] from='client.50340 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:46:22.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:46:21 gibba015 bash[29377]: cluster 2021-03-10T16:46:20.708361+0000 mgr.gibba045.orlgmj (mgr.34412) 9367 : cluster [DBG] pgmap v5335: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:22.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:46:21 gibba015 bash[30343]: audit 2021-03-10T16:46:20.073891+0000 mgr.gibba045.orlgmj (mgr.34412) 9366 : audit [DBG] from='client.50340 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:46:22.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:46:21 gibba015 bash[30343]: cluster 2021-03-10T16:46:20.708361+0000 mgr.gibba045.orlgmj (mgr.34412) 9367 : cluster [DBG] pgmap v5335: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:24.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:46:23 gibba045 bash[25517]: cluster 2021-03-10T16:46:22.709888+0000 mgr.gibba045.orlgmj (mgr.34412) 9368 : cluster [DBG] pgmap v5336: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:24.218 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:46:23 gibba015 bash[29377]: cluster 2021-03-10T16:46:22.709888+0000 mgr.gibba045.orlgmj (mgr.34412) 9368 : cluster [DBG] pgmap v5336: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:24.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:46:23 gibba015 bash[30343]: cluster 2021-03-10T16:46:22.709888+0000 mgr.gibba045.orlgmj (mgr.34412) 9368 : cluster [DBG] pgmap v5336: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:26.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:46:25 gibba045 bash[25517]: cluster 2021-03-10T16:46:24.711389+0000 mgr.gibba045.orlgmj (mgr.34412) 9369 : cluster [DBG] pgmap v5337: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:26.218 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:46:25 gibba015 bash[29377]: cluster 2021-03-10T16:46:24.711389+0000 mgr.gibba045.orlgmj (mgr.34412) 9369 : cluster [DBG] pgmap v5337: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:26.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:46:25 gibba015 bash[30343]: cluster 2021-03-10T16:46:24.711389+0000 mgr.gibba045.orlgmj (mgr.34412) 9369 : cluster [DBG] pgmap v5337: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:27.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:46:27 gibba015 bash[29377]: cluster 2021-03-10T16:46:26.712693+0000 mgr.gibba045.orlgmj (mgr.34412) 9370 : cluster [DBG] pgmap v5338: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:27.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:46:27 gibba015 bash[30343]: cluster 2021-03-10T16:46:26.712693+0000 mgr.gibba045.orlgmj (mgr.34412) 9370 : cluster [DBG] pgmap v5338: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:28.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:46:27 gibba045 bash[25517]: cluster 2021-03-10T16:46:26.712693+0000 mgr.gibba045.orlgmj (mgr.34412) 9370 : cluster [DBG] pgmap v5338: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:30.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:46:29 gibba045 bash[25517]: cluster 2021-03-10T16:46:28.713663+0000 mgr.gibba045.orlgmj (mgr.34412) 9371 : cluster [DBG] pgmap v5339: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:30.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:46:29 gibba015 bash[29377]: cluster 2021-03-10T16:46:28.713663+0000 mgr.gibba045.orlgmj (mgr.34412) 9371 : cluster [DBG] pgmap v5339: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:30.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:46:29 gibba015 bash[30343]: cluster 2021-03-10T16:46:28.713663+0000 mgr.gibba045.orlgmj (mgr.34412) 9371 : cluster [DBG] pgmap v5339: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:31.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:46:30 gibba045 bash[25517]: cephadm 2021-03-10T16:46:29.644770+0000 mgr.gibba045.orlgmj (mgr.34412) 9372 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:46:31.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:46:30 gibba015 bash[29377]: cephadm 2021-03-10T16:46:29.644770+0000 mgr.gibba045.orlgmj (mgr.34412) 9372 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:46:31.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:46:30 gibba015 bash[30343]: cephadm 2021-03-10T16:46:29.644770+0000 mgr.gibba045.orlgmj (mgr.34412) 9372 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:46:32.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:46:31 gibba045 bash[25517]: cluster 2021-03-10T16:46:30.715207+0000 mgr.gibba045.orlgmj (mgr.34412) 9373 : cluster [DBG] pgmap v5340: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:32.218 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:46:31 gibba015 bash[29377]: cluster 2021-03-10T16:46:30.715207+0000 mgr.gibba045.orlgmj (mgr.34412) 9373 : cluster [DBG] pgmap v5340: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:32.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:46:31 gibba015 bash[30343]: cluster 2021-03-10T16:46:30.715207+0000 mgr.gibba045.orlgmj (mgr.34412) 9373 : cluster [DBG] pgmap v5340: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:34.218 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:46:33 gibba015 bash[29377]: cluster 2021-03-10T16:46:32.716551+0000 mgr.gibba045.orlgmj (mgr.34412) 9374 : cluster [DBG] pgmap v5341: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:34.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:46:33 gibba015 bash[30343]: cluster 2021-03-10T16:46:32.716551+0000 mgr.gibba045.orlgmj (mgr.34412) 9374 : cluster [DBG] pgmap v5341: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:34.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:46:33 gibba045 bash[25517]: cluster 2021-03-10T16:46:32.716551+0000 mgr.gibba045.orlgmj (mgr.34412) 9374 : cluster [DBG] pgmap v5341: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:36.218 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:46:35 gibba015 bash[29377]: cluster 2021-03-10T16:46:34.717775+0000 mgr.gibba045.orlgmj (mgr.34412) 9375 : cluster [DBG] pgmap v5342: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:36.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:46:35 gibba015 bash[30343]: cluster 2021-03-10T16:46:34.717775+0000 mgr.gibba045.orlgmj (mgr.34412) 9375 : cluster [DBG] pgmap v5342: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:36.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:46:35 gibba045 bash[25517]: cluster 2021-03-10T16:46:34.717775+0000 mgr.gibba045.orlgmj (mgr.34412) 9375 : cluster [DBG] pgmap v5342: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:37.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:46:37 gibba015 bash[29377]: cluster 2021-03-10T16:46:36.719537+0000 mgr.gibba045.orlgmj (mgr.34412) 9376 : cluster [DBG] pgmap v5343: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:37.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:46:37 gibba015 bash[30343]: cluster 2021-03-10T16:46:36.719537+0000 mgr.gibba045.orlgmj (mgr.34412) 9376 : cluster [DBG] pgmap v5343: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:38.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:46:37 gibba045 bash[25517]: cluster 2021-03-10T16:46:36.719537+0000 mgr.gibba045.orlgmj (mgr.34412) 9376 : cluster [DBG] pgmap v5343: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:40.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:46:39 gibba045 bash[25517]: cluster 2021-03-10T16:46:38.720662+0000 mgr.gibba045.orlgmj (mgr.34412) 9377 : cluster [DBG] pgmap v5344: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:40.218 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:46:39 gibba015 bash[29377]: cluster 2021-03-10T16:46:38.720662+0000 mgr.gibba045.orlgmj (mgr.34412) 9377 : cluster [DBG] pgmap v5344: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:40.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:46:39 gibba015 bash[30343]: cluster 2021-03-10T16:46:38.720662+0000 mgr.gibba045.orlgmj (mgr.34412) 9377 : cluster [DBG] pgmap v5344: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:42.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:46:41 gibba045 bash[25517]: cluster 2021-03-10T16:46:40.722083+0000 mgr.gibba045.orlgmj (mgr.34412) 9378 : cluster [DBG] pgmap v5345: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:42.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:46:41 gibba015 bash[29377]: cluster 2021-03-10T16:46:40.722083+0000 mgr.gibba045.orlgmj (mgr.34412) 9378 : cluster [DBG] pgmap v5345: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:42.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:46:41 gibba015 bash[30343]: cluster 2021-03-10T16:46:40.722083+0000 mgr.gibba045.orlgmj (mgr.34412) 9378 : cluster [DBG] pgmap v5345: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:44.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:46:43 gibba045 bash[25517]: cluster 2021-03-10T16:46:42.723615+0000 mgr.gibba045.orlgmj (mgr.34412) 9379 : cluster [DBG] pgmap v5346: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:44.218 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:46:43 gibba015 bash[29377]: cluster 2021-03-10T16:46:42.723615+0000 mgr.gibba045.orlgmj (mgr.34412) 9379 : cluster [DBG] pgmap v5346: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:44.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:46:43 gibba015 bash[30343]: cluster 2021-03-10T16:46:42.723615+0000 mgr.gibba045.orlgmj (mgr.34412) 9379 : cluster [DBG] pgmap v5346: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:45.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:46:44 gibba015 bash[29377]: audit 2021-03-10T16:46:44.658330+0000 mon.c (mon.1) 2579 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:46:45.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:46:44 gibba015 bash[29377]: audit 2021-03-10T16:46:44.661174+0000 mon.c (mon.1) 2580 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:46:45.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:46:44 gibba015 bash[30343]: audit 2021-03-10T16:46:44.658330+0000 mon.c (mon.1) 2579 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:46:45.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:46:44 gibba015 bash[30343]: audit 2021-03-10T16:46:44.661174+0000 mon.c (mon.1) 2580 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:46:45.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:46:44 gibba045 bash[25517]: audit 2021-03-10T16:46:44.658330+0000 mon.c (mon.1) 2579 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:46:45.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:46:44 gibba045 bash[25517]: audit 2021-03-10T16:46:44.661174+0000 mon.c (mon.1) 2580 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:46:46.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:46:45 gibba015 bash[29377]: cephadm 2021-03-10T16:46:44.663288+0000 mgr.gibba045.orlgmj (mgr.34412) 9380 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:46:46.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:46:45 gibba015 bash[29377]: cluster 2021-03-10T16:46:44.724113+0000 mgr.gibba045.orlgmj (mgr.34412) 9381 : cluster [DBG] pgmap v5347: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:46.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:46:45 gibba015 bash[30343]: cephadm 2021-03-10T16:46:44.663288+0000 mgr.gibba045.orlgmj (mgr.34412) 9380 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:46:46.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:46:45 gibba015 bash[30343]: cluster 2021-03-10T16:46:44.724113+0000 mgr.gibba045.orlgmj (mgr.34412) 9381 : cluster [DBG] pgmap v5347: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:46.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:46:45 gibba045 bash[25517]: cephadm 2021-03-10T16:46:44.663288+0000 mgr.gibba045.orlgmj (mgr.34412) 9380 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:46:46.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:46:45 gibba045 bash[25517]: cluster 2021-03-10T16:46:44.724113+0000 mgr.gibba045.orlgmj (mgr.34412) 9381 : cluster [DBG] pgmap v5347: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:47.968 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:46:47 gibba015 bash[29377]: cluster 2021-03-10T16:46:46.725617+0000 mgr.gibba045.orlgmj (mgr.34412) 9382 : cluster [DBG] pgmap v5348: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:47.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:46:47 gibba015 bash[30343]: cluster 2021-03-10T16:46:46.725617+0000 mgr.gibba045.orlgmj (mgr.34412) 9382 : cluster [DBG] pgmap v5348: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:48.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:46:47 gibba045 bash[25517]: cluster 2021-03-10T16:46:46.725617+0000 mgr.gibba045.orlgmj (mgr.34412) 9382 : cluster [DBG] pgmap v5348: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:49.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:46:49 gibba015 bash[29377]: audit 2021-03-10T16:46:48.199347+0000 mon.a (mon.0) 2061 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:46:49.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:46:49 gibba015 bash[29377]: cephadm 2021-03-10T16:46:48.202864+0000 mgr.gibba045.orlgmj (mgr.34412) 9383 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:46:49.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:46:49 gibba015 bash[29377]: audit 2021-03-10T16:46:48.414483+0000 mon.a (mon.0) 2062 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:46:49.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:46:49 gibba015 bash[29377]: audit 2021-03-10T16:46:48.422384+0000 mon.c (mon.1) 2581 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:46:49.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:46:49 gibba015 bash[29377]: cephadm 2021-03-10T16:46:48.423686+0000 mgr.gibba045.orlgmj (mgr.34412) 9384 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:46:49.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:46:49 gibba015 bash[29377]: audit 2021-03-10T16:46:48.424727+0000 mon.c (mon.1) 2582 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:46:49.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:46:49 gibba015 bash[29377]: audit 2021-03-10T16:46:48.426106+0000 mon.c (mon.1) 2583 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:46:49.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:46:49 gibba015 bash[29377]: cephadm 2021-03-10T16:46:48.426494+0000 mgr.gibba045.orlgmj (mgr.34412) 9385 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:46:49.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:46:49 gibba015 bash[29377]: audit 2021-03-10T16:46:48.427352+0000 mon.c (mon.1) 2584 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:46:49.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:46:49 gibba015 bash[29377]: cephadm 2021-03-10T16:46:48.427915+0000 mgr.gibba045.orlgmj (mgr.34412) 9386 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:46:49.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:46:49 gibba015 bash[29377]: cephadm 2021-03-10T16:46:48.427956+0000 mgr.gibba045.orlgmj (mgr.34412) 9387 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:46:49.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:46:49 gibba015 bash[29377]: cephadm 2021-03-10T16:46:48.429322+0000 mgr.gibba045.orlgmj (mgr.34412) 9388 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:46:49.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:46:49 gibba015 bash[29377]: cephadm 2021-03-10T16:46:48.429362+0000 mgr.gibba045.orlgmj (mgr.34412) 9389 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:46:49.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:46:49 gibba015 bash[29377]: audit 2021-03-10T16:46:48.430220+0000 mon.c (mon.1) 2585 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:46:49.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:46:49 gibba015 bash[29377]: cephadm 2021-03-10T16:46:48.430533+0000 mgr.gibba045.orlgmj (mgr.34412) 9390 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:46:49.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:46:49 gibba015 bash[29377]: cephadm 2021-03-10T16:46:48.432134+0000 mgr.gibba045.orlgmj (mgr.34412) 9391 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:46:49.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:46:49 gibba015 bash[29377]: cephadm 2021-03-10T16:46:48.432171+0000 mgr.gibba045.orlgmj (mgr.34412) 9392 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:46:49.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:46:49 gibba015 bash[29377]: audit 2021-03-10T16:46:48.432171+0000 mon.c (mon.1) 2586 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:46:49.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:46:49 gibba015 bash[29377]: cephadm 2021-03-10T16:46:48.433642+0000 mgr.gibba045.orlgmj (mgr.34412) 9393 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:46:49.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:46:49 gibba015 bash[29377]: cephadm 2021-03-10T16:46:48.434088+0000 mgr.gibba045.orlgmj (mgr.34412) 9394 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:46:49.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:46:49 gibba015 bash[29377]: cephadm 2021-03-10T16:46:48.435804+0000 mgr.gibba045.orlgmj (mgr.34412) 9395 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:46:49.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:46:49 gibba015 bash[29377]: cephadm 2021-03-10T16:46:48.435851+0000 mgr.gibba045.orlgmj (mgr.34412) 9396 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:46:49.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:46:49 gibba015 bash[29377]: cephadm 2021-03-10T16:46:48.435990+0000 mgr.gibba045.orlgmj (mgr.34412) 9397 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:46:49.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:46:49 gibba015 bash[29377]: cluster 2021-03-10T16:46:48.726824+0000 mgr.gibba045.orlgmj (mgr.34412) 9398 : cluster [DBG] pgmap v5349: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:49.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:46:49 gibba015 bash[30343]: audit 2021-03-10T16:46:48.199347+0000 mon.a (mon.0) 2061 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:46:49.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:46:49 gibba015 bash[30343]: cephadm 2021-03-10T16:46:48.202864+0000 mgr.gibba045.orlgmj (mgr.34412) 9383 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:46:49.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:46:49 gibba015 bash[30343]: audit 2021-03-10T16:46:48.414483+0000 mon.a (mon.0) 2062 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:46:49.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:46:49 gibba015 bash[30343]: audit 2021-03-10T16:46:48.422384+0000 mon.c (mon.1) 2581 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:46:49.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:46:49 gibba015 bash[30343]: cephadm 2021-03-10T16:46:48.423686+0000 mgr.gibba045.orlgmj (mgr.34412) 9384 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:46:49.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:46:49 gibba015 bash[30343]: audit 2021-03-10T16:46:48.424727+0000 mon.c (mon.1) 2582 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:46:49.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:46:49 gibba015 bash[30343]: audit 2021-03-10T16:46:48.426106+0000 mon.c (mon.1) 2583 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:46:49.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:46:49 gibba015 bash[30343]: cephadm 2021-03-10T16:46:48.426494+0000 mgr.gibba045.orlgmj (mgr.34412) 9385 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:46:49.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:46:49 gibba015 bash[30343]: audit 2021-03-10T16:46:48.427352+0000 mon.c (mon.1) 2584 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:46:49.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:46:49 gibba015 bash[30343]: cephadm 2021-03-10T16:46:48.427915+0000 mgr.gibba045.orlgmj (mgr.34412) 9386 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:46:49.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:46:49 gibba015 bash[30343]: cephadm 2021-03-10T16:46:48.427956+0000 mgr.gibba045.orlgmj (mgr.34412) 9387 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:46:49.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:46:49 gibba015 bash[30343]: cephadm 2021-03-10T16:46:48.429322+0000 mgr.gibba045.orlgmj (mgr.34412) 9388 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:46:49.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:46:49 gibba015 bash[30343]: cephadm 2021-03-10T16:46:48.429362+0000 mgr.gibba045.orlgmj (mgr.34412) 9389 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:46:49.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:46:49 gibba015 bash[30343]: audit 2021-03-10T16:46:48.430220+0000 mon.c (mon.1) 2585 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:46:49.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:46:49 gibba015 bash[30343]: cephadm 2021-03-10T16:46:48.430533+0000 mgr.gibba045.orlgmj (mgr.34412) 9390 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:46:49.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:46:49 gibba015 bash[30343]: cephadm 2021-03-10T16:46:48.432134+0000 mgr.gibba045.orlgmj (mgr.34412) 9391 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:46:49.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:46:49 gibba015 bash[30343]: cephadm 2021-03-10T16:46:48.432171+0000 mgr.gibba045.orlgmj (mgr.34412) 9392 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:46:49.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:46:49 gibba015 bash[30343]: audit 2021-03-10T16:46:48.432171+0000 mon.c (mon.1) 2586 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:46:49.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:46:49 gibba015 bash[30343]: cephadm 2021-03-10T16:46:48.433642+0000 mgr.gibba045.orlgmj (mgr.34412) 9393 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:46:49.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:46:49 gibba015 bash[30343]: cephadm 2021-03-10T16:46:48.434088+0000 mgr.gibba045.orlgmj (mgr.34412) 9394 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:46:49.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:46:49 gibba015 bash[30343]: cephadm 2021-03-10T16:46:48.435804+0000 mgr.gibba045.orlgmj (mgr.34412) 9395 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:46:49.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:46:49 gibba015 bash[30343]: cephadm 2021-03-10T16:46:48.435851+0000 mgr.gibba045.orlgmj (mgr.34412) 9396 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:46:49.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:46:49 gibba015 bash[30343]: cephadm 2021-03-10T16:46:48.435990+0000 mgr.gibba045.orlgmj (mgr.34412) 9397 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:46:49.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:46:49 gibba015 bash[30343]: cluster 2021-03-10T16:46:48.726824+0000 mgr.gibba045.orlgmj (mgr.34412) 9398 : cluster [DBG] pgmap v5349: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:49.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:46:49 gibba045 bash[25517]: audit 2021-03-10T16:46:48.199347+0000 mon.a (mon.0) 2061 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:46:49.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:46:49 gibba045 bash[25517]: cephadm 2021-03-10T16:46:48.202864+0000 mgr.gibba045.orlgmj (mgr.34412) 9383 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:46:49.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:46:49 gibba045 bash[25517]: audit 2021-03-10T16:46:48.414483+0000 mon.a (mon.0) 2062 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:46:49.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:46:49 gibba045 bash[25517]: audit 2021-03-10T16:46:48.422384+0000 mon.c (mon.1) 2581 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:46:49.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:46:49 gibba045 bash[25517]: cephadm 2021-03-10T16:46:48.423686+0000 mgr.gibba045.orlgmj (mgr.34412) 9384 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:46:49.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:46:49 gibba045 bash[25517]: audit 2021-03-10T16:46:48.424727+0000 mon.c (mon.1) 2582 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:46:49.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:46:49 gibba045 bash[25517]: audit 2021-03-10T16:46:48.426106+0000 mon.c (mon.1) 2583 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:46:49.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:46:49 gibba045 bash[25517]: cephadm 2021-03-10T16:46:48.426494+0000 mgr.gibba045.orlgmj (mgr.34412) 9385 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:46:49.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:46:49 gibba045 bash[25517]: audit 2021-03-10T16:46:48.427352+0000 mon.c (mon.1) 2584 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:46:49.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:46:49 gibba045 bash[25517]: cephadm 2021-03-10T16:46:48.427915+0000 mgr.gibba045.orlgmj (mgr.34412) 9386 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:46:49.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:46:49 gibba045 bash[25517]: cephadm 2021-03-10T16:46:48.427956+0000 mgr.gibba045.orlgmj (mgr.34412) 9387 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:46:49.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:46:49 gibba045 bash[25517]: cephadm 2021-03-10T16:46:48.429322+0000 mgr.gibba045.orlgmj (mgr.34412) 9388 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:46:49.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:46:49 gibba045 bash[25517]: cephadm 2021-03-10T16:46:48.429362+0000 mgr.gibba045.orlgmj (mgr.34412) 9389 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:46:49.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:46:49 gibba045 bash[25517]: audit 2021-03-10T16:46:48.430220+0000 mon.c (mon.1) 2585 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:46:49.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:46:49 gibba045 bash[25517]: cephadm 2021-03-10T16:46:48.430533+0000 mgr.gibba045.orlgmj (mgr.34412) 9390 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:46:49.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:46:49 gibba045 bash[25517]: cephadm 2021-03-10T16:46:48.432134+0000 mgr.gibba045.orlgmj (mgr.34412) 9391 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:46:49.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:46:49 gibba045 bash[25517]: cephadm 2021-03-10T16:46:48.432171+0000 mgr.gibba045.orlgmj (mgr.34412) 9392 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:46:49.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:46:49 gibba045 bash[25517]: audit 2021-03-10T16:46:48.432171+0000 mon.c (mon.1) 2586 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:46:49.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:46:49 gibba045 bash[25517]: cephadm 2021-03-10T16:46:48.433642+0000 mgr.gibba045.orlgmj (mgr.34412) 9393 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:46:49.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:46:49 gibba045 bash[25517]: cephadm 2021-03-10T16:46:48.434088+0000 mgr.gibba045.orlgmj (mgr.34412) 9394 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:46:49.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:46:49 gibba045 bash[25517]: cephadm 2021-03-10T16:46:48.435804+0000 mgr.gibba045.orlgmj (mgr.34412) 9395 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:46:49.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:46:49 gibba045 bash[25517]: cephadm 2021-03-10T16:46:48.435851+0000 mgr.gibba045.orlgmj (mgr.34412) 9396 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:46:49.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:46:49 gibba045 bash[25517]: cephadm 2021-03-10T16:46:48.435990+0000 mgr.gibba045.orlgmj (mgr.34412) 9397 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:46:49.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:46:49 gibba045 bash[25517]: cluster 2021-03-10T16:46:48.726824+0000 mgr.gibba045.orlgmj (mgr.34412) 9398 : cluster [DBG] pgmap v5349: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:50.577 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:46:50.802 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:46:50.803 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 2s ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:46:50.803 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 9m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:46:50.803 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:46:50.804 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:46:50.804 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 2s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:46:50.804 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 2s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:46:50.805 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:46:50.805 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 2s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:46:50.805 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 2s ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:46:50.805 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 9m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:46:50.806 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 2s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:46:50.806 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 2s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:46:50.807 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 2s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:46:50.807 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 2s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:46:50.807 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:46:50.807 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:46:50.808 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:46:50.809 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:46:50.809 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 9m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:46:50.809 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 9m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:46:51.051 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:46:51.051 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:46:51.052 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:46:51.052 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:46:51.053 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:46:51.053 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:46:51.054 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:46:51.054 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:46:51.054 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:46:51.055 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:46:51.055 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:46:51.056 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:46:51.056 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:46:51.056 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:46:51.056 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:46:52.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:46:51 gibba045 bash[25517]: audit 2021-03-10T16:46:50.571878+0000 mgr.gibba045.orlgmj (mgr.34412) 9399 : audit [DBG] from='client.50352 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:46:52.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:46:51 gibba045 bash[25517]: cluster 2021-03-10T16:46:50.728678+0000 mgr.gibba045.orlgmj (mgr.34412) 9400 : cluster [DBG] pgmap v5350: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:52.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:46:51 gibba045 bash[25517]: audit 2021-03-10T16:46:50.797591+0000 mgr.gibba045.orlgmj (mgr.34412) 9401 : audit [DBG] from='client.64760 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:46:52.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:46:51 gibba045 bash[25517]: audit 2021-03-10T16:46:51.052501+0000 mon.c (mon.1) 2587 : audit [DBG] from='client.? 172.21.2.115:0/79209141' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:46:52.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:46:51 gibba015 bash[29377]: audit 2021-03-10T16:46:50.571878+0000 mgr.gibba045.orlgmj (mgr.34412) 9399 : audit [DBG] from='client.50352 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:46:52.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:46:51 gibba015 bash[29377]: cluster 2021-03-10T16:46:50.728678+0000 mgr.gibba045.orlgmj (mgr.34412) 9400 : cluster [DBG] pgmap v5350: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:52.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:46:51 gibba015 bash[29377]: audit 2021-03-10T16:46:50.797591+0000 mgr.gibba045.orlgmj (mgr.34412) 9401 : audit [DBG] from='client.64760 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:46:52.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:46:51 gibba015 bash[29377]: audit 2021-03-10T16:46:51.052501+0000 mon.c (mon.1) 2587 : audit [DBG] from='client.? 172.21.2.115:0/79209141' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:46:52.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:46:51 gibba015 bash[30343]: audit 2021-03-10T16:46:50.571878+0000 mgr.gibba045.orlgmj (mgr.34412) 9399 : audit [DBG] from='client.50352 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:46:52.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:46:51 gibba015 bash[30343]: cluster 2021-03-10T16:46:50.728678+0000 mgr.gibba045.orlgmj (mgr.34412) 9400 : cluster [DBG] pgmap v5350: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:52.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:46:51 gibba015 bash[30343]: audit 2021-03-10T16:46:50.797591+0000 mgr.gibba045.orlgmj (mgr.34412) 9401 : audit [DBG] from='client.64760 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:46:52.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:46:51 gibba015 bash[30343]: audit 2021-03-10T16:46:51.052501+0000 mon.c (mon.1) 2587 : audit [DBG] from='client.? 172.21.2.115:0/79209141' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:46:54.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:46:53 gibba045 bash[25517]: cluster 2021-03-10T16:46:52.730075+0000 mgr.gibba045.orlgmj (mgr.34412) 9402 : cluster [DBG] pgmap v5351: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:54.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:46:53 gibba045 bash[25517]: audit 2021-03-10T16:46:53.723510+0000 mon.c (mon.1) 2588 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:46:54.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:46:53 gibba045 bash[25517]: audit 2021-03-10T16:46:53.724181+0000 mon.c (mon.1) 2589 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:46:54.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:46:53 gibba045 bash[25517]: audit 2021-03-10T16:46:53.724546+0000 mon.a (mon.0) 2063 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:46:54.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:46:53 gibba045 bash[25517]: audit 2021-03-10T16:46:53.725620+0000 mon.a (mon.0) 2064 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:46:54.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:46:53 gibba045 bash[25517]: audit 2021-03-10T16:46:53.748204+0000 mon.c (mon.1) 2590 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T16:46:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:46:53 gibba045 bash[25517]: audit 2021-03-10T16:46:53.748934+0000 mon.c (mon.1) 2591 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:46:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:46:53 gibba045 bash[25517]: audit 2021-03-10T16:46:53.749445+0000 mon.a (mon.0) 2065 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T16:46:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:46:53 gibba045 bash[25517]: audit 2021-03-10T16:46:53.749662+0000 mon.c (mon.1) 2592 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:46:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:46:53 gibba045 bash[25517]: audit 2021-03-10T16:46:53.750504+0000 mon.c (mon.1) 2593 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:46:54.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:46:53 gibba045 bash[25517]: audit 2021-03-10T16:46:53.750937+0000 mon.a (mon.0) 2066 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:46:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:46:53 gibba045 bash[25517]: audit 2021-03-10T16:46:53.751944+0000 mon.a (mon.0) 2067 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:46:54.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:46:53 gibba045 bash[25517]: audit 2021-03-10T16:46:53.752734+0000 mon.a (mon.0) 2068 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:46:54.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:46:53 gibba015 bash[29377]: cluster 2021-03-10T16:46:52.730075+0000 mgr.gibba045.orlgmj (mgr.34412) 9402 : cluster [DBG] pgmap v5351: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:54.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:46:53 gibba015 bash[29377]: audit 2021-03-10T16:46:53.723510+0000 mon.c (mon.1) 2588 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:46:54.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:46:53 gibba015 bash[29377]: audit 2021-03-10T16:46:53.724181+0000 mon.c (mon.1) 2589 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:46:54.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:46:53 gibba015 bash[29377]: audit 2021-03-10T16:46:53.724546+0000 mon.a (mon.0) 2063 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:46:54.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:46:53 gibba015 bash[29377]: audit 2021-03-10T16:46:53.725620+0000 mon.a (mon.0) 2064 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:46:54.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:46:53 gibba015 bash[29377]: audit 2021-03-10T16:46:53.748204+0000 mon.c (mon.1) 2590 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T16:46:54.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:46:53 gibba015 bash[29377]: audit 2021-03-10T16:46:53.748934+0000 mon.c (mon.1) 2591 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:46:54.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:46:53 gibba015 bash[29377]: audit 2021-03-10T16:46:53.749445+0000 mon.a (mon.0) 2065 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T16:46:54.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:46:53 gibba015 bash[29377]: audit 2021-03-10T16:46:53.749662+0000 mon.c (mon.1) 2592 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:46:54.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:46:53 gibba015 bash[29377]: audit 2021-03-10T16:46:53.750504+0000 mon.c (mon.1) 2593 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:46:54.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:46:53 gibba015 bash[29377]: audit 2021-03-10T16:46:53.750937+0000 mon.a (mon.0) 2066 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:46:54.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:46:53 gibba015 bash[29377]: audit 2021-03-10T16:46:53.751944+0000 mon.a (mon.0) 2067 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:46:54.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:46:53 gibba015 bash[29377]: audit 2021-03-10T16:46:53.752734+0000 mon.a (mon.0) 2068 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:46:54.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:46:53 gibba015 bash[30343]: cluster 2021-03-10T16:46:52.730075+0000 mgr.gibba045.orlgmj (mgr.34412) 9402 : cluster [DBG] pgmap v5351: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:54.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:46:53 gibba015 bash[30343]: audit 2021-03-10T16:46:53.723510+0000 mon.c (mon.1) 2588 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:46:54.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:46:53 gibba015 bash[30343]: audit 2021-03-10T16:46:53.724181+0000 mon.c (mon.1) 2589 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:46:54.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:46:53 gibba015 bash[30343]: audit 2021-03-10T16:46:53.724546+0000 mon.a (mon.0) 2063 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:46:54.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:46:53 gibba015 bash[30343]: audit 2021-03-10T16:46:53.725620+0000 mon.a (mon.0) 2064 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:46:54.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:46:53 gibba015 bash[30343]: audit 2021-03-10T16:46:53.748204+0000 mon.c (mon.1) 2590 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T16:46:54.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:46:53 gibba015 bash[30343]: audit 2021-03-10T16:46:53.748934+0000 mon.c (mon.1) 2591 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:46:54.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:46:53 gibba015 bash[30343]: audit 2021-03-10T16:46:53.749445+0000 mon.a (mon.0) 2065 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T16:46:54.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:46:53 gibba015 bash[30343]: audit 2021-03-10T16:46:53.749662+0000 mon.c (mon.1) 2592 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:46:54.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:46:53 gibba015 bash[30343]: audit 2021-03-10T16:46:53.750504+0000 mon.c (mon.1) 2593 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:46:54.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:46:53 gibba015 bash[30343]: audit 2021-03-10T16:46:53.750937+0000 mon.a (mon.0) 2066 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:46:54.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:46:53 gibba015 bash[30343]: audit 2021-03-10T16:46:53.751944+0000 mon.a (mon.0) 2067 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:46:54.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:46:53 gibba015 bash[30343]: audit 2021-03-10T16:46:53.752734+0000 mon.a (mon.0) 2068 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:46:56.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:46:55 gibba015 bash[29377]: cluster 2021-03-10T16:46:54.731671+0000 mgr.gibba045.orlgmj (mgr.34412) 9403 : cluster [DBG] pgmap v5352: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:56.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:46:55 gibba015 bash[30343]: cluster 2021-03-10T16:46:54.731671+0000 mgr.gibba045.orlgmj (mgr.34412) 9403 : cluster [DBG] pgmap v5352: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:56.312 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:46:55 gibba045 bash[25517]: cluster 2021-03-10T16:46:54.731671+0000 mgr.gibba045.orlgmj (mgr.34412) 9403 : cluster [DBG] pgmap v5352: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:57.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:46:57 gibba015 bash[29377]: cluster 2021-03-10T16:46:56.733540+0000 mgr.gibba045.orlgmj (mgr.34412) 9404 : cluster [DBG] pgmap v5353: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:57.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:46:57 gibba015 bash[30343]: cluster 2021-03-10T16:46:56.733540+0000 mgr.gibba045.orlgmj (mgr.34412) 9404 : cluster [DBG] pgmap v5353: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:58.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:46:57 gibba045 bash[25517]: cluster 2021-03-10T16:46:56.733540+0000 mgr.gibba045.orlgmj (mgr.34412) 9404 : cluster [DBG] pgmap v5353: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:00.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:46:59 gibba045 bash[25517]: cluster 2021-03-10T16:46:58.734610+0000 mgr.gibba045.orlgmj (mgr.34412) 9405 : cluster [DBG] pgmap v5354: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:00.218 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:46:59 gibba015 bash[29377]: cluster 2021-03-10T16:46:58.734610+0000 mgr.gibba045.orlgmj (mgr.34412) 9405 : cluster [DBG] pgmap v5354: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:00.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:46:59 gibba015 bash[30343]: cluster 2021-03-10T16:46:58.734610+0000 mgr.gibba045.orlgmj (mgr.34412) 9405 : cluster [DBG] pgmap v5354: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:02.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:01 gibba015 bash[29377]: cluster 2021-03-10T16:47:00.736074+0000 mgr.gibba045.orlgmj (mgr.34412) 9406 : cluster [DBG] pgmap v5355: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:02.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:01 gibba015 bash[30343]: cluster 2021-03-10T16:47:00.736074+0000 mgr.gibba045.orlgmj (mgr.34412) 9406 : cluster [DBG] pgmap v5355: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:02.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:01 gibba045 bash[25517]: cluster 2021-03-10T16:47:00.736074+0000 mgr.gibba045.orlgmj (mgr.34412) 9406 : cluster [DBG] pgmap v5355: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:04.218 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:03 gibba015 bash[29377]: cluster 2021-03-10T16:47:02.737822+0000 mgr.gibba045.orlgmj (mgr.34412) 9407 : cluster [DBG] pgmap v5356: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:04.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:03 gibba015 bash[30343]: cluster 2021-03-10T16:47:02.737822+0000 mgr.gibba045.orlgmj (mgr.34412) 9407 : cluster [DBG] pgmap v5356: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:04.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:03 gibba045 bash[25517]: cluster 2021-03-10T16:47:02.737822+0000 mgr.gibba045.orlgmj (mgr.34412) 9407 : cluster [DBG] pgmap v5356: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:05.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:04 gibba015 bash[29377]: cephadm 2021-03-10T16:47:03.446479+0000 mgr.gibba045.orlgmj (mgr.34412) 9408 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:47:05.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:04 gibba015 bash[30343]: cephadm 2021-03-10T16:47:03.446479+0000 mgr.gibba045.orlgmj (mgr.34412) 9408 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:47:05.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:04 gibba045 bash[25517]: cephadm 2021-03-10T16:47:03.446479+0000 mgr.gibba045.orlgmj (mgr.34412) 9408 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:47:06.218 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:05 gibba015 bash[29377]: cluster 2021-03-10T16:47:04.739350+0000 mgr.gibba045.orlgmj (mgr.34412) 9409 : cluster [DBG] pgmap v5357: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:06.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:05 gibba015 bash[30343]: cluster 2021-03-10T16:47:04.739350+0000 mgr.gibba045.orlgmj (mgr.34412) 9409 : cluster [DBG] pgmap v5357: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:06.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:05 gibba045 bash[25517]: cluster 2021-03-10T16:47:04.739350+0000 mgr.gibba045.orlgmj (mgr.34412) 9409 : cluster [DBG] pgmap v5357: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:07.968 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:07 gibba015 bash[29377]: cluster 2021-03-10T16:47:06.741264+0000 mgr.gibba045.orlgmj (mgr.34412) 9410 : cluster [DBG] pgmap v5358: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:07.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:07 gibba015 bash[30343]: cluster 2021-03-10T16:47:06.741264+0000 mgr.gibba045.orlgmj (mgr.34412) 9410 : cluster [DBG] pgmap v5358: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:08.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:07 gibba045 bash[25517]: cluster 2021-03-10T16:47:06.741264+0000 mgr.gibba045.orlgmj (mgr.34412) 9410 : cluster [DBG] pgmap v5358: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:10.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:09 gibba015 bash[29377]: cluster 2021-03-10T16:47:08.742197+0000 mgr.gibba045.orlgmj (mgr.34412) 9411 : cluster [DBG] pgmap v5359: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:10.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:09 gibba015 bash[30343]: cluster 2021-03-10T16:47:08.742197+0000 mgr.gibba045.orlgmj (mgr.34412) 9411 : cluster [DBG] pgmap v5359: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:10.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:09 gibba045 bash[25517]: cluster 2021-03-10T16:47:08.742197+0000 mgr.gibba045.orlgmj (mgr.34412) 9411 : cluster [DBG] pgmap v5359: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:12.218 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:11 gibba015 bash[29377]: cluster 2021-03-10T16:47:10.743869+0000 mgr.gibba045.orlgmj (mgr.34412) 9412 : cluster [DBG] pgmap v5360: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:12.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:11 gibba015 bash[30343]: cluster 2021-03-10T16:47:10.743869+0000 mgr.gibba045.orlgmj (mgr.34412) 9412 : cluster [DBG] pgmap v5360: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:12.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:11 gibba045 bash[25517]: cluster 2021-03-10T16:47:10.743869+0000 mgr.gibba045.orlgmj (mgr.34412) 9412 : cluster [DBG] pgmap v5360: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:14.218 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:13 gibba015 bash[30343]: cluster 2021-03-10T16:47:12.745564+0000 mgr.gibba045.orlgmj (mgr.34412) 9413 : cluster [DBG] pgmap v5361: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:14.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:13 gibba015 bash[29377]: cluster 2021-03-10T16:47:12.745564+0000 mgr.gibba045.orlgmj (mgr.34412) 9413 : cluster [DBG] pgmap v5361: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:14.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:13 gibba045 bash[25517]: cluster 2021-03-10T16:47:12.745564+0000 mgr.gibba045.orlgmj (mgr.34412) 9413 : cluster [DBG] pgmap v5361: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:16.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:15 gibba015 bash[29377]: cluster 2021-03-10T16:47:14.747157+0000 mgr.gibba045.orlgmj (mgr.34412) 9414 : cluster [DBG] pgmap v5362: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:16.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:15 gibba015 bash[30343]: cluster 2021-03-10T16:47:14.747157+0000 mgr.gibba045.orlgmj (mgr.34412) 9414 : cluster [DBG] pgmap v5362: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:16.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:15 gibba045 bash[25517]: cluster 2021-03-10T16:47:14.747157+0000 mgr.gibba045.orlgmj (mgr.34412) 9414 : cluster [DBG] pgmap v5362: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:17.968 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:17 gibba015 bash[29377]: cluster 2021-03-10T16:47:16.749068+0000 mgr.gibba045.orlgmj (mgr.34412) 9415 : cluster [DBG] pgmap v5363: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:17.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:17 gibba015 bash[30343]: cluster 2021-03-10T16:47:16.749068+0000 mgr.gibba045.orlgmj (mgr.34412) 9415 : cluster [DBG] pgmap v5363: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:18.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:17 gibba045 bash[25517]: cluster 2021-03-10T16:47:16.749068+0000 mgr.gibba045.orlgmj (mgr.34412) 9415 : cluster [DBG] pgmap v5363: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:20.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:19 gibba015 bash[29377]: cephadm 2021-03-10T16:47:18.448019+0000 mgr.gibba045.orlgmj (mgr.34412) 9416 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:47:20.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:19 gibba015 bash[29377]: cluster 2021-03-10T16:47:18.750096+0000 mgr.gibba045.orlgmj (mgr.34412) 9417 : cluster [DBG] pgmap v5364: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:20.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:19 gibba015 bash[30343]: cephadm 2021-03-10T16:47:18.448019+0000 mgr.gibba045.orlgmj (mgr.34412) 9416 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:47:20.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:19 gibba015 bash[30343]: cluster 2021-03-10T16:47:18.750096+0000 mgr.gibba045.orlgmj (mgr.34412) 9417 : cluster [DBG] pgmap v5364: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:20.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:19 gibba045 bash[25517]: cephadm 2021-03-10T16:47:18.448019+0000 mgr.gibba045.orlgmj (mgr.34412) 9416 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:47:20.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:19 gibba045 bash[25517]: cluster 2021-03-10T16:47:18.750096+0000 mgr.gibba045.orlgmj (mgr.34412) 9417 : cluster [DBG] pgmap v5364: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:21.293 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:47:21.522 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:47:21.522 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 33s ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:47:21.523 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 9m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:47:21.523 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:47:21.523 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:47:21.524 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 33s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:47:21.524 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 33s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:47:21.524 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:47:21.525 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 33s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:47:21.525 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 33s ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:47:21.525 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 9m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:47:21.526 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 33s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:47:21.526 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 33s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:47:21.526 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 33s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:47:21.527 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 33s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:47:21.527 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:47:21.527 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:47:21.528 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:47:21.528 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:47:21.529 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 9m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:47:21.529 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 9m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:47:21.768 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:47:21.769 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:47:21.769 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:47:21.769 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:47:21.770 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:47:21.770 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:47:21.770 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:47:21.770 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:47:21.770 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:47:21.771 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:47:21.771 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:47:21.771 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:47:21.771 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:47:21.772 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:47:21.772 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:47:22.218 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:21 gibba015 bash[29377]: cluster 2021-03-10T16:47:20.751705+0000 mgr.gibba045.orlgmj (mgr.34412) 9418 : cluster [DBG] pgmap v5365: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:22.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:21 gibba015 bash[29377]: audit 2021-03-10T16:47:21.770337+0000 mon.c (mon.1) 2594 : audit [DBG] from='client.? 172.21.2.115:0/1869042598' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:47:22.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:21 gibba015 bash[30343]: cluster 2021-03-10T16:47:20.751705+0000 mgr.gibba045.orlgmj (mgr.34412) 9418 : cluster [DBG] pgmap v5365: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:22.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:21 gibba015 bash[30343]: audit 2021-03-10T16:47:21.770337+0000 mon.c (mon.1) 2594 : audit [DBG] from='client.? 172.21.2.115:0/1869042598' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:47:22.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:21 gibba045 bash[25517]: cluster 2021-03-10T16:47:20.751705+0000 mgr.gibba045.orlgmj (mgr.34412) 9418 : cluster [DBG] pgmap v5365: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:22.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:21 gibba045 bash[25517]: audit 2021-03-10T16:47:21.770337+0000 mon.c (mon.1) 2594 : audit [DBG] from='client.? 172.21.2.115:0/1869042598' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:47:23.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:22 gibba015 bash[29377]: audit 2021-03-10T16:47:21.288477+0000 mgr.gibba045.orlgmj (mgr.34412) 9419 : audit [DBG] from='client.50370 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:47:23.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:22 gibba015 bash[29377]: audit 2021-03-10T16:47:21.513619+0000 mgr.gibba045.orlgmj (mgr.34412) 9420 : audit [DBG] from='client.60364 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:47:23.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:22 gibba015 bash[30343]: audit 2021-03-10T16:47:21.288477+0000 mgr.gibba045.orlgmj (mgr.34412) 9419 : audit [DBG] from='client.50370 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:47:23.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:22 gibba015 bash[30343]: audit 2021-03-10T16:47:21.513619+0000 mgr.gibba045.orlgmj (mgr.34412) 9420 : audit [DBG] from='client.60364 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:47:23.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:22 gibba045 bash[25517]: audit 2021-03-10T16:47:21.288477+0000 mgr.gibba045.orlgmj (mgr.34412) 9419 : audit [DBG] from='client.50370 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:47:23.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:22 gibba045 bash[25517]: audit 2021-03-10T16:47:21.513619+0000 mgr.gibba045.orlgmj (mgr.34412) 9420 : audit [DBG] from='client.60364 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:47:24.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:23 gibba015 bash[29377]: cluster 2021-03-10T16:47:22.753305+0000 mgr.gibba045.orlgmj (mgr.34412) 9421 : cluster [DBG] pgmap v5366: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:24.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:23 gibba015 bash[30343]: cluster 2021-03-10T16:47:22.753305+0000 mgr.gibba045.orlgmj (mgr.34412) 9421 : cluster [DBG] pgmap v5366: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:24.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:23 gibba045 bash[25517]: cluster 2021-03-10T16:47:22.753305+0000 mgr.gibba045.orlgmj (mgr.34412) 9421 : cluster [DBG] pgmap v5366: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:26.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:25 gibba015 bash[29377]: cluster 2021-03-10T16:47:24.754907+0000 mgr.gibba045.orlgmj (mgr.34412) 9422 : cluster [DBG] pgmap v5367: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:26.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:25 gibba015 bash[30343]: cluster 2021-03-10T16:47:24.754907+0000 mgr.gibba045.orlgmj (mgr.34412) 9422 : cluster [DBG] pgmap v5367: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:26.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:25 gibba045 bash[25517]: cluster 2021-03-10T16:47:24.754907+0000 mgr.gibba045.orlgmj (mgr.34412) 9422 : cluster [DBG] pgmap v5367: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:27.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:27 gibba015 bash[29377]: cluster 2021-03-10T16:47:26.756051+0000 mgr.gibba045.orlgmj (mgr.34412) 9423 : cluster [DBG] pgmap v5368: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:27.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:27 gibba015 bash[30343]: cluster 2021-03-10T16:47:26.756051+0000 mgr.gibba045.orlgmj (mgr.34412) 9423 : cluster [DBG] pgmap v5368: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:28.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:27 gibba045 bash[25517]: cluster 2021-03-10T16:47:26.756051+0000 mgr.gibba045.orlgmj (mgr.34412) 9423 : cluster [DBG] pgmap v5368: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:30.218 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:29 gibba015 bash[29377]: cluster 2021-03-10T16:47:28.757243+0000 mgr.gibba045.orlgmj (mgr.34412) 9424 : cluster [DBG] pgmap v5369: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:30.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:29 gibba015 bash[30343]: cluster 2021-03-10T16:47:28.757243+0000 mgr.gibba045.orlgmj (mgr.34412) 9424 : cluster [DBG] pgmap v5369: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:30.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:29 gibba045 bash[25517]: cluster 2021-03-10T16:47:28.757243+0000 mgr.gibba045.orlgmj (mgr.34412) 9424 : cluster [DBG] pgmap v5369: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:32.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:31 gibba015 bash[29377]: cluster 2021-03-10T16:47:30.759010+0000 mgr.gibba045.orlgmj (mgr.34412) 9425 : cluster [DBG] pgmap v5370: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:32.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:31 gibba015 bash[30343]: cluster 2021-03-10T16:47:30.759010+0000 mgr.gibba045.orlgmj (mgr.34412) 9425 : cluster [DBG] pgmap v5370: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:32.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:31 gibba045 bash[25517]: cluster 2021-03-10T16:47:30.759010+0000 mgr.gibba045.orlgmj (mgr.34412) 9425 : cluster [DBG] pgmap v5370: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:34.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:33 gibba015 bash[29377]: cluster 2021-03-10T16:47:32.760590+0000 mgr.gibba045.orlgmj (mgr.34412) 9426 : cluster [DBG] pgmap v5371: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:34.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:33 gibba015 bash[30343]: cluster 2021-03-10T16:47:32.760590+0000 mgr.gibba045.orlgmj (mgr.34412) 9426 : cluster [DBG] pgmap v5371: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:34.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:33 gibba045 bash[25517]: cluster 2021-03-10T16:47:32.760590+0000 mgr.gibba045.orlgmj (mgr.34412) 9426 : cluster [DBG] pgmap v5371: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:35.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:34 gibba015 bash[29377]: cephadm 2021-03-10T16:47:33.463933+0000 mgr.gibba045.orlgmj (mgr.34412) 9427 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:47:35.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:34 gibba015 bash[30343]: cephadm 2021-03-10T16:47:33.463933+0000 mgr.gibba045.orlgmj (mgr.34412) 9427 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:47:35.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:34 gibba045 bash[25517]: cephadm 2021-03-10T16:47:33.463933+0000 mgr.gibba045.orlgmj (mgr.34412) 9427 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:47:36.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:35 gibba015 bash[29377]: cluster 2021-03-10T16:47:34.762252+0000 mgr.gibba045.orlgmj (mgr.34412) 9428 : cluster [DBG] pgmap v5372: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:36.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:35 gibba015 bash[30343]: cluster 2021-03-10T16:47:34.762252+0000 mgr.gibba045.orlgmj (mgr.34412) 9428 : cluster [DBG] pgmap v5372: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:36.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:35 gibba045 bash[25517]: cluster 2021-03-10T16:47:34.762252+0000 mgr.gibba045.orlgmj (mgr.34412) 9428 : cluster [DBG] pgmap v5372: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:37.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:37 gibba015 bash[29377]: cluster 2021-03-10T16:47:36.764136+0000 mgr.gibba045.orlgmj (mgr.34412) 9429 : cluster [DBG] pgmap v5373: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:37.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:37 gibba015 bash[30343]: cluster 2021-03-10T16:47:36.764136+0000 mgr.gibba045.orlgmj (mgr.34412) 9429 : cluster [DBG] pgmap v5373: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:38.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:37 gibba045 bash[25517]: cluster 2021-03-10T16:47:36.764136+0000 mgr.gibba045.orlgmj (mgr.34412) 9429 : cluster [DBG] pgmap v5373: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:40.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:39 gibba015 bash[29377]: cluster 2021-03-10T16:47:38.765458+0000 mgr.gibba045.orlgmj (mgr.34412) 9430 : cluster [DBG] pgmap v5374: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:40.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:39 gibba015 bash[30343]: cluster 2021-03-10T16:47:38.765458+0000 mgr.gibba045.orlgmj (mgr.34412) 9430 : cluster [DBG] pgmap v5374: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:40.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:39 gibba045 bash[25517]: cluster 2021-03-10T16:47:38.765458+0000 mgr.gibba045.orlgmj (mgr.34412) 9430 : cluster [DBG] pgmap v5374: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:42.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:41 gibba015 bash[29377]: cluster 2021-03-10T16:47:40.766998+0000 mgr.gibba045.orlgmj (mgr.34412) 9431 : cluster [DBG] pgmap v5375: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:42.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:41 gibba015 bash[30343]: cluster 2021-03-10T16:47:40.766998+0000 mgr.gibba045.orlgmj (mgr.34412) 9431 : cluster [DBG] pgmap v5375: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:42.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:41 gibba045 bash[25517]: cluster 2021-03-10T16:47:40.766998+0000 mgr.gibba045.orlgmj (mgr.34412) 9431 : cluster [DBG] pgmap v5375: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:44.218 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:43 gibba015 bash[29377]: cluster 2021-03-10T16:47:42.768289+0000 mgr.gibba045.orlgmj (mgr.34412) 9432 : cluster [DBG] pgmap v5376: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:44.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:43 gibba015 bash[30343]: cluster 2021-03-10T16:47:42.768289+0000 mgr.gibba045.orlgmj (mgr.34412) 9432 : cluster [DBG] pgmap v5376: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:44.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:43 gibba045 bash[25517]: cluster 2021-03-10T16:47:42.768289+0000 mgr.gibba045.orlgmj (mgr.34412) 9432 : cluster [DBG] pgmap v5376: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:46.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:45 gibba015 bash[29377]: cluster 2021-03-10T16:47:44.769902+0000 mgr.gibba045.orlgmj (mgr.34412) 9433 : cluster [DBG] pgmap v5377: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:46.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:45 gibba015 bash[30343]: cluster 2021-03-10T16:47:44.769902+0000 mgr.gibba045.orlgmj (mgr.34412) 9433 : cluster [DBG] pgmap v5377: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:46.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:45 gibba045 bash[25517]: cluster 2021-03-10T16:47:44.769902+0000 mgr.gibba045.orlgmj (mgr.34412) 9433 : cluster [DBG] pgmap v5377: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:47.968 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:47 gibba015 bash[29377]: cluster 2021-03-10T16:47:46.771476+0000 mgr.gibba045.orlgmj (mgr.34412) 9434 : cluster [DBG] pgmap v5378: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:47.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:47 gibba015 bash[30343]: cluster 2021-03-10T16:47:46.771476+0000 mgr.gibba045.orlgmj (mgr.34412) 9434 : cluster [DBG] pgmap v5378: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:48.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:47 gibba045 bash[25517]: cluster 2021-03-10T16:47:46.771476+0000 mgr.gibba045.orlgmj (mgr.34412) 9434 : cluster [DBG] pgmap v5378: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:48.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:48 gibba015 bash[29377]: audit 2021-03-10T16:47:48.478719+0000 mon.c (mon.1) 2595 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:47:48.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:48 gibba015 bash[29377]: audit 2021-03-10T16:47:48.486384+0000 mon.c (mon.1) 2596 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:47:48.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:48 gibba015 bash[30343]: audit 2021-03-10T16:47:48.478719+0000 mon.c (mon.1) 2595 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:47:48.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:48 gibba015 bash[30343]: audit 2021-03-10T16:47:48.486384+0000 mon.c (mon.1) 2596 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:47:49.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:48 gibba045 bash[25517]: audit 2021-03-10T16:47:48.478719+0000 mon.c (mon.1) 2595 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:47:49.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:48 gibba045 bash[25517]: audit 2021-03-10T16:47:48.486384+0000 mon.c (mon.1) 2596 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:47:49.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:49 gibba015 bash[29377]: cephadm 2021-03-10T16:47:48.486857+0000 mgr.gibba045.orlgmj (mgr.34412) 9435 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:47:49.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:49 gibba015 bash[29377]: cluster 2021-03-10T16:47:48.772851+0000 mgr.gibba045.orlgmj (mgr.34412) 9436 : cluster [DBG] pgmap v5379: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:49.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:49 gibba015 bash[30343]: cephadm 2021-03-10T16:47:48.486857+0000 mgr.gibba045.orlgmj (mgr.34412) 9435 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:47:49.970 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:49 gibba015 bash[30343]: cluster 2021-03-10T16:47:48.772851+0000 mgr.gibba045.orlgmj (mgr.34412) 9436 : cluster [DBG] pgmap v5379: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:50.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:49 gibba045 bash[25517]: cephadm 2021-03-10T16:47:48.486857+0000 mgr.gibba045.orlgmj (mgr.34412) 9435 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:47:50.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:49 gibba045 bash[25517]: cluster 2021-03-10T16:47:48.772851+0000 mgr.gibba045.orlgmj (mgr.34412) 9436 : cluster [DBG] pgmap v5379: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:52.013 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:47:52.218 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:51 gibba015 bash[30343]: cluster 2021-03-10T16:47:50.774440+0000 mgr.gibba045.orlgmj (mgr.34412) 9437 : cluster [DBG] pgmap v5380: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:52.218 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:51 gibba015 bash[29377]: cluster 2021-03-10T16:47:50.774440+0000 mgr.gibba045.orlgmj (mgr.34412) 9437 : cluster [DBG] pgmap v5380: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:52.238 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:47:52.239 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 64s ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:47:52.239 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 0s ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:47:52.239 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 0s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:47:52.239 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 0s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:47:52.240 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 64s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:47:52.240 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 64s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:47:52.240 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 0s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:47:52.240 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 64s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:47:52.241 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 64s ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:47:52.241 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 0s ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:47:52.241 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 64s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:47:52.241 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 64s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:47:52.242 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 64s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:47:52.242 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 64s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:47:52.243 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 0s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:47:52.243 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 0s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:47:52.243 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 0s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:47:52.243 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 0s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:47:52.244 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 0s ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:47:52.244 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 0s ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:47:52.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:51 gibba045 bash[25517]: cluster 2021-03-10T16:47:50.774440+0000 mgr.gibba045.orlgmj (mgr.34412) 9437 : cluster [DBG] pgmap v5380: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:52.491 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:47:52.491 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:47:52.491 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:47:52.492 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:47:52.492 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:47:52.492 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:47:52.492 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:47:52.493 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:47:52.493 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:47:52.493 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:47:52.493 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:47:52.493 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:47:52.494 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:47:52.494 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:47:52.494 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:47:53.513 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:53 gibba045 bash[25517]: audit 2021-03-10T16:47:52.008050+0000 mgr.gibba045.orlgmj (mgr.34412) 9438 : audit [DBG] from='client.50388 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:47:53.513 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:53 gibba045 bash[25517]: audit 2021-03-10T16:47:52.228749+0000 mon.a (mon.0) 2069 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:47:53.513 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:53 gibba045 bash[25517]: audit 2021-03-10T16:47:52.232021+0000 mgr.gibba045.orlgmj (mgr.34412) 9439 : audit [DBG] from='client.60382 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:47:53.514 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:53 gibba045 bash[25517]: audit 2021-03-10T16:47:52.238260+0000 mon.c (mon.1) 2597 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T16:47:53.514 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:53 gibba045 bash[25517]: audit 2021-03-10T16:47:52.492674+0000 mon.a (mon.0) 2070 : audit [DBG] from='client.? 172.21.2.115:0/6574590' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:47:53.514 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:53 gibba045 bash[25517]: cluster 2021-03-10T16:47:52.775960+0000 mgr.gibba045.orlgmj (mgr.34412) 9440 : cluster [DBG] pgmap v5381: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:53.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:53 gibba015 bash[29377]: audit 2021-03-10T16:47:52.008050+0000 mgr.gibba045.orlgmj (mgr.34412) 9438 : audit [DBG] from='client.50388 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:47:53.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:53 gibba015 bash[29377]: audit 2021-03-10T16:47:52.228749+0000 mon.a (mon.0) 2069 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:47:53.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:53 gibba015 bash[29377]: audit 2021-03-10T16:47:52.232021+0000 mgr.gibba045.orlgmj (mgr.34412) 9439 : audit [DBG] from='client.60382 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:47:53.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:53 gibba015 bash[29377]: audit 2021-03-10T16:47:52.238260+0000 mon.c (mon.1) 2597 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T16:47:53.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:53 gibba015 bash[29377]: audit 2021-03-10T16:47:52.492674+0000 mon.a (mon.0) 2070 : audit [DBG] from='client.? 172.21.2.115:0/6574590' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:47:53.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:53 gibba015 bash[29377]: cluster 2021-03-10T16:47:52.775960+0000 mgr.gibba045.orlgmj (mgr.34412) 9440 : cluster [DBG] pgmap v5381: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:53.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:53 gibba015 bash[30343]: audit 2021-03-10T16:47:52.008050+0000 mgr.gibba045.orlgmj (mgr.34412) 9438 : audit [DBG] from='client.50388 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:47:53.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:53 gibba015 bash[30343]: audit 2021-03-10T16:47:52.228749+0000 mon.a (mon.0) 2069 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:47:53.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:53 gibba015 bash[30343]: audit 2021-03-10T16:47:52.232021+0000 mgr.gibba045.orlgmj (mgr.34412) 9439 : audit [DBG] from='client.60382 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:47:53.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:53 gibba015 bash[30343]: audit 2021-03-10T16:47:52.238260+0000 mon.c (mon.1) 2597 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T16:47:53.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:53 gibba015 bash[30343]: audit 2021-03-10T16:47:52.492674+0000 mon.a (mon.0) 2070 : audit [DBG] from='client.? 172.21.2.115:0/6574590' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:47:53.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:53 gibba015 bash[30343]: cluster 2021-03-10T16:47:52.775960+0000 mgr.gibba045.orlgmj (mgr.34412) 9440 : cluster [DBG] pgmap v5381: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:54.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:54 gibba045 bash[25517]: audit 2021-03-10T16:47:53.740854+0000 mon.c (mon.1) 2598 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:47:54.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:54 gibba045 bash[25517]: audit 2021-03-10T16:47:53.741548+0000 mon.c (mon.1) 2599 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:47:54.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:54 gibba045 bash[25517]: audit 2021-03-10T16:47:53.742093+0000 mon.a (mon.0) 2071 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:47:54.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:54 gibba045 bash[25517]: audit 2021-03-10T16:47:53.743789+0000 mon.a (mon.0) 2072 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:47:54.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:54 gibba045 bash[25517]: audit 2021-03-10T16:47:53.757428+0000 mon.c (mon.1) 2600 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:47:54.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:54 gibba045 bash[25517]: audit 2021-03-10T16:47:53.758172+0000 mon.c (mon.1) 2601 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:47:54.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:54 gibba045 bash[25517]: audit 2021-03-10T16:47:53.758793+0000 mon.a (mon.0) 2073 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:47:54.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:54 gibba045 bash[25517]: audit 2021-03-10T16:47:53.758888+0000 mon.c (mon.1) 2602 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:47:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:54 gibba045 bash[25517]: audit 2021-03-10T16:47:53.759594+0000 mon.c (mon.1) 2603 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:47:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:54 gibba045 bash[25517]: audit 2021-03-10T16:47:53.761326+0000 mon.a (mon.0) 2074 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:47:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:54 gibba045 bash[25517]: audit 2021-03-10T16:47:53.762624+0000 mon.a (mon.0) 2075 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:47:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:54 gibba045 bash[25517]: audit 2021-03-10T16:47:53.763889+0000 mon.a (mon.0) 2076 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:47:54.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:54 gibba015 bash[29377]: audit 2021-03-10T16:47:53.740854+0000 mon.c (mon.1) 2598 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:47:54.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:54 gibba015 bash[29377]: audit 2021-03-10T16:47:53.741548+0000 mon.c (mon.1) 2599 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:47:54.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:54 gibba015 bash[29377]: audit 2021-03-10T16:47:53.742093+0000 mon.a (mon.0) 2071 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:47:54.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:54 gibba015 bash[29377]: audit 2021-03-10T16:47:53.743789+0000 mon.a (mon.0) 2072 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:47:54.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:54 gibba015 bash[29377]: audit 2021-03-10T16:47:53.757428+0000 mon.c (mon.1) 2600 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:47:54.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:54 gibba015 bash[29377]: audit 2021-03-10T16:47:53.758172+0000 mon.c (mon.1) 2601 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:47:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:54 gibba015 bash[29377]: audit 2021-03-10T16:47:53.758793+0000 mon.a (mon.0) 2073 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:47:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:54 gibba015 bash[29377]: audit 2021-03-10T16:47:53.758888+0000 mon.c (mon.1) 2602 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:47:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:54 gibba015 bash[29377]: audit 2021-03-10T16:47:53.759594+0000 mon.c (mon.1) 2603 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:47:54.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:54 gibba015 bash[29377]: audit 2021-03-10T16:47:53.761326+0000 mon.a (mon.0) 2074 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:47:54.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:54 gibba015 bash[29377]: audit 2021-03-10T16:47:53.762624+0000 mon.a (mon.0) 2075 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:47:54.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:54 gibba015 bash[29377]: audit 2021-03-10T16:47:53.763889+0000 mon.a (mon.0) 2076 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:47:54.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:54 gibba015 bash[30343]: audit 2021-03-10T16:47:53.740854+0000 mon.c (mon.1) 2598 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:47:54.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:54 gibba015 bash[30343]: audit 2021-03-10T16:47:53.741548+0000 mon.c (mon.1) 2599 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:47:54.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:54 gibba015 bash[30343]: audit 2021-03-10T16:47:53.742093+0000 mon.a (mon.0) 2071 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:47:54.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:54 gibba015 bash[30343]: audit 2021-03-10T16:47:53.743789+0000 mon.a (mon.0) 2072 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:47:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:54 gibba015 bash[30343]: audit 2021-03-10T16:47:53.757428+0000 mon.c (mon.1) 2600 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:47:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:54 gibba015 bash[30343]: audit 2021-03-10T16:47:53.758172+0000 mon.c (mon.1) 2601 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:47:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:54 gibba015 bash[30343]: audit 2021-03-10T16:47:53.758793+0000 mon.a (mon.0) 2073 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:47:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:54 gibba015 bash[30343]: audit 2021-03-10T16:47:53.758888+0000 mon.c (mon.1) 2602 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:47:54.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:54 gibba015 bash[30343]: audit 2021-03-10T16:47:53.759594+0000 mon.c (mon.1) 2603 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:47:54.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:54 gibba015 bash[30343]: audit 2021-03-10T16:47:53.761326+0000 mon.a (mon.0) 2074 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:47:54.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:54 gibba015 bash[30343]: audit 2021-03-10T16:47:53.762624+0000 mon.a (mon.0) 2075 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:47:54.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:54 gibba015 bash[30343]: audit 2021-03-10T16:47:53.763889+0000 mon.a (mon.0) 2076 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:47:55.552 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:55 gibba045 bash[25517]: cluster 2021-03-10T16:47:54.777765+0000 mgr.gibba045.orlgmj (mgr.34412) 9441 : cluster [DBG] pgmap v5382: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:55.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:55 gibba015 bash[29377]: cluster 2021-03-10T16:47:54.777765+0000 mgr.gibba045.orlgmj (mgr.34412) 9441 : cluster [DBG] pgmap v5382: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:55.719 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:55 gibba015 bash[30343]: cluster 2021-03-10T16:47:54.777765+0000 mgr.gibba045.orlgmj (mgr.34412) 9441 : cluster [DBG] pgmap v5382: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:57.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:57 gibba045 bash[25517]: cluster 2021-03-10T16:47:56.779344+0000 mgr.gibba045.orlgmj (mgr.34412) 9442 : cluster [DBG] pgmap v5383: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:57.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:57 gibba045 bash[25517]: audit 2021-03-10T16:47:57.042165+0000 mon.c (mon.1) 2604 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:47:57.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:57 gibba045 bash[25517]: audit 2021-03-10T16:47:57.216387+0000 mon.a (mon.0) 2077 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:47:57.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:57 gibba045 bash[25517]: audit 2021-03-10T16:47:57.458062+0000 mon.a (mon.0) 2078 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:47:57.803 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:57 gibba045 bash[25517]: audit 2021-03-10T16:47:57.461990+0000 mon.c (mon.1) 2605 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:47:57.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:57 gibba045 bash[25517]: audit 2021-03-10T16:47:57.463932+0000 mon.c (mon.1) 2606 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:47:57.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:57 gibba045 bash[25517]: audit 2021-03-10T16:47:57.465358+0000 mon.c (mon.1) 2607 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:47:57.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:57 gibba045 bash[25517]: audit 2021-03-10T16:47:57.466655+0000 mon.c (mon.1) 2608 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:47:57.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:57 gibba045 bash[25517]: audit 2021-03-10T16:47:57.469729+0000 mon.c (mon.1) 2609 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:47:57.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:57 gibba045 bash[25517]: audit 2021-03-10T16:47:57.471121+0000 mon.c (mon.1) 2610 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:47:57.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:57 gibba015 bash[29377]: cluster 2021-03-10T16:47:56.779344+0000 mgr.gibba045.orlgmj (mgr.34412) 9442 : cluster [DBG] pgmap v5383: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:57.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:57 gibba015 bash[29377]: audit 2021-03-10T16:47:57.042165+0000 mon.c (mon.1) 2604 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:47:57.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:57 gibba015 bash[29377]: audit 2021-03-10T16:47:57.216387+0000 mon.a (mon.0) 2077 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:47:57.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:57 gibba015 bash[29377]: audit 2021-03-10T16:47:57.458062+0000 mon.a (mon.0) 2078 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:47:57.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:57 gibba015 bash[29377]: audit 2021-03-10T16:47:57.461990+0000 mon.c (mon.1) 2605 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:47:57.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:57 gibba015 bash[29377]: audit 2021-03-10T16:47:57.463932+0000 mon.c (mon.1) 2606 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:47:57.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:57 gibba015 bash[29377]: audit 2021-03-10T16:47:57.465358+0000 mon.c (mon.1) 2607 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:47:57.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:57 gibba015 bash[29377]: audit 2021-03-10T16:47:57.466655+0000 mon.c (mon.1) 2608 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:47:57.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:57 gibba015 bash[29377]: audit 2021-03-10T16:47:57.469729+0000 mon.c (mon.1) 2609 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:47:57.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:57 gibba015 bash[29377]: audit 2021-03-10T16:47:57.471121+0000 mon.c (mon.1) 2610 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:47:57.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:57 gibba015 bash[30343]: cluster 2021-03-10T16:47:56.779344+0000 mgr.gibba045.orlgmj (mgr.34412) 9442 : cluster [DBG] pgmap v5383: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:57.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:57 gibba015 bash[30343]: audit 2021-03-10T16:47:57.042165+0000 mon.c (mon.1) 2604 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:47:57.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:57 gibba015 bash[30343]: audit 2021-03-10T16:47:57.216387+0000 mon.a (mon.0) 2077 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:47:57.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:57 gibba015 bash[30343]: audit 2021-03-10T16:47:57.458062+0000 mon.a (mon.0) 2078 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:47:57.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:57 gibba015 bash[30343]: audit 2021-03-10T16:47:57.461990+0000 mon.c (mon.1) 2605 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:47:57.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:57 gibba015 bash[30343]: audit 2021-03-10T16:47:57.463932+0000 mon.c (mon.1) 2606 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:47:57.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:57 gibba015 bash[30343]: audit 2021-03-10T16:47:57.465358+0000 mon.c (mon.1) 2607 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:47:57.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:57 gibba015 bash[30343]: audit 2021-03-10T16:47:57.466655+0000 mon.c (mon.1) 2608 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:47:57.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:57 gibba015 bash[30343]: audit 2021-03-10T16:47:57.469729+0000 mon.c (mon.1) 2609 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:47:57.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:57 gibba015 bash[30343]: audit 2021-03-10T16:47:57.471121+0000 mon.c (mon.1) 2610 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:47:58.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:58 gibba015 bash[29377]: cephadm 2021-03-10T16:47:57.220285+0000 mgr.gibba045.orlgmj (mgr.34412) 9443 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:47:58.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:58 gibba015 bash[29377]: cephadm 2021-03-10T16:47:57.463330+0000 mgr.gibba045.orlgmj (mgr.34412) 9444 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:47:58.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:58 gibba015 bash[29377]: cephadm 2021-03-10T16:47:57.465622+0000 mgr.gibba045.orlgmj (mgr.34412) 9445 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:47:58.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:58 gibba015 bash[29377]: cephadm 2021-03-10T16:47:57.467098+0000 mgr.gibba045.orlgmj (mgr.34412) 9446 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:47:58.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:58 gibba015 bash[29377]: cephadm 2021-03-10T16:47:57.467157+0000 mgr.gibba045.orlgmj (mgr.34412) 9447 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:47:58.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:58 gibba015 bash[29377]: cephadm 2021-03-10T16:47:57.468468+0000 mgr.gibba045.orlgmj (mgr.34412) 9448 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:47:58.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:58 gibba015 bash[29377]: cephadm 2021-03-10T16:47:57.468556+0000 mgr.gibba045.orlgmj (mgr.34412) 9449 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:47:58.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:58 gibba015 bash[29377]: cephadm 2021-03-10T16:47:57.469828+0000 mgr.gibba045.orlgmj (mgr.34412) 9450 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:47:58.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:58 gibba015 bash[29377]: cephadm 2021-03-10T16:47:57.471457+0000 mgr.gibba045.orlgmj (mgr.34412) 9451 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:47:58.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:58 gibba015 bash[29377]: cephadm 2021-03-10T16:47:57.471516+0000 mgr.gibba045.orlgmj (mgr.34412) 9452 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:47:58.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:58 gibba015 bash[29377]: cephadm 2021-03-10T16:47:57.472837+0000 mgr.gibba045.orlgmj (mgr.34412) 9453 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:47:58.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:58 gibba015 bash[29377]: cephadm 2021-03-10T16:47:57.473164+0000 mgr.gibba045.orlgmj (mgr.34412) 9454 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:47:58.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:58 gibba015 bash[29377]: cephadm 2021-03-10T16:47:57.474196+0000 mgr.gibba045.orlgmj (mgr.34412) 9455 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:47:58.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:58 gibba015 bash[29377]: cephadm 2021-03-10T16:47:57.474256+0000 mgr.gibba045.orlgmj (mgr.34412) 9456 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:47:58.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:58 gibba015 bash[29377]: cephadm 2021-03-10T16:47:57.474381+0000 mgr.gibba045.orlgmj (mgr.34412) 9457 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:47:58.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:58 gibba015 bash[30343]: cephadm 2021-03-10T16:47:57.220285+0000 mgr.gibba045.orlgmj (mgr.34412) 9443 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:47:58.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:58 gibba015 bash[30343]: cephadm 2021-03-10T16:47:57.463330+0000 mgr.gibba045.orlgmj (mgr.34412) 9444 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:47:58.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:58 gibba015 bash[30343]: cephadm 2021-03-10T16:47:57.465622+0000 mgr.gibba045.orlgmj (mgr.34412) 9445 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:47:58.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:58 gibba015 bash[30343]: cephadm 2021-03-10T16:47:57.467098+0000 mgr.gibba045.orlgmj (mgr.34412) 9446 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:47:58.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:58 gibba015 bash[30343]: cephadm 2021-03-10T16:47:57.467157+0000 mgr.gibba045.orlgmj (mgr.34412) 9447 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:47:58.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:58 gibba015 bash[30343]: cephadm 2021-03-10T16:47:57.468468+0000 mgr.gibba045.orlgmj (mgr.34412) 9448 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:47:58.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:58 gibba015 bash[30343]: cephadm 2021-03-10T16:47:57.468556+0000 mgr.gibba045.orlgmj (mgr.34412) 9449 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:47:58.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:58 gibba015 bash[30343]: cephadm 2021-03-10T16:47:57.469828+0000 mgr.gibba045.orlgmj (mgr.34412) 9450 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:47:58.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:58 gibba015 bash[30343]: cephadm 2021-03-10T16:47:57.471457+0000 mgr.gibba045.orlgmj (mgr.34412) 9451 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:47:58.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:58 gibba015 bash[30343]: cephadm 2021-03-10T16:47:57.471516+0000 mgr.gibba045.orlgmj (mgr.34412) 9452 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:47:58.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:58 gibba015 bash[30343]: cephadm 2021-03-10T16:47:57.472837+0000 mgr.gibba045.orlgmj (mgr.34412) 9453 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:47:58.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:58 gibba015 bash[30343]: cephadm 2021-03-10T16:47:57.473164+0000 mgr.gibba045.orlgmj (mgr.34412) 9454 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:47:58.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:58 gibba015 bash[30343]: cephadm 2021-03-10T16:47:57.474196+0000 mgr.gibba045.orlgmj (mgr.34412) 9455 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:47:58.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:58 gibba015 bash[30343]: cephadm 2021-03-10T16:47:57.474256+0000 mgr.gibba045.orlgmj (mgr.34412) 9456 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:47:58.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:58 gibba015 bash[30343]: cephadm 2021-03-10T16:47:57.474381+0000 mgr.gibba045.orlgmj (mgr.34412) 9457 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:47:59.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:58 gibba045 bash[25517]: cephadm 2021-03-10T16:47:57.220285+0000 mgr.gibba045.orlgmj (mgr.34412) 9443 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:47:59.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:58 gibba045 bash[25517]: cephadm 2021-03-10T16:47:57.463330+0000 mgr.gibba045.orlgmj (mgr.34412) 9444 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:47:59.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:58 gibba045 bash[25517]: cephadm 2021-03-10T16:47:57.465622+0000 mgr.gibba045.orlgmj (mgr.34412) 9445 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:47:59.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:58 gibba045 bash[25517]: cephadm 2021-03-10T16:47:57.467098+0000 mgr.gibba045.orlgmj (mgr.34412) 9446 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:47:59.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:58 gibba045 bash[25517]: cephadm 2021-03-10T16:47:57.467157+0000 mgr.gibba045.orlgmj (mgr.34412) 9447 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:47:59.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:58 gibba045 bash[25517]: cephadm 2021-03-10T16:47:57.468468+0000 mgr.gibba045.orlgmj (mgr.34412) 9448 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:47:59.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:58 gibba045 bash[25517]: cephadm 2021-03-10T16:47:57.468556+0000 mgr.gibba045.orlgmj (mgr.34412) 9449 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:47:59.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:58 gibba045 bash[25517]: cephadm 2021-03-10T16:47:57.469828+0000 mgr.gibba045.orlgmj (mgr.34412) 9450 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:47:59.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:58 gibba045 bash[25517]: cephadm 2021-03-10T16:47:57.471457+0000 mgr.gibba045.orlgmj (mgr.34412) 9451 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:47:59.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:58 gibba045 bash[25517]: cephadm 2021-03-10T16:47:57.471516+0000 mgr.gibba045.orlgmj (mgr.34412) 9452 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:47:59.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:58 gibba045 bash[25517]: cephadm 2021-03-10T16:47:57.472837+0000 mgr.gibba045.orlgmj (mgr.34412) 9453 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:47:59.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:58 gibba045 bash[25517]: cephadm 2021-03-10T16:47:57.473164+0000 mgr.gibba045.orlgmj (mgr.34412) 9454 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:47:59.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:58 gibba045 bash[25517]: cephadm 2021-03-10T16:47:57.474196+0000 mgr.gibba045.orlgmj (mgr.34412) 9455 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:47:59.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:58 gibba045 bash[25517]: cephadm 2021-03-10T16:47:57.474256+0000 mgr.gibba045.orlgmj (mgr.34412) 9456 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:47:59.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:58 gibba045 bash[25517]: cephadm 2021-03-10T16:47:57.474381+0000 mgr.gibba045.orlgmj (mgr.34412) 9457 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:47:59.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:47:59 gibba015 bash[29377]: cluster 2021-03-10T16:47:58.780720+0000 mgr.gibba045.orlgmj (mgr.34412) 9458 : cluster [DBG] pgmap v5384: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:59.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:47:59 gibba015 bash[30343]: cluster 2021-03-10T16:47:58.780720+0000 mgr.gibba045.orlgmj (mgr.34412) 9458 : cluster [DBG] pgmap v5384: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:00.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:47:59 gibba045 bash[25517]: cluster 2021-03-10T16:47:58.780720+0000 mgr.gibba045.orlgmj (mgr.34412) 9458 : cluster [DBG] pgmap v5384: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:02.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:48:01 gibba015 bash[29377]: cluster 2021-03-10T16:48:00.782585+0000 mgr.gibba045.orlgmj (mgr.34412) 9459 : cluster [DBG] pgmap v5385: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:02.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:48:01 gibba015 bash[30343]: cluster 2021-03-10T16:48:00.782585+0000 mgr.gibba045.orlgmj (mgr.34412) 9459 : cluster [DBG] pgmap v5385: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:02.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:48:01 gibba045 bash[25517]: cluster 2021-03-10T16:48:00.782585+0000 mgr.gibba045.orlgmj (mgr.34412) 9459 : cluster [DBG] pgmap v5385: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:04.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:48:03 gibba015 bash[29377]: cluster 2021-03-10T16:48:02.784123+0000 mgr.gibba045.orlgmj (mgr.34412) 9460 : cluster [DBG] pgmap v5386: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:04.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:48:03 gibba015 bash[30343]: cluster 2021-03-10T16:48:02.784123+0000 mgr.gibba045.orlgmj (mgr.34412) 9460 : cluster [DBG] pgmap v5386: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:04.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:48:03 gibba045 bash[25517]: cluster 2021-03-10T16:48:02.784123+0000 mgr.gibba045.orlgmj (mgr.34412) 9460 : cluster [DBG] pgmap v5386: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:06.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:48:05 gibba015 bash[29377]: cluster 2021-03-10T16:48:04.785887+0000 mgr.gibba045.orlgmj (mgr.34412) 9461 : cluster [DBG] pgmap v5387: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:06.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:48:05 gibba015 bash[30343]: cluster 2021-03-10T16:48:04.785887+0000 mgr.gibba045.orlgmj (mgr.34412) 9461 : cluster [DBG] pgmap v5387: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:06.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:48:05 gibba045 bash[25517]: cluster 2021-03-10T16:48:04.785887+0000 mgr.gibba045.orlgmj (mgr.34412) 9461 : cluster [DBG] pgmap v5387: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:07.968 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:48:07 gibba015 bash[29377]: cluster 2021-03-10T16:48:06.787432+0000 mgr.gibba045.orlgmj (mgr.34412) 9462 : cluster [DBG] pgmap v5388: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:07.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:48:07 gibba015 bash[30343]: cluster 2021-03-10T16:48:06.787432+0000 mgr.gibba045.orlgmj (mgr.34412) 9462 : cluster [DBG] pgmap v5388: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:08.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:48:07 gibba045 bash[25517]: cluster 2021-03-10T16:48:06.787432+0000 mgr.gibba045.orlgmj (mgr.34412) 9462 : cluster [DBG] pgmap v5388: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:10.218 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:48:09 gibba015 bash[29377]: cluster 2021-03-10T16:48:08.788802+0000 mgr.gibba045.orlgmj (mgr.34412) 9463 : cluster [DBG] pgmap v5389: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:10.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:48:09 gibba015 bash[30343]: cluster 2021-03-10T16:48:08.788802+0000 mgr.gibba045.orlgmj (mgr.34412) 9463 : cluster [DBG] pgmap v5389: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:10.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:48:09 gibba045 bash[25517]: cluster 2021-03-10T16:48:08.788802+0000 mgr.gibba045.orlgmj (mgr.34412) 9463 : cluster [DBG] pgmap v5389: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:12.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:48:11 gibba015 bash[29377]: cluster 2021-03-10T16:48:10.790693+0000 mgr.gibba045.orlgmj (mgr.34412) 9464 : cluster [DBG] pgmap v5390: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:12.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:48:11 gibba015 bash[30343]: cluster 2021-03-10T16:48:10.790693+0000 mgr.gibba045.orlgmj (mgr.34412) 9464 : cluster [DBG] pgmap v5390: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:12.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:48:11 gibba045 bash[25517]: cluster 2021-03-10T16:48:10.790693+0000 mgr.gibba045.orlgmj (mgr.34412) 9464 : cluster [DBG] pgmap v5390: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:14.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:48:13 gibba015 bash[29377]: cephadm 2021-03-10T16:48:12.490270+0000 mgr.gibba045.orlgmj (mgr.34412) 9465 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:48:14.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:48:13 gibba015 bash[29377]: cluster 2021-03-10T16:48:12.792212+0000 mgr.gibba045.orlgmj (mgr.34412) 9466 : cluster [DBG] pgmap v5391: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:14.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:48:13 gibba015 bash[30343]: cephadm 2021-03-10T16:48:12.490270+0000 mgr.gibba045.orlgmj (mgr.34412) 9465 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:48:14.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:48:13 gibba015 bash[30343]: cluster 2021-03-10T16:48:12.792212+0000 mgr.gibba045.orlgmj (mgr.34412) 9466 : cluster [DBG] pgmap v5391: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:14.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:48:13 gibba045 bash[25517]: cephadm 2021-03-10T16:48:12.490270+0000 mgr.gibba045.orlgmj (mgr.34412) 9465 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:48:14.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:48:13 gibba045 bash[25517]: cluster 2021-03-10T16:48:12.792212+0000 mgr.gibba045.orlgmj (mgr.34412) 9466 : cluster [DBG] pgmap v5391: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:16.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:48:15 gibba015 bash[29377]: cluster 2021-03-10T16:48:14.793886+0000 mgr.gibba045.orlgmj (mgr.34412) 9467 : cluster [DBG] pgmap v5392: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:16.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:48:15 gibba015 bash[30343]: cluster 2021-03-10T16:48:14.793886+0000 mgr.gibba045.orlgmj (mgr.34412) 9467 : cluster [DBG] pgmap v5392: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:16.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:48:15 gibba045 bash[25517]: cluster 2021-03-10T16:48:14.793886+0000 mgr.gibba045.orlgmj (mgr.34412) 9467 : cluster [DBG] pgmap v5392: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:17.968 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:48:17 gibba015 bash[29377]: cluster 2021-03-10T16:48:16.795453+0000 mgr.gibba045.orlgmj (mgr.34412) 9468 : cluster [DBG] pgmap v5393: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:17.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:48:17 gibba015 bash[30343]: cluster 2021-03-10T16:48:16.795453+0000 mgr.gibba045.orlgmj (mgr.34412) 9468 : cluster [DBG] pgmap v5393: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:18.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:48:17 gibba045 bash[25517]: cluster 2021-03-10T16:48:16.795453+0000 mgr.gibba045.orlgmj (mgr.34412) 9468 : cluster [DBG] pgmap v5393: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:20.218 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:48:19 gibba015 bash[29377]: cluster 2021-03-10T16:48:18.795913+0000 mgr.gibba045.orlgmj (mgr.34412) 9469 : cluster [DBG] pgmap v5394: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:20.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:48:19 gibba015 bash[30343]: cluster 2021-03-10T16:48:18.795913+0000 mgr.gibba045.orlgmj (mgr.34412) 9469 : cluster [DBG] pgmap v5394: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:20.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:48:19 gibba045 bash[25517]: cluster 2021-03-10T16:48:18.795913+0000 mgr.gibba045.orlgmj (mgr.34412) 9469 : cluster [DBG] pgmap v5394: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:22.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:48:21 gibba015 bash[29377]: cluster 2021-03-10T16:48:20.797590+0000 mgr.gibba045.orlgmj (mgr.34412) 9470 : cluster [DBG] pgmap v5395: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:22.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:48:21 gibba015 bash[30343]: cluster 2021-03-10T16:48:20.797590+0000 mgr.gibba045.orlgmj (mgr.34412) 9470 : cluster [DBG] pgmap v5395: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:22.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:48:21 gibba045 bash[25517]: cluster 2021-03-10T16:48:20.797590+0000 mgr.gibba045.orlgmj (mgr.34412) 9470 : cluster [DBG] pgmap v5395: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:22.733 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:48:22.960 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:48:22.961 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 94s ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:48:22.961 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 30s ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:48:22.962 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (2h) 30s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:48:22.962 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (2h) 30s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:48:22.963 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 94s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:48:22.963 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 94s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:48:22.963 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 30s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:48:22.964 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 94s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:48:22.964 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 94s ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:48:22.965 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 30s ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:48:22.965 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 94s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:48:22.965 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 94s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:48:22.966 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 94s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:48:22.966 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 94s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:48:22.967 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 30s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:48:22.967 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 30s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:48:22.968 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 30s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:48:22.968 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 30s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:48:22.968 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 30s ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:48:22.969 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 30s ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:48:23.208 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:48:23.209 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:48:23.209 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:48:23.209 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:48:23.209 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:48:23.210 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:48:23.210 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:48:23.210 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:48:23.210 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:48:23.211 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:48:23.211 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:48:23.211 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:48:23.211 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:48:23.211 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:48:23.212 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:48:24.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:48:23 gibba015 bash[29377]: audit 2021-03-10T16:48:22.728664+0000 mgr.gibba045.orlgmj (mgr.34412) 9471 : audit [DBG] from='client.50406 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:48:24.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:48:23 gibba015 bash[29377]: cluster 2021-03-10T16:48:22.798970+0000 mgr.gibba045.orlgmj (mgr.34412) 9472 : cluster [DBG] pgmap v5396: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:24.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:48:23 gibba015 bash[29377]: audit 2021-03-10T16:48:22.950777+0000 mgr.gibba045.orlgmj (mgr.34412) 9473 : audit [DBG] from='client.50412 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:48:24.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:48:23 gibba015 bash[29377]: audit 2021-03-10T16:48:23.210364+0000 mon.a (mon.0) 2079 : audit [DBG] from='client.? 172.21.2.115:0/99142677' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:48:24.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:48:23 gibba015 bash[30343]: audit 2021-03-10T16:48:22.728664+0000 mgr.gibba045.orlgmj (mgr.34412) 9471 : audit [DBG] from='client.50406 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:48:24.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:48:23 gibba015 bash[30343]: cluster 2021-03-10T16:48:22.798970+0000 mgr.gibba045.orlgmj (mgr.34412) 9472 : cluster [DBG] pgmap v5396: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:24.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:48:23 gibba015 bash[30343]: audit 2021-03-10T16:48:22.950777+0000 mgr.gibba045.orlgmj (mgr.34412) 9473 : audit [DBG] from='client.50412 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:48:24.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:48:23 gibba015 bash[30343]: audit 2021-03-10T16:48:23.210364+0000 mon.a (mon.0) 2079 : audit [DBG] from='client.? 172.21.2.115:0/99142677' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:48:24.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:48:23 gibba045 bash[25517]: audit 2021-03-10T16:48:22.728664+0000 mgr.gibba045.orlgmj (mgr.34412) 9471 : audit [DBG] from='client.50406 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:48:24.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:48:23 gibba045 bash[25517]: cluster 2021-03-10T16:48:22.798970+0000 mgr.gibba045.orlgmj (mgr.34412) 9472 : cluster [DBG] pgmap v5396: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:24.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:48:23 gibba045 bash[25517]: audit 2021-03-10T16:48:22.950777+0000 mgr.gibba045.orlgmj (mgr.34412) 9473 : audit [DBG] from='client.50412 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:48:24.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:48:23 gibba045 bash[25517]: audit 2021-03-10T16:48:23.210364+0000 mon.a (mon.0) 2079 : audit [DBG] from='client.? 172.21.2.115:0/99142677' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:48:26.218 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:48:25 gibba015 bash[29377]: cluster 2021-03-10T16:48:24.800710+0000 mgr.gibba045.orlgmj (mgr.34412) 9474 : cluster [DBG] pgmap v5397: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:26.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:48:25 gibba015 bash[30343]: cluster 2021-03-10T16:48:24.800710+0000 mgr.gibba045.orlgmj (mgr.34412) 9474 : cluster [DBG] pgmap v5397: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:26.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:48:25 gibba045 bash[25517]: cluster 2021-03-10T16:48:24.800710+0000 mgr.gibba045.orlgmj (mgr.34412) 9474 : cluster [DBG] pgmap v5397: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:27.802 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:48:27 gibba045 bash[25517]: cluster 2021-03-10T16:48:26.802366+0000 mgr.gibba045.orlgmj (mgr.34412) 9475 : cluster [DBG] pgmap v5398: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:27.968 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:48:27 gibba015 bash[29377]: cluster 2021-03-10T16:48:26.802366+0000 mgr.gibba045.orlgmj (mgr.34412) 9475 : cluster [DBG] pgmap v5398: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:27.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:48:27 gibba015 bash[30343]: cluster 2021-03-10T16:48:26.802366+0000 mgr.gibba045.orlgmj (mgr.34412) 9475 : cluster [DBG] pgmap v5398: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:28.968 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:48:28 gibba015 bash[29377]: cephadm 2021-03-10T16:48:27.506276+0000 mgr.gibba045.orlgmj (mgr.34412) 9476 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:48:28.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:48:28 gibba015 bash[30343]: cephadm 2021-03-10T16:48:27.506276+0000 mgr.gibba045.orlgmj (mgr.34412) 9476 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:48:29.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:48:28 gibba045 bash[25517]: cephadm 2021-03-10T16:48:27.506276+0000 mgr.gibba045.orlgmj (mgr.34412) 9476 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:48:30.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:48:29 gibba045 bash[25517]: cluster 2021-03-10T16:48:28.802984+0000 mgr.gibba045.orlgmj (mgr.34412) 9477 : cluster [DBG] pgmap v5399: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:30.218 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:48:29 gibba015 bash[29377]: cluster 2021-03-10T16:48:28.802984+0000 mgr.gibba045.orlgmj (mgr.34412) 9477 : cluster [DBG] pgmap v5399: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:30.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:48:29 gibba015 bash[30343]: cluster 2021-03-10T16:48:28.802984+0000 mgr.gibba045.orlgmj (mgr.34412) 9477 : cluster [DBG] pgmap v5399: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:32.218 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:48:31 gibba015 bash[29377]: cluster 2021-03-10T16:48:30.804769+0000 mgr.gibba045.orlgmj (mgr.34412) 9478 : cluster [DBG] pgmap v5400: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:32.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:48:31 gibba015 bash[30343]: cluster 2021-03-10T16:48:30.804769+0000 mgr.gibba045.orlgmj (mgr.34412) 9478 : cluster [DBG] pgmap v5400: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:32.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:48:31 gibba045 bash[25517]: cluster 2021-03-10T16:48:30.804769+0000 mgr.gibba045.orlgmj (mgr.34412) 9478 : cluster [DBG] pgmap v5400: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:34.218 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:48:33 gibba015 bash[29377]: cluster 2021-03-10T16:48:32.806209+0000 mgr.gibba045.orlgmj (mgr.34412) 9479 : cluster [DBG] pgmap v5401: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:34.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:48:33 gibba015 bash[30343]: cluster 2021-03-10T16:48:32.806209+0000 mgr.gibba045.orlgmj (mgr.34412) 9479 : cluster [DBG] pgmap v5401: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:34.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:48:33 gibba045 bash[25517]: cluster 2021-03-10T16:48:32.806209+0000 mgr.gibba045.orlgmj (mgr.34412) 9479 : cluster [DBG] pgmap v5401: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:36.218 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:48:35 gibba015 bash[29377]: cluster 2021-03-10T16:48:34.807862+0000 mgr.gibba045.orlgmj (mgr.34412) 9480 : cluster [DBG] pgmap v5402: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:36.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:48:35 gibba015 bash[30343]: cluster 2021-03-10T16:48:34.807862+0000 mgr.gibba045.orlgmj (mgr.34412) 9480 : cluster [DBG] pgmap v5402: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:36.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:48:35 gibba045 bash[25517]: cluster 2021-03-10T16:48:34.807862+0000 mgr.gibba045.orlgmj (mgr.34412) 9480 : cluster [DBG] pgmap v5402: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:37.968 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:48:37 gibba015 bash[29377]: cluster 2021-03-10T16:48:36.809317+0000 mgr.gibba045.orlgmj (mgr.34412) 9481 : cluster [DBG] pgmap v5403: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:37.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:48:37 gibba015 bash[30343]: cluster 2021-03-10T16:48:36.809317+0000 mgr.gibba045.orlgmj (mgr.34412) 9481 : cluster [DBG] pgmap v5403: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:38.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:48:37 gibba045 bash[25517]: cluster 2021-03-10T16:48:36.809317+0000 mgr.gibba045.orlgmj (mgr.34412) 9481 : cluster [DBG] pgmap v5403: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:40.218 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:48:39 gibba015 bash[29377]: cluster 2021-03-10T16:48:38.809692+0000 mgr.gibba045.orlgmj (mgr.34412) 9482 : cluster [DBG] pgmap v5404: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:40.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:48:39 gibba015 bash[30343]: cluster 2021-03-10T16:48:38.809692+0000 mgr.gibba045.orlgmj (mgr.34412) 9482 : cluster [DBG] pgmap v5404: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:40.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:48:39 gibba045 bash[25517]: cluster 2021-03-10T16:48:38.809692+0000 mgr.gibba045.orlgmj (mgr.34412) 9482 : cluster [DBG] pgmap v5404: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:42.218 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:48:41 gibba015 bash[29377]: cluster 2021-03-10T16:48:40.811388+0000 mgr.gibba045.orlgmj (mgr.34412) 9483 : cluster [DBG] pgmap v5405: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:42.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:48:41 gibba015 bash[30343]: cluster 2021-03-10T16:48:40.811388+0000 mgr.gibba045.orlgmj (mgr.34412) 9483 : cluster [DBG] pgmap v5405: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:42.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:48:41 gibba045 bash[25517]: cluster 2021-03-10T16:48:40.811388+0000 mgr.gibba045.orlgmj (mgr.34412) 9483 : cluster [DBG] pgmap v5405: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:44.218 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:48:43 gibba015 bash[29377]: cephadm 2021-03-10T16:48:42.522252+0000 mgr.gibba045.orlgmj (mgr.34412) 9484 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:48:44.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:48:43 gibba015 bash[29377]: cluster 2021-03-10T16:48:42.812825+0000 mgr.gibba045.orlgmj (mgr.34412) 9485 : cluster [DBG] pgmap v5406: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:44.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:48:43 gibba015 bash[30343]: cephadm 2021-03-10T16:48:42.522252+0000 mgr.gibba045.orlgmj (mgr.34412) 9484 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:48:44.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:48:43 gibba015 bash[30343]: cluster 2021-03-10T16:48:42.812825+0000 mgr.gibba045.orlgmj (mgr.34412) 9485 : cluster [DBG] pgmap v5406: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:44.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:48:43 gibba045 bash[25517]: cephadm 2021-03-10T16:48:42.522252+0000 mgr.gibba045.orlgmj (mgr.34412) 9484 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:48:44.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:48:43 gibba045 bash[25517]: cluster 2021-03-10T16:48:42.812825+0000 mgr.gibba045.orlgmj (mgr.34412) 9485 : cluster [DBG] pgmap v5406: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:46.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:48:45 gibba015 bash[29377]: cluster 2021-03-10T16:48:44.814408+0000 mgr.gibba045.orlgmj (mgr.34412) 9486 : cluster [DBG] pgmap v5407: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:46.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:48:45 gibba015 bash[30343]: cluster 2021-03-10T16:48:44.814408+0000 mgr.gibba045.orlgmj (mgr.34412) 9486 : cluster [DBG] pgmap v5407: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:46.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:48:45 gibba045 bash[25517]: cluster 2021-03-10T16:48:44.814408+0000 mgr.gibba045.orlgmj (mgr.34412) 9486 : cluster [DBG] pgmap v5407: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:48.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:48:47 gibba045 bash[25517]: cluster 2021-03-10T16:48:46.815913+0000 mgr.gibba045.orlgmj (mgr.34412) 9487 : cluster [DBG] pgmap v5408: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:48.218 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:48:47 gibba015 bash[29377]: cluster 2021-03-10T16:48:46.815913+0000 mgr.gibba045.orlgmj (mgr.34412) 9487 : cluster [DBG] pgmap v5408: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:48.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:48:47 gibba015 bash[30343]: cluster 2021-03-10T16:48:46.815913+0000 mgr.gibba045.orlgmj (mgr.34412) 9487 : cluster [DBG] pgmap v5408: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:50.218 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:48:49 gibba015 bash[29377]: cluster 2021-03-10T16:48:48.817101+0000 mgr.gibba045.orlgmj (mgr.34412) 9488 : cluster [DBG] pgmap v5409: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:50.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:48:49 gibba015 bash[30343]: cluster 2021-03-10T16:48:48.817101+0000 mgr.gibba045.orlgmj (mgr.34412) 9488 : cluster [DBG] pgmap v5409: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:50.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:48:49 gibba045 bash[25517]: cluster 2021-03-10T16:48:48.817101+0000 mgr.gibba045.orlgmj (mgr.34412) 9488 : cluster [DBG] pgmap v5409: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:52.218 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:48:51 gibba015 bash[29377]: cluster 2021-03-10T16:48:50.818977+0000 mgr.gibba045.orlgmj (mgr.34412) 9489 : cluster [DBG] pgmap v5410: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:52.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:48:51 gibba015 bash[30343]: cluster 2021-03-10T16:48:50.818977+0000 mgr.gibba045.orlgmj (mgr.34412) 9489 : cluster [DBG] pgmap v5410: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:52.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:48:51 gibba045 bash[25517]: cluster 2021-03-10T16:48:50.818977+0000 mgr.gibba045.orlgmj (mgr.34412) 9489 : cluster [DBG] pgmap v5410: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:53.452 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:48:53.681 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:48:53.682 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (2h) 2m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:48:53.682 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 61s ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:48:53.682 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 61s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:48:53.682 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 61s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:48:53.683 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:48:53.683 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:48:53.683 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 61s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:48:53.683 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:48:53.684 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 2m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:48:53.684 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 61s ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:48:53.684 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:48:53.684 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:48:53.684 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:48:53.685 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:48:53.685 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 61s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:48:53.685 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 61s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:48:53.685 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 61s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:48:53.686 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 61s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:48:53.686 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 61s ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:48:53.686 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 61s ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:48:53.929 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:48:53.930 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:48:53.930 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:48:53.931 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:48:53.931 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:48:53.932 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:48:53.932 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:48:53.932 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:48:53.933 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:48:53.933 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:48:53.934 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:48:53.934 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:48:53.935 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:48:53.935 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:48:53.935 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:48:54.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:48:53 gibba015 bash[29377]: cluster 2021-03-10T16:48:52.820379+0000 mgr.gibba045.orlgmj (mgr.34412) 9490 : cluster [DBG] pgmap v5411: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:54.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:48:53 gibba015 bash[29377]: audit 2021-03-10T16:48:53.745986+0000 mon.c (mon.1) 2611 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:48:54.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:48:53 gibba015 bash[29377]: audit 2021-03-10T16:48:53.746494+0000 mon.a (mon.0) 2080 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:48:54.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:48:53 gibba015 bash[29377]: audit 2021-03-10T16:48:53.749470+0000 mon.c (mon.1) 2612 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:48:54.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:48:53 gibba015 bash[29377]: audit 2021-03-10T16:48:53.749709+0000 mon.a (mon.0) 2081 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:48:54.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:48:53 gibba015 bash[29377]: audit 2021-03-10T16:48:53.763562+0000 mon.c (mon.1) 2613 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T16:48:54.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:48:53 gibba015 bash[29377]: audit 2021-03-10T16:48:53.763699+0000 mon.c (mon.1) 2614 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:48:54.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:48:53 gibba015 bash[29377]: audit 2021-03-10T16:48:53.763899+0000 mon.a (mon.0) 2082 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T16:48:54.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:48:53 gibba015 bash[29377]: audit 2021-03-10T16:48:53.763938+0000 mon.c (mon.1) 2615 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:48:54.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:48:53 gibba015 bash[29377]: audit 2021-03-10T16:48:53.764249+0000 mon.a (mon.0) 2083 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:48:54.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:48:53 gibba015 bash[29377]: audit 2021-03-10T16:48:53.764321+0000 mon.c (mon.1) 2616 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:48:54.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:48:53 gibba015 bash[29377]: audit 2021-03-10T16:48:53.764536+0000 mon.a (mon.0) 2084 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:48:54.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:48:53 gibba015 bash[29377]: audit 2021-03-10T16:48:53.764721+0000 mon.a (mon.0) 2085 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:48:54.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:48:53 gibba015 bash[30343]: cluster 2021-03-10T16:48:52.820379+0000 mgr.gibba045.orlgmj (mgr.34412) 9490 : cluster [DBG] pgmap v5411: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:54.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:48:53 gibba015 bash[30343]: audit 2021-03-10T16:48:53.745986+0000 mon.c (mon.1) 2611 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:48:54.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:48:53 gibba015 bash[30343]: audit 2021-03-10T16:48:53.746494+0000 mon.a (mon.0) 2080 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:48:54.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:48:53 gibba015 bash[30343]: audit 2021-03-10T16:48:53.749470+0000 mon.c (mon.1) 2612 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:48:54.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:48:53 gibba015 bash[30343]: audit 2021-03-10T16:48:53.749709+0000 mon.a (mon.0) 2081 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:48:54.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:48:53 gibba015 bash[30343]: audit 2021-03-10T16:48:53.763562+0000 mon.c (mon.1) 2613 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T16:48:54.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:48:53 gibba015 bash[30343]: audit 2021-03-10T16:48:53.763699+0000 mon.c (mon.1) 2614 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:48:54.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:48:53 gibba015 bash[30343]: audit 2021-03-10T16:48:53.763899+0000 mon.a (mon.0) 2082 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T16:48:54.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:48:53 gibba015 bash[30343]: audit 2021-03-10T16:48:53.763938+0000 mon.c (mon.1) 2615 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:48:54.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:48:53 gibba015 bash[30343]: audit 2021-03-10T16:48:53.764249+0000 mon.a (mon.0) 2083 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:48:54.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:48:53 gibba015 bash[30343]: audit 2021-03-10T16:48:53.764321+0000 mon.c (mon.1) 2616 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:48:54.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:48:53 gibba015 bash[30343]: audit 2021-03-10T16:48:53.764536+0000 mon.a (mon.0) 2084 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:48:54.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:48:53 gibba015 bash[30343]: audit 2021-03-10T16:48:53.764721+0000 mon.a (mon.0) 2085 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:48:54.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:48:53 gibba045 bash[25517]: cluster 2021-03-10T16:48:52.820379+0000 mgr.gibba045.orlgmj (mgr.34412) 9490 : cluster [DBG] pgmap v5411: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:54.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:48:53 gibba045 bash[25517]: audit 2021-03-10T16:48:53.745986+0000 mon.c (mon.1) 2611 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:48:54.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:48:53 gibba045 bash[25517]: audit 2021-03-10T16:48:53.746494+0000 mon.a (mon.0) 2080 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:48:54.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:48:53 gibba045 bash[25517]: audit 2021-03-10T16:48:53.749470+0000 mon.c (mon.1) 2612 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:48:54.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:48:53 gibba045 bash[25517]: audit 2021-03-10T16:48:53.749709+0000 mon.a (mon.0) 2081 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:48:54.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:48:53 gibba045 bash[25517]: audit 2021-03-10T16:48:53.763562+0000 mon.c (mon.1) 2613 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T16:48:54.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:48:53 gibba045 bash[25517]: audit 2021-03-10T16:48:53.763699+0000 mon.c (mon.1) 2614 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:48:54.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:48:53 gibba045 bash[25517]: audit 2021-03-10T16:48:53.763899+0000 mon.a (mon.0) 2082 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T16:48:54.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:48:53 gibba045 bash[25517]: audit 2021-03-10T16:48:53.763938+0000 mon.c (mon.1) 2615 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:48:54.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:48:53 gibba045 bash[25517]: audit 2021-03-10T16:48:53.764249+0000 mon.a (mon.0) 2083 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:48:54.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:48:53 gibba045 bash[25517]: audit 2021-03-10T16:48:53.764321+0000 mon.c (mon.1) 2616 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:48:54.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:48:53 gibba045 bash[25517]: audit 2021-03-10T16:48:53.764536+0000 mon.a (mon.0) 2084 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:48:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:48:53 gibba045 bash[25517]: audit 2021-03-10T16:48:53.764721+0000 mon.a (mon.0) 2085 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:48:55.218 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:48:54 gibba015 bash[29377]: audit 2021-03-10T16:48:53.447396+0000 mgr.gibba045.orlgmj (mgr.34412) 9491 : audit [DBG] from='client.50424 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:48:55.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:48:54 gibba015 bash[29377]: audit 2021-03-10T16:48:53.672901+0000 mgr.gibba045.orlgmj (mgr.34412) 9492 : audit [DBG] from='client.50430 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:48:55.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:48:54 gibba015 bash[29377]: audit 2021-03-10T16:48:53.930409+0000 mon.c (mon.1) 2617 : audit [DBG] from='client.? 172.21.2.115:0/4096906066' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:48:55.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:48:54 gibba015 bash[30343]: audit 2021-03-10T16:48:53.447396+0000 mgr.gibba045.orlgmj (mgr.34412) 9491 : audit [DBG] from='client.50424 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:48:55.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:48:54 gibba015 bash[30343]: audit 2021-03-10T16:48:53.672901+0000 mgr.gibba045.orlgmj (mgr.34412) 9492 : audit [DBG] from='client.50430 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:48:55.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:48:54 gibba015 bash[30343]: audit 2021-03-10T16:48:53.930409+0000 mon.c (mon.1) 2617 : audit [DBG] from='client.? 172.21.2.115:0/4096906066' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:48:55.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:48:54 gibba045 bash[25517]: audit 2021-03-10T16:48:53.447396+0000 mgr.gibba045.orlgmj (mgr.34412) 9491 : audit [DBG] from='client.50424 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:48:55.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:48:54 gibba045 bash[25517]: audit 2021-03-10T16:48:53.672901+0000 mgr.gibba045.orlgmj (mgr.34412) 9492 : audit [DBG] from='client.50430 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:48:55.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:48:54 gibba045 bash[25517]: audit 2021-03-10T16:48:53.930409+0000 mon.c (mon.1) 2617 : audit [DBG] from='client.? 172.21.2.115:0/4096906066' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:48:56.218 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:48:55 gibba015 bash[29377]: cluster 2021-03-10T16:48:54.821897+0000 mgr.gibba045.orlgmj (mgr.34412) 9493 : cluster [DBG] pgmap v5412: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:56.244 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:48:55 gibba015 bash[30343]: cluster 2021-03-10T16:48:54.821897+0000 mgr.gibba045.orlgmj (mgr.34412) 9493 : cluster [DBG] pgmap v5412: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:56.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:48:55 gibba045 bash[25517]: cluster 2021-03-10T16:48:54.821897+0000 mgr.gibba045.orlgmj (mgr.34412) 9493 : cluster [DBG] pgmap v5412: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:57.968 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:48:57 gibba015 bash[30343]: cluster 2021-03-10T16:48:56.823779+0000 mgr.gibba045.orlgmj (mgr.34412) 9494 : cluster [DBG] pgmap v5413: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:57.969 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:48:57 gibba015 bash[30343]: audit 2021-03-10T16:48:57.536897+0000 mon.c (mon.1) 2618 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:48:57.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:48:57 gibba015 bash[29377]: cluster 2021-03-10T16:48:56.823779+0000 mgr.gibba045.orlgmj (mgr.34412) 9494 : cluster [DBG] pgmap v5413: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:57.969 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:48:57 gibba015 bash[29377]: audit 2021-03-10T16:48:57.536897+0000 mon.c (mon.1) 2618 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:48:58.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:48:57 gibba045 bash[25517]: cluster 2021-03-10T16:48:56.823779+0000 mgr.gibba045.orlgmj (mgr.34412) 9494 : cluster [DBG] pgmap v5413: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:58.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:48:57 gibba045 bash[25517]: audit 2021-03-10T16:48:57.536897+0000 mon.c (mon.1) 2618 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:48:59.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:48:58 gibba045 bash[25517]: cephadm 2021-03-10T16:48:57.544939+0000 mgr.gibba045.orlgmj (mgr.34412) 9495 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:48:59.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:48:58 gibba045 bash[25517]: cephadm 2021-03-10T16:48:57.546680+0000 mgr.gibba045.orlgmj (mgr.34412) 9496 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:48:59.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:48:58 gibba045 bash[25517]: audit 2021-03-10T16:48:57.765221+0000 mon.a (mon.0) 2086 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:48:59.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:48:58 gibba045 bash[25517]: audit 2021-03-10T16:48:57.769155+0000 mon.c (mon.1) 2619 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:48:59.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:48:58 gibba045 bash[25517]: cephadm 2021-03-10T16:48:57.770426+0000 mgr.gibba045.orlgmj (mgr.34412) 9497 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:48:59.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:48:58 gibba045 bash[25517]: audit 2021-03-10T16:48:57.772224+0000 mon.c (mon.1) 2620 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:48:59.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:48:58 gibba045 bash[25517]: cephadm 2021-03-10T16:48:57.773884+0000 mgr.gibba045.orlgmj (mgr.34412) 9498 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:48:59.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:48:58 gibba045 bash[25517]: audit 2021-03-10T16:48:57.774493+0000 mon.c (mon.1) 2621 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:48:59.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:48:58 gibba045 bash[25517]: cephadm 2021-03-10T16:48:57.776132+0000 mgr.gibba045.orlgmj (mgr.34412) 9499 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:48:59.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:48:58 gibba045 bash[25517]: cephadm 2021-03-10T16:48:57.776167+0000 mgr.gibba045.orlgmj (mgr.34412) 9500 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:48:59.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:48:58 gibba045 bash[25517]: audit 2021-03-10T16:48:57.776813+0000 mon.c (mon.1) 2622 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:48:59.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:48:58 gibba045 bash[25517]: cephadm 2021-03-10T16:48:57.778519+0000 mgr.gibba045.orlgmj (mgr.34412) 9501 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:48:59.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:48:58 gibba045 bash[25517]: cephadm 2021-03-10T16:48:57.778554+0000 mgr.gibba045.orlgmj (mgr.34412) 9502 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:48:59.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:48:58 gibba045 bash[25517]: cephadm 2021-03-10T16:48:57.780832+0000 mgr.gibba045.orlgmj (mgr.34412) 9503 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:48:59.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:48:58 gibba045 bash[25517]: audit 2021-03-10T16:48:57.785877+0000 mon.c (mon.1) 2623 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:48:59.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:48:58 gibba045 bash[25517]: cephadm 2021-03-10T16:48:57.786080+0000 mgr.gibba045.orlgmj (mgr.34412) 9504 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:48:59.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:48:58 gibba045 bash[25517]: cephadm 2021-03-10T16:48:57.786387+0000 mgr.gibba045.orlgmj (mgr.34412) 9505 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:48:59.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:48:58 gibba045 bash[25517]: cephadm 2021-03-10T16:48:57.791581+0000 mgr.gibba045.orlgmj (mgr.34412) 9506 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:48:59.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:48:58 gibba045 bash[25517]: audit 2021-03-10T16:48:57.792714+0000 mon.c (mon.1) 2624 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:48:59.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:48:58 gibba045 bash[25517]: cephadm 2021-03-10T16:48:57.793823+0000 mgr.gibba045.orlgmj (mgr.34412) 9507 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:48:59.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:48:58 gibba045 bash[25517]: cephadm 2021-03-10T16:48:57.797761+0000 mgr.gibba045.orlgmj (mgr.34412) 9508 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:48:59.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:48:58 gibba045 bash[25517]: cephadm 2021-03-10T16:48:57.798162+0000 mgr.gibba045.orlgmj (mgr.34412) 9509 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:48:59.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:48:58 gibba045 bash[25517]: cephadm 2021-03-10T16:48:57.798765+0000 mgr.gibba045.orlgmj (mgr.34412) 9510 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:48:59.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:48:58 gibba015 bash[29377]: cephadm 2021-03-10T16:48:57.544939+0000 mgr.gibba045.orlgmj (mgr.34412) 9495 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:48:59.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:48:58 gibba015 bash[29377]: cephadm 2021-03-10T16:48:57.546680+0000 mgr.gibba045.orlgmj (mgr.34412) 9496 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:48:59.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:48:58 gibba015 bash[29377]: audit 2021-03-10T16:48:57.765221+0000 mon.a (mon.0) 2086 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:48:59.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:48:58 gibba015 bash[29377]: audit 2021-03-10T16:48:57.769155+0000 mon.c (mon.1) 2619 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:48:59.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:48:58 gibba015 bash[29377]: cephadm 2021-03-10T16:48:57.770426+0000 mgr.gibba045.orlgmj (mgr.34412) 9497 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:48:59.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:48:58 gibba015 bash[29377]: audit 2021-03-10T16:48:57.772224+0000 mon.c (mon.1) 2620 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:48:59.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:48:58 gibba015 bash[29377]: cephadm 2021-03-10T16:48:57.773884+0000 mgr.gibba045.orlgmj (mgr.34412) 9498 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:48:59.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:48:58 gibba015 bash[29377]: audit 2021-03-10T16:48:57.774493+0000 mon.c (mon.1) 2621 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:48:59.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:48:58 gibba015 bash[29377]: cephadm 2021-03-10T16:48:57.776132+0000 mgr.gibba045.orlgmj (mgr.34412) 9499 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:48:59.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:48:58 gibba015 bash[29377]: cephadm 2021-03-10T16:48:57.776167+0000 mgr.gibba045.orlgmj (mgr.34412) 9500 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:48:59.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:48:58 gibba015 bash[29377]: audit 2021-03-10T16:48:57.776813+0000 mon.c (mon.1) 2622 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:48:59.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:48:58 gibba015 bash[29377]: cephadm 2021-03-10T16:48:57.778519+0000 mgr.gibba045.orlgmj (mgr.34412) 9501 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:48:59.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:48:58 gibba015 bash[29377]: cephadm 2021-03-10T16:48:57.778554+0000 mgr.gibba045.orlgmj (mgr.34412) 9502 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:48:59.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:48:58 gibba015 bash[29377]: cephadm 2021-03-10T16:48:57.780832+0000 mgr.gibba045.orlgmj (mgr.34412) 9503 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:48:59.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:48:58 gibba015 bash[29377]: audit 2021-03-10T16:48:57.785877+0000 mon.c (mon.1) 2623 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:48:59.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:48:58 gibba015 bash[29377]: cephadm 2021-03-10T16:48:57.786080+0000 mgr.gibba045.orlgmj (mgr.34412) 9504 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:48:59.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:48:58 gibba015 bash[29377]: cephadm 2021-03-10T16:48:57.786387+0000 mgr.gibba045.orlgmj (mgr.34412) 9505 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:48:59.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:48:58 gibba015 bash[29377]: cephadm 2021-03-10T16:48:57.791581+0000 mgr.gibba045.orlgmj (mgr.34412) 9506 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:48:59.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:48:58 gibba015 bash[29377]: audit 2021-03-10T16:48:57.792714+0000 mon.c (mon.1) 2624 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:48:59.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:48:58 gibba015 bash[29377]: cephadm 2021-03-10T16:48:57.793823+0000 mgr.gibba045.orlgmj (mgr.34412) 9507 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:48:59.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:48:58 gibba015 bash[29377]: cephadm 2021-03-10T16:48:57.797761+0000 mgr.gibba045.orlgmj (mgr.34412) 9508 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:48:59.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:48:58 gibba015 bash[29377]: cephadm 2021-03-10T16:48:57.798162+0000 mgr.gibba045.orlgmj (mgr.34412) 9509 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:48:59.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:48:58 gibba015 bash[29377]: cephadm 2021-03-10T16:48:57.798765+0000 mgr.gibba045.orlgmj (mgr.34412) 9510 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:48:59.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:48:58 gibba015 bash[30343]: cephadm 2021-03-10T16:48:57.544939+0000 mgr.gibba045.orlgmj (mgr.34412) 9495 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:48:59.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:48:58 gibba015 bash[30343]: cephadm 2021-03-10T16:48:57.546680+0000 mgr.gibba045.orlgmj (mgr.34412) 9496 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:48:59.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:48:58 gibba015 bash[30343]: audit 2021-03-10T16:48:57.765221+0000 mon.a (mon.0) 2086 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:48:59.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:48:58 gibba015 bash[30343]: audit 2021-03-10T16:48:57.769155+0000 mon.c (mon.1) 2619 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:48:59.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:48:58 gibba015 bash[30343]: cephadm 2021-03-10T16:48:57.770426+0000 mgr.gibba045.orlgmj (mgr.34412) 9497 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:48:59.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:48:58 gibba015 bash[30343]: audit 2021-03-10T16:48:57.772224+0000 mon.c (mon.1) 2620 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:48:59.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:48:58 gibba015 bash[30343]: cephadm 2021-03-10T16:48:57.773884+0000 mgr.gibba045.orlgmj (mgr.34412) 9498 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:48:59.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:48:58 gibba015 bash[30343]: audit 2021-03-10T16:48:57.774493+0000 mon.c (mon.1) 2621 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:48:59.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:48:58 gibba015 bash[30343]: cephadm 2021-03-10T16:48:57.776132+0000 mgr.gibba045.orlgmj (mgr.34412) 9499 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:48:59.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:48:58 gibba015 bash[30343]: cephadm 2021-03-10T16:48:57.776167+0000 mgr.gibba045.orlgmj (mgr.34412) 9500 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:48:59.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:48:58 gibba015 bash[30343]: audit 2021-03-10T16:48:57.776813+0000 mon.c (mon.1) 2622 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:48:59.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:48:58 gibba015 bash[30343]: cephadm 2021-03-10T16:48:57.778519+0000 mgr.gibba045.orlgmj (mgr.34412) 9501 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:48:59.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:48:58 gibba015 bash[30343]: cephadm 2021-03-10T16:48:57.778554+0000 mgr.gibba045.orlgmj (mgr.34412) 9502 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:48:59.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:48:58 gibba015 bash[30343]: cephadm 2021-03-10T16:48:57.780832+0000 mgr.gibba045.orlgmj (mgr.34412) 9503 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:48:59.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:48:58 gibba015 bash[30343]: audit 2021-03-10T16:48:57.785877+0000 mon.c (mon.1) 2623 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:48:59.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:48:58 gibba015 bash[30343]: cephadm 2021-03-10T16:48:57.786080+0000 mgr.gibba045.orlgmj (mgr.34412) 9504 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:48:59.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:48:58 gibba015 bash[30343]: cephadm 2021-03-10T16:48:57.786387+0000 mgr.gibba045.orlgmj (mgr.34412) 9505 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:48:59.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:48:58 gibba015 bash[30343]: cephadm 2021-03-10T16:48:57.791581+0000 mgr.gibba045.orlgmj (mgr.34412) 9506 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:48:59.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:48:58 gibba015 bash[30343]: audit 2021-03-10T16:48:57.792714+0000 mon.c (mon.1) 2624 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:48:59.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:48:58 gibba015 bash[30343]: cephadm 2021-03-10T16:48:57.793823+0000 mgr.gibba045.orlgmj (mgr.34412) 9507 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:48:59.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:48:58 gibba015 bash[30343]: cephadm 2021-03-10T16:48:57.797761+0000 mgr.gibba045.orlgmj (mgr.34412) 9508 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:48:59.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:48:58 gibba015 bash[30343]: cephadm 2021-03-10T16:48:57.798162+0000 mgr.gibba045.orlgmj (mgr.34412) 9509 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:48:59.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:48:58 gibba015 bash[30343]: cephadm 2021-03-10T16:48:57.798765+0000 mgr.gibba045.orlgmj (mgr.34412) 9510 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:49:00.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:48:59 gibba045 bash[25517]: cluster 2021-03-10T16:48:58.824414+0000 mgr.gibba045.orlgmj (mgr.34412) 9511 : cluster [DBG] pgmap v5414: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:00.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:48:59 gibba015 bash[29377]: cluster 2021-03-10T16:48:58.824414+0000 mgr.gibba045.orlgmj (mgr.34412) 9511 : cluster [DBG] pgmap v5414: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:00.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:48:59 gibba015 bash[30343]: cluster 2021-03-10T16:48:58.824414+0000 mgr.gibba045.orlgmj (mgr.34412) 9511 : cluster [DBG] pgmap v5414: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:02.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:49:01 gibba015 bash[29377]: cluster 2021-03-10T16:49:00.826242+0000 mgr.gibba045.orlgmj (mgr.34412) 9512 : cluster [DBG] pgmap v5415: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:02.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:49:01 gibba015 bash[30343]: cluster 2021-03-10T16:49:00.826242+0000 mgr.gibba045.orlgmj (mgr.34412) 9512 : cluster [DBG] pgmap v5415: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:02.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:49:01 gibba045 bash[25517]: cluster 2021-03-10T16:49:00.826242+0000 mgr.gibba045.orlgmj (mgr.34412) 9512 : cluster [DBG] pgmap v5415: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:04.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:49:03 gibba015 bash[29377]: cluster 2021-03-10T16:49:02.827591+0000 mgr.gibba045.orlgmj (mgr.34412) 9513 : cluster [DBG] pgmap v5416: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:04.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:49:03 gibba015 bash[30343]: cluster 2021-03-10T16:49:02.827591+0000 mgr.gibba045.orlgmj (mgr.34412) 9513 : cluster [DBG] pgmap v5416: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:04.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:49:03 gibba045 bash[25517]: cluster 2021-03-10T16:49:02.827591+0000 mgr.gibba045.orlgmj (mgr.34412) 9513 : cluster [DBG] pgmap v5416: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:06.218 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:49:05 gibba015 bash[29377]: cluster 2021-03-10T16:49:04.829276+0000 mgr.gibba045.orlgmj (mgr.34412) 9514 : cluster [DBG] pgmap v5417: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:06.218 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:49:05 gibba015 bash[30343]: cluster 2021-03-10T16:49:04.829276+0000 mgr.gibba045.orlgmj (mgr.34412) 9514 : cluster [DBG] pgmap v5417: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:06.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:49:05 gibba045 bash[25517]: cluster 2021-03-10T16:49:04.829276+0000 mgr.gibba045.orlgmj (mgr.34412) 9514 : cluster [DBG] pgmap v5417: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:08.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:49:07 gibba045 bash[25517]: cluster 2021-03-10T16:49:06.830788+0000 mgr.gibba045.orlgmj (mgr.34412) 9515 : cluster [DBG] pgmap v5418: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:08.218 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:49:07 gibba015 bash[29377]: cluster 2021-03-10T16:49:06.830788+0000 mgr.gibba045.orlgmj (mgr.34412) 9515 : cluster [DBG] pgmap v5418: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:08.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:49:07 gibba015 bash[30343]: cluster 2021-03-10T16:49:06.830788+0000 mgr.gibba045.orlgmj (mgr.34412) 9515 : cluster [DBG] pgmap v5418: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:10.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:49:09 gibba015 bash[29377]: cluster 2021-03-10T16:49:08.831817+0000 mgr.gibba045.orlgmj (mgr.34412) 9516 : cluster [DBG] pgmap v5419: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:10.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:49:09 gibba015 bash[30343]: cluster 2021-03-10T16:49:08.831817+0000 mgr.gibba045.orlgmj (mgr.34412) 9516 : cluster [DBG] pgmap v5419: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:10.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:49:09 gibba045 bash[25517]: cluster 2021-03-10T16:49:08.831817+0000 mgr.gibba045.orlgmj (mgr.34412) 9516 : cluster [DBG] pgmap v5419: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:12.218 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:49:11 gibba015 bash[29377]: cluster 2021-03-10T16:49:10.833573+0000 mgr.gibba045.orlgmj (mgr.34412) 9517 : cluster [DBG] pgmap v5420: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:12.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:49:11 gibba015 bash[30343]: cluster 2021-03-10T16:49:10.833573+0000 mgr.gibba045.orlgmj (mgr.34412) 9517 : cluster [DBG] pgmap v5420: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:12.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:49:11 gibba045 bash[25517]: cluster 2021-03-10T16:49:10.833573+0000 mgr.gibba045.orlgmj (mgr.34412) 9517 : cluster [DBG] pgmap v5420: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:14.218 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:49:13 gibba015 bash[29377]: cephadm 2021-03-10T16:49:12.814720+0000 mgr.gibba045.orlgmj (mgr.34412) 9518 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:49:14.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:49:13 gibba015 bash[29377]: cluster 2021-03-10T16:49:12.834906+0000 mgr.gibba045.orlgmj (mgr.34412) 9519 : cluster [DBG] pgmap v5421: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:14.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:49:13 gibba015 bash[30343]: cephadm 2021-03-10T16:49:12.814720+0000 mgr.gibba045.orlgmj (mgr.34412) 9518 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:49:14.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:49:13 gibba015 bash[30343]: cluster 2021-03-10T16:49:12.834906+0000 mgr.gibba045.orlgmj (mgr.34412) 9519 : cluster [DBG] pgmap v5421: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:14.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:49:13 gibba045 bash[25517]: cephadm 2021-03-10T16:49:12.814720+0000 mgr.gibba045.orlgmj (mgr.34412) 9518 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:49:14.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:49:13 gibba045 bash[25517]: cluster 2021-03-10T16:49:12.834906+0000 mgr.gibba045.orlgmj (mgr.34412) 9519 : cluster [DBG] pgmap v5421: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:16.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:49:15 gibba015 bash[29377]: cluster 2021-03-10T16:49:14.836551+0000 mgr.gibba045.orlgmj (mgr.34412) 9520 : cluster [DBG] pgmap v5422: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:16.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:49:15 gibba015 bash[30343]: cluster 2021-03-10T16:49:14.836551+0000 mgr.gibba045.orlgmj (mgr.34412) 9520 : cluster [DBG] pgmap v5422: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:16.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:49:15 gibba045 bash[25517]: cluster 2021-03-10T16:49:14.836551+0000 mgr.gibba045.orlgmj (mgr.34412) 9520 : cluster [DBG] pgmap v5422: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:18.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:49:17 gibba045 bash[25517]: cluster 2021-03-10T16:49:16.838233+0000 mgr.gibba045.orlgmj (mgr.34412) 9521 : cluster [DBG] pgmap v5423: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:18.218 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:49:17 gibba015 bash[29377]: cluster 2021-03-10T16:49:16.838233+0000 mgr.gibba045.orlgmj (mgr.34412) 9521 : cluster [DBG] pgmap v5423: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:18.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:49:17 gibba015 bash[30343]: cluster 2021-03-10T16:49:16.838233+0000 mgr.gibba045.orlgmj (mgr.34412) 9521 : cluster [DBG] pgmap v5423: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:20.218 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:49:19 gibba015 bash[29377]: cluster 2021-03-10T16:49:18.839251+0000 mgr.gibba045.orlgmj (mgr.34412) 9522 : cluster [DBG] pgmap v5424: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:20.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:49:19 gibba015 bash[30343]: cluster 2021-03-10T16:49:18.839251+0000 mgr.gibba045.orlgmj (mgr.34412) 9522 : cluster [DBG] pgmap v5424: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:20.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:49:19 gibba045 bash[25517]: cluster 2021-03-10T16:49:18.839251+0000 mgr.gibba045.orlgmj (mgr.34412) 9522 : cluster [DBG] pgmap v5424: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:22.218 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:49:21 gibba015 bash[29377]: cluster 2021-03-10T16:49:20.841017+0000 mgr.gibba045.orlgmj (mgr.34412) 9523 : cluster [DBG] pgmap v5425: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:22.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:49:21 gibba015 bash[30343]: cluster 2021-03-10T16:49:20.841017+0000 mgr.gibba045.orlgmj (mgr.34412) 9523 : cluster [DBG] pgmap v5425: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:22.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:49:21 gibba045 bash[25517]: cluster 2021-03-10T16:49:20.841017+0000 mgr.gibba045.orlgmj (mgr.34412) 9523 : cluster [DBG] pgmap v5425: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:24.167 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:49:24.218 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:49:23 gibba015 bash[29377]: cluster 2021-03-10T16:49:22.842609+0000 mgr.gibba045.orlgmj (mgr.34412) 9524 : cluster [DBG] pgmap v5426: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:24.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:49:23 gibba015 bash[30343]: cluster 2021-03-10T16:49:22.842609+0000 mgr.gibba045.orlgmj (mgr.34412) 9524 : cluster [DBG] pgmap v5426: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:24.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:49:23 gibba045 bash[25517]: cluster 2021-03-10T16:49:22.842609+0000 mgr.gibba045.orlgmj (mgr.34412) 9524 : cluster [DBG] pgmap v5426: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:24.393 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:49:24.393 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 2m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:49:24.394 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 92s ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:49:24.394 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 92s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:49:24.395 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 92s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:49:24.395 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (2h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:49:24.395 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (2h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:49:24.396 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 92s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:49:24.396 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:49:24.396 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 2m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:49:24.396 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 92s ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:49:24.397 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:49:24.397 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:49:24.397 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:49:24.397 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:49:24.397 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 92s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:49:24.398 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 92s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:49:24.398 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 92s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:49:24.398 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 92s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:49:24.398 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 92s ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:49:24.399 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 92s ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:49:24.646 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:49:24.646 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:49:24.647 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:49:24.647 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:49:24.647 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:49:24.647 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:49:24.648 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:49:24.648 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:49:24.648 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:49:24.649 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:49:24.649 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:49:24.649 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:49:24.650 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:49:24.650 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:49:24.650 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:49:25.218 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:49:24 gibba015 bash[29377]: audit 2021-03-10T16:49:24.647589+0000 mon.c (mon.1) 2625 : audit [DBG] from='client.? 172.21.2.115:0/3192331069' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:49:25.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:49:24 gibba015 bash[30343]: audit 2021-03-10T16:49:24.647589+0000 mon.c (mon.1) 2625 : audit [DBG] from='client.? 172.21.2.115:0/3192331069' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:49:25.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:49:24 gibba045 bash[25517]: audit 2021-03-10T16:49:24.647589+0000 mon.c (mon.1) 2625 : audit [DBG] from='client.? 172.21.2.115:0/3192331069' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:49:26.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:49:25 gibba015 bash[29377]: audit 2021-03-10T16:49:24.162266+0000 mgr.gibba045.orlgmj (mgr.34412) 9525 : audit [DBG] from='client.60430 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:49:26.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:49:25 gibba015 bash[29377]: audit 2021-03-10T16:49:24.383869+0000 mgr.gibba045.orlgmj (mgr.34412) 9526 : audit [DBG] from='client.60436 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:49:26.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:49:25 gibba015 bash[29377]: cluster 2021-03-10T16:49:24.844248+0000 mgr.gibba045.orlgmj (mgr.34412) 9527 : cluster [DBG] pgmap v5427: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:26.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:49:25 gibba015 bash[30343]: audit 2021-03-10T16:49:24.162266+0000 mgr.gibba045.orlgmj (mgr.34412) 9525 : audit [DBG] from='client.60430 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:49:26.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:49:25 gibba015 bash[30343]: audit 2021-03-10T16:49:24.383869+0000 mgr.gibba045.orlgmj (mgr.34412) 9526 : audit [DBG] from='client.60436 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:49:26.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:49:25 gibba015 bash[30343]: cluster 2021-03-10T16:49:24.844248+0000 mgr.gibba045.orlgmj (mgr.34412) 9527 : cluster [DBG] pgmap v5427: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:26.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:49:25 gibba045 bash[25517]: audit 2021-03-10T16:49:24.162266+0000 mgr.gibba045.orlgmj (mgr.34412) 9525 : audit [DBG] from='client.60430 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:49:26.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:49:25 gibba045 bash[25517]: audit 2021-03-10T16:49:24.383869+0000 mgr.gibba045.orlgmj (mgr.34412) 9526 : audit [DBG] from='client.60436 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:49:26.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:49:25 gibba045 bash[25517]: cluster 2021-03-10T16:49:24.844248+0000 mgr.gibba045.orlgmj (mgr.34412) 9527 : cluster [DBG] pgmap v5427: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:28.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:49:27 gibba045 bash[25517]: cluster 2021-03-10T16:49:26.845975+0000 mgr.gibba045.orlgmj (mgr.34412) 9528 : cluster [DBG] pgmap v5428: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:28.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:49:27 gibba015 bash[29377]: cluster 2021-03-10T16:49:26.845975+0000 mgr.gibba045.orlgmj (mgr.34412) 9528 : cluster [DBG] pgmap v5428: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:28.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:49:27 gibba015 bash[30343]: cluster 2021-03-10T16:49:26.845975+0000 mgr.gibba045.orlgmj (mgr.34412) 9528 : cluster [DBG] pgmap v5428: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:29.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:49:28 gibba045 bash[25517]: cephadm 2021-03-10T16:49:27.829362+0000 mgr.gibba045.orlgmj (mgr.34412) 9529 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:49:29.218 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:49:28 gibba015 bash[29377]: cephadm 2021-03-10T16:49:27.829362+0000 mgr.gibba045.orlgmj (mgr.34412) 9529 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:49:29.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:49:28 gibba015 bash[30343]: cephadm 2021-03-10T16:49:27.829362+0000 mgr.gibba045.orlgmj (mgr.34412) 9529 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:49:30.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:49:29 gibba045 bash[25517]: cluster 2021-03-10T16:49:28.846561+0000 mgr.gibba045.orlgmj (mgr.34412) 9530 : cluster [DBG] pgmap v5429: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:30.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:49:29 gibba015 bash[29377]: cluster 2021-03-10T16:49:28.846561+0000 mgr.gibba045.orlgmj (mgr.34412) 9530 : cluster [DBG] pgmap v5429: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:30.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:49:29 gibba015 bash[30343]: cluster 2021-03-10T16:49:28.846561+0000 mgr.gibba045.orlgmj (mgr.34412) 9530 : cluster [DBG] pgmap v5429: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:32.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:49:31 gibba015 bash[29377]: cluster 2021-03-10T16:49:30.848187+0000 mgr.gibba045.orlgmj (mgr.34412) 9531 : cluster [DBG] pgmap v5430: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:32.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:49:31 gibba015 bash[30343]: cluster 2021-03-10T16:49:30.848187+0000 mgr.gibba045.orlgmj (mgr.34412) 9531 : cluster [DBG] pgmap v5430: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:32.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:49:31 gibba045 bash[25517]: cluster 2021-03-10T16:49:30.848187+0000 mgr.gibba045.orlgmj (mgr.34412) 9531 : cluster [DBG] pgmap v5430: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:34.218 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:49:33 gibba015 bash[29377]: cluster 2021-03-10T16:49:32.849714+0000 mgr.gibba045.orlgmj (mgr.34412) 9532 : cluster [DBG] pgmap v5431: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:34.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:49:33 gibba015 bash[30343]: cluster 2021-03-10T16:49:32.849714+0000 mgr.gibba045.orlgmj (mgr.34412) 9532 : cluster [DBG] pgmap v5431: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:34.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:49:33 gibba045 bash[25517]: cluster 2021-03-10T16:49:32.849714+0000 mgr.gibba045.orlgmj (mgr.34412) 9532 : cluster [DBG] pgmap v5431: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:36.218 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:49:35 gibba015 bash[29377]: cluster 2021-03-10T16:49:34.851246+0000 mgr.gibba045.orlgmj (mgr.34412) 9533 : cluster [DBG] pgmap v5432: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:36.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:49:35 gibba015 bash[30343]: cluster 2021-03-10T16:49:34.851246+0000 mgr.gibba045.orlgmj (mgr.34412) 9533 : cluster [DBG] pgmap v5432: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:36.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:49:35 gibba045 bash[25517]: cluster 2021-03-10T16:49:34.851246+0000 mgr.gibba045.orlgmj (mgr.34412) 9533 : cluster [DBG] pgmap v5432: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:38.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:49:37 gibba045 bash[25517]: cluster 2021-03-10T16:49:36.852761+0000 mgr.gibba045.orlgmj (mgr.34412) 9534 : cluster [DBG] pgmap v5433: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:38.218 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:49:37 gibba015 bash[29377]: cluster 2021-03-10T16:49:36.852761+0000 mgr.gibba045.orlgmj (mgr.34412) 9534 : cluster [DBG] pgmap v5433: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:38.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:49:37 gibba015 bash[30343]: cluster 2021-03-10T16:49:36.852761+0000 mgr.gibba045.orlgmj (mgr.34412) 9534 : cluster [DBG] pgmap v5433: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:40.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:49:39 gibba015 bash[29377]: cluster 2021-03-10T16:49:38.853872+0000 mgr.gibba045.orlgmj (mgr.34412) 9535 : cluster [DBG] pgmap v5434: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:40.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:49:39 gibba015 bash[30343]: cluster 2021-03-10T16:49:38.853872+0000 mgr.gibba045.orlgmj (mgr.34412) 9535 : cluster [DBG] pgmap v5434: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:40.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:49:39 gibba045 bash[25517]: cluster 2021-03-10T16:49:38.853872+0000 mgr.gibba045.orlgmj (mgr.34412) 9535 : cluster [DBG] pgmap v5434: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:42.218 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:49:41 gibba015 bash[29377]: cluster 2021-03-10T16:49:40.855471+0000 mgr.gibba045.orlgmj (mgr.34412) 9536 : cluster [DBG] pgmap v5435: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:42.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:49:41 gibba015 bash[30343]: cluster 2021-03-10T16:49:40.855471+0000 mgr.gibba045.orlgmj (mgr.34412) 9536 : cluster [DBG] pgmap v5435: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:42.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:49:41 gibba045 bash[25517]: cluster 2021-03-10T16:49:40.855471+0000 mgr.gibba045.orlgmj (mgr.34412) 9536 : cluster [DBG] pgmap v5435: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:44.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:49:43 gibba015 bash[29377]: cephadm 2021-03-10T16:49:42.845303+0000 mgr.gibba045.orlgmj (mgr.34412) 9537 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:49:44.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:49:43 gibba015 bash[29377]: cluster 2021-03-10T16:49:42.856908+0000 mgr.gibba045.orlgmj (mgr.34412) 9538 : cluster [DBG] pgmap v5436: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:44.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:49:43 gibba015 bash[30343]: cephadm 2021-03-10T16:49:42.845303+0000 mgr.gibba045.orlgmj (mgr.34412) 9537 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:49:44.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:49:43 gibba015 bash[30343]: cluster 2021-03-10T16:49:42.856908+0000 mgr.gibba045.orlgmj (mgr.34412) 9538 : cluster [DBG] pgmap v5436: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:44.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:49:43 gibba045 bash[25517]: cephadm 2021-03-10T16:49:42.845303+0000 mgr.gibba045.orlgmj (mgr.34412) 9537 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:49:44.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:49:43 gibba045 bash[25517]: cluster 2021-03-10T16:49:42.856908+0000 mgr.gibba045.orlgmj (mgr.34412) 9538 : cluster [DBG] pgmap v5436: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:46.218 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:49:45 gibba015 bash[29377]: cluster 2021-03-10T16:49:44.858659+0000 mgr.gibba045.orlgmj (mgr.34412) 9539 : cluster [DBG] pgmap v5437: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:46.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:49:45 gibba015 bash[30343]: cluster 2021-03-10T16:49:44.858659+0000 mgr.gibba045.orlgmj (mgr.34412) 9539 : cluster [DBG] pgmap v5437: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:46.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:49:45 gibba045 bash[25517]: cluster 2021-03-10T16:49:44.858659+0000 mgr.gibba045.orlgmj (mgr.34412) 9539 : cluster [DBG] pgmap v5437: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:48.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:49:47 gibba045 bash[25517]: cluster 2021-03-10T16:49:46.860257+0000 mgr.gibba045.orlgmj (mgr.34412) 9540 : cluster [DBG] pgmap v5438: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:48.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:49:47 gibba015 bash[29377]: cluster 2021-03-10T16:49:46.860257+0000 mgr.gibba045.orlgmj (mgr.34412) 9540 : cluster [DBG] pgmap v5438: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:48.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:49:47 gibba015 bash[30343]: cluster 2021-03-10T16:49:46.860257+0000 mgr.gibba045.orlgmj (mgr.34412) 9540 : cluster [DBG] pgmap v5438: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:50.218 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:49:49 gibba015 bash[29377]: cluster 2021-03-10T16:49:48.861485+0000 mgr.gibba045.orlgmj (mgr.34412) 9541 : cluster [DBG] pgmap v5439: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:50.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:49:49 gibba015 bash[30343]: cluster 2021-03-10T16:49:48.861485+0000 mgr.gibba045.orlgmj (mgr.34412) 9541 : cluster [DBG] pgmap v5439: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:50.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:49:49 gibba045 bash[25517]: cluster 2021-03-10T16:49:48.861485+0000 mgr.gibba045.orlgmj (mgr.34412) 9541 : cluster [DBG] pgmap v5439: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:52.218 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:49:51 gibba015 bash[29377]: cluster 2021-03-10T16:49:50.863196+0000 mgr.gibba045.orlgmj (mgr.34412) 9542 : cluster [DBG] pgmap v5440: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:52.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:49:51 gibba015 bash[30343]: cluster 2021-03-10T16:49:50.863196+0000 mgr.gibba045.orlgmj (mgr.34412) 9542 : cluster [DBG] pgmap v5440: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:52.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:49:51 gibba045 bash[25517]: cluster 2021-03-10T16:49:50.863196+0000 mgr.gibba045.orlgmj (mgr.34412) 9542 : cluster [DBG] pgmap v5440: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:54.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:49:53 gibba015 bash[29377]: cluster 2021-03-10T16:49:52.864771+0000 mgr.gibba045.orlgmj (mgr.34412) 9543 : cluster [DBG] pgmap v5441: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:54.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:49:53 gibba015 bash[29377]: audit 2021-03-10T16:49:53.751718+0000 mon.c (mon.1) 2626 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:49:54.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:49:53 gibba015 bash[29377]: audit 2021-03-10T16:49:53.752530+0000 mon.c (mon.1) 2627 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:49:54.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:49:53 gibba015 bash[29377]: audit 2021-03-10T16:49:53.752807+0000 mon.a (mon.0) 2087 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:49:54.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:49:53 gibba015 bash[29377]: audit 2021-03-10T16:49:53.753953+0000 mon.a (mon.0) 2088 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:49:54.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:49:53 gibba015 bash[29377]: audit 2021-03-10T16:49:53.767494+0000 mon.c (mon.1) 2628 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T16:49:54.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:49:53 gibba015 bash[29377]: audit 2021-03-10T16:49:53.768350+0000 mon.c (mon.1) 2629 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:49:54.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:49:53 gibba015 bash[29377]: audit 2021-03-10T16:49:53.768603+0000 mon.a (mon.0) 2089 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T16:49:54.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:49:53 gibba015 bash[29377]: audit 2021-03-10T16:49:53.769292+0000 mon.c (mon.1) 2630 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 5]}]: dispatch 2021-03-10T16:49:54.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:49:53 gibba015 bash[29377]: audit 2021-03-10T16:49:53.769802+0000 mon.a (mon.0) 2090 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:49:54.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:49:53 gibba015 bash[29377]: audit 2021-03-10T16:49:53.770376+0000 mon.c (mon.1) 2631 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T16:49:54.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:49:53 gibba015 bash[29377]: audit 2021-03-10T16:49:53.770609+0000 mon.a (mon.0) 2091 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 5]}]: dispatch 2021-03-10T16:49:54.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:49:53 gibba015 bash[29377]: audit 2021-03-10T16:49:53.771796+0000 mon.a (mon.0) 2092 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T16:49:54.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:49:53 gibba015 bash[30343]: cluster 2021-03-10T16:49:52.864771+0000 mgr.gibba045.orlgmj (mgr.34412) 9543 : cluster [DBG] pgmap v5441: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:54.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:49:53 gibba015 bash[30343]: audit 2021-03-10T16:49:53.751718+0000 mon.c (mon.1) 2626 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:49:54.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:49:53 gibba015 bash[30343]: audit 2021-03-10T16:49:53.752530+0000 mon.c (mon.1) 2627 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:49:54.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:49:53 gibba015 bash[30343]: audit 2021-03-10T16:49:53.752807+0000 mon.a (mon.0) 2087 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:49:54.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:49:53 gibba015 bash[30343]: audit 2021-03-10T16:49:53.753953+0000 mon.a (mon.0) 2088 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:49:54.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:49:53 gibba015 bash[30343]: audit 2021-03-10T16:49:53.767494+0000 mon.c (mon.1) 2628 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T16:49:54.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:49:53 gibba015 bash[30343]: audit 2021-03-10T16:49:53.768350+0000 mon.c (mon.1) 2629 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:49:54.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:49:53 gibba015 bash[30343]: audit 2021-03-10T16:49:53.768603+0000 mon.a (mon.0) 2089 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T16:49:54.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:49:53 gibba015 bash[30343]: audit 2021-03-10T16:49:53.769292+0000 mon.c (mon.1) 2630 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 5]}]: dispatch 2021-03-10T16:49:54.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:49:53 gibba015 bash[30343]: audit 2021-03-10T16:49:53.769802+0000 mon.a (mon.0) 2090 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:49:54.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:49:53 gibba015 bash[30343]: audit 2021-03-10T16:49:53.770376+0000 mon.c (mon.1) 2631 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T16:49:54.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:49:53 gibba015 bash[30343]: audit 2021-03-10T16:49:53.770609+0000 mon.a (mon.0) 2091 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 5]}]: dispatch 2021-03-10T16:49:54.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:49:53 gibba015 bash[30343]: audit 2021-03-10T16:49:53.771796+0000 mon.a (mon.0) 2092 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T16:49:54.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:49:53 gibba045 bash[25517]: cluster 2021-03-10T16:49:52.864771+0000 mgr.gibba045.orlgmj (mgr.34412) 9543 : cluster [DBG] pgmap v5441: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:54.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:49:53 gibba045 bash[25517]: audit 2021-03-10T16:49:53.751718+0000 mon.c (mon.1) 2626 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:49:54.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:49:53 gibba045 bash[25517]: audit 2021-03-10T16:49:53.752530+0000 mon.c (mon.1) 2627 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:49:54.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:49:53 gibba045 bash[25517]: audit 2021-03-10T16:49:53.752807+0000 mon.a (mon.0) 2087 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:49:54.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:49:53 gibba045 bash[25517]: audit 2021-03-10T16:49:53.753953+0000 mon.a (mon.0) 2088 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:49:54.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:49:53 gibba045 bash[25517]: audit 2021-03-10T16:49:53.767494+0000 mon.c (mon.1) 2628 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T16:49:54.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:49:53 gibba045 bash[25517]: audit 2021-03-10T16:49:53.768350+0000 mon.c (mon.1) 2629 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:49:54.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:49:53 gibba045 bash[25517]: audit 2021-03-10T16:49:53.768603+0000 mon.a (mon.0) 2089 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T16:49:54.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:49:53 gibba045 bash[25517]: audit 2021-03-10T16:49:53.769292+0000 mon.c (mon.1) 2630 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 5]}]: dispatch 2021-03-10T16:49:54.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:49:53 gibba045 bash[25517]: audit 2021-03-10T16:49:53.769802+0000 mon.a (mon.0) 2090 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:49:54.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:49:53 gibba045 bash[25517]: audit 2021-03-10T16:49:53.770376+0000 mon.c (mon.1) 2631 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T16:49:54.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:49:53 gibba045 bash[25517]: audit 2021-03-10T16:49:53.770609+0000 mon.a (mon.0) 2091 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 5]}]: dispatch 2021-03-10T16:49:54.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:49:53 gibba045 bash[25517]: audit 2021-03-10T16:49:53.771796+0000 mon.a (mon.0) 2092 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T16:49:54.889 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:49:55.119 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:49:55.120 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 3m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:49:55.120 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 2m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:49:55.120 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:49:55.120 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:49:55.121 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:49:55.121 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:49:55.121 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (2h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:49:55.121 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:49:55.122 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 3m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:49:55.122 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 2m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:49:55.122 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:49:55.122 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:49:55.123 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:49:55.123 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:49:55.123 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:49:55.124 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:49:55.124 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:49:55.124 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:49:55.124 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 2m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:49:55.125 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 2m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:49:55.365 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:49:55.366 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:49:55.366 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:49:55.366 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:49:55.367 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:49:55.367 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:49:55.367 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:49:55.367 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:49:55.367 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:49:55.368 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:49:55.368 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:49:55.368 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:49:55.368 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:49:55.368 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:49:55.369 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:49:56.218 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:49:55 gibba015 bash[29377]: cluster 2021-03-10T16:49:54.866420+0000 mgr.gibba045.orlgmj (mgr.34412) 9544 : cluster [DBG] pgmap v5442: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:56.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:49:55 gibba015 bash[29377]: audit 2021-03-10T16:49:54.884025+0000 mgr.gibba045.orlgmj (mgr.34412) 9545 : audit [DBG] from='client.50460 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:49:56.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:49:55 gibba015 bash[29377]: audit 2021-03-10T16:49:55.367248+0000 mon.a (mon.0) 2093 : audit [DBG] from='client.? 172.21.2.115:0/1162913987' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:49:56.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:49:55 gibba015 bash[30343]: cluster 2021-03-10T16:49:54.866420+0000 mgr.gibba045.orlgmj (mgr.34412) 9544 : cluster [DBG] pgmap v5442: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:56.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:49:55 gibba015 bash[30343]: audit 2021-03-10T16:49:54.884025+0000 mgr.gibba045.orlgmj (mgr.34412) 9545 : audit [DBG] from='client.50460 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:49:56.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:49:55 gibba015 bash[30343]: audit 2021-03-10T16:49:55.367248+0000 mon.a (mon.0) 2093 : audit [DBG] from='client.? 172.21.2.115:0/1162913987' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:49:56.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:49:55 gibba045 bash[25517]: cluster 2021-03-10T16:49:54.866420+0000 mgr.gibba045.orlgmj (mgr.34412) 9544 : cluster [DBG] pgmap v5442: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:56.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:49:55 gibba045 bash[25517]: audit 2021-03-10T16:49:54.884025+0000 mgr.gibba045.orlgmj (mgr.34412) 9545 : audit [DBG] from='client.50460 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:49:56.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:49:55 gibba045 bash[25517]: audit 2021-03-10T16:49:55.367248+0000 mon.a (mon.0) 2093 : audit [DBG] from='client.? 172.21.2.115:0/1162913987' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:49:57.218 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:49:56 gibba015 bash[29377]: audit 2021-03-10T16:49:55.110539+0000 mgr.gibba045.orlgmj (mgr.34412) 9546 : audit [DBG] from='client.60454 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:49:57.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:49:56 gibba015 bash[30343]: audit 2021-03-10T16:49:55.110539+0000 mgr.gibba045.orlgmj (mgr.34412) 9546 : audit [DBG] from='client.60454 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:49:57.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:49:56 gibba045 bash[25517]: audit 2021-03-10T16:49:55.110539+0000 mgr.gibba045.orlgmj (mgr.34412) 9546 : audit [DBG] from='client.60454 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:49:58.218 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:49:57 gibba015 bash[29377]: cluster 2021-03-10T16:49:56.868048+0000 mgr.gibba045.orlgmj (mgr.34412) 9547 : cluster [DBG] pgmap v5443: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:58.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:49:57 gibba015 bash[29377]: audit 2021-03-10T16:49:57.860020+0000 mon.c (mon.1) 2632 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:49:58.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:49:57 gibba015 bash[30343]: cluster 2021-03-10T16:49:56.868048+0000 mgr.gibba045.orlgmj (mgr.34412) 9547 : cluster [DBG] pgmap v5443: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:58.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:49:57 gibba015 bash[30343]: audit 2021-03-10T16:49:57.860020+0000 mon.c (mon.1) 2632 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:49:58.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:49:57 gibba045 bash[25517]: cluster 2021-03-10T16:49:56.868048+0000 mgr.gibba045.orlgmj (mgr.34412) 9547 : cluster [DBG] pgmap v5443: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:58.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:49:57 gibba045 bash[25517]: audit 2021-03-10T16:49:57.860020+0000 mon.c (mon.1) 2632 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:49:59.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:49:58 gibba015 bash[29377]: cephadm 2021-03-10T16:49:57.868218+0000 mgr.gibba045.orlgmj (mgr.34412) 9548 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:49:59.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:49:58 gibba015 bash[29377]: cephadm 2021-03-10T16:49:57.869839+0000 mgr.gibba045.orlgmj (mgr.34412) 9549 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:49:59.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:49:58 gibba015 bash[29377]: audit 2021-03-10T16:49:58.092971+0000 mon.a (mon.0) 2094 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:49:59.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:49:58 gibba015 bash[29377]: audit 2021-03-10T16:49:58.096623+0000 mon.c (mon.1) 2633 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:49:59.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:49:58 gibba015 bash[29377]: audit 2021-03-10T16:49:58.097970+0000 mon.c (mon.1) 2634 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:49:59.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:49:58 gibba015 bash[29377]: audit 2021-03-10T16:49:58.099591+0000 mon.c (mon.1) 2635 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:49:59.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:49:58 gibba015 bash[29377]: audit 2021-03-10T16:49:58.100947+0000 mon.c (mon.1) 2636 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:49:59.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:49:58 gibba015 bash[29377]: audit 2021-03-10T16:49:58.104231+0000 mon.c (mon.1) 2637 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:49:59.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:49:58 gibba015 bash[29377]: audit 2021-03-10T16:49:58.106115+0000 mon.c (mon.1) 2638 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:49:59.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:49:58 gibba015 bash[30343]: cephadm 2021-03-10T16:49:57.868218+0000 mgr.gibba045.orlgmj (mgr.34412) 9548 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:49:59.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:49:58 gibba015 bash[30343]: cephadm 2021-03-10T16:49:57.869839+0000 mgr.gibba045.orlgmj (mgr.34412) 9549 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:49:59.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:49:58 gibba015 bash[30343]: audit 2021-03-10T16:49:58.092971+0000 mon.a (mon.0) 2094 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:49:59.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:49:58 gibba015 bash[30343]: audit 2021-03-10T16:49:58.096623+0000 mon.c (mon.1) 2633 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:49:59.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:49:58 gibba015 bash[30343]: audit 2021-03-10T16:49:58.097970+0000 mon.c (mon.1) 2634 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:49:59.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:49:58 gibba015 bash[30343]: audit 2021-03-10T16:49:58.099591+0000 mon.c (mon.1) 2635 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:49:59.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:49:58 gibba015 bash[30343]: audit 2021-03-10T16:49:58.100947+0000 mon.c (mon.1) 2636 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:49:59.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:49:58 gibba015 bash[30343]: audit 2021-03-10T16:49:58.104231+0000 mon.c (mon.1) 2637 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:49:59.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:49:58 gibba015 bash[30343]: audit 2021-03-10T16:49:58.106115+0000 mon.c (mon.1) 2638 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:49:59.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:49:58 gibba045 bash[25517]: cephadm 2021-03-10T16:49:57.868218+0000 mgr.gibba045.orlgmj (mgr.34412) 9548 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:49:59.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:49:58 gibba045 bash[25517]: cephadm 2021-03-10T16:49:57.869839+0000 mgr.gibba045.orlgmj (mgr.34412) 9549 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:49:59.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:49:58 gibba045 bash[25517]: audit 2021-03-10T16:49:58.092971+0000 mon.a (mon.0) 2094 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:49:59.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:49:58 gibba045 bash[25517]: audit 2021-03-10T16:49:58.096623+0000 mon.c (mon.1) 2633 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:49:59.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:49:58 gibba045 bash[25517]: audit 2021-03-10T16:49:58.097970+0000 mon.c (mon.1) 2634 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:49:59.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:49:58 gibba045 bash[25517]: audit 2021-03-10T16:49:58.099591+0000 mon.c (mon.1) 2635 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:49:59.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:49:58 gibba045 bash[25517]: audit 2021-03-10T16:49:58.100947+0000 mon.c (mon.1) 2636 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:49:59.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:49:58 gibba045 bash[25517]: audit 2021-03-10T16:49:58.104231+0000 mon.c (mon.1) 2637 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:49:59.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:49:58 gibba045 bash[25517]: audit 2021-03-10T16:49:58.106115+0000 mon.c (mon.1) 2638 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:50:00.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:49:59 gibba015 bash[29377]: cephadm 2021-03-10T16:49:58.098026+0000 mgr.gibba045.orlgmj (mgr.34412) 9550 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:50:00.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:49:59 gibba015 bash[29377]: cephadm 2021-03-10T16:49:58.099787+0000 mgr.gibba045.orlgmj (mgr.34412) 9551 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:50:00.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:49:59 gibba015 bash[29377]: cephadm 2021-03-10T16:49:58.101307+0000 mgr.gibba045.orlgmj (mgr.34412) 9552 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:50:00.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:49:59 gibba015 bash[29377]: cephadm 2021-03-10T16:49:58.101344+0000 mgr.gibba045.orlgmj (mgr.34412) 9553 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:50:00.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:49:59 gibba015 bash[29377]: cephadm 2021-03-10T16:49:58.102722+0000 mgr.gibba045.orlgmj (mgr.34412) 9554 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:50:00.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:49:59 gibba015 bash[29377]: cephadm 2021-03-10T16:49:58.102826+0000 mgr.gibba045.orlgmj (mgr.34412) 9555 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:50:00.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:49:59 gibba015 bash[29377]: cephadm 2021-03-10T16:49:58.104123+0000 mgr.gibba045.orlgmj (mgr.34412) 9556 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:50:00.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:49:59 gibba015 bash[29377]: cephadm 2021-03-10T16:49:58.105829+0000 mgr.gibba045.orlgmj (mgr.34412) 9557 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:50:00.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:49:59 gibba015 bash[29377]: cephadm 2021-03-10T16:49:58.105952+0000 mgr.gibba045.orlgmj (mgr.34412) 9558 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:50:00.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:49:59 gibba015 bash[29377]: cephadm 2021-03-10T16:49:58.107520+0000 mgr.gibba045.orlgmj (mgr.34412) 9559 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:50:00.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:49:59 gibba015 bash[29377]: cephadm 2021-03-10T16:49:58.107955+0000 mgr.gibba045.orlgmj (mgr.34412) 9560 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:50:00.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:49:59 gibba015 bash[29377]: cephadm 2021-03-10T16:49:58.109266+0000 mgr.gibba045.orlgmj (mgr.34412) 9561 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:50:00.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:49:59 gibba015 bash[29377]: cephadm 2021-03-10T16:49:58.109302+0000 mgr.gibba045.orlgmj (mgr.34412) 9562 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:50:00.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:49:59 gibba015 bash[29377]: cephadm 2021-03-10T16:49:58.109407+0000 mgr.gibba045.orlgmj (mgr.34412) 9563 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:50:00.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:49:59 gibba015 bash[29377]: cluster 2021-03-10T16:49:58.869140+0000 mgr.gibba045.orlgmj (mgr.34412) 9564 : cluster [DBG] pgmap v5444: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:00.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:50:00 gibba015 bash[29377]: debug 2021-03-10T16:49:59.993+0000 7f21beb4f700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T16:50:00.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:49:59 gibba015 bash[30343]: cephadm 2021-03-10T16:49:58.098026+0000 mgr.gibba045.orlgmj (mgr.34412) 9550 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:50:00.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:49:59 gibba015 bash[30343]: cephadm 2021-03-10T16:49:58.099787+0000 mgr.gibba045.orlgmj (mgr.34412) 9551 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:50:00.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:49:59 gibba015 bash[30343]: cephadm 2021-03-10T16:49:58.101307+0000 mgr.gibba045.orlgmj (mgr.34412) 9552 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:50:00.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:49:59 gibba015 bash[30343]: cephadm 2021-03-10T16:49:58.101344+0000 mgr.gibba045.orlgmj (mgr.34412) 9553 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:50:00.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:49:59 gibba015 bash[30343]: cephadm 2021-03-10T16:49:58.102722+0000 mgr.gibba045.orlgmj (mgr.34412) 9554 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:50:00.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:49:59 gibba015 bash[30343]: cephadm 2021-03-10T16:49:58.102826+0000 mgr.gibba045.orlgmj (mgr.34412) 9555 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:50:00.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:49:59 gibba015 bash[30343]: cephadm 2021-03-10T16:49:58.104123+0000 mgr.gibba045.orlgmj (mgr.34412) 9556 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:50:00.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:49:59 gibba015 bash[30343]: cephadm 2021-03-10T16:49:58.105829+0000 mgr.gibba045.orlgmj (mgr.34412) 9557 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:50:00.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:49:59 gibba015 bash[30343]: cephadm 2021-03-10T16:49:58.105952+0000 mgr.gibba045.orlgmj (mgr.34412) 9558 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:50:00.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:49:59 gibba015 bash[30343]: cephadm 2021-03-10T16:49:58.107520+0000 mgr.gibba045.orlgmj (mgr.34412) 9559 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:50:00.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:49:59 gibba015 bash[30343]: cephadm 2021-03-10T16:49:58.107955+0000 mgr.gibba045.orlgmj (mgr.34412) 9560 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:50:00.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:49:59 gibba015 bash[30343]: cephadm 2021-03-10T16:49:58.109266+0000 mgr.gibba045.orlgmj (mgr.34412) 9561 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:50:00.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:49:59 gibba015 bash[30343]: cephadm 2021-03-10T16:49:58.109302+0000 mgr.gibba045.orlgmj (mgr.34412) 9562 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:50:00.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:49:59 gibba015 bash[30343]: cephadm 2021-03-10T16:49:58.109407+0000 mgr.gibba045.orlgmj (mgr.34412) 9563 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:50:00.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:49:59 gibba015 bash[30343]: cluster 2021-03-10T16:49:58.869140+0000 mgr.gibba045.orlgmj (mgr.34412) 9564 : cluster [DBG] pgmap v5444: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:00.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:49:59 gibba045 bash[25517]: cephadm 2021-03-10T16:49:58.098026+0000 mgr.gibba045.orlgmj (mgr.34412) 9550 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:50:00.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:49:59 gibba045 bash[25517]: cephadm 2021-03-10T16:49:58.099787+0000 mgr.gibba045.orlgmj (mgr.34412) 9551 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:50:00.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:49:59 gibba045 bash[25517]: cephadm 2021-03-10T16:49:58.101307+0000 mgr.gibba045.orlgmj (mgr.34412) 9552 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:50:00.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:49:59 gibba045 bash[25517]: cephadm 2021-03-10T16:49:58.101344+0000 mgr.gibba045.orlgmj (mgr.34412) 9553 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:50:00.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:49:59 gibba045 bash[25517]: cephadm 2021-03-10T16:49:58.102722+0000 mgr.gibba045.orlgmj (mgr.34412) 9554 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:50:00.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:49:59 gibba045 bash[25517]: cephadm 2021-03-10T16:49:58.102826+0000 mgr.gibba045.orlgmj (mgr.34412) 9555 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:50:00.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:49:59 gibba045 bash[25517]: cephadm 2021-03-10T16:49:58.104123+0000 mgr.gibba045.orlgmj (mgr.34412) 9556 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:50:00.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:49:59 gibba045 bash[25517]: cephadm 2021-03-10T16:49:58.105829+0000 mgr.gibba045.orlgmj (mgr.34412) 9557 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:50:00.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:49:59 gibba045 bash[25517]: cephadm 2021-03-10T16:49:58.105952+0000 mgr.gibba045.orlgmj (mgr.34412) 9558 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:50:00.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:49:59 gibba045 bash[25517]: cephadm 2021-03-10T16:49:58.107520+0000 mgr.gibba045.orlgmj (mgr.34412) 9559 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:50:00.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:49:59 gibba045 bash[25517]: cephadm 2021-03-10T16:49:58.107955+0000 mgr.gibba045.orlgmj (mgr.34412) 9560 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:50:00.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:49:59 gibba045 bash[25517]: cephadm 2021-03-10T16:49:58.109266+0000 mgr.gibba045.orlgmj (mgr.34412) 9561 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:50:00.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:49:59 gibba045 bash[25517]: cephadm 2021-03-10T16:49:58.109302+0000 mgr.gibba045.orlgmj (mgr.34412) 9562 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:50:00.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:49:59 gibba045 bash[25517]: cephadm 2021-03-10T16:49:58.109407+0000 mgr.gibba045.orlgmj (mgr.34412) 9563 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:50:00.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:49:59 gibba045 bash[25517]: cluster 2021-03-10T16:49:58.869140+0000 mgr.gibba045.orlgmj (mgr.34412) 9564 : cluster [DBG] pgmap v5444: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:01.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:50:00 gibba015 bash[29377]: cluster 2021-03-10T16:50:00.000102+0000 mon.a (mon.0) 2095 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T16:50:01.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:50:00 gibba015 bash[30343]: cluster 2021-03-10T16:50:00.000102+0000 mon.a (mon.0) 2095 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T16:50:01.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:50:00 gibba045 bash[25517]: cluster 2021-03-10T16:50:00.000102+0000 mon.a (mon.0) 2095 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T16:50:02.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:50:01 gibba045 bash[25517]: cluster 2021-03-10T16:50:00.870862+0000 mgr.gibba045.orlgmj (mgr.34412) 9565 : cluster [DBG] pgmap v5445: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:02.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:50:01 gibba015 bash[29377]: cluster 2021-03-10T16:50:00.870862+0000 mgr.gibba045.orlgmj (mgr.34412) 9565 : cluster [DBG] pgmap v5445: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:02.469 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:50:01 gibba015 bash[30343]: cluster 2021-03-10T16:50:00.870862+0000 mgr.gibba045.orlgmj (mgr.34412) 9565 : cluster [DBG] pgmap v5445: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:04.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:50:03 gibba045 bash[25517]: cluster 2021-03-10T16:50:02.872405+0000 mgr.gibba045.orlgmj (mgr.34412) 9566 : cluster [DBG] pgmap v5446: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:04.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:50:03 gibba015 bash[29377]: cluster 2021-03-10T16:50:02.872405+0000 mgr.gibba045.orlgmj (mgr.34412) 9566 : cluster [DBG] pgmap v5446: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:04.469 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:50:03 gibba015 bash[30343]: cluster 2021-03-10T16:50:02.872405+0000 mgr.gibba045.orlgmj (mgr.34412) 9566 : cluster [DBG] pgmap v5446: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:05.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:50:05 gibba045 bash[25517]: cluster 2021-03-10T16:50:04.874040+0000 mgr.gibba045.orlgmj (mgr.34412) 9567 : cluster [DBG] pgmap v5447: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:05.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:50:05 gibba015 bash[29377]: cluster 2021-03-10T16:50:04.874040+0000 mgr.gibba045.orlgmj (mgr.34412) 9567 : cluster [DBG] pgmap v5447: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:05.469 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:50:05 gibba015 bash[30343]: cluster 2021-03-10T16:50:04.874040+0000 mgr.gibba045.orlgmj (mgr.34412) 9567 : cluster [DBG] pgmap v5447: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:08.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:50:07 gibba045 bash[25517]: cluster 2021-03-10T16:50:06.875833+0000 mgr.gibba045.orlgmj (mgr.34412) 9568 : cluster [DBG] pgmap v5448: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:08.218 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:50:07 gibba015 bash[29377]: cluster 2021-03-10T16:50:06.875833+0000 mgr.gibba045.orlgmj (mgr.34412) 9568 : cluster [DBG] pgmap v5448: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:08.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:50:07 gibba015 bash[30343]: cluster 2021-03-10T16:50:06.875833+0000 mgr.gibba045.orlgmj (mgr.34412) 9568 : cluster [DBG] pgmap v5448: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:10.218 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:50:09 gibba015 bash[29377]: cluster 2021-03-10T16:50:08.876584+0000 mgr.gibba045.orlgmj (mgr.34412) 9569 : cluster [DBG] pgmap v5449: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:10.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:50:09 gibba015 bash[30343]: cluster 2021-03-10T16:50:08.876584+0000 mgr.gibba045.orlgmj (mgr.34412) 9569 : cluster [DBG] pgmap v5449: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:10.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:50:09 gibba045 bash[25517]: cluster 2021-03-10T16:50:08.876584+0000 mgr.gibba045.orlgmj (mgr.34412) 9569 : cluster [DBG] pgmap v5449: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:12.218 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:50:11 gibba015 bash[29377]: cluster 2021-03-10T16:50:10.878135+0000 mgr.gibba045.orlgmj (mgr.34412) 9570 : cluster [DBG] pgmap v5450: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:12.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:50:11 gibba015 bash[30343]: cluster 2021-03-10T16:50:10.878135+0000 mgr.gibba045.orlgmj (mgr.34412) 9570 : cluster [DBG] pgmap v5450: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:12.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:50:11 gibba045 bash[25517]: cluster 2021-03-10T16:50:10.878135+0000 mgr.gibba045.orlgmj (mgr.34412) 9570 : cluster [DBG] pgmap v5450: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:14.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:50:13 gibba015 bash[29377]: cluster 2021-03-10T16:50:12.879660+0000 mgr.gibba045.orlgmj (mgr.34412) 9571 : cluster [DBG] pgmap v5451: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:14.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:50:13 gibba015 bash[30343]: cluster 2021-03-10T16:50:12.879660+0000 mgr.gibba045.orlgmj (mgr.34412) 9571 : cluster [DBG] pgmap v5451: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:14.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:50:13 gibba045 bash[25517]: cluster 2021-03-10T16:50:12.879660+0000 mgr.gibba045.orlgmj (mgr.34412) 9571 : cluster [DBG] pgmap v5451: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:15.218 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:50:14 gibba015 bash[29377]: cephadm 2021-03-10T16:50:13.125073+0000 mgr.gibba045.orlgmj (mgr.34412) 9572 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:50:15.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:50:14 gibba015 bash[30343]: cephadm 2021-03-10T16:50:13.125073+0000 mgr.gibba045.orlgmj (mgr.34412) 9572 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:50:15.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:50:14 gibba045 bash[25517]: cephadm 2021-03-10T16:50:13.125073+0000 mgr.gibba045.orlgmj (mgr.34412) 9572 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:50:16.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:50:15 gibba045 bash[25517]: cluster 2021-03-10T16:50:14.881269+0000 mgr.gibba045.orlgmj (mgr.34412) 9573 : cluster [DBG] pgmap v5452: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:16.468 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:50:15 gibba015 bash[29377]: cluster 2021-03-10T16:50:14.881269+0000 mgr.gibba045.orlgmj (mgr.34412) 9573 : cluster [DBG] pgmap v5452: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:16.469 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:50:15 gibba015 bash[30343]: cluster 2021-03-10T16:50:14.881269+0000 mgr.gibba045.orlgmj (mgr.34412) 9573 : cluster [DBG] pgmap v5452: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:18.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:50:17 gibba045 bash[25517]: cluster 2021-03-10T16:50:16.882786+0000 mgr.gibba045.orlgmj (mgr.34412) 9574 : cluster [DBG] pgmap v5453: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:18.218 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:50:17 gibba015 bash[29377]: cluster 2021-03-10T16:50:16.882786+0000 mgr.gibba045.orlgmj (mgr.34412) 9574 : cluster [DBG] pgmap v5453: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:18.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:50:17 gibba015 bash[30343]: cluster 2021-03-10T16:50:16.882786+0000 mgr.gibba045.orlgmj (mgr.34412) 9574 : cluster [DBG] pgmap v5453: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:20.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:50:19 gibba015 bash[29377]: cluster 2021-03-10T16:50:18.883865+0000 mgr.gibba045.orlgmj (mgr.34412) 9575 : cluster [DBG] pgmap v5454: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:20.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:50:19 gibba015 bash[30343]: cluster 2021-03-10T16:50:18.883865+0000 mgr.gibba045.orlgmj (mgr.34412) 9575 : cluster [DBG] pgmap v5454: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:20.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:50:19 gibba045 bash[25517]: cluster 2021-03-10T16:50:18.883865+0000 mgr.gibba045.orlgmj (mgr.34412) 9575 : cluster [DBG] pgmap v5454: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:22.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:50:21 gibba015 bash[29377]: cluster 2021-03-10T16:50:20.885561+0000 mgr.gibba045.orlgmj (mgr.34412) 9576 : cluster [DBG] pgmap v5455: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:22.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:50:21 gibba015 bash[30343]: cluster 2021-03-10T16:50:20.885561+0000 mgr.gibba045.orlgmj (mgr.34412) 9576 : cluster [DBG] pgmap v5455: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:22.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:50:21 gibba045 bash[25517]: cluster 2021-03-10T16:50:20.885561+0000 mgr.gibba045.orlgmj (mgr.34412) 9576 : cluster [DBG] pgmap v5455: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:24.218 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:50:23 gibba015 bash[30343]: cluster 2021-03-10T16:50:22.886926+0000 mgr.gibba045.orlgmj (mgr.34412) 9577 : cluster [DBG] pgmap v5456: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:24.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:50:23 gibba015 bash[29377]: cluster 2021-03-10T16:50:22.886926+0000 mgr.gibba045.orlgmj (mgr.34412) 9577 : cluster [DBG] pgmap v5456: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:24.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:50:23 gibba045 bash[25517]: cluster 2021-03-10T16:50:22.886926+0000 mgr.gibba045.orlgmj (mgr.34412) 9577 : cluster [DBG] pgmap v5456: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:25.609 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:50:25.835 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:50:25.836 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 3m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:50:25.836 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 2m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:50:25.836 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:50:25.837 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:50:25.837 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:50:25.838 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:50:25.838 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:50:25.839 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:50:25.839 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 3m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:50:25.839 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 2m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:50:25.839 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:50:25.840 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:50:25.840 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:50:25.840 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:50:25.840 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:50:25.841 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:50:25.841 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:50:25.841 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:50:25.841 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 2m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:50:25.841 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 2m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:50:26.085 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:50:26.085 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:50:26.085 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:50:26.086 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:50:26.086 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:50:26.086 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:50:26.086 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:50:26.087 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:50:26.087 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:50:26.087 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:50:26.087 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:50:26.088 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:50:26.088 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:50:26.088 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:50:26.088 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:50:26.218 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:50:25 gibba015 bash[29377]: cluster 2021-03-10T16:50:24.888659+0000 mgr.gibba045.orlgmj (mgr.34412) 9578 : cluster [DBG] pgmap v5457: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:26.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:50:25 gibba015 bash[30343]: cluster 2021-03-10T16:50:24.888659+0000 mgr.gibba045.orlgmj (mgr.34412) 9578 : cluster [DBG] pgmap v5457: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:26.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:50:25 gibba045 bash[25517]: cluster 2021-03-10T16:50:24.888659+0000 mgr.gibba045.orlgmj (mgr.34412) 9578 : cluster [DBG] pgmap v5457: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:27.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:50:26 gibba045 bash[25517]: audit 2021-03-10T16:50:25.602941+0000 mgr.gibba045.orlgmj (mgr.34412) 9579 : audit [DBG] from='client.50478 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:50:27.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:50:26 gibba045 bash[25517]: audit 2021-03-10T16:50:25.826556+0000 mgr.gibba045.orlgmj (mgr.34412) 9580 : audit [DBG] from='client.60472 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:50:27.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:50:26 gibba045 bash[25517]: audit 2021-03-10T16:50:26.086342+0000 mon.a (mon.0) 2096 : audit [DBG] from='client.? 172.21.2.115:0/25569017' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:50:27.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:50:26 gibba015 bash[29377]: audit 2021-03-10T16:50:25.602941+0000 mgr.gibba045.orlgmj (mgr.34412) 9579 : audit [DBG] from='client.50478 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:50:27.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:50:26 gibba015 bash[29377]: audit 2021-03-10T16:50:25.826556+0000 mgr.gibba045.orlgmj (mgr.34412) 9580 : audit [DBG] from='client.60472 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:50:27.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:50:26 gibba015 bash[29377]: audit 2021-03-10T16:50:26.086342+0000 mon.a (mon.0) 2096 : audit [DBG] from='client.? 172.21.2.115:0/25569017' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:50:27.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:50:26 gibba015 bash[30343]: audit 2021-03-10T16:50:25.602941+0000 mgr.gibba045.orlgmj (mgr.34412) 9579 : audit [DBG] from='client.50478 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:50:27.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:50:26 gibba015 bash[30343]: audit 2021-03-10T16:50:25.826556+0000 mgr.gibba045.orlgmj (mgr.34412) 9580 : audit [DBG] from='client.60472 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:50:27.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:50:26 gibba015 bash[30343]: audit 2021-03-10T16:50:26.086342+0000 mon.a (mon.0) 2096 : audit [DBG] from='client.? 172.21.2.115:0/25569017' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:50:28.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:50:27 gibba045 bash[25517]: cluster 2021-03-10T16:50:26.890177+0000 mgr.gibba045.orlgmj (mgr.34412) 9581 : cluster [DBG] pgmap v5458: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:28.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:50:27 gibba015 bash[29377]: cluster 2021-03-10T16:50:26.890177+0000 mgr.gibba045.orlgmj (mgr.34412) 9581 : cluster [DBG] pgmap v5458: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:28.469 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:50:27 gibba015 bash[30343]: cluster 2021-03-10T16:50:26.890177+0000 mgr.gibba045.orlgmj (mgr.34412) 9581 : cluster [DBG] pgmap v5458: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:30.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:50:29 gibba045 bash[25517]: cephadm 2021-03-10T16:50:28.128511+0000 mgr.gibba045.orlgmj (mgr.34412) 9582 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:50:30.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:50:29 gibba045 bash[25517]: cluster 2021-03-10T16:50:28.891275+0000 mgr.gibba045.orlgmj (mgr.34412) 9583 : cluster [DBG] pgmap v5459: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:30.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:50:29 gibba015 bash[29377]: cephadm 2021-03-10T16:50:28.128511+0000 mgr.gibba045.orlgmj (mgr.34412) 9582 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:50:30.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:50:29 gibba015 bash[29377]: cluster 2021-03-10T16:50:28.891275+0000 mgr.gibba045.orlgmj (mgr.34412) 9583 : cluster [DBG] pgmap v5459: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:30.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:50:29 gibba015 bash[30343]: cephadm 2021-03-10T16:50:28.128511+0000 mgr.gibba045.orlgmj (mgr.34412) 9582 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:50:30.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:50:29 gibba015 bash[30343]: cluster 2021-03-10T16:50:28.891275+0000 mgr.gibba045.orlgmj (mgr.34412) 9583 : cluster [DBG] pgmap v5459: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:32.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:50:31 gibba045 bash[25517]: cluster 2021-03-10T16:50:30.893290+0000 mgr.gibba045.orlgmj (mgr.34412) 9584 : cluster [DBG] pgmap v5460: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:32.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:50:31 gibba015 bash[29377]: cluster 2021-03-10T16:50:30.893290+0000 mgr.gibba045.orlgmj (mgr.34412) 9584 : cluster [DBG] pgmap v5460: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:32.469 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:50:31 gibba015 bash[30343]: cluster 2021-03-10T16:50:30.893290+0000 mgr.gibba045.orlgmj (mgr.34412) 9584 : cluster [DBG] pgmap v5460: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:34.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:50:34 gibba045 bash[25517]: cluster 2021-03-10T16:50:32.894996+0000 mgr.gibba045.orlgmj (mgr.34412) 9585 : cluster [DBG] pgmap v5461: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:34.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:50:34 gibba015 bash[29377]: cluster 2021-03-10T16:50:32.894996+0000 mgr.gibba045.orlgmj (mgr.34412) 9585 : cluster [DBG] pgmap v5461: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:34.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:50:34 gibba015 bash[30343]: cluster 2021-03-10T16:50:32.894996+0000 mgr.gibba045.orlgmj (mgr.34412) 9585 : cluster [DBG] pgmap v5461: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:35.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:50:35 gibba045 bash[25517]: cluster 2021-03-10T16:50:34.896590+0000 mgr.gibba045.orlgmj (mgr.34412) 9586 : cluster [DBG] pgmap v5462: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:35.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:50:35 gibba015 bash[29377]: cluster 2021-03-10T16:50:34.896590+0000 mgr.gibba045.orlgmj (mgr.34412) 9586 : cluster [DBG] pgmap v5462: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:35.469 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:50:35 gibba015 bash[30343]: cluster 2021-03-10T16:50:34.896590+0000 mgr.gibba045.orlgmj (mgr.34412) 9586 : cluster [DBG] pgmap v5462: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:38.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:50:37 gibba045 bash[25517]: cluster 2021-03-10T16:50:36.898304+0000 mgr.gibba045.orlgmj (mgr.34412) 9587 : cluster [DBG] pgmap v5463: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:38.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:50:37 gibba015 bash[29377]: cluster 2021-03-10T16:50:36.898304+0000 mgr.gibba045.orlgmj (mgr.34412) 9587 : cluster [DBG] pgmap v5463: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:38.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:50:37 gibba015 bash[30343]: cluster 2021-03-10T16:50:36.898304+0000 mgr.gibba045.orlgmj (mgr.34412) 9587 : cluster [DBG] pgmap v5463: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:40.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:50:39 gibba015 bash[29377]: cluster 2021-03-10T16:50:38.899428+0000 mgr.gibba045.orlgmj (mgr.34412) 9588 : cluster [DBG] pgmap v5464: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:40.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:50:39 gibba015 bash[30343]: cluster 2021-03-10T16:50:38.899428+0000 mgr.gibba045.orlgmj (mgr.34412) 9588 : cluster [DBG] pgmap v5464: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:40.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:50:39 gibba045 bash[25517]: cluster 2021-03-10T16:50:38.899428+0000 mgr.gibba045.orlgmj (mgr.34412) 9588 : cluster [DBG] pgmap v5464: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:42.218 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:50:41 gibba015 bash[29377]: cluster 2021-03-10T16:50:40.901337+0000 mgr.gibba045.orlgmj (mgr.34412) 9589 : cluster [DBG] pgmap v5465: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:42.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:50:41 gibba015 bash[30343]: cluster 2021-03-10T16:50:40.901337+0000 mgr.gibba045.orlgmj (mgr.34412) 9589 : cluster [DBG] pgmap v5465: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:42.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:50:41 gibba045 bash[25517]: cluster 2021-03-10T16:50:40.901337+0000 mgr.gibba045.orlgmj (mgr.34412) 9589 : cluster [DBG] pgmap v5465: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:44.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:50:43 gibba045 bash[25517]: cluster 2021-03-10T16:50:42.903041+0000 mgr.gibba045.orlgmj (mgr.34412) 9590 : cluster [DBG] pgmap v5466: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:44.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:50:43 gibba015 bash[29377]: cluster 2021-03-10T16:50:42.903041+0000 mgr.gibba045.orlgmj (mgr.34412) 9590 : cluster [DBG] pgmap v5466: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:44.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:50:43 gibba015 bash[30343]: cluster 2021-03-10T16:50:42.903041+0000 mgr.gibba045.orlgmj (mgr.34412) 9590 : cluster [DBG] pgmap v5466: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:45.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:50:44 gibba045 bash[25517]: cephadm 2021-03-10T16:50:43.144561+0000 mgr.gibba045.orlgmj (mgr.34412) 9591 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:50:45.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:50:44 gibba015 bash[29377]: cephadm 2021-03-10T16:50:43.144561+0000 mgr.gibba045.orlgmj (mgr.34412) 9591 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:50:45.469 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:50:44 gibba015 bash[30343]: cephadm 2021-03-10T16:50:43.144561+0000 mgr.gibba045.orlgmj (mgr.34412) 9591 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:50:46.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:50:45 gibba045 bash[25517]: cluster 2021-03-10T16:50:44.904687+0000 mgr.gibba045.orlgmj (mgr.34412) 9592 : cluster [DBG] pgmap v5467: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:46.468 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:50:45 gibba015 bash[29377]: cluster 2021-03-10T16:50:44.904687+0000 mgr.gibba045.orlgmj (mgr.34412) 9592 : cluster [DBG] pgmap v5467: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:46.469 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:50:46 gibba015 bash[30343]: cluster 2021-03-10T16:50:44.904687+0000 mgr.gibba045.orlgmj (mgr.34412) 9592 : cluster [DBG] pgmap v5467: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:48.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:50:47 gibba045 bash[25517]: cluster 2021-03-10T16:50:46.906221+0000 mgr.gibba045.orlgmj (mgr.34412) 9593 : cluster [DBG] pgmap v5468: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:48.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:50:47 gibba015 bash[29377]: cluster 2021-03-10T16:50:46.906221+0000 mgr.gibba045.orlgmj (mgr.34412) 9593 : cluster [DBG] pgmap v5468: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:48.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:50:47 gibba015 bash[30343]: cluster 2021-03-10T16:50:46.906221+0000 mgr.gibba045.orlgmj (mgr.34412) 9593 : cluster [DBG] pgmap v5468: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:50.218 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:50:49 gibba015 bash[29377]: cluster 2021-03-10T16:50:48.907444+0000 mgr.gibba045.orlgmj (mgr.34412) 9594 : cluster [DBG] pgmap v5469: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:50.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:50:49 gibba015 bash[30343]: cluster 2021-03-10T16:50:48.907444+0000 mgr.gibba045.orlgmj (mgr.34412) 9594 : cluster [DBG] pgmap v5469: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:50.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:50:49 gibba045 bash[25517]: cluster 2021-03-10T16:50:48.907444+0000 mgr.gibba045.orlgmj (mgr.34412) 9594 : cluster [DBG] pgmap v5469: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:52.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:50:51 gibba045 bash[25517]: cluster 2021-03-10T16:50:50.909402+0000 mgr.gibba045.orlgmj (mgr.34412) 9595 : cluster [DBG] pgmap v5470: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:52.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:50:51 gibba015 bash[29377]: cluster 2021-03-10T16:50:50.909402+0000 mgr.gibba045.orlgmj (mgr.34412) 9595 : cluster [DBG] pgmap v5470: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:52.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:50:51 gibba015 bash[30343]: cluster 2021-03-10T16:50:50.909402+0000 mgr.gibba045.orlgmj (mgr.34412) 9595 : cluster [DBG] pgmap v5470: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:54.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:50:53 gibba045 bash[25517]: cluster 2021-03-10T16:50:52.910817+0000 mgr.gibba045.orlgmj (mgr.34412) 9596 : cluster [DBG] pgmap v5471: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:54.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:50:53 gibba045 bash[25517]: audit 2021-03-10T16:50:53.757821+0000 mon.c (mon.1) 2639 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:50:54.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:50:53 gibba045 bash[25517]: audit 2021-03-10T16:50:53.758471+0000 mon.c (mon.1) 2640 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:50:54.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:50:53 gibba045 bash[25517]: audit 2021-03-10T16:50:53.758931+0000 mon.a (mon.0) 2097 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:50:54.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:50:53 gibba045 bash[25517]: audit 2021-03-10T16:50:53.759979+0000 mon.a (mon.0) 2098 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:50:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:50:53 gibba045 bash[25517]: audit 2021-03-10T16:50:53.774767+0000 mon.c (mon.1) 2641 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:50:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:50:53 gibba045 bash[25517]: audit 2021-03-10T16:50:53.775536+0000 mon.c (mon.1) 2642 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:50:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:50:53 gibba045 bash[25517]: audit 2021-03-10T16:50:53.776028+0000 mon.a (mon.0) 2099 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:50:54.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:50:53 gibba045 bash[25517]: audit 2021-03-10T16:50:53.776264+0000 mon.c (mon.1) 2643 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:50:54.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:50:53 gibba045 bash[25517]: audit 2021-03-10T16:50:53.777106+0000 mon.c (mon.1) 2644 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:50:54.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:50:53 gibba045 bash[25517]: audit 2021-03-10T16:50:53.777346+0000 mon.a (mon.0) 2100 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:50:54.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:50:53 gibba045 bash[25517]: audit 2021-03-10T16:50:53.778543+0000 mon.a (mon.0) 2101 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:50:54.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:50:53 gibba045 bash[25517]: audit 2021-03-10T16:50:53.779347+0000 mon.a (mon.0) 2102 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:50:54.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:50:53 gibba015 bash[29377]: cluster 2021-03-10T16:50:52.910817+0000 mgr.gibba045.orlgmj (mgr.34412) 9596 : cluster [DBG] pgmap v5471: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:54.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:50:53 gibba015 bash[29377]: audit 2021-03-10T16:50:53.757821+0000 mon.c (mon.1) 2639 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:50:54.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:50:53 gibba015 bash[29377]: audit 2021-03-10T16:50:53.758471+0000 mon.c (mon.1) 2640 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:50:54.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:50:53 gibba015 bash[29377]: audit 2021-03-10T16:50:53.758931+0000 mon.a (mon.0) 2097 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:50:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:50:53 gibba015 bash[29377]: audit 2021-03-10T16:50:53.759979+0000 mon.a (mon.0) 2098 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:50:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:50:53 gibba015 bash[29377]: audit 2021-03-10T16:50:53.774767+0000 mon.c (mon.1) 2641 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:50:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:50:53 gibba015 bash[29377]: audit 2021-03-10T16:50:53.775536+0000 mon.c (mon.1) 2642 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:50:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:50:53 gibba015 bash[29377]: audit 2021-03-10T16:50:53.776028+0000 mon.a (mon.0) 2099 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:50:54.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:50:53 gibba015 bash[29377]: audit 2021-03-10T16:50:53.776264+0000 mon.c (mon.1) 2643 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:50:54.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:50:53 gibba015 bash[29377]: audit 2021-03-10T16:50:53.777106+0000 mon.c (mon.1) 2644 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:50:54.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:50:53 gibba015 bash[29377]: audit 2021-03-10T16:50:53.777346+0000 mon.a (mon.0) 2100 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:50:54.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:50:53 gibba015 bash[29377]: audit 2021-03-10T16:50:53.778543+0000 mon.a (mon.0) 2101 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:50:54.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:50:53 gibba015 bash[29377]: audit 2021-03-10T16:50:53.779347+0000 mon.a (mon.0) 2102 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:50:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:50:53 gibba015 bash[30343]: cluster 2021-03-10T16:50:52.910817+0000 mgr.gibba045.orlgmj (mgr.34412) 9596 : cluster [DBG] pgmap v5471: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:54.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:50:53 gibba015 bash[30343]: audit 2021-03-10T16:50:53.757821+0000 mon.c (mon.1) 2639 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:50:54.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:50:53 gibba015 bash[30343]: audit 2021-03-10T16:50:53.758471+0000 mon.c (mon.1) 2640 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:50:54.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:50:53 gibba015 bash[30343]: audit 2021-03-10T16:50:53.758931+0000 mon.a (mon.0) 2097 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:50:54.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:50:53 gibba015 bash[30343]: audit 2021-03-10T16:50:53.759979+0000 mon.a (mon.0) 2098 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:50:54.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:50:53 gibba015 bash[30343]: audit 2021-03-10T16:50:53.774767+0000 mon.c (mon.1) 2641 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:50:54.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:50:53 gibba015 bash[30343]: audit 2021-03-10T16:50:53.775536+0000 mon.c (mon.1) 2642 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:50:54.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:50:53 gibba015 bash[30343]: audit 2021-03-10T16:50:53.776028+0000 mon.a (mon.0) 2099 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:50:54.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:50:53 gibba015 bash[30343]: audit 2021-03-10T16:50:53.776264+0000 mon.c (mon.1) 2643 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:50:54.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:50:53 gibba015 bash[30343]: audit 2021-03-10T16:50:53.777106+0000 mon.c (mon.1) 2644 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:50:54.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:50:53 gibba015 bash[30343]: audit 2021-03-10T16:50:53.777346+0000 mon.a (mon.0) 2100 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:50:54.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:50:53 gibba015 bash[30343]: audit 2021-03-10T16:50:53.778543+0000 mon.a (mon.0) 2101 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:50:54.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:50:53 gibba015 bash[30343]: audit 2021-03-10T16:50:53.779347+0000 mon.a (mon.0) 2102 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:50:56.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:50:55 gibba045 bash[25517]: cluster 2021-03-10T16:50:54.912472+0000 mgr.gibba045.orlgmj (mgr.34412) 9597 : cluster [DBG] pgmap v5472: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:56.326 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:50:56.468 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:50:55 gibba015 bash[29377]: cluster 2021-03-10T16:50:54.912472+0000 mgr.gibba045.orlgmj (mgr.34412) 9597 : cluster [DBG] pgmap v5472: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:56.469 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:50:55 gibba015 bash[30343]: cluster 2021-03-10T16:50:54.912472+0000 mgr.gibba045.orlgmj (mgr.34412) 9597 : cluster [DBG] pgmap v5472: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:56.557 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:50:56.558 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 4m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:50:56.558 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 3m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:50:56.558 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:50:56.559 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:50:56.559 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:50:56.560 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:50:56.560 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:50:56.561 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:50:56.561 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 4m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:50:56.561 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 3m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:50:56.562 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:50:56.562 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:50:56.562 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:50:56.563 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:50:56.563 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:50:56.564 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:50:56.565 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:50:56.565 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:50:56.566 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 3m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:50:56.566 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 3m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:50:56.804 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:50:56.805 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:50:56.805 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:50:56.806 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:50:56.806 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:50:56.807 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:50:56.807 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:50:56.808 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:50:56.808 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:50:56.809 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:50:56.809 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:50:56.809 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:50:56.810 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:50:56.810 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:50:56.811 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:50:58.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:50:57 gibba045 bash[25517]: audit 2021-03-10T16:50:56.320942+0000 mgr.gibba045.orlgmj (mgr.34412) 9598 : audit [DBG] from='client.50496 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:50:58.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:50:57 gibba045 bash[25517]: audit 2021-03-10T16:50:56.547911+0000 mgr.gibba045.orlgmj (mgr.34412) 9599 : audit [DBG] from='client.60490 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:50:58.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:50:57 gibba045 bash[25517]: audit 2021-03-10T16:50:56.805780+0000 mon.a (mon.0) 2103 : audit [DBG] from='client.? 172.21.2.115:0/165160795' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:50:58.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:50:57 gibba045 bash[25517]: cluster 2021-03-10T16:50:56.913944+0000 mgr.gibba045.orlgmj (mgr.34412) 9600 : cluster [DBG] pgmap v5473: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:58.218 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:50:57 gibba015 bash[29377]: audit 2021-03-10T16:50:56.320942+0000 mgr.gibba045.orlgmj (mgr.34412) 9598 : audit [DBG] from='client.50496 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:50:58.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:50:57 gibba015 bash[29377]: audit 2021-03-10T16:50:56.547911+0000 mgr.gibba045.orlgmj (mgr.34412) 9599 : audit [DBG] from='client.60490 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:50:58.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:50:57 gibba015 bash[29377]: audit 2021-03-10T16:50:56.805780+0000 mon.a (mon.0) 2103 : audit [DBG] from='client.? 172.21.2.115:0/165160795' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:50:58.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:50:57 gibba015 bash[29377]: cluster 2021-03-10T16:50:56.913944+0000 mgr.gibba045.orlgmj (mgr.34412) 9600 : cluster [DBG] pgmap v5473: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:58.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:50:57 gibba015 bash[30343]: audit 2021-03-10T16:50:56.320942+0000 mgr.gibba045.orlgmj (mgr.34412) 9598 : audit [DBG] from='client.50496 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:50:58.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:50:57 gibba015 bash[30343]: audit 2021-03-10T16:50:56.547911+0000 mgr.gibba045.orlgmj (mgr.34412) 9599 : audit [DBG] from='client.60490 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:50:58.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:50:57 gibba015 bash[30343]: audit 2021-03-10T16:50:56.805780+0000 mon.a (mon.0) 2103 : audit [DBG] from='client.? 172.21.2.115:0/165160795' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:50:58.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:50:57 gibba015 bash[30343]: cluster 2021-03-10T16:50:56.913944+0000 mgr.gibba045.orlgmj (mgr.34412) 9600 : cluster [DBG] pgmap v5473: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:59.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:50:58 gibba045 bash[25517]: audit 2021-03-10T16:50:58.159031+0000 mon.c (mon.1) 2645 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:50:59.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:50:58 gibba045 bash[25517]: audit 2021-03-10T16:50:58.393659+0000 mon.a (mon.0) 2104 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:50:59.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:50:58 gibba045 bash[25517]: audit 2021-03-10T16:50:58.397494+0000 mon.c (mon.1) 2646 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:50:59.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:50:58 gibba045 bash[25517]: audit 2021-03-10T16:50:58.399045+0000 mon.c (mon.1) 2647 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:50:59.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:50:58 gibba045 bash[25517]: audit 2021-03-10T16:50:58.400412+0000 mon.c (mon.1) 2648 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:50:59.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:50:58 gibba045 bash[25517]: audit 2021-03-10T16:50:58.402081+0000 mon.c (mon.1) 2649 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:50:59.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:50:58 gibba045 bash[25517]: audit 2021-03-10T16:50:58.405365+0000 mon.c (mon.1) 2650 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:50:59.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:50:58 gibba045 bash[25517]: audit 2021-03-10T16:50:58.406731+0000 mon.c (mon.1) 2651 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:50:59.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:50:58 gibba015 bash[29377]: audit 2021-03-10T16:50:58.159031+0000 mon.c (mon.1) 2645 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:50:59.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:50:58 gibba015 bash[29377]: audit 2021-03-10T16:50:58.393659+0000 mon.a (mon.0) 2104 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:50:59.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:50:58 gibba015 bash[29377]: audit 2021-03-10T16:50:58.397494+0000 mon.c (mon.1) 2646 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:50:59.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:50:58 gibba015 bash[29377]: audit 2021-03-10T16:50:58.399045+0000 mon.c (mon.1) 2647 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:50:59.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:50:58 gibba015 bash[29377]: audit 2021-03-10T16:50:58.400412+0000 mon.c (mon.1) 2648 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:50:59.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:50:58 gibba015 bash[29377]: audit 2021-03-10T16:50:58.402081+0000 mon.c (mon.1) 2649 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:50:59.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:50:58 gibba015 bash[29377]: audit 2021-03-10T16:50:58.405365+0000 mon.c (mon.1) 2650 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:50:59.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:50:58 gibba015 bash[29377]: audit 2021-03-10T16:50:58.406731+0000 mon.c (mon.1) 2651 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:50:59.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:50:58 gibba015 bash[30343]: audit 2021-03-10T16:50:58.159031+0000 mon.c (mon.1) 2645 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:50:59.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:50:58 gibba015 bash[30343]: audit 2021-03-10T16:50:58.393659+0000 mon.a (mon.0) 2104 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:50:59.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:50:58 gibba015 bash[30343]: audit 2021-03-10T16:50:58.397494+0000 mon.c (mon.1) 2646 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:50:59.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:50:58 gibba015 bash[30343]: audit 2021-03-10T16:50:58.399045+0000 mon.c (mon.1) 2647 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:50:59.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:50:58 gibba015 bash[30343]: audit 2021-03-10T16:50:58.400412+0000 mon.c (mon.1) 2648 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:50:59.234 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:50:58 gibba015 bash[30343]: audit 2021-03-10T16:50:58.402081+0000 mon.c (mon.1) 2649 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:50:59.235 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:50:58 gibba015 bash[30343]: audit 2021-03-10T16:50:58.405365+0000 mon.c (mon.1) 2650 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:50:59.235 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:50:58 gibba015 bash[30343]: audit 2021-03-10T16:50:58.406731+0000 mon.c (mon.1) 2651 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:51:00.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:50:59 gibba015 bash[29377]: cephadm 2021-03-10T16:50:58.166809+0000 mgr.gibba045.orlgmj (mgr.34412) 9601 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:51:00.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:50:59 gibba015 bash[29377]: cephadm 2021-03-10T16:50:58.168338+0000 mgr.gibba045.orlgmj (mgr.34412) 9602 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:51:00.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:50:59 gibba015 bash[29377]: cephadm 2021-03-10T16:50:58.398983+0000 mgr.gibba045.orlgmj (mgr.34412) 9603 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:51:00.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:50:59 gibba015 bash[29377]: cephadm 2021-03-10T16:50:58.400752+0000 mgr.gibba045.orlgmj (mgr.34412) 9604 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:51:00.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:50:59 gibba015 bash[29377]: cephadm 2021-03-10T16:50:58.402309+0000 mgr.gibba045.orlgmj (mgr.34412) 9605 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:51:00.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:50:59 gibba015 bash[29377]: cephadm 2021-03-10T16:50:58.402346+0000 mgr.gibba045.orlgmj (mgr.34412) 9606 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:51:00.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:50:59 gibba015 bash[29377]: cephadm 2021-03-10T16:50:58.403685+0000 mgr.gibba045.orlgmj (mgr.34412) 9607 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:51:00.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:50:59 gibba015 bash[29377]: cephadm 2021-03-10T16:50:58.403723+0000 mgr.gibba045.orlgmj (mgr.34412) 9608 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:51:00.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:50:59 gibba015 bash[29377]: cephadm 2021-03-10T16:50:58.405227+0000 mgr.gibba045.orlgmj (mgr.34412) 9609 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:51:00.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:50:59 gibba015 bash[29377]: cephadm 2021-03-10T16:50:58.406936+0000 mgr.gibba045.orlgmj (mgr.34412) 9610 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:51:00.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:50:59 gibba015 bash[29377]: cephadm 2021-03-10T16:50:58.406976+0000 mgr.gibba045.orlgmj (mgr.34412) 9611 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:51:00.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:50:59 gibba015 bash[29377]: cephadm 2021-03-10T16:50:58.408350+0000 mgr.gibba045.orlgmj (mgr.34412) 9612 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:51:00.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:50:59 gibba015 bash[29377]: cephadm 2021-03-10T16:50:58.408678+0000 mgr.gibba045.orlgmj (mgr.34412) 9613 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:51:00.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:50:59 gibba015 bash[29377]: cephadm 2021-03-10T16:50:58.409950+0000 mgr.gibba045.orlgmj (mgr.34412) 9614 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:51:00.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:50:59 gibba015 bash[29377]: cephadm 2021-03-10T16:50:58.409988+0000 mgr.gibba045.orlgmj (mgr.34412) 9615 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:51:00.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:50:59 gibba015 bash[29377]: cephadm 2021-03-10T16:50:58.410099+0000 mgr.gibba045.orlgmj (mgr.34412) 9616 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:51:00.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:50:59 gibba015 bash[29377]: cluster 2021-03-10T16:50:58.915059+0000 mgr.gibba045.orlgmj (mgr.34412) 9617 : cluster [DBG] pgmap v5474: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:00.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:50:59 gibba015 bash[30343]: cephadm 2021-03-10T16:50:58.166809+0000 mgr.gibba045.orlgmj (mgr.34412) 9601 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:51:00.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:50:59 gibba015 bash[30343]: cephadm 2021-03-10T16:50:58.168338+0000 mgr.gibba045.orlgmj (mgr.34412) 9602 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:51:00.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:50:59 gibba015 bash[30343]: cephadm 2021-03-10T16:50:58.398983+0000 mgr.gibba045.orlgmj (mgr.34412) 9603 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:51:00.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:50:59 gibba015 bash[30343]: cephadm 2021-03-10T16:50:58.400752+0000 mgr.gibba045.orlgmj (mgr.34412) 9604 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:51:00.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:50:59 gibba015 bash[30343]: cephadm 2021-03-10T16:50:58.402309+0000 mgr.gibba045.orlgmj (mgr.34412) 9605 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:51:00.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:50:59 gibba015 bash[30343]: cephadm 2021-03-10T16:50:58.402346+0000 mgr.gibba045.orlgmj (mgr.34412) 9606 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:51:00.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:50:59 gibba015 bash[30343]: cephadm 2021-03-10T16:50:58.403685+0000 mgr.gibba045.orlgmj (mgr.34412) 9607 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:51:00.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:50:59 gibba015 bash[30343]: cephadm 2021-03-10T16:50:58.403723+0000 mgr.gibba045.orlgmj (mgr.34412) 9608 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:51:00.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:50:59 gibba015 bash[30343]: cephadm 2021-03-10T16:50:58.405227+0000 mgr.gibba045.orlgmj (mgr.34412) 9609 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:51:00.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:50:59 gibba015 bash[30343]: cephadm 2021-03-10T16:50:58.406936+0000 mgr.gibba045.orlgmj (mgr.34412) 9610 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:51:00.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:50:59 gibba015 bash[30343]: cephadm 2021-03-10T16:50:58.406976+0000 mgr.gibba045.orlgmj (mgr.34412) 9611 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:51:00.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:50:59 gibba015 bash[30343]: cephadm 2021-03-10T16:50:58.408350+0000 mgr.gibba045.orlgmj (mgr.34412) 9612 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:51:00.234 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:50:59 gibba015 bash[30343]: cephadm 2021-03-10T16:50:58.408678+0000 mgr.gibba045.orlgmj (mgr.34412) 9613 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:51:00.234 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:50:59 gibba015 bash[30343]: cephadm 2021-03-10T16:50:58.409950+0000 mgr.gibba045.orlgmj (mgr.34412) 9614 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:51:00.235 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:50:59 gibba015 bash[30343]: cephadm 2021-03-10T16:50:58.409988+0000 mgr.gibba045.orlgmj (mgr.34412) 9615 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:51:00.235 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:50:59 gibba015 bash[30343]: cephadm 2021-03-10T16:50:58.410099+0000 mgr.gibba045.orlgmj (mgr.34412) 9616 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:51:00.236 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:50:59 gibba015 bash[30343]: cluster 2021-03-10T16:50:58.915059+0000 mgr.gibba045.orlgmj (mgr.34412) 9617 : cluster [DBG] pgmap v5474: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:00.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:50:59 gibba045 bash[25517]: cephadm 2021-03-10T16:50:58.166809+0000 mgr.gibba045.orlgmj (mgr.34412) 9601 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:51:00.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:50:59 gibba045 bash[25517]: cephadm 2021-03-10T16:50:58.168338+0000 mgr.gibba045.orlgmj (mgr.34412) 9602 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:51:00.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:50:59 gibba045 bash[25517]: cephadm 2021-03-10T16:50:58.398983+0000 mgr.gibba045.orlgmj (mgr.34412) 9603 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:51:00.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:50:59 gibba045 bash[25517]: cephadm 2021-03-10T16:50:58.400752+0000 mgr.gibba045.orlgmj (mgr.34412) 9604 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:51:00.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:50:59 gibba045 bash[25517]: cephadm 2021-03-10T16:50:58.402309+0000 mgr.gibba045.orlgmj (mgr.34412) 9605 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:51:00.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:50:59 gibba045 bash[25517]: cephadm 2021-03-10T16:50:58.402346+0000 mgr.gibba045.orlgmj (mgr.34412) 9606 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:51:00.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:50:59 gibba045 bash[25517]: cephadm 2021-03-10T16:50:58.403685+0000 mgr.gibba045.orlgmj (mgr.34412) 9607 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:51:00.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:50:59 gibba045 bash[25517]: cephadm 2021-03-10T16:50:58.403723+0000 mgr.gibba045.orlgmj (mgr.34412) 9608 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:51:00.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:50:59 gibba045 bash[25517]: cephadm 2021-03-10T16:50:58.405227+0000 mgr.gibba045.orlgmj (mgr.34412) 9609 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:51:00.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:50:59 gibba045 bash[25517]: cephadm 2021-03-10T16:50:58.406936+0000 mgr.gibba045.orlgmj (mgr.34412) 9610 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:51:00.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:50:59 gibba045 bash[25517]: cephadm 2021-03-10T16:50:58.406976+0000 mgr.gibba045.orlgmj (mgr.34412) 9611 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:51:00.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:50:59 gibba045 bash[25517]: cephadm 2021-03-10T16:50:58.408350+0000 mgr.gibba045.orlgmj (mgr.34412) 9612 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:51:00.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:50:59 gibba045 bash[25517]: cephadm 2021-03-10T16:50:58.408678+0000 mgr.gibba045.orlgmj (mgr.34412) 9613 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:51:00.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:50:59 gibba045 bash[25517]: cephadm 2021-03-10T16:50:58.409950+0000 mgr.gibba045.orlgmj (mgr.34412) 9614 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:51:00.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:50:59 gibba045 bash[25517]: cephadm 2021-03-10T16:50:58.409988+0000 mgr.gibba045.orlgmj (mgr.34412) 9615 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:51:00.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:50:59 gibba045 bash[25517]: cephadm 2021-03-10T16:50:58.410099+0000 mgr.gibba045.orlgmj (mgr.34412) 9616 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:51:00.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:50:59 gibba045 bash[25517]: cluster 2021-03-10T16:50:58.915059+0000 mgr.gibba045.orlgmj (mgr.34412) 9617 : cluster [DBG] pgmap v5474: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:02.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:51:01 gibba045 bash[25517]: cluster 2021-03-10T16:51:00.916732+0000 mgr.gibba045.orlgmj (mgr.34412) 9618 : cluster [DBG] pgmap v5475: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:02.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:51:01 gibba015 bash[29377]: cluster 2021-03-10T16:51:00.916732+0000 mgr.gibba045.orlgmj (mgr.34412) 9618 : cluster [DBG] pgmap v5475: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:02.469 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:51:01 gibba015 bash[30343]: cluster 2021-03-10T16:51:00.916732+0000 mgr.gibba045.orlgmj (mgr.34412) 9618 : cluster [DBG] pgmap v5475: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:04.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:51:03 gibba045 bash[25517]: cluster 2021-03-10T16:51:02.918116+0000 mgr.gibba045.orlgmj (mgr.34412) 9619 : cluster [DBG] pgmap v5476: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:04.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:51:03 gibba015 bash[29377]: cluster 2021-03-10T16:51:02.918116+0000 mgr.gibba045.orlgmj (mgr.34412) 9619 : cluster [DBG] pgmap v5476: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:04.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:51:03 gibba015 bash[30343]: cluster 2021-03-10T16:51:02.918116+0000 mgr.gibba045.orlgmj (mgr.34412) 9619 : cluster [DBG] pgmap v5476: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:06.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:51:05 gibba045 bash[25517]: cluster 2021-03-10T16:51:04.919513+0000 mgr.gibba045.orlgmj (mgr.34412) 9620 : cluster [DBG] pgmap v5477: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:06.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:51:05 gibba015 bash[29377]: cluster 2021-03-10T16:51:04.919513+0000 mgr.gibba045.orlgmj (mgr.34412) 9620 : cluster [DBG] pgmap v5477: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:06.469 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:51:05 gibba015 bash[30343]: cluster 2021-03-10T16:51:04.919513+0000 mgr.gibba045.orlgmj (mgr.34412) 9620 : cluster [DBG] pgmap v5477: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:08.052 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:51:07 gibba045 bash[25517]: cluster 2021-03-10T16:51:06.921002+0000 mgr.gibba045.orlgmj (mgr.34412) 9621 : cluster [DBG] pgmap v5478: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:08.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:51:07 gibba015 bash[29377]: cluster 2021-03-10T16:51:06.921002+0000 mgr.gibba045.orlgmj (mgr.34412) 9621 : cluster [DBG] pgmap v5478: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:08.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:51:07 gibba015 bash[30343]: cluster 2021-03-10T16:51:06.921002+0000 mgr.gibba045.orlgmj (mgr.34412) 9621 : cluster [DBG] pgmap v5478: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:10.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:51:09 gibba045 bash[25517]: cluster 2021-03-10T16:51:08.922243+0000 mgr.gibba045.orlgmj (mgr.34412) 9622 : cluster [DBG] pgmap v5479: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:10.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:51:09 gibba015 bash[29377]: cluster 2021-03-10T16:51:08.922243+0000 mgr.gibba045.orlgmj (mgr.34412) 9622 : cluster [DBG] pgmap v5479: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:10.469 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:51:09 gibba015 bash[30343]: cluster 2021-03-10T16:51:08.922243+0000 mgr.gibba045.orlgmj (mgr.34412) 9622 : cluster [DBG] pgmap v5479: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:12.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:51:11 gibba045 bash[25517]: cluster 2021-03-10T16:51:10.923933+0000 mgr.gibba045.orlgmj (mgr.34412) 9623 : cluster [DBG] pgmap v5480: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:12.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:51:11 gibba015 bash[29377]: cluster 2021-03-10T16:51:10.923933+0000 mgr.gibba045.orlgmj (mgr.34412) 9623 : cluster [DBG] pgmap v5480: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:12.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:51:11 gibba015 bash[30343]: cluster 2021-03-10T16:51:10.923933+0000 mgr.gibba045.orlgmj (mgr.34412) 9623 : cluster [DBG] pgmap v5480: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:14.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:51:14 gibba045 bash[25517]: cluster 2021-03-10T16:51:12.925670+0000 mgr.gibba045.orlgmj (mgr.34412) 9624 : cluster [DBG] pgmap v5481: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:14.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:51:14 gibba015 bash[29377]: cluster 2021-03-10T16:51:12.925670+0000 mgr.gibba045.orlgmj (mgr.34412) 9624 : cluster [DBG] pgmap v5481: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:14.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:51:14 gibba015 bash[30343]: cluster 2021-03-10T16:51:12.925670+0000 mgr.gibba045.orlgmj (mgr.34412) 9624 : cluster [DBG] pgmap v5481: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:15.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:51:15 gibba045 bash[25517]: cephadm 2021-03-10T16:51:13.425268+0000 mgr.gibba045.orlgmj (mgr.34412) 9625 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:51:15.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:51:15 gibba015 bash[29377]: cephadm 2021-03-10T16:51:13.425268+0000 mgr.gibba045.orlgmj (mgr.34412) 9625 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:51:15.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:51:15 gibba015 bash[30343]: cephadm 2021-03-10T16:51:13.425268+0000 mgr.gibba045.orlgmj (mgr.34412) 9625 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:51:16.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:51:16 gibba045 bash[25517]: cluster 2021-03-10T16:51:14.927358+0000 mgr.gibba045.orlgmj (mgr.34412) 9626 : cluster [DBG] pgmap v5482: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:16.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:51:16 gibba015 bash[29377]: cluster 2021-03-10T16:51:14.927358+0000 mgr.gibba045.orlgmj (mgr.34412) 9626 : cluster [DBG] pgmap v5482: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:16.469 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:51:16 gibba015 bash[30343]: cluster 2021-03-10T16:51:14.927358+0000 mgr.gibba045.orlgmj (mgr.34412) 9626 : cluster [DBG] pgmap v5482: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:18.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:51:17 gibba045 bash[25517]: cluster 2021-03-10T16:51:16.929059+0000 mgr.gibba045.orlgmj (mgr.34412) 9627 : cluster [DBG] pgmap v5483: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:18.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:51:17 gibba015 bash[29377]: cluster 2021-03-10T16:51:16.929059+0000 mgr.gibba045.orlgmj (mgr.34412) 9627 : cluster [DBG] pgmap v5483: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:18.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:51:17 gibba015 bash[30343]: cluster 2021-03-10T16:51:16.929059+0000 mgr.gibba045.orlgmj (mgr.34412) 9627 : cluster [DBG] pgmap v5483: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:20.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:51:19 gibba045 bash[25517]: cluster 2021-03-10T16:51:18.930291+0000 mgr.gibba045.orlgmj (mgr.34412) 9628 : cluster [DBG] pgmap v5484: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:20.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:51:19 gibba015 bash[29377]: cluster 2021-03-10T16:51:18.930291+0000 mgr.gibba045.orlgmj (mgr.34412) 9628 : cluster [DBG] pgmap v5484: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:20.469 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:51:19 gibba015 bash[30343]: cluster 2021-03-10T16:51:18.930291+0000 mgr.gibba045.orlgmj (mgr.34412) 9628 : cluster [DBG] pgmap v5484: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:22.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:51:22 gibba045 bash[25517]: cluster 2021-03-10T16:51:20.932030+0000 mgr.gibba045.orlgmj (mgr.34412) 9629 : cluster [DBG] pgmap v5485: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:22.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:51:21 gibba015 bash[29377]: cluster 2021-03-10T16:51:20.932030+0000 mgr.gibba045.orlgmj (mgr.34412) 9629 : cluster [DBG] pgmap v5485: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:22.469 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:51:22 gibba015 bash[30343]: cluster 2021-03-10T16:51:20.932030+0000 mgr.gibba045.orlgmj (mgr.34412) 9629 : cluster [DBG] pgmap v5485: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:24.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:51:24 gibba045 bash[25517]: cluster 2021-03-10T16:51:22.933730+0000 mgr.gibba045.orlgmj (mgr.34412) 9630 : cluster [DBG] pgmap v5486: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:24.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:51:24 gibba015 bash[29377]: cluster 2021-03-10T16:51:22.933730+0000 mgr.gibba045.orlgmj (mgr.34412) 9630 : cluster [DBG] pgmap v5486: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:24.469 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:51:24 gibba015 bash[30343]: cluster 2021-03-10T16:51:22.933730+0000 mgr.gibba045.orlgmj (mgr.34412) 9630 : cluster [DBG] pgmap v5486: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:26.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:51:26 gibba045 bash[25517]: cluster 2021-03-10T16:51:24.935286+0000 mgr.gibba045.orlgmj (mgr.34412) 9631 : cluster [DBG] pgmap v5487: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:26.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:51:26 gibba015 bash[29377]: cluster 2021-03-10T16:51:24.935286+0000 mgr.gibba045.orlgmj (mgr.34412) 9631 : cluster [DBG] pgmap v5487: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:26.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:51:26 gibba015 bash[30343]: cluster 2021-03-10T16:51:24.935286+0000 mgr.gibba045.orlgmj (mgr.34412) 9631 : cluster [DBG] pgmap v5487: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:27.043 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:51:27.271 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:51:27.272 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 4m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:51:27.273 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 3m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:51:27.273 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:51:27.273 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:51:27.274 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:51:27.274 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:51:27.275 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:51:27.275 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:51:27.275 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 4m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:51:27.276 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 3m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:51:27.276 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:51:27.277 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:51:27.277 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:51:27.277 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:51:27.278 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:51:27.279 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:51:27.279 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:51:27.279 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:51:27.280 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 3m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:51:27.280 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 3m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:51:27.523 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:51:27.524 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:51:27.524 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:51:27.525 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:51:27.525 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:51:27.525 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:51:27.526 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:51:27.526 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:51:27.527 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:51:27.527 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:51:27.528 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:51:27.528 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:51:27.529 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:51:27.529 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:51:27.529 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:51:28.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:51:27 gibba045 bash[25517]: cluster 2021-03-10T16:51:26.936974+0000 mgr.gibba045.orlgmj (mgr.34412) 9632 : cluster [DBG] pgmap v5488: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:28.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:51:27 gibba045 bash[25517]: audit 2021-03-10T16:51:27.524100+0000 mon.a (mon.0) 2105 : audit [DBG] from='client.? 172.21.2.115:0/1557600515' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:51:28.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:51:27 gibba015 bash[29377]: cluster 2021-03-10T16:51:26.936974+0000 mgr.gibba045.orlgmj (mgr.34412) 9632 : cluster [DBG] pgmap v5488: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:28.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:51:27 gibba015 bash[29377]: audit 2021-03-10T16:51:27.524100+0000 mon.a (mon.0) 2105 : audit [DBG] from='client.? 172.21.2.115:0/1557600515' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:51:28.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:51:27 gibba015 bash[30343]: cluster 2021-03-10T16:51:26.936974+0000 mgr.gibba045.orlgmj (mgr.34412) 9632 : cluster [DBG] pgmap v5488: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:28.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:51:27 gibba015 bash[30343]: audit 2021-03-10T16:51:27.524100+0000 mon.a (mon.0) 2105 : audit [DBG] from='client.? 172.21.2.115:0/1557600515' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:51:29.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:51:28 gibba015 bash[29377]: audit 2021-03-10T16:51:27.038184+0000 mgr.gibba045.orlgmj (mgr.34412) 9633 : audit [DBG] from='client.60502 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:51:29.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:51:28 gibba015 bash[29377]: audit 2021-03-10T16:51:27.262236+0000 mgr.gibba045.orlgmj (mgr.34412) 9634 : audit [DBG] from='client.50520 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:51:29.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:51:28 gibba015 bash[30343]: audit 2021-03-10T16:51:27.038184+0000 mgr.gibba045.orlgmj (mgr.34412) 9633 : audit [DBG] from='client.60502 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:51:29.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:51:28 gibba015 bash[30343]: audit 2021-03-10T16:51:27.262236+0000 mgr.gibba045.orlgmj (mgr.34412) 9634 : audit [DBG] from='client.50520 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:51:29.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:51:28 gibba045 bash[25517]: audit 2021-03-10T16:51:27.038184+0000 mgr.gibba045.orlgmj (mgr.34412) 9633 : audit [DBG] from='client.60502 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:51:29.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:51:28 gibba045 bash[25517]: audit 2021-03-10T16:51:27.262236+0000 mgr.gibba045.orlgmj (mgr.34412) 9634 : audit [DBG] from='client.50520 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:51:30.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:51:29 gibba015 bash[29377]: cephadm 2021-03-10T16:51:28.441206+0000 mgr.gibba045.orlgmj (mgr.34412) 9635 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:51:30.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:51:29 gibba015 bash[29377]: cluster 2021-03-10T16:51:28.938241+0000 mgr.gibba045.orlgmj (mgr.34412) 9636 : cluster [DBG] pgmap v5489: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:30.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:51:29 gibba015 bash[30343]: cephadm 2021-03-10T16:51:28.441206+0000 mgr.gibba045.orlgmj (mgr.34412) 9635 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:51:30.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:51:29 gibba015 bash[30343]: cluster 2021-03-10T16:51:28.938241+0000 mgr.gibba045.orlgmj (mgr.34412) 9636 : cluster [DBG] pgmap v5489: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:30.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:51:29 gibba045 bash[25517]: cephadm 2021-03-10T16:51:28.441206+0000 mgr.gibba045.orlgmj (mgr.34412) 9635 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:51:30.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:51:29 gibba045 bash[25517]: cluster 2021-03-10T16:51:28.938241+0000 mgr.gibba045.orlgmj (mgr.34412) 9636 : cluster [DBG] pgmap v5489: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:32.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:51:32 gibba045 bash[25517]: cluster 2021-03-10T16:51:30.939886+0000 mgr.gibba045.orlgmj (mgr.34412) 9637 : cluster [DBG] pgmap v5490: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:32.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:51:32 gibba015 bash[29377]: cluster 2021-03-10T16:51:30.939886+0000 mgr.gibba045.orlgmj (mgr.34412) 9637 : cluster [DBG] pgmap v5490: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:32.469 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:51:32 gibba015 bash[30343]: cluster 2021-03-10T16:51:30.939886+0000 mgr.gibba045.orlgmj (mgr.34412) 9637 : cluster [DBG] pgmap v5490: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:34.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:51:34 gibba045 bash[25517]: cluster 2021-03-10T16:51:32.941572+0000 mgr.gibba045.orlgmj (mgr.34412) 9638 : cluster [DBG] pgmap v5491: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:34.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:51:34 gibba015 bash[29377]: cluster 2021-03-10T16:51:32.941572+0000 mgr.gibba045.orlgmj (mgr.34412) 9638 : cluster [DBG] pgmap v5491: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:34.469 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:51:34 gibba015 bash[30343]: cluster 2021-03-10T16:51:32.941572+0000 mgr.gibba045.orlgmj (mgr.34412) 9638 : cluster [DBG] pgmap v5491: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:36.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:51:36 gibba045 bash[25517]: cluster 2021-03-10T16:51:34.943217+0000 mgr.gibba045.orlgmj (mgr.34412) 9639 : cluster [DBG] pgmap v5492: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:36.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:51:36 gibba015 bash[29377]: cluster 2021-03-10T16:51:34.943217+0000 mgr.gibba045.orlgmj (mgr.34412) 9639 : cluster [DBG] pgmap v5492: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:36.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:51:36 gibba015 bash[30343]: cluster 2021-03-10T16:51:34.943217+0000 mgr.gibba045.orlgmj (mgr.34412) 9639 : cluster [DBG] pgmap v5492: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:38.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:51:37 gibba015 bash[29377]: cluster 2021-03-10T16:51:36.945068+0000 mgr.gibba045.orlgmj (mgr.34412) 9640 : cluster [DBG] pgmap v5493: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:38.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:51:37 gibba015 bash[30343]: cluster 2021-03-10T16:51:36.945068+0000 mgr.gibba045.orlgmj (mgr.34412) 9640 : cluster [DBG] pgmap v5493: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:38.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:51:37 gibba045 bash[25517]: cluster 2021-03-10T16:51:36.945068+0000 mgr.gibba045.orlgmj (mgr.34412) 9640 : cluster [DBG] pgmap v5493: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:40.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:51:40 gibba045 bash[25517]: cluster 2021-03-10T16:51:38.946283+0000 mgr.gibba045.orlgmj (mgr.34412) 9641 : cluster [DBG] pgmap v5494: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:40.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:51:40 gibba015 bash[29377]: cluster 2021-03-10T16:51:38.946283+0000 mgr.gibba045.orlgmj (mgr.34412) 9641 : cluster [DBG] pgmap v5494: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:40.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:51:40 gibba015 bash[30343]: cluster 2021-03-10T16:51:38.946283+0000 mgr.gibba045.orlgmj (mgr.34412) 9641 : cluster [DBG] pgmap v5494: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:42.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:51:42 gibba045 bash[25517]: cluster 2021-03-10T16:51:40.948088+0000 mgr.gibba045.orlgmj (mgr.34412) 9642 : cluster [DBG] pgmap v5495: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:42.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:51:42 gibba015 bash[29377]: cluster 2021-03-10T16:51:40.948088+0000 mgr.gibba045.orlgmj (mgr.34412) 9642 : cluster [DBG] pgmap v5495: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:42.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:51:42 gibba015 bash[30343]: cluster 2021-03-10T16:51:40.948088+0000 mgr.gibba045.orlgmj (mgr.34412) 9642 : cluster [DBG] pgmap v5495: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:44.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:51:44 gibba045 bash[25517]: cluster 2021-03-10T16:51:42.949518+0000 mgr.gibba045.orlgmj (mgr.34412) 9643 : cluster [DBG] pgmap v5496: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:44.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:51:44 gibba015 bash[29377]: cluster 2021-03-10T16:51:42.949518+0000 mgr.gibba045.orlgmj (mgr.34412) 9643 : cluster [DBG] pgmap v5496: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:44.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:51:44 gibba015 bash[30343]: cluster 2021-03-10T16:51:42.949518+0000 mgr.gibba045.orlgmj (mgr.34412) 9643 : cluster [DBG] pgmap v5496: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:45.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:51:45 gibba045 bash[25517]: cephadm 2021-03-10T16:51:43.457267+0000 mgr.gibba045.orlgmj (mgr.34412) 9644 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:51:45.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:51:45 gibba045 bash[25517]: cluster 2021-03-10T16:51:44.951143+0000 mgr.gibba045.orlgmj (mgr.34412) 9645 : cluster [DBG] pgmap v5497: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:45.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:51:45 gibba015 bash[29377]: cephadm 2021-03-10T16:51:43.457267+0000 mgr.gibba045.orlgmj (mgr.34412) 9644 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:51:45.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:51:45 gibba015 bash[29377]: cluster 2021-03-10T16:51:44.951143+0000 mgr.gibba045.orlgmj (mgr.34412) 9645 : cluster [DBG] pgmap v5497: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:45.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:51:45 gibba015 bash[30343]: cephadm 2021-03-10T16:51:43.457267+0000 mgr.gibba045.orlgmj (mgr.34412) 9644 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:51:45.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:51:45 gibba015 bash[30343]: cluster 2021-03-10T16:51:44.951143+0000 mgr.gibba045.orlgmj (mgr.34412) 9645 : cluster [DBG] pgmap v5497: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:48.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:51:47 gibba015 bash[29377]: cluster 2021-03-10T16:51:46.952910+0000 mgr.gibba045.orlgmj (mgr.34412) 9646 : cluster [DBG] pgmap v5498: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:48.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:51:47 gibba015 bash[30343]: cluster 2021-03-10T16:51:46.952910+0000 mgr.gibba045.orlgmj (mgr.34412) 9646 : cluster [DBG] pgmap v5498: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:48.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:51:47 gibba045 bash[25517]: cluster 2021-03-10T16:51:46.952910+0000 mgr.gibba045.orlgmj (mgr.34412) 9646 : cluster [DBG] pgmap v5498: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:50.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:51:50 gibba045 bash[25517]: cluster 2021-03-10T16:51:48.954140+0000 mgr.gibba045.orlgmj (mgr.34412) 9647 : cluster [DBG] pgmap v5499: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:50.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:51:50 gibba015 bash[29377]: cluster 2021-03-10T16:51:48.954140+0000 mgr.gibba045.orlgmj (mgr.34412) 9647 : cluster [DBG] pgmap v5499: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:50.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:51:50 gibba015 bash[30343]: cluster 2021-03-10T16:51:48.954140+0000 mgr.gibba045.orlgmj (mgr.34412) 9647 : cluster [DBG] pgmap v5499: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:52.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:51:52 gibba045 bash[25517]: cluster 2021-03-10T16:51:50.955644+0000 mgr.gibba045.orlgmj (mgr.34412) 9648 : cluster [DBG] pgmap v5500: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:52.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:51:52 gibba015 bash[29377]: cluster 2021-03-10T16:51:50.955644+0000 mgr.gibba045.orlgmj (mgr.34412) 9648 : cluster [DBG] pgmap v5500: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:52.469 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:51:52 gibba015 bash[30343]: cluster 2021-03-10T16:51:50.955644+0000 mgr.gibba045.orlgmj (mgr.34412) 9648 : cluster [DBG] pgmap v5500: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:54.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:51:54 gibba045 bash[25517]: cluster 2021-03-10T16:51:52.957228+0000 mgr.gibba045.orlgmj (mgr.34412) 9649 : cluster [DBG] pgmap v5501: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:54.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:51:54 gibba045 bash[25517]: audit 2021-03-10T16:51:53.765360+0000 mon.c (mon.1) 2652 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:51:54.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:51:54 gibba045 bash[25517]: audit 2021-03-10T16:51:53.765972+0000 mon.c (mon.1) 2653 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:51:54.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:51:54 gibba045 bash[25517]: audit 2021-03-10T16:51:53.766468+0000 mon.a (mon.0) 2106 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:51:54.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:51:54 gibba045 bash[25517]: audit 2021-03-10T16:51:53.767715+0000 mon.a (mon.0) 2107 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:51:54.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:51:54 gibba045 bash[25517]: audit 2021-03-10T16:51:53.781243+0000 mon.c (mon.1) 2654 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T16:51:54.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:51:54 gibba045 bash[25517]: audit 2021-03-10T16:51:53.781974+0000 mon.c (mon.1) 2655 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:51:54.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:51:54 gibba045 bash[25517]: audit 2021-03-10T16:51:53.782488+0000 mon.a (mon.0) 2108 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T16:51:54.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:51:54 gibba045 bash[25517]: audit 2021-03-10T16:51:53.782925+0000 mon.c (mon.1) 2656 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:51:54.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:51:54 gibba045 bash[25517]: audit 2021-03-10T16:51:53.783676+0000 mon.a (mon.0) 2109 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:51:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:51:54 gibba045 bash[25517]: audit 2021-03-10T16:51:53.784289+0000 mon.c (mon.1) 2657 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:51:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:51:54 gibba045 bash[25517]: audit 2021-03-10T16:51:53.784594+0000 mon.a (mon.0) 2110 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:51:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:51:54 gibba045 bash[25517]: audit 2021-03-10T16:51:53.785440+0000 mon.a (mon.0) 2111 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:51:54.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:51:54 gibba015 bash[29377]: cluster 2021-03-10T16:51:52.957228+0000 mgr.gibba045.orlgmj (mgr.34412) 9649 : cluster [DBG] pgmap v5501: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:54.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:51:54 gibba015 bash[29377]: audit 2021-03-10T16:51:53.765360+0000 mon.c (mon.1) 2652 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:51:54.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:51:54 gibba015 bash[29377]: audit 2021-03-10T16:51:53.765972+0000 mon.c (mon.1) 2653 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:51:54.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:51:54 gibba015 bash[29377]: audit 2021-03-10T16:51:53.766468+0000 mon.a (mon.0) 2106 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:51:54.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:51:54 gibba015 bash[29377]: audit 2021-03-10T16:51:53.767715+0000 mon.a (mon.0) 2107 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:51:54.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:51:54 gibba015 bash[29377]: audit 2021-03-10T16:51:53.781243+0000 mon.c (mon.1) 2654 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T16:51:54.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:51:54 gibba015 bash[29377]: audit 2021-03-10T16:51:53.781974+0000 mon.c (mon.1) 2655 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:51:54.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:51:54 gibba015 bash[29377]: audit 2021-03-10T16:51:53.782488+0000 mon.a (mon.0) 2108 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T16:51:54.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:51:54 gibba015 bash[29377]: audit 2021-03-10T16:51:53.782925+0000 mon.c (mon.1) 2656 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:51:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:51:54 gibba015 bash[29377]: audit 2021-03-10T16:51:53.783676+0000 mon.a (mon.0) 2109 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:51:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:51:54 gibba015 bash[29377]: audit 2021-03-10T16:51:53.784289+0000 mon.c (mon.1) 2657 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:51:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:51:54 gibba015 bash[29377]: audit 2021-03-10T16:51:53.784594+0000 mon.a (mon.0) 2110 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:51:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:51:54 gibba015 bash[29377]: audit 2021-03-10T16:51:53.785440+0000 mon.a (mon.0) 2111 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:51:54.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:51:54 gibba015 bash[30343]: cluster 2021-03-10T16:51:52.957228+0000 mgr.gibba045.orlgmj (mgr.34412) 9649 : cluster [DBG] pgmap v5501: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:54.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:51:54 gibba015 bash[30343]: audit 2021-03-10T16:51:53.765360+0000 mon.c (mon.1) 2652 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:51:54.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:51:54 gibba015 bash[30343]: audit 2021-03-10T16:51:53.765972+0000 mon.c (mon.1) 2653 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:51:54.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:51:54 gibba015 bash[30343]: audit 2021-03-10T16:51:53.766468+0000 mon.a (mon.0) 2106 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:51:54.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:51:54 gibba015 bash[30343]: audit 2021-03-10T16:51:53.767715+0000 mon.a (mon.0) 2107 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:51:54.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:51:54 gibba015 bash[30343]: audit 2021-03-10T16:51:53.781243+0000 mon.c (mon.1) 2654 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T16:51:54.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:51:54 gibba015 bash[30343]: audit 2021-03-10T16:51:53.781974+0000 mon.c (mon.1) 2655 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:51:54.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:51:54 gibba015 bash[30343]: audit 2021-03-10T16:51:53.782488+0000 mon.a (mon.0) 2108 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T16:51:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:51:54 gibba015 bash[30343]: audit 2021-03-10T16:51:53.782925+0000 mon.c (mon.1) 2656 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:51:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:51:54 gibba015 bash[30343]: audit 2021-03-10T16:51:53.783676+0000 mon.a (mon.0) 2109 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:51:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:51:54 gibba015 bash[30343]: audit 2021-03-10T16:51:53.784289+0000 mon.c (mon.1) 2657 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:51:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:51:54 gibba015 bash[30343]: audit 2021-03-10T16:51:53.784594+0000 mon.a (mon.0) 2110 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:51:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:51:54 gibba015 bash[30343]: audit 2021-03-10T16:51:53.785440+0000 mon.a (mon.0) 2111 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:51:55.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:51:55 gibba045 bash[25517]: cluster 2021-03-10T16:51:54.958725+0000 mgr.gibba045.orlgmj (mgr.34412) 9650 : cluster [DBG] pgmap v5502: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:55.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:51:55 gibba015 bash[29377]: cluster 2021-03-10T16:51:54.958725+0000 mgr.gibba045.orlgmj (mgr.34412) 9650 : cluster [DBG] pgmap v5502: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:55.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:51:55 gibba015 bash[30343]: cluster 2021-03-10T16:51:54.958725+0000 mgr.gibba045.orlgmj (mgr.34412) 9650 : cluster [DBG] pgmap v5502: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:57.765 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:51:57.992 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:51:57.992 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 5m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:51:57.992 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 4m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:51:57.992 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:51:57.993 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:51:57.993 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:51:57.993 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:51:57.993 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:51:57.994 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:51:57.994 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 5m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:51:57.994 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 4m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:51:57.994 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:51:57.995 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:51:57.995 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:51:57.995 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:51:57.995 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:51:57.995 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:51:57.996 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:51:57.996 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:51:57.996 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 4m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:51:57.996 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 4m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:51:58.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:51:57 gibba015 bash[29377]: cluster 2021-03-10T16:51:56.960500+0000 mgr.gibba045.orlgmj (mgr.34412) 9651 : cluster [DBG] pgmap v5503: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:58.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:51:57 gibba015 bash[30343]: cluster 2021-03-10T16:51:56.960500+0000 mgr.gibba045.orlgmj (mgr.34412) 9651 : cluster [DBG] pgmap v5503: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:58.241 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:51:58.241 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:51:58.242 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:51:58.242 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:51:58.243 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:51:58.243 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:51:58.243 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:51:58.244 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:51:58.244 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:51:58.245 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:51:58.245 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:51:58.246 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:51:58.246 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:51:58.247 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:51:58.247 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:51:58.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:51:57 gibba045 bash[25517]: cluster 2021-03-10T16:51:56.960500+0000 mgr.gibba045.orlgmj (mgr.34412) 9651 : cluster [DBG] pgmap v5503: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:59.053 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:51:58 gibba045 bash[25517]: audit 2021-03-10T16:51:57.759483+0000 mgr.gibba045.orlgmj (mgr.34412) 9652 : audit [DBG] from='client.50532 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:51:59.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:51:58 gibba045 bash[25517]: audit 2021-03-10T16:51:57.985218+0000 mgr.gibba045.orlgmj (mgr.34412) 9653 : audit [DBG] from='client.50538 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:51:59.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:51:58 gibba045 bash[25517]: audit 2021-03-10T16:51:58.242041+0000 mon.c (mon.1) 2658 : audit [DBG] from='client.? 172.21.2.115:0/4257891127' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:51:59.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:51:58 gibba045 bash[25517]: audit 2021-03-10T16:51:58.471688+0000 mon.c (mon.1) 2659 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:51:59.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:51:58 gibba045 bash[25517]: audit 2021-03-10T16:51:58.696029+0000 mon.a (mon.0) 2112 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:51:59.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:51:58 gibba045 bash[25517]: audit 2021-03-10T16:51:58.700268+0000 mon.c (mon.1) 2660 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:51:59.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:51:58 gibba045 bash[25517]: audit 2021-03-10T16:51:58.703063+0000 mon.c (mon.1) 2661 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:51:59.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:51:58 gibba045 bash[25517]: audit 2021-03-10T16:51:58.705483+0000 mon.c (mon.1) 2662 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:51:59.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:51:58 gibba045 bash[25517]: audit 2021-03-10T16:51:58.708133+0000 mon.c (mon.1) 2663 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:51:59.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:51:58 gibba045 bash[25517]: audit 2021-03-10T16:51:58.716965+0000 mon.c (mon.1) 2664 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:51:59.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:51:58 gibba045 bash[25517]: audit 2021-03-10T16:51:58.723822+0000 mon.c (mon.1) 2665 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:51:59.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:51:58 gibba015 bash[29377]: audit 2021-03-10T16:51:57.759483+0000 mgr.gibba045.orlgmj (mgr.34412) 9652 : audit [DBG] from='client.50532 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:51:59.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:51:58 gibba015 bash[29377]: audit 2021-03-10T16:51:57.985218+0000 mgr.gibba045.orlgmj (mgr.34412) 9653 : audit [DBG] from='client.50538 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:51:59.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:51:58 gibba015 bash[29377]: audit 2021-03-10T16:51:58.242041+0000 mon.c (mon.1) 2658 : audit [DBG] from='client.? 172.21.2.115:0/4257891127' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:51:59.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:51:58 gibba015 bash[29377]: audit 2021-03-10T16:51:58.471688+0000 mon.c (mon.1) 2659 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:51:59.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:51:58 gibba015 bash[29377]: audit 2021-03-10T16:51:58.696029+0000 mon.a (mon.0) 2112 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:51:59.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:51:58 gibba015 bash[29377]: audit 2021-03-10T16:51:58.700268+0000 mon.c (mon.1) 2660 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:51:59.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:51:58 gibba015 bash[29377]: audit 2021-03-10T16:51:58.703063+0000 mon.c (mon.1) 2661 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:51:59.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:51:58 gibba015 bash[29377]: audit 2021-03-10T16:51:58.705483+0000 mon.c (mon.1) 2662 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:51:59.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:51:58 gibba015 bash[29377]: audit 2021-03-10T16:51:58.708133+0000 mon.c (mon.1) 2663 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:51:59.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:51:58 gibba015 bash[29377]: audit 2021-03-10T16:51:58.716965+0000 mon.c (mon.1) 2664 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:51:59.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:51:58 gibba015 bash[29377]: audit 2021-03-10T16:51:58.723822+0000 mon.c (mon.1) 2665 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:51:59.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:51:58 gibba015 bash[30343]: audit 2021-03-10T16:51:57.759483+0000 mgr.gibba045.orlgmj (mgr.34412) 9652 : audit [DBG] from='client.50532 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:51:59.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:51:58 gibba015 bash[30343]: audit 2021-03-10T16:51:57.985218+0000 mgr.gibba045.orlgmj (mgr.34412) 9653 : audit [DBG] from='client.50538 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:51:59.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:51:58 gibba015 bash[30343]: audit 2021-03-10T16:51:58.242041+0000 mon.c (mon.1) 2658 : audit [DBG] from='client.? 172.21.2.115:0/4257891127' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:51:59.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:51:58 gibba015 bash[30343]: audit 2021-03-10T16:51:58.471688+0000 mon.c (mon.1) 2659 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:51:59.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:51:58 gibba015 bash[30343]: audit 2021-03-10T16:51:58.696029+0000 mon.a (mon.0) 2112 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:51:59.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:51:58 gibba015 bash[30343]: audit 2021-03-10T16:51:58.700268+0000 mon.c (mon.1) 2660 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:51:59.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:51:58 gibba015 bash[30343]: audit 2021-03-10T16:51:58.703063+0000 mon.c (mon.1) 2661 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:51:59.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:51:58 gibba015 bash[30343]: audit 2021-03-10T16:51:58.705483+0000 mon.c (mon.1) 2662 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:51:59.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:51:58 gibba015 bash[30343]: audit 2021-03-10T16:51:58.708133+0000 mon.c (mon.1) 2663 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:51:59.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:51:58 gibba015 bash[30343]: audit 2021-03-10T16:51:58.716965+0000 mon.c (mon.1) 2664 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:51:59.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:51:58 gibba015 bash[30343]: audit 2021-03-10T16:51:58.723822+0000 mon.c (mon.1) 2665 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:52:00.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:51:59 gibba015 bash[29377]: cephadm 2021-03-10T16:51:58.479968+0000 mgr.gibba045.orlgmj (mgr.34412) 9654 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:52:00.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:51:59 gibba015 bash[29377]: cephadm 2021-03-10T16:51:58.481737+0000 mgr.gibba045.orlgmj (mgr.34412) 9655 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:52:00.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:51:59 gibba015 bash[29377]: cephadm 2021-03-10T16:51:58.701456+0000 mgr.gibba045.orlgmj (mgr.34412) 9656 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:52:00.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:51:59 gibba015 bash[29377]: cephadm 2021-03-10T16:51:58.704639+0000 mgr.gibba045.orlgmj (mgr.34412) 9657 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:52:00.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:51:59 gibba015 bash[29377]: cephadm 2021-03-10T16:51:58.707011+0000 mgr.gibba045.orlgmj (mgr.34412) 9658 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:52:00.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:51:59 gibba015 bash[29377]: cephadm 2021-03-10T16:51:58.707050+0000 mgr.gibba045.orlgmj (mgr.34412) 9659 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:52:00.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:51:59 gibba015 bash[29377]: cephadm 2021-03-10T16:51:58.709754+0000 mgr.gibba045.orlgmj (mgr.34412) 9660 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:52:00.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:51:59 gibba015 bash[29377]: cephadm 2021-03-10T16:51:58.709790+0000 mgr.gibba045.orlgmj (mgr.34412) 9661 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:52:00.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:51:59 gibba015 bash[29377]: cephadm 2021-03-10T16:51:58.712117+0000 mgr.gibba045.orlgmj (mgr.34412) 9662 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:52:00.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:51:59 gibba015 bash[29377]: cephadm 2021-03-10T16:51:58.716952+0000 mgr.gibba045.orlgmj (mgr.34412) 9663 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:52:00.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:51:59 gibba015 bash[29377]: cephadm 2021-03-10T16:51:58.717260+0000 mgr.gibba045.orlgmj (mgr.34412) 9664 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:52:00.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:51:59 gibba015 bash[29377]: cephadm 2021-03-10T16:51:58.722526+0000 mgr.gibba045.orlgmj (mgr.34412) 9665 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:52:00.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:51:59 gibba015 bash[29377]: cephadm 2021-03-10T16:51:58.724757+0000 mgr.gibba045.orlgmj (mgr.34412) 9666 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:52:00.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:51:59 gibba015 bash[29377]: cephadm 2021-03-10T16:51:58.728795+0000 mgr.gibba045.orlgmj (mgr.34412) 9667 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:52:00.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:51:59 gibba015 bash[29377]: cephadm 2021-03-10T16:51:58.729324+0000 mgr.gibba045.orlgmj (mgr.34412) 9668 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:52:00.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:51:59 gibba015 bash[29377]: cephadm 2021-03-10T16:51:58.729925+0000 mgr.gibba045.orlgmj (mgr.34412) 9669 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:52:00.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:51:59 gibba015 bash[29377]: cluster 2021-03-10T16:51:58.961751+0000 mgr.gibba045.orlgmj (mgr.34412) 9670 : cluster [DBG] pgmap v5504: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:00.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:51:59 gibba015 bash[30343]: cephadm 2021-03-10T16:51:58.479968+0000 mgr.gibba045.orlgmj (mgr.34412) 9654 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:52:00.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:51:59 gibba015 bash[30343]: cephadm 2021-03-10T16:51:58.481737+0000 mgr.gibba045.orlgmj (mgr.34412) 9655 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:52:00.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:51:59 gibba015 bash[30343]: cephadm 2021-03-10T16:51:58.701456+0000 mgr.gibba045.orlgmj (mgr.34412) 9656 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:52:00.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:51:59 gibba015 bash[30343]: cephadm 2021-03-10T16:51:58.704639+0000 mgr.gibba045.orlgmj (mgr.34412) 9657 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:52:00.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:51:59 gibba015 bash[30343]: cephadm 2021-03-10T16:51:58.707011+0000 mgr.gibba045.orlgmj (mgr.34412) 9658 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:52:00.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:51:59 gibba015 bash[30343]: cephadm 2021-03-10T16:51:58.707050+0000 mgr.gibba045.orlgmj (mgr.34412) 9659 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:52:00.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:51:59 gibba015 bash[30343]: cephadm 2021-03-10T16:51:58.709754+0000 mgr.gibba045.orlgmj (mgr.34412) 9660 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:52:00.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:51:59 gibba015 bash[30343]: cephadm 2021-03-10T16:51:58.709790+0000 mgr.gibba045.orlgmj (mgr.34412) 9661 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:52:00.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:51:59 gibba015 bash[30343]: cephadm 2021-03-10T16:51:58.712117+0000 mgr.gibba045.orlgmj (mgr.34412) 9662 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:52:00.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:51:59 gibba015 bash[30343]: cephadm 2021-03-10T16:51:58.716952+0000 mgr.gibba045.orlgmj (mgr.34412) 9663 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:52:00.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:51:59 gibba015 bash[30343]: cephadm 2021-03-10T16:51:58.717260+0000 mgr.gibba045.orlgmj (mgr.34412) 9664 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:52:00.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:51:59 gibba015 bash[30343]: cephadm 2021-03-10T16:51:58.722526+0000 mgr.gibba045.orlgmj (mgr.34412) 9665 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:52:00.236 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:51:59 gibba015 bash[30343]: cephadm 2021-03-10T16:51:58.724757+0000 mgr.gibba045.orlgmj (mgr.34412) 9666 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:52:00.236 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:51:59 gibba015 bash[30343]: cephadm 2021-03-10T16:51:58.728795+0000 mgr.gibba045.orlgmj (mgr.34412) 9667 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:52:00.236 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:51:59 gibba015 bash[30343]: cephadm 2021-03-10T16:51:58.729324+0000 mgr.gibba045.orlgmj (mgr.34412) 9668 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:52:00.237 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:51:59 gibba015 bash[30343]: cephadm 2021-03-10T16:51:58.729925+0000 mgr.gibba045.orlgmj (mgr.34412) 9669 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:52:00.237 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:51:59 gibba015 bash[30343]: cluster 2021-03-10T16:51:58.961751+0000 mgr.gibba045.orlgmj (mgr.34412) 9670 : cluster [DBG] pgmap v5504: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:00.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:51:59 gibba045 bash[25517]: cephadm 2021-03-10T16:51:58.479968+0000 mgr.gibba045.orlgmj (mgr.34412) 9654 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:52:00.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:51:59 gibba045 bash[25517]: cephadm 2021-03-10T16:51:58.481737+0000 mgr.gibba045.orlgmj (mgr.34412) 9655 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:52:00.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:51:59 gibba045 bash[25517]: cephadm 2021-03-10T16:51:58.701456+0000 mgr.gibba045.orlgmj (mgr.34412) 9656 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:52:00.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:51:59 gibba045 bash[25517]: cephadm 2021-03-10T16:51:58.704639+0000 mgr.gibba045.orlgmj (mgr.34412) 9657 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:52:00.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:51:59 gibba045 bash[25517]: cephadm 2021-03-10T16:51:58.707011+0000 mgr.gibba045.orlgmj (mgr.34412) 9658 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:52:00.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:51:59 gibba045 bash[25517]: cephadm 2021-03-10T16:51:58.707050+0000 mgr.gibba045.orlgmj (mgr.34412) 9659 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:52:00.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:51:59 gibba045 bash[25517]: cephadm 2021-03-10T16:51:58.709754+0000 mgr.gibba045.orlgmj (mgr.34412) 9660 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:52:00.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:51:59 gibba045 bash[25517]: cephadm 2021-03-10T16:51:58.709790+0000 mgr.gibba045.orlgmj (mgr.34412) 9661 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:52:00.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:51:59 gibba045 bash[25517]: cephadm 2021-03-10T16:51:58.712117+0000 mgr.gibba045.orlgmj (mgr.34412) 9662 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:52:00.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:51:59 gibba045 bash[25517]: cephadm 2021-03-10T16:51:58.716952+0000 mgr.gibba045.orlgmj (mgr.34412) 9663 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:52:00.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:51:59 gibba045 bash[25517]: cephadm 2021-03-10T16:51:58.717260+0000 mgr.gibba045.orlgmj (mgr.34412) 9664 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:52:00.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:51:59 gibba045 bash[25517]: cephadm 2021-03-10T16:51:58.722526+0000 mgr.gibba045.orlgmj (mgr.34412) 9665 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:52:00.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:51:59 gibba045 bash[25517]: cephadm 2021-03-10T16:51:58.724757+0000 mgr.gibba045.orlgmj (mgr.34412) 9666 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:52:00.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:51:59 gibba045 bash[25517]: cephadm 2021-03-10T16:51:58.728795+0000 mgr.gibba045.orlgmj (mgr.34412) 9667 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:52:00.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:51:59 gibba045 bash[25517]: cephadm 2021-03-10T16:51:58.729324+0000 mgr.gibba045.orlgmj (mgr.34412) 9668 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:52:00.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:51:59 gibba045 bash[25517]: cephadm 2021-03-10T16:51:58.729925+0000 mgr.gibba045.orlgmj (mgr.34412) 9669 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:52:00.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:51:59 gibba045 bash[25517]: cluster 2021-03-10T16:51:58.961751+0000 mgr.gibba045.orlgmj (mgr.34412) 9670 : cluster [DBG] pgmap v5504: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:02.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:52:02 gibba045 bash[25517]: cluster 2021-03-10T16:52:00.963592+0000 mgr.gibba045.orlgmj (mgr.34412) 9671 : cluster [DBG] pgmap v5505: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:02.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:52:02 gibba015 bash[29377]: cluster 2021-03-10T16:52:00.963592+0000 mgr.gibba045.orlgmj (mgr.34412) 9671 : cluster [DBG] pgmap v5505: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:02.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:52:02 gibba015 bash[30343]: cluster 2021-03-10T16:52:00.963592+0000 mgr.gibba045.orlgmj (mgr.34412) 9671 : cluster [DBG] pgmap v5505: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:04.302 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:52:04 gibba045 bash[25517]: cluster 2021-03-10T16:52:02.965034+0000 mgr.gibba045.orlgmj (mgr.34412) 9672 : cluster [DBG] pgmap v5506: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:04.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:52:04 gibba015 bash[29377]: cluster 2021-03-10T16:52:02.965034+0000 mgr.gibba045.orlgmj (mgr.34412) 9672 : cluster [DBG] pgmap v5506: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:04.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:52:04 gibba015 bash[30343]: cluster 2021-03-10T16:52:02.965034+0000 mgr.gibba045.orlgmj (mgr.34412) 9672 : cluster [DBG] pgmap v5506: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:05.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:52:05 gibba045 bash[25517]: cluster 2021-03-10T16:52:04.966794+0000 mgr.gibba045.orlgmj (mgr.34412) 9673 : cluster [DBG] pgmap v5507: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:05.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:52:05 gibba015 bash[29377]: cluster 2021-03-10T16:52:04.966794+0000 mgr.gibba045.orlgmj (mgr.34412) 9673 : cluster [DBG] pgmap v5507: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:05.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:52:05 gibba015 bash[30343]: cluster 2021-03-10T16:52:04.966794+0000 mgr.gibba045.orlgmj (mgr.34412) 9673 : cluster [DBG] pgmap v5507: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:08.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:52:07 gibba015 bash[29377]: cluster 2021-03-10T16:52:06.968624+0000 mgr.gibba045.orlgmj (mgr.34412) 9674 : cluster [DBG] pgmap v5508: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:08.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:52:07 gibba015 bash[30343]: cluster 2021-03-10T16:52:06.968624+0000 mgr.gibba045.orlgmj (mgr.34412) 9674 : cluster [DBG] pgmap v5508: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:08.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:52:07 gibba045 bash[25517]: cluster 2021-03-10T16:52:06.968624+0000 mgr.gibba045.orlgmj (mgr.34412) 9674 : cluster [DBG] pgmap v5508: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:10.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:52:10 gibba045 bash[25517]: cluster 2021-03-10T16:52:08.969915+0000 mgr.gibba045.orlgmj (mgr.34412) 9675 : cluster [DBG] pgmap v5509: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:10.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:52:10 gibba015 bash[29377]: cluster 2021-03-10T16:52:08.969915+0000 mgr.gibba045.orlgmj (mgr.34412) 9675 : cluster [DBG] pgmap v5509: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:10.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:52:10 gibba015 bash[30343]: cluster 2021-03-10T16:52:08.969915+0000 mgr.gibba045.orlgmj (mgr.34412) 9675 : cluster [DBG] pgmap v5509: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:11.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:52:11 gibba015 bash[29377]: cluster 2021-03-10T16:52:10.971541+0000 mgr.gibba045.orlgmj (mgr.34412) 9676 : cluster [DBG] pgmap v5510: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:11.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:52:11 gibba015 bash[30343]: cluster 2021-03-10T16:52:10.971541+0000 mgr.gibba045.orlgmj (mgr.34412) 9676 : cluster [DBG] pgmap v5510: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:11.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:52:11 gibba045 bash[25517]: cluster 2021-03-10T16:52:10.971541+0000 mgr.gibba045.orlgmj (mgr.34412) 9676 : cluster [DBG] pgmap v5510: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:14.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:52:14 gibba045 bash[25517]: cluster 2021-03-10T16:52:12.973196+0000 mgr.gibba045.orlgmj (mgr.34412) 9677 : cluster [DBG] pgmap v5511: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:14.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:52:14 gibba015 bash[29377]: cluster 2021-03-10T16:52:12.973196+0000 mgr.gibba045.orlgmj (mgr.34412) 9677 : cluster [DBG] pgmap v5511: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:14.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:52:14 gibba015 bash[30343]: cluster 2021-03-10T16:52:12.973196+0000 mgr.gibba045.orlgmj (mgr.34412) 9677 : cluster [DBG] pgmap v5511: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:15.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:52:15 gibba045 bash[25517]: cephadm 2021-03-10T16:52:13.733215+0000 mgr.gibba045.orlgmj (mgr.34412) 9678 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:52:15.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:52:15 gibba045 bash[25517]: cluster 2021-03-10T16:52:14.974614+0000 mgr.gibba045.orlgmj (mgr.34412) 9679 : cluster [DBG] pgmap v5512: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:15.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:52:15 gibba015 bash[29377]: cephadm 2021-03-10T16:52:13.733215+0000 mgr.gibba045.orlgmj (mgr.34412) 9678 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:52:15.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:52:15 gibba015 bash[29377]: cluster 2021-03-10T16:52:14.974614+0000 mgr.gibba045.orlgmj (mgr.34412) 9679 : cluster [DBG] pgmap v5512: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:15.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:52:15 gibba015 bash[30343]: cephadm 2021-03-10T16:52:13.733215+0000 mgr.gibba045.orlgmj (mgr.34412) 9678 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:52:15.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:52:15 gibba015 bash[30343]: cluster 2021-03-10T16:52:14.974614+0000 mgr.gibba045.orlgmj (mgr.34412) 9679 : cluster [DBG] pgmap v5512: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:18.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:52:17 gibba015 bash[29377]: cluster 2021-03-10T16:52:16.976374+0000 mgr.gibba045.orlgmj (mgr.34412) 9680 : cluster [DBG] pgmap v5513: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:18.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:52:17 gibba015 bash[30343]: cluster 2021-03-10T16:52:16.976374+0000 mgr.gibba045.orlgmj (mgr.34412) 9680 : cluster [DBG] pgmap v5513: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:18.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:52:17 gibba045 bash[25517]: cluster 2021-03-10T16:52:16.976374+0000 mgr.gibba045.orlgmj (mgr.34412) 9680 : cluster [DBG] pgmap v5513: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:20.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:52:20 gibba045 bash[25517]: cluster 2021-03-10T16:52:18.977652+0000 mgr.gibba045.orlgmj (mgr.34412) 9681 : cluster [DBG] pgmap v5514: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:20.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:52:20 gibba015 bash[29377]: cluster 2021-03-10T16:52:18.977652+0000 mgr.gibba045.orlgmj (mgr.34412) 9681 : cluster [DBG] pgmap v5514: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:20.469 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:52:20 gibba015 bash[30343]: cluster 2021-03-10T16:52:18.977652+0000 mgr.gibba045.orlgmj (mgr.34412) 9681 : cluster [DBG] pgmap v5514: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:21.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:52:21 gibba045 bash[25517]: cluster 2021-03-10T16:52:20.979527+0000 mgr.gibba045.orlgmj (mgr.34412) 9682 : cluster [DBG] pgmap v5515: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:21.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:52:21 gibba015 bash[29377]: cluster 2021-03-10T16:52:20.979527+0000 mgr.gibba045.orlgmj (mgr.34412) 9682 : cluster [DBG] pgmap v5515: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:21.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:52:21 gibba015 bash[30343]: cluster 2021-03-10T16:52:20.979527+0000 mgr.gibba045.orlgmj (mgr.34412) 9682 : cluster [DBG] pgmap v5515: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:23.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:52:23 gibba015 bash[29377]: cluster 2021-03-10T16:52:22.981116+0000 mgr.gibba045.orlgmj (mgr.34412) 9683 : cluster [DBG] pgmap v5516: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:23.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:52:23 gibba015 bash[30343]: cluster 2021-03-10T16:52:22.981116+0000 mgr.gibba045.orlgmj (mgr.34412) 9683 : cluster [DBG] pgmap v5516: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:23.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:52:23 gibba045 bash[25517]: cluster 2021-03-10T16:52:22.981116+0000 mgr.gibba045.orlgmj (mgr.34412) 9683 : cluster [DBG] pgmap v5516: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:25.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:52:25 gibba015 bash[29377]: cluster 2021-03-10T16:52:24.982747+0000 mgr.gibba045.orlgmj (mgr.34412) 9684 : cluster [DBG] pgmap v5517: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:25.469 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:52:25 gibba015 bash[30343]: cluster 2021-03-10T16:52:24.982747+0000 mgr.gibba045.orlgmj (mgr.34412) 9684 : cluster [DBG] pgmap v5517: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:25.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:52:25 gibba045 bash[25517]: cluster 2021-03-10T16:52:24.982747+0000 mgr.gibba045.orlgmj (mgr.34412) 9684 : cluster [DBG] pgmap v5517: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:28.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:52:27 gibba015 bash[29377]: cluster 2021-03-10T16:52:26.984416+0000 mgr.gibba045.orlgmj (mgr.34412) 9685 : cluster [DBG] pgmap v5518: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:28.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:52:27 gibba015 bash[30343]: cluster 2021-03-10T16:52:26.984416+0000 mgr.gibba045.orlgmj (mgr.34412) 9685 : cluster [DBG] pgmap v5518: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:28.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:52:27 gibba045 bash[25517]: cluster 2021-03-10T16:52:26.984416+0000 mgr.gibba045.orlgmj (mgr.34412) 9685 : cluster [DBG] pgmap v5518: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:28.486 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:52:28.744 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:52:28.744 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 5m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:52:28.745 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 4m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:52:28.745 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:52:28.745 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:52:28.745 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:52:28.746 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:52:28.746 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:52:28.746 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:52:28.746 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 5m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:52:28.746 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 4m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:52:28.747 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:52:28.747 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:52:28.747 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:52:28.747 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:52:28.748 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:52:28.748 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:52:28.751 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:52:28.752 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:52:28.752 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 4m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:52:28.752 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 4m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:52:29.006 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:52:29.007 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:52:29.007 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:52:29.007 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:52:29.008 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:52:29.008 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:52:29.008 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:52:29.008 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:52:29.008 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:52:29.009 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:52:29.009 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:52:29.009 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:52:29.009 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:52:29.010 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:52:29.010 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:52:29.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:52:29 gibba015 bash[29377]: audit 2021-03-10T16:52:28.478777+0000 mgr.gibba045.orlgmj (mgr.34412) 9686 : audit [DBG] from='client.50550 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:52:29.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:52:29 gibba015 bash[29377]: audit 2021-03-10T16:52:28.706580+0000 mgr.gibba045.orlgmj (mgr.34412) 9687 : audit [DBG] from='client.50556 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:52:29.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:52:29 gibba015 bash[29377]: cephadm 2021-03-10T16:52:28.748944+0000 mgr.gibba045.orlgmj (mgr.34412) 9688 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:52:29.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:52:29 gibba015 bash[29377]: cluster 2021-03-10T16:52:28.985634+0000 mgr.gibba045.orlgmj (mgr.34412) 9689 : cluster [DBG] pgmap v5519: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:29.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:52:29 gibba015 bash[29377]: audit 2021-03-10T16:52:29.007456+0000 mon.c (mon.1) 2666 : audit [DBG] from='client.? 172.21.2.115:0/217773872' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:52:29.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:52:29 gibba015 bash[30343]: audit 2021-03-10T16:52:28.478777+0000 mgr.gibba045.orlgmj (mgr.34412) 9686 : audit [DBG] from='client.50550 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:52:29.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:52:29 gibba015 bash[30343]: audit 2021-03-10T16:52:28.706580+0000 mgr.gibba045.orlgmj (mgr.34412) 9687 : audit [DBG] from='client.50556 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:52:29.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:52:29 gibba015 bash[30343]: cephadm 2021-03-10T16:52:28.748944+0000 mgr.gibba045.orlgmj (mgr.34412) 9688 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:52:29.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:52:29 gibba015 bash[30343]: cluster 2021-03-10T16:52:28.985634+0000 mgr.gibba045.orlgmj (mgr.34412) 9689 : cluster [DBG] pgmap v5519: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:29.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:52:29 gibba015 bash[30343]: audit 2021-03-10T16:52:29.007456+0000 mon.c (mon.1) 2666 : audit [DBG] from='client.? 172.21.2.115:0/217773872' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:52:29.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:52:29 gibba045 bash[25517]: audit 2021-03-10T16:52:28.478777+0000 mgr.gibba045.orlgmj (mgr.34412) 9686 : audit [DBG] from='client.50550 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:52:29.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:52:29 gibba045 bash[25517]: audit 2021-03-10T16:52:28.706580+0000 mgr.gibba045.orlgmj (mgr.34412) 9687 : audit [DBG] from='client.50556 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:52:29.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:52:29 gibba045 bash[25517]: cephadm 2021-03-10T16:52:28.748944+0000 mgr.gibba045.orlgmj (mgr.34412) 9688 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:52:29.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:52:29 gibba045 bash[25517]: cluster 2021-03-10T16:52:28.985634+0000 mgr.gibba045.orlgmj (mgr.34412) 9689 : cluster [DBG] pgmap v5519: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:29.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:52:29 gibba045 bash[25517]: audit 2021-03-10T16:52:29.007456+0000 mon.c (mon.1) 2666 : audit [DBG] from='client.? 172.21.2.115:0/217773872' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:52:31.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:52:31 gibba015 bash[29377]: cluster 2021-03-10T16:52:30.987367+0000 mgr.gibba045.orlgmj (mgr.34412) 9690 : cluster [DBG] pgmap v5520: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:31.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:52:31 gibba015 bash[30343]: cluster 2021-03-10T16:52:30.987367+0000 mgr.gibba045.orlgmj (mgr.34412) 9690 : cluster [DBG] pgmap v5520: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:31.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:52:31 gibba045 bash[25517]: cluster 2021-03-10T16:52:30.987367+0000 mgr.gibba045.orlgmj (mgr.34412) 9690 : cluster [DBG] pgmap v5520: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:33.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:52:33 gibba015 bash[29377]: cluster 2021-03-10T16:52:32.989075+0000 mgr.gibba045.orlgmj (mgr.34412) 9691 : cluster [DBG] pgmap v5521: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:33.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:52:33 gibba015 bash[30343]: cluster 2021-03-10T16:52:32.989075+0000 mgr.gibba045.orlgmj (mgr.34412) 9691 : cluster [DBG] pgmap v5521: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:33.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:52:33 gibba045 bash[25517]: cluster 2021-03-10T16:52:32.989075+0000 mgr.gibba045.orlgmj (mgr.34412) 9691 : cluster [DBG] pgmap v5521: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:35.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:52:35 gibba015 bash[29377]: cluster 2021-03-10T16:52:34.990622+0000 mgr.gibba045.orlgmj (mgr.34412) 9692 : cluster [DBG] pgmap v5522: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:35.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:52:35 gibba015 bash[30343]: cluster 2021-03-10T16:52:34.990622+0000 mgr.gibba045.orlgmj (mgr.34412) 9692 : cluster [DBG] pgmap v5522: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:35.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:52:35 gibba045 bash[25517]: cluster 2021-03-10T16:52:34.990622+0000 mgr.gibba045.orlgmj (mgr.34412) 9692 : cluster [DBG] pgmap v5522: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:38.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:52:37 gibba015 bash[29377]: cluster 2021-03-10T16:52:36.992379+0000 mgr.gibba045.orlgmj (mgr.34412) 9693 : cluster [DBG] pgmap v5523: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:38.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:52:37 gibba015 bash[30343]: cluster 2021-03-10T16:52:36.992379+0000 mgr.gibba045.orlgmj (mgr.34412) 9693 : cluster [DBG] pgmap v5523: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:38.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:52:37 gibba045 bash[25517]: cluster 2021-03-10T16:52:36.992379+0000 mgr.gibba045.orlgmj (mgr.34412) 9693 : cluster [DBG] pgmap v5523: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:39.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:52:39 gibba015 bash[29377]: cluster 2021-03-10T16:52:38.993637+0000 mgr.gibba045.orlgmj (mgr.34412) 9694 : cluster [DBG] pgmap v5524: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:39.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:52:39 gibba015 bash[30343]: cluster 2021-03-10T16:52:38.993637+0000 mgr.gibba045.orlgmj (mgr.34412) 9694 : cluster [DBG] pgmap v5524: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:39.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:52:39 gibba045 bash[25517]: cluster 2021-03-10T16:52:38.993637+0000 mgr.gibba045.orlgmj (mgr.34412) 9694 : cluster [DBG] pgmap v5524: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:41.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:52:41 gibba015 bash[29377]: cluster 2021-03-10T16:52:40.995340+0000 mgr.gibba045.orlgmj (mgr.34412) 9695 : cluster [DBG] pgmap v5525: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:41.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:52:41 gibba015 bash[30343]: cluster 2021-03-10T16:52:40.995340+0000 mgr.gibba045.orlgmj (mgr.34412) 9695 : cluster [DBG] pgmap v5525: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:41.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:52:41 gibba045 bash[25517]: cluster 2021-03-10T16:52:40.995340+0000 mgr.gibba045.orlgmj (mgr.34412) 9695 : cluster [DBG] pgmap v5525: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:43.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:52:43 gibba015 bash[29377]: cluster 2021-03-10T16:52:42.997025+0000 mgr.gibba045.orlgmj (mgr.34412) 9696 : cluster [DBG] pgmap v5526: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:43.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:52:43 gibba015 bash[30343]: cluster 2021-03-10T16:52:42.997025+0000 mgr.gibba045.orlgmj (mgr.34412) 9696 : cluster [DBG] pgmap v5526: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:43.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:52:43 gibba045 bash[25517]: cluster 2021-03-10T16:52:42.997025+0000 mgr.gibba045.orlgmj (mgr.34412) 9696 : cluster [DBG] pgmap v5526: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:44.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:52:44 gibba015 bash[29377]: cephadm 2021-03-10T16:52:43.764749+0000 mgr.gibba045.orlgmj (mgr.34412) 9697 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:52:44.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:52:44 gibba015 bash[30343]: cephadm 2021-03-10T16:52:43.764749+0000 mgr.gibba045.orlgmj (mgr.34412) 9697 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:52:44.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:52:44 gibba045 bash[25517]: cephadm 2021-03-10T16:52:43.764749+0000 mgr.gibba045.orlgmj (mgr.34412) 9697 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:52:45.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:52:45 gibba015 bash[29377]: cluster 2021-03-10T16:52:44.998702+0000 mgr.gibba045.orlgmj (mgr.34412) 9698 : cluster [DBG] pgmap v5527: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:45.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:52:45 gibba015 bash[30343]: cluster 2021-03-10T16:52:44.998702+0000 mgr.gibba045.orlgmj (mgr.34412) 9698 : cluster [DBG] pgmap v5527: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:45.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:52:45 gibba045 bash[25517]: cluster 2021-03-10T16:52:44.998702+0000 mgr.gibba045.orlgmj (mgr.34412) 9698 : cluster [DBG] pgmap v5527: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:48.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:52:47 gibba015 bash[29377]: cluster 2021-03-10T16:52:47.000369+0000 mgr.gibba045.orlgmj (mgr.34412) 9699 : cluster [DBG] pgmap v5528: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:48.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:52:47 gibba015 bash[30343]: cluster 2021-03-10T16:52:47.000369+0000 mgr.gibba045.orlgmj (mgr.34412) 9699 : cluster [DBG] pgmap v5528: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:48.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:52:47 gibba045 bash[25517]: cluster 2021-03-10T16:52:47.000369+0000 mgr.gibba045.orlgmj (mgr.34412) 9699 : cluster [DBG] pgmap v5528: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:49.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:52:49 gibba015 bash[29377]: cluster 2021-03-10T16:52:49.001586+0000 mgr.gibba045.orlgmj (mgr.34412) 9700 : cluster [DBG] pgmap v5529: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:49.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:52:49 gibba015 bash[30343]: cluster 2021-03-10T16:52:49.001586+0000 mgr.gibba045.orlgmj (mgr.34412) 9700 : cluster [DBG] pgmap v5529: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:49.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:52:49 gibba045 bash[25517]: cluster 2021-03-10T16:52:49.001586+0000 mgr.gibba045.orlgmj (mgr.34412) 9700 : cluster [DBG] pgmap v5529: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:51.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:52:51 gibba015 bash[29377]: cluster 2021-03-10T16:52:51.003336+0000 mgr.gibba045.orlgmj (mgr.34412) 9701 : cluster [DBG] pgmap v5530: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:51.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:52:51 gibba015 bash[30343]: cluster 2021-03-10T16:52:51.003336+0000 mgr.gibba045.orlgmj (mgr.34412) 9701 : cluster [DBG] pgmap v5530: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:51.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:52:51 gibba045 bash[25517]: cluster 2021-03-10T16:52:51.003336+0000 mgr.gibba045.orlgmj (mgr.34412) 9701 : cluster [DBG] pgmap v5530: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:53.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:52:53 gibba015 bash[29377]: cluster 2021-03-10T16:52:53.005030+0000 mgr.gibba045.orlgmj (mgr.34412) 9702 : cluster [DBG] pgmap v5531: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:53.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:52:53 gibba015 bash[30343]: cluster 2021-03-10T16:52:53.005030+0000 mgr.gibba045.orlgmj (mgr.34412) 9702 : cluster [DBG] pgmap v5531: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:53.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:52:53 gibba045 bash[25517]: cluster 2021-03-10T16:52:53.005030+0000 mgr.gibba045.orlgmj (mgr.34412) 9702 : cluster [DBG] pgmap v5531: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:54.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:52:54 gibba015 bash[29377]: audit 2021-03-10T16:52:53.772141+0000 mon.c (mon.1) 2667 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:52:54.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:52:54 gibba015 bash[29377]: audit 2021-03-10T16:52:53.772929+0000 mon.c (mon.1) 2668 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:52:54.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:52:54 gibba015 bash[29377]: audit 2021-03-10T16:52:53.773406+0000 mon.a (mon.0) 2113 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:52:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:52:54 gibba015 bash[29377]: audit 2021-03-10T16:52:53.774731+0000 mon.a (mon.0) 2114 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:52:54.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:52:54 gibba015 bash[29377]: audit 2021-03-10T16:52:53.789480+0000 mon.c (mon.1) 2669 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T16:52:54.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:52:54 gibba015 bash[29377]: audit 2021-03-10T16:52:53.790311+0000 mon.c (mon.1) 2670 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:52:54.479 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:52:54 gibba015 bash[29377]: audit 2021-03-10T16:52:53.790849+0000 mon.a (mon.0) 2115 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T16:52:54.479 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:52:54 gibba015 bash[29377]: audit 2021-03-10T16:52:53.791287+0000 mon.c (mon.1) 2671 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T16:52:54.479 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:52:54 gibba015 bash[29377]: audit 2021-03-10T16:52:53.792417+0000 mon.c (mon.1) 2672 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:52:54.480 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:52:54 gibba015 bash[29377]: audit 2021-03-10T16:52:53.792985+0000 mon.a (mon.0) 2116 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:52:54.480 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:52:54 gibba015 bash[29377]: audit 2021-03-10T16:52:53.794179+0000 mon.a (mon.0) 2117 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T16:52:54.481 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:52:54 gibba015 bash[29377]: audit 2021-03-10T16:52:53.795125+0000 mon.a (mon.0) 2118 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:52:54.488 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:52:54 gibba015 bash[30343]: audit 2021-03-10T16:52:53.772141+0000 mon.c (mon.1) 2667 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:52:54.488 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:52:54 gibba015 bash[30343]: audit 2021-03-10T16:52:53.772929+0000 mon.c (mon.1) 2668 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:52:54.489 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:52:54 gibba015 bash[30343]: audit 2021-03-10T16:52:53.773406+0000 mon.a (mon.0) 2113 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:52:54.489 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:52:54 gibba015 bash[30343]: audit 2021-03-10T16:52:53.774731+0000 mon.a (mon.0) 2114 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:52:54.489 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:52:54 gibba015 bash[30343]: audit 2021-03-10T16:52:53.789480+0000 mon.c (mon.1) 2669 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T16:52:54.490 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:52:54 gibba015 bash[30343]: audit 2021-03-10T16:52:53.790311+0000 mon.c (mon.1) 2670 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:52:54.491 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:52:54 gibba015 bash[30343]: audit 2021-03-10T16:52:53.790849+0000 mon.a (mon.0) 2115 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T16:52:54.491 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:52:54 gibba015 bash[30343]: audit 2021-03-10T16:52:53.791287+0000 mon.c (mon.1) 2671 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T16:52:54.491 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:52:54 gibba015 bash[30343]: audit 2021-03-10T16:52:53.792417+0000 mon.c (mon.1) 2672 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:52:54.492 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:52:54 gibba015 bash[30343]: audit 2021-03-10T16:52:53.792985+0000 mon.a (mon.0) 2116 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:52:54.492 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:52:54 gibba015 bash[30343]: audit 2021-03-10T16:52:53.794179+0000 mon.a (mon.0) 2117 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T16:52:54.492 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:52:54 gibba015 bash[30343]: audit 2021-03-10T16:52:53.795125+0000 mon.a (mon.0) 2118 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:52:54.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:52:54 gibba045 bash[25517]: audit 2021-03-10T16:52:53.772141+0000 mon.c (mon.1) 2667 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:52:54.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:52:54 gibba045 bash[25517]: audit 2021-03-10T16:52:53.772929+0000 mon.c (mon.1) 2668 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:52:54.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:52:54 gibba045 bash[25517]: audit 2021-03-10T16:52:53.773406+0000 mon.a (mon.0) 2113 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:52:54.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:52:54 gibba045 bash[25517]: audit 2021-03-10T16:52:53.774731+0000 mon.a (mon.0) 2114 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:52:54.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:52:54 gibba045 bash[25517]: audit 2021-03-10T16:52:53.789480+0000 mon.c (mon.1) 2669 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T16:52:54.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:52:54 gibba045 bash[25517]: audit 2021-03-10T16:52:53.790311+0000 mon.c (mon.1) 2670 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:52:54.563 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:52:54 gibba045 bash[25517]: audit 2021-03-10T16:52:53.790849+0000 mon.a (mon.0) 2115 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T16:52:54.565 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:52:54 gibba045 bash[25517]: audit 2021-03-10T16:52:53.791287+0000 mon.c (mon.1) 2671 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T16:52:54.566 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:52:54 gibba045 bash[25517]: audit 2021-03-10T16:52:53.792417+0000 mon.c (mon.1) 2672 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:52:54.566 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:52:54 gibba045 bash[25517]: audit 2021-03-10T16:52:53.792985+0000 mon.a (mon.0) 2116 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:52:54.572 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:52:54 gibba045 bash[25517]: audit 2021-03-10T16:52:53.794179+0000 mon.a (mon.0) 2117 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T16:52:54.572 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:52:54 gibba045 bash[25517]: audit 2021-03-10T16:52:53.795125+0000 mon.a (mon.0) 2118 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:52:55.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:52:55 gibba015 bash[29377]: cluster 2021-03-10T16:52:55.006721+0000 mgr.gibba045.orlgmj (mgr.34412) 9703 : cluster [DBG] pgmap v5532: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:55.469 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:52:55 gibba015 bash[30343]: cluster 2021-03-10T16:52:55.006721+0000 mgr.gibba045.orlgmj (mgr.34412) 9703 : cluster [DBG] pgmap v5532: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:55.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:52:55 gibba045 bash[25517]: cluster 2021-03-10T16:52:55.006721+0000 mgr.gibba045.orlgmj (mgr.34412) 9703 : cluster [DBG] pgmap v5532: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:58.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:52:57 gibba015 bash[29377]: cluster 2021-03-10T16:52:57.008575+0000 mgr.gibba045.orlgmj (mgr.34412) 9704 : cluster [DBG] pgmap v5533: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:58.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:52:57 gibba015 bash[30343]: cluster 2021-03-10T16:52:57.008575+0000 mgr.gibba045.orlgmj (mgr.34412) 9704 : cluster [DBG] pgmap v5533: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:58.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:52:57 gibba045 bash[25517]: cluster 2021-03-10T16:52:57.008575+0000 mgr.gibba045.orlgmj (mgr.34412) 9704 : cluster [DBG] pgmap v5533: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:59.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:52:58 gibba015 bash[29377]: audit 2021-03-10T16:52:58.779554+0000 mon.c (mon.1) 2673 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:52:59.219 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:52:58 gibba015 bash[30343]: audit 2021-03-10T16:52:58.779554+0000 mon.c (mon.1) 2673 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:52:59.251 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:52:59.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:52:58 gibba045 bash[25517]: audit 2021-03-10T16:52:58.779554+0000 mon.c (mon.1) 2673 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:52:59.481 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:52:59.481 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 6m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:52:59.482 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 5m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:52:59.482 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:52:59.482 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:52:59.482 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:52:59.483 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:52:59.483 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:52:59.483 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:52:59.483 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 6m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:52:59.483 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 5m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:52:59.484 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:52:59.484 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:52:59.484 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:52:59.484 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:52:59.484 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:52:59.485 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:52:59.485 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:52:59.485 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:52:59.485 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 5m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:52:59.486 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 5m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:52:59.732 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:52:59.733 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:52:59.733 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:52:59.733 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:52:59.733 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:52:59.734 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:52:59.734 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:52:59.734 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:52:59.735 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:52:59.735 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:52:59.735 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:52:59.735 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:52:59.736 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:52:59.736 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:52:59.736 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:53:00.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:53:00 gibba045 bash[25517]: cephadm 2021-03-10T16:52:58.787013+0000 mgr.gibba045.orlgmj (mgr.34412) 9705 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:53:00.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:53:00 gibba045 bash[25517]: cephadm 2021-03-10T16:52:58.788896+0000 mgr.gibba045.orlgmj (mgr.34412) 9706 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:53:00.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:53:00 gibba045 bash[25517]: audit 2021-03-10T16:52:58.996893+0000 mon.a (mon.0) 2119 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:53:00.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:53:00 gibba045 bash[25517]: audit 2021-03-10T16:52:59.000412+0000 mon.c (mon.1) 2674 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:53:00.312 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:53:00 gibba045 bash[25517]: cephadm 2021-03-10T16:52:59.001904+0000 mgr.gibba045.orlgmj (mgr.34412) 9707 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:53:00.312 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:53:00 gibba045 bash[25517]: audit 2021-03-10T16:52:59.002095+0000 mon.c (mon.1) 2675 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:53:00.312 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:53:00 gibba045 bash[25517]: audit 2021-03-10T16:52:59.003616+0000 mon.c (mon.1) 2676 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:53:00.312 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:53:00 gibba045 bash[25517]: cephadm 2021-03-10T16:52:59.003651+0000 mgr.gibba045.orlgmj (mgr.34412) 9708 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:53:00.313 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:53:00 gibba045 bash[25517]: audit 2021-03-10T16:52:59.005007+0000 mon.c (mon.1) 2677 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:53:00.313 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:53:00 gibba045 bash[25517]: cephadm 2021-03-10T16:52:59.005273+0000 mgr.gibba045.orlgmj (mgr.34412) 9709 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:53:00.315 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:53:00 gibba045 bash[25517]: cephadm 2021-03-10T16:52:59.005341+0000 mgr.gibba045.orlgmj (mgr.34412) 9710 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:53:00.315 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:53:00 gibba045 bash[25517]: cephadm 2021-03-10T16:52:59.006689+0000 mgr.gibba045.orlgmj (mgr.34412) 9711 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:53:00.316 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:53:00 gibba045 bash[25517]: cephadm 2021-03-10T16:52:59.006727+0000 mgr.gibba045.orlgmj (mgr.34412) 9712 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:53:00.320 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:53:00 gibba045 bash[25517]: audit 2021-03-10T16:52:59.008051+0000 mon.c (mon.1) 2678 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:53:00.320 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:53:00 gibba045 bash[25517]: cephadm 2021-03-10T16:52:59.008090+0000 mgr.gibba045.orlgmj (mgr.34412) 9713 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:53:00.322 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:53:00 gibba045 bash[25517]: cluster 2021-03-10T16:52:59.008987+0000 mgr.gibba045.orlgmj (mgr.34412) 9714 : cluster [DBG] pgmap v5534: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:00.324 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:53:00 gibba045 bash[25517]: audit 2021-03-10T16:52:59.009772+0000 mon.c (mon.1) 2679 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:53:00.324 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:53:00 gibba045 bash[25517]: cephadm 2021-03-10T16:52:59.009818+0000 mgr.gibba045.orlgmj (mgr.34412) 9715 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:53:00.324 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:53:00 gibba045 bash[25517]: cephadm 2021-03-10T16:52:59.009853+0000 mgr.gibba045.orlgmj (mgr.34412) 9716 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:53:00.324 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:53:00 gibba045 bash[25517]: cephadm 2021-03-10T16:52:59.011252+0000 mgr.gibba045.orlgmj (mgr.34412) 9717 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:53:00.330 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:53:00 gibba045 bash[25517]: cephadm 2021-03-10T16:52:59.011571+0000 mgr.gibba045.orlgmj (mgr.34412) 9718 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:53:00.331 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:53:00 gibba045 bash[25517]: cephadm 2021-03-10T16:52:59.012826+0000 mgr.gibba045.orlgmj (mgr.34412) 9719 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:53:00.331 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:53:00 gibba045 bash[25517]: cephadm 2021-03-10T16:52:59.012862+0000 mgr.gibba045.orlgmj (mgr.34412) 9720 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:53:00.332 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:53:00 gibba045 bash[25517]: cephadm 2021-03-10T16:52:59.012967+0000 mgr.gibba045.orlgmj (mgr.34412) 9721 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:53:00.332 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:53:00 gibba045 bash[25517]: audit 2021-03-10T16:52:59.732833+0000 mon.a (mon.0) 2120 : audit [DBG] from='client.? 172.21.2.115:0/3382545479' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:53:00.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:53:00 gibba015 bash[29377]: cephadm 2021-03-10T16:52:58.787013+0000 mgr.gibba045.orlgmj (mgr.34412) 9705 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:53:00.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:53:00 gibba015 bash[29377]: cephadm 2021-03-10T16:52:58.788896+0000 mgr.gibba045.orlgmj (mgr.34412) 9706 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:53:00.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:53:00 gibba015 bash[29377]: audit 2021-03-10T16:52:58.996893+0000 mon.a (mon.0) 2119 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:53:00.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:53:00 gibba015 bash[29377]: audit 2021-03-10T16:52:59.000412+0000 mon.c (mon.1) 2674 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:53:00.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:53:00 gibba015 bash[29377]: cephadm 2021-03-10T16:52:59.001904+0000 mgr.gibba045.orlgmj (mgr.34412) 9707 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:53:00.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:53:00 gibba015 bash[29377]: audit 2021-03-10T16:52:59.002095+0000 mon.c (mon.1) 2675 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:53:00.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:53:00 gibba015 bash[29377]: audit 2021-03-10T16:52:59.003616+0000 mon.c (mon.1) 2676 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:53:00.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:53:00 gibba015 bash[29377]: cephadm 2021-03-10T16:52:59.003651+0000 mgr.gibba045.orlgmj (mgr.34412) 9708 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:53:00.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:53:00 gibba015 bash[29377]: audit 2021-03-10T16:52:59.005007+0000 mon.c (mon.1) 2677 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:53:00.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:53:00 gibba015 bash[29377]: cephadm 2021-03-10T16:52:59.005273+0000 mgr.gibba045.orlgmj (mgr.34412) 9709 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:53:00.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:53:00 gibba015 bash[29377]: cephadm 2021-03-10T16:52:59.005341+0000 mgr.gibba045.orlgmj (mgr.34412) 9710 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:53:00.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:53:00 gibba015 bash[29377]: cephadm 2021-03-10T16:52:59.006689+0000 mgr.gibba045.orlgmj (mgr.34412) 9711 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:53:00.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:53:00 gibba015 bash[29377]: cephadm 2021-03-10T16:52:59.006727+0000 mgr.gibba045.orlgmj (mgr.34412) 9712 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:53:00.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:53:00 gibba015 bash[29377]: audit 2021-03-10T16:52:59.008051+0000 mon.c (mon.1) 2678 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:53:00.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:53:00 gibba015 bash[29377]: cephadm 2021-03-10T16:52:59.008090+0000 mgr.gibba045.orlgmj (mgr.34412) 9713 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:53:00.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:53:00 gibba015 bash[29377]: cluster 2021-03-10T16:52:59.008987+0000 mgr.gibba045.orlgmj (mgr.34412) 9714 : cluster [DBG] pgmap v5534: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:00.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:53:00 gibba015 bash[29377]: audit 2021-03-10T16:52:59.009772+0000 mon.c (mon.1) 2679 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:53:00.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:53:00 gibba015 bash[29377]: cephadm 2021-03-10T16:52:59.009818+0000 mgr.gibba045.orlgmj (mgr.34412) 9715 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:53:00.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:53:00 gibba015 bash[29377]: cephadm 2021-03-10T16:52:59.009853+0000 mgr.gibba045.orlgmj (mgr.34412) 9716 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:53:00.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:53:00 gibba015 bash[29377]: cephadm 2021-03-10T16:52:59.011252+0000 mgr.gibba045.orlgmj (mgr.34412) 9717 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:53:00.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:53:00 gibba015 bash[29377]: cephadm 2021-03-10T16:52:59.011571+0000 mgr.gibba045.orlgmj (mgr.34412) 9718 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:53:00.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:53:00 gibba015 bash[29377]: cephadm 2021-03-10T16:52:59.012826+0000 mgr.gibba045.orlgmj (mgr.34412) 9719 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:53:00.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:53:00 gibba015 bash[29377]: cephadm 2021-03-10T16:52:59.012862+0000 mgr.gibba045.orlgmj (mgr.34412) 9720 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:53:00.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:53:00 gibba015 bash[29377]: cephadm 2021-03-10T16:52:59.012967+0000 mgr.gibba045.orlgmj (mgr.34412) 9721 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:53:00.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:53:00 gibba015 bash[29377]: audit 2021-03-10T16:52:59.732833+0000 mon.a (mon.0) 2120 : audit [DBG] from='client.? 172.21.2.115:0/3382545479' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:53:00.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:53:00 gibba015 bash[30343]: cephadm 2021-03-10T16:52:58.787013+0000 mgr.gibba045.orlgmj (mgr.34412) 9705 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:53:00.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:53:00 gibba015 bash[30343]: cephadm 2021-03-10T16:52:58.788896+0000 mgr.gibba045.orlgmj (mgr.34412) 9706 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:53:00.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:53:00 gibba015 bash[30343]: audit 2021-03-10T16:52:58.996893+0000 mon.a (mon.0) 2119 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:53:00.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:53:00 gibba015 bash[30343]: audit 2021-03-10T16:52:59.000412+0000 mon.c (mon.1) 2674 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:53:00.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:53:00 gibba015 bash[30343]: cephadm 2021-03-10T16:52:59.001904+0000 mgr.gibba045.orlgmj (mgr.34412) 9707 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:53:00.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:53:00 gibba015 bash[30343]: audit 2021-03-10T16:52:59.002095+0000 mon.c (mon.1) 2675 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:53:00.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:53:00 gibba015 bash[30343]: audit 2021-03-10T16:52:59.003616+0000 mon.c (mon.1) 2676 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:53:00.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:53:00 gibba015 bash[30343]: cephadm 2021-03-10T16:52:59.003651+0000 mgr.gibba045.orlgmj (mgr.34412) 9708 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:53:00.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:53:00 gibba015 bash[30343]: audit 2021-03-10T16:52:59.005007+0000 mon.c (mon.1) 2677 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:53:00.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:53:00 gibba015 bash[30343]: cephadm 2021-03-10T16:52:59.005273+0000 mgr.gibba045.orlgmj (mgr.34412) 9709 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:53:00.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:53:00 gibba015 bash[30343]: cephadm 2021-03-10T16:52:59.005341+0000 mgr.gibba045.orlgmj (mgr.34412) 9710 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:53:00.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:53:00 gibba015 bash[30343]: cephadm 2021-03-10T16:52:59.006689+0000 mgr.gibba045.orlgmj (mgr.34412) 9711 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:53:00.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:53:00 gibba015 bash[30343]: cephadm 2021-03-10T16:52:59.006727+0000 mgr.gibba045.orlgmj (mgr.34412) 9712 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:53:00.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:53:00 gibba015 bash[30343]: audit 2021-03-10T16:52:59.008051+0000 mon.c (mon.1) 2678 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:53:00.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:53:00 gibba015 bash[30343]: cephadm 2021-03-10T16:52:59.008090+0000 mgr.gibba045.orlgmj (mgr.34412) 9713 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:53:00.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:53:00 gibba015 bash[30343]: cluster 2021-03-10T16:52:59.008987+0000 mgr.gibba045.orlgmj (mgr.34412) 9714 : cluster [DBG] pgmap v5534: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:00.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:53:00 gibba015 bash[30343]: audit 2021-03-10T16:52:59.009772+0000 mon.c (mon.1) 2679 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:53:00.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:53:00 gibba015 bash[30343]: cephadm 2021-03-10T16:52:59.009818+0000 mgr.gibba045.orlgmj (mgr.34412) 9715 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:53:00.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:53:00 gibba015 bash[30343]: cephadm 2021-03-10T16:52:59.009853+0000 mgr.gibba045.orlgmj (mgr.34412) 9716 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:53:00.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:53:00 gibba015 bash[30343]: cephadm 2021-03-10T16:52:59.011252+0000 mgr.gibba045.orlgmj (mgr.34412) 9717 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:53:00.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:53:00 gibba015 bash[30343]: cephadm 2021-03-10T16:52:59.011571+0000 mgr.gibba045.orlgmj (mgr.34412) 9718 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:53:00.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:53:00 gibba015 bash[30343]: cephadm 2021-03-10T16:52:59.012826+0000 mgr.gibba045.orlgmj (mgr.34412) 9719 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:53:00.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:53:00 gibba015 bash[30343]: cephadm 2021-03-10T16:52:59.012862+0000 mgr.gibba045.orlgmj (mgr.34412) 9720 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:53:00.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:53:00 gibba015 bash[30343]: cephadm 2021-03-10T16:52:59.012967+0000 mgr.gibba045.orlgmj (mgr.34412) 9721 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:53:00.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:53:00 gibba015 bash[30343]: audit 2021-03-10T16:52:59.732833+0000 mon.a (mon.0) 2120 : audit [DBG] from='client.? 172.21.2.115:0/3382545479' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:53:01.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:53:01 gibba045 bash[25517]: audit 2021-03-10T16:52:59.245056+0000 mgr.gibba045.orlgmj (mgr.34412) 9722 : audit [DBG] from='client.60556 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:53:01.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:53:01 gibba045 bash[25517]: audit 2021-03-10T16:52:59.470987+0000 mgr.gibba045.orlgmj (mgr.34412) 9723 : audit [DBG] from='client.50574 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:53:01.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:53:01 gibba015 bash[29377]: audit 2021-03-10T16:52:59.245056+0000 mgr.gibba045.orlgmj (mgr.34412) 9722 : audit [DBG] from='client.60556 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:53:01.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:53:01 gibba015 bash[29377]: audit 2021-03-10T16:52:59.470987+0000 mgr.gibba045.orlgmj (mgr.34412) 9723 : audit [DBG] from='client.50574 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:53:01.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:53:01 gibba015 bash[30343]: audit 2021-03-10T16:52:59.245056+0000 mgr.gibba045.orlgmj (mgr.34412) 9722 : audit [DBG] from='client.60556 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:53:01.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:53:01 gibba015 bash[30343]: audit 2021-03-10T16:52:59.470987+0000 mgr.gibba045.orlgmj (mgr.34412) 9723 : audit [DBG] from='client.50574 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:53:02.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:53:02 gibba045 bash[25517]: cluster 2021-03-10T16:53:01.010616+0000 mgr.gibba045.orlgmj (mgr.34412) 9724 : cluster [DBG] pgmap v5535: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:02.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:53:02 gibba015 bash[29377]: cluster 2021-03-10T16:53:01.010616+0000 mgr.gibba045.orlgmj (mgr.34412) 9724 : cluster [DBG] pgmap v5535: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:02.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:53:02 gibba015 bash[30343]: cluster 2021-03-10T16:53:01.010616+0000 mgr.gibba045.orlgmj (mgr.34412) 9724 : cluster [DBG] pgmap v5535: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:04.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:53:04 gibba045 bash[25517]: cluster 2021-03-10T16:53:03.012233+0000 mgr.gibba045.orlgmj (mgr.34412) 9725 : cluster [DBG] pgmap v5536: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:04.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:53:04 gibba015 bash[29377]: cluster 2021-03-10T16:53:03.012233+0000 mgr.gibba045.orlgmj (mgr.34412) 9725 : cluster [DBG] pgmap v5536: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:04.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:53:04 gibba015 bash[30343]: cluster 2021-03-10T16:53:03.012233+0000 mgr.gibba045.orlgmj (mgr.34412) 9725 : cluster [DBG] pgmap v5536: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:06.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:53:06 gibba045 bash[25517]: cluster 2021-03-10T16:53:05.014088+0000 mgr.gibba045.orlgmj (mgr.34412) 9726 : cluster [DBG] pgmap v5537: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:06.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:53:06 gibba015 bash[29377]: cluster 2021-03-10T16:53:05.014088+0000 mgr.gibba045.orlgmj (mgr.34412) 9726 : cluster [DBG] pgmap v5537: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:06.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:53:06 gibba015 bash[30343]: cluster 2021-03-10T16:53:05.014088+0000 mgr.gibba045.orlgmj (mgr.34412) 9726 : cluster [DBG] pgmap v5537: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:08.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:53:07 gibba015 bash[29377]: cluster 2021-03-10T16:53:07.015910+0000 mgr.gibba045.orlgmj (mgr.34412) 9727 : cluster [DBG] pgmap v5538: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:08.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:53:07 gibba015 bash[30343]: cluster 2021-03-10T16:53:07.015910+0000 mgr.gibba045.orlgmj (mgr.34412) 9727 : cluster [DBG] pgmap v5538: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:08.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:53:07 gibba045 bash[25517]: cluster 2021-03-10T16:53:07.015910+0000 mgr.gibba045.orlgmj (mgr.34412) 9727 : cluster [DBG] pgmap v5538: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:09.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:53:09 gibba015 bash[29377]: cluster 2021-03-10T16:53:09.017316+0000 mgr.gibba045.orlgmj (mgr.34412) 9728 : cluster [DBG] pgmap v5539: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:09.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:53:09 gibba015 bash[30343]: cluster 2021-03-10T16:53:09.017316+0000 mgr.gibba045.orlgmj (mgr.34412) 9728 : cluster [DBG] pgmap v5539: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:09.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:53:09 gibba045 bash[25517]: cluster 2021-03-10T16:53:09.017316+0000 mgr.gibba045.orlgmj (mgr.34412) 9728 : cluster [DBG] pgmap v5539: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:11.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:53:11 gibba015 bash[29377]: cluster 2021-03-10T16:53:11.019024+0000 mgr.gibba045.orlgmj (mgr.34412) 9729 : cluster [DBG] pgmap v5540: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:11.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:53:11 gibba015 bash[30343]: cluster 2021-03-10T16:53:11.019024+0000 mgr.gibba045.orlgmj (mgr.34412) 9729 : cluster [DBG] pgmap v5540: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:11.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:53:11 gibba045 bash[25517]: cluster 2021-03-10T16:53:11.019024+0000 mgr.gibba045.orlgmj (mgr.34412) 9729 : cluster [DBG] pgmap v5540: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:13.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:53:13 gibba015 bash[29377]: cluster 2021-03-10T16:53:13.020654+0000 mgr.gibba045.orlgmj (mgr.34412) 9730 : cluster [DBG] pgmap v5541: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:13.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:53:13 gibba015 bash[30343]: cluster 2021-03-10T16:53:13.020654+0000 mgr.gibba045.orlgmj (mgr.34412) 9730 : cluster [DBG] pgmap v5541: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:13.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:53:13 gibba045 bash[25517]: cluster 2021-03-10T16:53:13.020654+0000 mgr.gibba045.orlgmj (mgr.34412) 9730 : cluster [DBG] pgmap v5541: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:14.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:53:14 gibba045 bash[25517]: cephadm 2021-03-10T16:53:14.026938+0000 mgr.gibba045.orlgmj (mgr.34412) 9731 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:53:14.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:53:14 gibba015 bash[29377]: cephadm 2021-03-10T16:53:14.026938+0000 mgr.gibba045.orlgmj (mgr.34412) 9731 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:53:14.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:53:14 gibba015 bash[30343]: cephadm 2021-03-10T16:53:14.026938+0000 mgr.gibba045.orlgmj (mgr.34412) 9731 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:53:15.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:53:15 gibba015 bash[29377]: cluster 2021-03-10T16:53:15.022071+0000 mgr.gibba045.orlgmj (mgr.34412) 9732 : cluster [DBG] pgmap v5542: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:15.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:53:15 gibba015 bash[30343]: cluster 2021-03-10T16:53:15.022071+0000 mgr.gibba045.orlgmj (mgr.34412) 9732 : cluster [DBG] pgmap v5542: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:15.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:53:15 gibba045 bash[25517]: cluster 2021-03-10T16:53:15.022071+0000 mgr.gibba045.orlgmj (mgr.34412) 9732 : cluster [DBG] pgmap v5542: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:18.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:53:17 gibba015 bash[29377]: cluster 2021-03-10T16:53:17.023732+0000 mgr.gibba045.orlgmj (mgr.34412) 9733 : cluster [DBG] pgmap v5543: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:18.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:53:17 gibba015 bash[30343]: cluster 2021-03-10T16:53:17.023732+0000 mgr.gibba045.orlgmj (mgr.34412) 9733 : cluster [DBG] pgmap v5543: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:18.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:53:17 gibba045 bash[25517]: cluster 2021-03-10T16:53:17.023732+0000 mgr.gibba045.orlgmj (mgr.34412) 9733 : cluster [DBG] pgmap v5543: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:19.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:53:19 gibba015 bash[29377]: cluster 2021-03-10T16:53:19.025011+0000 mgr.gibba045.orlgmj (mgr.34412) 9734 : cluster [DBG] pgmap v5544: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:19.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:53:19 gibba015 bash[30343]: cluster 2021-03-10T16:53:19.025011+0000 mgr.gibba045.orlgmj (mgr.34412) 9734 : cluster [DBG] pgmap v5544: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:19.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:53:19 gibba045 bash[25517]: cluster 2021-03-10T16:53:19.025011+0000 mgr.gibba045.orlgmj (mgr.34412) 9734 : cluster [DBG] pgmap v5544: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:21.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:53:21 gibba015 bash[29377]: cluster 2021-03-10T16:53:21.026708+0000 mgr.gibba045.orlgmj (mgr.34412) 9735 : cluster [DBG] pgmap v5545: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:21.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:53:21 gibba015 bash[30343]: cluster 2021-03-10T16:53:21.026708+0000 mgr.gibba045.orlgmj (mgr.34412) 9735 : cluster [DBG] pgmap v5545: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:21.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:53:21 gibba045 bash[25517]: cluster 2021-03-10T16:53:21.026708+0000 mgr.gibba045.orlgmj (mgr.34412) 9735 : cluster [DBG] pgmap v5545: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:23.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:53:23 gibba015 bash[29377]: cluster 2021-03-10T16:53:23.028178+0000 mgr.gibba045.orlgmj (mgr.34412) 9736 : cluster [DBG] pgmap v5546: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:23.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:53:23 gibba015 bash[30343]: cluster 2021-03-10T16:53:23.028178+0000 mgr.gibba045.orlgmj (mgr.34412) 9736 : cluster [DBG] pgmap v5546: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:23.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:53:23 gibba045 bash[25517]: cluster 2021-03-10T16:53:23.028178+0000 mgr.gibba045.orlgmj (mgr.34412) 9736 : cluster [DBG] pgmap v5546: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:25.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:53:25 gibba015 bash[29377]: cluster 2021-03-10T16:53:25.029852+0000 mgr.gibba045.orlgmj (mgr.34412) 9737 : cluster [DBG] pgmap v5547: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:25.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:53:25 gibba015 bash[30343]: cluster 2021-03-10T16:53:25.029852+0000 mgr.gibba045.orlgmj (mgr.34412) 9737 : cluster [DBG] pgmap v5547: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:25.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:53:25 gibba045 bash[25517]: cluster 2021-03-10T16:53:25.029852+0000 mgr.gibba045.orlgmj (mgr.34412) 9737 : cluster [DBG] pgmap v5547: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:28.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:53:27 gibba015 bash[29377]: cluster 2021-03-10T16:53:27.031477+0000 mgr.gibba045.orlgmj (mgr.34412) 9738 : cluster [DBG] pgmap v5548: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:28.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:53:27 gibba015 bash[30343]: cluster 2021-03-10T16:53:27.031477+0000 mgr.gibba045.orlgmj (mgr.34412) 9738 : cluster [DBG] pgmap v5548: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:28.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:53:27 gibba045 bash[25517]: cluster 2021-03-10T16:53:27.031477+0000 mgr.gibba045.orlgmj (mgr.34412) 9738 : cluster [DBG] pgmap v5548: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:29.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:53:29 gibba045 bash[25517]: cluster 2021-03-10T16:53:29.032757+0000 mgr.gibba045.orlgmj (mgr.34412) 9739 : cluster [DBG] pgmap v5549: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:29.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:53:29 gibba045 bash[25517]: cephadm 2021-03-10T16:53:29.041168+0000 mgr.gibba045.orlgmj (mgr.34412) 9740 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:53:29.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:53:29 gibba015 bash[29377]: cluster 2021-03-10T16:53:29.032757+0000 mgr.gibba045.orlgmj (mgr.34412) 9739 : cluster [DBG] pgmap v5549: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:29.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:53:29 gibba015 bash[29377]: cephadm 2021-03-10T16:53:29.041168+0000 mgr.gibba045.orlgmj (mgr.34412) 9740 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:53:29.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:53:29 gibba015 bash[30343]: cluster 2021-03-10T16:53:29.032757+0000 mgr.gibba045.orlgmj (mgr.34412) 9739 : cluster [DBG] pgmap v5549: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:29.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:53:29 gibba015 bash[30343]: cephadm 2021-03-10T16:53:29.041168+0000 mgr.gibba045.orlgmj (mgr.34412) 9740 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:53:29.979 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:53:30.206 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:53:30.206 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 6m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:53:30.206 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 5m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:53:30.207 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:53:30.207 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:53:30.207 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:53:30.207 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:53:30.207 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:53:30.208 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:53:30.208 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 6m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:53:30.208 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 5m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:53:30.208 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:53:30.209 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:53:30.209 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:53:30.209 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:53:30.209 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:53:30.210 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:53:30.210 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:53:30.219 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:53:30.220 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 5m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:53:30.220 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 5m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:53:30.459 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:53:30.459 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:53:30.460 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:53:30.460 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:53:30.460 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:53:30.460 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:53:30.461 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:53:30.461 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:53:30.461 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:53:30.461 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:53:30.461 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:53:30.462 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:53:30.462 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:53:30.462 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:53:30.462 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:53:30.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:53:30 gibba015 bash[29377]: audit 2021-03-10T16:53:29.973511+0000 mgr.gibba045.orlgmj (mgr.34412) 9741 : audit [DBG] from='client.60574 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:53:30.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:53:30 gibba015 bash[30343]: audit 2021-03-10T16:53:29.973511+0000 mgr.gibba045.orlgmj (mgr.34412) 9741 : audit [DBG] from='client.60574 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:53:30.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:53:30 gibba045 bash[25517]: audit 2021-03-10T16:53:29.973511+0000 mgr.gibba045.orlgmj (mgr.34412) 9741 : audit [DBG] from='client.60574 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:53:31.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:53:31 gibba015 bash[29377]: audit 2021-03-10T16:53:30.196084+0000 mgr.gibba045.orlgmj (mgr.34412) 9742 : audit [DBG] from='client.50592 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:53:31.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:53:31 gibba015 bash[29377]: audit 2021-03-10T16:53:30.459890+0000 mon.a (mon.0) 2121 : audit [DBG] from='client.? 172.21.2.115:0/1529811409' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:53:31.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:53:31 gibba015 bash[29377]: cluster 2021-03-10T16:53:31.034246+0000 mgr.gibba045.orlgmj (mgr.34412) 9743 : cluster [DBG] pgmap v5550: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:31.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:53:31 gibba015 bash[30343]: audit 2021-03-10T16:53:30.196084+0000 mgr.gibba045.orlgmj (mgr.34412) 9742 : audit [DBG] from='client.50592 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:53:31.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:53:31 gibba015 bash[30343]: audit 2021-03-10T16:53:30.459890+0000 mon.a (mon.0) 2121 : audit [DBG] from='client.? 172.21.2.115:0/1529811409' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:53:31.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:53:31 gibba015 bash[30343]: cluster 2021-03-10T16:53:31.034246+0000 mgr.gibba045.orlgmj (mgr.34412) 9743 : cluster [DBG] pgmap v5550: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:31.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:53:31 gibba045 bash[25517]: audit 2021-03-10T16:53:30.196084+0000 mgr.gibba045.orlgmj (mgr.34412) 9742 : audit [DBG] from='client.50592 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:53:31.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:53:31 gibba045 bash[25517]: audit 2021-03-10T16:53:30.459890+0000 mon.a (mon.0) 2121 : audit [DBG] from='client.? 172.21.2.115:0/1529811409' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:53:31.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:53:31 gibba045 bash[25517]: cluster 2021-03-10T16:53:31.034246+0000 mgr.gibba045.orlgmj (mgr.34412) 9743 : cluster [DBG] pgmap v5550: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:33.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:53:33 gibba015 bash[29377]: cluster 2021-03-10T16:53:33.035595+0000 mgr.gibba045.orlgmj (mgr.34412) 9744 : cluster [DBG] pgmap v5551: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:33.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:53:33 gibba015 bash[30343]: cluster 2021-03-10T16:53:33.035595+0000 mgr.gibba045.orlgmj (mgr.34412) 9744 : cluster [DBG] pgmap v5551: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:33.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:53:33 gibba045 bash[25517]: cluster 2021-03-10T16:53:33.035595+0000 mgr.gibba045.orlgmj (mgr.34412) 9744 : cluster [DBG] pgmap v5551: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:35.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:53:35 gibba015 bash[29377]: cluster 2021-03-10T16:53:35.037370+0000 mgr.gibba045.orlgmj (mgr.34412) 9745 : cluster [DBG] pgmap v5552: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:35.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:53:35 gibba015 bash[30343]: cluster 2021-03-10T16:53:35.037370+0000 mgr.gibba045.orlgmj (mgr.34412) 9745 : cluster [DBG] pgmap v5552: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:35.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:53:35 gibba045 bash[25517]: cluster 2021-03-10T16:53:35.037370+0000 mgr.gibba045.orlgmj (mgr.34412) 9745 : cluster [DBG] pgmap v5552: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:38.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:53:37 gibba015 bash[29377]: cluster 2021-03-10T16:53:37.038057+0000 mgr.gibba045.orlgmj (mgr.34412) 9746 : cluster [DBG] pgmap v5553: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:38.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:53:37 gibba015 bash[30343]: cluster 2021-03-10T16:53:37.038057+0000 mgr.gibba045.orlgmj (mgr.34412) 9746 : cluster [DBG] pgmap v5553: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:38.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:53:37 gibba045 bash[25517]: cluster 2021-03-10T16:53:37.038057+0000 mgr.gibba045.orlgmj (mgr.34412) 9746 : cluster [DBG] pgmap v5553: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:39.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:53:39 gibba015 bash[29377]: cluster 2021-03-10T16:53:39.039218+0000 mgr.gibba045.orlgmj (mgr.34412) 9747 : cluster [DBG] pgmap v5554: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:39.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:53:39 gibba015 bash[30343]: cluster 2021-03-10T16:53:39.039218+0000 mgr.gibba045.orlgmj (mgr.34412) 9747 : cluster [DBG] pgmap v5554: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:39.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:53:39 gibba045 bash[25517]: cluster 2021-03-10T16:53:39.039218+0000 mgr.gibba045.orlgmj (mgr.34412) 9747 : cluster [DBG] pgmap v5554: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:41.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:53:41 gibba015 bash[29377]: cluster 2021-03-10T16:53:41.041003+0000 mgr.gibba045.orlgmj (mgr.34412) 9748 : cluster [DBG] pgmap v5555: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:41.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:53:41 gibba015 bash[30343]: cluster 2021-03-10T16:53:41.041003+0000 mgr.gibba045.orlgmj (mgr.34412) 9748 : cluster [DBG] pgmap v5555: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:41.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:53:41 gibba045 bash[25517]: cluster 2021-03-10T16:53:41.041003+0000 mgr.gibba045.orlgmj (mgr.34412) 9748 : cluster [DBG] pgmap v5555: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:43.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:53:43 gibba015 bash[29377]: cluster 2021-03-10T16:53:43.042726+0000 mgr.gibba045.orlgmj (mgr.34412) 9749 : cluster [DBG] pgmap v5556: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:43.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:53:43 gibba015 bash[30343]: cluster 2021-03-10T16:53:43.042726+0000 mgr.gibba045.orlgmj (mgr.34412) 9749 : cluster [DBG] pgmap v5556: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:43.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:53:43 gibba045 bash[25517]: cluster 2021-03-10T16:53:43.042726+0000 mgr.gibba045.orlgmj (mgr.34412) 9749 : cluster [DBG] pgmap v5556: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:44.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:53:44 gibba015 bash[29377]: cephadm 2021-03-10T16:53:44.057148+0000 mgr.gibba045.orlgmj (mgr.34412) 9750 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:53:44.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:53:44 gibba015 bash[30343]: cephadm 2021-03-10T16:53:44.057148+0000 mgr.gibba045.orlgmj (mgr.34412) 9750 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:53:44.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:53:44 gibba045 bash[25517]: cephadm 2021-03-10T16:53:44.057148+0000 mgr.gibba045.orlgmj (mgr.34412) 9750 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:53:45.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:53:45 gibba015 bash[29377]: cluster 2021-03-10T16:53:45.044500+0000 mgr.gibba045.orlgmj (mgr.34412) 9751 : cluster [DBG] pgmap v5557: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:45.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:53:45 gibba015 bash[30343]: cluster 2021-03-10T16:53:45.044500+0000 mgr.gibba045.orlgmj (mgr.34412) 9751 : cluster [DBG] pgmap v5557: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:45.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:53:45 gibba045 bash[25517]: cluster 2021-03-10T16:53:45.044500+0000 mgr.gibba045.orlgmj (mgr.34412) 9751 : cluster [DBG] pgmap v5557: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:48.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:53:47 gibba015 bash[29377]: cluster 2021-03-10T16:53:47.046074+0000 mgr.gibba045.orlgmj (mgr.34412) 9752 : cluster [DBG] pgmap v5558: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:48.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:53:47 gibba015 bash[30343]: cluster 2021-03-10T16:53:47.046074+0000 mgr.gibba045.orlgmj (mgr.34412) 9752 : cluster [DBG] pgmap v5558: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:48.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:53:47 gibba045 bash[25517]: cluster 2021-03-10T16:53:47.046074+0000 mgr.gibba045.orlgmj (mgr.34412) 9752 : cluster [DBG] pgmap v5558: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:49.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:53:49 gibba015 bash[29377]: cluster 2021-03-10T16:53:49.047442+0000 mgr.gibba045.orlgmj (mgr.34412) 9753 : cluster [DBG] pgmap v5559: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:49.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:53:49 gibba015 bash[30343]: cluster 2021-03-10T16:53:49.047442+0000 mgr.gibba045.orlgmj (mgr.34412) 9753 : cluster [DBG] pgmap v5559: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:49.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:53:49 gibba045 bash[25517]: cluster 2021-03-10T16:53:49.047442+0000 mgr.gibba045.orlgmj (mgr.34412) 9753 : cluster [DBG] pgmap v5559: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:51.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:53:51 gibba015 bash[29377]: cluster 2021-03-10T16:53:51.049294+0000 mgr.gibba045.orlgmj (mgr.34412) 9754 : cluster [DBG] pgmap v5560: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:51.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:53:51 gibba015 bash[30343]: cluster 2021-03-10T16:53:51.049294+0000 mgr.gibba045.orlgmj (mgr.34412) 9754 : cluster [DBG] pgmap v5560: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:51.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:53:51 gibba045 bash[25517]: cluster 2021-03-10T16:53:51.049294+0000 mgr.gibba045.orlgmj (mgr.34412) 9754 : cluster [DBG] pgmap v5560: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:53.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:53:53 gibba015 bash[29377]: cluster 2021-03-10T16:53:53.050696+0000 mgr.gibba045.orlgmj (mgr.34412) 9755 : cluster [DBG] pgmap v5561: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:53.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:53:53 gibba015 bash[30343]: cluster 2021-03-10T16:53:53.050696+0000 mgr.gibba045.orlgmj (mgr.34412) 9755 : cluster [DBG] pgmap v5561: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:53.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:53:53 gibba045 bash[25517]: cluster 2021-03-10T16:53:53.050696+0000 mgr.gibba045.orlgmj (mgr.34412) 9755 : cluster [DBG] pgmap v5561: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:54.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:53:54 gibba015 bash[29377]: audit 2021-03-10T16:53:53.778994+0000 mon.c (mon.1) 2680 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:53:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:53:54 gibba015 bash[29377]: audit 2021-03-10T16:53:53.780061+0000 mon.c (mon.1) 2681 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:53:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:53:54 gibba015 bash[29377]: audit 2021-03-10T16:53:53.780295+0000 mon.a (mon.0) 2122 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:53:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:53:54 gibba015 bash[29377]: audit 2021-03-10T16:53:53.781452+0000 mon.a (mon.0) 2123 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:53:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:53:54 gibba015 bash[29377]: audit 2021-03-10T16:53:53.796286+0000 mon.c (mon.1) 2682 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T16:53:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:53:54 gibba015 bash[29377]: audit 2021-03-10T16:53:53.797432+0000 mon.c (mon.1) 2683 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:53:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:53:54 gibba015 bash[29377]: audit 2021-03-10T16:53:53.797740+0000 mon.a (mon.0) 2124 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T16:53:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:53:54 gibba015 bash[29377]: audit 2021-03-10T16:53:53.798528+0000 mon.c (mon.1) 2684 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:53:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:53:54 gibba015 bash[29377]: audit 2021-03-10T16:53:53.798799+0000 mon.a (mon.0) 2125 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:53:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:53:54 gibba015 bash[29377]: audit 2021-03-10T16:53:53.799829+0000 mon.a (mon.0) 2126 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:53:54.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:53:54 gibba015 bash[29377]: audit 2021-03-10T16:53:53.799839+0000 mon.c (mon.1) 2685 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:53:54.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:53:54 gibba015 bash[29377]: audit 2021-03-10T16:53:53.801170+0000 mon.a (mon.0) 2127 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:53:54.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:53:54 gibba015 bash[30343]: audit 2021-03-10T16:53:53.778994+0000 mon.c (mon.1) 2680 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:53:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:53:54 gibba015 bash[30343]: audit 2021-03-10T16:53:53.780061+0000 mon.c (mon.1) 2681 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:53:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:53:54 gibba015 bash[30343]: audit 2021-03-10T16:53:53.780295+0000 mon.a (mon.0) 2122 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:53:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:53:54 gibba015 bash[30343]: audit 2021-03-10T16:53:53.781452+0000 mon.a (mon.0) 2123 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:53:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:53:54 gibba015 bash[30343]: audit 2021-03-10T16:53:53.796286+0000 mon.c (mon.1) 2682 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T16:53:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:53:54 gibba015 bash[30343]: audit 2021-03-10T16:53:53.797432+0000 mon.c (mon.1) 2683 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:53:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:53:54 gibba015 bash[30343]: audit 2021-03-10T16:53:53.797740+0000 mon.a (mon.0) 2124 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T16:53:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:53:54 gibba015 bash[30343]: audit 2021-03-10T16:53:53.798528+0000 mon.c (mon.1) 2684 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:53:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:53:54 gibba015 bash[30343]: audit 2021-03-10T16:53:53.798799+0000 mon.a (mon.0) 2125 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:53:54.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:53:54 gibba015 bash[30343]: audit 2021-03-10T16:53:53.799829+0000 mon.a (mon.0) 2126 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:53:54.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:53:54 gibba015 bash[30343]: audit 2021-03-10T16:53:53.799839+0000 mon.c (mon.1) 2685 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:53:54.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:53:54 gibba015 bash[30343]: audit 2021-03-10T16:53:53.801170+0000 mon.a (mon.0) 2127 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:53:54.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:53:54 gibba045 bash[25517]: audit 2021-03-10T16:53:53.778994+0000 mon.c (mon.1) 2680 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:53:54.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:53:54 gibba045 bash[25517]: audit 2021-03-10T16:53:53.780061+0000 mon.c (mon.1) 2681 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:53:54.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:53:54 gibba045 bash[25517]: audit 2021-03-10T16:53:53.780295+0000 mon.a (mon.0) 2122 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:53:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:53:54 gibba045 bash[25517]: audit 2021-03-10T16:53:53.781452+0000 mon.a (mon.0) 2123 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:53:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:53:54 gibba045 bash[25517]: audit 2021-03-10T16:53:53.796286+0000 mon.c (mon.1) 2682 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T16:53:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:53:54 gibba045 bash[25517]: audit 2021-03-10T16:53:53.797432+0000 mon.c (mon.1) 2683 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:53:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:53:54 gibba045 bash[25517]: audit 2021-03-10T16:53:53.797740+0000 mon.a (mon.0) 2124 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T16:53:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:53:54 gibba045 bash[25517]: audit 2021-03-10T16:53:53.798528+0000 mon.c (mon.1) 2684 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:53:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:53:54 gibba045 bash[25517]: audit 2021-03-10T16:53:53.798799+0000 mon.a (mon.0) 2125 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:53:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:53:54 gibba045 bash[25517]: audit 2021-03-10T16:53:53.799829+0000 mon.a (mon.0) 2126 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:53:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:53:54 gibba045 bash[25517]: audit 2021-03-10T16:53:53.799839+0000 mon.c (mon.1) 2685 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:53:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:53:54 gibba045 bash[25517]: audit 2021-03-10T16:53:53.801170+0000 mon.a (mon.0) 2127 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:53:55.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:53:55 gibba015 bash[29377]: cluster 2021-03-10T16:53:55.052468+0000 mgr.gibba045.orlgmj (mgr.34412) 9756 : cluster [DBG] pgmap v5562: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:55.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:53:55 gibba015 bash[30343]: cluster 2021-03-10T16:53:55.052468+0000 mgr.gibba045.orlgmj (mgr.34412) 9756 : cluster [DBG] pgmap v5562: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:55.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:53:55 gibba045 bash[25517]: cluster 2021-03-10T16:53:55.052468+0000 mgr.gibba045.orlgmj (mgr.34412) 9756 : cluster [DBG] pgmap v5562: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:58.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:53:57 gibba015 bash[29377]: cluster 2021-03-10T16:53:57.054221+0000 mgr.gibba045.orlgmj (mgr.34412) 9757 : cluster [DBG] pgmap v5563: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:58.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:53:57 gibba015 bash[30343]: cluster 2021-03-10T16:53:57.054221+0000 mgr.gibba045.orlgmj (mgr.34412) 9757 : cluster [DBG] pgmap v5563: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:58.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:53:57 gibba045 bash[25517]: cluster 2021-03-10T16:53:57.054221+0000 mgr.gibba045.orlgmj (mgr.34412) 9757 : cluster [DBG] pgmap v5563: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:59.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:53:59 gibba015 bash[29377]: cluster 2021-03-10T16:53:59.055632+0000 mgr.gibba045.orlgmj (mgr.34412) 9758 : cluster [DBG] pgmap v5564: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:59.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:53:59 gibba015 bash[29377]: audit 2021-03-10T16:53:59.071794+0000 mon.c (mon.1) 2686 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:53:59.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:53:59 gibba015 bash[30343]: cluster 2021-03-10T16:53:59.055632+0000 mgr.gibba045.orlgmj (mgr.34412) 9758 : cluster [DBG] pgmap v5564: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:59.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:53:59 gibba015 bash[30343]: audit 2021-03-10T16:53:59.071794+0000 mon.c (mon.1) 2686 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:53:59.499 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:53:59 gibba045 bash[25517]: cluster 2021-03-10T16:53:59.055632+0000 mgr.gibba045.orlgmj (mgr.34412) 9758 : cluster [DBG] pgmap v5564: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:59.499 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:53:59 gibba045 bash[25517]: audit 2021-03-10T16:53:59.071794+0000 mon.c (mon.1) 2686 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:54:00.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:00 gibba045 bash[25517]: audit 2021-03-10T16:53:59.270704+0000 mon.a (mon.0) 2128 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:54:00.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:00 gibba045 bash[25517]: audit 2021-03-10T16:53:59.273789+0000 mon.a (mon.0) 2129 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:54:00.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:00 gibba045 bash[25517]: cephadm 2021-03-10T16:53:59.273858+0000 mgr.gibba045.orlgmj (mgr.34412) 9759 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:54:00.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:00 gibba045 bash[25517]: cephadm 2021-03-10T16:53:59.277422+0000 mgr.gibba045.orlgmj (mgr.34412) 9760 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:54:00.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:00 gibba045 bash[25517]: audit 2021-03-10T16:53:59.485032+0000 mon.a (mon.0) 2130 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:54:00.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:00 gibba045 bash[25517]: audit 2021-03-10T16:53:59.489008+0000 mon.c (mon.1) 2687 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:54:00.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:00 gibba045 bash[25517]: cephadm 2021-03-10T16:53:59.490485+0000 mgr.gibba045.orlgmj (mgr.34412) 9761 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:54:00.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:00 gibba045 bash[25517]: audit 2021-03-10T16:53:59.490523+0000 mon.c (mon.1) 2688 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:54:00.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:00 gibba045 bash[25517]: audit 2021-03-10T16:53:59.491862+0000 mon.c (mon.1) 2689 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:54:00.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:00 gibba045 bash[25517]: cephadm 2021-03-10T16:53:59.492191+0000 mgr.gibba045.orlgmj (mgr.34412) 9762 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:54:00.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:00 gibba045 bash[25517]: audit 2021-03-10T16:53:59.493011+0000 mon.c (mon.1) 2690 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:54:00.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:00 gibba045 bash[25517]: cephadm 2021-03-10T16:53:59.493534+0000 mgr.gibba045.orlgmj (mgr.34412) 9763 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:54:00.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:00 gibba045 bash[25517]: cephadm 2021-03-10T16:53:59.493579+0000 mgr.gibba045.orlgmj (mgr.34412) 9764 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:54:00.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:00 gibba045 bash[25517]: cephadm 2021-03-10T16:53:59.494861+0000 mgr.gibba045.orlgmj (mgr.34412) 9765 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:54:00.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:00 gibba045 bash[25517]: cephadm 2021-03-10T16:53:59.494904+0000 mgr.gibba045.orlgmj (mgr.34412) 9766 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:54:00.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:00 gibba045 bash[25517]: cephadm 2021-03-10T16:53:59.495933+0000 mgr.gibba045.orlgmj (mgr.34412) 9767 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:54:00.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:00 gibba045 bash[25517]: audit 2021-03-10T16:53:59.496229+0000 mon.c (mon.1) 2691 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:54:00.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:00 gibba045 bash[25517]: cephadm 2021-03-10T16:53:59.497756+0000 mgr.gibba045.orlgmj (mgr.34412) 9768 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:54:00.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:00 gibba045 bash[25517]: cephadm 2021-03-10T16:53:59.497801+0000 mgr.gibba045.orlgmj (mgr.34412) 9769 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:54:00.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:00 gibba045 bash[25517]: audit 2021-03-10T16:53:59.498104+0000 mon.c (mon.1) 2692 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:54:00.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:00 gibba045 bash[25517]: cephadm 2021-03-10T16:53:59.499457+0000 mgr.gibba045.orlgmj (mgr.34412) 9770 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:54:00.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:00 gibba045 bash[25517]: cephadm 2021-03-10T16:53:59.499844+0000 mgr.gibba045.orlgmj (mgr.34412) 9771 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:54:00.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:00 gibba045 bash[25517]: cephadm 2021-03-10T16:53:59.501545+0000 mgr.gibba045.orlgmj (mgr.34412) 9772 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:54:00.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:00 gibba045 bash[25517]: cephadm 2021-03-10T16:53:59.501593+0000 mgr.gibba045.orlgmj (mgr.34412) 9773 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:54:00.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:00 gibba045 bash[25517]: cephadm 2021-03-10T16:53:59.501723+0000 mgr.gibba045.orlgmj (mgr.34412) 9774 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:54:00.703 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:54:00.719 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:00 gibba015 bash[29377]: audit 2021-03-10T16:53:59.270704+0000 mon.a (mon.0) 2128 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:54:00.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:00 gibba015 bash[29377]: audit 2021-03-10T16:53:59.273789+0000 mon.a (mon.0) 2129 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:54:00.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:00 gibba015 bash[29377]: cephadm 2021-03-10T16:53:59.273858+0000 mgr.gibba045.orlgmj (mgr.34412) 9759 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:54:00.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:00 gibba015 bash[29377]: cephadm 2021-03-10T16:53:59.277422+0000 mgr.gibba045.orlgmj (mgr.34412) 9760 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:54:00.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:00 gibba015 bash[29377]: audit 2021-03-10T16:53:59.485032+0000 mon.a (mon.0) 2130 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:54:00.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:00 gibba015 bash[29377]: audit 2021-03-10T16:53:59.489008+0000 mon.c (mon.1) 2687 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:54:00.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:00 gibba015 bash[29377]: cephadm 2021-03-10T16:53:59.490485+0000 mgr.gibba045.orlgmj (mgr.34412) 9761 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:54:00.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:00 gibba015 bash[29377]: audit 2021-03-10T16:53:59.490523+0000 mon.c (mon.1) 2688 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:54:00.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:00 gibba015 bash[29377]: audit 2021-03-10T16:53:59.491862+0000 mon.c (mon.1) 2689 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:54:00.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:00 gibba015 bash[29377]: cephadm 2021-03-10T16:53:59.492191+0000 mgr.gibba045.orlgmj (mgr.34412) 9762 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:54:00.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:00 gibba015 bash[29377]: audit 2021-03-10T16:53:59.493011+0000 mon.c (mon.1) 2690 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:54:00.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:00 gibba015 bash[29377]: cephadm 2021-03-10T16:53:59.493534+0000 mgr.gibba045.orlgmj (mgr.34412) 9763 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:54:00.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:00 gibba015 bash[29377]: cephadm 2021-03-10T16:53:59.493579+0000 mgr.gibba045.orlgmj (mgr.34412) 9764 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:54:00.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:00 gibba015 bash[29377]: cephadm 2021-03-10T16:53:59.494861+0000 mgr.gibba045.orlgmj (mgr.34412) 9765 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:54:00.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:00 gibba015 bash[29377]: cephadm 2021-03-10T16:53:59.494904+0000 mgr.gibba045.orlgmj (mgr.34412) 9766 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:54:00.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:00 gibba015 bash[29377]: cephadm 2021-03-10T16:53:59.495933+0000 mgr.gibba045.orlgmj (mgr.34412) 9767 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:54:00.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:00 gibba015 bash[29377]: audit 2021-03-10T16:53:59.496229+0000 mon.c (mon.1) 2691 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:54:00.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:00 gibba015 bash[29377]: cephadm 2021-03-10T16:53:59.497756+0000 mgr.gibba045.orlgmj (mgr.34412) 9768 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:54:00.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:00 gibba015 bash[29377]: cephadm 2021-03-10T16:53:59.497801+0000 mgr.gibba045.orlgmj (mgr.34412) 9769 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:54:00.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:00 gibba015 bash[29377]: audit 2021-03-10T16:53:59.498104+0000 mon.c (mon.1) 2692 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:54:00.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:00 gibba015 bash[29377]: cephadm 2021-03-10T16:53:59.499457+0000 mgr.gibba045.orlgmj (mgr.34412) 9770 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:54:00.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:00 gibba015 bash[30343]: audit 2021-03-10T16:53:59.270704+0000 mon.a (mon.0) 2128 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:54:00.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:00 gibba015 bash[30343]: audit 2021-03-10T16:53:59.273789+0000 mon.a (mon.0) 2129 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:54:00.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:00 gibba015 bash[30343]: cephadm 2021-03-10T16:53:59.273858+0000 mgr.gibba045.orlgmj (mgr.34412) 9759 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:54:00.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:00 gibba015 bash[30343]: cephadm 2021-03-10T16:53:59.277422+0000 mgr.gibba045.orlgmj (mgr.34412) 9760 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:54:00.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:00 gibba015 bash[30343]: audit 2021-03-10T16:53:59.485032+0000 mon.a (mon.0) 2130 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:54:00.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:00 gibba015 bash[30343]: audit 2021-03-10T16:53:59.489008+0000 mon.c (mon.1) 2687 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:54:00.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:00 gibba015 bash[30343]: cephadm 2021-03-10T16:53:59.490485+0000 mgr.gibba045.orlgmj (mgr.34412) 9761 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:54:00.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:00 gibba015 bash[30343]: audit 2021-03-10T16:53:59.490523+0000 mon.c (mon.1) 2688 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:54:00.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:00 gibba015 bash[30343]: audit 2021-03-10T16:53:59.491862+0000 mon.c (mon.1) 2689 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:54:00.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:00 gibba015 bash[30343]: cephadm 2021-03-10T16:53:59.492191+0000 mgr.gibba045.orlgmj (mgr.34412) 9762 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:54:00.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:00 gibba015 bash[30343]: audit 2021-03-10T16:53:59.493011+0000 mon.c (mon.1) 2690 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:54:00.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:00 gibba015 bash[30343]: cephadm 2021-03-10T16:53:59.493534+0000 mgr.gibba045.orlgmj (mgr.34412) 9763 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:54:00.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:00 gibba015 bash[30343]: cephadm 2021-03-10T16:53:59.493579+0000 mgr.gibba045.orlgmj (mgr.34412) 9764 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:54:00.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:00 gibba015 bash[30343]: cephadm 2021-03-10T16:53:59.494861+0000 mgr.gibba045.orlgmj (mgr.34412) 9765 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:54:00.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:00 gibba015 bash[30343]: cephadm 2021-03-10T16:53:59.494904+0000 mgr.gibba045.orlgmj (mgr.34412) 9766 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:54:00.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:00 gibba015 bash[30343]: cephadm 2021-03-10T16:53:59.495933+0000 mgr.gibba045.orlgmj (mgr.34412) 9767 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:54:00.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:00 gibba015 bash[30343]: audit 2021-03-10T16:53:59.496229+0000 mon.c (mon.1) 2691 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:54:00.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:00 gibba015 bash[30343]: cephadm 2021-03-10T16:53:59.497756+0000 mgr.gibba045.orlgmj (mgr.34412) 9768 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:54:00.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:00 gibba015 bash[30343]: cephadm 2021-03-10T16:53:59.497801+0000 mgr.gibba045.orlgmj (mgr.34412) 9769 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:54:00.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:00 gibba015 bash[30343]: audit 2021-03-10T16:53:59.498104+0000 mon.c (mon.1) 2692 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:54:00.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:00 gibba015 bash[30343]: cephadm 2021-03-10T16:53:59.499457+0000 mgr.gibba045.orlgmj (mgr.34412) 9770 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:54:00.733 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:00 gibba015 bash[29377]: cephadm 2021-03-10T16:53:59.499844+0000 mgr.gibba045.orlgmj (mgr.34412) 9771 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:54:00.733 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:00 gibba015 bash[29377]: cephadm 2021-03-10T16:53:59.501545+0000 mgr.gibba045.orlgmj (mgr.34412) 9772 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:54:00.734 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:00 gibba015 bash[29377]: cephadm 2021-03-10T16:53:59.501593+0000 mgr.gibba045.orlgmj (mgr.34412) 9773 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:54:00.734 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:00 gibba015 bash[29377]: cephadm 2021-03-10T16:53:59.501723+0000 mgr.gibba045.orlgmj (mgr.34412) 9774 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:54:00.734 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:00 gibba015 bash[30343]: cephadm 2021-03-10T16:53:59.499844+0000 mgr.gibba045.orlgmj (mgr.34412) 9771 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:54:00.734 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:00 gibba015 bash[30343]: cephadm 2021-03-10T16:53:59.501545+0000 mgr.gibba045.orlgmj (mgr.34412) 9772 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:54:00.735 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:00 gibba015 bash[30343]: cephadm 2021-03-10T16:53:59.501593+0000 mgr.gibba045.orlgmj (mgr.34412) 9773 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:54:00.735 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:00 gibba015 bash[30343]: cephadm 2021-03-10T16:53:59.501723+0000 mgr.gibba045.orlgmj (mgr.34412) 9774 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:54:00.930 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:54:00.931 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 7m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:54:00.931 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 6m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:54:00.931 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:54:00.932 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:54:00.932 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:54:00.932 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:54:00.932 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:54:00.932 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:54:00.933 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 7m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:54:00.933 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 6m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:54:00.933 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:54:00.933 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:54:00.934 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:54:00.934 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:54:00.938 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:54:00.938 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:54:00.938 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:54:00.939 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:54:00.939 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 6m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:54:00.939 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 6m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:54:01.181 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:54:01.181 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:54:01.182 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:54:01.182 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:54:01.182 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:54:01.182 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:54:01.183 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:54:01.183 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:54:01.183 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:54:01.183 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:54:01.183 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:54:01.184 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:54:01.184 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:54:01.184 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:54:01.184 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:54:01.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:01 gibba045 bash[25517]: audit 2021-03-10T16:54:00.697227+0000 mgr.gibba045.orlgmj (mgr.34412) 9775 : audit [DBG] from='client.50604 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:54:01.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:01 gibba045 bash[25517]: audit 2021-03-10T16:54:00.920654+0000 mgr.gibba045.orlgmj (mgr.34412) 9776 : audit [DBG] from='client.50610 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:54:01.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:01 gibba045 bash[25517]: cluster 2021-03-10T16:54:01.057424+0000 mgr.gibba045.orlgmj (mgr.34412) 9777 : cluster [DBG] pgmap v5565: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:01.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:01 gibba045 bash[25517]: audit 2021-03-10T16:54:01.181796+0000 mon.c (mon.1) 2693 : audit [DBG] from='client.? 172.21.2.115:0/409435912' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:54:01.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:01 gibba015 bash[29377]: audit 2021-03-10T16:54:00.697227+0000 mgr.gibba045.orlgmj (mgr.34412) 9775 : audit [DBG] from='client.50604 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:54:01.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:01 gibba015 bash[29377]: audit 2021-03-10T16:54:00.920654+0000 mgr.gibba045.orlgmj (mgr.34412) 9776 : audit [DBG] from='client.50610 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:54:01.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:01 gibba015 bash[29377]: cluster 2021-03-10T16:54:01.057424+0000 mgr.gibba045.orlgmj (mgr.34412) 9777 : cluster [DBG] pgmap v5565: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:01.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:01 gibba015 bash[29377]: audit 2021-03-10T16:54:01.181796+0000 mon.c (mon.1) 2693 : audit [DBG] from='client.? 172.21.2.115:0/409435912' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:54:01.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:01 gibba015 bash[30343]: audit 2021-03-10T16:54:00.697227+0000 mgr.gibba045.orlgmj (mgr.34412) 9775 : audit [DBG] from='client.50604 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:54:01.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:01 gibba015 bash[30343]: audit 2021-03-10T16:54:00.920654+0000 mgr.gibba045.orlgmj (mgr.34412) 9776 : audit [DBG] from='client.50610 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:54:01.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:01 gibba015 bash[30343]: cluster 2021-03-10T16:54:01.057424+0000 mgr.gibba045.orlgmj (mgr.34412) 9777 : cluster [DBG] pgmap v5565: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:01.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:01 gibba015 bash[30343]: audit 2021-03-10T16:54:01.181796+0000 mon.c (mon.1) 2693 : audit [DBG] from='client.? 172.21.2.115:0/409435912' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:54:03.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:03 gibba015 bash[29377]: cluster 2021-03-10T16:54:03.058740+0000 mgr.gibba045.orlgmj (mgr.34412) 9778 : cluster [DBG] pgmap v5566: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:03.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:03 gibba015 bash[30343]: cluster 2021-03-10T16:54:03.058740+0000 mgr.gibba045.orlgmj (mgr.34412) 9778 : cluster [DBG] pgmap v5566: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:03.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:03 gibba045 bash[25517]: cluster 2021-03-10T16:54:03.058740+0000 mgr.gibba045.orlgmj (mgr.34412) 9778 : cluster [DBG] pgmap v5566: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:05.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:05 gibba015 bash[29377]: cluster 2021-03-10T16:54:05.060514+0000 mgr.gibba045.orlgmj (mgr.34412) 9779 : cluster [DBG] pgmap v5567: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:05.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:05 gibba015 bash[30343]: cluster 2021-03-10T16:54:05.060514+0000 mgr.gibba045.orlgmj (mgr.34412) 9779 : cluster [DBG] pgmap v5567: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:05.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:05 gibba045 bash[25517]: cluster 2021-03-10T16:54:05.060514+0000 mgr.gibba045.orlgmj (mgr.34412) 9779 : cluster [DBG] pgmap v5567: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:08.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:07 gibba015 bash[29377]: cluster 2021-03-10T16:54:07.062365+0000 mgr.gibba045.orlgmj (mgr.34412) 9780 : cluster [DBG] pgmap v5568: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:08.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:07 gibba015 bash[30343]: cluster 2021-03-10T16:54:07.062365+0000 mgr.gibba045.orlgmj (mgr.34412) 9780 : cluster [DBG] pgmap v5568: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:08.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:07 gibba045 bash[25517]: cluster 2021-03-10T16:54:07.062365+0000 mgr.gibba045.orlgmj (mgr.34412) 9780 : cluster [DBG] pgmap v5568: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:09.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:09 gibba015 bash[29377]: cluster 2021-03-10T16:54:09.063651+0000 mgr.gibba045.orlgmj (mgr.34412) 9781 : cluster [DBG] pgmap v5569: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:09.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:09 gibba015 bash[30343]: cluster 2021-03-10T16:54:09.063651+0000 mgr.gibba045.orlgmj (mgr.34412) 9781 : cluster [DBG] pgmap v5569: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:09.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:09 gibba045 bash[25517]: cluster 2021-03-10T16:54:09.063651+0000 mgr.gibba045.orlgmj (mgr.34412) 9781 : cluster [DBG] pgmap v5569: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:11.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:11 gibba015 bash[29377]: cluster 2021-03-10T16:54:11.065281+0000 mgr.gibba045.orlgmj (mgr.34412) 9782 : cluster [DBG] pgmap v5570: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:11.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:11 gibba015 bash[30343]: cluster 2021-03-10T16:54:11.065281+0000 mgr.gibba045.orlgmj (mgr.34412) 9782 : cluster [DBG] pgmap v5570: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:11.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:11 gibba045 bash[25517]: cluster 2021-03-10T16:54:11.065281+0000 mgr.gibba045.orlgmj (mgr.34412) 9782 : cluster [DBG] pgmap v5570: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:13.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:13 gibba015 bash[29377]: cluster 2021-03-10T16:54:13.067002+0000 mgr.gibba045.orlgmj (mgr.34412) 9783 : cluster [DBG] pgmap v5571: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:13.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:13 gibba015 bash[30343]: cluster 2021-03-10T16:54:13.067002+0000 mgr.gibba045.orlgmj (mgr.34412) 9783 : cluster [DBG] pgmap v5571: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:13.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:13 gibba045 bash[25517]: cluster 2021-03-10T16:54:13.067002+0000 mgr.gibba045.orlgmj (mgr.34412) 9783 : cluster [DBG] pgmap v5571: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:15.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:15 gibba015 bash[29377]: cephadm 2021-03-10T16:54:14.507838+0000 mgr.gibba045.orlgmj (mgr.34412) 9784 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:54:15.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:15 gibba015 bash[29377]: cluster 2021-03-10T16:54:15.068769+0000 mgr.gibba045.orlgmj (mgr.34412) 9785 : cluster [DBG] pgmap v5572: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:15.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:15 gibba015 bash[30343]: cephadm 2021-03-10T16:54:14.507838+0000 mgr.gibba045.orlgmj (mgr.34412) 9784 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:54:15.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:15 gibba015 bash[30343]: cluster 2021-03-10T16:54:15.068769+0000 mgr.gibba045.orlgmj (mgr.34412) 9785 : cluster [DBG] pgmap v5572: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:15.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:15 gibba045 bash[25517]: cephadm 2021-03-10T16:54:14.507838+0000 mgr.gibba045.orlgmj (mgr.34412) 9784 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:54:15.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:15 gibba045 bash[25517]: cluster 2021-03-10T16:54:15.068769+0000 mgr.gibba045.orlgmj (mgr.34412) 9785 : cluster [DBG] pgmap v5572: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:18.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:17 gibba015 bash[29377]: cluster 2021-03-10T16:54:17.070512+0000 mgr.gibba045.orlgmj (mgr.34412) 9786 : cluster [DBG] pgmap v5573: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:18.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:17 gibba015 bash[30343]: cluster 2021-03-10T16:54:17.070512+0000 mgr.gibba045.orlgmj (mgr.34412) 9786 : cluster [DBG] pgmap v5573: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:18.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:17 gibba045 bash[25517]: cluster 2021-03-10T16:54:17.070512+0000 mgr.gibba045.orlgmj (mgr.34412) 9786 : cluster [DBG] pgmap v5573: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:19.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:19 gibba015 bash[29377]: cluster 2021-03-10T16:54:19.071699+0000 mgr.gibba045.orlgmj (mgr.34412) 9787 : cluster [DBG] pgmap v5574: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:19.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:19 gibba015 bash[30343]: cluster 2021-03-10T16:54:19.071699+0000 mgr.gibba045.orlgmj (mgr.34412) 9787 : cluster [DBG] pgmap v5574: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:19.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:19 gibba045 bash[25517]: cluster 2021-03-10T16:54:19.071699+0000 mgr.gibba045.orlgmj (mgr.34412) 9787 : cluster [DBG] pgmap v5574: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:21.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:21 gibba015 bash[29377]: cluster 2021-03-10T16:54:21.073374+0000 mgr.gibba045.orlgmj (mgr.34412) 9788 : cluster [DBG] pgmap v5575: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:21.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:21 gibba015 bash[30343]: cluster 2021-03-10T16:54:21.073374+0000 mgr.gibba045.orlgmj (mgr.34412) 9788 : cluster [DBG] pgmap v5575: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:21.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:21 gibba045 bash[25517]: cluster 2021-03-10T16:54:21.073374+0000 mgr.gibba045.orlgmj (mgr.34412) 9788 : cluster [DBG] pgmap v5575: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:23.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:23 gibba015 bash[29377]: cluster 2021-03-10T16:54:23.074858+0000 mgr.gibba045.orlgmj (mgr.34412) 9789 : cluster [DBG] pgmap v5576: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:23.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:23 gibba015 bash[30343]: cluster 2021-03-10T16:54:23.074858+0000 mgr.gibba045.orlgmj (mgr.34412) 9789 : cluster [DBG] pgmap v5576: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:23.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:23 gibba045 bash[25517]: cluster 2021-03-10T16:54:23.074858+0000 mgr.gibba045.orlgmj (mgr.34412) 9789 : cluster [DBG] pgmap v5576: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:25.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:25 gibba015 bash[29377]: cluster 2021-03-10T16:54:25.076630+0000 mgr.gibba045.orlgmj (mgr.34412) 9790 : cluster [DBG] pgmap v5577: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:25.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:25 gibba015 bash[30343]: cluster 2021-03-10T16:54:25.076630+0000 mgr.gibba045.orlgmj (mgr.34412) 9790 : cluster [DBG] pgmap v5577: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:25.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:25 gibba045 bash[25517]: cluster 2021-03-10T16:54:25.076630+0000 mgr.gibba045.orlgmj (mgr.34412) 9790 : cluster [DBG] pgmap v5577: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:28.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:27 gibba015 bash[29377]: cluster 2021-03-10T16:54:27.078056+0000 mgr.gibba045.orlgmj (mgr.34412) 9791 : cluster [DBG] pgmap v5578: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:28.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:27 gibba015 bash[30343]: cluster 2021-03-10T16:54:27.078056+0000 mgr.gibba045.orlgmj (mgr.34412) 9791 : cluster [DBG] pgmap v5578: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:28.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:27 gibba045 bash[25517]: cluster 2021-03-10T16:54:27.078056+0000 mgr.gibba045.orlgmj (mgr.34412) 9791 : cluster [DBG] pgmap v5578: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:29.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:29 gibba015 bash[29377]: cluster 2021-03-10T16:54:29.079298+0000 mgr.gibba045.orlgmj (mgr.34412) 9792 : cluster [DBG] pgmap v5579: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:29.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:29 gibba015 bash[30343]: cluster 2021-03-10T16:54:29.079298+0000 mgr.gibba045.orlgmj (mgr.34412) 9792 : cluster [DBG] pgmap v5579: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:29.521 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:29 gibba045 bash[25517]: cluster 2021-03-10T16:54:29.079298+0000 mgr.gibba045.orlgmj (mgr.34412) 9792 : cluster [DBG] pgmap v5579: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:30.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:30 gibba015 bash[29377]: cephadm 2021-03-10T16:54:29.523751+0000 mgr.gibba045.orlgmj (mgr.34412) 9793 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:54:30.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:30 gibba015 bash[30343]: cephadm 2021-03-10T16:54:29.523751+0000 mgr.gibba045.orlgmj (mgr.34412) 9793 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:54:30.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:30 gibba045 bash[25517]: cephadm 2021-03-10T16:54:29.523751+0000 mgr.gibba045.orlgmj (mgr.34412) 9793 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:54:31.423 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:54:31.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:31 gibba015 bash[29377]: cluster 2021-03-10T16:54:31.080844+0000 mgr.gibba045.orlgmj (mgr.34412) 9794 : cluster [DBG] pgmap v5580: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:31.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:31 gibba015 bash[30343]: cluster 2021-03-10T16:54:31.080844+0000 mgr.gibba045.orlgmj (mgr.34412) 9794 : cluster [DBG] pgmap v5580: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:31.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:31 gibba045 bash[25517]: cluster 2021-03-10T16:54:31.080844+0000 mgr.gibba045.orlgmj (mgr.34412) 9794 : cluster [DBG] pgmap v5580: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:31.677 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:54:31.677 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 7m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:54:31.677 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 6m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:54:31.678 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:54:31.678 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:54:31.678 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:54:31.678 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:54:31.678 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:54:31.679 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:54:31.679 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 7m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:54:31.679 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 6m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:54:31.679 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:54:31.680 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:54:31.680 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:54:31.680 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:54:31.680 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:54:31.680 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:54:31.681 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:54:31.681 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:54:31.681 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 6m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:54:31.681 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 6m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:54:31.928 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:54:31.929 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:54:31.929 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:54:31.929 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:54:31.929 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:54:31.930 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:54:31.930 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:54:31.930 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:54:31.930 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:54:31.931 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:54:31.931 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:54:31.931 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:54:31.931 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:54:31.931 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:54:31.932 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:54:33.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:32 gibba015 bash[29377]: audit 2021-03-10T16:54:31.414961+0000 mgr.gibba045.orlgmj (mgr.34412) 9795 : audit [DBG] from='client.50622 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:54:33.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:32 gibba015 bash[29377]: audit 2021-03-10T16:54:31.638128+0000 mgr.gibba045.orlgmj (mgr.34412) 9796 : audit [DBG] from='client.50628 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:54:33.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:32 gibba015 bash[29377]: audit 2021-03-10T16:54:31.928892+0000 mon.a (mon.0) 2131 : audit [DBG] from='client.? 172.21.2.115:0/1897933732' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:54:33.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:32 gibba015 bash[30343]: audit 2021-03-10T16:54:31.414961+0000 mgr.gibba045.orlgmj (mgr.34412) 9795 : audit [DBG] from='client.50622 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:54:33.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:32 gibba015 bash[30343]: audit 2021-03-10T16:54:31.638128+0000 mgr.gibba045.orlgmj (mgr.34412) 9796 : audit [DBG] from='client.50628 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:54:33.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:32 gibba015 bash[30343]: audit 2021-03-10T16:54:31.928892+0000 mon.a (mon.0) 2131 : audit [DBG] from='client.? 172.21.2.115:0/1897933732' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:54:33.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:32 gibba045 bash[25517]: audit 2021-03-10T16:54:31.414961+0000 mgr.gibba045.orlgmj (mgr.34412) 9795 : audit [DBG] from='client.50622 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:54:33.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:32 gibba045 bash[25517]: audit 2021-03-10T16:54:31.638128+0000 mgr.gibba045.orlgmj (mgr.34412) 9796 : audit [DBG] from='client.50628 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:54:33.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:32 gibba045 bash[25517]: audit 2021-03-10T16:54:31.928892+0000 mon.a (mon.0) 2131 : audit [DBG] from='client.? 172.21.2.115:0/1897933732' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:54:34.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:33 gibba015 bash[29377]: cluster 2021-03-10T16:54:33.082441+0000 mgr.gibba045.orlgmj (mgr.34412) 9797 : cluster [DBG] pgmap v5581: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:34.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:33 gibba015 bash[30343]: cluster 2021-03-10T16:54:33.082441+0000 mgr.gibba045.orlgmj (mgr.34412) 9797 : cluster [DBG] pgmap v5581: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:34.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:33 gibba045 bash[25517]: cluster 2021-03-10T16:54:33.082441+0000 mgr.gibba045.orlgmj (mgr.34412) 9797 : cluster [DBG] pgmap v5581: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:35.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:35 gibba015 bash[29377]: cluster 2021-03-10T16:54:35.083984+0000 mgr.gibba045.orlgmj (mgr.34412) 9798 : cluster [DBG] pgmap v5582: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:35.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:35 gibba015 bash[30343]: cluster 2021-03-10T16:54:35.083984+0000 mgr.gibba045.orlgmj (mgr.34412) 9798 : cluster [DBG] pgmap v5582: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:35.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:35 gibba045 bash[25517]: cluster 2021-03-10T16:54:35.083984+0000 mgr.gibba045.orlgmj (mgr.34412) 9798 : cluster [DBG] pgmap v5582: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:38.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:37 gibba015 bash[29377]: cluster 2021-03-10T16:54:37.085705+0000 mgr.gibba045.orlgmj (mgr.34412) 9799 : cluster [DBG] pgmap v5583: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:38.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:37 gibba015 bash[30343]: cluster 2021-03-10T16:54:37.085705+0000 mgr.gibba045.orlgmj (mgr.34412) 9799 : cluster [DBG] pgmap v5583: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:38.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:37 gibba045 bash[25517]: cluster 2021-03-10T16:54:37.085705+0000 mgr.gibba045.orlgmj (mgr.34412) 9799 : cluster [DBG] pgmap v5583: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:39.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:39 gibba015 bash[29377]: cluster 2021-03-10T16:54:39.086952+0000 mgr.gibba045.orlgmj (mgr.34412) 9800 : cluster [DBG] pgmap v5584: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:39.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:39 gibba015 bash[30343]: cluster 2021-03-10T16:54:39.086952+0000 mgr.gibba045.orlgmj (mgr.34412) 9800 : cluster [DBG] pgmap v5584: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:39.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:39 gibba045 bash[25517]: cluster 2021-03-10T16:54:39.086952+0000 mgr.gibba045.orlgmj (mgr.34412) 9800 : cluster [DBG] pgmap v5584: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:41.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:41 gibba015 bash[29377]: cluster 2021-03-10T16:54:41.088728+0000 mgr.gibba045.orlgmj (mgr.34412) 9801 : cluster [DBG] pgmap v5585: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:41.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:41 gibba015 bash[30343]: cluster 2021-03-10T16:54:41.088728+0000 mgr.gibba045.orlgmj (mgr.34412) 9801 : cluster [DBG] pgmap v5585: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:41.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:41 gibba045 bash[25517]: cluster 2021-03-10T16:54:41.088728+0000 mgr.gibba045.orlgmj (mgr.34412) 9801 : cluster [DBG] pgmap v5585: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:44.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:44 gibba015 bash[29377]: cluster 2021-03-10T16:54:43.095791+0000 mgr.gibba045.orlgmj (mgr.34412) 9802 : cluster [DBG] pgmap v5586: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:44.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:44 gibba015 bash[30343]: cluster 2021-03-10T16:54:43.095791+0000 mgr.gibba045.orlgmj (mgr.34412) 9802 : cluster [DBG] pgmap v5586: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:44.535 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:44 gibba045 bash[25517]: cluster 2021-03-10T16:54:43.095791+0000 mgr.gibba045.orlgmj (mgr.34412) 9802 : cluster [DBG] pgmap v5586: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:45.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:45 gibba015 bash[29377]: cephadm 2021-03-10T16:54:44.537273+0000 mgr.gibba045.orlgmj (mgr.34412) 9803 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:54:45.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:45 gibba015 bash[30343]: cephadm 2021-03-10T16:54:44.537273+0000 mgr.gibba045.orlgmj (mgr.34412) 9803 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:54:45.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:45 gibba045 bash[25517]: cephadm 2021-03-10T16:54:44.537273+0000 mgr.gibba045.orlgmj (mgr.34412) 9803 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:54:46.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:46 gibba015 bash[29377]: cluster 2021-03-10T16:54:45.097269+0000 mgr.gibba045.orlgmj (mgr.34412) 9804 : cluster [DBG] pgmap v5587: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:46.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:46 gibba015 bash[30343]: cluster 2021-03-10T16:54:45.097269+0000 mgr.gibba045.orlgmj (mgr.34412) 9804 : cluster [DBG] pgmap v5587: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:46.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:46 gibba045 bash[25517]: cluster 2021-03-10T16:54:45.097269+0000 mgr.gibba045.orlgmj (mgr.34412) 9804 : cluster [DBG] pgmap v5587: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:49.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:48 gibba015 bash[29377]: cluster 2021-03-10T16:54:47.098856+0000 mgr.gibba045.orlgmj (mgr.34412) 9805 : cluster [DBG] pgmap v5588: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:49.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:48 gibba015 bash[30343]: cluster 2021-03-10T16:54:47.098856+0000 mgr.gibba045.orlgmj (mgr.34412) 9805 : cluster [DBG] pgmap v5588: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:49.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:48 gibba045 bash[25517]: cluster 2021-03-10T16:54:47.098856+0000 mgr.gibba045.orlgmj (mgr.34412) 9805 : cluster [DBG] pgmap v5588: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:51.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:50 gibba015 bash[29377]: cluster 2021-03-10T16:54:49.100077+0000 mgr.gibba045.orlgmj (mgr.34412) 9806 : cluster [DBG] pgmap v5589: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:51.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:50 gibba015 bash[30343]: cluster 2021-03-10T16:54:49.100077+0000 mgr.gibba045.orlgmj (mgr.34412) 9806 : cluster [DBG] pgmap v5589: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:51.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:50 gibba045 bash[25517]: cluster 2021-03-10T16:54:49.100077+0000 mgr.gibba045.orlgmj (mgr.34412) 9806 : cluster [DBG] pgmap v5589: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:53.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:52 gibba015 bash[29377]: cluster 2021-03-10T16:54:51.101758+0000 mgr.gibba045.orlgmj (mgr.34412) 9807 : cluster [DBG] pgmap v5590: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:53.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:52 gibba015 bash[30343]: cluster 2021-03-10T16:54:51.101758+0000 mgr.gibba045.orlgmj (mgr.34412) 9807 : cluster [DBG] pgmap v5590: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:53.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:52 gibba045 bash[25517]: cluster 2021-03-10T16:54:51.101758+0000 mgr.gibba045.orlgmj (mgr.34412) 9807 : cluster [DBG] pgmap v5590: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:54.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:53 gibba015 bash[29377]: audit 2021-03-10T16:54:53.785714+0000 mon.c (mon.1) 2694 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:54:54.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:53 gibba015 bash[29377]: audit 2021-03-10T16:54:53.786347+0000 mon.c (mon.1) 2695 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:54:54.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:53 gibba015 bash[29377]: audit 2021-03-10T16:54:53.786914+0000 mon.a (mon.0) 2132 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:54:54.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:53 gibba015 bash[29377]: audit 2021-03-10T16:54:53.788262+0000 mon.a (mon.0) 2133 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:54:54.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:53 gibba015 bash[29377]: audit 2021-03-10T16:54:53.804095+0000 mon.c (mon.1) 2696 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T16:54:54.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:53 gibba015 bash[29377]: audit 2021-03-10T16:54:53.804820+0000 mon.c (mon.1) 2697 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:54:54.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:53 gibba015 bash[29377]: audit 2021-03-10T16:54:53.805392+0000 mon.a (mon.0) 2134 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T16:54:54.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:53 gibba015 bash[29377]: audit 2021-03-10T16:54:53.806000+0000 mon.c (mon.1) 2698 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:54:54.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:53 gibba015 bash[29377]: audit 2021-03-10T16:54:53.807379+0000 mon.c (mon.1) 2699 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T16:54:54.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:53 gibba015 bash[29377]: audit 2021-03-10T16:54:53.807889+0000 mon.a (mon.0) 2135 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:54:54.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:53 gibba015 bash[29377]: audit 2021-03-10T16:54:53.809322+0000 mon.a (mon.0) 2136 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:54:54.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:53 gibba015 bash[29377]: audit 2021-03-10T16:54:53.809675+0000 mon.a (mon.0) 2137 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T16:54:54.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:53 gibba015 bash[30343]: audit 2021-03-10T16:54:53.785714+0000 mon.c (mon.1) 2694 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:54:54.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:53 gibba015 bash[30343]: audit 2021-03-10T16:54:53.786347+0000 mon.c (mon.1) 2695 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:54:54.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:53 gibba015 bash[30343]: audit 2021-03-10T16:54:53.786914+0000 mon.a (mon.0) 2132 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:54:54.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:53 gibba015 bash[30343]: audit 2021-03-10T16:54:53.788262+0000 mon.a (mon.0) 2133 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:54:54.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:53 gibba015 bash[30343]: audit 2021-03-10T16:54:53.804095+0000 mon.c (mon.1) 2696 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T16:54:54.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:53 gibba015 bash[30343]: audit 2021-03-10T16:54:53.804820+0000 mon.c (mon.1) 2697 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:54:54.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:53 gibba015 bash[30343]: audit 2021-03-10T16:54:53.805392+0000 mon.a (mon.0) 2134 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T16:54:54.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:53 gibba015 bash[30343]: audit 2021-03-10T16:54:53.806000+0000 mon.c (mon.1) 2698 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:54:54.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:53 gibba015 bash[30343]: audit 2021-03-10T16:54:53.807379+0000 mon.c (mon.1) 2699 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T16:54:54.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:53 gibba015 bash[30343]: audit 2021-03-10T16:54:53.807889+0000 mon.a (mon.0) 2135 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:54:54.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:53 gibba015 bash[30343]: audit 2021-03-10T16:54:53.809322+0000 mon.a (mon.0) 2136 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:54:54.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:53 gibba015 bash[30343]: audit 2021-03-10T16:54:53.809675+0000 mon.a (mon.0) 2137 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T16:54:54.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:53 gibba045 bash[25517]: audit 2021-03-10T16:54:53.785714+0000 mon.c (mon.1) 2694 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:54:54.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:53 gibba045 bash[25517]: audit 2021-03-10T16:54:53.786347+0000 mon.c (mon.1) 2695 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:54:54.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:53 gibba045 bash[25517]: audit 2021-03-10T16:54:53.786914+0000 mon.a (mon.0) 2132 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:54:54.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:53 gibba045 bash[25517]: audit 2021-03-10T16:54:53.788262+0000 mon.a (mon.0) 2133 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:54:54.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:53 gibba045 bash[25517]: audit 2021-03-10T16:54:53.804095+0000 mon.c (mon.1) 2696 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T16:54:54.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:53 gibba045 bash[25517]: audit 2021-03-10T16:54:53.804820+0000 mon.c (mon.1) 2697 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:54:54.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:53 gibba045 bash[25517]: audit 2021-03-10T16:54:53.805392+0000 mon.a (mon.0) 2134 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T16:54:54.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:53 gibba045 bash[25517]: audit 2021-03-10T16:54:53.806000+0000 mon.c (mon.1) 2698 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:54:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:53 gibba045 bash[25517]: audit 2021-03-10T16:54:53.807379+0000 mon.c (mon.1) 2699 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T16:54:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:53 gibba045 bash[25517]: audit 2021-03-10T16:54:53.807889+0000 mon.a (mon.0) 2135 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:54:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:53 gibba045 bash[25517]: audit 2021-03-10T16:54:53.809322+0000 mon.a (mon.0) 2136 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:54:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:53 gibba045 bash[25517]: audit 2021-03-10T16:54:53.809675+0000 mon.a (mon.0) 2137 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T16:54:55.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:54 gibba015 bash[29377]: cluster 2021-03-10T16:54:53.102486+0000 mgr.gibba045.orlgmj (mgr.34412) 9808 : cluster [DBG] pgmap v5591: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:55.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:54 gibba015 bash[30343]: cluster 2021-03-10T16:54:53.102486+0000 mgr.gibba045.orlgmj (mgr.34412) 9808 : cluster [DBG] pgmap v5591: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:55.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:54 gibba045 bash[25517]: cluster 2021-03-10T16:54:53.102486+0000 mgr.gibba045.orlgmj (mgr.34412) 9808 : cluster [DBG] pgmap v5591: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:57.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:56 gibba015 bash[29377]: cluster 2021-03-10T16:54:55.104033+0000 mgr.gibba045.orlgmj (mgr.34412) 9809 : cluster [DBG] pgmap v5592: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:57.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:56 gibba015 bash[30343]: cluster 2021-03-10T16:54:55.104033+0000 mgr.gibba045.orlgmj (mgr.34412) 9809 : cluster [DBG] pgmap v5592: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:57.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:56 gibba045 bash[25517]: cluster 2021-03-10T16:54:55.104033+0000 mgr.gibba045.orlgmj (mgr.34412) 9809 : cluster [DBG] pgmap v5592: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:59.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:58 gibba015 bash[29377]: cluster 2021-03-10T16:54:57.105804+0000 mgr.gibba045.orlgmj (mgr.34412) 9810 : cluster [DBG] pgmap v5593: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:59.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:58 gibba015 bash[30343]: cluster 2021-03-10T16:54:57.105804+0000 mgr.gibba045.orlgmj (mgr.34412) 9810 : cluster [DBG] pgmap v5593: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:59.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:58 gibba045 bash[25517]: cluster 2021-03-10T16:54:57.105804+0000 mgr.gibba045.orlgmj (mgr.34412) 9810 : cluster [DBG] pgmap v5593: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:00.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:59 gibba045 bash[25517]: audit 2021-03-10T16:54:59.552140+0000 mon.c (mon.1) 2700 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:55:00.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:59 gibba045 bash[25517]: audit 2021-03-10T16:54:59.768981+0000 mon.a (mon.0) 2138 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:55:00.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:59 gibba045 bash[25517]: audit 2021-03-10T16:54:59.773202+0000 mon.c (mon.1) 2701 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:55:00.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:59 gibba045 bash[25517]: audit 2021-03-10T16:54:59.774819+0000 mon.c (mon.1) 2702 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:55:00.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:59 gibba045 bash[25517]: audit 2021-03-10T16:54:59.776140+0000 mon.c (mon.1) 2703 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:55:00.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:59 gibba045 bash[25517]: audit 2021-03-10T16:54:59.777580+0000 mon.c (mon.1) 2704 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:55:00.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:59 gibba045 bash[25517]: audit 2021-03-10T16:54:59.780257+0000 mon.c (mon.1) 2705 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:55:00.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:54:59 gibba045 bash[25517]: audit 2021-03-10T16:54:59.781681+0000 mon.c (mon.1) 2706 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:55:00.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:59 gibba015 bash[29377]: audit 2021-03-10T16:54:59.552140+0000 mon.c (mon.1) 2700 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:55:00.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:59 gibba015 bash[29377]: audit 2021-03-10T16:54:59.768981+0000 mon.a (mon.0) 2138 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:55:00.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:59 gibba015 bash[29377]: audit 2021-03-10T16:54:59.773202+0000 mon.c (mon.1) 2701 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:55:00.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:59 gibba015 bash[29377]: audit 2021-03-10T16:54:59.774819+0000 mon.c (mon.1) 2702 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:55:00.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:59 gibba015 bash[29377]: audit 2021-03-10T16:54:59.776140+0000 mon.c (mon.1) 2703 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:55:00.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:59 gibba015 bash[29377]: audit 2021-03-10T16:54:59.777580+0000 mon.c (mon.1) 2704 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:55:00.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:59 gibba015 bash[29377]: audit 2021-03-10T16:54:59.780257+0000 mon.c (mon.1) 2705 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:55:00.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:54:59 gibba015 bash[29377]: audit 2021-03-10T16:54:59.781681+0000 mon.c (mon.1) 2706 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:55:00.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:59 gibba015 bash[30343]: audit 2021-03-10T16:54:59.552140+0000 mon.c (mon.1) 2700 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:55:00.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:59 gibba015 bash[30343]: audit 2021-03-10T16:54:59.768981+0000 mon.a (mon.0) 2138 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:55:00.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:59 gibba015 bash[30343]: audit 2021-03-10T16:54:59.773202+0000 mon.c (mon.1) 2701 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:55:00.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:59 gibba015 bash[30343]: audit 2021-03-10T16:54:59.774819+0000 mon.c (mon.1) 2702 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:55:00.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:59 gibba015 bash[30343]: audit 2021-03-10T16:54:59.776140+0000 mon.c (mon.1) 2703 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:55:00.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:59 gibba015 bash[30343]: audit 2021-03-10T16:54:59.777580+0000 mon.c (mon.1) 2704 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:55:00.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:59 gibba015 bash[30343]: audit 2021-03-10T16:54:59.780257+0000 mon.c (mon.1) 2705 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:55:00.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:54:59 gibba015 bash[30343]: audit 2021-03-10T16:54:59.781681+0000 mon.c (mon.1) 2706 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:55:01.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:55:00 gibba045 bash[25517]: cluster 2021-03-10T16:54:59.107202+0000 mgr.gibba045.orlgmj (mgr.34412) 9811 : cluster [DBG] pgmap v5594: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:01.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:55:00 gibba045 bash[25517]: cephadm 2021-03-10T16:54:59.560401+0000 mgr.gibba045.orlgmj (mgr.34412) 9812 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:55:01.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:55:00 gibba045 bash[25517]: cephadm 2021-03-10T16:54:59.562118+0000 mgr.gibba045.orlgmj (mgr.34412) 9813 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:55:01.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:55:00 gibba045 bash[25517]: cephadm 2021-03-10T16:54:59.774396+0000 mgr.gibba045.orlgmj (mgr.34412) 9814 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:55:01.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:55:00 gibba045 bash[25517]: cephadm 2021-03-10T16:54:59.776640+0000 mgr.gibba045.orlgmj (mgr.34412) 9815 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:55:01.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:55:00 gibba045 bash[25517]: cephadm 2021-03-10T16:54:59.777871+0000 mgr.gibba045.orlgmj (mgr.34412) 9816 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:55:01.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:55:00 gibba045 bash[25517]: cephadm 2021-03-10T16:54:59.777910+0000 mgr.gibba045.orlgmj (mgr.34412) 9817 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:55:01.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:55:00 gibba045 bash[25517]: cephadm 2021-03-10T16:54:59.779311+0000 mgr.gibba045.orlgmj (mgr.34412) 9818 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:55:01.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:55:00 gibba045 bash[25517]: cephadm 2021-03-10T16:54:59.779350+0000 mgr.gibba045.orlgmj (mgr.34412) 9819 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:55:01.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:55:00 gibba045 bash[25517]: cephadm 2021-03-10T16:54:59.780541+0000 mgr.gibba045.orlgmj (mgr.34412) 9820 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:55:01.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:55:00 gibba045 bash[25517]: cephadm 2021-03-10T16:54:59.782026+0000 mgr.gibba045.orlgmj (mgr.34412) 9821 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:55:01.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:55:00 gibba045 bash[25517]: cephadm 2021-03-10T16:54:59.782064+0000 mgr.gibba045.orlgmj (mgr.34412) 9822 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:55:01.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:55:00 gibba045 bash[25517]: cephadm 2021-03-10T16:54:59.783172+0000 mgr.gibba045.orlgmj (mgr.34412) 9823 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:55:01.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:55:00 gibba045 bash[25517]: cephadm 2021-03-10T16:54:59.783488+0000 mgr.gibba045.orlgmj (mgr.34412) 9824 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:55:01.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:55:00 gibba045 bash[25517]: cephadm 2021-03-10T16:54:59.784805+0000 mgr.gibba045.orlgmj (mgr.34412) 9825 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:55:01.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:55:00 gibba045 bash[25517]: cephadm 2021-03-10T16:54:59.784842+0000 mgr.gibba045.orlgmj (mgr.34412) 9826 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:55:01.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:55:00 gibba045 bash[25517]: cephadm 2021-03-10T16:54:59.784949+0000 mgr.gibba045.orlgmj (mgr.34412) 9827 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:55:01.366 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:55:00 gibba015 bash[29377]: cluster 2021-03-10T16:54:59.107202+0000 mgr.gibba045.orlgmj (mgr.34412) 9811 : cluster [DBG] pgmap v5594: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:01.367 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:55:00 gibba015 bash[29377]: cephadm 2021-03-10T16:54:59.560401+0000 mgr.gibba045.orlgmj (mgr.34412) 9812 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:55:01.367 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:55:00 gibba015 bash[29377]: cephadm 2021-03-10T16:54:59.562118+0000 mgr.gibba045.orlgmj (mgr.34412) 9813 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:55:01.368 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:55:00 gibba015 bash[29377]: cephadm 2021-03-10T16:54:59.774396+0000 mgr.gibba045.orlgmj (mgr.34412) 9814 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:55:01.368 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:55:00 gibba015 bash[29377]: cephadm 2021-03-10T16:54:59.776640+0000 mgr.gibba045.orlgmj (mgr.34412) 9815 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:55:01.368 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:55:00 gibba015 bash[29377]: cephadm 2021-03-10T16:54:59.777871+0000 mgr.gibba045.orlgmj (mgr.34412) 9816 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:55:01.368 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:55:00 gibba015 bash[29377]: cephadm 2021-03-10T16:54:59.777910+0000 mgr.gibba045.orlgmj (mgr.34412) 9817 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:55:01.369 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:55:00 gibba015 bash[29377]: cephadm 2021-03-10T16:54:59.779311+0000 mgr.gibba045.orlgmj (mgr.34412) 9818 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:55:01.369 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:55:00 gibba015 bash[29377]: cephadm 2021-03-10T16:54:59.779350+0000 mgr.gibba045.orlgmj (mgr.34412) 9819 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:55:01.369 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:55:00 gibba015 bash[29377]: cephadm 2021-03-10T16:54:59.780541+0000 mgr.gibba045.orlgmj (mgr.34412) 9820 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:55:01.369 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:55:00 gibba015 bash[29377]: cephadm 2021-03-10T16:54:59.782026+0000 mgr.gibba045.orlgmj (mgr.34412) 9821 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:55:01.369 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:55:00 gibba015 bash[29377]: cephadm 2021-03-10T16:54:59.782064+0000 mgr.gibba045.orlgmj (mgr.34412) 9822 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:55:01.370 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:55:00 gibba015 bash[29377]: cephadm 2021-03-10T16:54:59.783172+0000 mgr.gibba045.orlgmj (mgr.34412) 9823 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:55:01.377 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:55:00 gibba015 bash[29377]: cephadm 2021-03-10T16:54:59.783488+0000 mgr.gibba045.orlgmj (mgr.34412) 9824 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:55:01.377 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:55:00 gibba015 bash[29377]: cephadm 2021-03-10T16:54:59.784805+0000 mgr.gibba045.orlgmj (mgr.34412) 9825 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:55:01.379 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:55:00 gibba015 bash[29377]: cephadm 2021-03-10T16:54:59.784842+0000 mgr.gibba045.orlgmj (mgr.34412) 9826 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:55:01.380 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:55:00 gibba015 bash[29377]: cephadm 2021-03-10T16:54:59.784949+0000 mgr.gibba045.orlgmj (mgr.34412) 9827 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:55:01.380 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:55:00 gibba015 bash[30343]: cluster 2021-03-10T16:54:59.107202+0000 mgr.gibba045.orlgmj (mgr.34412) 9811 : cluster [DBG] pgmap v5594: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:01.380 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:55:00 gibba015 bash[30343]: cephadm 2021-03-10T16:54:59.560401+0000 mgr.gibba045.orlgmj (mgr.34412) 9812 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:55:01.381 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:55:00 gibba015 bash[30343]: cephadm 2021-03-10T16:54:59.562118+0000 mgr.gibba045.orlgmj (mgr.34412) 9813 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:55:01.381 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:55:00 gibba015 bash[30343]: cephadm 2021-03-10T16:54:59.774396+0000 mgr.gibba045.orlgmj (mgr.34412) 9814 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:55:01.381 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:55:00 gibba015 bash[30343]: cephadm 2021-03-10T16:54:59.776640+0000 mgr.gibba045.orlgmj (mgr.34412) 9815 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:55:01.381 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:55:00 gibba015 bash[30343]: cephadm 2021-03-10T16:54:59.777871+0000 mgr.gibba045.orlgmj (mgr.34412) 9816 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:55:01.382 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:55:00 gibba015 bash[30343]: cephadm 2021-03-10T16:54:59.777910+0000 mgr.gibba045.orlgmj (mgr.34412) 9817 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:55:01.382 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:55:00 gibba015 bash[30343]: cephadm 2021-03-10T16:54:59.779311+0000 mgr.gibba045.orlgmj (mgr.34412) 9818 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:55:01.382 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:55:00 gibba015 bash[30343]: cephadm 2021-03-10T16:54:59.779350+0000 mgr.gibba045.orlgmj (mgr.34412) 9819 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:55:01.382 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:55:00 gibba015 bash[30343]: cephadm 2021-03-10T16:54:59.780541+0000 mgr.gibba045.orlgmj (mgr.34412) 9820 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:55:01.382 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:55:00 gibba015 bash[30343]: cephadm 2021-03-10T16:54:59.782026+0000 mgr.gibba045.orlgmj (mgr.34412) 9821 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:55:01.383 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:55:00 gibba015 bash[30343]: cephadm 2021-03-10T16:54:59.782064+0000 mgr.gibba045.orlgmj (mgr.34412) 9822 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:55:01.383 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:55:00 gibba015 bash[30343]: cephadm 2021-03-10T16:54:59.783172+0000 mgr.gibba045.orlgmj (mgr.34412) 9823 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:55:01.383 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:55:00 gibba015 bash[30343]: cephadm 2021-03-10T16:54:59.783488+0000 mgr.gibba045.orlgmj (mgr.34412) 9824 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:55:01.383 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:55:00 gibba015 bash[30343]: cephadm 2021-03-10T16:54:59.784805+0000 mgr.gibba045.orlgmj (mgr.34412) 9825 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:55:01.384 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:55:00 gibba015 bash[30343]: cephadm 2021-03-10T16:54:59.784842+0000 mgr.gibba045.orlgmj (mgr.34412) 9826 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:55:01.384 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:55:00 gibba015 bash[30343]: cephadm 2021-03-10T16:54:59.784949+0000 mgr.gibba045.orlgmj (mgr.34412) 9827 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:55:02.174 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:55:02.398 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:55:02.399 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 8m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:55:02.399 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 7m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:55:02.399 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:55:02.400 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:55:02.400 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:55:02.400 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:55:02.400 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:55:02.401 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:55:02.401 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 8m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:55:02.401 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 7m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:55:02.401 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:55:02.402 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:55:02.402 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:55:02.403 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:55:02.403 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:55:02.404 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:55:02.404 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:55:02.404 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:55:02.404 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 7m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:55:02.404 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 7m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:55:02.647 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:55:02.648 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:55:02.648 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:55:02.648 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:55:02.649 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:55:02.649 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:55:02.649 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:55:02.649 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:55:02.649 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:55:02.650 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:55:02.650 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:55:02.650 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:55:02.650 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:55:02.651 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:55:02.651 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:55:03.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:55:02 gibba045 bash[25517]: cluster 2021-03-10T16:55:01.109023+0000 mgr.gibba045.orlgmj (mgr.34412) 9828 : cluster [DBG] pgmap v5595: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:03.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:55:02 gibba045 bash[25517]: audit 2021-03-10T16:55:02.646039+0000 mon.a (mon.0) 2139 : audit [DBG] from='client.? 172.21.2.115:0/1148922785' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:55:03.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:55:02 gibba015 bash[29377]: cluster 2021-03-10T16:55:01.109023+0000 mgr.gibba045.orlgmj (mgr.34412) 9828 : cluster [DBG] pgmap v5595: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:03.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:55:02 gibba015 bash[29377]: audit 2021-03-10T16:55:02.646039+0000 mon.a (mon.0) 2139 : audit [DBG] from='client.? 172.21.2.115:0/1148922785' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:55:03.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:55:02 gibba015 bash[30343]: cluster 2021-03-10T16:55:01.109023+0000 mgr.gibba045.orlgmj (mgr.34412) 9828 : cluster [DBG] pgmap v5595: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:03.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:55:02 gibba015 bash[30343]: audit 2021-03-10T16:55:02.646039+0000 mon.a (mon.0) 2139 : audit [DBG] from='client.? 172.21.2.115:0/1148922785' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:55:04.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:55:03 gibba045 bash[25517]: audit 2021-03-10T16:55:02.163628+0000 mgr.gibba045.orlgmj (mgr.34412) 9829 : audit [DBG] from='client.60628 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:55:04.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:55:03 gibba045 bash[25517]: audit 2021-03-10T16:55:02.388865+0000 mgr.gibba045.orlgmj (mgr.34412) 9830 : audit [DBG] from='client.60634 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:55:04.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:55:03 gibba015 bash[29377]: audit 2021-03-10T16:55:02.163628+0000 mgr.gibba045.orlgmj (mgr.34412) 9829 : audit [DBG] from='client.60628 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:55:04.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:55:03 gibba015 bash[29377]: audit 2021-03-10T16:55:02.388865+0000 mgr.gibba045.orlgmj (mgr.34412) 9830 : audit [DBG] from='client.60634 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:55:04.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:55:03 gibba015 bash[30343]: audit 2021-03-10T16:55:02.163628+0000 mgr.gibba045.orlgmj (mgr.34412) 9829 : audit [DBG] from='client.60628 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:55:04.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:55:03 gibba015 bash[30343]: audit 2021-03-10T16:55:02.388865+0000 mgr.gibba045.orlgmj (mgr.34412) 9830 : audit [DBG] from='client.60634 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:55:05.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:55:05 gibba045 bash[25517]: cluster 2021-03-10T16:55:03.109801+0000 mgr.gibba045.orlgmj (mgr.34412) 9831 : cluster [DBG] pgmap v5596: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:05.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:55:04 gibba015 bash[29377]: cluster 2021-03-10T16:55:03.109801+0000 mgr.gibba045.orlgmj (mgr.34412) 9831 : cluster [DBG] pgmap v5596: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:05.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:55:04 gibba015 bash[30343]: cluster 2021-03-10T16:55:03.109801+0000 mgr.gibba045.orlgmj (mgr.34412) 9831 : cluster [DBG] pgmap v5596: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:07.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:55:07 gibba045 bash[25517]: cluster 2021-03-10T16:55:05.111248+0000 mgr.gibba045.orlgmj (mgr.34412) 9832 : cluster [DBG] pgmap v5597: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:07.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:55:07 gibba015 bash[29377]: cluster 2021-03-10T16:55:05.111248+0000 mgr.gibba045.orlgmj (mgr.34412) 9832 : cluster [DBG] pgmap v5597: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:07.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:55:07 gibba015 bash[30343]: cluster 2021-03-10T16:55:05.111248+0000 mgr.gibba045.orlgmj (mgr.34412) 9832 : cluster [DBG] pgmap v5597: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:09.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:55:09 gibba045 bash[25517]: cluster 2021-03-10T16:55:07.112934+0000 mgr.gibba045.orlgmj (mgr.34412) 9833 : cluster [DBG] pgmap v5598: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:09.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:55:09 gibba015 bash[29377]: cluster 2021-03-10T16:55:07.112934+0000 mgr.gibba045.orlgmj (mgr.34412) 9833 : cluster [DBG] pgmap v5598: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:09.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:55:09 gibba015 bash[30343]: cluster 2021-03-10T16:55:07.112934+0000 mgr.gibba045.orlgmj (mgr.34412) 9833 : cluster [DBG] pgmap v5598: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:11.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:55:11 gibba045 bash[25517]: cluster 2021-03-10T16:55:09.114295+0000 mgr.gibba045.orlgmj (mgr.34412) 9834 : cluster [DBG] pgmap v5599: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:11.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:55:11 gibba015 bash[29377]: cluster 2021-03-10T16:55:09.114295+0000 mgr.gibba045.orlgmj (mgr.34412) 9834 : cluster [DBG] pgmap v5599: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:11.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:55:11 gibba015 bash[30343]: cluster 2021-03-10T16:55:09.114295+0000 mgr.gibba045.orlgmj (mgr.34412) 9834 : cluster [DBG] pgmap v5599: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:13.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:55:13 gibba045 bash[25517]: cluster 2021-03-10T16:55:11.115916+0000 mgr.gibba045.orlgmj (mgr.34412) 9835 : cluster [DBG] pgmap v5600: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:13.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:55:13 gibba015 bash[29377]: cluster 2021-03-10T16:55:11.115916+0000 mgr.gibba045.orlgmj (mgr.34412) 9835 : cluster [DBG] pgmap v5600: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:13.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:55:13 gibba015 bash[30343]: cluster 2021-03-10T16:55:11.115916+0000 mgr.gibba045.orlgmj (mgr.34412) 9835 : cluster [DBG] pgmap v5600: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:15.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:55:15 gibba045 bash[25517]: cluster 2021-03-10T16:55:13.116591+0000 mgr.gibba045.orlgmj (mgr.34412) 9836 : cluster [DBG] pgmap v5601: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:15.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:55:15 gibba015 bash[29377]: cluster 2021-03-10T16:55:13.116591+0000 mgr.gibba045.orlgmj (mgr.34412) 9836 : cluster [DBG] pgmap v5601: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:15.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:55:15 gibba015 bash[30343]: cluster 2021-03-10T16:55:13.116591+0000 mgr.gibba045.orlgmj (mgr.34412) 9836 : cluster [DBG] pgmap v5601: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:16.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:55:16 gibba045 bash[25517]: cephadm 2021-03-10T16:55:14.800833+0000 mgr.gibba045.orlgmj (mgr.34412) 9837 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:55:16.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:55:16 gibba015 bash[29377]: cephadm 2021-03-10T16:55:14.800833+0000 mgr.gibba045.orlgmj (mgr.34412) 9837 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:55:16.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:55:16 gibba015 bash[30343]: cephadm 2021-03-10T16:55:14.800833+0000 mgr.gibba045.orlgmj (mgr.34412) 9837 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:55:17.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:55:17 gibba015 bash[29377]: cluster 2021-03-10T16:55:15.117288+0000 mgr.gibba045.orlgmj (mgr.34412) 9838 : cluster [DBG] pgmap v5602: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:17.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:55:17 gibba015 bash[30343]: cluster 2021-03-10T16:55:15.117288+0000 mgr.gibba045.orlgmj (mgr.34412) 9838 : cluster [DBG] pgmap v5602: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:17.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:55:17 gibba045 bash[25517]: cluster 2021-03-10T16:55:15.117288+0000 mgr.gibba045.orlgmj (mgr.34412) 9838 : cluster [DBG] pgmap v5602: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:19.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:55:19 gibba015 bash[29377]: cluster 2021-03-10T16:55:17.117986+0000 mgr.gibba045.orlgmj (mgr.34412) 9839 : cluster [DBG] pgmap v5603: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:19.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:55:19 gibba015 bash[30343]: cluster 2021-03-10T16:55:17.117986+0000 mgr.gibba045.orlgmj (mgr.34412) 9839 : cluster [DBG] pgmap v5603: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:19.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:55:19 gibba045 bash[25517]: cluster 2021-03-10T16:55:17.117986+0000 mgr.gibba045.orlgmj (mgr.34412) 9839 : cluster [DBG] pgmap v5603: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:21.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:55:21 gibba015 bash[29377]: cluster 2021-03-10T16:55:19.119106+0000 mgr.gibba045.orlgmj (mgr.34412) 9840 : cluster [DBG] pgmap v5604: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:21.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:55:21 gibba015 bash[30343]: cluster 2021-03-10T16:55:19.119106+0000 mgr.gibba045.orlgmj (mgr.34412) 9840 : cluster [DBG] pgmap v5604: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:21.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:55:21 gibba045 bash[25517]: cluster 2021-03-10T16:55:19.119106+0000 mgr.gibba045.orlgmj (mgr.34412) 9840 : cluster [DBG] pgmap v5604: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:23.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:55:23 gibba015 bash[29377]: cluster 2021-03-10T16:55:21.119763+0000 mgr.gibba045.orlgmj (mgr.34412) 9841 : cluster [DBG] pgmap v5605: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:23.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:55:23 gibba015 bash[30343]: cluster 2021-03-10T16:55:21.119763+0000 mgr.gibba045.orlgmj (mgr.34412) 9841 : cluster [DBG] pgmap v5605: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:23.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:55:23 gibba045 bash[25517]: cluster 2021-03-10T16:55:21.119763+0000 mgr.gibba045.orlgmj (mgr.34412) 9841 : cluster [DBG] pgmap v5605: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:25.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:55:25 gibba015 bash[29377]: cluster 2021-03-10T16:55:23.120454+0000 mgr.gibba045.orlgmj (mgr.34412) 9842 : cluster [DBG] pgmap v5606: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:25.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:55:25 gibba015 bash[30343]: cluster 2021-03-10T16:55:23.120454+0000 mgr.gibba045.orlgmj (mgr.34412) 9842 : cluster [DBG] pgmap v5606: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:25.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:55:25 gibba045 bash[25517]: cluster 2021-03-10T16:55:23.120454+0000 mgr.gibba045.orlgmj (mgr.34412) 9842 : cluster [DBG] pgmap v5606: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:27.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:55:27 gibba015 bash[29377]: cluster 2021-03-10T16:55:25.120938+0000 mgr.gibba045.orlgmj (mgr.34412) 9843 : cluster [DBG] pgmap v5607: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:27.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:55:27 gibba015 bash[30343]: cluster 2021-03-10T16:55:25.120938+0000 mgr.gibba045.orlgmj (mgr.34412) 9843 : cluster [DBG] pgmap v5607: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:27.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:55:27 gibba045 bash[25517]: cluster 2021-03-10T16:55:25.120938+0000 mgr.gibba045.orlgmj (mgr.34412) 9843 : cluster [DBG] pgmap v5607: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:29.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:55:29 gibba015 bash[29377]: cluster 2021-03-10T16:55:27.121422+0000 mgr.gibba045.orlgmj (mgr.34412) 9844 : cluster [DBG] pgmap v5608: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:29.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:55:29 gibba015 bash[30343]: cluster 2021-03-10T16:55:27.121422+0000 mgr.gibba045.orlgmj (mgr.34412) 9844 : cluster [DBG] pgmap v5608: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:29.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:55:29 gibba045 bash[25517]: cluster 2021-03-10T16:55:27.121422+0000 mgr.gibba045.orlgmj (mgr.34412) 9844 : cluster [DBG] pgmap v5608: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:30.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:55:30 gibba015 bash[29377]: cluster 2021-03-10T16:55:29.121825+0000 mgr.gibba045.orlgmj (mgr.34412) 9845 : cluster [DBG] pgmap v5609: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:30.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:55:30 gibba015 bash[29377]: cephadm 2021-03-10T16:55:29.816944+0000 mgr.gibba045.orlgmj (mgr.34412) 9846 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:55:30.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:55:30 gibba015 bash[30343]: cluster 2021-03-10T16:55:29.121825+0000 mgr.gibba045.orlgmj (mgr.34412) 9845 : cluster [DBG] pgmap v5609: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:30.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:55:30 gibba015 bash[30343]: cephadm 2021-03-10T16:55:29.816944+0000 mgr.gibba045.orlgmj (mgr.34412) 9846 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:55:30.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:55:30 gibba045 bash[25517]: cluster 2021-03-10T16:55:29.121825+0000 mgr.gibba045.orlgmj (mgr.34412) 9845 : cluster [DBG] pgmap v5609: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:30.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:55:30 gibba045 bash[25517]: cephadm 2021-03-10T16:55:29.816944+0000 mgr.gibba045.orlgmj (mgr.34412) 9846 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:55:32.888 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:55:33.112 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:55:33.113 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 8m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:55:33.113 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 7m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:55:33.113 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:55:33.113 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:55:33.113 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:55:33.114 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:55:33.114 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:55:33.114 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:55:33.114 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 8m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:55:33.115 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 7m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:55:33.115 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:55:33.115 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:55:33.115 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:55:33.115 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:55:33.116 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:55:33.116 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:55:33.116 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:55:33.116 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:55:33.117 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 7m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:55:33.117 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 7m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:55:33.219 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:55:32 gibba015 bash[29377]: cluster 2021-03-10T16:55:31.123599+0000 mgr.gibba045.orlgmj (mgr.34412) 9847 : cluster [DBG] pgmap v5610: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:33.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:55:32 gibba015 bash[30343]: cluster 2021-03-10T16:55:31.123599+0000 mgr.gibba045.orlgmj (mgr.34412) 9847 : cluster [DBG] pgmap v5610: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:33.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:55:32 gibba045 bash[25517]: cluster 2021-03-10T16:55:31.123599+0000 mgr.gibba045.orlgmj (mgr.34412) 9847 : cluster [DBG] pgmap v5610: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:33.362 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:55:33.363 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:55:33.363 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:55:33.363 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:55:33.363 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:55:33.364 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:55:33.364 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:55:33.364 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:55:33.364 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:55:33.365 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:55:33.365 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:55:33.365 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:55:33.365 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:55:33.366 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:55:33.366 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:55:34.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:55:33 gibba015 bash[29377]: audit 2021-03-10T16:55:32.881814+0000 mgr.gibba045.orlgmj (mgr.34412) 9848 : audit [DBG] from='client.60646 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:55:34.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:55:33 gibba015 bash[29377]: audit 2021-03-10T16:55:33.106308+0000 mgr.gibba045.orlgmj (mgr.34412) 9849 : audit [DBG] from='client.60652 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:55:34.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:55:33 gibba015 bash[29377]: audit 2021-03-10T16:55:33.362806+0000 mon.a (mon.0) 2140 : audit [DBG] from='client.? 172.21.2.115:0/2426609149' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:55:34.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:55:33 gibba015 bash[30343]: audit 2021-03-10T16:55:32.881814+0000 mgr.gibba045.orlgmj (mgr.34412) 9848 : audit [DBG] from='client.60646 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:55:34.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:55:33 gibba015 bash[30343]: audit 2021-03-10T16:55:33.106308+0000 mgr.gibba045.orlgmj (mgr.34412) 9849 : audit [DBG] from='client.60652 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:55:34.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:55:33 gibba015 bash[30343]: audit 2021-03-10T16:55:33.362806+0000 mon.a (mon.0) 2140 : audit [DBG] from='client.? 172.21.2.115:0/2426609149' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:55:34.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:55:33 gibba045 bash[25517]: audit 2021-03-10T16:55:32.881814+0000 mgr.gibba045.orlgmj (mgr.34412) 9848 : audit [DBG] from='client.60646 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:55:34.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:55:33 gibba045 bash[25517]: audit 2021-03-10T16:55:33.106308+0000 mgr.gibba045.orlgmj (mgr.34412) 9849 : audit [DBG] from='client.60652 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:55:34.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:55:33 gibba045 bash[25517]: audit 2021-03-10T16:55:33.362806+0000 mon.a (mon.0) 2140 : audit [DBG] from='client.? 172.21.2.115:0/2426609149' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:55:35.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:55:34 gibba015 bash[29377]: cluster 2021-03-10T16:55:33.124186+0000 mgr.gibba045.orlgmj (mgr.34412) 9850 : cluster [DBG] pgmap v5611: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:35.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:55:34 gibba015 bash[30343]: cluster 2021-03-10T16:55:33.124186+0000 mgr.gibba045.orlgmj (mgr.34412) 9850 : cluster [DBG] pgmap v5611: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:35.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:55:34 gibba045 bash[25517]: cluster 2021-03-10T16:55:33.124186+0000 mgr.gibba045.orlgmj (mgr.34412) 9850 : cluster [DBG] pgmap v5611: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:37.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:55:36 gibba015 bash[29377]: cluster 2021-03-10T16:55:35.125701+0000 mgr.gibba045.orlgmj (mgr.34412) 9851 : cluster [DBG] pgmap v5612: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:37.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:55:36 gibba015 bash[30343]: cluster 2021-03-10T16:55:35.125701+0000 mgr.gibba045.orlgmj (mgr.34412) 9851 : cluster [DBG] pgmap v5612: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:37.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:55:36 gibba045 bash[25517]: cluster 2021-03-10T16:55:35.125701+0000 mgr.gibba045.orlgmj (mgr.34412) 9851 : cluster [DBG] pgmap v5612: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:39.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:55:38 gibba015 bash[29377]: cluster 2021-03-10T16:55:37.127159+0000 mgr.gibba045.orlgmj (mgr.34412) 9852 : cluster [DBG] pgmap v5613: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:39.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:55:38 gibba015 bash[30343]: cluster 2021-03-10T16:55:37.127159+0000 mgr.gibba045.orlgmj (mgr.34412) 9852 : cluster [DBG] pgmap v5613: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:39.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:55:38 gibba045 bash[25517]: cluster 2021-03-10T16:55:37.127159+0000 mgr.gibba045.orlgmj (mgr.34412) 9852 : cluster [DBG] pgmap v5613: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:41.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:55:40 gibba015 bash[29377]: cluster 2021-03-10T16:55:39.128283+0000 mgr.gibba045.orlgmj (mgr.34412) 9853 : cluster [DBG] pgmap v5614: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:41.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:55:40 gibba015 bash[30343]: cluster 2021-03-10T16:55:39.128283+0000 mgr.gibba045.orlgmj (mgr.34412) 9853 : cluster [DBG] pgmap v5614: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:41.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:55:40 gibba045 bash[25517]: cluster 2021-03-10T16:55:39.128283+0000 mgr.gibba045.orlgmj (mgr.34412) 9853 : cluster [DBG] pgmap v5614: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:43.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:55:42 gibba045 bash[25517]: cluster 2021-03-10T16:55:41.129731+0000 mgr.gibba045.orlgmj (mgr.34412) 9854 : cluster [DBG] pgmap v5615: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:43.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:55:42 gibba015 bash[29377]: cluster 2021-03-10T16:55:41.129731+0000 mgr.gibba045.orlgmj (mgr.34412) 9854 : cluster [DBG] pgmap v5615: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:43.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:55:42 gibba015 bash[30343]: cluster 2021-03-10T16:55:41.129731+0000 mgr.gibba045.orlgmj (mgr.34412) 9854 : cluster [DBG] pgmap v5615: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:45.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:55:44 gibba045 bash[25517]: cluster 2021-03-10T16:55:43.130595+0000 mgr.gibba045.orlgmj (mgr.34412) 9855 : cluster [DBG] pgmap v5616: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:45.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:55:44 gibba015 bash[29377]: cluster 2021-03-10T16:55:43.130595+0000 mgr.gibba045.orlgmj (mgr.34412) 9855 : cluster [DBG] pgmap v5616: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:45.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:55:44 gibba015 bash[30343]: cluster 2021-03-10T16:55:43.130595+0000 mgr.gibba045.orlgmj (mgr.34412) 9855 : cluster [DBG] pgmap v5616: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:46.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:55:45 gibba045 bash[25517]: cephadm 2021-03-10T16:55:44.832796+0000 mgr.gibba045.orlgmj (mgr.34412) 9856 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:55:46.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:55:45 gibba015 bash[29377]: cephadm 2021-03-10T16:55:44.832796+0000 mgr.gibba045.orlgmj (mgr.34412) 9856 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:55:46.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:55:45 gibba015 bash[30343]: cephadm 2021-03-10T16:55:44.832796+0000 mgr.gibba045.orlgmj (mgr.34412) 9856 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:55:47.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:55:47 gibba045 bash[25517]: cluster 2021-03-10T16:55:45.131918+0000 mgr.gibba045.orlgmj (mgr.34412) 9857 : cluster [DBG] pgmap v5617: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:47.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:55:46 gibba015 bash[29377]: cluster 2021-03-10T16:55:45.131918+0000 mgr.gibba045.orlgmj (mgr.34412) 9857 : cluster [DBG] pgmap v5617: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:47.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:55:46 gibba015 bash[30343]: cluster 2021-03-10T16:55:45.131918+0000 mgr.gibba045.orlgmj (mgr.34412) 9857 : cluster [DBG] pgmap v5617: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:49.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:55:49 gibba045 bash[25517]: cluster 2021-03-10T16:55:47.133681+0000 mgr.gibba045.orlgmj (mgr.34412) 9858 : cluster [DBG] pgmap v5618: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:49.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:55:49 gibba015 bash[29377]: cluster 2021-03-10T16:55:47.133681+0000 mgr.gibba045.orlgmj (mgr.34412) 9858 : cluster [DBG] pgmap v5618: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:49.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:55:49 gibba015 bash[30343]: cluster 2021-03-10T16:55:47.133681+0000 mgr.gibba045.orlgmj (mgr.34412) 9858 : cluster [DBG] pgmap v5618: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:51.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:55:51 gibba045 bash[25517]: cluster 2021-03-10T16:55:49.134866+0000 mgr.gibba045.orlgmj (mgr.34412) 9859 : cluster [DBG] pgmap v5619: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:51.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:55:51 gibba015 bash[29377]: cluster 2021-03-10T16:55:49.134866+0000 mgr.gibba045.orlgmj (mgr.34412) 9859 : cluster [DBG] pgmap v5619: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:51.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:55:51 gibba015 bash[30343]: cluster 2021-03-10T16:55:49.134866+0000 mgr.gibba045.orlgmj (mgr.34412) 9859 : cluster [DBG] pgmap v5619: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:53.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:55:53 gibba045 bash[25517]: cluster 2021-03-10T16:55:51.135388+0000 mgr.gibba045.orlgmj (mgr.34412) 9860 : cluster [DBG] pgmap v5620: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:53.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:55:53 gibba015 bash[29377]: cluster 2021-03-10T16:55:51.135388+0000 mgr.gibba045.orlgmj (mgr.34412) 9860 : cluster [DBG] pgmap v5620: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:53.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:55:53 gibba015 bash[30343]: cluster 2021-03-10T16:55:51.135388+0000 mgr.gibba045.orlgmj (mgr.34412) 9860 : cluster [DBG] pgmap v5620: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:54.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:55:54 gibba045 bash[25517]: audit 2021-03-10T16:55:53.794261+0000 mon.c (mon.1) 2707 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:55:54.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:55:54 gibba045 bash[25517]: audit 2021-03-10T16:55:53.794895+0000 mon.c (mon.1) 2708 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:55:54.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:55:54 gibba045 bash[25517]: audit 2021-03-10T16:55:53.795362+0000 mon.a (mon.0) 2141 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:55:54.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:55:54 gibba045 bash[25517]: audit 2021-03-10T16:55:53.796430+0000 mon.a (mon.0) 2142 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:55:54.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:55:54 gibba045 bash[25517]: audit 2021-03-10T16:55:53.811634+0000 mon.c (mon.1) 2709 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T16:55:54.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:55:54 gibba045 bash[25517]: audit 2021-03-10T16:55:53.812361+0000 mon.c (mon.1) 2710 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:55:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:55:54 gibba045 bash[25517]: audit 2021-03-10T16:55:53.812901+0000 mon.a (mon.0) 2143 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T16:55:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:55:54 gibba045 bash[25517]: audit 2021-03-10T16:55:53.812971+0000 mon.c (mon.1) 2711 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:55:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:55:54 gibba045 bash[25517]: audit 2021-03-10T16:55:53.813631+0000 mon.c (mon.1) 2712 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:55:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:55:54 gibba045 bash[25517]: audit 2021-03-10T16:55:53.814427+0000 mon.a (mon.0) 2144 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:55:54.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:55:54 gibba045 bash[25517]: audit 2021-03-10T16:55:53.815425+0000 mon.a (mon.0) 2145 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:55:54.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:55:54 gibba045 bash[25517]: audit 2021-03-10T16:55:53.816223+0000 mon.a (mon.0) 2146 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:55:54.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:55:54 gibba015 bash[29377]: audit 2021-03-10T16:55:53.794261+0000 mon.c (mon.1) 2707 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:55:54.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:55:54 gibba015 bash[29377]: audit 2021-03-10T16:55:53.794895+0000 mon.c (mon.1) 2708 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:55:54.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:55:54 gibba015 bash[29377]: audit 2021-03-10T16:55:53.795362+0000 mon.a (mon.0) 2141 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:55:54.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:55:54 gibba015 bash[29377]: audit 2021-03-10T16:55:53.796430+0000 mon.a (mon.0) 2142 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:55:54.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:55:54 gibba015 bash[29377]: audit 2021-03-10T16:55:53.811634+0000 mon.c (mon.1) 2709 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T16:55:54.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:55:54 gibba015 bash[29377]: audit 2021-03-10T16:55:53.812361+0000 mon.c (mon.1) 2710 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:55:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:55:54 gibba015 bash[29377]: audit 2021-03-10T16:55:53.812901+0000 mon.a (mon.0) 2143 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T16:55:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:55:54 gibba015 bash[29377]: audit 2021-03-10T16:55:53.812971+0000 mon.c (mon.1) 2711 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:55:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:55:54 gibba015 bash[29377]: audit 2021-03-10T16:55:53.813631+0000 mon.c (mon.1) 2712 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:55:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:55:54 gibba015 bash[29377]: audit 2021-03-10T16:55:53.814427+0000 mon.a (mon.0) 2144 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:55:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:55:54 gibba015 bash[29377]: audit 2021-03-10T16:55:53.815425+0000 mon.a (mon.0) 2145 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:55:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:55:54 gibba015 bash[29377]: audit 2021-03-10T16:55:53.816223+0000 mon.a (mon.0) 2146 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:55:54.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:55:54 gibba015 bash[30343]: audit 2021-03-10T16:55:53.794261+0000 mon.c (mon.1) 2707 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:55:54.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:55:54 gibba015 bash[30343]: audit 2021-03-10T16:55:53.794895+0000 mon.c (mon.1) 2708 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:55:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:55:54 gibba015 bash[30343]: audit 2021-03-10T16:55:53.795362+0000 mon.a (mon.0) 2141 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:55:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:55:54 gibba015 bash[30343]: audit 2021-03-10T16:55:53.796430+0000 mon.a (mon.0) 2142 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:55:54.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:55:54 gibba015 bash[30343]: audit 2021-03-10T16:55:53.811634+0000 mon.c (mon.1) 2709 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T16:55:54.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:55:54 gibba015 bash[30343]: audit 2021-03-10T16:55:53.812361+0000 mon.c (mon.1) 2710 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:55:54.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:55:54 gibba015 bash[30343]: audit 2021-03-10T16:55:53.812901+0000 mon.a (mon.0) 2143 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T16:55:54.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:55:54 gibba015 bash[30343]: audit 2021-03-10T16:55:53.812971+0000 mon.c (mon.1) 2711 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:55:54.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:55:54 gibba015 bash[30343]: audit 2021-03-10T16:55:53.813631+0000 mon.c (mon.1) 2712 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:55:54.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:55:54 gibba015 bash[30343]: audit 2021-03-10T16:55:53.814427+0000 mon.a (mon.0) 2144 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:55:54.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:55:54 gibba015 bash[30343]: audit 2021-03-10T16:55:53.815425+0000 mon.a (mon.0) 2145 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:55:54.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:55:54 gibba015 bash[30343]: audit 2021-03-10T16:55:53.816223+0000 mon.a (mon.0) 2146 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:55:55.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:55:55 gibba045 bash[25517]: cluster 2021-03-10T16:55:53.135844+0000 mgr.gibba045.orlgmj (mgr.34412) 9861 : cluster [DBG] pgmap v5621: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:55.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:55:55 gibba015 bash[29377]: cluster 2021-03-10T16:55:53.135844+0000 mgr.gibba045.orlgmj (mgr.34412) 9861 : cluster [DBG] pgmap v5621: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:55.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:55:55 gibba015 bash[30343]: cluster 2021-03-10T16:55:53.135844+0000 mgr.gibba045.orlgmj (mgr.34412) 9861 : cluster [DBG] pgmap v5621: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:57.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:55:57 gibba045 bash[25517]: cluster 2021-03-10T16:55:55.137301+0000 mgr.gibba045.orlgmj (mgr.34412) 9862 : cluster [DBG] pgmap v5622: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:57.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:55:57 gibba015 bash[29377]: cluster 2021-03-10T16:55:55.137301+0000 mgr.gibba045.orlgmj (mgr.34412) 9862 : cluster [DBG] pgmap v5622: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:57.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:55:57 gibba015 bash[30343]: cluster 2021-03-10T16:55:55.137301+0000 mgr.gibba045.orlgmj (mgr.34412) 9862 : cluster [DBG] pgmap v5622: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:59.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:55:59 gibba015 bash[29377]: cluster 2021-03-10T16:55:57.138087+0000 mgr.gibba045.orlgmj (mgr.34412) 9863 : cluster [DBG] pgmap v5623: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:59.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:55:59 gibba015 bash[30343]: cluster 2021-03-10T16:55:57.138087+0000 mgr.gibba045.orlgmj (mgr.34412) 9863 : cluster [DBG] pgmap v5623: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:59.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:55:59 gibba045 bash[25517]: cluster 2021-03-10T16:55:57.138087+0000 mgr.gibba045.orlgmj (mgr.34412) 9863 : cluster [DBG] pgmap v5623: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:00.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:56:00 gibba015 bash[29377]: audit 2021-03-10T16:55:59.847471+0000 mon.c (mon.1) 2713 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:56:00.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:56:00 gibba015 bash[30343]: audit 2021-03-10T16:55:59.847471+0000 mon.c (mon.1) 2713 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:56:00.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:56:00 gibba045 bash[25517]: audit 2021-03-10T16:55:59.847471+0000 mon.c (mon.1) 2713 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:56:01.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:56:01 gibba015 bash[29377]: cluster 2021-03-10T16:55:59.139316+0000 mgr.gibba045.orlgmj (mgr.34412) 9864 : cluster [DBG] pgmap v5624: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:01.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:56:01 gibba015 bash[29377]: cephadm 2021-03-10T16:55:59.855001+0000 mgr.gibba045.orlgmj (mgr.34412) 9865 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:56:01.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:56:01 gibba015 bash[29377]: cephadm 2021-03-10T16:55:59.856906+0000 mgr.gibba045.orlgmj (mgr.34412) 9866 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:56:01.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:56:01 gibba015 bash[29377]: audit 2021-03-10T16:56:00.065837+0000 mon.a (mon.0) 2147 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:56:01.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:56:01 gibba015 bash[29377]: audit 2021-03-10T16:56:00.069566+0000 mon.c (mon.1) 2714 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:56:01.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:56:01 gibba015 bash[29377]: cephadm 2021-03-10T16:56:00.070980+0000 mgr.gibba045.orlgmj (mgr.34412) 9867 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:56:01.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:56:01 gibba015 bash[29377]: audit 2021-03-10T16:56:00.071053+0000 mon.c (mon.1) 2715 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:56:01.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:56:01 gibba015 bash[29377]: audit 2021-03-10T16:56:00.072280+0000 mon.c (mon.1) 2716 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:56:01.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:56:01 gibba015 bash[29377]: cephadm 2021-03-10T16:56:00.072721+0000 mgr.gibba045.orlgmj (mgr.34412) 9868 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:56:01.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:56:01 gibba015 bash[29377]: audit 2021-03-10T16:56:00.073525+0000 mon.c (mon.1) 2717 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:56:01.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:56:01 gibba015 bash[29377]: cephadm 2021-03-10T16:56:00.074027+0000 mgr.gibba045.orlgmj (mgr.34412) 9869 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:56:01.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:56:01 gibba015 bash[29377]: cephadm 2021-03-10T16:56:00.074073+0000 mgr.gibba045.orlgmj (mgr.34412) 9870 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:56:01.479 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:56:01 gibba015 bash[29377]: cephadm 2021-03-10T16:56:00.075214+0000 mgr.gibba045.orlgmj (mgr.34412) 9871 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:56:01.480 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:56:01 gibba015 bash[29377]: cephadm 2021-03-10T16:56:00.075258+0000 mgr.gibba045.orlgmj (mgr.34412) 9872 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:56:01.480 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:56:01 gibba015 bash[29377]: cephadm 2021-03-10T16:56:00.076720+0000 mgr.gibba045.orlgmj (mgr.34412) 9873 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:56:01.481 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:56:01 gibba015 bash[29377]: audit 2021-03-10T16:56:00.076788+0000 mon.c (mon.1) 2718 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:56:01.481 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:56:01 gibba015 bash[29377]: audit 2021-03-10T16:56:00.078184+0000 mon.c (mon.1) 2719 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:56:01.482 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:56:01 gibba015 bash[29377]: cephadm 2021-03-10T16:56:00.078402+0000 mgr.gibba045.orlgmj (mgr.34412) 9874 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:56:01.482 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:56:01 gibba015 bash[29377]: cephadm 2021-03-10T16:56:00.078450+0000 mgr.gibba045.orlgmj (mgr.34412) 9875 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:56:01.482 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:56:01 gibba015 bash[29377]: cephadm 2021-03-10T16:56:00.079675+0000 mgr.gibba045.orlgmj (mgr.34412) 9876 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:56:01.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:56:01 gibba015 bash[30343]: cluster 2021-03-10T16:55:59.139316+0000 mgr.gibba045.orlgmj (mgr.34412) 9864 : cluster [DBG] pgmap v5624: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:01.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:56:01 gibba015 bash[30343]: cephadm 2021-03-10T16:55:59.855001+0000 mgr.gibba045.orlgmj (mgr.34412) 9865 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:56:01.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:56:01 gibba015 bash[30343]: cephadm 2021-03-10T16:55:59.856906+0000 mgr.gibba045.orlgmj (mgr.34412) 9866 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:56:01.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:56:01 gibba015 bash[30343]: audit 2021-03-10T16:56:00.065837+0000 mon.a (mon.0) 2147 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:56:01.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:56:01 gibba015 bash[30343]: audit 2021-03-10T16:56:00.069566+0000 mon.c (mon.1) 2714 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:56:01.485 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:56:01 gibba015 bash[30343]: cephadm 2021-03-10T16:56:00.070980+0000 mgr.gibba045.orlgmj (mgr.34412) 9867 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:56:01.485 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:56:01 gibba015 bash[30343]: audit 2021-03-10T16:56:00.071053+0000 mon.c (mon.1) 2715 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:56:01.485 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:56:01 gibba015 bash[30343]: audit 2021-03-10T16:56:00.072280+0000 mon.c (mon.1) 2716 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:56:01.485 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:56:01 gibba015 bash[30343]: cephadm 2021-03-10T16:56:00.072721+0000 mgr.gibba045.orlgmj (mgr.34412) 9868 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:56:01.486 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:56:01 gibba015 bash[30343]: audit 2021-03-10T16:56:00.073525+0000 mon.c (mon.1) 2717 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:56:01.486 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:56:01 gibba015 bash[30343]: cephadm 2021-03-10T16:56:00.074027+0000 mgr.gibba045.orlgmj (mgr.34412) 9869 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:56:01.486 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:56:01 gibba015 bash[30343]: cephadm 2021-03-10T16:56:00.074073+0000 mgr.gibba045.orlgmj (mgr.34412) 9870 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:56:01.487 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:56:01 gibba015 bash[30343]: cephadm 2021-03-10T16:56:00.075214+0000 mgr.gibba045.orlgmj (mgr.34412) 9871 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:56:01.487 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:56:01 gibba015 bash[30343]: cephadm 2021-03-10T16:56:00.075258+0000 mgr.gibba045.orlgmj (mgr.34412) 9872 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:56:01.487 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:56:01 gibba015 bash[30343]: cephadm 2021-03-10T16:56:00.076720+0000 mgr.gibba045.orlgmj (mgr.34412) 9873 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:56:01.487 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:56:01 gibba015 bash[30343]: audit 2021-03-10T16:56:00.076788+0000 mon.c (mon.1) 2718 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:56:01.488 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:56:01 gibba015 bash[30343]: audit 2021-03-10T16:56:00.078184+0000 mon.c (mon.1) 2719 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:56:01.488 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:56:01 gibba015 bash[30343]: cephadm 2021-03-10T16:56:00.078402+0000 mgr.gibba045.orlgmj (mgr.34412) 9874 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:56:01.488 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:56:01 gibba015 bash[30343]: cephadm 2021-03-10T16:56:00.078450+0000 mgr.gibba045.orlgmj (mgr.34412) 9875 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:56:01.488 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:56:01 gibba015 bash[30343]: cephadm 2021-03-10T16:56:00.079675+0000 mgr.gibba045.orlgmj (mgr.34412) 9876 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:56:01.489 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:56:01 gibba015 bash[29377]: cephadm 2021-03-10T16:56:00.080006+0000 mgr.gibba045.orlgmj (mgr.34412) 9877 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:56:01.489 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:56:01 gibba015 bash[29377]: cephadm 2021-03-10T16:56:00.081287+0000 mgr.gibba045.orlgmj (mgr.34412) 9878 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:56:01.497 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:56:01 gibba015 bash[29377]: cephadm 2021-03-10T16:56:00.081336+0000 mgr.gibba045.orlgmj (mgr.34412) 9879 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:56:01.498 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:56:01 gibba015 bash[29377]: cephadm 2021-03-10T16:56:00.081456+0000 mgr.gibba045.orlgmj (mgr.34412) 9880 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:56:01.498 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:56:01 gibba015 bash[30343]: cephadm 2021-03-10T16:56:00.080006+0000 mgr.gibba045.orlgmj (mgr.34412) 9877 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:56:01.499 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:56:01 gibba015 bash[30343]: cephadm 2021-03-10T16:56:00.081287+0000 mgr.gibba045.orlgmj (mgr.34412) 9878 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:56:01.499 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:56:01 gibba015 bash[30343]: cephadm 2021-03-10T16:56:00.081336+0000 mgr.gibba045.orlgmj (mgr.34412) 9879 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:56:01.499 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:56:01 gibba015 bash[30343]: cephadm 2021-03-10T16:56:00.081456+0000 mgr.gibba045.orlgmj (mgr.34412) 9880 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:56:01.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:56:01 gibba045 bash[25517]: cluster 2021-03-10T16:55:59.139316+0000 mgr.gibba045.orlgmj (mgr.34412) 9864 : cluster [DBG] pgmap v5624: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:01.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:56:01 gibba045 bash[25517]: cephadm 2021-03-10T16:55:59.855001+0000 mgr.gibba045.orlgmj (mgr.34412) 9865 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:56:01.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:56:01 gibba045 bash[25517]: cephadm 2021-03-10T16:55:59.856906+0000 mgr.gibba045.orlgmj (mgr.34412) 9866 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:56:01.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:56:01 gibba045 bash[25517]: audit 2021-03-10T16:56:00.065837+0000 mon.a (mon.0) 2147 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:56:01.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:56:01 gibba045 bash[25517]: audit 2021-03-10T16:56:00.069566+0000 mon.c (mon.1) 2714 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:56:01.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:56:01 gibba045 bash[25517]: cephadm 2021-03-10T16:56:00.070980+0000 mgr.gibba045.orlgmj (mgr.34412) 9867 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:56:01.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:56:01 gibba045 bash[25517]: audit 2021-03-10T16:56:00.071053+0000 mon.c (mon.1) 2715 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:56:01.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:56:01 gibba045 bash[25517]: audit 2021-03-10T16:56:00.072280+0000 mon.c (mon.1) 2716 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:56:01.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:56:01 gibba045 bash[25517]: cephadm 2021-03-10T16:56:00.072721+0000 mgr.gibba045.orlgmj (mgr.34412) 9868 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:56:01.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:56:01 gibba045 bash[25517]: audit 2021-03-10T16:56:00.073525+0000 mon.c (mon.1) 2717 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:56:01.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:56:01 gibba045 bash[25517]: cephadm 2021-03-10T16:56:00.074027+0000 mgr.gibba045.orlgmj (mgr.34412) 9869 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:56:01.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:56:01 gibba045 bash[25517]: cephadm 2021-03-10T16:56:00.074073+0000 mgr.gibba045.orlgmj (mgr.34412) 9870 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:56:01.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:56:01 gibba045 bash[25517]: cephadm 2021-03-10T16:56:00.075214+0000 mgr.gibba045.orlgmj (mgr.34412) 9871 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:56:01.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:56:01 gibba045 bash[25517]: cephadm 2021-03-10T16:56:00.075258+0000 mgr.gibba045.orlgmj (mgr.34412) 9872 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:56:01.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:56:01 gibba045 bash[25517]: cephadm 2021-03-10T16:56:00.076720+0000 mgr.gibba045.orlgmj (mgr.34412) 9873 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:56:01.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:56:01 gibba045 bash[25517]: audit 2021-03-10T16:56:00.076788+0000 mon.c (mon.1) 2718 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:56:01.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:56:01 gibba045 bash[25517]: audit 2021-03-10T16:56:00.078184+0000 mon.c (mon.1) 2719 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:56:01.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:56:01 gibba045 bash[25517]: cephadm 2021-03-10T16:56:00.078402+0000 mgr.gibba045.orlgmj (mgr.34412) 9874 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:56:01.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:56:01 gibba045 bash[25517]: cephadm 2021-03-10T16:56:00.078450+0000 mgr.gibba045.orlgmj (mgr.34412) 9875 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:56:01.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:56:01 gibba045 bash[25517]: cephadm 2021-03-10T16:56:00.079675+0000 mgr.gibba045.orlgmj (mgr.34412) 9876 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:56:01.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:56:01 gibba045 bash[25517]: cephadm 2021-03-10T16:56:00.080006+0000 mgr.gibba045.orlgmj (mgr.34412) 9877 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:56:01.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:56:01 gibba045 bash[25517]: cephadm 2021-03-10T16:56:00.081287+0000 mgr.gibba045.orlgmj (mgr.34412) 9878 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:56:01.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:56:01 gibba045 bash[25517]: cephadm 2021-03-10T16:56:00.081336+0000 mgr.gibba045.orlgmj (mgr.34412) 9879 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:56:01.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:56:01 gibba045 bash[25517]: cephadm 2021-03-10T16:56:00.081456+0000 mgr.gibba045.orlgmj (mgr.34412) 9880 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:56:03.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:56:03 gibba015 bash[29377]: cluster 2021-03-10T16:56:01.140607+0000 mgr.gibba045.orlgmj (mgr.34412) 9881 : cluster [DBG] pgmap v5625: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:03.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:56:03 gibba015 bash[30343]: cluster 2021-03-10T16:56:01.140607+0000 mgr.gibba045.orlgmj (mgr.34412) 9881 : cluster [DBG] pgmap v5625: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:03.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:56:03 gibba045 bash[25517]: cluster 2021-03-10T16:56:01.140607+0000 mgr.gibba045.orlgmj (mgr.34412) 9881 : cluster [DBG] pgmap v5625: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:03.605 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:56:03.825 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:56:03.826 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 9m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:56:03.826 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 8m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:56:03.826 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:56:03.826 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:56:03.827 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:56:03.827 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:56:03.827 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:56:03.827 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:56:03.828 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 9m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:56:03.828 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 8m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:56:03.828 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:56:03.828 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:56:03.829 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:56:03.829 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:56:03.829 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:56:03.829 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:56:03.830 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:56:03.830 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:56:03.830 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 8m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:56:03.830 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 8m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:56:04.072 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:56:04.072 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:56:04.072 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:56:04.073 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:56:04.073 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:56:04.073 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:56:04.073 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:56:04.073 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:56:04.074 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:56:04.074 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:56:04.074 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:56:04.074 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:56:04.075 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:56:04.075 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:56:04.075 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:56:04.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:56:04 gibba015 bash[29377]: audit 2021-03-10T16:56:04.071929+0000 mon.a (mon.0) 2148 : audit [DBG] from='client.? 172.21.2.115:0/69638680' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:56:04.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:56:04 gibba015 bash[30343]: audit 2021-03-10T16:56:04.071929+0000 mon.a (mon.0) 2148 : audit [DBG] from='client.? 172.21.2.115:0/69638680' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:56:04.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:56:04 gibba045 bash[25517]: audit 2021-03-10T16:56:04.071929+0000 mon.a (mon.0) 2148 : audit [DBG] from='client.? 172.21.2.115:0/69638680' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:56:05.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:56:05 gibba015 bash[29377]: cluster 2021-03-10T16:56:03.141288+0000 mgr.gibba045.orlgmj (mgr.34412) 9882 : cluster [DBG] pgmap v5626: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:05.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:56:05 gibba015 bash[29377]: audit 2021-03-10T16:56:03.598713+0000 mgr.gibba045.orlgmj (mgr.34412) 9883 : audit [DBG] from='client.50676 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:56:05.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:56:05 gibba015 bash[29377]: audit 2021-03-10T16:56:03.818570+0000 mgr.gibba045.orlgmj (mgr.34412) 9884 : audit [DBG] from='client.50682 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:56:05.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:56:05 gibba015 bash[30343]: cluster 2021-03-10T16:56:03.141288+0000 mgr.gibba045.orlgmj (mgr.34412) 9882 : cluster [DBG] pgmap v5626: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:05.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:56:05 gibba015 bash[30343]: audit 2021-03-10T16:56:03.598713+0000 mgr.gibba045.orlgmj (mgr.34412) 9883 : audit [DBG] from='client.50676 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:56:05.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:56:05 gibba015 bash[30343]: audit 2021-03-10T16:56:03.818570+0000 mgr.gibba045.orlgmj (mgr.34412) 9884 : audit [DBG] from='client.50682 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:56:05.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:56:05 gibba045 bash[25517]: cluster 2021-03-10T16:56:03.141288+0000 mgr.gibba045.orlgmj (mgr.34412) 9882 : cluster [DBG] pgmap v5626: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:05.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:56:05 gibba045 bash[25517]: audit 2021-03-10T16:56:03.598713+0000 mgr.gibba045.orlgmj (mgr.34412) 9883 : audit [DBG] from='client.50676 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:56:05.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:56:05 gibba045 bash[25517]: audit 2021-03-10T16:56:03.818570+0000 mgr.gibba045.orlgmj (mgr.34412) 9884 : audit [DBG] from='client.50682 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:56:07.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:56:07 gibba015 bash[29377]: cluster 2021-03-10T16:56:05.141743+0000 mgr.gibba045.orlgmj (mgr.34412) 9885 : cluster [DBG] pgmap v5627: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:07.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:56:07 gibba015 bash[30343]: cluster 2021-03-10T16:56:05.141743+0000 mgr.gibba045.orlgmj (mgr.34412) 9885 : cluster [DBG] pgmap v5627: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:07.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:56:07 gibba045 bash[25517]: cluster 2021-03-10T16:56:05.141743+0000 mgr.gibba045.orlgmj (mgr.34412) 9885 : cluster [DBG] pgmap v5627: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:09.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:56:09 gibba015 bash[29377]: cluster 2021-03-10T16:56:07.142396+0000 mgr.gibba045.orlgmj (mgr.34412) 9886 : cluster [DBG] pgmap v5628: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:09.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:56:09 gibba015 bash[30343]: cluster 2021-03-10T16:56:07.142396+0000 mgr.gibba045.orlgmj (mgr.34412) 9886 : cluster [DBG] pgmap v5628: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:09.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:56:09 gibba045 bash[25517]: cluster 2021-03-10T16:56:07.142396+0000 mgr.gibba045.orlgmj (mgr.34412) 9886 : cluster [DBG] pgmap v5628: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:11.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:56:11 gibba015 bash[29377]: cluster 2021-03-10T16:56:09.144005+0000 mgr.gibba045.orlgmj (mgr.34412) 9887 : cluster [DBG] pgmap v5629: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:11.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:56:11 gibba015 bash[30343]: cluster 2021-03-10T16:56:09.144005+0000 mgr.gibba045.orlgmj (mgr.34412) 9887 : cluster [DBG] pgmap v5629: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:11.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:56:11 gibba045 bash[25517]: cluster 2021-03-10T16:56:09.144005+0000 mgr.gibba045.orlgmj (mgr.34412) 9887 : cluster [DBG] pgmap v5629: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:13.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:56:12 gibba015 bash[29377]: cluster 2021-03-10T16:56:11.144518+0000 mgr.gibba045.orlgmj (mgr.34412) 9888 : cluster [DBG] pgmap v5630: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:13.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:56:12 gibba015 bash[30343]: cluster 2021-03-10T16:56:11.144518+0000 mgr.gibba045.orlgmj (mgr.34412) 9888 : cluster [DBG] pgmap v5630: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:13.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:56:12 gibba045 bash[25517]: cluster 2021-03-10T16:56:11.144518+0000 mgr.gibba045.orlgmj (mgr.34412) 9888 : cluster [DBG] pgmap v5630: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:15.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:56:14 gibba015 bash[29377]: cluster 2021-03-10T16:56:13.145732+0000 mgr.gibba045.orlgmj (mgr.34412) 9889 : cluster [DBG] pgmap v5631: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:15.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:56:14 gibba015 bash[30343]: cluster 2021-03-10T16:56:13.145732+0000 mgr.gibba045.orlgmj (mgr.34412) 9889 : cluster [DBG] pgmap v5631: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:15.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:56:14 gibba045 bash[25517]: cluster 2021-03-10T16:56:13.145732+0000 mgr.gibba045.orlgmj (mgr.34412) 9889 : cluster [DBG] pgmap v5631: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:16.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:56:15 gibba015 bash[29377]: cephadm 2021-03-10T16:56:15.097288+0000 mgr.gibba045.orlgmj (mgr.34412) 9890 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:56:16.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:56:15 gibba015 bash[30343]: cephadm 2021-03-10T16:56:15.097288+0000 mgr.gibba045.orlgmj (mgr.34412) 9890 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:56:16.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:56:15 gibba045 bash[25517]: cephadm 2021-03-10T16:56:15.097288+0000 mgr.gibba045.orlgmj (mgr.34412) 9890 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:56:17.220 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:56:16 gibba015 bash[29377]: cluster 2021-03-10T16:56:15.146213+0000 mgr.gibba045.orlgmj (mgr.34412) 9891 : cluster [DBG] pgmap v5632: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:17.220 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:56:16 gibba015 bash[30343]: cluster 2021-03-10T16:56:15.146213+0000 mgr.gibba045.orlgmj (mgr.34412) 9891 : cluster [DBG] pgmap v5632: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:17.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:56:16 gibba045 bash[25517]: cluster 2021-03-10T16:56:15.146213+0000 mgr.gibba045.orlgmj (mgr.34412) 9891 : cluster [DBG] pgmap v5632: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:19.303 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:56:18 gibba045 bash[25517]: cluster 2021-03-10T16:56:17.147710+0000 mgr.gibba045.orlgmj (mgr.34412) 9892 : cluster [DBG] pgmap v5633: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:19.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:56:18 gibba015 bash[29377]: cluster 2021-03-10T16:56:17.147710+0000 mgr.gibba045.orlgmj (mgr.34412) 9892 : cluster [DBG] pgmap v5633: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:19.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:56:18 gibba015 bash[30343]: cluster 2021-03-10T16:56:17.147710+0000 mgr.gibba045.orlgmj (mgr.34412) 9892 : cluster [DBG] pgmap v5633: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:21.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:56:20 gibba045 bash[25517]: cluster 2021-03-10T16:56:19.148962+0000 mgr.gibba045.orlgmj (mgr.34412) 9893 : cluster [DBG] pgmap v5634: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:21.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:56:20 gibba015 bash[29377]: cluster 2021-03-10T16:56:19.148962+0000 mgr.gibba045.orlgmj (mgr.34412) 9893 : cluster [DBG] pgmap v5634: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:21.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:56:20 gibba015 bash[30343]: cluster 2021-03-10T16:56:19.148962+0000 mgr.gibba045.orlgmj (mgr.34412) 9893 : cluster [DBG] pgmap v5634: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:23.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:56:22 gibba045 bash[25517]: cluster 2021-03-10T16:56:21.149664+0000 mgr.gibba045.orlgmj (mgr.34412) 9894 : cluster [DBG] pgmap v5635: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:23.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:56:22 gibba015 bash[29377]: cluster 2021-03-10T16:56:21.149664+0000 mgr.gibba045.orlgmj (mgr.34412) 9894 : cluster [DBG] pgmap v5635: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:23.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:56:22 gibba015 bash[30343]: cluster 2021-03-10T16:56:21.149664+0000 mgr.gibba045.orlgmj (mgr.34412) 9894 : cluster [DBG] pgmap v5635: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:25.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:56:25 gibba045 bash[25517]: cluster 2021-03-10T16:56:23.150297+0000 mgr.gibba045.orlgmj (mgr.34412) 9895 : cluster [DBG] pgmap v5636: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:25.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:56:25 gibba015 bash[29377]: cluster 2021-03-10T16:56:23.150297+0000 mgr.gibba045.orlgmj (mgr.34412) 9895 : cluster [DBG] pgmap v5636: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:25.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:56:25 gibba015 bash[30343]: cluster 2021-03-10T16:56:23.150297+0000 mgr.gibba045.orlgmj (mgr.34412) 9895 : cluster [DBG] pgmap v5636: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:27.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:56:27 gibba045 bash[25517]: cluster 2021-03-10T16:56:25.151729+0000 mgr.gibba045.orlgmj (mgr.34412) 9896 : cluster [DBG] pgmap v5637: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:27.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:56:27 gibba015 bash[29377]: cluster 2021-03-10T16:56:25.151729+0000 mgr.gibba045.orlgmj (mgr.34412) 9896 : cluster [DBG] pgmap v5637: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:27.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:56:27 gibba015 bash[30343]: cluster 2021-03-10T16:56:25.151729+0000 mgr.gibba045.orlgmj (mgr.34412) 9896 : cluster [DBG] pgmap v5637: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:29.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:56:29 gibba045 bash[25517]: cluster 2021-03-10T16:56:27.152515+0000 mgr.gibba045.orlgmj (mgr.34412) 9897 : cluster [DBG] pgmap v5638: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:29.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:56:29 gibba015 bash[29377]: cluster 2021-03-10T16:56:27.152515+0000 mgr.gibba045.orlgmj (mgr.34412) 9897 : cluster [DBG] pgmap v5638: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:29.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:56:29 gibba015 bash[30343]: cluster 2021-03-10T16:56:27.152515+0000 mgr.gibba045.orlgmj (mgr.34412) 9897 : cluster [DBG] pgmap v5638: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:31.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:56:31 gibba045 bash[25517]: cluster 2021-03-10T16:56:29.153638+0000 mgr.gibba045.orlgmj (mgr.34412) 9898 : cluster [DBG] pgmap v5639: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:31.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:56:31 gibba045 bash[25517]: cephadm 2021-03-10T16:56:30.101842+0000 mgr.gibba045.orlgmj (mgr.34412) 9899 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:56:31.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:56:31 gibba015 bash[29377]: cluster 2021-03-10T16:56:29.153638+0000 mgr.gibba045.orlgmj (mgr.34412) 9898 : cluster [DBG] pgmap v5639: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:31.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:56:31 gibba015 bash[29377]: cephadm 2021-03-10T16:56:30.101842+0000 mgr.gibba045.orlgmj (mgr.34412) 9899 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:56:31.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:56:31 gibba015 bash[30343]: cluster 2021-03-10T16:56:29.153638+0000 mgr.gibba045.orlgmj (mgr.34412) 9898 : cluster [DBG] pgmap v5639: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:31.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:56:31 gibba015 bash[30343]: cephadm 2021-03-10T16:56:30.101842+0000 mgr.gibba045.orlgmj (mgr.34412) 9899 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:56:33.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:56:33 gibba045 bash[25517]: cluster 2021-03-10T16:56:31.155350+0000 mgr.gibba045.orlgmj (mgr.34412) 9900 : cluster [DBG] pgmap v5640: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:33.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:56:33 gibba015 bash[29377]: cluster 2021-03-10T16:56:31.155350+0000 mgr.gibba045.orlgmj (mgr.34412) 9900 : cluster [DBG] pgmap v5640: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:33.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:56:33 gibba015 bash[30343]: cluster 2021-03-10T16:56:31.155350+0000 mgr.gibba045.orlgmj (mgr.34412) 9900 : cluster [DBG] pgmap v5640: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:34.312 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:56:34.541 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:56:34.542 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 9m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:56:34.542 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 8m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:56:34.542 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:56:34.542 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:56:34.543 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:56:34.543 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:56:34.543 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:56:34.543 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:56:34.543 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 9m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:56:34.544 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 8m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:56:34.544 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:56:34.544 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:56:34.544 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:56:34.544 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:56:34.545 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:56:34.545 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:56:34.545 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:56:34.545 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:56:34.545 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 8m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:56:34.546 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 8m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:56:34.797 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:56:34.797 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:56:34.798 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:56:34.798 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:56:34.798 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:56:34.798 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:56:34.798 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:56:34.799 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:56:34.799 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:56:34.799 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:56:34.799 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:56:34.800 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:56:34.800 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:56:34.800 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:56:34.800 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:56:35.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:56:35 gibba045 bash[25517]: cluster 2021-03-10T16:56:33.156211+0000 mgr.gibba045.orlgmj (mgr.34412) 9901 : cluster [DBG] pgmap v5641: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:35.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:56:35 gibba045 bash[25517]: audit 2021-03-10T16:56:34.797296+0000 mon.c (mon.1) 2720 : audit [DBG] from='client.? 172.21.2.115:0/3752358255' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:56:35.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:56:35 gibba015 bash[29377]: cluster 2021-03-10T16:56:33.156211+0000 mgr.gibba045.orlgmj (mgr.34412) 9901 : cluster [DBG] pgmap v5641: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:35.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:56:35 gibba015 bash[29377]: audit 2021-03-10T16:56:34.797296+0000 mon.c (mon.1) 2720 : audit [DBG] from='client.? 172.21.2.115:0/3752358255' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:56:35.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:56:35 gibba015 bash[30343]: cluster 2021-03-10T16:56:33.156211+0000 mgr.gibba045.orlgmj (mgr.34412) 9901 : cluster [DBG] pgmap v5641: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:35.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:56:35 gibba015 bash[30343]: audit 2021-03-10T16:56:34.797296+0000 mon.c (mon.1) 2720 : audit [DBG] from='client.? 172.21.2.115:0/3752358255' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:56:36.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:56:36 gibba015 bash[29377]: audit 2021-03-10T16:56:34.305283+0000 mgr.gibba045.orlgmj (mgr.34412) 9902 : audit [DBG] from='client.60682 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:56:36.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:56:36 gibba015 bash[29377]: audit 2021-03-10T16:56:34.530860+0000 mgr.gibba045.orlgmj (mgr.34412) 9903 : audit [DBG] from='client.50700 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:56:36.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:56:36 gibba015 bash[30343]: audit 2021-03-10T16:56:34.305283+0000 mgr.gibba045.orlgmj (mgr.34412) 9902 : audit [DBG] from='client.60682 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:56:36.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:56:36 gibba015 bash[30343]: audit 2021-03-10T16:56:34.530860+0000 mgr.gibba045.orlgmj (mgr.34412) 9903 : audit [DBG] from='client.50700 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:56:36.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:56:36 gibba045 bash[25517]: audit 2021-03-10T16:56:34.305283+0000 mgr.gibba045.orlgmj (mgr.34412) 9902 : audit [DBG] from='client.60682 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:56:36.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:56:36 gibba045 bash[25517]: audit 2021-03-10T16:56:34.530860+0000 mgr.gibba045.orlgmj (mgr.34412) 9903 : audit [DBG] from='client.50700 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:56:37.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:56:37 gibba015 bash[29377]: cluster 2021-03-10T16:56:35.157822+0000 mgr.gibba045.orlgmj (mgr.34412) 9904 : cluster [DBG] pgmap v5642: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:37.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:56:37 gibba015 bash[30343]: cluster 2021-03-10T16:56:35.157822+0000 mgr.gibba045.orlgmj (mgr.34412) 9904 : cluster [DBG] pgmap v5642: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:37.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:56:37 gibba045 bash[25517]: cluster 2021-03-10T16:56:35.157822+0000 mgr.gibba045.orlgmj (mgr.34412) 9904 : cluster [DBG] pgmap v5642: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:39.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:56:39 gibba015 bash[29377]: cluster 2021-03-10T16:56:37.159491+0000 mgr.gibba045.orlgmj (mgr.34412) 9905 : cluster [DBG] pgmap v5643: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:39.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:56:39 gibba015 bash[30343]: cluster 2021-03-10T16:56:37.159491+0000 mgr.gibba045.orlgmj (mgr.34412) 9905 : cluster [DBG] pgmap v5643: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:39.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:56:39 gibba045 bash[25517]: cluster 2021-03-10T16:56:37.159491+0000 mgr.gibba045.orlgmj (mgr.34412) 9905 : cluster [DBG] pgmap v5643: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:41.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:56:41 gibba015 bash[29377]: cluster 2021-03-10T16:56:39.159953+0000 mgr.gibba045.orlgmj (mgr.34412) 9906 : cluster [DBG] pgmap v5644: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:41.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:56:41 gibba015 bash[30343]: cluster 2021-03-10T16:56:39.159953+0000 mgr.gibba045.orlgmj (mgr.34412) 9906 : cluster [DBG] pgmap v5644: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:41.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:56:41 gibba045 bash[25517]: cluster 2021-03-10T16:56:39.159953+0000 mgr.gibba045.orlgmj (mgr.34412) 9906 : cluster [DBG] pgmap v5644: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:43.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:56:43 gibba015 bash[29377]: cluster 2021-03-10T16:56:41.161491+0000 mgr.gibba045.orlgmj (mgr.34412) 9907 : cluster [DBG] pgmap v5645: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:43.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:56:43 gibba015 bash[30343]: cluster 2021-03-10T16:56:41.161491+0000 mgr.gibba045.orlgmj (mgr.34412) 9907 : cluster [DBG] pgmap v5645: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:43.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:56:43 gibba045 bash[25517]: cluster 2021-03-10T16:56:41.161491+0000 mgr.gibba045.orlgmj (mgr.34412) 9907 : cluster [DBG] pgmap v5645: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:45.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:56:45 gibba015 bash[29377]: cluster 2021-03-10T16:56:43.162588+0000 mgr.gibba045.orlgmj (mgr.34412) 9908 : cluster [DBG] pgmap v5646: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:45.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:56:45 gibba015 bash[30343]: cluster 2021-03-10T16:56:43.162588+0000 mgr.gibba045.orlgmj (mgr.34412) 9908 : cluster [DBG] pgmap v5646: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:45.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:56:45 gibba045 bash[25517]: cluster 2021-03-10T16:56:43.162588+0000 mgr.gibba045.orlgmj (mgr.34412) 9908 : cluster [DBG] pgmap v5646: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:46.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:56:46 gibba015 bash[29377]: cephadm 2021-03-10T16:56:45.117237+0000 mgr.gibba045.orlgmj (mgr.34412) 9909 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:56:46.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:56:46 gibba015 bash[30343]: cephadm 2021-03-10T16:56:45.117237+0000 mgr.gibba045.orlgmj (mgr.34412) 9909 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:56:46.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:56:46 gibba045 bash[25517]: cephadm 2021-03-10T16:56:45.117237+0000 mgr.gibba045.orlgmj (mgr.34412) 9909 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:56:47.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:56:47 gibba015 bash[29377]: cluster 2021-03-10T16:56:45.164072+0000 mgr.gibba045.orlgmj (mgr.34412) 9910 : cluster [DBG] pgmap v5647: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:47.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:56:47 gibba015 bash[30343]: cluster 2021-03-10T16:56:45.164072+0000 mgr.gibba045.orlgmj (mgr.34412) 9910 : cluster [DBG] pgmap v5647: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:47.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:56:47 gibba045 bash[25517]: cluster 2021-03-10T16:56:45.164072+0000 mgr.gibba045.orlgmj (mgr.34412) 9910 : cluster [DBG] pgmap v5647: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:49.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:56:49 gibba015 bash[29377]: cluster 2021-03-10T16:56:47.164949+0000 mgr.gibba045.orlgmj (mgr.34412) 9911 : cluster [DBG] pgmap v5648: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:49.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:56:49 gibba015 bash[30343]: cluster 2021-03-10T16:56:47.164949+0000 mgr.gibba045.orlgmj (mgr.34412) 9911 : cluster [DBG] pgmap v5648: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:49.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:56:49 gibba045 bash[25517]: cluster 2021-03-10T16:56:47.164949+0000 mgr.gibba045.orlgmj (mgr.34412) 9911 : cluster [DBG] pgmap v5648: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:51.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:56:51 gibba015 bash[29377]: cluster 2021-03-10T16:56:49.166047+0000 mgr.gibba045.orlgmj (mgr.34412) 9912 : cluster [DBG] pgmap v5649: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:51.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:56:51 gibba015 bash[30343]: cluster 2021-03-10T16:56:49.166047+0000 mgr.gibba045.orlgmj (mgr.34412) 9912 : cluster [DBG] pgmap v5649: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:51.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:56:51 gibba045 bash[25517]: cluster 2021-03-10T16:56:49.166047+0000 mgr.gibba045.orlgmj (mgr.34412) 9912 : cluster [DBG] pgmap v5649: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:53.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:56:53 gibba015 bash[29377]: cluster 2021-03-10T16:56:51.167021+0000 mgr.gibba045.orlgmj (mgr.34412) 9913 : cluster [DBG] pgmap v5650: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:53.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:56:53 gibba015 bash[30343]: cluster 2021-03-10T16:56:51.167021+0000 mgr.gibba045.orlgmj (mgr.34412) 9913 : cluster [DBG] pgmap v5650: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:53.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:56:53 gibba045 bash[25517]: cluster 2021-03-10T16:56:51.167021+0000 mgr.gibba045.orlgmj (mgr.34412) 9913 : cluster [DBG] pgmap v5650: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:54.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:56:54 gibba015 bash[29377]: audit 2021-03-10T16:56:53.797986+0000 mon.c (mon.1) 2721 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:56:54.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:56:54 gibba015 bash[29377]: audit 2021-03-10T16:56:53.798832+0000 mon.c (mon.1) 2722 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:56:54.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:56:54 gibba015 bash[29377]: audit 2021-03-10T16:56:53.799156+0000 mon.a (mon.0) 2149 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:56:54.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:56:54 gibba015 bash[29377]: audit 2021-03-10T16:56:53.800357+0000 mon.a (mon.0) 2150 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:56:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:56:54 gibba015 bash[29377]: audit 2021-03-10T16:56:53.821417+0000 mon.c (mon.1) 2723 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T16:56:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:56:54 gibba015 bash[29377]: audit 2021-03-10T16:56:53.822149+0000 mon.c (mon.1) 2724 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:56:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:56:54 gibba015 bash[29377]: audit 2021-03-10T16:56:53.822779+0000 mon.a (mon.0) 2151 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T16:56:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:56:54 gibba015 bash[29377]: audit 2021-03-10T16:56:53.822847+0000 mon.c (mon.1) 2725 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:56:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:56:54 gibba015 bash[29377]: audit 2021-03-10T16:56:53.823533+0000 mon.c (mon.1) 2726 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:56:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:56:54 gibba015 bash[29377]: audit 2021-03-10T16:56:53.825528+0000 mon.a (mon.0) 2152 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:56:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:56:54 gibba015 bash[29377]: audit 2021-03-10T16:56:53.826781+0000 mon.a (mon.0) 2153 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:56:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:56:54 gibba015 bash[29377]: audit 2021-03-10T16:56:53.828051+0000 mon.a (mon.0) 2154 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:56:54.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:56:54 gibba015 bash[30343]: audit 2021-03-10T16:56:53.797986+0000 mon.c (mon.1) 2721 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:56:54.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:56:54 gibba015 bash[30343]: audit 2021-03-10T16:56:53.798832+0000 mon.c (mon.1) 2722 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:56:54.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:56:54 gibba015 bash[30343]: audit 2021-03-10T16:56:53.799156+0000 mon.a (mon.0) 2149 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:56:54.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:56:54 gibba015 bash[30343]: audit 2021-03-10T16:56:53.800357+0000 mon.a (mon.0) 2150 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:56:54.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:56:54 gibba015 bash[30343]: audit 2021-03-10T16:56:53.821417+0000 mon.c (mon.1) 2723 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T16:56:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:56:54 gibba015 bash[30343]: audit 2021-03-10T16:56:53.822149+0000 mon.c (mon.1) 2724 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:56:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:56:54 gibba015 bash[30343]: audit 2021-03-10T16:56:53.822779+0000 mon.a (mon.0) 2151 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T16:56:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:56:54 gibba015 bash[30343]: audit 2021-03-10T16:56:53.822847+0000 mon.c (mon.1) 2725 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:56:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:56:54 gibba015 bash[30343]: audit 2021-03-10T16:56:53.823533+0000 mon.c (mon.1) 2726 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:56:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:56:54 gibba015 bash[30343]: audit 2021-03-10T16:56:53.825528+0000 mon.a (mon.0) 2152 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:56:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:56:54 gibba015 bash[30343]: audit 2021-03-10T16:56:53.826781+0000 mon.a (mon.0) 2153 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:56:54.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:56:54 gibba015 bash[30343]: audit 2021-03-10T16:56:53.828051+0000 mon.a (mon.0) 2154 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:56:54.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:56:54 gibba045 bash[25517]: audit 2021-03-10T16:56:53.797986+0000 mon.c (mon.1) 2721 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:56:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:56:54 gibba045 bash[25517]: audit 2021-03-10T16:56:53.798832+0000 mon.c (mon.1) 2722 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:56:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:56:54 gibba045 bash[25517]: audit 2021-03-10T16:56:53.799156+0000 mon.a (mon.0) 2149 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:56:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:56:54 gibba045 bash[25517]: audit 2021-03-10T16:56:53.800357+0000 mon.a (mon.0) 2150 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:56:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:56:54 gibba045 bash[25517]: audit 2021-03-10T16:56:53.821417+0000 mon.c (mon.1) 2723 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T16:56:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:56:54 gibba045 bash[25517]: audit 2021-03-10T16:56:53.822149+0000 mon.c (mon.1) 2724 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:56:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:56:54 gibba045 bash[25517]: audit 2021-03-10T16:56:53.822779+0000 mon.a (mon.0) 2151 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T16:56:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:56:54 gibba045 bash[25517]: audit 2021-03-10T16:56:53.822847+0000 mon.c (mon.1) 2725 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:56:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:56:54 gibba045 bash[25517]: audit 2021-03-10T16:56:53.823533+0000 mon.c (mon.1) 2726 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:56:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:56:54 gibba045 bash[25517]: audit 2021-03-10T16:56:53.825528+0000 mon.a (mon.0) 2152 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:56:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:56:54 gibba045 bash[25517]: audit 2021-03-10T16:56:53.826781+0000 mon.a (mon.0) 2153 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:56:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:56:54 gibba045 bash[25517]: audit 2021-03-10T16:56:53.828051+0000 mon.a (mon.0) 2154 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:56:55.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:56:55 gibba015 bash[29377]: cluster 2021-03-10T16:56:53.168581+0000 mgr.gibba045.orlgmj (mgr.34412) 9914 : cluster [DBG] pgmap v5651: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:55.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:56:55 gibba015 bash[30343]: cluster 2021-03-10T16:56:53.168581+0000 mgr.gibba045.orlgmj (mgr.34412) 9914 : cluster [DBG] pgmap v5651: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:55.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:56:55 gibba045 bash[25517]: cluster 2021-03-10T16:56:53.168581+0000 mgr.gibba045.orlgmj (mgr.34412) 9914 : cluster [DBG] pgmap v5651: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:56.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:56:56 gibba015 bash[29377]: cluster 2021-03-10T16:56:55.169600+0000 mgr.gibba045.orlgmj (mgr.34412) 9915 : cluster [DBG] pgmap v5652: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:56.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:56:56 gibba015 bash[30343]: cluster 2021-03-10T16:56:55.169600+0000 mgr.gibba045.orlgmj (mgr.34412) 9915 : cluster [DBG] pgmap v5652: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:56.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:56:56 gibba045 bash[25517]: cluster 2021-03-10T16:56:55.169600+0000 mgr.gibba045.orlgmj (mgr.34412) 9915 : cluster [DBG] pgmap v5652: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:59.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:56:58 gibba045 bash[25517]: cluster 2021-03-10T16:56:57.170303+0000 mgr.gibba045.orlgmj (mgr.34412) 9916 : cluster [DBG] pgmap v5653: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:59.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:56:58 gibba015 bash[29377]: cluster 2021-03-10T16:56:57.170303+0000 mgr.gibba045.orlgmj (mgr.34412) 9916 : cluster [DBG] pgmap v5653: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:59.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:56:58 gibba015 bash[30343]: cluster 2021-03-10T16:56:57.170303+0000 mgr.gibba045.orlgmj (mgr.34412) 9916 : cluster [DBG] pgmap v5653: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:01.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:57:00 gibba045 bash[25517]: cluster 2021-03-10T16:56:59.171428+0000 mgr.gibba045.orlgmj (mgr.34412) 9917 : cluster [DBG] pgmap v5654: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:01.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:57:00 gibba045 bash[25517]: audit 2021-03-10T16:57:00.127267+0000 mon.c (mon.1) 2727 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:57:01.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:57:00 gibba045 bash[25517]: audit 2021-03-10T16:57:00.133141+0000 mon.c (mon.1) 2728 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:57:01.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:57:00 gibba045 bash[25517]: cephadm 2021-03-10T16:57:00.134614+0000 mgr.gibba045.orlgmj (mgr.34412) 9918 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:57:01.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:57:00 gibba015 bash[29377]: cluster 2021-03-10T16:56:59.171428+0000 mgr.gibba045.orlgmj (mgr.34412) 9917 : cluster [DBG] pgmap v5654: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:01.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:57:00 gibba015 bash[29377]: audit 2021-03-10T16:57:00.127267+0000 mon.c (mon.1) 2727 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:57:01.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:57:00 gibba015 bash[29377]: audit 2021-03-10T16:57:00.133141+0000 mon.c (mon.1) 2728 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:57:01.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:57:00 gibba015 bash[29377]: cephadm 2021-03-10T16:57:00.134614+0000 mgr.gibba045.orlgmj (mgr.34412) 9918 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:57:01.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:57:00 gibba015 bash[30343]: cluster 2021-03-10T16:56:59.171428+0000 mgr.gibba045.orlgmj (mgr.34412) 9917 : cluster [DBG] pgmap v5654: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:01.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:57:00 gibba015 bash[30343]: audit 2021-03-10T16:57:00.127267+0000 mon.c (mon.1) 2727 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:57:01.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:57:00 gibba015 bash[30343]: audit 2021-03-10T16:57:00.133141+0000 mon.c (mon.1) 2728 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:57:01.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:57:00 gibba015 bash[30343]: cephadm 2021-03-10T16:57:00.134614+0000 mgr.gibba045.orlgmj (mgr.34412) 9918 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:57:03.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:57:02 gibba045 bash[25517]: cluster 2021-03-10T16:57:01.173169+0000 mgr.gibba045.orlgmj (mgr.34412) 9919 : cluster [DBG] pgmap v5655: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:03.469 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:57:02 gibba015 bash[29377]: cluster 2021-03-10T16:57:01.173169+0000 mgr.gibba045.orlgmj (mgr.34412) 9919 : cluster [DBG] pgmap v5655: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:03.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:57:03 gibba015 bash[30343]: cluster 2021-03-10T16:57:01.173169+0000 mgr.gibba045.orlgmj (mgr.34412) 9919 : cluster [DBG] pgmap v5655: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:04.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:57:04 gibba015 bash[29377]: cluster 2021-03-10T16:57:03.174734+0000 mgr.gibba045.orlgmj (mgr.34412) 9920 : cluster [DBG] pgmap v5656: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:04.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:57:04 gibba015 bash[29377]: audit 2021-03-10T16:57:03.589204+0000 mon.a (mon.0) 2155 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:57:04.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:57:04 gibba015 bash[29377]: cephadm 2021-03-10T16:57:03.593284+0000 mgr.gibba045.orlgmj (mgr.34412) 9921 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:57:04.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:57:04 gibba015 bash[29377]: audit 2021-03-10T16:57:03.822809+0000 mon.a (mon.0) 2156 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:57:04.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:57:04 gibba015 bash[29377]: audit 2021-03-10T16:57:03.828018+0000 mon.c (mon.1) 2729 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:57:04.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:57:04 gibba015 bash[29377]: cephadm 2021-03-10T16:57:03.829062+0000 mgr.gibba045.orlgmj (mgr.34412) 9922 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:57:04.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:57:04 gibba015 bash[29377]: audit 2021-03-10T16:57:03.829856+0000 mon.c (mon.1) 2730 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:57:04.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:57:04 gibba015 bash[29377]: cephadm 2021-03-10T16:57:03.831504+0000 mgr.gibba045.orlgmj (mgr.34412) 9923 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:57:04.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:57:04 gibba015 bash[29377]: audit 2021-03-10T16:57:03.831550+0000 mon.c (mon.1) 2731 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:57:04.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:57:04 gibba015 bash[29377]: cephadm 2021-03-10T16:57:03.833074+0000 mgr.gibba045.orlgmj (mgr.34412) 9924 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:57:04.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:57:04 gibba015 bash[29377]: cephadm 2021-03-10T16:57:03.833142+0000 mgr.gibba045.orlgmj (mgr.34412) 9925 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:57:04.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:57:04 gibba015 bash[29377]: audit 2021-03-10T16:57:03.833208+0000 mon.c (mon.1) 2732 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:57:04.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:57:04 gibba015 bash[29377]: cephadm 2021-03-10T16:57:03.834768+0000 mgr.gibba045.orlgmj (mgr.34412) 9926 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:57:04.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:57:04 gibba015 bash[29377]: cephadm 2021-03-10T16:57:03.834844+0000 mgr.gibba045.orlgmj (mgr.34412) 9927 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:57:04.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:57:04 gibba015 bash[29377]: cephadm 2021-03-10T16:57:03.836538+0000 mgr.gibba045.orlgmj (mgr.34412) 9928 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:57:04.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:57:04 gibba015 bash[29377]: audit 2021-03-10T16:57:03.837140+0000 mon.c (mon.1) 2733 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:57:04.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:57:04 gibba015 bash[29377]: cephadm 2021-03-10T16:57:03.838442+0000 mgr.gibba045.orlgmj (mgr.34412) 9929 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:57:04.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:57:04 gibba015 bash[29377]: cephadm 2021-03-10T16:57:03.838522+0000 mgr.gibba045.orlgmj (mgr.34412) 9930 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:57:04.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:57:04 gibba015 bash[29377]: audit 2021-03-10T16:57:03.839890+0000 mon.c (mon.1) 2734 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:57:04.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:57:04 gibba015 bash[29377]: cephadm 2021-03-10T16:57:03.840620+0000 mgr.gibba045.orlgmj (mgr.34412) 9931 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:57:04.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:57:04 gibba015 bash[29377]: cephadm 2021-03-10T16:57:03.841520+0000 mgr.gibba045.orlgmj (mgr.34412) 9932 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:57:04.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:57:04 gibba015 bash[29377]: cephadm 2021-03-10T16:57:03.843337+0000 mgr.gibba045.orlgmj (mgr.34412) 9933 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:57:04.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:57:04 gibba015 bash[29377]: cephadm 2021-03-10T16:57:03.843441+0000 mgr.gibba045.orlgmj (mgr.34412) 9934 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:57:04.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:57:04 gibba015 bash[29377]: cephadm 2021-03-10T16:57:03.843696+0000 mgr.gibba045.orlgmj (mgr.34412) 9935 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:57:04.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:57:04 gibba015 bash[30343]: cluster 2021-03-10T16:57:03.174734+0000 mgr.gibba045.orlgmj (mgr.34412) 9920 : cluster [DBG] pgmap v5656: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:04.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:57:04 gibba015 bash[30343]: audit 2021-03-10T16:57:03.589204+0000 mon.a (mon.0) 2155 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:57:04.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:57:04 gibba015 bash[30343]: cephadm 2021-03-10T16:57:03.593284+0000 mgr.gibba045.orlgmj (mgr.34412) 9921 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:57:04.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:57:04 gibba015 bash[30343]: audit 2021-03-10T16:57:03.822809+0000 mon.a (mon.0) 2156 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:57:04.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:57:04 gibba015 bash[30343]: audit 2021-03-10T16:57:03.828018+0000 mon.c (mon.1) 2729 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:57:04.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:57:04 gibba015 bash[30343]: cephadm 2021-03-10T16:57:03.829062+0000 mgr.gibba045.orlgmj (mgr.34412) 9922 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:57:04.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:57:04 gibba015 bash[30343]: audit 2021-03-10T16:57:03.829856+0000 mon.c (mon.1) 2730 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:57:04.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:57:04 gibba015 bash[30343]: cephadm 2021-03-10T16:57:03.831504+0000 mgr.gibba045.orlgmj (mgr.34412) 9923 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:57:04.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:57:04 gibba015 bash[30343]: audit 2021-03-10T16:57:03.831550+0000 mon.c (mon.1) 2731 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:57:04.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:57:04 gibba015 bash[30343]: cephadm 2021-03-10T16:57:03.833074+0000 mgr.gibba045.orlgmj (mgr.34412) 9924 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:57:04.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:57:04 gibba015 bash[30343]: cephadm 2021-03-10T16:57:03.833142+0000 mgr.gibba045.orlgmj (mgr.34412) 9925 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:57:04.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:57:04 gibba015 bash[30343]: audit 2021-03-10T16:57:03.833208+0000 mon.c (mon.1) 2732 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:57:04.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:57:04 gibba015 bash[30343]: cephadm 2021-03-10T16:57:03.834768+0000 mgr.gibba045.orlgmj (mgr.34412) 9926 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:57:04.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:57:04 gibba015 bash[30343]: cephadm 2021-03-10T16:57:03.834844+0000 mgr.gibba045.orlgmj (mgr.34412) 9927 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:57:04.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:57:04 gibba015 bash[30343]: cephadm 2021-03-10T16:57:03.836538+0000 mgr.gibba045.orlgmj (mgr.34412) 9928 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:57:04.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:57:04 gibba015 bash[30343]: audit 2021-03-10T16:57:03.837140+0000 mon.c (mon.1) 2733 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:57:04.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:57:04 gibba015 bash[30343]: cephadm 2021-03-10T16:57:03.838442+0000 mgr.gibba045.orlgmj (mgr.34412) 9929 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:57:04.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:57:04 gibba015 bash[30343]: cephadm 2021-03-10T16:57:03.838522+0000 mgr.gibba045.orlgmj (mgr.34412) 9930 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:57:04.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:57:04 gibba015 bash[30343]: audit 2021-03-10T16:57:03.839890+0000 mon.c (mon.1) 2734 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:57:04.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:57:04 gibba015 bash[30343]: cephadm 2021-03-10T16:57:03.840620+0000 mgr.gibba045.orlgmj (mgr.34412) 9931 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:57:04.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:57:04 gibba015 bash[30343]: cephadm 2021-03-10T16:57:03.841520+0000 mgr.gibba045.orlgmj (mgr.34412) 9932 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:57:04.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:57:04 gibba015 bash[30343]: cephadm 2021-03-10T16:57:03.843337+0000 mgr.gibba045.orlgmj (mgr.34412) 9933 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:57:04.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:57:04 gibba015 bash[30343]: cephadm 2021-03-10T16:57:03.843441+0000 mgr.gibba045.orlgmj (mgr.34412) 9934 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:57:04.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:57:04 gibba015 bash[30343]: cephadm 2021-03-10T16:57:03.843696+0000 mgr.gibba045.orlgmj (mgr.34412) 9935 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:57:05.041 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:57:05.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:57:04 gibba045 bash[25517]: cluster 2021-03-10T16:57:03.174734+0000 mgr.gibba045.orlgmj (mgr.34412) 9920 : cluster [DBG] pgmap v5656: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:05.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:57:04 gibba045 bash[25517]: audit 2021-03-10T16:57:03.589204+0000 mon.a (mon.0) 2155 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:57:05.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:57:04 gibba045 bash[25517]: cephadm 2021-03-10T16:57:03.593284+0000 mgr.gibba045.orlgmj (mgr.34412) 9921 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:57:05.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:57:04 gibba045 bash[25517]: audit 2021-03-10T16:57:03.822809+0000 mon.a (mon.0) 2156 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:57:05.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:57:04 gibba045 bash[25517]: audit 2021-03-10T16:57:03.828018+0000 mon.c (mon.1) 2729 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:57:05.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:57:04 gibba045 bash[25517]: cephadm 2021-03-10T16:57:03.829062+0000 mgr.gibba045.orlgmj (mgr.34412) 9922 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:57:05.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:57:04 gibba045 bash[25517]: audit 2021-03-10T16:57:03.829856+0000 mon.c (mon.1) 2730 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:57:05.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:57:04 gibba045 bash[25517]: cephadm 2021-03-10T16:57:03.831504+0000 mgr.gibba045.orlgmj (mgr.34412) 9923 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:57:05.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:57:04 gibba045 bash[25517]: audit 2021-03-10T16:57:03.831550+0000 mon.c (mon.1) 2731 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:57:05.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:57:04 gibba045 bash[25517]: cephadm 2021-03-10T16:57:03.833074+0000 mgr.gibba045.orlgmj (mgr.34412) 9924 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:57:05.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:57:04 gibba045 bash[25517]: cephadm 2021-03-10T16:57:03.833142+0000 mgr.gibba045.orlgmj (mgr.34412) 9925 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:57:05.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:57:04 gibba045 bash[25517]: audit 2021-03-10T16:57:03.833208+0000 mon.c (mon.1) 2732 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:57:05.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:57:04 gibba045 bash[25517]: cephadm 2021-03-10T16:57:03.834768+0000 mgr.gibba045.orlgmj (mgr.34412) 9926 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:57:05.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:57:04 gibba045 bash[25517]: cephadm 2021-03-10T16:57:03.834844+0000 mgr.gibba045.orlgmj (mgr.34412) 9927 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:57:05.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:57:04 gibba045 bash[25517]: cephadm 2021-03-10T16:57:03.836538+0000 mgr.gibba045.orlgmj (mgr.34412) 9928 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:57:05.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:57:04 gibba045 bash[25517]: audit 2021-03-10T16:57:03.837140+0000 mon.c (mon.1) 2733 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:57:05.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:57:04 gibba045 bash[25517]: cephadm 2021-03-10T16:57:03.838442+0000 mgr.gibba045.orlgmj (mgr.34412) 9929 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:57:05.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:57:04 gibba045 bash[25517]: cephadm 2021-03-10T16:57:03.838522+0000 mgr.gibba045.orlgmj (mgr.34412) 9930 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:57:05.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:57:04 gibba045 bash[25517]: audit 2021-03-10T16:57:03.839890+0000 mon.c (mon.1) 2734 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:57:05.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:57:04 gibba045 bash[25517]: cephadm 2021-03-10T16:57:03.840620+0000 mgr.gibba045.orlgmj (mgr.34412) 9931 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:57:05.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:57:04 gibba045 bash[25517]: cephadm 2021-03-10T16:57:03.841520+0000 mgr.gibba045.orlgmj (mgr.34412) 9932 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:57:05.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:57:04 gibba045 bash[25517]: cephadm 2021-03-10T16:57:03.843337+0000 mgr.gibba045.orlgmj (mgr.34412) 9933 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:57:05.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:57:04 gibba045 bash[25517]: cephadm 2021-03-10T16:57:03.843441+0000 mgr.gibba045.orlgmj (mgr.34412) 9934 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:57:05.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:57:04 gibba045 bash[25517]: cephadm 2021-03-10T16:57:03.843696+0000 mgr.gibba045.orlgmj (mgr.34412) 9935 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:57:05.271 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:57:05.272 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 1s ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:57:05.272 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 9m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:57:05.272 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:57:05.272 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:57:05.272 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 1s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:57:05.273 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 1s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:57:05.273 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:57:05.273 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 1s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:57:05.273 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 1s ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:57:05.274 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 9m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:57:05.274 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 1s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:57:05.274 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 1s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:57:05.274 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 1s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:57:05.274 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 1s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:57:05.275 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:57:05.275 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:57:05.275 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:57:05.275 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:57:05.276 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 9m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:57:05.276 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 9m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:57:05.520 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:57:05.520 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:57:05.520 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:57:05.521 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:57:05.521 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:57:05.521 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:57:05.521 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:57:05.522 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:57:05.522 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:57:05.522 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:57:05.522 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:57:05.522 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:57:05.523 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:57:05.523 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:57:05.523 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:57:05.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:57:05 gibba015 bash[29377]: audit 2021-03-10T16:57:05.034420+0000 mgr.gibba045.orlgmj (mgr.34412) 9936 : audit [DBG] from='client.60700 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:57:05.970 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:57:05 gibba015 bash[29377]: audit 2021-03-10T16:57:05.519872+0000 mon.a (mon.0) 2157 : audit [DBG] from='client.? 172.21.2.115:0/3994016931' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:57:05.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:57:05 gibba015 bash[30343]: audit 2021-03-10T16:57:05.034420+0000 mgr.gibba045.orlgmj (mgr.34412) 9936 : audit [DBG] from='client.60700 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:57:05.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:57:05 gibba015 bash[30343]: audit 2021-03-10T16:57:05.519872+0000 mon.a (mon.0) 2157 : audit [DBG] from='client.? 172.21.2.115:0/3994016931' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:57:06.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:57:05 gibba045 bash[25517]: audit 2021-03-10T16:57:05.034420+0000 mgr.gibba045.orlgmj (mgr.34412) 9936 : audit [DBG] from='client.60700 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:57:06.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:57:05 gibba045 bash[25517]: audit 2021-03-10T16:57:05.519872+0000 mon.a (mon.0) 2157 : audit [DBG] from='client.? 172.21.2.115:0/3994016931' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:57:06.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:57:06 gibba015 bash[30343]: cluster 2021-03-10T16:57:05.176495+0000 mgr.gibba045.orlgmj (mgr.34412) 9937 : cluster [DBG] pgmap v5657: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:06.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:57:06 gibba015 bash[30343]: audit 2021-03-10T16:57:05.260671+0000 mgr.gibba045.orlgmj (mgr.34412) 9938 : audit [DBG] from='client.50718 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:57:06.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:57:06 gibba015 bash[29377]: cluster 2021-03-10T16:57:05.176495+0000 mgr.gibba045.orlgmj (mgr.34412) 9937 : cluster [DBG] pgmap v5657: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:06.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:57:06 gibba015 bash[29377]: audit 2021-03-10T16:57:05.260671+0000 mgr.gibba045.orlgmj (mgr.34412) 9938 : audit [DBG] from='client.50718 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:57:07.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:57:06 gibba045 bash[25517]: cluster 2021-03-10T16:57:05.176495+0000 mgr.gibba045.orlgmj (mgr.34412) 9937 : cluster [DBG] pgmap v5657: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:07.054 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:57:06 gibba045 bash[25517]: audit 2021-03-10T16:57:05.260671+0000 mgr.gibba045.orlgmj (mgr.34412) 9938 : audit [DBG] from='client.50718 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:57:09.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:57:08 gibba045 bash[25517]: cluster 2021-03-10T16:57:07.178212+0000 mgr.gibba045.orlgmj (mgr.34412) 9939 : cluster [DBG] pgmap v5658: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:09.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:57:08 gibba015 bash[29377]: cluster 2021-03-10T16:57:07.178212+0000 mgr.gibba045.orlgmj (mgr.34412) 9939 : cluster [DBG] pgmap v5658: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:09.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:57:08 gibba015 bash[30343]: cluster 2021-03-10T16:57:07.178212+0000 mgr.gibba045.orlgmj (mgr.34412) 9939 : cluster [DBG] pgmap v5658: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:11.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:57:10 gibba045 bash[25517]: cluster 2021-03-10T16:57:09.179460+0000 mgr.gibba045.orlgmj (mgr.34412) 9940 : cluster [DBG] pgmap v5659: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:11.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:57:10 gibba015 bash[29377]: cluster 2021-03-10T16:57:09.179460+0000 mgr.gibba045.orlgmj (mgr.34412) 9940 : cluster [DBG] pgmap v5659: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:11.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:57:10 gibba015 bash[30343]: cluster 2021-03-10T16:57:09.179460+0000 mgr.gibba045.orlgmj (mgr.34412) 9940 : cluster [DBG] pgmap v5659: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:13.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:57:12 gibba045 bash[25517]: cluster 2021-03-10T16:57:11.181288+0000 mgr.gibba045.orlgmj (mgr.34412) 9941 : cluster [DBG] pgmap v5660: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:13.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:57:12 gibba015 bash[29377]: cluster 2021-03-10T16:57:11.181288+0000 mgr.gibba045.orlgmj (mgr.34412) 9941 : cluster [DBG] pgmap v5660: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:13.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:57:12 gibba015 bash[30343]: cluster 2021-03-10T16:57:11.181288+0000 mgr.gibba045.orlgmj (mgr.34412) 9941 : cluster [DBG] pgmap v5660: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:15.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:57:15 gibba045 bash[25517]: cluster 2021-03-10T16:57:13.182382+0000 mgr.gibba045.orlgmj (mgr.34412) 9942 : cluster [DBG] pgmap v5661: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:15.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:57:15 gibba015 bash[29377]: cluster 2021-03-10T16:57:13.182382+0000 mgr.gibba045.orlgmj (mgr.34412) 9942 : cluster [DBG] pgmap v5661: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:15.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:57:15 gibba015 bash[30343]: cluster 2021-03-10T16:57:13.182382+0000 mgr.gibba045.orlgmj (mgr.34412) 9942 : cluster [DBG] pgmap v5661: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:17.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:57:17 gibba045 bash[25517]: cluster 2021-03-10T16:57:15.183224+0000 mgr.gibba045.orlgmj (mgr.34412) 9943 : cluster [DBG] pgmap v5662: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:17.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:57:17 gibba015 bash[29377]: cluster 2021-03-10T16:57:15.183224+0000 mgr.gibba045.orlgmj (mgr.34412) 9943 : cluster [DBG] pgmap v5662: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:17.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:57:17 gibba015 bash[30343]: cluster 2021-03-10T16:57:15.183224+0000 mgr.gibba045.orlgmj (mgr.34412) 9943 : cluster [DBG] pgmap v5662: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:19.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:57:19 gibba045 bash[25517]: cluster 2021-03-10T16:57:17.184891+0000 mgr.gibba045.orlgmj (mgr.34412) 9944 : cluster [DBG] pgmap v5663: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:19.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:57:19 gibba015 bash[29377]: cluster 2021-03-10T16:57:17.184891+0000 mgr.gibba045.orlgmj (mgr.34412) 9944 : cluster [DBG] pgmap v5663: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:19.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:57:19 gibba015 bash[30343]: cluster 2021-03-10T16:57:17.184891+0000 mgr.gibba045.orlgmj (mgr.34412) 9944 : cluster [DBG] pgmap v5663: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:20.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:57:20 gibba045 bash[25517]: cephadm 2021-03-10T16:57:18.859484+0000 mgr.gibba045.orlgmj (mgr.34412) 9945 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:57:20.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:57:20 gibba015 bash[29377]: cephadm 2021-03-10T16:57:18.859484+0000 mgr.gibba045.orlgmj (mgr.34412) 9945 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:57:20.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:57:20 gibba015 bash[30343]: cephadm 2021-03-10T16:57:18.859484+0000 mgr.gibba045.orlgmj (mgr.34412) 9945 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:57:21.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:57:21 gibba045 bash[25517]: cluster 2021-03-10T16:57:19.186215+0000 mgr.gibba045.orlgmj (mgr.34412) 9946 : cluster [DBG] pgmap v5664: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:21.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:57:21 gibba015 bash[29377]: cluster 2021-03-10T16:57:19.186215+0000 mgr.gibba045.orlgmj (mgr.34412) 9946 : cluster [DBG] pgmap v5664: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:21.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:57:21 gibba015 bash[30343]: cluster 2021-03-10T16:57:19.186215+0000 mgr.gibba045.orlgmj (mgr.34412) 9946 : cluster [DBG] pgmap v5664: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:23.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:57:23 gibba045 bash[25517]: cluster 2021-03-10T16:57:21.187143+0000 mgr.gibba045.orlgmj (mgr.34412) 9947 : cluster [DBG] pgmap v5665: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:23.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:57:23 gibba015 bash[29377]: cluster 2021-03-10T16:57:21.187143+0000 mgr.gibba045.orlgmj (mgr.34412) 9947 : cluster [DBG] pgmap v5665: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:23.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:57:23 gibba015 bash[30343]: cluster 2021-03-10T16:57:21.187143+0000 mgr.gibba045.orlgmj (mgr.34412) 9947 : cluster [DBG] pgmap v5665: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:25.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:57:25 gibba045 bash[25517]: cluster 2021-03-10T16:57:23.188105+0000 mgr.gibba045.orlgmj (mgr.34412) 9948 : cluster [DBG] pgmap v5666: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:25.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:57:25 gibba015 bash[29377]: cluster 2021-03-10T16:57:23.188105+0000 mgr.gibba045.orlgmj (mgr.34412) 9948 : cluster [DBG] pgmap v5666: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:25.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:57:25 gibba015 bash[30343]: cluster 2021-03-10T16:57:23.188105+0000 mgr.gibba045.orlgmj (mgr.34412) 9948 : cluster [DBG] pgmap v5666: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:27.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:57:27 gibba015 bash[29377]: cluster 2021-03-10T16:57:25.189698+0000 mgr.gibba045.orlgmj (mgr.34412) 9949 : cluster [DBG] pgmap v5667: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:27.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:57:27 gibba015 bash[30343]: cluster 2021-03-10T16:57:25.189698+0000 mgr.gibba045.orlgmj (mgr.34412) 9949 : cluster [DBG] pgmap v5667: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:27.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:57:27 gibba045 bash[25517]: cluster 2021-03-10T16:57:25.189698+0000 mgr.gibba045.orlgmj (mgr.34412) 9949 : cluster [DBG] pgmap v5667: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:29.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:57:29 gibba015 bash[29377]: cluster 2021-03-10T16:57:27.190564+0000 mgr.gibba045.orlgmj (mgr.34412) 9950 : cluster [DBG] pgmap v5668: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:29.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:57:29 gibba015 bash[30343]: cluster 2021-03-10T16:57:27.190564+0000 mgr.gibba045.orlgmj (mgr.34412) 9950 : cluster [DBG] pgmap v5668: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:29.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:57:29 gibba045 bash[25517]: cluster 2021-03-10T16:57:27.190564+0000 mgr.gibba045.orlgmj (mgr.34412) 9950 : cluster [DBG] pgmap v5668: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:31.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:57:31 gibba015 bash[29377]: cluster 2021-03-10T16:57:29.191678+0000 mgr.gibba045.orlgmj (mgr.34412) 9951 : cluster [DBG] pgmap v5669: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:31.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:57:31 gibba015 bash[30343]: cluster 2021-03-10T16:57:29.191678+0000 mgr.gibba045.orlgmj (mgr.34412) 9951 : cluster [DBG] pgmap v5669: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:31.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:57:31 gibba045 bash[25517]: cluster 2021-03-10T16:57:29.191678+0000 mgr.gibba045.orlgmj (mgr.34412) 9951 : cluster [DBG] pgmap v5669: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:33.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:57:33 gibba015 bash[29377]: cluster 2021-03-10T16:57:31.193258+0000 mgr.gibba045.orlgmj (mgr.34412) 9952 : cluster [DBG] pgmap v5670: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:33.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:57:33 gibba015 bash[30343]: cluster 2021-03-10T16:57:31.193258+0000 mgr.gibba045.orlgmj (mgr.34412) 9952 : cluster [DBG] pgmap v5670: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:33.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:57:33 gibba045 bash[25517]: cluster 2021-03-10T16:57:31.193258+0000 mgr.gibba045.orlgmj (mgr.34412) 9952 : cluster [DBG] pgmap v5670: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:35.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:57:35 gibba015 bash[29377]: cluster 2021-03-10T16:57:33.194495+0000 mgr.gibba045.orlgmj (mgr.34412) 9953 : cluster [DBG] pgmap v5671: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:35.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:57:35 gibba015 bash[29377]: cephadm 2021-03-10T16:57:33.875301+0000 mgr.gibba045.orlgmj (mgr.34412) 9954 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:57:35.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:57:35 gibba015 bash[30343]: cluster 2021-03-10T16:57:33.194495+0000 mgr.gibba045.orlgmj (mgr.34412) 9953 : cluster [DBG] pgmap v5671: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:35.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:57:35 gibba015 bash[30343]: cephadm 2021-03-10T16:57:33.875301+0000 mgr.gibba045.orlgmj (mgr.34412) 9954 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:57:35.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:57:35 gibba045 bash[25517]: cluster 2021-03-10T16:57:33.194495+0000 mgr.gibba045.orlgmj (mgr.34412) 9953 : cluster [DBG] pgmap v5671: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:35.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:57:35 gibba045 bash[25517]: cephadm 2021-03-10T16:57:33.875301+0000 mgr.gibba045.orlgmj (mgr.34412) 9954 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:57:35.762 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:57:35.990 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:57:35.990 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 32s ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:57:35.991 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 9m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:57:35.991 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:57:35.991 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:57:35.992 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 32s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:57:35.992 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 32s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:57:35.992 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:57:35.993 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 32s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:57:35.993 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 32s ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:57:35.993 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 9m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:57:35.993 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 32s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:57:35.993 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 32s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:57:35.994 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 32s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:57:35.994 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 32s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:57:35.994 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:57:35.994 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:57:35.995 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:57:35.995 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:57:35.995 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 9m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:57:35.995 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 9m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:57:36.243 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:57:36.244 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:57:36.244 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:57:36.245 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:57:36.245 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:57:36.246 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:57:36.246 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:57:36.246 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:57:36.247 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:57:36.247 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:57:36.247 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:57:36.248 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:57:36.248 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:57:36.248 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:57:36.248 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:57:37.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:57:37 gibba015 bash[29377]: cluster 2021-03-10T16:57:35.196065+0000 mgr.gibba045.orlgmj (mgr.34412) 9955 : cluster [DBG] pgmap v5672: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:37.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:57:37 gibba015 bash[29377]: audit 2021-03-10T16:57:35.755545+0000 mgr.gibba045.orlgmj (mgr.34412) 9956 : audit [DBG] from='client.60718 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:57:37.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:57:37 gibba015 bash[29377]: audit 2021-03-10T16:57:35.979769+0000 mgr.gibba045.orlgmj (mgr.34412) 9957 : audit [DBG] from='client.60724 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:57:37.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:57:37 gibba015 bash[29377]: audit 2021-03-10T16:57:36.242874+0000 mon.a (mon.0) 2158 : audit [DBG] from='client.? 172.21.2.115:0/2097980537' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:57:37.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:57:37 gibba015 bash[30343]: cluster 2021-03-10T16:57:35.196065+0000 mgr.gibba045.orlgmj (mgr.34412) 9955 : cluster [DBG] pgmap v5672: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:37.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:57:37 gibba015 bash[30343]: audit 2021-03-10T16:57:35.755545+0000 mgr.gibba045.orlgmj (mgr.34412) 9956 : audit [DBG] from='client.60718 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:57:37.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:57:37 gibba015 bash[30343]: audit 2021-03-10T16:57:35.979769+0000 mgr.gibba045.orlgmj (mgr.34412) 9957 : audit [DBG] from='client.60724 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:57:37.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:57:37 gibba015 bash[30343]: audit 2021-03-10T16:57:36.242874+0000 mon.a (mon.0) 2158 : audit [DBG] from='client.? 172.21.2.115:0/2097980537' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:57:37.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:57:37 gibba045 bash[25517]: cluster 2021-03-10T16:57:35.196065+0000 mgr.gibba045.orlgmj (mgr.34412) 9955 : cluster [DBG] pgmap v5672: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:37.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:57:37 gibba045 bash[25517]: audit 2021-03-10T16:57:35.755545+0000 mgr.gibba045.orlgmj (mgr.34412) 9956 : audit [DBG] from='client.60718 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:57:37.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:57:37 gibba045 bash[25517]: audit 2021-03-10T16:57:35.979769+0000 mgr.gibba045.orlgmj (mgr.34412) 9957 : audit [DBG] from='client.60724 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:57:37.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:57:37 gibba045 bash[25517]: audit 2021-03-10T16:57:36.242874+0000 mon.a (mon.0) 2158 : audit [DBG] from='client.? 172.21.2.115:0/2097980537' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:57:39.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:57:39 gibba015 bash[29377]: cluster 2021-03-10T16:57:37.197520+0000 mgr.gibba045.orlgmj (mgr.34412) 9958 : cluster [DBG] pgmap v5673: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:39.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:57:39 gibba015 bash[30343]: cluster 2021-03-10T16:57:37.197520+0000 mgr.gibba045.orlgmj (mgr.34412) 9958 : cluster [DBG] pgmap v5673: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:39.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:57:39 gibba045 bash[25517]: cluster 2021-03-10T16:57:37.197520+0000 mgr.gibba045.orlgmj (mgr.34412) 9958 : cluster [DBG] pgmap v5673: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:41.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:57:41 gibba015 bash[29377]: cluster 2021-03-10T16:57:39.199024+0000 mgr.gibba045.orlgmj (mgr.34412) 9959 : cluster [DBG] pgmap v5674: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:41.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:57:41 gibba015 bash[30343]: cluster 2021-03-10T16:57:39.199024+0000 mgr.gibba045.orlgmj (mgr.34412) 9959 : cluster [DBG] pgmap v5674: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:41.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:57:41 gibba045 bash[25517]: cluster 2021-03-10T16:57:39.199024+0000 mgr.gibba045.orlgmj (mgr.34412) 9959 : cluster [DBG] pgmap v5674: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:43.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:57:43 gibba015 bash[29377]: cluster 2021-03-10T16:57:41.200775+0000 mgr.gibba045.orlgmj (mgr.34412) 9960 : cluster [DBG] pgmap v5675: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:43.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:57:43 gibba015 bash[30343]: cluster 2021-03-10T16:57:41.200775+0000 mgr.gibba045.orlgmj (mgr.34412) 9960 : cluster [DBG] pgmap v5675: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:43.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:57:43 gibba045 bash[25517]: cluster 2021-03-10T16:57:41.200775+0000 mgr.gibba045.orlgmj (mgr.34412) 9960 : cluster [DBG] pgmap v5675: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:45.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:57:45 gibba015 bash[29377]: cluster 2021-03-10T16:57:43.202265+0000 mgr.gibba045.orlgmj (mgr.34412) 9961 : cluster [DBG] pgmap v5676: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:45.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:57:45 gibba015 bash[30343]: cluster 2021-03-10T16:57:43.202265+0000 mgr.gibba045.orlgmj (mgr.34412) 9961 : cluster [DBG] pgmap v5676: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:45.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:57:45 gibba045 bash[25517]: cluster 2021-03-10T16:57:43.202265+0000 mgr.gibba045.orlgmj (mgr.34412) 9961 : cluster [DBG] pgmap v5676: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:47.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:57:47 gibba015 bash[29377]: cluster 2021-03-10T16:57:45.203266+0000 mgr.gibba045.orlgmj (mgr.34412) 9962 : cluster [DBG] pgmap v5677: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:47.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:57:47 gibba015 bash[30343]: cluster 2021-03-10T16:57:45.203266+0000 mgr.gibba045.orlgmj (mgr.34412) 9962 : cluster [DBG] pgmap v5677: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:47.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:57:47 gibba045 bash[25517]: cluster 2021-03-10T16:57:45.203266+0000 mgr.gibba045.orlgmj (mgr.34412) 9962 : cluster [DBG] pgmap v5677: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:49.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:57:49 gibba015 bash[29377]: cluster 2021-03-10T16:57:47.204087+0000 mgr.gibba045.orlgmj (mgr.34412) 9963 : cluster [DBG] pgmap v5678: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:49.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:57:49 gibba015 bash[30343]: cluster 2021-03-10T16:57:47.204087+0000 mgr.gibba045.orlgmj (mgr.34412) 9963 : cluster [DBG] pgmap v5678: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:49.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:57:49 gibba045 bash[25517]: cluster 2021-03-10T16:57:47.204087+0000 mgr.gibba045.orlgmj (mgr.34412) 9963 : cluster [DBG] pgmap v5678: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:50.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:57:50 gibba015 bash[29377]: cephadm 2021-03-10T16:57:48.889270+0000 mgr.gibba045.orlgmj (mgr.34412) 9964 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:57:50.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:57:50 gibba015 bash[30343]: cephadm 2021-03-10T16:57:48.889270+0000 mgr.gibba045.orlgmj (mgr.34412) 9964 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:57:50.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:57:50 gibba045 bash[25517]: cephadm 2021-03-10T16:57:48.889270+0000 mgr.gibba045.orlgmj (mgr.34412) 9964 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:57:51.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:57:51 gibba015 bash[29377]: cluster 2021-03-10T16:57:49.205192+0000 mgr.gibba045.orlgmj (mgr.34412) 9965 : cluster [DBG] pgmap v5679: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:51.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:57:51 gibba015 bash[30343]: cluster 2021-03-10T16:57:49.205192+0000 mgr.gibba045.orlgmj (mgr.34412) 9965 : cluster [DBG] pgmap v5679: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:51.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:57:51 gibba045 bash[25517]: cluster 2021-03-10T16:57:49.205192+0000 mgr.gibba045.orlgmj (mgr.34412) 9965 : cluster [DBG] pgmap v5679: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:53.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:57:53 gibba045 bash[25517]: cluster 2021-03-10T16:57:51.206677+0000 mgr.gibba045.orlgmj (mgr.34412) 9966 : cluster [DBG] pgmap v5680: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:53.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:57:52 gibba015 bash[29377]: cluster 2021-03-10T16:57:51.206677+0000 mgr.gibba045.orlgmj (mgr.34412) 9966 : cluster [DBG] pgmap v5680: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:53.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:57:52 gibba015 bash[30343]: cluster 2021-03-10T16:57:51.206677+0000 mgr.gibba045.orlgmj (mgr.34412) 9966 : cluster [DBG] pgmap v5680: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:54.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:57:54 gibba045 bash[25517]: audit 2021-03-10T16:57:53.802887+0000 mon.c (mon.1) 2735 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:57:54.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:57:54 gibba045 bash[25517]: audit 2021-03-10T16:57:53.803495+0000 mon.c (mon.1) 2736 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:57:54.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:57:54 gibba045 bash[25517]: audit 2021-03-10T16:57:53.804103+0000 mon.a (mon.0) 2159 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:57:54.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:57:54 gibba045 bash[25517]: audit 2021-03-10T16:57:53.805487+0000 mon.a (mon.0) 2160 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:57:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:57:54 gibba045 bash[25517]: audit 2021-03-10T16:57:53.833032+0000 mon.c (mon.1) 2737 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T16:57:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:57:54 gibba045 bash[25517]: audit 2021-03-10T16:57:53.833900+0000 mon.c (mon.1) 2738 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:57:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:57:54 gibba045 bash[25517]: audit 2021-03-10T16:57:53.834432+0000 mon.a (mon.0) 2161 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T16:57:54.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:57:54 gibba045 bash[25517]: audit 2021-03-10T16:57:53.835098+0000 mon.c (mon.1) 2739 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:57:54.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:57:54 gibba045 bash[25517]: audit 2021-03-10T16:57:53.836494+0000 mon.c (mon.1) 2740 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:57:54.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:57:54 gibba045 bash[25517]: audit 2021-03-10T16:57:53.836517+0000 mon.a (mon.0) 2162 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:57:54.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:57:54 gibba045 bash[25517]: audit 2021-03-10T16:57:53.837803+0000 mon.a (mon.0) 2163 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:57:54.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:57:54 gibba045 bash[25517]: audit 2021-03-10T16:57:53.838026+0000 mon.a (mon.0) 2164 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:57:54.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:57:54 gibba015 bash[29377]: audit 2021-03-10T16:57:53.802887+0000 mon.c (mon.1) 2735 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:57:54.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:57:54 gibba015 bash[29377]: audit 2021-03-10T16:57:53.803495+0000 mon.c (mon.1) 2736 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:57:54.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:57:54 gibba015 bash[29377]: audit 2021-03-10T16:57:53.804103+0000 mon.a (mon.0) 2159 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:57:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:57:54 gibba015 bash[29377]: audit 2021-03-10T16:57:53.805487+0000 mon.a (mon.0) 2160 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:57:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:57:54 gibba015 bash[29377]: audit 2021-03-10T16:57:53.833032+0000 mon.c (mon.1) 2737 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T16:57:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:57:54 gibba015 bash[29377]: audit 2021-03-10T16:57:53.833900+0000 mon.c (mon.1) 2738 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:57:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:57:54 gibba015 bash[29377]: audit 2021-03-10T16:57:53.834432+0000 mon.a (mon.0) 2161 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T16:57:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:57:54 gibba015 bash[29377]: audit 2021-03-10T16:57:53.835098+0000 mon.c (mon.1) 2739 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:57:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:57:54 gibba015 bash[29377]: audit 2021-03-10T16:57:53.836494+0000 mon.c (mon.1) 2740 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:57:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:57:54 gibba015 bash[29377]: audit 2021-03-10T16:57:53.836517+0000 mon.a (mon.0) 2162 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:57:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:57:54 gibba015 bash[29377]: audit 2021-03-10T16:57:53.837803+0000 mon.a (mon.0) 2163 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:57:54.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:57:54 gibba015 bash[29377]: audit 2021-03-10T16:57:53.838026+0000 mon.a (mon.0) 2164 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:57:54.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:57:54 gibba015 bash[30343]: audit 2021-03-10T16:57:53.802887+0000 mon.c (mon.1) 2735 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:57:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:57:54 gibba015 bash[30343]: audit 2021-03-10T16:57:53.803495+0000 mon.c (mon.1) 2736 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:57:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:57:54 gibba015 bash[30343]: audit 2021-03-10T16:57:53.804103+0000 mon.a (mon.0) 2159 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:57:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:57:54 gibba015 bash[30343]: audit 2021-03-10T16:57:53.805487+0000 mon.a (mon.0) 2160 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:57:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:57:54 gibba015 bash[30343]: audit 2021-03-10T16:57:53.833032+0000 mon.c (mon.1) 2737 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T16:57:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:57:54 gibba015 bash[30343]: audit 2021-03-10T16:57:53.833900+0000 mon.c (mon.1) 2738 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:57:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:57:54 gibba015 bash[30343]: audit 2021-03-10T16:57:53.834432+0000 mon.a (mon.0) 2161 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T16:57:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:57:54 gibba015 bash[30343]: audit 2021-03-10T16:57:53.835098+0000 mon.c (mon.1) 2739 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:57:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:57:54 gibba015 bash[30343]: audit 2021-03-10T16:57:53.836494+0000 mon.c (mon.1) 2740 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:57:54.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:57:54 gibba015 bash[30343]: audit 2021-03-10T16:57:53.836517+0000 mon.a (mon.0) 2162 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:57:54.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:57:54 gibba015 bash[30343]: audit 2021-03-10T16:57:53.837803+0000 mon.a (mon.0) 2163 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:57:54.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:57:54 gibba015 bash[30343]: audit 2021-03-10T16:57:53.838026+0000 mon.a (mon.0) 2164 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:57:55.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:57:55 gibba045 bash[25517]: cluster 2021-03-10T16:57:53.208159+0000 mgr.gibba045.orlgmj (mgr.34412) 9967 : cluster [DBG] pgmap v5681: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:55.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:57:55 gibba015 bash[29377]: cluster 2021-03-10T16:57:53.208159+0000 mgr.gibba045.orlgmj (mgr.34412) 9967 : cluster [DBG] pgmap v5681: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:55.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:57:55 gibba015 bash[30343]: cluster 2021-03-10T16:57:53.208159+0000 mgr.gibba045.orlgmj (mgr.34412) 9967 : cluster [DBG] pgmap v5681: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:57.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:57:57 gibba045 bash[25517]: cluster 2021-03-10T16:57:55.209742+0000 mgr.gibba045.orlgmj (mgr.34412) 9968 : cluster [DBG] pgmap v5682: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:57.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:57:57 gibba015 bash[29377]: cluster 2021-03-10T16:57:55.209742+0000 mgr.gibba045.orlgmj (mgr.34412) 9968 : cluster [DBG] pgmap v5682: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:57.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:57:57 gibba015 bash[30343]: cluster 2021-03-10T16:57:55.209742+0000 mgr.gibba045.orlgmj (mgr.34412) 9968 : cluster [DBG] pgmap v5682: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:59.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:57:59 gibba045 bash[25517]: cluster 2021-03-10T16:57:57.210829+0000 mgr.gibba045.orlgmj (mgr.34412) 9969 : cluster [DBG] pgmap v5683: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:59.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:57:59 gibba015 bash[29377]: cluster 2021-03-10T16:57:57.210829+0000 mgr.gibba045.orlgmj (mgr.34412) 9969 : cluster [DBG] pgmap v5683: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:59.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:57:59 gibba015 bash[30343]: cluster 2021-03-10T16:57:57.210829+0000 mgr.gibba045.orlgmj (mgr.34412) 9969 : cluster [DBG] pgmap v5683: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:01.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:58:01 gibba045 bash[25517]: cluster 2021-03-10T16:57:59.211908+0000 mgr.gibba045.orlgmj (mgr.34412) 9970 : cluster [DBG] pgmap v5684: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:01.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:58:01 gibba015 bash[29377]: cluster 2021-03-10T16:57:59.211908+0000 mgr.gibba045.orlgmj (mgr.34412) 9970 : cluster [DBG] pgmap v5684: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:01.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:58:01 gibba015 bash[30343]: cluster 2021-03-10T16:57:59.211908+0000 mgr.gibba045.orlgmj (mgr.34412) 9970 : cluster [DBG] pgmap v5684: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:03.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:58:03 gibba045 bash[25517]: cluster 2021-03-10T16:58:01.213652+0000 mgr.gibba045.orlgmj (mgr.34412) 9971 : cluster [DBG] pgmap v5685: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:03.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:58:03 gibba015 bash[29377]: cluster 2021-03-10T16:58:01.213652+0000 mgr.gibba045.orlgmj (mgr.34412) 9971 : cluster [DBG] pgmap v5685: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:03.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:58:03 gibba015 bash[30343]: cluster 2021-03-10T16:58:01.213652+0000 mgr.gibba045.orlgmj (mgr.34412) 9971 : cluster [DBG] pgmap v5685: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:04.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:58:04 gibba045 bash[25517]: audit 2021-03-10T16:58:03.903856+0000 mon.c (mon.1) 2741 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:58:04.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:58:04 gibba045 bash[25517]: audit 2021-03-10T16:58:03.910511+0000 mon.c (mon.1) 2742 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:58:04.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:58:04 gibba015 bash[29377]: audit 2021-03-10T16:58:03.903856+0000 mon.c (mon.1) 2741 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:58:04.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:58:04 gibba015 bash[29377]: audit 2021-03-10T16:58:03.910511+0000 mon.c (mon.1) 2742 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:58:04.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:58:04 gibba015 bash[30343]: audit 2021-03-10T16:58:03.903856+0000 mon.c (mon.1) 2741 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:58:04.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:58:04 gibba015 bash[30343]: audit 2021-03-10T16:58:03.910511+0000 mon.c (mon.1) 2742 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:58:05.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:58:05 gibba015 bash[29377]: cluster 2021-03-10T16:58:03.215020+0000 mgr.gibba045.orlgmj (mgr.34412) 9972 : cluster [DBG] pgmap v5686: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:05.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:58:05 gibba015 bash[29377]: cephadm 2021-03-10T16:58:03.910848+0000 mgr.gibba045.orlgmj (mgr.34412) 9973 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:58:05.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:58:05 gibba015 bash[30343]: cluster 2021-03-10T16:58:03.215020+0000 mgr.gibba045.orlgmj (mgr.34412) 9972 : cluster [DBG] pgmap v5686: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:05.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:58:05 gibba015 bash[30343]: cephadm 2021-03-10T16:58:03.910848+0000 mgr.gibba045.orlgmj (mgr.34412) 9973 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:58:05.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:58:05 gibba045 bash[25517]: cluster 2021-03-10T16:58:03.215020+0000 mgr.gibba045.orlgmj (mgr.34412) 9972 : cluster [DBG] pgmap v5686: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:05.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:58:05 gibba045 bash[25517]: cephadm 2021-03-10T16:58:03.910848+0000 mgr.gibba045.orlgmj (mgr.34412) 9973 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:58:06.485 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:58:06.706 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:58:06.707 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 63s ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:58:06.707 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 10m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:58:06.707 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 10m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:58:06.707 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 10m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:58:06.708 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 63s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:58:06.708 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 63s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:58:06.708 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 10m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:58:06.708 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 63s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:58:06.708 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 63s ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:58:06.709 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 10m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:58:06.709 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 63s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:58:06.709 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 63s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:58:06.709 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 63s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:58:06.710 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 63s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:58:06.710 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 10m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:58:06.710 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 10m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:58:06.710 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 10m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:58:06.711 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 10m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:58:06.711 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 10m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:58:06.711 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 10m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:58:06.955 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:58:06.955 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:58:06.956 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:58:06.956 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:58:06.956 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:58:06.956 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:58:06.957 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:58:06.957 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:58:06.957 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:58:06.957 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:58:06.957 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:58:06.958 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:58:06.958 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:58:06.958 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:58:06.958 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:58:07.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:58:07 gibba015 bash[29377]: cluster 2021-03-10T16:58:05.216556+0000 mgr.gibba045.orlgmj (mgr.34412) 9974 : cluster [DBG] pgmap v5687: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:07.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:58:07 gibba015 bash[29377]: audit 2021-03-10T16:58:06.955040+0000 mon.a (mon.0) 2165 : audit [DBG] from='client.? 172.21.2.115:0/2094697069' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:58:07.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:58:07 gibba015 bash[30343]: cluster 2021-03-10T16:58:05.216556+0000 mgr.gibba045.orlgmj (mgr.34412) 9974 : cluster [DBG] pgmap v5687: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:07.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:58:07 gibba015 bash[30343]: audit 2021-03-10T16:58:06.955040+0000 mon.a (mon.0) 2165 : audit [DBG] from='client.? 172.21.2.115:0/2094697069' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:58:07.553 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:58:07 gibba045 bash[25517]: cluster 2021-03-10T16:58:05.216556+0000 mgr.gibba045.orlgmj (mgr.34412) 9974 : cluster [DBG] pgmap v5687: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:07.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:58:07 gibba045 bash[25517]: audit 2021-03-10T16:58:06.955040+0000 mon.a (mon.0) 2165 : audit [DBG] from='client.? 172.21.2.115:0/2094697069' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:58:08.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:58:08 gibba015 bash[29377]: audit 2021-03-10T16:58:06.478740+0000 mgr.gibba045.orlgmj (mgr.34412) 9975 : audit [DBG] from='client.60736 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:58:08.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:58:08 gibba015 bash[29377]: audit 2021-03-10T16:58:06.699904+0000 mgr.gibba045.orlgmj (mgr.34412) 9976 : audit [DBG] from='client.50754 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:58:08.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:58:08 gibba015 bash[29377]: audit 2021-03-10T16:58:07.582814+0000 mon.a (mon.0) 2166 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:58:08.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:58:08 gibba015 bash[29377]: audit 2021-03-10T16:58:07.803724+0000 mon.a (mon.0) 2167 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:58:08.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:58:08 gibba015 bash[29377]: audit 2021-03-10T16:58:07.807485+0000 mon.c (mon.1) 2743 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:58:08.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:58:08 gibba015 bash[29377]: audit 2021-03-10T16:58:07.809125+0000 mon.c (mon.1) 2744 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:58:08.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:58:08 gibba015 bash[29377]: audit 2021-03-10T16:58:07.810630+0000 mon.c (mon.1) 2745 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:58:08.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:58:08 gibba015 bash[29377]: audit 2021-03-10T16:58:07.812140+0000 mon.c (mon.1) 2746 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:58:08.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:58:08 gibba015 bash[29377]: audit 2021-03-10T16:58:07.815574+0000 mon.c (mon.1) 2747 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:58:08.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:58:08 gibba015 bash[29377]: audit 2021-03-10T16:58:07.817319+0000 mon.c (mon.1) 2748 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:58:08.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:58:08 gibba015 bash[30343]: audit 2021-03-10T16:58:06.478740+0000 mgr.gibba045.orlgmj (mgr.34412) 9975 : audit [DBG] from='client.60736 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:58:08.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:58:08 gibba015 bash[30343]: audit 2021-03-10T16:58:06.699904+0000 mgr.gibba045.orlgmj (mgr.34412) 9976 : audit [DBG] from='client.50754 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:58:08.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:58:08 gibba015 bash[30343]: audit 2021-03-10T16:58:07.582814+0000 mon.a (mon.0) 2166 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:58:08.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:58:08 gibba015 bash[30343]: audit 2021-03-10T16:58:07.803724+0000 mon.a (mon.0) 2167 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:58:08.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:58:08 gibba015 bash[30343]: audit 2021-03-10T16:58:07.807485+0000 mon.c (mon.1) 2743 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:58:08.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:58:08 gibba015 bash[30343]: audit 2021-03-10T16:58:07.809125+0000 mon.c (mon.1) 2744 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:58:08.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:58:08 gibba015 bash[30343]: audit 2021-03-10T16:58:07.810630+0000 mon.c (mon.1) 2745 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:58:08.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:58:08 gibba015 bash[30343]: audit 2021-03-10T16:58:07.812140+0000 mon.c (mon.1) 2746 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:58:08.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:58:08 gibba015 bash[30343]: audit 2021-03-10T16:58:07.815574+0000 mon.c (mon.1) 2747 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:58:08.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:58:08 gibba015 bash[30343]: audit 2021-03-10T16:58:07.817319+0000 mon.c (mon.1) 2748 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:58:08.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:58:08 gibba045 bash[25517]: audit 2021-03-10T16:58:06.478740+0000 mgr.gibba045.orlgmj (mgr.34412) 9975 : audit [DBG] from='client.60736 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:58:08.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:58:08 gibba045 bash[25517]: audit 2021-03-10T16:58:06.699904+0000 mgr.gibba045.orlgmj (mgr.34412) 9976 : audit [DBG] from='client.50754 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:58:08.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:58:08 gibba045 bash[25517]: audit 2021-03-10T16:58:07.582814+0000 mon.a (mon.0) 2166 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:58:08.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:58:08 gibba045 bash[25517]: audit 2021-03-10T16:58:07.803724+0000 mon.a (mon.0) 2167 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:58:08.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:58:08 gibba045 bash[25517]: audit 2021-03-10T16:58:07.807485+0000 mon.c (mon.1) 2743 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:58:08.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:58:08 gibba045 bash[25517]: audit 2021-03-10T16:58:07.809125+0000 mon.c (mon.1) 2744 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:58:08.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:58:08 gibba045 bash[25517]: audit 2021-03-10T16:58:07.810630+0000 mon.c (mon.1) 2745 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:58:08.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:58:08 gibba045 bash[25517]: audit 2021-03-10T16:58:07.812140+0000 mon.c (mon.1) 2746 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:58:08.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:58:08 gibba045 bash[25517]: audit 2021-03-10T16:58:07.815574+0000 mon.c (mon.1) 2747 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:58:08.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:58:08 gibba045 bash[25517]: audit 2021-03-10T16:58:07.817319+0000 mon.c (mon.1) 2748 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:58:09.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:58:09 gibba015 bash[29377]: cluster 2021-03-10T16:58:07.217077+0000 mgr.gibba045.orlgmj (mgr.34412) 9977 : cluster [DBG] pgmap v5688: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:09.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:58:09 gibba015 bash[29377]: cephadm 2021-03-10T16:58:07.588468+0000 mgr.gibba045.orlgmj (mgr.34412) 9978 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:58:09.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:58:09 gibba015 bash[29377]: cephadm 2021-03-10T16:58:07.808877+0000 mgr.gibba045.orlgmj (mgr.34412) 9979 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:58:09.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:58:09 gibba015 bash[29377]: cephadm 2021-03-10T16:58:07.810587+0000 mgr.gibba045.orlgmj (mgr.34412) 9980 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:58:09.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:58:09 gibba015 bash[29377]: cephadm 2021-03-10T16:58:07.812095+0000 mgr.gibba045.orlgmj (mgr.34412) 9981 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:58:09.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:58:09 gibba015 bash[29377]: cephadm 2021-03-10T16:58:07.812134+0000 mgr.gibba045.orlgmj (mgr.34412) 9982 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:58:09.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:58:09 gibba015 bash[29377]: cephadm 2021-03-10T16:58:07.813837+0000 mgr.gibba045.orlgmj (mgr.34412) 9983 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:58:09.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:58:09 gibba015 bash[29377]: cephadm 2021-03-10T16:58:07.813877+0000 mgr.gibba045.orlgmj (mgr.34412) 9984 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:58:09.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:58:09 gibba015 bash[29377]: cephadm 2021-03-10T16:58:07.815335+0000 mgr.gibba045.orlgmj (mgr.34412) 9985 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:58:09.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:58:09 gibba015 bash[29377]: cephadm 2021-03-10T16:58:07.817130+0000 mgr.gibba045.orlgmj (mgr.34412) 9986 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:58:09.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:58:09 gibba015 bash[29377]: cephadm 2021-03-10T16:58:07.817168+0000 mgr.gibba045.orlgmj (mgr.34412) 9987 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:58:09.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:58:09 gibba015 bash[29377]: cephadm 2021-03-10T16:58:07.818751+0000 mgr.gibba045.orlgmj (mgr.34412) 9988 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:58:09.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:58:09 gibba015 bash[29377]: cephadm 2021-03-10T16:58:07.819063+0000 mgr.gibba045.orlgmj (mgr.34412) 9989 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:58:09.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:58:09 gibba015 bash[29377]: cephadm 2021-03-10T16:58:07.820486+0000 mgr.gibba045.orlgmj (mgr.34412) 9990 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:58:09.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:58:09 gibba015 bash[29377]: cephadm 2021-03-10T16:58:07.820547+0000 mgr.gibba045.orlgmj (mgr.34412) 9991 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:58:09.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:58:09 gibba015 bash[29377]: cephadm 2021-03-10T16:58:07.820655+0000 mgr.gibba045.orlgmj (mgr.34412) 9992 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:58:09.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:58:09 gibba015 bash[30343]: cluster 2021-03-10T16:58:07.217077+0000 mgr.gibba045.orlgmj (mgr.34412) 9977 : cluster [DBG] pgmap v5688: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:09.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:58:09 gibba015 bash[30343]: cephadm 2021-03-10T16:58:07.588468+0000 mgr.gibba045.orlgmj (mgr.34412) 9978 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:58:09.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:58:09 gibba015 bash[30343]: cephadm 2021-03-10T16:58:07.808877+0000 mgr.gibba045.orlgmj (mgr.34412) 9979 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:58:09.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:58:09 gibba015 bash[30343]: cephadm 2021-03-10T16:58:07.810587+0000 mgr.gibba045.orlgmj (mgr.34412) 9980 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:58:09.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:58:09 gibba015 bash[30343]: cephadm 2021-03-10T16:58:07.812095+0000 mgr.gibba045.orlgmj (mgr.34412) 9981 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:58:09.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:58:09 gibba015 bash[30343]: cephadm 2021-03-10T16:58:07.812134+0000 mgr.gibba045.orlgmj (mgr.34412) 9982 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:58:09.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:58:09 gibba015 bash[30343]: cephadm 2021-03-10T16:58:07.813837+0000 mgr.gibba045.orlgmj (mgr.34412) 9983 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:58:09.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:58:09 gibba015 bash[30343]: cephadm 2021-03-10T16:58:07.813877+0000 mgr.gibba045.orlgmj (mgr.34412) 9984 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:58:09.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:58:09 gibba015 bash[30343]: cephadm 2021-03-10T16:58:07.815335+0000 mgr.gibba045.orlgmj (mgr.34412) 9985 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:58:09.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:58:09 gibba015 bash[30343]: cephadm 2021-03-10T16:58:07.817130+0000 mgr.gibba045.orlgmj (mgr.34412) 9986 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:58:09.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:58:09 gibba015 bash[30343]: cephadm 2021-03-10T16:58:07.817168+0000 mgr.gibba045.orlgmj (mgr.34412) 9987 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:58:09.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:58:09 gibba015 bash[30343]: cephadm 2021-03-10T16:58:07.818751+0000 mgr.gibba045.orlgmj (mgr.34412) 9988 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:58:09.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:58:09 gibba015 bash[30343]: cephadm 2021-03-10T16:58:07.819063+0000 mgr.gibba045.orlgmj (mgr.34412) 9989 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:58:09.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:58:09 gibba015 bash[30343]: cephadm 2021-03-10T16:58:07.820486+0000 mgr.gibba045.orlgmj (mgr.34412) 9990 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:58:09.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:58:09 gibba015 bash[30343]: cephadm 2021-03-10T16:58:07.820547+0000 mgr.gibba045.orlgmj (mgr.34412) 9991 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:58:09.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:58:09 gibba015 bash[30343]: cephadm 2021-03-10T16:58:07.820655+0000 mgr.gibba045.orlgmj (mgr.34412) 9992 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:58:09.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:58:09 gibba045 bash[25517]: cluster 2021-03-10T16:58:07.217077+0000 mgr.gibba045.orlgmj (mgr.34412) 9977 : cluster [DBG] pgmap v5688: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:09.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:58:09 gibba045 bash[25517]: cephadm 2021-03-10T16:58:07.588468+0000 mgr.gibba045.orlgmj (mgr.34412) 9978 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:58:09.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:58:09 gibba045 bash[25517]: cephadm 2021-03-10T16:58:07.808877+0000 mgr.gibba045.orlgmj (mgr.34412) 9979 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:58:09.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:58:09 gibba045 bash[25517]: cephadm 2021-03-10T16:58:07.810587+0000 mgr.gibba045.orlgmj (mgr.34412) 9980 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:58:09.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:58:09 gibba045 bash[25517]: cephadm 2021-03-10T16:58:07.812095+0000 mgr.gibba045.orlgmj (mgr.34412) 9981 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:58:09.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:58:09 gibba045 bash[25517]: cephadm 2021-03-10T16:58:07.812134+0000 mgr.gibba045.orlgmj (mgr.34412) 9982 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:58:09.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:58:09 gibba045 bash[25517]: cephadm 2021-03-10T16:58:07.813837+0000 mgr.gibba045.orlgmj (mgr.34412) 9983 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:58:09.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:58:09 gibba045 bash[25517]: cephadm 2021-03-10T16:58:07.813877+0000 mgr.gibba045.orlgmj (mgr.34412) 9984 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:58:09.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:58:09 gibba045 bash[25517]: cephadm 2021-03-10T16:58:07.815335+0000 mgr.gibba045.orlgmj (mgr.34412) 9985 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:58:09.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:58:09 gibba045 bash[25517]: cephadm 2021-03-10T16:58:07.817130+0000 mgr.gibba045.orlgmj (mgr.34412) 9986 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:58:09.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:58:09 gibba045 bash[25517]: cephadm 2021-03-10T16:58:07.817168+0000 mgr.gibba045.orlgmj (mgr.34412) 9987 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:58:09.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:58:09 gibba045 bash[25517]: cephadm 2021-03-10T16:58:07.818751+0000 mgr.gibba045.orlgmj (mgr.34412) 9988 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:58:09.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:58:09 gibba045 bash[25517]: cephadm 2021-03-10T16:58:07.819063+0000 mgr.gibba045.orlgmj (mgr.34412) 9989 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:58:09.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:58:09 gibba045 bash[25517]: cephadm 2021-03-10T16:58:07.820486+0000 mgr.gibba045.orlgmj (mgr.34412) 9990 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:58:09.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:58:09 gibba045 bash[25517]: cephadm 2021-03-10T16:58:07.820547+0000 mgr.gibba045.orlgmj (mgr.34412) 9991 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:58:09.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:58:09 gibba045 bash[25517]: cephadm 2021-03-10T16:58:07.820655+0000 mgr.gibba045.orlgmj (mgr.34412) 9992 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:58:11.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:58:11 gibba015 bash[29377]: cluster 2021-03-10T16:58:09.218277+0000 mgr.gibba045.orlgmj (mgr.34412) 9993 : cluster [DBG] pgmap v5689: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:11.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:58:11 gibba015 bash[30343]: cluster 2021-03-10T16:58:09.218277+0000 mgr.gibba045.orlgmj (mgr.34412) 9993 : cluster [DBG] pgmap v5689: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:11.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:58:11 gibba045 bash[25517]: cluster 2021-03-10T16:58:09.218277+0000 mgr.gibba045.orlgmj (mgr.34412) 9993 : cluster [DBG] pgmap v5689: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:13.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:58:13 gibba015 bash[29377]: cluster 2021-03-10T16:58:11.220090+0000 mgr.gibba045.orlgmj (mgr.34412) 9994 : cluster [DBG] pgmap v5690: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:13.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:58:13 gibba015 bash[30343]: cluster 2021-03-10T16:58:11.220090+0000 mgr.gibba045.orlgmj (mgr.34412) 9994 : cluster [DBG] pgmap v5690: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:13.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:58:13 gibba045 bash[25517]: cluster 2021-03-10T16:58:11.220090+0000 mgr.gibba045.orlgmj (mgr.34412) 9994 : cluster [DBG] pgmap v5690: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:15.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:58:15 gibba015 bash[29377]: cluster 2021-03-10T16:58:13.221655+0000 mgr.gibba045.orlgmj (mgr.34412) 9995 : cluster [DBG] pgmap v5691: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:15.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:58:15 gibba015 bash[30343]: cluster 2021-03-10T16:58:13.221655+0000 mgr.gibba045.orlgmj (mgr.34412) 9995 : cluster [DBG] pgmap v5691: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:15.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:58:15 gibba045 bash[25517]: cluster 2021-03-10T16:58:13.221655+0000 mgr.gibba045.orlgmj (mgr.34412) 9995 : cluster [DBG] pgmap v5691: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:17.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:58:17 gibba015 bash[29377]: cluster 2021-03-10T16:58:15.223272+0000 mgr.gibba045.orlgmj (mgr.34412) 9996 : cluster [DBG] pgmap v5692: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:17.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:58:17 gibba015 bash[30343]: cluster 2021-03-10T16:58:15.223272+0000 mgr.gibba045.orlgmj (mgr.34412) 9996 : cluster [DBG] pgmap v5692: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:17.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:58:17 gibba045 bash[25517]: cluster 2021-03-10T16:58:15.223272+0000 mgr.gibba045.orlgmj (mgr.34412) 9996 : cluster [DBG] pgmap v5692: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:19.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:58:19 gibba015 bash[29377]: cluster 2021-03-10T16:58:17.224947+0000 mgr.gibba045.orlgmj (mgr.34412) 9997 : cluster [DBG] pgmap v5693: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:19.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:58:19 gibba015 bash[30343]: cluster 2021-03-10T16:58:17.224947+0000 mgr.gibba045.orlgmj (mgr.34412) 9997 : cluster [DBG] pgmap v5693: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:19.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:58:19 gibba045 bash[25517]: cluster 2021-03-10T16:58:17.224947+0000 mgr.gibba045.orlgmj (mgr.34412) 9997 : cluster [DBG] pgmap v5693: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:21.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:58:21 gibba015 bash[29377]: cluster 2021-03-10T16:58:19.226177+0000 mgr.gibba045.orlgmj (mgr.34412) 9998 : cluster [DBG] pgmap v5694: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:21.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:58:21 gibba015 bash[30343]: cluster 2021-03-10T16:58:19.226177+0000 mgr.gibba045.orlgmj (mgr.34412) 9998 : cluster [DBG] pgmap v5694: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:21.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:58:21 gibba045 bash[25517]: cluster 2021-03-10T16:58:19.226177+0000 mgr.gibba045.orlgmj (mgr.34412) 9998 : cluster [DBG] pgmap v5694: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:23.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:58:23 gibba015 bash[29377]: cluster 2021-03-10T16:58:21.227922+0000 mgr.gibba045.orlgmj (mgr.34412) 9999 : cluster [DBG] pgmap v5695: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:23.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:58:23 gibba015 bash[30343]: cluster 2021-03-10T16:58:21.227922+0000 mgr.gibba045.orlgmj (mgr.34412) 9999 : cluster [DBG] pgmap v5695: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:23.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:58:23 gibba045 bash[25517]: cluster 2021-03-10T16:58:21.227922+0000 mgr.gibba045.orlgmj (mgr.34412) 9999 : cluster [DBG] pgmap v5695: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:24.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:58:24 gibba015 bash[29377]: cephadm 2021-03-10T16:58:22.836460+0000 mgr.gibba045.orlgmj (mgr.34412) 10000 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:58:24.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:58:24 gibba015 bash[30343]: cephadm 2021-03-10T16:58:22.836460+0000 mgr.gibba045.orlgmj (mgr.34412) 10000 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:58:24.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:58:24 gibba045 bash[25517]: cephadm 2021-03-10T16:58:22.836460+0000 mgr.gibba045.orlgmj (mgr.34412) 10000 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:58:25.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:58:25 gibba015 bash[29377]: cluster 2021-03-10T16:58:23.229580+0000 mgr.gibba045.orlgmj (mgr.34412) 10001 : cluster [DBG] pgmap v5696: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:25.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:58:25 gibba015 bash[30343]: cluster 2021-03-10T16:58:23.229580+0000 mgr.gibba045.orlgmj (mgr.34412) 10001 : cluster [DBG] pgmap v5696: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:25.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:58:25 gibba045 bash[25517]: cluster 2021-03-10T16:58:23.229580+0000 mgr.gibba045.orlgmj (mgr.34412) 10001 : cluster [DBG] pgmap v5696: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:27.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:58:27 gibba015 bash[29377]: cluster 2021-03-10T16:58:25.230569+0000 mgr.gibba045.orlgmj (mgr.34412) 10002 : cluster [DBG] pgmap v5697: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:27.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:58:27 gibba015 bash[30343]: cluster 2021-03-10T16:58:25.230569+0000 mgr.gibba045.orlgmj (mgr.34412) 10002 : cluster [DBG] pgmap v5697: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:27.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:58:27 gibba045 bash[25517]: cluster 2021-03-10T16:58:25.230569+0000 mgr.gibba045.orlgmj (mgr.34412) 10002 : cluster [DBG] pgmap v5697: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:29.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:58:29 gibba015 bash[29377]: cluster 2021-03-10T16:58:27.231970+0000 mgr.gibba045.orlgmj (mgr.34412) 10003 : cluster [DBG] pgmap v5698: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:29.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:58:29 gibba015 bash[30343]: cluster 2021-03-10T16:58:27.231970+0000 mgr.gibba045.orlgmj (mgr.34412) 10003 : cluster [DBG] pgmap v5698: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:29.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:58:29 gibba045 bash[25517]: cluster 2021-03-10T16:58:27.231970+0000 mgr.gibba045.orlgmj (mgr.34412) 10003 : cluster [DBG] pgmap v5698: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:30.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:58:30 gibba015 bash[29377]: cluster 2021-03-10T16:58:29.233017+0000 mgr.gibba045.orlgmj (mgr.34412) 10004 : cluster [DBG] pgmap v5699: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:30.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:58:30 gibba015 bash[30343]: cluster 2021-03-10T16:58:29.233017+0000 mgr.gibba045.orlgmj (mgr.34412) 10004 : cluster [DBG] pgmap v5699: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:30.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:58:30 gibba045 bash[25517]: cluster 2021-03-10T16:58:29.233017+0000 mgr.gibba045.orlgmj (mgr.34412) 10004 : cluster [DBG] pgmap v5699: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:33.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:58:33 gibba045 bash[25517]: cluster 2021-03-10T16:58:31.234427+0000 mgr.gibba045.orlgmj (mgr.34412) 10005 : cluster [DBG] pgmap v5700: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:33.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:58:33 gibba015 bash[29377]: cluster 2021-03-10T16:58:31.234427+0000 mgr.gibba045.orlgmj (mgr.34412) 10005 : cluster [DBG] pgmap v5700: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:33.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:58:33 gibba015 bash[30343]: cluster 2021-03-10T16:58:31.234427+0000 mgr.gibba045.orlgmj (mgr.34412) 10005 : cluster [DBG] pgmap v5700: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:35.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:58:35 gibba045 bash[25517]: cluster 2021-03-10T16:58:33.236076+0000 mgr.gibba045.orlgmj (mgr.34412) 10006 : cluster [DBG] pgmap v5701: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:35.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:58:35 gibba015 bash[29377]: cluster 2021-03-10T16:58:33.236076+0000 mgr.gibba045.orlgmj (mgr.34412) 10006 : cluster [DBG] pgmap v5701: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:35.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:58:35 gibba015 bash[30343]: cluster 2021-03-10T16:58:33.236076+0000 mgr.gibba045.orlgmj (mgr.34412) 10006 : cluster [DBG] pgmap v5701: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:37.201 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:58:37.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:58:37 gibba045 bash[25517]: cluster 2021-03-10T16:58:35.237711+0000 mgr.gibba045.orlgmj (mgr.34412) 10007 : cluster [DBG] pgmap v5702: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:37.424 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:58:37.425 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 93s ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:58:37.425 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 29s ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:58:37.425 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 29s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:58:37.425 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 29s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:58:37.426 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 93s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:58:37.426 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 93s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:58:37.426 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 29s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:58:37.426 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 93s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:58:37.427 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 93s ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:58:37.427 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 29s ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:58:37.427 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 93s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:58:37.427 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 93s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:58:37.427 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 93s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:58:37.428 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 93s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:58:37.428 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 29s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:58:37.428 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 29s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:58:37.428 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 29s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:58:37.429 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 29s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:58:37.429 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 29s ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:58:37.429 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 29s ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:58:37.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:58:37 gibba015 bash[29377]: cluster 2021-03-10T16:58:35.237711+0000 mgr.gibba045.orlgmj (mgr.34412) 10007 : cluster [DBG] pgmap v5702: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:37.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:58:37 gibba015 bash[30343]: cluster 2021-03-10T16:58:35.237711+0000 mgr.gibba045.orlgmj (mgr.34412) 10007 : cluster [DBG] pgmap v5702: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:37.674 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:58:37.675 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:58:37.675 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:58:37.675 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:58:37.675 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:58:37.676 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:58:37.676 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:58:37.676 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:58:37.676 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:58:37.677 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:58:37.677 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:58:37.677 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:58:37.677 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:58:37.678 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:58:37.678 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:58:38.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:58:38 gibba045 bash[25517]: audit 2021-03-10T16:58:37.674426+0000 mon.c (mon.1) 2749 : audit [DBG] from='client.? 172.21.2.115:0/3981630183' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:58:38.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:58:38 gibba015 bash[29377]: audit 2021-03-10T16:58:37.674426+0000 mon.c (mon.1) 2749 : audit [DBG] from='client.? 172.21.2.115:0/3981630183' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:58:38.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:58:38 gibba015 bash[30343]: audit 2021-03-10T16:58:37.674426+0000 mon.c (mon.1) 2749 : audit [DBG] from='client.? 172.21.2.115:0/3981630183' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:58:39.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:58:39 gibba045 bash[25517]: audit 2021-03-10T16:58:37.193524+0000 mgr.gibba045.orlgmj (mgr.34412) 10008 : audit [DBG] from='client.60754 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:58:39.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:58:39 gibba045 bash[25517]: cluster 2021-03-10T16:58:37.239464+0000 mgr.gibba045.orlgmj (mgr.34412) 10009 : cluster [DBG] pgmap v5703: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:39.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:58:39 gibba045 bash[25517]: audit 2021-03-10T16:58:37.414065+0000 mgr.gibba045.orlgmj (mgr.34412) 10010 : audit [DBG] from='client.50772 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:58:39.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:58:39 gibba045 bash[25517]: cephadm 2021-03-10T16:58:37.839585+0000 mgr.gibba045.orlgmj (mgr.34412) 10011 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:58:39.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:58:39 gibba015 bash[29377]: audit 2021-03-10T16:58:37.193524+0000 mgr.gibba045.orlgmj (mgr.34412) 10008 : audit [DBG] from='client.60754 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:58:39.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:58:39 gibba015 bash[29377]: cluster 2021-03-10T16:58:37.239464+0000 mgr.gibba045.orlgmj (mgr.34412) 10009 : cluster [DBG] pgmap v5703: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:39.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:58:39 gibba015 bash[29377]: audit 2021-03-10T16:58:37.414065+0000 mgr.gibba045.orlgmj (mgr.34412) 10010 : audit [DBG] from='client.50772 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:58:39.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:58:39 gibba015 bash[29377]: cephadm 2021-03-10T16:58:37.839585+0000 mgr.gibba045.orlgmj (mgr.34412) 10011 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:58:39.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:58:39 gibba015 bash[30343]: audit 2021-03-10T16:58:37.193524+0000 mgr.gibba045.orlgmj (mgr.34412) 10008 : audit [DBG] from='client.60754 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:58:39.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:58:39 gibba015 bash[30343]: cluster 2021-03-10T16:58:37.239464+0000 mgr.gibba045.orlgmj (mgr.34412) 10009 : cluster [DBG] pgmap v5703: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:39.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:58:39 gibba015 bash[30343]: audit 2021-03-10T16:58:37.414065+0000 mgr.gibba045.orlgmj (mgr.34412) 10010 : audit [DBG] from='client.50772 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:58:39.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:58:39 gibba015 bash[30343]: cephadm 2021-03-10T16:58:37.839585+0000 mgr.gibba045.orlgmj (mgr.34412) 10011 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:58:41.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:58:41 gibba015 bash[29377]: cluster 2021-03-10T16:58:39.241036+0000 mgr.gibba045.orlgmj (mgr.34412) 10012 : cluster [DBG] pgmap v5704: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:41.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:58:41 gibba015 bash[30343]: cluster 2021-03-10T16:58:39.241036+0000 mgr.gibba045.orlgmj (mgr.34412) 10012 : cluster [DBG] pgmap v5704: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:41.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:58:41 gibba045 bash[25517]: cluster 2021-03-10T16:58:39.241036+0000 mgr.gibba045.orlgmj (mgr.34412) 10012 : cluster [DBG] pgmap v5704: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:43.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:58:43 gibba015 bash[29377]: cluster 2021-03-10T16:58:41.242629+0000 mgr.gibba045.orlgmj (mgr.34412) 10013 : cluster [DBG] pgmap v5705: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:43.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:58:43 gibba015 bash[30343]: cluster 2021-03-10T16:58:41.242629+0000 mgr.gibba045.orlgmj (mgr.34412) 10013 : cluster [DBG] pgmap v5705: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:43.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:58:43 gibba045 bash[25517]: cluster 2021-03-10T16:58:41.242629+0000 mgr.gibba045.orlgmj (mgr.34412) 10013 : cluster [DBG] pgmap v5705: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:45.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:58:45 gibba015 bash[29377]: cluster 2021-03-10T16:58:43.244020+0000 mgr.gibba045.orlgmj (mgr.34412) 10014 : cluster [DBG] pgmap v5706: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:45.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:58:45 gibba015 bash[30343]: cluster 2021-03-10T16:58:43.244020+0000 mgr.gibba045.orlgmj (mgr.34412) 10014 : cluster [DBG] pgmap v5706: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:45.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:58:45 gibba045 bash[25517]: cluster 2021-03-10T16:58:43.244020+0000 mgr.gibba045.orlgmj (mgr.34412) 10014 : cluster [DBG] pgmap v5706: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:47.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:58:47 gibba015 bash[29377]: cluster 2021-03-10T16:58:45.245591+0000 mgr.gibba045.orlgmj (mgr.34412) 10015 : cluster [DBG] pgmap v5707: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:47.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:58:47 gibba015 bash[30343]: cluster 2021-03-10T16:58:45.245591+0000 mgr.gibba045.orlgmj (mgr.34412) 10015 : cluster [DBG] pgmap v5707: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:47.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:58:47 gibba045 bash[25517]: cluster 2021-03-10T16:58:45.245591+0000 mgr.gibba045.orlgmj (mgr.34412) 10015 : cluster [DBG] pgmap v5707: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:49.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:58:49 gibba015 bash[29377]: cluster 2021-03-10T16:58:47.247274+0000 mgr.gibba045.orlgmj (mgr.34412) 10016 : cluster [DBG] pgmap v5708: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:49.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:58:49 gibba015 bash[30343]: cluster 2021-03-10T16:58:47.247274+0000 mgr.gibba045.orlgmj (mgr.34412) 10016 : cluster [DBG] pgmap v5708: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:49.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:58:49 gibba045 bash[25517]: cluster 2021-03-10T16:58:47.247274+0000 mgr.gibba045.orlgmj (mgr.34412) 10016 : cluster [DBG] pgmap v5708: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:51.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:58:51 gibba015 bash[29377]: cluster 2021-03-10T16:58:49.248781+0000 mgr.gibba045.orlgmj (mgr.34412) 10017 : cluster [DBG] pgmap v5709: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:51.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:58:51 gibba015 bash[30343]: cluster 2021-03-10T16:58:49.248781+0000 mgr.gibba045.orlgmj (mgr.34412) 10017 : cluster [DBG] pgmap v5709: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:51.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:58:51 gibba045 bash[25517]: cluster 2021-03-10T16:58:49.248781+0000 mgr.gibba045.orlgmj (mgr.34412) 10017 : cluster [DBG] pgmap v5709: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:53.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:58:53 gibba015 bash[29377]: cluster 2021-03-10T16:58:51.250445+0000 mgr.gibba045.orlgmj (mgr.34412) 10018 : cluster [DBG] pgmap v5710: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:53.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:58:53 gibba015 bash[30343]: cluster 2021-03-10T16:58:51.250445+0000 mgr.gibba045.orlgmj (mgr.34412) 10018 : cluster [DBG] pgmap v5710: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:53.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:58:53 gibba045 bash[25517]: cluster 2021-03-10T16:58:51.250445+0000 mgr.gibba045.orlgmj (mgr.34412) 10018 : cluster [DBG] pgmap v5710: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:54.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:58:54 gibba015 bash[29377]: cephadm 2021-03-10T16:58:52.853219+0000 mgr.gibba045.orlgmj (mgr.34412) 10019 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:58:54.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:58:54 gibba015 bash[29377]: audit 2021-03-10T16:58:53.806803+0000 mon.c (mon.1) 2750 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:58:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:58:54 gibba015 bash[29377]: audit 2021-03-10T16:58:53.807903+0000 mon.a (mon.0) 2168 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:58:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:58:54 gibba015 bash[29377]: audit 2021-03-10T16:58:53.807954+0000 mon.c (mon.1) 2751 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:58:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:58:54 gibba015 bash[29377]: audit 2021-03-10T16:58:53.808814+0000 mon.a (mon.0) 2169 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:58:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:58:54 gibba015 bash[29377]: audit 2021-03-10T16:58:53.845301+0000 mon.c (mon.1) 2752 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:58:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:58:54 gibba015 bash[29377]: audit 2021-03-10T16:58:53.846014+0000 mon.c (mon.1) 2753 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:58:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:58:54 gibba015 bash[29377]: audit 2021-03-10T16:58:53.846524+0000 mon.a (mon.0) 2170 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:58:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:58:54 gibba015 bash[29377]: audit 2021-03-10T16:58:53.846703+0000 mon.c (mon.1) 2754 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T16:58:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:58:54 gibba015 bash[29377]: audit 2021-03-10T16:58:53.847597+0000 mon.c (mon.1) 2755 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:58:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:58:54 gibba015 bash[29377]: audit 2021-03-10T16:58:53.847706+0000 mon.a (mon.0) 2171 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:58:54.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:58:54 gibba015 bash[29377]: audit 2021-03-10T16:58:53.848904+0000 mon.a (mon.0) 2172 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T16:58:54.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:58:54 gibba015 bash[29377]: audit 2021-03-10T16:58:53.849793+0000 mon.a (mon.0) 2173 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:58:54.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:58:54 gibba015 bash[30343]: cephadm 2021-03-10T16:58:52.853219+0000 mgr.gibba045.orlgmj (mgr.34412) 10019 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:58:54.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:58:54 gibba015 bash[30343]: audit 2021-03-10T16:58:53.806803+0000 mon.c (mon.1) 2750 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:58:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:58:54 gibba015 bash[30343]: audit 2021-03-10T16:58:53.807903+0000 mon.a (mon.0) 2168 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:58:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:58:54 gibba015 bash[30343]: audit 2021-03-10T16:58:53.807954+0000 mon.c (mon.1) 2751 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:58:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:58:54 gibba015 bash[30343]: audit 2021-03-10T16:58:53.808814+0000 mon.a (mon.0) 2169 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:58:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:58:54 gibba015 bash[30343]: audit 2021-03-10T16:58:53.845301+0000 mon.c (mon.1) 2752 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:58:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:58:54 gibba015 bash[30343]: audit 2021-03-10T16:58:53.846014+0000 mon.c (mon.1) 2753 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:58:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:58:54 gibba015 bash[30343]: audit 2021-03-10T16:58:53.846524+0000 mon.a (mon.0) 2170 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:58:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:58:54 gibba015 bash[30343]: audit 2021-03-10T16:58:53.846703+0000 mon.c (mon.1) 2754 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T16:58:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:58:54 gibba015 bash[30343]: audit 2021-03-10T16:58:53.847597+0000 mon.c (mon.1) 2755 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:58:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:58:54 gibba015 bash[30343]: audit 2021-03-10T16:58:53.847706+0000 mon.a (mon.0) 2171 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:58:54.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:58:54 gibba015 bash[30343]: audit 2021-03-10T16:58:53.848904+0000 mon.a (mon.0) 2172 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T16:58:54.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:58:54 gibba015 bash[30343]: audit 2021-03-10T16:58:53.849793+0000 mon.a (mon.0) 2173 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:58:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:58:54 gibba045 bash[25517]: cephadm 2021-03-10T16:58:52.853219+0000 mgr.gibba045.orlgmj (mgr.34412) 10019 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:58:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:58:54 gibba045 bash[25517]: audit 2021-03-10T16:58:53.806803+0000 mon.c (mon.1) 2750 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:58:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:58:54 gibba045 bash[25517]: audit 2021-03-10T16:58:53.807903+0000 mon.a (mon.0) 2168 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:58:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:58:54 gibba045 bash[25517]: audit 2021-03-10T16:58:53.807954+0000 mon.c (mon.1) 2751 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:58:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:58:54 gibba045 bash[25517]: audit 2021-03-10T16:58:53.808814+0000 mon.a (mon.0) 2169 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:58:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:58:54 gibba045 bash[25517]: audit 2021-03-10T16:58:53.845301+0000 mon.c (mon.1) 2752 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:58:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:58:54 gibba045 bash[25517]: audit 2021-03-10T16:58:53.846014+0000 mon.c (mon.1) 2753 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:58:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:58:54 gibba045 bash[25517]: audit 2021-03-10T16:58:53.846524+0000 mon.a (mon.0) 2170 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:58:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:58:54 gibba045 bash[25517]: audit 2021-03-10T16:58:53.846703+0000 mon.c (mon.1) 2754 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T16:58:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:58:54 gibba045 bash[25517]: audit 2021-03-10T16:58:53.847597+0000 mon.c (mon.1) 2755 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:58:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:58:54 gibba045 bash[25517]: audit 2021-03-10T16:58:53.847706+0000 mon.a (mon.0) 2171 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:58:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:58:54 gibba045 bash[25517]: audit 2021-03-10T16:58:53.848904+0000 mon.a (mon.0) 2172 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T16:58:54.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:58:54 gibba045 bash[25517]: audit 2021-03-10T16:58:53.849793+0000 mon.a (mon.0) 2173 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:58:55.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:58:55 gibba015 bash[29377]: cluster 2021-03-10T16:58:53.252070+0000 mgr.gibba045.orlgmj (mgr.34412) 10020 : cluster [DBG] pgmap v5711: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:55.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:58:55 gibba015 bash[30343]: cluster 2021-03-10T16:58:53.252070+0000 mgr.gibba045.orlgmj (mgr.34412) 10020 : cluster [DBG] pgmap v5711: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:55.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:58:55 gibba045 bash[25517]: cluster 2021-03-10T16:58:53.252070+0000 mgr.gibba045.orlgmj (mgr.34412) 10020 : cluster [DBG] pgmap v5711: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:57.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:58:57 gibba015 bash[29377]: cluster 2021-03-10T16:58:55.253585+0000 mgr.gibba045.orlgmj (mgr.34412) 10021 : cluster [DBG] pgmap v5712: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:57.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:58:57 gibba015 bash[30343]: cluster 2021-03-10T16:58:55.253585+0000 mgr.gibba045.orlgmj (mgr.34412) 10021 : cluster [DBG] pgmap v5712: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:57.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:58:57 gibba045 bash[25517]: cluster 2021-03-10T16:58:55.253585+0000 mgr.gibba045.orlgmj (mgr.34412) 10021 : cluster [DBG] pgmap v5712: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:59.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:58:59 gibba015 bash[29377]: cluster 2021-03-10T16:58:57.255210+0000 mgr.gibba045.orlgmj (mgr.34412) 10022 : cluster [DBG] pgmap v5713: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:59.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:58:59 gibba015 bash[30343]: cluster 2021-03-10T16:58:57.255210+0000 mgr.gibba045.orlgmj (mgr.34412) 10022 : cluster [DBG] pgmap v5713: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:59.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:58:59 gibba045 bash[25517]: cluster 2021-03-10T16:58:57.255210+0000 mgr.gibba045.orlgmj (mgr.34412) 10022 : cluster [DBG] pgmap v5713: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:01.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:59:01 gibba015 bash[29377]: cluster 2021-03-10T16:58:59.256720+0000 mgr.gibba045.orlgmj (mgr.34412) 10023 : cluster [DBG] pgmap v5714: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:01.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:59:01 gibba015 bash[30343]: cluster 2021-03-10T16:58:59.256720+0000 mgr.gibba045.orlgmj (mgr.34412) 10023 : cluster [DBG] pgmap v5714: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:01.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:59:01 gibba045 bash[25517]: cluster 2021-03-10T16:58:59.256720+0000 mgr.gibba045.orlgmj (mgr.34412) 10023 : cluster [DBG] pgmap v5714: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:03.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:59:03 gibba015 bash[29377]: cluster 2021-03-10T16:59:01.258462+0000 mgr.gibba045.orlgmj (mgr.34412) 10024 : cluster [DBG] pgmap v5715: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:03.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:59:03 gibba015 bash[30343]: cluster 2021-03-10T16:59:01.258462+0000 mgr.gibba045.orlgmj (mgr.34412) 10024 : cluster [DBG] pgmap v5715: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:03.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:59:03 gibba045 bash[25517]: cluster 2021-03-10T16:59:01.258462+0000 mgr.gibba045.orlgmj (mgr.34412) 10024 : cluster [DBG] pgmap v5715: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:05.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:59:05 gibba015 bash[29377]: cluster 2021-03-10T16:59:03.260019+0000 mgr.gibba045.orlgmj (mgr.34412) 10025 : cluster [DBG] pgmap v5716: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:05.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:59:05 gibba015 bash[30343]: cluster 2021-03-10T16:59:03.260019+0000 mgr.gibba045.orlgmj (mgr.34412) 10025 : cluster [DBG] pgmap v5716: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:05.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:59:05 gibba045 bash[25517]: cluster 2021-03-10T16:59:03.260019+0000 mgr.gibba045.orlgmj (mgr.34412) 10025 : cluster [DBG] pgmap v5716: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:07.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:59:07 gibba015 bash[29377]: cluster 2021-03-10T16:59:05.261594+0000 mgr.gibba045.orlgmj (mgr.34412) 10026 : cluster [DBG] pgmap v5717: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:07.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:59:07 gibba015 bash[30343]: cluster 2021-03-10T16:59:05.261594+0000 mgr.gibba045.orlgmj (mgr.34412) 10026 : cluster [DBG] pgmap v5717: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:07.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:59:07 gibba045 bash[25517]: cluster 2021-03-10T16:59:05.261594+0000 mgr.gibba045.orlgmj (mgr.34412) 10026 : cluster [DBG] pgmap v5717: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:07.916 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:59:08.170 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:59:08.170 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 2m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:59:08.171 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 60s ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:59:08.171 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 60s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:59:08.171 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 60s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:59:08.171 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:59:08.172 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:59:08.172 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 60s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:59:08.172 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:59:08.172 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 2m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:59:08.173 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 60s ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:59:08.173 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:59:08.173 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:59:08.173 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:59:08.173 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:59:08.174 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 60s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:59:08.174 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 60s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:59:08.174 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 60s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:59:08.174 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 60s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:59:08.174 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 60s ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:59:08.175 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 60s ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:59:08.422 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:59:08.422 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:59:08.422 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:59:08.423 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:59:08.423 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:59:08.423 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:59:08.423 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:59:08.424 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:59:08.424 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:59:08.424 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:59:08.424 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:59:08.424 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:59:08.425 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:59:08.425 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:59:08.425 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:59:08.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:59:08 gibba015 bash[29377]: audit 2021-03-10T16:59:07.867132+0000 mon.c (mon.1) 2756 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:59:08.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:59:08 gibba015 bash[29377]: audit 2021-03-10T16:59:08.098990+0000 mon.a (mon.0) 2174 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:59:08.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:59:08 gibba015 bash[29377]: audit 2021-03-10T16:59:08.102749+0000 mon.c (mon.1) 2757 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:59:08.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:59:08 gibba015 bash[29377]: audit 2021-03-10T16:59:08.104064+0000 mon.c (mon.1) 2758 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:59:08.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:59:08 gibba015 bash[29377]: audit 2021-03-10T16:59:08.105330+0000 mon.c (mon.1) 2759 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:59:08.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:59:08 gibba015 bash[29377]: audit 2021-03-10T16:59:08.106493+0000 mon.c (mon.1) 2760 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:59:08.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:59:08 gibba015 bash[29377]: audit 2021-03-10T16:59:08.109535+0000 mon.c (mon.1) 2761 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:59:08.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:59:08 gibba015 bash[29377]: audit 2021-03-10T16:59:08.110945+0000 mon.c (mon.1) 2762 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:59:08.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:59:08 gibba015 bash[30343]: audit 2021-03-10T16:59:07.867132+0000 mon.c (mon.1) 2756 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:59:08.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:59:08 gibba015 bash[30343]: audit 2021-03-10T16:59:08.098990+0000 mon.a (mon.0) 2174 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:59:08.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:59:08 gibba015 bash[30343]: audit 2021-03-10T16:59:08.102749+0000 mon.c (mon.1) 2757 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:59:08.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:59:08 gibba015 bash[30343]: audit 2021-03-10T16:59:08.104064+0000 mon.c (mon.1) 2758 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:59:08.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:59:08 gibba015 bash[30343]: audit 2021-03-10T16:59:08.105330+0000 mon.c (mon.1) 2759 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:59:08.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:59:08 gibba015 bash[30343]: audit 2021-03-10T16:59:08.106493+0000 mon.c (mon.1) 2760 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:59:08.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:59:08 gibba015 bash[30343]: audit 2021-03-10T16:59:08.109535+0000 mon.c (mon.1) 2761 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:59:08.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:59:08 gibba015 bash[30343]: audit 2021-03-10T16:59:08.110945+0000 mon.c (mon.1) 2762 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:59:08.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:59:08 gibba045 bash[25517]: audit 2021-03-10T16:59:07.867132+0000 mon.c (mon.1) 2756 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:59:08.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:59:08 gibba045 bash[25517]: audit 2021-03-10T16:59:08.098990+0000 mon.a (mon.0) 2174 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T16:59:08.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:59:08 gibba045 bash[25517]: audit 2021-03-10T16:59:08.102749+0000 mon.c (mon.1) 2757 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:59:08.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:59:08 gibba045 bash[25517]: audit 2021-03-10T16:59:08.104064+0000 mon.c (mon.1) 2758 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:59:08.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:59:08 gibba045 bash[25517]: audit 2021-03-10T16:59:08.105330+0000 mon.c (mon.1) 2759 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:59:08.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:59:08 gibba045 bash[25517]: audit 2021-03-10T16:59:08.106493+0000 mon.c (mon.1) 2760 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:59:08.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:59:08 gibba045 bash[25517]: audit 2021-03-10T16:59:08.109535+0000 mon.c (mon.1) 2761 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:59:08.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:59:08 gibba045 bash[25517]: audit 2021-03-10T16:59:08.110945+0000 mon.c (mon.1) 2762 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:59:09.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:59:09 gibba015 bash[29377]: cluster 2021-03-10T16:59:07.263132+0000 mgr.gibba045.orlgmj (mgr.34412) 10027 : cluster [DBG] pgmap v5718: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:09.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:59:09 gibba015 bash[29377]: cephadm 2021-03-10T16:59:07.872601+0000 mgr.gibba045.orlgmj (mgr.34412) 10028 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:59:09.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:59:09 gibba015 bash[29377]: cephadm 2021-03-10T16:59:07.874344+0000 mgr.gibba045.orlgmj (mgr.34412) 10029 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:59:09.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:59:09 gibba015 bash[29377]: audit 2021-03-10T16:59:07.910233+0000 mgr.gibba045.orlgmj (mgr.34412) 10030 : audit [DBG] from='client.50784 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:59:09.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:59:09 gibba015 bash[29377]: cephadm 2021-03-10T16:59:08.104079+0000 mgr.gibba045.orlgmj (mgr.34412) 10031 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:59:09.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:59:09 gibba015 bash[29377]: cephadm 2021-03-10T16:59:08.105813+0000 mgr.gibba045.orlgmj (mgr.34412) 10032 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:59:09.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:59:09 gibba015 bash[29377]: cephadm 2021-03-10T16:59:08.107038+0000 mgr.gibba045.orlgmj (mgr.34412) 10033 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:59:09.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:59:09 gibba015 bash[29377]: cephadm 2021-03-10T16:59:08.107127+0000 mgr.gibba045.orlgmj (mgr.34412) 10034 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:59:09.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:59:09 gibba015 bash[29377]: cephadm 2021-03-10T16:59:08.108244+0000 mgr.gibba045.orlgmj (mgr.34412) 10035 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:59:09.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:59:09 gibba015 bash[29377]: cephadm 2021-03-10T16:59:08.108318+0000 mgr.gibba045.orlgmj (mgr.34412) 10036 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:59:09.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:59:09 gibba015 bash[29377]: cephadm 2021-03-10T16:59:08.109574+0000 mgr.gibba045.orlgmj (mgr.34412) 10037 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:59:09.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:59:09 gibba015 bash[29377]: cephadm 2021-03-10T16:59:08.111138+0000 mgr.gibba045.orlgmj (mgr.34412) 10038 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:59:09.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:59:09 gibba015 bash[29377]: cephadm 2021-03-10T16:59:08.111221+0000 mgr.gibba045.orlgmj (mgr.34412) 10039 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:59:09.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:59:09 gibba015 bash[29377]: cephadm 2021-03-10T16:59:08.112439+0000 mgr.gibba045.orlgmj (mgr.34412) 10040 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:59:09.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:59:09 gibba015 bash[29377]: cephadm 2021-03-10T16:59:08.112790+0000 mgr.gibba045.orlgmj (mgr.34412) 10041 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:59:09.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:59:09 gibba015 bash[29377]: cephadm 2021-03-10T16:59:08.114016+0000 mgr.gibba045.orlgmj (mgr.34412) 10042 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:59:09.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:59:09 gibba015 bash[29377]: cephadm 2021-03-10T16:59:08.114092+0000 mgr.gibba045.orlgmj (mgr.34412) 10043 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:59:09.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:59:09 gibba015 bash[29377]: cephadm 2021-03-10T16:59:08.114223+0000 mgr.gibba045.orlgmj (mgr.34412) 10044 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:59:09.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:59:09 gibba015 bash[29377]: audit 2021-03-10T16:59:08.143610+0000 mgr.gibba045.orlgmj (mgr.34412) 10045 : audit [DBG] from='client.50790 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:59:09.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:59:09 gibba015 bash[29377]: audit 2021-03-10T16:59:08.420929+0000 mon.a (mon.0) 2175 : audit [DBG] from='client.? 172.21.2.115:0/2853488492' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:59:09.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:59:09 gibba015 bash[30343]: cluster 2021-03-10T16:59:07.263132+0000 mgr.gibba045.orlgmj (mgr.34412) 10027 : cluster [DBG] pgmap v5718: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:09.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:59:09 gibba015 bash[30343]: cephadm 2021-03-10T16:59:07.872601+0000 mgr.gibba045.orlgmj (mgr.34412) 10028 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:59:09.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:59:09 gibba015 bash[30343]: cephadm 2021-03-10T16:59:07.874344+0000 mgr.gibba045.orlgmj (mgr.34412) 10029 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:59:09.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:59:09 gibba015 bash[30343]: audit 2021-03-10T16:59:07.910233+0000 mgr.gibba045.orlgmj (mgr.34412) 10030 : audit [DBG] from='client.50784 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:59:09.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:59:09 gibba015 bash[30343]: cephadm 2021-03-10T16:59:08.104079+0000 mgr.gibba045.orlgmj (mgr.34412) 10031 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:59:09.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:59:09 gibba015 bash[30343]: cephadm 2021-03-10T16:59:08.105813+0000 mgr.gibba045.orlgmj (mgr.34412) 10032 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:59:09.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:59:09 gibba015 bash[30343]: cephadm 2021-03-10T16:59:08.107038+0000 mgr.gibba045.orlgmj (mgr.34412) 10033 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:59:09.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:59:09 gibba015 bash[30343]: cephadm 2021-03-10T16:59:08.107127+0000 mgr.gibba045.orlgmj (mgr.34412) 10034 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:59:09.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:59:09 gibba015 bash[30343]: cephadm 2021-03-10T16:59:08.108244+0000 mgr.gibba045.orlgmj (mgr.34412) 10035 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:59:09.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:59:09 gibba015 bash[30343]: cephadm 2021-03-10T16:59:08.108318+0000 mgr.gibba045.orlgmj (mgr.34412) 10036 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:59:09.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:59:09 gibba015 bash[30343]: cephadm 2021-03-10T16:59:08.109574+0000 mgr.gibba045.orlgmj (mgr.34412) 10037 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:59:09.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:59:09 gibba015 bash[30343]: cephadm 2021-03-10T16:59:08.111138+0000 mgr.gibba045.orlgmj (mgr.34412) 10038 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:59:09.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:59:09 gibba015 bash[30343]: cephadm 2021-03-10T16:59:08.111221+0000 mgr.gibba045.orlgmj (mgr.34412) 10039 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:59:09.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:59:09 gibba015 bash[30343]: cephadm 2021-03-10T16:59:08.112439+0000 mgr.gibba045.orlgmj (mgr.34412) 10040 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:59:09.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:59:09 gibba015 bash[30343]: cephadm 2021-03-10T16:59:08.112790+0000 mgr.gibba045.orlgmj (mgr.34412) 10041 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:59:09.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:59:09 gibba015 bash[30343]: cephadm 2021-03-10T16:59:08.114016+0000 mgr.gibba045.orlgmj (mgr.34412) 10042 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:59:09.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:59:09 gibba015 bash[30343]: cephadm 2021-03-10T16:59:08.114092+0000 mgr.gibba045.orlgmj (mgr.34412) 10043 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:59:09.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:59:09 gibba015 bash[30343]: cephadm 2021-03-10T16:59:08.114223+0000 mgr.gibba045.orlgmj (mgr.34412) 10044 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:59:09.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:59:09 gibba015 bash[30343]: audit 2021-03-10T16:59:08.143610+0000 mgr.gibba045.orlgmj (mgr.34412) 10045 : audit [DBG] from='client.50790 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:59:09.485 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:59:09 gibba015 bash[30343]: audit 2021-03-10T16:59:08.420929+0000 mon.a (mon.0) 2175 : audit [DBG] from='client.? 172.21.2.115:0/2853488492' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:59:09.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:59:09 gibba045 bash[25517]: cluster 2021-03-10T16:59:07.263132+0000 mgr.gibba045.orlgmj (mgr.34412) 10027 : cluster [DBG] pgmap v5718: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:09.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:59:09 gibba045 bash[25517]: cephadm 2021-03-10T16:59:07.872601+0000 mgr.gibba045.orlgmj (mgr.34412) 10028 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T16:59:09.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:59:09 gibba045 bash[25517]: cephadm 2021-03-10T16:59:07.874344+0000 mgr.gibba045.orlgmj (mgr.34412) 10029 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T16:59:09.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:59:09 gibba045 bash[25517]: audit 2021-03-10T16:59:07.910233+0000 mgr.gibba045.orlgmj (mgr.34412) 10030 : audit [DBG] from='client.50784 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:59:09.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:59:09 gibba045 bash[25517]: cephadm 2021-03-10T16:59:08.104079+0000 mgr.gibba045.orlgmj (mgr.34412) 10031 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:59:09.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:59:09 gibba045 bash[25517]: cephadm 2021-03-10T16:59:08.105813+0000 mgr.gibba045.orlgmj (mgr.34412) 10032 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:59:09.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:59:09 gibba045 bash[25517]: cephadm 2021-03-10T16:59:08.107038+0000 mgr.gibba045.orlgmj (mgr.34412) 10033 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:59:09.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:59:09 gibba045 bash[25517]: cephadm 2021-03-10T16:59:08.107127+0000 mgr.gibba045.orlgmj (mgr.34412) 10034 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:59:09.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:59:09 gibba045 bash[25517]: cephadm 2021-03-10T16:59:08.108244+0000 mgr.gibba045.orlgmj (mgr.34412) 10035 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:59:09.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:59:09 gibba045 bash[25517]: cephadm 2021-03-10T16:59:08.108318+0000 mgr.gibba045.orlgmj (mgr.34412) 10036 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:59:09.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:59:09 gibba045 bash[25517]: cephadm 2021-03-10T16:59:08.109574+0000 mgr.gibba045.orlgmj (mgr.34412) 10037 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:59:09.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:59:09 gibba045 bash[25517]: cephadm 2021-03-10T16:59:08.111138+0000 mgr.gibba045.orlgmj (mgr.34412) 10038 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:59:09.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:59:09 gibba045 bash[25517]: cephadm 2021-03-10T16:59:08.111221+0000 mgr.gibba045.orlgmj (mgr.34412) 10039 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:59:09.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:59:09 gibba045 bash[25517]: cephadm 2021-03-10T16:59:08.112439+0000 mgr.gibba045.orlgmj (mgr.34412) 10040 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:59:09.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:59:09 gibba045 bash[25517]: cephadm 2021-03-10T16:59:08.112790+0000 mgr.gibba045.orlgmj (mgr.34412) 10041 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:59:09.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:59:09 gibba045 bash[25517]: cephadm 2021-03-10T16:59:08.114016+0000 mgr.gibba045.orlgmj (mgr.34412) 10042 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:59:09.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:59:09 gibba045 bash[25517]: cephadm 2021-03-10T16:59:08.114092+0000 mgr.gibba045.orlgmj (mgr.34412) 10043 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:59:09.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:59:09 gibba045 bash[25517]: cephadm 2021-03-10T16:59:08.114223+0000 mgr.gibba045.orlgmj (mgr.34412) 10044 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:59:09.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:59:09 gibba045 bash[25517]: audit 2021-03-10T16:59:08.143610+0000 mgr.gibba045.orlgmj (mgr.34412) 10045 : audit [DBG] from='client.50790 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:59:09.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:59:09 gibba045 bash[25517]: audit 2021-03-10T16:59:08.420929+0000 mon.a (mon.0) 2175 : audit [DBG] from='client.? 172.21.2.115:0/2853488492' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:59:10.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:59:10 gibba015 bash[29377]: cluster 2021-03-10T16:59:09.264276+0000 mgr.gibba045.orlgmj (mgr.34412) 10046 : cluster [DBG] pgmap v5719: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:10.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:59:10 gibba015 bash[30343]: cluster 2021-03-10T16:59:09.264276+0000 mgr.gibba045.orlgmj (mgr.34412) 10046 : cluster [DBG] pgmap v5719: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:10.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:59:10 gibba045 bash[25517]: cluster 2021-03-10T16:59:09.264276+0000 mgr.gibba045.orlgmj (mgr.34412) 10046 : cluster [DBG] pgmap v5719: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:13.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:59:13 gibba045 bash[25517]: cluster 2021-03-10T16:59:11.266118+0000 mgr.gibba045.orlgmj (mgr.34412) 10047 : cluster [DBG] pgmap v5720: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:13.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:59:13 gibba015 bash[29377]: cluster 2021-03-10T16:59:11.266118+0000 mgr.gibba045.orlgmj (mgr.34412) 10047 : cluster [DBG] pgmap v5720: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:13.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:59:13 gibba015 bash[30343]: cluster 2021-03-10T16:59:11.266118+0000 mgr.gibba045.orlgmj (mgr.34412) 10047 : cluster [DBG] pgmap v5720: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:15.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:59:15 gibba045 bash[25517]: cluster 2021-03-10T16:59:13.267782+0000 mgr.gibba045.orlgmj (mgr.34412) 10048 : cluster [DBG] pgmap v5721: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:15.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:59:15 gibba015 bash[29377]: cluster 2021-03-10T16:59:13.267782+0000 mgr.gibba045.orlgmj (mgr.34412) 10048 : cluster [DBG] pgmap v5721: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:15.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:59:15 gibba015 bash[30343]: cluster 2021-03-10T16:59:13.267782+0000 mgr.gibba045.orlgmj (mgr.34412) 10048 : cluster [DBG] pgmap v5721: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:17.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:59:17 gibba045 bash[25517]: cluster 2021-03-10T16:59:15.269528+0000 mgr.gibba045.orlgmj (mgr.34412) 10049 : cluster [DBG] pgmap v5722: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:17.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:59:17 gibba015 bash[29377]: cluster 2021-03-10T16:59:15.269528+0000 mgr.gibba045.orlgmj (mgr.34412) 10049 : cluster [DBG] pgmap v5722: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:17.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:59:17 gibba015 bash[30343]: cluster 2021-03-10T16:59:15.269528+0000 mgr.gibba045.orlgmj (mgr.34412) 10049 : cluster [DBG] pgmap v5722: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:19.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:59:19 gibba015 bash[29377]: cluster 2021-03-10T16:59:17.271043+0000 mgr.gibba045.orlgmj (mgr.34412) 10050 : cluster [DBG] pgmap v5723: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:19.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:59:19 gibba015 bash[30343]: cluster 2021-03-10T16:59:17.271043+0000 mgr.gibba045.orlgmj (mgr.34412) 10050 : cluster [DBG] pgmap v5723: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:19.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:59:19 gibba045 bash[25517]: cluster 2021-03-10T16:59:17.271043+0000 mgr.gibba045.orlgmj (mgr.34412) 10050 : cluster [DBG] pgmap v5723: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:21.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:59:21 gibba015 bash[29377]: cluster 2021-03-10T16:59:19.272292+0000 mgr.gibba045.orlgmj (mgr.34412) 10051 : cluster [DBG] pgmap v5724: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:21.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:59:21 gibba015 bash[30343]: cluster 2021-03-10T16:59:19.272292+0000 mgr.gibba045.orlgmj (mgr.34412) 10051 : cluster [DBG] pgmap v5724: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:21.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:59:21 gibba045 bash[25517]: cluster 2021-03-10T16:59:19.272292+0000 mgr.gibba045.orlgmj (mgr.34412) 10051 : cluster [DBG] pgmap v5724: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:23.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:59:23 gibba015 bash[29377]: cluster 2021-03-10T16:59:21.273739+0000 mgr.gibba045.orlgmj (mgr.34412) 10052 : cluster [DBG] pgmap v5725: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:23.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:59:23 gibba015 bash[30343]: cluster 2021-03-10T16:59:21.273739+0000 mgr.gibba045.orlgmj (mgr.34412) 10052 : cluster [DBG] pgmap v5725: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:23.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:59:23 gibba045 bash[25517]: cluster 2021-03-10T16:59:21.273739+0000 mgr.gibba045.orlgmj (mgr.34412) 10052 : cluster [DBG] pgmap v5725: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:24.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:59:24 gibba015 bash[29377]: cephadm 2021-03-10T16:59:23.128852+0000 mgr.gibba045.orlgmj (mgr.34412) 10053 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:59:24.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:59:24 gibba015 bash[30343]: cephadm 2021-03-10T16:59:23.128852+0000 mgr.gibba045.orlgmj (mgr.34412) 10053 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:59:24.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:59:24 gibba045 bash[25517]: cephadm 2021-03-10T16:59:23.128852+0000 mgr.gibba045.orlgmj (mgr.34412) 10053 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:59:25.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:59:25 gibba015 bash[29377]: cluster 2021-03-10T16:59:23.275417+0000 mgr.gibba045.orlgmj (mgr.34412) 10054 : cluster [DBG] pgmap v5726: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:25.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:59:25 gibba015 bash[30343]: cluster 2021-03-10T16:59:23.275417+0000 mgr.gibba045.orlgmj (mgr.34412) 10054 : cluster [DBG] pgmap v5726: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:25.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:59:25 gibba045 bash[25517]: cluster 2021-03-10T16:59:23.275417+0000 mgr.gibba045.orlgmj (mgr.34412) 10054 : cluster [DBG] pgmap v5726: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:27.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:59:27 gibba015 bash[29377]: cluster 2021-03-10T16:59:25.277131+0000 mgr.gibba045.orlgmj (mgr.34412) 10055 : cluster [DBG] pgmap v5727: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:27.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:59:27 gibba015 bash[30343]: cluster 2021-03-10T16:59:25.277131+0000 mgr.gibba045.orlgmj (mgr.34412) 10055 : cluster [DBG] pgmap v5727: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:27.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:59:27 gibba045 bash[25517]: cluster 2021-03-10T16:59:25.277131+0000 mgr.gibba045.orlgmj (mgr.34412) 10055 : cluster [DBG] pgmap v5727: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:29.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:59:29 gibba015 bash[29377]: cluster 2021-03-10T16:59:27.278569+0000 mgr.gibba045.orlgmj (mgr.34412) 10056 : cluster [DBG] pgmap v5728: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:29.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:59:29 gibba015 bash[30343]: cluster 2021-03-10T16:59:27.278569+0000 mgr.gibba045.orlgmj (mgr.34412) 10056 : cluster [DBG] pgmap v5728: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:29.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:59:29 gibba045 bash[25517]: cluster 2021-03-10T16:59:27.278569+0000 mgr.gibba045.orlgmj (mgr.34412) 10056 : cluster [DBG] pgmap v5728: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:31.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:59:31 gibba015 bash[29377]: cluster 2021-03-10T16:59:29.280021+0000 mgr.gibba045.orlgmj (mgr.34412) 10057 : cluster [DBG] pgmap v5729: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:31.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:59:31 gibba015 bash[30343]: cluster 2021-03-10T16:59:29.280021+0000 mgr.gibba045.orlgmj (mgr.34412) 10057 : cluster [DBG] pgmap v5729: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:31.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:59:31 gibba045 bash[25517]: cluster 2021-03-10T16:59:29.280021+0000 mgr.gibba045.orlgmj (mgr.34412) 10057 : cluster [DBG] pgmap v5729: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:33.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:59:33 gibba015 bash[29377]: cluster 2021-03-10T16:59:31.281590+0000 mgr.gibba045.orlgmj (mgr.34412) 10058 : cluster [DBG] pgmap v5730: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:33.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:59:33 gibba015 bash[30343]: cluster 2021-03-10T16:59:31.281590+0000 mgr.gibba045.orlgmj (mgr.34412) 10058 : cluster [DBG] pgmap v5730: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:33.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:59:33 gibba045 bash[25517]: cluster 2021-03-10T16:59:31.281590+0000 mgr.gibba045.orlgmj (mgr.34412) 10058 : cluster [DBG] pgmap v5730: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:35.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:59:35 gibba015 bash[29377]: cluster 2021-03-10T16:59:33.283239+0000 mgr.gibba045.orlgmj (mgr.34412) 10059 : cluster [DBG] pgmap v5731: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:35.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:59:35 gibba015 bash[30343]: cluster 2021-03-10T16:59:33.283239+0000 mgr.gibba045.orlgmj (mgr.34412) 10059 : cluster [DBG] pgmap v5731: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:35.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:59:35 gibba045 bash[25517]: cluster 2021-03-10T16:59:33.283239+0000 mgr.gibba045.orlgmj (mgr.34412) 10059 : cluster [DBG] pgmap v5731: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:37.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:59:37 gibba015 bash[29377]: cluster 2021-03-10T16:59:35.285000+0000 mgr.gibba045.orlgmj (mgr.34412) 10060 : cluster [DBG] pgmap v5732: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:37.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:59:37 gibba015 bash[30343]: cluster 2021-03-10T16:59:35.285000+0000 mgr.gibba045.orlgmj (mgr.34412) 10060 : cluster [DBG] pgmap v5732: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:37.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:59:37 gibba045 bash[25517]: cluster 2021-03-10T16:59:35.285000+0000 mgr.gibba045.orlgmj (mgr.34412) 10060 : cluster [DBG] pgmap v5732: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:38.668 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T16:59:38.894 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:59:38.894 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 2m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T16:59:38.895 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 91s ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T16:59:38.895 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 91s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T16:59:38.895 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 91s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T16:59:38.895 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T16:59:38.896 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T16:59:38.896 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 91s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T16:59:38.896 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T16:59:38.896 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 2m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T16:59:38.896 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 91s ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T16:59:38.897 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T16:59:38.897 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T16:59:38.897 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T16:59:38.897 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T16:59:38.898 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 91s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T16:59:38.898 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 91s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T16:59:38.898 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 91s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T16:59:38.898 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 91s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T16:59:38.899 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 91s ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T16:59:38.899 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 91s ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:59:39.141 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T16:59:39.141 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T16:59:39.142 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:59:39.142 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:59:39.142 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T16:59:39.142 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:59:39.143 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:59:39.143 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T16:59:39.143 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:59:39.143 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T16:59:39.143 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T16:59:39.144 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T16:59:39.144 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:59:39.144 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T16:59:39.144 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T16:59:39.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:59:39 gibba015 bash[29377]: cluster 2021-03-10T16:59:37.286619+0000 mgr.gibba045.orlgmj (mgr.34412) 10061 : cluster [DBG] pgmap v5733: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:39.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:59:39 gibba015 bash[29377]: cephadm 2021-03-10T16:59:38.144385+0000 mgr.gibba045.orlgmj (mgr.34412) 10062 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:59:39.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:59:39 gibba015 bash[29377]: audit 2021-03-10T16:59:39.141036+0000 mon.a (mon.0) 2176 : audit [DBG] from='client.? 172.21.2.115:0/2220075934' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:59:39.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:59:39 gibba015 bash[30343]: cluster 2021-03-10T16:59:37.286619+0000 mgr.gibba045.orlgmj (mgr.34412) 10061 : cluster [DBG] pgmap v5733: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:39.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:59:39 gibba015 bash[30343]: cephadm 2021-03-10T16:59:38.144385+0000 mgr.gibba045.orlgmj (mgr.34412) 10062 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:59:39.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:59:39 gibba015 bash[30343]: audit 2021-03-10T16:59:39.141036+0000 mon.a (mon.0) 2176 : audit [DBG] from='client.? 172.21.2.115:0/2220075934' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:59:39.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:59:39 gibba045 bash[25517]: cluster 2021-03-10T16:59:37.286619+0000 mgr.gibba045.orlgmj (mgr.34412) 10061 : cluster [DBG] pgmap v5733: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:39.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:59:39 gibba045 bash[25517]: cephadm 2021-03-10T16:59:38.144385+0000 mgr.gibba045.orlgmj (mgr.34412) 10062 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:59:39.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:59:39 gibba045 bash[25517]: audit 2021-03-10T16:59:39.141036+0000 mon.a (mon.0) 2176 : audit [DBG] from='client.? 172.21.2.115:0/2220075934' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:59:40.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:59:40 gibba015 bash[29377]: audit 2021-03-10T16:59:38.660770+0000 mgr.gibba045.orlgmj (mgr.34412) 10063 : audit [DBG] from='client.50802 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:59:40.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:59:40 gibba015 bash[29377]: audit 2021-03-10T16:59:38.883503+0000 mgr.gibba045.orlgmj (mgr.34412) 10064 : audit [DBG] from='client.50808 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:59:40.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:59:40 gibba015 bash[30343]: audit 2021-03-10T16:59:38.660770+0000 mgr.gibba045.orlgmj (mgr.34412) 10063 : audit [DBG] from='client.50802 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:59:40.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:59:40 gibba015 bash[30343]: audit 2021-03-10T16:59:38.883503+0000 mgr.gibba045.orlgmj (mgr.34412) 10064 : audit [DBG] from='client.50808 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:59:40.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:59:40 gibba045 bash[25517]: audit 2021-03-10T16:59:38.660770+0000 mgr.gibba045.orlgmj (mgr.34412) 10063 : audit [DBG] from='client.50802 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:59:40.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:59:40 gibba045 bash[25517]: audit 2021-03-10T16:59:38.883503+0000 mgr.gibba045.orlgmj (mgr.34412) 10064 : audit [DBG] from='client.50808 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:59:41.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:59:41 gibba015 bash[29377]: cluster 2021-03-10T16:59:39.288110+0000 mgr.gibba045.orlgmj (mgr.34412) 10065 : cluster [DBG] pgmap v5734: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:41.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:59:41 gibba015 bash[30343]: cluster 2021-03-10T16:59:39.288110+0000 mgr.gibba045.orlgmj (mgr.34412) 10065 : cluster [DBG] pgmap v5734: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:41.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:59:41 gibba045 bash[25517]: cluster 2021-03-10T16:59:39.288110+0000 mgr.gibba045.orlgmj (mgr.34412) 10065 : cluster [DBG] pgmap v5734: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:43.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:59:43 gibba015 bash[29377]: cluster 2021-03-10T16:59:41.289739+0000 mgr.gibba045.orlgmj (mgr.34412) 10066 : cluster [DBG] pgmap v5735: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:43.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:59:43 gibba015 bash[30343]: cluster 2021-03-10T16:59:41.289739+0000 mgr.gibba045.orlgmj (mgr.34412) 10066 : cluster [DBG] pgmap v5735: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:43.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:59:43 gibba045 bash[25517]: cluster 2021-03-10T16:59:41.289739+0000 mgr.gibba045.orlgmj (mgr.34412) 10066 : cluster [DBG] pgmap v5735: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:45.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:59:45 gibba015 bash[29377]: cluster 2021-03-10T16:59:43.291373+0000 mgr.gibba045.orlgmj (mgr.34412) 10067 : cluster [DBG] pgmap v5736: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:45.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:59:45 gibba015 bash[30343]: cluster 2021-03-10T16:59:43.291373+0000 mgr.gibba045.orlgmj (mgr.34412) 10067 : cluster [DBG] pgmap v5736: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:45.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:59:45 gibba045 bash[25517]: cluster 2021-03-10T16:59:43.291373+0000 mgr.gibba045.orlgmj (mgr.34412) 10067 : cluster [DBG] pgmap v5736: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:46.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:59:46 gibba015 bash[29377]: cluster 2021-03-10T16:59:45.292883+0000 mgr.gibba045.orlgmj (mgr.34412) 10068 : cluster [DBG] pgmap v5737: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:46.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:59:46 gibba015 bash[30343]: cluster 2021-03-10T16:59:45.292883+0000 mgr.gibba045.orlgmj (mgr.34412) 10068 : cluster [DBG] pgmap v5737: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:46.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:59:46 gibba045 bash[25517]: cluster 2021-03-10T16:59:45.292883+0000 mgr.gibba045.orlgmj (mgr.34412) 10068 : cluster [DBG] pgmap v5737: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:49.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:59:49 gibba015 bash[29377]: cluster 2021-03-10T16:59:47.294575+0000 mgr.gibba045.orlgmj (mgr.34412) 10069 : cluster [DBG] pgmap v5738: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:49.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:59:49 gibba015 bash[30343]: cluster 2021-03-10T16:59:47.294575+0000 mgr.gibba045.orlgmj (mgr.34412) 10069 : cluster [DBG] pgmap v5738: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:49.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:59:49 gibba045 bash[25517]: cluster 2021-03-10T16:59:47.294575+0000 mgr.gibba045.orlgmj (mgr.34412) 10069 : cluster [DBG] pgmap v5738: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:51.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:59:51 gibba015 bash[29377]: cluster 2021-03-10T16:59:49.295935+0000 mgr.gibba045.orlgmj (mgr.34412) 10070 : cluster [DBG] pgmap v5739: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:51.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:59:51 gibba015 bash[30343]: cluster 2021-03-10T16:59:49.295935+0000 mgr.gibba045.orlgmj (mgr.34412) 10070 : cluster [DBG] pgmap v5739: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:51.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:59:51 gibba045 bash[25517]: cluster 2021-03-10T16:59:49.295935+0000 mgr.gibba045.orlgmj (mgr.34412) 10070 : cluster [DBG] pgmap v5739: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:53.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:59:53 gibba015 bash[29377]: cluster 2021-03-10T16:59:51.297606+0000 mgr.gibba045.orlgmj (mgr.34412) 10071 : cluster [DBG] pgmap v5740: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:53.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:59:53 gibba015 bash[30343]: cluster 2021-03-10T16:59:51.297606+0000 mgr.gibba045.orlgmj (mgr.34412) 10071 : cluster [DBG] pgmap v5740: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:53.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:59:53 gibba045 bash[25517]: cluster 2021-03-10T16:59:51.297606+0000 mgr.gibba045.orlgmj (mgr.34412) 10071 : cluster [DBG] pgmap v5740: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:54.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:59:54 gibba015 bash[29377]: cephadm 2021-03-10T16:59:53.160009+0000 mgr.gibba045.orlgmj (mgr.34412) 10072 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:59:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:59:54 gibba015 bash[29377]: audit 2021-03-10T16:59:53.811382+0000 mon.c (mon.1) 2763 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:59:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:59:54 gibba015 bash[29377]: audit 2021-03-10T16:59:53.812091+0000 mon.c (mon.1) 2764 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:59:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:59:54 gibba015 bash[29377]: audit 2021-03-10T16:59:53.812522+0000 mon.a (mon.0) 2177 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:59:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:59:54 gibba015 bash[29377]: audit 2021-03-10T16:59:53.813854+0000 mon.a (mon.0) 2178 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:59:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:59:54 gibba015 bash[29377]: audit 2021-03-10T16:59:53.851162+0000 mon.c (mon.1) 2765 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T16:59:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:59:54 gibba015 bash[29377]: audit 2021-03-10T16:59:53.851917+0000 mon.c (mon.1) 2766 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T16:59:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:59:54 gibba015 bash[29377]: audit 2021-03-10T16:59:53.852393+0000 mon.a (mon.0) 2179 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T16:59:54.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:59:54 gibba015 bash[29377]: audit 2021-03-10T16:59:53.852585+0000 mon.c (mon.1) 2767 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:59:54.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:59:54 gibba015 bash[29377]: audit 2021-03-10T16:59:53.853312+0000 mon.c (mon.1) 2768 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:59:54.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:59:54 gibba015 bash[29377]: audit 2021-03-10T16:59:53.853877+0000 mon.a (mon.0) 2180 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T16:59:54.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:59:54 gibba015 bash[29377]: audit 2021-03-10T16:59:53.855183+0000 mon.a (mon.0) 2181 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:59:54.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:59:54 gibba015 bash[29377]: audit 2021-03-10T16:59:53.855985+0000 mon.a (mon.0) 2182 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:59:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:59:54 gibba015 bash[30343]: cephadm 2021-03-10T16:59:53.160009+0000 mgr.gibba045.orlgmj (mgr.34412) 10072 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:59:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:59:54 gibba015 bash[30343]: audit 2021-03-10T16:59:53.811382+0000 mon.c (mon.1) 2763 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:59:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:59:54 gibba015 bash[30343]: audit 2021-03-10T16:59:53.812091+0000 mon.c (mon.1) 2764 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:59:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:59:54 gibba015 bash[30343]: audit 2021-03-10T16:59:53.812522+0000 mon.a (mon.0) 2177 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:59:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:59:54 gibba015 bash[30343]: audit 2021-03-10T16:59:53.813854+0000 mon.a (mon.0) 2178 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:59:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:59:54 gibba015 bash[30343]: audit 2021-03-10T16:59:53.851162+0000 mon.c (mon.1) 2765 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T16:59:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:59:54 gibba015 bash[30343]: audit 2021-03-10T16:59:53.851917+0000 mon.c (mon.1) 2766 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T16:59:54.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:59:54 gibba015 bash[30343]: audit 2021-03-10T16:59:53.852393+0000 mon.a (mon.0) 2179 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T16:59:54.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:59:54 gibba015 bash[30343]: audit 2021-03-10T16:59:53.852585+0000 mon.c (mon.1) 2767 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:59:54.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:59:54 gibba015 bash[30343]: audit 2021-03-10T16:59:53.853312+0000 mon.c (mon.1) 2768 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:59:54.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:59:54 gibba015 bash[30343]: audit 2021-03-10T16:59:53.853877+0000 mon.a (mon.0) 2180 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T16:59:54.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:59:54 gibba015 bash[30343]: audit 2021-03-10T16:59:53.855183+0000 mon.a (mon.0) 2181 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:59:54.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:59:54 gibba015 bash[30343]: audit 2021-03-10T16:59:53.855985+0000 mon.a (mon.0) 2182 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:59:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:59:54 gibba045 bash[25517]: cephadm 2021-03-10T16:59:53.160009+0000 mgr.gibba045.orlgmj (mgr.34412) 10072 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T16:59:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:59:54 gibba045 bash[25517]: audit 2021-03-10T16:59:53.811382+0000 mon.c (mon.1) 2763 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:59:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:59:54 gibba045 bash[25517]: audit 2021-03-10T16:59:53.812091+0000 mon.c (mon.1) 2764 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:59:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:59:54 gibba045 bash[25517]: audit 2021-03-10T16:59:53.812522+0000 mon.a (mon.0) 2177 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:59:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:59:54 gibba045 bash[25517]: audit 2021-03-10T16:59:53.813854+0000 mon.a (mon.0) 2178 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T16:59:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:59:54 gibba045 bash[25517]: audit 2021-03-10T16:59:53.851162+0000 mon.c (mon.1) 2765 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T16:59:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:59:54 gibba045 bash[25517]: audit 2021-03-10T16:59:53.851917+0000 mon.c (mon.1) 2766 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T16:59:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:59:54 gibba045 bash[25517]: audit 2021-03-10T16:59:53.852393+0000 mon.a (mon.0) 2179 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T16:59:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:59:54 gibba045 bash[25517]: audit 2021-03-10T16:59:53.852585+0000 mon.c (mon.1) 2767 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:59:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:59:54 gibba045 bash[25517]: audit 2021-03-10T16:59:53.853312+0000 mon.c (mon.1) 2768 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:59:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:59:54 gibba045 bash[25517]: audit 2021-03-10T16:59:53.853877+0000 mon.a (mon.0) 2180 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T16:59:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:59:54 gibba045 bash[25517]: audit 2021-03-10T16:59:53.855183+0000 mon.a (mon.0) 2181 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:59:54.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:59:54 gibba045 bash[25517]: audit 2021-03-10T16:59:53.855985+0000 mon.a (mon.0) 2182 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:59:55.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:59:55 gibba015 bash[29377]: cluster 2021-03-10T16:59:53.299301+0000 mgr.gibba045.orlgmj (mgr.34412) 10073 : cluster [DBG] pgmap v5741: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:55.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:59:55 gibba015 bash[30343]: cluster 2021-03-10T16:59:53.299301+0000 mgr.gibba045.orlgmj (mgr.34412) 10073 : cluster [DBG] pgmap v5741: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:55.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:59:55 gibba045 bash[25517]: cluster 2021-03-10T16:59:53.299301+0000 mgr.gibba045.orlgmj (mgr.34412) 10073 : cluster [DBG] pgmap v5741: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:57.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:59:57 gibba015 bash[29377]: cluster 2021-03-10T16:59:55.301047+0000 mgr.gibba045.orlgmj (mgr.34412) 10074 : cluster [DBG] pgmap v5742: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:57.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:59:57 gibba015 bash[30343]: cluster 2021-03-10T16:59:55.301047+0000 mgr.gibba045.orlgmj (mgr.34412) 10074 : cluster [DBG] pgmap v5742: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:57.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:59:57 gibba045 bash[25517]: cluster 2021-03-10T16:59:55.301047+0000 mgr.gibba045.orlgmj (mgr.34412) 10074 : cluster [DBG] pgmap v5742: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:59.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 16:59:59 gibba015 bash[29377]: cluster 2021-03-10T16:59:57.302671+0000 mgr.gibba045.orlgmj (mgr.34412) 10075 : cluster [DBG] pgmap v5743: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:59.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 16:59:59 gibba015 bash[30343]: cluster 2021-03-10T16:59:57.302671+0000 mgr.gibba045.orlgmj (mgr.34412) 10075 : cluster [DBG] pgmap v5743: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:59.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 16:59:59 gibba045 bash[25517]: cluster 2021-03-10T16:59:57.302671+0000 mgr.gibba045.orlgmj (mgr.34412) 10075 : cluster [DBG] pgmap v5743: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:00.470 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:00:00 gibba015 bash[30343]: cluster 2021-03-10T17:00:00.000290+0000 mon.a (mon.0) 2183 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T17:00:00.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:00:00 gibba015 bash[29377]: debug 2021-03-10T16:59:59.995+0000 7f21beb4f700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T17:00:00.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:00:00 gibba015 bash[29377]: cluster 2021-03-10T17:00:00.000290+0000 mon.a (mon.0) 2183 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T17:00:00.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:00:00 gibba045 bash[25517]: cluster 2021-03-10T17:00:00.000290+0000 mon.a (mon.0) 2183 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T17:00:01.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:00:01 gibba015 bash[29377]: cluster 2021-03-10T16:59:59.303906+0000 mgr.gibba045.orlgmj (mgr.34412) 10076 : cluster [DBG] pgmap v5744: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:01.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:00:01 gibba015 bash[30343]: cluster 2021-03-10T16:59:59.303906+0000 mgr.gibba045.orlgmj (mgr.34412) 10076 : cluster [DBG] pgmap v5744: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:01.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:00:01 gibba045 bash[25517]: cluster 2021-03-10T16:59:59.303906+0000 mgr.gibba045.orlgmj (mgr.34412) 10076 : cluster [DBG] pgmap v5744: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:03.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:00:03 gibba015 bash[29377]: cluster 2021-03-10T17:00:01.305711+0000 mgr.gibba045.orlgmj (mgr.34412) 10077 : cluster [DBG] pgmap v5745: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:03.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:00:03 gibba015 bash[30343]: cluster 2021-03-10T17:00:01.305711+0000 mgr.gibba045.orlgmj (mgr.34412) 10077 : cluster [DBG] pgmap v5745: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:03.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:00:03 gibba045 bash[25517]: cluster 2021-03-10T17:00:01.305711+0000 mgr.gibba045.orlgmj (mgr.34412) 10077 : cluster [DBG] pgmap v5745: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:05.055 INFO:journalctl@ceph.prometheus.a.gibba045.stdout:Mar 10 17:00:04 gibba045 bash[19791]: level=info ts=2021-03-10T17:00:04.689Z caller=compact.go:507 component=tsdb msg="write block" mint=1615384803788 maxt=1615392000000 ulid=01F0EH9J528M5Z07YS90Y4QEFZ duration=47.188618ms 2021-03-10T17:00:05.055 INFO:journalctl@ceph.prometheus.a.gibba045.stdout:Mar 10 17:00:04 gibba045 bash[19791]: level=info ts=2021-03-10T17:00:04.691Z caller=head.go:847 component=tsdb msg="Head GC completed" duration=1.553063ms 2021-03-10T17:00:05.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:00:05 gibba015 bash[29377]: cluster 2021-03-10T17:00:03.307231+0000 mgr.gibba045.orlgmj (mgr.34412) 10078 : cluster [DBG] pgmap v5746: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:05.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:00:05 gibba015 bash[30343]: cluster 2021-03-10T17:00:03.307231+0000 mgr.gibba045.orlgmj (mgr.34412) 10078 : cluster [DBG] pgmap v5746: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:05.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:00:05 gibba045 bash[25517]: cluster 2021-03-10T17:00:03.307231+0000 mgr.gibba045.orlgmj (mgr.34412) 10078 : cluster [DBG] pgmap v5746: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:07.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:00:07 gibba015 bash[29377]: cluster 2021-03-10T17:00:05.308949+0000 mgr.gibba045.orlgmj (mgr.34412) 10079 : cluster [DBG] pgmap v5747: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:07.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:00:07 gibba015 bash[30343]: cluster 2021-03-10T17:00:05.308949+0000 mgr.gibba045.orlgmj (mgr.34412) 10079 : cluster [DBG] pgmap v5747: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:07.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:00:07 gibba045 bash[25517]: cluster 2021-03-10T17:00:05.308949+0000 mgr.gibba045.orlgmj (mgr.34412) 10079 : cluster [DBG] pgmap v5747: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:09.387 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:00:09.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:00:09 gibba015 bash[29377]: cluster 2021-03-10T17:00:07.310455+0000 mgr.gibba045.orlgmj (mgr.34412) 10080 : cluster [DBG] pgmap v5748: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:09.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:00:09 gibba015 bash[29377]: audit 2021-03-10T17:00:08.174274+0000 mon.c (mon.1) 2769 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:00:09.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:00:09 gibba015 bash[29377]: cephadm 2021-03-10T17:00:08.178572+0000 mgr.gibba045.orlgmj (mgr.34412) 10081 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:00:09.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:00:09 gibba015 bash[29377]: cephadm 2021-03-10T17:00:08.179312+0000 mgr.gibba045.orlgmj (mgr.34412) 10082 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:00:09.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:00:09 gibba015 bash[29377]: audit 2021-03-10T17:00:08.393264+0000 mon.a (mon.0) 2184 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:00:09.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:00:09 gibba015 bash[29377]: audit 2021-03-10T17:00:08.397018+0000 mon.c (mon.1) 2770 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:00:09.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:00:09 gibba015 bash[29377]: audit 2021-03-10T17:00:08.398225+0000 mon.c (mon.1) 2771 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:00:09.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:00:09 gibba015 bash[29377]: audit 2021-03-10T17:00:08.399418+0000 mon.c (mon.1) 2772 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:00:09.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:00:09 gibba015 bash[29377]: audit 2021-03-10T17:00:08.400584+0000 mon.c (mon.1) 2773 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:00:09.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:00:09 gibba015 bash[29377]: audit 2021-03-10T17:00:08.403918+0000 mon.c (mon.1) 2774 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:00:09.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:00:09 gibba015 bash[29377]: audit 2021-03-10T17:00:08.405415+0000 mon.c (mon.1) 2775 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:00:09.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:00:09 gibba015 bash[30343]: cluster 2021-03-10T17:00:07.310455+0000 mgr.gibba045.orlgmj (mgr.34412) 10080 : cluster [DBG] pgmap v5748: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:09.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:00:09 gibba015 bash[30343]: audit 2021-03-10T17:00:08.174274+0000 mon.c (mon.1) 2769 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:00:09.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:00:09 gibba015 bash[30343]: cephadm 2021-03-10T17:00:08.178572+0000 mgr.gibba045.orlgmj (mgr.34412) 10081 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:00:09.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:00:09 gibba015 bash[30343]: cephadm 2021-03-10T17:00:08.179312+0000 mgr.gibba045.orlgmj (mgr.34412) 10082 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:00:09.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:00:09 gibba015 bash[30343]: audit 2021-03-10T17:00:08.393264+0000 mon.a (mon.0) 2184 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:00:09.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:00:09 gibba015 bash[30343]: audit 2021-03-10T17:00:08.397018+0000 mon.c (mon.1) 2770 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:00:09.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:00:09 gibba015 bash[30343]: audit 2021-03-10T17:00:08.398225+0000 mon.c (mon.1) 2771 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:00:09.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:00:09 gibba015 bash[30343]: audit 2021-03-10T17:00:08.399418+0000 mon.c (mon.1) 2772 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:00:09.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:00:09 gibba015 bash[30343]: audit 2021-03-10T17:00:08.400584+0000 mon.c (mon.1) 2773 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:00:09.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:00:09 gibba015 bash[30343]: audit 2021-03-10T17:00:08.403918+0000 mon.c (mon.1) 2774 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:00:09.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:00:09 gibba015 bash[30343]: audit 2021-03-10T17:00:08.405415+0000 mon.c (mon.1) 2775 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:00:09.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:00:09 gibba045 bash[25517]: cluster 2021-03-10T17:00:07.310455+0000 mgr.gibba045.orlgmj (mgr.34412) 10080 : cluster [DBG] pgmap v5748: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:09.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:00:09 gibba045 bash[25517]: audit 2021-03-10T17:00:08.174274+0000 mon.c (mon.1) 2769 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:00:09.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:00:09 gibba045 bash[25517]: cephadm 2021-03-10T17:00:08.178572+0000 mgr.gibba045.orlgmj (mgr.34412) 10081 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:00:09.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:00:09 gibba045 bash[25517]: cephadm 2021-03-10T17:00:08.179312+0000 mgr.gibba045.orlgmj (mgr.34412) 10082 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:00:09.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:00:09 gibba045 bash[25517]: audit 2021-03-10T17:00:08.393264+0000 mon.a (mon.0) 2184 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:00:09.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:00:09 gibba045 bash[25517]: audit 2021-03-10T17:00:08.397018+0000 mon.c (mon.1) 2770 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:00:09.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:00:09 gibba045 bash[25517]: audit 2021-03-10T17:00:08.398225+0000 mon.c (mon.1) 2771 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:00:09.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:00:09 gibba045 bash[25517]: audit 2021-03-10T17:00:08.399418+0000 mon.c (mon.1) 2772 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:00:09.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:00:09 gibba045 bash[25517]: audit 2021-03-10T17:00:08.400584+0000 mon.c (mon.1) 2773 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:00:09.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:00:09 gibba045 bash[25517]: audit 2021-03-10T17:00:08.403918+0000 mon.c (mon.1) 2774 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:00:09.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:00:09 gibba045 bash[25517]: audit 2021-03-10T17:00:08.405415+0000 mon.c (mon.1) 2775 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:00:09.611 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:00:09.611 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 3m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:00:09.611 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 2m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:00:09.612 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:00:09.612 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:00:09.612 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:00:09.612 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:00:09.613 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:00:09.613 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:00:09.613 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 3m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:00:09.613 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 2m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:00:09.614 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:00:09.614 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:00:09.614 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:00:09.614 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:00:09.615 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:00:09.615 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:00:09.615 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:00:09.615 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:00:09.616 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 2m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:00:09.616 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 2m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:00:09.865 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:00:09.866 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:00:09.866 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:00:09.866 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:00:09.867 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:00:09.867 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:00:09.867 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:00:09.867 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:00:09.867 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:00:09.868 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:00:09.868 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:00:09.868 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:00:09.868 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:00:09.869 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:00:09.869 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:00:10.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:00:10 gibba015 bash[29377]: cephadm 2021-03-10T17:00:08.398449+0000 mgr.gibba045.orlgmj (mgr.34412) 10083 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:00:10.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:00:10 gibba015 bash[29377]: cephadm 2021-03-10T17:00:08.400043+0000 mgr.gibba045.orlgmj (mgr.34412) 10084 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:00:10.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:00:10 gibba015 bash[29377]: cephadm 2021-03-10T17:00:08.401170+0000 mgr.gibba045.orlgmj (mgr.34412) 10085 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:00:10.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:00:10 gibba015 bash[29377]: cephadm 2021-03-10T17:00:08.401208+0000 mgr.gibba045.orlgmj (mgr.34412) 10086 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:00:10.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:00:10 gibba015 bash[29377]: cephadm 2021-03-10T17:00:08.402423+0000 mgr.gibba045.orlgmj (mgr.34412) 10087 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:00:10.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:00:10 gibba015 bash[29377]: cephadm 2021-03-10T17:00:08.402459+0000 mgr.gibba045.orlgmj (mgr.34412) 10088 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:00:10.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:00:10 gibba015 bash[29377]: cephadm 2021-03-10T17:00:08.403391+0000 mgr.gibba045.orlgmj (mgr.34412) 10089 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:00:10.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:00:10 gibba015 bash[29377]: cephadm 2021-03-10T17:00:08.405453+0000 mgr.gibba045.orlgmj (mgr.34412) 10090 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:00:10.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:00:10 gibba015 bash[29377]: cephadm 2021-03-10T17:00:08.405494+0000 mgr.gibba045.orlgmj (mgr.34412) 10091 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:00:10.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:00:10 gibba015 bash[29377]: cephadm 2021-03-10T17:00:08.406775+0000 mgr.gibba045.orlgmj (mgr.34412) 10092 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:00:10.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:00:10 gibba015 bash[29377]: cephadm 2021-03-10T17:00:08.407199+0000 mgr.gibba045.orlgmj (mgr.34412) 10093 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:00:10.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:00:10 gibba015 bash[29377]: cephadm 2021-03-10T17:00:08.408310+0000 mgr.gibba045.orlgmj (mgr.34412) 10094 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:00:10.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:00:10 gibba015 bash[29377]: cephadm 2021-03-10T17:00:08.408348+0000 mgr.gibba045.orlgmj (mgr.34412) 10095 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:00:10.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:00:10 gibba015 bash[29377]: cephadm 2021-03-10T17:00:08.408651+0000 mgr.gibba045.orlgmj (mgr.34412) 10096 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:00:10.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:00:10 gibba015 bash[29377]: audit 2021-03-10T17:00:09.865252+0000 mon.c (mon.1) 2776 : audit [DBG] from='client.? 172.21.2.115:0/920344159' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:00:10.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:00:10 gibba015 bash[30343]: cephadm 2021-03-10T17:00:08.398449+0000 mgr.gibba045.orlgmj (mgr.34412) 10083 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:00:10.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:00:10 gibba015 bash[30343]: cephadm 2021-03-10T17:00:08.400043+0000 mgr.gibba045.orlgmj (mgr.34412) 10084 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:00:10.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:00:10 gibba015 bash[30343]: cephadm 2021-03-10T17:00:08.401170+0000 mgr.gibba045.orlgmj (mgr.34412) 10085 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:00:10.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:00:10 gibba015 bash[30343]: cephadm 2021-03-10T17:00:08.401208+0000 mgr.gibba045.orlgmj (mgr.34412) 10086 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:00:10.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:00:10 gibba015 bash[30343]: cephadm 2021-03-10T17:00:08.402423+0000 mgr.gibba045.orlgmj (mgr.34412) 10087 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:00:10.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:00:10 gibba015 bash[30343]: cephadm 2021-03-10T17:00:08.402459+0000 mgr.gibba045.orlgmj (mgr.34412) 10088 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:00:10.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:00:10 gibba015 bash[30343]: cephadm 2021-03-10T17:00:08.403391+0000 mgr.gibba045.orlgmj (mgr.34412) 10089 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:00:10.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:00:10 gibba015 bash[30343]: cephadm 2021-03-10T17:00:08.405453+0000 mgr.gibba045.orlgmj (mgr.34412) 10090 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:00:10.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:00:10 gibba015 bash[30343]: cephadm 2021-03-10T17:00:08.405494+0000 mgr.gibba045.orlgmj (mgr.34412) 10091 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:00:10.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:00:10 gibba015 bash[30343]: cephadm 2021-03-10T17:00:08.406775+0000 mgr.gibba045.orlgmj (mgr.34412) 10092 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:00:10.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:00:10 gibba015 bash[30343]: cephadm 2021-03-10T17:00:08.407199+0000 mgr.gibba045.orlgmj (mgr.34412) 10093 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:00:10.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:00:10 gibba015 bash[30343]: cephadm 2021-03-10T17:00:08.408310+0000 mgr.gibba045.orlgmj (mgr.34412) 10094 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:00:10.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:00:10 gibba015 bash[30343]: cephadm 2021-03-10T17:00:08.408348+0000 mgr.gibba045.orlgmj (mgr.34412) 10095 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:00:10.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:00:10 gibba015 bash[30343]: cephadm 2021-03-10T17:00:08.408651+0000 mgr.gibba045.orlgmj (mgr.34412) 10096 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:00:10.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:00:10 gibba015 bash[30343]: audit 2021-03-10T17:00:09.865252+0000 mon.c (mon.1) 2776 : audit [DBG] from='client.? 172.21.2.115:0/920344159' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:00:10.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:00:10 gibba045 bash[25517]: cephadm 2021-03-10T17:00:08.398449+0000 mgr.gibba045.orlgmj (mgr.34412) 10083 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:00:10.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:00:10 gibba045 bash[25517]: cephadm 2021-03-10T17:00:08.400043+0000 mgr.gibba045.orlgmj (mgr.34412) 10084 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:00:10.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:00:10 gibba045 bash[25517]: cephadm 2021-03-10T17:00:08.401170+0000 mgr.gibba045.orlgmj (mgr.34412) 10085 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:00:10.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:00:10 gibba045 bash[25517]: cephadm 2021-03-10T17:00:08.401208+0000 mgr.gibba045.orlgmj (mgr.34412) 10086 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:00:10.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:00:10 gibba045 bash[25517]: cephadm 2021-03-10T17:00:08.402423+0000 mgr.gibba045.orlgmj (mgr.34412) 10087 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:00:10.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:00:10 gibba045 bash[25517]: cephadm 2021-03-10T17:00:08.402459+0000 mgr.gibba045.orlgmj (mgr.34412) 10088 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:00:10.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:00:10 gibba045 bash[25517]: cephadm 2021-03-10T17:00:08.403391+0000 mgr.gibba045.orlgmj (mgr.34412) 10089 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:00:10.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:00:10 gibba045 bash[25517]: cephadm 2021-03-10T17:00:08.405453+0000 mgr.gibba045.orlgmj (mgr.34412) 10090 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:00:10.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:00:10 gibba045 bash[25517]: cephadm 2021-03-10T17:00:08.405494+0000 mgr.gibba045.orlgmj (mgr.34412) 10091 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:00:10.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:00:10 gibba045 bash[25517]: cephadm 2021-03-10T17:00:08.406775+0000 mgr.gibba045.orlgmj (mgr.34412) 10092 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:00:10.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:00:10 gibba045 bash[25517]: cephadm 2021-03-10T17:00:08.407199+0000 mgr.gibba045.orlgmj (mgr.34412) 10093 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:00:10.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:00:10 gibba045 bash[25517]: cephadm 2021-03-10T17:00:08.408310+0000 mgr.gibba045.orlgmj (mgr.34412) 10094 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:00:10.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:00:10 gibba045 bash[25517]: cephadm 2021-03-10T17:00:08.408348+0000 mgr.gibba045.orlgmj (mgr.34412) 10095 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:00:10.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:00:10 gibba045 bash[25517]: cephadm 2021-03-10T17:00:08.408651+0000 mgr.gibba045.orlgmj (mgr.34412) 10096 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:00:10.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:00:10 gibba045 bash[25517]: audit 2021-03-10T17:00:09.865252+0000 mon.c (mon.1) 2776 : audit [DBG] from='client.? 172.21.2.115:0/920344159' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:00:11.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:00:11 gibba015 bash[29377]: cluster 2021-03-10T17:00:09.311680+0000 mgr.gibba045.orlgmj (mgr.34412) 10097 : cluster [DBG] pgmap v5749: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:11.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:00:11 gibba015 bash[29377]: audit 2021-03-10T17:00:09.377174+0000 mgr.gibba045.orlgmj (mgr.34412) 10098 : audit [DBG] from='client.60808 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:00:11.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:00:11 gibba015 bash[29377]: audit 2021-03-10T17:00:09.600669+0000 mgr.gibba045.orlgmj (mgr.34412) 10099 : audit [DBG] from='client.50826 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:00:11.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:00:11 gibba015 bash[30343]: cluster 2021-03-10T17:00:09.311680+0000 mgr.gibba045.orlgmj (mgr.34412) 10097 : cluster [DBG] pgmap v5749: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:11.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:00:11 gibba015 bash[30343]: audit 2021-03-10T17:00:09.377174+0000 mgr.gibba045.orlgmj (mgr.34412) 10098 : audit [DBG] from='client.60808 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:00:11.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:00:11 gibba015 bash[30343]: audit 2021-03-10T17:00:09.600669+0000 mgr.gibba045.orlgmj (mgr.34412) 10099 : audit [DBG] from='client.50826 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:00:11.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:00:11 gibba045 bash[25517]: cluster 2021-03-10T17:00:09.311680+0000 mgr.gibba045.orlgmj (mgr.34412) 10097 : cluster [DBG] pgmap v5749: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:11.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:00:11 gibba045 bash[25517]: audit 2021-03-10T17:00:09.377174+0000 mgr.gibba045.orlgmj (mgr.34412) 10098 : audit [DBG] from='client.60808 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:00:11.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:00:11 gibba045 bash[25517]: audit 2021-03-10T17:00:09.600669+0000 mgr.gibba045.orlgmj (mgr.34412) 10099 : audit [DBG] from='client.50826 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:00:13.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:00:13 gibba015 bash[29377]: cluster 2021-03-10T17:00:11.313458+0000 mgr.gibba045.orlgmj (mgr.34412) 10100 : cluster [DBG] pgmap v5750: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:13.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:00:13 gibba015 bash[30343]: cluster 2021-03-10T17:00:11.313458+0000 mgr.gibba045.orlgmj (mgr.34412) 10100 : cluster [DBG] pgmap v5750: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:13.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:00:13 gibba045 bash[25517]: cluster 2021-03-10T17:00:11.313458+0000 mgr.gibba045.orlgmj (mgr.34412) 10100 : cluster [DBG] pgmap v5750: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:15.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:00:15 gibba015 bash[29377]: cluster 2021-03-10T17:00:13.315048+0000 mgr.gibba045.orlgmj (mgr.34412) 10101 : cluster [DBG] pgmap v5751: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:15.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:00:15 gibba015 bash[30343]: cluster 2021-03-10T17:00:13.315048+0000 mgr.gibba045.orlgmj (mgr.34412) 10101 : cluster [DBG] pgmap v5751: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:15.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:00:15 gibba045 bash[25517]: cluster 2021-03-10T17:00:13.315048+0000 mgr.gibba045.orlgmj (mgr.34412) 10101 : cluster [DBG] pgmap v5751: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:17.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:00:17 gibba015 bash[29377]: cluster 2021-03-10T17:00:15.316784+0000 mgr.gibba045.orlgmj (mgr.34412) 10102 : cluster [DBG] pgmap v5752: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:17.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:00:17 gibba015 bash[30343]: cluster 2021-03-10T17:00:15.316784+0000 mgr.gibba045.orlgmj (mgr.34412) 10102 : cluster [DBG] pgmap v5752: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:17.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:00:17 gibba045 bash[25517]: cluster 2021-03-10T17:00:15.316784+0000 mgr.gibba045.orlgmj (mgr.34412) 10102 : cluster [DBG] pgmap v5752: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:19.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:00:19 gibba015 bash[29377]: cluster 2021-03-10T17:00:17.318600+0000 mgr.gibba045.orlgmj (mgr.34412) 10103 : cluster [DBG] pgmap v5753: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:19.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:00:19 gibba015 bash[30343]: cluster 2021-03-10T17:00:17.318600+0000 mgr.gibba045.orlgmj (mgr.34412) 10103 : cluster [DBG] pgmap v5753: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:19.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:00:19 gibba045 bash[25517]: cluster 2021-03-10T17:00:17.318600+0000 mgr.gibba045.orlgmj (mgr.34412) 10103 : cluster [DBG] pgmap v5753: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:20.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:00:20 gibba045 bash[25517]: cluster 2021-03-10T17:00:19.319819+0000 mgr.gibba045.orlgmj (mgr.34412) 10104 : cluster [DBG] pgmap v5754: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:20.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:00:20 gibba015 bash[29377]: cluster 2021-03-10T17:00:19.319819+0000 mgr.gibba045.orlgmj (mgr.34412) 10104 : cluster [DBG] pgmap v5754: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:20.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:00:20 gibba015 bash[30343]: cluster 2021-03-10T17:00:19.319819+0000 mgr.gibba045.orlgmj (mgr.34412) 10104 : cluster [DBG] pgmap v5754: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:23.423 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:00:23 gibba045 bash[25517]: cluster 2021-03-10T17:00:21.321654+0000 mgr.gibba045.orlgmj (mgr.34412) 10105 : cluster [DBG] pgmap v5755: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:23.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:00:23 gibba015 bash[29377]: cluster 2021-03-10T17:00:21.321654+0000 mgr.gibba045.orlgmj (mgr.34412) 10105 : cluster [DBG] pgmap v5755: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:23.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:00:23 gibba015 bash[30343]: cluster 2021-03-10T17:00:21.321654+0000 mgr.gibba045.orlgmj (mgr.34412) 10105 : cluster [DBG] pgmap v5755: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:25.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:00:25 gibba015 bash[29377]: cluster 2021-03-10T17:00:23.323285+0000 mgr.gibba045.orlgmj (mgr.34412) 10106 : cluster [DBG] pgmap v5756: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:25.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:00:25 gibba015 bash[29377]: cephadm 2021-03-10T17:00:23.424083+0000 mgr.gibba045.orlgmj (mgr.34412) 10107 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:00:25.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:00:25 gibba015 bash[30343]: cluster 2021-03-10T17:00:23.323285+0000 mgr.gibba045.orlgmj (mgr.34412) 10106 : cluster [DBG] pgmap v5756: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:25.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:00:25 gibba015 bash[30343]: cephadm 2021-03-10T17:00:23.424083+0000 mgr.gibba045.orlgmj (mgr.34412) 10107 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:00:25.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:00:25 gibba045 bash[25517]: cluster 2021-03-10T17:00:23.323285+0000 mgr.gibba045.orlgmj (mgr.34412) 10106 : cluster [DBG] pgmap v5756: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:25.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:00:25 gibba045 bash[25517]: cephadm 2021-03-10T17:00:23.424083+0000 mgr.gibba045.orlgmj (mgr.34412) 10107 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:00:27.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:00:27 gibba015 bash[29377]: cluster 2021-03-10T17:00:25.324939+0000 mgr.gibba045.orlgmj (mgr.34412) 10108 : cluster [DBG] pgmap v5757: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:27.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:00:27 gibba015 bash[30343]: cluster 2021-03-10T17:00:25.324939+0000 mgr.gibba045.orlgmj (mgr.34412) 10108 : cluster [DBG] pgmap v5757: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:27.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:00:27 gibba045 bash[25517]: cluster 2021-03-10T17:00:25.324939+0000 mgr.gibba045.orlgmj (mgr.34412) 10108 : cluster [DBG] pgmap v5757: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:29.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:00:29 gibba015 bash[29377]: cluster 2021-03-10T17:00:27.326712+0000 mgr.gibba045.orlgmj (mgr.34412) 10109 : cluster [DBG] pgmap v5758: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:29.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:00:29 gibba015 bash[30343]: cluster 2021-03-10T17:00:27.326712+0000 mgr.gibba045.orlgmj (mgr.34412) 10109 : cluster [DBG] pgmap v5758: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:29.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:00:29 gibba045 bash[25517]: cluster 2021-03-10T17:00:27.326712+0000 mgr.gibba045.orlgmj (mgr.34412) 10109 : cluster [DBG] pgmap v5758: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:31.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:00:31 gibba015 bash[29377]: cluster 2021-03-10T17:00:29.327870+0000 mgr.gibba045.orlgmj (mgr.34412) 10110 : cluster [DBG] pgmap v5759: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:31.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:00:31 gibba015 bash[30343]: cluster 2021-03-10T17:00:29.327870+0000 mgr.gibba045.orlgmj (mgr.34412) 10110 : cluster [DBG] pgmap v5759: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:31.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:00:31 gibba045 bash[25517]: cluster 2021-03-10T17:00:29.327870+0000 mgr.gibba045.orlgmj (mgr.34412) 10110 : cluster [DBG] pgmap v5759: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:33.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:00:33 gibba015 bash[29377]: cluster 2021-03-10T17:00:31.329647+0000 mgr.gibba045.orlgmj (mgr.34412) 10111 : cluster [DBG] pgmap v5760: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:33.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:00:33 gibba015 bash[30343]: cluster 2021-03-10T17:00:31.329647+0000 mgr.gibba045.orlgmj (mgr.34412) 10111 : cluster [DBG] pgmap v5760: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:33.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:00:33 gibba045 bash[25517]: cluster 2021-03-10T17:00:31.329647+0000 mgr.gibba045.orlgmj (mgr.34412) 10111 : cluster [DBG] pgmap v5760: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:35.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:00:35 gibba015 bash[29377]: cluster 2021-03-10T17:00:33.331406+0000 mgr.gibba045.orlgmj (mgr.34412) 10112 : cluster [DBG] pgmap v5761: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:35.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:00:35 gibba015 bash[30343]: cluster 2021-03-10T17:00:33.331406+0000 mgr.gibba045.orlgmj (mgr.34412) 10112 : cluster [DBG] pgmap v5761: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:35.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:00:35 gibba045 bash[25517]: cluster 2021-03-10T17:00:33.331406+0000 mgr.gibba045.orlgmj (mgr.34412) 10112 : cluster [DBG] pgmap v5761: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:37.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:00:37 gibba015 bash[29377]: cluster 2021-03-10T17:00:35.333294+0000 mgr.gibba045.orlgmj (mgr.34412) 10113 : cluster [DBG] pgmap v5762: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:37.505 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:00:37 gibba015 bash[30343]: cluster 2021-03-10T17:00:35.333294+0000 mgr.gibba045.orlgmj (mgr.34412) 10113 : cluster [DBG] pgmap v5762: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:37.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:00:37 gibba045 bash[25517]: cluster 2021-03-10T17:00:35.333294+0000 mgr.gibba045.orlgmj (mgr.34412) 10113 : cluster [DBG] pgmap v5762: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:39.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:00:39 gibba015 bash[29377]: cluster 2021-03-10T17:00:37.335095+0000 mgr.gibba045.orlgmj (mgr.34412) 10114 : cluster [DBG] pgmap v5763: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:39.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:00:39 gibba015 bash[30343]: cluster 2021-03-10T17:00:37.335095+0000 mgr.gibba045.orlgmj (mgr.34412) 10114 : cluster [DBG] pgmap v5763: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:39.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:00:39 gibba045 bash[25517]: cluster 2021-03-10T17:00:37.335095+0000 mgr.gibba045.orlgmj (mgr.34412) 10114 : cluster [DBG] pgmap v5763: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:40.112 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:00:40.373 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:00:40.374 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 3m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:00:40.374 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 2m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:00:40.374 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:00:40.375 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:00:40.375 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:00:40.375 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:00:40.375 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:00:40.376 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:00:40.376 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 3m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:00:40.376 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 2m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:00:40.376 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:00:40.376 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:00:40.377 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:00:40.377 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:00:40.377 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:00:40.377 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:00:40.377 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:00:40.378 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:00:40.378 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 2m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:00:40.378 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 2m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:00:40.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:00:40 gibba015 bash[29377]: cephadm 2021-03-10T17:00:38.440151+0000 mgr.gibba045.orlgmj (mgr.34412) 10115 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:00:40.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:00:40 gibba015 bash[30343]: cephadm 2021-03-10T17:00:38.440151+0000 mgr.gibba045.orlgmj (mgr.34412) 10115 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:00:40.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:00:40 gibba045 bash[25517]: cephadm 2021-03-10T17:00:38.440151+0000 mgr.gibba045.orlgmj (mgr.34412) 10115 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:00:40.624 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:00:40.624 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:00:40.624 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:00:40.625 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:00:40.625 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:00:40.625 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:00:40.625 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:00:40.625 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:00:40.626 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:00:40.626 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:00:40.626 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:00:40.626 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:00:40.627 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:00:40.627 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:00:40.627 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:00:41.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:00:41 gibba015 bash[29377]: cluster 2021-03-10T17:00:39.336358+0000 mgr.gibba045.orlgmj (mgr.34412) 10116 : cluster [DBG] pgmap v5764: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:41.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:00:41 gibba015 bash[29377]: audit 2021-03-10T17:00:40.104082+0000 mgr.gibba045.orlgmj (mgr.34412) 10117 : audit [DBG] from='client.60826 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:00:41.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:00:41 gibba015 bash[29377]: audit 2021-03-10T17:00:40.623504+0000 mon.c (mon.1) 2777 : audit [DBG] from='client.? 172.21.2.115:0/1376108199' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:00:41.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:00:41 gibba015 bash[30343]: cluster 2021-03-10T17:00:39.336358+0000 mgr.gibba045.orlgmj (mgr.34412) 10116 : cluster [DBG] pgmap v5764: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:41.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:00:41 gibba015 bash[30343]: audit 2021-03-10T17:00:40.104082+0000 mgr.gibba045.orlgmj (mgr.34412) 10117 : audit [DBG] from='client.60826 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:00:41.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:00:41 gibba015 bash[30343]: audit 2021-03-10T17:00:40.623504+0000 mon.c (mon.1) 2777 : audit [DBG] from='client.? 172.21.2.115:0/1376108199' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:00:41.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:00:41 gibba045 bash[25517]: cluster 2021-03-10T17:00:39.336358+0000 mgr.gibba045.orlgmj (mgr.34412) 10116 : cluster [DBG] pgmap v5764: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:41.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:00:41 gibba045 bash[25517]: audit 2021-03-10T17:00:40.104082+0000 mgr.gibba045.orlgmj (mgr.34412) 10117 : audit [DBG] from='client.60826 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:00:41.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:00:41 gibba045 bash[25517]: audit 2021-03-10T17:00:40.623504+0000 mon.c (mon.1) 2777 : audit [DBG] from='client.? 172.21.2.115:0/1376108199' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:00:42.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:00:42 gibba015 bash[29377]: audit 2021-03-10T17:00:40.332706+0000 mgr.gibba045.orlgmj (mgr.34412) 10118 : audit [DBG] from='client.50844 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:00:42.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:00:42 gibba015 bash[30343]: audit 2021-03-10T17:00:40.332706+0000 mgr.gibba045.orlgmj (mgr.34412) 10118 : audit [DBG] from='client.50844 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:00:42.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:00:42 gibba045 bash[25517]: audit 2021-03-10T17:00:40.332706+0000 mgr.gibba045.orlgmj (mgr.34412) 10118 : audit [DBG] from='client.50844 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:00:43.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:00:43 gibba015 bash[29377]: cluster 2021-03-10T17:00:41.338110+0000 mgr.gibba045.orlgmj (mgr.34412) 10119 : cluster [DBG] pgmap v5765: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:43.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:00:43 gibba015 bash[30343]: cluster 2021-03-10T17:00:41.338110+0000 mgr.gibba045.orlgmj (mgr.34412) 10119 : cluster [DBG] pgmap v5765: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:43.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:00:43 gibba045 bash[25517]: cluster 2021-03-10T17:00:41.338110+0000 mgr.gibba045.orlgmj (mgr.34412) 10119 : cluster [DBG] pgmap v5765: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:45.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:00:45 gibba015 bash[29377]: cluster 2021-03-10T17:00:43.339731+0000 mgr.gibba045.orlgmj (mgr.34412) 10120 : cluster [DBG] pgmap v5766: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:45.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:00:45 gibba015 bash[30343]: cluster 2021-03-10T17:00:43.339731+0000 mgr.gibba045.orlgmj (mgr.34412) 10120 : cluster [DBG] pgmap v5766: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:45.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:00:45 gibba045 bash[25517]: cluster 2021-03-10T17:00:43.339731+0000 mgr.gibba045.orlgmj (mgr.34412) 10120 : cluster [DBG] pgmap v5766: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:47.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:00:47 gibba015 bash[29377]: cluster 2021-03-10T17:00:45.341438+0000 mgr.gibba045.orlgmj (mgr.34412) 10121 : cluster [DBG] pgmap v5767: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:47.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:00:47 gibba015 bash[30343]: cluster 2021-03-10T17:00:45.341438+0000 mgr.gibba045.orlgmj (mgr.34412) 10121 : cluster [DBG] pgmap v5767: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:47.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:00:47 gibba045 bash[25517]: cluster 2021-03-10T17:00:45.341438+0000 mgr.gibba045.orlgmj (mgr.34412) 10121 : cluster [DBG] pgmap v5767: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:49.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:00:49 gibba015 bash[29377]: cluster 2021-03-10T17:00:47.342907+0000 mgr.gibba045.orlgmj (mgr.34412) 10122 : cluster [DBG] pgmap v5768: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:49.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:00:49 gibba015 bash[30343]: cluster 2021-03-10T17:00:47.342907+0000 mgr.gibba045.orlgmj (mgr.34412) 10122 : cluster [DBG] pgmap v5768: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:49.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:00:49 gibba045 bash[25517]: cluster 2021-03-10T17:00:47.342907+0000 mgr.gibba045.orlgmj (mgr.34412) 10122 : cluster [DBG] pgmap v5768: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:51.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:00:51 gibba015 bash[29377]: cluster 2021-03-10T17:00:49.344152+0000 mgr.gibba045.orlgmj (mgr.34412) 10123 : cluster [DBG] pgmap v5769: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:51.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:00:51 gibba015 bash[30343]: cluster 2021-03-10T17:00:49.344152+0000 mgr.gibba045.orlgmj (mgr.34412) 10123 : cluster [DBG] pgmap v5769: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:51.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:00:51 gibba045 bash[25517]: cluster 2021-03-10T17:00:49.344152+0000 mgr.gibba045.orlgmj (mgr.34412) 10123 : cluster [DBG] pgmap v5769: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:53.444 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:00:53 gibba045 bash[25517]: cluster 2021-03-10T17:00:51.345890+0000 mgr.gibba045.orlgmj (mgr.34412) 10124 : cluster [DBG] pgmap v5770: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:53.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:00:53 gibba015 bash[29377]: cluster 2021-03-10T17:00:51.345890+0000 mgr.gibba045.orlgmj (mgr.34412) 10124 : cluster [DBG] pgmap v5770: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:53.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:00:53 gibba015 bash[30343]: cluster 2021-03-10T17:00:51.345890+0000 mgr.gibba045.orlgmj (mgr.34412) 10124 : cluster [DBG] pgmap v5770: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:00:54 gibba015 bash[29377]: audit 2021-03-10T17:00:53.817880+0000 mon.c (mon.1) 2778 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:00:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:00:54 gibba015 bash[29377]: audit 2021-03-10T17:00:53.819019+0000 mon.a (mon.0) 2185 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:00:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:00:54 gibba015 bash[29377]: audit 2021-03-10T17:00:53.821597+0000 mon.c (mon.1) 2779 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:00:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:00:54 gibba015 bash[29377]: audit 2021-03-10T17:00:53.822753+0000 mon.a (mon.0) 2186 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:00:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:00:54 gibba015 bash[29377]: audit 2021-03-10T17:00:53.861672+0000 mon.c (mon.1) 2780 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T17:00:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:00:54 gibba015 bash[29377]: audit 2021-03-10T17:00:53.862403+0000 mon.c (mon.1) 2781 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:00:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:00:54 gibba015 bash[29377]: audit 2021-03-10T17:00:53.862913+0000 mon.a (mon.0) 2187 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T17:00:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:00:54 gibba015 bash[29377]: audit 2021-03-10T17:00:53.863098+0000 mon.c (mon.1) 2782 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:00:54.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:00:54 gibba015 bash[29377]: audit 2021-03-10T17:00:53.863825+0000 mon.c (mon.1) 2783 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T17:00:54.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:00:54 gibba015 bash[29377]: audit 2021-03-10T17:00:53.864362+0000 mon.a (mon.0) 2188 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:00:54.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:00:54 gibba015 bash[29377]: audit 2021-03-10T17:00:53.865441+0000 mon.a (mon.0) 2189 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:00:54.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:00:54 gibba015 bash[29377]: audit 2021-03-10T17:00:53.866274+0000 mon.a (mon.0) 2190 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T17:00:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:00:54 gibba015 bash[30343]: audit 2021-03-10T17:00:53.817880+0000 mon.c (mon.1) 2778 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:00:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:00:54 gibba015 bash[30343]: audit 2021-03-10T17:00:53.819019+0000 mon.a (mon.0) 2185 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:00:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:00:54 gibba015 bash[30343]: audit 2021-03-10T17:00:53.821597+0000 mon.c (mon.1) 2779 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:00:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:00:54 gibba015 bash[30343]: audit 2021-03-10T17:00:53.822753+0000 mon.a (mon.0) 2186 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:00:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:00:54 gibba015 bash[30343]: audit 2021-03-10T17:00:53.861672+0000 mon.c (mon.1) 2780 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T17:00:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:00:54 gibba015 bash[30343]: audit 2021-03-10T17:00:53.862403+0000 mon.c (mon.1) 2781 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:00:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:00:54 gibba015 bash[30343]: audit 2021-03-10T17:00:53.862913+0000 mon.a (mon.0) 2187 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T17:00:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:00:54 gibba015 bash[30343]: audit 2021-03-10T17:00:53.863098+0000 mon.c (mon.1) 2782 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:00:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:00:54 gibba015 bash[30343]: audit 2021-03-10T17:00:53.863825+0000 mon.c (mon.1) 2783 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T17:00:54.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:00:54 gibba015 bash[30343]: audit 2021-03-10T17:00:53.864362+0000 mon.a (mon.0) 2188 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:00:54.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:00:54 gibba015 bash[30343]: audit 2021-03-10T17:00:53.865441+0000 mon.a (mon.0) 2189 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:00:54.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:00:54 gibba015 bash[30343]: audit 2021-03-10T17:00:53.866274+0000 mon.a (mon.0) 2190 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T17:00:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:00:54 gibba045 bash[25517]: audit 2021-03-10T17:00:53.817880+0000 mon.c (mon.1) 2778 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:00:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:00:54 gibba045 bash[25517]: audit 2021-03-10T17:00:53.819019+0000 mon.a (mon.0) 2185 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:00:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:00:54 gibba045 bash[25517]: audit 2021-03-10T17:00:53.821597+0000 mon.c (mon.1) 2779 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:00:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:00:54 gibba045 bash[25517]: audit 2021-03-10T17:00:53.822753+0000 mon.a (mon.0) 2186 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:00:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:00:54 gibba045 bash[25517]: audit 2021-03-10T17:00:53.861672+0000 mon.c (mon.1) 2780 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T17:00:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:00:54 gibba045 bash[25517]: audit 2021-03-10T17:00:53.862403+0000 mon.c (mon.1) 2781 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:00:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:00:54 gibba045 bash[25517]: audit 2021-03-10T17:00:53.862913+0000 mon.a (mon.0) 2187 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T17:00:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:00:54 gibba045 bash[25517]: audit 2021-03-10T17:00:53.863098+0000 mon.c (mon.1) 2782 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:00:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:00:54 gibba045 bash[25517]: audit 2021-03-10T17:00:53.863825+0000 mon.c (mon.1) 2783 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T17:00:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:00:54 gibba045 bash[25517]: audit 2021-03-10T17:00:53.864362+0000 mon.a (mon.0) 2188 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:00:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:00:54 gibba045 bash[25517]: audit 2021-03-10T17:00:53.865441+0000 mon.a (mon.0) 2189 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:00:54.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:00:54 gibba045 bash[25517]: audit 2021-03-10T17:00:53.866274+0000 mon.a (mon.0) 2190 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T17:00:55.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:00:55 gibba015 bash[29377]: cluster 2021-03-10T17:00:53.347597+0000 mgr.gibba045.orlgmj (mgr.34412) 10125 : cluster [DBG] pgmap v5771: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:55.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:00:55 gibba015 bash[29377]: cephadm 2021-03-10T17:00:53.445492+0000 mgr.gibba045.orlgmj (mgr.34412) 10126 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:00:55.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:00:55 gibba015 bash[30343]: cluster 2021-03-10T17:00:53.347597+0000 mgr.gibba045.orlgmj (mgr.34412) 10125 : cluster [DBG] pgmap v5771: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:55.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:00:55 gibba015 bash[30343]: cephadm 2021-03-10T17:00:53.445492+0000 mgr.gibba045.orlgmj (mgr.34412) 10126 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:00:55.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:00:55 gibba045 bash[25517]: cluster 2021-03-10T17:00:53.347597+0000 mgr.gibba045.orlgmj (mgr.34412) 10125 : cluster [DBG] pgmap v5771: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:55.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:00:55 gibba045 bash[25517]: cephadm 2021-03-10T17:00:53.445492+0000 mgr.gibba045.orlgmj (mgr.34412) 10126 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:00:57.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:00:57 gibba015 bash[29377]: cluster 2021-03-10T17:00:55.349113+0000 mgr.gibba045.orlgmj (mgr.34412) 10127 : cluster [DBG] pgmap v5772: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:57.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:00:57 gibba015 bash[30343]: cluster 2021-03-10T17:00:55.349113+0000 mgr.gibba045.orlgmj (mgr.34412) 10127 : cluster [DBG] pgmap v5772: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:57.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:00:57 gibba045 bash[25517]: cluster 2021-03-10T17:00:55.349113+0000 mgr.gibba045.orlgmj (mgr.34412) 10127 : cluster [DBG] pgmap v5772: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:59.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:00:59 gibba015 bash[29377]: cluster 2021-03-10T17:00:57.350909+0000 mgr.gibba045.orlgmj (mgr.34412) 10128 : cluster [DBG] pgmap v5773: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:59.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:00:59 gibba015 bash[30343]: cluster 2021-03-10T17:00:57.350909+0000 mgr.gibba045.orlgmj (mgr.34412) 10128 : cluster [DBG] pgmap v5773: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:59.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:00:59 gibba045 bash[25517]: cluster 2021-03-10T17:00:57.350909+0000 mgr.gibba045.orlgmj (mgr.34412) 10128 : cluster [DBG] pgmap v5773: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:01.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:01:01 gibba015 bash[29377]: cluster 2021-03-10T17:00:59.352142+0000 mgr.gibba045.orlgmj (mgr.34412) 10129 : cluster [DBG] pgmap v5774: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:01.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:01:01 gibba015 bash[30343]: cluster 2021-03-10T17:00:59.352142+0000 mgr.gibba045.orlgmj (mgr.34412) 10129 : cluster [DBG] pgmap v5774: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:01.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:01:01 gibba045 bash[25517]: cluster 2021-03-10T17:00:59.352142+0000 mgr.gibba045.orlgmj (mgr.34412) 10129 : cluster [DBG] pgmap v5774: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:03.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:01:03 gibba015 bash[29377]: cluster 2021-03-10T17:01:01.353881+0000 mgr.gibba045.orlgmj (mgr.34412) 10130 : cluster [DBG] pgmap v5775: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:03.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:01:03 gibba015 bash[30343]: cluster 2021-03-10T17:01:01.353881+0000 mgr.gibba045.orlgmj (mgr.34412) 10130 : cluster [DBG] pgmap v5775: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:03.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:01:03 gibba045 bash[25517]: cluster 2021-03-10T17:01:01.353881+0000 mgr.gibba045.orlgmj (mgr.34412) 10130 : cluster [DBG] pgmap v5775: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:05.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:01:05 gibba015 bash[29377]: cluster 2021-03-10T17:01:03.355598+0000 mgr.gibba045.orlgmj (mgr.34412) 10131 : cluster [DBG] pgmap v5776: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:05.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:01:05 gibba015 bash[30343]: cluster 2021-03-10T17:01:03.355598+0000 mgr.gibba045.orlgmj (mgr.34412) 10131 : cluster [DBG] pgmap v5776: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:05.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:01:05 gibba045 bash[25517]: cluster 2021-03-10T17:01:03.355598+0000 mgr.gibba045.orlgmj (mgr.34412) 10131 : cluster [DBG] pgmap v5776: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:07.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:01:07 gibba015 bash[29377]: cluster 2021-03-10T17:01:05.357168+0000 mgr.gibba045.orlgmj (mgr.34412) 10132 : cluster [DBG] pgmap v5777: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:07.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:01:07 gibba015 bash[30343]: cluster 2021-03-10T17:01:05.357168+0000 mgr.gibba045.orlgmj (mgr.34412) 10132 : cluster [DBG] pgmap v5777: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:07.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:01:07 gibba045 bash[25517]: cluster 2021-03-10T17:01:05.357168+0000 mgr.gibba045.orlgmj (mgr.34412) 10132 : cluster [DBG] pgmap v5777: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:09.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:01:09 gibba015 bash[29377]: cluster 2021-03-10T17:01:07.358913+0000 mgr.gibba045.orlgmj (mgr.34412) 10133 : cluster [DBG] pgmap v5778: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:09.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:01:09 gibba015 bash[29377]: audit 2021-03-10T17:01:08.448350+0000 mon.c (mon.1) 2784 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:01:09.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:01:09 gibba015 bash[29377]: audit 2021-03-10T17:01:08.718494+0000 mon.a (mon.0) 2191 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:01:09.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:01:09 gibba015 bash[29377]: audit 2021-03-10T17:01:08.722785+0000 mon.c (mon.1) 2785 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:01:09.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:01:09 gibba015 bash[29377]: audit 2021-03-10T17:01:08.724542+0000 mon.c (mon.1) 2786 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:01:09.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:01:09 gibba015 bash[29377]: audit 2021-03-10T17:01:08.725901+0000 mon.c (mon.1) 2787 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:01:09.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:01:09 gibba015 bash[29377]: audit 2021-03-10T17:01:08.727285+0000 mon.c (mon.1) 2788 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:01:09.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:01:09 gibba015 bash[29377]: audit 2021-03-10T17:01:08.730574+0000 mon.c (mon.1) 2789 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:01:09.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:01:09 gibba015 bash[29377]: audit 2021-03-10T17:01:08.732549+0000 mon.c (mon.1) 2790 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:01:09.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:01:09 gibba015 bash[30343]: cluster 2021-03-10T17:01:07.358913+0000 mgr.gibba045.orlgmj (mgr.34412) 10133 : cluster [DBG] pgmap v5778: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:09.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:01:09 gibba015 bash[30343]: audit 2021-03-10T17:01:08.448350+0000 mon.c (mon.1) 2784 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:01:09.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:01:09 gibba015 bash[30343]: audit 2021-03-10T17:01:08.718494+0000 mon.a (mon.0) 2191 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:01:09.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:01:09 gibba015 bash[30343]: audit 2021-03-10T17:01:08.722785+0000 mon.c (mon.1) 2785 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:01:09.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:01:09 gibba015 bash[30343]: audit 2021-03-10T17:01:08.724542+0000 mon.c (mon.1) 2786 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:01:09.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:01:09 gibba015 bash[30343]: audit 2021-03-10T17:01:08.725901+0000 mon.c (mon.1) 2787 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:01:09.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:01:09 gibba015 bash[30343]: audit 2021-03-10T17:01:08.727285+0000 mon.c (mon.1) 2788 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:01:09.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:01:09 gibba015 bash[30343]: audit 2021-03-10T17:01:08.730574+0000 mon.c (mon.1) 2789 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:01:09.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:01:09 gibba015 bash[30343]: audit 2021-03-10T17:01:08.732549+0000 mon.c (mon.1) 2790 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:01:09.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:01:09 gibba045 bash[25517]: cluster 2021-03-10T17:01:07.358913+0000 mgr.gibba045.orlgmj (mgr.34412) 10133 : cluster [DBG] pgmap v5778: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:09.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:01:09 gibba045 bash[25517]: audit 2021-03-10T17:01:08.448350+0000 mon.c (mon.1) 2784 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:01:09.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:01:09 gibba045 bash[25517]: audit 2021-03-10T17:01:08.718494+0000 mon.a (mon.0) 2191 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:01:09.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:01:09 gibba045 bash[25517]: audit 2021-03-10T17:01:08.722785+0000 mon.c (mon.1) 2785 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:01:09.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:01:09 gibba045 bash[25517]: audit 2021-03-10T17:01:08.724542+0000 mon.c (mon.1) 2786 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:01:09.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:01:09 gibba045 bash[25517]: audit 2021-03-10T17:01:08.725901+0000 mon.c (mon.1) 2787 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:01:09.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:01:09 gibba045 bash[25517]: audit 2021-03-10T17:01:08.727285+0000 mon.c (mon.1) 2788 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:01:09.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:01:09 gibba045 bash[25517]: audit 2021-03-10T17:01:08.730574+0000 mon.c (mon.1) 2789 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:01:09.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:01:09 gibba045 bash[25517]: audit 2021-03-10T17:01:08.732549+0000 mon.c (mon.1) 2790 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:01:10.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:01:10 gibba015 bash[29377]: cephadm 2021-03-10T17:01:08.456352+0000 mgr.gibba045.orlgmj (mgr.34412) 10134 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:01:10.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:01:10 gibba015 bash[29377]: cephadm 2021-03-10T17:01:08.457915+0000 mgr.gibba045.orlgmj (mgr.34412) 10135 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:01:10.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:01:10 gibba015 bash[29377]: cephadm 2021-03-10T17:01:08.723966+0000 mgr.gibba045.orlgmj (mgr.34412) 10136 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:01:10.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:01:10 gibba015 bash[29377]: cephadm 2021-03-10T17:01:08.726097+0000 mgr.gibba045.orlgmj (mgr.34412) 10137 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:01:10.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:01:10 gibba015 bash[29377]: cephadm 2021-03-10T17:01:08.727542+0000 mgr.gibba045.orlgmj (mgr.34412) 10138 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:01:10.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:01:10 gibba015 bash[29377]: cephadm 2021-03-10T17:01:08.727620+0000 mgr.gibba045.orlgmj (mgr.34412) 10139 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:01:10.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:01:10 gibba015 bash[29377]: cephadm 2021-03-10T17:01:08.728863+0000 mgr.gibba045.orlgmj (mgr.34412) 10140 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:01:10.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:01:10 gibba015 bash[29377]: cephadm 2021-03-10T17:01:08.728942+0000 mgr.gibba045.orlgmj (mgr.34412) 10141 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:01:10.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:01:10 gibba015 bash[29377]: cephadm 2021-03-10T17:01:08.730187+0000 mgr.gibba045.orlgmj (mgr.34412) 10142 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:01:10.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:01:10 gibba015 bash[29377]: cephadm 2021-03-10T17:01:08.731912+0000 mgr.gibba045.orlgmj (mgr.34412) 10143 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:01:10.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:01:10 gibba015 bash[29377]: cephadm 2021-03-10T17:01:08.731993+0000 mgr.gibba045.orlgmj (mgr.34412) 10144 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:01:10.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:01:10 gibba015 bash[29377]: cephadm 2021-03-10T17:01:08.733714+0000 mgr.gibba045.orlgmj (mgr.34412) 10145 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:01:10.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:01:10 gibba015 bash[29377]: cephadm 2021-03-10T17:01:08.734189+0000 mgr.gibba045.orlgmj (mgr.34412) 10146 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:01:10.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:01:10 gibba015 bash[29377]: cephadm 2021-03-10T17:01:08.735867+0000 mgr.gibba045.orlgmj (mgr.34412) 10147 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:01:10.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:01:10 gibba015 bash[29377]: cephadm 2021-03-10T17:01:08.735961+0000 mgr.gibba045.orlgmj (mgr.34412) 10148 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:01:10.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:01:10 gibba015 bash[29377]: cephadm 2021-03-10T17:01:08.736168+0000 mgr.gibba045.orlgmj (mgr.34412) 10149 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:01:10.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:01:10 gibba015 bash[30343]: cephadm 2021-03-10T17:01:08.456352+0000 mgr.gibba045.orlgmj (mgr.34412) 10134 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:01:10.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:01:10 gibba015 bash[30343]: cephadm 2021-03-10T17:01:08.457915+0000 mgr.gibba045.orlgmj (mgr.34412) 10135 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:01:10.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:01:10 gibba015 bash[30343]: cephadm 2021-03-10T17:01:08.723966+0000 mgr.gibba045.orlgmj (mgr.34412) 10136 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:01:10.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:01:10 gibba015 bash[30343]: cephadm 2021-03-10T17:01:08.726097+0000 mgr.gibba045.orlgmj (mgr.34412) 10137 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:01:10.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:01:10 gibba015 bash[30343]: cephadm 2021-03-10T17:01:08.727542+0000 mgr.gibba045.orlgmj (mgr.34412) 10138 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:01:10.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:01:10 gibba015 bash[30343]: cephadm 2021-03-10T17:01:08.727620+0000 mgr.gibba045.orlgmj (mgr.34412) 10139 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:01:10.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:01:10 gibba015 bash[30343]: cephadm 2021-03-10T17:01:08.728863+0000 mgr.gibba045.orlgmj (mgr.34412) 10140 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:01:10.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:01:10 gibba015 bash[30343]: cephadm 2021-03-10T17:01:08.728942+0000 mgr.gibba045.orlgmj (mgr.34412) 10141 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:01:10.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:01:10 gibba015 bash[30343]: cephadm 2021-03-10T17:01:08.730187+0000 mgr.gibba045.orlgmj (mgr.34412) 10142 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:01:10.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:01:10 gibba015 bash[30343]: cephadm 2021-03-10T17:01:08.731912+0000 mgr.gibba045.orlgmj (mgr.34412) 10143 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:01:10.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:01:10 gibba015 bash[30343]: cephadm 2021-03-10T17:01:08.731993+0000 mgr.gibba045.orlgmj (mgr.34412) 10144 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:01:10.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:01:10 gibba015 bash[30343]: cephadm 2021-03-10T17:01:08.733714+0000 mgr.gibba045.orlgmj (mgr.34412) 10145 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:01:10.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:01:10 gibba015 bash[30343]: cephadm 2021-03-10T17:01:08.734189+0000 mgr.gibba045.orlgmj (mgr.34412) 10146 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:01:10.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:01:10 gibba015 bash[30343]: cephadm 2021-03-10T17:01:08.735867+0000 mgr.gibba045.orlgmj (mgr.34412) 10147 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:01:10.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:01:10 gibba015 bash[30343]: cephadm 2021-03-10T17:01:08.735961+0000 mgr.gibba045.orlgmj (mgr.34412) 10148 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:01:10.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:01:10 gibba015 bash[30343]: cephadm 2021-03-10T17:01:08.736168+0000 mgr.gibba045.orlgmj (mgr.34412) 10149 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:01:10.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:01:10 gibba045 bash[25517]: cephadm 2021-03-10T17:01:08.456352+0000 mgr.gibba045.orlgmj (mgr.34412) 10134 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:01:10.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:01:10 gibba045 bash[25517]: cephadm 2021-03-10T17:01:08.457915+0000 mgr.gibba045.orlgmj (mgr.34412) 10135 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:01:10.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:01:10 gibba045 bash[25517]: cephadm 2021-03-10T17:01:08.723966+0000 mgr.gibba045.orlgmj (mgr.34412) 10136 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:01:10.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:01:10 gibba045 bash[25517]: cephadm 2021-03-10T17:01:08.726097+0000 mgr.gibba045.orlgmj (mgr.34412) 10137 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:01:10.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:01:10 gibba045 bash[25517]: cephadm 2021-03-10T17:01:08.727542+0000 mgr.gibba045.orlgmj (mgr.34412) 10138 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:01:10.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:01:10 gibba045 bash[25517]: cephadm 2021-03-10T17:01:08.727620+0000 mgr.gibba045.orlgmj (mgr.34412) 10139 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:01:10.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:01:10 gibba045 bash[25517]: cephadm 2021-03-10T17:01:08.728863+0000 mgr.gibba045.orlgmj (mgr.34412) 10140 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:01:10.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:01:10 gibba045 bash[25517]: cephadm 2021-03-10T17:01:08.728942+0000 mgr.gibba045.orlgmj (mgr.34412) 10141 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:01:10.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:01:10 gibba045 bash[25517]: cephadm 2021-03-10T17:01:08.730187+0000 mgr.gibba045.orlgmj (mgr.34412) 10142 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:01:10.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:01:10 gibba045 bash[25517]: cephadm 2021-03-10T17:01:08.731912+0000 mgr.gibba045.orlgmj (mgr.34412) 10143 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:01:10.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:01:10 gibba045 bash[25517]: cephadm 2021-03-10T17:01:08.731993+0000 mgr.gibba045.orlgmj (mgr.34412) 10144 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:01:10.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:01:10 gibba045 bash[25517]: cephadm 2021-03-10T17:01:08.733714+0000 mgr.gibba045.orlgmj (mgr.34412) 10145 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:01:10.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:01:10 gibba045 bash[25517]: cephadm 2021-03-10T17:01:08.734189+0000 mgr.gibba045.orlgmj (mgr.34412) 10146 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:01:10.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:01:10 gibba045 bash[25517]: cephadm 2021-03-10T17:01:08.735867+0000 mgr.gibba045.orlgmj (mgr.34412) 10147 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:01:10.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:01:10 gibba045 bash[25517]: cephadm 2021-03-10T17:01:08.735961+0000 mgr.gibba045.orlgmj (mgr.34412) 10148 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:01:10.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:01:10 gibba045 bash[25517]: cephadm 2021-03-10T17:01:08.736168+0000 mgr.gibba045.orlgmj (mgr.34412) 10149 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:01:10.866 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:01:11.093 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:01:11.093 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 4m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:01:11.094 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 3m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:01:11.094 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:01:11.095 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:01:11.095 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:01:11.095 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:01:11.096 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:01:11.096 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:01:11.098 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 4m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:01:11.098 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 3m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:01:11.098 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:01:11.099 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:01:11.099 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:01:11.099 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:01:11.100 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:01:11.100 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:01:11.101 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:01:11.101 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:01:11.101 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 3m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:01:11.101 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 3m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:01:11.345 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:01:11.346 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:01:11.346 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:01:11.346 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:01:11.346 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:01:11.347 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:01:11.347 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:01:11.347 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:01:11.347 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:01:11.348 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:01:11.348 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:01:11.348 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:01:11.348 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:01:11.349 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:01:11.349 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:01:11.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:01:11 gibba015 bash[29377]: cluster 2021-03-10T17:01:09.360158+0000 mgr.gibba045.orlgmj (mgr.34412) 10150 : cluster [DBG] pgmap v5779: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:11.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:01:11 gibba015 bash[30343]: cluster 2021-03-10T17:01:09.360158+0000 mgr.gibba045.orlgmj (mgr.34412) 10150 : cluster [DBG] pgmap v5779: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:11.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:01:11 gibba045 bash[25517]: cluster 2021-03-10T17:01:09.360158+0000 mgr.gibba045.orlgmj (mgr.34412) 10150 : cluster [DBG] pgmap v5779: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:12.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:01:12 gibba015 bash[29377]: audit 2021-03-10T17:01:10.858650+0000 mgr.gibba045.orlgmj (mgr.34412) 10151 : audit [DBG] from='client.50856 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:01:12.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:01:12 gibba015 bash[29377]: audit 2021-03-10T17:01:11.082065+0000 mgr.gibba045.orlgmj (mgr.34412) 10152 : audit [DBG] from='client.60850 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:01:12.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:01:12 gibba015 bash[29377]: audit 2021-03-10T17:01:11.344683+0000 mon.a (mon.0) 2192 : audit [DBG] from='client.? 172.21.2.115:0/1368663746' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:01:12.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:01:12 gibba015 bash[30343]: audit 2021-03-10T17:01:10.858650+0000 mgr.gibba045.orlgmj (mgr.34412) 10151 : audit [DBG] from='client.50856 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:01:12.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:01:12 gibba015 bash[30343]: audit 2021-03-10T17:01:11.082065+0000 mgr.gibba045.orlgmj (mgr.34412) 10152 : audit [DBG] from='client.60850 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:01:12.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:01:12 gibba015 bash[30343]: audit 2021-03-10T17:01:11.344683+0000 mon.a (mon.0) 2192 : audit [DBG] from='client.? 172.21.2.115:0/1368663746' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:01:12.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:01:12 gibba045 bash[25517]: audit 2021-03-10T17:01:10.858650+0000 mgr.gibba045.orlgmj (mgr.34412) 10151 : audit [DBG] from='client.50856 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:01:12.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:01:12 gibba045 bash[25517]: audit 2021-03-10T17:01:11.082065+0000 mgr.gibba045.orlgmj (mgr.34412) 10152 : audit [DBG] from='client.60850 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:01:12.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:01:12 gibba045 bash[25517]: audit 2021-03-10T17:01:11.344683+0000 mon.a (mon.0) 2192 : audit [DBG] from='client.? 172.21.2.115:0/1368663746' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:01:13.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:01:13 gibba015 bash[29377]: cluster 2021-03-10T17:01:11.361719+0000 mgr.gibba045.orlgmj (mgr.34412) 10153 : cluster [DBG] pgmap v5780: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:13.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:01:13 gibba015 bash[30343]: cluster 2021-03-10T17:01:11.361719+0000 mgr.gibba045.orlgmj (mgr.34412) 10153 : cluster [DBG] pgmap v5780: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:13.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:01:13 gibba045 bash[25517]: cluster 2021-03-10T17:01:11.361719+0000 mgr.gibba045.orlgmj (mgr.34412) 10153 : cluster [DBG] pgmap v5780: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:15.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:01:15 gibba015 bash[29377]: cluster 2021-03-10T17:01:13.363388+0000 mgr.gibba045.orlgmj (mgr.34412) 10154 : cluster [DBG] pgmap v5781: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:15.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:01:15 gibba015 bash[30343]: cluster 2021-03-10T17:01:13.363388+0000 mgr.gibba045.orlgmj (mgr.34412) 10154 : cluster [DBG] pgmap v5781: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:15.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:01:15 gibba045 bash[25517]: cluster 2021-03-10T17:01:13.363388+0000 mgr.gibba045.orlgmj (mgr.34412) 10154 : cluster [DBG] pgmap v5781: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:17.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:01:17 gibba015 bash[29377]: cluster 2021-03-10T17:01:15.364919+0000 mgr.gibba045.orlgmj (mgr.34412) 10155 : cluster [DBG] pgmap v5782: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:17.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:01:17 gibba015 bash[30343]: cluster 2021-03-10T17:01:15.364919+0000 mgr.gibba045.orlgmj (mgr.34412) 10155 : cluster [DBG] pgmap v5782: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:17.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:01:17 gibba045 bash[25517]: cluster 2021-03-10T17:01:15.364919+0000 mgr.gibba045.orlgmj (mgr.34412) 10155 : cluster [DBG] pgmap v5782: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:18.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:01:18 gibba045 bash[25517]: cluster 2021-03-10T17:01:17.366652+0000 mgr.gibba045.orlgmj (mgr.34412) 10156 : cluster [DBG] pgmap v5783: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:18.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:01:18 gibba015 bash[29377]: cluster 2021-03-10T17:01:17.366652+0000 mgr.gibba045.orlgmj (mgr.34412) 10156 : cluster [DBG] pgmap v5783: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:18.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:01:18 gibba015 bash[30343]: cluster 2021-03-10T17:01:17.366652+0000 mgr.gibba045.orlgmj (mgr.34412) 10156 : cluster [DBG] pgmap v5783: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:20.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:01:20 gibba015 bash[29377]: cluster 2021-03-10T17:01:19.368052+0000 mgr.gibba045.orlgmj (mgr.34412) 10157 : cluster [DBG] pgmap v5784: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:20.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:01:20 gibba015 bash[30343]: cluster 2021-03-10T17:01:19.368052+0000 mgr.gibba045.orlgmj (mgr.34412) 10157 : cluster [DBG] pgmap v5784: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:20.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:01:20 gibba045 bash[25517]: cluster 2021-03-10T17:01:19.368052+0000 mgr.gibba045.orlgmj (mgr.34412) 10157 : cluster [DBG] pgmap v5784: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:23.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:01:23 gibba015 bash[29377]: cluster 2021-03-10T17:01:21.369814+0000 mgr.gibba045.orlgmj (mgr.34412) 10158 : cluster [DBG] pgmap v5785: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:23.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:01:23 gibba015 bash[30343]: cluster 2021-03-10T17:01:21.369814+0000 mgr.gibba045.orlgmj (mgr.34412) 10158 : cluster [DBG] pgmap v5785: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:23.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:01:23 gibba045 bash[25517]: cluster 2021-03-10T17:01:21.369814+0000 mgr.gibba045.orlgmj (mgr.34412) 10158 : cluster [DBG] pgmap v5785: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:25.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:01:25 gibba015 bash[29377]: cluster 2021-03-10T17:01:23.371316+0000 mgr.gibba045.orlgmj (mgr.34412) 10159 : cluster [DBG] pgmap v5786: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:25.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:01:25 gibba015 bash[29377]: cephadm 2021-03-10T17:01:23.751944+0000 mgr.gibba045.orlgmj (mgr.34412) 10160 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:01:25.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:01:25 gibba015 bash[30343]: cluster 2021-03-10T17:01:23.371316+0000 mgr.gibba045.orlgmj (mgr.34412) 10159 : cluster [DBG] pgmap v5786: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:25.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:01:25 gibba015 bash[30343]: cephadm 2021-03-10T17:01:23.751944+0000 mgr.gibba045.orlgmj (mgr.34412) 10160 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:01:25.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:01:25 gibba045 bash[25517]: cluster 2021-03-10T17:01:23.371316+0000 mgr.gibba045.orlgmj (mgr.34412) 10159 : cluster [DBG] pgmap v5786: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:25.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:01:25 gibba045 bash[25517]: cephadm 2021-03-10T17:01:23.751944+0000 mgr.gibba045.orlgmj (mgr.34412) 10160 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:01:27.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:01:27 gibba015 bash[29377]: cluster 2021-03-10T17:01:25.372883+0000 mgr.gibba045.orlgmj (mgr.34412) 10161 : cluster [DBG] pgmap v5787: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:27.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:01:27 gibba015 bash[30343]: cluster 2021-03-10T17:01:25.372883+0000 mgr.gibba045.orlgmj (mgr.34412) 10161 : cluster [DBG] pgmap v5787: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:27.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:01:27 gibba045 bash[25517]: cluster 2021-03-10T17:01:25.372883+0000 mgr.gibba045.orlgmj (mgr.34412) 10161 : cluster [DBG] pgmap v5787: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:29.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:01:29 gibba015 bash[29377]: cluster 2021-03-10T17:01:27.374626+0000 mgr.gibba045.orlgmj (mgr.34412) 10162 : cluster [DBG] pgmap v5788: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:29.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:01:29 gibba015 bash[30343]: cluster 2021-03-10T17:01:27.374626+0000 mgr.gibba045.orlgmj (mgr.34412) 10162 : cluster [DBG] pgmap v5788: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:29.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:01:29 gibba045 bash[25517]: cluster 2021-03-10T17:01:27.374626+0000 mgr.gibba045.orlgmj (mgr.34412) 10162 : cluster [DBG] pgmap v5788: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:31.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:01:31 gibba015 bash[29377]: cluster 2021-03-10T17:01:29.375862+0000 mgr.gibba045.orlgmj (mgr.34412) 10163 : cluster [DBG] pgmap v5789: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:31.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:01:31 gibba015 bash[30343]: cluster 2021-03-10T17:01:29.375862+0000 mgr.gibba045.orlgmj (mgr.34412) 10163 : cluster [DBG] pgmap v5789: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:31.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:01:31 gibba045 bash[25517]: cluster 2021-03-10T17:01:29.375862+0000 mgr.gibba045.orlgmj (mgr.34412) 10163 : cluster [DBG] pgmap v5789: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:33.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:01:33 gibba015 bash[29377]: cluster 2021-03-10T17:01:31.377643+0000 mgr.gibba045.orlgmj (mgr.34412) 10164 : cluster [DBG] pgmap v5790: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:33.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:01:33 gibba015 bash[30343]: cluster 2021-03-10T17:01:31.377643+0000 mgr.gibba045.orlgmj (mgr.34412) 10164 : cluster [DBG] pgmap v5790: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:33.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:01:33 gibba045 bash[25517]: cluster 2021-03-10T17:01:31.377643+0000 mgr.gibba045.orlgmj (mgr.34412) 10164 : cluster [DBG] pgmap v5790: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:35.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:01:35 gibba015 bash[29377]: cluster 2021-03-10T17:01:33.379143+0000 mgr.gibba045.orlgmj (mgr.34412) 10165 : cluster [DBG] pgmap v5791: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:35.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:01:35 gibba015 bash[30343]: cluster 2021-03-10T17:01:33.379143+0000 mgr.gibba045.orlgmj (mgr.34412) 10165 : cluster [DBG] pgmap v5791: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:35.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:01:35 gibba045 bash[25517]: cluster 2021-03-10T17:01:33.379143+0000 mgr.gibba045.orlgmj (mgr.34412) 10165 : cluster [DBG] pgmap v5791: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:37.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:01:37 gibba015 bash[29377]: cluster 2021-03-10T17:01:35.380722+0000 mgr.gibba045.orlgmj (mgr.34412) 10166 : cluster [DBG] pgmap v5792: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:37.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:01:37 gibba015 bash[30343]: cluster 2021-03-10T17:01:35.380722+0000 mgr.gibba045.orlgmj (mgr.34412) 10166 : cluster [DBG] pgmap v5792: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:37.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:01:37 gibba045 bash[25517]: cluster 2021-03-10T17:01:35.380722+0000 mgr.gibba045.orlgmj (mgr.34412) 10166 : cluster [DBG] pgmap v5792: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:39.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:01:39 gibba015 bash[29377]: cluster 2021-03-10T17:01:37.382506+0000 mgr.gibba045.orlgmj (mgr.34412) 10167 : cluster [DBG] pgmap v5793: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:39.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:01:39 gibba015 bash[30343]: cluster 2021-03-10T17:01:37.382506+0000 mgr.gibba045.orlgmj (mgr.34412) 10167 : cluster [DBG] pgmap v5793: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:39.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:01:39 gibba045 bash[25517]: cluster 2021-03-10T17:01:37.382506+0000 mgr.gibba045.orlgmj (mgr.34412) 10167 : cluster [DBG] pgmap v5793: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:40.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:01:40 gibba015 bash[29377]: cephadm 2021-03-10T17:01:38.765478+0000 mgr.gibba045.orlgmj (mgr.34412) 10168 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:01:40.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:01:40 gibba015 bash[30343]: cephadm 2021-03-10T17:01:38.765478+0000 mgr.gibba045.orlgmj (mgr.34412) 10168 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:01:40.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:01:40 gibba045 bash[25517]: cephadm 2021-03-10T17:01:38.765478+0000 mgr.gibba045.orlgmj (mgr.34412) 10168 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:01:41.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:01:41 gibba015 bash[29377]: cluster 2021-03-10T17:01:39.384035+0000 mgr.gibba045.orlgmj (mgr.34412) 10169 : cluster [DBG] pgmap v5794: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:41.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:01:41 gibba015 bash[30343]: cluster 2021-03-10T17:01:39.384035+0000 mgr.gibba045.orlgmj (mgr.34412) 10169 : cluster [DBG] pgmap v5794: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:41.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:01:41 gibba045 bash[25517]: cluster 2021-03-10T17:01:39.384035+0000 mgr.gibba045.orlgmj (mgr.34412) 10169 : cluster [DBG] pgmap v5794: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:41.588 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:01:41.815 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:01:41.816 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 4m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:01:41.816 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 3m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:01:41.817 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:01:41.817 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:01:41.818 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:01:41.818 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:01:41.819 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:01:41.819 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:01:41.820 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 4m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:01:41.820 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 3m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:01:41.820 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:01:41.821 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:01:41.821 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:01:41.822 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:01:41.822 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:01:41.823 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:01:41.823 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:01:41.823 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:01:41.824 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 3m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:01:41.824 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 3m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:01:42.062 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:01:42.063 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:01:42.063 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:01:42.063 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:01:42.063 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:01:42.064 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:01:42.064 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:01:42.064 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:01:42.064 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:01:42.065 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:01:42.065 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:01:42.065 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:01:42.065 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:01:42.065 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:01:42.066 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:01:42.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:01:42 gibba015 bash[29377]: audit 2021-03-10T17:01:42.061829+0000 mon.c (mon.1) 2791 : audit [DBG] from='client.? 172.21.2.115:0/3033508681' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:01:42.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:01:42 gibba015 bash[30343]: audit 2021-03-10T17:01:42.061829+0000 mon.c (mon.1) 2791 : audit [DBG] from='client.? 172.21.2.115:0/3033508681' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:01:42.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:01:42 gibba045 bash[25517]: audit 2021-03-10T17:01:42.061829+0000 mon.c (mon.1) 2791 : audit [DBG] from='client.? 172.21.2.115:0/3033508681' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:01:43.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:01:43 gibba015 bash[29377]: cluster 2021-03-10T17:01:41.385925+0000 mgr.gibba045.orlgmj (mgr.34412) 10170 : cluster [DBG] pgmap v5795: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:43.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:01:43 gibba015 bash[29377]: audit 2021-03-10T17:01:41.581108+0000 mgr.gibba045.orlgmj (mgr.34412) 10171 : audit [DBG] from='client.60862 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:01:43.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:01:43 gibba015 bash[29377]: audit 2021-03-10T17:01:41.804541+0000 mgr.gibba045.orlgmj (mgr.34412) 10172 : audit [DBG] from='client.60868 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:01:43.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:01:43 gibba015 bash[30343]: cluster 2021-03-10T17:01:41.385925+0000 mgr.gibba045.orlgmj (mgr.34412) 10170 : cluster [DBG] pgmap v5795: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:43.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:01:43 gibba015 bash[30343]: audit 2021-03-10T17:01:41.581108+0000 mgr.gibba045.orlgmj (mgr.34412) 10171 : audit [DBG] from='client.60862 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:01:43.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:01:43 gibba015 bash[30343]: audit 2021-03-10T17:01:41.804541+0000 mgr.gibba045.orlgmj (mgr.34412) 10172 : audit [DBG] from='client.60868 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:01:43.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:01:43 gibba045 bash[25517]: cluster 2021-03-10T17:01:41.385925+0000 mgr.gibba045.orlgmj (mgr.34412) 10170 : cluster [DBG] pgmap v5795: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:43.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:01:43 gibba045 bash[25517]: audit 2021-03-10T17:01:41.581108+0000 mgr.gibba045.orlgmj (mgr.34412) 10171 : audit [DBG] from='client.60862 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:01:43.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:01:43 gibba045 bash[25517]: audit 2021-03-10T17:01:41.804541+0000 mgr.gibba045.orlgmj (mgr.34412) 10172 : audit [DBG] from='client.60868 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:01:45.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:01:45 gibba015 bash[29377]: cluster 2021-03-10T17:01:43.387575+0000 mgr.gibba045.orlgmj (mgr.34412) 10173 : cluster [DBG] pgmap v5796: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:45.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:01:45 gibba015 bash[30343]: cluster 2021-03-10T17:01:43.387575+0000 mgr.gibba045.orlgmj (mgr.34412) 10173 : cluster [DBG] pgmap v5796: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:45.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:01:45 gibba045 bash[25517]: cluster 2021-03-10T17:01:43.387575+0000 mgr.gibba045.orlgmj (mgr.34412) 10173 : cluster [DBG] pgmap v5796: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:47.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:01:47 gibba045 bash[25517]: cluster 2021-03-10T17:01:45.389164+0000 mgr.gibba045.orlgmj (mgr.34412) 10174 : cluster [DBG] pgmap v5797: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:47.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:01:47 gibba015 bash[29377]: cluster 2021-03-10T17:01:45.389164+0000 mgr.gibba045.orlgmj (mgr.34412) 10174 : cluster [DBG] pgmap v5797: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:47.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:01:47 gibba015 bash[30343]: cluster 2021-03-10T17:01:45.389164+0000 mgr.gibba045.orlgmj (mgr.34412) 10174 : cluster [DBG] pgmap v5797: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:48.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:01:48 gibba045 bash[25517]: cluster 2021-03-10T17:01:47.390916+0000 mgr.gibba045.orlgmj (mgr.34412) 10175 : cluster [DBG] pgmap v5798: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:48.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:01:48 gibba015 bash[29377]: cluster 2021-03-10T17:01:47.390916+0000 mgr.gibba045.orlgmj (mgr.34412) 10175 : cluster [DBG] pgmap v5798: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:48.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:01:48 gibba015 bash[30343]: cluster 2021-03-10T17:01:47.390916+0000 mgr.gibba045.orlgmj (mgr.34412) 10175 : cluster [DBG] pgmap v5798: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:50.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:01:50 gibba015 bash[29377]: cluster 2021-03-10T17:01:49.392197+0000 mgr.gibba045.orlgmj (mgr.34412) 10176 : cluster [DBG] pgmap v5799: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:50.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:01:50 gibba015 bash[30343]: cluster 2021-03-10T17:01:49.392197+0000 mgr.gibba045.orlgmj (mgr.34412) 10176 : cluster [DBG] pgmap v5799: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:50.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:01:50 gibba045 bash[25517]: cluster 2021-03-10T17:01:49.392197+0000 mgr.gibba045.orlgmj (mgr.34412) 10176 : cluster [DBG] pgmap v5799: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:53.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:01:53 gibba015 bash[29377]: cluster 2021-03-10T17:01:51.393758+0000 mgr.gibba045.orlgmj (mgr.34412) 10177 : cluster [DBG] pgmap v5800: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:53.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:01:53 gibba015 bash[30343]: cluster 2021-03-10T17:01:51.393758+0000 mgr.gibba045.orlgmj (mgr.34412) 10177 : cluster [DBG] pgmap v5800: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:53.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:01:53 gibba045 bash[25517]: cluster 2021-03-10T17:01:51.393758+0000 mgr.gibba045.orlgmj (mgr.34412) 10177 : cluster [DBG] pgmap v5800: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:54.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:01:54 gibba015 bash[29377]: audit 2021-03-10T17:01:53.821872+0000 mon.c (mon.1) 2792 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:01:54.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:01:54 gibba015 bash[29377]: audit 2021-03-10T17:01:53.823039+0000 mon.a (mon.0) 2193 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:01:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:01:54 gibba015 bash[29377]: audit 2021-03-10T17:01:53.825580+0000 mon.c (mon.1) 2793 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:01:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:01:54 gibba015 bash[29377]: audit 2021-03-10T17:01:53.826663+0000 mon.a (mon.0) 2194 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:01:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:01:54 gibba015 bash[29377]: audit 2021-03-10T17:01:53.871843+0000 mon.c (mon.1) 2794 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T17:01:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:01:54 gibba015 bash[29377]: audit 2021-03-10T17:01:53.872624+0000 mon.c (mon.1) 2795 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:01:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:01:54 gibba015 bash[29377]: audit 2021-03-10T17:01:53.873190+0000 mon.a (mon.0) 2195 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T17:01:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:01:54 gibba015 bash[29377]: audit 2021-03-10T17:01:53.873420+0000 mon.c (mon.1) 2796 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T17:01:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:01:54 gibba015 bash[29377]: audit 2021-03-10T17:01:53.874096+0000 mon.c (mon.1) 2797 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:01:54.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:01:54 gibba015 bash[29377]: audit 2021-03-10T17:01:53.875110+0000 mon.a (mon.0) 2196 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:01:54.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:01:54 gibba015 bash[29377]: audit 2021-03-10T17:01:53.876229+0000 mon.a (mon.0) 2197 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T17:01:54.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:01:54 gibba015 bash[29377]: audit 2021-03-10T17:01:53.877026+0000 mon.a (mon.0) 2198 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:01:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:01:54 gibba015 bash[30343]: audit 2021-03-10T17:01:53.821872+0000 mon.c (mon.1) 2792 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:01:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:01:54 gibba015 bash[30343]: audit 2021-03-10T17:01:53.823039+0000 mon.a (mon.0) 2193 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:01:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:01:54 gibba015 bash[30343]: audit 2021-03-10T17:01:53.825580+0000 mon.c (mon.1) 2793 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:01:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:01:54 gibba015 bash[30343]: audit 2021-03-10T17:01:53.826663+0000 mon.a (mon.0) 2194 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:01:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:01:54 gibba015 bash[30343]: audit 2021-03-10T17:01:53.871843+0000 mon.c (mon.1) 2794 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T17:01:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:01:54 gibba015 bash[30343]: audit 2021-03-10T17:01:53.872624+0000 mon.c (mon.1) 2795 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:01:54.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:01:54 gibba015 bash[30343]: audit 2021-03-10T17:01:53.873190+0000 mon.a (mon.0) 2195 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T17:01:54.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:01:54 gibba015 bash[30343]: audit 2021-03-10T17:01:53.873420+0000 mon.c (mon.1) 2796 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T17:01:54.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:01:54 gibba015 bash[30343]: audit 2021-03-10T17:01:53.874096+0000 mon.c (mon.1) 2797 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:01:54.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:01:54 gibba015 bash[30343]: audit 2021-03-10T17:01:53.875110+0000 mon.a (mon.0) 2196 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:01:54.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:01:54 gibba015 bash[30343]: audit 2021-03-10T17:01:53.876229+0000 mon.a (mon.0) 2197 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T17:01:54.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:01:54 gibba015 bash[30343]: audit 2021-03-10T17:01:53.877026+0000 mon.a (mon.0) 2198 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:01:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:01:54 gibba045 bash[25517]: audit 2021-03-10T17:01:53.821872+0000 mon.c (mon.1) 2792 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:01:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:01:54 gibba045 bash[25517]: audit 2021-03-10T17:01:53.823039+0000 mon.a (mon.0) 2193 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:01:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:01:54 gibba045 bash[25517]: audit 2021-03-10T17:01:53.825580+0000 mon.c (mon.1) 2793 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:01:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:01:54 gibba045 bash[25517]: audit 2021-03-10T17:01:53.826663+0000 mon.a (mon.0) 2194 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:01:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:01:54 gibba045 bash[25517]: audit 2021-03-10T17:01:53.871843+0000 mon.c (mon.1) 2794 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T17:01:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:01:54 gibba045 bash[25517]: audit 2021-03-10T17:01:53.872624+0000 mon.c (mon.1) 2795 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:01:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:01:54 gibba045 bash[25517]: audit 2021-03-10T17:01:53.873190+0000 mon.a (mon.0) 2195 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T17:01:54.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:01:54 gibba045 bash[25517]: audit 2021-03-10T17:01:53.873420+0000 mon.c (mon.1) 2796 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T17:01:54.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:01:54 gibba045 bash[25517]: audit 2021-03-10T17:01:53.874096+0000 mon.c (mon.1) 2797 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:01:54.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:01:54 gibba045 bash[25517]: audit 2021-03-10T17:01:53.875110+0000 mon.a (mon.0) 2196 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:01:54.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:01:54 gibba045 bash[25517]: audit 2021-03-10T17:01:53.876229+0000 mon.a (mon.0) 2197 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T17:01:54.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:01:54 gibba045 bash[25517]: audit 2021-03-10T17:01:53.877026+0000 mon.a (mon.0) 2198 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:01:55.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:01:55 gibba015 bash[29377]: cluster 2021-03-10T17:01:53.395449+0000 mgr.gibba045.orlgmj (mgr.34412) 10178 : cluster [DBG] pgmap v5801: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:55.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:01:55 gibba015 bash[29377]: cephadm 2021-03-10T17:01:53.773232+0000 mgr.gibba045.orlgmj (mgr.34412) 10179 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:01:55.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:01:55 gibba015 bash[30343]: cluster 2021-03-10T17:01:53.395449+0000 mgr.gibba045.orlgmj (mgr.34412) 10178 : cluster [DBG] pgmap v5801: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:55.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:01:55 gibba015 bash[30343]: cephadm 2021-03-10T17:01:53.773232+0000 mgr.gibba045.orlgmj (mgr.34412) 10179 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:01:55.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:01:55 gibba045 bash[25517]: cluster 2021-03-10T17:01:53.395449+0000 mgr.gibba045.orlgmj (mgr.34412) 10178 : cluster [DBG] pgmap v5801: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:55.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:01:55 gibba045 bash[25517]: cephadm 2021-03-10T17:01:53.773232+0000 mgr.gibba045.orlgmj (mgr.34412) 10179 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:01:57.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:01:57 gibba015 bash[29377]: cluster 2021-03-10T17:01:55.397129+0000 mgr.gibba045.orlgmj (mgr.34412) 10180 : cluster [DBG] pgmap v5802: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:57.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:01:57 gibba015 bash[30343]: cluster 2021-03-10T17:01:55.397129+0000 mgr.gibba045.orlgmj (mgr.34412) 10180 : cluster [DBG] pgmap v5802: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:57.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:01:57 gibba045 bash[25517]: cluster 2021-03-10T17:01:55.397129+0000 mgr.gibba045.orlgmj (mgr.34412) 10180 : cluster [DBG] pgmap v5802: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:59.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:01:59 gibba015 bash[29377]: cluster 2021-03-10T17:01:57.398607+0000 mgr.gibba045.orlgmj (mgr.34412) 10181 : cluster [DBG] pgmap v5803: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:59.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:01:59 gibba015 bash[30343]: cluster 2021-03-10T17:01:57.398607+0000 mgr.gibba045.orlgmj (mgr.34412) 10181 : cluster [DBG] pgmap v5803: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:59.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:01:59 gibba045 bash[25517]: cluster 2021-03-10T17:01:57.398607+0000 mgr.gibba045.orlgmj (mgr.34412) 10181 : cluster [DBG] pgmap v5803: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:01.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:02:01 gibba015 bash[29377]: cluster 2021-03-10T17:01:59.400141+0000 mgr.gibba045.orlgmj (mgr.34412) 10182 : cluster [DBG] pgmap v5804: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:01.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:02:01 gibba015 bash[30343]: cluster 2021-03-10T17:01:59.400141+0000 mgr.gibba045.orlgmj (mgr.34412) 10182 : cluster [DBG] pgmap v5804: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:01.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:02:01 gibba045 bash[25517]: cluster 2021-03-10T17:01:59.400141+0000 mgr.gibba045.orlgmj (mgr.34412) 10182 : cluster [DBG] pgmap v5804: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:03.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:02:03 gibba015 bash[29377]: cluster 2021-03-10T17:02:01.401776+0000 mgr.gibba045.orlgmj (mgr.34412) 10183 : cluster [DBG] pgmap v5805: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:03.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:02:03 gibba015 bash[30343]: cluster 2021-03-10T17:02:01.401776+0000 mgr.gibba045.orlgmj (mgr.34412) 10183 : cluster [DBG] pgmap v5805: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:03.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:02:03 gibba045 bash[25517]: cluster 2021-03-10T17:02:01.401776+0000 mgr.gibba045.orlgmj (mgr.34412) 10183 : cluster [DBG] pgmap v5805: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:05.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:02:05 gibba015 bash[29377]: cluster 2021-03-10T17:02:03.403440+0000 mgr.gibba045.orlgmj (mgr.34412) 10184 : cluster [DBG] pgmap v5806: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:05.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:02:05 gibba015 bash[30343]: cluster 2021-03-10T17:02:03.403440+0000 mgr.gibba045.orlgmj (mgr.34412) 10184 : cluster [DBG] pgmap v5806: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:05.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:02:05 gibba045 bash[25517]: cluster 2021-03-10T17:02:03.403440+0000 mgr.gibba045.orlgmj (mgr.34412) 10184 : cluster [DBG] pgmap v5806: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:07.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:02:07 gibba015 bash[29377]: cluster 2021-03-10T17:02:05.405235+0000 mgr.gibba045.orlgmj (mgr.34412) 10185 : cluster [DBG] pgmap v5807: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:07.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:02:07 gibba015 bash[30343]: cluster 2021-03-10T17:02:05.405235+0000 mgr.gibba045.orlgmj (mgr.34412) 10185 : cluster [DBG] pgmap v5807: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:07.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:02:07 gibba045 bash[25517]: cluster 2021-03-10T17:02:05.405235+0000 mgr.gibba045.orlgmj (mgr.34412) 10185 : cluster [DBG] pgmap v5807: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:09.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:02:09 gibba045 bash[25517]: cluster 2021-03-10T17:02:07.406724+0000 mgr.gibba045.orlgmj (mgr.34412) 10186 : cluster [DBG] pgmap v5808: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:09.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:02:09 gibba045 bash[25517]: audit 2021-03-10T17:02:08.788152+0000 mon.c (mon.1) 2798 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:02:09.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:02:09 gibba045 bash[25517]: audit 2021-03-10T17:02:09.012292+0000 mon.a (mon.0) 2199 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:02:09.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:02:09 gibba045 bash[25517]: audit 2021-03-10T17:02:09.016424+0000 mon.c (mon.1) 2799 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:02:09.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:02:09 gibba045 bash[25517]: audit 2021-03-10T17:02:09.018077+0000 mon.c (mon.1) 2800 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:02:09.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:02:09 gibba045 bash[25517]: audit 2021-03-10T17:02:09.019546+0000 mon.c (mon.1) 2801 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:02:09.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:02:09 gibba045 bash[25517]: audit 2021-03-10T17:02:09.020992+0000 mon.c (mon.1) 2802 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:02:09.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:02:09 gibba045 bash[25517]: audit 2021-03-10T17:02:09.024338+0000 mon.c (mon.1) 2803 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:02:09.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:02:09 gibba045 bash[25517]: audit 2021-03-10T17:02:09.026372+0000 mon.c (mon.1) 2804 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:02:09.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:02:09 gibba015 bash[29377]: cluster 2021-03-10T17:02:07.406724+0000 mgr.gibba045.orlgmj (mgr.34412) 10186 : cluster [DBG] pgmap v5808: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:09.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:02:09 gibba015 bash[29377]: audit 2021-03-10T17:02:08.788152+0000 mon.c (mon.1) 2798 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:02:09.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:02:09 gibba015 bash[29377]: audit 2021-03-10T17:02:09.012292+0000 mon.a (mon.0) 2199 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:02:09.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:02:09 gibba015 bash[29377]: audit 2021-03-10T17:02:09.016424+0000 mon.c (mon.1) 2799 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:02:09.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:02:09 gibba015 bash[29377]: audit 2021-03-10T17:02:09.018077+0000 mon.c (mon.1) 2800 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:02:09.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:02:09 gibba015 bash[29377]: audit 2021-03-10T17:02:09.019546+0000 mon.c (mon.1) 2801 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:02:09.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:02:09 gibba015 bash[29377]: audit 2021-03-10T17:02:09.020992+0000 mon.c (mon.1) 2802 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:02:09.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:02:09 gibba015 bash[29377]: audit 2021-03-10T17:02:09.024338+0000 mon.c (mon.1) 2803 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:02:09.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:02:09 gibba015 bash[29377]: audit 2021-03-10T17:02:09.026372+0000 mon.c (mon.1) 2804 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:02:09.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:02:09 gibba015 bash[30343]: cluster 2021-03-10T17:02:07.406724+0000 mgr.gibba045.orlgmj (mgr.34412) 10186 : cluster [DBG] pgmap v5808: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:09.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:02:09 gibba015 bash[30343]: audit 2021-03-10T17:02:08.788152+0000 mon.c (mon.1) 2798 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:02:09.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:02:09 gibba015 bash[30343]: audit 2021-03-10T17:02:09.012292+0000 mon.a (mon.0) 2199 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:02:09.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:02:09 gibba015 bash[30343]: audit 2021-03-10T17:02:09.016424+0000 mon.c (mon.1) 2799 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:02:09.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:02:09 gibba015 bash[30343]: audit 2021-03-10T17:02:09.018077+0000 mon.c (mon.1) 2800 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:02:09.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:02:09 gibba015 bash[30343]: audit 2021-03-10T17:02:09.019546+0000 mon.c (mon.1) 2801 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:02:09.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:02:09 gibba015 bash[30343]: audit 2021-03-10T17:02:09.020992+0000 mon.c (mon.1) 2802 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:02:09.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:02:09 gibba015 bash[30343]: audit 2021-03-10T17:02:09.024338+0000 mon.c (mon.1) 2803 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:02:09.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:02:09 gibba015 bash[30343]: audit 2021-03-10T17:02:09.026372+0000 mon.c (mon.1) 2804 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:02:10.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:02:10 gibba015 bash[29377]: cephadm 2021-03-10T17:02:08.794672+0000 mgr.gibba045.orlgmj (mgr.34412) 10187 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:02:10.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:02:10 gibba015 bash[29377]: cephadm 2021-03-10T17:02:08.795177+0000 mgr.gibba045.orlgmj (mgr.34412) 10188 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:02:10.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:02:10 gibba015 bash[29377]: cephadm 2021-03-10T17:02:09.017612+0000 mgr.gibba045.orlgmj (mgr.34412) 10189 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:02:10.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:02:10 gibba015 bash[29377]: cephadm 2021-03-10T17:02:09.019520+0000 mgr.gibba045.orlgmj (mgr.34412) 10190 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:02:10.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:02:10 gibba015 bash[29377]: cephadm 2021-03-10T17:02:09.021057+0000 mgr.gibba045.orlgmj (mgr.34412) 10191 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:02:10.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:02:10 gibba015 bash[29377]: cephadm 2021-03-10T17:02:09.021111+0000 mgr.gibba045.orlgmj (mgr.34412) 10192 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:02:10.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:02:10 gibba015 bash[29377]: cephadm 2021-03-10T17:02:09.022585+0000 mgr.gibba045.orlgmj (mgr.34412) 10193 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:02:10.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:02:10 gibba015 bash[29377]: cephadm 2021-03-10T17:02:09.022642+0000 mgr.gibba045.orlgmj (mgr.34412) 10194 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:02:10.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:02:10 gibba015 bash[29377]: cephadm 2021-03-10T17:02:09.023986+0000 mgr.gibba045.orlgmj (mgr.34412) 10195 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:02:10.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:02:10 gibba015 bash[29377]: cephadm 2021-03-10T17:02:09.025694+0000 mgr.gibba045.orlgmj (mgr.34412) 10196 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:02:10.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:02:10 gibba015 bash[29377]: cephadm 2021-03-10T17:02:09.025755+0000 mgr.gibba045.orlgmj (mgr.34412) 10197 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:02:10.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:02:10 gibba015 bash[29377]: cephadm 2021-03-10T17:02:09.027618+0000 mgr.gibba045.orlgmj (mgr.34412) 10198 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:02:10.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:02:10 gibba015 bash[29377]: cephadm 2021-03-10T17:02:09.028045+0000 mgr.gibba045.orlgmj (mgr.34412) 10199 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:02:10.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:02:10 gibba015 bash[29377]: cephadm 2021-03-10T17:02:09.029418+0000 mgr.gibba045.orlgmj (mgr.34412) 10200 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:02:10.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:02:10 gibba015 bash[29377]: cephadm 2021-03-10T17:02:09.029486+0000 mgr.gibba045.orlgmj (mgr.34412) 10201 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:02:10.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:02:10 gibba015 bash[29377]: cephadm 2021-03-10T17:02:09.029653+0000 mgr.gibba045.orlgmj (mgr.34412) 10202 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:02:10.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:02:10 gibba015 bash[30343]: cephadm 2021-03-10T17:02:08.794672+0000 mgr.gibba045.orlgmj (mgr.34412) 10187 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:02:10.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:02:10 gibba015 bash[30343]: cephadm 2021-03-10T17:02:08.795177+0000 mgr.gibba045.orlgmj (mgr.34412) 10188 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:02:10.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:02:10 gibba015 bash[30343]: cephadm 2021-03-10T17:02:09.017612+0000 mgr.gibba045.orlgmj (mgr.34412) 10189 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:02:10.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:02:10 gibba015 bash[30343]: cephadm 2021-03-10T17:02:09.019520+0000 mgr.gibba045.orlgmj (mgr.34412) 10190 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:02:10.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:02:10 gibba015 bash[30343]: cephadm 2021-03-10T17:02:09.021057+0000 mgr.gibba045.orlgmj (mgr.34412) 10191 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:02:10.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:02:10 gibba015 bash[30343]: cephadm 2021-03-10T17:02:09.021111+0000 mgr.gibba045.orlgmj (mgr.34412) 10192 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:02:10.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:02:10 gibba015 bash[30343]: cephadm 2021-03-10T17:02:09.022585+0000 mgr.gibba045.orlgmj (mgr.34412) 10193 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:02:10.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:02:10 gibba015 bash[30343]: cephadm 2021-03-10T17:02:09.022642+0000 mgr.gibba045.orlgmj (mgr.34412) 10194 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:02:10.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:02:10 gibba015 bash[30343]: cephadm 2021-03-10T17:02:09.023986+0000 mgr.gibba045.orlgmj (mgr.34412) 10195 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:02:10.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:02:10 gibba015 bash[30343]: cephadm 2021-03-10T17:02:09.025694+0000 mgr.gibba045.orlgmj (mgr.34412) 10196 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:02:10.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:02:10 gibba015 bash[30343]: cephadm 2021-03-10T17:02:09.025755+0000 mgr.gibba045.orlgmj (mgr.34412) 10197 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:02:10.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:02:10 gibba015 bash[30343]: cephadm 2021-03-10T17:02:09.027618+0000 mgr.gibba045.orlgmj (mgr.34412) 10198 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:02:10.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:02:10 gibba015 bash[30343]: cephadm 2021-03-10T17:02:09.028045+0000 mgr.gibba045.orlgmj (mgr.34412) 10199 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:02:10.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:02:10 gibba015 bash[30343]: cephadm 2021-03-10T17:02:09.029418+0000 mgr.gibba045.orlgmj (mgr.34412) 10200 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:02:10.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:02:10 gibba015 bash[30343]: cephadm 2021-03-10T17:02:09.029486+0000 mgr.gibba045.orlgmj (mgr.34412) 10201 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:02:10.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:02:10 gibba015 bash[30343]: cephadm 2021-03-10T17:02:09.029653+0000 mgr.gibba045.orlgmj (mgr.34412) 10202 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:02:10.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:02:10 gibba045 bash[25517]: cephadm 2021-03-10T17:02:08.794672+0000 mgr.gibba045.orlgmj (mgr.34412) 10187 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:02:10.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:02:10 gibba045 bash[25517]: cephadm 2021-03-10T17:02:08.795177+0000 mgr.gibba045.orlgmj (mgr.34412) 10188 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:02:10.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:02:10 gibba045 bash[25517]: cephadm 2021-03-10T17:02:09.017612+0000 mgr.gibba045.orlgmj (mgr.34412) 10189 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:02:10.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:02:10 gibba045 bash[25517]: cephadm 2021-03-10T17:02:09.019520+0000 mgr.gibba045.orlgmj (mgr.34412) 10190 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:02:10.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:02:10 gibba045 bash[25517]: cephadm 2021-03-10T17:02:09.021057+0000 mgr.gibba045.orlgmj (mgr.34412) 10191 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:02:10.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:02:10 gibba045 bash[25517]: cephadm 2021-03-10T17:02:09.021111+0000 mgr.gibba045.orlgmj (mgr.34412) 10192 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:02:10.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:02:10 gibba045 bash[25517]: cephadm 2021-03-10T17:02:09.022585+0000 mgr.gibba045.orlgmj (mgr.34412) 10193 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:02:10.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:02:10 gibba045 bash[25517]: cephadm 2021-03-10T17:02:09.022642+0000 mgr.gibba045.orlgmj (mgr.34412) 10194 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:02:10.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:02:10 gibba045 bash[25517]: cephadm 2021-03-10T17:02:09.023986+0000 mgr.gibba045.orlgmj (mgr.34412) 10195 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:02:10.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:02:10 gibba045 bash[25517]: cephadm 2021-03-10T17:02:09.025694+0000 mgr.gibba045.orlgmj (mgr.34412) 10196 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:02:10.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:02:10 gibba045 bash[25517]: cephadm 2021-03-10T17:02:09.025755+0000 mgr.gibba045.orlgmj (mgr.34412) 10197 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:02:10.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:02:10 gibba045 bash[25517]: cephadm 2021-03-10T17:02:09.027618+0000 mgr.gibba045.orlgmj (mgr.34412) 10198 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:02:10.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:02:10 gibba045 bash[25517]: cephadm 2021-03-10T17:02:09.028045+0000 mgr.gibba045.orlgmj (mgr.34412) 10199 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:02:10.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:02:10 gibba045 bash[25517]: cephadm 2021-03-10T17:02:09.029418+0000 mgr.gibba045.orlgmj (mgr.34412) 10200 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:02:10.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:02:10 gibba045 bash[25517]: cephadm 2021-03-10T17:02:09.029486+0000 mgr.gibba045.orlgmj (mgr.34412) 10201 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:02:10.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:02:10 gibba045 bash[25517]: cephadm 2021-03-10T17:02:09.029653+0000 mgr.gibba045.orlgmj (mgr.34412) 10202 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:02:11.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:02:11 gibba015 bash[29377]: cluster 2021-03-10T17:02:09.408094+0000 mgr.gibba045.orlgmj (mgr.34412) 10203 : cluster [DBG] pgmap v5809: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:11.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:02:11 gibba015 bash[30343]: cluster 2021-03-10T17:02:09.408094+0000 mgr.gibba045.orlgmj (mgr.34412) 10203 : cluster [DBG] pgmap v5809: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:11.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:02:11 gibba045 bash[25517]: cluster 2021-03-10T17:02:09.408094+0000 mgr.gibba045.orlgmj (mgr.34412) 10203 : cluster [DBG] pgmap v5809: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:12.307 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:02:12.532 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:02:12.533 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 5m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:02:12.533 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 4m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:02:12.533 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:02:12.533 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:02:12.534 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:02:12.534 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:02:12.534 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:02:12.535 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:02:12.535 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 5m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:02:12.536 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 4m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:02:12.536 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:02:12.536 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:02:12.537 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:02:12.537 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:02:12.538 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:02:12.538 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:02:12.538 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:02:12.539 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:02:12.539 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 4m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:02:12.539 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 4m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:02:12.787 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:02:12.788 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:02:12.788 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:02:12.789 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:02:12.789 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:02:12.790 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:02:12.790 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:02:12.790 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:02:12.791 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:02:12.791 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:02:12.792 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:02:12.792 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:02:12.793 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:02:12.793 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:02:12.794 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:02:13.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:02:13 gibba045 bash[25517]: cluster 2021-03-10T17:02:11.409957+0000 mgr.gibba045.orlgmj (mgr.34412) 10204 : cluster [DBG] pgmap v5810: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:13.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:02:13 gibba045 bash[25517]: audit 2021-03-10T17:02:12.786608+0000 mon.c (mon.1) 2805 : audit [DBG] from='client.? 172.21.2.115:0/3589690907' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:02:13.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:02:13 gibba015 bash[29377]: cluster 2021-03-10T17:02:11.409957+0000 mgr.gibba045.orlgmj (mgr.34412) 10204 : cluster [DBG] pgmap v5810: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:13.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:02:13 gibba015 bash[29377]: audit 2021-03-10T17:02:12.786608+0000 mon.c (mon.1) 2805 : audit [DBG] from='client.? 172.21.2.115:0/3589690907' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:02:13.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:02:13 gibba015 bash[30343]: cluster 2021-03-10T17:02:11.409957+0000 mgr.gibba045.orlgmj (mgr.34412) 10204 : cluster [DBG] pgmap v5810: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:13.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:02:13 gibba015 bash[30343]: audit 2021-03-10T17:02:12.786608+0000 mon.c (mon.1) 2805 : audit [DBG] from='client.? 172.21.2.115:0/3589690907' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:02:14.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:02:14 gibba045 bash[25517]: audit 2021-03-10T17:02:12.299900+0000 mgr.gibba045.orlgmj (mgr.34412) 10205 : audit [DBG] from='client.50892 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:02:14.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:02:14 gibba045 bash[25517]: audit 2021-03-10T17:02:12.521868+0000 mgr.gibba045.orlgmj (mgr.34412) 10206 : audit [DBG] from='client.50898 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:02:14.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:02:14 gibba015 bash[29377]: audit 2021-03-10T17:02:12.299900+0000 mgr.gibba045.orlgmj (mgr.34412) 10205 : audit [DBG] from='client.50892 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:02:14.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:02:14 gibba015 bash[29377]: audit 2021-03-10T17:02:12.521868+0000 mgr.gibba045.orlgmj (mgr.34412) 10206 : audit [DBG] from='client.50898 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:02:14.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:02:14 gibba015 bash[30343]: audit 2021-03-10T17:02:12.299900+0000 mgr.gibba045.orlgmj (mgr.34412) 10205 : audit [DBG] from='client.50892 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:02:14.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:02:14 gibba015 bash[30343]: audit 2021-03-10T17:02:12.521868+0000 mgr.gibba045.orlgmj (mgr.34412) 10206 : audit [DBG] from='client.50898 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:02:15.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:02:15 gibba045 bash[25517]: cluster 2021-03-10T17:02:13.411508+0000 mgr.gibba045.orlgmj (mgr.34412) 10207 : cluster [DBG] pgmap v5811: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:15.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:02:15 gibba015 bash[29377]: cluster 2021-03-10T17:02:13.411508+0000 mgr.gibba045.orlgmj (mgr.34412) 10207 : cluster [DBG] pgmap v5811: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:15.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:02:15 gibba015 bash[30343]: cluster 2021-03-10T17:02:13.411508+0000 mgr.gibba045.orlgmj (mgr.34412) 10207 : cluster [DBG] pgmap v5811: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:16.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:02:16 gibba045 bash[25517]: cluster 2021-03-10T17:02:15.413659+0000 mgr.gibba045.orlgmj (mgr.34412) 10208 : cluster [DBG] pgmap v5812: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:16.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:02:16 gibba015 bash[29377]: cluster 2021-03-10T17:02:15.413659+0000 mgr.gibba045.orlgmj (mgr.34412) 10208 : cluster [DBG] pgmap v5812: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:16.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:02:16 gibba015 bash[30343]: cluster 2021-03-10T17:02:15.413659+0000 mgr.gibba045.orlgmj (mgr.34412) 10208 : cluster [DBG] pgmap v5812: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:19.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:02:19 gibba015 bash[29377]: cluster 2021-03-10T17:02:17.415424+0000 mgr.gibba045.orlgmj (mgr.34412) 10209 : cluster [DBG] pgmap v5813: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:19.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:02:19 gibba015 bash[30343]: cluster 2021-03-10T17:02:17.415424+0000 mgr.gibba045.orlgmj (mgr.34412) 10209 : cluster [DBG] pgmap v5813: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:19.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:02:19 gibba045 bash[25517]: cluster 2021-03-10T17:02:17.415424+0000 mgr.gibba045.orlgmj (mgr.34412) 10209 : cluster [DBG] pgmap v5813: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:21.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:02:21 gibba015 bash[29377]: cluster 2021-03-10T17:02:19.416671+0000 mgr.gibba045.orlgmj (mgr.34412) 10210 : cluster [DBG] pgmap v5814: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:21.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:02:21 gibba015 bash[30343]: cluster 2021-03-10T17:02:19.416671+0000 mgr.gibba045.orlgmj (mgr.34412) 10210 : cluster [DBG] pgmap v5814: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:21.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:02:21 gibba045 bash[25517]: cluster 2021-03-10T17:02:19.416671+0000 mgr.gibba045.orlgmj (mgr.34412) 10210 : cluster [DBG] pgmap v5814: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:23.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:02:23 gibba015 bash[29377]: cluster 2021-03-10T17:02:21.418413+0000 mgr.gibba045.orlgmj (mgr.34412) 10211 : cluster [DBG] pgmap v5815: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:23.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:02:23 gibba015 bash[30343]: cluster 2021-03-10T17:02:21.418413+0000 mgr.gibba045.orlgmj (mgr.34412) 10211 : cluster [DBG] pgmap v5815: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:23.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:02:23 gibba045 bash[25517]: cluster 2021-03-10T17:02:21.418413+0000 mgr.gibba045.orlgmj (mgr.34412) 10211 : cluster [DBG] pgmap v5815: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:25.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:02:25 gibba015 bash[29377]: cluster 2021-03-10T17:02:23.418871+0000 mgr.gibba045.orlgmj (mgr.34412) 10212 : cluster [DBG] pgmap v5816: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:25.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:02:25 gibba015 bash[29377]: cephadm 2021-03-10T17:02:24.045260+0000 mgr.gibba045.orlgmj (mgr.34412) 10213 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:02:25.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:02:25 gibba015 bash[30343]: cluster 2021-03-10T17:02:23.418871+0000 mgr.gibba045.orlgmj (mgr.34412) 10212 : cluster [DBG] pgmap v5816: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:25.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:02:25 gibba015 bash[30343]: cephadm 2021-03-10T17:02:24.045260+0000 mgr.gibba045.orlgmj (mgr.34412) 10213 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:02:25.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:02:25 gibba045 bash[25517]: cluster 2021-03-10T17:02:23.418871+0000 mgr.gibba045.orlgmj (mgr.34412) 10212 : cluster [DBG] pgmap v5816: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:25.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:02:25 gibba045 bash[25517]: cephadm 2021-03-10T17:02:24.045260+0000 mgr.gibba045.orlgmj (mgr.34412) 10213 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:02:27.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:02:27 gibba015 bash[29377]: cluster 2021-03-10T17:02:25.420519+0000 mgr.gibba045.orlgmj (mgr.34412) 10214 : cluster [DBG] pgmap v5817: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:27.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:02:27 gibba015 bash[30343]: cluster 2021-03-10T17:02:25.420519+0000 mgr.gibba045.orlgmj (mgr.34412) 10214 : cluster [DBG] pgmap v5817: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:27.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:02:27 gibba045 bash[25517]: cluster 2021-03-10T17:02:25.420519+0000 mgr.gibba045.orlgmj (mgr.34412) 10214 : cluster [DBG] pgmap v5817: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:29.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:02:29 gibba015 bash[29377]: cluster 2021-03-10T17:02:27.422357+0000 mgr.gibba045.orlgmj (mgr.34412) 10215 : cluster [DBG] pgmap v5818: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:29.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:02:29 gibba015 bash[30343]: cluster 2021-03-10T17:02:27.422357+0000 mgr.gibba045.orlgmj (mgr.34412) 10215 : cluster [DBG] pgmap v5818: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:29.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:02:29 gibba045 bash[25517]: cluster 2021-03-10T17:02:27.422357+0000 mgr.gibba045.orlgmj (mgr.34412) 10215 : cluster [DBG] pgmap v5818: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:31.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:02:31 gibba015 bash[29377]: cluster 2021-03-10T17:02:29.423748+0000 mgr.gibba045.orlgmj (mgr.34412) 10216 : cluster [DBG] pgmap v5819: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:31.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:02:31 gibba015 bash[30343]: cluster 2021-03-10T17:02:29.423748+0000 mgr.gibba045.orlgmj (mgr.34412) 10216 : cluster [DBG] pgmap v5819: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:31.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:02:31 gibba045 bash[25517]: cluster 2021-03-10T17:02:29.423748+0000 mgr.gibba045.orlgmj (mgr.34412) 10216 : cluster [DBG] pgmap v5819: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:33.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:02:33 gibba015 bash[29377]: cluster 2021-03-10T17:02:31.424243+0000 mgr.gibba045.orlgmj (mgr.34412) 10217 : cluster [DBG] pgmap v5820: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:33.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:02:33 gibba015 bash[30343]: cluster 2021-03-10T17:02:31.424243+0000 mgr.gibba045.orlgmj (mgr.34412) 10217 : cluster [DBG] pgmap v5820: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:33.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:02:33 gibba045 bash[25517]: cluster 2021-03-10T17:02:31.424243+0000 mgr.gibba045.orlgmj (mgr.34412) 10217 : cluster [DBG] pgmap v5820: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:35.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:02:35 gibba015 bash[29377]: cluster 2021-03-10T17:02:33.425508+0000 mgr.gibba045.orlgmj (mgr.34412) 10218 : cluster [DBG] pgmap v5821: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:35.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:02:35 gibba015 bash[30343]: cluster 2021-03-10T17:02:33.425508+0000 mgr.gibba045.orlgmj (mgr.34412) 10218 : cluster [DBG] pgmap v5821: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:35.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:02:35 gibba045 bash[25517]: cluster 2021-03-10T17:02:33.425508+0000 mgr.gibba045.orlgmj (mgr.34412) 10218 : cluster [DBG] pgmap v5821: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:37.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:02:37 gibba045 bash[25517]: cluster 2021-03-10T17:02:35.427133+0000 mgr.gibba045.orlgmj (mgr.34412) 10219 : cluster [DBG] pgmap v5822: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:37.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:02:37 gibba015 bash[29377]: cluster 2021-03-10T17:02:35.427133+0000 mgr.gibba045.orlgmj (mgr.34412) 10219 : cluster [DBG] pgmap v5822: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:37.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:02:37 gibba015 bash[30343]: cluster 2021-03-10T17:02:35.427133+0000 mgr.gibba045.orlgmj (mgr.34412) 10219 : cluster [DBG] pgmap v5822: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:39.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:02:39 gibba045 bash[25517]: cluster 2021-03-10T17:02:37.428977+0000 mgr.gibba045.orlgmj (mgr.34412) 10220 : cluster [DBG] pgmap v5823: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:39.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:02:39 gibba015 bash[29377]: cluster 2021-03-10T17:02:37.428977+0000 mgr.gibba045.orlgmj (mgr.34412) 10220 : cluster [DBG] pgmap v5823: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:39.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:02:39 gibba015 bash[30343]: cluster 2021-03-10T17:02:37.428977+0000 mgr.gibba045.orlgmj (mgr.34412) 10220 : cluster [DBG] pgmap v5823: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:40.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:02:40 gibba045 bash[25517]: cephadm 2021-03-10T17:02:39.061218+0000 mgr.gibba045.orlgmj (mgr.34412) 10221 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:02:40.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:02:40 gibba015 bash[29377]: cephadm 2021-03-10T17:02:39.061218+0000 mgr.gibba045.orlgmj (mgr.34412) 10221 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:02:40.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:02:40 gibba015 bash[30343]: cephadm 2021-03-10T17:02:39.061218+0000 mgr.gibba045.orlgmj (mgr.34412) 10221 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:02:41.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:02:41 gibba045 bash[25517]: cluster 2021-03-10T17:02:39.429452+0000 mgr.gibba045.orlgmj (mgr.34412) 10222 : cluster [DBG] pgmap v5824: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:41.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:02:41 gibba015 bash[29377]: cluster 2021-03-10T17:02:39.429452+0000 mgr.gibba045.orlgmj (mgr.34412) 10222 : cluster [DBG] pgmap v5824: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:41.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:02:41 gibba015 bash[30343]: cluster 2021-03-10T17:02:39.429452+0000 mgr.gibba045.orlgmj (mgr.34412) 10222 : cluster [DBG] pgmap v5824: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:43.028 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:02:43.288 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:02:43.288 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 5m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:02:43.288 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 4m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:02:43.289 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:02:43.289 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:02:43.289 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:02:43.289 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:02:43.289 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:02:43.290 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:02:43.290 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 5m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:02:43.290 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 4m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:02:43.290 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:02:43.291 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:02:43.291 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:02:43.291 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:02:43.291 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:02:43.291 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:02:43.292 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:02:43.292 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:02:43.292 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 4m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:02:43.292 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 4m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:02:43.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:02:43 gibba015 bash[29377]: cluster 2021-03-10T17:02:41.430979+0000 mgr.gibba045.orlgmj (mgr.34412) 10223 : cluster [DBG] pgmap v5825: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:43.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:02:43 gibba015 bash[30343]: cluster 2021-03-10T17:02:41.430979+0000 mgr.gibba045.orlgmj (mgr.34412) 10223 : cluster [DBG] pgmap v5825: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:43.545 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:02:43.545 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:02:43.546 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:02:43.546 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:02:43.547 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:02:43.547 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:02:43.548 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:02:43.548 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:02:43.549 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:02:43.549 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:02:43.550 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:02:43.551 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:02:43.551 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:02:43.551 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:02:43.551 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:02:43.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:02:43 gibba045 bash[25517]: cluster 2021-03-10T17:02:41.430979+0000 mgr.gibba045.orlgmj (mgr.34412) 10223 : cluster [DBG] pgmap v5825: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:44.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:02:44 gibba015 bash[29377]: audit 2021-03-10T17:02:43.021196+0000 mgr.gibba045.orlgmj (mgr.34412) 10224 : audit [DBG] from='client.60898 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:02:44.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:02:44 gibba015 bash[29377]: audit 2021-03-10T17:02:43.544018+0000 mon.a (mon.0) 2200 : audit [DBG] from='client.? 172.21.2.115:0/3932590427' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:02:44.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:02:44 gibba015 bash[30343]: audit 2021-03-10T17:02:43.021196+0000 mgr.gibba045.orlgmj (mgr.34412) 10224 : audit [DBG] from='client.60898 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:02:44.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:02:44 gibba015 bash[30343]: audit 2021-03-10T17:02:43.544018+0000 mon.a (mon.0) 2200 : audit [DBG] from='client.? 172.21.2.115:0/3932590427' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:02:44.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:02:44 gibba045 bash[25517]: audit 2021-03-10T17:02:43.021196+0000 mgr.gibba045.orlgmj (mgr.34412) 10224 : audit [DBG] from='client.60898 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:02:44.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:02:44 gibba045 bash[25517]: audit 2021-03-10T17:02:43.544018+0000 mon.a (mon.0) 2200 : audit [DBG] from='client.? 172.21.2.115:0/3932590427' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:02:45.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:02:45 gibba015 bash[29377]: audit 2021-03-10T17:02:43.247791+0000 mgr.gibba045.orlgmj (mgr.34412) 10225 : audit [DBG] from='client.60904 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:02:45.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:02:45 gibba015 bash[29377]: cluster 2021-03-10T17:02:43.432201+0000 mgr.gibba045.orlgmj (mgr.34412) 10226 : cluster [DBG] pgmap v5826: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:45.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:02:45 gibba015 bash[30343]: audit 2021-03-10T17:02:43.247791+0000 mgr.gibba045.orlgmj (mgr.34412) 10225 : audit [DBG] from='client.60904 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:02:45.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:02:45 gibba015 bash[30343]: cluster 2021-03-10T17:02:43.432201+0000 mgr.gibba045.orlgmj (mgr.34412) 10226 : cluster [DBG] pgmap v5826: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:45.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:02:45 gibba045 bash[25517]: audit 2021-03-10T17:02:43.247791+0000 mgr.gibba045.orlgmj (mgr.34412) 10225 : audit [DBG] from='client.60904 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:02:45.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:02:45 gibba045 bash[25517]: cluster 2021-03-10T17:02:43.432201+0000 mgr.gibba045.orlgmj (mgr.34412) 10226 : cluster [DBG] pgmap v5826: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:47.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:02:47 gibba015 bash[29377]: cluster 2021-03-10T17:02:45.433880+0000 mgr.gibba045.orlgmj (mgr.34412) 10227 : cluster [DBG] pgmap v5827: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:47.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:02:47 gibba015 bash[30343]: cluster 2021-03-10T17:02:45.433880+0000 mgr.gibba045.orlgmj (mgr.34412) 10227 : cluster [DBG] pgmap v5827: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:47.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:02:47 gibba045 bash[25517]: cluster 2021-03-10T17:02:45.433880+0000 mgr.gibba045.orlgmj (mgr.34412) 10227 : cluster [DBG] pgmap v5827: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:49.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:02:49 gibba015 bash[29377]: cluster 2021-03-10T17:02:47.434754+0000 mgr.gibba045.orlgmj (mgr.34412) 10228 : cluster [DBG] pgmap v5828: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:49.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:02:49 gibba015 bash[30343]: cluster 2021-03-10T17:02:47.434754+0000 mgr.gibba045.orlgmj (mgr.34412) 10228 : cluster [DBG] pgmap v5828: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:49.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:02:49 gibba045 bash[25517]: cluster 2021-03-10T17:02:47.434754+0000 mgr.gibba045.orlgmj (mgr.34412) 10228 : cluster [DBG] pgmap v5828: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:51.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:02:51 gibba015 bash[29377]: cluster 2021-03-10T17:02:49.436141+0000 mgr.gibba045.orlgmj (mgr.34412) 10229 : cluster [DBG] pgmap v5829: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:51.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:02:51 gibba015 bash[30343]: cluster 2021-03-10T17:02:49.436141+0000 mgr.gibba045.orlgmj (mgr.34412) 10229 : cluster [DBG] pgmap v5829: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:51.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:02:51 gibba045 bash[25517]: cluster 2021-03-10T17:02:49.436141+0000 mgr.gibba045.orlgmj (mgr.34412) 10229 : cluster [DBG] pgmap v5829: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:53.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:02:53 gibba015 bash[29377]: cluster 2021-03-10T17:02:51.438017+0000 mgr.gibba045.orlgmj (mgr.34412) 10230 : cluster [DBG] pgmap v5830: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:53.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:02:53 gibba015 bash[30343]: cluster 2021-03-10T17:02:51.438017+0000 mgr.gibba045.orlgmj (mgr.34412) 10230 : cluster [DBG] pgmap v5830: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:53.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:02:53 gibba045 bash[25517]: cluster 2021-03-10T17:02:51.438017+0000 mgr.gibba045.orlgmj (mgr.34412) 10230 : cluster [DBG] pgmap v5830: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:02:54 gibba015 bash[29377]: audit 2021-03-10T17:02:53.825510+0000 mon.c (mon.1) 2806 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:02:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:02:54 gibba015 bash[29377]: audit 2021-03-10T17:02:53.826688+0000 mon.a (mon.0) 2201 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:02:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:02:54 gibba015 bash[29377]: audit 2021-03-10T17:02:53.829444+0000 mon.c (mon.1) 2807 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:02:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:02:54 gibba015 bash[29377]: audit 2021-03-10T17:02:53.830473+0000 mon.a (mon.0) 2202 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:02:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:02:54 gibba015 bash[29377]: audit 2021-03-10T17:02:53.883062+0000 mon.c (mon.1) 2808 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T17:02:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:02:54 gibba015 bash[29377]: audit 2021-03-10T17:02:53.883786+0000 mon.c (mon.1) 2809 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:02:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:02:54 gibba015 bash[29377]: audit 2021-03-10T17:02:53.884324+0000 mon.a (mon.0) 2203 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T17:02:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:02:54 gibba015 bash[29377]: audit 2021-03-10T17:02:53.884455+0000 mon.c (mon.1) 2810 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:02:54.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:02:54 gibba015 bash[29377]: audit 2021-03-10T17:02:53.885151+0000 mon.c (mon.1) 2811 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:02:54.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:02:54 gibba015 bash[29377]: audit 2021-03-10T17:02:53.885910+0000 mon.a (mon.0) 2204 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:02:54.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:02:54 gibba015 bash[29377]: audit 2021-03-10T17:02:53.886915+0000 mon.a (mon.0) 2205 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:02:54.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:02:54 gibba015 bash[29377]: audit 2021-03-10T17:02:53.887718+0000 mon.a (mon.0) 2206 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:02:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:02:54 gibba015 bash[30343]: audit 2021-03-10T17:02:53.825510+0000 mon.c (mon.1) 2806 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:02:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:02:54 gibba015 bash[30343]: audit 2021-03-10T17:02:53.826688+0000 mon.a (mon.0) 2201 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:02:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:02:54 gibba015 bash[30343]: audit 2021-03-10T17:02:53.829444+0000 mon.c (mon.1) 2807 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:02:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:02:54 gibba015 bash[30343]: audit 2021-03-10T17:02:53.830473+0000 mon.a (mon.0) 2202 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:02:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:02:54 gibba015 bash[30343]: audit 2021-03-10T17:02:53.883062+0000 mon.c (mon.1) 2808 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T17:02:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:02:54 gibba015 bash[30343]: audit 2021-03-10T17:02:53.883786+0000 mon.c (mon.1) 2809 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:02:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:02:54 gibba015 bash[30343]: audit 2021-03-10T17:02:53.884324+0000 mon.a (mon.0) 2203 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T17:02:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:02:54 gibba015 bash[30343]: audit 2021-03-10T17:02:53.884455+0000 mon.c (mon.1) 2810 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:02:54.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:02:54 gibba015 bash[30343]: audit 2021-03-10T17:02:53.885151+0000 mon.c (mon.1) 2811 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:02:54.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:02:54 gibba015 bash[30343]: audit 2021-03-10T17:02:53.885910+0000 mon.a (mon.0) 2204 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:02:54.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:02:54 gibba015 bash[30343]: audit 2021-03-10T17:02:53.886915+0000 mon.a (mon.0) 2205 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:02:54.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:02:54 gibba015 bash[30343]: audit 2021-03-10T17:02:53.887718+0000 mon.a (mon.0) 2206 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:02:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:02:54 gibba045 bash[25517]: audit 2021-03-10T17:02:53.825510+0000 mon.c (mon.1) 2806 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:02:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:02:54 gibba045 bash[25517]: audit 2021-03-10T17:02:53.826688+0000 mon.a (mon.0) 2201 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:02:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:02:54 gibba045 bash[25517]: audit 2021-03-10T17:02:53.829444+0000 mon.c (mon.1) 2807 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:02:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:02:54 gibba045 bash[25517]: audit 2021-03-10T17:02:53.830473+0000 mon.a (mon.0) 2202 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:02:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:02:54 gibba045 bash[25517]: audit 2021-03-10T17:02:53.883062+0000 mon.c (mon.1) 2808 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T17:02:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:02:54 gibba045 bash[25517]: audit 2021-03-10T17:02:53.883786+0000 mon.c (mon.1) 2809 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:02:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:02:54 gibba045 bash[25517]: audit 2021-03-10T17:02:53.884324+0000 mon.a (mon.0) 2203 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T17:02:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:02:54 gibba045 bash[25517]: audit 2021-03-10T17:02:53.884455+0000 mon.c (mon.1) 2810 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:02:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:02:54 gibba045 bash[25517]: audit 2021-03-10T17:02:53.885151+0000 mon.c (mon.1) 2811 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:02:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:02:54 gibba045 bash[25517]: audit 2021-03-10T17:02:53.885910+0000 mon.a (mon.0) 2204 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:02:54.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:02:54 gibba045 bash[25517]: audit 2021-03-10T17:02:53.886915+0000 mon.a (mon.0) 2205 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:02:54.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:02:54 gibba045 bash[25517]: audit 2021-03-10T17:02:53.887718+0000 mon.a (mon.0) 2206 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:02:55.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:02:55 gibba015 bash[29377]: cluster 2021-03-10T17:02:53.439154+0000 mgr.gibba045.orlgmj (mgr.34412) 10231 : cluster [DBG] pgmap v5831: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:55.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:02:55 gibba015 bash[29377]: cephadm 2021-03-10T17:02:54.066437+0000 mgr.gibba045.orlgmj (mgr.34412) 10232 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:02:55.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:02:55 gibba015 bash[30343]: cluster 2021-03-10T17:02:53.439154+0000 mgr.gibba045.orlgmj (mgr.34412) 10231 : cluster [DBG] pgmap v5831: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:55.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:02:55 gibba015 bash[30343]: cephadm 2021-03-10T17:02:54.066437+0000 mgr.gibba045.orlgmj (mgr.34412) 10232 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:02:55.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:02:55 gibba045 bash[25517]: cluster 2021-03-10T17:02:53.439154+0000 mgr.gibba045.orlgmj (mgr.34412) 10231 : cluster [DBG] pgmap v5831: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:55.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:02:55 gibba045 bash[25517]: cephadm 2021-03-10T17:02:54.066437+0000 mgr.gibba045.orlgmj (mgr.34412) 10232 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:02:57.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:02:57 gibba045 bash[25517]: cluster 2021-03-10T17:02:55.439955+0000 mgr.gibba045.orlgmj (mgr.34412) 10233 : cluster [DBG] pgmap v5832: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:57.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:02:57 gibba015 bash[29377]: cluster 2021-03-10T17:02:55.439955+0000 mgr.gibba045.orlgmj (mgr.34412) 10233 : cluster [DBG] pgmap v5832: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:57.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:02:57 gibba015 bash[30343]: cluster 2021-03-10T17:02:55.439955+0000 mgr.gibba045.orlgmj (mgr.34412) 10233 : cluster [DBG] pgmap v5832: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:59.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:02:59 gibba045 bash[25517]: cluster 2021-03-10T17:02:57.441674+0000 mgr.gibba045.orlgmj (mgr.34412) 10234 : cluster [DBG] pgmap v5833: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:59.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:02:59 gibba015 bash[29377]: cluster 2021-03-10T17:02:57.441674+0000 mgr.gibba045.orlgmj (mgr.34412) 10234 : cluster [DBG] pgmap v5833: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:59.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:02:59 gibba015 bash[30343]: cluster 2021-03-10T17:02:57.441674+0000 mgr.gibba045.orlgmj (mgr.34412) 10234 : cluster [DBG] pgmap v5833: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:01.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:03:01 gibba045 bash[25517]: cluster 2021-03-10T17:02:59.442920+0000 mgr.gibba045.orlgmj (mgr.34412) 10235 : cluster [DBG] pgmap v5834: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:01.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:03:01 gibba015 bash[29377]: cluster 2021-03-10T17:02:59.442920+0000 mgr.gibba045.orlgmj (mgr.34412) 10235 : cluster [DBG] pgmap v5834: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:01.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:03:01 gibba015 bash[30343]: cluster 2021-03-10T17:02:59.442920+0000 mgr.gibba045.orlgmj (mgr.34412) 10235 : cluster [DBG] pgmap v5834: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:03.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:03:03 gibba045 bash[25517]: cluster 2021-03-10T17:03:01.444889+0000 mgr.gibba045.orlgmj (mgr.34412) 10236 : cluster [DBG] pgmap v5835: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:03.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:03:03 gibba015 bash[29377]: cluster 2021-03-10T17:03:01.444889+0000 mgr.gibba045.orlgmj (mgr.34412) 10236 : cluster [DBG] pgmap v5835: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:03.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:03:03 gibba015 bash[30343]: cluster 2021-03-10T17:03:01.444889+0000 mgr.gibba045.orlgmj (mgr.34412) 10236 : cluster [DBG] pgmap v5835: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:05.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:03:05 gibba045 bash[25517]: cluster 2021-03-10T17:03:03.445782+0000 mgr.gibba045.orlgmj (mgr.34412) 10237 : cluster [DBG] pgmap v5836: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:05.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:03:05 gibba015 bash[29377]: cluster 2021-03-10T17:03:03.445782+0000 mgr.gibba045.orlgmj (mgr.34412) 10237 : cluster [DBG] pgmap v5836: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:05.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:03:05 gibba015 bash[30343]: cluster 2021-03-10T17:03:03.445782+0000 mgr.gibba045.orlgmj (mgr.34412) 10237 : cluster [DBG] pgmap v5836: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:06.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:03:06 gibba015 bash[29377]: cluster 2021-03-10T17:03:05.447388+0000 mgr.gibba045.orlgmj (mgr.34412) 10238 : cluster [DBG] pgmap v5837: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:06.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:03:06 gibba015 bash[30343]: cluster 2021-03-10T17:03:05.447388+0000 mgr.gibba045.orlgmj (mgr.34412) 10238 : cluster [DBG] pgmap v5837: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:06.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:03:06 gibba045 bash[25517]: cluster 2021-03-10T17:03:05.447388+0000 mgr.gibba045.orlgmj (mgr.34412) 10238 : cluster [DBG] pgmap v5837: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:09.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:03:09 gibba015 bash[29377]: cluster 2021-03-10T17:03:07.449195+0000 mgr.gibba045.orlgmj (mgr.34412) 10239 : cluster [DBG] pgmap v5838: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:09.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:03:09 gibba015 bash[29377]: audit 2021-03-10T17:03:09.081144+0000 mon.c (mon.1) 2812 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:03:09.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:03:09 gibba015 bash[30343]: cluster 2021-03-10T17:03:07.449195+0000 mgr.gibba045.orlgmj (mgr.34412) 10239 : cluster [DBG] pgmap v5838: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:09.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:03:09 gibba015 bash[30343]: audit 2021-03-10T17:03:09.081144+0000 mon.c (mon.1) 2812 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:03:09.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:03:09 gibba045 bash[25517]: cluster 2021-03-10T17:03:07.449195+0000 mgr.gibba045.orlgmj (mgr.34412) 10239 : cluster [DBG] pgmap v5838: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:09.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:03:09 gibba045 bash[25517]: audit 2021-03-10T17:03:09.081144+0000 mon.c (mon.1) 2812 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:03:10.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:03:10 gibba015 bash[29377]: cephadm 2021-03-10T17:03:09.088561+0000 mgr.gibba045.orlgmj (mgr.34412) 10240 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:03:10.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:03:10 gibba015 bash[29377]: cephadm 2021-03-10T17:03:09.090398+0000 mgr.gibba045.orlgmj (mgr.34412) 10241 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:03:10.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:03:10 gibba015 bash[29377]: audit 2021-03-10T17:03:09.328557+0000 mon.a (mon.0) 2207 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:03:10.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:03:10 gibba015 bash[29377]: audit 2021-03-10T17:03:09.345457+0000 mon.c (mon.1) 2813 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:03:10.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:03:10 gibba015 bash[29377]: audit 2021-03-10T17:03:09.349560+0000 mon.c (mon.1) 2814 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:03:10.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:03:10 gibba015 bash[29377]: audit 2021-03-10T17:03:09.353825+0000 mon.c (mon.1) 2815 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:03:10.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:03:10 gibba015 bash[29377]: audit 2021-03-10T17:03:09.357535+0000 mon.c (mon.1) 2816 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:03:10.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:03:10 gibba015 bash[29377]: audit 2021-03-10T17:03:09.364816+0000 mon.c (mon.1) 2817 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:03:10.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:03:10 gibba015 bash[29377]: audit 2021-03-10T17:03:09.369525+0000 mon.c (mon.1) 2818 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:03:10.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:03:10 gibba015 bash[30343]: cephadm 2021-03-10T17:03:09.088561+0000 mgr.gibba045.orlgmj (mgr.34412) 10240 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:03:10.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:03:10 gibba015 bash[30343]: cephadm 2021-03-10T17:03:09.090398+0000 mgr.gibba045.orlgmj (mgr.34412) 10241 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:03:10.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:03:10 gibba015 bash[30343]: audit 2021-03-10T17:03:09.328557+0000 mon.a (mon.0) 2207 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:03:10.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:03:10 gibba015 bash[30343]: audit 2021-03-10T17:03:09.345457+0000 mon.c (mon.1) 2813 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:03:10.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:03:10 gibba015 bash[30343]: audit 2021-03-10T17:03:09.349560+0000 mon.c (mon.1) 2814 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:03:10.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:03:10 gibba015 bash[30343]: audit 2021-03-10T17:03:09.353825+0000 mon.c (mon.1) 2815 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:03:10.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:03:10 gibba015 bash[30343]: audit 2021-03-10T17:03:09.357535+0000 mon.c (mon.1) 2816 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:03:10.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:03:10 gibba015 bash[30343]: audit 2021-03-10T17:03:09.364816+0000 mon.c (mon.1) 2817 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:03:10.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:03:10 gibba015 bash[30343]: audit 2021-03-10T17:03:09.369525+0000 mon.c (mon.1) 2818 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:03:10.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:03:10 gibba045 bash[25517]: cephadm 2021-03-10T17:03:09.088561+0000 mgr.gibba045.orlgmj (mgr.34412) 10240 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:03:10.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:03:10 gibba045 bash[25517]: cephadm 2021-03-10T17:03:09.090398+0000 mgr.gibba045.orlgmj (mgr.34412) 10241 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:03:10.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:03:10 gibba045 bash[25517]: audit 2021-03-10T17:03:09.328557+0000 mon.a (mon.0) 2207 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:03:10.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:03:10 gibba045 bash[25517]: audit 2021-03-10T17:03:09.345457+0000 mon.c (mon.1) 2813 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:03:10.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:03:10 gibba045 bash[25517]: audit 2021-03-10T17:03:09.349560+0000 mon.c (mon.1) 2814 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:03:10.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:03:10 gibba045 bash[25517]: audit 2021-03-10T17:03:09.353825+0000 mon.c (mon.1) 2815 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:03:10.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:03:10 gibba045 bash[25517]: audit 2021-03-10T17:03:09.357535+0000 mon.c (mon.1) 2816 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:03:10.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:03:10 gibba045 bash[25517]: audit 2021-03-10T17:03:09.364816+0000 mon.c (mon.1) 2817 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:03:10.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:03:10 gibba045 bash[25517]: audit 2021-03-10T17:03:09.369525+0000 mon.c (mon.1) 2818 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:03:11.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:03:11 gibba015 bash[29377]: cephadm 2021-03-10T17:03:09.344823+0000 mgr.gibba045.orlgmj (mgr.34412) 10242 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:03:11.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:03:11 gibba015 bash[29377]: cephadm 2021-03-10T17:03:09.350394+0000 mgr.gibba045.orlgmj (mgr.34412) 10243 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:03:11.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:03:11 gibba015 bash[29377]: cephadm 2021-03-10T17:03:09.354192+0000 mgr.gibba045.orlgmj (mgr.34412) 10244 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:03:11.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:03:11 gibba015 bash[29377]: cephadm 2021-03-10T17:03:09.354659+0000 mgr.gibba045.orlgmj (mgr.34412) 10245 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:03:11.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:03:11 gibba015 bash[29377]: cephadm 2021-03-10T17:03:09.358323+0000 mgr.gibba045.orlgmj (mgr.34412) 10246 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:03:11.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:03:11 gibba015 bash[29377]: cephadm 2021-03-10T17:03:09.358714+0000 mgr.gibba045.orlgmj (mgr.34412) 10247 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:03:11.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:03:11 gibba015 bash[29377]: cephadm 2021-03-10T17:03:09.361820+0000 mgr.gibba045.orlgmj (mgr.34412) 10248 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:03:11.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:03:11 gibba015 bash[29377]: cephadm 2021-03-10T17:03:09.365074+0000 mgr.gibba045.orlgmj (mgr.34412) 10249 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:03:11.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:03:11 gibba015 bash[29377]: cephadm 2021-03-10T17:03:09.365534+0000 mgr.gibba045.orlgmj (mgr.34412) 10250 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:03:11.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:03:11 gibba015 bash[29377]: cephadm 2021-03-10T17:03:09.368955+0000 mgr.gibba045.orlgmj (mgr.34412) 10251 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:03:11.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:03:11 gibba015 bash[29377]: cephadm 2021-03-10T17:03:09.370910+0000 mgr.gibba045.orlgmj (mgr.34412) 10252 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:03:11.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:03:11 gibba015 bash[29377]: cephadm 2021-03-10T17:03:09.373719+0000 mgr.gibba045.orlgmj (mgr.34412) 10253 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:03:11.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:03:11 gibba015 bash[29377]: cephadm 2021-03-10T17:03:09.374013+0000 mgr.gibba045.orlgmj (mgr.34412) 10254 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:03:11.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:03:11 gibba015 bash[29377]: cephadm 2021-03-10T17:03:09.374872+0000 mgr.gibba045.orlgmj (mgr.34412) 10255 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:03:11.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:03:11 gibba015 bash[29377]: cluster 2021-03-10T17:03:09.450431+0000 mgr.gibba045.orlgmj (mgr.34412) 10256 : cluster [DBG] pgmap v5839: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:11.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:03:11 gibba015 bash[30343]: cephadm 2021-03-10T17:03:09.344823+0000 mgr.gibba045.orlgmj (mgr.34412) 10242 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:03:11.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:03:11 gibba015 bash[30343]: cephadm 2021-03-10T17:03:09.350394+0000 mgr.gibba045.orlgmj (mgr.34412) 10243 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:03:11.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:03:11 gibba015 bash[30343]: cephadm 2021-03-10T17:03:09.354192+0000 mgr.gibba045.orlgmj (mgr.34412) 10244 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:03:11.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:03:11 gibba015 bash[30343]: cephadm 2021-03-10T17:03:09.354659+0000 mgr.gibba045.orlgmj (mgr.34412) 10245 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:03:11.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:03:11 gibba015 bash[30343]: cephadm 2021-03-10T17:03:09.358323+0000 mgr.gibba045.orlgmj (mgr.34412) 10246 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:03:11.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:03:11 gibba015 bash[30343]: cephadm 2021-03-10T17:03:09.358714+0000 mgr.gibba045.orlgmj (mgr.34412) 10247 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:03:11.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:03:11 gibba015 bash[30343]: cephadm 2021-03-10T17:03:09.361820+0000 mgr.gibba045.orlgmj (mgr.34412) 10248 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:03:11.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:03:11 gibba015 bash[30343]: cephadm 2021-03-10T17:03:09.365074+0000 mgr.gibba045.orlgmj (mgr.34412) 10249 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:03:11.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:03:11 gibba015 bash[30343]: cephadm 2021-03-10T17:03:09.365534+0000 mgr.gibba045.orlgmj (mgr.34412) 10250 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:03:11.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:03:11 gibba015 bash[30343]: cephadm 2021-03-10T17:03:09.368955+0000 mgr.gibba045.orlgmj (mgr.34412) 10251 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:03:11.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:03:11 gibba015 bash[30343]: cephadm 2021-03-10T17:03:09.370910+0000 mgr.gibba045.orlgmj (mgr.34412) 10252 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:03:11.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:03:11 gibba015 bash[30343]: cephadm 2021-03-10T17:03:09.373719+0000 mgr.gibba045.orlgmj (mgr.34412) 10253 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:03:11.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:03:11 gibba015 bash[30343]: cephadm 2021-03-10T17:03:09.374013+0000 mgr.gibba045.orlgmj (mgr.34412) 10254 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:03:11.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:03:11 gibba015 bash[30343]: cephadm 2021-03-10T17:03:09.374872+0000 mgr.gibba045.orlgmj (mgr.34412) 10255 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:03:11.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:03:11 gibba015 bash[30343]: cluster 2021-03-10T17:03:09.450431+0000 mgr.gibba045.orlgmj (mgr.34412) 10256 : cluster [DBG] pgmap v5839: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:11.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:03:11 gibba045 bash[25517]: cephadm 2021-03-10T17:03:09.344823+0000 mgr.gibba045.orlgmj (mgr.34412) 10242 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:03:11.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:03:11 gibba045 bash[25517]: cephadm 2021-03-10T17:03:09.350394+0000 mgr.gibba045.orlgmj (mgr.34412) 10243 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:03:11.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:03:11 gibba045 bash[25517]: cephadm 2021-03-10T17:03:09.354192+0000 mgr.gibba045.orlgmj (mgr.34412) 10244 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:03:11.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:03:11 gibba045 bash[25517]: cephadm 2021-03-10T17:03:09.354659+0000 mgr.gibba045.orlgmj (mgr.34412) 10245 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:03:11.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:03:11 gibba045 bash[25517]: cephadm 2021-03-10T17:03:09.358323+0000 mgr.gibba045.orlgmj (mgr.34412) 10246 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:03:11.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:03:11 gibba045 bash[25517]: cephadm 2021-03-10T17:03:09.358714+0000 mgr.gibba045.orlgmj (mgr.34412) 10247 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:03:11.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:03:11 gibba045 bash[25517]: cephadm 2021-03-10T17:03:09.361820+0000 mgr.gibba045.orlgmj (mgr.34412) 10248 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:03:11.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:03:11 gibba045 bash[25517]: cephadm 2021-03-10T17:03:09.365074+0000 mgr.gibba045.orlgmj (mgr.34412) 10249 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:03:11.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:03:11 gibba045 bash[25517]: cephadm 2021-03-10T17:03:09.365534+0000 mgr.gibba045.orlgmj (mgr.34412) 10250 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:03:11.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:03:11 gibba045 bash[25517]: cephadm 2021-03-10T17:03:09.368955+0000 mgr.gibba045.orlgmj (mgr.34412) 10251 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:03:11.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:03:11 gibba045 bash[25517]: cephadm 2021-03-10T17:03:09.370910+0000 mgr.gibba045.orlgmj (mgr.34412) 10252 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:03:11.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:03:11 gibba045 bash[25517]: cephadm 2021-03-10T17:03:09.373719+0000 mgr.gibba045.orlgmj (mgr.34412) 10253 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:03:11.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:03:11 gibba045 bash[25517]: cephadm 2021-03-10T17:03:09.374013+0000 mgr.gibba045.orlgmj (mgr.34412) 10254 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:03:11.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:03:11 gibba045 bash[25517]: cephadm 2021-03-10T17:03:09.374872+0000 mgr.gibba045.orlgmj (mgr.34412) 10255 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:03:11.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:03:11 gibba045 bash[25517]: cluster 2021-03-10T17:03:09.450431+0000 mgr.gibba045.orlgmj (mgr.34412) 10256 : cluster [DBG] pgmap v5839: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:13.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:03:13 gibba015 bash[29377]: cluster 2021-03-10T17:03:11.451342+0000 mgr.gibba045.orlgmj (mgr.34412) 10257 : cluster [DBG] pgmap v5840: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:13.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:03:13 gibba015 bash[30343]: cluster 2021-03-10T17:03:11.451342+0000 mgr.gibba045.orlgmj (mgr.34412) 10257 : cluster [DBG] pgmap v5840: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:13.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:03:13 gibba045 bash[25517]: cluster 2021-03-10T17:03:11.451342+0000 mgr.gibba045.orlgmj (mgr.34412) 10257 : cluster [DBG] pgmap v5840: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:13.787 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:03:14.016 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:03:14.016 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 6m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:03:14.016 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 5m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:03:14.016 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:03:14.017 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:03:14.017 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:03:14.017 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:03:14.017 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:03:14.018 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:03:14.018 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 6m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:03:14.018 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 5m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:03:14.018 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:03:14.019 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:03:14.019 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:03:14.019 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:03:14.019 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:03:14.020 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:03:14.020 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:03:14.020 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:03:14.020 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 5m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:03:14.021 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 5m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:03:14.263 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:03:14.263 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:03:14.264 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:03:14.264 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:03:14.264 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:03:14.264 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:03:14.265 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:03:14.265 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:03:14.265 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:03:14.265 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:03:14.265 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:03:14.266 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:03:14.266 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:03:14.266 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:03:14.266 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:03:15.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:03:15 gibba015 bash[29377]: cluster 2021-03-10T17:03:13.452696+0000 mgr.gibba045.orlgmj (mgr.34412) 10258 : cluster [DBG] pgmap v5841: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:15.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:03:15 gibba015 bash[29377]: audit 2021-03-10T17:03:13.779537+0000 mgr.gibba045.orlgmj (mgr.34412) 10259 : audit [DBG] from='client.50928 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:03:15.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:03:15 gibba015 bash[29377]: audit 2021-03-10T17:03:14.003914+0000 mgr.gibba045.orlgmj (mgr.34412) 10260 : audit [DBG] from='client.60922 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:03:15.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:03:15 gibba015 bash[29377]: audit 2021-03-10T17:03:14.262508+0000 mon.a (mon.0) 2208 : audit [DBG] from='client.? 172.21.2.115:0/188240383' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:03:15.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:03:15 gibba015 bash[30343]: cluster 2021-03-10T17:03:13.452696+0000 mgr.gibba045.orlgmj (mgr.34412) 10258 : cluster [DBG] pgmap v5841: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:15.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:03:15 gibba015 bash[30343]: audit 2021-03-10T17:03:13.779537+0000 mgr.gibba045.orlgmj (mgr.34412) 10259 : audit [DBG] from='client.50928 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:03:15.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:03:15 gibba015 bash[30343]: audit 2021-03-10T17:03:14.003914+0000 mgr.gibba045.orlgmj (mgr.34412) 10260 : audit [DBG] from='client.60922 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:03:15.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:03:15 gibba015 bash[30343]: audit 2021-03-10T17:03:14.262508+0000 mon.a (mon.0) 2208 : audit [DBG] from='client.? 172.21.2.115:0/188240383' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:03:15.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:03:15 gibba045 bash[25517]: cluster 2021-03-10T17:03:13.452696+0000 mgr.gibba045.orlgmj (mgr.34412) 10258 : cluster [DBG] pgmap v5841: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:15.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:03:15 gibba045 bash[25517]: audit 2021-03-10T17:03:13.779537+0000 mgr.gibba045.orlgmj (mgr.34412) 10259 : audit [DBG] from='client.50928 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:03:15.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:03:15 gibba045 bash[25517]: audit 2021-03-10T17:03:14.003914+0000 mgr.gibba045.orlgmj (mgr.34412) 10260 : audit [DBG] from='client.60922 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:03:15.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:03:15 gibba045 bash[25517]: audit 2021-03-10T17:03:14.262508+0000 mon.a (mon.0) 2208 : audit [DBG] from='client.? 172.21.2.115:0/188240383' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:03:17.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:03:17 gibba015 bash[29377]: cluster 2021-03-10T17:03:15.454210+0000 mgr.gibba045.orlgmj (mgr.34412) 10261 : cluster [DBG] pgmap v5842: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:17.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:03:17 gibba015 bash[30343]: cluster 2021-03-10T17:03:15.454210+0000 mgr.gibba045.orlgmj (mgr.34412) 10261 : cluster [DBG] pgmap v5842: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:17.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:03:17 gibba045 bash[25517]: cluster 2021-03-10T17:03:15.454210+0000 mgr.gibba045.orlgmj (mgr.34412) 10261 : cluster [DBG] pgmap v5842: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:19.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:03:19 gibba015 bash[29377]: cluster 2021-03-10T17:03:17.455844+0000 mgr.gibba045.orlgmj (mgr.34412) 10262 : cluster [DBG] pgmap v5843: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:19.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:03:19 gibba015 bash[30343]: cluster 2021-03-10T17:03:17.455844+0000 mgr.gibba045.orlgmj (mgr.34412) 10262 : cluster [DBG] pgmap v5843: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:19.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:03:19 gibba045 bash[25517]: cluster 2021-03-10T17:03:17.455844+0000 mgr.gibba045.orlgmj (mgr.34412) 10262 : cluster [DBG] pgmap v5843: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:21.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:03:21 gibba015 bash[29377]: cluster 2021-03-10T17:03:19.456656+0000 mgr.gibba045.orlgmj (mgr.34412) 10263 : cluster [DBG] pgmap v5844: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:21.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:03:21 gibba015 bash[30343]: cluster 2021-03-10T17:03:19.456656+0000 mgr.gibba045.orlgmj (mgr.34412) 10263 : cluster [DBG] pgmap v5844: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:21.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:03:21 gibba045 bash[25517]: cluster 2021-03-10T17:03:19.456656+0000 mgr.gibba045.orlgmj (mgr.34412) 10263 : cluster [DBG] pgmap v5844: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:23.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:03:23 gibba015 bash[29377]: cluster 2021-03-10T17:03:21.458548+0000 mgr.gibba045.orlgmj (mgr.34412) 10264 : cluster [DBG] pgmap v5845: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:23.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:03:23 gibba015 bash[30343]: cluster 2021-03-10T17:03:21.458548+0000 mgr.gibba045.orlgmj (mgr.34412) 10264 : cluster [DBG] pgmap v5845: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:23.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:03:23 gibba045 bash[25517]: cluster 2021-03-10T17:03:21.458548+0000 mgr.gibba045.orlgmj (mgr.34412) 10264 : cluster [DBG] pgmap v5845: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:25.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:03:25 gibba045 bash[25517]: cluster 2021-03-10T17:03:23.459818+0000 mgr.gibba045.orlgmj (mgr.34412) 10265 : cluster [DBG] pgmap v5846: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:25.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:03:25 gibba015 bash[29377]: cluster 2021-03-10T17:03:23.459818+0000 mgr.gibba045.orlgmj (mgr.34412) 10265 : cluster [DBG] pgmap v5846: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:25.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:03:25 gibba015 bash[30343]: cluster 2021-03-10T17:03:23.459818+0000 mgr.gibba045.orlgmj (mgr.34412) 10265 : cluster [DBG] pgmap v5846: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:26.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:03:26 gibba045 bash[25517]: cephadm 2021-03-10T17:03:24.379500+0000 mgr.gibba045.orlgmj (mgr.34412) 10266 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:03:26.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:03:26 gibba015 bash[29377]: cephadm 2021-03-10T17:03:24.379500+0000 mgr.gibba045.orlgmj (mgr.34412) 10266 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:03:26.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:03:26 gibba015 bash[30343]: cephadm 2021-03-10T17:03:24.379500+0000 mgr.gibba045.orlgmj (mgr.34412) 10266 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:03:27.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:03:27 gibba045 bash[25517]: cluster 2021-03-10T17:03:25.461445+0000 mgr.gibba045.orlgmj (mgr.34412) 10267 : cluster [DBG] pgmap v5847: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:27.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:03:27 gibba015 bash[29377]: cluster 2021-03-10T17:03:25.461445+0000 mgr.gibba045.orlgmj (mgr.34412) 10267 : cluster [DBG] pgmap v5847: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:27.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:03:27 gibba015 bash[30343]: cluster 2021-03-10T17:03:25.461445+0000 mgr.gibba045.orlgmj (mgr.34412) 10267 : cluster [DBG] pgmap v5847: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:29.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:03:29 gibba045 bash[25517]: cluster 2021-03-10T17:03:27.462106+0000 mgr.gibba045.orlgmj (mgr.34412) 10268 : cluster [DBG] pgmap v5848: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:29.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:03:29 gibba015 bash[29377]: cluster 2021-03-10T17:03:27.462106+0000 mgr.gibba045.orlgmj (mgr.34412) 10268 : cluster [DBG] pgmap v5848: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:29.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:03:29 gibba015 bash[30343]: cluster 2021-03-10T17:03:27.462106+0000 mgr.gibba045.orlgmj (mgr.34412) 10268 : cluster [DBG] pgmap v5848: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:31.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:03:31 gibba045 bash[25517]: cluster 2021-03-10T17:03:29.463229+0000 mgr.gibba045.orlgmj (mgr.34412) 10269 : cluster [DBG] pgmap v5849: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:31.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:03:31 gibba015 bash[29377]: cluster 2021-03-10T17:03:29.463229+0000 mgr.gibba045.orlgmj (mgr.34412) 10269 : cluster [DBG] pgmap v5849: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:31.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:03:31 gibba015 bash[30343]: cluster 2021-03-10T17:03:29.463229+0000 mgr.gibba045.orlgmj (mgr.34412) 10269 : cluster [DBG] pgmap v5849: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:33.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:03:33 gibba015 bash[29377]: cluster 2021-03-10T17:03:31.464990+0000 mgr.gibba045.orlgmj (mgr.34412) 10270 : cluster [DBG] pgmap v5850: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:33.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:03:33 gibba015 bash[30343]: cluster 2021-03-10T17:03:31.464990+0000 mgr.gibba045.orlgmj (mgr.34412) 10270 : cluster [DBG] pgmap v5850: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:33.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:03:33 gibba045 bash[25517]: cluster 2021-03-10T17:03:31.464990+0000 mgr.gibba045.orlgmj (mgr.34412) 10270 : cluster [DBG] pgmap v5850: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:35.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:03:35 gibba015 bash[29377]: cluster 2021-03-10T17:03:33.466337+0000 mgr.gibba045.orlgmj (mgr.34412) 10271 : cluster [DBG] pgmap v5851: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:35.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:03:35 gibba015 bash[30343]: cluster 2021-03-10T17:03:33.466337+0000 mgr.gibba045.orlgmj (mgr.34412) 10271 : cluster [DBG] pgmap v5851: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:35.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:03:35 gibba045 bash[25517]: cluster 2021-03-10T17:03:33.466337+0000 mgr.gibba045.orlgmj (mgr.34412) 10271 : cluster [DBG] pgmap v5851: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:37.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:03:37 gibba015 bash[29377]: cluster 2021-03-10T17:03:35.467256+0000 mgr.gibba045.orlgmj (mgr.34412) 10272 : cluster [DBG] pgmap v5852: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:37.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:03:37 gibba015 bash[30343]: cluster 2021-03-10T17:03:35.467256+0000 mgr.gibba045.orlgmj (mgr.34412) 10272 : cluster [DBG] pgmap v5852: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:37.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:03:37 gibba045 bash[25517]: cluster 2021-03-10T17:03:35.467256+0000 mgr.gibba045.orlgmj (mgr.34412) 10272 : cluster [DBG] pgmap v5852: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:39.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:03:39 gibba015 bash[29377]: cluster 2021-03-10T17:03:37.468923+0000 mgr.gibba045.orlgmj (mgr.34412) 10273 : cluster [DBG] pgmap v5853: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:39.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:03:39 gibba015 bash[30343]: cluster 2021-03-10T17:03:37.468923+0000 mgr.gibba045.orlgmj (mgr.34412) 10273 : cluster [DBG] pgmap v5853: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:39.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:03:39 gibba045 bash[25517]: cluster 2021-03-10T17:03:37.468923+0000 mgr.gibba045.orlgmj (mgr.34412) 10273 : cluster [DBG] pgmap v5853: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:41.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:03:41 gibba015 bash[29377]: cephadm 2021-03-10T17:03:39.395522+0000 mgr.gibba045.orlgmj (mgr.34412) 10274 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:03:41.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:03:41 gibba015 bash[29377]: cluster 2021-03-10T17:03:39.470348+0000 mgr.gibba045.orlgmj (mgr.34412) 10275 : cluster [DBG] pgmap v5854: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:41.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:03:41 gibba015 bash[30343]: cephadm 2021-03-10T17:03:39.395522+0000 mgr.gibba045.orlgmj (mgr.34412) 10274 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:03:41.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:03:41 gibba015 bash[30343]: cluster 2021-03-10T17:03:39.470348+0000 mgr.gibba045.orlgmj (mgr.34412) 10275 : cluster [DBG] pgmap v5854: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:41.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:03:41 gibba045 bash[25517]: cephadm 2021-03-10T17:03:39.395522+0000 mgr.gibba045.orlgmj (mgr.34412) 10274 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:03:41.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:03:41 gibba045 bash[25517]: cluster 2021-03-10T17:03:39.470348+0000 mgr.gibba045.orlgmj (mgr.34412) 10275 : cluster [DBG] pgmap v5854: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:43.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:03:43 gibba015 bash[29377]: cluster 2021-03-10T17:03:41.472380+0000 mgr.gibba045.orlgmj (mgr.34412) 10276 : cluster [DBG] pgmap v5855: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:43.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:03:43 gibba015 bash[30343]: cluster 2021-03-10T17:03:41.472380+0000 mgr.gibba045.orlgmj (mgr.34412) 10276 : cluster [DBG] pgmap v5855: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:43.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:03:43 gibba045 bash[25517]: cluster 2021-03-10T17:03:41.472380+0000 mgr.gibba045.orlgmj (mgr.34412) 10276 : cluster [DBG] pgmap v5855: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:44.506 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:03:44.740 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:03:44.741 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 6m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:03:44.741 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 5m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:03:44.741 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:03:44.741 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:03:44.742 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:03:44.742 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:03:44.742 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:03:44.742 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:03:44.743 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 6m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:03:44.743 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 5m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:03:44.743 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:03:44.743 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:03:44.743 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:03:44.744 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:03:44.744 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:03:44.744 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:03:44.744 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:03:44.745 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:03:44.745 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 5m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:03:44.745 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 5m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:03:44.990 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:03:44.990 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:03:44.991 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:03:44.991 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:03:44.991 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:03:44.991 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:03:44.992 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:03:44.992 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:03:44.992 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:03:44.992 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:03:44.992 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:03:44.993 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:03:44.993 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:03:44.993 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:03:44.993 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:03:45.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:03:45 gibba045 bash[25517]: cluster 2021-03-10T17:03:43.472999+0000 mgr.gibba045.orlgmj (mgr.34412) 10277 : cluster [DBG] pgmap v5856: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:45.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:03:45 gibba045 bash[25517]: audit 2021-03-10T17:03:44.989459+0000 mon.a (mon.0) 2209 : audit [DBG] from='client.? 172.21.2.115:0/155626822' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:03:45.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:03:45 gibba015 bash[29377]: cluster 2021-03-10T17:03:43.472999+0000 mgr.gibba045.orlgmj (mgr.34412) 10277 : cluster [DBG] pgmap v5856: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:45.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:03:45 gibba015 bash[29377]: audit 2021-03-10T17:03:44.989459+0000 mon.a (mon.0) 2209 : audit [DBG] from='client.? 172.21.2.115:0/155626822' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:03:45.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:03:45 gibba015 bash[30343]: cluster 2021-03-10T17:03:43.472999+0000 mgr.gibba045.orlgmj (mgr.34412) 10277 : cluster [DBG] pgmap v5856: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:45.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:03:45 gibba015 bash[30343]: audit 2021-03-10T17:03:44.989459+0000 mon.a (mon.0) 2209 : audit [DBG] from='client.? 172.21.2.115:0/155626822' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:03:46.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:03:46 gibba045 bash[25517]: audit 2021-03-10T17:03:44.498567+0000 mgr.gibba045.orlgmj (mgr.34412) 10278 : audit [DBG] from='client.60934 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:03:46.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:03:46 gibba045 bash[25517]: audit 2021-03-10T17:03:44.729508+0000 mgr.gibba045.orlgmj (mgr.34412) 10279 : audit [DBG] from='client.60940 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:03:46.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:03:46 gibba015 bash[29377]: audit 2021-03-10T17:03:44.498567+0000 mgr.gibba045.orlgmj (mgr.34412) 10278 : audit [DBG] from='client.60934 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:03:46.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:03:46 gibba015 bash[29377]: audit 2021-03-10T17:03:44.729508+0000 mgr.gibba045.orlgmj (mgr.34412) 10279 : audit [DBG] from='client.60940 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:03:46.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:03:46 gibba015 bash[30343]: audit 2021-03-10T17:03:44.498567+0000 mgr.gibba045.orlgmj (mgr.34412) 10278 : audit [DBG] from='client.60934 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:03:46.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:03:46 gibba015 bash[30343]: audit 2021-03-10T17:03:44.729508+0000 mgr.gibba045.orlgmj (mgr.34412) 10279 : audit [DBG] from='client.60940 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:03:47.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:03:47 gibba045 bash[25517]: cluster 2021-03-10T17:03:45.474432+0000 mgr.gibba045.orlgmj (mgr.34412) 10280 : cluster [DBG] pgmap v5857: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:47.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:03:47 gibba015 bash[29377]: cluster 2021-03-10T17:03:45.474432+0000 mgr.gibba045.orlgmj (mgr.34412) 10280 : cluster [DBG] pgmap v5857: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:47.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:03:47 gibba015 bash[30343]: cluster 2021-03-10T17:03:45.474432+0000 mgr.gibba045.orlgmj (mgr.34412) 10280 : cluster [DBG] pgmap v5857: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:49.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:03:49 gibba045 bash[25517]: cluster 2021-03-10T17:03:47.475969+0000 mgr.gibba045.orlgmj (mgr.34412) 10281 : cluster [DBG] pgmap v5858: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:49.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:03:49 gibba015 bash[29377]: cluster 2021-03-10T17:03:47.475969+0000 mgr.gibba045.orlgmj (mgr.34412) 10281 : cluster [DBG] pgmap v5858: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:49.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:03:49 gibba015 bash[30343]: cluster 2021-03-10T17:03:47.475969+0000 mgr.gibba045.orlgmj (mgr.34412) 10281 : cluster [DBG] pgmap v5858: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:51.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:03:51 gibba045 bash[25517]: cluster 2021-03-10T17:03:49.477186+0000 mgr.gibba045.orlgmj (mgr.34412) 10282 : cluster [DBG] pgmap v5859: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:51.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:03:51 gibba015 bash[29377]: cluster 2021-03-10T17:03:49.477186+0000 mgr.gibba045.orlgmj (mgr.34412) 10282 : cluster [DBG] pgmap v5859: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:51.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:03:51 gibba015 bash[30343]: cluster 2021-03-10T17:03:49.477186+0000 mgr.gibba045.orlgmj (mgr.34412) 10282 : cluster [DBG] pgmap v5859: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:53.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:03:53 gibba045 bash[25517]: cluster 2021-03-10T17:03:51.478269+0000 mgr.gibba045.orlgmj (mgr.34412) 10283 : cluster [DBG] pgmap v5860: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:53.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:03:53 gibba015 bash[29377]: cluster 2021-03-10T17:03:51.478269+0000 mgr.gibba045.orlgmj (mgr.34412) 10283 : cluster [DBG] pgmap v5860: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:53.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:03:53 gibba015 bash[30343]: cluster 2021-03-10T17:03:51.478269+0000 mgr.gibba045.orlgmj (mgr.34412) 10283 : cluster [DBG] pgmap v5860: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:03:54 gibba045 bash[25517]: audit 2021-03-10T17:03:53.830209+0000 mon.c (mon.1) 2819 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:03:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:03:54 gibba045 bash[25517]: audit 2021-03-10T17:03:53.831351+0000 mon.a (mon.0) 2210 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:03:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:03:54 gibba045 bash[25517]: audit 2021-03-10T17:03:53.835911+0000 mon.c (mon.1) 2820 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:03:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:03:54 gibba045 bash[25517]: audit 2021-03-10T17:03:53.836984+0000 mon.a (mon.0) 2211 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:03:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:03:54 gibba045 bash[25517]: audit 2021-03-10T17:03:53.894373+0000 mon.c (mon.1) 2821 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T17:03:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:03:54 gibba045 bash[25517]: audit 2021-03-10T17:03:53.895129+0000 mon.c (mon.1) 2822 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:03:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:03:54 gibba045 bash[25517]: audit 2021-03-10T17:03:53.895760+0000 mon.a (mon.0) 2212 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T17:03:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:03:54 gibba045 bash[25517]: audit 2021-03-10T17:03:53.896256+0000 mon.c (mon.1) 2823 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:03:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:03:54 gibba045 bash[25517]: audit 2021-03-10T17:03:53.897750+0000 mon.c (mon.1) 2824 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:03:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:03:54 gibba045 bash[25517]: audit 2021-03-10T17:03:53.898312+0000 mon.a (mon.0) 2213 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:03:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:03:54 gibba045 bash[25517]: audit 2021-03-10T17:03:53.899578+0000 mon.a (mon.0) 2214 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:03:54.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:03:54 gibba045 bash[25517]: audit 2021-03-10T17:03:53.899753+0000 mon.a (mon.0) 2215 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:03:54.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:03:54 gibba015 bash[29377]: audit 2021-03-10T17:03:53.830209+0000 mon.c (mon.1) 2819 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:03:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:03:54 gibba015 bash[29377]: audit 2021-03-10T17:03:53.831351+0000 mon.a (mon.0) 2210 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:03:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:03:54 gibba015 bash[29377]: audit 2021-03-10T17:03:53.835911+0000 mon.c (mon.1) 2820 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:03:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:03:54 gibba015 bash[29377]: audit 2021-03-10T17:03:53.836984+0000 mon.a (mon.0) 2211 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:03:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:03:54 gibba015 bash[29377]: audit 2021-03-10T17:03:53.894373+0000 mon.c (mon.1) 2821 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T17:03:54.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:03:54 gibba015 bash[29377]: audit 2021-03-10T17:03:53.895129+0000 mon.c (mon.1) 2822 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:03:54.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:03:54 gibba015 bash[29377]: audit 2021-03-10T17:03:53.895760+0000 mon.a (mon.0) 2212 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T17:03:54.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:03:54 gibba015 bash[29377]: audit 2021-03-10T17:03:53.896256+0000 mon.c (mon.1) 2823 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:03:54.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:03:54 gibba015 bash[29377]: audit 2021-03-10T17:03:53.897750+0000 mon.c (mon.1) 2824 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:03:54.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:03:54 gibba015 bash[29377]: audit 2021-03-10T17:03:53.898312+0000 mon.a (mon.0) 2213 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:03:54.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:03:54 gibba015 bash[29377]: audit 2021-03-10T17:03:53.899578+0000 mon.a (mon.0) 2214 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:03:54.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:03:54 gibba015 bash[29377]: audit 2021-03-10T17:03:53.899753+0000 mon.a (mon.0) 2215 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:03:54.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:03:54 gibba015 bash[30343]: audit 2021-03-10T17:03:53.830209+0000 mon.c (mon.1) 2819 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:03:54.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:03:54 gibba015 bash[30343]: audit 2021-03-10T17:03:53.831351+0000 mon.a (mon.0) 2210 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:03:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:03:54 gibba015 bash[30343]: audit 2021-03-10T17:03:53.835911+0000 mon.c (mon.1) 2820 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:03:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:03:54 gibba015 bash[30343]: audit 2021-03-10T17:03:53.836984+0000 mon.a (mon.0) 2211 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:03:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:03:54 gibba015 bash[30343]: audit 2021-03-10T17:03:53.894373+0000 mon.c (mon.1) 2821 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T17:03:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:03:54 gibba015 bash[30343]: audit 2021-03-10T17:03:53.895129+0000 mon.c (mon.1) 2822 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:03:54.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:03:54 gibba015 bash[30343]: audit 2021-03-10T17:03:53.895760+0000 mon.a (mon.0) 2212 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T17:03:54.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:03:54 gibba015 bash[30343]: audit 2021-03-10T17:03:53.896256+0000 mon.c (mon.1) 2823 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:03:54.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:03:54 gibba015 bash[30343]: audit 2021-03-10T17:03:53.897750+0000 mon.c (mon.1) 2824 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:03:54.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:03:54 gibba015 bash[30343]: audit 2021-03-10T17:03:53.898312+0000 mon.a (mon.0) 2213 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:03:54.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:03:54 gibba015 bash[30343]: audit 2021-03-10T17:03:53.899578+0000 mon.a (mon.0) 2214 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:03:54.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:03:54 gibba015 bash[30343]: audit 2021-03-10T17:03:53.899753+0000 mon.a (mon.0) 2215 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:03:55.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:03:55 gibba045 bash[25517]: cluster 2021-03-10T17:03:53.479416+0000 mgr.gibba045.orlgmj (mgr.34412) 10284 : cluster [DBG] pgmap v5861: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:55.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:03:55 gibba045 bash[25517]: cephadm 2021-03-10T17:03:54.411634+0000 mgr.gibba045.orlgmj (mgr.34412) 10285 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:03:55.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:03:55 gibba015 bash[29377]: cluster 2021-03-10T17:03:53.479416+0000 mgr.gibba045.orlgmj (mgr.34412) 10284 : cluster [DBG] pgmap v5861: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:55.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:03:55 gibba015 bash[29377]: cephadm 2021-03-10T17:03:54.411634+0000 mgr.gibba045.orlgmj (mgr.34412) 10285 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:03:55.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:03:55 gibba015 bash[30343]: cluster 2021-03-10T17:03:53.479416+0000 mgr.gibba045.orlgmj (mgr.34412) 10284 : cluster [DBG] pgmap v5861: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:55.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:03:55 gibba015 bash[30343]: cephadm 2021-03-10T17:03:54.411634+0000 mgr.gibba045.orlgmj (mgr.34412) 10285 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:03:56.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:03:56 gibba045 bash[25517]: cluster 2021-03-10T17:03:55.481007+0000 mgr.gibba045.orlgmj (mgr.34412) 10286 : cluster [DBG] pgmap v5862: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:56.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:03:56 gibba015 bash[29377]: cluster 2021-03-10T17:03:55.481007+0000 mgr.gibba045.orlgmj (mgr.34412) 10286 : cluster [DBG] pgmap v5862: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:56.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:03:56 gibba015 bash[30343]: cluster 2021-03-10T17:03:55.481007+0000 mgr.gibba045.orlgmj (mgr.34412) 10286 : cluster [DBG] pgmap v5862: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:59.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:03:59 gibba015 bash[29377]: cluster 2021-03-10T17:03:57.482539+0000 mgr.gibba045.orlgmj (mgr.34412) 10287 : cluster [DBG] pgmap v5863: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:59.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:03:59 gibba015 bash[30343]: cluster 2021-03-10T17:03:57.482539+0000 mgr.gibba045.orlgmj (mgr.34412) 10287 : cluster [DBG] pgmap v5863: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:59.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:03:59 gibba045 bash[25517]: cluster 2021-03-10T17:03:57.482539+0000 mgr.gibba045.orlgmj (mgr.34412) 10287 : cluster [DBG] pgmap v5863: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:01.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:04:01 gibba015 bash[29377]: cluster 2021-03-10T17:03:59.483265+0000 mgr.gibba045.orlgmj (mgr.34412) 10288 : cluster [DBG] pgmap v5864: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:01.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:04:01 gibba015 bash[30343]: cluster 2021-03-10T17:03:59.483265+0000 mgr.gibba045.orlgmj (mgr.34412) 10288 : cluster [DBG] pgmap v5864: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:01.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:04:01 gibba045 bash[25517]: cluster 2021-03-10T17:03:59.483265+0000 mgr.gibba045.orlgmj (mgr.34412) 10288 : cluster [DBG] pgmap v5864: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:03.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:04:03 gibba015 bash[29377]: cluster 2021-03-10T17:04:01.485141+0000 mgr.gibba045.orlgmj (mgr.34412) 10289 : cluster [DBG] pgmap v5865: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:03.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:04:03 gibba015 bash[30343]: cluster 2021-03-10T17:04:01.485141+0000 mgr.gibba045.orlgmj (mgr.34412) 10289 : cluster [DBG] pgmap v5865: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:03.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:04:03 gibba045 bash[25517]: cluster 2021-03-10T17:04:01.485141+0000 mgr.gibba045.orlgmj (mgr.34412) 10289 : cluster [DBG] pgmap v5865: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:05.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:04:05 gibba015 bash[29377]: cluster 2021-03-10T17:04:03.486237+0000 mgr.gibba045.orlgmj (mgr.34412) 10290 : cluster [DBG] pgmap v5866: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:05.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:04:05 gibba015 bash[30343]: cluster 2021-03-10T17:04:03.486237+0000 mgr.gibba045.orlgmj (mgr.34412) 10290 : cluster [DBG] pgmap v5866: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:05.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:04:05 gibba045 bash[25517]: cluster 2021-03-10T17:04:03.486237+0000 mgr.gibba045.orlgmj (mgr.34412) 10290 : cluster [DBG] pgmap v5866: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:07.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:04:07 gibba045 bash[25517]: cluster 2021-03-10T17:04:05.487625+0000 mgr.gibba045.orlgmj (mgr.34412) 10291 : cluster [DBG] pgmap v5867: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:07.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:04:07 gibba015 bash[29377]: cluster 2021-03-10T17:04:05.487625+0000 mgr.gibba045.orlgmj (mgr.34412) 10291 : cluster [DBG] pgmap v5867: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:07.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:04:07 gibba015 bash[30343]: cluster 2021-03-10T17:04:05.487625+0000 mgr.gibba045.orlgmj (mgr.34412) 10291 : cluster [DBG] pgmap v5867: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:09.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:04:09 gibba045 bash[25517]: cluster 2021-03-10T17:04:07.488454+0000 mgr.gibba045.orlgmj (mgr.34412) 10292 : cluster [DBG] pgmap v5868: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:09.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:04:09 gibba015 bash[29377]: cluster 2021-03-10T17:04:07.488454+0000 mgr.gibba045.orlgmj (mgr.34412) 10292 : cluster [DBG] pgmap v5868: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:09.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:04:09 gibba015 bash[30343]: cluster 2021-03-10T17:04:07.488454+0000 mgr.gibba045.orlgmj (mgr.34412) 10292 : cluster [DBG] pgmap v5868: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:10.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:04:10 gibba045 bash[25517]: audit 2021-03-10T17:04:09.426636+0000 mon.c (mon.1) 2825 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:04:10.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:04:10 gibba045 bash[25517]: audit 2021-03-10T17:04:09.631838+0000 mon.a (mon.0) 2216 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:04:10.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:04:10 gibba045 bash[25517]: audit 2021-03-10T17:04:09.640763+0000 mon.a (mon.0) 2217 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:04:10.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:04:10 gibba045 bash[25517]: audit 2021-03-10T17:04:09.829383+0000 mon.a (mon.0) 2218 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:04:10.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:04:10 gibba045 bash[25517]: audit 2021-03-10T17:04:09.833348+0000 mon.c (mon.1) 2826 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:04:10.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:04:10 gibba045 bash[25517]: audit 2021-03-10T17:04:09.834982+0000 mon.c (mon.1) 2827 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:04:10.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:04:10 gibba045 bash[25517]: audit 2021-03-10T17:04:09.836381+0000 mon.c (mon.1) 2828 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:04:10.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:04:10 gibba045 bash[25517]: audit 2021-03-10T17:04:09.837528+0000 mon.c (mon.1) 2829 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:04:10.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:04:10 gibba045 bash[25517]: audit 2021-03-10T17:04:09.840292+0000 mon.c (mon.1) 2830 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:04:10.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:04:10 gibba045 bash[25517]: audit 2021-03-10T17:04:09.841668+0000 mon.c (mon.1) 2831 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:04:10.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:04:10 gibba015 bash[29377]: audit 2021-03-10T17:04:09.426636+0000 mon.c (mon.1) 2825 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:04:10.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:04:10 gibba015 bash[29377]: audit 2021-03-10T17:04:09.631838+0000 mon.a (mon.0) 2216 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:04:10.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:04:10 gibba015 bash[29377]: audit 2021-03-10T17:04:09.640763+0000 mon.a (mon.0) 2217 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:04:10.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:04:10 gibba015 bash[29377]: audit 2021-03-10T17:04:09.829383+0000 mon.a (mon.0) 2218 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:04:10.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:04:10 gibba015 bash[29377]: audit 2021-03-10T17:04:09.833348+0000 mon.c (mon.1) 2826 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:04:10.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:04:10 gibba015 bash[29377]: audit 2021-03-10T17:04:09.834982+0000 mon.c (mon.1) 2827 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:04:10.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:04:10 gibba015 bash[29377]: audit 2021-03-10T17:04:09.836381+0000 mon.c (mon.1) 2828 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:04:10.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:04:10 gibba015 bash[29377]: audit 2021-03-10T17:04:09.837528+0000 mon.c (mon.1) 2829 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:04:10.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:04:10 gibba015 bash[29377]: audit 2021-03-10T17:04:09.840292+0000 mon.c (mon.1) 2830 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:04:10.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:04:10 gibba015 bash[29377]: audit 2021-03-10T17:04:09.841668+0000 mon.c (mon.1) 2831 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:04:10.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:04:10 gibba015 bash[30343]: audit 2021-03-10T17:04:09.426636+0000 mon.c (mon.1) 2825 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:04:10.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:04:10 gibba015 bash[30343]: audit 2021-03-10T17:04:09.631838+0000 mon.a (mon.0) 2216 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:04:10.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:04:10 gibba015 bash[30343]: audit 2021-03-10T17:04:09.640763+0000 mon.a (mon.0) 2217 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:04:10.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:04:10 gibba015 bash[30343]: audit 2021-03-10T17:04:09.829383+0000 mon.a (mon.0) 2218 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:04:10.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:04:10 gibba015 bash[30343]: audit 2021-03-10T17:04:09.833348+0000 mon.c (mon.1) 2826 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:04:10.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:04:10 gibba015 bash[30343]: audit 2021-03-10T17:04:09.834982+0000 mon.c (mon.1) 2827 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:04:10.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:04:10 gibba015 bash[30343]: audit 2021-03-10T17:04:09.836381+0000 mon.c (mon.1) 2828 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:04:10.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:04:10 gibba015 bash[30343]: audit 2021-03-10T17:04:09.837528+0000 mon.c (mon.1) 2829 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:04:10.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:04:10 gibba015 bash[30343]: audit 2021-03-10T17:04:09.840292+0000 mon.c (mon.1) 2830 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:04:10.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:04:10 gibba015 bash[30343]: audit 2021-03-10T17:04:09.841668+0000 mon.c (mon.1) 2831 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:04:11.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:04:11 gibba045 bash[25517]: cluster 2021-03-10T17:04:09.488815+0000 mgr.gibba045.orlgmj (mgr.34412) 10293 : cluster [DBG] pgmap v5869: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:11.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:04:11 gibba045 bash[25517]: cephadm 2021-03-10T17:04:09.635230+0000 mgr.gibba045.orlgmj (mgr.34412) 10294 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:04:11.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:04:11 gibba045 bash[25517]: cephadm 2021-03-10T17:04:09.643765+0000 mgr.gibba045.orlgmj (mgr.34412) 10295 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:04:11.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:04:11 gibba045 bash[25517]: cephadm 2021-03-10T17:04:09.834402+0000 mgr.gibba045.orlgmj (mgr.34412) 10296 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:04:11.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:04:11 gibba045 bash[25517]: cephadm 2021-03-10T17:04:09.836637+0000 mgr.gibba045.orlgmj (mgr.34412) 10297 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:04:11.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:04:11 gibba045 bash[25517]: cephadm 2021-03-10T17:04:09.837944+0000 mgr.gibba045.orlgmj (mgr.34412) 10298 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:04:11.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:04:11 gibba045 bash[25517]: cephadm 2021-03-10T17:04:09.837982+0000 mgr.gibba045.orlgmj (mgr.34412) 10299 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:04:11.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:04:11 gibba045 bash[25517]: cephadm 2021-03-10T17:04:09.839224+0000 mgr.gibba045.orlgmj (mgr.34412) 10300 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:04:11.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:04:11 gibba045 bash[25517]: cephadm 2021-03-10T17:04:09.839261+0000 mgr.gibba045.orlgmj (mgr.34412) 10301 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:04:11.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:04:11 gibba045 bash[25517]: cephadm 2021-03-10T17:04:09.840334+0000 mgr.gibba045.orlgmj (mgr.34412) 10302 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:04:11.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:04:11 gibba045 bash[25517]: cephadm 2021-03-10T17:04:09.841982+0000 mgr.gibba045.orlgmj (mgr.34412) 10303 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:04:11.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:04:11 gibba045 bash[25517]: cephadm 2021-03-10T17:04:09.842019+0000 mgr.gibba045.orlgmj (mgr.34412) 10304 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:04:11.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:04:11 gibba045 bash[25517]: cephadm 2021-03-10T17:04:09.843127+0000 mgr.gibba045.orlgmj (mgr.34412) 10305 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:04:11.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:04:11 gibba045 bash[25517]: cephadm 2021-03-10T17:04:09.843437+0000 mgr.gibba045.orlgmj (mgr.34412) 10306 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:04:11.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:04:11 gibba045 bash[25517]: cephadm 2021-03-10T17:04:09.844589+0000 mgr.gibba045.orlgmj (mgr.34412) 10307 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:04:11.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:04:11 gibba045 bash[25517]: cephadm 2021-03-10T17:04:09.844627+0000 mgr.gibba045.orlgmj (mgr.34412) 10308 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:04:11.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:04:11 gibba045 bash[25517]: cephadm 2021-03-10T17:04:09.844731+0000 mgr.gibba045.orlgmj (mgr.34412) 10309 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:04:11.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:04:11 gibba015 bash[29377]: cluster 2021-03-10T17:04:09.488815+0000 mgr.gibba045.orlgmj (mgr.34412) 10293 : cluster [DBG] pgmap v5869: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:11.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:04:11 gibba015 bash[29377]: cephadm 2021-03-10T17:04:09.635230+0000 mgr.gibba045.orlgmj (mgr.34412) 10294 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:04:11.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:04:11 gibba015 bash[29377]: cephadm 2021-03-10T17:04:09.643765+0000 mgr.gibba045.orlgmj (mgr.34412) 10295 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:04:11.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:04:11 gibba015 bash[29377]: cephadm 2021-03-10T17:04:09.834402+0000 mgr.gibba045.orlgmj (mgr.34412) 10296 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:04:11.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:04:11 gibba015 bash[29377]: cephadm 2021-03-10T17:04:09.836637+0000 mgr.gibba045.orlgmj (mgr.34412) 10297 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:04:11.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:04:11 gibba015 bash[29377]: cephadm 2021-03-10T17:04:09.837944+0000 mgr.gibba045.orlgmj (mgr.34412) 10298 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:04:11.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:04:11 gibba015 bash[29377]: cephadm 2021-03-10T17:04:09.837982+0000 mgr.gibba045.orlgmj (mgr.34412) 10299 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:04:11.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:04:11 gibba015 bash[29377]: cephadm 2021-03-10T17:04:09.839224+0000 mgr.gibba045.orlgmj (mgr.34412) 10300 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:04:11.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:04:11 gibba015 bash[29377]: cephadm 2021-03-10T17:04:09.839261+0000 mgr.gibba045.orlgmj (mgr.34412) 10301 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:04:11.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:04:11 gibba015 bash[29377]: cephadm 2021-03-10T17:04:09.840334+0000 mgr.gibba045.orlgmj (mgr.34412) 10302 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:04:11.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:04:11 gibba015 bash[29377]: cephadm 2021-03-10T17:04:09.841982+0000 mgr.gibba045.orlgmj (mgr.34412) 10303 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:04:11.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:04:11 gibba015 bash[29377]: cephadm 2021-03-10T17:04:09.842019+0000 mgr.gibba045.orlgmj (mgr.34412) 10304 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:04:11.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:04:11 gibba015 bash[29377]: cephadm 2021-03-10T17:04:09.843127+0000 mgr.gibba045.orlgmj (mgr.34412) 10305 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:04:11.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:04:11 gibba015 bash[29377]: cephadm 2021-03-10T17:04:09.843437+0000 mgr.gibba045.orlgmj (mgr.34412) 10306 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:04:11.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:04:11 gibba015 bash[29377]: cephadm 2021-03-10T17:04:09.844589+0000 mgr.gibba045.orlgmj (mgr.34412) 10307 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:04:11.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:04:11 gibba015 bash[29377]: cephadm 2021-03-10T17:04:09.844627+0000 mgr.gibba045.orlgmj (mgr.34412) 10308 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:04:11.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:04:11 gibba015 bash[29377]: cephadm 2021-03-10T17:04:09.844731+0000 mgr.gibba045.orlgmj (mgr.34412) 10309 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:04:11.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:04:11 gibba015 bash[30343]: cluster 2021-03-10T17:04:09.488815+0000 mgr.gibba045.orlgmj (mgr.34412) 10293 : cluster [DBG] pgmap v5869: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:11.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:04:11 gibba015 bash[30343]: cephadm 2021-03-10T17:04:09.635230+0000 mgr.gibba045.orlgmj (mgr.34412) 10294 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:04:11.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:04:11 gibba015 bash[30343]: cephadm 2021-03-10T17:04:09.643765+0000 mgr.gibba045.orlgmj (mgr.34412) 10295 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:04:11.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:04:11 gibba015 bash[30343]: cephadm 2021-03-10T17:04:09.834402+0000 mgr.gibba045.orlgmj (mgr.34412) 10296 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:04:11.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:04:11 gibba015 bash[30343]: cephadm 2021-03-10T17:04:09.836637+0000 mgr.gibba045.orlgmj (mgr.34412) 10297 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:04:11.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:04:11 gibba015 bash[30343]: cephadm 2021-03-10T17:04:09.837944+0000 mgr.gibba045.orlgmj (mgr.34412) 10298 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:04:11.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:04:11 gibba015 bash[30343]: cephadm 2021-03-10T17:04:09.837982+0000 mgr.gibba045.orlgmj (mgr.34412) 10299 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:04:11.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:04:11 gibba015 bash[30343]: cephadm 2021-03-10T17:04:09.839224+0000 mgr.gibba045.orlgmj (mgr.34412) 10300 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:04:11.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:04:11 gibba015 bash[30343]: cephadm 2021-03-10T17:04:09.839261+0000 mgr.gibba045.orlgmj (mgr.34412) 10301 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:04:11.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:04:11 gibba015 bash[30343]: cephadm 2021-03-10T17:04:09.840334+0000 mgr.gibba045.orlgmj (mgr.34412) 10302 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:04:11.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:04:11 gibba015 bash[30343]: cephadm 2021-03-10T17:04:09.841982+0000 mgr.gibba045.orlgmj (mgr.34412) 10303 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:04:11.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:04:11 gibba015 bash[30343]: cephadm 2021-03-10T17:04:09.842019+0000 mgr.gibba045.orlgmj (mgr.34412) 10304 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:04:11.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:04:11 gibba015 bash[30343]: cephadm 2021-03-10T17:04:09.843127+0000 mgr.gibba045.orlgmj (mgr.34412) 10305 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:04:11.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:04:11 gibba015 bash[30343]: cephadm 2021-03-10T17:04:09.843437+0000 mgr.gibba045.orlgmj (mgr.34412) 10306 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:04:11.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:04:11 gibba015 bash[30343]: cephadm 2021-03-10T17:04:09.844589+0000 mgr.gibba045.orlgmj (mgr.34412) 10307 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:04:11.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:04:11 gibba015 bash[30343]: cephadm 2021-03-10T17:04:09.844627+0000 mgr.gibba045.orlgmj (mgr.34412) 10308 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:04:11.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:04:11 gibba015 bash[30343]: cephadm 2021-03-10T17:04:09.844731+0000 mgr.gibba045.orlgmj (mgr.34412) 10309 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:04:13.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:04:13 gibba045 bash[25517]: cluster 2021-03-10T17:04:11.490512+0000 mgr.gibba045.orlgmj (mgr.34412) 10310 : cluster [DBG] pgmap v5870: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:13.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:04:13 gibba015 bash[29377]: cluster 2021-03-10T17:04:11.490512+0000 mgr.gibba045.orlgmj (mgr.34412) 10310 : cluster [DBG] pgmap v5870: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:13.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:04:13 gibba015 bash[30343]: cluster 2021-03-10T17:04:11.490512+0000 mgr.gibba045.orlgmj (mgr.34412) 10310 : cluster [DBG] pgmap v5870: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:15.232 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:04:15.465 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:04:15.465 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 7m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:04:15.466 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 6m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:04:15.466 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:04:15.466 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:04:15.466 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:04:15.466 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:04:15.467 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:04:15.467 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:04:15.467 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 7m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:04:15.467 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 6m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:04:15.468 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:04:15.468 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:04:15.468 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:04:15.468 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:04:15.468 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:04:15.469 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:04:15.469 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:04:15.469 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:04:15.469 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 6m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:04:15.470 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 6m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:04:15.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:04:15 gibba045 bash[25517]: cluster 2021-03-10T17:04:13.491820+0000 mgr.gibba045.orlgmj (mgr.34412) 10311 : cluster [DBG] pgmap v5871: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:15.712 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:04:15.713 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:04:15.713 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:04:15.713 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:04:15.714 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:04:15.714 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:04:15.714 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:04:15.714 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:04:15.714 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:04:15.715 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:04:15.715 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:04:15.715 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:04:15.715 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:04:15.716 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:04:15.716 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:04:15.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:04:15 gibba015 bash[29377]: cluster 2021-03-10T17:04:13.491820+0000 mgr.gibba045.orlgmj (mgr.34412) 10311 : cluster [DBG] pgmap v5871: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:15.720 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:04:15 gibba015 bash[30343]: cluster 2021-03-10T17:04:13.491820+0000 mgr.gibba045.orlgmj (mgr.34412) 10311 : cluster [DBG] pgmap v5871: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:16.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:04:16 gibba045 bash[25517]: audit 2021-03-10T17:04:15.225243+0000 mgr.gibba045.orlgmj (mgr.34412) 10312 : audit [DBG] from='client.50964 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:04:16.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:04:16 gibba045 bash[25517]: audit 2021-03-10T17:04:15.711815+0000 mon.a (mon.0) 2219 : audit [DBG] from='client.? 172.21.2.115:0/671320257' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:04:16.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:04:16 gibba015 bash[29377]: audit 2021-03-10T17:04:15.225243+0000 mgr.gibba045.orlgmj (mgr.34412) 10312 : audit [DBG] from='client.50964 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:04:16.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:04:16 gibba015 bash[29377]: audit 2021-03-10T17:04:15.711815+0000 mon.a (mon.0) 2219 : audit [DBG] from='client.? 172.21.2.115:0/671320257' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:04:16.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:04:16 gibba015 bash[30343]: audit 2021-03-10T17:04:15.225243+0000 mgr.gibba045.orlgmj (mgr.34412) 10312 : audit [DBG] from='client.50964 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:04:16.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:04:16 gibba015 bash[30343]: audit 2021-03-10T17:04:15.711815+0000 mon.a (mon.0) 2219 : audit [DBG] from='client.? 172.21.2.115:0/671320257' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:04:17.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:04:17 gibba045 bash[25517]: audit 2021-03-10T17:04:15.454308+0000 mgr.gibba045.orlgmj (mgr.34412) 10313 : audit [DBG] from='client.50970 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:04:17.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:04:17 gibba045 bash[25517]: cluster 2021-03-10T17:04:15.492763+0000 mgr.gibba045.orlgmj (mgr.34412) 10314 : cluster [DBG] pgmap v5872: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:17.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:04:17 gibba015 bash[29377]: audit 2021-03-10T17:04:15.454308+0000 mgr.gibba045.orlgmj (mgr.34412) 10313 : audit [DBG] from='client.50970 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:04:17.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:04:17 gibba015 bash[29377]: cluster 2021-03-10T17:04:15.492763+0000 mgr.gibba045.orlgmj (mgr.34412) 10314 : cluster [DBG] pgmap v5872: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:17.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:04:17 gibba015 bash[30343]: audit 2021-03-10T17:04:15.454308+0000 mgr.gibba045.orlgmj (mgr.34412) 10313 : audit [DBG] from='client.50970 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:04:17.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:04:17 gibba015 bash[30343]: cluster 2021-03-10T17:04:15.492763+0000 mgr.gibba045.orlgmj (mgr.34412) 10314 : cluster [DBG] pgmap v5872: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:18.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:04:18 gibba045 bash[25517]: cluster 2021-03-10T17:04:17.494463+0000 mgr.gibba045.orlgmj (mgr.34412) 10315 : cluster [DBG] pgmap v5873: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:18.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:04:18 gibba015 bash[29377]: cluster 2021-03-10T17:04:17.494463+0000 mgr.gibba045.orlgmj (mgr.34412) 10315 : cluster [DBG] pgmap v5873: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:18.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:04:18 gibba015 bash[30343]: cluster 2021-03-10T17:04:17.494463+0000 mgr.gibba045.orlgmj (mgr.34412) 10315 : cluster [DBG] pgmap v5873: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:20.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:04:20 gibba015 bash[29377]: cluster 2021-03-10T17:04:19.495999+0000 mgr.gibba045.orlgmj (mgr.34412) 10316 : cluster [DBG] pgmap v5874: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:20.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:04:20 gibba015 bash[30343]: cluster 2021-03-10T17:04:19.495999+0000 mgr.gibba045.orlgmj (mgr.34412) 10316 : cluster [DBG] pgmap v5874: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:21.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:04:20 gibba045 bash[25517]: cluster 2021-03-10T17:04:19.495999+0000 mgr.gibba045.orlgmj (mgr.34412) 10316 : cluster [DBG] pgmap v5874: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:23.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:04:23 gibba015 bash[29377]: cluster 2021-03-10T17:04:21.498032+0000 mgr.gibba045.orlgmj (mgr.34412) 10317 : cluster [DBG] pgmap v5875: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:23.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:04:23 gibba015 bash[30343]: cluster 2021-03-10T17:04:21.498032+0000 mgr.gibba045.orlgmj (mgr.34412) 10317 : cluster [DBG] pgmap v5875: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:23.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:04:23 gibba045 bash[25517]: cluster 2021-03-10T17:04:21.498032+0000 mgr.gibba045.orlgmj (mgr.34412) 10317 : cluster [DBG] pgmap v5875: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:25.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:04:25 gibba015 bash[29377]: cluster 2021-03-10T17:04:23.499244+0000 mgr.gibba045.orlgmj (mgr.34412) 10318 : cluster [DBG] pgmap v5876: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:25.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:04:25 gibba015 bash[30343]: cluster 2021-03-10T17:04:23.499244+0000 mgr.gibba045.orlgmj (mgr.34412) 10318 : cluster [DBG] pgmap v5876: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:25.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:04:25 gibba045 bash[25517]: cluster 2021-03-10T17:04:23.499244+0000 mgr.gibba045.orlgmj (mgr.34412) 10318 : cluster [DBG] pgmap v5876: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:26.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:04:26 gibba045 bash[25517]: cephadm 2021-03-10T17:04:24.860637+0000 mgr.gibba045.orlgmj (mgr.34412) 10319 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:04:26.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:04:26 gibba015 bash[29377]: cephadm 2021-03-10T17:04:24.860637+0000 mgr.gibba045.orlgmj (mgr.34412) 10319 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:04:26.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:04:26 gibba015 bash[30343]: cephadm 2021-03-10T17:04:24.860637+0000 mgr.gibba045.orlgmj (mgr.34412) 10319 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:04:27.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:04:27 gibba045 bash[25517]: cluster 2021-03-10T17:04:25.501011+0000 mgr.gibba045.orlgmj (mgr.34412) 10320 : cluster [DBG] pgmap v5877: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:27.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:04:27 gibba015 bash[29377]: cluster 2021-03-10T17:04:25.501011+0000 mgr.gibba045.orlgmj (mgr.34412) 10320 : cluster [DBG] pgmap v5877: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:27.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:04:27 gibba015 bash[30343]: cluster 2021-03-10T17:04:25.501011+0000 mgr.gibba045.orlgmj (mgr.34412) 10320 : cluster [DBG] pgmap v5877: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:29.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:04:29 gibba045 bash[25517]: cluster 2021-03-10T17:04:27.502735+0000 mgr.gibba045.orlgmj (mgr.34412) 10321 : cluster [DBG] pgmap v5878: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:29.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:04:29 gibba015 bash[29377]: cluster 2021-03-10T17:04:27.502735+0000 mgr.gibba045.orlgmj (mgr.34412) 10321 : cluster [DBG] pgmap v5878: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:29.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:04:29 gibba015 bash[30343]: cluster 2021-03-10T17:04:27.502735+0000 mgr.gibba045.orlgmj (mgr.34412) 10321 : cluster [DBG] pgmap v5878: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:31.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:04:31 gibba045 bash[25517]: cluster 2021-03-10T17:04:29.504086+0000 mgr.gibba045.orlgmj (mgr.34412) 10322 : cluster [DBG] pgmap v5879: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:31.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:04:31 gibba015 bash[29377]: cluster 2021-03-10T17:04:29.504086+0000 mgr.gibba045.orlgmj (mgr.34412) 10322 : cluster [DBG] pgmap v5879: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:31.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:04:31 gibba015 bash[30343]: cluster 2021-03-10T17:04:29.504086+0000 mgr.gibba045.orlgmj (mgr.34412) 10322 : cluster [DBG] pgmap v5879: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:33.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:04:33 gibba045 bash[25517]: cluster 2021-03-10T17:04:31.505724+0000 mgr.gibba045.orlgmj (mgr.34412) 10323 : cluster [DBG] pgmap v5880: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:33.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:04:33 gibba015 bash[29377]: cluster 2021-03-10T17:04:31.505724+0000 mgr.gibba045.orlgmj (mgr.34412) 10323 : cluster [DBG] pgmap v5880: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:33.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:04:33 gibba015 bash[30343]: cluster 2021-03-10T17:04:31.505724+0000 mgr.gibba045.orlgmj (mgr.34412) 10323 : cluster [DBG] pgmap v5880: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:35.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:04:35 gibba045 bash[25517]: cluster 2021-03-10T17:04:33.507009+0000 mgr.gibba045.orlgmj (mgr.34412) 10324 : cluster [DBG] pgmap v5881: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:35.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:04:35 gibba015 bash[29377]: cluster 2021-03-10T17:04:33.507009+0000 mgr.gibba045.orlgmj (mgr.34412) 10324 : cluster [DBG] pgmap v5881: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:35.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:04:35 gibba015 bash[30343]: cluster 2021-03-10T17:04:33.507009+0000 mgr.gibba045.orlgmj (mgr.34412) 10324 : cluster [DBG] pgmap v5881: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:37.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:04:37 gibba045 bash[25517]: cluster 2021-03-10T17:04:35.508791+0000 mgr.gibba045.orlgmj (mgr.34412) 10325 : cluster [DBG] pgmap v5882: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:37.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:04:37 gibba015 bash[29377]: cluster 2021-03-10T17:04:35.508791+0000 mgr.gibba045.orlgmj (mgr.34412) 10325 : cluster [DBG] pgmap v5882: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:37.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:04:37 gibba015 bash[30343]: cluster 2021-03-10T17:04:35.508791+0000 mgr.gibba045.orlgmj (mgr.34412) 10325 : cluster [DBG] pgmap v5882: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:39.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:04:39 gibba045 bash[25517]: cluster 2021-03-10T17:04:37.510543+0000 mgr.gibba045.orlgmj (mgr.34412) 10326 : cluster [DBG] pgmap v5883: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:39.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:04:39 gibba015 bash[29377]: cluster 2021-03-10T17:04:37.510543+0000 mgr.gibba045.orlgmj (mgr.34412) 10326 : cluster [DBG] pgmap v5883: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:39.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:04:39 gibba015 bash[30343]: cluster 2021-03-10T17:04:37.510543+0000 mgr.gibba045.orlgmj (mgr.34412) 10326 : cluster [DBG] pgmap v5883: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:41.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:04:41 gibba045 bash[25517]: cluster 2021-03-10T17:04:39.511929+0000 mgr.gibba045.orlgmj (mgr.34412) 10327 : cluster [DBG] pgmap v5884: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:41.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:04:41 gibba045 bash[25517]: cephadm 2021-03-10T17:04:39.876701+0000 mgr.gibba045.orlgmj (mgr.34412) 10328 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:04:41.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:04:41 gibba015 bash[29377]: cluster 2021-03-10T17:04:39.511929+0000 mgr.gibba045.orlgmj (mgr.34412) 10327 : cluster [DBG] pgmap v5884: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:41.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:04:41 gibba015 bash[29377]: cephadm 2021-03-10T17:04:39.876701+0000 mgr.gibba045.orlgmj (mgr.34412) 10328 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:04:41.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:04:41 gibba015 bash[30343]: cluster 2021-03-10T17:04:39.511929+0000 mgr.gibba045.orlgmj (mgr.34412) 10327 : cluster [DBG] pgmap v5884: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:41.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:04:41 gibba015 bash[30343]: cephadm 2021-03-10T17:04:39.876701+0000 mgr.gibba045.orlgmj (mgr.34412) 10328 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:04:43.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:04:43 gibba015 bash[29377]: cluster 2021-03-10T17:04:41.513940+0000 mgr.gibba045.orlgmj (mgr.34412) 10329 : cluster [DBG] pgmap v5885: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:43.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:04:43 gibba015 bash[30343]: cluster 2021-03-10T17:04:41.513940+0000 mgr.gibba045.orlgmj (mgr.34412) 10329 : cluster [DBG] pgmap v5885: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:43.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:04:43 gibba045 bash[25517]: cluster 2021-03-10T17:04:41.513940+0000 mgr.gibba045.orlgmj (mgr.34412) 10329 : cluster [DBG] pgmap v5885: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:45.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:04:45 gibba015 bash[29377]: cluster 2021-03-10T17:04:43.515145+0000 mgr.gibba045.orlgmj (mgr.34412) 10330 : cluster [DBG] pgmap v5886: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:45.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:04:45 gibba015 bash[30343]: cluster 2021-03-10T17:04:43.515145+0000 mgr.gibba045.orlgmj (mgr.34412) 10330 : cluster [DBG] pgmap v5886: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:45.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:04:45 gibba045 bash[25517]: cluster 2021-03-10T17:04:43.515145+0000 mgr.gibba045.orlgmj (mgr.34412) 10330 : cluster [DBG] pgmap v5886: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:45.954 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:04:46.184 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:04:46.185 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 7m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:04:46.185 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 6m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:04:46.185 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:04:46.185 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:04:46.185 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:04:46.186 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:04:46.186 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:04:46.186 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:04:46.186 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 7m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:04:46.187 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 6m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:04:46.187 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:04:46.187 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:04:46.187 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:04:46.188 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:04:46.188 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:04:46.188 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:04:46.188 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:04:46.188 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:04:46.189 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 6m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:04:46.189 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 6m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:04:46.430 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:04:46.431 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:04:46.431 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:04:46.431 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:04:46.432 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:04:46.432 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:04:46.432 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:04:46.432 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:04:46.433 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:04:46.433 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:04:46.433 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:04:46.433 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:04:46.434 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:04:46.434 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:04:46.434 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:04:47.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:04:47 gibba045 bash[25517]: cluster 2021-03-10T17:04:45.516833+0000 mgr.gibba045.orlgmj (mgr.34412) 10331 : cluster [DBG] pgmap v5887: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:47.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:04:47 gibba045 bash[25517]: audit 2021-03-10T17:04:45.946586+0000 mgr.gibba045.orlgmj (mgr.34412) 10332 : audit [DBG] from='client.60970 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:04:47.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:04:47 gibba045 bash[25517]: audit 2021-03-10T17:04:46.173059+0000 mgr.gibba045.orlgmj (mgr.34412) 10333 : audit [DBG] from='client.60976 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:04:47.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:04:47 gibba045 bash[25517]: audit 2021-03-10T17:04:46.429724+0000 mon.a (mon.0) 2220 : audit [DBG] from='client.? 172.21.2.115:0/949080684' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:04:47.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:04:47 gibba015 bash[29377]: cluster 2021-03-10T17:04:45.516833+0000 mgr.gibba045.orlgmj (mgr.34412) 10331 : cluster [DBG] pgmap v5887: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:47.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:04:47 gibba015 bash[29377]: audit 2021-03-10T17:04:45.946586+0000 mgr.gibba045.orlgmj (mgr.34412) 10332 : audit [DBG] from='client.60970 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:04:47.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:04:47 gibba015 bash[29377]: audit 2021-03-10T17:04:46.173059+0000 mgr.gibba045.orlgmj (mgr.34412) 10333 : audit [DBG] from='client.60976 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:04:47.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:04:47 gibba015 bash[29377]: audit 2021-03-10T17:04:46.429724+0000 mon.a (mon.0) 2220 : audit [DBG] from='client.? 172.21.2.115:0/949080684' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:04:47.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:04:47 gibba015 bash[30343]: cluster 2021-03-10T17:04:45.516833+0000 mgr.gibba045.orlgmj (mgr.34412) 10331 : cluster [DBG] pgmap v5887: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:47.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:04:47 gibba015 bash[30343]: audit 2021-03-10T17:04:45.946586+0000 mgr.gibba045.orlgmj (mgr.34412) 10332 : audit [DBG] from='client.60970 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:04:47.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:04:47 gibba015 bash[30343]: audit 2021-03-10T17:04:46.173059+0000 mgr.gibba045.orlgmj (mgr.34412) 10333 : audit [DBG] from='client.60976 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:04:47.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:04:47 gibba015 bash[30343]: audit 2021-03-10T17:04:46.429724+0000 mon.a (mon.0) 2220 : audit [DBG] from='client.? 172.21.2.115:0/949080684' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:04:49.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:04:49 gibba045 bash[25517]: cluster 2021-03-10T17:04:47.518342+0000 mgr.gibba045.orlgmj (mgr.34412) 10334 : cluster [DBG] pgmap v5888: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:49.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:04:49 gibba015 bash[29377]: cluster 2021-03-10T17:04:47.518342+0000 mgr.gibba045.orlgmj (mgr.34412) 10334 : cluster [DBG] pgmap v5888: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:49.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:04:49 gibba015 bash[30343]: cluster 2021-03-10T17:04:47.518342+0000 mgr.gibba045.orlgmj (mgr.34412) 10334 : cluster [DBG] pgmap v5888: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:51.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:04:51 gibba045 bash[25517]: cluster 2021-03-10T17:04:49.519929+0000 mgr.gibba045.orlgmj (mgr.34412) 10335 : cluster [DBG] pgmap v5889: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:51.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:04:51 gibba015 bash[29377]: cluster 2021-03-10T17:04:49.519929+0000 mgr.gibba045.orlgmj (mgr.34412) 10335 : cluster [DBG] pgmap v5889: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:51.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:04:51 gibba015 bash[30343]: cluster 2021-03-10T17:04:49.519929+0000 mgr.gibba045.orlgmj (mgr.34412) 10335 : cluster [DBG] pgmap v5889: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:53.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:04:53 gibba045 bash[25517]: cluster 2021-03-10T17:04:51.521977+0000 mgr.gibba045.orlgmj (mgr.34412) 10336 : cluster [DBG] pgmap v5890: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:53.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:04:53 gibba015 bash[29377]: cluster 2021-03-10T17:04:51.521977+0000 mgr.gibba045.orlgmj (mgr.34412) 10336 : cluster [DBG] pgmap v5890: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:53.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:04:53 gibba015 bash[30343]: cluster 2021-03-10T17:04:51.521977+0000 mgr.gibba045.orlgmj (mgr.34412) 10336 : cluster [DBG] pgmap v5890: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:04:54 gibba045 bash[25517]: audit 2021-03-10T17:04:53.836056+0000 mon.c (mon.1) 2832 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:04:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:04:54 gibba045 bash[25517]: audit 2021-03-10T17:04:53.837199+0000 mon.a (mon.0) 2221 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:04:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:04:54 gibba045 bash[25517]: audit 2021-03-10T17:04:53.842885+0000 mon.c (mon.1) 2833 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:04:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:04:54 gibba045 bash[25517]: audit 2021-03-10T17:04:53.843886+0000 mon.a (mon.0) 2222 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:04:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:04:54 gibba045 bash[25517]: audit 2021-03-10T17:04:53.906964+0000 mon.c (mon.1) 2834 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T17:04:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:04:54 gibba045 bash[25517]: audit 2021-03-10T17:04:53.907772+0000 mon.c (mon.1) 2835 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:04:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:04:54 gibba045 bash[25517]: audit 2021-03-10T17:04:53.908377+0000 mon.a (mon.0) 2223 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T17:04:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:04:54 gibba045 bash[25517]: audit 2021-03-10T17:04:53.908895+0000 mon.c (mon.1) 2836 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:04:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:04:54 gibba045 bash[25517]: audit 2021-03-10T17:04:53.910367+0000 mon.c (mon.1) 2837 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:04:54.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:04:54 gibba045 bash[25517]: audit 2021-03-10T17:04:53.910579+0000 mon.a (mon.0) 2224 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:04:54.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:04:54 gibba045 bash[25517]: audit 2021-03-10T17:04:53.912242+0000 mon.a (mon.0) 2225 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:04:54.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:04:54 gibba045 bash[25517]: audit 2021-03-10T17:04:53.912483+0000 mon.a (mon.0) 2226 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:04:54.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:04:54 gibba015 bash[29377]: audit 2021-03-10T17:04:53.836056+0000 mon.c (mon.1) 2832 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:04:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:04:54 gibba015 bash[29377]: audit 2021-03-10T17:04:53.837199+0000 mon.a (mon.0) 2221 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:04:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:04:54 gibba015 bash[29377]: audit 2021-03-10T17:04:53.842885+0000 mon.c (mon.1) 2833 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:04:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:04:54 gibba015 bash[29377]: audit 2021-03-10T17:04:53.843886+0000 mon.a (mon.0) 2222 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:04:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:04:54 gibba015 bash[29377]: audit 2021-03-10T17:04:53.906964+0000 mon.c (mon.1) 2834 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T17:04:54.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:04:54 gibba015 bash[29377]: audit 2021-03-10T17:04:53.907772+0000 mon.c (mon.1) 2835 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:04:54.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:04:54 gibba015 bash[29377]: audit 2021-03-10T17:04:53.908377+0000 mon.a (mon.0) 2223 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T17:04:54.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:04:54 gibba015 bash[29377]: audit 2021-03-10T17:04:53.908895+0000 mon.c (mon.1) 2836 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:04:54.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:04:54 gibba015 bash[29377]: audit 2021-03-10T17:04:53.910367+0000 mon.c (mon.1) 2837 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:04:54.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:04:54 gibba015 bash[29377]: audit 2021-03-10T17:04:53.910579+0000 mon.a (mon.0) 2224 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:04:54.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:04:54 gibba015 bash[29377]: audit 2021-03-10T17:04:53.912242+0000 mon.a (mon.0) 2225 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:04:54.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:04:54 gibba015 bash[29377]: audit 2021-03-10T17:04:53.912483+0000 mon.a (mon.0) 2226 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:04:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:04:54 gibba015 bash[30343]: audit 2021-03-10T17:04:53.836056+0000 mon.c (mon.1) 2832 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:04:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:04:54 gibba015 bash[30343]: audit 2021-03-10T17:04:53.837199+0000 mon.a (mon.0) 2221 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:04:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:04:54 gibba015 bash[30343]: audit 2021-03-10T17:04:53.842885+0000 mon.c (mon.1) 2833 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:04:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:04:54 gibba015 bash[30343]: audit 2021-03-10T17:04:53.843886+0000 mon.a (mon.0) 2222 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:04:54.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:04:54 gibba015 bash[30343]: audit 2021-03-10T17:04:53.906964+0000 mon.c (mon.1) 2834 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T17:04:54.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:04:54 gibba015 bash[30343]: audit 2021-03-10T17:04:53.907772+0000 mon.c (mon.1) 2835 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:04:54.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:04:54 gibba015 bash[30343]: audit 2021-03-10T17:04:53.908377+0000 mon.a (mon.0) 2223 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T17:04:54.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:04:54 gibba015 bash[30343]: audit 2021-03-10T17:04:53.908895+0000 mon.c (mon.1) 2836 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:04:54.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:04:54 gibba015 bash[30343]: audit 2021-03-10T17:04:53.910367+0000 mon.c (mon.1) 2837 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:04:54.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:04:54 gibba015 bash[30343]: audit 2021-03-10T17:04:53.910579+0000 mon.a (mon.0) 2224 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:04:54.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:04:54 gibba015 bash[30343]: audit 2021-03-10T17:04:53.912242+0000 mon.a (mon.0) 2225 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:04:54.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:04:54 gibba015 bash[30343]: audit 2021-03-10T17:04:53.912483+0000 mon.a (mon.0) 2226 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:04:55.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:04:55 gibba045 bash[25517]: cluster 2021-03-10T17:04:53.523296+0000 mgr.gibba045.orlgmj (mgr.34412) 10337 : cluster [DBG] pgmap v5891: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:55.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:04:55 gibba015 bash[29377]: cluster 2021-03-10T17:04:53.523296+0000 mgr.gibba045.orlgmj (mgr.34412) 10337 : cluster [DBG] pgmap v5891: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:55.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:04:55 gibba015 bash[30343]: cluster 2021-03-10T17:04:53.523296+0000 mgr.gibba045.orlgmj (mgr.34412) 10337 : cluster [DBG] pgmap v5891: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:56.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:04:56 gibba045 bash[25517]: cephadm 2021-03-10T17:04:54.892676+0000 mgr.gibba045.orlgmj (mgr.34412) 10338 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:04:56.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:04:56 gibba015 bash[29377]: cephadm 2021-03-10T17:04:54.892676+0000 mgr.gibba045.orlgmj (mgr.34412) 10338 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:04:56.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:04:56 gibba015 bash[30343]: cephadm 2021-03-10T17:04:54.892676+0000 mgr.gibba045.orlgmj (mgr.34412) 10338 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:04:57.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:04:57 gibba045 bash[25517]: cluster 2021-03-10T17:04:55.525029+0000 mgr.gibba045.orlgmj (mgr.34412) 10339 : cluster [DBG] pgmap v5892: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:57.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:04:57 gibba015 bash[29377]: cluster 2021-03-10T17:04:55.525029+0000 mgr.gibba045.orlgmj (mgr.34412) 10339 : cluster [DBG] pgmap v5892: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:57.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:04:57 gibba015 bash[30343]: cluster 2021-03-10T17:04:55.525029+0000 mgr.gibba045.orlgmj (mgr.34412) 10339 : cluster [DBG] pgmap v5892: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:59.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:04:59 gibba045 bash[25517]: cluster 2021-03-10T17:04:57.526765+0000 mgr.gibba045.orlgmj (mgr.34412) 10340 : cluster [DBG] pgmap v5893: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:59.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:04:59 gibba015 bash[29377]: cluster 2021-03-10T17:04:57.526765+0000 mgr.gibba045.orlgmj (mgr.34412) 10340 : cluster [DBG] pgmap v5893: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:59.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:04:59 gibba015 bash[30343]: cluster 2021-03-10T17:04:57.526765+0000 mgr.gibba045.orlgmj (mgr.34412) 10340 : cluster [DBG] pgmap v5893: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:00.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:05:00 gibba015 bash[29377]: cluster 2021-03-10T17:04:59.528223+0000 mgr.gibba045.orlgmj (mgr.34412) 10341 : cluster [DBG] pgmap v5894: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:00.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:05:00 gibba015 bash[30343]: cluster 2021-03-10T17:04:59.528223+0000 mgr.gibba045.orlgmj (mgr.34412) 10341 : cluster [DBG] pgmap v5894: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:00.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:05:00 gibba045 bash[25517]: cluster 2021-03-10T17:04:59.528223+0000 mgr.gibba045.orlgmj (mgr.34412) 10341 : cluster [DBG] pgmap v5894: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:03.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:05:03 gibba045 bash[25517]: cluster 2021-03-10T17:05:01.530298+0000 mgr.gibba045.orlgmj (mgr.34412) 10342 : cluster [DBG] pgmap v5895: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:03.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:05:03 gibba015 bash[29377]: cluster 2021-03-10T17:05:01.530298+0000 mgr.gibba045.orlgmj (mgr.34412) 10342 : cluster [DBG] pgmap v5895: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:03.874 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:05:03 gibba015 bash[30343]: cluster 2021-03-10T17:05:01.530298+0000 mgr.gibba045.orlgmj (mgr.34412) 10342 : cluster [DBG] pgmap v5895: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:05.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:05:05 gibba045 bash[25517]: cluster 2021-03-10T17:05:03.531507+0000 mgr.gibba045.orlgmj (mgr.34412) 10343 : cluster [DBG] pgmap v5896: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:05.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:05:05 gibba015 bash[29377]: cluster 2021-03-10T17:05:03.531507+0000 mgr.gibba045.orlgmj (mgr.34412) 10343 : cluster [DBG] pgmap v5896: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:05.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:05:05 gibba015 bash[30343]: cluster 2021-03-10T17:05:03.531507+0000 mgr.gibba045.orlgmj (mgr.34412) 10343 : cluster [DBG] pgmap v5896: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:07.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:05:07 gibba045 bash[25517]: cluster 2021-03-10T17:05:05.533211+0000 mgr.gibba045.orlgmj (mgr.34412) 10344 : cluster [DBG] pgmap v5897: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:07.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:05:07 gibba015 bash[29377]: cluster 2021-03-10T17:05:05.533211+0000 mgr.gibba045.orlgmj (mgr.34412) 10344 : cluster [DBG] pgmap v5897: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:07.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:05:07 gibba015 bash[30343]: cluster 2021-03-10T17:05:05.533211+0000 mgr.gibba045.orlgmj (mgr.34412) 10344 : cluster [DBG] pgmap v5897: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:09.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:05:09 gibba045 bash[25517]: cluster 2021-03-10T17:05:07.534931+0000 mgr.gibba045.orlgmj (mgr.34412) 10345 : cluster [DBG] pgmap v5898: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:09.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:05:09 gibba015 bash[29377]: cluster 2021-03-10T17:05:07.534931+0000 mgr.gibba045.orlgmj (mgr.34412) 10345 : cluster [DBG] pgmap v5898: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:09.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:05:09 gibba015 bash[30343]: cluster 2021-03-10T17:05:07.534931+0000 mgr.gibba045.orlgmj (mgr.34412) 10345 : cluster [DBG] pgmap v5898: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:10.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:05:10 gibba045 bash[25517]: audit 2021-03-10T17:05:09.907355+0000 mon.c (mon.1) 2838 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:05:10.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:05:10 gibba045 bash[25517]: audit 2021-03-10T17:05:10.132415+0000 mon.a (mon.0) 2227 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:05:10.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:05:10 gibba045 bash[25517]: audit 2021-03-10T17:05:10.135878+0000 mon.c (mon.1) 2839 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:05:10.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:05:10 gibba045 bash[25517]: audit 2021-03-10T17:05:10.137247+0000 mon.c (mon.1) 2840 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:05:10.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:05:10 gibba045 bash[25517]: audit 2021-03-10T17:05:10.139062+0000 mon.c (mon.1) 2841 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:05:10.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:05:10 gibba045 bash[25517]: audit 2021-03-10T17:05:10.140704+0000 mon.c (mon.1) 2842 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:05:10.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:05:10 gibba045 bash[25517]: audit 2021-03-10T17:05:10.144471+0000 mon.c (mon.1) 2843 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:05:10.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:05:10 gibba045 bash[25517]: audit 2021-03-10T17:05:10.146071+0000 mon.c (mon.1) 2844 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:05:10.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:05:10 gibba015 bash[29377]: audit 2021-03-10T17:05:09.907355+0000 mon.c (mon.1) 2838 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:05:10.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:05:10 gibba015 bash[29377]: audit 2021-03-10T17:05:10.132415+0000 mon.a (mon.0) 2227 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:05:10.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:05:10 gibba015 bash[29377]: audit 2021-03-10T17:05:10.135878+0000 mon.c (mon.1) 2839 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:05:10.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:05:10 gibba015 bash[29377]: audit 2021-03-10T17:05:10.137247+0000 mon.c (mon.1) 2840 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:05:10.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:05:10 gibba015 bash[29377]: audit 2021-03-10T17:05:10.139062+0000 mon.c (mon.1) 2841 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:05:10.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:05:10 gibba015 bash[29377]: audit 2021-03-10T17:05:10.140704+0000 mon.c (mon.1) 2842 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:05:10.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:05:10 gibba015 bash[29377]: audit 2021-03-10T17:05:10.144471+0000 mon.c (mon.1) 2843 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:05:10.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:05:10 gibba015 bash[29377]: audit 2021-03-10T17:05:10.146071+0000 mon.c (mon.1) 2844 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:05:10.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:05:10 gibba015 bash[30343]: audit 2021-03-10T17:05:09.907355+0000 mon.c (mon.1) 2838 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:05:10.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:05:10 gibba015 bash[30343]: audit 2021-03-10T17:05:10.132415+0000 mon.a (mon.0) 2227 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:05:10.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:05:10 gibba015 bash[30343]: audit 2021-03-10T17:05:10.135878+0000 mon.c (mon.1) 2839 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:05:10.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:05:10 gibba015 bash[30343]: audit 2021-03-10T17:05:10.137247+0000 mon.c (mon.1) 2840 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:05:10.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:05:10 gibba015 bash[30343]: audit 2021-03-10T17:05:10.139062+0000 mon.c (mon.1) 2841 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:05:10.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:05:10 gibba015 bash[30343]: audit 2021-03-10T17:05:10.140704+0000 mon.c (mon.1) 2842 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:05:10.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:05:10 gibba015 bash[30343]: audit 2021-03-10T17:05:10.144471+0000 mon.c (mon.1) 2843 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:05:10.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:05:10 gibba015 bash[30343]: audit 2021-03-10T17:05:10.146071+0000 mon.c (mon.1) 2844 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:05:11.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:05:11 gibba045 bash[25517]: cluster 2021-03-10T17:05:09.536424+0000 mgr.gibba045.orlgmj (mgr.34412) 10346 : cluster [DBG] pgmap v5899: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:11.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:05:11 gibba045 bash[25517]: cephadm 2021-03-10T17:05:09.914618+0000 mgr.gibba045.orlgmj (mgr.34412) 10347 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:05:11.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:05:11 gibba045 bash[25517]: cephadm 2021-03-10T17:05:09.916471+0000 mgr.gibba045.orlgmj (mgr.34412) 10348 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:05:11.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:05:11 gibba045 bash[25517]: cephadm 2021-03-10T17:05:10.137295+0000 mgr.gibba045.orlgmj (mgr.34412) 10349 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:05:11.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:05:11 gibba045 bash[25517]: cephadm 2021-03-10T17:05:10.139038+0000 mgr.gibba045.orlgmj (mgr.34412) 10350 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:05:11.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:05:11 gibba045 bash[25517]: cephadm 2021-03-10T17:05:10.140408+0000 mgr.gibba045.orlgmj (mgr.34412) 10351 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:05:11.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:05:11 gibba045 bash[25517]: cephadm 2021-03-10T17:05:10.140545+0000 mgr.gibba045.orlgmj (mgr.34412) 10352 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:05:11.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:05:11 gibba045 bash[25517]: cephadm 2021-03-10T17:05:10.142196+0000 mgr.gibba045.orlgmj (mgr.34412) 10353 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:05:11.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:05:11 gibba045 bash[25517]: cephadm 2021-03-10T17:05:10.142233+0000 mgr.gibba045.orlgmj (mgr.34412) 10354 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:05:11.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:05:11 gibba045 bash[25517]: cephadm 2021-03-10T17:05:10.143820+0000 mgr.gibba045.orlgmj (mgr.34412) 10355 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:05:11.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:05:11 gibba045 bash[25517]: cephadm 2021-03-10T17:05:10.146063+0000 mgr.gibba045.orlgmj (mgr.34412) 10356 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:05:11.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:05:11 gibba045 bash[25517]: cephadm 2021-03-10T17:05:10.146103+0000 mgr.gibba045.orlgmj (mgr.34412) 10357 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:05:11.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:05:11 gibba045 bash[25517]: cephadm 2021-03-10T17:05:10.147483+0000 mgr.gibba045.orlgmj (mgr.34412) 10358 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:05:11.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:05:11 gibba045 bash[25517]: cephadm 2021-03-10T17:05:10.147899+0000 mgr.gibba045.orlgmj (mgr.34412) 10359 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:05:11.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:05:11 gibba045 bash[25517]: cephadm 2021-03-10T17:05:10.149496+0000 mgr.gibba045.orlgmj (mgr.34412) 10360 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:05:11.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:05:11 gibba045 bash[25517]: cephadm 2021-03-10T17:05:10.149539+0000 mgr.gibba045.orlgmj (mgr.34412) 10361 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:05:11.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:05:11 gibba045 bash[25517]: cephadm 2021-03-10T17:05:10.149666+0000 mgr.gibba045.orlgmj (mgr.34412) 10362 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:05:11.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:05:11 gibba015 bash[29377]: cluster 2021-03-10T17:05:09.536424+0000 mgr.gibba045.orlgmj (mgr.34412) 10346 : cluster [DBG] pgmap v5899: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:11.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:05:11 gibba015 bash[29377]: cephadm 2021-03-10T17:05:09.914618+0000 mgr.gibba045.orlgmj (mgr.34412) 10347 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:05:11.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:05:11 gibba015 bash[29377]: cephadm 2021-03-10T17:05:09.916471+0000 mgr.gibba045.orlgmj (mgr.34412) 10348 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:05:11.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:05:11 gibba015 bash[29377]: cephadm 2021-03-10T17:05:10.137295+0000 mgr.gibba045.orlgmj (mgr.34412) 10349 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:05:11.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:05:11 gibba015 bash[29377]: cephadm 2021-03-10T17:05:10.139038+0000 mgr.gibba045.orlgmj (mgr.34412) 10350 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:05:11.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:05:11 gibba015 bash[29377]: cephadm 2021-03-10T17:05:10.140408+0000 mgr.gibba045.orlgmj (mgr.34412) 10351 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:05:11.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:05:11 gibba015 bash[29377]: cephadm 2021-03-10T17:05:10.140545+0000 mgr.gibba045.orlgmj (mgr.34412) 10352 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:05:11.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:05:11 gibba015 bash[29377]: cephadm 2021-03-10T17:05:10.142196+0000 mgr.gibba045.orlgmj (mgr.34412) 10353 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:05:11.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:05:11 gibba015 bash[29377]: cephadm 2021-03-10T17:05:10.142233+0000 mgr.gibba045.orlgmj (mgr.34412) 10354 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:05:11.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:05:11 gibba015 bash[29377]: cephadm 2021-03-10T17:05:10.143820+0000 mgr.gibba045.orlgmj (mgr.34412) 10355 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:05:11.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:05:11 gibba015 bash[29377]: cephadm 2021-03-10T17:05:10.146063+0000 mgr.gibba045.orlgmj (mgr.34412) 10356 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:05:11.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:05:11 gibba015 bash[29377]: cephadm 2021-03-10T17:05:10.146103+0000 mgr.gibba045.orlgmj (mgr.34412) 10357 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:05:11.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:05:11 gibba015 bash[29377]: cephadm 2021-03-10T17:05:10.147483+0000 mgr.gibba045.orlgmj (mgr.34412) 10358 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:05:11.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:05:11 gibba015 bash[29377]: cephadm 2021-03-10T17:05:10.147899+0000 mgr.gibba045.orlgmj (mgr.34412) 10359 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:05:11.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:05:11 gibba015 bash[29377]: cephadm 2021-03-10T17:05:10.149496+0000 mgr.gibba045.orlgmj (mgr.34412) 10360 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:05:11.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:05:11 gibba015 bash[29377]: cephadm 2021-03-10T17:05:10.149539+0000 mgr.gibba045.orlgmj (mgr.34412) 10361 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:05:11.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:05:11 gibba015 bash[29377]: cephadm 2021-03-10T17:05:10.149666+0000 mgr.gibba045.orlgmj (mgr.34412) 10362 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:05:11.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:05:11 gibba015 bash[30343]: cluster 2021-03-10T17:05:09.536424+0000 mgr.gibba045.orlgmj (mgr.34412) 10346 : cluster [DBG] pgmap v5899: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:11.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:05:11 gibba015 bash[30343]: cephadm 2021-03-10T17:05:09.914618+0000 mgr.gibba045.orlgmj (mgr.34412) 10347 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:05:11.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:05:11 gibba015 bash[30343]: cephadm 2021-03-10T17:05:09.916471+0000 mgr.gibba045.orlgmj (mgr.34412) 10348 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:05:11.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:05:11 gibba015 bash[30343]: cephadm 2021-03-10T17:05:10.137295+0000 mgr.gibba045.orlgmj (mgr.34412) 10349 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:05:11.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:05:11 gibba015 bash[30343]: cephadm 2021-03-10T17:05:10.139038+0000 mgr.gibba045.orlgmj (mgr.34412) 10350 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:05:11.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:05:11 gibba015 bash[30343]: cephadm 2021-03-10T17:05:10.140408+0000 mgr.gibba045.orlgmj (mgr.34412) 10351 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:05:11.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:05:11 gibba015 bash[30343]: cephadm 2021-03-10T17:05:10.140545+0000 mgr.gibba045.orlgmj (mgr.34412) 10352 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:05:11.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:05:11 gibba015 bash[30343]: cephadm 2021-03-10T17:05:10.142196+0000 mgr.gibba045.orlgmj (mgr.34412) 10353 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:05:11.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:05:11 gibba015 bash[30343]: cephadm 2021-03-10T17:05:10.142233+0000 mgr.gibba045.orlgmj (mgr.34412) 10354 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:05:11.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:05:11 gibba015 bash[30343]: cephadm 2021-03-10T17:05:10.143820+0000 mgr.gibba045.orlgmj (mgr.34412) 10355 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:05:11.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:05:11 gibba015 bash[30343]: cephadm 2021-03-10T17:05:10.146063+0000 mgr.gibba045.orlgmj (mgr.34412) 10356 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:05:11.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:05:11 gibba015 bash[30343]: cephadm 2021-03-10T17:05:10.146103+0000 mgr.gibba045.orlgmj (mgr.34412) 10357 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:05:11.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:05:11 gibba015 bash[30343]: cephadm 2021-03-10T17:05:10.147483+0000 mgr.gibba045.orlgmj (mgr.34412) 10358 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:05:11.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:05:11 gibba015 bash[30343]: cephadm 2021-03-10T17:05:10.147899+0000 mgr.gibba045.orlgmj (mgr.34412) 10359 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:05:11.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:05:11 gibba015 bash[30343]: cephadm 2021-03-10T17:05:10.149496+0000 mgr.gibba045.orlgmj (mgr.34412) 10360 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:05:11.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:05:11 gibba015 bash[30343]: cephadm 2021-03-10T17:05:10.149539+0000 mgr.gibba045.orlgmj (mgr.34412) 10361 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:05:11.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:05:11 gibba015 bash[30343]: cephadm 2021-03-10T17:05:10.149666+0000 mgr.gibba045.orlgmj (mgr.34412) 10362 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:05:13.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:05:13 gibba045 bash[25517]: cluster 2021-03-10T17:05:11.538308+0000 mgr.gibba045.orlgmj (mgr.34412) 10363 : cluster [DBG] pgmap v5900: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:13.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:05:13 gibba015 bash[29377]: cluster 2021-03-10T17:05:11.538308+0000 mgr.gibba045.orlgmj (mgr.34412) 10363 : cluster [DBG] pgmap v5900: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:13.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:05:13 gibba015 bash[30343]: cluster 2021-03-10T17:05:11.538308+0000 mgr.gibba045.orlgmj (mgr.34412) 10363 : cluster [DBG] pgmap v5900: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:15.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:05:15 gibba045 bash[25517]: cluster 2021-03-10T17:05:13.539492+0000 mgr.gibba045.orlgmj (mgr.34412) 10364 : cluster [DBG] pgmap v5901: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:15.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:05:15 gibba015 bash[29377]: cluster 2021-03-10T17:05:13.539492+0000 mgr.gibba045.orlgmj (mgr.34412) 10364 : cluster [DBG] pgmap v5901: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:15.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:05:15 gibba015 bash[30343]: cluster 2021-03-10T17:05:13.539492+0000 mgr.gibba045.orlgmj (mgr.34412) 10364 : cluster [DBG] pgmap v5901: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:16.676 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:05:16.903 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:05:16.904 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 8m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:05:16.904 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 7m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:05:16.904 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:05:16.904 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:05:16.905 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:05:16.905 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:05:16.905 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:05:16.905 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:05:16.906 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 8m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:05:16.906 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 7m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:05:16.906 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:05:16.906 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:05:16.906 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:05:16.907 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:05:16.907 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:05:16.907 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:05:16.907 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:05:16.907 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:05:16.908 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 7m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:05:16.908 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 7m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:05:17.150 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:05:17.150 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:05:17.151 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:05:17.151 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:05:17.151 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:05:17.151 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:05:17.152 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:05:17.152 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:05:17.152 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:05:17.152 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:05:17.152 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:05:17.153 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:05:17.153 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:05:17.153 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:05:17.153 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:05:17.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:05:17 gibba045 bash[25517]: cluster 2021-03-10T17:05:15.541142+0000 mgr.gibba045.orlgmj (mgr.34412) 10365 : cluster [DBG] pgmap v5902: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:17.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:05:17 gibba045 bash[25517]: audit 2021-03-10T17:05:17.149352+0000 mon.a (mon.0) 2228 : audit [DBG] from='client.? 172.21.2.115:0/118911404' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:05:17.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:05:17 gibba015 bash[29377]: cluster 2021-03-10T17:05:15.541142+0000 mgr.gibba045.orlgmj (mgr.34412) 10365 : cluster [DBG] pgmap v5902: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:17.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:05:17 gibba015 bash[29377]: audit 2021-03-10T17:05:17.149352+0000 mon.a (mon.0) 2228 : audit [DBG] from='client.? 172.21.2.115:0/118911404' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:05:17.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:05:17 gibba015 bash[30343]: cluster 2021-03-10T17:05:15.541142+0000 mgr.gibba045.orlgmj (mgr.34412) 10365 : cluster [DBG] pgmap v5902: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:17.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:05:17 gibba015 bash[30343]: audit 2021-03-10T17:05:17.149352+0000 mon.a (mon.0) 2228 : audit [DBG] from='client.? 172.21.2.115:0/118911404' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:05:18.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:05:18 gibba045 bash[25517]: audit 2021-03-10T17:05:16.669672+0000 mgr.gibba045.orlgmj (mgr.34412) 10366 : audit [DBG] from='client.51000 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:05:18.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:05:18 gibba045 bash[25517]: audit 2021-03-10T17:05:16.892687+0000 mgr.gibba045.orlgmj (mgr.34412) 10367 : audit [DBG] from='client.51006 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:05:18.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:05:18 gibba015 bash[29377]: audit 2021-03-10T17:05:16.669672+0000 mgr.gibba045.orlgmj (mgr.34412) 10366 : audit [DBG] from='client.51000 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:05:18.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:05:18 gibba015 bash[29377]: audit 2021-03-10T17:05:16.892687+0000 mgr.gibba045.orlgmj (mgr.34412) 10367 : audit [DBG] from='client.51006 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:05:18.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:05:18 gibba015 bash[30343]: audit 2021-03-10T17:05:16.669672+0000 mgr.gibba045.orlgmj (mgr.34412) 10366 : audit [DBG] from='client.51000 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:05:18.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:05:18 gibba015 bash[30343]: audit 2021-03-10T17:05:16.892687+0000 mgr.gibba045.orlgmj (mgr.34412) 10367 : audit [DBG] from='client.51006 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:05:19.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:05:19 gibba045 bash[25517]: cluster 2021-03-10T17:05:17.542968+0000 mgr.gibba045.orlgmj (mgr.34412) 10368 : cluster [DBG] pgmap v5903: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:19.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:05:19 gibba015 bash[29377]: cluster 2021-03-10T17:05:17.542968+0000 mgr.gibba045.orlgmj (mgr.34412) 10368 : cluster [DBG] pgmap v5903: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:19.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:05:19 gibba015 bash[30343]: cluster 2021-03-10T17:05:17.542968+0000 mgr.gibba045.orlgmj (mgr.34412) 10368 : cluster [DBG] pgmap v5903: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:20.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:05:20 gibba015 bash[29377]: cluster 2021-03-10T17:05:19.544487+0000 mgr.gibba045.orlgmj (mgr.34412) 10369 : cluster [DBG] pgmap v5904: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:20.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:05:20 gibba015 bash[30343]: cluster 2021-03-10T17:05:19.544487+0000 mgr.gibba045.orlgmj (mgr.34412) 10369 : cluster [DBG] pgmap v5904: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:20.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:05:20 gibba045 bash[25517]: cluster 2021-03-10T17:05:19.544487+0000 mgr.gibba045.orlgmj (mgr.34412) 10369 : cluster [DBG] pgmap v5904: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:23.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:05:23 gibba045 bash[25517]: cluster 2021-03-10T17:05:21.546563+0000 mgr.gibba045.orlgmj (mgr.34412) 10370 : cluster [DBG] pgmap v5905: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:23.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:05:23 gibba015 bash[29377]: cluster 2021-03-10T17:05:21.546563+0000 mgr.gibba045.orlgmj (mgr.34412) 10370 : cluster [DBG] pgmap v5905: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:23.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:05:23 gibba015 bash[30343]: cluster 2021-03-10T17:05:21.546563+0000 mgr.gibba045.orlgmj (mgr.34412) 10370 : cluster [DBG] pgmap v5905: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:25.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:05:25 gibba045 bash[25517]: cluster 2021-03-10T17:05:23.547880+0000 mgr.gibba045.orlgmj (mgr.34412) 10371 : cluster [DBG] pgmap v5906: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:25.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:05:25 gibba015 bash[29377]: cluster 2021-03-10T17:05:23.547880+0000 mgr.gibba045.orlgmj (mgr.34412) 10371 : cluster [DBG] pgmap v5906: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:25.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:05:25 gibba015 bash[30343]: cluster 2021-03-10T17:05:23.547880+0000 mgr.gibba045.orlgmj (mgr.34412) 10371 : cluster [DBG] pgmap v5906: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:26.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:05:26 gibba045 bash[25517]: cephadm 2021-03-10T17:05:25.165753+0000 mgr.gibba045.orlgmj (mgr.34412) 10372 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:05:26.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:05:26 gibba015 bash[29377]: cephadm 2021-03-10T17:05:25.165753+0000 mgr.gibba045.orlgmj (mgr.34412) 10372 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:05:26.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:05:26 gibba015 bash[30343]: cephadm 2021-03-10T17:05:25.165753+0000 mgr.gibba045.orlgmj (mgr.34412) 10372 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:05:27.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:05:27 gibba045 bash[25517]: cluster 2021-03-10T17:05:25.549478+0000 mgr.gibba045.orlgmj (mgr.34412) 10373 : cluster [DBG] pgmap v5907: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:27.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:05:27 gibba015 bash[29377]: cluster 2021-03-10T17:05:25.549478+0000 mgr.gibba045.orlgmj (mgr.34412) 10373 : cluster [DBG] pgmap v5907: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:27.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:05:27 gibba015 bash[30343]: cluster 2021-03-10T17:05:25.549478+0000 mgr.gibba045.orlgmj (mgr.34412) 10373 : cluster [DBG] pgmap v5907: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:29.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:05:29 gibba045 bash[25517]: cluster 2021-03-10T17:05:27.550973+0000 mgr.gibba045.orlgmj (mgr.34412) 10374 : cluster [DBG] pgmap v5908: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:29.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:05:29 gibba015 bash[29377]: cluster 2021-03-10T17:05:27.550973+0000 mgr.gibba045.orlgmj (mgr.34412) 10374 : cluster [DBG] pgmap v5908: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:29.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:05:29 gibba015 bash[30343]: cluster 2021-03-10T17:05:27.550973+0000 mgr.gibba045.orlgmj (mgr.34412) 10374 : cluster [DBG] pgmap v5908: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:31.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:05:31 gibba045 bash[25517]: cluster 2021-03-10T17:05:29.552538+0000 mgr.gibba045.orlgmj (mgr.34412) 10375 : cluster [DBG] pgmap v5909: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:31.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:05:31 gibba015 bash[29377]: cluster 2021-03-10T17:05:29.552538+0000 mgr.gibba045.orlgmj (mgr.34412) 10375 : cluster [DBG] pgmap v5909: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:31.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:05:31 gibba015 bash[30343]: cluster 2021-03-10T17:05:29.552538+0000 mgr.gibba045.orlgmj (mgr.34412) 10375 : cluster [DBG] pgmap v5909: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:33.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:05:33 gibba045 bash[25517]: cluster 2021-03-10T17:05:31.554655+0000 mgr.gibba045.orlgmj (mgr.34412) 10376 : cluster [DBG] pgmap v5910: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:33.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:05:33 gibba015 bash[29377]: cluster 2021-03-10T17:05:31.554655+0000 mgr.gibba045.orlgmj (mgr.34412) 10376 : cluster [DBG] pgmap v5910: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:33.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:05:33 gibba015 bash[30343]: cluster 2021-03-10T17:05:31.554655+0000 mgr.gibba045.orlgmj (mgr.34412) 10376 : cluster [DBG] pgmap v5910: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:35.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:05:35 gibba045 bash[25517]: cluster 2021-03-10T17:05:33.555877+0000 mgr.gibba045.orlgmj (mgr.34412) 10377 : cluster [DBG] pgmap v5911: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:35.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:05:35 gibba015 bash[29377]: cluster 2021-03-10T17:05:33.555877+0000 mgr.gibba045.orlgmj (mgr.34412) 10377 : cluster [DBG] pgmap v5911: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:35.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:05:35 gibba015 bash[30343]: cluster 2021-03-10T17:05:33.555877+0000 mgr.gibba045.orlgmj (mgr.34412) 10377 : cluster [DBG] pgmap v5911: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:37.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:05:37 gibba045 bash[25517]: cluster 2021-03-10T17:05:35.557636+0000 mgr.gibba045.orlgmj (mgr.34412) 10378 : cluster [DBG] pgmap v5912: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:37.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:05:37 gibba015 bash[29377]: cluster 2021-03-10T17:05:35.557636+0000 mgr.gibba045.orlgmj (mgr.34412) 10378 : cluster [DBG] pgmap v5912: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:37.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:05:37 gibba015 bash[30343]: cluster 2021-03-10T17:05:35.557636+0000 mgr.gibba045.orlgmj (mgr.34412) 10378 : cluster [DBG] pgmap v5912: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:38.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:05:38 gibba015 bash[29377]: cluster 2021-03-10T17:05:37.559255+0000 mgr.gibba045.orlgmj (mgr.34412) 10379 : cluster [DBG] pgmap v5913: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:38.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:05:38 gibba015 bash[30343]: cluster 2021-03-10T17:05:37.559255+0000 mgr.gibba045.orlgmj (mgr.34412) 10379 : cluster [DBG] pgmap v5913: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:38.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:05:38 gibba045 bash[25517]: cluster 2021-03-10T17:05:37.559255+0000 mgr.gibba045.orlgmj (mgr.34412) 10379 : cluster [DBG] pgmap v5913: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:40.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:05:40 gibba015 bash[29377]: cluster 2021-03-10T17:05:39.560790+0000 mgr.gibba045.orlgmj (mgr.34412) 10380 : cluster [DBG] pgmap v5914: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:40.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:05:40 gibba015 bash[29377]: cephadm 2021-03-10T17:05:40.181611+0000 mgr.gibba045.orlgmj (mgr.34412) 10381 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:05:40.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:05:40 gibba015 bash[30343]: cluster 2021-03-10T17:05:39.560790+0000 mgr.gibba045.orlgmj (mgr.34412) 10380 : cluster [DBG] pgmap v5914: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:40.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:05:40 gibba015 bash[30343]: cephadm 2021-03-10T17:05:40.181611+0000 mgr.gibba045.orlgmj (mgr.34412) 10381 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:05:41.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:05:40 gibba045 bash[25517]: cluster 2021-03-10T17:05:39.560790+0000 mgr.gibba045.orlgmj (mgr.34412) 10380 : cluster [DBG] pgmap v5914: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:41.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:05:40 gibba045 bash[25517]: cephadm 2021-03-10T17:05:40.181611+0000 mgr.gibba045.orlgmj (mgr.34412) 10381 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:05:43.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:05:43 gibba045 bash[25517]: cluster 2021-03-10T17:05:41.562658+0000 mgr.gibba045.orlgmj (mgr.34412) 10382 : cluster [DBG] pgmap v5915: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:43.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:05:43 gibba015 bash[29377]: cluster 2021-03-10T17:05:41.562658+0000 mgr.gibba045.orlgmj (mgr.34412) 10382 : cluster [DBG] pgmap v5915: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:43.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:05:43 gibba015 bash[30343]: cluster 2021-03-10T17:05:41.562658+0000 mgr.gibba045.orlgmj (mgr.34412) 10382 : cluster [DBG] pgmap v5915: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:45.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:05:45 gibba045 bash[25517]: cluster 2021-03-10T17:05:43.563879+0000 mgr.gibba045.orlgmj (mgr.34412) 10383 : cluster [DBG] pgmap v5916: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:45.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:05:45 gibba015 bash[29377]: cluster 2021-03-10T17:05:43.563879+0000 mgr.gibba045.orlgmj (mgr.34412) 10383 : cluster [DBG] pgmap v5916: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:45.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:05:45 gibba015 bash[30343]: cluster 2021-03-10T17:05:43.563879+0000 mgr.gibba045.orlgmj (mgr.34412) 10383 : cluster [DBG] pgmap v5916: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:47.393 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:05:47.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:05:47 gibba045 bash[25517]: cluster 2021-03-10T17:05:45.565471+0000 mgr.gibba045.orlgmj (mgr.34412) 10384 : cluster [DBG] pgmap v5917: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:47.619 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:05:47.620 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 8m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:05:47.620 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 7m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:05:47.620 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:05:47.620 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:05:47.620 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:05:47.621 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:05:47.621 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:05:47.621 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:05:47.621 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 8m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:05:47.622 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 7m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:05:47.622 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:05:47.622 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:05:47.624 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:05:47.624 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:05:47.624 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:05:47.624 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:05:47.625 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:05:47.625 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:05:47.625 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 7m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:05:47.626 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 7m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:05:47.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:05:47 gibba015 bash[29377]: cluster 2021-03-10T17:05:45.565471+0000 mgr.gibba045.orlgmj (mgr.34412) 10384 : cluster [DBG] pgmap v5917: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:47.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:05:47 gibba015 bash[30343]: cluster 2021-03-10T17:05:45.565471+0000 mgr.gibba045.orlgmj (mgr.34412) 10384 : cluster [DBG] pgmap v5917: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:47.868 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:05:47.868 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:05:47.869 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:05:47.869 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:05:47.869 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:05:47.869 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:05:47.870 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:05:47.870 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:05:47.870 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:05:47.870 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:05:47.871 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:05:47.871 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:05:47.871 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:05:47.871 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:05:47.872 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:05:48.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:05:48 gibba045 bash[25517]: audit 2021-03-10T17:05:47.867307+0000 mon.a (mon.0) 2229 : audit [DBG] from='client.? 172.21.2.115:0/1490974761' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:05:48.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:05:48 gibba015 bash[29377]: audit 2021-03-10T17:05:47.867307+0000 mon.a (mon.0) 2229 : audit [DBG] from='client.? 172.21.2.115:0/1490974761' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:05:48.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:05:48 gibba015 bash[30343]: audit 2021-03-10T17:05:47.867307+0000 mon.a (mon.0) 2229 : audit [DBG] from='client.? 172.21.2.115:0/1490974761' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:05:49.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:05:49 gibba045 bash[25517]: audit 2021-03-10T17:05:47.385572+0000 mgr.gibba045.orlgmj (mgr.34412) 10385 : audit [DBG] from='client.61006 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:05:49.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:05:49 gibba045 bash[25517]: cluster 2021-03-10T17:05:47.567098+0000 mgr.gibba045.orlgmj (mgr.34412) 10386 : cluster [DBG] pgmap v5918: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:49.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:05:49 gibba045 bash[25517]: audit 2021-03-10T17:05:47.608521+0000 mgr.gibba045.orlgmj (mgr.34412) 10387 : audit [DBG] from='client.61012 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:05:49.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:05:49 gibba015 bash[29377]: audit 2021-03-10T17:05:47.385572+0000 mgr.gibba045.orlgmj (mgr.34412) 10385 : audit [DBG] from='client.61006 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:05:49.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:05:49 gibba015 bash[29377]: cluster 2021-03-10T17:05:47.567098+0000 mgr.gibba045.orlgmj (mgr.34412) 10386 : cluster [DBG] pgmap v5918: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:49.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:05:49 gibba015 bash[29377]: audit 2021-03-10T17:05:47.608521+0000 mgr.gibba045.orlgmj (mgr.34412) 10387 : audit [DBG] from='client.61012 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:05:49.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:05:49 gibba015 bash[30343]: audit 2021-03-10T17:05:47.385572+0000 mgr.gibba045.orlgmj (mgr.34412) 10385 : audit [DBG] from='client.61006 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:05:49.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:05:49 gibba015 bash[30343]: cluster 2021-03-10T17:05:47.567098+0000 mgr.gibba045.orlgmj (mgr.34412) 10386 : cluster [DBG] pgmap v5918: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:49.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:05:49 gibba015 bash[30343]: audit 2021-03-10T17:05:47.608521+0000 mgr.gibba045.orlgmj (mgr.34412) 10387 : audit [DBG] from='client.61012 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:05:51.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:05:51 gibba045 bash[25517]: cluster 2021-03-10T17:05:49.568671+0000 mgr.gibba045.orlgmj (mgr.34412) 10388 : cluster [DBG] pgmap v5919: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:51.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:05:51 gibba015 bash[29377]: cluster 2021-03-10T17:05:49.568671+0000 mgr.gibba045.orlgmj (mgr.34412) 10388 : cluster [DBG] pgmap v5919: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:51.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:05:51 gibba015 bash[30343]: cluster 2021-03-10T17:05:49.568671+0000 mgr.gibba045.orlgmj (mgr.34412) 10388 : cluster [DBG] pgmap v5919: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:53.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:05:53 gibba045 bash[25517]: cluster 2021-03-10T17:05:51.570311+0000 mgr.gibba045.orlgmj (mgr.34412) 10389 : cluster [DBG] pgmap v5920: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:53.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:05:53 gibba015 bash[29377]: cluster 2021-03-10T17:05:51.570311+0000 mgr.gibba045.orlgmj (mgr.34412) 10389 : cluster [DBG] pgmap v5920: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:53.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:05:53 gibba015 bash[30343]: cluster 2021-03-10T17:05:51.570311+0000 mgr.gibba045.orlgmj (mgr.34412) 10389 : cluster [DBG] pgmap v5920: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:05:54 gibba045 bash[25517]: audit 2021-03-10T17:05:53.849550+0000 mon.c (mon.1) 2845 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:05:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:05:54 gibba045 bash[25517]: audit 2021-03-10T17:05:53.850179+0000 mon.c (mon.1) 2846 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:05:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:05:54 gibba045 bash[25517]: audit 2021-03-10T17:05:53.850664+0000 mon.a (mon.0) 2230 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:05:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:05:54 gibba045 bash[25517]: audit 2021-03-10T17:05:53.851803+0000 mon.a (mon.0) 2231 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:05:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:05:54 gibba045 bash[25517]: audit 2021-03-10T17:05:53.919471+0000 mon.c (mon.1) 2847 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T17:05:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:05:54 gibba045 bash[25517]: audit 2021-03-10T17:05:53.920195+0000 mon.c (mon.1) 2848 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:05:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:05:54 gibba045 bash[25517]: audit 2021-03-10T17:05:53.920671+0000 mon.a (mon.0) 2232 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T17:05:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:05:54 gibba045 bash[25517]: audit 2021-03-10T17:05:53.920884+0000 mon.c (mon.1) 2849 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:05:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:05:54 gibba045 bash[25517]: audit 2021-03-10T17:05:53.921721+0000 mon.c (mon.1) 2850 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:05:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:05:54 gibba045 bash[25517]: audit 2021-03-10T17:05:53.921977+0000 mon.a (mon.0) 2233 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:05:54.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:05:54 gibba045 bash[25517]: audit 2021-03-10T17:05:53.923250+0000 mon.a (mon.0) 2234 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:05:54.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:05:54 gibba045 bash[25517]: audit 2021-03-10T17:05:53.924112+0000 mon.a (mon.0) 2235 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:05:54.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:05:54 gibba015 bash[29377]: audit 2021-03-10T17:05:53.849550+0000 mon.c (mon.1) 2845 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:05:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:05:54 gibba015 bash[29377]: audit 2021-03-10T17:05:53.850179+0000 mon.c (mon.1) 2846 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:05:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:05:54 gibba015 bash[29377]: audit 2021-03-10T17:05:53.850664+0000 mon.a (mon.0) 2230 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:05:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:05:54 gibba015 bash[29377]: audit 2021-03-10T17:05:53.851803+0000 mon.a (mon.0) 2231 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:05:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:05:54 gibba015 bash[29377]: audit 2021-03-10T17:05:53.919471+0000 mon.c (mon.1) 2847 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T17:05:54.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:05:54 gibba015 bash[29377]: audit 2021-03-10T17:05:53.920195+0000 mon.c (mon.1) 2848 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:05:54.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:05:54 gibba015 bash[29377]: audit 2021-03-10T17:05:53.920671+0000 mon.a (mon.0) 2232 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T17:05:54.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:05:54 gibba015 bash[29377]: audit 2021-03-10T17:05:53.920884+0000 mon.c (mon.1) 2849 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:05:54.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:05:54 gibba015 bash[29377]: audit 2021-03-10T17:05:53.921721+0000 mon.c (mon.1) 2850 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:05:54.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:05:54 gibba015 bash[29377]: audit 2021-03-10T17:05:53.921977+0000 mon.a (mon.0) 2233 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:05:54.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:05:54 gibba015 bash[29377]: audit 2021-03-10T17:05:53.923250+0000 mon.a (mon.0) 2234 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:05:54.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:05:54 gibba015 bash[29377]: audit 2021-03-10T17:05:53.924112+0000 mon.a (mon.0) 2235 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:05:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:05:54 gibba015 bash[30343]: audit 2021-03-10T17:05:53.849550+0000 mon.c (mon.1) 2845 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:05:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:05:54 gibba015 bash[30343]: audit 2021-03-10T17:05:53.850179+0000 mon.c (mon.1) 2846 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:05:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:05:54 gibba015 bash[30343]: audit 2021-03-10T17:05:53.850664+0000 mon.a (mon.0) 2230 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:05:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:05:54 gibba015 bash[30343]: audit 2021-03-10T17:05:53.851803+0000 mon.a (mon.0) 2231 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:05:54.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:05:54 gibba015 bash[30343]: audit 2021-03-10T17:05:53.919471+0000 mon.c (mon.1) 2847 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T17:05:54.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:05:54 gibba015 bash[30343]: audit 2021-03-10T17:05:53.920195+0000 mon.c (mon.1) 2848 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:05:54.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:05:54 gibba015 bash[30343]: audit 2021-03-10T17:05:53.920671+0000 mon.a (mon.0) 2232 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T17:05:54.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:05:54 gibba015 bash[30343]: audit 2021-03-10T17:05:53.920884+0000 mon.c (mon.1) 2849 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:05:54.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:05:54 gibba015 bash[30343]: audit 2021-03-10T17:05:53.921721+0000 mon.c (mon.1) 2850 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:05:54.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:05:54 gibba015 bash[30343]: audit 2021-03-10T17:05:53.921977+0000 mon.a (mon.0) 2233 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:05:54.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:05:54 gibba015 bash[30343]: audit 2021-03-10T17:05:53.923250+0000 mon.a (mon.0) 2234 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:05:54.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:05:54 gibba015 bash[30343]: audit 2021-03-10T17:05:53.924112+0000 mon.a (mon.0) 2235 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:05:55.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:05:55 gibba045 bash[25517]: cluster 2021-03-10T17:05:53.571605+0000 mgr.gibba045.orlgmj (mgr.34412) 10390 : cluster [DBG] pgmap v5921: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:55.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:05:55 gibba015 bash[29377]: cluster 2021-03-10T17:05:53.571605+0000 mgr.gibba045.orlgmj (mgr.34412) 10390 : cluster [DBG] pgmap v5921: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:55.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:05:55 gibba015 bash[30343]: cluster 2021-03-10T17:05:53.571605+0000 mgr.gibba045.orlgmj (mgr.34412) 10390 : cluster [DBG] pgmap v5921: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:56.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:05:56 gibba015 bash[29377]: cephadm 2021-03-10T17:05:55.197649+0000 mgr.gibba045.orlgmj (mgr.34412) 10391 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:05:56.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:05:56 gibba015 bash[29377]: cluster 2021-03-10T17:05:55.573180+0000 mgr.gibba045.orlgmj (mgr.34412) 10392 : cluster [DBG] pgmap v5922: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:56.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:05:56 gibba015 bash[30343]: cephadm 2021-03-10T17:05:55.197649+0000 mgr.gibba045.orlgmj (mgr.34412) 10391 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:05:56.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:05:56 gibba015 bash[30343]: cluster 2021-03-10T17:05:55.573180+0000 mgr.gibba045.orlgmj (mgr.34412) 10392 : cluster [DBG] pgmap v5922: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:56.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:05:56 gibba045 bash[25517]: cephadm 2021-03-10T17:05:55.197649+0000 mgr.gibba045.orlgmj (mgr.34412) 10391 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:05:56.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:05:56 gibba045 bash[25517]: cluster 2021-03-10T17:05:55.573180+0000 mgr.gibba045.orlgmj (mgr.34412) 10392 : cluster [DBG] pgmap v5922: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:59.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:05:59 gibba045 bash[25517]: cluster 2021-03-10T17:05:57.574992+0000 mgr.gibba045.orlgmj (mgr.34412) 10393 : cluster [DBG] pgmap v5923: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:59.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:05:59 gibba015 bash[29377]: cluster 2021-03-10T17:05:57.574992+0000 mgr.gibba045.orlgmj (mgr.34412) 10393 : cluster [DBG] pgmap v5923: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:59.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:05:59 gibba015 bash[30343]: cluster 2021-03-10T17:05:57.574992+0000 mgr.gibba045.orlgmj (mgr.34412) 10393 : cluster [DBG] pgmap v5923: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:01.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:06:01 gibba045 bash[25517]: cluster 2021-03-10T17:05:59.576546+0000 mgr.gibba045.orlgmj (mgr.34412) 10394 : cluster [DBG] pgmap v5924: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:01.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:06:01 gibba015 bash[29377]: cluster 2021-03-10T17:05:59.576546+0000 mgr.gibba045.orlgmj (mgr.34412) 10394 : cluster [DBG] pgmap v5924: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:01.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:06:01 gibba015 bash[30343]: cluster 2021-03-10T17:05:59.576546+0000 mgr.gibba045.orlgmj (mgr.34412) 10394 : cluster [DBG] pgmap v5924: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:03.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:06:03 gibba045 bash[25517]: cluster 2021-03-10T17:06:01.578102+0000 mgr.gibba045.orlgmj (mgr.34412) 10395 : cluster [DBG] pgmap v5925: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:03.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:06:03 gibba015 bash[29377]: cluster 2021-03-10T17:06:01.578102+0000 mgr.gibba045.orlgmj (mgr.34412) 10395 : cluster [DBG] pgmap v5925: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:03.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:06:03 gibba015 bash[30343]: cluster 2021-03-10T17:06:01.578102+0000 mgr.gibba045.orlgmj (mgr.34412) 10395 : cluster [DBG] pgmap v5925: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:05.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:06:05 gibba045 bash[25517]: cluster 2021-03-10T17:06:03.579355+0000 mgr.gibba045.orlgmj (mgr.34412) 10396 : cluster [DBG] pgmap v5926: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:05.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:06:05 gibba015 bash[29377]: cluster 2021-03-10T17:06:03.579355+0000 mgr.gibba045.orlgmj (mgr.34412) 10396 : cluster [DBG] pgmap v5926: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:05.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:06:05 gibba015 bash[30343]: cluster 2021-03-10T17:06:03.579355+0000 mgr.gibba045.orlgmj (mgr.34412) 10396 : cluster [DBG] pgmap v5926: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:07.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:06:07 gibba045 bash[25517]: cluster 2021-03-10T17:06:05.580950+0000 mgr.gibba045.orlgmj (mgr.34412) 10397 : cluster [DBG] pgmap v5927: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:07.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:06:07 gibba015 bash[29377]: cluster 2021-03-10T17:06:05.580950+0000 mgr.gibba045.orlgmj (mgr.34412) 10397 : cluster [DBG] pgmap v5927: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:07.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:06:07 gibba015 bash[30343]: cluster 2021-03-10T17:06:05.580950+0000 mgr.gibba045.orlgmj (mgr.34412) 10397 : cluster [DBG] pgmap v5927: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:09.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:06:09 gibba045 bash[25517]: cluster 2021-03-10T17:06:07.582469+0000 mgr.gibba045.orlgmj (mgr.34412) 10398 : cluster [DBG] pgmap v5928: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:09.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:06:09 gibba015 bash[29377]: cluster 2021-03-10T17:06:07.582469+0000 mgr.gibba045.orlgmj (mgr.34412) 10398 : cluster [DBG] pgmap v5928: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:09.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:06:09 gibba015 bash[30343]: cluster 2021-03-10T17:06:07.582469+0000 mgr.gibba045.orlgmj (mgr.34412) 10398 : cluster [DBG] pgmap v5928: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:10.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:06:10 gibba045 bash[25517]: audit 2021-03-10T17:06:10.212290+0000 mon.c (mon.1) 2851 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:06:10.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:06:10 gibba015 bash[29377]: audit 2021-03-10T17:06:10.212290+0000 mon.c (mon.1) 2851 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:06:10.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:06:10 gibba015 bash[30343]: audit 2021-03-10T17:06:10.212290+0000 mon.c (mon.1) 2851 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:06:11.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:06:11 gibba015 bash[29377]: cluster 2021-03-10T17:06:09.583820+0000 mgr.gibba045.orlgmj (mgr.34412) 10399 : cluster [DBG] pgmap v5929: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:11.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:06:11 gibba015 bash[29377]: cephadm 2021-03-10T17:06:10.219779+0000 mgr.gibba045.orlgmj (mgr.34412) 10400 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:06:11.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:06:11 gibba015 bash[29377]: cephadm 2021-03-10T17:06:10.221638+0000 mgr.gibba045.orlgmj (mgr.34412) 10401 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:06:11.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:06:11 gibba015 bash[29377]: audit 2021-03-10T17:06:10.438503+0000 mon.a (mon.0) 2236 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:06:11.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:06:11 gibba015 bash[29377]: audit 2021-03-10T17:06:10.442496+0000 mon.c (mon.1) 2852 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:06:11.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:06:11 gibba015 bash[29377]: audit 2021-03-10T17:06:10.445225+0000 mon.c (mon.1) 2853 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:06:11.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:06:11 gibba015 bash[29377]: audit 2021-03-10T17:06:10.447580+0000 mon.c (mon.1) 2854 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:06:11.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:06:11 gibba015 bash[29377]: audit 2021-03-10T17:06:10.449703+0000 mon.c (mon.1) 2855 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:06:11.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:06:11 gibba015 bash[29377]: audit 2021-03-10T17:06:10.455659+0000 mon.c (mon.1) 2856 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:06:11.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:06:11 gibba015 bash[29377]: audit 2021-03-10T17:06:10.458320+0000 mon.c (mon.1) 2857 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:06:11.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:06:11 gibba015 bash[30343]: cluster 2021-03-10T17:06:09.583820+0000 mgr.gibba045.orlgmj (mgr.34412) 10399 : cluster [DBG] pgmap v5929: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:11.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:06:11 gibba015 bash[30343]: cephadm 2021-03-10T17:06:10.219779+0000 mgr.gibba045.orlgmj (mgr.34412) 10400 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:06:11.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:06:11 gibba015 bash[30343]: cephadm 2021-03-10T17:06:10.221638+0000 mgr.gibba045.orlgmj (mgr.34412) 10401 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:06:11.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:06:11 gibba015 bash[30343]: audit 2021-03-10T17:06:10.438503+0000 mon.a (mon.0) 2236 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:06:11.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:06:11 gibba015 bash[30343]: audit 2021-03-10T17:06:10.442496+0000 mon.c (mon.1) 2852 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:06:11.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:06:11 gibba015 bash[30343]: audit 2021-03-10T17:06:10.445225+0000 mon.c (mon.1) 2853 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:06:11.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:06:11 gibba015 bash[30343]: audit 2021-03-10T17:06:10.447580+0000 mon.c (mon.1) 2854 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:06:11.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:06:11 gibba015 bash[30343]: audit 2021-03-10T17:06:10.449703+0000 mon.c (mon.1) 2855 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:06:11.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:06:11 gibba015 bash[30343]: audit 2021-03-10T17:06:10.455659+0000 mon.c (mon.1) 2856 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:06:11.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:06:11 gibba015 bash[30343]: audit 2021-03-10T17:06:10.458320+0000 mon.c (mon.1) 2857 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:06:11.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:06:11 gibba045 bash[25517]: cluster 2021-03-10T17:06:09.583820+0000 mgr.gibba045.orlgmj (mgr.34412) 10399 : cluster [DBG] pgmap v5929: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:11.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:06:11 gibba045 bash[25517]: cephadm 2021-03-10T17:06:10.219779+0000 mgr.gibba045.orlgmj (mgr.34412) 10400 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:06:11.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:06:11 gibba045 bash[25517]: cephadm 2021-03-10T17:06:10.221638+0000 mgr.gibba045.orlgmj (mgr.34412) 10401 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:06:11.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:06:11 gibba045 bash[25517]: audit 2021-03-10T17:06:10.438503+0000 mon.a (mon.0) 2236 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:06:11.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:06:11 gibba045 bash[25517]: audit 2021-03-10T17:06:10.442496+0000 mon.c (mon.1) 2852 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:06:11.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:06:11 gibba045 bash[25517]: audit 2021-03-10T17:06:10.445225+0000 mon.c (mon.1) 2853 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:06:11.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:06:11 gibba045 bash[25517]: audit 2021-03-10T17:06:10.447580+0000 mon.c (mon.1) 2854 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:06:11.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:06:11 gibba045 bash[25517]: audit 2021-03-10T17:06:10.449703+0000 mon.c (mon.1) 2855 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:06:11.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:06:11 gibba045 bash[25517]: audit 2021-03-10T17:06:10.455659+0000 mon.c (mon.1) 2856 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:06:11.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:06:11 gibba045 bash[25517]: audit 2021-03-10T17:06:10.458320+0000 mon.c (mon.1) 2857 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:06:12.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:06:12 gibba015 bash[29377]: cephadm 2021-03-10T17:06:10.443553+0000 mgr.gibba045.orlgmj (mgr.34412) 10402 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:06:12.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:06:12 gibba015 bash[29377]: cephadm 2021-03-10T17:06:10.446746+0000 mgr.gibba045.orlgmj (mgr.34412) 10403 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:06:12.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:06:12 gibba015 bash[29377]: cephadm 2021-03-10T17:06:10.449048+0000 mgr.gibba045.orlgmj (mgr.34412) 10404 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:06:12.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:06:12 gibba015 bash[29377]: cephadm 2021-03-10T17:06:10.449094+0000 mgr.gibba045.orlgmj (mgr.34412) 10405 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:06:12.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:06:12 gibba015 bash[29377]: cephadm 2021-03-10T17:06:10.451246+0000 mgr.gibba045.orlgmj (mgr.34412) 10406 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:06:12.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:06:12 gibba015 bash[29377]: cephadm 2021-03-10T17:06:10.451289+0000 mgr.gibba045.orlgmj (mgr.34412) 10407 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:06:12.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:06:12 gibba015 bash[29377]: cephadm 2021-03-10T17:06:10.453454+0000 mgr.gibba045.orlgmj (mgr.34412) 10408 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:06:12.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:06:12 gibba015 bash[29377]: cephadm 2021-03-10T17:06:10.456994+0000 mgr.gibba045.orlgmj (mgr.34412) 10409 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:06:12.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:06:12 gibba015 bash[29377]: cephadm 2021-03-10T17:06:10.457040+0000 mgr.gibba045.orlgmj (mgr.34412) 10410 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:06:12.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:06:12 gibba015 bash[29377]: cephadm 2021-03-10T17:06:10.459355+0000 mgr.gibba045.orlgmj (mgr.34412) 10411 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:06:12.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:06:12 gibba015 bash[29377]: cephadm 2021-03-10T17:06:10.459675+0000 mgr.gibba045.orlgmj (mgr.34412) 10412 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:06:12.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:06:12 gibba015 bash[29377]: cephadm 2021-03-10T17:06:10.462181+0000 mgr.gibba045.orlgmj (mgr.34412) 10413 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:06:12.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:06:12 gibba015 bash[29377]: cephadm 2021-03-10T17:06:10.462230+0000 mgr.gibba045.orlgmj (mgr.34412) 10414 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:06:12.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:06:12 gibba015 bash[29377]: cephadm 2021-03-10T17:06:10.462353+0000 mgr.gibba045.orlgmj (mgr.34412) 10415 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:06:12.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:06:12 gibba015 bash[30343]: cephadm 2021-03-10T17:06:10.443553+0000 mgr.gibba045.orlgmj (mgr.34412) 10402 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:06:12.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:06:12 gibba015 bash[30343]: cephadm 2021-03-10T17:06:10.446746+0000 mgr.gibba045.orlgmj (mgr.34412) 10403 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:06:12.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:06:12 gibba015 bash[30343]: cephadm 2021-03-10T17:06:10.449048+0000 mgr.gibba045.orlgmj (mgr.34412) 10404 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:06:12.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:06:12 gibba015 bash[30343]: cephadm 2021-03-10T17:06:10.449094+0000 mgr.gibba045.orlgmj (mgr.34412) 10405 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:06:12.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:06:12 gibba015 bash[30343]: cephadm 2021-03-10T17:06:10.451246+0000 mgr.gibba045.orlgmj (mgr.34412) 10406 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:06:12.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:06:12 gibba015 bash[30343]: cephadm 2021-03-10T17:06:10.451289+0000 mgr.gibba045.orlgmj (mgr.34412) 10407 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:06:12.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:06:12 gibba015 bash[30343]: cephadm 2021-03-10T17:06:10.453454+0000 mgr.gibba045.orlgmj (mgr.34412) 10408 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:06:12.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:06:12 gibba015 bash[30343]: cephadm 2021-03-10T17:06:10.456994+0000 mgr.gibba045.orlgmj (mgr.34412) 10409 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:06:12.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:06:12 gibba015 bash[30343]: cephadm 2021-03-10T17:06:10.457040+0000 mgr.gibba045.orlgmj (mgr.34412) 10410 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:06:12.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:06:12 gibba015 bash[30343]: cephadm 2021-03-10T17:06:10.459355+0000 mgr.gibba045.orlgmj (mgr.34412) 10411 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:06:12.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:06:12 gibba015 bash[30343]: cephadm 2021-03-10T17:06:10.459675+0000 mgr.gibba045.orlgmj (mgr.34412) 10412 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:06:12.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:06:12 gibba015 bash[30343]: cephadm 2021-03-10T17:06:10.462181+0000 mgr.gibba045.orlgmj (mgr.34412) 10413 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:06:12.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:06:12 gibba015 bash[30343]: cephadm 2021-03-10T17:06:10.462230+0000 mgr.gibba045.orlgmj (mgr.34412) 10414 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:06:12.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:06:12 gibba015 bash[30343]: cephadm 2021-03-10T17:06:10.462353+0000 mgr.gibba045.orlgmj (mgr.34412) 10415 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:06:12.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:06:12 gibba045 bash[25517]: cephadm 2021-03-10T17:06:10.443553+0000 mgr.gibba045.orlgmj (mgr.34412) 10402 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:06:12.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:06:12 gibba045 bash[25517]: cephadm 2021-03-10T17:06:10.446746+0000 mgr.gibba045.orlgmj (mgr.34412) 10403 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:06:12.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:06:12 gibba045 bash[25517]: cephadm 2021-03-10T17:06:10.449048+0000 mgr.gibba045.orlgmj (mgr.34412) 10404 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:06:12.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:06:12 gibba045 bash[25517]: cephadm 2021-03-10T17:06:10.449094+0000 mgr.gibba045.orlgmj (mgr.34412) 10405 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:06:12.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:06:12 gibba045 bash[25517]: cephadm 2021-03-10T17:06:10.451246+0000 mgr.gibba045.orlgmj (mgr.34412) 10406 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:06:12.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:06:12 gibba045 bash[25517]: cephadm 2021-03-10T17:06:10.451289+0000 mgr.gibba045.orlgmj (mgr.34412) 10407 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:06:12.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:06:12 gibba045 bash[25517]: cephadm 2021-03-10T17:06:10.453454+0000 mgr.gibba045.orlgmj (mgr.34412) 10408 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:06:12.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:06:12 gibba045 bash[25517]: cephadm 2021-03-10T17:06:10.456994+0000 mgr.gibba045.orlgmj (mgr.34412) 10409 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:06:12.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:06:12 gibba045 bash[25517]: cephadm 2021-03-10T17:06:10.457040+0000 mgr.gibba045.orlgmj (mgr.34412) 10410 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:06:12.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:06:12 gibba045 bash[25517]: cephadm 2021-03-10T17:06:10.459355+0000 mgr.gibba045.orlgmj (mgr.34412) 10411 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:06:12.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:06:12 gibba045 bash[25517]: cephadm 2021-03-10T17:06:10.459675+0000 mgr.gibba045.orlgmj (mgr.34412) 10412 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:06:12.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:06:12 gibba045 bash[25517]: cephadm 2021-03-10T17:06:10.462181+0000 mgr.gibba045.orlgmj (mgr.34412) 10413 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:06:12.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:06:12 gibba045 bash[25517]: cephadm 2021-03-10T17:06:10.462230+0000 mgr.gibba045.orlgmj (mgr.34412) 10414 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:06:12.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:06:12 gibba045 bash[25517]: cephadm 2021-03-10T17:06:10.462353+0000 mgr.gibba045.orlgmj (mgr.34412) 10415 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:06:13.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:06:13 gibba015 bash[29377]: cluster 2021-03-10T17:06:11.585775+0000 mgr.gibba045.orlgmj (mgr.34412) 10416 : cluster [DBG] pgmap v5930: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:13.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:06:13 gibba015 bash[30343]: cluster 2021-03-10T17:06:11.585775+0000 mgr.gibba045.orlgmj (mgr.34412) 10416 : cluster [DBG] pgmap v5930: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:13.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:06:13 gibba045 bash[25517]: cluster 2021-03-10T17:06:11.585775+0000 mgr.gibba045.orlgmj (mgr.34412) 10416 : cluster [DBG] pgmap v5930: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:14.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:06:14 gibba015 bash[29377]: cluster 2021-03-10T17:06:13.586972+0000 mgr.gibba045.orlgmj (mgr.34412) 10417 : cluster [DBG] pgmap v5931: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:14.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:06:14 gibba015 bash[30343]: cluster 2021-03-10T17:06:13.586972+0000 mgr.gibba045.orlgmj (mgr.34412) 10417 : cluster [DBG] pgmap v5931: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:14.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:06:14 gibba045 bash[25517]: cluster 2021-03-10T17:06:13.586972+0000 mgr.gibba045.orlgmj (mgr.34412) 10417 : cluster [DBG] pgmap v5931: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:16.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:06:16 gibba015 bash[29377]: cluster 2021-03-10T17:06:15.588676+0000 mgr.gibba045.orlgmj (mgr.34412) 10418 : cluster [DBG] pgmap v5932: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:16.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:06:16 gibba015 bash[30343]: cluster 2021-03-10T17:06:15.588676+0000 mgr.gibba045.orlgmj (mgr.34412) 10418 : cluster [DBG] pgmap v5932: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:17.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:06:16 gibba045 bash[25517]: cluster 2021-03-10T17:06:15.588676+0000 mgr.gibba045.orlgmj (mgr.34412) 10418 : cluster [DBG] pgmap v5932: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:18.110 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:06:18.365 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:06:18.366 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 9m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:06:18.366 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 8m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:06:18.366 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:06:18.366 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:06:18.367 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:06:18.367 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:06:18.367 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:06:18.367 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:06:18.367 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 9m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:06:18.368 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 8m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:06:18.368 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:06:18.368 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:06:18.368 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:06:18.369 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:06:18.369 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:06:18.369 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:06:18.369 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:06:18.369 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:06:18.370 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 8m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:06:18.370 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 8m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:06:18.621 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:06:18.622 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:06:18.622 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:06:18.622 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:06:18.623 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:06:18.623 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:06:18.623 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:06:18.623 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:06:18.624 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:06:18.624 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:06:18.624 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:06:18.624 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:06:18.624 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:06:18.625 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:06:18.625 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:06:19.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:06:19 gibba045 bash[25517]: cluster 2021-03-10T17:06:17.590430+0000 mgr.gibba045.orlgmj (mgr.34412) 10419 : cluster [DBG] pgmap v5933: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:19.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:06:19 gibba045 bash[25517]: audit 2021-03-10T17:06:18.102044+0000 mgr.gibba045.orlgmj (mgr.34412) 10420 : audit [DBG] from='client.61024 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:06:19.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:06:19 gibba045 bash[25517]: audit 2021-03-10T17:06:18.620788+0000 mon.a (mon.0) 2237 : audit [DBG] from='client.? 172.21.2.115:0/701842612' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:06:19.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:06:19 gibba015 bash[29377]: cluster 2021-03-10T17:06:17.590430+0000 mgr.gibba045.orlgmj (mgr.34412) 10419 : cluster [DBG] pgmap v5933: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:19.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:06:19 gibba015 bash[29377]: audit 2021-03-10T17:06:18.102044+0000 mgr.gibba045.orlgmj (mgr.34412) 10420 : audit [DBG] from='client.61024 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:06:19.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:06:19 gibba015 bash[29377]: audit 2021-03-10T17:06:18.620788+0000 mon.a (mon.0) 2237 : audit [DBG] from='client.? 172.21.2.115:0/701842612' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:06:19.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:06:19 gibba015 bash[30343]: cluster 2021-03-10T17:06:17.590430+0000 mgr.gibba045.orlgmj (mgr.34412) 10419 : cluster [DBG] pgmap v5933: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:19.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:06:19 gibba015 bash[30343]: audit 2021-03-10T17:06:18.102044+0000 mgr.gibba045.orlgmj (mgr.34412) 10420 : audit [DBG] from='client.61024 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:06:19.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:06:19 gibba015 bash[30343]: audit 2021-03-10T17:06:18.620788+0000 mon.a (mon.0) 2237 : audit [DBG] from='client.? 172.21.2.115:0/701842612' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:06:20.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:06:20 gibba045 bash[25517]: audit 2021-03-10T17:06:18.325788+0000 mgr.gibba045.orlgmj (mgr.34412) 10421 : audit [DBG] from='client.51042 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:06:20.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:06:20 gibba015 bash[29377]: audit 2021-03-10T17:06:18.325788+0000 mgr.gibba045.orlgmj (mgr.34412) 10421 : audit [DBG] from='client.51042 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:06:20.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:06:20 gibba015 bash[30343]: audit 2021-03-10T17:06:18.325788+0000 mgr.gibba045.orlgmj (mgr.34412) 10421 : audit [DBG] from='client.51042 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:06:21.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:06:21 gibba045 bash[25517]: cluster 2021-03-10T17:06:19.591887+0000 mgr.gibba045.orlgmj (mgr.34412) 10422 : cluster [DBG] pgmap v5934: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:21.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:06:21 gibba015 bash[29377]: cluster 2021-03-10T17:06:19.591887+0000 mgr.gibba045.orlgmj (mgr.34412) 10422 : cluster [DBG] pgmap v5934: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:21.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:06:21 gibba015 bash[30343]: cluster 2021-03-10T17:06:19.591887+0000 mgr.gibba045.orlgmj (mgr.34412) 10422 : cluster [DBG] pgmap v5934: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:23.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:06:23 gibba045 bash[25517]: cluster 2021-03-10T17:06:21.593697+0000 mgr.gibba045.orlgmj (mgr.34412) 10423 : cluster [DBG] pgmap v5935: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:23.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:06:23 gibba015 bash[29377]: cluster 2021-03-10T17:06:21.593697+0000 mgr.gibba045.orlgmj (mgr.34412) 10423 : cluster [DBG] pgmap v5935: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:23.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:06:23 gibba015 bash[30343]: cluster 2021-03-10T17:06:21.593697+0000 mgr.gibba045.orlgmj (mgr.34412) 10423 : cluster [DBG] pgmap v5935: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:25.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:06:25 gibba045 bash[25517]: cluster 2021-03-10T17:06:23.594888+0000 mgr.gibba045.orlgmj (mgr.34412) 10424 : cluster [DBG] pgmap v5936: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:25.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:06:25 gibba015 bash[29377]: cluster 2021-03-10T17:06:23.594888+0000 mgr.gibba045.orlgmj (mgr.34412) 10424 : cluster [DBG] pgmap v5936: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:25.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:06:25 gibba015 bash[30343]: cluster 2021-03-10T17:06:23.594888+0000 mgr.gibba045.orlgmj (mgr.34412) 10424 : cluster [DBG] pgmap v5936: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:27.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:06:27 gibba045 bash[25517]: cephadm 2021-03-10T17:06:25.465025+0000 mgr.gibba045.orlgmj (mgr.34412) 10425 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:06:27.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:06:27 gibba045 bash[25517]: cluster 2021-03-10T17:06:25.596470+0000 mgr.gibba045.orlgmj (mgr.34412) 10426 : cluster [DBG] pgmap v5937: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:27.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:06:27 gibba015 bash[29377]: cephadm 2021-03-10T17:06:25.465025+0000 mgr.gibba045.orlgmj (mgr.34412) 10425 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:06:27.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:06:27 gibba015 bash[29377]: cluster 2021-03-10T17:06:25.596470+0000 mgr.gibba045.orlgmj (mgr.34412) 10426 : cluster [DBG] pgmap v5937: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:27.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:06:27 gibba015 bash[30343]: cephadm 2021-03-10T17:06:25.465025+0000 mgr.gibba045.orlgmj (mgr.34412) 10425 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:06:27.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:06:27 gibba015 bash[30343]: cluster 2021-03-10T17:06:25.596470+0000 mgr.gibba045.orlgmj (mgr.34412) 10426 : cluster [DBG] pgmap v5937: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:29.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:06:29 gibba015 bash[29377]: cluster 2021-03-10T17:06:27.597893+0000 mgr.gibba045.orlgmj (mgr.34412) 10427 : cluster [DBG] pgmap v5938: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:29.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:06:29 gibba015 bash[30343]: cluster 2021-03-10T17:06:27.597893+0000 mgr.gibba045.orlgmj (mgr.34412) 10427 : cluster [DBG] pgmap v5938: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:29.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:06:29 gibba045 bash[25517]: cluster 2021-03-10T17:06:27.597893+0000 mgr.gibba045.orlgmj (mgr.34412) 10427 : cluster [DBG] pgmap v5938: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:31.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:06:31 gibba015 bash[29377]: cluster 2021-03-10T17:06:29.599560+0000 mgr.gibba045.orlgmj (mgr.34412) 10428 : cluster [DBG] pgmap v5939: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:31.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:06:31 gibba015 bash[30343]: cluster 2021-03-10T17:06:29.599560+0000 mgr.gibba045.orlgmj (mgr.34412) 10428 : cluster [DBG] pgmap v5939: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:31.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:06:31 gibba045 bash[25517]: cluster 2021-03-10T17:06:29.599560+0000 mgr.gibba045.orlgmj (mgr.34412) 10428 : cluster [DBG] pgmap v5939: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:33.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:06:33 gibba045 bash[25517]: cluster 2021-03-10T17:06:31.601469+0000 mgr.gibba045.orlgmj (mgr.34412) 10429 : cluster [DBG] pgmap v5940: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:33.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:06:33 gibba015 bash[29377]: cluster 2021-03-10T17:06:31.601469+0000 mgr.gibba045.orlgmj (mgr.34412) 10429 : cluster [DBG] pgmap v5940: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:33.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:06:33 gibba015 bash[30343]: cluster 2021-03-10T17:06:31.601469+0000 mgr.gibba045.orlgmj (mgr.34412) 10429 : cluster [DBG] pgmap v5940: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:35.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:06:35 gibba045 bash[25517]: cluster 2021-03-10T17:06:33.602670+0000 mgr.gibba045.orlgmj (mgr.34412) 10430 : cluster [DBG] pgmap v5941: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:35.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:06:35 gibba015 bash[29377]: cluster 2021-03-10T17:06:33.602670+0000 mgr.gibba045.orlgmj (mgr.34412) 10430 : cluster [DBG] pgmap v5941: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:35.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:06:35 gibba015 bash[30343]: cluster 2021-03-10T17:06:33.602670+0000 mgr.gibba045.orlgmj (mgr.34412) 10430 : cluster [DBG] pgmap v5941: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:37.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:06:37 gibba045 bash[25517]: cluster 2021-03-10T17:06:35.604171+0000 mgr.gibba045.orlgmj (mgr.34412) 10431 : cluster [DBG] pgmap v5942: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:37.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:06:37 gibba015 bash[29377]: cluster 2021-03-10T17:06:35.604171+0000 mgr.gibba045.orlgmj (mgr.34412) 10431 : cluster [DBG] pgmap v5942: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:37.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:06:37 gibba015 bash[30343]: cluster 2021-03-10T17:06:35.604171+0000 mgr.gibba045.orlgmj (mgr.34412) 10431 : cluster [DBG] pgmap v5942: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:39.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:06:39 gibba045 bash[25517]: cluster 2021-03-10T17:06:37.605820+0000 mgr.gibba045.orlgmj (mgr.34412) 10432 : cluster [DBG] pgmap v5943: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:39.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:06:39 gibba015 bash[29377]: cluster 2021-03-10T17:06:37.605820+0000 mgr.gibba045.orlgmj (mgr.34412) 10432 : cluster [DBG] pgmap v5943: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:39.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:06:39 gibba015 bash[30343]: cluster 2021-03-10T17:06:37.605820+0000 mgr.gibba045.orlgmj (mgr.34412) 10432 : cluster [DBG] pgmap v5943: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:41.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:06:41 gibba045 bash[25517]: cluster 2021-03-10T17:06:39.607344+0000 mgr.gibba045.orlgmj (mgr.34412) 10433 : cluster [DBG] pgmap v5944: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:41.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:06:41 gibba015 bash[29377]: cluster 2021-03-10T17:06:39.607344+0000 mgr.gibba045.orlgmj (mgr.34412) 10433 : cluster [DBG] pgmap v5944: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:41.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:06:41 gibba015 bash[30343]: cluster 2021-03-10T17:06:39.607344+0000 mgr.gibba045.orlgmj (mgr.34412) 10433 : cluster [DBG] pgmap v5944: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:42.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:06:42 gibba045 bash[25517]: cephadm 2021-03-10T17:06:40.481162+0000 mgr.gibba045.orlgmj (mgr.34412) 10434 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:06:42.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:06:42 gibba015 bash[29377]: cephadm 2021-03-10T17:06:40.481162+0000 mgr.gibba045.orlgmj (mgr.34412) 10434 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:06:42.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:06:42 gibba015 bash[30343]: cephadm 2021-03-10T17:06:40.481162+0000 mgr.gibba045.orlgmj (mgr.34412) 10434 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:06:43.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:06:43 gibba015 bash[29377]: cluster 2021-03-10T17:06:41.609135+0000 mgr.gibba045.orlgmj (mgr.34412) 10435 : cluster [DBG] pgmap v5945: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:43.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:06:43 gibba015 bash[30343]: cluster 2021-03-10T17:06:41.609135+0000 mgr.gibba045.orlgmj (mgr.34412) 10435 : cluster [DBG] pgmap v5945: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:43.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:06:43 gibba045 bash[25517]: cluster 2021-03-10T17:06:41.609135+0000 mgr.gibba045.orlgmj (mgr.34412) 10435 : cluster [DBG] pgmap v5945: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:45.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:06:45 gibba015 bash[29377]: cluster 2021-03-10T17:06:43.610223+0000 mgr.gibba045.orlgmj (mgr.34412) 10436 : cluster [DBG] pgmap v5946: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:45.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:06:45 gibba015 bash[30343]: cluster 2021-03-10T17:06:43.610223+0000 mgr.gibba045.orlgmj (mgr.34412) 10436 : cluster [DBG] pgmap v5946: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:45.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:06:45 gibba045 bash[25517]: cluster 2021-03-10T17:06:43.610223+0000 mgr.gibba045.orlgmj (mgr.34412) 10436 : cluster [DBG] pgmap v5946: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:46.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:06:46 gibba015 bash[29377]: cluster 2021-03-10T17:06:45.611769+0000 mgr.gibba045.orlgmj (mgr.34412) 10437 : cluster [DBG] pgmap v5947: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:46.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:06:46 gibba015 bash[30343]: cluster 2021-03-10T17:06:45.611769+0000 mgr.gibba045.orlgmj (mgr.34412) 10437 : cluster [DBG] pgmap v5947: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:46.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:06:46 gibba045 bash[25517]: cluster 2021-03-10T17:06:45.611769+0000 mgr.gibba045.orlgmj (mgr.34412) 10437 : cluster [DBG] pgmap v5947: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:48.864 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:06:49.095 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:06:49.095 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 9m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:06:49.096 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 8m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:06:49.096 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:06:49.096 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:06:49.096 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:06:49.097 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:06:49.097 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:06:49.097 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:06:49.097 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 9m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:06:49.097 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 8m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:06:49.098 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:06:49.098 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:06:49.098 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:06:49.098 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:06:49.099 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:06:49.099 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:06:49.099 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:06:49.099 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:06:49.099 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 8m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:06:49.100 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 8m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:06:49.343 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:06:49.344 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:06:49.344 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:06:49.344 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:06:49.345 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:06:49.345 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:06:49.345 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:06:49.345 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:06:49.345 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:06:49.346 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:06:49.346 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:06:49.346 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:06:49.346 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:06:49.347 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:06:49.347 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:06:49.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:06:49 gibba045 bash[25517]: cluster 2021-03-10T17:06:47.613452+0000 mgr.gibba045.orlgmj (mgr.34412) 10438 : cluster [DBG] pgmap v5948: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:49.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:06:49 gibba015 bash[29377]: cluster 2021-03-10T17:06:47.613452+0000 mgr.gibba045.orlgmj (mgr.34412) 10438 : cluster [DBG] pgmap v5948: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:49.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:06:49 gibba015 bash[30343]: cluster 2021-03-10T17:06:47.613452+0000 mgr.gibba045.orlgmj (mgr.34412) 10438 : cluster [DBG] pgmap v5948: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:50.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:06:50 gibba045 bash[25517]: audit 2021-03-10T17:06:48.856864+0000 mgr.gibba045.orlgmj (mgr.34412) 10439 : audit [DBG] from='client.51054 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:06:50.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:06:50 gibba045 bash[25517]: audit 2021-03-10T17:06:49.083433+0000 mgr.gibba045.orlgmj (mgr.34412) 10440 : audit [DBG] from='client.61048 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:06:50.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:06:50 gibba045 bash[25517]: audit 2021-03-10T17:06:49.342893+0000 mon.c (mon.1) 2858 : audit [DBG] from='client.? 172.21.2.115:0/599428208' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:06:50.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:06:50 gibba015 bash[29377]: audit 2021-03-10T17:06:48.856864+0000 mgr.gibba045.orlgmj (mgr.34412) 10439 : audit [DBG] from='client.51054 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:06:50.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:06:50 gibba015 bash[29377]: audit 2021-03-10T17:06:49.083433+0000 mgr.gibba045.orlgmj (mgr.34412) 10440 : audit [DBG] from='client.61048 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:06:50.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:06:50 gibba015 bash[29377]: audit 2021-03-10T17:06:49.342893+0000 mon.c (mon.1) 2858 : audit [DBG] from='client.? 172.21.2.115:0/599428208' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:06:50.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:06:50 gibba015 bash[30343]: audit 2021-03-10T17:06:48.856864+0000 mgr.gibba045.orlgmj (mgr.34412) 10439 : audit [DBG] from='client.51054 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:06:50.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:06:50 gibba015 bash[30343]: audit 2021-03-10T17:06:49.083433+0000 mgr.gibba045.orlgmj (mgr.34412) 10440 : audit [DBG] from='client.61048 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:06:50.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:06:50 gibba015 bash[30343]: audit 2021-03-10T17:06:49.342893+0000 mon.c (mon.1) 2858 : audit [DBG] from='client.? 172.21.2.115:0/599428208' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:06:51.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:06:51 gibba045 bash[25517]: cluster 2021-03-10T17:06:49.614952+0000 mgr.gibba045.orlgmj (mgr.34412) 10441 : cluster [DBG] pgmap v5949: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:51.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:06:51 gibba015 bash[29377]: cluster 2021-03-10T17:06:49.614952+0000 mgr.gibba045.orlgmj (mgr.34412) 10441 : cluster [DBG] pgmap v5949: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:51.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:06:51 gibba015 bash[30343]: cluster 2021-03-10T17:06:49.614952+0000 mgr.gibba045.orlgmj (mgr.34412) 10441 : cluster [DBG] pgmap v5949: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:53.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:06:53 gibba045 bash[25517]: cluster 2021-03-10T17:06:51.616822+0000 mgr.gibba045.orlgmj (mgr.34412) 10442 : cluster [DBG] pgmap v5950: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:53.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:06:53 gibba015 bash[29377]: cluster 2021-03-10T17:06:51.616822+0000 mgr.gibba045.orlgmj (mgr.34412) 10442 : cluster [DBG] pgmap v5950: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:53.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:06:53 gibba015 bash[30343]: cluster 2021-03-10T17:06:51.616822+0000 mgr.gibba045.orlgmj (mgr.34412) 10442 : cluster [DBG] pgmap v5950: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:54.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:06:54 gibba015 bash[29377]: audit 2021-03-10T17:06:53.855568+0000 mon.c (mon.1) 2859 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:06:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:06:54 gibba015 bash[29377]: audit 2021-03-10T17:06:53.856411+0000 mon.c (mon.1) 2860 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:06:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:06:54 gibba015 bash[29377]: audit 2021-03-10T17:06:53.856825+0000 mon.a (mon.0) 2238 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:06:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:06:54 gibba015 bash[29377]: audit 2021-03-10T17:06:53.858190+0000 mon.a (mon.0) 2239 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:06:54.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:06:54 gibba015 bash[29377]: audit 2021-03-10T17:06:53.931640+0000 mon.c (mon.1) 2861 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T17:06:54.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:06:54 gibba015 bash[29377]: audit 2021-03-10T17:06:53.932389+0000 mon.c (mon.1) 2862 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:06:54.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:06:54 gibba015 bash[29377]: audit 2021-03-10T17:06:53.933003+0000 mon.a (mon.0) 2240 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T17:06:54.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:06:54 gibba015 bash[29377]: audit 2021-03-10T17:06:53.933060+0000 mon.c (mon.1) 2863 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T17:06:54.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:06:54 gibba015 bash[29377]: audit 2021-03-10T17:06:53.933804+0000 mon.c (mon.1) 2864 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T17:06:54.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:06:54 gibba015 bash[29377]: audit 2021-03-10T17:06:53.935192+0000 mon.a (mon.0) 2241 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:06:54.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:06:54 gibba015 bash[29377]: audit 2021-03-10T17:06:53.936156+0000 mon.a (mon.0) 2242 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T17:06:54.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:06:54 gibba015 bash[29377]: audit 2021-03-10T17:06:53.937045+0000 mon.a (mon.0) 2243 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T17:06:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:06:54 gibba015 bash[30343]: audit 2021-03-10T17:06:53.855568+0000 mon.c (mon.1) 2859 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:06:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:06:54 gibba015 bash[30343]: audit 2021-03-10T17:06:53.856411+0000 mon.c (mon.1) 2860 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:06:54.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:06:54 gibba015 bash[30343]: audit 2021-03-10T17:06:53.856825+0000 mon.a (mon.0) 2238 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:06:54.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:06:54 gibba015 bash[30343]: audit 2021-03-10T17:06:53.858190+0000 mon.a (mon.0) 2239 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:06:54.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:06:54 gibba015 bash[30343]: audit 2021-03-10T17:06:53.931640+0000 mon.c (mon.1) 2861 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T17:06:54.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:06:54 gibba015 bash[30343]: audit 2021-03-10T17:06:53.932389+0000 mon.c (mon.1) 2862 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:06:54.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:06:54 gibba015 bash[30343]: audit 2021-03-10T17:06:53.933003+0000 mon.a (mon.0) 2240 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T17:06:54.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:06:54 gibba015 bash[30343]: audit 2021-03-10T17:06:53.933060+0000 mon.c (mon.1) 2863 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T17:06:54.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:06:54 gibba015 bash[30343]: audit 2021-03-10T17:06:53.933804+0000 mon.c (mon.1) 2864 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T17:06:54.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:06:54 gibba015 bash[30343]: audit 2021-03-10T17:06:53.935192+0000 mon.a (mon.0) 2241 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:06:54.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:06:54 gibba015 bash[30343]: audit 2021-03-10T17:06:53.936156+0000 mon.a (mon.0) 2242 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T17:06:54.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:06:54 gibba015 bash[30343]: audit 2021-03-10T17:06:53.937045+0000 mon.a (mon.0) 2243 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T17:06:54.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:06:54 gibba045 bash[25517]: audit 2021-03-10T17:06:53.855568+0000 mon.c (mon.1) 2859 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:06:54.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:06:54 gibba045 bash[25517]: audit 2021-03-10T17:06:53.856411+0000 mon.c (mon.1) 2860 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:06:54.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:06:54 gibba045 bash[25517]: audit 2021-03-10T17:06:53.856825+0000 mon.a (mon.0) 2238 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:06:54.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:06:54 gibba045 bash[25517]: audit 2021-03-10T17:06:53.858190+0000 mon.a (mon.0) 2239 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:06:54.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:06:54 gibba045 bash[25517]: audit 2021-03-10T17:06:53.931640+0000 mon.c (mon.1) 2861 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T17:06:54.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:06:54 gibba045 bash[25517]: audit 2021-03-10T17:06:53.932389+0000 mon.c (mon.1) 2862 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:06:54.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:06:54 gibba045 bash[25517]: audit 2021-03-10T17:06:53.933003+0000 mon.a (mon.0) 2240 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T17:06:54.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:06:54 gibba045 bash[25517]: audit 2021-03-10T17:06:53.933060+0000 mon.c (mon.1) 2863 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T17:06:54.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:06:54 gibba045 bash[25517]: audit 2021-03-10T17:06:53.933804+0000 mon.c (mon.1) 2864 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T17:06:54.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:06:54 gibba045 bash[25517]: audit 2021-03-10T17:06:53.935192+0000 mon.a (mon.0) 2241 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:06:54.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:06:54 gibba045 bash[25517]: audit 2021-03-10T17:06:53.936156+0000 mon.a (mon.0) 2242 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T17:06:54.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:06:54 gibba045 bash[25517]: audit 2021-03-10T17:06:53.937045+0000 mon.a (mon.0) 2243 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T17:06:55.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:06:55 gibba015 bash[29377]: cluster 2021-03-10T17:06:53.617921+0000 mgr.gibba045.orlgmj (mgr.34412) 10443 : cluster [DBG] pgmap v5951: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:55.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:06:55 gibba015 bash[30343]: cluster 2021-03-10T17:06:53.617921+0000 mgr.gibba045.orlgmj (mgr.34412) 10443 : cluster [DBG] pgmap v5951: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:55.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:06:55 gibba045 bash[25517]: cluster 2021-03-10T17:06:53.617921+0000 mgr.gibba045.orlgmj (mgr.34412) 10443 : cluster [DBG] pgmap v5951: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:57.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:06:57 gibba015 bash[29377]: cephadm 2021-03-10T17:06:55.496705+0000 mgr.gibba045.orlgmj (mgr.34412) 10444 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:06:57.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:06:57 gibba015 bash[29377]: cluster 2021-03-10T17:06:55.619689+0000 mgr.gibba045.orlgmj (mgr.34412) 10445 : cluster [DBG] pgmap v5952: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:57.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:06:57 gibba015 bash[30343]: cephadm 2021-03-10T17:06:55.496705+0000 mgr.gibba045.orlgmj (mgr.34412) 10444 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:06:57.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:06:57 gibba015 bash[30343]: cluster 2021-03-10T17:06:55.619689+0000 mgr.gibba045.orlgmj (mgr.34412) 10445 : cluster [DBG] pgmap v5952: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:57.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:06:57 gibba045 bash[25517]: cephadm 2021-03-10T17:06:55.496705+0000 mgr.gibba045.orlgmj (mgr.34412) 10444 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:06:57.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:06:57 gibba045 bash[25517]: cluster 2021-03-10T17:06:55.619689+0000 mgr.gibba045.orlgmj (mgr.34412) 10445 : cluster [DBG] pgmap v5952: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:58.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:06:58 gibba015 bash[29377]: cluster 2021-03-10T17:06:57.621388+0000 mgr.gibba045.orlgmj (mgr.34412) 10446 : cluster [DBG] pgmap v5953: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:58.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:06:58 gibba015 bash[30343]: cluster 2021-03-10T17:06:57.621388+0000 mgr.gibba045.orlgmj (mgr.34412) 10446 : cluster [DBG] pgmap v5953: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:58.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:06:58 gibba045 bash[25517]: cluster 2021-03-10T17:06:57.621388+0000 mgr.gibba045.orlgmj (mgr.34412) 10446 : cluster [DBG] pgmap v5953: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:00.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:07:00 gibba015 bash[29377]: cluster 2021-03-10T17:06:59.623011+0000 mgr.gibba045.orlgmj (mgr.34412) 10447 : cluster [DBG] pgmap v5954: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:00.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:07:00 gibba015 bash[30343]: cluster 2021-03-10T17:06:59.623011+0000 mgr.gibba045.orlgmj (mgr.34412) 10447 : cluster [DBG] pgmap v5954: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:01.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:07:00 gibba045 bash[25517]: cluster 2021-03-10T17:06:59.623011+0000 mgr.gibba045.orlgmj (mgr.34412) 10447 : cluster [DBG] pgmap v5954: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:03.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:07:03 gibba045 bash[25517]: cluster 2021-03-10T17:07:01.625127+0000 mgr.gibba045.orlgmj (mgr.34412) 10448 : cluster [DBG] pgmap v5955: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:03.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:07:03 gibba015 bash[29377]: cluster 2021-03-10T17:07:01.625127+0000 mgr.gibba045.orlgmj (mgr.34412) 10448 : cluster [DBG] pgmap v5955: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:03.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:07:03 gibba015 bash[30343]: cluster 2021-03-10T17:07:01.625127+0000 mgr.gibba045.orlgmj (mgr.34412) 10448 : cluster [DBG] pgmap v5955: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:05.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:07:05 gibba045 bash[25517]: cluster 2021-03-10T17:07:03.626508+0000 mgr.gibba045.orlgmj (mgr.34412) 10449 : cluster [DBG] pgmap v5956: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:05.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:07:05 gibba015 bash[29377]: cluster 2021-03-10T17:07:03.626508+0000 mgr.gibba045.orlgmj (mgr.34412) 10449 : cluster [DBG] pgmap v5956: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:05.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:07:05 gibba015 bash[30343]: cluster 2021-03-10T17:07:03.626508+0000 mgr.gibba045.orlgmj (mgr.34412) 10449 : cluster [DBG] pgmap v5956: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:07.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:07:07 gibba045 bash[25517]: cluster 2021-03-10T17:07:05.628083+0000 mgr.gibba045.orlgmj (mgr.34412) 10450 : cluster [DBG] pgmap v5957: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:07.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:07:07 gibba015 bash[29377]: cluster 2021-03-10T17:07:05.628083+0000 mgr.gibba045.orlgmj (mgr.34412) 10450 : cluster [DBG] pgmap v5957: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:07.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:07:07 gibba015 bash[30343]: cluster 2021-03-10T17:07:05.628083+0000 mgr.gibba045.orlgmj (mgr.34412) 10450 : cluster [DBG] pgmap v5957: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:09.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:07:09 gibba015 bash[29377]: cluster 2021-03-10T17:07:07.629756+0000 mgr.gibba045.orlgmj (mgr.34412) 10451 : cluster [DBG] pgmap v5958: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:09.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:07:09 gibba015 bash[30343]: cluster 2021-03-10T17:07:07.629756+0000 mgr.gibba045.orlgmj (mgr.34412) 10451 : cluster [DBG] pgmap v5958: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:09.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:07:09 gibba045 bash[25517]: cluster 2021-03-10T17:07:07.629756+0000 mgr.gibba045.orlgmj (mgr.34412) 10451 : cluster [DBG] pgmap v5958: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:11.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:07:11 gibba015 bash[29377]: cluster 2021-03-10T17:07:09.631217+0000 mgr.gibba045.orlgmj (mgr.34412) 10452 : cluster [DBG] pgmap v5959: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:11.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:07:11 gibba015 bash[29377]: audit 2021-03-10T17:07:10.511545+0000 mon.c (mon.1) 2865 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:07:11.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:07:11 gibba015 bash[29377]: audit 2021-03-10T17:07:10.518536+0000 mon.c (mon.1) 2866 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:07:11.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:07:11 gibba015 bash[30343]: cluster 2021-03-10T17:07:09.631217+0000 mgr.gibba045.orlgmj (mgr.34412) 10452 : cluster [DBG] pgmap v5959: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:11.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:07:11 gibba015 bash[30343]: audit 2021-03-10T17:07:10.511545+0000 mon.c (mon.1) 2865 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:07:11.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:07:11 gibba015 bash[30343]: audit 2021-03-10T17:07:10.518536+0000 mon.c (mon.1) 2866 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:07:11.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:07:11 gibba045 bash[25517]: cluster 2021-03-10T17:07:09.631217+0000 mgr.gibba045.orlgmj (mgr.34412) 10452 : cluster [DBG] pgmap v5959: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:11.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:07:11 gibba045 bash[25517]: audit 2021-03-10T17:07:10.511545+0000 mon.c (mon.1) 2865 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:07:11.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:07:11 gibba045 bash[25517]: audit 2021-03-10T17:07:10.518536+0000 mon.c (mon.1) 2866 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:07:12.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:07:12 gibba015 bash[29377]: cephadm 2021-03-10T17:07:10.520133+0000 mgr.gibba045.orlgmj (mgr.34412) 10453 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:07:12.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:07:12 gibba015 bash[30343]: cephadm 2021-03-10T17:07:10.520133+0000 mgr.gibba045.orlgmj (mgr.34412) 10453 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:07:12.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:07:12 gibba045 bash[25517]: cephadm 2021-03-10T17:07:10.520133+0000 mgr.gibba045.orlgmj (mgr.34412) 10453 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:07:13.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:07:13 gibba015 bash[29377]: cluster 2021-03-10T17:07:11.633138+0000 mgr.gibba045.orlgmj (mgr.34412) 10454 : cluster [DBG] pgmap v5960: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:13.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:07:13 gibba015 bash[30343]: cluster 2021-03-10T17:07:11.633138+0000 mgr.gibba045.orlgmj (mgr.34412) 10454 : cluster [DBG] pgmap v5960: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:13.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:07:13 gibba045 bash[25517]: cluster 2021-03-10T17:07:11.633138+0000 mgr.gibba045.orlgmj (mgr.34412) 10454 : cluster [DBG] pgmap v5960: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:15.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:07:15 gibba015 bash[29377]: cluster 2021-03-10T17:07:13.634540+0000 mgr.gibba045.orlgmj (mgr.34412) 10455 : cluster [DBG] pgmap v5961: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:15.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:07:15 gibba015 bash[29377]: audit 2021-03-10T17:07:14.135934+0000 mon.a (mon.0) 2244 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:07:15.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:07:15 gibba015 bash[29377]: cephadm 2021-03-10T17:07:14.138972+0000 mgr.gibba045.orlgmj (mgr.34412) 10456 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:07:15.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:07:15 gibba015 bash[29377]: audit 2021-03-10T17:07:14.331379+0000 mon.a (mon.0) 2245 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:07:15.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:07:15 gibba015 bash[29377]: audit 2021-03-10T17:07:14.335172+0000 mon.c (mon.1) 2867 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:07:15.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:07:15 gibba015 bash[29377]: audit 2021-03-10T17:07:14.337206+0000 mon.c (mon.1) 2868 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:07:15.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:07:15 gibba015 bash[29377]: audit 2021-03-10T17:07:14.339033+0000 mon.c (mon.1) 2869 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:07:15.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:07:15 gibba015 bash[29377]: audit 2021-03-10T17:07:14.340382+0000 mon.c (mon.1) 2870 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:07:15.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:07:15 gibba015 bash[29377]: audit 2021-03-10T17:07:14.344118+0000 mon.c (mon.1) 2871 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:07:15.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:07:15 gibba015 bash[29377]: audit 2021-03-10T17:07:14.345751+0000 mon.c (mon.1) 2872 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:07:15.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:07:15 gibba015 bash[30343]: cluster 2021-03-10T17:07:13.634540+0000 mgr.gibba045.orlgmj (mgr.34412) 10455 : cluster [DBG] pgmap v5961: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:15.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:07:15 gibba015 bash[30343]: audit 2021-03-10T17:07:14.135934+0000 mon.a (mon.0) 2244 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:07:15.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:07:15 gibba015 bash[30343]: cephadm 2021-03-10T17:07:14.138972+0000 mgr.gibba045.orlgmj (mgr.34412) 10456 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:07:15.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:07:15 gibba015 bash[30343]: audit 2021-03-10T17:07:14.331379+0000 mon.a (mon.0) 2245 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:07:15.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:07:15 gibba015 bash[30343]: audit 2021-03-10T17:07:14.335172+0000 mon.c (mon.1) 2867 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:07:15.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:07:15 gibba015 bash[30343]: audit 2021-03-10T17:07:14.337206+0000 mon.c (mon.1) 2868 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:07:15.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:07:15 gibba015 bash[30343]: audit 2021-03-10T17:07:14.339033+0000 mon.c (mon.1) 2869 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:07:15.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:07:15 gibba015 bash[30343]: audit 2021-03-10T17:07:14.340382+0000 mon.c (mon.1) 2870 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:07:15.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:07:15 gibba015 bash[30343]: audit 2021-03-10T17:07:14.344118+0000 mon.c (mon.1) 2871 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:07:15.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:07:15 gibba015 bash[30343]: audit 2021-03-10T17:07:14.345751+0000 mon.c (mon.1) 2872 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:07:15.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:07:15 gibba045 bash[25517]: cluster 2021-03-10T17:07:13.634540+0000 mgr.gibba045.orlgmj (mgr.34412) 10455 : cluster [DBG] pgmap v5961: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:15.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:07:15 gibba045 bash[25517]: audit 2021-03-10T17:07:14.135934+0000 mon.a (mon.0) 2244 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:07:15.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:07:15 gibba045 bash[25517]: cephadm 2021-03-10T17:07:14.138972+0000 mgr.gibba045.orlgmj (mgr.34412) 10456 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:07:15.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:07:15 gibba045 bash[25517]: audit 2021-03-10T17:07:14.331379+0000 mon.a (mon.0) 2245 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:07:15.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:07:15 gibba045 bash[25517]: audit 2021-03-10T17:07:14.335172+0000 mon.c (mon.1) 2867 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:07:15.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:07:15 gibba045 bash[25517]: audit 2021-03-10T17:07:14.337206+0000 mon.c (mon.1) 2868 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:07:15.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:07:15 gibba045 bash[25517]: audit 2021-03-10T17:07:14.339033+0000 mon.c (mon.1) 2869 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:07:15.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:07:15 gibba045 bash[25517]: audit 2021-03-10T17:07:14.340382+0000 mon.c (mon.1) 2870 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:07:15.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:07:15 gibba045 bash[25517]: audit 2021-03-10T17:07:14.344118+0000 mon.c (mon.1) 2871 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:07:15.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:07:15 gibba045 bash[25517]: audit 2021-03-10T17:07:14.345751+0000 mon.c (mon.1) 2872 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:07:16.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:07:16 gibba015 bash[29377]: cephadm 2021-03-10T17:07:14.336435+0000 mgr.gibba045.orlgmj (mgr.34412) 10457 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:07:16.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:07:16 gibba015 bash[29377]: cephadm 2021-03-10T17:07:14.338771+0000 mgr.gibba045.orlgmj (mgr.34412) 10458 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:07:16.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:07:16 gibba015 bash[29377]: cephadm 2021-03-10T17:07:14.340378+0000 mgr.gibba045.orlgmj (mgr.34412) 10459 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:07:16.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:07:16 gibba015 bash[29377]: cephadm 2021-03-10T17:07:14.340422+0000 mgr.gibba045.orlgmj (mgr.34412) 10460 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:07:16.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:07:16 gibba015 bash[29377]: cephadm 2021-03-10T17:07:14.342078+0000 mgr.gibba045.orlgmj (mgr.34412) 10461 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:07:16.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:07:16 gibba015 bash[29377]: cephadm 2021-03-10T17:07:14.342119+0000 mgr.gibba045.orlgmj (mgr.34412) 10462 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:07:16.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:07:16 gibba015 bash[29377]: cephadm 2021-03-10T17:07:14.343655+0000 mgr.gibba045.orlgmj (mgr.34412) 10463 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:07:16.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:07:16 gibba015 bash[29377]: cephadm 2021-03-10T17:07:14.345621+0000 mgr.gibba045.orlgmj (mgr.34412) 10464 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:07:16.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:07:16 gibba015 bash[29377]: cephadm 2021-03-10T17:07:14.345666+0000 mgr.gibba045.orlgmj (mgr.34412) 10465 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:07:16.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:07:16 gibba015 bash[29377]: cephadm 2021-03-10T17:07:14.347134+0000 mgr.gibba045.orlgmj (mgr.34412) 10466 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:07:16.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:07:16 gibba015 bash[29377]: cephadm 2021-03-10T17:07:14.347614+0000 mgr.gibba045.orlgmj (mgr.34412) 10467 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:07:16.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:07:16 gibba015 bash[29377]: cephadm 2021-03-10T17:07:14.349041+0000 mgr.gibba045.orlgmj (mgr.34412) 10468 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:07:16.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:07:16 gibba015 bash[29377]: cephadm 2021-03-10T17:07:14.349091+0000 mgr.gibba045.orlgmj (mgr.34412) 10469 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:07:16.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:07:16 gibba015 bash[29377]: cephadm 2021-03-10T17:07:14.349234+0000 mgr.gibba045.orlgmj (mgr.34412) 10470 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:07:16.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:07:16 gibba015 bash[30343]: cephadm 2021-03-10T17:07:14.336435+0000 mgr.gibba045.orlgmj (mgr.34412) 10457 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:07:16.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:07:16 gibba015 bash[30343]: cephadm 2021-03-10T17:07:14.338771+0000 mgr.gibba045.orlgmj (mgr.34412) 10458 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:07:16.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:07:16 gibba015 bash[30343]: cephadm 2021-03-10T17:07:14.340378+0000 mgr.gibba045.orlgmj (mgr.34412) 10459 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:07:16.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:07:16 gibba015 bash[30343]: cephadm 2021-03-10T17:07:14.340422+0000 mgr.gibba045.orlgmj (mgr.34412) 10460 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:07:16.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:07:16 gibba015 bash[30343]: cephadm 2021-03-10T17:07:14.342078+0000 mgr.gibba045.orlgmj (mgr.34412) 10461 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:07:16.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:07:16 gibba015 bash[30343]: cephadm 2021-03-10T17:07:14.342119+0000 mgr.gibba045.orlgmj (mgr.34412) 10462 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:07:16.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:07:16 gibba015 bash[30343]: cephadm 2021-03-10T17:07:14.343655+0000 mgr.gibba045.orlgmj (mgr.34412) 10463 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:07:16.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:07:16 gibba015 bash[30343]: cephadm 2021-03-10T17:07:14.345621+0000 mgr.gibba045.orlgmj (mgr.34412) 10464 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:07:16.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:07:16 gibba015 bash[30343]: cephadm 2021-03-10T17:07:14.345666+0000 mgr.gibba045.orlgmj (mgr.34412) 10465 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:07:16.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:07:16 gibba015 bash[30343]: cephadm 2021-03-10T17:07:14.347134+0000 mgr.gibba045.orlgmj (mgr.34412) 10466 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:07:16.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:07:16 gibba015 bash[30343]: cephadm 2021-03-10T17:07:14.347614+0000 mgr.gibba045.orlgmj (mgr.34412) 10467 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:07:16.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:07:16 gibba015 bash[30343]: cephadm 2021-03-10T17:07:14.349041+0000 mgr.gibba045.orlgmj (mgr.34412) 10468 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:07:16.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:07:16 gibba015 bash[30343]: cephadm 2021-03-10T17:07:14.349091+0000 mgr.gibba045.orlgmj (mgr.34412) 10469 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:07:16.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:07:16 gibba015 bash[30343]: cephadm 2021-03-10T17:07:14.349234+0000 mgr.gibba045.orlgmj (mgr.34412) 10470 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:07:16.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:07:16 gibba045 bash[25517]: cephadm 2021-03-10T17:07:14.336435+0000 mgr.gibba045.orlgmj (mgr.34412) 10457 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:07:16.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:07:16 gibba045 bash[25517]: cephadm 2021-03-10T17:07:14.338771+0000 mgr.gibba045.orlgmj (mgr.34412) 10458 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:07:16.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:07:16 gibba045 bash[25517]: cephadm 2021-03-10T17:07:14.340378+0000 mgr.gibba045.orlgmj (mgr.34412) 10459 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:07:16.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:07:16 gibba045 bash[25517]: cephadm 2021-03-10T17:07:14.340422+0000 mgr.gibba045.orlgmj (mgr.34412) 10460 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:07:16.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:07:16 gibba045 bash[25517]: cephadm 2021-03-10T17:07:14.342078+0000 mgr.gibba045.orlgmj (mgr.34412) 10461 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:07:16.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:07:16 gibba045 bash[25517]: cephadm 2021-03-10T17:07:14.342119+0000 mgr.gibba045.orlgmj (mgr.34412) 10462 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:07:16.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:07:16 gibba045 bash[25517]: cephadm 2021-03-10T17:07:14.343655+0000 mgr.gibba045.orlgmj (mgr.34412) 10463 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:07:16.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:07:16 gibba045 bash[25517]: cephadm 2021-03-10T17:07:14.345621+0000 mgr.gibba045.orlgmj (mgr.34412) 10464 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:07:16.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:07:16 gibba045 bash[25517]: cephadm 2021-03-10T17:07:14.345666+0000 mgr.gibba045.orlgmj (mgr.34412) 10465 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:07:16.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:07:16 gibba045 bash[25517]: cephadm 2021-03-10T17:07:14.347134+0000 mgr.gibba045.orlgmj (mgr.34412) 10466 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:07:16.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:07:16 gibba045 bash[25517]: cephadm 2021-03-10T17:07:14.347614+0000 mgr.gibba045.orlgmj (mgr.34412) 10467 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:07:16.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:07:16 gibba045 bash[25517]: cephadm 2021-03-10T17:07:14.349041+0000 mgr.gibba045.orlgmj (mgr.34412) 10468 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:07:16.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:07:16 gibba045 bash[25517]: cephadm 2021-03-10T17:07:14.349091+0000 mgr.gibba045.orlgmj (mgr.34412) 10469 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:07:16.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:07:16 gibba045 bash[25517]: cephadm 2021-03-10T17:07:14.349234+0000 mgr.gibba045.orlgmj (mgr.34412) 10470 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:07:17.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:07:17 gibba015 bash[29377]: cluster 2021-03-10T17:07:15.636267+0000 mgr.gibba045.orlgmj (mgr.34412) 10471 : cluster [DBG] pgmap v5962: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:17.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:07:17 gibba015 bash[30343]: cluster 2021-03-10T17:07:15.636267+0000 mgr.gibba045.orlgmj (mgr.34412) 10471 : cluster [DBG] pgmap v5962: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:17.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:07:17 gibba045 bash[25517]: cluster 2021-03-10T17:07:15.636267+0000 mgr.gibba045.orlgmj (mgr.34412) 10471 : cluster [DBG] pgmap v5962: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:19.589 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:07:19.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:07:19 gibba015 bash[29377]: cluster 2021-03-10T17:07:17.637762+0000 mgr.gibba045.orlgmj (mgr.34412) 10472 : cluster [DBG] pgmap v5963: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:19.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:07:19 gibba015 bash[30343]: cluster 2021-03-10T17:07:17.637762+0000 mgr.gibba045.orlgmj (mgr.34412) 10472 : cluster [DBG] pgmap v5963: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:19.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:07:19 gibba045 bash[25517]: cluster 2021-03-10T17:07:17.637762+0000 mgr.gibba045.orlgmj (mgr.34412) 10472 : cluster [DBG] pgmap v5963: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:19.827 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:07:19.827 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 5s ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:07:19.828 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 9m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:07:19.828 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:07:19.828 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:07:19.828 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 5s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:07:19.829 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 5s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:07:19.829 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:07:19.829 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 5s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:07:19.829 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 5s ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:07:19.830 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 9m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:07:19.830 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 5s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:07:19.830 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 5s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:07:19.830 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 5s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:07:19.830 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 5s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:07:19.831 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:07:19.831 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:07:19.831 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:07:19.832 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:07:19.832 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 9m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:07:19.832 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 9m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:07:20.077 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:07:20.077 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:07:20.077 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:07:20.078 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:07:20.078 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:07:20.078 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:07:20.078 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:07:20.079 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:07:20.079 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:07:20.079 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:07:20.079 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:07:20.079 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:07:20.080 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:07:20.080 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:07:20.080 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:07:20.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:07:20 gibba015 bash[29377]: audit 2021-03-10T17:07:20.076148+0000 mon.a (mon.0) 2246 : audit [DBG] from='client.? 172.21.2.115:0/3676035823' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:07:20.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:07:20 gibba015 bash[30343]: audit 2021-03-10T17:07:20.076148+0000 mon.a (mon.0) 2246 : audit [DBG] from='client.? 172.21.2.115:0/3676035823' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:07:20.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:07:20 gibba045 bash[25517]: audit 2021-03-10T17:07:20.076148+0000 mon.a (mon.0) 2246 : audit [DBG] from='client.? 172.21.2.115:0/3676035823' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:07:21.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:07:21 gibba015 bash[29377]: audit 2021-03-10T17:07:19.581610+0000 mgr.gibba045.orlgmj (mgr.34412) 10473 : audit [DBG] from='client.61060 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:07:21.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:07:21 gibba015 bash[29377]: cluster 2021-03-10T17:07:19.639104+0000 mgr.gibba045.orlgmj (mgr.34412) 10474 : cluster [DBG] pgmap v5964: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:21.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:07:21 gibba015 bash[29377]: audit 2021-03-10T17:07:19.816664+0000 mgr.gibba045.orlgmj (mgr.34412) 10475 : audit [DBG] from='client.51078 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:07:21.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:07:21 gibba015 bash[30343]: audit 2021-03-10T17:07:19.581610+0000 mgr.gibba045.orlgmj (mgr.34412) 10473 : audit [DBG] from='client.61060 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:07:21.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:07:21 gibba015 bash[30343]: cluster 2021-03-10T17:07:19.639104+0000 mgr.gibba045.orlgmj (mgr.34412) 10474 : cluster [DBG] pgmap v5964: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:21.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:07:21 gibba015 bash[30343]: audit 2021-03-10T17:07:19.816664+0000 mgr.gibba045.orlgmj (mgr.34412) 10475 : audit [DBG] from='client.51078 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:07:21.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:07:21 gibba045 bash[25517]: audit 2021-03-10T17:07:19.581610+0000 mgr.gibba045.orlgmj (mgr.34412) 10473 : audit [DBG] from='client.61060 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:07:21.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:07:21 gibba045 bash[25517]: cluster 2021-03-10T17:07:19.639104+0000 mgr.gibba045.orlgmj (mgr.34412) 10474 : cluster [DBG] pgmap v5964: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:21.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:07:21 gibba045 bash[25517]: audit 2021-03-10T17:07:19.816664+0000 mgr.gibba045.orlgmj (mgr.34412) 10475 : audit [DBG] from='client.51078 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:07:23.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:07:23 gibba015 bash[29377]: cluster 2021-03-10T17:07:21.641101+0000 mgr.gibba045.orlgmj (mgr.34412) 10476 : cluster [DBG] pgmap v5965: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:23.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:07:23 gibba015 bash[30343]: cluster 2021-03-10T17:07:21.641101+0000 mgr.gibba045.orlgmj (mgr.34412) 10476 : cluster [DBG] pgmap v5965: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:23.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:07:23 gibba045 bash[25517]: cluster 2021-03-10T17:07:21.641101+0000 mgr.gibba045.orlgmj (mgr.34412) 10476 : cluster [DBG] pgmap v5965: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:24.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:07:24 gibba015 bash[29377]: cluster 2021-03-10T17:07:23.642482+0000 mgr.gibba045.orlgmj (mgr.34412) 10477 : cluster [DBG] pgmap v5966: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:24.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:07:24 gibba015 bash[30343]: cluster 2021-03-10T17:07:23.642482+0000 mgr.gibba045.orlgmj (mgr.34412) 10477 : cluster [DBG] pgmap v5966: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:24.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:07:24 gibba045 bash[25517]: cluster 2021-03-10T17:07:23.642482+0000 mgr.gibba045.orlgmj (mgr.34412) 10477 : cluster [DBG] pgmap v5966: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:26.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:07:26 gibba015 bash[29377]: cluster 2021-03-10T17:07:25.644121+0000 mgr.gibba045.orlgmj (mgr.34412) 10478 : cluster [DBG] pgmap v5967: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:26.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:07:26 gibba015 bash[30343]: cluster 2021-03-10T17:07:25.644121+0000 mgr.gibba045.orlgmj (mgr.34412) 10478 : cluster [DBG] pgmap v5967: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:27.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:07:26 gibba045 bash[25517]: cluster 2021-03-10T17:07:25.644121+0000 mgr.gibba045.orlgmj (mgr.34412) 10478 : cluster [DBG] pgmap v5967: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:29.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:07:29 gibba045 bash[25517]: cluster 2021-03-10T17:07:27.645827+0000 mgr.gibba045.orlgmj (mgr.34412) 10479 : cluster [DBG] pgmap v5968: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:29.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:07:29 gibba015 bash[29377]: cluster 2021-03-10T17:07:27.645827+0000 mgr.gibba045.orlgmj (mgr.34412) 10479 : cluster [DBG] pgmap v5968: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:29.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:07:29 gibba015 bash[30343]: cluster 2021-03-10T17:07:27.645827+0000 mgr.gibba045.orlgmj (mgr.34412) 10479 : cluster [DBG] pgmap v5968: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:31.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:07:31 gibba015 bash[29377]: cephadm 2021-03-10T17:07:29.365276+0000 mgr.gibba045.orlgmj (mgr.34412) 10480 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:07:31.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:07:31 gibba015 bash[29377]: cluster 2021-03-10T17:07:29.646630+0000 mgr.gibba045.orlgmj (mgr.34412) 10481 : cluster [DBG] pgmap v5969: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:31.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:07:31 gibba015 bash[30343]: cephadm 2021-03-10T17:07:29.365276+0000 mgr.gibba045.orlgmj (mgr.34412) 10480 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:07:31.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:07:31 gibba015 bash[30343]: cluster 2021-03-10T17:07:29.646630+0000 mgr.gibba045.orlgmj (mgr.34412) 10481 : cluster [DBG] pgmap v5969: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:31.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:07:31 gibba045 bash[25517]: cephadm 2021-03-10T17:07:29.365276+0000 mgr.gibba045.orlgmj (mgr.34412) 10480 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:07:31.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:07:31 gibba045 bash[25517]: cluster 2021-03-10T17:07:29.646630+0000 mgr.gibba045.orlgmj (mgr.34412) 10481 : cluster [DBG] pgmap v5969: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:33.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:07:33 gibba015 bash[29377]: cluster 2021-03-10T17:07:31.648326+0000 mgr.gibba045.orlgmj (mgr.34412) 10482 : cluster [DBG] pgmap v5970: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:33.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:07:33 gibba015 bash[30343]: cluster 2021-03-10T17:07:31.648326+0000 mgr.gibba045.orlgmj (mgr.34412) 10482 : cluster [DBG] pgmap v5970: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:33.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:07:33 gibba045 bash[25517]: cluster 2021-03-10T17:07:31.648326+0000 mgr.gibba045.orlgmj (mgr.34412) 10482 : cluster [DBG] pgmap v5970: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:35.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:07:35 gibba015 bash[29377]: cluster 2021-03-10T17:07:33.649740+0000 mgr.gibba045.orlgmj (mgr.34412) 10483 : cluster [DBG] pgmap v5971: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:35.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:07:35 gibba015 bash[30343]: cluster 2021-03-10T17:07:33.649740+0000 mgr.gibba045.orlgmj (mgr.34412) 10483 : cluster [DBG] pgmap v5971: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:35.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:07:35 gibba045 bash[25517]: cluster 2021-03-10T17:07:33.649740+0000 mgr.gibba045.orlgmj (mgr.34412) 10483 : cluster [DBG] pgmap v5971: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:37.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:07:37 gibba015 bash[29377]: cluster 2021-03-10T17:07:35.651497+0000 mgr.gibba045.orlgmj (mgr.34412) 10484 : cluster [DBG] pgmap v5972: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:37.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:07:37 gibba015 bash[30343]: cluster 2021-03-10T17:07:35.651497+0000 mgr.gibba045.orlgmj (mgr.34412) 10484 : cluster [DBG] pgmap v5972: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:37.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:07:37 gibba045 bash[25517]: cluster 2021-03-10T17:07:35.651497+0000 mgr.gibba045.orlgmj (mgr.34412) 10484 : cluster [DBG] pgmap v5972: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:38.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:07:38 gibba015 bash[29377]: cluster 2021-03-10T17:07:37.653098+0000 mgr.gibba045.orlgmj (mgr.34412) 10485 : cluster [DBG] pgmap v5973: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:38.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:07:38 gibba015 bash[30343]: cluster 2021-03-10T17:07:37.653098+0000 mgr.gibba045.orlgmj (mgr.34412) 10485 : cluster [DBG] pgmap v5973: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:38.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:07:38 gibba045 bash[25517]: cluster 2021-03-10T17:07:37.653098+0000 mgr.gibba045.orlgmj (mgr.34412) 10485 : cluster [DBG] pgmap v5973: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:40.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:07:40 gibba015 bash[29377]: cluster 2021-03-10T17:07:39.653994+0000 mgr.gibba045.orlgmj (mgr.34412) 10486 : cluster [DBG] pgmap v5974: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:40.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:07:40 gibba015 bash[30343]: cluster 2021-03-10T17:07:39.653994+0000 mgr.gibba045.orlgmj (mgr.34412) 10486 : cluster [DBG] pgmap v5974: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:41.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:07:40 gibba045 bash[25517]: cluster 2021-03-10T17:07:39.653994+0000 mgr.gibba045.orlgmj (mgr.34412) 10486 : cluster [DBG] pgmap v5974: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:43.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:07:43 gibba015 bash[29377]: cluster 2021-03-10T17:07:41.655622+0000 mgr.gibba045.orlgmj (mgr.34412) 10487 : cluster [DBG] pgmap v5975: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:43.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:07:43 gibba015 bash[30343]: cluster 2021-03-10T17:07:41.655622+0000 mgr.gibba045.orlgmj (mgr.34412) 10487 : cluster [DBG] pgmap v5975: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:43.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:07:43 gibba045 bash[25517]: cluster 2021-03-10T17:07:41.655622+0000 mgr.gibba045.orlgmj (mgr.34412) 10487 : cluster [DBG] pgmap v5975: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:45.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:07:45 gibba015 bash[29377]: cluster 2021-03-10T17:07:43.656872+0000 mgr.gibba045.orlgmj (mgr.34412) 10488 : cluster [DBG] pgmap v5976: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:45.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:07:45 gibba015 bash[30343]: cluster 2021-03-10T17:07:43.656872+0000 mgr.gibba045.orlgmj (mgr.34412) 10488 : cluster [DBG] pgmap v5976: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:45.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:07:45 gibba045 bash[25517]: cluster 2021-03-10T17:07:43.656872+0000 mgr.gibba045.orlgmj (mgr.34412) 10488 : cluster [DBG] pgmap v5976: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:46.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:07:46 gibba015 bash[29377]: cephadm 2021-03-10T17:07:44.380888+0000 mgr.gibba045.orlgmj (mgr.34412) 10489 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:07:46.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:07:46 gibba015 bash[30343]: cephadm 2021-03-10T17:07:44.380888+0000 mgr.gibba045.orlgmj (mgr.34412) 10489 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:07:46.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:07:46 gibba045 bash[25517]: cephadm 2021-03-10T17:07:44.380888+0000 mgr.gibba045.orlgmj (mgr.34412) 10489 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:07:47.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:07:47 gibba015 bash[29377]: cluster 2021-03-10T17:07:45.658579+0000 mgr.gibba045.orlgmj (mgr.34412) 10490 : cluster [DBG] pgmap v5977: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:47.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:07:47 gibba015 bash[30343]: cluster 2021-03-10T17:07:45.658579+0000 mgr.gibba045.orlgmj (mgr.34412) 10490 : cluster [DBG] pgmap v5977: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:47.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:07:47 gibba045 bash[25517]: cluster 2021-03-10T17:07:45.658579+0000 mgr.gibba045.orlgmj (mgr.34412) 10490 : cluster [DBG] pgmap v5977: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:49.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:07:49 gibba015 bash[29377]: cluster 2021-03-10T17:07:47.660147+0000 mgr.gibba045.orlgmj (mgr.34412) 10491 : cluster [DBG] pgmap v5978: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:49.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:07:49 gibba015 bash[30343]: cluster 2021-03-10T17:07:47.660147+0000 mgr.gibba045.orlgmj (mgr.34412) 10491 : cluster [DBG] pgmap v5978: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:49.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:07:49 gibba045 bash[25517]: cluster 2021-03-10T17:07:47.660147+0000 mgr.gibba045.orlgmj (mgr.34412) 10491 : cluster [DBG] pgmap v5978: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:50.321 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:07:50.552 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:07:50.552 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 36s ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:07:50.553 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 9m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:07:50.553 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:07:50.553 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:07:50.553 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 36s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:07:50.553 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 36s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:07:50.554 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:07:50.554 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 36s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:07:50.554 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 36s ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:07:50.555 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 9m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:07:50.555 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 36s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:07:50.555 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 36s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:07:50.555 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 36s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:07:50.555 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 36s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:07:50.556 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:07:50.556 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:07:50.556 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:07:50.557 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:07:50.557 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 9m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:07:50.557 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 9m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:07:50.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:07:50 gibba015 bash[29377]: cluster 2021-03-10T17:07:49.661498+0000 mgr.gibba045.orlgmj (mgr.34412) 10492 : cluster [DBG] pgmap v5979: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:50.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:07:50 gibba015 bash[29377]: audit 2021-03-10T17:07:50.313442+0000 mgr.gibba045.orlgmj (mgr.34412) 10493 : audit [DBG] from='client.61078 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:07:50.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:07:50 gibba015 bash[30343]: cluster 2021-03-10T17:07:49.661498+0000 mgr.gibba045.orlgmj (mgr.34412) 10492 : cluster [DBG] pgmap v5979: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:50.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:07:50 gibba015 bash[30343]: audit 2021-03-10T17:07:50.313442+0000 mgr.gibba045.orlgmj (mgr.34412) 10493 : audit [DBG] from='client.61078 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:07:50.798 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:07:50.799 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:07:50.799 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:07:50.799 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:07:50.799 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:07:50.800 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:07:50.800 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:07:50.800 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:07:50.800 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:07:50.800 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:07:50.801 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:07:50.801 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:07:50.801 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:07:50.801 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:07:50.802 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:07:50.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:07:50 gibba045 bash[25517]: cluster 2021-03-10T17:07:49.661498+0000 mgr.gibba045.orlgmj (mgr.34412) 10492 : cluster [DBG] pgmap v5979: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:50.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:07:50 gibba045 bash[25517]: audit 2021-03-10T17:07:50.313442+0000 mgr.gibba045.orlgmj (mgr.34412) 10493 : audit [DBG] from='client.61078 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:07:51.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:07:51 gibba015 bash[29377]: audit 2021-03-10T17:07:50.540946+0000 mgr.gibba045.orlgmj (mgr.34412) 10494 : audit [DBG] from='client.61084 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:07:51.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:07:51 gibba015 bash[29377]: audit 2021-03-10T17:07:50.797599+0000 mon.a (mon.0) 2247 : audit [DBG] from='client.? 172.21.2.115:0/752191719' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:07:51.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:07:51 gibba015 bash[30343]: audit 2021-03-10T17:07:50.540946+0000 mgr.gibba045.orlgmj (mgr.34412) 10494 : audit [DBG] from='client.61084 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:07:51.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:07:51 gibba015 bash[30343]: audit 2021-03-10T17:07:50.797599+0000 mon.a (mon.0) 2247 : audit [DBG] from='client.? 172.21.2.115:0/752191719' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:07:51.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:07:51 gibba045 bash[25517]: audit 2021-03-10T17:07:50.540946+0000 mgr.gibba045.orlgmj (mgr.34412) 10494 : audit [DBG] from='client.61084 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:07:51.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:07:51 gibba045 bash[25517]: audit 2021-03-10T17:07:50.797599+0000 mon.a (mon.0) 2247 : audit [DBG] from='client.? 172.21.2.115:0/752191719' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:07:53.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:07:53 gibba015 bash[29377]: cluster 2021-03-10T17:07:51.663240+0000 mgr.gibba045.orlgmj (mgr.34412) 10495 : cluster [DBG] pgmap v5980: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:53.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:07:53 gibba015 bash[30343]: cluster 2021-03-10T17:07:51.663240+0000 mgr.gibba045.orlgmj (mgr.34412) 10495 : cluster [DBG] pgmap v5980: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:53.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:07:53 gibba045 bash[25517]: cluster 2021-03-10T17:07:51.663240+0000 mgr.gibba045.orlgmj (mgr.34412) 10495 : cluster [DBG] pgmap v5980: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:07:54 gibba015 bash[29377]: audit 2021-03-10T17:07:53.869970+0000 mon.c (mon.1) 2873 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:07:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:07:54 gibba015 bash[29377]: audit 2021-03-10T17:07:53.871078+0000 mon.a (mon.0) 2248 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:07:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:07:54 gibba015 bash[29377]: audit 2021-03-10T17:07:53.871890+0000 mon.c (mon.1) 2874 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:07:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:07:54 gibba015 bash[29377]: audit 2021-03-10T17:07:53.872891+0000 mon.a (mon.0) 2249 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:07:54.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:07:54 gibba015 bash[29377]: audit 2021-03-10T17:07:53.944730+0000 mon.c (mon.1) 2875 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T17:07:54.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:07:54 gibba015 bash[29377]: audit 2021-03-10T17:07:53.945539+0000 mon.c (mon.1) 2876 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:07:54.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:07:54 gibba015 bash[29377]: audit 2021-03-10T17:07:53.946005+0000 mon.a (mon.0) 2250 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T17:07:54.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:07:54 gibba015 bash[29377]: audit 2021-03-10T17:07:53.946209+0000 mon.c (mon.1) 2877 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T17:07:54.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:07:54 gibba015 bash[29377]: audit 2021-03-10T17:07:53.947052+0000 mon.c (mon.1) 2878 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:07:54.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:07:54 gibba015 bash[29377]: audit 2021-03-10T17:07:53.947200+0000 mon.a (mon.0) 2251 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:07:54.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:07:54 gibba015 bash[29377]: audit 2021-03-10T17:07:53.948372+0000 mon.a (mon.0) 2252 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T17:07:54.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:07:54 gibba015 bash[29377]: audit 2021-03-10T17:07:53.949277+0000 mon.a (mon.0) 2253 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:07:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:07:54 gibba015 bash[30343]: audit 2021-03-10T17:07:53.869970+0000 mon.c (mon.1) 2873 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:07:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:07:54 gibba015 bash[30343]: audit 2021-03-10T17:07:53.871078+0000 mon.a (mon.0) 2248 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:07:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:07:54 gibba015 bash[30343]: audit 2021-03-10T17:07:53.871890+0000 mon.c (mon.1) 2874 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:07:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:07:54 gibba015 bash[30343]: audit 2021-03-10T17:07:53.872891+0000 mon.a (mon.0) 2249 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:07:54.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:07:54 gibba015 bash[30343]: audit 2021-03-10T17:07:53.944730+0000 mon.c (mon.1) 2875 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T17:07:54.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:07:54 gibba015 bash[30343]: audit 2021-03-10T17:07:53.945539+0000 mon.c (mon.1) 2876 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:07:54.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:07:54 gibba015 bash[30343]: audit 2021-03-10T17:07:53.946005+0000 mon.a (mon.0) 2250 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T17:07:54.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:07:54 gibba015 bash[30343]: audit 2021-03-10T17:07:53.946209+0000 mon.c (mon.1) 2877 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T17:07:54.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:07:54 gibba015 bash[30343]: audit 2021-03-10T17:07:53.947052+0000 mon.c (mon.1) 2878 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:07:54.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:07:54 gibba015 bash[30343]: audit 2021-03-10T17:07:53.947200+0000 mon.a (mon.0) 2251 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:07:54.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:07:54 gibba015 bash[30343]: audit 2021-03-10T17:07:53.948372+0000 mon.a (mon.0) 2252 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T17:07:54.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:07:54 gibba015 bash[30343]: audit 2021-03-10T17:07:53.949277+0000 mon.a (mon.0) 2253 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:07:54.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:07:54 gibba045 bash[25517]: audit 2021-03-10T17:07:53.869970+0000 mon.c (mon.1) 2873 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:07:54.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:07:54 gibba045 bash[25517]: audit 2021-03-10T17:07:53.871078+0000 mon.a (mon.0) 2248 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:07:54.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:07:54 gibba045 bash[25517]: audit 2021-03-10T17:07:53.871890+0000 mon.c (mon.1) 2874 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:07:54.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:07:54 gibba045 bash[25517]: audit 2021-03-10T17:07:53.872891+0000 mon.a (mon.0) 2249 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:07:54.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:07:54 gibba045 bash[25517]: audit 2021-03-10T17:07:53.944730+0000 mon.c (mon.1) 2875 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T17:07:54.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:07:54 gibba045 bash[25517]: audit 2021-03-10T17:07:53.945539+0000 mon.c (mon.1) 2876 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:07:54.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:07:54 gibba045 bash[25517]: audit 2021-03-10T17:07:53.946005+0000 mon.a (mon.0) 2250 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T17:07:54.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:07:54 gibba045 bash[25517]: audit 2021-03-10T17:07:53.946209+0000 mon.c (mon.1) 2877 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T17:07:54.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:07:54 gibba045 bash[25517]: audit 2021-03-10T17:07:53.947052+0000 mon.c (mon.1) 2878 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:07:54.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:07:54 gibba045 bash[25517]: audit 2021-03-10T17:07:53.947200+0000 mon.a (mon.0) 2251 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:07:54.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:07:54 gibba045 bash[25517]: audit 2021-03-10T17:07:53.948372+0000 mon.a (mon.0) 2252 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T17:07:54.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:07:54 gibba045 bash[25517]: audit 2021-03-10T17:07:53.949277+0000 mon.a (mon.0) 2253 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:07:55.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:07:55 gibba015 bash[29377]: cluster 2021-03-10T17:07:53.664294+0000 mgr.gibba045.orlgmj (mgr.34412) 10496 : cluster [DBG] pgmap v5981: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:55.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:07:55 gibba015 bash[30343]: cluster 2021-03-10T17:07:53.664294+0000 mgr.gibba045.orlgmj (mgr.34412) 10496 : cluster [DBG] pgmap v5981: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:55.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:07:55 gibba045 bash[25517]: cluster 2021-03-10T17:07:53.664294+0000 mgr.gibba045.orlgmj (mgr.34412) 10496 : cluster [DBG] pgmap v5981: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:57.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:07:57 gibba015 bash[29377]: cluster 2021-03-10T17:07:55.666096+0000 mgr.gibba045.orlgmj (mgr.34412) 10497 : cluster [DBG] pgmap v5982: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:57.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:07:57 gibba015 bash[30343]: cluster 2021-03-10T17:07:55.666096+0000 mgr.gibba045.orlgmj (mgr.34412) 10497 : cluster [DBG] pgmap v5982: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:57.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:07:57 gibba045 bash[25517]: cluster 2021-03-10T17:07:55.666096+0000 mgr.gibba045.orlgmj (mgr.34412) 10497 : cluster [DBG] pgmap v5982: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:59.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:07:59 gibba015 bash[29377]: cluster 2021-03-10T17:07:57.667647+0000 mgr.gibba045.orlgmj (mgr.34412) 10498 : cluster [DBG] pgmap v5983: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:59.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:07:59 gibba015 bash[30343]: cluster 2021-03-10T17:07:57.667647+0000 mgr.gibba045.orlgmj (mgr.34412) 10498 : cluster [DBG] pgmap v5983: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:59.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:07:59 gibba045 bash[25517]: cluster 2021-03-10T17:07:57.667647+0000 mgr.gibba045.orlgmj (mgr.34412) 10498 : cluster [DBG] pgmap v5983: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:00.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:08:00 gibba015 bash[29377]: cephadm 2021-03-10T17:07:59.393167+0000 mgr.gibba045.orlgmj (mgr.34412) 10499 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:08:00.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:08:00 gibba015 bash[29377]: cluster 2021-03-10T17:07:59.669285+0000 mgr.gibba045.orlgmj (mgr.34412) 10500 : cluster [DBG] pgmap v5984: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:00.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:08:00 gibba015 bash[30343]: cephadm 2021-03-10T17:07:59.393167+0000 mgr.gibba045.orlgmj (mgr.34412) 10499 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:08:00.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:08:00 gibba015 bash[30343]: cluster 2021-03-10T17:07:59.669285+0000 mgr.gibba045.orlgmj (mgr.34412) 10500 : cluster [DBG] pgmap v5984: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:00.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:08:00 gibba045 bash[25517]: cephadm 2021-03-10T17:07:59.393167+0000 mgr.gibba045.orlgmj (mgr.34412) 10499 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:08:00.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:08:00 gibba045 bash[25517]: cluster 2021-03-10T17:07:59.669285+0000 mgr.gibba045.orlgmj (mgr.34412) 10500 : cluster [DBG] pgmap v5984: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:03.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:08:03 gibba015 bash[29377]: cluster 2021-03-10T17:08:01.671115+0000 mgr.gibba045.orlgmj (mgr.34412) 10501 : cluster [DBG] pgmap v5985: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:03.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:08:03 gibba015 bash[30343]: cluster 2021-03-10T17:08:01.671115+0000 mgr.gibba045.orlgmj (mgr.34412) 10501 : cluster [DBG] pgmap v5985: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:03.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:08:03 gibba045 bash[25517]: cluster 2021-03-10T17:08:01.671115+0000 mgr.gibba045.orlgmj (mgr.34412) 10501 : cluster [DBG] pgmap v5985: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:05.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:08:05 gibba015 bash[29377]: cluster 2021-03-10T17:08:03.672460+0000 mgr.gibba045.orlgmj (mgr.34412) 10502 : cluster [DBG] pgmap v5986: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:05.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:08:05 gibba015 bash[30343]: cluster 2021-03-10T17:08:03.672460+0000 mgr.gibba045.orlgmj (mgr.34412) 10502 : cluster [DBG] pgmap v5986: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:05.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:08:05 gibba045 bash[25517]: cluster 2021-03-10T17:08:03.672460+0000 mgr.gibba045.orlgmj (mgr.34412) 10502 : cluster [DBG] pgmap v5986: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:07.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:08:07 gibba015 bash[29377]: cluster 2021-03-10T17:08:05.674116+0000 mgr.gibba045.orlgmj (mgr.34412) 10503 : cluster [DBG] pgmap v5987: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:07.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:08:07 gibba015 bash[30343]: cluster 2021-03-10T17:08:05.674116+0000 mgr.gibba045.orlgmj (mgr.34412) 10503 : cluster [DBG] pgmap v5987: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:07.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:08:07 gibba045 bash[25517]: cluster 2021-03-10T17:08:05.674116+0000 mgr.gibba045.orlgmj (mgr.34412) 10503 : cluster [DBG] pgmap v5987: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:09.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:08:09 gibba015 bash[29377]: cluster 2021-03-10T17:08:07.675779+0000 mgr.gibba045.orlgmj (mgr.34412) 10504 : cluster [DBG] pgmap v5988: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:09.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:08:09 gibba015 bash[30343]: cluster 2021-03-10T17:08:07.675779+0000 mgr.gibba045.orlgmj (mgr.34412) 10504 : cluster [DBG] pgmap v5988: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:09.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:08:09 gibba045 bash[25517]: cluster 2021-03-10T17:08:07.675779+0000 mgr.gibba045.orlgmj (mgr.34412) 10504 : cluster [DBG] pgmap v5988: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:11.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:08:11 gibba015 bash[29377]: cluster 2021-03-10T17:08:09.676682+0000 mgr.gibba045.orlgmj (mgr.34412) 10505 : cluster [DBG] pgmap v5989: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:11.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:08:11 gibba015 bash[30343]: cluster 2021-03-10T17:08:09.676682+0000 mgr.gibba045.orlgmj (mgr.34412) 10505 : cluster [DBG] pgmap v5989: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:11.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:08:11 gibba045 bash[25517]: cluster 2021-03-10T17:08:09.676682+0000 mgr.gibba045.orlgmj (mgr.34412) 10505 : cluster [DBG] pgmap v5989: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:13.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:08:13 gibba015 bash[29377]: cluster 2021-03-10T17:08:11.678188+0000 mgr.gibba045.orlgmj (mgr.34412) 10506 : cluster [DBG] pgmap v5990: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:13.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:08:13 gibba015 bash[30343]: cluster 2021-03-10T17:08:11.678188+0000 mgr.gibba045.orlgmj (mgr.34412) 10506 : cluster [DBG] pgmap v5990: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:13.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:08:13 gibba045 bash[25517]: cluster 2021-03-10T17:08:11.678188+0000 mgr.gibba045.orlgmj (mgr.34412) 10506 : cluster [DBG] pgmap v5990: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:15.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:08:15 gibba015 bash[29377]: cluster 2021-03-10T17:08:13.679408+0000 mgr.gibba045.orlgmj (mgr.34412) 10507 : cluster [DBG] pgmap v5991: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:15.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:08:15 gibba015 bash[29377]: audit 2021-03-10T17:08:14.407548+0000 mon.c (mon.1) 2879 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:08:15.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:08:15 gibba015 bash[29377]: audit 2021-03-10T17:08:14.412426+0000 mon.c (mon.1) 2880 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:08:15.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:08:15 gibba015 bash[30343]: cluster 2021-03-10T17:08:13.679408+0000 mgr.gibba045.orlgmj (mgr.34412) 10507 : cluster [DBG] pgmap v5991: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:15.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:08:15 gibba015 bash[30343]: audit 2021-03-10T17:08:14.407548+0000 mon.c (mon.1) 2879 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:08:15.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:08:15 gibba015 bash[30343]: audit 2021-03-10T17:08:14.412426+0000 mon.c (mon.1) 2880 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:08:15.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:08:15 gibba045 bash[25517]: cluster 2021-03-10T17:08:13.679408+0000 mgr.gibba045.orlgmj (mgr.34412) 10507 : cluster [DBG] pgmap v5991: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:15.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:08:15 gibba045 bash[25517]: audit 2021-03-10T17:08:14.407548+0000 mon.c (mon.1) 2879 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:08:15.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:08:15 gibba045 bash[25517]: audit 2021-03-10T17:08:14.412426+0000 mon.c (mon.1) 2880 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:08:16.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:08:16 gibba015 bash[29377]: cephadm 2021-03-10T17:08:14.413406+0000 mgr.gibba045.orlgmj (mgr.34412) 10508 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:08:16.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:08:16 gibba015 bash[30343]: cephadm 2021-03-10T17:08:14.413406+0000 mgr.gibba045.orlgmj (mgr.34412) 10508 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:08:16.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:08:16 gibba045 bash[25517]: cephadm 2021-03-10T17:08:14.413406+0000 mgr.gibba045.orlgmj (mgr.34412) 10508 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:08:17.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:08:17 gibba015 bash[29377]: cluster 2021-03-10T17:08:15.681398+0000 mgr.gibba045.orlgmj (mgr.34412) 10509 : cluster [DBG] pgmap v5992: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:17.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:08:17 gibba015 bash[30343]: cluster 2021-03-10T17:08:15.681398+0000 mgr.gibba045.orlgmj (mgr.34412) 10509 : cluster [DBG] pgmap v5992: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:17.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:08:17 gibba045 bash[25517]: cluster 2021-03-10T17:08:15.681398+0000 mgr.gibba045.orlgmj (mgr.34412) 10509 : cluster [DBG] pgmap v5992: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:19.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:08:19 gibba015 bash[29377]: cluster 2021-03-10T17:08:17.682062+0000 mgr.gibba045.orlgmj (mgr.34412) 10510 : cluster [DBG] pgmap v5993: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:19.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:08:19 gibba015 bash[29377]: audit 2021-03-10T17:08:18.146545+0000 mon.a (mon.0) 2254 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:08:19.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:08:19 gibba015 bash[29377]: cephadm 2021-03-10T17:08:18.149889+0000 mgr.gibba045.orlgmj (mgr.34412) 10511 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:08:19.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:08:19 gibba015 bash[29377]: audit 2021-03-10T17:08:18.360132+0000 mon.a (mon.0) 2255 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:08:19.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:08:19 gibba015 bash[29377]: audit 2021-03-10T17:08:18.363851+0000 mon.c (mon.1) 2881 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:08:19.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:08:19 gibba015 bash[29377]: audit 2021-03-10T17:08:18.365198+0000 mon.c (mon.1) 2882 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:08:19.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:08:19 gibba015 bash[29377]: audit 2021-03-10T17:08:18.366473+0000 mon.c (mon.1) 2883 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:08:19.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:08:19 gibba015 bash[29377]: audit 2021-03-10T17:08:18.367820+0000 mon.c (mon.1) 2884 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:08:19.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:08:19 gibba015 bash[29377]: audit 2021-03-10T17:08:18.370672+0000 mon.c (mon.1) 2885 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:08:19.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:08:19 gibba015 bash[29377]: audit 2021-03-10T17:08:18.372013+0000 mon.c (mon.1) 2886 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:08:19.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:08:19 gibba015 bash[30343]: cluster 2021-03-10T17:08:17.682062+0000 mgr.gibba045.orlgmj (mgr.34412) 10510 : cluster [DBG] pgmap v5993: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:19.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:08:19 gibba015 bash[30343]: audit 2021-03-10T17:08:18.146545+0000 mon.a (mon.0) 2254 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:08:19.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:08:19 gibba015 bash[30343]: cephadm 2021-03-10T17:08:18.149889+0000 mgr.gibba045.orlgmj (mgr.34412) 10511 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:08:19.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:08:19 gibba015 bash[30343]: audit 2021-03-10T17:08:18.360132+0000 mon.a (mon.0) 2255 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:08:19.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:08:19 gibba015 bash[30343]: audit 2021-03-10T17:08:18.363851+0000 mon.c (mon.1) 2881 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:08:19.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:08:19 gibba015 bash[30343]: audit 2021-03-10T17:08:18.365198+0000 mon.c (mon.1) 2882 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:08:19.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:08:19 gibba015 bash[30343]: audit 2021-03-10T17:08:18.366473+0000 mon.c (mon.1) 2883 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:08:19.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:08:19 gibba015 bash[30343]: audit 2021-03-10T17:08:18.367820+0000 mon.c (mon.1) 2884 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:08:19.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:08:19 gibba015 bash[30343]: audit 2021-03-10T17:08:18.370672+0000 mon.c (mon.1) 2885 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:08:19.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:08:19 gibba015 bash[30343]: audit 2021-03-10T17:08:18.372013+0000 mon.c (mon.1) 2886 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:08:19.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:08:19 gibba045 bash[25517]: cluster 2021-03-10T17:08:17.682062+0000 mgr.gibba045.orlgmj (mgr.34412) 10510 : cluster [DBG] pgmap v5993: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:19.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:08:19 gibba045 bash[25517]: audit 2021-03-10T17:08:18.146545+0000 mon.a (mon.0) 2254 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:08:19.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:08:19 gibba045 bash[25517]: cephadm 2021-03-10T17:08:18.149889+0000 mgr.gibba045.orlgmj (mgr.34412) 10511 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:08:19.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:08:19 gibba045 bash[25517]: audit 2021-03-10T17:08:18.360132+0000 mon.a (mon.0) 2255 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:08:19.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:08:19 gibba045 bash[25517]: audit 2021-03-10T17:08:18.363851+0000 mon.c (mon.1) 2881 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:08:19.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:08:19 gibba045 bash[25517]: audit 2021-03-10T17:08:18.365198+0000 mon.c (mon.1) 2882 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:08:19.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:08:19 gibba045 bash[25517]: audit 2021-03-10T17:08:18.366473+0000 mon.c (mon.1) 2883 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:08:19.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:08:19 gibba045 bash[25517]: audit 2021-03-10T17:08:18.367820+0000 mon.c (mon.1) 2884 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:08:19.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:08:19 gibba045 bash[25517]: audit 2021-03-10T17:08:18.370672+0000 mon.c (mon.1) 2885 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:08:19.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:08:19 gibba045 bash[25517]: audit 2021-03-10T17:08:18.372013+0000 mon.c (mon.1) 2886 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:08:20.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:08:20 gibba015 bash[29377]: cephadm 2021-03-10T17:08:18.365133+0000 mgr.gibba045.orlgmj (mgr.34412) 10512 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:08:20.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:08:20 gibba015 bash[29377]: cephadm 2021-03-10T17:08:18.366882+0000 mgr.gibba045.orlgmj (mgr.34412) 10513 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:08:20.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:08:20 gibba015 bash[29377]: cephadm 2021-03-10T17:08:18.368099+0000 mgr.gibba045.orlgmj (mgr.34412) 10514 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:08:20.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:08:20 gibba015 bash[29377]: cephadm 2021-03-10T17:08:18.368138+0000 mgr.gibba045.orlgmj (mgr.34412) 10515 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:08:20.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:08:20 gibba015 bash[29377]: cephadm 2021-03-10T17:08:18.369523+0000 mgr.gibba045.orlgmj (mgr.34412) 10516 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:08:20.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:08:20 gibba015 bash[29377]: cephadm 2021-03-10T17:08:18.369560+0000 mgr.gibba045.orlgmj (mgr.34412) 10517 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:08:20.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:08:20 gibba015 bash[29377]: cephadm 2021-03-10T17:08:18.370695+0000 mgr.gibba045.orlgmj (mgr.34412) 10518 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:08:20.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:08:20 gibba015 bash[29377]: cephadm 2021-03-10T17:08:18.372233+0000 mgr.gibba045.orlgmj (mgr.34412) 10519 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:08:20.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:08:20 gibba015 bash[29377]: cephadm 2021-03-10T17:08:18.372269+0000 mgr.gibba045.orlgmj (mgr.34412) 10520 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:08:20.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:08:20 gibba015 bash[29377]: cephadm 2021-03-10T17:08:18.373475+0000 mgr.gibba045.orlgmj (mgr.34412) 10521 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:08:20.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:08:20 gibba015 bash[29377]: cephadm 2021-03-10T17:08:18.373793+0000 mgr.gibba045.orlgmj (mgr.34412) 10522 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:08:20.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:08:20 gibba015 bash[29377]: cephadm 2021-03-10T17:08:18.374806+0000 mgr.gibba045.orlgmj (mgr.34412) 10523 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:08:20.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:08:20 gibba015 bash[29377]: cephadm 2021-03-10T17:08:18.374845+0000 mgr.gibba045.orlgmj (mgr.34412) 10524 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:08:20.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:08:20 gibba015 bash[29377]: cephadm 2021-03-10T17:08:18.374950+0000 mgr.gibba045.orlgmj (mgr.34412) 10525 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:08:20.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:08:20 gibba015 bash[30343]: cephadm 2021-03-10T17:08:18.365133+0000 mgr.gibba045.orlgmj (mgr.34412) 10512 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:08:20.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:08:20 gibba015 bash[30343]: cephadm 2021-03-10T17:08:18.366882+0000 mgr.gibba045.orlgmj (mgr.34412) 10513 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:08:20.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:08:20 gibba015 bash[30343]: cephadm 2021-03-10T17:08:18.368099+0000 mgr.gibba045.orlgmj (mgr.34412) 10514 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:08:20.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:08:20 gibba015 bash[30343]: cephadm 2021-03-10T17:08:18.368138+0000 mgr.gibba045.orlgmj (mgr.34412) 10515 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:08:20.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:08:20 gibba015 bash[30343]: cephadm 2021-03-10T17:08:18.369523+0000 mgr.gibba045.orlgmj (mgr.34412) 10516 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:08:20.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:08:20 gibba015 bash[30343]: cephadm 2021-03-10T17:08:18.369560+0000 mgr.gibba045.orlgmj (mgr.34412) 10517 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:08:20.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:08:20 gibba015 bash[30343]: cephadm 2021-03-10T17:08:18.370695+0000 mgr.gibba045.orlgmj (mgr.34412) 10518 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:08:20.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:08:20 gibba015 bash[30343]: cephadm 2021-03-10T17:08:18.372233+0000 mgr.gibba045.orlgmj (mgr.34412) 10519 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:08:20.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:08:20 gibba015 bash[30343]: cephadm 2021-03-10T17:08:18.372269+0000 mgr.gibba045.orlgmj (mgr.34412) 10520 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:08:20.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:08:20 gibba015 bash[30343]: cephadm 2021-03-10T17:08:18.373475+0000 mgr.gibba045.orlgmj (mgr.34412) 10521 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:08:20.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:08:20 gibba015 bash[30343]: cephadm 2021-03-10T17:08:18.373793+0000 mgr.gibba045.orlgmj (mgr.34412) 10522 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:08:20.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:08:20 gibba015 bash[30343]: cephadm 2021-03-10T17:08:18.374806+0000 mgr.gibba045.orlgmj (mgr.34412) 10523 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:08:20.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:08:20 gibba015 bash[30343]: cephadm 2021-03-10T17:08:18.374845+0000 mgr.gibba045.orlgmj (mgr.34412) 10524 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:08:20.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:08:20 gibba015 bash[30343]: cephadm 2021-03-10T17:08:18.374950+0000 mgr.gibba045.orlgmj (mgr.34412) 10525 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:08:20.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:08:20 gibba045 bash[25517]: cephadm 2021-03-10T17:08:18.365133+0000 mgr.gibba045.orlgmj (mgr.34412) 10512 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:08:20.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:08:20 gibba045 bash[25517]: cephadm 2021-03-10T17:08:18.366882+0000 mgr.gibba045.orlgmj (mgr.34412) 10513 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:08:20.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:08:20 gibba045 bash[25517]: cephadm 2021-03-10T17:08:18.368099+0000 mgr.gibba045.orlgmj (mgr.34412) 10514 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:08:20.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:08:20 gibba045 bash[25517]: cephadm 2021-03-10T17:08:18.368138+0000 mgr.gibba045.orlgmj (mgr.34412) 10515 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:08:20.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:08:20 gibba045 bash[25517]: cephadm 2021-03-10T17:08:18.369523+0000 mgr.gibba045.orlgmj (mgr.34412) 10516 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:08:20.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:08:20 gibba045 bash[25517]: cephadm 2021-03-10T17:08:18.369560+0000 mgr.gibba045.orlgmj (mgr.34412) 10517 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:08:20.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:08:20 gibba045 bash[25517]: cephadm 2021-03-10T17:08:18.370695+0000 mgr.gibba045.orlgmj (mgr.34412) 10518 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:08:20.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:08:20 gibba045 bash[25517]: cephadm 2021-03-10T17:08:18.372233+0000 mgr.gibba045.orlgmj (mgr.34412) 10519 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:08:20.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:08:20 gibba045 bash[25517]: cephadm 2021-03-10T17:08:18.372269+0000 mgr.gibba045.orlgmj (mgr.34412) 10520 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:08:20.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:08:20 gibba045 bash[25517]: cephadm 2021-03-10T17:08:18.373475+0000 mgr.gibba045.orlgmj (mgr.34412) 10521 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:08:20.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:08:20 gibba045 bash[25517]: cephadm 2021-03-10T17:08:18.373793+0000 mgr.gibba045.orlgmj (mgr.34412) 10522 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:08:20.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:08:20 gibba045 bash[25517]: cephadm 2021-03-10T17:08:18.374806+0000 mgr.gibba045.orlgmj (mgr.34412) 10523 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:08:20.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:08:20 gibba045 bash[25517]: cephadm 2021-03-10T17:08:18.374845+0000 mgr.gibba045.orlgmj (mgr.34412) 10524 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:08:20.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:08:20 gibba045 bash[25517]: cephadm 2021-03-10T17:08:18.374950+0000 mgr.gibba045.orlgmj (mgr.34412) 10525 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:08:21.040 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:08:21.295 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:08:21.295 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 67s ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:08:21.295 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 3s ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:08:21.296 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 3s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:08:21.296 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 3s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:08:21.296 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 67s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:08:21.296 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 67s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:08:21.296 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 3s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:08:21.297 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 67s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:08:21.297 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 67s ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:08:21.297 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 3s ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:08:21.297 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 67s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:08:21.298 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 67s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:08:21.298 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 67s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:08:21.298 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 67s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:08:21.298 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 3s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:08:21.298 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 3s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:08:21.299 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 3s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:08:21.299 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 3s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:08:21.299 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 3s ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:08:21.299 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 3s ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:08:21.470 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:08:21 gibba015 bash[29377]: cluster 2021-03-10T17:08:19.683014+0000 mgr.gibba045.orlgmj (mgr.34412) 10526 : cluster [DBG] pgmap v5994: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:21.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:08:21 gibba015 bash[30343]: cluster 2021-03-10T17:08:19.683014+0000 mgr.gibba045.orlgmj (mgr.34412) 10526 : cluster [DBG] pgmap v5994: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:21.551 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:08:21.551 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:08:21.551 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:08:21.551 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:08:21.552 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:08:21.552 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:08:21.552 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:08:21.552 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:08:21.553 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:08:21.553 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:08:21.553 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:08:21.553 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:08:21.554 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:08:21.554 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:08:21.554 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:08:21.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:08:21 gibba045 bash[25517]: cluster 2021-03-10T17:08:19.683014+0000 mgr.gibba045.orlgmj (mgr.34412) 10526 : cluster [DBG] pgmap v5994: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:22.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:08:22 gibba015 bash[29377]: audit 2021-03-10T17:08:21.032162+0000 mgr.gibba045.orlgmj (mgr.34412) 10527 : audit [DBG] from='client.51108 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:08:22.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:08:22 gibba015 bash[29377]: audit 2021-03-10T17:08:21.256271+0000 mgr.gibba045.orlgmj (mgr.34412) 10528 : audit [DBG] from='client.51114 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:08:22.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:08:22 gibba015 bash[29377]: audit 2021-03-10T17:08:21.549946+0000 mon.a (mon.0) 2256 : audit [DBG] from='client.? 172.21.2.115:0/4098071987' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:08:22.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:08:22 gibba015 bash[30343]: audit 2021-03-10T17:08:21.032162+0000 mgr.gibba045.orlgmj (mgr.34412) 10527 : audit [DBG] from='client.51108 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:08:22.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:08:22 gibba015 bash[30343]: audit 2021-03-10T17:08:21.256271+0000 mgr.gibba045.orlgmj (mgr.34412) 10528 : audit [DBG] from='client.51114 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:08:22.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:08:22 gibba015 bash[30343]: audit 2021-03-10T17:08:21.549946+0000 mon.a (mon.0) 2256 : audit [DBG] from='client.? 172.21.2.115:0/4098071987' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:08:22.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:08:22 gibba045 bash[25517]: audit 2021-03-10T17:08:21.032162+0000 mgr.gibba045.orlgmj (mgr.34412) 10527 : audit [DBG] from='client.51108 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:08:22.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:08:22 gibba045 bash[25517]: audit 2021-03-10T17:08:21.256271+0000 mgr.gibba045.orlgmj (mgr.34412) 10528 : audit [DBG] from='client.51114 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:08:22.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:08:22 gibba045 bash[25517]: audit 2021-03-10T17:08:21.549946+0000 mon.a (mon.0) 2256 : audit [DBG] from='client.? 172.21.2.115:0/4098071987' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:08:23.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:08:23 gibba015 bash[29377]: cluster 2021-03-10T17:08:21.684760+0000 mgr.gibba045.orlgmj (mgr.34412) 10529 : cluster [DBG] pgmap v5995: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:23.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:08:23 gibba015 bash[30343]: cluster 2021-03-10T17:08:21.684760+0000 mgr.gibba045.orlgmj (mgr.34412) 10529 : cluster [DBG] pgmap v5995: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:23.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:08:23 gibba045 bash[25517]: cluster 2021-03-10T17:08:21.684760+0000 mgr.gibba045.orlgmj (mgr.34412) 10529 : cluster [DBG] pgmap v5995: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:25.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:08:25 gibba015 bash[29377]: cluster 2021-03-10T17:08:23.686046+0000 mgr.gibba045.orlgmj (mgr.34412) 10530 : cluster [DBG] pgmap v5996: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:25.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:08:25 gibba015 bash[30343]: cluster 2021-03-10T17:08:23.686046+0000 mgr.gibba045.orlgmj (mgr.34412) 10530 : cluster [DBG] pgmap v5996: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:25.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:08:25 gibba045 bash[25517]: cluster 2021-03-10T17:08:23.686046+0000 mgr.gibba045.orlgmj (mgr.34412) 10530 : cluster [DBG] pgmap v5996: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:27.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:08:27 gibba015 bash[29377]: cluster 2021-03-10T17:08:25.687828+0000 mgr.gibba045.orlgmj (mgr.34412) 10531 : cluster [DBG] pgmap v5997: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:27.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:08:27 gibba015 bash[30343]: cluster 2021-03-10T17:08:25.687828+0000 mgr.gibba045.orlgmj (mgr.34412) 10531 : cluster [DBG] pgmap v5997: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:27.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:08:27 gibba045 bash[25517]: cluster 2021-03-10T17:08:25.687828+0000 mgr.gibba045.orlgmj (mgr.34412) 10531 : cluster [DBG] pgmap v5997: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:29.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:08:29 gibba015 bash[29377]: cluster 2021-03-10T17:08:27.689293+0000 mgr.gibba045.orlgmj (mgr.34412) 10532 : cluster [DBG] pgmap v5998: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:29.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:08:29 gibba015 bash[30343]: cluster 2021-03-10T17:08:27.689293+0000 mgr.gibba045.orlgmj (mgr.34412) 10532 : cluster [DBG] pgmap v5998: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:29.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:08:29 gibba045 bash[25517]: cluster 2021-03-10T17:08:27.689293+0000 mgr.gibba045.orlgmj (mgr.34412) 10532 : cluster [DBG] pgmap v5998: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:30.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:08:30 gibba015 bash[29377]: cluster 2021-03-10T17:08:29.690596+0000 mgr.gibba045.orlgmj (mgr.34412) 10533 : cluster [DBG] pgmap v5999: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:30.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:08:30 gibba015 bash[30343]: cluster 2021-03-10T17:08:29.690596+0000 mgr.gibba045.orlgmj (mgr.34412) 10533 : cluster [DBG] pgmap v5999: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:30.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:08:30 gibba045 bash[25517]: cluster 2021-03-10T17:08:29.690596+0000 mgr.gibba045.orlgmj (mgr.34412) 10533 : cluster [DBG] pgmap v5999: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:33.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:08:33 gibba015 bash[29377]: cluster 2021-03-10T17:08:31.692310+0000 mgr.gibba045.orlgmj (mgr.34412) 10534 : cluster [DBG] pgmap v6000: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:33.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:08:33 gibba015 bash[30343]: cluster 2021-03-10T17:08:31.692310+0000 mgr.gibba045.orlgmj (mgr.34412) 10534 : cluster [DBG] pgmap v6000: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:33.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:08:33 gibba045 bash[25517]: cluster 2021-03-10T17:08:31.692310+0000 mgr.gibba045.orlgmj (mgr.34412) 10534 : cluster [DBG] pgmap v6000: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:35.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:08:35 gibba015 bash[29377]: cephadm 2021-03-10T17:08:33.390565+0000 mgr.gibba045.orlgmj (mgr.34412) 10535 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:08:35.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:08:35 gibba015 bash[29377]: cluster 2021-03-10T17:08:33.693567+0000 mgr.gibba045.orlgmj (mgr.34412) 10536 : cluster [DBG] pgmap v6001: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:35.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:08:35 gibba015 bash[30343]: cephadm 2021-03-10T17:08:33.390565+0000 mgr.gibba045.orlgmj (mgr.34412) 10535 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:08:35.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:08:35 gibba015 bash[30343]: cluster 2021-03-10T17:08:33.693567+0000 mgr.gibba045.orlgmj (mgr.34412) 10536 : cluster [DBG] pgmap v6001: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:35.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:08:35 gibba045 bash[25517]: cephadm 2021-03-10T17:08:33.390565+0000 mgr.gibba045.orlgmj (mgr.34412) 10535 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:08:35.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:08:35 gibba045 bash[25517]: cluster 2021-03-10T17:08:33.693567+0000 mgr.gibba045.orlgmj (mgr.34412) 10536 : cluster [DBG] pgmap v6001: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:37.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:08:37 gibba015 bash[29377]: cluster 2021-03-10T17:08:35.695338+0000 mgr.gibba045.orlgmj (mgr.34412) 10537 : cluster [DBG] pgmap v6002: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:37.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:08:37 gibba015 bash[30343]: cluster 2021-03-10T17:08:35.695338+0000 mgr.gibba045.orlgmj (mgr.34412) 10537 : cluster [DBG] pgmap v6002: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:37.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:08:37 gibba045 bash[25517]: cluster 2021-03-10T17:08:35.695338+0000 mgr.gibba045.orlgmj (mgr.34412) 10537 : cluster [DBG] pgmap v6002: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:39.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:08:39 gibba015 bash[29377]: cluster 2021-03-10T17:08:37.696900+0000 mgr.gibba045.orlgmj (mgr.34412) 10538 : cluster [DBG] pgmap v6003: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:39.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:08:39 gibba015 bash[30343]: cluster 2021-03-10T17:08:37.696900+0000 mgr.gibba045.orlgmj (mgr.34412) 10538 : cluster [DBG] pgmap v6003: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:39.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:08:39 gibba045 bash[25517]: cluster 2021-03-10T17:08:37.696900+0000 mgr.gibba045.orlgmj (mgr.34412) 10538 : cluster [DBG] pgmap v6003: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:40.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:08:40 gibba015 bash[29377]: cluster 2021-03-10T17:08:39.697895+0000 mgr.gibba045.orlgmj (mgr.34412) 10539 : cluster [DBG] pgmap v6004: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:40.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:08:40 gibba015 bash[30343]: cluster 2021-03-10T17:08:39.697895+0000 mgr.gibba045.orlgmj (mgr.34412) 10539 : cluster [DBG] pgmap v6004: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:40.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:08:40 gibba045 bash[25517]: cluster 2021-03-10T17:08:39.697895+0000 mgr.gibba045.orlgmj (mgr.34412) 10539 : cluster [DBG] pgmap v6004: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:43.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:08:43 gibba015 bash[29377]: cluster 2021-03-10T17:08:41.699468+0000 mgr.gibba045.orlgmj (mgr.34412) 10540 : cluster [DBG] pgmap v6005: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:43.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:08:43 gibba015 bash[30343]: cluster 2021-03-10T17:08:41.699468+0000 mgr.gibba045.orlgmj (mgr.34412) 10540 : cluster [DBG] pgmap v6005: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:43.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:08:43 gibba045 bash[25517]: cluster 2021-03-10T17:08:41.699468+0000 mgr.gibba045.orlgmj (mgr.34412) 10540 : cluster [DBG] pgmap v6005: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:45.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:08:45 gibba015 bash[29377]: cluster 2021-03-10T17:08:43.700718+0000 mgr.gibba045.orlgmj (mgr.34412) 10541 : cluster [DBG] pgmap v6006: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:45.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:08:45 gibba015 bash[30343]: cluster 2021-03-10T17:08:43.700718+0000 mgr.gibba045.orlgmj (mgr.34412) 10541 : cluster [DBG] pgmap v6006: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:45.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:08:45 gibba045 bash[25517]: cluster 2021-03-10T17:08:43.700718+0000 mgr.gibba045.orlgmj (mgr.34412) 10541 : cluster [DBG] pgmap v6006: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:47.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:08:47 gibba015 bash[29377]: cluster 2021-03-10T17:08:45.702375+0000 mgr.gibba045.orlgmj (mgr.34412) 10542 : cluster [DBG] pgmap v6007: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:47.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:08:47 gibba015 bash[30343]: cluster 2021-03-10T17:08:45.702375+0000 mgr.gibba045.orlgmj (mgr.34412) 10542 : cluster [DBG] pgmap v6007: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:47.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:08:47 gibba045 bash[25517]: cluster 2021-03-10T17:08:45.702375+0000 mgr.gibba045.orlgmj (mgr.34412) 10542 : cluster [DBG] pgmap v6007: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:48.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:08:48 gibba015 bash[29377]: cluster 2021-03-10T17:08:47.703834+0000 mgr.gibba045.orlgmj (mgr.34412) 10543 : cluster [DBG] pgmap v6008: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:48.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:08:48 gibba015 bash[30343]: cluster 2021-03-10T17:08:47.703834+0000 mgr.gibba045.orlgmj (mgr.34412) 10543 : cluster [DBG] pgmap v6008: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:48.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:08:48 gibba045 bash[25517]: cluster 2021-03-10T17:08:47.703834+0000 mgr.gibba045.orlgmj (mgr.34412) 10543 : cluster [DBG] pgmap v6008: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:49.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:08:49 gibba015 bash[29377]: cephadm 2021-03-10T17:08:48.406340+0000 mgr.gibba045.orlgmj (mgr.34412) 10544 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:08:49.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:08:49 gibba015 bash[30343]: cephadm 2021-03-10T17:08:48.406340+0000 mgr.gibba045.orlgmj (mgr.34412) 10544 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:08:49.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:08:49 gibba045 bash[25517]: cephadm 2021-03-10T17:08:48.406340+0000 mgr.gibba045.orlgmj (mgr.34412) 10544 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:08:50.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:08:50 gibba015 bash[29377]: cluster 2021-03-10T17:08:49.705602+0000 mgr.gibba045.orlgmj (mgr.34412) 10545 : cluster [DBG] pgmap v6009: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:50.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:08:50 gibba015 bash[30343]: cluster 2021-03-10T17:08:49.705602+0000 mgr.gibba045.orlgmj (mgr.34412) 10545 : cluster [DBG] pgmap v6009: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:50.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:08:50 gibba045 bash[25517]: cluster 2021-03-10T17:08:49.705602+0000 mgr.gibba045.orlgmj (mgr.34412) 10545 : cluster [DBG] pgmap v6009: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:51.794 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:08:52.019 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:08:52.020 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 97s ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:08:52.020 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 33s ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:08:52.020 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 33s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:08:52.020 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 33s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:08:52.021 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 97s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:08:52.021 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 97s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:08:52.021 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 33s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:08:52.021 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 97s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:08:52.021 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 97s ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:08:52.022 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 33s ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:08:52.022 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 97s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:08:52.022 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 97s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:08:52.022 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 97s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:08:52.023 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 97s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:08:52.023 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 33s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:08:52.023 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 33s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:08:52.023 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 33s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:08:52.023 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 33s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:08:52.024 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 33s ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:08:52.024 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 33s ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:08:52.265 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:08:52.265 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:08:52.265 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:08:52.266 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:08:52.266 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:08:52.266 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:08:52.266 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:08:52.266 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:08:52.267 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:08:52.267 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:08:52.267 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:08:52.267 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:08:52.268 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:08:52.268 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:08:52.268 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:08:53.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:08:52 gibba045 bash[25517]: cluster 2021-03-10T17:08:51.707368+0000 mgr.gibba045.orlgmj (mgr.34412) 10546 : cluster [DBG] pgmap v6010: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:53.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:08:52 gibba045 bash[25517]: audit 2021-03-10T17:08:51.786476+0000 mgr.gibba045.orlgmj (mgr.34412) 10547 : audit [DBG] from='client.51126 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:08:53.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:08:52 gibba045 bash[25517]: audit 2021-03-10T17:08:52.008749+0000 mgr.gibba045.orlgmj (mgr.34412) 10548 : audit [DBG] from='client.61120 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:08:53.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:08:52 gibba045 bash[25517]: audit 2021-03-10T17:08:52.263939+0000 mon.a (mon.0) 2257 : audit [DBG] from='client.? 172.21.2.115:0/1967550935' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:08:53.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:08:52 gibba015 bash[29377]: cluster 2021-03-10T17:08:51.707368+0000 mgr.gibba045.orlgmj (mgr.34412) 10546 : cluster [DBG] pgmap v6010: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:53.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:08:52 gibba015 bash[29377]: audit 2021-03-10T17:08:51.786476+0000 mgr.gibba045.orlgmj (mgr.34412) 10547 : audit [DBG] from='client.51126 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:08:53.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:08:52 gibba015 bash[29377]: audit 2021-03-10T17:08:52.008749+0000 mgr.gibba045.orlgmj (mgr.34412) 10548 : audit [DBG] from='client.61120 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:08:53.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:08:52 gibba015 bash[29377]: audit 2021-03-10T17:08:52.263939+0000 mon.a (mon.0) 2257 : audit [DBG] from='client.? 172.21.2.115:0/1967550935' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:08:53.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:08:52 gibba015 bash[30343]: cluster 2021-03-10T17:08:51.707368+0000 mgr.gibba045.orlgmj (mgr.34412) 10546 : cluster [DBG] pgmap v6010: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:53.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:08:52 gibba015 bash[30343]: audit 2021-03-10T17:08:51.786476+0000 mgr.gibba045.orlgmj (mgr.34412) 10547 : audit [DBG] from='client.51126 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:08:53.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:08:52 gibba015 bash[30343]: audit 2021-03-10T17:08:52.008749+0000 mgr.gibba045.orlgmj (mgr.34412) 10548 : audit [DBG] from='client.61120 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:08:53.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:08:52 gibba015 bash[30343]: audit 2021-03-10T17:08:52.263939+0000 mon.a (mon.0) 2257 : audit [DBG] from='client.? 172.21.2.115:0/1967550935' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:08:55.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:08:54 gibba045 bash[25517]: cluster 2021-03-10T17:08:53.708659+0000 mgr.gibba045.orlgmj (mgr.34412) 10549 : cluster [DBG] pgmap v6011: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:55.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:08:54 gibba045 bash[25517]: audit 2021-03-10T17:08:53.877873+0000 mon.c (mon.1) 2887 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:08:55.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:08:54 gibba045 bash[25517]: audit 2021-03-10T17:08:53.879008+0000 mon.a (mon.0) 2258 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:08:55.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:08:54 gibba045 bash[25517]: audit 2021-03-10T17:08:53.879434+0000 mon.c (mon.1) 2888 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:08:55.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:08:54 gibba045 bash[25517]: audit 2021-03-10T17:08:53.880529+0000 mon.a (mon.0) 2259 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:08:55.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:08:54 gibba045 bash[25517]: audit 2021-03-10T17:08:53.957375+0000 mon.c (mon.1) 2889 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T17:08:55.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:08:54 gibba045 bash[25517]: audit 2021-03-10T17:08:53.958138+0000 mon.c (mon.1) 2890 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:08:55.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:08:54 gibba045 bash[25517]: audit 2021-03-10T17:08:53.958772+0000 mon.a (mon.0) 2260 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T17:08:55.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:08:54 gibba045 bash[25517]: audit 2021-03-10T17:08:53.959280+0000 mon.c (mon.1) 2891 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:08:55.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:08:54 gibba045 bash[25517]: audit 2021-03-10T17:08:53.960694+0000 mon.c (mon.1) 2892 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:08:55.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:08:54 gibba045 bash[25517]: audit 2021-03-10T17:08:53.960860+0000 mon.a (mon.0) 2261 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:08:55.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:08:54 gibba045 bash[25517]: audit 2021-03-10T17:08:53.961726+0000 mon.a (mon.0) 2262 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:08:55.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:08:54 gibba045 bash[25517]: audit 2021-03-10T17:08:53.961938+0000 mon.a (mon.0) 2263 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:08:55.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:08:54 gibba015 bash[29377]: cluster 2021-03-10T17:08:53.708659+0000 mgr.gibba045.orlgmj (mgr.34412) 10549 : cluster [DBG] pgmap v6011: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:55.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:08:54 gibba015 bash[29377]: audit 2021-03-10T17:08:53.877873+0000 mon.c (mon.1) 2887 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:08:55.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:08:54 gibba015 bash[29377]: audit 2021-03-10T17:08:53.879008+0000 mon.a (mon.0) 2258 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:08:55.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:08:54 gibba015 bash[29377]: audit 2021-03-10T17:08:53.879434+0000 mon.c (mon.1) 2888 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:08:55.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:08:54 gibba015 bash[29377]: audit 2021-03-10T17:08:53.880529+0000 mon.a (mon.0) 2259 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:08:55.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:08:54 gibba015 bash[29377]: audit 2021-03-10T17:08:53.957375+0000 mon.c (mon.1) 2889 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T17:08:55.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:08:54 gibba015 bash[29377]: audit 2021-03-10T17:08:53.958138+0000 mon.c (mon.1) 2890 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:08:55.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:08:54 gibba015 bash[29377]: audit 2021-03-10T17:08:53.958772+0000 mon.a (mon.0) 2260 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T17:08:55.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:08:54 gibba015 bash[29377]: audit 2021-03-10T17:08:53.959280+0000 mon.c (mon.1) 2891 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:08:55.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:08:54 gibba015 bash[29377]: audit 2021-03-10T17:08:53.960694+0000 mon.c (mon.1) 2892 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:08:55.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:08:54 gibba015 bash[29377]: audit 2021-03-10T17:08:53.960860+0000 mon.a (mon.0) 2261 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:08:55.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:08:54 gibba015 bash[29377]: audit 2021-03-10T17:08:53.961726+0000 mon.a (mon.0) 2262 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:08:55.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:08:54 gibba015 bash[29377]: audit 2021-03-10T17:08:53.961938+0000 mon.a (mon.0) 2263 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:08:55.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:08:54 gibba015 bash[30343]: cluster 2021-03-10T17:08:53.708659+0000 mgr.gibba045.orlgmj (mgr.34412) 10549 : cluster [DBG] pgmap v6011: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:55.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:08:54 gibba015 bash[30343]: audit 2021-03-10T17:08:53.877873+0000 mon.c (mon.1) 2887 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:08:55.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:08:54 gibba015 bash[30343]: audit 2021-03-10T17:08:53.879008+0000 mon.a (mon.0) 2258 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:08:55.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:08:54 gibba015 bash[30343]: audit 2021-03-10T17:08:53.879434+0000 mon.c (mon.1) 2888 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:08:55.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:08:54 gibba015 bash[30343]: audit 2021-03-10T17:08:53.880529+0000 mon.a (mon.0) 2259 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:08:55.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:08:54 gibba015 bash[30343]: audit 2021-03-10T17:08:53.957375+0000 mon.c (mon.1) 2889 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T17:08:55.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:08:54 gibba015 bash[30343]: audit 2021-03-10T17:08:53.958138+0000 mon.c (mon.1) 2890 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:08:55.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:08:54 gibba015 bash[30343]: audit 2021-03-10T17:08:53.958772+0000 mon.a (mon.0) 2260 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T17:08:55.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:08:54 gibba015 bash[30343]: audit 2021-03-10T17:08:53.959280+0000 mon.c (mon.1) 2891 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:08:55.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:08:54 gibba015 bash[30343]: audit 2021-03-10T17:08:53.960694+0000 mon.c (mon.1) 2892 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:08:55.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:08:54 gibba015 bash[30343]: audit 2021-03-10T17:08:53.960860+0000 mon.a (mon.0) 2261 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:08:55.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:08:54 gibba015 bash[30343]: audit 2021-03-10T17:08:53.961726+0000 mon.a (mon.0) 2262 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:08:55.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:08:54 gibba015 bash[30343]: audit 2021-03-10T17:08:53.961938+0000 mon.a (mon.0) 2263 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:08:57.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:08:56 gibba045 bash[25517]: cluster 2021-03-10T17:08:55.710540+0000 mgr.gibba045.orlgmj (mgr.34412) 10550 : cluster [DBG] pgmap v6012: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:57.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:08:56 gibba015 bash[29377]: cluster 2021-03-10T17:08:55.710540+0000 mgr.gibba045.orlgmj (mgr.34412) 10550 : cluster [DBG] pgmap v6012: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:57.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:08:56 gibba015 bash[30343]: cluster 2021-03-10T17:08:55.710540+0000 mgr.gibba045.orlgmj (mgr.34412) 10550 : cluster [DBG] pgmap v6012: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:59.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:08:59 gibba015 bash[29377]: cluster 2021-03-10T17:08:57.712160+0000 mgr.gibba045.orlgmj (mgr.34412) 10551 : cluster [DBG] pgmap v6013: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:59.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:08:59 gibba015 bash[30343]: cluster 2021-03-10T17:08:57.712160+0000 mgr.gibba045.orlgmj (mgr.34412) 10551 : cluster [DBG] pgmap v6013: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:59.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:08:59 gibba045 bash[25517]: cluster 2021-03-10T17:08:57.712160+0000 mgr.gibba045.orlgmj (mgr.34412) 10551 : cluster [DBG] pgmap v6013: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:01.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:09:01 gibba015 bash[29377]: cluster 2021-03-10T17:08:59.713688+0000 mgr.gibba045.orlgmj (mgr.34412) 10552 : cluster [DBG] pgmap v6014: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:01.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:09:01 gibba015 bash[30343]: cluster 2021-03-10T17:08:59.713688+0000 mgr.gibba045.orlgmj (mgr.34412) 10552 : cluster [DBG] pgmap v6014: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:01.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:09:01 gibba045 bash[25517]: cluster 2021-03-10T17:08:59.713688+0000 mgr.gibba045.orlgmj (mgr.34412) 10552 : cluster [DBG] pgmap v6014: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:03.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:09:03 gibba015 bash[29377]: cluster 2021-03-10T17:09:01.715169+0000 mgr.gibba045.orlgmj (mgr.34412) 10553 : cluster [DBG] pgmap v6015: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:03.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:09:03 gibba015 bash[30343]: cluster 2021-03-10T17:09:01.715169+0000 mgr.gibba045.orlgmj (mgr.34412) 10553 : cluster [DBG] pgmap v6015: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:03.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:09:03 gibba045 bash[25517]: cluster 2021-03-10T17:09:01.715169+0000 mgr.gibba045.orlgmj (mgr.34412) 10553 : cluster [DBG] pgmap v6015: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:04.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:09:04 gibba015 bash[29377]: cephadm 2021-03-10T17:09:03.421893+0000 mgr.gibba045.orlgmj (mgr.34412) 10554 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:09:04.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:09:04 gibba015 bash[29377]: cluster 2021-03-10T17:09:03.716398+0000 mgr.gibba045.orlgmj (mgr.34412) 10555 : cluster [DBG] pgmap v6016: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:04.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:09:04 gibba015 bash[30343]: cephadm 2021-03-10T17:09:03.421893+0000 mgr.gibba045.orlgmj (mgr.34412) 10554 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:09:04.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:09:04 gibba015 bash[30343]: cluster 2021-03-10T17:09:03.716398+0000 mgr.gibba045.orlgmj (mgr.34412) 10555 : cluster [DBG] pgmap v6016: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:04.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:09:04 gibba045 bash[25517]: cephadm 2021-03-10T17:09:03.421893+0000 mgr.gibba045.orlgmj (mgr.34412) 10554 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:09:04.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:09:04 gibba045 bash[25517]: cluster 2021-03-10T17:09:03.716398+0000 mgr.gibba045.orlgmj (mgr.34412) 10555 : cluster [DBG] pgmap v6016: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:07.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:09:06 gibba045 bash[25517]: cluster 2021-03-10T17:09:05.718094+0000 mgr.gibba045.orlgmj (mgr.34412) 10556 : cluster [DBG] pgmap v6017: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:07.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:09:06 gibba015 bash[29377]: cluster 2021-03-10T17:09:05.718094+0000 mgr.gibba045.orlgmj (mgr.34412) 10556 : cluster [DBG] pgmap v6017: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:07.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:09:06 gibba015 bash[30343]: cluster 2021-03-10T17:09:05.718094+0000 mgr.gibba045.orlgmj (mgr.34412) 10556 : cluster [DBG] pgmap v6017: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:09.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:09:09 gibba015 bash[29377]: cluster 2021-03-10T17:09:07.719506+0000 mgr.gibba045.orlgmj (mgr.34412) 10557 : cluster [DBG] pgmap v6018: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:09.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:09:09 gibba015 bash[30343]: cluster 2021-03-10T17:09:07.719506+0000 mgr.gibba045.orlgmj (mgr.34412) 10557 : cluster [DBG] pgmap v6018: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:09.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:09:09 gibba045 bash[25517]: cluster 2021-03-10T17:09:07.719506+0000 mgr.gibba045.orlgmj (mgr.34412) 10557 : cluster [DBG] pgmap v6018: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:10.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:09:10 gibba015 bash[29377]: cluster 2021-03-10T17:09:09.721146+0000 mgr.gibba045.orlgmj (mgr.34412) 10558 : cluster [DBG] pgmap v6019: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:10.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:09:10 gibba015 bash[30343]: cluster 2021-03-10T17:09:09.721146+0000 mgr.gibba045.orlgmj (mgr.34412) 10558 : cluster [DBG] pgmap v6019: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:10.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:09:10 gibba045 bash[25517]: cluster 2021-03-10T17:09:09.721146+0000 mgr.gibba045.orlgmj (mgr.34412) 10558 : cluster [DBG] pgmap v6019: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:13.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:09:13 gibba015 bash[29377]: cluster 2021-03-10T17:09:11.722673+0000 mgr.gibba045.orlgmj (mgr.34412) 10559 : cluster [DBG] pgmap v6020: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:13.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:09:13 gibba015 bash[30343]: cluster 2021-03-10T17:09:11.722673+0000 mgr.gibba045.orlgmj (mgr.34412) 10559 : cluster [DBG] pgmap v6020: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:13.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:09:13 gibba045 bash[25517]: cluster 2021-03-10T17:09:11.722673+0000 mgr.gibba045.orlgmj (mgr.34412) 10559 : cluster [DBG] pgmap v6020: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:15.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:09:15 gibba015 bash[29377]: cluster 2021-03-10T17:09:13.723841+0000 mgr.gibba045.orlgmj (mgr.34412) 10560 : cluster [DBG] pgmap v6021: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:15.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:09:15 gibba015 bash[30343]: cluster 2021-03-10T17:09:13.723841+0000 mgr.gibba045.orlgmj (mgr.34412) 10560 : cluster [DBG] pgmap v6021: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:15.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:09:15 gibba045 bash[25517]: cluster 2021-03-10T17:09:13.723841+0000 mgr.gibba045.orlgmj (mgr.34412) 10560 : cluster [DBG] pgmap v6021: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:16.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:09:16 gibba015 bash[29377]: cluster 2021-03-10T17:09:15.725761+0000 mgr.gibba045.orlgmj (mgr.34412) 10561 : cluster [DBG] pgmap v6022: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:16.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:09:16 gibba015 bash[30343]: cluster 2021-03-10T17:09:15.725761+0000 mgr.gibba045.orlgmj (mgr.34412) 10561 : cluster [DBG] pgmap v6022: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:16.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:09:16 gibba045 bash[25517]: cluster 2021-03-10T17:09:15.725761+0000 mgr.gibba045.orlgmj (mgr.34412) 10561 : cluster [DBG] pgmap v6022: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:19.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:09:19 gibba015 bash[29377]: cluster 2021-03-10T17:09:17.727341+0000 mgr.gibba045.orlgmj (mgr.34412) 10562 : cluster [DBG] pgmap v6023: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:19.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:09:19 gibba015 bash[29377]: audit 2021-03-10T17:09:18.432802+0000 mon.c (mon.1) 2893 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:09:19.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:09:19 gibba015 bash[29377]: audit 2021-03-10T17:09:18.653192+0000 mon.a (mon.0) 2264 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:09:19.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:09:19 gibba015 bash[29377]: audit 2021-03-10T17:09:18.657399+0000 mon.c (mon.1) 2894 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:09:19.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:09:19 gibba015 bash[29377]: audit 2021-03-10T17:09:18.660080+0000 mon.c (mon.1) 2895 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:09:19.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:09:19 gibba015 bash[29377]: audit 2021-03-10T17:09:18.665231+0000 mon.c (mon.1) 2896 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:09:19.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:09:19 gibba015 bash[29377]: audit 2021-03-10T17:09:18.670015+0000 mon.c (mon.1) 2897 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:09:19.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:09:19 gibba015 bash[29377]: audit 2021-03-10T17:09:18.680899+0000 mon.c (mon.1) 2898 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:09:19.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:09:19 gibba015 bash[29377]: audit 2021-03-10T17:09:18.687319+0000 mon.c (mon.1) 2899 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:09:19.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:09:19 gibba015 bash[30343]: cluster 2021-03-10T17:09:17.727341+0000 mgr.gibba045.orlgmj (mgr.34412) 10562 : cluster [DBG] pgmap v6023: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:19.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:09:19 gibba015 bash[30343]: audit 2021-03-10T17:09:18.432802+0000 mon.c (mon.1) 2893 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:09:19.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:09:19 gibba015 bash[30343]: audit 2021-03-10T17:09:18.653192+0000 mon.a (mon.0) 2264 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:09:19.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:09:19 gibba015 bash[30343]: audit 2021-03-10T17:09:18.657399+0000 mon.c (mon.1) 2894 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:09:19.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:09:19 gibba015 bash[30343]: audit 2021-03-10T17:09:18.660080+0000 mon.c (mon.1) 2895 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:09:19.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:09:19 gibba015 bash[30343]: audit 2021-03-10T17:09:18.665231+0000 mon.c (mon.1) 2896 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:09:19.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:09:19 gibba015 bash[30343]: audit 2021-03-10T17:09:18.670015+0000 mon.c (mon.1) 2897 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:09:19.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:09:19 gibba015 bash[30343]: audit 2021-03-10T17:09:18.680899+0000 mon.c (mon.1) 2898 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:09:19.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:09:19 gibba015 bash[30343]: audit 2021-03-10T17:09:18.687319+0000 mon.c (mon.1) 2899 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:09:19.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:09:19 gibba045 bash[25517]: cluster 2021-03-10T17:09:17.727341+0000 mgr.gibba045.orlgmj (mgr.34412) 10562 : cluster [DBG] pgmap v6023: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:19.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:09:19 gibba045 bash[25517]: audit 2021-03-10T17:09:18.432802+0000 mon.c (mon.1) 2893 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:09:19.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:09:19 gibba045 bash[25517]: audit 2021-03-10T17:09:18.653192+0000 mon.a (mon.0) 2264 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:09:19.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:09:19 gibba045 bash[25517]: audit 2021-03-10T17:09:18.657399+0000 mon.c (mon.1) 2894 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:09:19.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:09:19 gibba045 bash[25517]: audit 2021-03-10T17:09:18.660080+0000 mon.c (mon.1) 2895 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:09:19.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:09:19 gibba045 bash[25517]: audit 2021-03-10T17:09:18.665231+0000 mon.c (mon.1) 2896 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:09:19.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:09:19 gibba045 bash[25517]: audit 2021-03-10T17:09:18.670015+0000 mon.c (mon.1) 2897 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:09:19.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:09:19 gibba045 bash[25517]: audit 2021-03-10T17:09:18.680899+0000 mon.c (mon.1) 2898 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:09:19.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:09:19 gibba045 bash[25517]: audit 2021-03-10T17:09:18.687319+0000 mon.c (mon.1) 2899 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:09:20.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:09:20 gibba015 bash[29377]: cephadm 2021-03-10T17:09:18.437841+0000 mgr.gibba045.orlgmj (mgr.34412) 10563 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:09:20.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:09:20 gibba015 bash[29377]: cephadm 2021-03-10T17:09:18.438889+0000 mgr.gibba045.orlgmj (mgr.34412) 10564 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:09:20.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:09:20 gibba015 bash[29377]: cephadm 2021-03-10T17:09:18.658492+0000 mgr.gibba045.orlgmj (mgr.34412) 10565 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:09:20.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:09:20 gibba015 bash[29377]: cephadm 2021-03-10T17:09:18.661603+0000 mgr.gibba045.orlgmj (mgr.34412) 10566 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:09:20.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:09:20 gibba015 bash[29377]: cephadm 2021-03-10T17:09:18.665097+0000 mgr.gibba045.orlgmj (mgr.34412) 10567 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:09:20.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:09:20 gibba015 bash[29377]: cephadm 2021-03-10T17:09:18.665612+0000 mgr.gibba045.orlgmj (mgr.34412) 10568 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:09:20.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:09:20 gibba015 bash[29377]: cephadm 2021-03-10T17:09:18.670443+0000 mgr.gibba045.orlgmj (mgr.34412) 10569 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:09:20.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:09:20 gibba015 bash[29377]: cephadm 2021-03-10T17:09:18.671078+0000 mgr.gibba045.orlgmj (mgr.34412) 10570 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:09:20.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:09:20 gibba015 bash[29377]: cephadm 2021-03-10T17:09:18.675094+0000 mgr.gibba045.orlgmj (mgr.34412) 10571 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:09:20.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:09:20 gibba015 bash[29377]: cephadm 2021-03-10T17:09:18.680665+0000 mgr.gibba045.orlgmj (mgr.34412) 10572 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:09:20.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:09:20 gibba015 bash[29377]: cephadm 2021-03-10T17:09:18.681116+0000 mgr.gibba045.orlgmj (mgr.34412) 10573 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:09:20.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:09:20 gibba015 bash[29377]: cephadm 2021-03-10T17:09:18.686111+0000 mgr.gibba045.orlgmj (mgr.34412) 10574 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:09:20.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:09:20 gibba015 bash[29377]: cephadm 2021-03-10T17:09:18.688177+0000 mgr.gibba045.orlgmj (mgr.34412) 10575 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:09:20.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:09:20 gibba015 bash[29377]: cephadm 2021-03-10T17:09:18.693185+0000 mgr.gibba045.orlgmj (mgr.34412) 10576 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:09:20.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:09:20 gibba015 bash[29377]: cephadm 2021-03-10T17:09:18.693720+0000 mgr.gibba045.orlgmj (mgr.34412) 10577 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:09:20.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:09:20 gibba015 bash[29377]: cephadm 2021-03-10T17:09:18.694334+0000 mgr.gibba045.orlgmj (mgr.34412) 10578 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:09:20.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:09:20 gibba015 bash[30343]: cephadm 2021-03-10T17:09:18.437841+0000 mgr.gibba045.orlgmj (mgr.34412) 10563 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:09:20.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:09:20 gibba015 bash[30343]: cephadm 2021-03-10T17:09:18.438889+0000 mgr.gibba045.orlgmj (mgr.34412) 10564 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:09:20.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:09:20 gibba015 bash[30343]: cephadm 2021-03-10T17:09:18.658492+0000 mgr.gibba045.orlgmj (mgr.34412) 10565 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:09:20.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:09:20 gibba015 bash[30343]: cephadm 2021-03-10T17:09:18.661603+0000 mgr.gibba045.orlgmj (mgr.34412) 10566 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:09:20.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:09:20 gibba015 bash[30343]: cephadm 2021-03-10T17:09:18.665097+0000 mgr.gibba045.orlgmj (mgr.34412) 10567 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:09:20.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:09:20 gibba015 bash[30343]: cephadm 2021-03-10T17:09:18.665612+0000 mgr.gibba045.orlgmj (mgr.34412) 10568 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:09:20.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:09:20 gibba015 bash[30343]: cephadm 2021-03-10T17:09:18.670443+0000 mgr.gibba045.orlgmj (mgr.34412) 10569 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:09:20.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:09:20 gibba015 bash[30343]: cephadm 2021-03-10T17:09:18.671078+0000 mgr.gibba045.orlgmj (mgr.34412) 10570 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:09:20.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:09:20 gibba015 bash[30343]: cephadm 2021-03-10T17:09:18.675094+0000 mgr.gibba045.orlgmj (mgr.34412) 10571 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:09:20.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:09:20 gibba015 bash[30343]: cephadm 2021-03-10T17:09:18.680665+0000 mgr.gibba045.orlgmj (mgr.34412) 10572 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:09:20.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:09:20 gibba015 bash[30343]: cephadm 2021-03-10T17:09:18.681116+0000 mgr.gibba045.orlgmj (mgr.34412) 10573 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:09:20.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:09:20 gibba015 bash[30343]: cephadm 2021-03-10T17:09:18.686111+0000 mgr.gibba045.orlgmj (mgr.34412) 10574 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:09:20.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:09:20 gibba015 bash[30343]: cephadm 2021-03-10T17:09:18.688177+0000 mgr.gibba045.orlgmj (mgr.34412) 10575 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:09:20.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:09:20 gibba015 bash[30343]: cephadm 2021-03-10T17:09:18.693185+0000 mgr.gibba045.orlgmj (mgr.34412) 10576 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:09:20.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:09:20 gibba015 bash[30343]: cephadm 2021-03-10T17:09:18.693720+0000 mgr.gibba045.orlgmj (mgr.34412) 10577 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:09:20.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:09:20 gibba015 bash[30343]: cephadm 2021-03-10T17:09:18.694334+0000 mgr.gibba045.orlgmj (mgr.34412) 10578 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:09:20.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:09:20 gibba045 bash[25517]: cephadm 2021-03-10T17:09:18.437841+0000 mgr.gibba045.orlgmj (mgr.34412) 10563 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:09:20.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:09:20 gibba045 bash[25517]: cephadm 2021-03-10T17:09:18.438889+0000 mgr.gibba045.orlgmj (mgr.34412) 10564 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:09:20.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:09:20 gibba045 bash[25517]: cephadm 2021-03-10T17:09:18.658492+0000 mgr.gibba045.orlgmj (mgr.34412) 10565 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:09:20.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:09:20 gibba045 bash[25517]: cephadm 2021-03-10T17:09:18.661603+0000 mgr.gibba045.orlgmj (mgr.34412) 10566 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:09:20.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:09:20 gibba045 bash[25517]: cephadm 2021-03-10T17:09:18.665097+0000 mgr.gibba045.orlgmj (mgr.34412) 10567 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:09:20.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:09:20 gibba045 bash[25517]: cephadm 2021-03-10T17:09:18.665612+0000 mgr.gibba045.orlgmj (mgr.34412) 10568 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:09:20.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:09:20 gibba045 bash[25517]: cephadm 2021-03-10T17:09:18.670443+0000 mgr.gibba045.orlgmj (mgr.34412) 10569 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:09:20.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:09:20 gibba045 bash[25517]: cephadm 2021-03-10T17:09:18.671078+0000 mgr.gibba045.orlgmj (mgr.34412) 10570 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:09:20.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:09:20 gibba045 bash[25517]: cephadm 2021-03-10T17:09:18.675094+0000 mgr.gibba045.orlgmj (mgr.34412) 10571 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:09:20.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:09:20 gibba045 bash[25517]: cephadm 2021-03-10T17:09:18.680665+0000 mgr.gibba045.orlgmj (mgr.34412) 10572 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:09:20.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:09:20 gibba045 bash[25517]: cephadm 2021-03-10T17:09:18.681116+0000 mgr.gibba045.orlgmj (mgr.34412) 10573 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:09:20.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:09:20 gibba045 bash[25517]: cephadm 2021-03-10T17:09:18.686111+0000 mgr.gibba045.orlgmj (mgr.34412) 10574 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:09:20.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:09:20 gibba045 bash[25517]: cephadm 2021-03-10T17:09:18.688177+0000 mgr.gibba045.orlgmj (mgr.34412) 10575 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:09:20.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:09:20 gibba045 bash[25517]: cephadm 2021-03-10T17:09:18.693185+0000 mgr.gibba045.orlgmj (mgr.34412) 10576 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:09:20.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:09:20 gibba045 bash[25517]: cephadm 2021-03-10T17:09:18.693720+0000 mgr.gibba045.orlgmj (mgr.34412) 10577 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:09:20.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:09:20 gibba045 bash[25517]: cephadm 2021-03-10T17:09:18.694334+0000 mgr.gibba045.orlgmj (mgr.34412) 10578 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:09:21.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:09:21 gibba015 bash[29377]: cluster 2021-03-10T17:09:19.729031+0000 mgr.gibba045.orlgmj (mgr.34412) 10579 : cluster [DBG] pgmap v6024: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:21.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:09:21 gibba015 bash[30343]: cluster 2021-03-10T17:09:19.729031+0000 mgr.gibba045.orlgmj (mgr.34412) 10579 : cluster [DBG] pgmap v6024: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:21.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:09:21 gibba045 bash[25517]: cluster 2021-03-10T17:09:19.729031+0000 mgr.gibba045.orlgmj (mgr.34412) 10579 : cluster [DBG] pgmap v6024: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:22.511 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:09:22.738 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:09:22.739 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 2m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:09:22.739 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 64s ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:09:22.739 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 64s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:09:22.740 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 64s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:09:22.740 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:09:22.740 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:09:22.740 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 64s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:09:22.740 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:09:22.741 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 2m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:09:22.741 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 64s ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:09:22.741 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:09:22.741 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:09:22.742 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:09:22.742 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:09:22.742 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 64s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:09:22.742 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 64s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:09:22.742 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 64s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:09:22.743 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 64s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:09:22.743 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 64s ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:09:22.743 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 64s ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:09:22.985 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:09:22.986 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:09:22.986 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:09:22.986 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:09:22.987 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:09:22.987 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:09:22.987 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:09:22.987 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:09:22.987 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:09:22.988 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:09:22.988 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:09:22.988 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:09:22.988 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:09:22.989 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:09:22.989 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:09:23.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:09:23 gibba015 bash[29377]: cluster 2021-03-10T17:09:21.730782+0000 mgr.gibba045.orlgmj (mgr.34412) 10580 : cluster [DBG] pgmap v6025: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:23.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:09:23 gibba015 bash[29377]: audit 2021-03-10T17:09:22.984629+0000 mon.c (mon.1) 2900 : audit [DBG] from='client.? 172.21.2.115:0/1224598379' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:09:23.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:09:23 gibba015 bash[30343]: cluster 2021-03-10T17:09:21.730782+0000 mgr.gibba045.orlgmj (mgr.34412) 10580 : cluster [DBG] pgmap v6025: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:23.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:09:23 gibba015 bash[30343]: audit 2021-03-10T17:09:22.984629+0000 mon.c (mon.1) 2900 : audit [DBG] from='client.? 172.21.2.115:0/1224598379' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:09:23.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:09:23 gibba045 bash[25517]: cluster 2021-03-10T17:09:21.730782+0000 mgr.gibba045.orlgmj (mgr.34412) 10580 : cluster [DBG] pgmap v6025: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:23.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:09:23 gibba045 bash[25517]: audit 2021-03-10T17:09:22.984629+0000 mon.c (mon.1) 2900 : audit [DBG] from='client.? 172.21.2.115:0/1224598379' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:09:24.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:09:24 gibba015 bash[29377]: audit 2021-03-10T17:09:22.503289+0000 mgr.gibba045.orlgmj (mgr.34412) 10581 : audit [DBG] from='client.61132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:09:24.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:09:24 gibba015 bash[29377]: audit 2021-03-10T17:09:22.727423+0000 mgr.gibba045.orlgmj (mgr.34412) 10582 : audit [DBG] from='client.51150 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:09:24.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:09:24 gibba015 bash[30343]: audit 2021-03-10T17:09:22.503289+0000 mgr.gibba045.orlgmj (mgr.34412) 10581 : audit [DBG] from='client.61132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:09:24.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:09:24 gibba015 bash[30343]: audit 2021-03-10T17:09:22.727423+0000 mgr.gibba045.orlgmj (mgr.34412) 10582 : audit [DBG] from='client.51150 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:09:24.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:09:24 gibba045 bash[25517]: audit 2021-03-10T17:09:22.503289+0000 mgr.gibba045.orlgmj (mgr.34412) 10581 : audit [DBG] from='client.61132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:09:24.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:09:24 gibba045 bash[25517]: audit 2021-03-10T17:09:22.727423+0000 mgr.gibba045.orlgmj (mgr.34412) 10582 : audit [DBG] from='client.51150 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:09:25.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:09:25 gibba015 bash[29377]: cluster 2021-03-10T17:09:23.732186+0000 mgr.gibba045.orlgmj (mgr.34412) 10583 : cluster [DBG] pgmap v6026: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:25.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:09:25 gibba015 bash[30343]: cluster 2021-03-10T17:09:23.732186+0000 mgr.gibba045.orlgmj (mgr.34412) 10583 : cluster [DBG] pgmap v6026: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:25.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:09:25 gibba045 bash[25517]: cluster 2021-03-10T17:09:23.732186+0000 mgr.gibba045.orlgmj (mgr.34412) 10583 : cluster [DBG] pgmap v6026: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:26.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:09:26 gibba015 bash[29377]: cluster 2021-03-10T17:09:25.733967+0000 mgr.gibba045.orlgmj (mgr.34412) 10584 : cluster [DBG] pgmap v6027: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:26.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:09:26 gibba015 bash[30343]: cluster 2021-03-10T17:09:25.733967+0000 mgr.gibba045.orlgmj (mgr.34412) 10584 : cluster [DBG] pgmap v6027: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:26.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:09:26 gibba045 bash[25517]: cluster 2021-03-10T17:09:25.733967+0000 mgr.gibba045.orlgmj (mgr.34412) 10584 : cluster [DBG] pgmap v6027: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:29.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:09:29 gibba015 bash[29377]: cluster 2021-03-10T17:09:27.735659+0000 mgr.gibba045.orlgmj (mgr.34412) 10585 : cluster [DBG] pgmap v6028: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:29.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:09:29 gibba015 bash[30343]: cluster 2021-03-10T17:09:27.735659+0000 mgr.gibba045.orlgmj (mgr.34412) 10585 : cluster [DBG] pgmap v6028: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:29.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:09:29 gibba045 bash[25517]: cluster 2021-03-10T17:09:27.735659+0000 mgr.gibba045.orlgmj (mgr.34412) 10585 : cluster [DBG] pgmap v6028: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:30.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:09:30 gibba015 bash[29377]: cluster 2021-03-10T17:09:29.737215+0000 mgr.gibba045.orlgmj (mgr.34412) 10586 : cluster [DBG] pgmap v6029: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:30.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:09:30 gibba015 bash[30343]: cluster 2021-03-10T17:09:29.737215+0000 mgr.gibba045.orlgmj (mgr.34412) 10586 : cluster [DBG] pgmap v6029: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:30.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:09:30 gibba045 bash[25517]: cluster 2021-03-10T17:09:29.737215+0000 mgr.gibba045.orlgmj (mgr.34412) 10586 : cluster [DBG] pgmap v6029: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:33.710 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:09:33 gibba045 bash[25517]: cluster 2021-03-10T17:09:31.738823+0000 mgr.gibba045.orlgmj (mgr.34412) 10587 : cluster [DBG] pgmap v6030: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:33.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:09:33 gibba015 bash[29377]: cluster 2021-03-10T17:09:31.738823+0000 mgr.gibba045.orlgmj (mgr.34412) 10587 : cluster [DBG] pgmap v6030: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:33.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:09:33 gibba015 bash[30343]: cluster 2021-03-10T17:09:31.738823+0000 mgr.gibba045.orlgmj (mgr.34412) 10587 : cluster [DBG] pgmap v6030: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:35.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:09:35 gibba015 bash[29377]: cephadm 2021-03-10T17:09:33.710430+0000 mgr.gibba045.orlgmj (mgr.34412) 10588 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:09:35.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:09:35 gibba015 bash[29377]: cluster 2021-03-10T17:09:33.740060+0000 mgr.gibba045.orlgmj (mgr.34412) 10589 : cluster [DBG] pgmap v6031: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:35.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:09:35 gibba015 bash[30343]: cephadm 2021-03-10T17:09:33.710430+0000 mgr.gibba045.orlgmj (mgr.34412) 10588 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:09:35.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:09:35 gibba015 bash[30343]: cluster 2021-03-10T17:09:33.740060+0000 mgr.gibba045.orlgmj (mgr.34412) 10589 : cluster [DBG] pgmap v6031: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:35.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:09:35 gibba045 bash[25517]: cephadm 2021-03-10T17:09:33.710430+0000 mgr.gibba045.orlgmj (mgr.34412) 10588 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:09:35.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:09:35 gibba045 bash[25517]: cluster 2021-03-10T17:09:33.740060+0000 mgr.gibba045.orlgmj (mgr.34412) 10589 : cluster [DBG] pgmap v6031: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:36.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:09:36 gibba015 bash[29377]: cluster 2021-03-10T17:09:35.741998+0000 mgr.gibba045.orlgmj (mgr.34412) 10590 : cluster [DBG] pgmap v6032: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:36.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:09:36 gibba015 bash[30343]: cluster 2021-03-10T17:09:35.741998+0000 mgr.gibba045.orlgmj (mgr.34412) 10590 : cluster [DBG] pgmap v6032: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:36.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:09:36 gibba045 bash[25517]: cluster 2021-03-10T17:09:35.741998+0000 mgr.gibba045.orlgmj (mgr.34412) 10590 : cluster [DBG] pgmap v6032: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:39.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:09:39 gibba015 bash[29377]: cluster 2021-03-10T17:09:37.743549+0000 mgr.gibba045.orlgmj (mgr.34412) 10591 : cluster [DBG] pgmap v6033: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:39.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:09:39 gibba015 bash[30343]: cluster 2021-03-10T17:09:37.743549+0000 mgr.gibba045.orlgmj (mgr.34412) 10591 : cluster [DBG] pgmap v6033: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:39.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:09:39 gibba045 bash[25517]: cluster 2021-03-10T17:09:37.743549+0000 mgr.gibba045.orlgmj (mgr.34412) 10591 : cluster [DBG] pgmap v6033: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:40.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:09:40 gibba015 bash[29377]: cluster 2021-03-10T17:09:39.745092+0000 mgr.gibba045.orlgmj (mgr.34412) 10592 : cluster [DBG] pgmap v6034: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:40.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:09:40 gibba015 bash[30343]: cluster 2021-03-10T17:09:39.745092+0000 mgr.gibba045.orlgmj (mgr.34412) 10592 : cluster [DBG] pgmap v6034: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:40.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:09:40 gibba045 bash[25517]: cluster 2021-03-10T17:09:39.745092+0000 mgr.gibba045.orlgmj (mgr.34412) 10592 : cluster [DBG] pgmap v6034: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:43.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:09:43 gibba015 bash[29377]: cluster 2021-03-10T17:09:41.746837+0000 mgr.gibba045.orlgmj (mgr.34412) 10593 : cluster [DBG] pgmap v6035: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:43.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:09:43 gibba015 bash[30343]: cluster 2021-03-10T17:09:41.746837+0000 mgr.gibba045.orlgmj (mgr.34412) 10593 : cluster [DBG] pgmap v6035: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:43.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:09:43 gibba045 bash[25517]: cluster 2021-03-10T17:09:41.746837+0000 mgr.gibba045.orlgmj (mgr.34412) 10593 : cluster [DBG] pgmap v6035: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:44.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:09:44 gibba015 bash[29377]: cluster 2021-03-10T17:09:43.747903+0000 mgr.gibba045.orlgmj (mgr.34412) 10594 : cluster [DBG] pgmap v6036: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:44.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:09:44 gibba015 bash[30343]: cluster 2021-03-10T17:09:43.747903+0000 mgr.gibba045.orlgmj (mgr.34412) 10594 : cluster [DBG] pgmap v6036: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:44.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:09:44 gibba045 bash[25517]: cluster 2021-03-10T17:09:43.747903+0000 mgr.gibba045.orlgmj (mgr.34412) 10594 : cluster [DBG] pgmap v6036: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:47.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:09:46 gibba015 bash[29377]: cluster 2021-03-10T17:09:45.749769+0000 mgr.gibba045.orlgmj (mgr.34412) 10595 : cluster [DBG] pgmap v6037: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:47.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:09:46 gibba015 bash[30343]: cluster 2021-03-10T17:09:45.749769+0000 mgr.gibba045.orlgmj (mgr.34412) 10595 : cluster [DBG] pgmap v6037: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:47.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:09:46 gibba045 bash[25517]: cluster 2021-03-10T17:09:45.749769+0000 mgr.gibba045.orlgmj (mgr.34412) 10595 : cluster [DBG] pgmap v6037: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:49.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:09:49 gibba015 bash[29377]: cluster 2021-03-10T17:09:47.751390+0000 mgr.gibba045.orlgmj (mgr.34412) 10596 : cluster [DBG] pgmap v6038: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:49.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:09:49 gibba015 bash[29377]: cephadm 2021-03-10T17:09:48.726349+0000 mgr.gibba045.orlgmj (mgr.34412) 10597 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:09:49.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:09:49 gibba015 bash[30343]: cluster 2021-03-10T17:09:47.751390+0000 mgr.gibba045.orlgmj (mgr.34412) 10596 : cluster [DBG] pgmap v6038: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:49.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:09:49 gibba015 bash[30343]: cephadm 2021-03-10T17:09:48.726349+0000 mgr.gibba045.orlgmj (mgr.34412) 10597 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:09:49.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:09:49 gibba045 bash[25517]: cluster 2021-03-10T17:09:47.751390+0000 mgr.gibba045.orlgmj (mgr.34412) 10596 : cluster [DBG] pgmap v6038: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:49.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:09:49 gibba045 bash[25517]: cephadm 2021-03-10T17:09:48.726349+0000 mgr.gibba045.orlgmj (mgr.34412) 10597 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:09:50.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:09:50 gibba015 bash[29377]: cluster 2021-03-10T17:09:49.752985+0000 mgr.gibba045.orlgmj (mgr.34412) 10598 : cluster [DBG] pgmap v6039: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:50.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:09:50 gibba015 bash[30343]: cluster 2021-03-10T17:09:49.752985+0000 mgr.gibba045.orlgmj (mgr.34412) 10598 : cluster [DBG] pgmap v6039: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:50.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:09:50 gibba045 bash[25517]: cluster 2021-03-10T17:09:49.752985+0000 mgr.gibba045.orlgmj (mgr.34412) 10598 : cluster [DBG] pgmap v6039: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:53.233 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:09:53.459 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:09:53.460 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 2m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:09:53.460 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 95s ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:09:53.460 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 95s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:09:53.460 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 95s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:09:53.461 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:09:53.461 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:09:53.461 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 95s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:09:53.461 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:09:53.461 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 2m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:09:53.462 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 95s ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:09:53.462 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:09:53.462 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:09:53.462 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:09:53.463 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:09:53.463 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 95s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:09:53.463 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 95s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:09:53.463 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 95s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:09:53.463 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 95s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:09:53.464 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 95s ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:09:53.464 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 95s ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:09:53.707 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:09:53.708 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:09:53.708 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:09:53.708 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:09:53.708 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:09:53.708 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:09:53.709 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:09:53.709 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:09:53.709 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:09:53.709 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:09:53.710 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:09:53.710 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:09:53.710 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:09:53.710 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:09:53.710 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:09:53.720 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:09:53 gibba015 bash[29377]: cluster 2021-03-10T17:09:51.754715+0000 mgr.gibba045.orlgmj (mgr.34412) 10599 : cluster [DBG] pgmap v6040: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:53.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:09:53 gibba015 bash[30343]: cluster 2021-03-10T17:09:51.754715+0000 mgr.gibba045.orlgmj (mgr.34412) 10599 : cluster [DBG] pgmap v6040: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:53.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:09:53 gibba045 bash[25517]: cluster 2021-03-10T17:09:51.754715+0000 mgr.gibba045.orlgmj (mgr.34412) 10599 : cluster [DBG] pgmap v6040: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:09:54 gibba015 bash[29377]: audit 2021-03-10T17:09:53.220607+0000 mgr.gibba045.orlgmj (mgr.34412) 10600 : audit [DBG] from='client.61150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:09:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:09:54 gibba015 bash[29377]: audit 2021-03-10T17:09:53.448678+0000 mgr.gibba045.orlgmj (mgr.34412) 10601 : audit [DBG] from='client.61156 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:09:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:09:54 gibba015 bash[29377]: audit 2021-03-10T17:09:53.706338+0000 mon.a (mon.0) 2265 : audit [DBG] from='client.? 172.21.2.115:0/961171457' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:09:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:09:54 gibba015 bash[29377]: cluster 2021-03-10T17:09:53.756164+0000 mgr.gibba045.orlgmj (mgr.34412) 10602 : cluster [DBG] pgmap v6041: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:54.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:09:54 gibba015 bash[29377]: audit 2021-03-10T17:09:53.893632+0000 mon.c (mon.1) 2901 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:09:54.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:09:54 gibba015 bash[29377]: audit 2021-03-10T17:09:53.894759+0000 mon.a (mon.0) 2266 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:09:54.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:09:54 gibba015 bash[29377]: audit 2021-03-10T17:09:53.896100+0000 mon.c (mon.1) 2902 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:09:54.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:09:54 gibba015 bash[29377]: audit 2021-03-10T17:09:53.897148+0000 mon.a (mon.0) 2267 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:09:54.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:09:54 gibba015 bash[29377]: audit 2021-03-10T17:09:53.970351+0000 mon.c (mon.1) 2903 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T17:09:54.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:09:54 gibba015 bash[29377]: audit 2021-03-10T17:09:53.971139+0000 mon.c (mon.1) 2904 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T17:09:54.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:09:54 gibba015 bash[29377]: audit 2021-03-10T17:09:53.971740+0000 mon.a (mon.0) 2268 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T17:09:54.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:09:54 gibba015 bash[29377]: audit 2021-03-10T17:09:53.972268+0000 mon.c (mon.1) 2905 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:09:54.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:09:54 gibba015 bash[29377]: audit 2021-03-10T17:09:53.973746+0000 mon.c (mon.1) 2906 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T17:09:54.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:09:54 gibba015 bash[29377]: audit 2021-03-10T17:09:53.973884+0000 mon.a (mon.0) 2269 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T17:09:54.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:09:54 gibba015 bash[29377]: audit 2021-03-10T17:09:53.975611+0000 mon.a (mon.0) 2270 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:09:54.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:09:54 gibba015 bash[29377]: audit 2021-03-10T17:09:53.976110+0000 mon.a (mon.0) 2271 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T17:09:54.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:09:54 gibba015 bash[30343]: audit 2021-03-10T17:09:53.220607+0000 mgr.gibba045.orlgmj (mgr.34412) 10600 : audit [DBG] from='client.61150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:09:54.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:09:54 gibba015 bash[30343]: audit 2021-03-10T17:09:53.448678+0000 mgr.gibba045.orlgmj (mgr.34412) 10601 : audit [DBG] from='client.61156 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:09:54.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:09:54 gibba015 bash[30343]: audit 2021-03-10T17:09:53.706338+0000 mon.a (mon.0) 2265 : audit [DBG] from='client.? 172.21.2.115:0/961171457' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:09:54.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:09:54 gibba015 bash[30343]: cluster 2021-03-10T17:09:53.756164+0000 mgr.gibba045.orlgmj (mgr.34412) 10602 : cluster [DBG] pgmap v6041: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:54.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:09:54 gibba015 bash[30343]: audit 2021-03-10T17:09:53.893632+0000 mon.c (mon.1) 2901 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:09:54.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:09:54 gibba015 bash[30343]: audit 2021-03-10T17:09:53.894759+0000 mon.a (mon.0) 2266 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:09:54.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:09:54 gibba015 bash[30343]: audit 2021-03-10T17:09:53.896100+0000 mon.c (mon.1) 2902 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:09:54.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:09:54 gibba015 bash[30343]: audit 2021-03-10T17:09:53.897148+0000 mon.a (mon.0) 2267 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:09:54.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:09:54 gibba015 bash[30343]: audit 2021-03-10T17:09:53.970351+0000 mon.c (mon.1) 2903 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T17:09:54.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:09:54 gibba015 bash[30343]: audit 2021-03-10T17:09:53.971139+0000 mon.c (mon.1) 2904 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T17:09:54.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:09:54 gibba015 bash[30343]: audit 2021-03-10T17:09:53.971740+0000 mon.a (mon.0) 2268 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T17:09:54.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:09:54 gibba015 bash[30343]: audit 2021-03-10T17:09:53.972268+0000 mon.c (mon.1) 2905 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:09:54.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:09:54 gibba015 bash[30343]: audit 2021-03-10T17:09:53.973746+0000 mon.c (mon.1) 2906 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T17:09:54.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:09:54 gibba015 bash[30343]: audit 2021-03-10T17:09:53.973884+0000 mon.a (mon.0) 2269 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T17:09:54.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:09:54 gibba015 bash[30343]: audit 2021-03-10T17:09:53.975611+0000 mon.a (mon.0) 2270 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:09:54.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:09:54 gibba015 bash[30343]: audit 2021-03-10T17:09:53.976110+0000 mon.a (mon.0) 2271 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T17:09:54.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:09:54 gibba045 bash[25517]: audit 2021-03-10T17:09:53.220607+0000 mgr.gibba045.orlgmj (mgr.34412) 10600 : audit [DBG] from='client.61150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:09:54.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:09:54 gibba045 bash[25517]: audit 2021-03-10T17:09:53.448678+0000 mgr.gibba045.orlgmj (mgr.34412) 10601 : audit [DBG] from='client.61156 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:09:54.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:09:54 gibba045 bash[25517]: audit 2021-03-10T17:09:53.706338+0000 mon.a (mon.0) 2265 : audit [DBG] from='client.? 172.21.2.115:0/961171457' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:09:54.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:09:54 gibba045 bash[25517]: cluster 2021-03-10T17:09:53.756164+0000 mgr.gibba045.orlgmj (mgr.34412) 10602 : cluster [DBG] pgmap v6041: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:54.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:09:54 gibba045 bash[25517]: audit 2021-03-10T17:09:53.893632+0000 mon.c (mon.1) 2901 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:09:54.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:09:54 gibba045 bash[25517]: audit 2021-03-10T17:09:53.894759+0000 mon.a (mon.0) 2266 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:09:54.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:09:54 gibba045 bash[25517]: audit 2021-03-10T17:09:53.896100+0000 mon.c (mon.1) 2902 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:09:54.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:09:54 gibba045 bash[25517]: audit 2021-03-10T17:09:53.897148+0000 mon.a (mon.0) 2267 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:09:54.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:09:54 gibba045 bash[25517]: audit 2021-03-10T17:09:53.970351+0000 mon.c (mon.1) 2903 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T17:09:54.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:09:54 gibba045 bash[25517]: audit 2021-03-10T17:09:53.971139+0000 mon.c (mon.1) 2904 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T17:09:54.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:09:54 gibba045 bash[25517]: audit 2021-03-10T17:09:53.971740+0000 mon.a (mon.0) 2268 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T17:09:54.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:09:54 gibba045 bash[25517]: audit 2021-03-10T17:09:53.972268+0000 mon.c (mon.1) 2905 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:09:54.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:09:54 gibba045 bash[25517]: audit 2021-03-10T17:09:53.973746+0000 mon.c (mon.1) 2906 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T17:09:54.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:09:54 gibba045 bash[25517]: audit 2021-03-10T17:09:53.973884+0000 mon.a (mon.0) 2269 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T17:09:54.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:09:54 gibba045 bash[25517]: audit 2021-03-10T17:09:53.975611+0000 mon.a (mon.0) 2270 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:09:54.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:09:54 gibba045 bash[25517]: audit 2021-03-10T17:09:53.976110+0000 mon.a (mon.0) 2271 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T17:09:57.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:09:56 gibba015 bash[29377]: cluster 2021-03-10T17:09:55.757782+0000 mgr.gibba045.orlgmj (mgr.34412) 10603 : cluster [DBG] pgmap v6042: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:57.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:09:56 gibba015 bash[30343]: cluster 2021-03-10T17:09:55.757782+0000 mgr.gibba045.orlgmj (mgr.34412) 10603 : cluster [DBG] pgmap v6042: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:57.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:09:56 gibba045 bash[25517]: cluster 2021-03-10T17:09:55.757782+0000 mgr.gibba045.orlgmj (mgr.34412) 10603 : cluster [DBG] pgmap v6042: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:58.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:09:58 gibba015 bash[29377]: cluster 2021-03-10T17:09:57.759342+0000 mgr.gibba045.orlgmj (mgr.34412) 10604 : cluster [DBG] pgmap v6043: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:58.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:09:58 gibba015 bash[30343]: cluster 2021-03-10T17:09:57.759342+0000 mgr.gibba045.orlgmj (mgr.34412) 10604 : cluster [DBG] pgmap v6043: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:58.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:09:58 gibba045 bash[25517]: cluster 2021-03-10T17:09:57.759342+0000 mgr.gibba045.orlgmj (mgr.34412) 10604 : cluster [DBG] pgmap v6043: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:00.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:10:00 gibba015 bash[29377]: debug 2021-03-10T17:09:59.993+0000 7f21beb4f700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T17:10:01.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:10:00 gibba015 bash[29377]: cluster 2021-03-10T17:09:59.761160+0000 mgr.gibba045.orlgmj (mgr.34412) 10605 : cluster [DBG] pgmap v6044: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:01.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:10:00 gibba015 bash[29377]: cluster 2021-03-10T17:10:00.000192+0000 mon.a (mon.0) 2272 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T17:10:01.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:10:00 gibba015 bash[30343]: cluster 2021-03-10T17:09:59.761160+0000 mgr.gibba045.orlgmj (mgr.34412) 10605 : cluster [DBG] pgmap v6044: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:01.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:10:00 gibba015 bash[30343]: cluster 2021-03-10T17:10:00.000192+0000 mon.a (mon.0) 2272 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T17:10:01.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:10:00 gibba045 bash[25517]: cluster 2021-03-10T17:09:59.761160+0000 mgr.gibba045.orlgmj (mgr.34412) 10605 : cluster [DBG] pgmap v6044: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:01.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:10:00 gibba045 bash[25517]: cluster 2021-03-10T17:10:00.000192+0000 mon.a (mon.0) 2272 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T17:10:03.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:10:03 gibba015 bash[29377]: cluster 2021-03-10T17:10:01.762907+0000 mgr.gibba045.orlgmj (mgr.34412) 10606 : cluster [DBG] pgmap v6045: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:03.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:10:03 gibba015 bash[30343]: cluster 2021-03-10T17:10:01.762907+0000 mgr.gibba045.orlgmj (mgr.34412) 10606 : cluster [DBG] pgmap v6045: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:03.740 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:10:03 gibba045 bash[25517]: cluster 2021-03-10T17:10:01.762907+0000 mgr.gibba045.orlgmj (mgr.34412) 10606 : cluster [DBG] pgmap v6045: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:04.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:10:04 gibba015 bash[29377]: cephadm 2021-03-10T17:10:03.741387+0000 mgr.gibba045.orlgmj (mgr.34412) 10607 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:10:04.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:10:04 gibba015 bash[29377]: cluster 2021-03-10T17:10:03.764135+0000 mgr.gibba045.orlgmj (mgr.34412) 10608 : cluster [DBG] pgmap v6046: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:04.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:10:04 gibba015 bash[30343]: cephadm 2021-03-10T17:10:03.741387+0000 mgr.gibba045.orlgmj (mgr.34412) 10607 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:10:04.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:10:04 gibba015 bash[30343]: cluster 2021-03-10T17:10:03.764135+0000 mgr.gibba045.orlgmj (mgr.34412) 10608 : cluster [DBG] pgmap v6046: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:04.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:10:04 gibba045 bash[25517]: cephadm 2021-03-10T17:10:03.741387+0000 mgr.gibba045.orlgmj (mgr.34412) 10607 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:10:04.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:10:04 gibba045 bash[25517]: cluster 2021-03-10T17:10:03.764135+0000 mgr.gibba045.orlgmj (mgr.34412) 10608 : cluster [DBG] pgmap v6046: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:07.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:10:06 gibba015 bash[29377]: cluster 2021-03-10T17:10:05.765968+0000 mgr.gibba045.orlgmj (mgr.34412) 10609 : cluster [DBG] pgmap v6047: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:07.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:10:06 gibba015 bash[30343]: cluster 2021-03-10T17:10:05.765968+0000 mgr.gibba045.orlgmj (mgr.34412) 10609 : cluster [DBG] pgmap v6047: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:07.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:10:06 gibba045 bash[25517]: cluster 2021-03-10T17:10:05.765968+0000 mgr.gibba045.orlgmj (mgr.34412) 10609 : cluster [DBG] pgmap v6047: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:08.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:10:08 gibba015 bash[29377]: cluster 2021-03-10T17:10:07.767656+0000 mgr.gibba045.orlgmj (mgr.34412) 10610 : cluster [DBG] pgmap v6048: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:08.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:10:08 gibba015 bash[30343]: cluster 2021-03-10T17:10:07.767656+0000 mgr.gibba045.orlgmj (mgr.34412) 10610 : cluster [DBG] pgmap v6048: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:08.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:10:08 gibba045 bash[25517]: cluster 2021-03-10T17:10:07.767656+0000 mgr.gibba045.orlgmj (mgr.34412) 10610 : cluster [DBG] pgmap v6048: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:11.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:10:10 gibba015 bash[29377]: cluster 2021-03-10T17:10:09.769355+0000 mgr.gibba045.orlgmj (mgr.34412) 10611 : cluster [DBG] pgmap v6049: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:11.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:10:10 gibba015 bash[30343]: cluster 2021-03-10T17:10:09.769355+0000 mgr.gibba045.orlgmj (mgr.34412) 10611 : cluster [DBG] pgmap v6049: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:11.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:10:10 gibba045 bash[25517]: cluster 2021-03-10T17:10:09.769355+0000 mgr.gibba045.orlgmj (mgr.34412) 10611 : cluster [DBG] pgmap v6049: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:13.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:10:13 gibba015 bash[29377]: cluster 2021-03-10T17:10:11.771087+0000 mgr.gibba045.orlgmj (mgr.34412) 10612 : cluster [DBG] pgmap v6050: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:13.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:10:13 gibba015 bash[30343]: cluster 2021-03-10T17:10:11.771087+0000 mgr.gibba045.orlgmj (mgr.34412) 10612 : cluster [DBG] pgmap v6050: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:13.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:10:13 gibba045 bash[25517]: cluster 2021-03-10T17:10:11.771087+0000 mgr.gibba045.orlgmj (mgr.34412) 10612 : cluster [DBG] pgmap v6050: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:14.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:10:14 gibba015 bash[29377]: cluster 2021-03-10T17:10:13.772472+0000 mgr.gibba045.orlgmj (mgr.34412) 10613 : cluster [DBG] pgmap v6051: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:14.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:10:14 gibba015 bash[30343]: cluster 2021-03-10T17:10:13.772472+0000 mgr.gibba045.orlgmj (mgr.34412) 10613 : cluster [DBG] pgmap v6051: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:14.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:10:14 gibba045 bash[25517]: cluster 2021-03-10T17:10:13.772472+0000 mgr.gibba045.orlgmj (mgr.34412) 10613 : cluster [DBG] pgmap v6051: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:17.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:10:16 gibba015 bash[29377]: cluster 2021-03-10T17:10:15.774156+0000 mgr.gibba045.orlgmj (mgr.34412) 10614 : cluster [DBG] pgmap v6052: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:17.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:10:16 gibba015 bash[30343]: cluster 2021-03-10T17:10:15.774156+0000 mgr.gibba045.orlgmj (mgr.34412) 10614 : cluster [DBG] pgmap v6052: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:17.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:10:16 gibba045 bash[25517]: cluster 2021-03-10T17:10:15.774156+0000 mgr.gibba045.orlgmj (mgr.34412) 10614 : cluster [DBG] pgmap v6052: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:18.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:10:18 gibba015 bash[29377]: cluster 2021-03-10T17:10:17.775793+0000 mgr.gibba045.orlgmj (mgr.34412) 10615 : cluster [DBG] pgmap v6053: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:18.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:10:18 gibba015 bash[30343]: cluster 2021-03-10T17:10:17.775793+0000 mgr.gibba045.orlgmj (mgr.34412) 10615 : cluster [DBG] pgmap v6053: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:18.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:10:18 gibba045 bash[25517]: cluster 2021-03-10T17:10:17.775793+0000 mgr.gibba045.orlgmj (mgr.34412) 10615 : cluster [DBG] pgmap v6053: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:19.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:10:19 gibba015 bash[29377]: audit 2021-03-10T17:10:18.756088+0000 mon.c (mon.1) 2907 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:10:19.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:10:19 gibba015 bash[29377]: cephadm 2021-03-10T17:10:18.763553+0000 mgr.gibba045.orlgmj (mgr.34412) 10616 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:10:19.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:10:19 gibba015 bash[29377]: cephadm 2021-03-10T17:10:18.765623+0000 mgr.gibba045.orlgmj (mgr.34412) 10617 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:10:19.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:10:19 gibba015 bash[29377]: audit 2021-03-10T17:10:18.981289+0000 mon.a (mon.0) 2273 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:10:19.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:10:19 gibba015 bash[29377]: audit 2021-03-10T17:10:18.984920+0000 mon.c (mon.1) 2908 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:10:19.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:10:19 gibba015 bash[29377]: cephadm 2021-03-10T17:10:18.986402+0000 mgr.gibba045.orlgmj (mgr.34412) 10618 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:10:19.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:10:19 gibba015 bash[29377]: audit 2021-03-10T17:10:18.986425+0000 mon.c (mon.1) 2909 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:10:19.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:10:19 gibba015 bash[29377]: audit 2021-03-10T17:10:18.988076+0000 mon.c (mon.1) 2910 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:10:19.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:10:19 gibba015 bash[29377]: cephadm 2021-03-10T17:10:18.988101+0000 mgr.gibba045.orlgmj (mgr.34412) 10619 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:10:19.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:10:19 gibba015 bash[29377]: audit 2021-03-10T17:10:18.989410+0000 mon.c (mon.1) 2911 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:10:19.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:10:19 gibba015 bash[29377]: cephadm 2021-03-10T17:10:18.989635+0000 mgr.gibba045.orlgmj (mgr.34412) 10620 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:10:19.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:10:19 gibba015 bash[29377]: cephadm 2021-03-10T17:10:18.989674+0000 mgr.gibba045.orlgmj (mgr.34412) 10621 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:10:19.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:10:19 gibba015 bash[29377]: cephadm 2021-03-10T17:10:18.991254+0000 mgr.gibba045.orlgmj (mgr.34412) 10622 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:10:19.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:10:19 gibba015 bash[29377]: cephadm 2021-03-10T17:10:18.991293+0000 mgr.gibba045.orlgmj (mgr.34412) 10623 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:10:19.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:10:19 gibba015 bash[29377]: cephadm 2021-03-10T17:10:18.992539+0000 mgr.gibba045.orlgmj (mgr.34412) 10624 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:10:19.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:10:19 gibba015 bash[29377]: audit 2021-03-10T17:10:18.992919+0000 mon.c (mon.1) 2912 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:10:19.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:10:19 gibba015 bash[29377]: audit 2021-03-10T17:10:18.994346+0000 mon.c (mon.1) 2913 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:10:19.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:10:19 gibba015 bash[29377]: cephadm 2021-03-10T17:10:18.994491+0000 mgr.gibba045.orlgmj (mgr.34412) 10625 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:10:19.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:10:19 gibba015 bash[29377]: cephadm 2021-03-10T17:10:18.994527+0000 mgr.gibba045.orlgmj (mgr.34412) 10626 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:10:19.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:10:19 gibba015 bash[29377]: cephadm 2021-03-10T17:10:18.995931+0000 mgr.gibba045.orlgmj (mgr.34412) 10627 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:10:19.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:10:19 gibba015 bash[30343]: audit 2021-03-10T17:10:18.756088+0000 mon.c (mon.1) 2907 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:10:19.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:10:19 gibba015 bash[30343]: cephadm 2021-03-10T17:10:18.763553+0000 mgr.gibba045.orlgmj (mgr.34412) 10616 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:10:19.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:10:19 gibba015 bash[30343]: cephadm 2021-03-10T17:10:18.765623+0000 mgr.gibba045.orlgmj (mgr.34412) 10617 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:10:19.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:10:19 gibba015 bash[30343]: audit 2021-03-10T17:10:18.981289+0000 mon.a (mon.0) 2273 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:10:19.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:10:19 gibba015 bash[30343]: audit 2021-03-10T17:10:18.984920+0000 mon.c (mon.1) 2908 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:10:19.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:10:19 gibba015 bash[30343]: cephadm 2021-03-10T17:10:18.986402+0000 mgr.gibba045.orlgmj (mgr.34412) 10618 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:10:19.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:10:19 gibba015 bash[30343]: audit 2021-03-10T17:10:18.986425+0000 mon.c (mon.1) 2909 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:10:19.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:10:19 gibba015 bash[30343]: audit 2021-03-10T17:10:18.988076+0000 mon.c (mon.1) 2910 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:10:19.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:10:19 gibba015 bash[30343]: cephadm 2021-03-10T17:10:18.988101+0000 mgr.gibba045.orlgmj (mgr.34412) 10619 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:10:19.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:10:19 gibba015 bash[30343]: audit 2021-03-10T17:10:18.989410+0000 mon.c (mon.1) 2911 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:10:19.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:10:19 gibba015 bash[30343]: cephadm 2021-03-10T17:10:18.989635+0000 mgr.gibba045.orlgmj (mgr.34412) 10620 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:10:19.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:10:19 gibba015 bash[30343]: cephadm 2021-03-10T17:10:18.989674+0000 mgr.gibba045.orlgmj (mgr.34412) 10621 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:10:19.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:10:19 gibba015 bash[30343]: cephadm 2021-03-10T17:10:18.991254+0000 mgr.gibba045.orlgmj (mgr.34412) 10622 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:10:19.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:10:19 gibba015 bash[30343]: cephadm 2021-03-10T17:10:18.991293+0000 mgr.gibba045.orlgmj (mgr.34412) 10623 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:10:19.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:10:19 gibba015 bash[30343]: cephadm 2021-03-10T17:10:18.992539+0000 mgr.gibba045.orlgmj (mgr.34412) 10624 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:10:19.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:10:19 gibba015 bash[30343]: audit 2021-03-10T17:10:18.992919+0000 mon.c (mon.1) 2912 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:10:19.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:10:19 gibba015 bash[30343]: audit 2021-03-10T17:10:18.994346+0000 mon.c (mon.1) 2913 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:10:19.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:10:19 gibba015 bash[30343]: cephadm 2021-03-10T17:10:18.994491+0000 mgr.gibba045.orlgmj (mgr.34412) 10625 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:10:19.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:10:19 gibba015 bash[30343]: cephadm 2021-03-10T17:10:18.994527+0000 mgr.gibba045.orlgmj (mgr.34412) 10626 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:10:19.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:10:19 gibba015 bash[30343]: cephadm 2021-03-10T17:10:18.995931+0000 mgr.gibba045.orlgmj (mgr.34412) 10627 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:10:19.732 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:10:19 gibba015 bash[29377]: cephadm 2021-03-10T17:10:18.996247+0000 mgr.gibba045.orlgmj (mgr.34412) 10628 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:10:19.732 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:10:19 gibba015 bash[29377]: cephadm 2021-03-10T17:10:18.997549+0000 mgr.gibba045.orlgmj (mgr.34412) 10629 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:10:19.732 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:10:19 gibba015 bash[29377]: cephadm 2021-03-10T17:10:18.997585+0000 mgr.gibba045.orlgmj (mgr.34412) 10630 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:10:19.732 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:10:19 gibba015 bash[29377]: cephadm 2021-03-10T17:10:18.997692+0000 mgr.gibba045.orlgmj (mgr.34412) 10631 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:10:19.733 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:10:19 gibba015 bash[30343]: cephadm 2021-03-10T17:10:18.996247+0000 mgr.gibba045.orlgmj (mgr.34412) 10628 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:10:19.733 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:10:19 gibba015 bash[30343]: cephadm 2021-03-10T17:10:18.997549+0000 mgr.gibba045.orlgmj (mgr.34412) 10629 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:10:19.733 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:10:19 gibba015 bash[30343]: cephadm 2021-03-10T17:10:18.997585+0000 mgr.gibba045.orlgmj (mgr.34412) 10630 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:10:19.734 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:10:19 gibba015 bash[30343]: cephadm 2021-03-10T17:10:18.997692+0000 mgr.gibba045.orlgmj (mgr.34412) 10631 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:10:19.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:10:19 gibba045 bash[25517]: audit 2021-03-10T17:10:18.756088+0000 mon.c (mon.1) 2907 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:10:19.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:10:19 gibba045 bash[25517]: cephadm 2021-03-10T17:10:18.763553+0000 mgr.gibba045.orlgmj (mgr.34412) 10616 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:10:19.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:10:19 gibba045 bash[25517]: cephadm 2021-03-10T17:10:18.765623+0000 mgr.gibba045.orlgmj (mgr.34412) 10617 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:10:19.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:10:19 gibba045 bash[25517]: audit 2021-03-10T17:10:18.981289+0000 mon.a (mon.0) 2273 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:10:19.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:10:19 gibba045 bash[25517]: audit 2021-03-10T17:10:18.984920+0000 mon.c (mon.1) 2908 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:10:19.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:10:19 gibba045 bash[25517]: cephadm 2021-03-10T17:10:18.986402+0000 mgr.gibba045.orlgmj (mgr.34412) 10618 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:10:19.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:10:19 gibba045 bash[25517]: audit 2021-03-10T17:10:18.986425+0000 mon.c (mon.1) 2909 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:10:19.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:10:19 gibba045 bash[25517]: audit 2021-03-10T17:10:18.988076+0000 mon.c (mon.1) 2910 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:10:19.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:10:19 gibba045 bash[25517]: cephadm 2021-03-10T17:10:18.988101+0000 mgr.gibba045.orlgmj (mgr.34412) 10619 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:10:19.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:10:19 gibba045 bash[25517]: audit 2021-03-10T17:10:18.989410+0000 mon.c (mon.1) 2911 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:10:19.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:10:19 gibba045 bash[25517]: cephadm 2021-03-10T17:10:18.989635+0000 mgr.gibba045.orlgmj (mgr.34412) 10620 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:10:19.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:10:19 gibba045 bash[25517]: cephadm 2021-03-10T17:10:18.989674+0000 mgr.gibba045.orlgmj (mgr.34412) 10621 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:10:19.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:10:19 gibba045 bash[25517]: cephadm 2021-03-10T17:10:18.991254+0000 mgr.gibba045.orlgmj (mgr.34412) 10622 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:10:19.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:10:19 gibba045 bash[25517]: cephadm 2021-03-10T17:10:18.991293+0000 mgr.gibba045.orlgmj (mgr.34412) 10623 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:10:19.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:10:19 gibba045 bash[25517]: cephadm 2021-03-10T17:10:18.992539+0000 mgr.gibba045.orlgmj (mgr.34412) 10624 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:10:19.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:10:19 gibba045 bash[25517]: audit 2021-03-10T17:10:18.992919+0000 mon.c (mon.1) 2912 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:10:19.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:10:19 gibba045 bash[25517]: audit 2021-03-10T17:10:18.994346+0000 mon.c (mon.1) 2913 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:10:19.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:10:19 gibba045 bash[25517]: cephadm 2021-03-10T17:10:18.994491+0000 mgr.gibba045.orlgmj (mgr.34412) 10625 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:10:19.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:10:19 gibba045 bash[25517]: cephadm 2021-03-10T17:10:18.994527+0000 mgr.gibba045.orlgmj (mgr.34412) 10626 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:10:19.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:10:19 gibba045 bash[25517]: cephadm 2021-03-10T17:10:18.995931+0000 mgr.gibba045.orlgmj (mgr.34412) 10627 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:10:19.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:10:19 gibba045 bash[25517]: cephadm 2021-03-10T17:10:18.996247+0000 mgr.gibba045.orlgmj (mgr.34412) 10628 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:10:19.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:10:19 gibba045 bash[25517]: cephadm 2021-03-10T17:10:18.997549+0000 mgr.gibba045.orlgmj (mgr.34412) 10629 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:10:19.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:10:19 gibba045 bash[25517]: cephadm 2021-03-10T17:10:18.997585+0000 mgr.gibba045.orlgmj (mgr.34412) 10630 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:10:19.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:10:19 gibba045 bash[25517]: cephadm 2021-03-10T17:10:18.997692+0000 mgr.gibba045.orlgmj (mgr.34412) 10631 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:10:20.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:10:20 gibba015 bash[29377]: cluster 2021-03-10T17:10:19.777347+0000 mgr.gibba045.orlgmj (mgr.34412) 10632 : cluster [DBG] pgmap v6054: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:20.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:10:20 gibba015 bash[30343]: cluster 2021-03-10T17:10:19.777347+0000 mgr.gibba045.orlgmj (mgr.34412) 10632 : cluster [DBG] pgmap v6054: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:20.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:10:20 gibba045 bash[25517]: cluster 2021-03-10T17:10:19.777347+0000 mgr.gibba045.orlgmj (mgr.34412) 10632 : cluster [DBG] pgmap v6054: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:23.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:10:22 gibba015 bash[29377]: cluster 2021-03-10T17:10:21.779115+0000 mgr.gibba045.orlgmj (mgr.34412) 10633 : cluster [DBG] pgmap v6055: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:23.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:10:22 gibba015 bash[30343]: cluster 2021-03-10T17:10:21.779115+0000 mgr.gibba045.orlgmj (mgr.34412) 10633 : cluster [DBG] pgmap v6055: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:23.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:10:22 gibba045 bash[25517]: cluster 2021-03-10T17:10:21.779115+0000 mgr.gibba045.orlgmj (mgr.34412) 10633 : cluster [DBG] pgmap v6055: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:23.947 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:10:24.174 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:10:24.174 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 3m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:10:24.175 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 2m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:10:24.175 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:10:24.175 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:10:24.176 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:10:24.176 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:10:24.176 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:10:24.176 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:10:24.176 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 3m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:10:24.177 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 2m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:10:24.177 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:10:24.178 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:10:24.178 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:10:24.178 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:10:24.179 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:10:24.179 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:10:24.179 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:10:24.180 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:10:24.180 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 2m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:10:24.180 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 2m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:10:24.423 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:10:24.424 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:10:24.424 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:10:24.424 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:10:24.424 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:10:24.425 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:10:24.425 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:10:24.425 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:10:24.425 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:10:24.426 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:10:24.426 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:10:24.426 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:10:24.426 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:10:24.426 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:10:24.427 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:10:25.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:10:24 gibba015 bash[29377]: cluster 2021-03-10T17:10:23.780539+0000 mgr.gibba045.orlgmj (mgr.34412) 10634 : cluster [DBG] pgmap v6056: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:25.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:10:24 gibba015 bash[29377]: audit 2021-03-10T17:10:23.939744+0000 mgr.gibba045.orlgmj (mgr.34412) 10635 : audit [DBG] from='client.61168 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:10:25.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:10:24 gibba015 bash[29377]: audit 2021-03-10T17:10:24.161981+0000 mgr.gibba045.orlgmj (mgr.34412) 10636 : audit [DBG] from='client.51186 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:10:25.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:10:24 gibba015 bash[29377]: audit 2021-03-10T17:10:24.422431+0000 mon.c (mon.1) 2914 : audit [DBG] from='client.? 172.21.2.115:0/1058118230' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:10:25.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:10:24 gibba015 bash[30343]: cluster 2021-03-10T17:10:23.780539+0000 mgr.gibba045.orlgmj (mgr.34412) 10634 : cluster [DBG] pgmap v6056: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:25.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:10:24 gibba015 bash[30343]: audit 2021-03-10T17:10:23.939744+0000 mgr.gibba045.orlgmj (mgr.34412) 10635 : audit [DBG] from='client.61168 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:10:25.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:10:24 gibba015 bash[30343]: audit 2021-03-10T17:10:24.161981+0000 mgr.gibba045.orlgmj (mgr.34412) 10636 : audit [DBG] from='client.51186 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:10:25.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:10:24 gibba015 bash[30343]: audit 2021-03-10T17:10:24.422431+0000 mon.c (mon.1) 2914 : audit [DBG] from='client.? 172.21.2.115:0/1058118230' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:10:25.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:10:24 gibba045 bash[25517]: cluster 2021-03-10T17:10:23.780539+0000 mgr.gibba045.orlgmj (mgr.34412) 10634 : cluster [DBG] pgmap v6056: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:25.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:10:24 gibba045 bash[25517]: audit 2021-03-10T17:10:23.939744+0000 mgr.gibba045.orlgmj (mgr.34412) 10635 : audit [DBG] from='client.61168 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:10:25.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:10:24 gibba045 bash[25517]: audit 2021-03-10T17:10:24.161981+0000 mgr.gibba045.orlgmj (mgr.34412) 10636 : audit [DBG] from='client.51186 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:10:25.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:10:24 gibba045 bash[25517]: audit 2021-03-10T17:10:24.422431+0000 mon.c (mon.1) 2914 : audit [DBG] from='client.? 172.21.2.115:0/1058118230' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:10:27.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:10:26 gibba015 bash[29377]: cluster 2021-03-10T17:10:25.782192+0000 mgr.gibba045.orlgmj (mgr.34412) 10637 : cluster [DBG] pgmap v6057: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:27.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:10:26 gibba015 bash[30343]: cluster 2021-03-10T17:10:25.782192+0000 mgr.gibba045.orlgmj (mgr.34412) 10637 : cluster [DBG] pgmap v6057: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:27.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:10:26 gibba045 bash[25517]: cluster 2021-03-10T17:10:25.782192+0000 mgr.gibba045.orlgmj (mgr.34412) 10637 : cluster [DBG] pgmap v6057: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:28.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:10:28 gibba015 bash[29377]: cluster 2021-03-10T17:10:27.783781+0000 mgr.gibba045.orlgmj (mgr.34412) 10638 : cluster [DBG] pgmap v6058: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:28.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:10:28 gibba015 bash[30343]: cluster 2021-03-10T17:10:27.783781+0000 mgr.gibba045.orlgmj (mgr.34412) 10638 : cluster [DBG] pgmap v6058: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:28.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:10:28 gibba045 bash[25517]: cluster 2021-03-10T17:10:27.783781+0000 mgr.gibba045.orlgmj (mgr.34412) 10638 : cluster [DBG] pgmap v6058: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:31.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:10:30 gibba015 bash[29377]: cluster 2021-03-10T17:10:29.785521+0000 mgr.gibba045.orlgmj (mgr.34412) 10639 : cluster [DBG] pgmap v6059: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:31.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:10:30 gibba015 bash[30343]: cluster 2021-03-10T17:10:29.785521+0000 mgr.gibba045.orlgmj (mgr.34412) 10639 : cluster [DBG] pgmap v6059: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:31.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:10:30 gibba045 bash[25517]: cluster 2021-03-10T17:10:29.785521+0000 mgr.gibba045.orlgmj (mgr.34412) 10639 : cluster [DBG] pgmap v6059: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:33.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:10:32 gibba015 bash[29377]: cluster 2021-03-10T17:10:31.787141+0000 mgr.gibba045.orlgmj (mgr.34412) 10640 : cluster [DBG] pgmap v6060: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:33.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:10:32 gibba015 bash[30343]: cluster 2021-03-10T17:10:31.787141+0000 mgr.gibba045.orlgmj (mgr.34412) 10640 : cluster [DBG] pgmap v6060: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:33.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:10:32 gibba045 bash[25517]: cluster 2021-03-10T17:10:31.787141+0000 mgr.gibba045.orlgmj (mgr.34412) 10640 : cluster [DBG] pgmap v6060: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:35.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:10:34 gibba015 bash[29377]: cluster 2021-03-10T17:10:33.788647+0000 mgr.gibba045.orlgmj (mgr.34412) 10641 : cluster [DBG] pgmap v6061: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:35.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:10:34 gibba015 bash[29377]: cephadm 2021-03-10T17:10:34.013486+0000 mgr.gibba045.orlgmj (mgr.34412) 10642 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:10:35.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:10:34 gibba015 bash[30343]: cluster 2021-03-10T17:10:33.788647+0000 mgr.gibba045.orlgmj (mgr.34412) 10641 : cluster [DBG] pgmap v6061: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:35.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:10:34 gibba015 bash[30343]: cephadm 2021-03-10T17:10:34.013486+0000 mgr.gibba045.orlgmj (mgr.34412) 10642 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:10:35.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:10:34 gibba045 bash[25517]: cluster 2021-03-10T17:10:33.788647+0000 mgr.gibba045.orlgmj (mgr.34412) 10641 : cluster [DBG] pgmap v6061: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:35.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:10:34 gibba045 bash[25517]: cephadm 2021-03-10T17:10:34.013486+0000 mgr.gibba045.orlgmj (mgr.34412) 10642 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:10:37.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:10:36 gibba015 bash[29377]: cluster 2021-03-10T17:10:35.790504+0000 mgr.gibba045.orlgmj (mgr.34412) 10643 : cluster [DBG] pgmap v6062: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:37.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:10:36 gibba015 bash[30343]: cluster 2021-03-10T17:10:35.790504+0000 mgr.gibba045.orlgmj (mgr.34412) 10643 : cluster [DBG] pgmap v6062: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:37.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:10:36 gibba045 bash[25517]: cluster 2021-03-10T17:10:35.790504+0000 mgr.gibba045.orlgmj (mgr.34412) 10643 : cluster [DBG] pgmap v6062: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:38.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:10:38 gibba015 bash[29377]: cluster 2021-03-10T17:10:37.792079+0000 mgr.gibba045.orlgmj (mgr.34412) 10644 : cluster [DBG] pgmap v6063: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:38.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:10:38 gibba015 bash[30343]: cluster 2021-03-10T17:10:37.792079+0000 mgr.gibba045.orlgmj (mgr.34412) 10644 : cluster [DBG] pgmap v6063: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:38.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:10:38 gibba045 bash[25517]: cluster 2021-03-10T17:10:37.792079+0000 mgr.gibba045.orlgmj (mgr.34412) 10644 : cluster [DBG] pgmap v6063: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:41.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:10:40 gibba015 bash[29377]: cluster 2021-03-10T17:10:39.793746+0000 mgr.gibba045.orlgmj (mgr.34412) 10645 : cluster [DBG] pgmap v6064: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:41.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:10:40 gibba015 bash[30343]: cluster 2021-03-10T17:10:39.793746+0000 mgr.gibba045.orlgmj (mgr.34412) 10645 : cluster [DBG] pgmap v6064: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:41.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:10:40 gibba045 bash[25517]: cluster 2021-03-10T17:10:39.793746+0000 mgr.gibba045.orlgmj (mgr.34412) 10645 : cluster [DBG] pgmap v6064: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:43.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:10:42 gibba015 bash[29377]: cluster 2021-03-10T17:10:41.795272+0000 mgr.gibba045.orlgmj (mgr.34412) 10646 : cluster [DBG] pgmap v6065: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:43.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:10:42 gibba015 bash[30343]: cluster 2021-03-10T17:10:41.795272+0000 mgr.gibba045.orlgmj (mgr.34412) 10646 : cluster [DBG] pgmap v6065: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:43.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:10:42 gibba045 bash[25517]: cluster 2021-03-10T17:10:41.795272+0000 mgr.gibba045.orlgmj (mgr.34412) 10646 : cluster [DBG] pgmap v6065: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:45.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:10:44 gibba015 bash[29377]: cluster 2021-03-10T17:10:43.796294+0000 mgr.gibba045.orlgmj (mgr.34412) 10647 : cluster [DBG] pgmap v6066: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:45.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:10:44 gibba015 bash[30343]: cluster 2021-03-10T17:10:43.796294+0000 mgr.gibba045.orlgmj (mgr.34412) 10647 : cluster [DBG] pgmap v6066: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:45.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:10:44 gibba045 bash[25517]: cluster 2021-03-10T17:10:43.796294+0000 mgr.gibba045.orlgmj (mgr.34412) 10647 : cluster [DBG] pgmap v6066: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:47.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:10:46 gibba015 bash[29377]: cluster 2021-03-10T17:10:45.798109+0000 mgr.gibba045.orlgmj (mgr.34412) 10648 : cluster [DBG] pgmap v6067: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:47.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:10:46 gibba015 bash[30343]: cluster 2021-03-10T17:10:45.798109+0000 mgr.gibba045.orlgmj (mgr.34412) 10648 : cluster [DBG] pgmap v6067: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:47.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:10:46 gibba045 bash[25517]: cluster 2021-03-10T17:10:45.798109+0000 mgr.gibba045.orlgmj (mgr.34412) 10648 : cluster [DBG] pgmap v6067: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:48.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:10:48 gibba015 bash[29377]: cluster 2021-03-10T17:10:47.799622+0000 mgr.gibba045.orlgmj (mgr.34412) 10649 : cluster [DBG] pgmap v6068: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:48.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:10:48 gibba015 bash[30343]: cluster 2021-03-10T17:10:47.799622+0000 mgr.gibba045.orlgmj (mgr.34412) 10649 : cluster [DBG] pgmap v6068: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:48.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:10:48 gibba045 bash[25517]: cluster 2021-03-10T17:10:47.799622+0000 mgr.gibba045.orlgmj (mgr.34412) 10649 : cluster [DBG] pgmap v6068: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:49.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:10:49 gibba015 bash[29377]: cephadm 2021-03-10T17:10:49.029210+0000 mgr.gibba045.orlgmj (mgr.34412) 10650 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:10:49.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:10:49 gibba015 bash[30343]: cephadm 2021-03-10T17:10:49.029210+0000 mgr.gibba045.orlgmj (mgr.34412) 10650 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:10:49.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:10:49 gibba045 bash[25517]: cephadm 2021-03-10T17:10:49.029210+0000 mgr.gibba045.orlgmj (mgr.34412) 10650 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:10:50.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:10:50 gibba015 bash[29377]: cluster 2021-03-10T17:10:49.801313+0000 mgr.gibba045.orlgmj (mgr.34412) 10651 : cluster [DBG] pgmap v6069: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:50.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:10:50 gibba015 bash[30343]: cluster 2021-03-10T17:10:49.801313+0000 mgr.gibba045.orlgmj (mgr.34412) 10651 : cluster [DBG] pgmap v6069: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:50.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:10:50 gibba045 bash[25517]: cluster 2021-03-10T17:10:49.801313+0000 mgr.gibba045.orlgmj (mgr.34412) 10651 : cluster [DBG] pgmap v6069: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:53.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:10:52 gibba015 bash[29377]: cluster 2021-03-10T17:10:51.802817+0000 mgr.gibba045.orlgmj (mgr.34412) 10652 : cluster [DBG] pgmap v6070: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:53.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:10:52 gibba015 bash[30343]: cluster 2021-03-10T17:10:51.802817+0000 mgr.gibba045.orlgmj (mgr.34412) 10652 : cluster [DBG] pgmap v6070: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:53.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:10:52 gibba045 bash[25517]: cluster 2021-03-10T17:10:51.802817+0000 mgr.gibba045.orlgmj (mgr.34412) 10652 : cluster [DBG] pgmap v6070: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:54.670 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:10:54.895 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:10:54.896 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 3m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:10:54.896 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 2m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:10:54.897 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:10:54.897 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:10:54.897 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:10:54.897 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:10:54.898 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:10:54.898 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:10:54.898 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 3m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:10:54.898 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 2m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:10:54.899 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:10:54.899 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:10:54.899 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:10:54.899 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:10:54.900 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:10:54.900 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:10:54.900 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:10:54.900 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:10:54.901 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 2m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:10:54.901 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 2m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:10:55.152 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:10:55.153 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:10:55.153 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:10:55.153 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:10:55.153 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:10:55.154 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:10:55.154 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:10:55.154 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:10:55.154 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:10:55.155 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:10:55.155 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:10:55.155 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:10:55.155 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:10:55.156 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:10:55.156 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:10:55.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:10:54 gibba015 bash[29377]: cluster 2021-03-10T17:10:53.803242+0000 mgr.gibba045.orlgmj (mgr.34412) 10653 : cluster [DBG] pgmap v6071: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:55.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:10:54 gibba015 bash[29377]: audit 2021-03-10T17:10:53.903555+0000 mon.c (mon.1) 2915 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:10:55.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:10:54 gibba015 bash[29377]: audit 2021-03-10T17:10:53.903738+0000 mon.c (mon.1) 2916 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:10:55.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:10:54 gibba015 bash[29377]: audit 2021-03-10T17:10:53.904005+0000 mon.a (mon.0) 2274 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:10:55.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:10:54 gibba015 bash[29377]: audit 2021-03-10T17:10:53.904266+0000 mon.a (mon.0) 2275 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:10:55.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:10:54 gibba015 bash[29377]: audit 2021-03-10T17:10:53.983564+0000 mon.c (mon.1) 2917 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T17:10:55.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:10:54 gibba015 bash[29377]: audit 2021-03-10T17:10:53.984653+0000 mon.c (mon.1) 2918 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:10:55.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:10:54 gibba015 bash[29377]: audit 2021-03-10T17:10:53.984827+0000 mon.a (mon.0) 2276 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T17:10:55.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:10:54 gibba015 bash[29377]: audit 2021-03-10T17:10:53.985658+0000 mon.c (mon.1) 2919 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 5]}]: dispatch 2021-03-10T17:10:55.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:10:54 gibba015 bash[29377]: audit 2021-03-10T17:10:53.985945+0000 mon.a (mon.0) 2277 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:10:55.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:10:54 gibba015 bash[29377]: audit 2021-03-10T17:10:53.986799+0000 mon.c (mon.1) 2920 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:10:55.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:10:54 gibba015 bash[29377]: audit 2021-03-10T17:10:53.986941+0000 mon.a (mon.0) 2278 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 5]}]: dispatch 2021-03-10T17:10:55.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:10:54 gibba015 bash[29377]: audit 2021-03-10T17:10:53.987762+0000 mon.a (mon.0) 2279 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:10:55.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:10:54 gibba015 bash[30343]: cluster 2021-03-10T17:10:53.803242+0000 mgr.gibba045.orlgmj (mgr.34412) 10653 : cluster [DBG] pgmap v6071: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:55.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:10:54 gibba015 bash[30343]: audit 2021-03-10T17:10:53.903555+0000 mon.c (mon.1) 2915 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:10:55.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:10:54 gibba015 bash[30343]: audit 2021-03-10T17:10:53.903738+0000 mon.c (mon.1) 2916 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:10:55.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:10:54 gibba015 bash[30343]: audit 2021-03-10T17:10:53.904005+0000 mon.a (mon.0) 2274 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:10:55.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:10:54 gibba015 bash[30343]: audit 2021-03-10T17:10:53.904266+0000 mon.a (mon.0) 2275 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:10:55.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:10:54 gibba015 bash[30343]: audit 2021-03-10T17:10:53.983564+0000 mon.c (mon.1) 2917 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T17:10:55.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:10:54 gibba015 bash[30343]: audit 2021-03-10T17:10:53.984653+0000 mon.c (mon.1) 2918 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:10:55.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:10:54 gibba015 bash[30343]: audit 2021-03-10T17:10:53.984827+0000 mon.a (mon.0) 2276 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T17:10:55.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:10:54 gibba015 bash[30343]: audit 2021-03-10T17:10:53.985658+0000 mon.c (mon.1) 2919 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 5]}]: dispatch 2021-03-10T17:10:55.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:10:54 gibba015 bash[30343]: audit 2021-03-10T17:10:53.985945+0000 mon.a (mon.0) 2277 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:10:55.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:10:54 gibba015 bash[30343]: audit 2021-03-10T17:10:53.986799+0000 mon.c (mon.1) 2920 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:10:55.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:10:54 gibba015 bash[30343]: audit 2021-03-10T17:10:53.986941+0000 mon.a (mon.0) 2278 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 5]}]: dispatch 2021-03-10T17:10:55.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:10:54 gibba015 bash[30343]: audit 2021-03-10T17:10:53.987762+0000 mon.a (mon.0) 2279 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:10:55.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:10:54 gibba045 bash[25517]: cluster 2021-03-10T17:10:53.803242+0000 mgr.gibba045.orlgmj (mgr.34412) 10653 : cluster [DBG] pgmap v6071: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:55.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:10:54 gibba045 bash[25517]: audit 2021-03-10T17:10:53.903555+0000 mon.c (mon.1) 2915 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:10:55.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:10:54 gibba045 bash[25517]: audit 2021-03-10T17:10:53.903738+0000 mon.c (mon.1) 2916 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:10:55.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:10:54 gibba045 bash[25517]: audit 2021-03-10T17:10:53.904005+0000 mon.a (mon.0) 2274 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:10:55.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:10:54 gibba045 bash[25517]: audit 2021-03-10T17:10:53.904266+0000 mon.a (mon.0) 2275 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:10:55.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:10:54 gibba045 bash[25517]: audit 2021-03-10T17:10:53.983564+0000 mon.c (mon.1) 2917 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T17:10:55.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:10:54 gibba045 bash[25517]: audit 2021-03-10T17:10:53.984653+0000 mon.c (mon.1) 2918 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:10:55.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:10:54 gibba045 bash[25517]: audit 2021-03-10T17:10:53.984827+0000 mon.a (mon.0) 2276 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T17:10:55.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:10:54 gibba045 bash[25517]: audit 2021-03-10T17:10:53.985658+0000 mon.c (mon.1) 2919 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 5]}]: dispatch 2021-03-10T17:10:55.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:10:54 gibba045 bash[25517]: audit 2021-03-10T17:10:53.985945+0000 mon.a (mon.0) 2277 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:10:55.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:10:54 gibba045 bash[25517]: audit 2021-03-10T17:10:53.986799+0000 mon.c (mon.1) 2920 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:10:55.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:10:54 gibba045 bash[25517]: audit 2021-03-10T17:10:53.986941+0000 mon.a (mon.0) 2278 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 5]}]: dispatch 2021-03-10T17:10:55.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:10:54 gibba045 bash[25517]: audit 2021-03-10T17:10:53.987762+0000 mon.a (mon.0) 2279 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:10:56.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:10:55 gibba015 bash[29377]: audit 2021-03-10T17:10:54.663329+0000 mgr.gibba045.orlgmj (mgr.34412) 10654 : audit [DBG] from='client.51198 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:10:56.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:10:55 gibba015 bash[29377]: audit 2021-03-10T17:10:54.887323+0000 mgr.gibba045.orlgmj (mgr.34412) 10655 : audit [DBG] from='client.61192 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:10:56.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:10:55 gibba015 bash[29377]: audit 2021-03-10T17:10:55.151136+0000 mon.c (mon.1) 2921 : audit [DBG] from='client.? 172.21.2.115:0/3041335040' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:10:56.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:10:55 gibba015 bash[30343]: audit 2021-03-10T17:10:54.663329+0000 mgr.gibba045.orlgmj (mgr.34412) 10654 : audit [DBG] from='client.51198 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:10:56.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:10:55 gibba015 bash[30343]: audit 2021-03-10T17:10:54.887323+0000 mgr.gibba045.orlgmj (mgr.34412) 10655 : audit [DBG] from='client.61192 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:10:56.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:10:55 gibba015 bash[30343]: audit 2021-03-10T17:10:55.151136+0000 mon.c (mon.1) 2921 : audit [DBG] from='client.? 172.21.2.115:0/3041335040' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:10:56.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:10:55 gibba045 bash[25517]: audit 2021-03-10T17:10:54.663329+0000 mgr.gibba045.orlgmj (mgr.34412) 10654 : audit [DBG] from='client.51198 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:10:56.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:10:55 gibba045 bash[25517]: audit 2021-03-10T17:10:54.887323+0000 mgr.gibba045.orlgmj (mgr.34412) 10655 : audit [DBG] from='client.61192 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:10:56.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:10:55 gibba045 bash[25517]: audit 2021-03-10T17:10:55.151136+0000 mon.c (mon.1) 2921 : audit [DBG] from='client.? 172.21.2.115:0/3041335040' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:10:57.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:10:56 gibba015 bash[29377]: cluster 2021-03-10T17:10:55.805100+0000 mgr.gibba045.orlgmj (mgr.34412) 10656 : cluster [DBG] pgmap v6072: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:57.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:10:56 gibba015 bash[30343]: cluster 2021-03-10T17:10:55.805100+0000 mgr.gibba045.orlgmj (mgr.34412) 10656 : cluster [DBG] pgmap v6072: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:57.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:10:56 gibba045 bash[25517]: cluster 2021-03-10T17:10:55.805100+0000 mgr.gibba045.orlgmj (mgr.34412) 10656 : cluster [DBG] pgmap v6072: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:58.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:10:58 gibba015 bash[29377]: cluster 2021-03-10T17:10:57.806474+0000 mgr.gibba045.orlgmj (mgr.34412) 10657 : cluster [DBG] pgmap v6073: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:58.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:10:58 gibba015 bash[30343]: cluster 2021-03-10T17:10:57.806474+0000 mgr.gibba045.orlgmj (mgr.34412) 10657 : cluster [DBG] pgmap v6073: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:58.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:10:58 gibba045 bash[25517]: cluster 2021-03-10T17:10:57.806474+0000 mgr.gibba045.orlgmj (mgr.34412) 10657 : cluster [DBG] pgmap v6073: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:01.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:11:00 gibba015 bash[29377]: cluster 2021-03-10T17:10:59.808004+0000 mgr.gibba045.orlgmj (mgr.34412) 10658 : cluster [DBG] pgmap v6074: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:01.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:11:00 gibba015 bash[30343]: cluster 2021-03-10T17:10:59.808004+0000 mgr.gibba045.orlgmj (mgr.34412) 10658 : cluster [DBG] pgmap v6074: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:01.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:11:00 gibba045 bash[25517]: cluster 2021-03-10T17:10:59.808004+0000 mgr.gibba045.orlgmj (mgr.34412) 10658 : cluster [DBG] pgmap v6074: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:03.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:11:02 gibba015 bash[29377]: cluster 2021-03-10T17:11:01.809811+0000 mgr.gibba045.orlgmj (mgr.34412) 10659 : cluster [DBG] pgmap v6075: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:03.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:11:02 gibba015 bash[30343]: cluster 2021-03-10T17:11:01.809811+0000 mgr.gibba045.orlgmj (mgr.34412) 10659 : cluster [DBG] pgmap v6075: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:03.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:11:02 gibba045 bash[25517]: cluster 2021-03-10T17:11:01.809811+0000 mgr.gibba045.orlgmj (mgr.34412) 10659 : cluster [DBG] pgmap v6075: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:05.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:11:04 gibba015 bash[29377]: cluster 2021-03-10T17:11:03.810873+0000 mgr.gibba045.orlgmj (mgr.34412) 10660 : cluster [DBG] pgmap v6076: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:05.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:11:04 gibba015 bash[29377]: cephadm 2021-03-10T17:11:04.045050+0000 mgr.gibba045.orlgmj (mgr.34412) 10661 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:11:05.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:11:04 gibba015 bash[30343]: cluster 2021-03-10T17:11:03.810873+0000 mgr.gibba045.orlgmj (mgr.34412) 10660 : cluster [DBG] pgmap v6076: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:05.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:11:04 gibba015 bash[30343]: cephadm 2021-03-10T17:11:04.045050+0000 mgr.gibba045.orlgmj (mgr.34412) 10661 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:11:05.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:11:04 gibba045 bash[25517]: cluster 2021-03-10T17:11:03.810873+0000 mgr.gibba045.orlgmj (mgr.34412) 10660 : cluster [DBG] pgmap v6076: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:05.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:11:04 gibba045 bash[25517]: cephadm 2021-03-10T17:11:04.045050+0000 mgr.gibba045.orlgmj (mgr.34412) 10661 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:11:07.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:11:06 gibba015 bash[29377]: cluster 2021-03-10T17:11:05.812809+0000 mgr.gibba045.orlgmj (mgr.34412) 10662 : cluster [DBG] pgmap v6077: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:07.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:11:06 gibba015 bash[30343]: cluster 2021-03-10T17:11:05.812809+0000 mgr.gibba045.orlgmj (mgr.34412) 10662 : cluster [DBG] pgmap v6077: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:07.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:11:06 gibba045 bash[25517]: cluster 2021-03-10T17:11:05.812809+0000 mgr.gibba045.orlgmj (mgr.34412) 10662 : cluster [DBG] pgmap v6077: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:08.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:11:08 gibba015 bash[29377]: cluster 2021-03-10T17:11:07.814272+0000 mgr.gibba045.orlgmj (mgr.34412) 10663 : cluster [DBG] pgmap v6078: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:08.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:11:08 gibba015 bash[30343]: cluster 2021-03-10T17:11:07.814272+0000 mgr.gibba045.orlgmj (mgr.34412) 10663 : cluster [DBG] pgmap v6078: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:08.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:11:08 gibba045 bash[25517]: cluster 2021-03-10T17:11:07.814272+0000 mgr.gibba045.orlgmj (mgr.34412) 10663 : cluster [DBG] pgmap v6078: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:11.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:11:10 gibba015 bash[29377]: cluster 2021-03-10T17:11:09.815959+0000 mgr.gibba045.orlgmj (mgr.34412) 10664 : cluster [DBG] pgmap v6079: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:11.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:11:10 gibba015 bash[30343]: cluster 2021-03-10T17:11:09.815959+0000 mgr.gibba045.orlgmj (mgr.34412) 10664 : cluster [DBG] pgmap v6079: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:11.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:11:10 gibba045 bash[25517]: cluster 2021-03-10T17:11:09.815959+0000 mgr.gibba045.orlgmj (mgr.34412) 10664 : cluster [DBG] pgmap v6079: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:13.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:11:12 gibba015 bash[29377]: cluster 2021-03-10T17:11:11.817663+0000 mgr.gibba045.orlgmj (mgr.34412) 10665 : cluster [DBG] pgmap v6080: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:13.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:11:12 gibba015 bash[30343]: cluster 2021-03-10T17:11:11.817663+0000 mgr.gibba045.orlgmj (mgr.34412) 10665 : cluster [DBG] pgmap v6080: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:13.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:11:12 gibba045 bash[25517]: cluster 2021-03-10T17:11:11.817663+0000 mgr.gibba045.orlgmj (mgr.34412) 10665 : cluster [DBG] pgmap v6080: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:15.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:11:14 gibba015 bash[29377]: cluster 2021-03-10T17:11:13.818169+0000 mgr.gibba045.orlgmj (mgr.34412) 10666 : cluster [DBG] pgmap v6081: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:15.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:11:14 gibba015 bash[30343]: cluster 2021-03-10T17:11:13.818169+0000 mgr.gibba045.orlgmj (mgr.34412) 10666 : cluster [DBG] pgmap v6081: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:15.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:11:14 gibba045 bash[25517]: cluster 2021-03-10T17:11:13.818169+0000 mgr.gibba045.orlgmj (mgr.34412) 10666 : cluster [DBG] pgmap v6081: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:17.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:11:16 gibba015 bash[29377]: cluster 2021-03-10T17:11:15.819900+0000 mgr.gibba045.orlgmj (mgr.34412) 10667 : cluster [DBG] pgmap v6082: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:17.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:11:16 gibba015 bash[30343]: cluster 2021-03-10T17:11:15.819900+0000 mgr.gibba045.orlgmj (mgr.34412) 10667 : cluster [DBG] pgmap v6082: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:17.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:11:16 gibba045 bash[25517]: cluster 2021-03-10T17:11:15.819900+0000 mgr.gibba045.orlgmj (mgr.34412) 10667 : cluster [DBG] pgmap v6082: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:18.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:11:18 gibba015 bash[29377]: cluster 2021-03-10T17:11:17.821588+0000 mgr.gibba045.orlgmj (mgr.34412) 10668 : cluster [DBG] pgmap v6083: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:18.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:11:18 gibba015 bash[30343]: cluster 2021-03-10T17:11:17.821588+0000 mgr.gibba045.orlgmj (mgr.34412) 10668 : cluster [DBG] pgmap v6083: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:18.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:11:18 gibba045 bash[25517]: cluster 2021-03-10T17:11:17.821588+0000 mgr.gibba045.orlgmj (mgr.34412) 10668 : cluster [DBG] pgmap v6083: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:19.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:11:19 gibba015 bash[29377]: audit 2021-03-10T17:11:19.055817+0000 mon.c (mon.1) 2922 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:11:19.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:11:19 gibba015 bash[29377]: cephadm 2021-03-10T17:11:19.062523+0000 mgr.gibba045.orlgmj (mgr.34412) 10669 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:11:19.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:11:19 gibba015 bash[29377]: cephadm 2021-03-10T17:11:19.064494+0000 mgr.gibba045.orlgmj (mgr.34412) 10670 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:11:19.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:11:19 gibba015 bash[29377]: audit 2021-03-10T17:11:19.316000+0000 mon.a (mon.0) 2280 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:11:19.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:11:19 gibba015 bash[29377]: audit 2021-03-10T17:11:19.319756+0000 mon.c (mon.1) 2923 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:11:19.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:11:19 gibba015 bash[29377]: audit 2021-03-10T17:11:19.321057+0000 mon.c (mon.1) 2924 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:11:19.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:11:19 gibba015 bash[29377]: cephadm 2021-03-10T17:11:19.321212+0000 mgr.gibba045.orlgmj (mgr.34412) 10671 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:11:19.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:11:19 gibba015 bash[29377]: audit 2021-03-10T17:11:19.322324+0000 mon.c (mon.1) 2925 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:11:19.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:11:19 gibba015 bash[29377]: cephadm 2021-03-10T17:11:19.322747+0000 mgr.gibba045.orlgmj (mgr.34412) 10672 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:11:19.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:11:19 gibba015 bash[29377]: audit 2021-03-10T17:11:19.323488+0000 mon.c (mon.1) 2926 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:11:19.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:11:19 gibba015 bash[29377]: cephadm 2021-03-10T17:11:19.323949+0000 mgr.gibba045.orlgmj (mgr.34412) 10673 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:11:19.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:11:19 gibba015 bash[29377]: cephadm 2021-03-10T17:11:19.323987+0000 mgr.gibba045.orlgmj (mgr.34412) 10674 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:11:19.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:11:19 gibba015 bash[29377]: cephadm 2021-03-10T17:11:19.325173+0000 mgr.gibba045.orlgmj (mgr.34412) 10675 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:11:19.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:11:19 gibba015 bash[29377]: cephadm 2021-03-10T17:11:19.325211+0000 mgr.gibba045.orlgmj (mgr.34412) 10676 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:11:19.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:11:19 gibba015 bash[29377]: cephadm 2021-03-10T17:11:19.326313+0000 mgr.gibba045.orlgmj (mgr.34412) 10677 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:11:19.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:11:19 gibba015 bash[29377]: audit 2021-03-10T17:11:19.326367+0000 mon.c (mon.1) 2927 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:11:19.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:11:19 gibba015 bash[29377]: cephadm 2021-03-10T17:11:19.327931+0000 mgr.gibba045.orlgmj (mgr.34412) 10678 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:11:19.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:11:19 gibba015 bash[29377]: cephadm 2021-03-10T17:11:19.327968+0000 mgr.gibba045.orlgmj (mgr.34412) 10679 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:11:19.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:11:19 gibba015 bash[29377]: audit 2021-03-10T17:11:19.327986+0000 mon.c (mon.1) 2928 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:11:19.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:11:19 gibba015 bash[29377]: cephadm 2021-03-10T17:11:19.329441+0000 mgr.gibba045.orlgmj (mgr.34412) 10680 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:11:19.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:11:19 gibba015 bash[29377]: cephadm 2021-03-10T17:11:19.329768+0000 mgr.gibba045.orlgmj (mgr.34412) 10681 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:11:19.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:11:19 gibba015 bash[29377]: cephadm 2021-03-10T17:11:19.330888+0000 mgr.gibba045.orlgmj (mgr.34412) 10682 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:11:19.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:11:19 gibba015 bash[29377]: cephadm 2021-03-10T17:11:19.330925+0000 mgr.gibba045.orlgmj (mgr.34412) 10683 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:11:19.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:11:19 gibba015 bash[29377]: cephadm 2021-03-10T17:11:19.331034+0000 mgr.gibba045.orlgmj (mgr.34412) 10684 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:11:19.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:11:19 gibba015 bash[30343]: audit 2021-03-10T17:11:19.055817+0000 mon.c (mon.1) 2922 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:11:19.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:11:19 gibba015 bash[30343]: cephadm 2021-03-10T17:11:19.062523+0000 mgr.gibba045.orlgmj (mgr.34412) 10669 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:11:19.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:11:19 gibba015 bash[30343]: cephadm 2021-03-10T17:11:19.064494+0000 mgr.gibba045.orlgmj (mgr.34412) 10670 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:11:19.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:11:19 gibba015 bash[30343]: audit 2021-03-10T17:11:19.316000+0000 mon.a (mon.0) 2280 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:11:19.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:11:19 gibba015 bash[30343]: audit 2021-03-10T17:11:19.319756+0000 mon.c (mon.1) 2923 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:11:19.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:11:19 gibba015 bash[30343]: audit 2021-03-10T17:11:19.321057+0000 mon.c (mon.1) 2924 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:11:19.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:11:19 gibba015 bash[30343]: cephadm 2021-03-10T17:11:19.321212+0000 mgr.gibba045.orlgmj (mgr.34412) 10671 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:11:19.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:11:19 gibba015 bash[30343]: audit 2021-03-10T17:11:19.322324+0000 mon.c (mon.1) 2925 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:11:19.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:11:19 gibba015 bash[30343]: cephadm 2021-03-10T17:11:19.322747+0000 mgr.gibba045.orlgmj (mgr.34412) 10672 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:11:19.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:11:19 gibba015 bash[30343]: audit 2021-03-10T17:11:19.323488+0000 mon.c (mon.1) 2926 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:11:19.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:11:19 gibba015 bash[30343]: cephadm 2021-03-10T17:11:19.323949+0000 mgr.gibba045.orlgmj (mgr.34412) 10673 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:11:19.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:11:19 gibba015 bash[30343]: cephadm 2021-03-10T17:11:19.323987+0000 mgr.gibba045.orlgmj (mgr.34412) 10674 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:11:19.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:11:19 gibba015 bash[30343]: cephadm 2021-03-10T17:11:19.325173+0000 mgr.gibba045.orlgmj (mgr.34412) 10675 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:11:19.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:11:19 gibba015 bash[30343]: cephadm 2021-03-10T17:11:19.325211+0000 mgr.gibba045.orlgmj (mgr.34412) 10676 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:11:19.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:11:19 gibba015 bash[30343]: cephadm 2021-03-10T17:11:19.326313+0000 mgr.gibba045.orlgmj (mgr.34412) 10677 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:11:19.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:11:19 gibba015 bash[30343]: audit 2021-03-10T17:11:19.326367+0000 mon.c (mon.1) 2927 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:11:19.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:11:19 gibba015 bash[30343]: cephadm 2021-03-10T17:11:19.327931+0000 mgr.gibba045.orlgmj (mgr.34412) 10678 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:11:19.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:11:19 gibba015 bash[30343]: cephadm 2021-03-10T17:11:19.327968+0000 mgr.gibba045.orlgmj (mgr.34412) 10679 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:11:19.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:11:19 gibba015 bash[30343]: audit 2021-03-10T17:11:19.327986+0000 mon.c (mon.1) 2928 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:11:19.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:11:19 gibba015 bash[30343]: cephadm 2021-03-10T17:11:19.329441+0000 mgr.gibba045.orlgmj (mgr.34412) 10680 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:11:19.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:11:19 gibba015 bash[30343]: cephadm 2021-03-10T17:11:19.329768+0000 mgr.gibba045.orlgmj (mgr.34412) 10681 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:11:19.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:11:19 gibba015 bash[30343]: cephadm 2021-03-10T17:11:19.330888+0000 mgr.gibba045.orlgmj (mgr.34412) 10682 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:11:19.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:11:19 gibba015 bash[30343]: cephadm 2021-03-10T17:11:19.330925+0000 mgr.gibba045.orlgmj (mgr.34412) 10683 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:11:19.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:11:19 gibba015 bash[30343]: cephadm 2021-03-10T17:11:19.331034+0000 mgr.gibba045.orlgmj (mgr.34412) 10684 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:11:19.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:11:19 gibba045 bash[25517]: audit 2021-03-10T17:11:19.055817+0000 mon.c (mon.1) 2922 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:11:19.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:11:19 gibba045 bash[25517]: cephadm 2021-03-10T17:11:19.062523+0000 mgr.gibba045.orlgmj (mgr.34412) 10669 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:11:19.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:11:19 gibba045 bash[25517]: cephadm 2021-03-10T17:11:19.064494+0000 mgr.gibba045.orlgmj (mgr.34412) 10670 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:11:19.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:11:19 gibba045 bash[25517]: audit 2021-03-10T17:11:19.316000+0000 mon.a (mon.0) 2280 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:11:19.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:11:19 gibba045 bash[25517]: audit 2021-03-10T17:11:19.319756+0000 mon.c (mon.1) 2923 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:11:19.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:11:19 gibba045 bash[25517]: audit 2021-03-10T17:11:19.321057+0000 mon.c (mon.1) 2924 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:11:19.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:11:19 gibba045 bash[25517]: cephadm 2021-03-10T17:11:19.321212+0000 mgr.gibba045.orlgmj (mgr.34412) 10671 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:11:19.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:11:19 gibba045 bash[25517]: audit 2021-03-10T17:11:19.322324+0000 mon.c (mon.1) 2925 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:11:19.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:11:19 gibba045 bash[25517]: cephadm 2021-03-10T17:11:19.322747+0000 mgr.gibba045.orlgmj (mgr.34412) 10672 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:11:19.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:11:19 gibba045 bash[25517]: audit 2021-03-10T17:11:19.323488+0000 mon.c (mon.1) 2926 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:11:19.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:11:19 gibba045 bash[25517]: cephadm 2021-03-10T17:11:19.323949+0000 mgr.gibba045.orlgmj (mgr.34412) 10673 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:11:19.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:11:19 gibba045 bash[25517]: cephadm 2021-03-10T17:11:19.323987+0000 mgr.gibba045.orlgmj (mgr.34412) 10674 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:11:19.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:11:19 gibba045 bash[25517]: cephadm 2021-03-10T17:11:19.325173+0000 mgr.gibba045.orlgmj (mgr.34412) 10675 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:11:19.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:11:19 gibba045 bash[25517]: cephadm 2021-03-10T17:11:19.325211+0000 mgr.gibba045.orlgmj (mgr.34412) 10676 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:11:19.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:11:19 gibba045 bash[25517]: cephadm 2021-03-10T17:11:19.326313+0000 mgr.gibba045.orlgmj (mgr.34412) 10677 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:11:19.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:11:19 gibba045 bash[25517]: audit 2021-03-10T17:11:19.326367+0000 mon.c (mon.1) 2927 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:11:19.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:11:19 gibba045 bash[25517]: cephadm 2021-03-10T17:11:19.327931+0000 mgr.gibba045.orlgmj (mgr.34412) 10678 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:11:19.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:11:19 gibba045 bash[25517]: cephadm 2021-03-10T17:11:19.327968+0000 mgr.gibba045.orlgmj (mgr.34412) 10679 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:11:19.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:11:19 gibba045 bash[25517]: audit 2021-03-10T17:11:19.327986+0000 mon.c (mon.1) 2928 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:11:19.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:11:19 gibba045 bash[25517]: cephadm 2021-03-10T17:11:19.329441+0000 mgr.gibba045.orlgmj (mgr.34412) 10680 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:11:19.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:11:19 gibba045 bash[25517]: cephadm 2021-03-10T17:11:19.329768+0000 mgr.gibba045.orlgmj (mgr.34412) 10681 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:11:19.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:11:19 gibba045 bash[25517]: cephadm 2021-03-10T17:11:19.330888+0000 mgr.gibba045.orlgmj (mgr.34412) 10682 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:11:19.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:11:19 gibba045 bash[25517]: cephadm 2021-03-10T17:11:19.330925+0000 mgr.gibba045.orlgmj (mgr.34412) 10683 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:11:19.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:11:19 gibba045 bash[25517]: cephadm 2021-03-10T17:11:19.331034+0000 mgr.gibba045.orlgmj (mgr.34412) 10684 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:11:20.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:11:20 gibba015 bash[29377]: cluster 2021-03-10T17:11:19.823141+0000 mgr.gibba045.orlgmj (mgr.34412) 10685 : cluster [DBG] pgmap v6084: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:20.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:11:20 gibba015 bash[30343]: cluster 2021-03-10T17:11:19.823141+0000 mgr.gibba045.orlgmj (mgr.34412) 10685 : cluster [DBG] pgmap v6084: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:20.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:11:20 gibba045 bash[25517]: cluster 2021-03-10T17:11:19.823141+0000 mgr.gibba045.orlgmj (mgr.34412) 10685 : cluster [DBG] pgmap v6084: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:23.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:11:22 gibba015 bash[29377]: cluster 2021-03-10T17:11:21.824878+0000 mgr.gibba045.orlgmj (mgr.34412) 10686 : cluster [DBG] pgmap v6085: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:23.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:11:22 gibba015 bash[30343]: cluster 2021-03-10T17:11:21.824878+0000 mgr.gibba045.orlgmj (mgr.34412) 10686 : cluster [DBG] pgmap v6085: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:23.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:11:22 gibba045 bash[25517]: cluster 2021-03-10T17:11:21.824878+0000 mgr.gibba045.orlgmj (mgr.34412) 10686 : cluster [DBG] pgmap v6085: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:25.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:11:24 gibba015 bash[29377]: cluster 2021-03-10T17:11:23.825381+0000 mgr.gibba045.orlgmj (mgr.34412) 10687 : cluster [DBG] pgmap v6086: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:25.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:11:24 gibba015 bash[30343]: cluster 2021-03-10T17:11:23.825381+0000 mgr.gibba045.orlgmj (mgr.34412) 10687 : cluster [DBG] pgmap v6086: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:25.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:11:24 gibba045 bash[25517]: cluster 2021-03-10T17:11:23.825381+0000 mgr.gibba045.orlgmj (mgr.34412) 10687 : cluster [DBG] pgmap v6086: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:25.397 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:11:25.624 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:11:25.625 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 4m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:11:25.625 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 3m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:11:25.625 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:11:25.626 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:11:25.626 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:11:25.626 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:11:25.626 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:11:25.627 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:11:25.627 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 4m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:11:25.627 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 3m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:11:25.627 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:11:25.628 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:11:25.628 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:11:25.628 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:11:25.628 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:11:25.628 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:11:25.629 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:11:25.630 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:11:25.630 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 3m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:11:25.630 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 3m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:11:25.872 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:11:25.872 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:11:25.873 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:11:25.873 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:11:25.873 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:11:25.873 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:11:25.874 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:11:25.874 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:11:25.874 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:11:25.874 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:11:25.875 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:11:25.875 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:11:25.875 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:11:25.875 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:11:25.875 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:11:26.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:11:25 gibba015 bash[29377]: audit 2021-03-10T17:11:25.390079+0000 mgr.gibba045.orlgmj (mgr.34412) 10688 : audit [DBG] from='client.51216 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:11:26.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:11:25 gibba015 bash[29377]: audit 2021-03-10T17:11:25.870982+0000 mon.c (mon.1) 2929 : audit [DBG] from='client.? 172.21.2.115:0/2981341123' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:11:26.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:11:25 gibba015 bash[30343]: audit 2021-03-10T17:11:25.390079+0000 mgr.gibba045.orlgmj (mgr.34412) 10688 : audit [DBG] from='client.51216 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:11:26.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:11:25 gibba015 bash[30343]: audit 2021-03-10T17:11:25.870982+0000 mon.c (mon.1) 2929 : audit [DBG] from='client.? 172.21.2.115:0/2981341123' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:11:26.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:11:25 gibba045 bash[25517]: audit 2021-03-10T17:11:25.390079+0000 mgr.gibba045.orlgmj (mgr.34412) 10688 : audit [DBG] from='client.51216 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:11:26.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:11:25 gibba045 bash[25517]: audit 2021-03-10T17:11:25.870982+0000 mon.c (mon.1) 2929 : audit [DBG] from='client.? 172.21.2.115:0/2981341123' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:11:27.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:11:26 gibba015 bash[29377]: audit 2021-03-10T17:11:25.612920+0000 mgr.gibba045.orlgmj (mgr.34412) 10689 : audit [DBG] from='client.61210 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:11:27.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:11:26 gibba015 bash[29377]: cluster 2021-03-10T17:11:25.826997+0000 mgr.gibba045.orlgmj (mgr.34412) 10690 : cluster [DBG] pgmap v6087: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:27.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:11:26 gibba015 bash[30343]: audit 2021-03-10T17:11:25.612920+0000 mgr.gibba045.orlgmj (mgr.34412) 10689 : audit [DBG] from='client.61210 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:11:27.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:11:26 gibba015 bash[30343]: cluster 2021-03-10T17:11:25.826997+0000 mgr.gibba045.orlgmj (mgr.34412) 10690 : cluster [DBG] pgmap v6087: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:27.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:11:26 gibba045 bash[25517]: audit 2021-03-10T17:11:25.612920+0000 mgr.gibba045.orlgmj (mgr.34412) 10689 : audit [DBG] from='client.61210 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:11:27.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:11:26 gibba045 bash[25517]: cluster 2021-03-10T17:11:25.826997+0000 mgr.gibba045.orlgmj (mgr.34412) 10690 : cluster [DBG] pgmap v6087: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:28.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:11:28 gibba015 bash[29377]: cluster 2021-03-10T17:11:27.828546+0000 mgr.gibba045.orlgmj (mgr.34412) 10691 : cluster [DBG] pgmap v6088: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:28.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:11:28 gibba015 bash[30343]: cluster 2021-03-10T17:11:27.828546+0000 mgr.gibba045.orlgmj (mgr.34412) 10691 : cluster [DBG] pgmap v6088: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:28.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:11:28 gibba045 bash[25517]: cluster 2021-03-10T17:11:27.828546+0000 mgr.gibba045.orlgmj (mgr.34412) 10691 : cluster [DBG] pgmap v6088: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:31.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:11:30 gibba015 bash[29377]: cluster 2021-03-10T17:11:29.829912+0000 mgr.gibba045.orlgmj (mgr.34412) 10692 : cluster [DBG] pgmap v6089: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:31.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:11:30 gibba015 bash[30343]: cluster 2021-03-10T17:11:29.829912+0000 mgr.gibba045.orlgmj (mgr.34412) 10692 : cluster [DBG] pgmap v6089: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:31.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:11:30 gibba045 bash[25517]: cluster 2021-03-10T17:11:29.829912+0000 mgr.gibba045.orlgmj (mgr.34412) 10692 : cluster [DBG] pgmap v6089: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:33.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:11:32 gibba015 bash[29377]: cluster 2021-03-10T17:11:31.831532+0000 mgr.gibba045.orlgmj (mgr.34412) 10693 : cluster [DBG] pgmap v6090: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:33.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:11:32 gibba015 bash[30343]: cluster 2021-03-10T17:11:31.831532+0000 mgr.gibba045.orlgmj (mgr.34412) 10693 : cluster [DBG] pgmap v6090: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:33.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:11:32 gibba045 bash[25517]: cluster 2021-03-10T17:11:31.831532+0000 mgr.gibba045.orlgmj (mgr.34412) 10693 : cluster [DBG] pgmap v6090: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:35.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:11:34 gibba015 bash[29377]: cluster 2021-03-10T17:11:33.832145+0000 mgr.gibba045.orlgmj (mgr.34412) 10694 : cluster [DBG] pgmap v6091: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:35.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:11:34 gibba015 bash[29377]: cephadm 2021-03-10T17:11:34.341292+0000 mgr.gibba045.orlgmj (mgr.34412) 10695 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:11:35.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:11:34 gibba015 bash[30343]: cluster 2021-03-10T17:11:33.832145+0000 mgr.gibba045.orlgmj (mgr.34412) 10694 : cluster [DBG] pgmap v6091: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:35.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:11:34 gibba015 bash[30343]: cephadm 2021-03-10T17:11:34.341292+0000 mgr.gibba045.orlgmj (mgr.34412) 10695 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:11:35.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:11:34 gibba045 bash[25517]: cluster 2021-03-10T17:11:33.832145+0000 mgr.gibba045.orlgmj (mgr.34412) 10694 : cluster [DBG] pgmap v6091: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:35.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:11:34 gibba045 bash[25517]: cephadm 2021-03-10T17:11:34.341292+0000 mgr.gibba045.orlgmj (mgr.34412) 10695 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:11:37.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:11:36 gibba015 bash[29377]: cluster 2021-03-10T17:11:35.833930+0000 mgr.gibba045.orlgmj (mgr.34412) 10696 : cluster [DBG] pgmap v6092: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:37.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:11:36 gibba015 bash[30343]: cluster 2021-03-10T17:11:35.833930+0000 mgr.gibba045.orlgmj (mgr.34412) 10696 : cluster [DBG] pgmap v6092: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:37.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:11:36 gibba045 bash[25517]: cluster 2021-03-10T17:11:35.833930+0000 mgr.gibba045.orlgmj (mgr.34412) 10696 : cluster [DBG] pgmap v6092: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:38.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:11:38 gibba015 bash[29377]: cluster 2021-03-10T17:11:37.835444+0000 mgr.gibba045.orlgmj (mgr.34412) 10697 : cluster [DBG] pgmap v6093: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:38.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:11:38 gibba015 bash[30343]: cluster 2021-03-10T17:11:37.835444+0000 mgr.gibba045.orlgmj (mgr.34412) 10697 : cluster [DBG] pgmap v6093: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:38.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:11:38 gibba045 bash[25517]: cluster 2021-03-10T17:11:37.835444+0000 mgr.gibba045.orlgmj (mgr.34412) 10697 : cluster [DBG] pgmap v6093: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:41.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:11:40 gibba015 bash[29377]: cluster 2021-03-10T17:11:39.837105+0000 mgr.gibba045.orlgmj (mgr.34412) 10698 : cluster [DBG] pgmap v6094: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:41.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:11:40 gibba015 bash[30343]: cluster 2021-03-10T17:11:39.837105+0000 mgr.gibba045.orlgmj (mgr.34412) 10698 : cluster [DBG] pgmap v6094: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:41.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:11:40 gibba045 bash[25517]: cluster 2021-03-10T17:11:39.837105+0000 mgr.gibba045.orlgmj (mgr.34412) 10698 : cluster [DBG] pgmap v6094: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:43.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:11:42 gibba015 bash[29377]: cluster 2021-03-10T17:11:41.838911+0000 mgr.gibba045.orlgmj (mgr.34412) 10699 : cluster [DBG] pgmap v6095: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:43.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:11:42 gibba015 bash[30343]: cluster 2021-03-10T17:11:41.838911+0000 mgr.gibba045.orlgmj (mgr.34412) 10699 : cluster [DBG] pgmap v6095: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:43.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:11:42 gibba045 bash[25517]: cluster 2021-03-10T17:11:41.838911+0000 mgr.gibba045.orlgmj (mgr.34412) 10699 : cluster [DBG] pgmap v6095: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:45.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:11:44 gibba015 bash[29377]: cluster 2021-03-10T17:11:43.839518+0000 mgr.gibba045.orlgmj (mgr.34412) 10700 : cluster [DBG] pgmap v6096: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:45.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:11:44 gibba015 bash[30343]: cluster 2021-03-10T17:11:43.839518+0000 mgr.gibba045.orlgmj (mgr.34412) 10700 : cluster [DBG] pgmap v6096: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:45.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:11:44 gibba045 bash[25517]: cluster 2021-03-10T17:11:43.839518+0000 mgr.gibba045.orlgmj (mgr.34412) 10700 : cluster [DBG] pgmap v6096: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:47.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:11:46 gibba015 bash[29377]: cluster 2021-03-10T17:11:45.841242+0000 mgr.gibba045.orlgmj (mgr.34412) 10701 : cluster [DBG] pgmap v6097: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:47.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:11:46 gibba015 bash[30343]: cluster 2021-03-10T17:11:45.841242+0000 mgr.gibba045.orlgmj (mgr.34412) 10701 : cluster [DBG] pgmap v6097: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:47.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:11:46 gibba045 bash[25517]: cluster 2021-03-10T17:11:45.841242+0000 mgr.gibba045.orlgmj (mgr.34412) 10701 : cluster [DBG] pgmap v6097: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:48.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:11:48 gibba015 bash[29377]: cluster 2021-03-10T17:11:47.842731+0000 mgr.gibba045.orlgmj (mgr.34412) 10702 : cluster [DBG] pgmap v6098: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:48.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:11:48 gibba015 bash[30343]: cluster 2021-03-10T17:11:47.842731+0000 mgr.gibba045.orlgmj (mgr.34412) 10702 : cluster [DBG] pgmap v6098: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:48.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:11:48 gibba045 bash[25517]: cluster 2021-03-10T17:11:47.842731+0000 mgr.gibba045.orlgmj (mgr.34412) 10702 : cluster [DBG] pgmap v6098: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:49.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:11:49 gibba015 bash[29377]: cephadm 2021-03-10T17:11:49.356765+0000 mgr.gibba045.orlgmj (mgr.34412) 10703 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:11:49.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:11:49 gibba015 bash[30343]: cephadm 2021-03-10T17:11:49.356765+0000 mgr.gibba045.orlgmj (mgr.34412) 10703 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:11:49.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:11:49 gibba045 bash[25517]: cephadm 2021-03-10T17:11:49.356765+0000 mgr.gibba045.orlgmj (mgr.34412) 10703 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:11:50.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:11:50 gibba015 bash[29377]: cluster 2021-03-10T17:11:49.844264+0000 mgr.gibba045.orlgmj (mgr.34412) 10704 : cluster [DBG] pgmap v6099: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:50.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:11:50 gibba015 bash[30343]: cluster 2021-03-10T17:11:49.844264+0000 mgr.gibba045.orlgmj (mgr.34412) 10704 : cluster [DBG] pgmap v6099: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:50.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:11:50 gibba045 bash[25517]: cluster 2021-03-10T17:11:49.844264+0000 mgr.gibba045.orlgmj (mgr.34412) 10704 : cluster [DBG] pgmap v6099: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:53.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:11:52 gibba015 bash[29377]: cluster 2021-03-10T17:11:51.845999+0000 mgr.gibba045.orlgmj (mgr.34412) 10705 : cluster [DBG] pgmap v6100: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:53.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:11:52 gibba015 bash[30343]: cluster 2021-03-10T17:11:51.845999+0000 mgr.gibba045.orlgmj (mgr.34412) 10705 : cluster [DBG] pgmap v6100: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:53.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:11:52 gibba045 bash[25517]: cluster 2021-03-10T17:11:51.845999+0000 mgr.gibba045.orlgmj (mgr.34412) 10705 : cluster [DBG] pgmap v6100: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:55.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:11:54 gibba015 bash[29377]: cluster 2021-03-10T17:11:53.846777+0000 mgr.gibba045.orlgmj (mgr.34412) 10706 : cluster [DBG] pgmap v6101: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:55.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:11:54 gibba015 bash[29377]: audit 2021-03-10T17:11:53.910573+0000 mon.c (mon.1) 2930 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:11:55.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:11:54 gibba015 bash[29377]: audit 2021-03-10T17:11:53.915916+0000 mon.c (mon.1) 2931 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:11:55.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:11:54 gibba015 bash[29377]: audit 2021-03-10T17:11:53.916120+0000 mon.a (mon.0) 2281 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:11:55.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:11:54 gibba015 bash[29377]: audit 2021-03-10T17:11:53.916313+0000 mon.a (mon.0) 2282 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:11:55.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:11:54 gibba015 bash[29377]: audit 2021-03-10T17:11:53.996117+0000 mon.c (mon.1) 2932 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T17:11:55.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:11:54 gibba015 bash[29377]: audit 2021-03-10T17:11:53.996898+0000 mon.c (mon.1) 2933 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:11:55.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:11:54 gibba015 bash[29377]: audit 2021-03-10T17:11:53.997403+0000 mon.a (mon.0) 2283 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T17:11:55.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:11:54 gibba015 bash[29377]: audit 2021-03-10T17:11:53.997649+0000 mon.c (mon.1) 2934 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T17:11:55.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:11:54 gibba015 bash[29377]: audit 2021-03-10T17:11:53.998489+0000 mon.c (mon.1) 2935 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:11:55.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:11:54 gibba015 bash[29377]: audit 2021-03-10T17:11:53.998626+0000 mon.a (mon.0) 2284 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:11:55.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:11:54 gibba015 bash[29377]: audit 2021-03-10T17:11:53.999797+0000 mon.a (mon.0) 2285 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T17:11:55.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:11:54 gibba015 bash[29377]: audit 2021-03-10T17:11:54.000637+0000 mon.a (mon.0) 2286 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:11:55.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:11:54 gibba015 bash[30343]: cluster 2021-03-10T17:11:53.846777+0000 mgr.gibba045.orlgmj (mgr.34412) 10706 : cluster [DBG] pgmap v6101: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:55.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:11:54 gibba015 bash[30343]: audit 2021-03-10T17:11:53.910573+0000 mon.c (mon.1) 2930 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:11:55.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:11:54 gibba015 bash[30343]: audit 2021-03-10T17:11:53.915916+0000 mon.c (mon.1) 2931 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:11:55.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:11:54 gibba015 bash[30343]: audit 2021-03-10T17:11:53.916120+0000 mon.a (mon.0) 2281 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:11:55.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:11:54 gibba015 bash[30343]: audit 2021-03-10T17:11:53.916313+0000 mon.a (mon.0) 2282 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:11:55.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:11:54 gibba015 bash[30343]: audit 2021-03-10T17:11:53.996117+0000 mon.c (mon.1) 2932 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T17:11:55.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:11:54 gibba015 bash[30343]: audit 2021-03-10T17:11:53.996898+0000 mon.c (mon.1) 2933 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:11:55.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:11:54 gibba015 bash[30343]: audit 2021-03-10T17:11:53.997403+0000 mon.a (mon.0) 2283 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T17:11:55.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:11:54 gibba015 bash[30343]: audit 2021-03-10T17:11:53.997649+0000 mon.c (mon.1) 2934 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T17:11:55.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:11:54 gibba015 bash[30343]: audit 2021-03-10T17:11:53.998489+0000 mon.c (mon.1) 2935 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:11:55.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:11:54 gibba015 bash[30343]: audit 2021-03-10T17:11:53.998626+0000 mon.a (mon.0) 2284 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:11:55.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:11:54 gibba015 bash[30343]: audit 2021-03-10T17:11:53.999797+0000 mon.a (mon.0) 2285 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T17:11:55.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:11:54 gibba015 bash[30343]: audit 2021-03-10T17:11:54.000637+0000 mon.a (mon.0) 2286 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:11:55.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:11:54 gibba045 bash[25517]: cluster 2021-03-10T17:11:53.846777+0000 mgr.gibba045.orlgmj (mgr.34412) 10706 : cluster [DBG] pgmap v6101: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:55.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:11:54 gibba045 bash[25517]: audit 2021-03-10T17:11:53.910573+0000 mon.c (mon.1) 2930 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:11:55.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:11:54 gibba045 bash[25517]: audit 2021-03-10T17:11:53.915916+0000 mon.c (mon.1) 2931 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:11:55.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:11:54 gibba045 bash[25517]: audit 2021-03-10T17:11:53.916120+0000 mon.a (mon.0) 2281 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:11:55.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:11:54 gibba045 bash[25517]: audit 2021-03-10T17:11:53.916313+0000 mon.a (mon.0) 2282 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:11:55.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:11:54 gibba045 bash[25517]: audit 2021-03-10T17:11:53.996117+0000 mon.c (mon.1) 2932 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T17:11:55.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:11:54 gibba045 bash[25517]: audit 2021-03-10T17:11:53.996898+0000 mon.c (mon.1) 2933 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:11:55.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:11:54 gibba045 bash[25517]: audit 2021-03-10T17:11:53.997403+0000 mon.a (mon.0) 2283 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T17:11:55.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:11:54 gibba045 bash[25517]: audit 2021-03-10T17:11:53.997649+0000 mon.c (mon.1) 2934 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T17:11:55.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:11:54 gibba045 bash[25517]: audit 2021-03-10T17:11:53.998489+0000 mon.c (mon.1) 2935 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:11:55.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:11:54 gibba045 bash[25517]: audit 2021-03-10T17:11:53.998626+0000 mon.a (mon.0) 2284 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:11:55.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:11:54 gibba045 bash[25517]: audit 2021-03-10T17:11:53.999797+0000 mon.a (mon.0) 2285 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T17:11:55.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:11:54 gibba045 bash[25517]: audit 2021-03-10T17:11:54.000637+0000 mon.a (mon.0) 2286 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:11:56.115 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:11:56.343 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:11:56.343 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 4m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:11:56.343 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 3m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:11:56.343 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:11:56.344 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:11:56.344 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:11:56.344 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:11:56.344 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:11:56.345 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:11:56.345 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 4m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:11:56.345 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 3m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:11:56.345 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:11:56.345 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:11:56.346 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:11:56.346 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:11:56.346 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:11:56.346 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:11:56.347 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:11:56.347 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:11:56.347 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 3m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:11:56.347 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 3m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:11:56.592 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:11:56.593 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:11:56.593 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:11:56.593 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:11:56.593 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:11:56.594 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:11:56.594 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:11:56.594 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:11:56.594 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:11:56.595 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:11:56.595 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:11:56.595 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:11:56.595 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:11:56.596 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:11:56.596 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:11:57.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:11:56 gibba015 bash[29377]: cluster 2021-03-10T17:11:55.848662+0000 mgr.gibba045.orlgmj (mgr.34412) 10707 : cluster [DBG] pgmap v6102: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:57.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:11:56 gibba015 bash[29377]: audit 2021-03-10T17:11:56.107106+0000 mgr.gibba045.orlgmj (mgr.34412) 10708 : audit [DBG] from='client.61222 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:11:57.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:11:56 gibba015 bash[29377]: audit 2021-03-10T17:11:56.331652+0000 mgr.gibba045.orlgmj (mgr.34412) 10709 : audit [DBG] from='client.51240 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:11:57.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:11:56 gibba015 bash[29377]: audit 2021-03-10T17:11:56.591544+0000 mon.c (mon.1) 2936 : audit [DBG] from='client.? 172.21.2.115:0/1104468570' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:11:57.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:11:56 gibba015 bash[30343]: cluster 2021-03-10T17:11:55.848662+0000 mgr.gibba045.orlgmj (mgr.34412) 10707 : cluster [DBG] pgmap v6102: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:57.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:11:56 gibba015 bash[30343]: audit 2021-03-10T17:11:56.107106+0000 mgr.gibba045.orlgmj (mgr.34412) 10708 : audit [DBG] from='client.61222 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:11:57.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:11:56 gibba015 bash[30343]: audit 2021-03-10T17:11:56.331652+0000 mgr.gibba045.orlgmj (mgr.34412) 10709 : audit [DBG] from='client.51240 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:11:57.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:11:56 gibba015 bash[30343]: audit 2021-03-10T17:11:56.591544+0000 mon.c (mon.1) 2936 : audit [DBG] from='client.? 172.21.2.115:0/1104468570' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:11:57.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:11:56 gibba045 bash[25517]: cluster 2021-03-10T17:11:55.848662+0000 mgr.gibba045.orlgmj (mgr.34412) 10707 : cluster [DBG] pgmap v6102: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:57.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:11:56 gibba045 bash[25517]: audit 2021-03-10T17:11:56.107106+0000 mgr.gibba045.orlgmj (mgr.34412) 10708 : audit [DBG] from='client.61222 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:11:57.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:11:56 gibba045 bash[25517]: audit 2021-03-10T17:11:56.331652+0000 mgr.gibba045.orlgmj (mgr.34412) 10709 : audit [DBG] from='client.51240 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:11:57.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:11:56 gibba045 bash[25517]: audit 2021-03-10T17:11:56.591544+0000 mon.c (mon.1) 2936 : audit [DBG] from='client.? 172.21.2.115:0/1104468570' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:11:58.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:11:58 gibba015 bash[29377]: cluster 2021-03-10T17:11:57.850509+0000 mgr.gibba045.orlgmj (mgr.34412) 10710 : cluster [DBG] pgmap v6103: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:58.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:11:58 gibba015 bash[30343]: cluster 2021-03-10T17:11:57.850509+0000 mgr.gibba045.orlgmj (mgr.34412) 10710 : cluster [DBG] pgmap v6103: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:58.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:11:58 gibba045 bash[25517]: cluster 2021-03-10T17:11:57.850509+0000 mgr.gibba045.orlgmj (mgr.34412) 10710 : cluster [DBG] pgmap v6103: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:01.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:12:00 gibba015 bash[29377]: cluster 2021-03-10T17:11:59.852072+0000 mgr.gibba045.orlgmj (mgr.34412) 10711 : cluster [DBG] pgmap v6104: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:01.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:12:00 gibba015 bash[30343]: cluster 2021-03-10T17:11:59.852072+0000 mgr.gibba045.orlgmj (mgr.34412) 10711 : cluster [DBG] pgmap v6104: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:01.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:12:00 gibba045 bash[25517]: cluster 2021-03-10T17:11:59.852072+0000 mgr.gibba045.orlgmj (mgr.34412) 10711 : cluster [DBG] pgmap v6104: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:03.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:12:02 gibba015 bash[29377]: cluster 2021-03-10T17:12:01.853743+0000 mgr.gibba045.orlgmj (mgr.34412) 10712 : cluster [DBG] pgmap v6105: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:03.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:12:02 gibba015 bash[30343]: cluster 2021-03-10T17:12:01.853743+0000 mgr.gibba045.orlgmj (mgr.34412) 10712 : cluster [DBG] pgmap v6105: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:03.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:12:02 gibba045 bash[25517]: cluster 2021-03-10T17:12:01.853743+0000 mgr.gibba045.orlgmj (mgr.34412) 10712 : cluster [DBG] pgmap v6105: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:05.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:12:04 gibba015 bash[29377]: cluster 2021-03-10T17:12:03.854528+0000 mgr.gibba045.orlgmj (mgr.34412) 10713 : cluster [DBG] pgmap v6106: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:05.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:12:04 gibba015 bash[29377]: cephadm 2021-03-10T17:12:04.372939+0000 mgr.gibba045.orlgmj (mgr.34412) 10714 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:12:05.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:12:04 gibba015 bash[30343]: cluster 2021-03-10T17:12:03.854528+0000 mgr.gibba045.orlgmj (mgr.34412) 10713 : cluster [DBG] pgmap v6106: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:05.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:12:04 gibba015 bash[30343]: cephadm 2021-03-10T17:12:04.372939+0000 mgr.gibba045.orlgmj (mgr.34412) 10714 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:12:05.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:12:04 gibba045 bash[25517]: cluster 2021-03-10T17:12:03.854528+0000 mgr.gibba045.orlgmj (mgr.34412) 10713 : cluster [DBG] pgmap v6106: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:05.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:12:04 gibba045 bash[25517]: cephadm 2021-03-10T17:12:04.372939+0000 mgr.gibba045.orlgmj (mgr.34412) 10714 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:12:07.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:12:06 gibba015 bash[29377]: cluster 2021-03-10T17:12:05.856173+0000 mgr.gibba045.orlgmj (mgr.34412) 10715 : cluster [DBG] pgmap v6107: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:07.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:12:06 gibba015 bash[30343]: cluster 2021-03-10T17:12:05.856173+0000 mgr.gibba045.orlgmj (mgr.34412) 10715 : cluster [DBG] pgmap v6107: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:07.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:12:06 gibba045 bash[25517]: cluster 2021-03-10T17:12:05.856173+0000 mgr.gibba045.orlgmj (mgr.34412) 10715 : cluster [DBG] pgmap v6107: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:08.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:12:08 gibba015 bash[29377]: cluster 2021-03-10T17:12:07.857826+0000 mgr.gibba045.orlgmj (mgr.34412) 10716 : cluster [DBG] pgmap v6108: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:08.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:12:08 gibba015 bash[30343]: cluster 2021-03-10T17:12:07.857826+0000 mgr.gibba045.orlgmj (mgr.34412) 10716 : cluster [DBG] pgmap v6108: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:08.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:12:08 gibba045 bash[25517]: cluster 2021-03-10T17:12:07.857826+0000 mgr.gibba045.orlgmj (mgr.34412) 10716 : cluster [DBG] pgmap v6108: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:11.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:12:10 gibba015 bash[29377]: cluster 2021-03-10T17:12:09.859528+0000 mgr.gibba045.orlgmj (mgr.34412) 10717 : cluster [DBG] pgmap v6109: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:11.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:12:10 gibba015 bash[30343]: cluster 2021-03-10T17:12:09.859528+0000 mgr.gibba045.orlgmj (mgr.34412) 10717 : cluster [DBG] pgmap v6109: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:11.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:12:10 gibba045 bash[25517]: cluster 2021-03-10T17:12:09.859528+0000 mgr.gibba045.orlgmj (mgr.34412) 10717 : cluster [DBG] pgmap v6109: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:13.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:12:12 gibba015 bash[29377]: cluster 2021-03-10T17:12:11.861193+0000 mgr.gibba045.orlgmj (mgr.34412) 10718 : cluster [DBG] pgmap v6110: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:13.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:12:12 gibba015 bash[30343]: cluster 2021-03-10T17:12:11.861193+0000 mgr.gibba045.orlgmj (mgr.34412) 10718 : cluster [DBG] pgmap v6110: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:13.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:12:12 gibba045 bash[25517]: cluster 2021-03-10T17:12:11.861193+0000 mgr.gibba045.orlgmj (mgr.34412) 10718 : cluster [DBG] pgmap v6110: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:15.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:12:14 gibba015 bash[29377]: cluster 2021-03-10T17:12:13.861940+0000 mgr.gibba045.orlgmj (mgr.34412) 10719 : cluster [DBG] pgmap v6111: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:15.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:12:14 gibba015 bash[30343]: cluster 2021-03-10T17:12:13.861940+0000 mgr.gibba045.orlgmj (mgr.34412) 10719 : cluster [DBG] pgmap v6111: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:15.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:12:14 gibba045 bash[25517]: cluster 2021-03-10T17:12:13.861940+0000 mgr.gibba045.orlgmj (mgr.34412) 10719 : cluster [DBG] pgmap v6111: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:17.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:12:16 gibba015 bash[29377]: cluster 2021-03-10T17:12:15.863325+0000 mgr.gibba045.orlgmj (mgr.34412) 10720 : cluster [DBG] pgmap v6112: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:17.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:12:16 gibba015 bash[30343]: cluster 2021-03-10T17:12:15.863325+0000 mgr.gibba045.orlgmj (mgr.34412) 10720 : cluster [DBG] pgmap v6112: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:17.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:12:16 gibba045 bash[25517]: cluster 2021-03-10T17:12:15.863325+0000 mgr.gibba045.orlgmj (mgr.34412) 10720 : cluster [DBG] pgmap v6112: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:18.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:12:18 gibba015 bash[29377]: cluster 2021-03-10T17:12:17.864813+0000 mgr.gibba045.orlgmj (mgr.34412) 10721 : cluster [DBG] pgmap v6113: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:18.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:12:18 gibba015 bash[30343]: cluster 2021-03-10T17:12:17.864813+0000 mgr.gibba045.orlgmj (mgr.34412) 10721 : cluster [DBG] pgmap v6113: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:18.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:12:18 gibba045 bash[25517]: cluster 2021-03-10T17:12:17.864813+0000 mgr.gibba045.orlgmj (mgr.34412) 10721 : cluster [DBG] pgmap v6113: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:19.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:12:19 gibba015 bash[29377]: audit 2021-03-10T17:12:19.380365+0000 mon.c (mon.1) 2937 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:12:19.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:12:19 gibba015 bash[29377]: cephadm 2021-03-10T17:12:19.387896+0000 mgr.gibba045.orlgmj (mgr.34412) 10722 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:12:19.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:12:19 gibba015 bash[29377]: cephadm 2021-03-10T17:12:19.389635+0000 mgr.gibba045.orlgmj (mgr.34412) 10723 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:12:19.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:12:19 gibba015 bash[30343]: audit 2021-03-10T17:12:19.380365+0000 mon.c (mon.1) 2937 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:12:19.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:12:19 gibba015 bash[30343]: cephadm 2021-03-10T17:12:19.387896+0000 mgr.gibba045.orlgmj (mgr.34412) 10722 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:12:19.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:12:19 gibba015 bash[30343]: cephadm 2021-03-10T17:12:19.389635+0000 mgr.gibba045.orlgmj (mgr.34412) 10723 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:12:19.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:12:19 gibba045 bash[25517]: audit 2021-03-10T17:12:19.380365+0000 mon.c (mon.1) 2937 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:12:19.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:12:19 gibba045 bash[25517]: cephadm 2021-03-10T17:12:19.387896+0000 mgr.gibba045.orlgmj (mgr.34412) 10722 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:12:19.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:12:19 gibba045 bash[25517]: cephadm 2021-03-10T17:12:19.389635+0000 mgr.gibba045.orlgmj (mgr.34412) 10723 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:12:20.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:12:20 gibba015 bash[29377]: audit 2021-03-10T17:12:19.588899+0000 mon.a (mon.0) 2287 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:12:20.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:12:20 gibba015 bash[29377]: audit 2021-03-10T17:12:19.592753+0000 mon.c (mon.1) 2938 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:12:20.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:12:20 gibba015 bash[29377]: cephadm 2021-03-10T17:12:19.594029+0000 mgr.gibba045.orlgmj (mgr.34412) 10724 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:12:20.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:12:20 gibba015 bash[29377]: audit 2021-03-10T17:12:19.594491+0000 mon.c (mon.1) 2939 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:12:20.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:12:20 gibba015 bash[29377]: audit 2021-03-10T17:12:19.595868+0000 mon.c (mon.1) 2940 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:12:20.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:12:20 gibba015 bash[29377]: cephadm 2021-03-10T17:12:19.596006+0000 mgr.gibba045.orlgmj (mgr.34412) 10725 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:12:20.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:12:20 gibba015 bash[29377]: audit 2021-03-10T17:12:19.597151+0000 mon.c (mon.1) 2941 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:12:20.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:12:20 gibba015 bash[29377]: cephadm 2021-03-10T17:12:19.597503+0000 mgr.gibba045.orlgmj (mgr.34412) 10726 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:12:20.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:12:20 gibba015 bash[29377]: cephadm 2021-03-10T17:12:19.597542+0000 mgr.gibba045.orlgmj (mgr.34412) 10727 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:12:20.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:12:20 gibba015 bash[29377]: cephadm 2021-03-10T17:12:19.598860+0000 mgr.gibba045.orlgmj (mgr.34412) 10728 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:12:20.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:12:20 gibba015 bash[29377]: cephadm 2021-03-10T17:12:19.598898+0000 mgr.gibba045.orlgmj (mgr.34412) 10729 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:12:20.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:12:20 gibba015 bash[29377]: cephadm 2021-03-10T17:12:19.600103+0000 mgr.gibba045.orlgmj (mgr.34412) 10730 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:12:20.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:12:20 gibba015 bash[29377]: audit 2021-03-10T17:12:19.600580+0000 mon.c (mon.1) 2942 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:12:20.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:12:20 gibba015 bash[29377]: audit 2021-03-10T17:12:19.602127+0000 mon.c (mon.1) 2943 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:12:20.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:12:20 gibba015 bash[29377]: cephadm 2021-03-10T17:12:19.602160+0000 mgr.gibba045.orlgmj (mgr.34412) 10731 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:12:20.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:12:20 gibba015 bash[29377]: cephadm 2021-03-10T17:12:19.602196+0000 mgr.gibba045.orlgmj (mgr.34412) 10732 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:12:20.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:12:20 gibba015 bash[29377]: cephadm 2021-03-10T17:12:19.603562+0000 mgr.gibba045.orlgmj (mgr.34412) 10733 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:12:20.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:12:20 gibba015 bash[29377]: cephadm 2021-03-10T17:12:19.603912+0000 mgr.gibba045.orlgmj (mgr.34412) 10734 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:12:20.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:12:20 gibba015 bash[29377]: cephadm 2021-03-10T17:12:19.605189+0000 mgr.gibba045.orlgmj (mgr.34412) 10735 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:12:20.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:12:20 gibba015 bash[29377]: cephadm 2021-03-10T17:12:19.605227+0000 mgr.gibba045.orlgmj (mgr.34412) 10736 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:12:20.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:12:20 gibba015 bash[29377]: cephadm 2021-03-10T17:12:19.605389+0000 mgr.gibba045.orlgmj (mgr.34412) 10737 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:12:20.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:12:20 gibba015 bash[29377]: cluster 2021-03-10T17:12:19.866452+0000 mgr.gibba045.orlgmj (mgr.34412) 10738 : cluster [DBG] pgmap v6114: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:20.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:12:20 gibba015 bash[30343]: audit 2021-03-10T17:12:19.588899+0000 mon.a (mon.0) 2287 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:12:20.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:12:20 gibba015 bash[30343]: audit 2021-03-10T17:12:19.592753+0000 mon.c (mon.1) 2938 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:12:20.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:12:20 gibba015 bash[30343]: cephadm 2021-03-10T17:12:19.594029+0000 mgr.gibba045.orlgmj (mgr.34412) 10724 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:12:20.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:12:20 gibba015 bash[30343]: audit 2021-03-10T17:12:19.594491+0000 mon.c (mon.1) 2939 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:12:20.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:12:20 gibba015 bash[30343]: audit 2021-03-10T17:12:19.595868+0000 mon.c (mon.1) 2940 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:12:20.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:12:20 gibba015 bash[30343]: cephadm 2021-03-10T17:12:19.596006+0000 mgr.gibba045.orlgmj (mgr.34412) 10725 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:12:20.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:12:20 gibba015 bash[30343]: audit 2021-03-10T17:12:19.597151+0000 mon.c (mon.1) 2941 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:12:20.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:12:20 gibba015 bash[30343]: cephadm 2021-03-10T17:12:19.597503+0000 mgr.gibba045.orlgmj (mgr.34412) 10726 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:12:20.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:12:20 gibba015 bash[30343]: cephadm 2021-03-10T17:12:19.597542+0000 mgr.gibba045.orlgmj (mgr.34412) 10727 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:12:20.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:12:20 gibba015 bash[30343]: cephadm 2021-03-10T17:12:19.598860+0000 mgr.gibba045.orlgmj (mgr.34412) 10728 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:12:20.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:12:20 gibba015 bash[30343]: cephadm 2021-03-10T17:12:19.598898+0000 mgr.gibba045.orlgmj (mgr.34412) 10729 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:12:20.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:12:20 gibba015 bash[30343]: cephadm 2021-03-10T17:12:19.600103+0000 mgr.gibba045.orlgmj (mgr.34412) 10730 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:12:20.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:12:20 gibba015 bash[30343]: audit 2021-03-10T17:12:19.600580+0000 mon.c (mon.1) 2942 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:12:20.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:12:20 gibba015 bash[30343]: audit 2021-03-10T17:12:19.602127+0000 mon.c (mon.1) 2943 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:12:20.984 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:12:20 gibba015 bash[30343]: cephadm 2021-03-10T17:12:19.602160+0000 mgr.gibba045.orlgmj (mgr.34412) 10731 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:12:20.984 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:12:20 gibba015 bash[30343]: cephadm 2021-03-10T17:12:19.602196+0000 mgr.gibba045.orlgmj (mgr.34412) 10732 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:12:20.986 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:12:20 gibba015 bash[30343]: cephadm 2021-03-10T17:12:19.603562+0000 mgr.gibba045.orlgmj (mgr.34412) 10733 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:12:20.986 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:12:20 gibba015 bash[30343]: cephadm 2021-03-10T17:12:19.603912+0000 mgr.gibba045.orlgmj (mgr.34412) 10734 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:12:20.987 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:12:20 gibba015 bash[30343]: cephadm 2021-03-10T17:12:19.605189+0000 mgr.gibba045.orlgmj (mgr.34412) 10735 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:12:20.990 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:12:20 gibba015 bash[30343]: cephadm 2021-03-10T17:12:19.605227+0000 mgr.gibba045.orlgmj (mgr.34412) 10736 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:12:20.990 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:12:20 gibba015 bash[30343]: cephadm 2021-03-10T17:12:19.605389+0000 mgr.gibba045.orlgmj (mgr.34412) 10737 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:12:20.991 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:12:20 gibba015 bash[30343]: cluster 2021-03-10T17:12:19.866452+0000 mgr.gibba045.orlgmj (mgr.34412) 10738 : cluster [DBG] pgmap v6114: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:21.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:12:20 gibba045 bash[25517]: audit 2021-03-10T17:12:19.588899+0000 mon.a (mon.0) 2287 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:12:21.237 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:12:20 gibba045 bash[25517]: audit 2021-03-10T17:12:19.592753+0000 mon.c (mon.1) 2938 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:12:21.237 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:12:20 gibba045 bash[25517]: cephadm 2021-03-10T17:12:19.594029+0000 mgr.gibba045.orlgmj (mgr.34412) 10724 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:12:21.238 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:12:20 gibba045 bash[25517]: audit 2021-03-10T17:12:19.594491+0000 mon.c (mon.1) 2939 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:12:21.238 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:12:20 gibba045 bash[25517]: audit 2021-03-10T17:12:19.595868+0000 mon.c (mon.1) 2940 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:12:21.238 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:12:20 gibba045 bash[25517]: cephadm 2021-03-10T17:12:19.596006+0000 mgr.gibba045.orlgmj (mgr.34412) 10725 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:12:21.238 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:12:20 gibba045 bash[25517]: audit 2021-03-10T17:12:19.597151+0000 mon.c (mon.1) 2941 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:12:21.239 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:12:20 gibba045 bash[25517]: cephadm 2021-03-10T17:12:19.597503+0000 mgr.gibba045.orlgmj (mgr.34412) 10726 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:12:21.239 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:12:20 gibba045 bash[25517]: cephadm 2021-03-10T17:12:19.597542+0000 mgr.gibba045.orlgmj (mgr.34412) 10727 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:12:21.239 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:12:20 gibba045 bash[25517]: cephadm 2021-03-10T17:12:19.598860+0000 mgr.gibba045.orlgmj (mgr.34412) 10728 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:12:21.239 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:12:20 gibba045 bash[25517]: cephadm 2021-03-10T17:12:19.598898+0000 mgr.gibba045.orlgmj (mgr.34412) 10729 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:12:21.240 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:12:20 gibba045 bash[25517]: cephadm 2021-03-10T17:12:19.600103+0000 mgr.gibba045.orlgmj (mgr.34412) 10730 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:12:21.240 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:12:20 gibba045 bash[25517]: audit 2021-03-10T17:12:19.600580+0000 mon.c (mon.1) 2942 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:12:21.240 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:12:20 gibba045 bash[25517]: audit 2021-03-10T17:12:19.602127+0000 mon.c (mon.1) 2943 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:12:21.240 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:12:20 gibba045 bash[25517]: cephadm 2021-03-10T17:12:19.602160+0000 mgr.gibba045.orlgmj (mgr.34412) 10731 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:12:21.240 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:12:20 gibba045 bash[25517]: cephadm 2021-03-10T17:12:19.602196+0000 mgr.gibba045.orlgmj (mgr.34412) 10732 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:12:21.241 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:12:20 gibba045 bash[25517]: cephadm 2021-03-10T17:12:19.603562+0000 mgr.gibba045.orlgmj (mgr.34412) 10733 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:12:21.241 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:12:20 gibba045 bash[25517]: cephadm 2021-03-10T17:12:19.603912+0000 mgr.gibba045.orlgmj (mgr.34412) 10734 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:12:21.241 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:12:20 gibba045 bash[25517]: cephadm 2021-03-10T17:12:19.605189+0000 mgr.gibba045.orlgmj (mgr.34412) 10735 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:12:21.241 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:12:20 gibba045 bash[25517]: cephadm 2021-03-10T17:12:19.605227+0000 mgr.gibba045.orlgmj (mgr.34412) 10736 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:12:21.242 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:12:20 gibba045 bash[25517]: cephadm 2021-03-10T17:12:19.605389+0000 mgr.gibba045.orlgmj (mgr.34412) 10737 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:12:21.242 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:12:20 gibba045 bash[25517]: cluster 2021-03-10T17:12:19.866452+0000 mgr.gibba045.orlgmj (mgr.34412) 10738 : cluster [DBG] pgmap v6114: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:23.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:12:22 gibba015 bash[29377]: cluster 2021-03-10T17:12:21.868101+0000 mgr.gibba045.orlgmj (mgr.34412) 10739 : cluster [DBG] pgmap v6115: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:23.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:12:22 gibba015 bash[30343]: cluster 2021-03-10T17:12:21.868101+0000 mgr.gibba045.orlgmj (mgr.34412) 10739 : cluster [DBG] pgmap v6115: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:23.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:12:22 gibba045 bash[25517]: cluster 2021-03-10T17:12:21.868101+0000 mgr.gibba045.orlgmj (mgr.34412) 10739 : cluster [DBG] pgmap v6115: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:25.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:12:24 gibba015 bash[29377]: cluster 2021-03-10T17:12:23.869314+0000 mgr.gibba045.orlgmj (mgr.34412) 10740 : cluster [DBG] pgmap v6116: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:25.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:12:24 gibba015 bash[30343]: cluster 2021-03-10T17:12:23.869314+0000 mgr.gibba045.orlgmj (mgr.34412) 10740 : cluster [DBG] pgmap v6116: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:25.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:12:24 gibba045 bash[25517]: cluster 2021-03-10T17:12:23.869314+0000 mgr.gibba045.orlgmj (mgr.34412) 10740 : cluster [DBG] pgmap v6116: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:26.839 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:12:27.070 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:12:27.070 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 5m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:12:27.070 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 4m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:12:27.070 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:12:27.071 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:12:27.071 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:12:27.071 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:12:27.071 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:12:27.072 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:12:27.072 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 5m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:12:27.072 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 4m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:12:27.072 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:12:27.072 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:12:27.073 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:12:27.073 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:12:27.073 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:12:27.073 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:12:27.073 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:12:27.074 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:12:27.075 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 4m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:12:27.075 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 4m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:12:27.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:12:26 gibba015 bash[29377]: cluster 2021-03-10T17:12:25.871025+0000 mgr.gibba045.orlgmj (mgr.34412) 10741 : cluster [DBG] pgmap v6117: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:27.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:12:26 gibba015 bash[30343]: cluster 2021-03-10T17:12:25.871025+0000 mgr.gibba045.orlgmj (mgr.34412) 10741 : cluster [DBG] pgmap v6117: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:27.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:12:26 gibba045 bash[25517]: cluster 2021-03-10T17:12:25.871025+0000 mgr.gibba045.orlgmj (mgr.34412) 10741 : cluster [DBG] pgmap v6117: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:27.318 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:12:27.318 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:12:27.319 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:12:27.319 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:12:27.319 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:12:27.319 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:12:27.319 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:12:27.320 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:12:27.320 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:12:27.320 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:12:27.320 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:12:27.321 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:12:27.321 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:12:27.321 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:12:27.321 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:12:28.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:12:27 gibba015 bash[29377]: audit 2021-03-10T17:12:26.830581+0000 mgr.gibba045.orlgmj (mgr.34412) 10742 : audit [DBG] from='client.51252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:12:28.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:12:27 gibba015 bash[29377]: audit 2021-03-10T17:12:27.058660+0000 mgr.gibba045.orlgmj (mgr.34412) 10743 : audit [DBG] from='client.51258 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:12:28.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:12:27 gibba015 bash[29377]: audit 2021-03-10T17:12:27.316189+0000 mon.c (mon.1) 2944 : audit [DBG] from='client.? 172.21.2.115:0/4172749472' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:12:28.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:12:27 gibba015 bash[30343]: audit 2021-03-10T17:12:26.830581+0000 mgr.gibba045.orlgmj (mgr.34412) 10742 : audit [DBG] from='client.51252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:12:28.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:12:27 gibba015 bash[30343]: audit 2021-03-10T17:12:27.058660+0000 mgr.gibba045.orlgmj (mgr.34412) 10743 : audit [DBG] from='client.51258 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:12:28.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:12:27 gibba015 bash[30343]: audit 2021-03-10T17:12:27.316189+0000 mon.c (mon.1) 2944 : audit [DBG] from='client.? 172.21.2.115:0/4172749472' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:12:28.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:12:27 gibba045 bash[25517]: audit 2021-03-10T17:12:26.830581+0000 mgr.gibba045.orlgmj (mgr.34412) 10742 : audit [DBG] from='client.51252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:12:28.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:12:27 gibba045 bash[25517]: audit 2021-03-10T17:12:27.058660+0000 mgr.gibba045.orlgmj (mgr.34412) 10743 : audit [DBG] from='client.51258 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:12:28.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:12:27 gibba045 bash[25517]: audit 2021-03-10T17:12:27.316189+0000 mon.c (mon.1) 2944 : audit [DBG] from='client.? 172.21.2.115:0/4172749472' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:12:29.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:12:28 gibba015 bash[29377]: cluster 2021-03-10T17:12:27.872645+0000 mgr.gibba045.orlgmj (mgr.34412) 10744 : cluster [DBG] pgmap v6118: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:29.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:12:28 gibba015 bash[30343]: cluster 2021-03-10T17:12:27.872645+0000 mgr.gibba045.orlgmj (mgr.34412) 10744 : cluster [DBG] pgmap v6118: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:29.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:12:28 gibba045 bash[25517]: cluster 2021-03-10T17:12:27.872645+0000 mgr.gibba045.orlgmj (mgr.34412) 10744 : cluster [DBG] pgmap v6118: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:31.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:12:30 gibba015 bash[29377]: cluster 2021-03-10T17:12:29.874361+0000 mgr.gibba045.orlgmj (mgr.34412) 10745 : cluster [DBG] pgmap v6119: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:31.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:12:30 gibba015 bash[30343]: cluster 2021-03-10T17:12:29.874361+0000 mgr.gibba045.orlgmj (mgr.34412) 10745 : cluster [DBG] pgmap v6119: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:31.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:12:30 gibba045 bash[25517]: cluster 2021-03-10T17:12:29.874361+0000 mgr.gibba045.orlgmj (mgr.34412) 10745 : cluster [DBG] pgmap v6119: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:33.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:12:32 gibba015 bash[29377]: cluster 2021-03-10T17:12:31.875999+0000 mgr.gibba045.orlgmj (mgr.34412) 10746 : cluster [DBG] pgmap v6120: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:33.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:12:32 gibba015 bash[30343]: cluster 2021-03-10T17:12:31.875999+0000 mgr.gibba045.orlgmj (mgr.34412) 10746 : cluster [DBG] pgmap v6120: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:33.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:12:32 gibba045 bash[25517]: cluster 2021-03-10T17:12:31.875999+0000 mgr.gibba045.orlgmj (mgr.34412) 10746 : cluster [DBG] pgmap v6120: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:35.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:12:34 gibba045 bash[25517]: cluster 2021-03-10T17:12:33.877256+0000 mgr.gibba045.orlgmj (mgr.34412) 10747 : cluster [DBG] pgmap v6121: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:35.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:12:34 gibba015 bash[29377]: cluster 2021-03-10T17:12:33.877256+0000 mgr.gibba045.orlgmj (mgr.34412) 10747 : cluster [DBG] pgmap v6121: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:35.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:12:34 gibba015 bash[30343]: cluster 2021-03-10T17:12:33.877256+0000 mgr.gibba045.orlgmj (mgr.34412) 10747 : cluster [DBG] pgmap v6121: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:36.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:12:35 gibba045 bash[25517]: cephadm 2021-03-10T17:12:34.621476+0000 mgr.gibba045.orlgmj (mgr.34412) 10748 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:12:36.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:12:35 gibba015 bash[29377]: cephadm 2021-03-10T17:12:34.621476+0000 mgr.gibba045.orlgmj (mgr.34412) 10748 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:12:36.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:12:35 gibba015 bash[30343]: cephadm 2021-03-10T17:12:34.621476+0000 mgr.gibba045.orlgmj (mgr.34412) 10748 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:12:37.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:12:36 gibba045 bash[25517]: cluster 2021-03-10T17:12:35.878965+0000 mgr.gibba045.orlgmj (mgr.34412) 10749 : cluster [DBG] pgmap v6122: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:37.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:12:36 gibba015 bash[30343]: cluster 2021-03-10T17:12:35.878965+0000 mgr.gibba045.orlgmj (mgr.34412) 10749 : cluster [DBG] pgmap v6122: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:37.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:12:36 gibba015 bash[29377]: cluster 2021-03-10T17:12:35.878965+0000 mgr.gibba045.orlgmj (mgr.34412) 10749 : cluster [DBG] pgmap v6122: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:38.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:12:38 gibba015 bash[29377]: cluster 2021-03-10T17:12:37.880656+0000 mgr.gibba045.orlgmj (mgr.34412) 10750 : cluster [DBG] pgmap v6123: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:38.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:12:38 gibba015 bash[30343]: cluster 2021-03-10T17:12:37.880656+0000 mgr.gibba045.orlgmj (mgr.34412) 10750 : cluster [DBG] pgmap v6123: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:38.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:12:38 gibba045 bash[25517]: cluster 2021-03-10T17:12:37.880656+0000 mgr.gibba045.orlgmj (mgr.34412) 10750 : cluster [DBG] pgmap v6123: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:41.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:12:40 gibba015 bash[29377]: cluster 2021-03-10T17:12:39.882306+0000 mgr.gibba045.orlgmj (mgr.34412) 10751 : cluster [DBG] pgmap v6124: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:41.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:12:40 gibba015 bash[30343]: cluster 2021-03-10T17:12:39.882306+0000 mgr.gibba045.orlgmj (mgr.34412) 10751 : cluster [DBG] pgmap v6124: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:41.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:12:40 gibba045 bash[25517]: cluster 2021-03-10T17:12:39.882306+0000 mgr.gibba045.orlgmj (mgr.34412) 10751 : cluster [DBG] pgmap v6124: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:43.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:12:42 gibba015 bash[29377]: cluster 2021-03-10T17:12:41.883949+0000 mgr.gibba045.orlgmj (mgr.34412) 10752 : cluster [DBG] pgmap v6125: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:43.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:12:42 gibba015 bash[30343]: cluster 2021-03-10T17:12:41.883949+0000 mgr.gibba045.orlgmj (mgr.34412) 10752 : cluster [DBG] pgmap v6125: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:43.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:12:42 gibba045 bash[25517]: cluster 2021-03-10T17:12:41.883949+0000 mgr.gibba045.orlgmj (mgr.34412) 10752 : cluster [DBG] pgmap v6125: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:45.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:12:44 gibba015 bash[29377]: cluster 2021-03-10T17:12:43.885200+0000 mgr.gibba045.orlgmj (mgr.34412) 10753 : cluster [DBG] pgmap v6126: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:45.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:12:44 gibba015 bash[30343]: cluster 2021-03-10T17:12:43.885200+0000 mgr.gibba045.orlgmj (mgr.34412) 10753 : cluster [DBG] pgmap v6126: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:45.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:12:44 gibba045 bash[25517]: cluster 2021-03-10T17:12:43.885200+0000 mgr.gibba045.orlgmj (mgr.34412) 10753 : cluster [DBG] pgmap v6126: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:47.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:12:46 gibba015 bash[29377]: cluster 2021-03-10T17:12:45.886966+0000 mgr.gibba045.orlgmj (mgr.34412) 10754 : cluster [DBG] pgmap v6127: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:47.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:12:46 gibba015 bash[30343]: cluster 2021-03-10T17:12:45.886966+0000 mgr.gibba045.orlgmj (mgr.34412) 10754 : cluster [DBG] pgmap v6127: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:47.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:12:46 gibba045 bash[25517]: cluster 2021-03-10T17:12:45.886966+0000 mgr.gibba045.orlgmj (mgr.34412) 10754 : cluster [DBG] pgmap v6127: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:48.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:12:48 gibba015 bash[29377]: cluster 2021-03-10T17:12:47.888664+0000 mgr.gibba045.orlgmj (mgr.34412) 10755 : cluster [DBG] pgmap v6128: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:48.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:12:48 gibba015 bash[30343]: cluster 2021-03-10T17:12:47.888664+0000 mgr.gibba045.orlgmj (mgr.34412) 10755 : cluster [DBG] pgmap v6128: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:48.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:12:48 gibba045 bash[25517]: cluster 2021-03-10T17:12:47.888664+0000 mgr.gibba045.orlgmj (mgr.34412) 10755 : cluster [DBG] pgmap v6128: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:51.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:12:50 gibba015 bash[29377]: cephadm 2021-03-10T17:12:49.637062+0000 mgr.gibba045.orlgmj (mgr.34412) 10756 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:12:51.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:12:50 gibba015 bash[29377]: cluster 2021-03-10T17:12:49.890347+0000 mgr.gibba045.orlgmj (mgr.34412) 10757 : cluster [DBG] pgmap v6129: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:51.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:12:50 gibba015 bash[30343]: cephadm 2021-03-10T17:12:49.637062+0000 mgr.gibba045.orlgmj (mgr.34412) 10756 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:12:51.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:12:50 gibba015 bash[30343]: cluster 2021-03-10T17:12:49.890347+0000 mgr.gibba045.orlgmj (mgr.34412) 10757 : cluster [DBG] pgmap v6129: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:51.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:12:50 gibba045 bash[25517]: cephadm 2021-03-10T17:12:49.637062+0000 mgr.gibba045.orlgmj (mgr.34412) 10756 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:12:51.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:12:50 gibba045 bash[25517]: cluster 2021-03-10T17:12:49.890347+0000 mgr.gibba045.orlgmj (mgr.34412) 10757 : cluster [DBG] pgmap v6129: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:53.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:12:52 gibba015 bash[29377]: cluster 2021-03-10T17:12:51.891973+0000 mgr.gibba045.orlgmj (mgr.34412) 10758 : cluster [DBG] pgmap v6130: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:53.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:12:52 gibba015 bash[30343]: cluster 2021-03-10T17:12:51.891973+0000 mgr.gibba045.orlgmj (mgr.34412) 10758 : cluster [DBG] pgmap v6130: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:53.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:12:52 gibba045 bash[25517]: cluster 2021-03-10T17:12:51.891973+0000 mgr.gibba045.orlgmj (mgr.34412) 10758 : cluster [DBG] pgmap v6130: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:54.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:12:53 gibba045 bash[25517]: audit 2021-03-10T17:12:53.926917+0000 mon.c (mon.1) 2945 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:12:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:12:53 gibba045 bash[25517]: audit 2021-03-10T17:12:53.927599+0000 mon.c (mon.1) 2946 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:12:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:12:53 gibba045 bash[25517]: audit 2021-03-10T17:12:53.928190+0000 mon.a (mon.0) 2288 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:12:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:12:53 gibba045 bash[25517]: audit 2021-03-10T17:12:53.929567+0000 mon.a (mon.0) 2289 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:12:54.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:12:53 gibba015 bash[29377]: audit 2021-03-10T17:12:53.926917+0000 mon.c (mon.1) 2945 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:12:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:12:53 gibba015 bash[29377]: audit 2021-03-10T17:12:53.927599+0000 mon.c (mon.1) 2946 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:12:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:12:53 gibba015 bash[29377]: audit 2021-03-10T17:12:53.928190+0000 mon.a (mon.0) 2288 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:12:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:12:53 gibba015 bash[29377]: audit 2021-03-10T17:12:53.929567+0000 mon.a (mon.0) 2289 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:12:54.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:12:53 gibba015 bash[30343]: audit 2021-03-10T17:12:53.926917+0000 mon.c (mon.1) 2945 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:12:54.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:12:53 gibba015 bash[30343]: audit 2021-03-10T17:12:53.927599+0000 mon.c (mon.1) 2946 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:12:54.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:12:53 gibba015 bash[30343]: audit 2021-03-10T17:12:53.928190+0000 mon.a (mon.0) 2288 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:12:54.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:12:53 gibba015 bash[30343]: audit 2021-03-10T17:12:53.929567+0000 mon.a (mon.0) 2289 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:12:55.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:12:54 gibba045 bash[25517]: cluster 2021-03-10T17:12:53.893462+0000 mgr.gibba045.orlgmj (mgr.34412) 10759 : cluster [DBG] pgmap v6131: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:55.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:12:54 gibba045 bash[25517]: audit 2021-03-10T17:12:54.003137+0000 mon.c (mon.1) 2947 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T17:12:55.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:12:54 gibba045 bash[25517]: audit 2021-03-10T17:12:54.003396+0000 mon.c (mon.1) 2948 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:12:55.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:12:54 gibba045 bash[25517]: audit 2021-03-10T17:12:54.003627+0000 mon.c (mon.1) 2949 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:12:55.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:12:54 gibba045 bash[25517]: audit 2021-03-10T17:12:54.003745+0000 mon.a (mon.0) 2290 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T17:12:55.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:12:54 gibba045 bash[25517]: audit 2021-03-10T17:12:54.003866+0000 mon.c (mon.1) 2950 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:12:55.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:12:54 gibba045 bash[25517]: audit 2021-03-10T17:12:54.004172+0000 mon.a (mon.0) 2291 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:12:55.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:12:54 gibba045 bash[25517]: audit 2021-03-10T17:12:54.004595+0000 mon.a (mon.0) 2292 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:12:55.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:12:54 gibba045 bash[25517]: audit 2021-03-10T17:12:54.004892+0000 mon.a (mon.0) 2293 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:12:55.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:12:54 gibba015 bash[30343]: cluster 2021-03-10T17:12:53.893462+0000 mgr.gibba045.orlgmj (mgr.34412) 10759 : cluster [DBG] pgmap v6131: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:55.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:12:54 gibba015 bash[30343]: audit 2021-03-10T17:12:54.003137+0000 mon.c (mon.1) 2947 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T17:12:55.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:12:54 gibba015 bash[30343]: audit 2021-03-10T17:12:54.003396+0000 mon.c (mon.1) 2948 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:12:55.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:12:54 gibba015 bash[30343]: audit 2021-03-10T17:12:54.003627+0000 mon.c (mon.1) 2949 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:12:55.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:12:54 gibba015 bash[30343]: audit 2021-03-10T17:12:54.003745+0000 mon.a (mon.0) 2290 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T17:12:55.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:12:54 gibba015 bash[30343]: audit 2021-03-10T17:12:54.003866+0000 mon.c (mon.1) 2950 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:12:55.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:12:54 gibba015 bash[30343]: audit 2021-03-10T17:12:54.004172+0000 mon.a (mon.0) 2291 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:12:55.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:12:54 gibba015 bash[30343]: audit 2021-03-10T17:12:54.004595+0000 mon.a (mon.0) 2292 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:12:55.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:12:54 gibba015 bash[30343]: audit 2021-03-10T17:12:54.004892+0000 mon.a (mon.0) 2293 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:12:55.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:12:54 gibba015 bash[29377]: cluster 2021-03-10T17:12:53.893462+0000 mgr.gibba045.orlgmj (mgr.34412) 10759 : cluster [DBG] pgmap v6131: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:55.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:12:54 gibba015 bash[29377]: audit 2021-03-10T17:12:54.003137+0000 mon.c (mon.1) 2947 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T17:12:55.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:12:54 gibba015 bash[29377]: audit 2021-03-10T17:12:54.003396+0000 mon.c (mon.1) 2948 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:12:55.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:12:54 gibba015 bash[29377]: audit 2021-03-10T17:12:54.003627+0000 mon.c (mon.1) 2949 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:12:55.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:12:54 gibba015 bash[29377]: audit 2021-03-10T17:12:54.003745+0000 mon.a (mon.0) 2290 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T17:12:55.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:12:54 gibba015 bash[29377]: audit 2021-03-10T17:12:54.003866+0000 mon.c (mon.1) 2950 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:12:55.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:12:54 gibba015 bash[29377]: audit 2021-03-10T17:12:54.004172+0000 mon.a (mon.0) 2291 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:12:55.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:12:54 gibba015 bash[29377]: audit 2021-03-10T17:12:54.004595+0000 mon.a (mon.0) 2292 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:12:55.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:12:54 gibba015 bash[29377]: audit 2021-03-10T17:12:54.004892+0000 mon.a (mon.0) 2293 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:12:57.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:12:56 gibba045 bash[25517]: cluster 2021-03-10T17:12:55.895208+0000 mgr.gibba045.orlgmj (mgr.34412) 10760 : cluster [DBG] pgmap v6132: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:57.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:12:56 gibba015 bash[29377]: cluster 2021-03-10T17:12:55.895208+0000 mgr.gibba045.orlgmj (mgr.34412) 10760 : cluster [DBG] pgmap v6132: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:57.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:12:56 gibba015 bash[30343]: cluster 2021-03-10T17:12:55.895208+0000 mgr.gibba045.orlgmj (mgr.34412) 10760 : cluster [DBG] pgmap v6132: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:57.560 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:12:57.785 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:12:57.785 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 5m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:12:57.786 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 4m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:12:57.786 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:12:57.786 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:12:57.786 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:12:57.787 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:12:57.787 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:12:57.787 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:12:57.787 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 5m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:12:57.788 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 4m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:12:57.788 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:12:57.788 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:12:57.788 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:12:57.788 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:12:57.789 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:12:57.789 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:12:57.789 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:12:57.789 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:12:57.789 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 4m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:12:57.790 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 4m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:12:58.033 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:12:58.033 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:12:58.033 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:12:58.033 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:12:58.034 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:12:58.034 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:12:58.034 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:12:58.035 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:12:58.035 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:12:58.035 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:12:58.035 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:12:58.036 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:12:58.036 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:12:58.036 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:12:58.036 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:12:58.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:12:58 gibba015 bash[29377]: audit 2021-03-10T17:12:57.552880+0000 mgr.gibba045.orlgmj (mgr.34412) 10761 : audit [DBG] from='client.61258 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:12:58.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:12:58 gibba015 bash[29377]: audit 2021-03-10T17:12:57.774006+0000 mgr.gibba045.orlgmj (mgr.34412) 10762 : audit [DBG] from='client.51276 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:12:58.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:12:58 gibba015 bash[29377]: cluster 2021-03-10T17:12:57.896943+0000 mgr.gibba045.orlgmj (mgr.34412) 10763 : cluster [DBG] pgmap v6133: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:58.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:12:58 gibba015 bash[29377]: audit 2021-03-10T17:12:58.031671+0000 mon.c (mon.1) 2951 : audit [DBG] from='client.? 172.21.2.115:0/3312246315' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:12:58.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:12:58 gibba015 bash[30343]: audit 2021-03-10T17:12:57.552880+0000 mgr.gibba045.orlgmj (mgr.34412) 10761 : audit [DBG] from='client.61258 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:12:58.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:12:58 gibba015 bash[30343]: audit 2021-03-10T17:12:57.774006+0000 mgr.gibba045.orlgmj (mgr.34412) 10762 : audit [DBG] from='client.51276 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:12:58.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:12:58 gibba015 bash[30343]: cluster 2021-03-10T17:12:57.896943+0000 mgr.gibba045.orlgmj (mgr.34412) 10763 : cluster [DBG] pgmap v6133: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:58.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:12:58 gibba015 bash[30343]: audit 2021-03-10T17:12:58.031671+0000 mon.c (mon.1) 2951 : audit [DBG] from='client.? 172.21.2.115:0/3312246315' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:12:58.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:12:58 gibba045 bash[25517]: audit 2021-03-10T17:12:57.552880+0000 mgr.gibba045.orlgmj (mgr.34412) 10761 : audit [DBG] from='client.61258 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:12:58.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:12:58 gibba045 bash[25517]: audit 2021-03-10T17:12:57.774006+0000 mgr.gibba045.orlgmj (mgr.34412) 10762 : audit [DBG] from='client.51276 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:12:58.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:12:58 gibba045 bash[25517]: cluster 2021-03-10T17:12:57.896943+0000 mgr.gibba045.orlgmj (mgr.34412) 10763 : cluster [DBG] pgmap v6133: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:58.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:12:58 gibba045 bash[25517]: audit 2021-03-10T17:12:58.031671+0000 mon.c (mon.1) 2951 : audit [DBG] from='client.? 172.21.2.115:0/3312246315' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:13:01.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:13:00 gibba015 bash[29377]: cluster 2021-03-10T17:12:59.898382+0000 mgr.gibba045.orlgmj (mgr.34412) 10764 : cluster [DBG] pgmap v6134: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:01.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:13:00 gibba015 bash[30343]: cluster 2021-03-10T17:12:59.898382+0000 mgr.gibba045.orlgmj (mgr.34412) 10764 : cluster [DBG] pgmap v6134: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:01.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:13:00 gibba045 bash[25517]: cluster 2021-03-10T17:12:59.898382+0000 mgr.gibba045.orlgmj (mgr.34412) 10764 : cluster [DBG] pgmap v6134: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:03.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:13:02 gibba015 bash[29377]: cluster 2021-03-10T17:13:01.900137+0000 mgr.gibba045.orlgmj (mgr.34412) 10765 : cluster [DBG] pgmap v6135: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:03.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:13:02 gibba015 bash[30343]: cluster 2021-03-10T17:13:01.900137+0000 mgr.gibba045.orlgmj (mgr.34412) 10765 : cluster [DBG] pgmap v6135: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:03.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:13:02 gibba045 bash[25517]: cluster 2021-03-10T17:13:01.900137+0000 mgr.gibba045.orlgmj (mgr.34412) 10765 : cluster [DBG] pgmap v6135: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:05.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:13:04 gibba045 bash[25517]: cluster 2021-03-10T17:13:03.901335+0000 mgr.gibba045.orlgmj (mgr.34412) 10766 : cluster [DBG] pgmap v6136: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:05.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:13:04 gibba015 bash[29377]: cluster 2021-03-10T17:13:03.901335+0000 mgr.gibba045.orlgmj (mgr.34412) 10766 : cluster [DBG] pgmap v6136: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:05.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:13:04 gibba015 bash[30343]: cluster 2021-03-10T17:13:03.901335+0000 mgr.gibba045.orlgmj (mgr.34412) 10766 : cluster [DBG] pgmap v6136: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:06.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:13:05 gibba045 bash[25517]: cephadm 2021-03-10T17:13:04.652398+0000 mgr.gibba045.orlgmj (mgr.34412) 10767 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:13:06.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:13:05 gibba015 bash[29377]: cephadm 2021-03-10T17:13:04.652398+0000 mgr.gibba045.orlgmj (mgr.34412) 10767 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:13:06.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:13:05 gibba015 bash[30343]: cephadm 2021-03-10T17:13:04.652398+0000 mgr.gibba045.orlgmj (mgr.34412) 10767 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:13:07.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:13:06 gibba045 bash[25517]: cluster 2021-03-10T17:13:05.902956+0000 mgr.gibba045.orlgmj (mgr.34412) 10768 : cluster [DBG] pgmap v6137: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:07.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:13:06 gibba015 bash[29377]: cluster 2021-03-10T17:13:05.902956+0000 mgr.gibba045.orlgmj (mgr.34412) 10768 : cluster [DBG] pgmap v6137: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:07.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:13:06 gibba015 bash[30343]: cluster 2021-03-10T17:13:05.902956+0000 mgr.gibba045.orlgmj (mgr.34412) 10768 : cluster [DBG] pgmap v6137: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:08.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:13:08 gibba045 bash[25517]: cluster 2021-03-10T17:13:07.904362+0000 mgr.gibba045.orlgmj (mgr.34412) 10769 : cluster [DBG] pgmap v6138: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:08.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:13:08 gibba015 bash[29377]: cluster 2021-03-10T17:13:07.904362+0000 mgr.gibba045.orlgmj (mgr.34412) 10769 : cluster [DBG] pgmap v6138: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:08.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:13:08 gibba015 bash[30343]: cluster 2021-03-10T17:13:07.904362+0000 mgr.gibba045.orlgmj (mgr.34412) 10769 : cluster [DBG] pgmap v6138: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:11.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:13:10 gibba015 bash[29377]: cluster 2021-03-10T17:13:09.905944+0000 mgr.gibba045.orlgmj (mgr.34412) 10770 : cluster [DBG] pgmap v6139: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:11.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:13:10 gibba015 bash[30343]: cluster 2021-03-10T17:13:09.905944+0000 mgr.gibba045.orlgmj (mgr.34412) 10770 : cluster [DBG] pgmap v6139: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:11.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:13:10 gibba045 bash[25517]: cluster 2021-03-10T17:13:09.905944+0000 mgr.gibba045.orlgmj (mgr.34412) 10770 : cluster [DBG] pgmap v6139: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:13.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:13:12 gibba045 bash[25517]: cluster 2021-03-10T17:13:11.907684+0000 mgr.gibba045.orlgmj (mgr.34412) 10771 : cluster [DBG] pgmap v6140: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:13.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:13:12 gibba015 bash[29377]: cluster 2021-03-10T17:13:11.907684+0000 mgr.gibba045.orlgmj (mgr.34412) 10771 : cluster [DBG] pgmap v6140: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:13.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:13:12 gibba015 bash[30343]: cluster 2021-03-10T17:13:11.907684+0000 mgr.gibba045.orlgmj (mgr.34412) 10771 : cluster [DBG] pgmap v6140: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:15.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:13:14 gibba045 bash[25517]: cluster 2021-03-10T17:13:13.909069+0000 mgr.gibba045.orlgmj (mgr.34412) 10772 : cluster [DBG] pgmap v6141: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:15.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:13:14 gibba015 bash[29377]: cluster 2021-03-10T17:13:13.909069+0000 mgr.gibba045.orlgmj (mgr.34412) 10772 : cluster [DBG] pgmap v6141: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:15.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:13:14 gibba015 bash[30343]: cluster 2021-03-10T17:13:13.909069+0000 mgr.gibba045.orlgmj (mgr.34412) 10772 : cluster [DBG] pgmap v6141: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:17.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:13:16 gibba045 bash[25517]: cluster 2021-03-10T17:13:15.910611+0000 mgr.gibba045.orlgmj (mgr.34412) 10773 : cluster [DBG] pgmap v6142: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:17.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:13:16 gibba015 bash[29377]: cluster 2021-03-10T17:13:15.910611+0000 mgr.gibba045.orlgmj (mgr.34412) 10773 : cluster [DBG] pgmap v6142: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:17.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:13:16 gibba015 bash[30343]: cluster 2021-03-10T17:13:15.910611+0000 mgr.gibba045.orlgmj (mgr.34412) 10773 : cluster [DBG] pgmap v6142: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:18.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:13:18 gibba045 bash[25517]: cluster 2021-03-10T17:13:17.912144+0000 mgr.gibba045.orlgmj (mgr.34412) 10774 : cluster [DBG] pgmap v6143: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:18.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:13:18 gibba015 bash[29377]: cluster 2021-03-10T17:13:17.912144+0000 mgr.gibba045.orlgmj (mgr.34412) 10774 : cluster [DBG] pgmap v6143: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:18.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:13:18 gibba015 bash[30343]: cluster 2021-03-10T17:13:17.912144+0000 mgr.gibba045.orlgmj (mgr.34412) 10774 : cluster [DBG] pgmap v6143: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:20.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:13:19 gibba045 bash[25517]: audit 2021-03-10T17:13:19.667240+0000 mon.c (mon.1) 2952 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:13:20.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:13:19 gibba015 bash[29377]: audit 2021-03-10T17:13:19.667240+0000 mon.c (mon.1) 2952 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:13:20.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:13:19 gibba015 bash[30343]: audit 2021-03-10T17:13:19.667240+0000 mon.c (mon.1) 2952 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:13:21.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:13:20 gibba015 bash[29377]: cephadm 2021-03-10T17:13:19.674472+0000 mgr.gibba045.orlgmj (mgr.34412) 10775 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:13:21.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:13:20 gibba015 bash[29377]: cephadm 2021-03-10T17:13:19.676387+0000 mgr.gibba045.orlgmj (mgr.34412) 10776 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:13:21.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:13:20 gibba015 bash[29377]: audit 2021-03-10T17:13:19.884663+0000 mon.a (mon.0) 2294 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:13:21.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:13:20 gibba015 bash[29377]: audit 2021-03-10T17:13:19.888210+0000 mon.c (mon.1) 2953 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:13:21.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:13:20 gibba015 bash[29377]: cephadm 2021-03-10T17:13:19.889685+0000 mgr.gibba045.orlgmj (mgr.34412) 10777 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:13:21.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:13:20 gibba015 bash[29377]: audit 2021-03-10T17:13:19.889686+0000 mon.c (mon.1) 2954 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:13:21.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:13:20 gibba015 bash[29377]: audit 2021-03-10T17:13:19.891226+0000 mon.c (mon.1) 2955 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:13:21.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:13:20 gibba015 bash[29377]: cephadm 2021-03-10T17:13:19.891300+0000 mgr.gibba045.orlgmj (mgr.34412) 10778 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:13:21.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:13:20 gibba015 bash[29377]: cephadm 2021-03-10T17:13:19.892677+0000 mgr.gibba045.orlgmj (mgr.34412) 10779 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:13:21.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:13:20 gibba015 bash[29377]: cephadm 2021-03-10T17:13:19.892713+0000 mgr.gibba045.orlgmj (mgr.34412) 10780 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:13:21.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:13:20 gibba015 bash[29377]: audit 2021-03-10T17:13:19.892725+0000 mon.c (mon.1) 2956 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:13:21.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:13:20 gibba015 bash[29377]: cephadm 2021-03-10T17:13:19.894386+0000 mgr.gibba045.orlgmj (mgr.34412) 10781 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:13:21.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:13:20 gibba015 bash[29377]: cephadm 2021-03-10T17:13:19.894423+0000 mgr.gibba045.orlgmj (mgr.34412) 10782 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:13:21.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:13:20 gibba015 bash[29377]: cephadm 2021-03-10T17:13:19.895877+0000 mgr.gibba045.orlgmj (mgr.34412) 10783 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:13:21.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:13:20 gibba015 bash[29377]: audit 2021-03-10T17:13:19.896207+0000 mon.c (mon.1) 2957 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:13:21.230 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:13:20 gibba015 bash[29377]: audit 2021-03-10T17:13:19.897629+0000 mon.c (mon.1) 2958 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:13:21.231 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:13:20 gibba015 bash[29377]: cephadm 2021-03-10T17:13:19.897737+0000 mgr.gibba045.orlgmj (mgr.34412) 10784 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:13:21.231 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:13:20 gibba015 bash[29377]: cephadm 2021-03-10T17:13:19.897774+0000 mgr.gibba045.orlgmj (mgr.34412) 10785 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:13:21.231 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:13:20 gibba015 bash[29377]: cephadm 2021-03-10T17:13:19.899207+0000 mgr.gibba045.orlgmj (mgr.34412) 10786 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:13:21.231 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:13:20 gibba015 bash[29377]: cephadm 2021-03-10T17:13:19.899527+0000 mgr.gibba045.orlgmj (mgr.34412) 10787 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:13:21.232 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:13:20 gibba015 bash[29377]: cephadm 2021-03-10T17:13:19.900635+0000 mgr.gibba045.orlgmj (mgr.34412) 10788 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:13:21.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:13:20 gibba015 bash[30343]: cephadm 2021-03-10T17:13:19.674472+0000 mgr.gibba045.orlgmj (mgr.34412) 10775 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:13:21.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:13:20 gibba015 bash[30343]: cephadm 2021-03-10T17:13:19.676387+0000 mgr.gibba045.orlgmj (mgr.34412) 10776 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:13:21.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:13:20 gibba015 bash[30343]: audit 2021-03-10T17:13:19.884663+0000 mon.a (mon.0) 2294 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:13:21.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:13:20 gibba015 bash[30343]: audit 2021-03-10T17:13:19.888210+0000 mon.c (mon.1) 2953 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:13:21.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:13:20 gibba015 bash[30343]: cephadm 2021-03-10T17:13:19.889685+0000 mgr.gibba045.orlgmj (mgr.34412) 10777 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:13:21.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:13:20 gibba015 bash[30343]: audit 2021-03-10T17:13:19.889686+0000 mon.c (mon.1) 2954 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:13:21.234 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:13:20 gibba015 bash[30343]: audit 2021-03-10T17:13:19.891226+0000 mon.c (mon.1) 2955 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:13:21.234 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:13:20 gibba015 bash[30343]: cephadm 2021-03-10T17:13:19.891300+0000 mgr.gibba045.orlgmj (mgr.34412) 10778 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:13:21.235 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:13:20 gibba015 bash[30343]: cephadm 2021-03-10T17:13:19.892677+0000 mgr.gibba045.orlgmj (mgr.34412) 10779 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:13:21.235 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:13:20 gibba015 bash[30343]: cephadm 2021-03-10T17:13:19.892713+0000 mgr.gibba045.orlgmj (mgr.34412) 10780 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:13:21.235 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:13:20 gibba015 bash[30343]: audit 2021-03-10T17:13:19.892725+0000 mon.c (mon.1) 2956 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:13:21.235 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:13:20 gibba015 bash[30343]: cephadm 2021-03-10T17:13:19.894386+0000 mgr.gibba045.orlgmj (mgr.34412) 10781 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:13:21.236 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:13:20 gibba015 bash[30343]: cephadm 2021-03-10T17:13:19.894423+0000 mgr.gibba045.orlgmj (mgr.34412) 10782 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:13:21.236 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:13:20 gibba015 bash[30343]: cephadm 2021-03-10T17:13:19.895877+0000 mgr.gibba045.orlgmj (mgr.34412) 10783 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:13:21.236 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:13:20 gibba015 bash[30343]: audit 2021-03-10T17:13:19.896207+0000 mon.c (mon.1) 2957 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:13:21.236 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:13:20 gibba015 bash[30343]: audit 2021-03-10T17:13:19.897629+0000 mon.c (mon.1) 2958 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:13:21.236 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:13:20 gibba015 bash[30343]: cephadm 2021-03-10T17:13:19.897737+0000 mgr.gibba045.orlgmj (mgr.34412) 10784 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:13:21.237 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:13:20 gibba015 bash[30343]: cephadm 2021-03-10T17:13:19.897774+0000 mgr.gibba045.orlgmj (mgr.34412) 10785 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:13:21.237 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:13:20 gibba015 bash[30343]: cephadm 2021-03-10T17:13:19.899207+0000 mgr.gibba045.orlgmj (mgr.34412) 10786 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:13:21.237 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:13:20 gibba015 bash[30343]: cephadm 2021-03-10T17:13:19.899527+0000 mgr.gibba045.orlgmj (mgr.34412) 10787 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:13:21.237 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:13:20 gibba015 bash[30343]: cephadm 2021-03-10T17:13:19.900635+0000 mgr.gibba045.orlgmj (mgr.34412) 10788 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:13:21.238 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:13:20 gibba015 bash[29377]: cephadm 2021-03-10T17:13:19.900673+0000 mgr.gibba045.orlgmj (mgr.34412) 10789 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:13:21.238 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:13:20 gibba015 bash[29377]: cephadm 2021-03-10T17:13:19.900780+0000 mgr.gibba045.orlgmj (mgr.34412) 10790 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:13:21.238 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:13:20 gibba015 bash[29377]: cluster 2021-03-10T17:13:19.912961+0000 mgr.gibba045.orlgmj (mgr.34412) 10791 : cluster [DBG] pgmap v6144: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:21.239 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:13:20 gibba015 bash[30343]: cephadm 2021-03-10T17:13:19.900673+0000 mgr.gibba045.orlgmj (mgr.34412) 10789 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:13:21.239 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:13:20 gibba015 bash[30343]: cephadm 2021-03-10T17:13:19.900780+0000 mgr.gibba045.orlgmj (mgr.34412) 10790 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:13:21.239 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:13:20 gibba015 bash[30343]: cluster 2021-03-10T17:13:19.912961+0000 mgr.gibba045.orlgmj (mgr.34412) 10791 : cluster [DBG] pgmap v6144: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:21.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:13:20 gibba045 bash[25517]: cephadm 2021-03-10T17:13:19.674472+0000 mgr.gibba045.orlgmj (mgr.34412) 10775 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:13:21.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:13:20 gibba045 bash[25517]: cephadm 2021-03-10T17:13:19.676387+0000 mgr.gibba045.orlgmj (mgr.34412) 10776 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:13:21.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:13:20 gibba045 bash[25517]: audit 2021-03-10T17:13:19.884663+0000 mon.a (mon.0) 2294 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:13:21.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:13:20 gibba045 bash[25517]: audit 2021-03-10T17:13:19.888210+0000 mon.c (mon.1) 2953 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:13:21.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:13:20 gibba045 bash[25517]: cephadm 2021-03-10T17:13:19.889685+0000 mgr.gibba045.orlgmj (mgr.34412) 10777 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:13:21.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:13:20 gibba045 bash[25517]: audit 2021-03-10T17:13:19.889686+0000 mon.c (mon.1) 2954 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:13:21.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:13:20 gibba045 bash[25517]: audit 2021-03-10T17:13:19.891226+0000 mon.c (mon.1) 2955 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:13:21.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:13:20 gibba045 bash[25517]: cephadm 2021-03-10T17:13:19.891300+0000 mgr.gibba045.orlgmj (mgr.34412) 10778 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:13:21.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:13:20 gibba045 bash[25517]: cephadm 2021-03-10T17:13:19.892677+0000 mgr.gibba045.orlgmj (mgr.34412) 10779 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:13:21.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:13:20 gibba045 bash[25517]: cephadm 2021-03-10T17:13:19.892713+0000 mgr.gibba045.orlgmj (mgr.34412) 10780 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:13:21.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:13:20 gibba045 bash[25517]: audit 2021-03-10T17:13:19.892725+0000 mon.c (mon.1) 2956 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:13:21.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:13:20 gibba045 bash[25517]: cephadm 2021-03-10T17:13:19.894386+0000 mgr.gibba045.orlgmj (mgr.34412) 10781 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:13:21.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:13:20 gibba045 bash[25517]: cephadm 2021-03-10T17:13:19.894423+0000 mgr.gibba045.orlgmj (mgr.34412) 10782 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:13:21.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:13:20 gibba045 bash[25517]: cephadm 2021-03-10T17:13:19.895877+0000 mgr.gibba045.orlgmj (mgr.34412) 10783 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:13:21.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:13:20 gibba045 bash[25517]: audit 2021-03-10T17:13:19.896207+0000 mon.c (mon.1) 2957 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:13:21.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:13:20 gibba045 bash[25517]: audit 2021-03-10T17:13:19.897629+0000 mon.c (mon.1) 2958 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:13:21.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:13:20 gibba045 bash[25517]: cephadm 2021-03-10T17:13:19.897737+0000 mgr.gibba045.orlgmj (mgr.34412) 10784 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:13:21.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:13:20 gibba045 bash[25517]: cephadm 2021-03-10T17:13:19.897774+0000 mgr.gibba045.orlgmj (mgr.34412) 10785 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:13:21.312 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:13:20 gibba045 bash[25517]: cephadm 2021-03-10T17:13:19.899207+0000 mgr.gibba045.orlgmj (mgr.34412) 10786 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:13:21.312 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:13:20 gibba045 bash[25517]: cephadm 2021-03-10T17:13:19.899527+0000 mgr.gibba045.orlgmj (mgr.34412) 10787 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:13:21.312 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:13:20 gibba045 bash[25517]: cephadm 2021-03-10T17:13:19.900635+0000 mgr.gibba045.orlgmj (mgr.34412) 10788 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:13:21.312 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:13:20 gibba045 bash[25517]: cephadm 2021-03-10T17:13:19.900673+0000 mgr.gibba045.orlgmj (mgr.34412) 10789 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:13:21.313 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:13:20 gibba045 bash[25517]: cephadm 2021-03-10T17:13:19.900780+0000 mgr.gibba045.orlgmj (mgr.34412) 10790 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:13:21.313 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:13:20 gibba045 bash[25517]: cluster 2021-03-10T17:13:19.912961+0000 mgr.gibba045.orlgmj (mgr.34412) 10791 : cluster [DBG] pgmap v6144: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:23.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:13:22 gibba045 bash[25517]: cluster 2021-03-10T17:13:21.914622+0000 mgr.gibba045.orlgmj (mgr.34412) 10792 : cluster [DBG] pgmap v6145: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:23.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:13:22 gibba015 bash[29377]: cluster 2021-03-10T17:13:21.914622+0000 mgr.gibba045.orlgmj (mgr.34412) 10792 : cluster [DBG] pgmap v6145: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:23.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:13:22 gibba015 bash[30343]: cluster 2021-03-10T17:13:21.914622+0000 mgr.gibba045.orlgmj (mgr.34412) 10792 : cluster [DBG] pgmap v6145: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:25.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:13:24 gibba045 bash[25517]: cluster 2021-03-10T17:13:23.915873+0000 mgr.gibba045.orlgmj (mgr.34412) 10793 : cluster [DBG] pgmap v6146: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:25.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:13:24 gibba015 bash[29377]: cluster 2021-03-10T17:13:23.915873+0000 mgr.gibba045.orlgmj (mgr.34412) 10793 : cluster [DBG] pgmap v6146: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:25.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:13:24 gibba015 bash[30343]: cluster 2021-03-10T17:13:23.915873+0000 mgr.gibba045.orlgmj (mgr.34412) 10793 : cluster [DBG] pgmap v6146: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:27.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:13:26 gibba045 bash[25517]: cluster 2021-03-10T17:13:25.917547+0000 mgr.gibba045.orlgmj (mgr.34412) 10794 : cluster [DBG] pgmap v6147: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:27.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:13:26 gibba015 bash[29377]: cluster 2021-03-10T17:13:25.917547+0000 mgr.gibba045.orlgmj (mgr.34412) 10794 : cluster [DBG] pgmap v6147: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:27.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:13:26 gibba015 bash[30343]: cluster 2021-03-10T17:13:25.917547+0000 mgr.gibba045.orlgmj (mgr.34412) 10794 : cluster [DBG] pgmap v6147: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:28.270 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:13:28.497 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:13:28.497 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 6m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:13:28.497 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 5m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:13:28.498 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:13:28.498 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:13:28.498 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:13:28.498 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:13:28.499 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:13:28.499 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:13:28.499 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 6m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:13:28.499 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 5m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:13:28.499 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:13:28.500 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:13:28.500 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:13:28.500 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:13:28.500 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:13:28.501 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:13:28.501 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:13:28.501 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:13:28.501 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 5m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:13:28.502 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 5m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:13:28.749 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:13:28.750 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:13:28.750 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:13:28.750 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:13:28.750 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:13:28.751 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:13:28.751 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:13:28.751 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:13:28.751 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:13:28.751 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:13:28.752 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:13:28.752 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:13:28.752 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:13:28.752 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:13:28.753 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:13:28.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:13:28 gibba045 bash[25517]: cluster 2021-03-10T17:13:27.919162+0000 mgr.gibba045.orlgmj (mgr.34412) 10795 : cluster [DBG] pgmap v6148: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:28.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:13:28 gibba045 bash[25517]: audit 2021-03-10T17:13:28.264038+0000 mgr.gibba045.orlgmj (mgr.34412) 10796 : audit [DBG] from='client.61276 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:13:28.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:13:28 gibba015 bash[29377]: cluster 2021-03-10T17:13:27.919162+0000 mgr.gibba045.orlgmj (mgr.34412) 10795 : cluster [DBG] pgmap v6148: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:28.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:13:28 gibba015 bash[29377]: audit 2021-03-10T17:13:28.264038+0000 mgr.gibba045.orlgmj (mgr.34412) 10796 : audit [DBG] from='client.61276 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:13:28.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:13:28 gibba015 bash[30343]: cluster 2021-03-10T17:13:27.919162+0000 mgr.gibba045.orlgmj (mgr.34412) 10795 : cluster [DBG] pgmap v6148: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:28.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:13:28 gibba015 bash[30343]: audit 2021-03-10T17:13:28.264038+0000 mgr.gibba045.orlgmj (mgr.34412) 10796 : audit [DBG] from='client.61276 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:13:29.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:13:29 gibba045 bash[25517]: audit 2021-03-10T17:13:28.486733+0000 mgr.gibba045.orlgmj (mgr.34412) 10797 : audit [DBG] from='client.51294 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:13:29.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:13:29 gibba045 bash[25517]: audit 2021-03-10T17:13:28.748329+0000 mon.a (mon.0) 2295 : audit [DBG] from='client.? 172.21.2.115:0/3555010403' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:13:29.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:13:29 gibba015 bash[29377]: audit 2021-03-10T17:13:28.486733+0000 mgr.gibba045.orlgmj (mgr.34412) 10797 : audit [DBG] from='client.51294 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:13:29.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:13:29 gibba015 bash[29377]: audit 2021-03-10T17:13:28.748329+0000 mon.a (mon.0) 2295 : audit [DBG] from='client.? 172.21.2.115:0/3555010403' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:13:29.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:13:29 gibba015 bash[30343]: audit 2021-03-10T17:13:28.486733+0000 mgr.gibba045.orlgmj (mgr.34412) 10797 : audit [DBG] from='client.51294 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:13:29.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:13:29 gibba015 bash[30343]: audit 2021-03-10T17:13:28.748329+0000 mon.a (mon.0) 2295 : audit [DBG] from='client.? 172.21.2.115:0/3555010403' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:13:30.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:13:30 gibba045 bash[25517]: cluster 2021-03-10T17:13:29.920844+0000 mgr.gibba045.orlgmj (mgr.34412) 10798 : cluster [DBG] pgmap v6149: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:30.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:13:30 gibba015 bash[29377]: cluster 2021-03-10T17:13:29.920844+0000 mgr.gibba045.orlgmj (mgr.34412) 10798 : cluster [DBG] pgmap v6149: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:30.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:13:30 gibba015 bash[30343]: cluster 2021-03-10T17:13:29.920844+0000 mgr.gibba045.orlgmj (mgr.34412) 10798 : cluster [DBG] pgmap v6149: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:33.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:13:32 gibba045 bash[25517]: cluster 2021-03-10T17:13:31.922615+0000 mgr.gibba045.orlgmj (mgr.34412) 10799 : cluster [DBG] pgmap v6150: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:33.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:13:32 gibba015 bash[29377]: cluster 2021-03-10T17:13:31.922615+0000 mgr.gibba045.orlgmj (mgr.34412) 10799 : cluster [DBG] pgmap v6150: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:33.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:13:32 gibba015 bash[30343]: cluster 2021-03-10T17:13:31.922615+0000 mgr.gibba045.orlgmj (mgr.34412) 10799 : cluster [DBG] pgmap v6150: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:35.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:13:34 gibba045 bash[25517]: cluster 2021-03-10T17:13:33.923867+0000 mgr.gibba045.orlgmj (mgr.34412) 10800 : cluster [DBG] pgmap v6151: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:35.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:13:34 gibba015 bash[29377]: cluster 2021-03-10T17:13:33.923867+0000 mgr.gibba045.orlgmj (mgr.34412) 10800 : cluster [DBG] pgmap v6151: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:35.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:13:34 gibba015 bash[30343]: cluster 2021-03-10T17:13:33.923867+0000 mgr.gibba045.orlgmj (mgr.34412) 10800 : cluster [DBG] pgmap v6151: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:36.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:13:36 gibba045 bash[25517]: cephadm 2021-03-10T17:13:34.910270+0000 mgr.gibba045.orlgmj (mgr.34412) 10801 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:13:36.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:13:36 gibba015 bash[29377]: cephadm 2021-03-10T17:13:34.910270+0000 mgr.gibba045.orlgmj (mgr.34412) 10801 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:13:36.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:13:36 gibba015 bash[30343]: cephadm 2021-03-10T17:13:34.910270+0000 mgr.gibba045.orlgmj (mgr.34412) 10801 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:13:37.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:13:37 gibba045 bash[25517]: cluster 2021-03-10T17:13:35.925514+0000 mgr.gibba045.orlgmj (mgr.34412) 10802 : cluster [DBG] pgmap v6152: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:37.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:13:37 gibba015 bash[29377]: cluster 2021-03-10T17:13:35.925514+0000 mgr.gibba045.orlgmj (mgr.34412) 10802 : cluster [DBG] pgmap v6152: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:37.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:13:37 gibba015 bash[30343]: cluster 2021-03-10T17:13:35.925514+0000 mgr.gibba045.orlgmj (mgr.34412) 10802 : cluster [DBG] pgmap v6152: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:38.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:13:38 gibba045 bash[25517]: cluster 2021-03-10T17:13:37.927210+0000 mgr.gibba045.orlgmj (mgr.34412) 10803 : cluster [DBG] pgmap v6153: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:38.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:13:38 gibba015 bash[29377]: cluster 2021-03-10T17:13:37.927210+0000 mgr.gibba045.orlgmj (mgr.34412) 10803 : cluster [DBG] pgmap v6153: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:38.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:13:38 gibba015 bash[30343]: cluster 2021-03-10T17:13:37.927210+0000 mgr.gibba045.orlgmj (mgr.34412) 10803 : cluster [DBG] pgmap v6153: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:41.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:13:40 gibba045 bash[25517]: cluster 2021-03-10T17:13:39.928780+0000 mgr.gibba045.orlgmj (mgr.34412) 10804 : cluster [DBG] pgmap v6154: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:41.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:13:40 gibba015 bash[29377]: cluster 2021-03-10T17:13:39.928780+0000 mgr.gibba045.orlgmj (mgr.34412) 10804 : cluster [DBG] pgmap v6154: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:41.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:13:40 gibba015 bash[30343]: cluster 2021-03-10T17:13:39.928780+0000 mgr.gibba045.orlgmj (mgr.34412) 10804 : cluster [DBG] pgmap v6154: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:43.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:13:43 gibba045 bash[25517]: cluster 2021-03-10T17:13:41.930297+0000 mgr.gibba045.orlgmj (mgr.34412) 10805 : cluster [DBG] pgmap v6155: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:43.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:13:42 gibba015 bash[29377]: cluster 2021-03-10T17:13:41.930297+0000 mgr.gibba045.orlgmj (mgr.34412) 10805 : cluster [DBG] pgmap v6155: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:43.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:13:43 gibba015 bash[30343]: cluster 2021-03-10T17:13:41.930297+0000 mgr.gibba045.orlgmj (mgr.34412) 10805 : cluster [DBG] pgmap v6155: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:45.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:13:45 gibba045 bash[25517]: cluster 2021-03-10T17:13:43.931508+0000 mgr.gibba045.orlgmj (mgr.34412) 10806 : cluster [DBG] pgmap v6156: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:45.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:13:45 gibba015 bash[29377]: cluster 2021-03-10T17:13:43.931508+0000 mgr.gibba045.orlgmj (mgr.34412) 10806 : cluster [DBG] pgmap v6156: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:45.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:13:45 gibba015 bash[30343]: cluster 2021-03-10T17:13:43.931508+0000 mgr.gibba045.orlgmj (mgr.34412) 10806 : cluster [DBG] pgmap v6156: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:47.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:13:47 gibba045 bash[25517]: cluster 2021-03-10T17:13:45.933207+0000 mgr.gibba045.orlgmj (mgr.34412) 10807 : cluster [DBG] pgmap v6157: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:47.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:13:47 gibba015 bash[29377]: cluster 2021-03-10T17:13:45.933207+0000 mgr.gibba045.orlgmj (mgr.34412) 10807 : cluster [DBG] pgmap v6157: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:47.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:13:47 gibba015 bash[30343]: cluster 2021-03-10T17:13:45.933207+0000 mgr.gibba045.orlgmj (mgr.34412) 10807 : cluster [DBG] pgmap v6157: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:48.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:13:48 gibba045 bash[25517]: cluster 2021-03-10T17:13:47.934571+0000 mgr.gibba045.orlgmj (mgr.34412) 10808 : cluster [DBG] pgmap v6158: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:48.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:13:48 gibba015 bash[29377]: cluster 2021-03-10T17:13:47.934571+0000 mgr.gibba045.orlgmj (mgr.34412) 10808 : cluster [DBG] pgmap v6158: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:48.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:13:48 gibba015 bash[30343]: cluster 2021-03-10T17:13:47.934571+0000 mgr.gibba045.orlgmj (mgr.34412) 10808 : cluster [DBG] pgmap v6158: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:51.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:13:51 gibba045 bash[25517]: cephadm 2021-03-10T17:13:49.926177+0000 mgr.gibba045.orlgmj (mgr.34412) 10809 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:13:51.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:13:51 gibba045 bash[25517]: cluster 2021-03-10T17:13:49.936101+0000 mgr.gibba045.orlgmj (mgr.34412) 10810 : cluster [DBG] pgmap v6159: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:51.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:13:50 gibba015 bash[29377]: cephadm 2021-03-10T17:13:49.926177+0000 mgr.gibba045.orlgmj (mgr.34412) 10809 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:13:51.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:13:50 gibba015 bash[29377]: cluster 2021-03-10T17:13:49.936101+0000 mgr.gibba045.orlgmj (mgr.34412) 10810 : cluster [DBG] pgmap v6159: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:51.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:13:50 gibba015 bash[30343]: cephadm 2021-03-10T17:13:49.926177+0000 mgr.gibba045.orlgmj (mgr.34412) 10809 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:13:51.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:13:50 gibba015 bash[30343]: cluster 2021-03-10T17:13:49.936101+0000 mgr.gibba045.orlgmj (mgr.34412) 10810 : cluster [DBG] pgmap v6159: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:53.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:13:53 gibba045 bash[25517]: cluster 2021-03-10T17:13:51.938135+0000 mgr.gibba045.orlgmj (mgr.34412) 10811 : cluster [DBG] pgmap v6160: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:53.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:13:53 gibba015 bash[29377]: cluster 2021-03-10T17:13:51.938135+0000 mgr.gibba045.orlgmj (mgr.34412) 10811 : cluster [DBG] pgmap v6160: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:53.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:13:53 gibba015 bash[30343]: cluster 2021-03-10T17:13:51.938135+0000 mgr.gibba045.orlgmj (mgr.34412) 10811 : cluster [DBG] pgmap v6160: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:54.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:13:54 gibba045 bash[25517]: audit 2021-03-10T17:13:53.934200+0000 mon.c (mon.1) 2959 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:13:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:13:54 gibba045 bash[25517]: audit 2021-03-10T17:13:53.935341+0000 mon.a (mon.0) 2296 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:13:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:13:54 gibba045 bash[25517]: audit 2021-03-10T17:13:53.935829+0000 mon.c (mon.1) 2960 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:13:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:13:54 gibba045 bash[25517]: audit 2021-03-10T17:13:53.936856+0000 mon.a (mon.0) 2297 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:13:54.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:13:54 gibba015 bash[29377]: audit 2021-03-10T17:13:53.934200+0000 mon.c (mon.1) 2959 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:13:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:13:54 gibba015 bash[29377]: audit 2021-03-10T17:13:53.935341+0000 mon.a (mon.0) 2296 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:13:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:13:54 gibba015 bash[29377]: audit 2021-03-10T17:13:53.935829+0000 mon.c (mon.1) 2960 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:13:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:13:54 gibba015 bash[29377]: audit 2021-03-10T17:13:53.936856+0000 mon.a (mon.0) 2297 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:13:54.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:13:54 gibba015 bash[30343]: audit 2021-03-10T17:13:53.934200+0000 mon.c (mon.1) 2959 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:13:54.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:13:54 gibba015 bash[30343]: audit 2021-03-10T17:13:53.935341+0000 mon.a (mon.0) 2296 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:13:54.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:13:54 gibba015 bash[30343]: audit 2021-03-10T17:13:53.935829+0000 mon.c (mon.1) 2960 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:13:54.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:13:54 gibba015 bash[30343]: audit 2021-03-10T17:13:53.936856+0000 mon.a (mon.0) 2297 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:13:55.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:13:55 gibba045 bash[25517]: cluster 2021-03-10T17:13:53.938578+0000 mgr.gibba045.orlgmj (mgr.34412) 10812 : cluster [DBG] pgmap v6161: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:55.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:13:55 gibba045 bash[25517]: audit 2021-03-10T17:13:54.016155+0000 mon.c (mon.1) 2961 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T17:13:55.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:13:55 gibba045 bash[25517]: audit 2021-03-10T17:13:54.016676+0000 mon.a (mon.0) 2298 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T17:13:55.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:13:55 gibba045 bash[25517]: audit 2021-03-10T17:13:54.016684+0000 mon.c (mon.1) 2962 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:13:55.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:13:55 gibba045 bash[25517]: audit 2021-03-10T17:13:54.016804+0000 mon.c (mon.1) 2963 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:13:55.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:13:55 gibba045 bash[25517]: audit 2021-03-10T17:13:54.016941+0000 mon.c (mon.1) 2964 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:13:55.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:13:55 gibba045 bash[25517]: audit 2021-03-10T17:13:54.020248+0000 mon.a (mon.0) 2299 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:13:55.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:13:55 gibba045 bash[25517]: audit 2021-03-10T17:13:54.020750+0000 mon.a (mon.0) 2300 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:13:55.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:13:55 gibba045 bash[25517]: audit 2021-03-10T17:13:54.020969+0000 mon.a (mon.0) 2301 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:13:55.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:13:55 gibba015 bash[29377]: cluster 2021-03-10T17:13:53.938578+0000 mgr.gibba045.orlgmj (mgr.34412) 10812 : cluster [DBG] pgmap v6161: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:55.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:13:55 gibba015 bash[29377]: audit 2021-03-10T17:13:54.016155+0000 mon.c (mon.1) 2961 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T17:13:55.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:13:55 gibba015 bash[29377]: audit 2021-03-10T17:13:54.016676+0000 mon.a (mon.0) 2298 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T17:13:55.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:13:55 gibba015 bash[29377]: audit 2021-03-10T17:13:54.016684+0000 mon.c (mon.1) 2962 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:13:55.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:13:55 gibba015 bash[29377]: audit 2021-03-10T17:13:54.016804+0000 mon.c (mon.1) 2963 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:13:55.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:13:55 gibba015 bash[29377]: audit 2021-03-10T17:13:54.016941+0000 mon.c (mon.1) 2964 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:13:55.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:13:55 gibba015 bash[29377]: audit 2021-03-10T17:13:54.020248+0000 mon.a (mon.0) 2299 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:13:55.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:13:55 gibba015 bash[29377]: audit 2021-03-10T17:13:54.020750+0000 mon.a (mon.0) 2300 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:13:55.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:13:55 gibba015 bash[29377]: audit 2021-03-10T17:13:54.020969+0000 mon.a (mon.0) 2301 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:13:55.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:13:55 gibba015 bash[30343]: cluster 2021-03-10T17:13:53.938578+0000 mgr.gibba045.orlgmj (mgr.34412) 10812 : cluster [DBG] pgmap v6161: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:55.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:13:55 gibba015 bash[30343]: audit 2021-03-10T17:13:54.016155+0000 mon.c (mon.1) 2961 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T17:13:55.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:13:55 gibba015 bash[30343]: audit 2021-03-10T17:13:54.016676+0000 mon.a (mon.0) 2298 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T17:13:55.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:13:55 gibba015 bash[30343]: audit 2021-03-10T17:13:54.016684+0000 mon.c (mon.1) 2962 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:13:55.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:13:55 gibba015 bash[30343]: audit 2021-03-10T17:13:54.016804+0000 mon.c (mon.1) 2963 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:13:55.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:13:55 gibba015 bash[30343]: audit 2021-03-10T17:13:54.016941+0000 mon.c (mon.1) 2964 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:13:55.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:13:55 gibba015 bash[30343]: audit 2021-03-10T17:13:54.020248+0000 mon.a (mon.0) 2299 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:13:55.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:13:55 gibba015 bash[30343]: audit 2021-03-10T17:13:54.020750+0000 mon.a (mon.0) 2300 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:13:55.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:13:55 gibba015 bash[30343]: audit 2021-03-10T17:13:54.020969+0000 mon.a (mon.0) 2301 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:13:57.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:13:57 gibba045 bash[25517]: cluster 2021-03-10T17:13:55.940078+0000 mgr.gibba045.orlgmj (mgr.34412) 10813 : cluster [DBG] pgmap v6162: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:57.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:13:57 gibba015 bash[29377]: cluster 2021-03-10T17:13:55.940078+0000 mgr.gibba045.orlgmj (mgr.34412) 10813 : cluster [DBG] pgmap v6162: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:57.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:13:57 gibba015 bash[30343]: cluster 2021-03-10T17:13:55.940078+0000 mgr.gibba045.orlgmj (mgr.34412) 10813 : cluster [DBG] pgmap v6162: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:58.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:13:58 gibba045 bash[25517]: cluster 2021-03-10T17:13:57.941483+0000 mgr.gibba045.orlgmj (mgr.34412) 10814 : cluster [DBG] pgmap v6163: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:58.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:13:58 gibba015 bash[29377]: cluster 2021-03-10T17:13:57.941483+0000 mgr.gibba045.orlgmj (mgr.34412) 10814 : cluster [DBG] pgmap v6163: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:58.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:13:58 gibba015 bash[30343]: cluster 2021-03-10T17:13:57.941483+0000 mgr.gibba045.orlgmj (mgr.34412) 10814 : cluster [DBG] pgmap v6163: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:58.991 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:13:59.219 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:13:59.220 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 6m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:13:59.220 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 5m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:13:59.220 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:13:59.220 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:13:59.220 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:13:59.221 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:13:59.221 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:13:59.221 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:13:59.221 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 6m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:13:59.222 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 5m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:13:59.222 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:13:59.222 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:13:59.222 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:13:59.222 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:13:59.223 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:13:59.223 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:13:59.223 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:13:59.223 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:13:59.224 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 5m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:13:59.224 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 5m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:13:59.465 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:13:59.466 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:13:59.466 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:13:59.466 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:13:59.466 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:13:59.467 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:13:59.467 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:13:59.467 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:13:59.467 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:13:59.467 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:13:59.468 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:13:59.468 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:13:59.468 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:13:59.468 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:13:59.469 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:13:59.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:13:59 gibba045 bash[25517]: audit 2021-03-10T17:13:58.983458+0000 mgr.gibba045.orlgmj (mgr.34412) 10815 : audit [DBG] from='client.61294 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:13:59.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:13:59 gibba045 bash[25517]: audit 2021-03-10T17:13:59.207825+0000 mgr.gibba045.orlgmj (mgr.34412) 10816 : audit [DBG] from='client.61300 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:13:59.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:13:59 gibba045 bash[25517]: audit 2021-03-10T17:13:59.464274+0000 mon.a (mon.0) 2302 : audit [DBG] from='client.? 172.21.2.115:0/155856954' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:13:59.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:13:59 gibba015 bash[29377]: audit 2021-03-10T17:13:58.983458+0000 mgr.gibba045.orlgmj (mgr.34412) 10815 : audit [DBG] from='client.61294 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:13:59.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:13:59 gibba015 bash[29377]: audit 2021-03-10T17:13:59.207825+0000 mgr.gibba045.orlgmj (mgr.34412) 10816 : audit [DBG] from='client.61300 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:13:59.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:13:59 gibba015 bash[29377]: audit 2021-03-10T17:13:59.464274+0000 mon.a (mon.0) 2302 : audit [DBG] from='client.? 172.21.2.115:0/155856954' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:13:59.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:13:59 gibba015 bash[30343]: audit 2021-03-10T17:13:58.983458+0000 mgr.gibba045.orlgmj (mgr.34412) 10815 : audit [DBG] from='client.61294 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:13:59.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:13:59 gibba015 bash[30343]: audit 2021-03-10T17:13:59.207825+0000 mgr.gibba045.orlgmj (mgr.34412) 10816 : audit [DBG] from='client.61300 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:13:59.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:13:59 gibba015 bash[30343]: audit 2021-03-10T17:13:59.464274+0000 mon.a (mon.0) 2302 : audit [DBG] from='client.? 172.21.2.115:0/155856954' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:14:00.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:14:00 gibba045 bash[25517]: cluster 2021-03-10T17:13:59.942850+0000 mgr.gibba045.orlgmj (mgr.34412) 10817 : cluster [DBG] pgmap v6164: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:00.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:14:00 gibba015 bash[29377]: cluster 2021-03-10T17:13:59.942850+0000 mgr.gibba045.orlgmj (mgr.34412) 10817 : cluster [DBG] pgmap v6164: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:00.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:14:00 gibba015 bash[30343]: cluster 2021-03-10T17:13:59.942850+0000 mgr.gibba045.orlgmj (mgr.34412) 10817 : cluster [DBG] pgmap v6164: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:03.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:14:03 gibba045 bash[25517]: cluster 2021-03-10T17:14:01.944520+0000 mgr.gibba045.orlgmj (mgr.34412) 10818 : cluster [DBG] pgmap v6165: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:03.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:14:03 gibba015 bash[29377]: cluster 2021-03-10T17:14:01.944520+0000 mgr.gibba045.orlgmj (mgr.34412) 10818 : cluster [DBG] pgmap v6165: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:03.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:14:03 gibba015 bash[30343]: cluster 2021-03-10T17:14:01.944520+0000 mgr.gibba045.orlgmj (mgr.34412) 10818 : cluster [DBG] pgmap v6165: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:05.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:14:05 gibba045 bash[25517]: cluster 2021-03-10T17:14:03.945760+0000 mgr.gibba045.orlgmj (mgr.34412) 10819 : cluster [DBG] pgmap v6166: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:05.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:14:05 gibba015 bash[29377]: cluster 2021-03-10T17:14:03.945760+0000 mgr.gibba045.orlgmj (mgr.34412) 10819 : cluster [DBG] pgmap v6166: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:05.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:14:05 gibba015 bash[30343]: cluster 2021-03-10T17:14:03.945760+0000 mgr.gibba045.orlgmj (mgr.34412) 10819 : cluster [DBG] pgmap v6166: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:06.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:14:06 gibba045 bash[25517]: cephadm 2021-03-10T17:14:04.942168+0000 mgr.gibba045.orlgmj (mgr.34412) 10820 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:14:06.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:14:06 gibba015 bash[29377]: cephadm 2021-03-10T17:14:04.942168+0000 mgr.gibba045.orlgmj (mgr.34412) 10820 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:14:06.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:14:06 gibba015 bash[30343]: cephadm 2021-03-10T17:14:04.942168+0000 mgr.gibba045.orlgmj (mgr.34412) 10820 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:14:07.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:14:07 gibba045 bash[25517]: cluster 2021-03-10T17:14:05.947493+0000 mgr.gibba045.orlgmj (mgr.34412) 10821 : cluster [DBG] pgmap v6167: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:07.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:14:07 gibba015 bash[29377]: cluster 2021-03-10T17:14:05.947493+0000 mgr.gibba045.orlgmj (mgr.34412) 10821 : cluster [DBG] pgmap v6167: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:07.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:14:07 gibba015 bash[30343]: cluster 2021-03-10T17:14:05.947493+0000 mgr.gibba045.orlgmj (mgr.34412) 10821 : cluster [DBG] pgmap v6167: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:08.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:14:08 gibba045 bash[25517]: cluster 2021-03-10T17:14:07.948920+0000 mgr.gibba045.orlgmj (mgr.34412) 10822 : cluster [DBG] pgmap v6168: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:08.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:14:08 gibba015 bash[29377]: cluster 2021-03-10T17:14:07.948920+0000 mgr.gibba045.orlgmj (mgr.34412) 10822 : cluster [DBG] pgmap v6168: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:08.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:14:08 gibba015 bash[30343]: cluster 2021-03-10T17:14:07.948920+0000 mgr.gibba045.orlgmj (mgr.34412) 10822 : cluster [DBG] pgmap v6168: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:11.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:14:11 gibba045 bash[25517]: cluster 2021-03-10T17:14:09.950722+0000 mgr.gibba045.orlgmj (mgr.34412) 10823 : cluster [DBG] pgmap v6169: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:11.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:14:11 gibba015 bash[29377]: cluster 2021-03-10T17:14:09.950722+0000 mgr.gibba045.orlgmj (mgr.34412) 10823 : cluster [DBG] pgmap v6169: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:11.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:14:11 gibba015 bash[30343]: cluster 2021-03-10T17:14:09.950722+0000 mgr.gibba045.orlgmj (mgr.34412) 10823 : cluster [DBG] pgmap v6169: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:13.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:14:13 gibba045 bash[25517]: cluster 2021-03-10T17:14:11.952687+0000 mgr.gibba045.orlgmj (mgr.34412) 10824 : cluster [DBG] pgmap v6170: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:13.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:14:13 gibba015 bash[29377]: cluster 2021-03-10T17:14:11.952687+0000 mgr.gibba045.orlgmj (mgr.34412) 10824 : cluster [DBG] pgmap v6170: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:13.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:14:13 gibba015 bash[30343]: cluster 2021-03-10T17:14:11.952687+0000 mgr.gibba045.orlgmj (mgr.34412) 10824 : cluster [DBG] pgmap v6170: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:15.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:14:15 gibba045 bash[25517]: cluster 2021-03-10T17:14:13.953994+0000 mgr.gibba045.orlgmj (mgr.34412) 10825 : cluster [DBG] pgmap v6171: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:15.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:14:15 gibba015 bash[29377]: cluster 2021-03-10T17:14:13.953994+0000 mgr.gibba045.orlgmj (mgr.34412) 10825 : cluster [DBG] pgmap v6171: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:15.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:14:15 gibba015 bash[30343]: cluster 2021-03-10T17:14:13.953994+0000 mgr.gibba045.orlgmj (mgr.34412) 10825 : cluster [DBG] pgmap v6171: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:17.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:14:17 gibba045 bash[25517]: cluster 2021-03-10T17:14:15.955596+0000 mgr.gibba045.orlgmj (mgr.34412) 10826 : cluster [DBG] pgmap v6172: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:17.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:14:17 gibba015 bash[29377]: cluster 2021-03-10T17:14:15.955596+0000 mgr.gibba045.orlgmj (mgr.34412) 10826 : cluster [DBG] pgmap v6172: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:17.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:14:17 gibba015 bash[30343]: cluster 2021-03-10T17:14:15.955596+0000 mgr.gibba045.orlgmj (mgr.34412) 10826 : cluster [DBG] pgmap v6172: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:18.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:14:18 gibba045 bash[25517]: cluster 2021-03-10T17:14:17.957065+0000 mgr.gibba045.orlgmj (mgr.34412) 10827 : cluster [DBG] pgmap v6173: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:18.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:14:18 gibba015 bash[29377]: cluster 2021-03-10T17:14:17.957065+0000 mgr.gibba045.orlgmj (mgr.34412) 10827 : cluster [DBG] pgmap v6173: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:18.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:14:18 gibba015 bash[30343]: cluster 2021-03-10T17:14:17.957065+0000 mgr.gibba045.orlgmj (mgr.34412) 10827 : cluster [DBG] pgmap v6173: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:20.304 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:14:20 gibba045 bash[25517]: audit 2021-03-10T17:14:19.955889+0000 mon.c (mon.1) 2965 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:14:20.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:14:20 gibba015 bash[29377]: audit 2021-03-10T17:14:19.955889+0000 mon.c (mon.1) 2965 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:14:20.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:14:20 gibba015 bash[30343]: audit 2021-03-10T17:14:19.955889+0000 mon.c (mon.1) 2965 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:14:21.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:14:21 gibba015 bash[29377]: cluster 2021-03-10T17:14:19.958433+0000 mgr.gibba045.orlgmj (mgr.34412) 10828 : cluster [DBG] pgmap v6174: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:21.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:14:21 gibba015 bash[29377]: audit 2021-03-10T17:14:20.163816+0000 mon.a (mon.0) 2303 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:14:21.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:14:21 gibba015 bash[29377]: cephadm 2021-03-10T17:14:20.167422+0000 mgr.gibba045.orlgmj (mgr.34412) 10829 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:14:21.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:14:21 gibba015 bash[29377]: audit 2021-03-10T17:14:20.168034+0000 mon.a (mon.0) 2304 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:14:21.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:14:21 gibba015 bash[29377]: cephadm 2021-03-10T17:14:20.171092+0000 mgr.gibba045.orlgmj (mgr.34412) 10830 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:14:21.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:14:21 gibba015 bash[29377]: audit 2021-03-10T17:14:20.360131+0000 mon.a (mon.0) 2305 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:14:21.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:14:21 gibba015 bash[29377]: audit 2021-03-10T17:14:20.364070+0000 mon.c (mon.1) 2966 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:14:21.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:14:21 gibba015 bash[29377]: cephadm 2021-03-10T17:14:20.365503+0000 mgr.gibba045.orlgmj (mgr.34412) 10831 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:14:21.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:14:21 gibba015 bash[29377]: audit 2021-03-10T17:14:20.365876+0000 mon.c (mon.1) 2967 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:14:21.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:14:21 gibba015 bash[29377]: cephadm 2021-03-10T17:14:20.367494+0000 mgr.gibba045.orlgmj (mgr.34412) 10832 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:14:21.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:14:21 gibba015 bash[29377]: audit 2021-03-10T17:14:20.367536+0000 mon.c (mon.1) 2968 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:14:21.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:14:21 gibba015 bash[29377]: audit 2021-03-10T17:14:20.369011+0000 mon.c (mon.1) 2969 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:14:21.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:14:21 gibba015 bash[29377]: cephadm 2021-03-10T17:14:20.369228+0000 mgr.gibba045.orlgmj (mgr.34412) 10833 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:14:21.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:14:21 gibba015 bash[29377]: cephadm 2021-03-10T17:14:20.369265+0000 mgr.gibba045.orlgmj (mgr.34412) 10834 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:14:21.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:14:21 gibba015 bash[29377]: cephadm 2021-03-10T17:14:20.370685+0000 mgr.gibba045.orlgmj (mgr.34412) 10835 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:14:21.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:14:21 gibba015 bash[29377]: cephadm 2021-03-10T17:14:20.370725+0000 mgr.gibba045.orlgmj (mgr.34412) 10836 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:14:21.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:14:21 gibba015 bash[29377]: cephadm 2021-03-10T17:14:20.372259+0000 mgr.gibba045.orlgmj (mgr.34412) 10837 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:14:21.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:14:21 gibba015 bash[29377]: audit 2021-03-10T17:14:20.372609+0000 mon.c (mon.1) 2970 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:14:21.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:14:21 gibba015 bash[29377]: cephadm 2021-03-10T17:14:20.374144+0000 mgr.gibba045.orlgmj (mgr.34412) 10838 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:14:21.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:14:21 gibba015 bash[29377]: audit 2021-03-10T17:14:20.374151+0000 mon.c (mon.1) 2971 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:14:21.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:14:21 gibba015 bash[30343]: cluster 2021-03-10T17:14:19.958433+0000 mgr.gibba045.orlgmj (mgr.34412) 10828 : cluster [DBG] pgmap v6174: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:21.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:14:21 gibba015 bash[30343]: audit 2021-03-10T17:14:20.163816+0000 mon.a (mon.0) 2303 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:14:21.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:14:21 gibba015 bash[30343]: cephadm 2021-03-10T17:14:20.167422+0000 mgr.gibba045.orlgmj (mgr.34412) 10829 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:14:21.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:14:21 gibba015 bash[30343]: audit 2021-03-10T17:14:20.168034+0000 mon.a (mon.0) 2304 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:14:21.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:14:21 gibba015 bash[30343]: cephadm 2021-03-10T17:14:20.171092+0000 mgr.gibba045.orlgmj (mgr.34412) 10830 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:14:21.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:14:21 gibba015 bash[30343]: audit 2021-03-10T17:14:20.360131+0000 mon.a (mon.0) 2305 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:14:21.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:14:21 gibba015 bash[30343]: audit 2021-03-10T17:14:20.364070+0000 mon.c (mon.1) 2966 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:14:21.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:14:21 gibba015 bash[30343]: cephadm 2021-03-10T17:14:20.365503+0000 mgr.gibba045.orlgmj (mgr.34412) 10831 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:14:21.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:14:21 gibba015 bash[30343]: audit 2021-03-10T17:14:20.365876+0000 mon.c (mon.1) 2967 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:14:21.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:14:21 gibba015 bash[30343]: cephadm 2021-03-10T17:14:20.367494+0000 mgr.gibba045.orlgmj (mgr.34412) 10832 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:14:21.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:14:21 gibba015 bash[30343]: audit 2021-03-10T17:14:20.367536+0000 mon.c (mon.1) 2968 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:14:21.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:14:21 gibba015 bash[30343]: audit 2021-03-10T17:14:20.369011+0000 mon.c (mon.1) 2969 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:14:21.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:14:21 gibba015 bash[30343]: cephadm 2021-03-10T17:14:20.369228+0000 mgr.gibba045.orlgmj (mgr.34412) 10833 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:14:21.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:14:21 gibba015 bash[30343]: cephadm 2021-03-10T17:14:20.369265+0000 mgr.gibba045.orlgmj (mgr.34412) 10834 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:14:21.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:14:21 gibba015 bash[30343]: cephadm 2021-03-10T17:14:20.370685+0000 mgr.gibba045.orlgmj (mgr.34412) 10835 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:14:21.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:14:21 gibba015 bash[30343]: cephadm 2021-03-10T17:14:20.370725+0000 mgr.gibba045.orlgmj (mgr.34412) 10836 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:14:21.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:14:21 gibba015 bash[30343]: cephadm 2021-03-10T17:14:20.372259+0000 mgr.gibba045.orlgmj (mgr.34412) 10837 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:14:21.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:14:21 gibba015 bash[30343]: audit 2021-03-10T17:14:20.372609+0000 mon.c (mon.1) 2970 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:14:21.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:14:21 gibba015 bash[30343]: cephadm 2021-03-10T17:14:20.374144+0000 mgr.gibba045.orlgmj (mgr.34412) 10838 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:14:21.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:14:21 gibba015 bash[30343]: audit 2021-03-10T17:14:20.374151+0000 mon.c (mon.1) 2971 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:14:21.483 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:14:21 gibba015 bash[29377]: cephadm 2021-03-10T17:14:20.374179+0000 mgr.gibba045.orlgmj (mgr.34412) 10839 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:14:21.484 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:14:21 gibba015 bash[29377]: cephadm 2021-03-10T17:14:20.375558+0000 mgr.gibba045.orlgmj (mgr.34412) 10840 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:14:21.484 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:14:21 gibba015 bash[29377]: cephadm 2021-03-10T17:14:20.375869+0000 mgr.gibba045.orlgmj (mgr.34412) 10841 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:14:21.484 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:14:21 gibba015 bash[29377]: cephadm 2021-03-10T17:14:20.377330+0000 mgr.gibba045.orlgmj (mgr.34412) 10842 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:14:21.484 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:14:21 gibba015 bash[29377]: cephadm 2021-03-10T17:14:20.377366+0000 mgr.gibba045.orlgmj (mgr.34412) 10843 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:14:21.484 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:14:21 gibba015 bash[29377]: cephadm 2021-03-10T17:14:20.377471+0000 mgr.gibba045.orlgmj (mgr.34412) 10844 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:14:21.485 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:14:21 gibba015 bash[30343]: cephadm 2021-03-10T17:14:20.374179+0000 mgr.gibba045.orlgmj (mgr.34412) 10839 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:14:21.485 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:14:21 gibba015 bash[30343]: cephadm 2021-03-10T17:14:20.375558+0000 mgr.gibba045.orlgmj (mgr.34412) 10840 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:14:21.486 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:14:21 gibba015 bash[30343]: cephadm 2021-03-10T17:14:20.375869+0000 mgr.gibba045.orlgmj (mgr.34412) 10841 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:14:21.486 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:14:21 gibba015 bash[30343]: cephadm 2021-03-10T17:14:20.377330+0000 mgr.gibba045.orlgmj (mgr.34412) 10842 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:14:21.486 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:14:21 gibba015 bash[30343]: cephadm 2021-03-10T17:14:20.377366+0000 mgr.gibba045.orlgmj (mgr.34412) 10843 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:14:21.486 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:14:21 gibba015 bash[30343]: cephadm 2021-03-10T17:14:20.377471+0000 mgr.gibba045.orlgmj (mgr.34412) 10844 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:14:21.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:14:21 gibba045 bash[25517]: cluster 2021-03-10T17:14:19.958433+0000 mgr.gibba045.orlgmj (mgr.34412) 10828 : cluster [DBG] pgmap v6174: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:21.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:14:21 gibba045 bash[25517]: audit 2021-03-10T17:14:20.163816+0000 mon.a (mon.0) 2303 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:14:21.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:14:21 gibba045 bash[25517]: cephadm 2021-03-10T17:14:20.167422+0000 mgr.gibba045.orlgmj (mgr.34412) 10829 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:14:21.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:14:21 gibba045 bash[25517]: audit 2021-03-10T17:14:20.168034+0000 mon.a (mon.0) 2304 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:14:21.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:14:21 gibba045 bash[25517]: cephadm 2021-03-10T17:14:20.171092+0000 mgr.gibba045.orlgmj (mgr.34412) 10830 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:14:21.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:14:21 gibba045 bash[25517]: audit 2021-03-10T17:14:20.360131+0000 mon.a (mon.0) 2305 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:14:21.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:14:21 gibba045 bash[25517]: audit 2021-03-10T17:14:20.364070+0000 mon.c (mon.1) 2966 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:14:21.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:14:21 gibba045 bash[25517]: cephadm 2021-03-10T17:14:20.365503+0000 mgr.gibba045.orlgmj (mgr.34412) 10831 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:14:21.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:14:21 gibba045 bash[25517]: audit 2021-03-10T17:14:20.365876+0000 mon.c (mon.1) 2967 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:14:21.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:14:21 gibba045 bash[25517]: cephadm 2021-03-10T17:14:20.367494+0000 mgr.gibba045.orlgmj (mgr.34412) 10832 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:14:21.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:14:21 gibba045 bash[25517]: audit 2021-03-10T17:14:20.367536+0000 mon.c (mon.1) 2968 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:14:21.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:14:21 gibba045 bash[25517]: audit 2021-03-10T17:14:20.369011+0000 mon.c (mon.1) 2969 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:14:21.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:14:21 gibba045 bash[25517]: cephadm 2021-03-10T17:14:20.369228+0000 mgr.gibba045.orlgmj (mgr.34412) 10833 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:14:21.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:14:21 gibba045 bash[25517]: cephadm 2021-03-10T17:14:20.369265+0000 mgr.gibba045.orlgmj (mgr.34412) 10834 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:14:21.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:14:21 gibba045 bash[25517]: cephadm 2021-03-10T17:14:20.370685+0000 mgr.gibba045.orlgmj (mgr.34412) 10835 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:14:21.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:14:21 gibba045 bash[25517]: cephadm 2021-03-10T17:14:20.370725+0000 mgr.gibba045.orlgmj (mgr.34412) 10836 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:14:21.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:14:21 gibba045 bash[25517]: cephadm 2021-03-10T17:14:20.372259+0000 mgr.gibba045.orlgmj (mgr.34412) 10837 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:14:21.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:14:21 gibba045 bash[25517]: audit 2021-03-10T17:14:20.372609+0000 mon.c (mon.1) 2970 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:14:21.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:14:21 gibba045 bash[25517]: cephadm 2021-03-10T17:14:20.374144+0000 mgr.gibba045.orlgmj (mgr.34412) 10838 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:14:21.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:14:21 gibba045 bash[25517]: audit 2021-03-10T17:14:20.374151+0000 mon.c (mon.1) 2971 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:14:21.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:14:21 gibba045 bash[25517]: cephadm 2021-03-10T17:14:20.374179+0000 mgr.gibba045.orlgmj (mgr.34412) 10839 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:14:21.564 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:14:21 gibba045 bash[25517]: cephadm 2021-03-10T17:14:20.375558+0000 mgr.gibba045.orlgmj (mgr.34412) 10840 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:14:21.564 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:14:21 gibba045 bash[25517]: cephadm 2021-03-10T17:14:20.375869+0000 mgr.gibba045.orlgmj (mgr.34412) 10841 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:14:21.564 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:14:21 gibba045 bash[25517]: cephadm 2021-03-10T17:14:20.377330+0000 mgr.gibba045.orlgmj (mgr.34412) 10842 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:14:21.564 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:14:21 gibba045 bash[25517]: cephadm 2021-03-10T17:14:20.377366+0000 mgr.gibba045.orlgmj (mgr.34412) 10843 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:14:21.565 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:14:21 gibba045 bash[25517]: cephadm 2021-03-10T17:14:20.377471+0000 mgr.gibba045.orlgmj (mgr.34412) 10844 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:14:23.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:14:23 gibba015 bash[29377]: cluster 2021-03-10T17:14:21.960186+0000 mgr.gibba045.orlgmj (mgr.34412) 10845 : cluster [DBG] pgmap v6175: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:23.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:14:23 gibba015 bash[30343]: cluster 2021-03-10T17:14:21.960186+0000 mgr.gibba045.orlgmj (mgr.34412) 10845 : cluster [DBG] pgmap v6175: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:23.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:14:23 gibba045 bash[25517]: cluster 2021-03-10T17:14:21.960186+0000 mgr.gibba045.orlgmj (mgr.34412) 10845 : cluster [DBG] pgmap v6175: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:25.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:14:25 gibba015 bash[29377]: cluster 2021-03-10T17:14:23.961581+0000 mgr.gibba045.orlgmj (mgr.34412) 10846 : cluster [DBG] pgmap v6176: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:25.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:14:25 gibba015 bash[30343]: cluster 2021-03-10T17:14:23.961581+0000 mgr.gibba045.orlgmj (mgr.34412) 10846 : cluster [DBG] pgmap v6176: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:25.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:14:25 gibba045 bash[25517]: cluster 2021-03-10T17:14:23.961581+0000 mgr.gibba045.orlgmj (mgr.34412) 10846 : cluster [DBG] pgmap v6176: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:27.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:14:27 gibba015 bash[29377]: cluster 2021-03-10T17:14:25.963370+0000 mgr.gibba045.orlgmj (mgr.34412) 10847 : cluster [DBG] pgmap v6177: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:27.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:14:27 gibba015 bash[30343]: cluster 2021-03-10T17:14:25.963370+0000 mgr.gibba045.orlgmj (mgr.34412) 10847 : cluster [DBG] pgmap v6177: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:27.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:14:27 gibba045 bash[25517]: cluster 2021-03-10T17:14:25.963370+0000 mgr.gibba045.orlgmj (mgr.34412) 10847 : cluster [DBG] pgmap v6177: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:28.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:14:28 gibba045 bash[25517]: cluster 2021-03-10T17:14:27.964783+0000 mgr.gibba045.orlgmj (mgr.34412) 10848 : cluster [DBG] pgmap v6178: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:28.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:14:28 gibba015 bash[29377]: cluster 2021-03-10T17:14:27.964783+0000 mgr.gibba045.orlgmj (mgr.34412) 10848 : cluster [DBG] pgmap v6178: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:28.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:14:28 gibba015 bash[30343]: cluster 2021-03-10T17:14:27.964783+0000 mgr.gibba045.orlgmj (mgr.34412) 10848 : cluster [DBG] pgmap v6178: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:29.713 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:14:29.970 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:14:29.971 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 7m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:14:29.971 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 6m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:14:29.971 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:14:29.971 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:14:29.972 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:14:29.972 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:14:29.972 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:14:29.972 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:14:29.972 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 7m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:14:29.973 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 6m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:14:29.973 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:14:29.973 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:14:29.973 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:14:29.974 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:14:29.974 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:14:29.974 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:14:29.974 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:14:29.977 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:14:29.977 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 6m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:14:29.977 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 6m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:14:30.221 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:14:30.222 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:14:30.222 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:14:30.222 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:14:30.223 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:14:30.223 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:14:30.223 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:14:30.223 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:14:30.224 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:14:30.224 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:14:30.224 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:14:30.224 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:14:30.224 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:14:30.225 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:14:30.225 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:14:31.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:14:31 gibba045 bash[25517]: audit 2021-03-10T17:14:29.705596+0000 mgr.gibba045.orlgmj (mgr.34412) 10849 : audit [DBG] from='client.61312 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:14:31.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:14:31 gibba045 bash[25517]: audit 2021-03-10T17:14:29.929927+0000 mgr.gibba045.orlgmj (mgr.34412) 10850 : audit [DBG] from='client.51330 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:14:31.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:14:31 gibba045 bash[25517]: cluster 2021-03-10T17:14:29.965794+0000 mgr.gibba045.orlgmj (mgr.34412) 10851 : cluster [DBG] pgmap v6179: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:31.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:14:31 gibba045 bash[25517]: audit 2021-03-10T17:14:30.220681+0000 mon.a (mon.0) 2306 : audit [DBG] from='client.? 172.21.2.115:0/4154698787' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:14:31.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:14:31 gibba015 bash[29377]: audit 2021-03-10T17:14:29.705596+0000 mgr.gibba045.orlgmj (mgr.34412) 10849 : audit [DBG] from='client.61312 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:14:31.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:14:31 gibba015 bash[29377]: audit 2021-03-10T17:14:29.929927+0000 mgr.gibba045.orlgmj (mgr.34412) 10850 : audit [DBG] from='client.51330 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:14:31.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:14:31 gibba015 bash[29377]: cluster 2021-03-10T17:14:29.965794+0000 mgr.gibba045.orlgmj (mgr.34412) 10851 : cluster [DBG] pgmap v6179: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:31.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:14:31 gibba015 bash[29377]: audit 2021-03-10T17:14:30.220681+0000 mon.a (mon.0) 2306 : audit [DBG] from='client.? 172.21.2.115:0/4154698787' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:14:31.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:14:31 gibba015 bash[30343]: audit 2021-03-10T17:14:29.705596+0000 mgr.gibba045.orlgmj (mgr.34412) 10849 : audit [DBG] from='client.61312 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:14:31.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:14:31 gibba015 bash[30343]: audit 2021-03-10T17:14:29.929927+0000 mgr.gibba045.orlgmj (mgr.34412) 10850 : audit [DBG] from='client.51330 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:14:31.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:14:31 gibba015 bash[30343]: cluster 2021-03-10T17:14:29.965794+0000 mgr.gibba045.orlgmj (mgr.34412) 10851 : cluster [DBG] pgmap v6179: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:31.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:14:31 gibba015 bash[30343]: audit 2021-03-10T17:14:30.220681+0000 mon.a (mon.0) 2306 : audit [DBG] from='client.? 172.21.2.115:0/4154698787' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:14:33.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:14:33 gibba045 bash[25517]: cluster 2021-03-10T17:14:31.967372+0000 mgr.gibba045.orlgmj (mgr.34412) 10852 : cluster [DBG] pgmap v6180: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:33.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:14:33 gibba015 bash[29377]: cluster 2021-03-10T17:14:31.967372+0000 mgr.gibba045.orlgmj (mgr.34412) 10852 : cluster [DBG] pgmap v6180: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:33.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:14:33 gibba015 bash[30343]: cluster 2021-03-10T17:14:31.967372+0000 mgr.gibba045.orlgmj (mgr.34412) 10852 : cluster [DBG] pgmap v6180: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:35.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:14:35 gibba045 bash[25517]: cluster 2021-03-10T17:14:33.968659+0000 mgr.gibba045.orlgmj (mgr.34412) 10853 : cluster [DBG] pgmap v6181: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:35.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:14:35 gibba015 bash[29377]: cluster 2021-03-10T17:14:33.968659+0000 mgr.gibba045.orlgmj (mgr.34412) 10853 : cluster [DBG] pgmap v6181: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:35.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:14:35 gibba015 bash[30343]: cluster 2021-03-10T17:14:33.968659+0000 mgr.gibba045.orlgmj (mgr.34412) 10853 : cluster [DBG] pgmap v6181: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:36.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:14:36 gibba045 bash[25517]: cephadm 2021-03-10T17:14:35.393553+0000 mgr.gibba045.orlgmj (mgr.34412) 10854 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:14:36.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:14:36 gibba015 bash[29377]: cephadm 2021-03-10T17:14:35.393553+0000 mgr.gibba045.orlgmj (mgr.34412) 10854 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:14:36.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:14:36 gibba015 bash[30343]: cephadm 2021-03-10T17:14:35.393553+0000 mgr.gibba045.orlgmj (mgr.34412) 10854 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:14:37.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:14:37 gibba015 bash[29377]: cluster 2021-03-10T17:14:35.970435+0000 mgr.gibba045.orlgmj (mgr.34412) 10855 : cluster [DBG] pgmap v6182: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:37.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:14:37 gibba015 bash[30343]: cluster 2021-03-10T17:14:35.970435+0000 mgr.gibba045.orlgmj (mgr.34412) 10855 : cluster [DBG] pgmap v6182: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:37.554 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:14:37 gibba045 bash[25517]: cluster 2021-03-10T17:14:35.970435+0000 mgr.gibba045.orlgmj (mgr.34412) 10855 : cluster [DBG] pgmap v6182: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:38.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:14:38 gibba045 bash[25517]: cluster 2021-03-10T17:14:37.971821+0000 mgr.gibba045.orlgmj (mgr.34412) 10856 : cluster [DBG] pgmap v6183: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:38.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:14:38 gibba015 bash[29377]: cluster 2021-03-10T17:14:37.971821+0000 mgr.gibba045.orlgmj (mgr.34412) 10856 : cluster [DBG] pgmap v6183: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:38.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:14:38 gibba015 bash[30343]: cluster 2021-03-10T17:14:37.971821+0000 mgr.gibba045.orlgmj (mgr.34412) 10856 : cluster [DBG] pgmap v6183: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:41.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:14:41 gibba045 bash[25517]: cluster 2021-03-10T17:14:39.973518+0000 mgr.gibba045.orlgmj (mgr.34412) 10857 : cluster [DBG] pgmap v6184: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:41.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:14:41 gibba015 bash[29377]: cluster 2021-03-10T17:14:39.973518+0000 mgr.gibba045.orlgmj (mgr.34412) 10857 : cluster [DBG] pgmap v6184: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:41.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:14:41 gibba015 bash[30343]: cluster 2021-03-10T17:14:39.973518+0000 mgr.gibba045.orlgmj (mgr.34412) 10857 : cluster [DBG] pgmap v6184: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:43.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:14:43 gibba045 bash[25517]: cluster 2021-03-10T17:14:41.975281+0000 mgr.gibba045.orlgmj (mgr.34412) 10858 : cluster [DBG] pgmap v6185: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:43.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:14:43 gibba015 bash[29377]: cluster 2021-03-10T17:14:41.975281+0000 mgr.gibba045.orlgmj (mgr.34412) 10858 : cluster [DBG] pgmap v6185: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:43.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:14:43 gibba015 bash[30343]: cluster 2021-03-10T17:14:41.975281+0000 mgr.gibba045.orlgmj (mgr.34412) 10858 : cluster [DBG] pgmap v6185: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:45.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:14:45 gibba045 bash[25517]: cluster 2021-03-10T17:14:43.976684+0000 mgr.gibba045.orlgmj (mgr.34412) 10859 : cluster [DBG] pgmap v6186: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:45.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:14:45 gibba015 bash[29377]: cluster 2021-03-10T17:14:43.976684+0000 mgr.gibba045.orlgmj (mgr.34412) 10859 : cluster [DBG] pgmap v6186: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:45.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:14:45 gibba015 bash[30343]: cluster 2021-03-10T17:14:43.976684+0000 mgr.gibba045.orlgmj (mgr.34412) 10859 : cluster [DBG] pgmap v6186: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:47.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:14:47 gibba015 bash[29377]: cluster 2021-03-10T17:14:45.978439+0000 mgr.gibba045.orlgmj (mgr.34412) 10860 : cluster [DBG] pgmap v6187: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:47.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:14:47 gibba015 bash[30343]: cluster 2021-03-10T17:14:45.978439+0000 mgr.gibba045.orlgmj (mgr.34412) 10860 : cluster [DBG] pgmap v6187: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:47.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:14:47 gibba045 bash[25517]: cluster 2021-03-10T17:14:45.978439+0000 mgr.gibba045.orlgmj (mgr.34412) 10860 : cluster [DBG] pgmap v6187: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:48.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:14:48 gibba045 bash[25517]: cluster 2021-03-10T17:14:47.979847+0000 mgr.gibba045.orlgmj (mgr.34412) 10861 : cluster [DBG] pgmap v6188: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:48.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:14:48 gibba015 bash[29377]: cluster 2021-03-10T17:14:47.979847+0000 mgr.gibba045.orlgmj (mgr.34412) 10861 : cluster [DBG] pgmap v6188: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:48.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:14:48 gibba015 bash[30343]: cluster 2021-03-10T17:14:47.979847+0000 mgr.gibba045.orlgmj (mgr.34412) 10861 : cluster [DBG] pgmap v6188: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:51.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:14:51 gibba045 bash[25517]: cluster 2021-03-10T17:14:49.981505+0000 mgr.gibba045.orlgmj (mgr.34412) 10862 : cluster [DBG] pgmap v6189: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:51.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:14:51 gibba045 bash[25517]: cephadm 2021-03-10T17:14:50.409789+0000 mgr.gibba045.orlgmj (mgr.34412) 10863 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:14:51.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:14:51 gibba015 bash[29377]: cluster 2021-03-10T17:14:49.981505+0000 mgr.gibba045.orlgmj (mgr.34412) 10862 : cluster [DBG] pgmap v6189: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:51.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:14:51 gibba015 bash[29377]: cephadm 2021-03-10T17:14:50.409789+0000 mgr.gibba045.orlgmj (mgr.34412) 10863 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:14:51.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:14:51 gibba015 bash[30343]: cluster 2021-03-10T17:14:49.981505+0000 mgr.gibba045.orlgmj (mgr.34412) 10862 : cluster [DBG] pgmap v6189: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:51.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:14:51 gibba015 bash[30343]: cephadm 2021-03-10T17:14:50.409789+0000 mgr.gibba045.orlgmj (mgr.34412) 10863 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:14:53.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:14:53 gibba045 bash[25517]: cluster 2021-03-10T17:14:51.983330+0000 mgr.gibba045.orlgmj (mgr.34412) 10864 : cluster [DBG] pgmap v6190: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:53.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:14:53 gibba015 bash[29377]: cluster 2021-03-10T17:14:51.983330+0000 mgr.gibba045.orlgmj (mgr.34412) 10864 : cluster [DBG] pgmap v6190: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:53.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:14:53 gibba015 bash[30343]: cluster 2021-03-10T17:14:51.983330+0000 mgr.gibba045.orlgmj (mgr.34412) 10864 : cluster [DBG] pgmap v6190: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:14:54 gibba015 bash[29377]: audit 2021-03-10T17:14:53.947252+0000 mon.c (mon.1) 2972 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:14:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:14:54 gibba015 bash[29377]: audit 2021-03-10T17:14:53.948360+0000 mon.a (mon.0) 2307 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:14:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:14:54 gibba015 bash[29377]: audit 2021-03-10T17:14:53.949867+0000 mon.c (mon.1) 2973 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:14:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:14:54 gibba015 bash[29377]: audit 2021-03-10T17:14:53.950903+0000 mon.a (mon.0) 2308 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:14:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:14:54 gibba015 bash[29377]: audit 2021-03-10T17:14:54.028448+0000 mon.c (mon.1) 2974 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T17:14:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:14:54 gibba015 bash[29377]: audit 2021-03-10T17:14:54.029420+0000 mon.c (mon.1) 2975 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:14:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:14:54 gibba015 bash[29377]: audit 2021-03-10T17:14:54.029652+0000 mon.a (mon.0) 2309 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T17:14:54.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:14:54 gibba015 bash[29377]: audit 2021-03-10T17:14:54.030348+0000 mon.c (mon.1) 2976 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:14:54.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:14:54 gibba015 bash[29377]: audit 2021-03-10T17:14:54.030945+0000 mon.a (mon.0) 2310 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:14:54.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:14:54 gibba015 bash[29377]: audit 2021-03-10T17:14:54.031409+0000 mon.c (mon.1) 2977 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:14:54.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:14:54 gibba015 bash[29377]: audit 2021-03-10T17:14:54.031965+0000 mon.a (mon.0) 2311 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:14:54.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:14:54 gibba015 bash[29377]: audit 2021-03-10T17:14:54.032932+0000 mon.a (mon.0) 2312 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:14:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:14:54 gibba015 bash[30343]: audit 2021-03-10T17:14:53.947252+0000 mon.c (mon.1) 2972 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:14:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:14:54 gibba015 bash[30343]: audit 2021-03-10T17:14:53.948360+0000 mon.a (mon.0) 2307 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:14:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:14:54 gibba015 bash[30343]: audit 2021-03-10T17:14:53.949867+0000 mon.c (mon.1) 2973 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:14:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:14:54 gibba015 bash[30343]: audit 2021-03-10T17:14:53.950903+0000 mon.a (mon.0) 2308 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:14:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:14:54 gibba015 bash[30343]: audit 2021-03-10T17:14:54.028448+0000 mon.c (mon.1) 2974 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T17:14:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:14:54 gibba015 bash[30343]: audit 2021-03-10T17:14:54.029420+0000 mon.c (mon.1) 2975 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:14:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:14:54 gibba015 bash[30343]: audit 2021-03-10T17:14:54.029652+0000 mon.a (mon.0) 2309 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T17:14:54.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:14:54 gibba015 bash[30343]: audit 2021-03-10T17:14:54.030348+0000 mon.c (mon.1) 2976 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:14:54.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:14:54 gibba015 bash[30343]: audit 2021-03-10T17:14:54.030945+0000 mon.a (mon.0) 2310 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:14:54.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:14:54 gibba015 bash[30343]: audit 2021-03-10T17:14:54.031409+0000 mon.c (mon.1) 2977 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:14:54.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:14:54 gibba015 bash[30343]: audit 2021-03-10T17:14:54.031965+0000 mon.a (mon.0) 2311 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:14:54.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:14:54 gibba015 bash[30343]: audit 2021-03-10T17:14:54.032932+0000 mon.a (mon.0) 2312 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:14:54.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:14:54 gibba045 bash[25517]: audit 2021-03-10T17:14:53.947252+0000 mon.c (mon.1) 2972 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:14:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:14:54 gibba045 bash[25517]: audit 2021-03-10T17:14:53.948360+0000 mon.a (mon.0) 2307 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:14:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:14:54 gibba045 bash[25517]: audit 2021-03-10T17:14:53.949867+0000 mon.c (mon.1) 2973 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:14:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:14:54 gibba045 bash[25517]: audit 2021-03-10T17:14:53.950903+0000 mon.a (mon.0) 2308 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:14:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:14:54 gibba045 bash[25517]: audit 2021-03-10T17:14:54.028448+0000 mon.c (mon.1) 2974 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T17:14:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:14:54 gibba045 bash[25517]: audit 2021-03-10T17:14:54.029420+0000 mon.c (mon.1) 2975 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:14:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:14:54 gibba045 bash[25517]: audit 2021-03-10T17:14:54.029652+0000 mon.a (mon.0) 2309 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T17:14:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:14:54 gibba045 bash[25517]: audit 2021-03-10T17:14:54.030348+0000 mon.c (mon.1) 2976 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:14:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:14:54 gibba045 bash[25517]: audit 2021-03-10T17:14:54.030945+0000 mon.a (mon.0) 2310 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:14:54.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:14:54 gibba045 bash[25517]: audit 2021-03-10T17:14:54.031409+0000 mon.c (mon.1) 2977 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:14:54.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:14:54 gibba045 bash[25517]: audit 2021-03-10T17:14:54.031965+0000 mon.a (mon.0) 2311 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:14:54.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:14:54 gibba045 bash[25517]: audit 2021-03-10T17:14:54.032932+0000 mon.a (mon.0) 2312 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:14:55.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:14:55 gibba015 bash[29377]: cluster 2021-03-10T17:14:53.984632+0000 mgr.gibba045.orlgmj (mgr.34412) 10865 : cluster [DBG] pgmap v6191: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:55.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:14:55 gibba015 bash[30343]: cluster 2021-03-10T17:14:53.984632+0000 mgr.gibba045.orlgmj (mgr.34412) 10865 : cluster [DBG] pgmap v6191: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:55.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:14:55 gibba045 bash[25517]: cluster 2021-03-10T17:14:53.984632+0000 mgr.gibba045.orlgmj (mgr.34412) 10865 : cluster [DBG] pgmap v6191: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:57.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:14:57 gibba015 bash[29377]: cluster 2021-03-10T17:14:55.986441+0000 mgr.gibba045.orlgmj (mgr.34412) 10866 : cluster [DBG] pgmap v6192: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:57.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:14:57 gibba015 bash[30343]: cluster 2021-03-10T17:14:55.986441+0000 mgr.gibba045.orlgmj (mgr.34412) 10866 : cluster [DBG] pgmap v6192: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:57.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:14:57 gibba045 bash[25517]: cluster 2021-03-10T17:14:55.986441+0000 mgr.gibba045.orlgmj (mgr.34412) 10866 : cluster [DBG] pgmap v6192: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:58.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:14:58 gibba045 bash[25517]: cluster 2021-03-10T17:14:57.987820+0000 mgr.gibba045.orlgmj (mgr.34412) 10867 : cluster [DBG] pgmap v6193: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:58.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:14:58 gibba015 bash[29377]: cluster 2021-03-10T17:14:57.987820+0000 mgr.gibba045.orlgmj (mgr.34412) 10867 : cluster [DBG] pgmap v6193: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:58.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:14:58 gibba015 bash[30343]: cluster 2021-03-10T17:14:57.987820+0000 mgr.gibba045.orlgmj (mgr.34412) 10867 : cluster [DBG] pgmap v6193: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:00.465 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:15:00.692 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:15:00.692 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 7m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:15:00.693 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 6m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:15:00.693 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:15:00.693 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:15:00.693 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:15:00.694 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:15:00.694 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:15:00.694 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:15:00.694 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 7m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:15:00.695 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 6m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:15:00.695 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:15:00.695 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:15:00.695 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:15:00.695 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:15:00.696 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:15:00.696 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:15:00.696 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:15:00.696 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:15:00.697 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 6m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:15:00.697 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 6m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:15:00.940 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:15:00.940 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:15:00.941 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:15:00.941 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:15:00.941 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:15:00.941 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:15:00.942 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:15:00.942 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:15:00.942 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:15:00.942 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:15:00.942 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:15:00.943 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:15:00.943 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:15:00.943 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:15:00.943 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:15:01.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:15:01 gibba045 bash[25517]: cluster 2021-03-10T17:14:59.989413+0000 mgr.gibba045.orlgmj (mgr.34412) 10868 : cluster [DBG] pgmap v6194: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:01.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:15:01 gibba045 bash[25517]: audit 2021-03-10T17:15:00.457069+0000 mgr.gibba045.orlgmj (mgr.34412) 10869 : audit [DBG] from='client.61330 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:15:01.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:15:01 gibba045 bash[25517]: audit 2021-03-10T17:15:00.939028+0000 mon.c (mon.1) 2978 : audit [DBG] from='client.? 172.21.2.115:0/2899825107' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:15:01.395 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:15:01 gibba015 bash[29377]: cluster 2021-03-10T17:14:59.989413+0000 mgr.gibba045.orlgmj (mgr.34412) 10868 : cluster [DBG] pgmap v6194: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:01.395 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:15:01 gibba015 bash[29377]: audit 2021-03-10T17:15:00.457069+0000 mgr.gibba045.orlgmj (mgr.34412) 10869 : audit [DBG] from='client.61330 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:15:01.395 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:15:01 gibba015 bash[29377]: audit 2021-03-10T17:15:00.939028+0000 mon.c (mon.1) 2978 : audit [DBG] from='client.? 172.21.2.115:0/2899825107' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:15:01.396 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:15:01 gibba015 bash[30343]: cluster 2021-03-10T17:14:59.989413+0000 mgr.gibba045.orlgmj (mgr.34412) 10868 : cluster [DBG] pgmap v6194: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:01.396 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:15:01 gibba015 bash[30343]: audit 2021-03-10T17:15:00.457069+0000 mgr.gibba045.orlgmj (mgr.34412) 10869 : audit [DBG] from='client.61330 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:15:01.397 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:15:01 gibba015 bash[30343]: audit 2021-03-10T17:15:00.939028+0000 mon.c (mon.1) 2978 : audit [DBG] from='client.? 172.21.2.115:0/2899825107' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:15:02.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:15:02 gibba015 bash[29377]: audit 2021-03-10T17:15:00.680738+0000 mgr.gibba045.orlgmj (mgr.34412) 10870 : audit [DBG] from='client.61336 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:15:02.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:15:02 gibba015 bash[30343]: audit 2021-03-10T17:15:00.680738+0000 mgr.gibba045.orlgmj (mgr.34412) 10870 : audit [DBG] from='client.61336 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:15:02.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:15:02 gibba045 bash[25517]: audit 2021-03-10T17:15:00.680738+0000 mgr.gibba045.orlgmj (mgr.34412) 10870 : audit [DBG] from='client.61336 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:15:03.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:15:03 gibba015 bash[29377]: cluster 2021-03-10T17:15:01.991108+0000 mgr.gibba045.orlgmj (mgr.34412) 10871 : cluster [DBG] pgmap v6195: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:03.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:15:03 gibba015 bash[30343]: cluster 2021-03-10T17:15:01.991108+0000 mgr.gibba045.orlgmj (mgr.34412) 10871 : cluster [DBG] pgmap v6195: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:03.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:15:03 gibba045 bash[25517]: cluster 2021-03-10T17:15:01.991108+0000 mgr.gibba045.orlgmj (mgr.34412) 10871 : cluster [DBG] pgmap v6195: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:05.425 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:15:05 gibba045 bash[25517]: cluster 2021-03-10T17:15:03.992306+0000 mgr.gibba045.orlgmj (mgr.34412) 10872 : cluster [DBG] pgmap v6196: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:05.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:15:05 gibba015 bash[29377]: cluster 2021-03-10T17:15:03.992306+0000 mgr.gibba045.orlgmj (mgr.34412) 10872 : cluster [DBG] pgmap v6196: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:05.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:15:05 gibba015 bash[30343]: cluster 2021-03-10T17:15:03.992306+0000 mgr.gibba045.orlgmj (mgr.34412) 10872 : cluster [DBG] pgmap v6196: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:06.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:15:06 gibba015 bash[29377]: cephadm 2021-03-10T17:15:05.425562+0000 mgr.gibba045.orlgmj (mgr.34412) 10873 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:15:06.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:15:06 gibba015 bash[30343]: cephadm 2021-03-10T17:15:05.425562+0000 mgr.gibba045.orlgmj (mgr.34412) 10873 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:15:06.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:15:06 gibba045 bash[25517]: cephadm 2021-03-10T17:15:05.425562+0000 mgr.gibba045.orlgmj (mgr.34412) 10873 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:15:07.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:15:07 gibba015 bash[29377]: cluster 2021-03-10T17:15:05.994096+0000 mgr.gibba045.orlgmj (mgr.34412) 10874 : cluster [DBG] pgmap v6197: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:07.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:15:07 gibba015 bash[30343]: cluster 2021-03-10T17:15:05.994096+0000 mgr.gibba045.orlgmj (mgr.34412) 10874 : cluster [DBG] pgmap v6197: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:07.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:15:07 gibba045 bash[25517]: cluster 2021-03-10T17:15:05.994096+0000 mgr.gibba045.orlgmj (mgr.34412) 10874 : cluster [DBG] pgmap v6197: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:08.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:15:08 gibba045 bash[25517]: cluster 2021-03-10T17:15:07.995466+0000 mgr.gibba045.orlgmj (mgr.34412) 10875 : cluster [DBG] pgmap v6198: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:08.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:15:08 gibba015 bash[29377]: cluster 2021-03-10T17:15:07.995466+0000 mgr.gibba045.orlgmj (mgr.34412) 10875 : cluster [DBG] pgmap v6198: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:08.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:15:08 gibba015 bash[30343]: cluster 2021-03-10T17:15:07.995466+0000 mgr.gibba045.orlgmj (mgr.34412) 10875 : cluster [DBG] pgmap v6198: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:11.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:15:11 gibba015 bash[29377]: cluster 2021-03-10T17:15:09.997284+0000 mgr.gibba045.orlgmj (mgr.34412) 10876 : cluster [DBG] pgmap v6199: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:11.577 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:15:11 gibba015 bash[30343]: cluster 2021-03-10T17:15:09.997284+0000 mgr.gibba045.orlgmj (mgr.34412) 10876 : cluster [DBG] pgmap v6199: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:11.578 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:15:11 gibba045 bash[25517]: cluster 2021-03-10T17:15:09.997284+0000 mgr.gibba045.orlgmj (mgr.34412) 10876 : cluster [DBG] pgmap v6199: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:13.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:15:13 gibba015 bash[29377]: cluster 2021-03-10T17:15:11.999067+0000 mgr.gibba045.orlgmj (mgr.34412) 10877 : cluster [DBG] pgmap v6200: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:13.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:15:13 gibba015 bash[30343]: cluster 2021-03-10T17:15:11.999067+0000 mgr.gibba045.orlgmj (mgr.34412) 10877 : cluster [DBG] pgmap v6200: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:13.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:15:13 gibba045 bash[25517]: cluster 2021-03-10T17:15:11.999067+0000 mgr.gibba045.orlgmj (mgr.34412) 10877 : cluster [DBG] pgmap v6200: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:15.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:15:15 gibba015 bash[29377]: cluster 2021-03-10T17:15:14.000306+0000 mgr.gibba045.orlgmj (mgr.34412) 10878 : cluster [DBG] pgmap v6201: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:15.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:15:15 gibba015 bash[30343]: cluster 2021-03-10T17:15:14.000306+0000 mgr.gibba045.orlgmj (mgr.34412) 10878 : cluster [DBG] pgmap v6201: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:15.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:15:15 gibba045 bash[25517]: cluster 2021-03-10T17:15:14.000306+0000 mgr.gibba045.orlgmj (mgr.34412) 10878 : cluster [DBG] pgmap v6201: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:17.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:15:17 gibba015 bash[29377]: cluster 2021-03-10T17:15:16.001807+0000 mgr.gibba045.orlgmj (mgr.34412) 10879 : cluster [DBG] pgmap v6202: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:17.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:15:17 gibba015 bash[30343]: cluster 2021-03-10T17:15:16.001807+0000 mgr.gibba045.orlgmj (mgr.34412) 10879 : cluster [DBG] pgmap v6202: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:17.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:15:17 gibba045 bash[25517]: cluster 2021-03-10T17:15:16.001807+0000 mgr.gibba045.orlgmj (mgr.34412) 10879 : cluster [DBG] pgmap v6202: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:18.804 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:15:18 gibba045 bash[25517]: cluster 2021-03-10T17:15:18.003451+0000 mgr.gibba045.orlgmj (mgr.34412) 10880 : cluster [DBG] pgmap v6203: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:18.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:15:18 gibba015 bash[29377]: cluster 2021-03-10T17:15:18.003451+0000 mgr.gibba045.orlgmj (mgr.34412) 10880 : cluster [DBG] pgmap v6203: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:18.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:15:18 gibba015 bash[30343]: cluster 2021-03-10T17:15:18.003451+0000 mgr.gibba045.orlgmj (mgr.34412) 10880 : cluster [DBG] pgmap v6203: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:21.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:15:21 gibba015 bash[29377]: cluster 2021-03-10T17:15:20.004883+0000 mgr.gibba045.orlgmj (mgr.34412) 10881 : cluster [DBG] pgmap v6204: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:21.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:15:21 gibba015 bash[29377]: audit 2021-03-10T17:15:20.436400+0000 mon.c (mon.1) 2979 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:15:21.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:15:21 gibba015 bash[29377]: cephadm 2021-03-10T17:15:20.443754+0000 mgr.gibba045.orlgmj (mgr.34412) 10882 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:15:21.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:15:21 gibba015 bash[29377]: cephadm 2021-03-10T17:15:20.445601+0000 mgr.gibba045.orlgmj (mgr.34412) 10883 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:15:21.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:15:21 gibba015 bash[29377]: audit 2021-03-10T17:15:20.649268+0000 mon.a (mon.0) 2313 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:15:21.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:15:21 gibba015 bash[29377]: audit 2021-03-10T17:15:20.653663+0000 mon.c (mon.1) 2980 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:15:21.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:15:21 gibba015 bash[29377]: audit 2021-03-10T17:15:20.656512+0000 mon.c (mon.1) 2981 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:15:21.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:15:21 gibba015 bash[29377]: audit 2021-03-10T17:15:20.659230+0000 mon.c (mon.1) 2982 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:15:21.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:15:21 gibba015 bash[29377]: audit 2021-03-10T17:15:20.661619+0000 mon.c (mon.1) 2983 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:15:21.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:15:21 gibba015 bash[29377]: audit 2021-03-10T17:15:20.667541+0000 mon.c (mon.1) 2984 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:15:21.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:15:21 gibba015 bash[29377]: audit 2021-03-10T17:15:20.668880+0000 mon.c (mon.1) 2985 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:15:21.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:15:21 gibba015 bash[30343]: cluster 2021-03-10T17:15:20.004883+0000 mgr.gibba045.orlgmj (mgr.34412) 10881 : cluster [DBG] pgmap v6204: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:21.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:15:21 gibba015 bash[30343]: audit 2021-03-10T17:15:20.436400+0000 mon.c (mon.1) 2979 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:15:21.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:15:21 gibba015 bash[30343]: cephadm 2021-03-10T17:15:20.443754+0000 mgr.gibba045.orlgmj (mgr.34412) 10882 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:15:21.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:15:21 gibba015 bash[30343]: cephadm 2021-03-10T17:15:20.445601+0000 mgr.gibba045.orlgmj (mgr.34412) 10883 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:15:21.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:15:21 gibba015 bash[30343]: audit 2021-03-10T17:15:20.649268+0000 mon.a (mon.0) 2313 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:15:21.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:15:21 gibba015 bash[30343]: audit 2021-03-10T17:15:20.653663+0000 mon.c (mon.1) 2980 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:15:21.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:15:21 gibba015 bash[30343]: audit 2021-03-10T17:15:20.656512+0000 mon.c (mon.1) 2981 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:15:21.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:15:21 gibba015 bash[30343]: audit 2021-03-10T17:15:20.659230+0000 mon.c (mon.1) 2982 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:15:21.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:15:21 gibba015 bash[30343]: audit 2021-03-10T17:15:20.661619+0000 mon.c (mon.1) 2983 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:15:21.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:15:21 gibba015 bash[30343]: audit 2021-03-10T17:15:20.667541+0000 mon.c (mon.1) 2984 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:15:21.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:15:21 gibba015 bash[30343]: audit 2021-03-10T17:15:20.668880+0000 mon.c (mon.1) 2985 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:15:21.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:15:21 gibba045 bash[25517]: cluster 2021-03-10T17:15:20.004883+0000 mgr.gibba045.orlgmj (mgr.34412) 10881 : cluster [DBG] pgmap v6204: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:21.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:15:21 gibba045 bash[25517]: audit 2021-03-10T17:15:20.436400+0000 mon.c (mon.1) 2979 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:15:21.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:15:21 gibba045 bash[25517]: cephadm 2021-03-10T17:15:20.443754+0000 mgr.gibba045.orlgmj (mgr.34412) 10882 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:15:21.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:15:21 gibba045 bash[25517]: cephadm 2021-03-10T17:15:20.445601+0000 mgr.gibba045.orlgmj (mgr.34412) 10883 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:15:21.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:15:21 gibba045 bash[25517]: audit 2021-03-10T17:15:20.649268+0000 mon.a (mon.0) 2313 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:15:21.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:15:21 gibba045 bash[25517]: audit 2021-03-10T17:15:20.653663+0000 mon.c (mon.1) 2980 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:15:21.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:15:21 gibba045 bash[25517]: audit 2021-03-10T17:15:20.656512+0000 mon.c (mon.1) 2981 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:15:21.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:15:21 gibba045 bash[25517]: audit 2021-03-10T17:15:20.659230+0000 mon.c (mon.1) 2982 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:15:21.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:15:21 gibba045 bash[25517]: audit 2021-03-10T17:15:20.661619+0000 mon.c (mon.1) 2983 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:15:21.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:15:21 gibba045 bash[25517]: audit 2021-03-10T17:15:20.667541+0000 mon.c (mon.1) 2984 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:15:21.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:15:21 gibba045 bash[25517]: audit 2021-03-10T17:15:20.668880+0000 mon.c (mon.1) 2985 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:15:22.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:15:22 gibba015 bash[29377]: cephadm 2021-03-10T17:15:20.654611+0000 mgr.gibba045.orlgmj (mgr.34412) 10884 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:15:22.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:15:22 gibba015 bash[29377]: cephadm 2021-03-10T17:15:20.657964+0000 mgr.gibba045.orlgmj (mgr.34412) 10885 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:15:22.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:15:22 gibba015 bash[29377]: cephadm 2021-03-10T17:15:20.660642+0000 mgr.gibba045.orlgmj (mgr.34412) 10886 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:15:22.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:15:22 gibba015 bash[29377]: cephadm 2021-03-10T17:15:20.660689+0000 mgr.gibba045.orlgmj (mgr.34412) 10887 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:15:22.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:15:22 gibba015 bash[29377]: cephadm 2021-03-10T17:15:20.663062+0000 mgr.gibba045.orlgmj (mgr.34412) 10888 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:15:22.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:15:22 gibba015 bash[29377]: cephadm 2021-03-10T17:15:20.663106+0000 mgr.gibba045.orlgmj (mgr.34412) 10889 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:15:22.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:15:22 gibba015 bash[29377]: cephadm 2021-03-10T17:15:20.665558+0000 mgr.gibba045.orlgmj (mgr.34412) 10890 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:15:22.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:15:22 gibba015 bash[29377]: cephadm 2021-03-10T17:15:20.669204+0000 mgr.gibba045.orlgmj (mgr.34412) 10891 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:15:22.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:15:22 gibba015 bash[29377]: cephadm 2021-03-10T17:15:20.669311+0000 mgr.gibba045.orlgmj (mgr.34412) 10892 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:15:22.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:15:22 gibba015 bash[29377]: cephadm 2021-03-10T17:15:20.670405+0000 mgr.gibba045.orlgmj (mgr.34412) 10893 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:15:22.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:15:22 gibba015 bash[29377]: cephadm 2021-03-10T17:15:20.670726+0000 mgr.gibba045.orlgmj (mgr.34412) 10894 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:15:22.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:15:22 gibba015 bash[29377]: cephadm 2021-03-10T17:15:20.671721+0000 mgr.gibba045.orlgmj (mgr.34412) 10895 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:15:22.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:15:22 gibba015 bash[29377]: cephadm 2021-03-10T17:15:20.671768+0000 mgr.gibba045.orlgmj (mgr.34412) 10896 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:15:22.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:15:22 gibba015 bash[29377]: cephadm 2021-03-10T17:15:20.671884+0000 mgr.gibba045.orlgmj (mgr.34412) 10897 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:15:22.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:15:22 gibba015 bash[30343]: cephadm 2021-03-10T17:15:20.654611+0000 mgr.gibba045.orlgmj (mgr.34412) 10884 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:15:22.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:15:22 gibba015 bash[30343]: cephadm 2021-03-10T17:15:20.657964+0000 mgr.gibba045.orlgmj (mgr.34412) 10885 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:15:22.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:15:22 gibba015 bash[30343]: cephadm 2021-03-10T17:15:20.660642+0000 mgr.gibba045.orlgmj (mgr.34412) 10886 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:15:22.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:15:22 gibba015 bash[30343]: cephadm 2021-03-10T17:15:20.660689+0000 mgr.gibba045.orlgmj (mgr.34412) 10887 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:15:22.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:15:22 gibba015 bash[30343]: cephadm 2021-03-10T17:15:20.663062+0000 mgr.gibba045.orlgmj (mgr.34412) 10888 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:15:22.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:15:22 gibba015 bash[30343]: cephadm 2021-03-10T17:15:20.663106+0000 mgr.gibba045.orlgmj (mgr.34412) 10889 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:15:22.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:15:22 gibba015 bash[30343]: cephadm 2021-03-10T17:15:20.665558+0000 mgr.gibba045.orlgmj (mgr.34412) 10890 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:15:22.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:15:22 gibba015 bash[30343]: cephadm 2021-03-10T17:15:20.669204+0000 mgr.gibba045.orlgmj (mgr.34412) 10891 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:15:22.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:15:22 gibba015 bash[30343]: cephadm 2021-03-10T17:15:20.669311+0000 mgr.gibba045.orlgmj (mgr.34412) 10892 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:15:22.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:15:22 gibba015 bash[30343]: cephadm 2021-03-10T17:15:20.670405+0000 mgr.gibba045.orlgmj (mgr.34412) 10893 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:15:22.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:15:22 gibba015 bash[30343]: cephadm 2021-03-10T17:15:20.670726+0000 mgr.gibba045.orlgmj (mgr.34412) 10894 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:15:22.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:15:22 gibba015 bash[30343]: cephadm 2021-03-10T17:15:20.671721+0000 mgr.gibba045.orlgmj (mgr.34412) 10895 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:15:22.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:15:22 gibba015 bash[30343]: cephadm 2021-03-10T17:15:20.671768+0000 mgr.gibba045.orlgmj (mgr.34412) 10896 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:15:22.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:15:22 gibba015 bash[30343]: cephadm 2021-03-10T17:15:20.671884+0000 mgr.gibba045.orlgmj (mgr.34412) 10897 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:15:22.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:15:22 gibba045 bash[25517]: cephadm 2021-03-10T17:15:20.654611+0000 mgr.gibba045.orlgmj (mgr.34412) 10884 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:15:22.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:15:22 gibba045 bash[25517]: cephadm 2021-03-10T17:15:20.657964+0000 mgr.gibba045.orlgmj (mgr.34412) 10885 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:15:22.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:15:22 gibba045 bash[25517]: cephadm 2021-03-10T17:15:20.660642+0000 mgr.gibba045.orlgmj (mgr.34412) 10886 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:15:22.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:15:22 gibba045 bash[25517]: cephadm 2021-03-10T17:15:20.660689+0000 mgr.gibba045.orlgmj (mgr.34412) 10887 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:15:22.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:15:22 gibba045 bash[25517]: cephadm 2021-03-10T17:15:20.663062+0000 mgr.gibba045.orlgmj (mgr.34412) 10888 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:15:22.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:15:22 gibba045 bash[25517]: cephadm 2021-03-10T17:15:20.663106+0000 mgr.gibba045.orlgmj (mgr.34412) 10889 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:15:22.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:15:22 gibba045 bash[25517]: cephadm 2021-03-10T17:15:20.665558+0000 mgr.gibba045.orlgmj (mgr.34412) 10890 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:15:22.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:15:22 gibba045 bash[25517]: cephadm 2021-03-10T17:15:20.669204+0000 mgr.gibba045.orlgmj (mgr.34412) 10891 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:15:22.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:15:22 gibba045 bash[25517]: cephadm 2021-03-10T17:15:20.669311+0000 mgr.gibba045.orlgmj (mgr.34412) 10892 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:15:22.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:15:22 gibba045 bash[25517]: cephadm 2021-03-10T17:15:20.670405+0000 mgr.gibba045.orlgmj (mgr.34412) 10893 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:15:22.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:15:22 gibba045 bash[25517]: cephadm 2021-03-10T17:15:20.670726+0000 mgr.gibba045.orlgmj (mgr.34412) 10894 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:15:22.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:15:22 gibba045 bash[25517]: cephadm 2021-03-10T17:15:20.671721+0000 mgr.gibba045.orlgmj (mgr.34412) 10895 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:15:22.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:15:22 gibba045 bash[25517]: cephadm 2021-03-10T17:15:20.671768+0000 mgr.gibba045.orlgmj (mgr.34412) 10896 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:15:22.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:15:22 gibba045 bash[25517]: cephadm 2021-03-10T17:15:20.671884+0000 mgr.gibba045.orlgmj (mgr.34412) 10897 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:15:23.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:15:23 gibba015 bash[29377]: cluster 2021-03-10T17:15:22.006677+0000 mgr.gibba045.orlgmj (mgr.34412) 10898 : cluster [DBG] pgmap v6205: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:23.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:15:23 gibba015 bash[30343]: cluster 2021-03-10T17:15:22.006677+0000 mgr.gibba045.orlgmj (mgr.34412) 10898 : cluster [DBG] pgmap v6205: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:23.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:15:23 gibba045 bash[25517]: cluster 2021-03-10T17:15:22.006677+0000 mgr.gibba045.orlgmj (mgr.34412) 10898 : cluster [DBG] pgmap v6205: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:25.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:15:25 gibba015 bash[29377]: cluster 2021-03-10T17:15:24.007935+0000 mgr.gibba045.orlgmj (mgr.34412) 10899 : cluster [DBG] pgmap v6206: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:25.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:15:25 gibba015 bash[30343]: cluster 2021-03-10T17:15:24.007935+0000 mgr.gibba045.orlgmj (mgr.34412) 10899 : cluster [DBG] pgmap v6206: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:25.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:15:25 gibba045 bash[25517]: cluster 2021-03-10T17:15:24.007935+0000 mgr.gibba045.orlgmj (mgr.34412) 10899 : cluster [DBG] pgmap v6206: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:27.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:15:27 gibba015 bash[29377]: cluster 2021-03-10T17:15:26.009623+0000 mgr.gibba045.orlgmj (mgr.34412) 10900 : cluster [DBG] pgmap v6207: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:27.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:15:27 gibba015 bash[30343]: cluster 2021-03-10T17:15:26.009623+0000 mgr.gibba045.orlgmj (mgr.34412) 10900 : cluster [DBG] pgmap v6207: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:27.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:15:27 gibba045 bash[25517]: cluster 2021-03-10T17:15:26.009623+0000 mgr.gibba045.orlgmj (mgr.34412) 10900 : cluster [DBG] pgmap v6207: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:28.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:15:28 gibba045 bash[25517]: cluster 2021-03-10T17:15:28.011005+0000 mgr.gibba045.orlgmj (mgr.34412) 10901 : cluster [DBG] pgmap v6208: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:28.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:15:28 gibba015 bash[29377]: cluster 2021-03-10T17:15:28.011005+0000 mgr.gibba045.orlgmj (mgr.34412) 10901 : cluster [DBG] pgmap v6208: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:28.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:15:28 gibba015 bash[30343]: cluster 2021-03-10T17:15:28.011005+0000 mgr.gibba045.orlgmj (mgr.34412) 10901 : cluster [DBG] pgmap v6208: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:31.184 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:15:31.441 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:15:31.441 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 8m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:15:31.442 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 7m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:15:31.442 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:15:31.442 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:15:31.442 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:15:31.443 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:15:31.443 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:15:31.443 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:15:31.443 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 8m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:15:31.444 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 7m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:15:31.444 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:15:31.444 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:15:31.444 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:15:31.444 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:15:31.445 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:15:31.445 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:15:31.445 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:15:31.445 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:15:31.445 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 7m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:15:31.446 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 7m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:15:31.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:15:31 gibba015 bash[29377]: cluster 2021-03-10T17:15:30.011812+0000 mgr.gibba045.orlgmj (mgr.34412) 10902 : cluster [DBG] pgmap v6209: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:31.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:15:31 gibba015 bash[30343]: cluster 2021-03-10T17:15:30.011812+0000 mgr.gibba045.orlgmj (mgr.34412) 10902 : cluster [DBG] pgmap v6209: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:31.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:15:31 gibba045 bash[25517]: cluster 2021-03-10T17:15:30.011812+0000 mgr.gibba045.orlgmj (mgr.34412) 10902 : cluster [DBG] pgmap v6209: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:31.699 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:15:31.699 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:15:31.700 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:15:31.700 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:15:31.700 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:15:31.700 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:15:31.701 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:15:31.701 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:15:31.701 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:15:31.701 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:15:31.701 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:15:31.702 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:15:31.702 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:15:31.702 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:15:31.702 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:15:32.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:15:32 gibba015 bash[29377]: audit 2021-03-10T17:15:31.175868+0000 mgr.gibba045.orlgmj (mgr.34412) 10903 : audit [DBG] from='client.51360 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:15:32.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:15:32 gibba015 bash[29377]: audit 2021-03-10T17:15:31.400490+0000 mgr.gibba045.orlgmj (mgr.34412) 10904 : audit [DBG] from='client.51366 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:15:32.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:15:32 gibba015 bash[29377]: audit 2021-03-10T17:15:31.698162+0000 mon.c (mon.1) 2986 : audit [DBG] from='client.? 172.21.2.115:0/141887964' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:15:32.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:15:32 gibba015 bash[30343]: audit 2021-03-10T17:15:31.175868+0000 mgr.gibba045.orlgmj (mgr.34412) 10903 : audit [DBG] from='client.51360 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:15:32.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:15:32 gibba015 bash[30343]: audit 2021-03-10T17:15:31.400490+0000 mgr.gibba045.orlgmj (mgr.34412) 10904 : audit [DBG] from='client.51366 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:15:32.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:15:32 gibba015 bash[30343]: audit 2021-03-10T17:15:31.698162+0000 mon.c (mon.1) 2986 : audit [DBG] from='client.? 172.21.2.115:0/141887964' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:15:32.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:15:32 gibba045 bash[25517]: audit 2021-03-10T17:15:31.175868+0000 mgr.gibba045.orlgmj (mgr.34412) 10903 : audit [DBG] from='client.51360 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:15:32.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:15:32 gibba045 bash[25517]: audit 2021-03-10T17:15:31.400490+0000 mgr.gibba045.orlgmj (mgr.34412) 10904 : audit [DBG] from='client.51366 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:15:32.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:15:32 gibba045 bash[25517]: audit 2021-03-10T17:15:31.698162+0000 mon.c (mon.1) 2986 : audit [DBG] from='client.? 172.21.2.115:0/141887964' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:15:33.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:15:33 gibba015 bash[29377]: cluster 2021-03-10T17:15:32.013497+0000 mgr.gibba045.orlgmj (mgr.34412) 10905 : cluster [DBG] pgmap v6210: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:33.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:15:33 gibba015 bash[30343]: cluster 2021-03-10T17:15:32.013497+0000 mgr.gibba045.orlgmj (mgr.34412) 10905 : cluster [DBG] pgmap v6210: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:33.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:15:33 gibba045 bash[25517]: cluster 2021-03-10T17:15:32.013497+0000 mgr.gibba045.orlgmj (mgr.34412) 10905 : cluster [DBG] pgmap v6210: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:35.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:15:35 gibba015 bash[29377]: cluster 2021-03-10T17:15:34.014733+0000 mgr.gibba045.orlgmj (mgr.34412) 10906 : cluster [DBG] pgmap v6211: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:35.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:15:35 gibba015 bash[30343]: cluster 2021-03-10T17:15:34.014733+0000 mgr.gibba045.orlgmj (mgr.34412) 10906 : cluster [DBG] pgmap v6211: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:35.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:15:35 gibba045 bash[25517]: cluster 2021-03-10T17:15:34.014733+0000 mgr.gibba045.orlgmj (mgr.34412) 10906 : cluster [DBG] pgmap v6211: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:37.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:15:37 gibba015 bash[29377]: cephadm 2021-03-10T17:15:35.687905+0000 mgr.gibba045.orlgmj (mgr.34412) 10907 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:15:37.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:15:37 gibba015 bash[29377]: cluster 2021-03-10T17:15:36.016381+0000 mgr.gibba045.orlgmj (mgr.34412) 10908 : cluster [DBG] pgmap v6212: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:37.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:15:37 gibba015 bash[30343]: cephadm 2021-03-10T17:15:35.687905+0000 mgr.gibba045.orlgmj (mgr.34412) 10907 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:15:37.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:15:37 gibba015 bash[30343]: cluster 2021-03-10T17:15:36.016381+0000 mgr.gibba045.orlgmj (mgr.34412) 10908 : cluster [DBG] pgmap v6212: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:37.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:15:37 gibba045 bash[25517]: cephadm 2021-03-10T17:15:35.687905+0000 mgr.gibba045.orlgmj (mgr.34412) 10907 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:15:37.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:15:37 gibba045 bash[25517]: cluster 2021-03-10T17:15:36.016381+0000 mgr.gibba045.orlgmj (mgr.34412) 10908 : cluster [DBG] pgmap v6212: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:38.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:15:38 gibba045 bash[25517]: cluster 2021-03-10T17:15:38.017826+0000 mgr.gibba045.orlgmj (mgr.34412) 10909 : cluster [DBG] pgmap v6213: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:38.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:15:38 gibba015 bash[29377]: cluster 2021-03-10T17:15:38.017826+0000 mgr.gibba045.orlgmj (mgr.34412) 10909 : cluster [DBG] pgmap v6213: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:38.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:15:38 gibba015 bash[30343]: cluster 2021-03-10T17:15:38.017826+0000 mgr.gibba045.orlgmj (mgr.34412) 10909 : cluster [DBG] pgmap v6213: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:41.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:15:41 gibba015 bash[29377]: cluster 2021-03-10T17:15:40.018585+0000 mgr.gibba045.orlgmj (mgr.34412) 10910 : cluster [DBG] pgmap v6214: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:41.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:15:41 gibba015 bash[30343]: cluster 2021-03-10T17:15:40.018585+0000 mgr.gibba045.orlgmj (mgr.34412) 10910 : cluster [DBG] pgmap v6214: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:41.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:15:41 gibba045 bash[25517]: cluster 2021-03-10T17:15:40.018585+0000 mgr.gibba045.orlgmj (mgr.34412) 10910 : cluster [DBG] pgmap v6214: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:43.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:15:43 gibba015 bash[29377]: cluster 2021-03-10T17:15:42.020123+0000 mgr.gibba045.orlgmj (mgr.34412) 10911 : cluster [DBG] pgmap v6215: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:43.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:15:43 gibba015 bash[30343]: cluster 2021-03-10T17:15:42.020123+0000 mgr.gibba045.orlgmj (mgr.34412) 10911 : cluster [DBG] pgmap v6215: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:43.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:15:43 gibba045 bash[25517]: cluster 2021-03-10T17:15:42.020123+0000 mgr.gibba045.orlgmj (mgr.34412) 10911 : cluster [DBG] pgmap v6215: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:45.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:15:45 gibba015 bash[29377]: cluster 2021-03-10T17:15:44.021384+0000 mgr.gibba045.orlgmj (mgr.34412) 10912 : cluster [DBG] pgmap v6216: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:45.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:15:45 gibba015 bash[30343]: cluster 2021-03-10T17:15:44.021384+0000 mgr.gibba045.orlgmj (mgr.34412) 10912 : cluster [DBG] pgmap v6216: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:45.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:15:45 gibba045 bash[25517]: cluster 2021-03-10T17:15:44.021384+0000 mgr.gibba045.orlgmj (mgr.34412) 10912 : cluster [DBG] pgmap v6216: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:47.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:15:47 gibba015 bash[29377]: cluster 2021-03-10T17:15:46.023164+0000 mgr.gibba045.orlgmj (mgr.34412) 10913 : cluster [DBG] pgmap v6217: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:47.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:15:47 gibba015 bash[30343]: cluster 2021-03-10T17:15:46.023164+0000 mgr.gibba045.orlgmj (mgr.34412) 10913 : cluster [DBG] pgmap v6217: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:47.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:15:47 gibba045 bash[25517]: cluster 2021-03-10T17:15:46.023164+0000 mgr.gibba045.orlgmj (mgr.34412) 10913 : cluster [DBG] pgmap v6217: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:48.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:15:48 gibba015 bash[29377]: cluster 2021-03-10T17:15:48.024608+0000 mgr.gibba045.orlgmj (mgr.34412) 10914 : cluster [DBG] pgmap v6218: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:48.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:15:48 gibba015 bash[30343]: cluster 2021-03-10T17:15:48.024608+0000 mgr.gibba045.orlgmj (mgr.34412) 10914 : cluster [DBG] pgmap v6218: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:49.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:15:48 gibba045 bash[25517]: cluster 2021-03-10T17:15:48.024608+0000 mgr.gibba045.orlgmj (mgr.34412) 10914 : cluster [DBG] pgmap v6218: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:51.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:15:51 gibba015 bash[29377]: cluster 2021-03-10T17:15:50.025118+0000 mgr.gibba045.orlgmj (mgr.34412) 10915 : cluster [DBG] pgmap v6219: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:51.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:15:51 gibba015 bash[30343]: cluster 2021-03-10T17:15:50.025118+0000 mgr.gibba045.orlgmj (mgr.34412) 10915 : cluster [DBG] pgmap v6219: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:51.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:15:51 gibba045 bash[25517]: cluster 2021-03-10T17:15:50.025118+0000 mgr.gibba045.orlgmj (mgr.34412) 10915 : cluster [DBG] pgmap v6219: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:52.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:15:52 gibba015 bash[29377]: cephadm 2021-03-10T17:15:50.701240+0000 mgr.gibba045.orlgmj (mgr.34412) 10916 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:15:52.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:15:52 gibba015 bash[30343]: cephadm 2021-03-10T17:15:50.701240+0000 mgr.gibba045.orlgmj (mgr.34412) 10916 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:15:52.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:15:52 gibba045 bash[25517]: cephadm 2021-03-10T17:15:50.701240+0000 mgr.gibba045.orlgmj (mgr.34412) 10916 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:15:53.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:15:53 gibba015 bash[29377]: cluster 2021-03-10T17:15:52.026754+0000 mgr.gibba045.orlgmj (mgr.34412) 10917 : cluster [DBG] pgmap v6220: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:53.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:15:53 gibba015 bash[30343]: cluster 2021-03-10T17:15:52.026754+0000 mgr.gibba045.orlgmj (mgr.34412) 10917 : cluster [DBG] pgmap v6220: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:53.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:15:53 gibba045 bash[25517]: cluster 2021-03-10T17:15:52.026754+0000 mgr.gibba045.orlgmj (mgr.34412) 10917 : cluster [DBG] pgmap v6220: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:15:54 gibba015 bash[29377]: audit 2021-03-10T17:15:53.956832+0000 mon.c (mon.1) 2987 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:15:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:15:54 gibba015 bash[29377]: audit 2021-03-10T17:15:53.957553+0000 mon.c (mon.1) 2988 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:15:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:15:54 gibba015 bash[29377]: audit 2021-03-10T17:15:53.957956+0000 mon.a (mon.0) 2314 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:15:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:15:54 gibba015 bash[29377]: audit 2021-03-10T17:15:53.959154+0000 mon.a (mon.0) 2315 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:15:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:15:54 gibba015 bash[29377]: audit 2021-03-10T17:15:54.041526+0000 mon.c (mon.1) 2989 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T17:15:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:15:54 gibba015 bash[29377]: audit 2021-03-10T17:15:54.042301+0000 mon.c (mon.1) 2990 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T17:15:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:15:54 gibba015 bash[29377]: audit 2021-03-10T17:15:54.042779+0000 mon.a (mon.0) 2316 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T17:15:54.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:15:54 gibba015 bash[29377]: audit 2021-03-10T17:15:54.042990+0000 mon.c (mon.1) 2991 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:15:54.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:15:54 gibba015 bash[29377]: audit 2021-03-10T17:15:54.043827+0000 mon.c (mon.1) 2992 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:15:54.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:15:54 gibba015 bash[29377]: audit 2021-03-10T17:15:54.044177+0000 mon.a (mon.0) 2317 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T17:15:54.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:15:54 gibba015 bash[29377]: audit 2021-03-10T17:15:54.045136+0000 mon.a (mon.0) 2318 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:15:54.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:15:54 gibba015 bash[29377]: audit 2021-03-10T17:15:54.045936+0000 mon.a (mon.0) 2319 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:15:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:15:54 gibba015 bash[30343]: audit 2021-03-10T17:15:53.956832+0000 mon.c (mon.1) 2987 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:15:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:15:54 gibba015 bash[30343]: audit 2021-03-10T17:15:53.957553+0000 mon.c (mon.1) 2988 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:15:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:15:54 gibba015 bash[30343]: audit 2021-03-10T17:15:53.957956+0000 mon.a (mon.0) 2314 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:15:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:15:54 gibba015 bash[30343]: audit 2021-03-10T17:15:53.959154+0000 mon.a (mon.0) 2315 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:15:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:15:54 gibba015 bash[30343]: audit 2021-03-10T17:15:54.041526+0000 mon.c (mon.1) 2989 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T17:15:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:15:54 gibba015 bash[30343]: audit 2021-03-10T17:15:54.042301+0000 mon.c (mon.1) 2990 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T17:15:54.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:15:54 gibba015 bash[30343]: audit 2021-03-10T17:15:54.042779+0000 mon.a (mon.0) 2316 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T17:15:54.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:15:54 gibba015 bash[30343]: audit 2021-03-10T17:15:54.042990+0000 mon.c (mon.1) 2991 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:15:54.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:15:54 gibba015 bash[30343]: audit 2021-03-10T17:15:54.043827+0000 mon.c (mon.1) 2992 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:15:54.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:15:54 gibba015 bash[30343]: audit 2021-03-10T17:15:54.044177+0000 mon.a (mon.0) 2317 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T17:15:54.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:15:54 gibba015 bash[30343]: audit 2021-03-10T17:15:54.045136+0000 mon.a (mon.0) 2318 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:15:54.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:15:54 gibba015 bash[30343]: audit 2021-03-10T17:15:54.045936+0000 mon.a (mon.0) 2319 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:15:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:15:54 gibba045 bash[25517]: audit 2021-03-10T17:15:53.956832+0000 mon.c (mon.1) 2987 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:15:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:15:54 gibba045 bash[25517]: audit 2021-03-10T17:15:53.957553+0000 mon.c (mon.1) 2988 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:15:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:15:54 gibba045 bash[25517]: audit 2021-03-10T17:15:53.957956+0000 mon.a (mon.0) 2314 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:15:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:15:54 gibba045 bash[25517]: audit 2021-03-10T17:15:53.959154+0000 mon.a (mon.0) 2315 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:15:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:15:54 gibba045 bash[25517]: audit 2021-03-10T17:15:54.041526+0000 mon.c (mon.1) 2989 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T17:15:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:15:54 gibba045 bash[25517]: audit 2021-03-10T17:15:54.042301+0000 mon.c (mon.1) 2990 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T17:15:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:15:54 gibba045 bash[25517]: audit 2021-03-10T17:15:54.042779+0000 mon.a (mon.0) 2316 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T17:15:54.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:15:54 gibba045 bash[25517]: audit 2021-03-10T17:15:54.042990+0000 mon.c (mon.1) 2991 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:15:54.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:15:54 gibba045 bash[25517]: audit 2021-03-10T17:15:54.043827+0000 mon.c (mon.1) 2992 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:15:54.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:15:54 gibba045 bash[25517]: audit 2021-03-10T17:15:54.044177+0000 mon.a (mon.0) 2317 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T17:15:54.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:15:54 gibba045 bash[25517]: audit 2021-03-10T17:15:54.045136+0000 mon.a (mon.0) 2318 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:15:54.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:15:54 gibba045 bash[25517]: audit 2021-03-10T17:15:54.045936+0000 mon.a (mon.0) 2319 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:15:55.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:15:55 gibba015 bash[29377]: cluster 2021-03-10T17:15:54.027940+0000 mgr.gibba045.orlgmj (mgr.34412) 10918 : cluster [DBG] pgmap v6221: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:55.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:15:55 gibba015 bash[30343]: cluster 2021-03-10T17:15:54.027940+0000 mgr.gibba045.orlgmj (mgr.34412) 10918 : cluster [DBG] pgmap v6221: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:55.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:15:55 gibba045 bash[25517]: cluster 2021-03-10T17:15:54.027940+0000 mgr.gibba045.orlgmj (mgr.34412) 10918 : cluster [DBG] pgmap v6221: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:57.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:15:57 gibba015 bash[29377]: cluster 2021-03-10T17:15:56.029474+0000 mgr.gibba045.orlgmj (mgr.34412) 10919 : cluster [DBG] pgmap v6222: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:57.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:15:57 gibba015 bash[30343]: cluster 2021-03-10T17:15:56.029474+0000 mgr.gibba045.orlgmj (mgr.34412) 10919 : cluster [DBG] pgmap v6222: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:57.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:15:57 gibba045 bash[25517]: cluster 2021-03-10T17:15:56.029474+0000 mgr.gibba045.orlgmj (mgr.34412) 10919 : cluster [DBG] pgmap v6222: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:58.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:15:58 gibba015 bash[29377]: cluster 2021-03-10T17:15:58.030850+0000 mgr.gibba045.orlgmj (mgr.34412) 10920 : cluster [DBG] pgmap v6223: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:58.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:15:58 gibba015 bash[30343]: cluster 2021-03-10T17:15:58.030850+0000 mgr.gibba045.orlgmj (mgr.34412) 10920 : cluster [DBG] pgmap v6223: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:59.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:15:58 gibba045 bash[25517]: cluster 2021-03-10T17:15:58.030850+0000 mgr.gibba045.orlgmj (mgr.34412) 10920 : cluster [DBG] pgmap v6223: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:01.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:16:01 gibba015 bash[29377]: cluster 2021-03-10T17:16:00.031752+0000 mgr.gibba045.orlgmj (mgr.34412) 10921 : cluster [DBG] pgmap v6224: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:01.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:16:01 gibba015 bash[30343]: cluster 2021-03-10T17:16:00.031752+0000 mgr.gibba045.orlgmj (mgr.34412) 10921 : cluster [DBG] pgmap v6224: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:01.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:16:01 gibba045 bash[25517]: cluster 2021-03-10T17:16:00.031752+0000 mgr.gibba045.orlgmj (mgr.34412) 10921 : cluster [DBG] pgmap v6224: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:01.952 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:16:02.180 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:16:02.180 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 8m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:16:02.181 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 7m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:16:02.181 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:16:02.181 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:16:02.181 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:16:02.181 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:16:02.182 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:16:02.182 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:16:02.182 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 8m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:16:02.182 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 7m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:16:02.183 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:16:02.183 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:16:02.183 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:16:02.183 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:16:02.183 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:16:02.184 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:16:02.184 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:16:02.184 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:16:02.184 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 7m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:16:02.185 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 7m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:16:02.430 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:16:02.431 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:16:02.431 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:16:02.431 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:16:02.431 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:16:02.432 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:16:02.432 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:16:02.432 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:16:02.432 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:16:02.433 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:16:02.433 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:16:02.433 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:16:02.433 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:16:02.433 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:16:02.434 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:16:03.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:16:03 gibba015 bash[29377]: audit 2021-03-10T17:16:01.935848+0000 mgr.gibba045.orlgmj (mgr.34412) 10922 : audit [DBG] from='client.51378 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:16:03.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:16:03 gibba015 bash[29377]: cluster 2021-03-10T17:16:02.033332+0000 mgr.gibba045.orlgmj (mgr.34412) 10923 : cluster [DBG] pgmap v6225: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:03.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:16:03 gibba015 bash[29377]: audit 2021-03-10T17:16:02.169659+0000 mgr.gibba045.orlgmj (mgr.34412) 10924 : audit [DBG] from='client.61372 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:16:03.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:16:03 gibba015 bash[29377]: audit 2021-03-10T17:16:02.429312+0000 mon.c (mon.1) 2993 : audit [DBG] from='client.? 172.21.2.115:0/1981841092' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:16:03.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:16:03 gibba015 bash[30343]: audit 2021-03-10T17:16:01.935848+0000 mgr.gibba045.orlgmj (mgr.34412) 10922 : audit [DBG] from='client.51378 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:16:03.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:16:03 gibba015 bash[30343]: cluster 2021-03-10T17:16:02.033332+0000 mgr.gibba045.orlgmj (mgr.34412) 10923 : cluster [DBG] pgmap v6225: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:03.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:16:03 gibba015 bash[30343]: audit 2021-03-10T17:16:02.169659+0000 mgr.gibba045.orlgmj (mgr.34412) 10924 : audit [DBG] from='client.61372 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:16:03.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:16:03 gibba015 bash[30343]: audit 2021-03-10T17:16:02.429312+0000 mon.c (mon.1) 2993 : audit [DBG] from='client.? 172.21.2.115:0/1981841092' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:16:03.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:16:03 gibba045 bash[25517]: audit 2021-03-10T17:16:01.935848+0000 mgr.gibba045.orlgmj (mgr.34412) 10922 : audit [DBG] from='client.51378 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:16:03.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:16:03 gibba045 bash[25517]: cluster 2021-03-10T17:16:02.033332+0000 mgr.gibba045.orlgmj (mgr.34412) 10923 : cluster [DBG] pgmap v6225: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:03.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:16:03 gibba045 bash[25517]: audit 2021-03-10T17:16:02.169659+0000 mgr.gibba045.orlgmj (mgr.34412) 10924 : audit [DBG] from='client.61372 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:16:03.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:16:03 gibba045 bash[25517]: audit 2021-03-10T17:16:02.429312+0000 mon.c (mon.1) 2993 : audit [DBG] from='client.? 172.21.2.115:0/1981841092' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:16:05.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:16:05 gibba015 bash[29377]: cluster 2021-03-10T17:16:04.034900+0000 mgr.gibba045.orlgmj (mgr.34412) 10925 : cluster [DBG] pgmap v6226: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:05.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:16:05 gibba015 bash[30343]: cluster 2021-03-10T17:16:04.034900+0000 mgr.gibba045.orlgmj (mgr.34412) 10925 : cluster [DBG] pgmap v6226: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:05.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:16:05 gibba045 bash[25517]: cluster 2021-03-10T17:16:04.034900+0000 mgr.gibba045.orlgmj (mgr.34412) 10925 : cluster [DBG] pgmap v6226: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:07.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:16:07 gibba015 bash[29377]: cephadm 2021-03-10T17:16:05.702143+0000 mgr.gibba045.orlgmj (mgr.34412) 10926 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:16:07.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:16:07 gibba015 bash[29377]: cluster 2021-03-10T17:16:06.036718+0000 mgr.gibba045.orlgmj (mgr.34412) 10927 : cluster [DBG] pgmap v6227: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:07.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:16:07 gibba015 bash[30343]: cephadm 2021-03-10T17:16:05.702143+0000 mgr.gibba045.orlgmj (mgr.34412) 10926 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:16:07.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:16:07 gibba015 bash[30343]: cluster 2021-03-10T17:16:06.036718+0000 mgr.gibba045.orlgmj (mgr.34412) 10927 : cluster [DBG] pgmap v6227: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:07.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:16:07 gibba045 bash[25517]: cephadm 2021-03-10T17:16:05.702143+0000 mgr.gibba045.orlgmj (mgr.34412) 10926 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:16:07.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:16:07 gibba045 bash[25517]: cluster 2021-03-10T17:16:06.036718+0000 mgr.gibba045.orlgmj (mgr.34412) 10927 : cluster [DBG] pgmap v6227: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:08.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:16:08 gibba015 bash[29377]: cluster 2021-03-10T17:16:08.038101+0000 mgr.gibba045.orlgmj (mgr.34412) 10928 : cluster [DBG] pgmap v6228: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:08.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:16:08 gibba015 bash[30343]: cluster 2021-03-10T17:16:08.038101+0000 mgr.gibba045.orlgmj (mgr.34412) 10928 : cluster [DBG] pgmap v6228: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:09.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:16:08 gibba045 bash[25517]: cluster 2021-03-10T17:16:08.038101+0000 mgr.gibba045.orlgmj (mgr.34412) 10928 : cluster [DBG] pgmap v6228: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:11.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:16:11 gibba015 bash[29377]: cluster 2021-03-10T17:16:10.039771+0000 mgr.gibba045.orlgmj (mgr.34412) 10929 : cluster [DBG] pgmap v6229: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:11.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:16:11 gibba015 bash[30343]: cluster 2021-03-10T17:16:10.039771+0000 mgr.gibba045.orlgmj (mgr.34412) 10929 : cluster [DBG] pgmap v6229: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:11.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:16:11 gibba045 bash[25517]: cluster 2021-03-10T17:16:10.039771+0000 mgr.gibba045.orlgmj (mgr.34412) 10929 : cluster [DBG] pgmap v6229: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:13.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:16:13 gibba015 bash[29377]: cluster 2021-03-10T17:16:12.041327+0000 mgr.gibba045.orlgmj (mgr.34412) 10930 : cluster [DBG] pgmap v6230: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:13.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:16:13 gibba015 bash[30343]: cluster 2021-03-10T17:16:12.041327+0000 mgr.gibba045.orlgmj (mgr.34412) 10930 : cluster [DBG] pgmap v6230: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:13.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:16:13 gibba045 bash[25517]: cluster 2021-03-10T17:16:12.041327+0000 mgr.gibba045.orlgmj (mgr.34412) 10930 : cluster [DBG] pgmap v6230: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:15.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:16:15 gibba015 bash[29377]: cluster 2021-03-10T17:16:14.042566+0000 mgr.gibba045.orlgmj (mgr.34412) 10931 : cluster [DBG] pgmap v6231: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:15.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:16:15 gibba015 bash[30343]: cluster 2021-03-10T17:16:14.042566+0000 mgr.gibba045.orlgmj (mgr.34412) 10931 : cluster [DBG] pgmap v6231: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:15.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:16:15 gibba045 bash[25517]: cluster 2021-03-10T17:16:14.042566+0000 mgr.gibba045.orlgmj (mgr.34412) 10931 : cluster [DBG] pgmap v6231: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:17.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:16:17 gibba015 bash[29377]: cluster 2021-03-10T17:16:16.044150+0000 mgr.gibba045.orlgmj (mgr.34412) 10932 : cluster [DBG] pgmap v6232: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:17.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:16:17 gibba015 bash[30343]: cluster 2021-03-10T17:16:16.044150+0000 mgr.gibba045.orlgmj (mgr.34412) 10932 : cluster [DBG] pgmap v6232: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:17.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:16:17 gibba045 bash[25517]: cluster 2021-03-10T17:16:16.044150+0000 mgr.gibba045.orlgmj (mgr.34412) 10932 : cluster [DBG] pgmap v6232: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:18.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:16:18 gibba015 bash[29377]: cluster 2021-03-10T17:16:18.045608+0000 mgr.gibba045.orlgmj (mgr.34412) 10933 : cluster [DBG] pgmap v6233: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:18.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:16:18 gibba015 bash[30343]: cluster 2021-03-10T17:16:18.045608+0000 mgr.gibba045.orlgmj (mgr.34412) 10933 : cluster [DBG] pgmap v6233: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:19.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:16:18 gibba045 bash[25517]: cluster 2021-03-10T17:16:18.045608+0000 mgr.gibba045.orlgmj (mgr.34412) 10933 : cluster [DBG] pgmap v6233: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:21.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:16:21 gibba015 bash[29377]: cluster 2021-03-10T17:16:20.046567+0000 mgr.gibba045.orlgmj (mgr.34412) 10934 : cluster [DBG] pgmap v6234: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:21.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:16:21 gibba015 bash[29377]: audit 2021-03-10T17:16:20.717143+0000 mon.c (mon.1) 2994 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:16:21.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:16:21 gibba015 bash[29377]: audit 2021-03-10T17:16:20.722841+0000 mon.c (mon.1) 2995 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T17:16:21.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:16:21 gibba015 bash[30343]: cluster 2021-03-10T17:16:20.046567+0000 mgr.gibba045.orlgmj (mgr.34412) 10934 : cluster [DBG] pgmap v6234: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:21.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:16:21 gibba015 bash[30343]: audit 2021-03-10T17:16:20.717143+0000 mon.c (mon.1) 2994 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:16:21.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:16:21 gibba015 bash[30343]: audit 2021-03-10T17:16:20.722841+0000 mon.c (mon.1) 2995 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T17:16:21.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:16:21 gibba045 bash[25517]: cluster 2021-03-10T17:16:20.046567+0000 mgr.gibba045.orlgmj (mgr.34412) 10934 : cluster [DBG] pgmap v6234: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:21.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:16:21 gibba045 bash[25517]: audit 2021-03-10T17:16:20.717143+0000 mon.c (mon.1) 2994 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:16:21.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:16:21 gibba045 bash[25517]: audit 2021-03-10T17:16:20.722841+0000 mon.c (mon.1) 2995 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T17:16:22.248 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:16:22 gibba015 bash[29377]: cephadm 2021-03-10T17:16:20.724600+0000 mgr.gibba045.orlgmj (mgr.34412) 10935 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:16:22.248 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:16:22 gibba015 bash[30343]: cephadm 2021-03-10T17:16:20.724600+0000 mgr.gibba045.orlgmj (mgr.34412) 10935 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:16:22.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:16:22 gibba045 bash[25517]: cephadm 2021-03-10T17:16:20.724600+0000 mgr.gibba045.orlgmj (mgr.34412) 10935 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:16:23.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:16:23 gibba015 bash[29377]: cluster 2021-03-10T17:16:22.048255+0000 mgr.gibba045.orlgmj (mgr.34412) 10936 : cluster [DBG] pgmap v6235: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:23.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:16:23 gibba015 bash[30343]: cluster 2021-03-10T17:16:22.048255+0000 mgr.gibba045.orlgmj (mgr.34412) 10936 : cluster [DBG] pgmap v6235: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:23.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:16:23 gibba045 bash[25517]: cluster 2021-03-10T17:16:22.048255+0000 mgr.gibba045.orlgmj (mgr.34412) 10936 : cluster [DBG] pgmap v6235: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:25.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:16:25 gibba015 bash[29377]: cluster 2021-03-10T17:16:24.049690+0000 mgr.gibba045.orlgmj (mgr.34412) 10937 : cluster [DBG] pgmap v6236: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:25.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:16:25 gibba015 bash[30343]: cluster 2021-03-10T17:16:24.049690+0000 mgr.gibba045.orlgmj (mgr.34412) 10937 : cluster [DBG] pgmap v6236: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:25.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:16:25 gibba045 bash[25517]: cluster 2021-03-10T17:16:24.049690+0000 mgr.gibba045.orlgmj (mgr.34412) 10937 : cluster [DBG] pgmap v6236: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:26.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:16:26 gibba015 bash[29377]: audit 2021-03-10T17:16:25.700145+0000 mon.c (mon.1) 2996 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:16:26.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:16:26 gibba015 bash[29377]: audit 2021-03-10T17:16:25.876255+0000 mon.a (mon.0) 2320 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:16:26.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:16:26 gibba015 bash[29377]: audit 2021-03-10T17:16:26.083444+0000 mon.a (mon.0) 2321 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:16:26.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:16:26 gibba015 bash[29377]: audit 2021-03-10T17:16:26.092196+0000 mon.c (mon.1) 2997 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:16:26.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:16:26 gibba015 bash[29377]: audit 2021-03-10T17:16:26.093803+0000 mon.c (mon.1) 2998 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:16:26.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:16:26 gibba015 bash[29377]: audit 2021-03-10T17:16:26.095241+0000 mon.c (mon.1) 2999 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:16:26.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:16:26 gibba015 bash[29377]: audit 2021-03-10T17:16:26.096322+0000 mon.c (mon.1) 3000 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:16:26.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:16:26 gibba015 bash[29377]: audit 2021-03-10T17:16:26.099145+0000 mon.c (mon.1) 3001 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:16:26.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:16:26 gibba015 bash[29377]: audit 2021-03-10T17:16:26.100650+0000 mon.c (mon.1) 3002 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:16:26.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:16:26 gibba015 bash[30343]: audit 2021-03-10T17:16:25.700145+0000 mon.c (mon.1) 2996 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:16:26.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:16:26 gibba015 bash[30343]: audit 2021-03-10T17:16:25.876255+0000 mon.a (mon.0) 2320 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:16:26.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:16:26 gibba015 bash[30343]: audit 2021-03-10T17:16:26.083444+0000 mon.a (mon.0) 2321 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:16:26.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:16:26 gibba015 bash[30343]: audit 2021-03-10T17:16:26.092196+0000 mon.c (mon.1) 2997 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:16:26.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:16:26 gibba015 bash[30343]: audit 2021-03-10T17:16:26.093803+0000 mon.c (mon.1) 2998 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:16:26.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:16:26 gibba015 bash[30343]: audit 2021-03-10T17:16:26.095241+0000 mon.c (mon.1) 2999 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:16:26.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:16:26 gibba015 bash[30343]: audit 2021-03-10T17:16:26.096322+0000 mon.c (mon.1) 3000 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:16:26.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:16:26 gibba015 bash[30343]: audit 2021-03-10T17:16:26.099145+0000 mon.c (mon.1) 3001 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:16:26.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:16:26 gibba015 bash[30343]: audit 2021-03-10T17:16:26.100650+0000 mon.c (mon.1) 3002 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:16:26.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:16:26 gibba045 bash[25517]: audit 2021-03-10T17:16:25.700145+0000 mon.c (mon.1) 2996 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:16:26.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:16:26 gibba045 bash[25517]: audit 2021-03-10T17:16:25.876255+0000 mon.a (mon.0) 2320 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:16:26.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:16:26 gibba045 bash[25517]: audit 2021-03-10T17:16:26.083444+0000 mon.a (mon.0) 2321 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:16:26.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:16:26 gibba045 bash[25517]: audit 2021-03-10T17:16:26.092196+0000 mon.c (mon.1) 2997 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:16:26.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:16:26 gibba045 bash[25517]: audit 2021-03-10T17:16:26.093803+0000 mon.c (mon.1) 2998 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:16:26.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:16:26 gibba045 bash[25517]: audit 2021-03-10T17:16:26.095241+0000 mon.c (mon.1) 2999 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:16:26.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:16:26 gibba045 bash[25517]: audit 2021-03-10T17:16:26.096322+0000 mon.c (mon.1) 3000 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:16:26.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:16:26 gibba045 bash[25517]: audit 2021-03-10T17:16:26.099145+0000 mon.c (mon.1) 3001 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:16:26.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:16:26 gibba045 bash[25517]: audit 2021-03-10T17:16:26.100650+0000 mon.c (mon.1) 3002 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:16:27.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:16:27 gibba015 bash[29377]: cephadm 2021-03-10T17:16:25.880327+0000 mgr.gibba045.orlgmj (mgr.34412) 10938 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:16:27.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:16:27 gibba015 bash[29377]: cluster 2021-03-10T17:16:26.051354+0000 mgr.gibba045.orlgmj (mgr.34412) 10939 : cluster [DBG] pgmap v6237: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:27.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:16:27 gibba015 bash[29377]: cephadm 2021-03-10T17:16:26.093573+0000 mgr.gibba045.orlgmj (mgr.34412) 10940 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:16:27.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:16:27 gibba015 bash[29377]: cephadm 2021-03-10T17:16:26.095188+0000 mgr.gibba045.orlgmj (mgr.34412) 10941 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:16:27.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:16:27 gibba015 bash[29377]: cephadm 2021-03-10T17:16:26.096678+0000 mgr.gibba045.orlgmj (mgr.34412) 10942 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:16:27.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:16:27 gibba015 bash[29377]: cephadm 2021-03-10T17:16:26.096754+0000 mgr.gibba045.orlgmj (mgr.34412) 10943 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:16:27.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:16:27 gibba015 bash[29377]: cephadm 2021-03-10T17:16:26.098133+0000 mgr.gibba045.orlgmj (mgr.34412) 10944 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:16:27.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:16:27 gibba015 bash[29377]: cephadm 2021-03-10T17:16:26.098174+0000 mgr.gibba045.orlgmj (mgr.34412) 10945 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:16:27.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:16:27 gibba015 bash[29377]: cephadm 2021-03-10T17:16:26.099104+0000 mgr.gibba045.orlgmj (mgr.34412) 10946 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:16:27.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:16:27 gibba015 bash[29377]: cephadm 2021-03-10T17:16:26.100679+0000 mgr.gibba045.orlgmj (mgr.34412) 10947 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:16:27.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:16:27 gibba015 bash[29377]: cephadm 2021-03-10T17:16:26.100717+0000 mgr.gibba045.orlgmj (mgr.34412) 10948 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:16:27.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:16:27 gibba015 bash[29377]: cephadm 2021-03-10T17:16:26.102124+0000 mgr.gibba045.orlgmj (mgr.34412) 10949 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:16:27.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:16:27 gibba015 bash[29377]: cephadm 2021-03-10T17:16:26.102478+0000 mgr.gibba045.orlgmj (mgr.34412) 10950 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:16:27.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:16:27 gibba015 bash[29377]: cephadm 2021-03-10T17:16:26.103394+0000 mgr.gibba045.orlgmj (mgr.34412) 10951 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:16:27.479 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:16:27 gibba015 bash[29377]: cephadm 2021-03-10T17:16:26.103437+0000 mgr.gibba045.orlgmj (mgr.34412) 10952 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:16:27.479 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:16:27 gibba015 bash[29377]: cephadm 2021-03-10T17:16:26.103557+0000 mgr.gibba045.orlgmj (mgr.34412) 10953 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:16:27.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:16:27 gibba015 bash[30343]: cephadm 2021-03-10T17:16:25.880327+0000 mgr.gibba045.orlgmj (mgr.34412) 10938 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:16:27.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:16:27 gibba015 bash[30343]: cluster 2021-03-10T17:16:26.051354+0000 mgr.gibba045.orlgmj (mgr.34412) 10939 : cluster [DBG] pgmap v6237: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:27.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:16:27 gibba015 bash[30343]: cephadm 2021-03-10T17:16:26.093573+0000 mgr.gibba045.orlgmj (mgr.34412) 10940 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:16:27.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:16:27 gibba015 bash[30343]: cephadm 2021-03-10T17:16:26.095188+0000 mgr.gibba045.orlgmj (mgr.34412) 10941 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:16:27.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:16:27 gibba015 bash[30343]: cephadm 2021-03-10T17:16:26.096678+0000 mgr.gibba045.orlgmj (mgr.34412) 10942 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:16:27.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:16:27 gibba015 bash[30343]: cephadm 2021-03-10T17:16:26.096754+0000 mgr.gibba045.orlgmj (mgr.34412) 10943 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:16:27.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:16:27 gibba015 bash[30343]: cephadm 2021-03-10T17:16:26.098133+0000 mgr.gibba045.orlgmj (mgr.34412) 10944 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:16:27.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:16:27 gibba015 bash[30343]: cephadm 2021-03-10T17:16:26.098174+0000 mgr.gibba045.orlgmj (mgr.34412) 10945 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:16:27.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:16:27 gibba015 bash[30343]: cephadm 2021-03-10T17:16:26.099104+0000 mgr.gibba045.orlgmj (mgr.34412) 10946 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:16:27.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:16:27 gibba015 bash[30343]: cephadm 2021-03-10T17:16:26.100679+0000 mgr.gibba045.orlgmj (mgr.34412) 10947 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:16:27.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:16:27 gibba015 bash[30343]: cephadm 2021-03-10T17:16:26.100717+0000 mgr.gibba045.orlgmj (mgr.34412) 10948 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:16:27.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:16:27 gibba015 bash[30343]: cephadm 2021-03-10T17:16:26.102124+0000 mgr.gibba045.orlgmj (mgr.34412) 10949 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:16:27.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:16:27 gibba015 bash[30343]: cephadm 2021-03-10T17:16:26.102478+0000 mgr.gibba045.orlgmj (mgr.34412) 10950 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:16:27.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:16:27 gibba015 bash[30343]: cephadm 2021-03-10T17:16:26.103394+0000 mgr.gibba045.orlgmj (mgr.34412) 10951 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:16:27.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:16:27 gibba015 bash[30343]: cephadm 2021-03-10T17:16:26.103437+0000 mgr.gibba045.orlgmj (mgr.34412) 10952 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:16:27.485 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:16:27 gibba015 bash[30343]: cephadm 2021-03-10T17:16:26.103557+0000 mgr.gibba045.orlgmj (mgr.34412) 10953 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:16:27.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:16:27 gibba045 bash[25517]: cephadm 2021-03-10T17:16:25.880327+0000 mgr.gibba045.orlgmj (mgr.34412) 10938 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:16:27.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:16:27 gibba045 bash[25517]: cluster 2021-03-10T17:16:26.051354+0000 mgr.gibba045.orlgmj (mgr.34412) 10939 : cluster [DBG] pgmap v6237: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:27.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:16:27 gibba045 bash[25517]: cephadm 2021-03-10T17:16:26.093573+0000 mgr.gibba045.orlgmj (mgr.34412) 10940 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:16:27.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:16:27 gibba045 bash[25517]: cephadm 2021-03-10T17:16:26.095188+0000 mgr.gibba045.orlgmj (mgr.34412) 10941 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:16:27.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:16:27 gibba045 bash[25517]: cephadm 2021-03-10T17:16:26.096678+0000 mgr.gibba045.orlgmj (mgr.34412) 10942 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:16:27.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:16:27 gibba045 bash[25517]: cephadm 2021-03-10T17:16:26.096754+0000 mgr.gibba045.orlgmj (mgr.34412) 10943 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:16:27.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:16:27 gibba045 bash[25517]: cephadm 2021-03-10T17:16:26.098133+0000 mgr.gibba045.orlgmj (mgr.34412) 10944 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:16:27.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:16:27 gibba045 bash[25517]: cephadm 2021-03-10T17:16:26.098174+0000 mgr.gibba045.orlgmj (mgr.34412) 10945 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:16:27.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:16:27 gibba045 bash[25517]: cephadm 2021-03-10T17:16:26.099104+0000 mgr.gibba045.orlgmj (mgr.34412) 10946 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:16:27.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:16:27 gibba045 bash[25517]: cephadm 2021-03-10T17:16:26.100679+0000 mgr.gibba045.orlgmj (mgr.34412) 10947 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:16:27.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:16:27 gibba045 bash[25517]: cephadm 2021-03-10T17:16:26.100717+0000 mgr.gibba045.orlgmj (mgr.34412) 10948 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:16:27.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:16:27 gibba045 bash[25517]: cephadm 2021-03-10T17:16:26.102124+0000 mgr.gibba045.orlgmj (mgr.34412) 10949 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:16:27.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:16:27 gibba045 bash[25517]: cephadm 2021-03-10T17:16:26.102478+0000 mgr.gibba045.orlgmj (mgr.34412) 10950 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:16:27.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:16:27 gibba045 bash[25517]: cephadm 2021-03-10T17:16:26.103394+0000 mgr.gibba045.orlgmj (mgr.34412) 10951 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:16:27.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:16:27 gibba045 bash[25517]: cephadm 2021-03-10T17:16:26.103437+0000 mgr.gibba045.orlgmj (mgr.34412) 10952 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:16:27.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:16:27 gibba045 bash[25517]: cephadm 2021-03-10T17:16:26.103557+0000 mgr.gibba045.orlgmj (mgr.34412) 10953 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:16:28.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:16:28 gibba015 bash[29377]: cluster 2021-03-10T17:16:28.052759+0000 mgr.gibba045.orlgmj (mgr.34412) 10954 : cluster [DBG] pgmap v6238: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:28.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:16:28 gibba015 bash[30343]: cluster 2021-03-10T17:16:28.052759+0000 mgr.gibba045.orlgmj (mgr.34412) 10954 : cluster [DBG] pgmap v6238: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:29.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:16:28 gibba045 bash[25517]: cluster 2021-03-10T17:16:28.052759+0000 mgr.gibba045.orlgmj (mgr.34412) 10954 : cluster [DBG] pgmap v6238: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:31.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:16:31 gibba015 bash[29377]: cluster 2021-03-10T17:16:30.053436+0000 mgr.gibba045.orlgmj (mgr.34412) 10955 : cluster [DBG] pgmap v6239: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:31.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:16:31 gibba015 bash[30343]: cluster 2021-03-10T17:16:30.053436+0000 mgr.gibba045.orlgmj (mgr.34412) 10955 : cluster [DBG] pgmap v6239: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:31.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:16:31 gibba045 bash[25517]: cluster 2021-03-10T17:16:30.053436+0000 mgr.gibba045.orlgmj (mgr.34412) 10955 : cluster [DBG] pgmap v6239: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:32.675 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:16:32.903 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:16:32.904 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 9m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:16:32.904 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 8m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:16:32.904 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:16:32.904 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:16:32.904 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:16:32.905 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:16:32.905 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:16:32.905 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:16:32.905 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 9m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:16:32.906 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 8m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:16:32.906 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:16:32.906 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:16:32.906 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:16:32.906 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:16:32.907 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:16:32.907 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:16:32.907 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:16:32.907 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:16:32.908 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 8m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:16:32.908 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 8m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:16:33.154 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:16:33.154 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:16:33.154 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:16:33.155 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:16:33.155 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:16:33.155 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:16:33.155 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:16:33.155 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:16:33.156 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:16:33.156 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:16:33.156 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:16:33.156 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:16:33.157 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:16:33.157 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:16:33.157 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:16:33.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:16:33 gibba015 bash[29377]: cluster 2021-03-10T17:16:32.055152+0000 mgr.gibba045.orlgmj (mgr.34412) 10956 : cluster [DBG] pgmap v6240: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:33.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:16:33 gibba015 bash[30343]: cluster 2021-03-10T17:16:32.055152+0000 mgr.gibba045.orlgmj (mgr.34412) 10956 : cluster [DBG] pgmap v6240: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:33.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:16:33 gibba045 bash[25517]: cluster 2021-03-10T17:16:32.055152+0000 mgr.gibba045.orlgmj (mgr.34412) 10956 : cluster [DBG] pgmap v6240: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:34.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:16:34 gibba015 bash[29377]: audit 2021-03-10T17:16:32.666266+0000 mgr.gibba045.orlgmj (mgr.34412) 10957 : audit [DBG] from='client.61384 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:16:34.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:16:34 gibba015 bash[29377]: audit 2021-03-10T17:16:32.891201+0000 mgr.gibba045.orlgmj (mgr.34412) 10958 : audit [DBG] from='client.51402 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:16:34.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:16:34 gibba015 bash[29377]: audit 2021-03-10T17:16:33.152407+0000 mon.a (mon.0) 2322 : audit [DBG] from='client.? 172.21.2.115:0/630508715' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:16:34.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:16:34 gibba015 bash[30343]: audit 2021-03-10T17:16:32.666266+0000 mgr.gibba045.orlgmj (mgr.34412) 10957 : audit [DBG] from='client.61384 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:16:34.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:16:34 gibba015 bash[30343]: audit 2021-03-10T17:16:32.891201+0000 mgr.gibba045.orlgmj (mgr.34412) 10958 : audit [DBG] from='client.51402 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:16:34.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:16:34 gibba015 bash[30343]: audit 2021-03-10T17:16:33.152407+0000 mon.a (mon.0) 2322 : audit [DBG] from='client.? 172.21.2.115:0/630508715' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:16:34.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:16:34 gibba045 bash[25517]: audit 2021-03-10T17:16:32.666266+0000 mgr.gibba045.orlgmj (mgr.34412) 10957 : audit [DBG] from='client.61384 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:16:34.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:16:34 gibba045 bash[25517]: audit 2021-03-10T17:16:32.891201+0000 mgr.gibba045.orlgmj (mgr.34412) 10958 : audit [DBG] from='client.51402 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:16:34.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:16:34 gibba045 bash[25517]: audit 2021-03-10T17:16:33.152407+0000 mon.a (mon.0) 2322 : audit [DBG] from='client.? 172.21.2.115:0/630508715' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:16:35.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:16:35 gibba015 bash[29377]: cluster 2021-03-10T17:16:34.056415+0000 mgr.gibba045.orlgmj (mgr.34412) 10959 : cluster [DBG] pgmap v6241: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:35.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:16:35 gibba015 bash[30343]: cluster 2021-03-10T17:16:34.056415+0000 mgr.gibba045.orlgmj (mgr.34412) 10959 : cluster [DBG] pgmap v6241: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:35.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:16:35 gibba045 bash[25517]: cluster 2021-03-10T17:16:34.056415+0000 mgr.gibba045.orlgmj (mgr.34412) 10959 : cluster [DBG] pgmap v6241: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:37.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:16:37 gibba015 bash[29377]: cluster 2021-03-10T17:16:36.058212+0000 mgr.gibba045.orlgmj (mgr.34412) 10960 : cluster [DBG] pgmap v6242: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:37.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:16:37 gibba015 bash[30343]: cluster 2021-03-10T17:16:36.058212+0000 mgr.gibba045.orlgmj (mgr.34412) 10960 : cluster [DBG] pgmap v6242: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:37.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:16:37 gibba045 bash[25517]: cluster 2021-03-10T17:16:36.058212+0000 mgr.gibba045.orlgmj (mgr.34412) 10960 : cluster [DBG] pgmap v6242: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:38.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:16:38 gibba015 bash[29377]: cluster 2021-03-10T17:16:38.059577+0000 mgr.gibba045.orlgmj (mgr.34412) 10961 : cluster [DBG] pgmap v6243: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:38.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:16:38 gibba015 bash[30343]: cluster 2021-03-10T17:16:38.059577+0000 mgr.gibba045.orlgmj (mgr.34412) 10961 : cluster [DBG] pgmap v6243: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:39.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:16:38 gibba045 bash[25517]: cluster 2021-03-10T17:16:38.059577+0000 mgr.gibba045.orlgmj (mgr.34412) 10961 : cluster [DBG] pgmap v6243: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:41.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:16:41 gibba015 bash[29377]: cluster 2021-03-10T17:16:40.060638+0000 mgr.gibba045.orlgmj (mgr.34412) 10962 : cluster [DBG] pgmap v6244: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:41.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:16:41 gibba015 bash[30343]: cluster 2021-03-10T17:16:40.060638+0000 mgr.gibba045.orlgmj (mgr.34412) 10962 : cluster [DBG] pgmap v6244: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:41.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:16:41 gibba045 bash[25517]: cluster 2021-03-10T17:16:40.060638+0000 mgr.gibba045.orlgmj (mgr.34412) 10962 : cluster [DBG] pgmap v6244: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:42.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:16:42 gibba015 bash[29377]: cephadm 2021-03-10T17:16:41.119571+0000 mgr.gibba045.orlgmj (mgr.34412) 10963 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:16:42.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:16:42 gibba015 bash[30343]: cephadm 2021-03-10T17:16:41.119571+0000 mgr.gibba045.orlgmj (mgr.34412) 10963 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:16:42.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:16:42 gibba045 bash[25517]: cephadm 2021-03-10T17:16:41.119571+0000 mgr.gibba045.orlgmj (mgr.34412) 10963 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:16:43.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:16:43 gibba015 bash[29377]: cluster 2021-03-10T17:16:42.062071+0000 mgr.gibba045.orlgmj (mgr.34412) 10964 : cluster [DBG] pgmap v6245: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:43.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:16:43 gibba015 bash[30343]: cluster 2021-03-10T17:16:42.062071+0000 mgr.gibba045.orlgmj (mgr.34412) 10964 : cluster [DBG] pgmap v6245: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:43.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:16:43 gibba045 bash[25517]: cluster 2021-03-10T17:16:42.062071+0000 mgr.gibba045.orlgmj (mgr.34412) 10964 : cluster [DBG] pgmap v6245: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:45.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:16:45 gibba015 bash[29377]: cluster 2021-03-10T17:16:44.063413+0000 mgr.gibba045.orlgmj (mgr.34412) 10965 : cluster [DBG] pgmap v6246: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:45.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:16:45 gibba015 bash[30343]: cluster 2021-03-10T17:16:44.063413+0000 mgr.gibba045.orlgmj (mgr.34412) 10965 : cluster [DBG] pgmap v6246: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:45.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:16:45 gibba045 bash[25517]: cluster 2021-03-10T17:16:44.063413+0000 mgr.gibba045.orlgmj (mgr.34412) 10965 : cluster [DBG] pgmap v6246: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:47.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:16:47 gibba015 bash[29377]: cluster 2021-03-10T17:16:46.065207+0000 mgr.gibba045.orlgmj (mgr.34412) 10966 : cluster [DBG] pgmap v6247: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:47.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:16:47 gibba015 bash[30343]: cluster 2021-03-10T17:16:46.065207+0000 mgr.gibba045.orlgmj (mgr.34412) 10966 : cluster [DBG] pgmap v6247: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:47.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:16:47 gibba045 bash[25517]: cluster 2021-03-10T17:16:46.065207+0000 mgr.gibba045.orlgmj (mgr.34412) 10966 : cluster [DBG] pgmap v6247: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:48.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:16:48 gibba015 bash[29377]: cluster 2021-03-10T17:16:48.066631+0000 mgr.gibba045.orlgmj (mgr.34412) 10967 : cluster [DBG] pgmap v6248: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:48.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:16:48 gibba015 bash[30343]: cluster 2021-03-10T17:16:48.066631+0000 mgr.gibba045.orlgmj (mgr.34412) 10967 : cluster [DBG] pgmap v6248: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:49.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:16:48 gibba045 bash[25517]: cluster 2021-03-10T17:16:48.066631+0000 mgr.gibba045.orlgmj (mgr.34412) 10967 : cluster [DBG] pgmap v6248: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:51.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:16:51 gibba015 bash[29377]: cluster 2021-03-10T17:16:50.067484+0000 mgr.gibba045.orlgmj (mgr.34412) 10968 : cluster [DBG] pgmap v6249: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:51.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:16:51 gibba015 bash[30343]: cluster 2021-03-10T17:16:50.067484+0000 mgr.gibba045.orlgmj (mgr.34412) 10968 : cluster [DBG] pgmap v6249: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:51.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:16:51 gibba045 bash[25517]: cluster 2021-03-10T17:16:50.067484+0000 mgr.gibba045.orlgmj (mgr.34412) 10968 : cluster [DBG] pgmap v6249: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:53.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:16:53 gibba015 bash[29377]: cluster 2021-03-10T17:16:52.069209+0000 mgr.gibba045.orlgmj (mgr.34412) 10969 : cluster [DBG] pgmap v6250: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:53.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:16:53 gibba015 bash[30343]: cluster 2021-03-10T17:16:52.069209+0000 mgr.gibba045.orlgmj (mgr.34412) 10969 : cluster [DBG] pgmap v6250: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:53.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:16:53 gibba045 bash[25517]: cluster 2021-03-10T17:16:52.069209+0000 mgr.gibba045.orlgmj (mgr.34412) 10969 : cluster [DBG] pgmap v6250: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:16:54 gibba015 bash[29377]: audit 2021-03-10T17:16:53.964569+0000 mon.c (mon.1) 3003 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:16:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:16:54 gibba015 bash[29377]: audit 2021-03-10T17:16:53.965338+0000 mon.c (mon.1) 3004 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:16:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:16:54 gibba015 bash[29377]: audit 2021-03-10T17:16:53.965766+0000 mon.a (mon.0) 2323 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:16:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:16:54 gibba015 bash[29377]: audit 2021-03-10T17:16:53.967193+0000 mon.a (mon.0) 2324 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:16:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:16:54 gibba015 bash[29377]: audit 2021-03-10T17:16:54.052342+0000 mon.c (mon.1) 3005 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T17:16:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:16:54 gibba015 bash[29377]: audit 2021-03-10T17:16:54.053171+0000 mon.c (mon.1) 3006 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:16:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:16:54 gibba015 bash[29377]: audit 2021-03-10T17:16:54.053638+0000 mon.a (mon.0) 2325 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T17:16:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:16:54 gibba015 bash[29377]: audit 2021-03-10T17:16:54.053851+0000 mon.c (mon.1) 3007 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T17:16:54.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:16:54 gibba015 bash[29377]: audit 2021-03-10T17:16:54.054529+0000 mon.c (mon.1) 3008 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T17:16:54.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:16:54 gibba015 bash[29377]: audit 2021-03-10T17:16:54.055704+0000 mon.a (mon.0) 2326 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:16:54.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:16:54 gibba015 bash[29377]: audit 2021-03-10T17:16:54.056922+0000 mon.a (mon.0) 2327 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T17:16:54.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:16:54 gibba015 bash[29377]: audit 2021-03-10T17:16:54.057988+0000 mon.a (mon.0) 2328 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T17:16:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:16:54 gibba015 bash[30343]: audit 2021-03-10T17:16:53.964569+0000 mon.c (mon.1) 3003 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:16:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:16:54 gibba015 bash[30343]: audit 2021-03-10T17:16:53.965338+0000 mon.c (mon.1) 3004 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:16:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:16:54 gibba015 bash[30343]: audit 2021-03-10T17:16:53.965766+0000 mon.a (mon.0) 2323 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:16:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:16:54 gibba015 bash[30343]: audit 2021-03-10T17:16:53.967193+0000 mon.a (mon.0) 2324 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:16:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:16:54 gibba015 bash[30343]: audit 2021-03-10T17:16:54.052342+0000 mon.c (mon.1) 3005 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T17:16:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:16:54 gibba015 bash[30343]: audit 2021-03-10T17:16:54.053171+0000 mon.c (mon.1) 3006 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:16:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:16:54 gibba015 bash[30343]: audit 2021-03-10T17:16:54.053638+0000 mon.a (mon.0) 2325 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T17:16:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:16:54 gibba015 bash[30343]: audit 2021-03-10T17:16:54.053851+0000 mon.c (mon.1) 3007 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T17:16:54.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:16:54 gibba015 bash[30343]: audit 2021-03-10T17:16:54.054529+0000 mon.c (mon.1) 3008 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T17:16:54.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:16:54 gibba015 bash[30343]: audit 2021-03-10T17:16:54.055704+0000 mon.a (mon.0) 2326 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:16:54.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:16:54 gibba015 bash[30343]: audit 2021-03-10T17:16:54.056922+0000 mon.a (mon.0) 2327 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T17:16:54.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:16:54 gibba015 bash[30343]: audit 2021-03-10T17:16:54.057988+0000 mon.a (mon.0) 2328 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T17:16:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:16:54 gibba045 bash[25517]: audit 2021-03-10T17:16:53.964569+0000 mon.c (mon.1) 3003 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:16:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:16:54 gibba045 bash[25517]: audit 2021-03-10T17:16:53.965338+0000 mon.c (mon.1) 3004 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:16:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:16:54 gibba045 bash[25517]: audit 2021-03-10T17:16:53.965766+0000 mon.a (mon.0) 2323 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:16:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:16:54 gibba045 bash[25517]: audit 2021-03-10T17:16:53.967193+0000 mon.a (mon.0) 2324 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:16:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:16:54 gibba045 bash[25517]: audit 2021-03-10T17:16:54.052342+0000 mon.c (mon.1) 3005 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T17:16:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:16:54 gibba045 bash[25517]: audit 2021-03-10T17:16:54.053171+0000 mon.c (mon.1) 3006 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:16:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:16:54 gibba045 bash[25517]: audit 2021-03-10T17:16:54.053638+0000 mon.a (mon.0) 2325 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T17:16:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:16:54 gibba045 bash[25517]: audit 2021-03-10T17:16:54.053851+0000 mon.c (mon.1) 3007 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T17:16:54.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:16:54 gibba045 bash[25517]: audit 2021-03-10T17:16:54.054529+0000 mon.c (mon.1) 3008 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T17:16:54.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:16:54 gibba045 bash[25517]: audit 2021-03-10T17:16:54.055704+0000 mon.a (mon.0) 2326 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:16:54.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:16:54 gibba045 bash[25517]: audit 2021-03-10T17:16:54.056922+0000 mon.a (mon.0) 2327 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T17:16:54.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:16:54 gibba045 bash[25517]: audit 2021-03-10T17:16:54.057988+0000 mon.a (mon.0) 2328 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T17:16:55.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:16:55 gibba015 bash[29377]: cluster 2021-03-10T17:16:54.069687+0000 mgr.gibba045.orlgmj (mgr.34412) 10970 : cluster [DBG] pgmap v6251: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:55.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:16:55 gibba015 bash[30343]: cluster 2021-03-10T17:16:54.069687+0000 mgr.gibba045.orlgmj (mgr.34412) 10970 : cluster [DBG] pgmap v6251: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:55.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:16:55 gibba045 bash[25517]: cluster 2021-03-10T17:16:54.069687+0000 mgr.gibba045.orlgmj (mgr.34412) 10970 : cluster [DBG] pgmap v6251: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:57.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:16:57 gibba015 bash[29377]: cluster 2021-03-10T17:16:56.071285+0000 mgr.gibba045.orlgmj (mgr.34412) 10971 : cluster [DBG] pgmap v6252: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:57.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:16:57 gibba015 bash[29377]: cephadm 2021-03-10T17:16:56.130718+0000 mgr.gibba045.orlgmj (mgr.34412) 10972 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:16:57.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:16:57 gibba015 bash[30343]: cluster 2021-03-10T17:16:56.071285+0000 mgr.gibba045.orlgmj (mgr.34412) 10971 : cluster [DBG] pgmap v6252: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:57.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:16:57 gibba015 bash[30343]: cephadm 2021-03-10T17:16:56.130718+0000 mgr.gibba045.orlgmj (mgr.34412) 10972 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:16:57.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:16:57 gibba045 bash[25517]: cluster 2021-03-10T17:16:56.071285+0000 mgr.gibba045.orlgmj (mgr.34412) 10971 : cluster [DBG] pgmap v6252: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:57.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:16:57 gibba045 bash[25517]: cephadm 2021-03-10T17:16:56.130718+0000 mgr.gibba045.orlgmj (mgr.34412) 10972 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:16:58.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:16:58 gibba015 bash[29377]: cluster 2021-03-10T17:16:58.072723+0000 mgr.gibba045.orlgmj (mgr.34412) 10973 : cluster [DBG] pgmap v6253: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:58.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:16:58 gibba015 bash[30343]: cluster 2021-03-10T17:16:58.072723+0000 mgr.gibba045.orlgmj (mgr.34412) 10973 : cluster [DBG] pgmap v6253: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:59.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:16:58 gibba045 bash[25517]: cluster 2021-03-10T17:16:58.072723+0000 mgr.gibba045.orlgmj (mgr.34412) 10973 : cluster [DBG] pgmap v6253: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:01.399 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:17:01 gibba015 bash[29377]: cluster 2021-03-10T17:17:00.073694+0000 mgr.gibba045.orlgmj (mgr.34412) 10974 : cluster [DBG] pgmap v6254: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:01.399 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:17:01 gibba015 bash[30343]: cluster 2021-03-10T17:17:00.073694+0000 mgr.gibba045.orlgmj (mgr.34412) 10974 : cluster [DBG] pgmap v6254: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:01.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:17:01 gibba045 bash[25517]: cluster 2021-03-10T17:17:00.073694+0000 mgr.gibba045.orlgmj (mgr.34412) 10974 : cluster [DBG] pgmap v6254: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:03.393 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:17:03.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:17:03 gibba015 bash[29377]: cluster 2021-03-10T17:17:02.075268+0000 mgr.gibba045.orlgmj (mgr.34412) 10975 : cluster [DBG] pgmap v6255: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:03.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:17:03 gibba015 bash[30343]: cluster 2021-03-10T17:17:02.075268+0000 mgr.gibba045.orlgmj (mgr.34412) 10975 : cluster [DBG] pgmap v6255: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:03.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:17:03 gibba045 bash[25517]: cluster 2021-03-10T17:17:02.075268+0000 mgr.gibba045.orlgmj (mgr.34412) 10975 : cluster [DBG] pgmap v6255: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:03.653 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:17:03.653 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 9m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:17:03.653 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 8m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:17:03.654 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:17:03.654 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:17:03.654 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:17:03.654 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:17:03.654 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:17:03.655 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:17:03.655 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 9m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:17:03.655 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 8m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:17:03.655 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:17:03.656 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:17:03.656 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:17:03.656 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:17:03.656 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:17:03.657 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:17:03.657 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:17:03.658 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:17:03.658 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 8m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:17:03.658 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 8m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:17:03.928 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:17:03.929 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:17:03.929 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:17:03.929 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:17:03.930 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:17:03.930 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:17:03.930 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:17:03.930 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:17:03.931 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:17:03.931 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:17:03.931 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:17:03.931 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:17:03.931 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:17:03.932 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:17:03.932 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:17:04.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:17:04 gibba015 bash[29377]: audit 2021-03-10T17:17:03.384538+0000 mgr.gibba045.orlgmj (mgr.34412) 10976 : audit [DBG] from='client.51414 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:17:04.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:17:04 gibba015 bash[29377]: audit 2021-03-10T17:17:03.927459+0000 mon.c (mon.1) 3009 : audit [DBG] from='client.? 172.21.2.115:0/3872488681' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:17:04.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:17:04 gibba015 bash[30343]: audit 2021-03-10T17:17:03.384538+0000 mgr.gibba045.orlgmj (mgr.34412) 10976 : audit [DBG] from='client.51414 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:17:04.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:17:04 gibba015 bash[30343]: audit 2021-03-10T17:17:03.927459+0000 mon.c (mon.1) 3009 : audit [DBG] from='client.? 172.21.2.115:0/3872488681' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:17:04.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:17:04 gibba045 bash[25517]: audit 2021-03-10T17:17:03.384538+0000 mgr.gibba045.orlgmj (mgr.34412) 10976 : audit [DBG] from='client.51414 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:17:04.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:17:04 gibba045 bash[25517]: audit 2021-03-10T17:17:03.927459+0000 mon.c (mon.1) 3009 : audit [DBG] from='client.? 172.21.2.115:0/3872488681' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:17:05.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:17:05 gibba015 bash[29377]: audit 2021-03-10T17:17:03.612005+0000 mgr.gibba045.orlgmj (mgr.34412) 10977 : audit [DBG] from='client.61408 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:17:05.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:17:05 gibba015 bash[29377]: cluster 2021-03-10T17:17:04.076477+0000 mgr.gibba045.orlgmj (mgr.34412) 10978 : cluster [DBG] pgmap v6256: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:05.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:17:05 gibba015 bash[30343]: audit 2021-03-10T17:17:03.612005+0000 mgr.gibba045.orlgmj (mgr.34412) 10977 : audit [DBG] from='client.61408 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:17:05.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:17:05 gibba015 bash[30343]: cluster 2021-03-10T17:17:04.076477+0000 mgr.gibba045.orlgmj (mgr.34412) 10978 : cluster [DBG] pgmap v6256: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:05.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:17:05 gibba045 bash[25517]: audit 2021-03-10T17:17:03.612005+0000 mgr.gibba045.orlgmj (mgr.34412) 10977 : audit [DBG] from='client.61408 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:17:05.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:17:05 gibba045 bash[25517]: cluster 2021-03-10T17:17:04.076477+0000 mgr.gibba045.orlgmj (mgr.34412) 10978 : cluster [DBG] pgmap v6256: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:07.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:17:07 gibba015 bash[29377]: cluster 2021-03-10T17:17:06.078270+0000 mgr.gibba045.orlgmj (mgr.34412) 10979 : cluster [DBG] pgmap v6257: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:07.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:17:07 gibba015 bash[30343]: cluster 2021-03-10T17:17:06.078270+0000 mgr.gibba045.orlgmj (mgr.34412) 10979 : cluster [DBG] pgmap v6257: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:07.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:17:07 gibba045 bash[25517]: cluster 2021-03-10T17:17:06.078270+0000 mgr.gibba045.orlgmj (mgr.34412) 10979 : cluster [DBG] pgmap v6257: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:08.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:17:08 gibba015 bash[29377]: cluster 2021-03-10T17:17:08.079672+0000 mgr.gibba045.orlgmj (mgr.34412) 10980 : cluster [DBG] pgmap v6258: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:08.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:17:08 gibba015 bash[30343]: cluster 2021-03-10T17:17:08.079672+0000 mgr.gibba045.orlgmj (mgr.34412) 10980 : cluster [DBG] pgmap v6258: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:09.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:17:08 gibba045 bash[25517]: cluster 2021-03-10T17:17:08.079672+0000 mgr.gibba045.orlgmj (mgr.34412) 10980 : cluster [DBG] pgmap v6258: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:11.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:17:11 gibba015 bash[29377]: cluster 2021-03-10T17:17:10.081431+0000 mgr.gibba045.orlgmj (mgr.34412) 10981 : cluster [DBG] pgmap v6259: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:11.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:17:11 gibba015 bash[30343]: cluster 2021-03-10T17:17:10.081431+0000 mgr.gibba045.orlgmj (mgr.34412) 10981 : cluster [DBG] pgmap v6259: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:11.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:17:11 gibba045 bash[25517]: cluster 2021-03-10T17:17:10.081431+0000 mgr.gibba045.orlgmj (mgr.34412) 10981 : cluster [DBG] pgmap v6259: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:12.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:17:12 gibba015 bash[29377]: cephadm 2021-03-10T17:17:11.145896+0000 mgr.gibba045.orlgmj (mgr.34412) 10982 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:17:12.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:17:12 gibba015 bash[30343]: cephadm 2021-03-10T17:17:11.145896+0000 mgr.gibba045.orlgmj (mgr.34412) 10982 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:17:12.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:17:12 gibba045 bash[25517]: cephadm 2021-03-10T17:17:11.145896+0000 mgr.gibba045.orlgmj (mgr.34412) 10982 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:17:13.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:17:13 gibba015 bash[29377]: cluster 2021-03-10T17:17:12.083206+0000 mgr.gibba045.orlgmj (mgr.34412) 10983 : cluster [DBG] pgmap v6260: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:13.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:17:13 gibba015 bash[30343]: cluster 2021-03-10T17:17:12.083206+0000 mgr.gibba045.orlgmj (mgr.34412) 10983 : cluster [DBG] pgmap v6260: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:13.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:17:13 gibba045 bash[25517]: cluster 2021-03-10T17:17:12.083206+0000 mgr.gibba045.orlgmj (mgr.34412) 10983 : cluster [DBG] pgmap v6260: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:15.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:17:15 gibba015 bash[29377]: cluster 2021-03-10T17:17:14.084477+0000 mgr.gibba045.orlgmj (mgr.34412) 10984 : cluster [DBG] pgmap v6261: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:15.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:17:15 gibba015 bash[30343]: cluster 2021-03-10T17:17:14.084477+0000 mgr.gibba045.orlgmj (mgr.34412) 10984 : cluster [DBG] pgmap v6261: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:15.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:17:15 gibba045 bash[25517]: cluster 2021-03-10T17:17:14.084477+0000 mgr.gibba045.orlgmj (mgr.34412) 10984 : cluster [DBG] pgmap v6261: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:17.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:17:17 gibba015 bash[29377]: cluster 2021-03-10T17:17:16.086287+0000 mgr.gibba045.orlgmj (mgr.34412) 10985 : cluster [DBG] pgmap v6262: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:17.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:17:17 gibba015 bash[30343]: cluster 2021-03-10T17:17:16.086287+0000 mgr.gibba045.orlgmj (mgr.34412) 10985 : cluster [DBG] pgmap v6262: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:17.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:17:17 gibba045 bash[25517]: cluster 2021-03-10T17:17:16.086287+0000 mgr.gibba045.orlgmj (mgr.34412) 10985 : cluster [DBG] pgmap v6262: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:18.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:17:18 gibba015 bash[29377]: cluster 2021-03-10T17:17:18.087690+0000 mgr.gibba045.orlgmj (mgr.34412) 10986 : cluster [DBG] pgmap v6263: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:18.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:17:18 gibba015 bash[30343]: cluster 2021-03-10T17:17:18.087690+0000 mgr.gibba045.orlgmj (mgr.34412) 10986 : cluster [DBG] pgmap v6263: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:19.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:17:18 gibba045 bash[25517]: cluster 2021-03-10T17:17:18.087690+0000 mgr.gibba045.orlgmj (mgr.34412) 10986 : cluster [DBG] pgmap v6263: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:21.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:17:21 gibba015 bash[29377]: cluster 2021-03-10T17:17:20.089445+0000 mgr.gibba045.orlgmj (mgr.34412) 10987 : cluster [DBG] pgmap v6264: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:21.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:17:21 gibba015 bash[30343]: cluster 2021-03-10T17:17:20.089445+0000 mgr.gibba045.orlgmj (mgr.34412) 10987 : cluster [DBG] pgmap v6264: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:21.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:17:21 gibba045 bash[25517]: cluster 2021-03-10T17:17:20.089445+0000 mgr.gibba045.orlgmj (mgr.34412) 10987 : cluster [DBG] pgmap v6264: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:23.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:17:23 gibba015 bash[29377]: cluster 2021-03-10T17:17:22.091199+0000 mgr.gibba045.orlgmj (mgr.34412) 10988 : cluster [DBG] pgmap v6265: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:23.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:17:23 gibba015 bash[30343]: cluster 2021-03-10T17:17:22.091199+0000 mgr.gibba045.orlgmj (mgr.34412) 10988 : cluster [DBG] pgmap v6265: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:23.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:17:23 gibba045 bash[25517]: cluster 2021-03-10T17:17:22.091199+0000 mgr.gibba045.orlgmj (mgr.34412) 10988 : cluster [DBG] pgmap v6265: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:25.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:17:25 gibba015 bash[29377]: cluster 2021-03-10T17:17:24.092488+0000 mgr.gibba045.orlgmj (mgr.34412) 10989 : cluster [DBG] pgmap v6266: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:25.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:17:25 gibba015 bash[30343]: cluster 2021-03-10T17:17:24.092488+0000 mgr.gibba045.orlgmj (mgr.34412) 10989 : cluster [DBG] pgmap v6266: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:25.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:17:25 gibba045 bash[25517]: cluster 2021-03-10T17:17:24.092488+0000 mgr.gibba045.orlgmj (mgr.34412) 10989 : cluster [DBG] pgmap v6266: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:26.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:17:26 gibba015 bash[29377]: audit 2021-03-10T17:17:26.160736+0000 mon.c (mon.1) 3010 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:17:26.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:17:26 gibba015 bash[30343]: audit 2021-03-10T17:17:26.160736+0000 mon.c (mon.1) 3010 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:17:26.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:17:26 gibba045 bash[25517]: audit 2021-03-10T17:17:26.160736+0000 mon.c (mon.1) 3010 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:17:27.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:17:27 gibba015 bash[29377]: cluster 2021-03-10T17:17:26.093969+0000 mgr.gibba045.orlgmj (mgr.34412) 10990 : cluster [DBG] pgmap v6267: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:27.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:17:27 gibba015 bash[29377]: audit 2021-03-10T17:17:26.168927+0000 mon.c (mon.1) 3011 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:17:27.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:17:27 gibba015 bash[29377]: cephadm 2021-03-10T17:17:26.169858+0000 mgr.gibba045.orlgmj (mgr.34412) 10991 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:17:27.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:17:27 gibba015 bash[30343]: cluster 2021-03-10T17:17:26.093969+0000 mgr.gibba045.orlgmj (mgr.34412) 10990 : cluster [DBG] pgmap v6267: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:27.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:17:27 gibba015 bash[30343]: audit 2021-03-10T17:17:26.168927+0000 mon.c (mon.1) 3011 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:17:27.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:17:27 gibba015 bash[30343]: cephadm 2021-03-10T17:17:26.169858+0000 mgr.gibba045.orlgmj (mgr.34412) 10991 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:17:27.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:17:27 gibba045 bash[25517]: cluster 2021-03-10T17:17:26.093969+0000 mgr.gibba045.orlgmj (mgr.34412) 10990 : cluster [DBG] pgmap v6267: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:27.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:17:27 gibba045 bash[25517]: audit 2021-03-10T17:17:26.168927+0000 mon.c (mon.1) 3011 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:17:27.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:17:27 gibba045 bash[25517]: cephadm 2021-03-10T17:17:26.169858+0000 mgr.gibba045.orlgmj (mgr.34412) 10991 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:17:28.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:17:28 gibba015 bash[29377]: cluster 2021-03-10T17:17:28.095364+0000 mgr.gibba045.orlgmj (mgr.34412) 10992 : cluster [DBG] pgmap v6268: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:28.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:17:28 gibba015 bash[30343]: cluster 2021-03-10T17:17:28.095364+0000 mgr.gibba045.orlgmj (mgr.34412) 10992 : cluster [DBG] pgmap v6268: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:29.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:17:28 gibba045 bash[25517]: cluster 2021-03-10T17:17:28.095364+0000 mgr.gibba045.orlgmj (mgr.34412) 10992 : cluster [DBG] pgmap v6268: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:30.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:17:30 gibba015 bash[29377]: audit 2021-03-10T17:17:29.709526+0000 mon.a (mon.0) 2329 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:17:30.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:17:30 gibba015 bash[29377]: cephadm 2021-03-10T17:17:29.712493+0000 mgr.gibba045.orlgmj (mgr.34412) 10993 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:17:30.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:17:30 gibba015 bash[29377]: audit 2021-03-10T17:17:29.904232+0000 mon.a (mon.0) 2330 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:17:30.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:17:30 gibba015 bash[29377]: audit 2021-03-10T17:17:29.912278+0000 mon.c (mon.1) 3012 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:17:30.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:17:30 gibba015 bash[29377]: cephadm 2021-03-10T17:17:29.913222+0000 mgr.gibba045.orlgmj (mgr.34412) 10994 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:17:30.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:17:30 gibba015 bash[29377]: audit 2021-03-10T17:17:29.914348+0000 mon.c (mon.1) 3013 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:17:30.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:17:30 gibba015 bash[29377]: cephadm 2021-03-10T17:17:29.915730+0000 mgr.gibba045.orlgmj (mgr.34412) 10995 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:17:30.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:17:30 gibba015 bash[29377]: audit 2021-03-10T17:17:29.916333+0000 mon.c (mon.1) 3014 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:17:30.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:17:30 gibba015 bash[29377]: cephadm 2021-03-10T17:17:29.917615+0000 mgr.gibba045.orlgmj (mgr.34412) 10996 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:17:30.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:17:30 gibba015 bash[29377]: cephadm 2021-03-10T17:17:29.917657+0000 mgr.gibba045.orlgmj (mgr.34412) 10997 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:17:30.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:17:30 gibba015 bash[29377]: audit 2021-03-10T17:17:29.918788+0000 mon.c (mon.1) 3015 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:17:30.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:17:30 gibba015 bash[29377]: cephadm 2021-03-10T17:17:29.920152+0000 mgr.gibba045.orlgmj (mgr.34412) 10998 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:17:30.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:17:30 gibba015 bash[29377]: cephadm 2021-03-10T17:17:29.920198+0000 mgr.gibba045.orlgmj (mgr.34412) 10999 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:17:30.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:17:30 gibba015 bash[29377]: cephadm 2021-03-10T17:17:29.922167+0000 mgr.gibba045.orlgmj (mgr.34412) 11000 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:17:30.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:17:30 gibba015 bash[29377]: audit 2021-03-10T17:17:29.922595+0000 mon.c (mon.1) 3016 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:17:30.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:17:30 gibba015 bash[29377]: cephadm 2021-03-10T17:17:29.924096+0000 mgr.gibba045.orlgmj (mgr.34412) 11001 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:17:30.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:17:30 gibba015 bash[29377]: cephadm 2021-03-10T17:17:29.924140+0000 mgr.gibba045.orlgmj (mgr.34412) 11002 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:17:30.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:17:30 gibba015 bash[29377]: audit 2021-03-10T17:17:29.925387+0000 mon.c (mon.1) 3017 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:17:30.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:17:30 gibba015 bash[29377]: cephadm 2021-03-10T17:17:29.926395+0000 mgr.gibba045.orlgmj (mgr.34412) 11003 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:17:30.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:17:30 gibba015 bash[29377]: cephadm 2021-03-10T17:17:29.926891+0000 mgr.gibba045.orlgmj (mgr.34412) 11004 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:17:30.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:17:30 gibba015 bash[29377]: cephadm 2021-03-10T17:17:29.928802+0000 mgr.gibba045.orlgmj (mgr.34412) 11005 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:17:30.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:17:30 gibba015 bash[29377]: cephadm 2021-03-10T17:17:29.928852+0000 mgr.gibba045.orlgmj (mgr.34412) 11006 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:17:30.980 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:17:30 gibba015 bash[29377]: cephadm 2021-03-10T17:17:29.928997+0000 mgr.gibba045.orlgmj (mgr.34412) 11007 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:17:30.980 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:17:30 gibba015 bash[29377]: cluster 2021-03-10T17:17:30.097045+0000 mgr.gibba045.orlgmj (mgr.34412) 11008 : cluster [DBG] pgmap v6269: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:30.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:17:30 gibba015 bash[30343]: audit 2021-03-10T17:17:29.709526+0000 mon.a (mon.0) 2329 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:17:30.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:17:30 gibba015 bash[30343]: cephadm 2021-03-10T17:17:29.712493+0000 mgr.gibba045.orlgmj (mgr.34412) 10993 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:17:30.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:17:30 gibba015 bash[30343]: audit 2021-03-10T17:17:29.904232+0000 mon.a (mon.0) 2330 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:17:30.984 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:17:30 gibba015 bash[30343]: audit 2021-03-10T17:17:29.912278+0000 mon.c (mon.1) 3012 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:17:30.984 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:17:30 gibba015 bash[30343]: cephadm 2021-03-10T17:17:29.913222+0000 mgr.gibba045.orlgmj (mgr.34412) 10994 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:17:30.986 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:17:30 gibba015 bash[30343]: audit 2021-03-10T17:17:29.914348+0000 mon.c (mon.1) 3013 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:17:30.986 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:17:30 gibba015 bash[30343]: cephadm 2021-03-10T17:17:29.915730+0000 mgr.gibba045.orlgmj (mgr.34412) 10995 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:17:30.987 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:17:30 gibba015 bash[30343]: audit 2021-03-10T17:17:29.916333+0000 mon.c (mon.1) 3014 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:17:30.987 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:17:30 gibba015 bash[30343]: cephadm 2021-03-10T17:17:29.917615+0000 mgr.gibba045.orlgmj (mgr.34412) 10996 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:17:30.987 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:17:30 gibba015 bash[30343]: cephadm 2021-03-10T17:17:29.917657+0000 mgr.gibba045.orlgmj (mgr.34412) 10997 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:17:30.988 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:17:30 gibba015 bash[30343]: audit 2021-03-10T17:17:29.918788+0000 mon.c (mon.1) 3015 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:17:30.988 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:17:30 gibba015 bash[30343]: cephadm 2021-03-10T17:17:29.920152+0000 mgr.gibba045.orlgmj (mgr.34412) 10998 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:17:30.988 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:17:30 gibba015 bash[30343]: cephadm 2021-03-10T17:17:29.920198+0000 mgr.gibba045.orlgmj (mgr.34412) 10999 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:17:30.989 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:17:30 gibba015 bash[30343]: cephadm 2021-03-10T17:17:29.922167+0000 mgr.gibba045.orlgmj (mgr.34412) 11000 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:17:30.989 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:17:30 gibba015 bash[30343]: audit 2021-03-10T17:17:29.922595+0000 mon.c (mon.1) 3016 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:17:30.989 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:17:30 gibba015 bash[30343]: cephadm 2021-03-10T17:17:29.924096+0000 mgr.gibba045.orlgmj (mgr.34412) 11001 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:17:30.990 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:17:30 gibba015 bash[30343]: cephadm 2021-03-10T17:17:29.924140+0000 mgr.gibba045.orlgmj (mgr.34412) 11002 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:17:30.990 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:17:30 gibba015 bash[30343]: audit 2021-03-10T17:17:29.925387+0000 mon.c (mon.1) 3017 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:17:30.990 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:17:30 gibba015 bash[30343]: cephadm 2021-03-10T17:17:29.926395+0000 mgr.gibba045.orlgmj (mgr.34412) 11003 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:17:30.991 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:17:30 gibba015 bash[30343]: cephadm 2021-03-10T17:17:29.926891+0000 mgr.gibba045.orlgmj (mgr.34412) 11004 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:17:30.991 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:17:30 gibba015 bash[30343]: cephadm 2021-03-10T17:17:29.928802+0000 mgr.gibba045.orlgmj (mgr.34412) 11005 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:17:30.991 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:17:30 gibba015 bash[30343]: cephadm 2021-03-10T17:17:29.928852+0000 mgr.gibba045.orlgmj (mgr.34412) 11006 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:17:30.992 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:17:30 gibba015 bash[30343]: cephadm 2021-03-10T17:17:29.928997+0000 mgr.gibba045.orlgmj (mgr.34412) 11007 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:17:30.992 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:17:30 gibba015 bash[30343]: cluster 2021-03-10T17:17:30.097045+0000 mgr.gibba045.orlgmj (mgr.34412) 11008 : cluster [DBG] pgmap v6269: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:31.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:17:30 gibba045 bash[25517]: audit 2021-03-10T17:17:29.709526+0000 mon.a (mon.0) 2329 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:17:31.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:17:30 gibba045 bash[25517]: cephadm 2021-03-10T17:17:29.712493+0000 mgr.gibba045.orlgmj (mgr.34412) 10993 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:17:31.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:17:30 gibba045 bash[25517]: audit 2021-03-10T17:17:29.904232+0000 mon.a (mon.0) 2330 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:17:31.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:17:30 gibba045 bash[25517]: audit 2021-03-10T17:17:29.912278+0000 mon.c (mon.1) 3012 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:17:31.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:17:30 gibba045 bash[25517]: cephadm 2021-03-10T17:17:29.913222+0000 mgr.gibba045.orlgmj (mgr.34412) 10994 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:17:31.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:17:30 gibba045 bash[25517]: audit 2021-03-10T17:17:29.914348+0000 mon.c (mon.1) 3013 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:17:31.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:17:30 gibba045 bash[25517]: cephadm 2021-03-10T17:17:29.915730+0000 mgr.gibba045.orlgmj (mgr.34412) 10995 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:17:31.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:17:30 gibba045 bash[25517]: audit 2021-03-10T17:17:29.916333+0000 mon.c (mon.1) 3014 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:17:31.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:17:30 gibba045 bash[25517]: cephadm 2021-03-10T17:17:29.917615+0000 mgr.gibba045.orlgmj (mgr.34412) 10996 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:17:31.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:17:30 gibba045 bash[25517]: cephadm 2021-03-10T17:17:29.917657+0000 mgr.gibba045.orlgmj (mgr.34412) 10997 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:17:31.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:17:30 gibba045 bash[25517]: audit 2021-03-10T17:17:29.918788+0000 mon.c (mon.1) 3015 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:17:31.062 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:17:30 gibba045 bash[25517]: cephadm 2021-03-10T17:17:29.920152+0000 mgr.gibba045.orlgmj (mgr.34412) 10998 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:17:31.062 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:17:30 gibba045 bash[25517]: cephadm 2021-03-10T17:17:29.920198+0000 mgr.gibba045.orlgmj (mgr.34412) 10999 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:17:31.062 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:17:30 gibba045 bash[25517]: cephadm 2021-03-10T17:17:29.922167+0000 mgr.gibba045.orlgmj (mgr.34412) 11000 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:17:31.063 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:17:30 gibba045 bash[25517]: audit 2021-03-10T17:17:29.922595+0000 mon.c (mon.1) 3016 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:17:31.063 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:17:30 gibba045 bash[25517]: cephadm 2021-03-10T17:17:29.924096+0000 mgr.gibba045.orlgmj (mgr.34412) 11001 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:17:31.063 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:17:30 gibba045 bash[25517]: cephadm 2021-03-10T17:17:29.924140+0000 mgr.gibba045.orlgmj (mgr.34412) 11002 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:17:31.064 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:17:30 gibba045 bash[25517]: audit 2021-03-10T17:17:29.925387+0000 mon.c (mon.1) 3017 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:17:31.064 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:17:30 gibba045 bash[25517]: cephadm 2021-03-10T17:17:29.926395+0000 mgr.gibba045.orlgmj (mgr.34412) 11003 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:17:31.064 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:17:30 gibba045 bash[25517]: cephadm 2021-03-10T17:17:29.926891+0000 mgr.gibba045.orlgmj (mgr.34412) 11004 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:17:31.065 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:17:30 gibba045 bash[25517]: cephadm 2021-03-10T17:17:29.928802+0000 mgr.gibba045.orlgmj (mgr.34412) 11005 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:17:31.065 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:17:30 gibba045 bash[25517]: cephadm 2021-03-10T17:17:29.928852+0000 mgr.gibba045.orlgmj (mgr.34412) 11006 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:17:31.065 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:17:30 gibba045 bash[25517]: cephadm 2021-03-10T17:17:29.928997+0000 mgr.gibba045.orlgmj (mgr.34412) 11007 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:17:31.066 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:17:30 gibba045 bash[25517]: cluster 2021-03-10T17:17:30.097045+0000 mgr.gibba045.orlgmj (mgr.34412) 11008 : cluster [DBG] pgmap v6269: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:33.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:17:33 gibba015 bash[29377]: cluster 2021-03-10T17:17:32.098593+0000 mgr.gibba045.orlgmj (mgr.34412) 11009 : cluster [DBG] pgmap v6270: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:33.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:17:33 gibba015 bash[30343]: cluster 2021-03-10T17:17:32.098593+0000 mgr.gibba045.orlgmj (mgr.34412) 11009 : cluster [DBG] pgmap v6270: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:33.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:17:33 gibba045 bash[25517]: cluster 2021-03-10T17:17:32.098593+0000 mgr.gibba045.orlgmj (mgr.34412) 11009 : cluster [DBG] pgmap v6270: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:34.170 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:17:34.397 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:17:34.398 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 4s ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:17:34.398 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 9m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:17:34.399 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:17:34.399 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:17:34.400 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 4s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:17:34.400 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 4s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:17:34.400 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:17:34.401 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 4s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:17:34.401 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 4s ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:17:34.402 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 9m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:17:34.403 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 4s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:17:34.403 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 4s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:17:34.404 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 4s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:17:34.404 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 4s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:17:34.405 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:17:34.405 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:17:34.406 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:17:34.407 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:17:34.408 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 9m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:17:34.408 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 9m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:17:34.650 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:17:34.651 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:17:34.651 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:17:34.651 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:17:34.652 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:17:34.652 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:17:34.653 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:17:34.653 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:17:34.654 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:17:34.654 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:17:34.654 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:17:34.655 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:17:34.655 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:17:34.656 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:17:34.656 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:17:35.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:17:35 gibba015 bash[29377]: cluster 2021-03-10T17:17:34.099870+0000 mgr.gibba045.orlgmj (mgr.34412) 11010 : cluster [DBG] pgmap v6271: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:35.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:17:35 gibba015 bash[29377]: audit 2021-03-10T17:17:34.161747+0000 mgr.gibba045.orlgmj (mgr.34412) 11011 : audit [DBG] from='client.61420 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:17:35.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:17:35 gibba015 bash[29377]: audit 2021-03-10T17:17:34.385469+0000 mgr.gibba045.orlgmj (mgr.34412) 11012 : audit [DBG] from='client.61426 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:17:35.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:17:35 gibba015 bash[29377]: audit 2021-03-10T17:17:34.648814+0000 mon.a (mon.0) 2331 : audit [DBG] from='client.? 172.21.2.115:0/2664893602' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:17:35.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:17:35 gibba015 bash[30343]: cluster 2021-03-10T17:17:34.099870+0000 mgr.gibba045.orlgmj (mgr.34412) 11010 : cluster [DBG] pgmap v6271: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:35.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:17:35 gibba015 bash[30343]: audit 2021-03-10T17:17:34.161747+0000 mgr.gibba045.orlgmj (mgr.34412) 11011 : audit [DBG] from='client.61420 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:17:35.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:17:35 gibba015 bash[30343]: audit 2021-03-10T17:17:34.385469+0000 mgr.gibba045.orlgmj (mgr.34412) 11012 : audit [DBG] from='client.61426 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:17:35.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:17:35 gibba015 bash[30343]: audit 2021-03-10T17:17:34.648814+0000 mon.a (mon.0) 2331 : audit [DBG] from='client.? 172.21.2.115:0/2664893602' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:17:35.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:17:35 gibba045 bash[25517]: cluster 2021-03-10T17:17:34.099870+0000 mgr.gibba045.orlgmj (mgr.34412) 11010 : cluster [DBG] pgmap v6271: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:35.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:17:35 gibba045 bash[25517]: audit 2021-03-10T17:17:34.161747+0000 mgr.gibba045.orlgmj (mgr.34412) 11011 : audit [DBG] from='client.61420 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:17:35.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:17:35 gibba045 bash[25517]: audit 2021-03-10T17:17:34.385469+0000 mgr.gibba045.orlgmj (mgr.34412) 11012 : audit [DBG] from='client.61426 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:17:35.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:17:35 gibba045 bash[25517]: audit 2021-03-10T17:17:34.648814+0000 mon.a (mon.0) 2331 : audit [DBG] from='client.? 172.21.2.115:0/2664893602' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:17:37.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:17:37 gibba015 bash[29377]: cluster 2021-03-10T17:17:36.101733+0000 mgr.gibba045.orlgmj (mgr.34412) 11013 : cluster [DBG] pgmap v6272: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:37.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:17:37 gibba015 bash[30343]: cluster 2021-03-10T17:17:36.101733+0000 mgr.gibba045.orlgmj (mgr.34412) 11013 : cluster [DBG] pgmap v6272: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:37.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:17:37 gibba045 bash[25517]: cluster 2021-03-10T17:17:36.101733+0000 mgr.gibba045.orlgmj (mgr.34412) 11013 : cluster [DBG] pgmap v6272: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:38.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:17:38 gibba015 bash[29377]: cluster 2021-03-10T17:17:38.103137+0000 mgr.gibba045.orlgmj (mgr.34412) 11014 : cluster [DBG] pgmap v6273: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:38.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:17:38 gibba015 bash[30343]: cluster 2021-03-10T17:17:38.103137+0000 mgr.gibba045.orlgmj (mgr.34412) 11014 : cluster [DBG] pgmap v6273: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:39.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:17:38 gibba045 bash[25517]: cluster 2021-03-10T17:17:38.103137+0000 mgr.gibba045.orlgmj (mgr.34412) 11014 : cluster [DBG] pgmap v6273: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:41.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:17:41 gibba015 bash[29377]: cluster 2021-03-10T17:17:40.104848+0000 mgr.gibba045.orlgmj (mgr.34412) 11015 : cluster [DBG] pgmap v6274: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:41.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:17:41 gibba015 bash[30343]: cluster 2021-03-10T17:17:40.104848+0000 mgr.gibba045.orlgmj (mgr.34412) 11015 : cluster [DBG] pgmap v6274: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:41.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:17:41 gibba045 bash[25517]: cluster 2021-03-10T17:17:40.104848+0000 mgr.gibba045.orlgmj (mgr.34412) 11015 : cluster [DBG] pgmap v6274: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:43.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:17:43 gibba015 bash[29377]: cluster 2021-03-10T17:17:42.106682+0000 mgr.gibba045.orlgmj (mgr.34412) 11016 : cluster [DBG] pgmap v6275: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:43.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:17:43 gibba015 bash[30343]: cluster 2021-03-10T17:17:42.106682+0000 mgr.gibba045.orlgmj (mgr.34412) 11016 : cluster [DBG] pgmap v6275: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:43.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:17:43 gibba045 bash[25517]: cluster 2021-03-10T17:17:42.106682+0000 mgr.gibba045.orlgmj (mgr.34412) 11016 : cluster [DBG] pgmap v6275: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:45.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:17:45 gibba045 bash[25517]: cluster 2021-03-10T17:17:44.107889+0000 mgr.gibba045.orlgmj (mgr.34412) 11017 : cluster [DBG] pgmap v6276: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:45.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:17:45 gibba015 bash[29377]: cluster 2021-03-10T17:17:44.107889+0000 mgr.gibba045.orlgmj (mgr.34412) 11017 : cluster [DBG] pgmap v6276: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:45.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:17:45 gibba015 bash[30343]: cluster 2021-03-10T17:17:44.107889+0000 mgr.gibba045.orlgmj (mgr.34412) 11017 : cluster [DBG] pgmap v6276: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:46.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:17:46 gibba015 bash[29377]: cephadm 2021-03-10T17:17:44.944897+0000 mgr.gibba045.orlgmj (mgr.34412) 11018 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:17:46.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:17:46 gibba015 bash[30343]: cephadm 2021-03-10T17:17:44.944897+0000 mgr.gibba045.orlgmj (mgr.34412) 11018 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:17:46.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:17:46 gibba045 bash[25517]: cephadm 2021-03-10T17:17:44.944897+0000 mgr.gibba045.orlgmj (mgr.34412) 11018 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:17:47.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:17:47 gibba015 bash[29377]: cluster 2021-03-10T17:17:46.109601+0000 mgr.gibba045.orlgmj (mgr.34412) 11019 : cluster [DBG] pgmap v6277: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:47.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:17:47 gibba015 bash[30343]: cluster 2021-03-10T17:17:46.109601+0000 mgr.gibba045.orlgmj (mgr.34412) 11019 : cluster [DBG] pgmap v6277: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:47.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:17:47 gibba045 bash[25517]: cluster 2021-03-10T17:17:46.109601+0000 mgr.gibba045.orlgmj (mgr.34412) 11019 : cluster [DBG] pgmap v6277: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:48.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:17:48 gibba015 bash[29377]: cluster 2021-03-10T17:17:48.110993+0000 mgr.gibba045.orlgmj (mgr.34412) 11020 : cluster [DBG] pgmap v6278: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:48.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:17:48 gibba015 bash[30343]: cluster 2021-03-10T17:17:48.110993+0000 mgr.gibba045.orlgmj (mgr.34412) 11020 : cluster [DBG] pgmap v6278: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:49.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:17:48 gibba045 bash[25517]: cluster 2021-03-10T17:17:48.110993+0000 mgr.gibba045.orlgmj (mgr.34412) 11020 : cluster [DBG] pgmap v6278: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:51.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:17:51 gibba015 bash[29377]: cluster 2021-03-10T17:17:50.111836+0000 mgr.gibba045.orlgmj (mgr.34412) 11021 : cluster [DBG] pgmap v6279: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:51.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:17:51 gibba015 bash[30343]: cluster 2021-03-10T17:17:50.111836+0000 mgr.gibba045.orlgmj (mgr.34412) 11021 : cluster [DBG] pgmap v6279: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:51.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:17:51 gibba045 bash[25517]: cluster 2021-03-10T17:17:50.111836+0000 mgr.gibba045.orlgmj (mgr.34412) 11021 : cluster [DBG] pgmap v6279: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:53.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:17:53 gibba015 bash[29377]: cluster 2021-03-10T17:17:52.113425+0000 mgr.gibba045.orlgmj (mgr.34412) 11022 : cluster [DBG] pgmap v6280: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:53.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:17:53 gibba015 bash[30343]: cluster 2021-03-10T17:17:52.113425+0000 mgr.gibba045.orlgmj (mgr.34412) 11022 : cluster [DBG] pgmap v6280: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:53.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:17:53 gibba045 bash[25517]: cluster 2021-03-10T17:17:52.113425+0000 mgr.gibba045.orlgmj (mgr.34412) 11022 : cluster [DBG] pgmap v6280: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:17:54 gibba015 bash[29377]: audit 2021-03-10T17:17:53.972538+0000 mon.c (mon.1) 3018 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:17:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:17:54 gibba015 bash[29377]: audit 2021-03-10T17:17:53.973637+0000 mon.c (mon.1) 3019 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:17:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:17:54 gibba015 bash[29377]: audit 2021-03-10T17:17:53.973931+0000 mon.a (mon.0) 2332 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:17:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:17:54 gibba015 bash[29377]: audit 2021-03-10T17:17:53.975413+0000 mon.a (mon.0) 2333 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:17:54.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:17:54 gibba015 bash[29377]: audit 2021-03-10T17:17:54.063442+0000 mon.c (mon.1) 3020 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T17:17:54.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:17:54 gibba015 bash[29377]: audit 2021-03-10T17:17:54.064598+0000 mon.c (mon.1) 3021 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:17:54.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:17:54 gibba015 bash[29377]: audit 2021-03-10T17:17:54.064957+0000 mon.a (mon.0) 2334 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T17:17:54.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:17:54 gibba015 bash[29377]: audit 2021-03-10T17:17:54.065700+0000 mon.c (mon.1) 3022 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T17:17:54.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:17:54 gibba015 bash[29377]: audit 2021-03-10T17:17:54.066704+0000 mon.a (mon.0) 2335 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:17:54.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:17:54 gibba015 bash[29377]: audit 2021-03-10T17:17:54.066993+0000 mon.c (mon.1) 3023 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:17:54.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:17:54 gibba015 bash[29377]: audit 2021-03-10T17:17:54.068009+0000 mon.a (mon.0) 2336 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T17:17:54.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:17:54 gibba015 bash[29377]: audit 2021-03-10T17:17:54.069194+0000 mon.a (mon.0) 2337 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:17:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:17:54 gibba015 bash[30343]: audit 2021-03-10T17:17:53.972538+0000 mon.c (mon.1) 3018 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:17:54.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:17:54 gibba015 bash[30343]: audit 2021-03-10T17:17:53.973637+0000 mon.c (mon.1) 3019 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:17:54.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:17:54 gibba015 bash[30343]: audit 2021-03-10T17:17:53.973931+0000 mon.a (mon.0) 2332 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:17:54.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:17:54 gibba015 bash[30343]: audit 2021-03-10T17:17:53.975413+0000 mon.a (mon.0) 2333 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:17:54.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:17:54 gibba015 bash[30343]: audit 2021-03-10T17:17:54.063442+0000 mon.c (mon.1) 3020 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T17:17:54.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:17:54 gibba015 bash[30343]: audit 2021-03-10T17:17:54.064598+0000 mon.c (mon.1) 3021 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:17:54.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:17:54 gibba015 bash[30343]: audit 2021-03-10T17:17:54.064957+0000 mon.a (mon.0) 2334 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T17:17:54.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:17:54 gibba015 bash[30343]: audit 2021-03-10T17:17:54.065700+0000 mon.c (mon.1) 3022 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T17:17:54.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:17:54 gibba015 bash[30343]: audit 2021-03-10T17:17:54.066704+0000 mon.a (mon.0) 2335 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:17:54.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:17:54 gibba015 bash[30343]: audit 2021-03-10T17:17:54.066993+0000 mon.c (mon.1) 3023 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:17:54.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:17:54 gibba015 bash[30343]: audit 2021-03-10T17:17:54.068009+0000 mon.a (mon.0) 2336 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T17:17:54.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:17:54 gibba015 bash[30343]: audit 2021-03-10T17:17:54.069194+0000 mon.a (mon.0) 2337 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:17:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:17:54 gibba045 bash[25517]: audit 2021-03-10T17:17:53.972538+0000 mon.c (mon.1) 3018 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:17:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:17:54 gibba045 bash[25517]: audit 2021-03-10T17:17:53.973637+0000 mon.c (mon.1) 3019 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:17:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:17:54 gibba045 bash[25517]: audit 2021-03-10T17:17:53.973931+0000 mon.a (mon.0) 2332 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:17:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:17:54 gibba045 bash[25517]: audit 2021-03-10T17:17:53.975413+0000 mon.a (mon.0) 2333 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:17:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:17:54 gibba045 bash[25517]: audit 2021-03-10T17:17:54.063442+0000 mon.c (mon.1) 3020 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T17:17:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:17:54 gibba045 bash[25517]: audit 2021-03-10T17:17:54.064598+0000 mon.c (mon.1) 3021 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:17:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:17:54 gibba045 bash[25517]: audit 2021-03-10T17:17:54.064957+0000 mon.a (mon.0) 2334 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T17:17:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:17:54 gibba045 bash[25517]: audit 2021-03-10T17:17:54.065700+0000 mon.c (mon.1) 3022 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T17:17:54.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:17:54 gibba045 bash[25517]: audit 2021-03-10T17:17:54.066704+0000 mon.a (mon.0) 2335 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:17:54.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:17:54 gibba045 bash[25517]: audit 2021-03-10T17:17:54.066993+0000 mon.c (mon.1) 3023 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:17:54.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:17:54 gibba045 bash[25517]: audit 2021-03-10T17:17:54.068009+0000 mon.a (mon.0) 2336 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T17:17:54.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:17:54 gibba045 bash[25517]: audit 2021-03-10T17:17:54.069194+0000 mon.a (mon.0) 2337 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:17:55.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:17:55 gibba015 bash[29377]: cluster 2021-03-10T17:17:54.114141+0000 mgr.gibba045.orlgmj (mgr.34412) 11023 : cluster [DBG] pgmap v6281: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:55.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:17:55 gibba015 bash[30343]: cluster 2021-03-10T17:17:54.114141+0000 mgr.gibba045.orlgmj (mgr.34412) 11023 : cluster [DBG] pgmap v6281: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:55.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:17:55 gibba045 bash[25517]: cluster 2021-03-10T17:17:54.114141+0000 mgr.gibba045.orlgmj (mgr.34412) 11023 : cluster [DBG] pgmap v6281: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:57.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:17:57 gibba015 bash[29377]: cluster 2021-03-10T17:17:56.115752+0000 mgr.gibba045.orlgmj (mgr.34412) 11024 : cluster [DBG] pgmap v6282: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:57.573 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:17:57 gibba015 bash[30343]: cluster 2021-03-10T17:17:56.115752+0000 mgr.gibba045.orlgmj (mgr.34412) 11024 : cluster [DBG] pgmap v6282: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:57.574 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:17:57 gibba045 bash[25517]: cluster 2021-03-10T17:17:56.115752+0000 mgr.gibba045.orlgmj (mgr.34412) 11024 : cluster [DBG] pgmap v6282: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:58.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:17:58 gibba015 bash[29377]: cluster 2021-03-10T17:17:58.117438+0000 mgr.gibba045.orlgmj (mgr.34412) 11025 : cluster [DBG] pgmap v6283: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:58.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:17:58 gibba015 bash[30343]: cluster 2021-03-10T17:17:58.117438+0000 mgr.gibba045.orlgmj (mgr.34412) 11025 : cluster [DBG] pgmap v6283: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:59.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:17:58 gibba045 bash[25517]: cluster 2021-03-10T17:17:58.117438+0000 mgr.gibba045.orlgmj (mgr.34412) 11025 : cluster [DBG] pgmap v6283: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:01.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:01 gibba015 bash[29377]: cephadm 2021-03-10T17:17:59.949233+0000 mgr.gibba045.orlgmj (mgr.34412) 11026 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:18:01.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:01 gibba015 bash[29377]: cluster 2021-03-10T17:18:00.119254+0000 mgr.gibba045.orlgmj (mgr.34412) 11027 : cluster [DBG] pgmap v6284: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:01.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:01 gibba015 bash[30343]: cephadm 2021-03-10T17:17:59.949233+0000 mgr.gibba045.orlgmj (mgr.34412) 11026 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:18:01.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:01 gibba015 bash[30343]: cluster 2021-03-10T17:18:00.119254+0000 mgr.gibba045.orlgmj (mgr.34412) 11027 : cluster [DBG] pgmap v6284: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:01.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:01 gibba045 bash[25517]: cephadm 2021-03-10T17:17:59.949233+0000 mgr.gibba045.orlgmj (mgr.34412) 11026 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:18:01.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:01 gibba045 bash[25517]: cluster 2021-03-10T17:18:00.119254+0000 mgr.gibba045.orlgmj (mgr.34412) 11027 : cluster [DBG] pgmap v6284: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:03.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:03 gibba015 bash[29377]: cluster 2021-03-10T17:18:02.121104+0000 mgr.gibba045.orlgmj (mgr.34412) 11028 : cluster [DBG] pgmap v6285: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:03.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:03 gibba015 bash[30343]: cluster 2021-03-10T17:18:02.121104+0000 mgr.gibba045.orlgmj (mgr.34412) 11028 : cluster [DBG] pgmap v6285: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:03.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:03 gibba045 bash[25517]: cluster 2021-03-10T17:18:02.121104+0000 mgr.gibba045.orlgmj (mgr.34412) 11028 : cluster [DBG] pgmap v6285: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:04.897 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:18:05.125 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:18:05.125 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 35s ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:18:05.126 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 9m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:18:05.126 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:18:05.126 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:18:05.126 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 35s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:18:05.127 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 35s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:18:05.127 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:18:05.127 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 35s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:18:05.127 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 35s ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:18:05.128 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 9m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:18:05.128 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 35s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:18:05.128 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 35s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:18:05.128 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 35s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:18:05.128 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 35s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:18:05.129 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:18:05.129 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:18:05.129 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:18:05.129 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:18:05.130 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 9m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:18:05.130 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 9m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:18:05.376 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:18:05.376 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:18:05.377 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:18:05.377 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:18:05.377 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:18:05.377 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:18:05.378 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:18:05.378 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:18:05.378 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:18:05.378 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:18:05.379 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:18:05.379 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:18:05.379 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:18:05.379 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:18:05.379 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:18:05.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:05 gibba015 bash[29377]: cluster 2021-03-10T17:18:04.122419+0000 mgr.gibba045.orlgmj (mgr.34412) 11029 : cluster [DBG] pgmap v6286: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:05.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:05 gibba015 bash[30343]: cluster 2021-03-10T17:18:04.122419+0000 mgr.gibba045.orlgmj (mgr.34412) 11029 : cluster [DBG] pgmap v6286: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:05.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:05 gibba045 bash[25517]: cluster 2021-03-10T17:18:04.122419+0000 mgr.gibba045.orlgmj (mgr.34412) 11029 : cluster [DBG] pgmap v6286: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:06.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:06 gibba015 bash[29377]: audit 2021-03-10T17:18:04.888968+0000 mgr.gibba045.orlgmj (mgr.34412) 11030 : audit [DBG] from='client.51450 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:18:06.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:06 gibba015 bash[29377]: audit 2021-03-10T17:18:05.114060+0000 mgr.gibba045.orlgmj (mgr.34412) 11031 : audit [DBG] from='client.61444 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:18:06.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:06 gibba015 bash[29377]: audit 2021-03-10T17:18:05.375231+0000 mon.a (mon.0) 2338 : audit [DBG] from='client.? 172.21.2.115:0/3176593731' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:18:06.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:06 gibba015 bash[30343]: audit 2021-03-10T17:18:04.888968+0000 mgr.gibba045.orlgmj (mgr.34412) 11030 : audit [DBG] from='client.51450 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:18:06.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:06 gibba015 bash[30343]: audit 2021-03-10T17:18:05.114060+0000 mgr.gibba045.orlgmj (mgr.34412) 11031 : audit [DBG] from='client.61444 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:18:06.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:06 gibba015 bash[30343]: audit 2021-03-10T17:18:05.375231+0000 mon.a (mon.0) 2338 : audit [DBG] from='client.? 172.21.2.115:0/3176593731' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:18:06.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:06 gibba045 bash[25517]: audit 2021-03-10T17:18:04.888968+0000 mgr.gibba045.orlgmj (mgr.34412) 11030 : audit [DBG] from='client.51450 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:18:06.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:06 gibba045 bash[25517]: audit 2021-03-10T17:18:05.114060+0000 mgr.gibba045.orlgmj (mgr.34412) 11031 : audit [DBG] from='client.61444 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:18:06.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:06 gibba045 bash[25517]: audit 2021-03-10T17:18:05.375231+0000 mon.a (mon.0) 2338 : audit [DBG] from='client.? 172.21.2.115:0/3176593731' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:18:07.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:07 gibba015 bash[29377]: cluster 2021-03-10T17:18:06.124228+0000 mgr.gibba045.orlgmj (mgr.34412) 11032 : cluster [DBG] pgmap v6287: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:07.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:07 gibba015 bash[30343]: cluster 2021-03-10T17:18:06.124228+0000 mgr.gibba045.orlgmj (mgr.34412) 11032 : cluster [DBG] pgmap v6287: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:07.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:07 gibba045 bash[25517]: cluster 2021-03-10T17:18:06.124228+0000 mgr.gibba045.orlgmj (mgr.34412) 11032 : cluster [DBG] pgmap v6287: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:08.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:08 gibba015 bash[29377]: cluster 2021-03-10T17:18:08.125941+0000 mgr.gibba045.orlgmj (mgr.34412) 11033 : cluster [DBG] pgmap v6288: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:08.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:08 gibba015 bash[30343]: cluster 2021-03-10T17:18:08.125941+0000 mgr.gibba045.orlgmj (mgr.34412) 11033 : cluster [DBG] pgmap v6288: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:09.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:08 gibba045 bash[25517]: cluster 2021-03-10T17:18:08.125941+0000 mgr.gibba045.orlgmj (mgr.34412) 11033 : cluster [DBG] pgmap v6288: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:11.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:11 gibba015 bash[29377]: cluster 2021-03-10T17:18:10.127795+0000 mgr.gibba045.orlgmj (mgr.34412) 11034 : cluster [DBG] pgmap v6289: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:11.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:11 gibba015 bash[30343]: cluster 2021-03-10T17:18:10.127795+0000 mgr.gibba045.orlgmj (mgr.34412) 11034 : cluster [DBG] pgmap v6289: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:11.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:11 gibba045 bash[25517]: cluster 2021-03-10T17:18:10.127795+0000 mgr.gibba045.orlgmj (mgr.34412) 11034 : cluster [DBG] pgmap v6289: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:13.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:13 gibba015 bash[29377]: cluster 2021-03-10T17:18:12.129700+0000 mgr.gibba045.orlgmj (mgr.34412) 11035 : cluster [DBG] pgmap v6290: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:13.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:13 gibba015 bash[30343]: cluster 2021-03-10T17:18:12.129700+0000 mgr.gibba045.orlgmj (mgr.34412) 11035 : cluster [DBG] pgmap v6290: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:13.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:13 gibba045 bash[25517]: cluster 2021-03-10T17:18:12.129700+0000 mgr.gibba045.orlgmj (mgr.34412) 11035 : cluster [DBG] pgmap v6290: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:15.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:15 gibba045 bash[25517]: cluster 2021-03-10T17:18:14.130958+0000 mgr.gibba045.orlgmj (mgr.34412) 11036 : cluster [DBG] pgmap v6291: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:15.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:15 gibba015 bash[29377]: cluster 2021-03-10T17:18:14.130958+0000 mgr.gibba045.orlgmj (mgr.34412) 11036 : cluster [DBG] pgmap v6291: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:15.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:15 gibba015 bash[30343]: cluster 2021-03-10T17:18:14.130958+0000 mgr.gibba045.orlgmj (mgr.34412) 11036 : cluster [DBG] pgmap v6291: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:16.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:16 gibba015 bash[29377]: cephadm 2021-03-10T17:18:14.965323+0000 mgr.gibba045.orlgmj (mgr.34412) 11037 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:18:16.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:16 gibba015 bash[30343]: cephadm 2021-03-10T17:18:14.965323+0000 mgr.gibba045.orlgmj (mgr.34412) 11037 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:18:16.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:16 gibba045 bash[25517]: cephadm 2021-03-10T17:18:14.965323+0000 mgr.gibba045.orlgmj (mgr.34412) 11037 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:18:17.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:17 gibba045 bash[25517]: cluster 2021-03-10T17:18:16.132797+0000 mgr.gibba045.orlgmj (mgr.34412) 11038 : cluster [DBG] pgmap v6292: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:17.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:17 gibba015 bash[29377]: cluster 2021-03-10T17:18:16.132797+0000 mgr.gibba045.orlgmj (mgr.34412) 11038 : cluster [DBG] pgmap v6292: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:17.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:17 gibba015 bash[30343]: cluster 2021-03-10T17:18:16.132797+0000 mgr.gibba045.orlgmj (mgr.34412) 11038 : cluster [DBG] pgmap v6292: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:18.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:18 gibba015 bash[29377]: cluster 2021-03-10T17:18:18.135335+0000 mgr.gibba045.orlgmj (mgr.34412) 11039 : cluster [DBG] pgmap v6293: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:18.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:18 gibba015 bash[30343]: cluster 2021-03-10T17:18:18.135335+0000 mgr.gibba045.orlgmj (mgr.34412) 11039 : cluster [DBG] pgmap v6293: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:19.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:18 gibba045 bash[25517]: cluster 2021-03-10T17:18:18.135335+0000 mgr.gibba045.orlgmj (mgr.34412) 11039 : cluster [DBG] pgmap v6293: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:21.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:21 gibba015 bash[29377]: cluster 2021-03-10T17:18:20.136706+0000 mgr.gibba045.orlgmj (mgr.34412) 11040 : cluster [DBG] pgmap v6294: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:21.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:21 gibba015 bash[30343]: cluster 2021-03-10T17:18:20.136706+0000 mgr.gibba045.orlgmj (mgr.34412) 11040 : cluster [DBG] pgmap v6294: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:21.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:21 gibba045 bash[25517]: cluster 2021-03-10T17:18:20.136706+0000 mgr.gibba045.orlgmj (mgr.34412) 11040 : cluster [DBG] pgmap v6294: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:23.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:23 gibba015 bash[29377]: cluster 2021-03-10T17:18:22.138419+0000 mgr.gibba045.orlgmj (mgr.34412) 11041 : cluster [DBG] pgmap v6295: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:23.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:23 gibba015 bash[30343]: cluster 2021-03-10T17:18:22.138419+0000 mgr.gibba045.orlgmj (mgr.34412) 11041 : cluster [DBG] pgmap v6295: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:23.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:23 gibba045 bash[25517]: cluster 2021-03-10T17:18:22.138419+0000 mgr.gibba045.orlgmj (mgr.34412) 11041 : cluster [DBG] pgmap v6295: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:25.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:25 gibba015 bash[29377]: cluster 2021-03-10T17:18:24.139045+0000 mgr.gibba045.orlgmj (mgr.34412) 11042 : cluster [DBG] pgmap v6296: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:25.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:25 gibba015 bash[30343]: cluster 2021-03-10T17:18:24.139045+0000 mgr.gibba045.orlgmj (mgr.34412) 11042 : cluster [DBG] pgmap v6296: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:25.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:25 gibba045 bash[25517]: cluster 2021-03-10T17:18:24.139045+0000 mgr.gibba045.orlgmj (mgr.34412) 11042 : cluster [DBG] pgmap v6296: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:27.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:27 gibba045 bash[25517]: cluster 2021-03-10T17:18:26.140692+0000 mgr.gibba045.orlgmj (mgr.34412) 11043 : cluster [DBG] pgmap v6297: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:27.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:27 gibba015 bash[29377]: cluster 2021-03-10T17:18:26.140692+0000 mgr.gibba045.orlgmj (mgr.34412) 11043 : cluster [DBG] pgmap v6297: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:27.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:27 gibba015 bash[30343]: cluster 2021-03-10T17:18:26.140692+0000 mgr.gibba045.orlgmj (mgr.34412) 11043 : cluster [DBG] pgmap v6297: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:28.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:28 gibba015 bash[30343]: cluster 2021-03-10T17:18:28.142071+0000 mgr.gibba045.orlgmj (mgr.34412) 11044 : cluster [DBG] pgmap v6298: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:28.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:28 gibba015 bash[29377]: cluster 2021-03-10T17:18:28.142071+0000 mgr.gibba045.orlgmj (mgr.34412) 11044 : cluster [DBG] pgmap v6298: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:29.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:28 gibba045 bash[25517]: cluster 2021-03-10T17:18:28.142071+0000 mgr.gibba045.orlgmj (mgr.34412) 11044 : cluster [DBG] pgmap v6298: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:30.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:30 gibba045 bash[25517]: audit 2021-03-10T17:18:29.979877+0000 mon.c (mon.1) 3024 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:18:30.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:30 gibba045 bash[25517]: audit 2021-03-10T17:18:29.988100+0000 mon.c (mon.1) 3025 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:18:30.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:30 gibba015 bash[29377]: audit 2021-03-10T17:18:29.979877+0000 mon.c (mon.1) 3024 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:18:30.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:30 gibba015 bash[29377]: audit 2021-03-10T17:18:29.988100+0000 mon.c (mon.1) 3025 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:18:30.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:30 gibba015 bash[30343]: audit 2021-03-10T17:18:29.979877+0000 mon.c (mon.1) 3024 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:18:30.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:30 gibba015 bash[30343]: audit 2021-03-10T17:18:29.988100+0000 mon.c (mon.1) 3025 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:18:31.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:31 gibba045 bash[25517]: cephadm 2021-03-10T17:18:29.987011+0000 mgr.gibba045.orlgmj (mgr.34412) 11045 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:18:31.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:31 gibba045 bash[25517]: cluster 2021-03-10T17:18:30.142702+0000 mgr.gibba045.orlgmj (mgr.34412) 11046 : cluster [DBG] pgmap v6299: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:31.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:31 gibba015 bash[29377]: cephadm 2021-03-10T17:18:29.987011+0000 mgr.gibba045.orlgmj (mgr.34412) 11045 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:18:31.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:31 gibba015 bash[29377]: cluster 2021-03-10T17:18:30.142702+0000 mgr.gibba045.orlgmj (mgr.34412) 11046 : cluster [DBG] pgmap v6299: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:31.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:31 gibba015 bash[30343]: cephadm 2021-03-10T17:18:29.987011+0000 mgr.gibba045.orlgmj (mgr.34412) 11045 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:18:31.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:31 gibba015 bash[30343]: cluster 2021-03-10T17:18:30.142702+0000 mgr.gibba045.orlgmj (mgr.34412) 11046 : cluster [DBG] pgmap v6299: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:33.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:33 gibba015 bash[29377]: cluster 2021-03-10T17:18:32.144195+0000 mgr.gibba045.orlgmj (mgr.34412) 11047 : cluster [DBG] pgmap v6300: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:33.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:33 gibba015 bash[30343]: cluster 2021-03-10T17:18:32.144195+0000 mgr.gibba045.orlgmj (mgr.34412) 11047 : cluster [DBG] pgmap v6300: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:33.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:33 gibba045 bash[25517]: cluster 2021-03-10T17:18:32.144195+0000 mgr.gibba045.orlgmj (mgr.34412) 11047 : cluster [DBG] pgmap v6300: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:34.958 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:34 gibba045 bash[25517]: audit 2021-03-10T17:18:33.684743+0000 mon.a (mon.0) 2339 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:18:34.959 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:34 gibba045 bash[25517]: audit 2021-03-10T17:18:33.686913+0000 mon.c (mon.1) 3026 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T17:18:34.959 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:34 gibba045 bash[25517]: cluster 2021-03-10T17:18:34.145570+0000 mgr.gibba045.orlgmj (mgr.34412) 11048 : cluster [DBG] pgmap v6301: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:34.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:34 gibba015 bash[29377]: audit 2021-03-10T17:18:33.684743+0000 mon.a (mon.0) 2339 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:18:34.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:34 gibba015 bash[29377]: audit 2021-03-10T17:18:33.686913+0000 mon.c (mon.1) 3026 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T17:18:34.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:34 gibba015 bash[29377]: cluster 2021-03-10T17:18:34.145570+0000 mgr.gibba045.orlgmj (mgr.34412) 11048 : cluster [DBG] pgmap v6301: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:34.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:34 gibba015 bash[30343]: audit 2021-03-10T17:18:33.684743+0000 mon.a (mon.0) 2339 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:18:34.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:34 gibba015 bash[30343]: audit 2021-03-10T17:18:33.686913+0000 mon.c (mon.1) 3026 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T17:18:34.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:34 gibba015 bash[30343]: cluster 2021-03-10T17:18:34.145570+0000 mgr.gibba045.orlgmj (mgr.34412) 11048 : cluster [DBG] pgmap v6301: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:35.615 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:18:35.843 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:18:35.844 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 66s ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:18:35.844 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 2s ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:18:35.850 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 2s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:18:35.850 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 2s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:18:35.850 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 66s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:18:35.850 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 66s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:18:35.851 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 2s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:18:35.851 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 66s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:18:35.851 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 66s ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:18:35.851 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 2s ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:18:35.851 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 66s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:18:35.852 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 66s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:18:35.852 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 66s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:18:35.852 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 66s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:18:35.852 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 2s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:18:35.853 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 2s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:18:35.853 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 2s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:18:35.853 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 2s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:18:35.853 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 2s ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:18:35.854 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 2s ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:18:36.093 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:18:36.094 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:18:36.094 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:18:36.094 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:18:36.094 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:18:36.095 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:18:36.095 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:18:36.095 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:18:36.095 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:18:36.096 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:18:36.096 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:18:36.096 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:18:36.096 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:18:36.097 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:18:36.097 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:18:36.451 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:36 gibba045 bash[25517]: audit 2021-03-10T17:18:36.092088+0000 mon.c (mon.1) 3027 : audit [DBG] from='client.? 172.21.2.115:0/899702179' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:18:36.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:36 gibba015 bash[29377]: audit 2021-03-10T17:18:36.092088+0000 mon.c (mon.1) 3027 : audit [DBG] from='client.? 172.21.2.115:0/899702179' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:18:36.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:36 gibba015 bash[30343]: audit 2021-03-10T17:18:36.092088+0000 mon.c (mon.1) 3027 : audit [DBG] from='client.? 172.21.2.115:0/899702179' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:18:37.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:37 gibba015 bash[29377]: audit 2021-03-10T17:18:35.607753+0000 mgr.gibba045.orlgmj (mgr.34412) 11049 : audit [DBG] from='client.51468 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:18:37.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:37 gibba015 bash[29377]: audit 2021-03-10T17:18:35.831116+0000 mgr.gibba045.orlgmj (mgr.34412) 11050 : audit [DBG] from='client.61462 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:18:37.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:37 gibba015 bash[29377]: cluster 2021-03-10T17:18:36.146228+0000 mgr.gibba045.orlgmj (mgr.34412) 11051 : cluster [DBG] pgmap v6302: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:37.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:37 gibba015 bash[30343]: audit 2021-03-10T17:18:35.607753+0000 mgr.gibba045.orlgmj (mgr.34412) 11049 : audit [DBG] from='client.51468 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:18:37.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:37 gibba015 bash[30343]: audit 2021-03-10T17:18:35.831116+0000 mgr.gibba045.orlgmj (mgr.34412) 11050 : audit [DBG] from='client.61462 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:18:37.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:37 gibba015 bash[30343]: cluster 2021-03-10T17:18:36.146228+0000 mgr.gibba045.orlgmj (mgr.34412) 11051 : cluster [DBG] pgmap v6302: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:37.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:37 gibba045 bash[25517]: audit 2021-03-10T17:18:35.607753+0000 mgr.gibba045.orlgmj (mgr.34412) 11049 : audit [DBG] from='client.51468 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:18:37.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:37 gibba045 bash[25517]: audit 2021-03-10T17:18:35.831116+0000 mgr.gibba045.orlgmj (mgr.34412) 11050 : audit [DBG] from='client.61462 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:18:37.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:37 gibba045 bash[25517]: cluster 2021-03-10T17:18:36.146228+0000 mgr.gibba045.orlgmj (mgr.34412) 11051 : cluster [DBG] pgmap v6302: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:38.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:38 gibba015 bash[29377]: cluster 2021-03-10T17:18:38.147509+0000 mgr.gibba045.orlgmj (mgr.34412) 11052 : cluster [DBG] pgmap v6303: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:38.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:38 gibba015 bash[29377]: audit 2021-03-10T17:18:38.292190+0000 mon.c (mon.1) 3028 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:18:38.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:38 gibba015 bash[29377]: audit 2021-03-10T17:18:38.471708+0000 mon.a (mon.0) 2340 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:18:38.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:38 gibba015 bash[29377]: cephadm 2021-03-10T17:18:38.474953+0000 mgr.gibba045.orlgmj (mgr.34412) 11053 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:18:38.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:38 gibba015 bash[30343]: cluster 2021-03-10T17:18:38.147509+0000 mgr.gibba045.orlgmj (mgr.34412) 11052 : cluster [DBG] pgmap v6303: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:38.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:38 gibba015 bash[30343]: audit 2021-03-10T17:18:38.292190+0000 mon.c (mon.1) 3028 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:18:38.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:38 gibba015 bash[30343]: audit 2021-03-10T17:18:38.471708+0000 mon.a (mon.0) 2340 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:18:38.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:38 gibba015 bash[30343]: cephadm 2021-03-10T17:18:38.474953+0000 mgr.gibba045.orlgmj (mgr.34412) 11053 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:18:39.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:38 gibba045 bash[25517]: cluster 2021-03-10T17:18:38.147509+0000 mgr.gibba045.orlgmj (mgr.34412) 11052 : cluster [DBG] pgmap v6303: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:39.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:38 gibba045 bash[25517]: audit 2021-03-10T17:18:38.292190+0000 mon.c (mon.1) 3028 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:18:39.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:38 gibba045 bash[25517]: audit 2021-03-10T17:18:38.471708+0000 mon.a (mon.0) 2340 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:18:39.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:38 gibba045 bash[25517]: cephadm 2021-03-10T17:18:38.474953+0000 mgr.gibba045.orlgmj (mgr.34412) 11053 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:18:39.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:39 gibba015 bash[29377]: audit 2021-03-10T17:18:38.656158+0000 mon.a (mon.0) 2341 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:18:39.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:39 gibba015 bash[29377]: audit 2021-03-10T17:18:38.659648+0000 mon.c (mon.1) 3029 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:18:39.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:39 gibba015 bash[29377]: cephadm 2021-03-10T17:18:38.660941+0000 mgr.gibba045.orlgmj (mgr.34412) 11054 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:18:39.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:39 gibba015 bash[29377]: audit 2021-03-10T17:18:38.661151+0000 mon.c (mon.1) 3030 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:18:39.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:39 gibba015 bash[29377]: audit 2021-03-10T17:18:38.662422+0000 mon.c (mon.1) 3031 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:18:39.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:39 gibba015 bash[29377]: cephadm 2021-03-10T17:18:38.662700+0000 mgr.gibba045.orlgmj (mgr.34412) 11055 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:18:39.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:39 gibba015 bash[29377]: audit 2021-03-10T17:18:38.663356+0000 mon.c (mon.1) 3032 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:18:39.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:39 gibba015 bash[29377]: cephadm 2021-03-10T17:18:38.663997+0000 mgr.gibba045.orlgmj (mgr.34412) 11056 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:18:39.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:39 gibba015 bash[29377]: cephadm 2021-03-10T17:18:38.664036+0000 mgr.gibba045.orlgmj (mgr.34412) 11057 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:18:39.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:39 gibba015 bash[29377]: cephadm 2021-03-10T17:18:38.665118+0000 mgr.gibba045.orlgmj (mgr.34412) 11058 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:18:39.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:39 gibba015 bash[29377]: cephadm 2021-03-10T17:18:38.665157+0000 mgr.gibba045.orlgmj (mgr.34412) 11059 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:18:39.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:39 gibba015 bash[29377]: audit 2021-03-10T17:18:38.665801+0000 mon.c (mon.1) 3033 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:18:39.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:39 gibba015 bash[29377]: cephadm 2021-03-10T17:18:38.666001+0000 mgr.gibba045.orlgmj (mgr.34412) 11060 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:18:39.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:39 gibba015 bash[29377]: audit 2021-03-10T17:18:38.667169+0000 mon.c (mon.1) 3034 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:18:39.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:39 gibba015 bash[29377]: cephadm 2021-03-10T17:18:38.667369+0000 mgr.gibba045.orlgmj (mgr.34412) 11061 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:18:39.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:39 gibba015 bash[29377]: cephadm 2021-03-10T17:18:38.667407+0000 mgr.gibba045.orlgmj (mgr.34412) 11062 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:18:39.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:39 gibba015 bash[29377]: cephadm 2021-03-10T17:18:38.668513+0000 mgr.gibba045.orlgmj (mgr.34412) 11063 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:18:39.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:39 gibba015 bash[29377]: cephadm 2021-03-10T17:18:38.668845+0000 mgr.gibba045.orlgmj (mgr.34412) 11064 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:18:39.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:39 gibba015 bash[29377]: cephadm 2021-03-10T17:18:38.670263+0000 mgr.gibba045.orlgmj (mgr.34412) 11065 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:18:39.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:39 gibba015 bash[29377]: cephadm 2021-03-10T17:18:38.670301+0000 mgr.gibba045.orlgmj (mgr.34412) 11066 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:18:39.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:39 gibba015 bash[29377]: cephadm 2021-03-10T17:18:38.670415+0000 mgr.gibba045.orlgmj (mgr.34412) 11067 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:18:39.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:39 gibba015 bash[30343]: audit 2021-03-10T17:18:38.656158+0000 mon.a (mon.0) 2341 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:18:39.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:39 gibba015 bash[30343]: audit 2021-03-10T17:18:38.659648+0000 mon.c (mon.1) 3029 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:18:39.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:39 gibba015 bash[30343]: cephadm 2021-03-10T17:18:38.660941+0000 mgr.gibba045.orlgmj (mgr.34412) 11054 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:18:39.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:39 gibba015 bash[30343]: audit 2021-03-10T17:18:38.661151+0000 mon.c (mon.1) 3030 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:18:39.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:39 gibba015 bash[30343]: audit 2021-03-10T17:18:38.662422+0000 mon.c (mon.1) 3031 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:18:39.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:39 gibba015 bash[30343]: cephadm 2021-03-10T17:18:38.662700+0000 mgr.gibba045.orlgmj (mgr.34412) 11055 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:18:39.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:39 gibba015 bash[30343]: audit 2021-03-10T17:18:38.663356+0000 mon.c (mon.1) 3032 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:18:39.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:39 gibba015 bash[30343]: cephadm 2021-03-10T17:18:38.663997+0000 mgr.gibba045.orlgmj (mgr.34412) 11056 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:18:39.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:39 gibba015 bash[30343]: cephadm 2021-03-10T17:18:38.664036+0000 mgr.gibba045.orlgmj (mgr.34412) 11057 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:18:39.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:39 gibba015 bash[30343]: cephadm 2021-03-10T17:18:38.665118+0000 mgr.gibba045.orlgmj (mgr.34412) 11058 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:18:39.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:39 gibba015 bash[30343]: cephadm 2021-03-10T17:18:38.665157+0000 mgr.gibba045.orlgmj (mgr.34412) 11059 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:18:39.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:39 gibba015 bash[30343]: audit 2021-03-10T17:18:38.665801+0000 mon.c (mon.1) 3033 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:18:39.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:39 gibba015 bash[30343]: cephadm 2021-03-10T17:18:38.666001+0000 mgr.gibba045.orlgmj (mgr.34412) 11060 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:18:39.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:39 gibba015 bash[30343]: audit 2021-03-10T17:18:38.667169+0000 mon.c (mon.1) 3034 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:18:39.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:39 gibba015 bash[30343]: cephadm 2021-03-10T17:18:38.667369+0000 mgr.gibba045.orlgmj (mgr.34412) 11061 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:18:39.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:39 gibba015 bash[30343]: cephadm 2021-03-10T17:18:38.667407+0000 mgr.gibba045.orlgmj (mgr.34412) 11062 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:18:39.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:39 gibba015 bash[30343]: cephadm 2021-03-10T17:18:38.668513+0000 mgr.gibba045.orlgmj (mgr.34412) 11063 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:18:39.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:39 gibba015 bash[30343]: cephadm 2021-03-10T17:18:38.668845+0000 mgr.gibba045.orlgmj (mgr.34412) 11064 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:18:39.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:39 gibba015 bash[30343]: cephadm 2021-03-10T17:18:38.670263+0000 mgr.gibba045.orlgmj (mgr.34412) 11065 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:18:39.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:39 gibba015 bash[30343]: cephadm 2021-03-10T17:18:38.670301+0000 mgr.gibba045.orlgmj (mgr.34412) 11066 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:18:39.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:39 gibba015 bash[30343]: cephadm 2021-03-10T17:18:38.670415+0000 mgr.gibba045.orlgmj (mgr.34412) 11067 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:18:40.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:39 gibba045 bash[25517]: audit 2021-03-10T17:18:38.656158+0000 mon.a (mon.0) 2341 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:18:40.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:39 gibba045 bash[25517]: audit 2021-03-10T17:18:38.659648+0000 mon.c (mon.1) 3029 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:18:40.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:39 gibba045 bash[25517]: cephadm 2021-03-10T17:18:38.660941+0000 mgr.gibba045.orlgmj (mgr.34412) 11054 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:18:40.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:39 gibba045 bash[25517]: audit 2021-03-10T17:18:38.661151+0000 mon.c (mon.1) 3030 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:18:40.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:39 gibba045 bash[25517]: audit 2021-03-10T17:18:38.662422+0000 mon.c (mon.1) 3031 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:18:40.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:39 gibba045 bash[25517]: cephadm 2021-03-10T17:18:38.662700+0000 mgr.gibba045.orlgmj (mgr.34412) 11055 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:18:40.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:39 gibba045 bash[25517]: audit 2021-03-10T17:18:38.663356+0000 mon.c (mon.1) 3032 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:18:40.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:39 gibba045 bash[25517]: cephadm 2021-03-10T17:18:38.663997+0000 mgr.gibba045.orlgmj (mgr.34412) 11056 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:18:40.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:39 gibba045 bash[25517]: cephadm 2021-03-10T17:18:38.664036+0000 mgr.gibba045.orlgmj (mgr.34412) 11057 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:18:40.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:39 gibba045 bash[25517]: cephadm 2021-03-10T17:18:38.665118+0000 mgr.gibba045.orlgmj (mgr.34412) 11058 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:18:40.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:39 gibba045 bash[25517]: cephadm 2021-03-10T17:18:38.665157+0000 mgr.gibba045.orlgmj (mgr.34412) 11059 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:18:40.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:39 gibba045 bash[25517]: audit 2021-03-10T17:18:38.665801+0000 mon.c (mon.1) 3033 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:18:40.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:39 gibba045 bash[25517]: cephadm 2021-03-10T17:18:38.666001+0000 mgr.gibba045.orlgmj (mgr.34412) 11060 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:18:40.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:39 gibba045 bash[25517]: audit 2021-03-10T17:18:38.667169+0000 mon.c (mon.1) 3034 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:18:40.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:39 gibba045 bash[25517]: cephadm 2021-03-10T17:18:38.667369+0000 mgr.gibba045.orlgmj (mgr.34412) 11061 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:18:40.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:39 gibba045 bash[25517]: cephadm 2021-03-10T17:18:38.667407+0000 mgr.gibba045.orlgmj (mgr.34412) 11062 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:18:40.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:39 gibba045 bash[25517]: cephadm 2021-03-10T17:18:38.668513+0000 mgr.gibba045.orlgmj (mgr.34412) 11063 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:18:40.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:39 gibba045 bash[25517]: cephadm 2021-03-10T17:18:38.668845+0000 mgr.gibba045.orlgmj (mgr.34412) 11064 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:18:40.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:39 gibba045 bash[25517]: cephadm 2021-03-10T17:18:38.670263+0000 mgr.gibba045.orlgmj (mgr.34412) 11065 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:18:40.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:39 gibba045 bash[25517]: cephadm 2021-03-10T17:18:38.670301+0000 mgr.gibba045.orlgmj (mgr.34412) 11066 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:18:40.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:39 gibba045 bash[25517]: cephadm 2021-03-10T17:18:38.670415+0000 mgr.gibba045.orlgmj (mgr.34412) 11067 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:18:40.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:40 gibba015 bash[29377]: cluster 2021-03-10T17:18:40.149075+0000 mgr.gibba045.orlgmj (mgr.34412) 11068 : cluster [DBG] pgmap v6304: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:40.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:40 gibba015 bash[30343]: cluster 2021-03-10T17:18:40.149075+0000 mgr.gibba045.orlgmj (mgr.34412) 11068 : cluster [DBG] pgmap v6304: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:41.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:40 gibba045 bash[25517]: cluster 2021-03-10T17:18:40.149075+0000 mgr.gibba045.orlgmj (mgr.34412) 11068 : cluster [DBG] pgmap v6304: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:43.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:43 gibba015 bash[29377]: cluster 2021-03-10T17:18:42.149736+0000 mgr.gibba045.orlgmj (mgr.34412) 11069 : cluster [DBG] pgmap v6305: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:43.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:43 gibba015 bash[30343]: cluster 2021-03-10T17:18:42.149736+0000 mgr.gibba045.orlgmj (mgr.34412) 11069 : cluster [DBG] pgmap v6305: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:43.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:43 gibba045 bash[25517]: cluster 2021-03-10T17:18:42.149736+0000 mgr.gibba045.orlgmj (mgr.34412) 11069 : cluster [DBG] pgmap v6305: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:45.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:45 gibba015 bash[29377]: cluster 2021-03-10T17:18:44.150860+0000 mgr.gibba045.orlgmj (mgr.34412) 11070 : cluster [DBG] pgmap v6306: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:45.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:45 gibba015 bash[30343]: cluster 2021-03-10T17:18:44.150860+0000 mgr.gibba045.orlgmj (mgr.34412) 11070 : cluster [DBG] pgmap v6306: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:45.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:45 gibba045 bash[25517]: cluster 2021-03-10T17:18:44.150860+0000 mgr.gibba045.orlgmj (mgr.34412) 11070 : cluster [DBG] pgmap v6306: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:47.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:47 gibba045 bash[25517]: cluster 2021-03-10T17:18:46.152694+0000 mgr.gibba045.orlgmj (mgr.34412) 11071 : cluster [DBG] pgmap v6307: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:47.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:47 gibba015 bash[29377]: cluster 2021-03-10T17:18:46.152694+0000 mgr.gibba045.orlgmj (mgr.34412) 11071 : cluster [DBG] pgmap v6307: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:47.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:47 gibba015 bash[30343]: cluster 2021-03-10T17:18:46.152694+0000 mgr.gibba045.orlgmj (mgr.34412) 11071 : cluster [DBG] pgmap v6307: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:48.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:48 gibba015 bash[29377]: cluster 2021-03-10T17:18:48.154057+0000 mgr.gibba045.orlgmj (mgr.34412) 11072 : cluster [DBG] pgmap v6308: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:48.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:48 gibba015 bash[30343]: cluster 2021-03-10T17:18:48.154057+0000 mgr.gibba045.orlgmj (mgr.34412) 11072 : cluster [DBG] pgmap v6308: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:49.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:48 gibba045 bash[25517]: cluster 2021-03-10T17:18:48.154057+0000 mgr.gibba045.orlgmj (mgr.34412) 11072 : cluster [DBG] pgmap v6308: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:51.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:51 gibba015 bash[29377]: cluster 2021-03-10T17:18:50.155689+0000 mgr.gibba045.orlgmj (mgr.34412) 11073 : cluster [DBG] pgmap v6309: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:51.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:51 gibba015 bash[30343]: cluster 2021-03-10T17:18:50.155689+0000 mgr.gibba045.orlgmj (mgr.34412) 11073 : cluster [DBG] pgmap v6309: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:51.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:51 gibba045 bash[25517]: cluster 2021-03-10T17:18:50.155689+0000 mgr.gibba045.orlgmj (mgr.34412) 11073 : cluster [DBG] pgmap v6309: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:53.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:53 gibba045 bash[25517]: cluster 2021-03-10T17:18:52.157683+0000 mgr.gibba045.orlgmj (mgr.34412) 11074 : cluster [DBG] pgmap v6310: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:53.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:53 gibba015 bash[29377]: cluster 2021-03-10T17:18:52.157683+0000 mgr.gibba045.orlgmj (mgr.34412) 11074 : cluster [DBG] pgmap v6310: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:53.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:53 gibba015 bash[30343]: cluster 2021-03-10T17:18:52.157683+0000 mgr.gibba045.orlgmj (mgr.34412) 11074 : cluster [DBG] pgmap v6310: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:54 gibba045 bash[25517]: audit 2021-03-10T17:18:53.979894+0000 mon.c (mon.1) 3035 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:18:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:54 gibba045 bash[25517]: audit 2021-03-10T17:18:53.980581+0000 mon.c (mon.1) 3036 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:18:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:54 gibba045 bash[25517]: audit 2021-03-10T17:18:53.981164+0000 mon.a (mon.0) 2342 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:18:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:54 gibba045 bash[25517]: audit 2021-03-10T17:18:53.982567+0000 mon.a (mon.0) 2343 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:18:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:54 gibba045 bash[25517]: audit 2021-03-10T17:18:54.074938+0000 mon.c (mon.1) 3037 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T17:18:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:54 gibba045 bash[25517]: audit 2021-03-10T17:18:54.075707+0000 mon.c (mon.1) 3038 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T17:18:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:54 gibba045 bash[25517]: audit 2021-03-10T17:18:54.076317+0000 mon.a (mon.0) 2344 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T17:18:54.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:54 gibba045 bash[25517]: audit 2021-03-10T17:18:54.076831+0000 mon.c (mon.1) 3039 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:18:54.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:54 gibba045 bash[25517]: audit 2021-03-10T17:18:54.078310+0000 mon.c (mon.1) 3040 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:18:54.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:54 gibba045 bash[25517]: audit 2021-03-10T17:18:54.078921+0000 mon.a (mon.0) 2345 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T17:18:54.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:54 gibba045 bash[25517]: audit 2021-03-10T17:18:54.080489+0000 mon.a (mon.0) 2346 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:18:54.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:54 gibba045 bash[25517]: audit 2021-03-10T17:18:54.080904+0000 mon.a (mon.0) 2347 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:18:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:54 gibba015 bash[29377]: audit 2021-03-10T17:18:53.979894+0000 mon.c (mon.1) 3035 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:18:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:54 gibba015 bash[29377]: audit 2021-03-10T17:18:53.980581+0000 mon.c (mon.1) 3036 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:18:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:54 gibba015 bash[29377]: audit 2021-03-10T17:18:53.981164+0000 mon.a (mon.0) 2342 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:18:54.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:54 gibba015 bash[29377]: audit 2021-03-10T17:18:53.982567+0000 mon.a (mon.0) 2343 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:18:54.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:54 gibba015 bash[29377]: audit 2021-03-10T17:18:54.074938+0000 mon.c (mon.1) 3037 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T17:18:54.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:54 gibba015 bash[29377]: audit 2021-03-10T17:18:54.075707+0000 mon.c (mon.1) 3038 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T17:18:54.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:54 gibba015 bash[29377]: audit 2021-03-10T17:18:54.076317+0000 mon.a (mon.0) 2344 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T17:18:54.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:54 gibba015 bash[29377]: audit 2021-03-10T17:18:54.076831+0000 mon.c (mon.1) 3039 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:18:54.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:54 gibba015 bash[29377]: audit 2021-03-10T17:18:54.078310+0000 mon.c (mon.1) 3040 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:18:54.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:54 gibba015 bash[29377]: audit 2021-03-10T17:18:54.078921+0000 mon.a (mon.0) 2345 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T17:18:54.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:54 gibba015 bash[29377]: audit 2021-03-10T17:18:54.080489+0000 mon.a (mon.0) 2346 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:18:54.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:54 gibba015 bash[29377]: audit 2021-03-10T17:18:54.080904+0000 mon.a (mon.0) 2347 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:18:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:54 gibba015 bash[30343]: audit 2021-03-10T17:18:53.979894+0000 mon.c (mon.1) 3035 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:18:54.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:54 gibba015 bash[30343]: audit 2021-03-10T17:18:53.980581+0000 mon.c (mon.1) 3036 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:18:54.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:54 gibba015 bash[30343]: audit 2021-03-10T17:18:53.981164+0000 mon.a (mon.0) 2342 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:18:54.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:54 gibba015 bash[30343]: audit 2021-03-10T17:18:53.982567+0000 mon.a (mon.0) 2343 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:18:54.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:54 gibba015 bash[30343]: audit 2021-03-10T17:18:54.074938+0000 mon.c (mon.1) 3037 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T17:18:54.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:54 gibba015 bash[30343]: audit 2021-03-10T17:18:54.075707+0000 mon.c (mon.1) 3038 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T17:18:54.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:54 gibba015 bash[30343]: audit 2021-03-10T17:18:54.076317+0000 mon.a (mon.0) 2344 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T17:18:54.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:54 gibba015 bash[30343]: audit 2021-03-10T17:18:54.076831+0000 mon.c (mon.1) 3039 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:18:54.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:54 gibba015 bash[30343]: audit 2021-03-10T17:18:54.078310+0000 mon.c (mon.1) 3040 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:18:54.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:54 gibba015 bash[30343]: audit 2021-03-10T17:18:54.078921+0000 mon.a (mon.0) 2345 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T17:18:54.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:54 gibba015 bash[30343]: audit 2021-03-10T17:18:54.080489+0000 mon.a (mon.0) 2346 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:18:54.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:54 gibba015 bash[30343]: audit 2021-03-10T17:18:54.080904+0000 mon.a (mon.0) 2347 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:18:55.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:55 gibba045 bash[25517]: cephadm 2021-03-10T17:18:53.686457+0000 mgr.gibba045.orlgmj (mgr.34412) 11075 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:18:55.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:55 gibba045 bash[25517]: cluster 2021-03-10T17:18:54.158452+0000 mgr.gibba045.orlgmj (mgr.34412) 11076 : cluster [DBG] pgmap v6311: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:55.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:55 gibba015 bash[29377]: cephadm 2021-03-10T17:18:53.686457+0000 mgr.gibba045.orlgmj (mgr.34412) 11075 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:18:55.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:55 gibba015 bash[29377]: cluster 2021-03-10T17:18:54.158452+0000 mgr.gibba045.orlgmj (mgr.34412) 11076 : cluster [DBG] pgmap v6311: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:55.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:55 gibba015 bash[30343]: cephadm 2021-03-10T17:18:53.686457+0000 mgr.gibba045.orlgmj (mgr.34412) 11075 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:18:55.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:55 gibba015 bash[30343]: cluster 2021-03-10T17:18:54.158452+0000 mgr.gibba045.orlgmj (mgr.34412) 11076 : cluster [DBG] pgmap v6311: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:57.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:57 gibba045 bash[25517]: cluster 2021-03-10T17:18:56.160130+0000 mgr.gibba045.orlgmj (mgr.34412) 11077 : cluster [DBG] pgmap v6312: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:57.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:57 gibba015 bash[29377]: cluster 2021-03-10T17:18:56.160130+0000 mgr.gibba045.orlgmj (mgr.34412) 11077 : cluster [DBG] pgmap v6312: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:57.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:57 gibba015 bash[30343]: cluster 2021-03-10T17:18:56.160130+0000 mgr.gibba045.orlgmj (mgr.34412) 11077 : cluster [DBG] pgmap v6312: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:58.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:18:58 gibba015 bash[29377]: cluster 2021-03-10T17:18:58.161769+0000 mgr.gibba045.orlgmj (mgr.34412) 11078 : cluster [DBG] pgmap v6313: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:58.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:18:58 gibba015 bash[30343]: cluster 2021-03-10T17:18:58.161769+0000 mgr.gibba045.orlgmj (mgr.34412) 11078 : cluster [DBG] pgmap v6313: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:59.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:18:58 gibba045 bash[25517]: cluster 2021-03-10T17:18:58.161769+0000 mgr.gibba045.orlgmj (mgr.34412) 11078 : cluster [DBG] pgmap v6313: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:01.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:19:01 gibba045 bash[25517]: cluster 2021-03-10T17:19:00.162515+0000 mgr.gibba045.orlgmj (mgr.34412) 11079 : cluster [DBG] pgmap v6314: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:01.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:19:01 gibba015 bash[29377]: cluster 2021-03-10T17:19:00.162515+0000 mgr.gibba045.orlgmj (mgr.34412) 11079 : cluster [DBG] pgmap v6314: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:01.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:19:01 gibba015 bash[30343]: cluster 2021-03-10T17:19:00.162515+0000 mgr.gibba045.orlgmj (mgr.34412) 11079 : cluster [DBG] pgmap v6314: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:03.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:19:03 gibba045 bash[25517]: cluster 2021-03-10T17:19:02.164174+0000 mgr.gibba045.orlgmj (mgr.34412) 11080 : cluster [DBG] pgmap v6315: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:03.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:19:03 gibba015 bash[29377]: cluster 2021-03-10T17:19:02.164174+0000 mgr.gibba045.orlgmj (mgr.34412) 11080 : cluster [DBG] pgmap v6315: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:03.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:19:03 gibba015 bash[30343]: cluster 2021-03-10T17:19:02.164174+0000 mgr.gibba045.orlgmj (mgr.34412) 11080 : cluster [DBG] pgmap v6315: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:05.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:19:05 gibba045 bash[25517]: cluster 2021-03-10T17:19:04.165407+0000 mgr.gibba045.orlgmj (mgr.34412) 11081 : cluster [DBG] pgmap v6316: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:05.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:19:05 gibba015 bash[29377]: cluster 2021-03-10T17:19:04.165407+0000 mgr.gibba045.orlgmj (mgr.34412) 11081 : cluster [DBG] pgmap v6316: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:05.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:19:05 gibba015 bash[30343]: cluster 2021-03-10T17:19:04.165407+0000 mgr.gibba045.orlgmj (mgr.34412) 11081 : cluster [DBG] pgmap v6316: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:06.334 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:19:06.562 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:19:06.562 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 96s ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:19:06.563 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 32s ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:19:06.563 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 32s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:19:06.563 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 32s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:19:06.563 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 96s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:19:06.563 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 96s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:19:06.564 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 32s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:19:06.564 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 96s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:19:06.564 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 96s ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:19:06.564 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 32s ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:19:06.565 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 96s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:19:06.565 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 96s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:19:06.565 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 96s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:19:06.565 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 96s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:19:06.565 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 32s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:19:06.566 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 32s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:19:06.566 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 32s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:19:06.566 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 32s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:19:06.566 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 32s ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:19:06.567 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 32s ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:19:06.809 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:19:06.810 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:19:06.810 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:19:06.810 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:19:06.810 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:19:06.811 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:19:06.811 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:19:06.811 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:19:06.811 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:19:06.812 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:19:06.812 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:19:06.812 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:19:06.812 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:19:06.813 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:19:06.813 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:19:07.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:19:07 gibba045 bash[25517]: cluster 2021-03-10T17:19:06.166222+0000 mgr.gibba045.orlgmj (mgr.34412) 11082 : cluster [DBG] pgmap v6317: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:07.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:19:07 gibba045 bash[25517]: audit 2021-03-10T17:19:06.326033+0000 mgr.gibba045.orlgmj (mgr.34412) 11083 : audit [DBG] from='client.51486 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:19:07.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:19:07 gibba045 bash[25517]: audit 2021-03-10T17:19:06.550568+0000 mgr.gibba045.orlgmj (mgr.34412) 11084 : audit [DBG] from='client.61480 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:19:07.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:19:07 gibba045 bash[25517]: audit 2021-03-10T17:19:06.808150+0000 mon.c (mon.1) 3041 : audit [DBG] from='client.? 172.21.2.115:0/841641608' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:19:07.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:19:07 gibba015 bash[29377]: cluster 2021-03-10T17:19:06.166222+0000 mgr.gibba045.orlgmj (mgr.34412) 11082 : cluster [DBG] pgmap v6317: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:07.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:19:07 gibba015 bash[29377]: audit 2021-03-10T17:19:06.326033+0000 mgr.gibba045.orlgmj (mgr.34412) 11083 : audit [DBG] from='client.51486 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:19:07.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:19:07 gibba015 bash[29377]: audit 2021-03-10T17:19:06.550568+0000 mgr.gibba045.orlgmj (mgr.34412) 11084 : audit [DBG] from='client.61480 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:19:07.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:19:07 gibba015 bash[29377]: audit 2021-03-10T17:19:06.808150+0000 mon.c (mon.1) 3041 : audit [DBG] from='client.? 172.21.2.115:0/841641608' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:19:07.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:19:07 gibba015 bash[30343]: cluster 2021-03-10T17:19:06.166222+0000 mgr.gibba045.orlgmj (mgr.34412) 11082 : cluster [DBG] pgmap v6317: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:07.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:19:07 gibba015 bash[30343]: audit 2021-03-10T17:19:06.326033+0000 mgr.gibba045.orlgmj (mgr.34412) 11083 : audit [DBG] from='client.51486 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:19:07.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:19:07 gibba015 bash[30343]: audit 2021-03-10T17:19:06.550568+0000 mgr.gibba045.orlgmj (mgr.34412) 11084 : audit [DBG] from='client.61480 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:19:07.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:19:07 gibba015 bash[30343]: audit 2021-03-10T17:19:06.808150+0000 mon.c (mon.1) 3041 : audit [DBG] from='client.? 172.21.2.115:0/841641608' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:19:08.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:19:08 gibba015 bash[29377]: cluster 2021-03-10T17:19:08.167799+0000 mgr.gibba045.orlgmj (mgr.34412) 11085 : cluster [DBG] pgmap v6318: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:08.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:19:08 gibba015 bash[30343]: cluster 2021-03-10T17:19:08.167799+0000 mgr.gibba045.orlgmj (mgr.34412) 11085 : cluster [DBG] pgmap v6318: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:09.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:19:08 gibba045 bash[25517]: cluster 2021-03-10T17:19:08.167799+0000 mgr.gibba045.orlgmj (mgr.34412) 11085 : cluster [DBG] pgmap v6318: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:09.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:19:09 gibba015 bash[29377]: cephadm 2021-03-10T17:19:08.701348+0000 mgr.gibba045.orlgmj (mgr.34412) 11086 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:19:09.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:19:09 gibba015 bash[30343]: cephadm 2021-03-10T17:19:08.701348+0000 mgr.gibba045.orlgmj (mgr.34412) 11086 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:19:10.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:19:09 gibba045 bash[25517]: cephadm 2021-03-10T17:19:08.701348+0000 mgr.gibba045.orlgmj (mgr.34412) 11086 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:19:10.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:19:10 gibba015 bash[29377]: cluster 2021-03-10T17:19:10.169471+0000 mgr.gibba045.orlgmj (mgr.34412) 11087 : cluster [DBG] pgmap v6319: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:10.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:19:10 gibba015 bash[30343]: cluster 2021-03-10T17:19:10.169471+0000 mgr.gibba045.orlgmj (mgr.34412) 11087 : cluster [DBG] pgmap v6319: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:11.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:19:10 gibba045 bash[25517]: cluster 2021-03-10T17:19:10.169471+0000 mgr.gibba045.orlgmj (mgr.34412) 11087 : cluster [DBG] pgmap v6319: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:13.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:19:13 gibba045 bash[25517]: cluster 2021-03-10T17:19:12.170268+0000 mgr.gibba045.orlgmj (mgr.34412) 11088 : cluster [DBG] pgmap v6320: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:13.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:19:13 gibba015 bash[29377]: cluster 2021-03-10T17:19:12.170268+0000 mgr.gibba045.orlgmj (mgr.34412) 11088 : cluster [DBG] pgmap v6320: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:13.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:19:13 gibba015 bash[30343]: cluster 2021-03-10T17:19:12.170268+0000 mgr.gibba045.orlgmj (mgr.34412) 11088 : cluster [DBG] pgmap v6320: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:15.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:19:15 gibba045 bash[25517]: cluster 2021-03-10T17:19:14.171407+0000 mgr.gibba045.orlgmj (mgr.34412) 11089 : cluster [DBG] pgmap v6321: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:15.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:19:15 gibba015 bash[29377]: cluster 2021-03-10T17:19:14.171407+0000 mgr.gibba045.orlgmj (mgr.34412) 11089 : cluster [DBG] pgmap v6321: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:15.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:19:15 gibba015 bash[30343]: cluster 2021-03-10T17:19:14.171407+0000 mgr.gibba045.orlgmj (mgr.34412) 11089 : cluster [DBG] pgmap v6321: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:17.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:19:17 gibba045 bash[25517]: cluster 2021-03-10T17:19:16.173187+0000 mgr.gibba045.orlgmj (mgr.34412) 11090 : cluster [DBG] pgmap v6322: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:17.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:19:17 gibba015 bash[29377]: cluster 2021-03-10T17:19:16.173187+0000 mgr.gibba045.orlgmj (mgr.34412) 11090 : cluster [DBG] pgmap v6322: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:17.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:19:17 gibba015 bash[30343]: cluster 2021-03-10T17:19:16.173187+0000 mgr.gibba045.orlgmj (mgr.34412) 11090 : cluster [DBG] pgmap v6322: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:18.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:19:18 gibba015 bash[29377]: cluster 2021-03-10T17:19:18.174070+0000 mgr.gibba045.orlgmj (mgr.34412) 11091 : cluster [DBG] pgmap v6323: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:18.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:19:18 gibba015 bash[30343]: cluster 2021-03-10T17:19:18.174070+0000 mgr.gibba045.orlgmj (mgr.34412) 11091 : cluster [DBG] pgmap v6323: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:19.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:19:18 gibba045 bash[25517]: cluster 2021-03-10T17:19:18.174070+0000 mgr.gibba045.orlgmj (mgr.34412) 11091 : cluster [DBG] pgmap v6323: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:21.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:19:21 gibba045 bash[25517]: cluster 2021-03-10T17:19:20.175511+0000 mgr.gibba045.orlgmj (mgr.34412) 11092 : cluster [DBG] pgmap v6324: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:21.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:19:21 gibba015 bash[29377]: cluster 2021-03-10T17:19:20.175511+0000 mgr.gibba045.orlgmj (mgr.34412) 11092 : cluster [DBG] pgmap v6324: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:21.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:19:21 gibba015 bash[30343]: cluster 2021-03-10T17:19:20.175511+0000 mgr.gibba045.orlgmj (mgr.34412) 11092 : cluster [DBG] pgmap v6324: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:23.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:19:23 gibba045 bash[25517]: cluster 2021-03-10T17:19:22.177297+0000 mgr.gibba045.orlgmj (mgr.34412) 11093 : cluster [DBG] pgmap v6325: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:23.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:19:23 gibba015 bash[29377]: cluster 2021-03-10T17:19:22.177297+0000 mgr.gibba045.orlgmj (mgr.34412) 11093 : cluster [DBG] pgmap v6325: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:23.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:19:23 gibba015 bash[30343]: cluster 2021-03-10T17:19:22.177297+0000 mgr.gibba045.orlgmj (mgr.34412) 11093 : cluster [DBG] pgmap v6325: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:25.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:19:25 gibba045 bash[25517]: cephadm 2021-03-10T17:19:23.717278+0000 mgr.gibba045.orlgmj (mgr.34412) 11094 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:19:25.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:19:25 gibba045 bash[25517]: cluster 2021-03-10T17:19:24.177896+0000 mgr.gibba045.orlgmj (mgr.34412) 11095 : cluster [DBG] pgmap v6326: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:25.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:19:25 gibba015 bash[29377]: cephadm 2021-03-10T17:19:23.717278+0000 mgr.gibba045.orlgmj (mgr.34412) 11094 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:19:25.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:19:25 gibba015 bash[29377]: cluster 2021-03-10T17:19:24.177896+0000 mgr.gibba045.orlgmj (mgr.34412) 11095 : cluster [DBG] pgmap v6326: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:25.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:19:25 gibba015 bash[30343]: cephadm 2021-03-10T17:19:23.717278+0000 mgr.gibba045.orlgmj (mgr.34412) 11094 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:19:25.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:19:25 gibba015 bash[30343]: cluster 2021-03-10T17:19:24.177896+0000 mgr.gibba045.orlgmj (mgr.34412) 11095 : cluster [DBG] pgmap v6326: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:27.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:19:27 gibba045 bash[25517]: cluster 2021-03-10T17:19:26.179657+0000 mgr.gibba045.orlgmj (mgr.34412) 11096 : cluster [DBG] pgmap v6327: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:27.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:19:27 gibba015 bash[29377]: cluster 2021-03-10T17:19:26.179657+0000 mgr.gibba045.orlgmj (mgr.34412) 11096 : cluster [DBG] pgmap v6327: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:27.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:19:27 gibba015 bash[30343]: cluster 2021-03-10T17:19:26.179657+0000 mgr.gibba045.orlgmj (mgr.34412) 11096 : cluster [DBG] pgmap v6327: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:28.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:19:28 gibba015 bash[29377]: cluster 2021-03-10T17:19:28.181064+0000 mgr.gibba045.orlgmj (mgr.34412) 11097 : cluster [DBG] pgmap v6328: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:28.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:19:28 gibba015 bash[30343]: cluster 2021-03-10T17:19:28.181064+0000 mgr.gibba045.orlgmj (mgr.34412) 11097 : cluster [DBG] pgmap v6328: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:29.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:19:28 gibba045 bash[25517]: cluster 2021-03-10T17:19:28.181064+0000 mgr.gibba045.orlgmj (mgr.34412) 11097 : cluster [DBG] pgmap v6328: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:31.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:19:31 gibba045 bash[25517]: cluster 2021-03-10T17:19:30.181738+0000 mgr.gibba045.orlgmj (mgr.34412) 11098 : cluster [DBG] pgmap v6329: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:31.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:19:31 gibba015 bash[29377]: cluster 2021-03-10T17:19:30.181738+0000 mgr.gibba045.orlgmj (mgr.34412) 11098 : cluster [DBG] pgmap v6329: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:31.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:19:31 gibba015 bash[30343]: cluster 2021-03-10T17:19:30.181738+0000 mgr.gibba045.orlgmj (mgr.34412) 11098 : cluster [DBG] pgmap v6329: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:33.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:19:33 gibba045 bash[25517]: cluster 2021-03-10T17:19:32.183311+0000 mgr.gibba045.orlgmj (mgr.34412) 11099 : cluster [DBG] pgmap v6330: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:33.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:19:33 gibba015 bash[29377]: cluster 2021-03-10T17:19:32.183311+0000 mgr.gibba045.orlgmj (mgr.34412) 11099 : cluster [DBG] pgmap v6330: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:33.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:19:33 gibba015 bash[30343]: cluster 2021-03-10T17:19:32.183311+0000 mgr.gibba045.orlgmj (mgr.34412) 11099 : cluster [DBG] pgmap v6330: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:35.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:19:35 gibba045 bash[25517]: cluster 2021-03-10T17:19:34.184578+0000 mgr.gibba045.orlgmj (mgr.34412) 11100 : cluster [DBG] pgmap v6331: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:35.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:19:35 gibba015 bash[29377]: cluster 2021-03-10T17:19:34.184578+0000 mgr.gibba045.orlgmj (mgr.34412) 11100 : cluster [DBG] pgmap v6331: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:35.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:19:35 gibba015 bash[30343]: cluster 2021-03-10T17:19:34.184578+0000 mgr.gibba045.orlgmj (mgr.34412) 11100 : cluster [DBG] pgmap v6331: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:37.051 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:19:37.282 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:19:37.282 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 2m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:19:37.282 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 63s ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:19:37.283 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 63s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:19:37.283 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 63s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:19:37.283 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:19:37.283 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:19:37.284 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 63s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:19:37.284 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:19:37.284 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 2m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:19:37.284 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 63s ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:19:37.285 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:19:37.285 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:19:37.285 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:19:37.285 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:19:37.285 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 63s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:19:37.286 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 63s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:19:37.286 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 63s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:19:37.286 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 63s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:19:37.286 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 63s ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:19:37.287 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 63s ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:19:37.531 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:19:37.531 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:19:37.531 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:19:37.531 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:19:37.532 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:19:37.532 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:19:37.532 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:19:37.532 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:19:37.533 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:19:37.533 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:19:37.533 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:19:37.533 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:19:37.534 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:19:37.534 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:19:37.534 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:19:37.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:19:37 gibba045 bash[25517]: cluster 2021-03-10T17:19:36.185619+0000 mgr.gibba045.orlgmj (mgr.34412) 11101 : cluster [DBG] pgmap v6332: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:37.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:19:37 gibba015 bash[29377]: cluster 2021-03-10T17:19:36.185619+0000 mgr.gibba045.orlgmj (mgr.34412) 11101 : cluster [DBG] pgmap v6332: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:37.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:19:37 gibba015 bash[30343]: cluster 2021-03-10T17:19:36.185619+0000 mgr.gibba045.orlgmj (mgr.34412) 11101 : cluster [DBG] pgmap v6332: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:38.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:19:38 gibba045 bash[25517]: audit 2021-03-10T17:19:37.043101+0000 mgr.gibba045.orlgmj (mgr.34412) 11102 : audit [DBG] from='client.51504 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:19:38.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:19:38 gibba045 bash[25517]: audit 2021-03-10T17:19:37.269358+0000 mgr.gibba045.orlgmj (mgr.34412) 11103 : audit [DBG] from='client.51510 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:19:38.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:19:38 gibba045 bash[25517]: audit 2021-03-10T17:19:37.529470+0000 mon.c (mon.1) 3042 : audit [DBG] from='client.? 172.21.2.115:0/3993791598' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:19:38.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:19:38 gibba015 bash[29377]: audit 2021-03-10T17:19:37.043101+0000 mgr.gibba045.orlgmj (mgr.34412) 11102 : audit [DBG] from='client.51504 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:19:38.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:19:38 gibba015 bash[29377]: audit 2021-03-10T17:19:37.269358+0000 mgr.gibba045.orlgmj (mgr.34412) 11103 : audit [DBG] from='client.51510 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:19:38.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:19:38 gibba015 bash[29377]: audit 2021-03-10T17:19:37.529470+0000 mon.c (mon.1) 3042 : audit [DBG] from='client.? 172.21.2.115:0/3993791598' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:19:38.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:19:38 gibba015 bash[30343]: audit 2021-03-10T17:19:37.043101+0000 mgr.gibba045.orlgmj (mgr.34412) 11102 : audit [DBG] from='client.51504 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:19:38.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:19:38 gibba015 bash[30343]: audit 2021-03-10T17:19:37.269358+0000 mgr.gibba045.orlgmj (mgr.34412) 11103 : audit [DBG] from='client.51510 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:19:38.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:19:38 gibba015 bash[30343]: audit 2021-03-10T17:19:37.529470+0000 mon.c (mon.1) 3042 : audit [DBG] from='client.? 172.21.2.115:0/3993791598' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:19:39.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:19:39 gibba045 bash[25517]: cluster 2021-03-10T17:19:38.187145+0000 mgr.gibba045.orlgmj (mgr.34412) 11104 : cluster [DBG] pgmap v6333: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:39.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:19:39 gibba045 bash[25517]: audit 2021-03-10T17:19:38.731795+0000 mon.c (mon.1) 3043 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:19:39.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:19:39 gibba045 bash[25517]: audit 2021-03-10T17:19:38.951731+0000 mon.a (mon.0) 2348 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:19:39.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:19:39 gibba045 bash[25517]: audit 2021-03-10T17:19:38.955496+0000 mon.c (mon.1) 3044 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:19:39.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:19:39 gibba045 bash[25517]: audit 2021-03-10T17:19:38.957165+0000 mon.c (mon.1) 3045 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:19:39.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:19:39 gibba045 bash[25517]: audit 2021-03-10T17:19:38.958728+0000 mon.c (mon.1) 3046 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:19:39.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:19:39 gibba045 bash[25517]: audit 2021-03-10T17:19:38.960211+0000 mon.c (mon.1) 3047 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:19:39.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:19:39 gibba045 bash[25517]: audit 2021-03-10T17:19:38.963449+0000 mon.c (mon.1) 3048 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:19:39.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:19:39 gibba045 bash[25517]: audit 2021-03-10T17:19:38.964985+0000 mon.c (mon.1) 3049 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:19:39.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:19:39 gibba015 bash[29377]: cluster 2021-03-10T17:19:38.187145+0000 mgr.gibba045.orlgmj (mgr.34412) 11104 : cluster [DBG] pgmap v6333: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:39.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:19:39 gibba015 bash[29377]: audit 2021-03-10T17:19:38.731795+0000 mon.c (mon.1) 3043 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:19:39.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:19:39 gibba015 bash[29377]: audit 2021-03-10T17:19:38.951731+0000 mon.a (mon.0) 2348 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:19:39.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:19:39 gibba015 bash[29377]: audit 2021-03-10T17:19:38.955496+0000 mon.c (mon.1) 3044 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:19:39.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:19:39 gibba015 bash[29377]: audit 2021-03-10T17:19:38.957165+0000 mon.c (mon.1) 3045 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:19:39.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:19:39 gibba015 bash[29377]: audit 2021-03-10T17:19:38.958728+0000 mon.c (mon.1) 3046 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:19:39.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:19:39 gibba015 bash[29377]: audit 2021-03-10T17:19:38.960211+0000 mon.c (mon.1) 3047 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:19:39.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:19:39 gibba015 bash[29377]: audit 2021-03-10T17:19:38.963449+0000 mon.c (mon.1) 3048 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:19:39.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:19:39 gibba015 bash[29377]: audit 2021-03-10T17:19:38.964985+0000 mon.c (mon.1) 3049 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:19:39.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:19:39 gibba015 bash[30343]: cluster 2021-03-10T17:19:38.187145+0000 mgr.gibba045.orlgmj (mgr.34412) 11104 : cluster [DBG] pgmap v6333: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:39.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:19:39 gibba015 bash[30343]: audit 2021-03-10T17:19:38.731795+0000 mon.c (mon.1) 3043 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:19:39.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:19:39 gibba015 bash[30343]: audit 2021-03-10T17:19:38.951731+0000 mon.a (mon.0) 2348 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:19:39.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:19:39 gibba015 bash[30343]: audit 2021-03-10T17:19:38.955496+0000 mon.c (mon.1) 3044 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:19:39.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:19:39 gibba015 bash[30343]: audit 2021-03-10T17:19:38.957165+0000 mon.c (mon.1) 3045 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:19:39.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:19:39 gibba015 bash[30343]: audit 2021-03-10T17:19:38.958728+0000 mon.c (mon.1) 3046 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:19:39.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:19:39 gibba015 bash[30343]: audit 2021-03-10T17:19:38.960211+0000 mon.c (mon.1) 3047 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:19:39.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:19:39 gibba015 bash[30343]: audit 2021-03-10T17:19:38.963449+0000 mon.c (mon.1) 3048 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:19:39.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:19:39 gibba015 bash[30343]: audit 2021-03-10T17:19:38.964985+0000 mon.c (mon.1) 3049 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:19:40.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:19:40 gibba045 bash[25517]: cephadm 2021-03-10T17:19:38.738649+0000 mgr.gibba045.orlgmj (mgr.34412) 11105 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:19:40.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:19:40 gibba045 bash[25517]: cephadm 2021-03-10T17:19:38.740399+0000 mgr.gibba045.orlgmj (mgr.34412) 11106 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:19:40.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:19:40 gibba045 bash[25517]: cephadm 2021-03-10T17:19:38.956819+0000 mgr.gibba045.orlgmj (mgr.34412) 11107 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:19:40.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:19:40 gibba045 bash[25517]: cephadm 2021-03-10T17:19:38.958620+0000 mgr.gibba045.orlgmj (mgr.34412) 11108 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:19:40.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:19:40 gibba045 bash[25517]: cephadm 2021-03-10T17:19:38.960154+0000 mgr.gibba045.orlgmj (mgr.34412) 11109 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:19:40.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:19:40 gibba045 bash[25517]: cephadm 2021-03-10T17:19:38.960198+0000 mgr.gibba045.orlgmj (mgr.34412) 11110 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:19:40.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:19:40 gibba045 bash[25517]: cephadm 2021-03-10T17:19:38.961734+0000 mgr.gibba045.orlgmj (mgr.34412) 11111 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:19:40.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:19:40 gibba045 bash[25517]: cephadm 2021-03-10T17:19:38.961781+0000 mgr.gibba045.orlgmj (mgr.34412) 11112 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:19:40.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:19:40 gibba045 bash[25517]: cephadm 2021-03-10T17:19:38.963150+0000 mgr.gibba045.orlgmj (mgr.34412) 11113 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:19:40.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:19:40 gibba045 bash[25517]: cephadm 2021-03-10T17:19:38.964805+0000 mgr.gibba045.orlgmj (mgr.34412) 11114 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:19:40.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:19:40 gibba045 bash[25517]: cephadm 2021-03-10T17:19:38.964848+0000 mgr.gibba045.orlgmj (mgr.34412) 11115 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:19:40.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:19:40 gibba045 bash[25517]: cephadm 2021-03-10T17:19:38.966257+0000 mgr.gibba045.orlgmj (mgr.34412) 11116 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:19:40.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:19:40 gibba045 bash[25517]: cephadm 2021-03-10T17:19:38.966580+0000 mgr.gibba045.orlgmj (mgr.34412) 11117 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:19:40.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:19:40 gibba045 bash[25517]: cephadm 2021-03-10T17:19:38.967800+0000 mgr.gibba045.orlgmj (mgr.34412) 11118 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:19:40.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:19:40 gibba045 bash[25517]: cephadm 2021-03-10T17:19:38.967873+0000 mgr.gibba045.orlgmj (mgr.34412) 11119 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:19:40.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:19:40 gibba045 bash[25517]: cephadm 2021-03-10T17:19:38.967989+0000 mgr.gibba045.orlgmj (mgr.34412) 11120 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:19:40.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:19:40 gibba015 bash[29377]: cephadm 2021-03-10T17:19:38.738649+0000 mgr.gibba045.orlgmj (mgr.34412) 11105 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:19:40.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:19:40 gibba015 bash[29377]: cephadm 2021-03-10T17:19:38.740399+0000 mgr.gibba045.orlgmj (mgr.34412) 11106 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:19:40.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:19:40 gibba015 bash[29377]: cephadm 2021-03-10T17:19:38.956819+0000 mgr.gibba045.orlgmj (mgr.34412) 11107 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:19:40.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:19:40 gibba015 bash[29377]: cephadm 2021-03-10T17:19:38.958620+0000 mgr.gibba045.orlgmj (mgr.34412) 11108 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:19:40.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:19:40 gibba015 bash[29377]: cephadm 2021-03-10T17:19:38.960154+0000 mgr.gibba045.orlgmj (mgr.34412) 11109 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:19:40.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:19:40 gibba015 bash[29377]: cephadm 2021-03-10T17:19:38.960198+0000 mgr.gibba045.orlgmj (mgr.34412) 11110 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:19:40.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:19:40 gibba015 bash[29377]: cephadm 2021-03-10T17:19:38.961734+0000 mgr.gibba045.orlgmj (mgr.34412) 11111 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:19:40.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:19:40 gibba015 bash[29377]: cephadm 2021-03-10T17:19:38.961781+0000 mgr.gibba045.orlgmj (mgr.34412) 11112 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:19:40.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:19:40 gibba015 bash[29377]: cephadm 2021-03-10T17:19:38.963150+0000 mgr.gibba045.orlgmj (mgr.34412) 11113 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:19:40.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:19:40 gibba015 bash[29377]: cephadm 2021-03-10T17:19:38.964805+0000 mgr.gibba045.orlgmj (mgr.34412) 11114 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:19:40.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:19:40 gibba015 bash[29377]: cephadm 2021-03-10T17:19:38.964848+0000 mgr.gibba045.orlgmj (mgr.34412) 11115 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:19:40.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:19:40 gibba015 bash[29377]: cephadm 2021-03-10T17:19:38.966257+0000 mgr.gibba045.orlgmj (mgr.34412) 11116 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:19:40.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:19:40 gibba015 bash[29377]: cephadm 2021-03-10T17:19:38.966580+0000 mgr.gibba045.orlgmj (mgr.34412) 11117 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:19:40.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:19:40 gibba015 bash[29377]: cephadm 2021-03-10T17:19:38.967800+0000 mgr.gibba045.orlgmj (mgr.34412) 11118 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:19:40.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:19:40 gibba015 bash[29377]: cephadm 2021-03-10T17:19:38.967873+0000 mgr.gibba045.orlgmj (mgr.34412) 11119 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:19:40.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:19:40 gibba015 bash[29377]: cephadm 2021-03-10T17:19:38.967989+0000 mgr.gibba045.orlgmj (mgr.34412) 11120 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:19:40.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:19:40 gibba015 bash[30343]: cephadm 2021-03-10T17:19:38.738649+0000 mgr.gibba045.orlgmj (mgr.34412) 11105 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:19:40.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:19:40 gibba015 bash[30343]: cephadm 2021-03-10T17:19:38.740399+0000 mgr.gibba045.orlgmj (mgr.34412) 11106 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:19:40.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:19:40 gibba015 bash[30343]: cephadm 2021-03-10T17:19:38.956819+0000 mgr.gibba045.orlgmj (mgr.34412) 11107 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:19:40.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:19:40 gibba015 bash[30343]: cephadm 2021-03-10T17:19:38.958620+0000 mgr.gibba045.orlgmj (mgr.34412) 11108 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:19:40.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:19:40 gibba015 bash[30343]: cephadm 2021-03-10T17:19:38.960154+0000 mgr.gibba045.orlgmj (mgr.34412) 11109 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:19:40.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:19:40 gibba015 bash[30343]: cephadm 2021-03-10T17:19:38.960198+0000 mgr.gibba045.orlgmj (mgr.34412) 11110 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:19:40.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:19:40 gibba015 bash[30343]: cephadm 2021-03-10T17:19:38.961734+0000 mgr.gibba045.orlgmj (mgr.34412) 11111 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:19:40.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:19:40 gibba015 bash[30343]: cephadm 2021-03-10T17:19:38.961781+0000 mgr.gibba045.orlgmj (mgr.34412) 11112 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:19:40.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:19:40 gibba015 bash[30343]: cephadm 2021-03-10T17:19:38.963150+0000 mgr.gibba045.orlgmj (mgr.34412) 11113 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:19:40.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:19:40 gibba015 bash[30343]: cephadm 2021-03-10T17:19:38.964805+0000 mgr.gibba045.orlgmj (mgr.34412) 11114 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:19:40.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:19:40 gibba015 bash[30343]: cephadm 2021-03-10T17:19:38.964848+0000 mgr.gibba045.orlgmj (mgr.34412) 11115 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:19:40.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:19:40 gibba015 bash[30343]: cephadm 2021-03-10T17:19:38.966257+0000 mgr.gibba045.orlgmj (mgr.34412) 11116 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:19:40.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:19:40 gibba015 bash[30343]: cephadm 2021-03-10T17:19:38.966580+0000 mgr.gibba045.orlgmj (mgr.34412) 11117 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:19:40.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:19:40 gibba015 bash[30343]: cephadm 2021-03-10T17:19:38.967800+0000 mgr.gibba045.orlgmj (mgr.34412) 11118 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:19:40.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:19:40 gibba015 bash[30343]: cephadm 2021-03-10T17:19:38.967873+0000 mgr.gibba045.orlgmj (mgr.34412) 11119 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:19:40.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:19:40 gibba015 bash[30343]: cephadm 2021-03-10T17:19:38.967989+0000 mgr.gibba045.orlgmj (mgr.34412) 11120 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:19:41.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:19:41 gibba045 bash[25517]: cluster 2021-03-10T17:19:40.188910+0000 mgr.gibba045.orlgmj (mgr.34412) 11121 : cluster [DBG] pgmap v6334: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:41.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:19:41 gibba015 bash[29377]: cluster 2021-03-10T17:19:40.188910+0000 mgr.gibba045.orlgmj (mgr.34412) 11121 : cluster [DBG] pgmap v6334: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:41.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:19:41 gibba015 bash[30343]: cluster 2021-03-10T17:19:40.188910+0000 mgr.gibba045.orlgmj (mgr.34412) 11121 : cluster [DBG] pgmap v6334: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:43.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:19:43 gibba015 bash[29377]: cluster 2021-03-10T17:19:42.189956+0000 mgr.gibba045.orlgmj (mgr.34412) 11122 : cluster [DBG] pgmap v6335: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:43.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:19:43 gibba015 bash[30343]: cluster 2021-03-10T17:19:42.189956+0000 mgr.gibba045.orlgmj (mgr.34412) 11122 : cluster [DBG] pgmap v6335: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:43.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:19:43 gibba045 bash[25517]: cluster 2021-03-10T17:19:42.189956+0000 mgr.gibba045.orlgmj (mgr.34412) 11122 : cluster [DBG] pgmap v6335: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:45.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:19:45 gibba015 bash[29377]: cluster 2021-03-10T17:19:44.191095+0000 mgr.gibba045.orlgmj (mgr.34412) 11123 : cluster [DBG] pgmap v6336: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:45.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:19:45 gibba015 bash[30343]: cluster 2021-03-10T17:19:44.191095+0000 mgr.gibba045.orlgmj (mgr.34412) 11123 : cluster [DBG] pgmap v6336: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:45.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:19:45 gibba045 bash[25517]: cluster 2021-03-10T17:19:44.191095+0000 mgr.gibba045.orlgmj (mgr.34412) 11123 : cluster [DBG] pgmap v6336: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:47.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:19:47 gibba015 bash[29377]: cluster 2021-03-10T17:19:46.192804+0000 mgr.gibba045.orlgmj (mgr.34412) 11124 : cluster [DBG] pgmap v6337: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:47.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:19:47 gibba015 bash[30343]: cluster 2021-03-10T17:19:46.192804+0000 mgr.gibba045.orlgmj (mgr.34412) 11124 : cluster [DBG] pgmap v6337: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:47.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:19:47 gibba045 bash[25517]: cluster 2021-03-10T17:19:46.192804+0000 mgr.gibba045.orlgmj (mgr.34412) 11124 : cluster [DBG] pgmap v6337: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:48.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:19:48 gibba015 bash[29377]: cluster 2021-03-10T17:19:48.193668+0000 mgr.gibba045.orlgmj (mgr.34412) 11125 : cluster [DBG] pgmap v6338: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:48.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:19:48 gibba015 bash[30343]: cluster 2021-03-10T17:19:48.193668+0000 mgr.gibba045.orlgmj (mgr.34412) 11125 : cluster [DBG] pgmap v6338: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:49.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:19:48 gibba045 bash[25517]: cluster 2021-03-10T17:19:48.193668+0000 mgr.gibba045.orlgmj (mgr.34412) 11125 : cluster [DBG] pgmap v6338: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:51.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:19:51 gibba045 bash[25517]: cluster 2021-03-10T17:19:50.195107+0000 mgr.gibba045.orlgmj (mgr.34412) 11126 : cluster [DBG] pgmap v6339: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:51.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:19:51 gibba015 bash[29377]: cluster 2021-03-10T17:19:50.195107+0000 mgr.gibba045.orlgmj (mgr.34412) 11126 : cluster [DBG] pgmap v6339: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:51.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:19:51 gibba015 bash[30343]: cluster 2021-03-10T17:19:50.195107+0000 mgr.gibba045.orlgmj (mgr.34412) 11126 : cluster [DBG] pgmap v6339: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:53.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:19:53 gibba045 bash[25517]: cluster 2021-03-10T17:19:52.196749+0000 mgr.gibba045.orlgmj (mgr.34412) 11127 : cluster [DBG] pgmap v6340: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:53.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:19:53 gibba015 bash[29377]: cluster 2021-03-10T17:19:52.196749+0000 mgr.gibba045.orlgmj (mgr.34412) 11127 : cluster [DBG] pgmap v6340: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:53.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:19:53 gibba015 bash[30343]: cluster 2021-03-10T17:19:52.196749+0000 mgr.gibba045.orlgmj (mgr.34412) 11127 : cluster [DBG] pgmap v6340: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:19:54 gibba045 bash[25517]: audit 2021-03-10T17:19:53.986697+0000 mon.c (mon.1) 3050 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:19:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:19:54 gibba045 bash[25517]: audit 2021-03-10T17:19:53.987316+0000 mon.c (mon.1) 3051 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:19:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:19:54 gibba045 bash[25517]: audit 2021-03-10T17:19:53.987917+0000 mon.a (mon.0) 2349 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:19:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:19:54 gibba045 bash[25517]: audit 2021-03-10T17:19:53.989335+0000 mon.a (mon.0) 2350 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:19:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:19:54 gibba045 bash[25517]: audit 2021-03-10T17:19:54.086820+0000 mon.c (mon.1) 3052 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T17:19:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:19:54 gibba045 bash[25517]: audit 2021-03-10T17:19:54.087665+0000 mon.c (mon.1) 3053 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:19:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:19:54 gibba045 bash[25517]: audit 2021-03-10T17:19:54.088201+0000 mon.a (mon.0) 2351 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T17:19:54.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:19:54 gibba045 bash[25517]: audit 2021-03-10T17:19:54.088850+0000 mon.c (mon.1) 3054 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:19:54.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:19:54 gibba045 bash[25517]: audit 2021-03-10T17:19:54.090306+0000 mon.c (mon.1) 3055 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:19:54.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:19:54 gibba045 bash[25517]: audit 2021-03-10T17:19:54.090340+0000 mon.a (mon.0) 2352 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:19:54.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:19:54 gibba045 bash[25517]: audit 2021-03-10T17:19:54.091894+0000 mon.a (mon.0) 2353 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:19:54.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:19:54 gibba045 bash[25517]: audit 2021-03-10T17:19:54.092156+0000 mon.a (mon.0) 2354 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:19:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:19:54 gibba015 bash[29377]: audit 2021-03-10T17:19:53.986697+0000 mon.c (mon.1) 3050 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:19:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:19:54 gibba015 bash[29377]: audit 2021-03-10T17:19:53.987316+0000 mon.c (mon.1) 3051 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:19:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:19:54 gibba015 bash[29377]: audit 2021-03-10T17:19:53.987917+0000 mon.a (mon.0) 2349 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:19:54.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:19:54 gibba015 bash[29377]: audit 2021-03-10T17:19:53.989335+0000 mon.a (mon.0) 2350 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:19:54.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:19:54 gibba015 bash[29377]: audit 2021-03-10T17:19:54.086820+0000 mon.c (mon.1) 3052 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T17:19:54.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:19:54 gibba015 bash[29377]: audit 2021-03-10T17:19:54.087665+0000 mon.c (mon.1) 3053 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:19:54.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:19:54 gibba015 bash[29377]: audit 2021-03-10T17:19:54.088201+0000 mon.a (mon.0) 2351 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T17:19:54.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:19:54 gibba015 bash[29377]: audit 2021-03-10T17:19:54.088850+0000 mon.c (mon.1) 3054 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:19:54.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:19:54 gibba015 bash[29377]: audit 2021-03-10T17:19:54.090306+0000 mon.c (mon.1) 3055 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:19:54.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:19:54 gibba015 bash[29377]: audit 2021-03-10T17:19:54.090340+0000 mon.a (mon.0) 2352 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:19:54.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:19:54 gibba015 bash[29377]: audit 2021-03-10T17:19:54.091894+0000 mon.a (mon.0) 2353 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:19:54.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:19:54 gibba015 bash[29377]: audit 2021-03-10T17:19:54.092156+0000 mon.a (mon.0) 2354 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:19:54.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:19:54 gibba015 bash[30343]: audit 2021-03-10T17:19:53.986697+0000 mon.c (mon.1) 3050 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:19:54.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:19:54 gibba015 bash[30343]: audit 2021-03-10T17:19:53.987316+0000 mon.c (mon.1) 3051 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:19:54.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:19:54 gibba015 bash[30343]: audit 2021-03-10T17:19:53.987917+0000 mon.a (mon.0) 2349 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:19:54.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:19:54 gibba015 bash[30343]: audit 2021-03-10T17:19:53.989335+0000 mon.a (mon.0) 2350 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:19:54.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:19:54 gibba015 bash[30343]: audit 2021-03-10T17:19:54.086820+0000 mon.c (mon.1) 3052 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T17:19:54.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:19:54 gibba015 bash[30343]: audit 2021-03-10T17:19:54.087665+0000 mon.c (mon.1) 3053 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:19:54.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:19:54 gibba015 bash[30343]: audit 2021-03-10T17:19:54.088201+0000 mon.a (mon.0) 2351 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T17:19:54.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:19:54 gibba015 bash[30343]: audit 2021-03-10T17:19:54.088850+0000 mon.c (mon.1) 3054 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:19:54.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:19:54 gibba015 bash[30343]: audit 2021-03-10T17:19:54.090306+0000 mon.c (mon.1) 3055 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:19:54.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:19:54 gibba015 bash[30343]: audit 2021-03-10T17:19:54.090340+0000 mon.a (mon.0) 2352 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:19:54.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:19:54 gibba015 bash[30343]: audit 2021-03-10T17:19:54.091894+0000 mon.a (mon.0) 2353 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:19:54.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:19:54 gibba015 bash[30343]: audit 2021-03-10T17:19:54.092156+0000 mon.a (mon.0) 2354 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:19:55.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:19:55 gibba045 bash[25517]: cephadm 2021-03-10T17:19:53.987691+0000 mgr.gibba045.orlgmj (mgr.34412) 11128 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:19:55.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:19:55 gibba045 bash[25517]: cluster 2021-03-10T17:19:54.197804+0000 mgr.gibba045.orlgmj (mgr.34412) 11129 : cluster [DBG] pgmap v6341: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:55.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:19:55 gibba015 bash[29377]: cephadm 2021-03-10T17:19:53.987691+0000 mgr.gibba045.orlgmj (mgr.34412) 11128 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:19:55.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:19:55 gibba015 bash[29377]: cluster 2021-03-10T17:19:54.197804+0000 mgr.gibba045.orlgmj (mgr.34412) 11129 : cluster [DBG] pgmap v6341: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:55.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:19:55 gibba015 bash[30343]: cephadm 2021-03-10T17:19:53.987691+0000 mgr.gibba045.orlgmj (mgr.34412) 11128 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:19:55.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:19:55 gibba015 bash[30343]: cluster 2021-03-10T17:19:54.197804+0000 mgr.gibba045.orlgmj (mgr.34412) 11129 : cluster [DBG] pgmap v6341: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:57.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:19:57 gibba045 bash[25517]: cluster 2021-03-10T17:19:56.199449+0000 mgr.gibba045.orlgmj (mgr.34412) 11130 : cluster [DBG] pgmap v6342: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:57.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:19:57 gibba015 bash[29377]: cluster 2021-03-10T17:19:56.199449+0000 mgr.gibba045.orlgmj (mgr.34412) 11130 : cluster [DBG] pgmap v6342: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:57.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:19:57 gibba015 bash[30343]: cluster 2021-03-10T17:19:56.199449+0000 mgr.gibba045.orlgmj (mgr.34412) 11130 : cluster [DBG] pgmap v6342: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:58.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:19:58 gibba015 bash[29377]: cluster 2021-03-10T17:19:58.201132+0000 mgr.gibba045.orlgmj (mgr.34412) 11131 : cluster [DBG] pgmap v6343: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:58.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:19:58 gibba015 bash[30343]: cluster 2021-03-10T17:19:58.201132+0000 mgr.gibba045.orlgmj (mgr.34412) 11131 : cluster [DBG] pgmap v6343: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:59.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:19:58 gibba045 bash[25517]: cluster 2021-03-10T17:19:58.201132+0000 mgr.gibba045.orlgmj (mgr.34412) 11131 : cluster [DBG] pgmap v6343: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:00.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:20:00 gibba015 bash[29377]: debug 2021-03-10T17:19:59.994+0000 7f21beb4f700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T17:20:00.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:20:00 gibba015 bash[29377]: cluster 2021-03-10T17:20:00.000173+0000 mon.a (mon.0) 2355 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T17:20:00.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:20:00 gibba015 bash[30343]: cluster 2021-03-10T17:20:00.000173+0000 mon.a (mon.0) 2355 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T17:20:00.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:20:00 gibba045 bash[25517]: cluster 2021-03-10T17:20:00.000173+0000 mon.a (mon.0) 2355 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T17:20:01.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:20:01 gibba015 bash[29377]: cluster 2021-03-10T17:20:00.202796+0000 mgr.gibba045.orlgmj (mgr.34412) 11132 : cluster [DBG] pgmap v6344: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:01.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:20:01 gibba015 bash[30343]: cluster 2021-03-10T17:20:00.202796+0000 mgr.gibba045.orlgmj (mgr.34412) 11132 : cluster [DBG] pgmap v6344: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:01.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:20:01 gibba045 bash[25517]: cluster 2021-03-10T17:20:00.202796+0000 mgr.gibba045.orlgmj (mgr.34412) 11132 : cluster [DBG] pgmap v6344: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:03.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:20:03 gibba045 bash[25517]: cluster 2021-03-10T17:20:02.204630+0000 mgr.gibba045.orlgmj (mgr.34412) 11133 : cluster [DBG] pgmap v6345: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:03.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:20:03 gibba015 bash[29377]: cluster 2021-03-10T17:20:02.204630+0000 mgr.gibba045.orlgmj (mgr.34412) 11133 : cluster [DBG] pgmap v6345: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:03.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:20:03 gibba015 bash[30343]: cluster 2021-03-10T17:20:02.204630+0000 mgr.gibba045.orlgmj (mgr.34412) 11133 : cluster [DBG] pgmap v6345: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:05.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:20:05 gibba045 bash[25517]: cluster 2021-03-10T17:20:04.205816+0000 mgr.gibba045.orlgmj (mgr.34412) 11134 : cluster [DBG] pgmap v6346: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:05.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:20:05 gibba015 bash[29377]: cluster 2021-03-10T17:20:04.205816+0000 mgr.gibba045.orlgmj (mgr.34412) 11134 : cluster [DBG] pgmap v6346: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:05.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:20:05 gibba015 bash[30343]: cluster 2021-03-10T17:20:04.205816+0000 mgr.gibba045.orlgmj (mgr.34412) 11134 : cluster [DBG] pgmap v6346: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:07.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:20:07 gibba045 bash[25517]: cluster 2021-03-10T17:20:06.207158+0000 mgr.gibba045.orlgmj (mgr.34412) 11135 : cluster [DBG] pgmap v6347: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:07.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:20:07 gibba015 bash[29377]: cluster 2021-03-10T17:20:06.207158+0000 mgr.gibba045.orlgmj (mgr.34412) 11135 : cluster [DBG] pgmap v6347: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:07.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:20:07 gibba015 bash[30343]: cluster 2021-03-10T17:20:06.207158+0000 mgr.gibba045.orlgmj (mgr.34412) 11135 : cluster [DBG] pgmap v6347: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:07.775 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:20:08.001 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:20:08.001 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 2m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:20:08.002 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 94s ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:20:08.002 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 94s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:20:08.003 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 94s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:20:08.003 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:20:08.004 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:20:08.004 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 94s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:20:08.004 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:20:08.005 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 2m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:20:08.006 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 94s ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:20:08.006 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:20:08.007 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:20:08.007 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:20:08.008 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:20:08.008 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 94s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:20:08.009 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 94s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:20:08.009 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 94s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:20:08.010 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 94s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:20:08.010 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 94s ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:20:08.010 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 94s ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:20:08.250 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:20:08.250 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:20:08.250 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:20:08.251 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:20:08.251 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:20:08.251 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:20:08.251 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:20:08.252 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:20:08.252 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:20:08.253 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:20:08.253 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:20:08.253 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:20:08.253 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:20:08.254 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:20:08.254 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:20:08.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:20:08 gibba015 bash[29377]: audit 2021-03-10T17:20:07.766504+0000 mgr.gibba045.orlgmj (mgr.34412) 11136 : audit [DBG] from='client.61510 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:20:08.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:20:08 gibba015 bash[29377]: audit 2021-03-10T17:20:07.988252+0000 mgr.gibba045.orlgmj (mgr.34412) 11137 : audit [DBG] from='client.61516 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:20:08.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:20:08 gibba015 bash[29377]: cluster 2021-03-10T17:20:08.208680+0000 mgr.gibba045.orlgmj (mgr.34412) 11138 : cluster [DBG] pgmap v6348: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:08.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:20:08 gibba015 bash[29377]: audit 2021-03-10T17:20:08.248684+0000 mon.a (mon.0) 2356 : audit [DBG] from='client.? 172.21.2.115:0/2973824361' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:20:08.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:20:08 gibba015 bash[30343]: audit 2021-03-10T17:20:07.766504+0000 mgr.gibba045.orlgmj (mgr.34412) 11136 : audit [DBG] from='client.61510 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:20:08.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:20:08 gibba015 bash[30343]: audit 2021-03-10T17:20:07.988252+0000 mgr.gibba045.orlgmj (mgr.34412) 11137 : audit [DBG] from='client.61516 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:20:08.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:20:08 gibba015 bash[30343]: cluster 2021-03-10T17:20:08.208680+0000 mgr.gibba045.orlgmj (mgr.34412) 11138 : cluster [DBG] pgmap v6348: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:08.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:20:08 gibba015 bash[30343]: audit 2021-03-10T17:20:08.248684+0000 mon.a (mon.0) 2356 : audit [DBG] from='client.? 172.21.2.115:0/2973824361' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:20:09.003 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:20:08 gibba045 bash[25517]: audit 2021-03-10T17:20:07.766504+0000 mgr.gibba045.orlgmj (mgr.34412) 11136 : audit [DBG] from='client.61510 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:20:09.004 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:20:08 gibba045 bash[25517]: audit 2021-03-10T17:20:07.988252+0000 mgr.gibba045.orlgmj (mgr.34412) 11137 : audit [DBG] from='client.61516 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:20:09.004 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:20:08 gibba045 bash[25517]: cluster 2021-03-10T17:20:08.208680+0000 mgr.gibba045.orlgmj (mgr.34412) 11138 : cluster [DBG] pgmap v6348: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:09.005 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:20:08 gibba045 bash[25517]: audit 2021-03-10T17:20:08.248684+0000 mon.a (mon.0) 2356 : audit [DBG] from='client.? 172.21.2.115:0/2973824361' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:20:09.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:20:09 gibba015 bash[29377]: cephadm 2021-03-10T17:20:09.003466+0000 mgr.gibba045.orlgmj (mgr.34412) 11139 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:20:09.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:20:09 gibba015 bash[30343]: cephadm 2021-03-10T17:20:09.003466+0000 mgr.gibba045.orlgmj (mgr.34412) 11139 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:20:10.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:20:09 gibba045 bash[25517]: cephadm 2021-03-10T17:20:09.003466+0000 mgr.gibba045.orlgmj (mgr.34412) 11139 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:20:10.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:20:10 gibba015 bash[29377]: cluster 2021-03-10T17:20:10.210145+0000 mgr.gibba045.orlgmj (mgr.34412) 11140 : cluster [DBG] pgmap v6349: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:10.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:20:10 gibba015 bash[30343]: cluster 2021-03-10T17:20:10.210145+0000 mgr.gibba045.orlgmj (mgr.34412) 11140 : cluster [DBG] pgmap v6349: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:11.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:20:10 gibba045 bash[25517]: cluster 2021-03-10T17:20:10.210145+0000 mgr.gibba045.orlgmj (mgr.34412) 11140 : cluster [DBG] pgmap v6349: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:13.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:20:13 gibba045 bash[25517]: cluster 2021-03-10T17:20:12.211431+0000 mgr.gibba045.orlgmj (mgr.34412) 11141 : cluster [DBG] pgmap v6350: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:13.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:20:13 gibba015 bash[29377]: cluster 2021-03-10T17:20:12.211431+0000 mgr.gibba045.orlgmj (mgr.34412) 11141 : cluster [DBG] pgmap v6350: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:13.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:20:13 gibba015 bash[30343]: cluster 2021-03-10T17:20:12.211431+0000 mgr.gibba045.orlgmj (mgr.34412) 11141 : cluster [DBG] pgmap v6350: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:15.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:20:15 gibba045 bash[25517]: cluster 2021-03-10T17:20:14.212641+0000 mgr.gibba045.orlgmj (mgr.34412) 11142 : cluster [DBG] pgmap v6351: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:15.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:20:15 gibba015 bash[29377]: cluster 2021-03-10T17:20:14.212641+0000 mgr.gibba045.orlgmj (mgr.34412) 11142 : cluster [DBG] pgmap v6351: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:15.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:20:15 gibba015 bash[30343]: cluster 2021-03-10T17:20:14.212641+0000 mgr.gibba045.orlgmj (mgr.34412) 11142 : cluster [DBG] pgmap v6351: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:17.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:20:17 gibba045 bash[25517]: cluster 2021-03-10T17:20:16.214081+0000 mgr.gibba045.orlgmj (mgr.34412) 11143 : cluster [DBG] pgmap v6352: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:17.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:20:17 gibba015 bash[29377]: cluster 2021-03-10T17:20:16.214081+0000 mgr.gibba045.orlgmj (mgr.34412) 11143 : cluster [DBG] pgmap v6352: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:17.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:20:17 gibba015 bash[30343]: cluster 2021-03-10T17:20:16.214081+0000 mgr.gibba045.orlgmj (mgr.34412) 11143 : cluster [DBG] pgmap v6352: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:18.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:20:18 gibba015 bash[29377]: cluster 2021-03-10T17:20:18.215457+0000 mgr.gibba045.orlgmj (mgr.34412) 11144 : cluster [DBG] pgmap v6353: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:18.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:20:18 gibba015 bash[30343]: cluster 2021-03-10T17:20:18.215457+0000 mgr.gibba045.orlgmj (mgr.34412) 11144 : cluster [DBG] pgmap v6353: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:19.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:20:18 gibba045 bash[25517]: cluster 2021-03-10T17:20:18.215457+0000 mgr.gibba045.orlgmj (mgr.34412) 11144 : cluster [DBG] pgmap v6353: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:21.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:20:21 gibba045 bash[25517]: cluster 2021-03-10T17:20:20.217017+0000 mgr.gibba045.orlgmj (mgr.34412) 11145 : cluster [DBG] pgmap v6354: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:21.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:20:21 gibba015 bash[29377]: cluster 2021-03-10T17:20:20.217017+0000 mgr.gibba045.orlgmj (mgr.34412) 11145 : cluster [DBG] pgmap v6354: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:21.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:20:21 gibba015 bash[30343]: cluster 2021-03-10T17:20:20.217017+0000 mgr.gibba045.orlgmj (mgr.34412) 11145 : cluster [DBG] pgmap v6354: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:23.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:20:23 gibba045 bash[25517]: cluster 2021-03-10T17:20:22.218524+0000 mgr.gibba045.orlgmj (mgr.34412) 11146 : cluster [DBG] pgmap v6355: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:23.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:20:23 gibba015 bash[29377]: cluster 2021-03-10T17:20:22.218524+0000 mgr.gibba045.orlgmj (mgr.34412) 11146 : cluster [DBG] pgmap v6355: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:23.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:20:23 gibba015 bash[30343]: cluster 2021-03-10T17:20:22.218524+0000 mgr.gibba045.orlgmj (mgr.34412) 11146 : cluster [DBG] pgmap v6355: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:25.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:20:25 gibba045 bash[25517]: cephadm 2021-03-10T17:20:24.019198+0000 mgr.gibba045.orlgmj (mgr.34412) 11147 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:20:25.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:20:25 gibba045 bash[25517]: cluster 2021-03-10T17:20:24.219786+0000 mgr.gibba045.orlgmj (mgr.34412) 11148 : cluster [DBG] pgmap v6356: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:25.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:20:25 gibba015 bash[29377]: cephadm 2021-03-10T17:20:24.019198+0000 mgr.gibba045.orlgmj (mgr.34412) 11147 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:20:25.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:20:25 gibba015 bash[29377]: cluster 2021-03-10T17:20:24.219786+0000 mgr.gibba045.orlgmj (mgr.34412) 11148 : cluster [DBG] pgmap v6356: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:25.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:20:25 gibba015 bash[30343]: cephadm 2021-03-10T17:20:24.019198+0000 mgr.gibba045.orlgmj (mgr.34412) 11147 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:20:25.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:20:25 gibba015 bash[30343]: cluster 2021-03-10T17:20:24.219786+0000 mgr.gibba045.orlgmj (mgr.34412) 11148 : cluster [DBG] pgmap v6356: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:27.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:20:27 gibba015 bash[29377]: cluster 2021-03-10T17:20:26.221629+0000 mgr.gibba045.orlgmj (mgr.34412) 11149 : cluster [DBG] pgmap v6357: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:27.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:20:27 gibba015 bash[30343]: cluster 2021-03-10T17:20:26.221629+0000 mgr.gibba045.orlgmj (mgr.34412) 11149 : cluster [DBG] pgmap v6357: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:27.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:20:27 gibba045 bash[25517]: cluster 2021-03-10T17:20:26.221629+0000 mgr.gibba045.orlgmj (mgr.34412) 11149 : cluster [DBG] pgmap v6357: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:28.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:20:28 gibba015 bash[29377]: cluster 2021-03-10T17:20:28.223144+0000 mgr.gibba045.orlgmj (mgr.34412) 11150 : cluster [DBG] pgmap v6358: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:28.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:20:28 gibba015 bash[30343]: cluster 2021-03-10T17:20:28.223144+0000 mgr.gibba045.orlgmj (mgr.34412) 11150 : cluster [DBG] pgmap v6358: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:29.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:20:28 gibba045 bash[25517]: cluster 2021-03-10T17:20:28.223144+0000 mgr.gibba045.orlgmj (mgr.34412) 11150 : cluster [DBG] pgmap v6358: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:31.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:20:31 gibba045 bash[25517]: cluster 2021-03-10T17:20:30.224783+0000 mgr.gibba045.orlgmj (mgr.34412) 11151 : cluster [DBG] pgmap v6359: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:31.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:20:31 gibba015 bash[29377]: cluster 2021-03-10T17:20:30.224783+0000 mgr.gibba045.orlgmj (mgr.34412) 11151 : cluster [DBG] pgmap v6359: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:31.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:20:31 gibba015 bash[30343]: cluster 2021-03-10T17:20:30.224783+0000 mgr.gibba045.orlgmj (mgr.34412) 11151 : cluster [DBG] pgmap v6359: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:33.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:20:33 gibba045 bash[25517]: cluster 2021-03-10T17:20:32.226585+0000 mgr.gibba045.orlgmj (mgr.34412) 11152 : cluster [DBG] pgmap v6360: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:33.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:20:33 gibba015 bash[29377]: cluster 2021-03-10T17:20:32.226585+0000 mgr.gibba045.orlgmj (mgr.34412) 11152 : cluster [DBG] pgmap v6360: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:33.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:20:33 gibba015 bash[30343]: cluster 2021-03-10T17:20:32.226585+0000 mgr.gibba045.orlgmj (mgr.34412) 11152 : cluster [DBG] pgmap v6360: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:35.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:20:35 gibba015 bash[29377]: cluster 2021-03-10T17:20:34.227845+0000 mgr.gibba045.orlgmj (mgr.34412) 11153 : cluster [DBG] pgmap v6361: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:35.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:20:35 gibba015 bash[30343]: cluster 2021-03-10T17:20:34.227845+0000 mgr.gibba045.orlgmj (mgr.34412) 11153 : cluster [DBG] pgmap v6361: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:35.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:20:35 gibba045 bash[25517]: cluster 2021-03-10T17:20:34.227845+0000 mgr.gibba045.orlgmj (mgr.34412) 11153 : cluster [DBG] pgmap v6361: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:37.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:20:37 gibba015 bash[29377]: cluster 2021-03-10T17:20:36.229231+0000 mgr.gibba045.orlgmj (mgr.34412) 11154 : cluster [DBG] pgmap v6362: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:38.713 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:20:37 gibba015 bash[30343]: cluster 2021-03-10T17:20:36.229231+0000 mgr.gibba045.orlgmj (mgr.34412) 11154 : cluster [DBG] pgmap v6362: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:38.714 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:20:38.714 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:20:37 gibba045 bash[25517]: cluster 2021-03-10T17:20:36.229231+0000 mgr.gibba045.orlgmj (mgr.34412) 11154 : cluster [DBG] pgmap v6362: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:38.715 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:20:38.715 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 3m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:20:38.716 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 2m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:20:38.716 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:20:38.716 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:20:38.716 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:20:38.716 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:20:38.717 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:20:38.717 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:20:38.717 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 3m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:20:38.717 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 2m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:20:38.718 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:20:38.718 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:20:38.719 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:20:38.719 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:20:38.719 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:20:38.720 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:20:38.720 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:20:38.721 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:20:38.721 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 2m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:20:38.721 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 2m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:20:38.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:20:38 gibba015 bash[29377]: cluster 2021-03-10T17:20:38.230696+0000 mgr.gibba045.orlgmj (mgr.34412) 11155 : cluster [DBG] pgmap v6363: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:38.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:20:38 gibba015 bash[29377]: audit 2021-03-10T17:20:38.484462+0000 mgr.gibba045.orlgmj (mgr.34412) 11156 : audit [DBG] from='client.61528 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:20:38.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:20:38 gibba015 bash[30343]: cluster 2021-03-10T17:20:38.230696+0000 mgr.gibba045.orlgmj (mgr.34412) 11155 : cluster [DBG] pgmap v6363: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:38.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:20:38 gibba015 bash[30343]: audit 2021-03-10T17:20:38.484462+0000 mgr.gibba045.orlgmj (mgr.34412) 11156 : audit [DBG] from='client.61528 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:20:38.974 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:20:38.974 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:20:38.975 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:20:38.975 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:20:38.976 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:20:38.976 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:20:38.976 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:20:38.977 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:20:38.978 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:20:38.978 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:20:38.979 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:20:38.979 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:20:38.979 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:20:38.980 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:20:38.980 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:20:39.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:20:38 gibba045 bash[25517]: cluster 2021-03-10T17:20:38.230696+0000 mgr.gibba045.orlgmj (mgr.34412) 11155 : cluster [DBG] pgmap v6363: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:39.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:20:38 gibba045 bash[25517]: audit 2021-03-10T17:20:38.484462+0000 mgr.gibba045.orlgmj (mgr.34412) 11156 : audit [DBG] from='client.61528 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:20:39.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:20:39 gibba015 bash[29377]: audit 2021-03-10T17:20:38.707447+0000 mgr.gibba045.orlgmj (mgr.34412) 11157 : audit [DBG] from='client.61534 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:20:39.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:20:39 gibba015 bash[29377]: audit 2021-03-10T17:20:38.972795+0000 mon.c (mon.1) 3056 : audit [DBG] from='client.? 172.21.2.115:0/2570240187' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:20:39.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:20:39 gibba015 bash[29377]: audit 2021-03-10T17:20:39.026942+0000 mon.c (mon.1) 3057 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:20:39.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:20:39 gibba015 bash[29377]: cephadm 2021-03-10T17:20:39.032790+0000 mgr.gibba045.orlgmj (mgr.34412) 11158 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:20:39.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:20:39 gibba015 bash[29377]: cephadm 2021-03-10T17:20:39.034545+0000 mgr.gibba045.orlgmj (mgr.34412) 11159 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:20:39.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:20:39 gibba015 bash[29377]: audit 2021-03-10T17:20:39.241544+0000 mon.a (mon.0) 2357 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:20:39.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:20:39 gibba015 bash[29377]: audit 2021-03-10T17:20:39.245402+0000 mon.c (mon.1) 3058 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:20:39.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:20:39 gibba015 bash[29377]: cephadm 2021-03-10T17:20:39.246482+0000 mgr.gibba045.orlgmj (mgr.34412) 11160 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:20:39.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:20:39 gibba015 bash[29377]: audit 2021-03-10T17:20:39.246883+0000 mon.c (mon.1) 3059 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:20:39.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:20:39 gibba015 bash[29377]: audit 2021-03-10T17:20:39.248140+0000 mon.c (mon.1) 3060 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:20:39.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:20:39 gibba015 bash[29377]: cephadm 2021-03-10T17:20:39.248392+0000 mgr.gibba045.orlgmj (mgr.34412) 11161 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:20:39.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:20:39 gibba015 bash[29377]: cephadm 2021-03-10T17:20:39.249595+0000 mgr.gibba045.orlgmj (mgr.34412) 11162 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:20:39.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:20:39 gibba015 bash[29377]: cephadm 2021-03-10T17:20:39.249633+0000 mgr.gibba045.orlgmj (mgr.34412) 11163 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:20:39.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:20:39 gibba015 bash[29377]: audit 2021-03-10T17:20:39.249683+0000 mon.c (mon.1) 3061 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:20:39.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:20:39 gibba015 bash[29377]: cephadm 2021-03-10T17:20:39.251165+0000 mgr.gibba045.orlgmj (mgr.34412) 11164 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:20:39.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:20:39 gibba015 bash[29377]: cephadm 2021-03-10T17:20:39.251203+0000 mgr.gibba045.orlgmj (mgr.34412) 11165 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:20:39.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:20:39 gibba015 bash[29377]: cephadm 2021-03-10T17:20:39.252681+0000 mgr.gibba045.orlgmj (mgr.34412) 11166 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:20:39.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:20:39 gibba015 bash[29377]: audit 2021-03-10T17:20:39.252684+0000 mon.c (mon.1) 3062 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:20:39.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:20:39 gibba015 bash[29377]: cephadm 2021-03-10T17:20:39.254128+0000 mgr.gibba045.orlgmj (mgr.34412) 11167 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:20:39.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:20:39 gibba015 bash[30343]: audit 2021-03-10T17:20:38.707447+0000 mgr.gibba045.orlgmj (mgr.34412) 11157 : audit [DBG] from='client.61534 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:20:39.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:20:39 gibba015 bash[30343]: audit 2021-03-10T17:20:38.972795+0000 mon.c (mon.1) 3056 : audit [DBG] from='client.? 172.21.2.115:0/2570240187' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:20:39.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:20:39 gibba015 bash[30343]: audit 2021-03-10T17:20:39.026942+0000 mon.c (mon.1) 3057 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:20:39.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:20:39 gibba015 bash[30343]: cephadm 2021-03-10T17:20:39.032790+0000 mgr.gibba045.orlgmj (mgr.34412) 11158 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:20:39.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:20:39 gibba015 bash[30343]: cephadm 2021-03-10T17:20:39.034545+0000 mgr.gibba045.orlgmj (mgr.34412) 11159 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:20:39.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:20:39 gibba015 bash[30343]: audit 2021-03-10T17:20:39.241544+0000 mon.a (mon.0) 2357 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:20:39.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:20:39 gibba015 bash[30343]: audit 2021-03-10T17:20:39.245402+0000 mon.c (mon.1) 3058 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:20:39.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:20:39 gibba015 bash[30343]: cephadm 2021-03-10T17:20:39.246482+0000 mgr.gibba045.orlgmj (mgr.34412) 11160 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:20:39.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:20:39 gibba015 bash[30343]: audit 2021-03-10T17:20:39.246883+0000 mon.c (mon.1) 3059 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:20:39.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:20:39 gibba015 bash[30343]: audit 2021-03-10T17:20:39.248140+0000 mon.c (mon.1) 3060 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:20:39.985 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:20:39 gibba015 bash[30343]: cephadm 2021-03-10T17:20:39.248392+0000 mgr.gibba045.orlgmj (mgr.34412) 11161 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:20:39.986 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:20:39 gibba015 bash[30343]: cephadm 2021-03-10T17:20:39.249595+0000 mgr.gibba045.orlgmj (mgr.34412) 11162 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:20:39.987 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:20:39 gibba015 bash[30343]: cephadm 2021-03-10T17:20:39.249633+0000 mgr.gibba045.orlgmj (mgr.34412) 11163 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:20:39.987 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:20:39 gibba015 bash[30343]: audit 2021-03-10T17:20:39.249683+0000 mon.c (mon.1) 3061 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:20:39.987 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:20:39 gibba015 bash[30343]: cephadm 2021-03-10T17:20:39.251165+0000 mgr.gibba045.orlgmj (mgr.34412) 11164 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:20:39.988 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:20:39 gibba015 bash[30343]: cephadm 2021-03-10T17:20:39.251203+0000 mgr.gibba045.orlgmj (mgr.34412) 11165 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:20:39.988 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:20:39 gibba015 bash[30343]: cephadm 2021-03-10T17:20:39.252681+0000 mgr.gibba045.orlgmj (mgr.34412) 11166 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:20:39.988 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:20:39 gibba015 bash[30343]: audit 2021-03-10T17:20:39.252684+0000 mon.c (mon.1) 3062 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:20:39.988 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:20:39 gibba015 bash[30343]: cephadm 2021-03-10T17:20:39.254128+0000 mgr.gibba045.orlgmj (mgr.34412) 11167 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:20:39.989 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:20:39 gibba015 bash[29377]: audit 2021-03-10T17:20:39.254142+0000 mon.c (mon.1) 3063 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:20:39.989 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:20:39 gibba015 bash[29377]: cephadm 2021-03-10T17:20:39.254167+0000 mgr.gibba045.orlgmj (mgr.34412) 11168 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:20:39.989 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:20:39 gibba015 bash[29377]: cephadm 2021-03-10T17:20:39.255456+0000 mgr.gibba045.orlgmj (mgr.34412) 11169 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:20:39.990 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:20:39 gibba015 bash[29377]: cephadm 2021-03-10T17:20:39.255774+0000 mgr.gibba045.orlgmj (mgr.34412) 11170 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:20:39.990 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:20:39 gibba015 bash[29377]: cephadm 2021-03-10T17:20:39.256849+0000 mgr.gibba045.orlgmj (mgr.34412) 11171 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:20:39.990 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:20:39 gibba015 bash[29377]: cephadm 2021-03-10T17:20:39.256889+0000 mgr.gibba045.orlgmj (mgr.34412) 11172 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:20:39.991 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:20:39 gibba015 bash[29377]: cephadm 2021-03-10T17:20:39.256994+0000 mgr.gibba045.orlgmj (mgr.34412) 11173 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:20:39.991 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:20:39 gibba015 bash[30343]: audit 2021-03-10T17:20:39.254142+0000 mon.c (mon.1) 3063 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:20:39.991 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:20:39 gibba015 bash[30343]: cephadm 2021-03-10T17:20:39.254167+0000 mgr.gibba045.orlgmj (mgr.34412) 11168 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:20:39.992 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:20:39 gibba015 bash[30343]: cephadm 2021-03-10T17:20:39.255456+0000 mgr.gibba045.orlgmj (mgr.34412) 11169 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:20:39.992 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:20:39 gibba015 bash[30343]: cephadm 2021-03-10T17:20:39.255774+0000 mgr.gibba045.orlgmj (mgr.34412) 11170 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:20:39.992 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:20:39 gibba015 bash[30343]: cephadm 2021-03-10T17:20:39.256849+0000 mgr.gibba045.orlgmj (mgr.34412) 11171 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:20:39.992 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:20:39 gibba015 bash[30343]: cephadm 2021-03-10T17:20:39.256889+0000 mgr.gibba045.orlgmj (mgr.34412) 11172 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:20:39.993 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:20:39 gibba015 bash[30343]: cephadm 2021-03-10T17:20:39.256994+0000 mgr.gibba045.orlgmj (mgr.34412) 11173 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:20:40.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:20:39 gibba045 bash[25517]: audit 2021-03-10T17:20:38.707447+0000 mgr.gibba045.orlgmj (mgr.34412) 11157 : audit [DBG] from='client.61534 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:20:40.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:20:39 gibba045 bash[25517]: audit 2021-03-10T17:20:38.972795+0000 mon.c (mon.1) 3056 : audit [DBG] from='client.? 172.21.2.115:0/2570240187' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:20:40.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:20:39 gibba045 bash[25517]: audit 2021-03-10T17:20:39.026942+0000 mon.c (mon.1) 3057 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:20:40.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:20:39 gibba045 bash[25517]: cephadm 2021-03-10T17:20:39.032790+0000 mgr.gibba045.orlgmj (mgr.34412) 11158 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:20:40.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:20:39 gibba045 bash[25517]: cephadm 2021-03-10T17:20:39.034545+0000 mgr.gibba045.orlgmj (mgr.34412) 11159 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:20:40.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:20:39 gibba045 bash[25517]: audit 2021-03-10T17:20:39.241544+0000 mon.a (mon.0) 2357 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:20:40.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:20:39 gibba045 bash[25517]: audit 2021-03-10T17:20:39.245402+0000 mon.c (mon.1) 3058 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:20:40.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:20:39 gibba045 bash[25517]: cephadm 2021-03-10T17:20:39.246482+0000 mgr.gibba045.orlgmj (mgr.34412) 11160 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:20:40.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:20:39 gibba045 bash[25517]: audit 2021-03-10T17:20:39.246883+0000 mon.c (mon.1) 3059 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:20:40.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:20:39 gibba045 bash[25517]: audit 2021-03-10T17:20:39.248140+0000 mon.c (mon.1) 3060 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:20:40.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:20:39 gibba045 bash[25517]: cephadm 2021-03-10T17:20:39.248392+0000 mgr.gibba045.orlgmj (mgr.34412) 11161 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:20:40.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:20:39 gibba045 bash[25517]: cephadm 2021-03-10T17:20:39.249595+0000 mgr.gibba045.orlgmj (mgr.34412) 11162 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:20:40.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:20:39 gibba045 bash[25517]: cephadm 2021-03-10T17:20:39.249633+0000 mgr.gibba045.orlgmj (mgr.34412) 11163 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:20:40.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:20:39 gibba045 bash[25517]: audit 2021-03-10T17:20:39.249683+0000 mon.c (mon.1) 3061 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:20:40.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:20:39 gibba045 bash[25517]: cephadm 2021-03-10T17:20:39.251165+0000 mgr.gibba045.orlgmj (mgr.34412) 11164 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:20:40.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:20:39 gibba045 bash[25517]: cephadm 2021-03-10T17:20:39.251203+0000 mgr.gibba045.orlgmj (mgr.34412) 11165 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:20:40.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:20:39 gibba045 bash[25517]: cephadm 2021-03-10T17:20:39.252681+0000 mgr.gibba045.orlgmj (mgr.34412) 11166 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:20:40.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:20:39 gibba045 bash[25517]: audit 2021-03-10T17:20:39.252684+0000 mon.c (mon.1) 3062 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:20:40.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:20:39 gibba045 bash[25517]: cephadm 2021-03-10T17:20:39.254128+0000 mgr.gibba045.orlgmj (mgr.34412) 11167 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:20:40.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:20:39 gibba045 bash[25517]: audit 2021-03-10T17:20:39.254142+0000 mon.c (mon.1) 3063 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:20:40.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:20:39 gibba045 bash[25517]: cephadm 2021-03-10T17:20:39.254167+0000 mgr.gibba045.orlgmj (mgr.34412) 11168 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:20:40.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:20:39 gibba045 bash[25517]: cephadm 2021-03-10T17:20:39.255456+0000 mgr.gibba045.orlgmj (mgr.34412) 11169 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:20:40.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:20:39 gibba045 bash[25517]: cephadm 2021-03-10T17:20:39.255774+0000 mgr.gibba045.orlgmj (mgr.34412) 11170 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:20:40.062 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:20:39 gibba045 bash[25517]: cephadm 2021-03-10T17:20:39.256849+0000 mgr.gibba045.orlgmj (mgr.34412) 11171 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:20:40.062 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:20:39 gibba045 bash[25517]: cephadm 2021-03-10T17:20:39.256889+0000 mgr.gibba045.orlgmj (mgr.34412) 11172 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:20:40.062 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:20:39 gibba045 bash[25517]: cephadm 2021-03-10T17:20:39.256994+0000 mgr.gibba045.orlgmj (mgr.34412) 11173 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:20:40.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:20:40 gibba015 bash[29377]: cluster 2021-03-10T17:20:40.232485+0000 mgr.gibba045.orlgmj (mgr.34412) 11174 : cluster [DBG] pgmap v6364: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:40.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:20:40 gibba015 bash[30343]: cluster 2021-03-10T17:20:40.232485+0000 mgr.gibba045.orlgmj (mgr.34412) 11174 : cluster [DBG] pgmap v6364: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:41.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:20:40 gibba045 bash[25517]: cluster 2021-03-10T17:20:40.232485+0000 mgr.gibba045.orlgmj (mgr.34412) 11174 : cluster [DBG] pgmap v6364: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:43.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:20:43 gibba045 bash[25517]: cluster 2021-03-10T17:20:42.234246+0000 mgr.gibba045.orlgmj (mgr.34412) 11175 : cluster [DBG] pgmap v6365: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:43.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:20:43 gibba015 bash[29377]: cluster 2021-03-10T17:20:42.234246+0000 mgr.gibba045.orlgmj (mgr.34412) 11175 : cluster [DBG] pgmap v6365: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:43.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:20:43 gibba015 bash[30343]: cluster 2021-03-10T17:20:42.234246+0000 mgr.gibba045.orlgmj (mgr.34412) 11175 : cluster [DBG] pgmap v6365: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:45.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:20:45 gibba015 bash[29377]: cluster 2021-03-10T17:20:44.235444+0000 mgr.gibba045.orlgmj (mgr.34412) 11176 : cluster [DBG] pgmap v6366: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:45.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:20:45 gibba015 bash[30343]: cluster 2021-03-10T17:20:44.235444+0000 mgr.gibba045.orlgmj (mgr.34412) 11176 : cluster [DBG] pgmap v6366: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:45.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:20:45 gibba045 bash[25517]: cluster 2021-03-10T17:20:44.235444+0000 mgr.gibba045.orlgmj (mgr.34412) 11176 : cluster [DBG] pgmap v6366: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:47.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:20:47 gibba015 bash[29377]: cluster 2021-03-10T17:20:46.237104+0000 mgr.gibba045.orlgmj (mgr.34412) 11177 : cluster [DBG] pgmap v6367: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:47.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:20:47 gibba015 bash[30343]: cluster 2021-03-10T17:20:46.237104+0000 mgr.gibba045.orlgmj (mgr.34412) 11177 : cluster [DBG] pgmap v6367: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:47.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:20:47 gibba045 bash[25517]: cluster 2021-03-10T17:20:46.237104+0000 mgr.gibba045.orlgmj (mgr.34412) 11177 : cluster [DBG] pgmap v6367: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:48.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:20:48 gibba015 bash[29377]: cluster 2021-03-10T17:20:48.238677+0000 mgr.gibba045.orlgmj (mgr.34412) 11178 : cluster [DBG] pgmap v6368: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:48.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:20:48 gibba015 bash[30343]: cluster 2021-03-10T17:20:48.238677+0000 mgr.gibba045.orlgmj (mgr.34412) 11178 : cluster [DBG] pgmap v6368: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:49.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:20:48 gibba045 bash[25517]: cluster 2021-03-10T17:20:48.238677+0000 mgr.gibba045.orlgmj (mgr.34412) 11178 : cluster [DBG] pgmap v6368: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:51.555 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:20:51 gibba045 bash[25517]: cluster 2021-03-10T17:20:50.240246+0000 mgr.gibba045.orlgmj (mgr.34412) 11179 : cluster [DBG] pgmap v6369: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:51.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:20:51 gibba015 bash[29377]: cluster 2021-03-10T17:20:50.240246+0000 mgr.gibba045.orlgmj (mgr.34412) 11179 : cluster [DBG] pgmap v6369: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:51.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:20:51 gibba015 bash[30343]: cluster 2021-03-10T17:20:50.240246+0000 mgr.gibba045.orlgmj (mgr.34412) 11179 : cluster [DBG] pgmap v6369: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:53.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:20:53 gibba015 bash[29377]: cluster 2021-03-10T17:20:52.242017+0000 mgr.gibba045.orlgmj (mgr.34412) 11180 : cluster [DBG] pgmap v6370: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:53.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:20:53 gibba015 bash[30343]: cluster 2021-03-10T17:20:52.242017+0000 mgr.gibba045.orlgmj (mgr.34412) 11180 : cluster [DBG] pgmap v6370: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:53.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:20:53 gibba045 bash[25517]: cluster 2021-03-10T17:20:52.242017+0000 mgr.gibba045.orlgmj (mgr.34412) 11180 : cluster [DBG] pgmap v6370: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:20:54 gibba045 bash[25517]: audit 2021-03-10T17:20:54.000696+0000 mon.c (mon.1) 3064 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:20:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:20:54 gibba045 bash[25517]: audit 2021-03-10T17:20:54.001390+0000 mon.c (mon.1) 3065 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:20:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:20:54 gibba045 bash[25517]: audit 2021-03-10T17:20:54.001847+0000 mon.a (mon.0) 2358 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:20:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:20:54 gibba045 bash[25517]: audit 2021-03-10T17:20:54.003042+0000 mon.a (mon.0) 2359 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:20:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:20:54 gibba045 bash[25517]: audit 2021-03-10T17:20:54.099210+0000 mon.c (mon.1) 3066 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T17:20:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:20:54 gibba045 bash[25517]: audit 2021-03-10T17:20:54.099932+0000 mon.c (mon.1) 3067 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:20:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:20:54 gibba045 bash[25517]: audit 2021-03-10T17:20:54.100428+0000 mon.a (mon.0) 2360 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T17:20:54.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:20:54 gibba045 bash[25517]: audit 2021-03-10T17:20:54.100661+0000 mon.c (mon.1) 3068 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:20:54.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:20:54 gibba045 bash[25517]: audit 2021-03-10T17:20:54.101366+0000 mon.c (mon.1) 3069 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:20:54.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:20:54 gibba045 bash[25517]: audit 2021-03-10T17:20:54.101980+0000 mon.a (mon.0) 2361 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:20:54.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:20:54 gibba045 bash[25517]: audit 2021-03-10T17:20:54.103199+0000 mon.a (mon.0) 2362 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:20:54.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:20:54 gibba045 bash[25517]: audit 2021-03-10T17:20:54.104022+0000 mon.a (mon.0) 2363 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:20:54.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:20:54 gibba015 bash[29377]: audit 2021-03-10T17:20:54.000696+0000 mon.c (mon.1) 3064 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:20:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:20:54 gibba015 bash[29377]: audit 2021-03-10T17:20:54.001390+0000 mon.c (mon.1) 3065 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:20:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:20:54 gibba015 bash[29377]: audit 2021-03-10T17:20:54.001847+0000 mon.a (mon.0) 2358 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:20:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:20:54 gibba015 bash[29377]: audit 2021-03-10T17:20:54.003042+0000 mon.a (mon.0) 2359 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:20:54.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:20:54 gibba015 bash[29377]: audit 2021-03-10T17:20:54.099210+0000 mon.c (mon.1) 3066 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T17:20:54.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:20:54 gibba015 bash[29377]: audit 2021-03-10T17:20:54.099932+0000 mon.c (mon.1) 3067 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:20:54.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:20:54 gibba015 bash[29377]: audit 2021-03-10T17:20:54.100428+0000 mon.a (mon.0) 2360 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T17:20:54.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:20:54 gibba015 bash[29377]: audit 2021-03-10T17:20:54.100661+0000 mon.c (mon.1) 3068 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:20:54.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:20:54 gibba015 bash[29377]: audit 2021-03-10T17:20:54.101366+0000 mon.c (mon.1) 3069 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:20:54.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:20:54 gibba015 bash[29377]: audit 2021-03-10T17:20:54.101980+0000 mon.a (mon.0) 2361 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:20:54.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:20:54 gibba015 bash[29377]: audit 2021-03-10T17:20:54.103199+0000 mon.a (mon.0) 2362 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:20:54.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:20:54 gibba015 bash[29377]: audit 2021-03-10T17:20:54.104022+0000 mon.a (mon.0) 2363 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:20:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:20:54 gibba015 bash[30343]: audit 2021-03-10T17:20:54.000696+0000 mon.c (mon.1) 3064 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:20:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:20:54 gibba015 bash[30343]: audit 2021-03-10T17:20:54.001390+0000 mon.c (mon.1) 3065 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:20:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:20:54 gibba015 bash[30343]: audit 2021-03-10T17:20:54.001847+0000 mon.a (mon.0) 2358 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:20:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:20:54 gibba015 bash[30343]: audit 2021-03-10T17:20:54.003042+0000 mon.a (mon.0) 2359 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:20:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:20:54 gibba015 bash[30343]: audit 2021-03-10T17:20:54.099210+0000 mon.c (mon.1) 3066 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T17:20:54.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:20:54 gibba015 bash[30343]: audit 2021-03-10T17:20:54.099932+0000 mon.c (mon.1) 3067 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:20:54.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:20:54 gibba015 bash[30343]: audit 2021-03-10T17:20:54.100428+0000 mon.a (mon.0) 2360 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T17:20:54.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:20:54 gibba015 bash[30343]: audit 2021-03-10T17:20:54.100661+0000 mon.c (mon.1) 3068 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:20:54.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:20:54 gibba015 bash[30343]: audit 2021-03-10T17:20:54.101366+0000 mon.c (mon.1) 3069 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:20:54.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:20:54 gibba015 bash[30343]: audit 2021-03-10T17:20:54.101980+0000 mon.a (mon.0) 2361 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:20:54.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:20:54 gibba015 bash[30343]: audit 2021-03-10T17:20:54.103199+0000 mon.a (mon.0) 2362 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:20:54.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:20:54 gibba015 bash[30343]: audit 2021-03-10T17:20:54.104022+0000 mon.a (mon.0) 2363 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:20:55.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:20:55 gibba015 bash[29377]: cluster 2021-03-10T17:20:54.243350+0000 mgr.gibba045.orlgmj (mgr.34412) 11181 : cluster [DBG] pgmap v6371: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:55.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:20:55 gibba015 bash[29377]: cephadm 2021-03-10T17:20:54.272790+0000 mgr.gibba045.orlgmj (mgr.34412) 11182 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:20:55.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:20:55 gibba015 bash[30343]: cluster 2021-03-10T17:20:54.243350+0000 mgr.gibba045.orlgmj (mgr.34412) 11181 : cluster [DBG] pgmap v6371: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:55.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:20:55 gibba015 bash[30343]: cephadm 2021-03-10T17:20:54.272790+0000 mgr.gibba045.orlgmj (mgr.34412) 11182 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:20:55.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:20:55 gibba045 bash[25517]: cluster 2021-03-10T17:20:54.243350+0000 mgr.gibba045.orlgmj (mgr.34412) 11181 : cluster [DBG] pgmap v6371: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:55.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:20:55 gibba045 bash[25517]: cephadm 2021-03-10T17:20:54.272790+0000 mgr.gibba045.orlgmj (mgr.34412) 11182 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:20:57.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:20:57 gibba015 bash[29377]: cluster 2021-03-10T17:20:56.245022+0000 mgr.gibba045.orlgmj (mgr.34412) 11183 : cluster [DBG] pgmap v6372: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:57.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:20:57 gibba015 bash[30343]: cluster 2021-03-10T17:20:56.245022+0000 mgr.gibba045.orlgmj (mgr.34412) 11183 : cluster [DBG] pgmap v6372: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:57.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:20:57 gibba045 bash[25517]: cluster 2021-03-10T17:20:56.245022+0000 mgr.gibba045.orlgmj (mgr.34412) 11183 : cluster [DBG] pgmap v6372: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:58.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:20:58 gibba015 bash[29377]: cluster 2021-03-10T17:20:58.246423+0000 mgr.gibba045.orlgmj (mgr.34412) 11184 : cluster [DBG] pgmap v6373: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:58.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:20:58 gibba015 bash[30343]: cluster 2021-03-10T17:20:58.246423+0000 mgr.gibba045.orlgmj (mgr.34412) 11184 : cluster [DBG] pgmap v6373: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:59.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:20:58 gibba045 bash[25517]: cluster 2021-03-10T17:20:58.246423+0000 mgr.gibba045.orlgmj (mgr.34412) 11184 : cluster [DBG] pgmap v6373: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:01.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:21:01 gibba015 bash[29377]: cluster 2021-03-10T17:21:00.248068+0000 mgr.gibba045.orlgmj (mgr.34412) 11185 : cluster [DBG] pgmap v6374: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:01.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:21:01 gibba015 bash[30343]: cluster 2021-03-10T17:21:00.248068+0000 mgr.gibba045.orlgmj (mgr.34412) 11185 : cluster [DBG] pgmap v6374: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:01.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:21:01 gibba045 bash[25517]: cluster 2021-03-10T17:21:00.248068+0000 mgr.gibba045.orlgmj (mgr.34412) 11185 : cluster [DBG] pgmap v6374: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:03.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:21:03 gibba015 bash[29377]: cluster 2021-03-10T17:21:02.249706+0000 mgr.gibba045.orlgmj (mgr.34412) 11186 : cluster [DBG] pgmap v6375: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:03.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:21:03 gibba015 bash[30343]: cluster 2021-03-10T17:21:02.249706+0000 mgr.gibba045.orlgmj (mgr.34412) 11186 : cluster [DBG] pgmap v6375: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:03.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:21:03 gibba045 bash[25517]: cluster 2021-03-10T17:21:02.249706+0000 mgr.gibba045.orlgmj (mgr.34412) 11186 : cluster [DBG] pgmap v6375: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:05.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:21:05 gibba015 bash[29377]: cluster 2021-03-10T17:21:04.250970+0000 mgr.gibba045.orlgmj (mgr.34412) 11187 : cluster [DBG] pgmap v6376: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:05.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:21:05 gibba015 bash[30343]: cluster 2021-03-10T17:21:04.250970+0000 mgr.gibba045.orlgmj (mgr.34412) 11187 : cluster [DBG] pgmap v6376: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:05.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:21:05 gibba045 bash[25517]: cluster 2021-03-10T17:21:04.250970+0000 mgr.gibba045.orlgmj (mgr.34412) 11187 : cluster [DBG] pgmap v6376: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:07.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:21:07 gibba015 bash[29377]: cluster 2021-03-10T17:21:06.252628+0000 mgr.gibba045.orlgmj (mgr.34412) 11188 : cluster [DBG] pgmap v6377: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:07.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:21:07 gibba015 bash[30343]: cluster 2021-03-10T17:21:06.252628+0000 mgr.gibba045.orlgmj (mgr.34412) 11188 : cluster [DBG] pgmap v6377: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:07.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:21:07 gibba045 bash[25517]: cluster 2021-03-10T17:21:06.252628+0000 mgr.gibba045.orlgmj (mgr.34412) 11188 : cluster [DBG] pgmap v6377: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:08.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:21:08 gibba015 bash[29377]: cluster 2021-03-10T17:21:08.254114+0000 mgr.gibba045.orlgmj (mgr.34412) 11189 : cluster [DBG] pgmap v6378: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:08.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:21:08 gibba015 bash[30343]: cluster 2021-03-10T17:21:08.254114+0000 mgr.gibba045.orlgmj (mgr.34412) 11189 : cluster [DBG] pgmap v6378: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:09.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:21:08 gibba045 bash[25517]: cluster 2021-03-10T17:21:08.254114+0000 mgr.gibba045.orlgmj (mgr.34412) 11189 : cluster [DBG] pgmap v6378: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:09.215 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:21:09.442 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:21:09.443 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 3m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:21:09.443 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 2m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:21:09.443 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:21:09.443 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:21:09.444 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:21:09.444 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:21:09.444 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:21:09.444 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:21:09.445 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 3m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:21:09.445 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 2m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:21:09.445 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:21:09.445 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:21:09.446 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:21:09.446 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:21:09.446 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:21:09.446 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:21:09.447 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:21:09.447 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:21:09.447 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 2m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:21:09.447 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 2m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:21:09.693 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:21:09.693 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:21:09.693 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:21:09.694 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:21:09.694 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:21:09.694 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:21:09.694 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:21:09.695 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:21:09.695 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:21:09.695 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:21:09.695 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:21:09.695 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:21:09.696 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:21:09.696 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:21:09.696 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:21:09.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:21:09 gibba015 bash[29377]: audit 2021-03-10T17:21:09.207218+0000 mgr.gibba045.orlgmj (mgr.34412) 11190 : audit [DBG] from='client.51558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:21:09.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:21:09 gibba015 bash[29377]: cephadm 2021-03-10T17:21:09.288651+0000 mgr.gibba045.orlgmj (mgr.34412) 11191 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:21:09.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:21:09 gibba015 bash[29377]: audit 2021-03-10T17:21:09.430170+0000 mgr.gibba045.orlgmj (mgr.34412) 11192 : audit [DBG] from='client.51564 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:21:09.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:21:09 gibba015 bash[29377]: audit 2021-03-10T17:21:09.691942+0000 mon.a (mon.0) 2364 : audit [DBG] from='client.? 172.21.2.115:0/899760571' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:21:09.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:21:09 gibba015 bash[30343]: audit 2021-03-10T17:21:09.207218+0000 mgr.gibba045.orlgmj (mgr.34412) 11190 : audit [DBG] from='client.51558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:21:09.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:21:09 gibba015 bash[30343]: cephadm 2021-03-10T17:21:09.288651+0000 mgr.gibba045.orlgmj (mgr.34412) 11191 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:21:09.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:21:09 gibba015 bash[30343]: audit 2021-03-10T17:21:09.430170+0000 mgr.gibba045.orlgmj (mgr.34412) 11192 : audit [DBG] from='client.51564 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:21:09.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:21:09 gibba015 bash[30343]: audit 2021-03-10T17:21:09.691942+0000 mon.a (mon.0) 2364 : audit [DBG] from='client.? 172.21.2.115:0/899760571' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:21:10.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:21:09 gibba045 bash[25517]: audit 2021-03-10T17:21:09.207218+0000 mgr.gibba045.orlgmj (mgr.34412) 11190 : audit [DBG] from='client.51558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:21:10.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:21:09 gibba045 bash[25517]: cephadm 2021-03-10T17:21:09.288651+0000 mgr.gibba045.orlgmj (mgr.34412) 11191 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:21:10.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:21:09 gibba045 bash[25517]: audit 2021-03-10T17:21:09.430170+0000 mgr.gibba045.orlgmj (mgr.34412) 11192 : audit [DBG] from='client.51564 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:21:10.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:21:09 gibba045 bash[25517]: audit 2021-03-10T17:21:09.691942+0000 mon.a (mon.0) 2364 : audit [DBG] from='client.? 172.21.2.115:0/899760571' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:21:11.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:21:10 gibba045 bash[25517]: cluster 2021-03-10T17:21:10.255721+0000 mgr.gibba045.orlgmj (mgr.34412) 11193 : cluster [DBG] pgmap v6379: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:11.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:21:10 gibba015 bash[29377]: cluster 2021-03-10T17:21:10.255721+0000 mgr.gibba045.orlgmj (mgr.34412) 11193 : cluster [DBG] pgmap v6379: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:11.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:21:10 gibba015 bash[30343]: cluster 2021-03-10T17:21:10.255721+0000 mgr.gibba045.orlgmj (mgr.34412) 11193 : cluster [DBG] pgmap v6379: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:13.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:21:13 gibba015 bash[29377]: cluster 2021-03-10T17:21:12.257271+0000 mgr.gibba045.orlgmj (mgr.34412) 11194 : cluster [DBG] pgmap v6380: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:13.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:21:13 gibba015 bash[30343]: cluster 2021-03-10T17:21:12.257271+0000 mgr.gibba045.orlgmj (mgr.34412) 11194 : cluster [DBG] pgmap v6380: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:13.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:21:13 gibba045 bash[25517]: cluster 2021-03-10T17:21:12.257271+0000 mgr.gibba045.orlgmj (mgr.34412) 11194 : cluster [DBG] pgmap v6380: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:15.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:21:15 gibba015 bash[29377]: cluster 2021-03-10T17:21:14.258532+0000 mgr.gibba045.orlgmj (mgr.34412) 11195 : cluster [DBG] pgmap v6381: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:15.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:21:15 gibba015 bash[30343]: cluster 2021-03-10T17:21:14.258532+0000 mgr.gibba045.orlgmj (mgr.34412) 11195 : cluster [DBG] pgmap v6381: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:15.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:21:15 gibba045 bash[25517]: cluster 2021-03-10T17:21:14.258532+0000 mgr.gibba045.orlgmj (mgr.34412) 11195 : cluster [DBG] pgmap v6381: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:17.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:21:17 gibba015 bash[29377]: cluster 2021-03-10T17:21:16.260151+0000 mgr.gibba045.orlgmj (mgr.34412) 11196 : cluster [DBG] pgmap v6382: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:17.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:21:17 gibba015 bash[30343]: cluster 2021-03-10T17:21:16.260151+0000 mgr.gibba045.orlgmj (mgr.34412) 11196 : cluster [DBG] pgmap v6382: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:17.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:21:17 gibba045 bash[25517]: cluster 2021-03-10T17:21:16.260151+0000 mgr.gibba045.orlgmj (mgr.34412) 11196 : cluster [DBG] pgmap v6382: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:18.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:21:18 gibba015 bash[29377]: cluster 2021-03-10T17:21:18.261891+0000 mgr.gibba045.orlgmj (mgr.34412) 11197 : cluster [DBG] pgmap v6383: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:18.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:21:18 gibba015 bash[30343]: cluster 2021-03-10T17:21:18.261891+0000 mgr.gibba045.orlgmj (mgr.34412) 11197 : cluster [DBG] pgmap v6383: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:19.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:21:18 gibba045 bash[25517]: cluster 2021-03-10T17:21:18.261891+0000 mgr.gibba045.orlgmj (mgr.34412) 11197 : cluster [DBG] pgmap v6383: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:21.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:21:21 gibba015 bash[29377]: cluster 2021-03-10T17:21:20.263308+0000 mgr.gibba045.orlgmj (mgr.34412) 11198 : cluster [DBG] pgmap v6384: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:21.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:21:21 gibba015 bash[30343]: cluster 2021-03-10T17:21:20.263308+0000 mgr.gibba045.orlgmj (mgr.34412) 11198 : cluster [DBG] pgmap v6384: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:21.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:21:21 gibba045 bash[25517]: cluster 2021-03-10T17:21:20.263308+0000 mgr.gibba045.orlgmj (mgr.34412) 11198 : cluster [DBG] pgmap v6384: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:23.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:21:23 gibba015 bash[29377]: cluster 2021-03-10T17:21:22.265088+0000 mgr.gibba045.orlgmj (mgr.34412) 11199 : cluster [DBG] pgmap v6385: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:23.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:21:23 gibba015 bash[30343]: cluster 2021-03-10T17:21:22.265088+0000 mgr.gibba045.orlgmj (mgr.34412) 11199 : cluster [DBG] pgmap v6385: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:23.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:21:23 gibba045 bash[25517]: cluster 2021-03-10T17:21:22.265088+0000 mgr.gibba045.orlgmj (mgr.34412) 11199 : cluster [DBG] pgmap v6385: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:25.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:21:25 gibba015 bash[29377]: cluster 2021-03-10T17:21:24.266302+0000 mgr.gibba045.orlgmj (mgr.34412) 11200 : cluster [DBG] pgmap v6386: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:25.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:21:25 gibba015 bash[29377]: cephadm 2021-03-10T17:21:24.301246+0000 mgr.gibba045.orlgmj (mgr.34412) 11201 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:21:25.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:21:25 gibba015 bash[30343]: cluster 2021-03-10T17:21:24.266302+0000 mgr.gibba045.orlgmj (mgr.34412) 11200 : cluster [DBG] pgmap v6386: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:25.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:21:25 gibba015 bash[30343]: cephadm 2021-03-10T17:21:24.301246+0000 mgr.gibba045.orlgmj (mgr.34412) 11201 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:21:25.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:21:25 gibba045 bash[25517]: cluster 2021-03-10T17:21:24.266302+0000 mgr.gibba045.orlgmj (mgr.34412) 11200 : cluster [DBG] pgmap v6386: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:25.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:21:25 gibba045 bash[25517]: cephadm 2021-03-10T17:21:24.301246+0000 mgr.gibba045.orlgmj (mgr.34412) 11201 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:21:27.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:21:27 gibba015 bash[29377]: cluster 2021-03-10T17:21:26.268082+0000 mgr.gibba045.orlgmj (mgr.34412) 11202 : cluster [DBG] pgmap v6387: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:27.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:21:27 gibba015 bash[30343]: cluster 2021-03-10T17:21:26.268082+0000 mgr.gibba045.orlgmj (mgr.34412) 11202 : cluster [DBG] pgmap v6387: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:27.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:21:27 gibba045 bash[25517]: cluster 2021-03-10T17:21:26.268082+0000 mgr.gibba045.orlgmj (mgr.34412) 11202 : cluster [DBG] pgmap v6387: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:29.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:21:28 gibba045 bash[25517]: cluster 2021-03-10T17:21:28.269668+0000 mgr.gibba045.orlgmj (mgr.34412) 11203 : cluster [DBG] pgmap v6388: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:29.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:21:28 gibba015 bash[29377]: cluster 2021-03-10T17:21:28.269668+0000 mgr.gibba045.orlgmj (mgr.34412) 11203 : cluster [DBG] pgmap v6388: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:29.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:21:28 gibba015 bash[30343]: cluster 2021-03-10T17:21:28.269668+0000 mgr.gibba045.orlgmj (mgr.34412) 11203 : cluster [DBG] pgmap v6388: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:31.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:21:31 gibba015 bash[29377]: cluster 2021-03-10T17:21:30.271222+0000 mgr.gibba045.orlgmj (mgr.34412) 11204 : cluster [DBG] pgmap v6389: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:31.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:21:31 gibba015 bash[30343]: cluster 2021-03-10T17:21:30.271222+0000 mgr.gibba045.orlgmj (mgr.34412) 11204 : cluster [DBG] pgmap v6389: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:31.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:21:31 gibba045 bash[25517]: cluster 2021-03-10T17:21:30.271222+0000 mgr.gibba045.orlgmj (mgr.34412) 11204 : cluster [DBG] pgmap v6389: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:33.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:21:33 gibba015 bash[29377]: cluster 2021-03-10T17:21:32.272994+0000 mgr.gibba045.orlgmj (mgr.34412) 11205 : cluster [DBG] pgmap v6390: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:33.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:21:33 gibba015 bash[30343]: cluster 2021-03-10T17:21:32.272994+0000 mgr.gibba045.orlgmj (mgr.34412) 11205 : cluster [DBG] pgmap v6390: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:33.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:21:33 gibba045 bash[25517]: cluster 2021-03-10T17:21:32.272994+0000 mgr.gibba045.orlgmj (mgr.34412) 11205 : cluster [DBG] pgmap v6390: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:35.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:21:35 gibba015 bash[29377]: cluster 2021-03-10T17:21:34.274210+0000 mgr.gibba045.orlgmj (mgr.34412) 11206 : cluster [DBG] pgmap v6391: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:35.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:21:35 gibba015 bash[30343]: cluster 2021-03-10T17:21:34.274210+0000 mgr.gibba045.orlgmj (mgr.34412) 11206 : cluster [DBG] pgmap v6391: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:35.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:21:35 gibba045 bash[25517]: cluster 2021-03-10T17:21:34.274210+0000 mgr.gibba045.orlgmj (mgr.34412) 11206 : cluster [DBG] pgmap v6391: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:37.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:21:37 gibba015 bash[29377]: cluster 2021-03-10T17:21:36.276002+0000 mgr.gibba045.orlgmj (mgr.34412) 11207 : cluster [DBG] pgmap v6392: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:37.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:21:37 gibba015 bash[30343]: cluster 2021-03-10T17:21:36.276002+0000 mgr.gibba045.orlgmj (mgr.34412) 11207 : cluster [DBG] pgmap v6392: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:37.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:21:37 gibba045 bash[25517]: cluster 2021-03-10T17:21:36.276002+0000 mgr.gibba045.orlgmj (mgr.34412) 11207 : cluster [DBG] pgmap v6392: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:39.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:21:38 gibba045 bash[25517]: cluster 2021-03-10T17:21:38.277482+0000 mgr.gibba045.orlgmj (mgr.34412) 11208 : cluster [DBG] pgmap v6393: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:39.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:21:38 gibba015 bash[29377]: cluster 2021-03-10T17:21:38.277482+0000 mgr.gibba045.orlgmj (mgr.34412) 11208 : cluster [DBG] pgmap v6393: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:39.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:21:38 gibba015 bash[30343]: cluster 2021-03-10T17:21:38.277482+0000 mgr.gibba045.orlgmj (mgr.34412) 11208 : cluster [DBG] pgmap v6393: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:39.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:21:39 gibba045 bash[25517]: audit 2021-03-10T17:21:39.315962+0000 mon.c (mon.1) 3070 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:21:39.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:21:39 gibba045 bash[25517]: cephadm 2021-03-10T17:21:39.322644+0000 mgr.gibba045.orlgmj (mgr.34412) 11209 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:21:39.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:21:39 gibba045 bash[25517]: cephadm 2021-03-10T17:21:39.324617+0000 mgr.gibba045.orlgmj (mgr.34412) 11210 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:21:39.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:21:39 gibba045 bash[25517]: audit 2021-03-10T17:21:39.527448+0000 mon.a (mon.0) 2365 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:21:39.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:21:39 gibba045 bash[25517]: audit 2021-03-10T17:21:39.531375+0000 mon.c (mon.1) 3071 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:21:39.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:21:39 gibba045 bash[25517]: cephadm 2021-03-10T17:21:39.532265+0000 mgr.gibba045.orlgmj (mgr.34412) 11211 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:21:39.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:21:39 gibba045 bash[25517]: audit 2021-03-10T17:21:39.534779+0000 mon.c (mon.1) 3072 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:21:39.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:21:39 gibba045 bash[25517]: cephadm 2021-03-10T17:21:39.535917+0000 mgr.gibba045.orlgmj (mgr.34412) 11212 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:21:39.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:21:39 gibba045 bash[25517]: audit 2021-03-10T17:21:39.537383+0000 mon.c (mon.1) 3073 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:21:39.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:21:39 gibba045 bash[25517]: cephadm 2021-03-10T17:21:39.538689+0000 mgr.gibba045.orlgmj (mgr.34412) 11213 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:21:39.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:21:39 gibba045 bash[25517]: cephadm 2021-03-10T17:21:39.538726+0000 mgr.gibba045.orlgmj (mgr.34412) 11214 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:21:39.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:21:39 gibba045 bash[25517]: audit 2021-03-10T17:21:39.540269+0000 mon.c (mon.1) 3074 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:21:39.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:21:39 gibba045 bash[25517]: cephadm 2021-03-10T17:21:39.541405+0000 mgr.gibba045.orlgmj (mgr.34412) 11215 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:21:39.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:21:39 gibba045 bash[25517]: cephadm 2021-03-10T17:21:39.541447+0000 mgr.gibba045.orlgmj (mgr.34412) 11216 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:21:39.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:21:39 gibba045 bash[25517]: cephadm 2021-03-10T17:21:39.544002+0000 mgr.gibba045.orlgmj (mgr.34412) 11217 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:21:39.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:21:39 gibba045 bash[25517]: audit 2021-03-10T17:21:39.546592+0000 mon.c (mon.1) 3075 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:21:39.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:21:39 gibba045 bash[25517]: cephadm 2021-03-10T17:21:39.547807+0000 mgr.gibba045.orlgmj (mgr.34412) 11218 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:21:39.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:21:39 gibba045 bash[25517]: cephadm 2021-03-10T17:21:39.547844+0000 mgr.gibba045.orlgmj (mgr.34412) 11219 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:21:39.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:21:39 gibba045 bash[25517]: audit 2021-03-10T17:21:39.549553+0000 mon.c (mon.1) 3076 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:21:39.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:21:39 gibba045 bash[25517]: cephadm 2021-03-10T17:21:39.550505+0000 mgr.gibba045.orlgmj (mgr.34412) 11220 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:21:39.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:21:39 gibba045 bash[25517]: cephadm 2021-03-10T17:21:39.550929+0000 mgr.gibba045.orlgmj (mgr.34412) 11221 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:21:39.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:21:39 gibba045 bash[25517]: cephadm 2021-03-10T17:21:39.553640+0000 mgr.gibba045.orlgmj (mgr.34412) 11222 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:21:39.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:21:39 gibba045 bash[25517]: cephadm 2021-03-10T17:21:39.553682+0000 mgr.gibba045.orlgmj (mgr.34412) 11223 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:21:39.812 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:21:39 gibba045 bash[25517]: cephadm 2021-03-10T17:21:39.553809+0000 mgr.gibba045.orlgmj (mgr.34412) 11224 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:21:39.952 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:21:40.179 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:21:40.179 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 4m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:21:40.179 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 3m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:21:40.180 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:21:40.180 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:21:40.180 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:21:40.180 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:21:40.180 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:21:40.181 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:21:40.181 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 4m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:21:40.181 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 3m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:21:40.181 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:21:40.182 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:21:40.182 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:21:40.182 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:21:40.182 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:21:40.183 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:21:40.183 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:21:40.183 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:21:40.183 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 3m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:21:40.183 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 3m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:21:40.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:21:39 gibba015 bash[29377]: audit 2021-03-10T17:21:39.315962+0000 mon.c (mon.1) 3070 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:21:40.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:21:39 gibba015 bash[29377]: cephadm 2021-03-10T17:21:39.322644+0000 mgr.gibba045.orlgmj (mgr.34412) 11209 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:21:40.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:21:39 gibba015 bash[29377]: cephadm 2021-03-10T17:21:39.324617+0000 mgr.gibba045.orlgmj (mgr.34412) 11210 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:21:40.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:21:39 gibba015 bash[29377]: audit 2021-03-10T17:21:39.527448+0000 mon.a (mon.0) 2365 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:21:40.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:21:39 gibba015 bash[29377]: audit 2021-03-10T17:21:39.531375+0000 mon.c (mon.1) 3071 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:21:40.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:21:39 gibba015 bash[29377]: cephadm 2021-03-10T17:21:39.532265+0000 mgr.gibba045.orlgmj (mgr.34412) 11211 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:21:40.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:21:39 gibba015 bash[29377]: audit 2021-03-10T17:21:39.534779+0000 mon.c (mon.1) 3072 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:21:40.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:21:39 gibba015 bash[29377]: cephadm 2021-03-10T17:21:39.535917+0000 mgr.gibba045.orlgmj (mgr.34412) 11212 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:21:40.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:21:39 gibba015 bash[29377]: audit 2021-03-10T17:21:39.537383+0000 mon.c (mon.1) 3073 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:21:40.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:21:39 gibba015 bash[29377]: cephadm 2021-03-10T17:21:39.538689+0000 mgr.gibba045.orlgmj (mgr.34412) 11213 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:21:40.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:21:39 gibba015 bash[29377]: cephadm 2021-03-10T17:21:39.538726+0000 mgr.gibba045.orlgmj (mgr.34412) 11214 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:21:40.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:21:39 gibba015 bash[29377]: audit 2021-03-10T17:21:39.540269+0000 mon.c (mon.1) 3074 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:21:40.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:21:39 gibba015 bash[29377]: cephadm 2021-03-10T17:21:39.541405+0000 mgr.gibba045.orlgmj (mgr.34412) 11215 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:21:40.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:21:39 gibba015 bash[29377]: cephadm 2021-03-10T17:21:39.541447+0000 mgr.gibba045.orlgmj (mgr.34412) 11216 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:21:40.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:21:39 gibba015 bash[29377]: cephadm 2021-03-10T17:21:39.544002+0000 mgr.gibba045.orlgmj (mgr.34412) 11217 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:21:40.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:21:39 gibba015 bash[29377]: audit 2021-03-10T17:21:39.546592+0000 mon.c (mon.1) 3075 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:21:40.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:21:39 gibba015 bash[29377]: cephadm 2021-03-10T17:21:39.547807+0000 mgr.gibba045.orlgmj (mgr.34412) 11218 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:21:40.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:21:39 gibba015 bash[29377]: cephadm 2021-03-10T17:21:39.547844+0000 mgr.gibba045.orlgmj (mgr.34412) 11219 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:21:40.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:21:39 gibba015 bash[29377]: audit 2021-03-10T17:21:39.549553+0000 mon.c (mon.1) 3076 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:21:40.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:21:39 gibba015 bash[29377]: cephadm 2021-03-10T17:21:39.550505+0000 mgr.gibba045.orlgmj (mgr.34412) 11220 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:21:40.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:21:39 gibba015 bash[30343]: audit 2021-03-10T17:21:39.315962+0000 mon.c (mon.1) 3070 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:21:40.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:21:39 gibba015 bash[30343]: cephadm 2021-03-10T17:21:39.322644+0000 mgr.gibba045.orlgmj (mgr.34412) 11209 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:21:40.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:21:39 gibba015 bash[30343]: cephadm 2021-03-10T17:21:39.324617+0000 mgr.gibba045.orlgmj (mgr.34412) 11210 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:21:40.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:21:39 gibba015 bash[30343]: audit 2021-03-10T17:21:39.527448+0000 mon.a (mon.0) 2365 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:21:40.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:21:39 gibba015 bash[30343]: audit 2021-03-10T17:21:39.531375+0000 mon.c (mon.1) 3071 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:21:40.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:21:39 gibba015 bash[30343]: cephadm 2021-03-10T17:21:39.532265+0000 mgr.gibba045.orlgmj (mgr.34412) 11211 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:21:40.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:21:39 gibba015 bash[30343]: audit 2021-03-10T17:21:39.534779+0000 mon.c (mon.1) 3072 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:21:40.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:21:39 gibba015 bash[30343]: cephadm 2021-03-10T17:21:39.535917+0000 mgr.gibba045.orlgmj (mgr.34412) 11212 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:21:40.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:21:39 gibba015 bash[30343]: audit 2021-03-10T17:21:39.537383+0000 mon.c (mon.1) 3073 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:21:40.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:21:39 gibba015 bash[30343]: cephadm 2021-03-10T17:21:39.538689+0000 mgr.gibba045.orlgmj (mgr.34412) 11213 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:21:40.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:21:39 gibba015 bash[30343]: cephadm 2021-03-10T17:21:39.538726+0000 mgr.gibba045.orlgmj (mgr.34412) 11214 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:21:40.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:21:39 gibba015 bash[30343]: audit 2021-03-10T17:21:39.540269+0000 mon.c (mon.1) 3074 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:21:40.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:21:39 gibba015 bash[30343]: cephadm 2021-03-10T17:21:39.541405+0000 mgr.gibba045.orlgmj (mgr.34412) 11215 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:21:40.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:21:39 gibba015 bash[30343]: cephadm 2021-03-10T17:21:39.541447+0000 mgr.gibba045.orlgmj (mgr.34412) 11216 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:21:40.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:21:39 gibba015 bash[30343]: cephadm 2021-03-10T17:21:39.544002+0000 mgr.gibba045.orlgmj (mgr.34412) 11217 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:21:40.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:21:39 gibba015 bash[30343]: audit 2021-03-10T17:21:39.546592+0000 mon.c (mon.1) 3075 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:21:40.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:21:39 gibba015 bash[30343]: cephadm 2021-03-10T17:21:39.547807+0000 mgr.gibba045.orlgmj (mgr.34412) 11218 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:21:40.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:21:39 gibba015 bash[30343]: cephadm 2021-03-10T17:21:39.547844+0000 mgr.gibba045.orlgmj (mgr.34412) 11219 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:21:40.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:21:39 gibba015 bash[30343]: audit 2021-03-10T17:21:39.549553+0000 mon.c (mon.1) 3076 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:21:40.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:21:39 gibba015 bash[30343]: cephadm 2021-03-10T17:21:39.550505+0000 mgr.gibba045.orlgmj (mgr.34412) 11220 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:21:40.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:21:39 gibba015 bash[30343]: cephadm 2021-03-10T17:21:39.550929+0000 mgr.gibba045.orlgmj (mgr.34412) 11221 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:21:40.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:21:39 gibba015 bash[30343]: cephadm 2021-03-10T17:21:39.553640+0000 mgr.gibba045.orlgmj (mgr.34412) 11222 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:21:40.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:21:39 gibba015 bash[30343]: cephadm 2021-03-10T17:21:39.553682+0000 mgr.gibba045.orlgmj (mgr.34412) 11223 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:21:40.234 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:21:39 gibba015 bash[30343]: cephadm 2021-03-10T17:21:39.553809+0000 mgr.gibba045.orlgmj (mgr.34412) 11224 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:21:40.234 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:21:39 gibba015 bash[29377]: cephadm 2021-03-10T17:21:39.550929+0000 mgr.gibba045.orlgmj (mgr.34412) 11221 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:21:40.234 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:21:39 gibba015 bash[29377]: cephadm 2021-03-10T17:21:39.553640+0000 mgr.gibba045.orlgmj (mgr.34412) 11222 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:21:40.235 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:21:39 gibba015 bash[29377]: cephadm 2021-03-10T17:21:39.553682+0000 mgr.gibba045.orlgmj (mgr.34412) 11223 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:21:40.235 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:21:39 gibba015 bash[29377]: cephadm 2021-03-10T17:21:39.553809+0000 mgr.gibba045.orlgmj (mgr.34412) 11224 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:21:40.427 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:21:40.427 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:21:40.428 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:21:40.428 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:21:40.428 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:21:40.428 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:21:40.429 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:21:40.429 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:21:40.429 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:21:40.429 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:21:40.429 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:21:40.430 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:21:40.430 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:21:40.430 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:21:40.430 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:21:41.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:21:40 gibba045 bash[25517]: audit 2021-03-10T17:21:39.943253+0000 mgr.gibba045.orlgmj (mgr.34412) 11225 : audit [DBG] from='client.61564 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:21:41.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:21:40 gibba045 bash[25517]: audit 2021-03-10T17:21:40.167758+0000 mgr.gibba045.orlgmj (mgr.34412) 11226 : audit [DBG] from='client.61570 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:21:41.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:21:40 gibba045 bash[25517]: cluster 2021-03-10T17:21:40.279012+0000 mgr.gibba045.orlgmj (mgr.34412) 11227 : cluster [DBG] pgmap v6394: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:41.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:21:40 gibba045 bash[25517]: audit 2021-03-10T17:21:40.425847+0000 mon.c (mon.1) 3077 : audit [DBG] from='client.? 172.21.2.115:0/3444218576' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:21:41.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:21:40 gibba015 bash[29377]: audit 2021-03-10T17:21:39.943253+0000 mgr.gibba045.orlgmj (mgr.34412) 11225 : audit [DBG] from='client.61564 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:21:41.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:21:40 gibba015 bash[29377]: audit 2021-03-10T17:21:40.167758+0000 mgr.gibba045.orlgmj (mgr.34412) 11226 : audit [DBG] from='client.61570 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:21:41.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:21:40 gibba015 bash[29377]: cluster 2021-03-10T17:21:40.279012+0000 mgr.gibba045.orlgmj (mgr.34412) 11227 : cluster [DBG] pgmap v6394: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:41.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:21:40 gibba015 bash[29377]: audit 2021-03-10T17:21:40.425847+0000 mon.c (mon.1) 3077 : audit [DBG] from='client.? 172.21.2.115:0/3444218576' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:21:41.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:21:40 gibba015 bash[30343]: audit 2021-03-10T17:21:39.943253+0000 mgr.gibba045.orlgmj (mgr.34412) 11225 : audit [DBG] from='client.61564 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:21:41.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:21:40 gibba015 bash[30343]: audit 2021-03-10T17:21:40.167758+0000 mgr.gibba045.orlgmj (mgr.34412) 11226 : audit [DBG] from='client.61570 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:21:41.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:21:40 gibba015 bash[30343]: cluster 2021-03-10T17:21:40.279012+0000 mgr.gibba045.orlgmj (mgr.34412) 11227 : cluster [DBG] pgmap v6394: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:41.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:21:40 gibba015 bash[30343]: audit 2021-03-10T17:21:40.425847+0000 mon.c (mon.1) 3077 : audit [DBG] from='client.? 172.21.2.115:0/3444218576' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:21:43.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:21:43 gibba015 bash[29377]: cluster 2021-03-10T17:21:42.280724+0000 mgr.gibba045.orlgmj (mgr.34412) 11228 : cluster [DBG] pgmap v6395: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:43.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:21:43 gibba015 bash[30343]: cluster 2021-03-10T17:21:42.280724+0000 mgr.gibba045.orlgmj (mgr.34412) 11228 : cluster [DBG] pgmap v6395: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:43.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:21:43 gibba045 bash[25517]: cluster 2021-03-10T17:21:42.280724+0000 mgr.gibba045.orlgmj (mgr.34412) 11228 : cluster [DBG] pgmap v6395: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:45.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:21:45 gibba015 bash[29377]: cluster 2021-03-10T17:21:44.281885+0000 mgr.gibba045.orlgmj (mgr.34412) 11229 : cluster [DBG] pgmap v6396: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:45.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:21:45 gibba015 bash[30343]: cluster 2021-03-10T17:21:44.281885+0000 mgr.gibba045.orlgmj (mgr.34412) 11229 : cluster [DBG] pgmap v6396: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:45.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:21:45 gibba045 bash[25517]: cluster 2021-03-10T17:21:44.281885+0000 mgr.gibba045.orlgmj (mgr.34412) 11229 : cluster [DBG] pgmap v6396: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:47.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:21:47 gibba015 bash[29377]: cluster 2021-03-10T17:21:46.283592+0000 mgr.gibba045.orlgmj (mgr.34412) 11230 : cluster [DBG] pgmap v6397: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:47.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:21:47 gibba015 bash[30343]: cluster 2021-03-10T17:21:46.283592+0000 mgr.gibba045.orlgmj (mgr.34412) 11230 : cluster [DBG] pgmap v6397: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:47.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:21:47 gibba045 bash[25517]: cluster 2021-03-10T17:21:46.283592+0000 mgr.gibba045.orlgmj (mgr.34412) 11230 : cluster [DBG] pgmap v6397: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:49.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:21:48 gibba045 bash[25517]: cluster 2021-03-10T17:21:48.285156+0000 mgr.gibba045.orlgmj (mgr.34412) 11231 : cluster [DBG] pgmap v6398: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:49.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:21:48 gibba015 bash[29377]: cluster 2021-03-10T17:21:48.285156+0000 mgr.gibba045.orlgmj (mgr.34412) 11231 : cluster [DBG] pgmap v6398: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:49.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:21:48 gibba015 bash[30343]: cluster 2021-03-10T17:21:48.285156+0000 mgr.gibba045.orlgmj (mgr.34412) 11231 : cluster [DBG] pgmap v6398: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:51.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:21:51 gibba015 bash[29377]: cluster 2021-03-10T17:21:50.286791+0000 mgr.gibba045.orlgmj (mgr.34412) 11232 : cluster [DBG] pgmap v6399: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:51.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:21:51 gibba015 bash[30343]: cluster 2021-03-10T17:21:50.286791+0000 mgr.gibba045.orlgmj (mgr.34412) 11232 : cluster [DBG] pgmap v6399: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:51.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:21:51 gibba045 bash[25517]: cluster 2021-03-10T17:21:50.286791+0000 mgr.gibba045.orlgmj (mgr.34412) 11232 : cluster [DBG] pgmap v6399: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:53.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:21:53 gibba015 bash[29377]: cluster 2021-03-10T17:21:52.288625+0000 mgr.gibba045.orlgmj (mgr.34412) 11233 : cluster [DBG] pgmap v6400: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:53.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:21:53 gibba015 bash[30343]: cluster 2021-03-10T17:21:52.288625+0000 mgr.gibba045.orlgmj (mgr.34412) 11233 : cluster [DBG] pgmap v6400: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:53.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:21:53 gibba045 bash[25517]: cluster 2021-03-10T17:21:52.288625+0000 mgr.gibba045.orlgmj (mgr.34412) 11233 : cluster [DBG] pgmap v6400: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:21:54 gibba015 bash[29377]: audit 2021-03-10T17:21:54.009945+0000 mon.c (mon.1) 3078 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:21:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:21:54 gibba015 bash[29377]: audit 2021-03-10T17:21:54.010573+0000 mon.c (mon.1) 3079 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:21:54.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:21:54 gibba015 bash[29377]: audit 2021-03-10T17:21:54.011054+0000 mon.a (mon.0) 2366 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:21:54.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:21:54 gibba015 bash[29377]: audit 2021-03-10T17:21:54.012205+0000 mon.a (mon.0) 2367 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:21:54.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:21:54 gibba015 bash[29377]: audit 2021-03-10T17:21:54.110064+0000 mon.c (mon.1) 3080 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T17:21:54.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:21:54 gibba015 bash[29377]: audit 2021-03-10T17:21:54.110815+0000 mon.c (mon.1) 3081 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:21:54.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:21:54 gibba015 bash[29377]: audit 2021-03-10T17:21:54.111268+0000 mon.a (mon.0) 2368 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T17:21:54.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:21:54 gibba015 bash[29377]: audit 2021-03-10T17:21:54.111499+0000 mon.c (mon.1) 3082 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T17:21:54.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:21:54 gibba015 bash[29377]: audit 2021-03-10T17:21:54.112321+0000 mon.c (mon.1) 3083 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:21:54.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:21:54 gibba015 bash[29377]: audit 2021-03-10T17:21:54.112446+0000 mon.a (mon.0) 2369 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:21:54.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:21:54 gibba015 bash[29377]: audit 2021-03-10T17:21:54.113697+0000 mon.a (mon.0) 2370 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T17:21:54.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:21:54 gibba015 bash[29377]: audit 2021-03-10T17:21:54.114501+0000 mon.a (mon.0) 2371 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:21:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:21:54 gibba015 bash[30343]: audit 2021-03-10T17:21:54.009945+0000 mon.c (mon.1) 3078 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:21:54.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:21:54 gibba015 bash[30343]: audit 2021-03-10T17:21:54.010573+0000 mon.c (mon.1) 3079 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:21:54.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:21:54 gibba015 bash[30343]: audit 2021-03-10T17:21:54.011054+0000 mon.a (mon.0) 2366 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:21:54.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:21:54 gibba015 bash[30343]: audit 2021-03-10T17:21:54.012205+0000 mon.a (mon.0) 2367 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:21:54.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:21:54 gibba015 bash[30343]: audit 2021-03-10T17:21:54.110064+0000 mon.c (mon.1) 3080 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T17:21:54.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:21:54 gibba015 bash[30343]: audit 2021-03-10T17:21:54.110815+0000 mon.c (mon.1) 3081 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:21:54.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:21:54 gibba015 bash[30343]: audit 2021-03-10T17:21:54.111268+0000 mon.a (mon.0) 2368 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T17:21:54.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:21:54 gibba015 bash[30343]: audit 2021-03-10T17:21:54.111499+0000 mon.c (mon.1) 3082 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T17:21:54.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:21:54 gibba015 bash[30343]: audit 2021-03-10T17:21:54.112321+0000 mon.c (mon.1) 3083 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:21:54.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:21:54 gibba015 bash[30343]: audit 2021-03-10T17:21:54.112446+0000 mon.a (mon.0) 2369 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:21:54.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:21:54 gibba015 bash[30343]: audit 2021-03-10T17:21:54.113697+0000 mon.a (mon.0) 2370 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T17:21:54.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:21:54 gibba015 bash[30343]: audit 2021-03-10T17:21:54.114501+0000 mon.a (mon.0) 2371 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:21:54.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:21:54 gibba045 bash[25517]: audit 2021-03-10T17:21:54.009945+0000 mon.c (mon.1) 3078 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:21:54.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:21:54 gibba045 bash[25517]: audit 2021-03-10T17:21:54.010573+0000 mon.c (mon.1) 3079 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:21:54.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:21:54 gibba045 bash[25517]: audit 2021-03-10T17:21:54.011054+0000 mon.a (mon.0) 2366 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:21:54.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:21:54 gibba045 bash[25517]: audit 2021-03-10T17:21:54.012205+0000 mon.a (mon.0) 2367 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:21:54.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:21:54 gibba045 bash[25517]: audit 2021-03-10T17:21:54.110064+0000 mon.c (mon.1) 3080 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T17:21:54.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:21:54 gibba045 bash[25517]: audit 2021-03-10T17:21:54.110815+0000 mon.c (mon.1) 3081 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:21:54.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:21:54 gibba045 bash[25517]: audit 2021-03-10T17:21:54.111268+0000 mon.a (mon.0) 2368 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T17:21:54.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:21:54 gibba045 bash[25517]: audit 2021-03-10T17:21:54.111499+0000 mon.c (mon.1) 3082 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T17:21:54.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:21:54 gibba045 bash[25517]: audit 2021-03-10T17:21:54.112321+0000 mon.c (mon.1) 3083 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:21:54.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:21:54 gibba045 bash[25517]: audit 2021-03-10T17:21:54.112446+0000 mon.a (mon.0) 2369 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:21:54.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:21:54 gibba045 bash[25517]: audit 2021-03-10T17:21:54.113697+0000 mon.a (mon.0) 2370 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T17:21:54.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:21:54 gibba045 bash[25517]: audit 2021-03-10T17:21:54.114501+0000 mon.a (mon.0) 2371 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:21:55.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:21:55 gibba015 bash[29377]: cluster 2021-03-10T17:21:54.290159+0000 mgr.gibba045.orlgmj (mgr.34412) 11234 : cluster [DBG] pgmap v6401: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:55.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:21:55 gibba015 bash[29377]: cephadm 2021-03-10T17:21:54.556562+0000 mgr.gibba045.orlgmj (mgr.34412) 11235 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:21:55.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:21:55 gibba015 bash[30343]: cluster 2021-03-10T17:21:54.290159+0000 mgr.gibba045.orlgmj (mgr.34412) 11234 : cluster [DBG] pgmap v6401: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:55.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:21:55 gibba015 bash[30343]: cephadm 2021-03-10T17:21:54.556562+0000 mgr.gibba045.orlgmj (mgr.34412) 11235 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:21:55.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:21:55 gibba045 bash[25517]: cluster 2021-03-10T17:21:54.290159+0000 mgr.gibba045.orlgmj (mgr.34412) 11234 : cluster [DBG] pgmap v6401: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:55.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:21:55 gibba045 bash[25517]: cephadm 2021-03-10T17:21:54.556562+0000 mgr.gibba045.orlgmj (mgr.34412) 11235 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:21:57.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:21:57 gibba015 bash[29377]: cluster 2021-03-10T17:21:56.291631+0000 mgr.gibba045.orlgmj (mgr.34412) 11236 : cluster [DBG] pgmap v6402: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:57.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:21:57 gibba015 bash[30343]: cluster 2021-03-10T17:21:56.291631+0000 mgr.gibba045.orlgmj (mgr.34412) 11236 : cluster [DBG] pgmap v6402: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:57.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:21:57 gibba045 bash[25517]: cluster 2021-03-10T17:21:56.291631+0000 mgr.gibba045.orlgmj (mgr.34412) 11236 : cluster [DBG] pgmap v6402: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:59.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:21:58 gibba045 bash[25517]: cluster 2021-03-10T17:21:58.293307+0000 mgr.gibba045.orlgmj (mgr.34412) 11237 : cluster [DBG] pgmap v6403: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:59.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:21:58 gibba015 bash[29377]: cluster 2021-03-10T17:21:58.293307+0000 mgr.gibba045.orlgmj (mgr.34412) 11237 : cluster [DBG] pgmap v6403: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:59.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:21:58 gibba015 bash[30343]: cluster 2021-03-10T17:21:58.293307+0000 mgr.gibba045.orlgmj (mgr.34412) 11237 : cluster [DBG] pgmap v6403: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:01.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:22:01 gibba015 bash[29377]: cluster 2021-03-10T17:22:00.294944+0000 mgr.gibba045.orlgmj (mgr.34412) 11238 : cluster [DBG] pgmap v6404: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:01.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:22:01 gibba015 bash[30343]: cluster 2021-03-10T17:22:00.294944+0000 mgr.gibba045.orlgmj (mgr.34412) 11238 : cluster [DBG] pgmap v6404: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:01.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:22:01 gibba045 bash[25517]: cluster 2021-03-10T17:22:00.294944+0000 mgr.gibba045.orlgmj (mgr.34412) 11238 : cluster [DBG] pgmap v6404: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:03.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:22:03 gibba015 bash[29377]: cluster 2021-03-10T17:22:02.296790+0000 mgr.gibba045.orlgmj (mgr.34412) 11239 : cluster [DBG] pgmap v6405: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:03.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:22:03 gibba015 bash[30343]: cluster 2021-03-10T17:22:02.296790+0000 mgr.gibba045.orlgmj (mgr.34412) 11239 : cluster [DBG] pgmap v6405: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:03.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:22:03 gibba045 bash[25517]: cluster 2021-03-10T17:22:02.296790+0000 mgr.gibba045.orlgmj (mgr.34412) 11239 : cluster [DBG] pgmap v6405: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:05.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:22:05 gibba015 bash[29377]: cluster 2021-03-10T17:22:04.298046+0000 mgr.gibba045.orlgmj (mgr.34412) 11240 : cluster [DBG] pgmap v6406: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:05.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:22:05 gibba015 bash[30343]: cluster 2021-03-10T17:22:04.298046+0000 mgr.gibba045.orlgmj (mgr.34412) 11240 : cluster [DBG] pgmap v6406: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:05.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:22:05 gibba045 bash[25517]: cluster 2021-03-10T17:22:04.298046+0000 mgr.gibba045.orlgmj (mgr.34412) 11240 : cluster [DBG] pgmap v6406: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:07.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:22:07 gibba015 bash[29377]: cluster 2021-03-10T17:22:06.299776+0000 mgr.gibba045.orlgmj (mgr.34412) 11241 : cluster [DBG] pgmap v6407: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:07.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:22:07 gibba015 bash[30343]: cluster 2021-03-10T17:22:06.299776+0000 mgr.gibba045.orlgmj (mgr.34412) 11241 : cluster [DBG] pgmap v6407: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:07.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:22:07 gibba045 bash[25517]: cluster 2021-03-10T17:22:06.299776+0000 mgr.gibba045.orlgmj (mgr.34412) 11241 : cluster [DBG] pgmap v6407: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:09.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:22:08 gibba045 bash[25517]: cluster 2021-03-10T17:22:08.301431+0000 mgr.gibba045.orlgmj (mgr.34412) 11242 : cluster [DBG] pgmap v6408: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:09.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:22:08 gibba015 bash[29377]: cluster 2021-03-10T17:22:08.301431+0000 mgr.gibba045.orlgmj (mgr.34412) 11242 : cluster [DBG] pgmap v6408: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:09.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:22:08 gibba015 bash[30343]: cluster 2021-03-10T17:22:08.301431+0000 mgr.gibba045.orlgmj (mgr.34412) 11242 : cluster [DBG] pgmap v6408: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:10.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:22:09 gibba045 bash[25517]: cephadm 2021-03-10T17:22:09.572670+0000 mgr.gibba045.orlgmj (mgr.34412) 11243 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:22:10.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:22:09 gibba015 bash[29377]: cephadm 2021-03-10T17:22:09.572670+0000 mgr.gibba045.orlgmj (mgr.34412) 11243 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:22:10.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:22:09 gibba015 bash[30343]: cephadm 2021-03-10T17:22:09.572670+0000 mgr.gibba045.orlgmj (mgr.34412) 11243 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:22:10.670 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:22:10.897 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:22:10.898 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 4m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:22:10.898 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 3m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:22:10.898 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:22:10.899 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:22:10.899 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:22:10.899 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:22:10.899 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:22:10.899 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:22:10.900 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 4m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:22:10.900 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 3m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:22:10.900 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:22:10.900 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:22:10.901 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:22:10.901 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:22:10.901 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:22:10.901 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:22:10.902 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:22:10.902 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:22:10.902 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 3m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:22:10.902 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 3m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:22:11.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:22:10 gibba045 bash[25517]: cluster 2021-03-10T17:22:10.303136+0000 mgr.gibba045.orlgmj (mgr.34412) 11244 : cluster [DBG] pgmap v6409: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:11.148 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:22:11.148 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:22:11.149 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:22:11.149 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:22:11.149 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:22:11.150 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:22:11.150 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:22:11.151 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:22:11.151 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:22:11.151 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:22:11.152 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:22:11.152 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:22:11.153 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:22:11.153 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:22:11.153 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:22:11.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:22:10 gibba015 bash[29377]: cluster 2021-03-10T17:22:10.303136+0000 mgr.gibba045.orlgmj (mgr.34412) 11244 : cluster [DBG] pgmap v6409: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:11.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:22:10 gibba015 bash[30343]: cluster 2021-03-10T17:22:10.303136+0000 mgr.gibba045.orlgmj (mgr.34412) 11244 : cluster [DBG] pgmap v6409: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:12.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:22:11 gibba045 bash[25517]: audit 2021-03-10T17:22:10.661402+0000 mgr.gibba045.orlgmj (mgr.34412) 11245 : audit [DBG] from='client.51594 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:22:12.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:22:11 gibba045 bash[25517]: audit 2021-03-10T17:22:10.885957+0000 mgr.gibba045.orlgmj (mgr.34412) 11246 : audit [DBG] from='client.61588 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:22:12.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:22:11 gibba045 bash[25517]: audit 2021-03-10T17:22:11.146620+0000 mon.a (mon.0) 2372 : audit [DBG] from='client.? 172.21.2.115:0/3258786056' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:22:12.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:22:11 gibba015 bash[29377]: audit 2021-03-10T17:22:10.661402+0000 mgr.gibba045.orlgmj (mgr.34412) 11245 : audit [DBG] from='client.51594 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:22:12.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:22:11 gibba015 bash[29377]: audit 2021-03-10T17:22:10.885957+0000 mgr.gibba045.orlgmj (mgr.34412) 11246 : audit [DBG] from='client.61588 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:22:12.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:22:11 gibba015 bash[29377]: audit 2021-03-10T17:22:11.146620+0000 mon.a (mon.0) 2372 : audit [DBG] from='client.? 172.21.2.115:0/3258786056' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:22:12.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:22:11 gibba015 bash[30343]: audit 2021-03-10T17:22:10.661402+0000 mgr.gibba045.orlgmj (mgr.34412) 11245 : audit [DBG] from='client.51594 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:22:12.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:22:11 gibba015 bash[30343]: audit 2021-03-10T17:22:10.885957+0000 mgr.gibba045.orlgmj (mgr.34412) 11246 : audit [DBG] from='client.61588 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:22:12.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:22:11 gibba015 bash[30343]: audit 2021-03-10T17:22:11.146620+0000 mon.a (mon.0) 2372 : audit [DBG] from='client.? 172.21.2.115:0/3258786056' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:22:13.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:22:12 gibba045 bash[25517]: cluster 2021-03-10T17:22:12.304655+0000 mgr.gibba045.orlgmj (mgr.34412) 11247 : cluster [DBG] pgmap v6410: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:13.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:22:12 gibba015 bash[29377]: cluster 2021-03-10T17:22:12.304655+0000 mgr.gibba045.orlgmj (mgr.34412) 11247 : cluster [DBG] pgmap v6410: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:13.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:22:12 gibba015 bash[30343]: cluster 2021-03-10T17:22:12.304655+0000 mgr.gibba045.orlgmj (mgr.34412) 11247 : cluster [DBG] pgmap v6410: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:15.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:22:15 gibba015 bash[29377]: cluster 2021-03-10T17:22:14.306140+0000 mgr.gibba045.orlgmj (mgr.34412) 11248 : cluster [DBG] pgmap v6411: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:15.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:22:15 gibba015 bash[30343]: cluster 2021-03-10T17:22:14.306140+0000 mgr.gibba045.orlgmj (mgr.34412) 11248 : cluster [DBG] pgmap v6411: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:15.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:22:15 gibba045 bash[25517]: cluster 2021-03-10T17:22:14.306140+0000 mgr.gibba045.orlgmj (mgr.34412) 11248 : cluster [DBG] pgmap v6411: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:17.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:22:17 gibba015 bash[29377]: cluster 2021-03-10T17:22:16.307907+0000 mgr.gibba045.orlgmj (mgr.34412) 11249 : cluster [DBG] pgmap v6412: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:17.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:22:17 gibba015 bash[30343]: cluster 2021-03-10T17:22:16.307907+0000 mgr.gibba045.orlgmj (mgr.34412) 11249 : cluster [DBG] pgmap v6412: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:17.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:22:17 gibba045 bash[25517]: cluster 2021-03-10T17:22:16.307907+0000 mgr.gibba045.orlgmj (mgr.34412) 11249 : cluster [DBG] pgmap v6412: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:19.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:22:18 gibba045 bash[25517]: cluster 2021-03-10T17:22:18.309535+0000 mgr.gibba045.orlgmj (mgr.34412) 11250 : cluster [DBG] pgmap v6413: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:19.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:22:18 gibba015 bash[29377]: cluster 2021-03-10T17:22:18.309535+0000 mgr.gibba045.orlgmj (mgr.34412) 11250 : cluster [DBG] pgmap v6413: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:19.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:22:18 gibba015 bash[30343]: cluster 2021-03-10T17:22:18.309535+0000 mgr.gibba045.orlgmj (mgr.34412) 11250 : cluster [DBG] pgmap v6413: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:21.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:22:21 gibba015 bash[29377]: cluster 2021-03-10T17:22:20.311199+0000 mgr.gibba045.orlgmj (mgr.34412) 11251 : cluster [DBG] pgmap v6414: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:21.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:22:21 gibba015 bash[30343]: cluster 2021-03-10T17:22:20.311199+0000 mgr.gibba045.orlgmj (mgr.34412) 11251 : cluster [DBG] pgmap v6414: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:21.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:22:21 gibba045 bash[25517]: cluster 2021-03-10T17:22:20.311199+0000 mgr.gibba045.orlgmj (mgr.34412) 11251 : cluster [DBG] pgmap v6414: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:23.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:22:23 gibba015 bash[29377]: cluster 2021-03-10T17:22:22.312894+0000 mgr.gibba045.orlgmj (mgr.34412) 11252 : cluster [DBG] pgmap v6415: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:23.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:22:23 gibba015 bash[30343]: cluster 2021-03-10T17:22:22.312894+0000 mgr.gibba045.orlgmj (mgr.34412) 11252 : cluster [DBG] pgmap v6415: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:23.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:22:23 gibba045 bash[25517]: cluster 2021-03-10T17:22:22.312894+0000 mgr.gibba045.orlgmj (mgr.34412) 11252 : cluster [DBG] pgmap v6415: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:25.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:22:25 gibba015 bash[29377]: cluster 2021-03-10T17:22:24.314096+0000 mgr.gibba045.orlgmj (mgr.34412) 11253 : cluster [DBG] pgmap v6416: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:26.075 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:22:25 gibba015 bash[29377]: cephadm 2021-03-10T17:22:24.581437+0000 mgr.gibba045.orlgmj (mgr.34412) 11254 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:22:26.076 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:22:25 gibba015 bash[30343]: cluster 2021-03-10T17:22:24.314096+0000 mgr.gibba045.orlgmj (mgr.34412) 11253 : cluster [DBG] pgmap v6416: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:26.076 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:22:25 gibba015 bash[30343]: cephadm 2021-03-10T17:22:24.581437+0000 mgr.gibba045.orlgmj (mgr.34412) 11254 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:22:26.077 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:22:25 gibba045 bash[25517]: cluster 2021-03-10T17:22:24.314096+0000 mgr.gibba045.orlgmj (mgr.34412) 11253 : cluster [DBG] pgmap v6416: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:26.077 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:22:25 gibba045 bash[25517]: cephadm 2021-03-10T17:22:24.581437+0000 mgr.gibba045.orlgmj (mgr.34412) 11254 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:22:27.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:22:27 gibba015 bash[29377]: cluster 2021-03-10T17:22:26.315594+0000 mgr.gibba045.orlgmj (mgr.34412) 11255 : cluster [DBG] pgmap v6417: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:27.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:22:27 gibba015 bash[30343]: cluster 2021-03-10T17:22:26.315594+0000 mgr.gibba045.orlgmj (mgr.34412) 11255 : cluster [DBG] pgmap v6417: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:27.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:22:27 gibba045 bash[25517]: cluster 2021-03-10T17:22:26.315594+0000 mgr.gibba045.orlgmj (mgr.34412) 11255 : cluster [DBG] pgmap v6417: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:29.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:22:28 gibba045 bash[25517]: cluster 2021-03-10T17:22:28.317042+0000 mgr.gibba045.orlgmj (mgr.34412) 11256 : cluster [DBG] pgmap v6418: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:29.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:22:28 gibba015 bash[29377]: cluster 2021-03-10T17:22:28.317042+0000 mgr.gibba045.orlgmj (mgr.34412) 11256 : cluster [DBG] pgmap v6418: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:29.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:22:28 gibba015 bash[30343]: cluster 2021-03-10T17:22:28.317042+0000 mgr.gibba045.orlgmj (mgr.34412) 11256 : cluster [DBG] pgmap v6418: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:31.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:22:31 gibba015 bash[29377]: cluster 2021-03-10T17:22:30.318690+0000 mgr.gibba045.orlgmj (mgr.34412) 11257 : cluster [DBG] pgmap v6419: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:31.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:22:31 gibba015 bash[30343]: cluster 2021-03-10T17:22:30.318690+0000 mgr.gibba045.orlgmj (mgr.34412) 11257 : cluster [DBG] pgmap v6419: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:31.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:22:31 gibba045 bash[25517]: cluster 2021-03-10T17:22:30.318690+0000 mgr.gibba045.orlgmj (mgr.34412) 11257 : cluster [DBG] pgmap v6419: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:33.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:22:33 gibba015 bash[29377]: cluster 2021-03-10T17:22:32.320259+0000 mgr.gibba045.orlgmj (mgr.34412) 11258 : cluster [DBG] pgmap v6420: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:33.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:22:33 gibba015 bash[30343]: cluster 2021-03-10T17:22:32.320259+0000 mgr.gibba045.orlgmj (mgr.34412) 11258 : cluster [DBG] pgmap v6420: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:33.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:22:33 gibba045 bash[25517]: cluster 2021-03-10T17:22:32.320259+0000 mgr.gibba045.orlgmj (mgr.34412) 11258 : cluster [DBG] pgmap v6420: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:35.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:22:35 gibba015 bash[29377]: cluster 2021-03-10T17:22:34.321753+0000 mgr.gibba045.orlgmj (mgr.34412) 11259 : cluster [DBG] pgmap v6421: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:35.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:22:35 gibba015 bash[30343]: cluster 2021-03-10T17:22:34.321753+0000 mgr.gibba045.orlgmj (mgr.34412) 11259 : cluster [DBG] pgmap v6421: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:35.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:22:35 gibba045 bash[25517]: cluster 2021-03-10T17:22:34.321753+0000 mgr.gibba045.orlgmj (mgr.34412) 11259 : cluster [DBG] pgmap v6421: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:37.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:22:37 gibba015 bash[29377]: cluster 2021-03-10T17:22:36.323243+0000 mgr.gibba045.orlgmj (mgr.34412) 11260 : cluster [DBG] pgmap v6422: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:37.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:22:37 gibba015 bash[30343]: cluster 2021-03-10T17:22:36.323243+0000 mgr.gibba045.orlgmj (mgr.34412) 11260 : cluster [DBG] pgmap v6422: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:37.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:22:37 gibba045 bash[25517]: cluster 2021-03-10T17:22:36.323243+0000 mgr.gibba045.orlgmj (mgr.34412) 11260 : cluster [DBG] pgmap v6422: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:39.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:22:38 gibba045 bash[25517]: cluster 2021-03-10T17:22:38.324762+0000 mgr.gibba045.orlgmj (mgr.34412) 11261 : cluster [DBG] pgmap v6423: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:39.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:22:38 gibba015 bash[29377]: cluster 2021-03-10T17:22:38.324762+0000 mgr.gibba045.orlgmj (mgr.34412) 11261 : cluster [DBG] pgmap v6423: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:39.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:22:38 gibba015 bash[30343]: cluster 2021-03-10T17:22:38.324762+0000 mgr.gibba045.orlgmj (mgr.34412) 11261 : cluster [DBG] pgmap v6423: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:40.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:22:39 gibba045 bash[25517]: audit 2021-03-10T17:22:39.596205+0000 mon.c (mon.1) 3084 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:22:40.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:22:39 gibba045 bash[25517]: cephadm 2021-03-10T17:22:39.603301+0000 mgr.gibba045.orlgmj (mgr.34412) 11262 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:22:40.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:22:39 gibba045 bash[25517]: cephadm 2021-03-10T17:22:39.604758+0000 mgr.gibba045.orlgmj (mgr.34412) 11263 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:22:40.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:22:39 gibba015 bash[29377]: audit 2021-03-10T17:22:39.596205+0000 mon.c (mon.1) 3084 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:22:40.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:22:39 gibba015 bash[29377]: cephadm 2021-03-10T17:22:39.603301+0000 mgr.gibba045.orlgmj (mgr.34412) 11262 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:22:40.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:22:39 gibba015 bash[29377]: cephadm 2021-03-10T17:22:39.604758+0000 mgr.gibba045.orlgmj (mgr.34412) 11263 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:22:40.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:22:39 gibba015 bash[30343]: audit 2021-03-10T17:22:39.596205+0000 mon.c (mon.1) 3084 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:22:40.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:22:39 gibba015 bash[30343]: cephadm 2021-03-10T17:22:39.603301+0000 mgr.gibba045.orlgmj (mgr.34412) 11262 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:22:40.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:22:39 gibba015 bash[30343]: cephadm 2021-03-10T17:22:39.604758+0000 mgr.gibba045.orlgmj (mgr.34412) 11263 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:22:41.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:22:40 gibba015 bash[30343]: audit 2021-03-10T17:22:39.801292+0000 mon.a (mon.0) 2373 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:22:41.221 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:22:40 gibba015 bash[30343]: audit 2021-03-10T17:22:39.804814+0000 mon.c (mon.1) 3085 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:22:41.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:22:40 gibba015 bash[30343]: audit 2021-03-10T17:22:39.806072+0000 mon.c (mon.1) 3086 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:22:41.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:22:40 gibba015 bash[30343]: cephadm 2021-03-10T17:22:39.806079+0000 mgr.gibba045.orlgmj (mgr.34412) 11264 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:22:41.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:22:40 gibba015 bash[30343]: audit 2021-03-10T17:22:39.807538+0000 mon.c (mon.1) 3087 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:22:41.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:22:40 gibba015 bash[30343]: cephadm 2021-03-10T17:22:39.807700+0000 mgr.gibba045.orlgmj (mgr.34412) 11265 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:22:41.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:22:40 gibba015 bash[30343]: cephadm 2021-03-10T17:22:39.808796+0000 mgr.gibba045.orlgmj (mgr.34412) 11266 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:22:41.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:22:40 gibba015 bash[30343]: audit 2021-03-10T17:22:39.808849+0000 mon.c (mon.1) 3088 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:22:41.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:22:40 gibba015 bash[30343]: cephadm 2021-03-10T17:22:39.808942+0000 mgr.gibba045.orlgmj (mgr.34412) 11267 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:22:41.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:22:40 gibba015 bash[30343]: cephadm 2021-03-10T17:22:39.810318+0000 mgr.gibba045.orlgmj (mgr.34412) 11268 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:22:41.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:22:40 gibba015 bash[30343]: cephadm 2021-03-10T17:22:39.810356+0000 mgr.gibba045.orlgmj (mgr.34412) 11269 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:22:41.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:22:40 gibba015 bash[30343]: cephadm 2021-03-10T17:22:39.811650+0000 mgr.gibba045.orlgmj (mgr.34412) 11270 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:22:41.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:22:40 gibba015 bash[30343]: audit 2021-03-10T17:22:39.811737+0000 mon.c (mon.1) 3089 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:22:41.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:22:40 gibba015 bash[30343]: audit 2021-03-10T17:22:39.813035+0000 mon.c (mon.1) 3090 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:22:41.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:22:40 gibba015 bash[30343]: cephadm 2021-03-10T17:22:39.813236+0000 mgr.gibba045.orlgmj (mgr.34412) 11271 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:22:41.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:22:40 gibba015 bash[30343]: cephadm 2021-03-10T17:22:39.813273+0000 mgr.gibba045.orlgmj (mgr.34412) 11272 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:22:41.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:22:40 gibba015 bash[30343]: cephadm 2021-03-10T17:22:39.814462+0000 mgr.gibba045.orlgmj (mgr.34412) 11273 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:22:41.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:22:40 gibba015 bash[30343]: cephadm 2021-03-10T17:22:39.814778+0000 mgr.gibba045.orlgmj (mgr.34412) 11274 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:22:41.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:22:40 gibba015 bash[30343]: cephadm 2021-03-10T17:22:39.815796+0000 mgr.gibba045.orlgmj (mgr.34412) 11275 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:22:41.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:22:40 gibba015 bash[30343]: cephadm 2021-03-10T17:22:39.815835+0000 mgr.gibba045.orlgmj (mgr.34412) 11276 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:22:41.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:22:40 gibba015 bash[30343]: cephadm 2021-03-10T17:22:39.816020+0000 mgr.gibba045.orlgmj (mgr.34412) 11277 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:22:41.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:22:40 gibba015 bash[30343]: cluster 2021-03-10T17:22:40.326289+0000 mgr.gibba045.orlgmj (mgr.34412) 11278 : cluster [DBG] pgmap v6424: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:41.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:22:40 gibba015 bash[29377]: audit 2021-03-10T17:22:39.801292+0000 mon.a (mon.0) 2373 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:22:41.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:22:40 gibba015 bash[29377]: audit 2021-03-10T17:22:39.804814+0000 mon.c (mon.1) 3085 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:22:41.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:22:40 gibba015 bash[29377]: audit 2021-03-10T17:22:39.806072+0000 mon.c (mon.1) 3086 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:22:41.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:22:40 gibba015 bash[29377]: cephadm 2021-03-10T17:22:39.806079+0000 mgr.gibba045.orlgmj (mgr.34412) 11264 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:22:41.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:22:40 gibba015 bash[29377]: audit 2021-03-10T17:22:39.807538+0000 mon.c (mon.1) 3087 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:22:41.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:22:40 gibba015 bash[29377]: cephadm 2021-03-10T17:22:39.807700+0000 mgr.gibba045.orlgmj (mgr.34412) 11265 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:22:41.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:22:40 gibba015 bash[29377]: cephadm 2021-03-10T17:22:39.808796+0000 mgr.gibba045.orlgmj (mgr.34412) 11266 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:22:41.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:22:40 gibba015 bash[29377]: audit 2021-03-10T17:22:39.808849+0000 mon.c (mon.1) 3088 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:22:41.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:22:40 gibba015 bash[29377]: cephadm 2021-03-10T17:22:39.808942+0000 mgr.gibba045.orlgmj (mgr.34412) 11267 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:22:41.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:22:40 gibba015 bash[29377]: cephadm 2021-03-10T17:22:39.810318+0000 mgr.gibba045.orlgmj (mgr.34412) 11268 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:22:41.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:22:40 gibba015 bash[29377]: cephadm 2021-03-10T17:22:39.810356+0000 mgr.gibba045.orlgmj (mgr.34412) 11269 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:22:41.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:22:40 gibba015 bash[29377]: cephadm 2021-03-10T17:22:39.811650+0000 mgr.gibba045.orlgmj (mgr.34412) 11270 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:22:41.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:22:40 gibba015 bash[29377]: audit 2021-03-10T17:22:39.811737+0000 mon.c (mon.1) 3089 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:22:41.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:22:40 gibba015 bash[29377]: audit 2021-03-10T17:22:39.813035+0000 mon.c (mon.1) 3090 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:22:41.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:22:40 gibba015 bash[29377]: cephadm 2021-03-10T17:22:39.813236+0000 mgr.gibba045.orlgmj (mgr.34412) 11271 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:22:41.230 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:22:40 gibba015 bash[29377]: cephadm 2021-03-10T17:22:39.813273+0000 mgr.gibba045.orlgmj (mgr.34412) 11272 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:22:41.230 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:22:40 gibba015 bash[29377]: cephadm 2021-03-10T17:22:39.814462+0000 mgr.gibba045.orlgmj (mgr.34412) 11273 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:22:41.230 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:22:40 gibba015 bash[29377]: cephadm 2021-03-10T17:22:39.814778+0000 mgr.gibba045.orlgmj (mgr.34412) 11274 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:22:41.230 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:22:40 gibba015 bash[29377]: cephadm 2021-03-10T17:22:39.815796+0000 mgr.gibba045.orlgmj (mgr.34412) 11275 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:22:41.231 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:22:40 gibba015 bash[29377]: cephadm 2021-03-10T17:22:39.815835+0000 mgr.gibba045.orlgmj (mgr.34412) 11276 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:22:41.231 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:22:40 gibba015 bash[29377]: cephadm 2021-03-10T17:22:39.816020+0000 mgr.gibba045.orlgmj (mgr.34412) 11277 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:22:41.231 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:22:40 gibba015 bash[29377]: cluster 2021-03-10T17:22:40.326289+0000 mgr.gibba045.orlgmj (mgr.34412) 11278 : cluster [DBG] pgmap v6424: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:41.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:22:40 gibba045 bash[25517]: audit 2021-03-10T17:22:39.801292+0000 mon.a (mon.0) 2373 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:22:41.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:22:40 gibba045 bash[25517]: audit 2021-03-10T17:22:39.804814+0000 mon.c (mon.1) 3085 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:22:41.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:22:40 gibba045 bash[25517]: audit 2021-03-10T17:22:39.806072+0000 mon.c (mon.1) 3086 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:22:41.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:22:40 gibba045 bash[25517]: cephadm 2021-03-10T17:22:39.806079+0000 mgr.gibba045.orlgmj (mgr.34412) 11264 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:22:41.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:22:40 gibba045 bash[25517]: audit 2021-03-10T17:22:39.807538+0000 mon.c (mon.1) 3087 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:22:41.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:22:40 gibba045 bash[25517]: cephadm 2021-03-10T17:22:39.807700+0000 mgr.gibba045.orlgmj (mgr.34412) 11265 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:22:41.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:22:40 gibba045 bash[25517]: cephadm 2021-03-10T17:22:39.808796+0000 mgr.gibba045.orlgmj (mgr.34412) 11266 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:22:41.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:22:40 gibba045 bash[25517]: audit 2021-03-10T17:22:39.808849+0000 mon.c (mon.1) 3088 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:22:41.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:22:40 gibba045 bash[25517]: cephadm 2021-03-10T17:22:39.808942+0000 mgr.gibba045.orlgmj (mgr.34412) 11267 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:22:41.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:22:40 gibba045 bash[25517]: cephadm 2021-03-10T17:22:39.810318+0000 mgr.gibba045.orlgmj (mgr.34412) 11268 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:22:41.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:22:40 gibba045 bash[25517]: cephadm 2021-03-10T17:22:39.810356+0000 mgr.gibba045.orlgmj (mgr.34412) 11269 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:22:41.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:22:40 gibba045 bash[25517]: cephadm 2021-03-10T17:22:39.811650+0000 mgr.gibba045.orlgmj (mgr.34412) 11270 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:22:41.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:22:40 gibba045 bash[25517]: audit 2021-03-10T17:22:39.811737+0000 mon.c (mon.1) 3089 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:22:41.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:22:40 gibba045 bash[25517]: audit 2021-03-10T17:22:39.813035+0000 mon.c (mon.1) 3090 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:22:41.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:22:40 gibba045 bash[25517]: cephadm 2021-03-10T17:22:39.813236+0000 mgr.gibba045.orlgmj (mgr.34412) 11271 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:22:41.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:22:40 gibba045 bash[25517]: cephadm 2021-03-10T17:22:39.813273+0000 mgr.gibba045.orlgmj (mgr.34412) 11272 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:22:41.312 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:22:40 gibba045 bash[25517]: cephadm 2021-03-10T17:22:39.814462+0000 mgr.gibba045.orlgmj (mgr.34412) 11273 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:22:41.312 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:22:40 gibba045 bash[25517]: cephadm 2021-03-10T17:22:39.814778+0000 mgr.gibba045.orlgmj (mgr.34412) 11274 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:22:41.312 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:22:40 gibba045 bash[25517]: cephadm 2021-03-10T17:22:39.815796+0000 mgr.gibba045.orlgmj (mgr.34412) 11275 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:22:41.312 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:22:40 gibba045 bash[25517]: cephadm 2021-03-10T17:22:39.815835+0000 mgr.gibba045.orlgmj (mgr.34412) 11276 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:22:41.312 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:22:40 gibba045 bash[25517]: cephadm 2021-03-10T17:22:39.816020+0000 mgr.gibba045.orlgmj (mgr.34412) 11277 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:22:41.313 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:22:40 gibba045 bash[25517]: cluster 2021-03-10T17:22:40.326289+0000 mgr.gibba045.orlgmj (mgr.34412) 11278 : cluster [DBG] pgmap v6424: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:41.391 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:22:41.615 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:22:41.616 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 5m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:22:41.616 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 4m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:22:41.616 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:22:41.616 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:22:41.617 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:22:41.617 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:22:41.617 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:22:41.617 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:22:41.618 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 5m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:22:41.618 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 4m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:22:41.618 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:22:41.618 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:22:41.618 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:22:41.619 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:22:41.619 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:22:41.619 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:22:41.619 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:22:41.620 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:22:41.620 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 4m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:22:41.620 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 4m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:22:41.867 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:22:41.867 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:22:41.868 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:22:41.868 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:22:41.868 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:22:41.868 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:22:41.869 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:22:41.869 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:22:41.869 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:22:41.869 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:22:41.869 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:22:41.870 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:22:41.870 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:22:41.870 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:22:41.870 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:22:42.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:22:41 gibba015 bash[29377]: audit 2021-03-10T17:22:41.382531+0000 mgr.gibba045.orlgmj (mgr.34412) 11279 : audit [DBG] from='client.51612 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:22:42.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:22:41 gibba015 bash[29377]: audit 2021-03-10T17:22:41.603734+0000 mgr.gibba045.orlgmj (mgr.34412) 11280 : audit [DBG] from='client.51618 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:22:42.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:22:41 gibba015 bash[30343]: audit 2021-03-10T17:22:41.382531+0000 mgr.gibba045.orlgmj (mgr.34412) 11279 : audit [DBG] from='client.51612 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:22:42.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:22:41 gibba015 bash[30343]: audit 2021-03-10T17:22:41.603734+0000 mgr.gibba045.orlgmj (mgr.34412) 11280 : audit [DBG] from='client.51618 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:22:42.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:22:41 gibba045 bash[25517]: audit 2021-03-10T17:22:41.382531+0000 mgr.gibba045.orlgmj (mgr.34412) 11279 : audit [DBG] from='client.51612 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:22:42.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:22:41 gibba045 bash[25517]: audit 2021-03-10T17:22:41.603734+0000 mgr.gibba045.orlgmj (mgr.34412) 11280 : audit [DBG] from='client.51618 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:22:43.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:22:42 gibba015 bash[29377]: audit 2021-03-10T17:22:41.866159+0000 mon.a (mon.0) 2374 : audit [DBG] from='client.? 172.21.2.115:0/2051942449' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:22:43.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:22:42 gibba015 bash[29377]: cluster 2021-03-10T17:22:42.327962+0000 mgr.gibba045.orlgmj (mgr.34412) 11281 : cluster [DBG] pgmap v6425: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:43.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:22:42 gibba015 bash[30343]: audit 2021-03-10T17:22:41.866159+0000 mon.a (mon.0) 2374 : audit [DBG] from='client.? 172.21.2.115:0/2051942449' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:22:43.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:22:42 gibba015 bash[30343]: cluster 2021-03-10T17:22:42.327962+0000 mgr.gibba045.orlgmj (mgr.34412) 11281 : cluster [DBG] pgmap v6425: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:43.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:22:42 gibba045 bash[25517]: audit 2021-03-10T17:22:41.866159+0000 mon.a (mon.0) 2374 : audit [DBG] from='client.? 172.21.2.115:0/2051942449' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:22:43.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:22:42 gibba045 bash[25517]: cluster 2021-03-10T17:22:42.327962+0000 mgr.gibba045.orlgmj (mgr.34412) 11281 : cluster [DBG] pgmap v6425: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:45.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:22:45 gibba015 bash[29377]: cluster 2021-03-10T17:22:44.329158+0000 mgr.gibba045.orlgmj (mgr.34412) 11282 : cluster [DBG] pgmap v6426: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:45.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:22:45 gibba015 bash[30343]: cluster 2021-03-10T17:22:44.329158+0000 mgr.gibba045.orlgmj (mgr.34412) 11282 : cluster [DBG] pgmap v6426: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:45.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:22:45 gibba045 bash[25517]: cluster 2021-03-10T17:22:44.329158+0000 mgr.gibba045.orlgmj (mgr.34412) 11282 : cluster [DBG] pgmap v6426: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:47.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:22:47 gibba015 bash[29377]: cluster 2021-03-10T17:22:46.330989+0000 mgr.gibba045.orlgmj (mgr.34412) 11283 : cluster [DBG] pgmap v6427: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:47.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:22:47 gibba015 bash[30343]: cluster 2021-03-10T17:22:46.330989+0000 mgr.gibba045.orlgmj (mgr.34412) 11283 : cluster [DBG] pgmap v6427: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:47.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:22:47 gibba045 bash[25517]: cluster 2021-03-10T17:22:46.330989+0000 mgr.gibba045.orlgmj (mgr.34412) 11283 : cluster [DBG] pgmap v6427: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:49.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:22:48 gibba045 bash[25517]: cluster 2021-03-10T17:22:48.349797+0000 mgr.gibba045.orlgmj (mgr.34412) 11284 : cluster [DBG] pgmap v6428: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:49.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:22:48 gibba015 bash[29377]: cluster 2021-03-10T17:22:48.349797+0000 mgr.gibba045.orlgmj (mgr.34412) 11284 : cluster [DBG] pgmap v6428: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:49.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:22:48 gibba015 bash[30343]: cluster 2021-03-10T17:22:48.349797+0000 mgr.gibba045.orlgmj (mgr.34412) 11284 : cluster [DBG] pgmap v6428: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:51.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:22:51 gibba015 bash[29377]: cluster 2021-03-10T17:22:50.351326+0000 mgr.gibba045.orlgmj (mgr.34412) 11285 : cluster [DBG] pgmap v6429: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:51.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:22:51 gibba015 bash[30343]: cluster 2021-03-10T17:22:50.351326+0000 mgr.gibba045.orlgmj (mgr.34412) 11285 : cluster [DBG] pgmap v6429: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:51.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:22:51 gibba045 bash[25517]: cluster 2021-03-10T17:22:50.351326+0000 mgr.gibba045.orlgmj (mgr.34412) 11285 : cluster [DBG] pgmap v6429: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:53.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:22:53 gibba015 bash[29377]: cluster 2021-03-10T17:22:52.353204+0000 mgr.gibba045.orlgmj (mgr.34412) 11286 : cluster [DBG] pgmap v6430: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:53.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:22:53 gibba015 bash[30343]: cluster 2021-03-10T17:22:52.353204+0000 mgr.gibba045.orlgmj (mgr.34412) 11286 : cluster [DBG] pgmap v6430: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:53.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:22:53 gibba045 bash[25517]: cluster 2021-03-10T17:22:52.353204+0000 mgr.gibba045.orlgmj (mgr.34412) 11286 : cluster [DBG] pgmap v6430: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:22:54 gibba015 bash[29377]: audit 2021-03-10T17:22:54.026451+0000 mon.c (mon.1) 3091 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:22:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:22:54 gibba015 bash[29377]: audit 2021-03-10T17:22:54.027086+0000 mon.c (mon.1) 3092 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:22:54.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:22:54 gibba015 bash[29377]: audit 2021-03-10T17:22:54.027708+0000 mon.a (mon.0) 2375 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:22:54.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:22:54 gibba015 bash[29377]: audit 2021-03-10T17:22:54.029522+0000 mon.a (mon.0) 2376 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:22:54.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:22:54 gibba015 bash[29377]: audit 2021-03-10T17:22:54.118925+0000 mon.c (mon.1) 3093 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T17:22:54.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:22:54 gibba015 bash[29377]: audit 2021-03-10T17:22:54.119669+0000 mon.c (mon.1) 3094 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:22:54.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:22:54 gibba015 bash[29377]: audit 2021-03-10T17:22:54.120279+0000 mon.a (mon.0) 2377 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T17:22:54.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:22:54 gibba015 bash[29377]: audit 2021-03-10T17:22:54.120350+0000 mon.c (mon.1) 3095 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:22:54.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:22:54 gibba015 bash[29377]: audit 2021-03-10T17:22:54.121026+0000 mon.c (mon.1) 3096 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T17:22:54.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:22:54 gibba015 bash[29377]: audit 2021-03-10T17:22:54.122851+0000 mon.a (mon.0) 2378 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:22:54.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:22:54 gibba015 bash[29377]: audit 2021-03-10T17:22:54.124131+0000 mon.a (mon.0) 2379 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:22:54.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:22:54 gibba015 bash[29377]: audit 2021-03-10T17:22:54.125409+0000 mon.a (mon.0) 2380 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T17:22:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:22:54 gibba015 bash[30343]: audit 2021-03-10T17:22:54.026451+0000 mon.c (mon.1) 3091 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:22:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:22:54 gibba015 bash[30343]: audit 2021-03-10T17:22:54.027086+0000 mon.c (mon.1) 3092 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:22:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:22:54 gibba015 bash[30343]: audit 2021-03-10T17:22:54.027708+0000 mon.a (mon.0) 2375 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:22:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:22:54 gibba015 bash[30343]: audit 2021-03-10T17:22:54.029522+0000 mon.a (mon.0) 2376 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:22:54.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:22:54 gibba015 bash[30343]: audit 2021-03-10T17:22:54.118925+0000 mon.c (mon.1) 3093 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T17:22:54.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:22:54 gibba015 bash[30343]: audit 2021-03-10T17:22:54.119669+0000 mon.c (mon.1) 3094 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:22:54.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:22:54 gibba015 bash[30343]: audit 2021-03-10T17:22:54.120279+0000 mon.a (mon.0) 2377 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T17:22:54.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:22:54 gibba015 bash[30343]: audit 2021-03-10T17:22:54.120350+0000 mon.c (mon.1) 3095 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:22:54.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:22:54 gibba015 bash[30343]: audit 2021-03-10T17:22:54.121026+0000 mon.c (mon.1) 3096 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T17:22:54.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:22:54 gibba015 bash[30343]: audit 2021-03-10T17:22:54.122851+0000 mon.a (mon.0) 2378 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:22:54.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:22:54 gibba015 bash[30343]: audit 2021-03-10T17:22:54.124131+0000 mon.a (mon.0) 2379 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:22:54.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:22:54 gibba015 bash[30343]: audit 2021-03-10T17:22:54.125409+0000 mon.a (mon.0) 2380 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T17:22:54.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:22:54 gibba045 bash[25517]: audit 2021-03-10T17:22:54.026451+0000 mon.c (mon.1) 3091 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:22:54.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:22:54 gibba045 bash[25517]: audit 2021-03-10T17:22:54.027086+0000 mon.c (mon.1) 3092 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:22:54.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:22:54 gibba045 bash[25517]: audit 2021-03-10T17:22:54.027708+0000 mon.a (mon.0) 2375 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:22:54.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:22:54 gibba045 bash[25517]: audit 2021-03-10T17:22:54.029522+0000 mon.a (mon.0) 2376 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:22:54.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:22:54 gibba045 bash[25517]: audit 2021-03-10T17:22:54.118925+0000 mon.c (mon.1) 3093 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T17:22:54.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:22:54 gibba045 bash[25517]: audit 2021-03-10T17:22:54.119669+0000 mon.c (mon.1) 3094 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:22:54.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:22:54 gibba045 bash[25517]: audit 2021-03-10T17:22:54.120279+0000 mon.a (mon.0) 2377 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T17:22:54.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:22:54 gibba045 bash[25517]: audit 2021-03-10T17:22:54.120350+0000 mon.c (mon.1) 3095 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:22:54.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:22:54 gibba045 bash[25517]: audit 2021-03-10T17:22:54.121026+0000 mon.c (mon.1) 3096 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T17:22:54.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:22:54 gibba045 bash[25517]: audit 2021-03-10T17:22:54.122851+0000 mon.a (mon.0) 2378 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:22:54.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:22:54 gibba045 bash[25517]: audit 2021-03-10T17:22:54.124131+0000 mon.a (mon.0) 2379 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:22:54.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:22:54 gibba045 bash[25517]: audit 2021-03-10T17:22:54.125409+0000 mon.a (mon.0) 2380 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T17:22:55.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:22:55 gibba015 bash[29377]: cluster 2021-03-10T17:22:54.354438+0000 mgr.gibba045.orlgmj (mgr.34412) 11287 : cluster [DBG] pgmap v6431: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:55.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:22:55 gibba015 bash[30343]: cluster 2021-03-10T17:22:54.354438+0000 mgr.gibba045.orlgmj (mgr.34412) 11287 : cluster [DBG] pgmap v6431: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:55.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:22:55 gibba045 bash[25517]: cluster 2021-03-10T17:22:54.354438+0000 mgr.gibba045.orlgmj (mgr.34412) 11287 : cluster [DBG] pgmap v6431: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:56.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:22:56 gibba015 bash[29377]: cephadm 2021-03-10T17:22:54.829261+0000 mgr.gibba045.orlgmj (mgr.34412) 11288 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:22:58.004 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:22:56 gibba015 bash[30343]: cephadm 2021-03-10T17:22:54.829261+0000 mgr.gibba045.orlgmj (mgr.34412) 11288 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:22:58.005 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:22:57 gibba015 bash[29377]: cluster 2021-03-10T17:22:56.356087+0000 mgr.gibba045.orlgmj (mgr.34412) 11289 : cluster [DBG] pgmap v6432: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:58.005 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:22:57 gibba015 bash[30343]: cluster 2021-03-10T17:22:56.356087+0000 mgr.gibba045.orlgmj (mgr.34412) 11289 : cluster [DBG] pgmap v6432: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:58.006 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:22:56 gibba045 bash[25517]: cephadm 2021-03-10T17:22:54.829261+0000 mgr.gibba045.orlgmj (mgr.34412) 11288 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:22:58.006 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:22:57 gibba045 bash[25517]: cluster 2021-03-10T17:22:56.356087+0000 mgr.gibba045.orlgmj (mgr.34412) 11289 : cluster [DBG] pgmap v6432: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:59.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:22:58 gibba045 bash[25517]: cluster 2021-03-10T17:22:58.357079+0000 mgr.gibba045.orlgmj (mgr.34412) 11290 : cluster [DBG] pgmap v6433: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:59.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:22:58 gibba015 bash[29377]: cluster 2021-03-10T17:22:58.357079+0000 mgr.gibba045.orlgmj (mgr.34412) 11290 : cluster [DBG] pgmap v6433: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:59.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:22:58 gibba015 bash[30343]: cluster 2021-03-10T17:22:58.357079+0000 mgr.gibba045.orlgmj (mgr.34412) 11290 : cluster [DBG] pgmap v6433: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:01.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:23:01 gibba015 bash[29377]: cluster 2021-03-10T17:23:00.358628+0000 mgr.gibba045.orlgmj (mgr.34412) 11291 : cluster [DBG] pgmap v6434: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:01.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:23:01 gibba015 bash[30343]: cluster 2021-03-10T17:23:00.358628+0000 mgr.gibba045.orlgmj (mgr.34412) 11291 : cluster [DBG] pgmap v6434: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:01.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:23:01 gibba045 bash[25517]: cluster 2021-03-10T17:23:00.358628+0000 mgr.gibba045.orlgmj (mgr.34412) 11291 : cluster [DBG] pgmap v6434: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:03.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:23:03 gibba015 bash[29377]: cluster 2021-03-10T17:23:02.360367+0000 mgr.gibba045.orlgmj (mgr.34412) 11292 : cluster [DBG] pgmap v6435: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:03.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:23:03 gibba015 bash[30343]: cluster 2021-03-10T17:23:02.360367+0000 mgr.gibba045.orlgmj (mgr.34412) 11292 : cluster [DBG] pgmap v6435: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:03.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:23:03 gibba045 bash[25517]: cluster 2021-03-10T17:23:02.360367+0000 mgr.gibba045.orlgmj (mgr.34412) 11292 : cluster [DBG] pgmap v6435: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:05.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:23:05 gibba015 bash[29377]: cluster 2021-03-10T17:23:04.361698+0000 mgr.gibba045.orlgmj (mgr.34412) 11293 : cluster [DBG] pgmap v6436: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:05.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:23:05 gibba015 bash[30343]: cluster 2021-03-10T17:23:04.361698+0000 mgr.gibba045.orlgmj (mgr.34412) 11293 : cluster [DBG] pgmap v6436: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:05.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:23:05 gibba045 bash[25517]: cluster 2021-03-10T17:23:04.361698+0000 mgr.gibba045.orlgmj (mgr.34412) 11293 : cluster [DBG] pgmap v6436: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:07.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:23:07 gibba015 bash[29377]: cluster 2021-03-10T17:23:06.363141+0000 mgr.gibba045.orlgmj (mgr.34412) 11294 : cluster [DBG] pgmap v6437: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:07.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:23:07 gibba015 bash[30343]: cluster 2021-03-10T17:23:06.363141+0000 mgr.gibba045.orlgmj (mgr.34412) 11294 : cluster [DBG] pgmap v6437: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:07.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:23:07 gibba045 bash[25517]: cluster 2021-03-10T17:23:06.363141+0000 mgr.gibba045.orlgmj (mgr.34412) 11294 : cluster [DBG] pgmap v6437: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:09.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:23:08 gibba045 bash[25517]: cluster 2021-03-10T17:23:08.363982+0000 mgr.gibba045.orlgmj (mgr.34412) 11295 : cluster [DBG] pgmap v6438: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:09.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:23:08 gibba015 bash[29377]: cluster 2021-03-10T17:23:08.363982+0000 mgr.gibba045.orlgmj (mgr.34412) 11295 : cluster [DBG] pgmap v6438: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:09.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:23:08 gibba015 bash[30343]: cluster 2021-03-10T17:23:08.363982+0000 mgr.gibba045.orlgmj (mgr.34412) 11295 : cluster [DBG] pgmap v6438: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:11.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:23:11 gibba015 bash[29377]: cephadm 2021-03-10T17:23:09.841406+0000 mgr.gibba045.orlgmj (mgr.34412) 11296 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:23:11.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:23:11 gibba015 bash[29377]: cluster 2021-03-10T17:23:10.365449+0000 mgr.gibba045.orlgmj (mgr.34412) 11297 : cluster [DBG] pgmap v6439: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:11.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:23:11 gibba015 bash[30343]: cephadm 2021-03-10T17:23:09.841406+0000 mgr.gibba045.orlgmj (mgr.34412) 11296 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:23:11.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:23:11 gibba015 bash[30343]: cluster 2021-03-10T17:23:10.365449+0000 mgr.gibba045.orlgmj (mgr.34412) 11297 : cluster [DBG] pgmap v6439: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:11.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:23:11 gibba045 bash[25517]: cephadm 2021-03-10T17:23:09.841406+0000 mgr.gibba045.orlgmj (mgr.34412) 11296 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:23:11.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:23:11 gibba045 bash[25517]: cluster 2021-03-10T17:23:10.365449+0000 mgr.gibba045.orlgmj (mgr.34412) 11297 : cluster [DBG] pgmap v6439: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:12.111 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:23:12.352 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:23:12.353 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 5m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:23:12.353 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 4m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:23:12.353 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:23:12.354 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:23:12.354 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:23:12.354 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:23:12.354 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:23:12.354 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:23:12.355 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 5m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:23:12.355 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 4m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:23:12.355 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:23:12.355 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:23:12.356 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:23:12.356 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:23:12.356 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:23:12.356 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:23:12.356 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:23:12.357 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:23:12.357 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 4m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:23:12.357 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 4m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:23:12.602 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:23:12.602 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:23:12.603 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:23:12.603 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:23:12.603 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:23:12.603 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:23:12.603 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:23:12.604 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:23:12.604 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:23:12.604 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:23:12.604 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:23:12.605 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:23:12.605 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:23:12.605 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:23:12.605 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:23:13.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:23:13 gibba015 bash[29377]: audit 2021-03-10T17:23:12.103398+0000 mgr.gibba045.orlgmj (mgr.34412) 11298 : audit [DBG] from='client.61618 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:23:13.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:23:13 gibba015 bash[29377]: audit 2021-03-10T17:23:12.325496+0000 mgr.gibba045.orlgmj (mgr.34412) 11299 : audit [DBG] from='client.61624 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:23:13.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:23:13 gibba015 bash[29377]: cluster 2021-03-10T17:23:12.366304+0000 mgr.gibba045.orlgmj (mgr.34412) 11300 : cluster [DBG] pgmap v6440: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:13.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:23:13 gibba015 bash[29377]: audit 2021-03-10T17:23:12.600921+0000 mon.a (mon.0) 2381 : audit [DBG] from='client.? 172.21.2.115:0/3230083697' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:23:13.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:23:13 gibba015 bash[30343]: audit 2021-03-10T17:23:12.103398+0000 mgr.gibba045.orlgmj (mgr.34412) 11298 : audit [DBG] from='client.61618 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:23:13.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:23:13 gibba015 bash[30343]: audit 2021-03-10T17:23:12.325496+0000 mgr.gibba045.orlgmj (mgr.34412) 11299 : audit [DBG] from='client.61624 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:23:13.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:23:13 gibba015 bash[30343]: cluster 2021-03-10T17:23:12.366304+0000 mgr.gibba045.orlgmj (mgr.34412) 11300 : cluster [DBG] pgmap v6440: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:13.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:23:13 gibba015 bash[30343]: audit 2021-03-10T17:23:12.600921+0000 mon.a (mon.0) 2381 : audit [DBG] from='client.? 172.21.2.115:0/3230083697' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:23:13.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:23:13 gibba045 bash[25517]: audit 2021-03-10T17:23:12.103398+0000 mgr.gibba045.orlgmj (mgr.34412) 11298 : audit [DBG] from='client.61618 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:23:13.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:23:13 gibba045 bash[25517]: audit 2021-03-10T17:23:12.325496+0000 mgr.gibba045.orlgmj (mgr.34412) 11299 : audit [DBG] from='client.61624 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:23:13.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:23:13 gibba045 bash[25517]: cluster 2021-03-10T17:23:12.366304+0000 mgr.gibba045.orlgmj (mgr.34412) 11300 : cluster [DBG] pgmap v6440: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:13.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:23:13 gibba045 bash[25517]: audit 2021-03-10T17:23:12.600921+0000 mon.a (mon.0) 2381 : audit [DBG] from='client.? 172.21.2.115:0/3230083697' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:23:15.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:23:15 gibba015 bash[29377]: cluster 2021-03-10T17:23:14.367396+0000 mgr.gibba045.orlgmj (mgr.34412) 11301 : cluster [DBG] pgmap v6441: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:15.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:23:15 gibba015 bash[30343]: cluster 2021-03-10T17:23:14.367396+0000 mgr.gibba045.orlgmj (mgr.34412) 11301 : cluster [DBG] pgmap v6441: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:15.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:23:15 gibba045 bash[25517]: cluster 2021-03-10T17:23:14.367396+0000 mgr.gibba045.orlgmj (mgr.34412) 11301 : cluster [DBG] pgmap v6441: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:17.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:23:17 gibba015 bash[29377]: cluster 2021-03-10T17:23:16.369347+0000 mgr.gibba045.orlgmj (mgr.34412) 11302 : cluster [DBG] pgmap v6442: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:17.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:23:17 gibba015 bash[30343]: cluster 2021-03-10T17:23:16.369347+0000 mgr.gibba045.orlgmj (mgr.34412) 11302 : cluster [DBG] pgmap v6442: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:17.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:23:17 gibba045 bash[25517]: cluster 2021-03-10T17:23:16.369347+0000 mgr.gibba045.orlgmj (mgr.34412) 11302 : cluster [DBG] pgmap v6442: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:19.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:23:18 gibba045 bash[25517]: cluster 2021-03-10T17:23:18.370219+0000 mgr.gibba045.orlgmj (mgr.34412) 11303 : cluster [DBG] pgmap v6443: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:19.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:23:18 gibba015 bash[29377]: cluster 2021-03-10T17:23:18.370219+0000 mgr.gibba045.orlgmj (mgr.34412) 11303 : cluster [DBG] pgmap v6443: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:19.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:23:18 gibba015 bash[30343]: cluster 2021-03-10T17:23:18.370219+0000 mgr.gibba045.orlgmj (mgr.34412) 11303 : cluster [DBG] pgmap v6443: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:21.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:23:21 gibba015 bash[29377]: cluster 2021-03-10T17:23:20.371770+0000 mgr.gibba045.orlgmj (mgr.34412) 11304 : cluster [DBG] pgmap v6444: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:21.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:23:21 gibba015 bash[30343]: cluster 2021-03-10T17:23:20.371770+0000 mgr.gibba045.orlgmj (mgr.34412) 11304 : cluster [DBG] pgmap v6444: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:21.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:23:21 gibba045 bash[25517]: cluster 2021-03-10T17:23:20.371770+0000 mgr.gibba045.orlgmj (mgr.34412) 11304 : cluster [DBG] pgmap v6444: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:23.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:23:23 gibba015 bash[29377]: cluster 2021-03-10T17:23:22.373279+0000 mgr.gibba045.orlgmj (mgr.34412) 11305 : cluster [DBG] pgmap v6445: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:23.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:23:23 gibba015 bash[30343]: cluster 2021-03-10T17:23:22.373279+0000 mgr.gibba045.orlgmj (mgr.34412) 11305 : cluster [DBG] pgmap v6445: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:23.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:23:23 gibba045 bash[25517]: cluster 2021-03-10T17:23:22.373279+0000 mgr.gibba045.orlgmj (mgr.34412) 11305 : cluster [DBG] pgmap v6445: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:25.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:23:25 gibba015 bash[29377]: cluster 2021-03-10T17:23:24.374536+0000 mgr.gibba045.orlgmj (mgr.34412) 11306 : cluster [DBG] pgmap v6446: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:25.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:23:25 gibba015 bash[30343]: cluster 2021-03-10T17:23:24.374536+0000 mgr.gibba045.orlgmj (mgr.34412) 11306 : cluster [DBG] pgmap v6446: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:25.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:23:25 gibba045 bash[25517]: cluster 2021-03-10T17:23:24.374536+0000 mgr.gibba045.orlgmj (mgr.34412) 11306 : cluster [DBG] pgmap v6446: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:26.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:23:26 gibba015 bash[29377]: cephadm 2021-03-10T17:23:24.850512+0000 mgr.gibba045.orlgmj (mgr.34412) 11307 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:23:26.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:23:26 gibba015 bash[30343]: cephadm 2021-03-10T17:23:24.850512+0000 mgr.gibba045.orlgmj (mgr.34412) 11307 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:23:26.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:23:26 gibba045 bash[25517]: cephadm 2021-03-10T17:23:24.850512+0000 mgr.gibba045.orlgmj (mgr.34412) 11307 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:23:27.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:23:27 gibba015 bash[29377]: cluster 2021-03-10T17:23:26.376159+0000 mgr.gibba045.orlgmj (mgr.34412) 11308 : cluster [DBG] pgmap v6447: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:27.721 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:23:27 gibba015 bash[30343]: cluster 2021-03-10T17:23:26.376159+0000 mgr.gibba045.orlgmj (mgr.34412) 11308 : cluster [DBG] pgmap v6447: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:27.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:23:27 gibba045 bash[25517]: cluster 2021-03-10T17:23:26.376159+0000 mgr.gibba045.orlgmj (mgr.34412) 11308 : cluster [DBG] pgmap v6447: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:29.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:23:28 gibba045 bash[25517]: cluster 2021-03-10T17:23:28.377068+0000 mgr.gibba045.orlgmj (mgr.34412) 11309 : cluster [DBG] pgmap v6448: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:29.234 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:23:28 gibba015 bash[29377]: cluster 2021-03-10T17:23:28.377068+0000 mgr.gibba045.orlgmj (mgr.34412) 11309 : cluster [DBG] pgmap v6448: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:29.234 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:23:28 gibba015 bash[30343]: cluster 2021-03-10T17:23:28.377068+0000 mgr.gibba045.orlgmj (mgr.34412) 11309 : cluster [DBG] pgmap v6448: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:31.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:23:31 gibba015 bash[29377]: cluster 2021-03-10T17:23:30.378350+0000 mgr.gibba045.orlgmj (mgr.34412) 11310 : cluster [DBG] pgmap v6449: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:31.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:23:31 gibba015 bash[30343]: cluster 2021-03-10T17:23:30.378350+0000 mgr.gibba045.orlgmj (mgr.34412) 11310 : cluster [DBG] pgmap v6449: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:31.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:23:31 gibba045 bash[25517]: cluster 2021-03-10T17:23:30.378350+0000 mgr.gibba045.orlgmj (mgr.34412) 11310 : cluster [DBG] pgmap v6449: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:33.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:23:33 gibba015 bash[29377]: cluster 2021-03-10T17:23:32.380152+0000 mgr.gibba045.orlgmj (mgr.34412) 11311 : cluster [DBG] pgmap v6450: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:33.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:23:33 gibba015 bash[30343]: cluster 2021-03-10T17:23:32.380152+0000 mgr.gibba045.orlgmj (mgr.34412) 11311 : cluster [DBG] pgmap v6450: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:33.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:23:33 gibba045 bash[25517]: cluster 2021-03-10T17:23:32.380152+0000 mgr.gibba045.orlgmj (mgr.34412) 11311 : cluster [DBG] pgmap v6450: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:35.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:23:35 gibba015 bash[29377]: cluster 2021-03-10T17:23:34.381400+0000 mgr.gibba045.orlgmj (mgr.34412) 11312 : cluster [DBG] pgmap v6451: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:35.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:23:35 gibba015 bash[30343]: cluster 2021-03-10T17:23:34.381400+0000 mgr.gibba045.orlgmj (mgr.34412) 11312 : cluster [DBG] pgmap v6451: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:35.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:23:35 gibba045 bash[25517]: cluster 2021-03-10T17:23:34.381400+0000 mgr.gibba045.orlgmj (mgr.34412) 11312 : cluster [DBG] pgmap v6451: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:37.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:23:37 gibba015 bash[29377]: cluster 2021-03-10T17:23:36.383192+0000 mgr.gibba045.orlgmj (mgr.34412) 11313 : cluster [DBG] pgmap v6452: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:37.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:23:37 gibba015 bash[30343]: cluster 2021-03-10T17:23:36.383192+0000 mgr.gibba045.orlgmj (mgr.34412) 11313 : cluster [DBG] pgmap v6452: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:37.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:23:37 gibba045 bash[25517]: cluster 2021-03-10T17:23:36.383192+0000 mgr.gibba045.orlgmj (mgr.34412) 11313 : cluster [DBG] pgmap v6452: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:39.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:23:38 gibba045 bash[25517]: cluster 2021-03-10T17:23:38.383994+0000 mgr.gibba045.orlgmj (mgr.34412) 11314 : cluster [DBG] pgmap v6453: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:39.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:23:38 gibba015 bash[29377]: cluster 2021-03-10T17:23:38.383994+0000 mgr.gibba045.orlgmj (mgr.34412) 11314 : cluster [DBG] pgmap v6453: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:39.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:23:38 gibba015 bash[30343]: cluster 2021-03-10T17:23:38.383994+0000 mgr.gibba045.orlgmj (mgr.34412) 11314 : cluster [DBG] pgmap v6453: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:40.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:23:39 gibba015 bash[29377]: audit 2021-03-10T17:23:39.850904+0000 mon.c (mon.1) 3097 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:23:40.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:23:39 gibba015 bash[30343]: audit 2021-03-10T17:23:39.850904+0000 mon.c (mon.1) 3097 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:23:40.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:23:39 gibba045 bash[25517]: audit 2021-03-10T17:23:39.850904+0000 mon.c (mon.1) 3097 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:23:41.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:23:41 gibba015 bash[29377]: cephadm 2021-03-10T17:23:39.857815+0000 mgr.gibba045.orlgmj (mgr.34412) 11315 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:23:41.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:23:41 gibba015 bash[29377]: cephadm 2021-03-10T17:23:39.859617+0000 mgr.gibba045.orlgmj (mgr.34412) 11316 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:23:41.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:23:41 gibba015 bash[29377]: audit 2021-03-10T17:23:40.073852+0000 mon.a (mon.0) 2382 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:23:41.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:23:41 gibba015 bash[29377]: audit 2021-03-10T17:23:40.077935+0000 mon.c (mon.1) 3098 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:23:41.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:23:41 gibba015 bash[29377]: cephadm 2021-03-10T17:23:40.078944+0000 mgr.gibba045.orlgmj (mgr.34412) 11317 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:23:41.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:23:41 gibba015 bash[29377]: audit 2021-03-10T17:23:40.079371+0000 mon.c (mon.1) 3099 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:23:41.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:23:41 gibba015 bash[29377]: audit 2021-03-10T17:23:40.080781+0000 mon.c (mon.1) 3100 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:23:41.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:23:41 gibba015 bash[29377]: cephadm 2021-03-10T17:23:40.080808+0000 mgr.gibba045.orlgmj (mgr.34412) 11318 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:23:41.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:23:41 gibba015 bash[29377]: audit 2021-03-10T17:23:40.082071+0000 mon.c (mon.1) 3101 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:23:41.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:23:41 gibba015 bash[29377]: cephadm 2021-03-10T17:23:40.082191+0000 mgr.gibba045.orlgmj (mgr.34412) 11319 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:23:41.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:23:41 gibba015 bash[29377]: cephadm 2021-03-10T17:23:40.082231+0000 mgr.gibba045.orlgmj (mgr.34412) 11320 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:23:41.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:23:41 gibba015 bash[29377]: cephadm 2021-03-10T17:23:40.083544+0000 mgr.gibba045.orlgmj (mgr.34412) 11321 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:23:41.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:23:41 gibba015 bash[29377]: cephadm 2021-03-10T17:23:40.083581+0000 mgr.gibba045.orlgmj (mgr.34412) 11322 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:23:41.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:23:41 gibba015 bash[29377]: cephadm 2021-03-10T17:23:40.084849+0000 mgr.gibba045.orlgmj (mgr.34412) 11323 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:23:41.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:23:41 gibba015 bash[29377]: audit 2021-03-10T17:23:40.085282+0000 mon.c (mon.1) 3102 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:23:41.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:23:41 gibba015 bash[29377]: cephadm 2021-03-10T17:23:40.086603+0000 mgr.gibba045.orlgmj (mgr.34412) 11324 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:23:41.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:23:41 gibba015 bash[29377]: cephadm 2021-03-10T17:23:40.086641+0000 mgr.gibba045.orlgmj (mgr.34412) 11325 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:23:41.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:23:41 gibba015 bash[29377]: audit 2021-03-10T17:23:40.087002+0000 mon.c (mon.1) 3103 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:23:41.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:23:41 gibba015 bash[29377]: cephadm 2021-03-10T17:23:40.088095+0000 mgr.gibba045.orlgmj (mgr.34412) 11326 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:23:41.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:23:41 gibba015 bash[29377]: cephadm 2021-03-10T17:23:40.088410+0000 mgr.gibba045.orlgmj (mgr.34412) 11327 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:23:41.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:23:41 gibba015 bash[29377]: cephadm 2021-03-10T17:23:40.089719+0000 mgr.gibba045.orlgmj (mgr.34412) 11328 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:23:41.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:23:41 gibba015 bash[30343]: cephadm 2021-03-10T17:23:39.857815+0000 mgr.gibba045.orlgmj (mgr.34412) 11315 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:23:41.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:23:41 gibba015 bash[30343]: cephadm 2021-03-10T17:23:39.859617+0000 mgr.gibba045.orlgmj (mgr.34412) 11316 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:23:41.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:23:41 gibba015 bash[30343]: audit 2021-03-10T17:23:40.073852+0000 mon.a (mon.0) 2382 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:23:41.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:23:41 gibba015 bash[30343]: audit 2021-03-10T17:23:40.077935+0000 mon.c (mon.1) 3098 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:23:41.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:23:41 gibba015 bash[30343]: cephadm 2021-03-10T17:23:40.078944+0000 mgr.gibba045.orlgmj (mgr.34412) 11317 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:23:41.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:23:41 gibba015 bash[30343]: audit 2021-03-10T17:23:40.079371+0000 mon.c (mon.1) 3099 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:23:41.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:23:41 gibba015 bash[30343]: audit 2021-03-10T17:23:40.080781+0000 mon.c (mon.1) 3100 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:23:41.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:23:41 gibba015 bash[30343]: cephadm 2021-03-10T17:23:40.080808+0000 mgr.gibba045.orlgmj (mgr.34412) 11318 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:23:41.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:23:41 gibba015 bash[30343]: audit 2021-03-10T17:23:40.082071+0000 mon.c (mon.1) 3101 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:23:41.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:23:41 gibba015 bash[30343]: cephadm 2021-03-10T17:23:40.082191+0000 mgr.gibba045.orlgmj (mgr.34412) 11319 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:23:41.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:23:41 gibba015 bash[30343]: cephadm 2021-03-10T17:23:40.082231+0000 mgr.gibba045.orlgmj (mgr.34412) 11320 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:23:41.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:23:41 gibba015 bash[30343]: cephadm 2021-03-10T17:23:40.083544+0000 mgr.gibba045.orlgmj (mgr.34412) 11321 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:23:41.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:23:41 gibba015 bash[30343]: cephadm 2021-03-10T17:23:40.083581+0000 mgr.gibba045.orlgmj (mgr.34412) 11322 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:23:41.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:23:41 gibba015 bash[30343]: cephadm 2021-03-10T17:23:40.084849+0000 mgr.gibba045.orlgmj (mgr.34412) 11323 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:23:41.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:23:41 gibba015 bash[30343]: audit 2021-03-10T17:23:40.085282+0000 mon.c (mon.1) 3102 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:23:41.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:23:41 gibba015 bash[30343]: cephadm 2021-03-10T17:23:40.086603+0000 mgr.gibba045.orlgmj (mgr.34412) 11324 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:23:41.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:23:41 gibba015 bash[30343]: cephadm 2021-03-10T17:23:40.086641+0000 mgr.gibba045.orlgmj (mgr.34412) 11325 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:23:41.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:23:41 gibba015 bash[30343]: audit 2021-03-10T17:23:40.087002+0000 mon.c (mon.1) 3103 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:23:41.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:23:41 gibba015 bash[30343]: cephadm 2021-03-10T17:23:40.088095+0000 mgr.gibba045.orlgmj (mgr.34412) 11326 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:23:41.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:23:41 gibba015 bash[30343]: cephadm 2021-03-10T17:23:40.088410+0000 mgr.gibba045.orlgmj (mgr.34412) 11327 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:23:41.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:23:41 gibba015 bash[30343]: cephadm 2021-03-10T17:23:40.089719+0000 mgr.gibba045.orlgmj (mgr.34412) 11328 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:23:41.483 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:23:41 gibba015 bash[29377]: cephadm 2021-03-10T17:23:40.089759+0000 mgr.gibba045.orlgmj (mgr.34412) 11329 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:23:41.483 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:23:41 gibba015 bash[29377]: cephadm 2021-03-10T17:23:40.089925+0000 mgr.gibba045.orlgmj (mgr.34412) 11330 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:23:41.483 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:23:41 gibba015 bash[29377]: cluster 2021-03-10T17:23:40.385350+0000 mgr.gibba045.orlgmj (mgr.34412) 11331 : cluster [DBG] pgmap v6454: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:41.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:23:41 gibba015 bash[30343]: cephadm 2021-03-10T17:23:40.089759+0000 mgr.gibba045.orlgmj (mgr.34412) 11329 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:23:41.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:23:41 gibba015 bash[30343]: cephadm 2021-03-10T17:23:40.089925+0000 mgr.gibba045.orlgmj (mgr.34412) 11330 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:23:41.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:23:41 gibba015 bash[30343]: cluster 2021-03-10T17:23:40.385350+0000 mgr.gibba045.orlgmj (mgr.34412) 11331 : cluster [DBG] pgmap v6454: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:41.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:23:41 gibba045 bash[25517]: cephadm 2021-03-10T17:23:39.857815+0000 mgr.gibba045.orlgmj (mgr.34412) 11315 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:23:41.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:23:41 gibba045 bash[25517]: cephadm 2021-03-10T17:23:39.859617+0000 mgr.gibba045.orlgmj (mgr.34412) 11316 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:23:41.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:23:41 gibba045 bash[25517]: audit 2021-03-10T17:23:40.073852+0000 mon.a (mon.0) 2382 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:23:41.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:23:41 gibba045 bash[25517]: audit 2021-03-10T17:23:40.077935+0000 mon.c (mon.1) 3098 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:23:41.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:23:41 gibba045 bash[25517]: cephadm 2021-03-10T17:23:40.078944+0000 mgr.gibba045.orlgmj (mgr.34412) 11317 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:23:41.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:23:41 gibba045 bash[25517]: audit 2021-03-10T17:23:40.079371+0000 mon.c (mon.1) 3099 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:23:41.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:23:41 gibba045 bash[25517]: audit 2021-03-10T17:23:40.080781+0000 mon.c (mon.1) 3100 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:23:41.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:23:41 gibba045 bash[25517]: cephadm 2021-03-10T17:23:40.080808+0000 mgr.gibba045.orlgmj (mgr.34412) 11318 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:23:41.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:23:41 gibba045 bash[25517]: audit 2021-03-10T17:23:40.082071+0000 mon.c (mon.1) 3101 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:23:41.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:23:41 gibba045 bash[25517]: cephadm 2021-03-10T17:23:40.082191+0000 mgr.gibba045.orlgmj (mgr.34412) 11319 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:23:41.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:23:41 gibba045 bash[25517]: cephadm 2021-03-10T17:23:40.082231+0000 mgr.gibba045.orlgmj (mgr.34412) 11320 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:23:41.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:23:41 gibba045 bash[25517]: cephadm 2021-03-10T17:23:40.083544+0000 mgr.gibba045.orlgmj (mgr.34412) 11321 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:23:41.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:23:41 gibba045 bash[25517]: cephadm 2021-03-10T17:23:40.083581+0000 mgr.gibba045.orlgmj (mgr.34412) 11322 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:23:41.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:23:41 gibba045 bash[25517]: cephadm 2021-03-10T17:23:40.084849+0000 mgr.gibba045.orlgmj (mgr.34412) 11323 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:23:41.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:23:41 gibba045 bash[25517]: audit 2021-03-10T17:23:40.085282+0000 mon.c (mon.1) 3102 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:23:41.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:23:41 gibba045 bash[25517]: cephadm 2021-03-10T17:23:40.086603+0000 mgr.gibba045.orlgmj (mgr.34412) 11324 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:23:41.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:23:41 gibba045 bash[25517]: cephadm 2021-03-10T17:23:40.086641+0000 mgr.gibba045.orlgmj (mgr.34412) 11325 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:23:41.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:23:41 gibba045 bash[25517]: audit 2021-03-10T17:23:40.087002+0000 mon.c (mon.1) 3103 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:23:41.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:23:41 gibba045 bash[25517]: cephadm 2021-03-10T17:23:40.088095+0000 mgr.gibba045.orlgmj (mgr.34412) 11326 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:23:41.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:23:41 gibba045 bash[25517]: cephadm 2021-03-10T17:23:40.088410+0000 mgr.gibba045.orlgmj (mgr.34412) 11327 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:23:41.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:23:41 gibba045 bash[25517]: cephadm 2021-03-10T17:23:40.089719+0000 mgr.gibba045.orlgmj (mgr.34412) 11328 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:23:41.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:23:41 gibba045 bash[25517]: cephadm 2021-03-10T17:23:40.089759+0000 mgr.gibba045.orlgmj (mgr.34412) 11329 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:23:41.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:23:41 gibba045 bash[25517]: cephadm 2021-03-10T17:23:40.089925+0000 mgr.gibba045.orlgmj (mgr.34412) 11330 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:23:41.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:23:41 gibba045 bash[25517]: cluster 2021-03-10T17:23:40.385350+0000 mgr.gibba045.orlgmj (mgr.34412) 11331 : cluster [DBG] pgmap v6454: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:42.842 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:23:43.073 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:23:43.073 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 6m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:23:43.073 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 5m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:23:43.074 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:23:43.074 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:23:43.074 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:23:43.075 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:23:43.075 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:23:43.075 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:23:43.075 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 6m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:23:43.076 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 5m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:23:43.076 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:23:43.076 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:23:43.076 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:23:43.076 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:23:43.077 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:23:43.077 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:23:43.077 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:23:43.077 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:23:43.078 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 5m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:23:43.078 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 5m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:23:43.320 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:23:43.320 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:23:43.320 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:23:43.320 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:23:43.321 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:23:43.321 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:23:43.321 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:23:43.321 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:23:43.322 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:23:43.322 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:23:43.322 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:23:43.322 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:23:43.323 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:23:43.323 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:23:43.323 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:23:43.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:23:43 gibba015 bash[29377]: cluster 2021-03-10T17:23:42.386988+0000 mgr.gibba045.orlgmj (mgr.34412) 11332 : cluster [DBG] pgmap v6455: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:43.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:23:43 gibba015 bash[29377]: audit 2021-03-10T17:23:43.318527+0000 mon.c (mon.1) 3104 : audit [DBG] from='client.? 172.21.2.115:0/2519589351' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:23:43.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:23:43 gibba015 bash[30343]: cluster 2021-03-10T17:23:42.386988+0000 mgr.gibba045.orlgmj (mgr.34412) 11332 : cluster [DBG] pgmap v6455: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:43.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:23:43 gibba015 bash[30343]: audit 2021-03-10T17:23:43.318527+0000 mon.c (mon.1) 3104 : audit [DBG] from='client.? 172.21.2.115:0/2519589351' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:23:43.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:23:43 gibba045 bash[25517]: cluster 2021-03-10T17:23:42.386988+0000 mgr.gibba045.orlgmj (mgr.34412) 11332 : cluster [DBG] pgmap v6455: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:43.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:23:43 gibba045 bash[25517]: audit 2021-03-10T17:23:43.318527+0000 mon.c (mon.1) 3104 : audit [DBG] from='client.? 172.21.2.115:0/2519589351' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:23:44.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:23:44 gibba015 bash[29377]: audit 2021-03-10T17:23:42.835403+0000 mgr.gibba045.orlgmj (mgr.34412) 11333 : audit [DBG] from='client.61636 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:23:44.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:23:44 gibba015 bash[29377]: audit 2021-03-10T17:23:43.060866+0000 mgr.gibba045.orlgmj (mgr.34412) 11334 : audit [DBG] from='client.51654 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:23:44.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:23:44 gibba015 bash[30343]: audit 2021-03-10T17:23:42.835403+0000 mgr.gibba045.orlgmj (mgr.34412) 11333 : audit [DBG] from='client.61636 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:23:44.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:23:44 gibba015 bash[30343]: audit 2021-03-10T17:23:43.060866+0000 mgr.gibba045.orlgmj (mgr.34412) 11334 : audit [DBG] from='client.51654 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:23:44.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:23:44 gibba045 bash[25517]: audit 2021-03-10T17:23:42.835403+0000 mgr.gibba045.orlgmj (mgr.34412) 11333 : audit [DBG] from='client.61636 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:23:44.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:23:44 gibba045 bash[25517]: audit 2021-03-10T17:23:43.060866+0000 mgr.gibba045.orlgmj (mgr.34412) 11334 : audit [DBG] from='client.51654 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:23:45.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:23:45 gibba015 bash[29377]: cluster 2021-03-10T17:23:44.388209+0000 mgr.gibba045.orlgmj (mgr.34412) 11335 : cluster [DBG] pgmap v6456: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:45.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:23:45 gibba015 bash[30343]: cluster 2021-03-10T17:23:44.388209+0000 mgr.gibba045.orlgmj (mgr.34412) 11335 : cluster [DBG] pgmap v6456: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:45.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:23:45 gibba045 bash[25517]: cluster 2021-03-10T17:23:44.388209+0000 mgr.gibba045.orlgmj (mgr.34412) 11335 : cluster [DBG] pgmap v6456: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:47.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:23:47 gibba045 bash[25517]: cluster 2021-03-10T17:23:46.389864+0000 mgr.gibba045.orlgmj (mgr.34412) 11336 : cluster [DBG] pgmap v6457: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:47.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:23:47 gibba015 bash[29377]: cluster 2021-03-10T17:23:46.389864+0000 mgr.gibba045.orlgmj (mgr.34412) 11336 : cluster [DBG] pgmap v6457: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:47.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:23:47 gibba015 bash[30343]: cluster 2021-03-10T17:23:46.389864+0000 mgr.gibba045.orlgmj (mgr.34412) 11336 : cluster [DBG] pgmap v6457: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:49.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:23:48 gibba045 bash[25517]: cluster 2021-03-10T17:23:48.390774+0000 mgr.gibba045.orlgmj (mgr.34412) 11337 : cluster [DBG] pgmap v6458: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:49.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:23:48 gibba015 bash[29377]: cluster 2021-03-10T17:23:48.390774+0000 mgr.gibba045.orlgmj (mgr.34412) 11337 : cluster [DBG] pgmap v6458: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:49.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:23:48 gibba015 bash[30343]: cluster 2021-03-10T17:23:48.390774+0000 mgr.gibba045.orlgmj (mgr.34412) 11337 : cluster [DBG] pgmap v6458: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:51.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:23:51 gibba015 bash[29377]: cluster 2021-03-10T17:23:50.392297+0000 mgr.gibba045.orlgmj (mgr.34412) 11338 : cluster [DBG] pgmap v6459: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:51.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:23:51 gibba015 bash[30343]: cluster 2021-03-10T17:23:50.392297+0000 mgr.gibba045.orlgmj (mgr.34412) 11338 : cluster [DBG] pgmap v6459: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:51.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:23:51 gibba045 bash[25517]: cluster 2021-03-10T17:23:50.392297+0000 mgr.gibba045.orlgmj (mgr.34412) 11338 : cluster [DBG] pgmap v6459: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:53.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:23:53 gibba015 bash[29377]: cluster 2021-03-10T17:23:52.394103+0000 mgr.gibba045.orlgmj (mgr.34412) 11339 : cluster [DBG] pgmap v6460: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:53.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:23:53 gibba015 bash[30343]: cluster 2021-03-10T17:23:52.394103+0000 mgr.gibba045.orlgmj (mgr.34412) 11339 : cluster [DBG] pgmap v6460: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:53.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:23:53 gibba045 bash[25517]: cluster 2021-03-10T17:23:52.394103+0000 mgr.gibba045.orlgmj (mgr.34412) 11339 : cluster [DBG] pgmap v6460: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:54.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:23:54 gibba045 bash[25517]: audit 2021-03-10T17:23:54.033935+0000 mon.c (mon.1) 3105 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:23:54.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:23:54 gibba045 bash[25517]: audit 2021-03-10T17:23:54.035027+0000 mon.a (mon.0) 2383 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:23:54.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:23:54 gibba045 bash[25517]: audit 2021-03-10T17:23:54.035397+0000 mon.c (mon.1) 3106 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:23:54.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:23:54 gibba045 bash[25517]: audit 2021-03-10T17:23:54.036393+0000 mon.a (mon.0) 2384 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:23:54.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:23:54 gibba045 bash[25517]: audit 2021-03-10T17:23:54.131050+0000 mon.c (mon.1) 3107 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T17:23:54.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:23:54 gibba045 bash[25517]: audit 2021-03-10T17:23:54.131792+0000 mon.c (mon.1) 3108 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:23:54.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:23:54 gibba045 bash[25517]: audit 2021-03-10T17:23:54.132303+0000 mon.a (mon.0) 2385 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T17:23:54.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:23:54 gibba045 bash[25517]: audit 2021-03-10T17:23:54.132450+0000 mon.c (mon.1) 3109 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T17:23:54.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:23:54 gibba045 bash[25517]: audit 2021-03-10T17:23:54.133461+0000 mon.c (mon.1) 3110 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T17:23:54.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:23:54 gibba045 bash[25517]: audit 2021-03-10T17:23:54.133812+0000 mon.a (mon.0) 2386 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:23:54.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:23:54 gibba045 bash[25517]: audit 2021-03-10T17:23:54.134778+0000 mon.a (mon.0) 2387 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T17:23:54.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:23:54 gibba045 bash[25517]: audit 2021-03-10T17:23:54.135559+0000 mon.a (mon.0) 2388 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T17:23:54.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:23:54 gibba015 bash[29377]: audit 2021-03-10T17:23:54.033935+0000 mon.c (mon.1) 3105 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:23:54.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:23:54 gibba015 bash[29377]: audit 2021-03-10T17:23:54.035027+0000 mon.a (mon.0) 2383 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:23:54.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:23:54 gibba015 bash[29377]: audit 2021-03-10T17:23:54.035397+0000 mon.c (mon.1) 3106 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:23:54.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:23:54 gibba015 bash[29377]: audit 2021-03-10T17:23:54.036393+0000 mon.a (mon.0) 2384 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:23:54.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:23:54 gibba015 bash[29377]: audit 2021-03-10T17:23:54.131050+0000 mon.c (mon.1) 3107 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T17:23:54.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:23:54 gibba015 bash[29377]: audit 2021-03-10T17:23:54.131792+0000 mon.c (mon.1) 3108 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:23:54.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:23:54 gibba015 bash[29377]: audit 2021-03-10T17:23:54.132303+0000 mon.a (mon.0) 2385 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T17:23:54.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:23:54 gibba015 bash[29377]: audit 2021-03-10T17:23:54.132450+0000 mon.c (mon.1) 3109 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T17:23:54.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:23:54 gibba015 bash[29377]: audit 2021-03-10T17:23:54.133461+0000 mon.c (mon.1) 3110 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T17:23:54.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:23:54 gibba015 bash[29377]: audit 2021-03-10T17:23:54.133812+0000 mon.a (mon.0) 2386 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:23:54.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:23:54 gibba015 bash[29377]: audit 2021-03-10T17:23:54.134778+0000 mon.a (mon.0) 2387 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T17:23:54.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:23:54 gibba015 bash[29377]: audit 2021-03-10T17:23:54.135559+0000 mon.a (mon.0) 2388 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T17:23:54.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:23:54 gibba015 bash[30343]: audit 2021-03-10T17:23:54.033935+0000 mon.c (mon.1) 3105 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:23:54.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:23:54 gibba015 bash[30343]: audit 2021-03-10T17:23:54.035027+0000 mon.a (mon.0) 2383 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:23:54.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:23:54 gibba015 bash[30343]: audit 2021-03-10T17:23:54.035397+0000 mon.c (mon.1) 3106 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:23:54.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:23:54 gibba015 bash[30343]: audit 2021-03-10T17:23:54.036393+0000 mon.a (mon.0) 2384 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:23:54.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:23:54 gibba015 bash[30343]: audit 2021-03-10T17:23:54.131050+0000 mon.c (mon.1) 3107 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T17:23:54.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:23:54 gibba015 bash[30343]: audit 2021-03-10T17:23:54.131792+0000 mon.c (mon.1) 3108 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:23:54.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:23:54 gibba015 bash[30343]: audit 2021-03-10T17:23:54.132303+0000 mon.a (mon.0) 2385 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T17:23:54.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:23:54 gibba015 bash[30343]: audit 2021-03-10T17:23:54.132450+0000 mon.c (mon.1) 3109 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T17:23:54.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:23:54 gibba015 bash[30343]: audit 2021-03-10T17:23:54.133461+0000 mon.c (mon.1) 3110 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T17:23:54.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:23:54 gibba015 bash[30343]: audit 2021-03-10T17:23:54.133812+0000 mon.a (mon.0) 2386 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:23:54.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:23:54 gibba015 bash[30343]: audit 2021-03-10T17:23:54.134778+0000 mon.a (mon.0) 2387 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T17:23:54.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:23:54 gibba015 bash[30343]: audit 2021-03-10T17:23:54.135559+0000 mon.a (mon.0) 2388 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T17:23:55.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:23:55 gibba045 bash[25517]: cluster 2021-03-10T17:23:54.395341+0000 mgr.gibba045.orlgmj (mgr.34412) 11340 : cluster [DBG] pgmap v6461: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:55.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:23:55 gibba015 bash[29377]: cluster 2021-03-10T17:23:54.395341+0000 mgr.gibba045.orlgmj (mgr.34412) 11340 : cluster [DBG] pgmap v6461: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:55.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:23:55 gibba015 bash[30343]: cluster 2021-03-10T17:23:54.395341+0000 mgr.gibba045.orlgmj (mgr.34412) 11340 : cluster [DBG] pgmap v6461: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:56.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:23:56 gibba045 bash[25517]: cephadm 2021-03-10T17:23:55.091591+0000 mgr.gibba045.orlgmj (mgr.34412) 11341 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:23:56.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:23:56 gibba015 bash[29377]: cephadm 2021-03-10T17:23:55.091591+0000 mgr.gibba045.orlgmj (mgr.34412) 11341 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:23:56.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:23:56 gibba015 bash[30343]: cephadm 2021-03-10T17:23:55.091591+0000 mgr.gibba045.orlgmj (mgr.34412) 11341 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:23:57.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:23:57 gibba045 bash[25517]: cluster 2021-03-10T17:23:56.397225+0000 mgr.gibba045.orlgmj (mgr.34412) 11342 : cluster [DBG] pgmap v6462: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:57.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:23:57 gibba015 bash[29377]: cluster 2021-03-10T17:23:56.397225+0000 mgr.gibba045.orlgmj (mgr.34412) 11342 : cluster [DBG] pgmap v6462: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:57.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:23:57 gibba015 bash[30343]: cluster 2021-03-10T17:23:56.397225+0000 mgr.gibba045.orlgmj (mgr.34412) 11342 : cluster [DBG] pgmap v6462: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:59.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:23:58 gibba045 bash[25517]: cluster 2021-03-10T17:23:58.398014+0000 mgr.gibba045.orlgmj (mgr.34412) 11343 : cluster [DBG] pgmap v6463: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:59.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:23:58 gibba015 bash[29377]: cluster 2021-03-10T17:23:58.398014+0000 mgr.gibba045.orlgmj (mgr.34412) 11343 : cluster [DBG] pgmap v6463: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:59.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:23:58 gibba015 bash[30343]: cluster 2021-03-10T17:23:58.398014+0000 mgr.gibba045.orlgmj (mgr.34412) 11343 : cluster [DBG] pgmap v6463: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:01.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:24:01 gibba015 bash[29377]: cluster 2021-03-10T17:24:00.399469+0000 mgr.gibba045.orlgmj (mgr.34412) 11344 : cluster [DBG] pgmap v6464: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:01.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:24:01 gibba015 bash[30343]: cluster 2021-03-10T17:24:00.399469+0000 mgr.gibba045.orlgmj (mgr.34412) 11344 : cluster [DBG] pgmap v6464: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:01.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:24:01 gibba045 bash[25517]: cluster 2021-03-10T17:24:00.399469+0000 mgr.gibba045.orlgmj (mgr.34412) 11344 : cluster [DBG] pgmap v6464: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:03.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:24:03 gibba015 bash[29377]: cluster 2021-03-10T17:24:02.401204+0000 mgr.gibba045.orlgmj (mgr.34412) 11345 : cluster [DBG] pgmap v6465: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:03.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:24:03 gibba015 bash[30343]: cluster 2021-03-10T17:24:02.401204+0000 mgr.gibba045.orlgmj (mgr.34412) 11345 : cluster [DBG] pgmap v6465: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:03.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:24:03 gibba045 bash[25517]: cluster 2021-03-10T17:24:02.401204+0000 mgr.gibba045.orlgmj (mgr.34412) 11345 : cluster [DBG] pgmap v6465: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:05.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:24:05 gibba045 bash[25517]: cluster 2021-03-10T17:24:04.402524+0000 mgr.gibba045.orlgmj (mgr.34412) 11346 : cluster [DBG] pgmap v6466: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:05.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:24:05 gibba015 bash[29377]: cluster 2021-03-10T17:24:04.402524+0000 mgr.gibba045.orlgmj (mgr.34412) 11346 : cluster [DBG] pgmap v6466: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:05.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:24:05 gibba015 bash[30343]: cluster 2021-03-10T17:24:04.402524+0000 mgr.gibba045.orlgmj (mgr.34412) 11346 : cluster [DBG] pgmap v6466: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:07.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:24:07 gibba045 bash[25517]: cluster 2021-03-10T17:24:06.404289+0000 mgr.gibba045.orlgmj (mgr.34412) 11347 : cluster [DBG] pgmap v6467: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:07.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:24:07 gibba015 bash[29377]: cluster 2021-03-10T17:24:06.404289+0000 mgr.gibba045.orlgmj (mgr.34412) 11347 : cluster [DBG] pgmap v6467: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:07.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:24:07 gibba015 bash[30343]: cluster 2021-03-10T17:24:06.404289+0000 mgr.gibba045.orlgmj (mgr.34412) 11347 : cluster [DBG] pgmap v6467: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:09.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:24:08 gibba015 bash[29377]: cluster 2021-03-10T17:24:08.405212+0000 mgr.gibba045.orlgmj (mgr.34412) 11348 : cluster [DBG] pgmap v6468: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:09.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:24:08 gibba015 bash[30343]: cluster 2021-03-10T17:24:08.405212+0000 mgr.gibba045.orlgmj (mgr.34412) 11348 : cluster [DBG] pgmap v6468: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:09.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:24:08 gibba045 bash[25517]: cluster 2021-03-10T17:24:08.405212+0000 mgr.gibba045.orlgmj (mgr.34412) 11348 : cluster [DBG] pgmap v6468: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:11.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:24:11 gibba015 bash[29377]: cephadm 2021-03-10T17:24:10.093528+0000 mgr.gibba045.orlgmj (mgr.34412) 11349 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:24:11.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:24:11 gibba015 bash[29377]: cluster 2021-03-10T17:24:10.406547+0000 mgr.gibba045.orlgmj (mgr.34412) 11350 : cluster [DBG] pgmap v6469: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:11.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:24:11 gibba015 bash[30343]: cephadm 2021-03-10T17:24:10.093528+0000 mgr.gibba045.orlgmj (mgr.34412) 11349 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:24:11.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:24:11 gibba015 bash[30343]: cluster 2021-03-10T17:24:10.406547+0000 mgr.gibba045.orlgmj (mgr.34412) 11350 : cluster [DBG] pgmap v6469: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:11.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:24:11 gibba045 bash[25517]: cephadm 2021-03-10T17:24:10.093528+0000 mgr.gibba045.orlgmj (mgr.34412) 11349 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:24:11.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:24:11 gibba045 bash[25517]: cluster 2021-03-10T17:24:10.406547+0000 mgr.gibba045.orlgmj (mgr.34412) 11350 : cluster [DBG] pgmap v6469: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:13.562 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:24:13.788 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:24:13.789 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 6m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:24:13.789 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 5m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:24:13.789 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:24:13.789 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:24:13.790 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:24:13.790 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:24:13.790 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:24:13.790 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:24:13.791 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 6m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:24:13.791 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 5m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:24:13.791 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:24:13.791 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:24:13.791 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:24:13.792 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:24:13.792 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:24:13.792 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:24:13.792 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:24:13.793 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:24:13.793 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 5m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:24:13.793 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 5m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:24:13.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:24:13 gibba045 bash[25517]: cluster 2021-03-10T17:24:12.408391+0000 mgr.gibba045.orlgmj (mgr.34412) 11351 : cluster [DBG] pgmap v6470: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:13.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:24:13 gibba015 bash[29377]: cluster 2021-03-10T17:24:12.408391+0000 mgr.gibba045.orlgmj (mgr.34412) 11351 : cluster [DBG] pgmap v6470: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:13.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:24:13 gibba015 bash[30343]: cluster 2021-03-10T17:24:12.408391+0000 mgr.gibba045.orlgmj (mgr.34412) 11351 : cluster [DBG] pgmap v6470: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:14.037 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:24:14.038 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:24:14.038 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:24:14.038 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:24:14.039 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:24:14.039 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:24:14.039 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:24:14.039 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:24:14.040 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:24:14.040 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:24:14.040 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:24:14.040 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:24:14.040 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:24:14.041 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:24:14.041 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:24:14.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:24:14 gibba045 bash[25517]: audit 2021-03-10T17:24:13.554083+0000 mgr.gibba045.orlgmj (mgr.34412) 11352 : audit [DBG] from='client.51666 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:24:14.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:24:14 gibba045 bash[25517]: audit 2021-03-10T17:24:14.036581+0000 mon.c (mon.1) 3111 : audit [DBG] from='client.? 172.21.2.115:0/72635799' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:24:14.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:24:14 gibba015 bash[29377]: audit 2021-03-10T17:24:13.554083+0000 mgr.gibba045.orlgmj (mgr.34412) 11352 : audit [DBG] from='client.51666 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:24:14.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:24:14 gibba015 bash[29377]: audit 2021-03-10T17:24:14.036581+0000 mon.c (mon.1) 3111 : audit [DBG] from='client.? 172.21.2.115:0/72635799' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:24:14.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:24:14 gibba015 bash[30343]: audit 2021-03-10T17:24:13.554083+0000 mgr.gibba045.orlgmj (mgr.34412) 11352 : audit [DBG] from='client.51666 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:24:14.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:24:14 gibba015 bash[30343]: audit 2021-03-10T17:24:14.036581+0000 mon.c (mon.1) 3111 : audit [DBG] from='client.? 172.21.2.115:0/72635799' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:24:15.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:24:15 gibba045 bash[25517]: audit 2021-03-10T17:24:13.776734+0000 mgr.gibba045.orlgmj (mgr.34412) 11353 : audit [DBG] from='client.61660 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:24:15.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:24:15 gibba045 bash[25517]: cluster 2021-03-10T17:24:14.409812+0000 mgr.gibba045.orlgmj (mgr.34412) 11354 : cluster [DBG] pgmap v6471: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:15.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:24:15 gibba015 bash[29377]: audit 2021-03-10T17:24:13.776734+0000 mgr.gibba045.orlgmj (mgr.34412) 11353 : audit [DBG] from='client.61660 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:24:15.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:24:15 gibba015 bash[29377]: cluster 2021-03-10T17:24:14.409812+0000 mgr.gibba045.orlgmj (mgr.34412) 11354 : cluster [DBG] pgmap v6471: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:15.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:24:15 gibba015 bash[30343]: audit 2021-03-10T17:24:13.776734+0000 mgr.gibba045.orlgmj (mgr.34412) 11353 : audit [DBG] from='client.61660 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:24:15.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:24:15 gibba015 bash[30343]: cluster 2021-03-10T17:24:14.409812+0000 mgr.gibba045.orlgmj (mgr.34412) 11354 : cluster [DBG] pgmap v6471: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:17.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:24:17 gibba045 bash[25517]: cluster 2021-03-10T17:24:16.411494+0000 mgr.gibba045.orlgmj (mgr.34412) 11355 : cluster [DBG] pgmap v6472: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:17.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:24:17 gibba015 bash[29377]: cluster 2021-03-10T17:24:16.411494+0000 mgr.gibba045.orlgmj (mgr.34412) 11355 : cluster [DBG] pgmap v6472: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:17.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:24:17 gibba015 bash[30343]: cluster 2021-03-10T17:24:16.411494+0000 mgr.gibba045.orlgmj (mgr.34412) 11355 : cluster [DBG] pgmap v6472: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:19.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:24:18 gibba015 bash[29377]: cluster 2021-03-10T17:24:18.413136+0000 mgr.gibba045.orlgmj (mgr.34412) 11356 : cluster [DBG] pgmap v6473: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:19.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:24:18 gibba015 bash[30343]: cluster 2021-03-10T17:24:18.413136+0000 mgr.gibba045.orlgmj (mgr.34412) 11356 : cluster [DBG] pgmap v6473: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:19.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:24:18 gibba045 bash[25517]: cluster 2021-03-10T17:24:18.413136+0000 mgr.gibba045.orlgmj (mgr.34412) 11356 : cluster [DBG] pgmap v6473: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:21.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:24:21 gibba045 bash[25517]: cluster 2021-03-10T17:24:20.414752+0000 mgr.gibba045.orlgmj (mgr.34412) 11357 : cluster [DBG] pgmap v6474: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:21.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:24:21 gibba015 bash[29377]: cluster 2021-03-10T17:24:20.414752+0000 mgr.gibba045.orlgmj (mgr.34412) 11357 : cluster [DBG] pgmap v6474: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:21.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:24:21 gibba015 bash[30343]: cluster 2021-03-10T17:24:20.414752+0000 mgr.gibba045.orlgmj (mgr.34412) 11357 : cluster [DBG] pgmap v6474: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:23.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:24:23 gibba045 bash[25517]: cluster 2021-03-10T17:24:22.416547+0000 mgr.gibba045.orlgmj (mgr.34412) 11358 : cluster [DBG] pgmap v6475: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:23.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:24:23 gibba015 bash[29377]: cluster 2021-03-10T17:24:22.416547+0000 mgr.gibba045.orlgmj (mgr.34412) 11358 : cluster [DBG] pgmap v6475: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:23.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:24:23 gibba015 bash[30343]: cluster 2021-03-10T17:24:22.416547+0000 mgr.gibba045.orlgmj (mgr.34412) 11358 : cluster [DBG] pgmap v6475: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:25.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:24:25 gibba045 bash[25517]: cluster 2021-03-10T17:24:24.417703+0000 mgr.gibba045.orlgmj (mgr.34412) 11359 : cluster [DBG] pgmap v6476: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:25.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:24:25 gibba015 bash[29377]: cluster 2021-03-10T17:24:24.417703+0000 mgr.gibba045.orlgmj (mgr.34412) 11359 : cluster [DBG] pgmap v6476: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:25.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:24:25 gibba015 bash[30343]: cluster 2021-03-10T17:24:24.417703+0000 mgr.gibba045.orlgmj (mgr.34412) 11359 : cluster [DBG] pgmap v6476: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:26.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:24:26 gibba045 bash[25517]: cephadm 2021-03-10T17:24:25.109518+0000 mgr.gibba045.orlgmj (mgr.34412) 11360 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:24:26.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:24:26 gibba015 bash[29377]: cephadm 2021-03-10T17:24:25.109518+0000 mgr.gibba045.orlgmj (mgr.34412) 11360 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:24:26.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:24:26 gibba015 bash[30343]: cephadm 2021-03-10T17:24:25.109518+0000 mgr.gibba045.orlgmj (mgr.34412) 11360 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:24:27.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:24:27 gibba045 bash[25517]: cluster 2021-03-10T17:24:26.419625+0000 mgr.gibba045.orlgmj (mgr.34412) 11361 : cluster [DBG] pgmap v6477: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:27.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:24:27 gibba015 bash[29377]: cluster 2021-03-10T17:24:26.419625+0000 mgr.gibba045.orlgmj (mgr.34412) 11361 : cluster [DBG] pgmap v6477: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:27.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:24:27 gibba015 bash[30343]: cluster 2021-03-10T17:24:26.419625+0000 mgr.gibba045.orlgmj (mgr.34412) 11361 : cluster [DBG] pgmap v6477: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:29.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:24:28 gibba015 bash[29377]: cluster 2021-03-10T17:24:28.420567+0000 mgr.gibba045.orlgmj (mgr.34412) 11362 : cluster [DBG] pgmap v6478: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:29.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:24:28 gibba015 bash[30343]: cluster 2021-03-10T17:24:28.420567+0000 mgr.gibba045.orlgmj (mgr.34412) 11362 : cluster [DBG] pgmap v6478: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:29.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:24:28 gibba045 bash[25517]: cluster 2021-03-10T17:24:28.420567+0000 mgr.gibba045.orlgmj (mgr.34412) 11362 : cluster [DBG] pgmap v6478: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:31.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:24:31 gibba045 bash[25517]: cluster 2021-03-10T17:24:30.422133+0000 mgr.gibba045.orlgmj (mgr.34412) 11363 : cluster [DBG] pgmap v6479: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:31.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:24:31 gibba015 bash[29377]: cluster 2021-03-10T17:24:30.422133+0000 mgr.gibba045.orlgmj (mgr.34412) 11363 : cluster [DBG] pgmap v6479: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:31.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:24:31 gibba015 bash[30343]: cluster 2021-03-10T17:24:30.422133+0000 mgr.gibba045.orlgmj (mgr.34412) 11363 : cluster [DBG] pgmap v6479: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:33.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:24:33 gibba045 bash[25517]: cluster 2021-03-10T17:24:32.423788+0000 mgr.gibba045.orlgmj (mgr.34412) 11364 : cluster [DBG] pgmap v6480: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:33.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:24:33 gibba015 bash[29377]: cluster 2021-03-10T17:24:32.423788+0000 mgr.gibba045.orlgmj (mgr.34412) 11364 : cluster [DBG] pgmap v6480: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:33.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:24:33 gibba015 bash[30343]: cluster 2021-03-10T17:24:32.423788+0000 mgr.gibba045.orlgmj (mgr.34412) 11364 : cluster [DBG] pgmap v6480: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:35.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:24:35 gibba045 bash[25517]: cluster 2021-03-10T17:24:34.425071+0000 mgr.gibba045.orlgmj (mgr.34412) 11365 : cluster [DBG] pgmap v6481: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:35.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:24:35 gibba015 bash[29377]: cluster 2021-03-10T17:24:34.425071+0000 mgr.gibba045.orlgmj (mgr.34412) 11365 : cluster [DBG] pgmap v6481: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:35.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:24:35 gibba015 bash[30343]: cluster 2021-03-10T17:24:34.425071+0000 mgr.gibba045.orlgmj (mgr.34412) 11365 : cluster [DBG] pgmap v6481: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:37.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:24:37 gibba045 bash[25517]: cluster 2021-03-10T17:24:36.426934+0000 mgr.gibba045.orlgmj (mgr.34412) 11366 : cluster [DBG] pgmap v6482: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:37.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:24:37 gibba015 bash[29377]: cluster 2021-03-10T17:24:36.426934+0000 mgr.gibba045.orlgmj (mgr.34412) 11366 : cluster [DBG] pgmap v6482: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:37.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:24:37 gibba015 bash[30343]: cluster 2021-03-10T17:24:36.426934+0000 mgr.gibba045.orlgmj (mgr.34412) 11366 : cluster [DBG] pgmap v6482: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:39.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:24:38 gibba015 bash[29377]: cluster 2021-03-10T17:24:38.428192+0000 mgr.gibba045.orlgmj (mgr.34412) 11367 : cluster [DBG] pgmap v6483: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:39.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:24:38 gibba015 bash[30343]: cluster 2021-03-10T17:24:38.428192+0000 mgr.gibba045.orlgmj (mgr.34412) 11367 : cluster [DBG] pgmap v6483: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:39.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:24:38 gibba045 bash[25517]: cluster 2021-03-10T17:24:38.428192+0000 mgr.gibba045.orlgmj (mgr.34412) 11367 : cluster [DBG] pgmap v6483: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:40.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:24:40 gibba015 bash[29377]: audit 2021-03-10T17:24:40.124209+0000 mon.c (mon.1) 3112 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:24:40.471 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:24:40 gibba015 bash[30343]: audit 2021-03-10T17:24:40.124209+0000 mon.c (mon.1) 3112 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:24:40.540 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:24:40 gibba045 bash[25517]: audit 2021-03-10T17:24:40.124209+0000 mon.c (mon.1) 3112 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:24:41.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:24:41 gibba015 bash[29377]: audit 2021-03-10T17:24:40.332588+0000 mon.a (mon.0) 2389 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:24:41.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:24:41 gibba015 bash[29377]: cephadm 2021-03-10T17:24:40.335452+0000 mgr.gibba045.orlgmj (mgr.34412) 11368 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:24:41.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:24:41 gibba015 bash[29377]: audit 2021-03-10T17:24:40.340830+0000 mon.a (mon.0) 2390 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:24:41.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:24:41 gibba015 bash[29377]: cephadm 2021-03-10T17:24:40.343709+0000 mgr.gibba045.orlgmj (mgr.34412) 11369 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:24:41.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:24:41 gibba015 bash[29377]: cluster 2021-03-10T17:24:40.428681+0000 mgr.gibba045.orlgmj (mgr.34412) 11370 : cluster [DBG] pgmap v6484: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:41.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:24:41 gibba015 bash[29377]: audit 2021-03-10T17:24:40.525703+0000 mon.a (mon.0) 2391 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:24:41.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:24:41 gibba015 bash[29377]: audit 2021-03-10T17:24:40.529549+0000 mon.c (mon.1) 3113 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:24:41.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:24:41 gibba015 bash[29377]: cephadm 2021-03-10T17:24:40.530774+0000 mgr.gibba045.orlgmj (mgr.34412) 11371 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:24:41.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:24:41 gibba015 bash[29377]: audit 2021-03-10T17:24:40.530997+0000 mon.c (mon.1) 3114 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:24:41.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:24:41 gibba015 bash[29377]: audit 2021-03-10T17:24:40.532307+0000 mon.c (mon.1) 3115 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:24:41.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:24:41 gibba015 bash[29377]: cephadm 2021-03-10T17:24:40.532392+0000 mgr.gibba045.orlgmj (mgr.34412) 11372 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:24:41.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:24:41 gibba015 bash[29377]: audit 2021-03-10T17:24:40.533616+0000 mon.c (mon.1) 3116 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:24:41.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:24:41 gibba015 bash[29377]: cephadm 2021-03-10T17:24:40.533694+0000 mgr.gibba045.orlgmj (mgr.34412) 11373 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:24:41.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:24:41 gibba015 bash[29377]: cephadm 2021-03-10T17:24:40.533738+0000 mgr.gibba045.orlgmj (mgr.34412) 11374 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:24:41.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:24:41 gibba015 bash[29377]: cephadm 2021-03-10T17:24:40.535040+0000 mgr.gibba045.orlgmj (mgr.34412) 11375 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:24:41.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:24:41 gibba015 bash[29377]: cephadm 2021-03-10T17:24:40.535084+0000 mgr.gibba045.orlgmj (mgr.34412) 11376 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:24:41.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:24:41 gibba015 bash[29377]: cephadm 2021-03-10T17:24:40.536292+0000 mgr.gibba045.orlgmj (mgr.34412) 11377 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:24:41.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:24:41 gibba015 bash[29377]: audit 2021-03-10T17:24:40.536642+0000 mon.c (mon.1) 3117 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:24:41.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:24:41 gibba015 bash[29377]: cephadm 2021-03-10T17:24:40.537930+0000 mgr.gibba045.orlgmj (mgr.34412) 11378 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:24:41.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:24:41 gibba015 bash[29377]: cephadm 2021-03-10T17:24:40.537974+0000 mgr.gibba045.orlgmj (mgr.34412) 11379 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:24:41.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:24:41 gibba015 bash[30343]: audit 2021-03-10T17:24:40.332588+0000 mon.a (mon.0) 2389 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:24:41.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:24:41 gibba015 bash[30343]: cephadm 2021-03-10T17:24:40.335452+0000 mgr.gibba045.orlgmj (mgr.34412) 11368 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:24:41.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:24:41 gibba015 bash[30343]: audit 2021-03-10T17:24:40.340830+0000 mon.a (mon.0) 2390 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:24:41.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:24:41 gibba015 bash[30343]: cephadm 2021-03-10T17:24:40.343709+0000 mgr.gibba045.orlgmj (mgr.34412) 11369 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:24:41.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:24:41 gibba015 bash[30343]: cluster 2021-03-10T17:24:40.428681+0000 mgr.gibba045.orlgmj (mgr.34412) 11370 : cluster [DBG] pgmap v6484: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:41.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:24:41 gibba015 bash[30343]: audit 2021-03-10T17:24:40.525703+0000 mon.a (mon.0) 2391 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:24:41.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:24:41 gibba015 bash[30343]: audit 2021-03-10T17:24:40.529549+0000 mon.c (mon.1) 3113 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:24:41.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:24:41 gibba015 bash[30343]: cephadm 2021-03-10T17:24:40.530774+0000 mgr.gibba045.orlgmj (mgr.34412) 11371 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:24:41.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:24:41 gibba015 bash[30343]: audit 2021-03-10T17:24:40.530997+0000 mon.c (mon.1) 3114 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:24:41.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:24:41 gibba015 bash[30343]: audit 2021-03-10T17:24:40.532307+0000 mon.c (mon.1) 3115 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:24:41.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:24:41 gibba015 bash[30343]: cephadm 2021-03-10T17:24:40.532392+0000 mgr.gibba045.orlgmj (mgr.34412) 11372 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:24:41.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:24:41 gibba015 bash[30343]: audit 2021-03-10T17:24:40.533616+0000 mon.c (mon.1) 3116 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:24:41.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:24:41 gibba015 bash[30343]: cephadm 2021-03-10T17:24:40.533694+0000 mgr.gibba045.orlgmj (mgr.34412) 11373 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:24:41.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:24:41 gibba015 bash[30343]: cephadm 2021-03-10T17:24:40.533738+0000 mgr.gibba045.orlgmj (mgr.34412) 11374 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:24:41.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:24:41 gibba015 bash[30343]: cephadm 2021-03-10T17:24:40.535040+0000 mgr.gibba045.orlgmj (mgr.34412) 11375 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:24:41.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:24:41 gibba015 bash[30343]: cephadm 2021-03-10T17:24:40.535084+0000 mgr.gibba045.orlgmj (mgr.34412) 11376 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:24:41.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:24:41 gibba015 bash[30343]: cephadm 2021-03-10T17:24:40.536292+0000 mgr.gibba045.orlgmj (mgr.34412) 11377 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:24:41.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:24:41 gibba015 bash[30343]: audit 2021-03-10T17:24:40.536642+0000 mon.c (mon.1) 3117 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:24:41.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:24:41 gibba015 bash[30343]: cephadm 2021-03-10T17:24:40.537930+0000 mgr.gibba045.orlgmj (mgr.34412) 11378 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:24:41.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:24:41 gibba015 bash[30343]: cephadm 2021-03-10T17:24:40.537974+0000 mgr.gibba045.orlgmj (mgr.34412) 11379 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:24:41.733 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:24:41 gibba015 bash[29377]: audit 2021-03-10T17:24:40.538130+0000 mon.c (mon.1) 3118 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:24:41.733 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:24:41 gibba015 bash[29377]: cephadm 2021-03-10T17:24:40.539301+0000 mgr.gibba045.orlgmj (mgr.34412) 11380 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:24:41.733 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:24:41 gibba015 bash[29377]: cephadm 2021-03-10T17:24:40.539623+0000 mgr.gibba045.orlgmj (mgr.34412) 11381 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:24:41.734 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:24:41 gibba015 bash[29377]: cephadm 2021-03-10T17:24:40.540718+0000 mgr.gibba045.orlgmj (mgr.34412) 11382 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:24:41.734 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:24:41 gibba015 bash[29377]: cephadm 2021-03-10T17:24:40.540765+0000 mgr.gibba045.orlgmj (mgr.34412) 11383 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:24:41.734 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:24:41 gibba015 bash[29377]: cephadm 2021-03-10T17:24:40.540884+0000 mgr.gibba045.orlgmj (mgr.34412) 11384 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:24:41.735 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:24:41 gibba015 bash[30343]: audit 2021-03-10T17:24:40.538130+0000 mon.c (mon.1) 3118 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:24:41.735 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:24:41 gibba015 bash[30343]: cephadm 2021-03-10T17:24:40.539301+0000 mgr.gibba045.orlgmj (mgr.34412) 11380 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:24:41.735 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:24:41 gibba015 bash[30343]: cephadm 2021-03-10T17:24:40.539623+0000 mgr.gibba045.orlgmj (mgr.34412) 11381 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:24:41.735 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:24:41 gibba015 bash[30343]: cephadm 2021-03-10T17:24:40.540718+0000 mgr.gibba045.orlgmj (mgr.34412) 11382 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:24:41.736 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:24:41 gibba015 bash[30343]: cephadm 2021-03-10T17:24:40.540765+0000 mgr.gibba045.orlgmj (mgr.34412) 11383 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:24:41.736 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:24:41 gibba015 bash[30343]: cephadm 2021-03-10T17:24:40.540884+0000 mgr.gibba045.orlgmj (mgr.34412) 11384 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:24:41.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:24:41 gibba045 bash[25517]: audit 2021-03-10T17:24:40.332588+0000 mon.a (mon.0) 2389 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:24:41.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:24:41 gibba045 bash[25517]: cephadm 2021-03-10T17:24:40.335452+0000 mgr.gibba045.orlgmj (mgr.34412) 11368 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:24:41.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:24:41 gibba045 bash[25517]: audit 2021-03-10T17:24:40.340830+0000 mon.a (mon.0) 2390 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:24:41.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:24:41 gibba045 bash[25517]: cephadm 2021-03-10T17:24:40.343709+0000 mgr.gibba045.orlgmj (mgr.34412) 11369 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:24:41.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:24:41 gibba045 bash[25517]: cluster 2021-03-10T17:24:40.428681+0000 mgr.gibba045.orlgmj (mgr.34412) 11370 : cluster [DBG] pgmap v6484: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:41.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:24:41 gibba045 bash[25517]: audit 2021-03-10T17:24:40.525703+0000 mon.a (mon.0) 2391 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:24:41.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:24:41 gibba045 bash[25517]: audit 2021-03-10T17:24:40.529549+0000 mon.c (mon.1) 3113 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:24:41.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:24:41 gibba045 bash[25517]: cephadm 2021-03-10T17:24:40.530774+0000 mgr.gibba045.orlgmj (mgr.34412) 11371 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:24:41.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:24:41 gibba045 bash[25517]: audit 2021-03-10T17:24:40.530997+0000 mon.c (mon.1) 3114 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:24:41.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:24:41 gibba045 bash[25517]: audit 2021-03-10T17:24:40.532307+0000 mon.c (mon.1) 3115 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:24:41.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:24:41 gibba045 bash[25517]: cephadm 2021-03-10T17:24:40.532392+0000 mgr.gibba045.orlgmj (mgr.34412) 11372 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:24:41.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:24:41 gibba045 bash[25517]: audit 2021-03-10T17:24:40.533616+0000 mon.c (mon.1) 3116 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:24:41.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:24:41 gibba045 bash[25517]: cephadm 2021-03-10T17:24:40.533694+0000 mgr.gibba045.orlgmj (mgr.34412) 11373 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:24:41.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:24:41 gibba045 bash[25517]: cephadm 2021-03-10T17:24:40.533738+0000 mgr.gibba045.orlgmj (mgr.34412) 11374 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:24:41.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:24:41 gibba045 bash[25517]: cephadm 2021-03-10T17:24:40.535040+0000 mgr.gibba045.orlgmj (mgr.34412) 11375 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:24:41.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:24:41 gibba045 bash[25517]: cephadm 2021-03-10T17:24:40.535084+0000 mgr.gibba045.orlgmj (mgr.34412) 11376 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:24:41.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:24:41 gibba045 bash[25517]: cephadm 2021-03-10T17:24:40.536292+0000 mgr.gibba045.orlgmj (mgr.34412) 11377 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:24:41.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:24:41 gibba045 bash[25517]: audit 2021-03-10T17:24:40.536642+0000 mon.c (mon.1) 3117 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:24:41.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:24:41 gibba045 bash[25517]: cephadm 2021-03-10T17:24:40.537930+0000 mgr.gibba045.orlgmj (mgr.34412) 11378 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:24:41.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:24:41 gibba045 bash[25517]: cephadm 2021-03-10T17:24:40.537974+0000 mgr.gibba045.orlgmj (mgr.34412) 11379 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:24:41.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:24:41 gibba045 bash[25517]: audit 2021-03-10T17:24:40.538130+0000 mon.c (mon.1) 3118 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:24:41.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:24:41 gibba045 bash[25517]: cephadm 2021-03-10T17:24:40.539301+0000 mgr.gibba045.orlgmj (mgr.34412) 11380 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:24:41.812 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:24:41 gibba045 bash[25517]: cephadm 2021-03-10T17:24:40.539623+0000 mgr.gibba045.orlgmj (mgr.34412) 11381 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:24:41.812 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:24:41 gibba045 bash[25517]: cephadm 2021-03-10T17:24:40.540718+0000 mgr.gibba045.orlgmj (mgr.34412) 11382 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:24:41.812 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:24:41 gibba045 bash[25517]: cephadm 2021-03-10T17:24:40.540765+0000 mgr.gibba045.orlgmj (mgr.34412) 11383 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:24:41.812 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:24:41 gibba045 bash[25517]: cephadm 2021-03-10T17:24:40.540884+0000 mgr.gibba045.orlgmj (mgr.34412) 11384 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:24:43.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:24:43 gibba045 bash[25517]: cluster 2021-03-10T17:24:42.430300+0000 mgr.gibba045.orlgmj (mgr.34412) 11385 : cluster [DBG] pgmap v6485: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:43.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:24:43 gibba015 bash[29377]: cluster 2021-03-10T17:24:42.430300+0000 mgr.gibba045.orlgmj (mgr.34412) 11385 : cluster [DBG] pgmap v6485: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:43.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:24:43 gibba015 bash[30343]: cluster 2021-03-10T17:24:42.430300+0000 mgr.gibba045.orlgmj (mgr.34412) 11385 : cluster [DBG] pgmap v6485: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:44.281 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:24:44.507 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:24:44.508 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 7m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:24:44.508 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 6m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:24:44.508 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:24:44.508 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:24:44.508 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:24:44.509 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:24:44.509 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:24:44.509 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:24:44.509 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 7m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:24:44.510 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 6m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:24:44.510 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:24:44.510 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:24:44.510 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:24:44.511 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:24:44.511 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:24:44.511 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:24:44.511 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:24:44.511 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:24:44.512 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 6m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:24:44.512 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 6m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:24:44.762 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:24:44.762 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:24:44.762 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:24:44.763 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:24:44.763 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:24:44.763 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:24:44.763 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:24:44.764 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:24:44.764 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:24:44.764 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:24:44.764 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:24:44.764 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:24:44.765 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:24:44.765 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:24:44.765 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:24:45.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:24:45 gibba045 bash[25517]: audit 2021-03-10T17:24:44.272178+0000 mgr.gibba045.orlgmj (mgr.34412) 11386 : audit [DBG] from='client.51684 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:24:45.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:24:45 gibba045 bash[25517]: cluster 2021-03-10T17:24:44.431524+0000 mgr.gibba045.orlgmj (mgr.34412) 11387 : cluster [DBG] pgmap v6486: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:45.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:24:45 gibba045 bash[25517]: audit 2021-03-10T17:24:44.495524+0000 mgr.gibba045.orlgmj (mgr.34412) 11388 : audit [DBG] from='client.61678 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:24:45.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:24:45 gibba045 bash[25517]: audit 2021-03-10T17:24:44.760757+0000 mon.a (mon.0) 2392 : audit [DBG] from='client.? 172.21.2.115:0/271296757' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:24:45.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:24:45 gibba015 bash[29377]: audit 2021-03-10T17:24:44.272178+0000 mgr.gibba045.orlgmj (mgr.34412) 11386 : audit [DBG] from='client.51684 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:24:45.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:24:45 gibba015 bash[29377]: cluster 2021-03-10T17:24:44.431524+0000 mgr.gibba045.orlgmj (mgr.34412) 11387 : cluster [DBG] pgmap v6486: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:45.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:24:45 gibba015 bash[29377]: audit 2021-03-10T17:24:44.495524+0000 mgr.gibba045.orlgmj (mgr.34412) 11388 : audit [DBG] from='client.61678 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:24:45.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:24:45 gibba015 bash[29377]: audit 2021-03-10T17:24:44.760757+0000 mon.a (mon.0) 2392 : audit [DBG] from='client.? 172.21.2.115:0/271296757' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:24:45.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:24:45 gibba015 bash[30343]: audit 2021-03-10T17:24:44.272178+0000 mgr.gibba045.orlgmj (mgr.34412) 11386 : audit [DBG] from='client.51684 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:24:45.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:24:45 gibba015 bash[30343]: cluster 2021-03-10T17:24:44.431524+0000 mgr.gibba045.orlgmj (mgr.34412) 11387 : cluster [DBG] pgmap v6486: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:45.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:24:45 gibba015 bash[30343]: audit 2021-03-10T17:24:44.495524+0000 mgr.gibba045.orlgmj (mgr.34412) 11388 : audit [DBG] from='client.61678 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:24:45.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:24:45 gibba015 bash[30343]: audit 2021-03-10T17:24:44.760757+0000 mon.a (mon.0) 2392 : audit [DBG] from='client.? 172.21.2.115:0/271296757' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:24:47.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:24:47 gibba045 bash[25517]: cluster 2021-03-10T17:24:46.433448+0000 mgr.gibba045.orlgmj (mgr.34412) 11389 : cluster [DBG] pgmap v6487: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:47.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:24:47 gibba015 bash[29377]: cluster 2021-03-10T17:24:46.433448+0000 mgr.gibba045.orlgmj (mgr.34412) 11389 : cluster [DBG] pgmap v6487: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:47.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:24:47 gibba015 bash[30343]: cluster 2021-03-10T17:24:46.433448+0000 mgr.gibba045.orlgmj (mgr.34412) 11389 : cluster [DBG] pgmap v6487: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:49.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:24:48 gibba015 bash[29377]: cluster 2021-03-10T17:24:48.434616+0000 mgr.gibba045.orlgmj (mgr.34412) 11390 : cluster [DBG] pgmap v6488: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:49.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:24:48 gibba015 bash[30343]: cluster 2021-03-10T17:24:48.434616+0000 mgr.gibba045.orlgmj (mgr.34412) 11390 : cluster [DBG] pgmap v6488: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:49.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:24:48 gibba045 bash[25517]: cluster 2021-03-10T17:24:48.434616+0000 mgr.gibba045.orlgmj (mgr.34412) 11390 : cluster [DBG] pgmap v6488: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:51.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:24:51 gibba045 bash[25517]: cluster 2021-03-10T17:24:50.436190+0000 mgr.gibba045.orlgmj (mgr.34412) 11391 : cluster [DBG] pgmap v6489: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:51.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:24:51 gibba015 bash[29377]: cluster 2021-03-10T17:24:50.436190+0000 mgr.gibba045.orlgmj (mgr.34412) 11391 : cluster [DBG] pgmap v6489: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:51.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:24:51 gibba015 bash[30343]: cluster 2021-03-10T17:24:50.436190+0000 mgr.gibba045.orlgmj (mgr.34412) 11391 : cluster [DBG] pgmap v6489: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:53.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:24:53 gibba045 bash[25517]: cluster 2021-03-10T17:24:52.437798+0000 mgr.gibba045.orlgmj (mgr.34412) 11392 : cluster [DBG] pgmap v6490: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:53.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:24:53 gibba015 bash[29377]: cluster 2021-03-10T17:24:52.437798+0000 mgr.gibba045.orlgmj (mgr.34412) 11392 : cluster [DBG] pgmap v6490: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:53.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:24:53 gibba015 bash[30343]: cluster 2021-03-10T17:24:52.437798+0000 mgr.gibba045.orlgmj (mgr.34412) 11392 : cluster [DBG] pgmap v6490: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:54.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:24:54 gibba045 bash[25517]: audit 2021-03-10T17:24:54.040240+0000 mon.c (mon.1) 3119 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:24:54.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:24:54 gibba045 bash[25517]: audit 2021-03-10T17:24:54.040926+0000 mon.c (mon.1) 3120 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:24:54.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:24:54 gibba045 bash[25517]: audit 2021-03-10T17:24:54.041537+0000 mon.a (mon.0) 2393 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:24:54.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:24:54 gibba045 bash[25517]: audit 2021-03-10T17:24:54.042873+0000 mon.a (mon.0) 2394 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:24:54.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:24:54 gibba045 bash[25517]: audit 2021-03-10T17:24:54.141929+0000 mon.c (mon.1) 3121 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T17:24:54.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:24:54 gibba045 bash[25517]: audit 2021-03-10T17:24:54.142689+0000 mon.c (mon.1) 3122 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:24:54.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:24:54 gibba045 bash[25517]: audit 2021-03-10T17:24:54.143317+0000 mon.a (mon.0) 2395 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T17:24:54.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:24:54 gibba045 bash[25517]: audit 2021-03-10T17:24:54.143378+0000 mon.c (mon.1) 3123 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:24:54.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:24:54 gibba045 bash[25517]: audit 2021-03-10T17:24:54.144055+0000 mon.c (mon.1) 3124 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:24:54.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:24:54 gibba045 bash[25517]: audit 2021-03-10T17:24:54.145355+0000 mon.a (mon.0) 2396 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:24:54.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:24:54 gibba045 bash[25517]: audit 2021-03-10T17:24:54.146460+0000 mon.a (mon.0) 2397 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:24:54.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:24:54 gibba045 bash[25517]: audit 2021-03-10T17:24:54.147335+0000 mon.a (mon.0) 2398 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:24:54.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:24:54 gibba015 bash[29377]: audit 2021-03-10T17:24:54.040240+0000 mon.c (mon.1) 3119 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:24:54.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:24:54 gibba015 bash[29377]: audit 2021-03-10T17:24:54.040926+0000 mon.c (mon.1) 3120 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:24:54.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:24:54 gibba015 bash[29377]: audit 2021-03-10T17:24:54.041537+0000 mon.a (mon.0) 2393 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:24:54.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:24:54 gibba015 bash[29377]: audit 2021-03-10T17:24:54.042873+0000 mon.a (mon.0) 2394 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:24:54.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:24:54 gibba015 bash[29377]: audit 2021-03-10T17:24:54.141929+0000 mon.c (mon.1) 3121 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T17:24:54.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:24:54 gibba015 bash[29377]: audit 2021-03-10T17:24:54.142689+0000 mon.c (mon.1) 3122 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:24:54.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:24:54 gibba015 bash[29377]: audit 2021-03-10T17:24:54.143317+0000 mon.a (mon.0) 2395 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T17:24:54.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:24:54 gibba015 bash[29377]: audit 2021-03-10T17:24:54.143378+0000 mon.c (mon.1) 3123 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:24:54.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:24:54 gibba015 bash[29377]: audit 2021-03-10T17:24:54.144055+0000 mon.c (mon.1) 3124 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:24:54.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:24:54 gibba015 bash[29377]: audit 2021-03-10T17:24:54.145355+0000 mon.a (mon.0) 2396 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:24:54.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:24:54 gibba015 bash[29377]: audit 2021-03-10T17:24:54.146460+0000 mon.a (mon.0) 2397 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:24:54.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:24:54 gibba015 bash[29377]: audit 2021-03-10T17:24:54.147335+0000 mon.a (mon.0) 2398 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:24:54.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:24:54 gibba015 bash[30343]: audit 2021-03-10T17:24:54.040240+0000 mon.c (mon.1) 3119 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:24:54.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:24:54 gibba015 bash[30343]: audit 2021-03-10T17:24:54.040926+0000 mon.c (mon.1) 3120 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:24:54.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:24:54 gibba015 bash[30343]: audit 2021-03-10T17:24:54.041537+0000 mon.a (mon.0) 2393 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:24:54.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:24:54 gibba015 bash[30343]: audit 2021-03-10T17:24:54.042873+0000 mon.a (mon.0) 2394 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:24:54.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:24:54 gibba015 bash[30343]: audit 2021-03-10T17:24:54.141929+0000 mon.c (mon.1) 3121 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T17:24:54.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:24:54 gibba015 bash[30343]: audit 2021-03-10T17:24:54.142689+0000 mon.c (mon.1) 3122 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:24:54.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:24:54 gibba015 bash[30343]: audit 2021-03-10T17:24:54.143317+0000 mon.a (mon.0) 2395 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T17:24:54.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:24:54 gibba015 bash[30343]: audit 2021-03-10T17:24:54.143378+0000 mon.c (mon.1) 3123 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:24:54.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:24:54 gibba015 bash[30343]: audit 2021-03-10T17:24:54.144055+0000 mon.c (mon.1) 3124 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:24:54.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:24:54 gibba015 bash[30343]: audit 2021-03-10T17:24:54.145355+0000 mon.a (mon.0) 2396 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:24:54.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:24:54 gibba015 bash[30343]: audit 2021-03-10T17:24:54.146460+0000 mon.a (mon.0) 2397 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:24:54.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:24:54 gibba015 bash[30343]: audit 2021-03-10T17:24:54.147335+0000 mon.a (mon.0) 2398 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:24:55.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:24:55 gibba045 bash[25517]: cluster 2021-03-10T17:24:54.439082+0000 mgr.gibba045.orlgmj (mgr.34412) 11393 : cluster [DBG] pgmap v6491: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:55.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:24:55 gibba015 bash[29377]: cluster 2021-03-10T17:24:54.439082+0000 mgr.gibba045.orlgmj (mgr.34412) 11393 : cluster [DBG] pgmap v6491: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:55.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:24:55 gibba015 bash[30343]: cluster 2021-03-10T17:24:54.439082+0000 mgr.gibba045.orlgmj (mgr.34412) 11393 : cluster [DBG] pgmap v6491: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:56.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:24:56 gibba045 bash[25517]: cephadm 2021-03-10T17:24:55.552661+0000 mgr.gibba045.orlgmj (mgr.34412) 11394 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:24:56.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:24:56 gibba015 bash[29377]: cephadm 2021-03-10T17:24:55.552661+0000 mgr.gibba045.orlgmj (mgr.34412) 11394 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:24:56.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:24:56 gibba015 bash[30343]: cephadm 2021-03-10T17:24:55.552661+0000 mgr.gibba045.orlgmj (mgr.34412) 11394 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:24:57.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:24:57 gibba045 bash[25517]: cluster 2021-03-10T17:24:56.441070+0000 mgr.gibba045.orlgmj (mgr.34412) 11395 : cluster [DBG] pgmap v6492: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:57.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:24:57 gibba015 bash[29377]: cluster 2021-03-10T17:24:56.441070+0000 mgr.gibba045.orlgmj (mgr.34412) 11395 : cluster [DBG] pgmap v6492: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:57.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:24:57 gibba015 bash[30343]: cluster 2021-03-10T17:24:56.441070+0000 mgr.gibba045.orlgmj (mgr.34412) 11395 : cluster [DBG] pgmap v6492: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:59.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:24:58 gibba015 bash[29377]: cluster 2021-03-10T17:24:58.442533+0000 mgr.gibba045.orlgmj (mgr.34412) 11396 : cluster [DBG] pgmap v6493: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:59.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:24:58 gibba015 bash[30343]: cluster 2021-03-10T17:24:58.442533+0000 mgr.gibba045.orlgmj (mgr.34412) 11396 : cluster [DBG] pgmap v6493: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:59.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:24:58 gibba045 bash[25517]: cluster 2021-03-10T17:24:58.442533+0000 mgr.gibba045.orlgmj (mgr.34412) 11396 : cluster [DBG] pgmap v6493: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:01.721 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:25:01 gibba015 bash[29377]: cluster 2021-03-10T17:25:00.444187+0000 mgr.gibba045.orlgmj (mgr.34412) 11397 : cluster [DBG] pgmap v6494: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:01.722 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:25:01 gibba015 bash[30343]: cluster 2021-03-10T17:25:00.444187+0000 mgr.gibba045.orlgmj (mgr.34412) 11397 : cluster [DBG] pgmap v6494: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:01.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:25:01 gibba045 bash[25517]: cluster 2021-03-10T17:25:00.444187+0000 mgr.gibba045.orlgmj (mgr.34412) 11397 : cluster [DBG] pgmap v6494: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:03.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:25:03 gibba045 bash[25517]: cluster 2021-03-10T17:25:02.445879+0000 mgr.gibba045.orlgmj (mgr.34412) 11398 : cluster [DBG] pgmap v6495: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:03.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:25:03 gibba015 bash[29377]: cluster 2021-03-10T17:25:02.445879+0000 mgr.gibba045.orlgmj (mgr.34412) 11398 : cluster [DBG] pgmap v6495: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:03.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:25:03 gibba015 bash[30343]: cluster 2021-03-10T17:25:02.445879+0000 mgr.gibba045.orlgmj (mgr.34412) 11398 : cluster [DBG] pgmap v6495: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:05.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:25:05 gibba045 bash[25517]: cluster 2021-03-10T17:25:04.447071+0000 mgr.gibba045.orlgmj (mgr.34412) 11399 : cluster [DBG] pgmap v6496: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:05.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:25:05 gibba015 bash[29377]: cluster 2021-03-10T17:25:04.447071+0000 mgr.gibba045.orlgmj (mgr.34412) 11399 : cluster [DBG] pgmap v6496: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:05.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:25:05 gibba015 bash[30343]: cluster 2021-03-10T17:25:04.447071+0000 mgr.gibba045.orlgmj (mgr.34412) 11399 : cluster [DBG] pgmap v6496: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:07.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:25:07 gibba045 bash[25517]: cluster 2021-03-10T17:25:06.448880+0000 mgr.gibba045.orlgmj (mgr.34412) 11400 : cluster [DBG] pgmap v6497: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:07.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:25:07 gibba015 bash[29377]: cluster 2021-03-10T17:25:06.448880+0000 mgr.gibba045.orlgmj (mgr.34412) 11400 : cluster [DBG] pgmap v6497: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:07.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:25:07 gibba015 bash[30343]: cluster 2021-03-10T17:25:06.448880+0000 mgr.gibba045.orlgmj (mgr.34412) 11400 : cluster [DBG] pgmap v6497: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:09.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:25:08 gibba015 bash[29377]: cluster 2021-03-10T17:25:08.450056+0000 mgr.gibba045.orlgmj (mgr.34412) 11401 : cluster [DBG] pgmap v6498: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:09.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:25:08 gibba015 bash[30343]: cluster 2021-03-10T17:25:08.450056+0000 mgr.gibba045.orlgmj (mgr.34412) 11401 : cluster [DBG] pgmap v6498: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:09.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:25:08 gibba045 bash[25517]: cluster 2021-03-10T17:25:08.450056+0000 mgr.gibba045.orlgmj (mgr.34412) 11401 : cluster [DBG] pgmap v6498: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:11.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:25:11 gibba045 bash[25517]: cluster 2021-03-10T17:25:10.451568+0000 mgr.gibba045.orlgmj (mgr.34412) 11402 : cluster [DBG] pgmap v6499: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:11.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:25:11 gibba045 bash[25517]: cephadm 2021-03-10T17:25:10.568393+0000 mgr.gibba045.orlgmj (mgr.34412) 11403 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:25:11.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:25:11 gibba015 bash[29377]: cluster 2021-03-10T17:25:10.451568+0000 mgr.gibba045.orlgmj (mgr.34412) 11402 : cluster [DBG] pgmap v6499: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:11.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:25:11 gibba015 bash[29377]: cephadm 2021-03-10T17:25:10.568393+0000 mgr.gibba045.orlgmj (mgr.34412) 11403 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:25:11.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:25:11 gibba015 bash[30343]: cluster 2021-03-10T17:25:10.451568+0000 mgr.gibba045.orlgmj (mgr.34412) 11402 : cluster [DBG] pgmap v6499: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:11.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:25:11 gibba015 bash[30343]: cephadm 2021-03-10T17:25:10.568393+0000 mgr.gibba045.orlgmj (mgr.34412) 11403 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:25:13.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:25:13 gibba045 bash[25517]: cluster 2021-03-10T17:25:12.453276+0000 mgr.gibba045.orlgmj (mgr.34412) 11404 : cluster [DBG] pgmap v6500: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:13.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:25:13 gibba015 bash[29377]: cluster 2021-03-10T17:25:12.453276+0000 mgr.gibba045.orlgmj (mgr.34412) 11404 : cluster [DBG] pgmap v6500: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:13.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:25:13 gibba015 bash[30343]: cluster 2021-03-10T17:25:12.453276+0000 mgr.gibba045.orlgmj (mgr.34412) 11404 : cluster [DBG] pgmap v6500: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:15.010 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:25:15.237 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:25:15.237 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 7m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:25:15.238 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 6m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:25:15.238 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:25:15.238 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:25:15.238 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:25:15.239 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:25:15.239 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:25:15.239 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:25:15.239 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 7m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:25:15.240 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 6m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:25:15.240 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:25:15.240 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:25:15.240 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:25:15.241 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:25:15.241 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:25:15.241 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:25:15.241 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:25:15.242 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:25:15.242 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 6m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:25:15.242 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 6m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:25:15.485 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:25:15.485 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:25:15.486 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:25:15.486 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:25:15.486 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:25:15.486 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:25:15.487 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:25:15.487 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:25:15.487 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:25:15.487 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:25:15.487 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:25:15.488 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:25:15.488 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:25:15.488 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:25:15.488 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:25:15.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:25:15 gibba045 bash[25517]: cluster 2021-03-10T17:25:14.454513+0000 mgr.gibba045.orlgmj (mgr.34412) 11405 : cluster [DBG] pgmap v6501: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:15.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:25:15 gibba045 bash[25517]: audit 2021-03-10T17:25:15.483544+0000 mon.c (mon.1) 3125 : audit [DBG] from='client.? 172.21.2.115:0/2200615530' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:25:15.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:25:15 gibba015 bash[29377]: cluster 2021-03-10T17:25:14.454513+0000 mgr.gibba045.orlgmj (mgr.34412) 11405 : cluster [DBG] pgmap v6501: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:15.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:25:15 gibba015 bash[29377]: audit 2021-03-10T17:25:15.483544+0000 mon.c (mon.1) 3125 : audit [DBG] from='client.? 172.21.2.115:0/2200615530' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:25:15.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:25:15 gibba015 bash[30343]: cluster 2021-03-10T17:25:14.454513+0000 mgr.gibba045.orlgmj (mgr.34412) 11405 : cluster [DBG] pgmap v6501: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:15.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:25:15 gibba015 bash[30343]: audit 2021-03-10T17:25:15.483544+0000 mon.c (mon.1) 3125 : audit [DBG] from='client.? 172.21.2.115:0/2200615530' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:25:16.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:25:16 gibba045 bash[25517]: audit 2021-03-10T17:25:15.001379+0000 mgr.gibba045.orlgmj (mgr.34412) 11406 : audit [DBG] from='client.61690 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:25:16.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:25:16 gibba045 bash[25517]: audit 2021-03-10T17:25:15.225741+0000 mgr.gibba045.orlgmj (mgr.34412) 11407 : audit [DBG] from='client.61696 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:25:16.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:25:16 gibba015 bash[29377]: audit 2021-03-10T17:25:15.001379+0000 mgr.gibba045.orlgmj (mgr.34412) 11406 : audit [DBG] from='client.61690 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:25:16.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:25:16 gibba015 bash[29377]: audit 2021-03-10T17:25:15.225741+0000 mgr.gibba045.orlgmj (mgr.34412) 11407 : audit [DBG] from='client.61696 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:25:16.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:25:16 gibba015 bash[30343]: audit 2021-03-10T17:25:15.001379+0000 mgr.gibba045.orlgmj (mgr.34412) 11406 : audit [DBG] from='client.61690 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:25:16.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:25:16 gibba015 bash[30343]: audit 2021-03-10T17:25:15.225741+0000 mgr.gibba045.orlgmj (mgr.34412) 11407 : audit [DBG] from='client.61696 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:25:17.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:25:17 gibba045 bash[25517]: cluster 2021-03-10T17:25:16.456496+0000 mgr.gibba045.orlgmj (mgr.34412) 11408 : cluster [DBG] pgmap v6502: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:17.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:25:17 gibba015 bash[29377]: cluster 2021-03-10T17:25:16.456496+0000 mgr.gibba045.orlgmj (mgr.34412) 11408 : cluster [DBG] pgmap v6502: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:17.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:25:17 gibba015 bash[30343]: cluster 2021-03-10T17:25:16.456496+0000 mgr.gibba045.orlgmj (mgr.34412) 11408 : cluster [DBG] pgmap v6502: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:19.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:25:18 gibba015 bash[29377]: cluster 2021-03-10T17:25:18.457777+0000 mgr.gibba045.orlgmj (mgr.34412) 11409 : cluster [DBG] pgmap v6503: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:19.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:25:18 gibba015 bash[30343]: cluster 2021-03-10T17:25:18.457777+0000 mgr.gibba045.orlgmj (mgr.34412) 11409 : cluster [DBG] pgmap v6503: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:19.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:25:18 gibba045 bash[25517]: cluster 2021-03-10T17:25:18.457777+0000 mgr.gibba045.orlgmj (mgr.34412) 11409 : cluster [DBG] pgmap v6503: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:21.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:25:21 gibba045 bash[25517]: cluster 2021-03-10T17:25:20.459187+0000 mgr.gibba045.orlgmj (mgr.34412) 11410 : cluster [DBG] pgmap v6504: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:21.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:25:21 gibba015 bash[29377]: cluster 2021-03-10T17:25:20.459187+0000 mgr.gibba045.orlgmj (mgr.34412) 11410 : cluster [DBG] pgmap v6504: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:21.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:25:21 gibba015 bash[30343]: cluster 2021-03-10T17:25:20.459187+0000 mgr.gibba045.orlgmj (mgr.34412) 11410 : cluster [DBG] pgmap v6504: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:23.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:25:23 gibba045 bash[25517]: cluster 2021-03-10T17:25:22.460980+0000 mgr.gibba045.orlgmj (mgr.34412) 11411 : cluster [DBG] pgmap v6505: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:23.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:25:23 gibba015 bash[29377]: cluster 2021-03-10T17:25:22.460980+0000 mgr.gibba045.orlgmj (mgr.34412) 11411 : cluster [DBG] pgmap v6505: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:23.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:25:23 gibba015 bash[30343]: cluster 2021-03-10T17:25:22.460980+0000 mgr.gibba045.orlgmj (mgr.34412) 11411 : cluster [DBG] pgmap v6505: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:25.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:25:25 gibba045 bash[25517]: cluster 2021-03-10T17:25:24.462234+0000 mgr.gibba045.orlgmj (mgr.34412) 11412 : cluster [DBG] pgmap v6506: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:25.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:25:25 gibba015 bash[29377]: cluster 2021-03-10T17:25:24.462234+0000 mgr.gibba045.orlgmj (mgr.34412) 11412 : cluster [DBG] pgmap v6506: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:25.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:25:25 gibba015 bash[30343]: cluster 2021-03-10T17:25:24.462234+0000 mgr.gibba045.orlgmj (mgr.34412) 11412 : cluster [DBG] pgmap v6506: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:26.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:25:26 gibba045 bash[25517]: cephadm 2021-03-10T17:25:25.583914+0000 mgr.gibba045.orlgmj (mgr.34412) 11413 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:25:26.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:25:26 gibba015 bash[29377]: cephadm 2021-03-10T17:25:25.583914+0000 mgr.gibba045.orlgmj (mgr.34412) 11413 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:25:26.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:25:26 gibba015 bash[30343]: cephadm 2021-03-10T17:25:25.583914+0000 mgr.gibba045.orlgmj (mgr.34412) 11413 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:25:27.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:25:27 gibba045 bash[25517]: cluster 2021-03-10T17:25:26.464038+0000 mgr.gibba045.orlgmj (mgr.34412) 11414 : cluster [DBG] pgmap v6507: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:27.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:25:27 gibba015 bash[29377]: cluster 2021-03-10T17:25:26.464038+0000 mgr.gibba045.orlgmj (mgr.34412) 11414 : cluster [DBG] pgmap v6507: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:27.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:25:27 gibba015 bash[30343]: cluster 2021-03-10T17:25:26.464038+0000 mgr.gibba045.orlgmj (mgr.34412) 11414 : cluster [DBG] pgmap v6507: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:29.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:25:28 gibba015 bash[29377]: cluster 2021-03-10T17:25:28.465567+0000 mgr.gibba045.orlgmj (mgr.34412) 11415 : cluster [DBG] pgmap v6508: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:29.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:25:28 gibba015 bash[30343]: cluster 2021-03-10T17:25:28.465567+0000 mgr.gibba045.orlgmj (mgr.34412) 11415 : cluster [DBG] pgmap v6508: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:29.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:25:28 gibba045 bash[25517]: cluster 2021-03-10T17:25:28.465567+0000 mgr.gibba045.orlgmj (mgr.34412) 11415 : cluster [DBG] pgmap v6508: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:31.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:25:31 gibba045 bash[25517]: cluster 2021-03-10T17:25:30.467284+0000 mgr.gibba045.orlgmj (mgr.34412) 11416 : cluster [DBG] pgmap v6509: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:31.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:25:31 gibba015 bash[29377]: cluster 2021-03-10T17:25:30.467284+0000 mgr.gibba045.orlgmj (mgr.34412) 11416 : cluster [DBG] pgmap v6509: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:31.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:25:31 gibba015 bash[30343]: cluster 2021-03-10T17:25:30.467284+0000 mgr.gibba045.orlgmj (mgr.34412) 11416 : cluster [DBG] pgmap v6509: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:33.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:25:33 gibba045 bash[25517]: cluster 2021-03-10T17:25:32.469056+0000 mgr.gibba045.orlgmj (mgr.34412) 11417 : cluster [DBG] pgmap v6510: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:33.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:25:33 gibba015 bash[29377]: cluster 2021-03-10T17:25:32.469056+0000 mgr.gibba045.orlgmj (mgr.34412) 11417 : cluster [DBG] pgmap v6510: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:33.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:25:33 gibba015 bash[30343]: cluster 2021-03-10T17:25:32.469056+0000 mgr.gibba045.orlgmj (mgr.34412) 11417 : cluster [DBG] pgmap v6510: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:35.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:25:35 gibba045 bash[25517]: cluster 2021-03-10T17:25:34.470537+0000 mgr.gibba045.orlgmj (mgr.34412) 11418 : cluster [DBG] pgmap v6511: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:35.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:25:35 gibba015 bash[29377]: cluster 2021-03-10T17:25:34.470537+0000 mgr.gibba045.orlgmj (mgr.34412) 11418 : cluster [DBG] pgmap v6511: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:35.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:25:35 gibba015 bash[30343]: cluster 2021-03-10T17:25:34.470537+0000 mgr.gibba045.orlgmj (mgr.34412) 11418 : cluster [DBG] pgmap v6511: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:37.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:25:37 gibba015 bash[29377]: cluster 2021-03-10T17:25:36.472469+0000 mgr.gibba045.orlgmj (mgr.34412) 11419 : cluster [DBG] pgmap v6512: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:37.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:25:37 gibba015 bash[30343]: cluster 2021-03-10T17:25:36.472469+0000 mgr.gibba045.orlgmj (mgr.34412) 11419 : cluster [DBG] pgmap v6512: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:38.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:25:37 gibba045 bash[25517]: cluster 2021-03-10T17:25:36.472469+0000 mgr.gibba045.orlgmj (mgr.34412) 11419 : cluster [DBG] pgmap v6512: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:39.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:25:38 gibba015 bash[29377]: cluster 2021-03-10T17:25:38.473664+0000 mgr.gibba045.orlgmj (mgr.34412) 11420 : cluster [DBG] pgmap v6513: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:39.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:25:38 gibba015 bash[30343]: cluster 2021-03-10T17:25:38.473664+0000 mgr.gibba045.orlgmj (mgr.34412) 11420 : cluster [DBG] pgmap v6513: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:39.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:25:38 gibba045 bash[25517]: cluster 2021-03-10T17:25:38.473664+0000 mgr.gibba045.orlgmj (mgr.34412) 11420 : cluster [DBG] pgmap v6513: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:41.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:25:41 gibba045 bash[25517]: cluster 2021-03-10T17:25:40.475385+0000 mgr.gibba045.orlgmj (mgr.34412) 11421 : cluster [DBG] pgmap v6514: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:41.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:25:41 gibba045 bash[25517]: audit 2021-03-10T17:25:40.598338+0000 mon.c (mon.1) 3126 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:25:41.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:25:41 gibba045 bash[25517]: cephadm 2021-03-10T17:25:40.603126+0000 mgr.gibba045.orlgmj (mgr.34412) 11422 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:25:41.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:25:41 gibba045 bash[25517]: cephadm 2021-03-10T17:25:40.603951+0000 mgr.gibba045.orlgmj (mgr.34412) 11423 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:25:41.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:25:41 gibba045 bash[25517]: audit 2021-03-10T17:25:40.821012+0000 mon.a (mon.0) 2399 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:25:41.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:25:41 gibba045 bash[25517]: audit 2021-03-10T17:25:40.825701+0000 mon.c (mon.1) 3127 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:25:41.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:25:41 gibba045 bash[25517]: audit 2021-03-10T17:25:40.827284+0000 mon.c (mon.1) 3128 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:25:41.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:25:41 gibba045 bash[25517]: audit 2021-03-10T17:25:40.828654+0000 mon.c (mon.1) 3129 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:25:41.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:25:41 gibba045 bash[25517]: audit 2021-03-10T17:25:40.829742+0000 mon.c (mon.1) 3130 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:25:41.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:25:41 gibba045 bash[25517]: audit 2021-03-10T17:25:40.832855+0000 mon.c (mon.1) 3131 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:25:41.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:25:41 gibba045 bash[25517]: audit 2021-03-10T17:25:40.834450+0000 mon.c (mon.1) 3132 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:25:41.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:25:41 gibba015 bash[29377]: cluster 2021-03-10T17:25:40.475385+0000 mgr.gibba045.orlgmj (mgr.34412) 11421 : cluster [DBG] pgmap v6514: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:41.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:25:41 gibba015 bash[29377]: audit 2021-03-10T17:25:40.598338+0000 mon.c (mon.1) 3126 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:25:41.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:25:41 gibba015 bash[29377]: cephadm 2021-03-10T17:25:40.603126+0000 mgr.gibba045.orlgmj (mgr.34412) 11422 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:25:41.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:25:41 gibba015 bash[29377]: cephadm 2021-03-10T17:25:40.603951+0000 mgr.gibba045.orlgmj (mgr.34412) 11423 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:25:41.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:25:41 gibba015 bash[29377]: audit 2021-03-10T17:25:40.821012+0000 mon.a (mon.0) 2399 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:25:41.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:25:41 gibba015 bash[29377]: audit 2021-03-10T17:25:40.825701+0000 mon.c (mon.1) 3127 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:25:41.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:25:41 gibba015 bash[29377]: audit 2021-03-10T17:25:40.827284+0000 mon.c (mon.1) 3128 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:25:41.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:25:41 gibba015 bash[29377]: audit 2021-03-10T17:25:40.828654+0000 mon.c (mon.1) 3129 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:25:41.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:25:41 gibba015 bash[29377]: audit 2021-03-10T17:25:40.829742+0000 mon.c (mon.1) 3130 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:25:41.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:25:41 gibba015 bash[29377]: audit 2021-03-10T17:25:40.832855+0000 mon.c (mon.1) 3131 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:25:41.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:25:41 gibba015 bash[29377]: audit 2021-03-10T17:25:40.834450+0000 mon.c (mon.1) 3132 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:25:41.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:25:41 gibba015 bash[30343]: cluster 2021-03-10T17:25:40.475385+0000 mgr.gibba045.orlgmj (mgr.34412) 11421 : cluster [DBG] pgmap v6514: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:41.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:25:41 gibba015 bash[30343]: audit 2021-03-10T17:25:40.598338+0000 mon.c (mon.1) 3126 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:25:41.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:25:41 gibba015 bash[30343]: cephadm 2021-03-10T17:25:40.603126+0000 mgr.gibba045.orlgmj (mgr.34412) 11422 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:25:41.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:25:41 gibba015 bash[30343]: cephadm 2021-03-10T17:25:40.603951+0000 mgr.gibba045.orlgmj (mgr.34412) 11423 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:25:41.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:25:41 gibba015 bash[30343]: audit 2021-03-10T17:25:40.821012+0000 mon.a (mon.0) 2399 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:25:41.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:25:41 gibba015 bash[30343]: audit 2021-03-10T17:25:40.825701+0000 mon.c (mon.1) 3127 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:25:41.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:25:41 gibba015 bash[30343]: audit 2021-03-10T17:25:40.827284+0000 mon.c (mon.1) 3128 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:25:41.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:25:41 gibba015 bash[30343]: audit 2021-03-10T17:25:40.828654+0000 mon.c (mon.1) 3129 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:25:41.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:25:41 gibba015 bash[30343]: audit 2021-03-10T17:25:40.829742+0000 mon.c (mon.1) 3130 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:25:41.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:25:41 gibba015 bash[30343]: audit 2021-03-10T17:25:40.832855+0000 mon.c (mon.1) 3131 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:25:41.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:25:41 gibba015 bash[30343]: audit 2021-03-10T17:25:40.834450+0000 mon.c (mon.1) 3132 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:25:42.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:25:42 gibba045 bash[25517]: cephadm 2021-03-10T17:25:40.826630+0000 mgr.gibba045.orlgmj (mgr.34412) 11424 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:25:42.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:25:42 gibba045 bash[25517]: cephadm 2021-03-10T17:25:40.828658+0000 mgr.gibba045.orlgmj (mgr.34412) 11425 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:25:42.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:25:42 gibba045 bash[25517]: cephadm 2021-03-10T17:25:40.830050+0000 mgr.gibba045.orlgmj (mgr.34412) 11426 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:25:42.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:25:42 gibba045 bash[25517]: cephadm 2021-03-10T17:25:40.830112+0000 mgr.gibba045.orlgmj (mgr.34412) 11427 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:25:42.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:25:42 gibba045 bash[25517]: cephadm 2021-03-10T17:25:40.831237+0000 mgr.gibba045.orlgmj (mgr.34412) 11428 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:25:42.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:25:42 gibba045 bash[25517]: cephadm 2021-03-10T17:25:40.831299+0000 mgr.gibba045.orlgmj (mgr.34412) 11429 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:25:42.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:25:42 gibba045 bash[25517]: cephadm 2021-03-10T17:25:40.832507+0000 mgr.gibba045.orlgmj (mgr.34412) 11430 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:25:42.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:25:42 gibba045 bash[25517]: cephadm 2021-03-10T17:25:40.834180+0000 mgr.gibba045.orlgmj (mgr.34412) 11431 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:25:42.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:25:42 gibba045 bash[25517]: cephadm 2021-03-10T17:25:40.834248+0000 mgr.gibba045.orlgmj (mgr.34412) 11432 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:25:42.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:25:42 gibba045 bash[25517]: cephadm 2021-03-10T17:25:40.835618+0000 mgr.gibba045.orlgmj (mgr.34412) 11433 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:25:42.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:25:42 gibba045 bash[25517]: cephadm 2021-03-10T17:25:40.836124+0000 mgr.gibba045.orlgmj (mgr.34412) 11434 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:25:42.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:25:42 gibba045 bash[25517]: cephadm 2021-03-10T17:25:40.837451+0000 mgr.gibba045.orlgmj (mgr.34412) 11435 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:25:42.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:25:42 gibba045 bash[25517]: cephadm 2021-03-10T17:25:40.837533+0000 mgr.gibba045.orlgmj (mgr.34412) 11436 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:25:42.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:25:42 gibba045 bash[25517]: cephadm 2021-03-10T17:25:40.837733+0000 mgr.gibba045.orlgmj (mgr.34412) 11437 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:25:42.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:25:42 gibba015 bash[29377]: cephadm 2021-03-10T17:25:40.826630+0000 mgr.gibba045.orlgmj (mgr.34412) 11424 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:25:42.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:25:42 gibba015 bash[29377]: cephadm 2021-03-10T17:25:40.828658+0000 mgr.gibba045.orlgmj (mgr.34412) 11425 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:25:42.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:25:42 gibba015 bash[29377]: cephadm 2021-03-10T17:25:40.830050+0000 mgr.gibba045.orlgmj (mgr.34412) 11426 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:25:42.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:25:42 gibba015 bash[29377]: cephadm 2021-03-10T17:25:40.830112+0000 mgr.gibba045.orlgmj (mgr.34412) 11427 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:25:42.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:25:42 gibba015 bash[29377]: cephadm 2021-03-10T17:25:40.831237+0000 mgr.gibba045.orlgmj (mgr.34412) 11428 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:25:42.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:25:42 gibba015 bash[29377]: cephadm 2021-03-10T17:25:40.831299+0000 mgr.gibba045.orlgmj (mgr.34412) 11429 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:25:42.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:25:42 gibba015 bash[29377]: cephadm 2021-03-10T17:25:40.832507+0000 mgr.gibba045.orlgmj (mgr.34412) 11430 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:25:42.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:25:42 gibba015 bash[29377]: cephadm 2021-03-10T17:25:40.834180+0000 mgr.gibba045.orlgmj (mgr.34412) 11431 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:25:42.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:25:42 gibba015 bash[29377]: cephadm 2021-03-10T17:25:40.834248+0000 mgr.gibba045.orlgmj (mgr.34412) 11432 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:25:42.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:25:42 gibba015 bash[29377]: cephadm 2021-03-10T17:25:40.835618+0000 mgr.gibba045.orlgmj (mgr.34412) 11433 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:25:42.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:25:42 gibba015 bash[29377]: cephadm 2021-03-10T17:25:40.836124+0000 mgr.gibba045.orlgmj (mgr.34412) 11434 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:25:42.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:25:42 gibba015 bash[29377]: cephadm 2021-03-10T17:25:40.837451+0000 mgr.gibba045.orlgmj (mgr.34412) 11435 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:25:42.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:25:42 gibba015 bash[29377]: cephadm 2021-03-10T17:25:40.837533+0000 mgr.gibba045.orlgmj (mgr.34412) 11436 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:25:42.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:25:42 gibba015 bash[29377]: cephadm 2021-03-10T17:25:40.837733+0000 mgr.gibba045.orlgmj (mgr.34412) 11437 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:25:42.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:25:42 gibba015 bash[30343]: cephadm 2021-03-10T17:25:40.826630+0000 mgr.gibba045.orlgmj (mgr.34412) 11424 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:25:42.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:25:42 gibba015 bash[30343]: cephadm 2021-03-10T17:25:40.828658+0000 mgr.gibba045.orlgmj (mgr.34412) 11425 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:25:42.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:25:42 gibba015 bash[30343]: cephadm 2021-03-10T17:25:40.830050+0000 mgr.gibba045.orlgmj (mgr.34412) 11426 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:25:42.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:25:42 gibba015 bash[30343]: cephadm 2021-03-10T17:25:40.830112+0000 mgr.gibba045.orlgmj (mgr.34412) 11427 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:25:42.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:25:42 gibba015 bash[30343]: cephadm 2021-03-10T17:25:40.831237+0000 mgr.gibba045.orlgmj (mgr.34412) 11428 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:25:42.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:25:42 gibba015 bash[30343]: cephadm 2021-03-10T17:25:40.831299+0000 mgr.gibba045.orlgmj (mgr.34412) 11429 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:25:42.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:25:42 gibba015 bash[30343]: cephadm 2021-03-10T17:25:40.832507+0000 mgr.gibba045.orlgmj (mgr.34412) 11430 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:25:42.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:25:42 gibba015 bash[30343]: cephadm 2021-03-10T17:25:40.834180+0000 mgr.gibba045.orlgmj (mgr.34412) 11431 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:25:42.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:25:42 gibba015 bash[30343]: cephadm 2021-03-10T17:25:40.834248+0000 mgr.gibba045.orlgmj (mgr.34412) 11432 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:25:42.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:25:42 gibba015 bash[30343]: cephadm 2021-03-10T17:25:40.835618+0000 mgr.gibba045.orlgmj (mgr.34412) 11433 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:25:42.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:25:42 gibba015 bash[30343]: cephadm 2021-03-10T17:25:40.836124+0000 mgr.gibba045.orlgmj (mgr.34412) 11434 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:25:42.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:25:42 gibba015 bash[30343]: cephadm 2021-03-10T17:25:40.837451+0000 mgr.gibba045.orlgmj (mgr.34412) 11435 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:25:42.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:25:42 gibba015 bash[30343]: cephadm 2021-03-10T17:25:40.837533+0000 mgr.gibba045.orlgmj (mgr.34412) 11436 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:25:42.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:25:42 gibba015 bash[30343]: cephadm 2021-03-10T17:25:40.837733+0000 mgr.gibba045.orlgmj (mgr.34412) 11437 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:25:43.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:25:43 gibba045 bash[25517]: cluster 2021-03-10T17:25:42.477242+0000 mgr.gibba045.orlgmj (mgr.34412) 11438 : cluster [DBG] pgmap v6515: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:43.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:25:43 gibba015 bash[29377]: cluster 2021-03-10T17:25:42.477242+0000 mgr.gibba045.orlgmj (mgr.34412) 11438 : cluster [DBG] pgmap v6515: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:43.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:25:43 gibba015 bash[30343]: cluster 2021-03-10T17:25:42.477242+0000 mgr.gibba045.orlgmj (mgr.34412) 11438 : cluster [DBG] pgmap v6515: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:45.732 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:25:45.958 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:25:45.959 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 8m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:25:45.959 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 7m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:25:45.959 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:25:45.959 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:25:45.960 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:25:45.960 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:25:45.960 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:25:45.960 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:25:45.961 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 8m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:25:45.961 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 7m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:25:45.961 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:25:45.961 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:25:45.961 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:25:45.962 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:25:45.962 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:25:45.962 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:25:45.962 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:25:45.963 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:25:45.963 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 7m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:25:45.963 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 7m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:25:45.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:25:45 gibba015 bash[29377]: cluster 2021-03-10T17:25:44.478638+0000 mgr.gibba045.orlgmj (mgr.34412) 11439 : cluster [DBG] pgmap v6516: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:45.971 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:25:45 gibba015 bash[30343]: cluster 2021-03-10T17:25:44.478638+0000 mgr.gibba045.orlgmj (mgr.34412) 11439 : cluster [DBG] pgmap v6516: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:46.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:25:45 gibba045 bash[25517]: cluster 2021-03-10T17:25:44.478638+0000 mgr.gibba045.orlgmj (mgr.34412) 11439 : cluster [DBG] pgmap v6516: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:46.207 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:25:46.207 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:25:46.208 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:25:46.208 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:25:46.208 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:25:46.208 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:25:46.209 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:25:46.209 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:25:46.209 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:25:46.209 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:25:46.209 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:25:46.210 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:25:46.210 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:25:46.210 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:25:46.210 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:25:46.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:25:46 gibba015 bash[29377]: audit 2021-03-10T17:25:46.205537+0000 mon.c (mon.1) 3133 : audit [DBG] from='client.? 172.21.2.115:0/3756900368' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:25:46.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:25:46 gibba015 bash[30343]: audit 2021-03-10T17:25:46.205537+0000 mon.c (mon.1) 3133 : audit [DBG] from='client.? 172.21.2.115:0/3756900368' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:25:47.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:25:46 gibba045 bash[25517]: audit 2021-03-10T17:25:46.205537+0000 mon.c (mon.1) 3133 : audit [DBG] from='client.? 172.21.2.115:0/3756900368' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:25:47.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:25:47 gibba015 bash[29377]: audit 2021-03-10T17:25:45.723966+0000 mgr.gibba045.orlgmj (mgr.34412) 11440 : audit [DBG] from='client.61708 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:25:47.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:25:47 gibba015 bash[29377]: audit 2021-03-10T17:25:45.946826+0000 mgr.gibba045.orlgmj (mgr.34412) 11441 : audit [DBG] from='client.61714 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:25:47.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:25:47 gibba015 bash[29377]: cluster 2021-03-10T17:25:46.480606+0000 mgr.gibba045.orlgmj (mgr.34412) 11442 : cluster [DBG] pgmap v6517: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:47.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:25:47 gibba015 bash[30343]: audit 2021-03-10T17:25:45.723966+0000 mgr.gibba045.orlgmj (mgr.34412) 11440 : audit [DBG] from='client.61708 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:25:47.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:25:47 gibba015 bash[30343]: audit 2021-03-10T17:25:45.946826+0000 mgr.gibba045.orlgmj (mgr.34412) 11441 : audit [DBG] from='client.61714 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:25:47.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:25:47 gibba015 bash[30343]: cluster 2021-03-10T17:25:46.480606+0000 mgr.gibba045.orlgmj (mgr.34412) 11442 : cluster [DBG] pgmap v6517: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:48.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:25:47 gibba045 bash[25517]: audit 2021-03-10T17:25:45.723966+0000 mgr.gibba045.orlgmj (mgr.34412) 11440 : audit [DBG] from='client.61708 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:25:48.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:25:47 gibba045 bash[25517]: audit 2021-03-10T17:25:45.946826+0000 mgr.gibba045.orlgmj (mgr.34412) 11441 : audit [DBG] from='client.61714 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:25:48.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:25:47 gibba045 bash[25517]: cluster 2021-03-10T17:25:46.480606+0000 mgr.gibba045.orlgmj (mgr.34412) 11442 : cluster [DBG] pgmap v6517: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:49.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:25:48 gibba015 bash[29377]: cluster 2021-03-10T17:25:48.482120+0000 mgr.gibba045.orlgmj (mgr.34412) 11443 : cluster [DBG] pgmap v6518: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:49.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:25:48 gibba015 bash[30343]: cluster 2021-03-10T17:25:48.482120+0000 mgr.gibba045.orlgmj (mgr.34412) 11443 : cluster [DBG] pgmap v6518: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:49.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:25:48 gibba045 bash[25517]: cluster 2021-03-10T17:25:48.482120+0000 mgr.gibba045.orlgmj (mgr.34412) 11443 : cluster [DBG] pgmap v6518: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:51.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:25:51 gibba045 bash[25517]: cluster 2021-03-10T17:25:50.483789+0000 mgr.gibba045.orlgmj (mgr.34412) 11444 : cluster [DBG] pgmap v6519: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:51.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:25:51 gibba015 bash[29377]: cluster 2021-03-10T17:25:50.483789+0000 mgr.gibba045.orlgmj (mgr.34412) 11444 : cluster [DBG] pgmap v6519: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:51.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:25:51 gibba015 bash[30343]: cluster 2021-03-10T17:25:50.483789+0000 mgr.gibba045.orlgmj (mgr.34412) 11444 : cluster [DBG] pgmap v6519: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:53.805 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:25:53 gibba045 bash[25517]: cluster 2021-03-10T17:25:52.485524+0000 mgr.gibba045.orlgmj (mgr.34412) 11445 : cluster [DBG] pgmap v6520: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:53.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:25:53 gibba015 bash[29377]: cluster 2021-03-10T17:25:52.485524+0000 mgr.gibba045.orlgmj (mgr.34412) 11445 : cluster [DBG] pgmap v6520: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:53.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:25:53 gibba015 bash[30343]: cluster 2021-03-10T17:25:52.485524+0000 mgr.gibba045.orlgmj (mgr.34412) 11445 : cluster [DBG] pgmap v6520: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:54.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:25:54 gibba015 bash[29377]: audit 2021-03-10T17:25:54.047911+0000 mon.c (mon.1) 3134 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:25:54.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:25:54 gibba015 bash[29377]: audit 2021-03-10T17:25:54.048550+0000 mon.c (mon.1) 3135 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:25:54.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:25:54 gibba015 bash[29377]: audit 2021-03-10T17:25:54.049037+0000 mon.a (mon.0) 2400 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:25:54.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:25:54 gibba015 bash[29377]: audit 2021-03-10T17:25:54.050309+0000 mon.a (mon.0) 2401 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:25:54.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:25:54 gibba015 bash[29377]: audit 2021-03-10T17:25:54.148376+0000 mon.c (mon.1) 3136 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T17:25:54.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:25:54 gibba015 bash[29377]: audit 2021-03-10T17:25:54.149158+0000 mon.c (mon.1) 3137 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:25:54.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:25:54 gibba015 bash[29377]: audit 2021-03-10T17:25:54.149631+0000 mon.a (mon.0) 2402 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T17:25:54.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:25:54 gibba015 bash[29377]: audit 2021-03-10T17:25:54.149887+0000 mon.c (mon.1) 3138 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T17:25:54.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:25:54 gibba015 bash[29377]: audit 2021-03-10T17:25:54.150721+0000 mon.c (mon.1) 3139 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:25:54.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:25:54 gibba015 bash[29377]: audit 2021-03-10T17:25:54.151167+0000 mon.a (mon.0) 2403 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:25:54.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:25:54 gibba015 bash[29377]: audit 2021-03-10T17:25:54.152285+0000 mon.a (mon.0) 2404 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T17:25:54.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:25:54 gibba015 bash[29377]: audit 2021-03-10T17:25:54.153292+0000 mon.a (mon.0) 2405 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:25:54.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:25:54 gibba015 bash[30343]: audit 2021-03-10T17:25:54.047911+0000 mon.c (mon.1) 3134 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:25:54.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:25:54 gibba015 bash[30343]: audit 2021-03-10T17:25:54.048550+0000 mon.c (mon.1) 3135 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:25:54.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:25:54 gibba015 bash[30343]: audit 2021-03-10T17:25:54.049037+0000 mon.a (mon.0) 2400 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:25:54.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:25:54 gibba015 bash[30343]: audit 2021-03-10T17:25:54.050309+0000 mon.a (mon.0) 2401 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:25:54.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:25:54 gibba015 bash[30343]: audit 2021-03-10T17:25:54.148376+0000 mon.c (mon.1) 3136 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T17:25:54.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:25:54 gibba015 bash[30343]: audit 2021-03-10T17:25:54.149158+0000 mon.c (mon.1) 3137 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:25:54.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:25:54 gibba015 bash[30343]: audit 2021-03-10T17:25:54.149631+0000 mon.a (mon.0) 2402 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T17:25:54.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:25:54 gibba015 bash[30343]: audit 2021-03-10T17:25:54.149887+0000 mon.c (mon.1) 3138 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T17:25:54.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:25:54 gibba015 bash[30343]: audit 2021-03-10T17:25:54.150721+0000 mon.c (mon.1) 3139 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:25:54.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:25:54 gibba015 bash[30343]: audit 2021-03-10T17:25:54.151167+0000 mon.a (mon.0) 2403 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:25:54.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:25:54 gibba015 bash[30343]: audit 2021-03-10T17:25:54.152285+0000 mon.a (mon.0) 2404 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T17:25:54.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:25:54 gibba015 bash[30343]: audit 2021-03-10T17:25:54.153292+0000 mon.a (mon.0) 2405 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:25:55.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:25:54 gibba045 bash[25517]: audit 2021-03-10T17:25:54.047911+0000 mon.c (mon.1) 3134 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:25:55.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:25:54 gibba045 bash[25517]: audit 2021-03-10T17:25:54.048550+0000 mon.c (mon.1) 3135 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:25:55.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:25:54 gibba045 bash[25517]: audit 2021-03-10T17:25:54.049037+0000 mon.a (mon.0) 2400 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:25:55.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:25:54 gibba045 bash[25517]: audit 2021-03-10T17:25:54.050309+0000 mon.a (mon.0) 2401 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:25:55.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:25:54 gibba045 bash[25517]: audit 2021-03-10T17:25:54.148376+0000 mon.c (mon.1) 3136 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T17:25:55.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:25:54 gibba045 bash[25517]: audit 2021-03-10T17:25:54.149158+0000 mon.c (mon.1) 3137 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:25:55.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:25:54 gibba045 bash[25517]: audit 2021-03-10T17:25:54.149631+0000 mon.a (mon.0) 2402 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T17:25:55.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:25:54 gibba045 bash[25517]: audit 2021-03-10T17:25:54.149887+0000 mon.c (mon.1) 3138 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T17:25:55.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:25:54 gibba045 bash[25517]: audit 2021-03-10T17:25:54.150721+0000 mon.c (mon.1) 3139 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:25:55.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:25:54 gibba045 bash[25517]: audit 2021-03-10T17:25:54.151167+0000 mon.a (mon.0) 2403 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:25:55.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:25:54 gibba045 bash[25517]: audit 2021-03-10T17:25:54.152285+0000 mon.a (mon.0) 2404 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T17:25:55.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:25:54 gibba045 bash[25517]: audit 2021-03-10T17:25:54.153292+0000 mon.a (mon.0) 2405 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:25:55.854 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:25:55 gibba045 bash[25517]: cluster 2021-03-10T17:25:54.486756+0000 mgr.gibba045.orlgmj (mgr.34412) 11446 : cluster [DBG] pgmap v6521: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:55.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:25:55 gibba015 bash[29377]: cluster 2021-03-10T17:25:54.486756+0000 mgr.gibba045.orlgmj (mgr.34412) 11446 : cluster [DBG] pgmap v6521: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:55.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:25:55 gibba015 bash[30343]: cluster 2021-03-10T17:25:54.486756+0000 mgr.gibba045.orlgmj (mgr.34412) 11446 : cluster [DBG] pgmap v6521: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:57.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:25:57 gibba015 bash[29377]: cephadm 2021-03-10T17:25:55.853884+0000 mgr.gibba045.orlgmj (mgr.34412) 11447 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:25:57.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:25:57 gibba015 bash[29377]: cluster 2021-03-10T17:25:56.488741+0000 mgr.gibba045.orlgmj (mgr.34412) 11448 : cluster [DBG] pgmap v6522: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:57.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:25:57 gibba015 bash[30343]: cephadm 2021-03-10T17:25:55.853884+0000 mgr.gibba045.orlgmj (mgr.34412) 11447 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:25:57.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:25:57 gibba015 bash[30343]: cluster 2021-03-10T17:25:56.488741+0000 mgr.gibba045.orlgmj (mgr.34412) 11448 : cluster [DBG] pgmap v6522: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:58.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:25:57 gibba045 bash[25517]: cephadm 2021-03-10T17:25:55.853884+0000 mgr.gibba045.orlgmj (mgr.34412) 11447 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:25:58.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:25:57 gibba045 bash[25517]: cluster 2021-03-10T17:25:56.488741+0000 mgr.gibba045.orlgmj (mgr.34412) 11448 : cluster [DBG] pgmap v6522: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:59.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:25:58 gibba015 bash[29377]: cluster 2021-03-10T17:25:58.490001+0000 mgr.gibba045.orlgmj (mgr.34412) 11449 : cluster [DBG] pgmap v6523: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:59.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:25:58 gibba015 bash[30343]: cluster 2021-03-10T17:25:58.490001+0000 mgr.gibba045.orlgmj (mgr.34412) 11449 : cluster [DBG] pgmap v6523: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:59.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:25:58 gibba045 bash[25517]: cluster 2021-03-10T17:25:58.490001+0000 mgr.gibba045.orlgmj (mgr.34412) 11449 : cluster [DBG] pgmap v6523: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:01.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:26:01 gibba045 bash[25517]: cluster 2021-03-10T17:26:00.491693+0000 mgr.gibba045.orlgmj (mgr.34412) 11450 : cluster [DBG] pgmap v6524: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:01.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:26:01 gibba015 bash[29377]: cluster 2021-03-10T17:26:00.491693+0000 mgr.gibba045.orlgmj (mgr.34412) 11450 : cluster [DBG] pgmap v6524: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:01.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:26:01 gibba015 bash[30343]: cluster 2021-03-10T17:26:00.491693+0000 mgr.gibba045.orlgmj (mgr.34412) 11450 : cluster [DBG] pgmap v6524: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:03.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:26:03 gibba015 bash[29377]: cluster 2021-03-10T17:26:02.493498+0000 mgr.gibba045.orlgmj (mgr.34412) 11451 : cluster [DBG] pgmap v6525: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:03.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:26:03 gibba015 bash[30343]: cluster 2021-03-10T17:26:02.493498+0000 mgr.gibba045.orlgmj (mgr.34412) 11451 : cluster [DBG] pgmap v6525: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:04.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:26:03 gibba045 bash[25517]: cluster 2021-03-10T17:26:02.493498+0000 mgr.gibba045.orlgmj (mgr.34412) 11451 : cluster [DBG] pgmap v6525: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:05.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:26:05 gibba015 bash[29377]: cluster 2021-03-10T17:26:04.494730+0000 mgr.gibba045.orlgmj (mgr.34412) 11452 : cluster [DBG] pgmap v6526: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:05.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:26:05 gibba015 bash[30343]: cluster 2021-03-10T17:26:04.494730+0000 mgr.gibba045.orlgmj (mgr.34412) 11452 : cluster [DBG] pgmap v6526: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:06.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:26:05 gibba045 bash[25517]: cluster 2021-03-10T17:26:04.494730+0000 mgr.gibba045.orlgmj (mgr.34412) 11452 : cluster [DBG] pgmap v6526: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:07.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:26:07 gibba015 bash[29377]: cluster 2021-03-10T17:26:06.496630+0000 mgr.gibba045.orlgmj (mgr.34412) 11453 : cluster [DBG] pgmap v6527: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:07.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:26:07 gibba015 bash[30343]: cluster 2021-03-10T17:26:06.496630+0000 mgr.gibba045.orlgmj (mgr.34412) 11453 : cluster [DBG] pgmap v6527: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:08.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:26:07 gibba045 bash[25517]: cluster 2021-03-10T17:26:06.496630+0000 mgr.gibba045.orlgmj (mgr.34412) 11453 : cluster [DBG] pgmap v6527: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:09.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:26:08 gibba015 bash[29377]: cluster 2021-03-10T17:26:08.497885+0000 mgr.gibba045.orlgmj (mgr.34412) 11454 : cluster [DBG] pgmap v6528: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:09.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:26:08 gibba015 bash[30343]: cluster 2021-03-10T17:26:08.497885+0000 mgr.gibba045.orlgmj (mgr.34412) 11454 : cluster [DBG] pgmap v6528: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:09.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:26:08 gibba045 bash[25517]: cluster 2021-03-10T17:26:08.497885+0000 mgr.gibba045.orlgmj (mgr.34412) 11454 : cluster [DBG] pgmap v6528: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:11.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:26:11 gibba015 bash[29377]: cluster 2021-03-10T17:26:10.499535+0000 mgr.gibba045.orlgmj (mgr.34412) 11455 : cluster [DBG] pgmap v6529: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:11.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:26:11 gibba015 bash[30343]: cluster 2021-03-10T17:26:10.499535+0000 mgr.gibba045.orlgmj (mgr.34412) 11455 : cluster [DBG] pgmap v6529: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:12.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:26:11 gibba045 bash[25517]: cluster 2021-03-10T17:26:10.499535+0000 mgr.gibba045.orlgmj (mgr.34412) 11455 : cluster [DBG] pgmap v6529: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:12.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:26:12 gibba015 bash[29377]: cephadm 2021-03-10T17:26:10.870117+0000 mgr.gibba045.orlgmj (mgr.34412) 11456 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:26:12.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:26:12 gibba015 bash[30343]: cephadm 2021-03-10T17:26:10.870117+0000 mgr.gibba045.orlgmj (mgr.34412) 11456 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:26:13.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:26:12 gibba045 bash[25517]: cephadm 2021-03-10T17:26:10.870117+0000 mgr.gibba045.orlgmj (mgr.34412) 11456 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:26:13.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:26:13 gibba015 bash[29377]: cluster 2021-03-10T17:26:12.501474+0000 mgr.gibba045.orlgmj (mgr.34412) 11457 : cluster [DBG] pgmap v6530: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:13.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:26:13 gibba015 bash[30343]: cluster 2021-03-10T17:26:12.501474+0000 mgr.gibba045.orlgmj (mgr.34412) 11457 : cluster [DBG] pgmap v6530: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:14.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:26:13 gibba045 bash[25517]: cluster 2021-03-10T17:26:12.501474+0000 mgr.gibba045.orlgmj (mgr.34412) 11457 : cluster [DBG] pgmap v6530: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:15.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:26:15 gibba015 bash[29377]: cluster 2021-03-10T17:26:14.502993+0000 mgr.gibba045.orlgmj (mgr.34412) 11458 : cluster [DBG] pgmap v6531: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:15.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:26:15 gibba015 bash[30343]: cluster 2021-03-10T17:26:14.502993+0000 mgr.gibba045.orlgmj (mgr.34412) 11458 : cluster [DBG] pgmap v6531: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:16.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:26:15 gibba045 bash[25517]: cluster 2021-03-10T17:26:14.502993+0000 mgr.gibba045.orlgmj (mgr.34412) 11458 : cluster [DBG] pgmap v6531: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:16.448 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:26:16.697 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:26:16.698 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 8m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:26:16.698 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 7m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:26:16.698 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:26:16.699 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:26:16.699 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:26:16.699 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:26:16.699 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:26:16.699 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:26:16.700 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 8m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:26:16.700 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 7m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:26:16.700 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:26:16.700 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:26:16.701 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:26:16.701 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:26:16.701 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:26:16.701 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:26:16.701 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:26:16.703 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:26:16.703 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 7m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:26:16.703 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 7m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:26:16.949 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:26:16.950 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:26:16.950 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:26:16.950 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:26:16.951 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:26:16.951 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:26:16.951 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:26:16.951 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:26:16.951 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:26:16.952 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:26:16.952 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:26:16.952 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:26:16.952 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:26:16.953 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:26:16.953 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:26:17.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:26:17 gibba015 bash[29377]: audit 2021-03-10T17:26:16.439457+0000 mgr.gibba045.orlgmj (mgr.34412) 11459 : audit [DBG] from='client.51738 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:26:17.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:26:17 gibba015 bash[29377]: cluster 2021-03-10T17:26:16.505044+0000 mgr.gibba045.orlgmj (mgr.34412) 11460 : cluster [DBG] pgmap v6532: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:17.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:26:17 gibba015 bash[29377]: audit 2021-03-10T17:26:16.665236+0000 mgr.gibba045.orlgmj (mgr.34412) 11461 : audit [DBG] from='client.61732 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:26:17.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:26:17 gibba015 bash[29377]: audit 2021-03-10T17:26:16.947860+0000 mon.c (mon.1) 3140 : audit [DBG] from='client.? 172.21.2.115:0/2485546696' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:26:17.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:26:17 gibba015 bash[30343]: audit 2021-03-10T17:26:16.439457+0000 mgr.gibba045.orlgmj (mgr.34412) 11459 : audit [DBG] from='client.51738 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:26:17.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:26:17 gibba015 bash[30343]: cluster 2021-03-10T17:26:16.505044+0000 mgr.gibba045.orlgmj (mgr.34412) 11460 : cluster [DBG] pgmap v6532: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:17.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:26:17 gibba015 bash[30343]: audit 2021-03-10T17:26:16.665236+0000 mgr.gibba045.orlgmj (mgr.34412) 11461 : audit [DBG] from='client.61732 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:26:17.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:26:17 gibba015 bash[30343]: audit 2021-03-10T17:26:16.947860+0000 mon.c (mon.1) 3140 : audit [DBG] from='client.? 172.21.2.115:0/2485546696' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:26:18.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:26:17 gibba045 bash[25517]: audit 2021-03-10T17:26:16.439457+0000 mgr.gibba045.orlgmj (mgr.34412) 11459 : audit [DBG] from='client.51738 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:26:18.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:26:17 gibba045 bash[25517]: cluster 2021-03-10T17:26:16.505044+0000 mgr.gibba045.orlgmj (mgr.34412) 11460 : cluster [DBG] pgmap v6532: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:18.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:26:17 gibba045 bash[25517]: audit 2021-03-10T17:26:16.665236+0000 mgr.gibba045.orlgmj (mgr.34412) 11461 : audit [DBG] from='client.61732 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:26:18.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:26:17 gibba045 bash[25517]: audit 2021-03-10T17:26:16.947860+0000 mon.c (mon.1) 3140 : audit [DBG] from='client.? 172.21.2.115:0/2485546696' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:26:19.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:26:18 gibba015 bash[29377]: cluster 2021-03-10T17:26:18.506100+0000 mgr.gibba045.orlgmj (mgr.34412) 11462 : cluster [DBG] pgmap v6533: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:19.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:26:18 gibba015 bash[30343]: cluster 2021-03-10T17:26:18.506100+0000 mgr.gibba045.orlgmj (mgr.34412) 11462 : cluster [DBG] pgmap v6533: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:19.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:26:18 gibba045 bash[25517]: cluster 2021-03-10T17:26:18.506100+0000 mgr.gibba045.orlgmj (mgr.34412) 11462 : cluster [DBG] pgmap v6533: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:21.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:26:21 gibba015 bash[29377]: cluster 2021-03-10T17:26:20.507818+0000 mgr.gibba045.orlgmj (mgr.34412) 11463 : cluster [DBG] pgmap v6534: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:21.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:26:21 gibba015 bash[30343]: cluster 2021-03-10T17:26:20.507818+0000 mgr.gibba045.orlgmj (mgr.34412) 11463 : cluster [DBG] pgmap v6534: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:22.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:26:21 gibba045 bash[25517]: cluster 2021-03-10T17:26:20.507818+0000 mgr.gibba045.orlgmj (mgr.34412) 11463 : cluster [DBG] pgmap v6534: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:23.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:26:23 gibba015 bash[29377]: cluster 2021-03-10T17:26:22.509388+0000 mgr.gibba045.orlgmj (mgr.34412) 11464 : cluster [DBG] pgmap v6535: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:23.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:26:23 gibba015 bash[30343]: cluster 2021-03-10T17:26:22.509388+0000 mgr.gibba045.orlgmj (mgr.34412) 11464 : cluster [DBG] pgmap v6535: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:24.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:26:23 gibba045 bash[25517]: cluster 2021-03-10T17:26:22.509388+0000 mgr.gibba045.orlgmj (mgr.34412) 11464 : cluster [DBG] pgmap v6535: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:25.885 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:26:25 gibba045 bash[25517]: cluster 2021-03-10T17:26:24.510923+0000 mgr.gibba045.orlgmj (mgr.34412) 11465 : cluster [DBG] pgmap v6536: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:25.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:26:25 gibba015 bash[29377]: cluster 2021-03-10T17:26:24.510923+0000 mgr.gibba045.orlgmj (mgr.34412) 11465 : cluster [DBG] pgmap v6536: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:25.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:26:25 gibba015 bash[30343]: cluster 2021-03-10T17:26:24.510923+0000 mgr.gibba045.orlgmj (mgr.34412) 11465 : cluster [DBG] pgmap v6536: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:27.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:26:27 gibba015 bash[29377]: cephadm 2021-03-10T17:26:25.885372+0000 mgr.gibba045.orlgmj (mgr.34412) 11466 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:26:27.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:26:27 gibba015 bash[29377]: cluster 2021-03-10T17:26:26.512917+0000 mgr.gibba045.orlgmj (mgr.34412) 11467 : cluster [DBG] pgmap v6537: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:27.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:26:27 gibba015 bash[30343]: cephadm 2021-03-10T17:26:25.885372+0000 mgr.gibba045.orlgmj (mgr.34412) 11466 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:26:27.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:26:27 gibba015 bash[30343]: cluster 2021-03-10T17:26:26.512917+0000 mgr.gibba045.orlgmj (mgr.34412) 11467 : cluster [DBG] pgmap v6537: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:28.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:26:27 gibba045 bash[25517]: cephadm 2021-03-10T17:26:25.885372+0000 mgr.gibba045.orlgmj (mgr.34412) 11466 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:26:28.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:26:27 gibba045 bash[25517]: cluster 2021-03-10T17:26:26.512917+0000 mgr.gibba045.orlgmj (mgr.34412) 11467 : cluster [DBG] pgmap v6537: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:29.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:26:28 gibba015 bash[29377]: cluster 2021-03-10T17:26:28.513958+0000 mgr.gibba045.orlgmj (mgr.34412) 11468 : cluster [DBG] pgmap v6538: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:29.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:26:28 gibba015 bash[30343]: cluster 2021-03-10T17:26:28.513958+0000 mgr.gibba045.orlgmj (mgr.34412) 11468 : cluster [DBG] pgmap v6538: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:29.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:26:28 gibba045 bash[25517]: cluster 2021-03-10T17:26:28.513958+0000 mgr.gibba045.orlgmj (mgr.34412) 11468 : cluster [DBG] pgmap v6538: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:31.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:26:31 gibba015 bash[29377]: cluster 2021-03-10T17:26:30.515634+0000 mgr.gibba045.orlgmj (mgr.34412) 11469 : cluster [DBG] pgmap v6539: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:31.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:26:31 gibba015 bash[30343]: cluster 2021-03-10T17:26:30.515634+0000 mgr.gibba045.orlgmj (mgr.34412) 11469 : cluster [DBG] pgmap v6539: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:32.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:26:31 gibba045 bash[25517]: cluster 2021-03-10T17:26:30.515634+0000 mgr.gibba045.orlgmj (mgr.34412) 11469 : cluster [DBG] pgmap v6539: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:33.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:26:33 gibba015 bash[29377]: cluster 2021-03-10T17:26:32.517490+0000 mgr.gibba045.orlgmj (mgr.34412) 11470 : cluster [DBG] pgmap v6540: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:33.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:26:33 gibba015 bash[30343]: cluster 2021-03-10T17:26:32.517490+0000 mgr.gibba045.orlgmj (mgr.34412) 11470 : cluster [DBG] pgmap v6540: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:34.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:26:33 gibba045 bash[25517]: cluster 2021-03-10T17:26:32.517490+0000 mgr.gibba045.orlgmj (mgr.34412) 11470 : cluster [DBG] pgmap v6540: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:35.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:26:35 gibba015 bash[29377]: cluster 2021-03-10T17:26:34.518980+0000 mgr.gibba045.orlgmj (mgr.34412) 11471 : cluster [DBG] pgmap v6541: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:35.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:26:35 gibba015 bash[30343]: cluster 2021-03-10T17:26:34.518980+0000 mgr.gibba045.orlgmj (mgr.34412) 11471 : cluster [DBG] pgmap v6541: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:36.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:26:35 gibba045 bash[25517]: cluster 2021-03-10T17:26:34.518980+0000 mgr.gibba045.orlgmj (mgr.34412) 11471 : cluster [DBG] pgmap v6541: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:37.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:26:37 gibba015 bash[29377]: cluster 2021-03-10T17:26:36.521039+0000 mgr.gibba045.orlgmj (mgr.34412) 11472 : cluster [DBG] pgmap v6542: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:37.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:26:37 gibba015 bash[30343]: cluster 2021-03-10T17:26:36.521039+0000 mgr.gibba045.orlgmj (mgr.34412) 11472 : cluster [DBG] pgmap v6542: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:38.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:26:37 gibba045 bash[25517]: cluster 2021-03-10T17:26:36.521039+0000 mgr.gibba045.orlgmj (mgr.34412) 11472 : cluster [DBG] pgmap v6542: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:39.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:26:38 gibba015 bash[29377]: cluster 2021-03-10T17:26:38.522120+0000 mgr.gibba045.orlgmj (mgr.34412) 11473 : cluster [DBG] pgmap v6543: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:39.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:26:38 gibba015 bash[30343]: cluster 2021-03-10T17:26:38.522120+0000 mgr.gibba045.orlgmj (mgr.34412) 11473 : cluster [DBG] pgmap v6543: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:39.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:26:38 gibba045 bash[25517]: cluster 2021-03-10T17:26:38.522120+0000 mgr.gibba045.orlgmj (mgr.34412) 11473 : cluster [DBG] pgmap v6543: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:41.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:26:41 gibba015 bash[29377]: cluster 2021-03-10T17:26:40.523868+0000 mgr.gibba045.orlgmj (mgr.34412) 11474 : cluster [DBG] pgmap v6544: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:41.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:26:41 gibba015 bash[29377]: audit 2021-03-10T17:26:40.900455+0000 mon.c (mon.1) 3141 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:26:41.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:26:41 gibba015 bash[29377]: audit 2021-03-10T17:26:41.136969+0000 mon.a (mon.0) 2406 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:26:41.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:26:41 gibba015 bash[29377]: audit 2021-03-10T17:26:41.140623+0000 mon.c (mon.1) 3142 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:26:41.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:26:41 gibba015 bash[29377]: audit 2021-03-10T17:26:41.141817+0000 mon.c (mon.1) 3143 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:26:41.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:26:41 gibba015 bash[29377]: audit 2021-03-10T17:26:41.143081+0000 mon.c (mon.1) 3144 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:26:41.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:26:41 gibba015 bash[29377]: audit 2021-03-10T17:26:41.144087+0000 mon.c (mon.1) 3145 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:26:41.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:26:41 gibba015 bash[29377]: audit 2021-03-10T17:26:41.147021+0000 mon.c (mon.1) 3146 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:26:41.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:26:41 gibba015 bash[29377]: audit 2021-03-10T17:26:41.148604+0000 mon.c (mon.1) 3147 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:26:41.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:26:41 gibba015 bash[30343]: cluster 2021-03-10T17:26:40.523868+0000 mgr.gibba045.orlgmj (mgr.34412) 11474 : cluster [DBG] pgmap v6544: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:41.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:26:41 gibba015 bash[30343]: audit 2021-03-10T17:26:40.900455+0000 mon.c (mon.1) 3141 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:26:41.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:26:41 gibba015 bash[30343]: audit 2021-03-10T17:26:41.136969+0000 mon.a (mon.0) 2406 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:26:41.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:26:41 gibba015 bash[30343]: audit 2021-03-10T17:26:41.140623+0000 mon.c (mon.1) 3142 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:26:41.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:26:41 gibba015 bash[30343]: audit 2021-03-10T17:26:41.141817+0000 mon.c (mon.1) 3143 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:26:41.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:26:41 gibba015 bash[30343]: audit 2021-03-10T17:26:41.143081+0000 mon.c (mon.1) 3144 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:26:41.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:26:41 gibba015 bash[30343]: audit 2021-03-10T17:26:41.144087+0000 mon.c (mon.1) 3145 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:26:41.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:26:41 gibba015 bash[30343]: audit 2021-03-10T17:26:41.147021+0000 mon.c (mon.1) 3146 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:26:41.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:26:41 gibba015 bash[30343]: audit 2021-03-10T17:26:41.148604+0000 mon.c (mon.1) 3147 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:26:42.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:26:41 gibba045 bash[25517]: cluster 2021-03-10T17:26:40.523868+0000 mgr.gibba045.orlgmj (mgr.34412) 11474 : cluster [DBG] pgmap v6544: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:42.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:26:41 gibba045 bash[25517]: audit 2021-03-10T17:26:40.900455+0000 mon.c (mon.1) 3141 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:26:42.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:26:41 gibba045 bash[25517]: audit 2021-03-10T17:26:41.136969+0000 mon.a (mon.0) 2406 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:26:42.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:26:41 gibba045 bash[25517]: audit 2021-03-10T17:26:41.140623+0000 mon.c (mon.1) 3142 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:26:42.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:26:41 gibba045 bash[25517]: audit 2021-03-10T17:26:41.141817+0000 mon.c (mon.1) 3143 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:26:42.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:26:41 gibba045 bash[25517]: audit 2021-03-10T17:26:41.143081+0000 mon.c (mon.1) 3144 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:26:42.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:26:41 gibba045 bash[25517]: audit 2021-03-10T17:26:41.144087+0000 mon.c (mon.1) 3145 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:26:42.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:26:41 gibba045 bash[25517]: audit 2021-03-10T17:26:41.147021+0000 mon.c (mon.1) 3146 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:26:42.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:26:41 gibba045 bash[25517]: audit 2021-03-10T17:26:41.148604+0000 mon.c (mon.1) 3147 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:26:42.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:26:42 gibba015 bash[29377]: cephadm 2021-03-10T17:26:40.907807+0000 mgr.gibba045.orlgmj (mgr.34412) 11475 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:26:42.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:26:42 gibba015 bash[29377]: cephadm 2021-03-10T17:26:40.909789+0000 mgr.gibba045.orlgmj (mgr.34412) 11476 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:26:42.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:26:42 gibba015 bash[29377]: cephadm 2021-03-10T17:26:41.141878+0000 mgr.gibba045.orlgmj (mgr.34412) 11477 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:26:42.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:26:42 gibba015 bash[29377]: cephadm 2021-03-10T17:26:41.143402+0000 mgr.gibba045.orlgmj (mgr.34412) 11478 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:26:42.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:26:42 gibba015 bash[29377]: cephadm 2021-03-10T17:26:41.144559+0000 mgr.gibba045.orlgmj (mgr.34412) 11479 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:26:42.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:26:42 gibba015 bash[29377]: cephadm 2021-03-10T17:26:41.144599+0000 mgr.gibba045.orlgmj (mgr.34412) 11480 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:26:42.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:26:42 gibba015 bash[29377]: cephadm 2021-03-10T17:26:41.145781+0000 mgr.gibba045.orlgmj (mgr.34412) 11481 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:26:42.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:26:42 gibba015 bash[29377]: cephadm 2021-03-10T17:26:41.145819+0000 mgr.gibba045.orlgmj (mgr.34412) 11482 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:26:42.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:26:42 gibba015 bash[29377]: cephadm 2021-03-10T17:26:41.146989+0000 mgr.gibba045.orlgmj (mgr.34412) 11483 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:26:42.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:26:42 gibba015 bash[29377]: cephadm 2021-03-10T17:26:41.148526+0000 mgr.gibba045.orlgmj (mgr.34412) 11484 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:26:42.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:26:42 gibba015 bash[29377]: cephadm 2021-03-10T17:26:41.148564+0000 mgr.gibba045.orlgmj (mgr.34412) 11485 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:26:42.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:26:42 gibba015 bash[29377]: cephadm 2021-03-10T17:26:41.149866+0000 mgr.gibba045.orlgmj (mgr.34412) 11486 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:26:42.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:26:42 gibba015 bash[29377]: cephadm 2021-03-10T17:26:41.150308+0000 mgr.gibba045.orlgmj (mgr.34412) 11487 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:26:42.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:26:42 gibba015 bash[29377]: cephadm 2021-03-10T17:26:41.151650+0000 mgr.gibba045.orlgmj (mgr.34412) 11488 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:26:42.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:26:42 gibba015 bash[29377]: cephadm 2021-03-10T17:26:41.151694+0000 mgr.gibba045.orlgmj (mgr.34412) 11489 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:26:42.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:26:42 gibba015 bash[29377]: cephadm 2021-03-10T17:26:41.151822+0000 mgr.gibba045.orlgmj (mgr.34412) 11490 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:26:42.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:26:42 gibba015 bash[30343]: cephadm 2021-03-10T17:26:40.907807+0000 mgr.gibba045.orlgmj (mgr.34412) 11475 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:26:42.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:26:42 gibba015 bash[30343]: cephadm 2021-03-10T17:26:40.909789+0000 mgr.gibba045.orlgmj (mgr.34412) 11476 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:26:42.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:26:42 gibba015 bash[30343]: cephadm 2021-03-10T17:26:41.141878+0000 mgr.gibba045.orlgmj (mgr.34412) 11477 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:26:42.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:26:42 gibba015 bash[30343]: cephadm 2021-03-10T17:26:41.143402+0000 mgr.gibba045.orlgmj (mgr.34412) 11478 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:26:42.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:26:42 gibba015 bash[30343]: cephadm 2021-03-10T17:26:41.144559+0000 mgr.gibba045.orlgmj (mgr.34412) 11479 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:26:42.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:26:42 gibba015 bash[30343]: cephadm 2021-03-10T17:26:41.144599+0000 mgr.gibba045.orlgmj (mgr.34412) 11480 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:26:42.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:26:42 gibba015 bash[30343]: cephadm 2021-03-10T17:26:41.145781+0000 mgr.gibba045.orlgmj (mgr.34412) 11481 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:26:42.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:26:42 gibba015 bash[30343]: cephadm 2021-03-10T17:26:41.145819+0000 mgr.gibba045.orlgmj (mgr.34412) 11482 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:26:42.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:26:42 gibba015 bash[30343]: cephadm 2021-03-10T17:26:41.146989+0000 mgr.gibba045.orlgmj (mgr.34412) 11483 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:26:42.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:26:42 gibba015 bash[30343]: cephadm 2021-03-10T17:26:41.148526+0000 mgr.gibba045.orlgmj (mgr.34412) 11484 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:26:42.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:26:42 gibba015 bash[30343]: cephadm 2021-03-10T17:26:41.148564+0000 mgr.gibba045.orlgmj (mgr.34412) 11485 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:26:42.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:26:42 gibba015 bash[30343]: cephadm 2021-03-10T17:26:41.149866+0000 mgr.gibba045.orlgmj (mgr.34412) 11486 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:26:42.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:26:42 gibba015 bash[30343]: cephadm 2021-03-10T17:26:41.150308+0000 mgr.gibba045.orlgmj (mgr.34412) 11487 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:26:42.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:26:42 gibba015 bash[30343]: cephadm 2021-03-10T17:26:41.151650+0000 mgr.gibba045.orlgmj (mgr.34412) 11488 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:26:42.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:26:42 gibba015 bash[30343]: cephadm 2021-03-10T17:26:41.151694+0000 mgr.gibba045.orlgmj (mgr.34412) 11489 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:26:42.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:26:42 gibba015 bash[30343]: cephadm 2021-03-10T17:26:41.151822+0000 mgr.gibba045.orlgmj (mgr.34412) 11490 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:26:43.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:26:42 gibba045 bash[25517]: cephadm 2021-03-10T17:26:40.907807+0000 mgr.gibba045.orlgmj (mgr.34412) 11475 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:26:43.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:26:42 gibba045 bash[25517]: cephadm 2021-03-10T17:26:40.909789+0000 mgr.gibba045.orlgmj (mgr.34412) 11476 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:26:43.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:26:42 gibba045 bash[25517]: cephadm 2021-03-10T17:26:41.141878+0000 mgr.gibba045.orlgmj (mgr.34412) 11477 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:26:43.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:26:42 gibba045 bash[25517]: cephadm 2021-03-10T17:26:41.143402+0000 mgr.gibba045.orlgmj (mgr.34412) 11478 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:26:43.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:26:42 gibba045 bash[25517]: cephadm 2021-03-10T17:26:41.144559+0000 mgr.gibba045.orlgmj (mgr.34412) 11479 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:26:43.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:26:42 gibba045 bash[25517]: cephadm 2021-03-10T17:26:41.144599+0000 mgr.gibba045.orlgmj (mgr.34412) 11480 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:26:43.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:26:42 gibba045 bash[25517]: cephadm 2021-03-10T17:26:41.145781+0000 mgr.gibba045.orlgmj (mgr.34412) 11481 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:26:43.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:26:42 gibba045 bash[25517]: cephadm 2021-03-10T17:26:41.145819+0000 mgr.gibba045.orlgmj (mgr.34412) 11482 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:26:43.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:26:42 gibba045 bash[25517]: cephadm 2021-03-10T17:26:41.146989+0000 mgr.gibba045.orlgmj (mgr.34412) 11483 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:26:43.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:26:42 gibba045 bash[25517]: cephadm 2021-03-10T17:26:41.148526+0000 mgr.gibba045.orlgmj (mgr.34412) 11484 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:26:43.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:26:42 gibba045 bash[25517]: cephadm 2021-03-10T17:26:41.148564+0000 mgr.gibba045.orlgmj (mgr.34412) 11485 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:26:43.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:26:42 gibba045 bash[25517]: cephadm 2021-03-10T17:26:41.149866+0000 mgr.gibba045.orlgmj (mgr.34412) 11486 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:26:43.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:26:42 gibba045 bash[25517]: cephadm 2021-03-10T17:26:41.150308+0000 mgr.gibba045.orlgmj (mgr.34412) 11487 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:26:43.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:26:42 gibba045 bash[25517]: cephadm 2021-03-10T17:26:41.151650+0000 mgr.gibba045.orlgmj (mgr.34412) 11488 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:26:43.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:26:42 gibba045 bash[25517]: cephadm 2021-03-10T17:26:41.151694+0000 mgr.gibba045.orlgmj (mgr.34412) 11489 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:26:43.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:26:42 gibba045 bash[25517]: cephadm 2021-03-10T17:26:41.151822+0000 mgr.gibba045.orlgmj (mgr.34412) 11490 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:26:43.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:26:43 gibba015 bash[29377]: cluster 2021-03-10T17:26:42.525654+0000 mgr.gibba045.orlgmj (mgr.34412) 11491 : cluster [DBG] pgmap v6545: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:43.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:26:43 gibba015 bash[30343]: cluster 2021-03-10T17:26:42.525654+0000 mgr.gibba045.orlgmj (mgr.34412) 11491 : cluster [DBG] pgmap v6545: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:44.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:26:43 gibba045 bash[25517]: cluster 2021-03-10T17:26:42.525654+0000 mgr.gibba045.orlgmj (mgr.34412) 11491 : cluster [DBG] pgmap v6545: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:45.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:26:45 gibba015 bash[29377]: cluster 2021-03-10T17:26:44.527020+0000 mgr.gibba045.orlgmj (mgr.34412) 11492 : cluster [DBG] pgmap v6546: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:45.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:26:45 gibba015 bash[30343]: cluster 2021-03-10T17:26:44.527020+0000 mgr.gibba045.orlgmj (mgr.34412) 11492 : cluster [DBG] pgmap v6546: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:46.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:26:45 gibba045 bash[25517]: cluster 2021-03-10T17:26:44.527020+0000 mgr.gibba045.orlgmj (mgr.34412) 11492 : cluster [DBG] pgmap v6546: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:47.194 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:26:47.420 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:26:47.421 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 9m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:26:47.421 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 8m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:26:47.422 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:26:47.422 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:26:47.422 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:26:47.423 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:26:47.423 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:26:47.424 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:26:47.424 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 9m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:26:47.425 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 8m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:26:47.425 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:26:47.426 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:26:47.426 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:26:47.427 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:26:47.427 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:26:47.428 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:26:47.428 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:26:47.429 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:26:47.429 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 8m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:26:47.429 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 8m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:26:47.671 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:26:47.671 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:26:47.672 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:26:47.672 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:26:47.672 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:26:47.672 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:26:47.672 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:26:47.673 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:26:47.673 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:26:47.673 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:26:47.673 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:26:47.673 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:26:47.674 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:26:47.674 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:26:47.674 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:26:47.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:26:47 gibba015 bash[29377]: cluster 2021-03-10T17:26:46.529004+0000 mgr.gibba045.orlgmj (mgr.34412) 11493 : cluster [DBG] pgmap v6547: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:47.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:26:47 gibba015 bash[30343]: cluster 2021-03-10T17:26:46.529004+0000 mgr.gibba045.orlgmj (mgr.34412) 11493 : cluster [DBG] pgmap v6547: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:48.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:26:47 gibba045 bash[25517]: cluster 2021-03-10T17:26:46.529004+0000 mgr.gibba045.orlgmj (mgr.34412) 11493 : cluster [DBG] pgmap v6547: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:48.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:26:48 gibba015 bash[29377]: audit 2021-03-10T17:26:47.184757+0000 mgr.gibba045.orlgmj (mgr.34412) 11494 : audit [DBG] from='client.51756 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:26:48.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:26:48 gibba015 bash[29377]: audit 2021-03-10T17:26:47.409514+0000 mgr.gibba045.orlgmj (mgr.34412) 11495 : audit [DBG] from='client.61750 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:26:48.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:26:48 gibba015 bash[29377]: audit 2021-03-10T17:26:47.669659+0000 mon.c (mon.1) 3148 : audit [DBG] from='client.? 172.21.2.115:0/2838951702' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:26:48.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:26:48 gibba015 bash[30343]: audit 2021-03-10T17:26:47.184757+0000 mgr.gibba045.orlgmj (mgr.34412) 11494 : audit [DBG] from='client.51756 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:26:48.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:26:48 gibba015 bash[30343]: audit 2021-03-10T17:26:47.409514+0000 mgr.gibba045.orlgmj (mgr.34412) 11495 : audit [DBG] from='client.61750 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:26:48.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:26:48 gibba015 bash[30343]: audit 2021-03-10T17:26:47.669659+0000 mon.c (mon.1) 3148 : audit [DBG] from='client.? 172.21.2.115:0/2838951702' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:26:49.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:26:48 gibba045 bash[25517]: audit 2021-03-10T17:26:47.184757+0000 mgr.gibba045.orlgmj (mgr.34412) 11494 : audit [DBG] from='client.51756 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:26:49.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:26:48 gibba045 bash[25517]: audit 2021-03-10T17:26:47.409514+0000 mgr.gibba045.orlgmj (mgr.34412) 11495 : audit [DBG] from='client.61750 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:26:49.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:26:48 gibba045 bash[25517]: audit 2021-03-10T17:26:47.669659+0000 mon.c (mon.1) 3148 : audit [DBG] from='client.? 172.21.2.115:0/2838951702' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:26:49.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:26:49 gibba015 bash[29377]: cluster 2021-03-10T17:26:48.530351+0000 mgr.gibba045.orlgmj (mgr.34412) 11496 : cluster [DBG] pgmap v6548: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:49.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:26:49 gibba015 bash[30343]: cluster 2021-03-10T17:26:48.530351+0000 mgr.gibba045.orlgmj (mgr.34412) 11496 : cluster [DBG] pgmap v6548: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:50.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:26:49 gibba045 bash[25517]: cluster 2021-03-10T17:26:48.530351+0000 mgr.gibba045.orlgmj (mgr.34412) 11496 : cluster [DBG] pgmap v6548: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:51.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:26:51 gibba015 bash[29377]: cluster 2021-03-10T17:26:50.532002+0000 mgr.gibba045.orlgmj (mgr.34412) 11497 : cluster [DBG] pgmap v6549: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:51.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:26:51 gibba015 bash[30343]: cluster 2021-03-10T17:26:50.532002+0000 mgr.gibba045.orlgmj (mgr.34412) 11497 : cluster [DBG] pgmap v6549: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:52.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:26:51 gibba045 bash[25517]: cluster 2021-03-10T17:26:50.532002+0000 mgr.gibba045.orlgmj (mgr.34412) 11497 : cluster [DBG] pgmap v6549: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:53.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:26:53 gibba015 bash[29377]: cluster 2021-03-10T17:26:52.533836+0000 mgr.gibba045.orlgmj (mgr.34412) 11498 : cluster [DBG] pgmap v6550: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:53.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:26:53 gibba015 bash[30343]: cluster 2021-03-10T17:26:52.533836+0000 mgr.gibba045.orlgmj (mgr.34412) 11498 : cluster [DBG] pgmap v6550: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:54.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:26:53 gibba045 bash[25517]: cluster 2021-03-10T17:26:52.533836+0000 mgr.gibba045.orlgmj (mgr.34412) 11498 : cluster [DBG] pgmap v6550: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:54.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:26:54 gibba015 bash[29377]: audit 2021-03-10T17:26:54.054965+0000 mon.c (mon.1) 3149 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:26:54.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:26:54 gibba015 bash[29377]: audit 2021-03-10T17:26:54.055604+0000 mon.c (mon.1) 3150 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:26:54.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:26:54 gibba015 bash[29377]: audit 2021-03-10T17:26:54.056132+0000 mon.a (mon.0) 2407 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:26:54.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:26:54 gibba015 bash[29377]: audit 2021-03-10T17:26:54.057349+0000 mon.a (mon.0) 2408 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:26:54.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:26:54 gibba015 bash[29377]: audit 2021-03-10T17:26:54.158363+0000 mon.c (mon.1) 3151 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T17:26:54.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:26:54 gibba015 bash[29377]: audit 2021-03-10T17:26:54.159079+0000 mon.c (mon.1) 3152 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T17:26:54.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:26:54 gibba015 bash[29377]: audit 2021-03-10T17:26:54.159606+0000 mon.a (mon.0) 2409 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T17:26:54.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:26:54 gibba015 bash[29377]: audit 2021-03-10T17:26:54.159748+0000 mon.c (mon.1) 3153 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:26:54.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:26:54 gibba015 bash[29377]: audit 2021-03-10T17:26:54.160779+0000 mon.c (mon.1) 3154 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-03-10T17:26:54.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:26:54 gibba015 bash[29377]: audit 2021-03-10T17:26:54.160834+0000 mon.a (mon.0) 2410 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T17:26:54.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:26:54 gibba015 bash[29377]: audit 2021-03-10T17:26:54.161862+0000 mon.a (mon.0) 2411 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:26:54.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:26:54 gibba015 bash[29377]: audit 2021-03-10T17:26:54.162898+0000 mon.a (mon.0) 2412 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-03-10T17:26:54.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:26:54 gibba015 bash[30343]: audit 2021-03-10T17:26:54.054965+0000 mon.c (mon.1) 3149 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:26:54.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:26:54 gibba015 bash[30343]: audit 2021-03-10T17:26:54.055604+0000 mon.c (mon.1) 3150 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:26:54.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:26:54 gibba015 bash[30343]: audit 2021-03-10T17:26:54.056132+0000 mon.a (mon.0) 2407 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:26:54.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:26:54 gibba015 bash[30343]: audit 2021-03-10T17:26:54.057349+0000 mon.a (mon.0) 2408 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:26:54.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:26:54 gibba015 bash[30343]: audit 2021-03-10T17:26:54.158363+0000 mon.c (mon.1) 3151 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T17:26:54.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:26:54 gibba015 bash[30343]: audit 2021-03-10T17:26:54.159079+0000 mon.c (mon.1) 3152 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T17:26:54.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:26:54 gibba015 bash[30343]: audit 2021-03-10T17:26:54.159606+0000 mon.a (mon.0) 2409 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T17:26:54.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:26:54 gibba015 bash[30343]: audit 2021-03-10T17:26:54.159748+0000 mon.c (mon.1) 3153 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:26:54.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:26:54 gibba015 bash[30343]: audit 2021-03-10T17:26:54.160779+0000 mon.c (mon.1) 3154 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-03-10T17:26:54.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:26:54 gibba015 bash[30343]: audit 2021-03-10T17:26:54.160834+0000 mon.a (mon.0) 2410 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T17:26:54.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:26:54 gibba015 bash[30343]: audit 2021-03-10T17:26:54.161862+0000 mon.a (mon.0) 2411 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:26:54.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:26:54 gibba015 bash[30343]: audit 2021-03-10T17:26:54.162898+0000 mon.a (mon.0) 2412 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-03-10T17:26:55.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:26:54 gibba045 bash[25517]: audit 2021-03-10T17:26:54.054965+0000 mon.c (mon.1) 3149 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:26:55.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:26:54 gibba045 bash[25517]: audit 2021-03-10T17:26:54.055604+0000 mon.c (mon.1) 3150 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:26:55.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:26:54 gibba045 bash[25517]: audit 2021-03-10T17:26:54.056132+0000 mon.a (mon.0) 2407 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:26:55.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:26:54 gibba045 bash[25517]: audit 2021-03-10T17:26:54.057349+0000 mon.a (mon.0) 2408 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:26:55.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:26:54 gibba045 bash[25517]: audit 2021-03-10T17:26:54.158363+0000 mon.c (mon.1) 3151 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T17:26:55.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:26:54 gibba045 bash[25517]: audit 2021-03-10T17:26:54.159079+0000 mon.c (mon.1) 3152 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T17:26:55.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:26:54 gibba045 bash[25517]: audit 2021-03-10T17:26:54.159606+0000 mon.a (mon.0) 2409 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T17:26:55.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:26:54 gibba045 bash[25517]: audit 2021-03-10T17:26:54.159748+0000 mon.c (mon.1) 3153 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:26:55.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:26:54 gibba045 bash[25517]: audit 2021-03-10T17:26:54.160779+0000 mon.c (mon.1) 3154 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-03-10T17:26:55.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:26:54 gibba045 bash[25517]: audit 2021-03-10T17:26:54.160834+0000 mon.a (mon.0) 2410 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T17:26:55.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:26:54 gibba045 bash[25517]: audit 2021-03-10T17:26:54.161862+0000 mon.a (mon.0) 2411 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:26:55.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:26:54 gibba045 bash[25517]: audit 2021-03-10T17:26:54.162898+0000 mon.a (mon.0) 2412 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-03-10T17:26:55.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:26:55 gibba015 bash[29377]: cluster 2021-03-10T17:26:54.535298+0000 mgr.gibba045.orlgmj (mgr.34412) 11499 : cluster [DBG] pgmap v6551: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:55.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:26:55 gibba015 bash[30343]: cluster 2021-03-10T17:26:54.535298+0000 mgr.gibba045.orlgmj (mgr.34412) 11499 : cluster [DBG] pgmap v6551: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:56.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:26:55 gibba045 bash[25517]: cluster 2021-03-10T17:26:54.535298+0000 mgr.gibba045.orlgmj (mgr.34412) 11499 : cluster [DBG] pgmap v6551: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:57.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:26:57 gibba015 bash[29377]: cephadm 2021-03-10T17:26:56.167861+0000 mgr.gibba045.orlgmj (mgr.34412) 11500 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:26:57.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:26:57 gibba015 bash[29377]: cluster 2021-03-10T17:26:56.537394+0000 mgr.gibba045.orlgmj (mgr.34412) 11501 : cluster [DBG] pgmap v6552: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:57.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:26:57 gibba015 bash[30343]: cephadm 2021-03-10T17:26:56.167861+0000 mgr.gibba045.orlgmj (mgr.34412) 11500 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:26:57.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:26:57 gibba015 bash[30343]: cluster 2021-03-10T17:26:56.537394+0000 mgr.gibba045.orlgmj (mgr.34412) 11501 : cluster [DBG] pgmap v6552: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:58.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:26:57 gibba045 bash[25517]: cephadm 2021-03-10T17:26:56.167861+0000 mgr.gibba045.orlgmj (mgr.34412) 11500 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:26:58.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:26:57 gibba045 bash[25517]: cluster 2021-03-10T17:26:56.537394+0000 mgr.gibba045.orlgmj (mgr.34412) 11501 : cluster [DBG] pgmap v6552: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:59.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:26:58 gibba015 bash[29377]: cluster 2021-03-10T17:26:58.538718+0000 mgr.gibba045.orlgmj (mgr.34412) 11502 : cluster [DBG] pgmap v6553: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:59.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:26:58 gibba015 bash[30343]: cluster 2021-03-10T17:26:58.538718+0000 mgr.gibba045.orlgmj (mgr.34412) 11502 : cluster [DBG] pgmap v6553: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:59.305 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:26:58 gibba045 bash[25517]: cluster 2021-03-10T17:26:58.538718+0000 mgr.gibba045.orlgmj (mgr.34412) 11502 : cluster [DBG] pgmap v6553: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:01.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:27:01 gibba015 bash[29377]: cluster 2021-03-10T17:27:00.540273+0000 mgr.gibba045.orlgmj (mgr.34412) 11503 : cluster [DBG] pgmap v6554: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:01.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:27:01 gibba015 bash[30343]: cluster 2021-03-10T17:27:00.540273+0000 mgr.gibba045.orlgmj (mgr.34412) 11503 : cluster [DBG] pgmap v6554: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:02.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:27:01 gibba045 bash[25517]: cluster 2021-03-10T17:27:00.540273+0000 mgr.gibba045.orlgmj (mgr.34412) 11503 : cluster [DBG] pgmap v6554: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:03.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:27:03 gibba015 bash[29377]: cluster 2021-03-10T17:27:02.542122+0000 mgr.gibba045.orlgmj (mgr.34412) 11504 : cluster [DBG] pgmap v6555: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:03.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:27:03 gibba015 bash[30343]: cluster 2021-03-10T17:27:02.542122+0000 mgr.gibba045.orlgmj (mgr.34412) 11504 : cluster [DBG] pgmap v6555: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:04.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:27:03 gibba045 bash[25517]: cluster 2021-03-10T17:27:02.542122+0000 mgr.gibba045.orlgmj (mgr.34412) 11504 : cluster [DBG] pgmap v6555: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:05.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:27:05 gibba015 bash[29377]: cluster 2021-03-10T17:27:04.543593+0000 mgr.gibba045.orlgmj (mgr.34412) 11505 : cluster [DBG] pgmap v6556: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:05.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:27:05 gibba015 bash[30343]: cluster 2021-03-10T17:27:04.543593+0000 mgr.gibba045.orlgmj (mgr.34412) 11505 : cluster [DBG] pgmap v6556: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:06.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:27:05 gibba045 bash[25517]: cluster 2021-03-10T17:27:04.543593+0000 mgr.gibba045.orlgmj (mgr.34412) 11505 : cluster [DBG] pgmap v6556: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:07.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:27:07 gibba015 bash[29377]: cluster 2021-03-10T17:27:06.545359+0000 mgr.gibba045.orlgmj (mgr.34412) 11506 : cluster [DBG] pgmap v6557: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:07.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:27:07 gibba015 bash[30343]: cluster 2021-03-10T17:27:06.545359+0000 mgr.gibba045.orlgmj (mgr.34412) 11506 : cluster [DBG] pgmap v6557: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:08.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:27:07 gibba045 bash[25517]: cluster 2021-03-10T17:27:06.545359+0000 mgr.gibba045.orlgmj (mgr.34412) 11506 : cluster [DBG] pgmap v6557: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:09.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:27:08 gibba015 bash[29377]: cluster 2021-03-10T17:27:08.546749+0000 mgr.gibba045.orlgmj (mgr.34412) 11507 : cluster [DBG] pgmap v6558: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:09.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:27:08 gibba015 bash[30343]: cluster 2021-03-10T17:27:08.546749+0000 mgr.gibba045.orlgmj (mgr.34412) 11507 : cluster [DBG] pgmap v6558: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:09.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:27:08 gibba045 bash[25517]: cluster 2021-03-10T17:27:08.546749+0000 mgr.gibba045.orlgmj (mgr.34412) 11507 : cluster [DBG] pgmap v6558: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:11.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:27:11 gibba015 bash[29377]: cluster 2021-03-10T17:27:10.548276+0000 mgr.gibba045.orlgmj (mgr.34412) 11508 : cluster [DBG] pgmap v6559: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:11.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:27:11 gibba015 bash[30343]: cluster 2021-03-10T17:27:10.548276+0000 mgr.gibba045.orlgmj (mgr.34412) 11508 : cluster [DBG] pgmap v6559: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:12.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:27:11 gibba045 bash[25517]: cluster 2021-03-10T17:27:10.548276+0000 mgr.gibba045.orlgmj (mgr.34412) 11508 : cluster [DBG] pgmap v6559: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:12.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:27:12 gibba015 bash[29377]: cephadm 2021-03-10T17:27:11.183887+0000 mgr.gibba045.orlgmj (mgr.34412) 11509 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:27:12.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:27:12 gibba015 bash[30343]: cephadm 2021-03-10T17:27:11.183887+0000 mgr.gibba045.orlgmj (mgr.34412) 11509 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:27:13.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:27:12 gibba045 bash[25517]: cephadm 2021-03-10T17:27:11.183887+0000 mgr.gibba045.orlgmj (mgr.34412) 11509 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:27:13.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:27:13 gibba015 bash[29377]: cluster 2021-03-10T17:27:12.549841+0000 mgr.gibba045.orlgmj (mgr.34412) 11510 : cluster [DBG] pgmap v6560: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:13.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:27:13 gibba015 bash[30343]: cluster 2021-03-10T17:27:12.549841+0000 mgr.gibba045.orlgmj (mgr.34412) 11510 : cluster [DBG] pgmap v6560: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:14.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:27:13 gibba045 bash[25517]: cluster 2021-03-10T17:27:12.549841+0000 mgr.gibba045.orlgmj (mgr.34412) 11510 : cluster [DBG] pgmap v6560: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:15.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:27:15 gibba015 bash[29377]: cluster 2021-03-10T17:27:14.551102+0000 mgr.gibba045.orlgmj (mgr.34412) 11511 : cluster [DBG] pgmap v6561: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:15.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:27:15 gibba015 bash[30343]: cluster 2021-03-10T17:27:14.551102+0000 mgr.gibba045.orlgmj (mgr.34412) 11511 : cluster [DBG] pgmap v6561: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:16.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:27:15 gibba045 bash[25517]: cluster 2021-03-10T17:27:14.551102+0000 mgr.gibba045.orlgmj (mgr.34412) 11511 : cluster [DBG] pgmap v6561: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:17.909 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:27:17.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:27:17 gibba015 bash[29377]: cluster 2021-03-10T17:27:16.553207+0000 mgr.gibba045.orlgmj (mgr.34412) 11512 : cluster [DBG] pgmap v6562: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:17.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:27:17 gibba015 bash[30343]: cluster 2021-03-10T17:27:16.553207+0000 mgr.gibba045.orlgmj (mgr.34412) 11512 : cluster [DBG] pgmap v6562: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:18.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:27:17 gibba045 bash[25517]: cluster 2021-03-10T17:27:16.553207+0000 mgr.gibba045.orlgmj (mgr.34412) 11512 : cluster [DBG] pgmap v6562: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:18.136 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:27:18.137 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 9m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:27:18.137 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 8m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:27:18.137 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:27:18.137 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:27:18.138 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:27:18.138 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:27:18.138 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:27:18.138 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:27:18.139 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 9m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:27:18.139 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 8m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:27:18.139 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:27:18.139 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:27:18.139 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:27:18.140 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:27:18.140 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:27:18.140 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:27:18.140 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:27:18.141 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:27:18.141 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 8m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:27:18.141 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 8m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:27:18.390 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:27:18.390 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:27:18.390 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:27:18.391 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:27:18.391 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:27:18.391 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:27:18.391 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:27:18.392 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:27:18.392 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:27:18.392 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:27:18.392 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:27:18.392 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:27:18.393 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:27:18.393 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:27:18.393 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:27:19.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:27:18 gibba015 bash[29377]: audit 2021-03-10T17:27:17.900695+0000 mgr.gibba045.orlgmj (mgr.34412) 11513 : audit [DBG] from='client.51774 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:27:19.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:27:18 gibba015 bash[29377]: audit 2021-03-10T17:27:18.123891+0000 mgr.gibba045.orlgmj (mgr.34412) 11514 : audit [DBG] from='client.51780 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:27:19.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:27:18 gibba015 bash[29377]: audit 2021-03-10T17:27:18.387596+0000 mon.c (mon.1) 3155 : audit [DBG] from='client.? 172.21.2.115:0/4140298789' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:27:19.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:27:18 gibba015 bash[29377]: cluster 2021-03-10T17:27:18.554457+0000 mgr.gibba045.orlgmj (mgr.34412) 11515 : cluster [DBG] pgmap v6563: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:19.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:27:18 gibba015 bash[30343]: audit 2021-03-10T17:27:17.900695+0000 mgr.gibba045.orlgmj (mgr.34412) 11513 : audit [DBG] from='client.51774 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:27:19.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:27:18 gibba015 bash[30343]: audit 2021-03-10T17:27:18.123891+0000 mgr.gibba045.orlgmj (mgr.34412) 11514 : audit [DBG] from='client.51780 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:27:19.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:27:18 gibba015 bash[30343]: audit 2021-03-10T17:27:18.387596+0000 mon.c (mon.1) 3155 : audit [DBG] from='client.? 172.21.2.115:0/4140298789' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:27:19.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:27:18 gibba015 bash[30343]: cluster 2021-03-10T17:27:18.554457+0000 mgr.gibba045.orlgmj (mgr.34412) 11515 : cluster [DBG] pgmap v6563: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:19.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:27:18 gibba045 bash[25517]: audit 2021-03-10T17:27:17.900695+0000 mgr.gibba045.orlgmj (mgr.34412) 11513 : audit [DBG] from='client.51774 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:27:19.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:27:18 gibba045 bash[25517]: audit 2021-03-10T17:27:18.123891+0000 mgr.gibba045.orlgmj (mgr.34412) 11514 : audit [DBG] from='client.51780 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:27:19.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:27:18 gibba045 bash[25517]: audit 2021-03-10T17:27:18.387596+0000 mon.c (mon.1) 3155 : audit [DBG] from='client.? 172.21.2.115:0/4140298789' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:27:19.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:27:18 gibba045 bash[25517]: cluster 2021-03-10T17:27:18.554457+0000 mgr.gibba045.orlgmj (mgr.34412) 11515 : cluster [DBG] pgmap v6563: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:21.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:27:21 gibba015 bash[29377]: cluster 2021-03-10T17:27:20.555978+0000 mgr.gibba045.orlgmj (mgr.34412) 11516 : cluster [DBG] pgmap v6564: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:21.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:27:21 gibba015 bash[30343]: cluster 2021-03-10T17:27:20.555978+0000 mgr.gibba045.orlgmj (mgr.34412) 11516 : cluster [DBG] pgmap v6564: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:22.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:27:21 gibba045 bash[25517]: cluster 2021-03-10T17:27:20.555978+0000 mgr.gibba045.orlgmj (mgr.34412) 11516 : cluster [DBG] pgmap v6564: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:23.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:27:23 gibba015 bash[29377]: cluster 2021-03-10T17:27:22.557729+0000 mgr.gibba045.orlgmj (mgr.34412) 11517 : cluster [DBG] pgmap v6565: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:24.083 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:27:23 gibba015 bash[30343]: cluster 2021-03-10T17:27:22.557729+0000 mgr.gibba045.orlgmj (mgr.34412) 11517 : cluster [DBG] pgmap v6565: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:24.083 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:27:23 gibba045 bash[25517]: cluster 2021-03-10T17:27:22.557729+0000 mgr.gibba045.orlgmj (mgr.34412) 11517 : cluster [DBG] pgmap v6565: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:25.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:27:25 gibba015 bash[29377]: cluster 2021-03-10T17:27:24.559172+0000 mgr.gibba045.orlgmj (mgr.34412) 11518 : cluster [DBG] pgmap v6566: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:25.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:27:25 gibba015 bash[30343]: cluster 2021-03-10T17:27:24.559172+0000 mgr.gibba045.orlgmj (mgr.34412) 11518 : cluster [DBG] pgmap v6566: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:26.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:27:25 gibba045 bash[25517]: cluster 2021-03-10T17:27:24.559172+0000 mgr.gibba045.orlgmj (mgr.34412) 11518 : cluster [DBG] pgmap v6566: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:27.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:27:27 gibba015 bash[29377]: cephadm 2021-03-10T17:27:26.199929+0000 mgr.gibba045.orlgmj (mgr.34412) 11519 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:27:27.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:27:27 gibba015 bash[29377]: cluster 2021-03-10T17:27:26.561153+0000 mgr.gibba045.orlgmj (mgr.34412) 11520 : cluster [DBG] pgmap v6567: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:27.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:27:27 gibba015 bash[30343]: cephadm 2021-03-10T17:27:26.199929+0000 mgr.gibba045.orlgmj (mgr.34412) 11519 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:27:27.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:27:27 gibba015 bash[30343]: cluster 2021-03-10T17:27:26.561153+0000 mgr.gibba045.orlgmj (mgr.34412) 11520 : cluster [DBG] pgmap v6567: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:28.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:27:27 gibba045 bash[25517]: cephadm 2021-03-10T17:27:26.199929+0000 mgr.gibba045.orlgmj (mgr.34412) 11519 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:27:28.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:27:27 gibba045 bash[25517]: cluster 2021-03-10T17:27:26.561153+0000 mgr.gibba045.orlgmj (mgr.34412) 11520 : cluster [DBG] pgmap v6567: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:29.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:27:28 gibba015 bash[29377]: cluster 2021-03-10T17:27:28.562229+0000 mgr.gibba045.orlgmj (mgr.34412) 11521 : cluster [DBG] pgmap v6568: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:29.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:27:28 gibba015 bash[30343]: cluster 2021-03-10T17:27:28.562229+0000 mgr.gibba045.orlgmj (mgr.34412) 11521 : cluster [DBG] pgmap v6568: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:29.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:27:28 gibba045 bash[25517]: cluster 2021-03-10T17:27:28.562229+0000 mgr.gibba045.orlgmj (mgr.34412) 11521 : cluster [DBG] pgmap v6568: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:31.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:27:31 gibba015 bash[29377]: cluster 2021-03-10T17:27:30.563848+0000 mgr.gibba045.orlgmj (mgr.34412) 11522 : cluster [DBG] pgmap v6569: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:31.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:27:31 gibba015 bash[30343]: cluster 2021-03-10T17:27:30.563848+0000 mgr.gibba045.orlgmj (mgr.34412) 11522 : cluster [DBG] pgmap v6569: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:32.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:27:31 gibba045 bash[25517]: cluster 2021-03-10T17:27:30.563848+0000 mgr.gibba045.orlgmj (mgr.34412) 11522 : cluster [DBG] pgmap v6569: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:33.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:27:33 gibba015 bash[29377]: cluster 2021-03-10T17:27:32.565535+0000 mgr.gibba045.orlgmj (mgr.34412) 11523 : cluster [DBG] pgmap v6570: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:33.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:27:33 gibba015 bash[30343]: cluster 2021-03-10T17:27:32.565535+0000 mgr.gibba045.orlgmj (mgr.34412) 11523 : cluster [DBG] pgmap v6570: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:34.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:27:33 gibba045 bash[25517]: cluster 2021-03-10T17:27:32.565535+0000 mgr.gibba045.orlgmj (mgr.34412) 11523 : cluster [DBG] pgmap v6570: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:35.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:27:35 gibba015 bash[29377]: cluster 2021-03-10T17:27:34.566767+0000 mgr.gibba045.orlgmj (mgr.34412) 11524 : cluster [DBG] pgmap v6571: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:35.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:27:35 gibba015 bash[30343]: cluster 2021-03-10T17:27:34.566767+0000 mgr.gibba045.orlgmj (mgr.34412) 11524 : cluster [DBG] pgmap v6571: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:36.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:27:35 gibba045 bash[25517]: cluster 2021-03-10T17:27:34.566767+0000 mgr.gibba045.orlgmj (mgr.34412) 11524 : cluster [DBG] pgmap v6571: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:37.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:27:37 gibba015 bash[29377]: cluster 2021-03-10T17:27:36.568801+0000 mgr.gibba045.orlgmj (mgr.34412) 11525 : cluster [DBG] pgmap v6572: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:37.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:27:37 gibba015 bash[30343]: cluster 2021-03-10T17:27:36.568801+0000 mgr.gibba045.orlgmj (mgr.34412) 11525 : cluster [DBG] pgmap v6572: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:38.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:27:37 gibba045 bash[25517]: cluster 2021-03-10T17:27:36.568801+0000 mgr.gibba045.orlgmj (mgr.34412) 11525 : cluster [DBG] pgmap v6572: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:39.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:27:38 gibba015 bash[29377]: cluster 2021-03-10T17:27:38.570183+0000 mgr.gibba045.orlgmj (mgr.34412) 11526 : cluster [DBG] pgmap v6573: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:39.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:27:38 gibba015 bash[30343]: cluster 2021-03-10T17:27:38.570183+0000 mgr.gibba045.orlgmj (mgr.34412) 11526 : cluster [DBG] pgmap v6573: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:39.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:27:38 gibba045 bash[25517]: cluster 2021-03-10T17:27:38.570183+0000 mgr.gibba045.orlgmj (mgr.34412) 11526 : cluster [DBG] pgmap v6573: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:41.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:27:41 gibba015 bash[29377]: cluster 2021-03-10T17:27:40.571711+0000 mgr.gibba045.orlgmj (mgr.34412) 11527 : cluster [DBG] pgmap v6574: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:41.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:27:41 gibba015 bash[29377]: audit 2021-03-10T17:27:41.215064+0000 mon.c (mon.1) 3156 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:27:41.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:27:41 gibba015 bash[29377]: audit 2021-03-10T17:27:41.221875+0000 mon.c (mon.1) 3157 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:27:41.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:27:41 gibba015 bash[30343]: cluster 2021-03-10T17:27:40.571711+0000 mgr.gibba045.orlgmj (mgr.34412) 11527 : cluster [DBG] pgmap v6574: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:41.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:27:41 gibba015 bash[30343]: audit 2021-03-10T17:27:41.215064+0000 mon.c (mon.1) 3156 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:27:41.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:27:41 gibba015 bash[30343]: audit 2021-03-10T17:27:41.221875+0000 mon.c (mon.1) 3157 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:27:42.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:27:41 gibba045 bash[25517]: cluster 2021-03-10T17:27:40.571711+0000 mgr.gibba045.orlgmj (mgr.34412) 11527 : cluster [DBG] pgmap v6574: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:42.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:27:41 gibba045 bash[25517]: audit 2021-03-10T17:27:41.215064+0000 mon.c (mon.1) 3156 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:27:42.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:27:41 gibba045 bash[25517]: audit 2021-03-10T17:27:41.221875+0000 mon.c (mon.1) 3157 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:27:42.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:27:42 gibba015 bash[29377]: cephadm 2021-03-10T17:27:41.223382+0000 mgr.gibba045.orlgmj (mgr.34412) 11528 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:27:42.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:27:42 gibba015 bash[30343]: cephadm 2021-03-10T17:27:41.223382+0000 mgr.gibba045.orlgmj (mgr.34412) 11528 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:27:43.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:27:42 gibba045 bash[25517]: cephadm 2021-03-10T17:27:41.223382+0000 mgr.gibba045.orlgmj (mgr.34412) 11528 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:27:43.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:27:43 gibba015 bash[29377]: cluster 2021-03-10T17:27:42.573160+0000 mgr.gibba045.orlgmj (mgr.34412) 11529 : cluster [DBG] pgmap v6575: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:43.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:27:43 gibba015 bash[30343]: cluster 2021-03-10T17:27:42.573160+0000 mgr.gibba045.orlgmj (mgr.34412) 11529 : cluster [DBG] pgmap v6575: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:44.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:27:43 gibba045 bash[25517]: cluster 2021-03-10T17:27:42.573160+0000 mgr.gibba045.orlgmj (mgr.34412) 11529 : cluster [DBG] pgmap v6575: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:45.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:27:45 gibba015 bash[29377]: cluster 2021-03-10T17:27:44.574612+0000 mgr.gibba045.orlgmj (mgr.34412) 11530 : cluster [DBG] pgmap v6576: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:45.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:27:45 gibba015 bash[29377]: audit 2021-03-10T17:27:44.694191+0000 mon.a (mon.0) 2413 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:27:45.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:27:45 gibba015 bash[29377]: cephadm 2021-03-10T17:27:44.697041+0000 mgr.gibba045.orlgmj (mgr.34412) 11531 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:27:45.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:27:45 gibba015 bash[29377]: audit 2021-03-10T17:27:44.905677+0000 mon.a (mon.0) 2414 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:27:45.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:27:45 gibba015 bash[29377]: audit 2021-03-10T17:27:44.913934+0000 mon.c (mon.1) 3158 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:27:45.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:27:45 gibba015 bash[29377]: audit 2021-03-10T17:27:44.915339+0000 mon.c (mon.1) 3159 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:27:45.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:27:45 gibba015 bash[29377]: audit 2021-03-10T17:27:44.916909+0000 mon.c (mon.1) 3160 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:27:45.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:27:45 gibba015 bash[29377]: audit 2021-03-10T17:27:44.918123+0000 mon.c (mon.1) 3161 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:27:45.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:27:45 gibba015 bash[29377]: audit 2021-03-10T17:27:44.921764+0000 mon.c (mon.1) 3162 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:27:45.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:27:45 gibba015 bash[29377]: audit 2021-03-10T17:27:44.923645+0000 mon.c (mon.1) 3163 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:27:45.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:27:45 gibba015 bash[30343]: cluster 2021-03-10T17:27:44.574612+0000 mgr.gibba045.orlgmj (mgr.34412) 11530 : cluster [DBG] pgmap v6576: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:45.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:27:45 gibba015 bash[30343]: audit 2021-03-10T17:27:44.694191+0000 mon.a (mon.0) 2413 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:27:45.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:27:45 gibba015 bash[30343]: cephadm 2021-03-10T17:27:44.697041+0000 mgr.gibba045.orlgmj (mgr.34412) 11531 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:27:45.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:27:45 gibba015 bash[30343]: audit 2021-03-10T17:27:44.905677+0000 mon.a (mon.0) 2414 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:27:45.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:27:45 gibba015 bash[30343]: audit 2021-03-10T17:27:44.913934+0000 mon.c (mon.1) 3158 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:27:45.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:27:45 gibba015 bash[30343]: audit 2021-03-10T17:27:44.915339+0000 mon.c (mon.1) 3159 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:27:45.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:27:45 gibba015 bash[30343]: audit 2021-03-10T17:27:44.916909+0000 mon.c (mon.1) 3160 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:27:45.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:27:45 gibba015 bash[30343]: audit 2021-03-10T17:27:44.918123+0000 mon.c (mon.1) 3161 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:27:45.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:27:45 gibba015 bash[30343]: audit 2021-03-10T17:27:44.921764+0000 mon.c (mon.1) 3162 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:27:45.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:27:45 gibba015 bash[30343]: audit 2021-03-10T17:27:44.923645+0000 mon.c (mon.1) 3163 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:27:46.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:27:45 gibba045 bash[25517]: cluster 2021-03-10T17:27:44.574612+0000 mgr.gibba045.orlgmj (mgr.34412) 11530 : cluster [DBG] pgmap v6576: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:46.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:27:45 gibba045 bash[25517]: audit 2021-03-10T17:27:44.694191+0000 mon.a (mon.0) 2413 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:27:46.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:27:45 gibba045 bash[25517]: cephadm 2021-03-10T17:27:44.697041+0000 mgr.gibba045.orlgmj (mgr.34412) 11531 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:27:46.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:27:45 gibba045 bash[25517]: audit 2021-03-10T17:27:44.905677+0000 mon.a (mon.0) 2414 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:27:46.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:27:45 gibba045 bash[25517]: audit 2021-03-10T17:27:44.913934+0000 mon.c (mon.1) 3158 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:27:46.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:27:45 gibba045 bash[25517]: audit 2021-03-10T17:27:44.915339+0000 mon.c (mon.1) 3159 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:27:46.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:27:45 gibba045 bash[25517]: audit 2021-03-10T17:27:44.916909+0000 mon.c (mon.1) 3160 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:27:46.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:27:45 gibba045 bash[25517]: audit 2021-03-10T17:27:44.918123+0000 mon.c (mon.1) 3161 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:27:46.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:27:45 gibba045 bash[25517]: audit 2021-03-10T17:27:44.921764+0000 mon.c (mon.1) 3162 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:27:46.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:27:45 gibba045 bash[25517]: audit 2021-03-10T17:27:44.923645+0000 mon.c (mon.1) 3163 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:27:46.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:27:46 gibba015 bash[29377]: cephadm 2021-03-10T17:27:44.914900+0000 mgr.gibba045.orlgmj (mgr.34412) 11532 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:27:46.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:27:46 gibba015 bash[29377]: cephadm 2021-03-10T17:27:44.916878+0000 mgr.gibba045.orlgmj (mgr.34412) 11533 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:27:46.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:27:46 gibba015 bash[29377]: cephadm 2021-03-10T17:27:44.918223+0000 mgr.gibba045.orlgmj (mgr.34412) 11534 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:27:46.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:27:46 gibba015 bash[29377]: cephadm 2021-03-10T17:27:44.918284+0000 mgr.gibba045.orlgmj (mgr.34412) 11535 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:27:46.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:27:46 gibba015 bash[29377]: cephadm 2021-03-10T17:27:44.919663+0000 mgr.gibba045.orlgmj (mgr.34412) 11536 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:27:46.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:27:46 gibba015 bash[29377]: cephadm 2021-03-10T17:27:44.919759+0000 mgr.gibba045.orlgmj (mgr.34412) 11537 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:27:46.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:27:46 gibba015 bash[29377]: cephadm 2021-03-10T17:27:44.921109+0000 mgr.gibba045.orlgmj (mgr.34412) 11538 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:27:46.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:27:46 gibba015 bash[29377]: cephadm 2021-03-10T17:27:44.923006+0000 mgr.gibba045.orlgmj (mgr.34412) 11539 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:27:46.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:27:46 gibba015 bash[29377]: cephadm 2021-03-10T17:27:44.923071+0000 mgr.gibba045.orlgmj (mgr.34412) 11540 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:27:46.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:27:46 gibba015 bash[29377]: cephadm 2021-03-10T17:27:44.924729+0000 mgr.gibba045.orlgmj (mgr.34412) 11541 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:27:46.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:27:46 gibba015 bash[29377]: cephadm 2021-03-10T17:27:44.925103+0000 mgr.gibba045.orlgmj (mgr.34412) 11542 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:27:46.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:27:46 gibba015 bash[29377]: cephadm 2021-03-10T17:27:44.926673+0000 mgr.gibba045.orlgmj (mgr.34412) 11543 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:27:46.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:27:46 gibba015 bash[29377]: cephadm 2021-03-10T17:27:44.926747+0000 mgr.gibba045.orlgmj (mgr.34412) 11544 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:27:46.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:27:46 gibba015 bash[29377]: cephadm 2021-03-10T17:27:44.926903+0000 mgr.gibba045.orlgmj (mgr.34412) 11545 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:27:46.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:27:46 gibba015 bash[30343]: cephadm 2021-03-10T17:27:44.914900+0000 mgr.gibba045.orlgmj (mgr.34412) 11532 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:27:46.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:27:46 gibba015 bash[30343]: cephadm 2021-03-10T17:27:44.916878+0000 mgr.gibba045.orlgmj (mgr.34412) 11533 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:27:46.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:27:46 gibba015 bash[30343]: cephadm 2021-03-10T17:27:44.918223+0000 mgr.gibba045.orlgmj (mgr.34412) 11534 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:27:46.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:27:46 gibba015 bash[30343]: cephadm 2021-03-10T17:27:44.918284+0000 mgr.gibba045.orlgmj (mgr.34412) 11535 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:27:46.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:27:46 gibba015 bash[30343]: cephadm 2021-03-10T17:27:44.919663+0000 mgr.gibba045.orlgmj (mgr.34412) 11536 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:27:46.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:27:46 gibba015 bash[30343]: cephadm 2021-03-10T17:27:44.919759+0000 mgr.gibba045.orlgmj (mgr.34412) 11537 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:27:46.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:27:46 gibba015 bash[30343]: cephadm 2021-03-10T17:27:44.921109+0000 mgr.gibba045.orlgmj (mgr.34412) 11538 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:27:46.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:27:46 gibba015 bash[30343]: cephadm 2021-03-10T17:27:44.923006+0000 mgr.gibba045.orlgmj (mgr.34412) 11539 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:27:46.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:27:46 gibba015 bash[30343]: cephadm 2021-03-10T17:27:44.923071+0000 mgr.gibba045.orlgmj (mgr.34412) 11540 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:27:46.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:27:46 gibba015 bash[30343]: cephadm 2021-03-10T17:27:44.924729+0000 mgr.gibba045.orlgmj (mgr.34412) 11541 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:27:46.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:27:46 gibba015 bash[30343]: cephadm 2021-03-10T17:27:44.925103+0000 mgr.gibba045.orlgmj (mgr.34412) 11542 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:27:46.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:27:46 gibba015 bash[30343]: cephadm 2021-03-10T17:27:44.926673+0000 mgr.gibba045.orlgmj (mgr.34412) 11543 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:27:46.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:27:46 gibba015 bash[30343]: cephadm 2021-03-10T17:27:44.926747+0000 mgr.gibba045.orlgmj (mgr.34412) 11544 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:27:46.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:27:46 gibba015 bash[30343]: cephadm 2021-03-10T17:27:44.926903+0000 mgr.gibba045.orlgmj (mgr.34412) 11545 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:27:47.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:27:46 gibba045 bash[25517]: cephadm 2021-03-10T17:27:44.914900+0000 mgr.gibba045.orlgmj (mgr.34412) 11532 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:27:47.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:27:46 gibba045 bash[25517]: cephadm 2021-03-10T17:27:44.916878+0000 mgr.gibba045.orlgmj (mgr.34412) 11533 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:27:47.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:27:46 gibba045 bash[25517]: cephadm 2021-03-10T17:27:44.918223+0000 mgr.gibba045.orlgmj (mgr.34412) 11534 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:27:47.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:27:46 gibba045 bash[25517]: cephadm 2021-03-10T17:27:44.918284+0000 mgr.gibba045.orlgmj (mgr.34412) 11535 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:27:47.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:27:46 gibba045 bash[25517]: cephadm 2021-03-10T17:27:44.919663+0000 mgr.gibba045.orlgmj (mgr.34412) 11536 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:27:47.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:27:46 gibba045 bash[25517]: cephadm 2021-03-10T17:27:44.919759+0000 mgr.gibba045.orlgmj (mgr.34412) 11537 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:27:47.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:27:46 gibba045 bash[25517]: cephadm 2021-03-10T17:27:44.921109+0000 mgr.gibba045.orlgmj (mgr.34412) 11538 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:27:47.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:27:46 gibba045 bash[25517]: cephadm 2021-03-10T17:27:44.923006+0000 mgr.gibba045.orlgmj (mgr.34412) 11539 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:27:47.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:27:46 gibba045 bash[25517]: cephadm 2021-03-10T17:27:44.923071+0000 mgr.gibba045.orlgmj (mgr.34412) 11540 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:27:47.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:27:46 gibba045 bash[25517]: cephadm 2021-03-10T17:27:44.924729+0000 mgr.gibba045.orlgmj (mgr.34412) 11541 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:27:47.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:27:46 gibba045 bash[25517]: cephadm 2021-03-10T17:27:44.925103+0000 mgr.gibba045.orlgmj (mgr.34412) 11542 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:27:47.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:27:46 gibba045 bash[25517]: cephadm 2021-03-10T17:27:44.926673+0000 mgr.gibba045.orlgmj (mgr.34412) 11543 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:27:47.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:27:46 gibba045 bash[25517]: cephadm 2021-03-10T17:27:44.926747+0000 mgr.gibba045.orlgmj (mgr.34412) 11544 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:27:47.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:27:46 gibba045 bash[25517]: cephadm 2021-03-10T17:27:44.926903+0000 mgr.gibba045.orlgmj (mgr.34412) 11545 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:27:47.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:27:47 gibba015 bash[29377]: cluster 2021-03-10T17:27:46.576552+0000 mgr.gibba045.orlgmj (mgr.34412) 11546 : cluster [DBG] pgmap v6577: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:47.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:27:47 gibba015 bash[30343]: cluster 2021-03-10T17:27:46.576552+0000 mgr.gibba045.orlgmj (mgr.34412) 11546 : cluster [DBG] pgmap v6577: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:48.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:27:47 gibba045 bash[25517]: cluster 2021-03-10T17:27:46.576552+0000 mgr.gibba045.orlgmj (mgr.34412) 11546 : cluster [DBG] pgmap v6577: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:48.632 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:27:48.887 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:27:48.887 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 4s ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:27:48.887 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 9m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:27:48.888 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:27:48.888 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:27:48.888 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 4s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:27:48.888 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 4s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:27:48.888 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:27:48.889 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 4s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:27:48.889 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 4s ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:27:48.889 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 9m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:27:48.889 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 4s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:27:48.890 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 4s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:27:48.890 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 4s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:27:48.890 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 4s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:27:48.890 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:27:48.891 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:27:48.891 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:27:48.891 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:27:48.891 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 9m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:27:48.892 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 9m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:27:49.141 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:27:49.141 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:27:49.141 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:27:49.141 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:27:49.142 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:27:49.142 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:27:49.142 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:27:49.142 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:27:49.143 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:27:49.143 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:27:49.143 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:27:49.143 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:27:49.143 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:27:49.144 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:27:49.144 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:27:49.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:27:48 gibba015 bash[29377]: cluster 2021-03-10T17:27:48.577859+0000 mgr.gibba045.orlgmj (mgr.34412) 11547 : cluster [DBG] pgmap v6578: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:49.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:27:48 gibba015 bash[29377]: audit 2021-03-10T17:27:48.623252+0000 mgr.gibba045.orlgmj (mgr.34412) 11548 : audit [DBG] from='client.61780 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:27:49.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:27:48 gibba015 bash[30343]: cluster 2021-03-10T17:27:48.577859+0000 mgr.gibba045.orlgmj (mgr.34412) 11547 : cluster [DBG] pgmap v6578: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:49.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:27:48 gibba015 bash[30343]: audit 2021-03-10T17:27:48.623252+0000 mgr.gibba045.orlgmj (mgr.34412) 11548 : audit [DBG] from='client.61780 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:27:49.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:27:48 gibba045 bash[25517]: cluster 2021-03-10T17:27:48.577859+0000 mgr.gibba045.orlgmj (mgr.34412) 11547 : cluster [DBG] pgmap v6578: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:49.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:27:48 gibba045 bash[25517]: audit 2021-03-10T17:27:48.623252+0000 mgr.gibba045.orlgmj (mgr.34412) 11548 : audit [DBG] from='client.61780 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:27:50.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:27:49 gibba015 bash[29377]: audit 2021-03-10T17:27:48.846644+0000 mgr.gibba045.orlgmj (mgr.34412) 11549 : audit [DBG] from='client.61786 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:27:50.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:27:49 gibba015 bash[29377]: audit 2021-03-10T17:27:49.139104+0000 mon.c (mon.1) 3164 : audit [DBG] from='client.? 172.21.2.115:0/1261546833' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:27:50.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:27:49 gibba015 bash[30343]: audit 2021-03-10T17:27:48.846644+0000 mgr.gibba045.orlgmj (mgr.34412) 11549 : audit [DBG] from='client.61786 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:27:50.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:27:49 gibba015 bash[30343]: audit 2021-03-10T17:27:49.139104+0000 mon.c (mon.1) 3164 : audit [DBG] from='client.? 172.21.2.115:0/1261546833' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:27:50.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:27:49 gibba045 bash[25517]: audit 2021-03-10T17:27:48.846644+0000 mgr.gibba045.orlgmj (mgr.34412) 11549 : audit [DBG] from='client.61786 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:27:50.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:27:49 gibba045 bash[25517]: audit 2021-03-10T17:27:49.139104+0000 mon.c (mon.1) 3164 : audit [DBG] from='client.? 172.21.2.115:0/1261546833' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:27:51.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:27:50 gibba015 bash[29377]: cluster 2021-03-10T17:27:50.579231+0000 mgr.gibba045.orlgmj (mgr.34412) 11550 : cluster [DBG] pgmap v6579: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:51.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:27:50 gibba015 bash[30343]: cluster 2021-03-10T17:27:50.579231+0000 mgr.gibba045.orlgmj (mgr.34412) 11550 : cluster [DBG] pgmap v6579: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:51.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:27:50 gibba045 bash[25517]: cluster 2021-03-10T17:27:50.579231+0000 mgr.gibba045.orlgmj (mgr.34412) 11550 : cluster [DBG] pgmap v6579: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:53.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:27:53 gibba015 bash[29377]: cluster 2021-03-10T17:27:52.581000+0000 mgr.gibba045.orlgmj (mgr.34412) 11551 : cluster [DBG] pgmap v6580: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:53.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:27:53 gibba015 bash[30343]: cluster 2021-03-10T17:27:52.581000+0000 mgr.gibba045.orlgmj (mgr.34412) 11551 : cluster [DBG] pgmap v6580: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:27:53 gibba045 bash[25517]: cluster 2021-03-10T17:27:52.581000+0000 mgr.gibba045.orlgmj (mgr.34412) 11551 : cluster [DBG] pgmap v6580: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:54.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:27:54 gibba015 bash[29377]: audit 2021-03-10T17:27:54.071931+0000 mon.c (mon.1) 3165 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:27:54.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:27:54 gibba015 bash[29377]: audit 2021-03-10T17:27:54.072587+0000 mon.c (mon.1) 3166 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:27:54.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:27:54 gibba015 bash[29377]: audit 2021-03-10T17:27:54.073044+0000 mon.a (mon.0) 2415 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:27:54.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:27:54 gibba015 bash[29377]: audit 2021-03-10T17:27:54.074193+0000 mon.a (mon.0) 2416 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:27:54.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:27:54 gibba015 bash[29377]: audit 2021-03-10T17:27:54.164639+0000 mon.c (mon.1) 3167 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T17:27:54.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:27:54 gibba015 bash[29377]: audit 2021-03-10T17:27:54.165399+0000 mon.c (mon.1) 3168 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:27:54.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:27:54 gibba015 bash[29377]: audit 2021-03-10T17:27:54.165921+0000 mon.a (mon.0) 2417 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T17:27:54.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:27:54 gibba015 bash[29377]: audit 2021-03-10T17:27:54.166068+0000 mon.c (mon.1) 3169 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:27:54.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:27:54 gibba015 bash[29377]: audit 2021-03-10T17:27:54.166733+0000 mon.c (mon.1) 3170 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T17:27:54.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:27:54 gibba015 bash[29377]: audit 2021-03-10T17:27:54.167392+0000 mon.a (mon.0) 2418 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:27:54.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:27:54 gibba015 bash[29377]: audit 2021-03-10T17:27:54.168635+0000 mon.a (mon.0) 2419 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:27:54.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:27:54 gibba015 bash[29377]: audit 2021-03-10T17:27:54.169558+0000 mon.a (mon.0) 2420 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T17:27:54.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:27:54 gibba015 bash[30343]: audit 2021-03-10T17:27:54.071931+0000 mon.c (mon.1) 3165 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:27:54.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:27:54 gibba015 bash[30343]: audit 2021-03-10T17:27:54.072587+0000 mon.c (mon.1) 3166 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:27:54.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:27:54 gibba015 bash[30343]: audit 2021-03-10T17:27:54.073044+0000 mon.a (mon.0) 2415 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:27:54.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:27:54 gibba015 bash[30343]: audit 2021-03-10T17:27:54.074193+0000 mon.a (mon.0) 2416 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:27:54.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:27:54 gibba015 bash[30343]: audit 2021-03-10T17:27:54.164639+0000 mon.c (mon.1) 3167 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T17:27:54.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:27:54 gibba015 bash[30343]: audit 2021-03-10T17:27:54.165399+0000 mon.c (mon.1) 3168 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:27:54.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:27:54 gibba015 bash[30343]: audit 2021-03-10T17:27:54.165921+0000 mon.a (mon.0) 2417 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T17:27:54.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:27:54 gibba015 bash[30343]: audit 2021-03-10T17:27:54.166068+0000 mon.c (mon.1) 3169 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:27:54.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:27:54 gibba015 bash[30343]: audit 2021-03-10T17:27:54.166733+0000 mon.c (mon.1) 3170 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T17:27:54.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:27:54 gibba015 bash[30343]: audit 2021-03-10T17:27:54.167392+0000 mon.a (mon.0) 2418 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:27:54.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:27:54 gibba015 bash[30343]: audit 2021-03-10T17:27:54.168635+0000 mon.a (mon.0) 2419 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:27:54.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:27:54 gibba015 bash[30343]: audit 2021-03-10T17:27:54.169558+0000 mon.a (mon.0) 2420 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T17:27:55.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:27:54 gibba045 bash[25517]: audit 2021-03-10T17:27:54.071931+0000 mon.c (mon.1) 3165 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:27:55.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:27:54 gibba045 bash[25517]: audit 2021-03-10T17:27:54.072587+0000 mon.c (mon.1) 3166 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:27:55.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:27:54 gibba045 bash[25517]: audit 2021-03-10T17:27:54.073044+0000 mon.a (mon.0) 2415 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:27:55.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:27:54 gibba045 bash[25517]: audit 2021-03-10T17:27:54.074193+0000 mon.a (mon.0) 2416 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:27:55.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:27:54 gibba045 bash[25517]: audit 2021-03-10T17:27:54.164639+0000 mon.c (mon.1) 3167 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T17:27:55.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:27:54 gibba045 bash[25517]: audit 2021-03-10T17:27:54.165399+0000 mon.c (mon.1) 3168 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:27:55.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:27:54 gibba045 bash[25517]: audit 2021-03-10T17:27:54.165921+0000 mon.a (mon.0) 2417 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T17:27:55.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:27:54 gibba045 bash[25517]: audit 2021-03-10T17:27:54.166068+0000 mon.c (mon.1) 3169 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:27:55.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:27:54 gibba045 bash[25517]: audit 2021-03-10T17:27:54.166733+0000 mon.c (mon.1) 3170 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T17:27:55.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:27:54 gibba045 bash[25517]: audit 2021-03-10T17:27:54.167392+0000 mon.a (mon.0) 2418 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:27:55.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:27:54 gibba045 bash[25517]: audit 2021-03-10T17:27:54.168635+0000 mon.a (mon.0) 2419 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:27:55.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:27:54 gibba045 bash[25517]: audit 2021-03-10T17:27:54.169558+0000 mon.a (mon.0) 2420 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T17:27:55.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:27:55 gibba015 bash[29377]: cluster 2021-03-10T17:27:54.582403+0000 mgr.gibba045.orlgmj (mgr.34412) 11552 : cluster [DBG] pgmap v6581: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:55.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:27:55 gibba015 bash[30343]: cluster 2021-03-10T17:27:54.582403+0000 mgr.gibba045.orlgmj (mgr.34412) 11552 : cluster [DBG] pgmap v6581: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:56.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:27:55 gibba045 bash[25517]: cluster 2021-03-10T17:27:54.582403+0000 mgr.gibba045.orlgmj (mgr.34412) 11552 : cluster [DBG] pgmap v6581: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:57.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:27:57 gibba015 bash[29377]: cluster 2021-03-10T17:27:56.584289+0000 mgr.gibba045.orlgmj (mgr.34412) 11553 : cluster [DBG] pgmap v6582: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:57.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:27:57 gibba015 bash[30343]: cluster 2021-03-10T17:27:56.584289+0000 mgr.gibba045.orlgmj (mgr.34412) 11553 : cluster [DBG] pgmap v6582: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:58.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:27:57 gibba045 bash[25517]: cluster 2021-03-10T17:27:56.584289+0000 mgr.gibba045.orlgmj (mgr.34412) 11553 : cluster [DBG] pgmap v6582: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:59.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:27:58 gibba015 bash[29377]: cluster 2021-03-10T17:27:58.585466+0000 mgr.gibba045.orlgmj (mgr.34412) 11554 : cluster [DBG] pgmap v6583: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:59.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:27:58 gibba015 bash[30343]: cluster 2021-03-10T17:27:58.585466+0000 mgr.gibba045.orlgmj (mgr.34412) 11554 : cluster [DBG] pgmap v6583: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:59.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:27:58 gibba045 bash[25517]: cluster 2021-03-10T17:27:58.585466+0000 mgr.gibba045.orlgmj (mgr.34412) 11554 : cluster [DBG] pgmap v6583: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:01.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:28:01 gibba015 bash[29377]: cephadm 2021-03-10T17:27:59.942502+0000 mgr.gibba045.orlgmj (mgr.34412) 11555 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:28:01.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:28:01 gibba015 bash[29377]: cluster 2021-03-10T17:28:00.587101+0000 mgr.gibba045.orlgmj (mgr.34412) 11556 : cluster [DBG] pgmap v6584: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:01.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:28:01 gibba015 bash[30343]: cephadm 2021-03-10T17:27:59.942502+0000 mgr.gibba045.orlgmj (mgr.34412) 11555 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:28:01.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:28:01 gibba015 bash[30343]: cluster 2021-03-10T17:28:00.587101+0000 mgr.gibba045.orlgmj (mgr.34412) 11556 : cluster [DBG] pgmap v6584: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:02.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:28:01 gibba045 bash[25517]: cephadm 2021-03-10T17:27:59.942502+0000 mgr.gibba045.orlgmj (mgr.34412) 11555 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:28:02.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:28:01 gibba045 bash[25517]: cluster 2021-03-10T17:28:00.587101+0000 mgr.gibba045.orlgmj (mgr.34412) 11556 : cluster [DBG] pgmap v6584: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:03.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:28:03 gibba015 bash[29377]: cluster 2021-03-10T17:28:02.588948+0000 mgr.gibba045.orlgmj (mgr.34412) 11557 : cluster [DBG] pgmap v6585: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:03.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:28:03 gibba015 bash[30343]: cluster 2021-03-10T17:28:02.588948+0000 mgr.gibba045.orlgmj (mgr.34412) 11557 : cluster [DBG] pgmap v6585: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:04.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:28:03 gibba045 bash[25517]: cluster 2021-03-10T17:28:02.588948+0000 mgr.gibba045.orlgmj (mgr.34412) 11557 : cluster [DBG] pgmap v6585: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:05.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:28:05 gibba015 bash[29377]: cluster 2021-03-10T17:28:04.590465+0000 mgr.gibba045.orlgmj (mgr.34412) 11558 : cluster [DBG] pgmap v6586: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:05.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:28:05 gibba015 bash[30343]: cluster 2021-03-10T17:28:04.590465+0000 mgr.gibba045.orlgmj (mgr.34412) 11558 : cluster [DBG] pgmap v6586: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:06.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:28:05 gibba045 bash[25517]: cluster 2021-03-10T17:28:04.590465+0000 mgr.gibba045.orlgmj (mgr.34412) 11558 : cluster [DBG] pgmap v6586: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:07.971 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:28:07 gibba015 bash[29377]: cluster 2021-03-10T17:28:06.592541+0000 mgr.gibba045.orlgmj (mgr.34412) 11559 : cluster [DBG] pgmap v6587: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:07.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:28:07 gibba015 bash[30343]: cluster 2021-03-10T17:28:06.592541+0000 mgr.gibba045.orlgmj (mgr.34412) 11559 : cluster [DBG] pgmap v6587: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:08.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:28:07 gibba045 bash[25517]: cluster 2021-03-10T17:28:06.592541+0000 mgr.gibba045.orlgmj (mgr.34412) 11559 : cluster [DBG] pgmap v6587: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:09.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:28:08 gibba015 bash[29377]: cluster 2021-03-10T17:28:08.593620+0000 mgr.gibba045.orlgmj (mgr.34412) 11560 : cluster [DBG] pgmap v6588: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:09.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:28:08 gibba015 bash[30343]: cluster 2021-03-10T17:28:08.593620+0000 mgr.gibba045.orlgmj (mgr.34412) 11560 : cluster [DBG] pgmap v6588: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:09.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:28:08 gibba045 bash[25517]: cluster 2021-03-10T17:28:08.593620+0000 mgr.gibba045.orlgmj (mgr.34412) 11560 : cluster [DBG] pgmap v6588: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:11.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:28:11 gibba015 bash[29377]: cluster 2021-03-10T17:28:10.595138+0000 mgr.gibba045.orlgmj (mgr.34412) 11561 : cluster [DBG] pgmap v6589: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:11.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:28:11 gibba015 bash[30343]: cluster 2021-03-10T17:28:10.595138+0000 mgr.gibba045.orlgmj (mgr.34412) 11561 : cluster [DBG] pgmap v6589: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:12.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:28:11 gibba045 bash[25517]: cluster 2021-03-10T17:28:10.595138+0000 mgr.gibba045.orlgmj (mgr.34412) 11561 : cluster [DBG] pgmap v6589: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:13.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:28:13 gibba015 bash[29377]: cluster 2021-03-10T17:28:12.596907+0000 mgr.gibba045.orlgmj (mgr.34412) 11562 : cluster [DBG] pgmap v6590: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:13.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:28:13 gibba015 bash[30343]: cluster 2021-03-10T17:28:12.596907+0000 mgr.gibba045.orlgmj (mgr.34412) 11562 : cluster [DBG] pgmap v6590: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:14.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:28:13 gibba045 bash[25517]: cluster 2021-03-10T17:28:12.596907+0000 mgr.gibba045.orlgmj (mgr.34412) 11562 : cluster [DBG] pgmap v6590: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:15.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:28:15 gibba015 bash[29377]: cluster 2021-03-10T17:28:14.598161+0000 mgr.gibba045.orlgmj (mgr.34412) 11563 : cluster [DBG] pgmap v6591: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:15.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:28:15 gibba015 bash[30343]: cluster 2021-03-10T17:28:14.598161+0000 mgr.gibba045.orlgmj (mgr.34412) 11563 : cluster [DBG] pgmap v6591: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:16.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:28:15 gibba045 bash[25517]: cluster 2021-03-10T17:28:14.598161+0000 mgr.gibba045.orlgmj (mgr.34412) 11563 : cluster [DBG] pgmap v6591: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:16.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:28:16 gibba015 bash[29377]: cephadm 2021-03-10T17:28:14.958528+0000 mgr.gibba045.orlgmj (mgr.34412) 11564 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:28:16.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:28:16 gibba015 bash[30343]: cephadm 2021-03-10T17:28:14.958528+0000 mgr.gibba045.orlgmj (mgr.34412) 11564 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:28:17.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:28:16 gibba045 bash[25517]: cephadm 2021-03-10T17:28:14.958528+0000 mgr.gibba045.orlgmj (mgr.34412) 11564 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:28:17.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:28:17 gibba015 bash[29377]: cluster 2021-03-10T17:28:16.600160+0000 mgr.gibba045.orlgmj (mgr.34412) 11565 : cluster [DBG] pgmap v6592: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:17.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:28:17 gibba015 bash[30343]: cluster 2021-03-10T17:28:16.600160+0000 mgr.gibba045.orlgmj (mgr.34412) 11565 : cluster [DBG] pgmap v6592: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:18.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:28:17 gibba045 bash[25517]: cluster 2021-03-10T17:28:16.600160+0000 mgr.gibba045.orlgmj (mgr.34412) 11565 : cluster [DBG] pgmap v6592: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:19.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:28:18 gibba015 bash[29377]: cluster 2021-03-10T17:28:18.601478+0000 mgr.gibba045.orlgmj (mgr.34412) 11566 : cluster [DBG] pgmap v6593: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:19.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:28:18 gibba015 bash[30343]: cluster 2021-03-10T17:28:18.601478+0000 mgr.gibba045.orlgmj (mgr.34412) 11566 : cluster [DBG] pgmap v6593: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:19.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:28:18 gibba045 bash[25517]: cluster 2021-03-10T17:28:18.601478+0000 mgr.gibba045.orlgmj (mgr.34412) 11566 : cluster [DBG] pgmap v6593: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:19.383 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:28:19.609 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:28:19.609 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 34s ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:28:19.610 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 9m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:28:19.610 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:28:19.610 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:28:19.611 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 34s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:28:19.611 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 34s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:28:19.611 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:28:19.612 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 34s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:28:19.612 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 34s ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:28:19.612 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 9m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:28:19.612 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 34s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:28:19.613 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 34s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:28:19.613 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 34s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:28:19.613 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 34s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:28:19.613 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:28:19.614 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:28:19.614 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:28:19.614 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:28:19.614 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 9m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:28:19.615 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 9m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:28:19.863 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:28:19.864 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:28:19.864 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:28:19.864 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:28:19.865 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:28:19.865 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:28:19.865 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:28:19.865 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:28:19.866 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:28:19.866 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:28:19.866 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:28:19.866 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:28:19.867 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:28:19.867 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:28:19.867 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:28:20.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:28:19 gibba015 bash[29377]: audit 2021-03-10T17:28:19.373520+0000 mgr.gibba045.orlgmj (mgr.34412) 11567 : audit [DBG] from='client.61798 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:28:20.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:28:19 gibba015 bash[29377]: audit 2021-03-10T17:28:19.596943+0000 mgr.gibba045.orlgmj (mgr.34412) 11568 : audit [DBG] from='client.51816 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:28:20.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:28:19 gibba015 bash[29377]: audit 2021-03-10T17:28:19.861906+0000 mon.a (mon.0) 2421 : audit [DBG] from='client.? 172.21.2.115:0/1199046928' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:28:20.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:28:19 gibba015 bash[30343]: audit 2021-03-10T17:28:19.373520+0000 mgr.gibba045.orlgmj (mgr.34412) 11567 : audit [DBG] from='client.61798 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:28:20.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:28:19 gibba015 bash[30343]: audit 2021-03-10T17:28:19.596943+0000 mgr.gibba045.orlgmj (mgr.34412) 11568 : audit [DBG] from='client.51816 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:28:20.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:28:19 gibba015 bash[30343]: audit 2021-03-10T17:28:19.861906+0000 mon.a (mon.0) 2421 : audit [DBG] from='client.? 172.21.2.115:0/1199046928' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:28:20.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:28:19 gibba045 bash[25517]: audit 2021-03-10T17:28:19.373520+0000 mgr.gibba045.orlgmj (mgr.34412) 11567 : audit [DBG] from='client.61798 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:28:20.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:28:19 gibba045 bash[25517]: audit 2021-03-10T17:28:19.596943+0000 mgr.gibba045.orlgmj (mgr.34412) 11568 : audit [DBG] from='client.51816 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:28:20.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:28:19 gibba045 bash[25517]: audit 2021-03-10T17:28:19.861906+0000 mon.a (mon.0) 2421 : audit [DBG] from='client.? 172.21.2.115:0/1199046928' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:28:21.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:28:20 gibba015 bash[29377]: cluster 2021-03-10T17:28:20.602971+0000 mgr.gibba045.orlgmj (mgr.34412) 11569 : cluster [DBG] pgmap v6594: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:21.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:28:20 gibba015 bash[30343]: cluster 2021-03-10T17:28:20.602971+0000 mgr.gibba045.orlgmj (mgr.34412) 11569 : cluster [DBG] pgmap v6594: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:21.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:28:20 gibba045 bash[25517]: cluster 2021-03-10T17:28:20.602971+0000 mgr.gibba045.orlgmj (mgr.34412) 11569 : cluster [DBG] pgmap v6594: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:23.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:28:23 gibba015 bash[29377]: cluster 2021-03-10T17:28:22.604760+0000 mgr.gibba045.orlgmj (mgr.34412) 11570 : cluster [DBG] pgmap v6595: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:23.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:28:23 gibba015 bash[30343]: cluster 2021-03-10T17:28:22.604760+0000 mgr.gibba045.orlgmj (mgr.34412) 11570 : cluster [DBG] pgmap v6595: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:24.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:28:23 gibba045 bash[25517]: cluster 2021-03-10T17:28:22.604760+0000 mgr.gibba045.orlgmj (mgr.34412) 11570 : cluster [DBG] pgmap v6595: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:25.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:28:25 gibba015 bash[29377]: cluster 2021-03-10T17:28:24.606213+0000 mgr.gibba045.orlgmj (mgr.34412) 11571 : cluster [DBG] pgmap v6596: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:25.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:28:25 gibba015 bash[30343]: cluster 2021-03-10T17:28:24.606213+0000 mgr.gibba045.orlgmj (mgr.34412) 11571 : cluster [DBG] pgmap v6596: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:26.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:28:25 gibba045 bash[25517]: cluster 2021-03-10T17:28:24.606213+0000 mgr.gibba045.orlgmj (mgr.34412) 11571 : cluster [DBG] pgmap v6596: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:27.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:28:27 gibba015 bash[29377]: cluster 2021-03-10T17:28:26.608113+0000 mgr.gibba045.orlgmj (mgr.34412) 11572 : cluster [DBG] pgmap v6597: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:27.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:28:27 gibba015 bash[30343]: cluster 2021-03-10T17:28:26.608113+0000 mgr.gibba045.orlgmj (mgr.34412) 11572 : cluster [DBG] pgmap v6597: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:28.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:28:27 gibba045 bash[25517]: cluster 2021-03-10T17:28:26.608113+0000 mgr.gibba045.orlgmj (mgr.34412) 11572 : cluster [DBG] pgmap v6597: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:29.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:28:28 gibba015 bash[29377]: cluster 2021-03-10T17:28:28.609479+0000 mgr.gibba045.orlgmj (mgr.34412) 11573 : cluster [DBG] pgmap v6598: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:29.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:28:29 gibba015 bash[30343]: cluster 2021-03-10T17:28:28.609479+0000 mgr.gibba045.orlgmj (mgr.34412) 11573 : cluster [DBG] pgmap v6598: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:29.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:28:28 gibba045 bash[25517]: cluster 2021-03-10T17:28:28.609479+0000 mgr.gibba045.orlgmj (mgr.34412) 11573 : cluster [DBG] pgmap v6598: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:31.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:28:31 gibba015 bash[29377]: cephadm 2021-03-10T17:28:29.974643+0000 mgr.gibba045.orlgmj (mgr.34412) 11574 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:28:31.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:28:31 gibba015 bash[29377]: cluster 2021-03-10T17:28:30.611201+0000 mgr.gibba045.orlgmj (mgr.34412) 11575 : cluster [DBG] pgmap v6599: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:31.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:28:31 gibba015 bash[30343]: cephadm 2021-03-10T17:28:29.974643+0000 mgr.gibba045.orlgmj (mgr.34412) 11574 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:28:31.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:28:31 gibba015 bash[30343]: cluster 2021-03-10T17:28:30.611201+0000 mgr.gibba045.orlgmj (mgr.34412) 11575 : cluster [DBG] pgmap v6599: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:32.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:28:31 gibba045 bash[25517]: cephadm 2021-03-10T17:28:29.974643+0000 mgr.gibba045.orlgmj (mgr.34412) 11574 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:28:32.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:28:31 gibba045 bash[25517]: cluster 2021-03-10T17:28:30.611201+0000 mgr.gibba045.orlgmj (mgr.34412) 11575 : cluster [DBG] pgmap v6599: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:33.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:28:33 gibba015 bash[29377]: cluster 2021-03-10T17:28:32.612981+0000 mgr.gibba045.orlgmj (mgr.34412) 11576 : cluster [DBG] pgmap v6600: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:33.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:28:33 gibba015 bash[30343]: cluster 2021-03-10T17:28:32.612981+0000 mgr.gibba045.orlgmj (mgr.34412) 11576 : cluster [DBG] pgmap v6600: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:34.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:28:33 gibba045 bash[25517]: cluster 2021-03-10T17:28:32.612981+0000 mgr.gibba045.orlgmj (mgr.34412) 11576 : cluster [DBG] pgmap v6600: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:35.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:28:35 gibba015 bash[29377]: cluster 2021-03-10T17:28:34.614528+0000 mgr.gibba045.orlgmj (mgr.34412) 11577 : cluster [DBG] pgmap v6601: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:35.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:28:35 gibba015 bash[30343]: cluster 2021-03-10T17:28:34.614528+0000 mgr.gibba045.orlgmj (mgr.34412) 11577 : cluster [DBG] pgmap v6601: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:36.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:28:35 gibba045 bash[25517]: cluster 2021-03-10T17:28:34.614528+0000 mgr.gibba045.orlgmj (mgr.34412) 11577 : cluster [DBG] pgmap v6601: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:37.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:28:37 gibba015 bash[29377]: cluster 2021-03-10T17:28:36.616311+0000 mgr.gibba045.orlgmj (mgr.34412) 11578 : cluster [DBG] pgmap v6602: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:37.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:28:37 gibba015 bash[30343]: cluster 2021-03-10T17:28:36.616311+0000 mgr.gibba045.orlgmj (mgr.34412) 11578 : cluster [DBG] pgmap v6602: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:38.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:28:37 gibba045 bash[25517]: cluster 2021-03-10T17:28:36.616311+0000 mgr.gibba045.orlgmj (mgr.34412) 11578 : cluster [DBG] pgmap v6602: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:39.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:28:38 gibba015 bash[29377]: cluster 2021-03-10T17:28:38.617457+0000 mgr.gibba045.orlgmj (mgr.34412) 11579 : cluster [DBG] pgmap v6603: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:39.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:28:38 gibba015 bash[30343]: cluster 2021-03-10T17:28:38.617457+0000 mgr.gibba045.orlgmj (mgr.34412) 11579 : cluster [DBG] pgmap v6603: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:39.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:28:38 gibba045 bash[25517]: cluster 2021-03-10T17:28:38.617457+0000 mgr.gibba045.orlgmj (mgr.34412) 11579 : cluster [DBG] pgmap v6603: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:41.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:28:41 gibba015 bash[29377]: cluster 2021-03-10T17:28:40.619278+0000 mgr.gibba045.orlgmj (mgr.34412) 11580 : cluster [DBG] pgmap v6604: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:41.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:28:41 gibba015 bash[30343]: cluster 2021-03-10T17:28:40.619278+0000 mgr.gibba045.orlgmj (mgr.34412) 11580 : cluster [DBG] pgmap v6604: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:42.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:28:41 gibba045 bash[25517]: cluster 2021-03-10T17:28:40.619278+0000 mgr.gibba045.orlgmj (mgr.34412) 11580 : cluster [DBG] pgmap v6604: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:43.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:28:43 gibba015 bash[29377]: cluster 2021-03-10T17:28:42.621095+0000 mgr.gibba045.orlgmj (mgr.34412) 11581 : cluster [DBG] pgmap v6605: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:43.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:28:43 gibba015 bash[30343]: cluster 2021-03-10T17:28:42.621095+0000 mgr.gibba045.orlgmj (mgr.34412) 11581 : cluster [DBG] pgmap v6605: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:44.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:28:43 gibba045 bash[25517]: cluster 2021-03-10T17:28:42.621095+0000 mgr.gibba045.orlgmj (mgr.34412) 11581 : cluster [DBG] pgmap v6605: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:45.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:28:45 gibba015 bash[29377]: cluster 2021-03-10T17:28:44.622789+0000 mgr.gibba045.orlgmj (mgr.34412) 11582 : cluster [DBG] pgmap v6606: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:45.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:28:45 gibba015 bash[29377]: audit 2021-03-10T17:28:44.989573+0000 mon.c (mon.1) 3171 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:28:45.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:28:45 gibba015 bash[29377]: audit 2021-03-10T17:28:44.996510+0000 mon.c (mon.1) 3172 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:28:45.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:28:45 gibba015 bash[30343]: cluster 2021-03-10T17:28:44.622789+0000 mgr.gibba045.orlgmj (mgr.34412) 11582 : cluster [DBG] pgmap v6606: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:45.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:28:45 gibba015 bash[30343]: audit 2021-03-10T17:28:44.989573+0000 mon.c (mon.1) 3171 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:28:45.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:28:45 gibba015 bash[30343]: audit 2021-03-10T17:28:44.996510+0000 mon.c (mon.1) 3172 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:28:46.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:28:45 gibba045 bash[25517]: cluster 2021-03-10T17:28:44.622789+0000 mgr.gibba045.orlgmj (mgr.34412) 11582 : cluster [DBG] pgmap v6606: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:46.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:28:45 gibba045 bash[25517]: audit 2021-03-10T17:28:44.989573+0000 mon.c (mon.1) 3171 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:28:46.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:28:45 gibba045 bash[25517]: audit 2021-03-10T17:28:44.996510+0000 mon.c (mon.1) 3172 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:28:46.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:28:46 gibba015 bash[29377]: cephadm 2021-03-10T17:28:44.996819+0000 mgr.gibba045.orlgmj (mgr.34412) 11583 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:28:46.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:28:46 gibba015 bash[30343]: cephadm 2021-03-10T17:28:44.996819+0000 mgr.gibba045.orlgmj (mgr.34412) 11583 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:28:47.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:28:46 gibba045 bash[25517]: cephadm 2021-03-10T17:28:44.996819+0000 mgr.gibba045.orlgmj (mgr.34412) 11583 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:28:47.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:28:47 gibba015 bash[29377]: cluster 2021-03-10T17:28:46.625044+0000 mgr.gibba045.orlgmj (mgr.34412) 11584 : cluster [DBG] pgmap v6607: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:47.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:28:47 gibba015 bash[30343]: cluster 2021-03-10T17:28:46.625044+0000 mgr.gibba045.orlgmj (mgr.34412) 11584 : cluster [DBG] pgmap v6607: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:48.055 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:28:47 gibba045 bash[25517]: cluster 2021-03-10T17:28:46.625044+0000 mgr.gibba045.orlgmj (mgr.34412) 11584 : cluster [DBG] pgmap v6607: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:50.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:28:49 gibba045 bash[25517]: cluster 2021-03-10T17:28:48.626200+0000 mgr.gibba045.orlgmj (mgr.34412) 11585 : cluster [DBG] pgmap v6608: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:50.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:28:49 gibba045 bash[25517]: audit 2021-03-10T17:28:48.788326+0000 mon.a (mon.0) 2422 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:28:50.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:28:49 gibba045 bash[25517]: audit 2021-03-10T17:28:48.997516+0000 mon.a (mon.0) 2423 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:28:50.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:28:49 gibba045 bash[25517]: audit 2021-03-10T17:28:49.001552+0000 mon.c (mon.1) 3173 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:28:50.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:28:49 gibba045 bash[25517]: audit 2021-03-10T17:28:49.003682+0000 mon.c (mon.1) 3174 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:28:50.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:28:49 gibba045 bash[25517]: audit 2021-03-10T17:28:49.006316+0000 mon.c (mon.1) 3175 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:28:50.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:28:49 gibba045 bash[25517]: audit 2021-03-10T17:28:49.008555+0000 mon.c (mon.1) 3176 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:28:50.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:28:49 gibba045 bash[25517]: audit 2021-03-10T17:28:49.015001+0000 mon.c (mon.1) 3177 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:28:50.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:28:49 gibba045 bash[25517]: audit 2021-03-10T17:28:49.018097+0000 mon.c (mon.1) 3178 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:28:50.109 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:28:50.221 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:28:49 gibba015 bash[29377]: cluster 2021-03-10T17:28:48.626200+0000 mgr.gibba045.orlgmj (mgr.34412) 11585 : cluster [DBG] pgmap v6608: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:50.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:28:49 gibba015 bash[29377]: audit 2021-03-10T17:28:48.788326+0000 mon.a (mon.0) 2422 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:28:50.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:28:49 gibba015 bash[29377]: audit 2021-03-10T17:28:48.997516+0000 mon.a (mon.0) 2423 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:28:50.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:28:49 gibba015 bash[29377]: audit 2021-03-10T17:28:49.001552+0000 mon.c (mon.1) 3173 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:28:50.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:28:49 gibba015 bash[29377]: audit 2021-03-10T17:28:49.003682+0000 mon.c (mon.1) 3174 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:28:50.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:28:49 gibba015 bash[29377]: audit 2021-03-10T17:28:49.006316+0000 mon.c (mon.1) 3175 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:28:50.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:28:49 gibba015 bash[29377]: audit 2021-03-10T17:28:49.008555+0000 mon.c (mon.1) 3176 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:28:50.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:28:49 gibba015 bash[29377]: audit 2021-03-10T17:28:49.015001+0000 mon.c (mon.1) 3177 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:28:50.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:28:49 gibba015 bash[29377]: audit 2021-03-10T17:28:49.018097+0000 mon.c (mon.1) 3178 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:28:50.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:28:49 gibba015 bash[30343]: cluster 2021-03-10T17:28:48.626200+0000 mgr.gibba045.orlgmj (mgr.34412) 11585 : cluster [DBG] pgmap v6608: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:50.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:28:49 gibba015 bash[30343]: audit 2021-03-10T17:28:48.788326+0000 mon.a (mon.0) 2422 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:28:50.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:28:49 gibba015 bash[30343]: audit 2021-03-10T17:28:48.997516+0000 mon.a (mon.0) 2423 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:28:50.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:28:49 gibba015 bash[30343]: audit 2021-03-10T17:28:49.001552+0000 mon.c (mon.1) 3173 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:28:50.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:28:49 gibba015 bash[30343]: audit 2021-03-10T17:28:49.003682+0000 mon.c (mon.1) 3174 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:28:50.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:28:49 gibba015 bash[30343]: audit 2021-03-10T17:28:49.006316+0000 mon.c (mon.1) 3175 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:28:50.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:28:49 gibba015 bash[30343]: audit 2021-03-10T17:28:49.008555+0000 mon.c (mon.1) 3176 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:28:50.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:28:49 gibba015 bash[30343]: audit 2021-03-10T17:28:49.015001+0000 mon.c (mon.1) 3177 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:28:50.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:28:49 gibba015 bash[30343]: audit 2021-03-10T17:28:49.018097+0000 mon.c (mon.1) 3178 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:28:50.339 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:28:50.340 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 65s ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:28:50.340 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 1s ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:28:50.340 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 1s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:28:50.340 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 1s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:28:50.341 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 65s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:28:50.341 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 65s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:28:50.341 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 1s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:28:50.342 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 65s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:28:50.342 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 65s ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:28:50.342 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 1s ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:28:50.342 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 65s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:28:50.342 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 65s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:28:50.343 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 65s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:28:50.343 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 65s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:28:50.343 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 1s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:28:50.343 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 1s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:28:50.344 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 1s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:28:50.344 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 1s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:28:50.344 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 1s ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:28:50.344 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 1s ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:28:50.590 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:28:50.590 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:28:50.590 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:28:50.591 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:28:50.591 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:28:50.591 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:28:50.591 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:28:50.592 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:28:50.592 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:28:50.592 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:28:50.592 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:28:50.592 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:28:50.593 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:28:50.593 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:28:50.593 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:28:51.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:28:50 gibba045 bash[25517]: cephadm 2021-03-10T17:28:48.791400+0000 mgr.gibba045.orlgmj (mgr.34412) 11586 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:28:51.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:28:50 gibba045 bash[25517]: cephadm 2021-03-10T17:28:49.002559+0000 mgr.gibba045.orlgmj (mgr.34412) 11587 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:28:51.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:28:50 gibba045 bash[25517]: cephadm 2021-03-10T17:28:49.004860+0000 mgr.gibba045.orlgmj (mgr.34412) 11588 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:28:51.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:28:50 gibba045 bash[25517]: cephadm 2021-03-10T17:28:49.007296+0000 mgr.gibba045.orlgmj (mgr.34412) 11589 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:28:51.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:28:50 gibba045 bash[25517]: cephadm 2021-03-10T17:28:49.007338+0000 mgr.gibba045.orlgmj (mgr.34412) 11590 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:28:51.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:28:50 gibba045 bash[25517]: cephadm 2021-03-10T17:28:49.009849+0000 mgr.gibba045.orlgmj (mgr.34412) 11591 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:28:51.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:28:50 gibba045 bash[25517]: cephadm 2021-03-10T17:28:49.009886+0000 mgr.gibba045.orlgmj (mgr.34412) 11592 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:28:51.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:28:50 gibba045 bash[25517]: cephadm 2021-03-10T17:28:49.012110+0000 mgr.gibba045.orlgmj (mgr.34412) 11593 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:28:51.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:28:50 gibba045 bash[25517]: cephadm 2021-03-10T17:28:49.016048+0000 mgr.gibba045.orlgmj (mgr.34412) 11594 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:28:51.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:28:50 gibba045 bash[25517]: cephadm 2021-03-10T17:28:49.016085+0000 mgr.gibba045.orlgmj (mgr.34412) 11595 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:28:51.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:28:50 gibba045 bash[25517]: cephadm 2021-03-10T17:28:49.018854+0000 mgr.gibba045.orlgmj (mgr.34412) 11596 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:28:51.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:28:50 gibba045 bash[25517]: cephadm 2021-03-10T17:28:49.019186+0000 mgr.gibba045.orlgmj (mgr.34412) 11597 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:28:51.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:28:50 gibba045 bash[25517]: cephadm 2021-03-10T17:28:49.022121+0000 mgr.gibba045.orlgmj (mgr.34412) 11598 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:28:51.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:28:50 gibba045 bash[25517]: cephadm 2021-03-10T17:28:49.022159+0000 mgr.gibba045.orlgmj (mgr.34412) 11599 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:28:51.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:28:50 gibba045 bash[25517]: cephadm 2021-03-10T17:28:49.022268+0000 mgr.gibba045.orlgmj (mgr.34412) 11600 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:28:51.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:28:50 gibba045 bash[25517]: audit 2021-03-10T17:28:50.101391+0000 mgr.gibba045.orlgmj (mgr.34412) 11601 : audit [DBG] from='client.61816 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:28:51.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:28:50 gibba045 bash[25517]: audit 2021-03-10T17:28:50.326731+0000 mgr.gibba045.orlgmj (mgr.34412) 11602 : audit [DBG] from='client.61822 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:28:51.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:28:50 gibba045 bash[25517]: audit 2021-03-10T17:28:50.588289+0000 mon.c (mon.1) 3179 : audit [DBG] from='client.? 172.21.2.115:0/1694930694' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:28:51.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:28:50 gibba045 bash[25517]: cluster 2021-03-10T17:28:50.627572+0000 mgr.gibba045.orlgmj (mgr.34412) 11603 : cluster [DBG] pgmap v6609: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:51.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:28:50 gibba015 bash[29377]: cephadm 2021-03-10T17:28:48.791400+0000 mgr.gibba045.orlgmj (mgr.34412) 11586 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:28:51.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:28:50 gibba015 bash[29377]: cephadm 2021-03-10T17:28:49.002559+0000 mgr.gibba045.orlgmj (mgr.34412) 11587 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:28:51.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:28:50 gibba015 bash[29377]: cephadm 2021-03-10T17:28:49.004860+0000 mgr.gibba045.orlgmj (mgr.34412) 11588 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:28:51.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:28:50 gibba015 bash[29377]: cephadm 2021-03-10T17:28:49.007296+0000 mgr.gibba045.orlgmj (mgr.34412) 11589 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:28:51.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:28:50 gibba015 bash[29377]: cephadm 2021-03-10T17:28:49.007338+0000 mgr.gibba045.orlgmj (mgr.34412) 11590 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:28:51.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:28:50 gibba015 bash[29377]: cephadm 2021-03-10T17:28:49.009849+0000 mgr.gibba045.orlgmj (mgr.34412) 11591 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:28:51.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:28:50 gibba015 bash[29377]: cephadm 2021-03-10T17:28:49.009886+0000 mgr.gibba045.orlgmj (mgr.34412) 11592 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:28:51.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:28:50 gibba015 bash[29377]: cephadm 2021-03-10T17:28:49.012110+0000 mgr.gibba045.orlgmj (mgr.34412) 11593 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:28:51.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:28:50 gibba015 bash[29377]: cephadm 2021-03-10T17:28:49.016048+0000 mgr.gibba045.orlgmj (mgr.34412) 11594 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:28:51.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:28:50 gibba015 bash[29377]: cephadm 2021-03-10T17:28:49.016085+0000 mgr.gibba045.orlgmj (mgr.34412) 11595 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:28:51.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:28:50 gibba015 bash[29377]: cephadm 2021-03-10T17:28:49.018854+0000 mgr.gibba045.orlgmj (mgr.34412) 11596 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:28:51.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:28:50 gibba015 bash[29377]: cephadm 2021-03-10T17:28:49.019186+0000 mgr.gibba045.orlgmj (mgr.34412) 11597 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:28:51.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:28:50 gibba015 bash[29377]: cephadm 2021-03-10T17:28:49.022121+0000 mgr.gibba045.orlgmj (mgr.34412) 11598 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:28:51.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:28:50 gibba015 bash[29377]: cephadm 2021-03-10T17:28:49.022159+0000 mgr.gibba045.orlgmj (mgr.34412) 11599 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:28:51.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:28:50 gibba015 bash[29377]: cephadm 2021-03-10T17:28:49.022268+0000 mgr.gibba045.orlgmj (mgr.34412) 11600 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:28:51.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:28:50 gibba015 bash[29377]: audit 2021-03-10T17:28:50.101391+0000 mgr.gibba045.orlgmj (mgr.34412) 11601 : audit [DBG] from='client.61816 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:28:51.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:28:50 gibba015 bash[29377]: audit 2021-03-10T17:28:50.326731+0000 mgr.gibba045.orlgmj (mgr.34412) 11602 : audit [DBG] from='client.61822 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:28:51.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:28:50 gibba015 bash[29377]: audit 2021-03-10T17:28:50.588289+0000 mon.c (mon.1) 3179 : audit [DBG] from='client.? 172.21.2.115:0/1694930694' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:28:51.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:28:50 gibba015 bash[29377]: cluster 2021-03-10T17:28:50.627572+0000 mgr.gibba045.orlgmj (mgr.34412) 11603 : cluster [DBG] pgmap v6609: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:51.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:28:50 gibba015 bash[30343]: cephadm 2021-03-10T17:28:48.791400+0000 mgr.gibba045.orlgmj (mgr.34412) 11586 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:28:51.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:28:50 gibba015 bash[30343]: cephadm 2021-03-10T17:28:49.002559+0000 mgr.gibba045.orlgmj (mgr.34412) 11587 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:28:51.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:28:50 gibba015 bash[30343]: cephadm 2021-03-10T17:28:49.004860+0000 mgr.gibba045.orlgmj (mgr.34412) 11588 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:28:51.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:28:50 gibba015 bash[30343]: cephadm 2021-03-10T17:28:49.007296+0000 mgr.gibba045.orlgmj (mgr.34412) 11589 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:28:51.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:28:50 gibba015 bash[30343]: cephadm 2021-03-10T17:28:49.007338+0000 mgr.gibba045.orlgmj (mgr.34412) 11590 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:28:51.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:28:50 gibba015 bash[30343]: cephadm 2021-03-10T17:28:49.009849+0000 mgr.gibba045.orlgmj (mgr.34412) 11591 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:28:51.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:28:50 gibba015 bash[30343]: cephadm 2021-03-10T17:28:49.009886+0000 mgr.gibba045.orlgmj (mgr.34412) 11592 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:28:51.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:28:50 gibba015 bash[30343]: cephadm 2021-03-10T17:28:49.012110+0000 mgr.gibba045.orlgmj (mgr.34412) 11593 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:28:51.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:28:50 gibba015 bash[30343]: cephadm 2021-03-10T17:28:49.016048+0000 mgr.gibba045.orlgmj (mgr.34412) 11594 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:28:51.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:28:50 gibba015 bash[30343]: cephadm 2021-03-10T17:28:49.016085+0000 mgr.gibba045.orlgmj (mgr.34412) 11595 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:28:51.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:28:50 gibba015 bash[30343]: cephadm 2021-03-10T17:28:49.018854+0000 mgr.gibba045.orlgmj (mgr.34412) 11596 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:28:51.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:28:50 gibba015 bash[30343]: cephadm 2021-03-10T17:28:49.019186+0000 mgr.gibba045.orlgmj (mgr.34412) 11597 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:28:51.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:28:50 gibba015 bash[30343]: cephadm 2021-03-10T17:28:49.022121+0000 mgr.gibba045.orlgmj (mgr.34412) 11598 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:28:51.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:28:50 gibba015 bash[30343]: cephadm 2021-03-10T17:28:49.022159+0000 mgr.gibba045.orlgmj (mgr.34412) 11599 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:28:51.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:28:50 gibba015 bash[30343]: cephadm 2021-03-10T17:28:49.022268+0000 mgr.gibba045.orlgmj (mgr.34412) 11600 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:28:51.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:28:50 gibba015 bash[30343]: audit 2021-03-10T17:28:50.101391+0000 mgr.gibba045.orlgmj (mgr.34412) 11601 : audit [DBG] from='client.61816 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:28:51.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:28:50 gibba015 bash[30343]: audit 2021-03-10T17:28:50.326731+0000 mgr.gibba045.orlgmj (mgr.34412) 11602 : audit [DBG] from='client.61822 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:28:51.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:28:50 gibba015 bash[30343]: audit 2021-03-10T17:28:50.588289+0000 mon.c (mon.1) 3179 : audit [DBG] from='client.? 172.21.2.115:0/1694930694' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:28:51.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:28:50 gibba015 bash[30343]: cluster 2021-03-10T17:28:50.627572+0000 mgr.gibba045.orlgmj (mgr.34412) 11603 : cluster [DBG] pgmap v6609: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:53.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:28:53 gibba015 bash[29377]: cluster 2021-03-10T17:28:52.629237+0000 mgr.gibba045.orlgmj (mgr.34412) 11604 : cluster [DBG] pgmap v6610: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:53.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:28:53 gibba015 bash[30343]: cluster 2021-03-10T17:28:52.629237+0000 mgr.gibba045.orlgmj (mgr.34412) 11604 : cluster [DBG] pgmap v6610: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:28:53 gibba045 bash[25517]: cluster 2021-03-10T17:28:52.629237+0000 mgr.gibba045.orlgmj (mgr.34412) 11604 : cluster [DBG] pgmap v6610: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:54.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:28:54 gibba015 bash[29377]: audit 2021-03-10T17:28:54.079043+0000 mon.c (mon.1) 3180 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:28:54.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:28:54 gibba015 bash[29377]: audit 2021-03-10T17:28:54.080186+0000 mon.a (mon.0) 2424 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:28:54.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:28:54 gibba015 bash[29377]: audit 2021-03-10T17:28:54.080708+0000 mon.c (mon.1) 3181 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:28:54.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:28:54 gibba015 bash[29377]: audit 2021-03-10T17:28:54.081668+0000 mon.a (mon.0) 2425 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:28:54.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:28:54 gibba015 bash[29377]: audit 2021-03-10T17:28:54.176227+0000 mon.c (mon.1) 3182 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T17:28:54.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:28:54 gibba015 bash[29377]: audit 2021-03-10T17:28:54.176967+0000 mon.c (mon.1) 3183 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:28:54.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:28:54 gibba015 bash[29377]: audit 2021-03-10T17:28:54.177496+0000 mon.a (mon.0) 2426 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T17:28:54.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:28:54 gibba015 bash[29377]: audit 2021-03-10T17:28:54.177683+0000 mon.c (mon.1) 3184 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:28:54.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:28:54 gibba015 bash[29377]: audit 2021-03-10T17:28:54.178761+0000 mon.c (mon.1) 3185 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:28:54.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:28:54 gibba015 bash[29377]: audit 2021-03-10T17:28:54.178764+0000 mon.a (mon.0) 2427 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:28:54.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:28:54 gibba015 bash[29377]: audit 2021-03-10T17:28:54.179767+0000 mon.a (mon.0) 2428 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:28:54.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:28:54 gibba015 bash[29377]: audit 2021-03-10T17:28:54.180749+0000 mon.a (mon.0) 2429 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:28:54.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:28:54 gibba015 bash[30343]: audit 2021-03-10T17:28:54.079043+0000 mon.c (mon.1) 3180 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:28:54.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:28:54 gibba015 bash[30343]: audit 2021-03-10T17:28:54.080186+0000 mon.a (mon.0) 2424 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:28:54.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:28:54 gibba015 bash[30343]: audit 2021-03-10T17:28:54.080708+0000 mon.c (mon.1) 3181 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:28:54.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:28:54 gibba015 bash[30343]: audit 2021-03-10T17:28:54.081668+0000 mon.a (mon.0) 2425 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:28:54.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:28:54 gibba015 bash[30343]: audit 2021-03-10T17:28:54.176227+0000 mon.c (mon.1) 3182 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T17:28:54.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:28:54 gibba015 bash[30343]: audit 2021-03-10T17:28:54.176967+0000 mon.c (mon.1) 3183 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:28:54.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:28:54 gibba015 bash[30343]: audit 2021-03-10T17:28:54.177496+0000 mon.a (mon.0) 2426 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T17:28:54.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:28:54 gibba015 bash[30343]: audit 2021-03-10T17:28:54.177683+0000 mon.c (mon.1) 3184 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:28:54.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:28:54 gibba015 bash[30343]: audit 2021-03-10T17:28:54.178761+0000 mon.c (mon.1) 3185 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:28:54.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:28:54 gibba015 bash[30343]: audit 2021-03-10T17:28:54.178764+0000 mon.a (mon.0) 2427 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:28:54.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:28:54 gibba015 bash[30343]: audit 2021-03-10T17:28:54.179767+0000 mon.a (mon.0) 2428 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:28:54.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:28:54 gibba015 bash[30343]: audit 2021-03-10T17:28:54.180749+0000 mon.a (mon.0) 2429 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:28:55.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:28:54 gibba045 bash[25517]: audit 2021-03-10T17:28:54.079043+0000 mon.c (mon.1) 3180 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:28:55.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:28:54 gibba045 bash[25517]: audit 2021-03-10T17:28:54.080186+0000 mon.a (mon.0) 2424 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:28:55.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:28:54 gibba045 bash[25517]: audit 2021-03-10T17:28:54.080708+0000 mon.c (mon.1) 3181 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:28:55.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:28:54 gibba045 bash[25517]: audit 2021-03-10T17:28:54.081668+0000 mon.a (mon.0) 2425 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:28:55.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:28:54 gibba045 bash[25517]: audit 2021-03-10T17:28:54.176227+0000 mon.c (mon.1) 3182 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T17:28:55.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:28:54 gibba045 bash[25517]: audit 2021-03-10T17:28:54.176967+0000 mon.c (mon.1) 3183 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:28:55.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:28:54 gibba045 bash[25517]: audit 2021-03-10T17:28:54.177496+0000 mon.a (mon.0) 2426 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T17:28:55.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:28:54 gibba045 bash[25517]: audit 2021-03-10T17:28:54.177683+0000 mon.c (mon.1) 3184 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:28:55.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:28:54 gibba045 bash[25517]: audit 2021-03-10T17:28:54.178761+0000 mon.c (mon.1) 3185 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:28:55.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:28:54 gibba045 bash[25517]: audit 2021-03-10T17:28:54.178764+0000 mon.a (mon.0) 2427 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:28:55.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:28:54 gibba045 bash[25517]: audit 2021-03-10T17:28:54.179767+0000 mon.a (mon.0) 2428 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:28:55.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:28:54 gibba045 bash[25517]: audit 2021-03-10T17:28:54.180749+0000 mon.a (mon.0) 2429 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:28:55.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:28:55 gibba015 bash[29377]: cluster 2021-03-10T17:28:54.630539+0000 mgr.gibba045.orlgmj (mgr.34412) 11605 : cluster [DBG] pgmap v6611: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:55.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:28:55 gibba015 bash[30343]: cluster 2021-03-10T17:28:54.630539+0000 mgr.gibba045.orlgmj (mgr.34412) 11605 : cluster [DBG] pgmap v6611: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:56.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:28:55 gibba045 bash[25517]: cluster 2021-03-10T17:28:54.630539+0000 mgr.gibba045.orlgmj (mgr.34412) 11605 : cluster [DBG] pgmap v6611: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:57.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:28:57 gibba015 bash[29377]: cluster 2021-03-10T17:28:56.632150+0000 mgr.gibba045.orlgmj (mgr.34412) 11606 : cluster [DBG] pgmap v6612: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:57.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:28:57 gibba015 bash[30343]: cluster 2021-03-10T17:28:56.632150+0000 mgr.gibba045.orlgmj (mgr.34412) 11606 : cluster [DBG] pgmap v6612: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:58.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:28:57 gibba045 bash[25517]: cluster 2021-03-10T17:28:56.632150+0000 mgr.gibba045.orlgmj (mgr.34412) 11606 : cluster [DBG] pgmap v6612: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:59.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:28:58 gibba015 bash[29377]: cluster 2021-03-10T17:28:58.633357+0000 mgr.gibba045.orlgmj (mgr.34412) 11607 : cluster [DBG] pgmap v6613: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:59.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:28:58 gibba015 bash[30343]: cluster 2021-03-10T17:28:58.633357+0000 mgr.gibba045.orlgmj (mgr.34412) 11607 : cluster [DBG] pgmap v6613: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:59.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:28:58 gibba045 bash[25517]: cluster 2021-03-10T17:28:58.633357+0000 mgr.gibba045.orlgmj (mgr.34412) 11607 : cluster [DBG] pgmap v6613: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:01.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:29:01 gibba015 bash[29377]: cluster 2021-03-10T17:29:00.634793+0000 mgr.gibba045.orlgmj (mgr.34412) 11608 : cluster [DBG] pgmap v6614: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:01.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:29:01 gibba015 bash[30343]: cluster 2021-03-10T17:29:00.634793+0000 mgr.gibba045.orlgmj (mgr.34412) 11608 : cluster [DBG] pgmap v6614: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:02.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:29:01 gibba045 bash[25517]: cluster 2021-03-10T17:29:00.634793+0000 mgr.gibba045.orlgmj (mgr.34412) 11608 : cluster [DBG] pgmap v6614: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:03.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:29:03 gibba015 bash[29377]: cluster 2021-03-10T17:29:02.636340+0000 mgr.gibba045.orlgmj (mgr.34412) 11609 : cluster [DBG] pgmap v6615: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:03.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:29:03 gibba015 bash[30343]: cluster 2021-03-10T17:29:02.636340+0000 mgr.gibba045.orlgmj (mgr.34412) 11609 : cluster [DBG] pgmap v6615: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:04.037 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:29:03 gibba045 bash[25517]: cluster 2021-03-10T17:29:02.636340+0000 mgr.gibba045.orlgmj (mgr.34412) 11609 : cluster [DBG] pgmap v6615: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:05.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:29:05 gibba015 bash[29377]: cephadm 2021-03-10T17:29:04.037247+0000 mgr.gibba045.orlgmj (mgr.34412) 11610 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:29:05.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:29:05 gibba015 bash[29377]: cluster 2021-03-10T17:29:04.637652+0000 mgr.gibba045.orlgmj (mgr.34412) 11611 : cluster [DBG] pgmap v6616: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:05.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:29:05 gibba015 bash[30343]: cephadm 2021-03-10T17:29:04.037247+0000 mgr.gibba045.orlgmj (mgr.34412) 11610 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:29:05.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:29:05 gibba015 bash[30343]: cluster 2021-03-10T17:29:04.637652+0000 mgr.gibba045.orlgmj (mgr.34412) 11611 : cluster [DBG] pgmap v6616: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:06.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:29:05 gibba045 bash[25517]: cephadm 2021-03-10T17:29:04.037247+0000 mgr.gibba045.orlgmj (mgr.34412) 11610 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:29:06.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:29:05 gibba045 bash[25517]: cluster 2021-03-10T17:29:04.637652+0000 mgr.gibba045.orlgmj (mgr.34412) 11611 : cluster [DBG] pgmap v6616: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:08.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:29:07 gibba045 bash[25517]: cluster 2021-03-10T17:29:06.639703+0000 mgr.gibba045.orlgmj (mgr.34412) 11612 : cluster [DBG] pgmap v6617: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:08.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:29:07 gibba015 bash[29377]: cluster 2021-03-10T17:29:06.639703+0000 mgr.gibba045.orlgmj (mgr.34412) 11612 : cluster [DBG] pgmap v6617: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:08.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:29:07 gibba015 bash[30343]: cluster 2021-03-10T17:29:06.639703+0000 mgr.gibba045.orlgmj (mgr.34412) 11612 : cluster [DBG] pgmap v6617: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:09.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:29:08 gibba015 bash[29377]: cluster 2021-03-10T17:29:08.641276+0000 mgr.gibba045.orlgmj (mgr.34412) 11613 : cluster [DBG] pgmap v6618: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:09.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:29:08 gibba015 bash[30343]: cluster 2021-03-10T17:29:08.641276+0000 mgr.gibba045.orlgmj (mgr.34412) 11613 : cluster [DBG] pgmap v6618: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:09.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:29:08 gibba045 bash[25517]: cluster 2021-03-10T17:29:08.641276+0000 mgr.gibba045.orlgmj (mgr.34412) 11613 : cluster [DBG] pgmap v6618: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:11.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:29:11 gibba015 bash[29377]: cluster 2021-03-10T17:29:10.642975+0000 mgr.gibba045.orlgmj (mgr.34412) 11614 : cluster [DBG] pgmap v6619: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:11.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:29:11 gibba015 bash[30343]: cluster 2021-03-10T17:29:10.642975+0000 mgr.gibba045.orlgmj (mgr.34412) 11614 : cluster [DBG] pgmap v6619: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:12.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:29:11 gibba045 bash[25517]: cluster 2021-03-10T17:29:10.642975+0000 mgr.gibba045.orlgmj (mgr.34412) 11614 : cluster [DBG] pgmap v6619: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:13.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:29:13 gibba015 bash[29377]: cluster 2021-03-10T17:29:12.644652+0000 mgr.gibba045.orlgmj (mgr.34412) 11615 : cluster [DBG] pgmap v6620: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:13.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:29:13 gibba015 bash[30343]: cluster 2021-03-10T17:29:12.644652+0000 mgr.gibba045.orlgmj (mgr.34412) 11615 : cluster [DBG] pgmap v6620: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:14.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:29:13 gibba045 bash[25517]: cluster 2021-03-10T17:29:12.644652+0000 mgr.gibba045.orlgmj (mgr.34412) 11615 : cluster [DBG] pgmap v6620: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:16.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:29:15 gibba045 bash[25517]: cluster 2021-03-10T17:29:14.645598+0000 mgr.gibba045.orlgmj (mgr.34412) 11616 : cluster [DBG] pgmap v6621: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:16.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:29:15 gibba015 bash[29377]: cluster 2021-03-10T17:29:14.645598+0000 mgr.gibba045.orlgmj (mgr.34412) 11616 : cluster [DBG] pgmap v6621: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:16.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:29:15 gibba015 bash[30343]: cluster 2021-03-10T17:29:14.645598+0000 mgr.gibba045.orlgmj (mgr.34412) 11616 : cluster [DBG] pgmap v6621: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:18.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:29:17 gibba045 bash[25517]: cluster 2021-03-10T17:29:16.647354+0000 mgr.gibba045.orlgmj (mgr.34412) 11617 : cluster [DBG] pgmap v6622: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:18.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:29:17 gibba015 bash[29377]: cluster 2021-03-10T17:29:16.647354+0000 mgr.gibba045.orlgmj (mgr.34412) 11617 : cluster [DBG] pgmap v6622: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:18.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:29:17 gibba015 bash[30343]: cluster 2021-03-10T17:29:16.647354+0000 mgr.gibba045.orlgmj (mgr.34412) 11617 : cluster [DBG] pgmap v6622: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:19.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:29:18 gibba015 bash[29377]: cluster 2021-03-10T17:29:18.648863+0000 mgr.gibba045.orlgmj (mgr.34412) 11618 : cluster [DBG] pgmap v6623: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:19.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:29:18 gibba015 bash[30343]: cluster 2021-03-10T17:29:18.648863+0000 mgr.gibba045.orlgmj (mgr.34412) 11618 : cluster [DBG] pgmap v6623: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:19.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:29:18 gibba045 bash[25517]: cluster 2021-03-10T17:29:18.648863+0000 mgr.gibba045.orlgmj (mgr.34412) 11618 : cluster [DBG] pgmap v6623: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:20.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:29:19 gibba045 bash[25517]: cephadm 2021-03-10T17:29:19.053164+0000 mgr.gibba045.orlgmj (mgr.34412) 11619 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:29:20.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:29:19 gibba015 bash[29377]: cephadm 2021-03-10T17:29:19.053164+0000 mgr.gibba045.orlgmj (mgr.34412) 11619 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:29:20.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:29:19 gibba015 bash[30343]: cephadm 2021-03-10T17:29:19.053164+0000 mgr.gibba045.orlgmj (mgr.34412) 11619 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:29:20.835 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:29:21.064 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:29:21.065 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 96s ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:29:21.065 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 32s ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:29:21.065 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 32s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:29:21.065 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 32s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:29:21.066 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 96s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:29:21.066 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 96s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:29:21.066 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 32s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:29:21.066 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 96s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:29:21.067 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 96s ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:29:21.067 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 32s ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:29:21.067 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 96s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:29:21.068 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 96s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:29:21.068 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 96s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:29:21.068 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 96s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:29:21.068 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 32s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:29:21.069 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 32s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:29:21.069 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 32s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:29:21.069 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 32s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:29:21.069 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 32s ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:29:21.070 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 32s ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:29:21.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:29:20 gibba045 bash[25517]: cluster 2021-03-10T17:29:20.650533+0000 mgr.gibba045.orlgmj (mgr.34412) 11620 : cluster [DBG] pgmap v6624: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:21.314 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:29:21.315 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:29:21.315 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:29:21.315 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:29:21.315 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:29:21.316 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:29:21.316 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:29:21.316 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:29:21.316 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:29:21.317 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:29:21.317 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:29:21.317 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:29:21.317 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:29:21.317 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:29:21.318 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:29:21.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:29:20 gibba015 bash[29377]: cluster 2021-03-10T17:29:20.650533+0000 mgr.gibba045.orlgmj (mgr.34412) 11620 : cluster [DBG] pgmap v6624: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:21.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:29:20 gibba015 bash[30343]: cluster 2021-03-10T17:29:20.650533+0000 mgr.gibba045.orlgmj (mgr.34412) 11620 : cluster [DBG] pgmap v6624: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:22.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:29:21 gibba045 bash[25517]: audit 2021-03-10T17:29:20.825962+0000 mgr.gibba045.orlgmj (mgr.34412) 11621 : audit [DBG] from='client.51846 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:29:22.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:29:21 gibba045 bash[25517]: audit 2021-03-10T17:29:21.052560+0000 mgr.gibba045.orlgmj (mgr.34412) 11622 : audit [DBG] from='client.61840 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:29:22.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:29:21 gibba045 bash[25517]: audit 2021-03-10T17:29:21.312973+0000 mon.c (mon.1) 3186 : audit [DBG] from='client.? 172.21.2.115:0/580456947' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:29:22.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:29:21 gibba015 bash[29377]: audit 2021-03-10T17:29:20.825962+0000 mgr.gibba045.orlgmj (mgr.34412) 11621 : audit [DBG] from='client.51846 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:29:22.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:29:21 gibba015 bash[29377]: audit 2021-03-10T17:29:21.052560+0000 mgr.gibba045.orlgmj (mgr.34412) 11622 : audit [DBG] from='client.61840 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:29:22.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:29:21 gibba015 bash[29377]: audit 2021-03-10T17:29:21.312973+0000 mon.c (mon.1) 3186 : audit [DBG] from='client.? 172.21.2.115:0/580456947' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:29:22.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:29:21 gibba015 bash[30343]: audit 2021-03-10T17:29:20.825962+0000 mgr.gibba045.orlgmj (mgr.34412) 11621 : audit [DBG] from='client.51846 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:29:22.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:29:21 gibba015 bash[30343]: audit 2021-03-10T17:29:21.052560+0000 mgr.gibba045.orlgmj (mgr.34412) 11622 : audit [DBG] from='client.61840 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:29:22.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:29:21 gibba015 bash[30343]: audit 2021-03-10T17:29:21.312973+0000 mon.c (mon.1) 3186 : audit [DBG] from='client.? 172.21.2.115:0/580456947' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:29:23.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:29:22 gibba045 bash[25517]: cluster 2021-03-10T17:29:22.652071+0000 mgr.gibba045.orlgmj (mgr.34412) 11623 : cluster [DBG] pgmap v6625: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:23.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:29:22 gibba015 bash[29377]: cluster 2021-03-10T17:29:22.652071+0000 mgr.gibba045.orlgmj (mgr.34412) 11623 : cluster [DBG] pgmap v6625: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:23.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:29:22 gibba015 bash[30343]: cluster 2021-03-10T17:29:22.652071+0000 mgr.gibba045.orlgmj (mgr.34412) 11623 : cluster [DBG] pgmap v6625: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:25.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:29:25 gibba015 bash[29377]: cluster 2021-03-10T17:29:24.652876+0000 mgr.gibba045.orlgmj (mgr.34412) 11624 : cluster [DBG] pgmap v6626: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:25.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:29:25 gibba015 bash[30343]: cluster 2021-03-10T17:29:24.652876+0000 mgr.gibba045.orlgmj (mgr.34412) 11624 : cluster [DBG] pgmap v6626: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:26.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:29:25 gibba045 bash[25517]: cluster 2021-03-10T17:29:24.652876+0000 mgr.gibba045.orlgmj (mgr.34412) 11624 : cluster [DBG] pgmap v6626: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:28.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:29:27 gibba045 bash[25517]: cluster 2021-03-10T17:29:26.654632+0000 mgr.gibba045.orlgmj (mgr.34412) 11625 : cluster [DBG] pgmap v6627: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:28.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:29:27 gibba015 bash[29377]: cluster 2021-03-10T17:29:26.654632+0000 mgr.gibba045.orlgmj (mgr.34412) 11625 : cluster [DBG] pgmap v6627: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:28.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:29:27 gibba015 bash[30343]: cluster 2021-03-10T17:29:26.654632+0000 mgr.gibba045.orlgmj (mgr.34412) 11625 : cluster [DBG] pgmap v6627: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:29.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:29:28 gibba045 bash[25517]: cluster 2021-03-10T17:29:28.655838+0000 mgr.gibba045.orlgmj (mgr.34412) 11626 : cluster [DBG] pgmap v6628: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:29.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:29:28 gibba015 bash[29377]: cluster 2021-03-10T17:29:28.655838+0000 mgr.gibba045.orlgmj (mgr.34412) 11626 : cluster [DBG] pgmap v6628: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:29.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:29:28 gibba015 bash[30343]: cluster 2021-03-10T17:29:28.655838+0000 mgr.gibba045.orlgmj (mgr.34412) 11626 : cluster [DBG] pgmap v6628: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:31.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:29:31 gibba015 bash[29377]: cluster 2021-03-10T17:29:30.657628+0000 mgr.gibba045.orlgmj (mgr.34412) 11627 : cluster [DBG] pgmap v6629: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:31.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:29:31 gibba015 bash[30343]: cluster 2021-03-10T17:29:30.657628+0000 mgr.gibba045.orlgmj (mgr.34412) 11627 : cluster [DBG] pgmap v6629: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:32.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:29:31 gibba045 bash[25517]: cluster 2021-03-10T17:29:30.657628+0000 mgr.gibba045.orlgmj (mgr.34412) 11627 : cluster [DBG] pgmap v6629: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:34.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:29:33 gibba045 bash[25517]: cluster 2021-03-10T17:29:32.659184+0000 mgr.gibba045.orlgmj (mgr.34412) 11628 : cluster [DBG] pgmap v6630: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:34.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:29:33 gibba015 bash[29377]: cluster 2021-03-10T17:29:32.659184+0000 mgr.gibba045.orlgmj (mgr.34412) 11628 : cluster [DBG] pgmap v6630: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:34.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:29:33 gibba015 bash[30343]: cluster 2021-03-10T17:29:32.659184+0000 mgr.gibba045.orlgmj (mgr.34412) 11628 : cluster [DBG] pgmap v6630: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:36.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:29:35 gibba045 bash[25517]: cephadm 2021-03-10T17:29:34.068469+0000 mgr.gibba045.orlgmj (mgr.34412) 11629 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:29:36.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:29:35 gibba045 bash[25517]: cluster 2021-03-10T17:29:34.660540+0000 mgr.gibba045.orlgmj (mgr.34412) 11630 : cluster [DBG] pgmap v6631: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:36.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:29:35 gibba015 bash[29377]: cephadm 2021-03-10T17:29:34.068469+0000 mgr.gibba045.orlgmj (mgr.34412) 11629 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:29:36.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:29:35 gibba015 bash[29377]: cluster 2021-03-10T17:29:34.660540+0000 mgr.gibba045.orlgmj (mgr.34412) 11630 : cluster [DBG] pgmap v6631: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:36.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:29:35 gibba015 bash[30343]: cephadm 2021-03-10T17:29:34.068469+0000 mgr.gibba045.orlgmj (mgr.34412) 11629 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:29:36.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:29:35 gibba015 bash[30343]: cluster 2021-03-10T17:29:34.660540+0000 mgr.gibba045.orlgmj (mgr.34412) 11630 : cluster [DBG] pgmap v6631: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:38.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:29:37 gibba045 bash[25517]: cluster 2021-03-10T17:29:36.662517+0000 mgr.gibba045.orlgmj (mgr.34412) 11631 : cluster [DBG] pgmap v6632: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:38.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:29:37 gibba015 bash[30343]: cluster 2021-03-10T17:29:36.662517+0000 mgr.gibba045.orlgmj (mgr.34412) 11631 : cluster [DBG] pgmap v6632: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:38.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:29:37 gibba015 bash[29377]: cluster 2021-03-10T17:29:36.662517+0000 mgr.gibba045.orlgmj (mgr.34412) 11631 : cluster [DBG] pgmap v6632: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:39.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:29:38 gibba045 bash[25517]: cluster 2021-03-10T17:29:38.663546+0000 mgr.gibba045.orlgmj (mgr.34412) 11632 : cluster [DBG] pgmap v6633: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:39.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:29:38 gibba015 bash[29377]: cluster 2021-03-10T17:29:38.663546+0000 mgr.gibba045.orlgmj (mgr.34412) 11632 : cluster [DBG] pgmap v6633: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:39.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:29:38 gibba015 bash[30343]: cluster 2021-03-10T17:29:38.663546+0000 mgr.gibba045.orlgmj (mgr.34412) 11632 : cluster [DBG] pgmap v6633: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:42.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:29:41 gibba045 bash[25517]: cluster 2021-03-10T17:29:40.665338+0000 mgr.gibba045.orlgmj (mgr.34412) 11633 : cluster [DBG] pgmap v6634: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:42.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:29:41 gibba015 bash[29377]: cluster 2021-03-10T17:29:40.665338+0000 mgr.gibba045.orlgmj (mgr.34412) 11633 : cluster [DBG] pgmap v6634: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:42.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:29:41 gibba015 bash[30343]: cluster 2021-03-10T17:29:40.665338+0000 mgr.gibba045.orlgmj (mgr.34412) 11633 : cluster [DBG] pgmap v6634: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:44.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:29:43 gibba045 bash[25517]: cluster 2021-03-10T17:29:42.667013+0000 mgr.gibba045.orlgmj (mgr.34412) 11634 : cluster [DBG] pgmap v6635: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:44.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:29:43 gibba015 bash[29377]: cluster 2021-03-10T17:29:42.667013+0000 mgr.gibba045.orlgmj (mgr.34412) 11634 : cluster [DBG] pgmap v6635: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:44.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:29:43 gibba015 bash[30343]: cluster 2021-03-10T17:29:42.667013+0000 mgr.gibba045.orlgmj (mgr.34412) 11634 : cluster [DBG] pgmap v6635: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:46.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:29:45 gibba045 bash[25517]: cluster 2021-03-10T17:29:44.667826+0000 mgr.gibba045.orlgmj (mgr.34412) 11635 : cluster [DBG] pgmap v6636: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:46.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:29:45 gibba015 bash[29377]: cluster 2021-03-10T17:29:44.667826+0000 mgr.gibba045.orlgmj (mgr.34412) 11635 : cluster [DBG] pgmap v6636: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:46.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:29:45 gibba015 bash[30343]: cluster 2021-03-10T17:29:44.667826+0000 mgr.gibba045.orlgmj (mgr.34412) 11635 : cluster [DBG] pgmap v6636: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:48.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:29:47 gibba045 bash[25517]: cluster 2021-03-10T17:29:46.669525+0000 mgr.gibba045.orlgmj (mgr.34412) 11636 : cluster [DBG] pgmap v6637: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:48.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:29:47 gibba015 bash[29377]: cluster 2021-03-10T17:29:46.669525+0000 mgr.gibba045.orlgmj (mgr.34412) 11636 : cluster [DBG] pgmap v6637: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:48.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:29:47 gibba015 bash[30343]: cluster 2021-03-10T17:29:46.669525+0000 mgr.gibba045.orlgmj (mgr.34412) 11636 : cluster [DBG] pgmap v6637: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:49.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:29:48 gibba045 bash[25517]: cluster 2021-03-10T17:29:48.670747+0000 mgr.gibba045.orlgmj (mgr.34412) 11637 : cluster [DBG] pgmap v6638: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:49.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:29:48 gibba015 bash[29377]: cluster 2021-03-10T17:29:48.670747+0000 mgr.gibba045.orlgmj (mgr.34412) 11637 : cluster [DBG] pgmap v6638: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:49.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:29:48 gibba015 bash[30343]: cluster 2021-03-10T17:29:48.670747+0000 mgr.gibba045.orlgmj (mgr.34412) 11637 : cluster [DBG] pgmap v6638: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:50.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:29:49 gibba045 bash[25517]: audit 2021-03-10T17:29:49.079989+0000 mon.c (mon.1) 3187 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:29:50.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:29:49 gibba045 bash[25517]: cephadm 2021-03-10T17:29:49.087288+0000 mgr.gibba045.orlgmj (mgr.34412) 11638 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:29:50.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:29:49 gibba045 bash[25517]: cephadm 2021-03-10T17:29:49.089100+0000 mgr.gibba045.orlgmj (mgr.34412) 11639 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:29:50.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:29:49 gibba045 bash[25517]: audit 2021-03-10T17:29:49.341234+0000 mon.a (mon.0) 2430 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:29:50.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:29:49 gibba045 bash[25517]: audit 2021-03-10T17:29:49.344954+0000 mon.c (mon.1) 3188 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:29:50.312 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:29:49 gibba045 bash[25517]: cephadm 2021-03-10T17:29:49.346086+0000 mgr.gibba045.orlgmj (mgr.34412) 11640 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:29:50.313 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:29:49 gibba045 bash[25517]: audit 2021-03-10T17:29:49.346348+0000 mon.c (mon.1) 3189 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:29:50.313 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:29:49 gibba045 bash[25517]: audit 2021-03-10T17:29:49.347837+0000 mon.c (mon.1) 3190 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:29:50.314 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:29:49 gibba045 bash[25517]: cephadm 2021-03-10T17:29:49.347907+0000 mgr.gibba045.orlgmj (mgr.34412) 11641 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:29:50.315 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:29:49 gibba045 bash[25517]: audit 2021-03-10T17:29:49.349131+0000 mon.c (mon.1) 3191 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:29:50.315 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:29:49 gibba045 bash[25517]: cephadm 2021-03-10T17:29:49.349293+0000 mgr.gibba045.orlgmj (mgr.34412) 11642 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:29:50.316 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:29:49 gibba045 bash[25517]: cephadm 2021-03-10T17:29:49.349331+0000 mgr.gibba045.orlgmj (mgr.34412) 11643 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:29:50.316 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:29:49 gibba045 bash[25517]: cephadm 2021-03-10T17:29:49.350537+0000 mgr.gibba045.orlgmj (mgr.34412) 11644 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:29:50.317 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:29:49 gibba045 bash[25517]: cephadm 2021-03-10T17:29:49.350576+0000 mgr.gibba045.orlgmj (mgr.34412) 11645 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:29:50.317 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:29:49 gibba045 bash[25517]: cephadm 2021-03-10T17:29:49.352033+0000 mgr.gibba045.orlgmj (mgr.34412) 11646 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:29:50.318 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:29:49 gibba045 bash[25517]: audit 2021-03-10T17:29:49.352344+0000 mon.c (mon.1) 3192 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:29:50.318 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:29:49 gibba045 bash[25517]: cephadm 2021-03-10T17:29:49.353809+0000 mgr.gibba045.orlgmj (mgr.34412) 11647 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:29:50.319 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:29:49 gibba045 bash[25517]: cephadm 2021-03-10T17:29:49.353848+0000 mgr.gibba045.orlgmj (mgr.34412) 11648 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:29:50.319 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:29:49 gibba045 bash[25517]: audit 2021-03-10T17:29:49.354363+0000 mon.c (mon.1) 3193 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:29:50.320 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:29:49 gibba045 bash[25517]: cephadm 2021-03-10T17:29:49.355272+0000 mgr.gibba045.orlgmj (mgr.34412) 11649 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:29:50.320 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:29:49 gibba045 bash[25517]: cephadm 2021-03-10T17:29:49.355610+0000 mgr.gibba045.orlgmj (mgr.34412) 11650 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:29:50.321 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:29:49 gibba045 bash[25517]: cephadm 2021-03-10T17:29:49.357358+0000 mgr.gibba045.orlgmj (mgr.34412) 11651 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:29:50.321 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:29:49 gibba045 bash[25517]: cephadm 2021-03-10T17:29:49.357400+0000 mgr.gibba045.orlgmj (mgr.34412) 11652 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:29:50.322 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:29:49 gibba045 bash[25517]: cephadm 2021-03-10T17:29:49.357526+0000 mgr.gibba045.orlgmj (mgr.34412) 11653 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:29:50.479 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:29:49 gibba015 bash[29377]: audit 2021-03-10T17:29:49.079989+0000 mon.c (mon.1) 3187 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:29:50.480 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:29:49 gibba015 bash[29377]: cephadm 2021-03-10T17:29:49.087288+0000 mgr.gibba045.orlgmj (mgr.34412) 11638 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:29:50.481 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:29:49 gibba015 bash[29377]: cephadm 2021-03-10T17:29:49.089100+0000 mgr.gibba045.orlgmj (mgr.34412) 11639 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:29:50.483 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:29:49 gibba015 bash[29377]: audit 2021-03-10T17:29:49.341234+0000 mon.a (mon.0) 2430 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:29:50.484 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:29:49 gibba015 bash[29377]: audit 2021-03-10T17:29:49.344954+0000 mon.c (mon.1) 3188 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:29:50.485 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:29:49 gibba015 bash[29377]: cephadm 2021-03-10T17:29:49.346086+0000 mgr.gibba045.orlgmj (mgr.34412) 11640 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:29:50.485 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:29:49 gibba015 bash[29377]: audit 2021-03-10T17:29:49.346348+0000 mon.c (mon.1) 3189 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:29:50.486 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:29:49 gibba015 bash[29377]: audit 2021-03-10T17:29:49.347837+0000 mon.c (mon.1) 3190 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:29:50.488 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:29:49 gibba015 bash[29377]: cephadm 2021-03-10T17:29:49.347907+0000 mgr.gibba045.orlgmj (mgr.34412) 11641 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:29:50.488 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:29:49 gibba015 bash[29377]: audit 2021-03-10T17:29:49.349131+0000 mon.c (mon.1) 3191 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:29:50.490 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:29:49 gibba015 bash[29377]: cephadm 2021-03-10T17:29:49.349293+0000 mgr.gibba045.orlgmj (mgr.34412) 11642 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:29:50.492 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:29:49 gibba015 bash[29377]: cephadm 2021-03-10T17:29:49.349331+0000 mgr.gibba045.orlgmj (mgr.34412) 11643 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:29:50.494 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:29:49 gibba015 bash[29377]: cephadm 2021-03-10T17:29:49.350537+0000 mgr.gibba045.orlgmj (mgr.34412) 11644 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:29:50.494 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:29:49 gibba015 bash[29377]: cephadm 2021-03-10T17:29:49.350576+0000 mgr.gibba045.orlgmj (mgr.34412) 11645 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:29:50.494 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:29:49 gibba015 bash[29377]: cephadm 2021-03-10T17:29:49.352033+0000 mgr.gibba045.orlgmj (mgr.34412) 11646 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:29:50.494 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:29:49 gibba015 bash[29377]: audit 2021-03-10T17:29:49.352344+0000 mon.c (mon.1) 3192 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:29:50.495 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:29:49 gibba015 bash[29377]: cephadm 2021-03-10T17:29:49.353809+0000 mgr.gibba045.orlgmj (mgr.34412) 11647 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:29:50.495 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:29:49 gibba015 bash[29377]: cephadm 2021-03-10T17:29:49.353848+0000 mgr.gibba045.orlgmj (mgr.34412) 11648 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:29:50.495 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:29:49 gibba015 bash[29377]: audit 2021-03-10T17:29:49.354363+0000 mon.c (mon.1) 3193 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:29:50.495 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:29:49 gibba015 bash[29377]: cephadm 2021-03-10T17:29:49.355272+0000 mgr.gibba045.orlgmj (mgr.34412) 11649 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:29:50.495 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:29:49 gibba015 bash[29377]: cephadm 2021-03-10T17:29:49.355610+0000 mgr.gibba045.orlgmj (mgr.34412) 11650 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:29:50.496 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:29:49 gibba015 bash[29377]: cephadm 2021-03-10T17:29:49.357358+0000 mgr.gibba045.orlgmj (mgr.34412) 11651 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:29:50.496 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:29:49 gibba015 bash[29377]: cephadm 2021-03-10T17:29:49.357400+0000 mgr.gibba045.orlgmj (mgr.34412) 11652 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:29:50.496 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:29:49 gibba015 bash[29377]: cephadm 2021-03-10T17:29:49.357526+0000 mgr.gibba045.orlgmj (mgr.34412) 11653 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:29:50.497 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:29:49 gibba015 bash[30343]: audit 2021-03-10T17:29:49.079989+0000 mon.c (mon.1) 3187 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:29:50.497 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:29:49 gibba015 bash[30343]: cephadm 2021-03-10T17:29:49.087288+0000 mgr.gibba045.orlgmj (mgr.34412) 11638 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:29:50.497 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:29:49 gibba015 bash[30343]: cephadm 2021-03-10T17:29:49.089100+0000 mgr.gibba045.orlgmj (mgr.34412) 11639 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:29:50.497 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:29:49 gibba015 bash[30343]: audit 2021-03-10T17:29:49.341234+0000 mon.a (mon.0) 2430 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:29:50.498 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:29:49 gibba015 bash[30343]: audit 2021-03-10T17:29:49.344954+0000 mon.c (mon.1) 3188 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:29:50.498 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:29:49 gibba015 bash[30343]: cephadm 2021-03-10T17:29:49.346086+0000 mgr.gibba045.orlgmj (mgr.34412) 11640 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:29:50.498 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:29:49 gibba015 bash[30343]: audit 2021-03-10T17:29:49.346348+0000 mon.c (mon.1) 3189 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:29:50.498 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:29:49 gibba015 bash[30343]: audit 2021-03-10T17:29:49.347837+0000 mon.c (mon.1) 3190 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:29:50.499 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:29:49 gibba015 bash[30343]: cephadm 2021-03-10T17:29:49.347907+0000 mgr.gibba045.orlgmj (mgr.34412) 11641 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:29:50.499 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:29:49 gibba015 bash[30343]: audit 2021-03-10T17:29:49.349131+0000 mon.c (mon.1) 3191 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:29:50.500 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:29:49 gibba015 bash[30343]: cephadm 2021-03-10T17:29:49.349293+0000 mgr.gibba045.orlgmj (mgr.34412) 11642 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:29:50.500 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:29:49 gibba015 bash[30343]: cephadm 2021-03-10T17:29:49.349331+0000 mgr.gibba045.orlgmj (mgr.34412) 11643 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:29:50.500 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:29:49 gibba015 bash[30343]: cephadm 2021-03-10T17:29:49.350537+0000 mgr.gibba045.orlgmj (mgr.34412) 11644 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:29:50.500 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:29:49 gibba015 bash[30343]: cephadm 2021-03-10T17:29:49.350576+0000 mgr.gibba045.orlgmj (mgr.34412) 11645 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:29:50.501 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:29:49 gibba015 bash[30343]: cephadm 2021-03-10T17:29:49.352033+0000 mgr.gibba045.orlgmj (mgr.34412) 11646 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:29:50.501 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:29:49 gibba015 bash[30343]: audit 2021-03-10T17:29:49.352344+0000 mon.c (mon.1) 3192 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:29:50.501 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:29:49 gibba015 bash[30343]: cephadm 2021-03-10T17:29:49.353809+0000 mgr.gibba045.orlgmj (mgr.34412) 11647 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:29:50.501 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:29:49 gibba015 bash[30343]: cephadm 2021-03-10T17:29:49.353848+0000 mgr.gibba045.orlgmj (mgr.34412) 11648 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:29:50.502 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:29:49 gibba015 bash[30343]: audit 2021-03-10T17:29:49.354363+0000 mon.c (mon.1) 3193 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:29:50.502 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:29:49 gibba015 bash[30343]: cephadm 2021-03-10T17:29:49.355272+0000 mgr.gibba045.orlgmj (mgr.34412) 11649 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:29:50.502 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:29:49 gibba015 bash[30343]: cephadm 2021-03-10T17:29:49.355610+0000 mgr.gibba045.orlgmj (mgr.34412) 11650 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:29:50.502 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:29:49 gibba015 bash[30343]: cephadm 2021-03-10T17:29:49.357358+0000 mgr.gibba045.orlgmj (mgr.34412) 11651 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:29:50.503 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:29:49 gibba015 bash[30343]: cephadm 2021-03-10T17:29:49.357400+0000 mgr.gibba045.orlgmj (mgr.34412) 11652 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:29:50.503 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:29:49 gibba015 bash[30343]: cephadm 2021-03-10T17:29:49.357526+0000 mgr.gibba045.orlgmj (mgr.34412) 11653 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:29:51.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:29:51 gibba045 bash[25517]: cluster 2021-03-10T17:29:50.672314+0000 mgr.gibba045.orlgmj (mgr.34412) 11654 : cluster [DBG] pgmap v6639: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:51.471 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:29:51 gibba015 bash[29377]: cluster 2021-03-10T17:29:50.672314+0000 mgr.gibba045.orlgmj (mgr.34412) 11654 : cluster [DBG] pgmap v6639: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:51.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:29:51 gibba015 bash[30343]: cluster 2021-03-10T17:29:50.672314+0000 mgr.gibba045.orlgmj (mgr.34412) 11654 : cluster [DBG] pgmap v6639: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:51.558 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:29:51.787 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:29:51.788 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 2m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:29:51.788 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 63s ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:29:51.788 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 63s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:29:51.788 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 63s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:29:51.789 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:29:51.789 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:29:51.789 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 63s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:29:51.789 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:29:51.790 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 2m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:29:51.790 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 63s ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:29:51.790 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:29:51.790 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:29:51.791 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:29:51.791 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:29:51.791 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 63s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:29:51.791 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 63s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:29:51.791 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 63s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:29:51.792 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 63s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:29:51.792 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 63s ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:29:51.792 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 63s ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:29:52.037 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:29:52.037 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:29:52.038 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:29:52.038 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:29:52.038 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:29:52.038 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:29:52.039 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:29:52.039 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:29:52.039 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:29:52.039 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:29:52.040 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:29:52.040 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:29:52.040 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:29:52.040 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:29:52.040 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:29:52.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:29:52 gibba045 bash[25517]: audit 2021-03-10T17:29:51.548949+0000 mgr.gibba045.orlgmj (mgr.34412) 11655 : audit [DBG] from='client.51864 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:29:52.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:29:52 gibba045 bash[25517]: audit 2021-03-10T17:29:51.774998+0000 mgr.gibba045.orlgmj (mgr.34412) 11656 : audit [DBG] from='client.51870 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:29:52.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:29:52 gibba015 bash[29377]: audit 2021-03-10T17:29:51.548949+0000 mgr.gibba045.orlgmj (mgr.34412) 11655 : audit [DBG] from='client.51864 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:29:52.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:29:52 gibba015 bash[29377]: audit 2021-03-10T17:29:51.774998+0000 mgr.gibba045.orlgmj (mgr.34412) 11656 : audit [DBG] from='client.51870 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:29:52.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:29:52 gibba015 bash[30343]: audit 2021-03-10T17:29:51.548949+0000 mgr.gibba045.orlgmj (mgr.34412) 11655 : audit [DBG] from='client.51864 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:29:52.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:29:52 gibba015 bash[30343]: audit 2021-03-10T17:29:51.774998+0000 mgr.gibba045.orlgmj (mgr.34412) 11656 : audit [DBG] from='client.51870 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:29:53.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:29:53 gibba045 bash[25517]: audit 2021-03-10T17:29:52.035488+0000 mon.c (mon.1) 3194 : audit [DBG] from='client.? 172.21.2.115:0/1147742014' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:29:53.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:29:53 gibba045 bash[25517]: cluster 2021-03-10T17:29:52.674027+0000 mgr.gibba045.orlgmj (mgr.34412) 11657 : cluster [DBG] pgmap v6640: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:53.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:29:53 gibba015 bash[29377]: audit 2021-03-10T17:29:52.035488+0000 mon.c (mon.1) 3194 : audit [DBG] from='client.? 172.21.2.115:0/1147742014' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:29:53.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:29:53 gibba015 bash[29377]: cluster 2021-03-10T17:29:52.674027+0000 mgr.gibba045.orlgmj (mgr.34412) 11657 : cluster [DBG] pgmap v6640: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:53.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:29:53 gibba015 bash[30343]: audit 2021-03-10T17:29:52.035488+0000 mon.c (mon.1) 3194 : audit [DBG] from='client.? 172.21.2.115:0/1147742014' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:29:53.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:29:53 gibba015 bash[30343]: cluster 2021-03-10T17:29:52.674027+0000 mgr.gibba045.orlgmj (mgr.34412) 11657 : cluster [DBG] pgmap v6640: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:54.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:29:54 gibba015 bash[29377]: audit 2021-03-10T17:29:54.086828+0000 mon.c (mon.1) 3195 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:29:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:29:54 gibba015 bash[29377]: audit 2021-03-10T17:29:54.087509+0000 mon.c (mon.1) 3196 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:29:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:29:54 gibba015 bash[29377]: audit 2021-03-10T17:29:54.087957+0000 mon.a (mon.0) 2431 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:29:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:29:54 gibba015 bash[29377]: audit 2021-03-10T17:29:54.089126+0000 mon.a (mon.0) 2432 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:29:54.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:29:54 gibba015 bash[30343]: audit 2021-03-10T17:29:54.086828+0000 mon.c (mon.1) 3195 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:29:54.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:29:54 gibba015 bash[30343]: audit 2021-03-10T17:29:54.087509+0000 mon.c (mon.1) 3196 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:29:54.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:29:54 gibba015 bash[30343]: audit 2021-03-10T17:29:54.087957+0000 mon.a (mon.0) 2431 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:29:54.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:29:54 gibba015 bash[30343]: audit 2021-03-10T17:29:54.089126+0000 mon.a (mon.0) 2432 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:29:54.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:29:54 gibba045 bash[25517]: audit 2021-03-10T17:29:54.086828+0000 mon.c (mon.1) 3195 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:29:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:29:54 gibba045 bash[25517]: audit 2021-03-10T17:29:54.087509+0000 mon.c (mon.1) 3196 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:29:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:29:54 gibba045 bash[25517]: audit 2021-03-10T17:29:54.087957+0000 mon.a (mon.0) 2431 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:29:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:29:54 gibba045 bash[25517]: audit 2021-03-10T17:29:54.089126+0000 mon.a (mon.0) 2432 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:29:55.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:29:55 gibba015 bash[29377]: audit 2021-03-10T17:29:54.184516+0000 mon.c (mon.1) 3197 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T17:29:55.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:29:55 gibba015 bash[29377]: audit 2021-03-10T17:29:54.184742+0000 mon.c (mon.1) 3198 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:29:55.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:29:55 gibba015 bash[29377]: audit 2021-03-10T17:29:54.184936+0000 mon.c (mon.1) 3199 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:29:55.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:29:55 gibba015 bash[29377]: audit 2021-03-10T17:29:54.185038+0000 mon.a (mon.0) 2433 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T17:29:55.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:29:55 gibba015 bash[29377]: audit 2021-03-10T17:29:54.185142+0000 mon.c (mon.1) 3200 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:29:55.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:29:55 gibba015 bash[29377]: audit 2021-03-10T17:29:54.185437+0000 mon.a (mon.0) 2434 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:29:55.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:29:55 gibba015 bash[29377]: audit 2021-03-10T17:29:54.185707+0000 mon.a (mon.0) 2435 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:29:55.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:29:55 gibba015 bash[29377]: audit 2021-03-10T17:29:54.185919+0000 mon.a (mon.0) 2436 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:29:55.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:29:55 gibba015 bash[29377]: cluster 2021-03-10T17:29:54.674803+0000 mgr.gibba045.orlgmj (mgr.34412) 11658 : cluster [DBG] pgmap v6641: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:55.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:29:55 gibba015 bash[30343]: audit 2021-03-10T17:29:54.184516+0000 mon.c (mon.1) 3197 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T17:29:55.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:29:55 gibba015 bash[30343]: audit 2021-03-10T17:29:54.184742+0000 mon.c (mon.1) 3198 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:29:55.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:29:55 gibba015 bash[30343]: audit 2021-03-10T17:29:54.184936+0000 mon.c (mon.1) 3199 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:29:55.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:29:55 gibba015 bash[30343]: audit 2021-03-10T17:29:54.185038+0000 mon.a (mon.0) 2433 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T17:29:55.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:29:55 gibba015 bash[30343]: audit 2021-03-10T17:29:54.185142+0000 mon.c (mon.1) 3200 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:29:55.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:29:55 gibba015 bash[30343]: audit 2021-03-10T17:29:54.185437+0000 mon.a (mon.0) 2434 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:29:55.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:29:55 gibba015 bash[30343]: audit 2021-03-10T17:29:54.185707+0000 mon.a (mon.0) 2435 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:29:55.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:29:55 gibba015 bash[30343]: audit 2021-03-10T17:29:54.185919+0000 mon.a (mon.0) 2436 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:29:55.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:29:55 gibba015 bash[30343]: cluster 2021-03-10T17:29:54.674803+0000 mgr.gibba045.orlgmj (mgr.34412) 11658 : cluster [DBG] pgmap v6641: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:55.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:29:55 gibba045 bash[25517]: audit 2021-03-10T17:29:54.184516+0000 mon.c (mon.1) 3197 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T17:29:55.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:29:55 gibba045 bash[25517]: audit 2021-03-10T17:29:54.184742+0000 mon.c (mon.1) 3198 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:29:55.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:29:55 gibba045 bash[25517]: audit 2021-03-10T17:29:54.184936+0000 mon.c (mon.1) 3199 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:29:55.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:29:55 gibba045 bash[25517]: audit 2021-03-10T17:29:54.185038+0000 mon.a (mon.0) 2433 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T17:29:55.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:29:55 gibba045 bash[25517]: audit 2021-03-10T17:29:54.185142+0000 mon.c (mon.1) 3200 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:29:55.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:29:55 gibba045 bash[25517]: audit 2021-03-10T17:29:54.185437+0000 mon.a (mon.0) 2434 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:29:55.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:29:55 gibba045 bash[25517]: audit 2021-03-10T17:29:54.185707+0000 mon.a (mon.0) 2435 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:29:55.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:29:55 gibba045 bash[25517]: audit 2021-03-10T17:29:54.185919+0000 mon.a (mon.0) 2436 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:29:55.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:29:55 gibba045 bash[25517]: cluster 2021-03-10T17:29:54.674803+0000 mgr.gibba045.orlgmj (mgr.34412) 11658 : cluster [DBG] pgmap v6641: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:58.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:29:57 gibba045 bash[25517]: cluster 2021-03-10T17:29:56.676597+0000 mgr.gibba045.orlgmj (mgr.34412) 11659 : cluster [DBG] pgmap v6642: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:58.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:29:57 gibba015 bash[29377]: cluster 2021-03-10T17:29:56.676597+0000 mgr.gibba045.orlgmj (mgr.34412) 11659 : cluster [DBG] pgmap v6642: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:58.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:29:57 gibba015 bash[30343]: cluster 2021-03-10T17:29:56.676597+0000 mgr.gibba045.orlgmj (mgr.34412) 11659 : cluster [DBG] pgmap v6642: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:59.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:29:58 gibba045 bash[25517]: cluster 2021-03-10T17:29:58.677610+0000 mgr.gibba045.orlgmj (mgr.34412) 11660 : cluster [DBG] pgmap v6643: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:59.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:29:58 gibba015 bash[29377]: cluster 2021-03-10T17:29:58.677610+0000 mgr.gibba045.orlgmj (mgr.34412) 11660 : cluster [DBG] pgmap v6643: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:59.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:29:58 gibba015 bash[30343]: cluster 2021-03-10T17:29:58.677610+0000 mgr.gibba045.orlgmj (mgr.34412) 11660 : cluster [DBG] pgmap v6643: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:00.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:30:00 gibba045 bash[25517]: cluster 2021-03-10T17:30:00.000190+0000 mon.a (mon.0) 2437 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T17:30:00.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:30:00 gibba015 bash[29377]: debug 2021-03-10T17:29:59.996+0000 7f21beb4f700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T17:30:00.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:30:00 gibba015 bash[29377]: cluster 2021-03-10T17:30:00.000190+0000 mon.a (mon.0) 2437 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T17:30:00.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:30:00 gibba015 bash[30343]: cluster 2021-03-10T17:30:00.000190+0000 mon.a (mon.0) 2437 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T17:30:01.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:30:01 gibba015 bash[29377]: cluster 2021-03-10T17:30:00.679263+0000 mgr.gibba045.orlgmj (mgr.34412) 11661 : cluster [DBG] pgmap v6644: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:01.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:30:01 gibba015 bash[30343]: cluster 2021-03-10T17:30:00.679263+0000 mgr.gibba045.orlgmj (mgr.34412) 11661 : cluster [DBG] pgmap v6644: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:01.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:30:01 gibba045 bash[25517]: cluster 2021-03-10T17:30:00.679263+0000 mgr.gibba045.orlgmj (mgr.34412) 11661 : cluster [DBG] pgmap v6644: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:04.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:30:03 gibba045 bash[25517]: cluster 2021-03-10T17:30:02.680994+0000 mgr.gibba045.orlgmj (mgr.34412) 11662 : cluster [DBG] pgmap v6645: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:04.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:30:03 gibba015 bash[29377]: cluster 2021-03-10T17:30:02.680994+0000 mgr.gibba045.orlgmj (mgr.34412) 11662 : cluster [DBG] pgmap v6645: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:04.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:30:03 gibba015 bash[30343]: cluster 2021-03-10T17:30:02.680994+0000 mgr.gibba045.orlgmj (mgr.34412) 11662 : cluster [DBG] pgmap v6645: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:06.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:30:05 gibba045 bash[25517]: cephadm 2021-03-10T17:30:04.361219+0000 mgr.gibba045.orlgmj (mgr.34412) 11663 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:30:06.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:30:05 gibba045 bash[25517]: cluster 2021-03-10T17:30:04.681925+0000 mgr.gibba045.orlgmj (mgr.34412) 11664 : cluster [DBG] pgmap v6646: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:06.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:30:05 gibba015 bash[29377]: cephadm 2021-03-10T17:30:04.361219+0000 mgr.gibba045.orlgmj (mgr.34412) 11663 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:30:06.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:30:05 gibba015 bash[29377]: cluster 2021-03-10T17:30:04.681925+0000 mgr.gibba045.orlgmj (mgr.34412) 11664 : cluster [DBG] pgmap v6646: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:06.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:30:05 gibba015 bash[30343]: cephadm 2021-03-10T17:30:04.361219+0000 mgr.gibba045.orlgmj (mgr.34412) 11663 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:30:06.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:30:05 gibba015 bash[30343]: cluster 2021-03-10T17:30:04.681925+0000 mgr.gibba045.orlgmj (mgr.34412) 11664 : cluster [DBG] pgmap v6646: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:08.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:30:07 gibba045 bash[25517]: cluster 2021-03-10T17:30:06.683651+0000 mgr.gibba045.orlgmj (mgr.34412) 11665 : cluster [DBG] pgmap v6647: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:08.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:30:07 gibba015 bash[29377]: cluster 2021-03-10T17:30:06.683651+0000 mgr.gibba045.orlgmj (mgr.34412) 11665 : cluster [DBG] pgmap v6647: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:08.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:30:07 gibba015 bash[30343]: cluster 2021-03-10T17:30:06.683651+0000 mgr.gibba045.orlgmj (mgr.34412) 11665 : cluster [DBG] pgmap v6647: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:09.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:30:08 gibba045 bash[25517]: cluster 2021-03-10T17:30:08.684939+0000 mgr.gibba045.orlgmj (mgr.34412) 11666 : cluster [DBG] pgmap v6648: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:09.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:30:08 gibba015 bash[29377]: cluster 2021-03-10T17:30:08.684939+0000 mgr.gibba045.orlgmj (mgr.34412) 11666 : cluster [DBG] pgmap v6648: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:09.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:30:08 gibba015 bash[30343]: cluster 2021-03-10T17:30:08.684939+0000 mgr.gibba045.orlgmj (mgr.34412) 11666 : cluster [DBG] pgmap v6648: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:12.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:30:11 gibba045 bash[25517]: cluster 2021-03-10T17:30:10.686646+0000 mgr.gibba045.orlgmj (mgr.34412) 11667 : cluster [DBG] pgmap v6649: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:12.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:30:11 gibba015 bash[29377]: cluster 2021-03-10T17:30:10.686646+0000 mgr.gibba045.orlgmj (mgr.34412) 11667 : cluster [DBG] pgmap v6649: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:12.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:30:11 gibba015 bash[30343]: cluster 2021-03-10T17:30:10.686646+0000 mgr.gibba045.orlgmj (mgr.34412) 11667 : cluster [DBG] pgmap v6649: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:14.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:30:13 gibba045 bash[25517]: cluster 2021-03-10T17:30:12.688205+0000 mgr.gibba045.orlgmj (mgr.34412) 11668 : cluster [DBG] pgmap v6650: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:14.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:30:13 gibba015 bash[29377]: cluster 2021-03-10T17:30:12.688205+0000 mgr.gibba045.orlgmj (mgr.34412) 11668 : cluster [DBG] pgmap v6650: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:14.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:30:13 gibba015 bash[30343]: cluster 2021-03-10T17:30:12.688205+0000 mgr.gibba045.orlgmj (mgr.34412) 11668 : cluster [DBG] pgmap v6650: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:16.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:30:15 gibba045 bash[25517]: cluster 2021-03-10T17:30:14.689148+0000 mgr.gibba045.orlgmj (mgr.34412) 11669 : cluster [DBG] pgmap v6651: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:16.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:30:15 gibba015 bash[29377]: cluster 2021-03-10T17:30:14.689148+0000 mgr.gibba045.orlgmj (mgr.34412) 11669 : cluster [DBG] pgmap v6651: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:16.328 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:30:15 gibba015 bash[30343]: cluster 2021-03-10T17:30:14.689148+0000 mgr.gibba045.orlgmj (mgr.34412) 11669 : cluster [DBG] pgmap v6651: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:18.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:30:17 gibba045 bash[25517]: cluster 2021-03-10T17:30:16.690923+0000 mgr.gibba045.orlgmj (mgr.34412) 11670 : cluster [DBG] pgmap v6652: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:18.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:30:17 gibba015 bash[29377]: cluster 2021-03-10T17:30:16.690923+0000 mgr.gibba045.orlgmj (mgr.34412) 11670 : cluster [DBG] pgmap v6652: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:18.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:30:17 gibba015 bash[30343]: cluster 2021-03-10T17:30:16.690923+0000 mgr.gibba045.orlgmj (mgr.34412) 11670 : cluster [DBG] pgmap v6652: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:19.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:30:19 gibba045 bash[25517]: cluster 2021-03-10T17:30:18.692190+0000 mgr.gibba045.orlgmj (mgr.34412) 11671 : cluster [DBG] pgmap v6653: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:19.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:30:18 gibba015 bash[29377]: cluster 2021-03-10T17:30:18.692190+0000 mgr.gibba045.orlgmj (mgr.34412) 11671 : cluster [DBG] pgmap v6653: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:19.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:30:19 gibba015 bash[30343]: cluster 2021-03-10T17:30:18.692190+0000 mgr.gibba045.orlgmj (mgr.34412) 11671 : cluster [DBG] pgmap v6653: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:20.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:30:20 gibba045 bash[25517]: cephadm 2021-03-10T17:30:19.365565+0000 mgr.gibba045.orlgmj (mgr.34412) 11672 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:30:20.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:30:20 gibba015 bash[29377]: cephadm 2021-03-10T17:30:19.365565+0000 mgr.gibba045.orlgmj (mgr.34412) 11672 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:30:20.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:30:20 gibba015 bash[30343]: cephadm 2021-03-10T17:30:19.365565+0000 mgr.gibba045.orlgmj (mgr.34412) 11672 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:30:21.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:30:21 gibba045 bash[25517]: cluster 2021-03-10T17:30:20.693909+0000 mgr.gibba045.orlgmj (mgr.34412) 11673 : cluster [DBG] pgmap v6654: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:21.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:30:21 gibba015 bash[29377]: cluster 2021-03-10T17:30:20.693909+0000 mgr.gibba045.orlgmj (mgr.34412) 11673 : cluster [DBG] pgmap v6654: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:21.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:30:21 gibba015 bash[30343]: cluster 2021-03-10T17:30:20.693909+0000 mgr.gibba045.orlgmj (mgr.34412) 11673 : cluster [DBG] pgmap v6654: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:22.281 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:30:22.507 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:30:22.508 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 2m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:30:22.508 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 93s ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:30:22.508 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 93s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:30:22.509 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 93s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:30:22.509 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:30:22.509 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:30:22.509 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 93s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:30:22.509 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:30:22.510 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 2m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:30:22.510 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 93s ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:30:22.510 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:30:22.510 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:30:22.511 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:30:22.511 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:30:22.511 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 93s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:30:22.511 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 93s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:30:22.511 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 93s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:30:22.512 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 93s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:30:22.512 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 93s ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:30:22.512 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 93s ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:30:22.756 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:30:22.756 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:30:22.756 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:30:22.756 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:30:22.757 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:30:22.757 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:30:22.757 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:30:22.757 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:30:22.758 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:30:22.758 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:30:22.758 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:30:22.758 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:30:22.759 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:30:22.759 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:30:22.759 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:30:24.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:30:23 gibba045 bash[25517]: audit 2021-03-10T17:30:22.271574+0000 mgr.gibba045.orlgmj (mgr.34412) 11674 : audit [DBG] from='client.51882 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:30:24.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:30:23 gibba045 bash[25517]: audit 2021-03-10T17:30:22.494979+0000 mgr.gibba045.orlgmj (mgr.34412) 11675 : audit [DBG] from='client.61876 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:30:24.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:30:23 gibba045 bash[25517]: cluster 2021-03-10T17:30:22.695449+0000 mgr.gibba045.orlgmj (mgr.34412) 11676 : cluster [DBG] pgmap v6655: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:24.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:30:23 gibba045 bash[25517]: audit 2021-03-10T17:30:22.753844+0000 mon.a (mon.0) 2438 : audit [DBG] from='client.? 172.21.2.115:0/2855929089' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:30:24.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:30:23 gibba015 bash[29377]: audit 2021-03-10T17:30:22.271574+0000 mgr.gibba045.orlgmj (mgr.34412) 11674 : audit [DBG] from='client.51882 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:30:24.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:30:23 gibba015 bash[29377]: audit 2021-03-10T17:30:22.494979+0000 mgr.gibba045.orlgmj (mgr.34412) 11675 : audit [DBG] from='client.61876 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:30:24.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:30:23 gibba015 bash[29377]: cluster 2021-03-10T17:30:22.695449+0000 mgr.gibba045.orlgmj (mgr.34412) 11676 : cluster [DBG] pgmap v6655: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:24.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:30:23 gibba015 bash[29377]: audit 2021-03-10T17:30:22.753844+0000 mon.a (mon.0) 2438 : audit [DBG] from='client.? 172.21.2.115:0/2855929089' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:30:24.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:30:23 gibba015 bash[30343]: audit 2021-03-10T17:30:22.271574+0000 mgr.gibba045.orlgmj (mgr.34412) 11674 : audit [DBG] from='client.51882 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:30:24.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:30:23 gibba015 bash[30343]: audit 2021-03-10T17:30:22.494979+0000 mgr.gibba045.orlgmj (mgr.34412) 11675 : audit [DBG] from='client.61876 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:30:24.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:30:23 gibba015 bash[30343]: cluster 2021-03-10T17:30:22.695449+0000 mgr.gibba045.orlgmj (mgr.34412) 11676 : cluster [DBG] pgmap v6655: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:24.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:30:23 gibba015 bash[30343]: audit 2021-03-10T17:30:22.753844+0000 mon.a (mon.0) 2438 : audit [DBG] from='client.? 172.21.2.115:0/2855929089' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:30:26.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:30:25 gibba045 bash[25517]: cluster 2021-03-10T17:30:24.696357+0000 mgr.gibba045.orlgmj (mgr.34412) 11677 : cluster [DBG] pgmap v6656: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:26.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:30:25 gibba015 bash[29377]: cluster 2021-03-10T17:30:24.696357+0000 mgr.gibba045.orlgmj (mgr.34412) 11677 : cluster [DBG] pgmap v6656: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:26.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:30:25 gibba015 bash[30343]: cluster 2021-03-10T17:30:24.696357+0000 mgr.gibba045.orlgmj (mgr.34412) 11677 : cluster [DBG] pgmap v6656: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:28.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:30:27 gibba045 bash[25517]: cluster 2021-03-10T17:30:26.698032+0000 mgr.gibba045.orlgmj (mgr.34412) 11678 : cluster [DBG] pgmap v6657: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:28.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:30:27 gibba015 bash[29377]: cluster 2021-03-10T17:30:26.698032+0000 mgr.gibba045.orlgmj (mgr.34412) 11678 : cluster [DBG] pgmap v6657: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:28.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:30:27 gibba015 bash[30343]: cluster 2021-03-10T17:30:26.698032+0000 mgr.gibba045.orlgmj (mgr.34412) 11678 : cluster [DBG] pgmap v6657: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:29.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:30:29 gibba045 bash[25517]: cluster 2021-03-10T17:30:28.699345+0000 mgr.gibba045.orlgmj (mgr.34412) 11679 : cluster [DBG] pgmap v6658: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:29.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:30:29 gibba015 bash[29377]: cluster 2021-03-10T17:30:28.699345+0000 mgr.gibba045.orlgmj (mgr.34412) 11679 : cluster [DBG] pgmap v6658: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:29.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:30:29 gibba015 bash[30343]: cluster 2021-03-10T17:30:28.699345+0000 mgr.gibba045.orlgmj (mgr.34412) 11679 : cluster [DBG] pgmap v6658: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:32.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:30:31 gibba045 bash[25517]: cluster 2021-03-10T17:30:30.701074+0000 mgr.gibba045.orlgmj (mgr.34412) 11680 : cluster [DBG] pgmap v6659: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:32.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:30:31 gibba015 bash[29377]: cluster 2021-03-10T17:30:30.701074+0000 mgr.gibba045.orlgmj (mgr.34412) 11680 : cluster [DBG] pgmap v6659: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:32.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:30:31 gibba015 bash[30343]: cluster 2021-03-10T17:30:30.701074+0000 mgr.gibba045.orlgmj (mgr.34412) 11680 : cluster [DBG] pgmap v6659: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:34.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:30:33 gibba045 bash[25517]: cluster 2021-03-10T17:30:32.702486+0000 mgr.gibba045.orlgmj (mgr.34412) 11681 : cluster [DBG] pgmap v6660: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:34.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:30:33 gibba015 bash[29377]: cluster 2021-03-10T17:30:32.702486+0000 mgr.gibba045.orlgmj (mgr.34412) 11681 : cluster [DBG] pgmap v6660: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:34.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:30:33 gibba015 bash[30343]: cluster 2021-03-10T17:30:32.702486+0000 mgr.gibba045.orlgmj (mgr.34412) 11681 : cluster [DBG] pgmap v6660: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:36.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:30:35 gibba045 bash[25517]: cephadm 2021-03-10T17:30:34.381364+0000 mgr.gibba045.orlgmj (mgr.34412) 11682 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:30:36.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:30:35 gibba045 bash[25517]: cluster 2021-03-10T17:30:34.703993+0000 mgr.gibba045.orlgmj (mgr.34412) 11683 : cluster [DBG] pgmap v6661: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:36.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:30:35 gibba015 bash[29377]: cephadm 2021-03-10T17:30:34.381364+0000 mgr.gibba045.orlgmj (mgr.34412) 11682 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:30:36.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:30:35 gibba015 bash[29377]: cluster 2021-03-10T17:30:34.703993+0000 mgr.gibba045.orlgmj (mgr.34412) 11683 : cluster [DBG] pgmap v6661: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:36.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:30:35 gibba015 bash[30343]: cephadm 2021-03-10T17:30:34.381364+0000 mgr.gibba045.orlgmj (mgr.34412) 11682 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:30:36.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:30:35 gibba015 bash[30343]: cluster 2021-03-10T17:30:34.703993+0000 mgr.gibba045.orlgmj (mgr.34412) 11683 : cluster [DBG] pgmap v6661: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:38.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:30:37 gibba045 bash[25517]: cluster 2021-03-10T17:30:36.705918+0000 mgr.gibba045.orlgmj (mgr.34412) 11684 : cluster [DBG] pgmap v6662: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:38.144 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:30:37 gibba015 bash[29377]: cluster 2021-03-10T17:30:36.705918+0000 mgr.gibba045.orlgmj (mgr.34412) 11684 : cluster [DBG] pgmap v6662: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:38.145 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:30:37 gibba015 bash[30343]: cluster 2021-03-10T17:30:36.705918+0000 mgr.gibba045.orlgmj (mgr.34412) 11684 : cluster [DBG] pgmap v6662: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:39.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:30:39 gibba045 bash[25517]: cluster 2021-03-10T17:30:38.707198+0000 mgr.gibba045.orlgmj (mgr.34412) 11685 : cluster [DBG] pgmap v6663: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:39.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:30:39 gibba015 bash[29377]: cluster 2021-03-10T17:30:38.707198+0000 mgr.gibba045.orlgmj (mgr.34412) 11685 : cluster [DBG] pgmap v6663: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:39.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:30:39 gibba015 bash[30343]: cluster 2021-03-10T17:30:38.707198+0000 mgr.gibba045.orlgmj (mgr.34412) 11685 : cluster [DBG] pgmap v6663: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:42.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:30:41 gibba045 bash[25517]: cluster 2021-03-10T17:30:40.708782+0000 mgr.gibba045.orlgmj (mgr.34412) 11686 : cluster [DBG] pgmap v6664: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:42.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:30:41 gibba015 bash[29377]: cluster 2021-03-10T17:30:40.708782+0000 mgr.gibba045.orlgmj (mgr.34412) 11686 : cluster [DBG] pgmap v6664: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:42.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:30:41 gibba015 bash[30343]: cluster 2021-03-10T17:30:40.708782+0000 mgr.gibba045.orlgmj (mgr.34412) 11686 : cluster [DBG] pgmap v6664: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:44.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:30:43 gibba045 bash[25517]: cluster 2021-03-10T17:30:42.710192+0000 mgr.gibba045.orlgmj (mgr.34412) 11687 : cluster [DBG] pgmap v6665: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:44.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:30:43 gibba015 bash[29377]: cluster 2021-03-10T17:30:42.710192+0000 mgr.gibba045.orlgmj (mgr.34412) 11687 : cluster [DBG] pgmap v6665: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:44.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:30:43 gibba015 bash[30343]: cluster 2021-03-10T17:30:42.710192+0000 mgr.gibba045.orlgmj (mgr.34412) 11687 : cluster [DBG] pgmap v6665: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:46.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:30:45 gibba045 bash[25517]: cluster 2021-03-10T17:30:44.711336+0000 mgr.gibba045.orlgmj (mgr.34412) 11688 : cluster [DBG] pgmap v6666: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:46.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:30:45 gibba015 bash[29377]: cluster 2021-03-10T17:30:44.711336+0000 mgr.gibba045.orlgmj (mgr.34412) 11688 : cluster [DBG] pgmap v6666: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:46.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:30:45 gibba015 bash[30343]: cluster 2021-03-10T17:30:44.711336+0000 mgr.gibba045.orlgmj (mgr.34412) 11688 : cluster [DBG] pgmap v6666: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:48.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:30:47 gibba045 bash[25517]: cluster 2021-03-10T17:30:46.713096+0000 mgr.gibba045.orlgmj (mgr.34412) 11689 : cluster [DBG] pgmap v6667: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:48.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:30:47 gibba015 bash[29377]: cluster 2021-03-10T17:30:46.713096+0000 mgr.gibba045.orlgmj (mgr.34412) 11689 : cluster [DBG] pgmap v6667: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:48.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:30:47 gibba015 bash[30343]: cluster 2021-03-10T17:30:46.713096+0000 mgr.gibba045.orlgmj (mgr.34412) 11689 : cluster [DBG] pgmap v6667: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:49.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:30:49 gibba045 bash[25517]: cluster 2021-03-10T17:30:48.714087+0000 mgr.gibba045.orlgmj (mgr.34412) 11690 : cluster [DBG] pgmap v6668: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:49.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:30:49 gibba015 bash[29377]: cluster 2021-03-10T17:30:48.714087+0000 mgr.gibba045.orlgmj (mgr.34412) 11690 : cluster [DBG] pgmap v6668: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:49.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:30:49 gibba015 bash[30343]: cluster 2021-03-10T17:30:48.714087+0000 mgr.gibba045.orlgmj (mgr.34412) 11690 : cluster [DBG] pgmap v6668: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:50.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:30:50 gibba045 bash[25517]: audit 2021-03-10T17:30:49.394347+0000 mon.c (mon.1) 3201 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:30:50.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:30:50 gibba045 bash[25517]: cephadm 2021-03-10T17:30:49.401342+0000 mgr.gibba045.orlgmj (mgr.34412) 11691 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:30:50.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:30:50 gibba045 bash[25517]: cephadm 2021-03-10T17:30:49.403217+0000 mgr.gibba045.orlgmj (mgr.34412) 11692 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:30:50.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:30:50 gibba045 bash[25517]: audit 2021-03-10T17:30:49.607494+0000 mon.a (mon.0) 2439 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:30:50.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:30:50 gibba045 bash[25517]: audit 2021-03-10T17:30:49.611043+0000 mon.c (mon.1) 3202 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:30:50.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:30:50 gibba045 bash[25517]: cephadm 2021-03-10T17:30:49.611991+0000 mgr.gibba045.orlgmj (mgr.34412) 11693 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:30:50.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:30:50 gibba045 bash[25517]: audit 2021-03-10T17:30:49.612630+0000 mon.c (mon.1) 3203 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:30:50.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:30:50 gibba045 bash[25517]: audit 2021-03-10T17:30:49.613986+0000 mon.c (mon.1) 3204 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:30:50.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:30:50 gibba045 bash[25517]: cephadm 2021-03-10T17:30:49.614065+0000 mgr.gibba045.orlgmj (mgr.34412) 11694 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:30:50.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:30:50 gibba045 bash[25517]: audit 2021-03-10T17:30:49.615132+0000 mon.c (mon.1) 3205 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:30:50.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:30:50 gibba045 bash[25517]: cephadm 2021-03-10T17:30:49.615406+0000 mgr.gibba045.orlgmj (mgr.34412) 11695 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:30:50.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:30:50 gibba045 bash[25517]: cephadm 2021-03-10T17:30:49.615444+0000 mgr.gibba045.orlgmj (mgr.34412) 11696 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:30:50.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:30:50 gibba045 bash[25517]: cephadm 2021-03-10T17:30:49.616693+0000 mgr.gibba045.orlgmj (mgr.34412) 11697 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:30:50.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:30:50 gibba045 bash[25517]: cephadm 2021-03-10T17:30:49.616767+0000 mgr.gibba045.orlgmj (mgr.34412) 11698 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:30:50.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:30:50 gibba045 bash[25517]: audit 2021-03-10T17:30:49.617860+0000 mon.c (mon.1) 3206 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:30:50.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:30:50 gibba045 bash[25517]: cephadm 2021-03-10T17:30:49.617942+0000 mgr.gibba045.orlgmj (mgr.34412) 11699 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:30:50.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:30:50 gibba045 bash[25517]: audit 2021-03-10T17:30:49.619197+0000 mon.c (mon.1) 3207 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:30:50.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:30:50 gibba045 bash[25517]: cephadm 2021-03-10T17:30:49.619200+0000 mgr.gibba045.orlgmj (mgr.34412) 11700 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:30:50.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:30:50 gibba045 bash[25517]: cephadm 2021-03-10T17:30:49.619315+0000 mgr.gibba045.orlgmj (mgr.34412) 11701 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:30:50.312 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:30:50 gibba045 bash[25517]: cephadm 2021-03-10T17:30:49.620521+0000 mgr.gibba045.orlgmj (mgr.34412) 11702 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:30:50.312 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:30:50 gibba045 bash[25517]: cephadm 2021-03-10T17:30:49.620849+0000 mgr.gibba045.orlgmj (mgr.34412) 11703 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:30:50.312 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:30:50 gibba045 bash[25517]: cephadm 2021-03-10T17:30:49.621816+0000 mgr.gibba045.orlgmj (mgr.34412) 11704 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:30:50.312 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:30:50 gibba045 bash[25517]: cephadm 2021-03-10T17:30:49.621856+0000 mgr.gibba045.orlgmj (mgr.34412) 11705 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:30:50.312 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:30:50 gibba045 bash[25517]: cephadm 2021-03-10T17:30:49.621964+0000 mgr.gibba045.orlgmj (mgr.34412) 11706 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:30:50.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:30:50 gibba015 bash[29377]: audit 2021-03-10T17:30:49.394347+0000 mon.c (mon.1) 3201 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:30:50.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:30:50 gibba015 bash[29377]: cephadm 2021-03-10T17:30:49.401342+0000 mgr.gibba045.orlgmj (mgr.34412) 11691 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:30:50.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:30:50 gibba015 bash[29377]: cephadm 2021-03-10T17:30:49.403217+0000 mgr.gibba045.orlgmj (mgr.34412) 11692 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:30:50.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:30:50 gibba015 bash[29377]: audit 2021-03-10T17:30:49.607494+0000 mon.a (mon.0) 2439 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:30:50.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:30:50 gibba015 bash[29377]: audit 2021-03-10T17:30:49.611043+0000 mon.c (mon.1) 3202 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:30:50.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:30:50 gibba015 bash[29377]: cephadm 2021-03-10T17:30:49.611991+0000 mgr.gibba045.orlgmj (mgr.34412) 11693 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:30:50.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:30:50 gibba015 bash[29377]: audit 2021-03-10T17:30:49.612630+0000 mon.c (mon.1) 3203 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:30:50.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:30:50 gibba015 bash[29377]: audit 2021-03-10T17:30:49.613986+0000 mon.c (mon.1) 3204 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:30:50.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:30:50 gibba015 bash[29377]: cephadm 2021-03-10T17:30:49.614065+0000 mgr.gibba045.orlgmj (mgr.34412) 11694 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:30:50.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:30:50 gibba015 bash[29377]: audit 2021-03-10T17:30:49.615132+0000 mon.c (mon.1) 3205 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:30:50.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:30:50 gibba015 bash[29377]: cephadm 2021-03-10T17:30:49.615406+0000 mgr.gibba045.orlgmj (mgr.34412) 11695 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:30:50.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:30:50 gibba015 bash[29377]: cephadm 2021-03-10T17:30:49.615444+0000 mgr.gibba045.orlgmj (mgr.34412) 11696 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:30:50.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:30:50 gibba015 bash[29377]: cephadm 2021-03-10T17:30:49.616693+0000 mgr.gibba045.orlgmj (mgr.34412) 11697 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:30:50.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:30:50 gibba015 bash[29377]: cephadm 2021-03-10T17:30:49.616767+0000 mgr.gibba045.orlgmj (mgr.34412) 11698 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:30:50.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:30:50 gibba015 bash[29377]: audit 2021-03-10T17:30:49.617860+0000 mon.c (mon.1) 3206 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:30:50.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:30:50 gibba015 bash[29377]: cephadm 2021-03-10T17:30:49.617942+0000 mgr.gibba045.orlgmj (mgr.34412) 11699 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:30:50.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:30:50 gibba015 bash[29377]: audit 2021-03-10T17:30:49.619197+0000 mon.c (mon.1) 3207 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:30:50.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:30:50 gibba015 bash[29377]: cephadm 2021-03-10T17:30:49.619200+0000 mgr.gibba045.orlgmj (mgr.34412) 11700 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:30:50.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:30:50 gibba015 bash[29377]: cephadm 2021-03-10T17:30:49.619315+0000 mgr.gibba045.orlgmj (mgr.34412) 11701 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:30:50.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:30:50 gibba015 bash[29377]: cephadm 2021-03-10T17:30:49.620521+0000 mgr.gibba045.orlgmj (mgr.34412) 11702 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:30:50.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:30:50 gibba015 bash[30343]: audit 2021-03-10T17:30:49.394347+0000 mon.c (mon.1) 3201 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:30:50.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:30:50 gibba015 bash[30343]: cephadm 2021-03-10T17:30:49.401342+0000 mgr.gibba045.orlgmj (mgr.34412) 11691 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:30:50.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:30:50 gibba015 bash[30343]: cephadm 2021-03-10T17:30:49.403217+0000 mgr.gibba045.orlgmj (mgr.34412) 11692 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:30:50.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:30:50 gibba015 bash[30343]: audit 2021-03-10T17:30:49.607494+0000 mon.a (mon.0) 2439 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:30:50.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:30:50 gibba015 bash[30343]: audit 2021-03-10T17:30:49.611043+0000 mon.c (mon.1) 3202 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:30:50.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:30:50 gibba015 bash[30343]: cephadm 2021-03-10T17:30:49.611991+0000 mgr.gibba045.orlgmj (mgr.34412) 11693 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:30:50.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:30:50 gibba015 bash[30343]: audit 2021-03-10T17:30:49.612630+0000 mon.c (mon.1) 3203 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:30:50.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:30:50 gibba015 bash[30343]: audit 2021-03-10T17:30:49.613986+0000 mon.c (mon.1) 3204 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:30:50.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:30:50 gibba015 bash[30343]: cephadm 2021-03-10T17:30:49.614065+0000 mgr.gibba045.orlgmj (mgr.34412) 11694 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:30:50.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:30:50 gibba015 bash[30343]: audit 2021-03-10T17:30:49.615132+0000 mon.c (mon.1) 3205 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:30:50.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:30:50 gibba015 bash[30343]: cephadm 2021-03-10T17:30:49.615406+0000 mgr.gibba045.orlgmj (mgr.34412) 11695 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:30:50.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:30:50 gibba015 bash[30343]: cephadm 2021-03-10T17:30:49.615444+0000 mgr.gibba045.orlgmj (mgr.34412) 11696 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:30:50.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:30:50 gibba015 bash[30343]: cephadm 2021-03-10T17:30:49.616693+0000 mgr.gibba045.orlgmj (mgr.34412) 11697 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:30:50.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:30:50 gibba015 bash[30343]: cephadm 2021-03-10T17:30:49.616767+0000 mgr.gibba045.orlgmj (mgr.34412) 11698 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:30:50.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:30:50 gibba015 bash[30343]: audit 2021-03-10T17:30:49.617860+0000 mon.c (mon.1) 3206 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:30:50.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:30:50 gibba015 bash[30343]: cephadm 2021-03-10T17:30:49.617942+0000 mgr.gibba045.orlgmj (mgr.34412) 11699 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:30:50.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:30:50 gibba015 bash[30343]: audit 2021-03-10T17:30:49.619197+0000 mon.c (mon.1) 3207 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:30:50.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:30:50 gibba015 bash[30343]: cephadm 2021-03-10T17:30:49.619200+0000 mgr.gibba045.orlgmj (mgr.34412) 11700 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:30:50.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:30:50 gibba015 bash[30343]: cephadm 2021-03-10T17:30:49.619315+0000 mgr.gibba045.orlgmj (mgr.34412) 11701 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:30:50.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:30:50 gibba015 bash[30343]: cephadm 2021-03-10T17:30:49.620521+0000 mgr.gibba045.orlgmj (mgr.34412) 11702 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:30:50.484 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:30:50 gibba015 bash[29377]: cephadm 2021-03-10T17:30:49.620849+0000 mgr.gibba045.orlgmj (mgr.34412) 11703 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:30:50.485 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:30:50 gibba015 bash[29377]: cephadm 2021-03-10T17:30:49.621816+0000 mgr.gibba045.orlgmj (mgr.34412) 11704 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:30:50.485 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:30:50 gibba015 bash[29377]: cephadm 2021-03-10T17:30:49.621856+0000 mgr.gibba045.orlgmj (mgr.34412) 11705 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:30:50.485 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:30:50 gibba015 bash[29377]: cephadm 2021-03-10T17:30:49.621964+0000 mgr.gibba045.orlgmj (mgr.34412) 11706 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:30:50.486 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:30:50 gibba015 bash[30343]: cephadm 2021-03-10T17:30:49.620849+0000 mgr.gibba045.orlgmj (mgr.34412) 11703 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:30:50.486 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:30:50 gibba015 bash[30343]: cephadm 2021-03-10T17:30:49.621816+0000 mgr.gibba045.orlgmj (mgr.34412) 11704 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:30:50.486 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:30:50 gibba015 bash[30343]: cephadm 2021-03-10T17:30:49.621856+0000 mgr.gibba045.orlgmj (mgr.34412) 11705 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:30:50.486 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:30:50 gibba015 bash[30343]: cephadm 2021-03-10T17:30:49.621964+0000 mgr.gibba045.orlgmj (mgr.34412) 11706 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:30:51.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:30:51 gibba045 bash[25517]: cluster 2021-03-10T17:30:50.715682+0000 mgr.gibba045.orlgmj (mgr.34412) 11707 : cluster [DBG] pgmap v6669: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:51.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:30:51 gibba015 bash[29377]: cluster 2021-03-10T17:30:50.715682+0000 mgr.gibba045.orlgmj (mgr.34412) 11707 : cluster [DBG] pgmap v6669: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:51.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:30:51 gibba015 bash[30343]: cluster 2021-03-10T17:30:50.715682+0000 mgr.gibba045.orlgmj (mgr.34412) 11707 : cluster [DBG] pgmap v6669: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:53.004 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:30:53.233 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:30:53.233 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 3m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:30:53.233 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 2m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:30:53.234 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:30:53.234 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:30:53.234 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:30:53.234 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:30:53.235 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:30:53.235 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:30:53.235 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 3m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:30:53.235 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 2m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:30:53.236 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:30:53.236 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:30:53.236 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:30:53.236 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:30:53.236 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:30:53.237 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:30:53.237 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:30:53.237 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:30:53.237 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 2m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:30:53.238 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 2m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:30:53.481 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:30:53.482 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:30:53.482 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:30:53.482 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:30:53.482 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:30:53.483 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:30:53.483 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:30:53.483 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:30:53.483 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:30:53.483 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:30:53.484 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:30:53.484 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:30:53.484 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:30:53.484 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:30:53.485 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:30:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:30:53 gibba045 bash[25517]: cluster 2021-03-10T17:30:52.717365+0000 mgr.gibba045.orlgmj (mgr.34412) 11708 : cluster [DBG] pgmap v6670: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:30:53 gibba045 bash[25517]: audit 2021-03-10T17:30:53.479205+0000 mon.c (mon.1) 3208 : audit [DBG] from='client.? 172.21.2.115:0/662526020' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:30:54.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:30:53 gibba015 bash[29377]: cluster 2021-03-10T17:30:52.717365+0000 mgr.gibba045.orlgmj (mgr.34412) 11708 : cluster [DBG] pgmap v6670: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:54.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:30:53 gibba015 bash[29377]: audit 2021-03-10T17:30:53.479205+0000 mon.c (mon.1) 3208 : audit [DBG] from='client.? 172.21.2.115:0/662526020' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:30:54.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:30:53 gibba015 bash[30343]: cluster 2021-03-10T17:30:52.717365+0000 mgr.gibba045.orlgmj (mgr.34412) 11708 : cluster [DBG] pgmap v6670: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:54.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:30:53 gibba015 bash[30343]: audit 2021-03-10T17:30:53.479205+0000 mon.c (mon.1) 3208 : audit [DBG] from='client.? 172.21.2.115:0/662526020' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:30:55.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:30:54 gibba045 bash[25517]: audit 2021-03-10T17:30:52.994435+0000 mgr.gibba045.orlgmj (mgr.34412) 11709 : audit [DBG] from='client.51900 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:30:55.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:30:54 gibba045 bash[25517]: audit 2021-03-10T17:30:53.220794+0000 mgr.gibba045.orlgmj (mgr.34412) 11710 : audit [DBG] from='client.51906 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:30:55.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:30:54 gibba045 bash[25517]: audit 2021-03-10T17:30:54.093807+0000 mon.c (mon.1) 3209 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:30:55.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:30:54 gibba045 bash[25517]: audit 2021-03-10T17:30:54.094420+0000 mon.c (mon.1) 3210 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:30:55.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:30:54 gibba045 bash[25517]: audit 2021-03-10T17:30:54.094923+0000 mon.a (mon.0) 2440 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:30:55.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:30:54 gibba045 bash[25517]: audit 2021-03-10T17:30:54.096094+0000 mon.a (mon.0) 2441 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:30:55.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:30:54 gibba045 bash[25517]: audit 2021-03-10T17:30:54.193892+0000 mon.c (mon.1) 3211 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T17:30:55.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:30:54 gibba045 bash[25517]: audit 2021-03-10T17:30:54.194712+0000 mon.c (mon.1) 3212 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:30:55.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:30:54 gibba045 bash[25517]: audit 2021-03-10T17:30:54.195175+0000 mon.a (mon.0) 2442 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T17:30:55.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:30:54 gibba045 bash[25517]: audit 2021-03-10T17:30:54.195393+0000 mon.c (mon.1) 3213 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T17:30:55.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:30:54 gibba045 bash[25517]: audit 2021-03-10T17:30:54.196269+0000 mon.c (mon.1) 3214 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:30:55.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:30:54 gibba045 bash[25517]: audit 2021-03-10T17:30:54.196489+0000 mon.a (mon.0) 2443 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:30:55.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:30:54 gibba045 bash[25517]: audit 2021-03-10T17:30:54.197698+0000 mon.a (mon.0) 2444 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T17:30:55.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:30:54 gibba045 bash[25517]: audit 2021-03-10T17:30:54.198499+0000 mon.a (mon.0) 2445 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:30:55.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:30:54 gibba015 bash[29377]: audit 2021-03-10T17:30:52.994435+0000 mgr.gibba045.orlgmj (mgr.34412) 11709 : audit [DBG] from='client.51900 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:30:55.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:30:54 gibba015 bash[29377]: audit 2021-03-10T17:30:53.220794+0000 mgr.gibba045.orlgmj (mgr.34412) 11710 : audit [DBG] from='client.51906 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:30:55.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:30:54 gibba015 bash[29377]: audit 2021-03-10T17:30:54.093807+0000 mon.c (mon.1) 3209 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:30:55.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:30:54 gibba015 bash[29377]: audit 2021-03-10T17:30:54.094420+0000 mon.c (mon.1) 3210 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:30:55.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:30:54 gibba015 bash[29377]: audit 2021-03-10T17:30:54.094923+0000 mon.a (mon.0) 2440 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:30:55.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:30:54 gibba015 bash[29377]: audit 2021-03-10T17:30:54.096094+0000 mon.a (mon.0) 2441 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:30:55.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:30:54 gibba015 bash[29377]: audit 2021-03-10T17:30:54.193892+0000 mon.c (mon.1) 3211 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T17:30:55.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:30:54 gibba015 bash[29377]: audit 2021-03-10T17:30:54.194712+0000 mon.c (mon.1) 3212 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:30:55.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:30:54 gibba015 bash[29377]: audit 2021-03-10T17:30:54.195175+0000 mon.a (mon.0) 2442 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T17:30:55.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:30:54 gibba015 bash[29377]: audit 2021-03-10T17:30:54.195393+0000 mon.c (mon.1) 3213 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T17:30:55.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:30:54 gibba015 bash[29377]: audit 2021-03-10T17:30:54.196269+0000 mon.c (mon.1) 3214 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:30:55.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:30:54 gibba015 bash[29377]: audit 2021-03-10T17:30:54.196489+0000 mon.a (mon.0) 2443 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:30:55.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:30:54 gibba015 bash[29377]: audit 2021-03-10T17:30:54.197698+0000 mon.a (mon.0) 2444 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T17:30:55.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:30:54 gibba015 bash[29377]: audit 2021-03-10T17:30:54.198499+0000 mon.a (mon.0) 2445 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:30:55.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:30:54 gibba015 bash[30343]: audit 2021-03-10T17:30:52.994435+0000 mgr.gibba045.orlgmj (mgr.34412) 11709 : audit [DBG] from='client.51900 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:30:55.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:30:54 gibba015 bash[30343]: audit 2021-03-10T17:30:53.220794+0000 mgr.gibba045.orlgmj (mgr.34412) 11710 : audit [DBG] from='client.51906 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:30:55.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:30:54 gibba015 bash[30343]: audit 2021-03-10T17:30:54.093807+0000 mon.c (mon.1) 3209 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:30:55.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:30:54 gibba015 bash[30343]: audit 2021-03-10T17:30:54.094420+0000 mon.c (mon.1) 3210 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:30:55.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:30:54 gibba015 bash[30343]: audit 2021-03-10T17:30:54.094923+0000 mon.a (mon.0) 2440 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:30:55.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:30:54 gibba015 bash[30343]: audit 2021-03-10T17:30:54.096094+0000 mon.a (mon.0) 2441 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:30:55.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:30:54 gibba015 bash[30343]: audit 2021-03-10T17:30:54.193892+0000 mon.c (mon.1) 3211 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T17:30:55.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:30:54 gibba015 bash[30343]: audit 2021-03-10T17:30:54.194712+0000 mon.c (mon.1) 3212 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:30:55.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:30:54 gibba015 bash[30343]: audit 2021-03-10T17:30:54.195175+0000 mon.a (mon.0) 2442 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T17:30:55.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:30:54 gibba015 bash[30343]: audit 2021-03-10T17:30:54.195393+0000 mon.c (mon.1) 3213 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T17:30:55.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:30:54 gibba015 bash[30343]: audit 2021-03-10T17:30:54.196269+0000 mon.c (mon.1) 3214 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:30:55.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:30:54 gibba015 bash[30343]: audit 2021-03-10T17:30:54.196489+0000 mon.a (mon.0) 2443 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:30:55.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:30:54 gibba015 bash[30343]: audit 2021-03-10T17:30:54.197698+0000 mon.a (mon.0) 2444 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T17:30:55.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:30:54 gibba015 bash[30343]: audit 2021-03-10T17:30:54.198499+0000 mon.a (mon.0) 2445 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:30:56.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:30:55 gibba045 bash[25517]: cluster 2021-03-10T17:30:54.718345+0000 mgr.gibba045.orlgmj (mgr.34412) 11711 : cluster [DBG] pgmap v6671: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:56.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:30:55 gibba015 bash[29377]: cluster 2021-03-10T17:30:54.718345+0000 mgr.gibba045.orlgmj (mgr.34412) 11711 : cluster [DBG] pgmap v6671: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:56.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:30:55 gibba015 bash[30343]: cluster 2021-03-10T17:30:54.718345+0000 mgr.gibba045.orlgmj (mgr.34412) 11711 : cluster [DBG] pgmap v6671: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:58.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:30:57 gibba015 bash[29377]: cluster 2021-03-10T17:30:56.720017+0000 mgr.gibba045.orlgmj (mgr.34412) 11712 : cluster [DBG] pgmap v6672: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:58.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:30:57 gibba015 bash[30343]: cluster 2021-03-10T17:30:56.720017+0000 mgr.gibba045.orlgmj (mgr.34412) 11712 : cluster [DBG] pgmap v6672: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:58.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:30:57 gibba045 bash[25517]: cluster 2021-03-10T17:30:56.720017+0000 mgr.gibba045.orlgmj (mgr.34412) 11712 : cluster [DBG] pgmap v6672: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:59.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:30:59 gibba045 bash[25517]: cluster 2021-03-10T17:30:58.721370+0000 mgr.gibba045.orlgmj (mgr.34412) 11713 : cluster [DBG] pgmap v6673: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:59.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:30:59 gibba015 bash[29377]: cluster 2021-03-10T17:30:58.721370+0000 mgr.gibba045.orlgmj (mgr.34412) 11713 : cluster [DBG] pgmap v6673: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:59.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:30:59 gibba015 bash[30343]: cluster 2021-03-10T17:30:58.721370+0000 mgr.gibba045.orlgmj (mgr.34412) 11713 : cluster [DBG] pgmap v6673: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:02.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:31:01 gibba045 bash[25517]: cluster 2021-03-10T17:31:00.723234+0000 mgr.gibba045.orlgmj (mgr.34412) 11714 : cluster [DBG] pgmap v6674: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:02.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:31:01 gibba015 bash[29377]: cluster 2021-03-10T17:31:00.723234+0000 mgr.gibba045.orlgmj (mgr.34412) 11714 : cluster [DBG] pgmap v6674: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:02.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:31:01 gibba015 bash[30343]: cluster 2021-03-10T17:31:00.723234+0000 mgr.gibba045.orlgmj (mgr.34412) 11714 : cluster [DBG] pgmap v6674: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:04.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:31:03 gibba045 bash[25517]: cluster 2021-03-10T17:31:02.724968+0000 mgr.gibba045.orlgmj (mgr.34412) 11715 : cluster [DBG] pgmap v6675: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:04.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:31:03 gibba015 bash[29377]: cluster 2021-03-10T17:31:02.724968+0000 mgr.gibba045.orlgmj (mgr.34412) 11715 : cluster [DBG] pgmap v6675: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:04.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:31:03 gibba015 bash[30343]: cluster 2021-03-10T17:31:02.724968+0000 mgr.gibba045.orlgmj (mgr.34412) 11715 : cluster [DBG] pgmap v6675: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:06.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:31:05 gibba045 bash[25517]: cephadm 2021-03-10T17:31:04.637588+0000 mgr.gibba045.orlgmj (mgr.34412) 11716 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:31:06.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:31:05 gibba045 bash[25517]: cluster 2021-03-10T17:31:04.726549+0000 mgr.gibba045.orlgmj (mgr.34412) 11717 : cluster [DBG] pgmap v6676: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:06.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:31:05 gibba015 bash[29377]: cephadm 2021-03-10T17:31:04.637588+0000 mgr.gibba045.orlgmj (mgr.34412) 11716 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:31:06.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:31:05 gibba015 bash[29377]: cluster 2021-03-10T17:31:04.726549+0000 mgr.gibba045.orlgmj (mgr.34412) 11717 : cluster [DBG] pgmap v6676: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:06.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:31:05 gibba015 bash[30343]: cephadm 2021-03-10T17:31:04.637588+0000 mgr.gibba045.orlgmj (mgr.34412) 11716 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:31:06.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:31:05 gibba015 bash[30343]: cluster 2021-03-10T17:31:04.726549+0000 mgr.gibba045.orlgmj (mgr.34412) 11717 : cluster [DBG] pgmap v6676: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:08.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:31:07 gibba015 bash[29377]: cluster 2021-03-10T17:31:06.728507+0000 mgr.gibba045.orlgmj (mgr.34412) 11718 : cluster [DBG] pgmap v6677: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:08.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:31:07 gibba015 bash[30343]: cluster 2021-03-10T17:31:06.728507+0000 mgr.gibba045.orlgmj (mgr.34412) 11718 : cluster [DBG] pgmap v6677: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:08.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:31:07 gibba045 bash[25517]: cluster 2021-03-10T17:31:06.728507+0000 mgr.gibba045.orlgmj (mgr.34412) 11718 : cluster [DBG] pgmap v6677: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:09.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:31:09 gibba045 bash[25517]: cluster 2021-03-10T17:31:08.729682+0000 mgr.gibba045.orlgmj (mgr.34412) 11719 : cluster [DBG] pgmap v6678: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:09.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:31:09 gibba015 bash[29377]: cluster 2021-03-10T17:31:08.729682+0000 mgr.gibba045.orlgmj (mgr.34412) 11719 : cluster [DBG] pgmap v6678: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:09.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:31:09 gibba015 bash[30343]: cluster 2021-03-10T17:31:08.729682+0000 mgr.gibba045.orlgmj (mgr.34412) 11719 : cluster [DBG] pgmap v6678: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:12.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:31:11 gibba045 bash[25517]: cluster 2021-03-10T17:31:10.731218+0000 mgr.gibba045.orlgmj (mgr.34412) 11720 : cluster [DBG] pgmap v6679: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:12.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:31:11 gibba015 bash[29377]: cluster 2021-03-10T17:31:10.731218+0000 mgr.gibba045.orlgmj (mgr.34412) 11720 : cluster [DBG] pgmap v6679: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:12.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:31:11 gibba015 bash[30343]: cluster 2021-03-10T17:31:10.731218+0000 mgr.gibba045.orlgmj (mgr.34412) 11720 : cluster [DBG] pgmap v6679: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:14.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:31:13 gibba045 bash[25517]: cluster 2021-03-10T17:31:12.732875+0000 mgr.gibba045.orlgmj (mgr.34412) 11721 : cluster [DBG] pgmap v6680: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:14.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:31:13 gibba015 bash[29377]: cluster 2021-03-10T17:31:12.732875+0000 mgr.gibba045.orlgmj (mgr.34412) 11721 : cluster [DBG] pgmap v6680: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:14.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:31:13 gibba015 bash[30343]: cluster 2021-03-10T17:31:12.732875+0000 mgr.gibba045.orlgmj (mgr.34412) 11721 : cluster [DBG] pgmap v6680: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:16.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:31:15 gibba015 bash[29377]: cluster 2021-03-10T17:31:14.734474+0000 mgr.gibba045.orlgmj (mgr.34412) 11722 : cluster [DBG] pgmap v6681: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:16.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:31:15 gibba015 bash[30343]: cluster 2021-03-10T17:31:14.734474+0000 mgr.gibba045.orlgmj (mgr.34412) 11722 : cluster [DBG] pgmap v6681: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:16.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:31:15 gibba045 bash[25517]: cluster 2021-03-10T17:31:14.734474+0000 mgr.gibba045.orlgmj (mgr.34412) 11722 : cluster [DBG] pgmap v6681: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:18.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:31:17 gibba015 bash[29377]: cluster 2021-03-10T17:31:16.736101+0000 mgr.gibba045.orlgmj (mgr.34412) 11723 : cluster [DBG] pgmap v6682: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:18.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:31:17 gibba015 bash[30343]: cluster 2021-03-10T17:31:16.736101+0000 mgr.gibba045.orlgmj (mgr.34412) 11723 : cluster [DBG] pgmap v6682: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:18.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:31:17 gibba045 bash[25517]: cluster 2021-03-10T17:31:16.736101+0000 mgr.gibba045.orlgmj (mgr.34412) 11723 : cluster [DBG] pgmap v6682: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:19.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:31:19 gibba045 bash[25517]: cluster 2021-03-10T17:31:18.737486+0000 mgr.gibba045.orlgmj (mgr.34412) 11724 : cluster [DBG] pgmap v6683: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:19.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:31:19 gibba015 bash[30343]: cluster 2021-03-10T17:31:18.737486+0000 mgr.gibba045.orlgmj (mgr.34412) 11724 : cluster [DBG] pgmap v6683: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:19.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:31:19 gibba015 bash[29377]: cluster 2021-03-10T17:31:18.737486+0000 mgr.gibba045.orlgmj (mgr.34412) 11724 : cluster [DBG] pgmap v6683: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:20.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:31:20 gibba045 bash[25517]: cephadm 2021-03-10T17:31:19.653171+0000 mgr.gibba045.orlgmj (mgr.34412) 11725 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:31:20.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:31:20 gibba015 bash[29377]: cephadm 2021-03-10T17:31:19.653171+0000 mgr.gibba045.orlgmj (mgr.34412) 11725 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:31:20.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:31:20 gibba015 bash[30343]: cephadm 2021-03-10T17:31:19.653171+0000 mgr.gibba045.orlgmj (mgr.34412) 11725 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:31:21.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:31:21 gibba045 bash[25517]: cluster 2021-03-10T17:31:20.739084+0000 mgr.gibba045.orlgmj (mgr.34412) 11726 : cluster [DBG] pgmap v6684: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:21.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:31:21 gibba015 bash[29377]: cluster 2021-03-10T17:31:20.739084+0000 mgr.gibba045.orlgmj (mgr.34412) 11726 : cluster [DBG] pgmap v6684: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:21.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:31:21 gibba015 bash[30343]: cluster 2021-03-10T17:31:20.739084+0000 mgr.gibba045.orlgmj (mgr.34412) 11726 : cluster [DBG] pgmap v6684: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:23.724 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:31:23.956 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:31:23.957 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 3m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:31:23.957 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 2m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:31:23.957 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:31:23.957 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:31:23.958 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:31:23.958 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:31:23.958 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:31:23.958 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:31:23.959 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 3m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:31:23.959 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 2m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:31:23.959 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:31:23.959 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:31:23.960 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:31:23.960 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:31:23.960 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:31:23.960 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:31:23.960 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:31:23.961 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:31:23.961 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 2m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:31:23.961 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 2m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:31:24.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:31:23 gibba045 bash[25517]: cluster 2021-03-10T17:31:22.740675+0000 mgr.gibba045.orlgmj (mgr.34412) 11727 : cluster [DBG] pgmap v6685: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:24.203 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:31:24.204 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:31:24.204 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:31:24.204 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:31:24.204 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:31:24.205 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:31:24.205 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:31:24.205 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:31:24.205 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:31:24.206 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:31:24.206 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:31:24.206 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:31:24.206 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:31:24.206 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:31:24.207 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:31:24.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:31:23 gibba015 bash[29377]: cluster 2021-03-10T17:31:22.740675+0000 mgr.gibba045.orlgmj (mgr.34412) 11727 : cluster [DBG] pgmap v6685: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:24.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:31:23 gibba015 bash[30343]: cluster 2021-03-10T17:31:22.740675+0000 mgr.gibba045.orlgmj (mgr.34412) 11727 : cluster [DBG] pgmap v6685: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:25.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:31:24 gibba045 bash[25517]: audit 2021-03-10T17:31:23.714391+0000 mgr.gibba045.orlgmj (mgr.34412) 11728 : audit [DBG] from='client.51918 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:31:25.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:31:24 gibba045 bash[25517]: audit 2021-03-10T17:31:24.201362+0000 mon.a (mon.0) 2446 : audit [DBG] from='client.? 172.21.2.115:0/1479107048' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:31:25.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:31:24 gibba015 bash[29377]: audit 2021-03-10T17:31:23.714391+0000 mgr.gibba045.orlgmj (mgr.34412) 11728 : audit [DBG] from='client.51918 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:31:25.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:31:24 gibba015 bash[29377]: audit 2021-03-10T17:31:24.201362+0000 mon.a (mon.0) 2446 : audit [DBG] from='client.? 172.21.2.115:0/1479107048' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:31:25.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:31:24 gibba015 bash[30343]: audit 2021-03-10T17:31:23.714391+0000 mgr.gibba045.orlgmj (mgr.34412) 11728 : audit [DBG] from='client.51918 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:31:25.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:31:24 gibba015 bash[30343]: audit 2021-03-10T17:31:24.201362+0000 mon.a (mon.0) 2446 : audit [DBG] from='client.? 172.21.2.115:0/1479107048' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:31:26.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:31:25 gibba015 bash[29377]: audit 2021-03-10T17:31:23.942918+0000 mgr.gibba045.orlgmj (mgr.34412) 11729 : audit [DBG] from='client.61912 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:31:26.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:31:25 gibba015 bash[29377]: cluster 2021-03-10T17:31:24.742316+0000 mgr.gibba045.orlgmj (mgr.34412) 11730 : cluster [DBG] pgmap v6686: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:26.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:31:25 gibba015 bash[30343]: audit 2021-03-10T17:31:23.942918+0000 mgr.gibba045.orlgmj (mgr.34412) 11729 : audit [DBG] from='client.61912 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:31:26.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:31:25 gibba015 bash[30343]: cluster 2021-03-10T17:31:24.742316+0000 mgr.gibba045.orlgmj (mgr.34412) 11730 : cluster [DBG] pgmap v6686: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:26.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:31:25 gibba045 bash[25517]: audit 2021-03-10T17:31:23.942918+0000 mgr.gibba045.orlgmj (mgr.34412) 11729 : audit [DBG] from='client.61912 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:31:26.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:31:25 gibba045 bash[25517]: cluster 2021-03-10T17:31:24.742316+0000 mgr.gibba045.orlgmj (mgr.34412) 11730 : cluster [DBG] pgmap v6686: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:28.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:31:27 gibba015 bash[29377]: cluster 2021-03-10T17:31:26.744189+0000 mgr.gibba045.orlgmj (mgr.34412) 11731 : cluster [DBG] pgmap v6687: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:28.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:31:27 gibba015 bash[30343]: cluster 2021-03-10T17:31:26.744189+0000 mgr.gibba045.orlgmj (mgr.34412) 11731 : cluster [DBG] pgmap v6687: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:28.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:31:27 gibba045 bash[25517]: cluster 2021-03-10T17:31:26.744189+0000 mgr.gibba045.orlgmj (mgr.34412) 11731 : cluster [DBG] pgmap v6687: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:29.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:31:29 gibba045 bash[25517]: cluster 2021-03-10T17:31:28.745743+0000 mgr.gibba045.orlgmj (mgr.34412) 11732 : cluster [DBG] pgmap v6688: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:29.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:31:29 gibba015 bash[29377]: cluster 2021-03-10T17:31:28.745743+0000 mgr.gibba045.orlgmj (mgr.34412) 11732 : cluster [DBG] pgmap v6688: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:29.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:31:29 gibba015 bash[30343]: cluster 2021-03-10T17:31:28.745743+0000 mgr.gibba045.orlgmj (mgr.34412) 11732 : cluster [DBG] pgmap v6688: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:32.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:31:31 gibba015 bash[29377]: cluster 2021-03-10T17:31:30.747332+0000 mgr.gibba045.orlgmj (mgr.34412) 11733 : cluster [DBG] pgmap v6689: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:32.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:31:31 gibba015 bash[30343]: cluster 2021-03-10T17:31:30.747332+0000 mgr.gibba045.orlgmj (mgr.34412) 11733 : cluster [DBG] pgmap v6689: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:32.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:31:31 gibba045 bash[25517]: cluster 2021-03-10T17:31:30.747332+0000 mgr.gibba045.orlgmj (mgr.34412) 11733 : cluster [DBG] pgmap v6689: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:34.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:31:33 gibba015 bash[29377]: cluster 2021-03-10T17:31:32.748991+0000 mgr.gibba045.orlgmj (mgr.34412) 11734 : cluster [DBG] pgmap v6690: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:34.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:31:33 gibba015 bash[30343]: cluster 2021-03-10T17:31:32.748991+0000 mgr.gibba045.orlgmj (mgr.34412) 11734 : cluster [DBG] pgmap v6690: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:34.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:31:33 gibba045 bash[25517]: cluster 2021-03-10T17:31:32.748991+0000 mgr.gibba045.orlgmj (mgr.34412) 11734 : cluster [DBG] pgmap v6690: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:36.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:31:35 gibba015 bash[29377]: cephadm 2021-03-10T17:31:34.668771+0000 mgr.gibba045.orlgmj (mgr.34412) 11735 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:31:36.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:31:35 gibba015 bash[29377]: cluster 2021-03-10T17:31:34.750567+0000 mgr.gibba045.orlgmj (mgr.34412) 11736 : cluster [DBG] pgmap v6691: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:36.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:31:35 gibba015 bash[30343]: cephadm 2021-03-10T17:31:34.668771+0000 mgr.gibba045.orlgmj (mgr.34412) 11735 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:31:36.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:31:35 gibba015 bash[30343]: cluster 2021-03-10T17:31:34.750567+0000 mgr.gibba045.orlgmj (mgr.34412) 11736 : cluster [DBG] pgmap v6691: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:36.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:31:35 gibba045 bash[25517]: cephadm 2021-03-10T17:31:34.668771+0000 mgr.gibba045.orlgmj (mgr.34412) 11735 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:31:36.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:31:35 gibba045 bash[25517]: cluster 2021-03-10T17:31:34.750567+0000 mgr.gibba045.orlgmj (mgr.34412) 11736 : cluster [DBG] pgmap v6691: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:38.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:31:37 gibba015 bash[29377]: cluster 2021-03-10T17:31:36.752124+0000 mgr.gibba045.orlgmj (mgr.34412) 11737 : cluster [DBG] pgmap v6692: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:38.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:31:37 gibba015 bash[30343]: cluster 2021-03-10T17:31:36.752124+0000 mgr.gibba045.orlgmj (mgr.34412) 11737 : cluster [DBG] pgmap v6692: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:38.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:31:37 gibba045 bash[25517]: cluster 2021-03-10T17:31:36.752124+0000 mgr.gibba045.orlgmj (mgr.34412) 11737 : cluster [DBG] pgmap v6692: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:39.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:31:39 gibba045 bash[25517]: cluster 2021-03-10T17:31:38.753495+0000 mgr.gibba045.orlgmj (mgr.34412) 11738 : cluster [DBG] pgmap v6693: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:39.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:31:39 gibba015 bash[29377]: cluster 2021-03-10T17:31:38.753495+0000 mgr.gibba045.orlgmj (mgr.34412) 11738 : cluster [DBG] pgmap v6693: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:39.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:31:39 gibba015 bash[30343]: cluster 2021-03-10T17:31:38.753495+0000 mgr.gibba045.orlgmj (mgr.34412) 11738 : cluster [DBG] pgmap v6693: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:42.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:31:41 gibba015 bash[29377]: cluster 2021-03-10T17:31:40.754852+0000 mgr.gibba045.orlgmj (mgr.34412) 11739 : cluster [DBG] pgmap v6694: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:42.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:31:41 gibba015 bash[30343]: cluster 2021-03-10T17:31:40.754852+0000 mgr.gibba045.orlgmj (mgr.34412) 11739 : cluster [DBG] pgmap v6694: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:42.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:31:41 gibba045 bash[25517]: cluster 2021-03-10T17:31:40.754852+0000 mgr.gibba045.orlgmj (mgr.34412) 11739 : cluster [DBG] pgmap v6694: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:44.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:31:43 gibba015 bash[29377]: cluster 2021-03-10T17:31:42.756549+0000 mgr.gibba045.orlgmj (mgr.34412) 11740 : cluster [DBG] pgmap v6695: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:44.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:31:43 gibba015 bash[30343]: cluster 2021-03-10T17:31:42.756549+0000 mgr.gibba045.orlgmj (mgr.34412) 11740 : cluster [DBG] pgmap v6695: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:44.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:31:43 gibba045 bash[25517]: cluster 2021-03-10T17:31:42.756549+0000 mgr.gibba045.orlgmj (mgr.34412) 11740 : cluster [DBG] pgmap v6695: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:46.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:31:45 gibba015 bash[29377]: cluster 2021-03-10T17:31:44.757888+0000 mgr.gibba045.orlgmj (mgr.34412) 11741 : cluster [DBG] pgmap v6696: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:46.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:31:45 gibba015 bash[30343]: cluster 2021-03-10T17:31:44.757888+0000 mgr.gibba045.orlgmj (mgr.34412) 11741 : cluster [DBG] pgmap v6696: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:46.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:31:45 gibba045 bash[25517]: cluster 2021-03-10T17:31:44.757888+0000 mgr.gibba045.orlgmj (mgr.34412) 11741 : cluster [DBG] pgmap v6696: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:48.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:31:47 gibba015 bash[29377]: cluster 2021-03-10T17:31:46.759554+0000 mgr.gibba045.orlgmj (mgr.34412) 11742 : cluster [DBG] pgmap v6697: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:48.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:31:47 gibba015 bash[30343]: cluster 2021-03-10T17:31:46.759554+0000 mgr.gibba045.orlgmj (mgr.34412) 11742 : cluster [DBG] pgmap v6697: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:48.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:31:47 gibba045 bash[25517]: cluster 2021-03-10T17:31:46.759554+0000 mgr.gibba045.orlgmj (mgr.34412) 11742 : cluster [DBG] pgmap v6697: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:49.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:31:49 gibba045 bash[25517]: cluster 2021-03-10T17:31:48.761040+0000 mgr.gibba045.orlgmj (mgr.34412) 11743 : cluster [DBG] pgmap v6698: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:49.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:31:49 gibba015 bash[29377]: cluster 2021-03-10T17:31:48.761040+0000 mgr.gibba045.orlgmj (mgr.34412) 11743 : cluster [DBG] pgmap v6698: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:49.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:31:49 gibba015 bash[30343]: cluster 2021-03-10T17:31:48.761040+0000 mgr.gibba045.orlgmj (mgr.34412) 11743 : cluster [DBG] pgmap v6698: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:50.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:31:50 gibba045 bash[25517]: audit 2021-03-10T17:31:49.683665+0000 mon.c (mon.1) 3215 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:31:50.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:31:50 gibba045 bash[25517]: cephadm 2021-03-10T17:31:49.690809+0000 mgr.gibba045.orlgmj (mgr.34412) 11744 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:31:50.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:31:50 gibba045 bash[25517]: cephadm 2021-03-10T17:31:49.692776+0000 mgr.gibba045.orlgmj (mgr.34412) 11745 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:31:50.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:31:50 gibba045 bash[25517]: audit 2021-03-10T17:31:49.902399+0000 mon.a (mon.0) 2447 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:31:50.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:31:50 gibba045 bash[25517]: audit 2021-03-10T17:31:49.914644+0000 mon.c (mon.1) 3216 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:31:50.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:31:50 gibba045 bash[25517]: audit 2021-03-10T17:31:49.918385+0000 mon.c (mon.1) 3217 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:31:50.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:31:50 gibba045 bash[25517]: audit 2021-03-10T17:31:49.921952+0000 mon.c (mon.1) 3218 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:31:50.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:31:50 gibba045 bash[25517]: audit 2021-03-10T17:31:49.924859+0000 mon.c (mon.1) 3219 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:31:50.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:31:50 gibba045 bash[25517]: audit 2021-03-10T17:31:49.933897+0000 mon.c (mon.1) 3220 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:31:50.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:31:50 gibba045 bash[25517]: audit 2021-03-10T17:31:49.939394+0000 mon.c (mon.1) 3221 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:31:50.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:31:50 gibba015 bash[29377]: audit 2021-03-10T17:31:49.683665+0000 mon.c (mon.1) 3215 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:31:50.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:31:50 gibba015 bash[29377]: cephadm 2021-03-10T17:31:49.690809+0000 mgr.gibba045.orlgmj (mgr.34412) 11744 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:31:50.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:31:50 gibba015 bash[29377]: cephadm 2021-03-10T17:31:49.692776+0000 mgr.gibba045.orlgmj (mgr.34412) 11745 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:31:50.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:31:50 gibba015 bash[29377]: audit 2021-03-10T17:31:49.902399+0000 mon.a (mon.0) 2447 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:31:50.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:31:50 gibba015 bash[29377]: audit 2021-03-10T17:31:49.914644+0000 mon.c (mon.1) 3216 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:31:50.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:31:50 gibba015 bash[29377]: audit 2021-03-10T17:31:49.918385+0000 mon.c (mon.1) 3217 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:31:50.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:31:50 gibba015 bash[29377]: audit 2021-03-10T17:31:49.921952+0000 mon.c (mon.1) 3218 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:31:50.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:31:50 gibba015 bash[29377]: audit 2021-03-10T17:31:49.924859+0000 mon.c (mon.1) 3219 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:31:50.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:31:50 gibba015 bash[29377]: audit 2021-03-10T17:31:49.933897+0000 mon.c (mon.1) 3220 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:31:50.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:31:50 gibba015 bash[29377]: audit 2021-03-10T17:31:49.939394+0000 mon.c (mon.1) 3221 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:31:50.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:31:50 gibba015 bash[30343]: audit 2021-03-10T17:31:49.683665+0000 mon.c (mon.1) 3215 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:31:50.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:31:50 gibba015 bash[30343]: cephadm 2021-03-10T17:31:49.690809+0000 mgr.gibba045.orlgmj (mgr.34412) 11744 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:31:50.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:31:50 gibba015 bash[30343]: cephadm 2021-03-10T17:31:49.692776+0000 mgr.gibba045.orlgmj (mgr.34412) 11745 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:31:50.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:31:50 gibba015 bash[30343]: audit 2021-03-10T17:31:49.902399+0000 mon.a (mon.0) 2447 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:31:50.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:31:50 gibba015 bash[30343]: audit 2021-03-10T17:31:49.914644+0000 mon.c (mon.1) 3216 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:31:50.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:31:50 gibba015 bash[30343]: audit 2021-03-10T17:31:49.918385+0000 mon.c (mon.1) 3217 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:31:50.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:31:50 gibba015 bash[30343]: audit 2021-03-10T17:31:49.921952+0000 mon.c (mon.1) 3218 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:31:50.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:31:50 gibba015 bash[30343]: audit 2021-03-10T17:31:49.924859+0000 mon.c (mon.1) 3219 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:31:50.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:31:50 gibba015 bash[30343]: audit 2021-03-10T17:31:49.933897+0000 mon.c (mon.1) 3220 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:31:50.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:31:50 gibba015 bash[30343]: audit 2021-03-10T17:31:49.939394+0000 mon.c (mon.1) 3221 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:31:51.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:31:51 gibba015 bash[29377]: cephadm 2021-03-10T17:31:49.914316+0000 mgr.gibba045.orlgmj (mgr.34412) 11746 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:31:51.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:31:51 gibba015 bash[29377]: cephadm 2021-03-10T17:31:49.918965+0000 mgr.gibba045.orlgmj (mgr.34412) 11747 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:31:51.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:31:51 gibba015 bash[29377]: cephadm 2021-03-10T17:31:49.922346+0000 mgr.gibba045.orlgmj (mgr.34412) 11748 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:31:51.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:31:51 gibba015 bash[29377]: cephadm 2021-03-10T17:31:49.922572+0000 mgr.gibba045.orlgmj (mgr.34412) 11749 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:31:51.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:31:51 gibba015 bash[29377]: cephadm 2021-03-10T17:31:49.925575+0000 mgr.gibba045.orlgmj (mgr.34412) 11750 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:31:51.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:31:51 gibba015 bash[29377]: cephadm 2021-03-10T17:31:49.926008+0000 mgr.gibba045.orlgmj (mgr.34412) 11751 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:31:51.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:31:51 gibba015 bash[29377]: cephadm 2021-03-10T17:31:49.929328+0000 mgr.gibba045.orlgmj (mgr.34412) 11752 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:31:51.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:31:51 gibba015 bash[29377]: cephadm 2021-03-10T17:31:49.934021+0000 mgr.gibba045.orlgmj (mgr.34412) 11753 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:31:51.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:31:51 gibba015 bash[29377]: cephadm 2021-03-10T17:31:49.934425+0000 mgr.gibba045.orlgmj (mgr.34412) 11754 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:31:51.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:31:51 gibba015 bash[29377]: cephadm 2021-03-10T17:31:49.938758+0000 mgr.gibba045.orlgmj (mgr.34412) 11755 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:31:51.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:31:51 gibba015 bash[29377]: cephadm 2021-03-10T17:31:49.940235+0000 mgr.gibba045.orlgmj (mgr.34412) 11756 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:31:51.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:31:51 gibba015 bash[29377]: cephadm 2021-03-10T17:31:49.943717+0000 mgr.gibba045.orlgmj (mgr.34412) 11757 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:31:51.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:31:51 gibba015 bash[29377]: cephadm 2021-03-10T17:31:49.943920+0000 mgr.gibba045.orlgmj (mgr.34412) 11758 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:31:51.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:31:51 gibba015 bash[29377]: cephadm 2021-03-10T17:31:49.944395+0000 mgr.gibba045.orlgmj (mgr.34412) 11759 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:31:51.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:31:51 gibba015 bash[29377]: cluster 2021-03-10T17:31:50.762602+0000 mgr.gibba045.orlgmj (mgr.34412) 11760 : cluster [DBG] pgmap v6699: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:51.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:31:51 gibba015 bash[30343]: cephadm 2021-03-10T17:31:49.914316+0000 mgr.gibba045.orlgmj (mgr.34412) 11746 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:31:51.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:31:51 gibba015 bash[30343]: cephadm 2021-03-10T17:31:49.918965+0000 mgr.gibba045.orlgmj (mgr.34412) 11747 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:31:51.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:31:51 gibba015 bash[30343]: cephadm 2021-03-10T17:31:49.922346+0000 mgr.gibba045.orlgmj (mgr.34412) 11748 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:31:51.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:31:51 gibba015 bash[30343]: cephadm 2021-03-10T17:31:49.922572+0000 mgr.gibba045.orlgmj (mgr.34412) 11749 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:31:51.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:31:51 gibba015 bash[30343]: cephadm 2021-03-10T17:31:49.925575+0000 mgr.gibba045.orlgmj (mgr.34412) 11750 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:31:51.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:31:51 gibba015 bash[30343]: cephadm 2021-03-10T17:31:49.926008+0000 mgr.gibba045.orlgmj (mgr.34412) 11751 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:31:51.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:31:51 gibba015 bash[30343]: cephadm 2021-03-10T17:31:49.929328+0000 mgr.gibba045.orlgmj (mgr.34412) 11752 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:31:51.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:31:51 gibba015 bash[30343]: cephadm 2021-03-10T17:31:49.934021+0000 mgr.gibba045.orlgmj (mgr.34412) 11753 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:31:51.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:31:51 gibba015 bash[30343]: cephadm 2021-03-10T17:31:49.934425+0000 mgr.gibba045.orlgmj (mgr.34412) 11754 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:31:51.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:31:51 gibba015 bash[30343]: cephadm 2021-03-10T17:31:49.938758+0000 mgr.gibba045.orlgmj (mgr.34412) 11755 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:31:51.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:31:51 gibba015 bash[30343]: cephadm 2021-03-10T17:31:49.940235+0000 mgr.gibba045.orlgmj (mgr.34412) 11756 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:31:51.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:31:51 gibba015 bash[30343]: cephadm 2021-03-10T17:31:49.943717+0000 mgr.gibba045.orlgmj (mgr.34412) 11757 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:31:51.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:31:51 gibba015 bash[30343]: cephadm 2021-03-10T17:31:49.943920+0000 mgr.gibba045.orlgmj (mgr.34412) 11758 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:31:51.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:31:51 gibba015 bash[30343]: cephadm 2021-03-10T17:31:49.944395+0000 mgr.gibba045.orlgmj (mgr.34412) 11759 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:31:51.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:31:51 gibba015 bash[30343]: cluster 2021-03-10T17:31:50.762602+0000 mgr.gibba045.orlgmj (mgr.34412) 11760 : cluster [DBG] pgmap v6699: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:51.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:31:51 gibba045 bash[25517]: cephadm 2021-03-10T17:31:49.914316+0000 mgr.gibba045.orlgmj (mgr.34412) 11746 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:31:51.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:31:51 gibba045 bash[25517]: cephadm 2021-03-10T17:31:49.918965+0000 mgr.gibba045.orlgmj (mgr.34412) 11747 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:31:51.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:31:51 gibba045 bash[25517]: cephadm 2021-03-10T17:31:49.922346+0000 mgr.gibba045.orlgmj (mgr.34412) 11748 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:31:51.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:31:51 gibba045 bash[25517]: cephadm 2021-03-10T17:31:49.922572+0000 mgr.gibba045.orlgmj (mgr.34412) 11749 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:31:51.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:31:51 gibba045 bash[25517]: cephadm 2021-03-10T17:31:49.925575+0000 mgr.gibba045.orlgmj (mgr.34412) 11750 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:31:51.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:31:51 gibba045 bash[25517]: cephadm 2021-03-10T17:31:49.926008+0000 mgr.gibba045.orlgmj (mgr.34412) 11751 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:31:51.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:31:51 gibba045 bash[25517]: cephadm 2021-03-10T17:31:49.929328+0000 mgr.gibba045.orlgmj (mgr.34412) 11752 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:31:51.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:31:51 gibba045 bash[25517]: cephadm 2021-03-10T17:31:49.934021+0000 mgr.gibba045.orlgmj (mgr.34412) 11753 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:31:51.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:31:51 gibba045 bash[25517]: cephadm 2021-03-10T17:31:49.934425+0000 mgr.gibba045.orlgmj (mgr.34412) 11754 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:31:51.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:31:51 gibba045 bash[25517]: cephadm 2021-03-10T17:31:49.938758+0000 mgr.gibba045.orlgmj (mgr.34412) 11755 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:31:51.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:31:51 gibba045 bash[25517]: cephadm 2021-03-10T17:31:49.940235+0000 mgr.gibba045.orlgmj (mgr.34412) 11756 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:31:51.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:31:51 gibba045 bash[25517]: cephadm 2021-03-10T17:31:49.943717+0000 mgr.gibba045.orlgmj (mgr.34412) 11757 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:31:51.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:31:51 gibba045 bash[25517]: cephadm 2021-03-10T17:31:49.943920+0000 mgr.gibba045.orlgmj (mgr.34412) 11758 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:31:51.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:31:51 gibba045 bash[25517]: cephadm 2021-03-10T17:31:49.944395+0000 mgr.gibba045.orlgmj (mgr.34412) 11759 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:31:51.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:31:51 gibba045 bash[25517]: cluster 2021-03-10T17:31:50.762602+0000 mgr.gibba045.orlgmj (mgr.34412) 11760 : cluster [DBG] pgmap v6699: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:54.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:31:53 gibba015 bash[29377]: cluster 2021-03-10T17:31:52.764292+0000 mgr.gibba045.orlgmj (mgr.34412) 11761 : cluster [DBG] pgmap v6700: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:54.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:31:53 gibba015 bash[30343]: cluster 2021-03-10T17:31:52.764292+0000 mgr.gibba045.orlgmj (mgr.34412) 11761 : cluster [DBG] pgmap v6700: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:31:53 gibba045 bash[25517]: cluster 2021-03-10T17:31:52.764292+0000 mgr.gibba045.orlgmj (mgr.34412) 11761 : cluster [DBG] pgmap v6700: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:54.449 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:31:54.681 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:31:54.681 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 4m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:31:54.682 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 3m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:31:54.682 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:31:54.682 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:31:54.682 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:31:54.683 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:31:54.683 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:31:54.683 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:31:54.683 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 4m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:31:54.683 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 3m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:31:54.684 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:31:54.684 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:31:54.684 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:31:54.684 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:31:54.685 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:31:54.685 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:31:54.685 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:31:54.685 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:31:54.686 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 3m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:31:54.686 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 3m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:31:54.930 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:31:54.930 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:31:54.931 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:31:54.931 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:31:54.931 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:31:54.931 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:31:54.932 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:31:54.932 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:31:54.932 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:31:54.932 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:31:54.933 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:31:54.933 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:31:54.933 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:31:54.933 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:31:54.934 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:31:55.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:31:54 gibba015 bash[29377]: audit 2021-03-10T17:31:54.110676+0000 mon.c (mon.1) 3222 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:31:55.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:31:54 gibba015 bash[29377]: audit 2021-03-10T17:31:54.111321+0000 mon.c (mon.1) 3223 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:31:55.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:31:54 gibba015 bash[29377]: audit 2021-03-10T17:31:54.112577+0000 mon.a (mon.0) 2448 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:31:55.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:31:54 gibba015 bash[29377]: audit 2021-03-10T17:31:54.113374+0000 mon.a (mon.0) 2449 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:31:55.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:31:54 gibba015 bash[29377]: audit 2021-03-10T17:31:54.204284+0000 mon.c (mon.1) 3224 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T17:31:55.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:31:54 gibba015 bash[29377]: audit 2021-03-10T17:31:54.205010+0000 mon.c (mon.1) 3225 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:31:55.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:31:54 gibba015 bash[29377]: audit 2021-03-10T17:31:54.205550+0000 mon.a (mon.0) 2450 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T17:31:55.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:31:54 gibba015 bash[29377]: audit 2021-03-10T17:31:54.205754+0000 mon.c (mon.1) 3226 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:31:55.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:31:54 gibba015 bash[29377]: audit 2021-03-10T17:31:54.206585+0000 mon.c (mon.1) 3227 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T17:31:55.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:31:54 gibba015 bash[29377]: audit 2021-03-10T17:31:54.206766+0000 mon.a (mon.0) 2451 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:31:55.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:31:54 gibba015 bash[29377]: audit 2021-03-10T17:31:54.207934+0000 mon.a (mon.0) 2452 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:31:55.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:31:54 gibba015 bash[29377]: audit 2021-03-10T17:31:54.208729+0000 mon.a (mon.0) 2453 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T17:31:55.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:31:54 gibba015 bash[30343]: audit 2021-03-10T17:31:54.110676+0000 mon.c (mon.1) 3222 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:31:55.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:31:54 gibba015 bash[30343]: audit 2021-03-10T17:31:54.111321+0000 mon.c (mon.1) 3223 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:31:55.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:31:54 gibba015 bash[30343]: audit 2021-03-10T17:31:54.112577+0000 mon.a (mon.0) 2448 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:31:55.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:31:54 gibba015 bash[30343]: audit 2021-03-10T17:31:54.113374+0000 mon.a (mon.0) 2449 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:31:55.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:31:54 gibba015 bash[30343]: audit 2021-03-10T17:31:54.204284+0000 mon.c (mon.1) 3224 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T17:31:55.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:31:54 gibba015 bash[30343]: audit 2021-03-10T17:31:54.205010+0000 mon.c (mon.1) 3225 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:31:55.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:31:54 gibba015 bash[30343]: audit 2021-03-10T17:31:54.205550+0000 mon.a (mon.0) 2450 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T17:31:55.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:31:54 gibba015 bash[30343]: audit 2021-03-10T17:31:54.205754+0000 mon.c (mon.1) 3226 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:31:55.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:31:54 gibba015 bash[30343]: audit 2021-03-10T17:31:54.206585+0000 mon.c (mon.1) 3227 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T17:31:55.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:31:54 gibba015 bash[30343]: audit 2021-03-10T17:31:54.206766+0000 mon.a (mon.0) 2451 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:31:55.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:31:54 gibba015 bash[30343]: audit 2021-03-10T17:31:54.207934+0000 mon.a (mon.0) 2452 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:31:55.234 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:31:54 gibba015 bash[30343]: audit 2021-03-10T17:31:54.208729+0000 mon.a (mon.0) 2453 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T17:31:55.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:31:54 gibba045 bash[25517]: audit 2021-03-10T17:31:54.110676+0000 mon.c (mon.1) 3222 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:31:55.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:31:54 gibba045 bash[25517]: audit 2021-03-10T17:31:54.111321+0000 mon.c (mon.1) 3223 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:31:55.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:31:54 gibba045 bash[25517]: audit 2021-03-10T17:31:54.112577+0000 mon.a (mon.0) 2448 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:31:55.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:31:54 gibba045 bash[25517]: audit 2021-03-10T17:31:54.113374+0000 mon.a (mon.0) 2449 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:31:55.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:31:54 gibba045 bash[25517]: audit 2021-03-10T17:31:54.204284+0000 mon.c (mon.1) 3224 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T17:31:55.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:31:54 gibba045 bash[25517]: audit 2021-03-10T17:31:54.205010+0000 mon.c (mon.1) 3225 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:31:55.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:31:54 gibba045 bash[25517]: audit 2021-03-10T17:31:54.205550+0000 mon.a (mon.0) 2450 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T17:31:55.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:31:54 gibba045 bash[25517]: audit 2021-03-10T17:31:54.205754+0000 mon.c (mon.1) 3226 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:31:55.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:31:54 gibba045 bash[25517]: audit 2021-03-10T17:31:54.206585+0000 mon.c (mon.1) 3227 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T17:31:55.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:31:54 gibba045 bash[25517]: audit 2021-03-10T17:31:54.206766+0000 mon.a (mon.0) 2451 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:31:55.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:31:54 gibba045 bash[25517]: audit 2021-03-10T17:31:54.207934+0000 mon.a (mon.0) 2452 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:31:55.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:31:54 gibba045 bash[25517]: audit 2021-03-10T17:31:54.208729+0000 mon.a (mon.0) 2453 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T17:31:56.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:31:55 gibba015 bash[29377]: audit 2021-03-10T17:31:54.439930+0000 mgr.gibba045.orlgmj (mgr.34412) 11762 : audit [DBG] from='client.61924 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:31:56.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:31:55 gibba015 bash[29377]: audit 2021-03-10T17:31:54.670290+0000 mgr.gibba045.orlgmj (mgr.34412) 11763 : audit [DBG] from='client.61930 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:31:56.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:31:55 gibba015 bash[29377]: cluster 2021-03-10T17:31:54.765611+0000 mgr.gibba045.orlgmj (mgr.34412) 11764 : cluster [DBG] pgmap v6701: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:56.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:31:55 gibba015 bash[29377]: audit 2021-03-10T17:31:54.928163+0000 mon.c (mon.1) 3228 : audit [DBG] from='client.? 172.21.2.115:0/663580024' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:31:56.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:31:55 gibba015 bash[30343]: audit 2021-03-10T17:31:54.439930+0000 mgr.gibba045.orlgmj (mgr.34412) 11762 : audit [DBG] from='client.61924 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:31:56.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:31:55 gibba015 bash[30343]: audit 2021-03-10T17:31:54.670290+0000 mgr.gibba045.orlgmj (mgr.34412) 11763 : audit [DBG] from='client.61930 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:31:56.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:31:55 gibba015 bash[30343]: cluster 2021-03-10T17:31:54.765611+0000 mgr.gibba045.orlgmj (mgr.34412) 11764 : cluster [DBG] pgmap v6701: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:56.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:31:55 gibba015 bash[30343]: audit 2021-03-10T17:31:54.928163+0000 mon.c (mon.1) 3228 : audit [DBG] from='client.? 172.21.2.115:0/663580024' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:31:56.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:31:55 gibba045 bash[25517]: audit 2021-03-10T17:31:54.439930+0000 mgr.gibba045.orlgmj (mgr.34412) 11762 : audit [DBG] from='client.61924 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:31:56.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:31:55 gibba045 bash[25517]: audit 2021-03-10T17:31:54.670290+0000 mgr.gibba045.orlgmj (mgr.34412) 11763 : audit [DBG] from='client.61930 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:31:56.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:31:55 gibba045 bash[25517]: cluster 2021-03-10T17:31:54.765611+0000 mgr.gibba045.orlgmj (mgr.34412) 11764 : cluster [DBG] pgmap v6701: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:56.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:31:55 gibba045 bash[25517]: audit 2021-03-10T17:31:54.928163+0000 mon.c (mon.1) 3228 : audit [DBG] from='client.? 172.21.2.115:0/663580024' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:31:58.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:31:57 gibba015 bash[29377]: cluster 2021-03-10T17:31:56.767502+0000 mgr.gibba045.orlgmj (mgr.34412) 11765 : cluster [DBG] pgmap v6702: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:58.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:31:57 gibba015 bash[30343]: cluster 2021-03-10T17:31:56.767502+0000 mgr.gibba045.orlgmj (mgr.34412) 11765 : cluster [DBG] pgmap v6702: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:58.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:31:57 gibba045 bash[25517]: cluster 2021-03-10T17:31:56.767502+0000 mgr.gibba045.orlgmj (mgr.34412) 11765 : cluster [DBG] pgmap v6702: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:59.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:31:59 gibba045 bash[25517]: cluster 2021-03-10T17:31:58.768886+0000 mgr.gibba045.orlgmj (mgr.34412) 11766 : cluster [DBG] pgmap v6703: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:59.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:31:59 gibba015 bash[29377]: cluster 2021-03-10T17:31:58.768886+0000 mgr.gibba045.orlgmj (mgr.34412) 11766 : cluster [DBG] pgmap v6703: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:59.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:31:59 gibba015 bash[30343]: cluster 2021-03-10T17:31:58.768886+0000 mgr.gibba045.orlgmj (mgr.34412) 11766 : cluster [DBG] pgmap v6703: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:02.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:32:01 gibba015 bash[29377]: cluster 2021-03-10T17:32:00.770317+0000 mgr.gibba045.orlgmj (mgr.34412) 11767 : cluster [DBG] pgmap v6704: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:02.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:32:01 gibba015 bash[30343]: cluster 2021-03-10T17:32:00.770317+0000 mgr.gibba045.orlgmj (mgr.34412) 11767 : cluster [DBG] pgmap v6704: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:02.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:32:01 gibba045 bash[25517]: cluster 2021-03-10T17:32:00.770317+0000 mgr.gibba045.orlgmj (mgr.34412) 11767 : cluster [DBG] pgmap v6704: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:04.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:32:03 gibba015 bash[29377]: cluster 2021-03-10T17:32:02.771866+0000 mgr.gibba045.orlgmj (mgr.34412) 11768 : cluster [DBG] pgmap v6705: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:04.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:32:03 gibba015 bash[30343]: cluster 2021-03-10T17:32:02.771866+0000 mgr.gibba045.orlgmj (mgr.34412) 11768 : cluster [DBG] pgmap v6705: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:04.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:32:03 gibba045 bash[25517]: cluster 2021-03-10T17:32:02.771866+0000 mgr.gibba045.orlgmj (mgr.34412) 11768 : cluster [DBG] pgmap v6705: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:06.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:32:05 gibba015 bash[29377]: cluster 2021-03-10T17:32:04.773520+0000 mgr.gibba045.orlgmj (mgr.34412) 11769 : cluster [DBG] pgmap v6706: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:06.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:32:05 gibba015 bash[30343]: cluster 2021-03-10T17:32:04.773520+0000 mgr.gibba045.orlgmj (mgr.34412) 11769 : cluster [DBG] pgmap v6706: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:06.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:32:05 gibba045 bash[25517]: cluster 2021-03-10T17:32:04.773520+0000 mgr.gibba045.orlgmj (mgr.34412) 11769 : cluster [DBG] pgmap v6706: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:07.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:32:06 gibba015 bash[29377]: cephadm 2021-03-10T17:32:04.957383+0000 mgr.gibba045.orlgmj (mgr.34412) 11770 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:32:07.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:32:06 gibba015 bash[30343]: cephadm 2021-03-10T17:32:04.957383+0000 mgr.gibba045.orlgmj (mgr.34412) 11770 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:32:07.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:32:06 gibba045 bash[25517]: cephadm 2021-03-10T17:32:04.957383+0000 mgr.gibba045.orlgmj (mgr.34412) 11770 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:32:08.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:32:07 gibba015 bash[29377]: cluster 2021-03-10T17:32:06.775307+0000 mgr.gibba045.orlgmj (mgr.34412) 11771 : cluster [DBG] pgmap v6707: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:08.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:32:07 gibba015 bash[30343]: cluster 2021-03-10T17:32:06.775307+0000 mgr.gibba045.orlgmj (mgr.34412) 11771 : cluster [DBG] pgmap v6707: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:08.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:32:07 gibba045 bash[25517]: cluster 2021-03-10T17:32:06.775307+0000 mgr.gibba045.orlgmj (mgr.34412) 11771 : cluster [DBG] pgmap v6707: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:09.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:32:09 gibba045 bash[25517]: cluster 2021-03-10T17:32:08.776676+0000 mgr.gibba045.orlgmj (mgr.34412) 11772 : cluster [DBG] pgmap v6708: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:09.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:32:09 gibba015 bash[29377]: cluster 2021-03-10T17:32:08.776676+0000 mgr.gibba045.orlgmj (mgr.34412) 11772 : cluster [DBG] pgmap v6708: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:09.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:32:09 gibba015 bash[30343]: cluster 2021-03-10T17:32:08.776676+0000 mgr.gibba045.orlgmj (mgr.34412) 11772 : cluster [DBG] pgmap v6708: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:12.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:32:11 gibba015 bash[29377]: cluster 2021-03-10T17:32:10.778309+0000 mgr.gibba045.orlgmj (mgr.34412) 11773 : cluster [DBG] pgmap v6709: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:12.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:32:11 gibba015 bash[30343]: cluster 2021-03-10T17:32:10.778309+0000 mgr.gibba045.orlgmj (mgr.34412) 11773 : cluster [DBG] pgmap v6709: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:12.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:32:11 gibba045 bash[25517]: cluster 2021-03-10T17:32:10.778309+0000 mgr.gibba045.orlgmj (mgr.34412) 11773 : cluster [DBG] pgmap v6709: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:14.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:32:13 gibba015 bash[29377]: cluster 2021-03-10T17:32:12.779808+0000 mgr.gibba045.orlgmj (mgr.34412) 11774 : cluster [DBG] pgmap v6710: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:14.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:32:13 gibba015 bash[30343]: cluster 2021-03-10T17:32:12.779808+0000 mgr.gibba045.orlgmj (mgr.34412) 11774 : cluster [DBG] pgmap v6710: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:14.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:32:13 gibba045 bash[25517]: cluster 2021-03-10T17:32:12.779808+0000 mgr.gibba045.orlgmj (mgr.34412) 11774 : cluster [DBG] pgmap v6710: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:16.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:32:15 gibba015 bash[29377]: cluster 2021-03-10T17:32:14.781361+0000 mgr.gibba045.orlgmj (mgr.34412) 11775 : cluster [DBG] pgmap v6711: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:16.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:32:15 gibba015 bash[30343]: cluster 2021-03-10T17:32:14.781361+0000 mgr.gibba045.orlgmj (mgr.34412) 11775 : cluster [DBG] pgmap v6711: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:16.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:32:15 gibba045 bash[25517]: cluster 2021-03-10T17:32:14.781361+0000 mgr.gibba045.orlgmj (mgr.34412) 11775 : cluster [DBG] pgmap v6711: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:17.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:32:16 gibba015 bash[29377]: cluster 2021-03-10T17:32:16.783102+0000 mgr.gibba045.orlgmj (mgr.34412) 11776 : cluster [DBG] pgmap v6712: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:17.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:32:16 gibba015 bash[30343]: cluster 2021-03-10T17:32:16.783102+0000 mgr.gibba045.orlgmj (mgr.34412) 11776 : cluster [DBG] pgmap v6712: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:17.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:32:16 gibba045 bash[25517]: cluster 2021-03-10T17:32:16.783102+0000 mgr.gibba045.orlgmj (mgr.34412) 11776 : cluster [DBG] pgmap v6712: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:19.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:32:19 gibba015 bash[29377]: cluster 2021-03-10T17:32:18.784589+0000 mgr.gibba045.orlgmj (mgr.34412) 11777 : cluster [DBG] pgmap v6713: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:19.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:32:19 gibba015 bash[30343]: cluster 2021-03-10T17:32:18.784589+0000 mgr.gibba045.orlgmj (mgr.34412) 11777 : cluster [DBG] pgmap v6713: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:19.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:32:19 gibba045 bash[25517]: cluster 2021-03-10T17:32:18.784589+0000 mgr.gibba045.orlgmj (mgr.34412) 11777 : cluster [DBG] pgmap v6713: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:22.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:32:21 gibba015 bash[29377]: cephadm 2021-03-10T17:32:19.967684+0000 mgr.gibba045.orlgmj (mgr.34412) 11778 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:32:22.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:32:21 gibba015 bash[29377]: cluster 2021-03-10T17:32:20.786062+0000 mgr.gibba045.orlgmj (mgr.34412) 11779 : cluster [DBG] pgmap v6714: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:22.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:32:21 gibba015 bash[30343]: cephadm 2021-03-10T17:32:19.967684+0000 mgr.gibba045.orlgmj (mgr.34412) 11778 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:32:22.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:32:21 gibba015 bash[30343]: cluster 2021-03-10T17:32:20.786062+0000 mgr.gibba045.orlgmj (mgr.34412) 11779 : cluster [DBG] pgmap v6714: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:22.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:32:21 gibba045 bash[25517]: cephadm 2021-03-10T17:32:19.967684+0000 mgr.gibba045.orlgmj (mgr.34412) 11778 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:32:22.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:32:21 gibba045 bash[25517]: cluster 2021-03-10T17:32:20.786062+0000 mgr.gibba045.orlgmj (mgr.34412) 11779 : cluster [DBG] pgmap v6714: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:24.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:32:23 gibba015 bash[29377]: cluster 2021-03-10T17:32:22.787573+0000 mgr.gibba045.orlgmj (mgr.34412) 11780 : cluster [DBG] pgmap v6715: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:24.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:32:23 gibba015 bash[30343]: cluster 2021-03-10T17:32:22.787573+0000 mgr.gibba045.orlgmj (mgr.34412) 11780 : cluster [DBG] pgmap v6715: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:24.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:32:23 gibba045 bash[25517]: cluster 2021-03-10T17:32:22.787573+0000 mgr.gibba045.orlgmj (mgr.34412) 11780 : cluster [DBG] pgmap v6715: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:25.175 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:32:25.402 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:32:25.403 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 4m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:32:25.403 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 3m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:32:25.403 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:32:25.404 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:32:25.404 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:32:25.404 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:32:25.404 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:32:25.405 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:32:25.405 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 4m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:32:25.405 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 3m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:32:25.405 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:32:25.405 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:32:25.406 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:32:25.406 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:32:25.406 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:32:25.406 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:32:25.407 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:32:25.407 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:32:25.407 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 3m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:32:25.407 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 3m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:32:25.650 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:32:25.651 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:32:25.651 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:32:25.651 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:32:25.651 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:32:25.651 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:32:25.652 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:32:25.652 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:32:25.652 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:32:25.652 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:32:25.653 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:32:25.653 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:32:25.653 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:32:25.653 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:32:25.653 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:32:26.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:32:25 gibba015 bash[29377]: cluster 2021-03-10T17:32:24.789204+0000 mgr.gibba045.orlgmj (mgr.34412) 11781 : cluster [DBG] pgmap v6716: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:26.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:32:25 gibba015 bash[29377]: audit 2021-03-10T17:32:25.648096+0000 mon.a (mon.0) 2454 : audit [DBG] from='client.? 172.21.2.115:0/3613767952' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:32:26.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:32:25 gibba015 bash[30343]: cluster 2021-03-10T17:32:24.789204+0000 mgr.gibba045.orlgmj (mgr.34412) 11781 : cluster [DBG] pgmap v6716: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:26.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:32:25 gibba015 bash[30343]: audit 2021-03-10T17:32:25.648096+0000 mon.a (mon.0) 2454 : audit [DBG] from='client.? 172.21.2.115:0/3613767952' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:32:26.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:32:25 gibba045 bash[25517]: cluster 2021-03-10T17:32:24.789204+0000 mgr.gibba045.orlgmj (mgr.34412) 11781 : cluster [DBG] pgmap v6716: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:26.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:32:25 gibba045 bash[25517]: audit 2021-03-10T17:32:25.648096+0000 mon.a (mon.0) 2454 : audit [DBG] from='client.? 172.21.2.115:0/3613767952' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:32:27.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:32:26 gibba015 bash[29377]: audit 2021-03-10T17:32:25.165735+0000 mgr.gibba045.orlgmj (mgr.34412) 11782 : audit [DBG] from='client.51954 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:32:27.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:32:26 gibba015 bash[29377]: audit 2021-03-10T17:32:25.390226+0000 mgr.gibba045.orlgmj (mgr.34412) 11783 : audit [DBG] from='client.51960 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:32:27.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:32:26 gibba015 bash[29377]: cluster 2021-03-10T17:32:26.790963+0000 mgr.gibba045.orlgmj (mgr.34412) 11784 : cluster [DBG] pgmap v6717: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:27.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:32:26 gibba015 bash[30343]: audit 2021-03-10T17:32:25.165735+0000 mgr.gibba045.orlgmj (mgr.34412) 11782 : audit [DBG] from='client.51954 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:32:27.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:32:26 gibba015 bash[30343]: audit 2021-03-10T17:32:25.390226+0000 mgr.gibba045.orlgmj (mgr.34412) 11783 : audit [DBG] from='client.51960 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:32:27.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:32:26 gibba015 bash[30343]: cluster 2021-03-10T17:32:26.790963+0000 mgr.gibba045.orlgmj (mgr.34412) 11784 : cluster [DBG] pgmap v6717: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:27.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:32:26 gibba045 bash[25517]: audit 2021-03-10T17:32:25.165735+0000 mgr.gibba045.orlgmj (mgr.34412) 11782 : audit [DBG] from='client.51954 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:32:27.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:32:26 gibba045 bash[25517]: audit 2021-03-10T17:32:25.390226+0000 mgr.gibba045.orlgmj (mgr.34412) 11783 : audit [DBG] from='client.51960 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:32:27.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:32:26 gibba045 bash[25517]: cluster 2021-03-10T17:32:26.790963+0000 mgr.gibba045.orlgmj (mgr.34412) 11784 : cluster [DBG] pgmap v6717: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:29.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:32:29 gibba015 bash[29377]: cluster 2021-03-10T17:32:28.792288+0000 mgr.gibba045.orlgmj (mgr.34412) 11785 : cluster [DBG] pgmap v6718: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:29.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:32:29 gibba015 bash[30343]: cluster 2021-03-10T17:32:28.792288+0000 mgr.gibba045.orlgmj (mgr.34412) 11785 : cluster [DBG] pgmap v6718: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:29.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:32:29 gibba045 bash[25517]: cluster 2021-03-10T17:32:28.792288+0000 mgr.gibba045.orlgmj (mgr.34412) 11785 : cluster [DBG] pgmap v6718: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:32.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:32:31 gibba015 bash[29377]: cluster 2021-03-10T17:32:30.793791+0000 mgr.gibba045.orlgmj (mgr.34412) 11786 : cluster [DBG] pgmap v6719: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:32.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:32:31 gibba015 bash[30343]: cluster 2021-03-10T17:32:30.793791+0000 mgr.gibba045.orlgmj (mgr.34412) 11786 : cluster [DBG] pgmap v6719: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:32.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:32:31 gibba045 bash[25517]: cluster 2021-03-10T17:32:30.793791+0000 mgr.gibba045.orlgmj (mgr.34412) 11786 : cluster [DBG] pgmap v6719: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:34.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:32:33 gibba015 bash[29377]: cluster 2021-03-10T17:32:32.795055+0000 mgr.gibba045.orlgmj (mgr.34412) 11787 : cluster [DBG] pgmap v6720: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:34.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:32:33 gibba015 bash[30343]: cluster 2021-03-10T17:32:32.795055+0000 mgr.gibba045.orlgmj (mgr.34412) 11787 : cluster [DBG] pgmap v6720: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:34.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:32:33 gibba045 bash[25517]: cluster 2021-03-10T17:32:32.795055+0000 mgr.gibba045.orlgmj (mgr.34412) 11787 : cluster [DBG] pgmap v6720: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:35.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:32:34 gibba015 bash[29377]: cluster 2021-03-10T17:32:34.796792+0000 mgr.gibba045.orlgmj (mgr.34412) 11788 : cluster [DBG] pgmap v6721: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:35.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:32:34 gibba015 bash[30343]: cluster 2021-03-10T17:32:34.796792+0000 mgr.gibba045.orlgmj (mgr.34412) 11788 : cluster [DBG] pgmap v6721: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:35.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:32:34 gibba045 bash[25517]: cluster 2021-03-10T17:32:34.796792+0000 mgr.gibba045.orlgmj (mgr.34412) 11788 : cluster [DBG] pgmap v6721: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:36.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:32:35 gibba015 bash[29377]: cephadm 2021-03-10T17:32:34.983622+0000 mgr.gibba045.orlgmj (mgr.34412) 11789 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:32:36.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:32:35 gibba015 bash[30343]: cephadm 2021-03-10T17:32:34.983622+0000 mgr.gibba045.orlgmj (mgr.34412) 11789 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:32:36.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:32:35 gibba045 bash[25517]: cephadm 2021-03-10T17:32:34.983622+0000 mgr.gibba045.orlgmj (mgr.34412) 11789 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:32:37.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:32:36 gibba015 bash[29377]: cluster 2021-03-10T17:32:36.798531+0000 mgr.gibba045.orlgmj (mgr.34412) 11790 : cluster [DBG] pgmap v6722: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:37.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:32:36 gibba015 bash[30343]: cluster 2021-03-10T17:32:36.798531+0000 mgr.gibba045.orlgmj (mgr.34412) 11790 : cluster [DBG] pgmap v6722: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:37.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:32:36 gibba045 bash[25517]: cluster 2021-03-10T17:32:36.798531+0000 mgr.gibba045.orlgmj (mgr.34412) 11790 : cluster [DBG] pgmap v6722: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:39.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:32:39 gibba015 bash[29377]: cluster 2021-03-10T17:32:38.799796+0000 mgr.gibba045.orlgmj (mgr.34412) 11791 : cluster [DBG] pgmap v6723: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:39.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:32:39 gibba015 bash[30343]: cluster 2021-03-10T17:32:38.799796+0000 mgr.gibba045.orlgmj (mgr.34412) 11791 : cluster [DBG] pgmap v6723: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:39.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:32:39 gibba045 bash[25517]: cluster 2021-03-10T17:32:38.799796+0000 mgr.gibba045.orlgmj (mgr.34412) 11791 : cluster [DBG] pgmap v6723: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:42.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:32:41 gibba015 bash[29377]: cluster 2021-03-10T17:32:40.801322+0000 mgr.gibba045.orlgmj (mgr.34412) 11792 : cluster [DBG] pgmap v6724: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:42.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:32:41 gibba015 bash[30343]: cluster 2021-03-10T17:32:40.801322+0000 mgr.gibba045.orlgmj (mgr.34412) 11792 : cluster [DBG] pgmap v6724: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:42.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:32:41 gibba045 bash[25517]: cluster 2021-03-10T17:32:40.801322+0000 mgr.gibba045.orlgmj (mgr.34412) 11792 : cluster [DBG] pgmap v6724: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:44.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:32:43 gibba015 bash[29377]: cluster 2021-03-10T17:32:42.802848+0000 mgr.gibba045.orlgmj (mgr.34412) 11793 : cluster [DBG] pgmap v6725: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:44.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:32:43 gibba015 bash[30343]: cluster 2021-03-10T17:32:42.802848+0000 mgr.gibba045.orlgmj (mgr.34412) 11793 : cluster [DBG] pgmap v6725: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:44.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:32:43 gibba045 bash[25517]: cluster 2021-03-10T17:32:42.802848+0000 mgr.gibba045.orlgmj (mgr.34412) 11793 : cluster [DBG] pgmap v6725: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:45.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:32:44 gibba015 bash[29377]: cluster 2021-03-10T17:32:44.805153+0000 mgr.gibba045.orlgmj (mgr.34412) 11794 : cluster [DBG] pgmap v6726: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:45.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:32:44 gibba015 bash[30343]: cluster 2021-03-10T17:32:44.805153+0000 mgr.gibba045.orlgmj (mgr.34412) 11794 : cluster [DBG] pgmap v6726: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:45.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:32:44 gibba045 bash[25517]: cluster 2021-03-10T17:32:44.805153+0000 mgr.gibba045.orlgmj (mgr.34412) 11794 : cluster [DBG] pgmap v6726: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:48.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:32:47 gibba015 bash[29377]: cluster 2021-03-10T17:32:46.807013+0000 mgr.gibba045.orlgmj (mgr.34412) 11795 : cluster [DBG] pgmap v6727: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:48.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:32:47 gibba015 bash[30343]: cluster 2021-03-10T17:32:46.807013+0000 mgr.gibba045.orlgmj (mgr.34412) 11795 : cluster [DBG] pgmap v6727: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:48.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:32:47 gibba045 bash[25517]: cluster 2021-03-10T17:32:46.807013+0000 mgr.gibba045.orlgmj (mgr.34412) 11795 : cluster [DBG] pgmap v6727: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:49.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:32:49 gibba015 bash[29377]: cluster 2021-03-10T17:32:48.807637+0000 mgr.gibba045.orlgmj (mgr.34412) 11796 : cluster [DBG] pgmap v6728: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:49.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:32:49 gibba015 bash[30343]: cluster 2021-03-10T17:32:48.807637+0000 mgr.gibba045.orlgmj (mgr.34412) 11796 : cluster [DBG] pgmap v6728: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:49.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:32:49 gibba045 bash[25517]: cluster 2021-03-10T17:32:48.807637+0000 mgr.gibba045.orlgmj (mgr.34412) 11796 : cluster [DBG] pgmap v6728: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:50.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:32:50 gibba015 bash[29377]: audit 2021-03-10T17:32:49.998504+0000 mon.c (mon.1) 3229 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:32:50.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:32:50 gibba015 bash[30343]: audit 2021-03-10T17:32:49.998504+0000 mon.c (mon.1) 3229 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:32:50.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:32:50 gibba045 bash[25517]: audit 2021-03-10T17:32:49.998504+0000 mon.c (mon.1) 3229 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:32:51.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:32:51 gibba015 bash[29377]: cephadm 2021-03-10T17:32:50.005991+0000 mgr.gibba045.orlgmj (mgr.34412) 11797 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:32:51.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:32:51 gibba015 bash[29377]: cephadm 2021-03-10T17:32:50.006551+0000 mgr.gibba045.orlgmj (mgr.34412) 11798 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:32:51.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:32:51 gibba015 bash[29377]: audit 2021-03-10T17:32:50.195142+0000 mon.a (mon.0) 2455 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:32:51.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:32:51 gibba015 bash[29377]: audit 2021-03-10T17:32:50.199031+0000 mon.c (mon.1) 3230 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:32:51.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:32:51 gibba015 bash[29377]: cephadm 2021-03-10T17:32:50.199879+0000 mgr.gibba045.orlgmj (mgr.34412) 11799 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:32:51.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:32:51 gibba015 bash[29377]: audit 2021-03-10T17:32:50.200857+0000 mon.c (mon.1) 3231 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:32:51.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:32:51 gibba015 bash[29377]: cephadm 2021-03-10T17:32:50.202278+0000 mgr.gibba045.orlgmj (mgr.34412) 11800 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:32:51.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:32:51 gibba015 bash[29377]: audit 2021-03-10T17:32:50.202618+0000 mon.c (mon.1) 3232 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:32:51.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:32:51 gibba015 bash[29377]: cephadm 2021-03-10T17:32:50.203903+0000 mgr.gibba045.orlgmj (mgr.34412) 11801 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:32:51.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:32:51 gibba015 bash[29377]: cephadm 2021-03-10T17:32:50.203942+0000 mgr.gibba045.orlgmj (mgr.34412) 11802 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:32:51.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:32:51 gibba015 bash[29377]: audit 2021-03-10T17:32:50.204164+0000 mon.c (mon.1) 3233 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:32:51.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:32:51 gibba015 bash[29377]: cephadm 2021-03-10T17:32:50.205608+0000 mgr.gibba045.orlgmj (mgr.34412) 11803 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:32:51.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:32:51 gibba015 bash[29377]: cephadm 2021-03-10T17:32:50.205649+0000 mgr.gibba045.orlgmj (mgr.34412) 11804 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:32:51.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:32:51 gibba015 bash[29377]: cephadm 2021-03-10T17:32:50.207029+0000 mgr.gibba045.orlgmj (mgr.34412) 11805 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:32:51.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:32:51 gibba015 bash[29377]: audit 2021-03-10T17:32:50.207276+0000 mon.c (mon.1) 3234 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:32:51.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:32:51 gibba015 bash[29377]: cephadm 2021-03-10T17:32:50.208589+0000 mgr.gibba045.orlgmj (mgr.34412) 11806 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:32:51.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:32:51 gibba015 bash[29377]: cephadm 2021-03-10T17:32:50.208625+0000 mgr.gibba045.orlgmj (mgr.34412) 11807 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:32:51.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:32:51 gibba015 bash[29377]: audit 2021-03-10T17:32:50.208735+0000 mon.c (mon.1) 3235 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:32:51.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:32:51 gibba015 bash[29377]: cephadm 2021-03-10T17:32:50.209950+0000 mgr.gibba045.orlgmj (mgr.34412) 11808 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:32:51.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:32:51 gibba015 bash[29377]: cephadm 2021-03-10T17:32:50.210267+0000 mgr.gibba045.orlgmj (mgr.34412) 11809 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:32:51.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:32:51 gibba015 bash[29377]: cephadm 2021-03-10T17:32:50.211402+0000 mgr.gibba045.orlgmj (mgr.34412) 11810 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:32:51.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:32:51 gibba015 bash[29377]: cephadm 2021-03-10T17:32:50.211441+0000 mgr.gibba045.orlgmj (mgr.34412) 11811 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:32:51.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:32:51 gibba015 bash[29377]: cephadm 2021-03-10T17:32:50.211547+0000 mgr.gibba045.orlgmj (mgr.34412) 11812 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:32:51.479 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:32:51 gibba015 bash[29377]: cluster 2021-03-10T17:32:50.809354+0000 mgr.gibba045.orlgmj (mgr.34412) 11813 : cluster [DBG] pgmap v6729: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:51.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:32:51 gibba015 bash[30343]: cephadm 2021-03-10T17:32:50.005991+0000 mgr.gibba045.orlgmj (mgr.34412) 11797 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:32:51.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:32:51 gibba015 bash[30343]: cephadm 2021-03-10T17:32:50.006551+0000 mgr.gibba045.orlgmj (mgr.34412) 11798 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:32:51.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:32:51 gibba015 bash[30343]: audit 2021-03-10T17:32:50.195142+0000 mon.a (mon.0) 2455 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:32:51.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:32:51 gibba015 bash[30343]: audit 2021-03-10T17:32:50.199031+0000 mon.c (mon.1) 3230 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:32:51.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:32:51 gibba015 bash[30343]: cephadm 2021-03-10T17:32:50.199879+0000 mgr.gibba045.orlgmj (mgr.34412) 11799 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:32:51.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:32:51 gibba015 bash[30343]: audit 2021-03-10T17:32:50.200857+0000 mon.c (mon.1) 3231 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:32:51.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:32:51 gibba015 bash[30343]: cephadm 2021-03-10T17:32:50.202278+0000 mgr.gibba045.orlgmj (mgr.34412) 11800 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:32:51.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:32:51 gibba015 bash[30343]: audit 2021-03-10T17:32:50.202618+0000 mon.c (mon.1) 3232 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:32:51.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:32:51 gibba015 bash[30343]: cephadm 2021-03-10T17:32:50.203903+0000 mgr.gibba045.orlgmj (mgr.34412) 11801 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:32:51.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:32:51 gibba015 bash[30343]: cephadm 2021-03-10T17:32:50.203942+0000 mgr.gibba045.orlgmj (mgr.34412) 11802 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:32:51.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:32:51 gibba015 bash[30343]: audit 2021-03-10T17:32:50.204164+0000 mon.c (mon.1) 3233 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:32:51.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:32:51 gibba015 bash[30343]: cephadm 2021-03-10T17:32:50.205608+0000 mgr.gibba045.orlgmj (mgr.34412) 11803 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:32:51.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:32:51 gibba015 bash[30343]: cephadm 2021-03-10T17:32:50.205649+0000 mgr.gibba045.orlgmj (mgr.34412) 11804 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:32:51.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:32:51 gibba015 bash[30343]: cephadm 2021-03-10T17:32:50.207029+0000 mgr.gibba045.orlgmj (mgr.34412) 11805 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:32:51.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:32:51 gibba015 bash[30343]: audit 2021-03-10T17:32:50.207276+0000 mon.c (mon.1) 3234 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:32:51.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:32:51 gibba015 bash[30343]: cephadm 2021-03-10T17:32:50.208589+0000 mgr.gibba045.orlgmj (mgr.34412) 11806 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:32:51.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:32:51 gibba015 bash[30343]: cephadm 2021-03-10T17:32:50.208625+0000 mgr.gibba045.orlgmj (mgr.34412) 11807 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:32:51.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:32:51 gibba015 bash[30343]: audit 2021-03-10T17:32:50.208735+0000 mon.c (mon.1) 3235 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:32:51.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:32:51 gibba015 bash[30343]: cephadm 2021-03-10T17:32:50.209950+0000 mgr.gibba045.orlgmj (mgr.34412) 11808 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:32:51.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:32:51 gibba015 bash[30343]: cephadm 2021-03-10T17:32:50.210267+0000 mgr.gibba045.orlgmj (mgr.34412) 11809 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:32:51.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:32:51 gibba015 bash[30343]: cephadm 2021-03-10T17:32:50.211402+0000 mgr.gibba045.orlgmj (mgr.34412) 11810 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:32:51.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:32:51 gibba015 bash[30343]: cephadm 2021-03-10T17:32:50.211441+0000 mgr.gibba045.orlgmj (mgr.34412) 11811 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:32:51.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:32:51 gibba015 bash[30343]: cephadm 2021-03-10T17:32:50.211547+0000 mgr.gibba045.orlgmj (mgr.34412) 11812 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:32:51.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:32:51 gibba015 bash[30343]: cluster 2021-03-10T17:32:50.809354+0000 mgr.gibba045.orlgmj (mgr.34412) 11813 : cluster [DBG] pgmap v6729: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:51.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:32:51 gibba045 bash[25517]: cephadm 2021-03-10T17:32:50.005991+0000 mgr.gibba045.orlgmj (mgr.34412) 11797 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:32:51.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:32:51 gibba045 bash[25517]: cephadm 2021-03-10T17:32:50.006551+0000 mgr.gibba045.orlgmj (mgr.34412) 11798 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:32:51.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:32:51 gibba045 bash[25517]: audit 2021-03-10T17:32:50.195142+0000 mon.a (mon.0) 2455 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:32:51.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:32:51 gibba045 bash[25517]: audit 2021-03-10T17:32:50.199031+0000 mon.c (mon.1) 3230 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:32:51.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:32:51 gibba045 bash[25517]: cephadm 2021-03-10T17:32:50.199879+0000 mgr.gibba045.orlgmj (mgr.34412) 11799 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:32:51.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:32:51 gibba045 bash[25517]: audit 2021-03-10T17:32:50.200857+0000 mon.c (mon.1) 3231 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:32:51.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:32:51 gibba045 bash[25517]: cephadm 2021-03-10T17:32:50.202278+0000 mgr.gibba045.orlgmj (mgr.34412) 11800 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:32:51.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:32:51 gibba045 bash[25517]: audit 2021-03-10T17:32:50.202618+0000 mon.c (mon.1) 3232 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:32:51.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:32:51 gibba045 bash[25517]: cephadm 2021-03-10T17:32:50.203903+0000 mgr.gibba045.orlgmj (mgr.34412) 11801 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:32:51.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:32:51 gibba045 bash[25517]: cephadm 2021-03-10T17:32:50.203942+0000 mgr.gibba045.orlgmj (mgr.34412) 11802 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:32:51.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:32:51 gibba045 bash[25517]: audit 2021-03-10T17:32:50.204164+0000 mon.c (mon.1) 3233 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:32:51.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:32:51 gibba045 bash[25517]: cephadm 2021-03-10T17:32:50.205608+0000 mgr.gibba045.orlgmj (mgr.34412) 11803 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:32:51.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:32:51 gibba045 bash[25517]: cephadm 2021-03-10T17:32:50.205649+0000 mgr.gibba045.orlgmj (mgr.34412) 11804 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:32:51.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:32:51 gibba045 bash[25517]: cephadm 2021-03-10T17:32:50.207029+0000 mgr.gibba045.orlgmj (mgr.34412) 11805 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:32:51.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:32:51 gibba045 bash[25517]: audit 2021-03-10T17:32:50.207276+0000 mon.c (mon.1) 3234 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:32:51.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:32:51 gibba045 bash[25517]: cephadm 2021-03-10T17:32:50.208589+0000 mgr.gibba045.orlgmj (mgr.34412) 11806 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:32:51.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:32:51 gibba045 bash[25517]: cephadm 2021-03-10T17:32:50.208625+0000 mgr.gibba045.orlgmj (mgr.34412) 11807 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:32:51.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:32:51 gibba045 bash[25517]: audit 2021-03-10T17:32:50.208735+0000 mon.c (mon.1) 3235 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:32:51.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:32:51 gibba045 bash[25517]: cephadm 2021-03-10T17:32:50.209950+0000 mgr.gibba045.orlgmj (mgr.34412) 11808 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:32:51.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:32:51 gibba045 bash[25517]: cephadm 2021-03-10T17:32:50.210267+0000 mgr.gibba045.orlgmj (mgr.34412) 11809 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:32:51.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:32:51 gibba045 bash[25517]: cephadm 2021-03-10T17:32:50.211402+0000 mgr.gibba045.orlgmj (mgr.34412) 11810 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:32:51.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:32:51 gibba045 bash[25517]: cephadm 2021-03-10T17:32:50.211441+0000 mgr.gibba045.orlgmj (mgr.34412) 11811 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:32:51.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:32:51 gibba045 bash[25517]: cephadm 2021-03-10T17:32:50.211547+0000 mgr.gibba045.orlgmj (mgr.34412) 11812 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:32:51.563 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:32:51 gibba045 bash[25517]: cluster 2021-03-10T17:32:50.809354+0000 mgr.gibba045.orlgmj (mgr.34412) 11813 : cluster [DBG] pgmap v6729: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:54.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:32:53 gibba015 bash[29377]: cluster 2021-03-10T17:32:52.809802+0000 mgr.gibba045.orlgmj (mgr.34412) 11814 : cluster [DBG] pgmap v6730: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:54.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:32:53 gibba015 bash[30343]: cluster 2021-03-10T17:32:52.809802+0000 mgr.gibba045.orlgmj (mgr.34412) 11814 : cluster [DBG] pgmap v6730: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:54.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:32:53 gibba045 bash[25517]: cluster 2021-03-10T17:32:52.809802+0000 mgr.gibba045.orlgmj (mgr.34412) 11814 : cluster [DBG] pgmap v6730: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:55.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:32:54 gibba015 bash[29377]: audit 2021-03-10T17:32:54.117016+0000 mon.c (mon.1) 3236 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:32:55.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:32:54 gibba015 bash[29377]: audit 2021-03-10T17:32:54.118291+0000 mon.a (mon.0) 2456 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:32:55.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:32:54 gibba015 bash[29377]: audit 2021-03-10T17:32:54.120248+0000 mon.c (mon.1) 3237 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:32:55.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:32:54 gibba015 bash[29377]: audit 2021-03-10T17:32:54.121391+0000 mon.a (mon.0) 2457 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:32:55.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:32:54 gibba015 bash[29377]: audit 2021-03-10T17:32:54.214452+0000 mon.c (mon.1) 3238 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T17:32:55.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:32:54 gibba015 bash[29377]: audit 2021-03-10T17:32:54.215230+0000 mon.c (mon.1) 3239 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T17:32:55.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:32:54 gibba015 bash[29377]: audit 2021-03-10T17:32:54.215717+0000 mon.a (mon.0) 2458 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T17:32:55.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:32:54 gibba015 bash[29377]: audit 2021-03-10T17:32:54.215902+0000 mon.c (mon.1) 3240 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:32:55.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:32:54 gibba015 bash[29377]: audit 2021-03-10T17:32:54.216552+0000 mon.c (mon.1) 3241 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:32:55.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:32:54 gibba015 bash[29377]: audit 2021-03-10T17:32:54.217304+0000 mon.a (mon.0) 2459 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T17:32:55.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:32:54 gibba015 bash[29377]: audit 2021-03-10T17:32:54.218299+0000 mon.a (mon.0) 2460 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:32:55.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:32:54 gibba015 bash[29377]: audit 2021-03-10T17:32:54.219067+0000 mon.a (mon.0) 2461 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:32:55.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:32:54 gibba015 bash[30343]: audit 2021-03-10T17:32:54.117016+0000 mon.c (mon.1) 3236 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:32:55.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:32:54 gibba015 bash[30343]: audit 2021-03-10T17:32:54.118291+0000 mon.a (mon.0) 2456 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:32:55.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:32:54 gibba015 bash[30343]: audit 2021-03-10T17:32:54.120248+0000 mon.c (mon.1) 3237 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:32:55.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:32:54 gibba015 bash[30343]: audit 2021-03-10T17:32:54.121391+0000 mon.a (mon.0) 2457 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:32:55.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:32:54 gibba015 bash[30343]: audit 2021-03-10T17:32:54.214452+0000 mon.c (mon.1) 3238 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T17:32:55.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:32:54 gibba015 bash[30343]: audit 2021-03-10T17:32:54.215230+0000 mon.c (mon.1) 3239 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T17:32:55.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:32:54 gibba015 bash[30343]: audit 2021-03-10T17:32:54.215717+0000 mon.a (mon.0) 2458 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T17:32:55.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:32:54 gibba015 bash[30343]: audit 2021-03-10T17:32:54.215902+0000 mon.c (mon.1) 3240 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:32:55.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:32:54 gibba015 bash[30343]: audit 2021-03-10T17:32:54.216552+0000 mon.c (mon.1) 3241 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:32:55.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:32:54 gibba015 bash[30343]: audit 2021-03-10T17:32:54.217304+0000 mon.a (mon.0) 2459 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T17:32:55.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:32:54 gibba015 bash[30343]: audit 2021-03-10T17:32:54.218299+0000 mon.a (mon.0) 2460 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:32:55.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:32:54 gibba015 bash[30343]: audit 2021-03-10T17:32:54.219067+0000 mon.a (mon.0) 2461 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:32:55.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:32:54 gibba045 bash[25517]: audit 2021-03-10T17:32:54.117016+0000 mon.c (mon.1) 3236 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:32:55.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:32:54 gibba045 bash[25517]: audit 2021-03-10T17:32:54.118291+0000 mon.a (mon.0) 2456 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:32:55.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:32:54 gibba045 bash[25517]: audit 2021-03-10T17:32:54.120248+0000 mon.c (mon.1) 3237 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:32:55.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:32:54 gibba045 bash[25517]: audit 2021-03-10T17:32:54.121391+0000 mon.a (mon.0) 2457 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:32:55.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:32:54 gibba045 bash[25517]: audit 2021-03-10T17:32:54.214452+0000 mon.c (mon.1) 3238 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T17:32:55.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:32:54 gibba045 bash[25517]: audit 2021-03-10T17:32:54.215230+0000 mon.c (mon.1) 3239 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T17:32:55.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:32:54 gibba045 bash[25517]: audit 2021-03-10T17:32:54.215717+0000 mon.a (mon.0) 2458 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T17:32:55.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:32:54 gibba045 bash[25517]: audit 2021-03-10T17:32:54.215902+0000 mon.c (mon.1) 3240 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:32:55.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:32:54 gibba045 bash[25517]: audit 2021-03-10T17:32:54.216552+0000 mon.c (mon.1) 3241 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:32:55.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:32:54 gibba045 bash[25517]: audit 2021-03-10T17:32:54.217304+0000 mon.a (mon.0) 2459 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T17:32:55.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:32:54 gibba045 bash[25517]: audit 2021-03-10T17:32:54.218299+0000 mon.a (mon.0) 2460 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:32:55.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:32:54 gibba045 bash[25517]: audit 2021-03-10T17:32:54.219067+0000 mon.a (mon.0) 2461 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:32:55.939 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:32:56.166 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:32:56.166 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 5m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:32:56.167 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 4m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:32:56.167 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:32:56.167 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:32:56.167 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:32:56.168 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:32:56.168 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:32:56.168 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:32:56.168 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 5m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:32:56.168 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 4m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:32:56.169 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:32:56.169 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:32:56.169 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:32:56.169 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:32:56.170 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:32:56.170 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:32:56.170 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:32:56.170 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:32:56.170 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 4m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:32:56.171 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 4m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:32:56.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:32:55 gibba015 bash[29377]: cluster 2021-03-10T17:32:54.811384+0000 mgr.gibba045.orlgmj (mgr.34412) 11815 : cluster [DBG] pgmap v6731: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:56.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:32:55 gibba015 bash[30343]: cluster 2021-03-10T17:32:54.811384+0000 mgr.gibba045.orlgmj (mgr.34412) 11815 : cluster [DBG] pgmap v6731: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:56.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:32:55 gibba045 bash[25517]: cluster 2021-03-10T17:32:54.811384+0000 mgr.gibba045.orlgmj (mgr.34412) 11815 : cluster [DBG] pgmap v6731: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:56.419 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:32:56.420 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:32:56.420 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:32:56.420 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:32:56.420 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:32:56.421 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:32:56.421 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:32:56.421 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:32:56.421 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:32:56.422 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:32:56.422 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:32:56.422 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:32:56.422 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:32:56.422 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:32:56.423 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:32:57.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:32:56 gibba015 bash[29377]: audit 2021-03-10T17:32:55.930060+0000 mgr.gibba045.orlgmj (mgr.34412) 11816 : audit [DBG] from='client.61960 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:32:57.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:32:56 gibba015 bash[29377]: audit 2021-03-10T17:32:56.152941+0000 mgr.gibba045.orlgmj (mgr.34412) 11817 : audit [DBG] from='client.51978 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:32:57.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:32:56 gibba015 bash[29377]: audit 2021-03-10T17:32:56.417320+0000 mon.c (mon.1) 3242 : audit [DBG] from='client.? 172.21.2.115:0/4093150277' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:32:57.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:32:56 gibba015 bash[29377]: cluster 2021-03-10T17:32:56.812473+0000 mgr.gibba045.orlgmj (mgr.34412) 11818 : cluster [DBG] pgmap v6732: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:57.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:32:56 gibba015 bash[30343]: audit 2021-03-10T17:32:55.930060+0000 mgr.gibba045.orlgmj (mgr.34412) 11816 : audit [DBG] from='client.61960 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:32:57.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:32:56 gibba015 bash[30343]: audit 2021-03-10T17:32:56.152941+0000 mgr.gibba045.orlgmj (mgr.34412) 11817 : audit [DBG] from='client.51978 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:32:57.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:32:56 gibba015 bash[30343]: audit 2021-03-10T17:32:56.417320+0000 mon.c (mon.1) 3242 : audit [DBG] from='client.? 172.21.2.115:0/4093150277' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:32:57.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:32:56 gibba015 bash[30343]: cluster 2021-03-10T17:32:56.812473+0000 mgr.gibba045.orlgmj (mgr.34412) 11818 : cluster [DBG] pgmap v6732: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:57.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:32:56 gibba045 bash[25517]: audit 2021-03-10T17:32:55.930060+0000 mgr.gibba045.orlgmj (mgr.34412) 11816 : audit [DBG] from='client.61960 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:32:57.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:32:56 gibba045 bash[25517]: audit 2021-03-10T17:32:56.152941+0000 mgr.gibba045.orlgmj (mgr.34412) 11817 : audit [DBG] from='client.51978 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:32:57.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:32:56 gibba045 bash[25517]: audit 2021-03-10T17:32:56.417320+0000 mon.c (mon.1) 3242 : audit [DBG] from='client.? 172.21.2.115:0/4093150277' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:32:57.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:32:56 gibba045 bash[25517]: cluster 2021-03-10T17:32:56.812473+0000 mgr.gibba045.orlgmj (mgr.34412) 11818 : cluster [DBG] pgmap v6732: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:59.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:32:59 gibba015 bash[29377]: cluster 2021-03-10T17:32:58.812949+0000 mgr.gibba045.orlgmj (mgr.34412) 11819 : cluster [DBG] pgmap v6733: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:59.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:32:59 gibba015 bash[30343]: cluster 2021-03-10T17:32:58.812949+0000 mgr.gibba045.orlgmj (mgr.34412) 11819 : cluster [DBG] pgmap v6733: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:59.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:32:59 gibba045 bash[25517]: cluster 2021-03-10T17:32:58.812949+0000 mgr.gibba045.orlgmj (mgr.34412) 11819 : cluster [DBG] pgmap v6733: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:02.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:33:01 gibba015 bash[29377]: cluster 2021-03-10T17:33:00.813391+0000 mgr.gibba045.orlgmj (mgr.34412) 11820 : cluster [DBG] pgmap v6734: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:02.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:33:01 gibba015 bash[30343]: cluster 2021-03-10T17:33:00.813391+0000 mgr.gibba045.orlgmj (mgr.34412) 11820 : cluster [DBG] pgmap v6734: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:02.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:33:01 gibba045 bash[25517]: cluster 2021-03-10T17:33:00.813391+0000 mgr.gibba045.orlgmj (mgr.34412) 11820 : cluster [DBG] pgmap v6734: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:03.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:33:02 gibba015 bash[29377]: cluster 2021-03-10T17:33:02.814820+0000 mgr.gibba045.orlgmj (mgr.34412) 11821 : cluster [DBG] pgmap v6735: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:03.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:33:02 gibba015 bash[30343]: cluster 2021-03-10T17:33:02.814820+0000 mgr.gibba045.orlgmj (mgr.34412) 11821 : cluster [DBG] pgmap v6735: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:03.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:33:02 gibba045 bash[25517]: cluster 2021-03-10T17:33:02.814820+0000 mgr.gibba045.orlgmj (mgr.34412) 11821 : cluster [DBG] pgmap v6735: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:06.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:33:05 gibba015 bash[29377]: cluster 2021-03-10T17:33:04.816585+0000 mgr.gibba045.orlgmj (mgr.34412) 11822 : cluster [DBG] pgmap v6736: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:06.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:33:05 gibba015 bash[30343]: cluster 2021-03-10T17:33:04.816585+0000 mgr.gibba045.orlgmj (mgr.34412) 11822 : cluster [DBG] pgmap v6736: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:06.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:33:05 gibba045 bash[25517]: cluster 2021-03-10T17:33:04.816585+0000 mgr.gibba045.orlgmj (mgr.34412) 11822 : cluster [DBG] pgmap v6736: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:07.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:33:06 gibba015 bash[29377]: cephadm 2021-03-10T17:33:05.227488+0000 mgr.gibba045.orlgmj (mgr.34412) 11823 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:33:07.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:33:06 gibba015 bash[29377]: cluster 2021-03-10T17:33:06.818337+0000 mgr.gibba045.orlgmj (mgr.34412) 11824 : cluster [DBG] pgmap v6737: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:07.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:33:06 gibba015 bash[30343]: cephadm 2021-03-10T17:33:05.227488+0000 mgr.gibba045.orlgmj (mgr.34412) 11823 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:33:07.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:33:06 gibba015 bash[30343]: cluster 2021-03-10T17:33:06.818337+0000 mgr.gibba045.orlgmj (mgr.34412) 11824 : cluster [DBG] pgmap v6737: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:07.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:33:06 gibba045 bash[25517]: cephadm 2021-03-10T17:33:05.227488+0000 mgr.gibba045.orlgmj (mgr.34412) 11823 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:33:07.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:33:06 gibba045 bash[25517]: cluster 2021-03-10T17:33:06.818337+0000 mgr.gibba045.orlgmj (mgr.34412) 11824 : cluster [DBG] pgmap v6737: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:09.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:33:09 gibba015 bash[29377]: cluster 2021-03-10T17:33:08.818869+0000 mgr.gibba045.orlgmj (mgr.34412) 11825 : cluster [DBG] pgmap v6738: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:09.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:33:09 gibba015 bash[30343]: cluster 2021-03-10T17:33:08.818869+0000 mgr.gibba045.orlgmj (mgr.34412) 11825 : cluster [DBG] pgmap v6738: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:09.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:33:09 gibba045 bash[25517]: cluster 2021-03-10T17:33:08.818869+0000 mgr.gibba045.orlgmj (mgr.34412) 11825 : cluster [DBG] pgmap v6738: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:12.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:33:11 gibba015 bash[29377]: cluster 2021-03-10T17:33:10.820247+0000 mgr.gibba045.orlgmj (mgr.34412) 11826 : cluster [DBG] pgmap v6739: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:12.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:33:11 gibba015 bash[30343]: cluster 2021-03-10T17:33:10.820247+0000 mgr.gibba045.orlgmj (mgr.34412) 11826 : cluster [DBG] pgmap v6739: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:12.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:33:11 gibba045 bash[25517]: cluster 2021-03-10T17:33:10.820247+0000 mgr.gibba045.orlgmj (mgr.34412) 11826 : cluster [DBG] pgmap v6739: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:13.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:33:12 gibba015 bash[29377]: cluster 2021-03-10T17:33:12.821826+0000 mgr.gibba045.orlgmj (mgr.34412) 11827 : cluster [DBG] pgmap v6740: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:13.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:33:12 gibba015 bash[30343]: cluster 2021-03-10T17:33:12.821826+0000 mgr.gibba045.orlgmj (mgr.34412) 11827 : cluster [DBG] pgmap v6740: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:13.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:33:12 gibba045 bash[25517]: cluster 2021-03-10T17:33:12.821826+0000 mgr.gibba045.orlgmj (mgr.34412) 11827 : cluster [DBG] pgmap v6740: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:15.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:33:14 gibba015 bash[29377]: cluster 2021-03-10T17:33:14.823635+0000 mgr.gibba045.orlgmj (mgr.34412) 11828 : cluster [DBG] pgmap v6741: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:15.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:33:14 gibba015 bash[30343]: cluster 2021-03-10T17:33:14.823635+0000 mgr.gibba045.orlgmj (mgr.34412) 11828 : cluster [DBG] pgmap v6741: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:15.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:33:14 gibba045 bash[25517]: cluster 2021-03-10T17:33:14.823635+0000 mgr.gibba045.orlgmj (mgr.34412) 11828 : cluster [DBG] pgmap v6741: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:17.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:33:16 gibba015 bash[29377]: cluster 2021-03-10T17:33:16.824169+0000 mgr.gibba045.orlgmj (mgr.34412) 11829 : cluster [DBG] pgmap v6742: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:17.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:33:16 gibba015 bash[30343]: cluster 2021-03-10T17:33:16.824169+0000 mgr.gibba045.orlgmj (mgr.34412) 11829 : cluster [DBG] pgmap v6742: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:17.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:33:16 gibba045 bash[25517]: cluster 2021-03-10T17:33:16.824169+0000 mgr.gibba045.orlgmj (mgr.34412) 11829 : cluster [DBG] pgmap v6742: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:19.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:33:19 gibba015 bash[29377]: cluster 2021-03-10T17:33:18.824626+0000 mgr.gibba045.orlgmj (mgr.34412) 11830 : cluster [DBG] pgmap v6743: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:19.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:33:19 gibba015 bash[30343]: cluster 2021-03-10T17:33:18.824626+0000 mgr.gibba045.orlgmj (mgr.34412) 11830 : cluster [DBG] pgmap v6743: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:19.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:33:19 gibba045 bash[25517]: cluster 2021-03-10T17:33:18.824626+0000 mgr.gibba045.orlgmj (mgr.34412) 11830 : cluster [DBG] pgmap v6743: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:21.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:33:20 gibba015 bash[29377]: cephadm 2021-03-10T17:33:20.242460+0000 mgr.gibba045.orlgmj (mgr.34412) 11831 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:33:21.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:33:20 gibba015 bash[29377]: cluster 2021-03-10T17:33:20.825622+0000 mgr.gibba045.orlgmj (mgr.34412) 11832 : cluster [DBG] pgmap v6744: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:21.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:33:20 gibba015 bash[30343]: cephadm 2021-03-10T17:33:20.242460+0000 mgr.gibba045.orlgmj (mgr.34412) 11831 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:33:21.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:33:20 gibba015 bash[30343]: cluster 2021-03-10T17:33:20.825622+0000 mgr.gibba045.orlgmj (mgr.34412) 11832 : cluster [DBG] pgmap v6744: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:21.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:33:20 gibba045 bash[25517]: cephadm 2021-03-10T17:33:20.242460+0000 mgr.gibba045.orlgmj (mgr.34412) 11831 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:33:21.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:33:20 gibba045 bash[25517]: cluster 2021-03-10T17:33:20.825622+0000 mgr.gibba045.orlgmj (mgr.34412) 11832 : cluster [DBG] pgmap v6744: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:23.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:33:22 gibba015 bash[29377]: cluster 2021-03-10T17:33:22.827067+0000 mgr.gibba045.orlgmj (mgr.34412) 11833 : cluster [DBG] pgmap v6745: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:23.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:33:22 gibba015 bash[30343]: cluster 2021-03-10T17:33:22.827067+0000 mgr.gibba045.orlgmj (mgr.34412) 11833 : cluster [DBG] pgmap v6745: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:23.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:33:22 gibba045 bash[25517]: cluster 2021-03-10T17:33:22.827067+0000 mgr.gibba045.orlgmj (mgr.34412) 11833 : cluster [DBG] pgmap v6745: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:25.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:33:24 gibba015 bash[29377]: cluster 2021-03-10T17:33:24.827654+0000 mgr.gibba045.orlgmj (mgr.34412) 11834 : cluster [DBG] pgmap v6746: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:25.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:33:24 gibba015 bash[30343]: cluster 2021-03-10T17:33:24.827654+0000 mgr.gibba045.orlgmj (mgr.34412) 11834 : cluster [DBG] pgmap v6746: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:25.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:33:24 gibba045 bash[25517]: cluster 2021-03-10T17:33:24.827654+0000 mgr.gibba045.orlgmj (mgr.34412) 11834 : cluster [DBG] pgmap v6746: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:26.663 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:33:26.892 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:33:26.892 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 5m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:33:26.893 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 4m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:33:26.893 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:33:26.893 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:33:26.893 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:33:26.894 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:33:26.894 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:33:26.894 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:33:26.894 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 5m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:33:26.894 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 4m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:33:26.895 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:33:26.895 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:33:26.895 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:33:26.895 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:33:26.896 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:33:26.896 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:33:26.896 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:33:26.896 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:33:26.896 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 4m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:33:26.897 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 4m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:33:27.139 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:33:27.139 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:33:27.140 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:33:27.140 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:33:27.140 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:33:27.140 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:33:27.141 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:33:27.141 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:33:27.141 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:33:27.141 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:33:27.142 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:33:27.142 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:33:27.142 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:33:27.142 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:33:27.142 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:33:28.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:33:27 gibba015 bash[29377]: audit 2021-03-10T17:33:26.654738+0000 mgr.gibba045.orlgmj (mgr.34412) 11835 : audit [DBG] from='client.51990 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:33:28.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:33:27 gibba015 bash[29377]: cluster 2021-03-10T17:33:26.829223+0000 mgr.gibba045.orlgmj (mgr.34412) 11836 : cluster [DBG] pgmap v6747: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:28.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:33:27 gibba015 bash[29377]: audit 2021-03-10T17:33:26.879416+0000 mgr.gibba045.orlgmj (mgr.34412) 11837 : audit [DBG] from='client.51996 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:33:28.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:33:27 gibba015 bash[29377]: audit 2021-03-10T17:33:27.136896+0000 mon.c (mon.1) 3243 : audit [DBG] from='client.? 172.21.2.115:0/2324012261' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:33:28.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:33:27 gibba015 bash[30343]: audit 2021-03-10T17:33:26.654738+0000 mgr.gibba045.orlgmj (mgr.34412) 11835 : audit [DBG] from='client.51990 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:33:28.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:33:27 gibba015 bash[30343]: cluster 2021-03-10T17:33:26.829223+0000 mgr.gibba045.orlgmj (mgr.34412) 11836 : cluster [DBG] pgmap v6747: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:28.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:33:27 gibba015 bash[30343]: audit 2021-03-10T17:33:26.879416+0000 mgr.gibba045.orlgmj (mgr.34412) 11837 : audit [DBG] from='client.51996 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:33:28.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:33:27 gibba015 bash[30343]: audit 2021-03-10T17:33:27.136896+0000 mon.c (mon.1) 3243 : audit [DBG] from='client.? 172.21.2.115:0/2324012261' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:33:28.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:33:27 gibba045 bash[25517]: audit 2021-03-10T17:33:26.654738+0000 mgr.gibba045.orlgmj (mgr.34412) 11835 : audit [DBG] from='client.51990 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:33:28.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:33:27 gibba045 bash[25517]: cluster 2021-03-10T17:33:26.829223+0000 mgr.gibba045.orlgmj (mgr.34412) 11836 : cluster [DBG] pgmap v6747: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:28.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:33:27 gibba045 bash[25517]: audit 2021-03-10T17:33:26.879416+0000 mgr.gibba045.orlgmj (mgr.34412) 11837 : audit [DBG] from='client.51996 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:33:28.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:33:27 gibba045 bash[25517]: audit 2021-03-10T17:33:27.136896+0000 mon.c (mon.1) 3243 : audit [DBG] from='client.? 172.21.2.115:0/2324012261' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:33:29.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:33:29 gibba015 bash[29377]: cluster 2021-03-10T17:33:28.829665+0000 mgr.gibba045.orlgmj (mgr.34412) 11838 : cluster [DBG] pgmap v6748: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:29.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:33:29 gibba015 bash[30343]: cluster 2021-03-10T17:33:28.829665+0000 mgr.gibba045.orlgmj (mgr.34412) 11838 : cluster [DBG] pgmap v6748: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:29.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:33:29 gibba045 bash[25517]: cluster 2021-03-10T17:33:28.829665+0000 mgr.gibba045.orlgmj (mgr.34412) 11838 : cluster [DBG] pgmap v6748: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:31.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:33:30 gibba015 bash[29377]: cluster 2021-03-10T17:33:30.831253+0000 mgr.gibba045.orlgmj (mgr.34412) 11839 : cluster [DBG] pgmap v6749: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:31.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:33:30 gibba015 bash[30343]: cluster 2021-03-10T17:33:30.831253+0000 mgr.gibba045.orlgmj (mgr.34412) 11839 : cluster [DBG] pgmap v6749: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:31.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:33:30 gibba045 bash[25517]: cluster 2021-03-10T17:33:30.831253+0000 mgr.gibba045.orlgmj (mgr.34412) 11839 : cluster [DBG] pgmap v6749: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:33.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:33:32 gibba015 bash[29377]: cluster 2021-03-10T17:33:32.831820+0000 mgr.gibba045.orlgmj (mgr.34412) 11840 : cluster [DBG] pgmap v6750: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:33.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:33:32 gibba015 bash[30343]: cluster 2021-03-10T17:33:32.831820+0000 mgr.gibba045.orlgmj (mgr.34412) 11840 : cluster [DBG] pgmap v6750: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:33.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:33:32 gibba045 bash[25517]: cluster 2021-03-10T17:33:32.831820+0000 mgr.gibba045.orlgmj (mgr.34412) 11840 : cluster [DBG] pgmap v6750: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:35.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:33:34 gibba015 bash[29377]: cluster 2021-03-10T17:33:34.833259+0000 mgr.gibba045.orlgmj (mgr.34412) 11841 : cluster [DBG] pgmap v6751: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:35.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:33:34 gibba015 bash[30343]: cluster 2021-03-10T17:33:34.833259+0000 mgr.gibba045.orlgmj (mgr.34412) 11841 : cluster [DBG] pgmap v6751: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:35.262 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:33:34 gibba045 bash[25517]: cluster 2021-03-10T17:33:34.833259+0000 mgr.gibba045.orlgmj (mgr.34412) 11841 : cluster [DBG] pgmap v6751: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:36.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:33:35 gibba015 bash[29377]: cephadm 2021-03-10T17:33:35.258426+0000 mgr.gibba045.orlgmj (mgr.34412) 11842 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:33:36.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:33:35 gibba015 bash[30343]: cephadm 2021-03-10T17:33:35.258426+0000 mgr.gibba045.orlgmj (mgr.34412) 11842 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:33:36.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:33:35 gibba045 bash[25517]: cephadm 2021-03-10T17:33:35.258426+0000 mgr.gibba045.orlgmj (mgr.34412) 11842 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:33:37.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:33:36 gibba015 bash[29377]: cluster 2021-03-10T17:33:36.834868+0000 mgr.gibba045.orlgmj (mgr.34412) 11843 : cluster [DBG] pgmap v6752: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:37.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:33:36 gibba015 bash[30343]: cluster 2021-03-10T17:33:36.834868+0000 mgr.gibba045.orlgmj (mgr.34412) 11843 : cluster [DBG] pgmap v6752: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:37.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:33:36 gibba045 bash[25517]: cluster 2021-03-10T17:33:36.834868+0000 mgr.gibba045.orlgmj (mgr.34412) 11843 : cluster [DBG] pgmap v6752: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:39.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:33:39 gibba015 bash[29377]: cluster 2021-03-10T17:33:38.835588+0000 mgr.gibba045.orlgmj (mgr.34412) 11844 : cluster [DBG] pgmap v6753: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:39.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:33:39 gibba015 bash[30343]: cluster 2021-03-10T17:33:38.835588+0000 mgr.gibba045.orlgmj (mgr.34412) 11844 : cluster [DBG] pgmap v6753: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:39.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:33:39 gibba045 bash[25517]: cluster 2021-03-10T17:33:38.835588+0000 mgr.gibba045.orlgmj (mgr.34412) 11844 : cluster [DBG] pgmap v6753: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:41.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:33:40 gibba015 bash[29377]: cluster 2021-03-10T17:33:40.836333+0000 mgr.gibba045.orlgmj (mgr.34412) 11845 : cluster [DBG] pgmap v6754: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:41.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:33:40 gibba015 bash[30343]: cluster 2021-03-10T17:33:40.836333+0000 mgr.gibba045.orlgmj (mgr.34412) 11845 : cluster [DBG] pgmap v6754: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:41.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:33:40 gibba045 bash[25517]: cluster 2021-03-10T17:33:40.836333+0000 mgr.gibba045.orlgmj (mgr.34412) 11845 : cluster [DBG] pgmap v6754: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:43.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:33:42 gibba015 bash[29377]: cluster 2021-03-10T17:33:42.837828+0000 mgr.gibba045.orlgmj (mgr.34412) 11846 : cluster [DBG] pgmap v6755: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:43.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:33:42 gibba015 bash[30343]: cluster 2021-03-10T17:33:42.837828+0000 mgr.gibba045.orlgmj (mgr.34412) 11846 : cluster [DBG] pgmap v6755: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:43.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:33:42 gibba045 bash[25517]: cluster 2021-03-10T17:33:42.837828+0000 mgr.gibba045.orlgmj (mgr.34412) 11846 : cluster [DBG] pgmap v6755: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:45.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:33:44 gibba015 bash[29377]: cluster 2021-03-10T17:33:44.839445+0000 mgr.gibba045.orlgmj (mgr.34412) 11847 : cluster [DBG] pgmap v6756: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:45.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:33:44 gibba015 bash[30343]: cluster 2021-03-10T17:33:44.839445+0000 mgr.gibba045.orlgmj (mgr.34412) 11847 : cluster [DBG] pgmap v6756: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:45.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:33:44 gibba045 bash[25517]: cluster 2021-03-10T17:33:44.839445+0000 mgr.gibba045.orlgmj (mgr.34412) 11847 : cluster [DBG] pgmap v6756: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:47.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:33:46 gibba015 bash[29377]: cluster 2021-03-10T17:33:46.841241+0000 mgr.gibba045.orlgmj (mgr.34412) 11848 : cluster [DBG] pgmap v6757: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:47.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:33:46 gibba015 bash[30343]: cluster 2021-03-10T17:33:46.841241+0000 mgr.gibba045.orlgmj (mgr.34412) 11848 : cluster [DBG] pgmap v6757: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:47.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:33:46 gibba045 bash[25517]: cluster 2021-03-10T17:33:46.841241+0000 mgr.gibba045.orlgmj (mgr.34412) 11848 : cluster [DBG] pgmap v6757: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:49.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:33:49 gibba015 bash[29377]: cluster 2021-03-10T17:33:48.841913+0000 mgr.gibba045.orlgmj (mgr.34412) 11849 : cluster [DBG] pgmap v6758: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:49.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:33:49 gibba015 bash[30343]: cluster 2021-03-10T17:33:48.841913+0000 mgr.gibba045.orlgmj (mgr.34412) 11849 : cluster [DBG] pgmap v6758: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:49.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:33:49 gibba045 bash[25517]: cluster 2021-03-10T17:33:48.841913+0000 mgr.gibba045.orlgmj (mgr.34412) 11849 : cluster [DBG] pgmap v6758: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:50.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:33:50 gibba015 bash[29377]: audit 2021-03-10T17:33:50.273670+0000 mon.c (mon.1) 3244 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:33:50.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:33:50 gibba015 bash[30343]: audit 2021-03-10T17:33:50.273670+0000 mon.c (mon.1) 3244 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:33:50.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:33:50 gibba045 bash[25517]: audit 2021-03-10T17:33:50.273670+0000 mon.c (mon.1) 3244 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:33:51.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:33:51 gibba045 bash[25517]: cephadm 2021-03-10T17:33:50.281382+0000 mgr.gibba045.orlgmj (mgr.34412) 11850 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:33:51.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:33:51 gibba045 bash[25517]: cephadm 2021-03-10T17:33:50.283216+0000 mgr.gibba045.orlgmj (mgr.34412) 11851 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:33:51.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:33:51 gibba045 bash[25517]: audit 2021-03-10T17:33:50.483247+0000 mon.a (mon.0) 2462 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:33:51.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:33:51 gibba045 bash[25517]: audit 2021-03-10T17:33:50.486848+0000 mon.c (mon.1) 3245 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:33:51.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:33:51 gibba045 bash[25517]: cephadm 2021-03-10T17:33:50.487975+0000 mgr.gibba045.orlgmj (mgr.34412) 11852 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:33:51.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:33:51 gibba045 bash[25517]: audit 2021-03-10T17:33:50.488173+0000 mon.c (mon.1) 3246 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:33:51.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:33:51 gibba045 bash[25517]: cephadm 2021-03-10T17:33:50.489670+0000 mgr.gibba045.orlgmj (mgr.34412) 11853 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:33:51.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:33:51 gibba045 bash[25517]: audit 2021-03-10T17:33:50.489797+0000 mon.c (mon.1) 3247 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:33:51.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:33:51 gibba045 bash[25517]: cephadm 2021-03-10T17:33:50.491088+0000 mgr.gibba045.orlgmj (mgr.34412) 11854 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:33:51.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:33:51 gibba045 bash[25517]: cephadm 2021-03-10T17:33:50.491132+0000 mgr.gibba045.orlgmj (mgr.34412) 11855 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:33:51.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:33:51 gibba045 bash[25517]: audit 2021-03-10T17:33:50.491501+0000 mon.c (mon.1) 3248 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:33:51.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:33:51 gibba045 bash[25517]: cephadm 2021-03-10T17:33:50.492879+0000 mgr.gibba045.orlgmj (mgr.34412) 11856 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:33:51.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:33:51 gibba045 bash[25517]: cephadm 2021-03-10T17:33:50.492917+0000 mgr.gibba045.orlgmj (mgr.34412) 11857 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:33:51.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:33:51 gibba045 bash[25517]: audit 2021-03-10T17:33:50.494151+0000 mon.c (mon.1) 3249 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:33:51.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:33:51 gibba045 bash[25517]: cephadm 2021-03-10T17:33:50.494182+0000 mgr.gibba045.orlgmj (mgr.34412) 11858 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:33:51.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:33:51 gibba045 bash[25517]: audit 2021-03-10T17:33:50.495441+0000 mon.c (mon.1) 3250 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:33:51.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:33:51 gibba045 bash[25517]: cephadm 2021-03-10T17:33:50.495523+0000 mgr.gibba045.orlgmj (mgr.34412) 11859 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:33:51.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:33:51 gibba045 bash[25517]: cephadm 2021-03-10T17:33:50.495556+0000 mgr.gibba045.orlgmj (mgr.34412) 11860 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:33:51.812 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:33:51 gibba045 bash[25517]: cephadm 2021-03-10T17:33:50.496800+0000 mgr.gibba045.orlgmj (mgr.34412) 11861 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:33:51.812 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:33:51 gibba045 bash[25517]: cephadm 2021-03-10T17:33:50.497113+0000 mgr.gibba045.orlgmj (mgr.34412) 11862 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:33:51.812 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:33:51 gibba045 bash[25517]: cephadm 2021-03-10T17:33:50.498061+0000 mgr.gibba045.orlgmj (mgr.34412) 11863 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:33:51.812 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:33:51 gibba045 bash[25517]: cephadm 2021-03-10T17:33:50.498099+0000 mgr.gibba045.orlgmj (mgr.34412) 11864 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:33:51.812 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:33:51 gibba045 bash[25517]: cephadm 2021-03-10T17:33:50.498204+0000 mgr.gibba045.orlgmj (mgr.34412) 11865 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:33:51.813 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:33:51 gibba045 bash[25517]: cluster 2021-03-10T17:33:50.843442+0000 mgr.gibba045.orlgmj (mgr.34412) 11866 : cluster [DBG] pgmap v6759: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:51.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:33:51 gibba015 bash[29377]: cephadm 2021-03-10T17:33:50.281382+0000 mgr.gibba045.orlgmj (mgr.34412) 11850 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:33:51.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:33:51 gibba015 bash[29377]: cephadm 2021-03-10T17:33:50.283216+0000 mgr.gibba045.orlgmj (mgr.34412) 11851 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:33:51.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:33:51 gibba015 bash[29377]: audit 2021-03-10T17:33:50.483247+0000 mon.a (mon.0) 2462 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:33:51.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:33:51 gibba015 bash[29377]: audit 2021-03-10T17:33:50.486848+0000 mon.c (mon.1) 3245 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:33:51.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:33:51 gibba015 bash[29377]: cephadm 2021-03-10T17:33:50.487975+0000 mgr.gibba045.orlgmj (mgr.34412) 11852 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:33:51.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:33:51 gibba015 bash[29377]: audit 2021-03-10T17:33:50.488173+0000 mon.c (mon.1) 3246 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:33:51.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:33:51 gibba015 bash[29377]: cephadm 2021-03-10T17:33:50.489670+0000 mgr.gibba045.orlgmj (mgr.34412) 11853 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:33:51.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:33:51 gibba015 bash[29377]: audit 2021-03-10T17:33:50.489797+0000 mon.c (mon.1) 3247 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:33:51.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:33:51 gibba015 bash[29377]: cephadm 2021-03-10T17:33:50.491088+0000 mgr.gibba045.orlgmj (mgr.34412) 11854 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:33:51.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:33:51 gibba015 bash[29377]: cephadm 2021-03-10T17:33:50.491132+0000 mgr.gibba045.orlgmj (mgr.34412) 11855 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:33:51.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:33:51 gibba015 bash[29377]: audit 2021-03-10T17:33:50.491501+0000 mon.c (mon.1) 3248 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:33:51.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:33:51 gibba015 bash[29377]: cephadm 2021-03-10T17:33:50.492879+0000 mgr.gibba045.orlgmj (mgr.34412) 11856 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:33:51.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:33:51 gibba015 bash[29377]: cephadm 2021-03-10T17:33:50.492917+0000 mgr.gibba045.orlgmj (mgr.34412) 11857 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:33:51.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:33:51 gibba015 bash[29377]: audit 2021-03-10T17:33:50.494151+0000 mon.c (mon.1) 3249 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:33:51.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:33:51 gibba015 bash[29377]: cephadm 2021-03-10T17:33:50.494182+0000 mgr.gibba045.orlgmj (mgr.34412) 11858 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:33:51.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:33:51 gibba015 bash[29377]: audit 2021-03-10T17:33:50.495441+0000 mon.c (mon.1) 3250 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:33:51.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:33:51 gibba015 bash[29377]: cephadm 2021-03-10T17:33:50.495523+0000 mgr.gibba045.orlgmj (mgr.34412) 11859 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:33:51.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:33:51 gibba015 bash[29377]: cephadm 2021-03-10T17:33:50.495556+0000 mgr.gibba045.orlgmj (mgr.34412) 11860 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:33:51.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:33:51 gibba015 bash[29377]: cephadm 2021-03-10T17:33:50.496800+0000 mgr.gibba045.orlgmj (mgr.34412) 11861 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:33:51.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:33:51 gibba015 bash[29377]: cephadm 2021-03-10T17:33:50.497113+0000 mgr.gibba045.orlgmj (mgr.34412) 11862 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:33:51.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:33:51 gibba015 bash[29377]: cephadm 2021-03-10T17:33:50.498061+0000 mgr.gibba045.orlgmj (mgr.34412) 11863 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:33:51.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:33:51 gibba015 bash[30343]: cephadm 2021-03-10T17:33:50.281382+0000 mgr.gibba045.orlgmj (mgr.34412) 11850 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:33:51.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:33:51 gibba015 bash[30343]: cephadm 2021-03-10T17:33:50.283216+0000 mgr.gibba045.orlgmj (mgr.34412) 11851 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:33:51.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:33:51 gibba015 bash[30343]: audit 2021-03-10T17:33:50.483247+0000 mon.a (mon.0) 2462 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:33:51.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:33:51 gibba015 bash[30343]: audit 2021-03-10T17:33:50.486848+0000 mon.c (mon.1) 3245 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:33:51.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:33:51 gibba015 bash[30343]: cephadm 2021-03-10T17:33:50.487975+0000 mgr.gibba045.orlgmj (mgr.34412) 11852 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:33:51.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:33:51 gibba015 bash[30343]: audit 2021-03-10T17:33:50.488173+0000 mon.c (mon.1) 3246 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:33:51.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:33:51 gibba015 bash[30343]: cephadm 2021-03-10T17:33:50.489670+0000 mgr.gibba045.orlgmj (mgr.34412) 11853 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:33:51.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:33:51 gibba015 bash[30343]: audit 2021-03-10T17:33:50.489797+0000 mon.c (mon.1) 3247 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:33:51.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:33:51 gibba015 bash[30343]: cephadm 2021-03-10T17:33:50.491088+0000 mgr.gibba045.orlgmj (mgr.34412) 11854 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:33:51.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:33:51 gibba015 bash[30343]: cephadm 2021-03-10T17:33:50.491132+0000 mgr.gibba045.orlgmj (mgr.34412) 11855 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:33:51.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:33:51 gibba015 bash[30343]: audit 2021-03-10T17:33:50.491501+0000 mon.c (mon.1) 3248 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:33:51.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:33:51 gibba015 bash[30343]: cephadm 2021-03-10T17:33:50.492879+0000 mgr.gibba045.orlgmj (mgr.34412) 11856 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:33:51.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:33:51 gibba015 bash[30343]: cephadm 2021-03-10T17:33:50.492917+0000 mgr.gibba045.orlgmj (mgr.34412) 11857 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:33:51.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:33:51 gibba015 bash[30343]: audit 2021-03-10T17:33:50.494151+0000 mon.c (mon.1) 3249 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:33:51.983 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:33:51 gibba015 bash[30343]: cephadm 2021-03-10T17:33:50.494182+0000 mgr.gibba045.orlgmj (mgr.34412) 11858 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:33:51.984 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:33:51 gibba015 bash[30343]: audit 2021-03-10T17:33:50.495441+0000 mon.c (mon.1) 3250 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:33:51.984 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:33:51 gibba015 bash[30343]: cephadm 2021-03-10T17:33:50.495523+0000 mgr.gibba045.orlgmj (mgr.34412) 11859 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:33:51.984 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:33:51 gibba015 bash[30343]: cephadm 2021-03-10T17:33:50.495556+0000 mgr.gibba045.orlgmj (mgr.34412) 11860 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:33:51.984 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:33:51 gibba015 bash[30343]: cephadm 2021-03-10T17:33:50.496800+0000 mgr.gibba045.orlgmj (mgr.34412) 11861 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:33:51.984 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:33:51 gibba015 bash[30343]: cephadm 2021-03-10T17:33:50.497113+0000 mgr.gibba045.orlgmj (mgr.34412) 11862 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:33:51.985 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:33:51 gibba015 bash[30343]: cephadm 2021-03-10T17:33:50.498061+0000 mgr.gibba045.orlgmj (mgr.34412) 11863 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:33:51.985 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:33:51 gibba015 bash[30343]: cephadm 2021-03-10T17:33:50.498099+0000 mgr.gibba045.orlgmj (mgr.34412) 11864 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:33:51.985 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:33:51 gibba015 bash[30343]: cephadm 2021-03-10T17:33:50.498204+0000 mgr.gibba045.orlgmj (mgr.34412) 11865 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:33:51.985 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:33:51 gibba015 bash[30343]: cluster 2021-03-10T17:33:50.843442+0000 mgr.gibba045.orlgmj (mgr.34412) 11866 : cluster [DBG] pgmap v6759: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:51.986 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:33:51 gibba015 bash[29377]: cephadm 2021-03-10T17:33:50.498099+0000 mgr.gibba045.orlgmj (mgr.34412) 11864 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:33:51.986 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:33:51 gibba015 bash[29377]: cephadm 2021-03-10T17:33:50.498204+0000 mgr.gibba045.orlgmj (mgr.34412) 11865 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:33:51.986 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:33:51 gibba015 bash[29377]: cluster 2021-03-10T17:33:50.843442+0000 mgr.gibba045.orlgmj (mgr.34412) 11866 : cluster [DBG] pgmap v6759: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:53.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:33:52 gibba015 bash[29377]: cluster 2021-03-10T17:33:52.845060+0000 mgr.gibba045.orlgmj (mgr.34412) 11867 : cluster [DBG] pgmap v6760: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:53.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:33:52 gibba015 bash[30343]: cluster 2021-03-10T17:33:52.845060+0000 mgr.gibba045.orlgmj (mgr.34412) 11867 : cluster [DBG] pgmap v6760: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:53.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:33:52 gibba045 bash[25517]: cluster 2021-03-10T17:33:52.845060+0000 mgr.gibba045.orlgmj (mgr.34412) 11867 : cluster [DBG] pgmap v6760: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:33:54 gibba015 bash[29377]: audit 2021-03-10T17:33:54.130841+0000 mon.c (mon.1) 3251 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:33:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:33:54 gibba015 bash[29377]: audit 2021-03-10T17:33:54.131896+0000 mon.c (mon.1) 3252 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:33:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:33:54 gibba015 bash[29377]: audit 2021-03-10T17:33:54.131986+0000 mon.a (mon.0) 2463 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:33:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:33:54 gibba015 bash[29377]: audit 2021-03-10T17:33:54.133155+0000 mon.a (mon.0) 2464 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:33:54.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:33:54 gibba015 bash[30343]: audit 2021-03-10T17:33:54.130841+0000 mon.c (mon.1) 3251 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:33:54.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:33:54 gibba015 bash[30343]: audit 2021-03-10T17:33:54.131896+0000 mon.c (mon.1) 3252 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:33:54.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:33:54 gibba015 bash[30343]: audit 2021-03-10T17:33:54.131986+0000 mon.a (mon.0) 2463 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:33:54.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:33:54 gibba015 bash[30343]: audit 2021-03-10T17:33:54.133155+0000 mon.a (mon.0) 2464 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:33:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:33:54 gibba045 bash[25517]: audit 2021-03-10T17:33:54.130841+0000 mon.c (mon.1) 3251 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:33:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:33:54 gibba045 bash[25517]: audit 2021-03-10T17:33:54.131896+0000 mon.c (mon.1) 3252 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:33:54.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:33:54 gibba045 bash[25517]: audit 2021-03-10T17:33:54.131986+0000 mon.a (mon.0) 2463 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:33:54.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:33:54 gibba045 bash[25517]: audit 2021-03-10T17:33:54.133155+0000 mon.a (mon.0) 2464 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:33:55.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:33:55 gibba015 bash[29377]: audit 2021-03-10T17:33:54.220883+0000 mon.c (mon.1) 3253 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T17:33:55.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:33:55 gibba015 bash[29377]: audit 2021-03-10T17:33:54.221784+0000 mon.c (mon.1) 3254 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:33:55.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:33:55 gibba015 bash[29377]: audit 2021-03-10T17:33:54.222246+0000 mon.a (mon.0) 2465 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T17:33:55.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:33:55 gibba015 bash[29377]: audit 2021-03-10T17:33:54.222852+0000 mon.c (mon.1) 3255 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:33:55.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:33:55 gibba015 bash[29377]: audit 2021-03-10T17:33:54.223532+0000 mon.a (mon.0) 2466 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:33:55.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:33:55 gibba015 bash[29377]: audit 2021-03-10T17:33:54.224185+0000 mon.c (mon.1) 3256 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:33:55.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:33:55 gibba015 bash[29377]: audit 2021-03-10T17:33:54.224456+0000 mon.a (mon.0) 2467 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:33:55.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:33:55 gibba015 bash[29377]: audit 2021-03-10T17:33:54.225282+0000 mon.a (mon.0) 2468 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:33:55.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:33:55 gibba015 bash[29377]: cluster 2021-03-10T17:33:54.846662+0000 mgr.gibba045.orlgmj (mgr.34412) 11868 : cluster [DBG] pgmap v6761: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:55.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:33:55 gibba015 bash[30343]: audit 2021-03-10T17:33:54.220883+0000 mon.c (mon.1) 3253 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T17:33:55.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:33:55 gibba015 bash[30343]: audit 2021-03-10T17:33:54.221784+0000 mon.c (mon.1) 3254 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:33:55.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:33:55 gibba015 bash[30343]: audit 2021-03-10T17:33:54.222246+0000 mon.a (mon.0) 2465 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T17:33:55.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:33:55 gibba015 bash[30343]: audit 2021-03-10T17:33:54.222852+0000 mon.c (mon.1) 3255 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:33:55.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:33:55 gibba015 bash[30343]: audit 2021-03-10T17:33:54.223532+0000 mon.a (mon.0) 2466 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:33:55.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:33:55 gibba015 bash[30343]: audit 2021-03-10T17:33:54.224185+0000 mon.c (mon.1) 3256 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:33:55.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:33:55 gibba015 bash[30343]: audit 2021-03-10T17:33:54.224456+0000 mon.a (mon.0) 2467 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:33:55.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:33:55 gibba015 bash[30343]: audit 2021-03-10T17:33:54.225282+0000 mon.a (mon.0) 2468 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:33:55.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:33:55 gibba015 bash[30343]: cluster 2021-03-10T17:33:54.846662+0000 mgr.gibba045.orlgmj (mgr.34412) 11868 : cluster [DBG] pgmap v6761: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:55.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:33:55 gibba045 bash[25517]: audit 2021-03-10T17:33:54.220883+0000 mon.c (mon.1) 3253 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T17:33:55.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:33:55 gibba045 bash[25517]: audit 2021-03-10T17:33:54.221784+0000 mon.c (mon.1) 3254 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:33:55.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:33:55 gibba045 bash[25517]: audit 2021-03-10T17:33:54.222246+0000 mon.a (mon.0) 2465 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T17:33:55.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:33:55 gibba045 bash[25517]: audit 2021-03-10T17:33:54.222852+0000 mon.c (mon.1) 3255 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:33:55.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:33:55 gibba045 bash[25517]: audit 2021-03-10T17:33:54.223532+0000 mon.a (mon.0) 2466 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:33:55.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:33:55 gibba045 bash[25517]: audit 2021-03-10T17:33:54.224185+0000 mon.c (mon.1) 3256 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:33:55.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:33:55 gibba045 bash[25517]: audit 2021-03-10T17:33:54.224456+0000 mon.a (mon.0) 2467 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:33:55.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:33:55 gibba045 bash[25517]: audit 2021-03-10T17:33:54.225282+0000 mon.a (mon.0) 2468 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:33:55.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:33:55 gibba045 bash[25517]: cluster 2021-03-10T17:33:54.846662+0000 mgr.gibba045.orlgmj (mgr.34412) 11868 : cluster [DBG] pgmap v6761: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:57.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:33:56 gibba015 bash[29377]: cluster 2021-03-10T17:33:56.847585+0000 mgr.gibba045.orlgmj (mgr.34412) 11869 : cluster [DBG] pgmap v6762: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:57.222 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:33:56 gibba015 bash[30343]: cluster 2021-03-10T17:33:56.847585+0000 mgr.gibba045.orlgmj (mgr.34412) 11869 : cluster [DBG] pgmap v6762: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:57.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:33:56 gibba045 bash[25517]: cluster 2021-03-10T17:33:56.847585+0000 mgr.gibba045.orlgmj (mgr.34412) 11869 : cluster [DBG] pgmap v6762: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:57.381 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:33:57.608 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:33:57.609 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 6m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:33:57.609 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 5m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:33:57.610 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:33:57.610 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:33:57.611 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:33:57.611 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:33:57.611 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:33:57.612 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:33:57.612 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 6m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:33:57.613 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 5m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:33:57.613 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:33:57.613 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:33:57.614 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:33:57.614 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:33:57.615 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:33:57.615 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:33:57.615 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:33:57.616 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:33:57.616 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 5m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:33:57.617 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 5m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:33:57.856 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:33:57.857 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:33:57.857 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:33:57.857 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:33:57.858 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:33:57.858 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:33:57.858 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:33:57.858 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:33:57.859 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:33:57.859 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:33:57.859 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:33:57.859 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:33:57.859 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:33:57.860 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:33:57.860 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:33:58.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:33:57 gibba015 bash[29377]: audit 2021-03-10T17:33:57.372190+0000 mgr.gibba045.orlgmj (mgr.34412) 11870 : audit [DBG] from='client.61996 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:33:58.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:33:57 gibba015 bash[29377]: audit 2021-03-10T17:33:57.595290+0000 mgr.gibba045.orlgmj (mgr.34412) 11871 : audit [DBG] from='client.52014 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:33:58.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:33:57 gibba015 bash[29377]: audit 2021-03-10T17:33:57.854261+0000 mon.c (mon.1) 3257 : audit [DBG] from='client.? 172.21.2.115:0/4169355784' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:33:58.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:33:57 gibba015 bash[30343]: audit 2021-03-10T17:33:57.372190+0000 mgr.gibba045.orlgmj (mgr.34412) 11870 : audit [DBG] from='client.61996 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:33:58.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:33:57 gibba015 bash[30343]: audit 2021-03-10T17:33:57.595290+0000 mgr.gibba045.orlgmj (mgr.34412) 11871 : audit [DBG] from='client.52014 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:33:58.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:33:57 gibba015 bash[30343]: audit 2021-03-10T17:33:57.854261+0000 mon.c (mon.1) 3257 : audit [DBG] from='client.? 172.21.2.115:0/4169355784' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:33:58.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:33:57 gibba045 bash[25517]: audit 2021-03-10T17:33:57.372190+0000 mgr.gibba045.orlgmj (mgr.34412) 11870 : audit [DBG] from='client.61996 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:33:58.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:33:57 gibba045 bash[25517]: audit 2021-03-10T17:33:57.595290+0000 mgr.gibba045.orlgmj (mgr.34412) 11871 : audit [DBG] from='client.52014 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:33:58.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:33:57 gibba045 bash[25517]: audit 2021-03-10T17:33:57.854261+0000 mon.c (mon.1) 3257 : audit [DBG] from='client.? 172.21.2.115:0/4169355784' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:33:59.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:33:59 gibba015 bash[29377]: cluster 2021-03-10T17:33:58.848020+0000 mgr.gibba045.orlgmj (mgr.34412) 11872 : cluster [DBG] pgmap v6763: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:59.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:33:59 gibba015 bash[30343]: cluster 2021-03-10T17:33:58.848020+0000 mgr.gibba045.orlgmj (mgr.34412) 11872 : cluster [DBG] pgmap v6763: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:59.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:33:59 gibba045 bash[25517]: cluster 2021-03-10T17:33:58.848020+0000 mgr.gibba045.orlgmj (mgr.34412) 11872 : cluster [DBG] pgmap v6763: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:01.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:34:00 gibba015 bash[29377]: cluster 2021-03-10T17:34:00.849698+0000 mgr.gibba045.orlgmj (mgr.34412) 11873 : cluster [DBG] pgmap v6764: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:01.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:34:00 gibba015 bash[30343]: cluster 2021-03-10T17:34:00.849698+0000 mgr.gibba045.orlgmj (mgr.34412) 11873 : cluster [DBG] pgmap v6764: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:01.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:34:00 gibba045 bash[25517]: cluster 2021-03-10T17:34:00.849698+0000 mgr.gibba045.orlgmj (mgr.34412) 11873 : cluster [DBG] pgmap v6764: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:03.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:34:02 gibba015 bash[29377]: cluster 2021-03-10T17:34:02.851294+0000 mgr.gibba045.orlgmj (mgr.34412) 11874 : cluster [DBG] pgmap v6765: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:03.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:34:02 gibba015 bash[30343]: cluster 2021-03-10T17:34:02.851294+0000 mgr.gibba045.orlgmj (mgr.34412) 11874 : cluster [DBG] pgmap v6765: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:03.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:34:02 gibba045 bash[25517]: cluster 2021-03-10T17:34:02.851294+0000 mgr.gibba045.orlgmj (mgr.34412) 11874 : cluster [DBG] pgmap v6765: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:05.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:34:04 gibba015 bash[29377]: cluster 2021-03-10T17:34:04.852102+0000 mgr.gibba045.orlgmj (mgr.34412) 11875 : cluster [DBG] pgmap v6766: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:05.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:34:04 gibba015 bash[30343]: cluster 2021-03-10T17:34:04.852102+0000 mgr.gibba045.orlgmj (mgr.34412) 11875 : cluster [DBG] pgmap v6766: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:05.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:34:04 gibba045 bash[25517]: cluster 2021-03-10T17:34:04.852102+0000 mgr.gibba045.orlgmj (mgr.34412) 11875 : cluster [DBG] pgmap v6766: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:06.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:34:05 gibba015 bash[29377]: cephadm 2021-03-10T17:34:05.501165+0000 mgr.gibba045.orlgmj (mgr.34412) 11876 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:34:06.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:34:05 gibba015 bash[30343]: cephadm 2021-03-10T17:34:05.501165+0000 mgr.gibba045.orlgmj (mgr.34412) 11876 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:34:06.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:34:05 gibba045 bash[25517]: cephadm 2021-03-10T17:34:05.501165+0000 mgr.gibba045.orlgmj (mgr.34412) 11876 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:34:07.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:34:06 gibba015 bash[29377]: cluster 2021-03-10T17:34:06.853523+0000 mgr.gibba045.orlgmj (mgr.34412) 11877 : cluster [DBG] pgmap v6767: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:07.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:34:06 gibba015 bash[30343]: cluster 2021-03-10T17:34:06.853523+0000 mgr.gibba045.orlgmj (mgr.34412) 11877 : cluster [DBG] pgmap v6767: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:07.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:34:06 gibba045 bash[25517]: cluster 2021-03-10T17:34:06.853523+0000 mgr.gibba045.orlgmj (mgr.34412) 11877 : cluster [DBG] pgmap v6767: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:09.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:34:09 gibba015 bash[29377]: cluster 2021-03-10T17:34:08.854745+0000 mgr.gibba045.orlgmj (mgr.34412) 11878 : cluster [DBG] pgmap v6768: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:09.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:34:09 gibba015 bash[30343]: cluster 2021-03-10T17:34:08.854745+0000 mgr.gibba045.orlgmj (mgr.34412) 11878 : cluster [DBG] pgmap v6768: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:09.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:34:09 gibba045 bash[25517]: cluster 2021-03-10T17:34:08.854745+0000 mgr.gibba045.orlgmj (mgr.34412) 11878 : cluster [DBG] pgmap v6768: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:11.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:34:10 gibba015 bash[29377]: cluster 2021-03-10T17:34:10.856504+0000 mgr.gibba045.orlgmj (mgr.34412) 11879 : cluster [DBG] pgmap v6769: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:11.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:34:10 gibba015 bash[30343]: cluster 2021-03-10T17:34:10.856504+0000 mgr.gibba045.orlgmj (mgr.34412) 11879 : cluster [DBG] pgmap v6769: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:11.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:34:10 gibba045 bash[25517]: cluster 2021-03-10T17:34:10.856504+0000 mgr.gibba045.orlgmj (mgr.34412) 11879 : cluster [DBG] pgmap v6769: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:13.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:34:12 gibba015 bash[29377]: cluster 2021-03-10T17:34:12.857722+0000 mgr.gibba045.orlgmj (mgr.34412) 11880 : cluster [DBG] pgmap v6770: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:13.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:34:12 gibba015 bash[30343]: cluster 2021-03-10T17:34:12.857722+0000 mgr.gibba045.orlgmj (mgr.34412) 11880 : cluster [DBG] pgmap v6770: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:13.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:34:12 gibba045 bash[25517]: cluster 2021-03-10T17:34:12.857722+0000 mgr.gibba045.orlgmj (mgr.34412) 11880 : cluster [DBG] pgmap v6770: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:15.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:34:14 gibba015 bash[29377]: cluster 2021-03-10T17:34:14.859208+0000 mgr.gibba045.orlgmj (mgr.34412) 11881 : cluster [DBG] pgmap v6771: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:15.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:34:14 gibba015 bash[30343]: cluster 2021-03-10T17:34:14.859208+0000 mgr.gibba045.orlgmj (mgr.34412) 11881 : cluster [DBG] pgmap v6771: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:15.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:34:14 gibba045 bash[25517]: cluster 2021-03-10T17:34:14.859208+0000 mgr.gibba045.orlgmj (mgr.34412) 11881 : cluster [DBG] pgmap v6771: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:17.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:34:16 gibba015 bash[29377]: cluster 2021-03-10T17:34:16.861006+0000 mgr.gibba045.orlgmj (mgr.34412) 11882 : cluster [DBG] pgmap v6772: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:17.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:34:16 gibba015 bash[30343]: cluster 2021-03-10T17:34:16.861006+0000 mgr.gibba045.orlgmj (mgr.34412) 11882 : cluster [DBG] pgmap v6772: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:17.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:34:16 gibba045 bash[25517]: cluster 2021-03-10T17:34:16.861006+0000 mgr.gibba045.orlgmj (mgr.34412) 11882 : cluster [DBG] pgmap v6772: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:19.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:34:19 gibba015 bash[29377]: cluster 2021-03-10T17:34:18.862226+0000 mgr.gibba045.orlgmj (mgr.34412) 11883 : cluster [DBG] pgmap v6773: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:19.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:34:19 gibba015 bash[30343]: cluster 2021-03-10T17:34:18.862226+0000 mgr.gibba045.orlgmj (mgr.34412) 11883 : cluster [DBG] pgmap v6773: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:19.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:34:19 gibba045 bash[25517]: cluster 2021-03-10T17:34:18.862226+0000 mgr.gibba045.orlgmj (mgr.34412) 11883 : cluster [DBG] pgmap v6773: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:21.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:34:20 gibba015 bash[29377]: cephadm 2021-03-10T17:34:20.517208+0000 mgr.gibba045.orlgmj (mgr.34412) 11884 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:34:21.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:34:20 gibba015 bash[29377]: cluster 2021-03-10T17:34:20.863158+0000 mgr.gibba045.orlgmj (mgr.34412) 11885 : cluster [DBG] pgmap v6774: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:21.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:34:20 gibba015 bash[30343]: cephadm 2021-03-10T17:34:20.517208+0000 mgr.gibba045.orlgmj (mgr.34412) 11884 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:34:21.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:34:20 gibba015 bash[30343]: cluster 2021-03-10T17:34:20.863158+0000 mgr.gibba045.orlgmj (mgr.34412) 11885 : cluster [DBG] pgmap v6774: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:21.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:34:20 gibba045 bash[25517]: cephadm 2021-03-10T17:34:20.517208+0000 mgr.gibba045.orlgmj (mgr.34412) 11884 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:34:21.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:34:20 gibba045 bash[25517]: cluster 2021-03-10T17:34:20.863158+0000 mgr.gibba045.orlgmj (mgr.34412) 11885 : cluster [DBG] pgmap v6774: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:23.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:34:22 gibba015 bash[29377]: cluster 2021-03-10T17:34:22.864508+0000 mgr.gibba045.orlgmj (mgr.34412) 11886 : cluster [DBG] pgmap v6775: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:23.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:34:22 gibba015 bash[30343]: cluster 2021-03-10T17:34:22.864508+0000 mgr.gibba045.orlgmj (mgr.34412) 11886 : cluster [DBG] pgmap v6775: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:23.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:34:22 gibba045 bash[25517]: cluster 2021-03-10T17:34:22.864508+0000 mgr.gibba045.orlgmj (mgr.34412) 11886 : cluster [DBG] pgmap v6775: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:25.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:34:24 gibba015 bash[29377]: cluster 2021-03-10T17:34:24.866094+0000 mgr.gibba045.orlgmj (mgr.34412) 11887 : cluster [DBG] pgmap v6776: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:25.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:34:24 gibba015 bash[30343]: cluster 2021-03-10T17:34:24.866094+0000 mgr.gibba045.orlgmj (mgr.34412) 11887 : cluster [DBG] pgmap v6776: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:25.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:34:24 gibba045 bash[25517]: cluster 2021-03-10T17:34:24.866094+0000 mgr.gibba045.orlgmj (mgr.34412) 11887 : cluster [DBG] pgmap v6776: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:27.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:34:26 gibba015 bash[29377]: cluster 2021-03-10T17:34:26.867844+0000 mgr.gibba045.orlgmj (mgr.34412) 11888 : cluster [DBG] pgmap v6777: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:27.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:34:26 gibba015 bash[30343]: cluster 2021-03-10T17:34:26.867844+0000 mgr.gibba045.orlgmj (mgr.34412) 11888 : cluster [DBG] pgmap v6777: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:27.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:34:26 gibba045 bash[25517]: cluster 2021-03-10T17:34:26.867844+0000 mgr.gibba045.orlgmj (mgr.34412) 11888 : cluster [DBG] pgmap v6777: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:28.097 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:34:28.325 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:34:28.326 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 6m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:34:28.326 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 5m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:34:28.326 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:34:28.327 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:34:28.327 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:34:28.327 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:34:28.328 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:34:28.328 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:34:28.329 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 6m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:34:28.329 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 5m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:34:28.329 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:34:28.330 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:34:28.330 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:34:28.331 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:34:28.331 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:34:28.332 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:34:28.332 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:34:28.333 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:34:28.333 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 5m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:34:28.333 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 5m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:34:28.572 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:34:28.573 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:34:28.573 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:34:28.573 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:34:28.573 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:34:28.573 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:34:28.574 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:34:28.574 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:34:28.574 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:34:28.574 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:34:28.575 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:34:28.575 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:34:28.575 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:34:28.575 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:34:28.575 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:34:29.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:34:29 gibba015 bash[29377]: audit 2021-03-10T17:34:28.087076+0000 mgr.gibba045.orlgmj (mgr.34412) 11889 : audit [DBG] from='client.52026 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:34:29.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:34:29 gibba015 bash[29377]: audit 2021-03-10T17:34:28.312480+0000 mgr.gibba045.orlgmj (mgr.34412) 11890 : audit [DBG] from='client.62020 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:34:29.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:34:29 gibba015 bash[29377]: audit 2021-03-10T17:34:28.570030+0000 mon.c (mon.1) 3258 : audit [DBG] from='client.? 172.21.2.115:0/1518161393' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:34:29.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:34:29 gibba015 bash[29377]: cluster 2021-03-10T17:34:28.869054+0000 mgr.gibba045.orlgmj (mgr.34412) 11891 : cluster [DBG] pgmap v6778: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:29.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:34:29 gibba015 bash[30343]: audit 2021-03-10T17:34:28.087076+0000 mgr.gibba045.orlgmj (mgr.34412) 11889 : audit [DBG] from='client.52026 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:34:29.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:34:29 gibba015 bash[30343]: audit 2021-03-10T17:34:28.312480+0000 mgr.gibba045.orlgmj (mgr.34412) 11890 : audit [DBG] from='client.62020 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:34:29.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:34:29 gibba015 bash[30343]: audit 2021-03-10T17:34:28.570030+0000 mon.c (mon.1) 3258 : audit [DBG] from='client.? 172.21.2.115:0/1518161393' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:34:29.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:34:29 gibba015 bash[30343]: cluster 2021-03-10T17:34:28.869054+0000 mgr.gibba045.orlgmj (mgr.34412) 11891 : cluster [DBG] pgmap v6778: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:29.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:34:29 gibba045 bash[25517]: audit 2021-03-10T17:34:28.087076+0000 mgr.gibba045.orlgmj (mgr.34412) 11889 : audit [DBG] from='client.52026 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:34:29.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:34:29 gibba045 bash[25517]: audit 2021-03-10T17:34:28.312480+0000 mgr.gibba045.orlgmj (mgr.34412) 11890 : audit [DBG] from='client.62020 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:34:29.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:34:29 gibba045 bash[25517]: audit 2021-03-10T17:34:28.570030+0000 mon.c (mon.1) 3258 : audit [DBG] from='client.? 172.21.2.115:0/1518161393' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:34:29.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:34:29 gibba045 bash[25517]: cluster 2021-03-10T17:34:28.869054+0000 mgr.gibba045.orlgmj (mgr.34412) 11891 : cluster [DBG] pgmap v6778: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:31.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:34:30 gibba015 bash[29377]: cluster 2021-03-10T17:34:30.870542+0000 mgr.gibba045.orlgmj (mgr.34412) 11892 : cluster [DBG] pgmap v6779: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:31.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:34:30 gibba015 bash[30343]: cluster 2021-03-10T17:34:30.870542+0000 mgr.gibba045.orlgmj (mgr.34412) 11892 : cluster [DBG] pgmap v6779: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:31.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:34:30 gibba045 bash[25517]: cluster 2021-03-10T17:34:30.870542+0000 mgr.gibba045.orlgmj (mgr.34412) 11892 : cluster [DBG] pgmap v6779: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:33.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:34:32 gibba015 bash[29377]: cluster 2021-03-10T17:34:32.871976+0000 mgr.gibba045.orlgmj (mgr.34412) 11893 : cluster [DBG] pgmap v6780: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:33.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:34:32 gibba015 bash[30343]: cluster 2021-03-10T17:34:32.871976+0000 mgr.gibba045.orlgmj (mgr.34412) 11893 : cluster [DBG] pgmap v6780: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:33.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:34:32 gibba045 bash[25517]: cluster 2021-03-10T17:34:32.871976+0000 mgr.gibba045.orlgmj (mgr.34412) 11893 : cluster [DBG] pgmap v6780: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:35.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:34:34 gibba015 bash[29377]: cluster 2021-03-10T17:34:34.873694+0000 mgr.gibba045.orlgmj (mgr.34412) 11894 : cluster [DBG] pgmap v6781: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:35.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:34:34 gibba015 bash[30343]: cluster 2021-03-10T17:34:34.873694+0000 mgr.gibba045.orlgmj (mgr.34412) 11894 : cluster [DBG] pgmap v6781: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:35.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:34:34 gibba045 bash[25517]: cluster 2021-03-10T17:34:34.873694+0000 mgr.gibba045.orlgmj (mgr.34412) 11894 : cluster [DBG] pgmap v6781: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:36.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:34:35 gibba015 bash[29377]: cephadm 2021-03-10T17:34:35.533169+0000 mgr.gibba045.orlgmj (mgr.34412) 11895 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:34:36.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:34:35 gibba015 bash[30343]: cephadm 2021-03-10T17:34:35.533169+0000 mgr.gibba045.orlgmj (mgr.34412) 11895 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:34:36.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:34:35 gibba045 bash[25517]: cephadm 2021-03-10T17:34:35.533169+0000 mgr.gibba045.orlgmj (mgr.34412) 11895 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:34:37.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:34:36 gibba045 bash[25517]: cluster 2021-03-10T17:34:36.874843+0000 mgr.gibba045.orlgmj (mgr.34412) 11896 : cluster [DBG] pgmap v6782: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:37.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:34:36 gibba015 bash[29377]: cluster 2021-03-10T17:34:36.874843+0000 mgr.gibba045.orlgmj (mgr.34412) 11896 : cluster [DBG] pgmap v6782: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:37.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:34:36 gibba015 bash[30343]: cluster 2021-03-10T17:34:36.874843+0000 mgr.gibba045.orlgmj (mgr.34412) 11896 : cluster [DBG] pgmap v6782: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:39.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:34:39 gibba015 bash[29377]: cluster 2021-03-10T17:34:38.875972+0000 mgr.gibba045.orlgmj (mgr.34412) 11897 : cluster [DBG] pgmap v6783: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:39.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:34:39 gibba015 bash[30343]: cluster 2021-03-10T17:34:38.875972+0000 mgr.gibba045.orlgmj (mgr.34412) 11897 : cluster [DBG] pgmap v6783: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:39.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:34:39 gibba045 bash[25517]: cluster 2021-03-10T17:34:38.875972+0000 mgr.gibba045.orlgmj (mgr.34412) 11897 : cluster [DBG] pgmap v6783: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:41.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:34:40 gibba015 bash[29377]: cluster 2021-03-10T17:34:40.877651+0000 mgr.gibba045.orlgmj (mgr.34412) 11898 : cluster [DBG] pgmap v6784: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:41.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:34:40 gibba015 bash[30343]: cluster 2021-03-10T17:34:40.877651+0000 mgr.gibba045.orlgmj (mgr.34412) 11898 : cluster [DBG] pgmap v6784: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:41.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:34:40 gibba045 bash[25517]: cluster 2021-03-10T17:34:40.877651+0000 mgr.gibba045.orlgmj (mgr.34412) 11898 : cluster [DBG] pgmap v6784: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:43.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:34:42 gibba015 bash[29377]: cluster 2021-03-10T17:34:42.879051+0000 mgr.gibba045.orlgmj (mgr.34412) 11899 : cluster [DBG] pgmap v6785: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:43.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:34:42 gibba015 bash[30343]: cluster 2021-03-10T17:34:42.879051+0000 mgr.gibba045.orlgmj (mgr.34412) 11899 : cluster [DBG] pgmap v6785: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:43.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:34:42 gibba045 bash[25517]: cluster 2021-03-10T17:34:42.879051+0000 mgr.gibba045.orlgmj (mgr.34412) 11899 : cluster [DBG] pgmap v6785: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:45.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:34:44 gibba015 bash[29377]: cluster 2021-03-10T17:34:44.880840+0000 mgr.gibba045.orlgmj (mgr.34412) 11900 : cluster [DBG] pgmap v6786: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:45.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:34:44 gibba015 bash[30343]: cluster 2021-03-10T17:34:44.880840+0000 mgr.gibba045.orlgmj (mgr.34412) 11900 : cluster [DBG] pgmap v6786: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:45.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:34:44 gibba045 bash[25517]: cluster 2021-03-10T17:34:44.880840+0000 mgr.gibba045.orlgmj (mgr.34412) 11900 : cluster [DBG] pgmap v6786: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:47.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:34:46 gibba015 bash[29377]: cluster 2021-03-10T17:34:46.882351+0000 mgr.gibba045.orlgmj (mgr.34412) 11901 : cluster [DBG] pgmap v6787: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:47.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:34:46 gibba015 bash[30343]: cluster 2021-03-10T17:34:46.882351+0000 mgr.gibba045.orlgmj (mgr.34412) 11901 : cluster [DBG] pgmap v6787: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:47.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:34:46 gibba045 bash[25517]: cluster 2021-03-10T17:34:46.882351+0000 mgr.gibba045.orlgmj (mgr.34412) 11901 : cluster [DBG] pgmap v6787: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:49.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:34:49 gibba015 bash[29377]: cluster 2021-03-10T17:34:48.883554+0000 mgr.gibba045.orlgmj (mgr.34412) 11902 : cluster [DBG] pgmap v6788: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:49.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:34:49 gibba015 bash[30343]: cluster 2021-03-10T17:34:48.883554+0000 mgr.gibba045.orlgmj (mgr.34412) 11902 : cluster [DBG] pgmap v6788: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:49.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:34:49 gibba045 bash[25517]: cluster 2021-03-10T17:34:48.883554+0000 mgr.gibba045.orlgmj (mgr.34412) 11902 : cluster [DBG] pgmap v6788: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:50.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:34:50 gibba015 bash[29377]: audit 2021-03-10T17:34:50.548200+0000 mon.c (mon.1) 3259 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:34:50.972 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:34:50 gibba015 bash[30343]: audit 2021-03-10T17:34:50.548200+0000 mon.c (mon.1) 3259 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:34:50.982 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:34:50 gibba045 bash[25517]: audit 2021-03-10T17:34:50.548200+0000 mon.c (mon.1) 3259 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:34:52.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:34:51 gibba045 bash[25517]: audit 2021-03-10T17:34:50.758047+0000 mon.a (mon.0) 2469 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:34:52.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:34:51 gibba045 bash[25517]: cephadm 2021-03-10T17:34:50.760913+0000 mgr.gibba045.orlgmj (mgr.34412) 11903 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:34:52.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:34:51 gibba045 bash[25517]: audit 2021-03-10T17:34:50.760950+0000 mon.a (mon.0) 2470 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:34:52.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:34:51 gibba045 bash[25517]: cephadm 2021-03-10T17:34:50.764070+0000 mgr.gibba045.orlgmj (mgr.34412) 11904 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:34:52.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:34:51 gibba045 bash[25517]: cluster 2021-03-10T17:34:50.884104+0000 mgr.gibba045.orlgmj (mgr.34412) 11905 : cluster [DBG] pgmap v6789: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:52.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:34:51 gibba045 bash[25517]: audit 2021-03-10T17:34:50.965497+0000 mon.a (mon.0) 2471 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:34:52.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:34:51 gibba045 bash[25517]: audit 2021-03-10T17:34:50.969400+0000 mon.c (mon.1) 3260 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:34:52.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:34:51 gibba045 bash[25517]: audit 2021-03-10T17:34:50.971156+0000 mon.c (mon.1) 3261 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:34:52.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:34:51 gibba045 bash[25517]: audit 2021-03-10T17:34:50.972978+0000 mon.c (mon.1) 3262 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:34:52.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:34:51 gibba045 bash[25517]: audit 2021-03-10T17:34:50.974560+0000 mon.c (mon.1) 3263 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:34:52.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:34:51 gibba045 bash[25517]: audit 2021-03-10T17:34:50.977874+0000 mon.c (mon.1) 3264 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:34:52.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:34:51 gibba045 bash[25517]: audit 2021-03-10T17:34:50.979381+0000 mon.c (mon.1) 3265 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:34:52.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:34:51 gibba015 bash[29377]: audit 2021-03-10T17:34:50.758047+0000 mon.a (mon.0) 2469 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:34:52.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:34:51 gibba015 bash[29377]: cephadm 2021-03-10T17:34:50.760913+0000 mgr.gibba045.orlgmj (mgr.34412) 11903 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:34:52.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:34:51 gibba015 bash[29377]: audit 2021-03-10T17:34:50.760950+0000 mon.a (mon.0) 2470 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:34:52.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:34:51 gibba015 bash[29377]: cephadm 2021-03-10T17:34:50.764070+0000 mgr.gibba045.orlgmj (mgr.34412) 11904 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:34:52.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:34:51 gibba015 bash[29377]: cluster 2021-03-10T17:34:50.884104+0000 mgr.gibba045.orlgmj (mgr.34412) 11905 : cluster [DBG] pgmap v6789: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:52.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:34:51 gibba015 bash[29377]: audit 2021-03-10T17:34:50.965497+0000 mon.a (mon.0) 2471 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:34:52.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:34:51 gibba015 bash[29377]: audit 2021-03-10T17:34:50.969400+0000 mon.c (mon.1) 3260 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:34:52.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:34:51 gibba015 bash[29377]: audit 2021-03-10T17:34:50.971156+0000 mon.c (mon.1) 3261 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:34:52.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:34:51 gibba015 bash[29377]: audit 2021-03-10T17:34:50.972978+0000 mon.c (mon.1) 3262 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:34:52.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:34:51 gibba015 bash[29377]: audit 2021-03-10T17:34:50.974560+0000 mon.c (mon.1) 3263 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:34:52.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:34:51 gibba015 bash[29377]: audit 2021-03-10T17:34:50.977874+0000 mon.c (mon.1) 3264 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:34:52.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:34:51 gibba015 bash[29377]: audit 2021-03-10T17:34:50.979381+0000 mon.c (mon.1) 3265 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:34:52.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:34:51 gibba015 bash[30343]: audit 2021-03-10T17:34:50.758047+0000 mon.a (mon.0) 2469 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:34:52.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:34:51 gibba015 bash[30343]: cephadm 2021-03-10T17:34:50.760913+0000 mgr.gibba045.orlgmj (mgr.34412) 11903 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:34:52.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:34:51 gibba015 bash[30343]: audit 2021-03-10T17:34:50.760950+0000 mon.a (mon.0) 2470 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:34:52.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:34:51 gibba015 bash[30343]: cephadm 2021-03-10T17:34:50.764070+0000 mgr.gibba045.orlgmj (mgr.34412) 11904 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:34:52.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:34:51 gibba015 bash[30343]: cluster 2021-03-10T17:34:50.884104+0000 mgr.gibba045.orlgmj (mgr.34412) 11905 : cluster [DBG] pgmap v6789: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:52.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:34:51 gibba015 bash[30343]: audit 2021-03-10T17:34:50.965497+0000 mon.a (mon.0) 2471 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:34:52.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:34:51 gibba015 bash[30343]: audit 2021-03-10T17:34:50.969400+0000 mon.c (mon.1) 3260 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:34:52.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:34:51 gibba015 bash[30343]: audit 2021-03-10T17:34:50.971156+0000 mon.c (mon.1) 3261 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:34:52.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:34:51 gibba015 bash[30343]: audit 2021-03-10T17:34:50.972978+0000 mon.c (mon.1) 3262 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:34:52.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:34:51 gibba015 bash[30343]: audit 2021-03-10T17:34:50.974560+0000 mon.c (mon.1) 3263 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:34:52.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:34:51 gibba015 bash[30343]: audit 2021-03-10T17:34:50.977874+0000 mon.c (mon.1) 3264 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:34:52.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:34:51 gibba015 bash[30343]: audit 2021-03-10T17:34:50.979381+0000 mon.c (mon.1) 3265 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:34:53.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:34:52 gibba045 bash[25517]: cephadm 2021-03-10T17:34:50.970461+0000 mgr.gibba045.orlgmj (mgr.34412) 11906 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:34:53.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:34:52 gibba045 bash[25517]: cephadm 2021-03-10T17:34:50.972529+0000 mgr.gibba045.orlgmj (mgr.34412) 11907 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:34:53.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:34:52 gibba045 bash[25517]: cephadm 2021-03-10T17:34:50.974272+0000 mgr.gibba045.orlgmj (mgr.34412) 11908 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:34:53.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:34:52 gibba045 bash[25517]: cephadm 2021-03-10T17:34:50.974310+0000 mgr.gibba045.orlgmj (mgr.34412) 11909 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:34:53.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:34:52 gibba045 bash[25517]: cephadm 2021-03-10T17:34:50.976012+0000 mgr.gibba045.orlgmj (mgr.34412) 11910 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:34:53.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:34:52 gibba045 bash[25517]: cephadm 2021-03-10T17:34:50.976052+0000 mgr.gibba045.orlgmj (mgr.34412) 11911 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:34:53.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:34:52 gibba045 bash[25517]: cephadm 2021-03-10T17:34:50.977517+0000 mgr.gibba045.orlgmj (mgr.34412) 11912 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:34:53.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:34:52 gibba045 bash[25517]: cephadm 2021-03-10T17:34:50.979148+0000 mgr.gibba045.orlgmj (mgr.34412) 11913 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:34:53.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:34:52 gibba045 bash[25517]: cephadm 2021-03-10T17:34:50.979194+0000 mgr.gibba045.orlgmj (mgr.34412) 11914 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:34:53.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:34:52 gibba045 bash[25517]: cephadm 2021-03-10T17:34:50.980526+0000 mgr.gibba045.orlgmj (mgr.34412) 11915 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:34:53.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:34:52 gibba045 bash[25517]: cephadm 2021-03-10T17:34:50.980899+0000 mgr.gibba045.orlgmj (mgr.34412) 11916 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:34:53.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:34:52 gibba045 bash[25517]: cephadm 2021-03-10T17:34:50.982068+0000 mgr.gibba045.orlgmj (mgr.34412) 11917 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:34:53.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:34:52 gibba045 bash[25517]: cephadm 2021-03-10T17:34:50.982108+0000 mgr.gibba045.orlgmj (mgr.34412) 11918 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:34:53.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:34:52 gibba045 bash[25517]: cephadm 2021-03-10T17:34:50.982270+0000 mgr.gibba045.orlgmj (mgr.34412) 11919 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:34:53.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:34:52 gibba015 bash[29377]: cephadm 2021-03-10T17:34:50.970461+0000 mgr.gibba045.orlgmj (mgr.34412) 11906 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:34:53.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:34:52 gibba015 bash[29377]: cephadm 2021-03-10T17:34:50.972529+0000 mgr.gibba045.orlgmj (mgr.34412) 11907 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:34:53.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:34:52 gibba015 bash[29377]: cephadm 2021-03-10T17:34:50.974272+0000 mgr.gibba045.orlgmj (mgr.34412) 11908 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:34:53.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:34:52 gibba015 bash[29377]: cephadm 2021-03-10T17:34:50.974310+0000 mgr.gibba045.orlgmj (mgr.34412) 11909 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:34:53.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:34:52 gibba015 bash[29377]: cephadm 2021-03-10T17:34:50.976012+0000 mgr.gibba045.orlgmj (mgr.34412) 11910 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:34:53.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:34:52 gibba015 bash[29377]: cephadm 2021-03-10T17:34:50.976052+0000 mgr.gibba045.orlgmj (mgr.34412) 11911 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:34:53.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:34:52 gibba015 bash[29377]: cephadm 2021-03-10T17:34:50.977517+0000 mgr.gibba045.orlgmj (mgr.34412) 11912 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:34:53.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:34:52 gibba015 bash[29377]: cephadm 2021-03-10T17:34:50.979148+0000 mgr.gibba045.orlgmj (mgr.34412) 11913 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:34:53.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:34:52 gibba015 bash[29377]: cephadm 2021-03-10T17:34:50.979194+0000 mgr.gibba045.orlgmj (mgr.34412) 11914 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:34:53.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:34:52 gibba015 bash[29377]: cephadm 2021-03-10T17:34:50.980526+0000 mgr.gibba045.orlgmj (mgr.34412) 11915 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:34:53.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:34:52 gibba015 bash[29377]: cephadm 2021-03-10T17:34:50.980899+0000 mgr.gibba045.orlgmj (mgr.34412) 11916 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:34:53.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:34:52 gibba015 bash[29377]: cephadm 2021-03-10T17:34:50.982068+0000 mgr.gibba045.orlgmj (mgr.34412) 11917 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:34:53.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:34:52 gibba015 bash[29377]: cephadm 2021-03-10T17:34:50.982108+0000 mgr.gibba045.orlgmj (mgr.34412) 11918 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:34:53.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:34:52 gibba015 bash[29377]: cephadm 2021-03-10T17:34:50.982270+0000 mgr.gibba045.orlgmj (mgr.34412) 11919 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:34:53.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:34:52 gibba015 bash[30343]: cephadm 2021-03-10T17:34:50.970461+0000 mgr.gibba045.orlgmj (mgr.34412) 11906 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:34:53.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:34:52 gibba015 bash[30343]: cephadm 2021-03-10T17:34:50.972529+0000 mgr.gibba045.orlgmj (mgr.34412) 11907 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:34:53.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:34:52 gibba015 bash[30343]: cephadm 2021-03-10T17:34:50.974272+0000 mgr.gibba045.orlgmj (mgr.34412) 11908 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:34:53.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:34:52 gibba015 bash[30343]: cephadm 2021-03-10T17:34:50.974310+0000 mgr.gibba045.orlgmj (mgr.34412) 11909 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:34:53.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:34:52 gibba015 bash[30343]: cephadm 2021-03-10T17:34:50.976012+0000 mgr.gibba045.orlgmj (mgr.34412) 11910 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:34:53.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:34:52 gibba015 bash[30343]: cephadm 2021-03-10T17:34:50.976052+0000 mgr.gibba045.orlgmj (mgr.34412) 11911 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:34:53.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:34:52 gibba015 bash[30343]: cephadm 2021-03-10T17:34:50.977517+0000 mgr.gibba045.orlgmj (mgr.34412) 11912 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:34:53.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:34:52 gibba015 bash[30343]: cephadm 2021-03-10T17:34:50.979148+0000 mgr.gibba045.orlgmj (mgr.34412) 11913 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:34:53.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:34:52 gibba015 bash[30343]: cephadm 2021-03-10T17:34:50.979194+0000 mgr.gibba045.orlgmj (mgr.34412) 11914 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:34:53.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:34:52 gibba015 bash[30343]: cephadm 2021-03-10T17:34:50.980526+0000 mgr.gibba045.orlgmj (mgr.34412) 11915 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:34:53.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:34:52 gibba015 bash[30343]: cephadm 2021-03-10T17:34:50.980899+0000 mgr.gibba045.orlgmj (mgr.34412) 11916 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:34:53.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:34:52 gibba015 bash[30343]: cephadm 2021-03-10T17:34:50.982068+0000 mgr.gibba045.orlgmj (mgr.34412) 11917 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:34:53.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:34:52 gibba015 bash[30343]: cephadm 2021-03-10T17:34:50.982108+0000 mgr.gibba045.orlgmj (mgr.34412) 11918 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:34:53.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:34:52 gibba015 bash[30343]: cephadm 2021-03-10T17:34:50.982270+0000 mgr.gibba045.orlgmj (mgr.34412) 11919 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:34:54.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:34:53 gibba045 bash[25517]: cluster 2021-03-10T17:34:52.885304+0000 mgr.gibba045.orlgmj (mgr.34412) 11920 : cluster [DBG] pgmap v6790: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:54.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:34:53 gibba015 bash[29377]: cluster 2021-03-10T17:34:52.885304+0000 mgr.gibba045.orlgmj (mgr.34412) 11920 : cluster [DBG] pgmap v6790: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:54.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:34:53 gibba015 bash[30343]: cluster 2021-03-10T17:34:52.885304+0000 mgr.gibba045.orlgmj (mgr.34412) 11920 : cluster [DBG] pgmap v6790: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:55.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:34:54 gibba045 bash[25517]: audit 2021-03-10T17:34:54.141112+0000 mon.c (mon.1) 3266 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:34:55.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:34:54 gibba045 bash[25517]: audit 2021-03-10T17:34:54.141751+0000 mon.c (mon.1) 3267 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:34:55.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:34:54 gibba045 bash[25517]: audit 2021-03-10T17:34:54.142238+0000 mon.a (mon.0) 2472 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:34:55.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:34:54 gibba045 bash[25517]: audit 2021-03-10T17:34:54.143431+0000 mon.a (mon.0) 2473 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:34:55.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:34:54 gibba045 bash[25517]: audit 2021-03-10T17:34:54.230895+0000 mon.c (mon.1) 3268 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T17:34:55.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:34:54 gibba045 bash[25517]: audit 2021-03-10T17:34:54.231597+0000 mon.c (mon.1) 3269 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:34:55.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:34:54 gibba045 bash[25517]: audit 2021-03-10T17:34:54.232097+0000 mon.a (mon.0) 2474 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T17:34:55.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:34:54 gibba045 bash[25517]: audit 2021-03-10T17:34:54.232298+0000 mon.c (mon.1) 3270 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T17:34:55.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:34:54 gibba045 bash[25517]: audit 2021-03-10T17:34:54.233136+0000 mon.c (mon.1) 3271 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:34:55.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:34:54 gibba045 bash[25517]: audit 2021-03-10T17:34:54.233432+0000 mon.a (mon.0) 2475 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:34:55.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:34:54 gibba045 bash[25517]: audit 2021-03-10T17:34:54.234674+0000 mon.a (mon.0) 2476 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T17:34:55.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:34:54 gibba045 bash[25517]: audit 2021-03-10T17:34:54.235507+0000 mon.a (mon.0) 2477 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:34:55.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:34:54 gibba015 bash[29377]: audit 2021-03-10T17:34:54.141112+0000 mon.c (mon.1) 3266 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:34:55.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:34:54 gibba015 bash[29377]: audit 2021-03-10T17:34:54.141751+0000 mon.c (mon.1) 3267 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:34:55.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:34:54 gibba015 bash[29377]: audit 2021-03-10T17:34:54.142238+0000 mon.a (mon.0) 2472 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:34:55.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:34:54 gibba015 bash[29377]: audit 2021-03-10T17:34:54.143431+0000 mon.a (mon.0) 2473 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:34:55.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:34:54 gibba015 bash[29377]: audit 2021-03-10T17:34:54.230895+0000 mon.c (mon.1) 3268 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T17:34:55.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:34:54 gibba015 bash[29377]: audit 2021-03-10T17:34:54.231597+0000 mon.c (mon.1) 3269 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:34:55.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:34:54 gibba015 bash[29377]: audit 2021-03-10T17:34:54.232097+0000 mon.a (mon.0) 2474 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T17:34:55.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:34:54 gibba015 bash[29377]: audit 2021-03-10T17:34:54.232298+0000 mon.c (mon.1) 3270 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T17:34:55.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:34:54 gibba015 bash[29377]: audit 2021-03-10T17:34:54.233136+0000 mon.c (mon.1) 3271 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:34:55.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:34:54 gibba015 bash[29377]: audit 2021-03-10T17:34:54.233432+0000 mon.a (mon.0) 2475 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:34:55.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:34:54 gibba015 bash[29377]: audit 2021-03-10T17:34:54.234674+0000 mon.a (mon.0) 2476 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T17:34:55.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:34:54 gibba015 bash[29377]: audit 2021-03-10T17:34:54.235507+0000 mon.a (mon.0) 2477 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:34:55.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:34:54 gibba015 bash[30343]: audit 2021-03-10T17:34:54.141112+0000 mon.c (mon.1) 3266 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:34:55.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:34:54 gibba015 bash[30343]: audit 2021-03-10T17:34:54.141751+0000 mon.c (mon.1) 3267 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:34:55.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:34:54 gibba015 bash[30343]: audit 2021-03-10T17:34:54.142238+0000 mon.a (mon.0) 2472 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:34:55.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:34:54 gibba015 bash[30343]: audit 2021-03-10T17:34:54.143431+0000 mon.a (mon.0) 2473 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:34:55.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:34:54 gibba015 bash[30343]: audit 2021-03-10T17:34:54.230895+0000 mon.c (mon.1) 3268 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T17:34:55.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:34:54 gibba015 bash[30343]: audit 2021-03-10T17:34:54.231597+0000 mon.c (mon.1) 3269 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:34:55.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:34:54 gibba015 bash[30343]: audit 2021-03-10T17:34:54.232097+0000 mon.a (mon.0) 2474 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T17:34:55.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:34:54 gibba015 bash[30343]: audit 2021-03-10T17:34:54.232298+0000 mon.c (mon.1) 3270 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T17:34:55.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:34:54 gibba015 bash[30343]: audit 2021-03-10T17:34:54.233136+0000 mon.c (mon.1) 3271 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:34:55.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:34:54 gibba015 bash[30343]: audit 2021-03-10T17:34:54.233432+0000 mon.a (mon.0) 2475 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:34:55.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:34:54 gibba015 bash[30343]: audit 2021-03-10T17:34:54.234674+0000 mon.a (mon.0) 2476 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T17:34:55.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:34:54 gibba015 bash[30343]: audit 2021-03-10T17:34:54.235507+0000 mon.a (mon.0) 2477 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:34:56.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:34:55 gibba015 bash[29377]: cluster 2021-03-10T17:34:54.886948+0000 mgr.gibba045.orlgmj (mgr.34412) 11921 : cluster [DBG] pgmap v6791: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:56.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:34:55 gibba015 bash[30343]: cluster 2021-03-10T17:34:54.886948+0000 mgr.gibba045.orlgmj (mgr.34412) 11921 : cluster [DBG] pgmap v6791: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:56.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:34:55 gibba045 bash[25517]: cluster 2021-03-10T17:34:54.886948+0000 mgr.gibba045.orlgmj (mgr.34412) 11921 : cluster [DBG] pgmap v6791: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:57.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:34:56 gibba045 bash[25517]: cluster 2021-03-10T17:34:56.888810+0000 mgr.gibba045.orlgmj (mgr.34412) 11922 : cluster [DBG] pgmap v6792: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:57.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:34:56 gibba015 bash[29377]: cluster 2021-03-10T17:34:56.888810+0000 mgr.gibba045.orlgmj (mgr.34412) 11922 : cluster [DBG] pgmap v6792: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:57.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:34:56 gibba015 bash[30343]: cluster 2021-03-10T17:34:56.888810+0000 mgr.gibba045.orlgmj (mgr.34412) 11922 : cluster [DBG] pgmap v6792: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:58.814 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:34:59.042 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:34:59.043 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 7m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:34:59.043 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 6m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:34:59.043 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:34:59.044 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:34:59.044 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:34:59.044 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:34:59.044 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:34:59.045 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:34:59.045 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 7m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:34:59.046 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 6m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:34:59.046 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:34:59.046 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:34:59.046 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:34:59.047 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:34:59.047 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:34:59.047 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:34:59.047 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:34:59.048 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:34:59.048 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 6m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:34:59.048 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 6m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:34:59.294 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:34:59.295 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:34:59.295 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:34:59.295 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:34:59.296 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:34:59.296 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:34:59.296 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:34:59.296 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:34:59.296 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:34:59.297 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:34:59.297 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:34:59.297 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:34:59.297 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:34:59.298 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:34:59.298 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:34:59.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:34:59 gibba015 bash[29377]: audit 2021-03-10T17:34:58.805370+0000 mgr.gibba045.orlgmj (mgr.34412) 11923 : audit [DBG] from='client.62032 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:34:59.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:34:59 gibba015 bash[29377]: cluster 2021-03-10T17:34:58.889965+0000 mgr.gibba045.orlgmj (mgr.34412) 11924 : cluster [DBG] pgmap v6793: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:59.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:34:59 gibba015 bash[30343]: audit 2021-03-10T17:34:58.805370+0000 mgr.gibba045.orlgmj (mgr.34412) 11923 : audit [DBG] from='client.62032 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:34:59.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:34:59 gibba015 bash[30343]: cluster 2021-03-10T17:34:58.889965+0000 mgr.gibba045.orlgmj (mgr.34412) 11924 : cluster [DBG] pgmap v6793: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:59.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:34:59 gibba045 bash[25517]: audit 2021-03-10T17:34:58.805370+0000 mgr.gibba045.orlgmj (mgr.34412) 11923 : audit [DBG] from='client.62032 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:34:59.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:34:59 gibba045 bash[25517]: cluster 2021-03-10T17:34:58.889965+0000 mgr.gibba045.orlgmj (mgr.34412) 11924 : cluster [DBG] pgmap v6793: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:00.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:35:00 gibba015 bash[29377]: audit 2021-03-10T17:34:59.029828+0000 mgr.gibba045.orlgmj (mgr.34412) 11925 : audit [DBG] from='client.52050 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:35:00.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:35:00 gibba015 bash[29377]: audit 2021-03-10T17:34:59.292240+0000 mon.c (mon.1) 3272 : audit [DBG] from='client.? 172.21.2.115:0/2452659566' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:35:00.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:35:00 gibba015 bash[30343]: audit 2021-03-10T17:34:59.029828+0000 mgr.gibba045.orlgmj (mgr.34412) 11925 : audit [DBG] from='client.52050 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:35:00.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:35:00 gibba015 bash[30343]: audit 2021-03-10T17:34:59.292240+0000 mon.c (mon.1) 3272 : audit [DBG] from='client.? 172.21.2.115:0/2452659566' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:35:00.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:35:00 gibba045 bash[25517]: audit 2021-03-10T17:34:59.029828+0000 mgr.gibba045.orlgmj (mgr.34412) 11925 : audit [DBG] from='client.52050 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:35:00.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:35:00 gibba045 bash[25517]: audit 2021-03-10T17:34:59.292240+0000 mon.c (mon.1) 3272 : audit [DBG] from='client.? 172.21.2.115:0/2452659566' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:35:01.420 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:35:01 gibba015 bash[29377]: cluster 2021-03-10T17:35:00.891605+0000 mgr.gibba045.orlgmj (mgr.34412) 11926 : cluster [DBG] pgmap v6794: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:01.420 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:35:01 gibba015 bash[30343]: cluster 2021-03-10T17:35:00.891605+0000 mgr.gibba045.orlgmj (mgr.34412) 11926 : cluster [DBG] pgmap v6794: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:01.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:35:01 gibba045 bash[25517]: cluster 2021-03-10T17:35:00.891605+0000 mgr.gibba045.orlgmj (mgr.34412) 11926 : cluster [DBG] pgmap v6794: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:03.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:35:02 gibba045 bash[25517]: cluster 2021-03-10T17:35:02.893074+0000 mgr.gibba045.orlgmj (mgr.34412) 11927 : cluster [DBG] pgmap v6795: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:03.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:35:02 gibba015 bash[29377]: cluster 2021-03-10T17:35:02.893074+0000 mgr.gibba045.orlgmj (mgr.34412) 11927 : cluster [DBG] pgmap v6795: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:03.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:35:02 gibba015 bash[30343]: cluster 2021-03-10T17:35:02.893074+0000 mgr.gibba045.orlgmj (mgr.34412) 11927 : cluster [DBG] pgmap v6795: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:05.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:35:04 gibba045 bash[25517]: cluster 2021-03-10T17:35:04.894872+0000 mgr.gibba045.orlgmj (mgr.34412) 11928 : cluster [DBG] pgmap v6796: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:05.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:35:04 gibba015 bash[29377]: cluster 2021-03-10T17:35:04.894872+0000 mgr.gibba045.orlgmj (mgr.34412) 11928 : cluster [DBG] pgmap v6796: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:05.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:35:04 gibba015 bash[30343]: cluster 2021-03-10T17:35:04.894872+0000 mgr.gibba045.orlgmj (mgr.34412) 11928 : cluster [DBG] pgmap v6796: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:07.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:35:06 gibba045 bash[25517]: cephadm 2021-03-10T17:35:05.998333+0000 mgr.gibba045.orlgmj (mgr.34412) 11929 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:35:07.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:35:06 gibba045 bash[25517]: cluster 2021-03-10T17:35:06.896671+0000 mgr.gibba045.orlgmj (mgr.34412) 11930 : cluster [DBG] pgmap v6797: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:07.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:35:06 gibba015 bash[29377]: cephadm 2021-03-10T17:35:05.998333+0000 mgr.gibba045.orlgmj (mgr.34412) 11929 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:35:07.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:35:06 gibba015 bash[29377]: cluster 2021-03-10T17:35:06.896671+0000 mgr.gibba045.orlgmj (mgr.34412) 11930 : cluster [DBG] pgmap v6797: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:07.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:35:06 gibba015 bash[30343]: cephadm 2021-03-10T17:35:05.998333+0000 mgr.gibba045.orlgmj (mgr.34412) 11929 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:35:07.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:35:06 gibba015 bash[30343]: cluster 2021-03-10T17:35:06.896671+0000 mgr.gibba045.orlgmj (mgr.34412) 11930 : cluster [DBG] pgmap v6797: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:09.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:35:09 gibba015 bash[29377]: cluster 2021-03-10T17:35:08.897896+0000 mgr.gibba045.orlgmj (mgr.34412) 11931 : cluster [DBG] pgmap v6798: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:09.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:35:09 gibba015 bash[30343]: cluster 2021-03-10T17:35:08.897896+0000 mgr.gibba045.orlgmj (mgr.34412) 11931 : cluster [DBG] pgmap v6798: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:09.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:35:09 gibba045 bash[25517]: cluster 2021-03-10T17:35:08.897896+0000 mgr.gibba045.orlgmj (mgr.34412) 11931 : cluster [DBG] pgmap v6798: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:11.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:35:10 gibba045 bash[25517]: cluster 2021-03-10T17:35:10.899551+0000 mgr.gibba045.orlgmj (mgr.34412) 11932 : cluster [DBG] pgmap v6799: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:11.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:35:10 gibba015 bash[29377]: cluster 2021-03-10T17:35:10.899551+0000 mgr.gibba045.orlgmj (mgr.34412) 11932 : cluster [DBG] pgmap v6799: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:11.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:35:10 gibba015 bash[30343]: cluster 2021-03-10T17:35:10.899551+0000 mgr.gibba045.orlgmj (mgr.34412) 11932 : cluster [DBG] pgmap v6799: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:13.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:35:12 gibba045 bash[25517]: cluster 2021-03-10T17:35:12.900895+0000 mgr.gibba045.orlgmj (mgr.34412) 11933 : cluster [DBG] pgmap v6800: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:13.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:35:12 gibba015 bash[29377]: cluster 2021-03-10T17:35:12.900895+0000 mgr.gibba045.orlgmj (mgr.34412) 11933 : cluster [DBG] pgmap v6800: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:13.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:35:12 gibba015 bash[30343]: cluster 2021-03-10T17:35:12.900895+0000 mgr.gibba045.orlgmj (mgr.34412) 11933 : cluster [DBG] pgmap v6800: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:15.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:35:14 gibba045 bash[25517]: cluster 2021-03-10T17:35:14.902702+0000 mgr.gibba045.orlgmj (mgr.34412) 11934 : cluster [DBG] pgmap v6801: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:15.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:35:14 gibba015 bash[29377]: cluster 2021-03-10T17:35:14.902702+0000 mgr.gibba045.orlgmj (mgr.34412) 11934 : cluster [DBG] pgmap v6801: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:15.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:35:14 gibba015 bash[30343]: cluster 2021-03-10T17:35:14.902702+0000 mgr.gibba045.orlgmj (mgr.34412) 11934 : cluster [DBG] pgmap v6801: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:17.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:35:16 gibba045 bash[25517]: cluster 2021-03-10T17:35:16.904342+0000 mgr.gibba045.orlgmj (mgr.34412) 11935 : cluster [DBG] pgmap v6802: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:17.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:35:16 gibba015 bash[29377]: cluster 2021-03-10T17:35:16.904342+0000 mgr.gibba045.orlgmj (mgr.34412) 11935 : cluster [DBG] pgmap v6802: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:17.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:35:16 gibba015 bash[30343]: cluster 2021-03-10T17:35:16.904342+0000 mgr.gibba045.orlgmj (mgr.34412) 11935 : cluster [DBG] pgmap v6802: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:19.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:35:19 gibba015 bash[29377]: cluster 2021-03-10T17:35:18.905546+0000 mgr.gibba045.orlgmj (mgr.34412) 11936 : cluster [DBG] pgmap v6803: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:19.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:35:19 gibba015 bash[30343]: cluster 2021-03-10T17:35:18.905546+0000 mgr.gibba045.orlgmj (mgr.34412) 11936 : cluster [DBG] pgmap v6803: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:19.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:35:19 gibba045 bash[25517]: cluster 2021-03-10T17:35:18.905546+0000 mgr.gibba045.orlgmj (mgr.34412) 11936 : cluster [DBG] pgmap v6803: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:21.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:35:20 gibba045 bash[25517]: cluster 2021-03-10T17:35:20.907366+0000 mgr.gibba045.orlgmj (mgr.34412) 11937 : cluster [DBG] pgmap v6804: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:21.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:35:20 gibba015 bash[29377]: cluster 2021-03-10T17:35:20.907366+0000 mgr.gibba045.orlgmj (mgr.34412) 11937 : cluster [DBG] pgmap v6804: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:21.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:35:20 gibba015 bash[30343]: cluster 2021-03-10T17:35:20.907366+0000 mgr.gibba045.orlgmj (mgr.34412) 11937 : cluster [DBG] pgmap v6804: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:22.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:35:21 gibba045 bash[25517]: cephadm 2021-03-10T17:35:21.000483+0000 mgr.gibba045.orlgmj (mgr.34412) 11938 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:35:22.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:35:21 gibba015 bash[29377]: cephadm 2021-03-10T17:35:21.000483+0000 mgr.gibba045.orlgmj (mgr.34412) 11938 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:35:22.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:35:21 gibba015 bash[30343]: cephadm 2021-03-10T17:35:21.000483+0000 mgr.gibba045.orlgmj (mgr.34412) 11938 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:35:23.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:35:23 gibba045 bash[25517]: cluster 2021-03-10T17:35:22.908854+0000 mgr.gibba045.orlgmj (mgr.34412) 11939 : cluster [DBG] pgmap v6805: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:23.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:35:23 gibba015 bash[29377]: cluster 2021-03-10T17:35:22.908854+0000 mgr.gibba045.orlgmj (mgr.34412) 11939 : cluster [DBG] pgmap v6805: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:23.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:35:23 gibba015 bash[30343]: cluster 2021-03-10T17:35:22.908854+0000 mgr.gibba045.orlgmj (mgr.34412) 11939 : cluster [DBG] pgmap v6805: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:25.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:35:24 gibba045 bash[25517]: cluster 2021-03-10T17:35:24.910474+0000 mgr.gibba045.orlgmj (mgr.34412) 11940 : cluster [DBG] pgmap v6806: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:25.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:35:24 gibba015 bash[29377]: cluster 2021-03-10T17:35:24.910474+0000 mgr.gibba045.orlgmj (mgr.34412) 11940 : cluster [DBG] pgmap v6806: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:25.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:35:24 gibba015 bash[30343]: cluster 2021-03-10T17:35:24.910474+0000 mgr.gibba045.orlgmj (mgr.34412) 11940 : cluster [DBG] pgmap v6806: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:27.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:35:26 gibba045 bash[25517]: cluster 2021-03-10T17:35:26.912195+0000 mgr.gibba045.orlgmj (mgr.34412) 11941 : cluster [DBG] pgmap v6807: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:27.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:35:26 gibba015 bash[29377]: cluster 2021-03-10T17:35:26.912195+0000 mgr.gibba045.orlgmj (mgr.34412) 11941 : cluster [DBG] pgmap v6807: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:27.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:35:26 gibba015 bash[30343]: cluster 2021-03-10T17:35:26.912195+0000 mgr.gibba045.orlgmj (mgr.34412) 11941 : cluster [DBG] pgmap v6807: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:29.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:35:29 gibba015 bash[29377]: cluster 2021-03-10T17:35:28.913447+0000 mgr.gibba045.orlgmj (mgr.34412) 11942 : cluster [DBG] pgmap v6808: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:29.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:35:29 gibba015 bash[30343]: cluster 2021-03-10T17:35:28.913447+0000 mgr.gibba045.orlgmj (mgr.34412) 11942 : cluster [DBG] pgmap v6808: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:29.537 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:35:29.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:35:29 gibba045 bash[25517]: cluster 2021-03-10T17:35:28.913447+0000 mgr.gibba045.orlgmj (mgr.34412) 11942 : cluster [DBG] pgmap v6808: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:29.772 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:35:29.772 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 7m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:35:29.772 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 6m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:35:29.772 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:35:29.773 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:35:29.773 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:35:29.773 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:35:29.773 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:35:29.774 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:35:29.774 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 7m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:35:29.774 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 6m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:35:29.774 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:35:29.774 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:35:29.775 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:35:29.775 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:35:29.775 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:35:29.775 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:35:29.775 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:35:29.776 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:35:29.776 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 6m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:35:29.776 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 6m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:35:30.021 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:35:30.022 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:35:30.022 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:35:30.022 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:35:30.022 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:35:30.023 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:35:30.023 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:35:30.023 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:35:30.023 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:35:30.023 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:35:30.024 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:35:30.024 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:35:30.024 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:35:30.024 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:35:30.024 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:35:30.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:35:30 gibba015 bash[29377]: audit 2021-03-10T17:35:29.528034+0000 mgr.gibba045.orlgmj (mgr.34412) 11943 : audit [DBG] from='client.52062 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:35:30.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:35:30 gibba015 bash[29377]: audit 2021-03-10T17:35:29.759472+0000 mgr.gibba045.orlgmj (mgr.34412) 11944 : audit [DBG] from='client.52068 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:35:30.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:35:30 gibba015 bash[29377]: audit 2021-03-10T17:35:30.019142+0000 mon.c (mon.1) 3273 : audit [DBG] from='client.? 172.21.2.115:0/865970428' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:35:30.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:35:30 gibba015 bash[30343]: audit 2021-03-10T17:35:29.528034+0000 mgr.gibba045.orlgmj (mgr.34412) 11943 : audit [DBG] from='client.52062 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:35:30.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:35:30 gibba015 bash[30343]: audit 2021-03-10T17:35:29.759472+0000 mgr.gibba045.orlgmj (mgr.34412) 11944 : audit [DBG] from='client.52068 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:35:30.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:35:30 gibba015 bash[30343]: audit 2021-03-10T17:35:30.019142+0000 mon.c (mon.1) 3273 : audit [DBG] from='client.? 172.21.2.115:0/865970428' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:35:30.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:35:30 gibba045 bash[25517]: audit 2021-03-10T17:35:29.528034+0000 mgr.gibba045.orlgmj (mgr.34412) 11943 : audit [DBG] from='client.52062 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:35:30.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:35:30 gibba045 bash[25517]: audit 2021-03-10T17:35:29.759472+0000 mgr.gibba045.orlgmj (mgr.34412) 11944 : audit [DBG] from='client.52068 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:35:30.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:35:30 gibba045 bash[25517]: audit 2021-03-10T17:35:30.019142+0000 mon.c (mon.1) 3273 : audit [DBG] from='client.? 172.21.2.115:0/865970428' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:35:31.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:35:31 gibba015 bash[29377]: cluster 2021-03-10T17:35:30.914311+0000 mgr.gibba045.orlgmj (mgr.34412) 11945 : cluster [DBG] pgmap v6809: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:31.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:35:31 gibba015 bash[30343]: cluster 2021-03-10T17:35:30.914311+0000 mgr.gibba045.orlgmj (mgr.34412) 11945 : cluster [DBG] pgmap v6809: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:31.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:35:31 gibba045 bash[25517]: cluster 2021-03-10T17:35:30.914311+0000 mgr.gibba045.orlgmj (mgr.34412) 11945 : cluster [DBG] pgmap v6809: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:33.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:35:32 gibba045 bash[25517]: cluster 2021-03-10T17:35:32.915652+0000 mgr.gibba045.orlgmj (mgr.34412) 11946 : cluster [DBG] pgmap v6810: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:33.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:35:32 gibba015 bash[29377]: cluster 2021-03-10T17:35:32.915652+0000 mgr.gibba045.orlgmj (mgr.34412) 11946 : cluster [DBG] pgmap v6810: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:33.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:35:32 gibba015 bash[30343]: cluster 2021-03-10T17:35:32.915652+0000 mgr.gibba045.orlgmj (mgr.34412) 11946 : cluster [DBG] pgmap v6810: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:35.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:35:34 gibba045 bash[25517]: cluster 2021-03-10T17:35:34.917371+0000 mgr.gibba045.orlgmj (mgr.34412) 11947 : cluster [DBG] pgmap v6811: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:35.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:35:34 gibba015 bash[29377]: cluster 2021-03-10T17:35:34.917371+0000 mgr.gibba045.orlgmj (mgr.34412) 11947 : cluster [DBG] pgmap v6811: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:35.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:35:34 gibba015 bash[30343]: cluster 2021-03-10T17:35:34.917371+0000 mgr.gibba045.orlgmj (mgr.34412) 11947 : cluster [DBG] pgmap v6811: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:37.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:35:36 gibba045 bash[25517]: cephadm 2021-03-10T17:35:36.013535+0000 mgr.gibba045.orlgmj (mgr.34412) 11948 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:35:37.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:35:36 gibba045 bash[25517]: cluster 2021-03-10T17:35:36.919014+0000 mgr.gibba045.orlgmj (mgr.34412) 11949 : cluster [DBG] pgmap v6812: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:37.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:35:36 gibba015 bash[29377]: cephadm 2021-03-10T17:35:36.013535+0000 mgr.gibba045.orlgmj (mgr.34412) 11948 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:35:37.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:35:36 gibba015 bash[29377]: cluster 2021-03-10T17:35:36.919014+0000 mgr.gibba045.orlgmj (mgr.34412) 11949 : cluster [DBG] pgmap v6812: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:37.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:35:36 gibba015 bash[30343]: cephadm 2021-03-10T17:35:36.013535+0000 mgr.gibba045.orlgmj (mgr.34412) 11948 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:35:37.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:35:36 gibba015 bash[30343]: cluster 2021-03-10T17:35:36.919014+0000 mgr.gibba045.orlgmj (mgr.34412) 11949 : cluster [DBG] pgmap v6812: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:39.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:35:39 gibba015 bash[29377]: cluster 2021-03-10T17:35:38.920239+0000 mgr.gibba045.orlgmj (mgr.34412) 11950 : cluster [DBG] pgmap v6813: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:39.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:35:39 gibba015 bash[30343]: cluster 2021-03-10T17:35:38.920239+0000 mgr.gibba045.orlgmj (mgr.34412) 11950 : cluster [DBG] pgmap v6813: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:39.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:35:39 gibba045 bash[25517]: cluster 2021-03-10T17:35:38.920239+0000 mgr.gibba045.orlgmj (mgr.34412) 11950 : cluster [DBG] pgmap v6813: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:41.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:35:40 gibba045 bash[25517]: cluster 2021-03-10T17:35:40.921740+0000 mgr.gibba045.orlgmj (mgr.34412) 11951 : cluster [DBG] pgmap v6814: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:41.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:35:40 gibba015 bash[29377]: cluster 2021-03-10T17:35:40.921740+0000 mgr.gibba045.orlgmj (mgr.34412) 11951 : cluster [DBG] pgmap v6814: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:41.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:35:40 gibba015 bash[30343]: cluster 2021-03-10T17:35:40.921740+0000 mgr.gibba045.orlgmj (mgr.34412) 11951 : cluster [DBG] pgmap v6814: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:43.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:35:42 gibba045 bash[25517]: cluster 2021-03-10T17:35:42.923250+0000 mgr.gibba045.orlgmj (mgr.34412) 11952 : cluster [DBG] pgmap v6815: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:43.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:35:42 gibba015 bash[29377]: cluster 2021-03-10T17:35:42.923250+0000 mgr.gibba045.orlgmj (mgr.34412) 11952 : cluster [DBG] pgmap v6815: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:43.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:35:42 gibba015 bash[30343]: cluster 2021-03-10T17:35:42.923250+0000 mgr.gibba045.orlgmj (mgr.34412) 11952 : cluster [DBG] pgmap v6815: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:45.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:35:44 gibba045 bash[25517]: cluster 2021-03-10T17:35:44.925218+0000 mgr.gibba045.orlgmj (mgr.34412) 11953 : cluster [DBG] pgmap v6816: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:45.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:35:44 gibba015 bash[29377]: cluster 2021-03-10T17:35:44.925218+0000 mgr.gibba045.orlgmj (mgr.34412) 11953 : cluster [DBG] pgmap v6816: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:45.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:35:45 gibba015 bash[30343]: cluster 2021-03-10T17:35:44.925218+0000 mgr.gibba045.orlgmj (mgr.34412) 11953 : cluster [DBG] pgmap v6816: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:47.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:35:46 gibba045 bash[25517]: cluster 2021-03-10T17:35:46.927043+0000 mgr.gibba045.orlgmj (mgr.34412) 11954 : cluster [DBG] pgmap v6817: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:47.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:35:46 gibba015 bash[29377]: cluster 2021-03-10T17:35:46.927043+0000 mgr.gibba045.orlgmj (mgr.34412) 11954 : cluster [DBG] pgmap v6817: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:47.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:35:46 gibba015 bash[30343]: cluster 2021-03-10T17:35:46.927043+0000 mgr.gibba045.orlgmj (mgr.34412) 11954 : cluster [DBG] pgmap v6817: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:49.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:35:49 gibba015 bash[29377]: cluster 2021-03-10T17:35:48.928390+0000 mgr.gibba045.orlgmj (mgr.34412) 11955 : cluster [DBG] pgmap v6818: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:49.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:35:49 gibba015 bash[30343]: cluster 2021-03-10T17:35:48.928390+0000 mgr.gibba045.orlgmj (mgr.34412) 11955 : cluster [DBG] pgmap v6818: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:49.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:35:49 gibba045 bash[25517]: cluster 2021-03-10T17:35:48.928390+0000 mgr.gibba045.orlgmj (mgr.34412) 11955 : cluster [DBG] pgmap v6818: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:51.265 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:35:50 gibba045 bash[25517]: cluster 2021-03-10T17:35:50.930390+0000 mgr.gibba045.orlgmj (mgr.34412) 11956 : cluster [DBG] pgmap v6819: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:51.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:35:50 gibba015 bash[29377]: cluster 2021-03-10T17:35:50.930390+0000 mgr.gibba045.orlgmj (mgr.34412) 11956 : cluster [DBG] pgmap v6819: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:51.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:35:50 gibba015 bash[30343]: cluster 2021-03-10T17:35:50.930390+0000 mgr.gibba045.orlgmj (mgr.34412) 11956 : cluster [DBG] pgmap v6819: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:52.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:35:52 gibba045 bash[25517]: audit 2021-03-10T17:35:51.028326+0000 mon.c (mon.1) 3274 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:35:52.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:35:52 gibba045 bash[25517]: cephadm 2021-03-10T17:35:51.033232+0000 mgr.gibba045.orlgmj (mgr.34412) 11957 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:35:52.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:35:52 gibba045 bash[25517]: cephadm 2021-03-10T17:35:51.033884+0000 mgr.gibba045.orlgmj (mgr.34412) 11958 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:35:52.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:35:52 gibba045 bash[25517]: audit 2021-03-10T17:35:51.247611+0000 mon.a (mon.0) 2478 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:35:52.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:35:52 gibba045 bash[25517]: audit 2021-03-10T17:35:51.251371+0000 mon.c (mon.1) 3275 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:35:52.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:35:52 gibba045 bash[25517]: cephadm 2021-03-10T17:35:51.252515+0000 mgr.gibba045.orlgmj (mgr.34412) 11959 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:35:52.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:35:52 gibba045 bash[25517]: audit 2021-03-10T17:35:51.253155+0000 mon.c (mon.1) 3276 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:35:52.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:35:52 gibba045 bash[25517]: cephadm 2021-03-10T17:35:51.254498+0000 mgr.gibba045.orlgmj (mgr.34412) 11960 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:35:52.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:35:52 gibba045 bash[25517]: audit 2021-03-10T17:35:51.254604+0000 mon.c (mon.1) 3277 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:35:52.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:35:52 gibba045 bash[25517]: cephadm 2021-03-10T17:35:51.255943+0000 mgr.gibba045.orlgmj (mgr.34412) 11961 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:35:52.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:35:52 gibba045 bash[25517]: cephadm 2021-03-10T17:35:51.255987+0000 mgr.gibba045.orlgmj (mgr.34412) 11962 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:35:52.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:35:52 gibba045 bash[25517]: audit 2021-03-10T17:35:51.256276+0000 mon.c (mon.1) 3278 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:35:52.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:35:52 gibba045 bash[25517]: cephadm 2021-03-10T17:35:51.257671+0000 mgr.gibba045.orlgmj (mgr.34412) 11963 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:35:52.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:35:52 gibba045 bash[25517]: cephadm 2021-03-10T17:35:51.257714+0000 mgr.gibba045.orlgmj (mgr.34412) 11964 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:35:52.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:35:52 gibba045 bash[25517]: cephadm 2021-03-10T17:35:51.259308+0000 mgr.gibba045.orlgmj (mgr.34412) 11965 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:35:52.312 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:35:52 gibba045 bash[25517]: audit 2021-03-10T17:35:51.259848+0000 mon.c (mon.1) 3279 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:35:52.312 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:35:52 gibba045 bash[25517]: cephadm 2021-03-10T17:35:51.261078+0000 mgr.gibba045.orlgmj (mgr.34412) 11966 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:35:52.312 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:35:52 gibba045 bash[25517]: cephadm 2021-03-10T17:35:51.261123+0000 mgr.gibba045.orlgmj (mgr.34412) 11967 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:35:52.312 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:35:52 gibba045 bash[25517]: audit 2021-03-10T17:35:51.261747+0000 mon.c (mon.1) 3280 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:35:52.313 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:35:52 gibba045 bash[25517]: cephadm 2021-03-10T17:35:51.262782+0000 mgr.gibba045.orlgmj (mgr.34412) 11968 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:35:52.313 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:35:52 gibba045 bash[25517]: cephadm 2021-03-10T17:35:51.263171+0000 mgr.gibba045.orlgmj (mgr.34412) 11969 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:35:52.313 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:35:52 gibba045 bash[25517]: cephadm 2021-03-10T17:35:51.264696+0000 mgr.gibba045.orlgmj (mgr.34412) 11970 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:35:52.313 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:35:52 gibba045 bash[25517]: cephadm 2021-03-10T17:35:51.264765+0000 mgr.gibba045.orlgmj (mgr.34412) 11971 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:35:52.313 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:35:52 gibba045 bash[25517]: cephadm 2021-03-10T17:35:51.264904+0000 mgr.gibba045.orlgmj (mgr.34412) 11972 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:35:52.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:35:52 gibba015 bash[29377]: audit 2021-03-10T17:35:51.028326+0000 mon.c (mon.1) 3274 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:35:52.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:35:52 gibba015 bash[29377]: cephadm 2021-03-10T17:35:51.033232+0000 mgr.gibba045.orlgmj (mgr.34412) 11957 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:35:52.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:35:52 gibba015 bash[29377]: cephadm 2021-03-10T17:35:51.033884+0000 mgr.gibba045.orlgmj (mgr.34412) 11958 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:35:52.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:35:52 gibba015 bash[29377]: audit 2021-03-10T17:35:51.247611+0000 mon.a (mon.0) 2478 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:35:52.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:35:52 gibba015 bash[29377]: audit 2021-03-10T17:35:51.251371+0000 mon.c (mon.1) 3275 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:35:52.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:35:52 gibba015 bash[29377]: cephadm 2021-03-10T17:35:51.252515+0000 mgr.gibba045.orlgmj (mgr.34412) 11959 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:35:52.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:35:52 gibba015 bash[29377]: audit 2021-03-10T17:35:51.253155+0000 mon.c (mon.1) 3276 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:35:52.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:35:52 gibba015 bash[29377]: cephadm 2021-03-10T17:35:51.254498+0000 mgr.gibba045.orlgmj (mgr.34412) 11960 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:35:52.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:35:52 gibba015 bash[29377]: audit 2021-03-10T17:35:51.254604+0000 mon.c (mon.1) 3277 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:35:52.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:35:52 gibba015 bash[29377]: cephadm 2021-03-10T17:35:51.255943+0000 mgr.gibba045.orlgmj (mgr.34412) 11961 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:35:52.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:35:52 gibba015 bash[29377]: cephadm 2021-03-10T17:35:51.255987+0000 mgr.gibba045.orlgmj (mgr.34412) 11962 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:35:52.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:35:52 gibba015 bash[29377]: audit 2021-03-10T17:35:51.256276+0000 mon.c (mon.1) 3278 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:35:52.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:35:52 gibba015 bash[29377]: cephadm 2021-03-10T17:35:51.257671+0000 mgr.gibba045.orlgmj (mgr.34412) 11963 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:35:52.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:35:52 gibba015 bash[29377]: cephadm 2021-03-10T17:35:51.257714+0000 mgr.gibba045.orlgmj (mgr.34412) 11964 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:35:52.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:35:52 gibba015 bash[29377]: cephadm 2021-03-10T17:35:51.259308+0000 mgr.gibba045.orlgmj (mgr.34412) 11965 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:35:52.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:35:52 gibba015 bash[29377]: audit 2021-03-10T17:35:51.259848+0000 mon.c (mon.1) 3279 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:35:52.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:35:52 gibba015 bash[29377]: cephadm 2021-03-10T17:35:51.261078+0000 mgr.gibba045.orlgmj (mgr.34412) 11966 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:35:52.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:35:52 gibba015 bash[29377]: cephadm 2021-03-10T17:35:51.261123+0000 mgr.gibba045.orlgmj (mgr.34412) 11967 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:35:52.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:35:52 gibba015 bash[29377]: audit 2021-03-10T17:35:51.261747+0000 mon.c (mon.1) 3280 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:35:52.479 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:35:52 gibba015 bash[29377]: cephadm 2021-03-10T17:35:51.262782+0000 mgr.gibba045.orlgmj (mgr.34412) 11968 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:35:52.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:35:52 gibba015 bash[30343]: audit 2021-03-10T17:35:51.028326+0000 mon.c (mon.1) 3274 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:35:52.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:35:52 gibba015 bash[30343]: cephadm 2021-03-10T17:35:51.033232+0000 mgr.gibba045.orlgmj (mgr.34412) 11957 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:35:52.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:35:52 gibba015 bash[30343]: cephadm 2021-03-10T17:35:51.033884+0000 mgr.gibba045.orlgmj (mgr.34412) 11958 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:35:52.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:35:52 gibba015 bash[30343]: audit 2021-03-10T17:35:51.247611+0000 mon.a (mon.0) 2478 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:35:52.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:35:52 gibba015 bash[30343]: audit 2021-03-10T17:35:51.251371+0000 mon.c (mon.1) 3275 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:35:52.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:35:52 gibba015 bash[30343]: cephadm 2021-03-10T17:35:51.252515+0000 mgr.gibba045.orlgmj (mgr.34412) 11959 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:35:52.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:35:52 gibba015 bash[30343]: audit 2021-03-10T17:35:51.253155+0000 mon.c (mon.1) 3276 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:35:52.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:35:52 gibba015 bash[30343]: cephadm 2021-03-10T17:35:51.254498+0000 mgr.gibba045.orlgmj (mgr.34412) 11960 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:35:52.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:35:52 gibba015 bash[30343]: audit 2021-03-10T17:35:51.254604+0000 mon.c (mon.1) 3277 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:35:52.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:35:52 gibba015 bash[30343]: cephadm 2021-03-10T17:35:51.255943+0000 mgr.gibba045.orlgmj (mgr.34412) 11961 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:35:52.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:35:52 gibba015 bash[30343]: cephadm 2021-03-10T17:35:51.255987+0000 mgr.gibba045.orlgmj (mgr.34412) 11962 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:35:52.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:35:52 gibba015 bash[30343]: audit 2021-03-10T17:35:51.256276+0000 mon.c (mon.1) 3278 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:35:52.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:35:52 gibba015 bash[30343]: cephadm 2021-03-10T17:35:51.257671+0000 mgr.gibba045.orlgmj (mgr.34412) 11963 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:35:52.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:35:52 gibba015 bash[30343]: cephadm 2021-03-10T17:35:51.257714+0000 mgr.gibba045.orlgmj (mgr.34412) 11964 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:35:52.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:35:52 gibba015 bash[30343]: cephadm 2021-03-10T17:35:51.259308+0000 mgr.gibba045.orlgmj (mgr.34412) 11965 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:35:52.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:35:52 gibba015 bash[30343]: audit 2021-03-10T17:35:51.259848+0000 mon.c (mon.1) 3279 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:35:52.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:35:52 gibba015 bash[30343]: cephadm 2021-03-10T17:35:51.261078+0000 mgr.gibba045.orlgmj (mgr.34412) 11966 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:35:52.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:35:52 gibba015 bash[30343]: cephadm 2021-03-10T17:35:51.261123+0000 mgr.gibba045.orlgmj (mgr.34412) 11967 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:35:52.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:35:52 gibba015 bash[30343]: audit 2021-03-10T17:35:51.261747+0000 mon.c (mon.1) 3280 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:35:52.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:35:52 gibba015 bash[30343]: cephadm 2021-03-10T17:35:51.262782+0000 mgr.gibba045.orlgmj (mgr.34412) 11968 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:35:52.485 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:35:52 gibba015 bash[29377]: cephadm 2021-03-10T17:35:51.263171+0000 mgr.gibba045.orlgmj (mgr.34412) 11969 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:35:52.485 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:35:52 gibba015 bash[29377]: cephadm 2021-03-10T17:35:51.264696+0000 mgr.gibba045.orlgmj (mgr.34412) 11970 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:35:52.485 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:35:52 gibba015 bash[29377]: cephadm 2021-03-10T17:35:51.264765+0000 mgr.gibba045.orlgmj (mgr.34412) 11971 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:35:52.485 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:35:52 gibba015 bash[29377]: cephadm 2021-03-10T17:35:51.264904+0000 mgr.gibba045.orlgmj (mgr.34412) 11972 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:35:52.486 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:35:52 gibba015 bash[30343]: cephadm 2021-03-10T17:35:51.263171+0000 mgr.gibba045.orlgmj (mgr.34412) 11969 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:35:52.486 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:35:52 gibba015 bash[30343]: cephadm 2021-03-10T17:35:51.264696+0000 mgr.gibba045.orlgmj (mgr.34412) 11970 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:35:52.487 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:35:52 gibba015 bash[30343]: cephadm 2021-03-10T17:35:51.264765+0000 mgr.gibba045.orlgmj (mgr.34412) 11971 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:35:52.487 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:35:52 gibba015 bash[30343]: cephadm 2021-03-10T17:35:51.264904+0000 mgr.gibba045.orlgmj (mgr.34412) 11972 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:35:53.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:35:53 gibba045 bash[25517]: cluster 2021-03-10T17:35:52.931821+0000 mgr.gibba045.orlgmj (mgr.34412) 11973 : cluster [DBG] pgmap v6820: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:53.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:35:53 gibba015 bash[29377]: cluster 2021-03-10T17:35:52.931821+0000 mgr.gibba045.orlgmj (mgr.34412) 11973 : cluster [DBG] pgmap v6820: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:53.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:35:53 gibba015 bash[30343]: cluster 2021-03-10T17:35:52.931821+0000 mgr.gibba045.orlgmj (mgr.34412) 11973 : cluster [DBG] pgmap v6820: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:54.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:35:54 gibba015 bash[29377]: audit 2021-03-10T17:35:54.145213+0000 mon.c (mon.1) 3281 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:35:54.597 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:35:54 gibba015 bash[29377]: audit 2021-03-10T17:35:54.145870+0000 mon.c (mon.1) 3282 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:35:54.597 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:35:54 gibba015 bash[29377]: audit 2021-03-10T17:35:54.146417+0000 mon.a (mon.0) 2479 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:35:54.597 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:35:54 gibba015 bash[29377]: audit 2021-03-10T17:35:54.147622+0000 mon.a (mon.0) 2480 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:35:54.598 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:35:54 gibba015 bash[30343]: audit 2021-03-10T17:35:54.145213+0000 mon.c (mon.1) 3281 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:35:54.598 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:35:54 gibba015 bash[30343]: audit 2021-03-10T17:35:54.145870+0000 mon.c (mon.1) 3282 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:35:54.599 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:35:54 gibba015 bash[30343]: audit 2021-03-10T17:35:54.146417+0000 mon.a (mon.0) 2479 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:35:54.599 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:35:54 gibba015 bash[30343]: audit 2021-03-10T17:35:54.147622+0000 mon.a (mon.0) 2480 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:35:54.599 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:35:54 gibba045 bash[25517]: audit 2021-03-10T17:35:54.145213+0000 mon.c (mon.1) 3281 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:35:54.600 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:35:54 gibba045 bash[25517]: audit 2021-03-10T17:35:54.145870+0000 mon.c (mon.1) 3282 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:35:54.600 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:35:54 gibba045 bash[25517]: audit 2021-03-10T17:35:54.146417+0000 mon.a (mon.0) 2479 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:35:54.600 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:35:54 gibba045 bash[25517]: audit 2021-03-10T17:35:54.147622+0000 mon.a (mon.0) 2480 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:35:55.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:35:55 gibba015 bash[29377]: audit 2021-03-10T17:35:54.238947+0000 mon.c (mon.1) 3283 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T17:35:55.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:35:55 gibba015 bash[29377]: audit 2021-03-10T17:35:54.239701+0000 mon.c (mon.1) 3284 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:35:55.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:35:55 gibba015 bash[29377]: audit 2021-03-10T17:35:54.240187+0000 mon.a (mon.0) 2481 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T17:35:55.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:35:55 gibba015 bash[29377]: audit 2021-03-10T17:35:54.240375+0000 mon.c (mon.1) 3285 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T17:35:55.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:35:55 gibba015 bash[29377]: audit 2021-03-10T17:35:54.241315+0000 mon.c (mon.1) 3286 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:35:55.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:35:55 gibba015 bash[29377]: audit 2021-03-10T17:35:54.241712+0000 mon.a (mon.0) 2482 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:35:55.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:35:55 gibba015 bash[29377]: audit 2021-03-10T17:35:54.242734+0000 mon.a (mon.0) 2483 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T17:35:55.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:35:55 gibba015 bash[29377]: audit 2021-03-10T17:35:54.243530+0000 mon.a (mon.0) 2484 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:35:55.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:35:55 gibba015 bash[29377]: cluster 2021-03-10T17:35:54.933741+0000 mgr.gibba045.orlgmj (mgr.34412) 11974 : cluster [DBG] pgmap v6821: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:55.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:35:55 gibba015 bash[30343]: audit 2021-03-10T17:35:54.238947+0000 mon.c (mon.1) 3283 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T17:35:55.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:35:55 gibba015 bash[30343]: audit 2021-03-10T17:35:54.239701+0000 mon.c (mon.1) 3284 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:35:55.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:35:55 gibba015 bash[30343]: audit 2021-03-10T17:35:54.240187+0000 mon.a (mon.0) 2481 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T17:35:55.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:35:55 gibba015 bash[30343]: audit 2021-03-10T17:35:54.240375+0000 mon.c (mon.1) 3285 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T17:35:55.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:35:55 gibba015 bash[30343]: audit 2021-03-10T17:35:54.241315+0000 mon.c (mon.1) 3286 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:35:55.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:35:55 gibba015 bash[30343]: audit 2021-03-10T17:35:54.241712+0000 mon.a (mon.0) 2482 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:35:55.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:35:55 gibba015 bash[30343]: audit 2021-03-10T17:35:54.242734+0000 mon.a (mon.0) 2483 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T17:35:55.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:35:55 gibba015 bash[30343]: audit 2021-03-10T17:35:54.243530+0000 mon.a (mon.0) 2484 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:35:55.477 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:35:55 gibba015 bash[30343]: cluster 2021-03-10T17:35:54.933741+0000 mgr.gibba045.orlgmj (mgr.34412) 11974 : cluster [DBG] pgmap v6821: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:55.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:35:55 gibba045 bash[25517]: audit 2021-03-10T17:35:54.238947+0000 mon.c (mon.1) 3283 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T17:35:55.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:35:55 gibba045 bash[25517]: audit 2021-03-10T17:35:54.239701+0000 mon.c (mon.1) 3284 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:35:55.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:35:55 gibba045 bash[25517]: audit 2021-03-10T17:35:54.240187+0000 mon.a (mon.0) 2481 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T17:35:55.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:35:55 gibba045 bash[25517]: audit 2021-03-10T17:35:54.240375+0000 mon.c (mon.1) 3285 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T17:35:55.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:35:55 gibba045 bash[25517]: audit 2021-03-10T17:35:54.241315+0000 mon.c (mon.1) 3286 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:35:55.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:35:55 gibba045 bash[25517]: audit 2021-03-10T17:35:54.241712+0000 mon.a (mon.0) 2482 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:35:55.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:35:55 gibba045 bash[25517]: audit 2021-03-10T17:35:54.242734+0000 mon.a (mon.0) 2483 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T17:35:55.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:35:55 gibba045 bash[25517]: audit 2021-03-10T17:35:54.243530+0000 mon.a (mon.0) 2484 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:35:55.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:35:55 gibba045 bash[25517]: cluster 2021-03-10T17:35:54.933741+0000 mgr.gibba045.orlgmj (mgr.34412) 11974 : cluster [DBG] pgmap v6821: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:57.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:35:57 gibba045 bash[25517]: cluster 2021-03-10T17:35:56.935559+0000 mgr.gibba045.orlgmj (mgr.34412) 11975 : cluster [DBG] pgmap v6822: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:57.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:35:56 gibba015 bash[29377]: cluster 2021-03-10T17:35:56.935559+0000 mgr.gibba045.orlgmj (mgr.34412) 11975 : cluster [DBG] pgmap v6822: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:57.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:35:57 gibba015 bash[30343]: cluster 2021-03-10T17:35:56.935559+0000 mgr.gibba045.orlgmj (mgr.34412) 11975 : cluster [DBG] pgmap v6822: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:59.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:35:59 gibba015 bash[29377]: cluster 2021-03-10T17:35:58.936922+0000 mgr.gibba045.orlgmj (mgr.34412) 11976 : cluster [DBG] pgmap v6823: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:59.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:35:59 gibba015 bash[30343]: cluster 2021-03-10T17:35:58.936922+0000 mgr.gibba045.orlgmj (mgr.34412) 11976 : cluster [DBG] pgmap v6823: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:59.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:35:59 gibba045 bash[25517]: cluster 2021-03-10T17:35:58.936922+0000 mgr.gibba045.orlgmj (mgr.34412) 11976 : cluster [DBG] pgmap v6823: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:00.262 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:36:00.490 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:36:00.491 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 8m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:36:00.491 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 7m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:36:00.491 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:36:00.491 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:36:00.492 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:36:00.492 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:36:00.492 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:36:00.493 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:36:00.493 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 8m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:36:00.493 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 7m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:36:00.493 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:36:00.494 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:36:00.494 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:36:00.495 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:36:00.495 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:36:00.495 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:36:00.495 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:36:00.496 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:36:00.496 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 7m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:36:00.496 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 7m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:36:00.739 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:36:00.740 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:36:00.740 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:36:00.740 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:36:00.740 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:36:00.741 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:36:00.741 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:36:00.741 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:36:00.741 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:36:00.741 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:36:00.742 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:36:00.742 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:36:00.742 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:36:00.742 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:36:00.743 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:36:01.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:36:00 gibba045 bash[25517]: audit 2021-03-10T17:36:00.737121+0000 mon.c (mon.1) 3287 : audit [DBG] from='client.? 172.21.2.115:0/3458637149' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:36:01.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:36:00 gibba015 bash[29377]: audit 2021-03-10T17:36:00.737121+0000 mon.c (mon.1) 3287 : audit [DBG] from='client.? 172.21.2.115:0/3458637149' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:36:01.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:36:00 gibba015 bash[30343]: audit 2021-03-10T17:36:00.737121+0000 mon.c (mon.1) 3287 : audit [DBG] from='client.? 172.21.2.115:0/3458637149' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:36:02.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:36:01 gibba015 bash[29377]: audit 2021-03-10T17:36:00.251940+0000 mgr.gibba045.orlgmj (mgr.34412) 11977 : audit [DBG] from='client.62068 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:36:02.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:36:01 gibba015 bash[29377]: audit 2021-03-10T17:36:00.477071+0000 mgr.gibba045.orlgmj (mgr.34412) 11978 : audit [DBG] from='client.52086 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:36:02.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:36:01 gibba015 bash[29377]: cluster 2021-03-10T17:36:00.938696+0000 mgr.gibba045.orlgmj (mgr.34412) 11979 : cluster [DBG] pgmap v6824: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:02.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:36:01 gibba015 bash[30343]: audit 2021-03-10T17:36:00.251940+0000 mgr.gibba045.orlgmj (mgr.34412) 11977 : audit [DBG] from='client.62068 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:36:02.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:36:01 gibba015 bash[30343]: audit 2021-03-10T17:36:00.477071+0000 mgr.gibba045.orlgmj (mgr.34412) 11978 : audit [DBG] from='client.52086 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:36:02.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:36:01 gibba015 bash[30343]: cluster 2021-03-10T17:36:00.938696+0000 mgr.gibba045.orlgmj (mgr.34412) 11979 : cluster [DBG] pgmap v6824: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:02.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:36:01 gibba045 bash[25517]: audit 2021-03-10T17:36:00.251940+0000 mgr.gibba045.orlgmj (mgr.34412) 11977 : audit [DBG] from='client.62068 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:36:02.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:36:01 gibba045 bash[25517]: audit 2021-03-10T17:36:00.477071+0000 mgr.gibba045.orlgmj (mgr.34412) 11978 : audit [DBG] from='client.52086 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:36:02.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:36:01 gibba045 bash[25517]: cluster 2021-03-10T17:36:00.938696+0000 mgr.gibba045.orlgmj (mgr.34412) 11979 : cluster [DBG] pgmap v6824: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:03.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:36:03 gibba045 bash[25517]: cluster 2021-03-10T17:36:02.940177+0000 mgr.gibba045.orlgmj (mgr.34412) 11980 : cluster [DBG] pgmap v6825: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:03.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:36:03 gibba015 bash[29377]: cluster 2021-03-10T17:36:02.940177+0000 mgr.gibba045.orlgmj (mgr.34412) 11980 : cluster [DBG] pgmap v6825: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:03.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:36:03 gibba015 bash[30343]: cluster 2021-03-10T17:36:02.940177+0000 mgr.gibba045.orlgmj (mgr.34412) 11980 : cluster [DBG] pgmap v6825: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:05.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:36:05 gibba045 bash[25517]: cluster 2021-03-10T17:36:04.941715+0000 mgr.gibba045.orlgmj (mgr.34412) 11981 : cluster [DBG] pgmap v6826: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:05.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:36:05 gibba015 bash[29377]: cluster 2021-03-10T17:36:04.941715+0000 mgr.gibba045.orlgmj (mgr.34412) 11981 : cluster [DBG] pgmap v6826: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:05.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:36:05 gibba015 bash[30343]: cluster 2021-03-10T17:36:04.941715+0000 mgr.gibba045.orlgmj (mgr.34412) 11981 : cluster [DBG] pgmap v6826: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:07.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:36:07 gibba045 bash[25517]: cephadm 2021-03-10T17:36:06.281037+0000 mgr.gibba045.orlgmj (mgr.34412) 11982 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:36:07.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:36:07 gibba045 bash[25517]: cluster 2021-03-10T17:36:06.943350+0000 mgr.gibba045.orlgmj (mgr.34412) 11983 : cluster [DBG] pgmap v6827: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:07.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:36:07 gibba015 bash[29377]: cephadm 2021-03-10T17:36:06.281037+0000 mgr.gibba045.orlgmj (mgr.34412) 11982 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:36:07.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:36:07 gibba015 bash[29377]: cluster 2021-03-10T17:36:06.943350+0000 mgr.gibba045.orlgmj (mgr.34412) 11983 : cluster [DBG] pgmap v6827: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:07.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:36:07 gibba015 bash[30343]: cephadm 2021-03-10T17:36:06.281037+0000 mgr.gibba045.orlgmj (mgr.34412) 11982 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:36:07.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:36:07 gibba015 bash[30343]: cluster 2021-03-10T17:36:06.943350+0000 mgr.gibba045.orlgmj (mgr.34412) 11983 : cluster [DBG] pgmap v6827: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:09.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:36:09 gibba015 bash[29377]: cluster 2021-03-10T17:36:08.944577+0000 mgr.gibba045.orlgmj (mgr.34412) 11984 : cluster [DBG] pgmap v6828: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:09.846 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:36:09 gibba015 bash[30343]: cluster 2021-03-10T17:36:08.944577+0000 mgr.gibba045.orlgmj (mgr.34412) 11984 : cluster [DBG] pgmap v6828: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:09.847 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:36:09 gibba045 bash[25517]: cluster 2021-03-10T17:36:08.944577+0000 mgr.gibba045.orlgmj (mgr.34412) 11984 : cluster [DBG] pgmap v6828: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:11.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:36:11 gibba045 bash[25517]: cluster 2021-03-10T17:36:10.946326+0000 mgr.gibba045.orlgmj (mgr.34412) 11985 : cluster [DBG] pgmap v6829: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:11.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:36:11 gibba015 bash[29377]: cluster 2021-03-10T17:36:10.946326+0000 mgr.gibba045.orlgmj (mgr.34412) 11985 : cluster [DBG] pgmap v6829: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:11.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:36:11 gibba015 bash[30343]: cluster 2021-03-10T17:36:10.946326+0000 mgr.gibba045.orlgmj (mgr.34412) 11985 : cluster [DBG] pgmap v6829: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:13.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:36:13 gibba045 bash[25517]: cluster 2021-03-10T17:36:12.947759+0000 mgr.gibba045.orlgmj (mgr.34412) 11986 : cluster [DBG] pgmap v6830: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:13.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:36:13 gibba015 bash[29377]: cluster 2021-03-10T17:36:12.947759+0000 mgr.gibba045.orlgmj (mgr.34412) 11986 : cluster [DBG] pgmap v6830: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:13.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:36:13 gibba015 bash[30343]: cluster 2021-03-10T17:36:12.947759+0000 mgr.gibba045.orlgmj (mgr.34412) 11986 : cluster [DBG] pgmap v6830: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:15.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:36:15 gibba045 bash[25517]: cluster 2021-03-10T17:36:14.949619+0000 mgr.gibba045.orlgmj (mgr.34412) 11987 : cluster [DBG] pgmap v6831: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:15.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:36:15 gibba015 bash[29377]: cluster 2021-03-10T17:36:14.949619+0000 mgr.gibba045.orlgmj (mgr.34412) 11987 : cluster [DBG] pgmap v6831: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:15.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:36:15 gibba015 bash[30343]: cluster 2021-03-10T17:36:14.949619+0000 mgr.gibba045.orlgmj (mgr.34412) 11987 : cluster [DBG] pgmap v6831: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:17.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:36:17 gibba045 bash[25517]: cluster 2021-03-10T17:36:16.951127+0000 mgr.gibba045.orlgmj (mgr.34412) 11988 : cluster [DBG] pgmap v6832: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:17.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:36:17 gibba015 bash[29377]: cluster 2021-03-10T17:36:16.951127+0000 mgr.gibba045.orlgmj (mgr.34412) 11988 : cluster [DBG] pgmap v6832: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:17.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:36:17 gibba015 bash[30343]: cluster 2021-03-10T17:36:16.951127+0000 mgr.gibba045.orlgmj (mgr.34412) 11988 : cluster [DBG] pgmap v6832: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:19.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:36:19 gibba015 bash[29377]: cluster 2021-03-10T17:36:18.952348+0000 mgr.gibba045.orlgmj (mgr.34412) 11989 : cluster [DBG] pgmap v6833: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:19.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:36:19 gibba015 bash[30343]: cluster 2021-03-10T17:36:18.952348+0000 mgr.gibba045.orlgmj (mgr.34412) 11989 : cluster [DBG] pgmap v6833: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:19.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:36:19 gibba045 bash[25517]: cluster 2021-03-10T17:36:18.952348+0000 mgr.gibba045.orlgmj (mgr.34412) 11989 : cluster [DBG] pgmap v6833: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:21.287 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:36:21 gibba045 bash[25517]: cluster 2021-03-10T17:36:20.953910+0000 mgr.gibba045.orlgmj (mgr.34412) 11990 : cluster [DBG] pgmap v6834: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:21.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:36:21 gibba015 bash[29377]: cluster 2021-03-10T17:36:20.953910+0000 mgr.gibba045.orlgmj (mgr.34412) 11990 : cluster [DBG] pgmap v6834: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:21.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:36:21 gibba015 bash[30343]: cluster 2021-03-10T17:36:20.953910+0000 mgr.gibba045.orlgmj (mgr.34412) 11990 : cluster [DBG] pgmap v6834: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:22.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:36:22 gibba045 bash[25517]: cephadm 2021-03-10T17:36:21.286508+0000 mgr.gibba045.orlgmj (mgr.34412) 11991 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:36:22.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:36:22 gibba015 bash[29377]: cephadm 2021-03-10T17:36:21.286508+0000 mgr.gibba045.orlgmj (mgr.34412) 11991 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:36:22.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:36:22 gibba015 bash[30343]: cephadm 2021-03-10T17:36:21.286508+0000 mgr.gibba045.orlgmj (mgr.34412) 11991 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:36:23.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:36:23 gibba045 bash[25517]: cluster 2021-03-10T17:36:22.955423+0000 mgr.gibba045.orlgmj (mgr.34412) 11992 : cluster [DBG] pgmap v6835: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:23.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:36:23 gibba015 bash[29377]: cluster 2021-03-10T17:36:22.955423+0000 mgr.gibba045.orlgmj (mgr.34412) 11992 : cluster [DBG] pgmap v6835: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:23.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:36:23 gibba015 bash[30343]: cluster 2021-03-10T17:36:22.955423+0000 mgr.gibba045.orlgmj (mgr.34412) 11992 : cluster [DBG] pgmap v6835: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:26.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:36:26 gibba045 bash[25517]: cluster 2021-03-10T17:36:24.957249+0000 mgr.gibba045.orlgmj (mgr.34412) 11993 : cluster [DBG] pgmap v6836: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:26.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:36:26 gibba015 bash[29377]: cluster 2021-03-10T17:36:24.957249+0000 mgr.gibba045.orlgmj (mgr.34412) 11993 : cluster [DBG] pgmap v6836: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:26.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:36:26 gibba015 bash[30343]: cluster 2021-03-10T17:36:24.957249+0000 mgr.gibba045.orlgmj (mgr.34412) 11993 : cluster [DBG] pgmap v6836: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:28.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:36:28 gibba045 bash[25517]: cluster 2021-03-10T17:36:26.958714+0000 mgr.gibba045.orlgmj (mgr.34412) 11994 : cluster [DBG] pgmap v6837: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:28.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:36:28 gibba015 bash[29377]: cluster 2021-03-10T17:36:26.958714+0000 mgr.gibba045.orlgmj (mgr.34412) 11994 : cluster [DBG] pgmap v6837: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:28.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:36:28 gibba015 bash[30343]: cluster 2021-03-10T17:36:26.958714+0000 mgr.gibba045.orlgmj (mgr.34412) 11994 : cluster [DBG] pgmap v6837: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:30.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:36:30 gibba015 bash[29377]: cluster 2021-03-10T17:36:28.959915+0000 mgr.gibba045.orlgmj (mgr.34412) 11995 : cluster [DBG] pgmap v6838: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:30.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:36:30 gibba015 bash[30343]: cluster 2021-03-10T17:36:28.959915+0000 mgr.gibba045.orlgmj (mgr.34412) 11995 : cluster [DBG] pgmap v6838: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:30.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:36:30 gibba045 bash[25517]: cluster 2021-03-10T17:36:28.959915+0000 mgr.gibba045.orlgmj (mgr.34412) 11995 : cluster [DBG] pgmap v6838: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:30.984 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:36:31.213 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:36:31.213 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 8m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:36:31.213 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 7m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:36:31.213 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:36:31.214 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:36:31.214 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:36:31.214 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:36:31.214 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:36:31.215 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:36:31.215 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 8m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:36:31.215 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 7m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:36:31.215 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:36:31.216 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:36:31.216 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:36:31.216 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:36:31.216 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:36:31.216 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:36:31.217 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:36:31.217 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:36:31.217 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 7m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:36:31.217 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 7m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:36:31.461 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:36:31.461 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:36:31.461 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:36:31.461 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:36:31.462 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:36:31.462 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:36:31.462 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:36:31.462 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:36:31.463 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:36:31.463 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:36:31.463 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:36:31.463 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:36:31.463 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:36:31.464 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:36:31.464 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:36:32.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:36:32 gibba015 bash[29377]: cluster 2021-03-10T17:36:30.961578+0000 mgr.gibba045.orlgmj (mgr.34412) 11996 : cluster [DBG] pgmap v6839: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:32.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:36:32 gibba015 bash[29377]: audit 2021-03-10T17:36:30.974242+0000 mgr.gibba045.orlgmj (mgr.34412) 11997 : audit [DBG] from='client.52098 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:36:32.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:36:32 gibba015 bash[29377]: audit 2021-03-10T17:36:31.197488+0000 mgr.gibba045.orlgmj (mgr.34412) 11998 : audit [DBG] from='client.62092 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:36:32.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:36:32 gibba015 bash[29377]: audit 2021-03-10T17:36:31.458410+0000 mon.a (mon.0) 2485 : audit [DBG] from='client.? 172.21.2.115:0/2062572840' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:36:32.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:36:32 gibba015 bash[30343]: cluster 2021-03-10T17:36:30.961578+0000 mgr.gibba045.orlgmj (mgr.34412) 11996 : cluster [DBG] pgmap v6839: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:32.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:36:32 gibba015 bash[30343]: audit 2021-03-10T17:36:30.974242+0000 mgr.gibba045.orlgmj (mgr.34412) 11997 : audit [DBG] from='client.52098 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:36:32.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:36:32 gibba015 bash[30343]: audit 2021-03-10T17:36:31.197488+0000 mgr.gibba045.orlgmj (mgr.34412) 11998 : audit [DBG] from='client.62092 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:36:32.476 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:36:32 gibba015 bash[30343]: audit 2021-03-10T17:36:31.458410+0000 mon.a (mon.0) 2485 : audit [DBG] from='client.? 172.21.2.115:0/2062572840' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:36:32.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:36:32 gibba045 bash[25517]: cluster 2021-03-10T17:36:30.961578+0000 mgr.gibba045.orlgmj (mgr.34412) 11996 : cluster [DBG] pgmap v6839: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:32.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:36:32 gibba045 bash[25517]: audit 2021-03-10T17:36:30.974242+0000 mgr.gibba045.orlgmj (mgr.34412) 11997 : audit [DBG] from='client.52098 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:36:32.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:36:32 gibba045 bash[25517]: audit 2021-03-10T17:36:31.197488+0000 mgr.gibba045.orlgmj (mgr.34412) 11998 : audit [DBG] from='client.62092 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:36:32.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:36:32 gibba045 bash[25517]: audit 2021-03-10T17:36:31.458410+0000 mon.a (mon.0) 2485 : audit [DBG] from='client.? 172.21.2.115:0/2062572840' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:36:34.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:36:34 gibba015 bash[29377]: cluster 2021-03-10T17:36:32.962873+0000 mgr.gibba045.orlgmj (mgr.34412) 11999 : cluster [DBG] pgmap v6840: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:34.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:36:34 gibba015 bash[30343]: cluster 2021-03-10T17:36:32.962873+0000 mgr.gibba045.orlgmj (mgr.34412) 11999 : cluster [DBG] pgmap v6840: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:34.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:36:34 gibba045 bash[25517]: cluster 2021-03-10T17:36:32.962873+0000 mgr.gibba045.orlgmj (mgr.34412) 11999 : cluster [DBG] pgmap v6840: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:36.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:36:36 gibba015 bash[29377]: cluster 2021-03-10T17:36:34.964637+0000 mgr.gibba045.orlgmj (mgr.34412) 12000 : cluster [DBG] pgmap v6841: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:36.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:36:36 gibba015 bash[30343]: cluster 2021-03-10T17:36:34.964637+0000 mgr.gibba045.orlgmj (mgr.34412) 12000 : cluster [DBG] pgmap v6841: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:36.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:36:36 gibba045 bash[25517]: cluster 2021-03-10T17:36:34.964637+0000 mgr.gibba045.orlgmj (mgr.34412) 12000 : cluster [DBG] pgmap v6841: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:37.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:36:37 gibba045 bash[25517]: cephadm 2021-03-10T17:36:36.288583+0000 mgr.gibba045.orlgmj (mgr.34412) 12001 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:36:37.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:36:37 gibba015 bash[29377]: cephadm 2021-03-10T17:36:36.288583+0000 mgr.gibba045.orlgmj (mgr.34412) 12001 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:36:37.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:36:37 gibba015 bash[30343]: cephadm 2021-03-10T17:36:36.288583+0000 mgr.gibba045.orlgmj (mgr.34412) 12001 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:36:38.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:36:38 gibba045 bash[25517]: cluster 2021-03-10T17:36:36.966233+0000 mgr.gibba045.orlgmj (mgr.34412) 12002 : cluster [DBG] pgmap v6842: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:38.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:36:38 gibba015 bash[29377]: cluster 2021-03-10T17:36:36.966233+0000 mgr.gibba045.orlgmj (mgr.34412) 12002 : cluster [DBG] pgmap v6842: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:38.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:36:38 gibba015 bash[30343]: cluster 2021-03-10T17:36:36.966233+0000 mgr.gibba045.orlgmj (mgr.34412) 12002 : cluster [DBG] pgmap v6842: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:40.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:36:40 gibba045 bash[25517]: cluster 2021-03-10T17:36:38.967463+0000 mgr.gibba045.orlgmj (mgr.34412) 12003 : cluster [DBG] pgmap v6843: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:40.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:36:40 gibba015 bash[29377]: cluster 2021-03-10T17:36:38.967463+0000 mgr.gibba045.orlgmj (mgr.34412) 12003 : cluster [DBG] pgmap v6843: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:40.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:36:40 gibba015 bash[30343]: cluster 2021-03-10T17:36:38.967463+0000 mgr.gibba045.orlgmj (mgr.34412) 12003 : cluster [DBG] pgmap v6843: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:42.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:36:42 gibba045 bash[25517]: cluster 2021-03-10T17:36:40.969145+0000 mgr.gibba045.orlgmj (mgr.34412) 12004 : cluster [DBG] pgmap v6844: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:42.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:36:42 gibba015 bash[29377]: cluster 2021-03-10T17:36:40.969145+0000 mgr.gibba045.orlgmj (mgr.34412) 12004 : cluster [DBG] pgmap v6844: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:42.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:36:42 gibba015 bash[30343]: cluster 2021-03-10T17:36:40.969145+0000 mgr.gibba045.orlgmj (mgr.34412) 12004 : cluster [DBG] pgmap v6844: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:44.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:36:44 gibba045 bash[25517]: cluster 2021-03-10T17:36:42.970558+0000 mgr.gibba045.orlgmj (mgr.34412) 12005 : cluster [DBG] pgmap v6845: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:44.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:36:44 gibba015 bash[29377]: cluster 2021-03-10T17:36:42.970558+0000 mgr.gibba045.orlgmj (mgr.34412) 12005 : cluster [DBG] pgmap v6845: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:44.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:36:44 gibba015 bash[30343]: cluster 2021-03-10T17:36:42.970558+0000 mgr.gibba045.orlgmj (mgr.34412) 12005 : cluster [DBG] pgmap v6845: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:46.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:36:46 gibba045 bash[25517]: cluster 2021-03-10T17:36:44.972291+0000 mgr.gibba045.orlgmj (mgr.34412) 12006 : cluster [DBG] pgmap v6846: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:46.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:36:46 gibba015 bash[29377]: cluster 2021-03-10T17:36:44.972291+0000 mgr.gibba045.orlgmj (mgr.34412) 12006 : cluster [DBG] pgmap v6846: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:46.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:36:46 gibba015 bash[30343]: cluster 2021-03-10T17:36:44.972291+0000 mgr.gibba045.orlgmj (mgr.34412) 12006 : cluster [DBG] pgmap v6846: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:48.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:36:48 gibba045 bash[25517]: cluster 2021-03-10T17:36:46.974113+0000 mgr.gibba045.orlgmj (mgr.34412) 12007 : cluster [DBG] pgmap v6847: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:48.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:36:48 gibba015 bash[29377]: cluster 2021-03-10T17:36:46.974113+0000 mgr.gibba045.orlgmj (mgr.34412) 12007 : cluster [DBG] pgmap v6847: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:48.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:36:48 gibba015 bash[30343]: cluster 2021-03-10T17:36:46.974113+0000 mgr.gibba045.orlgmj (mgr.34412) 12007 : cluster [DBG] pgmap v6847: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:50.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:36:50 gibba045 bash[25517]: cluster 2021-03-10T17:36:48.975427+0000 mgr.gibba045.orlgmj (mgr.34412) 12008 : cluster [DBG] pgmap v6848: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:50.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:36:50 gibba015 bash[29377]: cluster 2021-03-10T17:36:48.975427+0000 mgr.gibba045.orlgmj (mgr.34412) 12008 : cluster [DBG] pgmap v6848: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:50.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:36:50 gibba015 bash[30343]: cluster 2021-03-10T17:36:48.975427+0000 mgr.gibba045.orlgmj (mgr.34412) 12008 : cluster [DBG] pgmap v6848: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:52.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:36:52 gibba045 bash[25517]: cluster 2021-03-10T17:36:50.976991+0000 mgr.gibba045.orlgmj (mgr.34412) 12009 : cluster [DBG] pgmap v6849: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:52.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:36:52 gibba045 bash[25517]: audit 2021-03-10T17:36:51.299633+0000 mon.c (mon.1) 3288 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:36:52.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:36:52 gibba045 bash[25517]: cephadm 2021-03-10T17:36:51.305824+0000 mgr.gibba045.orlgmj (mgr.34412) 12010 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:36:52.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:36:52 gibba045 bash[25517]: cephadm 2021-03-10T17:36:51.307610+0000 mgr.gibba045.orlgmj (mgr.34412) 12011 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:36:52.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:36:52 gibba045 bash[25517]: audit 2021-03-10T17:36:51.512402+0000 mon.a (mon.0) 2486 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:36:52.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:36:52 gibba045 bash[25517]: audit 2021-03-10T17:36:51.516591+0000 mon.c (mon.1) 3289 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:36:52.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:36:52 gibba045 bash[25517]: cephadm 2021-03-10T17:36:51.517774+0000 mgr.gibba045.orlgmj (mgr.34412) 12012 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:36:52.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:36:52 gibba045 bash[25517]: audit 2021-03-10T17:36:51.518151+0000 mon.c (mon.1) 3290 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:36:52.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:36:52 gibba045 bash[25517]: audit 2021-03-10T17:36:51.519570+0000 mon.c (mon.1) 3291 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:36:52.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:36:52 gibba045 bash[25517]: cephadm 2021-03-10T17:36:51.519587+0000 mgr.gibba045.orlgmj (mgr.34412) 12013 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:36:52.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:36:52 gibba045 bash[25517]: cephadm 2021-03-10T17:36:51.520756+0000 mgr.gibba045.orlgmj (mgr.34412) 12014 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:36:52.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:36:52 gibba045 bash[25517]: cephadm 2021-03-10T17:36:51.520830+0000 mgr.gibba045.orlgmj (mgr.34412) 12015 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:36:52.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:36:52 gibba045 bash[25517]: audit 2021-03-10T17:36:51.520876+0000 mon.c (mon.1) 3292 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:36:52.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:36:52 gibba045 bash[25517]: cephadm 2021-03-10T17:36:51.522314+0000 mgr.gibba045.orlgmj (mgr.34412) 12016 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:36:52.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:36:52 gibba045 bash[25517]: cephadm 2021-03-10T17:36:51.522352+0000 mgr.gibba045.orlgmj (mgr.34412) 12017 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:36:52.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:36:52 gibba045 bash[25517]: cephadm 2021-03-10T17:36:51.523602+0000 mgr.gibba045.orlgmj (mgr.34412) 12018 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:36:52.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:36:52 gibba045 bash[25517]: audit 2021-03-10T17:36:51.524628+0000 mon.c (mon.1) 3293 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:36:52.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:36:52 gibba045 bash[25517]: cephadm 2021-03-10T17:36:51.525932+0000 mgr.gibba045.orlgmj (mgr.34412) 12019 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:36:52.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:36:52 gibba045 bash[25517]: cephadm 2021-03-10T17:36:51.525969+0000 mgr.gibba045.orlgmj (mgr.34412) 12020 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:36:52.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:36:52 gibba045 bash[25517]: audit 2021-03-10T17:36:51.526361+0000 mon.c (mon.1) 3294 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:36:52.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:36:52 gibba045 bash[25517]: cephadm 2021-03-10T17:36:51.527474+0000 mgr.gibba045.orlgmj (mgr.34412) 12021 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:36:52.564 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:36:52 gibba045 bash[25517]: cephadm 2021-03-10T17:36:51.527845+0000 mgr.gibba045.orlgmj (mgr.34412) 12022 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:36:52.566 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:36:52 gibba045 bash[25517]: cephadm 2021-03-10T17:36:51.529588+0000 mgr.gibba045.orlgmj (mgr.34412) 12023 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:36:52.566 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:36:52 gibba045 bash[25517]: cephadm 2021-03-10T17:36:51.529625+0000 mgr.gibba045.orlgmj (mgr.34412) 12024 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:36:52.567 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:36:52 gibba045 bash[25517]: cephadm 2021-03-10T17:36:51.529742+0000 mgr.gibba045.orlgmj (mgr.34412) 12025 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:36:52.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:36:52 gibba015 bash[29377]: cluster 2021-03-10T17:36:50.976991+0000 mgr.gibba045.orlgmj (mgr.34412) 12009 : cluster [DBG] pgmap v6849: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:52.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:36:52 gibba015 bash[29377]: audit 2021-03-10T17:36:51.299633+0000 mon.c (mon.1) 3288 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:36:52.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:36:52 gibba015 bash[29377]: cephadm 2021-03-10T17:36:51.305824+0000 mgr.gibba045.orlgmj (mgr.34412) 12010 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:36:52.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:36:52 gibba015 bash[29377]: cephadm 2021-03-10T17:36:51.307610+0000 mgr.gibba045.orlgmj (mgr.34412) 12011 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:36:52.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:36:52 gibba015 bash[29377]: audit 2021-03-10T17:36:51.512402+0000 mon.a (mon.0) 2486 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:36:52.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:36:52 gibba015 bash[29377]: audit 2021-03-10T17:36:51.516591+0000 mon.c (mon.1) 3289 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:36:52.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:36:52 gibba015 bash[29377]: cephadm 2021-03-10T17:36:51.517774+0000 mgr.gibba045.orlgmj (mgr.34412) 12012 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:36:52.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:36:52 gibba015 bash[29377]: audit 2021-03-10T17:36:51.518151+0000 mon.c (mon.1) 3290 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:36:52.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:36:52 gibba015 bash[29377]: audit 2021-03-10T17:36:51.519570+0000 mon.c (mon.1) 3291 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:36:52.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:36:52 gibba015 bash[29377]: cephadm 2021-03-10T17:36:51.519587+0000 mgr.gibba045.orlgmj (mgr.34412) 12013 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:36:52.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:36:52 gibba015 bash[29377]: cephadm 2021-03-10T17:36:51.520756+0000 mgr.gibba045.orlgmj (mgr.34412) 12014 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:36:52.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:36:52 gibba015 bash[29377]: cephadm 2021-03-10T17:36:51.520830+0000 mgr.gibba045.orlgmj (mgr.34412) 12015 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:36:52.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:36:52 gibba015 bash[29377]: audit 2021-03-10T17:36:51.520876+0000 mon.c (mon.1) 3292 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:36:52.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:36:52 gibba015 bash[29377]: cephadm 2021-03-10T17:36:51.522314+0000 mgr.gibba045.orlgmj (mgr.34412) 12016 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:36:52.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:36:52 gibba015 bash[29377]: cephadm 2021-03-10T17:36:51.522352+0000 mgr.gibba045.orlgmj (mgr.34412) 12017 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:36:52.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:36:52 gibba015 bash[29377]: cephadm 2021-03-10T17:36:51.523602+0000 mgr.gibba045.orlgmj (mgr.34412) 12018 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:36:52.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:36:52 gibba015 bash[29377]: audit 2021-03-10T17:36:51.524628+0000 mon.c (mon.1) 3293 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:36:52.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:36:52 gibba015 bash[29377]: cephadm 2021-03-10T17:36:51.525932+0000 mgr.gibba045.orlgmj (mgr.34412) 12019 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:36:52.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:36:52 gibba015 bash[29377]: cephadm 2021-03-10T17:36:51.525969+0000 mgr.gibba045.orlgmj (mgr.34412) 12020 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:36:52.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:36:52 gibba015 bash[29377]: audit 2021-03-10T17:36:51.526361+0000 mon.c (mon.1) 3294 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:36:52.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:36:52 gibba015 bash[30343]: cluster 2021-03-10T17:36:50.976991+0000 mgr.gibba045.orlgmj (mgr.34412) 12009 : cluster [DBG] pgmap v6849: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:52.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:36:52 gibba015 bash[30343]: audit 2021-03-10T17:36:51.299633+0000 mon.c (mon.1) 3288 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:36:52.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:36:52 gibba015 bash[30343]: cephadm 2021-03-10T17:36:51.305824+0000 mgr.gibba045.orlgmj (mgr.34412) 12010 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:36:52.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:36:52 gibba015 bash[30343]: cephadm 2021-03-10T17:36:51.307610+0000 mgr.gibba045.orlgmj (mgr.34412) 12011 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:36:52.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:36:52 gibba015 bash[30343]: audit 2021-03-10T17:36:51.512402+0000 mon.a (mon.0) 2486 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:36:52.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:36:52 gibba015 bash[30343]: audit 2021-03-10T17:36:51.516591+0000 mon.c (mon.1) 3289 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:36:52.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:36:52 gibba015 bash[30343]: cephadm 2021-03-10T17:36:51.517774+0000 mgr.gibba045.orlgmj (mgr.34412) 12012 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:36:52.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:36:52 gibba015 bash[30343]: audit 2021-03-10T17:36:51.518151+0000 mon.c (mon.1) 3290 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:36:52.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:36:52 gibba015 bash[30343]: audit 2021-03-10T17:36:51.519570+0000 mon.c (mon.1) 3291 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:36:52.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:36:52 gibba015 bash[30343]: cephadm 2021-03-10T17:36:51.519587+0000 mgr.gibba045.orlgmj (mgr.34412) 12013 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:36:52.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:36:52 gibba015 bash[30343]: cephadm 2021-03-10T17:36:51.520756+0000 mgr.gibba045.orlgmj (mgr.34412) 12014 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:36:52.731 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:36:52 gibba015 bash[30343]: cephadm 2021-03-10T17:36:51.520830+0000 mgr.gibba045.orlgmj (mgr.34412) 12015 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:36:52.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:36:52 gibba015 bash[30343]: audit 2021-03-10T17:36:51.520876+0000 mon.c (mon.1) 3292 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:36:52.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:36:52 gibba015 bash[30343]: cephadm 2021-03-10T17:36:51.522314+0000 mgr.gibba045.orlgmj (mgr.34412) 12016 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:36:52.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:36:52 gibba015 bash[30343]: cephadm 2021-03-10T17:36:51.522352+0000 mgr.gibba045.orlgmj (mgr.34412) 12017 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:36:52.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:36:52 gibba015 bash[30343]: cephadm 2021-03-10T17:36:51.523602+0000 mgr.gibba045.orlgmj (mgr.34412) 12018 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:36:52.732 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:36:52 gibba015 bash[30343]: audit 2021-03-10T17:36:51.524628+0000 mon.c (mon.1) 3293 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:36:52.733 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:36:52 gibba015 bash[30343]: cephadm 2021-03-10T17:36:51.525932+0000 mgr.gibba045.orlgmj (mgr.34412) 12019 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:36:52.733 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:36:52 gibba015 bash[30343]: cephadm 2021-03-10T17:36:51.525969+0000 mgr.gibba045.orlgmj (mgr.34412) 12020 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:36:52.733 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:36:52 gibba015 bash[30343]: audit 2021-03-10T17:36:51.526361+0000 mon.c (mon.1) 3294 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:36:52.734 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:36:52 gibba015 bash[29377]: cephadm 2021-03-10T17:36:51.527474+0000 mgr.gibba045.orlgmj (mgr.34412) 12021 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:36:52.734 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:36:52 gibba015 bash[29377]: cephadm 2021-03-10T17:36:51.527845+0000 mgr.gibba045.orlgmj (mgr.34412) 12022 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:36:52.734 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:36:52 gibba015 bash[29377]: cephadm 2021-03-10T17:36:51.529588+0000 mgr.gibba045.orlgmj (mgr.34412) 12023 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:36:52.734 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:36:52 gibba015 bash[29377]: cephadm 2021-03-10T17:36:51.529625+0000 mgr.gibba045.orlgmj (mgr.34412) 12024 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:36:52.735 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:36:52 gibba015 bash[29377]: cephadm 2021-03-10T17:36:51.529742+0000 mgr.gibba045.orlgmj (mgr.34412) 12025 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:36:52.735 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:36:52 gibba015 bash[30343]: cephadm 2021-03-10T17:36:51.527474+0000 mgr.gibba045.orlgmj (mgr.34412) 12021 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:36:52.735 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:36:52 gibba015 bash[30343]: cephadm 2021-03-10T17:36:51.527845+0000 mgr.gibba045.orlgmj (mgr.34412) 12022 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:36:52.736 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:36:52 gibba015 bash[30343]: cephadm 2021-03-10T17:36:51.529588+0000 mgr.gibba045.orlgmj (mgr.34412) 12023 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:36:52.736 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:36:52 gibba015 bash[30343]: cephadm 2021-03-10T17:36:51.529625+0000 mgr.gibba045.orlgmj (mgr.34412) 12024 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:36:52.736 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:36:52 gibba015 bash[30343]: cephadm 2021-03-10T17:36:51.529742+0000 mgr.gibba045.orlgmj (mgr.34412) 12025 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:36:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:36:54 gibba045 bash[25517]: cluster 2021-03-10T17:36:52.978435+0000 mgr.gibba045.orlgmj (mgr.34412) 12026 : cluster [DBG] pgmap v6850: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:54.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:36:54 gibba045 bash[25517]: audit 2021-03-10T17:36:54.149383+0000 mon.c (mon.1) 3295 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:36:54.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:36:54 gibba045 bash[25517]: audit 2021-03-10T17:36:54.150029+0000 mon.c (mon.1) 3296 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:36:54.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:36:54 gibba045 bash[25517]: audit 2021-03-10T17:36:54.150506+0000 mon.a (mon.0) 2487 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:36:54.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:36:54 gibba045 bash[25517]: audit 2021-03-10T17:36:54.151615+0000 mon.a (mon.0) 2488 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:36:54.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:36:54 gibba045 bash[25517]: audit 2021-03-10T17:36:54.249554+0000 mon.c (mon.1) 3297 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T17:36:54.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:36:54 gibba045 bash[25517]: audit 2021-03-10T17:36:54.250319+0000 mon.c (mon.1) 3298 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:36:54.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:36:54 gibba045 bash[25517]: audit 2021-03-10T17:36:54.250775+0000 mon.a (mon.0) 2489 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T17:36:54.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:36:54 gibba045 bash[25517]: audit 2021-03-10T17:36:54.251021+0000 mon.c (mon.1) 3299 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:36:54.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:36:54 gibba045 bash[25517]: audit 2021-03-10T17:36:54.252003+0000 mon.a (mon.0) 2490 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:36:54.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:36:54 gibba045 bash[25517]: audit 2021-03-10T17:36:54.252115+0000 mon.c (mon.1) 3300 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:36:54.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:36:54 gibba045 bash[25517]: audit 2021-03-10T17:36:54.253139+0000 mon.a (mon.0) 2491 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:36:54.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:36:54 gibba045 bash[25517]: audit 2021-03-10T17:36:54.254241+0000 mon.a (mon.0) 2492 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:36:54.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:36:54 gibba015 bash[29377]: cluster 2021-03-10T17:36:52.978435+0000 mgr.gibba045.orlgmj (mgr.34412) 12026 : cluster [DBG] pgmap v6850: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:54.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:36:54 gibba015 bash[29377]: audit 2021-03-10T17:36:54.149383+0000 mon.c (mon.1) 3295 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:36:54.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:36:54 gibba015 bash[29377]: audit 2021-03-10T17:36:54.150029+0000 mon.c (mon.1) 3296 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:36:54.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:36:54 gibba015 bash[29377]: audit 2021-03-10T17:36:54.150506+0000 mon.a (mon.0) 2487 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:36:54.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:36:54 gibba015 bash[29377]: audit 2021-03-10T17:36:54.151615+0000 mon.a (mon.0) 2488 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:36:54.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:36:54 gibba015 bash[29377]: audit 2021-03-10T17:36:54.249554+0000 mon.c (mon.1) 3297 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T17:36:54.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:36:54 gibba015 bash[29377]: audit 2021-03-10T17:36:54.250319+0000 mon.c (mon.1) 3298 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:36:54.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:36:54 gibba015 bash[29377]: audit 2021-03-10T17:36:54.250775+0000 mon.a (mon.0) 2489 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T17:36:54.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:36:54 gibba015 bash[29377]: audit 2021-03-10T17:36:54.251021+0000 mon.c (mon.1) 3299 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:36:54.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:36:54 gibba015 bash[29377]: audit 2021-03-10T17:36:54.252003+0000 mon.a (mon.0) 2490 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:36:54.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:36:54 gibba015 bash[29377]: audit 2021-03-10T17:36:54.252115+0000 mon.c (mon.1) 3300 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:36:54.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:36:54 gibba015 bash[29377]: audit 2021-03-10T17:36:54.253139+0000 mon.a (mon.0) 2491 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:36:54.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:36:54 gibba015 bash[29377]: audit 2021-03-10T17:36:54.254241+0000 mon.a (mon.0) 2492 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:36:54.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:36:54 gibba015 bash[30343]: cluster 2021-03-10T17:36:52.978435+0000 mgr.gibba045.orlgmj (mgr.34412) 12026 : cluster [DBG] pgmap v6850: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:54.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:36:54 gibba015 bash[30343]: audit 2021-03-10T17:36:54.149383+0000 mon.c (mon.1) 3295 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:36:54.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:36:54 gibba015 bash[30343]: audit 2021-03-10T17:36:54.150029+0000 mon.c (mon.1) 3296 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:36:54.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:36:54 gibba015 bash[30343]: audit 2021-03-10T17:36:54.150506+0000 mon.a (mon.0) 2487 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:36:54.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:36:54 gibba015 bash[30343]: audit 2021-03-10T17:36:54.151615+0000 mon.a (mon.0) 2488 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:36:54.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:36:54 gibba015 bash[30343]: audit 2021-03-10T17:36:54.249554+0000 mon.c (mon.1) 3297 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T17:36:54.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:36:54 gibba015 bash[30343]: audit 2021-03-10T17:36:54.250319+0000 mon.c (mon.1) 3298 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:36:54.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:36:54 gibba015 bash[30343]: audit 2021-03-10T17:36:54.250775+0000 mon.a (mon.0) 2489 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T17:36:54.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:36:54 gibba015 bash[30343]: audit 2021-03-10T17:36:54.251021+0000 mon.c (mon.1) 3299 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:36:54.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:36:54 gibba015 bash[30343]: audit 2021-03-10T17:36:54.252003+0000 mon.a (mon.0) 2490 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:36:54.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:36:54 gibba015 bash[30343]: audit 2021-03-10T17:36:54.252115+0000 mon.c (mon.1) 3300 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:36:54.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:36:54 gibba015 bash[30343]: audit 2021-03-10T17:36:54.253139+0000 mon.a (mon.0) 2491 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:36:54.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:36:54 gibba015 bash[30343]: audit 2021-03-10T17:36:54.254241+0000 mon.a (mon.0) 2492 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:36:56.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:36:56 gibba015 bash[29377]: cluster 2021-03-10T17:36:54.980207+0000 mgr.gibba045.orlgmj (mgr.34412) 12027 : cluster [DBG] pgmap v6851: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:56.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:36:56 gibba015 bash[30343]: cluster 2021-03-10T17:36:54.980207+0000 mgr.gibba045.orlgmj (mgr.34412) 12027 : cluster [DBG] pgmap v6851: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:56.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:36:56 gibba045 bash[25517]: cluster 2021-03-10T17:36:54.980207+0000 mgr.gibba045.orlgmj (mgr.34412) 12027 : cluster [DBG] pgmap v6851: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:58.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:36:58 gibba015 bash[29377]: cluster 2021-03-10T17:36:56.981683+0000 mgr.gibba045.orlgmj (mgr.34412) 12028 : cluster [DBG] pgmap v6852: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:58.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:36:58 gibba015 bash[30343]: cluster 2021-03-10T17:36:56.981683+0000 mgr.gibba045.orlgmj (mgr.34412) 12028 : cluster [DBG] pgmap v6852: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:58.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:36:58 gibba045 bash[25517]: cluster 2021-03-10T17:36:56.981683+0000 mgr.gibba045.orlgmj (mgr.34412) 12028 : cluster [DBG] pgmap v6852: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:00.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:37:00 gibba015 bash[29377]: cluster 2021-03-10T17:36:58.983010+0000 mgr.gibba045.orlgmj (mgr.34412) 12029 : cluster [DBG] pgmap v6853: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:00.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:37:00 gibba015 bash[30343]: cluster 2021-03-10T17:36:58.983010+0000 mgr.gibba045.orlgmj (mgr.34412) 12029 : cluster [DBG] pgmap v6853: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:00.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:37:00 gibba045 bash[25517]: cluster 2021-03-10T17:36:58.983010+0000 mgr.gibba045.orlgmj (mgr.34412) 12029 : cluster [DBG] pgmap v6853: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:01.703 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:37:01.928 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:37:01.929 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 9m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:37:01.929 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 8m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:37:01.930 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:37:01.930 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:37:01.930 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:37:01.930 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:37:01.931 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:37:01.931 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:37:01.931 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 9m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:37:01.931 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 8m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:37:01.932 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:37:01.932 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:37:01.932 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:37:01.932 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:37:01.933 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:37:01.933 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:37:01.933 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:37:01.934 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:37:01.934 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 8m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:37:01.934 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 8m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:37:02.180 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:37:02.181 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:37:02.181 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:37:02.181 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:37:02.181 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:37:02.182 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:37:02.182 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:37:02.182 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:37:02.182 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:37:02.183 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:37:02.183 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:37:02.183 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:37:02.183 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:37:02.183 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:37:02.184 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:37:02.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:37:02 gibba015 bash[29377]: cluster 2021-03-10T17:37:00.984695+0000 mgr.gibba045.orlgmj (mgr.34412) 12030 : cluster [DBG] pgmap v6854: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:02.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:37:02 gibba015 bash[29377]: audit 2021-03-10T17:37:01.692990+0000 mgr.gibba045.orlgmj (mgr.34412) 12031 : audit [DBG] from='client.62104 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:37:02.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:37:02 gibba015 bash[29377]: audit 2021-03-10T17:37:01.915886+0000 mgr.gibba045.orlgmj (mgr.34412) 12032 : audit [DBG] from='client.52122 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:37:02.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:37:02 gibba015 bash[29377]: audit 2021-03-10T17:37:02.176412+0000 mon.a (mon.0) 2493 : audit [DBG] from='client.? 172.21.2.115:0/2506582399' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:37:02.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:37:02 gibba015 bash[30343]: cluster 2021-03-10T17:37:00.984695+0000 mgr.gibba045.orlgmj (mgr.34412) 12030 : cluster [DBG] pgmap v6854: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:02.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:37:02 gibba015 bash[30343]: audit 2021-03-10T17:37:01.692990+0000 mgr.gibba045.orlgmj (mgr.34412) 12031 : audit [DBG] from='client.62104 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:37:02.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:37:02 gibba015 bash[30343]: audit 2021-03-10T17:37:01.915886+0000 mgr.gibba045.orlgmj (mgr.34412) 12032 : audit [DBG] from='client.52122 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:37:02.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:37:02 gibba015 bash[30343]: audit 2021-03-10T17:37:02.176412+0000 mon.a (mon.0) 2493 : audit [DBG] from='client.? 172.21.2.115:0/2506582399' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:37:02.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:37:02 gibba045 bash[25517]: cluster 2021-03-10T17:37:00.984695+0000 mgr.gibba045.orlgmj (mgr.34412) 12030 : cluster [DBG] pgmap v6854: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:02.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:37:02 gibba045 bash[25517]: audit 2021-03-10T17:37:01.692990+0000 mgr.gibba045.orlgmj (mgr.34412) 12031 : audit [DBG] from='client.62104 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:37:02.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:37:02 gibba045 bash[25517]: audit 2021-03-10T17:37:01.915886+0000 mgr.gibba045.orlgmj (mgr.34412) 12032 : audit [DBG] from='client.52122 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:37:02.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:37:02 gibba045 bash[25517]: audit 2021-03-10T17:37:02.176412+0000 mon.a (mon.0) 2493 : audit [DBG] from='client.? 172.21.2.115:0/2506582399' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:37:04.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:37:04 gibba015 bash[29377]: cluster 2021-03-10T17:37:02.985949+0000 mgr.gibba045.orlgmj (mgr.34412) 12033 : cluster [DBG] pgmap v6855: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:04.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:37:04 gibba015 bash[30343]: cluster 2021-03-10T17:37:02.985949+0000 mgr.gibba045.orlgmj (mgr.34412) 12033 : cluster [DBG] pgmap v6855: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:04.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:37:04 gibba045 bash[25517]: cluster 2021-03-10T17:37:02.985949+0000 mgr.gibba045.orlgmj (mgr.34412) 12033 : cluster [DBG] pgmap v6855: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:06.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:37:06 gibba015 bash[29377]: cluster 2021-03-10T17:37:04.987732+0000 mgr.gibba045.orlgmj (mgr.34412) 12034 : cluster [DBG] pgmap v6856: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:06.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:37:06 gibba015 bash[30343]: cluster 2021-03-10T17:37:04.987732+0000 mgr.gibba045.orlgmj (mgr.34412) 12034 : cluster [DBG] pgmap v6856: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:06.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:37:06 gibba045 bash[25517]: cluster 2021-03-10T17:37:04.987732+0000 mgr.gibba045.orlgmj (mgr.34412) 12034 : cluster [DBG] pgmap v6856: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:07.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:37:07 gibba015 bash[29377]: cephadm 2021-03-10T17:37:06.545744+0000 mgr.gibba045.orlgmj (mgr.34412) 12035 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:37:07.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:37:07 gibba015 bash[30343]: cephadm 2021-03-10T17:37:06.545744+0000 mgr.gibba045.orlgmj (mgr.34412) 12035 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:37:07.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:37:07 gibba045 bash[25517]: cephadm 2021-03-10T17:37:06.545744+0000 mgr.gibba045.orlgmj (mgr.34412) 12035 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:37:08.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:37:08 gibba015 bash[29377]: cluster 2021-03-10T17:37:06.989522+0000 mgr.gibba045.orlgmj (mgr.34412) 12036 : cluster [DBG] pgmap v6857: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:08.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:37:08 gibba015 bash[30343]: cluster 2021-03-10T17:37:06.989522+0000 mgr.gibba045.orlgmj (mgr.34412) 12036 : cluster [DBG] pgmap v6857: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:08.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:37:08 gibba045 bash[25517]: cluster 2021-03-10T17:37:06.989522+0000 mgr.gibba045.orlgmj (mgr.34412) 12036 : cluster [DBG] pgmap v6857: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:10.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:37:10 gibba015 bash[29377]: cluster 2021-03-10T17:37:08.990756+0000 mgr.gibba045.orlgmj (mgr.34412) 12037 : cluster [DBG] pgmap v6858: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:10.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:37:10 gibba015 bash[30343]: cluster 2021-03-10T17:37:08.990756+0000 mgr.gibba045.orlgmj (mgr.34412) 12037 : cluster [DBG] pgmap v6858: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:10.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:37:10 gibba045 bash[25517]: cluster 2021-03-10T17:37:08.990756+0000 mgr.gibba045.orlgmj (mgr.34412) 12037 : cluster [DBG] pgmap v6858: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:12.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:37:12 gibba015 bash[29377]: cluster 2021-03-10T17:37:10.992387+0000 mgr.gibba045.orlgmj (mgr.34412) 12038 : cluster [DBG] pgmap v6859: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:12.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:37:12 gibba015 bash[30343]: cluster 2021-03-10T17:37:10.992387+0000 mgr.gibba045.orlgmj (mgr.34412) 12038 : cluster [DBG] pgmap v6859: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:12.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:37:12 gibba045 bash[25517]: cluster 2021-03-10T17:37:10.992387+0000 mgr.gibba045.orlgmj (mgr.34412) 12038 : cluster [DBG] pgmap v6859: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:14.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:37:14 gibba015 bash[29377]: cluster 2021-03-10T17:37:12.993684+0000 mgr.gibba045.orlgmj (mgr.34412) 12039 : cluster [DBG] pgmap v6860: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:14.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:37:14 gibba015 bash[30343]: cluster 2021-03-10T17:37:12.993684+0000 mgr.gibba045.orlgmj (mgr.34412) 12039 : cluster [DBG] pgmap v6860: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:14.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:37:14 gibba045 bash[25517]: cluster 2021-03-10T17:37:12.993684+0000 mgr.gibba045.orlgmj (mgr.34412) 12039 : cluster [DBG] pgmap v6860: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:16.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:37:16 gibba015 bash[29377]: cluster 2021-03-10T17:37:14.995323+0000 mgr.gibba045.orlgmj (mgr.34412) 12040 : cluster [DBG] pgmap v6861: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:16.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:37:16 gibba015 bash[30343]: cluster 2021-03-10T17:37:14.995323+0000 mgr.gibba045.orlgmj (mgr.34412) 12040 : cluster [DBG] pgmap v6861: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:16.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:37:16 gibba045 bash[25517]: cluster 2021-03-10T17:37:14.995323+0000 mgr.gibba045.orlgmj (mgr.34412) 12040 : cluster [DBG] pgmap v6861: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:18.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:37:18 gibba015 bash[29377]: cluster 2021-03-10T17:37:16.996911+0000 mgr.gibba045.orlgmj (mgr.34412) 12041 : cluster [DBG] pgmap v6862: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:18.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:37:18 gibba015 bash[30343]: cluster 2021-03-10T17:37:16.996911+0000 mgr.gibba045.orlgmj (mgr.34412) 12041 : cluster [DBG] pgmap v6862: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:18.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:37:18 gibba045 bash[25517]: cluster 2021-03-10T17:37:16.996911+0000 mgr.gibba045.orlgmj (mgr.34412) 12041 : cluster [DBG] pgmap v6862: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:20.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:37:20 gibba015 bash[29377]: cluster 2021-03-10T17:37:18.998163+0000 mgr.gibba045.orlgmj (mgr.34412) 12042 : cluster [DBG] pgmap v6863: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:20.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:37:20 gibba015 bash[30343]: cluster 2021-03-10T17:37:18.998163+0000 mgr.gibba045.orlgmj (mgr.34412) 12042 : cluster [DBG] pgmap v6863: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:20.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:37:20 gibba045 bash[25517]: cluster 2021-03-10T17:37:18.998163+0000 mgr.gibba045.orlgmj (mgr.34412) 12042 : cluster [DBG] pgmap v6863: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:22.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:37:22 gibba015 bash[29377]: cluster 2021-03-10T17:37:20.999838+0000 mgr.gibba045.orlgmj (mgr.34412) 12043 : cluster [DBG] pgmap v6864: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:22.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:37:22 gibba015 bash[29377]: cephadm 2021-03-10T17:37:21.561525+0000 mgr.gibba045.orlgmj (mgr.34412) 12044 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:37:22.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:37:22 gibba015 bash[30343]: cluster 2021-03-10T17:37:20.999838+0000 mgr.gibba045.orlgmj (mgr.34412) 12043 : cluster [DBG] pgmap v6864: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:22.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:37:22 gibba015 bash[30343]: cephadm 2021-03-10T17:37:21.561525+0000 mgr.gibba045.orlgmj (mgr.34412) 12044 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:37:22.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:37:22 gibba045 bash[25517]: cluster 2021-03-10T17:37:20.999838+0000 mgr.gibba045.orlgmj (mgr.34412) 12043 : cluster [DBG] pgmap v6864: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:22.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:37:22 gibba045 bash[25517]: cephadm 2021-03-10T17:37:21.561525+0000 mgr.gibba045.orlgmj (mgr.34412) 12044 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:37:24.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:37:24 gibba015 bash[29377]: cluster 2021-03-10T17:37:23.001282+0000 mgr.gibba045.orlgmj (mgr.34412) 12045 : cluster [DBG] pgmap v6865: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:24.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:37:24 gibba015 bash[30343]: cluster 2021-03-10T17:37:23.001282+0000 mgr.gibba045.orlgmj (mgr.34412) 12045 : cluster [DBG] pgmap v6865: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:24.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:37:24 gibba045 bash[25517]: cluster 2021-03-10T17:37:23.001282+0000 mgr.gibba045.orlgmj (mgr.34412) 12045 : cluster [DBG] pgmap v6865: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:26.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:37:26 gibba015 bash[29377]: cluster 2021-03-10T17:37:25.002919+0000 mgr.gibba045.orlgmj (mgr.34412) 12046 : cluster [DBG] pgmap v6866: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:26.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:37:26 gibba015 bash[30343]: cluster 2021-03-10T17:37:25.002919+0000 mgr.gibba045.orlgmj (mgr.34412) 12046 : cluster [DBG] pgmap v6866: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:26.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:37:26 gibba045 bash[25517]: cluster 2021-03-10T17:37:25.002919+0000 mgr.gibba045.orlgmj (mgr.34412) 12046 : cluster [DBG] pgmap v6866: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:28.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:37:28 gibba015 bash[29377]: cluster 2021-03-10T17:37:27.004721+0000 mgr.gibba045.orlgmj (mgr.34412) 12047 : cluster [DBG] pgmap v6867: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:28.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:37:28 gibba015 bash[30343]: cluster 2021-03-10T17:37:27.004721+0000 mgr.gibba045.orlgmj (mgr.34412) 12047 : cluster [DBG] pgmap v6867: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:28.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:37:28 gibba045 bash[25517]: cluster 2021-03-10T17:37:27.004721+0000 mgr.gibba045.orlgmj (mgr.34412) 12047 : cluster [DBG] pgmap v6867: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:30.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:37:30 gibba015 bash[29377]: cluster 2021-03-10T17:37:29.006048+0000 mgr.gibba045.orlgmj (mgr.34412) 12048 : cluster [DBG] pgmap v6868: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:30.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:37:30 gibba015 bash[30343]: cluster 2021-03-10T17:37:29.006048+0000 mgr.gibba045.orlgmj (mgr.34412) 12048 : cluster [DBG] pgmap v6868: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:30.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:37:30 gibba045 bash[25517]: cluster 2021-03-10T17:37:29.006048+0000 mgr.gibba045.orlgmj (mgr.34412) 12048 : cluster [DBG] pgmap v6868: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:32.420 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:37:32.649 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:37:32.649 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 9m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:37:32.649 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 8m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:37:32.650 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:37:32.650 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:37:32.650 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:37:32.650 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:37:32.651 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:37:32.651 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:37:32.651 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 9m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:37:32.651 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 8m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:37:32.652 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:37:32.652 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:37:32.652 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:37:32.652 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:37:32.653 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:37:32.653 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:37:32.653 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:37:32.653 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:37:32.654 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 8m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:37:32.654 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 8m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:37:32.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:37:32 gibba015 bash[29377]: cluster 2021-03-10T17:37:31.007510+0000 mgr.gibba045.orlgmj (mgr.34412) 12049 : cluster [DBG] pgmap v6869: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:32.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:37:32 gibba015 bash[30343]: cluster 2021-03-10T17:37:31.007510+0000 mgr.gibba045.orlgmj (mgr.34412) 12049 : cluster [DBG] pgmap v6869: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:32.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:37:32 gibba045 bash[25517]: cluster 2021-03-10T17:37:31.007510+0000 mgr.gibba045.orlgmj (mgr.34412) 12049 : cluster [DBG] pgmap v6869: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:32.898 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:37:32.899 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:37:32.899 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:37:32.899 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:37:32.899 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:37:32.900 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:37:32.900 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:37:32.900 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:37:32.900 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:37:32.901 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:37:32.901 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:37:32.901 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:37:32.901 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:37:32.902 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:37:32.902 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:37:33.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:37:33 gibba045 bash[25517]: audit 2021-03-10T17:37:32.410855+0000 mgr.gibba045.orlgmj (mgr.34412) 12050 : audit [DBG] from='client.52134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:37:33.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:37:33 gibba045 bash[25517]: audit 2021-03-10T17:37:32.636318+0000 mgr.gibba045.orlgmj (mgr.34412) 12051 : audit [DBG] from='client.52140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:37:33.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:37:33 gibba045 bash[25517]: audit 2021-03-10T17:37:32.895925+0000 mon.c (mon.1) 3301 : audit [DBG] from='client.? 172.21.2.115:0/1825022140' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:37:33.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:37:33 gibba015 bash[29377]: audit 2021-03-10T17:37:32.410855+0000 mgr.gibba045.orlgmj (mgr.34412) 12050 : audit [DBG] from='client.52134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:37:33.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:37:33 gibba015 bash[29377]: audit 2021-03-10T17:37:32.636318+0000 mgr.gibba045.orlgmj (mgr.34412) 12051 : audit [DBG] from='client.52140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:37:33.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:37:33 gibba015 bash[29377]: audit 2021-03-10T17:37:32.895925+0000 mon.c (mon.1) 3301 : audit [DBG] from='client.? 172.21.2.115:0/1825022140' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:37:33.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:37:33 gibba015 bash[30343]: audit 2021-03-10T17:37:32.410855+0000 mgr.gibba045.orlgmj (mgr.34412) 12050 : audit [DBG] from='client.52134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:37:33.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:37:33 gibba015 bash[30343]: audit 2021-03-10T17:37:32.636318+0000 mgr.gibba045.orlgmj (mgr.34412) 12051 : audit [DBG] from='client.52140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:37:33.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:37:33 gibba015 bash[30343]: audit 2021-03-10T17:37:32.895925+0000 mon.c (mon.1) 3301 : audit [DBG] from='client.? 172.21.2.115:0/1825022140' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:37:34.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:37:34 gibba045 bash[25517]: cluster 2021-03-10T17:37:33.008942+0000 mgr.gibba045.orlgmj (mgr.34412) 12052 : cluster [DBG] pgmap v6870: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:34.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:37:34 gibba015 bash[29377]: cluster 2021-03-10T17:37:33.008942+0000 mgr.gibba045.orlgmj (mgr.34412) 12052 : cluster [DBG] pgmap v6870: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:34.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:37:34 gibba015 bash[30343]: cluster 2021-03-10T17:37:33.008942+0000 mgr.gibba045.orlgmj (mgr.34412) 12052 : cluster [DBG] pgmap v6870: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:36.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:37:36 gibba045 bash[25517]: cluster 2021-03-10T17:37:35.010476+0000 mgr.gibba045.orlgmj (mgr.34412) 12053 : cluster [DBG] pgmap v6871: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:36.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:37:36 gibba015 bash[29377]: cluster 2021-03-10T17:37:35.010476+0000 mgr.gibba045.orlgmj (mgr.34412) 12053 : cluster [DBG] pgmap v6871: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:36.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:37:36 gibba015 bash[30343]: cluster 2021-03-10T17:37:35.010476+0000 mgr.gibba045.orlgmj (mgr.34412) 12053 : cluster [DBG] pgmap v6871: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:37.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:37:37 gibba045 bash[25517]: cephadm 2021-03-10T17:37:36.577248+0000 mgr.gibba045.orlgmj (mgr.34412) 12054 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:37:37.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:37:37 gibba015 bash[29377]: cephadm 2021-03-10T17:37:36.577248+0000 mgr.gibba045.orlgmj (mgr.34412) 12054 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:37:37.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:37:37 gibba015 bash[30343]: cephadm 2021-03-10T17:37:36.577248+0000 mgr.gibba045.orlgmj (mgr.34412) 12054 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:37:38.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:37:38 gibba045 bash[25517]: cluster 2021-03-10T17:37:37.012225+0000 mgr.gibba045.orlgmj (mgr.34412) 12055 : cluster [DBG] pgmap v6872: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:38.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:37:38 gibba015 bash[29377]: cluster 2021-03-10T17:37:37.012225+0000 mgr.gibba045.orlgmj (mgr.34412) 12055 : cluster [DBG] pgmap v6872: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:38.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:37:38 gibba015 bash[30343]: cluster 2021-03-10T17:37:37.012225+0000 mgr.gibba045.orlgmj (mgr.34412) 12055 : cluster [DBG] pgmap v6872: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:40.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:37:40 gibba045 bash[25517]: cluster 2021-03-10T17:37:39.013491+0000 mgr.gibba045.orlgmj (mgr.34412) 12056 : cluster [DBG] pgmap v6873: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:40.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:37:40 gibba015 bash[29377]: cluster 2021-03-10T17:37:39.013491+0000 mgr.gibba045.orlgmj (mgr.34412) 12056 : cluster [DBG] pgmap v6873: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:40.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:37:40 gibba015 bash[30343]: cluster 2021-03-10T17:37:39.013491+0000 mgr.gibba045.orlgmj (mgr.34412) 12056 : cluster [DBG] pgmap v6873: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:42.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:37:42 gibba045 bash[25517]: cluster 2021-03-10T17:37:41.015140+0000 mgr.gibba045.orlgmj (mgr.34412) 12057 : cluster [DBG] pgmap v6874: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:42.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:37:42 gibba015 bash[29377]: cluster 2021-03-10T17:37:41.015140+0000 mgr.gibba045.orlgmj (mgr.34412) 12057 : cluster [DBG] pgmap v6874: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:42.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:37:42 gibba015 bash[30343]: cluster 2021-03-10T17:37:41.015140+0000 mgr.gibba045.orlgmj (mgr.34412) 12057 : cluster [DBG] pgmap v6874: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:44.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:37:44 gibba045 bash[25517]: cluster 2021-03-10T17:37:43.016703+0000 mgr.gibba045.orlgmj (mgr.34412) 12058 : cluster [DBG] pgmap v6875: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:44.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:37:44 gibba015 bash[29377]: cluster 2021-03-10T17:37:43.016703+0000 mgr.gibba045.orlgmj (mgr.34412) 12058 : cluster [DBG] pgmap v6875: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:44.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:37:44 gibba015 bash[30343]: cluster 2021-03-10T17:37:43.016703+0000 mgr.gibba045.orlgmj (mgr.34412) 12058 : cluster [DBG] pgmap v6875: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:46.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:37:46 gibba015 bash[29377]: cluster 2021-03-10T17:37:45.018243+0000 mgr.gibba045.orlgmj (mgr.34412) 12059 : cluster [DBG] pgmap v6876: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:46.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:37:46 gibba015 bash[30343]: cluster 2021-03-10T17:37:45.018243+0000 mgr.gibba045.orlgmj (mgr.34412) 12059 : cluster [DBG] pgmap v6876: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:47.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:37:46 gibba045 bash[25517]: cluster 2021-03-10T17:37:45.018243+0000 mgr.gibba045.orlgmj (mgr.34412) 12059 : cluster [DBG] pgmap v6876: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:48.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:37:48 gibba015 bash[29377]: cluster 2021-03-10T17:37:47.019881+0000 mgr.gibba045.orlgmj (mgr.34412) 12060 : cluster [DBG] pgmap v6877: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:48.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:37:48 gibba015 bash[30343]: cluster 2021-03-10T17:37:47.019881+0000 mgr.gibba045.orlgmj (mgr.34412) 12060 : cluster [DBG] pgmap v6877: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:49.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:37:48 gibba045 bash[25517]: cluster 2021-03-10T17:37:47.019881+0000 mgr.gibba045.orlgmj (mgr.34412) 12060 : cluster [DBG] pgmap v6877: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:50.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:37:50 gibba015 bash[29377]: cluster 2021-03-10T17:37:49.021185+0000 mgr.gibba045.orlgmj (mgr.34412) 12061 : cluster [DBG] pgmap v6878: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:50.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:37:50 gibba015 bash[30343]: cluster 2021-03-10T17:37:49.021185+0000 mgr.gibba045.orlgmj (mgr.34412) 12061 : cluster [DBG] pgmap v6878: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:51.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:37:50 gibba045 bash[25517]: cluster 2021-03-10T17:37:49.021185+0000 mgr.gibba045.orlgmj (mgr.34412) 12061 : cluster [DBG] pgmap v6878: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:52.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:37:52 gibba015 bash[29377]: cluster 2021-03-10T17:37:51.022982+0000 mgr.gibba045.orlgmj (mgr.34412) 12062 : cluster [DBG] pgmap v6879: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:52.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:37:52 gibba015 bash[29377]: audit 2021-03-10T17:37:51.591219+0000 mon.c (mon.1) 3302 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:37:52.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:37:52 gibba015 bash[29377]: audit 2021-03-10T17:37:51.594016+0000 mon.c (mon.1) 3303 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:37:52.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:37:52 gibba015 bash[29377]: cephadm 2021-03-10T17:37:51.595523+0000 mgr.gibba045.orlgmj (mgr.34412) 12063 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:37:52.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:37:52 gibba015 bash[30343]: cluster 2021-03-10T17:37:51.022982+0000 mgr.gibba045.orlgmj (mgr.34412) 12062 : cluster [DBG] pgmap v6879: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:52.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:37:52 gibba015 bash[30343]: audit 2021-03-10T17:37:51.591219+0000 mon.c (mon.1) 3302 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:37:52.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:37:52 gibba015 bash[30343]: audit 2021-03-10T17:37:51.594016+0000 mon.c (mon.1) 3303 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:37:52.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:37:52 gibba015 bash[30343]: cephadm 2021-03-10T17:37:51.595523+0000 mgr.gibba045.orlgmj (mgr.34412) 12063 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:37:53.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:37:52 gibba045 bash[25517]: cluster 2021-03-10T17:37:51.022982+0000 mgr.gibba045.orlgmj (mgr.34412) 12062 : cluster [DBG] pgmap v6879: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:53.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:37:52 gibba045 bash[25517]: audit 2021-03-10T17:37:51.591219+0000 mon.c (mon.1) 3302 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:37:53.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:37:52 gibba045 bash[25517]: audit 2021-03-10T17:37:51.594016+0000 mon.c (mon.1) 3303 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:37:53.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:37:52 gibba045 bash[25517]: cephadm 2021-03-10T17:37:51.595523+0000 mgr.gibba045.orlgmj (mgr.34412) 12063 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:37:54.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:37:54 gibba015 bash[29377]: cluster 2021-03-10T17:37:53.024408+0000 mgr.gibba045.orlgmj (mgr.34412) 12064 : cluster [DBG] pgmap v6880: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:54.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:37:54 gibba015 bash[29377]: audit 2021-03-10T17:37:54.153524+0000 mon.c (mon.1) 3304 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:37:54.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:37:54 gibba015 bash[29377]: audit 2021-03-10T17:37:54.154278+0000 mon.c (mon.1) 3305 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:37:54.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:37:54 gibba015 bash[29377]: audit 2021-03-10T17:37:54.154676+0000 mon.a (mon.0) 2494 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:37:54.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:37:54 gibba015 bash[29377]: audit 2021-03-10T17:37:54.155744+0000 mon.a (mon.0) 2495 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:37:54.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:37:54 gibba015 bash[29377]: audit 2021-03-10T17:37:54.260680+0000 mon.c (mon.1) 3306 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T17:37:54.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:37:54 gibba015 bash[29377]: audit 2021-03-10T17:37:54.261494+0000 mon.c (mon.1) 3307 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:37:54.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:37:54 gibba015 bash[29377]: audit 2021-03-10T17:37:54.261901+0000 mon.a (mon.0) 2496 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T17:37:54.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:37:54 gibba015 bash[29377]: audit 2021-03-10T17:37:54.262220+0000 mon.c (mon.1) 3308 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:37:54.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:37:54 gibba015 bash[29377]: audit 2021-03-10T17:37:54.263037+0000 mon.c (mon.1) 3309 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T17:37:54.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:37:54 gibba015 bash[29377]: audit 2021-03-10T17:37:54.263220+0000 mon.a (mon.0) 2497 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:37:54.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:37:54 gibba015 bash[29377]: audit 2021-03-10T17:37:54.264327+0000 mon.a (mon.0) 2498 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:37:54.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:37:54 gibba015 bash[29377]: audit 2021-03-10T17:37:54.265159+0000 mon.a (mon.0) 2499 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T17:37:54.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:37:54 gibba015 bash[30343]: cluster 2021-03-10T17:37:53.024408+0000 mgr.gibba045.orlgmj (mgr.34412) 12064 : cluster [DBG] pgmap v6880: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:54.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:37:54 gibba015 bash[30343]: audit 2021-03-10T17:37:54.153524+0000 mon.c (mon.1) 3304 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:37:54.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:37:54 gibba015 bash[30343]: audit 2021-03-10T17:37:54.154278+0000 mon.c (mon.1) 3305 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:37:54.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:37:54 gibba015 bash[30343]: audit 2021-03-10T17:37:54.154676+0000 mon.a (mon.0) 2494 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:37:54.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:37:54 gibba015 bash[30343]: audit 2021-03-10T17:37:54.155744+0000 mon.a (mon.0) 2495 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:37:54.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:37:54 gibba015 bash[30343]: audit 2021-03-10T17:37:54.260680+0000 mon.c (mon.1) 3306 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T17:37:54.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:37:54 gibba015 bash[30343]: audit 2021-03-10T17:37:54.261494+0000 mon.c (mon.1) 3307 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:37:54.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:37:54 gibba015 bash[30343]: audit 2021-03-10T17:37:54.261901+0000 mon.a (mon.0) 2496 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T17:37:54.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:37:54 gibba015 bash[30343]: audit 2021-03-10T17:37:54.262220+0000 mon.c (mon.1) 3308 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:37:54.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:37:54 gibba015 bash[30343]: audit 2021-03-10T17:37:54.263037+0000 mon.c (mon.1) 3309 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T17:37:54.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:37:54 gibba015 bash[30343]: audit 2021-03-10T17:37:54.263220+0000 mon.a (mon.0) 2497 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:37:54.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:37:54 gibba015 bash[30343]: audit 2021-03-10T17:37:54.264327+0000 mon.a (mon.0) 2498 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:37:54.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:37:54 gibba015 bash[30343]: audit 2021-03-10T17:37:54.265159+0000 mon.a (mon.0) 2499 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T17:37:55.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:37:54 gibba045 bash[25517]: cluster 2021-03-10T17:37:53.024408+0000 mgr.gibba045.orlgmj (mgr.34412) 12064 : cluster [DBG] pgmap v6880: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:55.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:37:54 gibba045 bash[25517]: audit 2021-03-10T17:37:54.153524+0000 mon.c (mon.1) 3304 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:37:55.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:37:54 gibba045 bash[25517]: audit 2021-03-10T17:37:54.154278+0000 mon.c (mon.1) 3305 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:37:55.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:37:54 gibba045 bash[25517]: audit 2021-03-10T17:37:54.154676+0000 mon.a (mon.0) 2494 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:37:55.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:37:54 gibba045 bash[25517]: audit 2021-03-10T17:37:54.155744+0000 mon.a (mon.0) 2495 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:37:55.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:37:54 gibba045 bash[25517]: audit 2021-03-10T17:37:54.260680+0000 mon.c (mon.1) 3306 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T17:37:55.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:37:54 gibba045 bash[25517]: audit 2021-03-10T17:37:54.261494+0000 mon.c (mon.1) 3307 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:37:55.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:37:54 gibba045 bash[25517]: audit 2021-03-10T17:37:54.261901+0000 mon.a (mon.0) 2496 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T17:37:55.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:37:54 gibba045 bash[25517]: audit 2021-03-10T17:37:54.262220+0000 mon.c (mon.1) 3308 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:37:55.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:37:54 gibba045 bash[25517]: audit 2021-03-10T17:37:54.263037+0000 mon.c (mon.1) 3309 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T17:37:55.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:37:54 gibba045 bash[25517]: audit 2021-03-10T17:37:54.263220+0000 mon.a (mon.0) 2497 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:37:55.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:37:54 gibba045 bash[25517]: audit 2021-03-10T17:37:54.264327+0000 mon.a (mon.0) 2498 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:37:55.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:37:54 gibba045 bash[25517]: audit 2021-03-10T17:37:54.265159+0000 mon.a (mon.0) 2499 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T17:37:56.105 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:37:56 gibba015 bash[29377]: cluster 2021-03-10T17:37:55.026193+0000 mgr.gibba045.orlgmj (mgr.34412) 12065 : cluster [DBG] pgmap v6881: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:56.106 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:37:56 gibba015 bash[29377]: audit 2021-03-10T17:37:55.093329+0000 mon.a (mon.0) 2500 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:37:56.106 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:37:56 gibba015 bash[29377]: cephadm 2021-03-10T17:37:55.096199+0000 mgr.gibba045.orlgmj (mgr.34412) 12066 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:37:56.106 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:37:56 gibba015 bash[29377]: audit 2021-03-10T17:37:55.301598+0000 mon.a (mon.0) 2501 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:37:56.106 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:37:56 gibba015 bash[29377]: audit 2021-03-10T17:37:55.308741+0000 mon.c (mon.1) 3310 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:37:56.107 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:37:56 gibba015 bash[29377]: cephadm 2021-03-10T17:37:55.309911+0000 mgr.gibba045.orlgmj (mgr.34412) 12067 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:37:56.107 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:37:56 gibba015 bash[29377]: audit 2021-03-10T17:37:55.310257+0000 mon.c (mon.1) 3311 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:37:56.107 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:37:56 gibba015 bash[29377]: cephadm 2021-03-10T17:37:55.311529+0000 mgr.gibba045.orlgmj (mgr.34412) 12068 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:37:56.107 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:37:56 gibba015 bash[29377]: audit 2021-03-10T17:37:55.311650+0000 mon.c (mon.1) 3312 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:37:56.107 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:37:56 gibba015 bash[29377]: audit 2021-03-10T17:37:55.312906+0000 mon.c (mon.1) 3313 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:37:56.108 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:37:56 gibba015 bash[29377]: cephadm 2021-03-10T17:37:55.313028+0000 mgr.gibba045.orlgmj (mgr.34412) 12069 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:37:56.108 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:37:56 gibba015 bash[29377]: cephadm 2021-03-10T17:37:55.313066+0000 mgr.gibba045.orlgmj (mgr.34412) 12070 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:37:56.108 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:37:56 gibba015 bash[29377]: cephadm 2021-03-10T17:37:55.314341+0000 mgr.gibba045.orlgmj (mgr.34412) 12071 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:37:56.108 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:37:56 gibba015 bash[29377]: cephadm 2021-03-10T17:37:55.314379+0000 mgr.gibba045.orlgmj (mgr.34412) 12072 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:37:56.109 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:37:56 gibba015 bash[29377]: cephadm 2021-03-10T17:37:55.315520+0000 mgr.gibba045.orlgmj (mgr.34412) 12073 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:37:56.109 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:37:56 gibba015 bash[29377]: audit 2021-03-10T17:37:55.315588+0000 mon.c (mon.1) 3314 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:37:56.109 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:37:56 gibba015 bash[29377]: audit 2021-03-10T17:37:55.316879+0000 mon.c (mon.1) 3315 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:37:56.109 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:37:56 gibba015 bash[30343]: cluster 2021-03-10T17:37:55.026193+0000 mgr.gibba045.orlgmj (mgr.34412) 12065 : cluster [DBG] pgmap v6881: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:56.110 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:37:56 gibba015 bash[30343]: audit 2021-03-10T17:37:55.093329+0000 mon.a (mon.0) 2500 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:37:56.110 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:37:56 gibba015 bash[30343]: cephadm 2021-03-10T17:37:55.096199+0000 mgr.gibba045.orlgmj (mgr.34412) 12066 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:37:56.110 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:37:56 gibba015 bash[30343]: audit 2021-03-10T17:37:55.301598+0000 mon.a (mon.0) 2501 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:37:56.110 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:37:56 gibba015 bash[30343]: audit 2021-03-10T17:37:55.308741+0000 mon.c (mon.1) 3310 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:37:56.111 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:37:56 gibba015 bash[30343]: cephadm 2021-03-10T17:37:55.309911+0000 mgr.gibba045.orlgmj (mgr.34412) 12067 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:37:56.111 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:37:56 gibba015 bash[30343]: audit 2021-03-10T17:37:55.310257+0000 mon.c (mon.1) 3311 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:37:56.111 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:37:56 gibba015 bash[30343]: cephadm 2021-03-10T17:37:55.311529+0000 mgr.gibba045.orlgmj (mgr.34412) 12068 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:37:56.111 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:37:56 gibba015 bash[30343]: audit 2021-03-10T17:37:55.311650+0000 mon.c (mon.1) 3312 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:37:56.111 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:37:56 gibba015 bash[30343]: audit 2021-03-10T17:37:55.312906+0000 mon.c (mon.1) 3313 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:37:56.112 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:37:56 gibba015 bash[30343]: cephadm 2021-03-10T17:37:55.313028+0000 mgr.gibba045.orlgmj (mgr.34412) 12069 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:37:56.112 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:37:56 gibba015 bash[30343]: cephadm 2021-03-10T17:37:55.313066+0000 mgr.gibba045.orlgmj (mgr.34412) 12070 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:37:56.112 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:37:56 gibba015 bash[30343]: cephadm 2021-03-10T17:37:55.314341+0000 mgr.gibba045.orlgmj (mgr.34412) 12071 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:37:56.112 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:37:56 gibba015 bash[30343]: cephadm 2021-03-10T17:37:55.314379+0000 mgr.gibba045.orlgmj (mgr.34412) 12072 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:37:56.112 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:37:56 gibba015 bash[30343]: cephadm 2021-03-10T17:37:55.315520+0000 mgr.gibba045.orlgmj (mgr.34412) 12073 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:37:56.113 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:37:56 gibba015 bash[30343]: audit 2021-03-10T17:37:55.315588+0000 mon.c (mon.1) 3314 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:37:56.113 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:37:56 gibba015 bash[30343]: audit 2021-03-10T17:37:55.316879+0000 mon.c (mon.1) 3315 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:37:56.113 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:37:56 gibba015 bash[30343]: cephadm 2021-03-10T17:37:55.317072+0000 mgr.gibba045.orlgmj (mgr.34412) 12074 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:37:56.113 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:37:56 gibba015 bash[30343]: cephadm 2021-03-10T17:37:55.317109+0000 mgr.gibba045.orlgmj (mgr.34412) 12075 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:37:56.114 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:37:56 gibba015 bash[30343]: cephadm 2021-03-10T17:37:55.318220+0000 mgr.gibba045.orlgmj (mgr.34412) 12076 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:37:56.472 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:37:56 gibba015 bash[30343]: cephadm 2021-03-10T17:37:55.318552+0000 mgr.gibba045.orlgmj (mgr.34412) 12077 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:37:56.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:37:56 gibba015 bash[30343]: cephadm 2021-03-10T17:37:55.319390+0000 mgr.gibba045.orlgmj (mgr.34412) 12078 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:37:56.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:37:56 gibba015 bash[30343]: cephadm 2021-03-10T17:37:55.319431+0000 mgr.gibba045.orlgmj (mgr.34412) 12079 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:37:56.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:37:56 gibba015 bash[30343]: cephadm 2021-03-10T17:37:55.319616+0000 mgr.gibba045.orlgmj (mgr.34412) 12080 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:37:56.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:37:56 gibba015 bash[29377]: cephadm 2021-03-10T17:37:55.317072+0000 mgr.gibba045.orlgmj (mgr.34412) 12074 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:37:56.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:37:56 gibba015 bash[29377]: cephadm 2021-03-10T17:37:55.317109+0000 mgr.gibba045.orlgmj (mgr.34412) 12075 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:37:56.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:37:56 gibba015 bash[29377]: cephadm 2021-03-10T17:37:55.318220+0000 mgr.gibba045.orlgmj (mgr.34412) 12076 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:37:56.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:37:56 gibba015 bash[29377]: cephadm 2021-03-10T17:37:55.318552+0000 mgr.gibba045.orlgmj (mgr.34412) 12077 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:37:56.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:37:56 gibba015 bash[29377]: cephadm 2021-03-10T17:37:55.319390+0000 mgr.gibba045.orlgmj (mgr.34412) 12078 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:37:56.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:37:56 gibba015 bash[29377]: cephadm 2021-03-10T17:37:55.319431+0000 mgr.gibba045.orlgmj (mgr.34412) 12079 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:37:56.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:37:56 gibba015 bash[29377]: cephadm 2021-03-10T17:37:55.319616+0000 mgr.gibba045.orlgmj (mgr.34412) 12080 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:37:56.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:37:56 gibba045 bash[25517]: cluster 2021-03-10T17:37:55.026193+0000 mgr.gibba045.orlgmj (mgr.34412) 12065 : cluster [DBG] pgmap v6881: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:56.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:37:56 gibba045 bash[25517]: audit 2021-03-10T17:37:55.093329+0000 mon.a (mon.0) 2500 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:37:56.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:37:56 gibba045 bash[25517]: cephadm 2021-03-10T17:37:55.096199+0000 mgr.gibba045.orlgmj (mgr.34412) 12066 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:37:56.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:37:56 gibba045 bash[25517]: audit 2021-03-10T17:37:55.301598+0000 mon.a (mon.0) 2501 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:37:56.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:37:56 gibba045 bash[25517]: audit 2021-03-10T17:37:55.308741+0000 mon.c (mon.1) 3310 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:37:56.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:37:56 gibba045 bash[25517]: cephadm 2021-03-10T17:37:55.309911+0000 mgr.gibba045.orlgmj (mgr.34412) 12067 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:37:56.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:37:56 gibba045 bash[25517]: audit 2021-03-10T17:37:55.310257+0000 mon.c (mon.1) 3311 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:37:56.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:37:56 gibba045 bash[25517]: cephadm 2021-03-10T17:37:55.311529+0000 mgr.gibba045.orlgmj (mgr.34412) 12068 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:37:56.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:37:56 gibba045 bash[25517]: audit 2021-03-10T17:37:55.311650+0000 mon.c (mon.1) 3312 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:37:56.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:37:56 gibba045 bash[25517]: audit 2021-03-10T17:37:55.312906+0000 mon.c (mon.1) 3313 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:37:56.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:37:56 gibba045 bash[25517]: cephadm 2021-03-10T17:37:55.313028+0000 mgr.gibba045.orlgmj (mgr.34412) 12069 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:37:56.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:37:56 gibba045 bash[25517]: cephadm 2021-03-10T17:37:55.313066+0000 mgr.gibba045.orlgmj (mgr.34412) 12070 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:37:56.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:37:56 gibba045 bash[25517]: cephadm 2021-03-10T17:37:55.314341+0000 mgr.gibba045.orlgmj (mgr.34412) 12071 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:37:56.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:37:56 gibba045 bash[25517]: cephadm 2021-03-10T17:37:55.314379+0000 mgr.gibba045.orlgmj (mgr.34412) 12072 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:37:56.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:37:56 gibba045 bash[25517]: cephadm 2021-03-10T17:37:55.315520+0000 mgr.gibba045.orlgmj (mgr.34412) 12073 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:37:56.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:37:56 gibba045 bash[25517]: audit 2021-03-10T17:37:55.315588+0000 mon.c (mon.1) 3314 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:37:56.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:37:56 gibba045 bash[25517]: audit 2021-03-10T17:37:55.316879+0000 mon.c (mon.1) 3315 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:37:56.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:37:56 gibba045 bash[25517]: cephadm 2021-03-10T17:37:55.317072+0000 mgr.gibba045.orlgmj (mgr.34412) 12074 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:37:56.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:37:56 gibba045 bash[25517]: cephadm 2021-03-10T17:37:55.317109+0000 mgr.gibba045.orlgmj (mgr.34412) 12075 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:37:56.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:37:56 gibba045 bash[25517]: cephadm 2021-03-10T17:37:55.318220+0000 mgr.gibba045.orlgmj (mgr.34412) 12076 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:37:56.563 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:37:56 gibba045 bash[25517]: cephadm 2021-03-10T17:37:55.318552+0000 mgr.gibba045.orlgmj (mgr.34412) 12077 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:37:56.563 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:37:56 gibba045 bash[25517]: cephadm 2021-03-10T17:37:55.319390+0000 mgr.gibba045.orlgmj (mgr.34412) 12078 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:37:56.563 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:37:56 gibba045 bash[25517]: cephadm 2021-03-10T17:37:55.319431+0000 mgr.gibba045.orlgmj (mgr.34412) 12079 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:37:56.563 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:37:56 gibba045 bash[25517]: cephadm 2021-03-10T17:37:55.319616+0000 mgr.gibba045.orlgmj (mgr.34412) 12080 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:37:58.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:37:58 gibba015 bash[29377]: cluster 2021-03-10T17:37:57.027676+0000 mgr.gibba045.orlgmj (mgr.34412) 12081 : cluster [DBG] pgmap v6882: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:58.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:37:58 gibba015 bash[30343]: cluster 2021-03-10T17:37:57.027676+0000 mgr.gibba045.orlgmj (mgr.34412) 12081 : cluster [DBG] pgmap v6882: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:58.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:37:58 gibba045 bash[25517]: cluster 2021-03-10T17:37:57.027676+0000 mgr.gibba045.orlgmj (mgr.34412) 12081 : cluster [DBG] pgmap v6882: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:00.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:38:00 gibba045 bash[25517]: cluster 2021-03-10T17:37:59.028962+0000 mgr.gibba045.orlgmj (mgr.34412) 12082 : cluster [DBG] pgmap v6883: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:00.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:38:00 gibba015 bash[29377]: cluster 2021-03-10T17:37:59.028962+0000 mgr.gibba045.orlgmj (mgr.34412) 12082 : cluster [DBG] pgmap v6883: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:00.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:38:00 gibba015 bash[30343]: cluster 2021-03-10T17:37:59.028962+0000 mgr.gibba045.orlgmj (mgr.34412) 12082 : cluster [DBG] pgmap v6883: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:02.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:38:02 gibba045 bash[25517]: cluster 2021-03-10T17:38:01.030771+0000 mgr.gibba045.orlgmj (mgr.34412) 12083 : cluster [DBG] pgmap v6884: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:02.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:38:02 gibba015 bash[29377]: cluster 2021-03-10T17:38:01.030771+0000 mgr.gibba045.orlgmj (mgr.34412) 12083 : cluster [DBG] pgmap v6884: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:02.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:38:02 gibba015 bash[30343]: cluster 2021-03-10T17:38:01.030771+0000 mgr.gibba045.orlgmj (mgr.34412) 12083 : cluster [DBG] pgmap v6884: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:03.142 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:38:03.371 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:38:03.371 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 8s ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:38:03.372 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 9m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:38:03.372 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:38:03.372 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:38:03.372 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 8s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:38:03.373 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 8s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:38:03.373 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:38:03.373 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 8s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:38:03.373 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 8s ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:38:03.374 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 9m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:38:03.374 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 8s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:38:03.374 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 8s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:38:03.374 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 8s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:38:03.375 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 8s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:38:03.375 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:38:03.375 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:38:03.375 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:38:03.376 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:38:03.376 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 9m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:38:03.376 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 9m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:38:03.619 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:38:03.620 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:38:03.620 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:38:03.620 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:38:03.620 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:38:03.621 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:38:03.621 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:38:03.621 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:38:03.621 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:38:03.622 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:38:03.622 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:38:03.622 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:38:03.622 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:38:03.622 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:38:03.623 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:38:04.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:38:04 gibba045 bash[25517]: cluster 2021-03-10T17:38:03.032125+0000 mgr.gibba045.orlgmj (mgr.34412) 12084 : cluster [DBG] pgmap v6885: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:04.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:38:04 gibba045 bash[25517]: audit 2021-03-10T17:38:03.132224+0000 mgr.gibba045.orlgmj (mgr.34412) 12085 : audit [DBG] from='client.62137 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:38:04.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:38:04 gibba045 bash[25517]: audit 2021-03-10T17:38:03.358157+0000 mgr.gibba045.orlgmj (mgr.34412) 12086 : audit [DBG] from='client.62143 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:38:04.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:38:04 gibba045 bash[25517]: audit 2021-03-10T17:38:03.616795+0000 mon.a (mon.0) 2502 : audit [DBG] from='client.? 172.21.2.115:0/470166429' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:38:04.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:38:04 gibba015 bash[29377]: cluster 2021-03-10T17:38:03.032125+0000 mgr.gibba045.orlgmj (mgr.34412) 12084 : cluster [DBG] pgmap v6885: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:04.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:38:04 gibba015 bash[29377]: audit 2021-03-10T17:38:03.132224+0000 mgr.gibba045.orlgmj (mgr.34412) 12085 : audit [DBG] from='client.62137 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:38:04.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:38:04 gibba015 bash[29377]: audit 2021-03-10T17:38:03.358157+0000 mgr.gibba045.orlgmj (mgr.34412) 12086 : audit [DBG] from='client.62143 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:38:04.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:38:04 gibba015 bash[29377]: audit 2021-03-10T17:38:03.616795+0000 mon.a (mon.0) 2502 : audit [DBG] from='client.? 172.21.2.115:0/470166429' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:38:04.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:38:04 gibba015 bash[30343]: cluster 2021-03-10T17:38:03.032125+0000 mgr.gibba045.orlgmj (mgr.34412) 12084 : cluster [DBG] pgmap v6885: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:04.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:38:04 gibba015 bash[30343]: audit 2021-03-10T17:38:03.132224+0000 mgr.gibba045.orlgmj (mgr.34412) 12085 : audit [DBG] from='client.62137 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:38:04.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:38:04 gibba015 bash[30343]: audit 2021-03-10T17:38:03.358157+0000 mgr.gibba045.orlgmj (mgr.34412) 12086 : audit [DBG] from='client.62143 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:38:04.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:38:04 gibba015 bash[30343]: audit 2021-03-10T17:38:03.616795+0000 mon.a (mon.0) 2502 : audit [DBG] from='client.? 172.21.2.115:0/470166429' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:38:06.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:38:06 gibba045 bash[25517]: cluster 2021-03-10T17:38:05.033722+0000 mgr.gibba045.orlgmj (mgr.34412) 12087 : cluster [DBG] pgmap v6886: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:06.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:38:06 gibba015 bash[29377]: cluster 2021-03-10T17:38:05.033722+0000 mgr.gibba045.orlgmj (mgr.34412) 12087 : cluster [DBG] pgmap v6886: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:06.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:38:06 gibba015 bash[30343]: cluster 2021-03-10T17:38:05.033722+0000 mgr.gibba045.orlgmj (mgr.34412) 12087 : cluster [DBG] pgmap v6886: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:08.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:38:08 gibba045 bash[25517]: cluster 2021-03-10T17:38:07.035510+0000 mgr.gibba045.orlgmj (mgr.34412) 12088 : cluster [DBG] pgmap v6887: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:08.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:38:08 gibba015 bash[29377]: cluster 2021-03-10T17:38:07.035510+0000 mgr.gibba045.orlgmj (mgr.34412) 12088 : cluster [DBG] pgmap v6887: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:08.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:38:08 gibba015 bash[30343]: cluster 2021-03-10T17:38:07.035510+0000 mgr.gibba045.orlgmj (mgr.34412) 12088 : cluster [DBG] pgmap v6887: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:10.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:38:10 gibba045 bash[25517]: cluster 2021-03-10T17:38:09.036738+0000 mgr.gibba045.orlgmj (mgr.34412) 12089 : cluster [DBG] pgmap v6888: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:10.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:38:10 gibba015 bash[29377]: cluster 2021-03-10T17:38:09.036738+0000 mgr.gibba045.orlgmj (mgr.34412) 12089 : cluster [DBG] pgmap v6888: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:10.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:38:10 gibba015 bash[30343]: cluster 2021-03-10T17:38:09.036738+0000 mgr.gibba045.orlgmj (mgr.34412) 12089 : cluster [DBG] pgmap v6888: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:11.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:38:11 gibba045 bash[25517]: cephadm 2021-03-10T17:38:10.323684+0000 mgr.gibba045.orlgmj (mgr.34412) 12090 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:38:11.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:38:11 gibba015 bash[29377]: cephadm 2021-03-10T17:38:10.323684+0000 mgr.gibba045.orlgmj (mgr.34412) 12090 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:38:11.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:38:11 gibba015 bash[30343]: cephadm 2021-03-10T17:38:10.323684+0000 mgr.gibba045.orlgmj (mgr.34412) 12090 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:38:12.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:38:12 gibba045 bash[25517]: cluster 2021-03-10T17:38:11.038286+0000 mgr.gibba045.orlgmj (mgr.34412) 12091 : cluster [DBG] pgmap v6889: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:12.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:38:12 gibba015 bash[29377]: cluster 2021-03-10T17:38:11.038286+0000 mgr.gibba045.orlgmj (mgr.34412) 12091 : cluster [DBG] pgmap v6889: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:12.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:38:12 gibba015 bash[30343]: cluster 2021-03-10T17:38:11.038286+0000 mgr.gibba045.orlgmj (mgr.34412) 12091 : cluster [DBG] pgmap v6889: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:14.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:38:14 gibba045 bash[25517]: cluster 2021-03-10T17:38:13.039986+0000 mgr.gibba045.orlgmj (mgr.34412) 12092 : cluster [DBG] pgmap v6890: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:14.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:38:14 gibba015 bash[29377]: cluster 2021-03-10T17:38:13.039986+0000 mgr.gibba045.orlgmj (mgr.34412) 12092 : cluster [DBG] pgmap v6890: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:14.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:38:14 gibba015 bash[30343]: cluster 2021-03-10T17:38:13.039986+0000 mgr.gibba045.orlgmj (mgr.34412) 12092 : cluster [DBG] pgmap v6890: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:16.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:38:16 gibba015 bash[29377]: cluster 2021-03-10T17:38:15.041570+0000 mgr.gibba045.orlgmj (mgr.34412) 12093 : cluster [DBG] pgmap v6891: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:16.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:38:16 gibba015 bash[30343]: cluster 2021-03-10T17:38:15.041570+0000 mgr.gibba045.orlgmj (mgr.34412) 12093 : cluster [DBG] pgmap v6891: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:16.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:38:16 gibba045 bash[25517]: cluster 2021-03-10T17:38:15.041570+0000 mgr.gibba045.orlgmj (mgr.34412) 12093 : cluster [DBG] pgmap v6891: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:18.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:38:18 gibba015 bash[30343]: cluster 2021-03-10T17:38:17.043201+0000 mgr.gibba045.orlgmj (mgr.34412) 12094 : cluster [DBG] pgmap v6892: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:18.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:38:18 gibba015 bash[29377]: cluster 2021-03-10T17:38:17.043201+0000 mgr.gibba045.orlgmj (mgr.34412) 12094 : cluster [DBG] pgmap v6892: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:18.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:38:18 gibba045 bash[25517]: cluster 2021-03-10T17:38:17.043201+0000 mgr.gibba045.orlgmj (mgr.34412) 12094 : cluster [DBG] pgmap v6892: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:20.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:38:20 gibba015 bash[29377]: cluster 2021-03-10T17:38:19.044421+0000 mgr.gibba045.orlgmj (mgr.34412) 12095 : cluster [DBG] pgmap v6893: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:20.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:38:20 gibba015 bash[30343]: cluster 2021-03-10T17:38:19.044421+0000 mgr.gibba045.orlgmj (mgr.34412) 12095 : cluster [DBG] pgmap v6893: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:20.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:38:20 gibba045 bash[25517]: cluster 2021-03-10T17:38:19.044421+0000 mgr.gibba045.orlgmj (mgr.34412) 12095 : cluster [DBG] pgmap v6893: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:22.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:38:22 gibba015 bash[29377]: cluster 2021-03-10T17:38:21.045879+0000 mgr.gibba045.orlgmj (mgr.34412) 12096 : cluster [DBG] pgmap v6894: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:22.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:38:22 gibba015 bash[30343]: cluster 2021-03-10T17:38:21.045879+0000 mgr.gibba045.orlgmj (mgr.34412) 12096 : cluster [DBG] pgmap v6894: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:22.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:38:22 gibba045 bash[25517]: cluster 2021-03-10T17:38:21.045879+0000 mgr.gibba045.orlgmj (mgr.34412) 12096 : cluster [DBG] pgmap v6894: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:24.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:38:24 gibba015 bash[29377]: cluster 2021-03-10T17:38:23.047515+0000 mgr.gibba045.orlgmj (mgr.34412) 12097 : cluster [DBG] pgmap v6895: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:24.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:38:24 gibba015 bash[30343]: cluster 2021-03-10T17:38:23.047515+0000 mgr.gibba045.orlgmj (mgr.34412) 12097 : cluster [DBG] pgmap v6895: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:24.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:38:24 gibba045 bash[25517]: cluster 2021-03-10T17:38:23.047515+0000 mgr.gibba045.orlgmj (mgr.34412) 12097 : cluster [DBG] pgmap v6895: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:26.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:38:26 gibba015 bash[29377]: cluster 2021-03-10T17:38:25.048944+0000 mgr.gibba045.orlgmj (mgr.34412) 12098 : cluster [DBG] pgmap v6896: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:26.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:38:26 gibba015 bash[29377]: cephadm 2021-03-10T17:38:25.339724+0000 mgr.gibba045.orlgmj (mgr.34412) 12099 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:38:26.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:38:26 gibba015 bash[30343]: cluster 2021-03-10T17:38:25.048944+0000 mgr.gibba045.orlgmj (mgr.34412) 12098 : cluster [DBG] pgmap v6896: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:26.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:38:26 gibba015 bash[30343]: cephadm 2021-03-10T17:38:25.339724+0000 mgr.gibba045.orlgmj (mgr.34412) 12099 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:38:26.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:38:26 gibba045 bash[25517]: cluster 2021-03-10T17:38:25.048944+0000 mgr.gibba045.orlgmj (mgr.34412) 12098 : cluster [DBG] pgmap v6896: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:26.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:38:26 gibba045 bash[25517]: cephadm 2021-03-10T17:38:25.339724+0000 mgr.gibba045.orlgmj (mgr.34412) 12099 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:38:28.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:38:28 gibba015 bash[29377]: cluster 2021-03-10T17:38:27.050711+0000 mgr.gibba045.orlgmj (mgr.34412) 12100 : cluster [DBG] pgmap v6897: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:28.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:38:28 gibba015 bash[30343]: cluster 2021-03-10T17:38:27.050711+0000 mgr.gibba045.orlgmj (mgr.34412) 12100 : cluster [DBG] pgmap v6897: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:28.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:38:28 gibba045 bash[25517]: cluster 2021-03-10T17:38:27.050711+0000 mgr.gibba045.orlgmj (mgr.34412) 12100 : cluster [DBG] pgmap v6897: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:30.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:38:30 gibba015 bash[29377]: cluster 2021-03-10T17:38:29.052051+0000 mgr.gibba045.orlgmj (mgr.34412) 12101 : cluster [DBG] pgmap v6898: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:30.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:38:30 gibba015 bash[30343]: cluster 2021-03-10T17:38:29.052051+0000 mgr.gibba045.orlgmj (mgr.34412) 12101 : cluster [DBG] pgmap v6898: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:30.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:38:30 gibba045 bash[25517]: cluster 2021-03-10T17:38:29.052051+0000 mgr.gibba045.orlgmj (mgr.34412) 12101 : cluster [DBG] pgmap v6898: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:32.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:38:32 gibba015 bash[29377]: cluster 2021-03-10T17:38:31.053764+0000 mgr.gibba045.orlgmj (mgr.34412) 12102 : cluster [DBG] pgmap v6899: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:32.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:38:32 gibba015 bash[30343]: cluster 2021-03-10T17:38:31.053764+0000 mgr.gibba045.orlgmj (mgr.34412) 12102 : cluster [DBG] pgmap v6899: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:32.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:38:32 gibba045 bash[25517]: cluster 2021-03-10T17:38:31.053764+0000 mgr.gibba045.orlgmj (mgr.34412) 12102 : cluster [DBG] pgmap v6899: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:33.860 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:38:34.089 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:38:34.090 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 38s ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:38:34.090 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 9m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:38:34.090 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:38:34.091 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:38:34.091 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 38s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:38:34.091 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 38s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:38:34.091 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:38:34.092 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 38s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:38:34.092 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 38s ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:38:34.092 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 9m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:38:34.092 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 38s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:38:34.092 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 38s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:38:34.093 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 38s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:38:34.093 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 38s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:38:34.093 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:38:34.093 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:38:34.094 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:38:34.094 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:38:34.094 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 9m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:38:34.094 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 9m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:38:34.338 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:38:34.339 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:38:34.339 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:38:34.339 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:38:34.339 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:38:34.340 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:38:34.340 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:38:34.340 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:38:34.340 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:38:34.340 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:38:34.341 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:38:34.341 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:38:34.341 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:38:34.341 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:38:34.342 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:38:34.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:38:34 gibba015 bash[29377]: cluster 2021-03-10T17:38:33.055465+0000 mgr.gibba045.orlgmj (mgr.34412) 12103 : cluster [DBG] pgmap v6900: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:34.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:38:34 gibba015 bash[29377]: audit 2021-03-10T17:38:33.851337+0000 mgr.gibba045.orlgmj (mgr.34412) 12104 : audit [DBG] from='client.52170 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:38:34.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:38:34 gibba015 bash[29377]: audit 2021-03-10T17:38:34.335884+0000 mon.c (mon.1) 3316 : audit [DBG] from='client.? 172.21.2.115:0/4174488054' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:38:34.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:38:34 gibba015 bash[30343]: cluster 2021-03-10T17:38:33.055465+0000 mgr.gibba045.orlgmj (mgr.34412) 12103 : cluster [DBG] pgmap v6900: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:34.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:38:34 gibba015 bash[30343]: audit 2021-03-10T17:38:33.851337+0000 mgr.gibba045.orlgmj (mgr.34412) 12104 : audit [DBG] from='client.52170 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:38:34.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:38:34 gibba015 bash[30343]: audit 2021-03-10T17:38:34.335884+0000 mon.c (mon.1) 3316 : audit [DBG] from='client.? 172.21.2.115:0/4174488054' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:38:34.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:38:34 gibba045 bash[25517]: cluster 2021-03-10T17:38:33.055465+0000 mgr.gibba045.orlgmj (mgr.34412) 12103 : cluster [DBG] pgmap v6900: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:34.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:38:34 gibba045 bash[25517]: audit 2021-03-10T17:38:33.851337+0000 mgr.gibba045.orlgmj (mgr.34412) 12104 : audit [DBG] from='client.52170 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:38:34.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:38:34 gibba045 bash[25517]: audit 2021-03-10T17:38:34.335884+0000 mon.c (mon.1) 3316 : audit [DBG] from='client.? 172.21.2.115:0/4174488054' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:38:35.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:38:35 gibba015 bash[29377]: audit 2021-03-10T17:38:34.076914+0000 mgr.gibba045.orlgmj (mgr.34412) 12105 : audit [DBG] from='client.52176 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:38:35.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:38:35 gibba015 bash[30343]: audit 2021-03-10T17:38:34.076914+0000 mgr.gibba045.orlgmj (mgr.34412) 12105 : audit [DBG] from='client.52176 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:38:35.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:38:35 gibba045 bash[25517]: audit 2021-03-10T17:38:34.076914+0000 mgr.gibba045.orlgmj (mgr.34412) 12105 : audit [DBG] from='client.52176 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:38:36.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:38:36 gibba015 bash[29377]: cluster 2021-03-10T17:38:35.057186+0000 mgr.gibba045.orlgmj (mgr.34412) 12106 : cluster [DBG] pgmap v6901: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:36.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:38:36 gibba015 bash[30343]: cluster 2021-03-10T17:38:35.057186+0000 mgr.gibba045.orlgmj (mgr.34412) 12106 : cluster [DBG] pgmap v6901: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:36.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:38:36 gibba045 bash[25517]: cluster 2021-03-10T17:38:35.057186+0000 mgr.gibba045.orlgmj (mgr.34412) 12106 : cluster [DBG] pgmap v6901: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:38.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:38:38 gibba015 bash[29377]: cluster 2021-03-10T17:38:37.058903+0000 mgr.gibba045.orlgmj (mgr.34412) 12107 : cluster [DBG] pgmap v6902: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:38.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:38:38 gibba015 bash[30343]: cluster 2021-03-10T17:38:37.058903+0000 mgr.gibba045.orlgmj (mgr.34412) 12107 : cluster [DBG] pgmap v6902: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:38.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:38:38 gibba045 bash[25517]: cluster 2021-03-10T17:38:37.058903+0000 mgr.gibba045.orlgmj (mgr.34412) 12107 : cluster [DBG] pgmap v6902: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:40.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:38:40 gibba015 bash[29377]: cluster 2021-03-10T17:38:39.060116+0000 mgr.gibba045.orlgmj (mgr.34412) 12108 : cluster [DBG] pgmap v6903: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:40.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:38:40 gibba015 bash[30343]: cluster 2021-03-10T17:38:39.060116+0000 mgr.gibba045.orlgmj (mgr.34412) 12108 : cluster [DBG] pgmap v6903: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:40.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:38:40 gibba045 bash[25517]: cluster 2021-03-10T17:38:39.060116+0000 mgr.gibba045.orlgmj (mgr.34412) 12108 : cluster [DBG] pgmap v6903: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:41.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:38:41 gibba015 bash[29377]: cephadm 2021-03-10T17:38:40.355662+0000 mgr.gibba045.orlgmj (mgr.34412) 12109 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:38:41.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:38:41 gibba015 bash[30343]: cephadm 2021-03-10T17:38:40.355662+0000 mgr.gibba045.orlgmj (mgr.34412) 12109 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:38:41.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:38:41 gibba045 bash[25517]: cephadm 2021-03-10T17:38:40.355662+0000 mgr.gibba045.orlgmj (mgr.34412) 12109 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:38:42.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:38:42 gibba015 bash[29377]: cluster 2021-03-10T17:38:41.061838+0000 mgr.gibba045.orlgmj (mgr.34412) 12110 : cluster [DBG] pgmap v6904: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:42.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:38:42 gibba015 bash[30343]: cluster 2021-03-10T17:38:41.061838+0000 mgr.gibba045.orlgmj (mgr.34412) 12110 : cluster [DBG] pgmap v6904: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:42.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:38:42 gibba045 bash[25517]: cluster 2021-03-10T17:38:41.061838+0000 mgr.gibba045.orlgmj (mgr.34412) 12110 : cluster [DBG] pgmap v6904: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:44.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:38:44 gibba015 bash[29377]: cluster 2021-03-10T17:38:43.063422+0000 mgr.gibba045.orlgmj (mgr.34412) 12111 : cluster [DBG] pgmap v6905: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:44.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:38:44 gibba015 bash[30343]: cluster 2021-03-10T17:38:43.063422+0000 mgr.gibba045.orlgmj (mgr.34412) 12111 : cluster [DBG] pgmap v6905: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:44.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:38:44 gibba045 bash[25517]: cluster 2021-03-10T17:38:43.063422+0000 mgr.gibba045.orlgmj (mgr.34412) 12111 : cluster [DBG] pgmap v6905: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:46.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:38:46 gibba015 bash[29377]: cluster 2021-03-10T17:38:45.065027+0000 mgr.gibba045.orlgmj (mgr.34412) 12112 : cluster [DBG] pgmap v6906: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:46.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:38:46 gibba015 bash[30343]: cluster 2021-03-10T17:38:45.065027+0000 mgr.gibba045.orlgmj (mgr.34412) 12112 : cluster [DBG] pgmap v6906: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:46.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:38:46 gibba045 bash[25517]: cluster 2021-03-10T17:38:45.065027+0000 mgr.gibba045.orlgmj (mgr.34412) 12112 : cluster [DBG] pgmap v6906: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:48.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:38:48 gibba015 bash[29377]: cluster 2021-03-10T17:38:47.066870+0000 mgr.gibba045.orlgmj (mgr.34412) 12113 : cluster [DBG] pgmap v6907: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:48.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:38:48 gibba015 bash[30343]: cluster 2021-03-10T17:38:47.066870+0000 mgr.gibba045.orlgmj (mgr.34412) 12113 : cluster [DBG] pgmap v6907: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:48.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:38:48 gibba045 bash[25517]: cluster 2021-03-10T17:38:47.066870+0000 mgr.gibba045.orlgmj (mgr.34412) 12113 : cluster [DBG] pgmap v6907: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:50.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:38:50 gibba015 bash[29377]: cluster 2021-03-10T17:38:49.068108+0000 mgr.gibba045.orlgmj (mgr.34412) 12114 : cluster [DBG] pgmap v6908: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:50.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:38:50 gibba015 bash[30343]: cluster 2021-03-10T17:38:49.068108+0000 mgr.gibba045.orlgmj (mgr.34412) 12114 : cluster [DBG] pgmap v6908: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:50.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:38:50 gibba045 bash[25517]: cluster 2021-03-10T17:38:49.068108+0000 mgr.gibba045.orlgmj (mgr.34412) 12114 : cluster [DBG] pgmap v6908: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:52.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:38:52 gibba045 bash[25517]: cluster 2021-03-10T17:38:51.069806+0000 mgr.gibba045.orlgmj (mgr.34412) 12115 : cluster [DBG] pgmap v6909: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:52.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:38:52 gibba015 bash[29377]: cluster 2021-03-10T17:38:51.069806+0000 mgr.gibba045.orlgmj (mgr.34412) 12115 : cluster [DBG] pgmap v6909: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:52.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:38:52 gibba015 bash[30343]: cluster 2021-03-10T17:38:51.069806+0000 mgr.gibba045.orlgmj (mgr.34412) 12115 : cluster [DBG] pgmap v6909: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:54.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:38:54 gibba045 bash[25517]: cluster 2021-03-10T17:38:53.071406+0000 mgr.gibba045.orlgmj (mgr.34412) 12116 : cluster [DBG] pgmap v6910: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:54.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:38:54 gibba045 bash[25517]: audit 2021-03-10T17:38:54.157738+0000 mon.c (mon.1) 3317 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:38:54.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:38:54 gibba045 bash[25517]: audit 2021-03-10T17:38:54.158609+0000 mon.c (mon.1) 3318 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:38:54.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:38:54 gibba045 bash[25517]: audit 2021-03-10T17:38:54.158969+0000 mon.a (mon.0) 2503 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:38:54.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:38:54 gibba045 bash[25517]: audit 2021-03-10T17:38:54.160252+0000 mon.a (mon.0) 2504 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:38:54.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:38:54 gibba045 bash[25517]: audit 2021-03-10T17:38:54.270594+0000 mon.c (mon.1) 3319 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T17:38:54.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:38:54 gibba045 bash[25517]: audit 2021-03-10T17:38:54.271536+0000 mon.c (mon.1) 3320 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T17:38:54.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:38:54 gibba045 bash[25517]: audit 2021-03-10T17:38:54.272000+0000 mon.a (mon.0) 2505 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T17:38:54.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:38:54 gibba045 bash[25517]: audit 2021-03-10T17:38:54.272441+0000 mon.c (mon.1) 3321 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:38:54.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:38:54 gibba045 bash[25517]: audit 2021-03-10T17:38:54.273588+0000 mon.c (mon.1) 3322 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:38:54.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:38:54 gibba045 bash[25517]: audit 2021-03-10T17:38:54.274232+0000 mon.a (mon.0) 2506 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T17:38:54.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:38:54 gibba045 bash[25517]: audit 2021-03-10T17:38:54.275386+0000 mon.a (mon.0) 2507 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:38:54.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:38:54 gibba045 bash[25517]: audit 2021-03-10T17:38:54.276333+0000 mon.a (mon.0) 2508 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:38:54.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:38:54 gibba015 bash[29377]: cluster 2021-03-10T17:38:53.071406+0000 mgr.gibba045.orlgmj (mgr.34412) 12116 : cluster [DBG] pgmap v6910: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:54.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:38:54 gibba015 bash[29377]: audit 2021-03-10T17:38:54.157738+0000 mon.c (mon.1) 3317 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:38:54.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:38:54 gibba015 bash[29377]: audit 2021-03-10T17:38:54.158609+0000 mon.c (mon.1) 3318 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:38:54.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:38:54 gibba015 bash[29377]: audit 2021-03-10T17:38:54.158969+0000 mon.a (mon.0) 2503 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:38:54.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:38:54 gibba015 bash[29377]: audit 2021-03-10T17:38:54.160252+0000 mon.a (mon.0) 2504 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:38:54.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:38:54 gibba015 bash[29377]: audit 2021-03-10T17:38:54.270594+0000 mon.c (mon.1) 3319 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T17:38:54.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:38:54 gibba015 bash[29377]: audit 2021-03-10T17:38:54.271536+0000 mon.c (mon.1) 3320 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T17:38:54.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:38:54 gibba015 bash[29377]: audit 2021-03-10T17:38:54.272000+0000 mon.a (mon.0) 2505 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T17:38:54.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:38:54 gibba015 bash[29377]: audit 2021-03-10T17:38:54.272441+0000 mon.c (mon.1) 3321 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:38:54.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:38:54 gibba015 bash[29377]: audit 2021-03-10T17:38:54.273588+0000 mon.c (mon.1) 3322 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:38:54.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:38:54 gibba015 bash[29377]: audit 2021-03-10T17:38:54.274232+0000 mon.a (mon.0) 2506 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T17:38:54.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:38:54 gibba015 bash[29377]: audit 2021-03-10T17:38:54.275386+0000 mon.a (mon.0) 2507 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:38:54.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:38:54 gibba015 bash[29377]: audit 2021-03-10T17:38:54.276333+0000 mon.a (mon.0) 2508 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:38:54.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:38:54 gibba015 bash[30343]: cluster 2021-03-10T17:38:53.071406+0000 mgr.gibba045.orlgmj (mgr.34412) 12116 : cluster [DBG] pgmap v6910: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:54.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:38:54 gibba015 bash[30343]: audit 2021-03-10T17:38:54.157738+0000 mon.c (mon.1) 3317 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:38:54.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:38:54 gibba015 bash[30343]: audit 2021-03-10T17:38:54.158609+0000 mon.c (mon.1) 3318 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:38:54.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:38:54 gibba015 bash[30343]: audit 2021-03-10T17:38:54.158969+0000 mon.a (mon.0) 2503 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:38:54.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:38:54 gibba015 bash[30343]: audit 2021-03-10T17:38:54.160252+0000 mon.a (mon.0) 2504 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:38:54.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:38:54 gibba015 bash[30343]: audit 2021-03-10T17:38:54.270594+0000 mon.c (mon.1) 3319 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T17:38:54.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:38:54 gibba015 bash[30343]: audit 2021-03-10T17:38:54.271536+0000 mon.c (mon.1) 3320 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T17:38:54.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:38:54 gibba015 bash[30343]: audit 2021-03-10T17:38:54.272000+0000 mon.a (mon.0) 2505 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T17:38:54.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:38:54 gibba015 bash[30343]: audit 2021-03-10T17:38:54.272441+0000 mon.c (mon.1) 3321 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:38:54.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:38:54 gibba015 bash[30343]: audit 2021-03-10T17:38:54.273588+0000 mon.c (mon.1) 3322 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:38:54.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:38:54 gibba015 bash[30343]: audit 2021-03-10T17:38:54.274232+0000 mon.a (mon.0) 2506 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T17:38:54.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:38:54 gibba015 bash[30343]: audit 2021-03-10T17:38:54.275386+0000 mon.a (mon.0) 2507 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:38:54.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:38:54 gibba015 bash[30343]: audit 2021-03-10T17:38:54.276333+0000 mon.a (mon.0) 2508 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:38:55.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:38:55 gibba045 bash[25517]: audit 2021-03-10T17:38:55.370532+0000 mon.c (mon.1) 3323 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:38:55.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:38:55 gibba045 bash[25517]: audit 2021-03-10T17:38:55.378907+0000 mon.c (mon.1) 3324 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:38:55.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:38:55 gibba015 bash[29377]: audit 2021-03-10T17:38:55.370532+0000 mon.c (mon.1) 3323 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:38:55.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:38:55 gibba015 bash[29377]: audit 2021-03-10T17:38:55.378907+0000 mon.c (mon.1) 3324 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:38:55.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:38:55 gibba015 bash[30343]: audit 2021-03-10T17:38:55.370532+0000 mon.c (mon.1) 3323 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:38:55.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:38:55 gibba015 bash[30343]: audit 2021-03-10T17:38:55.378907+0000 mon.c (mon.1) 3324 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:38:56.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:38:56 gibba045 bash[25517]: cluster 2021-03-10T17:38:55.073158+0000 mgr.gibba045.orlgmj (mgr.34412) 12117 : cluster [DBG] pgmap v6911: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:56.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:38:56 gibba045 bash[25517]: cephadm 2021-03-10T17:38:55.378166+0000 mgr.gibba045.orlgmj (mgr.34412) 12118 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:38:56.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:38:56 gibba015 bash[29377]: cluster 2021-03-10T17:38:55.073158+0000 mgr.gibba045.orlgmj (mgr.34412) 12117 : cluster [DBG] pgmap v6911: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:56.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:38:56 gibba015 bash[29377]: cephadm 2021-03-10T17:38:55.378166+0000 mgr.gibba045.orlgmj (mgr.34412) 12118 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:38:56.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:38:56 gibba015 bash[30343]: cluster 2021-03-10T17:38:55.073158+0000 mgr.gibba045.orlgmj (mgr.34412) 12117 : cluster [DBG] pgmap v6911: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:56.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:38:56 gibba015 bash[30343]: cephadm 2021-03-10T17:38:55.378166+0000 mgr.gibba045.orlgmj (mgr.34412) 12118 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:38:58.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:38:58 gibba045 bash[25517]: cluster 2021-03-10T17:38:57.074910+0000 mgr.gibba045.orlgmj (mgr.34412) 12119 : cluster [DBG] pgmap v6912: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:58.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:38:58 gibba015 bash[29377]: cluster 2021-03-10T17:38:57.074910+0000 mgr.gibba045.orlgmj (mgr.34412) 12119 : cluster [DBG] pgmap v6912: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:58.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:38:58 gibba015 bash[30343]: cluster 2021-03-10T17:38:57.074910+0000 mgr.gibba045.orlgmj (mgr.34412) 12119 : cluster [DBG] pgmap v6912: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:00.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:39:00 gibba015 bash[29377]: audit 2021-03-10T17:38:59.052753+0000 mon.a (mon.0) 2509 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:39:00.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:39:00 gibba015 bash[29377]: cephadm 2021-03-10T17:38:59.055732+0000 mgr.gibba045.orlgmj (mgr.34412) 12120 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:39:00.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:39:00 gibba015 bash[29377]: cluster 2021-03-10T17:38:59.075508+0000 mgr.gibba045.orlgmj (mgr.34412) 12121 : cluster [DBG] pgmap v6913: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:00.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:39:00 gibba015 bash[29377]: audit 2021-03-10T17:38:59.276169+0000 mon.a (mon.0) 2510 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:39:00.474 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:39:00 gibba015 bash[29377]: audit 2021-03-10T17:38:59.280063+0000 mon.c (mon.1) 3325 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:39:00.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:39:00 gibba015 bash[29377]: cephadm 2021-03-10T17:38:59.281076+0000 mgr.gibba045.orlgmj (mgr.34412) 12122 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:39:00.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:39:00 gibba015 bash[29377]: audit 2021-03-10T17:38:59.281296+0000 mon.c (mon.1) 3326 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:39:00.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:39:00 gibba015 bash[29377]: audit 2021-03-10T17:38:59.282530+0000 mon.c (mon.1) 3327 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:39:00.475 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:39:00 gibba015 bash[29377]: cephadm 2021-03-10T17:38:59.282877+0000 mgr.gibba045.orlgmj (mgr.34412) 12123 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:39:00.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:39:00 gibba015 bash[29377]: audit 2021-03-10T17:38:59.283733+0000 mon.c (mon.1) 3328 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:39:00.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:39:00 gibba015 bash[29377]: cephadm 2021-03-10T17:38:59.283930+0000 mgr.gibba045.orlgmj (mgr.34412) 12124 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:39:00.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:39:00 gibba015 bash[29377]: cephadm 2021-03-10T17:38:59.284010+0000 mgr.gibba045.orlgmj (mgr.34412) 12125 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:39:00.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:39:00 gibba015 bash[29377]: cephadm 2021-03-10T17:38:59.285196+0000 mgr.gibba045.orlgmj (mgr.34412) 12126 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:39:00.476 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:39:00 gibba015 bash[29377]: cephadm 2021-03-10T17:38:59.285232+0000 mgr.gibba045.orlgmj (mgr.34412) 12127 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:39:00.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:39:00 gibba015 bash[29377]: cephadm 2021-03-10T17:38:59.286365+0000 mgr.gibba045.orlgmj (mgr.34412) 12128 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:39:00.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:39:00 gibba015 bash[29377]: audit 2021-03-10T17:38:59.286563+0000 mon.c (mon.1) 3329 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:39:00.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:39:00 gibba015 bash[29377]: cephadm 2021-03-10T17:38:59.287850+0000 mgr.gibba045.orlgmj (mgr.34412) 12129 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:39:00.477 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:39:00 gibba015 bash[29377]: audit 2021-03-10T17:38:59.287862+0000 mon.c (mon.1) 3330 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:39:00.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:39:00 gibba015 bash[29377]: cephadm 2021-03-10T17:38:59.287887+0000 mgr.gibba045.orlgmj (mgr.34412) 12130 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:39:00.478 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:39:00 gibba015 bash[29377]: cephadm 2021-03-10T17:38:59.289079+0000 mgr.gibba045.orlgmj (mgr.34412) 12131 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:39:00.478 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:39:00 gibba015 bash[30343]: audit 2021-03-10T17:38:59.052753+0000 mon.a (mon.0) 2509 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:39:00.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:39:00 gibba015 bash[30343]: cephadm 2021-03-10T17:38:59.055732+0000 mgr.gibba045.orlgmj (mgr.34412) 12120 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:39:00.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:39:00 gibba015 bash[30343]: cluster 2021-03-10T17:38:59.075508+0000 mgr.gibba045.orlgmj (mgr.34412) 12121 : cluster [DBG] pgmap v6913: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:00.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:39:00 gibba015 bash[30343]: audit 2021-03-10T17:38:59.276169+0000 mon.a (mon.0) 2510 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:39:00.479 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:39:00 gibba015 bash[30343]: audit 2021-03-10T17:38:59.280063+0000 mon.c (mon.1) 3325 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:39:00.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:39:00 gibba015 bash[30343]: cephadm 2021-03-10T17:38:59.281076+0000 mgr.gibba045.orlgmj (mgr.34412) 12122 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:39:00.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:39:00 gibba015 bash[30343]: audit 2021-03-10T17:38:59.281296+0000 mon.c (mon.1) 3326 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:39:00.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:39:00 gibba015 bash[30343]: audit 2021-03-10T17:38:59.282530+0000 mon.c (mon.1) 3327 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:39:00.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:39:00 gibba015 bash[30343]: cephadm 2021-03-10T17:38:59.282877+0000 mgr.gibba045.orlgmj (mgr.34412) 12123 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:39:00.480 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:39:00 gibba015 bash[30343]: audit 2021-03-10T17:38:59.283733+0000 mon.c (mon.1) 3328 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:39:00.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:39:00 gibba015 bash[30343]: cephadm 2021-03-10T17:38:59.283930+0000 mgr.gibba045.orlgmj (mgr.34412) 12124 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:39:00.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:39:00 gibba015 bash[30343]: cephadm 2021-03-10T17:38:59.284010+0000 mgr.gibba045.orlgmj (mgr.34412) 12125 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:39:00.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:39:00 gibba015 bash[30343]: cephadm 2021-03-10T17:38:59.285196+0000 mgr.gibba045.orlgmj (mgr.34412) 12126 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:39:00.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:39:00 gibba015 bash[30343]: cephadm 2021-03-10T17:38:59.285232+0000 mgr.gibba045.orlgmj (mgr.34412) 12127 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:39:00.481 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:39:00 gibba015 bash[30343]: cephadm 2021-03-10T17:38:59.286365+0000 mgr.gibba045.orlgmj (mgr.34412) 12128 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:39:00.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:39:00 gibba015 bash[30343]: audit 2021-03-10T17:38:59.286563+0000 mon.c (mon.1) 3329 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:39:00.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:39:00 gibba015 bash[30343]: cephadm 2021-03-10T17:38:59.287850+0000 mgr.gibba045.orlgmj (mgr.34412) 12129 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:39:00.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:39:00 gibba015 bash[30343]: audit 2021-03-10T17:38:59.287862+0000 mon.c (mon.1) 3330 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:39:00.482 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:39:00 gibba015 bash[30343]: cephadm 2021-03-10T17:38:59.287887+0000 mgr.gibba045.orlgmj (mgr.34412) 12130 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:39:00.483 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:39:00 gibba015 bash[30343]: cephadm 2021-03-10T17:38:59.289079+0000 mgr.gibba045.orlgmj (mgr.34412) 12131 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:39:00.483 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:39:00 gibba015 bash[29377]: cephadm 2021-03-10T17:38:59.289394+0000 mgr.gibba045.orlgmj (mgr.34412) 12132 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:39:00.483 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:39:00 gibba015 bash[29377]: cephadm 2021-03-10T17:38:59.290459+0000 mgr.gibba045.orlgmj (mgr.34412) 12133 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:39:00.484 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:39:00 gibba015 bash[29377]: cephadm 2021-03-10T17:38:59.290497+0000 mgr.gibba045.orlgmj (mgr.34412) 12134 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:39:00.484 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:39:00 gibba015 bash[29377]: cephadm 2021-03-10T17:38:59.290603+0000 mgr.gibba045.orlgmj (mgr.34412) 12135 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:39:00.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:39:00 gibba015 bash[30343]: cephadm 2021-03-10T17:38:59.289394+0000 mgr.gibba045.orlgmj (mgr.34412) 12132 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:39:00.484 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:39:00 gibba015 bash[30343]: cephadm 2021-03-10T17:38:59.290459+0000 mgr.gibba045.orlgmj (mgr.34412) 12133 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:39:00.485 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:39:00 gibba015 bash[30343]: cephadm 2021-03-10T17:38:59.290497+0000 mgr.gibba045.orlgmj (mgr.34412) 12134 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:39:00.485 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:39:00 gibba015 bash[30343]: cephadm 2021-03-10T17:38:59.290603+0000 mgr.gibba045.orlgmj (mgr.34412) 12135 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:39:00.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:39:00 gibba045 bash[25517]: audit 2021-03-10T17:38:59.052753+0000 mon.a (mon.0) 2509 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:39:00.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:39:00 gibba045 bash[25517]: cephadm 2021-03-10T17:38:59.055732+0000 mgr.gibba045.orlgmj (mgr.34412) 12120 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:39:00.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:39:00 gibba045 bash[25517]: cluster 2021-03-10T17:38:59.075508+0000 mgr.gibba045.orlgmj (mgr.34412) 12121 : cluster [DBG] pgmap v6913: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:00.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:39:00 gibba045 bash[25517]: audit 2021-03-10T17:38:59.276169+0000 mon.a (mon.0) 2510 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:39:00.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:39:00 gibba045 bash[25517]: audit 2021-03-10T17:38:59.280063+0000 mon.c (mon.1) 3325 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:39:00.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:39:00 gibba045 bash[25517]: cephadm 2021-03-10T17:38:59.281076+0000 mgr.gibba045.orlgmj (mgr.34412) 12122 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:39:00.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:39:00 gibba045 bash[25517]: audit 2021-03-10T17:38:59.281296+0000 mon.c (mon.1) 3326 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:39:00.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:39:00 gibba045 bash[25517]: audit 2021-03-10T17:38:59.282530+0000 mon.c (mon.1) 3327 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:39:00.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:39:00 gibba045 bash[25517]: cephadm 2021-03-10T17:38:59.282877+0000 mgr.gibba045.orlgmj (mgr.34412) 12123 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:39:00.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:39:00 gibba045 bash[25517]: audit 2021-03-10T17:38:59.283733+0000 mon.c (mon.1) 3328 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:39:00.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:39:00 gibba045 bash[25517]: cephadm 2021-03-10T17:38:59.283930+0000 mgr.gibba045.orlgmj (mgr.34412) 12124 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:39:00.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:39:00 gibba045 bash[25517]: cephadm 2021-03-10T17:38:59.284010+0000 mgr.gibba045.orlgmj (mgr.34412) 12125 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:39:00.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:39:00 gibba045 bash[25517]: cephadm 2021-03-10T17:38:59.285196+0000 mgr.gibba045.orlgmj (mgr.34412) 12126 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:39:00.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:39:00 gibba045 bash[25517]: cephadm 2021-03-10T17:38:59.285232+0000 mgr.gibba045.orlgmj (mgr.34412) 12127 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:39:00.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:39:00 gibba045 bash[25517]: cephadm 2021-03-10T17:38:59.286365+0000 mgr.gibba045.orlgmj (mgr.34412) 12128 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:39:00.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:39:00 gibba045 bash[25517]: audit 2021-03-10T17:38:59.286563+0000 mon.c (mon.1) 3329 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:39:00.561 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:39:00 gibba045 bash[25517]: cephadm 2021-03-10T17:38:59.287850+0000 mgr.gibba045.orlgmj (mgr.34412) 12129 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:39:00.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:39:00 gibba045 bash[25517]: audit 2021-03-10T17:38:59.287862+0000 mon.c (mon.1) 3330 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:39:00.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:39:00 gibba045 bash[25517]: cephadm 2021-03-10T17:38:59.287887+0000 mgr.gibba045.orlgmj (mgr.34412) 12130 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:39:00.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:39:00 gibba045 bash[25517]: cephadm 2021-03-10T17:38:59.289079+0000 mgr.gibba045.orlgmj (mgr.34412) 12131 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:39:00.562 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:39:00 gibba045 bash[25517]: cephadm 2021-03-10T17:38:59.289394+0000 mgr.gibba045.orlgmj (mgr.34412) 12132 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:39:00.563 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:39:00 gibba045 bash[25517]: cephadm 2021-03-10T17:38:59.290459+0000 mgr.gibba045.orlgmj (mgr.34412) 12133 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:39:00.563 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:39:00 gibba045 bash[25517]: cephadm 2021-03-10T17:38:59.290497+0000 mgr.gibba045.orlgmj (mgr.34412) 12134 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:39:00.563 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:39:00 gibba045 bash[25517]: cephadm 2021-03-10T17:38:59.290603+0000 mgr.gibba045.orlgmj (mgr.34412) 12135 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:39:02.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:39:02 gibba015 bash[29377]: cluster 2021-03-10T17:39:01.077252+0000 mgr.gibba045.orlgmj (mgr.34412) 12136 : cluster [DBG] pgmap v6914: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:02.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:39:02 gibba015 bash[30343]: cluster 2021-03-10T17:39:01.077252+0000 mgr.gibba045.orlgmj (mgr.34412) 12136 : cluster [DBG] pgmap v6914: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:02.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:39:02 gibba045 bash[25517]: cluster 2021-03-10T17:39:01.077252+0000 mgr.gibba045.orlgmj (mgr.34412) 12136 : cluster [DBG] pgmap v6914: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:04.556 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:39:04 gibba045 bash[25517]: cluster 2021-03-10T17:39:03.078958+0000 mgr.gibba045.orlgmj (mgr.34412) 12137 : cluster [DBG] pgmap v6915: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:04.582 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:39:04.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:39:04 gibba015 bash[29377]: cluster 2021-03-10T17:39:03.078958+0000 mgr.gibba045.orlgmj (mgr.34412) 12137 : cluster [DBG] pgmap v6915: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:04.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:39:04 gibba015 bash[30343]: cluster 2021-03-10T17:39:03.078958+0000 mgr.gibba045.orlgmj (mgr.34412) 12137 : cluster [DBG] pgmap v6915: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:04.816 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:39:04.816 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 69s ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:39:04.817 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 5s ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:39:04.817 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 5s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:39:04.817 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 5s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:39:04.817 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 69s ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:39:04.818 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 69s ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:39:04.818 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 5s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:39:04.818 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 69s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:39:04.818 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 69s ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:39:04.818 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 5s ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:39:04.819 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 69s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:39:04.819 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 69s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:39:04.819 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 69s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:39:04.819 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 69s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:39:04.820 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 5s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:39:04.820 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 5s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:39:04.820 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 5s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:39:04.821 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 5s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:39:04.821 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 5s ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:39:04.821 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 5s ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:39:05.064 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:39:05.065 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:39:05.065 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:39:05.065 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:39:05.065 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:39:05.066 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:39:05.066 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:39:05.066 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:39:05.066 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:39:05.067 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:39:05.067 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:39:05.067 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:39:05.067 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:39:05.067 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:39:05.068 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:39:05.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:39:05 gibba045 bash[25517]: audit 2021-03-10T17:39:04.571397+0000 mgr.gibba045.orlgmj (mgr.34412) 12138 : audit [DBG] from='client.52188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:39:05.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:39:05 gibba045 bash[25517]: audit 2021-03-10T17:39:04.802935+0000 mgr.gibba045.orlgmj (mgr.34412) 12139 : audit [DBG] from='client.62179 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:39:05.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:39:05 gibba045 bash[25517]: audit 2021-03-10T17:39:05.062026+0000 mon.c (mon.1) 3331 : audit [DBG] from='client.? 172.21.2.115:0/2471758060' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:39:05.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:39:05 gibba015 bash[29377]: audit 2021-03-10T17:39:04.571397+0000 mgr.gibba045.orlgmj (mgr.34412) 12138 : audit [DBG] from='client.52188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:39:05.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:39:05 gibba015 bash[29377]: audit 2021-03-10T17:39:04.802935+0000 mgr.gibba045.orlgmj (mgr.34412) 12139 : audit [DBG] from='client.62179 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:39:05.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:39:05 gibba015 bash[29377]: audit 2021-03-10T17:39:05.062026+0000 mon.c (mon.1) 3331 : audit [DBG] from='client.? 172.21.2.115:0/2471758060' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:39:05.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:39:05 gibba015 bash[30343]: audit 2021-03-10T17:39:04.571397+0000 mgr.gibba045.orlgmj (mgr.34412) 12138 : audit [DBG] from='client.52188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:39:05.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:39:05 gibba015 bash[30343]: audit 2021-03-10T17:39:04.802935+0000 mgr.gibba045.orlgmj (mgr.34412) 12139 : audit [DBG] from='client.62179 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:39:05.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:39:05 gibba015 bash[30343]: audit 2021-03-10T17:39:05.062026+0000 mon.c (mon.1) 3331 : audit [DBG] from='client.? 172.21.2.115:0/2471758060' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:39:06.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:39:06 gibba045 bash[25517]: cluster 2021-03-10T17:39:05.080535+0000 mgr.gibba045.orlgmj (mgr.34412) 12140 : cluster [DBG] pgmap v6916: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:06.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:39:06 gibba015 bash[29377]: cluster 2021-03-10T17:39:05.080535+0000 mgr.gibba045.orlgmj (mgr.34412) 12140 : cluster [DBG] pgmap v6916: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:06.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:39:06 gibba015 bash[30343]: cluster 2021-03-10T17:39:05.080535+0000 mgr.gibba045.orlgmj (mgr.34412) 12140 : cluster [DBG] pgmap v6916: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:08.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:39:08 gibba045 bash[25517]: cluster 2021-03-10T17:39:07.081989+0000 mgr.gibba045.orlgmj (mgr.34412) 12141 : cluster [DBG] pgmap v6917: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:08.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:39:08 gibba015 bash[29377]: cluster 2021-03-10T17:39:07.081989+0000 mgr.gibba045.orlgmj (mgr.34412) 12141 : cluster [DBG] pgmap v6917: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:08.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:39:08 gibba015 bash[30343]: cluster 2021-03-10T17:39:07.081989+0000 mgr.gibba045.orlgmj (mgr.34412) 12141 : cluster [DBG] pgmap v6917: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:10.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:39:10 gibba045 bash[25517]: cluster 2021-03-10T17:39:09.083210+0000 mgr.gibba045.orlgmj (mgr.34412) 12142 : cluster [DBG] pgmap v6918: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:10.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:39:10 gibba015 bash[29377]: cluster 2021-03-10T17:39:09.083210+0000 mgr.gibba045.orlgmj (mgr.34412) 12142 : cluster [DBG] pgmap v6918: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:10.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:39:10 gibba015 bash[30343]: cluster 2021-03-10T17:39:09.083210+0000 mgr.gibba045.orlgmj (mgr.34412) 12142 : cluster [DBG] pgmap v6918: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:12.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:39:12 gibba045 bash[25517]: cluster 2021-03-10T17:39:11.084860+0000 mgr.gibba045.orlgmj (mgr.34412) 12143 : cluster [DBG] pgmap v6919: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:12.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:39:12 gibba015 bash[29377]: cluster 2021-03-10T17:39:11.084860+0000 mgr.gibba045.orlgmj (mgr.34412) 12143 : cluster [DBG] pgmap v6919: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:12.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:39:12 gibba015 bash[30343]: cluster 2021-03-10T17:39:11.084860+0000 mgr.gibba045.orlgmj (mgr.34412) 12143 : cluster [DBG] pgmap v6919: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:14.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:39:14 gibba015 bash[29377]: cluster 2021-03-10T17:39:13.086540+0000 mgr.gibba045.orlgmj (mgr.34412) 12144 : cluster [DBG] pgmap v6920: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:14.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:39:14 gibba015 bash[30343]: cluster 2021-03-10T17:39:13.086540+0000 mgr.gibba045.orlgmj (mgr.34412) 12144 : cluster [DBG] pgmap v6920: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:14.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:39:14 gibba045 bash[25517]: cluster 2021-03-10T17:39:13.086540+0000 mgr.gibba045.orlgmj (mgr.34412) 12144 : cluster [DBG] pgmap v6920: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:15.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:39:15 gibba015 bash[29377]: cephadm 2021-03-10T17:39:14.305916+0000 mgr.gibba045.orlgmj (mgr.34412) 12145 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:39:15.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:39:15 gibba015 bash[30343]: cephadm 2021-03-10T17:39:14.305916+0000 mgr.gibba045.orlgmj (mgr.34412) 12145 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:39:15.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:39:15 gibba045 bash[25517]: cephadm 2021-03-10T17:39:14.305916+0000 mgr.gibba045.orlgmj (mgr.34412) 12145 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:39:16.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:39:16 gibba015 bash[29377]: cluster 2021-03-10T17:39:15.088206+0000 mgr.gibba045.orlgmj (mgr.34412) 12146 : cluster [DBG] pgmap v6921: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:16.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:39:16 gibba015 bash[30343]: cluster 2021-03-10T17:39:15.088206+0000 mgr.gibba045.orlgmj (mgr.34412) 12146 : cluster [DBG] pgmap v6921: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:16.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:39:16 gibba045 bash[25517]: cluster 2021-03-10T17:39:15.088206+0000 mgr.gibba045.orlgmj (mgr.34412) 12146 : cluster [DBG] pgmap v6921: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:18.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:39:18 gibba015 bash[29377]: cluster 2021-03-10T17:39:17.090000+0000 mgr.gibba045.orlgmj (mgr.34412) 12147 : cluster [DBG] pgmap v6922: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:18.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:39:18 gibba015 bash[30343]: cluster 2021-03-10T17:39:17.090000+0000 mgr.gibba045.orlgmj (mgr.34412) 12147 : cluster [DBG] pgmap v6922: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:18.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:39:18 gibba045 bash[25517]: cluster 2021-03-10T17:39:17.090000+0000 mgr.gibba045.orlgmj (mgr.34412) 12147 : cluster [DBG] pgmap v6922: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:20.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:39:20 gibba015 bash[29377]: cluster 2021-03-10T17:39:19.091159+0000 mgr.gibba045.orlgmj (mgr.34412) 12148 : cluster [DBG] pgmap v6923: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:20.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:39:20 gibba015 bash[30343]: cluster 2021-03-10T17:39:19.091159+0000 mgr.gibba045.orlgmj (mgr.34412) 12148 : cluster [DBG] pgmap v6923: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:20.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:39:20 gibba045 bash[25517]: cluster 2021-03-10T17:39:19.091159+0000 mgr.gibba045.orlgmj (mgr.34412) 12148 : cluster [DBG] pgmap v6923: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:22.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:39:22 gibba015 bash[29377]: cluster 2021-03-10T17:39:21.092809+0000 mgr.gibba045.orlgmj (mgr.34412) 12149 : cluster [DBG] pgmap v6924: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:22.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:39:22 gibba015 bash[30343]: cluster 2021-03-10T17:39:21.092809+0000 mgr.gibba045.orlgmj (mgr.34412) 12149 : cluster [DBG] pgmap v6924: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:22.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:39:22 gibba045 bash[25517]: cluster 2021-03-10T17:39:21.092809+0000 mgr.gibba045.orlgmj (mgr.34412) 12149 : cluster [DBG] pgmap v6924: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:24.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:39:24 gibba015 bash[29377]: cluster 2021-03-10T17:39:23.094216+0000 mgr.gibba045.orlgmj (mgr.34412) 12150 : cluster [DBG] pgmap v6925: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:24.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:39:24 gibba015 bash[30343]: cluster 2021-03-10T17:39:23.094216+0000 mgr.gibba045.orlgmj (mgr.34412) 12150 : cluster [DBG] pgmap v6925: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:24.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:39:24 gibba045 bash[25517]: cluster 2021-03-10T17:39:23.094216+0000 mgr.gibba045.orlgmj (mgr.34412) 12150 : cluster [DBG] pgmap v6925: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:26.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:39:26 gibba015 bash[29377]: cluster 2021-03-10T17:39:25.095713+0000 mgr.gibba045.orlgmj (mgr.34412) 12151 : cluster [DBG] pgmap v6926: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:26.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:39:26 gibba015 bash[30343]: cluster 2021-03-10T17:39:25.095713+0000 mgr.gibba045.orlgmj (mgr.34412) 12151 : cluster [DBG] pgmap v6926: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:26.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:39:26 gibba045 bash[25517]: cluster 2021-03-10T17:39:25.095713+0000 mgr.gibba045.orlgmj (mgr.34412) 12151 : cluster [DBG] pgmap v6926: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:28.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:39:28 gibba015 bash[29377]: cluster 2021-03-10T17:39:27.097464+0000 mgr.gibba045.orlgmj (mgr.34412) 12152 : cluster [DBG] pgmap v6927: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:28.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:39:28 gibba015 bash[30343]: cluster 2021-03-10T17:39:27.097464+0000 mgr.gibba045.orlgmj (mgr.34412) 12152 : cluster [DBG] pgmap v6927: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:28.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:39:28 gibba045 bash[25517]: cluster 2021-03-10T17:39:27.097464+0000 mgr.gibba045.orlgmj (mgr.34412) 12152 : cluster [DBG] pgmap v6927: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:30.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:39:30 gibba015 bash[29377]: cluster 2021-03-10T17:39:29.098717+0000 mgr.gibba045.orlgmj (mgr.34412) 12153 : cluster [DBG] pgmap v6928: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:30.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:39:30 gibba015 bash[29377]: cephadm 2021-03-10T17:39:29.321725+0000 mgr.gibba045.orlgmj (mgr.34412) 12154 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:39:30.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:39:30 gibba015 bash[30343]: cluster 2021-03-10T17:39:29.098717+0000 mgr.gibba045.orlgmj (mgr.34412) 12153 : cluster [DBG] pgmap v6928: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:30.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:39:30 gibba015 bash[30343]: cephadm 2021-03-10T17:39:29.321725+0000 mgr.gibba045.orlgmj (mgr.34412) 12154 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:39:30.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:39:30 gibba045 bash[25517]: cluster 2021-03-10T17:39:29.098717+0000 mgr.gibba045.orlgmj (mgr.34412) 12153 : cluster [DBG] pgmap v6928: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:30.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:39:30 gibba045 bash[25517]: cephadm 2021-03-10T17:39:29.321725+0000 mgr.gibba045.orlgmj (mgr.34412) 12154 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:39:32.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:39:32 gibba015 bash[29377]: cluster 2021-03-10T17:39:31.100481+0000 mgr.gibba045.orlgmj (mgr.34412) 12155 : cluster [DBG] pgmap v6929: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:32.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:39:32 gibba015 bash[30343]: cluster 2021-03-10T17:39:31.100481+0000 mgr.gibba045.orlgmj (mgr.34412) 12155 : cluster [DBG] pgmap v6929: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:32.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:39:32 gibba045 bash[25517]: cluster 2021-03-10T17:39:31.100481+0000 mgr.gibba045.orlgmj (mgr.34412) 12155 : cluster [DBG] pgmap v6929: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:34.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:39:34 gibba015 bash[29377]: cluster 2021-03-10T17:39:33.102203+0000 mgr.gibba045.orlgmj (mgr.34412) 12156 : cluster [DBG] pgmap v6930: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:34.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:39:34 gibba015 bash[30343]: cluster 2021-03-10T17:39:33.102203+0000 mgr.gibba045.orlgmj (mgr.34412) 12156 : cluster [DBG] pgmap v6930: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:34.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:39:34 gibba045 bash[25517]: cluster 2021-03-10T17:39:33.102203+0000 mgr.gibba045.orlgmj (mgr.34412) 12156 : cluster [DBG] pgmap v6930: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:35.308 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:39:35.537 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:39:35.538 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 100s ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:39:35.538 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 36s ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:39:35.538 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 36s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:39:35.538 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 36s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:39:35.539 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 100s ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:39:35.539 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 100s ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:39:35.539 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 36s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:39:35.539 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 100s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:39:35.539 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 100s ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:39:35.540 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 36s ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:39:35.540 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 100s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:39:35.540 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 100s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:39:35.540 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 100s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:39:35.541 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 100s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:39:35.541 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 36s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:39:35.541 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 36s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:39:35.541 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 36s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:39:35.541 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 36s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:39:35.542 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 36s ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:39:35.542 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 36s ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:39:35.791 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:39:35.791 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:39:35.791 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:39:35.792 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:39:35.792 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:39:35.792 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:39:35.792 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:39:35.793 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:39:35.793 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:39:35.793 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:39:35.793 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:39:35.793 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:39:35.794 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:39:35.794 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:39:35.794 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:39:36.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:39:36 gibba015 bash[29377]: cluster 2021-03-10T17:39:35.103707+0000 mgr.gibba045.orlgmj (mgr.34412) 12157 : cluster [DBG] pgmap v6931: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:36.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:39:36 gibba015 bash[29377]: audit 2021-03-10T17:39:35.298960+0000 mgr.gibba045.orlgmj (mgr.34412) 12158 : audit [DBG] from='client.62191 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:39:36.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:39:36 gibba015 bash[29377]: audit 2021-03-10T17:39:35.524346+0000 mgr.gibba045.orlgmj (mgr.34412) 12159 : audit [DBG] from='client.62197 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:39:36.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:39:36 gibba015 bash[29377]: audit 2021-03-10T17:39:35.788304+0000 mon.c (mon.1) 3332 : audit [DBG] from='client.? 172.21.2.115:0/3338958382' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:39:36.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:39:36 gibba015 bash[30343]: cluster 2021-03-10T17:39:35.103707+0000 mgr.gibba045.orlgmj (mgr.34412) 12157 : cluster [DBG] pgmap v6931: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:36.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:39:36 gibba015 bash[30343]: audit 2021-03-10T17:39:35.298960+0000 mgr.gibba045.orlgmj (mgr.34412) 12158 : audit [DBG] from='client.62191 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:39:36.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:39:36 gibba015 bash[30343]: audit 2021-03-10T17:39:35.524346+0000 mgr.gibba045.orlgmj (mgr.34412) 12159 : audit [DBG] from='client.62197 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:39:36.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:39:36 gibba015 bash[30343]: audit 2021-03-10T17:39:35.788304+0000 mon.c (mon.1) 3332 : audit [DBG] from='client.? 172.21.2.115:0/3338958382' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:39:36.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:39:36 gibba045 bash[25517]: cluster 2021-03-10T17:39:35.103707+0000 mgr.gibba045.orlgmj (mgr.34412) 12157 : cluster [DBG] pgmap v6931: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:36.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:39:36 gibba045 bash[25517]: audit 2021-03-10T17:39:35.298960+0000 mgr.gibba045.orlgmj (mgr.34412) 12158 : audit [DBG] from='client.62191 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:39:36.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:39:36 gibba045 bash[25517]: audit 2021-03-10T17:39:35.524346+0000 mgr.gibba045.orlgmj (mgr.34412) 12159 : audit [DBG] from='client.62197 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:39:36.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:39:36 gibba045 bash[25517]: audit 2021-03-10T17:39:35.788304+0000 mon.c (mon.1) 3332 : audit [DBG] from='client.? 172.21.2.115:0/3338958382' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:39:38.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:39:38 gibba015 bash[29377]: cluster 2021-03-10T17:39:37.105557+0000 mgr.gibba045.orlgmj (mgr.34412) 12160 : cluster [DBG] pgmap v6932: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:38.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:39:38 gibba015 bash[30343]: cluster 2021-03-10T17:39:37.105557+0000 mgr.gibba045.orlgmj (mgr.34412) 12160 : cluster [DBG] pgmap v6932: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:38.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:39:38 gibba045 bash[25517]: cluster 2021-03-10T17:39:37.105557+0000 mgr.gibba045.orlgmj (mgr.34412) 12160 : cluster [DBG] pgmap v6932: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:40.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:39:40 gibba015 bash[29377]: cluster 2021-03-10T17:39:39.106824+0000 mgr.gibba045.orlgmj (mgr.34412) 12161 : cluster [DBG] pgmap v6933: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:40.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:39:40 gibba015 bash[30343]: cluster 2021-03-10T17:39:39.106824+0000 mgr.gibba045.orlgmj (mgr.34412) 12161 : cluster [DBG] pgmap v6933: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:40.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:39:40 gibba045 bash[25517]: cluster 2021-03-10T17:39:39.106824+0000 mgr.gibba045.orlgmj (mgr.34412) 12161 : cluster [DBG] pgmap v6933: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:42.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:39:42 gibba015 bash[29377]: cluster 2021-03-10T17:39:41.108611+0000 mgr.gibba045.orlgmj (mgr.34412) 12162 : cluster [DBG] pgmap v6934: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:42.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:39:42 gibba015 bash[30343]: cluster 2021-03-10T17:39:41.108611+0000 mgr.gibba045.orlgmj (mgr.34412) 12162 : cluster [DBG] pgmap v6934: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:42.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:39:42 gibba045 bash[25517]: cluster 2021-03-10T17:39:41.108611+0000 mgr.gibba045.orlgmj (mgr.34412) 12162 : cluster [DBG] pgmap v6934: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:44.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:39:44 gibba015 bash[29377]: cluster 2021-03-10T17:39:43.110199+0000 mgr.gibba045.orlgmj (mgr.34412) 12163 : cluster [DBG] pgmap v6935: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:44.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:39:44 gibba015 bash[30343]: cluster 2021-03-10T17:39:43.110199+0000 mgr.gibba045.orlgmj (mgr.34412) 12163 : cluster [DBG] pgmap v6935: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:44.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:39:44 gibba045 bash[25517]: cluster 2021-03-10T17:39:43.110199+0000 mgr.gibba045.orlgmj (mgr.34412) 12163 : cluster [DBG] pgmap v6935: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:45.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:39:45 gibba015 bash[29377]: cephadm 2021-03-10T17:39:44.337214+0000 mgr.gibba045.orlgmj (mgr.34412) 12164 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:39:45.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:39:45 gibba015 bash[30343]: cephadm 2021-03-10T17:39:44.337214+0000 mgr.gibba045.orlgmj (mgr.34412) 12164 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:39:45.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:39:45 gibba045 bash[25517]: cephadm 2021-03-10T17:39:44.337214+0000 mgr.gibba045.orlgmj (mgr.34412) 12164 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:39:46.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:39:46 gibba015 bash[29377]: cluster 2021-03-10T17:39:45.112000+0000 mgr.gibba045.orlgmj (mgr.34412) 12165 : cluster [DBG] pgmap v6936: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:46.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:39:46 gibba015 bash[30343]: cluster 2021-03-10T17:39:45.112000+0000 mgr.gibba045.orlgmj (mgr.34412) 12165 : cluster [DBG] pgmap v6936: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:46.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:39:46 gibba045 bash[25517]: cluster 2021-03-10T17:39:45.112000+0000 mgr.gibba045.orlgmj (mgr.34412) 12165 : cluster [DBG] pgmap v6936: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:48.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:39:48 gibba015 bash[29377]: cluster 2021-03-10T17:39:47.113930+0000 mgr.gibba045.orlgmj (mgr.34412) 12166 : cluster [DBG] pgmap v6937: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:48.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:39:48 gibba015 bash[30343]: cluster 2021-03-10T17:39:47.113930+0000 mgr.gibba045.orlgmj (mgr.34412) 12166 : cluster [DBG] pgmap v6937: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:48.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:39:48 gibba045 bash[25517]: cluster 2021-03-10T17:39:47.113930+0000 mgr.gibba045.orlgmj (mgr.34412) 12166 : cluster [DBG] pgmap v6937: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:50.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:39:50 gibba045 bash[25517]: cluster 2021-03-10T17:39:49.115281+0000 mgr.gibba045.orlgmj (mgr.34412) 12167 : cluster [DBG] pgmap v6938: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:50.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:39:50 gibba015 bash[29377]: cluster 2021-03-10T17:39:49.115281+0000 mgr.gibba045.orlgmj (mgr.34412) 12167 : cluster [DBG] pgmap v6938: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:50.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:39:50 gibba015 bash[30343]: cluster 2021-03-10T17:39:49.115281+0000 mgr.gibba045.orlgmj (mgr.34412) 12167 : cluster [DBG] pgmap v6938: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:52.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:39:52 gibba045 bash[25517]: cluster 2021-03-10T17:39:51.117133+0000 mgr.gibba045.orlgmj (mgr.34412) 12168 : cluster [DBG] pgmap v6939: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:52.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:39:52 gibba015 bash[29377]: cluster 2021-03-10T17:39:51.117133+0000 mgr.gibba045.orlgmj (mgr.34412) 12168 : cluster [DBG] pgmap v6939: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:52.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:39:52 gibba015 bash[30343]: cluster 2021-03-10T17:39:51.117133+0000 mgr.gibba045.orlgmj (mgr.34412) 12168 : cluster [DBG] pgmap v6939: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:54.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:39:54 gibba045 bash[25517]: cluster 2021-03-10T17:39:53.118541+0000 mgr.gibba045.orlgmj (mgr.34412) 12169 : cluster [DBG] pgmap v6940: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:54.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:39:54 gibba045 bash[25517]: audit 2021-03-10T17:39:54.165190+0000 mon.c (mon.1) 3333 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:39:54.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:39:54 gibba045 bash[25517]: audit 2021-03-10T17:39:54.166254+0000 mon.a (mon.0) 2511 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:39:54.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:39:54 gibba045 bash[25517]: audit 2021-03-10T17:39:54.166669+0000 mon.c (mon.1) 3334 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:39:54.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:39:54 gibba045 bash[25517]: audit 2021-03-10T17:39:54.167799+0000 mon.a (mon.0) 2512 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:39:54.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:39:54 gibba045 bash[25517]: audit 2021-03-10T17:39:54.282470+0000 mon.c (mon.1) 3335 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T17:39:54.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:39:54 gibba045 bash[25517]: audit 2021-03-10T17:39:54.283279+0000 mon.c (mon.1) 3336 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:39:54.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:39:54 gibba045 bash[25517]: audit 2021-03-10T17:39:54.283681+0000 mon.a (mon.0) 2513 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T17:39:54.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:39:54 gibba045 bash[25517]: audit 2021-03-10T17:39:54.284303+0000 mon.c (mon.1) 3337 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:39:54.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:39:54 gibba045 bash[25517]: audit 2021-03-10T17:39:54.284931+0000 mon.a (mon.0) 2514 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:39:54.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:39:54 gibba045 bash[25517]: audit 2021-03-10T17:39:54.285652+0000 mon.c (mon.1) 3338 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:39:54.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:39:54 gibba045 bash[25517]: audit 2021-03-10T17:39:54.285815+0000 mon.a (mon.0) 2515 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:39:54.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:39:54 gibba045 bash[25517]: audit 2021-03-10T17:39:54.287293+0000 mon.a (mon.0) 2516 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:39:54.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:39:54 gibba015 bash[29377]: cluster 2021-03-10T17:39:53.118541+0000 mgr.gibba045.orlgmj (mgr.34412) 12169 : cluster [DBG] pgmap v6940: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:54.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:39:54 gibba015 bash[29377]: audit 2021-03-10T17:39:54.165190+0000 mon.c (mon.1) 3333 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:39:54.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:39:54 gibba015 bash[29377]: audit 2021-03-10T17:39:54.166254+0000 mon.a (mon.0) 2511 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:39:54.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:39:54 gibba015 bash[29377]: audit 2021-03-10T17:39:54.166669+0000 mon.c (mon.1) 3334 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:39:54.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:39:54 gibba015 bash[29377]: audit 2021-03-10T17:39:54.167799+0000 mon.a (mon.0) 2512 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:39:54.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:39:54 gibba015 bash[29377]: audit 2021-03-10T17:39:54.282470+0000 mon.c (mon.1) 3335 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T17:39:54.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:39:54 gibba015 bash[29377]: audit 2021-03-10T17:39:54.283279+0000 mon.c (mon.1) 3336 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:39:54.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:39:54 gibba015 bash[29377]: audit 2021-03-10T17:39:54.283681+0000 mon.a (mon.0) 2513 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T17:39:54.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:39:54 gibba015 bash[29377]: audit 2021-03-10T17:39:54.284303+0000 mon.c (mon.1) 3337 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:39:54.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:39:54 gibba015 bash[29377]: audit 2021-03-10T17:39:54.284931+0000 mon.a (mon.0) 2514 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:39:54.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:39:54 gibba015 bash[29377]: audit 2021-03-10T17:39:54.285652+0000 mon.c (mon.1) 3338 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:39:54.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:39:54 gibba015 bash[29377]: audit 2021-03-10T17:39:54.285815+0000 mon.a (mon.0) 2515 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:39:54.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:39:54 gibba015 bash[29377]: audit 2021-03-10T17:39:54.287293+0000 mon.a (mon.0) 2516 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:39:54.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:39:54 gibba015 bash[30343]: cluster 2021-03-10T17:39:53.118541+0000 mgr.gibba045.orlgmj (mgr.34412) 12169 : cluster [DBG] pgmap v6940: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:54.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:39:54 gibba015 bash[30343]: audit 2021-03-10T17:39:54.165190+0000 mon.c (mon.1) 3333 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:39:54.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:39:54 gibba015 bash[30343]: audit 2021-03-10T17:39:54.166254+0000 mon.a (mon.0) 2511 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:39:54.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:39:54 gibba015 bash[30343]: audit 2021-03-10T17:39:54.166669+0000 mon.c (mon.1) 3334 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:39:54.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:39:54 gibba015 bash[30343]: audit 2021-03-10T17:39:54.167799+0000 mon.a (mon.0) 2512 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:39:54.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:39:54 gibba015 bash[30343]: audit 2021-03-10T17:39:54.282470+0000 mon.c (mon.1) 3335 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T17:39:54.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:39:54 gibba015 bash[30343]: audit 2021-03-10T17:39:54.283279+0000 mon.c (mon.1) 3336 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:39:54.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:39:54 gibba015 bash[30343]: audit 2021-03-10T17:39:54.283681+0000 mon.a (mon.0) 2513 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T17:39:54.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:39:54 gibba015 bash[30343]: audit 2021-03-10T17:39:54.284303+0000 mon.c (mon.1) 3337 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:39:54.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:39:54 gibba015 bash[30343]: audit 2021-03-10T17:39:54.284931+0000 mon.a (mon.0) 2514 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:39:54.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:39:54 gibba015 bash[30343]: audit 2021-03-10T17:39:54.285652+0000 mon.c (mon.1) 3338 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:39:54.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:39:54 gibba015 bash[30343]: audit 2021-03-10T17:39:54.285815+0000 mon.a (mon.0) 2515 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:39:54.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:39:54 gibba015 bash[30343]: audit 2021-03-10T17:39:54.287293+0000 mon.a (mon.0) 2516 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:39:56.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:39:56 gibba045 bash[25517]: cluster 2021-03-10T17:39:55.120288+0000 mgr.gibba045.orlgmj (mgr.34412) 12170 : cluster [DBG] pgmap v6941: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:56.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:39:56 gibba015 bash[29377]: cluster 2021-03-10T17:39:55.120288+0000 mgr.gibba045.orlgmj (mgr.34412) 12170 : cluster [DBG] pgmap v6941: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:56.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:39:56 gibba015 bash[30343]: cluster 2021-03-10T17:39:55.120288+0000 mgr.gibba045.orlgmj (mgr.34412) 12170 : cluster [DBG] pgmap v6941: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:58.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:39:58 gibba045 bash[25517]: cluster 2021-03-10T17:39:57.122130+0000 mgr.gibba045.orlgmj (mgr.34412) 12171 : cluster [DBG] pgmap v6942: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:58.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:39:58 gibba015 bash[29377]: cluster 2021-03-10T17:39:57.122130+0000 mgr.gibba045.orlgmj (mgr.34412) 12171 : cluster [DBG] pgmap v6942: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:58.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:39:58 gibba015 bash[30343]: cluster 2021-03-10T17:39:57.122130+0000 mgr.gibba045.orlgmj (mgr.34412) 12171 : cluster [DBG] pgmap v6942: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:59.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:39:59 gibba045 bash[25517]: audit 2021-03-10T17:39:59.347575+0000 mon.c (mon.1) 3339 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:39:59.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:39:59 gibba015 bash[29377]: audit 2021-03-10T17:39:59.347575+0000 mon.c (mon.1) 3339 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:39:59.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:39:59 gibba015 bash[30343]: audit 2021-03-10T17:39:59.347575+0000 mon.c (mon.1) 3339 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:40:00.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:40:00 gibba015 bash[29377]: debug 2021-03-10T17:39:59.994+0000 7f21beb4f700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T17:40:00.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:40:00 gibba015 bash[29377]: cluster 2021-03-10T17:39:59.123307+0000 mgr.gibba045.orlgmj (mgr.34412) 12172 : cluster [DBG] pgmap v6943: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:00.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:40:00 gibba015 bash[29377]: cephadm 2021-03-10T17:39:59.354479+0000 mgr.gibba045.orlgmj (mgr.34412) 12173 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:40:00.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:40:00 gibba015 bash[29377]: cephadm 2021-03-10T17:39:59.356199+0000 mgr.gibba045.orlgmj (mgr.34412) 12174 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:40:00.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:40:00 gibba015 bash[29377]: audit 2021-03-10T17:39:59.589437+0000 mon.a (mon.0) 2517 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:40:00.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:40:00 gibba015 bash[29377]: audit 2021-03-10T17:39:59.593021+0000 mon.c (mon.1) 3340 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:40:00.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:40:00 gibba015 bash[29377]: cephadm 2021-03-10T17:39:59.594239+0000 mgr.gibba045.orlgmj (mgr.34412) 12175 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:40:00.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:40:00 gibba015 bash[29377]: audit 2021-03-10T17:39:59.594440+0000 mon.c (mon.1) 3341 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:40:00.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:40:00 gibba015 bash[29377]: audit 2021-03-10T17:39:59.595720+0000 mon.c (mon.1) 3342 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:40:00.978 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:40:00 gibba015 bash[29377]: cephadm 2021-03-10T17:39:59.595877+0000 mgr.gibba045.orlgmj (mgr.34412) 12176 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:40:00.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:40:00 gibba015 bash[29377]: audit 2021-03-10T17:39:59.596890+0000 mon.c (mon.1) 3343 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:40:00.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:40:00 gibba015 bash[29377]: cephadm 2021-03-10T17:39:59.597097+0000 mgr.gibba045.orlgmj (mgr.34412) 12177 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:40:00.979 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:40:00 gibba015 bash[29377]: cephadm 2021-03-10T17:39:59.597140+0000 mgr.gibba045.orlgmj (mgr.34412) 12178 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:40:00.980 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:40:00 gibba015 bash[29377]: cephadm 2021-03-10T17:39:59.598369+0000 mgr.gibba045.orlgmj (mgr.34412) 12179 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:40:00.980 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:40:00 gibba015 bash[29377]: cephadm 2021-03-10T17:39:59.598413+0000 mgr.gibba045.orlgmj (mgr.34412) 12180 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:40:00.981 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:40:00 gibba015 bash[29377]: audit 2021-03-10T17:39:59.599428+0000 mon.c (mon.1) 3344 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:40:00.981 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:40:00 gibba015 bash[29377]: cephadm 2021-03-10T17:39:59.599532+0000 mgr.gibba045.orlgmj (mgr.34412) 12181 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:40:00.982 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:40:00 gibba015 bash[29377]: audit 2021-03-10T17:39:59.600835+0000 mon.c (mon.1) 3345 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:40:00.982 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:40:00 gibba015 bash[29377]: cephadm 2021-03-10T17:39:59.600868+0000 mgr.gibba045.orlgmj (mgr.34412) 12182 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:40:00.983 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:40:00 gibba015 bash[29377]: cephadm 2021-03-10T17:39:59.600912+0000 mgr.gibba045.orlgmj (mgr.34412) 12183 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:40:00.983 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:40:00 gibba015 bash[29377]: cephadm 2021-03-10T17:39:59.602107+0000 mgr.gibba045.orlgmj (mgr.34412) 12184 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:40:00.984 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:40:00 gibba015 bash[30343]: cluster 2021-03-10T17:39:59.123307+0000 mgr.gibba045.orlgmj (mgr.34412) 12172 : cluster [DBG] pgmap v6943: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:00.985 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:40:00 gibba015 bash[30343]: cephadm 2021-03-10T17:39:59.354479+0000 mgr.gibba045.orlgmj (mgr.34412) 12173 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:40:00.985 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:40:00 gibba015 bash[30343]: cephadm 2021-03-10T17:39:59.356199+0000 mgr.gibba045.orlgmj (mgr.34412) 12174 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:40:00.986 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:40:00 gibba015 bash[30343]: audit 2021-03-10T17:39:59.589437+0000 mon.a (mon.0) 2517 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:40:00.986 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:40:00 gibba015 bash[30343]: audit 2021-03-10T17:39:59.593021+0000 mon.c (mon.1) 3340 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:40:00.986 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:40:00 gibba015 bash[30343]: cephadm 2021-03-10T17:39:59.594239+0000 mgr.gibba045.orlgmj (mgr.34412) 12175 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:40:00.987 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:40:00 gibba015 bash[30343]: audit 2021-03-10T17:39:59.594440+0000 mon.c (mon.1) 3341 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:40:00.987 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:40:00 gibba015 bash[30343]: audit 2021-03-10T17:39:59.595720+0000 mon.c (mon.1) 3342 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:40:00.988 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:40:00 gibba015 bash[30343]: cephadm 2021-03-10T17:39:59.595877+0000 mgr.gibba045.orlgmj (mgr.34412) 12176 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:40:00.988 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:40:00 gibba015 bash[30343]: audit 2021-03-10T17:39:59.596890+0000 mon.c (mon.1) 3343 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:40:00.989 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:40:00 gibba015 bash[30343]: cephadm 2021-03-10T17:39:59.597097+0000 mgr.gibba045.orlgmj (mgr.34412) 12177 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:40:00.989 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:40:00 gibba015 bash[30343]: cephadm 2021-03-10T17:39:59.597140+0000 mgr.gibba045.orlgmj (mgr.34412) 12178 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:40:00.990 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:40:00 gibba015 bash[30343]: cephadm 2021-03-10T17:39:59.598369+0000 mgr.gibba045.orlgmj (mgr.34412) 12179 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:40:00.990 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:40:00 gibba015 bash[30343]: cephadm 2021-03-10T17:39:59.598413+0000 mgr.gibba045.orlgmj (mgr.34412) 12180 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:40:00.990 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:40:00 gibba015 bash[30343]: audit 2021-03-10T17:39:59.599428+0000 mon.c (mon.1) 3344 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:40:00.991 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:40:00 gibba015 bash[30343]: cephadm 2021-03-10T17:39:59.599532+0000 mgr.gibba045.orlgmj (mgr.34412) 12181 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:40:00.991 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:40:00 gibba015 bash[30343]: audit 2021-03-10T17:39:59.600835+0000 mon.c (mon.1) 3345 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:40:00.992 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:40:00 gibba015 bash[30343]: cephadm 2021-03-10T17:39:59.600868+0000 mgr.gibba045.orlgmj (mgr.34412) 12182 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:40:00.992 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:40:00 gibba015 bash[30343]: cephadm 2021-03-10T17:39:59.600912+0000 mgr.gibba045.orlgmj (mgr.34412) 12183 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:40:00.993 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:40:00 gibba015 bash[30343]: cephadm 2021-03-10T17:39:59.602107+0000 mgr.gibba045.orlgmj (mgr.34412) 12184 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:40:00.994 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:40:00 gibba015 bash[29377]: cephadm 2021-03-10T17:39:59.602487+0000 mgr.gibba045.orlgmj (mgr.34412) 12185 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:40:00.994 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:40:00 gibba015 bash[29377]: cephadm 2021-03-10T17:39:59.603460+0000 mgr.gibba045.orlgmj (mgr.34412) 12186 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:40:00.994 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:40:00 gibba015 bash[29377]: cephadm 2021-03-10T17:39:59.603508+0000 mgr.gibba045.orlgmj (mgr.34412) 12187 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:40:00.995 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:40:00 gibba015 bash[29377]: cephadm 2021-03-10T17:39:59.603634+0000 mgr.gibba045.orlgmj (mgr.34412) 12188 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:40:00.995 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:40:00 gibba015 bash[29377]: cluster 2021-03-10T17:40:00.000211+0000 mon.a (mon.0) 2518 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T17:40:00.996 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:40:00 gibba015 bash[30343]: cephadm 2021-03-10T17:39:59.602487+0000 mgr.gibba045.orlgmj (mgr.34412) 12185 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:40:00.996 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:40:00 gibba015 bash[30343]: cephadm 2021-03-10T17:39:59.603460+0000 mgr.gibba045.orlgmj (mgr.34412) 12186 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:40:00.997 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:40:00 gibba015 bash[30343]: cephadm 2021-03-10T17:39:59.603508+0000 mgr.gibba045.orlgmj (mgr.34412) 12187 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:40:00.997 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:40:00 gibba015 bash[30343]: cephadm 2021-03-10T17:39:59.603634+0000 mgr.gibba045.orlgmj (mgr.34412) 12188 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:40:00.998 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:40:00 gibba015 bash[30343]: cluster 2021-03-10T17:40:00.000211+0000 mon.a (mon.0) 2518 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T17:40:01.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:40:00 gibba045 bash[25517]: cluster 2021-03-10T17:39:59.123307+0000 mgr.gibba045.orlgmj (mgr.34412) 12172 : cluster [DBG] pgmap v6943: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:01.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:40:00 gibba045 bash[25517]: cephadm 2021-03-10T17:39:59.354479+0000 mgr.gibba045.orlgmj (mgr.34412) 12173 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:40:01.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:40:00 gibba045 bash[25517]: cephadm 2021-03-10T17:39:59.356199+0000 mgr.gibba045.orlgmj (mgr.34412) 12174 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:40:01.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:40:00 gibba045 bash[25517]: audit 2021-03-10T17:39:59.589437+0000 mon.a (mon.0) 2517 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:40:01.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:40:00 gibba045 bash[25517]: audit 2021-03-10T17:39:59.593021+0000 mon.c (mon.1) 3340 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:40:01.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:40:00 gibba045 bash[25517]: cephadm 2021-03-10T17:39:59.594239+0000 mgr.gibba045.orlgmj (mgr.34412) 12175 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:40:01.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:40:00 gibba045 bash[25517]: audit 2021-03-10T17:39:59.594440+0000 mon.c (mon.1) 3341 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:40:01.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:40:00 gibba045 bash[25517]: audit 2021-03-10T17:39:59.595720+0000 mon.c (mon.1) 3342 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:40:01.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:40:00 gibba045 bash[25517]: cephadm 2021-03-10T17:39:59.595877+0000 mgr.gibba045.orlgmj (mgr.34412) 12176 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:40:01.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:40:00 gibba045 bash[25517]: audit 2021-03-10T17:39:59.596890+0000 mon.c (mon.1) 3343 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:40:01.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:40:00 gibba045 bash[25517]: cephadm 2021-03-10T17:39:59.597097+0000 mgr.gibba045.orlgmj (mgr.34412) 12177 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:40:01.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:40:00 gibba045 bash[25517]: cephadm 2021-03-10T17:39:59.597140+0000 mgr.gibba045.orlgmj (mgr.34412) 12178 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:40:01.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:40:00 gibba045 bash[25517]: cephadm 2021-03-10T17:39:59.598369+0000 mgr.gibba045.orlgmj (mgr.34412) 12179 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:40:01.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:40:00 gibba045 bash[25517]: cephadm 2021-03-10T17:39:59.598413+0000 mgr.gibba045.orlgmj (mgr.34412) 12180 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:40:01.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:40:00 gibba045 bash[25517]: audit 2021-03-10T17:39:59.599428+0000 mon.c (mon.1) 3344 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:40:01.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:40:00 gibba045 bash[25517]: cephadm 2021-03-10T17:39:59.599532+0000 mgr.gibba045.orlgmj (mgr.34412) 12181 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:40:01.062 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:40:00 gibba045 bash[25517]: audit 2021-03-10T17:39:59.600835+0000 mon.c (mon.1) 3345 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:40:01.062 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:40:00 gibba045 bash[25517]: cephadm 2021-03-10T17:39:59.600868+0000 mgr.gibba045.orlgmj (mgr.34412) 12182 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:40:01.062 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:40:00 gibba045 bash[25517]: cephadm 2021-03-10T17:39:59.600912+0000 mgr.gibba045.orlgmj (mgr.34412) 12183 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:40:01.062 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:40:00 gibba045 bash[25517]: cephadm 2021-03-10T17:39:59.602107+0000 mgr.gibba045.orlgmj (mgr.34412) 12184 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:40:01.063 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:40:00 gibba045 bash[25517]: cephadm 2021-03-10T17:39:59.602487+0000 mgr.gibba045.orlgmj (mgr.34412) 12185 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:40:01.063 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:40:00 gibba045 bash[25517]: cephadm 2021-03-10T17:39:59.603460+0000 mgr.gibba045.orlgmj (mgr.34412) 12186 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:40:01.063 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:40:00 gibba045 bash[25517]: cephadm 2021-03-10T17:39:59.603508+0000 mgr.gibba045.orlgmj (mgr.34412) 12187 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:40:01.063 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:40:00 gibba045 bash[25517]: cephadm 2021-03-10T17:39:59.603634+0000 mgr.gibba045.orlgmj (mgr.34412) 12188 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:40:01.063 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:40:00 gibba045 bash[25517]: cluster 2021-03-10T17:40:00.000211+0000 mon.a (mon.0) 2518 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T17:40:02.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:40:02 gibba015 bash[29377]: cluster 2021-03-10T17:40:01.125055+0000 mgr.gibba045.orlgmj (mgr.34412) 12189 : cluster [DBG] pgmap v6944: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:02.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:40:02 gibba015 bash[30343]: cluster 2021-03-10T17:40:01.125055+0000 mgr.gibba045.orlgmj (mgr.34412) 12189 : cluster [DBG] pgmap v6944: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:03.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:40:02 gibba045 bash[25517]: cluster 2021-03-10T17:40:01.125055+0000 mgr.gibba045.orlgmj (mgr.34412) 12189 : cluster [DBG] pgmap v6944: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:04.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:40:04 gibba015 bash[29377]: cluster 2021-03-10T17:40:03.126549+0000 mgr.gibba045.orlgmj (mgr.34412) 12190 : cluster [DBG] pgmap v6945: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:04.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:40:04 gibba015 bash[30343]: cluster 2021-03-10T17:40:03.126549+0000 mgr.gibba045.orlgmj (mgr.34412) 12190 : cluster [DBG] pgmap v6945: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:05.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:40:04 gibba045 bash[25517]: cluster 2021-03-10T17:40:03.126549+0000 mgr.gibba045.orlgmj (mgr.34412) 12190 : cluster [DBG] pgmap v6945: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:06.031 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:40:06.259 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:40:06.259 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 2m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:40:06.259 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 67s ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:40:06.260 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 67s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:40:06.260 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 67s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:40:06.260 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 2m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:40:06.260 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 2m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:40:06.261 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 67s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:40:06.261 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 2m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:40:06.261 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 2m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:40:06.261 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 67s ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:40:06.261 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:40:06.262 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:40:06.262 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:40:06.262 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:40:06.262 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 67s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:40:06.263 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 67s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:40:06.263 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 67s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:40:06.263 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 67s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:40:06.263 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 67s ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:40:06.263 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 67s ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:40:06.504 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:40:06.504 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:40:06.505 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:40:06.505 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:40:06.505 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:40:06.505 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:40:06.505 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:40:06.506 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:40:06.506 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:40:06.506 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:40:06.506 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:40:06.507 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:40:06.507 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:40:06.507 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:40:06.507 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:40:06.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:40:06 gibba015 bash[29377]: cluster 2021-03-10T17:40:05.128286+0000 mgr.gibba045.orlgmj (mgr.34412) 12191 : cluster [DBG] pgmap v6946: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:06.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:40:06 gibba015 bash[29377]: audit 2021-03-10T17:40:06.021861+0000 mgr.gibba045.orlgmj (mgr.34412) 12192 : audit [DBG] from='client.62209 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:40:06.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:40:06 gibba015 bash[29377]: audit 2021-03-10T17:40:06.501469+0000 mon.c (mon.1) 3346 : audit [DBG] from='client.? 172.21.2.115:0/2226111387' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:40:06.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:40:06 gibba015 bash[30343]: cluster 2021-03-10T17:40:05.128286+0000 mgr.gibba045.orlgmj (mgr.34412) 12191 : cluster [DBG] pgmap v6946: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:06.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:40:06 gibba015 bash[30343]: audit 2021-03-10T17:40:06.021861+0000 mgr.gibba045.orlgmj (mgr.34412) 12192 : audit [DBG] from='client.62209 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:40:06.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:40:06 gibba015 bash[30343]: audit 2021-03-10T17:40:06.501469+0000 mon.c (mon.1) 3346 : audit [DBG] from='client.? 172.21.2.115:0/2226111387' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:40:07.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:40:06 gibba045 bash[25517]: cluster 2021-03-10T17:40:05.128286+0000 mgr.gibba045.orlgmj (mgr.34412) 12191 : cluster [DBG] pgmap v6946: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:07.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:40:06 gibba045 bash[25517]: audit 2021-03-10T17:40:06.021861+0000 mgr.gibba045.orlgmj (mgr.34412) 12192 : audit [DBG] from='client.62209 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:40:07.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:40:06 gibba045 bash[25517]: audit 2021-03-10T17:40:06.501469+0000 mon.c (mon.1) 3346 : audit [DBG] from='client.? 172.21.2.115:0/2226111387' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:40:07.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:40:07 gibba015 bash[29377]: audit 2021-03-10T17:40:06.247227+0000 mgr.gibba045.orlgmj (mgr.34412) 12193 : audit [DBG] from='client.52230 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:40:07.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:40:07 gibba015 bash[30343]: audit 2021-03-10T17:40:06.247227+0000 mgr.gibba045.orlgmj (mgr.34412) 12193 : audit [DBG] from='client.52230 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:40:08.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:40:07 gibba045 bash[25517]: audit 2021-03-10T17:40:06.247227+0000 mgr.gibba045.orlgmj (mgr.34412) 12193 : audit [DBG] from='client.52230 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:40:08.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:40:08 gibba015 bash[29377]: cluster 2021-03-10T17:40:07.130062+0000 mgr.gibba045.orlgmj (mgr.34412) 12194 : cluster [DBG] pgmap v6947: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:08.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:40:08 gibba015 bash[30343]: cluster 2021-03-10T17:40:07.130062+0000 mgr.gibba045.orlgmj (mgr.34412) 12194 : cluster [DBG] pgmap v6947: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:09.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:40:08 gibba045 bash[25517]: cluster 2021-03-10T17:40:07.130062+0000 mgr.gibba045.orlgmj (mgr.34412) 12194 : cluster [DBG] pgmap v6947: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:10.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:40:10 gibba015 bash[29377]: cluster 2021-03-10T17:40:09.131218+0000 mgr.gibba045.orlgmj (mgr.34412) 12195 : cluster [DBG] pgmap v6948: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:10.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:40:10 gibba015 bash[30343]: cluster 2021-03-10T17:40:09.131218+0000 mgr.gibba045.orlgmj (mgr.34412) 12195 : cluster [DBG] pgmap v6948: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:11.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:40:10 gibba045 bash[25517]: cluster 2021-03-10T17:40:09.131218+0000 mgr.gibba045.orlgmj (mgr.34412) 12195 : cluster [DBG] pgmap v6948: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:12.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:40:12 gibba015 bash[29377]: cluster 2021-03-10T17:40:11.132912+0000 mgr.gibba045.orlgmj (mgr.34412) 12196 : cluster [DBG] pgmap v6949: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:12.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:40:12 gibba015 bash[30343]: cluster 2021-03-10T17:40:11.132912+0000 mgr.gibba045.orlgmj (mgr.34412) 12196 : cluster [DBG] pgmap v6949: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:13.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:40:12 gibba045 bash[25517]: cluster 2021-03-10T17:40:11.132912+0000 mgr.gibba045.orlgmj (mgr.34412) 12196 : cluster [DBG] pgmap v6949: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:14.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:40:14 gibba015 bash[29377]: cluster 2021-03-10T17:40:13.134458+0000 mgr.gibba045.orlgmj (mgr.34412) 12197 : cluster [DBG] pgmap v6950: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:14.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:40:14 gibba015 bash[30343]: cluster 2021-03-10T17:40:13.134458+0000 mgr.gibba045.orlgmj (mgr.34412) 12197 : cluster [DBG] pgmap v6950: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:15.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:40:14 gibba045 bash[25517]: cluster 2021-03-10T17:40:13.134458+0000 mgr.gibba045.orlgmj (mgr.34412) 12197 : cluster [DBG] pgmap v6950: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:15.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:40:15 gibba015 bash[29377]: cephadm 2021-03-10T17:40:14.619598+0000 mgr.gibba045.orlgmj (mgr.34412) 12198 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:40:15.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:40:15 gibba015 bash[30343]: cephadm 2021-03-10T17:40:14.619598+0000 mgr.gibba045.orlgmj (mgr.34412) 12198 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:40:16.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:40:15 gibba045 bash[25517]: cephadm 2021-03-10T17:40:14.619598+0000 mgr.gibba045.orlgmj (mgr.34412) 12198 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:40:16.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:40:16 gibba015 bash[29377]: cluster 2021-03-10T17:40:15.134987+0000 mgr.gibba045.orlgmj (mgr.34412) 12199 : cluster [DBG] pgmap v6951: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:16.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:40:16 gibba015 bash[30343]: cluster 2021-03-10T17:40:15.134987+0000 mgr.gibba045.orlgmj (mgr.34412) 12199 : cluster [DBG] pgmap v6951: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:17.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:40:16 gibba045 bash[25517]: cluster 2021-03-10T17:40:15.134987+0000 mgr.gibba045.orlgmj (mgr.34412) 12199 : cluster [DBG] pgmap v6951: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:18.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:40:18 gibba015 bash[29377]: cluster 2021-03-10T17:40:17.136718+0000 mgr.gibba045.orlgmj (mgr.34412) 12200 : cluster [DBG] pgmap v6952: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:18.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:40:18 gibba015 bash[30343]: cluster 2021-03-10T17:40:17.136718+0000 mgr.gibba045.orlgmj (mgr.34412) 12200 : cluster [DBG] pgmap v6952: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:19.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:40:18 gibba045 bash[25517]: cluster 2021-03-10T17:40:17.136718+0000 mgr.gibba045.orlgmj (mgr.34412) 12200 : cluster [DBG] pgmap v6952: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:20.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:40:20 gibba015 bash[29377]: cluster 2021-03-10T17:40:19.138204+0000 mgr.gibba045.orlgmj (mgr.34412) 12201 : cluster [DBG] pgmap v6953: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:20.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:40:20 gibba015 bash[30343]: cluster 2021-03-10T17:40:19.138204+0000 mgr.gibba045.orlgmj (mgr.34412) 12201 : cluster [DBG] pgmap v6953: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:21.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:40:20 gibba045 bash[25517]: cluster 2021-03-10T17:40:19.138204+0000 mgr.gibba045.orlgmj (mgr.34412) 12201 : cluster [DBG] pgmap v6953: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:22.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:40:22 gibba015 bash[29377]: cluster 2021-03-10T17:40:21.138920+0000 mgr.gibba045.orlgmj (mgr.34412) 12202 : cluster [DBG] pgmap v6954: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:22.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:40:22 gibba015 bash[30343]: cluster 2021-03-10T17:40:21.138920+0000 mgr.gibba045.orlgmj (mgr.34412) 12202 : cluster [DBG] pgmap v6954: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:23.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:40:22 gibba045 bash[25517]: cluster 2021-03-10T17:40:21.138920+0000 mgr.gibba045.orlgmj (mgr.34412) 12202 : cluster [DBG] pgmap v6954: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:24.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:40:24 gibba015 bash[29377]: cluster 2021-03-10T17:40:23.140466+0000 mgr.gibba045.orlgmj (mgr.34412) 12203 : cluster [DBG] pgmap v6955: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:24.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:40:24 gibba015 bash[30343]: cluster 2021-03-10T17:40:23.140466+0000 mgr.gibba045.orlgmj (mgr.34412) 12203 : cluster [DBG] pgmap v6955: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:25.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:40:24 gibba045 bash[25517]: cluster 2021-03-10T17:40:23.140466+0000 mgr.gibba045.orlgmj (mgr.34412) 12203 : cluster [DBG] pgmap v6955: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:26.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:40:26 gibba015 bash[29377]: cluster 2021-03-10T17:40:25.142180+0000 mgr.gibba045.orlgmj (mgr.34412) 12204 : cluster [DBG] pgmap v6956: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:26.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:40:26 gibba015 bash[30343]: cluster 2021-03-10T17:40:25.142180+0000 mgr.gibba045.orlgmj (mgr.34412) 12204 : cluster [DBG] pgmap v6956: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:27.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:40:26 gibba045 bash[25517]: cluster 2021-03-10T17:40:25.142180+0000 mgr.gibba045.orlgmj (mgr.34412) 12204 : cluster [DBG] pgmap v6956: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:28.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:40:28 gibba015 bash[29377]: cluster 2021-03-10T17:40:27.142955+0000 mgr.gibba045.orlgmj (mgr.34412) 12205 : cluster [DBG] pgmap v6957: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:28.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:40:28 gibba015 bash[30343]: cluster 2021-03-10T17:40:27.142955+0000 mgr.gibba045.orlgmj (mgr.34412) 12205 : cluster [DBG] pgmap v6957: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:29.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:40:28 gibba045 bash[25517]: cluster 2021-03-10T17:40:27.142955+0000 mgr.gibba045.orlgmj (mgr.34412) 12205 : cluster [DBG] pgmap v6957: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:31.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:40:30 gibba045 bash[25517]: cluster 2021-03-10T17:40:29.144061+0000 mgr.gibba045.orlgmj (mgr.34412) 12206 : cluster [DBG] pgmap v6958: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:31.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:40:30 gibba045 bash[25517]: cephadm 2021-03-10T17:40:29.635533+0000 mgr.gibba045.orlgmj (mgr.34412) 12207 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:40:31.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:40:30 gibba015 bash[29377]: cluster 2021-03-10T17:40:29.144061+0000 mgr.gibba045.orlgmj (mgr.34412) 12206 : cluster [DBG] pgmap v6958: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:31.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:40:30 gibba015 bash[29377]: cephadm 2021-03-10T17:40:29.635533+0000 mgr.gibba045.orlgmj (mgr.34412) 12207 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:40:31.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:40:30 gibba015 bash[30343]: cluster 2021-03-10T17:40:29.144061+0000 mgr.gibba045.orlgmj (mgr.34412) 12206 : cluster [DBG] pgmap v6958: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:31.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:40:30 gibba015 bash[30343]: cephadm 2021-03-10T17:40:29.635533+0000 mgr.gibba045.orlgmj (mgr.34412) 12207 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:40:33.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:40:32 gibba045 bash[25517]: cluster 2021-03-10T17:40:31.145676+0000 mgr.gibba045.orlgmj (mgr.34412) 12208 : cluster [DBG] pgmap v6959: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:33.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:40:32 gibba015 bash[29377]: cluster 2021-03-10T17:40:31.145676+0000 mgr.gibba045.orlgmj (mgr.34412) 12208 : cluster [DBG] pgmap v6959: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:33.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:40:32 gibba015 bash[30343]: cluster 2021-03-10T17:40:31.145676+0000 mgr.gibba045.orlgmj (mgr.34412) 12208 : cluster [DBG] pgmap v6959: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:35.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:40:34 gibba045 bash[25517]: cluster 2021-03-10T17:40:33.146423+0000 mgr.gibba045.orlgmj (mgr.34412) 12209 : cluster [DBG] pgmap v6960: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:35.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:40:34 gibba015 bash[29377]: cluster 2021-03-10T17:40:33.146423+0000 mgr.gibba045.orlgmj (mgr.34412) 12209 : cluster [DBG] pgmap v6960: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:35.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:40:34 gibba015 bash[30343]: cluster 2021-03-10T17:40:33.146423+0000 mgr.gibba045.orlgmj (mgr.34412) 12209 : cluster [DBG] pgmap v6960: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:36.747 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:40:36.980 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:40:36.981 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 2m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:40:36.981 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 97s ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:40:36.981 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 97s ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:40:36.982 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 97s ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:40:36.982 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 2m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:40:36.982 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 2m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:40:36.982 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 97s ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:40:36.983 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 2m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:40:36.983 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 2m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:40:36.983 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 97s ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:40:36.983 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:40:36.983 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:40:36.984 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:40:36.984 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:40:36.984 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 97s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:40:36.984 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 97s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:40:36.984 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 97s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:40:36.985 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 97s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:40:36.985 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 97s ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:40:36.985 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 97s ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:40:37.056 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:40:36 gibba045 bash[25517]: cluster 2021-03-10T17:40:35.148019+0000 mgr.gibba045.orlgmj (mgr.34412) 12210 : cluster [DBG] pgmap v6961: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:37.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:40:36 gibba015 bash[29377]: cluster 2021-03-10T17:40:35.148019+0000 mgr.gibba045.orlgmj (mgr.34412) 12210 : cluster [DBG] pgmap v6961: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:37.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:40:36 gibba015 bash[30343]: cluster 2021-03-10T17:40:35.148019+0000 mgr.gibba045.orlgmj (mgr.34412) 12210 : cluster [DBG] pgmap v6961: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:37.228 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:40:37.228 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:40:37.228 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:40:37.228 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:40:37.229 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:40:37.229 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:40:37.229 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:40:37.229 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:40:37.230 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:40:37.230 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:40:37.230 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:40:37.230 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:40:37.230 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:40:37.231 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:40:37.231 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:40:38.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:40:37 gibba045 bash[25517]: audit 2021-03-10T17:40:36.737455+0000 mgr.gibba045.orlgmj (mgr.34412) 12211 : audit [DBG] from='client.52242 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:40:38.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:40:37 gibba045 bash[25517]: audit 2021-03-10T17:40:36.967644+0000 mgr.gibba045.orlgmj (mgr.34412) 12212 : audit [DBG] from='client.52248 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:40:38.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:40:37 gibba045 bash[25517]: audit 2021-03-10T17:40:37.225580+0000 mon.c (mon.1) 3347 : audit [DBG] from='client.? 172.21.2.115:0/1015014534' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:40:38.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:40:37 gibba015 bash[29377]: audit 2021-03-10T17:40:36.737455+0000 mgr.gibba045.orlgmj (mgr.34412) 12211 : audit [DBG] from='client.52242 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:40:38.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:40:37 gibba015 bash[29377]: audit 2021-03-10T17:40:36.967644+0000 mgr.gibba045.orlgmj (mgr.34412) 12212 : audit [DBG] from='client.52248 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:40:38.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:40:37 gibba015 bash[29377]: audit 2021-03-10T17:40:37.225580+0000 mon.c (mon.1) 3347 : audit [DBG] from='client.? 172.21.2.115:0/1015014534' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:40:38.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:40:37 gibba015 bash[30343]: audit 2021-03-10T17:40:36.737455+0000 mgr.gibba045.orlgmj (mgr.34412) 12211 : audit [DBG] from='client.52242 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:40:38.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:40:37 gibba015 bash[30343]: audit 2021-03-10T17:40:36.967644+0000 mgr.gibba045.orlgmj (mgr.34412) 12212 : audit [DBG] from='client.52248 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:40:38.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:40:37 gibba015 bash[30343]: audit 2021-03-10T17:40:37.225580+0000 mon.c (mon.1) 3347 : audit [DBG] from='client.? 172.21.2.115:0/1015014534' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:40:39.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:40:38 gibba045 bash[25517]: cluster 2021-03-10T17:40:37.149816+0000 mgr.gibba045.orlgmj (mgr.34412) 12213 : cluster [DBG] pgmap v6962: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:39.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:40:38 gibba015 bash[29377]: cluster 2021-03-10T17:40:37.149816+0000 mgr.gibba045.orlgmj (mgr.34412) 12213 : cluster [DBG] pgmap v6962: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:39.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:40:38 gibba015 bash[30343]: cluster 2021-03-10T17:40:37.149816+0000 mgr.gibba045.orlgmj (mgr.34412) 12213 : cluster [DBG] pgmap v6962: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:41.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:40:40 gibba045 bash[25517]: cluster 2021-03-10T17:40:39.150286+0000 mgr.gibba045.orlgmj (mgr.34412) 12214 : cluster [DBG] pgmap v6963: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:41.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:40:40 gibba015 bash[29377]: cluster 2021-03-10T17:40:39.150286+0000 mgr.gibba045.orlgmj (mgr.34412) 12214 : cluster [DBG] pgmap v6963: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:41.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:40:40 gibba015 bash[30343]: cluster 2021-03-10T17:40:39.150286+0000 mgr.gibba045.orlgmj (mgr.34412) 12214 : cluster [DBG] pgmap v6963: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:43.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:40:42 gibba045 bash[25517]: cluster 2021-03-10T17:40:41.151996+0000 mgr.gibba045.orlgmj (mgr.34412) 12215 : cluster [DBG] pgmap v6964: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:43.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:40:42 gibba015 bash[29377]: cluster 2021-03-10T17:40:41.151996+0000 mgr.gibba045.orlgmj (mgr.34412) 12215 : cluster [DBG] pgmap v6964: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:43.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:40:42 gibba015 bash[30343]: cluster 2021-03-10T17:40:41.151996+0000 mgr.gibba045.orlgmj (mgr.34412) 12215 : cluster [DBG] pgmap v6964: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:45.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:40:44 gibba045 bash[25517]: cluster 2021-03-10T17:40:43.153544+0000 mgr.gibba045.orlgmj (mgr.34412) 12216 : cluster [DBG] pgmap v6965: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:45.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:40:44 gibba015 bash[29377]: cluster 2021-03-10T17:40:43.153544+0000 mgr.gibba045.orlgmj (mgr.34412) 12216 : cluster [DBG] pgmap v6965: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:45.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:40:44 gibba015 bash[30343]: cluster 2021-03-10T17:40:43.153544+0000 mgr.gibba045.orlgmj (mgr.34412) 12216 : cluster [DBG] pgmap v6965: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:46.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:40:45 gibba015 bash[29377]: cephadm 2021-03-10T17:40:44.651075+0000 mgr.gibba045.orlgmj (mgr.34412) 12217 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:40:46.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:40:45 gibba015 bash[30343]: cephadm 2021-03-10T17:40:44.651075+0000 mgr.gibba045.orlgmj (mgr.34412) 12217 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:40:46.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:40:45 gibba045 bash[25517]: cephadm 2021-03-10T17:40:44.651075+0000 mgr.gibba045.orlgmj (mgr.34412) 12217 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:40:47.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:40:46 gibba015 bash[29377]: cluster 2021-03-10T17:40:45.154294+0000 mgr.gibba045.orlgmj (mgr.34412) 12218 : cluster [DBG] pgmap v6966: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:47.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:40:46 gibba015 bash[30343]: cluster 2021-03-10T17:40:45.154294+0000 mgr.gibba045.orlgmj (mgr.34412) 12218 : cluster [DBG] pgmap v6966: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:47.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:40:46 gibba045 bash[25517]: cluster 2021-03-10T17:40:45.154294+0000 mgr.gibba045.orlgmj (mgr.34412) 12218 : cluster [DBG] pgmap v6966: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:49.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:40:48 gibba015 bash[29377]: cluster 2021-03-10T17:40:47.155798+0000 mgr.gibba045.orlgmj (mgr.34412) 12219 : cluster [DBG] pgmap v6967: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:49.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:40:48 gibba015 bash[30343]: cluster 2021-03-10T17:40:47.155798+0000 mgr.gibba045.orlgmj (mgr.34412) 12219 : cluster [DBG] pgmap v6967: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:49.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:40:48 gibba045 bash[25517]: cluster 2021-03-10T17:40:47.155798+0000 mgr.gibba045.orlgmj (mgr.34412) 12219 : cluster [DBG] pgmap v6967: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:51.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:40:50 gibba015 bash[29377]: cluster 2021-03-10T17:40:49.157045+0000 mgr.gibba045.orlgmj (mgr.34412) 12220 : cluster [DBG] pgmap v6968: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:51.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:40:50 gibba015 bash[30343]: cluster 2021-03-10T17:40:49.157045+0000 mgr.gibba045.orlgmj (mgr.34412) 12220 : cluster [DBG] pgmap v6968: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:51.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:40:50 gibba045 bash[25517]: cluster 2021-03-10T17:40:49.157045+0000 mgr.gibba045.orlgmj (mgr.34412) 12220 : cluster [DBG] pgmap v6968: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:53.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:40:52 gibba015 bash[29377]: cluster 2021-03-10T17:40:51.157728+0000 mgr.gibba045.orlgmj (mgr.34412) 12221 : cluster [DBG] pgmap v6969: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:53.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:40:52 gibba015 bash[30343]: cluster 2021-03-10T17:40:51.157728+0000 mgr.gibba045.orlgmj (mgr.34412) 12221 : cluster [DBG] pgmap v6969: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:53.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:40:52 gibba045 bash[25517]: cluster 2021-03-10T17:40:51.157728+0000 mgr.gibba045.orlgmj (mgr.34412) 12221 : cluster [DBG] pgmap v6969: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:55.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:40:54 gibba015 bash[29377]: cluster 2021-03-10T17:40:53.158991+0000 mgr.gibba045.orlgmj (mgr.34412) 12222 : cluster [DBG] pgmap v6970: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:55.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:40:54 gibba015 bash[29377]: audit 2021-03-10T17:40:54.169857+0000 mon.c (mon.1) 3348 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:40:55.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:40:54 gibba015 bash[29377]: audit 2021-03-10T17:40:54.170569+0000 mon.c (mon.1) 3349 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:40:55.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:40:54 gibba015 bash[29377]: audit 2021-03-10T17:40:54.170987+0000 mon.a (mon.0) 2519 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:40:55.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:40:54 gibba015 bash[29377]: audit 2021-03-10T17:40:54.172330+0000 mon.a (mon.0) 2520 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:40:55.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:40:54 gibba015 bash[29377]: audit 2021-03-10T17:40:54.296701+0000 mon.c (mon.1) 3350 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T17:40:55.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:40:54 gibba015 bash[29377]: audit 2021-03-10T17:40:54.297505+0000 mon.c (mon.1) 3351 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T17:40:55.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:40:54 gibba015 bash[29377]: audit 2021-03-10T17:40:54.297912+0000 mon.a (mon.0) 2521 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T17:40:55.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:40:54 gibba015 bash[29377]: audit 2021-03-10T17:40:54.298212+0000 mon.c (mon.1) 3352 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:40:55.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:40:54 gibba015 bash[29377]: audit 2021-03-10T17:40:54.298893+0000 mon.c (mon.1) 3353 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T17:40:55.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:40:54 gibba015 bash[29377]: audit 2021-03-10T17:40:54.299660+0000 mon.a (mon.0) 2522 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T17:40:55.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:40:54 gibba015 bash[29377]: audit 2021-03-10T17:40:54.300717+0000 mon.a (mon.0) 2523 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:40:55.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:40:54 gibba015 bash[29377]: audit 2021-03-10T17:40:54.301556+0000 mon.a (mon.0) 2524 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T17:40:55.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:40:54 gibba015 bash[30343]: cluster 2021-03-10T17:40:53.158991+0000 mgr.gibba045.orlgmj (mgr.34412) 12222 : cluster [DBG] pgmap v6970: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:55.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:40:54 gibba015 bash[30343]: audit 2021-03-10T17:40:54.169857+0000 mon.c (mon.1) 3348 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:40:55.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:40:54 gibba015 bash[30343]: audit 2021-03-10T17:40:54.170569+0000 mon.c (mon.1) 3349 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:40:55.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:40:54 gibba015 bash[30343]: audit 2021-03-10T17:40:54.170987+0000 mon.a (mon.0) 2519 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:40:55.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:40:54 gibba015 bash[30343]: audit 2021-03-10T17:40:54.172330+0000 mon.a (mon.0) 2520 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:40:55.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:40:54 gibba015 bash[30343]: audit 2021-03-10T17:40:54.296701+0000 mon.c (mon.1) 3350 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T17:40:55.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:40:54 gibba015 bash[30343]: audit 2021-03-10T17:40:54.297505+0000 mon.c (mon.1) 3351 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T17:40:55.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:40:54 gibba015 bash[30343]: audit 2021-03-10T17:40:54.297912+0000 mon.a (mon.0) 2521 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T17:40:55.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:40:54 gibba015 bash[30343]: audit 2021-03-10T17:40:54.298212+0000 mon.c (mon.1) 3352 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:40:55.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:40:54 gibba015 bash[30343]: audit 2021-03-10T17:40:54.298893+0000 mon.c (mon.1) 3353 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T17:40:55.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:40:54 gibba015 bash[30343]: audit 2021-03-10T17:40:54.299660+0000 mon.a (mon.0) 2522 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T17:40:55.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:40:54 gibba015 bash[30343]: audit 2021-03-10T17:40:54.300717+0000 mon.a (mon.0) 2523 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:40:55.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:40:54 gibba015 bash[30343]: audit 2021-03-10T17:40:54.301556+0000 mon.a (mon.0) 2524 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T17:40:55.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:40:54 gibba045 bash[25517]: cluster 2021-03-10T17:40:53.158991+0000 mgr.gibba045.orlgmj (mgr.34412) 12222 : cluster [DBG] pgmap v6970: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:55.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:40:54 gibba045 bash[25517]: audit 2021-03-10T17:40:54.169857+0000 mon.c (mon.1) 3348 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:40:55.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:40:54 gibba045 bash[25517]: audit 2021-03-10T17:40:54.170569+0000 mon.c (mon.1) 3349 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:40:55.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:40:54 gibba045 bash[25517]: audit 2021-03-10T17:40:54.170987+0000 mon.a (mon.0) 2519 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:40:55.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:40:54 gibba045 bash[25517]: audit 2021-03-10T17:40:54.172330+0000 mon.a (mon.0) 2520 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:40:55.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:40:54 gibba045 bash[25517]: audit 2021-03-10T17:40:54.296701+0000 mon.c (mon.1) 3350 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T17:40:55.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:40:54 gibba045 bash[25517]: audit 2021-03-10T17:40:54.297505+0000 mon.c (mon.1) 3351 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T17:40:55.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:40:54 gibba045 bash[25517]: audit 2021-03-10T17:40:54.297912+0000 mon.a (mon.0) 2521 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T17:40:55.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:40:54 gibba045 bash[25517]: audit 2021-03-10T17:40:54.298212+0000 mon.c (mon.1) 3352 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:40:55.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:40:54 gibba045 bash[25517]: audit 2021-03-10T17:40:54.298893+0000 mon.c (mon.1) 3353 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T17:40:55.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:40:54 gibba045 bash[25517]: audit 2021-03-10T17:40:54.299660+0000 mon.a (mon.0) 2522 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T17:40:55.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:40:54 gibba045 bash[25517]: audit 2021-03-10T17:40:54.300717+0000 mon.a (mon.0) 2523 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:40:55.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:40:54 gibba045 bash[25517]: audit 2021-03-10T17:40:54.301556+0000 mon.a (mon.0) 2524 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T17:40:57.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:40:56 gibba015 bash[29377]: cluster 2021-03-10T17:40:55.160554+0000 mgr.gibba045.orlgmj (mgr.34412) 12223 : cluster [DBG] pgmap v6971: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:57.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:40:56 gibba015 bash[30343]: cluster 2021-03-10T17:40:55.160554+0000 mgr.gibba045.orlgmj (mgr.34412) 12223 : cluster [DBG] pgmap v6971: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:57.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:40:56 gibba045 bash[25517]: cluster 2021-03-10T17:40:55.160554+0000 mgr.gibba045.orlgmj (mgr.34412) 12223 : cluster [DBG] pgmap v6971: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:59.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:40:58 gibba015 bash[29377]: cluster 2021-03-10T17:40:57.161127+0000 mgr.gibba045.orlgmj (mgr.34412) 12224 : cluster [DBG] pgmap v6972: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:59.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:40:58 gibba015 bash[30343]: cluster 2021-03-10T17:40:57.161127+0000 mgr.gibba045.orlgmj (mgr.34412) 12224 : cluster [DBG] pgmap v6972: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:59.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:40:58 gibba045 bash[25517]: cluster 2021-03-10T17:40:57.161127+0000 mgr.gibba045.orlgmj (mgr.34412) 12224 : cluster [DBG] pgmap v6972: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:00.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:40:59 gibba015 bash[29377]: audit 2021-03-10T17:40:59.665169+0000 mon.c (mon.1) 3354 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:41:00.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:40:59 gibba015 bash[30343]: audit 2021-03-10T17:40:59.665169+0000 mon.c (mon.1) 3354 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:41:00.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:40:59 gibba045 bash[25517]: audit 2021-03-10T17:40:59.665169+0000 mon.c (mon.1) 3354 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:41:01.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:41:00 gibba015 bash[29377]: cluster 2021-03-10T17:40:59.162336+0000 mgr.gibba045.orlgmj (mgr.34412) 12225 : cluster [DBG] pgmap v6973: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:01.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:41:00 gibba015 bash[29377]: cephadm 2021-03-10T17:40:59.668999+0000 mgr.gibba045.orlgmj (mgr.34412) 12226 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:41:01.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:41:00 gibba015 bash[29377]: cephadm 2021-03-10T17:40:59.669354+0000 mgr.gibba045.orlgmj (mgr.34412) 12227 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:41:01.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:41:00 gibba015 bash[29377]: audit 2021-03-10T17:40:59.869993+0000 mon.a (mon.0) 2525 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:41:01.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:41:00 gibba015 bash[29377]: audit 2021-03-10T17:40:59.873930+0000 mon.c (mon.1) 3355 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:41:01.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:41:00 gibba015 bash[29377]: audit 2021-03-10T17:40:59.874961+0000 mon.c (mon.1) 3356 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:41:01.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:41:00 gibba015 bash[29377]: cephadm 2021-03-10T17:40:59.875219+0000 mgr.gibba045.orlgmj (mgr.34412) 12228 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:41:01.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:41:00 gibba015 bash[29377]: audit 2021-03-10T17:40:59.876083+0000 mon.c (mon.1) 3357 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:41:01.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:41:00 gibba015 bash[29377]: cephadm 2021-03-10T17:40:59.876608+0000 mgr.gibba045.orlgmj (mgr.34412) 12229 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:41:01.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:41:00 gibba015 bash[29377]: audit 2021-03-10T17:40:59.877339+0000 mon.c (mon.1) 3358 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:41:01.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:41:00 gibba015 bash[29377]: cephadm 2021-03-10T17:40:59.877550+0000 mgr.gibba045.orlgmj (mgr.34412) 12230 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:41:01.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:41:00 gibba015 bash[29377]: cephadm 2021-03-10T17:40:59.877590+0000 mgr.gibba045.orlgmj (mgr.34412) 12231 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:41:01.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:41:00 gibba015 bash[29377]: cephadm 2021-03-10T17:40:59.878604+0000 mgr.gibba045.orlgmj (mgr.34412) 12232 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:41:01.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:41:00 gibba015 bash[29377]: cephadm 2021-03-10T17:40:59.878640+0000 mgr.gibba045.orlgmj (mgr.34412) 12233 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:41:01.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:41:00 gibba015 bash[29377]: cephadm 2021-03-10T17:40:59.880836+0000 mgr.gibba045.orlgmj (mgr.34412) 12234 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:41:01.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:41:00 gibba015 bash[29377]: audit 2021-03-10T17:40:59.883205+0000 mon.c (mon.1) 3359 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:41:01.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:41:00 gibba015 bash[29377]: cephadm 2021-03-10T17:40:59.884305+0000 mgr.gibba045.orlgmj (mgr.34412) 12235 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:41:01.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:41:00 gibba015 bash[29377]: cephadm 2021-03-10T17:40:59.884354+0000 mgr.gibba045.orlgmj (mgr.34412) 12236 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:41:01.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:41:00 gibba015 bash[29377]: audit 2021-03-10T17:40:59.885833+0000 mon.c (mon.1) 3360 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:41:01.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:41:00 gibba015 bash[29377]: cephadm 2021-03-10T17:40:59.886840+0000 mgr.gibba045.orlgmj (mgr.34412) 12237 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:41:01.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:41:00 gibba015 bash[30343]: cluster 2021-03-10T17:40:59.162336+0000 mgr.gibba045.orlgmj (mgr.34412) 12225 : cluster [DBG] pgmap v6973: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:01.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:41:00 gibba015 bash[30343]: cephadm 2021-03-10T17:40:59.668999+0000 mgr.gibba045.orlgmj (mgr.34412) 12226 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:41:01.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:41:00 gibba015 bash[30343]: cephadm 2021-03-10T17:40:59.669354+0000 mgr.gibba045.orlgmj (mgr.34412) 12227 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:41:01.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:41:00 gibba015 bash[30343]: audit 2021-03-10T17:40:59.869993+0000 mon.a (mon.0) 2525 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:41:01.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:41:00 gibba015 bash[30343]: audit 2021-03-10T17:40:59.873930+0000 mon.c (mon.1) 3355 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:41:01.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:41:00 gibba015 bash[30343]: audit 2021-03-10T17:40:59.874961+0000 mon.c (mon.1) 3356 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:41:01.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:41:00 gibba015 bash[30343]: cephadm 2021-03-10T17:40:59.875219+0000 mgr.gibba045.orlgmj (mgr.34412) 12228 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:41:01.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:41:00 gibba015 bash[30343]: audit 2021-03-10T17:40:59.876083+0000 mon.c (mon.1) 3357 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:41:01.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:41:00 gibba015 bash[30343]: cephadm 2021-03-10T17:40:59.876608+0000 mgr.gibba045.orlgmj (mgr.34412) 12229 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:41:01.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:41:00 gibba015 bash[30343]: audit 2021-03-10T17:40:59.877339+0000 mon.c (mon.1) 3358 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:41:01.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:41:00 gibba015 bash[30343]: cephadm 2021-03-10T17:40:59.877550+0000 mgr.gibba045.orlgmj (mgr.34412) 12230 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:41:01.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:41:00 gibba015 bash[30343]: cephadm 2021-03-10T17:40:59.877590+0000 mgr.gibba045.orlgmj (mgr.34412) 12231 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:41:01.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:41:00 gibba015 bash[30343]: cephadm 2021-03-10T17:40:59.878604+0000 mgr.gibba045.orlgmj (mgr.34412) 12232 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:41:01.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:41:00 gibba015 bash[30343]: cephadm 2021-03-10T17:40:59.878640+0000 mgr.gibba045.orlgmj (mgr.34412) 12233 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:41:01.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:41:00 gibba015 bash[30343]: cephadm 2021-03-10T17:40:59.880836+0000 mgr.gibba045.orlgmj (mgr.34412) 12234 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:41:01.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:41:00 gibba015 bash[30343]: audit 2021-03-10T17:40:59.883205+0000 mon.c (mon.1) 3359 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:41:01.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:41:00 gibba015 bash[30343]: cephadm 2021-03-10T17:40:59.884305+0000 mgr.gibba045.orlgmj (mgr.34412) 12235 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:41:01.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:41:00 gibba015 bash[30343]: cephadm 2021-03-10T17:40:59.884354+0000 mgr.gibba045.orlgmj (mgr.34412) 12236 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:41:01.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:41:00 gibba015 bash[30343]: audit 2021-03-10T17:40:59.885833+0000 mon.c (mon.1) 3360 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:41:01.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:41:00 gibba015 bash[30343]: cephadm 2021-03-10T17:40:59.886840+0000 mgr.gibba045.orlgmj (mgr.34412) 12237 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:41:01.234 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:41:00 gibba015 bash[29377]: cephadm 2021-03-10T17:40:59.887150+0000 mgr.gibba045.orlgmj (mgr.34412) 12238 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:41:01.234 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:41:00 gibba015 bash[29377]: cephadm 2021-03-10T17:40:59.889782+0000 mgr.gibba045.orlgmj (mgr.34412) 12239 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:41:01.234 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:41:00 gibba015 bash[29377]: cephadm 2021-03-10T17:40:59.889819+0000 mgr.gibba045.orlgmj (mgr.34412) 12240 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:41:01.235 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:41:00 gibba015 bash[29377]: cephadm 2021-03-10T17:40:59.889950+0000 mgr.gibba045.orlgmj (mgr.34412) 12241 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:41:01.235 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:41:00 gibba015 bash[30343]: cephadm 2021-03-10T17:40:59.887150+0000 mgr.gibba045.orlgmj (mgr.34412) 12238 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:41:01.235 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:41:00 gibba015 bash[30343]: cephadm 2021-03-10T17:40:59.889782+0000 mgr.gibba045.orlgmj (mgr.34412) 12239 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:41:01.235 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:41:00 gibba015 bash[30343]: cephadm 2021-03-10T17:40:59.889819+0000 mgr.gibba045.orlgmj (mgr.34412) 12240 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:41:01.236 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:41:00 gibba015 bash[30343]: cephadm 2021-03-10T17:40:59.889950+0000 mgr.gibba045.orlgmj (mgr.34412) 12241 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:41:01.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:41:00 gibba045 bash[25517]: cluster 2021-03-10T17:40:59.162336+0000 mgr.gibba045.orlgmj (mgr.34412) 12225 : cluster [DBG] pgmap v6973: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:01.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:41:00 gibba045 bash[25517]: cephadm 2021-03-10T17:40:59.668999+0000 mgr.gibba045.orlgmj (mgr.34412) 12226 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:41:01.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:41:00 gibba045 bash[25517]: cephadm 2021-03-10T17:40:59.669354+0000 mgr.gibba045.orlgmj (mgr.34412) 12227 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:41:01.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:41:00 gibba045 bash[25517]: audit 2021-03-10T17:40:59.869993+0000 mon.a (mon.0) 2525 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:41:01.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:41:00 gibba045 bash[25517]: audit 2021-03-10T17:40:59.873930+0000 mon.c (mon.1) 3355 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:41:01.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:41:00 gibba045 bash[25517]: audit 2021-03-10T17:40:59.874961+0000 mon.c (mon.1) 3356 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:41:01.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:41:00 gibba045 bash[25517]: cephadm 2021-03-10T17:40:59.875219+0000 mgr.gibba045.orlgmj (mgr.34412) 12228 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:41:01.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:41:00 gibba045 bash[25517]: audit 2021-03-10T17:40:59.876083+0000 mon.c (mon.1) 3357 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:41:01.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:41:00 gibba045 bash[25517]: cephadm 2021-03-10T17:40:59.876608+0000 mgr.gibba045.orlgmj (mgr.34412) 12229 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:41:01.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:41:00 gibba045 bash[25517]: audit 2021-03-10T17:40:59.877339+0000 mon.c (mon.1) 3358 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:41:01.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:41:00 gibba045 bash[25517]: cephadm 2021-03-10T17:40:59.877550+0000 mgr.gibba045.orlgmj (mgr.34412) 12230 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:41:01.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:41:00 gibba045 bash[25517]: cephadm 2021-03-10T17:40:59.877590+0000 mgr.gibba045.orlgmj (mgr.34412) 12231 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:41:01.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:41:00 gibba045 bash[25517]: cephadm 2021-03-10T17:40:59.878604+0000 mgr.gibba045.orlgmj (mgr.34412) 12232 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:41:01.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:41:00 gibba045 bash[25517]: cephadm 2021-03-10T17:40:59.878640+0000 mgr.gibba045.orlgmj (mgr.34412) 12233 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:41:01.314 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:41:00 gibba045 bash[25517]: cephadm 2021-03-10T17:40:59.880836+0000 mgr.gibba045.orlgmj (mgr.34412) 12234 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:41:01.315 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:41:00 gibba045 bash[25517]: audit 2021-03-10T17:40:59.883205+0000 mon.c (mon.1) 3359 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:41:01.315 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:41:00 gibba045 bash[25517]: cephadm 2021-03-10T17:40:59.884305+0000 mgr.gibba045.orlgmj (mgr.34412) 12235 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:41:01.315 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:41:00 gibba045 bash[25517]: cephadm 2021-03-10T17:40:59.884354+0000 mgr.gibba045.orlgmj (mgr.34412) 12236 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:41:01.315 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:41:00 gibba045 bash[25517]: audit 2021-03-10T17:40:59.885833+0000 mon.c (mon.1) 3360 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:41:01.315 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:41:00 gibba045 bash[25517]: cephadm 2021-03-10T17:40:59.886840+0000 mgr.gibba045.orlgmj (mgr.34412) 12237 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:41:01.316 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:41:00 gibba045 bash[25517]: cephadm 2021-03-10T17:40:59.887150+0000 mgr.gibba045.orlgmj (mgr.34412) 12238 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:41:01.316 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:41:00 gibba045 bash[25517]: cephadm 2021-03-10T17:40:59.889782+0000 mgr.gibba045.orlgmj (mgr.34412) 12239 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:41:01.316 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:41:00 gibba045 bash[25517]: cephadm 2021-03-10T17:40:59.889819+0000 mgr.gibba045.orlgmj (mgr.34412) 12240 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:41:01.316 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:41:00 gibba045 bash[25517]: cephadm 2021-03-10T17:40:59.889950+0000 mgr.gibba045.orlgmj (mgr.34412) 12241 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:41:03.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:41:02 gibba015 bash[29377]: cluster 2021-03-10T17:41:01.164033+0000 mgr.gibba045.orlgmj (mgr.34412) 12242 : cluster [DBG] pgmap v6974: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:03.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:41:02 gibba015 bash[30343]: cluster 2021-03-10T17:41:01.164033+0000 mgr.gibba045.orlgmj (mgr.34412) 12242 : cluster [DBG] pgmap v6974: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:03.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:41:02 gibba045 bash[25517]: cluster 2021-03-10T17:41:01.164033+0000 mgr.gibba045.orlgmj (mgr.34412) 12242 : cluster [DBG] pgmap v6974: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:05.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:41:04 gibba015 bash[29377]: cluster 2021-03-10T17:41:03.164965+0000 mgr.gibba045.orlgmj (mgr.34412) 12243 : cluster [DBG] pgmap v6975: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:05.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:41:04 gibba015 bash[30343]: cluster 2021-03-10T17:41:03.164965+0000 mgr.gibba045.orlgmj (mgr.34412) 12243 : cluster [DBG] pgmap v6975: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:05.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:41:04 gibba045 bash[25517]: cluster 2021-03-10T17:41:03.164965+0000 mgr.gibba045.orlgmj (mgr.34412) 12243 : cluster [DBG] pgmap v6975: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:07.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:41:06 gibba015 bash[29377]: cluster 2021-03-10T17:41:05.166516+0000 mgr.gibba045.orlgmj (mgr.34412) 12244 : cluster [DBG] pgmap v6976: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:07.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:41:06 gibba015 bash[30343]: cluster 2021-03-10T17:41:05.166516+0000 mgr.gibba045.orlgmj (mgr.34412) 12244 : cluster [DBG] pgmap v6976: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:07.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:41:06 gibba045 bash[25517]: cluster 2021-03-10T17:41:05.166516+0000 mgr.gibba045.orlgmj (mgr.34412) 12244 : cluster [DBG] pgmap v6976: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:07.474 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:41:07.698 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:41:07.699 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 3m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:41:07.699 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 2m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:41:07.699 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 2m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:41:07.700 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 2m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:41:07.700 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 3m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:41:07.700 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 3m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:41:07.700 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 2m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:41:07.700 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 3m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:41:07.701 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 3m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:41:07.701 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 2m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:41:07.701 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 3m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:41:07.701 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:41:07.702 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:41:07.702 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:41:07.702 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:41:07.702 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:41:07.702 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:41:07.703 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:41:07.703 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 2m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:41:07.703 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 2m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:41:07.945 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:41:07.946 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:41:07.946 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:41:07.946 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:41:07.946 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:41:07.947 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:41:07.947 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:41:07.947 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:41:07.947 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:41:07.948 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:41:07.948 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:41:07.948 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:41:07.948 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:41:07.948 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:41:07.949 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:41:09.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:41:08 gibba015 bash[29377]: cluster 2021-03-10T17:41:07.167995+0000 mgr.gibba045.orlgmj (mgr.34412) 12245 : cluster [DBG] pgmap v6977: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:09.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:41:08 gibba015 bash[29377]: audit 2021-03-10T17:41:07.464274+0000 mgr.gibba045.orlgmj (mgr.34412) 12246 : audit [DBG] from='client.52260 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:41:09.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:41:08 gibba015 bash[29377]: audit 2021-03-10T17:41:07.685602+0000 mgr.gibba045.orlgmj (mgr.34412) 12247 : audit [DBG] from='client.62251 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:41:09.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:41:08 gibba015 bash[29377]: audit 2021-03-10T17:41:07.942963+0000 mon.c (mon.1) 3361 : audit [DBG] from='client.? 172.21.2.115:0/1258170049' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:41:09.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:41:08 gibba015 bash[30343]: cluster 2021-03-10T17:41:07.167995+0000 mgr.gibba045.orlgmj (mgr.34412) 12245 : cluster [DBG] pgmap v6977: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:09.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:41:08 gibba015 bash[30343]: audit 2021-03-10T17:41:07.464274+0000 mgr.gibba045.orlgmj (mgr.34412) 12246 : audit [DBG] from='client.52260 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:41:09.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:41:08 gibba015 bash[30343]: audit 2021-03-10T17:41:07.685602+0000 mgr.gibba045.orlgmj (mgr.34412) 12247 : audit [DBG] from='client.62251 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:41:09.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:41:08 gibba015 bash[30343]: audit 2021-03-10T17:41:07.942963+0000 mon.c (mon.1) 3361 : audit [DBG] from='client.? 172.21.2.115:0/1258170049' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:41:09.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:41:08 gibba045 bash[25517]: cluster 2021-03-10T17:41:07.167995+0000 mgr.gibba045.orlgmj (mgr.34412) 12245 : cluster [DBG] pgmap v6977: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:09.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:41:08 gibba045 bash[25517]: audit 2021-03-10T17:41:07.464274+0000 mgr.gibba045.orlgmj (mgr.34412) 12246 : audit [DBG] from='client.52260 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:41:09.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:41:08 gibba045 bash[25517]: audit 2021-03-10T17:41:07.685602+0000 mgr.gibba045.orlgmj (mgr.34412) 12247 : audit [DBG] from='client.62251 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:41:09.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:41:08 gibba045 bash[25517]: audit 2021-03-10T17:41:07.942963+0000 mon.c (mon.1) 3361 : audit [DBG] from='client.? 172.21.2.115:0/1258170049' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:41:11.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:41:10 gibba015 bash[29377]: cluster 2021-03-10T17:41:09.169522+0000 mgr.gibba045.orlgmj (mgr.34412) 12248 : cluster [DBG] pgmap v6978: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:11.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:41:10 gibba015 bash[30343]: cluster 2021-03-10T17:41:09.169522+0000 mgr.gibba045.orlgmj (mgr.34412) 12248 : cluster [DBG] pgmap v6978: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:11.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:41:10 gibba045 bash[25517]: cluster 2021-03-10T17:41:09.169522+0000 mgr.gibba045.orlgmj (mgr.34412) 12248 : cluster [DBG] pgmap v6978: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:13.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:41:12 gibba015 bash[29377]: cluster 2021-03-10T17:41:11.171403+0000 mgr.gibba045.orlgmj (mgr.34412) 12249 : cluster [DBG] pgmap v6979: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:13.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:41:12 gibba015 bash[30343]: cluster 2021-03-10T17:41:11.171403+0000 mgr.gibba045.orlgmj (mgr.34412) 12249 : cluster [DBG] pgmap v6979: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:13.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:41:12 gibba045 bash[25517]: cluster 2021-03-10T17:41:11.171403+0000 mgr.gibba045.orlgmj (mgr.34412) 12249 : cluster [DBG] pgmap v6979: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:15.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:41:14 gibba015 bash[29377]: cluster 2021-03-10T17:41:13.173208+0000 mgr.gibba045.orlgmj (mgr.34412) 12250 : cluster [DBG] pgmap v6980: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:15.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:41:14 gibba015 bash[30343]: cluster 2021-03-10T17:41:13.173208+0000 mgr.gibba045.orlgmj (mgr.34412) 12250 : cluster [DBG] pgmap v6980: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:15.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:41:14 gibba045 bash[25517]: cluster 2021-03-10T17:41:13.173208+0000 mgr.gibba045.orlgmj (mgr.34412) 12250 : cluster [DBG] pgmap v6980: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:16.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:41:15 gibba015 bash[29377]: cephadm 2021-03-10T17:41:14.906042+0000 mgr.gibba045.orlgmj (mgr.34412) 12251 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:41:16.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:41:15 gibba015 bash[30343]: cephadm 2021-03-10T17:41:14.906042+0000 mgr.gibba045.orlgmj (mgr.34412) 12251 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:41:16.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:41:15 gibba045 bash[25517]: cephadm 2021-03-10T17:41:14.906042+0000 mgr.gibba045.orlgmj (mgr.34412) 12251 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:41:17.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:41:16 gibba015 bash[29377]: cluster 2021-03-10T17:41:15.174888+0000 mgr.gibba045.orlgmj (mgr.34412) 12252 : cluster [DBG] pgmap v6981: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:17.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:41:16 gibba015 bash[30343]: cluster 2021-03-10T17:41:15.174888+0000 mgr.gibba045.orlgmj (mgr.34412) 12252 : cluster [DBG] pgmap v6981: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:17.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:41:16 gibba045 bash[25517]: cluster 2021-03-10T17:41:15.174888+0000 mgr.gibba045.orlgmj (mgr.34412) 12252 : cluster [DBG] pgmap v6981: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:19.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:41:18 gibba015 bash[29377]: cluster 2021-03-10T17:41:17.176699+0000 mgr.gibba045.orlgmj (mgr.34412) 12253 : cluster [DBG] pgmap v6982: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:19.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:41:18 gibba015 bash[30343]: cluster 2021-03-10T17:41:17.176699+0000 mgr.gibba045.orlgmj (mgr.34412) 12253 : cluster [DBG] pgmap v6982: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:19.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:41:18 gibba045 bash[25517]: cluster 2021-03-10T17:41:17.176699+0000 mgr.gibba045.orlgmj (mgr.34412) 12253 : cluster [DBG] pgmap v6982: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:21.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:41:20 gibba015 bash[29377]: cluster 2021-03-10T17:41:19.177978+0000 mgr.gibba045.orlgmj (mgr.34412) 12254 : cluster [DBG] pgmap v6983: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:21.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:41:20 gibba015 bash[30343]: cluster 2021-03-10T17:41:19.177978+0000 mgr.gibba045.orlgmj (mgr.34412) 12254 : cluster [DBG] pgmap v6983: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:21.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:41:20 gibba045 bash[25517]: cluster 2021-03-10T17:41:19.177978+0000 mgr.gibba045.orlgmj (mgr.34412) 12254 : cluster [DBG] pgmap v6983: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:23.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:41:22 gibba045 bash[25517]: cluster 2021-03-10T17:41:21.178843+0000 mgr.gibba045.orlgmj (mgr.34412) 12255 : cluster [DBG] pgmap v6984: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:23.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:41:22 gibba015 bash[29377]: cluster 2021-03-10T17:41:21.178843+0000 mgr.gibba045.orlgmj (mgr.34412) 12255 : cluster [DBG] pgmap v6984: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:23.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:41:22 gibba015 bash[30343]: cluster 2021-03-10T17:41:21.178843+0000 mgr.gibba045.orlgmj (mgr.34412) 12255 : cluster [DBG] pgmap v6984: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:25.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:41:24 gibba045 bash[25517]: cluster 2021-03-10T17:41:23.180128+0000 mgr.gibba045.orlgmj (mgr.34412) 12256 : cluster [DBG] pgmap v6985: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:25.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:41:24 gibba015 bash[29377]: cluster 2021-03-10T17:41:23.180128+0000 mgr.gibba045.orlgmj (mgr.34412) 12256 : cluster [DBG] pgmap v6985: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:25.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:41:24 gibba015 bash[30343]: cluster 2021-03-10T17:41:23.180128+0000 mgr.gibba045.orlgmj (mgr.34412) 12256 : cluster [DBG] pgmap v6985: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:27.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:41:26 gibba045 bash[25517]: cluster 2021-03-10T17:41:25.181651+0000 mgr.gibba045.orlgmj (mgr.34412) 12257 : cluster [DBG] pgmap v6986: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:27.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:41:26 gibba015 bash[29377]: cluster 2021-03-10T17:41:25.181651+0000 mgr.gibba045.orlgmj (mgr.34412) 12257 : cluster [DBG] pgmap v6986: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:27.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:41:26 gibba015 bash[30343]: cluster 2021-03-10T17:41:25.181651+0000 mgr.gibba045.orlgmj (mgr.34412) 12257 : cluster [DBG] pgmap v6986: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:29.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:41:29 gibba045 bash[25517]: cluster 2021-03-10T17:41:27.183385+0000 mgr.gibba045.orlgmj (mgr.34412) 12258 : cluster [DBG] pgmap v6987: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:29.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:41:29 gibba015 bash[29377]: cluster 2021-03-10T17:41:27.183385+0000 mgr.gibba045.orlgmj (mgr.34412) 12258 : cluster [DBG] pgmap v6987: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:29.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:41:29 gibba015 bash[30343]: cluster 2021-03-10T17:41:27.183385+0000 mgr.gibba045.orlgmj (mgr.34412) 12258 : cluster [DBG] pgmap v6987: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:31.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:41:31 gibba045 bash[25517]: cluster 2021-03-10T17:41:29.184586+0000 mgr.gibba045.orlgmj (mgr.34412) 12259 : cluster [DBG] pgmap v6988: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:31.344 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:41:31 gibba045 bash[25517]: cephadm 2021-03-10T17:41:29.917084+0000 mgr.gibba045.orlgmj (mgr.34412) 12260 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:41:31.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:41:31 gibba015 bash[29377]: cluster 2021-03-10T17:41:29.184586+0000 mgr.gibba045.orlgmj (mgr.34412) 12259 : cluster [DBG] pgmap v6988: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:31.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:41:31 gibba015 bash[29377]: cephadm 2021-03-10T17:41:29.917084+0000 mgr.gibba045.orlgmj (mgr.34412) 12260 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:41:31.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:41:31 gibba015 bash[30343]: cluster 2021-03-10T17:41:29.184586+0000 mgr.gibba045.orlgmj (mgr.34412) 12259 : cluster [DBG] pgmap v6988: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:31.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:41:31 gibba015 bash[30343]: cephadm 2021-03-10T17:41:29.917084+0000 mgr.gibba045.orlgmj (mgr.34412) 12260 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:41:33.306 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:41:33 gibba045 bash[25517]: cluster 2021-03-10T17:41:31.186300+0000 mgr.gibba045.orlgmj (mgr.34412) 12261 : cluster [DBG] pgmap v6989: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:33.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:41:33 gibba015 bash[29377]: cluster 2021-03-10T17:41:31.186300+0000 mgr.gibba045.orlgmj (mgr.34412) 12261 : cluster [DBG] pgmap v6989: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:33.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:41:33 gibba015 bash[30343]: cluster 2021-03-10T17:41:31.186300+0000 mgr.gibba045.orlgmj (mgr.34412) 12261 : cluster [DBG] pgmap v6989: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:35.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:41:35 gibba045 bash[25517]: cluster 2021-03-10T17:41:33.187814+0000 mgr.gibba045.orlgmj (mgr.34412) 12262 : cluster [DBG] pgmap v6990: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:35.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:41:35 gibba015 bash[29377]: cluster 2021-03-10T17:41:33.187814+0000 mgr.gibba045.orlgmj (mgr.34412) 12262 : cluster [DBG] pgmap v6990: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:35.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:41:35 gibba015 bash[30343]: cluster 2021-03-10T17:41:33.187814+0000 mgr.gibba045.orlgmj (mgr.34412) 12262 : cluster [DBG] pgmap v6990: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:37.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:41:37 gibba045 bash[25517]: cluster 2021-03-10T17:41:35.189477+0000 mgr.gibba045.orlgmj (mgr.34412) 12263 : cluster [DBG] pgmap v6991: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:37.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:41:37 gibba015 bash[29377]: cluster 2021-03-10T17:41:35.189477+0000 mgr.gibba045.orlgmj (mgr.34412) 12263 : cluster [DBG] pgmap v6991: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:37.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:41:37 gibba015 bash[30343]: cluster 2021-03-10T17:41:35.189477+0000 mgr.gibba045.orlgmj (mgr.34412) 12263 : cluster [DBG] pgmap v6991: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:38.188 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:41:38.416 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:41:38.416 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 3m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:41:38.417 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 2m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:41:38.417 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 2m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:41:38.418 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 2m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:41:38.418 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 3m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:41:38.418 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 3m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:41:38.419 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 2m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:41:38.419 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 3m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:41:38.419 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 3m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:41:38.420 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 2m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:41:38.420 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 3m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:41:38.420 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 3m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:41:38.420 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 3m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:41:38.421 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:41:38.421 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:41:38.421 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:41:38.421 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:41:38.421 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:41:38.422 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 2m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:41:38.422 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 2m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:41:38.668 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:41:38.668 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:41:38.668 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:41:38.668 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:41:38.669 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:41:38.669 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:41:38.669 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:41:38.669 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:41:38.670 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:41:38.670 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:41:38.670 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:41:38.670 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:41:38.671 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:41:38.671 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:41:38.671 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:41:39.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:41:39 gibba045 bash[25517]: cluster 2021-03-10T17:41:37.191077+0000 mgr.gibba045.orlgmj (mgr.34412) 12264 : cluster [DBG] pgmap v6992: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:39.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:41:39 gibba045 bash[25517]: audit 2021-03-10T17:41:38.665141+0000 mon.c (mon.1) 3362 : audit [DBG] from='client.? 172.21.2.115:0/4216030128' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:41:39.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:41:39 gibba015 bash[29377]: cluster 2021-03-10T17:41:37.191077+0000 mgr.gibba045.orlgmj (mgr.34412) 12264 : cluster [DBG] pgmap v6992: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:39.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:41:39 gibba015 bash[29377]: audit 2021-03-10T17:41:38.665141+0000 mon.c (mon.1) 3362 : audit [DBG] from='client.? 172.21.2.115:0/4216030128' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:41:39.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:41:39 gibba015 bash[30343]: cluster 2021-03-10T17:41:37.191077+0000 mgr.gibba045.orlgmj (mgr.34412) 12264 : cluster [DBG] pgmap v6992: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:39.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:41:39 gibba015 bash[30343]: audit 2021-03-10T17:41:38.665141+0000 mon.c (mon.1) 3362 : audit [DBG] from='client.? 172.21.2.115:0/4216030128' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:41:40.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:41:40 gibba045 bash[25517]: audit 2021-03-10T17:41:38.178456+0000 mgr.gibba045.orlgmj (mgr.34412) 12265 : audit [DBG] from='client.52278 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:41:40.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:41:40 gibba045 bash[25517]: audit 2021-03-10T17:41:38.403049+0000 mgr.gibba045.orlgmj (mgr.34412) 12266 : audit [DBG] from='client.52284 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:41:40.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:41:40 gibba015 bash[29377]: audit 2021-03-10T17:41:38.178456+0000 mgr.gibba045.orlgmj (mgr.34412) 12265 : audit [DBG] from='client.52278 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:41:40.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:41:40 gibba015 bash[29377]: audit 2021-03-10T17:41:38.403049+0000 mgr.gibba045.orlgmj (mgr.34412) 12266 : audit [DBG] from='client.52284 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:41:40.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:41:40 gibba015 bash[30343]: audit 2021-03-10T17:41:38.178456+0000 mgr.gibba045.orlgmj (mgr.34412) 12265 : audit [DBG] from='client.52278 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:41:40.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:41:40 gibba015 bash[30343]: audit 2021-03-10T17:41:38.403049+0000 mgr.gibba045.orlgmj (mgr.34412) 12266 : audit [DBG] from='client.52284 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:41:41.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:41:41 gibba015 bash[29377]: cluster 2021-03-10T17:41:39.192276+0000 mgr.gibba045.orlgmj (mgr.34412) 12267 : cluster [DBG] pgmap v6993: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:41.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:41:41 gibba015 bash[30343]: cluster 2021-03-10T17:41:39.192276+0000 mgr.gibba045.orlgmj (mgr.34412) 12267 : cluster [DBG] pgmap v6993: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:41.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:41:41 gibba045 bash[25517]: cluster 2021-03-10T17:41:39.192276+0000 mgr.gibba045.orlgmj (mgr.34412) 12267 : cluster [DBG] pgmap v6993: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:43.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:41:43 gibba015 bash[29377]: cluster 2021-03-10T17:41:41.194099+0000 mgr.gibba045.orlgmj (mgr.34412) 12268 : cluster [DBG] pgmap v6994: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:43.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:41:43 gibba015 bash[30343]: cluster 2021-03-10T17:41:41.194099+0000 mgr.gibba045.orlgmj (mgr.34412) 12268 : cluster [DBG] pgmap v6994: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:43.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:41:43 gibba045 bash[25517]: cluster 2021-03-10T17:41:41.194099+0000 mgr.gibba045.orlgmj (mgr.34412) 12268 : cluster [DBG] pgmap v6994: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:45.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:41:45 gibba045 bash[25517]: cluster 2021-03-10T17:41:43.195760+0000 mgr.gibba045.orlgmj (mgr.34412) 12269 : cluster [DBG] pgmap v6995: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:45.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:41:45 gibba015 bash[29377]: cluster 2021-03-10T17:41:43.195760+0000 mgr.gibba045.orlgmj (mgr.34412) 12269 : cluster [DBG] pgmap v6995: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:45.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:41:45 gibba015 bash[30343]: cluster 2021-03-10T17:41:43.195760+0000 mgr.gibba045.orlgmj (mgr.34412) 12269 : cluster [DBG] pgmap v6995: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:46.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:41:46 gibba015 bash[29377]: cephadm 2021-03-10T17:41:44.933059+0000 mgr.gibba045.orlgmj (mgr.34412) 12270 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:41:46.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:41:46 gibba015 bash[30343]: cephadm 2021-03-10T17:41:44.933059+0000 mgr.gibba045.orlgmj (mgr.34412) 12270 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:41:46.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:41:46 gibba045 bash[25517]: cephadm 2021-03-10T17:41:44.933059+0000 mgr.gibba045.orlgmj (mgr.34412) 12270 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:41:47.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:41:47 gibba015 bash[29377]: cluster 2021-03-10T17:41:45.196959+0000 mgr.gibba045.orlgmj (mgr.34412) 12271 : cluster [DBG] pgmap v6996: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:47.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:41:47 gibba015 bash[30343]: cluster 2021-03-10T17:41:45.196959+0000 mgr.gibba045.orlgmj (mgr.34412) 12271 : cluster [DBG] pgmap v6996: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:47.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:41:47 gibba045 bash[25517]: cluster 2021-03-10T17:41:45.196959+0000 mgr.gibba045.orlgmj (mgr.34412) 12271 : cluster [DBG] pgmap v6996: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:48.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:41:48 gibba015 bash[29377]: cluster 2021-03-10T17:41:47.198661+0000 mgr.gibba045.orlgmj (mgr.34412) 12272 : cluster [DBG] pgmap v6997: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:48.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:41:48 gibba015 bash[30343]: cluster 2021-03-10T17:41:47.198661+0000 mgr.gibba045.orlgmj (mgr.34412) 12272 : cluster [DBG] pgmap v6997: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:48.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:41:48 gibba045 bash[25517]: cluster 2021-03-10T17:41:47.198661+0000 mgr.gibba045.orlgmj (mgr.34412) 12272 : cluster [DBG] pgmap v6997: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:50.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:41:50 gibba015 bash[29377]: cluster 2021-03-10T17:41:49.199871+0000 mgr.gibba045.orlgmj (mgr.34412) 12273 : cluster [DBG] pgmap v6998: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:50.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:41:50 gibba015 bash[30343]: cluster 2021-03-10T17:41:49.199871+0000 mgr.gibba045.orlgmj (mgr.34412) 12273 : cluster [DBG] pgmap v6998: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:50.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:41:50 gibba045 bash[25517]: cluster 2021-03-10T17:41:49.199871+0000 mgr.gibba045.orlgmj (mgr.34412) 12273 : cluster [DBG] pgmap v6998: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:52.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:41:52 gibba015 bash[29377]: cluster 2021-03-10T17:41:51.200934+0000 mgr.gibba045.orlgmj (mgr.34412) 12274 : cluster [DBG] pgmap v6999: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:52.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:41:52 gibba015 bash[30343]: cluster 2021-03-10T17:41:51.200934+0000 mgr.gibba045.orlgmj (mgr.34412) 12274 : cluster [DBG] pgmap v6999: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:52.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:41:52 gibba045 bash[25517]: cluster 2021-03-10T17:41:51.200934+0000 mgr.gibba045.orlgmj (mgr.34412) 12274 : cluster [DBG] pgmap v6999: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:54.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:41:54 gibba015 bash[30343]: cluster 2021-03-10T17:41:53.202332+0000 mgr.gibba045.orlgmj (mgr.34412) 12275 : cluster [DBG] pgmap v7000: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:54.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:41:54 gibba015 bash[30343]: audit 2021-03-10T17:41:54.174733+0000 mon.c (mon.1) 3363 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:41:54.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:41:54 gibba015 bash[30343]: audit 2021-03-10T17:41:54.175376+0000 mon.c (mon.1) 3364 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:41:54.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:41:54 gibba015 bash[30343]: audit 2021-03-10T17:41:54.176001+0000 mon.a (mon.0) 2526 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:41:54.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:41:54 gibba015 bash[30343]: audit 2021-03-10T17:41:54.177216+0000 mon.a (mon.0) 2527 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:41:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:41:54 gibba015 bash[30343]: audit 2021-03-10T17:41:54.308404+0000 mon.c (mon.1) 3365 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T17:41:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:41:54 gibba015 bash[30343]: audit 2021-03-10T17:41:54.309181+0000 mon.c (mon.1) 3366 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:41:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:41:54 gibba015 bash[30343]: audit 2021-03-10T17:41:54.309814+0000 mon.a (mon.0) 2528 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T17:41:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:41:54 gibba015 bash[30343]: audit 2021-03-10T17:41:54.309877+0000 mon.c (mon.1) 3367 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T17:41:54.725 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:41:54 gibba015 bash[30343]: audit 2021-03-10T17:41:54.310519+0000 mon.c (mon.1) 3368 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T17:41:54.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:41:54 gibba015 bash[30343]: audit 2021-03-10T17:41:54.312044+0000 mon.a (mon.0) 2529 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:41:54.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:41:54 gibba015 bash[30343]: audit 2021-03-10T17:41:54.313302+0000 mon.a (mon.0) 2530 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T17:41:54.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:41:54 gibba015 bash[30343]: audit 2021-03-10T17:41:54.314208+0000 mon.a (mon.0) 2531 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T17:41:54.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:41:54 gibba015 bash[29377]: cluster 2021-03-10T17:41:53.202332+0000 mgr.gibba045.orlgmj (mgr.34412) 12275 : cluster [DBG] pgmap v7000: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:54.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:41:54 gibba015 bash[29377]: audit 2021-03-10T17:41:54.174733+0000 mon.c (mon.1) 3363 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:41:54.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:41:54 gibba015 bash[29377]: audit 2021-03-10T17:41:54.175376+0000 mon.c (mon.1) 3364 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:41:54.727 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:41:54 gibba015 bash[29377]: audit 2021-03-10T17:41:54.176001+0000 mon.a (mon.0) 2526 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:41:54.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:41:54 gibba015 bash[29377]: audit 2021-03-10T17:41:54.177216+0000 mon.a (mon.0) 2527 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:41:54.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:41:54 gibba015 bash[29377]: audit 2021-03-10T17:41:54.308404+0000 mon.c (mon.1) 3365 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T17:41:54.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:41:54 gibba015 bash[29377]: audit 2021-03-10T17:41:54.309181+0000 mon.c (mon.1) 3366 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:41:54.728 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:41:54 gibba015 bash[29377]: audit 2021-03-10T17:41:54.309814+0000 mon.a (mon.0) 2528 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T17:41:54.729 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:41:54 gibba015 bash[29377]: audit 2021-03-10T17:41:54.309877+0000 mon.c (mon.1) 3367 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T17:41:54.729 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:41:54 gibba015 bash[29377]: audit 2021-03-10T17:41:54.310519+0000 mon.c (mon.1) 3368 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T17:41:54.729 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:41:54 gibba015 bash[29377]: audit 2021-03-10T17:41:54.312044+0000 mon.a (mon.0) 2529 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:41:54.729 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:41:54 gibba015 bash[29377]: audit 2021-03-10T17:41:54.313302+0000 mon.a (mon.0) 2530 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T17:41:54.730 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:41:54 gibba015 bash[29377]: audit 2021-03-10T17:41:54.314208+0000 mon.a (mon.0) 2531 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T17:41:54.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:41:54 gibba045 bash[25517]: cluster 2021-03-10T17:41:53.202332+0000 mgr.gibba045.orlgmj (mgr.34412) 12275 : cluster [DBG] pgmap v7000: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:54.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:41:54 gibba045 bash[25517]: audit 2021-03-10T17:41:54.174733+0000 mon.c (mon.1) 3363 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:41:54.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:41:54 gibba045 bash[25517]: audit 2021-03-10T17:41:54.175376+0000 mon.c (mon.1) 3364 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:41:54.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:41:54 gibba045 bash[25517]: audit 2021-03-10T17:41:54.176001+0000 mon.a (mon.0) 2526 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:41:54.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:41:54 gibba045 bash[25517]: audit 2021-03-10T17:41:54.177216+0000 mon.a (mon.0) 2527 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:41:54.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:41:54 gibba045 bash[25517]: audit 2021-03-10T17:41:54.308404+0000 mon.c (mon.1) 3365 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T17:41:54.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:41:54 gibba045 bash[25517]: audit 2021-03-10T17:41:54.309181+0000 mon.c (mon.1) 3366 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:41:54.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:41:54 gibba045 bash[25517]: audit 2021-03-10T17:41:54.309814+0000 mon.a (mon.0) 2528 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T17:41:54.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:41:54 gibba045 bash[25517]: audit 2021-03-10T17:41:54.309877+0000 mon.c (mon.1) 3367 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T17:41:54.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:41:54 gibba045 bash[25517]: audit 2021-03-10T17:41:54.310519+0000 mon.c (mon.1) 3368 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T17:41:54.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:41:54 gibba045 bash[25517]: audit 2021-03-10T17:41:54.312044+0000 mon.a (mon.0) 2529 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:41:54.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:41:54 gibba045 bash[25517]: audit 2021-03-10T17:41:54.313302+0000 mon.a (mon.0) 2530 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T17:41:54.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:41:54 gibba045 bash[25517]: audit 2021-03-10T17:41:54.314208+0000 mon.a (mon.0) 2531 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T17:41:56.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:41:56 gibba015 bash[29377]: cluster 2021-03-10T17:41:55.203840+0000 mgr.gibba045.orlgmj (mgr.34412) 12276 : cluster [DBG] pgmap v7001: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:56.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:41:56 gibba015 bash[30343]: cluster 2021-03-10T17:41:55.203840+0000 mgr.gibba045.orlgmj (mgr.34412) 12276 : cluster [DBG] pgmap v7001: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:56.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:41:56 gibba045 bash[25517]: cluster 2021-03-10T17:41:55.203840+0000 mgr.gibba045.orlgmj (mgr.34412) 12276 : cluster [DBG] pgmap v7001: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:58.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:41:58 gibba015 bash[29377]: cluster 2021-03-10T17:41:57.204957+0000 mgr.gibba045.orlgmj (mgr.34412) 12277 : cluster [DBG] pgmap v7002: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:58.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:41:58 gibba015 bash[30343]: cluster 2021-03-10T17:41:57.204957+0000 mgr.gibba045.orlgmj (mgr.34412) 12277 : cluster [DBG] pgmap v7002: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:58.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:41:58 gibba045 bash[25517]: cluster 2021-03-10T17:41:57.204957+0000 mgr.gibba045.orlgmj (mgr.34412) 12277 : cluster [DBG] pgmap v7002: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:00.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:42:00 gibba045 bash[25517]: cluster 2021-03-10T17:41:59.206090+0000 mgr.gibba045.orlgmj (mgr.34412) 12278 : cluster [DBG] pgmap v7003: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:00.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:42:00 gibba045 bash[25517]: audit 2021-03-10T17:41:59.947636+0000 mon.c (mon.1) 3369 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:42:00.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:42:00 gibba045 bash[25517]: cephadm 2021-03-10T17:41:59.954143+0000 mgr.gibba045.orlgmj (mgr.34412) 12279 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:42:00.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:42:00 gibba045 bash[25517]: cephadm 2021-03-10T17:41:59.956112+0000 mgr.gibba045.orlgmj (mgr.34412) 12280 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:42:00.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:42:00 gibba045 bash[25517]: audit 2021-03-10T17:42:00.163126+0000 mon.a (mon.0) 2532 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:42:00.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:42:00 gibba045 bash[25517]: audit 2021-03-10T17:42:00.166926+0000 mon.c (mon.1) 3370 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:42:00.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:42:00 gibba045 bash[25517]: audit 2021-03-10T17:42:00.169192+0000 mon.c (mon.1) 3371 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:42:00.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:42:00 gibba045 bash[25517]: audit 2021-03-10T17:42:00.170784+0000 mon.c (mon.1) 3372 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:42:00.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:42:00 gibba045 bash[25517]: audit 2021-03-10T17:42:00.172523+0000 mon.c (mon.1) 3373 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:42:00.559 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:42:00 gibba045 bash[25517]: audit 2021-03-10T17:42:00.176210+0000 mon.c (mon.1) 3374 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:42:00.560 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:42:00 gibba045 bash[25517]: audit 2021-03-10T17:42:00.178063+0000 mon.c (mon.1) 3375 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:42:00.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:42:00 gibba015 bash[29377]: cluster 2021-03-10T17:41:59.206090+0000 mgr.gibba045.orlgmj (mgr.34412) 12278 : cluster [DBG] pgmap v7003: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:00.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:42:00 gibba015 bash[29377]: audit 2021-03-10T17:41:59.947636+0000 mon.c (mon.1) 3369 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:42:00.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:42:00 gibba015 bash[29377]: cephadm 2021-03-10T17:41:59.954143+0000 mgr.gibba045.orlgmj (mgr.34412) 12279 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:42:00.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:42:00 gibba015 bash[29377]: cephadm 2021-03-10T17:41:59.956112+0000 mgr.gibba045.orlgmj (mgr.34412) 12280 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:42:00.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:42:00 gibba015 bash[29377]: audit 2021-03-10T17:42:00.163126+0000 mon.a (mon.0) 2532 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:42:00.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:42:00 gibba015 bash[29377]: audit 2021-03-10T17:42:00.166926+0000 mon.c (mon.1) 3370 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:42:00.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:42:00 gibba015 bash[29377]: audit 2021-03-10T17:42:00.169192+0000 mon.c (mon.1) 3371 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:42:00.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:42:00 gibba015 bash[29377]: audit 2021-03-10T17:42:00.170784+0000 mon.c (mon.1) 3372 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:42:00.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:42:00 gibba015 bash[29377]: audit 2021-03-10T17:42:00.172523+0000 mon.c (mon.1) 3373 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:42:00.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:42:00 gibba015 bash[29377]: audit 2021-03-10T17:42:00.176210+0000 mon.c (mon.1) 3374 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:42:00.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:42:00 gibba015 bash[29377]: audit 2021-03-10T17:42:00.178063+0000 mon.c (mon.1) 3375 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:42:00.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:42:00 gibba015 bash[30343]: cluster 2021-03-10T17:41:59.206090+0000 mgr.gibba045.orlgmj (mgr.34412) 12278 : cluster [DBG] pgmap v7003: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:00.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:42:00 gibba015 bash[30343]: audit 2021-03-10T17:41:59.947636+0000 mon.c (mon.1) 3369 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:42:00.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:42:00 gibba015 bash[30343]: cephadm 2021-03-10T17:41:59.954143+0000 mgr.gibba045.orlgmj (mgr.34412) 12279 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:42:00.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:42:00 gibba015 bash[30343]: cephadm 2021-03-10T17:41:59.956112+0000 mgr.gibba045.orlgmj (mgr.34412) 12280 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:42:00.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:42:00 gibba015 bash[30343]: audit 2021-03-10T17:42:00.163126+0000 mon.a (mon.0) 2532 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:42:00.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:42:00 gibba015 bash[30343]: audit 2021-03-10T17:42:00.166926+0000 mon.c (mon.1) 3370 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:42:00.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:42:00 gibba015 bash[30343]: audit 2021-03-10T17:42:00.169192+0000 mon.c (mon.1) 3371 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:42:00.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:42:00 gibba015 bash[30343]: audit 2021-03-10T17:42:00.170784+0000 mon.c (mon.1) 3372 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:42:00.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:42:00 gibba015 bash[30343]: audit 2021-03-10T17:42:00.172523+0000 mon.c (mon.1) 3373 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:42:00.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:42:00 gibba015 bash[30343]: audit 2021-03-10T17:42:00.176210+0000 mon.c (mon.1) 3374 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:42:00.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:42:00 gibba015 bash[30343]: audit 2021-03-10T17:42:00.178063+0000 mon.c (mon.1) 3375 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:42:01.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:42:01 gibba015 bash[29377]: cephadm 2021-03-10T17:42:00.168029+0000 mgr.gibba045.orlgmj (mgr.34412) 12281 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:42:01.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:42:01 gibba015 bash[29377]: cephadm 2021-03-10T17:42:00.170521+0000 mgr.gibba045.orlgmj (mgr.34412) 12282 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:42:01.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:42:01 gibba015 bash[29377]: cephadm 2021-03-10T17:42:00.172108+0000 mgr.gibba045.orlgmj (mgr.34412) 12283 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:42:01.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:42:01 gibba015 bash[29377]: cephadm 2021-03-10T17:42:00.172150+0000 mgr.gibba045.orlgmj (mgr.34412) 12284 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:42:01.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:42:01 gibba015 bash[29377]: cephadm 2021-03-10T17:42:00.173946+0000 mgr.gibba045.orlgmj (mgr.34412) 12285 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:42:01.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:42:01 gibba015 bash[29377]: cephadm 2021-03-10T17:42:00.173984+0000 mgr.gibba045.orlgmj (mgr.34412) 12286 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:42:01.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:42:01 gibba015 bash[29377]: cephadm 2021-03-10T17:42:00.175467+0000 mgr.gibba045.orlgmj (mgr.34412) 12287 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:42:01.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:42:01 gibba015 bash[29377]: cephadm 2021-03-10T17:42:00.177479+0000 mgr.gibba045.orlgmj (mgr.34412) 12288 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:42:01.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:42:01 gibba015 bash[29377]: cephadm 2021-03-10T17:42:00.177519+0000 mgr.gibba045.orlgmj (mgr.34412) 12289 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:42:01.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:42:01 gibba015 bash[29377]: cephadm 2021-03-10T17:42:00.179098+0000 mgr.gibba045.orlgmj (mgr.34412) 12290 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:42:01.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:42:01 gibba015 bash[29377]: cephadm 2021-03-10T17:42:00.179515+0000 mgr.gibba045.orlgmj (mgr.34412) 12291 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:42:01.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:42:01 gibba015 bash[29377]: cephadm 2021-03-10T17:42:00.181385+0000 mgr.gibba045.orlgmj (mgr.34412) 12292 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:42:01.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:42:01 gibba015 bash[29377]: cephadm 2021-03-10T17:42:00.181430+0000 mgr.gibba045.orlgmj (mgr.34412) 12293 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:42:01.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:42:01 gibba015 bash[29377]: cephadm 2021-03-10T17:42:00.181562+0000 mgr.gibba045.orlgmj (mgr.34412) 12294 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:42:01.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:42:01 gibba015 bash[30343]: cephadm 2021-03-10T17:42:00.168029+0000 mgr.gibba045.orlgmj (mgr.34412) 12281 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:42:01.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:42:01 gibba015 bash[30343]: cephadm 2021-03-10T17:42:00.170521+0000 mgr.gibba045.orlgmj (mgr.34412) 12282 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:42:01.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:42:01 gibba015 bash[30343]: cephadm 2021-03-10T17:42:00.172108+0000 mgr.gibba045.orlgmj (mgr.34412) 12283 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:42:01.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:42:01 gibba015 bash[30343]: cephadm 2021-03-10T17:42:00.172150+0000 mgr.gibba045.orlgmj (mgr.34412) 12284 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:42:01.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:42:01 gibba015 bash[30343]: cephadm 2021-03-10T17:42:00.173946+0000 mgr.gibba045.orlgmj (mgr.34412) 12285 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:42:01.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:42:01 gibba015 bash[30343]: cephadm 2021-03-10T17:42:00.173984+0000 mgr.gibba045.orlgmj (mgr.34412) 12286 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:42:01.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:42:01 gibba015 bash[30343]: cephadm 2021-03-10T17:42:00.175467+0000 mgr.gibba045.orlgmj (mgr.34412) 12287 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:42:01.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:42:01 gibba015 bash[30343]: cephadm 2021-03-10T17:42:00.177479+0000 mgr.gibba045.orlgmj (mgr.34412) 12288 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:42:01.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:42:01 gibba015 bash[30343]: cephadm 2021-03-10T17:42:00.177519+0000 mgr.gibba045.orlgmj (mgr.34412) 12289 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:42:01.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:42:01 gibba015 bash[30343]: cephadm 2021-03-10T17:42:00.179098+0000 mgr.gibba045.orlgmj (mgr.34412) 12290 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:42:01.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:42:01 gibba015 bash[30343]: cephadm 2021-03-10T17:42:00.179515+0000 mgr.gibba045.orlgmj (mgr.34412) 12291 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:42:01.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:42:01 gibba015 bash[30343]: cephadm 2021-03-10T17:42:00.181385+0000 mgr.gibba045.orlgmj (mgr.34412) 12292 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:42:01.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:42:01 gibba015 bash[30343]: cephadm 2021-03-10T17:42:00.181430+0000 mgr.gibba045.orlgmj (mgr.34412) 12293 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:42:01.730 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:42:01 gibba015 bash[30343]: cephadm 2021-03-10T17:42:00.181562+0000 mgr.gibba045.orlgmj (mgr.34412) 12294 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:42:01.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:42:01 gibba045 bash[25517]: cephadm 2021-03-10T17:42:00.168029+0000 mgr.gibba045.orlgmj (mgr.34412) 12281 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:42:01.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:42:01 gibba045 bash[25517]: cephadm 2021-03-10T17:42:00.170521+0000 mgr.gibba045.orlgmj (mgr.34412) 12282 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:42:01.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:42:01 gibba045 bash[25517]: cephadm 2021-03-10T17:42:00.172108+0000 mgr.gibba045.orlgmj (mgr.34412) 12283 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:42:01.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:42:01 gibba045 bash[25517]: cephadm 2021-03-10T17:42:00.172150+0000 mgr.gibba045.orlgmj (mgr.34412) 12284 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:42:01.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:42:01 gibba045 bash[25517]: cephadm 2021-03-10T17:42:00.173946+0000 mgr.gibba045.orlgmj (mgr.34412) 12285 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:42:01.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:42:01 gibba045 bash[25517]: cephadm 2021-03-10T17:42:00.173984+0000 mgr.gibba045.orlgmj (mgr.34412) 12286 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:42:01.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:42:01 gibba045 bash[25517]: cephadm 2021-03-10T17:42:00.175467+0000 mgr.gibba045.orlgmj (mgr.34412) 12287 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:42:01.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:42:01 gibba045 bash[25517]: cephadm 2021-03-10T17:42:00.177479+0000 mgr.gibba045.orlgmj (mgr.34412) 12288 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:42:01.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:42:01 gibba045 bash[25517]: cephadm 2021-03-10T17:42:00.177519+0000 mgr.gibba045.orlgmj (mgr.34412) 12289 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:42:01.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:42:01 gibba045 bash[25517]: cephadm 2021-03-10T17:42:00.179098+0000 mgr.gibba045.orlgmj (mgr.34412) 12290 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:42:01.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:42:01 gibba045 bash[25517]: cephadm 2021-03-10T17:42:00.179515+0000 mgr.gibba045.orlgmj (mgr.34412) 12291 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:42:01.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:42:01 gibba045 bash[25517]: cephadm 2021-03-10T17:42:00.181385+0000 mgr.gibba045.orlgmj (mgr.34412) 12292 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:42:01.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:42:01 gibba045 bash[25517]: cephadm 2021-03-10T17:42:00.181430+0000 mgr.gibba045.orlgmj (mgr.34412) 12293 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:42:01.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:42:01 gibba045 bash[25517]: cephadm 2021-03-10T17:42:00.181562+0000 mgr.gibba045.orlgmj (mgr.34412) 12294 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:42:02.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:42:02 gibba015 bash[29377]: cluster 2021-03-10T17:42:01.207840+0000 mgr.gibba045.orlgmj (mgr.34412) 12295 : cluster [DBG] pgmap v7004: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:02.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:42:02 gibba015 bash[30343]: cluster 2021-03-10T17:42:01.207840+0000 mgr.gibba045.orlgmj (mgr.34412) 12295 : cluster [DBG] pgmap v7004: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:02.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:42:02 gibba045 bash[25517]: cluster 2021-03-10T17:42:01.207840+0000 mgr.gibba045.orlgmj (mgr.34412) 12295 : cluster [DBG] pgmap v7004: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:04.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:42:04 gibba015 bash[29377]: cluster 2021-03-10T17:42:03.209151+0000 mgr.gibba045.orlgmj (mgr.34412) 12296 : cluster [DBG] pgmap v7005: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:04.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:42:04 gibba015 bash[30343]: cluster 2021-03-10T17:42:03.209151+0000 mgr.gibba045.orlgmj (mgr.34412) 12296 : cluster [DBG] pgmap v7005: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:04.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:42:04 gibba045 bash[25517]: cluster 2021-03-10T17:42:03.209151+0000 mgr.gibba045.orlgmj (mgr.34412) 12296 : cluster [DBG] pgmap v7005: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:06.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:42:06 gibba015 bash[29377]: cluster 2021-03-10T17:42:05.210738+0000 mgr.gibba045.orlgmj (mgr.34412) 12297 : cluster [DBG] pgmap v7006: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:06.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:42:06 gibba015 bash[30343]: cluster 2021-03-10T17:42:05.210738+0000 mgr.gibba045.orlgmj (mgr.34412) 12297 : cluster [DBG] pgmap v7006: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:06.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:42:06 gibba045 bash[25517]: cluster 2021-03-10T17:42:05.210738+0000 mgr.gibba045.orlgmj (mgr.34412) 12297 : cluster [DBG] pgmap v7006: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:08.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:42:08 gibba015 bash[29377]: cluster 2021-03-10T17:42:07.212403+0000 mgr.gibba045.orlgmj (mgr.34412) 12298 : cluster [DBG] pgmap v7007: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:08.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:42:08 gibba015 bash[30343]: cluster 2021-03-10T17:42:07.212403+0000 mgr.gibba045.orlgmj (mgr.34412) 12298 : cluster [DBG] pgmap v7007: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:08.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:42:08 gibba045 bash[25517]: cluster 2021-03-10T17:42:07.212403+0000 mgr.gibba045.orlgmj (mgr.34412) 12298 : cluster [DBG] pgmap v7007: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:08.914 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:42:09.142 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:42:09.142 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 4m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:42:09.142 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 3m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:42:09.143 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 3m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:42:09.143 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 3m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:42:09.143 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 4m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:42:09.143 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 4m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:42:09.144 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 3m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:42:09.144 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 4m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:42:09.144 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 4m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:42:09.144 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 3m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:42:09.145 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 4m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:42:09.145 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 4m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:42:09.145 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 4m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:42:09.145 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 4m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:42:09.145 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:42:09.146 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:42:09.146 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:42:09.146 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:42:09.146 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 3m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:42:09.147 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 3m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:42:09.390 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:42:09.391 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:42:09.391 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:42:09.391 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:42:09.391 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:42:09.392 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:42:09.392 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:42:09.392 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:42:09.392 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:42:09.393 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:42:09.393 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:42:09.393 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:42:09.393 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:42:09.393 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:42:09.394 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:42:09.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:42:09 gibba015 bash[29377]: audit 2021-03-10T17:42:08.904546+0000 mgr.gibba045.orlgmj (mgr.34412) 12299 : audit [DBG] from='client.52296 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:42:09.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:42:09 gibba015 bash[29377]: audit 2021-03-10T17:42:09.387909+0000 mon.a (mon.0) 2533 : audit [DBG] from='client.? 172.21.2.115:0/2602340169' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:42:09.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:42:09 gibba015 bash[30343]: audit 2021-03-10T17:42:08.904546+0000 mgr.gibba045.orlgmj (mgr.34412) 12299 : audit [DBG] from='client.52296 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:42:09.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:42:09 gibba015 bash[30343]: audit 2021-03-10T17:42:09.387909+0000 mon.a (mon.0) 2533 : audit [DBG] from='client.? 172.21.2.115:0/2602340169' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:42:09.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:42:09 gibba045 bash[25517]: audit 2021-03-10T17:42:08.904546+0000 mgr.gibba045.orlgmj (mgr.34412) 12299 : audit [DBG] from='client.52296 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:42:09.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:42:09 gibba045 bash[25517]: audit 2021-03-10T17:42:09.387909+0000 mon.a (mon.0) 2533 : audit [DBG] from='client.? 172.21.2.115:0/2602340169' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:42:10.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:42:10 gibba015 bash[29377]: audit 2021-03-10T17:42:09.126593+0000 mgr.gibba045.orlgmj (mgr.34412) 12300 : audit [DBG] from='client.62287 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:42:10.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:42:10 gibba015 bash[29377]: cluster 2021-03-10T17:42:09.213677+0000 mgr.gibba045.orlgmj (mgr.34412) 12301 : cluster [DBG] pgmap v7008: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:10.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:42:10 gibba015 bash[30343]: audit 2021-03-10T17:42:09.126593+0000 mgr.gibba045.orlgmj (mgr.34412) 12300 : audit [DBG] from='client.62287 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:42:10.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:42:10 gibba015 bash[30343]: cluster 2021-03-10T17:42:09.213677+0000 mgr.gibba045.orlgmj (mgr.34412) 12301 : cluster [DBG] pgmap v7008: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:10.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:42:10 gibba045 bash[25517]: audit 2021-03-10T17:42:09.126593+0000 mgr.gibba045.orlgmj (mgr.34412) 12300 : audit [DBG] from='client.62287 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:42:10.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:42:10 gibba045 bash[25517]: cluster 2021-03-10T17:42:09.213677+0000 mgr.gibba045.orlgmj (mgr.34412) 12301 : cluster [DBG] pgmap v7008: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:12.722 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:42:12 gibba015 bash[29377]: cluster 2021-03-10T17:42:11.215528+0000 mgr.gibba045.orlgmj (mgr.34412) 12302 : cluster [DBG] pgmap v7009: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:12.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:42:12 gibba015 bash[30343]: cluster 2021-03-10T17:42:11.215528+0000 mgr.gibba045.orlgmj (mgr.34412) 12302 : cluster [DBG] pgmap v7009: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:12.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:42:12 gibba045 bash[25517]: cluster 2021-03-10T17:42:11.215528+0000 mgr.gibba045.orlgmj (mgr.34412) 12302 : cluster [DBG] pgmap v7009: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:14.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:42:14 gibba015 bash[29377]: cluster 2021-03-10T17:42:13.217036+0000 mgr.gibba045.orlgmj (mgr.34412) 12303 : cluster [DBG] pgmap v7010: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:14.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:42:14 gibba015 bash[30343]: cluster 2021-03-10T17:42:13.217036+0000 mgr.gibba045.orlgmj (mgr.34412) 12303 : cluster [DBG] pgmap v7010: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:14.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:42:14 gibba045 bash[25517]: cluster 2021-03-10T17:42:13.217036+0000 mgr.gibba045.orlgmj (mgr.34412) 12303 : cluster [DBG] pgmap v7010: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:16.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:42:16 gibba015 bash[29377]: cephadm 2021-03-10T17:42:15.197239+0000 mgr.gibba045.orlgmj (mgr.34412) 12304 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:42:16.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:42:16 gibba015 bash[29377]: cluster 2021-03-10T17:42:15.218464+0000 mgr.gibba045.orlgmj (mgr.34412) 12305 : cluster [DBG] pgmap v7011: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:16.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:42:16 gibba015 bash[30343]: cephadm 2021-03-10T17:42:15.197239+0000 mgr.gibba045.orlgmj (mgr.34412) 12304 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:42:16.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:42:16 gibba015 bash[30343]: cluster 2021-03-10T17:42:15.218464+0000 mgr.gibba045.orlgmj (mgr.34412) 12305 : cluster [DBG] pgmap v7011: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:16.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:42:16 gibba045 bash[25517]: cephadm 2021-03-10T17:42:15.197239+0000 mgr.gibba045.orlgmj (mgr.34412) 12304 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:42:16.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:42:16 gibba045 bash[25517]: cluster 2021-03-10T17:42:15.218464+0000 mgr.gibba045.orlgmj (mgr.34412) 12305 : cluster [DBG] pgmap v7011: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:18.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:42:18 gibba015 bash[29377]: cluster 2021-03-10T17:42:17.220101+0000 mgr.gibba045.orlgmj (mgr.34412) 12306 : cluster [DBG] pgmap v7012: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:18.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:42:18 gibba015 bash[30343]: cluster 2021-03-10T17:42:17.220101+0000 mgr.gibba045.orlgmj (mgr.34412) 12306 : cluster [DBG] pgmap v7012: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:18.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:42:18 gibba045 bash[25517]: cluster 2021-03-10T17:42:17.220101+0000 mgr.gibba045.orlgmj (mgr.34412) 12306 : cluster [DBG] pgmap v7012: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:20.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:42:20 gibba045 bash[25517]: cluster 2021-03-10T17:42:19.221446+0000 mgr.gibba045.orlgmj (mgr.34412) 12307 : cluster [DBG] pgmap v7013: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:20.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:42:20 gibba015 bash[29377]: cluster 2021-03-10T17:42:19.221446+0000 mgr.gibba045.orlgmj (mgr.34412) 12307 : cluster [DBG] pgmap v7013: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:20.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:42:20 gibba015 bash[30343]: cluster 2021-03-10T17:42:19.221446+0000 mgr.gibba045.orlgmj (mgr.34412) 12307 : cluster [DBG] pgmap v7013: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:22.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:42:22 gibba045 bash[25517]: cluster 2021-03-10T17:42:21.223058+0000 mgr.gibba045.orlgmj (mgr.34412) 12308 : cluster [DBG] pgmap v7014: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:22.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:42:22 gibba015 bash[29377]: cluster 2021-03-10T17:42:21.223058+0000 mgr.gibba045.orlgmj (mgr.34412) 12308 : cluster [DBG] pgmap v7014: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:22.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:42:22 gibba015 bash[30343]: cluster 2021-03-10T17:42:21.223058+0000 mgr.gibba045.orlgmj (mgr.34412) 12308 : cluster [DBG] pgmap v7014: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:24.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:42:24 gibba045 bash[25517]: cluster 2021-03-10T17:42:23.224589+0000 mgr.gibba045.orlgmj (mgr.34412) 12309 : cluster [DBG] pgmap v7015: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:24.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:42:24 gibba015 bash[29377]: cluster 2021-03-10T17:42:23.224589+0000 mgr.gibba045.orlgmj (mgr.34412) 12309 : cluster [DBG] pgmap v7015: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:24.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:42:24 gibba015 bash[30343]: cluster 2021-03-10T17:42:23.224589+0000 mgr.gibba045.orlgmj (mgr.34412) 12309 : cluster [DBG] pgmap v7015: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:26.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:42:26 gibba045 bash[25517]: cluster 2021-03-10T17:42:25.226197+0000 mgr.gibba045.orlgmj (mgr.34412) 12310 : cluster [DBG] pgmap v7016: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:26.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:42:26 gibba015 bash[29377]: cluster 2021-03-10T17:42:25.226197+0000 mgr.gibba045.orlgmj (mgr.34412) 12310 : cluster [DBG] pgmap v7016: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:26.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:42:26 gibba015 bash[30343]: cluster 2021-03-10T17:42:25.226197+0000 mgr.gibba045.orlgmj (mgr.34412) 12310 : cluster [DBG] pgmap v7016: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:28.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:42:28 gibba045 bash[25517]: cluster 2021-03-10T17:42:27.227942+0000 mgr.gibba045.orlgmj (mgr.34412) 12311 : cluster [DBG] pgmap v7017: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:28.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:42:28 gibba015 bash[29377]: cluster 2021-03-10T17:42:27.227942+0000 mgr.gibba045.orlgmj (mgr.34412) 12311 : cluster [DBG] pgmap v7017: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:28.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:42:28 gibba015 bash[30343]: cluster 2021-03-10T17:42:27.227942+0000 mgr.gibba045.orlgmj (mgr.34412) 12311 : cluster [DBG] pgmap v7017: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:30.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:42:30 gibba045 bash[25517]: cluster 2021-03-10T17:42:29.229108+0000 mgr.gibba045.orlgmj (mgr.34412) 12312 : cluster [DBG] pgmap v7018: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:30.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:42:30 gibba015 bash[30343]: cluster 2021-03-10T17:42:29.229108+0000 mgr.gibba045.orlgmj (mgr.34412) 12312 : cluster [DBG] pgmap v7018: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:30.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:42:30 gibba015 bash[29377]: cluster 2021-03-10T17:42:29.229108+0000 mgr.gibba045.orlgmj (mgr.34412) 12312 : cluster [DBG] pgmap v7018: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:31.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:42:31 gibba045 bash[25517]: cephadm 2021-03-10T17:42:30.212956+0000 mgr.gibba045.orlgmj (mgr.34412) 12313 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:42:31.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:42:31 gibba015 bash[29377]: cephadm 2021-03-10T17:42:30.212956+0000 mgr.gibba045.orlgmj (mgr.34412) 12313 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:42:31.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:42:31 gibba015 bash[30343]: cephadm 2021-03-10T17:42:30.212956+0000 mgr.gibba045.orlgmj (mgr.34412) 12313 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:42:32.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:42:32 gibba045 bash[25517]: cluster 2021-03-10T17:42:31.230807+0000 mgr.gibba045.orlgmj (mgr.34412) 12314 : cluster [DBG] pgmap v7019: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:32.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:42:32 gibba015 bash[29377]: cluster 2021-03-10T17:42:31.230807+0000 mgr.gibba045.orlgmj (mgr.34412) 12314 : cluster [DBG] pgmap v7019: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:32.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:42:32 gibba015 bash[30343]: cluster 2021-03-10T17:42:31.230807+0000 mgr.gibba045.orlgmj (mgr.34412) 12314 : cluster [DBG] pgmap v7019: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:34.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:42:34 gibba045 bash[25517]: cluster 2021-03-10T17:42:33.232201+0000 mgr.gibba045.orlgmj (mgr.34412) 12315 : cluster [DBG] pgmap v7020: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:34.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:42:34 gibba015 bash[29377]: cluster 2021-03-10T17:42:33.232201+0000 mgr.gibba045.orlgmj (mgr.34412) 12315 : cluster [DBG] pgmap v7020: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:34.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:42:34 gibba015 bash[30343]: cluster 2021-03-10T17:42:33.232201+0000 mgr.gibba045.orlgmj (mgr.34412) 12315 : cluster [DBG] pgmap v7020: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:36.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:42:36 gibba045 bash[25517]: cluster 2021-03-10T17:42:35.233699+0000 mgr.gibba045.orlgmj (mgr.34412) 12316 : cluster [DBG] pgmap v7021: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:36.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:42:36 gibba015 bash[29377]: cluster 2021-03-10T17:42:35.233699+0000 mgr.gibba045.orlgmj (mgr.34412) 12316 : cluster [DBG] pgmap v7021: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:36.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:42:36 gibba015 bash[30343]: cluster 2021-03-10T17:42:35.233699+0000 mgr.gibba045.orlgmj (mgr.34412) 12316 : cluster [DBG] pgmap v7021: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:38.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:42:38 gibba015 bash[29377]: cluster 2021-03-10T17:42:37.235395+0000 mgr.gibba045.orlgmj (mgr.34412) 12317 : cluster [DBG] pgmap v7022: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:38.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:42:38 gibba015 bash[30343]: cluster 2021-03-10T17:42:37.235395+0000 mgr.gibba045.orlgmj (mgr.34412) 12317 : cluster [DBG] pgmap v7022: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:39.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:42:38 gibba045 bash[25517]: cluster 2021-03-10T17:42:37.235395+0000 mgr.gibba045.orlgmj (mgr.34412) 12317 : cluster [DBG] pgmap v7022: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:39.636 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:42:39.900 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:42:39.900 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 4m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:42:39.900 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 3m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:42:39.901 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 3m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:42:39.901 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 3m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:42:39.901 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 4m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:42:39.901 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 4m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:42:39.901 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 3m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:42:39.902 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 4m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:42:39.902 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 4m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:42:39.902 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 3m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:42:39.902 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 4m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:42:39.903 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 4m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:42:39.903 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 4m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:42:39.903 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 4m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:42:39.903 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 3m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:42:39.903 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 3m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:42:39.904 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:42:39.904 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:42:39.904 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 3m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:42:39.904 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 3m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:42:40.154 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:42:40.154 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:42:40.154 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:42:40.155 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:42:40.155 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:42:40.155 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:42:40.155 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:42:40.155 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:42:40.156 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:42:40.156 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:42:40.156 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:42:40.156 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:42:40.157 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:42:40.157 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:42:40.157 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:42:40.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:42:40 gibba015 bash[29377]: cluster 2021-03-10T17:42:39.236870+0000 mgr.gibba045.orlgmj (mgr.34412) 12318 : cluster [DBG] pgmap v7023: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:40.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:42:40 gibba015 bash[29377]: audit 2021-03-10T17:42:39.625863+0000 mgr.gibba045.orlgmj (mgr.34412) 12319 : audit [DBG] from='client.62299 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:42:40.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:42:40 gibba015 bash[29377]: audit 2021-03-10T17:42:39.859188+0000 mgr.gibba045.orlgmj (mgr.34412) 12320 : audit [DBG] from='client.62305 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:42:40.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:42:40 gibba015 bash[29377]: audit 2021-03-10T17:42:40.151097+0000 mon.a (mon.0) 2534 : audit [DBG] from='client.? 172.21.2.115:0/3432040573' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:42:40.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:42:40 gibba015 bash[30343]: cluster 2021-03-10T17:42:39.236870+0000 mgr.gibba045.orlgmj (mgr.34412) 12318 : cluster [DBG] pgmap v7023: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:40.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:42:40 gibba015 bash[30343]: audit 2021-03-10T17:42:39.625863+0000 mgr.gibba045.orlgmj (mgr.34412) 12319 : audit [DBG] from='client.62299 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:42:40.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:42:40 gibba015 bash[30343]: audit 2021-03-10T17:42:39.859188+0000 mgr.gibba045.orlgmj (mgr.34412) 12320 : audit [DBG] from='client.62305 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:42:40.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:42:40 gibba015 bash[30343]: audit 2021-03-10T17:42:40.151097+0000 mon.a (mon.0) 2534 : audit [DBG] from='client.? 172.21.2.115:0/3432040573' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:42:41.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:42:40 gibba045 bash[25517]: cluster 2021-03-10T17:42:39.236870+0000 mgr.gibba045.orlgmj (mgr.34412) 12318 : cluster [DBG] pgmap v7023: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:41.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:42:40 gibba045 bash[25517]: audit 2021-03-10T17:42:39.625863+0000 mgr.gibba045.orlgmj (mgr.34412) 12319 : audit [DBG] from='client.62299 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:42:41.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:42:40 gibba045 bash[25517]: audit 2021-03-10T17:42:39.859188+0000 mgr.gibba045.orlgmj (mgr.34412) 12320 : audit [DBG] from='client.62305 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:42:41.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:42:40 gibba045 bash[25517]: audit 2021-03-10T17:42:40.151097+0000 mon.a (mon.0) 2534 : audit [DBG] from='client.? 172.21.2.115:0/3432040573' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:42:42.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:42:42 gibba015 bash[29377]: cluster 2021-03-10T17:42:41.238635+0000 mgr.gibba045.orlgmj (mgr.34412) 12321 : cluster [DBG] pgmap v7024: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:42.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:42:42 gibba015 bash[30343]: cluster 2021-03-10T17:42:41.238635+0000 mgr.gibba045.orlgmj (mgr.34412) 12321 : cluster [DBG] pgmap v7024: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:43.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:42:42 gibba045 bash[25517]: cluster 2021-03-10T17:42:41.238635+0000 mgr.gibba045.orlgmj (mgr.34412) 12321 : cluster [DBG] pgmap v7024: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:44.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:42:44 gibba015 bash[29377]: cluster 2021-03-10T17:42:43.239982+0000 mgr.gibba045.orlgmj (mgr.34412) 12322 : cluster [DBG] pgmap v7025: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:44.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:42:44 gibba015 bash[30343]: cluster 2021-03-10T17:42:43.239982+0000 mgr.gibba045.orlgmj (mgr.34412) 12322 : cluster [DBG] pgmap v7025: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:45.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:42:44 gibba045 bash[25517]: cluster 2021-03-10T17:42:43.239982+0000 mgr.gibba045.orlgmj (mgr.34412) 12322 : cluster [DBG] pgmap v7025: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:46.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:42:46 gibba015 bash[29377]: cephadm 2021-03-10T17:42:45.228953+0000 mgr.gibba045.orlgmj (mgr.34412) 12323 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:42:46.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:42:46 gibba015 bash[29377]: cluster 2021-03-10T17:42:45.241580+0000 mgr.gibba045.orlgmj (mgr.34412) 12324 : cluster [DBG] pgmap v7026: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:46.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:42:46 gibba015 bash[30343]: cephadm 2021-03-10T17:42:45.228953+0000 mgr.gibba045.orlgmj (mgr.34412) 12323 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:42:46.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:42:46 gibba015 bash[30343]: cluster 2021-03-10T17:42:45.241580+0000 mgr.gibba045.orlgmj (mgr.34412) 12324 : cluster [DBG] pgmap v7026: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:47.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:42:46 gibba045 bash[25517]: cephadm 2021-03-10T17:42:45.228953+0000 mgr.gibba045.orlgmj (mgr.34412) 12323 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:42:47.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:42:46 gibba045 bash[25517]: cluster 2021-03-10T17:42:45.241580+0000 mgr.gibba045.orlgmj (mgr.34412) 12324 : cluster [DBG] pgmap v7026: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:48.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:42:48 gibba015 bash[29377]: cluster 2021-03-10T17:42:47.243271+0000 mgr.gibba045.orlgmj (mgr.34412) 12325 : cluster [DBG] pgmap v7027: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:48.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:42:48 gibba015 bash[30343]: cluster 2021-03-10T17:42:47.243271+0000 mgr.gibba045.orlgmj (mgr.34412) 12325 : cluster [DBG] pgmap v7027: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:49.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:42:48 gibba045 bash[25517]: cluster 2021-03-10T17:42:47.243271+0000 mgr.gibba045.orlgmj (mgr.34412) 12325 : cluster [DBG] pgmap v7027: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:50.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:42:50 gibba015 bash[29377]: cluster 2021-03-10T17:42:49.244478+0000 mgr.gibba045.orlgmj (mgr.34412) 12326 : cluster [DBG] pgmap v7028: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:50.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:42:50 gibba015 bash[30343]: cluster 2021-03-10T17:42:49.244478+0000 mgr.gibba045.orlgmj (mgr.34412) 12326 : cluster [DBG] pgmap v7028: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:51.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:42:50 gibba045 bash[25517]: cluster 2021-03-10T17:42:49.244478+0000 mgr.gibba045.orlgmj (mgr.34412) 12326 : cluster [DBG] pgmap v7028: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:52.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:42:52 gibba015 bash[29377]: cluster 2021-03-10T17:42:51.246264+0000 mgr.gibba045.orlgmj (mgr.34412) 12327 : cluster [DBG] pgmap v7029: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:52.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:42:52 gibba015 bash[30343]: cluster 2021-03-10T17:42:51.246264+0000 mgr.gibba045.orlgmj (mgr.34412) 12327 : cluster [DBG] pgmap v7029: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:53.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:42:52 gibba045 bash[25517]: cluster 2021-03-10T17:42:51.246264+0000 mgr.gibba045.orlgmj (mgr.34412) 12327 : cluster [DBG] pgmap v7029: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:54.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:42:54 gibba015 bash[29377]: cluster 2021-03-10T17:42:53.247859+0000 mgr.gibba045.orlgmj (mgr.34412) 12328 : cluster [DBG] pgmap v7030: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:54.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:42:54 gibba015 bash[29377]: audit 2021-03-10T17:42:54.179632+0000 mon.c (mon.1) 3376 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:42:54.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:42:54 gibba015 bash[29377]: audit 2021-03-10T17:42:54.180275+0000 mon.c (mon.1) 3377 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:42:54.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:42:54 gibba015 bash[29377]: audit 2021-03-10T17:42:54.180752+0000 mon.a (mon.0) 2535 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:42:54.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:42:54 gibba015 bash[29377]: audit 2021-03-10T17:42:54.181956+0000 mon.a (mon.0) 2536 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:42:54.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:42:54 gibba015 bash[29377]: audit 2021-03-10T17:42:54.319620+0000 mon.c (mon.1) 3378 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T17:42:54.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:42:54 gibba015 bash[29377]: audit 2021-03-10T17:42:54.320429+0000 mon.c (mon.1) 3379 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:42:54.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:42:54 gibba015 bash[29377]: audit 2021-03-10T17:42:54.320834+0000 mon.a (mon.0) 2537 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T17:42:54.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:42:54 gibba015 bash[29377]: audit 2021-03-10T17:42:54.321256+0000 mon.c (mon.1) 3380 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:42:54.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:42:54 gibba015 bash[29377]: audit 2021-03-10T17:42:54.322109+0000 mon.c (mon.1) 3381 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T17:42:54.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:42:54 gibba015 bash[29377]: audit 2021-03-10T17:42:54.322166+0000 mon.a (mon.0) 2538 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:42:54.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:42:54 gibba015 bash[29377]: audit 2021-03-10T17:42:54.323347+0000 mon.a (mon.0) 2539 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:42:54.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:42:54 gibba015 bash[29377]: audit 2021-03-10T17:42:54.324162+0000 mon.a (mon.0) 2540 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T17:42:54.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:42:54 gibba015 bash[30343]: cluster 2021-03-10T17:42:53.247859+0000 mgr.gibba045.orlgmj (mgr.34412) 12328 : cluster [DBG] pgmap v7030: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:54.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:42:54 gibba015 bash[30343]: audit 2021-03-10T17:42:54.179632+0000 mon.c (mon.1) 3376 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:42:54.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:42:54 gibba015 bash[30343]: audit 2021-03-10T17:42:54.180275+0000 mon.c (mon.1) 3377 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:42:54.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:42:54 gibba015 bash[30343]: audit 2021-03-10T17:42:54.180752+0000 mon.a (mon.0) 2535 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:42:54.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:42:54 gibba015 bash[30343]: audit 2021-03-10T17:42:54.181956+0000 mon.a (mon.0) 2536 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:42:54.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:42:54 gibba015 bash[30343]: audit 2021-03-10T17:42:54.319620+0000 mon.c (mon.1) 3378 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T17:42:54.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:42:54 gibba015 bash[30343]: audit 2021-03-10T17:42:54.320429+0000 mon.c (mon.1) 3379 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:42:54.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:42:54 gibba015 bash[30343]: audit 2021-03-10T17:42:54.320834+0000 mon.a (mon.0) 2537 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T17:42:54.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:42:54 gibba015 bash[30343]: audit 2021-03-10T17:42:54.321256+0000 mon.c (mon.1) 3380 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:42:54.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:42:54 gibba015 bash[30343]: audit 2021-03-10T17:42:54.322109+0000 mon.c (mon.1) 3381 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T17:42:54.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:42:54 gibba015 bash[30343]: audit 2021-03-10T17:42:54.322166+0000 mon.a (mon.0) 2538 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:42:54.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:42:54 gibba015 bash[30343]: audit 2021-03-10T17:42:54.323347+0000 mon.a (mon.0) 2539 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:42:54.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:42:54 gibba015 bash[30343]: audit 2021-03-10T17:42:54.324162+0000 mon.a (mon.0) 2540 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T17:42:55.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:42:54 gibba045 bash[25517]: cluster 2021-03-10T17:42:53.247859+0000 mgr.gibba045.orlgmj (mgr.34412) 12328 : cluster [DBG] pgmap v7030: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:55.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:42:54 gibba045 bash[25517]: audit 2021-03-10T17:42:54.179632+0000 mon.c (mon.1) 3376 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:42:55.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:42:54 gibba045 bash[25517]: audit 2021-03-10T17:42:54.180275+0000 mon.c (mon.1) 3377 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:42:55.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:42:54 gibba045 bash[25517]: audit 2021-03-10T17:42:54.180752+0000 mon.a (mon.0) 2535 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:42:55.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:42:54 gibba045 bash[25517]: audit 2021-03-10T17:42:54.181956+0000 mon.a (mon.0) 2536 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:42:55.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:42:54 gibba045 bash[25517]: audit 2021-03-10T17:42:54.319620+0000 mon.c (mon.1) 3378 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T17:42:55.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:42:54 gibba045 bash[25517]: audit 2021-03-10T17:42:54.320429+0000 mon.c (mon.1) 3379 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:42:55.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:42:54 gibba045 bash[25517]: audit 2021-03-10T17:42:54.320834+0000 mon.a (mon.0) 2537 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T17:42:55.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:42:54 gibba045 bash[25517]: audit 2021-03-10T17:42:54.321256+0000 mon.c (mon.1) 3380 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:42:55.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:42:54 gibba045 bash[25517]: audit 2021-03-10T17:42:54.322109+0000 mon.c (mon.1) 3381 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T17:42:55.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:42:54 gibba045 bash[25517]: audit 2021-03-10T17:42:54.322166+0000 mon.a (mon.0) 2538 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:42:55.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:42:54 gibba045 bash[25517]: audit 2021-03-10T17:42:54.323347+0000 mon.a (mon.0) 2539 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:42:55.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:42:54 gibba045 bash[25517]: audit 2021-03-10T17:42:54.324162+0000 mon.a (mon.0) 2540 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T17:42:56.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:42:56 gibba015 bash[29377]: cluster 2021-03-10T17:42:55.249578+0000 mgr.gibba045.orlgmj (mgr.34412) 12329 : cluster [DBG] pgmap v7031: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:56.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:42:56 gibba015 bash[30343]: cluster 2021-03-10T17:42:55.249578+0000 mgr.gibba045.orlgmj (mgr.34412) 12329 : cluster [DBG] pgmap v7031: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:57.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:42:56 gibba045 bash[25517]: cluster 2021-03-10T17:42:55.249578+0000 mgr.gibba045.orlgmj (mgr.34412) 12329 : cluster [DBG] pgmap v7031: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:58.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:42:58 gibba015 bash[29377]: cluster 2021-03-10T17:42:57.251336+0000 mgr.gibba045.orlgmj (mgr.34412) 12330 : cluster [DBG] pgmap v7032: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:58.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:42:58 gibba015 bash[30343]: cluster 2021-03-10T17:42:57.251336+0000 mgr.gibba045.orlgmj (mgr.34412) 12330 : cluster [DBG] pgmap v7032: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:59.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:42:58 gibba045 bash[25517]: cluster 2021-03-10T17:42:57.251336+0000 mgr.gibba045.orlgmj (mgr.34412) 12330 : cluster [DBG] pgmap v7032: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:00.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:43:00 gibba045 bash[25517]: cluster 2021-03-10T17:42:59.252589+0000 mgr.gibba045.orlgmj (mgr.34412) 12331 : cluster [DBG] pgmap v7033: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:00.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:43:00 gibba045 bash[25517]: audit 2021-03-10T17:43:00.244041+0000 mon.c (mon.1) 3382 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:43:00.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:43:00 gibba045 bash[25517]: audit 2021-03-10T17:43:00.457315+0000 mon.a (mon.0) 2541 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:43:00.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:43:00 gibba045 bash[25517]: audit 2021-03-10T17:43:00.461018+0000 mon.c (mon.1) 3383 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:43:00.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:43:00 gibba045 bash[25517]: audit 2021-03-10T17:43:00.462563+0000 mon.c (mon.1) 3384 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:43:00.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:43:00 gibba045 bash[25517]: audit 2021-03-10T17:43:00.464152+0000 mon.c (mon.1) 3385 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:43:00.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:43:00 gibba045 bash[25517]: audit 2021-03-10T17:43:00.465575+0000 mon.c (mon.1) 3386 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:43:00.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:43:00 gibba045 bash[25517]: audit 2021-03-10T17:43:00.469016+0000 mon.c (mon.1) 3387 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:43:00.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:43:00 gibba045 bash[25517]: audit 2021-03-10T17:43:00.470697+0000 mon.c (mon.1) 3388 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:43:00.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:43:00 gibba015 bash[29377]: cluster 2021-03-10T17:42:59.252589+0000 mgr.gibba045.orlgmj (mgr.34412) 12331 : cluster [DBG] pgmap v7033: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:00.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:43:00 gibba015 bash[29377]: audit 2021-03-10T17:43:00.244041+0000 mon.c (mon.1) 3382 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:43:00.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:43:00 gibba015 bash[29377]: audit 2021-03-10T17:43:00.457315+0000 mon.a (mon.0) 2541 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:43:00.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:43:00 gibba015 bash[29377]: audit 2021-03-10T17:43:00.461018+0000 mon.c (mon.1) 3383 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:43:00.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:43:00 gibba015 bash[29377]: audit 2021-03-10T17:43:00.462563+0000 mon.c (mon.1) 3384 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:43:00.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:43:00 gibba015 bash[29377]: audit 2021-03-10T17:43:00.464152+0000 mon.c (mon.1) 3385 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:43:00.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:43:00 gibba015 bash[29377]: audit 2021-03-10T17:43:00.465575+0000 mon.c (mon.1) 3386 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:43:00.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:43:00 gibba015 bash[29377]: audit 2021-03-10T17:43:00.469016+0000 mon.c (mon.1) 3387 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:43:00.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:43:00 gibba015 bash[29377]: audit 2021-03-10T17:43:00.470697+0000 mon.c (mon.1) 3388 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:43:00.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:43:00 gibba015 bash[30343]: cluster 2021-03-10T17:42:59.252589+0000 mgr.gibba045.orlgmj (mgr.34412) 12331 : cluster [DBG] pgmap v7033: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:00.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:43:00 gibba015 bash[30343]: audit 2021-03-10T17:43:00.244041+0000 mon.c (mon.1) 3382 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:43:00.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:43:00 gibba015 bash[30343]: audit 2021-03-10T17:43:00.457315+0000 mon.a (mon.0) 2541 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:43:00.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:43:00 gibba015 bash[30343]: audit 2021-03-10T17:43:00.461018+0000 mon.c (mon.1) 3383 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:43:00.976 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:43:00 gibba015 bash[30343]: audit 2021-03-10T17:43:00.462563+0000 mon.c (mon.1) 3384 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:43:00.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:43:00 gibba015 bash[30343]: audit 2021-03-10T17:43:00.464152+0000 mon.c (mon.1) 3385 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:43:00.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:43:00 gibba015 bash[30343]: audit 2021-03-10T17:43:00.465575+0000 mon.c (mon.1) 3386 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:43:00.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:43:00 gibba015 bash[30343]: audit 2021-03-10T17:43:00.469016+0000 mon.c (mon.1) 3387 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:43:00.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:43:00 gibba015 bash[30343]: audit 2021-03-10T17:43:00.470697+0000 mon.c (mon.1) 3388 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:43:01.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:43:01 gibba015 bash[29377]: cephadm 2021-03-10T17:43:00.251131+0000 mgr.gibba045.orlgmj (mgr.34412) 12332 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:43:01.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:43:01 gibba015 bash[29377]: cephadm 2021-03-10T17:43:00.253060+0000 mgr.gibba045.orlgmj (mgr.34412) 12333 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:43:01.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:43:01 gibba015 bash[29377]: cephadm 2021-03-10T17:43:00.462221+0000 mgr.gibba045.orlgmj (mgr.34412) 12334 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:43:01.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:43:01 gibba015 bash[29377]: cephadm 2021-03-10T17:43:00.464117+0000 mgr.gibba045.orlgmj (mgr.34412) 12335 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:43:01.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:43:01 gibba015 bash[29377]: cephadm 2021-03-10T17:43:00.465598+0000 mgr.gibba045.orlgmj (mgr.34412) 12336 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:43:01.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:43:01 gibba015 bash[29377]: cephadm 2021-03-10T17:43:00.465635+0000 mgr.gibba045.orlgmj (mgr.34412) 12337 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:43:01.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:43:01 gibba015 bash[29377]: cephadm 2021-03-10T17:43:00.466993+0000 mgr.gibba045.orlgmj (mgr.34412) 12338 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:43:01.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:43:01 gibba015 bash[29377]: cephadm 2021-03-10T17:43:00.467030+0000 mgr.gibba045.orlgmj (mgr.34412) 12339 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:43:01.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:43:01 gibba015 bash[29377]: cephadm 2021-03-10T17:43:00.468321+0000 mgr.gibba045.orlgmj (mgr.34412) 12340 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:43:01.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:43:01 gibba015 bash[29377]: cephadm 2021-03-10T17:43:00.470224+0000 mgr.gibba045.orlgmj (mgr.34412) 12341 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:43:01.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:43:01 gibba015 bash[29377]: cephadm 2021-03-10T17:43:00.470297+0000 mgr.gibba045.orlgmj (mgr.34412) 12342 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:43:01.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:43:01 gibba015 bash[29377]: cephadm 2021-03-10T17:43:00.471820+0000 mgr.gibba045.orlgmj (mgr.34412) 12343 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:43:01.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:43:01 gibba015 bash[29377]: cephadm 2021-03-10T17:43:00.472150+0000 mgr.gibba045.orlgmj (mgr.34412) 12344 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:43:01.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:43:01 gibba015 bash[29377]: cephadm 2021-03-10T17:43:00.473604+0000 mgr.gibba045.orlgmj (mgr.34412) 12345 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:43:01.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:43:01 gibba015 bash[29377]: cephadm 2021-03-10T17:43:00.473649+0000 mgr.gibba045.orlgmj (mgr.34412) 12346 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:43:01.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:43:01 gibba015 bash[29377]: cephadm 2021-03-10T17:43:00.473758+0000 mgr.gibba045.orlgmj (mgr.34412) 12347 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:43:01.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:43:01 gibba015 bash[30343]: cephadm 2021-03-10T17:43:00.251131+0000 mgr.gibba045.orlgmj (mgr.34412) 12332 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:43:01.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:43:01 gibba015 bash[30343]: cephadm 2021-03-10T17:43:00.253060+0000 mgr.gibba045.orlgmj (mgr.34412) 12333 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:43:01.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:43:01 gibba015 bash[30343]: cephadm 2021-03-10T17:43:00.462221+0000 mgr.gibba045.orlgmj (mgr.34412) 12334 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:43:01.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:43:01 gibba015 bash[30343]: cephadm 2021-03-10T17:43:00.464117+0000 mgr.gibba045.orlgmj (mgr.34412) 12335 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:43:01.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:43:01 gibba015 bash[30343]: cephadm 2021-03-10T17:43:00.465598+0000 mgr.gibba045.orlgmj (mgr.34412) 12336 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:43:01.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:43:01 gibba015 bash[30343]: cephadm 2021-03-10T17:43:00.465635+0000 mgr.gibba045.orlgmj (mgr.34412) 12337 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:43:01.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:43:01 gibba015 bash[30343]: cephadm 2021-03-10T17:43:00.466993+0000 mgr.gibba045.orlgmj (mgr.34412) 12338 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:43:01.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:43:01 gibba015 bash[30343]: cephadm 2021-03-10T17:43:00.467030+0000 mgr.gibba045.orlgmj (mgr.34412) 12339 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:43:01.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:43:01 gibba015 bash[30343]: cephadm 2021-03-10T17:43:00.468321+0000 mgr.gibba045.orlgmj (mgr.34412) 12340 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:43:01.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:43:01 gibba015 bash[30343]: cephadm 2021-03-10T17:43:00.470224+0000 mgr.gibba045.orlgmj (mgr.34412) 12341 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:43:01.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:43:01 gibba015 bash[30343]: cephadm 2021-03-10T17:43:00.470297+0000 mgr.gibba045.orlgmj (mgr.34412) 12342 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:43:01.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:43:01 gibba015 bash[30343]: cephadm 2021-03-10T17:43:00.471820+0000 mgr.gibba045.orlgmj (mgr.34412) 12343 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:43:01.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:43:01 gibba015 bash[30343]: cephadm 2021-03-10T17:43:00.472150+0000 mgr.gibba045.orlgmj (mgr.34412) 12344 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:43:01.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:43:01 gibba015 bash[30343]: cephadm 2021-03-10T17:43:00.473604+0000 mgr.gibba045.orlgmj (mgr.34412) 12345 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:43:01.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:43:01 gibba015 bash[30343]: cephadm 2021-03-10T17:43:00.473649+0000 mgr.gibba045.orlgmj (mgr.34412) 12346 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:43:01.982 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:43:01 gibba015 bash[30343]: cephadm 2021-03-10T17:43:00.473758+0000 mgr.gibba045.orlgmj (mgr.34412) 12347 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:43:02.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:43:01 gibba045 bash[25517]: cephadm 2021-03-10T17:43:00.251131+0000 mgr.gibba045.orlgmj (mgr.34412) 12332 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:43:02.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:43:01 gibba045 bash[25517]: cephadm 2021-03-10T17:43:00.253060+0000 mgr.gibba045.orlgmj (mgr.34412) 12333 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:43:02.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:43:01 gibba045 bash[25517]: cephadm 2021-03-10T17:43:00.462221+0000 mgr.gibba045.orlgmj (mgr.34412) 12334 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:43:02.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:43:01 gibba045 bash[25517]: cephadm 2021-03-10T17:43:00.464117+0000 mgr.gibba045.orlgmj (mgr.34412) 12335 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:43:02.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:43:01 gibba045 bash[25517]: cephadm 2021-03-10T17:43:00.465598+0000 mgr.gibba045.orlgmj (mgr.34412) 12336 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:43:02.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:43:01 gibba045 bash[25517]: cephadm 2021-03-10T17:43:00.465635+0000 mgr.gibba045.orlgmj (mgr.34412) 12337 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:43:02.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:43:01 gibba045 bash[25517]: cephadm 2021-03-10T17:43:00.466993+0000 mgr.gibba045.orlgmj (mgr.34412) 12338 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:43:02.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:43:01 gibba045 bash[25517]: cephadm 2021-03-10T17:43:00.467030+0000 mgr.gibba045.orlgmj (mgr.34412) 12339 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:43:02.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:43:01 gibba045 bash[25517]: cephadm 2021-03-10T17:43:00.468321+0000 mgr.gibba045.orlgmj (mgr.34412) 12340 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:43:02.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:43:01 gibba045 bash[25517]: cephadm 2021-03-10T17:43:00.470224+0000 mgr.gibba045.orlgmj (mgr.34412) 12341 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:43:02.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:43:01 gibba045 bash[25517]: cephadm 2021-03-10T17:43:00.470297+0000 mgr.gibba045.orlgmj (mgr.34412) 12342 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:43:02.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:43:01 gibba045 bash[25517]: cephadm 2021-03-10T17:43:00.471820+0000 mgr.gibba045.orlgmj (mgr.34412) 12343 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:43:02.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:43:01 gibba045 bash[25517]: cephadm 2021-03-10T17:43:00.472150+0000 mgr.gibba045.orlgmj (mgr.34412) 12344 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:43:02.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:43:01 gibba045 bash[25517]: cephadm 2021-03-10T17:43:00.473604+0000 mgr.gibba045.orlgmj (mgr.34412) 12345 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:43:02.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:43:01 gibba045 bash[25517]: cephadm 2021-03-10T17:43:00.473649+0000 mgr.gibba045.orlgmj (mgr.34412) 12346 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:43:02.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:43:01 gibba045 bash[25517]: cephadm 2021-03-10T17:43:00.473758+0000 mgr.gibba045.orlgmj (mgr.34412) 12347 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:43:02.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:43:02 gibba015 bash[29377]: cluster 2021-03-10T17:43:01.254049+0000 mgr.gibba045.orlgmj (mgr.34412) 12348 : cluster [DBG] pgmap v7034: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:02.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:43:02 gibba015 bash[30343]: cluster 2021-03-10T17:43:01.254049+0000 mgr.gibba045.orlgmj (mgr.34412) 12348 : cluster [DBG] pgmap v7034: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:03.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:43:02 gibba045 bash[25517]: cluster 2021-03-10T17:43:01.254049+0000 mgr.gibba045.orlgmj (mgr.34412) 12348 : cluster [DBG] pgmap v7034: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:04.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:43:04 gibba015 bash[29377]: cluster 2021-03-10T17:43:03.255749+0000 mgr.gibba045.orlgmj (mgr.34412) 12349 : cluster [DBG] pgmap v7035: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:04.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:43:04 gibba015 bash[30343]: cluster 2021-03-10T17:43:03.255749+0000 mgr.gibba045.orlgmj (mgr.34412) 12349 : cluster [DBG] pgmap v7035: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:05.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:43:04 gibba045 bash[25517]: cluster 2021-03-10T17:43:03.255749+0000 mgr.gibba045.orlgmj (mgr.34412) 12349 : cluster [DBG] pgmap v7035: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:06.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:43:06 gibba015 bash[29377]: cluster 2021-03-10T17:43:05.257350+0000 mgr.gibba045.orlgmj (mgr.34412) 12350 : cluster [DBG] pgmap v7036: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:06.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:43:06 gibba015 bash[30343]: cluster 2021-03-10T17:43:05.257350+0000 mgr.gibba045.orlgmj (mgr.34412) 12350 : cluster [DBG] pgmap v7036: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:07.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:43:06 gibba045 bash[25517]: cluster 2021-03-10T17:43:05.257350+0000 mgr.gibba045.orlgmj (mgr.34412) 12350 : cluster [DBG] pgmap v7036: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:08.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:43:08 gibba015 bash[29377]: cluster 2021-03-10T17:43:07.259310+0000 mgr.gibba045.orlgmj (mgr.34412) 12351 : cluster [DBG] pgmap v7037: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:08.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:43:08 gibba015 bash[30343]: cluster 2021-03-10T17:43:07.259310+0000 mgr.gibba045.orlgmj (mgr.34412) 12351 : cluster [DBG] pgmap v7037: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:09.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:43:08 gibba045 bash[25517]: cluster 2021-03-10T17:43:07.259310+0000 mgr.gibba045.orlgmj (mgr.34412) 12351 : cluster [DBG] pgmap v7037: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:10.396 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:43:10.621 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:43:10.622 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 5m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:43:10.622 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 4m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:43:10.622 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 4m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:43:10.622 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 4m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:43:10.623 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 5m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:43:10.623 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 5m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:43:10.623 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 4m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:43:10.623 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 5m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:43:10.623 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 5m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:43:10.624 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 4m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:43:10.624 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 5m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:43:10.624 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 5m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:43:10.624 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 5m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:43:10.625 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 5m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:43:10.625 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 4m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:43:10.625 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 4m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:43:10.625 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 4m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:43:10.626 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:43:10.626 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 4m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:43:10.626 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 4m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:43:10.876 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:43:10.877 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:43:10.877 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:43:10.877 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:43:10.877 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:43:10.878 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:43:10.878 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:43:10.878 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:43:10.878 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:43:10.879 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:43:10.879 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:43:10.879 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:43:10.879 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:43:10.879 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:43:10.880 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:43:10.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:43:10 gibba015 bash[29377]: cluster 2021-03-10T17:43:09.260772+0000 mgr.gibba045.orlgmj (mgr.34412) 12352 : cluster [DBG] pgmap v7038: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:10.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:43:10 gibba015 bash[30343]: cluster 2021-03-10T17:43:09.260772+0000 mgr.gibba045.orlgmj (mgr.34412) 12352 : cluster [DBG] pgmap v7038: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:11.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:43:10 gibba045 bash[25517]: cluster 2021-03-10T17:43:09.260772+0000 mgr.gibba045.orlgmj (mgr.34412) 12352 : cluster [DBG] pgmap v7038: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:11.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:43:11 gibba015 bash[29377]: audit 2021-03-10T17:43:10.386050+0000 mgr.gibba045.orlgmj (mgr.34412) 12353 : audit [DBG] from='client.52332 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:43:11.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:43:11 gibba015 bash[29377]: audit 2021-03-10T17:43:10.608033+0000 mgr.gibba045.orlgmj (mgr.34412) 12354 : audit [DBG] from='client.62323 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:43:11.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:43:11 gibba015 bash[29377]: audit 2021-03-10T17:43:10.873509+0000 mon.a (mon.0) 2542 : audit [DBG] from='client.? 172.21.2.115:0/3628693987' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:43:11.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:43:11 gibba015 bash[30343]: audit 2021-03-10T17:43:10.386050+0000 mgr.gibba045.orlgmj (mgr.34412) 12353 : audit [DBG] from='client.52332 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:43:11.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:43:11 gibba015 bash[30343]: audit 2021-03-10T17:43:10.608033+0000 mgr.gibba045.orlgmj (mgr.34412) 12354 : audit [DBG] from='client.62323 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:43:11.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:43:11 gibba015 bash[30343]: audit 2021-03-10T17:43:10.873509+0000 mon.a (mon.0) 2542 : audit [DBG] from='client.? 172.21.2.115:0/3628693987' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:43:12.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:43:11 gibba045 bash[25517]: audit 2021-03-10T17:43:10.386050+0000 mgr.gibba045.orlgmj (mgr.34412) 12353 : audit [DBG] from='client.52332 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:43:12.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:43:11 gibba045 bash[25517]: audit 2021-03-10T17:43:10.608033+0000 mgr.gibba045.orlgmj (mgr.34412) 12354 : audit [DBG] from='client.62323 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:43:12.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:43:11 gibba045 bash[25517]: audit 2021-03-10T17:43:10.873509+0000 mon.a (mon.0) 2542 : audit [DBG] from='client.? 172.21.2.115:0/3628693987' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:43:12.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:43:12 gibba015 bash[30343]: cluster 2021-03-10T17:43:11.262767+0000 mgr.gibba045.orlgmj (mgr.34412) 12355 : cluster [DBG] pgmap v7039: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:12.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:43:12 gibba015 bash[29377]: cluster 2021-03-10T17:43:11.262767+0000 mgr.gibba045.orlgmj (mgr.34412) 12355 : cluster [DBG] pgmap v7039: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:13.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:43:12 gibba045 bash[25517]: cluster 2021-03-10T17:43:11.262767+0000 mgr.gibba045.orlgmj (mgr.34412) 12355 : cluster [DBG] pgmap v7039: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:15.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:43:14 gibba045 bash[25517]: cluster 2021-03-10T17:43:13.264475+0000 mgr.gibba045.orlgmj (mgr.34412) 12356 : cluster [DBG] pgmap v7040: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:15.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:43:14 gibba015 bash[29377]: cluster 2021-03-10T17:43:13.264475+0000 mgr.gibba045.orlgmj (mgr.34412) 12356 : cluster [DBG] pgmap v7040: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:15.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:43:14 gibba015 bash[30343]: cluster 2021-03-10T17:43:13.264475+0000 mgr.gibba045.orlgmj (mgr.34412) 12356 : cluster [DBG] pgmap v7040: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:17.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:43:16 gibba045 bash[25517]: cluster 2021-03-10T17:43:15.266019+0000 mgr.gibba045.orlgmj (mgr.34412) 12357 : cluster [DBG] pgmap v7041: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:17.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:43:16 gibba045 bash[25517]: cephadm 2021-03-10T17:43:15.489827+0000 mgr.gibba045.orlgmj (mgr.34412) 12358 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:43:17.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:43:16 gibba015 bash[29377]: cluster 2021-03-10T17:43:15.266019+0000 mgr.gibba045.orlgmj (mgr.34412) 12357 : cluster [DBG] pgmap v7041: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:17.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:43:16 gibba015 bash[29377]: cephadm 2021-03-10T17:43:15.489827+0000 mgr.gibba045.orlgmj (mgr.34412) 12358 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:43:17.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:43:16 gibba015 bash[30343]: cluster 2021-03-10T17:43:15.266019+0000 mgr.gibba045.orlgmj (mgr.34412) 12357 : cluster [DBG] pgmap v7041: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:17.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:43:16 gibba015 bash[30343]: cephadm 2021-03-10T17:43:15.489827+0000 mgr.gibba045.orlgmj (mgr.34412) 12358 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:43:19.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:43:18 gibba045 bash[25517]: cluster 2021-03-10T17:43:17.267831+0000 mgr.gibba045.orlgmj (mgr.34412) 12359 : cluster [DBG] pgmap v7042: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:19.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:43:18 gibba015 bash[29377]: cluster 2021-03-10T17:43:17.267831+0000 mgr.gibba045.orlgmj (mgr.34412) 12359 : cluster [DBG] pgmap v7042: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:19.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:43:18 gibba015 bash[30343]: cluster 2021-03-10T17:43:17.267831+0000 mgr.gibba045.orlgmj (mgr.34412) 12359 : cluster [DBG] pgmap v7042: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:21.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:43:20 gibba045 bash[25517]: cluster 2021-03-10T17:43:19.269409+0000 mgr.gibba045.orlgmj (mgr.34412) 12360 : cluster [DBG] pgmap v7043: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:21.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:43:20 gibba015 bash[29377]: cluster 2021-03-10T17:43:19.269409+0000 mgr.gibba045.orlgmj (mgr.34412) 12360 : cluster [DBG] pgmap v7043: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:21.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:43:20 gibba015 bash[30343]: cluster 2021-03-10T17:43:19.269409+0000 mgr.gibba045.orlgmj (mgr.34412) 12360 : cluster [DBG] pgmap v7043: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:23.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:43:22 gibba045 bash[25517]: cluster 2021-03-10T17:43:21.271048+0000 mgr.gibba045.orlgmj (mgr.34412) 12361 : cluster [DBG] pgmap v7044: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:23.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:43:22 gibba015 bash[29377]: cluster 2021-03-10T17:43:21.271048+0000 mgr.gibba045.orlgmj (mgr.34412) 12361 : cluster [DBG] pgmap v7044: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:23.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:43:22 gibba015 bash[30343]: cluster 2021-03-10T17:43:21.271048+0000 mgr.gibba045.orlgmj (mgr.34412) 12361 : cluster [DBG] pgmap v7044: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:25.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:43:24 gibba045 bash[25517]: cluster 2021-03-10T17:43:23.272827+0000 mgr.gibba045.orlgmj (mgr.34412) 12362 : cluster [DBG] pgmap v7045: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:25.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:43:24 gibba015 bash[29377]: cluster 2021-03-10T17:43:23.272827+0000 mgr.gibba045.orlgmj (mgr.34412) 12362 : cluster [DBG] pgmap v7045: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:25.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:43:24 gibba015 bash[30343]: cluster 2021-03-10T17:43:23.272827+0000 mgr.gibba045.orlgmj (mgr.34412) 12362 : cluster [DBG] pgmap v7045: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:27.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:43:26 gibba045 bash[25517]: cluster 2021-03-10T17:43:25.274514+0000 mgr.gibba045.orlgmj (mgr.34412) 12363 : cluster [DBG] pgmap v7046: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:27.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:43:26 gibba015 bash[29377]: cluster 2021-03-10T17:43:25.274514+0000 mgr.gibba045.orlgmj (mgr.34412) 12363 : cluster [DBG] pgmap v7046: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:27.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:43:26 gibba015 bash[30343]: cluster 2021-03-10T17:43:25.274514+0000 mgr.gibba045.orlgmj (mgr.34412) 12363 : cluster [DBG] pgmap v7046: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:29.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:43:28 gibba045 bash[25517]: cluster 2021-03-10T17:43:27.276135+0000 mgr.gibba045.orlgmj (mgr.34412) 12364 : cluster [DBG] pgmap v7047: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:29.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:43:28 gibba015 bash[29377]: cluster 2021-03-10T17:43:27.276135+0000 mgr.gibba045.orlgmj (mgr.34412) 12364 : cluster [DBG] pgmap v7047: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:29.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:43:28 gibba015 bash[30343]: cluster 2021-03-10T17:43:27.276135+0000 mgr.gibba045.orlgmj (mgr.34412) 12364 : cluster [DBG] pgmap v7047: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:31.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:43:30 gibba045 bash[25517]: cluster 2021-03-10T17:43:29.277620+0000 mgr.gibba045.orlgmj (mgr.34412) 12365 : cluster [DBG] pgmap v7048: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:31.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:43:30 gibba015 bash[29377]: cluster 2021-03-10T17:43:29.277620+0000 mgr.gibba045.orlgmj (mgr.34412) 12365 : cluster [DBG] pgmap v7048: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:31.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:43:30 gibba015 bash[30343]: cluster 2021-03-10T17:43:29.277620+0000 mgr.gibba045.orlgmj (mgr.34412) 12365 : cluster [DBG] pgmap v7048: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:32.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:43:31 gibba045 bash[25517]: cephadm 2021-03-10T17:43:30.505913+0000 mgr.gibba045.orlgmj (mgr.34412) 12366 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:43:32.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:43:31 gibba015 bash[29377]: cephadm 2021-03-10T17:43:30.505913+0000 mgr.gibba045.orlgmj (mgr.34412) 12366 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:43:32.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:43:31 gibba015 bash[30343]: cephadm 2021-03-10T17:43:30.505913+0000 mgr.gibba045.orlgmj (mgr.34412) 12366 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:43:33.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:43:32 gibba015 bash[29377]: cluster 2021-03-10T17:43:31.279328+0000 mgr.gibba045.orlgmj (mgr.34412) 12367 : cluster [DBG] pgmap v7049: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:33.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:43:32 gibba015 bash[30343]: cluster 2021-03-10T17:43:31.279328+0000 mgr.gibba045.orlgmj (mgr.34412) 12367 : cluster [DBG] pgmap v7049: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:33.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:43:32 gibba045 bash[25517]: cluster 2021-03-10T17:43:31.279328+0000 mgr.gibba045.orlgmj (mgr.34412) 12367 : cluster [DBG] pgmap v7049: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:35.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:43:34 gibba015 bash[29377]: cluster 2021-03-10T17:43:33.280893+0000 mgr.gibba045.orlgmj (mgr.34412) 12368 : cluster [DBG] pgmap v7050: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:35.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:43:34 gibba015 bash[30343]: cluster 2021-03-10T17:43:33.280893+0000 mgr.gibba045.orlgmj (mgr.34412) 12368 : cluster [DBG] pgmap v7050: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:35.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:43:34 gibba045 bash[25517]: cluster 2021-03-10T17:43:33.280893+0000 mgr.gibba045.orlgmj (mgr.34412) 12368 : cluster [DBG] pgmap v7050: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:37.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:43:36 gibba015 bash[29377]: cluster 2021-03-10T17:43:35.282603+0000 mgr.gibba045.orlgmj (mgr.34412) 12369 : cluster [DBG] pgmap v7051: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:37.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:43:36 gibba015 bash[30343]: cluster 2021-03-10T17:43:35.282603+0000 mgr.gibba045.orlgmj (mgr.34412) 12369 : cluster [DBG] pgmap v7051: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:37.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:43:36 gibba045 bash[25517]: cluster 2021-03-10T17:43:35.282603+0000 mgr.gibba045.orlgmj (mgr.34412) 12369 : cluster [DBG] pgmap v7051: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:39.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:43:38 gibba015 bash[29377]: cluster 2021-03-10T17:43:37.284220+0000 mgr.gibba045.orlgmj (mgr.34412) 12370 : cluster [DBG] pgmap v7052: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:39.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:43:38 gibba015 bash[30343]: cluster 2021-03-10T17:43:37.284220+0000 mgr.gibba045.orlgmj (mgr.34412) 12370 : cluster [DBG] pgmap v7052: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:39.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:43:38 gibba045 bash[25517]: cluster 2021-03-10T17:43:37.284220+0000 mgr.gibba045.orlgmj (mgr.34412) 12370 : cluster [DBG] pgmap v7052: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:41.116 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:43:41.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:43:40 gibba015 bash[29377]: cluster 2021-03-10T17:43:39.285764+0000 mgr.gibba045.orlgmj (mgr.34412) 12371 : cluster [DBG] pgmap v7053: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:41.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:43:40 gibba015 bash[30343]: cluster 2021-03-10T17:43:39.285764+0000 mgr.gibba045.orlgmj (mgr.34412) 12371 : cluster [DBG] pgmap v7053: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:41.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:43:40 gibba045 bash[25517]: cluster 2021-03-10T17:43:39.285764+0000 mgr.gibba045.orlgmj (mgr.34412) 12371 : cluster [DBG] pgmap v7053: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:41.342 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:43:41.342 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 5m ago 3h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:43:41.343 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (3h) 4m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:43:41.343 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 4m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:43:41.343 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 4m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:43:41.343 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 5m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:43:41.344 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 5m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:43:41.344 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 4m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:43:41.344 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 5m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:43:41.344 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (3h) 5m ago 3h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:43:41.344 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (3h) 4m ago 3h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:43:41.345 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 5m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:43:41.345 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 5m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:43:41.345 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 5m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:43:41.345 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 5m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:43:41.346 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 4m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:43:41.346 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 4m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:43:41.346 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 4m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:43:41.346 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 4m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:43:41.347 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 4m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:43:41.347 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 4m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:43:41.589 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:43:41.589 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:43:41.589 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:43:41.589 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:43:41.590 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:43:41.590 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:43:41.590 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:43:41.590 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:43:41.591 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:43:41.591 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:43:41.591 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:43:41.591 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:43:41.592 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:43:41.592 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:43:41.592 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:43:42.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:43:41 gibba015 bash[29377]: audit 2021-03-10T17:43:41.106630+0000 mgr.gibba045.orlgmj (mgr.34412) 12372 : audit [DBG] from='client.62335 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:43:42.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:43:41 gibba015 bash[29377]: audit 2021-03-10T17:43:41.586050+0000 mon.c (mon.1) 3389 : audit [DBG] from='client.? 172.21.2.115:0/3440170602' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:43:42.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:43:41 gibba015 bash[30343]: audit 2021-03-10T17:43:41.106630+0000 mgr.gibba045.orlgmj (mgr.34412) 12372 : audit [DBG] from='client.62335 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:43:42.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:43:41 gibba015 bash[30343]: audit 2021-03-10T17:43:41.586050+0000 mon.c (mon.1) 3389 : audit [DBG] from='client.? 172.21.2.115:0/3440170602' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:43:42.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:43:41 gibba045 bash[25517]: audit 2021-03-10T17:43:41.106630+0000 mgr.gibba045.orlgmj (mgr.34412) 12372 : audit [DBG] from='client.62335 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:43:42.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:43:41 gibba045 bash[25517]: audit 2021-03-10T17:43:41.586050+0000 mon.c (mon.1) 3389 : audit [DBG] from='client.? 172.21.2.115:0/3440170602' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:43:43.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:43:42 gibba015 bash[29377]: cluster 2021-03-10T17:43:41.287488+0000 mgr.gibba045.orlgmj (mgr.34412) 12373 : cluster [DBG] pgmap v7054: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:43.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:43:42 gibba015 bash[29377]: audit 2021-03-10T17:43:41.328501+0000 mgr.gibba045.orlgmj (mgr.34412) 12374 : audit [DBG] from='client.62341 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:43:43.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:43:42 gibba015 bash[30343]: cluster 2021-03-10T17:43:41.287488+0000 mgr.gibba045.orlgmj (mgr.34412) 12373 : cluster [DBG] pgmap v7054: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:43.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:43:42 gibba015 bash[30343]: audit 2021-03-10T17:43:41.328501+0000 mgr.gibba045.orlgmj (mgr.34412) 12374 : audit [DBG] from='client.62341 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:43:43.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:43:42 gibba045 bash[25517]: cluster 2021-03-10T17:43:41.287488+0000 mgr.gibba045.orlgmj (mgr.34412) 12373 : cluster [DBG] pgmap v7054: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:43.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:43:42 gibba045 bash[25517]: audit 2021-03-10T17:43:41.328501+0000 mgr.gibba045.orlgmj (mgr.34412) 12374 : audit [DBG] from='client.62341 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:43:45.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:43:44 gibba015 bash[29377]: cluster 2021-03-10T17:43:43.289045+0000 mgr.gibba045.orlgmj (mgr.34412) 12375 : cluster [DBG] pgmap v7055: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:45.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:43:44 gibba015 bash[30343]: cluster 2021-03-10T17:43:43.289045+0000 mgr.gibba045.orlgmj (mgr.34412) 12375 : cluster [DBG] pgmap v7055: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:45.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:43:44 gibba045 bash[25517]: cluster 2021-03-10T17:43:43.289045+0000 mgr.gibba045.orlgmj (mgr.34412) 12375 : cluster [DBG] pgmap v7055: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:47.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:43:46 gibba015 bash[29377]: cluster 2021-03-10T17:43:45.290716+0000 mgr.gibba045.orlgmj (mgr.34412) 12376 : cluster [DBG] pgmap v7056: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:47.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:43:46 gibba015 bash[29377]: cephadm 2021-03-10T17:43:45.521894+0000 mgr.gibba045.orlgmj (mgr.34412) 12377 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:43:47.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:43:46 gibba015 bash[30343]: cluster 2021-03-10T17:43:45.290716+0000 mgr.gibba045.orlgmj (mgr.34412) 12376 : cluster [DBG] pgmap v7056: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:47.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:43:46 gibba015 bash[30343]: cephadm 2021-03-10T17:43:45.521894+0000 mgr.gibba045.orlgmj (mgr.34412) 12377 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:43:47.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:43:46 gibba045 bash[25517]: cluster 2021-03-10T17:43:45.290716+0000 mgr.gibba045.orlgmj (mgr.34412) 12376 : cluster [DBG] pgmap v7056: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:47.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:43:46 gibba045 bash[25517]: cephadm 2021-03-10T17:43:45.521894+0000 mgr.gibba045.orlgmj (mgr.34412) 12377 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:43:49.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:43:48 gibba015 bash[29377]: cluster 2021-03-10T17:43:47.292304+0000 mgr.gibba045.orlgmj (mgr.34412) 12378 : cluster [DBG] pgmap v7057: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:49.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:43:48 gibba015 bash[30343]: cluster 2021-03-10T17:43:47.292304+0000 mgr.gibba045.orlgmj (mgr.34412) 12378 : cluster [DBG] pgmap v7057: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:49.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:43:48 gibba045 bash[25517]: cluster 2021-03-10T17:43:47.292304+0000 mgr.gibba045.orlgmj (mgr.34412) 12378 : cluster [DBG] pgmap v7057: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:51.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:43:50 gibba015 bash[29377]: cluster 2021-03-10T17:43:49.293519+0000 mgr.gibba045.orlgmj (mgr.34412) 12379 : cluster [DBG] pgmap v7058: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:51.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:43:50 gibba015 bash[30343]: cluster 2021-03-10T17:43:49.293519+0000 mgr.gibba045.orlgmj (mgr.34412) 12379 : cluster [DBG] pgmap v7058: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:51.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:43:50 gibba045 bash[25517]: cluster 2021-03-10T17:43:49.293519+0000 mgr.gibba045.orlgmj (mgr.34412) 12379 : cluster [DBG] pgmap v7058: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:53.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:43:52 gibba015 bash[29377]: cluster 2021-03-10T17:43:51.295223+0000 mgr.gibba045.orlgmj (mgr.34412) 12380 : cluster [DBG] pgmap v7059: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:53.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:43:52 gibba015 bash[30343]: cluster 2021-03-10T17:43:51.295223+0000 mgr.gibba045.orlgmj (mgr.34412) 12380 : cluster [DBG] pgmap v7059: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:53.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:43:52 gibba045 bash[25517]: cluster 2021-03-10T17:43:51.295223+0000 mgr.gibba045.orlgmj (mgr.34412) 12380 : cluster [DBG] pgmap v7059: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:55.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:43:54 gibba015 bash[29377]: cluster 2021-03-10T17:43:53.296914+0000 mgr.gibba045.orlgmj (mgr.34412) 12381 : cluster [DBG] pgmap v7060: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:55.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:43:54 gibba015 bash[29377]: audit 2021-03-10T17:43:54.186811+0000 mon.c (mon.1) 3390 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:43:55.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:43:54 gibba015 bash[29377]: audit 2021-03-10T17:43:54.188000+0000 mon.a (mon.0) 2543 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:43:55.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:43:54 gibba015 bash[29377]: audit 2021-03-10T17:43:54.188396+0000 mon.c (mon.1) 3391 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:43:55.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:43:54 gibba015 bash[29377]: audit 2021-03-10T17:43:54.189662+0000 mon.a (mon.0) 2544 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:43:55.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:43:54 gibba015 bash[29377]: audit 2021-03-10T17:43:54.329696+0000 mon.c (mon.1) 3392 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T17:43:55.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:43:54 gibba015 bash[29377]: audit 2021-03-10T17:43:54.330440+0000 mon.c (mon.1) 3393 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:43:55.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:43:54 gibba015 bash[29377]: audit 2021-03-10T17:43:54.331024+0000 mon.a (mon.0) 2545 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T17:43:55.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:43:54 gibba015 bash[29377]: audit 2021-03-10T17:43:54.331443+0000 mon.c (mon.1) 3394 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T17:43:55.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:43:54 gibba015 bash[29377]: audit 2021-03-10T17:43:54.332759+0000 mon.a (mon.0) 2546 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:43:55.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:43:54 gibba015 bash[29377]: audit 2021-03-10T17:43:54.332832+0000 mon.c (mon.1) 3395 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:43:55.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:43:54 gibba015 bash[29377]: audit 2021-03-10T17:43:54.334128+0000 mon.a (mon.0) 2547 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T17:43:55.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:43:54 gibba015 bash[29377]: audit 2021-03-10T17:43:54.335253+0000 mon.a (mon.0) 2548 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:43:55.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:43:54 gibba015 bash[30343]: cluster 2021-03-10T17:43:53.296914+0000 mgr.gibba045.orlgmj (mgr.34412) 12381 : cluster [DBG] pgmap v7060: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:55.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:43:54 gibba015 bash[30343]: audit 2021-03-10T17:43:54.186811+0000 mon.c (mon.1) 3390 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:43:55.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:43:54 gibba015 bash[30343]: audit 2021-03-10T17:43:54.188000+0000 mon.a (mon.0) 2543 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:43:55.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:43:54 gibba015 bash[30343]: audit 2021-03-10T17:43:54.188396+0000 mon.c (mon.1) 3391 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:43:55.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:43:54 gibba015 bash[30343]: audit 2021-03-10T17:43:54.189662+0000 mon.a (mon.0) 2544 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:43:55.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:43:54 gibba015 bash[30343]: audit 2021-03-10T17:43:54.329696+0000 mon.c (mon.1) 3392 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T17:43:55.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:43:54 gibba015 bash[30343]: audit 2021-03-10T17:43:54.330440+0000 mon.c (mon.1) 3393 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:43:55.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:43:54 gibba015 bash[30343]: audit 2021-03-10T17:43:54.331024+0000 mon.a (mon.0) 2545 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T17:43:55.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:43:54 gibba015 bash[30343]: audit 2021-03-10T17:43:54.331443+0000 mon.c (mon.1) 3394 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T17:43:55.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:43:54 gibba015 bash[30343]: audit 2021-03-10T17:43:54.332759+0000 mon.a (mon.0) 2546 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:43:55.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:43:54 gibba015 bash[30343]: audit 2021-03-10T17:43:54.332832+0000 mon.c (mon.1) 3395 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:43:55.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:43:54 gibba015 bash[30343]: audit 2021-03-10T17:43:54.334128+0000 mon.a (mon.0) 2547 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T17:43:55.234 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:43:54 gibba015 bash[30343]: audit 2021-03-10T17:43:54.335253+0000 mon.a (mon.0) 2548 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:43:55.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:43:54 gibba045 bash[25517]: cluster 2021-03-10T17:43:53.296914+0000 mgr.gibba045.orlgmj (mgr.34412) 12381 : cluster [DBG] pgmap v7060: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:55.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:43:54 gibba045 bash[25517]: audit 2021-03-10T17:43:54.186811+0000 mon.c (mon.1) 3390 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:43:55.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:43:54 gibba045 bash[25517]: audit 2021-03-10T17:43:54.188000+0000 mon.a (mon.0) 2543 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:43:55.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:43:54 gibba045 bash[25517]: audit 2021-03-10T17:43:54.188396+0000 mon.c (mon.1) 3391 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:43:55.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:43:54 gibba045 bash[25517]: audit 2021-03-10T17:43:54.189662+0000 mon.a (mon.0) 2544 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:43:55.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:43:54 gibba045 bash[25517]: audit 2021-03-10T17:43:54.329696+0000 mon.c (mon.1) 3392 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T17:43:55.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:43:54 gibba045 bash[25517]: audit 2021-03-10T17:43:54.330440+0000 mon.c (mon.1) 3393 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:43:55.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:43:54 gibba045 bash[25517]: audit 2021-03-10T17:43:54.331024+0000 mon.a (mon.0) 2545 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T17:43:55.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:43:54 gibba045 bash[25517]: audit 2021-03-10T17:43:54.331443+0000 mon.c (mon.1) 3394 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T17:43:55.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:43:54 gibba045 bash[25517]: audit 2021-03-10T17:43:54.332759+0000 mon.a (mon.0) 2546 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:43:55.312 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:43:54 gibba045 bash[25517]: audit 2021-03-10T17:43:54.332832+0000 mon.c (mon.1) 3395 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:43:55.312 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:43:54 gibba045 bash[25517]: audit 2021-03-10T17:43:54.334128+0000 mon.a (mon.0) 2547 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T17:43:55.313 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:43:54 gibba045 bash[25517]: audit 2021-03-10T17:43:54.335253+0000 mon.a (mon.0) 2548 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:43:57.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:43:56 gibba015 bash[29377]: cluster 2021-03-10T17:43:55.298545+0000 mgr.gibba045.orlgmj (mgr.34412) 12382 : cluster [DBG] pgmap v7061: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:57.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:43:56 gibba015 bash[30343]: cluster 2021-03-10T17:43:55.298545+0000 mgr.gibba045.orlgmj (mgr.34412) 12382 : cluster [DBG] pgmap v7061: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:57.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:43:56 gibba045 bash[25517]: cluster 2021-03-10T17:43:55.298545+0000 mgr.gibba045.orlgmj (mgr.34412) 12382 : cluster [DBG] pgmap v7061: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:59.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:43:58 gibba015 bash[29377]: cluster 2021-03-10T17:43:57.300282+0000 mgr.gibba045.orlgmj (mgr.34412) 12383 : cluster [DBG] pgmap v7062: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:59.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:43:58 gibba015 bash[30343]: cluster 2021-03-10T17:43:57.300282+0000 mgr.gibba045.orlgmj (mgr.34412) 12383 : cluster [DBG] pgmap v7062: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:59.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:43:58 gibba045 bash[25517]: cluster 2021-03-10T17:43:57.300282+0000 mgr.gibba045.orlgmj (mgr.34412) 12383 : cluster [DBG] pgmap v7062: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:01.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:44:00 gibba045 bash[25517]: cluster 2021-03-10T17:43:59.301533+0000 mgr.gibba045.orlgmj (mgr.34412) 12384 : cluster [DBG] pgmap v7063: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:01.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:44:00 gibba045 bash[25517]: audit 2021-03-10T17:44:00.524397+0000 mon.c (mon.1) 3396 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:44:01.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:44:00 gibba045 bash[25517]: audit 2021-03-10T17:44:00.739326+0000 mon.a (mon.0) 2549 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:44:01.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:44:00 gibba045 bash[25517]: audit 2021-03-10T17:44:00.743054+0000 mon.c (mon.1) 3397 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:44:01.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:44:00 gibba045 bash[25517]: audit 2021-03-10T17:44:00.744428+0000 mon.c (mon.1) 3398 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:44:01.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:44:00 gibba045 bash[25517]: audit 2021-03-10T17:44:00.745820+0000 mon.c (mon.1) 3399 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:44:01.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:44:00 gibba045 bash[25517]: audit 2021-03-10T17:44:00.747274+0000 mon.c (mon.1) 3400 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:44:01.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:44:00 gibba045 bash[25517]: audit 2021-03-10T17:44:00.750505+0000 mon.c (mon.1) 3401 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:44:01.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:44:00 gibba045 bash[25517]: audit 2021-03-10T17:44:00.752423+0000 mon.c (mon.1) 3402 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:44:01.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:44:00 gibba015 bash[29377]: cluster 2021-03-10T17:43:59.301533+0000 mgr.gibba045.orlgmj (mgr.34412) 12384 : cluster [DBG] pgmap v7063: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:01.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:44:00 gibba015 bash[29377]: audit 2021-03-10T17:44:00.524397+0000 mon.c (mon.1) 3396 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:44:01.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:44:00 gibba015 bash[29377]: audit 2021-03-10T17:44:00.739326+0000 mon.a (mon.0) 2549 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:44:01.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:44:00 gibba015 bash[29377]: audit 2021-03-10T17:44:00.743054+0000 mon.c (mon.1) 3397 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:44:01.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:44:00 gibba015 bash[29377]: audit 2021-03-10T17:44:00.744428+0000 mon.c (mon.1) 3398 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:44:01.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:44:00 gibba015 bash[29377]: audit 2021-03-10T17:44:00.745820+0000 mon.c (mon.1) 3399 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:44:01.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:44:00 gibba015 bash[29377]: audit 2021-03-10T17:44:00.747274+0000 mon.c (mon.1) 3400 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:44:01.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:44:00 gibba015 bash[29377]: audit 2021-03-10T17:44:00.750505+0000 mon.c (mon.1) 3401 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:44:01.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:44:00 gibba015 bash[29377]: audit 2021-03-10T17:44:00.752423+0000 mon.c (mon.1) 3402 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:44:01.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:44:00 gibba015 bash[30343]: cluster 2021-03-10T17:43:59.301533+0000 mgr.gibba045.orlgmj (mgr.34412) 12384 : cluster [DBG] pgmap v7063: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:01.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:44:00 gibba015 bash[30343]: audit 2021-03-10T17:44:00.524397+0000 mon.c (mon.1) 3396 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:44:01.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:44:00 gibba015 bash[30343]: audit 2021-03-10T17:44:00.739326+0000 mon.a (mon.0) 2549 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:44:01.226 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:44:00 gibba015 bash[30343]: audit 2021-03-10T17:44:00.743054+0000 mon.c (mon.1) 3397 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:44:01.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:44:00 gibba015 bash[30343]: audit 2021-03-10T17:44:00.744428+0000 mon.c (mon.1) 3398 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:44:01.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:44:00 gibba015 bash[30343]: audit 2021-03-10T17:44:00.745820+0000 mon.c (mon.1) 3399 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:44:01.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:44:00 gibba015 bash[30343]: audit 2021-03-10T17:44:00.747274+0000 mon.c (mon.1) 3400 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:44:01.227 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:44:00 gibba015 bash[30343]: audit 2021-03-10T17:44:00.750505+0000 mon.c (mon.1) 3401 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:44:01.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:44:00 gibba015 bash[30343]: audit 2021-03-10T17:44:00.752423+0000 mon.c (mon.1) 3402 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:44:02.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:44:01 gibba015 bash[29377]: cephadm 2021-03-10T17:44:00.531710+0000 mgr.gibba045.orlgmj (mgr.34412) 12385 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:44:02.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:44:01 gibba015 bash[29377]: cephadm 2021-03-10T17:44:00.533657+0000 mgr.gibba045.orlgmj (mgr.34412) 12386 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:44:02.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:44:01 gibba015 bash[29377]: cephadm 2021-03-10T17:44:00.743921+0000 mgr.gibba045.orlgmj (mgr.34412) 12387 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:44:02.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:44:01 gibba015 bash[29377]: cephadm 2021-03-10T17:44:00.745988+0000 mgr.gibba045.orlgmj (mgr.34412) 12388 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:44:02.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:44:01 gibba015 bash[29377]: cephadm 2021-03-10T17:44:00.747172+0000 mgr.gibba045.orlgmj (mgr.34412) 12389 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:44:02.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:44:01 gibba015 bash[29377]: cephadm 2021-03-10T17:44:00.747210+0000 mgr.gibba045.orlgmj (mgr.34412) 12390 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:44:02.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:44:01 gibba015 bash[29377]: cephadm 2021-03-10T17:44:00.748748+0000 mgr.gibba045.orlgmj (mgr.34412) 12391 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:44:02.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:44:01 gibba015 bash[29377]: cephadm 2021-03-10T17:44:00.748785+0000 mgr.gibba045.orlgmj (mgr.34412) 12392 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:44:02.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:44:01 gibba015 bash[29377]: cephadm 2021-03-10T17:44:00.750192+0000 mgr.gibba045.orlgmj (mgr.34412) 12393 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:44:02.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:44:01 gibba015 bash[29377]: cephadm 2021-03-10T17:44:00.751967+0000 mgr.gibba045.orlgmj (mgr.34412) 12394 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:44:02.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:44:01 gibba015 bash[29377]: cephadm 2021-03-10T17:44:00.752003+0000 mgr.gibba045.orlgmj (mgr.34412) 12395 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:44:02.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:44:01 gibba015 bash[29377]: cephadm 2021-03-10T17:44:00.753587+0000 mgr.gibba045.orlgmj (mgr.34412) 12396 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:44:02.228 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:44:01 gibba015 bash[29377]: cephadm 2021-03-10T17:44:00.753902+0000 mgr.gibba045.orlgmj (mgr.34412) 12397 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:44:02.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:44:01 gibba015 bash[29377]: cephadm 2021-03-10T17:44:00.755190+0000 mgr.gibba045.orlgmj (mgr.34412) 12398 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:44:02.229 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:44:01 gibba015 bash[29377]: cephadm 2021-03-10T17:44:00.755242+0000 mgr.gibba045.orlgmj (mgr.34412) 12399 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:44:02.230 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:44:01 gibba015 bash[29377]: cephadm 2021-03-10T17:44:00.755347+0000 mgr.gibba045.orlgmj (mgr.34412) 12400 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:44:02.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:44:01 gibba015 bash[30343]: cephadm 2021-03-10T17:44:00.531710+0000 mgr.gibba045.orlgmj (mgr.34412) 12385 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:44:02.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:44:01 gibba015 bash[30343]: cephadm 2021-03-10T17:44:00.533657+0000 mgr.gibba045.orlgmj (mgr.34412) 12386 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:44:02.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:44:01 gibba015 bash[30343]: cephadm 2021-03-10T17:44:00.743921+0000 mgr.gibba045.orlgmj (mgr.34412) 12387 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:44:02.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:44:01 gibba015 bash[30343]: cephadm 2021-03-10T17:44:00.745988+0000 mgr.gibba045.orlgmj (mgr.34412) 12388 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:44:02.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:44:01 gibba015 bash[30343]: cephadm 2021-03-10T17:44:00.747172+0000 mgr.gibba045.orlgmj (mgr.34412) 12389 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:44:02.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:44:01 gibba015 bash[30343]: cephadm 2021-03-10T17:44:00.747210+0000 mgr.gibba045.orlgmj (mgr.34412) 12390 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:44:02.233 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:44:01 gibba015 bash[30343]: cephadm 2021-03-10T17:44:00.748748+0000 mgr.gibba045.orlgmj (mgr.34412) 12391 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:44:02.234 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:44:01 gibba015 bash[30343]: cephadm 2021-03-10T17:44:00.748785+0000 mgr.gibba045.orlgmj (mgr.34412) 12392 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:44:02.234 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:44:01 gibba015 bash[30343]: cephadm 2021-03-10T17:44:00.750192+0000 mgr.gibba045.orlgmj (mgr.34412) 12393 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:44:02.235 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:44:01 gibba015 bash[30343]: cephadm 2021-03-10T17:44:00.751967+0000 mgr.gibba045.orlgmj (mgr.34412) 12394 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:44:02.235 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:44:01 gibba015 bash[30343]: cephadm 2021-03-10T17:44:00.752003+0000 mgr.gibba045.orlgmj (mgr.34412) 12395 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:44:02.235 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:44:01 gibba015 bash[30343]: cephadm 2021-03-10T17:44:00.753587+0000 mgr.gibba045.orlgmj (mgr.34412) 12396 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:44:02.236 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:44:01 gibba015 bash[30343]: cephadm 2021-03-10T17:44:00.753902+0000 mgr.gibba045.orlgmj (mgr.34412) 12397 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:44:02.236 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:44:01 gibba015 bash[30343]: cephadm 2021-03-10T17:44:00.755190+0000 mgr.gibba045.orlgmj (mgr.34412) 12398 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:44:02.236 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:44:01 gibba015 bash[30343]: cephadm 2021-03-10T17:44:00.755242+0000 mgr.gibba045.orlgmj (mgr.34412) 12399 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:44:02.237 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:44:01 gibba015 bash[30343]: cephadm 2021-03-10T17:44:00.755347+0000 mgr.gibba045.orlgmj (mgr.34412) 12400 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:44:02.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:44:01 gibba045 bash[25517]: cephadm 2021-03-10T17:44:00.531710+0000 mgr.gibba045.orlgmj (mgr.34412) 12385 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:44:02.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:44:01 gibba045 bash[25517]: cephadm 2021-03-10T17:44:00.533657+0000 mgr.gibba045.orlgmj (mgr.34412) 12386 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:44:02.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:44:01 gibba045 bash[25517]: cephadm 2021-03-10T17:44:00.743921+0000 mgr.gibba045.orlgmj (mgr.34412) 12387 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:44:02.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:44:01 gibba045 bash[25517]: cephadm 2021-03-10T17:44:00.745988+0000 mgr.gibba045.orlgmj (mgr.34412) 12388 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:44:02.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:44:01 gibba045 bash[25517]: cephadm 2021-03-10T17:44:00.747172+0000 mgr.gibba045.orlgmj (mgr.34412) 12389 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:44:02.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:44:01 gibba045 bash[25517]: cephadm 2021-03-10T17:44:00.747210+0000 mgr.gibba045.orlgmj (mgr.34412) 12390 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:44:02.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:44:01 gibba045 bash[25517]: cephadm 2021-03-10T17:44:00.748748+0000 mgr.gibba045.orlgmj (mgr.34412) 12391 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:44:02.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:44:01 gibba045 bash[25517]: cephadm 2021-03-10T17:44:00.748785+0000 mgr.gibba045.orlgmj (mgr.34412) 12392 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:44:02.309 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:44:01 gibba045 bash[25517]: cephadm 2021-03-10T17:44:00.750192+0000 mgr.gibba045.orlgmj (mgr.34412) 12393 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:44:02.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:44:01 gibba045 bash[25517]: cephadm 2021-03-10T17:44:00.751967+0000 mgr.gibba045.orlgmj (mgr.34412) 12394 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:44:02.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:44:01 gibba045 bash[25517]: cephadm 2021-03-10T17:44:00.752003+0000 mgr.gibba045.orlgmj (mgr.34412) 12395 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:44:02.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:44:01 gibba045 bash[25517]: cephadm 2021-03-10T17:44:00.753587+0000 mgr.gibba045.orlgmj (mgr.34412) 12396 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:44:02.310 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:44:01 gibba045 bash[25517]: cephadm 2021-03-10T17:44:00.753902+0000 mgr.gibba045.orlgmj (mgr.34412) 12397 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:44:02.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:44:01 gibba045 bash[25517]: cephadm 2021-03-10T17:44:00.755190+0000 mgr.gibba045.orlgmj (mgr.34412) 12398 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:44:02.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:44:01 gibba045 bash[25517]: cephadm 2021-03-10T17:44:00.755242+0000 mgr.gibba045.orlgmj (mgr.34412) 12399 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:44:02.311 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:44:01 gibba045 bash[25517]: cephadm 2021-03-10T17:44:00.755347+0000 mgr.gibba045.orlgmj (mgr.34412) 12400 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:44:03.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:44:02 gibba015 bash[29377]: cluster 2021-03-10T17:44:01.303305+0000 mgr.gibba045.orlgmj (mgr.34412) 12401 : cluster [DBG] pgmap v7064: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:03.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:44:02 gibba015 bash[30343]: cluster 2021-03-10T17:44:01.303305+0000 mgr.gibba045.orlgmj (mgr.34412) 12401 : cluster [DBG] pgmap v7064: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:03.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:44:02 gibba045 bash[25517]: cluster 2021-03-10T17:44:01.303305+0000 mgr.gibba045.orlgmj (mgr.34412) 12401 : cluster [DBG] pgmap v7064: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:05.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:44:04 gibba015 bash[29377]: cluster 2021-03-10T17:44:03.304921+0000 mgr.gibba045.orlgmj (mgr.34412) 12402 : cluster [DBG] pgmap v7065: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:05.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:44:04 gibba015 bash[30343]: cluster 2021-03-10T17:44:03.304921+0000 mgr.gibba045.orlgmj (mgr.34412) 12402 : cluster [DBG] pgmap v7065: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:05.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:44:04 gibba045 bash[25517]: cluster 2021-03-10T17:44:03.304921+0000 mgr.gibba045.orlgmj (mgr.34412) 12402 : cluster [DBG] pgmap v7065: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:07.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:44:06 gibba045 bash[25517]: cluster 2021-03-10T17:44:05.306331+0000 mgr.gibba045.orlgmj (mgr.34412) 12403 : cluster [DBG] pgmap v7066: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:07.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:44:06 gibba015 bash[29377]: cluster 2021-03-10T17:44:05.306331+0000 mgr.gibba045.orlgmj (mgr.34412) 12403 : cluster [DBG] pgmap v7066: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:07.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:44:06 gibba015 bash[30343]: cluster 2021-03-10T17:44:05.306331+0000 mgr.gibba045.orlgmj (mgr.34412) 12403 : cluster [DBG] pgmap v7066: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:09.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:44:08 gibba045 bash[25517]: cluster 2021-03-10T17:44:07.307826+0000 mgr.gibba045.orlgmj (mgr.34412) 12404 : cluster [DBG] pgmap v7067: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:09.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:44:08 gibba015 bash[29377]: cluster 2021-03-10T17:44:07.307826+0000 mgr.gibba045.orlgmj (mgr.34412) 12404 : cluster [DBG] pgmap v7067: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:09.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:44:08 gibba015 bash[30343]: cluster 2021-03-10T17:44:07.307826+0000 mgr.gibba045.orlgmj (mgr.34412) 12404 : cluster [DBG] pgmap v7067: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:11.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:44:11 gibba045 bash[25517]: cluster 2021-03-10T17:44:09.309094+0000 mgr.gibba045.orlgmj (mgr.34412) 12405 : cluster [DBG] pgmap v7068: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:11.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:44:10 gibba015 bash[29377]: cluster 2021-03-10T17:44:09.309094+0000 mgr.gibba045.orlgmj (mgr.34412) 12405 : cluster [DBG] pgmap v7068: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:11.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:44:10 gibba015 bash[30343]: cluster 2021-03-10T17:44:09.309094+0000 mgr.gibba045.orlgmj (mgr.34412) 12405 : cluster [DBG] pgmap v7068: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:11.832 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:44:12.055 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:44:12.055 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 6m ago 4h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:44:12.056 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (4h) 5m ago 4h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:44:12.056 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 5m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:44:12.056 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 5m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:44:12.056 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 6m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:44:12.057 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 6m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:44:12.057 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 5m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:44:12.057 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 6m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:44:12.057 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (4h) 6m ago 4h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:44:12.058 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (4h) 5m ago 4h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:44:12.058 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 6m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:44:12.058 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 6m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:44:12.058 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 6m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:44:12.058 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 6m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:44:12.059 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 5m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:44:12.059 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 5m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:44:12.059 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 5m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:44:12.059 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 5m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:44:12.060 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (3h) 5m ago 4h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:44:12.060 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 5m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:44:12.305 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:44:12.305 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:44:12.305 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:44:12.306 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:44:12.306 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:44:12.306 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:44:12.306 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:44:12.307 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:44:12.307 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:44:12.307 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:44:12.307 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:44:12.307 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:44:12.308 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:44:12.308 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:44:12.308 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:44:13.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:44:13 gibba045 bash[25517]: cluster 2021-03-10T17:44:11.310572+0000 mgr.gibba045.orlgmj (mgr.34412) 12406 : cluster [DBG] pgmap v7069: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:13.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:44:13 gibba045 bash[25517]: audit 2021-03-10T17:44:11.821818+0000 mgr.gibba045.orlgmj (mgr.34412) 12407 : audit [DBG] from='client.62353 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:44:13.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:44:13 gibba045 bash[25517]: audit 2021-03-10T17:44:12.044032+0000 mgr.gibba045.orlgmj (mgr.34412) 12408 : audit [DBG] from='client.52374 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:44:13.308 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:44:13 gibba045 bash[25517]: audit 2021-03-10T17:44:12.302190+0000 mon.c (mon.1) 3403 : audit [DBG] from='client.? 172.21.2.115:0/10999857' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:44:13.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:44:13 gibba015 bash[29377]: cluster 2021-03-10T17:44:11.310572+0000 mgr.gibba045.orlgmj (mgr.34412) 12406 : cluster [DBG] pgmap v7069: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:13.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:44:13 gibba015 bash[29377]: audit 2021-03-10T17:44:11.821818+0000 mgr.gibba045.orlgmj (mgr.34412) 12407 : audit [DBG] from='client.62353 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:44:13.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:44:13 gibba015 bash[29377]: audit 2021-03-10T17:44:12.044032+0000 mgr.gibba045.orlgmj (mgr.34412) 12408 : audit [DBG] from='client.52374 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:44:13.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:44:13 gibba015 bash[29377]: audit 2021-03-10T17:44:12.302190+0000 mon.c (mon.1) 3403 : audit [DBG] from='client.? 172.21.2.115:0/10999857' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:44:13.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:44:13 gibba015 bash[30343]: cluster 2021-03-10T17:44:11.310572+0000 mgr.gibba045.orlgmj (mgr.34412) 12406 : cluster [DBG] pgmap v7069: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:13.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:44:13 gibba015 bash[30343]: audit 2021-03-10T17:44:11.821818+0000 mgr.gibba045.orlgmj (mgr.34412) 12407 : audit [DBG] from='client.62353 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:44:13.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:44:13 gibba015 bash[30343]: audit 2021-03-10T17:44:12.044032+0000 mgr.gibba045.orlgmj (mgr.34412) 12408 : audit [DBG] from='client.52374 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:44:13.475 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:44:13 gibba015 bash[30343]: audit 2021-03-10T17:44:12.302190+0000 mon.c (mon.1) 3403 : audit [DBG] from='client.? 172.21.2.115:0/10999857' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:44:15.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:44:15 gibba045 bash[25517]: cluster 2021-03-10T17:44:13.312100+0000 mgr.gibba045.orlgmj (mgr.34412) 12409 : cluster [DBG] pgmap v7070: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:15.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:44:15 gibba015 bash[29377]: cluster 2021-03-10T17:44:13.312100+0000 mgr.gibba045.orlgmj (mgr.34412) 12409 : cluster [DBG] pgmap v7070: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:15.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:44:15 gibba015 bash[30343]: cluster 2021-03-10T17:44:13.312100+0000 mgr.gibba045.orlgmj (mgr.34412) 12409 : cluster [DBG] pgmap v7070: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:17.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:44:17 gibba045 bash[25517]: cluster 2021-03-10T17:44:15.314026+0000 mgr.gibba045.orlgmj (mgr.34412) 12410 : cluster [DBG] pgmap v7071: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:17.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:44:17 gibba045 bash[25517]: cephadm 2021-03-10T17:44:15.771323+0000 mgr.gibba045.orlgmj (mgr.34412) 12411 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:44:17.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:44:17 gibba015 bash[29377]: cluster 2021-03-10T17:44:15.314026+0000 mgr.gibba045.orlgmj (mgr.34412) 12410 : cluster [DBG] pgmap v7071: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:17.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:44:17 gibba015 bash[29377]: cephadm 2021-03-10T17:44:15.771323+0000 mgr.gibba045.orlgmj (mgr.34412) 12411 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:44:17.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:44:17 gibba015 bash[30343]: cluster 2021-03-10T17:44:15.314026+0000 mgr.gibba045.orlgmj (mgr.34412) 12410 : cluster [DBG] pgmap v7071: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:17.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:44:17 gibba015 bash[30343]: cephadm 2021-03-10T17:44:15.771323+0000 mgr.gibba045.orlgmj (mgr.34412) 12411 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:44:19.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:44:19 gibba045 bash[25517]: cluster 2021-03-10T17:44:17.315753+0000 mgr.gibba045.orlgmj (mgr.34412) 12412 : cluster [DBG] pgmap v7072: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:19.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:44:19 gibba015 bash[29377]: cluster 2021-03-10T17:44:17.315753+0000 mgr.gibba045.orlgmj (mgr.34412) 12412 : cluster [DBG] pgmap v7072: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:19.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:44:19 gibba015 bash[30343]: cluster 2021-03-10T17:44:17.315753+0000 mgr.gibba045.orlgmj (mgr.34412) 12412 : cluster [DBG] pgmap v7072: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:21.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:44:21 gibba045 bash[25517]: cluster 2021-03-10T17:44:19.317278+0000 mgr.gibba045.orlgmj (mgr.34412) 12413 : cluster [DBG] pgmap v7073: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:21.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:44:21 gibba015 bash[29377]: cluster 2021-03-10T17:44:19.317278+0000 mgr.gibba045.orlgmj (mgr.34412) 12413 : cluster [DBG] pgmap v7073: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:21.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:44:21 gibba015 bash[30343]: cluster 2021-03-10T17:44:19.317278+0000 mgr.gibba045.orlgmj (mgr.34412) 12413 : cluster [DBG] pgmap v7073: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:23.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:44:23 gibba045 bash[25517]: cluster 2021-03-10T17:44:21.318934+0000 mgr.gibba045.orlgmj (mgr.34412) 12414 : cluster [DBG] pgmap v7074: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:23.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:44:23 gibba015 bash[29377]: cluster 2021-03-10T17:44:21.318934+0000 mgr.gibba045.orlgmj (mgr.34412) 12414 : cluster [DBG] pgmap v7074: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:23.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:44:23 gibba015 bash[30343]: cluster 2021-03-10T17:44:21.318934+0000 mgr.gibba045.orlgmj (mgr.34412) 12414 : cluster [DBG] pgmap v7074: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:25.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:44:25 gibba015 bash[29377]: cluster 2021-03-10T17:44:23.320684+0000 mgr.gibba045.orlgmj (mgr.34412) 12415 : cluster [DBG] pgmap v7075: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:25.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:44:25 gibba015 bash[30343]: cluster 2021-03-10T17:44:23.320684+0000 mgr.gibba045.orlgmj (mgr.34412) 12415 : cluster [DBG] pgmap v7075: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:25.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:44:25 gibba045 bash[25517]: cluster 2021-03-10T17:44:23.320684+0000 mgr.gibba045.orlgmj (mgr.34412) 12415 : cluster [DBG] pgmap v7075: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:27.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:44:27 gibba015 bash[29377]: cluster 2021-03-10T17:44:25.322554+0000 mgr.gibba045.orlgmj (mgr.34412) 12416 : cluster [DBG] pgmap v7076: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:27.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:44:27 gibba015 bash[30343]: cluster 2021-03-10T17:44:25.322554+0000 mgr.gibba045.orlgmj (mgr.34412) 12416 : cluster [DBG] pgmap v7076: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:27.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:44:27 gibba045 bash[25517]: cluster 2021-03-10T17:44:25.322554+0000 mgr.gibba045.orlgmj (mgr.34412) 12416 : cluster [DBG] pgmap v7076: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:29.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:44:29 gibba015 bash[29377]: cluster 2021-03-10T17:44:27.324519+0000 mgr.gibba045.orlgmj (mgr.34412) 12417 : cluster [DBG] pgmap v7077: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:29.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:44:29 gibba015 bash[30343]: cluster 2021-03-10T17:44:27.324519+0000 mgr.gibba045.orlgmj (mgr.34412) 12417 : cluster [DBG] pgmap v7077: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:29.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:44:29 gibba045 bash[25517]: cluster 2021-03-10T17:44:27.324519+0000 mgr.gibba045.orlgmj (mgr.34412) 12417 : cluster [DBG] pgmap v7077: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:31.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:44:31 gibba015 bash[29377]: cluster 2021-03-10T17:44:29.325932+0000 mgr.gibba045.orlgmj (mgr.34412) 12418 : cluster [DBG] pgmap v7078: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:31.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:44:31 gibba015 bash[30343]: cluster 2021-03-10T17:44:29.325932+0000 mgr.gibba045.orlgmj (mgr.34412) 12418 : cluster [DBG] pgmap v7078: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:31.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:44:31 gibba045 bash[25517]: cluster 2021-03-10T17:44:29.325932+0000 mgr.gibba045.orlgmj (mgr.34412) 12418 : cluster [DBG] pgmap v7078: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:32.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:44:32 gibba015 bash[30343]: cephadm 2021-03-10T17:44:30.787412+0000 mgr.gibba045.orlgmj (mgr.34412) 12419 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:44:32.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:44:32 gibba015 bash[29377]: cephadm 2021-03-10T17:44:30.787412+0000 mgr.gibba045.orlgmj (mgr.34412) 12419 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:44:32.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:44:32 gibba045 bash[25517]: cephadm 2021-03-10T17:44:30.787412+0000 mgr.gibba045.orlgmj (mgr.34412) 12419 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:44:33.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:44:33 gibba015 bash[29377]: cluster 2021-03-10T17:44:31.327814+0000 mgr.gibba045.orlgmj (mgr.34412) 12420 : cluster [DBG] pgmap v7079: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:33.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:44:33 gibba015 bash[30343]: cluster 2021-03-10T17:44:31.327814+0000 mgr.gibba045.orlgmj (mgr.34412) 12420 : cluster [DBG] pgmap v7079: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:33.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:44:33 gibba045 bash[25517]: cluster 2021-03-10T17:44:31.327814+0000 mgr.gibba045.orlgmj (mgr.34412) 12420 : cluster [DBG] pgmap v7079: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:35.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:44:35 gibba015 bash[29377]: cluster 2021-03-10T17:44:33.329546+0000 mgr.gibba045.orlgmj (mgr.34412) 12421 : cluster [DBG] pgmap v7080: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:35.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:44:35 gibba015 bash[30343]: cluster 2021-03-10T17:44:33.329546+0000 mgr.gibba045.orlgmj (mgr.34412) 12421 : cluster [DBG] pgmap v7080: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:35.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:44:35 gibba045 bash[25517]: cluster 2021-03-10T17:44:33.329546+0000 mgr.gibba045.orlgmj (mgr.34412) 12421 : cluster [DBG] pgmap v7080: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:37.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:44:37 gibba015 bash[29377]: cluster 2021-03-10T17:44:35.330969+0000 mgr.gibba045.orlgmj (mgr.34412) 12422 : cluster [DBG] pgmap v7081: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:37.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:44:37 gibba015 bash[30343]: cluster 2021-03-10T17:44:35.330969+0000 mgr.gibba045.orlgmj (mgr.34412) 12422 : cluster [DBG] pgmap v7081: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:37.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:44:37 gibba045 bash[25517]: cluster 2021-03-10T17:44:35.330969+0000 mgr.gibba045.orlgmj (mgr.34412) 12422 : cluster [DBG] pgmap v7081: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:39.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:44:39 gibba015 bash[29377]: cluster 2021-03-10T17:44:37.332660+0000 mgr.gibba045.orlgmj (mgr.34412) 12423 : cluster [DBG] pgmap v7082: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:39.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:44:39 gibba015 bash[30343]: cluster 2021-03-10T17:44:37.332660+0000 mgr.gibba045.orlgmj (mgr.34412) 12423 : cluster [DBG] pgmap v7082: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:39.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:44:39 gibba045 bash[25517]: cluster 2021-03-10T17:44:37.332660+0000 mgr.gibba045.orlgmj (mgr.34412) 12423 : cluster [DBG] pgmap v7082: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:41.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:44:41 gibba015 bash[29377]: cluster 2021-03-10T17:44:39.333879+0000 mgr.gibba045.orlgmj (mgr.34412) 12424 : cluster [DBG] pgmap v7083: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:41.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:44:41 gibba015 bash[30343]: cluster 2021-03-10T17:44:39.333879+0000 mgr.gibba045.orlgmj (mgr.34412) 12424 : cluster [DBG] pgmap v7083: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:41.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:44:41 gibba045 bash[25517]: cluster 2021-03-10T17:44:39.333879+0000 mgr.gibba045.orlgmj (mgr.34412) 12424 : cluster [DBG] pgmap v7083: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:42.550 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:44:42.780 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:44:42.781 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 6m ago 4h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:44:42.781 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (4h) 5m ago 4h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:44:42.782 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 5m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:44:42.782 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 5m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:44:42.782 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 6m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:44:42.783 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 6m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:44:42.783 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 5m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:44:42.784 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 6m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:44:42.784 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (4h) 6m ago 4h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:44:42.784 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (4h) 5m ago 4h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:44:42.785 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 6m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:44:42.785 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 6m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:44:42.785 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 6m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:44:42.786 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 6m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:44:42.786 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 5m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:44:42.787 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 5m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:44:42.787 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 5m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:44:42.787 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 5m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:44:42.788 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (4h) 5m ago 4h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:44:42.789 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 5m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:44:43.027 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:44:43.027 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:44:43.028 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:44:43.028 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:44:43.028 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:44:43.028 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:44:43.029 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:44:43.029 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:44:43.029 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:44:43.029 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:44:43.030 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:44:43.030 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:44:43.030 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:44:43.030 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:44:43.030 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:44:43.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:44:43 gibba015 bash[29377]: cluster 2021-03-10T17:44:41.335627+0000 mgr.gibba045.orlgmj (mgr.34412) 12425 : cluster [DBG] pgmap v7084: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:43.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:44:43 gibba015 bash[29377]: audit 2021-03-10T17:44:43.024518+0000 mon.a (mon.0) 2550 : audit [DBG] from='client.? 172.21.2.115:0/2562621538' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:44:43.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:44:43 gibba015 bash[30343]: cluster 2021-03-10T17:44:41.335627+0000 mgr.gibba045.orlgmj (mgr.34412) 12425 : cluster [DBG] pgmap v7084: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:43.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:44:43 gibba015 bash[30343]: audit 2021-03-10T17:44:43.024518+0000 mon.a (mon.0) 2550 : audit [DBG] from='client.? 172.21.2.115:0/2562621538' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:44:43.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:44:43 gibba045 bash[25517]: cluster 2021-03-10T17:44:41.335627+0000 mgr.gibba045.orlgmj (mgr.34412) 12425 : cluster [DBG] pgmap v7084: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:43.558 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:44:43 gibba045 bash[25517]: audit 2021-03-10T17:44:43.024518+0000 mon.a (mon.0) 2550 : audit [DBG] from='client.? 172.21.2.115:0/2562621538' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:44:44.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:44:44 gibba015 bash[29377]: audit 2021-03-10T17:44:42.539044+0000 mgr.gibba045.orlgmj (mgr.34412) 12426 : audit [DBG] from='client.62371 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:44:44.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:44:44 gibba015 bash[29377]: audit 2021-03-10T17:44:42.769352+0000 mgr.gibba045.orlgmj (mgr.34412) 12427 : audit [DBG] from='client.52392 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:44:44.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:44:44 gibba015 bash[30343]: audit 2021-03-10T17:44:42.539044+0000 mgr.gibba045.orlgmj (mgr.34412) 12426 : audit [DBG] from='client.62371 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:44:44.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:44:44 gibba015 bash[30343]: audit 2021-03-10T17:44:42.769352+0000 mgr.gibba045.orlgmj (mgr.34412) 12427 : audit [DBG] from='client.52392 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:44:44.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:44:44 gibba045 bash[25517]: audit 2021-03-10T17:44:42.539044+0000 mgr.gibba045.orlgmj (mgr.34412) 12426 : audit [DBG] from='client.62371 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:44:44.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:44:44 gibba045 bash[25517]: audit 2021-03-10T17:44:42.769352+0000 mgr.gibba045.orlgmj (mgr.34412) 12427 : audit [DBG] from='client.52392 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:44:45.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:44:45 gibba015 bash[29377]: cluster 2021-03-10T17:44:43.337299+0000 mgr.gibba045.orlgmj (mgr.34412) 12428 : cluster [DBG] pgmap v7085: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:45.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:44:45 gibba015 bash[30343]: cluster 2021-03-10T17:44:43.337299+0000 mgr.gibba045.orlgmj (mgr.34412) 12428 : cluster [DBG] pgmap v7085: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:45.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:44:45 gibba045 bash[25517]: cluster 2021-03-10T17:44:43.337299+0000 mgr.gibba045.orlgmj (mgr.34412) 12428 : cluster [DBG] pgmap v7085: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:47.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:44:47 gibba015 bash[29377]: cluster 2021-03-10T17:44:45.338892+0000 mgr.gibba045.orlgmj (mgr.34412) 12429 : cluster [DBG] pgmap v7086: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:47.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:44:47 gibba015 bash[29377]: cephadm 2021-03-10T17:44:45.803225+0000 mgr.gibba045.orlgmj (mgr.34412) 12430 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:44:47.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:44:47 gibba015 bash[30343]: cluster 2021-03-10T17:44:45.338892+0000 mgr.gibba045.orlgmj (mgr.34412) 12429 : cluster [DBG] pgmap v7086: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:47.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:44:47 gibba015 bash[30343]: cephadm 2021-03-10T17:44:45.803225+0000 mgr.gibba045.orlgmj (mgr.34412) 12430 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:44:47.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:44:47 gibba045 bash[25517]: cluster 2021-03-10T17:44:45.338892+0000 mgr.gibba045.orlgmj (mgr.34412) 12429 : cluster [DBG] pgmap v7086: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:47.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:44:47 gibba045 bash[25517]: cephadm 2021-03-10T17:44:45.803225+0000 mgr.gibba045.orlgmj (mgr.34412) 12430 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:44:48.472 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:44:48 gibba015 bash[29377]: cluster 2021-03-10T17:44:47.340692+0000 mgr.gibba045.orlgmj (mgr.34412) 12431 : cluster [DBG] pgmap v7087: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:48.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:44:48 gibba015 bash[30343]: cluster 2021-03-10T17:44:47.340692+0000 mgr.gibba045.orlgmj (mgr.34412) 12431 : cluster [DBG] pgmap v7087: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:48.557 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:44:48 gibba045 bash[25517]: cluster 2021-03-10T17:44:47.340692+0000 mgr.gibba045.orlgmj (mgr.34412) 12431 : cluster [DBG] pgmap v7087: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:50.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:44:50 gibba015 bash[29377]: cluster 2021-03-10T17:44:49.342216+0000 mgr.gibba045.orlgmj (mgr.34412) 12432 : cluster [DBG] pgmap v7088: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:50.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:44:50 gibba015 bash[30343]: cluster 2021-03-10T17:44:49.342216+0000 mgr.gibba045.orlgmj (mgr.34412) 12432 : cluster [DBG] pgmap v7088: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:50.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:44:50 gibba045 bash[25517]: cluster 2021-03-10T17:44:49.342216+0000 mgr.gibba045.orlgmj (mgr.34412) 12432 : cluster [DBG] pgmap v7088: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:52.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:44:52 gibba015 bash[29377]: cluster 2021-03-10T17:44:51.343695+0000 mgr.gibba045.orlgmj (mgr.34412) 12433 : cluster [DBG] pgmap v7089: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:52.724 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:44:52 gibba015 bash[30343]: cluster 2021-03-10T17:44:51.343695+0000 mgr.gibba045.orlgmj (mgr.34412) 12433 : cluster [DBG] pgmap v7089: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:52.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:44:52 gibba045 bash[25517]: cluster 2021-03-10T17:44:51.343695+0000 mgr.gibba045.orlgmj (mgr.34412) 12433 : cluster [DBG] pgmap v7089: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:54.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:44:54 gibba015 bash[29377]: cluster 2021-03-10T17:44:53.345390+0000 mgr.gibba045.orlgmj (mgr.34412) 12434 : cluster [DBG] pgmap v7090: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:54.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:44:54 gibba015 bash[29377]: audit 2021-03-10T17:44:54.191240+0000 mon.c (mon.1) 3404 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:44:54.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:44:54 gibba015 bash[29377]: audit 2021-03-10T17:44:54.191894+0000 mon.c (mon.1) 3405 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:44:54.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:44:54 gibba015 bash[29377]: audit 2021-03-10T17:44:54.192426+0000 mon.a (mon.0) 2551 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:44:54.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:44:54 gibba015 bash[29377]: audit 2021-03-10T17:44:54.193795+0000 mon.a (mon.0) 2552 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:44:54.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:44:54 gibba015 bash[29377]: audit 2021-03-10T17:44:54.341475+0000 mon.c (mon.1) 3406 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T17:44:54.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:44:54 gibba015 bash[29377]: audit 2021-03-10T17:44:54.342203+0000 mon.c (mon.1) 3407 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T17:44:54.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:44:54 gibba015 bash[29377]: audit 2021-03-10T17:44:54.342773+0000 mon.a (mon.0) 2553 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T17:44:54.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:44:54 gibba015 bash[29377]: audit 2021-03-10T17:44:54.342921+0000 mon.c (mon.1) 3408 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T17:44:54.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:44:54 gibba015 bash[29377]: audit 2021-03-10T17:44:54.343596+0000 mon.c (mon.1) 3409 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:44:54.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:44:54 gibba015 bash[29377]: audit 2021-03-10T17:44:54.345104+0000 mon.a (mon.0) 2554 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T17:44:54.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:44:54 gibba015 bash[29377]: audit 2021-03-10T17:44:54.346069+0000 mon.a (mon.0) 2555 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T17:44:54.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:44:54 gibba015 bash[29377]: audit 2021-03-10T17:44:54.347005+0000 mon.a (mon.0) 2556 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:44:54.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:44:54 gibba015 bash[30343]: cluster 2021-03-10T17:44:53.345390+0000 mgr.gibba045.orlgmj (mgr.34412) 12434 : cluster [DBG] pgmap v7090: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:54.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:44:54 gibba015 bash[30343]: audit 2021-03-10T17:44:54.191240+0000 mon.c (mon.1) 3404 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:44:54.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:44:54 gibba015 bash[30343]: audit 2021-03-10T17:44:54.191894+0000 mon.c (mon.1) 3405 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:44:54.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:44:54 gibba015 bash[30343]: audit 2021-03-10T17:44:54.192426+0000 mon.a (mon.0) 2551 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:44:54.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:44:54 gibba015 bash[30343]: audit 2021-03-10T17:44:54.193795+0000 mon.a (mon.0) 2552 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:44:54.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:44:54 gibba015 bash[30343]: audit 2021-03-10T17:44:54.341475+0000 mon.c (mon.1) 3406 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T17:44:54.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:44:54 gibba015 bash[30343]: audit 2021-03-10T17:44:54.342203+0000 mon.c (mon.1) 3407 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T17:44:54.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:44:54 gibba015 bash[30343]: audit 2021-03-10T17:44:54.342773+0000 mon.a (mon.0) 2553 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T17:44:54.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:44:54 gibba015 bash[30343]: audit 2021-03-10T17:44:54.342921+0000 mon.c (mon.1) 3408 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T17:44:54.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:44:54 gibba015 bash[30343]: audit 2021-03-10T17:44:54.343596+0000 mon.c (mon.1) 3409 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:44:54.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:44:54 gibba015 bash[30343]: audit 2021-03-10T17:44:54.345104+0000 mon.a (mon.0) 2554 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T17:44:54.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:44:54 gibba015 bash[30343]: audit 2021-03-10T17:44:54.346069+0000 mon.a (mon.0) 2555 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T17:44:54.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:44:54 gibba015 bash[30343]: audit 2021-03-10T17:44:54.347005+0000 mon.a (mon.0) 2556 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:44:54.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:44:54 gibba045 bash[25517]: cluster 2021-03-10T17:44:53.345390+0000 mgr.gibba045.orlgmj (mgr.34412) 12434 : cluster [DBG] pgmap v7090: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:54.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:44:54 gibba045 bash[25517]: audit 2021-03-10T17:44:54.191240+0000 mon.c (mon.1) 3404 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:44:54.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:44:54 gibba045 bash[25517]: audit 2021-03-10T17:44:54.191894+0000 mon.c (mon.1) 3405 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:44:54.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:44:54 gibba045 bash[25517]: audit 2021-03-10T17:44:54.192426+0000 mon.a (mon.0) 2551 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:44:54.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:44:54 gibba045 bash[25517]: audit 2021-03-10T17:44:54.193795+0000 mon.a (mon.0) 2552 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:44:54.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:44:54 gibba045 bash[25517]: audit 2021-03-10T17:44:54.341475+0000 mon.c (mon.1) 3406 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T17:44:54.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:44:54 gibba045 bash[25517]: audit 2021-03-10T17:44:54.342203+0000 mon.c (mon.1) 3407 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T17:44:54.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:44:54 gibba045 bash[25517]: audit 2021-03-10T17:44:54.342773+0000 mon.a (mon.0) 2553 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T17:44:54.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:44:54 gibba045 bash[25517]: audit 2021-03-10T17:44:54.342921+0000 mon.c (mon.1) 3408 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T17:44:54.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:44:54 gibba045 bash[25517]: audit 2021-03-10T17:44:54.343596+0000 mon.c (mon.1) 3409 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:44:54.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:44:54 gibba045 bash[25517]: audit 2021-03-10T17:44:54.345104+0000 mon.a (mon.0) 2554 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T17:44:54.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:44:54 gibba045 bash[25517]: audit 2021-03-10T17:44:54.346069+0000 mon.a (mon.0) 2555 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T17:44:54.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:44:54 gibba045 bash[25517]: audit 2021-03-10T17:44:54.347005+0000 mon.a (mon.0) 2556 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:44:56.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:44:56 gibba015 bash[29377]: cluster 2021-03-10T17:44:55.346815+0000 mgr.gibba045.orlgmj (mgr.34412) 12435 : cluster [DBG] pgmap v7091: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:56.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:44:56 gibba015 bash[30343]: cluster 2021-03-10T17:44:55.346815+0000 mgr.gibba045.orlgmj (mgr.34412) 12435 : cluster [DBG] pgmap v7091: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:56.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:44:56 gibba045 bash[25517]: cluster 2021-03-10T17:44:55.346815+0000 mgr.gibba045.orlgmj (mgr.34412) 12435 : cluster [DBG] pgmap v7091: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:58.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:44:58 gibba015 bash[29377]: cluster 2021-03-10T17:44:57.348651+0000 mgr.gibba045.orlgmj (mgr.34412) 12436 : cluster [DBG] pgmap v7092: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:58.723 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:44:58 gibba015 bash[30343]: cluster 2021-03-10T17:44:57.348651+0000 mgr.gibba045.orlgmj (mgr.34412) 12436 : cluster [DBG] pgmap v7092: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:58.806 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:44:58 gibba045 bash[25517]: cluster 2021-03-10T17:44:57.348651+0000 mgr.gibba045.orlgmj (mgr.34412) 12436 : cluster [DBG] pgmap v7092: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:00.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:45:00 gibba045 bash[25517]: cluster 2021-03-10T17:44:59.350094+0000 mgr.gibba045.orlgmj (mgr.34412) 12437 : cluster [DBG] pgmap v7093: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:00.972 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:45:00 gibba015 bash[29377]: cluster 2021-03-10T17:44:59.350094+0000 mgr.gibba045.orlgmj (mgr.34412) 12437 : cluster [DBG] pgmap v7093: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:00.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:45:00 gibba015 bash[30343]: cluster 2021-03-10T17:44:59.350094+0000 mgr.gibba045.orlgmj (mgr.34412) 12437 : cluster [DBG] pgmap v7093: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:01.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:45:01 gibba015 bash[29377]: audit 2021-03-10T17:45:00.806059+0000 mon.c (mon.1) 3410 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:45:01.723 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:45:01 gibba015 bash[29377]: audit 2021-03-10T17:45:01.008654+0000 mon.a (mon.0) 2557 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:45:01.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:45:01 gibba015 bash[29377]: cephadm 2021-03-10T17:45:01.011458+0000 mgr.gibba045.orlgmj (mgr.34412) 12438 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:45:01.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:45:01 gibba015 bash[29377]: audit 2021-03-10T17:45:01.011530+0000 mon.a (mon.0) 2558 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:45:01.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:45:01 gibba015 bash[29377]: cephadm 2021-03-10T17:45:01.014406+0000 mgr.gibba045.orlgmj (mgr.34412) 12439 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:45:01.724 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:45:01 gibba015 bash[29377]: audit 2021-03-10T17:45:01.195645+0000 mon.a (mon.0) 2559 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:45:01.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:45:01 gibba015 bash[29377]: audit 2021-03-10T17:45:01.199160+0000 mon.c (mon.1) 3411 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:45:01.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:45:01 gibba015 bash[29377]: audit 2021-03-10T17:45:01.200721+0000 mon.c (mon.1) 3412 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:45:01.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:45:01 gibba015 bash[29377]: audit 2021-03-10T17:45:01.201994+0000 mon.c (mon.1) 3413 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:45:01.725 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:45:01 gibba015 bash[29377]: audit 2021-03-10T17:45:01.203147+0000 mon.c (mon.1) 3414 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:45:01.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:45:01 gibba015 bash[29377]: audit 2021-03-10T17:45:01.206305+0000 mon.c (mon.1) 3415 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:45:01.726 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:45:01 gibba015 bash[29377]: audit 2021-03-10T17:45:01.208230+0000 mon.c (mon.1) 3416 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:45:01.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:45:01 gibba015 bash[30343]: audit 2021-03-10T17:45:00.806059+0000 mon.c (mon.1) 3410 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:45:01.726 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:45:01 gibba015 bash[30343]: audit 2021-03-10T17:45:01.008654+0000 mon.a (mon.0) 2557 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:45:01.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:45:01 gibba015 bash[30343]: cephadm 2021-03-10T17:45:01.011458+0000 mgr.gibba045.orlgmj (mgr.34412) 12438 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:45:01.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:45:01 gibba015 bash[30343]: audit 2021-03-10T17:45:01.011530+0000 mon.a (mon.0) 2558 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:45:01.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:45:01 gibba015 bash[30343]: cephadm 2021-03-10T17:45:01.014406+0000 mgr.gibba045.orlgmj (mgr.34412) 12439 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:45:01.727 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:45:01 gibba015 bash[30343]: audit 2021-03-10T17:45:01.195645+0000 mon.a (mon.0) 2559 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:45:01.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:45:01 gibba015 bash[30343]: audit 2021-03-10T17:45:01.199160+0000 mon.c (mon.1) 3411 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:45:01.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:45:01 gibba015 bash[30343]: audit 2021-03-10T17:45:01.200721+0000 mon.c (mon.1) 3412 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:45:01.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:45:01 gibba015 bash[30343]: audit 2021-03-10T17:45:01.201994+0000 mon.c (mon.1) 3413 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:45:01.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:45:01 gibba015 bash[30343]: audit 2021-03-10T17:45:01.203147+0000 mon.c (mon.1) 3414 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:45:01.728 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:45:01 gibba015 bash[30343]: audit 2021-03-10T17:45:01.206305+0000 mon.c (mon.1) 3415 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:45:01.729 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:45:01 gibba015 bash[30343]: audit 2021-03-10T17:45:01.208230+0000 mon.c (mon.1) 3416 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:45:01.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:45:01 gibba045 bash[25517]: audit 2021-03-10T17:45:00.806059+0000 mon.c (mon.1) 3410 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:45:01.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:45:01 gibba045 bash[25517]: audit 2021-03-10T17:45:01.008654+0000 mon.a (mon.0) 2557 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:45:01.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:45:01 gibba045 bash[25517]: cephadm 2021-03-10T17:45:01.011458+0000 mgr.gibba045.orlgmj (mgr.34412) 12438 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:45:01.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:45:01 gibba045 bash[25517]: audit 2021-03-10T17:45:01.011530+0000 mon.a (mon.0) 2558 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:45:01.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:45:01 gibba045 bash[25517]: cephadm 2021-03-10T17:45:01.014406+0000 mgr.gibba045.orlgmj (mgr.34412) 12439 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:45:01.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:45:01 gibba045 bash[25517]: audit 2021-03-10T17:45:01.195645+0000 mon.a (mon.0) 2559 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:45:01.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:45:01 gibba045 bash[25517]: audit 2021-03-10T17:45:01.199160+0000 mon.c (mon.1) 3411 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:45:01.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:45:01 gibba045 bash[25517]: audit 2021-03-10T17:45:01.200721+0000 mon.c (mon.1) 3412 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:45:01.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:45:01 gibba045 bash[25517]: audit 2021-03-10T17:45:01.201994+0000 mon.c (mon.1) 3413 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:45:01.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:45:01 gibba045 bash[25517]: audit 2021-03-10T17:45:01.203147+0000 mon.c (mon.1) 3414 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:45:01.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:45:01 gibba045 bash[25517]: audit 2021-03-10T17:45:01.206305+0000 mon.c (mon.1) 3415 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:45:01.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:45:01 gibba045 bash[25517]: audit 2021-03-10T17:45:01.208230+0000 mon.c (mon.1) 3416 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:45:02.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:45:02 gibba045 bash[25517]: cephadm 2021-03-10T17:45:01.200165+0000 mgr.gibba045.orlgmj (mgr.34412) 12440 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:45:02.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:45:02 gibba045 bash[25517]: cephadm 2021-03-10T17:45:01.202135+0000 mgr.gibba045.orlgmj (mgr.34412) 12441 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:45:02.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:45:02 gibba045 bash[25517]: cephadm 2021-03-10T17:45:01.203385+0000 mgr.gibba045.orlgmj (mgr.34412) 12442 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:45:02.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:45:02 gibba045 bash[25517]: cephadm 2021-03-10T17:45:01.203423+0000 mgr.gibba045.orlgmj (mgr.34412) 12443 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:45:02.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:45:02 gibba045 bash[25517]: cephadm 2021-03-10T17:45:01.204602+0000 mgr.gibba045.orlgmj (mgr.34412) 12444 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:45:02.809 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:45:02 gibba045 bash[25517]: cephadm 2021-03-10T17:45:01.204639+0000 mgr.gibba045.orlgmj (mgr.34412) 12445 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:45:02.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:45:02 gibba045 bash[25517]: cephadm 2021-03-10T17:45:01.205908+0000 mgr.gibba045.orlgmj (mgr.34412) 12446 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:45:02.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:45:02 gibba045 bash[25517]: cephadm 2021-03-10T17:45:01.207459+0000 mgr.gibba045.orlgmj (mgr.34412) 12447 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:45:02.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:45:02 gibba045 bash[25517]: cephadm 2021-03-10T17:45:01.207497+0000 mgr.gibba045.orlgmj (mgr.34412) 12448 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:45:02.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:45:02 gibba045 bash[25517]: cephadm 2021-03-10T17:45:01.209445+0000 mgr.gibba045.orlgmj (mgr.34412) 12449 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:45:02.810 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:45:02 gibba045 bash[25517]: cephadm 2021-03-10T17:45:01.209765+0000 mgr.gibba045.orlgmj (mgr.34412) 12450 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:45:02.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:45:02 gibba045 bash[25517]: cephadm 2021-03-10T17:45:01.211212+0000 mgr.gibba045.orlgmj (mgr.34412) 12451 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:45:02.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:45:02 gibba045 bash[25517]: cephadm 2021-03-10T17:45:01.211251+0000 mgr.gibba045.orlgmj (mgr.34412) 12452 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:45:02.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:45:02 gibba045 bash[25517]: cephadm 2021-03-10T17:45:01.211355+0000 mgr.gibba045.orlgmj (mgr.34412) 12453 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:45:02.811 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:45:02 gibba045 bash[25517]: cluster 2021-03-10T17:45:01.351806+0000 mgr.gibba045.orlgmj (mgr.34412) 12454 : cluster [DBG] pgmap v7094: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:02.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:45:02 gibba015 bash[29377]: cephadm 2021-03-10T17:45:01.200165+0000 mgr.gibba045.orlgmj (mgr.34412) 12440 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:45:02.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:45:02 gibba015 bash[29377]: cephadm 2021-03-10T17:45:01.202135+0000 mgr.gibba045.orlgmj (mgr.34412) 12441 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:45:02.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:45:02 gibba015 bash[29377]: cephadm 2021-03-10T17:45:01.203385+0000 mgr.gibba045.orlgmj (mgr.34412) 12442 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:45:02.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:45:02 gibba015 bash[29377]: cephadm 2021-03-10T17:45:01.203423+0000 mgr.gibba045.orlgmj (mgr.34412) 12443 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:45:02.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:45:02 gibba015 bash[29377]: cephadm 2021-03-10T17:45:01.204602+0000 mgr.gibba045.orlgmj (mgr.34412) 12444 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:45:02.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:45:02 gibba015 bash[29377]: cephadm 2021-03-10T17:45:01.204639+0000 mgr.gibba045.orlgmj (mgr.34412) 12445 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:45:02.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:45:02 gibba015 bash[29377]: cephadm 2021-03-10T17:45:01.205908+0000 mgr.gibba045.orlgmj (mgr.34412) 12446 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:45:02.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:45:02 gibba015 bash[29377]: cephadm 2021-03-10T17:45:01.207459+0000 mgr.gibba045.orlgmj (mgr.34412) 12447 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:45:02.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:45:02 gibba015 bash[29377]: cephadm 2021-03-10T17:45:01.207497+0000 mgr.gibba045.orlgmj (mgr.34412) 12448 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:45:02.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:45:02 gibba015 bash[29377]: cephadm 2021-03-10T17:45:01.209445+0000 mgr.gibba045.orlgmj (mgr.34412) 12449 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:45:02.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:45:02 gibba015 bash[29377]: cephadm 2021-03-10T17:45:01.209765+0000 mgr.gibba045.orlgmj (mgr.34412) 12450 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:45:02.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:45:02 gibba015 bash[29377]: cephadm 2021-03-10T17:45:01.211212+0000 mgr.gibba045.orlgmj (mgr.34412) 12451 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:45:02.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:45:02 gibba015 bash[29377]: cephadm 2021-03-10T17:45:01.211251+0000 mgr.gibba045.orlgmj (mgr.34412) 12452 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:45:02.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:45:02 gibba015 bash[29377]: cephadm 2021-03-10T17:45:01.211355+0000 mgr.gibba045.orlgmj (mgr.34412) 12453 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:45:02.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:45:02 gibba015 bash[29377]: cluster 2021-03-10T17:45:01.351806+0000 mgr.gibba045.orlgmj (mgr.34412) 12454 : cluster [DBG] pgmap v7094: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:02.977 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:45:02 gibba015 bash[30343]: cephadm 2021-03-10T17:45:01.200165+0000 mgr.gibba045.orlgmj (mgr.34412) 12440 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:45:02.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:45:02 gibba015 bash[30343]: cephadm 2021-03-10T17:45:01.202135+0000 mgr.gibba045.orlgmj (mgr.34412) 12441 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:45:02.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:45:02 gibba015 bash[30343]: cephadm 2021-03-10T17:45:01.203385+0000 mgr.gibba045.orlgmj (mgr.34412) 12442 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:45:02.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:45:02 gibba015 bash[30343]: cephadm 2021-03-10T17:45:01.203423+0000 mgr.gibba045.orlgmj (mgr.34412) 12443 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:45:02.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:45:02 gibba015 bash[30343]: cephadm 2021-03-10T17:45:01.204602+0000 mgr.gibba045.orlgmj (mgr.34412) 12444 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:45:02.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:45:02 gibba015 bash[30343]: cephadm 2021-03-10T17:45:01.204639+0000 mgr.gibba045.orlgmj (mgr.34412) 12445 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:45:02.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:45:02 gibba015 bash[30343]: cephadm 2021-03-10T17:45:01.205908+0000 mgr.gibba045.orlgmj (mgr.34412) 12446 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:45:02.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:45:02 gibba015 bash[30343]: cephadm 2021-03-10T17:45:01.207459+0000 mgr.gibba045.orlgmj (mgr.34412) 12447 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:45:02.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:45:02 gibba015 bash[30343]: cephadm 2021-03-10T17:45:01.207497+0000 mgr.gibba045.orlgmj (mgr.34412) 12448 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:45:02.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:45:02 gibba015 bash[30343]: cephadm 2021-03-10T17:45:01.209445+0000 mgr.gibba045.orlgmj (mgr.34412) 12449 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:45:02.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:45:02 gibba015 bash[30343]: cephadm 2021-03-10T17:45:01.209765+0000 mgr.gibba045.orlgmj (mgr.34412) 12450 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:45:02.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:45:02 gibba015 bash[30343]: cephadm 2021-03-10T17:45:01.211212+0000 mgr.gibba045.orlgmj (mgr.34412) 12451 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:45:02.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:45:02 gibba015 bash[30343]: cephadm 2021-03-10T17:45:01.211251+0000 mgr.gibba045.orlgmj (mgr.34412) 12452 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:45:02.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:45:02 gibba015 bash[30343]: cephadm 2021-03-10T17:45:01.211355+0000 mgr.gibba045.orlgmj (mgr.34412) 12453 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:45:02.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:45:02 gibba015 bash[30343]: cluster 2021-03-10T17:45:01.351806+0000 mgr.gibba045.orlgmj (mgr.34412) 12454 : cluster [DBG] pgmap v7094: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:04.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:45:04 gibba045 bash[25517]: cluster 2021-03-10T17:45:03.353526+0000 mgr.gibba045.orlgmj (mgr.34412) 12455 : cluster [DBG] pgmap v7095: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:04.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:45:04 gibba015 bash[29377]: cluster 2021-03-10T17:45:03.353526+0000 mgr.gibba045.orlgmj (mgr.34412) 12455 : cluster [DBG] pgmap v7095: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:04.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:45:04 gibba015 bash[30343]: cluster 2021-03-10T17:45:03.353526+0000 mgr.gibba045.orlgmj (mgr.34412) 12455 : cluster [DBG] pgmap v7095: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:06.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:45:06 gibba045 bash[25517]: cluster 2021-03-10T17:45:05.355090+0000 mgr.gibba045.orlgmj (mgr.34412) 12456 : cluster [DBG] pgmap v7096: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:07.025 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:45:06 gibba015 bash[29377]: cluster 2021-03-10T17:45:05.355090+0000 mgr.gibba045.orlgmj (mgr.34412) 12456 : cluster [DBG] pgmap v7096: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:07.030 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:45:06 gibba015 bash[30343]: cluster 2021-03-10T17:45:05.355090+0000 mgr.gibba045.orlgmj (mgr.34412) 12456 : cluster [DBG] pgmap v7096: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:08.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:45:08 gibba045 bash[25517]: cluster 2021-03-10T17:45:07.356565+0000 mgr.gibba045.orlgmj (mgr.34412) 12457 : cluster [DBG] pgmap v7097: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:08.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:45:08 gibba015 bash[29377]: cluster 2021-03-10T17:45:07.356565+0000 mgr.gibba045.orlgmj (mgr.34412) 12457 : cluster [DBG] pgmap v7097: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:08.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:45:08 gibba015 bash[30343]: cluster 2021-03-10T17:45:07.356565+0000 mgr.gibba045.orlgmj (mgr.34412) 12457 : cluster [DBG] pgmap v7097: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:10.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:45:10 gibba045 bash[25517]: cluster 2021-03-10T17:45:09.357732+0000 mgr.gibba045.orlgmj (mgr.34412) 12458 : cluster [DBG] pgmap v7098: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:10.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:45:10 gibba015 bash[29377]: cluster 2021-03-10T17:45:09.357732+0000 mgr.gibba045.orlgmj (mgr.34412) 12458 : cluster [DBG] pgmap v7098: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:10.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:45:10 gibba015 bash[30343]: cluster 2021-03-10T17:45:09.357732+0000 mgr.gibba045.orlgmj (mgr.34412) 12458 : cluster [DBG] pgmap v7098: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:12.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:45:12 gibba045 bash[25517]: cluster 2021-03-10T17:45:11.359347+0000 mgr.gibba045.orlgmj (mgr.34412) 12459 : cluster [DBG] pgmap v7099: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:12.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:45:12 gibba015 bash[29377]: cluster 2021-03-10T17:45:11.359347+0000 mgr.gibba045.orlgmj (mgr.34412) 12459 : cluster [DBG] pgmap v7099: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:12.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:45:12 gibba015 bash[30343]: cluster 2021-03-10T17:45:11.359347+0000 mgr.gibba045.orlgmj (mgr.34412) 12459 : cluster [DBG] pgmap v7099: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:13.268 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:45:13.490 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:45:13.490 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 7m ago 4h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:45:13.491 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (4h) 6m ago 4h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:45:13.491 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 6m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:45:13.491 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 6m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:45:13.491 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 7m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:45:13.492 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 7m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:45:13.492 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 6m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:45:13.492 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 7m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:45:13.492 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (4h) 7m ago 4h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:45:13.493 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (4h) 6m ago 4h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:45:13.493 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 7m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:45:13.493 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 7m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:45:13.493 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 7m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:45:13.493 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 7m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:45:13.494 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 6m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:45:13.494 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 6m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:45:13.494 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 6m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:45:13.495 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 6m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:45:13.495 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (4h) 6m ago 4h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:45:13.495 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 6m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:45:13.739 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:45:13.739 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:45:13.740 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:45:13.740 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:45:13.740 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:45:13.740 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:45:13.741 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:45:13.741 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:45:13.741 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:45:13.741 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:45:13.741 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:45:13.742 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:45:13.742 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:45:13.742 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:45:13.742 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:45:14.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:45:14 gibba045 bash[25517]: audit 2021-03-10T17:45:13.258710+0000 mgr.gibba045.orlgmj (mgr.34412) 12460 : audit [DBG] from='client.62389 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:45:14.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:45:14 gibba045 bash[25517]: cluster 2021-03-10T17:45:13.360928+0000 mgr.gibba045.orlgmj (mgr.34412) 12461 : cluster [DBG] pgmap v7100: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:14.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:45:14 gibba045 bash[25517]: audit 2021-03-10T17:45:13.479205+0000 mgr.gibba045.orlgmj (mgr.34412) 12462 : audit [DBG] from='client.62395 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:45:14.808 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:45:14 gibba045 bash[25517]: audit 2021-03-10T17:45:13.736420+0000 mon.a (mon.0) 2560 : audit [DBG] from='client.? 172.21.2.115:0/2604020341' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:45:14.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:45:14 gibba015 bash[29377]: audit 2021-03-10T17:45:13.258710+0000 mgr.gibba045.orlgmj (mgr.34412) 12460 : audit [DBG] from='client.62389 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:45:14.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:45:14 gibba015 bash[29377]: cluster 2021-03-10T17:45:13.360928+0000 mgr.gibba045.orlgmj (mgr.34412) 12461 : cluster [DBG] pgmap v7100: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:14.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:45:14 gibba015 bash[29377]: audit 2021-03-10T17:45:13.479205+0000 mgr.gibba045.orlgmj (mgr.34412) 12462 : audit [DBG] from='client.62395 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:45:14.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:45:14 gibba015 bash[29377]: audit 2021-03-10T17:45:13.736420+0000 mon.a (mon.0) 2560 : audit [DBG] from='client.? 172.21.2.115:0/2604020341' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:45:14.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:45:14 gibba015 bash[30343]: audit 2021-03-10T17:45:13.258710+0000 mgr.gibba045.orlgmj (mgr.34412) 12460 : audit [DBG] from='client.62389 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:45:14.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:45:14 gibba015 bash[30343]: cluster 2021-03-10T17:45:13.360928+0000 mgr.gibba045.orlgmj (mgr.34412) 12461 : cluster [DBG] pgmap v7100: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:14.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:45:14 gibba015 bash[30343]: audit 2021-03-10T17:45:13.479205+0000 mgr.gibba045.orlgmj (mgr.34412) 12462 : audit [DBG] from='client.62395 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:45:14.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:45:14 gibba015 bash[30343]: audit 2021-03-10T17:45:13.736420+0000 mon.a (mon.0) 2560 : audit [DBG] from='client.? 172.21.2.115:0/2604020341' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:45:16.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:45:16 gibba045 bash[25517]: cluster 2021-03-10T17:45:15.362504+0000 mgr.gibba045.orlgmj (mgr.34412) 12463 : cluster [DBG] pgmap v7101: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:16.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:45:16 gibba015 bash[29377]: cluster 2021-03-10T17:45:15.362504+0000 mgr.gibba045.orlgmj (mgr.34412) 12463 : cluster [DBG] pgmap v7101: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:16.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:45:16 gibba015 bash[30343]: cluster 2021-03-10T17:45:15.362504+0000 mgr.gibba045.orlgmj (mgr.34412) 12463 : cluster [DBG] pgmap v7101: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:17.807 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:45:17 gibba045 bash[25517]: cephadm 2021-03-10T17:45:16.213239+0000 mgr.gibba045.orlgmj (mgr.34412) 12464 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:45:17.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:45:17 gibba015 bash[29377]: cephadm 2021-03-10T17:45:16.213239+0000 mgr.gibba045.orlgmj (mgr.34412) 12464 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:45:17.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:45:17 gibba015 bash[30343]: cephadm 2021-03-10T17:45:16.213239+0000 mgr.gibba045.orlgmj (mgr.34412) 12464 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:45:18.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:45:18 gibba015 bash[29377]: cluster 2021-03-10T17:45:17.364250+0000 mgr.gibba045.orlgmj (mgr.34412) 12465 : cluster [DBG] pgmap v7102: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:18.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:45:18 gibba015 bash[30343]: cluster 2021-03-10T17:45:17.364250+0000 mgr.gibba045.orlgmj (mgr.34412) 12465 : cluster [DBG] pgmap v7102: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:19.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:45:18 gibba045 bash[25517]: cluster 2021-03-10T17:45:17.364250+0000 mgr.gibba045.orlgmj (mgr.34412) 12465 : cluster [DBG] pgmap v7102: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:20.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:45:20 gibba015 bash[29377]: cluster 2021-03-10T17:45:19.365485+0000 mgr.gibba045.orlgmj (mgr.34412) 12466 : cluster [DBG] pgmap v7103: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:20.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:45:20 gibba015 bash[30343]: cluster 2021-03-10T17:45:19.365485+0000 mgr.gibba045.orlgmj (mgr.34412) 12466 : cluster [DBG] pgmap v7103: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:21.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:45:20 gibba045 bash[25517]: cluster 2021-03-10T17:45:19.365485+0000 mgr.gibba045.orlgmj (mgr.34412) 12466 : cluster [DBG] pgmap v7103: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:22.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:45:22 gibba015 bash[29377]: cluster 2021-03-10T17:45:21.367239+0000 mgr.gibba045.orlgmj (mgr.34412) 12467 : cluster [DBG] pgmap v7104: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:22.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:45:22 gibba015 bash[30343]: cluster 2021-03-10T17:45:21.367239+0000 mgr.gibba045.orlgmj (mgr.34412) 12467 : cluster [DBG] pgmap v7104: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:23.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:45:22 gibba045 bash[25517]: cluster 2021-03-10T17:45:21.367239+0000 mgr.gibba045.orlgmj (mgr.34412) 12467 : cluster [DBG] pgmap v7104: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:24.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:45:24 gibba015 bash[29377]: cluster 2021-03-10T17:45:23.368973+0000 mgr.gibba045.orlgmj (mgr.34412) 12468 : cluster [DBG] pgmap v7105: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:24.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:45:24 gibba015 bash[30343]: cluster 2021-03-10T17:45:23.368973+0000 mgr.gibba045.orlgmj (mgr.34412) 12468 : cluster [DBG] pgmap v7105: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:25.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:45:24 gibba045 bash[25517]: cluster 2021-03-10T17:45:23.368973+0000 mgr.gibba045.orlgmj (mgr.34412) 12468 : cluster [DBG] pgmap v7105: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:26.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:45:26 gibba015 bash[29377]: cluster 2021-03-10T17:45:25.370587+0000 mgr.gibba045.orlgmj (mgr.34412) 12469 : cluster [DBG] pgmap v7106: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:26.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:45:26 gibba015 bash[30343]: cluster 2021-03-10T17:45:25.370587+0000 mgr.gibba045.orlgmj (mgr.34412) 12469 : cluster [DBG] pgmap v7106: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:27.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:45:26 gibba045 bash[25517]: cluster 2021-03-10T17:45:25.370587+0000 mgr.gibba045.orlgmj (mgr.34412) 12469 : cluster [DBG] pgmap v7106: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:28.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:45:28 gibba015 bash[29377]: cluster 2021-03-10T17:45:27.372329+0000 mgr.gibba045.orlgmj (mgr.34412) 12470 : cluster [DBG] pgmap v7107: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:28.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:45:28 gibba015 bash[30343]: cluster 2021-03-10T17:45:27.372329+0000 mgr.gibba045.orlgmj (mgr.34412) 12470 : cluster [DBG] pgmap v7107: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:29.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:45:28 gibba045 bash[25517]: cluster 2021-03-10T17:45:27.372329+0000 mgr.gibba045.orlgmj (mgr.34412) 12470 : cluster [DBG] pgmap v7107: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:30.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:45:30 gibba015 bash[29377]: cluster 2021-03-10T17:45:29.373891+0000 mgr.gibba045.orlgmj (mgr.34412) 12471 : cluster [DBG] pgmap v7108: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:30.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:45:30 gibba015 bash[30343]: cluster 2021-03-10T17:45:29.373891+0000 mgr.gibba045.orlgmj (mgr.34412) 12471 : cluster [DBG] pgmap v7108: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:31.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:45:30 gibba045 bash[25517]: cluster 2021-03-10T17:45:29.373891+0000 mgr.gibba045.orlgmj (mgr.34412) 12471 : cluster [DBG] pgmap v7108: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:32.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:45:32 gibba015 bash[29377]: cephadm 2021-03-10T17:45:31.227690+0000 mgr.gibba045.orlgmj (mgr.34412) 12472 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:45:32.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:45:32 gibba015 bash[29377]: cluster 2021-03-10T17:45:31.375476+0000 mgr.gibba045.orlgmj (mgr.34412) 12473 : cluster [DBG] pgmap v7109: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:32.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:45:32 gibba015 bash[30343]: cephadm 2021-03-10T17:45:31.227690+0000 mgr.gibba045.orlgmj (mgr.34412) 12472 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:45:32.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:45:32 gibba015 bash[30343]: cluster 2021-03-10T17:45:31.375476+0000 mgr.gibba045.orlgmj (mgr.34412) 12473 : cluster [DBG] pgmap v7109: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:33.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:45:32 gibba045 bash[25517]: cephadm 2021-03-10T17:45:31.227690+0000 mgr.gibba045.orlgmj (mgr.34412) 12472 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:45:33.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:45:32 gibba045 bash[25517]: cluster 2021-03-10T17:45:31.375476+0000 mgr.gibba045.orlgmj (mgr.34412) 12473 : cluster [DBG] pgmap v7109: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:34.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:45:34 gibba015 bash[29377]: cluster 2021-03-10T17:45:33.377026+0000 mgr.gibba045.orlgmj (mgr.34412) 12474 : cluster [DBG] pgmap v7110: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:34.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:45:34 gibba015 bash[30343]: cluster 2021-03-10T17:45:33.377026+0000 mgr.gibba045.orlgmj (mgr.34412) 12474 : cluster [DBG] pgmap v7110: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:35.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:45:34 gibba045 bash[25517]: cluster 2021-03-10T17:45:33.377026+0000 mgr.gibba045.orlgmj (mgr.34412) 12474 : cluster [DBG] pgmap v7110: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:36.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:45:36 gibba015 bash[29377]: cluster 2021-03-10T17:45:35.378731+0000 mgr.gibba045.orlgmj (mgr.34412) 12475 : cluster [DBG] pgmap v7111: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:36.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:45:36 gibba015 bash[30343]: cluster 2021-03-10T17:45:35.378731+0000 mgr.gibba045.orlgmj (mgr.34412) 12475 : cluster [DBG] pgmap v7111: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:37.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:45:36 gibba045 bash[25517]: cluster 2021-03-10T17:45:35.378731+0000 mgr.gibba045.orlgmj (mgr.34412) 12475 : cluster [DBG] pgmap v7111: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:38.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:45:38 gibba015 bash[29377]: cluster 2021-03-10T17:45:37.380366+0000 mgr.gibba045.orlgmj (mgr.34412) 12476 : cluster [DBG] pgmap v7112: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:38.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:45:38 gibba015 bash[30343]: cluster 2021-03-10T17:45:37.380366+0000 mgr.gibba045.orlgmj (mgr.34412) 12476 : cluster [DBG] pgmap v7112: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:39.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:45:38 gibba045 bash[25517]: cluster 2021-03-10T17:45:37.380366+0000 mgr.gibba045.orlgmj (mgr.34412) 12476 : cluster [DBG] pgmap v7112: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:40.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:45:40 gibba015 bash[29377]: cluster 2021-03-10T17:45:39.381886+0000 mgr.gibba045.orlgmj (mgr.34412) 12477 : cluster [DBG] pgmap v7113: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:40.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:45:40 gibba015 bash[30343]: cluster 2021-03-10T17:45:39.381886+0000 mgr.gibba045.orlgmj (mgr.34412) 12477 : cluster [DBG] pgmap v7113: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:41.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:45:40 gibba045 bash[25517]: cluster 2021-03-10T17:45:39.381886+0000 mgr.gibba045.orlgmj (mgr.34412) 12477 : cluster [DBG] pgmap v7113: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:42.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:45:42 gibba015 bash[29377]: cluster 2021-03-10T17:45:41.383625+0000 mgr.gibba045.orlgmj (mgr.34412) 12478 : cluster [DBG] pgmap v7114: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:42.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:45:42 gibba015 bash[30343]: cluster 2021-03-10T17:45:41.383625+0000 mgr.gibba045.orlgmj (mgr.34412) 12478 : cluster [DBG] pgmap v7114: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:43.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:45:42 gibba045 bash[25517]: cluster 2021-03-10T17:45:41.383625+0000 mgr.gibba045.orlgmj (mgr.34412) 12478 : cluster [DBG] pgmap v7114: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:43.982 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:45:44.207 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:45:44.208 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 7m ago 4h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:45:44.208 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (4h) 6m ago 4h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:45:44.208 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 6m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:45:44.208 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 6m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:45:44.209 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 7m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:45:44.209 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 7m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:45:44.209 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 6m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:45:44.209 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 7m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:45:44.210 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (4h) 7m ago 4h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:45:44.210 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (4h) 6m ago 4h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:45:44.210 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 7m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:45:44.210 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 7m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:45:44.211 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 7m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:45:44.211 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 7m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:45:44.211 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 6m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:45:44.211 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 6m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:45:44.211 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 6m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:45:44.212 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 6m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:45:44.212 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (4h) 6m ago 4h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:45:44.212 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 6m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:45:44.453 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:45:44.453 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:45:44.453 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:45:44.454 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:45:44.454 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:45:44.454 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:45:44.454 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:45:44.455 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:45:44.455 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:45:44.455 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:45:44.455 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:45:44.455 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:45:44.456 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:45:44.456 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:45:44.456 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:45:44.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:45:44 gibba015 bash[29377]: cluster 2021-03-10T17:45:43.385332+0000 mgr.gibba045.orlgmj (mgr.34412) 12479 : cluster [DBG] pgmap v7115: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:44.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:45:44 gibba015 bash[29377]: audit 2021-03-10T17:45:43.971958+0000 mgr.gibba045.orlgmj (mgr.34412) 12480 : audit [DBG] from='client.52422 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:45:44.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:45:44 gibba015 bash[29377]: audit 2021-03-10T17:45:44.450153+0000 mon.c (mon.1) 3417 : audit [DBG] from='client.? 172.21.2.115:0/558277007' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:45:44.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:45:44 gibba015 bash[30343]: cluster 2021-03-10T17:45:43.385332+0000 mgr.gibba045.orlgmj (mgr.34412) 12479 : cluster [DBG] pgmap v7115: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:44.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:45:44 gibba015 bash[30343]: audit 2021-03-10T17:45:43.971958+0000 mgr.gibba045.orlgmj (mgr.34412) 12480 : audit [DBG] from='client.52422 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:45:44.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:45:44 gibba015 bash[30343]: audit 2021-03-10T17:45:44.450153+0000 mon.c (mon.1) 3417 : audit [DBG] from='client.? 172.21.2.115:0/558277007' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:45:45.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:45:44 gibba045 bash[25517]: cluster 2021-03-10T17:45:43.385332+0000 mgr.gibba045.orlgmj (mgr.34412) 12479 : cluster [DBG] pgmap v7115: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:45.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:45:44 gibba045 bash[25517]: audit 2021-03-10T17:45:43.971958+0000 mgr.gibba045.orlgmj (mgr.34412) 12480 : audit [DBG] from='client.52422 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:45:45.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:45:44 gibba045 bash[25517]: audit 2021-03-10T17:45:44.450153+0000 mon.c (mon.1) 3417 : audit [DBG] from='client.? 172.21.2.115:0/558277007' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:45:45.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:45:45 gibba015 bash[29377]: audit 2021-03-10T17:45:44.193431+0000 mgr.gibba045.orlgmj (mgr.34412) 12481 : audit [DBG] from='client.52428 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:45:45.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:45:45 gibba015 bash[30343]: audit 2021-03-10T17:45:44.193431+0000 mgr.gibba045.orlgmj (mgr.34412) 12481 : audit [DBG] from='client.52428 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:45:46.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:45:45 gibba045 bash[25517]: audit 2021-03-10T17:45:44.193431+0000 mgr.gibba045.orlgmj (mgr.34412) 12481 : audit [DBG] from='client.52428 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:45:46.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:45:46 gibba015 bash[29377]: cluster 2021-03-10T17:45:45.387022+0000 mgr.gibba045.orlgmj (mgr.34412) 12482 : cluster [DBG] pgmap v7116: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:46.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:45:46 gibba015 bash[30343]: cluster 2021-03-10T17:45:45.387022+0000 mgr.gibba045.orlgmj (mgr.34412) 12482 : cluster [DBG] pgmap v7116: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:47.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:45:46 gibba045 bash[25517]: cluster 2021-03-10T17:45:45.387022+0000 mgr.gibba045.orlgmj (mgr.34412) 12482 : cluster [DBG] pgmap v7116: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:47.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:45:47 gibba015 bash[29377]: cephadm 2021-03-10T17:45:46.242001+0000 mgr.gibba045.orlgmj (mgr.34412) 12483 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:45:47.975 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:45:47 gibba015 bash[30343]: cephadm 2021-03-10T17:45:46.242001+0000 mgr.gibba045.orlgmj (mgr.34412) 12483 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:45:48.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:45:47 gibba045 bash[25517]: cephadm 2021-03-10T17:45:46.242001+0000 mgr.gibba045.orlgmj (mgr.34412) 12483 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:45:48.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:45:48 gibba015 bash[29377]: cluster 2021-03-10T17:45:47.388761+0000 mgr.gibba045.orlgmj (mgr.34412) 12484 : cluster [DBG] pgmap v7117: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:48.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:45:48 gibba015 bash[30343]: cluster 2021-03-10T17:45:47.388761+0000 mgr.gibba045.orlgmj (mgr.34412) 12484 : cluster [DBG] pgmap v7117: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:49.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:45:48 gibba045 bash[25517]: cluster 2021-03-10T17:45:47.388761+0000 mgr.gibba045.orlgmj (mgr.34412) 12484 : cluster [DBG] pgmap v7117: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:50.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:45:50 gibba015 bash[29377]: cluster 2021-03-10T17:45:49.390235+0000 mgr.gibba045.orlgmj (mgr.34412) 12485 : cluster [DBG] pgmap v7118: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:50.974 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:45:50 gibba015 bash[30343]: cluster 2021-03-10T17:45:49.390235+0000 mgr.gibba045.orlgmj (mgr.34412) 12485 : cluster [DBG] pgmap v7118: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:51.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:45:50 gibba045 bash[25517]: cluster 2021-03-10T17:45:49.390235+0000 mgr.gibba045.orlgmj (mgr.34412) 12485 : cluster [DBG] pgmap v7118: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:52.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:45:52 gibba015 bash[29377]: cluster 2021-03-10T17:45:51.392017+0000 mgr.gibba045.orlgmj (mgr.34412) 12486 : cluster [DBG] pgmap v7119: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:52.973 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:45:52 gibba015 bash[30343]: cluster 2021-03-10T17:45:51.392017+0000 mgr.gibba045.orlgmj (mgr.34412) 12486 : cluster [DBG] pgmap v7119: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:53.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:45:52 gibba045 bash[25517]: cluster 2021-03-10T17:45:51.392017+0000 mgr.gibba045.orlgmj (mgr.34412) 12486 : cluster [DBG] pgmap v7119: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:54.973 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:45:54 gibba015 bash[29377]: cluster 2021-03-10T17:45:53.393570+0000 mgr.gibba045.orlgmj (mgr.34412) 12487 : cluster [DBG] pgmap v7120: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:54.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:45:54 gibba015 bash[29377]: audit 2021-03-10T17:45:54.195586+0000 mon.c (mon.1) 3418 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:45:54.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:45:54 gibba015 bash[29377]: audit 2021-03-10T17:45:54.196208+0000 mon.c (mon.1) 3419 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:45:54.974 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:45:54 gibba015 bash[29377]: audit 2021-03-10T17:45:54.196806+0000 mon.a (mon.0) 2561 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:45:54.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:45:54 gibba015 bash[29377]: audit 2021-03-10T17:45:54.198096+0000 mon.a (mon.0) 2562 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:45:54.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:45:54 gibba015 bash[29377]: audit 2021-03-10T17:45:54.351986+0000 mon.c (mon.1) 3420 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T17:45:54.975 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:45:54 gibba015 bash[29377]: audit 2021-03-10T17:45:54.352742+0000 mon.c (mon.1) 3421 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:45:54.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:45:54 gibba015 bash[29377]: audit 2021-03-10T17:45:54.353423+0000 mon.a (mon.0) 2563 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T17:45:54.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:45:54 gibba015 bash[29377]: audit 2021-03-10T17:45:54.353453+0000 mon.c (mon.1) 3422 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:45:54.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:45:54 gibba015 bash[29377]: audit 2021-03-10T17:45:54.354168+0000 mon.c (mon.1) 3423 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:45:54.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:45:54 gibba015 bash[29377]: audit 2021-03-10T17:45:54.355677+0000 mon.a (mon.0) 2564 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:45:54.976 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:45:54 gibba015 bash[29377]: audit 2021-03-10T17:45:54.356525+0000 mon.a (mon.0) 2565 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:45:54.977 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:45:54 gibba015 bash[29377]: audit 2021-03-10T17:45:54.357599+0000 mon.a (mon.0) 2566 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:45:54.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:45:54 gibba015 bash[30343]: cluster 2021-03-10T17:45:53.393570+0000 mgr.gibba045.orlgmj (mgr.34412) 12487 : cluster [DBG] pgmap v7120: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:54.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:45:54 gibba015 bash[30343]: audit 2021-03-10T17:45:54.195586+0000 mon.c (mon.1) 3418 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:45:54.978 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:45:54 gibba015 bash[30343]: audit 2021-03-10T17:45:54.196208+0000 mon.c (mon.1) 3419 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:45:54.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:45:54 gibba015 bash[30343]: audit 2021-03-10T17:45:54.196806+0000 mon.a (mon.0) 2561 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:45:54.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:45:54 gibba015 bash[30343]: audit 2021-03-10T17:45:54.198096+0000 mon.a (mon.0) 2562 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:45:54.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:45:54 gibba015 bash[30343]: audit 2021-03-10T17:45:54.351986+0000 mon.c (mon.1) 3420 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T17:45:54.979 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:45:54 gibba015 bash[30343]: audit 2021-03-10T17:45:54.352742+0000 mon.c (mon.1) 3421 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:45:54.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:45:54 gibba015 bash[30343]: audit 2021-03-10T17:45:54.353423+0000 mon.a (mon.0) 2563 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T17:45:54.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:45:54 gibba015 bash[30343]: audit 2021-03-10T17:45:54.353453+0000 mon.c (mon.1) 3422 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:45:54.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:45:54 gibba015 bash[30343]: audit 2021-03-10T17:45:54.354168+0000 mon.c (mon.1) 3423 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:45:54.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:45:54 gibba015 bash[30343]: audit 2021-03-10T17:45:54.355677+0000 mon.a (mon.0) 2564 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:45:54.980 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:45:54 gibba015 bash[30343]: audit 2021-03-10T17:45:54.356525+0000 mon.a (mon.0) 2565 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:45:54.981 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:45:54 gibba015 bash[30343]: audit 2021-03-10T17:45:54.357599+0000 mon.a (mon.0) 2566 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:45:55.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:45:54 gibba045 bash[25517]: cluster 2021-03-10T17:45:53.393570+0000 mgr.gibba045.orlgmj (mgr.34412) 12487 : cluster [DBG] pgmap v7120: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:55.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:45:54 gibba045 bash[25517]: audit 2021-03-10T17:45:54.195586+0000 mon.c (mon.1) 3418 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:45:55.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:45:54 gibba045 bash[25517]: audit 2021-03-10T17:45:54.196208+0000 mon.c (mon.1) 3419 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:45:55.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:45:54 gibba045 bash[25517]: audit 2021-03-10T17:45:54.196806+0000 mon.a (mon.0) 2561 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/trash_purge_schedule"}]: dispatch 2021-03-10T17:45:55.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:45:54 gibba045 bash[25517]: audit 2021-03-10T17:45:54.198096+0000 mon.a (mon.0) 2562 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba045.orlgmj/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:45:55.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:45:54 gibba045 bash[25517]: audit 2021-03-10T17:45:54.351986+0000 mon.c (mon.1) 3420 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T17:45:55.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:45:54 gibba045 bash[25517]: audit 2021-03-10T17:45:54.352742+0000 mon.c (mon.1) 3421 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:45:55.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:45:54 gibba045 bash[25517]: audit 2021-03-10T17:45:54.353423+0000 mon.a (mon.0) 2563 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T17:45:55.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:45:54 gibba045 bash[25517]: audit 2021-03-10T17:45:54.353453+0000 mon.c (mon.1) 3422 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:45:55.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:45:54 gibba045 bash[25517]: audit 2021-03-10T17:45:54.354168+0000 mon.c (mon.1) 3423 : audit [INF] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:45:55.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:45:54 gibba045 bash[25517]: audit 2021-03-10T17:45:54.355677+0000 mon.a (mon.0) 2564 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:45:55.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:45:54 gibba045 bash[25517]: audit 2021-03-10T17:45:54.356525+0000 mon.a (mon.0) 2565 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:45:55.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:45:54 gibba045 bash[25517]: audit 2021-03-10T17:45:54.357599+0000 mon.a (mon.0) 2566 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:45:57.064 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:45:56 gibba045 bash[25517]: cluster 2021-03-10T17:45:55.395406+0000 mgr.gibba045.orlgmj (mgr.34412) 12488 : cluster [DBG] pgmap v7121: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:57.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:45:56 gibba015 bash[29377]: cluster 2021-03-10T17:45:55.395406+0000 mgr.gibba045.orlgmj (mgr.34412) 12488 : cluster [DBG] pgmap v7121: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:57.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:45:56 gibba015 bash[30343]: cluster 2021-03-10T17:45:55.395406+0000 mgr.gibba045.orlgmj (mgr.34412) 12488 : cluster [DBG] pgmap v7121: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:59.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:45:58 gibba045 bash[25517]: cluster 2021-03-10T17:45:57.397399+0000 mgr.gibba045.orlgmj (mgr.34412) 12489 : cluster [DBG] pgmap v7122: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:59.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:45:58 gibba015 bash[29377]: cluster 2021-03-10T17:45:57.397399+0000 mgr.gibba045.orlgmj (mgr.34412) 12489 : cluster [DBG] pgmap v7122: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:59.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:45:58 gibba015 bash[30343]: cluster 2021-03-10T17:45:57.397399+0000 mgr.gibba045.orlgmj (mgr.34412) 12489 : cluster [DBG] pgmap v7122: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:01.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:46:00 gibba045 bash[25517]: cluster 2021-03-10T17:45:59.398739+0000 mgr.gibba045.orlgmj (mgr.34412) 12490 : cluster [DBG] pgmap v7123: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:01.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:46:00 gibba015 bash[29377]: cluster 2021-03-10T17:45:59.398739+0000 mgr.gibba045.orlgmj (mgr.34412) 12490 : cluster [DBG] pgmap v7123: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:01.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:46:00 gibba015 bash[30343]: cluster 2021-03-10T17:45:59.398739+0000 mgr.gibba045.orlgmj (mgr.34412) 12490 : cluster [DBG] pgmap v7123: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:02.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:46:01 gibba045 bash[25517]: audit 2021-03-10T17:46:01.256912+0000 mon.c (mon.1) 3424 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:46:02.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:46:01 gibba045 bash[25517]: audit 2021-03-10T17:46:01.471857+0000 mon.a (mon.0) 2567 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:46:02.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:46:01 gibba045 bash[25517]: audit 2021-03-10T17:46:01.475432+0000 mon.c (mon.1) 3425 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:46:02.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:46:01 gibba045 bash[25517]: audit 2021-03-10T17:46:01.476876+0000 mon.c (mon.1) 3426 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:46:02.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:46:01 gibba045 bash[25517]: audit 2021-03-10T17:46:01.478144+0000 mon.c (mon.1) 3427 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:46:02.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:46:01 gibba045 bash[25517]: audit 2021-03-10T17:46:01.479334+0000 mon.c (mon.1) 3428 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:46:02.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:46:01 gibba045 bash[25517]: audit 2021-03-10T17:46:01.482477+0000 mon.c (mon.1) 3429 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:46:02.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:46:01 gibba045 bash[25517]: audit 2021-03-10T17:46:01.484275+0000 mon.c (mon.1) 3430 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:46:02.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:46:01 gibba015 bash[29377]: audit 2021-03-10T17:46:01.256912+0000 mon.c (mon.1) 3424 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:46:02.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:46:01 gibba015 bash[29377]: audit 2021-03-10T17:46:01.471857+0000 mon.a (mon.0) 2567 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:46:02.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:46:01 gibba015 bash[29377]: audit 2021-03-10T17:46:01.475432+0000 mon.c (mon.1) 3425 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:46:02.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:46:01 gibba015 bash[29377]: audit 2021-03-10T17:46:01.476876+0000 mon.c (mon.1) 3426 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:46:02.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:46:01 gibba015 bash[29377]: audit 2021-03-10T17:46:01.478144+0000 mon.c (mon.1) 3427 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:46:02.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:46:01 gibba015 bash[29377]: audit 2021-03-10T17:46:01.479334+0000 mon.c (mon.1) 3428 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:46:02.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:46:01 gibba015 bash[29377]: audit 2021-03-10T17:46:01.482477+0000 mon.c (mon.1) 3429 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:46:02.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:46:01 gibba015 bash[29377]: audit 2021-03-10T17:46:01.484275+0000 mon.c (mon.1) 3430 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:46:02.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:46:01 gibba015 bash[30343]: audit 2021-03-10T17:46:01.256912+0000 mon.c (mon.1) 3424 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:46:02.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:46:01 gibba015 bash[30343]: audit 2021-03-10T17:46:01.471857+0000 mon.a (mon.0) 2567 : audit [INF] from='mgr.34412 ' entity='mgr.gibba045.orlgmj' 2021-03-10T17:46:02.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:46:01 gibba015 bash[30343]: audit 2021-03-10T17:46:01.475432+0000 mon.c (mon.1) 3425 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:46:02.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:46:01 gibba015 bash[30343]: audit 2021-03-10T17:46:01.476876+0000 mon.c (mon.1) 3426 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:46:02.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:46:01 gibba015 bash[30343]: audit 2021-03-10T17:46:01.478144+0000 mon.c (mon.1) 3427 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:46:02.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:46:01 gibba015 bash[30343]: audit 2021-03-10T17:46:01.479334+0000 mon.c (mon.1) 3428 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:46:02.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:46:01 gibba015 bash[30343]: audit 2021-03-10T17:46:01.482477+0000 mon.c (mon.1) 3429 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:46:02.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:46:01 gibba015 bash[30343]: audit 2021-03-10T17:46:01.484275+0000 mon.c (mon.1) 3430 : audit [DBG] from='mgr.34412 172.21.2.145:0/4281257678' entity='mgr.gibba045.orlgmj' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:46:03.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:46:02 gibba045 bash[25517]: cephadm 2021-03-10T17:46:01.264871+0000 mgr.gibba045.orlgmj (mgr.34412) 12491 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:46:03.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:46:02 gibba045 bash[25517]: cephadm 2021-03-10T17:46:01.267075+0000 mgr.gibba045.orlgmj (mgr.34412) 12492 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:46:03.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:46:02 gibba045 bash[25517]: cluster 2021-03-10T17:46:01.399327+0000 mgr.gibba045.orlgmj (mgr.34412) 12493 : cluster [DBG] pgmap v7124: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:03.058 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:46:02 gibba045 bash[25517]: cephadm 2021-03-10T17:46:01.476664+0000 mgr.gibba045.orlgmj (mgr.34412) 12494 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:46:03.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:46:02 gibba045 bash[25517]: cephadm 2021-03-10T17:46:01.478382+0000 mgr.gibba045.orlgmj (mgr.34412) 12495 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:46:03.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:46:02 gibba045 bash[25517]: cephadm 2021-03-10T17:46:01.479446+0000 mgr.gibba045.orlgmj (mgr.34412) 12496 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:46:03.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:46:02 gibba045 bash[25517]: cephadm 2021-03-10T17:46:01.479514+0000 mgr.gibba045.orlgmj (mgr.34412) 12497 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:46:03.059 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:46:02 gibba045 bash[25517]: cephadm 2021-03-10T17:46:01.480828+0000 mgr.gibba045.orlgmj (mgr.34412) 12498 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:46:03.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:46:02 gibba045 bash[25517]: cephadm 2021-03-10T17:46:01.480866+0000 mgr.gibba045.orlgmj (mgr.34412) 12499 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:46:03.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:46:02 gibba045 bash[25517]: cephadm 2021-03-10T17:46:01.482099+0000 mgr.gibba045.orlgmj (mgr.34412) 12500 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:46:03.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:46:02 gibba045 bash[25517]: cephadm 2021-03-10T17:46:01.483700+0000 mgr.gibba045.orlgmj (mgr.34412) 12501 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:46:03.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:46:02 gibba045 bash[25517]: cephadm 2021-03-10T17:46:01.483832+0000 mgr.gibba045.orlgmj (mgr.34412) 12502 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:46:03.060 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:46:02 gibba045 bash[25517]: cephadm 2021-03-10T17:46:01.485471+0000 mgr.gibba045.orlgmj (mgr.34412) 12503 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:46:03.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:46:02 gibba045 bash[25517]: cephadm 2021-03-10T17:46:01.485857+0000 mgr.gibba045.orlgmj (mgr.34412) 12504 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:46:03.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:46:02 gibba045 bash[25517]: cephadm 2021-03-10T17:46:01.486993+0000 mgr.gibba045.orlgmj (mgr.34412) 12505 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:46:03.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:46:02 gibba045 bash[25517]: cephadm 2021-03-10T17:46:01.487031+0000 mgr.gibba045.orlgmj (mgr.34412) 12506 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:46:03.061 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:46:02 gibba045 bash[25517]: cephadm 2021-03-10T17:46:01.487136+0000 mgr.gibba045.orlgmj (mgr.34412) 12507 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:46:03.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:46:02 gibba015 bash[29377]: cephadm 2021-03-10T17:46:01.264871+0000 mgr.gibba045.orlgmj (mgr.34412) 12491 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:46:03.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:46:02 gibba015 bash[29377]: cephadm 2021-03-10T17:46:01.267075+0000 mgr.gibba045.orlgmj (mgr.34412) 12492 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:46:03.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:46:02 gibba015 bash[29377]: cluster 2021-03-10T17:46:01.399327+0000 mgr.gibba045.orlgmj (mgr.34412) 12493 : cluster [DBG] pgmap v7124: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:03.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:46:02 gibba015 bash[29377]: cephadm 2021-03-10T17:46:01.476664+0000 mgr.gibba045.orlgmj (mgr.34412) 12494 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:46:03.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:46:02 gibba015 bash[29377]: cephadm 2021-03-10T17:46:01.478382+0000 mgr.gibba045.orlgmj (mgr.34412) 12495 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:46:03.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:46:02 gibba015 bash[29377]: cephadm 2021-03-10T17:46:01.479446+0000 mgr.gibba045.orlgmj (mgr.34412) 12496 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:46:03.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:46:02 gibba015 bash[29377]: cephadm 2021-03-10T17:46:01.479514+0000 mgr.gibba045.orlgmj (mgr.34412) 12497 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:46:03.225 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:46:02 gibba015 bash[29377]: cephadm 2021-03-10T17:46:01.480828+0000 mgr.gibba045.orlgmj (mgr.34412) 12498 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:46:03.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:46:02 gibba015 bash[29377]: cephadm 2021-03-10T17:46:01.480866+0000 mgr.gibba045.orlgmj (mgr.34412) 12499 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:46:03.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:46:02 gibba015 bash[29377]: cephadm 2021-03-10T17:46:01.482099+0000 mgr.gibba045.orlgmj (mgr.34412) 12500 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:46:03.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:46:02 gibba015 bash[29377]: cephadm 2021-03-10T17:46:01.483700+0000 mgr.gibba045.orlgmj (mgr.34412) 12501 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:46:03.226 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:46:02 gibba015 bash[29377]: cephadm 2021-03-10T17:46:01.483832+0000 mgr.gibba045.orlgmj (mgr.34412) 12502 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:46:03.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:46:02 gibba015 bash[29377]: cephadm 2021-03-10T17:46:01.485471+0000 mgr.gibba045.orlgmj (mgr.34412) 12503 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:46:03.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:46:02 gibba015 bash[29377]: cephadm 2021-03-10T17:46:01.485857+0000 mgr.gibba045.orlgmj (mgr.34412) 12504 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:46:03.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:46:02 gibba015 bash[29377]: cephadm 2021-03-10T17:46:01.486993+0000 mgr.gibba045.orlgmj (mgr.34412) 12505 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:46:03.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:46:02 gibba015 bash[29377]: cephadm 2021-03-10T17:46:01.487031+0000 mgr.gibba045.orlgmj (mgr.34412) 12506 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:46:03.227 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:46:02 gibba015 bash[29377]: cephadm 2021-03-10T17:46:01.487136+0000 mgr.gibba045.orlgmj (mgr.34412) 12507 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:46:03.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:46:02 gibba015 bash[30343]: cephadm 2021-03-10T17:46:01.264871+0000 mgr.gibba045.orlgmj (mgr.34412) 12491 : cephadm [INF] Refreshing gibba015 facts 2021-03-10T17:46:03.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:46:02 gibba015 bash[30343]: cephadm 2021-03-10T17:46:01.267075+0000 mgr.gibba045.orlgmj (mgr.34412) 12492 : cephadm [INF] Refreshing gibba045 facts 2021-03-10T17:46:03.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:46:02 gibba015 bash[30343]: cluster 2021-03-10T17:46:01.399327+0000 mgr.gibba045.orlgmj (mgr.34412) 12493 : cluster [DBG] pgmap v7124: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:03.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:46:02 gibba015 bash[30343]: cephadm 2021-03-10T17:46:01.476664+0000 mgr.gibba045.orlgmj (mgr.34412) 12494 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:46:03.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:46:02 gibba015 bash[30343]: cephadm 2021-03-10T17:46:01.478382+0000 mgr.gibba045.orlgmj (mgr.34412) 12495 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:46:03.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:46:02 gibba015 bash[30343]: cephadm 2021-03-10T17:46:01.479446+0000 mgr.gibba045.orlgmj (mgr.34412) 12496 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:46:03.229 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:46:02 gibba015 bash[30343]: cephadm 2021-03-10T17:46:01.479514+0000 mgr.gibba045.orlgmj (mgr.34412) 12497 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:46:03.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:46:02 gibba015 bash[30343]: cephadm 2021-03-10T17:46:01.480828+0000 mgr.gibba045.orlgmj (mgr.34412) 12498 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:46:03.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:46:02 gibba015 bash[30343]: cephadm 2021-03-10T17:46:01.480866+0000 mgr.gibba045.orlgmj (mgr.34412) 12499 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:46:03.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:46:02 gibba015 bash[30343]: cephadm 2021-03-10T17:46:01.482099+0000 mgr.gibba045.orlgmj (mgr.34412) 12500 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:46:03.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:46:02 gibba015 bash[30343]: cephadm 2021-03-10T17:46:01.483700+0000 mgr.gibba045.orlgmj (mgr.34412) 12501 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:46:03.230 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:46:02 gibba015 bash[30343]: cephadm 2021-03-10T17:46:01.483832+0000 mgr.gibba045.orlgmj (mgr.34412) 12502 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:46:03.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:46:02 gibba015 bash[30343]: cephadm 2021-03-10T17:46:01.485471+0000 mgr.gibba045.orlgmj (mgr.34412) 12503 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:46:03.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:46:02 gibba015 bash[30343]: cephadm 2021-03-10T17:46:01.485857+0000 mgr.gibba045.orlgmj (mgr.34412) 12504 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:46:03.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:46:02 gibba015 bash[30343]: cephadm 2021-03-10T17:46:01.486993+0000 mgr.gibba045.orlgmj (mgr.34412) 12505 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:46:03.231 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:46:02 gibba015 bash[30343]: cephadm 2021-03-10T17:46:01.487031+0000 mgr.gibba045.orlgmj (mgr.34412) 12506 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:46:03.232 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:46:02 gibba015 bash[30343]: cephadm 2021-03-10T17:46:01.487136+0000 mgr.gibba045.orlgmj (mgr.34412) 12507 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:46:05.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:46:04 gibba045 bash[25517]: cluster 2021-03-10T17:46:03.400682+0000 mgr.gibba045.orlgmj (mgr.34412) 12508 : cluster [DBG] pgmap v7125: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:05.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:46:04 gibba015 bash[29377]: cluster 2021-03-10T17:46:03.400682+0000 mgr.gibba045.orlgmj (mgr.34412) 12508 : cluster [DBG] pgmap v7125: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:05.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:46:04 gibba015 bash[30343]: cluster 2021-03-10T17:46:03.400682+0000 mgr.gibba045.orlgmj (mgr.34412) 12508 : cluster [DBG] pgmap v7125: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:07.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:46:06 gibba045 bash[25517]: cluster 2021-03-10T17:46:05.402106+0000 mgr.gibba045.orlgmj (mgr.34412) 12509 : cluster [DBG] pgmap v7126: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:07.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:46:06 gibba015 bash[29377]: cluster 2021-03-10T17:46:05.402106+0000 mgr.gibba045.orlgmj (mgr.34412) 12509 : cluster [DBG] pgmap v7126: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:07.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:46:06 gibba015 bash[30343]: cluster 2021-03-10T17:46:05.402106+0000 mgr.gibba045.orlgmj (mgr.34412) 12509 : cluster [DBG] pgmap v7126: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:09.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:46:08 gibba045 bash[25517]: cluster 2021-03-10T17:46:07.403824+0000 mgr.gibba045.orlgmj (mgr.34412) 12510 : cluster [DBG] pgmap v7127: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:09.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:46:08 gibba015 bash[29377]: cluster 2021-03-10T17:46:07.403824+0000 mgr.gibba045.orlgmj (mgr.34412) 12510 : cluster [DBG] pgmap v7127: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:09.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:46:08 gibba015 bash[30343]: cluster 2021-03-10T17:46:07.403824+0000 mgr.gibba045.orlgmj (mgr.34412) 12510 : cluster [DBG] pgmap v7127: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:11.057 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:46:10 gibba045 bash[25517]: cluster 2021-03-10T17:46:09.405302+0000 mgr.gibba045.orlgmj (mgr.34412) 12511 : cluster [DBG] pgmap v7128: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:11.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:46:10 gibba015 bash[29377]: cluster 2021-03-10T17:46:09.405302+0000 mgr.gibba045.orlgmj (mgr.34412) 12511 : cluster [DBG] pgmap v7128: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:11.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:46:10 gibba015 bash[30343]: cluster 2021-03-10T17:46:09.405302+0000 mgr.gibba045.orlgmj (mgr.34412) 12511 : cluster [DBG] pgmap v7128: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:13.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:46:12 gibba015 bash[29377]: cluster 2021-03-10T17:46:11.407067+0000 mgr.gibba045.orlgmj (mgr.34412) 12512 : cluster [DBG] pgmap v7129: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:13.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:46:12 gibba015 bash[30343]: cluster 2021-03-10T17:46:11.407067+0000 mgr.gibba045.orlgmj (mgr.34412) 12512 : cluster [DBG] pgmap v7129: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:13.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:46:12 gibba045 bash[25517]: cluster 2021-03-10T17:46:11.407067+0000 mgr.gibba045.orlgmj (mgr.34412) 12512 : cluster [DBG] pgmap v7129: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:14.701 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:46:14.936 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:46:14.937 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 8m ago 4h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:46:14.937 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (4h) 7m ago 4h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:46:14.937 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 7m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:46:14.937 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 7m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:46:14.938 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 8m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:46:14.938 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 8m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:46:14.938 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 7m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:46:14.938 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 8m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:46:14.938 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (4h) 8m ago 4h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:46:14.939 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (4h) 7m ago 4h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:46:14.939 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 8m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:46:14.939 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 8m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:46:14.939 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 8m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:46:14.940 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 8m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:46:14.940 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 7m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:46:14.940 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 7m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:46:14.940 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 7m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:46:14.940 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 7m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:46:14.941 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (4h) 7m ago 4h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:46:14.941 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 7m ago 4h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:46:15.184 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:46:15.185 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:46:15.185 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:46:15.185 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:46:15.186 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:46:15.186 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:46:15.186 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:46:15.186 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:46:15.187 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:46:15.187 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:46:15.187 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:46:15.187 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:46:15.187 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:46:15.188 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:46:15.188 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:46:15.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:46:14 gibba015 bash[29377]: cluster 2021-03-10T17:46:13.408649+0000 mgr.gibba045.orlgmj (mgr.34412) 12513 : cluster [DBG] pgmap v7130: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:15.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:46:14 gibba015 bash[30343]: cluster 2021-03-10T17:46:13.408649+0000 mgr.gibba045.orlgmj (mgr.34412) 12513 : cluster [DBG] pgmap v7130: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:15.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:46:14 gibba045 bash[25517]: cluster 2021-03-10T17:46:13.408649+0000 mgr.gibba045.orlgmj (mgr.34412) 12513 : cluster [DBG] pgmap v7130: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:16.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:46:15 gibba015 bash[29377]: audit 2021-03-10T17:46:14.691930+0000 mgr.gibba045.orlgmj (mgr.34412) 12514 : audit [DBG] from='client.62425 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:46:16.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:46:15 gibba015 bash[29377]: audit 2021-03-10T17:46:14.922830+0000 mgr.gibba045.orlgmj (mgr.34412) 12515 : audit [DBG] from='client.62431 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:46:16.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:46:15 gibba015 bash[29377]: audit 2021-03-10T17:46:15.181902+0000 mon.a (mon.0) 2568 : audit [DBG] from='client.? 172.21.2.115:0/50990681' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:46:16.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:46:15 gibba015 bash[30343]: audit 2021-03-10T17:46:14.691930+0000 mgr.gibba045.orlgmj (mgr.34412) 12514 : audit [DBG] from='client.62425 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:46:16.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:46:15 gibba015 bash[30343]: audit 2021-03-10T17:46:14.922830+0000 mgr.gibba045.orlgmj (mgr.34412) 12515 : audit [DBG] from='client.62431 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:46:16.225 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:46:15 gibba015 bash[30343]: audit 2021-03-10T17:46:15.181902+0000 mon.a (mon.0) 2568 : audit [DBG] from='client.? 172.21.2.115:0/50990681' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:46:16.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:46:15 gibba045 bash[25517]: audit 2021-03-10T17:46:14.691930+0000 mgr.gibba045.orlgmj (mgr.34412) 12514 : audit [DBG] from='client.62425 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:46:16.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:46:15 gibba045 bash[25517]: audit 2021-03-10T17:46:14.922830+0000 mgr.gibba045.orlgmj (mgr.34412) 12515 : audit [DBG] from='client.62431 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:46:16.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:46:15 gibba045 bash[25517]: audit 2021-03-10T17:46:15.181902+0000 mon.a (mon.0) 2568 : audit [DBG] from='client.? 172.21.2.115:0/50990681' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:46:17.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:46:16 gibba015 bash[29377]: cluster 2021-03-10T17:46:15.410293+0000 mgr.gibba045.orlgmj (mgr.34412) 12516 : cluster [DBG] pgmap v7131: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:17.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:46:16 gibba015 bash[30343]: cluster 2021-03-10T17:46:15.410293+0000 mgr.gibba045.orlgmj (mgr.34412) 12516 : cluster [DBG] pgmap v7131: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:17.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:46:16 gibba045 bash[25517]: cluster 2021-03-10T17:46:15.410293+0000 mgr.gibba045.orlgmj (mgr.34412) 12516 : cluster [DBG] pgmap v7131: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:18.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:46:17 gibba015 bash[29377]: cephadm 2021-03-10T17:46:16.503045+0000 mgr.gibba045.orlgmj (mgr.34412) 12517 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:46:18.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:46:17 gibba015 bash[30343]: cephadm 2021-03-10T17:46:16.503045+0000 mgr.gibba045.orlgmj (mgr.34412) 12517 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:46:18.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:46:17 gibba045 bash[25517]: cephadm 2021-03-10T17:46:16.503045+0000 mgr.gibba045.orlgmj (mgr.34412) 12517 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:46:19.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:46:18 gibba015 bash[29377]: cluster 2021-03-10T17:46:17.412079+0000 mgr.gibba045.orlgmj (mgr.34412) 12518 : cluster [DBG] pgmap v7132: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:19.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:46:18 gibba015 bash[30343]: cluster 2021-03-10T17:46:17.412079+0000 mgr.gibba045.orlgmj (mgr.34412) 12518 : cluster [DBG] pgmap v7132: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:19.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:46:18 gibba045 bash[25517]: cluster 2021-03-10T17:46:17.412079+0000 mgr.gibba045.orlgmj (mgr.34412) 12518 : cluster [DBG] pgmap v7132: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:21.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:46:20 gibba015 bash[29377]: cluster 2021-03-10T17:46:19.413314+0000 mgr.gibba045.orlgmj (mgr.34412) 12519 : cluster [DBG] pgmap v7133: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:21.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:46:20 gibba015 bash[30343]: cluster 2021-03-10T17:46:19.413314+0000 mgr.gibba045.orlgmj (mgr.34412) 12519 : cluster [DBG] pgmap v7133: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:21.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:46:20 gibba045 bash[25517]: cluster 2021-03-10T17:46:19.413314+0000 mgr.gibba045.orlgmj (mgr.34412) 12519 : cluster [DBG] pgmap v7133: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:23.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:46:22 gibba015 bash[29377]: cluster 2021-03-10T17:46:21.415173+0000 mgr.gibba045.orlgmj (mgr.34412) 12520 : cluster [DBG] pgmap v7134: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:23.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:46:22 gibba015 bash[30343]: cluster 2021-03-10T17:46:21.415173+0000 mgr.gibba045.orlgmj (mgr.34412) 12520 : cluster [DBG] pgmap v7134: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:23.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:46:22 gibba045 bash[25517]: cluster 2021-03-10T17:46:21.415173+0000 mgr.gibba045.orlgmj (mgr.34412) 12520 : cluster [DBG] pgmap v7134: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:25.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:46:24 gibba015 bash[29377]: cluster 2021-03-10T17:46:23.416311+0000 mgr.gibba045.orlgmj (mgr.34412) 12521 : cluster [DBG] pgmap v7135: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:25.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:46:24 gibba015 bash[30343]: cluster 2021-03-10T17:46:23.416311+0000 mgr.gibba045.orlgmj (mgr.34412) 12521 : cluster [DBG] pgmap v7135: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:25.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:46:24 gibba045 bash[25517]: cluster 2021-03-10T17:46:23.416311+0000 mgr.gibba045.orlgmj (mgr.34412) 12521 : cluster [DBG] pgmap v7135: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:27.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:46:26 gibba015 bash[29377]: cluster 2021-03-10T17:46:25.417965+0000 mgr.gibba045.orlgmj (mgr.34412) 12522 : cluster [DBG] pgmap v7136: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:27.228 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:46:26 gibba015 bash[30343]: cluster 2021-03-10T17:46:25.417965+0000 mgr.gibba045.orlgmj (mgr.34412) 12522 : cluster [DBG] pgmap v7136: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:27.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:46:26 gibba045 bash[25517]: cluster 2021-03-10T17:46:25.417965+0000 mgr.gibba045.orlgmj (mgr.34412) 12522 : cluster [DBG] pgmap v7136: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:29.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:46:28 gibba015 bash[29377]: cluster 2021-03-10T17:46:27.419774+0000 mgr.gibba045.orlgmj (mgr.34412) 12523 : cluster [DBG] pgmap v7137: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:29.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:46:28 gibba015 bash[30343]: cluster 2021-03-10T17:46:27.419774+0000 mgr.gibba045.orlgmj (mgr.34412) 12523 : cluster [DBG] pgmap v7137: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:29.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:46:28 gibba045 bash[25517]: cluster 2021-03-10T17:46:27.419774+0000 mgr.gibba045.orlgmj (mgr.34412) 12523 : cluster [DBG] pgmap v7137: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:31.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:46:30 gibba015 bash[29377]: cluster 2021-03-10T17:46:29.421009+0000 mgr.gibba045.orlgmj (mgr.34412) 12524 : cluster [DBG] pgmap v7138: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:31.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:46:30 gibba015 bash[30343]: cluster 2021-03-10T17:46:29.421009+0000 mgr.gibba045.orlgmj (mgr.34412) 12524 : cluster [DBG] pgmap v7138: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:31.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:46:30 gibba045 bash[25517]: cluster 2021-03-10T17:46:29.421009+0000 mgr.gibba045.orlgmj (mgr.34412) 12524 : cluster [DBG] pgmap v7138: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:33.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:46:32 gibba015 bash[29377]: cluster 2021-03-10T17:46:31.422790+0000 mgr.gibba045.orlgmj (mgr.34412) 12525 : cluster [DBG] pgmap v7139: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:33.224 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:46:32 gibba015 bash[29377]: cephadm 2021-03-10T17:46:31.517202+0000 mgr.gibba045.orlgmj (mgr.34412) 12526 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:46:33.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:46:32 gibba015 bash[30343]: cluster 2021-03-10T17:46:31.422790+0000 mgr.gibba045.orlgmj (mgr.34412) 12525 : cluster [DBG] pgmap v7139: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:33.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:46:32 gibba015 bash[30343]: cephadm 2021-03-10T17:46:31.517202+0000 mgr.gibba045.orlgmj (mgr.34412) 12526 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:46:33.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:46:32 gibba045 bash[25517]: cluster 2021-03-10T17:46:31.422790+0000 mgr.gibba045.orlgmj (mgr.34412) 12525 : cluster [DBG] pgmap v7139: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:33.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:46:32 gibba045 bash[25517]: cephadm 2021-03-10T17:46:31.517202+0000 mgr.gibba045.orlgmj (mgr.34412) 12526 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:46:35.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:46:34 gibba015 bash[29377]: cluster 2021-03-10T17:46:33.424120+0000 mgr.gibba045.orlgmj (mgr.34412) 12527 : cluster [DBG] pgmap v7140: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:35.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:46:34 gibba015 bash[30343]: cluster 2021-03-10T17:46:33.424120+0000 mgr.gibba045.orlgmj (mgr.34412) 12527 : cluster [DBG] pgmap v7140: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:35.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:46:34 gibba045 bash[25517]: cluster 2021-03-10T17:46:33.424120+0000 mgr.gibba045.orlgmj (mgr.34412) 12527 : cluster [DBG] pgmap v7140: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:37.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:46:36 gibba015 bash[29377]: cluster 2021-03-10T17:46:35.425753+0000 mgr.gibba045.orlgmj (mgr.34412) 12528 : cluster [DBG] pgmap v7141: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:37.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:46:36 gibba015 bash[30343]: cluster 2021-03-10T17:46:35.425753+0000 mgr.gibba045.orlgmj (mgr.34412) 12528 : cluster [DBG] pgmap v7141: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:37.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:46:36 gibba045 bash[25517]: cluster 2021-03-10T17:46:35.425753+0000 mgr.gibba045.orlgmj (mgr.34412) 12528 : cluster [DBG] pgmap v7141: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:39.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:46:38 gibba015 bash[29377]: cluster 2021-03-10T17:46:37.427236+0000 mgr.gibba045.orlgmj (mgr.34412) 12529 : cluster [DBG] pgmap v7142: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:39.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:46:38 gibba015 bash[30343]: cluster 2021-03-10T17:46:37.427236+0000 mgr.gibba045.orlgmj (mgr.34412) 12529 : cluster [DBG] pgmap v7142: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:39.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:46:38 gibba045 bash[25517]: cluster 2021-03-10T17:46:37.427236+0000 mgr.gibba045.orlgmj (mgr.34412) 12529 : cluster [DBG] pgmap v7142: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:41.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:46:40 gibba015 bash[29377]: cluster 2021-03-10T17:46:39.428740+0000 mgr.gibba045.orlgmj (mgr.34412) 12530 : cluster [DBG] pgmap v7143: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:41.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:46:40 gibba015 bash[30343]: cluster 2021-03-10T17:46:39.428740+0000 mgr.gibba045.orlgmj (mgr.34412) 12530 : cluster [DBG] pgmap v7143: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:41.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:46:40 gibba045 bash[25517]: cluster 2021-03-10T17:46:39.428740+0000 mgr.gibba045.orlgmj (mgr.34412) 12530 : cluster [DBG] pgmap v7143: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:43.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:46:42 gibba015 bash[29377]: cluster 2021-03-10T17:46:41.430784+0000 mgr.gibba045.orlgmj (mgr.34412) 12531 : cluster [DBG] pgmap v7144: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:43.224 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:46:42 gibba015 bash[30343]: cluster 2021-03-10T17:46:41.430784+0000 mgr.gibba045.orlgmj (mgr.34412) 12531 : cluster [DBG] pgmap v7144: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:43.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:46:42 gibba045 bash[25517]: cluster 2021-03-10T17:46:41.430784+0000 mgr.gibba045.orlgmj (mgr.34412) 12531 : cluster [DBG] pgmap v7144: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:45.222 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:46:44 gibba015 bash[29377]: cluster 2021-03-10T17:46:43.431872+0000 mgr.gibba045.orlgmj (mgr.34412) 12532 : cluster [DBG] pgmap v7145: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:45.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:46:44 gibba015 bash[30343]: cluster 2021-03-10T17:46:43.431872+0000 mgr.gibba045.orlgmj (mgr.34412) 12532 : cluster [DBG] pgmap v7145: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:45.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:46:44 gibba045 bash[25517]: cluster 2021-03-10T17:46:43.431872+0000 mgr.gibba045.orlgmj (mgr.34412) 12532 : cluster [DBG] pgmap v7145: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:45.428 INFO:teuthology.orchestra.run.gibba015.stdout:true 2021-03-10T17:46:45.654 INFO:teuthology.orchestra.run.gibba015.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:46:45.655 INFO:teuthology.orchestra.run.gibba015.stdout:alertmanager.a gibba015 running (3h) 8m ago 4h 0.21.0 prom/alertmanager c876f5897d7b df987682eada 2021-03-10T17:46:45.655 INFO:teuthology.orchestra.run.gibba015.stdout:grafana.a gibba045 running (4h) 7m ago 4h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d86cab6511db 2021-03-10T17:46:45.655 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.gibba045.orlgmj gibba045 running (3h) 7m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ea964e825589 2021-03-10T17:46:45.656 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.x gibba045 running (3h) 7m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 0b25900c63e0 2021-03-10T17:46:45.656 INFO:teuthology.orchestra.run.gibba015.stdout:mgr.y gibba015 running (3h) 8m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da fb55e770cd62 2021-03-10T17:46:45.656 INFO:teuthology.orchestra.run.gibba015.stdout:mon.a gibba015 running (3h) 8m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 49fd96830250 2021-03-10T17:46:45.656 INFO:teuthology.orchestra.run.gibba015.stdout:mon.b gibba045 running (3h) 7m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 711c20b99610 2021-03-10T17:46:45.657 INFO:teuthology.orchestra.run.gibba015.stdout:mon.c gibba015 running (3h) 8m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6743d7c3d229 2021-03-10T17:46:45.657 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.a gibba015 running (4h) 8m ago 4h 1.1.2 prom/node-exporter c19ae228f069 3e13444f9f78 2021-03-10T17:46:45.657 INFO:teuthology.orchestra.run.gibba015.stdout:node-exporter.b gibba045 running (4h) 7m ago 4h 1.1.2 prom/node-exporter c19ae228f069 369947ba7ea0 2021-03-10T17:46:45.657 INFO:teuthology.orchestra.run.gibba015.stdout:osd.0 gibba015 running (3h) 8m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 16b899f1a884 2021-03-10T17:46:45.658 INFO:teuthology.orchestra.run.gibba015.stdout:osd.1 gibba015 running (3h) 8m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a2563b12db31 2021-03-10T17:46:45.658 INFO:teuthology.orchestra.run.gibba015.stdout:osd.2 gibba015 running (3h) 8m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 631d06864cce 2021-03-10T17:46:45.658 INFO:teuthology.orchestra.run.gibba015.stdout:osd.3 gibba015 running (3h) 8m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 3ee3a1227959 2021-03-10T17:46:45.658 INFO:teuthology.orchestra.run.gibba015.stdout:osd.4 gibba045 running (3h) 7m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 6033bb8eeb2f 2021-03-10T17:46:45.659 INFO:teuthology.orchestra.run.gibba015.stdout:osd.5 gibba045 running (3h) 7m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da ddf0533d3938 2021-03-10T17:46:45.659 INFO:teuthology.orchestra.run.gibba015.stdout:osd.6 gibba045 running (3h) 7m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 2f661a38189c 2021-03-10T17:46:45.659 INFO:teuthology.orchestra.run.gibba015.stdout:osd.7 gibba045 running (3h) 7m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 48829f2944d4 2021-03-10T17:46:45.659 INFO:teuthology.orchestra.run.gibba015.stdout:prometheus.a gibba045 running (4h) 7m ago 4h 2.25.0 prom/prometheus:latest a618f5685492 b3907fa26ba0 2021-03-10T17:46:45.660 INFO:teuthology.orchestra.run.gibba015.stdout:rgw.r.z.gibba045.atotkw gibba045 error 7m ago 4h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:46:45.900 INFO:teuthology.orchestra.run.gibba015.stdout:{ 2021-03-10T17:46:45.901 INFO:teuthology.orchestra.run.gibba015.stdout: "mon": { 2021-03-10T17:46:45.901 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:46:45.901 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:46:45.902 INFO:teuthology.orchestra.run.gibba015.stdout: "mgr": { 2021-03-10T17:46:45.902 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:46:45.902 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:46:45.902 INFO:teuthology.orchestra.run.gibba015.stdout: "osd": { 2021-03-10T17:46:45.903 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:46:45.903 INFO:teuthology.orchestra.run.gibba015.stdout: }, 2021-03-10T17:46:45.903 INFO:teuthology.orchestra.run.gibba015.stdout: "mds": {}, 2021-03-10T17:46:45.903 INFO:teuthology.orchestra.run.gibba015.stdout: "overall": { 2021-03-10T17:46:45.903 INFO:teuthology.orchestra.run.gibba015.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:46:45.904 INFO:teuthology.orchestra.run.gibba015.stdout: } 2021-03-10T17:46:45.904 INFO:teuthology.orchestra.run.gibba015.stdout:} 2021-03-10T17:46:46.223 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:46:45 gibba015 bash[29377]: audit 2021-03-10T17:46:45.897737+0000 mon.c (mon.1) 3431 : audit [DBG] from='client.? 172.21.2.115:0/899534585' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:46:46.223 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:46:45 gibba015 bash[30343]: audit 2021-03-10T17:46:45.897737+0000 mon.c (mon.1) 3431 : audit [DBG] from='client.? 172.21.2.115:0/899534585' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:46:46.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:46:45 gibba045 bash[25517]: audit 2021-03-10T17:46:45.897737+0000 mon.c (mon.1) 3431 : audit [DBG] from='client.? 172.21.2.115:0/899534585' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:46:46.978 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:46:46 gibba045 bash[25517]: audit 2021-03-10T17:46:45.418118+0000 mgr.gibba045.orlgmj (mgr.34412) 12533 : audit [DBG] from='client.62443 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:46:46.979 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:46:46 gibba045 bash[25517]: cluster 2021-03-10T17:46:45.433579+0000 mgr.gibba045.orlgmj (mgr.34412) 12534 : cluster [DBG] pgmap v7146: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:46.979 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:46:46 gibba045 bash[25517]: audit 2021-03-10T17:46:45.640112+0000 mgr.gibba045.orlgmj (mgr.34412) 12535 : audit [DBG] from='client.62449 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:46:47.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:46:46 gibba015 bash[29377]: audit 2021-03-10T17:46:45.418118+0000 mgr.gibba045.orlgmj (mgr.34412) 12533 : audit [DBG] from='client.62443 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:46:47.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:46:46 gibba015 bash[29377]: cluster 2021-03-10T17:46:45.433579+0000 mgr.gibba045.orlgmj (mgr.34412) 12534 : cluster [DBG] pgmap v7146: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:47.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:46:46 gibba015 bash[29377]: audit 2021-03-10T17:46:45.640112+0000 mgr.gibba045.orlgmj (mgr.34412) 12535 : audit [DBG] from='client.62449 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:46:47.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:46:46 gibba015 bash[30343]: audit 2021-03-10T17:46:45.418118+0000 mgr.gibba045.orlgmj (mgr.34412) 12533 : audit [DBG] from='client.62443 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:46:47.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:46:46 gibba015 bash[30343]: cluster 2021-03-10T17:46:45.433579+0000 mgr.gibba045.orlgmj (mgr.34412) 12534 : cluster [DBG] pgmap v7146: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:47.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:46:46 gibba015 bash[30343]: audit 2021-03-10T17:46:45.640112+0000 mgr.gibba045.orlgmj (mgr.34412) 12535 : audit [DBG] from='client.62449 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:46:48.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:46:47 gibba045 bash[25517]: cephadm 2021-03-10T17:46:46.533247+0000 mgr.gibba045.orlgmj (mgr.34412) 12536 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:46:48.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:46:47 gibba015 bash[29377]: cephadm 2021-03-10T17:46:46.533247+0000 mgr.gibba045.orlgmj (mgr.34412) 12536 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:46:48.473 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:46:47 gibba015 bash[30343]: cephadm 2021-03-10T17:46:46.533247+0000 mgr.gibba045.orlgmj (mgr.34412) 12536 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba045.atotkw'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba045.atotkw']. 2021-03-10T17:46:49.307 INFO:journalctl@ceph.mon.b.gibba045.stdout:Mar 10 17:46:48 gibba045 bash[25517]: cluster 2021-03-10T17:46:47.435456+0000 mgr.gibba045.orlgmj (mgr.34412) 12537 : cluster [DBG] pgmap v7147: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:49.473 INFO:journalctl@ceph.mon.a.gibba015.stdout:Mar 10 17:46:48 gibba015 bash[29377]: cluster 2021-03-10T17:46:47.435456+0000 mgr.gibba045.orlgmj (mgr.34412) 12537 : cluster [DBG] pgmap v7147: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:49.474 INFO:journalctl@ceph.mon.c.gibba015.stdout:Mar 10 17:46:48 gibba015 bash[30343]: cluster 2021-03-10T17:46:47.435456+0000 mgr.gibba045.orlgmj (mgr.34412) 12537 : cluster [DBG] pgmap v7147: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:50.126 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2021-03-10T17:46:50.129 DEBUG:teuthology.task.console_log:Killing console logger for gibba015 2021-03-10T17:46:50.130 DEBUG:teuthology.task.console_log:Killing console logger for gibba045 2021-03-10T17:46:50.131 DEBUG:teuthology.exit:Finished running handlers